2024-04-26T17:40:56.517 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T17:40:56.518 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} --name leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi --verbose --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896 -- /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896/orig.config.yaml 2024-04-26T17:40:56.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T17:40:56.673 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896 branch: wip-lusov-quiescer-fixes description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: null first_in_suite: false job_id: '7674896' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer-fixes ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer-fixes sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9496 sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer-fixes suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCcBMxZ5PR3K2WuwyLaphFskuLZxb7KDiKoiMuXPGj3LdVa8O05Q7DM8xxbZCYnGUlroftllbYvvX2ZwYWe/Trk= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/cMG0NW96dS7uNOTA1J8lMsqhySopl8pFL/u2ABZGHA+cQugFffFpajeT2IxWcBAZRRVSP8nHlmclp9zOnFi8= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBs6qhK6cP6GfWskahZ5zdUCWGLP5eGfCPFs301HBYiIbIpk+OZcnQB/T71k3lV8CLZUsjB1td1wzLBPvSYfDk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_17:24:23 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T17:40:56.673 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa; will attempt to use it 2024-04-26T17:40:56.674 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks 2024-04-26T17:40:56.674 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T17:40:56.675 INFO:teuthology.task.internal:Checking packages... 2024-04-26T17:40:56.700 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1' 2024-04-26T17:40:56.701 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T17:40:56.701 INFO:teuthology.packaging:ref: None 2024-04-26T17:40:56.701 INFO:teuthology.packaging:tag: None 2024-04-26T17:40:56.701 INFO:teuthology.packaging:branch: wip-lusov-quiescer-fixes 2024-04-26T17:40:56.701 INFO:teuthology.packaging:sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:40:56.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer-fixes 2024-04-26T17:40:56.931 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3267.gbc94a2a9 2024-04-26T17:40:56.932 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T17:40:56.938 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T17:40:56.939 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T17:40:56.944 INFO:teuthology.task.internal:Saving configuration 2024-04-26T17:40:56.966 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T17:40:56.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T17:40:56.998 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:35:44.185576', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCcBMxZ5PR3K2WuwyLaphFskuLZxb7KDiKoiMuXPGj3LdVa8O05Q7DM8xxbZCYnGUlroftllbYvvX2ZwYWe/Trk='} 2024-04-26T17:40:57.020 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:35:44.181914', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/cMG0NW96dS7uNOTA1J8lMsqhySopl8pFL/u2ABZGHA+cQugFffFpajeT2IxWcBAZRRVSP8nHlmclp9zOnFi8='} 2024-04-26T17:40:57.043 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:35:44.183842', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIBs6qhK6cP6GfWskahZ5zdUCWGLP5eGfCPFs301HBYiIbIpk+OZcnQB/T71k3lV8CLZUsjB1td1wzLBPvSYfDk='} 2024-04-26T17:40:57.043 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T17:40:57.048 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-26T17:40:57.048 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-26T17:40:57.048 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-26T17:40:57.048 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T17:40:57.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f02ecf5d0d0>, signals=[15]) 2024-04-26T17:40:57.151 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T17:40:57.157 INFO:teuthology.task.internal:Opening connections... 2024-04-26T17:40:57.158 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:40:57.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:40:57.239 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2024-04-26T17:40:57.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:40:57.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-04-26T17:40:57.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:40:57.390 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T17:40:57.397 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-04-26T17:40:57.415 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-04-26T17:40:57.415 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:40:57.471 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:40:57.472 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:40:57.472 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:40:57.472 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:40:57.472 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:40:57.472 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-04-26T17:40:57.505 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-04-26T17:40:57.524 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-04-26T17:40:57.524 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-26T17:40:57.580 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:40:57.581 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:40:57.582 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:40:57.582 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-26T17:40:57.614 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-04-26T17:40:57.632 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-04-26T17:40:57.633 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:40:57.690 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:40:57.691 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:40:57.691 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-04-26T17:40:57.721 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T17:40:57.732 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T17:40:57.737 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T17:40:57.737 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:40:57.740 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:40:57.742 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:40:57.759 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T17:40:57.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T17:40:57.765 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:40:57.796 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:40:57.800 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:40:57.896 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T17:40:57.959 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T17:40:57.975 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-26T17:40:57.975 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-26T17:40:57.975 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-26T17:40:57.976 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:40:57.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:40:57.992 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-04-26T17:40:58.048 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-437.el9.x86_64 2024-04-26T17:40:58.049 INFO:teuthology.task.kernel:Running kernel on smithi092: 5.14.0-437.el9.x86_64 2024-04-26T17:40:58.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2024-04-26T17:41:01.183 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.0 MB 00:01 2024-04-26T17:41:03.035 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-26T17:41:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-04-26T17:41:09.360 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 16 kB 00:01 2024-04-26T17:41:10.914 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-26T17:41:15.952 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T17:41:17.817 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T17:41:17.817 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T17:41:17.912 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-04-26T17:41:17.913 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-04-26T17:41:17.913 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-04-26T17:41:18.014 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2024-04-26T17:41:18.513 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 05:41:15 PM UTC. 2024-04-26T17:41:18.642 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalling: 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:41:18.652 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 255 k 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 0 2024-04-26T17:41:18.653 INFO:teuthology.orchestra.run.smithi092.stderr:Operation aborted. 2024-04-26T17:41:18.710 INFO:teuthology.orchestra.run.smithi092.stdout:Is this ok [y/N]: 2024-04-26T17:41:18.710 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2024-04-26T17:41:19.225 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 05:41:15 PM UTC. 2024-04-26T17:41:19.352 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout: Package Architecture Version Repository Size 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalling: 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:================================================================================ 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 255 k 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:Installed size: 0 2024-04-26T17:41:19.353 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-04-26T17:41:19.745 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-437.el9.x86_64.rpm 791 kB/s | 255 kB 00:00 2024-04-26T17:41:19.746 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:41:19.746 INFO:teuthology.orchestra.run.smithi092.stdout:Total 650 kB/s | 255 kB 00:00 2024-04-26T17:41:19.767 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-04-26T17:41:19.953 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-04-26T17:41:19.953 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-04-26T17:41:19.958 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-04-26T17:41:19.958 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-04-26T17:41:20.088 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-04-26T17:41:20.155 INFO:teuthology.orchestra.run.smithi092.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:41:20.155 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:41:20.838 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:41:20.838 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout:Reinstalled: 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:41:21.508 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-04-26T17:41:21.700 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T17:41:21.746 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T17:41:21.747 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T17:41:21.747 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T17:41:21.747 DEBUG:teuthology.parallel:result is None 2024-04-26T17:41:21.747 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T17:41:21.755 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T17:41:21.755 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:41:21.758 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:41:21.760 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:41:21.778 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T17:41:21.784 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T17:41:21.790 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T17:41:21.791 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:41:21.812 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:41:21.819 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:41:22.117 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T17:41:22.215 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T17:41:22.216 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:41:22.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:41:22.233 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:41:22.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:41:22.251 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:41:22.253 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:41:22.304 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:41:22.304 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.324 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.337 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.366 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.372 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.400 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:41:22.403 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T17:41:22.525 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T17:41:22.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:41:22.534 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:41:22.544 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:41:22.573 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T17:41:22.840 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T17:41:22.840 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:41:22.843 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:41:22.846 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:41:22.863 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:22.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:22.993 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.120 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:41:23.121 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:41:23.187 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:23.227 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:23.285 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.367 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.413 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:41:23.413 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:41:23.479 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:23.519 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:41:23.587 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.623 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:41:23.670 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:41:23.670 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:41:23.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-04-26T17:41:23.738 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2024-04-26T17:41:23.740 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-04-26T17:41:23.774 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:41:23.775 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:41:23.809 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:41:24.278 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T17:41:24.286 INFO:teuthology.task.internal:Starting timer... 2024-04-26T17:41:24.286 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T17:41:24.296 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T17:41:24.304 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-26T17:41:24.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-04-26T17:41:24.377 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-04-26T17:41:24.379 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2024-04-26T17:41:24.452 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2024-04-26T17:41:24.454 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-04-26T17:41:24.539 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-04-26T17:41:24.541 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T17:41:24.541 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-04-26T17:41:24.561 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-04-26T17:41:24.561 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2024-04-26T17:41:24.593 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2024-04-26T17:41:24.593 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-04-26T17:41:24.623 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-04-26T17:41:24.623 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-04-26T17:41:24.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:41:24.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:41:24.650 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:41:24.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:41:24.678 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:41:24.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:41:24.703 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T17:41:24.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:41:24.727 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:41:24.753 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:41:24.778 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T17:41:24.787 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T17:41:24.793 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T17:41:24.948 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T17:41:24.965 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T17:41:24.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi092.front.sepia.ceph.com,smithi156.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T17:45:16.106 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-04-26T17:45:16.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-26T17:45:16.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:45:16.187 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-04-26T17:45:16.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-26T17:45:16.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-26T17:45:16.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:45:16.336 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-26T17:45:16.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-26T17:45:16.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-26T17:45:16.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:45:16.489 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-04-26T17:45:16.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-04-26T17:45:16.565 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T17:45:16.578 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T17:45:16.578 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:45:16.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:45:16.581 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:45:16.581 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:45:16.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:45:16.584 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:45:16.609 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:45:16.609 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:45:16.623 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:45:16.623 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:45:16.633 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:45:16.645 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2024-04-26T17:45:16.646 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-04-26T17:45:16.647 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:45:16.655 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2024-04-26T17:45:16.656 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-04-26T17:45:16.668 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:45:16.669 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-04-26T17:45:16.669 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:45:16.679 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-04-26T17:45:16.681 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:45:16.683 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:45:16.692 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:45:16.705 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:45:16.736 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:45:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.740 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.741 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.760 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.764 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:45:16.765 INFO:teuthology.run_tasks:Running task install... 2024-04-26T17:45:16.774 DEBUG:teuthology.task.install:project ceph 2024-04-26T17:45:16.774 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}} 2024-04-26T17:45:16.774 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'} 2024-04-26T17:45:16.774 INFO:teuthology.task.install:Using flavor: default 2024-04-26T17:45:16.780 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T17:45:16.781 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T17:45:16.781 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:45:16.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:45:16.783 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:45:16.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:45:16.785 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:45:16.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:45:17.013 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:45:17.013 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:45:17.020 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:45:17.020 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:45:17.031 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:45:17.031 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:45:17.181 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:45:17.182 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:45:17.182 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:45:17.189 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:45:17.189 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:45:17.189 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:45:17.199 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:45:17.199 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:45:17.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:45:17.208 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:45:17.209 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:45:17.214 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:45:17.214 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:45:17.224 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:45:17.224 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:45:17.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:45:17.279 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:45:17.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:45:17.349 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:45:17.352 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:45:17.362 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:45:17.413 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2024-04-26T17:45:17.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2024-04-26T17:45:17.415 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-04-26T17:45:17.416 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-04-26T17:45:17.425 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-04-26T17:45:17.426 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-04-26T17:45:17.642 INFO:teuthology.orchestra.run.smithi156.stdout:48 files removed 2024-04-26T17:45:17.643 INFO:teuthology.orchestra.run.smithi189.stdout:48 files removed 2024-04-26T17:45:17.648 INFO:teuthology.orchestra.run.smithi092.stdout:48 files removed 2024-04-26T17:45:17.668 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:45:17.670 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:45:17.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:45:18.344 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 204 kB/s | 84 kB 00:00 2024-04-26T17:45:18.404 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-04-26T17:45:18.419 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 172 kB/s | 84 kB 00:00 2024-04-26T17:45:18.703 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-04-26T17:45:18.753 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 40 kB/s | 12 kB 00:00 2024-04-26T17:45:18.804 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-04-26T17:45:19.062 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2024-04-26T17:45:19.112 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-26T17:45:19.238 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-26T17:45:19.546 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-04-26T17:45:19.772 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-26T17:45:19.787 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-26T17:45:21.547 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-04-26T17:45:21.615 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-26T17:45:23.938 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-04-26T17:45:25.714 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T17:45:26.749 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-04-26T17:45:27.373 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-26T17:45:28.071 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T17:45:28.250 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-04-26T17:45:28.775 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T17:45:29.638 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-26T17:45:30.595 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 21 MB 00:02 2024-04-26T17:45:32.915 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-04-26T17:45:33.841 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T17:45:35.734 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-26T17:45:35.951 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:35.951 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:35.962 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:45:35.963 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:45:35.964 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:45:35.965 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:45:35.966 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:45:35.968 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:45:35.969 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:45:36.032 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:45:36.042 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:45:36.043 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:45:36.044 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:45:36.045 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:45:36.046 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:45:36.047 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:45:36.048 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:45:36.049 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:45:36.050 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:45:36.051 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:45:36.052 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout:======================================================================================= 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout:Install 148 Packages 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 4 Packages 2024-04-26T17:45:36.053 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:45:36.054 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 222 M 2024-04-26T17:45:36.054 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-04-26T17:45:36.976 INFO:teuthology.orchestra.run.smithi156.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-26T17:45:37.176 INFO:teuthology.orchestra.run.smithi156.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 4.3 MB/s | 890 kB 00:00 2024-04-26T17:45:37.243 INFO:teuthology.orchestra.run.smithi156.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 2.1 MB/s | 145 kB 00:00 2024-04-26T17:45:37.568 INFO:teuthology.orchestra.run.smithi156.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 7.1 MB/s | 5.4 MB 00:00 2024-04-26T17:45:37.618 INFO:teuthology.orchestra.run.smithi156.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 6.3 MB/s | 2.4 MB 00:00 2024-04-26T17:45:37.752 INFO:teuthology.orchestra.run.smithi156.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-04-26T17:45:37.919 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:37.920 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:37.931 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:45:37.932 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:45:37.933 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:45:37.934 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:45:37.935 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:45:37.938 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:45:37.939 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:45:38.000 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-04-26T17:45:38.014 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T17:45:38.017 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:45:38.018 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:45:38.019 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:45:38.020 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:45:38.021 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:45:38.022 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:45:38.023 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:45:38.024 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:45:38.025 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:45:38.026 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:45:38.027 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:45:38.028 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout:Install 148 Packages 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 4 Packages 2024-04-26T17:45:38.029 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:45:38.030 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 222 M 2024-04-26T17:45:38.030 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-04-26T17:45:38.294 INFO:teuthology.orchestra.run.smithi156.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 7.0 MB/s | 4.7 MB 00:00 2024-04-26T17:45:38.786 INFO:teuthology.orchestra.run.smithi189.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-26T17:45:38.986 INFO:teuthology.orchestra.run.smithi156.stdout:(8/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 9.7 MB/s | 21 MB 00:02 2024-04-26T17:45:39.053 INFO:teuthology.orchestra.run.smithi156.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 378 kB/s | 25 kB 00:00 2024-04-26T17:45:39.503 INFO:teuthology.orchestra.run.smithi189.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.2 MB/s | 890 kB 00:00 2024-04-26T17:45:39.536 INFO:teuthology.orchestra.run.smithi156.stdout:(10/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 9.4 MB/s | 17 MB 00:01 2024-04-26T17:45:39.611 INFO:teuthology.orchestra.run.smithi156.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 2.9 MB/s | 224 kB 00:00 2024-04-26T17:45:39.644 INFO:teuthology.orchestra.run.smithi189.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.0 MB/s | 145 kB 00:00 2024-04-26T17:45:39.678 INFO:teuthology.orchestra.run.smithi156.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 406 kB/s | 27 kB 00:00 2024-04-26T17:45:39.746 INFO:teuthology.orchestra.run.smithi156.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 476 kB/s | 32 kB 00:00 2024-04-26T17:45:39.895 INFO:teuthology.orchestra.run.smithi156.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 4.9 MB/s | 746 kB 00:00 2024-04-26T17:45:39.979 INFO:teuthology.orchestra.run.smithi156.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.9 MB/s | 163 kB 00:00 2024-04-26T17:45:40.071 INFO:teuthology.orchestra.run.smithi156.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.4 MB/s | 127 kB 00:00 2024-04-26T17:45:40.149 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:40.150 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:45:40.160 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:45:40.161 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:45:40.162 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:45:40.163 INFO:teuthology.orchestra.run.smithi156.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 5.4 MB/s | 501 kB 00:00 2024-04-26T17:45:40.163 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:45:40.165 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:45:40.167 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:45:40.168 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:45:40.229 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:45:40.238 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:45:40.239 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:45:40.240 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:45:40.241 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:45:40.242 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:45:40.243 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:45:40.244 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:45:40.245 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:45:40.246 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:45:40.247 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:45:40.248 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-04-26T17:45:40.249 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-04-26T17:45:40.250 INFO:teuthology.orchestra.run.smithi092.stdout:Install 148 Packages 2024-04-26T17:45:40.250 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 4 Packages 2024-04-26T17:45:40.250 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:45:40.250 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 222 M 2024-04-26T17:45:40.250 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-04-26T17:45:40.855 INFO:teuthology.orchestra.run.smithi156.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 7.8 MB/s | 5.4 MB 00:00 2024-04-26T17:45:40.930 INFO:teuthology.orchestra.run.smithi156.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 604 kB/s | 45 kB 00:00 2024-04-26T17:45:41.014 INFO:teuthology.orchestra.run.smithi156.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.6 MB/s | 135 kB 00:00 2024-04-26T17:45:41.139 INFO:teuthology.orchestra.run.smithi156.stdout:(21/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 3.7 MB/s | 11 MB 00:02 2024-04-26T17:45:41.164 INFO:teuthology.orchestra.run.smithi156.stdout:(22/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.0 MB/s | 162 kB 00:00 2024-04-26T17:45:41.248 INFO:teuthology.orchestra.run.smithi156.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T17:45:41.282 INFO:teuthology.orchestra.run.smithi156.stdout:(24/152): python3-rados-19.0.0-3267.gbc94a2a9.e 2.2 MB/s | 320 kB 00:00 2024-04-26T17:45:41.307 INFO:teuthology.orchestra.run.smithi156.stdout:(25/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.7 MB/s | 99 kB 00:00 2024-04-26T17:45:41.341 INFO:teuthology.orchestra.run.smithi156.stdout:(26/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T17:45:41.424 INFO:teuthology.orchestra.run.smithi156.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-26T17:45:41.500 INFO:teuthology.orchestra.run.smithi156.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 456 kB/s | 34 kB 00:00 2024-04-26T17:45:41.515 INFO:teuthology.orchestra.run.smithi092.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-04-26T17:45:41.520 INFO:teuthology.orchestra.run.smithi189.stdout:(4/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 7.0 MB/s | 21 MB 00:03 2024-04-26T17:45:41.570 INFO:teuthology.orchestra.run.smithi189.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 1.2 MB/s | 2.4 MB 00:01 2024-04-26T17:45:41.583 INFO:teuthology.orchestra.run.smithi156.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.7 MB/s | 142 kB 00:00 2024-04-26T17:45:41.633 INFO:teuthology.orchestra.run.smithi156.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 9.5 MB/s | 3.1 MB 00:00 2024-04-26T17:45:42.020 INFO:teuthology.orchestra.run.smithi189.stdout:(6/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-04-26T17:45:42.349 INFO:teuthology.orchestra.run.smithi092.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.0 MB/s | 890 kB 00:00 2024-04-26T17:45:42.570 INFO:teuthology.orchestra.run.smithi189.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 4.7 MB/s | 4.7 MB 00:00 2024-04-26T17:45:42.590 INFO:teuthology.orchestra.run.smithi092.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 598 kB/s | 145 kB 00:00 2024-04-26T17:45:42.667 INFO:teuthology.orchestra.run.smithi156.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 7.2 MB/s | 7.4 MB 00:01 2024-04-26T17:45:42.784 INFO:teuthology.orchestra.run.smithi156.stdout:(32/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 2.9 MB/s | 3.5 MB 00:01 2024-04-26T17:45:42.809 INFO:teuthology.orchestra.run.smithi156.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3267.gbc 1.7 MB/s | 249 kB 00:00 2024-04-26T17:45:42.860 INFO:teuthology.orchestra.run.smithi156.stdout:(34/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 656 kB/s | 49 kB 00:00 2024-04-26T17:45:42.877 INFO:teuthology.orchestra.run.smithi156.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3267.gb 245 kB/s | 16 kB 00:00 2024-04-26T17:45:42.912 INFO:teuthology.orchestra.run.smithi189.stdout:(8/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-04-26T17:45:42.994 INFO:teuthology.orchestra.run.smithi156.stdout:(36/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 2.0 MB/s | 273 kB 00:00 2024-04-26T17:45:43.004 INFO:teuthology.orchestra.run.smithi189.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 276 kB/s | 25 kB 00:00 2024-04-26T17:45:43.044 INFO:teuthology.orchestra.run.smithi156.stdout:(37/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 4.4 MB/s | 762 kB 00:00 2024-04-26T17:45:43.061 INFO:teuthology.orchestra.run.smithi156.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 272 kB/s | 18 kB 00:00 2024-04-26T17:45:43.212 INFO:teuthology.orchestra.run.smithi156.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-04-26T17:45:43.304 INFO:teuthology.orchestra.run.smithi156.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T17:45:43.379 INFO:teuthology.orchestra.run.smithi156.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-26T17:45:43.404 INFO:teuthology.orchestra.run.smithi156.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-26T17:45:43.407 INFO:teuthology.orchestra.run.smithi092.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 2.3 MB/s | 5.4 MB 00:02 2024-04-26T17:45:43.454 INFO:teuthology.orchestra.run.smithi156.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T17:45:43.457 INFO:teuthology.orchestra.run.smithi092.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.7 MB/s | 2.4 MB 00:00 2024-04-26T17:45:43.538 INFO:teuthology.orchestra.run.smithi156.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-26T17:45:43.588 INFO:teuthology.orchestra.run.smithi156.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T17:45:43.672 INFO:teuthology.orchestra.run.smithi156.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-26T17:45:43.708 INFO:teuthology.orchestra.run.smithi156.stdout:(47/152): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-04-26T17:45:43.708 INFO:teuthology.orchestra.run.smithi092.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-04-26T17:45:43.850 INFO:teuthology.orchestra.run.smithi156.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-04-26T17:45:43.908 INFO:teuthology.orchestra.run.smithi156.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T17:45:43.967 INFO:teuthology.orchestra.run.smithi156.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-04-26T17:45:43.992 INFO:teuthology.orchestra.run.smithi156.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-04-26T17:45:44.042 INFO:teuthology.orchestra.run.smithi156.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-04-26T17:45:44.093 INFO:teuthology.orchestra.run.smithi156.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-04-26T17:45:44.143 INFO:teuthology.orchestra.run.smithi156.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-26T17:45:44.202 INFO:teuthology.orchestra.run.smithi156.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-04-26T17:45:44.285 INFO:teuthology.orchestra.run.smithi156.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-26T17:45:44.336 INFO:teuthology.orchestra.run.smithi156.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-04-26T17:45:44.404 INFO:teuthology.orchestra.run.smithi189.stdout:(10/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 5.8 MB/s | 11 MB 00:01 2024-04-26T17:45:44.424 INFO:teuthology.orchestra.run.smithi092.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 4.9 MB/s | 4.7 MB 00:00 2024-04-26T17:45:44.511 INFO:teuthology.orchestra.run.smithi156.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-26T17:45:44.563 INFO:teuthology.orchestra.run.smithi189.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.4 MB/s | 224 kB 00:00 2024-04-26T17:45:44.661 INFO:teuthology.orchestra.run.smithi156.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-04-26T17:45:44.663 INFO:teuthology.orchestra.run.smithi189.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 270 kB/s | 27 kB 00:00 2024-04-26T17:45:44.712 INFO:teuthology.orchestra.run.smithi156.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-04-26T17:45:44.737 INFO:teuthology.orchestra.run.smithi156.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-26T17:45:44.755 INFO:teuthology.orchestra.run.smithi189.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 346 kB/s | 32 kB 00:00 2024-04-26T17:45:45.005 INFO:teuthology.orchestra.run.smithi189.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 2.9 MB/s | 746 kB 00:00 2024-04-26T17:45:45.106 INFO:teuthology.orchestra.run.smithi189.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.6 MB/s | 163 kB 00:00 2024-04-26T17:45:45.171 INFO:teuthology.orchestra.run.smithi156.stdout:(62/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 8.0 MB/s | 49 MB 00:06 2024-04-26T17:45:45.195 INFO:teuthology.orchestra.run.smithi156.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 98 kB/s | 47 kB 00:00 2024-04-26T17:45:45.222 INFO:teuthology.orchestra.run.smithi189.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.1 MB/s | 127 kB 00:00 2024-04-26T17:45:45.229 INFO:teuthology.orchestra.run.smithi156.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 594 kB/s | 292 kB 00:00 2024-04-26T17:45:45.254 INFO:teuthology.orchestra.run.smithi156.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-26T17:45:45.356 INFO:teuthology.orchestra.run.smithi189.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 3.7 MB/s | 501 kB 00:00 2024-04-26T17:45:45.371 INFO:teuthology.orchestra.run.smithi156.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 940 kB/s | 188 kB 00:00 2024-04-26T17:45:45.458 INFO:teuthology.orchestra.run.smithi092.stdout:(8/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x86 9.6 MB/s | 17 MB 00:01 2024-04-26T17:45:45.516 INFO:teuthology.orchestra.run.smithi092.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 434 kB/s | 25 kB 00:00 2024-04-26T17:45:45.658 INFO:teuthology.orchestra.run.smithi092.stdout:(10/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 8.6 MB/s | 11 MB 00:01 2024-04-26T17:45:45.742 INFO:teuthology.orchestra.run.smithi092.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 2.6 MB/s | 224 kB 00:00 2024-04-26T17:45:45.755 INFO:teuthology.orchestra.run.smithi156.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-04-26T17:45:45.809 INFO:teuthology.orchestra.run.smithi092.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 406 kB/s | 27 kB 00:00 2024-04-26T17:45:45.876 INFO:teuthology.orchestra.run.smithi092.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 476 kB/s | 32 kB 00:00 2024-04-26T17:45:45.989 INFO:teuthology.orchestra.run.smithi156.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 3.8 MB/s | 911 kB 00:00 2024-04-26T17:45:46.026 INFO:teuthology.orchestra.run.smithi092.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 4.9 MB/s | 746 kB 00:00 2024-04-26T17:45:46.039 INFO:teuthology.orchestra.run.smithi189.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 7.9 MB/s | 5.4 MB 00:00 2024-04-26T17:45:46.047 INFO:teuthology.orchestra.run.smithi156.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-26T17:45:46.102 INFO:teuthology.orchestra.run.smithi092.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 2.1 MB/s | 163 kB 00:00 2024-04-26T17:45:46.106 INFO:teuthology.orchestra.run.smithi189.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 679 kB/s | 45 kB 00:00 2024-04-26T17:45:46.160 INFO:teuthology.orchestra.run.smithi092.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 2.1 MB/s | 127 kB 00:00 2024-04-26T17:45:46.181 INFO:teuthology.orchestra.run.smithi156.stdout:(70/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-04-26T17:45:46.182 INFO:teuthology.orchestra.run.smithi189.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.8 MB/s | 135 kB 00:00 2024-04-26T17:45:46.248 INFO:teuthology.orchestra.run.smithi156.stdout:(71/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.7 MB/s | 4.7 MB 00:01 2024-04-26T17:45:46.252 INFO:teuthology.orchestra.run.smithi092.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 5.3 MB/s | 501 kB 00:00 2024-04-26T17:45:46.265 INFO:teuthology.orchestra.run.smithi189.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.9 MB/s | 162 kB 00:00 2024-04-26T17:45:46.307 INFO:teuthology.orchestra.run.smithi156.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T17:45:46.365 INFO:teuthology.orchestra.run.smithi189.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 3.1 MB/s | 320 kB 00:00 2024-04-26T17:45:46.457 INFO:teuthology.orchestra.run.smithi156.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-04-26T17:45:46.466 INFO:teuthology.orchestra.run.smithi189.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 2.9 MB/s | 298 kB 00:00 2024-04-26T17:45:46.548 INFO:teuthology.orchestra.run.smithi156.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-26T17:45:46.557 INFO:teuthology.orchestra.run.smithi189.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T17:45:46.632 INFO:teuthology.orchestra.run.smithi156.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-26T17:45:46.649 INFO:teuthology.orchestra.run.smithi189.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 932 kB/s | 85 kB 00:00 2024-04-26T17:45:46.691 INFO:teuthology.orchestra.run.smithi156.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-04-26T17:45:46.741 INFO:teuthology.orchestra.run.smithi156.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-04-26T17:45:46.825 INFO:teuthology.orchestra.run.smithi156.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T17:45:46.875 INFO:teuthology.orchestra.run.smithi156.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-04-26T17:45:46.944 INFO:teuthology.orchestra.run.smithi092.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 7.8 MB/s | 5.4 MB 00:00 2024-04-26T17:45:47.027 INFO:teuthology.orchestra.run.smithi092.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 544 kB/s | 45 kB 00:00 2024-04-26T17:45:47.067 INFO:teuthology.orchestra.run.smithi156.stdout:(80/152): python3-babel-2.9.1-2.el9.noarch.rpm 7.8 MB/s | 6.0 MB 00:00 2024-04-26T17:45:47.111 INFO:teuthology.orchestra.run.smithi092.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.6 MB/s | 135 kB 00:00 2024-04-26T17:45:47.126 INFO:teuthology.orchestra.run.smithi156.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-26T17:45:47.184 INFO:teuthology.orchestra.run.smithi156.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-26T17:45:47.191 INFO:teuthology.orchestra.run.smithi189.stdout:(26/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 5.7 MB/s | 3.1 MB 00:00 2024-04-26T17:45:47.194 INFO:teuthology.orchestra.run.smithi092.stdout:(21/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.9 MB/s | 162 kB 00:00 2024-04-26T17:45:47.250 INFO:teuthology.orchestra.run.smithi189.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-26T17:45:47.286 INFO:teuthology.orchestra.run.smithi092.stdout:(22/152): python3-rados-19.0.0-3267.gbc94a2a9.e 3.4 MB/s | 320 kB 00:00 2024-04-26T17:45:47.335 INFO:teuthology.orchestra.run.smithi156.stdout:(83/152): postgresql-server-13.14-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-04-26T17:45:47.351 INFO:teuthology.orchestra.run.smithi189.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 341 kB/s | 34 kB 00:00 2024-04-26T17:45:47.360 INFO:teuthology.orchestra.run.smithi156.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 440 kB/s | 77 kB 00:00 2024-04-26T17:45:47.370 INFO:teuthology.orchestra.run.smithi092.stdout:(23/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T17:45:47.376 INFO:teuthology.orchestra.run.smithi156.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-04-26T17:45:47.418 INFO:teuthology.orchestra.run.smithi189.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 2.1 MB/s | 142 kB 00:00 2024-04-26T17:45:47.435 INFO:teuthology.orchestra.run.smithi156.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-04-26T17:45:47.454 INFO:teuthology.orchestra.run.smithi092.stdout:(24/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.2 MB/s | 99 kB 00:00 2024-04-26T17:45:47.469 INFO:teuthology.orchestra.run.smithi156.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-26T17:45:47.527 INFO:teuthology.orchestra.run.smithi156.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-04-26T17:45:47.546 INFO:teuthology.orchestra.run.smithi092.stdout:(25/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 933 kB/s | 85 kB 00:00 2024-04-26T17:45:47.553 INFO:teuthology.orchestra.run.smithi156.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 612 kB/s | 51 kB 00:00 2024-04-26T17:45:47.578 INFO:teuthology.orchestra.run.smithi156.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T17:45:47.628 INFO:teuthology.orchestra.run.smithi156.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 837 kB/s | 42 kB 00:00 2024-04-26T17:45:47.679 INFO:teuthology.orchestra.run.smithi156.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-04-26T17:45:47.762 INFO:teuthology.orchestra.run.smithi156.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-26T17:45:47.812 INFO:teuthology.orchestra.run.smithi156.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-04-26T17:45:47.880 INFO:teuthology.orchestra.run.smithi156.stdout:(95/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.1 MB/s | 5.1 MB 00:01 2024-04-26T17:45:47.905 INFO:teuthology.orchestra.run.smithi156.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-04-26T17:45:47.963 INFO:teuthology.orchestra.run.smithi156.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-04-26T17:45:47.971 INFO:teuthology.orchestra.run.smithi092.stdout:(26/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 7.3 MB/s | 3.1 MB 00:00 2024-04-26T17:45:47.988 INFO:teuthology.orchestra.run.smithi156.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-26T17:45:48.022 INFO:teuthology.orchestra.run.smithi156.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-26T17:45:48.038 INFO:teuthology.orchestra.run.smithi092.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.5 MB/s | 170 kB 00:00 2024-04-26T17:45:48.043 INFO:teuthology.orchestra.run.smithi189.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 5.7 MB/s | 3.5 MB 00:00 2024-04-26T17:45:48.047 INFO:teuthology.orchestra.run.smithi156.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T17:45:48.081 INFO:teuthology.orchestra.run.smithi156.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-04-26T17:45:48.105 INFO:teuthology.orchestra.run.smithi092.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 512 kB/s | 34 kB 00:00 2024-04-26T17:45:48.106 INFO:teuthology.orchestra.run.smithi156.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2024-04-26T17:45:48.189 INFO:teuthology.orchestra.run.smithi092.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.7 MB/s | 142 kB 00:00 2024-04-26T17:45:48.290 INFO:teuthology.orchestra.run.smithi156.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-04-26T17:45:48.664 INFO:teuthology.orchestra.run.smithi092.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 7.5 MB/s | 3.5 MB 00:00 2024-04-26T17:45:48.840 INFO:teuthology.orchestra.run.smithi156.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 747 kB/s | 548 kB 00:00 2024-04-26T17:45:48.958 INFO:teuthology.orchestra.run.smithi156.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-04-26T17:45:48.983 INFO:teuthology.orchestra.run.smithi156.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 446 kB/s | 309 kB 00:00 2024-04-26T17:45:49.100 INFO:teuthology.orchestra.run.smithi156.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 223 kB/s | 26 kB 00:00 2024-04-26T17:45:49.217 INFO:teuthology.orchestra.run.smithi156.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-04-26T17:45:49.334 INFO:teuthology.orchestra.run.smithi156.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 578 kB/s | 67 kB 00:00 2024-04-26T17:45:49.393 INFO:teuthology.orchestra.run.smithi156.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-26T17:45:49.435 INFO:teuthology.orchestra.run.smithi189.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2024-04-26T17:45:49.478 INFO:teuthology.orchestra.run.smithi156.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-26T17:45:49.502 INFO:teuthology.orchestra.run.smithi189.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 3.7 MB/s | 249 kB 00:00 2024-04-26T17:45:49.514 INFO:teuthology.orchestra.run.smithi092.stdout:(31/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 12 MB/s | 49 MB 00:03 2024-04-26T17:45:49.518 INFO:teuthology.orchestra.run.smithi156.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-04-26T17:45:49.544 INFO:teuthology.orchestra.run.smithi189.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 1.2 MB/s | 49 kB 00:00 2024-04-26T17:45:49.564 INFO:teuthology.orchestra.run.smithi092.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 4.9 MB/s | 249 kB 00:00 2024-04-26T17:45:49.586 INFO:teuthology.orchestra.run.smithi189.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 395 kB/s | 16 kB 00:00 2024-04-26T17:45:49.627 INFO:teuthology.orchestra.run.smithi156.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-04-26T17:45:49.644 INFO:teuthology.orchestra.run.smithi189.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 4.6 MB/s | 273 kB 00:00 2024-04-26T17:45:49.656 INFO:teuthology.orchestra.run.smithi092.stdout:(33/152): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-04-26T17:45:49.681 INFO:teuthology.orchestra.run.smithi092.stdout:(34/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 422 kB/s | 49 kB 00:00 2024-04-26T17:45:49.685 INFO:teuthology.orchestra.run.smithi156.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-26T17:45:49.707 INFO:teuthology.orchestra.run.smithi092.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3267.gb 329 kB/s | 16 kB 00:00 2024-04-26T17:45:49.736 INFO:teuthology.orchestra.run.smithi156.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-04-26T17:45:49.741 INFO:teuthology.orchestra.run.smithi092.stdout:(36/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 4.6 MB/s | 273 kB 00:00 2024-04-26T17:45:49.753 INFO:teuthology.orchestra.run.smithi189.stdout:(36/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-26T17:45:49.783 INFO:teuthology.orchestra.run.smithi092.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 439 kB/s | 18 kB 00:00 2024-04-26T17:45:49.794 INFO:teuthology.orchestra.run.smithi156.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-04-26T17:45:49.795 INFO:teuthology.orchestra.run.smithi189.stdout:(37/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 438 kB/s | 18 kB 00:00 2024-04-26T17:45:49.824 INFO:teuthology.orchestra.run.smithi092.stdout:(38/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-26T17:45:49.844 INFO:teuthology.orchestra.run.smithi156.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-26T17:45:49.883 INFO:teuthology.orchestra.run.smithi092.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 802 kB/s | 80 kB 00:00 2024-04-26T17:45:49.920 INFO:teuthology.orchestra.run.smithi156.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-26T17:45:49.933 INFO:teuthology.orchestra.run.smithi092.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-04-26T17:45:49.945 INFO:teuthology.orchestra.run.smithi189.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-04-26T17:45:49.953 INFO:teuthology.orchestra.run.smithi156.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-26T17:45:49.975 INFO:teuthology.orchestra.run.smithi092.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T17:45:50.020 INFO:teuthology.orchestra.run.smithi156.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-04-26T17:45:50.026 INFO:teuthology.orchestra.run.smithi092.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T17:45:50.062 INFO:teuthology.orchestra.run.smithi156.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 1.9 MB/s | 206 kB 00:00 2024-04-26T17:45:50.092 INFO:teuthology.orchestra.run.smithi092.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T17:45:50.143 INFO:teuthology.orchestra.run.smithi092.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-04-26T17:45:50.146 INFO:teuthology.orchestra.run.smithi189.stdout:(39/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 2.1 MB/s | 17 MB 00:08 2024-04-26T17:45:50.171 INFO:teuthology.orchestra.run.smithi156.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-26T17:45:50.184 INFO:teuthology.orchestra.run.smithi092.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-26T17:45:50.226 INFO:teuthology.orchestra.run.smithi092.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-26T17:45:50.277 INFO:teuthology.orchestra.run.smithi092.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-26T17:45:50.279 INFO:teuthology.orchestra.run.smithi189.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-04-26T17:45:50.344 INFO:teuthology.orchestra.run.smithi092.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-04-26T17:45:50.354 INFO:teuthology.orchestra.run.smithi189.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 938 kB/s | 195 kB 00:00 2024-04-26T17:45:50.355 INFO:teuthology.orchestra.run.smithi156.stdout:(123/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-04-26T17:45:50.371 INFO:teuthology.orchestra.run.smithi156.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 53 kB/s | 11 kB 00:00 2024-04-26T17:45:50.380 INFO:teuthology.orchestra.run.smithi189.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-26T17:45:50.403 INFO:teuthology.orchestra.run.smithi092.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 943 kB 00:00 2024-04-26T17:45:50.413 INFO:teuthology.orchestra.run.smithi156.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-04-26T17:45:50.430 INFO:teuthology.orchestra.run.smithi189.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T17:45:50.436 INFO:teuthology.orchestra.run.smithi092.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-04-26T17:45:50.455 INFO:teuthology.orchestra.run.smithi156.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2024-04-26T17:45:50.478 INFO:teuthology.orchestra.run.smithi092.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 287 kB/s | 21 kB 00:00 2024-04-26T17:45:50.489 INFO:teuthology.orchestra.run.smithi189.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T17:45:50.514 INFO:teuthology.orchestra.run.smithi156.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-26T17:45:50.528 INFO:teuthology.orchestra.run.smithi092.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-04-26T17:45:50.547 INFO:teuthology.orchestra.run.smithi189.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-26T17:45:50.553 INFO:teuthology.orchestra.run.smithi092.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-04-26T17:45:50.589 INFO:teuthology.orchestra.run.smithi156.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 184 kB/s | 20 kB 00:00 2024-04-26T17:45:50.604 INFO:teuthology.orchestra.run.smithi092.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-26T17:45:50.631 INFO:teuthology.orchestra.run.smithi189.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-26T17:45:50.646 INFO:teuthology.orchestra.run.smithi092.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-04-26T17:45:50.656 INFO:teuthology.orchestra.run.smithi156.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-26T17:45:50.698 INFO:teuthology.orchestra.run.smithi189.stdout:(47/152): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-04-26T17:45:50.698 INFO:teuthology.orchestra.run.smithi156.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 430 kB/s | 46 kB 00:00 2024-04-26T17:45:50.713 INFO:teuthology.orchestra.run.smithi092.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-04-26T17:45:50.765 INFO:teuthology.orchestra.run.smithi156.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 727 kB/s | 79 kB 00:00 2024-04-26T17:45:50.765 INFO:teuthology.orchestra.run.smithi092.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-04-26T17:45:50.790 INFO:teuthology.orchestra.run.smithi156.stdout:(132/152): python3-jaraco-collections-3.0.0-8.e 55 kB/s | 23 kB 00:00 2024-04-26T17:45:50.798 INFO:teuthology.orchestra.run.smithi189.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-04-26T17:45:50.824 INFO:teuthology.orchestra.run.smithi156.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 459 kB/s | 58 kB 00:00 2024-04-26T17:45:50.832 INFO:teuthology.orchestra.run.smithi092.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 380 kB/s | 45 kB 00:00 2024-04-26T17:45:50.857 INFO:teuthology.orchestra.run.smithi189.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T17:45:50.874 INFO:teuthology.orchestra.run.smithi156.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-04-26T17:45:50.890 INFO:teuthology.orchestra.run.smithi092.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-04-26T17:45:50.916 INFO:teuthology.orchestra.run.smithi156.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 130 kB/s | 16 kB 00:00 2024-04-26T17:45:50.941 INFO:teuthology.orchestra.run.smithi092.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 510 kB/s | 25 kB 00:00 2024-04-26T17:45:50.941 INFO:teuthology.orchestra.run.smithi156.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-04-26T17:45:50.957 INFO:teuthology.orchestra.run.smithi189.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-04-26T17:45:50.975 INFO:teuthology.orchestra.run.smithi156.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-04-26T17:45:50.982 INFO:teuthology.orchestra.run.smithi189.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-04-26T17:45:50.991 INFO:teuthology.orchestra.run.smithi092.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-04-26T17:45:51.018 INFO:teuthology.orchestra.run.smithi092.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-04-26T17:45:51.033 INFO:teuthology.orchestra.run.smithi189.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-04-26T17:45:51.050 INFO:teuthology.orchestra.run.smithi156.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-26T17:45:51.083 INFO:teuthology.orchestra.run.smithi189.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-04-26T17:45:51.084 INFO:teuthology.orchestra.run.smithi092.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-26T17:45:51.084 INFO:teuthology.orchestra.run.smithi156.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 544 kB/s | 59 kB 00:00 2024-04-26T17:45:51.109 INFO:teuthology.orchestra.run.smithi092.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-26T17:45:51.109 INFO:teuthology.orchestra.run.smithi156.stdout:(140/152): python3-repoze-lru-0.7-16.el9.noarch 160 kB/s | 31 kB 00:00 2024-04-26T17:45:51.141 INFO:teuthology.orchestra.run.smithi189.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-04-26T17:45:51.150 INFO:teuthology.orchestra.run.smithi092.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-04-26T17:45:51.159 INFO:teuthology.orchestra.run.smithi156.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-04-26T17:45:51.183 INFO:teuthology.orchestra.run.smithi189.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-04-26T17:45:51.193 INFO:teuthology.orchestra.run.smithi156.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-04-26T17:45:51.267 INFO:teuthology.orchestra.run.smithi189.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-26T17:45:51.268 INFO:teuthology.orchestra.run.smithi156.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 827 kB/s | 90 kB 00:00 2024-04-26T17:45:51.310 INFO:teuthology.orchestra.run.smithi156.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-26T17:45:51.318 INFO:teuthology.orchestra.run.smithi189.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-26T17:45:51.376 INFO:teuthology.orchestra.run.smithi092.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-04-26T17:45:51.377 INFO:teuthology.orchestra.run.smithi156.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-04-26T17:45:51.428 INFO:teuthology.orchestra.run.smithi156.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-26T17:45:51.443 INFO:teuthology.orchestra.run.smithi092.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-26T17:45:51.473 INFO:teuthology.orchestra.run.smithi156.stdout:(147/152): python3-webob-1.8.7-6.el9.noarch.rpm 632 kB/s | 230 kB 00:00 2024-04-26T17:45:51.510 INFO:teuthology.orchestra.run.smithi189.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-04-26T17:45:51.528 INFO:teuthology.orchestra.run.smithi156.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T17:45:51.543 INFO:teuthology.orchestra.run.smithi092.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-26T17:45:51.585 INFO:teuthology.orchestra.run.smithi092.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-04-26T17:45:51.619 INFO:teuthology.orchestra.run.smithi092.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-26T17:45:51.660 INFO:teuthology.orchestra.run.smithi189.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-04-26T17:45:51.727 INFO:teuthology.orchestra.run.smithi092.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-26T17:45:51.752 INFO:teuthology.orchestra.run.smithi189.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-04-26T17:45:51.777 INFO:teuthology.orchestra.run.smithi189.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 218 kB/s | 25 kB 00:00 2024-04-26T17:45:51.794 INFO:teuthology.orchestra.run.smithi092.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-26T17:45:51.802 INFO:teuthology.orchestra.run.smithi189.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-04-26T17:45:51.846 INFO:teuthology.orchestra.run.smithi156.stdout:(149/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 8.5 MB/s | 3.1 MB 00:00 2024-04-26T17:45:51.861 INFO:teuthology.orchestra.run.smithi189.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-26T17:45:51.879 INFO:teuthology.orchestra.run.smithi156.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 3.9 MB/s | 1.3 MB 00:00 2024-04-26T17:45:51.886 INFO:teuthology.orchestra.run.smithi189.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-26T17:45:51.912 INFO:teuthology.orchestra.run.smithi189.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-04-26T17:45:51.919 INFO:teuthology.orchestra.run.smithi092.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-04-26T17:45:51.995 INFO:teuthology.orchestra.run.smithi092.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-04-26T17:45:52.079 INFO:teuthology.orchestra.run.smithi156.stdout:(151/152): librados2-19.0.0-3267.gbc94a2a9.el9. 5.2 MB/s | 3.4 MB 00:00 2024-04-26T17:45:52.099 INFO:teuthology.orchestra.run.smithi092.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.3 MB/s | 248 kB 00:00 2024-04-26T17:45:52.187 INFO:teuthology.orchestra.run.smithi092.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-04-26T17:45:52.212 INFO:teuthology.orchestra.run.smithi092.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 228 kB/s | 26 kB 00:00 2024-04-26T17:45:52.254 INFO:teuthology.orchestra.run.smithi092.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-26T17:45:52.304 INFO:teuthology.orchestra.run.smithi092.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-26T17:45:52.312 INFO:teuthology.orchestra.run.smithi156.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.1 MB/s | 2.4 MB 00:00 2024-04-26T17:45:52.318 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:45:52.318 INFO:teuthology.orchestra.run.smithi156.stdout:Total 14 MB/s | 222 MB 00:16 2024-04-26T17:45:52.329 INFO:teuthology.orchestra.run.smithi092.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-04-26T17:45:52.405 INFO:teuthology.orchestra.run.smithi092.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-26T17:45:52.480 INFO:teuthology.orchestra.run.smithi092.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-26T17:45:52.530 INFO:teuthology.orchestra.run.smithi092.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T17:45:52.622 INFO:teuthology.orchestra.run.smithi092.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-04-26T17:45:52.647 INFO:teuthology.orchestra.run.smithi092.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-04-26T17:45:52.703 INFO:teuthology.orchestra.run.smithi189.stdout:(66/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-04-26T17:45:52.840 INFO:teuthology.orchestra.run.smithi092.stdout:(86/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 1.8 MB/s | 21 MB 00:11 2024-04-26T17:45:52.890 INFO:teuthology.orchestra.run.smithi092.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 1.0 MB/s | 269 kB 00:00 2024-04-26T17:45:52.912 INFO:teuthology.orchestra.run.smithi189.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.6 MB/s | 4.7 MB 00:01 2024-04-26T17:45:52.915 INFO:teuthology.orchestra.run.smithi092.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 593 kB/s | 159 kB 00:00 2024-04-26T17:45:52.941 INFO:teuthology.orchestra.run.smithi092.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-04-26T17:45:52.966 INFO:teuthology.orchestra.run.smithi092.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-04-26T17:45:52.991 INFO:teuthology.orchestra.run.smithi092.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-04-26T17:45:53.029 INFO:teuthology.orchestra.run.smithi189.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-04-26T17:45:53.041 INFO:teuthology.orchestra.run.smithi092.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-04-26T17:45:53.067 INFO:teuthology.orchestra.run.smithi092.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 586 kB/s | 44 kB 00:00 2024-04-26T17:45:53.088 INFO:teuthology.orchestra.run.smithi189.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-26T17:45:53.117 INFO:teuthology.orchestra.run.smithi092.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-04-26T17:45:53.142 INFO:teuthology.orchestra.run.smithi092.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-26T17:45:53.155 INFO:teuthology.orchestra.run.smithi189.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-04-26T17:45:53.193 INFO:teuthology.orchestra.run.smithi092.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-04-26T17:45:53.243 INFO:teuthology.orchestra.run.smithi092.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T17:45:53.268 INFO:teuthology.orchestra.run.smithi092.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-04-26T17:45:53.327 INFO:teuthology.orchestra.run.smithi092.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-04-26T17:45:53.352 INFO:teuthology.orchestra.run.smithi092.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-04-26T17:45:53.388 INFO:teuthology.orchestra.run.smithi189.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-04-26T17:45:53.419 INFO:teuthology.orchestra.run.smithi092.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 487 kB/s | 45 kB 00:00 2024-04-26T17:45:53.431 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-04-26T17:45:53.447 INFO:teuthology.orchestra.run.smithi189.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T17:45:53.569 INFO:teuthology.orchestra.run.smithi092.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-04-26T17:45:53.580 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-04-26T17:45:53.580 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-04-26T17:45:53.594 INFO:teuthology.orchestra.run.smithi092.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-04-26T17:45:53.805 INFO:teuthology.orchestra.run.smithi189.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 8.1 MB/s | 5.8 MB 00:00 2024-04-26T17:45:53.853 INFO:teuthology.orchestra.run.smithi092.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-04-26T17:45:53.864 INFO:teuthology.orchestra.run.smithi189.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-26T17:45:53.923 INFO:teuthology.orchestra.run.smithi189.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-26T17:45:53.989 INFO:teuthology.orchestra.run.smithi189.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-04-26T17:45:54.020 INFO:teuthology.orchestra.run.smithi092.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 726 kB/s | 309 kB 00:00 2024-04-26T17:45:54.040 INFO:teuthology.orchestra.run.smithi189.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-04-26T17:45:54.045 INFO:teuthology.orchestra.run.smithi092.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 101 kB/s | 19 kB 00:00 2024-04-26T17:45:54.070 INFO:teuthology.orchestra.run.smithi092.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-26T17:45:54.099 INFO:teuthology.orchestra.run.smithi189.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-26T17:45:54.149 INFO:teuthology.orchestra.run.smithi189.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-04-26T17:45:54.170 INFO:teuthology.orchestra.run.smithi092.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-04-26T17:45:54.196 INFO:teuthology.orchestra.run.smithi092.stdout:(109/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 172 kB/s | 26 kB 00:00 2024-04-26T17:45:54.254 INFO:teuthology.orchestra.run.smithi092.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 807 kB/s | 67 kB 00:00 2024-04-26T17:45:54.413 INFO:teuthology.orchestra.run.smithi092.stdout:(111/152): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-04-26T17:45:54.438 INFO:teuthology.orchestra.run.smithi092.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 624 kB/s | 151 kB 00:00 2024-04-26T17:45:54.449 INFO:teuthology.orchestra.run.smithi189.stdout:(80/152): python3-babel-2.9.1-2.el9.noarch.rpm 6.0 MB/s | 6.0 MB 00:01 2024-04-26T17:45:54.472 INFO:teuthology.orchestra.run.smithi092.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-04-26T17:45:54.497 INFO:teuthology.orchestra.run.smithi092.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-26T17:45:54.507 INFO:teuthology.orchestra.run.smithi189.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-26T17:45:54.522 INFO:teuthology.orchestra.run.smithi092.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2024-04-26T17:45:54.548 INFO:teuthology.orchestra.run.smithi092.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 424 kB/s | 32 kB 00:00 2024-04-26T17:45:54.565 INFO:teuthology.orchestra.run.smithi092.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 222 kB/s | 15 kB 00:00 2024-04-26T17:45:54.600 INFO:teuthology.orchestra.run.smithi189.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-04-26T17:45:54.640 INFO:teuthology.orchestra.run.smithi092.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-26T17:45:54.650 INFO:teuthology.orchestra.run.smithi189.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-26T17:45:54.657 INFO:teuthology.orchestra.run.smithi092.stdout:(119/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2024-04-26T17:45:54.682 INFO:teuthology.orchestra.run.smithi092.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-26T17:45:54.700 INFO:teuthology.orchestra.run.smithi189.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-04-26T17:45:54.724 INFO:teuthology.orchestra.run.smithi092.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-04-26T17:45:54.759 INFO:teuthology.orchestra.run.smithi189.stdout:(85/152): python3-oauthlib-3.1.1-5.el9.noarch.r 886 kB/s | 222 kB 00:00 2024-04-26T17:45:54.786 INFO:teuthology.orchestra.run.smithi189.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-04-26T17:45:54.799 INFO:teuthology.orchestra.run.smithi092.stdout:(122/152): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-26T17:45:54.811 INFO:teuthology.orchestra.run.smithi189.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.0 MB/s | 159 kB 00:00 2024-04-26T17:45:54.824 INFO:teuthology.orchestra.run.smithi092.stdout:(123/152): python3-google-auth-2.29.0-1.el9.noa 1.2 MB/s | 206 kB 00:00 2024-04-26T17:45:54.845 INFO:teuthology.orchestra.run.smithi189.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-04-26T17:45:54.850 INFO:teuthology.orchestra.run.smithi092.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-26T17:45:54.870 INFO:teuthology.orchestra.run.smithi189.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-04-26T17:45:54.875 INFO:teuthology.orchestra.run.smithi092.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-26T17:45:54.909 INFO:teuthology.orchestra.run.smithi092.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 210 kB/s | 18 kB 00:00 2024-04-26T17:45:54.934 INFO:teuthology.orchestra.run.smithi092.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 276 kB/s | 23 kB 00:00 2024-04-26T17:45:54.959 INFO:teuthology.orchestra.run.smithi092.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-04-26T17:45:54.993 INFO:teuthology.orchestra.run.smithi092.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2024-04-26T17:45:55.043 INFO:teuthology.orchestra.run.smithi092.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-04-26T17:45:55.076 INFO:teuthology.orchestra.run.smithi092.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-04-26T17:45:55.102 INFO:teuthology.orchestra.run.smithi092.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 724 kB/s | 79 kB 00:00 2024-04-26T17:45:55.127 INFO:teuthology.orchestra.run.smithi092.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-04-26T17:45:55.161 INFO:teuthology.orchestra.run.smithi092.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-26T17:45:55.177 INFO:teuthology.orchestra.run.smithi092.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-26T17:45:55.211 INFO:teuthology.orchestra.run.smithi092.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-26T17:45:55.228 INFO:teuthology.orchestra.run.smithi092.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 419 kB/s | 28 kB 00:00 2024-04-26T17:45:55.253 INFO:teuthology.orchestra.run.smithi092.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-04-26T17:45:55.295 INFO:teuthology.orchestra.run.smithi092.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-26T17:45:55.304 INFO:teuthology.orchestra.run.smithi189.stdout:(90/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 4.0 MB/s | 49 MB 00:12 2024-04-26T17:45:55.312 INFO:teuthology.orchestra.run.smithi092.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-04-26T17:45:55.329 INFO:teuthology.orchestra.run.smithi189.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 111 kB/s | 54 kB 00:00 2024-04-26T17:45:55.329 INFO:teuthology.orchestra.run.smithi092.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-26T17:45:55.361 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-04-26T17:45:55.361 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-04-26T17:45:55.371 INFO:teuthology.orchestra.run.smithi092.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-26T17:45:55.387 INFO:teuthology.orchestra.run.smithi189.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-04-26T17:45:55.405 INFO:teuthology.orchestra.run.smithi092.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-26T17:45:55.413 INFO:teuthology.orchestra.run.smithi189.stdout:(93/152): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-04-26T17:45:55.430 INFO:teuthology.orchestra.run.smithi092.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-04-26T17:45:55.455 INFO:teuthology.orchestra.run.smithi092.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-26T17:45:55.472 INFO:teuthology.orchestra.run.smithi189.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-04-26T17:45:55.480 INFO:teuthology.orchestra.run.smithi092.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-04-26T17:45:55.497 INFO:teuthology.orchestra.run.smithi189.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-04-26T17:45:55.522 INFO:teuthology.orchestra.run.smithi189.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-04-26T17:45:55.564 INFO:teuthology.orchestra.run.smithi092.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-26T17:45:55.589 INFO:teuthology.orchestra.run.smithi189.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-04-26T17:45:55.614 INFO:teuthology.orchestra.run.smithi189.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-04-26T17:45:55.615 INFO:teuthology.orchestra.run.smithi092.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.9 MB/s | 1.6 MB 00:00 2024-04-26T17:45:55.649 INFO:teuthology.orchestra.run.smithi189.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-26T17:45:55.673 INFO:teuthology.orchestra.run.smithi189.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T17:45:55.715 INFO:teuthology.orchestra.run.smithi189.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-04-26T17:45:55.723 INFO:teuthology.orchestra.run.smithi092.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-04-26T17:45:55.740 INFO:teuthology.orchestra.run.smithi189.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 334 kB/s | 22 kB 00:00 2024-04-26T17:45:55.833 INFO:teuthology.orchestra.run.smithi189.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-04-26T17:45:55.840 INFO:teuthology.orchestra.run.smithi092.stdout:(150/152): librados2-19.0.0-3267.gbc94a2a9.el9. 9.4 MB/s | 3.4 MB 00:00 2024-04-26T17:45:55.899 INFO:teuthology.orchestra.run.smithi092.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-04-26T17:45:55.949 INFO:teuthology.orchestra.run.smithi092.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-04-26T17:45:55.952 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:45:55.952 INFO:teuthology.orchestra.run.smithi092.stdout:Total 14 MB/s | 222 MB 00:15 2024-04-26T17:45:56.549 INFO:teuthology.orchestra.run.smithi189.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 678 kB/s | 548 kB 00:00 2024-04-26T17:45:56.575 INFO:teuthology.orchestra.run.smithi189.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 416 kB/s | 309 kB 00:00 2024-04-26T17:45:56.691 INFO:teuthology.orchestra.run.smithi189.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 137 kB/s | 19 kB 00:00 2024-04-26T17:45:56.825 INFO:teuthology.orchestra.run.smithi189.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-04-26T17:45:56.926 INFO:teuthology.orchestra.run.smithi189.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-04-26T17:45:57.034 INFO:teuthology.orchestra.run.smithi189.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-04-26T17:45:57.056 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-04-26T17:45:57.193 INFO:teuthology.orchestra.run.smithi189.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-04-26T17:45:57.198 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-04-26T17:45:57.199 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-04-26T17:45:57.218 INFO:teuthology.orchestra.run.smithi189.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 823 kB/s | 151 kB 00:00 2024-04-26T17:45:57.327 INFO:teuthology.orchestra.run.smithi189.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-04-26T17:45:57.427 INFO:teuthology.orchestra.run.smithi189.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-04-26T17:45:57.452 INFO:teuthology.orchestra.run.smithi189.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 346 kB/s | 43 kB 00:00 2024-04-26T17:45:57.528 INFO:teuthology.orchestra.run.smithi189.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-04-26T17:45:57.553 INFO:teuthology.orchestra.run.smithi189.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-26T17:45:57.628 INFO:teuthology.orchestra.run.smithi189.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-26T17:45:57.779 INFO:teuthology.orchestra.run.smithi189.stdout:(118/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-04-26T17:45:57.804 INFO:teuthology.orchestra.run.smithi189.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-04-26T17:45:57.829 INFO:teuthology.orchestra.run.smithi189.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-04-26T17:45:57.904 INFO:teuthology.orchestra.run.smithi189.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-04-26T17:45:58.013 INFO:teuthology.orchestra.run.smithi189.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-26T17:45:58.055 INFO:teuthology.orchestra.run.smithi189.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-04-26T17:45:58.130 INFO:teuthology.orchestra.run.smithi189.stdout:(124/152): python3-colorama-0.4.4-12.el9.noarch 101 kB/s | 35 kB 00:00 2024-04-26T17:45:58.155 INFO:teuthology.orchestra.run.smithi189.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-04-26T17:45:58.181 INFO:teuthology.orchestra.run.smithi189.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-04-26T17:45:58.223 INFO:teuthology.orchestra.run.smithi189.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-04-26T17:45:58.248 INFO:teuthology.orchestra.run.smithi189.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-26T17:45:58.298 INFO:teuthology.orchestra.run.smithi189.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-04-26T17:45:58.348 INFO:teuthology.orchestra.run.smithi189.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-04-26T17:45:58.374 INFO:teuthology.orchestra.run.smithi189.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-04-26T17:45:58.441 INFO:teuthology.orchestra.run.smithi189.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-04-26T17:45:58.491 INFO:teuthology.orchestra.run.smithi189.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-26T17:45:58.524 INFO:teuthology.orchestra.run.smithi189.stdout:(134/152): python3-more-itertools-8.12.0-2.el9. 349 kB/s | 79 kB 00:00 2024-04-26T17:45:58.541 INFO:teuthology.orchestra.run.smithi189.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-26T17:45:58.583 INFO:teuthology.orchestra.run.smithi189.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 975 kB/s | 90 kB 00:00 2024-04-26T17:45:58.642 INFO:teuthology.orchestra.run.smithi189.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-04-26T17:45:58.667 INFO:teuthology.orchestra.run.smithi189.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 245 kB/s | 31 kB 00:00 2024-04-26T17:45:58.692 INFO:teuthology.orchestra.run.smithi189.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-04-26T17:45:58.784 INFO:teuthology.orchestra.run.smithi189.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 416 kB/s | 59 kB 00:00 2024-04-26T17:45:58.810 INFO:teuthology.orchestra.run.smithi189.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 252 kB/s | 36 kB 00:00 2024-04-26T17:45:58.835 INFO:teuthology.orchestra.run.smithi189.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 358 kB/s | 51 kB 00:00 2024-04-26T17:45:58.927 INFO:teuthology.orchestra.run.smithi189.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-04-26T17:45:58.977 INFO:teuthology.orchestra.run.smithi189.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-04-26T17:45:59.003 INFO:teuthology.orchestra.run.smithi189.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-04-26T17:45:59.004 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-04-26T17:45:59.004 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-04-26T17:45:59.019 INFO:teuthology.orchestra.run.smithi189.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-04-26T17:45:59.087 INFO:teuthology.orchestra.run.smithi189.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-26T17:45:59.337 INFO:teuthology.orchestra.run.smithi189.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-04-26T17:45:59.454 INFO:teuthology.orchestra.run.smithi189.stdout:(149/152): librados2-19.0.0-3267.gbc94a2a9.el9. 7.8 MB/s | 3.4 MB 00:00 2024-04-26T17:45:59.554 INFO:teuthology.orchestra.run.smithi189.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 1.3 MB 00:00 2024-04-26T17:45:59.838 INFO:teuthology.orchestra.run.smithi189.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 2.4 MB 00:00 2024-04-26T17:45:59.996 INFO:teuthology.orchestra.run.smithi189.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-04-26T17:45:59.999 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:45:59.999 INFO:teuthology.orchestra.run.smithi189.stdout:Total 10 MB/s | 222 MB 00:21 2024-04-26T17:46:01.110 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-04-26T17:46:01.253 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-04-26T17:46:01.253 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-04-26T17:46:01.480 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-04-26T17:46:01.574 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:46:01.613 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:46:01.667 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:46:01.708 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:46:01.734 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:46:01.777 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:46:02.107 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:46:02.218 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:02.340 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:02.361 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:02.453 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:02.491 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:02.641 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:46:02.688 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:46:02.716 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:02.803 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:02.825 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:02.871 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:02.893 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:02.912 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:03.060 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:03.093 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:03.201 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:46:03.271 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-04-26T17:46:03.272 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-04-26T17:46:03.295 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:46:03.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:46:03.368 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:46:03.443 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:46:03.493 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:46:03.537 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:46:03.569 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:46:03.597 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:46:03.667 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:46:03.728 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:46:03.758 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:46:03.803 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:46:03.879 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:46:03.913 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:46:03.965 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:46:03.993 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:46:04.072 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:46:04.125 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:46:04.199 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:46:04.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:46:04.385 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:46:04.913 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:46:04.985 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-04-26T17:46:05.111 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:46:05.131 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:46:05.160 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:46:05.199 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:46:05.203 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:46:05.241 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:46:05.253 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:46:05.282 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:46:05.286 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:46:05.311 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:46:05.354 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:46:05.435 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:46:05.494 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:46:05.548 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:46:05.621 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:46:05.652 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:46:05.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:46:05.689 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:46:05.735 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:46:05.780 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:46:05.803 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:05.823 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:46:05.866 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:46:05.959 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:05.988 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:06.001 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:46:06.046 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:46:06.070 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:06.076 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:46:06.101 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:06.117 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:46:06.212 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:46:06.243 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:46:06.249 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:46:06.283 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:46:06.297 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:46:06.308 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:46:06.325 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:06.342 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:46:06.416 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:46:06.429 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:06.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:06.514 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:06.535 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:06.544 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:46:06.560 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:06.574 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:46:06.602 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:46:06.636 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:46:06.675 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:46:06.707 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:46:06.737 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:46:06.744 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:06.780 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:46:06.813 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:46:06.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:46:06.894 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:46:06.981 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:46:06.987 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:46:07.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:46:07.069 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:46:07.133 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:46:07.168 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:46:07.205 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:46:07.211 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:46:07.244 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:46:07.254 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:46:07.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:46:07.284 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:46:07.332 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:46:07.339 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:46:07.402 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:46:07.433 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:46:07.438 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:46:07.468 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:46:07.486 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:46:07.544 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:46:07.579 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:46:07.622 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:46:07.651 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:46:07.720 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:46:07.773 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:46:07.849 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:46:07.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:46:08.035 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:46:08.210 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:46:08.258 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:46:08.292 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:46:08.381 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:46:08.441 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:46:08.528 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:46:08.561 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:46:08.581 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:46:08.673 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:46:08.701 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:46:08.739 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:46:08.744 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:46:08.766 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:46:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:46:08.824 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:46:08.844 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:46:08.986 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:46:09.043 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:46:09.097 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:46:09.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:46:09.202 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:46:09.220 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-04-26T17:46:09.238 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:46:09.285 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:46:09.299 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:46:09.337 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:46:09.346 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:46:09.380 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:46:09.422 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:46:09.488 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:46:09.492 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:46:09.558 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:46:09.607 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:46:09.611 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:46:09.641 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:46:09.676 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:46:09.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:46:09.701 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:46:09.745 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:46:09.777 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:46:09.808 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:46:09.848 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:46:09.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:46:09.898 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:46:09.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:46:10.081 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:46:10.091 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:46:10.185 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:10.216 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:46:10.290 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:10.320 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:10.376 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:46:10.410 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:46:10.411 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:10.441 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:10.450 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:46:10.490 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:46:10.519 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:46:10.554 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:46:10.587 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:46:10.589 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:46:10.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:46:10.646 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:46:10.662 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:46:10.674 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:10.751 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:46:10.776 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:10.800 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:10.801 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:46:10.832 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:46:10.833 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:46:10.862 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:46:10.879 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:46:10.884 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:10.908 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:46:10.921 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:46:10.949 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:46:10.978 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:46:10.982 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:46:11.025 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:46:11.101 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:11.134 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:46:11.241 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:46:11.321 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:46:11.337 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:46:11.353 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:11.374 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:46:11.410 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:46:11.462 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:11.484 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:46:11.491 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:46:11.527 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:46:11.534 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:46:11.578 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:46:11.610 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:46:11.639 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:46:11.709 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:46:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:46:11.786 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:46:11.797 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:46:11.824 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:46:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:46:11.868 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:46:11.929 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:46:11.945 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:46:11.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:46:11.988 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:46:12.008 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:46:12.014 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:46:12.031 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:12.042 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:46:12.076 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:46:12.102 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:12.108 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:46:12.112 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:46:12.133 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:46:12.157 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:46:12.232 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:46:12.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:46:12.314 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:46:12.367 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:46:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:46:12.418 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:46:12.949 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:46:13.027 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:46:13.029 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:46:13.059 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:46:13.101 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:46:13.137 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:46:13.140 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:46:13.181 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:46:13.345 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:46:13.409 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:46:13.464 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:46:13.536 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:46:13.568 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:46:13.605 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:46:13.651 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:46:13.696 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:46:13.739 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:46:13.781 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:46:13.918 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:46:13.961 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:46:13.992 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:46:14.033 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:46:14.127 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:46:14.158 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:46:14.190 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:46:14.215 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:46:14.240 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:46:14.315 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:46:14.372 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:46:14.432 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:14.442 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:46:14.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:46:14.470 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:46:14.489 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:46:14.496 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:46:14.517 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:46:14.546 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:14.552 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:46:14.591 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:46:14.622 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:46:14.652 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:46:14.678 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:46:14.711 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:46:14.753 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:46:14.788 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:46:14.806 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:46:14.850 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:14.875 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:46:14.918 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:46:14.940 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:14.949 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:46:14.971 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:46:14.996 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:46:15.007 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:46:15.090 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:15.112 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:46:15.133 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:15.160 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:46:15.223 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:15.223 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:46:15.223 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:46:15.223 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:15.251 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:15.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:46:15.519 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:15.590 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:15.613 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:46:15.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:46:15.939 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:46:15.973 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:46:16.075 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:46:16.132 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:46:16.228 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:46:16.275 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:46:16.453 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:46:16.481 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:46:16.567 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:46:17.220 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:46:17.330 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:46:17.872 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:17.909 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:18.451 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:18.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:18.570 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:46:18.586 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:18.586 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:46:18.586 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:46:18.587 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:18.630 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:18.660 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:46:18.688 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:46:18.721 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:46:19.034 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:46:19.088 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:19.183 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:46:19.214 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:46:19.250 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:46:19.728 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:46:19.770 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:19.842 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:46:19.864 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:46:22.170 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:22.210 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:22.759 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:46:22.822 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:22.902 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:46:22.902 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:46:22.903 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:46:22.903 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:22.931 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:26.729 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:26.729 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2024-04-26T17:46:26.729 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2024-04-26T17:46:26.729 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2024-04-26T17:46:26.729 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2024-04-26T17:46:26.730 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2024-04-26T17:46:26.730 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2024-04-26T17:46:26.730 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2024-04-26T17:46:26.730 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:26.922 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:26.922 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:26.922 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:46:26.923 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:28.418 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:28.443 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:28.443 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:28.443 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:46:28.443 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:28.444 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:28.444 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:28.669 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:28.691 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:28.691 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:28.691 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:46:28.692 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:28.692 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:28.692 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:29.152 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:29.175 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:29.175 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:29.175 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:46:29.175 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:29.176 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:29.176 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:29.282 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:46:29.339 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:46:29.394 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:46:29.580 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:46:29.629 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:46:29.697 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:46:29.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:29.916 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:29.954 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:46:29.977 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:46:29.996 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:46:30.152 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:30.152 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-04-26T17:46:30.153 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:30.324 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:30.367 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:30.368 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:30.368 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:46:30.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:30.440 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:30.470 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:30.502 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:46:30.572 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:46:30.601 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:31.645 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:31.678 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:31.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:31.844 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:31.844 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:31.844 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:46:31.844 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:31.845 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:31.845 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:32.070 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:32.092 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:32.545 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:32.568 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:32.646 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:32.675 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:46:32.679 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:32.724 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:46:32.779 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:46:32.781 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:32.941 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:46:32.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:46:32.972 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:32.996 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:33.012 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:46:33.040 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:33.052 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:33.082 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:46:33.150 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:46:33.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:33.197 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:46:33.301 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:33.346 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:46:33.378 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:46:33.406 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:46:33.849 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:33.879 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:33.911 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:46:33.972 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:46:34.002 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:34.122 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:46:34.151 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:34.174 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:34.174 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:34.174 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:46:34.174 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:34.174 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:34.175 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:34.218 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:34.241 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:34.241 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:34.241 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:46:34.241 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:34.286 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:34.309 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:34.379 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:46:34.379 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-04-26T17:46:34.379 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-04-26T17:46:34.380 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:34.543 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:34.559 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:46:34.559 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:34.559 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:46:34.559 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:34.620 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:34.643 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:35.032 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:35.071 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:36.028 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:36.037 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:36.062 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:46:36.064 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:36.163 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:36.297 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:46:36.320 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:36.325 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:46:36.356 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:36.378 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:36.379 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:36.379 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:46:36.379 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:36.379 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:36.379 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:36.423 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:36.434 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:36.532 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:46:36.580 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:46:36.774 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:46:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:36.912 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:46:36.952 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:46:37.008 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:46:37.193 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:46:37.241 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:46:37.311 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:46:37.400 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:37.509 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:46:37.534 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:37.538 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:37.556 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:37.557 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:37.557 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:46:37.557 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:37.557 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:37.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:37.575 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:46:37.601 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:37.606 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:46:37.623 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:37.623 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:37.624 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:46:37.624 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:37.634 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:46:37.669 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:37.691 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:38.003 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:38.026 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:38.041 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:38.074 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:46:38.107 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:46:38.176 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:46:38.214 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:39.252 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:46:39.291 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:39.465 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:46:39.506 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:46:39.547 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:46:39.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:46:39.606 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:46:39.779 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:46:39.827 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:46:39.857 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:46:40.256 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:46:40.283 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:40.386 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:46:40.477 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:40.513 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:40.534 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:40.562 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:46:40.593 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:46:40.617 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:40.661 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:40.672 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:46:40.770 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:46:40.818 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:46:41.396 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:46:41.502 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:46:41.535 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:46:41.625 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:46:41.656 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:46:41.656 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:41.740 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:41.750 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:46:41.773 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:41.773 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:41.788 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:46:41.812 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:41.856 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:41.870 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:41.878 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:46:41.879 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:41.879 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:46:41.879 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:41.923 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:41.940 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:46:41.946 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:42.249 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:42.271 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:46:42.272 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:46:42.272 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:46:42.272 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:42.272 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:46:42.272 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:42.890 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:46:42.930 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:46:42.971 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:46:43.003 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:46:43.031 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:46:43.212 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:46:43.268 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:46:43.298 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:46:43.904 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:43.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:43.966 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:44.789 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:46:44.875 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:46:44.908 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:46:44.997 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:46:45.071 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:46:45.071 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:45.147 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:45.171 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:45.172 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:45.264 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:45.327 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:46.877 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:46:46.918 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:46:46.968 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:46:47.000 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:46:47.027 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:46:47.209 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:46:47.248 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:46:47.278 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:46:47.828 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:47.828 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:46:47.829 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:46:47.830 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:46:47.831 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:46:47.832 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:46:47.833 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:46:47.834 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:46:47.838 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:46:47.839 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:46:47.840 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:46:47.841 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:46:47.842 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:46:47.843 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:46:47.844 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:46:47.845 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:47.846 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:46:47.867 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:47.887 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:46:48.731 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:46:48.822 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:46:48.864 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:46:48.946 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:46:48.976 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:46:48.977 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:49.061 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:46:49.085 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:49.085 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:49.165 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:46:49.241 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:49.998 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:49.998 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:49.998 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2024-04-26T17:46:49.999 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:49.999 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:49.999 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:49.999 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:49.999 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-04-26T17:46:50.000 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:46:50.000 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:46:50.000 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:46:50.000 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:46:50.000 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.001 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.002 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:50.003 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:46:50.004 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:46:50.005 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:46:50.006 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.007 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:46:50.007 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:46:50.007 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:46:50.007 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:46:50.007 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:46:50.008 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.009 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:46:50.010 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:46:50.011 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:46:50.012 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:46:50.012 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:46:50.012 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:46:50.012 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:46:50.012 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:46:50.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:46:50.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:46:50.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:46:50.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:46:50.013 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:46:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:46:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:46:50.014 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:46:50.015 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:46:50.016 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:46:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:50.018 INFO:teuthology.orchestra.run.smithi156.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:46:50.019 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:46:50.019 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:46:50.019 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:46:50.019 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:46:50.019 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:46:50.020 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:46:50.020 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-04-26T17:46:50.021 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-04-26T17:46:50.401 DEBUG:teuthology.parallel:result is None 2024-04-26T17:46:51.365 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:51.365 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:46:51.365 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:51.366 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:46:51.367 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:46:51.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:46:51.369 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:46:51.370 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:46:51.371 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:46:51.372 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:46:51.373 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:46:51.374 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:46:51.375 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:46:51.376 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:46:51.377 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:46:51.378 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:46:51.378 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:46:51.378 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:46:51.378 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:46:51.378 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:46:51.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:46:51.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:46:51.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:46:51.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:46:51.379 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:46:51.380 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:46:51.380 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:46:51.380 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:46:51.380 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:46:51.380 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:46:51.381 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:46:51.381 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:46:51.381 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:51.381 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:51.381 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:46:51.382 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:46:51.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:46:51.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:46:51.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:46:51.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:46:51.383 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:46:51.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:46:51.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:46:51.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:46:51.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:46:51.384 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:46:51.385 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:46:51.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:46:51.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:46:51.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:46:51.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:46:51.386 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:46:51.387 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:46:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:51.388 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:46:53.368 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.369 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.370 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.371 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:46:53.372 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:46:53.373 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:46:53.374 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:46:53.375 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:46:53.376 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:46:53.377 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.378 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:46:53.379 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:46:53.380 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:46:53.380 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-04-26T17:46:53.763 DEBUG:teuthology.parallel:result is None 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:46:55.205 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:46:55.206 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:46:55.207 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:46:55.207 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:46:55.207 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:46:55.207 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:46:55.220 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:46:55.221 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:46:55.222 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:46:55.223 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:46:55.224 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:46:55.225 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:46:55.226 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:46:55.227 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:46:55.228 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:46:55.229 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:46:55.230 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:46:57.326 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.327 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.328 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:46:57.329 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:46:57.330 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:46:57.331 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:46:57.332 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:46:57.333 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:46:57.334 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:46:57.335 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:46:57.336 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:46:57.337 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:46:57.338 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-04-26T17:46:57.693 DEBUG:teuthology.parallel:result is None 2024-04-26T17:46:57.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:57.844 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:46:57.868 INFO:teuthology.orchestra.run.smithi092.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:57.869 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:57.869 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:46:57.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:58.088 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:46:58.114 INFO:teuthology.orchestra.run.smithi156.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:58.114 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:58.114 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:46:58.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:58.333 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:46:58.354 INFO:teuthology.orchestra.run.smithi189.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:58.355 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:46:58.355 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:46:58.356 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T17:46:58.357 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:46:58.357 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:46:58.387 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:46:58.387 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:46:58.418 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:46:58.418 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:46:58.443 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T17:46:58.444 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:46:58.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:46:58.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:46:58.536 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:46:58.536 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:46:58.564 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:46:58.632 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:46:58.632 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:46:58.656 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:46:58.719 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T17:46:58.720 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:46:58.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:46:58.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:46:58.812 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:46:58.812 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:46:58.839 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:46:58.906 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:46:58.906 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:46:58.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:46:58.994 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T17:46:58.995 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:46:58.995 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:46:59.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:46:59.085 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:46:59.085 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:46:59.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:46:59.177 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:46:59.177 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:46:59.200 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:46:59.263 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-26T17:46:59.370 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-26T17:46:59.370 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:59.370 INFO:tasks.cephadm:Cluster fsid is fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:46:59.371 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-26T17:46:59.371 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.92', 'mon.b': '172.21.15.156', 'mon.c': '172.21.15.189'} 2024-04-26T17:46:59.371 INFO:tasks.cephadm:First mon is mon.a on smithi092 2024-04-26T17:46:59.371 INFO:tasks.cephadm:First mgr is x 2024-04-26T17:46:59.371 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-26T17:46:59.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-04-26T17:46:59.397 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2024-04-26T17:46:59.424 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-04-26T17:46:59.448 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-26T17:46:59.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:59.587 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78913/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3267-gbc94a2a9', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3267.gbc94a2a9'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-26 08:22:46.917786', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-quiescer-fixes', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-04-26T17:46:59.722 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-quiescer-fixes, sha1 bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:46:59.723 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm 2024-04-26T17:46:59.723 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:00.506 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 17:47 /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:00.506 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.115 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 17:47 /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.115 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.527 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 781590 Apr 26 17:47 /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.528 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.546 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.565 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-26T17:47:01.599 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 on all hosts... 2024-04-26T17:47:01.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T17:47:01.602 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T17:47:01.607 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 pull 2024-04-26T17:47:03.209 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T17:47:03.267 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T17:47:03.294 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T17:47:35.393 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:47:35.393 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T17:47:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T17:47:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-04-26T17:47:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T17:47:35.394 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-04-26T17:47:35.394 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:47:55.140 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-04-26T17:47:55.140 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T17:47:55.141 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T17:47:55.141 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-04-26T17:47:55.141 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T17:47:55.141 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-04-26T17:47:55.141 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-04-26T17:47:55.219 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555", 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc" 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2024-04-26T17:47:55.220 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-04-26T17:47:55.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-04-26T17:47:55.284 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2024-04-26T17:47:55.315 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-04-26T17:47:55.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-04-26T17:47:55.368 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2024-04-26T17:47:55.394 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-04-26T17:47:55.417 INFO:tasks.cephadm:Writing seed config... 2024-04-26T17:47:55.418 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-26T17:47:55.419 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-26T17:47:55.420 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-26T17:47:55.421 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-26T17:47:55.422 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-26T17:47:55.422 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:47:55.422 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-26T17:47:55.439 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = fb3c417a-03f4-11ef-bc93-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-26T17:47:55.439 DEBUG:teuthology.orchestra.run.smithi092:mon.a> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a.service 2024-04-26T17:47:55.482 DEBUG:teuthology.orchestra.run.smithi092:mgr.x> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.x.service 2024-04-26T17:47:55.524 INFO:tasks.cephadm:Bootstrapping... 2024-04-26T17:47:55.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 -v bootstrap --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.92 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-26T17:47:55.717 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:47:55.717 INFO:teuthology.orchestra.run.smithi092.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', '-v', 'bootstrap', '--fsid', 'fb3c417a-03f4-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.92', '--skip-admin-label'] 2024-04-26T17:47:55.718 INFO:teuthology.orchestra.run.smithi092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-26T17:47:55.718 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying podman|docker is present... 2024-04-26T17:47:55.743 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T17:47:55.744 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying lvm2 is present... 2024-04-26T17:47:55.744 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying time synchronization is in place... 2024-04-26T17:47:55.751 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T17:47:55.751 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T17:47:55.757 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T17:47:55.758 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:47:55.764 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-04-26T17:47:55.771 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-04-26T17:47:55.771 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-04-26T17:47:55.771 INFO:teuthology.orchestra.run.smithi092.stdout:Repeating the final host check... 2024-04-26T17:47:55.796 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-26T17:47:55.796 INFO:teuthology.orchestra.run.smithi092.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-26T17:47:55.796 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl is present 2024-04-26T17:47:55.796 INFO:teuthology.orchestra.run.smithi092.stdout:lvcreate is present 2024-04-26T17:47:55.802 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-26T17:47:55.802 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-26T17:47:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-26T17:47:55.808 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:47:55.815 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout enabled 2024-04-26T17:47:55.822 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout active 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Unit chronyd.service is enabled and running 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Host looks OK 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Cluster fsid: fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Acquiring lock 139918901984416 on /run/cephadm/fb3c417a-03f4-11ef-bc93-c7b262605968.lock 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Lock 139918901984416 acquired on /run/cephadm/fb3c417a-03f4-11ef-bc93-c7b262605968.lock 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 3300 ... 2024-04-26T17:47:55.823 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying IP 172.21.15.92 port 6789 ... 2024-04-26T17:47:55.824 INFO:teuthology.orchestra.run.smithi092.stdout:Base mon IP(s) is [172.21.15.92:3300, 172.21.15.92:6789], mon addrv is [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-04-26T17:47:55.827 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.92 metric 100 2024-04-26T17:47:55.827 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.92 metric 100 2024-04-26T17:47:55.829 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-26T17:47:55.830 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-26T17:47:55.830 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout inet6 fe80::cbcc:f494:f165:35c5/64 scope link noprefixroute 2024-04-26T17:47:55.832 INFO:teuthology.orchestra.run.smithi092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-26T17:47:55.833 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-04-26T17:47:55.833 INFO:teuthology.orchestra.run.smithi092.stdout:Mon IP `172.21.15.92` is in CIDR network `172.21.0.0/20` 2024-04-26T17:47:55.833 INFO:teuthology.orchestra.run.smithi092.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-26T17:47:55.833 INFO:teuthology.orchestra.run.smithi092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-26T17:47:55.834 INFO:teuthology.orchestra.run.smithi092.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stdout 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1... 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Getting image source signatures 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:449452a284afe5840255d087488a224329a4679c5f5d200bb867a639c75ddfd2 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Copying config sha256:3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 2024-04-26T17:47:56.292 INFO:teuthology.orchestra.run.smithi092.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-26T17:47:57.281 INFO:teuthology.orchestra.run.smithi092.stdout:ceph: stdout ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T17:47:57.281 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph version: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T17:47:57.281 INFO:teuthology.orchestra.run.smithi092.stdout:Extracting ceph user uid/gid from container image... 2024-04-26T17:47:58.238 INFO:teuthology.orchestra.run.smithi092.stdout:stat: stdout 167 167 2024-04-26T17:47:58.238 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial keys... 2024-04-26T17:47:59.185 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDO6CtmeXlVIRAA+r9SOjQmk5t25KLs+bcB6A== 2024-04-26T17:48:00.234 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDP6CtmMTChHhAAce7mInagEa/8M28KEejJ0Q== 2024-04-26T17:48:01.175 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph-authtool: stdout AQDQ6CtmnjUQIhAA2GIEt5J6c6IkmpOiM+Vnng== 2024-04-26T17:48:01.176 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial monmap... 2024-04-26T17:48:02.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T17:48:02.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-26T17:48:02.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:monmaptool for a [v2:172.21.15.92:3300,v1:172.21.15.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:setting min_mon_release = quincy 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: set fsid to fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:48:02.145 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mon... 2024-04-26T17:48:03.083 INFO:teuthology.orchestra.run.smithi092.stdout:create mon.a on 2024-04-26T17:48:03.288 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-26T17:48:03.427 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-26T17:48:03.625 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target. 2024-04-26T17:48:03.625 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target. 2024-04-26T17:48:03.864 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a 2024-04-26T17:48:03.864 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a.service: Unit ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a.service not loaded. 2024-04-26T17:48:04.027 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target.wants/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a.service → /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@.service. 2024-04-26T17:48:04.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:04 smithi092 ceph-mon[28786]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T17:48:04.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:04 smithi092 bash[28767]: b76cbdfb2511036d581729bad44bb3d1656d465ccc083e5dcc47158488863142 2024-04-26T17:48:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T17:48:04.556 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-04-26T17:48:04.563 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T17:48:04.563 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:48:04.563 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-04-26T17:48:04.564 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T17:48:04.564 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon to start... 2024-04-26T17:48:04.564 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mon... 2024-04-26T17:48:04.808 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:04 smithi092 systemd[1]: Started Ceph mon.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:48:05.632 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: monmap epoch 1 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: last_changed 2024-04-26T17:48:01.505526+0000 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: min_mon_release 19 (squid) 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: election_strategy: 1 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: fsmap 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: mgrmap e1: no daemons active 2024-04-26T17:48:05.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:05 smithi092 ceph-mon[28786]: from='client.? 172.21.15.92:0/2526548554' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout cluster: 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout id: fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout services: 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.579081s) 2024-04-26T17:48:05.641 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout data: 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout pgs: 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.001+0000 7fe20f8c3700 1 Processor -- start 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.001+0000 7fe20f8c3700 1 -- start start 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20f8c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20f8c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe20807ce90 con 0x7fe2081097c0 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20d65f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:05.642 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20d65f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41134/0 (socket says 172.21.15.92:41134) 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20d65f700 1 -- 172.21.15.92:0/2710209998 learned_addr learned my addr 172.21.15.92:0/2710209998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20d65f700 1 -- 172.21.15.92:0/2710209998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20810c0f0 con 0x7fe2081097c0 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe20d65f700 1 --2- 172.21.15.92:0/2710209998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe2000098a0 tx=0x7fe200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfec0201df4383b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.002+0000 7fe207fff700 1 -- 172.21.15.92:0/2710209998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe200004160 con 0x7fe2081097c0 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe207fff700 1 -- 172.21.15.92:0/2710209998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200004300 con 0x7fe2081097c0 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe207fff700 1 -- 172.21.15.92:0/2710209998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2000036a0 con 0x7fe2081097c0 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2710209998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 msgr2=0x7fe20810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 --2- 172.21.15.92:0/2710209998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe2000098a0 tx=0x7fe200009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2710209998 shutdown_connections 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 --2- 172.21.15.92:0/2710209998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20810bbb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2710209998 >> 172.21.15.92:0/2710209998 conn(0x7fe208103210 msgr2=0x7fe208105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2710209998 shutdown_connections 2024-04-26T17:48:05.643 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.003+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2710209998 wait complete. 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20f8c3700 1 Processor -- start 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20f8c3700 1 -- start start 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20f8c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20f8c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe20810c560 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20d65f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20d65f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41148/0 (socket says 172.21.15.92:41148) 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20d65f700 1 -- 172.21.15.92:0/2526548554 learned_addr learned my addr 172.21.15.92:0/2526548554 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.004+0000 7fe20d65f700 1 -- 172.21.15.92:0/2526548554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20819c9b0 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe20d65f700 1 --2- 172.21.15.92:0/2526548554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe200004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe200003db0 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200011630 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe200011950 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20819cc40 con 0x7fe2081097c0 2024-04-26T17:48:05.644 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20819f930 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe200011af0 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.005+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe20001c450 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.006+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208064a80 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.008+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe200032020 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.079+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fe20802e610 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.080+0000 7fe2067fc700 1 -- 172.21.15.92:0/2526548554 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fe200004260 con 0x7fe2081097c0 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 msgr2=0x7fe20819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 --2- 172.21.15.92:0/2526548554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe200004750 comp rx=0 tx=0).stop 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 shutdown_connections 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 --2- 172.21.15.92:0/2526548554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2081097c0 0x7fe20819c470 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 >> 172.21.15.92:0/2526548554 conn(0x7fe208103210 msgr2=0x7fe208105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 shutdown_connections 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:05.081+0000 7fe20f8c3700 1 -- 172.21.15.92:0/2526548554 wait complete. 2024-04-26T17:48:05.645 INFO:teuthology.orchestra.run.smithi092.stdout:mon is available 2024-04-26T17:48:05.646 INFO:teuthology.orchestra.run.smithi092.stdout:Assimilating anything we can from ceph.conf... 2024-04-26T17:48:06.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:06 smithi092 ceph-mon[28786]: from='client.? 172.21.15.92:0/855721368' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T17:48:06.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:06 smithi092 ceph-mon[28786]: from='client.? 172.21.15.92:0/855721368' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-26T17:48:06.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:06.749 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.92:3300,v1:172.21.15.92:6789] 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T17:48:06.750 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93f5332700 1 Processor -- start 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93f5332700 1 -- start start 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93f5332700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93f5332700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01097f0 con 0x7f93f0108e00 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.058+0000 7f93eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41152/0 (socket says 172.21.15.92:41152) 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93eeffd700 1 -- 172.21.15.92:0/940659909 learned_addr learned my addr 172.21.15.92:0/940659909 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93eeffd700 1 -- 172.21.15.92:0/940659909 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f0109f60 con 0x7f93f0108e00 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93eeffd700 1 --2- 172.21.15.92:0/940659909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93e00098a0 tx=0x7f93e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575c693d0a9202d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93ee7fc700 1 -- 172.21.15.92:0/940659909 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e0004160 con 0x7f93f0108e00 2024-04-26T17:48:06.751 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93ee7fc700 1 -- 172.21.15.92:0/940659909 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0004300 con 0x7f93f0108e00 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.059+0000 7f93ee7fc700 1 -- 172.21.15.92:0/940659909 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e00036a0 con 0x7f93f0108e00 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- 172.21.15.92:0/940659909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 msgr2=0x7f93f0109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 --2- 172.21.15.92:0/940659909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f93e00098a0 tx=0x7f93e0009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- 172.21.15.92:0/940659909 shutdown_connections 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 --2- 172.21.15.92:0/940659909 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f0109220 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- 172.21.15.92:0/940659909 >> 172.21.15.92:0/940659909 conn(0x7f93f01043c0 msgr2=0x7f93f01067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- 172.21.15.92:0/940659909 shutdown_connections 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- 172.21.15.92:0/940659909 wait complete. 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 Processor -- start 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.060+0000 7f93f5332700 1 -- start start 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93f5332700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93f5332700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93f010a490 con 0x7f93f0108e00 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:06.752 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93eeffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41162/0 (socket says 172.21.15.92:41162) 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93eeffd700 1 -- 172.21.15.92:0/855721368 learned_addr learned my addr 172.21.15.92:0/855721368 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93eeffd700 1 -- 172.21.15.92:0/855721368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f019ca40 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93eeffd700 1 --2- 172.21.15.92:0/855721368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e0003db0 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0011630 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f019ccd0 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93e0011950 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.061+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f019f9c0 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.062+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93e001a460 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.062+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93e001b780 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.062+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f0064a80 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.065+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f93e0031020 con 0x7f93f0108e00 2024-04-26T17:48:06.753 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.131+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f93f019d1b0 con 0x7f93f0108e00 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.135+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f93f019d1b0 con 0x7f93f0108e00 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.135+0000 7f93ecff9700 1 -- 172.21.15.92:0/855721368 <== mon.0 v2:172.21.15.92:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f93e001a8e0 con 0x7f93f0108e00 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 msgr2=0x7f93f019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 --2- 172.21.15.92:0/855721368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f93e0000c00 tx=0x7f93e0004750 comp rx=0 tx=0).stop 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 shutdown_connections 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 --2- 172.21.15.92:0/855721368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f0108e00 0x7f93f019c500 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 >> 172.21.15.92:0/855721368 conn(0x7f93f01043c0 msgr2=0x7f93f0193160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 shutdown_connections 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:06.136+0000 7f93f5332700 1 -- 172.21.15.92:0/855721368 wait complete. 2024-04-26T17:48:06.754 INFO:teuthology.orchestra.run.smithi092.stdout:Generating new minimal ceph.conf... 2024-04-26T17:48:07.856 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:07 smithi092 ceph-mon[28786]: from='client.? 172.21.15.92:0/3796590163' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa87e05f700 1 Processor -- start 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa87e05f700 1 -- start start 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa87e05f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa87e05f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa878109740 con 0x7fa878108d50 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41170/0 (socket says 172.21.15.92:41170) 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.182+0000 7fa8777fe700 1 -- 172.21.15.92:0/1750445949 learned_addr learned my addr 172.21.15.92:0/1750445949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:07.865 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa8777fe700 1 -- 172.21.15.92:0/1750445949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa878109f50 con 0x7fa878108d50 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa8777fe700 1 --2- 172.21.15.92:0/1750445949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8680098a0 tx=0x7fa868009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6059bf4dc80119 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa8767fc700 1 -- 172.21.15.92:0/1750445949 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa868004160 con 0x7fa878108d50 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa8767fc700 1 -- 172.21.15.92:0/1750445949 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa868004300 con 0x7fa878108d50 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa8767fc700 1 -- 172.21.15.92:0/1750445949 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa868011af0 con 0x7fa878108d50 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa87e05f700 1 -- 172.21.15.92:0/1750445949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 msgr2=0x7fa878109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.183+0000 7fa87e05f700 1 --2- 172.21.15.92:0/1750445949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8680098a0 tx=0x7fa868009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- 172.21.15.92:0/1750445949 shutdown_connections 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 --2- 172.21.15.92:0/1750445949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa878109170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- 172.21.15.92:0/1750445949 >> 172.21.15.92:0/1750445949 conn(0x7fa8781042b0 msgr2=0x7fa878106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- 172.21.15.92:0/1750445949 shutdown_connections 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- 172.21.15.92:0/1750445949 wait complete. 2024-04-26T17:48:07.866 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 Processor -- start 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- start start 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.184+0000 7fa87e05f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810d300 con 0x7fa878108d50 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41178/0 (socket says 172.21.15.92:41178) 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa8777fe700 1 -- 172.21.15.92:0/3796590163 learned_addr learned my addr 172.21.15.92:0/3796590163 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:07.867 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa8777fe700 1 -- 172.21.15.92:0/3796590163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87819d240 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa8777fe700 1 --2- 172.21.15.92:0/3796590163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa868009fb0 tx=0x7fa868011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8680036a0 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa86801a430 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa868019550 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87819d4d0 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781a01b0 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa868019b90 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.185+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa868024730 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.186+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878064a80 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.189+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa868043e50 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.254+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8781a0380 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.255+0000 7fa874ff9700 1 -- 172.21.15.92:0/3796590163 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fa868032030 con 0x7fa878108d50 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 msgr2=0x7fa87819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:07.868 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 --2- 172.21.15.92:0/3796590163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa868009fb0 tx=0x7fa868011940 comp rx=0 tx=0).stop 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 shutdown_connections 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 --2- 172.21.15.92:0/3796590163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa878108d50 0x7fa87819cd00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 >> 172.21.15.92:0/3796590163 conn(0x7fa8781042b0 msgr2=0x7fa878104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 shutdown_connections 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:07.256+0000 7fa87e05f700 1 -- 172.21.15.92:0/3796590163 wait complete. 2024-04-26T17:48:07.869 INFO:teuthology.orchestra.run.smithi092.stdout:Restarting the monitor... 2024-04-26T17:48:08.135 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:07 smithi092 systemd[1]: Stopping Ceph mon.a for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:48:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a[28782]: 2024-04-26T17:48:08.134+0000 7fb097990700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-26T17:48:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a[28782]: 2024-04-26T17:48:08.135+0000 7fb097990700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-26T17:48:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 podman[29030]: 2024-04-26 17:48:08.20749445 +0000 UTC m=+0.183801161 container died b76cbdfb2511036d581729bad44bb3d1656d465ccc083e5dcc47158488863142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T17:48:08.821 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 podman[29030]: 2024-04-26 17:48:08.587013505 +0000 UTC m=+0.563320232 container cleanup b76cbdfb2511036d581729bad44bb3d1656d465ccc083e5dcc47158488863142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T17:48:08.821 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 bash[29030]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a 2024-04-26T17:48:09.173 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 podman[29044]: 2024-04-26 17:48:08.822505327 +0000 UTC m=+0.616257526 container remove b76cbdfb2511036d581729bad44bb3d1656d465ccc083e5dcc47158488863142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T17:48:09.174 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-26T17:48:09.174 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 systemd[1]: Stopped Ceph mon.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:48:09.174 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:08 smithi092 systemd[1]: Starting Ceph mon.a for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 podman[29137]: 2024-04-26 17:48:09.077459986 +0000 UTC m=+0.018071813 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 podman[29137]: 2024-04-26 17:48:09.189941107 +0000 UTC m=+0.130552941 container create 97922cfaead77039abec71ac3230218864f271659719a913a3729149b8c2a777 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 podman[29137]: 2024-04-26 17:48:09.375326721 +0000 UTC m=+0.315938513 container init 97922cfaead77039abec71ac3230218864f271659719a913a3729149b8c2a777 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 podman[29137]: 2024-04-26 17:48:09.379124561 +0000 UTC m=+0.319736353 container start 97922cfaead77039abec71ac3230218864f271659719a913a3729149b8c2a777 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-a, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev), process ceph-mon, pid 2 2024-04-26T17:48:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: pidfile_write: ignore empty --pid-file 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: load: jerasure load: lrc 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: RocksDB version: 7.9.2 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Git sha 0 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Compile date 2024-04-26 07:20:26 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: DB SUMMARY 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: DB Session ID: MMX2ZMCU61B2FD99TKZH 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: CURRENT file: CURRENT 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104526 ; 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.error_if_exists: 0 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.create_if_missing: 0 2024-04-26T17:48:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.paranoid_checks: 1 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.env: 0x556bd2d63cc0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.info_log: 0x556bd5161d80 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.statistics: (nil) 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.use_fsync: 0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_log_file_size: 0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T17:48:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_fallocate: 1 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.use_direct_reads: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.db_log_dir: 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.wal_dir: 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T17:48:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.write_buffer_manager: 0x556bd51330e0 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T17:48:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T17:48:09.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T17:48:09.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T17:48:09.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.unordered_write: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.row_cache: None 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.wal_filter: None 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.two_write_queues: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.wal_compression: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.atomic_flush: 0 2024-04-26T17:48:09.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.log_readahead_size: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_background_jobs: 2 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_background_compactions: -1 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_subcompactions: 1 2024-04-26T17:48:09.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_open_files: -1 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_background_flushes: -1 2024-04-26T17:48:09.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Compression algorithms supported: 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kZSTD supported: 0 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kXpressCompression supported: 0 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kZlibCompression supported: 1 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kSnappyCompression supported: 1 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kLZ4Compression supported: 1 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: kBZip2Compression supported: 0 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.merge_operator: 2024-04-26T17:48:09.475 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_filter: None 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556bd5161f40) 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_type: 0 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_index_type: 0 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_shortening: 1 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T17:48:09.476 INFO:journalctl@ceph.mon.a.smithi092.stdout: checksum: 4 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: no_block_cache: 0 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache: 0x556bd51651f0 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_options: 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: capacity : 536870912 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_shard_bits : 4 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: strict_capacity_limit : 0 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_cache_compressed: (nil) 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: persistent_cache: (nil) 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size: 4096 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_size_deviation: 10 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_restart_interval: 16 2024-04-26T17:48:09.477 INFO:journalctl@ceph.mon.a.smithi092.stdout: index_block_restart_interval: 1 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: metadata_block_size: 4096 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: partition_filters: 0 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: use_delta_encoding: 1 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: filter_policy: bloomfilter 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: whole_key_filtering: 1 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: verify_compression: 0 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: format_version: 5 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_index_compression: 1 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: block_align: 0 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: max_auto_readahead_size: 262144 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: prepopulate_block_cache: 0 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: initial_auto_readahead_size: 8192 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T17:48:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression: NoCompression 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.num_levels: 7 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T17:48:09.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T17:48:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T17:48:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T17:48:09.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.inplace_update_support: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.bloom_locality: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.max_successive_merges: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T17:48:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.ttl: 2592000 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enable_blob_files: false 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.min_blob_size: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T17:48:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2653f21e-95fb-452c-b731-acd6a4cd2a15 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153689407659, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153689408704, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99753, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97635, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14028, "raw_average_key_size": 49, "raw_value_size": 89993, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714153689, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2653f21e-95fb-452c-b731-acd6a4cd2a15", "db_session_id": "MMX2ZMCU61B2FD99TKZH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153689408788, "job": 1, "event": "recovery_finished"} 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556bd5282000 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: DB pointer 0x556bd526e000 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T17:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** DB Stats ** 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: L0 2/0 99.28 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:48:09.486 INFO:journalctl@ceph.mon.a.smithi092.stdout: Sum 2/0 99.28 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** Compaction Stats [default] ** 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T17:48:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: Cumulative compaction: 0.00 GB write, 31.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: Interval compaction: 0.00 GB write, 31.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache BinnedLRUCache@0x556bd51651f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: starting mon.a rank 0 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???) e1 preinit fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).mds e1 new map 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).mds e1 print_map 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: e1 2024-04-26T17:48:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout: legacy client fscid: -1 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout: 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout: No filesystems configured 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 bash[29137]: 97922cfaead77039abec71ac3230218864f271659719a913a3729149b8c2a777 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: monmap epoch 1 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: last_changed 2024-04-26T17:48:01.505526+0000 2024-04-26T17:48:09.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: min_mon_release 19 (squid) 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: election_strategy: 1 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: fsmap 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: osdmap e1: 0 total, 0 up, 0 in 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 ceph-mon[29156]: mgrmap e1: no daemons active 2024-04-26T17:48:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:09 smithi092 systemd[1]: Started Ceph mon.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:48:09.490 INFO:teuthology.orchestra.run.smithi092.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-26T17:48:10.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52edd4c700 1 Processor -- start 2024-04-26T17:48:10.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52edd4c700 1 -- start start 2024-04-26T17:48:10.512 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52edd4c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52edd4c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52e807d840 con 0x7f52e807ee00 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41180/0 (socket says 172.21.15.92:41180) 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.921+0000 7f52e77fe700 1 -- 172.21.15.92:0/2360038760 learned_addr learned my addr 172.21.15.92:0/2360038760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52e77fe700 1 -- 172.21.15.92:0/2360038760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e807d9c0 con 0x7f52e807ee00 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52e77fe700 1 --2- 172.21.15.92:0/2360038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098a0 tx=0x7f52d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc63974d6b5d5bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52e67fc700 1 -- 172.21.15.92:0/2360038760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8004160 con 0x7f52e807ee00 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52e67fc700 1 -- 172.21.15.92:0/2360038760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f52d8004300 con 0x7f52e807ee00 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52e67fc700 1 -- 172.21.15.92:0/2360038760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8011af0 con 0x7f52e807ee00 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52edd4c700 1 -- 172.21.15.92:0/2360038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 msgr2=0x7f52e807d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52edd4c700 1 --2- 172.21.15.92:0/2360038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f52d80098a0 tx=0x7f52d8009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.922+0000 7f52edd4c700 1 -- 172.21.15.92:0/2360038760 shutdown_connections 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 --2- 172.21.15.92:0/2360038760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e807d300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 -- 172.21.15.92:0/2360038760 >> 172.21.15.92:0/2360038760 conn(0x7f52e81043c0 msgr2=0x7f52e81067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:10.513 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 -- 172.21.15.92:0/2360038760 shutdown_connections 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 -- 172.21.15.92:0/2360038760 wait complete. 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 Processor -- start 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.923+0000 7f52edd4c700 1 -- start start 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52edd4c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52edd4c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52e810f310 con 0x7f52e807ee00 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41192/0 (socket says 172.21.15.92:41192) 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e77fe700 1 -- 172.21.15.92:0/2809954156 learned_addr learned my addr 172.21.15.92:0/2809954156 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e77fe700 1 -- 172.21.15.92:0/2809954156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e819f420 con 0x7f52e807ee00 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e77fe700 1 --2- 172.21.15.92:0/2809954156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009fb0 tx=0x7f52d8011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d80036a0 con 0x7f52e807ee00 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e819f6b0 con 0x7f52e807ee00 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f52d801a430 con 0x7f52e807ee00 2024-04-26T17:48:10.514 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52d8019550 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e81a23a0 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.924+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52d8019be0 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.925+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52d8024730 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.925+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8064a80 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.928+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f52d8043e50 con 0x7f52e807ee00 2024-04-26T17:48:10.515 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.994+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f52e81a2570 con 0x7f52e807ee00 2024-04-26T17:48:10.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.996+0000 7f52e4ff9700 1 -- 172.21.15.92:0/2809954156 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f52d8032030 con 0x7f52e807ee00 2024-04-26T17:48:10.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 msgr2=0x7f52e819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:10.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 --2- 172.21.15.92:0/2809954156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009fb0 tx=0x7f52d8011940 comp rx=0 tx=0).stop 2024-04-26T17:48:10.517 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 shutdown_connections 2024-04-26T17:48:10.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 --2- 172.21.15.92:0/2809954156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52e807ee00 0x7f52e819eee0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:10.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 >> 172.21.15.92:0/2809954156 conn(0x7f52e81043c0 msgr2=0x7f52e8104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:10.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 shutdown_connections 2024-04-26T17:48:10.518 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:09.997+0000 7f52edd4c700 1 -- 172.21.15.92:0/2809954156 wait complete. 2024-04-26T17:48:10.518 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-26T17:48:10.538 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-26T17:48:10.539 INFO:teuthology.orchestra.run.smithi092.stdout:Creating mgr... 2024-04-26T17:48:10.539 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-26T17:48:10.540 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-26T17:48:10.782 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.x 2024-04-26T17:48:10.783 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.x.service: Unit ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.x.service not loaded. 2024-04-26T17:48:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968.target.wants/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@.service. 2024-04-26T17:48:10.946 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:10 smithi092 systemd[1]: Starting Ceph mgr.x for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:48:11.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:10 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2809954156' entity='client.admin' 2024-04-26T17:48:11.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 podman[29372]: 2024-04-26 17:48:11.150478212 +0000 UTC m=+0.100256125 container create 3b31bd6de70597de43ef162a7bade10ff053c029fe908cbed2caf91d01cf6779 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T17:48:11.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 podman[29372]: 2024-04-26 17:48:11.067974588 +0000 UTC m=+0.017752462 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:48:11.458 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T17:48:11.458 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-04-26T17:48:11.465 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T17:48:11.466 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:48:11.466 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-04-26T17:48:11.466 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to enable service . firewalld.service is not available 2024-04-26T17:48:11.474 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T17:48:11.474 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-04-26T17:48:11.481 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T17:48:11.481 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:48:11.481 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-04-26T17:48:11.481 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-26T17:48:11.481 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr to start... 2024-04-26T17:48:11.482 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr... 2024-04-26T17:48:11.536 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 podman[29372]: 2024-04-26 17:48:11.377831569 +0000 UTC m=+0.327609436 container init 3b31bd6de70597de43ef162a7bade10ff053c029fe908cbed2caf91d01cf6779 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T17:48:11.536 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 podman[29372]: 2024-04-26 17:48:11.380568603 +0000 UTC m=+0.330346471 container start 3b31bd6de70597de43ef162a7bade10ff053c029fe908cbed2caf91d01cf6779 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T17:48:11.536 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 bash[29372]: 3b31bd6de70597de43ef162a7bade10ff053c029fe908cbed2caf91d01cf6779 2024-04-26T17:48:11.536 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 systemd[1]: Started Ceph mgr.x for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:48:11.826 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:11.535+0000 7f3f391ef200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:48:11.826 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:11.724+0000 7f3f391ef200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:11.826 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:11.825+0000 7f3f391ef200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:48:12.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:12 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2328567760' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T17:48:12.492 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:12 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:12.148+0000 7f3f391ef200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:48:12.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:12 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:12.233+0000 7f3f391ef200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:48:12.670 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T17:48:12.671 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T17:48:12.672 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T17:48:12.673 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T17:48:04.505778+0000", 2024-04-26T17:48:12.674 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.929+0000 7f34cfbb0700 1 Processor -- start 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.929+0000 7f34cfbb0700 1 -- start start 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cfbb0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cfbb0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34c8108650 con 0x7f34c8107c60 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cd94c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cd94c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41206/0 (socket says 172.21.15.92:41206) 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cd94c700 1 -- 172.21.15.92:0/1088185814 learned_addr learned my addr 172.21.15.92:0/1088185814 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.930+0000 7f34cd94c700 1 -- 172.21.15.92:0/1088185814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c8108e60 con 0x7f34c8107c60 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cd94c700 1 --2- 172.21.15.92:0/1088185814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f34b80098a0 tx=0x7f34b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5285b2bbc51d3997 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cc94a700 1 -- 172.21.15.92:0/1088185814 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8004160 con 0x7f34c8107c60 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cc94a700 1 -- 172.21.15.92:0/1088185814 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f34b8004300 con 0x7f34c8107c60 2024-04-26T17:48:12.675 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cc94a700 1 -- 172.21.15.92:0/1088185814 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8011af0 con 0x7f34c8107c60 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 -- 172.21.15.92:0/1088185814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 msgr2=0x7f34c8108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 --2- 172.21.15.92:0/1088185814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f34b80098a0 tx=0x7f34b8009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 -- 172.21.15.92:0/1088185814 shutdown_connections 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 --2- 172.21.15.92:0/1088185814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c8108080 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 -- 172.21.15.92:0/1088185814 >> 172.21.15.92:0/1088185814 conn(0x7f34c81031e0 msgr2=0x7f34c8105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 -- 172.21.15.92:0/1088185814 shutdown_connections 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.931+0000 7f34cfbb0700 1 -- 172.21.15.92:0/1088185814 wait complete. 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cfbb0700 1 Processor -- start 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cfbb0700 1 -- start start 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cfbb0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cfbb0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34c810c210 con 0x7f34c8107c60 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cd94c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cd94c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41216/0 (socket says 172.21.15.92:41216) 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.932+0000 7f34cd94c700 1 -- 172.21.15.92:0/2328567760 learned_addr learned my addr 172.21.15.92:0/2328567760 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:12.676 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34cd94c700 1 -- 172.21.15.92:0/2328567760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c819f9a0 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34cd94c700 1 --2- 172.21.15.92:0/2328567760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c00 tx=0x7f34b8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8003b20 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34cfbb0700 1 -- 172.21.15.92:0/2328567760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c819fb70 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f34b801a8c0 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b8024940 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34cfbb0700 1 -- 172.21.15.92:0/2328567760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c819ff90 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34b8022020 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.933+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f34b8019610 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.934+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b0005330 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:11.936+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f34b801aa70 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.010+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f34b00058f0 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.010+0000 7f34beffd700 1 -- 172.21.15.92:0/2328567760 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f34b801a430 con 0x7f34c8107c60 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 msgr2=0x7f34c807cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:12.677 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 --2- 172.21.15.92:0/2328567760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34b8000c00 tx=0x7f34b8011b70 comp rx=0 tx=0).stop 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 shutdown_connections 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 --2- 172.21.15.92:0/2328567760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34c8107c60 0x7f34c807cad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 >> 172.21.15.92:0/2328567760 conn(0x7f34c81031e0 msgr2=0x7f34c8103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 shutdown_connections 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:12.012+0000 7f34bcff9700 1 -- 172.21.15.92:0/2328567760 wait complete. 2024-04-26T17:48:12.678 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (1/15)... 2024-04-26T17:48:13.586 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:13 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:13.421+0000 7f3f391ef200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:48:13.587 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:13 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:13.586+0000 7f3f391ef200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:13.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:13 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:13.754+0000 7f3f391ef200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:48:14.327 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:14.036+0000 7f3f391ef200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:48:14.327 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:14.128+0000 7f3f391ef200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:48:14.327 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:14.327+0000 7f3f391ef200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:48:14.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:14.517+0000 7f3f391ef200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:15.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:15 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1956322134' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T17:48:15.456 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:15 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:15.131+0000 7f3f391ef200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:48:15.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:15 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:15.562+0000 7f3f391ef200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:48:15.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:15 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:15.658+0000 7f3f391ef200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T17:48:15.760 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.761 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T17:48:15.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:15.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T17:48:15.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T17:48:15.762 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T17:48:15.770 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T17:48:15.771 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T17:48:04.505778+0000", 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.062+0000 7f4787eef700 1 Processor -- start 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4787eef700 1 -- start start 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4787eef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4787eef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4780108650 con 0x7f4780107c60 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4785c8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:15.772 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4785c8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40722/0 (socket says 172.21.15.92:40722) 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4785c8b700 1 -- 172.21.15.92:0/654412068 learned_addr learned my addr 172.21.15.92:0/654412068 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.063+0000 7f4785c8b700 1 -- 172.21.15.92:0/654412068 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4780108e60 con 0x7f4780107c60 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4785c8b700 1 --2- 172.21.15.92:0/654412068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f477c0098a0 tx=0x7f477c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d78332d0700e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4784c89700 1 -- 172.21.15.92:0/654412068 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c004160 con 0x7f4780107c60 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4784c89700 1 -- 172.21.15.92:0/654412068 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f477c004300 con 0x7f4780107c60 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4784c89700 1 -- 172.21.15.92:0/654412068 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c011af0 con 0x7f4780107c60 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4787eef700 1 -- 172.21.15.92:0/654412068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 msgr2=0x7f4780108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.064+0000 7f4787eef700 1 --2- 172.21.15.92:0/654412068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f477c0098a0 tx=0x7f477c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- 172.21.15.92:0/654412068 shutdown_connections 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 --2- 172.21.15.92:0/654412068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780108080 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- 172.21.15.92:0/654412068 >> 172.21.15.92:0/654412068 conn(0x7f4780103200 msgr2=0x7f4780105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- 172.21.15.92:0/654412068 shutdown_connections 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- 172.21.15.92:0/654412068 wait complete. 2024-04-26T17:48:15.773 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 Processor -- start 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- start start 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.065+0000 7f4787eef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f478010c210 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4785c8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4785c8b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40724/0 (socket says 172.21.15.92:40724) 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4785c8b700 1 -- 172.21.15.92:0/1956322134 learned_addr learned my addr 172.21.15.92:0/1956322134 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4785c8b700 1 -- 172.21.15.92:0/1956322134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4780193310 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4785c8b700 1 --2- 172.21.15.92:0/1956322134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f477c003f40 tx=0x7f477c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c0038b0 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f477c003a50 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4780191500 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c01a5c0 con 0x7f4780107c60 2024-04-26T17:48:15.774 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.066+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4780191a40 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.067+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f477c01a870 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.067+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f477c02dd20 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.067+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4780064a80 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.070+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f477c0248c0 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.158+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4780191d80 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4776ffd700 1 -- 172.21.15.92:0/1956322134 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f477c032030 con 0x7f4780107c60 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 msgr2=0x7f4780192dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4787eef700 1 --2- 172.21.15.92:0/1956322134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f477c003f40 tx=0x7f477c011890 comp rx=0 tx=0).stop 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 shutdown_connections 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4787eef700 1 --2- 172.21.15.92:0/1956322134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4780107c60 0x7f4780192dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.159+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 >> 172.21.15.92:0/1956322134 conn(0x7f4780103200 msgr2=0x7f4780103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.160+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 shutdown_connections 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:15.160+0000 7f4787eef700 1 -- 172.21.15.92:0/1956322134 wait complete. 2024-04-26T17:48:15.775 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (2/15)... 2024-04-26T17:48:16.242 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:15 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:15.860+0000 7f3f391ef200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:48:16.702 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:16.374+0000 7f3f391ef200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:48:16.702 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:16.465+0000 7f3f391ef200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:48:16.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:16.702+0000 7f3f391ef200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:48:16.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:16.832+0000 7f3f391ef200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:48:16.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:16.926+0000 7f3f391ef200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:48:17.337 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:17 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:17.039+0000 7f3f391ef200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:17.337 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:17 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:17.337+0000 7f3f391ef200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:48:18.142 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:17 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:17.936+0000 7f3f391ef200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:48:18.492 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:18.159+0000 7f3f391ef200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: Activating manager daemon x 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: mgrmap e2: x(active, starting, since 0.00318253s) 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: Manager daemon x is now available 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' 2024-04-26T17:48:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' 2024-04-26T17:48:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:18 smithi092 ceph-mon[29156]: from='mgr.14100 172.21.15.92:0/69727045' entity='mgr.x' 2024-04-26T17:48:18.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:18.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:18.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:48:18.853 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-04-26T17:48:18.854 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T17:48:18.855 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T17:48:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T17:48:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T17:48:18.856 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.857 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T17:48:18.858 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:18.859 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T17:48:04.505778+0000", 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.166+0000 7fb3e51c3700 1 Processor -- start 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.166+0000 7fb3e51c3700 1 -- start start 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.166+0000 7fb3e51c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:18.860 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.166+0000 7fb3e51c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e0108600 con 0x7fb3e0107c10 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.166+0000 7fb3ded9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ded9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40744/0 (socket says 172.21.15.92:40744) 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ded9d700 1 -- 172.21.15.92:0/2666943495 learned_addr learned my addr 172.21.15.92:0/2666943495 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ded9d700 1 -- 172.21.15.92:0/2666943495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e0108e10 con 0x7fb3e0107c10 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ded9d700 1 --2- 172.21.15.92:0/2666943495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00098a0 tx=0x7fb3d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c25f1f38dc9f699 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ddd9b700 1 -- 172.21.15.92:0/2666943495 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d0004160 con 0x7fb3e0107c10 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ddd9b700 1 -- 172.21.15.92:0/2666943495 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb3d0004300 con 0x7fb3e0107c10 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.167+0000 7fb3ddd9b700 1 -- 172.21.15.92:0/2666943495 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d0011af0 con 0x7fb3e0107c10 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 -- 172.21.15.92:0/2666943495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 msgr2=0x7fb3e0108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 --2- 172.21.15.92:0/2666943495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00098a0 tx=0x7fb3d0009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 -- 172.21.15.92:0/2666943495 shutdown_connections 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 --2- 172.21.15.92:0/2666943495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e0108030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 -- 172.21.15.92:0/2666943495 >> 172.21.15.92:0/2666943495 conn(0x7fb3e0103210 msgr2=0x7fb3e0105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:18.861 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 -- 172.21.15.92:0/2666943495 shutdown_connections 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.168+0000 7fb3e51c3700 1 -- 172.21.15.92:0/2666943495 wait complete. 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3e51c3700 1 Processor -- start 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3e51c3700 1 -- start start 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3e51c3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3e51c3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e007bff0 con 0x7fb3e0107c10 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3ded9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3ded9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40768/0 (socket says 172.21.15.92:40768) 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.169+0000 7fb3ded9d700 1 -- 172.21.15.92:0/3325608263 learned_addr learned my addr 172.21.15.92:0/3325608263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3ded9d700 1 -- 172.21.15.92:0/3325608263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e010e010 con 0x7fb3e0107c10 2024-04-26T17:48:18.862 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3ded9d700 1 --2- 172.21.15.92:0/3325608263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0003f40 tx=0x7fb3d0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d00038b0 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb3d0003a50 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e010c200 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.170+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d001a5c0 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.171+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e010c740 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.171+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 2) ==== 46314+0+0 (secure 0 0 0) 0x7fb3d001a870 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.172+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e0064a80 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.172+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb3d0024800 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.174+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb3d0019c70 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.250+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb3e01964f0 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.251+0000 7fb3c7fff700 1 -- 172.21.15.92:0/3325608263 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb3d001ab60 con 0x7fb3e0107c10 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.251+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 msgr2=0x7fb3e010dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:18.863 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.251+0000 7fb3e51c3700 1 --2- 172.21.15.92:0/3325608263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0003f40 tx=0x7fb3d0011890 comp rx=0 tx=0).stop 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.251+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 shutdown_connections 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.251+0000 7fb3e51c3700 1 --2- 172.21.15.92:0/3325608263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb3e0107c10 0x7fb3e010dad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.252+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 >> 172.21.15.92:0/3325608263 conn(0x7fb3e0103210 msgr2=0x7fb3e01039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.252+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 shutdown_connections 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:18.252+0000 7fb3e51c3700 1 -- 172.21.15.92:0/3325608263 wait complete. 2024-04-26T17:48:18.864 INFO:teuthology.orchestra.run.smithi092.stdout:mgr not available, waiting (3/15)... 2024-04-26T17:48:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3325608263' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T17:48:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:19 smithi092 ceph-mon[29156]: mgrmap e3: x(active, since 1.00688s) 2024-04-26T17:48:21.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:21 smithi092 ceph-mon[29156]: mgrmap e4: x(active, since 2s) 2024-04-26T17:48:22.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:22 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/535488903' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-26T17:48:22.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:22.292 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "health": { 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 0 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "a" 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:22.293 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.294 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-26T17:48:22.295 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "restful" 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ], 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "modified": "2024-04-26T17:48:04.505778+0000", 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-26T17:48:22.296 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout }, 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f42883dc700 1 Processor -- start 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f42883dc700 1 -- start start 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f42883dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f42883dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f428007d840 con 0x7f428007ee00 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f4286178700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f4286178700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40796/0 (socket says 172.21.15.92:40796) 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.259+0000 7f4286178700 1 -- 172.21.15.92:0/532480863 learned_addr learned my addr 172.21.15.92:0/532480863 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.260+0000 7f4286178700 1 -- 172.21.15.92:0/532480863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428007d9c0 con 0x7f428007ee00 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.260+0000 7f4286178700 1 --2- 172.21.15.92:0/532480863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098a0 tx=0x7f427c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6d6813a821b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.260+0000 7f4285176700 1 -- 172.21.15.92:0/532480863 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c004160 con 0x7f428007ee00 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.260+0000 7f4285176700 1 -- 172.21.15.92:0/532480863 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f427c004300 con 0x7f428007ee00 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.260+0000 7f4285176700 1 -- 172.21.15.92:0/532480863 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c011af0 con 0x7f428007ee00 2024-04-26T17:48:22.297 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- 172.21.15.92:0/532480863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 msgr2=0x7f428007d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 --2- 172.21.15.92:0/532480863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f427c0098a0 tx=0x7f427c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- 172.21.15.92:0/532480863 shutdown_connections 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 --2- 172.21.15.92:0/532480863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428007d300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- 172.21.15.92:0/532480863 >> 172.21.15.92:0/532480863 conn(0x7f42801043c0 msgr2=0x7f42801067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- 172.21.15.92:0/532480863 shutdown_connections 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- 172.21.15.92:0/532480863 wait complete. 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 Processor -- start 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.261+0000 7f42883dc700 1 -- start start 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42883dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42883dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f428010f310 con 0x7f428007ee00 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f4286178700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f4286178700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40810/0 (socket says 172.21.15.92:40810) 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f4286178700 1 -- 172.21.15.92:0/535488903 learned_addr learned my addr 172.21.15.92:0/535488903 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:22.298 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f4286178700 1 -- 172.21.15.92:0/535488903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428019f420 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f4286178700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f427c009fb0 tx=0x7f427c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c0036a0 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f427c01a430 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428019f6b0 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f427c019550 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.262+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42801a23a0 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.263+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f427c019850 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.263+0000 7f42777fe700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 0x7f426c03b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.263+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4280064a80 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.263+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f427c04da30 con 0x7f428007ee00 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.263+0000 7f4285977700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 0x7f426c03b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.264+0000 7f4285977700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 0x7f426c03b9d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4270006fd0 tx=0x7f4270006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:22.299 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.269+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f427c04d450 con 0x7f428007ee00 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.552+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f42801a2570 con 0x7f428007ee00 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.553+0000 7f42777fe700 1 -- 172.21.15.92:0/535488903 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f42801a2570 con 0x7f428007ee00 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 msgr2=0x7f426c03b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 0x7f426c03b9d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4270006fd0 tx=0x7f4270006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 msgr2=0x7f428019eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f427c009fb0 tx=0x7f427c011940 comp rx=0 tx=0).stop 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 shutdown_connections 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f426c039510 0x7f426c03b9d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 --2- 172.21.15.92:0/535488903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f428007ee00 0x7f428019eee0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 >> 172.21.15.92:0/535488903 conn(0x7f42801043c0 msgr2=0x7f4280104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 shutdown_connections 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:21.555+0000 7f42883dc700 1 -- 172.21.15.92:0/535488903 wait complete. 2024-04-26T17:48:22.300 INFO:teuthology.orchestra.run.smithi092.stdout:mgr is available 2024-04-26T17:48:23.424 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:23 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/431868281' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [global] 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout fsid = fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 2024-04-26T17:48:23.433 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout [osd] 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f047347c700 1 Processor -- start 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f047347c700 1 -- start start 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f047347c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f047347c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f046c07ce70 con 0x7f046c109830 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f0471218700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f0471218700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40814/0 (socket says 172.21.15.92:40814) 2024-04-26T17:48:23.434 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.672+0000 7f0471218700 1 -- 172.21.15.92:0/3863242639 learned_addr learned my addr 172.21.15.92:0/3863242639 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.673+0000 7f0471218700 1 -- 172.21.15.92:0/3863242639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c10c160 con 0x7f046c109830 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.673+0000 7f0471218700 1 --2- 172.21.15.92:0/3863242639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f04680098a0 tx=0x7f0468009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382ef978c73dc4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.673+0000 7f0463fff700 1 -- 172.21.15.92:0/3863242639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0468004160 con 0x7f046c109830 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.673+0000 7f0463fff700 1 -- 172.21.15.92:0/3863242639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0468004300 con 0x7f046c109830 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.673+0000 7f0463fff700 1 -- 172.21.15.92:0/3863242639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0468011af0 con 0x7f046c109830 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- 172.21.15.92:0/3863242639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 msgr2=0x7f046c10bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 --2- 172.21.15.92:0/3863242639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f04680098a0 tx=0x7f0468009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- 172.21.15.92:0/3863242639 shutdown_connections 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 --2- 172.21.15.92:0/3863242639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c10bc20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- 172.21.15.92:0/3863242639 >> 172.21.15.92:0/3863242639 conn(0x7f046c103200 msgr2=0x7f046c105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- 172.21.15.92:0/3863242639 shutdown_connections 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- 172.21.15.92:0/3863242639 wait complete. 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 Processor -- start 2024-04-26T17:48:23.435 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.674+0000 7f047347c700 1 -- start start 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f047347c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f047347c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f046c10d0d0 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f0471218700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f0471218700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40822/0 (socket says 172.21.15.92:40822) 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f0471218700 1 -- 172.21.15.92:0/431868281 learned_addr learned my addr 172.21.15.92:0/431868281 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f0471218700 1 -- 172.21.15.92:0/431868281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046c19d210 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f0471218700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0468011ac0 tx=0x7f0468011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0468003970 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0468003b10 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0468024610 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046c19d4a0 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.675+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f046c1a0180 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.676+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f046801a430 con 0x7f046c109830 2024-04-26T17:48:23.436 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.676+0000 7f04627fc700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 0x7f045803ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.676+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f046804d8c0 con 0x7f046c109830 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.676+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046c064a80 con 0x7f046c109830 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.676+0000 7f0470a17700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 0x7f045803ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.677+0000 7f0470a17700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 0x7f045803ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f045c006fd0 tx=0x7f045c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.682+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0468016260 con 0x7f046c109830 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.877+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f046c1a0350 con 0x7f046c109830 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.878+0000 7f04627fc700 1 -- 172.21.15.92:0/431868281 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f046804d2e0 con 0x7f046c109830 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 msgr2=0x7f045803ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 0x7f045803ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f045c006fd0 tx=0x7f045c006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 msgr2=0x7f046c19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0468011ac0 tx=0x7f0468011ba0 comp rx=0 tx=0).stop 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 shutdown_connections 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f0458039560 0x7f045803ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:23.437 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 --2- 172.21.15.92:0/431868281 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f046c109830 0x7f046c19ccd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:23.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 >> 172.21.15.92:0/431868281 conn(0x7f046c103200 msgr2=0x7f046c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:23.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 shutdown_connections 2024-04-26T17:48:23.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:22.881+0000 7f047347c700 1 -- 172.21.15.92:0/431868281 wait complete. 2024-04-26T17:48:23.438 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling cephadm module... 2024-04-26T17:48:24.388 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3878369846' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-26T17:48:24.389 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setuser ceph since I am not root 2024-04-26T17:48:24.389 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setgroup ceph since I am not root 2024-04-26T17:48:24.389 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:24.388+0000 7fe0f565e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:48:24.677 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:24.574+0000 7fe0f565e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:24.677 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:24.677+0000 7fe0f565e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.842+0000 7f6c601cd700 1 Processor -- start 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.842+0000 7f6c601cd700 1 -- start start 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.842+0000 7f6c601cd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.842+0000 7f6c601cd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5807ced0 con 0x7f6c581097e0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5df69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5df69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40832/0 (socket says 172.21.15.92:40832) 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5df69700 1 -- 172.21.15.92:0/4063938485 learned_addr learned my addr 172.21.15.92:0/4063938485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5df69700 1 -- 172.21.15.92:0/4063938485 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5810c110 con 0x7f6c581097e0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5df69700 1 --2- 172.21.15.92:0/4063938485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009e80 tx=0x7f6c4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e961169e24a72532 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5cf67700 1 -- 172.21.15.92:0/4063938485 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48017070 con 0x7f6c581097e0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5cf67700 1 -- 172.21.15.92:0/4063938485 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6c4800b8c0 con 0x7f6c581097e0 2024-04-26T17:48:24.789 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.843+0000 7f6c5cf67700 1 -- 172.21.15.92:0/4063938485 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48004490 con 0x7f6c581097e0 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 -- 172.21.15.92:0/4063938485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 msgr2=0x7f6c5810bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 --2- 172.21.15.92:0/4063938485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009e80 tx=0x7f6c4800b330 comp rx=0 tx=0).stop 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 -- 172.21.15.92:0/4063938485 shutdown_connections 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 --2- 172.21.15.92:0/4063938485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5810bbd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 -- 172.21.15.92:0/4063938485 >> 172.21.15.92:0/4063938485 conn(0x7f6c58103230 msgr2=0x7f6c58105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 -- 172.21.15.92:0/4063938485 shutdown_connections 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 -- 172.21.15.92:0/4063938485 wait complete. 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.844+0000 7f6c601cd700 1 Processor -- start 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c601cd700 1 -- start start 2024-04-26T17:48:24.790 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c601cd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c601cd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5810d0e0 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c5df69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c5df69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40844/0 (socket says 172.21.15.92:40844) 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c5df69700 1 -- 172.21.15.92:0/3878369846 learned_addr learned my addr 172.21.15.92:0/3878369846 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c5df69700 1 -- 172.21.15.92:0/3878369846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5819d160 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c5df69700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b7b0 tx=0x7f6c4800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48020020 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6c48003d10 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5819d3f0 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c48017040 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.845+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c581a00e0 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.846+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f6c48023020 con 0x7f6c581097e0 2024-04-26T17:48:24.791 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.846+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c58064a80 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.846+0000 7f6c56ffd700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 0x7f6c4003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.846+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c4800f050 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.847+0000 7f6c5d768700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 0x7f6c4003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.847+0000 7f6c5d768700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 0x7f6c4003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c006fd0 tx=0x7f6c4c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:23.852+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6c4802a020 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.104+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f6c581a07d0 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.219+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f6c4804d2b0 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.220+0000 7f6c56ffd700 1 -- 172.21.15.92:0/3878369846 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f6c48025400 con 0x7f6c581097e0 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 msgr2=0x7f6c4003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 0x7f6c4003ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c006fd0 tx=0x7f6c4c006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 msgr2=0x7f6c5819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b7b0 tx=0x7f6c4800be90 comp rx=0 tx=0).stop 2024-04-26T17:48:24.792 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 shutdown_connections 2024-04-26T17:48:24.793 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f6c40039560 0x7f6c4003ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:24.793 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 --2- 172.21.15.92:0/3878369846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c581097e0 0x7f6c5819cc20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:24.793 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 >> 172.21.15.92:0/3878369846 conn(0x7f6c58103230 msgr2=0x7f6c58103cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:24.793 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 shutdown_connections 2024-04-26T17:48:24.793 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:24.222+0000 7f6c601cd700 1 -- 172.21.15.92:0/3878369846 wait complete. 2024-04-26T17:48:25.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:25 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3878369846' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-26T17:48:25.413 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:25 smithi092 ceph-mon[29156]: mgrmap e5: x(active, since 6s) 2024-04-26T17:48:25.413 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:24 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:24.994+0000 7fe0f565e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:48:25.413 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:25 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:25.080+0000 7fe0f565e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:48:26.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:26.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-26T17:48:26.071 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427eb8a700 1 Processor -- start 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427eb8a700 1 -- start start 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427eb8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427eb8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4278109c40 con 0x7f4278109250 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427c926700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:26.073 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427c926700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51740/0 (socket says 172.21.15.92:51740) 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.208+0000 7f427c926700 1 -- 172.21.15.92:0/949324714 learned_addr learned my addr 172.21.15.92:0/949324714 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.209+0000 7f427c926700 1 -- 172.21.15.92:0/949324714 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4278109dc0 con 0x7f4278109250 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.209+0000 7f427c926700 1 --2- 172.21.15.92:0/949324714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f426c0098a0 tx=0x7f426c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231edc267193bc4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.209+0000 7f42777fe700 1 -- 172.21.15.92:0/949324714 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426c004160 con 0x7f4278109250 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.209+0000 7f42777fe700 1 -- 172.21.15.92:0/949324714 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f426c004300 con 0x7f4278109250 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.209+0000 7f42777fe700 1 -- 172.21.15.92:0/949324714 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426c011af0 con 0x7f4278109250 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- 172.21.15.92:0/949324714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 msgr2=0x7f4278109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 --2- 172.21.15.92:0/949324714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f426c0098a0 tx=0x7f426c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- 172.21.15.92:0/949324714 shutdown_connections 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 --2- 172.21.15.92:0/949324714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f4278109670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- 172.21.15.92:0/949324714 >> 172.21.15.92:0/949324714 conn(0x7f4278102a00 msgr2=0x7f4278104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- 172.21.15.92:0/949324714 shutdown_connections 2024-04-26T17:48:26.074 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- 172.21.15.92:0/949324714 wait complete. 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 Processor -- start 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.210+0000 7f427eb8a700 1 -- start start 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427eb8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427eb8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4278107af0 con 0x7f4278109250 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427c926700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427c926700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51746/0 (socket says 172.21.15.92:51746) 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427c926700 1 -- 172.21.15.92:0/1838344439 learned_addr learned my addr 172.21.15.92:0/1838344439 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427c926700 1 -- 172.21.15.92:0/1838344439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427819f3f0 con 0x7f4278109250 2024-04-26T17:48:26.075 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427c926700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f426c011ac0 tx=0x7f426c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426c003970 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427eb8a700 1 -- 172.21.15.92:0/1838344439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427819f6e0 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f426c003b10 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f426c024610 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.211+0000 7f427eb8a700 1 -- 172.21.15.92:0/1838344439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42781a2320 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.212+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f426c024890 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.212+0000 7f427eb8a700 1 -- 172.21.15.92:0/1838344439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4278064a80 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.213+0000 7f4275ffb700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 0x7f426803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.213+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f426c04da60 con 0x7f4278109250 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.213+0000 7f4277fff700 1 -- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 msgr2=0x7f426803ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.213+0000 7f4277fff700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 0x7f426803ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:48:26.076 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.217+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f426c02cc30 con 0x7f4278109250 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.414+0000 7f4277fff700 1 -- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 msgr2=0x7f426803ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.414+0000 7f4277fff700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 0x7f426803ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.501+0000 7f427eb8a700 1 -- 172.21.15.92:0/1838344439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f42781a2680 con 0x7f4278109250 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.505+0000 7f4275ffb700 1 -- 172.21.15.92:0/1838344439 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f42781a2680 con 0x7f4278109250 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 msgr2=0x7f426803ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 0x7f426803ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 msgr2=0x7f427819eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f426c011ac0 tx=0x7f426c011ba0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 shutdown_connections 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f42680395b0 0x7f426803ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 --2- 172.21.15.92:0/1838344439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4278109250 0x7f427819eeb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.508+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 >> 172.21.15.92:0/1838344439 conn(0x7f4278102a00 msgr2=0x7f42781954d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.512+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 shutdown_connections 2024-04-26T17:48:26.077 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:25.512+0000 7f42637fe700 1 -- 172.21.15.92:0/1838344439 wait complete. 2024-04-26T17:48:26.078 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-04-26T17:48:26.078 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 5... 2024-04-26T17:48:26.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:26 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1838344439' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T17:48:26.466 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:26.286+0000 7fe0f565e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:48:26.466 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:26.466+0000 7fe0f565e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:26.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:26.644+0000 7fe0f565e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:48:27.041 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:26.944+0000 7fe0f565e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:48:27.457 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:27 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:27.041+0000 7fe0f565e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:48:27.458 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:27 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:27.263+0000 7fe0f565e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:48:27.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:27 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:27.459+0000 7fe0f565e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:28.242 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:28 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:28.060+0000 7fe0f565e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:48:28.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:28 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:28.479+0000 7fe0f565e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:48:28.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:28 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:28.575+0000 7fe0f565e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:48:29.242 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:28 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:28.777+0000 7fe0f565e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:48:29.626 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.294+0000 7fe0f565e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:48:29.627 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.385+0000 7fe0f565e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:48:29.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.627+0000 7fe0f565e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:48:29.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.759+0000 7fe0f565e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:48:29.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.854+0000 7fe0f565e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:48:29.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:29.968+0000 7fe0f565e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:30.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:30.267+0000 7fe0f565e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:48:31.132 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:30.865+0000 7fe0f565e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:48:31.132 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:31.080+0000 7fe0f565e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: Active manager daemon x restarted 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: Activating manager daemon x 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: osdmap e2: 0 total, 0 up, 0 in 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: mgrmap e6: x(active, starting, since 0.0035415s) 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:48:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: Manager daemon x is now available 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:31 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:48:32.358 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:32 smithi092 ceph-mon[29156]: Found migration_current of "None". Setting to last migration. 2024-04-26T17:48:32.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:32 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:48:32.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:32 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:32.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:32 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:32.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:32 smithi092 ceph-mon[29156]: mgrmap e7: x(active, since 1.00561s) 2024-04-26T17:48:32.709 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.491+0000 7f81fb683700 1 Processor -- start 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.491+0000 7f81fb683700 1 -- start start 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81fb683700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81fb683700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4109810 con 0x7f81f4108e20 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81f941f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81f941f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51760/0 (socket says 172.21.15.92:51760) 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81f941f700 1 -- 172.21.15.92:0/4057900428 learned_addr learned my addr 172.21.15.92:0/4057900428 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81f941f700 1 -- 172.21.15.92:0/4057900428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4109f80 con 0x7f81f4108e20 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.492+0000 7f81f941f700 1 --2- 172.21.15.92:0/4057900428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098a0 tx=0x7f81f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b1eb3632ce6ab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81ebfff700 1 -- 172.21.15.92:0/4057900428 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81f0004160 con 0x7f81f4108e20 2024-04-26T17:48:32.710 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81ebfff700 1 -- 172.21.15.92:0/4057900428 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f81f0004300 con 0x7f81f4108e20 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81ebfff700 1 -- 172.21.15.92:0/4057900428 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81f0011af0 con 0x7f81f4108e20 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81fb683700 1 -- 172.21.15.92:0/4057900428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 msgr2=0x7f81f4109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81fb683700 1 --2- 172.21.15.92:0/4057900428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81f00098a0 tx=0x7f81f0009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81fb683700 1 -- 172.21.15.92:0/4057900428 shutdown_connections 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81fb683700 1 --2- 172.21.15.92:0/4057900428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f4109240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.493+0000 7f81fb683700 1 -- 172.21.15.92:0/4057900428 >> 172.21.15.92:0/4057900428 conn(0x7f81f4104400 msgr2=0x7f81f4106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 -- 172.21.15.92:0/4057900428 shutdown_connections 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 -- 172.21.15.92:0/4057900428 wait complete. 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 Processor -- start 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 -- start start 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.494+0000 7f81fb683700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410d330 con 0x7f81f4108e20 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81f941f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:32.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81f941f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51764/0 (socket says 172.21.15.92:51764) 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81f941f700 1 -- 172.21.15.92:0/3410526472 learned_addr learned my addr 172.21.15.92:0/3410526472 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81f941f700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f407f0d0 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81f941f700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81f00117b0 tx=0x7f81f0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81f0003af0 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f407d2c0 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f81f0020070 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81f0019630 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.495+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f407d800 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.496+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f81f00198f0 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.496+0000 7f81ea7fc700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.496+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f81e003c180 con 0x7f81e00395b0 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.497+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f81f004dba0 con 0x7f81f4108e20 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.496+0000 7f81f8c1e700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.497+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:48:32.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.698+0000 7f81f8c1e700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:26.698+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:27.099+0000 7f81f8c1e700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:27.099+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:27.900+0000 7f81f8c1e700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:27.900+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:29.501+0000 7f81f8c1e700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/1516469819 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:29.501+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:31.083+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f81f002bd00 con 0x7f81f4108e20 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:31.084+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 msgr2=0x7f81e003ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:31.084+0000 7f81ea7fc700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.085+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f81f004f7c0 con 0x7f81f4108e20 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.085+0000 7f81ea7fc700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 0x7f81e003f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.085+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f81f0017ec0 con 0x7f81e003cea0 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.085+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 0x7f81e003f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:32.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.086+0000 7f81f8c1e700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 0x7f81e003f290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f81e4003a10 tx=0x7f81e4009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.087+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f81f0017ec0 con 0x7f81e003cea0 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f81f406a530 con 0x7f81e003cea0 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81ea7fc700 1 -- 172.21.15.92:0/3410526472 <== mgr.14120 v2:172.21.15.92:6800/2200342511 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f81f406a530 con 0x7f81e003cea0 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 msgr2=0x7f81e003f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 0x7f81e003f290 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f81e4003a10 tx=0x7f81e4009290 comp rx=0 tx=0).stop 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 msgr2=0x7f81f407eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81f00117b0 tx=0x7f81f0011b70 comp rx=0 tx=0).stop 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 shutdown_connections 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f81e003cea0 0x7f81e003f290 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81f4108e20 0x7f81f407eb90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 --2- 172.21.15.92:0/3410526472 >> [v2:172.21.15.92:6800/1516469819,v1:172.21.15.92:6801/1516469819] conn(0x7f81e00395b0 0x7f81e003ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.095+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 >> 172.21.15.92:0/3410526472 conn(0x7f81f4104400 msgr2=0x7f81f4104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:32.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.096+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 shutdown_connections 2024-04-26T17:48:32.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:32.096+0000 7f81fb683700 1 -- 172.21.15.92:0/3410526472 wait complete. 2024-04-26T17:48:32.715 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 5 is available 2024-04-26T17:48:32.715 INFO:teuthology.orchestra.run.smithi092.stdout:Setting orchestrator backend to cephadm... 2024-04-26T17:48:33.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:31] ENGINE Bus STARTING 2024-04-26T17:48:33.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:32] ENGINE Serving on http://172.21.15.92:8765 2024-04-26T17:48:33.359 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T17:48:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T17:48:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:32] ENGINE Serving on https://172.21.15.92:7150 2024-04-26T17:48:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:32] ENGINE Bus STARTED 2024-04-26T17:48:33.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:33 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:33.917 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94fa396700 1 Processor -- start 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94fa396700 1 -- start start 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94fa396700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94fa396700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94f4109750 con 0x7f94f4108d60 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51854/0 (socket says 172.21.15.92:51854) 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94f3fff700 1 -- 172.21.15.92:0/155154624 learned_addr learned my addr 172.21.15.92:0/155154624 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.132+0000 7f94f3fff700 1 -- 172.21.15.92:0/155154624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f4109f10 con 0x7f94f4108d60 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94f3fff700 1 --2- 172.21.15.92:0/155154624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f94e40098a0 tx=0x7f94e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb74a84981df88e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94f2ffd700 1 -- 172.21.15.92:0/155154624 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e4004160 con 0x7f94f4108d60 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94f2ffd700 1 -- 172.21.15.92:0/155154624 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f94e4004300 con 0x7f94f4108d60 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94f2ffd700 1 -- 172.21.15.92:0/155154624 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e4011af0 con 0x7f94f4108d60 2024-04-26T17:48:33.924 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 -- 172.21.15.92:0/155154624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 msgr2=0x7f94f4109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 --2- 172.21.15.92:0/155154624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f94e40098a0 tx=0x7f94e4009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 -- 172.21.15.92:0/155154624 shutdown_connections 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 --2- 172.21.15.92:0/155154624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f4109180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 -- 172.21.15.92:0/155154624 >> 172.21.15.92:0/155154624 conn(0x7f94f4104300 msgr2=0x7f94f4106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 -- 172.21.15.92:0/155154624 shutdown_connections 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.133+0000 7f94fa396700 1 -- 172.21.15.92:0/155154624 wait complete. 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94fa396700 1 Processor -- start 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94fa396700 1 -- start start 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94fa396700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94fa396700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94f410d2c0 con 0x7f94f4108d60 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51866/0 (socket says 172.21.15.92:51866) 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.134+0000 7f94f3fff700 1 -- 172.21.15.92:0/218003983 learned_addr learned my addr 172.21.15.92:0/218003983 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:33.925 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.135+0000 7f94f3fff700 1 -- 172.21.15.92:0/218003983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f407f0d0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.135+0000 7f94f3fff700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f94e4003f40 tx=0x7f94e4011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.137+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e40038b0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.137+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f94e4003a50 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.137+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f407d2c0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.137+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e401a5c0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.137+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f407d800 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.138+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f4064a80 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.141+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f94e401a8c0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.141+0000 7f94f17fa700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 0x7f94dc03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.141+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f94e404dde0 con 0x7f94f4108d60 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.141+0000 7f94f37fe700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 0x7f94dc03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.141+0000 7f94f37fe700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 0x7f94dc03ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94e8006fd0 tx=0x7f94e8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:33.926 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.146+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f94e404c890 con 0x7f94f4108d60 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.360+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f94f407e060 con 0x7f94dc039560 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.366+0000 7f94f17fa700 1 -- 172.21.15.92:0/218003983 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f94f407e060 con 0x7f94dc039560 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 msgr2=0x7f94dc03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 0x7f94dc03ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94e8006fd0 tx=0x7f94e8006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 msgr2=0x7f94f407eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f94e4003f40 tx=0x7f94e4011890 comp rx=0 tx=0).stop 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 shutdown_connections 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f94dc039560 0x7f94dc03ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 --2- 172.21.15.92:0/218003983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94f4108d60 0x7f94f407eb90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 >> 172.21.15.92:0/218003983 conn(0x7f94f4104300 msgr2=0x7f94f4104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 shutdown_connections 2024-04-26T17:48:33.927 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:33.368+0000 7f94fa396700 1 -- 172.21.15.92:0/218003983 wait complete. 2024-04-26T17:48:34.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:34 smithi092 ceph-mon[29156]: mgrmap e8: x(active, since 2s) 2024-04-26T17:48:34.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:34 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:34.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:34 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:35.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-26T17:48:35.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.333+0000 7fb8c114a700 1 Processor -- start 2024-04-26T17:48:35.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.333+0000 7fb8c114a700 1 -- start start 2024-04-26T17:48:35.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.333+0000 7fb8c114a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:35.128 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.333+0000 7fb8c114a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc07ce70 con 0x7fb8bc109840 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51872/0 (socket says 172.21.15.92:51872) 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8bad9d700 1 -- 172.21.15.92:0/3545792014 learned_addr learned my addr 172.21.15.92:0/3545792014 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8bad9d700 1 -- 172.21.15.92:0/3545792014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc10c170 con 0x7fb8bc109840 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8bad9d700 1 --2- 172.21.15.92:0/3545792014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00098a0 tx=0x7fb8b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb1365b040d1712 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8b9d9b700 1 -- 172.21.15.92:0/3545792014 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8b0004160 con 0x7fb8bc109840 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8b9d9b700 1 -- 172.21.15.92:0/3545792014 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb8b0004300 con 0x7fb8bc109840 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.334+0000 7fb8b9d9b700 1 -- 172.21.15.92:0/3545792014 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8b0011af0 con 0x7fb8bc109840 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 -- 172.21.15.92:0/3545792014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 msgr2=0x7fb8bc10bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 --2- 172.21.15.92:0/3545792014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00098a0 tx=0x7fb8b0009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:35.129 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 -- 172.21.15.92:0/3545792014 shutdown_connections 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 --2- 172.21.15.92:0/3545792014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc10bc30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 -- 172.21.15.92:0/3545792014 >> 172.21.15.92:0/3545792014 conn(0x7fb8bc103210 msgr2=0x7fb8bc105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 -- 172.21.15.92:0/3545792014 shutdown_connections 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.335+0000 7fb8c114a700 1 -- 172.21.15.92:0/3545792014 wait complete. 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8c114a700 1 Processor -- start 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8c114a700 1 -- start start 2024-04-26T17:48:35.130 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8c114a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8c114a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc10d0e0 con 0x7fb8bc109840 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8bad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51878/0 (socket says 172.21.15.92:51878) 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8bad9d700 1 -- 172.21.15.92:0/4097892308 learned_addr learned my addr 172.21.15.92:0/4097892308 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8bad9d700 1 -- 172.21.15.92:0/4097892308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc19d190 con 0x7fb8bc109840 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.336+0000 7fb8bad9d700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0003f40 tx=0x7fb8b0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.337+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8b00038b0 con 0x7fb8bc109840 2024-04-26T17:48:35.131 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.337+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb8b0003a50 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.337+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc19d420 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.337+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8b001a5c0 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.337+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc1a0110 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fb8b001a8c0 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc06a530 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8a3fff700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 0x7fb8a403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb8b004dae0 con 0x7fb8bc109840 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8ba59c700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 0x7fb8a403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:35.132 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.338+0000 7fb8ba59c700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 0x7fb8a403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.343+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb8b0019c70 con 0x7fb8bc109840 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.551+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fb8bc1043e0 con 0x7fb8a4039560 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.552+0000 7fb8a3fff700 1 -- 172.21.15.92:0/4097892308 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fb8bc1043e0 con 0x7fb8a4039560 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 msgr2=0x7fb8a403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 0x7fb8a403ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac006fd0 tx=0x7fb8ac006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 msgr2=0x7fb8bc19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0003f40 tx=0x7fb8b0011890 comp rx=0 tx=0).stop 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 shutdown_connections 2024-04-26T17:48:35.133 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fb8a4039560 0x7fb8a403ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:35.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 --2- 172.21.15.92:0/4097892308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb8bc109840 0x7fb8bc19cc50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:35.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.554+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 >> 172.21.15.92:0/4097892308 conn(0x7fb8bc103210 msgr2=0x7fb8bc103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:35.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.555+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 shutdown_connections 2024-04-26T17:48:35.134 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:34.555+0000 7fb8c114a700 1 -- 172.21.15.92:0/4097892308 wait complete. 2024-04-26T17:48:35.134 INFO:teuthology.orchestra.run.smithi092.stdout:Generating ssh key... 2024-04-26T17:48:35.373 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:35 smithi092 ceph-mon[29156]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:36.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-mon[29156]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: Generating public/private rsa key pair. 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: Your identification has been saved in /tmp/tmpga17rgbd/key. 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: Your public key has been saved in /tmp/tmpga17rgbd/key.pub. 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: The key fingerprint is: 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: SHA256:XVWFGbCtEH87Uu8ruHWuqAmLSv0+T+FIw1APPexCyUY ceph-fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: The key's randomart image is: 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: +---[RSA 3072]----+ 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | oE+ . ..o=+| 2024-04-26T17:48:36.390 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | .=o+ o +o | 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | .o ..o + + | 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | o. o o + o | 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | +S.. o o .| 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | . . + . . o | 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | . . o o .. ..| 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | . o.+ ..o.o .| 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: | ....+o+.o..oo | 2024-04-26T17:48:36.391 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: +----[SHA256]-----+ 2024-04-26T17:48:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.590+0000 7f83981bd700 1 Processor -- start 2024-04-26T17:48:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f83981bd700 1 -- start start 2024-04-26T17:48:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f83981bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:36.935 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f83981bd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f839007ced0 con 0x7f8390109780 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f8395f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f8395f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36448/0 (socket says 172.21.15.92:36448) 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f8395f59700 1 -- 172.21.15.92:0/3807628821 learned_addr learned my addr 172.21.15.92:0/3807628821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f8395f59700 1 -- 172.21.15.92:0/3807628821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839010c0b0 con 0x7f8390109780 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.591+0000 7f8395f59700 1 --2- 172.21.15.92:0/3807628821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83800098a0 tx=0x7f8380009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42d719556451bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f8394f57700 1 -- 172.21.15.92:0/3807628821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8380004160 con 0x7f8390109780 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f8394f57700 1 -- 172.21.15.92:0/3807628821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8380004300 con 0x7f8390109780 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f8394f57700 1 -- 172.21.15.92:0/3807628821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8380011af0 con 0x7f8390109780 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 -- 172.21.15.92:0/3807628821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 msgr2=0x7f839010bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 --2- 172.21.15.92:0/3807628821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83800098a0 tx=0x7f8380009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 -- 172.21.15.92:0/3807628821 shutdown_connections 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 --2- 172.21.15.92:0/3807628821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839010bb70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:36.936 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 -- 172.21.15.92:0/3807628821 >> 172.21.15.92:0/3807628821 conn(0x7f8390103210 msgr2=0x7f8390105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 -- 172.21.15.92:0/3807628821 shutdown_connections 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.592+0000 7f83981bd700 1 -- 172.21.15.92:0/3807628821 wait complete. 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f83981bd700 1 Processor -- start 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f83981bd700 1 -- start start 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f83981bd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f83981bd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f839010d080 con 0x7f8390109780 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f8395f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f8395f59700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36460/0 (socket says 172.21.15.92:36460) 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f8395f59700 1 -- 172.21.15.92:0/1673192469 learned_addr learned my addr 172.21.15.92:0/1673192469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.593+0000 7f8395f59700 1 -- 172.21.15.92:0/1673192469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839019d1c0 con 0x7f8390109780 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f8395f59700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8380011ac0 tx=0x7f8380011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8380003b20 con 0x7f8390109780 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f838001a8c0 con 0x7f8390109780 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83800248d0 con 0x7f8390109780 2024-04-26T17:48:36.937 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839019d450 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.594+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83901a0140 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8380022020 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f8386ffd700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 0x7f837c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8390064a80 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f838004d890 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f8395758700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 0x7f837c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.595+0000 7f8395758700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 0x7f837c03ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f838c006fd0 tx=0x7f838c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.600+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f838001aa70 con 0x7f8390109780 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:35.804+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f83901044d0 con 0x7f837c0395b0 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.377+0000 7f8386ffd700 1 -- 172.21.15.92:0/1673192469 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f83901044d0 con 0x7f837c0395b0 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 msgr2=0x7f837c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 0x7f837c03ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f838c006fd0 tx=0x7f838c006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 msgr2=0x7f839019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:36.938 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8380011ac0 tx=0x7f8380011ba0 comp rx=0 tx=0).stop 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 shutdown_connections 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f837c0395b0 0x7f837c03ba70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 --2- 172.21.15.92:0/1673192469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8390109780 0x7f839019cc80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 >> 172.21.15.92:0/1673192469 conn(0x7f8390103210 msgr2=0x7f8390103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 shutdown_connections 2024-04-26T17:48:36.939 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:36.379+0000 7f83981bd700 1 -- 172.21.15.92:0/1673192469 wait complete. 2024-04-26T17:48:37.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:37 smithi092 ceph-mon[29156]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:37.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:37 smithi092 ceph-mon[29156]: Generating ssh key... 2024-04-26T17:48:37.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:37 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:37.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:37 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:38.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:48:38.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.367+0000 7f0cfbc89700 1 Processor -- start 2024-04-26T17:48:38.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.367+0000 7f0cfbc89700 1 -- start start 2024-04-26T17:48:38.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cfbc89700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:38.141 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cfbc89700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf4109c60 con 0x7f0cf4109270 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf9a25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf9a25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36476/0 (socket says 172.21.15.92:36476) 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf9a25700 1 -- 172.21.15.92:0/1103884290 learned_addr learned my addr 172.21.15.92:0/1103884290 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf9a25700 1 -- 172.21.15.92:0/1103884290 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf4107e80 con 0x7f0cf4109270 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf9a25700 1 --2- 172.21.15.92:0/1103884290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009e80 tx=0x7f0ce800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a3a9a2b520f036 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf8a23700 1 -- 172.21.15.92:0/1103884290 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce8017070 con 0x7f0cf4109270 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf8a23700 1 -- 172.21.15.92:0/1103884290 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0ce800b8c0 con 0x7f0cf4109270 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.368+0000 7f0cf8a23700 1 -- 172.21.15.92:0/1103884290 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce8004490 con 0x7f0cf4109270 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 -- 172.21.15.92:0/1103884290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 msgr2=0x7f0cf4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/1103884290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009e80 tx=0x7f0ce800b330 comp rx=0 tx=0).stop 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 -- 172.21.15.92:0/1103884290 shutdown_connections 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/1103884290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf4109690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:38.142 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 -- 172.21.15.92:0/1103884290 >> 172.21.15.92:0/1103884290 conn(0x7f0cf4102a30 msgr2=0x7f0cf4104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 -- 172.21.15.92:0/1103884290 shutdown_connections 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 -- 172.21.15.92:0/1103884290 wait complete. 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.369+0000 7f0cfbc89700 1 Processor -- start 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cfbc89700 1 -- start start 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cfbc89700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cfbc89700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf410c240 con 0x7f0cf4109270 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf9a25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf9a25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36480/0 (socket says 172.21.15.92:36480) 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf9a25700 1 -- 172.21.15.92:0/2362822253 learned_addr learned my addr 172.21.15.92:0/2362822253 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf9a25700 1 -- 172.21.15.92:0/2362822253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf419d1c0 con 0x7f0cf4109270 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf9a25700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b7b0 tx=0x7f0ce800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce8020020 con 0x7f0cf4109270 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0ce8012430 con 0x7f0cf4109270 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf419d450 con 0x7f0cf4109270 2024-04-26T17:48:38.143 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ce8017040 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.370+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf41a0140 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.371+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f0ce8023020 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.371+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf4064a80 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.372+0000 7f0cf2ffd700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 0x7f0ce403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.372+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0ce800f050 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.372+0000 7f0cf9224700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 0x7f0ce403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.372+0000 7f0cf9224700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 0x7f0ce403ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0006fd0 tx=0x7f0ce0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.377+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0ce802a020 con 0x7f0cf4109270 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.576+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0cf402e840 con 0x7f0ce4039560 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.577+0000 7f0cf2ffd700 1 -- 172.21.15.92:0/2362822253 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0cf402e840 con 0x7f0ce4039560 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 msgr2=0x7f0ce403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 0x7f0ce403ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0006fd0 tx=0x7f0ce0006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 msgr2=0x7f0cf419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800b7b0 tx=0x7f0ce800be20 comp rx=0 tx=0).stop 2024-04-26T17:48:38.144 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 shutdown_connections 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f0ce4039560 0x7f0ce403ba20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 --2- 172.21.15.92:0/2362822253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0cf4109270 0x7f0cf419cc80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 >> 172.21.15.92:0/2362822253 conn(0x7f0cf4102a30 msgr2=0x7f0cf4103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 shutdown_connections 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:37.579+0000 7f0cfbc89700 1 -- 172.21.15.92:0/2362822253 wait complete. 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:Adding key to root@localhost authorized_keys... 2024-04-26T17:48:38.145 INFO:teuthology.orchestra.run.smithi092.stdout:Adding host smithi092... 2024-04-26T17:48:38.452 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:38 smithi092 ceph-mon[29156]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:39.594 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:39 smithi092 ceph-mon[29156]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:40 smithi092 ceph-mon[29156]: Deploying cephadm binary to smithi092 2024-04-26T17:48:43.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Added host 'smithi092' with addr '172.21.15.92' 2024-04-26T17:48:43.448 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f522a110700 1 Processor -- start 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f522a110700 1 -- start start 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f522a110700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f522a110700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5224109770 con 0x7f5224108d80 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f52237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f52237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36492/0 (socket says 172.21.15.92:36492) 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f52237fe700 1 -- 172.21.15.92:0/1845908892 learned_addr learned my addr 172.21.15.92:0/1845908892 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.556+0000 7f52237fe700 1 -- 172.21.15.92:0/1845908892 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5224109f30 con 0x7f5224108d80 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f52237fe700 1 --2- 172.21.15.92:0/1845908892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f52140098a0 tx=0x7f5214009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e286d6327ab52ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f52227fc700 1 -- 172.21.15.92:0/1845908892 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5214004160 con 0x7f5224108d80 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f52227fc700 1 -- 172.21.15.92:0/1845908892 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5214004300 con 0x7f5224108d80 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f52227fc700 1 -- 172.21.15.92:0/1845908892 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5214011af0 con 0x7f5224108d80 2024-04-26T17:48:43.449 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 -- 172.21.15.92:0/1845908892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 msgr2=0x7f52241091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 --2- 172.21.15.92:0/1845908892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f52140098a0 tx=0x7f5214009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 -- 172.21.15.92:0/1845908892 shutdown_connections 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 --2- 172.21.15.92:0/1845908892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f52241091a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 -- 172.21.15.92:0/1845908892 >> 172.21.15.92:0/1845908892 conn(0x7f5224104340 msgr2=0x7f5224106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 -- 172.21.15.92:0/1845908892 shutdown_connections 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.557+0000 7f522a110700 1 -- 172.21.15.92:0/1845908892 wait complete. 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f522a110700 1 Processor -- start 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f522a110700 1 -- start start 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f522a110700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f522a110700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f522410d2e0 con 0x7f5224108d80 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f52237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:43.450 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f52237fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36500/0 (socket says 172.21.15.92:36500) 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.558+0000 7f52237fe700 1 -- 172.21.15.92:0/3898801300 learned_addr learned my addr 172.21.15.92:0/3898801300 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f52237fe700 1 -- 172.21.15.92:0/3898801300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522419d220 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f52237fe700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52140117b0 tx=0x7f5214011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5214003af0 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5214020070 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522419d4b0 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5214019630 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.559+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52241a0190 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f52140198f0 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f5220ff9700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 0x7f520c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5224064a80 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f521404dd90 con 0x7f5224108d80 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f5222ffd700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 0x7f520c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:43.451 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.560+0000 7f5222ffd700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 0x7f520c03ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.565+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f52140042a0 con 0x7f5224108d80 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:38.768+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "addr": "172.21.15.92", "target": ["mon-mgr", ""]}) -- 0x7f5224105600 con 0x7f520c0395b0 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.878+0000 7f5220ff9700 1 -- 172.21.15.92:0/3898801300 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5224105600 con 0x7f520c0395b0 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.880+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 msgr2=0x7f520c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.880+0000 7f522a110700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 0x7f520c03ba70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5218006fd0 tx=0x7f5218006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.880+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 msgr2=0x7f522419cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.880+0000 7f522a110700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f52140117b0 tx=0x7f5214011b70 comp rx=0 tx=0).stop 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 shutdown_connections 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f520c0395b0 0x7f520c03ba70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 --2- 172.21.15.92:0/3898801300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5224108d80 0x7f522419cce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 >> 172.21.15.92:0/3898801300 conn(0x7f5224104340 msgr2=0x7f5224104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 shutdown_connections 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:42.881+0000 7f522a110700 1 -- 172.21.15.92:0/3898801300 wait complete. 2024-04-26T17:48:43.452 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mon service... 2024-04-26T17:48:44.157 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:43 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:44.157 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:43 smithi092 ceph-mon[29156]: Added host smithi092 2024-04-26T17:48:44.157 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:43 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:45.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-26T17:48:45.110 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.928+0000 7f8343a45700 1 Processor -- start 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.928+0000 7f8343a45700 1 -- start start 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.928+0000 7f8343a45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.928+0000 7f8343a45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f833c07ce90 con 0x7f833c1097c0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f83417e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f83417e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36504/0 (socket says 172.21.15.92:36504) 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f83417e1700 1 -- 172.21.15.92:0/1893860116 learned_addr learned my addr 172.21.15.92:0/1893860116 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f83417e1700 1 -- 172.21.15.92:0/1893860116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c10c0f0 con 0x7f833c1097c0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f83417e1700 1 --2- 172.21.15.92:0/1893860116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8338009e80 tx=0x7f833800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7208057d11d401 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f8333fff700 1 -- 172.21.15.92:0/1893860116 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338017070 con 0x7f833c1097c0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f8333fff700 1 -- 172.21.15.92:0/1893860116 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f833800b8c0 con 0x7f833c1097c0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.929+0000 7f8333fff700 1 -- 172.21.15.92:0/1893860116 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338004490 con 0x7f833c1097c0 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 -- 172.21.15.92:0/1893860116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 msgr2=0x7f833c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:45.111 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 --2- 172.21.15.92:0/1893860116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8338009e80 tx=0x7f833800b330 comp rx=0 tx=0).stop 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 -- 172.21.15.92:0/1893860116 shutdown_connections 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 --2- 172.21.15.92:0/1893860116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c10bbb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 -- 172.21.15.92:0/1893860116 >> 172.21.15.92:0/1893860116 conn(0x7f833c103210 msgr2=0x7f833c105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 -- 172.21.15.92:0/1893860116 shutdown_connections 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.930+0000 7f8343a45700 1 -- 172.21.15.92:0/1893860116 wait complete. 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 Processor -- start 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 -- start start 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f833c10d0b0 con 0x7f833c1097c0 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83417e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83417e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36518/0 (socket says 172.21.15.92:36518) 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83417e1700 1 -- 172.21.15.92:0/3690961691 learned_addr learned my addr 172.21.15.92:0/3690961691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83417e1700 1 -- 172.21.15.92:0/3690961691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c19d180 con 0x7f833c1097c0 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83417e1700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f833800b7b0 tx=0x7f833800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:45.112 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338020020 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c19d410 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8338012430 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8338017040 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.931+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1a0100 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.932+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8338023020 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.932+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c064a80 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.932+0000 7f83327fc700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 0x7f832803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.932+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f833800f050 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.932+0000 7f8340fe0700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 0x7f832803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.933+0000 7f8340fe0700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 0x7f832803ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f832c006fd0 tx=0x7f832c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:43.938+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f833802a020 con 0x7f833c1097c0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.156+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f833c104410 con 0x7f83280395b0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.164+0000 7f83327fc700 1 -- 172.21.15.92:0/3690961691 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f833c104410 con 0x7f83280395b0 2024-04-26T17:48:45.113 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 msgr2=0x7f832803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 0x7f832803ba70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f832c006fd0 tx=0x7f832c006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 msgr2=0x7f833c19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f833800b7b0 tx=0x7f833800be20 comp rx=0 tx=0).stop 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 shutdown_connections 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f83280395b0 0x7f832803ba70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 --2- 172.21.15.92:0/3690961691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f833c1097c0 0x7f833c19cc40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 >> 172.21.15.92:0/3690961691 conn(0x7f833c103210 msgr2=0x7f833c103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 shutdown_connections 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:44.166+0000 7f8343a45700 1 -- 172.21.15.92:0/3690961691 wait complete. 2024-04-26T17:48:45.114 INFO:teuthology.orchestra.run.smithi092.stdout:Deploying unmanaged mgr service... 2024-04-26T17:48:45.339 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:45 smithi092 ceph-mon[29156]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:45.339 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:45 smithi092 ceph-mon[29156]: Saving service mon spec with placement count:5 2024-04-26T17:48:45.339 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:45 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:46.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-26T17:48:46.711 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6797d96700 1 Processor -- start 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6797d96700 1 -- start start 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6797d96700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6797d96700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67901097f0 con 0x7f6790108e00 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6795b32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6795b32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60790/0 (socket says 172.21.15.92:60790) 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6795b32700 1 -- 172.21.15.92:0/2103954026 learned_addr learned my addr 172.21.15.92:0/2103954026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.555+0000 7f6795b32700 1 -- 172.21.15.92:0/2103954026 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6790109f60 con 0x7f6790108e00 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6795b32700 1 --2- 172.21.15.92:0/2103954026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098a0 tx=0x7f678c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abd9b2d6138d963 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6794b30700 1 -- 172.21.15.92:0/2103954026 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c004160 con 0x7f6790108e00 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6794b30700 1 -- 172.21.15.92:0/2103954026 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f678c004300 con 0x7f6790108e00 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6794b30700 1 -- 172.21.15.92:0/2103954026 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c011af0 con 0x7f6790108e00 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 -- 172.21.15.92:0/2103954026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 msgr2=0x7f6790109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 --2- 172.21.15.92:0/2103954026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f678c0098a0 tx=0x7f678c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:46.712 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 -- 172.21.15.92:0/2103954026 shutdown_connections 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 --2- 172.21.15.92:0/2103954026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f6790109220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 -- 172.21.15.92:0/2103954026 >> 172.21.15.92:0/2103954026 conn(0x7f67901043c0 msgr2=0x7f67901067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 -- 172.21.15.92:0/2103954026 shutdown_connections 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.556+0000 7f6797d96700 1 -- 172.21.15.92:0/2103954026 wait complete. 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6797d96700 1 Processor -- start 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6797d96700 1 -- start start 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6797d96700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6797d96700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f679010d310 con 0x7f6790108e00 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6795b32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6795b32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60806/0 (socket says 172.21.15.92:60806) 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.557+0000 7f6795b32700 1 -- 172.21.15.92:0/307549937 learned_addr learned my addr 172.21.15.92:0/307549937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6795b32700 1 -- 172.21.15.92:0/307549937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679019d250 con 0x7f6790108e00 2024-04-26T17:48:46.713 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6795b32700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f678c0117b0 tx=0x7f678c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c003af0 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f678c020070 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f678c019630 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679019d4e0 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.558+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67901a01c0 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f678c01a430 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6790064a80 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6786ffd700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 0x7f677c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f678c04db40 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6795331700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 0x7f677c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.559+0000 7f6795331700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 0x7f677c03ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.564+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f678c02b260 con 0x7f6790108e00 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.780+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6790105600 con 0x7f677c0395b0 2024-04-26T17:48:46.714 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.784+0000 7f6786ffd700 1 -- 172.21.15.92:0/307549937 <== mgr.14120 v2:172.21.15.92:6800/2200342511 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6790105600 con 0x7f677c0395b0 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 msgr2=0x7f677c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 0x7f677c03ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6780006fd0 tx=0x7f6780006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 msgr2=0x7f679019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f678c0117b0 tx=0x7f678c011b70 comp rx=0 tx=0).stop 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 shutdown_connections 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f677c0395b0 0x7f677c03ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 --2- 172.21.15.92:0/307549937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6790108e00 0x7f679019cd10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 >> 172.21.15.92:0/307549937 conn(0x7f67901043c0 msgr2=0x7f6790104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 shutdown_connections 2024-04-26T17:48:46.715 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:45.786+0000 7f6797d96700 1 -- 172.21.15.92:0/307549937 wait complete. 2024-04-26T17:48:46.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:46 smithi092 ceph-mon[29156]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:48:46.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:46 smithi092 ceph-mon[29156]: Saving service mgr spec with placement count:2 2024-04-26T17:48:46.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:46 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:46.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:46 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:47.943 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:47 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:47.943 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:47 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/706132945' entity='client.admin' 2024-04-26T17:48:47.950 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.145+0000 7f8281177700 1 Processor -- start 2024-04-26T17:48:47.950 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.145+0000 7f8281177700 1 -- start start 2024-04-26T17:48:47.950 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f8281177700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:47.950 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f8281177700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f827c108b80 con 0x7f827c108190 2024-04-26T17:48:47.950 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f827ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f827ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60810/0 (socket says 172.21.15.92:60810) 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f827ad9d700 1 -- 172.21.15.92:0/2812870396 learned_addr learned my addr 172.21.15.92:0/2812870396 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f827ad9d700 1 -- 172.21.15.92:0/2812870396 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c108eb0 con 0x7f827c108190 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f827ad9d700 1 --2- 172.21.15.92:0/2812870396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098a0 tx=0x7f826c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba8d1e1023691e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.146+0000 7f8279d9b700 1 -- 172.21.15.92:0/2812870396 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c004160 con 0x7f827c108190 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8279d9b700 1 -- 172.21.15.92:0/2812870396 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c004300 con 0x7f827c108190 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8279d9b700 1 -- 172.21.15.92:0/2812870396 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c011a20 con 0x7f827c108190 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 -- 172.21.15.92:0/2812870396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 msgr2=0x7f827c1085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 --2- 172.21.15.92:0/2812870396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098a0 tx=0x7f826c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:47.951 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 -- 172.21.15.92:0/2812870396 shutdown_connections 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 --2- 172.21.15.92:0/2812870396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c1085b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 -- 172.21.15.92:0/2812870396 >> 172.21.15.92:0/2812870396 conn(0x7f827c102a30 msgr2=0x7f827c104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 -- 172.21.15.92:0/2812870396 shutdown_connections 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.147+0000 7f8281177700 1 -- 172.21.15.92:0/2812870396 wait complete. 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f8281177700 1 Processor -- start 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f8281177700 1 -- start start 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f8281177700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f8281177700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f827c10c260 con 0x7f827c108190 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f827ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f827ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60812/0 (socket says 172.21.15.92:60812) 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.148+0000 7f827ad9d700 1 -- 172.21.15.92:0/706132945 learned_addr learned my addr 172.21.15.92:0/706132945 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f827ad9d700 1 -- 172.21.15.92:0/706132945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f827c193360 con 0x7f827c108190 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f827ad9d700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f826c000c00 tx=0x7f826c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:47.952 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c003aa0 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f826c01b8f0 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f827c191550 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c023870 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.149+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827c191a90 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.150+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827c064a80 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.150+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f826c023b20 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.150+0000 7f8263fff700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 0x7f826403bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.150+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f826c04de70 con 0x7f827c108190 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.150+0000 7f827a59c700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 0x7f826403bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:47.953 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.151+0000 7f827a59c700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 0x7f826403bac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.155+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f826c01f030 con 0x7f827c108190 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.369+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f827c196b70 con 0x7f827c108190 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.372+0000 7f8263fff700 1 -- 172.21.15.92:0/706132945 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f826c048020 con 0x7f827c108190 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 msgr2=0x7f826403bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 0x7f826403bac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 msgr2=0x7f827c192e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f826c000c00 tx=0x7f826c011aa0 comp rx=0 tx=0).stop 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 shutdown_connections 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f8264039600 0x7f826403bac0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 --2- 172.21.15.92:0/706132945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f827c108190 0x7f827c192e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 >> 172.21.15.92:0/706132945 conn(0x7f827c102a30 msgr2=0x7f827c1037d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 shutdown_connections 2024-04-26T17:48:47.954 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:47.375+0000 7f8281177700 1 -- 172.21.15.92:0/706132945 wait complete. 2024-04-26T17:48:49.694 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:49 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/4148671854' entity='client.admin' 2024-04-26T17:48:49.694 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:49 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.384+0000 7f3e3f4d7700 1 Processor -- start 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.384+0000 7f3e3f4d7700 1 -- start start 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.384+0000 7f3e3f4d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.384+0000 7f3e3f4d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3807ce70 con 0x7f3e38107620 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e3d273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e3d273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60814/0 (socket says 172.21.15.92:60814) 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e3d273700 1 -- 172.21.15.92:0/3179397569 learned_addr learned my addr 172.21.15.92:0/3179397569 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e3d273700 1 -- 172.21.15.92:0/3179397569 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e38107f80 con 0x7f3e38107620 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e3d273700 1 --2- 172.21.15.92:0/3179397569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43289ae6b102059d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e2ffff700 1 -- 172.21.15.92:0/3179397569 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34017070 con 0x7f3e38107620 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e2ffff700 1 -- 172.21.15.92:0/3179397569 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e3400b8c0 con 0x7f3e38107620 2024-04-26T17:48:49.702 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.385+0000 7f3e2ffff700 1 -- 172.21.15.92:0/3179397569 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34004490 con 0x7f3e38107620 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/3179397569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 msgr2=0x7f3e38107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/3179397569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009e80 tx=0x7f3e3400b330 comp rx=0 tx=0).stop 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/3179397569 shutdown_connections 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/3179397569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e38107a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/3179397569 >> 172.21.15.92:0/3179397569 conn(0x7f3e38103200 msgr2=0x7f3e38105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/3179397569 shutdown_connections 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/3179397569 wait complete. 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 Processor -- start 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.386+0000 7f3e3f4d7700 1 -- start start 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3f4d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3f4d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38108ff0 con 0x7f3e38107620 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3d273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3d273700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60818/0 (socket says 172.21.15.92:60818) 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3d273700 1 -- 172.21.15.92:0/4148671854 learned_addr learned my addr 172.21.15.92:0/4148671854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:49.703 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3d273700 1 -- 172.21.15.92:0/4148671854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3819f390 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3d273700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e34004220 tx=0x7f3e340093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34020020 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e34003b50 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3819f620 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e34017040 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.387+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e381a2310 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.388+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f3e34023020 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.388+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e38064a80 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.388+0000 7f3e2e7fc700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 0x7f3e2403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.388+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3e3400f050 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.389+0000 7f3e3ca72700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 0x7f3e2403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.389+0000 7f3e3ca72700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 0x7f3e2403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e28006fd0 tx=0x7f3e28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.394+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e3402a020 con 0x7f3e38107620 2024-04-26T17:48:49.704 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.595+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f3e3802e840 con 0x7f3e38107620 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.598+0000 7f3e2e7fc700 1 -- 172.21.15.92:0/4148671854 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3e34003d00 con 0x7f3e38107620 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 msgr2=0x7f3e2403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 0x7f3e2403ba70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3e28006fd0 tx=0x7f3e28006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 msgr2=0x7f3e3819ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3e34004220 tx=0x7f3e340093e0 comp rx=0 tx=0).stop 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 shutdown_connections 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f3e240395b0 0x7f3e2403ba70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 --2- 172.21.15.92:0/4148671854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e38107620 0x7f3e3819ee50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 >> 172.21.15.92:0/4148671854 conn(0x7f3e38103200 msgr2=0x7f3e38195a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 shutdown_connections 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:48.600+0000 7f3e3f4d7700 1 -- 172.21.15.92:0/4148671854 wait complete. 2024-04-26T17:48:49.705 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling the dashboard module... 2024-04-26T17:48:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/655849946' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-26T17:48:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-mon[29156]: from='mgr.14120 172.21.15.92:0/2626339910' entity='mgr.x' 2024-04-26T17:48:50.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setuser ceph since I am not root 2024-04-26T17:48:50.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setgroup ceph since I am not root 2024-04-26T17:48:51.095 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:50.803+0000 7f51b8aef200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:48:51.096 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:50 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:50.994+0000 7f51b8aef200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:51.096 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:51 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:51.095+0000 7f51b8aef200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:48:51.275 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.151+0000 7fa2593a0700 1 Processor -- start 2024-04-26T17:48:51.275 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.151+0000 7fa2593a0700 1 -- start start 2024-04-26T17:48:51.275 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa2593a0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:51.275 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa2593a0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa254108440 con 0x7fa254107a50 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60826/0 (socket says 172.21.15.92:60826) 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa253fff700 1 -- 172.21.15.92:0/2134092149 learned_addr learned my addr 172.21.15.92:0/2134092149 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa253fff700 1 -- 172.21.15.92:0/2134092149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa254108c50 con 0x7fa254107a50 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.152+0000 7fa253fff700 1 --2- 172.21.15.92:0/2134092149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098a0 tx=0x7fa244009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411b41e344997dff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa252ffd700 1 -- 172.21.15.92:0/2134092149 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa244004160 con 0x7fa254107a50 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa252ffd700 1 -- 172.21.15.92:0/2134092149 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa244004300 con 0x7fa254107a50 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa252ffd700 1 -- 172.21.15.92:0/2134092149 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa244011a20 con 0x7fa254107a50 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 -- 172.21.15.92:0/2134092149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 msgr2=0x7fa254107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 --2- 172.21.15.92:0/2134092149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098a0 tx=0x7fa244009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 -- 172.21.15.92:0/2134092149 shutdown_connections 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 --2- 172.21.15.92:0/2134092149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa254107e70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:51.276 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 -- 172.21.15.92:0/2134092149 >> 172.21.15.92:0/2134092149 conn(0x7fa254102fd0 msgr2=0x7fa254105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 -- 172.21.15.92:0/2134092149 shutdown_connections 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.153+0000 7fa2593a0700 1 -- 172.21.15.92:0/2134092149 wait complete. 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa2593a0700 1 Processor -- start 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa2593a0700 1 -- start start 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa2593a0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa2593a0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa25410c000 con 0x7fa254107a50 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa253fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60838/0 (socket says 172.21.15.92:60838) 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.154+0000 7fa253fff700 1 -- 172.21.15.92:0/655849946 learned_addr learned my addr 172.21.15.92:0/655849946 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa253fff700 1 -- 172.21.15.92:0/655849946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25419d090 con 0x7fa254107a50 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa253fff700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2440119f0 tx=0x7fa244011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2440039e0 con 0x7fa254107a50 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa24401b8f0 con 0x7fa254107a50 2024-04-26T17:48:51.277 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2440237a0 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25419d320 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.155+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2541a0010 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.156+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25406a530 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.157+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fa24401b440 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.157+0000 7fa2517fa700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 0x7fa23c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.157+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa24404dd80 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.157+0000 7fa2537fe700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 0x7fa23c03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.157+0000 7fa2537fe700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 0x7fa23c03ba20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa248006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.162+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa24401f030 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.427+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fa25402e720 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.602+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fa2440193d0 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.604+0000 7fa2517fa700 1 -- 172.21.15.92:0/655849946 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7fa24402a300 con 0x7fa254107a50 2024-04-26T17:48:51.278 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 msgr2=0x7fa23c03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 0x7fa23c03ba20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa248006fd0 tx=0x7fa248006e40 comp rx=0 tx=0).stop 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 msgr2=0x7fa25419cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa2440119f0 tx=0x7fa244011ad0 comp rx=0 tx=0).stop 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 shutdown_connections 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7fa23c039560 0x7fa23c03ba20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 --2- 172.21.15.92:0/655849946 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa254107a50 0x7fa25419cb50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 >> 172.21.15.92:0/655849946 conn(0x7fa254102fd0 msgr2=0x7fa254103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 shutdown_connections 2024-04-26T17:48:51.279 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:50.605+0000 7fa2593a0700 1 -- 172.21.15.92:0/655849946 wait complete. 2024-04-26T17:48:51.704 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:51 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/655849946' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-26T17:48:51.704 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:51 smithi092 ceph-mon[29156]: mgrmap e9: x(active, since 19s) 2024-04-26T17:48:51.704 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:51 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:51.409+0000 7f51b8aef200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:48:51.704 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:51 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:51.494+0000 7f51b8aef200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:48:52.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:52 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/484750082' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-26T17:48:52.986 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:52 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:52.717+0000 7f51b8aef200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:48:52.986 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:52 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:52.889+0000 7f51b8aef200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:52.994 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:52.994 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.733+0000 7f66828b7700 1 Processor -- start 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.733+0000 7f66828b7700 1 -- start start 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.733+0000 7f66828b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.733+0000 7f66828b7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f667c07ce50 con 0x7f667c1098a0 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60864/0 (socket says 172.21.15.92:60864) 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667bfff700 1 -- 172.21.15.92:0/3546225283 learned_addr learned my addr 172.21.15.92:0/3546225283 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667bfff700 1 -- 172.21.15.92:0/3546225283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c10c1d0 con 0x7f667c1098a0 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667bfff700 1 --2- 172.21.15.92:0/3546225283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098a0 tx=0x7f666c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2828cc70fc699828 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:52.995 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667affd700 1 -- 172.21.15.92:0/3546225283 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666c004160 con 0x7f667c1098a0 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667affd700 1 -- 172.21.15.92:0/3546225283 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c004300 con 0x7f667c1098a0 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.734+0000 7f667affd700 1 -- 172.21.15.92:0/3546225283 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666c011a20 con 0x7f667c1098a0 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 -- 172.21.15.92:0/3546225283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 msgr2=0x7f667c10bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 --2- 172.21.15.92:0/3546225283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f666c0098a0 tx=0x7f666c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 -- 172.21.15.92:0/3546225283 shutdown_connections 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 --2- 172.21.15.92:0/3546225283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c10bc90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 -- 172.21.15.92:0/3546225283 >> 172.21.15.92:0/3546225283 conn(0x7f667c103270 msgr2=0x7f667c105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 -- 172.21.15.92:0/3546225283 shutdown_connections 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.735+0000 7f66828b7700 1 -- 172.21.15.92:0/3546225283 wait complete. 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.736+0000 7f66828b7700 1 Processor -- start 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.736+0000 7f66828b7700 1 -- start start 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.736+0000 7f66828b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.736+0000 7f66828b7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f667c10d170 con 0x7f667c1098a0 2024-04-26T17:48:52.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f667bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f667bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60874/0 (socket says 172.21.15.92:60874) 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f667bfff700 1 -- 172.21.15.92:0/484750082 learned_addr learned my addr 172.21.15.92:0/484750082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f667bfff700 1 -- 172.21.15.92:0/484750082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667c19d1a0 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f667bfff700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666c003aa0 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f666c01b8f0 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.737+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667c19d430 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.738+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f666c023870 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.738+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f667c1a0120 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f666c023b20 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f66797fa700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 0x7f666403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f667c064a80 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f666c04de50 con 0x7f667c1098a0 2024-04-26T17:48:52.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f667b7fe700 1 -- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 msgr2=0x7f666403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.739+0000 7f667b7fe700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 0x7f666403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.744+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f666c01f030 con 0x7f667c1098a0 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.940+0000 7f667b7fe700 1 -- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 msgr2=0x7f666403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:51.940+0000 7f667b7fe700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 0x7f666403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.057+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f667c1a06e0 con 0x7f667c1098a0 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.058+0000 7f66797fa700 1 -- 172.21.15.92:0/484750082 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f666c016260 con 0x7f667c1098a0 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 msgr2=0x7f666403bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 0x7f666403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 msgr2=0x7f667c19cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f666c000c00 tx=0x7f666c011aa0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 shutdown_connections 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7f6664039660 0x7f666403bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 --2- 172.21.15.92:0/484750082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f667c1098a0 0x7f667c19cc60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:52.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 >> 172.21.15.92:0/484750082 conn(0x7f667c103270 msgr2=0x7f667c103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:52.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 shutdown_connections 2024-04-26T17:48:52.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:52.061+0000 7f66828b7700 1 -- 172.21.15.92:0/484750082 wait complete. 2024-04-26T17:48:52.999 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for the mgr to restart... 2024-04-26T17:48:52.999 INFO:teuthology.orchestra.run.smithi092.stdout:Waiting for mgr epoch 9... 2024-04-26T17:48:53.242 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:53 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:53.065+0000 7f51b8aef200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:48:53.592 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:53 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:53.358+0000 7f51b8aef200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:48:53.592 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:53 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:53.453+0000 7f51b8aef200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:48:53.860 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:53 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:53.659+0000 7f51b8aef200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:48:54.242 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:53 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:53.860+0000 7f51b8aef200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:48:54.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:54 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:54.457+0000 7f51b8aef200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:48:55.183 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:54 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:54.882+0000 7f51b8aef200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:48:55.184 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:54 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:54.981+0000 7f51b8aef200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:48:55.184 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:55 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:55.183+0000 7f51b8aef200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:48:55.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:55 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:55.725+0000 7f51b8aef200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:48:55.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:55 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:55.820+0000 7f51b8aef200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:48:56.417 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:56.069+0000 7f51b8aef200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:48:56.417 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:56.204+0000 7f51b8aef200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:48:56.417 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:56.301+0000 7f51b8aef200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:48:56.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:56.429+0000 7f51b8aef200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:48:56.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:56.726+0000 7f51b8aef200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:48:57.584 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:57.318+0000 7f51b8aef200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:48:57.585 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:48:57.531+0000 7f51b8aef200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: Active manager daemon x restarted 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: Activating manager daemon x 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: osdmap e3: 0 total, 0 up, 0 in 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: mgrmap e10: x(active, starting, since 0.0036772s) 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: Manager daemon x is now available 2024-04-26T17:48:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:48:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:48:58.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:48:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:58 smithi092 ceph-mon[29156]: mgrmap e11: x(active, since 1.00582s) 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout { 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout } 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.791+0000 7ffaea074700 1 Processor -- start 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.791+0000 7ffaea074700 1 -- start start 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffaea074700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffaea074700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4108600 con 0x7ffae4107c10 2024-04-26T17:48:59.357 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60880/0 (socket says 172.21.15.92:60880) 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae37fe700 1 -- 172.21.15.92:0/426684769 learned_addr learned my addr 172.21.15.92:0/426684769 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae37fe700 1 -- 172.21.15.92:0/426684769 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae4108e10 con 0x7ffae4107c10 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae37fe700 1 --2- 172.21.15.92:0/426684769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffad400bb40 tx=0x7ffad400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82c1efab09ddd9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.792+0000 7ffae27fc700 1 -- 172.21.15.92:0/426684769 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad400dbe0 con 0x7ffae4107c10 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffae27fc700 1 -- 172.21.15.92:0/426684769 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffad40044e0 con 0x7ffae4107c10 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffae27fc700 1 -- 172.21.15.92:0/426684769 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad4010470 con 0x7ffae4107c10 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 -- 172.21.15.92:0/426684769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 msgr2=0x7ffae4108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 --2- 172.21.15.92:0/426684769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffad400bb40 tx=0x7ffad400be50 comp rx=0 tx=0).stop 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 -- 172.21.15.92:0/426684769 shutdown_connections 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 --2- 172.21.15.92:0/426684769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae4108030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 -- 172.21.15.92:0/426684769 >> 172.21.15.92:0/426684769 conn(0x7ffae4103210 msgr2=0x7ffae4105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:59.358 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 -- 172.21.15.92:0/426684769 shutdown_connections 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.793+0000 7ffaea074700 1 -- 172.21.15.92:0/426684769 wait complete. 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffaea074700 1 Processor -- start 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffaea074700 1 -- start start 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffaea074700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffaea074700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffae407bff0 con 0x7ffae4107c10 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffae37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.794+0000 7ffae37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60888/0 (socket says 172.21.15.92:60888) 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae37fe700 1 -- 172.21.15.92:0/3865266783 learned_addr learned my addr 172.21.15.92:0/3865266783 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae37fe700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae419af90 con 0x7ffae4107c10 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae37fe700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffad400d650 tx=0x7ffad4003ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad4027070 con 0x7ffae4107c10 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae419b220 con 0x7ffae4107c10 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffad4010c20 con 0x7ffae4107c10 2024-04-26T17:48:59.359 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad4022b10 con 0x7ffae4107c10 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.795+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae419df10 con 0x7ffae4107c10 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7ffad402a070 con 0x7ffae4107c10 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffae0ff9700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffae406a530 con 0x7ffacc0395b0 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffad401f070 con 0x7ffae4107c10 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffae2ffd700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.796+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.997+0000 7ffae2ffd700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:53.997+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:54.398+0000 7ffae2ffd700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:54.398+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:55.199+0000 7ffae2ffd700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:59.360 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:55.199+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:56.800+0000 7ffae2ffd700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/2200342511 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:56.800+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:57.535+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7ffad4022410 con 0x7ffae4107c10 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:57.535+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 msgr2=0x7ffacc03ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:57.535+0000 7ffae0ff9700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.536+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7ffad402cce0 con 0x7ffae4107c10 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.536+0000 7ffae0ff9700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 0x7ffacc03f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.536+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffad4001d30 con 0x7ffacc03ce40 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.537+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 0x7ffacc03f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.537+0000 7ffae2ffd700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 0x7ffacc03f230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffad8003a10 tx=0x7ffad80092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.538+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ffad4001d30 con 0x7ffacc03ce40 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.546+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ffae4192810 con 0x7ffacc03ce40 2024-04-26T17:48:59.361 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.546+0000 7ffae0ff9700 1 -- 172.21.15.92:0/3865266783 <== mgr.14152 v2:172.21.15.92:6800/3474750194 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ffae4192810 con 0x7ffacc03ce40 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 msgr2=0x7ffacc03f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 0x7ffacc03f230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffad8003a10 tx=0x7ffad80092b0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 msgr2=0x7ffae419aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffad400d650 tx=0x7ffad4003ff0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 shutdown_connections 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffacc03ce40 0x7ffacc03f230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffae4107c10 0x7ffae419aa50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 --2- 172.21.15.92:0/3865266783 >> [v2:172.21.15.92:6800/2200342511,v1:172.21.15.92:6801/2200342511] conn(0x7ffacc0395b0 0x7ffacc03ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 >> 172.21.15.92:0/3865266783 conn(0x7ffae4103210 msgr2=0x7ffae4191090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 shutdown_connections 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:58.547+0000 7ffaea074700 1 -- 172.21.15.92:0/3865266783 wait complete. 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:mgr epoch 9 is available 2024-04-26T17:48:59.362 INFO:teuthology.orchestra.run.smithi092.stdout:Generating a dashboard self-signed certificate... 2024-04-26T17:48:59.682 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:58] ENGINE Bus STARTING 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:58] ENGINE Serving on https://172.21.15.92:7150 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:58] ENGINE Serving on http://172.21.15.92:8765 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: [26/Apr/2024:17:48:58] ENGINE Bus STARTED 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-26T17:48:59.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:48:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.785+0000 7f4510682700 1 Processor -- start 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.785+0000 7f4510682700 1 -- start start 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.785+0000 7f4510682700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.785+0000 7f4510682700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4508109740 con 0x7f4508108d50 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450e41e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:00.650 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450e41e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50358/0 (socket says 172.21.15.92:50358) 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450e41e700 1 -- 172.21.15.92:0/895472160 learned_addr learned my addr 172.21.15.92:0/895472160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450e41e700 1 -- 172.21.15.92:0/895472160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4508109f00 con 0x7f4508108d50 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450e41e700 1 --2- 172.21.15.92:0/895472160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45040098a0 tx=0x7f4504009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5320c3af4b9cbb19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450d41c700 1 -- 172.21.15.92:0/895472160 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4504004160 con 0x7f4508108d50 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450d41c700 1 -- 172.21.15.92:0/895472160 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4504004300 con 0x7f4508108d50 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.786+0000 7f450d41c700 1 -- 172.21.15.92:0/895472160 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4504011a20 con 0x7f4508108d50 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 -- 172.21.15.92:0/895472160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 msgr2=0x7f4508109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 --2- 172.21.15.92:0/895472160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45040098a0 tx=0x7f4504009bb0 comp rx=0 tx=0).stop 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 -- 172.21.15.92:0/895472160 shutdown_connections 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 --2- 172.21.15.92:0/895472160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f4508109170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 -- 172.21.15.92:0/895472160 >> 172.21.15.92:0/895472160 conn(0x7f4508104310 msgr2=0x7f4508106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 -- 172.21.15.92:0/895472160 shutdown_connections 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.787+0000 7f4510682700 1 -- 172.21.15.92:0/895472160 wait complete. 2024-04-26T17:49:00.651 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f4510682700 1 Processor -- start 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f4510682700 1 -- start start 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f4510682700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f4510682700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f450810d2b0 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f450e41e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f450e41e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50372/0 (socket says 172.21.15.92:50372) 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f450e41e700 1 -- 172.21.15.92:0/992720929 learned_addr learned my addr 172.21.15.92:0/992720929 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.788+0000 7f450e41e700 1 -- 172.21.15.92:0/992720929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450819d160 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f450e41e700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45040116e0 tx=0x7f4504011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45040039e0 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f450401b8f0 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450819d3f0 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4504023760 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.789+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45081a00e0 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.790+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f4504023a00 con 0x7f4508108d50 2024-04-26T17:49:00.652 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.790+0000 7f44ff7fe700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 0x7f44f403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.790+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f45040528d0 con 0x7f4508108d50 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.790+0000 7f450dc1d700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 0x7f44f403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.790+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4508064a80 con 0x7f4508108d50 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.791+0000 7f450dc1d700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 0x7f44f403b9b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006fd0 tx=0x7f44f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:48:59.800+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f450401f030 con 0x7f4508108d50 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.017+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f45081054c0 con 0x7f44f40394f0 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.083+0000 7f44ff7fe700 1 -- 172.21.15.92:0/992720929 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f45081054c0 con 0x7f44f40394f0 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 msgr2=0x7f44f403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 0x7f44f403b9b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006fd0 tx=0x7f44f8006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:00.653 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 msgr2=0x7f450819cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45040116e0 tx=0x7f4504011aa0 comp rx=0 tx=0).stop 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 shutdown_connections 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f44f40394f0 0x7f44f403b9b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 --2- 172.21.15.92:0/992720929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4508108d50 0x7f450819cc20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 >> 172.21.15.92:0/992720929 conn(0x7f4508104310 msgr2=0x7f4508104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 shutdown_connections 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:00.086+0000 7f4510682700 1 -- 172.21.15.92:0/992720929 wait complete. 2024-04-26T17:49:00.654 INFO:teuthology.orchestra.run.smithi092.stdout:Creating initial admin user... 2024-04-26T17:49:01.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:01 smithi092 ceph-mon[29156]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:01.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:01.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:01.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:01 smithi092 ceph-mon[29156]: mgrmap e12: x(active, since 2s) 2024-04-26T17:49:01.301 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ysPZNAwluhjA1wjx0W70iewekjuYrNbJamIh6pJPTZeySp0ZSIXZm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714153741, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf450a2700 1 Processor -- start 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf450a2700 1 -- start start 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf450a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf450a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf40107a40 con 0x7fbf40107050 2024-04-26T17:49:02.438 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf3ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf3ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50376/0 (socket says 172.21.15.92:50376) 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.070+0000 7fbf3ed9d700 1 -- 172.21.15.92:0/2681919159 learned_addr learned my addr 172.21.15.92:0/2681919159 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.071+0000 7fbf3ed9d700 1 -- 172.21.15.92:0/2681919159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf40107bc0 con 0x7fbf40107050 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.071+0000 7fbf3ed9d700 1 --2- 172.21.15.92:0/2681919159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098a0 tx=0x7fbf34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfae38498f54f66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.071+0000 7fbf3dd9b700 1 -- 172.21.15.92:0/2681919159 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf34004160 con 0x7fbf40107050 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.071+0000 7fbf3dd9b700 1 -- 172.21.15.92:0/2681919159 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf34004300 con 0x7fbf40107050 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.071+0000 7fbf3dd9b700 1 -- 172.21.15.92:0/2681919159 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf34011a20 con 0x7fbf40107050 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 -- 172.21.15.92:0/2681919159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 msgr2=0x7fbf40107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 --2- 172.21.15.92:0/2681919159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098a0 tx=0x7fbf34009bb0 comp rx=0 tx=0).stop 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 -- 172.21.15.92:0/2681919159 shutdown_connections 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 --2- 172.21.15.92:0/2681919159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40107470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 -- 172.21.15.92:0/2681919159 >> 172.21.15.92:0/2681919159 conn(0x7fbf40102a30 msgr2=0x7fbf40104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 -- 172.21.15.92:0/2681919159 shutdown_connections 2024-04-26T17:49:02.439 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.072+0000 7fbf450a2700 1 -- 172.21.15.92:0/2681919159 wait complete. 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf450a2700 1 Processor -- start 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf450a2700 1 -- start start 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf450a2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf450a2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4010d300 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf3ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf3ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50384/0 (socket says 172.21.15.92:50384) 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf3ed9d700 1 -- 172.21.15.92:0/4135127947 learned_addr learned my addr 172.21.15.92:0/4135127947 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.073+0000 7fbf3ed9d700 1 -- 172.21.15.92:0/4135127947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf40109e90 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf3ed9d700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf340116e0 tx=0x7fbf34011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf340039e0 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf40108080 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf3401b8f0 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf34023760 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.074+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf401085c0 con 0x7fbf40107050 2024-04-26T17:49:02.440 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.075+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fbf340239d0 con 0x7fbf40107050 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.075+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf40064a80 con 0x7fbf40107050 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.075+0000 7fbf27fff700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 0x7fbf2803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.075+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbf3404e160 con 0x7fbf40107050 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.075+0000 7fbf3e59c700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 0x7fbf2803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.076+0000 7fbf3e59c700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 0x7fbf2803ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.080+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbf3401f030 con 0x7fbf40107050 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.302+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fbf40108f40 con 0x7fbf280395b0 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.527+0000 7fbf27fff700 1 -- 172.21.15.92:0/4135127947 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fbf40108f40 con 0x7fbf280395b0 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 msgr2=0x7fbf2803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 0x7fbf2803ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006fd0 tx=0x7fbf30006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 msgr2=0x7fbf40109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf340116e0 tx=0x7fbf34011aa0 comp rx=0 tx=0).stop 2024-04-26T17:49:02.441 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 shutdown_connections 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbf280395b0 0x7fbf2803ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 --2- 172.21.15.92:0/4135127947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf40107050 0x7fbf40109950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 >> 172.21.15.92:0/4135127947 conn(0x7fbf40102a30 msgr2=0x7fbf40103490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 shutdown_connections 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:01.530+0000 7fbf450a2700 1 -- 172.21.15.92:0/4135127947 wait complete. 2024-04-26T17:49:02.442 INFO:teuthology.orchestra.run.smithi092.stdout:Fetching dashboard port number... 2024-04-26T17:49:02.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:02 smithi092 ceph-mon[29156]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:02.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:03 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2636163652' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stdout 8443 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.284+0000 7f2cbe317700 1 Processor -- start 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.284+0000 7f2cbe317700 1 -- start start 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.284+0000 7f2cbe317700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.284+0000 7f2cbe317700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb807ce90 con 0x7f2cb8109820 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:03.996 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50398/0 (socket says 172.21.15.92:50398) 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb7fff700 1 -- 172.21.15.92:0/1783524643 learned_addr learned my addr 172.21.15.92:0/1783524643 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb7fff700 1 -- 172.21.15.92:0/1783524643 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb810c150 con 0x7f2cb8109820 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb7fff700 1 --2- 172.21.15.92:0/1783524643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0098a0 tx=0x7f2cac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72cdd56883e9b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb6ffd700 1 -- 172.21.15.92:0/1783524643 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac004160 con 0x7f2cb8109820 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb6ffd700 1 -- 172.21.15.92:0/1783524643 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cac004300 con 0x7f2cb8109820 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.285+0000 7f2cb6ffd700 1 -- 172.21.15.92:0/1783524643 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac011a20 con 0x7f2cb8109820 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 -- 172.21.15.92:0/1783524643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 msgr2=0x7f2cb810bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 --2- 172.21.15.92:0/1783524643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0098a0 tx=0x7f2cac009bb0 comp rx=0 tx=0).stop 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 -- 172.21.15.92:0/1783524643 shutdown_connections 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 --2- 172.21.15.92:0/1783524643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb810bc10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 -- 172.21.15.92:0/1783524643 >> 172.21.15.92:0/1783524643 conn(0x7f2cb8103230 msgr2=0x7f2cb8105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 -- 172.21.15.92:0/1783524643 shutdown_connections 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 -- 172.21.15.92:0/1783524643 wait complete. 2024-04-26T17:49:03.997 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.286+0000 7f2cbe317700 1 Processor -- start 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cbe317700 1 -- start start 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cbe317700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cbe317700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb810d150 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50400/0 (socket says 172.21.15.92:50400) 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb7fff700 1 -- 172.21.15.92:0/2636163652 learned_addr learned my addr 172.21.15.92:0/2636163652 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb7fff700 1 -- 172.21.15.92:0/2636163652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb819d1e0 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb7fff700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0116e0 tx=0x7f2cac011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac003b20 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cac01b8f0 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac0238c0 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.287+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb819d470 con 0x7f2cb8109820 2024-04-26T17:49:03.998 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.288+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb81a0160 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f2cac023a60 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cb57fa700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 0x7f2ca003bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2cac04e280 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb8064a80 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cb77fe700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 0x7f2ca003bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.289+0000 7f2cb77fe700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 0x7f2ca003bad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8006fd0 tx=0x7f2ca8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.294+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2cac01f030 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.491+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2cb81a0330 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.492+0000 7f2cb57fa700 1 -- 172.21.15.92:0/2636163652 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2cac018e30 con 0x7f2cb8109820 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 msgr2=0x7f2ca003bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 0x7f2ca003bad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8006fd0 tx=0x7f2ca8006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 msgr2=0x7f2cb819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0116e0 tx=0x7f2cac011aa0 comp rx=0 tx=0).stop 2024-04-26T17:49:03.999 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 shutdown_connections 2024-04-26T17:49:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2ca0039610 0x7f2ca003bad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 --2- 172.21.15.92:0/2636163652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb8109820 0x7f2cb819cca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 >> 172.21.15.92:0/2636163652 conn(0x7f2cb8103230 msgr2=0x7f2cb8103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 shutdown_connections 2024-04-26T17:49:04.000 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:03.494+0000 7f2cbe317700 1 -- 172.21.15.92:0/2636163652 wait complete. 2024-04-26T17:49:04.001 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-26T17:49:04.001 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout disabled 2024-04-26T17:49:04.008 INFO:teuthology.orchestra.run.smithi092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-26T17:49:04.009 INFO:teuthology.orchestra.run.smithi092.stdout:systemctl: stdout inactive 2024-04-26T17:49:04.009 INFO:teuthology.orchestra.run.smithi092.stdout:firewalld.service is not enabled 2024-04-26T17:49:04.009 INFO:teuthology.orchestra.run.smithi092.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-26T17:49:04.010 INFO:teuthology.orchestra.run.smithi092.stdout:Ceph Dashboard is now available at: 2024-04-26T17:49:04.010 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:04.010 INFO:teuthology.orchestra.run.smithi092.stdout: URL: https://smithi092:8443/ 2024-04-26T17:49:04.010 INFO:teuthology.orchestra.run.smithi092.stdout: User: admin 2024-04-26T17:49:04.010 INFO:teuthology.orchestra.run.smithi092.stdout: Password: 93uapuupuu 2024-04-26T17:49:04.011 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:04.011 INFO:teuthology.orchestra.run.smithi092.stdout:Saving cluster configuration to /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config directory 2024-04-26T17:49:04.011 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling autotune for osd_memory_target 2024-04-26T17:49:05.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.426+0000 7feb8868e700 1 Processor -- start 2024-04-26T17:49:05.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.426+0000 7feb8868e700 1 -- start start 2024-04-26T17:49:05.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.426+0000 7feb8868e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:05.240 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.426+0000 7feb8868e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb8007d840 con 0x7feb8007ee50 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb8642a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb8642a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50406/0 (socket says 172.21.15.92:50406) 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb8642a700 1 -- 172.21.15.92:0/2337565261 learned_addr learned my addr 172.21.15.92:0/2337565261 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb8642a700 1 -- 172.21.15.92:0/2337565261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8007d9c0 con 0x7feb8007ee50 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb8642a700 1 --2- 172.21.15.92:0/2337565261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0098a0 tx=0x7feb7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d40afa06ec8510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb85428700 1 -- 172.21.15.92:0/2337565261 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c004160 con 0x7feb8007ee50 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb85428700 1 -- 172.21.15.92:0/2337565261 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c004300 con 0x7feb8007ee50 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.427+0000 7feb85428700 1 -- 172.21.15.92:0/2337565261 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c011a20 con 0x7feb8007ee50 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- 172.21.15.92:0/2337565261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 msgr2=0x7feb8007d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 --2- 172.21.15.92:0/2337565261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0098a0 tx=0x7feb7c009bb0 comp rx=0 tx=0).stop 2024-04-26T17:49:05.241 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- 172.21.15.92:0/2337565261 shutdown_connections 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 --2- 172.21.15.92:0/2337565261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8007d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- 172.21.15.92:0/2337565261 >> 172.21.15.92:0/2337565261 conn(0x7feb80104340 msgr2=0x7feb80106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- 172.21.15.92:0/2337565261 shutdown_connections 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- 172.21.15.92:0/2337565261 wait complete. 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 Processor -- start 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.428+0000 7feb8868e700 1 -- start start 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8868e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:05.242 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8868e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb8010f2e0 con 0x7feb8007ee50 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8642a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8642a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50408/0 (socket says 172.21.15.92:50408) 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8642a700 1 -- 172.21.15.92:0/1312858614 learned_addr learned my addr 172.21.15.92:0/1312858614 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8642a700 1 -- 172.21.15.92:0/1312858614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8019f3e0 con 0x7feb8007ee50 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8642a700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0116e0 tx=0x7feb7c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c003b20 con 0x7feb8007ee50 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7c01b8f0 con 0x7feb8007ee50 2024-04-26T17:49:05.243 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb7c0238c0 con 0x7feb8007ee50 2024-04-26T17:49:05.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8019f670 con 0x7feb8007ee50 2024-04-26T17:49:05.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.429+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb801a2310 con 0x7feb8007ee50 2024-04-26T17:49:05.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.430+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7feb7c01b440 con 0x7feb8007ee50 2024-04-26T17:49:05.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.430+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb80064a80 con 0x7feb8007ee50 2024-04-26T17:49:05.244 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.430+0000 7feb777fe700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 0x7feb6c03bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.430+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feb7c04e140 con 0x7feb8007ee50 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.431+0000 7feb85c29700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 0x7feb6c03bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.431+0000 7feb85c29700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 0x7feb6c03bad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb70006fd0 tx=0x7feb70006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.436+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7feb7c01f030 con 0x7feb8007ee50 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.529+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7feb7c02c3f0 con 0x7feb8007ee50 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.633+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7feb801a2930 con 0x7feb8007ee50 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.634+0000 7feb777fe700 1 -- 172.21.15.92:0/1312858614 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7feb7c0292a0 con 0x7feb8007ee50 2024-04-26T17:49:05.245 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 msgr2=0x7feb6c03bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 0x7feb6c03bad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb70006fd0 tx=0x7feb70006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 msgr2=0x7feb8019eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0116e0 tx=0x7feb7c011aa0 comp rx=0 tx=0).stop 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 shutdown_connections 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feb6c039610 0x7feb6c03bad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 --2- 172.21.15.92:0/1312858614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb8007ee50 0x7feb8019eea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 >> 172.21.15.92:0/1312858614 conn(0x7feb80104340 msgr2=0x7feb80104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 shutdown_connections 2024-04-26T17:49:05.246 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:04.636+0000 7feb8868e700 1 -- 172.21.15.92:0/1312858614 wait complete. 2024-04-26T17:49:05.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:05 smithi092 ceph-mon[29156]: mgrmap e13: x(active, since 6s) 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.660+0000 7f2459f37700 1 Processor -- start 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.660+0000 7f2459f37700 1 -- start start 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f2459f37700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f2459f37700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2454108600 con 0x7f2454107c10 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57068/0 (socket says 172.21.15.92:57068) 2024-04-26T17:49:06.694 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24537fe700 1 -- 172.21.15.92:0/1184207160 learned_addr learned my addr 172.21.15.92:0/1184207160 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24537fe700 1 -- 172.21.15.92:0/1184207160 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2454108e10 con 0x7f2454107c10 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24537fe700 1 --2- 172.21.15.92:0/1184207160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24440098a0 tx=0x7f2444009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a5ffb8c1d9f665 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24527fc700 1 -- 172.21.15.92:0/1184207160 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2444004160 con 0x7f2454107c10 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24527fc700 1 -- 172.21.15.92:0/1184207160 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2444004300 con 0x7f2454107c10 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.661+0000 7f24527fc700 1 -- 172.21.15.92:0/1184207160 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2444011a20 con 0x7f2454107c10 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 -- 172.21.15.92:0/1184207160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 msgr2=0x7f2454108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 --2- 172.21.15.92:0/1184207160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f24440098a0 tx=0x7f2444009bb0 comp rx=0 tx=0).stop 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 -- 172.21.15.92:0/1184207160 shutdown_connections 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 --2- 172.21.15.92:0/1184207160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f2454108030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 -- 172.21.15.92:0/1184207160 >> 172.21.15.92:0/1184207160 conn(0x7f2454103210 msgr2=0x7f2454105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:06.695 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 -- 172.21.15.92:0/1184207160 shutdown_connections 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 -- 172.21.15.92:0/1184207160 wait complete. 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.662+0000 7f2459f37700 1 Processor -- start 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2459f37700 1 -- start start 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2459f37700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2459f37700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f245410c1c0 con 0x7f2454107c10 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f24537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f24537fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57080/0 (socket says 172.21.15.92:57080) 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f24537fe700 1 -- 172.21.15.92:0/1931529810 learned_addr learned my addr 172.21.15.92:0/1931529810 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f24537fe700 1 -- 172.21.15.92:0/1931529810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245419d1c0 con 0x7f2454107c10 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f24537fe700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24440116e0 tx=0x7f2444011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24440039e0 con 0x7f2454107c10 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f244401b8f0 con 0x7f2454107c10 2024-04-26T17:49:06.696 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245419d450 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.663+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2444023760 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.664+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24541a0140 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.664+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f24440239d0 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.664+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2454064a80 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.665+0000 7f2450ff9700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 0x7f243c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.665+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f244404e3b0 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.665+0000 7f2452ffd700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 0x7f243c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.665+0000 7f2452ffd700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 0x7f243c03bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2448006fd0 tx=0x7f2448006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.670+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f244401f030 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.983+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f245402e6e0 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.985+0000 7f2450ff9700 1 -- 172.21.15.92:0/1931529810 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f2444018c10 con 0x7f2454107c10 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 msgr2=0x7f243c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 0x7f243c03bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2448006fd0 tx=0x7f2448006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:06.697 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 msgr2=0x7f245419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24440116e0 tx=0x7f2444011aa0 comp rx=0 tx=0).stop 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 shutdown_connections 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f243c039650 0x7f243c03bb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 --2- 172.21.15.92:0/1931529810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2454107c10 0x7f245419cc80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 >> 172.21.15.92:0/1931529810 conn(0x7f2454103210 msgr2=0x7f2454104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 shutdown_connections 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr 2024-04-26T17:49:05.987+0000 7f2459f37700 1 -- 172.21.15.92:0/1931529810 wait complete. 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:06.698 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout:Or, if you are only running a single cluster on this host: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: ceph telemetry on 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout:For more information see: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:06.699 INFO:teuthology.orchestra.run.smithi092.stdout:Bootstrap complete. 2024-04-26T17:49:06.729 INFO:tasks.cephadm:Fetching config... 2024-04-26T17:49:06.730 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:49:06.730 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-26T17:49:06.745 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-26T17:49:06.745 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:49:06.745 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-26T17:49:06.799 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-26T17:49:06.800 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:49:06.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-26T17:49:06.863 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-26T17:49:06.863 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:49:06.863 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-26T17:49:06.918 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-26T17:49:06.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T17:49:06.990 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:07.001 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T17:49:07.041 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:07.053 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-26T17:49:07.092 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4nHh93WJahsFsOHCTnv45UN3hYx4f6+NR/ypnHKQfars/QuSh+/2UGtoXa49U0PgkpdxtvDoQEb9WaoaKc5JA0kAFFYrwph3wAvzJCBoNUgUWlkwmUf2s95xAXRh2f3FDZs1GOUIXDSkOYcfno1boEScGIykCmDVTCQU2giTq8ggSP7jZzkXM9uuUviNjiWo6s+V97tdXkjihfmGId2b+CLPwHeMx40amUESAWSmZx0/VmiRzjqS6nxJZ3mzvI0QVTVScl15QSjdmgbzKdSgJ6lodvsn2i2pZk3C9zHzedan1HvTOdJA/H/Q+AjRdwvu7xmApBtfWa5qcq3vS4qZElcd5TIllO0h2wLDQoNer6UQ+MxgSVjzuPHYOrZm6EQdJIcdNDoHknV/YZwpqV2feU3VlB21w8JF/r38/AaSHf51DSXynH/VfdPtsUb0Ca9mbv0URg+o6MK8AC1PSyJ7qLnyVn9WSlym4ezVeJX0yWr3F7K8A4Jtok1sV7PiE+XM= ceph-fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:07.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-26T17:49:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:06 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1931529810' entity='client.admin' 2024-04-26T17:49:07.345 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.451+0000 7f408522d700 1 -- 172.21.15.92:0/1184998833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 msgr2=0x7f4080075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.451+0000 7f408522d700 1 --2- 172.21.15.92:0/1184998833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f4080075830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4070009910 tx=0x7f4070009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.451+0000 7f408522d700 1 -- 172.21.15.92:0/1184998833 shutdown_connections 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.451+0000 7f408522d700 1 --2- 172.21.15.92:0/1184998833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f4080075830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.452+0000 7f408522d700 1 -- 172.21.15.92:0/1184998833 >> 172.21.15.92:0/1184998833 conn(0x7f40800fe440 msgr2=0x7f4080100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.452+0000 7f408522d700 1 -- 172.21.15.92:0/1184998833 shutdown_connections 2024-04-26T17:49:09.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.452+0000 7f408522d700 1 -- 172.21.15.92:0/1184998833 wait complete. 2024-04-26T17:49:09.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.452+0000 7f408522d700 1 Processor -- start 2024-04-26T17:49:09.453 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f408522d700 1 -- start start 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f408522d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f408522d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f408010afd0 con 0x7f40800773d0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f407ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f407ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57108/0 (socket says 172.21.15.92:57108) 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f407ed9d700 1 -- 172.21.15.92:0/974206294 learned_addr learned my addr 172.21.15.92:0/974206294 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f407ed9d700 1 -- 172.21.15.92:0/974206294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408019abb0 con 0x7f40800773d0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f407ed9d700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4070005b40 tx=0x7f4070004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4070027070 con 0x7f40800773d0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f407000be10 con 0x7f40800773d0 2024-04-26T17:49:09.454 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f408019ae40 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.453+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4070022de0 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.454+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f408019db30 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.454+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f407002a070 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.454+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408010b750 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.454+0000 7f4067fff700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 0x7f406803bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.455+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f407001e030 con 0x7f40800773d0 2024-04-26T17:49:09.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.455+0000 7f407e59c700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 0x7f406803bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:09.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.455+0000 7f407e59c700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 0x7f406803bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:09.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.460+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4070013070 con 0x7f40800773d0 2024-04-26T17:49:09.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.666+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f408002e5a0 con 0x7f40800773d0 2024-04-26T17:49:09.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.669+0000 7f4067fff700 1 -- 172.21.15.92:0/974206294 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f407000d340 con 0x7f40800773d0 2024-04-26T17:49:09.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 msgr2=0x7f406803bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:09.670 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 0x7f406803bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 msgr2=0x7f408019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4070005b40 tx=0x7f4070004f80 comp rx=0 tx=0).stop 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 shutdown_connections 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f40680396b0 0x7f406803bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 --2- 172.21.15.92:0/974206294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40800773d0 0x7f408019a670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 >> 172.21.15.92:0/974206294 conn(0x7f40800fe440 msgr2=0x7f40800fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 shutdown_connections 2024-04-26T17:49:09.671 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:09.671+0000 7f408522d700 1 -- 172.21.15.92:0/974206294 wait complete. 2024-04-26T17:49:10.458 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-26T17:49:10.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-26T17:49:10.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:10 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/974206294' entity='client.admin' 2024-04-26T17:49:10.703 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:49:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:12.345 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:12.346 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:12.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/1791187189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 msgr2=0x7fa1f81048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:12.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/1791187189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f81048b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8009910 tx=0x7fa1e8009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/1791187189 shutdown_connections 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/1791187189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f81048b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/1791187189 >> 172.21.15.92:0/1791187189 conn(0x7fa1f80fcad0 msgr2=0x7fa1f80fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/1791187189 shutdown_connections 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.845+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/1791187189 wait complete. 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1fe5f1700 1 Processor -- start 2024-04-26T17:49:12.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1fe5f1700 1 -- start start 2024-04-26T17:49:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1fe5f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1fe5f1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8108d90 con 0x7fa1f8104490 2024-04-26T17:49:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1f7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57136/0 (socket says 172.21.15.92:57136) 2024-04-26T17:49:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1f7fff700 1 -- 172.21.15.92:0/3221027166 learned_addr learned my addr 172.21.15.92:0/3221027166 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1f7fff700 1 -- 172.21.15.92:0/3221027166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f81989b0 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.846+0000 7fa1f7fff700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005800 tx=0x7fa1e8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.847+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1e8027070 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.847+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e800be10 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.847+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f8198ca0 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.847+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1e800f460 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.847+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f819b930 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa1e802a070 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f8109510 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1f57fa700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 0x7fa1e003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa1e801e030 con 0x7fa1f8104490 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1f77fe700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 0x7fa1e003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:12.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.848+0000 7fa1f77fe700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 0x7fa1e003bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006fd0 tx=0x7fa1ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:12.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:12.853+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa1e8013070 con 0x7fa1f8104490 2024-04-26T17:49:13.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.056+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa1f802e680 con 0x7fa1e0039650 2024-04-26T17:49:13.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.059+0000 7fa1f57fa700 1 -- 172.21.15.92:0/3221027166 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa1f802e680 con 0x7fa1e0039650 2024-04-26T17:49:13.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.061+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 msgr2=0x7fa1e003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.061+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 0x7fa1e003bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec006fd0 tx=0x7fa1ec006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.061+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 msgr2=0x7fa1f8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.061+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005800 tx=0x7fa1e8009f60 comp rx=0 tx=0).stop 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 shutdown_connections 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa1e0039650 0x7fa1e003bb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 --2- 172.21.15.92:0/3221027166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1f8104490 0x7fa1f8198470 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 >> 172.21.15.92:0/3221027166 conn(0x7fa1f80fcad0 msgr2=0x7fa1f80fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 shutdown_connections 2024-04-26T17:49:13.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:13.062+0000 7fa1fe5f1700 1 -- 172.21.15.92:0/3221027166 wait complete. 2024-04-26T17:49:13.793 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2024-04-26T17:49:13.793 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:49:13.793 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2024-04-26T17:49:13.812 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:49:13.813 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:13.869 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2024-04-26T17:49:13.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch host add smithi156 2024-04-26T17:49:14.105 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:14.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:14.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:14.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:14.325 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:14.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:15.153 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:15 smithi092 ceph-mon[29156]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 -- 172.21.15.92:0/2087795285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 msgr2=0x7fb430102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 --2- 172.21.15.92:0/2087795285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb430102370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb420009910 tx=0x7fb420009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 -- 172.21.15.92:0/2087795285 shutdown_connections 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 --2- 172.21.15.92:0/2087795285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb430102370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 -- 172.21.15.92:0/2087795285 >> 172.21.15.92:0/2087795285 conn(0x7fb4300fd840 msgr2=0x7fb4300ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 -- 172.21.15.92:0/2087795285 shutdown_connections 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.632+0000 7fb435570700 1 -- 172.21.15.92:0/2087795285 wait complete. 2024-04-26T17:49:15.634 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb435570700 1 Processor -- start 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb435570700 1 -- start start 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb435570700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb435570700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb43010c210 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb42effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb42effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40106/0 (socket says 172.21.15.92:40106) 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.633+0000 7fb42effd700 1 -- 172.21.15.92:0/952716098 learned_addr learned my addr 172.21.15.92:0/952716098 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb42effd700 1 -- 172.21.15.92:0/952716098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb430199c10 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb42effd700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4200056d0 tx=0x7fb4200057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420026070 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb42000bba0 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb430199f00 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb420003920 con 0x7fb430101f90 2024-04-26T17:49:15.635 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.634+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43019a3c0 con 0x7fb430101f90 2024-04-26T17:49:15.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.635+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fb420029070 con 0x7fb430101f90 2024-04-26T17:49:15.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.635+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb430103470 con 0x7fb430101f90 2024-04-26T17:49:15.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.635+0000 7fb417fff700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 0x7fb41803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:15.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.635+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb42001e070 con 0x7fb430101f90 2024-04-26T17:49:15.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.635+0000 7fb42e7fc700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 0x7fb41803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:15.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.636+0000 7fb42e7fc700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 0x7fb41803bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb424006fd0 tx=0x7fb424006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:15.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.640+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb420013070 con 0x7fb430101f90 2024-04-26T17:49:15.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:15.842+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) -- 0x7fb43006b8a0 con 0x7fb418039650 2024-04-26T17:49:16.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:16 smithi092 ceph-mon[29156]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:18 smithi092 ceph-mon[29156]: Deploying cephadm binary to smithi156 2024-04-26T17:49:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:18 smithi092 ceph-mon[29156]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:20.255 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi156' with addr '172.21.15.156' 2024-04-26T17:49:20.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.254+0000 7fb417fff700 1 -- 172.21.15.92:0/952716098 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb43006b8a0 con 0x7fb418039650 2024-04-26T17:49:20.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 msgr2=0x7fb41803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:20.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 0x7fb41803bb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb424006fd0 tx=0x7fb424006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:20.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 msgr2=0x7fb4301996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4200056d0 tx=0x7fb4200057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 shutdown_connections 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb418039650 0x7fb41803bb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 --2- 172.21.15.92:0/952716098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb430101f90 0x7fb4301996d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 >> 172.21.15.92:0/952716098 conn(0x7fb4300fd840 msgr2=0x7fb430103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 shutdown_connections 2024-04-26T17:49:20.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:20.257+0000 7fb435570700 1 -- 172.21.15.92:0/952716098 wait complete. 2024-04-26T17:49:20.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:20 smithi092 ceph-mon[29156]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:20.851 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:20.851 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:20.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T17:49:21.109 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:21.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:21 smithi092 ceph-mon[29156]: Added host smithi156 2024-04-26T17:49:21.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:21 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:21.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:21 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 -- 172.21.15.92:0/407301186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 msgr2=0x7fce701023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 --2- 172.21.15.92:0/407301186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce701023b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fce60009910 tx=0x7fce60009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 -- 172.21.15.92:0/407301186 shutdown_connections 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 --2- 172.21.15.92:0/407301186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce701023b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 -- 172.21.15.92:0/407301186 >> 172.21.15.92:0/407301186 conn(0x7fce70077880 msgr2=0x7fce70077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 -- 172.21.15.92:0/407301186 shutdown_connections 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.628+0000 7fce75123700 1 -- 172.21.15.92:0/407301186 wait complete. 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce75123700 1 Processor -- start 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce75123700 1 -- start start 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce75123700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:22.636 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce75123700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce7010c200 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce6ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce6ed9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40124/0 (socket says 172.21.15.92:40124) 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce6ed9d700 1 -- 172.21.15.92:0/2886899269 learned_addr learned my addr 172.21.15.92:0/2886899269 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.629+0000 7fce6ed9d700 1 -- 172.21.15.92:0/2886899269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7019d940 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce6ed9d700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce600056d0 tx=0x7fce600057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60026070 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce6000bba0 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7019dc30 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce60003920 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.630+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce70197610 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fce60029070 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce6cd99700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 0x7fce5c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fce6001e070 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce70103460 con 0x7fce70101fd0 2024-04-26T17:49:22.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce67fff700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 0x7fce5c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.631+0000 7fce67fff700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 0x7fce5c03bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce58006fd0 tx=0x7fce58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:22.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.636+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fce60030070 con 0x7fce70101fd0 2024-04-26T17:49:22.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:22 smithi092 ceph-mon[29156]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.840+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce70064a80 con 0x7fce5c039650 2024-04-26T17:49:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.841+0000 7fce6cd99700 1 -- 172.21.15.92:0/2886899269 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fce70064a80 con 0x7fce5c039650 2024-04-26T17:49:22.841 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:22.841 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2024-04-26T17:49:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 msgr2=0x7fce5c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 0x7fce5c03bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fce58006fd0 tx=0x7fce58006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 msgr2=0x7fce7019d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce600056d0 tx=0x7fce600057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:22.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 shutdown_connections 2024-04-26T17:49:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fce5c039650 0x7fce5c03bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 --2- 172.21.15.92:0/2886899269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce70101fd0 0x7fce7019d400 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 >> 172.21.15.92:0/2886899269 conn(0x7fce70077880 msgr2=0x7fce70103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 shutdown_connections 2024-04-26T17:49:22.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:22.843+0000 7fce75123700 1 -- 172.21.15.92:0/2886899269 wait complete. 2024-04-26T17:49:23.475 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-04-26T17:49:23.476 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:49:23.476 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-04-26T17:49:23.496 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:49:23.496 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:23.553 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-04-26T17:49:23.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch host add smithi189 2024-04-26T17:49:23.787 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:24.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:23 smithi092 ceph-mon[29156]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:49:24.193 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:24.194 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:23 smithi092 ceph-mon[29156]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:25.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 -- 172.21.15.92:0/3231320907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 msgr2=0x7f1f90103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 --2- 172.21.15.92:0/3231320907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f90103470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009910 tx=0x7f1f8c009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 -- 172.21.15.92:0/3231320907 shutdown_connections 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 --2- 172.21.15.92:0/3231320907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f90103470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 -- 172.21.15.92:0/3231320907 >> 172.21.15.92:0/3231320907 conn(0x7f1f900fe960 msgr2=0x7f1f90100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 -- 172.21.15.92:0/3231320907 shutdown_connections 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.257+0000 7f1f9860e700 1 -- 172.21.15.92:0/3231320907 wait complete. 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f9860e700 1 Processor -- start 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f9860e700 1 -- start start 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f9860e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:25.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f9860e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9010d310 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f963aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f963aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51222/0 (socket says 172.21.15.92:51222) 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.258+0000 7f1f963aa700 1 -- 172.21.15.92:0/1107350097 learned_addr learned my addr 172.21.15.92:0/1107350097 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f963aa700 1 -- 172.21.15.92:0/1107350097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9019eaf0 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f963aa700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0056d0 tx=0x7f1f8c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c026070 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f8c00bba0 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9019ede0 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f8c003920 con 0x7f1f90103090 2024-04-26T17:49:25.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.259+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f90198850 con 0x7f1f90103090 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.260+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f1f8c029070 con 0x7f1f90103090 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.260+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f90104570 con 0x7f1f90103090 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.260+0000 7f1f877fe700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 0x7f1f7c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.260+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f8c01e070 con 0x7f1f90103090 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.260+0000 7f1f95ba9700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 0x7f1f7c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.261+0000 7f1f95ba9700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 0x7f1f7c03bb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f80006fd0 tx=0x7f1f80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:25.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.265+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f8c013070 con 0x7f1f90103090 2024-04-26T17:49:25.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:25.466+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}) -- 0x7f1f90199be0 con 0x7f1f7c039650 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:27.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:27 smithi092 ceph-mon[29156]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:49:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:27 smithi092 ceph-mon[29156]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:27 smithi092 ceph-mon[29156]: Deploying cephadm binary to smithi189 2024-04-26T17:49:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:27 smithi092 ceph-mon[29156]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:27 smithi092 ceph-mon[29156]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:49:28.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:28 smithi092 ceph-mon[29156]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:29.673 INFO:teuthology.orchestra.run.smithi092.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-04-26T17:49:29.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.672+0000 7f1f877fe700 1 -- 172.21.15.92:0/1107350097 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f1f90199be0 con 0x7f1f7c039650 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 msgr2=0x7f1f7c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 0x7f1f7c03bb10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1f80006fd0 tx=0x7f1f80006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 msgr2=0x7f1f9019e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0056d0 tx=0x7f1f8c0057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 shutdown_connections 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c039650 0x7f1f7c03bb10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 --2- 172.21.15.92:0/1107350097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90103090 0x7f1f9019e5b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 >> 172.21.15.92:0/1107350097 conn(0x7f1f900fe960 msgr2=0x7f1f90104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 shutdown_connections 2024-04-26T17:49:29.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:29.675+0000 7f1f9860e700 1 -- 172.21.15.92:0/1107350097 wait complete. 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: Added host smithi189 2024-04-26T17:49:30.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:30.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-26T17:49:30.546 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:32.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 -- 172.21.15.92:0/169217823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 msgr2=0x7f22e0103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:32.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 --2- 172.21.15.92:0/169217823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e0103470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009910 tx=0x7f22d0009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:32.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 -- 172.21.15.92:0/169217823 shutdown_connections 2024-04-26T17:49:32.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 --2- 172.21.15.92:0/169217823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e0103470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:32.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 -- 172.21.15.92:0/169217823 >> 172.21.15.92:0/169217823 conn(0x7f22e00fe960 msgr2=0x7f22e0100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:32.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 -- 172.21.15.92:0/169217823 shutdown_connections 2024-04-26T17:49:32.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 -- 172.21.15.92:0/169217823 wait complete. 2024-04-26T17:49:32.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.120+0000 7f22e5f17700 1 Processor -- start 2024-04-26T17:49:32.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22e5f17700 1 -- start start 2024-04-26T17:49:32.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22e5f17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:32.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22e5f17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f22e010d310 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22df7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22df7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51234/0 (socket says 172.21.15.92:51234) 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22df7fe700 1 -- 172.21.15.92:0/194524652 learned_addr learned my addr 172.21.15.92:0/194524652 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22df7fe700 1 -- 172.21.15.92:0/194524652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e019eaf0 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22df7fe700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22d00056d0 tx=0x7f22d00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0026070 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d000bba0 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0003920 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.121+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e019ede0 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.122+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e0198850 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.122+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f22d0029070 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.122+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0104570 con 0x7f22e0103090 2024-04-26T17:49:32.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.122+0000 7f22dcff9700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 0x7f22c803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:32.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.123+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f22d001e070 con 0x7f22e0103090 2024-04-26T17:49:32.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.123+0000 7f22deffd700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 0x7f22c803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:32.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.123+0000 7f22deffd700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 0x7f22c803bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006fd0 tx=0x7f22d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:32.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.128+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f22d0013070 con 0x7f22e0103090 2024-04-26T17:49:32.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.333+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22e0199be0 con 0x7f22c8039650 2024-04-26T17:49:32.334 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.335+0000 7f22dcff9700 1 -- 172.21.15.92:0/194524652 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f22e0199be0 con 0x7f22c8039650 2024-04-26T17:49:32.335 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:49:32.335 INFO:teuthology.orchestra.run.smithi092.stdout:[{"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 msgr2=0x7f22c803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 0x7f22c803bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006fd0 tx=0x7f22d4006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 msgr2=0x7f22e019e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22d00056d0 tx=0x7f22d00057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 shutdown_connections 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f22c8039650 0x7f22c803bb10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 --2- 172.21.15.92:0/194524652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0103090 0x7f22e019e5b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 >> 172.21.15.92:0/194524652 conn(0x7f22e00fe960 msgr2=0x7f22e0104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 shutdown_connections 2024-04-26T17:49:32.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:32.337+0000 7f22e5f17700 1 -- 172.21.15.92:0/194524652 wait complete. 2024-04-26T17:49:32.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:32 smithi092 ceph-mon[29156]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:32.968 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-26T17:49:32.969 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-26T17:49:33.201 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:33.550 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:33 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:33.550 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:33 smithi092 ceph-mon[29156]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:49:34.424 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:34 smithi092 ceph-mon[29156]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 -- 172.21.15.92:0/3776840183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 msgr2=0x7f52f8109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 --2- 172.21.15.92:0/3776840183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f8109220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009910 tx=0x7f52e8009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 -- 172.21.15.92:0/3776840183 shutdown_connections 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 --2- 172.21.15.92:0/3776840183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f8109220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 -- 172.21.15.92:0/3776840183 >> 172.21.15.92:0/3776840183 conn(0x7f52f80792b0 msgr2=0x7f52f80796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 -- 172.21.15.92:0/3776840183 shutdown_connections 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 -- 172.21.15.92:0/3776840183 wait complete. 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.654+0000 7f52fddf1700 1 Processor -- start 2024-04-26T17:49:34.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52fddf1700 1 -- start start 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52fddf1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52fddf1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52f810d310 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44240/0 (socket says 172.21.15.92:44240) 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52f77fe700 1 -- 172.21.15.92:0/569465639 learned_addr learned my addr 172.21.15.92:0/569465639 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52f77fe700 1 -- 172.21.15.92:0/569465639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f81045e0 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.655+0000 7f52f77fe700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f52e80056d0 tx=0x7f52e80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e8026070 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f8102c90 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52e800bc00 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e8003920 con 0x7f52f8108e40 2024-04-26T17:49:34.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f8103150 con 0x7f52f8108e40 2024-04-26T17:49:34.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.656+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f52e8029070 con 0x7f52f8108e40 2024-04-26T17:49:34.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.657+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f806b000 con 0x7f52f8108e40 2024-04-26T17:49:34.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.657+0000 7f52f4ff9700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 0x7f52e003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:34.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.657+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f52e801e070 con 0x7f52f8108e40 2024-04-26T17:49:34.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.657+0000 7f52f6ffd700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 0x7f52e003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:34.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.657+0000 7f52f6ffd700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 0x7f52e003bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006fd0 tx=0x7f52ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:34.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.662+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f52e8013070 con 0x7f52f8108e40 2024-04-26T17:49:34.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:34.864+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f52f8103c20 con 0x7f52f8108e40 2024-04-26T17:49:35.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.261+0000 7f52f4ff9700 1 -- 172.21.15.92:0/569465639 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f52e8030090 con 0x7f52f8108e40 2024-04-26T17:49:35.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 msgr2=0x7f52e003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 0x7f52e003bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52ec006fd0 tx=0x7f52ec006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 msgr2=0x7f52f81026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f52e80056d0 tx=0x7f52e80057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 shutdown_connections 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52e0039650 0x7f52e003bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 --2- 172.21.15.92:0/569465639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52f8108e40 0x7f52f81026f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 >> 172.21.15.92:0/569465639 conn(0x7f52f80792b0 msgr2=0x7f52f80feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 shutdown_connections 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:49:35.264+0000 7f52fddf1700 1 -- 172.21.15.92:0/569465639 wait complete. 2024-04-26T17:49:35.263 INFO:teuthology.orchestra.run.smithi092.stderr:adjusted tunables profile to default 2024-04-26T17:49:35.652 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:35 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/569465639' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T17:49:35.988 INFO:tasks.cephadm:Adding mon.a on smithi092 2024-04-26T17:49:35.988 INFO:tasks.cephadm:Adding mon.b on smithi156 2024-04-26T17:49:35.989 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-04-26T17:49:35.989 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch apply mon '3;smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c' 2024-04-26T17:49:36.227 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/569465639' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:37.610 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- 172.21.15.189:0/1878405606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 msgr2=0x7ff470103470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 --2- 172.21.15.189:0/1878405606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff470103470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff460009910 tx=0x7ff460009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- 172.21.15.189:0/1878405606 shutdown_connections 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 --2- 172.21.15.189:0/1878405606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff470103470 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- 172.21.15.189:0/1878405606 >> 172.21.15.189:0/1878405606 conn(0x7ff4700fe960 msgr2=0x7ff470100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- 172.21.15.189:0/1878405606 shutdown_connections 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- 172.21.15.189:0/1878405606 wait complete. 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 Processor -- start 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.609+0000 7ff476592700 1 -- start start 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff476592700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff476592700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff47010d310 con 0x7ff470103090 2024-04-26T17:49:37.611 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff46ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:37.612 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff46ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.189:52882/0 (socket says 172.21.15.189:52882) 2024-04-26T17:49:37.612 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff46ffff700 1 -- 172.21.15.189:0/1719075289 learned_addr learned my addr 172.21.15.189:0/1719075289 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:49:37.612 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.610+0000 7ff46ffff700 1 -- 172.21.15.189:0/1719075289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47019eaf0 con 0x7ff470103090 2024-04-26T17:49:37.612 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff46ffff700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4600056d0 tx=0x7ff4600057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460026070 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff46000bba0 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47019ede0 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff460003920 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.611+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff470198850 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.612+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff470104570 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.612+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7ff460029070 con 0x7ff470103090 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.612+0000 7ff46d7fa700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 0x7ff45803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:37.613 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.612+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff46001e070 con 0x7ff470103090 2024-04-26T17:49:37.614 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.612+0000 7ff46f7fe700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 0x7ff45803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:37.614 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.613+0000 7ff46f7fe700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 0x7ff45803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff464006fd0 tx=0x7ff464006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:37.617 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.617+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff460013070 con 0x7ff470103090 2024-04-26T17:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:37 smithi092 ceph-mon[29156]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:37 smithi092 ceph-mon[29156]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:49:37.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.827+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}) -- 0x7ff4700008d0 con 0x7ff458039650 2024-04-26T17:49:37.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.834+0000 7ff46d7fa700 1 -- 172.21.15.189:0/1719075289 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff4700008d0 con 0x7ff458039650 2024-04-26T17:49:37.834 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-04-26T17:49:37.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 msgr2=0x7ff45803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:37.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 0x7ff45803bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff464006fd0 tx=0x7ff464006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 msgr2=0x7ff47019e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4600056d0 tx=0x7ff4600057b0 comp rx=0 tx=0).stop 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 shutdown_connections 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff458039650 0x7ff45803bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 --2- 172.21.15.189:0/1719075289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff470103090 0x7ff47019e5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 >> 172.21.15.189:0/1719075289 conn(0x7ff4700fe960 msgr2=0x7ff470104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 shutdown_connections 2024-04-26T17:49:37.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:37.836+0000 7ff476592700 1 -- 172.21.15.189:0/1719075289 wait complete. 2024-04-26T17:49:38.433 DEBUG:teuthology.orchestra.run.smithi156:mon.b> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.b.service 2024-04-26T17:49:38.436 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mon.c.service 2024-04-26T17:49:38.438 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T17:49:38.438 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T17:49:38.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:39.558 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:39.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:39 smithi092 ceph-mon[29156]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:39 smithi092 ceph-mon[29156]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c;count:3 2024-04-26T17:49:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:39 smithi092 ceph-mon[29156]: Deploying daemon mon.c on smithi189 2024-04-26T17:49:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:40 smithi092 ceph-mon[29156]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:41.793 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:41 smithi189 systemd[1]: Starting Ceph mon.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 -- 172.21.15.189:0/2490110850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 msgr2=0x7f72281092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 --2- 172.21.15.189:0/2490110850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281092a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f722000b0a0 tx=0x7f722000b3b0 comp rx=0 tx=0).stop 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 -- 172.21.15.189:0/2490110850 shutdown_connections 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 --2- 172.21.15.189:0/2490110850 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281092a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 -- 172.21.15.189:0/2490110850 >> 172.21.15.189:0/2490110850 conn(0x7f7228077880 msgr2=0x7f7228077c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.297+0000 7f722f334700 1 -- 172.21.15.189:0/2490110850 shutdown_connections 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.298+0000 7f722f334700 1 -- 172.21.15.189:0/2490110850 wait complete. 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.298+0000 7f722f334700 1 Processor -- start 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.298+0000 7f722f334700 1 -- start start 2024-04-26T17:49:42.299 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.298+0000 7f722f334700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.298+0000 7f722f334700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f722810d300 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722d0d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722d0d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.189:52898/0 (socket says 172.21.15.189:52898) 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722d0d0700 1 -- 172.21.15.189:0/165133183 learned_addr learned my addr 172.21.15.189:0/165133183 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722d0d0700 1 -- 172.21.15.189:0/165133183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72281a0b90 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722d0d0700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7220006130 tx=0x7f72200097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220021020 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72281a0e20 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72200079b0 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220017040 con 0x7f7228108ec0 2024-04-26T17:49:42.300 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.299+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f722819a7d0 con 0x7f7228108ec0 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.300+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7228104570 con 0x7f7228108ec0 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.300+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f7220024020 con 0x7f7228108ec0 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.301+0000 7f721e7fc700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 0x7f721403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.301+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f722000f050 con 0x7f7228108ec0 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.301+0000 7f722c8cf700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 0x7f721403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:42.301 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.301+0000 7f722c8cf700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 0x7f721403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7218006fd0 tx=0x7f7218006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:42.305 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.306+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f722002b020 con 0x7f7228108ec0 2024-04-26T17:49:42.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 podman[32713]: 2024-04-26 17:49:42.082962042 +0000 UTC m=+0.019400121 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:49:42.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 podman[32713]: 2024-04-26 17:49:42.338318541 +0000 UTC m=+0.274756605 container create 0707340a0999892f8c4904bd709ed44e313f7a9484216732a85aa2fb1410b615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T17:49:42.565 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.565+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f722002ebe0 con 0x7f7228108ec0 2024-04-26T17:49:42.603 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:42.603+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7228064a80 con 0x7f7228108ec0 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 podman[32713]: 2024-04-26 17:49:42.507312223 +0000 UTC m=+0.443750290 container init 0707340a0999892f8c4904bd709ed44e313f7a9484216732a85aa2fb1410b615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 podman[32713]: 2024-04-26 17:49:42.510227179 +0000 UTC m=+0.446665252 container start 0707340a0999892f8c4904bd709ed44e313f7a9484216732a85aa2fb1410b615 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: set uid:gid to 167:167 (ceph:ceph) 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev), process ceph-mon, pid 2 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pidfile_write: ignore empty --pid-file 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: load: jerasure load: lrc 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: RocksDB version: 7.9.2 2024-04-26T17:49:42.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Git sha 0 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Compile date 2024-04-26 07:20:26 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: DB SUMMARY 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: DB Session ID: 8G8G1KOOHNDRSOWN94WA 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: CURRENT file: CURRENT 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: IDENTITY file: IDENTITY 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.error_if_exists: 0 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.create_if_missing: 0 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.paranoid_checks: 1 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-26T17:49:42.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.env: 0x560368bcecc0 2024-04-26T17:49:42.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.fs: PosixFileSystem 2024-04-26T17:49:42.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.info_log: 0x56036b381d80 2024-04-26T17:49:42.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_file_opening_threads: 16 2024-04-26T17:49:42.606 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.statistics: (nil) 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.use_fsync: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_log_file_size: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.keep_log_file_num: 1000 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.recycle_log_file_num: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_fallocate: 1 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_mmap_reads: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_mmap_writes: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.use_direct_reads: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.create_missing_column_families: 0 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.db_log_dir: 2024-04-26T17:49:42.607 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.wal_dir: 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.advise_random_on_open: 1 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.db_write_buffer_size: 0 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.write_buffer_manager: 0x56036b3530e0 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.rate_limiter: (nil) 2024-04-26T17:49:42.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.wal_recovery_mode: 2 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enable_thread_tracking: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enable_pipelined_write: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.unordered_write: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.row_cache: None 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.wal_filter: None 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_ingest_behind: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.two_write_queues: 0 2024-04-26T17:49:42.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.manual_wal_flush: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.wal_compression: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.atomic_flush: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.log_readahead_size: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.best_efforts_recovery: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.allow_data_in_errors: 0 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.db_host_id: __hostname__ 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-26T17:49:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_background_jobs: 2 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_background_compactions: -1 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_subcompactions: 1 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_total_wal_size: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_open_files: -1 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bytes_per_sync: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_readahead_size: 0 2024-04-26T17:49:42.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_background_flushes: -1 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Compression algorithms supported: 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kZSTD supported: 0 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kXpressCompression supported: 0 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kLZ4HCCompression supported: 1 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kZlibCompression supported: 1 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kSnappyCompression supported: 1 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kLZ4Compression supported: 1 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: kBZip2Compression supported: 0 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-26T17:49:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.merge_operator: 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_filter: None 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_filter_factory: None 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.sst_partitioner_factory: None 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56036b381f40) 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks: 1 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: pin_top_level_index_and_filter: 1 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_type: 0 2024-04-26T17:49:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_index_type: 0 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_shortening: 1 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: checksum: 4 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: no_block_cache: 0 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache: 0x56036b3851f0 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_name: BinnedLRUCache 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_options: 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: capacity : 536870912 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_shard_bits : 4 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: strict_capacity_limit : 0 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: high_pri_pool_ratio: 0.000 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_cache_compressed: (nil) 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: persistent_cache: (nil) 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size: 4096 2024-04-26T17:49:42.614 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_size_deviation: 10 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_restart_interval: 16 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: index_block_restart_interval: 1 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: metadata_block_size: 4096 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: partition_filters: 0 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: use_delta_encoding: 1 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: filter_policy: bloomfilter 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: whole_key_filtering: 1 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: verify_compression: 0 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: read_amp_bytes_per_bit: 0 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: format_version: 5 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_index_compression: 1 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: block_align: 0 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: max_auto_readahead_size: 262144 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: prepopulate_block_cache: 0 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: initial_auto_readahead_size: 8192 2024-04-26T17:49:42.615 INFO:journalctl@ceph.mon.c.smithi189.stdout: num_file_reads_for_auto_readahead: 2 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.write_buffer_size: 33554432 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_write_buffer_number: 2 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression: NoCompression 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression: Disabled 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.prefix_extractor: nullptr 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.num_levels: 7 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-26T17:49:42.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.level: 32767 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.strategy: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.enabled: false 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-26T17:49:42.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.target_file_size_base: 67108864 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-26T17:49:42.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.arena_block_size: 1048576 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.disable_auto_compactions: 0 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-26T17:49:42.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.inplace_update_support: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.bloom_locality: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.max_successive_merges: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.paranoid_file_checks: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.force_consistency_checks: 1 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.report_bg_io_stats: 0 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.ttl: 2592000 2024-04-26T17:49:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enable_blob_files: false 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.min_blob_size: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_file_size: 268435456 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.blob_file_starting_level: 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-26T17:49:42.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e7628727-c302-4f2b-a2c3-16e966e8a4ef 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153782540468, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153782541035, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714153782, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e7628727-c302-4f2b-a2c3-16e966e8a4ef", "db_session_id": "8G8G1KOOHNDRSOWN94WA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714153782541145, "job": 1, "event": "recovery_finished"} 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56036b4a2000 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: DB pointer 0x56036b48e000 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** DB Stats ** 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T17:49:42.622 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** Compaction Stats [default] ** 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-26T17:49:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache BinnedLRUCache@0x56036b3851f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: using public_addr v2:172.21.15.189:0/0 -> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: starting mon.c rank -1 at public addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] at bind addrs [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(???) e0 preinit fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).mds e1 new map 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: e1 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T17:49:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout: legacy client fscid: -1 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout: 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout: No filesystems configured 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:49:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:49:42.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-26T17:49:42.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:49:42.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:49:42.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Deploying cephadm binary to smithi189 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Added host smithi189 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/569465639' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/569465639' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:42.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Saving service mon spec with placement smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c;count:3 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: Deploying daemon mon.c on smithi189 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 ceph-mon[32756]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 bash[32713]: 0707340a0999892f8c4904bd709ed44e313f7a9484216732a85aa2fb1410b615 2024-04-26T17:49:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:42 smithi189 systemd[1]: Started Ceph mon.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:49:47.581 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.581+0000 7f721e7fc700 1 -- 172.21.15.189:0/165133183 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f7220003f80 con 0x7f7228108ec0 2024-04-26T17:49:47.582 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:49:47.582 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","modified":"2024-04-26T17:49:42.565878Z","created":"2024-04-26T17:48:01.505526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 msgr2=0x7f721403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 0x7f721403bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7218006fd0 tx=0x7f7218006e40 comp rx=0 tx=0).stop 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 msgr2=0x7f72281a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7220006130 tx=0x7f72200097d0 comp rx=0 tx=0).stop 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 shutdown_connections 2024-04-26T17:49:47.584 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7214039650 0x7f721403bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:47.585 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 --2- 172.21.15.189:0/165133183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7228108ec0 0x7f72281a0650 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:47.585 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.584+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 >> 172.21.15.189:0/165133183 conn(0x7f7228077880 msgr2=0x7f722810b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:47.585 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.585+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 shutdown_connections 2024-04-26T17:49:47.585 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:47.585+0000 7f722f334700 1 -- 172.21.15.189:0/165133183 wait complete. 2024-04-26T17:49:47.585 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: mon.a calling monitor election 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/165133183' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: mon.c calling monitor election 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: monmap epoch 2 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: last_changed 2024-04-26T17:49:42.565878+0000 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: min_mon_release 19 (squid) 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: election_strategy: 1 2024-04-26T17:49:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: fsmap 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: mgrmap e13: x(active, since 50s) 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: overall HEALTH_OK 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: mon.a calling monitor election 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/165133183' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: mon.c calling monitor election 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: monmap epoch 2 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: last_changed 2024-04-26T17:49:42.565878+0000 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: min_mon_release 19 (squid) 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: election_strategy: 1 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: fsmap 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: mgrmap e13: x(active, since 50s) 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: overall HEALTH_OK 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:48.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:48 smithi092 ceph-mon[29156]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:48 smithi092 ceph-mon[29156]: Deploying daemon mon.b on smithi156 2024-04-26T17:49:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:48 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:48 smithi189 ceph-mon[32756]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:48 smithi189 ceph-mon[32756]: Deploying daemon mon.b on smithi156 2024-04-26T17:49:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:48 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:49.235 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T17:49:49.235 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T17:49:49.473 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:49:50.732 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:50 smithi189 ceph-mon[32756]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:50.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2822985562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 msgr2=0x7f9f98107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2822985562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98107a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009910 tx=0x7f9f88009c20 comp rx=0 tx=0).stop 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2822985562 shutdown_connections 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2822985562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98107a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2822985562 >> 172.21.15.189:0/2822985562 conn(0x7f9f980fcc50 msgr2=0x7f9f980ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2822985562 shutdown_connections 2024-04-26T17:49:50.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2822985562 wait complete. 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.834+0000 7f9f9e12e700 1 Processor -- start 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f9e12e700 1 -- start start 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f9e12e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f9e12e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f9e12e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9810bb60 con 0x7f9f98107670 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f9e12e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9810b9e0 con 0x7f9f98199e90 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:57724/0 (socket says 172.21.15.189:57724) 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 -- 172.21.15.189:0/2323779968 learned_addr learned my addr 172.21.15.189:0/2323779968 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:49:50.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 -- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 msgr2=0x7f9f9819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 -- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 msgr2=0x7f9f9819a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f977fe700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f96ffd700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f977fe700 1 -- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 msgr2=0x7f9f9819a310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.835+0000 7f9f977fe700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f977fe700 1 -- 172.21.15.189:0/2323779968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f981a29c0 con 0x7f9f98107670 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f977fe700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98199950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f88014000 tx=0x7f9f88005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9f88005dc0 con 0x7f9f98107670 2024-04-26T17:49:50.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f981a2b90 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f8800b750 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9f880039a0 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.836+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981a3070 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.837+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f98102ce0 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.837+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f9f88029070 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.837+0000 7f9f94ff9700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 0x7f9f8003b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.837+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9f8801e070 con 0x7f9f98107670 2024-04-26T17:49:50.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.837+0000 7f9f96ffd700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 0x7f9f8003b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:50.840 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.838+0000 7f9f96ffd700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 0x7f9f8003b8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009180 tx=0x7f9f8c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:50.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:50.843+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9f88013070 con 0x7f9f98107670 2024-04-26T17:49:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:50 smithi092 ceph-mon[29156]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:51.125 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.126+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9f981a3370 con 0x7f9f98107670 2024-04-26T17:49:51.126 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.126+0000 7f9f94ff9700 1 -- 172.21.15.189:0/2323779968 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f9f88030090 con 0x7f9f98107670 2024-04-26T17:49:51.126 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:49:51.126 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","modified":"2024-04-26T17:49:42.565878Z","created":"2024-04-26T17:48:01.505526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 msgr2=0x7f9f8003b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 0x7f9f8003b8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009180 tx=0x7f9f8c008040 comp rx=0 tx=0).stop 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 msgr2=0x7f9f98199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98199950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f88014000 tx=0x7f9f88005030 comp rx=0 tx=0).stop 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 shutdown_connections 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9f800393f0 0x7f9f8003b8b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f98107670 0x7f9f98199950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 --2- 172.21.15.189:0/2323779968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9f98199e90 0x7f9f9819a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 >> 172.21.15.189:0/2323779968 conn(0x7f9f980fcc50 msgr2=0x7f9f980fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 shutdown_connections 2024-04-26T17:49:51.129 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:51.129+0000 7f9f9e12e700 1 -- 172.21.15.189:0/2323779968 wait complete. 2024-04-26T17:49:51.130 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-04-26T17:49:51.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:51 smithi156 ceph-mon[32679]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-26T17:49:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:51 smithi156 bash[32660]: 1887ea051e1255b33f51b65a3fcbc45b4248392caa82f1ecbe9b9fb2aa23eecb 2024-04-26T17:49:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:51 smithi156 systemd[1]: Started Ceph mon.b for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:49:52.680 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-26T17:49:52.680 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-26T17:49:52.924 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:49:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:49:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: mon.c calling monitor election 2024-04-26T17:49:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: mon.a calling monitor election 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: monmap epoch 3 2024-04-26T17:49:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: min_mon_release 19 (squid) 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: election_strategy: 1 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: fsmap 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: mgrmap e13: x(active, since 58s) 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: overall HEALTH_OK 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:49:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: mon.c calling monitor election 2024-04-26T17:49:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: mon.a calling monitor election 2024-04-26T17:49:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: monmap epoch 3 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: min_mon_release 19 (squid) 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: election_strategy: 1 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: fsmap 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: mgrmap e13: x(active, since 58s) 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: overall HEALTH_OK 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 -- 172.21.15.189:0/3013172534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 msgr2=0x7fa2e8005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 --2- 172.21.15.189:0/3013172534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2e8005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc102e60 tx=0x7fa2ec00feb0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 -- 172.21.15.189:0/3013172534 shutdown_connections 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 --2- 172.21.15.189:0/3013172534 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2e8005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 -- 172.21.15.189:0/3013172534 >> 172.21.15.189:0/3013172534 conn(0x7fa2fc0fea20 msgr2=0x7fa2fc100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 -- 172.21.15.189:0/3013172534 shutdown_connections 2024-04-26T17:49:57.345 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.345+0000 7fa3042d5700 1 -- 172.21.15.189:0/3013172534 wait complete. 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 Processor -- start 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 -- start start 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2fc198e80 0x7fa2fc199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc10ae20 con 0x7fa2e80035c0 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc10aca0 con 0x7fa2fc198e80 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa3042d5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa2fc10afa0 con 0x7fa2fc19ec70 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:57.348 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa301870700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.189:54714/0 (socket says 172.21.15.189:54714) 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 -- 172.21.15.189:0/1774340101 learned_addr learned my addr 172.21.15.189:0/1774340101 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa301870700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 msgr2=0x7fa2fc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa301870700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 msgr2=0x7fa2fc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa301870700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa301870700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 msgr2=0x7fa2fc198940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302872700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2fc198e80 0x7fa2fc199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2fc198e80 msgr2=0x7fa2fc199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2fc198e80 0x7fa2fc199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.346+0000 7fa302071700 1 -- 172.21.15.189:0/1774340101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2fc1a5600 con 0x7fa2e80035c0 2024-04-26T17:49:57.349 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa302071700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001eb0 tx=0x7fa2ec013a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec029030 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2fc1a57d0 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2ec0044e0 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec003980 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.347+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2fc1a5d10 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.348+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7fa2ec02c070 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.348+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2fc064a80 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.348+0000 7fa2f37fe700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 0x7fa2e003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.348+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa2ec04ed70 con 0x7fa2e80035c0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.348+0000 7fa301870700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 0x7fa2e003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:49:57.350 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.349+0000 7fa301870700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 0x7fa2e003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009850 tx=0x7fa2f8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:49:57.352 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.353+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa2ec01ac30 con 0x7fa2e80035c0 2024-04-26T17:49:57.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:57.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:57.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:57.604 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:57.636 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.637+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa2fc1a6000 con 0x7fa2e80035c0 2024-04-26T17:49:57.637 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.637+0000 7fa2f37fe700 1 -- 172.21.15.189:0/1774340101 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fa2ec0342a0 con 0x7fa2e80035c0 2024-04-26T17:49:57.637 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-04-26T17:49:57.637 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","modified":"2024-04-26T17:49:51.401752Z","created":"2024-04-26T17:48:01.505526Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 msgr2=0x7fa2e003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 0x7fa2e003bfa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009850 tx=0x7fa2f8008040 comp rx=0 tx=0).stop 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 msgr2=0x7fa2fc19e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec001eb0 tx=0x7fa2ec013a10 comp rx=0 tx=0).stop 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 shutdown_connections 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa2e0039ae0 0x7fa2e003bfa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2fc198e80 0x7fa2fc199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.639 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2e80035c0 0x7fa2fc19e730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.640 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 --2- 172.21.15.189:0/1774340101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa2fc19ec70 0x7fa2fc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:49:57.640 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.639+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 >> 172.21.15.189:0/1774340101 conn(0x7fa2fc0fea20 msgr2=0x7fa2fc106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:49:57.640 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.640+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 shutdown_connections 2024-04-26T17:49:57.640 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:49:57.640+0000 7fa3042d5700 1 -- 172.21.15.189:0/1774340101 wait complete. 2024-04-26T17:49:57.640 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-04-26T17:49:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.635 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-26T17:49:58.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.c calling monitor election 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.a calling monitor election 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:49:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: monmap epoch 3 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: min_mon_release 19 (squid) 2024-04-26T17:49:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: election_strategy: 1 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: fsmap 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mgrmap e13: x(active, since 58s) 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: overall HEALTH_OK 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:49:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:49:58.874 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:49:59.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mon.b calling monitor election 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mon.b calling monitor election 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mon.c calling monitor election 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mon.a calling monitor election 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: monmap epoch 3 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:59.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: min_mon_release 19 (squid) 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: election_strategy: 1 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: fsmap 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: mgrmap e13: x(active, since 60s) 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: overall HEALTH_OK 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:59.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:58 smithi092 ceph-mon[29156]: Reconfiguring daemon mon.a on smithi092 2024-04-26T17:49:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mon.b calling monitor election 2024-04-26T17:49:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:49:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:49:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:49:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mon.b calling monitor election 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mon.c calling monitor election 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mon.a calling monitor election 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: monmap epoch 3 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: min_mon_release 19 (squid) 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: election_strategy: 1 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: fsmap 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: mgrmap e13: x(active, since 60s) 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: overall HEALTH_OK 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:58 smithi189 ceph-mon[32756]: Reconfiguring daemon mon.a on smithi092 2024-04-26T17:49:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.b calling monitor election 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.b calling monitor election 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.c calling monitor election 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.a calling monitor election 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-26T17:49:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: monmap epoch 3 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: last_changed 2024-04-26T17:49:51.401752+0000 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: created 2024-04-26T17:48:01.505526+0000 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: min_mon_release 19 (squid) 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: election_strategy: 1 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 0: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.a 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: 2: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: fsmap 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: osdmap e4: 0 total, 0 up, 0 in 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: mgrmap e13: x(active, since 60s) 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: overall HEALTH_OK 2024-04-26T17:49:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Reconfiguring mon.a (unknown last config time)... 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:49:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:58 smithi156 ceph-mon[32679]: Reconfiguring daemon mon.a on smithi092 2024-04-26T17:50:00.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:50:00.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:49:59 smithi092 ceph-mon[29156]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:59 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:50:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:49:59 smithi189 ceph-mon[32756]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:59 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:50:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:49:59 smithi156 ceph-mon[32679]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:00.492 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:50:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:50:00.401+0000 7f517e784700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T17:50:01.153 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:00 smithi092 ceph-mon[29156]: overall HEALTH_OK 2024-04-26T17:50:01.153 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.153 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 -- 172.21.15.92:0/3840023018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102320 msgr2=0x7f2a7c1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:01.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 --2- 172.21.15.92:0/3840023018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102320 0x7f2a7c1027a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009990 tx=0x7f2a70009ca0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 -- 172.21.15.92:0/3840023018 shutdown_connections 2024-04-26T17:50:01.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 --2- 172.21.15.92:0/3840023018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 --2- 172.21.15.92:0/3840023018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c108390 0x7f2a7c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 --2- 172.21.15.92:0/3840023018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102320 0x7f2a7c1027a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.376+0000 7f2a81893700 1 -- 172.21.15.92:0/3840023018 >> 172.21.15.92:0/3840023018 conn(0x7f2a7c0792d0 msgr2=0x7f2a7c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.377+0000 7f2a81893700 1 -- 172.21.15.92:0/3840023018 shutdown_connections 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.377+0000 7f2a81893700 1 -- 172.21.15.92:0/3840023018 wait complete. 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.377+0000 7f2a81893700 1 Processor -- start 2024-04-26T17:50:01.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.377+0000 7f2a81893700 1 -- start start 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 0x7f2a7c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c108390 0x7f2a7c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c112530 con 0x7f2a7c102ce0 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c1123b0 con 0x7f2a7c108390 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7c1126b0 con 0x7f2a7c102320 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50224/0 (socket says 172.21.15.92:50224) 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 -- 172.21.15.92:0/3045462623 learned_addr learned my addr 172.21.15.92:0/3045462623 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7b7fe700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c108390 0x7f2a7c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7affd700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 0x7f2a7c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:01.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 -- 172.21.15.92:0/3045462623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 msgr2=0x7f2a7c19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 0x7f2a7c19e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 -- 172.21.15.92:0/3045462623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c108390 msgr2=0x7f2a7c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c108390 0x7f2a7c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 -- 172.21.15.92:0/3045462623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7c199010 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7affd700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 0x7f2a7c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a7a7fc700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a70000c00 tx=0x7f2a700047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70027070 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a70003f20 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.378+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7c1992a0 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.379+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70022cf0 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.379+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7c1a55c0 con 0x7f2a7c102ce0 2024-04-26T17:50:01.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.379+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f2a7002a070 con 0x7f2a7c102ce0 2024-04-26T17:50:01.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.379+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a7c06a110 con 0x7f2a7c102ce0 2024-04-26T17:50:01.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.380+0000 7f2a80891700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 0x7f2a6403bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:01.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.380+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2a7004d910 con 0x7f2a7c102ce0 2024-04-26T17:50:01.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.380+0000 7f2a7affd700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 0x7f2a6403bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:01.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.380+0000 7f2a7affd700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 0x7f2a6403bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c1999f0 tx=0x7f2a6c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:01.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.385+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2a70013070 con 0x7f2a7c102ce0 2024-04-26T17:50:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:00 smithi189 ceph-mon[32756]: overall HEALTH_OK 2024-04-26T17:50:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:00 smithi156 ceph-mon[32679]: overall HEALTH_OK 2024-04-26T17:50:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:01.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.588+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2a7c10a2e0 con 0x7f2a7c102ce0 2024-04-26T17:50:01.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.589+0000 7f2a80891700 1 -- 172.21.15.92:0/3045462623 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f2a70024080 con 0x7f2a7c102ce0 2024-04-26T17:50:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:# minimal ceph.conf for fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:50:01.589 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-04-26T17:50:01.590 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:50:01.590 INFO:teuthology.orchestra.run.smithi092.stdout: mon_host = [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-04-26T17:50:01.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 msgr2=0x7f2a6403bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 0x7f2a6403bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c1999f0 tx=0x7f2a6c008040 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 msgr2=0x7f2a7c19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2a70000c00 tx=0x7f2a700047b0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 shutdown_connections 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a64039890 0x7f2a6403bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a7c108390 0x7f2a7c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2a7c102320 0x7f2a7c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 --2- 172.21.15.92:0/3045462623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a7c102ce0 0x7f2a7c19ec30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.591+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 >> 172.21.15.92:0/3045462623 conn(0x7f2a7c0792d0 msgr2=0x7f2a7c100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.592+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 shutdown_connections 2024-04-26T17:50:01.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:01.592+0000 7f2a81893700 1 -- 172.21.15.92:0/3045462623 wait complete. 2024-04-26T17:50:02.173 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-26T17:50:02.173 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:50:02.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T17:50:02.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: Reconfiguring mon.b (monmap changed)... 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: Reconfiguring daemon mon.b on smithi156 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:01 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3045462623' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.199 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:50:02.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:50:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: Reconfiguring mon.b (monmap changed)... 2024-04-26T17:50:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: Reconfiguring daemon mon.b on smithi156 2024-04-26T17:50:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:01 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3045462623' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.263 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:50:02.263 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T17:50:02.292 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:50:02.292 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:50:02.358 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:50:02.358 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-04-26T17:50:02.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: Reconfiguring mon.b (monmap changed)... 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: Reconfiguring daemon mon.b on smithi156 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:02.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:01 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3045462623' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:02.390 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:50:02.390 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:50:02.457 INFO:tasks.cephadm:Adding mgr.x on smithi092 2024-04-26T17:50:02.458 INFO:tasks.cephadm:Adding mgr.y on smithi156 2024-04-26T17:50:02.458 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-04-26T17:50:02.458 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch apply mgr '3;smithi092=x;smithi156=y;smithi189=z' 2024-04-26T17:50:02.743 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: Reconfiguring mon.c (monmap changed)... 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:03.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:03 smithi189 ceph-mon[32756]: Reconfiguring daemon mon.c on smithi189 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: Reconfiguring mon.c (monmap changed)... 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:03 smithi156 ceph-mon[32679]: Reconfiguring daemon mon.c on smithi189 2024-04-26T17:50:03.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: Reconfiguring mon.c (monmap changed)... 2024-04-26T17:50:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-26T17:50:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-26T17:50:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:03 smithi092 ceph-mon[29156]: Reconfiguring daemon mon.c on smithi189 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 -- 172.21.15.189:0/330201953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 msgr2=0x7f5b28101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 --2- 172.21.15.189:0/330201953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28101670 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009910 tx=0x7f5b18009c20 comp rx=0 tx=0).stop 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 -- 172.21.15.189:0/330201953 shutdown_connections 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 --2- 172.21.15.189:0/330201953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28101670 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 -- 172.21.15.189:0/330201953 >> 172.21.15.189:0/330201953 conn(0x7f5b280fcb90 msgr2=0x7f5b280feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 -- 172.21.15.189:0/330201953 shutdown_connections 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 -- 172.21.15.189:0/330201953 wait complete. 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.196+0000 7f5b2e828700 1 Processor -- start 2024-04-26T17:50:04.196 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 -- start start 2024-04-26T17:50:04.198 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:04.198 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b281021e0 0x7f5b28102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:04.198 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b28102ba0 0x7f5b281a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28108ed0 con 0x7f5b28101250 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28108d50 con 0x7f5b28102ba0 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2e828700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28109050 con 0x7f5b281021e0 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.189:54722/0 (socket says 172.21.15.189:54722) 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 -- 172.21.15.189:0/477554125 learned_addr learned my addr 172.21.15.189:0/477554125 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b2cdc5700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b28102ba0 0x7f5b281a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b277fe700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b281021e0 0x7f5b28102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 -- 172.21.15.189:0/477554125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b281021e0 msgr2=0x7f5b28102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b281021e0 0x7f5b28102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 -- 172.21.15.189:0/477554125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b28102ba0 msgr2=0x7f5b281a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.197+0000 7f5b27fff700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b28102ba0 0x7f5b281a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b27fff700 1 -- 172.21.15.189:0/477554125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b281a2db0 con 0x7f5b28101250 2024-04-26T17:50:04.199 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b27fff700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b180059d0 tx=0x7f5b18005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18026070 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b1800b750 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b281a3040 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180038e0 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.198+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b281a35a0 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.199+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f5b18029070 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.199+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b28064a80 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.199+0000 7f5b257fa700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 0x7f5b1003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.199+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5b1804d4a0 con 0x7f5b28101250 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.199+0000 7f5b277fe700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 0x7f5b1003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:04.200 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.200+0000 7f5b277fe700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 0x7f5b1003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009ad0 tx=0x7f5b1c009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:04.204 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.205+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b18013070 con 0x7f5b28101250 2024-04-26T17:50:04.427 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.427+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi156=y;smithi189=z", "target": ["mon-mgr", ""]}) -- 0x7f5b28063860 con 0x7f5b10039ae0 2024-04-26T17:50:04.433 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.434+0000 7f5b257fa700 1 -- 172.21.15.189:0/477554125 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5b28063860 con 0x7f5b10039ae0 2024-04-26T17:50:04.433 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 msgr2=0x7f5b1003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 0x7f5b1003bfa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009ad0 tx=0x7f5b1c009210 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 msgr2=0x7f5b28103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5b180059d0 tx=0x7f5b18005020 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 shutdown_connections 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5b10039ae0 0x7f5b1003bfa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b28102ba0 0x7f5b281a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b28101250 0x7f5b28103b90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 --2- 172.21.15.189:0/477554125 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b281021e0 0x7f5b28102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 >> 172.21.15.189:0/477554125 conn(0x7f5b280fcb90 msgr2=0x7f5b280fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:04.436 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 shutdown_connections 2024-04-26T17:50:04.437 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:50:04.436+0000 7f5b2e828700 1 -- 172.21.15.189:0/477554125 wait complete. 2024-04-26T17:50:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:04 smithi189 ceph-mon[32756]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:04 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:04 smithi156 ceph-mon[32679]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:04 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:04 smithi092 ceph-mon[29156]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:04 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:05 smithi189 ceph-mon[32756]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi156=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:05.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:05 smithi189 ceph-mon[32756]: Saving service mgr spec with placement smithi092=x;smithi156=y;smithi189=z;count:3 2024-04-26T17:50:05.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:05 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:05 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:05 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:05.768 DEBUG:teuthology.orchestra.run.smithi156:mgr.y> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.y.service 2024-04-26T17:50:05.771 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mgr.z.service 2024-04-26T17:50:05.773 INFO:tasks.cephadm:Deploying OSDs... 2024-04-26T17:50:05.773 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:50:05.773 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:50:05.788 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:50:05.789 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-26 17:49:10.460012788 +0000 2024-04-26T17:50:05.843 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-26 17:44:35.956264379 +0000 2024-04-26T17:50:05.844 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-26 17:44:35.956264379 +0000 2024-04-26T17:50:05.844 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-26 17:44:35.956264379 +0000 2024-04-26T17:50:05.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:50:05.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:05 smithi092 ceph-mon[29156]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi156=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:05.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:05 smithi092 ceph-mon[29156]: Saving service mgr spec with placement smithi092=x;smithi156=y;smithi189=z;count:3 2024-04-26T17:50:05.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:05 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:05 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:05 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:05.906 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-26T17:50:05.906 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-26T17:50:05.906 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000214919 s, 2.4 MB/s 2024-04-26T17:50:05.907 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:50:05.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:05 smithi156 ceph-mon[32679]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi092=x;smithi156=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:05 smithi156 ceph-mon[32679]: Saving service mgr spec with placement smithi092=x;smithi156=y;smithi189=z;count:3 2024-04-26T17:50:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:05 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:05 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:05 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:05.963 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-26 17:49:10.495011778 +0000 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-26 17:44:36.294254346 +0000 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-26 17:44:36.294254346 +0000 2024-04-26T17:50:06.018 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-26 17:44:36.294254346 +0000 2024-04-26T17:50:06.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:50:06.079 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-26T17:50:06.079 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-26T17:50:06.079 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000194742 s, 2.6 MB/s 2024-04-26T17:50:06.081 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:50:06.136 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-26 17:49:10.526010883 +0000 2024-04-26T17:50:06.191 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-26 17:44:36.638244135 +0000 2024-04-26T17:50:06.192 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-26 17:44:36.638244135 +0000 2024-04-26T17:50:06.192 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-26 17:44:36.638244135 +0000 2024-04-26T17:50:06.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:50:06.253 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-26T17:50:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-26T17:50:06.254 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000229803 s, 2.2 MB/s 2024-04-26T17:50:06.255 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:50:06.310 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-26 17:49:10.558009960 +0000 2024-04-26T17:50:06.365 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-26 17:44:36.974234162 +0000 2024-04-26T17:50:06.366 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-26 17:44:36.974234162 +0000 2024-04-26T17:50:06.366 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-26 17:44:36.974234162 +0000 2024-04-26T17:50:06.366 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:50:06.427 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-26T17:50:06.427 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-26T17:50:06.427 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000233716 s, 2.2 MB/s 2024-04-26T17:50:06.428 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:50:06.484 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-04-26T17:50:06.484 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:50:06.503 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:50:06.503 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2024-04-26T17:50:06.560 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:50:06.560 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.560 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T17:50:06.560 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.561 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.561 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-26 17:49:50.862408573 +0000 2024-04-26T17:50:06.561 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-26 17:44:57.006462273 +0000 2024-04-26T17:50:06.561 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-26 17:44:57.006462273 +0000 2024-04-26T17:50:06.561 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-26 17:44:57.006462273 +0000 2024-04-26T17:50:06.561 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:50:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-26T17:50:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-26T17:50:06.627 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000109168 s, 4.7 MB/s 2024-04-26T17:50:06.628 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:06.685 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2024-04-26T17:50:06.742 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-26 17:49:50.862408573 +0000 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-26 17:44:57.347456647 +0000 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-26 17:44:57.347456647 +0000 2024-04-26T17:50:06.743 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-26 17:44:57.347456647 +0000 2024-04-26T17:50:06.743 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:50:06.806 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:06.806 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:06.806 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:06.807 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:06.807 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:06.807 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:06.807 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:06.807 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:06.809 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-26T17:50:06.809 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-26T17:50:06.809 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000100586 s, 5.1 MB/s 2024-04-26T17:50:06.810 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:50:06.869 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-26 17:49:50.863408557 +0000 2024-04-26T17:50:06.926 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-26 17:44:57.676451219 +0000 2024-04-26T17:50:06.927 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-26 17:44:57.676451219 +0000 2024-04-26T17:50:06.927 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-26 17:44:57.676451219 +0000 2024-04-26T17:50:06.927 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:50:06.990 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-26T17:50:06.991 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-26T17:50:06.991 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00012821 s, 4.0 MB/s 2024-04-26T17:50:06.992 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:50:06.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:06.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:07.049 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-04-26 17:49:50.863408557 +0000 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-04-26 17:44:58.006445775 +0000 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-04-26 17:44:58.006445775 +0000 2024-04-26T17:50:07.105 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-04-26 17:44:58.006445775 +0000 2024-04-26T17:50:07.106 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:50:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-04-26T17:50:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-04-26T17:50:07.169 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000112471 s, 4.6 MB/s 2024-04-26T17:50:07.170 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:50:07.226 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-04-26T17:50:07.226 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:50:07.245 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:50:07.245 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-04-26T17:50:07.302 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:50:07.302 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:07.302 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T17:50:07.302 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:07.303 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:07.303 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-26 17:49:41.635818536 +0000 2024-04-26T17:50:07.303 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-26 17:44:57.815986879 +0000 2024-04-26T17:50:07.303 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-26 17:44:57.815986879 +0000 2024-04-26T17:50:07.303 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-26 17:44:57.815986879 +0000 2024-04-26T17:50:07.303 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:50:07.441 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-26T17:50:07.441 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-26T17:50:07.441 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000272308 s, 1.9 MB/s 2024-04-26T17:50:07.443 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:50:07.458 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-26 17:50:07.395316296 +0000 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-26 17:44:58.157980079 +0000 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-26 17:44:58.157980079 +0000 2024-04-26T17:50:07.514 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-26 17:44:58.157980079 +0000 2024-04-26T17:50:07.515 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:50:07.612 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-26T17:50:07.613 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-26T17:50:07.613 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000189891 s, 2.7 MB/s 2024-04-26T17:50:07.614 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:50:07.629 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:07.686 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-26 17:50:07.569312903 +0000 2024-04-26T17:50:07.687 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-26 17:44:58.490973457 +0000 2024-04-26T17:50:07.687 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-26 17:44:58.490973457 +0000 2024-04-26T17:50:07.687 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-26 17:44:58.490973457 +0000 2024-04-26T17:50:07.687 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:50:07.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:07 smithi189 ceph-mon[32756]: Deploying daemon mgr.z on smithi189 2024-04-26T17:50:07.747 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:07 smithi189 systemd[1]: Starting Ceph mgr.z for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:50:07.750 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-26T17:50:07.750 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-26T17:50:07.750 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000185177 s, 2.8 MB/s 2024-04-26T17:50:07.751 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:50:07.807 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-04-26T17:50:07.861 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:50:07.861 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-04-26 17:50:07.570312884 +0000 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-04-26 17:44:58.847966360 +0000 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-04-26 17:44:58.847966360 +0000 2024-04-26T17:50:07.862 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-04-26 17:44:58.847966360 +0000 2024-04-26T17:50:07.862 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:50:07.924 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-04-26T17:50:07.924 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-04-26T17:50:07.924 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000200146 s, 2.6 MB/s 2024-04-26T17:50:07.926 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:50:07.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:07 smithi156 ceph-mon[32679]: Deploying daemon mgr.z on smithi189 2024-04-26T17:50:07.982 INFO:tasks.cephadm:Deploying osd.0 on smithi092 with /dev/vg_nvme/lv_4... 2024-04-26T17:50:07.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T17:50:07.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:07 smithi092 ceph-mon[29156]: Deploying daemon mgr.z on smithi189 2024-04-26T17:50:08.087 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:07 smithi189 podman[34518]: 2024-04-26 17:50:07.844175116 +0000 UTC m=+0.109252415 container create 14e252f49d4bdbe8fb775e2a4214a176d6564a75c76abdb90050e12bda0e1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T17:50:08.087 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:07 smithi189 podman[34518]: 2024-04-26 17:50:07.754166004 +0000 UTC m=+0.019243322 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:50:08.087 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 podman[34518]: 2024-04-26 17:50:08.088323139 +0000 UTC m=+0.353400439 container init 14e252f49d4bdbe8fb775e2a4214a176d6564a75c76abdb90050e12bda0e1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5) 2024-04-26T17:50:08.227 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:50:08.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 podman[34518]: 2024-04-26 17:50:08.091078928 +0000 UTC m=+0.356156234 container start 14e252f49d4bdbe8fb775e2a4214a176d6564a75c76abdb90050e12bda0e1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-04-26T17:50:08.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mgr[34627]: -- 172.21.15.189:0/3538294860 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e10eb85a0 con 0x561e10e8d000 2024-04-26T17:50:08.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 bash[34518]: 14e252f49d4bdbe8fb775e2a4214a176d6564a75c76abdb90050e12bda0e1aaa 2024-04-26T17:50:08.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 systemd[1]: Started Ceph mgr.z for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:50:08.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:08.240+0000 7f9e1b87f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:08.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:08.833 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:08.833 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.833 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:08.428+0000 7f9e1b87f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:08.529+0000 7f9e1b87f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:08.838+0000 7f9e1b87f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:08.839 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:08.839 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-26T17:50:08.839 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:08.839 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:09.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:08 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:08.924+0000 7f9e1b87f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:50:09.616 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:09 smithi092 ceph-mon[29156]: Deploying daemon mgr.y on smithi156 2024-04-26T17:50:09.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:09 smithi156 ceph-mon[32679]: Deploying daemon mgr.y on smithi156 2024-04-26T17:50:09.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:09 smithi189 ceph-mon[32756]: Deploying daemon mgr.y on smithi156 2024-04-26T17:50:10.140 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T17:50:10.141 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T17:50:10.141 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-04-26T17:50:10.141 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-04-26T17:50:10.141 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011396 s, 920 MB/s 2024-04-26T17:50:10.141 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-04-26T17:50:10.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 systemd[1]: Starting Ceph mgr.y for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:50:10.517 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:10.172+0000 7f9e1b87f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:50:10.517 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:10.344+0000 7f9e1b87f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:50:10.517 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:10.517+0000 7f9e1b87f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:50:10.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:10 smithi092 ceph-mon[29156]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:10.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-04-26T17:50:10.774 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:10 smithi156 ceph-mon[32679]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:10.774 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 podman[34056]: 2024-04-26 17:50:10.392036208 +0000 UTC m=+0.018246436 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:50:10.775 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 podman[34056]: 2024-04-26 17:50:10.506608314 +0000 UTC m=+0.132818529 container create a4261903a8043af4d6cd066e0a715fb2c34aa1b830b115942dbdc778d5775a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T17:50:10.775 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 podman[34056]: 2024-04-26 17:50:10.709147625 +0000 UTC m=+0.335357840 container init a4261903a8043af4d6cd066e0a715fb2c34aa1b830b115942dbdc778d5775a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T17:50:10.775 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 podman[34056]: 2024-04-26 17:50:10.711703751 +0000 UTC m=+0.337913967 container start a4261903a8043af4d6cd066e0a715fb2c34aa1b830b115942dbdc778d5775a12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T17:50:10.775 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 ceph-mgr[34075]: -- 172.21.15.156:0/1712975566 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2a83e25a0 con 0x55c2a83b7000 2024-04-26T17:50:10.775 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 bash[34056]: a4261903a8043af4d6cd066e0a715fb2c34aa1b830b115942dbdc778d5775a12 2024-04-26T17:50:10.802 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-mon[32756]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:11.016 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:50:11.049 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 systemd[1]: Started Ceph mgr.y for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:50:11.049 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:10 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:10.865+0000 7f3eb0db4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:50:11.049 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:11.050+0000 7f3eb0db4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:50:11.102 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:10.803+0000 7f9e1b87f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:50:11.102 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:10 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:10.894+0000 7f9e1b87f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:50:11.102 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:11.102+0000 7f9e1b87f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:50:11.386 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:11.302+0000 7f9e1b87f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:50:11.432 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:11.157+0000 7f3eb0db4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:50:11.830 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:11.479+0000 7f3eb0db4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:50:11.830 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:11.578+0000 7f3eb0db4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:50:12.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:12.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:11 smithi092 ceph-mon[29156]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:12.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:11.942+0000 7f9e1b87f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:50:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:11 smithi189 ceph-mon[32756]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:11 smithi156 ceph-mon[32679]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 -- 172.21.15.92:0/3618157825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4103f30 msgr2=0x7f97b410a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 --2- 172.21.15.92:0/3618157825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4103f30 0x7f97b410a7e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97a40099c0 tx=0x7f97a4009cd0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 -- 172.21.15.92:0/3618157825 shutdown_connections 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 --2- 172.21.15.92:0/3618157825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4103f30 0x7f97b410a7e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 --2- 172.21.15.92:0/3618157825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4102390 0x7f97b41027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 --2- 172.21.15.92:0/3618157825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 0x7f97b41039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 -- 172.21.15.92:0/3618157825 >> 172.21.15.92:0/3618157825 conn(0x7f97b40fd950 msgr2=0x7f97b40ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 -- 172.21.15.92:0/3618157825 shutdown_connections 2024-04-26T17:50:12.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 -- 172.21.15.92:0/3618157825 wait complete. 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.610+0000 7f97bc252700 1 Processor -- start 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 -- start start 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 0x7f97b4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4103f30 0x7f97b419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97b410de30 con 0x7f97b4102390 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f97b410dcb0 con 0x7f97b4103590 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97bc252700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97b410dfb0 con 0x7f97b4103f30 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55614/0 (socket says 172.21.15.92:55614) 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 -- 172.21.15.92:0/1669723974 learned_addr learned my addr 172.21.15.92:0/1669723974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b97ed700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 0x7f97b4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97ba7ef700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4103f30 0x7f97b419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:12.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 -- 172.21.15.92:0/1669723974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4103f30 msgr2=0x7f97b419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4103f30 0x7f97b419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 -- 172.21.15.92:0/1669723974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 msgr2=0x7f97b4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 0x7f97b4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 -- 172.21.15.92:0/1669723974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b406bb70 con 0x7f97b4102390 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.611+0000 7f97b9fee700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009f20 tx=0x7f97ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.612+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac003a00 con 0x7f97b4102390 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.612+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b406be60 con 0x7f97b4102390 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.612+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97ac00ce70 con 0x7f97b4102390 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.612+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac004710 con 0x7f97b4102390 2024-04-26T17:50:12.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.612+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b406c3a0 con 0x7f97b4102390 2024-04-26T17:50:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.613+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 46614+0+0 (secure 0 0 0) 0x7f97ac012050 con 0x7f97b4102390 2024-04-26T17:50:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.613+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b406a110 con 0x7f97b4102390 2024-04-26T17:50:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.613+0000 7f97b2ffd700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 0x7f979c03bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:12.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.613+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f97ac04c6e0 con 0x7f97b4102390 2024-04-26T17:50:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.613+0000 7f97b97ed700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 0x7f979c03bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:12.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.614+0000 7f97b97ed700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 0x7f979c03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005950 tx=0x7f97a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:12.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.618+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f97ac010040 con 0x7f97b4102390 2024-04-26T17:50:12.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:12 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:12.383+0000 7f9e1b87f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:50:12.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:12 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:12.480+0000 7f9e1b87f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:50:12.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:12.849+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f97b406c670 con 0x7f979c039890 2024-04-26T17:50:13.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:12 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:12.682+0000 7f9e1b87f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:50:13.159 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:12 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:12.822+0000 7f3eb0db4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:50:13.159 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:12 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:12.989+0000 7f3eb0db4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:50:13.159 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:13.160+0000 7f3eb0db4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: Reconfiguring daemon mgr.x on smithi092 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: Reconfiguring daemon mgr.x on smithi092 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.202+0000 7f9e1b87f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.296+0000 7f9e1b87f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: Reconfiguring mgr.x (unknown last config time)... 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: Reconfiguring daemon mgr.x on smithi092 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:13.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:13.739 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:13.445+0000 7f3eb0db4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:50:13.739 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:13.536+0000 7f3eb0db4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:50:13.739 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:13.740+0000 7f3eb0db4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:50:13.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.543+0000 7f9e1b87f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:50:13.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.677+0000 7f9e1b87f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:50:13.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.772+0000 7f9e1b87f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:50:14.182 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:13.930+0000 7f3eb0db4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:50:14.193 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:13.887+0000 7f9e1b87f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:50:14.193 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:14.194+0000 7f9e1b87f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.682 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:14.533+0000 7f3eb0db4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:15.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:14 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:14.802+0000 7f9e1b87f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:50:15.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:50:15.018+0000 7f9e1b87f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:50:15.244 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:14.950+0000 7f3eb0db4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:50:15.244 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:15.045+0000 7f3eb0db4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:50:15.244 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:15.244+0000 7f3eb0db4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:50:15.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:15.300+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 14) ==== 92602+0+0 (secure 0 0 0) 0x7f97ac01c360 con 0x7f97b4102390 2024-04-26T17:50:15.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:15 smithi092 ceph-mon[29156]: Standby manager daemon z started 2024-04-26T17:50:15.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:15 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:50:15.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:15 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:15.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:15 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:50:15.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:15 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-mon[32756]: Standby manager daemon z started 2024-04-26T17:50:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:50:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:50:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:15 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-mon[32679]: Standby manager daemon z started 2024-04-26T17:50:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:50:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:50:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/3005771534' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:16.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:15.769+0000 7f3eb0db4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:50:16.099 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:15 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:15.859+0000 7f3eb0db4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-mon[32679]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-mon[32679]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:16.100+0000 7f3eb0db4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:16.232+0000 7f3eb0db4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:50:16.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:16.326+0000 7f3eb0db4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:50:16.632 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:16 smithi092 ceph-mon[29156]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T17:50:16.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:50:16.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:16 smithi092 ceph-mon[29156]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:16.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:16 smithi189 ceph-mon[32756]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-26T17:50:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:50:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:16 smithi189 ceph-mon[32756]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:16.742 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:16.440+0000 7f3eb0db4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:50:16.742 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:16.742+0000 7f3eb0db4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:50:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:17 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]: dispatch 2024-04-26T17:50:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:17 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]': finished 2024-04-26T17:50:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:17 smithi189 ceph-mon[32756]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T17:50:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:17 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3303257762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]: dispatch 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]': finished 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-mon[32679]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3303257762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:17.336+0000 7f3eb0db4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:50:17.683 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:50:17 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:50:17.547+0000 7f3eb0db4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:50:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:17 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]: dispatch 2024-04-26T17:50:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:17 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/974577472' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55536846-f612-4ca4-a1b7-c189c46c0248"}]': finished 2024-04-26T17:50:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:17 smithi092 ceph-mon[29156]: osdmap e5: 1 total, 0 up, 1 in 2024-04-26T17:50:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:17 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3303257762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:18.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:18.313+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f97ac01b300 con 0x7f97b4102390 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: Standby manager daemon y started 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:50:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:18 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: Standby manager daemon y started 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:50:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:18 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: Standby manager daemon y started 2024-04-26T17:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:18 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/414106668' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:50:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:19 smithi189 ceph-mon[32756]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-26T17:50:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:50:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:19 smithi156 ceph-mon[32679]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-26T17:50:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:50:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:19 smithi092 ceph-mon[29156]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-04-26T17:50:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:50:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:20 smithi156 ceph-mon[32679]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:20 smithi092 ceph-mon[29156]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:20.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:20 smithi189 ceph-mon[32756]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:22 smithi092 ceph-mon[29156]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:22 smithi189 ceph-mon[32756]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:22 smithi156 ceph-mon[32679]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T17:50:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T17:50:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-26T17:50:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:24 smithi189 ceph-mon[32756]: Deploying daemon osd.0 on smithi092 2024-04-26T17:50:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:24 smithi189 ceph-mon[32756]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:24.923 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:24 smithi092 ceph-mon[29156]: Deploying daemon osd.0 on smithi092 2024-04-26T17:50:24.923 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:24 smithi092 ceph-mon[29156]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:24.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:24 smithi156 ceph-mon[32679]: Deploying daemon osd.0 on smithi092 2024-04-26T17:50:24.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:24 smithi156 ceph-mon[32679]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:26 smithi092 ceph-mon[29156]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:26 smithi189 ceph-mon[32756]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:26 smithi156 ceph-mon[32679]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:28.685 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:28 smithi092 ceph-mon[29156]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:28 smithi189 ceph-mon[32756]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:28.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:28 smithi156 ceph-mon[32679]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:30.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:30 smithi092 ceph-mon[29156]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:30 smithi189 ceph-mon[32756]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:31.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:30 smithi156 ceph-mon[32679]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:32.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.354+0000 7f97b2ffd700 1 -- 172.21.15.92:0/1669723974 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97b406c670 con 0x7f979c039890 2024-04-26T17:50:32.355 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 0 on host 'smithi092' 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 msgr2=0x7f979c03bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 0x7f979c03bd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f97a8005950 tx=0x7f97a800b410 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 msgr2=0x7f97b41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009f20 tx=0x7f97ac00c3a0 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 shutdown_connections 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f979c039890 0x7f979c03bd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97b4103f30 0x7f97b419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b4102390 0x7f97b41984c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 --2- 172.21.15.92:0/1669723974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97b4103590 0x7f97b4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 >> 172.21.15.92:0/1669723974 conn(0x7f97b40fd950 msgr2=0x7f97b4106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:32.357 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 shutdown_connections 2024-04-26T17:50:32.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:50:32.357+0000 7f97bc252700 1 -- 172.21.15.92:0/1669723974 wait complete. 2024-04-26T17:50:32.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:32.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:32.686 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:32.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:32.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:33.033 DEBUG:teuthology.orchestra.run.smithi092:osd.0> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.0.service 2024-04-26T17:50:33.035 INFO:tasks.cephadm:Deploying osd.1 on smithi156 with /dev/vg_nvme/lv_4... 2024-04-26T17:50:33.035 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T17:50:33.278 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:50:33.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:33 smithi156 ceph-mon[32679]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T17:50:33.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:33 smithi092 ceph-mon[29156]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T17:50:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:33 smithi189 ceph-mon[32756]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-26T17:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-mon[29156]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T17:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-mon[29156]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T17:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-mon[29156]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-mon[29156]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:34.743 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-0[43875]: 2024-04-26T17:50:34.475+0000 7fd49c1ca700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T17:50:34.743 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:50:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-0[43875]: 2024-04-26T17:50:34.480+0000 7fd497fbd700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:50:34.781 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:34 smithi156 ceph-mon[32679]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T17:50:34.781 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:34 smithi156 ceph-mon[32679]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T17:50:34.782 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:34 smithi156 ceph-mon[32679]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:50:34.782 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:34.782 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:34 smithi156 ceph-mon[32679]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:34 smithi189 ceph-mon[32756]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-26T17:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:34 smithi189 ceph-mon[32756]: osdmap e6: 1 total, 0 up, 1 in 2024-04-26T17:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:34 smithi189 ceph-mon[32756]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:34 smithi189 ceph-mon[32756]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00842973 s, 1.2 GB/s 2024-04-26T17:50:35.103 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-26T17:50:35.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:35 smithi156 ceph-mon[32679]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:50:35.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:35 smithi156 ceph-mon[32679]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T17:50:35.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.688 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2024-04-26T17:50:35.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:35 smithi092 ceph-mon[29156]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:50:35.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:35 smithi092 ceph-mon[29156]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T17:50:35.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:35 smithi189 ceph-mon[32756]: from='osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:50:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:35 smithi189 ceph-mon[32756]: osdmap e7: 1 total, 0 up, 1 in 2024-04-26T17:50:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:35.927 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] boot 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:50:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] boot 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: osd.0 [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] boot 2024-04-26T17:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: osdmap e8: 1 total, 1 up, 1 in 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 -- 172.21.15.156:0/3863263903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54103580 msgr2=0x7ffb541039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 --2- 172.21.15.156:0/3863263903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54103580 0x7ffb541039e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb480099c0 tx=0x7ffb48009cd0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 -- 172.21.15.156:0/3863263903 shutdown_connections 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 --2- 172.21.15.156:0/3863263903 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103f20 0x7ffb5410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 --2- 172.21.15.156:0/3863263903 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54102380 0x7ffb541027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 --2- 172.21.15.156:0/3863263903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54103580 0x7ffb541039e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.479 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 -- 172.21.15.156:0/3863263903 >> 172.21.15.156:0/3863263903 conn(0x7ffb540fd920 msgr2=0x7ffb540ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 -- 172.21.15.156:0/3863263903 shutdown_connections 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.476+0000 7ffb5a863700 1 -- 172.21.15.156:0/3863263903 wait complete. 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 Processor -- start 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 -- start start 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 0x7ffb541a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54103f20 0x7ffb541a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5410de90 con 0x7ffb54103580 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5410dd10 con 0x7ffb54102380 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb5a863700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5410e010 con 0x7ffb54103f20 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb53fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:34384/0 (socket says 172.21.15.156:34384) 2024-04-26T17:50:37.480 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb53fff700 1 -- 172.21.15.156:0/1574806853 learned_addr learned my addr 172.21.15.156:0/1574806853 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb537fe700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 0x7ffb541a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.477+0000 7ffb58e00700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54103f20 0x7ffb541a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 -- 172.21.15.156:0/1574806853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54103f20 msgr2=0x7ffb541a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54103f20 0x7ffb541a2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 -- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 msgr2=0x7ffb541a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 0x7ffb541a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 -- 172.21.15.156:0/1574806853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb541a34f0 con 0x7ffb54102380 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb537fe700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 0x7ffb541a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb53fff700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400d980 tx=0x7ffb4400dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44017070 con 0x7ffb54102380 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb541a37e0 con 0x7ffb54102380 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb44010460 con 0x7ffb54102380 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400de60 con 0x7ffb54102380 2024-04-26T17:50:37.481 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.478+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb541a3cf0 con 0x7ffb54102380 2024-04-26T17:50:37.482 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.479+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5406a110 con 0x7ffb54102380 2024-04-26T17:50:37.482 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.480+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7ffb44009b40 con 0x7ffb54102380 2024-04-26T17:50:37.483 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.481+0000 7ffb517fa700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 0x7ffb3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:50:37.483 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.481+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7ffb440ce500 con 0x7ffb54102380 2024-04-26T17:50:37.483 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.481+0000 7ffb537fe700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 0x7ffb3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:50:37.483 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.482+0000 7ffb537fe700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 0x7ffb3c0a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb48000c00 tx=0x7ffb48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:50:37.486 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.486+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ffb4409c950 con 0x7ffb54102380 2024-04-26T17:50:37.689 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:37.689+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffb54063860 con 0x7ffb3c0a3bb0 2024-04-26T17:50:37.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:37 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi092 2024-04-26T17:50:37.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 17088M 2024-04-26T17:50:37.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:37 smithi156 ceph-mon[32679]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T17:50:37.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:37 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi092 2024-04-26T17:50:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 17088M 2024-04-26T17:50:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:37 smithi092 ceph-mon[29156]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T17:50:37.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:37 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi092 2024-04-26T17:50:37.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 17088M 2024-04-26T17:50:37.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:37 smithi189 ceph-mon[32756]: osdmap e9: 1 total, 1 up, 1 in 2024-04-26T17:50:38.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:38 smithi156 ceph-mon[32679]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:38.614 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:38 smithi156 ceph-mon[32679]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:38.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:38.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:38.615 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:38 smithi092 ceph-mon[29156]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:38 smithi092 ceph-mon[29156]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:38 smithi189 ceph-mon[32756]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:38.952 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:38 smithi189 ceph-mon[32756]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:50:38.953 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:50:38.953 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:50:38.953 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/3905591953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]': finished 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T17:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/3905591953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]': finished 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T17:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/3905591953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]: dispatch 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f315aace-94f0-4e29-bd41-38288afb5d92"}]': finished 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: osdmap e10: 2 total, 1 up, 2 in 2024-04-26T17:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:41 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/3884265354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:41 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/3884265354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:41.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:41 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/3884265354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:50:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:42 smithi189 ceph-mon[32756]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:42.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:42 smithi156 ceph-mon[32679]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:42.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:42 smithi092 ceph-mon[29156]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:44.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:44 smithi156 ceph-mon[32679]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:44 smithi189 ceph-mon[32756]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:44 smithi092 ceph-mon[29156]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:46 smithi189 ceph-mon[32756]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:46 smithi156 ceph-mon[32679]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:46.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:46 smithi092 ceph-mon[29156]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T17:50:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:47.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:47 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T17:50:47.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:47 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:47.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-26T17:50:47.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:48 smithi189 ceph-mon[32756]: Deploying daemon osd.1 on smithi156 2024-04-26T17:50:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:48 smithi189 ceph-mon[32756]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:48.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:48 smithi156 ceph-mon[32679]: Deploying daemon osd.1 on smithi156 2024-04-26T17:50:48.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:48 smithi156 ceph-mon[32679]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:48 smithi092 ceph-mon[29156]: Deploying daemon osd.1 on smithi156 2024-04-26T17:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:48 smithi092 ceph-mon[29156]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:50.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:50 smithi156 ceph-mon[32679]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:50 smithi189 ceph-mon[32756]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:50 smithi092 ceph-mon[29156]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:52 smithi189 ceph-mon[32756]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:52.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:52 smithi156 ceph-mon[32679]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:52.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:52 smithi092 ceph-mon[29156]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:54 smithi189 ceph-mon[32756]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:54 smithi156 ceph-mon[32679]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:54 smithi092 ceph-mon[29156]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:56.054 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 1 on host 'smithi156' 2024-04-26T17:50:56.054 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.054+0000 7ffb517fa700 1 -- 172.21.15.156:0/1574806853 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb54063860 con 0x7ffb3c0a3bb0 2024-04-26T17:50:56.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 msgr2=0x7ffb3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:56.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 0x7ffb3c0a6070 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffb48000c00 tx=0x7ffb48005fb0 comp rx=0 tx=0).stop 2024-04-26T17:50:56.056 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 msgr2=0x7ffb5406c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400d980 tx=0x7ffb4400dd40 comp rx=0 tx=0).stop 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 shutdown_connections 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ffb3c0a3bb0 0x7ffb3c0a6070 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb54102380 0x7ffb5406c6b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb54103f20 0x7ffb541a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 --2- 172.21.15.156:0/1574806853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb54103580 0x7ffb541a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 >> 172.21.15.156:0/1574806853 conn(0x7ffb540fd920 msgr2=0x7ffb541068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 shutdown_connections 2024-04-26T17:50:56.057 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:50:56.057+0000 7ffb5a863700 1 -- 172.21.15.156:0/1574806853 wait complete. 2024-04-26T17:50:56.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:56.626 DEBUG:teuthology.orchestra.run.smithi156:osd.1> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.1.service 2024-04-26T17:50:56.629 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-04-26T17:50:56.629 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-26T17:50:56.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:50:56.878 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:50:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:57 smithi189 ceph-mon[32756]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:57 smithi189 ceph-mon[32756]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:57 smithi156 ceph-mon[32679]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:57 smithi156 ceph-mon[32679]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:57 smithi092 ceph-mon[29156]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:57 smithi092 ceph-mon[29156]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:58 smithi189 ceph-mon[32756]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-mon[32679]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:58.638 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-26T17:50:58.638 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-26T17:50:58.639 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-04-26T17:50:58.639 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-04-26T17:50:58.639 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114756 s, 914 MB/s 2024-04-26T17:50:58.639 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-04-26T17:50:58.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-26T17:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: from='osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: osdmap e11: 2 total, 1 up, 2 in 2024-04-26T17:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:58 smithi092 ceph-mon[29156]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:50:59.183 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-1[37269]: 2024-04-26T17:50:58.829+0000 7fe7dd03e700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T17:50:59.183 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:50:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-1[37269]: 2024-04-26T17:50:58.832+0000 7fe7d4628700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:50:59.267 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-04-26T17:50:59.548 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:50:59.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:50:59.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:50:59.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T17:50:59.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:59.549 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:50:59 smithi189 ceph-mon[32756]: from='osd.1 ' entity='osd.1' 2024-04-26T17:50:59.549 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:59.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:50:59 smithi156 ceph-mon[32679]: from='osd.1 ' entity='osd.1' 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: osdmap e12: 2 total, 1 up, 2 in 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:50:59 smithi092 ceph-mon[29156]: from='osd.1 ' entity='osd.1' 2024-04-26T17:51:00.520 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:00.520 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi156 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 17088M 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] boot 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T17:51:00.521 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi156 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 17088M 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] boot 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T17:51:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi156 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 17088M 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: osd.1 [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] boot 2024-04-26T17:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: osdmap e13: 2 total, 2 up, 2 in 2024-04-26T17:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:51:01.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 -- 172.21.15.189:0/3008925715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040105020 msgr2=0x7f804010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:01.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 --2- 172.21.15.189:0/3008925715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040105020 0x7f804010b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f803800b0a0 tx=0x7f803800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 -- 172.21.15.189:0/3008925715 shutdown_connections 2024-04-26T17:51:01.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 --2- 172.21.15.189:0/3008925715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f80401038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 --2- 172.21.15.189:0/3008925715 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040105020 0x7f804010b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 --2- 172.21.15.189:0/3008925715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040104680 0x7f8040104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 -- 172.21.15.189:0/3008925715 >> 172.21.15.189:0/3008925715 conn(0x7f80400fea20 msgr2=0x7f8040100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 -- 172.21.15.189:0/3008925715 shutdown_connections 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.046+0000 7f80474c7700 1 -- 172.21.15.189:0/3008925715 wait complete. 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 Processor -- start 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 -- start start 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f8040199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040105020 0x7f80401a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f804010efa0 con 0x7f8040105020 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f804010ee20 con 0x7f8040103480 2024-04-26T17:51:01.049 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f80474c7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f804010f120 con 0x7f8040104680 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f8044a62700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f8044a62700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:36630/0 (socket says 172.21.15.189:36630) 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f8044a62700 1 -- 172.21.15.189:0/1787318597 learned_addr learned my addr 172.21.15.189:0/1787318597 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.047+0000 7f8045263700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f8040199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8045a64700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040105020 0x7f80401a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 -- 172.21.15.189:0/1787318597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 msgr2=0x7f8040199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f8040199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 -- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040105020 msgr2=0x7f80401a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040105020 0x7f80401a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 -- 172.21.15.189:0/1787318597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80401a1270 con 0x7f8040104680 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8045263700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f8040199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f8044a62700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c950 tx=0x7f803c00cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:01.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c007ac0 con 0x7f8040104680 2024-04-26T17:51:01.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80401a1560 con 0x7f8040104680 2024-04-26T17:51:01.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f803c004ce0 con 0x7f8040104680 2024-04-26T17:51:01.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803c005550 con 0x7f8040104680 2024-04-26T17:51:01.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.048+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80401a1b70 con 0x7f8040104680 2024-04-26T17:51:01.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.049+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f804006a110 con 0x7f8040104680 2024-04-26T17:51:01.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.051+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f803c007c60 con 0x7f8040104680 2024-04-26T17:51:01.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.051+0000 7f80367fc700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 0x7f802c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:01.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.051+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f803c0ceaf0 con 0x7f8040104680 2024-04-26T17:51:01.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.051+0000 7f8045263700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 0x7f802c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:01.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.052+0000 7f8045263700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 0x7f802c0a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80401044e0 tx=0x7f8030008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:01.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.055+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f803c014030 con 0x7f8040104680 2024-04-26T17:51:01.261 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:01.262+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8040063860 con 0x7f802c0a3c30 2024-04-26T17:51:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T17:51:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:01 smithi189 ceph-mon[32756]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:01 smithi156 ceph-mon[32679]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: osdmap e14: 2 total, 2 up, 2 in 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:01 smithi092 ceph-mon[29156]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/1797875792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]': finished 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T17:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:04 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/780884896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/1797875792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]': finished 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:04 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/780884896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/1797875792' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]: dispatch 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b044658-ea68-41e1-87e3-dc22b4f2684a"}]': finished 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: osdmap e15: 3 total, 2 up, 3 in 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:04 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/780884896' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:06 smithi189 ceph-mon[32756]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:06 smithi156 ceph-mon[32679]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:06 smithi092 ceph-mon[29156]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:08 smithi189 ceph-mon[32756]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:08 smithi156 ceph-mon[32679]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:08.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:08 smithi092 ceph-mon[29156]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:10 smithi189 ceph-mon[32756]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:10 smithi156 ceph-mon[32679]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:10.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:10 smithi092 ceph-mon[29156]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:11.702 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T17:51:11.702 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:11 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T17:51:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:11 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:11.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-26T17:51:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:11 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:12 smithi189 ceph-mon[32756]: Deploying daemon osd.2 on smithi189 2024-04-26T17:51:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:12 smithi189 ceph-mon[32756]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:12.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:12 smithi156 ceph-mon[32679]: Deploying daemon osd.2 on smithi189 2024-04-26T17:51:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:12 smithi156 ceph-mon[32679]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:12.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:12 smithi092 ceph-mon[29156]: Deploying daemon osd.2 on smithi189 2024-04-26T17:51:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:12 smithi092 ceph-mon[29156]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:14 smithi189 ceph-mon[32756]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:14.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:14 smithi156 ceph-mon[32679]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:14 smithi092 ceph-mon[29156]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:16.840 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:16 smithi189 ceph-mon[32756]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:16.840 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.840 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.840 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:16 smithi156 ceph-mon[32679]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:16 smithi092 ceph-mon[29156]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:18 smithi189 ceph-mon[32756]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:18.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:18 smithi156 ceph-mon[32679]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:18 smithi092 ceph-mon[29156]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:19.577 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.576+0000 7f80367fc700 1 -- 172.21.15.189:0/1787318597 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8040063860 con 0x7f802c0a3c30 2024-04-26T17:51:19.577 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-04-26T17:51:19.579 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 msgr2=0x7f802c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:19.579 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 0x7f802c0a60f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80401044e0 tx=0x7f8030008040 comp rx=0 tx=0).stop 2024-04-26T17:51:19.579 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 msgr2=0x7f8040199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:19.579 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f803c00c950 tx=0x7f803c00cd10 comp rx=0 tx=0).stop 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 shutdown_connections 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f802c0a3c30 0x7f802c0a60f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8040103480 0x7f8040199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8040105020 0x7f80401a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 --2- 172.21.15.189:0/1787318597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8040104680 0x7f8040199b50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 >> 172.21.15.189:0/1787318597 conn(0x7f80400fea20 msgr2=0x7f8040107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 shutdown_connections 2024-04-26T17:51:19.580 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:51:19.579+0000 7f80474c7700 1 -- 172.21.15.189:0/1787318597 wait complete. 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:20.032 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:19 smithi189 ceph-mon[32756]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:20.156 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.2.service 2024-04-26T17:51:20.158 INFO:tasks.cephadm:Deploying osd.3 on smithi092 with /dev/vg_nvme/lv_3... 2024-04-26T17:51:20.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:19 smithi156 ceph-mon[32679]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:20.184 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:19 smithi092 ceph-mon[29156]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:20.400 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:51:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:20 smithi189 ceph-mon[32756]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:20 smithi189 ceph-mon[32756]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:20 smithi156 ceph-mon[32679]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:20 smithi156 ceph-mon[32679]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:20 smithi092 ceph-mon[29156]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:20 smithi092 ceph-mon[29156]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.077 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:21 smithi092 ceph-mon[29156]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:21 smithi189 ceph-mon[32756]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:22.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-26T17:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: osdmap e16: 3 total, 2 up, 3 in 2024-04-26T17:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: from='osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:21 smithi156 ceph-mon[32679]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T17:51:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T17:51:22.454 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-04-26T17:51:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-04-26T17:51:22.454 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0122336 s, 857 MB/s 2024-04-26T17:51:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-04-26T17:51:22.637 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-2[37916]: 2024-04-26T17:51:22.273+0000 7f26adb1f700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T17:51:22.637 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-2[37916]: 2024-04-26T17:51:22.277+0000 7f26a5109700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:51:23.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:22 smithi092 ceph-mon[29156]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:51:23.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:22 smithi092 ceph-mon[29156]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T17:51:23.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:22 smithi092 ceph-mon[29156]: from='osd.2 ' entity='osd.2' 2024-04-26T17:51:23.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-04-26T17:51:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-mon[32756]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:51:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-mon[32756]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T17:51:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:22 smithi189 ceph-mon[32756]: from='osd.2 ' entity='osd.2' 2024-04-26T17:51:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:22 smithi156 ceph-mon[32679]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:51:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:22 smithi156 ceph-mon[32679]: osdmap e17: 3 total, 2 up, 3 in 2024-04-26T17:51:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:22 smithi156 ceph-mon[32679]: from='osd.2 ' entity='osd.2' 2024-04-26T17:51:23.410 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi189 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 17088M 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] boot 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi189 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 17088M 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] boot 2024-04-26T17:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T17:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi189 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 17088M 2024-04-26T17:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: osd.2 [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] boot 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: osdmap e18: 3 total, 3 up, 3 in 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-04-26T17:51:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 -- 172.21.15.92:0/1388562202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670103480 msgr2=0x7f26701038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 --2- 172.21.15.92:0/1388562202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670103480 0x7f26701038a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f266c0099c0 tx=0x7f266c009cd0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 -- 172.21.15.92:0/1388562202 shutdown_connections 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 --2- 172.21.15.92:0/1388562202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670105020 0x7f267010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 --2- 172.21.15.92:0/1388562202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670103480 0x7f26701038a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 --2- 172.21.15.92:0/1388562202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 -- 172.21.15.92:0/1388562202 >> 172.21.15.92:0/1388562202 conn(0x7f26700fea20 msgr2=0x7f2670100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 -- 172.21.15.92:0/1388562202 shutdown_connections 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.082+0000 7f2677bec700 1 -- 172.21.15.92:0/1388562202 wait complete. 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 Processor -- start 2024-04-26T17:51:25.108 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 -- start start 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670103480 0x7f26701996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f267010eff0 con 0x7f2670105020 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f267010ee70 con 0x7f2670103480 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2677bec700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f267010f170 con 0x7f2670104680 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58350/0 (socket says 172.21.15.92:58350) 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 -- 172.21.15.92:0/3786526601 learned_addr learned my addr 172.21.15.92:0/3786526601 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2675988700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670103480 0x7f26701996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2675187700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 -- 172.21.15.92:0/3786526601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 msgr2=0x7f2670199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:25.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 -- 172.21.15.92:0/3786526601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670103480 msgr2=0x7f26701996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670103480 0x7f26701996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 -- 172.21.15.92:0/3786526601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26701a1350 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2675187700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.083+0000 7f2676189700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f266800b9a0 tx=0x7f266800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668019070 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f266800cde0 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26701a1640 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668007370 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701a1bb0 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.084+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267006a110 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.086+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) ==== 138590+0+0 (secure 0 0 0) 0x7f266801c070 con 0x7f2670105020 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.086+0000 7f2666ffd700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 0x7f265c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:25.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.086+0000 7f2675988700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 0x7f265c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.086+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f26680cebd0 con 0x7f2670105020 2024-04-26T17:51:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.087+0000 7f2675988700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 0x7f265c0a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f266c0038c0 tx=0x7f266c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:25.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.090+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2668023070 con 0x7f2670105020 2024-04-26T17:51:25.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:25.299+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2670063860 con 0x7f265c0a3bb0 2024-04-26T17:51:25.391 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:25.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 ceph-mon[29156]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T17:51:25.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:25.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:25.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 ceph-mon[32756]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T17:51:25.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:25.546 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41528]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.546 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41528]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.546 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41528]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.546 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41528]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 ceph-mon[32679]: osdmap e19: 3 total, 3 up, 3 in 2024-04-26T17:51:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-26T17:51:25.657 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.657 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41412]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41412]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41415]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.658 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41415]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48372]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48372]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48375]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48375]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.743 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48366]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.743 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48366]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.743 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48366]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.744 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48366]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.744 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48369]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.744 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.744 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48369]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.744 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 26 17:51:25 smithi092 sudo[48369]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.887 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.887 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.887 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41531]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.887 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41531]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41534]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41534]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41534]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41534]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41537]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41537]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41537]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:25 smithi189 sudo[41537]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41418]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41418]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41421]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41421]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41421]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-26T17:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:25 smithi156 sudo[41421]: pam_unix(sudo:session): session closed for user root 2024-04-26T17:51:26.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:26.581+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f26680989e0 con 0x7f2670105020 2024-04-26T17:51:26.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:26.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T17:51:26.581 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: pgmap v84: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.582 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.583 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:26 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: pgmap v84: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:26 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-26T17:51:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: osdmap e20: 3 total, 3 up, 3 in 2024-04-26T17:51:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: pgmap v84: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:51:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:26 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-26T17:51:27.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:27 smithi092 ceph-mon[29156]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T17:51:27.518 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:27 smithi092 ceph-mon[29156]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T17:51:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:27 smithi189 ceph-mon[32756]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T17:51:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:27 smithi189 ceph-mon[32756]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T17:51:27.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:27 smithi156 ceph-mon[32679]: osdmap e21: 3 total, 3 up, 3 in 2024-04-26T17:51:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:27 smithi156 ceph-mon[32679]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-26T17:51:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:28 smithi189 ceph-mon[32756]: pgmap v86: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:28 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]: dispatch 2024-04-26T17:51:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:28 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]': finished 2024-04-26T17:51:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:28 smithi189 ceph-mon[32756]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T17:51:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:28 smithi156 ceph-mon[32679]: pgmap v86: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:28 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]: dispatch 2024-04-26T17:51:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:28 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]': finished 2024-04-26T17:51:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:28 smithi156 ceph-mon[32679]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T17:51:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:28 smithi092 ceph-mon[29156]: pgmap v86: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:28 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]: dispatch 2024-04-26T17:51:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:28 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/242857171' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4bd9306-9b9e-45b9-b1d8-2661ac428acb"}]': finished 2024-04-26T17:51:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:28 smithi092 ceph-mon[29156]: osdmap e22: 4 total, 3 up, 4 in 2024-04-26T17:51:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:29 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3993885295' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:29.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:29 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3993885295' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:29.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:29 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3993885295' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:30 smithi189 ceph-mon[32756]: pgmap v88: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:30 smithi156 ceph-mon[32679]: pgmap v88: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:30.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:30 smithi092 ceph-mon[29156]: pgmap v88: 1 pgs: 1 active+clean; 128 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:32 smithi189 ceph-mon[32756]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-26T17:51:32.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:32 smithi156 ceph-mon[32679]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-26T17:51:32.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:32 smithi092 ceph-mon[29156]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 16 KiB/s rd, 468 KiB/s wr, 42 op/s 2024-04-26T17:51:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:34 smithi189 ceph-mon[32756]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 31 op/s 2024-04-26T17:51:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:34 smithi156 ceph-mon[32679]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 31 op/s 2024-04-26T17:51:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:34 smithi092 ceph-mon[29156]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 351 KiB/s wr, 31 op/s 2024-04-26T17:51:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:36 smithi189 ceph-mon[32756]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 303 KiB/s wr, 27 op/s 2024-04-26T17:51:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T17:51:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:36 smithi189 ceph-mon[32756]: Deploying daemon osd.3 on smithi092 2024-04-26T17:51:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:36 smithi156 ceph-mon[32679]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 303 KiB/s wr, 27 op/s 2024-04-26T17:51:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T17:51:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:36 smithi156 ceph-mon[32679]: Deploying daemon osd.3 on smithi092 2024-04-26T17:51:36.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:36 smithi092 ceph-mon[29156]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 11 KiB/s rd, 303 KiB/s wr, 27 op/s 2024-04-26T17:51:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-26T17:51:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:36 smithi092 ceph-mon[29156]: Deploying daemon osd.3 on smithi092 2024-04-26T17:51:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:38 smithi189 ceph-mon[32756]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-26T17:51:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:38 smithi156 ceph-mon[32679]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-26T17:51:38.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:38 smithi092 ceph-mon[29156]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 9.9 KiB/s rd, 281 KiB/s wr, 25 op/s 2024-04-26T17:51:40.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:40 smithi092 ceph-mon[29156]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 246 KiB/s wr, 22 op/s 2024-04-26T17:51:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:40 smithi189 ceph-mon[32756]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 246 KiB/s wr, 22 op/s 2024-04-26T17:51:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:40 smithi156 ceph-mon[32679]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.7 KiB/s rd, 246 KiB/s wr, 22 op/s 2024-04-26T17:51:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:42 smithi189 ceph-mon[32756]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-26T17:51:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:42 smithi156 ceph-mon[32679]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-26T17:51:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:42 smithi092 ceph-mon[29156]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail; 8.2 KiB/s rd, 234 KiB/s wr, 21 op/s 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.265+0000 7f2666ffd700 1 -- 172.21.15.92:0/3786526601 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2670063860 con 0x7f265c0a3bb0 2024-04-26T17:51:45.265 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 3 on host 'smithi092' 2024-04-26T17:51:45.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 msgr2=0x7f265c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 0x7f265c0a6070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f266c0038c0 tx=0x7f266c00b540 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 msgr2=0x7f26701a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f266800b9a0 tx=0x7f266800bcb0 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 shutdown_connections 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f265c0a3bb0 0x7f265c0a6070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2670103480 0x7f26701996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2670105020 0x7f26701a0cb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 --2- 172.21.15.92:0/3786526601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2670104680 0x7f2670199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.267+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 >> 172.21.15.92:0/3786526601 conn(0x7f26700fea20 msgr2=0x7f2670107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.268+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 shutdown_connections 2024-04-26T17:51:45.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:51:45.268+0000 7f2677bec700 1 -- 172.21.15.92:0/3786526601 wait complete. 2024-04-26T17:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:45 smithi189 ceph-mon[32756]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T17:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:45 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:45 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:45 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:45 smithi156 ceph-mon[32679]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T17:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:45 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:45 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:45 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:45.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:45 smithi092 ceph-mon[29156]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-26T17:51:45.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:45 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:45 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:45.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:45 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:51:45.990 DEBUG:teuthology.orchestra.run.smithi092:osd.3> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.3.service 2024-04-26T17:51:45.992 INFO:tasks.cephadm:Deploying osd.4 on smithi156 with /dev/vg_nvme/lv_3... 2024-04-26T17:51:45.992 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T17:51:46.247 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:51:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:46 smithi189 ceph-mon[32756]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:46 smithi189 ceph-mon[32756]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T17:51:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:46 smithi189 ceph-mon[32756]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T17:51:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:46 smithi189 ceph-mon[32756]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:51:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:46.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-mon[29156]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:46.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-mon[29156]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T17:51:46.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-mon[29156]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T17:51:46.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-mon[29156]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:51:46.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:46.904 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-3[50567]: 2024-04-26T17:51:46.631+0000 7f663020e700 -1 osd.3 0 waiting for initial osdmap 2024-04-26T17:51:46.904 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 26 17:51:46 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-3[50567]: 2024-04-26T17:51:46.637+0000 7f662c001700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:51:46.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:46 smithi156 ceph-mon[32679]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:46.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:46 smithi156 ceph-mon[32679]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-26T17:51:46.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:46 smithi156 ceph-mon[32679]: osdmap e23: 4 total, 3 up, 4 in 2024-04-26T17:51:46.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:46 smithi156 ceph-mon[32679]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:51:46.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:47 smithi092 ceph-mon[29156]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:51:47.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:47 smithi092 ceph-mon[29156]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T17:51:47.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.783 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:47 smithi189 ceph-mon[32756]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:51:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:47 smithi189 ceph-mon[32756]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T17:51:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:47 smithi156 ceph-mon[32679]: from='osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:47 smithi156 ceph-mon[32679]: osdmap e24: 4 total, 3 up, 4 in 2024-04-26T17:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:47 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:47 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.092 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T17:51:48.092 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T17:51:48.092 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-26T17:51:48.092 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-26T17:51:48.092 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00867558 s, 1.2 GB/s 2024-04-26T17:51:48.093 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] boot 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T17:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:48 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.768 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2024-04-26T17:51:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] boot 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T17:51:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:48 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: osd.3 [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] boot 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: osdmap e25: 4 total, 4 up, 4 in 2024-04-26T17:51:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:48 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:51:49.020 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:51:49.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:49.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: osdmap e26: 4 total, 4 up, 4 in 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:51:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 -- 172.21.15.156:0/2431556314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101ed0 msgr2=0x7fdb5c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2431556314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c10baa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400b0a0 tx=0x7fdb5400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 -- 172.21.15.156:0/2431556314 shutdown_connections 2024-04-26T17:51:50.637 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2431556314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c10baa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2431556314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2431556314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101530 0x7fdb5c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 -- 172.21.15.156:0/2431556314 >> 172.21.15.156:0/2431556314 conn(0x7fdb5c0fd090 msgr2=0x7fdb5c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 -- 172.21.15.156:0/2431556314 shutdown_connections 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.635+0000 7fdb6223c700 1 -- 172.21.15.156:0/2431556314 wait complete. 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 Processor -- start 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 -- start start 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:50.638 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c10eff0 con 0x7fdb5c101ed0 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c10ee70 con 0x7fdb5c101530 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb6223c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c10f170 con 0x7fdb5c104ab0 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:47688/0 (socket says 172.21.15.156:47688) 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 -- 172.21.15.156:0/2261120105 learned_addr learned my addr 172.21.15.156:0/2261120105 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5bfff700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb52ffd700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 -- 172.21.15.156:0/2261120105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 msgr2=0x7fdb5c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 -- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 msgr2=0x7fdb5c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:51:50.639 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5b7fe700 1 -- 172.21.15.156:0/2261120105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c1a11a0 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb52ffd700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.636+0000 7fdb5bfff700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb5b7fe700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b500 tx=0x7fdb4c00b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c015020 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb4c011ce0 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c1a1490 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c010d50 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.637+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1a1aa0 con 0x7fdb5c101530 2024-04-26T17:51:50.640 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.638+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c06a110 con 0x7fdb5c101530 2024-04-26T17:51:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.639+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fdb4c018020 con 0x7fdb5c101530 2024-04-26T17:51:50.641 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.639+0000 7fdb597fa700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 0x7fdb480a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:51:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.640+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7fdb4c0ce930 con 0x7fdb5c101530 2024-04-26T17:51:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.640+0000 7fdb52ffd700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 0x7fdb480a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:51:50.642 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.640+0000 7fdb52ffd700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 0x7fdb480a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb44005fd0 tx=0x7fdb44005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:51:50.643 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.644+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdb4c01f020 con 0x7fdb5c101530 2024-04-26T17:51:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:50 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi092 2024-04-26T17:51:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:50 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 8544M 2024-04-26T17:51:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:50 smithi156 ceph-mon[32679]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:51:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:50 smithi156 ceph-mon[32679]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T17:51:50.855 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:51:50.855+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fdb5c063860 con 0x7fdb480a3cc0 2024-04-26T17:51:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:50 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi092 2024-04-26T17:51:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:50 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 8544M 2024-04-26T17:51:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:50 smithi092 ceph-mon[29156]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:51:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:50 smithi092 ceph-mon[29156]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T17:51:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:50 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi092 2024-04-26T17:51:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:50 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 8544M 2024-04-26T17:51:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:50 smithi189 ceph-mon[32756]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:51:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:50 smithi189 ceph-mon[32756]: osdmap e27: 4 total, 4 up, 4 in 2024-04-26T17:51:51.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:51 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:51.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:51 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:51.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:51 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:51.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:51 smithi156 ceph-mon[32679]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T17:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:51 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:51 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:51 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:51 smithi092 ceph-mon[29156]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T17:51:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:51 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:51:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:51 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:51:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:51 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:51:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:51 smithi189 ceph-mon[32756]: osdmap e28: 4 total, 4 up, 4 in 2024-04-26T17:51:52.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:52 smithi156 ceph-mon[32679]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:52.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:52 smithi156 ceph-mon[32679]: pgmap v105: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:52.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:52 smithi156 ceph-mon[32679]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T17:51:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:52 smithi092 ceph-mon[29156]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:52 smithi092 ceph-mon[29156]: pgmap v105: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:52 smithi092 ceph-mon[29156]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T17:51:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:52 smithi189 ceph-mon[32756]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:51:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:52 smithi189 ceph-mon[32756]: pgmap v105: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:52 smithi189 ceph-mon[32756]: osdmap e29: 4 total, 4 up, 4 in 2024-04-26T17:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:53 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/2986985474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:53 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:53 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]': finished 2024-04-26T17:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:53 smithi156 ceph-mon[32679]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T17:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:53 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:53 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/2986985474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:53 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:53 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]': finished 2024-04-26T17:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:53 smithi092 ceph-mon[29156]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T17:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:53 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:53 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/2986985474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:53 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]: dispatch 2024-04-26T17:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:53 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "629fcf0c-6485-40a8-b061-830ca371d1a6"}]': finished 2024-04-26T17:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:53 smithi189 ceph-mon[32756]: osdmap e30: 5 total, 4 up, 5 in 2024-04-26T17:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:53 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:51:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:54 smithi156 ceph-mon[32679]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:54 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/3254918792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:54 smithi092 ceph-mon[29156]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:54 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/3254918792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:54 smithi189 ceph-mon[32756]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:51:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:54 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/3254918792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:51:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:56 smithi156 ceph-mon[32679]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:51:56.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:56 smithi092 ceph-mon[29156]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:51:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:56 smithi189 ceph-mon[32756]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:51:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:51:58 smithi156 ceph-mon[32679]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:51:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:51:58 smithi092 ceph-mon[29156]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:51:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:51:58 smithi189 ceph-mon[32756]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:00.766 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:00 smithi156 ceph-mon[32679]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:00 smithi092 ceph-mon[29156]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:00 smithi189 ceph-mon[32756]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:01.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T17:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:01.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T17:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-26T17:52:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:02.872 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:02 smithi156 ceph-mon[32679]: Deploying daemon osd.4 on smithi156 2024-04-26T17:52:02.872 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:02 smithi156 ceph-mon[32679]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:02 smithi092 ceph-mon[29156]: Deploying daemon osd.4 on smithi156 2024-04-26T17:52:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:02 smithi092 ceph-mon[29156]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:02 smithi189 ceph-mon[32756]: Deploying daemon osd.4 on smithi156 2024-04-26T17:52:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:02 smithi189 ceph-mon[32756]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:04.714 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:04 smithi156 ceph-mon[32679]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:04 smithi092 ceph-mon[29156]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:04 smithi189 ceph-mon[32756]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:06.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:06 smithi156 ceph-mon[32679]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:06 smithi092 ceph-mon[29156]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:06 smithi189 ceph-mon[32756]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:08 smithi156 ceph-mon[32679]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:08.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:08 smithi189 ceph-mon[32756]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:08 smithi092 ceph-mon[29156]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:10.269 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 4 on host 'smithi156' 2024-04-26T17:52:10.269 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.269+0000 7fdb597fa700 1 -- 172.21.15.156:0/2261120105 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdb5c063860 con 0x7fdb480a3cc0 2024-04-26T17:52:10.271 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 msgr2=0x7fdb480a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 0x7fdb480a6180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdb44005fd0 tx=0x7fdb44005e20 comp rx=0 tx=0).stop 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 msgr2=0x7fdb5c199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b500 tx=0x7fdb4c00b8c0 comp rx=0 tx=0).stop 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 shutdown_connections 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdb480a3cc0 0x7fdb480a6180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdb5c101530 0x7fdb5c199540 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdb5c104ab0 0x7fdb5c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:10.272 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 --2- 172.21.15.156:0/2261120105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb5c101ed0 0x7fdb5c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:10.273 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.272+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 >> 172.21.15.156:0/2261120105 conn(0x7fdb5c0fd090 msgr2=0x7fdb5c107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:52:10.273 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.273+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 shutdown_connections 2024-04-26T17:52:10.273 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:52:10.273+0000 7fdb6223c700 1 -- 172.21.15.156:0/2261120105 wait complete. 2024-04-26T17:52:10.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.613 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:10 smithi156 ceph-mon[32679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:10 smithi189 ceph-mon[32756]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:10 smithi092 ceph-mon[29156]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-26T17:52:10.903 DEBUG:teuthology.orchestra.run.smithi156:osd.4> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.4.service 2024-04-26T17:52:10.906 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-04-26T17:52:10.906 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-26T17:52:11.153 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:52:12.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T17:52:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T17:52:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-mon[32679]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:12.410 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-4[44254]: 2024-04-26T17:52:12.231+0000 7f7a03216700 -1 osd.4 0 waiting for initial osdmap 2024-04-26T17:52:12.410 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 26 17:52:12 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-4[44254]: 2024-04-26T17:52:12.236+0000 7f79ff009700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:12 smithi092 ceph-mon[29156]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:12.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-26T17:52:12.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: osdmap e31: 5 total, 4 up, 5 in 2024-04-26T17:52:12.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:12.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: from='osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:52:12.547 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:12 smithi189 ceph-mon[32756]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113315 s, 925 MB/s 2024-04-26T17:52:13.099 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 2024-04-26T17:52:13.100 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-04-26T17:52:13.411 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:13 smithi189 ceph-mon[32756]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:52:13.411 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:13 smithi189 ceph-mon[32756]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T17:52:13.411 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.411 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:13 smithi092 ceph-mon[29156]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:52:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:13 smithi092 ceph-mon[29156]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T17:52:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.535 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:13 smithi156 ceph-mon[32679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:52:13.535 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:13 smithi156 ceph-mon[32679]: osdmap e32: 5 total, 4 up, 5 in 2024-04-26T17:52:13.535 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.535 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:13.715 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-04-26T17:52:13.958 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] boot 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.351 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:14.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:14.352 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] boot 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: osd.4 [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] boot 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: osdmap e33: 5 total, 5 up, 5 in 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:15.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:15 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi156 2024-04-26T17:52:15.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:15 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 8544M 2024-04-26T17:52:15.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:15 smithi189 ceph-mon[32756]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T17:52:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:15 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi156 2024-04-26T17:52:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:15 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 8544M 2024-04-26T17:52:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:15 smithi092 ceph-mon[29156]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T17:52:15.666 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- 172.21.15.189:0/460869786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90105020 msgr2=0x7f1f9010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/460869786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90105020 0x7f1f9010b8d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800b0a0 tx=0x7f1f8800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- 172.21.15.189:0/460869786 shutdown_connections 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/460869786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90103480 0x7f1f901038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/460869786 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90105020 0x7f1f9010b8d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/460869786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90104680 0x7f1f90104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- 172.21.15.189:0/460869786 >> 172.21.15.189:0/460869786 conn(0x7f1f900fea20 msgr2=0x7f1f90100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- 172.21.15.189:0/460869786 shutdown_connections 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- 172.21.15.189:0/460869786 wait complete. 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 Processor -- start 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.660+0000 7f1f97c7a700 1 -- start start 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:15.667 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 0x7f1f90199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90105020 0x7f1f901a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9010ef20 con 0x7f1f90105020 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9010eda0 con 0x7f1f90104680 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9010f0a0 con 0x7f1f90103480 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:35236/0 (socket says 172.21.15.189:35236) 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 -- 172.21.15.189:0/1779893440 learned_addr learned my addr 172.21.15.189:0/1779893440 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95215700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 0x7f1f90199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f96217700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90105020 0x7f1f901a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 -- 172.21.15.189:0/1779893440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 msgr2=0x7f1f90199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 0x7f1f90199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.668 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 -- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90105020 msgr2=0x7f1f901a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90105020 0x7f1f901a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 -- 172.21.15.189:0/1779893440 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f901a11f0 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95215700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 0x7f1f90199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f95a16700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c920 tx=0x7f1f8c00cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004220 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f8c007d70 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c003d40 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.661+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f901a14e0 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.662+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f901a1a20 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.662+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9006a110 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.663+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f1f8c0078c0 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.664+0000 7f1f86ffd700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 0x7f1f7c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.664+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f1f8c0cefb0 con 0x7f1f90103480 2024-04-26T17:52:15.669 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.664+0000 7f1f95215700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 0x7f1f7c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:15.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.665+0000 7f1f95215700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 0x7f1f7c0a6180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f80005fd0 tx=0x7f1f80005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:52:15.670 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.669+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1f8c014030 con 0x7f1f90103480 2024-04-26T17:52:15.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:15 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi156 2024-04-26T17:52:15.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:15 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 8544M 2024-04-26T17:52:15.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:15 smithi156 ceph-mon[32679]: osdmap e34: 5 total, 5 up, 5 in 2024-04-26T17:52:15.874 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:15.874+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1f90063860 con 0x7f1f7c0a3cc0 2024-04-26T17:52:16.500 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:16 smithi189 ceph-mon[32756]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:16.500 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:16.500 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:16.500 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:16 smithi156 ceph-mon[32679]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:16 smithi092 ceph-mon[29156]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:17.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:17 smithi189 ceph-mon[32756]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:17 smithi156 ceph-mon[32679]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:17 smithi092 ceph-mon[29156]: from='client.24208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:18 smithi189 ceph-mon[32756]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:18 smithi156 ceph-mon[32679]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:18 smithi092 ceph-mon[29156]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/726589786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]': finished 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:19 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/1289093004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/726589786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]': finished 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:19 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/1289093004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/726589786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]: dispatch 2024-04-26T17:52:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23e77478-0d7d-40d5-b841-afac85598bda"}]': finished 2024-04-26T17:52:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: osdmap e35: 6 total, 5 up, 6 in 2024-04-26T17:52:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/1289093004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:20 smithi189 ceph-mon[32756]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:20 smithi156 ceph-mon[32679]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:20.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:20 smithi092 ceph-mon[29156]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:22.822 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:22 smithi189 ceph-mon[32756]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:22.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:22 smithi156 ceph-mon[32679]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:22 smithi092 ceph-mon[29156]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:24.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:24 smithi189 ceph-mon[32756]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:24 smithi156 ceph-mon[32679]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:24 smithi092 ceph-mon[29156]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:26.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:26 smithi189 ceph-mon[32756]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:26.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T17:52:26.733 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:26 smithi156 ceph-mon[32679]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T17:52:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:26.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:26 smithi092 ceph-mon[29156]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-26T17:52:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:27 smithi189 ceph-mon[32756]: Deploying daemon osd.5 on smithi189 2024-04-26T17:52:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:27 smithi156 ceph-mon[32679]: Deploying daemon osd.5 on smithi189 2024-04-26T17:52:27.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:27 smithi092 ceph-mon[29156]: Deploying daemon osd.5 on smithi189 2024-04-26T17:52:28.817 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:28 smithi189 ceph-mon[32756]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:28 smithi156 ceph-mon[32679]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:28 smithi092 ceph-mon[29156]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:30.727 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:30 smithi189 ceph-mon[32756]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:30 smithi156 ceph-mon[32679]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:30 smithi092 ceph-mon[29156]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:32 smithi189 ceph-mon[32756]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:32.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:32 smithi156 ceph-mon[32679]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:32 smithi092 ceph-mon[29156]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:34 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:34 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:34 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:35.092 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.093+0000 7f1f86ffd700 1 -- 172.21.15.189:0/1779893440 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f90063860 con 0x7f1f7c0a3cc0 2024-04-26T17:52:35.093 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-04-26T17:52:35.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 msgr2=0x7f1f7c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:35.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 0x7f1f7c0a6180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f80005fd0 tx=0x7f1f80005ee0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 msgr2=0x7f1f90199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:35.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00c920 tx=0x7f1f8c00cce0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.095 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 shutdown_connections 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1f7c0a3cc0 0x7f1f7c0a6180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f90105020 0x7f1f901a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1f90103480 0x7f1f90199590 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 --2- 172.21.15.189:0/1779893440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f90104680 0x7f1f90199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 >> 172.21.15.189:0/1779893440 conn(0x7f1f900fea20 msgr2=0x7f1f90107a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 shutdown_connections 2024-04-26T17:52:35.096 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:52:35.096+0000 7f1f97c7a700 1 -- 172.21.15.189:0/1779893440 wait complete. 2024-04-26T17:52:35.740 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.5.service 2024-04-26T17:52:35.743 INFO:tasks.cephadm:Deploying osd.6 on smithi092 with /dev/vg_nvme/lv_2... 2024-04-26T17:52:35.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T17:52:35.994 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.355 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:36 smithi092 ceph-mon[29156]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:36 smithi189 ceph-mon[32756]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:36.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-26T17:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:36 smithi156 ceph-mon[32679]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:37.231 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-mon[32756]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T17:52:37.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-mon[32756]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-mon[32756]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T17:52:37.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:37.232 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-mon[32756]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:37 smithi156 ceph-mon[32679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T17:52:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:37 smithi156 ceph-mon[32679]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:37 smithi156 ceph-mon[32679]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T17:52:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:37 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:37 smithi156 ceph-mon[32679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:37 smithi092 ceph-mon[29156]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-26T17:52:37.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:37 smithi092 ceph-mon[29156]: from='osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:37 smithi092 ceph-mon[29156]: osdmap e36: 6 total, 5 up, 6 in 2024-04-26T17:52:37.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:37 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:37.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:37 smithi092 ceph-mon[29156]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:52:37.887 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-5[44434]: 2024-04-26T17:52:37.492+0000 7fae1dedf700 -1 osd.5 0 waiting for initial osdmap 2024-04-26T17:52:37.887 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 26 17:52:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-5[44434]: 2024-04-26T17:52:37.502+0000 7fae15cca700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:52:38.215 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T17:52:38.215 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T17:52:38.216 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-04-26T17:52:38.216 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-04-26T17:52:38.216 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114469 s, 916 MB/s 2024-04-26T17:52:38.216 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-04-26T17:52:38.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:52:38.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: from='osd.5 ' entity='osd.5' 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] boot 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T17:52:38.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:38 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: from='osd.5 ' entity='osd.5' 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] boot 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T17:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:38 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: osdmap e37: 6 total, 5 up, 6 in 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: from='osd.5 ' entity='osd.5' 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: osd.5 [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] boot 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: osdmap e38: 6 total, 6 up, 6 in 2024-04-26T17:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:38 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:52:38.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-04-26T17:52:39.117 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:52:39.130 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.131 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:39 smithi156 ceph-mon[32679]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:39 smithi092 ceph-mon[29156]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:52:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:39 smithi189 ceph-mon[32756]: osdmap e39: 6 total, 6 up, 6 in 2024-04-26T17:52:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:40 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi189 2024-04-26T17:52:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:40 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 8544M 2024-04-26T17:52:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:40 smithi189 ceph-mon[32756]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:40 smithi189 ceph-mon[32756]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T17:52:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:40 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi189 2024-04-26T17:52:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:40 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 8544M 2024-04-26T17:52:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:40 smithi156 ceph-mon[32679]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:40 smithi156 ceph-mon[32679]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T17:52:40.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:40 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi189 2024-04-26T17:52:40.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:40 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 8544M 2024-04-26T17:52:40.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:40 smithi092 ceph-mon[29156]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:40.440 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:40 smithi092 ceph-mon[29156]: osdmap e40: 6 total, 6 up, 6 in 2024-04-26T17:52:40.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 -- 172.21.15.92:0/3653513665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c1023b0 msgr2=0x7fbb9c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:40.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 --2- 172.21.15.92:0/3653513665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1027d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb980099c0 tx=0x7fbb98009cd0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 -- 172.21.15.92:0/3653513665 shutdown_connections 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 --2- 172.21.15.92:0/3653513665 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c103f50 0x7fbb9c10a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 --2- 172.21.15.92:0/3653513665 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1027d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 --2- 172.21.15.92:0/3653513665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1035b0 0x7fbb9c103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 -- 172.21.15.92:0/3653513665 >> 172.21.15.92:0/3653513665 conn(0x7fbb9c0fd970 msgr2=0x7fbb9c0ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 -- 172.21.15.92:0/3653513665 shutdown_connections 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.742+0000 7fbba3d47700 1 -- 172.21.15.92:0/3653513665 wait complete. 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 Processor -- start 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 -- start start 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c1035b0 0x7fbb9c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c10de20 con 0x7fbb9c103f50 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c10dca0 con 0x7fbb9c1023b0 2024-04-26T17:52:40.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba3d47700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c10dfa0 con 0x7fbb9c1035b0 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba22e4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba22e4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56506/0 (socket says 172.21.15.92:56506) 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba22e4700 1 -- 172.21.15.92:0/1496891532 learned_addr learned my addr 172.21.15.92:0/1496891532 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba1ae3700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.743+0000 7fbba12e2700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c1035b0 0x7fbb9c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 -- 172.21.15.92:0/1496891532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c1035b0 msgr2=0x7fbb9c199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c1035b0 0x7fbb9c199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 -- 172.21.15.92:0/1496891532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1023b0 msgr2=0x7fbb9c1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 -- 172.21.15.92:0/1496891532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c1a1150 con 0x7fbb9c103f50 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba22e4700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb94007f10 tx=0x7fbb9400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:52:40.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94004bb0 con 0x7fbb9c103f50 2024-04-26T17:52:40.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb94004d50 con 0x7fbb9c103f50 2024-04-26T17:52:40.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c1a1440 con 0x7fbb9c103f50 2024-04-26T17:52:40.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb940058e0 con 0x7fbb9c103f50 2024-04-26T17:52:40.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.744+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c1a1980 con 0x7fbb9c103f50 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.745+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c06a110 con 0x7fbb9c103f50 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.746+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fbb9401a020 con 0x7fbb9c103f50 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.747+0000 7fbb92ffd700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 0x7fbb880a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.747+0000 7fbba1ae3700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 0x7fbb880a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.747+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7fbb940cec00 con 0x7fbb9c103f50 2024-04-26T17:52:40.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.747+0000 7fbba1ae3700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 0x7fbb880a6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb980038c0 tx=0x7fbb9800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:52:40.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.751+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbb940d5080 con 0x7fbb9c103f50 2024-04-26T17:52:40.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:52:40.955+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbb9c1a1c30 con 0x7fbb880a3cc0 2024-04-26T17:52:41.218 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:41 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:41.218 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:41 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:41.218 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:41 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:41.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:41 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:41 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:41 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:41.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:41 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:52:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:41 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:52:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:41 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:42 smithi092 ceph-mon[29156]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:42 smithi092 ceph-mon[29156]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T17:52:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:42 smithi092 ceph-mon[29156]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:52:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:42 smithi189 ceph-mon[32756]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:42 smithi189 ceph-mon[32756]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T17:52:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:42 smithi189 ceph-mon[32756]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:52:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:42 smithi156 ceph-mon[32679]: from='client.14334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:52:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:42 smithi156 ceph-mon[32679]: osdmap e41: 6 total, 6 up, 6 in 2024-04-26T17:52:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:42 smithi156 ceph-mon[32679]: pgmap v143: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 192 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-26T17:52:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:43 smithi092 ceph-mon[29156]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T17:52:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:43 smithi189 ceph-mon[32756]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T17:52:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:43 smithi156 ceph-mon[32679]: osdmap e42: 6 total, 6 up, 6 in 2024-04-26T17:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:44 smithi189 ceph-mon[32756]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-04-26T17:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:44 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]: dispatch 2024-04-26T17:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:44 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]': finished 2024-04-26T17:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:44 smithi189 ceph-mon[32756]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T17:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:44 smithi156 ceph-mon[32679]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-04-26T17:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:44 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]: dispatch 2024-04-26T17:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:44 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]': finished 2024-04-26T17:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:44 smithi156 ceph-mon[32679]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T17:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:44 smithi092 ceph-mon[29156]: pgmap v145: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-04-26T17:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:44 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]: dispatch 2024-04-26T17:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:44 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/914485095' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93f45cf1-bff5-478b-8032-f981eb9e611e"}]': finished 2024-04-26T17:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:44 smithi092 ceph-mon[29156]: osdmap e43: 7 total, 6 up, 7 in 2024-04-26T17:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:52:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:45 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2345148752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:45 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2345148752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:45 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2345148752' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:52:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:46 smithi189 ceph-mon[32756]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-26T17:52:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:46 smithi156 ceph-mon[32679]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-26T17:52:46.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:46 smithi092 ceph-mon[29156]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-26T17:52:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:48 smithi189 ceph-mon[32756]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:48.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:48 smithi092 ceph-mon[29156]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:48.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:48 smithi156 ceph-mon[32679]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:50.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:50 smithi092 ceph-mon[29156]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:50 smithi189 ceph-mon[32756]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:50.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:50 smithi156 ceph-mon[32679]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:51.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:51 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T17:52:51.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:51 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:51.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:51 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T17:52:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:51 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:51 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-26T17:52:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:51 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:52:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:52 smithi156 ceph-mon[32679]: Deploying daemon osd.6 on smithi092 2024-04-26T17:52:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:52 smithi156 ceph-mon[32679]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:52.942 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:52 smithi092 ceph-mon[29156]: Deploying daemon osd.6 on smithi092 2024-04-26T17:52:52.942 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:52 smithi092 ceph-mon[29156]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:52 smithi189 ceph-mon[32756]: Deploying daemon osd.6 on smithi092 2024-04-26T17:52:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:52 smithi189 ceph-mon[32756]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:54 smithi156 ceph-mon[32679]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:54 smithi092 ceph-mon[29156]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:54 smithi189 ceph-mon[32756]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:56.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:56 smithi092 ceph-mon[29156]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:56.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:56 smithi156 ceph-mon[32679]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:56 smithi189 ceph-mon[32756]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:52:58 smithi189 ceph-mon[32756]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:52:58 smithi156 ceph-mon[32679]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:52:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:52:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:52:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:52:58 smithi092 ceph-mon[29156]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:00 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:00 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:00 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.465 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 6 on host 'smithi092' 2024-04-26T17:53:01.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.466+0000 7fbb92ffd700 1 -- 172.21.15.92:0/1496891532 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbb9c1a1c30 con 0x7fbb880a3cc0 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.468+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 msgr2=0x7fbb880a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.468+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 0x7fbb880a6180 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbb980038c0 tx=0x7fbb9800b540 comp rx=0 tx=0).stop 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 msgr2=0x7fbb9c1a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb94007f10 tx=0x7fbb9400d3b0 comp rx=0 tx=0).stop 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 shutdown_connections 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb880a3cc0 0x7fbb880a6180 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb9c1023b0 0x7fbb9c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb9c103f50 0x7fbb9c1a0ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:01.468 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 --2- 172.21.15.92:0/1496891532 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb9c1035b0 0x7fbb9c199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:01.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 >> 172.21.15.92:0/1496891532 conn(0x7fbb9c0fd970 msgr2=0x7fbb9c06baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:01.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 shutdown_connections 2024-04-26T17:53:01.469 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:01.469+0000 7fbba3d47700 1 -- 172.21.15.92:0/1496891532 wait complete. 2024-04-26T17:53:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:01 smithi092 ceph-mon[29156]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T17:53:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:01 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:01 smithi189 ceph-mon[32756]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T17:53:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:01 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:01.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:01 smithi156 ceph-mon[32679]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-26T17:53:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:01 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:02.189 DEBUG:teuthology.orchestra.run.smithi092:osd.6> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.6.service 2024-04-26T17:53:02.192 INFO:tasks.cephadm:Deploying osd.7 on smithi156 with /dev/vg_nvme/lv_2... 2024-04-26T17:53:02.192 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T17:53:02.440 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:53:02.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:02 smithi156 ceph-mon[32679]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:02.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:02 smithi156 ceph-mon[32679]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T17:53:02.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:02 smithi156 ceph-mon[32679]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T17:53:02.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:02 smithi156 ceph-mon[32679]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:53:02.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:02 smithi092 ceph-mon[29156]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:02 smithi092 ceph-mon[29156]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T17:53:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:02 smithi092 ceph-mon[29156]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T17:53:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:02 smithi092 ceph-mon[29156]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:53:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:02 smithi189 ceph-mon[32756]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:02 smithi189 ceph-mon[32756]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-26T17:53:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:02 smithi189 ceph-mon[32756]: osdmap e44: 7 total, 6 up, 7 in 2024-04-26T17:53:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:02 smithi189 ceph-mon[32756]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:53:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.408 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-6[57095]: 2024-04-26T17:53:03.067+0000 7f97853e8700 -1 osd.6 0 waiting for initial osdmap 2024-04-26T17:53:03.408 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-6[57095]: 2024-04-26T17:53:03.075+0000 7f977d1d3700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:53:03.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-mon[29156]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:53:03.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-mon[29156]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T17:53:03.667 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:03 smithi092 ceph-mon[29156]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' 2024-04-26T17:53:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:03 smithi156 ceph-mon[32679]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:53:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:03 smithi156 ceph-mon[32679]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T17:53:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:03 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:03 smithi156 ceph-mon[32679]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' 2024-04-26T17:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:03 smithi189 ceph-mon[32756]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:03 smithi189 ceph-mon[32756]: osdmap e45: 7 total, 6 up, 7 in 2024-04-26T17:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:03 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:03 smithi189 ceph-mon[32756]: from='osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757]' entity='osd.6' 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875445 s, 1.2 GB/s 2024-04-26T17:53:04.523 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-26T17:53:04.823 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] boot 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T17:53:04.824 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:04 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] boot 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T17:53:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:04 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: osd.6 [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] boot 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: osdmap e46: 7 total, 7 up, 7 in 2024-04-26T17:53:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:04 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:53:05.225 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2024-04-26T17:53:05.467 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi092 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 5696M 2024-04-26T17:53:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:06 smithi156 ceph-mon[32679]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T17:53:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi092 2024-04-26T17:53:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 5696M 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:06 smithi189 ceph-mon[32756]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: osdmap e47: 7 total, 7 up, 7 in 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi092 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 5696M 2024-04-26T17:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:06 smithi092 ceph-mon[29156]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:07.165 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 -- 172.21.15.156:0/4264653794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 msgr2=0x7f885c104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:07.165 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 --2- 172.21.15.156:0/4264653794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c104eb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f88500099c0 tx=0x7f8850009cd0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 -- 172.21.15.156:0/4264653794 shutdown_connections 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 --2- 172.21.15.156:0/4264653794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c104eb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 --2- 172.21.15.156:0/4264653794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101ed0 0x7f885c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 --2- 172.21.15.156:0/4264653794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101510 0x7f885c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.163+0000 7f8863138700 1 -- 172.21.15.156:0/4264653794 >> 172.21.15.156:0/4264653794 conn(0x7f885c0fd090 msgr2=0x7f885c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- 172.21.15.156:0/4264653794 shutdown_connections 2024-04-26T17:53:07.166 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- 172.21.15.156:0/4264653794 wait complete. 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 Processor -- start 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- start start 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101510 0x7f885c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 0x7f885c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10ef30 con 0x7f885c101510 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10edb0 con 0x7f885c104a90 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f8863138700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10f0b0 con 0x7f885c101ed0 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f88616d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f88616d5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:59336/0 (socket says 172.21.15.156:59336) 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.164+0000 7f88616d5700 1 -- 172.21.15.156:0/1571015348 learned_addr learned my addr 172.21.15.156:0/1571015348 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-26T17:53:07.167 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8860ed4700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101510 0x7f885c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f885bfff700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 0x7f885c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 -- 172.21.15.156:0/1571015348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 msgr2=0x7f885c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 0x7f885c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 -- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101510 msgr2=0x7f885c19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101510 0x7f885c19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 -- 172.21.15.156:0/1571015348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c1a33b0 con 0x7f885c104a90 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f885bfff700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 0x7f885c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f88616d5700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f885400ada0 tx=0x7f885400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854017020 con 0x7f885c104a90 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f885400ce30 con 0x7f885c104a90 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88540054a0 con 0x7f885c104a90 2024-04-26T17:53:07.168 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c1a36a0 con 0x7f885c104a90 2024-04-26T17:53:07.169 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.165+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c1a3be0 con 0x7f885c104a90 2024-04-26T17:53:07.169 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.166+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c06a110 con 0x7f885c104a90 2024-04-26T17:53:07.170 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.167+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f885400c980 con 0x7f885c104a90 2024-04-26T17:53:07.170 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.168+0000 7f8859ffb700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 0x7f884c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:07.170 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.168+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f88540ceec0 con 0x7f885c104a90 2024-04-26T17:53:07.170 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.168+0000 7f8860ed4700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 0x7f884c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:07.170 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.168+0000 7f8860ed4700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 0x7f884c0a6180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8850003790 tx=0x7f8850005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:07.171 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.172+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8854021020 con 0x7f885c104a90 2024-04-26T17:53:07.378 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:07.379+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f885c103d40 con 0x7f884c0a3cc0 2024-04-26T17:53:07.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:07 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:07 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:07 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:07 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:07 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:07 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:07 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:07 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:07 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:08 smithi092 ceph-mon[29156]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:08 smithi092 ceph-mon[29156]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:08 smithi189 ceph-mon[32756]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:08 smithi189 ceph-mon[32756]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:08 smithi156 ceph-mon[32679]: from='client.24269 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:08 smithi156 ceph-mon[32679]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/652804460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]': finished 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T17:53:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/652804460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]': finished 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T17:53:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/652804460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]: dispatch 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "939fcac7-da9c-4597-bb1a-72551333afc2"}]': finished 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: osdmap e48: 8 total, 7 up, 8 in 2024-04-26T17:53:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:11.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:11 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/3813585664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:11 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/3813585664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:11 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/3813585664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:12.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:12 smithi156 ceph-mon[32679]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:12.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:12 smithi092 ceph-mon[29156]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:12 smithi189 ceph-mon[32756]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:14.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:14 smithi156 ceph-mon[32679]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:14 smithi092 ceph-mon[29156]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:14 smithi189 ceph-mon[32756]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:16.878 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:16 smithi156 ceph-mon[32679]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:16 smithi092 ceph-mon[29156]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:16 smithi189 ceph-mon[32756]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:17.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T17:53:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T17:53:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-26T17:53:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:18.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:18 smithi156 ceph-mon[32679]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:18 smithi156 ceph-mon[32679]: Deploying daemon osd.7 on smithi156 2024-04-26T17:53:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:18 smithi092 ceph-mon[29156]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:18 smithi092 ceph-mon[29156]: Deploying daemon osd.7 on smithi156 2024-04-26T17:53:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:18 smithi189 ceph-mon[32756]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:18 smithi189 ceph-mon[32756]: Deploying daemon osd.7 on smithi156 2024-04-26T17:53:20.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:20 smithi156 ceph-mon[32679]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:20 smithi092 ceph-mon[29156]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:20 smithi189 ceph-mon[32756]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:22 smithi156 ceph-mon[32679]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:22 smithi092 ceph-mon[29156]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:22 smithi189 ceph-mon[32756]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:24 smithi189 ceph-mon[32756]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:24 smithi156 ceph-mon[32679]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:24 smithi092 ceph-mon[29156]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:26.882 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:26.882 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.883 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.883 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:26.883 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:26.883 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:27.243 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.243+0000 7f8859ffb700 1 -- 172.21.15.156:0/1571015348 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f885c103d40 con 0x7f884c0a3cc0 2024-04-26T17:53:27.244 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 7 on host 'smithi156' 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.245+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 msgr2=0x7f884c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.245+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 0x7f884c0a6180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8850003790 tx=0x7f8850005fb0 comp rx=0 tx=0).stop 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 msgr2=0x7f885c1a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f885400ada0 tx=0x7f885400c330 comp rx=0 tx=0).stop 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 shutdown_connections 2024-04-26T17:53:27.246 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f884c0a3cc0 0x7f884c0a6180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f885c104a90 0x7f885c1a2d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f885c101510 0x7f885c19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 --2- 172.21.15.156:0/1571015348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f885c101ed0 0x7f885c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 >> 172.21.15.156:0/1571015348 conn(0x7f885c0fd090 msgr2=0x7f885c102620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 shutdown_connections 2024-04-26T17:53:27.247 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:53:27.246+0000 7f8863138700 1 -- 172.21.15.156:0/1571015348 wait complete. 2024-04-26T17:53:27.990 DEBUG:teuthology.orchestra.run.smithi156:osd.7> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.7.service 2024-04-26T17:53:27.993 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-04-26T17:53:27.993 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:28 smithi156 ceph-mon[32679]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:28.241 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:28 smithi189 ceph-mon[32756]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-26T17:53:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:28 smithi092 ceph-mon[29156]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:29 smithi189 ceph-mon[32756]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T17:53:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:29 smithi189 ceph-mon[32756]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:29 smithi189 ceph-mon[32756]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T17:53:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:29 smithi189 ceph-mon[32756]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:29.463 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-mon[32679]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T17:53:29.463 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-mon[32679]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:29.464 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-mon[32679]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T17:53:29.464 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:29.464 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-mon[32679]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:29.464 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-7[50805]: 2024-04-26T17:53:29.206+0000 7faf8931b700 -1 osd.7 0 waiting for initial osdmap 2024-04-26T17:53:29.464 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 26 17:53:29 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-7[50805]: 2024-04-26T17:53:29.216+0000 7faf8510e700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:29 smithi092 ceph-mon[29156]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-26T17:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:29 smithi092 ceph-mon[29156]: from='osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:29 smithi092 ceph-mon[29156]: osdmap e49: 8 total, 7 up, 8 in 2024-04-26T17:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:29 smithi092 ceph-mon[29156]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113906 s, 921 MB/s 2024-04-26T17:53:30.417 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] boot 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:30 smithi189 ceph-mon[32756]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] boot 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:30 smithi092 ceph-mon[29156]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: osdmap e50: 8 total, 7 up, 8 in 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: osd.7 [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] boot 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: osdmap e51: 8 total, 8 up, 8 in 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:53:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:30 smithi156 ceph-mon[32679]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-04-26T17:53:31.093 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-04-26T17:53:31.334 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:31 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:31 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: osdmap e52: 8 total, 8 up, 8 in 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:31 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:32 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi156 2024-04-26T17:53:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:32 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 5696M 2024-04-26T17:53:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:32 smithi092 ceph-mon[29156]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T17:53:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:32 smithi092 ceph-mon[29156]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:32.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:32 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi156 2024-04-26T17:53:32.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:32 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 5696M 2024-04-26T17:53:32.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:32 smithi189 ceph-mon[32756]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T17:53:32.798 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:32 smithi189 ceph-mon[32756]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:32 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi156 2024-04-26T17:53:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:32 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 5696M 2024-04-26T17:53:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:32 smithi156 ceph-mon[32679]: osdmap e53: 8 total, 8 up, 8 in 2024-04-26T17:53:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:32 smithi156 ceph-mon[32679]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:33.014 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- 172.21.15.189:0/1284943043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564103480 msgr2=0x7f35641038a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 --2- 172.21.15.189:0/1284943043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564103480 0x7f35641038a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3558009990 tx=0x7f3558009ca0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- 172.21.15.189:0/1284943043 shutdown_connections 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 --2- 172.21.15.189:0/1284943043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564105020 0x7f356410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 --2- 172.21.15.189:0/1284943043 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564103480 0x7f35641038a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 --2- 172.21.15.189:0/1284943043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564104680 0x7f3564104ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- 172.21.15.189:0/1284943043 >> 172.21.15.189:0/1284943043 conn(0x7f35640fea20 msgr2=0x7f3564100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- 172.21.15.189:0/1284943043 shutdown_connections 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- 172.21.15.189:0/1284943043 wait complete. 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 Processor -- start 2024-04-26T17:53:33.015 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 -- start start 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.013+0000 7f356c45d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564103480 0x7f3564199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564105020 0x7f35641a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f356410ef20 con 0x7f3564103480 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f356410eda0 con 0x7f3564105020 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f356410f0a0 con 0x7f3564104680 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:47588/0 (socket says 172.21.15.189:47588) 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 -- 172.21.15.189:0/1544135627 learned_addr learned my addr 172.21.15.189:0/1544135627 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356a1f9700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564103480 0x7f3564199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356a9fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564105020 0x7f35641a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 -- 172.21.15.189:0/1544135627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564105020 msgr2=0x7f35641a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:33.016 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564105020 0x7f35641a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 -- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564103480 msgr2=0x7f3564199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564103480 0x7f3564199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 -- 172.21.15.189:0/1544135627 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35641a1270 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35699f8700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f356000d9b0 tx=0x7f356000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560017070 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3560005020 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 -- 172.21.15.189:0/1544135627 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35640756b0 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560009b50 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.014+0000 7f356c45d700 1 -- 172.21.15.189:0/1544135627 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3564075ba0 con 0x7f3564104680 2024-04-26T17:53:33.017 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.015+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f354c005330 con 0x7f3564104680 2024-04-26T17:53:33.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.016+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f35600051d0 con 0x7f3564104680 2024-04-26T17:53:33.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.017+0000 7f35577fe700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 0x7f35500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:33.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.017+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7f35600cf780 con 0x7f3564104680 2024-04-26T17:53:33.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.017+0000 7f356a1f9700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 0x7f35500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:33.018 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.018+0000 7f356a1f9700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 0x7f35500a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35580038a0 tx=0x7f3558005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:33.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.022+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3560020020 con 0x7f3564104680 2024-04-26T17:53:33.232 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:33.233+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f354c000bc0 con 0x7f35500a3c40 2024-04-26T17:53:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:33 smithi092 ceph-mon[29156]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T17:53:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:33 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:33 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:33 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:33.845 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:33 smithi189 ceph-mon[32756]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T17:53:33.845 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:33 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:33.845 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:33 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:33.845 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:33 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:33 smithi156 ceph-mon[32679]: osdmap e54: 8 total, 8 up, 8 in 2024-04-26T17:53:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:33 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:53:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:33 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:53:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:33 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:34 smithi092 ceph-mon[29156]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:34 smithi092 ceph-mon[29156]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T17:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:34 smithi092 ceph-mon[29156]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:34.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:34 smithi189 ceph-mon[32756]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:34.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:34 smithi189 ceph-mon[32756]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T17:53:34.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:34 smithi189 ceph-mon[32756]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:34 smithi156 ceph-mon[32679]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:53:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:34 smithi156 ceph-mon[32679]: osdmap e55: 8 total, 8 up, 8 in 2024-04-26T17:53:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:34 smithi156 ceph-mon[32679]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/515051755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]': finished 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:36 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/2665371868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/515051755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]': finished 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:36 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/2665371868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/515051755' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]: dispatch 2024-04-26T17:53:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fde43dbf-ec98-4ffc-952c-a02d99f49c8c"}]': finished 2024-04-26T17:53:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: osdmap e56: 9 total, 8 up, 9 in 2024-04-26T17:53:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:36 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/2665371868' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:53:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:38 smithi156 ceph-mon[32679]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:38.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:38 smithi189 ceph-mon[32756]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:38 smithi092 ceph-mon[29156]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:40.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:40 smithi156 ceph-mon[32679]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:40 smithi092 ceph-mon[29156]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:40.996 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:40 smithi189 ceph-mon[32756]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:42 smithi156 ceph-mon[32679]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:42 smithi092 ceph-mon[29156]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:43.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:42 smithi189 ceph-mon[32756]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:43.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T17:53:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:43.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T17:53:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-26T17:53:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:44 smithi156 ceph-mon[32679]: Deploying daemon osd.8 on smithi189 2024-04-26T17:53:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:44 smithi156 ceph-mon[32679]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:44 smithi092 ceph-mon[29156]: Deploying daemon osd.8 on smithi189 2024-04-26T17:53:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:44 smithi092 ceph-mon[29156]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:45.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:44 smithi189 ceph-mon[32756]: Deploying daemon osd.8 on smithi189 2024-04-26T17:53:45.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:44 smithi189 ceph-mon[32756]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:46 smithi156 ceph-mon[32679]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:46 smithi092 ceph-mon[29156]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:47.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:46 smithi189 ceph-mon[32756]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:48.716 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:48 smithi189 ceph-mon[32756]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:48 smithi156 ceph-mon[32679]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:48 smithi092 ceph-mon[29156]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:50 smithi189 ceph-mon[32756]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:50 smithi156 ceph-mon[32679]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:50 smithi092 ceph-mon[29156]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.954 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:52.954 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.954 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.955 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:52.955 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:52.955 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.002 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.002+0000 7f35577fe700 1 -- 172.21.15.189:0/1544135627 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f354c000bc0 con 0x7f35500a3c40 2024-04-26T17:53:53.003 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 msgr2=0x7f35500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 0x7f35500a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35580038a0 tx=0x7f3558005fb0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 msgr2=0x7f3564199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f356000d9b0 tx=0x7f356000dcc0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 shutdown_connections 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f35500a3c40 0x7f35500a6100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3564105020 0x7f35641a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3564103480 0x7f3564199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.005 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 --2- 172.21.15.189:0/1544135627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3564104680 0x7f3564199ba0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:53.006 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.004+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 >> 172.21.15.189:0/1544135627 conn(0x7f35640fea20 msgr2=0x7f3564107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:53.006 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.005+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 shutdown_connections 2024-04-26T17:53:53.006 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:53:53.005+0000 7f35557fa700 1 -- 172.21.15.189:0/1544135627 wait complete. 2024-04-26T17:53:53.695 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.8.service 2024-04-26T17:53:53.697 INFO:tasks.cephadm:Deploying osd.9 on smithi092 with /dev/vg_nvme/lv_1... 2024-04-26T17:53:53.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T17:53:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:53 smithi156 ceph-mon[32679]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:53 smithi156 ceph-mon[32679]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:53 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:53 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:53 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:53 smithi189 ceph-mon[32756]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:53 smithi189 ceph-mon[32756]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:53 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:53 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:53.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:53 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.947 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:53:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:53 smithi092 ceph-mon[29156]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:53 smithi092 ceph-mon[29156]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-26T17:53:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:53 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:53 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:53:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:53 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T17:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T17:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:54 smithi189 ceph-mon[32756]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:54 smithi156 ceph-mon[32679]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: from='osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: osdmap e57: 9 total, 8 up, 9 in 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:54 smithi092 ceph-mon[29156]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:53:55.241 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-8[50989]: 2024-04-26T17:53:55.127+0000 7f837d291700 -1 osd.8 0 waiting for initial osdmap 2024-04-26T17:53:55.242 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-8[50989]: 2024-04-26T17:53:55.138+0000 7f837507c700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:53:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:55 smithi092 ceph-mon[29156]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:53:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:55 smithi092 ceph-mon[29156]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T17:53:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:55 smithi092 ceph-mon[29156]: from='osd.8 ' entity='osd.8' 2024-04-26T17:53:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:55 smithi156 ceph-mon[32679]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:53:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:55 smithi156 ceph-mon[32679]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T17:53:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:55 smithi156 ceph-mon[32679]: from='osd.8 ' entity='osd.8' 2024-04-26T17:53:56.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-mon[32756]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:53:56.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-mon[32756]: osdmap e58: 9 total, 8 up, 9 in 2024-04-26T17:53:56.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:56.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:56.029 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:55 smithi189 ceph-mon[32756]: from='osd.8 ' entity='osd.8' 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133628 s, 785 MB/s 2024-04-26T17:53:56.168 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] boot 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T17:53:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:56 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:56.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] boot 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T17:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:56 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:57.121 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: pgmap v197: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: osd.8 [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] boot 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: osdmap e59: 9 total, 9 up, 9 in 2024-04-26T17:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:56 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi189 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 5696M 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi189 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 5696M 2024-04-26T17:53:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: osdmap e60: 9 total, 9 up, 9 in 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi189 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:53:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 5696M 2024-04-26T17:53:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:53:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:53:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:53:58.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:58 smithi092 ceph-mon[29156]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:53:58.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:58 smithi092 ceph-mon[29156]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T17:53:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:58 smithi156 ceph-mon[32679]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:53:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:58 smithi156 ceph-mon[32679]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 -- 172.21.15.92:0/3665489461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc1091d0 msgr2=0x7fc8bc10b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/3665489461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc10b5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b0a0 tx=0x7fc8b400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 -- 172.21.15.92:0/3665489461 shutdown_connections 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/3665489461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc10b5e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/3665489461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc103f70 0x7fc8bc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.944 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/3665489461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 0x7fc8bc108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 -- 172.21.15.92:0/3665489461 >> 172.21.15.92:0/3665489461 conn(0x7fc8bc0fd920 msgr2=0x7fc8bc0ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:53:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 -- 172.21.15.92:0/3665489461 shutdown_connections 2024-04-26T17:53:58.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.944+0000 7fc8c37f0700 1 -- 172.21.15.92:0/3665489461 wait complete. 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 Processor -- start 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 -- start start 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 0x7fc8bc101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc102460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10efe0 con 0x7fc8bc103f70 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10ee60 con 0x7fc8bc1068a0 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c37f0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc10f160 con 0x7fc8bc1091d0 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:58.947 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54646/0 (socket says 172.21.15.92:54646) 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 -- 172.21.15.92:0/2344447691 learned_addr learned my addr 172.21.15.92:0/2344447691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c0d8b700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 0x7fc8bc101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c1d8d700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc102460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 -- 172.21.15.92:0/2344447691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 msgr2=0x7fc8bc102460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc102460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 -- 172.21.15.92:0/2344447691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 msgr2=0x7fc8bc101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 0x7fc8bc101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 -- 172.21.15.92:0/2344447691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8bc102d30 con 0x7fc8bc103f70 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c1d8d700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8c158c700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b530 tx=0x7fc8b800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.945+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8015020 con 0x7fc8bc103f70 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.946+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8b8011ce0 con 0x7fc8bc103f70 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.946+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc1a3880 con 0x7fc8bc103f70 2024-04-26T17:53:58.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.946+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8010d20 con 0x7fc8bc103f70 2024-04-26T17:53:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.946+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc1a3e10 con 0x7fc8bc103f70 2024-04-26T17:53:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.946+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc06a110 con 0x7fc8bc103f70 2024-04-26T17:53:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.948+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fc8b8018020 con 0x7fc8bc103f70 2024-04-26T17:53:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.948+0000 7fc8b27fc700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 0x7fc8a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:53:58.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.948+0000 7fc8c0d8b700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 0x7fc8a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:53:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.948+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5829+0+0 (secure 0 0 0) 0x7fc8b80cf870 con 0x7fc8bc103f70 2024-04-26T17:53:58.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.949+0000 7fc8c0d8b700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 0x7fc8a80a6100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac006fd0 tx=0x7fc8ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:53:58.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:58.952+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc8b801f020 con 0x7fc8bc103f70 2024-04-26T17:53:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:58 smithi189 ceph-mon[32756]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:53:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:58 smithi189 ceph-mon[32756]: osdmap e61: 9 total, 9 up, 9 in 2024-04-26T17:53:59.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:53:59.158+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc8bc063860 con 0x7fc8a80a3c40 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:00.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:53:59 smithi092 ceph-mon[29156]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:53:59 smithi189 ceph-mon[32756]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: osdmap e62: 9 total, 9 up, 9 in 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:53:59 smithi156 ceph-mon[32679]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:01.121 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:00 smithi092 ceph-mon[29156]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T17:54:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:00 smithi189 ceph-mon[32756]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T17:54:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:00 smithi156 ceph-mon[32679]: osdmap e63: 9 total, 9 up, 9 in 2024-04-26T17:54:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:01 smithi189 ceph-mon[32756]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T17:54:02.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:01 smithi156 ceph-mon[32679]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T17:54:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:01 smithi092 ceph-mon[29156]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-26T17:54:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:02 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]: dispatch 2024-04-26T17:54:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:02 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]': finished 2024-04-26T17:54:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:02 smithi092 ceph-mon[29156]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T17:54:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:02 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]: dispatch 2024-04-26T17:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:02 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]': finished 2024-04-26T17:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:02 smithi189 ceph-mon[32756]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T17:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:03.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:02 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]: dispatch 2024-04-26T17:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:02 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3393081540' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "835333c8-14f9-48e8-a46d-d01933f736e4"}]': finished 2024-04-26T17:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:02 smithi156 ceph-mon[32679]: osdmap e64: 10 total, 9 up, 10 in 2024-04-26T17:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:03 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/541023390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:03 smithi189 ceph-mon[32756]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:03 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/541023390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:03 smithi156 ceph-mon[32679]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:03 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/541023390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:03 smithi092 ceph-mon[29156]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-04-26T17:54:06.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:06 smithi156 ceph-mon[32679]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-26T17:54:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:06 smithi092 ceph-mon[29156]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-26T17:54:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:06 smithi189 ceph-mon[32756]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-04-26T17:54:08.856 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:08 smithi092 ceph-mon[29156]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:54:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:08 smithi156 ceph-mon[32679]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:54:08.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:08 smithi189 ceph-mon[32756]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:54:10.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:10 smithi092 ceph-mon[29156]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-26T17:54:10.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T17:54:10.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:10 smithi156 ceph-mon[32679]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-26T17:54:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T17:54:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:11.134 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:10 smithi189 ceph-mon[32756]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-04-26T17:54:11.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-26T17:54:11.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:11 smithi156 ceph-mon[32679]: Deploying daemon osd.9 on smithi092 2024-04-26T17:54:11.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:11 smithi092 ceph-mon[29156]: Deploying daemon osd.9 on smithi092 2024-04-26T17:54:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:11 smithi189 ceph-mon[32756]: Deploying daemon osd.9 on smithi092 2024-04-26T17:54:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:12 smithi156 ceph-mon[32679]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:12 smithi092 ceph-mon[29156]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:12 smithi189 ceph-mon[32756]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:14.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:14 smithi092 ceph-mon[29156]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:14 smithi156 ceph-mon[32679]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:14 smithi189 ceph-mon[32756]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:16.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:16 smithi092 ceph-mon[29156]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:16.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:16.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:16.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:16 smithi156 ceph-mon[32679]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:16 smithi189 ceph-mon[32756]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:18.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:18 smithi092 ceph-mon[29156]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:18 smithi156 ceph-mon[32679]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:18 smithi189 ceph-mon[32756]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:19.952 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 9 on host 'smithi092' 2024-04-26T17:54:19.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.952+0000 7fc8b27fc700 1 -- 172.21.15.92:0/2344447691 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc8bc063860 con 0x7fc8a80a3c40 2024-04-26T17:54:19.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 msgr2=0x7fc8a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 0x7fc8a80a6100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac006fd0 tx=0x7fc8ac008040 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 msgr2=0x7fc8bc103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800b530 tx=0x7fc8b800b8f0 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 shutdown_connections 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc8a80a3c40 0x7fc8a80a6100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc8bc1091d0 0x7fc8bc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc8bc103f70 0x7fc8bc103880 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 --2- 172.21.15.92:0/2344447691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc8bc1068a0 0x7fc8bc101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.954+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 >> 172.21.15.92:0/2344447691 conn(0x7fc8bc0fd920 msgr2=0x7fc8bc1049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.955+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 shutdown_connections 2024-04-26T17:54:19.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:54:19.955+0000 7fc8c37f0700 1 -- 172.21.15.92:0/2344447691 wait complete. 2024-04-26T17:54:20.720 DEBUG:teuthology.orchestra.run.smithi092:osd.9> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.9.service 2024-04-26T17:54:20.722 INFO:tasks.cephadm:Deploying osd.10 on smithi156 with /dev/vg_nvme/lv_1... 2024-04-26T17:54:20.722 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T17:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:20 smithi189 ceph-mon[32756]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T17:54:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:20 smithi156 ceph-mon[32679]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:20.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:20 smithi092 ceph-mon[29156]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-26T17:54:20.972 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:54:22.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:22 smithi156 ceph-mon[32679]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T17:54:22.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:22 smithi156 ceph-mon[32679]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T17:54:22.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:22 smithi156 ceph-mon[32679]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:54:22.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:22.125 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:22 smithi156 ceph-mon[32679]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:22.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-mon[29156]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T17:54:22.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-mon[29156]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T17:54:22.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-mon[29156]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:54:22.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:22.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-mon[29156]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:22 smithi189 ceph-mon[32756]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-26T17:54:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:22 smithi189 ceph-mon[32756]: osdmap e65: 10 total, 9 up, 10 in 2024-04-26T17:54:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:22 smithi189 ceph-mon[32756]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-04-26T17:54:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:22 smithi189 ceph-mon[32756]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:22.591 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-9[64135]: 2024-04-26T17:54:22.461+0000 7f5f5093c700 -1 osd.9 0 waiting for initial osdmap 2024-04-26T17:54:22.591 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 26 17:54:22 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-9[64135]: 2024-04-26T17:54:22.472+0000 7f5f48727700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:54:22.958 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T17:54:22.958 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T17:54:22.959 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2024-04-26T17:54:22.959 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2024-04-26T17:54:22.959 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00839801 s, 1.2 GB/s 2024-04-26T17:54:22.959 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2024-04-26T17:54:23.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:23 smithi092 ceph-mon[29156]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:54:23.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:23 smithi092 ceph-mon[29156]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T17:54:23.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:23 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:23 smithi092 ceph-mon[29156]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' 2024-04-26T17:54:23.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:23 smithi156 ceph-mon[32679]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:54:23.348 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:23 smithi156 ceph-mon[32679]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T17:54:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:23 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.349 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:23 smithi156 ceph-mon[32679]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' 2024-04-26T17:54:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:23 smithi189 ceph-mon[32756]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-04-26T17:54:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:23 smithi189 ceph-mon[32756]: osdmap e66: 10 total, 9 up, 10 in 2024-04-26T17:54:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:23 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:23 smithi189 ceph-mon[32756]: from='osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931]' entity='osd.9' 2024-04-26T17:54:23.780 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi156:vg_nvme/lv_1 2024-04-26T17:54:24.028 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.b/config 2024-04-26T17:54:24.300 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:54:24.300 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:54:24.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] boot 2024-04-26T17:54:24.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T17:54:24.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:24 smithi156 ceph-mon[32679]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] boot 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:24 smithi189 ceph-mon[32756]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:54:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:54:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: osd.9 [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] boot 2024-04-26T17:54:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: osdmap e67: 10 total, 10 up, 10 in 2024-04-26T17:54:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:54:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:24 smithi092 ceph-mon[29156]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi092 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 4272M 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:25 smithi156 ceph-mon[32679]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi092 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 4272M 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:25 smithi092 ceph-mon[29156]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T17:54:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi092 2024-04-26T17:54:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 4272M 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:25 smithi189 ceph-mon[32756]: osdmap e68: 10 total, 10 up, 10 in 2024-04-26T17:54:25.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 -- 172.21.15.156:0/4132122575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 msgr2=0x7f8c301038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:25.858 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 --2- 172.21.15.156:0/4132122575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c301038d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b0d0 tx=0x7f8c2800b3e0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 -- 172.21.15.156:0/4132122575 shutdown_connections 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 --2- 172.21.15.156:0/4132122575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c301038d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 --2- 172.21.15.156:0/4132122575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c30105050 0x7f8c3010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 --2- 172.21.15.156:0/4132122575 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c301046b0 0x7f8c30104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 -- 172.21.15.156:0/4132122575 >> 172.21.15.156:0/4132122575 conn(0x7f8c300fea70 msgr2=0x7f8c30100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 -- 172.21.15.156:0/4132122575 shutdown_connections 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.856+0000 7f8c37300700 1 -- 172.21.15.156:0/4132122575 wait complete. 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 Processor -- start 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 -- start start 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 0x7f8c30199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c30105050 0x7f8c301a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:25.859 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010efb0 con 0x7f8c301046b0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010ee30 con 0x7f8c301034b0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c37300700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3010f130 con 0x7f8c30105050 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:46106/0 (socket says 172.21.15.156:46106) 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 -- 172.21.15.156:0/2835938587 learned_addr learned my addr 172.21.15.156:0/2835938587 (peer_addr_for_me v2:172.21.15.156:0/0) 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 -- 172.21.15.156:0/2835938587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c30105050 msgr2=0x7f8c301a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c30105050 0x7f8c301a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3489b700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 0x7f8c30199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 -- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 msgr2=0x7f8c30199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 0x7f8c30199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3509c700 1 -- 172.21.15.156:0/2835938587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c301a12e0 con 0x7f8c301034b0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.857+0000 7f8c3489b700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 0x7f8c30199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c3509c700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009040 tx=0x7f8c28004e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:54:25.860 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2801f030 con 0x7f8c301034b0 2024-04-26T17:54:25.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c28007b40 con 0x7f8c301034b0 2024-04-26T17:54:25.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c301a1570 con 0x7f8c301034b0 2024-04-26T17:54:25.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c28004710 con 0x7f8c301034b0 2024-04-26T17:54:25.861 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.858+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301a1a20 con 0x7f8c301034b0 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.859+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3006a110 con 0x7f8c301034b0 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.860+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f8c28003a00 con 0x7f8c301034b0 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.861+0000 7f8c267fc700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 0x7f8c1c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.861+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f8c2800f020 con 0x7f8c301034b0 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.861+0000 7f8c3489b700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 0x7f8c1c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:25.862 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.861+0000 7f8c3489b700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 0x7f8c1c0a6180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c20007900 tx=0x7f8c20008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:54:25.864 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:25.864+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8c28029020 con 0x7f8c301034b0 2024-04-26T17:54:26.070 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:26.070+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8c30063860 con 0x7f8c1c0a3cc0 2024-04-26T17:54:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:26 smithi156 ceph-mon[32679]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:26 smithi092 ceph-mon[29156]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:26 smithi189 ceph-mon[32756]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:27.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:27 smithi092 ceph-mon[29156]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:27 smithi156 ceph-mon[32679]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:27 smithi189 ceph-mon[32756]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:28.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:28 smithi156 ceph-mon[32679]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:28 smithi092 ceph-mon[29156]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:28 smithi189 ceph-mon[32756]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:29 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/493043601' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:29 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:29 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]': finished 2024-04-26T17:54:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:29 smithi156 ceph-mon[32679]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T17:54:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:29 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/493043601' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:29 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:29 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]': finished 2024-04-26T17:54:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:29 smithi092 ceph-mon[29156]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T17:54:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:29 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/493043601' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:29 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]: dispatch 2024-04-26T17:54:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:29 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfe79378-5503-496e-a181-79991a26c848"}]': finished 2024-04-26T17:54:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:29 smithi189 ceph-mon[32756]: osdmap e69: 11 total, 10 up, 11 in 2024-04-26T17:54:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:30 smithi156 ceph-mon[32679]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:30 smithi156 ceph-mon[32679]: from='client.? 172.21.15.156:0/2868279770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:30 smithi092 ceph-mon[29156]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:30 smithi092 ceph-mon[29156]: from='client.? 172.21.15.156:0/2868279770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:30 smithi189 ceph-mon[32756]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:30 smithi189 ceph-mon[32756]: from='client.? 172.21.15.156:0/2868279770' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:32 smithi156 ceph-mon[32679]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:32 smithi092 ceph-mon[29156]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:32 smithi189 ceph-mon[32756]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:34 smithi156 ceph-mon[32679]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:34 smithi092 ceph-mon[29156]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:34 smithi189 ceph-mon[32756]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:36 smithi156 ceph-mon[32679]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T17:54:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:36 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:36 smithi092 ceph-mon[29156]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T17:54:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:36 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:36 smithi189 ceph-mon[32756]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-26T17:54:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:36 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:37.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:37 smithi156 ceph-mon[32679]: Deploying daemon osd.10 on smithi156 2024-04-26T17:54:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:37 smithi092 ceph-mon[29156]: Deploying daemon osd.10 on smithi156 2024-04-26T17:54:38.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:37 smithi189 ceph-mon[32756]: Deploying daemon osd.10 on smithi156 2024-04-26T17:54:38.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:38 smithi156 ceph-mon[32679]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:38 smithi092 ceph-mon[29156]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:38 smithi189 ceph-mon[32756]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:40 smithi156 ceph-mon[32679]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:40 smithi092 ceph-mon[29156]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:40 smithi189 ceph-mon[32756]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:42 smithi156 ceph-mon[32679]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:42 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:42 smithi092 ceph-mon[29156]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:42 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:42 smithi189 ceph-mon[32756]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:42 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:44.778 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:44 smithi156 ceph-mon[32679]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:44 smithi092 ceph-mon[29156]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:44 smithi189 ceph-mon[32756]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:46.288 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.288+0000 7f8c267fc700 1 -- 172.21.15.156:0/2835938587 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f8c30063860 con 0x7f8c1c0a3cc0 2024-04-26T17:54:46.289 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 10 on host 'smithi156' 2024-04-26T17:54:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 msgr2=0x7f8c1c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 0x7f8c1c0a6180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c20007900 tx=0x7f8c20008040 comp rx=0 tx=0).stop 2024-04-26T17:54:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 msgr2=0x7f8c30199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009040 tx=0x7f8c28004e00 comp rx=0 tx=0).stop 2024-04-26T17:54:46.291 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 shutdown_connections 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8c1c0a3cc0 0x7f8c1c0a6180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c301034b0 0x7f8c30199680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8c30105050 0x7f8c301a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 --2- 172.21.15.156:0/2835938587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c301046b0 0x7f8c30199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 >> 172.21.15.156:0/2835938587 conn(0x7f8c300fea70 msgr2=0x7f8c30107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 shutdown_connections 2024-04-26T17:54:46.292 INFO:teuthology.orchestra.run.smithi156.stderr:2024-04-26T17:54:46.291+0000 7f8c37300700 1 -- 172.21.15.156:0/2835938587 wait complete. 2024-04-26T17:54:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:46 smithi189 ceph-mon[32756]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:46 smithi156 ceph-mon[32679]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:46.942 DEBUG:teuthology.orchestra.run.smithi156:osd.10> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.10.service 2024-04-26T17:54:46.944 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-04-26T17:54:46.944 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-26T17:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:46 smithi092 ceph-mon[29156]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-26T17:54:47.190 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-mon[32679]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:48.434 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-10[57399]: 2024-04-26T17:54:48.284+0000 7f6ec552b700 -1 osd.10 0 waiting for initial osdmap 2024-04-26T17:54:48.434 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 26 17:54:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-10[57399]: 2024-04-26T17:54:48.296+0000 7f6ec131e700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:54:48.569 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T17:54:48.569 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.569 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T17:54:48.569 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:48.569 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.570 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:48 smithi189 ceph-mon[32756]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-26T17:54:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: from='osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: osdmap e70: 11 total, 10 up, 11 in 2024-04-26T17:54:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2024-04-26T17:54:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:48 smithi092 ceph-mon[29156]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10+0 records in 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr:10+0 records out 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119817 s, 875 MB/s 2024-04-26T17:54:49.294 INFO:teuthology.orchestra.run.smithi189.stderr:--> Zapping successful for: 2024-04-26T17:54:49.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] boot 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T17:54:49.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:49 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] boot 2024-04-26T17:54:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T17:54:49.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: osdmap e71: 11 total, 10 up, 11 in 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: osd.10 [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] boot 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: osdmap e72: 11 total, 11 up, 11 in 2024-04-26T17:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:54:50.051 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-04-26T17:54:50.309 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:50.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:50.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: osdmap e73: 11 total, 11 up, 11 in 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:54:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:50 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:54:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:51 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi156 2024-04-26T17:54:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:51 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 4272M 2024-04-26T17:54:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:51 smithi156 ceph-mon[32679]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T17:54:51.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:51 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi156 2024-04-26T17:54:51.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:51 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 4272M 2024-04-26T17:54:51.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:51 smithi189 ceph-mon[32756]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T17:54:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:51 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi156 2024-04-26T17:54:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:51 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 4272M 2024-04-26T17:54:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:51 smithi092 ceph-mon[29156]: osdmap e74: 11 total, 11 up, 11 in 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- 172.21.15.189:0/52413175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74102380 msgr2=0x7fad741027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 --2- 172.21.15.189:0/52413175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74102380 0x7fad741027a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad68009990 tx=0x7fad68009ca0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- 172.21.15.189:0/52413175 shutdown_connections 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 --2- 172.21.15.189:0/52413175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 0x7fad7410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 --2- 172.21.15.189:0/52413175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74102380 0x7fad741027a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 --2- 172.21.15.189:0/52413175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74103580 0x7fad741039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.100 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- 172.21.15.189:0/52413175 >> 172.21.15.189:0/52413175 conn(0x7fad740fd920 msgr2=0x7fad740ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- 172.21.15.189:0/52413175 shutdown_connections 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- 172.21.15.189:0/52413175 wait complete. 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 Processor -- start 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.099+0000 7fad7ab99700 1 -- start start 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74102380 0x7fad7406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 0x7fad741a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad7410de10 con 0x7fad74102380 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fad7410dc90 con 0x7fad74103f20 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fad7410df90 con 0x7fad74103580 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:48472/0 (socket says 172.21.15.189:48472) 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 -- 172.21.15.189:0/392327572 learned_addr learned my addr 172.21.15.189:0/392327572 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:54:52.101 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad78935700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74102380 0x7fad7406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad79136700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 0x7fad741a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 -- 172.21.15.189:0/392327572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 msgr2=0x7fad741a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 0x7fad741a2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 -- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74102380 msgr2=0x7fad7406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74102380 0x7fad7406c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 -- 172.21.15.189:0/392327572 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad741a3450 con 0x7fad74103580 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad73fff700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d980 tx=0x7fad6000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:54:52.102 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60016070 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad741a3740 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad600044d0 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.100+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60004d00 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.101+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad741a3cd0 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.102+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7406a110 con 0x7fad74103580 2024-04-26T17:54:52.103 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.103+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fad60004020 con 0x7fad74103580 2024-04-26T17:54:52.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.103+0000 7fad71ffb700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 0x7fad640a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:54:52.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.103+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7fad600cfcd0 con 0x7fad74103580 2024-04-26T17:54:52.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.104+0000 7fad78935700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 0x7fad640a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:54:52.104 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.104+0000 7fad78935700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 0x7fad640a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad680038a0 tx=0x7fad68005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:54:52.107 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.108+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fad6001f020 con 0x7fad74103580 2024-04-26T17:54:52.312 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:54:52.312+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fad74063860 con 0x7fad640a3c40 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:52 smithi189 ceph-mon[32756]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:52 smithi156 ceph-mon[32679]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: osdmap e75: 11 total, 11 up, 11 in 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: pgmap v242: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:54:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:52 smithi092 ceph-mon[29156]: osdmap e76: 11 total, 11 up, 11 in 2024-04-26T17:54:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:53 smithi189 ceph-mon[32756]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:53 smithi156 ceph-mon[32679]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:53 smithi092 ceph-mon[29156]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:54:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:54 smithi189 ceph-mon[32756]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:54 smithi156 ceph-mon[32679]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:54 smithi092 ceph-mon[29156]: pgmap v244: 1 pgs: 1 remapped+peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:54:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:55 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/2976035690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:55 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:55 smithi189 ceph-mon[32756]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]': finished 2024-04-26T17:54:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:55 smithi189 ceph-mon[32756]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T17:54:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:55 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/2976035690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:55 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:55 smithi156 ceph-mon[32679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]': finished 2024-04-26T17:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:55 smithi156 ceph-mon[32679]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T17:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:55 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/2976035690' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:55 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]: dispatch 2024-04-26T17:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:55 smithi092 ceph-mon[29156]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9c94655-dbf2-4779-a48e-3be47e6d1744"}]': finished 2024-04-26T17:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:55 smithi092 ceph-mon[29156]: osdmap e77: 12 total, 11 up, 12 in 2024-04-26T17:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:54:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:56 smithi189 ceph-mon[32756]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T17:54:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:56 smithi189 ceph-mon[32756]: from='client.? 172.21.15.189:0/2784071251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:56.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:56 smithi092 ceph-mon[29156]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T17:54:56.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:56 smithi092 ceph-mon[29156]: from='client.? 172.21.15.189:0/2784071251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:56 smithi156 ceph-mon[32679]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-04-26T17:54:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:56 smithi156 ceph-mon[32679]: from='client.? 172.21.15.189:0/2784071251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-26T17:54:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:54:58 smithi156 ceph-mon[32679]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-26T17:54:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:54:58 smithi092 ceph-mon[29156]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-26T17:54:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:54:58 smithi189 ceph-mon[32756]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-04-26T17:55:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:00 smithi156 ceph-mon[32679]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:55:00.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:00 smithi189 ceph-mon[32756]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:55:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:00 smithi092 ceph-mon[29156]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-26T17:55:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:02 smithi189 ceph-mon[32756]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T17:55:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T17:55:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:02 smithi156 ceph-mon[32679]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T17:55:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T17:55:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:02 smithi092 ceph-mon[29156]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-04-26T17:55:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-26T17:55:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:03.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:03 smithi189 ceph-mon[32756]: Deploying daemon osd.11 on smithi189 2024-04-26T17:55:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:03 smithi156 ceph-mon[32679]: Deploying daemon osd.11 on smithi189 2024-04-26T17:55:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:03 smithi092 ceph-mon[29156]: Deploying daemon osd.11 on smithi189 2024-04-26T17:55:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:04 smithi156 ceph-mon[32679]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T17:55:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:04 smithi092 ceph-mon[29156]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T17:55:04.998 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:04 smithi189 ceph-mon[32756]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-26T17:55:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:06 smithi156 ceph-mon[32679]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T17:55:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:06 smithi092 ceph-mon[29156]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T17:55:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:06 smithi189 ceph-mon[32756]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-04-26T17:55:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:08 smithi156 ceph-mon[32679]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:08 smithi092 ceph-mon[29156]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:09.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:08 smithi189 ceph-mon[32756]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:09.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:09.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:09 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:09.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:09 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:09.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:09 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:09 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:09 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:09 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:10.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:10 smithi189 ceph-mon[32756]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:10 smithi092 ceph-mon[29156]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:11.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:10 smithi156 ceph-mon[32679]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:12.482 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.483+0000 7fad71ffb700 1 -- 172.21.15.189:0/392327572 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fad74063860 con 0x7fad640a3c40 2024-04-26T17:55:12.483 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 msgr2=0x7fad640a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 0x7fad640a6100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad680038a0 tx=0x7fad68005fd0 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 msgr2=0x7fad741a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d980 tx=0x7fad6000dd40 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 shutdown_connections 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fad640a3c40 0x7fad640a6100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fad74103f20 0x7fad741a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad74102380 0x7fad7406c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 --2- 172.21.15.189:0/392327572 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fad74103580 0x7fad741a0720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:12.485 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 >> 172.21.15.189:0/392327572 conn(0x7fad740fd920 msgr2=0x7fad741069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:12.486 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 shutdown_connections 2024-04-26T17:55:12.486 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:12.485+0000 7fad7ab99700 1 -- 172.21.15.189:0/392327572 wait complete. 2024-04-26T17:55:12.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:12.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:12.851 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:12.852 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:12 smithi189 ceph-mon[32756]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:12 smithi156 ceph-mon[32679]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:12 smithi092 ceph-mon[29156]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-26T17:55:13.173 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@osd.11.service 2024-04-26T17:55:13.175 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-26T17:55:13.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T17:55:13.433 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:14.601 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T17:55:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T17:55:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.602 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-mon[32756]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:14.602 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-11[57589]: 2024-04-26T17:55:14.478+0000 7f7d415c6700 -1 osd.11 0 waiting for initial osdmap 2024-04-26T17:55:14.602 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 26 17:55:14 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-osd-11[57589]: 2024-04-26T17:55:14.490+0000 7f7d3d3b9700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:14 smithi092 ceph-mon[29156]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: osdmap e78: 12 total, 11 up, 12 in 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: from='osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]: dispatch 2024-04-26T17:55:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:14 smithi156 ceph-mon[32679]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:15.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 -- 172.21.15.92:0/691712447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8104670 msgr2=0x7f32a8106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:15.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/691712447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8104670 0x7f32a8106b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f329c009990 tx=0x7f329c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 -- 172.21.15.92:0/691712447 shutdown_connections 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/691712447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 0x7f32a8104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/691712447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8107040 0x7f32a81074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/691712447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8104670 0x7f32a8106b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.257+0000 7f32ae9a7700 1 -- 172.21.15.92:0/691712447 >> 172.21.15.92:0/691712447 conn(0x7f32a80fd940 msgr2=0x7f32a80ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- 172.21.15.92:0/691712447 shutdown_connections 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- 172.21.15.92:0/691712447 wait complete. 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 Processor -- start 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- start start 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 0x7f32a819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:15.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8104670 0x7f32a81a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32a81154f0 con 0x7f32a8107040 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8115370 con 0x7f32a8101d00 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.258+0000 7f32ae9a7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8115670 con 0x7f32a8104670 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33058/0 (socket says 172.21.15.92:33058) 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 -- 172.21.15.92:0/1725020646 learned_addr learned my addr 172.21.15.92:0/1725020646 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32a7fff700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 0x7f32a819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32a77fe700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8104670 0x7f32a81a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 -- 172.21.15.92:0/1725020646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8104670 msgr2=0x7f32a81a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8104670 0x7f32a81a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 -- 172.21.15.92:0/1725020646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 msgr2=0x7f32a819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:15.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 0x7f32a819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 -- 172.21.15.92:0/1725020646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a81a77c0 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32acf44700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007f10 tx=0x7f32a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a0004bb0 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32a0004d50 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a00058e0 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a81a7ab0 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.259+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a81a7ff0 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.260+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a806a110 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.261+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f32a001a020 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.262+0000 7f32a57fa700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 0x7f32900a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.262+0000 7f32a7fff700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 0x7f32900a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.262+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6847+0+0 (secure 0 0 0) 0x7f32a00cf500 con 0x7f32a8107040 2024-04-26T17:55:15.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.262+0000 7f32a7fff700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 0x7f32900a6100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f329800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:15.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.267+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f32a0010070 con 0x7f32a8107040 2024-04-26T17:55:15.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.465+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f32a802e620 con 0x7f32a8107040 2024-04-26T17:55:15.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.465+0000 7f32a57fa700 1 -- 172.21.15.92:0/1725020646 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f32a009c4a0 con 0x7f32a8107040 2024-04-26T17:55:15.464 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 msgr2=0x7f32900a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 0x7f32900a6100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3298005950 tx=0x7f329800a300 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 msgr2=0x7f32a81a7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32a0007f10 tx=0x7f32a000d3b0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 shutdown_connections 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f32900a3c40 0x7f32900a6100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32a8101d00 0x7f32a819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32a8107040 0x7f32a81a7120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 --2- 172.21.15.92:0/1725020646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32a8104670 0x7f32a81a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 >> 172.21.15.92:0/1725020646 conn(0x7f32a80fd940 msgr2=0x7f32a8102680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 shutdown_connections 2024-04-26T17:55:15.467 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:15.467+0000 7f32ae9a7700 1 -- 172.21.15.92:0/1725020646 wait complete. 2024-04-26T17:55:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:15 smithi092 ceph-mon[29156]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:55:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:15 smithi092 ceph-mon[29156]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T17:55:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:15 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:15 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:15 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1725020646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:15 smithi189 ceph-mon[32756]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:15 smithi189 ceph-mon[32756]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T17:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:15 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:15 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:15 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1725020646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:15 smithi156 ceph-mon[32679]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-04-26T17:55:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:15 smithi156 ceph-mon[32679]: osdmap e79: 12 total, 11 up, 12 in 2024-04-26T17:55:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:15 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:15 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:15 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1725020646' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:16.097 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1714154089,"num_in_osds":12,"osd_in_since":1714154095,"num_remapped_pgs":0} 2024-04-26T17:55:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: purged_snaps scrub starts 2024-04-26T17:55:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: purged_snaps scrub ok 2024-04-26T17:55:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] boot 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: purged_snaps scrub starts 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: purged_snaps scrub ok 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] boot 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: purged_snaps scrub starts 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: purged_snaps scrub ok 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: osd.11 [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] boot 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: osdmap e80: 12 total, 12 up, 12 in 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-04-26T17:55:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:17.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-26T17:55:17.340 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:17.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:17 smithi092 ceph-mon[29156]: Detected new or changed devices on smithi189 2024-04-26T17:55:17.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 4272M 2024-04-26T17:55:17.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:17 smithi092 ceph-mon[29156]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T17:55:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:17 smithi189 ceph-mon[32756]: Detected new or changed devices on smithi189 2024-04-26T17:55:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 4272M 2024-04-26T17:55:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:17 smithi189 ceph-mon[32756]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T17:55:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:17 smithi156 ceph-mon[32679]: Detected new or changed devices on smithi189 2024-04-26T17:55:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 4272M 2024-04-26T17:55:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:17 smithi156 ceph-mon[32679]: osdmap e81: 12 total, 12 up, 12 in 2024-04-26T17:55:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:18 smithi092 ceph-mon[29156]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:18 smithi189 ceph-mon[32756]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:18 smithi156 ceph-mon[32679]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:19.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/648676626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0109180 msgr2=0x7f0dc010b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:19.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/648676626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0109180 0x7f0dc010b5f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0db800b0a0 tx=0x7f0db800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/648676626 shutdown_connections 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/648676626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0109180 0x7f0dc010b5f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/648676626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dc0103f20 0x7f0dc0106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/648676626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0108c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/648676626 >> 172.21.15.92:0/648676626 conn(0x7f0dc00fd950 msgr2=0x7f0dc00ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/648676626 shutdown_connections 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.068+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/648676626 wait complete. 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 Processor -- start 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 -- start start 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dc0109180 0x7f0dc01a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:19.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010ef70 con 0x7f0dc0103f20 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010edf0 con 0x7f0dc0106850 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dc4ce8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc010f0f0 con 0x7f0dc0109180 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33078/0 (socket says 172.21.15.92:33078) 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 -- 172.21.15.92:0/316597708 learned_addr learned my addr 172.21.15.92:0/316597708 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 -- 172.21.15.92:0/316597708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dc0109180 msgr2=0x7f0dc01a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dc0109180 0x7f0dc01a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbdd9b700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 -- 172.21.15.92:0/316597708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 msgr2=0x7f0dc0199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 -- 172.21.15.92:0/316597708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc01a12a0 con 0x7f0dc0103f20 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbdd9b700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.069+0000 7f0dbe59c700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b560 tx=0x7f0db000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:19.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.070+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0015020 con 0x7f0dc0103f20 2024-04-26T17:55:19.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.070+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc01a1590 con 0x7f0dc0103f20 2024-04-26T17:55:19.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.070+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db0011ce0 con 0x7f0dc0103f20 2024-04-26T17:55:19.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.070+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0010da0 con 0x7f0dc0103f20 2024-04-26T17:55:19.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.070+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc01a1b20 con 0x7f0dc0103f20 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.071+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc006a110 con 0x7f0dc0103f20 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.072+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f0db0018020 con 0x7f0dc0103f20 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.072+0000 7f0daf7fe700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.072+0000 7f0dbdd9b700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.072+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0db00cf770 con 0x7f0dc0103f20 2024-04-26T17:55:19.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.073+0000 7f0dbdd9b700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 0x7f0da80a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0db4005d90 tx=0x7f0db4005d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:19.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.077+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0db001f020 con 0x7f0dc0103f20 2024-04-26T17:55:19.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.276+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0dc002e4c0 con 0x7f0dc0103f20 2024-04-26T17:55:19.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.277+0000 7f0daf7fe700 1 -- 172.21.15.92:0/316597708 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f0db009c5f0 con 0x7f0dc0103f20 2024-04-26T17:55:19.276 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 msgr2=0x7f0da80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 0x7f0da80a6100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0db4005d90 tx=0x7f0db4005d20 comp rx=0 tx=0).stop 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 msgr2=0x7f0dc0199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b560 tx=0x7f0db000b920 comp rx=0 tx=0).stop 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 shutdown_connections 2024-04-26T17:55:19.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f0da80a3c40 0x7f0da80a6100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0dc0109180 0x7f0dc01a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dc0103f20 0x7f0dc0199640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 --2- 172.21.15.92:0/316597708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dc0106850 0x7f0dc0199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 >> 172.21.15.92:0/316597708 conn(0x7f0dc00fd950 msgr2=0x7f0dc0104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 shutdown_connections 2024-04-26T17:55:19.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:19.279+0000 7f0dc4ce8700 1 -- 172.21.15.92:0/316597708 wait complete. 2024-04-26T17:55:19.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/316597708' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:19 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/316597708' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:19 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/316597708' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-26T17:55:20.091 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1714154115,"num_in_osds":12,"osd_in_since":1714154095,"num_remapped_pgs":0} 2024-04-26T17:55:20.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:55:20.324 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:20.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:20 smithi092 ceph-mon[29156]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:20 smithi189 ceph-mon[32756]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:20 smithi156 ceph-mon[32679]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:22.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- 172.21.15.92:0/362524089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c801094b0 msgr2=0x7f3c80109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 --2- 172.21.15.92:0/362524089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c801094b0 0x7f3c80109890 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009990 tx=0x7f3c70009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- 172.21.15.92:0/362524089 shutdown_connections 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 --2- 172.21.15.92:0/362524089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80102330 0x7f3c801102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 --2- 172.21.15.92:0/362524089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c801094b0 0x7f3c80109890 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 --2- 172.21.15.92:0/362524089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c80101970 0x7f3c80101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- 172.21.15.92:0/362524089 >> 172.21.15.92:0/362524089 conn(0x7f3c80078920 msgr2=0x7f3c800ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- 172.21.15.92:0/362524089 shutdown_connections 2024-04-26T17:55:22.175 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- 172.21.15.92:0/362524089 wait complete. 2024-04-26T17:55:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 Processor -- start 2024-04-26T17:55:22.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.175+0000 7f3c863b9700 1 -- start start 2024-04-26T17:55:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80101970 0x7f3c8019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:22.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 0x7f3c80199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c80113640 con 0x7f3c80102330 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3c801134c0 con 0x7f3c801094b0 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c863b9700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c801137c0 con 0x7f3c80101970 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33106/0 (socket says 172.21.15.92:33106) 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 -- 172.21.15.92:0/3207978497 learned_addr learned my addr 172.21.15.92:0/3207978497 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c84956700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 0x7f3c80199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7ffff700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80101970 0x7f3c8019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 -- 172.21.15.92:0/3207978497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80101970 msgr2=0x7f3c8019f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80101970 0x7f3c8019f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 -- 172.21.15.92:0/3207978497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 msgr2=0x7f3c80199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 0x7f3c80199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 -- 172.21.15.92:0/3207978497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8019a080 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c84956700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 0x7f3c80199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.176+0000 7f3c7f7fe700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400d950 tx=0x7f3c7400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.177+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74016070 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.177+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c74010460 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.177+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8019a370 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.177+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400f620 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.177+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c801a6630 con 0x7f3c80102330 2024-04-26T17:55:22.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.178+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8006a110 con 0x7f3c80102330 2024-04-26T17:55:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.179+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f3c74019070 con 0x7f3c80102330 2024-04-26T17:55:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.179+0000 7f3c7d7fa700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 0x7f3c680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.179+0000 7f3c7ffff700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 0x7f3c680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.180+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f3c740cfbd0 con 0x7f3c80102330 2024-04-26T17:55:22.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.180+0000 7f3c7ffff700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 0x7f3c680a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3c70006010 tx=0x7f3c7000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:22.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.183+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3c7409ca50 con 0x7f3c80102330 2024-04-26T17:55:22.386 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.387+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c8002e490 con 0x7f3c80102330 2024-04-26T17:55:22.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.388+0000 7f3c7d7fa700 1 -- 172.21.15.92:0/3207978497 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18432 (secure 0 0 0) 0x7f3c7409c350 con 0x7f3c80102330 2024-04-26T17:55:22.388 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:22.388 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":81,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:55:16.481366+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 msgr2=0x7f3c680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 0x7f3c680a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3c70006010 tx=0x7f3c7000b540 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 msgr2=0x7f3c8019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400d950 tx=0x7f3c7400dd10 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 shutdown_connections 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3c680a3c40 0x7f3c680a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c801094b0 0x7f3c80199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c80101970 0x7f3c8019f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 --2- 172.21.15.92:0/3207978497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c80102330 0x7f3c8019fca0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.390+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 >> 172.21.15.92:0/3207978497 conn(0x7f3c80078920 msgr2=0x7f3c80100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:22.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.391+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 shutdown_connections 2024-04-26T17:55:22.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:22.391+0000 7f3c863b9700 1 -- 172.21.15.92:0/3207978497 wait complete. 2024-04-26T17:55:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:22 smithi156 ceph-mon[32679]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:22 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3207978497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:55:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:22 smithi092 ceph-mon[29156]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:22 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3207978497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:55:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:22 smithi189 ceph-mon[32756]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:22 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3207978497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:55:23.172 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T17:51:23.617086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T17:55:23.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-26T17:55:23.408 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:24.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:24 smithi092 ceph-mon[29156]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:24 smithi156 ceph-mon[32679]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.124+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/638376011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc109480 msgr2=0x7f9acc109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.124+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/638376011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc109480 0x7f9acc109860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009990 tx=0x7f9ac0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/638376011 shutdown_connections 2024-04-26T17:55:25.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/638376011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9acc103ea0 0x7f9acc1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/638376011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc109480 0x7f9acc109860 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/638376011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc1034e0 0x7f9acc103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/638376011 >> 172.21.15.92:0/638376011 conn(0x7f9acc07a5e0 msgr2=0x7f9acc07a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/638376011 shutdown_connections 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/638376011 wait complete. 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 Processor -- start 2024-04-26T17:55:25.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.125+0000 7f9ad2ef0700 1 -- start start 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 0x7f9acc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9acc109480 0x7f9acc199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113610 con 0x7f9acc1034e0 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113490 con 0x7f9acc103ea0 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113790 con 0x7f9acc109480 2024-04-26T17:55:25.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55876/0 (socket says 172.21.15.92:55876) 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 -- 172.21.15.92:0/2017782397 learned_addr learned my addr 172.21.15.92:0/2017782397 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9acbfff700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 0x7f9acc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 -- 172.21.15.92:0/2017782397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9acc109480 msgr2=0x7f9acc199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9acc109480 0x7f9acc199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 -- 172.21.15.92:0/2017782397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 msgr2=0x7f9acc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 0x7f9acc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 -- 172.21.15.92:0/2017782397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc19a090 con 0x7f9acc1034e0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9acbfff700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 0x7f9acc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad0c8c700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0027070 con 0x7f9acc1034e0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ac00041d0 con 0x7f9acc1034e0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000f460 con 0x7f9acc1034e0 2024-04-26T17:55:25.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.126+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc19a320 con 0x7f9acc1034e0 2024-04-26T17:55:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.127+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1a6640 con 0x7f9acc1034e0 2024-04-26T17:55:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.127+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc06a110 con 0x7f9acc1034e0 2024-04-26T17:55:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.128+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9ac002a070 con 0x7f9acc1034e0 2024-04-26T17:55:25.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.129+0000 7f9ac9ffb700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 0x7f9abc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.129+0000 7f9acbfff700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 0x7f9abc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.129+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9ac00d1390 con 0x7f9acc1034e0 2024-04-26T17:55:25.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.129+0000 7f9acbfff700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 0x7f9abc0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005fd0 tx=0x7f9ab8005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:25.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.133+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9ac0031070 con 0x7f9acc1034e0 2024-04-26T17:55:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:24 smithi189 ceph-mon[32756]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:25.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.332+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9acc02e490 con 0x7f9acc1034e0 2024-04-26T17:55:25.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.333+0000 7f9ac9ffb700 1 -- 172.21.15.92:0/2017782397 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f9ac0013070 con 0x7f9acc1034e0 2024-04-26T17:55:25.333 INFO:teuthology.orchestra.run.smithi092.stdout:pg_num: 1 2024-04-26T17:55:25.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 msgr2=0x7f9abc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:25.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 0x7f9abc0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005fd0 tx=0x7f9ab8005dc0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 msgr2=0x7f9acc19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:25.335 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac00047b0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 shutdown_connections 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9abc0a3cc0 0x7f9abc0a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9acc109480 0x7f9acc199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9acc1034e0 0x7f9acc19f770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 --2- 172.21.15.92:0/2017782397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9acc103ea0 0x7f9acc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 >> 172.21.15.92:0/2017782397 conn(0x7f9acc07a5e0 msgr2=0x7f9acc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 shutdown_connections 2024-04-26T17:55:25.336 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:25.335+0000 7f9ad2ef0700 1 -- 172.21.15.92:0/2017782397 wait complete. 2024-04-26T17:55:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:25 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2017782397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T17:55:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:25 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2017782397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T17:55:26.118 INFO:tasks.cephadm:Adding mds.a on smithi092 2024-04-26T17:55:26.118 INFO:tasks.cephadm:Adding mds.d on smithi092 2024-04-26T17:55:26.118 INFO:tasks.cephadm:Adding mds.g on smithi092 2024-04-26T17:55:26.118 INFO:tasks.cephadm:Adding mds.j on smithi092 2024-04-26T17:55:26.118 INFO:tasks.cephadm:Adding mds.b on smithi156 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.e on smithi156 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.h on smithi156 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.k on smithi156 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-04-26T17:55:26.119 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-04-26T17:55:26.119 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph orch apply mds all '12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-04-26T17:55:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:25 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2017782397' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-26T17:55:26.372 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.c/config 2024-04-26T17:55:26.784 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:26 smithi092 ceph-mon[29156]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:26.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:26 smithi189 ceph-mon[32756]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:26 smithi156 ceph-mon[32679]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.042+0000 7f5206711700 1 -- 172.21.15.189:0/3699310680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52001046a0 msgr2=0x7f5200104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.042+0000 7f5206711700 1 --2- 172.21.15.189:0/3699310680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52001046a0 0x7f5200104b00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009990 tx=0x7f51f4009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- 172.21.15.189:0/3699310680 shutdown_connections 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- 172.21.15.189:0/3699310680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001034a0 0x7f52001038c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- 172.21.15.189:0/3699310680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5200105040 0x7f520010b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- 172.21.15.189:0/3699310680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52001046a0 0x7f5200104b00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- 172.21.15.189:0/3699310680 >> 172.21.15.189:0/3699310680 conn(0x7f52000fea40 msgr2=0x7f5200100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- 172.21.15.189:0/3699310680 shutdown_connections 2024-04-26T17:55:28.044 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- 172.21.15.189:0/3699310680 wait complete. 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 Processor -- start 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- start start 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52001034a0 0x7f520019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 0x7f520019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f520010efc0 con 0x7f52001034a0 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.043+0000 7f5206711700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f520010ee40 con 0x7f52001046a0 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5206711700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f520010f140 con 0x7f5200105040 2024-04-26T17:55:28.045 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:28.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:54992/0 (socket says 172.21.15.189:54992) 2024-04-26T17:55:28.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 -- 172.21.15.189:0/1465556563 learned_addr learned my addr 172.21.15.189:0/1465556563 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-04-26T17:55:28.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51fffff700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52001034a0 0x7f520019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:28.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51ff7fe700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 0x7f520019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:28.046 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 -- 172.21.15.189:0/1465556563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 msgr2=0x7f520019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 0x7f520019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 -- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52001034a0 msgr2=0x7f520019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52001034a0 0x7f520019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 -- 172.21.15.189:0/1465556563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52001a34f0 con 0x7f5200105040 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51ff7fe700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 0x7f520019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:55:28.047 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5204cae700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007f10 tx=0x7f51f800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:28.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8004bb0 con 0x7f5200105040 2024-04-26T17:55:28.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001a37e0 con 0x7f5200105040 2024-04-26T17:55:28.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001a3d20 con 0x7f5200105040 2024-04-26T17:55:28.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f8004d50 con 0x7f5200105040 2024-04-26T17:55:28.048 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.044+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8005a30 con 0x7f5200105040 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.045+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520006a110 con 0x7f5200105040 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.047+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f51f801a020 con 0x7f5200105040 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.048+0000 7f51fd7fa700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 0x7f51e80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.048+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f51f80cfd60 con 0x7f5200105040 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.048+0000 7f51fffff700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 0x7f51e80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:28.050 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.048+0000 7f51fffff700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 0x7f51e80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5200104500 tx=0x7f51f0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:28.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.052+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f51f8010070 con 0x7f5200105040 2024-04-26T17:55:28.260 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.260+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f5200076e70 con 0x7f51e80a3c40 2024-04-26T17:55:28.267 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.267+0000 7f51fd7fa700 1 -- 172.21.15.189:0/1465556563 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5200076e70 con 0x7f51e80a3c40 2024-04-26T17:55:28.267 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.269+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 msgr2=0x7f51e80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.269+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 0x7f51e80a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5200104500 tx=0x7f51f0009190 comp rx=0 tx=0).stop 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 msgr2=0x7f52001a2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007f10 tx=0x7f51f800d3b0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 shutdown_connections 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51e80a3c40 0x7f51e80a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5200105040 0x7f52001a2e50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52001034a0 0x7f520019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.270 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 --2- 172.21.15.189:0/1465556563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52001046a0 0x7f520019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:28.270 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 >> 172.21.15.189:0/1465556563 conn(0x7f52000fea40 msgr2=0x7f5200075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:28.270 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 shutdown_connections 2024-04-26T17:55:28.270 INFO:teuthology.orchestra.run.smithi189.stderr:2024-04-26T17:55:28.270+0000 7f5206711700 1 -- 172.21.15.189:0/1465556563 wait complete. 2024-04-26T17:55:28.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:28 smithi189 ceph-mon[32756]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:28.915 DEBUG:teuthology.orchestra.run.smithi092:mds.a> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service 2024-04-26T17:55:28.918 DEBUG:teuthology.orchestra.run.smithi092:mds.d> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service 2024-04-26T17:55:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:28 smithi156 ceph-mon[32679]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:28.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:28 smithi092 ceph-mon[29156]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:28.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:28.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:55:28.938 DEBUG:teuthology.orchestra.run.smithi092:mds.g> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service 2024-04-26T17:55:28.982 DEBUG:teuthology.orchestra.run.smithi092:mds.j> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service 2024-04-26T17:55:29.025 DEBUG:teuthology.orchestra.run.smithi156:mds.b> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.b.service 2024-04-26T17:55:29.027 DEBUG:teuthology.orchestra.run.smithi156:mds.e> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.e.service 2024-04-26T17:55:29.071 DEBUG:teuthology.orchestra.run.smithi156:mds.h> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service 2024-04-26T17:55:29.114 DEBUG:teuthology.orchestra.run.smithi156:mds.k> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service 2024-04-26T17:55:29.157 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service 2024-04-26T17:55:29.159 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service 2024-04-26T17:55:29.203 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service 2024-04-26T17:55:29.246 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service 2024-04-26T17:55:29.289 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-26T17:55:29.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:29.523 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:29.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:29.850 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:55:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-04-26T17:55:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:29.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:29.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:29.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='client.24364 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: Saving service mds.all spec with placement smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:30 smithi156 ceph-mon[32679]: Deploying daemon mds.l on smithi189 2024-04-26T17:55:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:30 smithi156 ceph-mon[32679]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:30.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:30 smithi092 ceph-mon[29156]: Deploying daemon mds.l on smithi189 2024-04-26T17:55:30.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:30 smithi092 ceph-mon[29156]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:30.987 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:30 smithi189 ceph-mon[32756]: Deploying daemon mds.l on smithi189 2024-04-26T17:55:30.987 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:30 smithi189 ceph-mon[32756]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:31.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 -- 172.21.15.92:0/2125336118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd0102e60 msgr2=0x7f9cd0103240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:31.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2125336118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd0102e60 0x7f9cd0103240 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009990 tx=0x7f9cc0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 -- 172.21.15.92:0/2125336118 shutdown_connections 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2125336118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd010ff00 0x7f9cd01122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2125336118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd0102e60 0x7f9cd0103240 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.299+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2125336118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 0x7f9cd010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 -- 172.21.15.92:0/2125336118 >> 172.21.15.92:0/2125336118 conn(0x7f9cd0078390 msgr2=0x7f9cd00787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 -- 172.21.15.92:0/2125336118 shutdown_connections 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 -- 172.21.15.92:0/2125336118 wait complete. 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 Processor -- start 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 -- start start 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd0102e60 0x7f9cd01a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.300+0000 7f9cd6076700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 0x7f9cd01a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd0115860 con 0x7f9cd010ff00 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01156e0 con 0x7f9cd0103780 2024-04-26T17:55:31.308 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd01159e0 con 0x7f9cd0102e60 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55900/0 (socket says 172.21.15.92:55900) 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 -- 172.21.15.92:0/2034343883 learned_addr learned my addr 172.21.15.92:0/2034343883 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccf7fe700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd0102e60 0x7f9cd01a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cceffd700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 0x7f9cd01a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 -- 172.21.15.92:0/2034343883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd0102e60 msgr2=0x7f9cd01a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd0102e60 0x7f9cd01a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 -- 172.21.15.92:0/2034343883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 msgr2=0x7f9cd01a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 0x7f9cd01a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 -- 172.21.15.92:0/2034343883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd019c2a0 con 0x7f9cd010ff00 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9ccffff700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80094f0 tx=0x7f9cc800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800ddd0 con 0x7f9cd010ff00 2024-04-26T17:55:31.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc8009e20 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd019c590 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8015400 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.301+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01a8800 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.302+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd006a110 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.303+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f9cc8005020 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.304+0000 7f9cccff9700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 0x7f9cb80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.304+0000 7f9ccf7fe700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 0x7f9cb80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.304+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f9cc80cf940 con 0x7f9cd010ff00 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.304+0000 7f9ccf7fe700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 0x7f9cb80a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000b5c0 tx=0x7f9cc0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:31.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.309+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9cc8010070 con 0x7f9cd010ff00 2024-04-26T17:55:31.379 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:31.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.560+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cd002e490 con 0x7f9cd010ff00 2024-04-26T17:55:31.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.560+0000 7f9cccff9700 1 -- 172.21.15.92:0/2034343883 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f9cc809c7c0 con 0x7f9cd010ff00 2024-04-26T17:55:31.561 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-26T17:55:31.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 msgr2=0x7f9cb80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 0x7f9cb80a6100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000b5c0 tx=0x7f9cc0005fd0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 msgr2=0x7f9cd019bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9cc80094f0 tx=0x7f9cc800d3b0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 shutdown_connections 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f9cb80a3c40 0x7f9cb80a6100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cd010ff00 0x7f9cd019bb40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9cd0102e60 0x7f9cd01a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 --2- 172.21.15.92:0/2034343883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cd0103780 0x7f9cd01a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 >> 172.21.15.92:0/2034343883 conn(0x7f9cd0078390 msgr2=0x7f9cd01112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 shutdown_connections 2024-04-26T17:55:31.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:31.562+0000 7f9cd6076700 1 -- 172.21.15.92:0/2034343883 wait complete. 2024-04-26T17:55:31.564 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 1 2024-04-26T17:55:31.637 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 podman[61975]: 2024-04-26 17:55:31.283836302 +0000 UTC m=+0.018276973 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:31.637 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 podman[61975]: 2024-04-26 17:55:31.398858041 +0000 UTC m=+0.133298754 container create 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T17:55:31.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:31 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2034343883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:31.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:31 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2034343883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:31 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2034343883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 podman[61975]: 2024-04-26 17:55:31.693407566 +0000 UTC m=+0.427848236 container init 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 podman[61975]: 2024-04-26 17:55:31.696236517 +0000 UTC m=+0.430677188 container start 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 ceph-mds[61994]: -- 172.21.15.189:0/2039015470 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559280fdfa40 con 0x559280fb2800 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: starting mds.l at 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 bash[61975]: 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 2024-04-26T17:55:32.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 17:55:31 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:boot 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: fsmap 1 up:standby 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:32.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:32 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:boot 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: fsmap 1 up:standby 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:32 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:boot 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: fsmap 1 up:standby 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:32 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:33.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:33 smithi156 ceph-mon[32679]: Deploying daemon mds.k on smithi156 2024-04-26T17:55:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:33 smithi092 ceph-mon[29156]: Deploying daemon mds.k on smithi156 2024-04-26T17:55:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:33 smithi189 ceph-mon[32756]: Deploying daemon mds.k on smithi156 2024-04-26T17:55:34.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:34.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:34.504 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 podman[62112]: 2024-04-26 17:55:34.139144262 +0000 UTC m=+0.017771536 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:34.504 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 podman[62112]: 2024-04-26 17:55:34.382546525 +0000 UTC m=+0.261173786 container create 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-26T17:55:34.664 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:34 smithi156 ceph-mon[32679]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 podman[62112]: 2024-04-26 17:55:34.635321663 +0000 UTC m=+0.513948926 container init 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 podman[62112]: 2024-04-26 17:55:34.638256566 +0000 UTC m=+0.516883827 container start 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 ceph-mds[62131]: -- 172.21.15.156:0/2496689478 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bbe63afa40 con 0x55bbe6382800 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: starting mds.k at 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 bash[62112]: 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f 2024-04-26T17:55:34.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 17:55:34 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:34 smithi092 ceph-mon[29156]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:34 smithi189 ceph-mon[32756]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:35.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:boot 2024-04-26T17:55:35.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: fsmap 2 up:standby 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:35.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:35 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:36.057 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:boot 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: fsmap 2 up:standby 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:36.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:35 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:boot 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: fsmap 2 up:standby 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:35 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:36 smithi092 ceph-mon[29156]: Deploying daemon mds.j on smithi092 2024-04-26T17:55:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:36 smithi092 ceph-mon[29156]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:36.997 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:36 smithi156 ceph-mon[32679]: Deploying daemon mds.j on smithi092 2024-04-26T17:55:36.997 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:36 smithi156 ceph-mon[32679]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:36 smithi189 ceph-mon[32756]: Deploying daemon mds.j on smithi092 2024-04-26T17:55:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:36 smithi189 ceph-mon[32756]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:37.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 -- 172.21.15.92:0/3788979955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 msgr2=0x7f02281027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:37.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 --2- 172.21.15.92:0/3788979955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f02281027a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0224009990 tx=0x7f0224009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 -- 172.21.15.92:0/3788979955 shutdown_connections 2024-04-26T17:55:37.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 --2- 172.21.15.92:0/3788979955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 0x7f0228108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 --2- 172.21.15.92:0/3788979955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0228102ce0 0x7f022810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 --2- 172.21.15.92:0/3788979955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f02281027a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 -- 172.21.15.92:0/3788979955 >> 172.21.15.92:0/3788979955 conn(0x7f02280792d0 msgr2=0x7f02280796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 -- 172.21.15.92:0/3788979955 shutdown_connections 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.299+0000 7f022f67c700 1 -- 172.21.15.92:0/3788979955 wait complete. 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 Processor -- start 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 -- start start 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0228102ce0 0x7f022819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 0x7f02281998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0228112530 con 0x7f0228102320 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f02281123b0 con 0x7f0228108390 2024-04-26T17:55:37.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022f67c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02281126b0 con 0x7f0228102ce0 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39758/0 (socket says 172.21.15.92:39758) 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 -- 172.21.15.92:0/3052608359 learned_addr learned my addr 172.21.15.92:0/3052608359 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022dc19700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 0x7f02281998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 -- 172.21.15.92:0/3052608359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0228102ce0 msgr2=0x7f022819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0228102ce0 0x7f022819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 -- 172.21.15.92:0/3052608359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 msgr2=0x7f02281998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.300+0000 7f022d418700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 0x7f02281998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f022d418700 1 -- 172.21.15.92:0/3052608359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022819a010 con 0x7f0228102320 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f022d418700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f021800c9b0 tx=0x7f021800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218007b00 con 0x7f0228102320 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0218007ca0 con 0x7f0228102320 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022819a300 con 0x7f0228102320 2024-04-26T17:55:37.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218018730 con 0x7f0228102320 2024-04-26T17:55:37.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.301+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02281a65c0 con 0x7f0228102320 2024-04-26T17:55:37.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.302+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022806a110 con 0x7f0228102320 2024-04-26T17:55:37.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.303+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f021800f450 con 0x7f0228102320 2024-04-26T17:55:37.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.303+0000 7f021e7fc700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 0x7f02140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:37.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.304+0000 7f022cc17700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 0x7f02140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:37.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.304+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f02180cfff0 con 0x7f0228102320 2024-04-26T17:55:37.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.304+0000 7f022cc17700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 0x7f02140a6100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02240098e0 tx=0x7f0224005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:37.309 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.309+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0218014030 con 0x7f0228102320 2024-04-26T17:55:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.564+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f022819ade0 con 0x7f0228102320 2024-04-26T17:55:37.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.564+0000 7f021e7fc700 1 -- 172.21.15.92:0/3052608359 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f021809ce70 con 0x7f0228102320 2024-04-26T17:55:37.565 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:37.565 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 msgr2=0x7f02140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 0x7f02140a6100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02240098e0 tx=0x7f0224005fb0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 msgr2=0x7f022819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f021800c9b0 tx=0x7f021800cd70 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 shutdown_connections 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f02140a3c40 0x7f02140a6100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0228108390 0x7f02281998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0228102320 0x7f022819f6f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 --2- 172.21.15.92:0/3052608359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0228102ce0 0x7f022819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 >> 172.21.15.92:0/3052608359 conn(0x7f02280792d0 msgr2=0x7f0228101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 shutdown_connections 2024-04-26T17:55:37.567 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:37.566+0000 7f022f67c700 1 -- 172.21.15.92:0/3052608359 wait complete. 2024-04-26T17:55:37.568 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 3 2024-04-26T17:55:37.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:37 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3052608359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:38.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:37 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3052608359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:38.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:37 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3052608359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:38.812 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:38 smithi092 ceph-mon[29156]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:39.016 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:38 smithi189 ceph-mon[32756]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:38 smithi156 ceph-mon[32679]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:39.493 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 17:55:39 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: Deploying daemon mds.d on smithi092 2024-04-26T17:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:boot 2024-04-26T17:55:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: fsmap 3 up:standby 2024-04-26T17:55:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:40 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: Deploying daemon mds.d on smithi092 2024-04-26T17:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:boot 2024-04-26T17:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: fsmap 3 up:standby 2024-04-26T17:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:40 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:55:40.522 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: Deploying daemon mds.d on smithi092 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:boot 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: fsmap 3 up:standby 2024-04-26T17:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:40 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:55:40.867 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:42.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:42 smithi092 ceph-mon[29156]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- 172.21.15.92:0/2359117385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 msgr2=0x7f5824102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 --2- 172.21.15.92:0/2359117385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f5824102790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5814009990 tx=0x7f5814009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- 172.21.15.92:0/2359117385 shutdown_connections 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 --2- 172.21.15.92:0/2359117385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 0x7f582410f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 --2- 172.21.15.92:0/2359117385 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5824108380 0x7f5824108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 --2- 172.21.15.92:0/2359117385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f5824102790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- 172.21.15.92:0/2359117385 >> 172.21.15.92:0/2359117385 conn(0x7f5824079290 msgr2=0x7f58240796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:42.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- 172.21.15.92:0/2359117385 shutdown_connections 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- 172.21.15.92:0/2359117385 wait complete. 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 Processor -- start 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.927+0000 7f582bfab700 1 -- start start 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 0x7f582419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5824108380 0x7f5824199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58241125a0 con 0x7f5824102310 2024-04-26T17:55:42.930 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5824112420 con 0x7f5824102cd0 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5824112720 con 0x7f5824108380 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39782/0 (socket says 172.21.15.92:39782) 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 -- 172.21.15.92:0/3124050591 learned_addr learned my addr 172.21.15.92:0/3124050591 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829546700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 0x7f582419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 -- 172.21.15.92:0/3124050591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5824108380 msgr2=0x7f5824199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5824108380 0x7f5824199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 -- 172.21.15.92:0/3124050591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 msgr2=0x7f582419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 0x7f582419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 -- 172.21.15.92:0/3124050591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582419a190 con 0x7f5824102310 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f5829d47700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f582000b530 tx=0x7f582000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820015020 con 0x7f5824102310 2024-04-26T17:55:42.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5820011ce0 con 0x7f5824102310 2024-04-26T17:55:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582419a480 con 0x7f5824102310 2024-04-26T17:55:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820010d20 con 0x7f5824102310 2024-04-26T17:55:42.932 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.928+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241a6740 con 0x7f5824102310 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.929+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582406a110 con 0x7f5824102310 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.930+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5820018020 con 0x7f5824102310 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.931+0000 7f581affd700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 0x7f58100a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.931+0000 7f5829546700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 0x7f58100a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.931+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f58200cf780 con 0x7f5824102310 2024-04-26T17:55:42.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.931+0000 7f5829546700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 0x7f58100a6180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5814006010 tx=0x7f581401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:42 smithi156 ceph-mon[32679]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:42.935 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:42.936+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f582001f020 con 0x7f5824102310 2024-04-26T17:55:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:42 smithi189 ceph-mon[32756]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:43.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.187+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f582419af60 con 0x7f5824102310 2024-04-26T17:55:43.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.188+0000 7f581affd700 1 -- 172.21.15.92:0/3124050591 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7f582009c600 con 0x7f5824102310 2024-04-26T17:55:43.188 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:43.188 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T17:55:43.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 msgr2=0x7f58100a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:43.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 0x7f58100a6180 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5814006010 tx=0x7f581401a040 comp rx=0 tx=0).stop 2024-04-26T17:55:43.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 msgr2=0x7f582419f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:43.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f582000b530 tx=0x7f582000b8f0 comp rx=0 tx=0).stop 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 shutdown_connections 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58100a3cc0 0x7f58100a6180 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5824108380 0x7f5824199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5824102310 0x7f582419f870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 --2- 172.21.15.92:0/3124050591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5824102cd0 0x7f582419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 >> 172.21.15.92:0/3124050591 conn(0x7f5824079290 msgr2=0x7f58241065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 shutdown_connections 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:43.190+0000 7f582bfab700 1 -- 172.21.15.92:0/3124050591 wait complete. 2024-04-26T17:55:43.191 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 4 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3124050591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:43 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3124050591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:43 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3124050591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:43 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:44 smithi156 ceph-mon[32679]: Deploying daemon mds.e on smithi156 2024-04-26T17:55:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:44 smithi156 ceph-mon[32679]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:44 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:boot 2024-04-26T17:55:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:44 smithi156 ceph-mon[32679]: fsmap 4 up:standby 2024-04-26T17:55:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:44 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:55:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:44 smithi092 ceph-mon[29156]: Deploying daemon mds.e on smithi156 2024-04-26T17:55:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:44 smithi092 ceph-mon[29156]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:44 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:boot 2024-04-26T17:55:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:44 smithi092 ceph-mon[29156]: fsmap 4 up:standby 2024-04-26T17:55:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:44 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:55:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:44 smithi189 ceph-mon[32756]: Deploying daemon mds.e on smithi156 2024-04-26T17:55:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:44 smithi189 ceph-mon[32756]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:44 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:boot 2024-04-26T17:55:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:44 smithi189 ceph-mon[32756]: fsmap 4 up:standby 2024-04-26T17:55:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:44 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:55:45.683 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:45 smithi156 systemd[1]: Starting Ceph mds.e for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:45.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:46.008 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:45 smithi156 podman[62435]: 2024-04-26 17:55:45.754785196 +0000 UTC m=+0.115054364 container create 9c393594945bed36549a615ec30724e98f4b6fecacda92f2b5fd3c9fcd0ac912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T17:55:46.008 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:45 smithi156 podman[62435]: 2024-04-26 17:55:45.657931604 +0000 UTC m=+0.018200743 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:46.008 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:45 smithi156 podman[62435]: 2024-04-26 17:55:45.982504559 +0000 UTC m=+0.342773684 container init 9c393594945bed36549a615ec30724e98f4b6fecacda92f2b5fd3c9fcd0ac912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T17:55:46.008 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:45 smithi156 podman[62435]: 2024-04-26 17:55:45.985049363 +0000 UTC m=+0.345318490 container start 9c393594945bed36549a615ec30724e98f4b6fecacda92f2b5fd3c9fcd0ac912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T17:55:46.009 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mds[62454]: -- 172.21.15.156:0/4205414313 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2c8899a40 con 0x55f2c886cc00 2024-04-26T17:55:46.115 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:46.433 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-e[62450]: starting mds.e at 2024-04-26T17:55:46.433 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:46 smithi156 bash[62435]: 9c393594945bed36549a615ec30724e98f4b6fecacda92f2b5fd3c9fcd0ac912 2024-04-26T17:55:46.433 INFO:journalctl@ceph.mds.e.smithi156.stdout:Apr 26 17:55:46 smithi156 systemd[1]: Started Ceph mds.e for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:46 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:46 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:47.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:47.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:47.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:47.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:47.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:47.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:47.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:46 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 -- 172.21.15.92:0/3552416255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c103470 msgr2=0x7f083c1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 --2- 172.21.15.92:0/3552416255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c103470 0x7f083c1038f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0830009990 tx=0x7f0830009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 -- 172.21.15.92:0/3552416255 shutdown_connections 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 --2- 172.21.15.92:0/3552416255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103e30 0x7f083c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 --2- 172.21.15.92:0/3552416255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c1094c0 0x7f083c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 --2- 172.21.15.92:0/3552416255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c103470 0x7f083c1038f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.827 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 -- 172.21.15.92:0/3552416255 >> 172.21.15.92:0/3552416255 conn(0x7f083c07a580 msgr2=0x7f083c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:47.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.827+0000 7f0842117700 1 -- 172.21.15.92:0/3552416255 shutdown_connections 2024-04-26T17:55:47.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 -- 172.21.15.92:0/3552416255 wait complete. 2024-04-26T17:55:47.828 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 Processor -- start 2024-04-26T17:55:47.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 -- start start 2024-04-26T17:55:47.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103470 0x7f083c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c103e30 0x7f083c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f083c1136b0 con 0x7f083c1094c0 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f083c113530 con 0x7f083c103470 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.828+0000 7f0842117700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f083c113830 con 0x7f083c103e30 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40742/0 (socket says 172.21.15.92:40742) 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 -- 172.21.15.92:0/1328196682 learned_addr learned my addr 172.21.15.92:0/1328196682 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083affd700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c103e30 0x7f083c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083b7fe700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103470 0x7f083c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 -- 172.21.15.92:0/1328196682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c103e30 msgr2=0x7f083c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:47.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c103e30 0x7f083c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 -- 172.21.15.92:0/1328196682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103470 msgr2=0x7f083c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103470 0x7f083c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 -- 172.21.15.92:0/1328196682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c19a3f0 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f083bfff700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f083400b970 tx=0x7f083400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083400d860 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c19a6e0 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f083400e430 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834017660 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.829+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c1a69c0 con 0x7f083c1094c0 2024-04-26T17:55:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.830+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c104b60 con 0x7f083c1094c0 2024-04-26T17:55:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.832+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f083400da00 con 0x7f083c1094c0 2024-04-26T17:55:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.833+0000 7f0838ff9700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 0x7f08240a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.833+0000 7f083b7fe700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 0x7f08240a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.833+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f08340cfd20 con 0x7f083c1094c0 2024-04-26T17:55:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.833+0000 7f083b7fe700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 0x7f08240a6100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f082c005950 tx=0x7f082c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:47.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:47.836+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0834013030 con 0x7f083c1094c0 2024-04-26T17:55:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:47 smithi092 ceph-mon[29156]: Deploying daemon mds.f on smithi189 2024-04-26T17:55:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:47 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6834/1296842780,v1:172.21.15.156:6835/1296842780] up:boot 2024-04-26T17:55:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:47 smithi092 ceph-mon[29156]: fsmap 5 up:standby 2024-04-26T17:55:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:47 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:55:48.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:47 smithi189 ceph-mon[32756]: Deploying daemon mds.f on smithi189 2024-04-26T17:55:48.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:47 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6834/1296842780,v1:172.21.15.156:6835/1296842780] up:boot 2024-04-26T17:55:48.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:47 smithi189 ceph-mon[32756]: fsmap 5 up:standby 2024-04-26T17:55:48.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:47 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:55:48.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.081+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083c19afd0 con 0x7f083c1094c0 2024-04-26T17:55:48.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.081+0000 7f0838ff9700 1 -- 172.21.15.92:0/1328196682 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7f083409cba0 con 0x7f083c1094c0 2024-04-26T17:55:48.080 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:48.081 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 msgr2=0x7f08240a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 0x7f08240a6100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f082c005950 tx=0x7f082c00a300 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 msgr2=0x7f083c199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f083400b970 tx=0x7f083400bc80 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 shutdown_connections 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f08240a3c40 0x7f08240a6100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f083c103470 0x7f083c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f083c1094c0 0x7f083c199b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 --2- 172.21.15.92:0/1328196682 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f083c103e30 0x7f083c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.083+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 >> 172.21.15.92:0/1328196682 conn(0x7f083c07a580 msgr2=0x7f083c1022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.084+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 shutdown_connections 2024-04-26T17:55:48.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:48.084+0000 7f0842117700 1 -- 172.21.15.92:0/1328196682 wait complete. 2024-04-26T17:55:48.084 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 6 2024-04-26T17:55:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:47 smithi156 ceph-mon[32679]: Deploying daemon mds.f on smithi189 2024-04-26T17:55:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:47 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6834/1296842780,v1:172.21.15.156:6835/1296842780] up:boot 2024-04-26T17:55:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:47 smithi156 ceph-mon[32679]: fsmap 5 up:standby 2024-04-26T17:55:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:47 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:55:48.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 podman[62285]: 2024-04-26 17:55:48.508289833 +0000 UTC m=+0.018227458 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:48.947 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:48 smithi189 ceph-mon[32756]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:48.947 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:48 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1328196682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:48.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 podman[62285]: 2024-04-26 17:55:48.848516454 +0000 UTC m=+0.358454075 container init fcde8f43459fedf96c132f5114d6e481533a2090edcb2a3ddff73dac52d09c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-26T17:55:48.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 podman[62285]: 2024-04-26 17:55:48.851393001 +0000 UTC m=+0.361330617 container start fcde8f43459fedf96c132f5114d6e481533a2090edcb2a3ddff73dac52d09c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T17:55:48.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 ceph-mds[62304]: -- 172.21.15.189:0/1924850647 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b628797a40 con 0x55b62876ac00 2024-04-26T17:55:48.948 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: starting mds.f at 2024-04-26T17:55:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:48 smithi092 ceph-mon[29156]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:48 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1328196682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:48 smithi156 ceph-mon[32679]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:48 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1328196682' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:49.309 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 bash[62285]: fcde8f43459fedf96c132f5114d6e481533a2090edcb2a3ddff73dac52d09c13 2024-04-26T17:55:49.309 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 17:55:48 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: Deploying daemon mds.c on smithi189 2024-04-26T17:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:boot 2024-04-26T17:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: fsmap 6 up:standby 2024-04-26T17:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:50 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:49 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: Deploying daemon mds.c on smithi189 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:boot 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: fsmap 6 up:standby 2024-04-26T17:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:50 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: Deploying daemon mds.c on smithi189 2024-04-26T17:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:boot 2024-04-26T17:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: fsmap 6 up:standby 2024-04-26T17:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:49 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:55:50.801 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:51.055 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:51.387 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:51.703 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 podman[62599]: 2024-04-26 17:55:51.320555764 +0000 UTC m=+0.017871904 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:51.703 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 podman[62599]: 2024-04-26 17:55:51.442758457 +0000 UTC m=+0.140074579 container create f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-26T17:55:51.703 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 podman[62599]: 2024-04-26 17:55:51.704059453 +0000 UTC m=+0.401375573 container init f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-26T17:55:52.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 podman[62599]: 2024-04-26 17:55:51.706896209 +0000 UTC m=+0.404212332 container start f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T17:55:52.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 ceph-mds[62619]: -- 172.21.15.189:0/1342524347 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c375eada40 con 0x55c375e80800 2024-04-26T17:55:52.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: starting mds.c at 2024-04-26T17:55:52.138 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 bash[62599]: f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 2024-04-26T17:55:52.138 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 17:55:51 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:52.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1283960689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 msgr2=0x7ff0f406b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:52.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1283960689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f406b130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009990 tx=0x7ff0ec009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1283960689 shutdown_connections 2024-04-26T17:55:52.764 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1283960689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f4105e60 0x7ff0f41062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1283960689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f406b130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1283960689 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f406b670 0x7ff0f406bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.762+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1283960689 >> 172.21.15.92:0/1283960689 conn(0x7ff0f40792d0 msgr2=0x7ff0f40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1283960689 shutdown_connections 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1283960689 wait complete. 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 Processor -- start 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- start start 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 0x7ff0f41a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4105e60 0x7ff0f41a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:52.765 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f4119be0 con 0x7ff0f4108350 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f4119a60 con 0x7ff0f406b670 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fbb45700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f4119d60 con 0x7ff0f4105e60 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fa0e2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fa0e2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40764/0 (socket says 172.21.15.92:40764) 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.763+0000 7ff0fa0e2700 1 -- 172.21.15.92:0/1114817484 learned_addr learned my addr 172.21.15.92:0/1114817484 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0f98e1700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 0x7ff0f41a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 -- 172.21.15.92:0/1114817484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4105e60 msgr2=0x7ff0f41a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:52.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4105e60 0x7ff0f41a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 -- 172.21.15.92:0/1114817484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 msgr2=0x7ff0f41a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 0x7ff0f41a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 -- 172.21.15.92:0/1114817484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f41a5080 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0f98e1700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 0x7ff0f41a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fa0e2700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400d980 tx=0x7ff0e400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4017070 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0e4009df0 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f41a5370 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40053a0 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.764+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f41acbf0 con 0x7ff0f4108350 2024-04-26T17:55:52.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.765+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f406a110 con 0x7ff0f4108350 2024-04-26T17:55:52.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.766+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7ff0e4004750 con 0x7ff0f4108350 2024-04-26T17:55:52.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.767+0000 7ff0f2ffd700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 0x7ff0dc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:52.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.767+0000 7ff0f98e1700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 0x7ff0dc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:52.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.767+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff0e40cfed0 con 0x7ff0f4108350 2024-04-26T17:55:52.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.767+0000 7ff0f98e1700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 0x7ff0dc0a6100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00b5c0 tx=0x7ff0ec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:52.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:52.771+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff0e4020020 con 0x7ff0f4108350 2024-04-26T17:55:52.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:52.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.827 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.828 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.828 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:52.828 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:52.828 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:52 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:52 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:53.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.019+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0f41ace60 con 0x7ff0f4108350 2024-04-26T17:55:53.018 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.019+0000 7ff0f2ffd700 1 -- 172.21.15.92:0/1114817484 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7ff0e409cd50 con 0x7ff0f4108350 2024-04-26T17:55:53.018 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:53.018 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-26T17:55:53.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 msgr2=0x7ff0dc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:53.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 0x7ff0dc0a6100 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00b5c0 tx=0x7ff0ec005fb0 comp rx=0 tx=0).stop 2024-04-26T17:55:53.021 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 msgr2=0x7ff0f41a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400d980 tx=0x7ff0e400dd40 comp rx=0 tx=0).stop 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 shutdown_connections 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff0dc0a3c40 0x7ff0dc0a6100 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0f406b670 0x7ff0f41a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff0f4108350 0x7ff0f41a4940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 --2- 172.21.15.92:0/1114817484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4105e60 0x7ff0f41a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 >> 172.21.15.92:0/1114817484 conn(0x7ff0f40792d0 msgr2=0x7ff0f4101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 shutdown_connections 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:53.021+0000 7ff0fbb45700 1 -- 172.21.15.92:0/1114817484 wait complete. 2024-04-26T17:55:53.022 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 8 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:52 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:53.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:53 smithi156 ceph-mon[32679]: Deploying daemon mds.h on smithi156 2024-04-26T17:55:53.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:boot 2024-04-26T17:55:53.887 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:53 smithi156 ceph-mon[32679]: fsmap 7 up:standby 2024-04-26T17:55:53.887 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:53 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:55:53.887 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:53 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1114817484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:53 smithi092 ceph-mon[29156]: Deploying daemon mds.h on smithi156 2024-04-26T17:55:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:boot 2024-04-26T17:55:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:53 smithi092 ceph-mon[29156]: fsmap 7 up:standby 2024-04-26T17:55:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:53 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:55:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:53 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1114817484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:53 smithi189 ceph-mon[32756]: Deploying daemon mds.h on smithi156 2024-04-26T17:55:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:boot 2024-04-26T17:55:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:53 smithi189 ceph-mon[32756]: fsmap 7 up:standby 2024-04-26T17:55:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:53 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:55:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:53 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1114817484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:54.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:54.578 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 podman[62744]: 2024-04-26 17:55:54.1884538 +0000 UTC m=+0.018506924 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:54.579 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 podman[62744]: 2024-04-26 17:55:54.335763083 +0000 UTC m=+0.165816179 container create 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424) 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:54 smithi156 ceph-mon[32679]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 podman[62744]: 2024-04-26 17:55:54.580187733 +0000 UTC m=+0.410240829 container init 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 podman[62744]: 2024-04-26 17:55:54.582718982 +0000 UTC m=+0.412772081 container start 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 ceph-mds[62763]: -- 172.21.15.156:0/2838664298 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc76a81a40 con 0x55fc76a54c00 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: starting mds.h at 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 bash[62744]: 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 2024-04-26T17:55:54.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 17:55:54 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:54 smithi092 ceph-mon[29156]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:54 smithi189 ceph-mon[32756]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:55.761 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:boot 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: fsmap 8 up:standby 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:55 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:56.015 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:boot 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: fsmap 8 up:standby 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:56.103 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:55 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:boot 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: fsmap 8 up:standby 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:55 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:56 smithi092 ceph-mon[29156]: Deploying daemon mds.i on smithi189 2024-04-26T17:55:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:56 smithi092 ceph-mon[29156]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:57.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:56 smithi189 ceph-mon[32756]: Deploying daemon mds.i on smithi189 2024-04-26T17:55:57.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:56 smithi189 ceph-mon[32756]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:57.124 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:56 smithi189 systemd[1]: Starting Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:55:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:56 smithi156 ceph-mon[32679]: Deploying daemon mds.i on smithi189 2024-04-26T17:55:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:56 smithi156 ceph-mon[32679]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:57.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 podman[62911]: 2024-04-26 17:55:57.027516182 +0000 UTC m=+0.018316916 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:55:57.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 podman[62911]: 2024-04-26 17:55:57.165619993 +0000 UTC m=+0.156420769 container create 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 -- 172.21.15.92:0/1577218128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 msgr2=0x7f28fc108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 --2- 172.21.15.92:0/1577218128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc108770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009990 tx=0x7f28f0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 -- 172.21.15.92:0/1577218128 shutdown_connections 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 --2- 172.21.15.92:0/1577218128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 0x7f28fc10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 --2- 172.21.15.92:0/1577218128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc108770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 --2- 172.21.15.92:0/1577218128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 0x7f28fc1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.759 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 -- 172.21.15.92:0/1577218128 >> 172.21.15.92:0/1577218128 conn(0x7f28fc0792d0 msgr2=0x7f28fc0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 -- 172.21.15.92:0/1577218128 shutdown_connections 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.731+0000 7f2902d36700 1 -- 172.21.15.92:0/1577218128 wait complete. 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 Processor -- start 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 -- start start 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 0x7f28fc19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 0x7f28fc19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc1124e0 con 0x7f28fc108390 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc112360 con 0x7f28fc102ce0 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2902d36700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc112660 con 0x7f28fc102320 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52622/0 (socket says 172.21.15.92:52622) 2024-04-26T17:55:57.760 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 -- 172.21.15.92:0/956075450 learned_addr learned my addr 172.21.15.92:0/956075450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f2900ad2700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 0x7f28fc19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f28fbfff700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 0x7f28fc19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 -- 172.21.15.92:0/956075450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 msgr2=0x7f28fc19e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 0x7f28fc19e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 -- 172.21.15.92:0/956075450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 msgr2=0x7f28fc19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 0x7f28fc19ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.732+0000 7f29012d3700 1 -- 172.21.15.92:0/956075450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc199000 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f29012d3700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007ee0 tx=0x7f28f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f400dbd0 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f400dd70 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc1992f0 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4005990 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.733+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc1a55b0 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.734+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc06a110 con 0x7f28fc108390 2024-04-26T17:55:57.761 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.735+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f28f401a020 con 0x7f28fc108390 2024-04-26T17:55:57.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.736+0000 7f28f9ffb700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 0x7f28ec0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:55:57.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.736+0000 7f2900ad2700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 0x7f28ec0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:55:57.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.736+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f28f40cfd00 con 0x7f28fc108390 2024-04-26T17:55:57.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.736+0000 7f2900ad2700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 0x7f28ec0a6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28f0006010 tx=0x7f28f000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:55:57.762 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:57.744+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f28f4010070 con 0x7f28fc108390 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 podman[62911]: 2024-04-26 17:55:57.400554911 +0000 UTC m=+0.391355645 container init 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 podman[62911]: 2024-04-26 17:55:57.403105286 +0000 UTC m=+0.393906029 container start 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 ceph-mds[62930]: -- 172.21.15.189:0/3336293935 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56531166fa40 con 0x565311642800 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: starting mds.i at 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 bash[62911]: 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 2024-04-26T17:55:57.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 17:55:57 smithi189 systemd[1]: Started Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:55:58.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.004+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28fc02e490 con 0x7f28fc108390 2024-04-26T17:55:58.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.005+0000 7f28f9ffb700 1 -- 172.21.15.92:0/956075450 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8013 (secure 0 0 0) 0x7f28f409cb80 con 0x7f28fc108390 2024-04-26T17:55:58.004 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:55:58.004 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24406,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-26T17:55:58.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 msgr2=0x7f28ec0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:58.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 0x7f28ec0a6180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28f0006010 tx=0x7f28f000b540 comp rx=0 tx=0).stop 2024-04-26T17:55:58.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 msgr2=0x7f28fc1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:55:58.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007ee0 tx=0x7f28f400d3b0 comp rx=0 tx=0).stop 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 shutdown_connections 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f28ec0a3cc0 0x7f28ec0a6180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28fc108390 0x7f28fc1988a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f28fc102320 0x7f28fc19e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 --2- 172.21.15.92:0/956075450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28fc102ce0 0x7f28fc19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 >> 172.21.15.92:0/956075450 conn(0x7f28fc0792d0 msgr2=0x7f28fc1010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 shutdown_connections 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:55:58.007+0000 7f2902d36700 1 -- 172.21.15.92:0/956075450 wait complete. 2024-04-26T17:55:58.007 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 10 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:58.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: Deploying daemon mds.g on smithi092 2024-04-26T17:55:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:boot 2024-04-26T17:55:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: fsmap 9 up:standby 2024-04-26T17:55:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:55:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:55:58 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/956075450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: Deploying daemon mds.g on smithi092 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:boot 2024-04-26T17:55:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: fsmap 9 up:standby 2024-04-26T17:55:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:55:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:55:58 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/956075450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: Deploying daemon mds.g on smithi092 2024-04-26T17:55:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:55:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:boot 2024-04-26T17:55:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: fsmap 9 up:standby 2024-04-26T17:55:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:55:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:55:58 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/956075450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:00.670 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 systemd[1]: Starting Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:56:00.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:56:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:00 smithi156 ceph-mon[32679]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:00.937 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:00 smithi092 ceph-mon[29156]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:00.938 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 podman[70748]: 2024-04-26 17:56:00.594084151 +0000 UTC m=+0.017892063 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:56:00.938 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 podman[70748]: 2024-04-26 17:56:00.700423392 +0000 UTC m=+0.124231309 container create 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T17:56:00.938 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 podman[70748]: 2024-04-26 17:56:00.938534855 +0000 UTC m=+0.362342776 container init 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T17:56:01.111 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:00 smithi189 ceph-mon[32756]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:01.234 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 podman[70748]: 2024-04-26 17:56:00.942141707 +0000 UTC m=+0.365949620 container start 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T17:56:01.234 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 ceph-mds[70798]: -- 172.21.15.92:0/1174778380 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a74967ba40 con 0x55a74964ec00 2024-04-26T17:56:01.235 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: starting mds.g at 2024-04-26T17:56:01.235 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:01 smithi092 bash[70748]: 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 2024-04-26T17:56:01.235 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 17:56:01 smithi092 systemd[1]: Started Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:56:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: Deploying daemon mds.a on smithi092 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:boot 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: fsmap 10 up:standby 2024-04-26T17:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:02 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: Deploying daemon mds.a on smithi092 2024-04-26T17:56:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:boot 2024-04-26T17:56:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: fsmap 10 up:standby 2024-04-26T17:56:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:02 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: Deploying daemon mds.a on smithi092 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:boot 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: fsmap 10 up:standby 2024-04-26T17:56:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:02 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:56:04.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 -- 172.21.15.92:0/686854840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b10101a10 msgr2=0x7f5b10101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:04.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 --2- 172.21.15.92:0/686854840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b10101a10 0x7f5b10101e70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009990 tx=0x7f5b00009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 -- 172.21.15.92:0/686854840 shutdown_connections 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 --2- 172.21.15.92:0/686854840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b101023b0 0x7f5b101102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 --2- 172.21.15.92:0/686854840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b10109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 --2- 172.21.15.92:0/686854840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b10101a10 0x7f5b10101e70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 -- 172.21.15.92:0/686854840 >> 172.21.15.92:0/686854840 conn(0x7f5b10078990 msgr2=0x7f5b100ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 -- 172.21.15.92:0/686854840 shutdown_connections 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.090+0000 7f5b177ee700 1 -- 172.21.15.92:0/686854840 wait complete. 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 Processor -- start 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 -- start start 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b10101a10 0x7f5b1019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b101997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:04.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b101135c0 con 0x7f5b101023b0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10113440 con 0x7f5b10101a10 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.091+0000 7f5b177ee700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5b10113740 con 0x7f5b101094b0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52648/0 (socket says 172.21.15.92:52648) 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 -- 172.21.15.92:0/1983872620 learned_addr learned my addr 172.21.15.92:0/1983872620 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b15d8b700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b101997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b1558a700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b10101a10 0x7f5b1019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 -- 172.21.15.92:0/1983872620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 msgr2=0x7f5b101997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b101997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 -- 172.21.15.92:0/1983872620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b10101a10 msgr2=0x7f5b1019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b10101a10 0x7f5b1019f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 -- 172.21.15.92:0/1983872620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b10199fa0 con 0x7f5b101023b0 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b15d8b700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b101997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:56:04.103 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b14d89700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b000057f0 tx=0x7f5b00003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00027070 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1019a230 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b000041c0 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00022e60 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.092+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b101a64a0 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.093+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b10104d30 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.094+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5b0002a070 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.095+0000 7f5b067fc700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 0x7f5afc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.095+0000 7f5b1558a700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 0x7f5afc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.095+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5b000d1230 con 0x7f5b101023b0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.095+0000 7f5b1558a700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 0x7f5afc0a6100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005fd0 tx=0x7f5b0c005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:04.104 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.099+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5b00013070 con 0x7f5b101023b0 2024-04-26T17:56:04.367 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.367+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b1019acf0 con 0x7f5b101023b0 2024-04-26T17:56:04.367 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:04 smithi092 podman[71191]: 2024-04-26 17:56:04.320090782 +0000 UTC m=+0.137406671 container create 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T17:56:04.368 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.367+0000 7f5b067fc700 1 -- 172.21.15.92:0/1983872620 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8839 (secure 0 0 0) 0x7f5b0009e140 con 0x7f5b101023b0 2024-04-26T17:56:04.368 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:56:04.368 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24406,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 msgr2=0x7f5afc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 0x7f5afc0a6100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c005fd0 tx=0x7f5b0c005ce0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 msgr2=0x7f5b1019fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b000057f0 tx=0x7f5b00003730 comp rx=0 tx=0).stop 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 shutdown_connections 2024-04-26T17:56:04.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5afc0a3c40 0x7f5afc0a6100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b10101a10 0x7f5b1019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5b101094b0 0x7f5b101997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 --2- 172.21.15.92:0/1983872620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b101023b0 0x7f5b1019fb80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.369+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 >> 172.21.15.92:0/1983872620 conn(0x7f5b10078990 msgr2=0x7f5b10106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.370+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 shutdown_connections 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:04.370+0000 7f5b177ee700 1 -- 172.21.15.92:0/1983872620 wait complete. 2024-04-26T17:56:04.371 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 11 2024-04-26T17:56:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:04 smithi156 ceph-mon[32679]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:04 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1983872620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:04 smithi092 ceph-mon[29156]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:04 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1983872620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:04 smithi189 ceph-mon[32756]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:04 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1983872620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:05.493 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 podman[71191]: 2024-04-26 17:56:05.203149236 +0000 UTC m=+1.020465122 container init 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux ) 2024-04-26T17:56:05.493 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 podman[71191]: 2024-04-26 17:56:05.206009135 +0000 UTC m=+1.023325021 container start 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424) 2024-04-26T17:56:05.493 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 ceph-mds[71227]: -- 172.21.15.92:0/1539339266 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564bac8b9a40 con 0x564bac88c800 2024-04-26T17:56:05.493 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: starting mds.a at 2024-04-26T17:56:05.493 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 bash[71191]: 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 2024-04-26T17:56:05.494 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 17:56:05 smithi092 systemd[1]: Started Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:56:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: Deploying daemon mds.b on smithi156 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:boot 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: fsmap 11 up:standby 2024-04-26T17:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:06 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: Deploying daemon mds.b on smithi156 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:boot 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: fsmap 11 up:standby 2024-04-26T17:56:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:06 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: Deploying daemon mds.b on smithi156 2024-04-26T17:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:boot 2024-04-26T17:56:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: fsmap 11 up:standby 2024-04-26T17:56:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:06 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:56:07.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:56:07.330 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:07.684 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:07 smithi156 systemd[1]: Starting Ceph mds.b for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T17:56:08.052 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:07 smithi156 podman[63056]: 2024-04-26 17:56:07.67533998 +0000 UTC m=+0.019202146 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T17:56:08.052 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:07 smithi156 podman[63056]: 2024-04-26 17:56:07.800207949 +0000 UTC m=+0.144070145 container create ba7b4dc6705f63bed1fb6b5c7d273ec6c4468befbeed3e7a7228b8ddf57784db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T17:56:08.052 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 podman[63056]: 2024-04-26 17:56:08.052843447 +0000 UTC m=+0.396705602 container init ba7b4dc6705f63bed1fb6b5c7d273ec6c4468befbeed3e7a7228b8ddf57784db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T17:56:08.433 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 podman[63056]: 2024-04-26 17:56:08.055930327 +0000 UTC m=+0.399792489 container start ba7b4dc6705f63bed1fb6b5c7d273ec6c4468befbeed3e7a7228b8ddf57784db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-26T17:56:08.433 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mds[63075]: -- 172.21.15.156:0/1964443340 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56470ba99a40 con 0x56470ba6d000 2024-04-26T17:56:08.433 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: starting mds.b at 2024-04-26T17:56:08.433 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 bash[63056]: ba7b4dc6705f63bed1fb6b5c7d273ec6c4468befbeed3e7a7228b8ddf57784db 2024-04-26T17:56:08.433 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:08 smithi156 systemd[1]: Started Ceph mds.b for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:08 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:08 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 -- 172.21.15.92:0/2710243807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 msgr2=0x7fb404109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/2710243807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404109880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb400009990 tx=0x7fb400009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 -- 172.21.15.92:0/2710243807 shutdown_connections 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/2710243807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406c510 0x7fb4041102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/2710243807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404109880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/2710243807 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406bb70 0x7fb40406bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 -- 172.21.15.92:0/2710243807 >> 172.21.15.92:0/2710243807 conn(0x7fb4040792f0 msgr2=0x7fb404079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 -- 172.21.15.92:0/2710243807 shutdown_connections 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.057+0000 7fb40b3a1700 1 -- 172.21.15.92:0/2710243807 wait complete. 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 Processor -- start 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 -- start start 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406bb70 0x7fb40419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406c510 0x7fb40419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb404113590 con 0x7fb4041094a0 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb404113410 con 0x7fb40406bb70 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40b3a1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb404113710 con 0x7fb40406c510 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40993e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:09.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40993e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38636/0 (socket says 172.21.15.92:38636) 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40993e700 1 -- 172.21.15.92:0/1511119618 learned_addr learned my addr 172.21.15.92:0/1511119618 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40893c700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406c510 0x7fb40419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40913d700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406bb70 0x7fb40419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.058+0000 7fb40993e700 1 -- 172.21.15.92:0/1511119618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406c510 msgr2=0x7fb40419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40993e700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406c510 0x7fb40419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40993e700 1 -- 172.21.15.92:0/1511119618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406bb70 msgr2=0x7fb40419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40993e700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406bb70 0x7fb40419f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40993e700 1 -- 172.21.15.92:0/1511119618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404199ff0 con 0x7fb4041094a0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40993e700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00a390 tx=0x7fb3fc00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc01d070 con 0x7fb4041094a0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419a2e0 con 0x7fb4041094a0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3fc00ae50 con 0x7fb4041094a0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc017720 con 0x7fb4041094a0 2024-04-26T17:56:09.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.059+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb404102350 con 0x7fb4041094a0 2024-04-26T17:56:09.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.060+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404104b50 con 0x7fb4041094a0 2024-04-26T17:56:09.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.061+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fb3fc020070 con 0x7fb4041094a0 2024-04-26T17:56:09.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.061+0000 7fb3fa7fc700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 0x7fb3f00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:09.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.061+0000 7fb40913d700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 0x7fb3f00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:09.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.062+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fb3fc0d32b0 con 0x7fb4041094a0 2024-04-26T17:56:09.063 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.062+0000 7fb40913d700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 0x7fb3f00a6100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb400005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:09.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.066+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb3fc0a0130 con 0x7fb4041094a0 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:08 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.352+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb40402e490 con 0x7fb4041094a0 2024-04-26T17:56:09.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.353+0000 7fb3fa7fc700 1 -- 172.21.15.92:0/1511119618 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10494 (secure 0 0 0) 0x7fb3fc09fa30 con 0x7fb4041094a0 2024-04-26T17:56:09.354 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:56:09.354 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24406,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-04-26T17:56:09.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 msgr2=0x7fb3f00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 0x7fb3f00a6100 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb4000098e0 tx=0x7fb400005960 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 msgr2=0x7fb404199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00a390 tx=0x7fb3fc00a6a0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 shutdown_connections 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb3f00a3c40 0x7fb3f00a6100 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb40406bb70 0x7fb40419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4041094a0 0x7fb404199810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 --2- 172.21.15.92:0/1511119618 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb40406c510 0x7fb40419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 >> 172.21.15.92:0/1511119618 conn(0x7fb4040792f0 msgr2=0x7fb4041003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 shutdown_connections 2024-04-26T17:56:09.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:09.355+0000 7fb40b3a1700 1 -- 172.21.15.92:0/1511119618 wait complete. 2024-04-26T17:56:09.357 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 13 2024-04-26T17:56:09.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:boot 2024-04-26T17:56:09.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:09 smithi156 ceph-mon[32679]: fsmap 12 up:standby 2024-04-26T17:56:09.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:09 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:56:09.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:09 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1511119618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:boot 2024-04-26T17:56:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:09 smithi092 ceph-mon[29156]: fsmap 12 up:standby 2024-04-26T17:56:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:09 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:56:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:09 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1511119618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:boot 2024-04-26T17:56:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:09 smithi189 ceph-mon[32756]: fsmap 12 up:standby 2024-04-26T17:56:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:09 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:56:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:09 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1511119618' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:56:10.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-04-26T17:56:10.635 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:10 smithi092 ceph-mon[29156]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:10 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:10 smithi189 ceph-mon[32756]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:10 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:10 smithi156 ceph-mon[32679]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:10 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:12.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- 172.21.15.92:0/349615348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c103ea0 msgr2=0x7f575c1102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:12.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 --2- 172.21.15.92:0/349615348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c103ea0 0x7f575c1102c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f575400b0a0 tx=0x7f575400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- 172.21.15.92:0/349615348 shutdown_connections 2024-04-26T17:56:12.369 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 --2- 172.21.15.92:0/349615348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c109480 0x7f575c109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 --2- 172.21.15.92:0/349615348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c103ea0 0x7f575c1102c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 --2- 172.21.15.92:0/349615348 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c1034e0 0x7f575c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- 172.21.15.92:0/349615348 >> 172.21.15.92:0/349615348 conn(0x7f575c07a5e0 msgr2=0x7f575c07a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:12.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- 172.21.15.92:0/349615348 shutdown_connections 2024-04-26T17:56:12.370 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- 172.21.15.92:0/349615348 wait complete. 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 Processor -- start 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.369+0000 7f5763626700 1 -- start start 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c1034e0 0x7f575c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c103ea0 0x7f575c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113620 con 0x7f575c109480 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1134a0 con 0x7f575c1034e0 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1137a0 con 0x7f575c103ea0 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38650/0 (socket says 172.21.15.92:38650) 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 -- 172.21.15.92:0/865549089 learned_addr learned my addr 172.21.15.92:0/865549089 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f57613c2700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c1034e0 0x7f575c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:12.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5760bc1700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c103ea0 0x7f575c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 -- 172.21.15.92:0/865549089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c103ea0 msgr2=0x7f575c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c103ea0 0x7f575c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 -- 172.21.15.92:0/865549089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c1034e0 msgr2=0x7f575c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c1034e0 0x7f575c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 -- 172.21.15.92:0/865549089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c19a020 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5761bc3700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57540062a0 tx=0x7f5754004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754021070 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5754007c80 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c19a2b0 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575401d450 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.370+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c1a65d0 con 0x7f575c109480 2024-04-26T17:56:12.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.371+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c06a110 con 0x7f575c109480 2024-04-26T17:56:12.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.373+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f5754004000 con 0x7f575c109480 2024-04-26T17:56:12.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.373+0000 7f57527fc700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 0x7f57480a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:12.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.373+0000 7f57613c2700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 0x7f57480a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:12.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.373+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f575400f020 con 0x7f575c109480 2024-04-26T17:56:12.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.374+0000 7f57613c2700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 0x7f57480a6180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5758005950 tx=0x7f575800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:12.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.377+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f575402a020 con 0x7f575c109480 2024-04-26T17:56:12.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.621+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f575c02e490 con 0x7f575c109480 2024-04-26T17:56:12.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.624+0000 7f57527fc700 1 -- 172.21.15.92:0/865549089 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f575409e8b0 con 0x7f575c109480 2024-04-26T17:56:12.625 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:56:12.625 INFO:teuthology.orchestra.run.smithi092.stdout:[ 2024-04-26T17:56:12.625 INFO:teuthology.orchestra.run.smithi092.stdout: { 2024-04-26T17:56:12.625 INFO:teuthology.orchestra.run.smithi092.stdout: "poolnum": 1, 2024-04-26T17:56:12.625 INFO:teuthology.orchestra.run.smithi092.stdout: "poolname": ".mgr" 2024-04-26T17:56:12.626 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T17:56:12.626 INFO:teuthology.orchestra.run.smithi092.stdout:] 2024-04-26T17:56:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 msgr2=0x7f57480a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 0x7f57480a6180 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5758005950 tx=0x7f575800a300 comp rx=0 tx=0).stop 2024-04-26T17:56:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 msgr2=0x7f575c1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:12.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f57540062a0 tx=0x7f5754004e20 comp rx=0 tx=0).stop 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 shutdown_connections 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57480a3cc0 0x7f57480a6180 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f575c1034e0 0x7f575c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f575c109480 0x7f575c1998c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 --2- 172.21.15.92:0/865549089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f575c103ea0 0x7f575c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 >> 172.21.15.92:0/865549089 conn(0x7f575c07a5e0 msgr2=0x7f575c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 shutdown_connections 2024-04-26T17:56:12.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:12.626+0000 7f5763626700 1 -- 172.21.15.92:0/865549089 wait complete. 2024-04-26T17:56:12.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:12 smithi092 ceph-mon[29156]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:12.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:12.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:12.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:12 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:12.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:12 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/865549089' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T17:56:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:12 smithi189 ceph-mon[32756]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:12 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:12 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/865549089' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T17:56:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:12 smithi156 ceph-mon[32679]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:12 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:12 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/865549089' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-26T17:56:13.326 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T17:56:13.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T17:56:13.591 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:13.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:13.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:13.961 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:13 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:13 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:14.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:13 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:14 smithi189 ceph-mon[32756]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:14 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:14 smithi156 ceph-mon[32679]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:14 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:14 smithi092 ceph-mon[29156]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:14 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 -- 172.21.15.92:0/494632659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65341034b0 msgr2=0x7f6534103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 --2- 172.21.15.92:0/494632659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65341034b0 0x7f6534103930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65280099c0 tx=0x7f6528009cd0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 -- 172.21.15.92:0/494632659 shutdown_connections 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 --2- 172.21.15.92:0/494632659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534103e70 0x7f6534110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 --2- 172.21.15.92:0/494632659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6534109550 0x7f6534109930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 --2- 172.21.15.92:0/494632659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65341034b0 0x7f6534103930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 -- 172.21.15.92:0/494632659 >> 172.21.15.92:0/494632659 conn(0x7f653407a610 msgr2=0x7f653407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 -- 172.21.15.92:0/494632659 shutdown_connections 2024-04-26T17:56:15.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.301+0000 7f6539db9700 1 -- 172.21.15.92:0/494632659 wait complete. 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 Processor -- start 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 -- start start 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65341034b0 0x7f653419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534109550 0x7f6534199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.302+0000 7f6539db9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65341136a0 con 0x7f6534103e70 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6539db9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6534113520 con 0x7f6534109550 2024-04-26T17:56:15.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6539db9700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6534113820 con 0x7f65341034b0 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50208/0 (socket says 172.21.15.92:50208) 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 -- 172.21.15.92:0/248738273 learned_addr learned my addr 172.21.15.92:0/248738273 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6533fff700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534109550 0x7f6534199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f65337fe700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65341034b0 0x7f653419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 -- 172.21.15.92:0/248738273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65341034b0 msgr2=0x7f653419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65341034b0 0x7f653419f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 -- 172.21.15.92:0/248738273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534109550 msgr2=0x7f6534199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534109550 0x7f6534199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 -- 172.21.15.92:0/248738273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653419a0c0 con 0x7f6534103e70 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6532ffd700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f652800b580 tx=0x7f65280057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528026070 con 0x7f6534103e70 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653419a350 con 0x7f6534103e70 2024-04-26T17:56:15.305 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6528003f20 con 0x7f6534103e70 2024-04-26T17:56:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652800fbb0 con 0x7f6534103e70 2024-04-26T17:56:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.303+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65341a6670 con 0x7f6534103e70 2024-04-26T17:56:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.304+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653410b9e0 con 0x7f6534103e70 2024-04-26T17:56:15.306 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.305+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f6528029070 con 0x7f6534103e70 2024-04-26T17:56:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.306+0000 7f6530ff9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 0x7f651c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.306+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f65280d1100 con 0x7f6534103e70 2024-04-26T17:56:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.306+0000 7f65337fe700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 0x7f651c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:15.307 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.307+0000 7f65337fe700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 0x7f651c0a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f653419aaa0 tx=0x7f652400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:15.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.310+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6528013070 con 0x7f6534103e70 2024-04-26T17:56:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:15.521+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f653419ae90 con 0x7f6534103e70 2024-04-26T17:56:16.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.441+0000 7f6530ff9700 1 -- 172.21.15.92:0/248738273 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f652809e010 con 0x7f6534103e70 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.443+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 msgr2=0x7f651c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.443+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 0x7f651c0a6100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f653419aaa0 tx=0x7f652400b3c0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.443+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 msgr2=0x7f653419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.443+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f652800b580 tx=0x7f65280057c0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 shutdown_connections 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f651c0a3c40 0x7f651c0a6100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6534109550 0x7f6534199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f65341034b0 0x7f653419f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 --2- 172.21.15.92:0/248738273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6534103e70 0x7f653419fce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 >> 172.21.15.92:0/248738273 conn(0x7f653407a610 msgr2=0x7f6534102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 shutdown_connections 2024-04-26T17:56:16.445 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:16.444+0000 7f6539db9700 1 -- 172.21.15.92:0/248738273 wait complete. 2024-04-26T17:56:16.446 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_metadata' created 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T17:56:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:16 smithi156 ceph-mon[32679]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T17:56:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:16 smithi092 ceph-mon[29156]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-26T17:56:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:16 smithi189 ceph-mon[32756]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:17.157 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T17:56:17.397 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T17:56:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T17:56:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:17 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:17 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/248738273' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-26T17:56:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: osdmap e82: 12 total, 12 up, 12 in 2024-04-26T17:56:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:56:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:56:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:17 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:56:18.570 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:18 smithi092 ceph-mon[29156]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T17:56:18.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:18 smithi092 ceph-mon[29156]: pgmap v293: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:18 smithi189 ceph-mon[32756]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T17:56:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:18 smithi189 ceph-mon[32756]: pgmap v293: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:18 smithi156 ceph-mon[32679]: osdmap e83: 12 total, 12 up, 12 in 2024-04-26T17:56:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:18 smithi156 ceph-mon[32679]: pgmap v293: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:19.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 -- 172.21.15.92:0/4168358730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102320 msgr2=0x7f03f01027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 --2- 172.21.15.92:0/4168358730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102320 0x7f03f01027a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009990 tx=0x7f03d8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 -- 172.21.15.92:0/4168358730 shutdown_connections 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 --2- 172.21.15.92:0/4168358730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0108390 0x7f03f0108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 --2- 172.21.15.92:0/4168358730 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0102ce0 0x7f03f010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 --2- 172.21.15.92:0/4168358730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102320 0x7f03f01027a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 -- 172.21.15.92:0/4168358730 >> 172.21.15.92:0/4168358730 conn(0x7f03f00792d0 msgr2=0x7f03f00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 -- 172.21.15.92:0/4168358730 shutdown_connections 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.140+0000 7f03f68b1700 1 -- 172.21.15.92:0/4168358730 wait complete. 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 Processor -- start 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 -- start start 2024-04-26T17:56:19.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0102320 0x7f03f019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 0x7f03f01a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0112530 con 0x7f03f0102ce0 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01123b0 con 0x7f03f0102320 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f68b1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01126b0 con 0x7f03f0108390 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50222/0 (socket says 172.21.15.92:50222) 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 -- 172.21.15.92:0/250062373 learned_addr learned my addr 172.21.15.92:0/250062373 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03f4e4e700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 0x7f03f01a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:19.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 -- 172.21.15.92:0/250062373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 msgr2=0x7f03f01a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 0x7f03f01a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.141+0000 7f03e7fff700 1 -- 172.21.15.92:0/250062373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0102320 msgr2=0x7f03f019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03effff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0102320 0x7f03f019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03e7fff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0102320 0x7f03f019a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03e7fff700 1 -- 172.21.15.92:0/250062373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f01a5ef0 con 0x7f03f0102ce0 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03f4e4e700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 0x7f03f01a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03e7fff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f03d8000c00 tx=0x7f03d80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:19.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8027070 con 0x7f03f0102ce0 2024-04-26T17:56:19.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f01a6120 con 0x7f03f0102ce0 2024-04-26T17:56:19.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d80041d0 con 0x7f03f0102ce0 2024-04-26T17:56:19.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800f460 con 0x7f03f0102ce0 2024-04-26T17:56:19.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.142+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f01a6580 con 0x7f03f0102ce0 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.143+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f006a110 con 0x7f03f0102ce0 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.144+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f03d802a070 con 0x7f03f0102ce0 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.145+0000 7f03edffb700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 0x7f03dc0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.145+0000 7f03effff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 0x7f03dc0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.145+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7497+0+0 (secure 0 0 0) 0x7f03d80d1490 con 0x7f03f0102ce0 2024-04-26T17:56:19.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.145+0000 7f03effff700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 0x7f03dc0a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f03e0005950 tx=0x7f03e0005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:19.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.149+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f03d8031070 con 0x7f03f0102ce0 2024-04-26T17:56:19.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.354+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f03f002e490 con 0x7f03f0102ce0 2024-04-26T17:56:19.457 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.457+0000 7f03edffb700 1 -- 172.21.15.92:0/250062373 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f03d8013070 con 0x7f03f0102ce0 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 msgr2=0x7f03dc0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 0x7f03dc0a6100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f03e0005950 tx=0x7f03e0005cf0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 msgr2=0x7f03f019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f03d8000c00 tx=0x7f03d80047b0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 shutdown_connections 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f03dc0a3c40 0x7f03dc0a6100 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03f0102320 0x7f03f019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03f0108390 0x7f03f01a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 --2- 172.21.15.92:0/250062373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03f0102ce0 0x7f03f019ae70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:19.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.460+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 >> 172.21.15.92:0/250062373 conn(0x7f03f00792d0 msgr2=0x7f03f0100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:19.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.461+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 shutdown_connections 2024-04-26T17:56:19.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:19.461+0000 7f03f68b1700 1 -- 172.21.15.92:0/250062373 wait complete. 2024-04-26T17:56:19.466 INFO:teuthology.orchestra.run.smithi092.stderr:pool 'cephfs_data' created 2024-04-26T17:56:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:19 smithi092 ceph-mon[29156]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T17:56:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:19 smithi092 ceph-mon[29156]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T17:56:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T17:56:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:19 smithi189 ceph-mon[32756]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T17:56:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:19 smithi189 ceph-mon[32756]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T17:56:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:19 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T17:56:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:19 smithi156 ceph-mon[32679]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-26T17:56:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:19 smithi156 ceph-mon[32679]: osdmap e84: 12 total, 12 up, 12 in 2024-04-26T17:56:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:19 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-26T17:56:20.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T17:56:20.440 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:20 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T17:56:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:20 smithi092 ceph-mon[29156]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T17:56:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:20 smithi092 ceph-mon[29156]: pgmap v296: 97 pgs: 77 unknown, 20 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:20.772 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:20 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T17:56:20.772 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:20 smithi156 ceph-mon[32679]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T17:56:20.772 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:20 smithi156 ceph-mon[32679]: pgmap v296: 97 pgs: 77 unknown, 20 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:20 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/250062373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-26T17:56:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:20 smithi189 ceph-mon[32756]: osdmap e85: 12 total, 12 up, 12 in 2024-04-26T17:56:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:20 smithi189 ceph-mon[32756]: pgmap v296: 97 pgs: 77 unknown, 20 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:21 smithi092 ceph-mon[29156]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T17:56:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:21 smithi189 ceph-mon[32756]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T17:56:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:21 smithi156 ceph-mon[32679]: osdmap e86: 12 total, 12 up, 12 in 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 -- 172.21.15.92:0/361191104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107b30 msgr2=0x7f9820101de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 --2- 172.21.15.92:0/361191104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107b30 0x7f9820101de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9810009990 tx=0x7f9810009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 -- 172.21.15.92:0/361191104 shutdown_connections 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 --2- 172.21.15.92:0/361191104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107180 0x7f9820107560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 --2- 172.21.15.92:0/361191104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98201023b0 0x7f9820102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 --2- 172.21.15.92:0/361191104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107b30 0x7f9820101de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 -- 172.21.15.92:0/361191104 >> 172.21.15.92:0/361191104 conn(0x7f9820077640 msgr2=0x7f9820077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 -- 172.21.15.92:0/361191104 shutdown_connections 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.296+0000 7f98279fd700 1 -- 172.21.15.92:0/361191104 wait complete. 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 Processor -- start 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 -- start start 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98201023b0 0x7f98201a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:22.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107b30 0x7f98201a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:22.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9820119e10 con 0x7f9820107180 2024-04-26T17:56:22.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9820119c90 con 0x7f9820107b30 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f98279fd700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9820119f90 con 0x7f98201023b0 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50234/0 (socket says 172.21.15.92:50234) 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 -- 172.21.15.92:0/3723464225 learned_addr learned my addr 172.21.15.92:0/3723464225 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 -- 172.21.15.92:0/3723464225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98201023b0 msgr2=0x7f98201a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98201023b0 0x7f98201a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9824f98700 1 -- 172.21.15.92:0/3723464225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107b30 msgr2=0x7f98201a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.297+0000 7f9825f9a700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107b30 0x7f98201a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f9824f98700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107b30 0x7f98201a4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f9824f98700 1 -- 172.21.15.92:0/3723464225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98201a52d0 con 0x7f9820107180 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f9824f98700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9810000c00 tx=0x7f98100047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810027070 con 0x7f9820107180 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98100041d0 con 0x7f9820107180 2024-04-26T17:56:22.302 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98201a5560 con 0x7f9820107180 2024-04-26T17:56:22.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981000f460 con 0x7f9820107180 2024-04-26T17:56:22.303 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.298+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98201ace40 con 0x7f9820107180 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.299+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982006b710 con 0x7f9820107180 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.300+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f981002a070 con 0x7f9820107180 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.301+0000 7f98167fc700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 0x7f980c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.301+0000 7f9825799700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 0x7f980c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.301+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7879+0+0 (secure 0 0 0) 0x7f98100d1690 con 0x7f9820107180 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.301+0000 7f9825799700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 0x7f980c0a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9820078c80 tx=0x7f981c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:22.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.305+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9810031070 con 0x7f9820107180 2024-04-26T17:56:22.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:22.550+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f98201ad080 con 0x7f9820107180 2024-04-26T17:56:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:22 smithi092 ceph-mon[29156]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T17:56:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:22 smithi092 ceph-mon[29156]: pgmap v299: 97 pgs: 20 creating+peering, 52 active+clean, 25 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:22 smithi189 ceph-mon[32756]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T17:56:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:22 smithi189 ceph-mon[32756]: pgmap v299: 97 pgs: 20 creating+peering, 52 active+clean, 25 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:22 smithi156 ceph-mon[32679]: osdmap e87: 12 total, 12 up, 12 in 2024-04-26T17:56:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:22 smithi156 ceph-mon[32679]: pgmap v299: 97 pgs: 20 creating+peering, 52 active+clean, 25 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:23.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.494+0000 7f98167fc700 1 -- 172.21.15.92:0/3723464225 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f9810013070 con 0x7f9820107180 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 msgr2=0x7f980c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 0x7f980c0a6100 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9820078c80 tx=0x7f981c006d20 comp rx=0 tx=0).stop 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 msgr2=0x7f98201a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9810000c00 tx=0x7f98100047b0 comp rx=0 tx=0).stop 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 shutdown_connections 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f980c0a3c40 0x7f980c0a6100 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9820107b30 0x7f98201a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98201023b0 0x7f98201a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:23.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 --2- 172.21.15.92:0/3723464225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9820107180 0x7f98201a0800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:23.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.498+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 >> 172.21.15.92:0/3723464225 conn(0x7f9820077640 msgr2=0x7f9820102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:23.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.499+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 shutdown_connections 2024-04-26T17:56:23.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:23.499+0000 7f98279fd700 1 -- 172.21.15.92:0/3723464225 wait complete. 2024-04-26T17:56:23.499 INFO:teuthology.orchestra.run.smithi092.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T17:56:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:23 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T17:56:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:23 smithi092 ceph-mon[29156]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T17:56:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:23 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T17:56:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:23 smithi189 ceph-mon[32756]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T17:56:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:23 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-26T17:56:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:23 smithi156 ceph-mon[32679]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-26T17:56:24.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:56:24.564 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:24.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:24 smithi092 ceph-mon[29156]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T17:56:24.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:24 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T17:56:24.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:24 smithi092 ceph-mon[29156]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T17:56:24.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:24 smithi092 ceph-mon[29156]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T17:56:24.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:24 smithi092 ceph-mon[29156]: pgmap v301: 97 pgs: 20 creating+peering, 57 active+clean, 20 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:24 smithi189 ceph-mon[32756]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T17:56:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:24 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T17:56:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:24 smithi189 ceph-mon[32756]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T17:56:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:24 smithi189 ceph-mon[32756]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T17:56:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:24 smithi189 ceph-mon[32756]: pgmap v301: 97 pgs: 20 creating+peering, 57 active+clean, 20 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:24 smithi156 ceph-mon[32679]: osdmap e88: 12 total, 12 up, 12 in 2024-04-26T17:56:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:24 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3723464225' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-26T17:56:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:24 smithi156 ceph-mon[32679]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-26T17:56:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:24 smithi156 ceph-mon[32679]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-26T17:56:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:24 smithi156 ceph-mon[32679]: pgmap v301: 97 pgs: 20 creating+peering, 57 active+clean, 20 unknown; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:25 smithi092 ceph-mon[29156]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T17:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:25 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T17:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:25 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T17:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:25 smithi092 ceph-mon[29156]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:25 smithi092 ceph-mon[29156]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:25 smithi189 ceph-mon[32756]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T17:56:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:25 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T17:56:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:25 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T17:56:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:25 smithi189 ceph-mon[32756]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:25 smithi189 ceph-mon[32756]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:25 smithi156 ceph-mon[32679]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-04-26T17:56:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:25 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T17:56:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:25 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T17:56:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:25 smithi156 ceph-mon[32679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:25 smithi156 ceph-mon[32679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:26.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 -- 172.21.15.92:0/4044839654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 msgr2=0x7faec410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:26.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 --2- 172.21.15.92:0/4044839654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec410f1d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faebc00b0a0 tx=0x7faebc00b3b0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.310 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 -- 172.21.15.92:0/4044839654 shutdown_connections 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 --2- 172.21.15.92:0/4044839654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec410f1d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 --2- 172.21.15.92:0/4044839654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4108390 0x7faec4108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 --2- 172.21.15.92:0/4044839654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4102320 0x7faec41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 -- 172.21.15.92:0/4044839654 >> 172.21.15.92:0/4044839654 conn(0x7faec40792d0 msgr2=0x7faec40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 -- 172.21.15.92:0/4044839654 shutdown_connections 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.308+0000 7faeca3de700 1 -- 172.21.15.92:0/4044839654 wait complete. 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 Processor -- start 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 -- start start 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4102320 0x7faec419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 0x7faec41998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faec41124d0 con 0x7faec4102ce0 2024-04-26T17:56:26.311 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7faec4112350 con 0x7faec4108390 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faeca3de700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faec4112650 con 0x7faec4102320 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faec37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faec37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38460/0 (socket says 172.21.15.92:38460) 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faec37fe700 1 -- 172.21.15.92:0/3518593321 learned_addr learned my addr 172.21.15.92:0/3518593321 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faec897b700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 0x7faec41998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.309+0000 7faec3fff700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4102320 0x7faec419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 -- 172.21.15.92:0/3518593321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4102320 msgr2=0x7faec419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4102320 0x7faec419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 -- 172.21.15.92:0/3518593321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 msgr2=0x7faec41998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 0x7faec41998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 -- 172.21.15.92:0/3518593321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec419a030 con 0x7faec4102ce0 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec897b700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 0x7faec41998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:56:26.312 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec37fe700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c920 tx=0x7faeb400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4007b00 con 0x7faec4102ce0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb4004ce0 con 0x7faec4102ce0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec419a320 con 0x7faec4102ce0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4005650 con 0x7faec4102ce0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.310+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41a6590 con 0x7faec4102ce0 2024-04-26T17:56:26.313 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.311+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec406a110 con 0x7faec4102ce0 2024-04-26T17:56:26.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.312+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7faeb4004750 con 0x7faec4102ce0 2024-04-26T17:56:26.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.313+0000 7faec17fa700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 0x7faeac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:26.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.313+0000 7faec3fff700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 0x7faeac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:26.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.313+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7faeb40cff00 con 0x7faec4102ce0 2024-04-26T17:56:26.314 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.313+0000 7faec3fff700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 0x7faeac0a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005fd0 tx=0x7faeb8005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:26.316 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.317+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7faeb4014030 con 0x7faec4102ce0 2024-04-26T17:56:26.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.522+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec41a6820 con 0x7faec4102ce0 2024-04-26T17:56:26.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.523+0000 7faec17fa700 1 -- 172.21.15.92:0/3518593321 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22195 (secure 0 0 0) 0x7faeb409ca30 con 0x7faec4102ce0 2024-04-26T17:56:26.523 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:56:26.523 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":88,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:22.551124+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.525+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 msgr2=0x7faeac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.525+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 0x7faeac0a6100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb8005fd0 tx=0x7faeb8005d90 comp rx=0 tx=0).stop 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.525+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 msgr2=0x7faec419fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.525+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c920 tx=0x7faeb400cce0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 shutdown_connections 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faeac0a3c40 0x7faeac0a6100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faec4108390 0x7faec41998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faec4102320 0x7faec419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 --2- 172.21.15.92:0/3518593321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faec4102ce0 0x7faec419fc00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:26.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 >> 172.21.15.92:0/3518593321 conn(0x7faec40792d0 msgr2=0x7faec4101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:26.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 shutdown_connections 2024-04-26T17:56:26.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:26.526+0000 7faeca3de700 1 -- 172.21.15.92:0/3518593321 wait complete. 2024-04-26T17:56:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:26 smithi092 ceph-mon[29156]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-26T17:56:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:26 smithi189 ceph-mon[32756]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-26T17:56:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:26 smithi156 ceph-mon[32679]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 3 op/s 2024-04-26T17:56:27.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:56:27.635 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:27 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3518593321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:27 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3518593321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:27.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:27 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3518593321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:28 smithi092 ceph-mon[29156]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:28 smithi189 ceph-mon[32756]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:28 smithi156 ceph-mon[32679]: pgmap v303: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:28.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:28 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T17:56:28.680+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T17:56:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 -- 172.21.15.92:0/2397435736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c108390 msgr2=0x7f771c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 --2- 172.21.15.92:0/2397435736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c108390 0x7f771c108770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f770c009990 tx=0x7f770c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 -- 172.21.15.92:0/2397435736 shutdown_connections 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 --2- 172.21.15.92:0/2397435736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f771c102ce0 0x7f771c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 --2- 172.21.15.92:0/2397435736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c108390 0x7f771c108770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 --2- 172.21.15.92:0/2397435736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102320 0x7f771c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 -- 172.21.15.92:0/2397435736 >> 172.21.15.92:0/2397435736 conn(0x7f771c0792d0 msgr2=0x7f771c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 -- 172.21.15.92:0/2397435736 shutdown_connections 2024-04-26T17:56:29.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.268+0000 7f7720ea5700 1 -- 172.21.15.92:0/2397435736 wait complete. 2024-04-26T17:56:29.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 Processor -- start 2024-04-26T17:56:29.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 -- start start 2024-04-26T17:56:29.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:29.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102ce0 0x7f771c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f771c108390 0x7f771c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1125b0 con 0x7f771c102320 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f771c112430 con 0x7f771c108390 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f7720ea5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f771c112730 con 0x7f771c102ce0 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f771a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f771a59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38476/0 (socket says 172.21.15.92:38476) 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.269+0000 7f771a59c700 1 -- 172.21.15.92:0/3168291407 learned_addr learned my addr 172.21.15.92:0/3168291407 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f7719d9b700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102ce0 0x7f771c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 -- 172.21.15.92:0/3168291407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102ce0 msgr2=0x7f771c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102ce0 0x7f771c19fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 -- 172.21.15.92:0/3168291407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f771c108390 msgr2=0x7f771c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f771c108390 0x7f771c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 -- 172.21.15.92:0/3168291407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c19a110 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f771a59c700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f770c000c00 tx=0x7f770c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c027070 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c19a3a0 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a66c0 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770c0041d0 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.270+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c00f460 con 0x7f771c102320 2024-04-26T17:56:29.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.271+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c06a110 con 0x7f771c102320 2024-04-26T17:56:29.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.272+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f770c02a070 con 0x7f771c102320 2024-04-26T17:56:29.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.273+0000 7f770b7fe700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 0x7f77040a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:29.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.273+0000 7f7719d9b700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 0x7f77040a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:29.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.273+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f770c0d1640 con 0x7f771c102320 2024-04-26T17:56:29.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.273+0000 7f7719d9b700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 0x7f77040a6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:29.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.276+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f770c031070 con 0x7f771c102320 2024-04-26T17:56:29.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.478+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f771c1a6890 con 0x7f771c102320 2024-04-26T17:56:29.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.480+0000 7f770b7fe700 1 -- 172.21.15.92:0/3168291407 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22195 (secure 0 0 0) 0x7f770c013070 con 0x7f771c102320 2024-04-26T17:56:29.480 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:56:29.480 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":88,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:22.551124+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 msgr2=0x7f77040a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 0x7f77040a6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7710006fd0 tx=0x7f7710008040 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 msgr2=0x7f771c19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f770c000c00 tx=0x7f770c0047b0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 shutdown_connections 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f77040a3cc0 0x7f77040a6180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f771c108390 0x7f771c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f771c102320 0x7f771c19f7f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 --2- 172.21.15.92:0/3168291407 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f771c102ce0 0x7f771c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 >> 172.21.15.92:0/3168291407 conn(0x7f771c0792d0 msgr2=0x7f771c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 shutdown_connections 2024-04-26T17:56:29.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:29.483+0000 7f7720ea5700 1 -- 172.21.15.92:0/3168291407 wait complete. 2024-04-26T17:56:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:29 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3168291407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:29 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3168291407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:29 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3168291407' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:56:30.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-04-26T17:56:30.498 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:30.762 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:30 smithi092 ceph-mon[29156]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:30 smithi189 ceph-mon[32756]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:30 smithi156 ceph-mon[32679]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-04-26T17:56:32.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 -- 172.21.15.92:0/177724062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 msgr2=0x7fa47c1140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 --2- 172.21.15.92:0/177724062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1140b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa470009990 tx=0x7fa470009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 -- 172.21.15.92:0/177724062 shutdown_connections 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 --2- 172.21.15.92:0/177724062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 0x7fa47c075a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 --2- 172.21.15.92:0/177724062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 0x7fa47c1169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 --2- 172.21.15.92:0/177724062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1140b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 -- 172.21.15.92:0/177724062 >> 172.21.15.92:0/177724062 conn(0x7fa47c07a580 msgr2=0x7fa47c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 -- 172.21.15.92:0/177724062 shutdown_connections 2024-04-26T17:56:32.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.523+0000 7fa482798700 1 -- 172.21.15.92:0/177724062 wait complete. 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 Processor -- start 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 -- start start 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 0x7fa47c1a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 0x7fa47c1a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c119be0 con 0x7fa47c075f70 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c119a60 con 0x7fa47c075650 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa482798700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c119d60 con 0x7fa47c1145f0 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa47b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa47b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38490/0 (socket says 172.21.15.92:38490) 2024-04-26T17:56:32.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa47b7fe700 1 -- 172.21.15.92:0/3330415474 learned_addr learned my addr 172.21.15.92:0/3330415474 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.524+0000 7fa47bfff700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 0x7fa47c1a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa480d35700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 0x7fa47c1a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 -- 172.21.15.92:0/3330415474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 msgr2=0x7fa47c1a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 0x7fa47c1a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 -- 172.21.15.92:0/3330415474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 msgr2=0x7fa47c1a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 0x7fa47c1a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 -- 172.21.15.92:0/3330415474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47c1a5140 con 0x7fa47c075f70 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa47b7fe700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa4700047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470027070 con 0x7fa47c075f70 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47c1a53d0 con 0x7fa47c075f70 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa470003f20 con 0x7fa47c075f70 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470022cf0 con 0x7fa47c075f70 2024-04-26T17:56:32.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.525+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47c1accb0 con 0x7fa47c075f70 2024-04-26T17:56:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.526+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47c06a110 con 0x7fa47c075f70 2024-04-26T17:56:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.528+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa47002a070 con 0x7fa47c075f70 2024-04-26T17:56:32.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.528+0000 7fa4797fa700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 0x7fa4640a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.529+0000 7fa47bfff700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 0x7fa4640a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.529+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fa4700d13a0 con 0x7fa47c075f70 2024-04-26T17:56:32.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.529+0000 7fa47bfff700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 0x7fa4640a6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa46c005950 tx=0x7fa46c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:32.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.532+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa470013070 con 0x7fa47c075f70 2024-04-26T17:56:32.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:32.779+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa47c1a1490 con 0x7fa47c075f70 2024-04-26T17:56:32.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:32 smithi092 ceph-mon[29156]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:32 smithi156 ceph-mon[32679]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:32 smithi189 ceph-mon[32756]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:33.686 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.686+0000 7fa4797fa700 1 -- 172.21.15.92:0/3330415474 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fa47009df60 con 0x7fa47c075f70 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.688+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 msgr2=0x7fa4640a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.688+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 0x7fa4640a6180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa46c005950 tx=0x7fa46c00b410 comp rx=0 tx=0).stop 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.688+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 msgr2=0x7fa47c1a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.688+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa4700047b0 comp rx=0 tx=0).stop 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 shutdown_connections 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa4640a3cc0 0x7fa4640a6180 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa47c075650 0x7fa47c1a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa47c1145f0 0x7fa47c1a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:33.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 --2- 172.21.15.92:0/3330415474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa47c075f70 0x7fa47c1a0670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:33.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 >> 172.21.15.92:0/3330415474 conn(0x7fa47c07a580 msgr2=0x7fa47c110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:33.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 shutdown_connections 2024-04-26T17:56:33.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:33.689+0000 7fa482798700 1 -- 172.21.15.92:0/3330415474 wait complete. 2024-04-26T17:56:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:33 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T17:56:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:33 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T17:56:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:33 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-26T17:56:34.489 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-26T17:56:34.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-04-26T17:56:34.733 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:34.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:34 smithi092 ceph-mon[29156]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:34 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T17:56:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:34 smithi092 ceph-mon[29156]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:34 smithi189 ceph-mon[32756]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:34 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T17:56:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:34 smithi189 ceph-mon[32756]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:34 smithi156 ceph-mon[32679]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-04-26T17:56:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:34 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3330415474' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-26T17:56:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:34 smithi156 ceph-mon[32679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 -- 172.21.15.92:0/4174394101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641034d0 msgr2=0x7fee64103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 --2- 172.21.15.92:0/4174394101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641034d0 0x7fee64103950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0099c0 tx=0x7fee4c009cd0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 -- 172.21.15.92:0/4174394101 shutdown_connections 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 --2- 172.21.15.92:0/4174394101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 0x7fee64110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 --2- 172.21.15.92:0/4174394101 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641083b0 0x7fee64108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 --2- 172.21.15.92:0/4174394101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641034d0 0x7fee64103950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 -- 172.21.15.92:0/4174394101 >> 172.21.15.92:0/4174394101 conn(0x7fee6407a580 msgr2=0x7fee6407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 -- 172.21.15.92:0/4174394101 shutdown_connections 2024-04-26T17:56:36.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.499+0000 7fee6978a700 1 -- 172.21.15.92:0/4174394101 wait complete. 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 Processor -- start 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 -- start start 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641034d0 0x7fee6419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 0x7fee6419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee641136a0 con 0x7fee641083b0 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fee64113520 con 0x7fee64103e90 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee6978a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee64113820 con 0x7fee641034d0 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53766/0 (socket says 172.21.15.92:53766) 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 -- 172.21.15.92:0/3409961822 learned_addr learned my addr 172.21.15.92:0/3409961822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee62ffd700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641034d0 0x7fee6419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:36.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee5bfff700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 0x7fee6419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 -- 172.21.15.92:0/3409961822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641034d0 msgr2=0x7fee6419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641034d0 0x7fee6419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 -- 172.21.15.92:0/3409961822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 msgr2=0x7fee6419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 0x7fee6419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.500+0000 7fee637fe700 1 -- 172.21.15.92:0/3409961822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6419a040 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee637fe700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00b9e0 tx=0x7fee5c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00d820 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6419a330 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee5c015420 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c014610 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.501+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee641a65f0 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.502+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6406a110 con 0x7fee641083b0 2024-04-26T17:56:36.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.503+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fee5c0147b0 con 0x7fee641083b0 2024-04-26T17:56:36.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.503+0000 7fee60ff9700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 0x7fee500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:36.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.503+0000 7fee62ffd700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 0x7fee500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:36.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.503+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fee5c0cfb00 con 0x7fee641083b0 2024-04-26T17:56:36.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.504+0000 7fee62ffd700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 0x7fee500a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee6419aa20 tx=0x7fee5400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:36.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.508+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fee5c09c630 con 0x7fee641083b0 2024-04-26T17:56:36.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:36.754+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fee6419ae40 con 0x7fee641083b0 2024-04-26T17:56:36.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:36 smithi092 ceph-mon[29156]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T17:56:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:36 smithi189 ceph-mon[32756]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T17:56:37.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:36 smithi156 ceph-mon[32679]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-26T17:56:37.705 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.705+0000 7fee60ff9700 1 -- 172.21.15.92:0/3409961822 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fee6419ae40 con 0x7fee641083b0 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 msgr2=0x7fee500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 0x7fee500a6100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fee6419aa20 tx=0x7fee5400a380 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 msgr2=0x7fee641998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee5c00b9e0 tx=0x7fee5c00bcf0 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 shutdown_connections 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fee500a3c40 0x7fee500a6100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee641083b0 0x7fee641998e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee641034d0 0x7fee6419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 --2- 172.21.15.92:0/3409961822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee64103e90 0x7fee6419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.707+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 >> 172.21.15.92:0/3409961822 conn(0x7fee6407a580 msgr2=0x7fee64101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.708+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 shutdown_connections 2024-04-26T17:56:37.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:37.708+0000 7fee6978a700 1 -- 172.21.15.92:0/3409961822 wait complete. 2024-04-26T17:56:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:37 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T17:56:38.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:37 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T17:56:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:37 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-26T17:56:38.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-04-26T17:56:38.834 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:38.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-26T17:56:38.957 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:38 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T17:56:39.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-26T17:56:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:38 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T17:56:39.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 2 op/s 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3409961822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-26T17:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:38 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:active 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-26T17:56:39.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-26T17:56:39.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:39 smithi092 ceph-mon[29156]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T17:56:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:active 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-26T17:56:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:39 smithi189 ceph-mon[32756]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T17:56:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] up:active 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-04-26T17:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:39 smithi156 ceph-mon[32679]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.523+0000 7fa0b104a700 1 -- 172.21.15.92:0/3798070774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 msgr2=0x7fa0ac110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.523+0000 7fa0b104a700 1 --2- 172.21.15.92:0/3798070774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac110290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400b0a0 tx=0x7fa0a400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 -- 172.21.15.92:0/3798070774 shutdown_connections 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 --2- 172.21.15.92:0/3798070774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac110290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 --2- 172.21.15.92:0/3798070774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 --2- 172.21.15.92:0/3798070774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 -- 172.21.15.92:0/3798070774 >> 172.21.15.92:0/3798070774 conn(0x7fa0ac07a580 msgr2=0x7fa0ac07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:40.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 -- 172.21.15.92:0/3798070774 shutdown_connections 2024-04-26T17:56:40.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 -- 172.21.15.92:0/3798070774 wait complete. 2024-04-26T17:56:40.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 Processor -- start 2024-04-26T17:56:40.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.524+0000 7fa0b104a700 1 -- start start 2024-04-26T17:56:40.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac1135c0 con 0x7fa0ac103e30 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac113440 con 0x7fa0ac103470 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0b104a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac113740 con 0x7fa0ac1094c0 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53792/0 (socket says 172.21.15.92:53792) 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 -- 172.21.15.92:0/1853206776 learned_addr learned my addr 172.21.15.92:0/1853206776 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0ab59e700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 -- 172.21.15.92:0/1853206776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 msgr2=0x7fa0ac0761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac0761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 -- 172.21.15.92:0/1853206776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 msgr2=0x7fa0ac075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 -- 172.21.15.92:0/1853206776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac1a7f60 con 0x7fa0ac103e30 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0ab59e700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac0761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aad9d700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa0aa59c700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000e9a0 tx=0x7fa0a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.525+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000cbd0 con 0x7fa0ac103e30 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.526+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ac1a8250 con 0x7fa0ac103e30 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.526+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a000cd70 con 0x7fa0ac103e30 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.526+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0018680 con 0x7fa0ac103e30 2024-04-26T17:56:40.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.526+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ac1a8790 con 0x7fa0ac103e30 2024-04-26T17:56:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.527+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ac06a110 con 0x7fa0ac103e30 2024-04-26T17:56:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.528+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa0a0010430 con 0x7fa0ac103e30 2024-04-26T17:56:40.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.528+0000 7fa093fff700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 0x7fa0940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.529+0000 7fa0aad9d700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 0x7fa0940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.529+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fa0a00d0540 con 0x7fa0ac103e30 2024-04-26T17:56:40.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.529+0000 7fa0aad9d700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 0x7fa0940a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00afa0 tx=0x7fa09c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:40.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.533+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa0a009d070 con 0x7fa0ac103e30 2024-04-26T17:56:40.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:40.781+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa0ac02e490 con 0x7fa0ac103e30 2024-04-26T17:56:40.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:40 smithi092 ceph-mon[29156]: pgmap v309: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-26T17:56:40.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:active 2024-04-26T17:56:40.782 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:40 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:40 smithi189 ceph-mon[32756]: pgmap v309: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-26T17:56:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:active 2024-04-26T17:56:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:40 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:40 smithi156 ceph-mon[32679]: pgmap v309: 97 pgs: 97 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-26T17:56:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] up:active 2024-04-26T17:56:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:40 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.733+0000 7fa093fff700 1 -- 172.21.15.92:0/1853206776 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fa0a009c970 con 0x7fa0ac103e30 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 msgr2=0x7fa0940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 0x7fa0940a6100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00afa0 tx=0x7fa09c00a380 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 msgr2=0x7fa0ac075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000e9a0 tx=0x7fa0a000ecb0 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 shutdown_connections 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa0940a3c40 0x7fa0940a6100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0ac103470 0x7fa0ac075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac1094c0 0x7fa0ac0761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 --2- 172.21.15.92:0/1853206776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0ac103e30 0x7fa0ac075c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 >> 172.21.15.92:0/1853206776 conn(0x7fa0ac07a580 msgr2=0x7fa0ac101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 shutdown_connections 2024-04-26T17:56:41.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:41.736+0000 7fa0b104a700 1 -- 172.21.15.92:0/1853206776 wait complete. 2024-04-26T17:56:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:41 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T17:56:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:41 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T17:56:42.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:41 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-26T17:56:42.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-04-26T17:56:42.796 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:42.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:42 smithi092 ceph-mon[29156]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:42.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:42 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T17:56:42.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:42.918 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:42 smithi189 ceph-mon[32756]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:42 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T17:56:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:43.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:42 smithi156 ceph-mon[32679]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:42 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1853206776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-26T17:56:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-04-26T17:56:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:43.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 17:56:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T17:56:43.680+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T17:56:44.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 -- 172.21.15.92:0/1905004977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c48107640 msgr2=0x7f2c4810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:44.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 --2- 172.21.15.92:0/1905004977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c48107640 0x7f2c4810f210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b0d0 tx=0x7f2c4000b3e0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 -- 172.21.15.92:0/1905004977 shutdown_connections 2024-04-26T17:56:44.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 --2- 172.21.15.92:0/1905004977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c48107640 0x7f2c4810f210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 --2- 172.21.15.92:0/1905004977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c481025b0 0x7f2c48102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 --2- 172.21.15.92:0/1905004977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c48102f60 0x7f2c48106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 -- 172.21.15.92:0/1905004977 >> 172.21.15.92:0/1905004977 conn(0x7f2c480792d0 msgr2=0x7f2c480796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:44.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 -- 172.21.15.92:0/1905004977 shutdown_connections 2024-04-26T17:56:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.522+0000 7f2c503c1700 1 -- 172.21.15.92:0/1905004977 wait complete. 2024-04-26T17:56:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 Processor -- start 2024-04-26T17:56:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 -- start start 2024-04-26T17:56:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:44.528 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c48102f60 0x7f2c4819ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c48107640 0x7f2c48199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c481125f0 con 0x7f2c481025b0 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48112470 con 0x7f2c48102f60 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c503c1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48112770 con 0x7f2c48107640 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c4e15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c4e15d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47648/0 (socket says 172.21.15.92:47648) 2024-04-26T17:56:44.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.523+0000 7f2c4e15d700 1 -- 172.21.15.92:0/264897060 learned_addr learned my addr 172.21.15.92:0/264897060 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:44.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e95e700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c48107640 0x7f2c48199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:44.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 -- 172.21.15.92:0/264897060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c48107640 msgr2=0x7f2c48199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:44.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c48107640 0x7f2c48199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 -- 172.21.15.92:0/264897060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c48102f60 msgr2=0x7f2c4819ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:44.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c48102f60 0x7f2c4819ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 -- 172.21.15.92:0/264897060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4819a410 con 0x7f2c481025b0 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c4e15d700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b550 tx=0x7f2c4400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c44015020 con 0x7f2c481025b0 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c44011ce0 con 0x7f2c481025b0 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4819a700 con 0x7f2c481025b0 2024-04-26T17:56:44.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c44010d20 con 0x7f2c481025b0 2024-04-26T17:56:44.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.524+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c481a69e0 con 0x7f2c481025b0 2024-04-26T17:56:44.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.525+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c48103a40 con 0x7f2c481025b0 2024-04-26T17:56:44.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.527+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7f2c44018020 con 0x7f2c481025b0 2024-04-26T17:56:44.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.528+0000 7f2c3f7fe700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 0x7f2c340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:44.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.528+0000 7f2c4d95c700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 0x7f2c340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:44.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.528+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f2c440d0080 con 0x7f2c481025b0 2024-04-26T17:56:44.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.528+0000 7f2c4d95c700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 0x7f2c340a6100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c4819b280 tx=0x7f2c38006cd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:44.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.531+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2c4401f020 con 0x7f2c481025b0 2024-04-26T17:56:44.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:44.778+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f2c481a6bb0 con 0x7f2c481025b0 2024-04-26T17:56:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:44 smithi092 ceph-mon[29156]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:44 smithi189 ceph-mon[32756]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:44 smithi156 ceph-mon[32679]: pgmap v311: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-04-26T17:56:45.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.743+0000 7f2c3f7fe700 1 -- 172.21.15.92:0/264897060 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f2c4409cbb0 con 0x7f2c481025b0 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 msgr2=0x7f2c340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 0x7f2c340a6100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c4819b280 tx=0x7f2c38006cd0 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 msgr2=0x7f2c4819fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b550 tx=0x7f2c4400b910 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 shutdown_connections 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c340a3c40 0x7f2c340a6100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c48107640 0x7f2c48199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c481025b0 0x7f2c4819fa60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 --2- 172.21.15.92:0/264897060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c48102f60 0x7f2c4819ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 >> 172.21.15.92:0/264897060 conn(0x7f2c480792d0 msgr2=0x7f2c48108810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 shutdown_connections 2024-04-26T17:56:45.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:45.745+0000 7f2c503c1700 1 -- 172.21.15.92:0/264897060 wait complete. 2024-04-26T17:56:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:45 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T17:56:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:45 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T17:56:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:45 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-26T17:56:46.531 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-26T17:56:46.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-04-26T17:56:46.774 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:46.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:46 smithi092 ceph-mon[29156]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:46.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:46 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T17:56:46.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:46 smithi189 ceph-mon[32756]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:46 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T17:56:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:47.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:46 smithi156 ceph-mon[32679]: pgmap v312: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:46 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/264897060' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-26T17:56:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 -- 172.21.15.92:0/212720764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 msgr2=0x7fa7f006bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/212720764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f006bb30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009990 tx=0x7fa7ec009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 -- 172.21.15.92:0/212720764 shutdown_connections 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/212720764 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f0105eb0 0x7fa7f0106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/212720764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f006bb30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/212720764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f006c070 0x7fa7f006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.484 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 -- 172.21.15.92:0/212720764 >> 172.21.15.92:0/212720764 conn(0x7fa7f0078370 msgr2=0x7fa7f0078780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 -- 172.21.15.92:0/212720764 shutdown_connections 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.479+0000 7fa7f7a22700 1 -- 172.21.15.92:0/212720764 wait complete. 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 Processor -- start 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 -- start start 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f006c070 0x7fa7f01a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f0105eb0 0x7fa7f01a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0119c70 con 0x7fa7f0108440 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0119af0 con 0x7fa7f0105eb0 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f7a22700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0119df0 con 0x7fa7f006c070 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47678/0 (socket says 172.21.15.92:47678) 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 -- 172.21.15.92:0/3477518475 learned_addr learned my addr 172.21.15.92:0/3477518475 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:48.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f57be700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f006c070 0x7fa7f01a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f4fbd700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f0105eb0 0x7fa7f01a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 -- 172.21.15.92:0/3477518475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f006c070 msgr2=0x7fa7f01a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f006c070 0x7fa7f01a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 -- 172.21.15.92:0/3477518475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f0105eb0 msgr2=0x7fa7f01a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f0105eb0 0x7fa7f01a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 -- 172.21.15.92:0/3477518475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f01a5110 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.480+0000 7fa7f5fbf700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800b970 tx=0x7fa7e800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8019070 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e800cde0 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8007370 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f01a5400 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f01acd00 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.481+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f006a110 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.483+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138646+0+0 (secure 0 0 0) 0x7fa7e801c070 con 0x7fa7f0108440 2024-04-26T17:56:48.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.483+0000 7fa7e67fc700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 0x7fa7dc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:48.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.483+0000 7fa7f57be700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 0x7fa7dc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:48.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.483+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fa7e80cfe20 con 0x7fa7f0108440 2024-04-26T17:56:48.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.484+0000 7fa7f57be700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 0x7fa7dc0a6180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009750 tx=0x7fa7ec005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:48.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.487+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7e8023070 con 0x7fa7f0108440 2024-04-26T17:56:48.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.714+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa7f0101ab0 con 0x7fa7dc0a3cc0 2024-04-26T17:56:48.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.740+0000 7fa7e67fc700 1 -- 172.21.15.92:0/3477518475 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa7f0101ab0 con 0x7fa7dc0a3cc0 2024-04-26T17:56:48.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 msgr2=0x7fa7dc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 0x7fa7dc0a6180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009750 tx=0x7fa7ec005960 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 msgr2=0x7fa7f01a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800b970 tx=0x7fa7e800bc80 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 shutdown_connections 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7dc0a3cc0 0x7fa7dc0a6180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f0108440 0x7fa7f01a49d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7f006c070 0x7fa7f01a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 --2- 172.21.15.92:0/3477518475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7f0105eb0 0x7fa7f01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 >> 172.21.15.92:0/3477518475 conn(0x7fa7f0078370 msgr2=0x7fa7f01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 shutdown_connections 2024-04-26T17:56:48.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:48.742+0000 7fa7f7a22700 1 -- 172.21.15.92:0/3477518475 wait complete. 2024-04-26T17:56:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-mon[29156]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:48.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:56:48.719+0000 7f511a748700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:56:48.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:56:48.719+0000 7f511a748700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:56:48.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:56:48.719+0000 7f511a748700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:56:48.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:56:48.719+0000 7f511a748700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:56:48.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:56:48 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:56:48.719+0000 7f511a748700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:56:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:48 smithi189 ceph-mon[32756]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:48 smithi156 ceph-mon[32679]: pgmap v313: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-04-26T17:56:49.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-26T17:56:49.742 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:50.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:49 smithi092 ceph-mon[29156]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:49 smithi189 ceph-mon[32756]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:49 smithi156 ceph-mon[32679]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:50.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:50 smithi092 ceph-mon[29156]: pgmap v314: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-04-26T17:56:50.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:50 smithi092 ceph-mon[29156]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T17:56:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:50 smithi189 ceph-mon[32756]: pgmap v314: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-04-26T17:56:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:50 smithi189 ceph-mon[32756]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T17:56:51.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:50 smithi156 ceph-mon[32679]: pgmap v314: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-04-26T17:56:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:50 smithi156 ceph-mon[32679]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- 172.21.15.92:0/3833459214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 msgr2=0x7f97a4108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/3833459214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4108770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009990 tx=0x7f97a0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- 172.21.15.92:0/3833459214 shutdown_connections 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/3833459214 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102ce0 0x7f97a410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/3833459214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4108770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/3833459214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102320 0x7f97a41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- 172.21.15.92:0/3833459214 >> 172.21.15.92:0/3833459214 conn(0x7f97a40792d0 msgr2=0x7f97a40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- 172.21.15.92:0/3833459214 shutdown_connections 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- 172.21.15.92:0/3833459214 wait complete. 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 Processor -- start 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.508+0000 7f97ac1b8700 1 -- start start 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102320 0x7f97a4104000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102ce0 0x7f97a4104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4112530 con 0x7f97a4108390 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41123b0 con 0x7f97a4102ce0 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41126b0 con 0x7f97a4102320 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47708/0 (socket says 172.21.15.92:47708) 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 -- 172.21.15.92:0/2013296671 learned_addr learned my addr 172.21.15.92:0/2013296671 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:51.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97a9753700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102ce0 0x7f97a4104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97a9f54700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102320 0x7f97a4104000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 -- 172.21.15.92:0/2013296671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102320 msgr2=0x7f97a4104000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102320 0x7f97a4104000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 -- 172.21.15.92:0/2013296671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102ce0 msgr2=0x7f97a4104540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102ce0 0x7f97a4104540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 -- 172.21.15.92:0/2013296671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a41a8070 con 0x7f97a4108390 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97aa755700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b970 tx=0x7f979c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c00d860 con 0x7f97a4108390 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c00e430 con 0x7f97a4108390 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a41a8360 con 0x7f97a4108390 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.509+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c017660 con 0x7f97a4108390 2024-04-26T17:56:51.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.510+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a8850 con 0x7f97a4108390 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.511+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a406a110 con 0x7f97a4108390 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.511+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f979c00da00 con 0x7f97a4108390 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.512+0000 7f979affd700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 0x7f97900a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.512+0000 7f97a9f54700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 0x7f97900a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.512+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f979c0cfff0 con 0x7f97a4108390 2024-04-26T17:56:51.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.512+0000 7f97a9f54700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 0x7f97900a6190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97a000b5c0 tx=0x7f97a0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:51.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.517+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f979c013030 con 0x7f97a4108390 2024-04-26T17:56:51.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.751+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f97a4106120 con 0x7f97900a3cd0 2024-04-26T17:56:51.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.778+0000 7f979affd700 1 -- 172.21.15.92:0/2013296671 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f97a4106120 con 0x7f97900a3cd0 2024-04-26T17:56:51.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:51 smithi092 ceph-mon[29156]: pgmap v315: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-26T17:56:51.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 msgr2=0x7f97900a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 0x7f97900a6190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f97a000b5c0 tx=0x7f97a0005960 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 msgr2=0x7f97a4104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f979c00b970 tx=0x7f979c00bc80 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 shutdown_connections 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f97900a3cd0 0x7f97900a6190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a4108390 0x7f97a4104a80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97a4102320 0x7f97a4104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 --2- 172.21.15.92:0/2013296671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f97a4102ce0 0x7f97a4104540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:51.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 >> 172.21.15.92:0/2013296671 conn(0x7f97a40792d0 msgr2=0x7f97a41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:51.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 shutdown_connections 2024-04-26T17:56:51.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:51.781+0000 7f97ac1b8700 1 -- 172.21.15.92:0/2013296671 wait complete. 2024-04-26T17:56:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:51 smithi189 ceph-mon[32756]: pgmap v315: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-26T17:56:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:51 smithi156 ceph-mon[32679]: pgmap v315: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-26T17:56:52.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-26T17:56:52.735 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:53.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:52 smithi092 ceph-mon[29156]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:52 smithi189 ceph-mon[32756]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:52 smithi156 ceph-mon[32679]: from='client.14667 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:53 smithi092 ceph-mon[29156]: pgmap v316: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-04-26T17:56:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:53 smithi189 ceph-mon[32756]: pgmap v316: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-04-26T17:56:54.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:53 smithi156 ceph-mon[32679]: pgmap v316: 97 pgs: 97 active+clean; 588 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-04-26T17:56:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 -- 172.21.15.92:0/2140981389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17406c560 msgr2=0x7fb1741102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 --2- 172.21.15.92:0/2140981389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17406c560 0x7fb1741102e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00b0a0 tx=0x7fb16c00b3b0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 -- 172.21.15.92:0/2140981389 shutdown_connections 2024-04-26T17:56:54.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 --2- 172.21.15.92:0/2140981389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb1741094a0 0x7fb174109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 --2- 172.21.15.92:0/2140981389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb17406c560 0x7fb1741102e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 --2- 172.21.15.92:0/2140981389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 0x7fb17406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 -- 172.21.15.92:0/2140981389 >> 172.21.15.92:0/2140981389 conn(0x7fb1740792d0 msgr2=0x7fb1740796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 -- 172.21.15.92:0/2140981389 shutdown_connections 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.484+0000 7fb1797d0700 1 -- 172.21.15.92:0/2140981389 wait complete. 2024-04-26T17:56:54.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.485+0000 7fb1797d0700 1 Processor -- start 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.485+0000 7fb1797d0700 1 -- start start 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 0x7fb17419f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb17406c560 0x7fb17419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741135d0 con 0x7fb1741094a0 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb174113450 con 0x7fb17406c560 2024-04-26T17:56:54.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb174113750 con 0x7fb17406bbc0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52262/0 (socket says 172.21.15.92:52262) 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 -- 172.21.15.92:0/3731691191 learned_addr learned my addr 172.21.15.92:0/3731691191 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb172ffd700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 0x7fb17419f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1727fc700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb17406c560 0x7fb17419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 -- 172.21.15.92:0/3731691191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 msgr2=0x7fb17419f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 0x7fb17419f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 -- 172.21.15.92:0/3731691191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb17406c560 msgr2=0x7fb17419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb17406c560 0x7fb17419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 -- 172.21.15.92:0/3731691191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17419a070 con 0x7fb1741094a0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1737fe700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00b830 tx=0x7fb16c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c021070 con 0x7fb1741094a0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb16c007e30 con 0x7fb1741094a0 2024-04-26T17:56:54.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17419a300 con 0x7fb1741094a0 2024-04-26T17:56:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c004700 con 0x7fb1741094a0 2024-04-26T17:56:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.486+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741a65d0 con 0x7fb1741094a0 2024-04-26T17:56:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.487+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb17406a110 con 0x7fb1741094a0 2024-04-26T17:56:54.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.489+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb16c003d70 con 0x7fb1741094a0 2024-04-26T17:56:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.490+0000 7fb15bfff700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 0x7fb15c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.490+0000 7fb172ffd700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 0x7fb15c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.490+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fb16c00f020 con 0x7fb1741094a0 2024-04-26T17:56:54.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.490+0000 7fb172ffd700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 0x7fb15c0a6190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb164005950 tx=0x7fb16400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:54.493 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.493+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb16c02a020 con 0x7fb1741094a0 2024-04-26T17:56:54.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.726+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb174063860 con 0x7fb15c0a3cd0 2024-04-26T17:56:54.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.731+0000 7fb15bfff700 1 -- 172.21.15.92:0/3731691191 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb174063860 con 0x7fb15c0a3cd0 2024-04-26T17:56:54.731 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_0/842ec69f-f8d6-4170-8527-c0f9db0fa269 2024-04-26T17:56:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 msgr2=0x7fb15c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 0x7fb15c0a6190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb164005950 tx=0x7fb16400a300 comp rx=0 tx=0).stop 2024-04-26T17:56:54.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 msgr2=0x7fb174199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00b830 tx=0x7fb16c004ce0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 shutdown_connections 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb15c0a3cd0 0x7fb15c0a6190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1741094a0 0x7fb174199910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb17406bbc0 0x7fb17419f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 --2- 172.21.15.92:0/3731691191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb17406c560 0x7fb17419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 >> 172.21.15.92:0/3731691191 conn(0x7fb1740792d0 msgr2=0x7fb174100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 shutdown_connections 2024-04-26T17:56:54.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:54.733+0000 7fb1797d0700 1 -- 172.21.15.92:0/3731691191 wait complete. 2024-04-26T17:56:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:54 smithi092 ceph-mon[29156]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:54 smithi189 ceph-mon[32756]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:54 smithi156 ceph-mon[32679]: from='client.14673 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:55.397 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-26T17:56:55.637 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:56.030 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:55 smithi092 ceph-mon[29156]: pgmap v317: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-04-26T17:56:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:55 smithi189 ceph-mon[32756]: pgmap v317: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-04-26T17:56:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:55 smithi156 ceph-mon[32679]: pgmap v317: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-04-26T17:56:57.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 -- 172.21.15.92:0/1238165625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 msgr2=0x7f6810102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:57.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 --2- 172.21.15.92:0/1238165625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810102990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f68000099c0 tx=0x7f6800009cd0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 -- 172.21.15.92:0/1238165625 shutdown_connections 2024-04-26T17:56:57.371 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 --2- 172.21.15.92:0/1238165625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6810107640 0x7f681010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 --2- 172.21.15.92:0/1238165625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810102990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 --2- 172.21.15.92:0/1238165625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6810102f60 0x7f6810106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 -- 172.21.15.92:0/1238165625 >> 172.21.15.92:0/1238165625 conn(0x7f68100792f0 msgr2=0x7f6810079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 -- 172.21.15.92:0/1238165625 shutdown_connections 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.370+0000 7f681604d700 1 -- 172.21.15.92:0/1238165625 wait complete. 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 Processor -- start 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 -- start start 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6810102f60 0x7f681019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6810107640 0x7f681019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6810112550 con 0x7f68101025b0 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f68101123d0 con 0x7f6810102f60 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f681604d700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f68101126d0 con 0x7f6810107640 2024-04-26T17:56:57.372 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f680f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f680f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52274/0 (socket says 172.21.15.92:52274) 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.371+0000 7f680f7fe700 1 -- 172.21.15.92:0/3596734161 learned_addr learned my addr 172.21.15.92:0/3596734161 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 -- 172.21.15.92:0/3596734161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6810107640 msgr2=0x7f681019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6810107640 0x7f681019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 -- 172.21.15.92:0/3596734161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6810102f60 msgr2=0x7f681019a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6810102f60 0x7f681019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 -- 172.21.15.92:0/3596734161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681019eb50 con 0x7f68101025b0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680f7fe700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f680000b580 tx=0x7f68000047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800027070 con 0x7f68101025b0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6800004020 con 0x7f68101025b0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681019ede0 con 0x7f68101025b0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6800022e30 con 0x7f68101025b0 2024-04-26T17:56:57.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.372+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f681019f2c0 con 0x7f68101025b0 2024-04-26T17:56:57.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.373+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681006a110 con 0x7f68101025b0 2024-04-26T17:56:57.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.374+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f6800022590 con 0x7f68101025b0 2024-04-26T17:56:57.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.374+0000 7f680d7fa700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 0x7f67fc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:56:57.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.375+0000 7f6806ffd700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 0x7f67fc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:56:57.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.375+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f68000d1640 con 0x7f68101025b0 2024-04-26T17:56:57.375 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.375+0000 7f6806ffd700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 0x7f67fc0a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005fd0 tx=0x7f67f8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:56:57.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.378+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6800030070 con 0x7f68101025b0 2024-04-26T17:56:57.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.612+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6810106650 con 0x7f67fc0a3cd0 2024-04-26T17:56:57.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.644+0000 7f680d7fa700 1 -- 172.21.15.92:0/3596734161 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6810106650 con 0x7f67fc0a3cd0 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 msgr2=0x7f67fc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 0x7f67fc0a6190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005fd0 tx=0x7f67f8005f60 comp rx=0 tx=0).stop 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 msgr2=0x7f6810199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f680000b580 tx=0x7f68000047b0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 shutdown_connections 2024-04-26T17:56:57.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f67fc0a3cd0 0x7f67fc0a6190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6810107640 0x7f681019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68101025b0 0x7f6810199e00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 --2- 172.21.15.92:0/3596734161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6810102f60 0x7f681019a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 >> 172.21.15.92:0/3596734161 conn(0x7f68100792f0 msgr2=0x7f6810105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 shutdown_connections 2024-04-26T17:56:57.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:56:57.646+0000 7f681604d700 1 -- 172.21.15.92:0/3596734161 wait complete. 2024-04-26T17:56:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T17:56:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T17:56:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-04-26T17:56:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:57 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T17:56:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T17:56:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T17:56:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-04-26T17:56:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:57 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-04-26T17:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:57 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-26T17:56:58.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-26T17:56:58.593 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: pgmap v319: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-04-26T17:56:58.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:56:58 smithi092 ceph-mon[29156]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T17:56:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T17:56:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T17:56:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T17:56:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T17:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-04-26T17:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T17:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T17:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: pgmap v319: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-04-26T17:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:56:58 smithi189 ceph-mon[32756]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: osdmap e89: 12 total, 12 up, 12 in 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: pgmap v319: 97 pgs: 97 active+clean; 607 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-04-26T17:56:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:56:58 smithi156 ceph-mon[32679]: osdmap e90: 12 total, 12 up, 12 in 2024-04-26T17:57:00.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 -- 172.21.15.92:0/3260456324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc102480 msgr2=0x7facdc10e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:00.297 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 --2- 172.21.15.92:0/3260456324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc102480 0x7facdc10e990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7facd400b0a0 tx=0x7facd400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 -- 172.21.15.92:0/3260456324 shutdown_connections 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 --2- 172.21.15.92:0/3260456324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc102480 0x7facdc10e990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 --2- 172.21.15.92:0/3260456324 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc107ac0 0x7facdc107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 --2- 172.21.15.92:0/3260456324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facdc101ac0 0x7facdc101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 -- 172.21.15.92:0/3260456324 >> 172.21.15.92:0/3260456324 conn(0x7facdc078920 msgr2=0x7facdc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 -- 172.21.15.92:0/3260456324 shutdown_connections 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.296+0000 7face30b8700 1 -- 172.21.15.92:0/3260456324 wait complete. 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 Processor -- start 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 -- start start 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc102480 0x7facdc19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facdc107ac0 0x7facdc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7facdc112560 con 0x7facdc101ac0 2024-04-26T17:57:00.298 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1123e0 con 0x7facdc107ac0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face30b8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1126e0 con 0x7facdc102480 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52288/0 (socket says 172.21.15.92:52288) 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 -- 172.21.15.92:0/523799411 learned_addr learned my addr 172.21.15.92:0/523799411 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7facdbfff700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc102480 0x7facdc19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 -- 172.21.15.92:0/523799411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc102480 msgr2=0x7facdc19fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc102480 0x7facdc19fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 -- 172.21.15.92:0/523799411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facdc107ac0 msgr2=0x7facdc199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facdc107ac0 0x7facdc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 -- 172.21.15.92:0/523799411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc19a010 con 0x7facdc101ac0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.297+0000 7face0e54700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facd000d950 tx=0x7facd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.298+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0016070 con 0x7facdc101ac0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.298+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc19a300 con 0x7facdc101ac0 2024-04-26T17:57:00.299 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.298+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facd0009df0 con 0x7facdc101ac0 2024-04-26T17:57:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.298+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd000f3c0 con 0x7facdc101ac0 2024-04-26T17:57:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.298+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc1a64c0 con 0x7facdc101ac0 2024-04-26T17:57:00.300 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.299+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc103200 con 0x7facdc101ac0 2024-04-26T17:57:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.301+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7facd0019070 con 0x7facdc101ac0 2024-04-26T17:57:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.301+0000 7facd9ffb700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.301+0000 7facdbfff700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.301+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7facd00cfff0 con 0x7facdc101ac0 2024-04-26T17:57:00.301 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.301+0000 7facdbfff700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 0x7faccc0a6190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facdc100e70 tx=0x7facc800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:00.304 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.305+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7facd009c970 con 0x7facdc101ac0 2024-04-26T17:57:00.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.545+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7facdc1056c0 con 0x7faccc0a3cd0 2024-04-26T17:57:00.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.550+0000 7facd9ffb700 1 -- 172.21.15.92:0/523799411 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7facdc1056c0 con 0x7faccc0a3cd0 2024-04-26T17:57:00.550 INFO:teuthology.orchestra.run.smithi092.stdout:/volumes/qa/sv_1/a702ca5f-ce45-4990-9a25-2c6a38991d13 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 msgr2=0x7faccc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 0x7faccc0a6190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facdc100e70 tx=0x7facc800a380 comp rx=0 tx=0).stop 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 msgr2=0x7facdc19f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7facd000d950 tx=0x7facd000dc60 comp rx=0 tx=0).stop 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 shutdown_connections 2024-04-26T17:57:00.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7faccc0a3cd0 0x7faccc0a6190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7facdc107ac0 0x7facdc199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc101ac0 0x7facdc19f660 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 --2- 172.21.15.92:0/523799411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7facdc102480 0x7facdc19fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 >> 172.21.15.92:0/523799411 conn(0x7facdc078920 msgr2=0x7facdc10f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 shutdown_connections 2024-04-26T17:57:00.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:00.553+0000 7face30b8700 1 -- 172.21.15.92:0/523799411 wait complete. 2024-04-26T17:57:00.927 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:00 smithi092 ceph-mon[29156]: pgmap v321: 97 pgs: 1 activating, 96 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:00 smithi156 ceph-mon[32679]: pgmap v321: 97 pgs: 1 activating, 96 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:00 smithi189 ceph-mon[32756]: pgmap v321: 97 pgs: 1 activating, 96 active+clean; 629 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:01.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:57:01.518 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:01 smithi156 ceph-mon[32679]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:57:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:01 smithi092 ceph-mon[29156]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:57:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:01 smithi189 ceph-mon[32756]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:57:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:02 smithi156 ceph-mon[32679]: pgmap v322: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:02 smithi092 ceph-mon[29156]: pgmap v322: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:02 smithi189 ceph-mon[32756]: pgmap v322: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:03.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 -- 172.21.15.92:0/2787390426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 msgr2=0x7f2974106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:03.409 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 --2- 172.21.15.92:0/2787390426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f2974106f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f29640099c0 tx=0x7f2964009cd0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 -- 172.21.15.92:0/2787390426 shutdown_connections 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 --2- 172.21.15.92:0/2787390426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f29741025b0 0x7f2974102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 --2- 172.21.15.92:0/2787390426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2974107640 0x7f297410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 --2- 172.21.15.92:0/2787390426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f2974106f60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 -- 172.21.15.92:0/2787390426 >> 172.21.15.92:0/2787390426 conn(0x7f29740792d0 msgr2=0x7f29740796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 -- 172.21.15.92:0/2787390426 shutdown_connections 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.400+0000 7f297ad69700 1 -- 172.21.15.92:0/2787390426 wait complete. 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 Processor -- start 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 -- start start 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 0x7f297419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2974107640 0x7f2974199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:03.410 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2974112530 con 0x7f2974102f60 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f29741123b0 con 0x7f2974107640 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f297ad69700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f29741126b0 con 0x7f29741025b0 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52306/0 (socket says 172.21.15.92:52306) 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 -- 172.21.15.92:0/1308724602 learned_addr learned my addr 172.21.15.92:0/1308724602 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2978b05700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 0x7f297419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2979306700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2974107640 0x7f2974199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 -- 172.21.15.92:0/1308724602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 msgr2=0x7f297419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 0x7f297419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 -- 172.21.15.92:0/1308724602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2974107640 msgr2=0x7f2974199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2974107640 0x7f2974199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2973fff700 1 -- 172.21.15.92:0/1308724602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297419a160 con 0x7f2974102f60 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.401+0000 7f2978b05700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 0x7f297419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:03.411 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f2973fff700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2964006010 tx=0x7f29640047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964027070 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2964003f20 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f297419a3f0 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2964022cd0 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.402+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29741a6710 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.403+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297406a110 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.404+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f296402a070 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.404+0000 7f2971ffb700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 0x7f29600a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.405+0000 7f2978b05700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 0x7f29600a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.405+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f29640d1740 con 0x7f2974102f60 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.405+0000 7f2978b05700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 0x7f29600a6190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f297419ab40 tx=0x7f296c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:03.412 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.408+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2964031070 con 0x7f2974102f60 2024-04-26T17:57:03.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.653+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f297402e490 con 0x7f2974102f60 2024-04-26T17:57:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.654+0000 7f2971ffb700 1 -- 172.21.15.92:0/1308724602 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7f2964013070 con 0x7f2974102f60 2024-04-26T17:57:03.653 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 msgr2=0x7f29600a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 0x7f29600a6190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f297419ab40 tx=0x7f296c009040 comp rx=0 tx=0).stop 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 msgr2=0x7f297419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2964006010 tx=0x7f29640047b0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 shutdown_connections 2024-04-26T17:57:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f29600a3cd0 0x7f29600a6190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2974107640 0x7f2974199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f29741025b0 0x7f297419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 --2- 172.21.15.92:0/1308724602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2974102f60 0x7f297419fd80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 >> 172.21.15.92:0/1308724602 conn(0x7f29740792d0 msgr2=0x7f297406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 shutdown_connections 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:03.657+0000 7f297ad69700 1 -- 172.21.15.92:0/1308724602 wait complete. 2024-04-26T17:57:03.657 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:57:04.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:57:04.622 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:04.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:04 smithi092 ceph-mon[29156]: pgmap v323: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:04.906 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:04 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1308724602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:57:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:04 smithi156 ceph-mon[32679]: pgmap v323: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:04 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1308724602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:57:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:04 smithi189 ceph-mon[32756]: pgmap v323: 97 pgs: 1 activating, 96 active+clean; 630 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.4 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:04 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1308724602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:57:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 -- 172.21.15.92:0/1142516869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 msgr2=0x7f2aa4109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 --2- 172.21.15.92:0/1142516869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa4109880 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2a98009990 tx=0x7f2a98009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 -- 172.21.15.92:0/1142516869 shutdown_connections 2024-04-26T17:57:06.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 --2- 172.21.15.92:0/1142516869 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 0x7f2aa41102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 --2- 172.21.15.92:0/1142516869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa4109880 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 --2- 172.21.15.92:0/1142516869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 -- 172.21.15.92:0/1142516869 >> 172.21.15.92:0/1142516869 conn(0x7f2aa40792d0 msgr2=0x7f2aa40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 -- 172.21.15.92:0/1142516869 shutdown_connections 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.345+0000 7f2aaa935700 1 -- 172.21.15.92:0/1142516869 wait complete. 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 Processor -- start 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 -- start start 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa41a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 0x7f2aa41a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa4113590 con 0x7f2aa41094a0 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa4113410 con 0x7f2aa406b130 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aaa935700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa4113710 con 0x7f2aa406bad0 2024-04-26T17:57:06.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aa8ed2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aa8ed2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34164/0 (socket says 172.21.15.92:34164) 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aa8ed2700 1 -- 172.21.15.92:0/3012479174 learned_addr learned my addr 172.21.15.92:0/3012479174 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aa3fff700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa41a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.346+0000 7f2aa37fe700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 0x7f2aa41a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 -- 172.21.15.92:0/3012479174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 msgr2=0x7f2aa41a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 0x7f2aa41a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 -- 172.21.15.92:0/3012479174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 msgr2=0x7f2aa41a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa41a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 -- 172.21.15.92:0/3012479174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa410fc20 con 0x7f2aa41094a0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa3fff700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa41a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa8ed2700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007d70 tx=0x7f2a9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c016020 con 0x7f2aa41094a0 2024-04-26T17:57:06.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa410ff10 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a9c00ad40 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0115e0 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.347+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa41acbb0 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.348+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa406a110 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.349+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2a9c019020 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.349+0000 7f2aa17fa700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 0x7f2a8c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.350+0000 7f2aa3fff700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 0x7f2a8c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.350+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f2a9c0d0340 con 0x7f2aa41094a0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.350+0000 7f2aa3fff700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 0x7f2a8c0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a98006010 tx=0x7f2a9801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:06.356 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.354+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2a9c020020 con 0x7f2aa41094a0 2024-04-26T17:57:06.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.555+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2aa402e490 con 0x7f2aa41094a0 2024-04-26T17:57:06.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.556+0000 7f2aa17fa700 1 -- 172.21.15.92:0/3012479174 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22478 (secure 0 0 0) 0x7f2a9c09cdd0 con 0x7f2aa41094a0 2024-04-26T17:57:06.556 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:06.556 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":90,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:58.617254+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.558+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 msgr2=0x7f2a8c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.558+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 0x7f2a8c0a6190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a98006010 tx=0x7f2a9801a040 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.558+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 msgr2=0x7f2aa410f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.558+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007d70 tx=0x7f2a9c00a340 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 shutdown_connections 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2a8c0a3cd0 0x7f2a8c0a6190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aa406b130 0x7f2aa41a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2aa41094a0 0x7f2aa410f490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 --2- 172.21.15.92:0/3012479174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2aa406bad0 0x7f2aa41a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:06.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 >> 172.21.15.92:0/3012479174 conn(0x7f2aa40792d0 msgr2=0x7f2aa4100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:06.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 shutdown_connections 2024-04-26T17:57:06.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:06.559+0000 7f2aaa935700 1 -- 172.21.15.92:0/3012479174 wait complete. 2024-04-26T17:57:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:06 smithi156 ceph-mon[32679]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:06 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3012479174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:06 smithi092 ceph-mon[29156]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:06 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3012479174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:06 smithi189 ceph-mon[32756]: pgmap v324: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 72 B/s, 0 objects/s recovering 2024-04-26T17:57:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:06 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3012479174' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:07.278 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T17:57:07.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:57:07.518 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:08 smithi156 ceph-mon[32679]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 58 B/s, 0 objects/s recovering 2024-04-26T17:57:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:08 smithi092 ceph-mon[29156]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 58 B/s, 0 objects/s recovering 2024-04-26T17:57:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:08 smithi189 ceph-mon[32756]: pgmap v325: 97 pgs: 97 active+clean; 634 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 58 B/s, 0 objects/s recovering 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.268+0000 7fc2267a9700 1 -- 172.21.15.92:0/1236556662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc220103470 msgr2=0x7fc2201038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.268+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1236556662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc220103470 0x7fc2201038f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc214009990 tx=0x7fc214009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.268+0000 7fc2267a9700 1 -- 172.21.15.92:0/1236556662 shutdown_connections 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.268+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1236556662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 0x7fc220110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1236556662 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2201094c0 0x7fc2201098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.269 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1236556662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc220103470 0x7fc2201038f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 -- 172.21.15.92:0/1236556662 >> 172.21.15.92:0/1236556662 conn(0x7fc22007a580 msgr2=0x7fc22007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 -- 172.21.15.92:0/1236556662 shutdown_connections 2024-04-26T17:57:09.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 -- 172.21.15.92:0/1236556662 wait complete. 2024-04-26T17:57:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 Processor -- start 2024-04-26T17:57:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.269+0000 7fc2267a9700 1 -- start start 2024-04-26T17:57:09.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc220103470 0x7fc22019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 0x7fc22019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc220113640 con 0x7fc2201094c0 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201134c0 con 0x7fc220103e30 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc2267a9700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2201137c0 con 0x7fc220103470 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34186/0 (socket says 172.21.15.92:34186) 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 -- 172.21.15.92:0/1532632347 learned_addr learned my addr 172.21.15.92:0/1532632347 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc21f7fe700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 0x7fc22019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc21ffff700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc220103470 0x7fc22019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 -- 172.21.15.92:0/1532632347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc220103470 msgr2=0x7fc22019f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc220103470 0x7fc22019f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 -- 172.21.15.92:0/1532632347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 msgr2=0x7fc22019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:09.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 0x7fc22019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 -- 172.21.15.92:0/1532632347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22019a100 con 0x7fc2201094c0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.270+0000 7fc224d46700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc218007ee0 tx=0x7fc21800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.271+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21800dbd0 con 0x7fc2201094c0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.271+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc21800dd70 con 0x7fc2201094c0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.271+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218005990 con 0x7fc2201094c0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.271+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22019a3f0 con 0x7fc2201094c0 2024-04-26T17:57:09.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.271+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201a66b0 con 0x7fc2201094c0 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.272+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22006a110 con 0x7fc2201094c0 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.273+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fc21801a020 con 0x7fc2201094c0 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.274+0000 7fc21d7fa700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 0x7fc2080a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.274+0000 7fc21ffff700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 0x7fc2080a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.274+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fc2180d02e0 con 0x7fc2201094c0 2024-04-26T17:57:09.274 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.274+0000 7fc21ffff700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 0x7fc2080a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc210006fd0 tx=0x7fc210008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:09.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.278+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fc218010070 con 0x7fc2201094c0 2024-04-26T17:57:09.473 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.473+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc220063860 con 0x7fc2080a3cd0 2024-04-26T17:57:09.483 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.483+0000 7fc21d7fa700 1 -- 172.21.15.92:0/1532632347 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258887 (secure 0 0 0) 0x7fc220063860 con 0x7fc2080a3cd0 2024-04-26T17:57:09.487 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 msgr2=0x7fc2080a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 0x7fc2080a6190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc210006fd0 tx=0x7fc210008040 comp rx=0 tx=0).stop 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 msgr2=0x7fc2201999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc218007ee0 tx=0x7fc21800d3b0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 shutdown_connections 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fc2080a3cd0 0x7fc2080a6190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2201094c0 0x7fc2201999a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc220103470 0x7fc22019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 --2- 172.21.15.92:0/1532632347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220103e30 0x7fc22019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:09.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 >> 172.21.15.92:0/1532632347 conn(0x7fc22007a580 msgr2=0x7fc2201022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:09.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 shutdown_connections 2024-04-26T17:57:09.491 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:09.486+0000 7fc2267a9700 1 -- 172.21.15.92:0/1532632347 wait complete. 2024-04-26T17:57:09.491 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:57:10.196 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-04-26T17:57:07.633304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":648975,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":301,"num_read_kb":263,"num_write":340,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365332,"kb_used_data":11988,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576492,"statfs":{"total":1151940427776,"available":1151566327808,"internally_reserved":0,"allocated":12275712,"data_stored":7696329,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27544,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":58,"num_write":17,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002355"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625150+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:56:58.625150+0000","last_peered":"2024-04-26T17:56:58.625150+0000","last_clean":"2024-04-26T17:56:58.625150+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:56:58.625150+0000","last_undegraded":"2024-04-26T17:56:58.625150+0000","last_fullsized":"2024-04-26T17:56:58.625150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180964+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:56:59.180964+0000","last_peered":"2024-04-26T17:56:59.180964+0000","last_clean":"2024-04-26T17:56:59.180964+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:56:59.180964+0000","last_undegraded":"2024-04-26T17:56:59.180964+0000","last_fullsized":"2024-04-26T17:56:59.180964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180784+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:56:59.180784+0000","last_peered":"2024-04-26T17:56:59.180784+0000","last_clean":"2024-04-26T17:56:59.180784+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:56:59.180784+0000","last_undegraded":"2024-04-26T17:56:59.180784+0000","last_fullsized":"2024-04-26T17:56:59.180784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777001+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:56:58.777001+0000","last_peered":"2024-04-26T17:56:58.777001+0000","last_clean":"2024-04-26T17:56:58.777001+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:56:58.777001+0000","last_undegraded":"2024-04-26T17:56:58.777001+0000","last_fullsized":"2024-04-26T17:56:58.777001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626212+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:56:58.626212+0000","last_peered":"2024-04-26T17:56:58.626212+0000","last_clean":"2024-04-26T17:56:58.626212+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:56:58.626212+0000","last_undegraded":"2024-04-26T17:56:58.626212+0000","last_fullsized":"2024-04-26T17:56:58.626212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624995+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:56:58.624995+0000","last_peered":"2024-04-26T17:56:58.624995+0000","last_clean":"2024-04-26T17:56:58.624995+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:56:58.624995+0000","last_undegraded":"2024-04-26T17:56:58.624995+0000","last_fullsized":"2024-04-26T17:56:58.624995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.622981+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:56:58.622981+0000","last_peered":"2024-04-26T17:56:58.622981+0000","last_clean":"2024-04-26T17:56:58.622981+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:56:58.622981+0000","last_undegraded":"2024-04-26T17:56:58.622981+0000","last_fullsized":"2024-04-26T17:56:58.622981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627218+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:56:58.627218+0000","last_peered":"2024-04-26T17:56:58.627218+0000","last_clean":"2024-04-26T17:56:58.627218+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:56:58.627218+0000","last_undegraded":"2024-04-26T17:56:58.627218+0000","last_fullsized":"2024-04-26T17:56:58.627218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621734+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:56:58.621734+0000","last_peered":"2024-04-26T17:56:58.621734+0000","last_clean":"2024-04-26T17:56:58.621734+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:56:58.621734+0000","last_undegraded":"2024-04-26T17:56:58.621734+0000","last_fullsized":"2024-04-26T17:56:58.621734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625626+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:56:58.625626+0000","last_peered":"2024-04-26T17:56:58.625626+0000","last_clean":"2024-04-26T17:56:58.625626+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:56:58.625626+0000","last_undegraded":"2024-04-26T17:56:58.625626+0000","last_fullsized":"2024-04-26T17:56:58.625626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623291+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:56:58.623291+0000","last_peered":"2024-04-26T17:56:58.623291+0000","last_clean":"2024-04-26T17:56:58.623291+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:56:58.623291+0000","last_undegraded":"2024-04-26T17:56:58.623291+0000","last_fullsized":"2024-04-26T17:56:58.623291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.632207+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:56:58.632207+0000","last_peered":"2024-04-26T17:56:58.632207+0000","last_clean":"2024-04-26T17:56:58.632207+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:56:58.632207+0000","last_undegraded":"2024-04-26T17:56:58.632207+0000","last_fullsized":"2024-04-26T17:56:58.632207+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620689+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:56:58.620689+0000","last_peered":"2024-04-26T17:56:58.620689+0000","last_clean":"2024-04-26T17:56:58.620689+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:56:58.620689+0000","last_undegraded":"2024-04-26T17:56:58.620689+0000","last_fullsized":"2024-04-26T17:56:58.620689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180696+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:56:59.180696+0000","last_peered":"2024-04-26T17:56:59.180696+0000","last_clean":"2024-04-26T17:56:59.180696+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:56:59.180696+0000","last_undegraded":"2024-04-26T17:56:59.180696+0000","last_fullsized":"2024-04-26T17:56:59.180696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180596+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:56:59.180596+0000","last_peered":"2024-04-26T17:56:59.180596+0000","last_clean":"2024-04-26T17:56:59.180596+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:56:59.180596+0000","last_undegraded":"2024-04-26T17:56:59.180596+0000","last_fullsized":"2024-04-26T17:56:59.180596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621131+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:56:58.621131+0000","last_peered":"2024-04-26T17:56:58.621131+0000","last_clean":"2024-04-26T17:56:58.621131+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:56:58.621131+0000","last_undegraded":"2024-04-26T17:56:58.621131+0000","last_fullsized":"2024-04-26T17:56:58.621131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625284+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:56:58.625284+0000","last_peered":"2024-04-26T17:56:58.625284+0000","last_clean":"2024-04-26T17:56:58.625284+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:56:58.625284+0000","last_undegraded":"2024-04-26T17:56:58.625284+0000","last_fullsized":"2024-04-26T17:56:58.625284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624321+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:56:58.624321+0000","last_peered":"2024-04-26T17:56:58.624321+0000","last_clean":"2024-04-26T17:56:58.624321+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:56:58.624321+0000","last_undegraded":"2024-04-26T17:56:58.624321+0000","last_fullsized":"2024-04-26T17:56:58.624321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628050+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:56:58.628050+0000","last_peered":"2024-04-26T17:56:58.628050+0000","last_clean":"2024-04-26T17:56:58.628050+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:56:58.628050+0000","last_undegraded":"2024-04-26T17:56:58.628050+0000","last_fullsized":"2024-04-26T17:56:58.628050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.783365+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:56:58.783365+0000","last_peered":"2024-04-26T17:56:58.783365+0000","last_clean":"2024-04-26T17:56:58.783365+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:56:58.783365+0000","last_undegraded":"2024-04-26T17:56:58.783365+0000","last_fullsized":"2024-04-26T17:56:58.783365+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627718+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:56:58.627718+0000","last_peered":"2024-04-26T17:56:58.627718+0000","last_clean":"2024-04-26T17:56:58.627718+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:56:58.627718+0000","last_undegraded":"2024-04-26T17:56:58.627718+0000","last_fullsized":"2024-04-26T17:56:58.627718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627920+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:56:58.627920+0000","last_peered":"2024-04-26T17:56:58.627920+0000","last_clean":"2024-04-26T17:56:58.627920+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:56:58.627920+0000","last_undegraded":"2024-04-26T17:56:58.627920+0000","last_fullsized":"2024-04-26T17:56:58.627920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181165+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:56:59.181165+0000","last_peered":"2024-04-26T17:56:59.181165+0000","last_clean":"2024-04-26T17:56:59.181165+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:56:59.181165+0000","last_undegraded":"2024-04-26T17:56:59.181165+0000","last_fullsized":"2024-04-26T17:56:59.181165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627279+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:56:58.627279+0000","last_peered":"2024-04-26T17:56:58.627279+0000","last_clean":"2024-04-26T17:56:58.627279+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627279+0000","last_undegraded":"2024-04-26T17:56:58.627279+0000","last_fullsized":"2024-04-26T17:56:58.627279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621361+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:56:58.621361+0000","last_peered":"2024-04-26T17:56:58.621361+0000","last_clean":"2024-04-26T17:56:58.621361+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:56:58.621361+0000","last_undegraded":"2024-04-26T17:56:58.621361+0000","last_fullsized":"2024-04-26T17:56:58.621361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627192+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:56:58.627192+0000","last_peered":"2024-04-26T17:56:58.627192+0000","last_clean":"2024-04-26T17:56:58.627192+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627192+0000","last_undegraded":"2024-04-26T17:56:58.627192+0000","last_fullsized":"2024-04-26T17:56:58.627192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621757+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:56:58.621757+0000","last_peered":"2024-04-26T17:56:58.621757+0000","last_clean":"2024-04-26T17:56:58.621757+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:56:58.621757+0000","last_undegraded":"2024-04-26T17:56:58.621757+0000","last_fullsized":"2024-04-26T17:56:58.621757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:01.778555+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:57:01.778555+0000","last_peered":"2024-04-26T17:57:01.778555+0000","last_clean":"2024-04-26T17:57:01.778555+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:57:01.778555+0000","last_undegraded":"2024-04-26T17:57:01.778555+0000","last_fullsized":"2024-04-26T17:57:01.778555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626464+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:56:58.626464+0000","last_peered":"2024-04-26T17:56:58.626464+0000","last_clean":"2024-04-26T17:56:58.626464+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:56:58.626464+0000","last_undegraded":"2024-04-26T17:56:58.626464+0000","last_fullsized":"2024-04-26T17:56:58.626464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625011+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:56:58.625011+0000","last_peered":"2024-04-26T17:56:58.625011+0000","last_clean":"2024-04-26T17:56:58.625011+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:56:58.625011+0000","last_undegraded":"2024-04-26T17:56:58.625011+0000","last_fullsized":"2024-04-26T17:56:58.625011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621485+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:56:58.621485+0000","last_peered":"2024-04-26T17:56:58.621485+0000","last_clean":"2024-04-26T17:56:58.621485+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:56:58.621485+0000","last_undegraded":"2024-04-26T17:56:58.621485+0000","last_fullsized":"2024-04-26T17:56:58.621485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620515+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:56:58.620515+0000","last_peered":"2024-04-26T17:56:58.620515+0000","last_clean":"2024-04-26T17:56:58.620515+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:56:58.620515+0000","last_undegraded":"2024-04-26T17:56:58.620515+0000","last_fullsized":"2024-04-26T17:56:58.620515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627115+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:56:58.627115+0000","last_peered":"2024-04-26T17:56:58.627115+0000","last_clean":"2024-04-26T17:56:58.627115+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:56:58.627115+0000","last_undegraded":"2024-04-26T17:56:58.627115+0000","last_fullsized":"2024-04-26T17:56:58.627115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621197+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:56:58.621197+0000","last_peered":"2024-04-26T17:56:58.621197+0000","last_clean":"2024-04-26T17:56:58.621197+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:56:58.621197+0000","last_undegraded":"2024-04-26T17:56:58.621197+0000","last_fullsized":"2024-04-26T17:56:58.621197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624109+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:56:58.624109+0000","last_peered":"2024-04-26T17:56:58.624109+0000","last_clean":"2024-04-26T17:56:58.624109+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:56:58.624109+0000","last_undegraded":"2024-04-26T17:56:58.624109+0000","last_fullsized":"2024-04-26T17:56:58.624109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:02.779349+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:57:02.779349+0000","last_peered":"2024-04-26T17:57:02.779349+0000","last_clean":"2024-04-26T17:57:02.779349+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:57:02.779349+0000","last_undegraded":"2024-04-26T17:57:02.779349+0000","last_fullsized":"2024-04-26T17:57:02.779349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621654+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:56:58.621654+0000","last_peered":"2024-04-26T17:56:58.621654+0000","last_clean":"2024-04-26T17:56:58.621654+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:56:58.621654+0000","last_undegraded":"2024-04-26T17:56:58.621654+0000","last_fullsized":"2024-04-26T17:56:58.621654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623398+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:56:58.623398+0000","last_peered":"2024-04-26T17:56:58.623398+0000","last_clean":"2024-04-26T17:56:58.623398+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:56:58.623398+0000","last_undegraded":"2024-04-26T17:56:58.623398+0000","last_fullsized":"2024-04-26T17:56:58.623398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181116+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:56:59.181116+0000","last_peered":"2024-04-26T17:56:59.181116+0000","last_clean":"2024-04-26T17:56:59.181116+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:56:59.181116+0000","last_undegraded":"2024-04-26T17:56:59.181116+0000","last_fullsized":"2024-04-26T17:56:59.181116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621803+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:56:58.621803+0000","last_peered":"2024-04-26T17:56:58.621803+0000","last_clean":"2024-04-26T17:56:58.621803+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:56:58.621803+0000","last_undegraded":"2024-04-26T17:56:58.621803+0000","last_fullsized":"2024-04-26T17:56:58.621803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621365+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:56:58.621365+0000","last_peered":"2024-04-26T17:56:58.621365+0000","last_clean":"2024-04-26T17:56:58.621365+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:56:58.621365+0000","last_undegraded":"2024-04-26T17:56:58.621365+0000","last_fullsized":"2024-04-26T17:56:58.621365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'26","reported_seq":107,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:03.782043+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:57:03.782043+0000","last_peered":"2024-04-26T17:57:03.782043+0000","last_clean":"2024-04-26T17:57:03.782043+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:57:03.782043+0000","last_undegraded":"2024-04-26T17:57:03.782043+0000","last_fullsized":"2024-04-26T17:57:03.782043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54372,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":79,"num_write":27,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627072+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:56:58.627072+0000","last_peered":"2024-04-26T17:56:58.627072+0000","last_clean":"2024-04-26T17:56:58.627072+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:56:58.627072+0000","last_undegraded":"2024-04-26T17:56:58.627072+0000","last_fullsized":"2024-04-26T17:56:58.627072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627777+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:56:58.627777+0000","last_peered":"2024-04-26T17:56:58.627777+0000","last_clean":"2024-04-26T17:56:58.627777+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:56:58.627777+0000","last_undegraded":"2024-04-26T17:56:58.627777+0000","last_fullsized":"2024-04-26T17:56:58.627777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620784+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:56:58.620784+0000","last_peered":"2024-04-26T17:56:58.620784+0000","last_clean":"2024-04-26T17:56:58.620784+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:56:58.620784+0000","last_undegraded":"2024-04-26T17:56:58.620784+0000","last_fullsized":"2024-04-26T17:56:58.620784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621467+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:56:58.621467+0000","last_peered":"2024-04-26T17:56:58.621467+0000","last_clean":"2024-04-26T17:56:58.621467+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:56:58.621467+0000","last_undegraded":"2024-04-26T17:56:58.621467+0000","last_fullsized":"2024-04-26T17:56:58.621467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623152+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:56:58.623152+0000","last_peered":"2024-04-26T17:56:58.623152+0000","last_clean":"2024-04-26T17:56:58.623152+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:56:58.623152+0000","last_undegraded":"2024-04-26T17:56:58.623152+0000","last_fullsized":"2024-04-26T17:56:58.623152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:02.782306+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:57:02.782306+0000","last_peered":"2024-04-26T17:57:02.782306+0000","last_clean":"2024-04-26T17:57:02.782306+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:57:02.782306+0000","last_undegraded":"2024-04-26T17:57:02.782306+0000","last_fullsized":"2024-04-26T17:57:02.782306+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627910+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:56:58.627910+0000","last_peered":"2024-04-26T17:56:58.627910+0000","last_clean":"2024-04-26T17:56:58.627910+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:56:58.627910+0000","last_undegraded":"2024-04-26T17:56:58.627910+0000","last_fullsized":"2024-04-26T17:56:58.627910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626465+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:56:58.626465+0000","last_peered":"2024-04-26T17:56:58.626465+0000","last_clean":"2024-04-26T17:56:58.626465+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:56:58.626465+0000","last_undegraded":"2024-04-26T17:56:58.626465+0000","last_fullsized":"2024-04-26T17:56:58.626465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621381+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:56:58.621381+0000","last_peered":"2024-04-26T17:56:58.621381+0000","last_clean":"2024-04-26T17:56:58.621381+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:56:58.621381+0000","last_undegraded":"2024-04-26T17:56:58.621381+0000","last_fullsized":"2024-04-26T17:56:58.621381+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627296+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:56:58.627296+0000","last_peered":"2024-04-26T17:56:58.627296+0000","last_clean":"2024-04-26T17:56:58.627296+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:56:58.627296+0000","last_undegraded":"2024-04-26T17:56:58.627296+0000","last_fullsized":"2024-04-26T17:56:58.627296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625142+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:56:58.625142+0000","last_peered":"2024-04-26T17:56:58.625142+0000","last_clean":"2024-04-26T17:56:58.625142+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:56:58.625142+0000","last_undegraded":"2024-04-26T17:56:58.625142+0000","last_fullsized":"2024-04-26T17:56:58.625142+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.182031+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:56:59.182031+0000","last_peered":"2024-04-26T17:56:59.182031+0000","last_clean":"2024-04-26T17:56:59.182031+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:56:59.182031+0000","last_undegraded":"2024-04-26T17:56:59.182031+0000","last_fullsized":"2024-04-26T17:56:59.182031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625251+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:56:58.625251+0000","last_peered":"2024-04-26T17:56:58.625251+0000","last_clean":"2024-04-26T17:56:58.625251+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:56:58.625251+0000","last_undegraded":"2024-04-26T17:56:58.625251+0000","last_fullsized":"2024-04-26T17:56:58.625251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623126+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:56:58.623126+0000","last_peered":"2024-04-26T17:56:58.623126+0000","last_clean":"2024-04-26T17:56:58.623126+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:56:58.623126+0000","last_undegraded":"2024-04-26T17:56:58.623126+0000","last_fullsized":"2024-04-26T17:56:58.623126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181994+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:56:59.181994+0000","last_peered":"2024-04-26T17:56:59.181994+0000","last_clean":"2024-04-26T17:56:59.181994+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:56:59.181994+0000","last_undegraded":"2024-04-26T17:56:59.181994+0000","last_fullsized":"2024-04-26T17:56:59.181994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621585+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:56:58.621585+0000","last_peered":"2024-04-26T17:56:58.621585+0000","last_clean":"2024-04-26T17:56:58.621585+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:56:58.621585+0000","last_undegraded":"2024-04-26T17:56:58.621585+0000","last_fullsized":"2024-04-26T17:56:58.621585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:02.781564+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:57:02.781564+0000","last_peered":"2024-04-26T17:57:02.781564+0000","last_clean":"2024-04-26T17:57:02.781564+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:57:02.781564+0000","last_undegraded":"2024-04-26T17:57:02.781564+0000","last_fullsized":"2024-04-26T17:57:02.781564+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627275+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:56:58.627275+0000","last_peered":"2024-04-26T17:56:58.627275+0000","last_clean":"2024-04-26T17:56:58.627275+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:56:58.627275+0000","last_undegraded":"2024-04-26T17:56:58.627275+0000","last_fullsized":"2024-04-26T17:56:58.627275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.776753+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:56:58.776753+0000","last_peered":"2024-04-26T17:56:58.776753+0000","last_clean":"2024-04-26T17:56:58.776753+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:56:58.776753+0000","last_undegraded":"2024-04-26T17:56:58.776753+0000","last_fullsized":"2024-04-26T17:56:58.776753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":356,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623739+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:56:58.623739+0000","last_peered":"2024-04-26T17:56:58.623739+0000","last_clean":"2024-04-26T17:56:58.623739+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:56:58.623739+0000","last_undegraded":"2024-04-26T17:56:58.623739+0000","last_fullsized":"2024-04-26T17:56:58.623739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620399+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:56:58.620399+0000","last_peered":"2024-04-26T17:56:58.620399+0000","last_clean":"2024-04-26T17:56:58.620399+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:56:58.620399+0000","last_undegraded":"2024-04-26T17:56:58.620399+0000","last_fullsized":"2024-04-26T17:56:58.620399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623814+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:56:58.623814+0000","last_peered":"2024-04-26T17:56:58.623814+0000","last_clean":"2024-04-26T17:56:58.623814+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:56:58.623814+0000","last_undegraded":"2024-04-26T17:56:58.623814+0000","last_fullsized":"2024-04-26T17:56:58.623814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627100+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:56:58.627100+0000","last_peered":"2024-04-26T17:56:58.627100+0000","last_clean":"2024-04-26T17:56:58.627100+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:56:58.627100+0000","last_undegraded":"2024-04-26T17:56:58.627100+0000","last_fullsized":"2024-04-26T17:56:58.627100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620703+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:56:58.620703+0000","last_peered":"2024-04-26T17:56:58.620703+0000","last_clean":"2024-04-26T17:56:58.620703+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:56:58.620703+0000","last_undegraded":"2024-04-26T17:56:58.620703+0000","last_fullsized":"2024-04-26T17:56:58.620703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:01.505976+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:57:01.505976+0000","last_peered":"2024-04-26T17:57:01.505976+0000","last_clean":"2024-04-26T17:57:01.505976+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:57:01.505976+0000","last_undegraded":"2024-04-26T17:57:01.505976+0000","last_fullsized":"2024-04-26T17:57:01.505976+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627670+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:56:58.627670+0000","last_peered":"2024-04-26T17:56:58.627670+0000","last_clean":"2024-04-26T17:56:58.627670+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:56:58.627670+0000","last_undegraded":"2024-04-26T17:56:58.627670+0000","last_fullsized":"2024-04-26T17:56:58.627670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777023+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:56:58.777023+0000","last_peered":"2024-04-26T17:56:58.777023+0000","last_clean":"2024-04-26T17:56:58.777023+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:56:58.777023+0000","last_undegraded":"2024-04-26T17:56:58.777023+0000","last_fullsized":"2024-04-26T17:56:58.777023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180997+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:56:59.180997+0000","last_peered":"2024-04-26T17:56:59.180997+0000","last_clean":"2024-04-26T17:56:59.180997+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:56:59.180997+0000","last_undegraded":"2024-04-26T17:56:59.180997+0000","last_fullsized":"2024-04-26T17:56:59.180997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621148+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:56:58.621148+0000","last_peered":"2024-04-26T17:56:58.621148+0000","last_clean":"2024-04-26T17:56:58.621148+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:56:58.621148+0000","last_undegraded":"2024-04-26T17:56:58.621148+0000","last_fullsized":"2024-04-26T17:56:58.621148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626391+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:56:58.626391+0000","last_peered":"2024-04-26T17:56:58.626391+0000","last_clean":"2024-04-26T17:56:58.626391+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:56:58.626391+0000","last_undegraded":"2024-04-26T17:56:58.626391+0000","last_fullsized":"2024-04-26T17:56:58.626391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627494+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:56:58.627494+0000","last_peered":"2024-04-26T17:56:58.627494+0000","last_clean":"2024-04-26T17:56:58.627494+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:56:58.627494+0000","last_undegraded":"2024-04-26T17:56:58.627494+0000","last_fullsized":"2024-04-26T17:56:58.627494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624717+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:56:58.624717+0000","last_peered":"2024-04-26T17:56:58.624717+0000","last_clean":"2024-04-26T17:56:58.624717+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:56:58.624717+0000","last_undegraded":"2024-04-26T17:56:58.624717+0000","last_fullsized":"2024-04-26T17:56:58.624717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.633216+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:56:58.633216+0000","last_peered":"2024-04-26T17:56:58.633216+0000","last_clean":"2024-04-26T17:56:58.633216+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:56:58.633216+0000","last_undegraded":"2024-04-26T17:56:58.633216+0000","last_fullsized":"2024-04-26T17:56:58.633216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627277+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:56:58.627277+0000","last_peered":"2024-04-26T17:56:58.627277+0000","last_clean":"2024-04-26T17:56:58.627277+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:56:58.627277+0000","last_undegraded":"2024-04-26T17:56:58.627277+0000","last_fullsized":"2024-04-26T17:56:58.627277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626611+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:56:58.626611+0000","last_peered":"2024-04-26T17:56:58.626611+0000","last_clean":"2024-04-26T17:56:58.626611+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:56:58.626611+0000","last_undegraded":"2024-04-26T17:56:58.626611+0000","last_fullsized":"2024-04-26T17:56:58.626611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623503+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:56:58.623503+0000","last_peered":"2024-04-26T17:56:58.623503+0000","last_clean":"2024-04-26T17:56:58.623503+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:56:58.623503+0000","last_undegraded":"2024-04-26T17:56:58.623503+0000","last_fullsized":"2024-04-26T17:56:58.623503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628211+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:56:58.628211+0000","last_peered":"2024-04-26T17:56:58.628211+0000","last_clean":"2024-04-26T17:56:58.628211+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:56:58.628211+0000","last_undegraded":"2024-04-26T17:56:58.628211+0000","last_fullsized":"2024-04-26T17:56:58.628211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623431+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:56:58.623431+0000","last_peered":"2024-04-26T17:56:58.623431+0000","last_clean":"2024-04-26T17:56:58.623431+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:56:58.623431+0000","last_undegraded":"2024-04-26T17:56:58.623431+0000","last_fullsized":"2024-04-26T17:56:58.623431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621658+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:56:58.621658+0000","last_peered":"2024-04-26T17:56:58.621658+0000","last_clean":"2024-04-26T17:56:58.621658+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:56:58.621658+0000","last_undegraded":"2024-04-26T17:56:58.621658+0000","last_fullsized":"2024-04-26T17:56:58.621658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623539+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:56:58.623539+0000","last_peered":"2024-04-26T17:56:58.623539+0000","last_clean":"2024-04-26T17:56:58.623539+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:56:58.623539+0000","last_undegraded":"2024-04-26T17:56:58.623539+0000","last_fullsized":"2024-04-26T17:56:58.623539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620783+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:56:58.620783+0000","last_peered":"2024-04-26T17:56:58.620783+0000","last_clean":"2024-04-26T17:56:58.620783+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:56:58.620783+0000","last_undegraded":"2024-04-26T17:56:58.620783+0000","last_fullsized":"2024-04-26T17:56:58.620783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623468+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:56:58.623468+0000","last_peered":"2024-04-26T17:56:58.623468+0000","last_clean":"2024-04-26T17:56:58.623468+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:56:58.623468+0000","last_undegraded":"2024-04-26T17:56:58.623468+0000","last_fullsized":"2024-04-26T17:56:58.623468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624785+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:56:58.624785+0000","last_peered":"2024-04-26T17:56:58.624785+0000","last_clean":"2024-04-26T17:56:58.624785+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:56:58.624785+0000","last_undegraded":"2024-04-26T17:56:58.624785+0000","last_fullsized":"2024-04-26T17:56:58.624785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627640+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:56:58.627640+0000","last_peered":"2024-04-26T17:56:58.627640+0000","last_clean":"2024-04-26T17:56:58.627640+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:56:58.627640+0000","last_undegraded":"2024-04-26T17:56:58.627640+0000","last_fullsized":"2024-04-26T17:56:58.627640+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627616+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:56:58.627616+0000","last_peered":"2024-04-26T17:56:58.627616+0000","last_clean":"2024-04-26T17:56:58.627616+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:56:58.627616+0000","last_undegraded":"2024-04-26T17:56:58.627616+0000","last_fullsized":"2024-04-26T17:56:58.627616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180988+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:56:59.180988+0000","last_peered":"2024-04-26T17:56:59.180988+0000","last_clean":"2024-04-26T17:56:59.180988+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:56:59.180988+0000","last_undegraded":"2024-04-26T17:56:59.180988+0000","last_fullsized":"2024-04-26T17:56:59.180988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620674+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:56:58.620674+0000","last_peered":"2024-04-26T17:56:58.620674+0000","last_clean":"2024-04-26T17:56:58.620674+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:56:58.620674+0000","last_undegraded":"2024-04-26T17:56:58.620674+0000","last_fullsized":"2024-04-26T17:56:58.620674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625102+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:56:58.625102+0000","last_peered":"2024-04-26T17:56:58.625102+0000","last_clean":"2024-04-26T17:56:58.625102+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:56:58.625102+0000","last_undegraded":"2024-04-26T17:56:58.625102+0000","last_fullsized":"2024-04-26T17:56:58.625102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627969+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:56:58.627969+0000","last_peered":"2024-04-26T17:56:58.627969+0000","last_clean":"2024-04-26T17:56:58.627969+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:56:58.627969+0000","last_undegraded":"2024-04-26T17:56:58.627969+0000","last_fullsized":"2024-04-26T17:56:58.627969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627584+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:56:58.627584+0000","last_peered":"2024-04-26T17:56:58.627584+0000","last_clean":"2024-04-26T17:56:58.627584+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:56:58.627584+0000","last_undegraded":"2024-04-26T17:56:58.627584+0000","last_fullsized":"2024-04-26T17:56:58.627584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621281+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:56:58.621281+0000","last_peered":"2024-04-26T17:56:58.621281+0000","last_clean":"2024-04-26T17:56:58.621281+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:56:58.621281+0000","last_undegraded":"2024-04-26T17:56:58.621281+0000","last_fullsized":"2024-04-26T17:56:58.621281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627405+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:56:58.627405+0000","last_peered":"2024-04-26T17:56:58.627405+0000","last_clean":"2024-04-26T17:56:58.627405+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:56:58.627405+0000","last_undegraded":"2024-04-26T17:56:58.627405+0000","last_fullsized":"2024-04-26T17:56:58.627405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621336+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:56:58.621336+0000","last_peered":"2024-04-26T17:56:58.621336+0000","last_clean":"2024-04-26T17:56:58.621336+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:56:58.621336+0000","last_undegraded":"2024-04-26T17:56:58.621336+0000","last_fullsized":"2024-04-26T17:56:58.621336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620631+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:56:58.620631+0000","last_peered":"2024-04-26T17:56:58.620631+0000","last_clean":"2024-04-26T17:56:58.620631+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:56:58.620631+0000","last_undegraded":"2024-04-26T17:56:58.620631+0000","last_fullsized":"2024-04-26T17:56:58.620631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625302+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:56:58.625302+0000","last_peered":"2024-04-26T17:56:58.625302+0000","last_clean":"2024-04-26T17:56:58.625302+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:56:58.625302+0000","last_undegraded":"2024-04-26T17:56:58.625302+0000","last_fullsized":"2024-04-26T17:56:58.625302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284174,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58373,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":165,"num_read_kb":144,"num_write":157,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383704,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":479699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645341,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":1125552,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":479935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":479273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1071785,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495667,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":479324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":533489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":480595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":535230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":479635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757303,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1071469,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":56113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":55950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:57:10.201 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:57:10.438 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:10.847 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:10 smithi092 ceph-mon[29156]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:10.848 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:10 smithi092 ceph-mon[29156]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 52 B/s, 0 objects/s recovering 2024-04-26T17:57:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:10 smithi156 ceph-mon[32679]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:10 smithi156 ceph-mon[32679]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 52 B/s, 0 objects/s recovering 2024-04-26T17:57:10.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:10 smithi189 ceph-mon[32756]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:10.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:10 smithi189 ceph-mon[32756]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 52 B/s, 0 objects/s recovering 2024-04-26T17:57:12.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.173+0000 7f4fe6324700 1 -- 172.21.15.92:0/3539576900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102350 msgr2=0x7f4fe01027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:12.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.173+0000 7f4fe6324700 1 --2- 172.21.15.92:0/3539576900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102350 0x7f4fe01027d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009990 tx=0x7f4fd4009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 -- 172.21.15.92:0/3539576900 shutdown_connections 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 --2- 172.21.15.92:0/3539576900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe01083d0 0x7f4fe01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 --2- 172.21.15.92:0/3539576900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fe0102d10 0x7f4fe010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 --2- 172.21.15.92:0/3539576900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102350 0x7f4fe01027d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 -- 172.21.15.92:0/3539576900 >> 172.21.15.92:0/3539576900 conn(0x7f4fe0078390 msgr2=0x7f4fe00787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 -- 172.21.15.92:0/3539576900 shutdown_connections 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 -- 172.21.15.92:0/3539576900 wait complete. 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 Processor -- start 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.174+0000 7f4fe6324700 1 -- start start 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe0102350 0x7f4fe01043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fe01083d0 0x7f4fe0104e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0112540 con 0x7f4fe0102d10 2024-04-26T17:57:12.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe01123c0 con 0x7f4fe0102350 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe01126c0 con 0x7f4fe01083d0 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34206/0 (socket says 172.21.15.92:34206) 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 -- 172.21.15.92:0/2963790285 learned_addr learned my addr 172.21.15.92:0/2963790285 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdffff700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe0102350 0x7f4fe01043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 -- 172.21.15.92:0/2963790285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fe01083d0 msgr2=0x7f4fe0104e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fe01083d0 0x7f4fe0104e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 -- 172.21.15.92:0/2963790285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe0102350 msgr2=0x7f4fe01043f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe0102350 0x7f4fe01043f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 -- 172.21.15.92:0/2963790285 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe01a80a0 con 0x7f4fe0102d10 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdf7fe700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4003ac0 tx=0x7f4fd4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4027070 con 0x7f4fe0102d10 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe01a8330 con 0x7f4fe0102d10 2024-04-26T17:57:12.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd4003680 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.175+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4022d40 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.176+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe01a8860 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.176+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0103a40 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.178+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4fd402a070 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.178+0000 7f4fdd7fa700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 0x7f4fc80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.178+0000 7f4fdffff700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 0x7f4fc80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.178+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f4fd40d1960 con 0x7f4fe0102d10 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.179+0000 7f4fdffff700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 0x7f4fc80a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0005950 tx=0x7f4fd00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:12.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.182+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4fd4031020 con 0x7f4fe0102d10 2024-04-26T17:57:12.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.380+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4fe0100ea0 con 0x7f4fc80a3cd0 2024-04-26T17:57:12.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.387+0000 7f4fdd7fa700 1 -- 172.21.15.92:0/2963790285 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258889 (secure 0 0 0) 0x7f4fe0100ea0 con 0x7f4fc80a3cd0 2024-04-26T17:57:12.391 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.389+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 msgr2=0x7f4fc80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.389+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 0x7f4fc80a6190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0005950 tx=0x7f4fd00058e0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.389+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 msgr2=0x7f4fe0104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.389+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4003ac0 tx=0x7f4fd4003ba0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 shutdown_connections 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4fc80a3cd0 0x7f4fc80a6190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fe0102350 0x7f4fe01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fe01083d0 0x7f4fe0104e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 --2- 172.21.15.92:0/2963790285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe0102d10 0x7f4fe0104930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:12.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 >> 172.21.15.92:0/2963790285 conn(0x7f4fe0078390 msgr2=0x7f4fe01067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:12.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 shutdown_connections 2024-04-26T17:57:12.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:12.390+0000 7f4fe6324700 1 -- 172.21.15.92:0/2963790285 wait complete. 2024-04-26T17:57:12.394 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:57:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:12 smithi156 ceph-mon[32679]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-26T17:57:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:12 smithi092 ceph-mon[29156]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-26T17:57:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:12 smithi189 ceph-mon[32756]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-26T17:57:13.140 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-04-26T17:57:11.634409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655220,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":332,"num_read_kb":285,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365340,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576484,"statfs":{"total":1151940427776,"available":1151566319616,"internally_reserved":0,"allocated":12288000,"data_stored":7715064,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10619,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":11,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003119"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625150+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:56:58.625150+0000","last_peered":"2024-04-26T17:56:58.625150+0000","last_clean":"2024-04-26T17:56:58.625150+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:56:58.625150+0000","last_undegraded":"2024-04-26T17:56:58.625150+0000","last_fullsized":"2024-04-26T17:56:58.625150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180964+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:56:59.180964+0000","last_peered":"2024-04-26T17:56:59.180964+0000","last_clean":"2024-04-26T17:56:59.180964+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:56:59.180964+0000","last_undegraded":"2024-04-26T17:56:59.180964+0000","last_fullsized":"2024-04-26T17:56:59.180964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180784+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:56:59.180784+0000","last_peered":"2024-04-26T17:56:59.180784+0000","last_clean":"2024-04-26T17:56:59.180784+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:56:59.180784+0000","last_undegraded":"2024-04-26T17:56:59.180784+0000","last_fullsized":"2024-04-26T17:56:59.180784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777001+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:56:58.777001+0000","last_peered":"2024-04-26T17:56:58.777001+0000","last_clean":"2024-04-26T17:56:58.777001+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:56:58.777001+0000","last_undegraded":"2024-04-26T17:56:58.777001+0000","last_fullsized":"2024-04-26T17:56:58.777001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626212+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:56:58.626212+0000","last_peered":"2024-04-26T17:56:58.626212+0000","last_clean":"2024-04-26T17:56:58.626212+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:56:58.626212+0000","last_undegraded":"2024-04-26T17:56:58.626212+0000","last_fullsized":"2024-04-26T17:56:58.626212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624995+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:56:58.624995+0000","last_peered":"2024-04-26T17:56:58.624995+0000","last_clean":"2024-04-26T17:56:58.624995+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:56:58.624995+0000","last_undegraded":"2024-04-26T17:56:58.624995+0000","last_fullsized":"2024-04-26T17:56:58.624995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.622981+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:56:58.622981+0000","last_peered":"2024-04-26T17:56:58.622981+0000","last_clean":"2024-04-26T17:56:58.622981+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:56:58.622981+0000","last_undegraded":"2024-04-26T17:56:58.622981+0000","last_fullsized":"2024-04-26T17:56:58.622981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627218+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:56:58.627218+0000","last_peered":"2024-04-26T17:56:58.627218+0000","last_clean":"2024-04-26T17:56:58.627218+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:56:58.627218+0000","last_undegraded":"2024-04-26T17:56:58.627218+0000","last_fullsized":"2024-04-26T17:56:58.627218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621734+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:56:58.621734+0000","last_peered":"2024-04-26T17:56:58.621734+0000","last_clean":"2024-04-26T17:56:58.621734+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:56:58.621734+0000","last_undegraded":"2024-04-26T17:56:58.621734+0000","last_fullsized":"2024-04-26T17:56:58.621734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625626+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:56:58.625626+0000","last_peered":"2024-04-26T17:56:58.625626+0000","last_clean":"2024-04-26T17:56:58.625626+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:56:58.625626+0000","last_undegraded":"2024-04-26T17:56:58.625626+0000","last_fullsized":"2024-04-26T17:56:58.625626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623291+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:56:58.623291+0000","last_peered":"2024-04-26T17:56:58.623291+0000","last_clean":"2024-04-26T17:56:58.623291+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:56:58.623291+0000","last_undegraded":"2024-04-26T17:56:58.623291+0000","last_fullsized":"2024-04-26T17:56:58.623291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.632207+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:56:58.632207+0000","last_peered":"2024-04-26T17:56:58.632207+0000","last_clean":"2024-04-26T17:56:58.632207+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:56:58.632207+0000","last_undegraded":"2024-04-26T17:56:58.632207+0000","last_fullsized":"2024-04-26T17:56:58.632207+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620689+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:56:58.620689+0000","last_peered":"2024-04-26T17:56:58.620689+0000","last_clean":"2024-04-26T17:56:58.620689+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:56:58.620689+0000","last_undegraded":"2024-04-26T17:56:58.620689+0000","last_fullsized":"2024-04-26T17:56:58.620689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180696+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:56:59.180696+0000","last_peered":"2024-04-26T17:56:59.180696+0000","last_clean":"2024-04-26T17:56:59.180696+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:56:59.180696+0000","last_undegraded":"2024-04-26T17:56:59.180696+0000","last_fullsized":"2024-04-26T17:56:59.180696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180596+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:56:59.180596+0000","last_peered":"2024-04-26T17:56:59.180596+0000","last_clean":"2024-04-26T17:56:59.180596+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:56:59.180596+0000","last_undegraded":"2024-04-26T17:56:59.180596+0000","last_fullsized":"2024-04-26T17:56:59.180596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621131+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:56:58.621131+0000","last_peered":"2024-04-26T17:56:58.621131+0000","last_clean":"2024-04-26T17:56:58.621131+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:56:58.621131+0000","last_undegraded":"2024-04-26T17:56:58.621131+0000","last_fullsized":"2024-04-26T17:56:58.621131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625284+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:56:58.625284+0000","last_peered":"2024-04-26T17:56:58.625284+0000","last_clean":"2024-04-26T17:56:58.625284+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:56:58.625284+0000","last_undegraded":"2024-04-26T17:56:58.625284+0000","last_fullsized":"2024-04-26T17:56:58.625284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624321+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:56:58.624321+0000","last_peered":"2024-04-26T17:56:58.624321+0000","last_clean":"2024-04-26T17:56:58.624321+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:56:58.624321+0000","last_undegraded":"2024-04-26T17:56:58.624321+0000","last_fullsized":"2024-04-26T17:56:58.624321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628050+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:56:58.628050+0000","last_peered":"2024-04-26T17:56:58.628050+0000","last_clean":"2024-04-26T17:56:58.628050+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:56:58.628050+0000","last_undegraded":"2024-04-26T17:56:58.628050+0000","last_fullsized":"2024-04-26T17:56:58.628050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.783365+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:56:58.783365+0000","last_peered":"2024-04-26T17:56:58.783365+0000","last_clean":"2024-04-26T17:56:58.783365+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:56:58.783365+0000","last_undegraded":"2024-04-26T17:56:58.783365+0000","last_fullsized":"2024-04-26T17:56:58.783365+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627718+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:56:58.627718+0000","last_peered":"2024-04-26T17:56:58.627718+0000","last_clean":"2024-04-26T17:56:58.627718+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:56:58.627718+0000","last_undegraded":"2024-04-26T17:56:58.627718+0000","last_fullsized":"2024-04-26T17:56:58.627718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627920+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:56:58.627920+0000","last_peered":"2024-04-26T17:56:58.627920+0000","last_clean":"2024-04-26T17:56:58.627920+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:56:58.627920+0000","last_undegraded":"2024-04-26T17:56:58.627920+0000","last_fullsized":"2024-04-26T17:56:58.627920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181165+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:56:59.181165+0000","last_peered":"2024-04-26T17:56:59.181165+0000","last_clean":"2024-04-26T17:56:59.181165+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:56:59.181165+0000","last_undegraded":"2024-04-26T17:56:59.181165+0000","last_fullsized":"2024-04-26T17:56:59.181165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627279+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:56:58.627279+0000","last_peered":"2024-04-26T17:56:58.627279+0000","last_clean":"2024-04-26T17:56:58.627279+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627279+0000","last_undegraded":"2024-04-26T17:56:58.627279+0000","last_fullsized":"2024-04-26T17:56:58.627279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621361+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:56:58.621361+0000","last_peered":"2024-04-26T17:56:58.621361+0000","last_clean":"2024-04-26T17:56:58.621361+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:56:58.621361+0000","last_undegraded":"2024-04-26T17:56:58.621361+0000","last_fullsized":"2024-04-26T17:56:58.621361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627192+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:56:58.627192+0000","last_peered":"2024-04-26T17:56:58.627192+0000","last_clean":"2024-04-26T17:56:58.627192+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627192+0000","last_undegraded":"2024-04-26T17:56:58.627192+0000","last_fullsized":"2024-04-26T17:56:58.627192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621757+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:56:58.621757+0000","last_peered":"2024-04-26T17:56:58.621757+0000","last_clean":"2024-04-26T17:56:58.621757+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:56:58.621757+0000","last_undegraded":"2024-04-26T17:56:58.621757+0000","last_fullsized":"2024-04-26T17:56:58.621757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:06.786628+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:57:06.786628+0000","last_peered":"2024-04-26T17:57:06.786628+0000","last_clean":"2024-04-26T17:57:06.786628+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:57:06.786628+0000","last_undegraded":"2024-04-26T17:57:06.786628+0000","last_fullsized":"2024-04-26T17:57:06.786628+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626464+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:56:58.626464+0000","last_peered":"2024-04-26T17:56:58.626464+0000","last_clean":"2024-04-26T17:56:58.626464+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:56:58.626464+0000","last_undegraded":"2024-04-26T17:56:58.626464+0000","last_fullsized":"2024-04-26T17:56:58.626464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625011+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:56:58.625011+0000","last_peered":"2024-04-26T17:56:58.625011+0000","last_clean":"2024-04-26T17:56:58.625011+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:56:58.625011+0000","last_undegraded":"2024-04-26T17:56:58.625011+0000","last_fullsized":"2024-04-26T17:56:58.625011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621485+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:56:58.621485+0000","last_peered":"2024-04-26T17:56:58.621485+0000","last_clean":"2024-04-26T17:56:58.621485+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:56:58.621485+0000","last_undegraded":"2024-04-26T17:56:58.621485+0000","last_fullsized":"2024-04-26T17:56:58.621485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620515+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:56:58.620515+0000","last_peered":"2024-04-26T17:56:58.620515+0000","last_clean":"2024-04-26T17:56:58.620515+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:56:58.620515+0000","last_undegraded":"2024-04-26T17:56:58.620515+0000","last_fullsized":"2024-04-26T17:56:58.620515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627115+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:56:58.627115+0000","last_peered":"2024-04-26T17:56:58.627115+0000","last_clean":"2024-04-26T17:56:58.627115+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:56:58.627115+0000","last_undegraded":"2024-04-26T17:56:58.627115+0000","last_fullsized":"2024-04-26T17:56:58.627115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621197+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:56:58.621197+0000","last_peered":"2024-04-26T17:56:58.621197+0000","last_clean":"2024-04-26T17:56:58.621197+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:56:58.621197+0000","last_undegraded":"2024-04-26T17:56:58.621197+0000","last_fullsized":"2024-04-26T17:56:58.621197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624109+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:56:58.624109+0000","last_peered":"2024-04-26T17:56:58.624109+0000","last_clean":"2024-04-26T17:56:58.624109+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:56:58.624109+0000","last_undegraded":"2024-04-26T17:56:58.624109+0000","last_fullsized":"2024-04-26T17:56:58.624109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:07.787357+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:57:07.787357+0000","last_peered":"2024-04-26T17:57:07.787357+0000","last_clean":"2024-04-26T17:57:07.787357+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:57:07.787357+0000","last_undegraded":"2024-04-26T17:57:07.787357+0000","last_fullsized":"2024-04-26T17:57:07.787357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621654+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:56:58.621654+0000","last_peered":"2024-04-26T17:56:58.621654+0000","last_clean":"2024-04-26T17:56:58.621654+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:56:58.621654+0000","last_undegraded":"2024-04-26T17:56:58.621654+0000","last_fullsized":"2024-04-26T17:56:58.621654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623398+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:56:58.623398+0000","last_peered":"2024-04-26T17:56:58.623398+0000","last_clean":"2024-04-26T17:56:58.623398+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:56:58.623398+0000","last_undegraded":"2024-04-26T17:56:58.623398+0000","last_fullsized":"2024-04-26T17:56:58.623398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181116+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:56:59.181116+0000","last_peered":"2024-04-26T17:56:59.181116+0000","last_clean":"2024-04-26T17:56:59.181116+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:56:59.181116+0000","last_undegraded":"2024-04-26T17:56:59.181116+0000","last_fullsized":"2024-04-26T17:56:59.181116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621803+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:56:58.621803+0000","last_peered":"2024-04-26T17:56:58.621803+0000","last_clean":"2024-04-26T17:56:58.621803+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:56:58.621803+0000","last_undegraded":"2024-04-26T17:56:58.621803+0000","last_fullsized":"2024-04-26T17:56:58.621803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621365+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:56:58.621365+0000","last_peered":"2024-04-26T17:56:58.621365+0000","last_clean":"2024-04-26T17:56:58.621365+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:56:58.621365+0000","last_undegraded":"2024-04-26T17:56:58.621365+0000","last_fullsized":"2024-04-26T17:56:58.621365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'29","reported_seq":121,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:08.788780+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:57:08.788780+0000","last_peered":"2024-04-26T17:57:08.788780+0000","last_clean":"2024-04-26T17:57:08.788780+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:57:08.788780+0000","last_undegraded":"2024-04-26T17:57:08.788780+0000","last_fullsized":"2024-04-26T17:57:08.788780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60617,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":91,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627072+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:56:58.627072+0000","last_peered":"2024-04-26T17:56:58.627072+0000","last_clean":"2024-04-26T17:56:58.627072+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:56:58.627072+0000","last_undegraded":"2024-04-26T17:56:58.627072+0000","last_fullsized":"2024-04-26T17:56:58.627072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627777+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:56:58.627777+0000","last_peered":"2024-04-26T17:56:58.627777+0000","last_clean":"2024-04-26T17:56:58.627777+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:56:58.627777+0000","last_undegraded":"2024-04-26T17:56:58.627777+0000","last_fullsized":"2024-04-26T17:56:58.627777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620784+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:56:58.620784+0000","last_peered":"2024-04-26T17:56:58.620784+0000","last_clean":"2024-04-26T17:56:58.620784+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:56:58.620784+0000","last_undegraded":"2024-04-26T17:56:58.620784+0000","last_fullsized":"2024-04-26T17:56:58.620784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621467+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:56:58.621467+0000","last_peered":"2024-04-26T17:56:58.621467+0000","last_clean":"2024-04-26T17:56:58.621467+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:56:58.621467+0000","last_undegraded":"2024-04-26T17:56:58.621467+0000","last_fullsized":"2024-04-26T17:56:58.621467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623152+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:56:58.623152+0000","last_peered":"2024-04-26T17:56:58.623152+0000","last_clean":"2024-04-26T17:56:58.623152+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:56:58.623152+0000","last_undegraded":"2024-04-26T17:56:58.623152+0000","last_fullsized":"2024-04-26T17:56:58.623152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:07.789167+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:57:07.789167+0000","last_peered":"2024-04-26T17:57:07.789167+0000","last_clean":"2024-04-26T17:57:07.789167+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:57:07.789167+0000","last_undegraded":"2024-04-26T17:57:07.789167+0000","last_fullsized":"2024-04-26T17:57:07.789167+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627910+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:56:58.627910+0000","last_peered":"2024-04-26T17:56:58.627910+0000","last_clean":"2024-04-26T17:56:58.627910+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:56:58.627910+0000","last_undegraded":"2024-04-26T17:56:58.627910+0000","last_fullsized":"2024-04-26T17:56:58.627910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626465+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:56:58.626465+0000","last_peered":"2024-04-26T17:56:58.626465+0000","last_clean":"2024-04-26T17:56:58.626465+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:56:58.626465+0000","last_undegraded":"2024-04-26T17:56:58.626465+0000","last_fullsized":"2024-04-26T17:56:58.626465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621381+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:56:58.621381+0000","last_peered":"2024-04-26T17:56:58.621381+0000","last_clean":"2024-04-26T17:56:58.621381+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:56:58.621381+0000","last_undegraded":"2024-04-26T17:56:58.621381+0000","last_fullsized":"2024-04-26T17:56:58.621381+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627296+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:56:58.627296+0000","last_peered":"2024-04-26T17:56:58.627296+0000","last_clean":"2024-04-26T17:56:58.627296+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:56:58.627296+0000","last_undegraded":"2024-04-26T17:56:58.627296+0000","last_fullsized":"2024-04-26T17:56:58.627296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625142+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:56:58.625142+0000","last_peered":"2024-04-26T17:56:58.625142+0000","last_clean":"2024-04-26T17:56:58.625142+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:56:58.625142+0000","last_undegraded":"2024-04-26T17:56:58.625142+0000","last_fullsized":"2024-04-26T17:56:58.625142+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.182031+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:56:59.182031+0000","last_peered":"2024-04-26T17:56:59.182031+0000","last_clean":"2024-04-26T17:56:59.182031+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:56:59.182031+0000","last_undegraded":"2024-04-26T17:56:59.182031+0000","last_fullsized":"2024-04-26T17:56:59.182031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625251+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:56:58.625251+0000","last_peered":"2024-04-26T17:56:58.625251+0000","last_clean":"2024-04-26T17:56:58.625251+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:56:58.625251+0000","last_undegraded":"2024-04-26T17:56:58.625251+0000","last_fullsized":"2024-04-26T17:56:58.625251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623126+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:56:58.623126+0000","last_peered":"2024-04-26T17:56:58.623126+0000","last_clean":"2024-04-26T17:56:58.623126+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:56:58.623126+0000","last_undegraded":"2024-04-26T17:56:58.623126+0000","last_fullsized":"2024-04-26T17:56:58.623126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181994+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:56:59.181994+0000","last_peered":"2024-04-26T17:56:59.181994+0000","last_clean":"2024-04-26T17:56:59.181994+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:56:59.181994+0000","last_undegraded":"2024-04-26T17:56:59.181994+0000","last_fullsized":"2024-04-26T17:56:59.181994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621585+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:56:58.621585+0000","last_peered":"2024-04-26T17:56:58.621585+0000","last_clean":"2024-04-26T17:56:58.621585+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:56:58.621585+0000","last_undegraded":"2024-04-26T17:56:58.621585+0000","last_fullsized":"2024-04-26T17:56:58.621585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:07.788375+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:57:07.788375+0000","last_peered":"2024-04-26T17:57:07.788375+0000","last_clean":"2024-04-26T17:57:07.788375+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:57:07.788375+0000","last_undegraded":"2024-04-26T17:57:07.788375+0000","last_fullsized":"2024-04-26T17:57:07.788375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627275+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:56:58.627275+0000","last_peered":"2024-04-26T17:56:58.627275+0000","last_clean":"2024-04-26T17:56:58.627275+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:56:58.627275+0000","last_undegraded":"2024-04-26T17:56:58.627275+0000","last_fullsized":"2024-04-26T17:56:58.627275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.776753+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:56:58.776753+0000","last_peered":"2024-04-26T17:56:58.776753+0000","last_clean":"2024-04-26T17:56:58.776753+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:56:58.776753+0000","last_undegraded":"2024-04-26T17:56:58.776753+0000","last_fullsized":"2024-04-26T17:56:58.776753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":356,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623739+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:56:58.623739+0000","last_peered":"2024-04-26T17:56:58.623739+0000","last_clean":"2024-04-26T17:56:58.623739+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:56:58.623739+0000","last_undegraded":"2024-04-26T17:56:58.623739+0000","last_fullsized":"2024-04-26T17:56:58.623739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620399+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:56:58.620399+0000","last_peered":"2024-04-26T17:56:58.620399+0000","last_clean":"2024-04-26T17:56:58.620399+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:56:58.620399+0000","last_undegraded":"2024-04-26T17:56:58.620399+0000","last_fullsized":"2024-04-26T17:56:58.620399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623814+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:56:58.623814+0000","last_peered":"2024-04-26T17:56:58.623814+0000","last_clean":"2024-04-26T17:56:58.623814+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:56:58.623814+0000","last_undegraded":"2024-04-26T17:56:58.623814+0000","last_fullsized":"2024-04-26T17:56:58.623814+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627100+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:56:58.627100+0000","last_peered":"2024-04-26T17:56:58.627100+0000","last_clean":"2024-04-26T17:56:58.627100+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:56:58.627100+0000","last_undegraded":"2024-04-26T17:56:58.627100+0000","last_fullsized":"2024-04-26T17:56:58.627100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620703+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:56:58.620703+0000","last_peered":"2024-04-26T17:56:58.620703+0000","last_clean":"2024-04-26T17:56:58.620703+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:56:58.620703+0000","last_undegraded":"2024-04-26T17:56:58.620703+0000","last_fullsized":"2024-04-26T17:56:58.620703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'10","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:03.506362+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:57:03.506362+0000","last_peered":"2024-04-26T17:57:03.506362+0000","last_clean":"2024-04-26T17:57:03.506362+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:57:03.506362+0000","last_undegraded":"2024-04-26T17:57:03.506362+0000","last_fullsized":"2024-04-26T17:57:03.506362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627670+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:56:58.627670+0000","last_peered":"2024-04-26T17:56:58.627670+0000","last_clean":"2024-04-26T17:56:58.627670+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:56:58.627670+0000","last_undegraded":"2024-04-26T17:56:58.627670+0000","last_fullsized":"2024-04-26T17:56:58.627670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777023+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:56:58.777023+0000","last_peered":"2024-04-26T17:56:58.777023+0000","last_clean":"2024-04-26T17:56:58.777023+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:56:58.777023+0000","last_undegraded":"2024-04-26T17:56:58.777023+0000","last_fullsized":"2024-04-26T17:56:58.777023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180997+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:56:59.180997+0000","last_peered":"2024-04-26T17:56:59.180997+0000","last_clean":"2024-04-26T17:56:59.180997+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:56:59.180997+0000","last_undegraded":"2024-04-26T17:56:59.180997+0000","last_fullsized":"2024-04-26T17:56:59.180997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621148+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:56:58.621148+0000","last_peered":"2024-04-26T17:56:58.621148+0000","last_clean":"2024-04-26T17:56:58.621148+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:56:58.621148+0000","last_undegraded":"2024-04-26T17:56:58.621148+0000","last_fullsized":"2024-04-26T17:56:58.621148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626391+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:56:58.626391+0000","last_peered":"2024-04-26T17:56:58.626391+0000","last_clean":"2024-04-26T17:56:58.626391+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:56:58.626391+0000","last_undegraded":"2024-04-26T17:56:58.626391+0000","last_fullsized":"2024-04-26T17:56:58.626391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627494+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:56:58.627494+0000","last_peered":"2024-04-26T17:56:58.627494+0000","last_clean":"2024-04-26T17:56:58.627494+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:56:58.627494+0000","last_undegraded":"2024-04-26T17:56:58.627494+0000","last_fullsized":"2024-04-26T17:56:58.627494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624717+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:56:58.624717+0000","last_peered":"2024-04-26T17:56:58.624717+0000","last_clean":"2024-04-26T17:56:58.624717+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:56:58.624717+0000","last_undegraded":"2024-04-26T17:56:58.624717+0000","last_fullsized":"2024-04-26T17:56:58.624717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.633216+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:56:58.633216+0000","last_peered":"2024-04-26T17:56:58.633216+0000","last_clean":"2024-04-26T17:56:58.633216+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:56:58.633216+0000","last_undegraded":"2024-04-26T17:56:58.633216+0000","last_fullsized":"2024-04-26T17:56:58.633216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627277+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:56:58.627277+0000","last_peered":"2024-04-26T17:56:58.627277+0000","last_clean":"2024-04-26T17:56:58.627277+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:56:58.627277+0000","last_undegraded":"2024-04-26T17:56:58.627277+0000","last_fullsized":"2024-04-26T17:56:58.627277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626611+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:56:58.626611+0000","last_peered":"2024-04-26T17:56:58.626611+0000","last_clean":"2024-04-26T17:56:58.626611+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:56:58.626611+0000","last_undegraded":"2024-04-26T17:56:58.626611+0000","last_fullsized":"2024-04-26T17:56:58.626611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623503+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:56:58.623503+0000","last_peered":"2024-04-26T17:56:58.623503+0000","last_clean":"2024-04-26T17:56:58.623503+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:56:58.623503+0000","last_undegraded":"2024-04-26T17:56:58.623503+0000","last_fullsized":"2024-04-26T17:56:58.623503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628211+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:56:58.628211+0000","last_peered":"2024-04-26T17:56:58.628211+0000","last_clean":"2024-04-26T17:56:58.628211+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:56:58.628211+0000","last_undegraded":"2024-04-26T17:56:58.628211+0000","last_fullsized":"2024-04-26T17:56:58.628211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623431+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:56:58.623431+0000","last_peered":"2024-04-26T17:56:58.623431+0000","last_clean":"2024-04-26T17:56:58.623431+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:56:58.623431+0000","last_undegraded":"2024-04-26T17:56:58.623431+0000","last_fullsized":"2024-04-26T17:56:58.623431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621658+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:56:58.621658+0000","last_peered":"2024-04-26T17:56:58.621658+0000","last_clean":"2024-04-26T17:56:58.621658+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:56:58.621658+0000","last_undegraded":"2024-04-26T17:56:58.621658+0000","last_fullsized":"2024-04-26T17:56:58.621658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623539+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:56:58.623539+0000","last_peered":"2024-04-26T17:56:58.623539+0000","last_clean":"2024-04-26T17:56:58.623539+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:56:58.623539+0000","last_undegraded":"2024-04-26T17:56:58.623539+0000","last_fullsized":"2024-04-26T17:56:58.623539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620783+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:56:58.620783+0000","last_peered":"2024-04-26T17:56:58.620783+0000","last_clean":"2024-04-26T17:56:58.620783+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:56:58.620783+0000","last_undegraded":"2024-04-26T17:56:58.620783+0000","last_fullsized":"2024-04-26T17:56:58.620783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623468+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:56:58.623468+0000","last_peered":"2024-04-26T17:56:58.623468+0000","last_clean":"2024-04-26T17:56:58.623468+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:56:58.623468+0000","last_undegraded":"2024-04-26T17:56:58.623468+0000","last_fullsized":"2024-04-26T17:56:58.623468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624785+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:56:58.624785+0000","last_peered":"2024-04-26T17:56:58.624785+0000","last_clean":"2024-04-26T17:56:58.624785+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:56:58.624785+0000","last_undegraded":"2024-04-26T17:56:58.624785+0000","last_fullsized":"2024-04-26T17:56:58.624785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627640+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:56:58.627640+0000","last_peered":"2024-04-26T17:56:58.627640+0000","last_clean":"2024-04-26T17:56:58.627640+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:56:58.627640+0000","last_undegraded":"2024-04-26T17:56:58.627640+0000","last_fullsized":"2024-04-26T17:56:58.627640+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627616+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:56:58.627616+0000","last_peered":"2024-04-26T17:56:58.627616+0000","last_clean":"2024-04-26T17:56:58.627616+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:56:58.627616+0000","last_undegraded":"2024-04-26T17:56:58.627616+0000","last_fullsized":"2024-04-26T17:56:58.627616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180988+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:56:59.180988+0000","last_peered":"2024-04-26T17:56:59.180988+0000","last_clean":"2024-04-26T17:56:59.180988+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:56:59.180988+0000","last_undegraded":"2024-04-26T17:56:59.180988+0000","last_fullsized":"2024-04-26T17:56:59.180988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620674+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:56:58.620674+0000","last_peered":"2024-04-26T17:56:58.620674+0000","last_clean":"2024-04-26T17:56:58.620674+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:56:58.620674+0000","last_undegraded":"2024-04-26T17:56:58.620674+0000","last_fullsized":"2024-04-26T17:56:58.620674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625102+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:56:58.625102+0000","last_peered":"2024-04-26T17:56:58.625102+0000","last_clean":"2024-04-26T17:56:58.625102+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:56:58.625102+0000","last_undegraded":"2024-04-26T17:56:58.625102+0000","last_fullsized":"2024-04-26T17:56:58.625102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627969+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:56:58.627969+0000","last_peered":"2024-04-26T17:56:58.627969+0000","last_clean":"2024-04-26T17:56:58.627969+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:56:58.627969+0000","last_undegraded":"2024-04-26T17:56:58.627969+0000","last_fullsized":"2024-04-26T17:56:58.627969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627584+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:56:58.627584+0000","last_peered":"2024-04-26T17:56:58.627584+0000","last_clean":"2024-04-26T17:56:58.627584+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:56:58.627584+0000","last_undegraded":"2024-04-26T17:56:58.627584+0000","last_fullsized":"2024-04-26T17:56:58.627584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621281+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:56:58.621281+0000","last_peered":"2024-04-26T17:56:58.621281+0000","last_clean":"2024-04-26T17:56:58.621281+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:56:58.621281+0000","last_undegraded":"2024-04-26T17:56:58.621281+0000","last_fullsized":"2024-04-26T17:56:58.621281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627405+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:56:58.627405+0000","last_peered":"2024-04-26T17:56:58.627405+0000","last_clean":"2024-04-26T17:56:58.627405+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:56:58.627405+0000","last_undegraded":"2024-04-26T17:56:58.627405+0000","last_fullsized":"2024-04-26T17:56:58.627405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621336+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:56:58.621336+0000","last_peered":"2024-04-26T17:56:58.621336+0000","last_clean":"2024-04-26T17:56:58.621336+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:56:58.621336+0000","last_undegraded":"2024-04-26T17:56:58.621336+0000","last_fullsized":"2024-04-26T17:56:58.621336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620631+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:56:58.620631+0000","last_peered":"2024-04-26T17:56:58.620631+0000","last_clean":"2024-04-26T17:56:58.620631+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:56:58.620631+0000","last_undegraded":"2024-04-26T17:56:58.620631+0000","last_fullsized":"2024-04-26T17:56:58.620631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625302+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:56:58.625302+0000","last_peered":"2024-04-26T17:56:58.625302+0000","last_clean":"2024-04-26T17:56:58.625302+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:56:58.625302+0000","last_undegraded":"2024-04-26T17:56:58.625302+0000","last_fullsized":"2024-04-26T17:56:58.625302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284174,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64618,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383705,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":479699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":1131797,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":479935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070505,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":479273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332142,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1071785,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":479324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1044480,"data_stored":539734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":480595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":541475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":479635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1071469,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:57:13.144 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T17:57:13.145 INFO:tasks.cephadm:Setting up client nodes... 2024-04-26T17:57:13.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-26T17:57:13.385 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:13.850 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:13 smithi092 ceph-mon[29156]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:13 smithi156 ceph-mon[32679]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:13 smithi189 ceph-mon[32756]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:57:14.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:14 smithi092 ceph-mon[29156]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-26T17:57:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:14 smithi156 ceph-mon[32679]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-26T17:57:15.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.110+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1046940851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc103fd0 msgr2=0x7fdcbc1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:15.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.110+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1046940851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc103fd0 0x7fdcbc1063c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009990 tx=0x7fdcb8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1046940851 shutdown_connections 2024-04-26T17:57:15.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1046940851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcbc109230 0x7fdcbc10b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1046940851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc103fd0 0x7fdcbc1063c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1046940851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc106900 0x7fdcbc108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1046940851 >> 172.21.15.92:0/1046940851 conn(0x7fdcbc0fd980 msgr2=0x7fdcbc0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1046940851 shutdown_connections 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1046940851 wait complete. 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 Processor -- start 2024-04-26T17:57:15.114 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- start start 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcbc103fd0 0x7fdcbc199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 0x7fdcbc1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10f020 con 0x7fdcbc106900 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10eea0 con 0x7fdcbc109230 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc3a7a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc10f1a0 con 0x7fdcbc103fd0 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.111+0000 7fdcc1015700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36782/0 (socket says 172.21.15.92:36782) 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 -- 172.21.15.92:0/1037114466 learned_addr learned my addr 172.21.15.92:0/1037114466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 -- 172.21.15.92:0/1037114466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcbc103fd0 msgr2=0x7fdcbc199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcbc103fd0 0x7fdcbc199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.115 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 -- 172.21.15.92:0/1037114466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 msgr2=0x7fdcbc1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc2017700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 0x7fdcbc1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 0x7fdcbc1a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 -- 172.21.15.92:0/1037114466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc1a12c0 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc2017700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 0x7fdcbc1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc1015700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b560 tx=0x7fdcac00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac015020 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc1a15b0 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcac011ce0 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac010da0 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.112+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc1a1bc0 con 0x7fdcbc106900 2024-04-26T17:57:15.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.113+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcbc051960 con 0x7fdcbc106900 2024-04-26T17:57:15.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.114+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fdcac018020 con 0x7fdcbc106900 2024-04-26T17:57:15.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.115+0000 7fdcb2ffd700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 0x7fdca80a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:15.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.115+0000 7fdcc1816700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 0x7fdca80a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:15.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.115+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fdcac0cfb70 con 0x7fdcbc106900 2024-04-26T17:57:15.117 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.115+0000 7fdcc1816700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 0x7fdca80a6240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800b5c0 tx=0x7fdcb8003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:15.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.119+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fdcac01f020 con 0x7fdcbc106900 2024-04-26T17:57:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:14 smithi189 ceph-mon[32756]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-04-26T17:57:15.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.398+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdcbc064030 con 0x7fdcbc106900 2024-04-26T17:57:15.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.400+0000 7fdcb2ffd700 1 -- 172.21.15.92:0/1037114466 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fdcac09c600 con 0x7fdcbc106900 2024-04-26T17:57:15.400 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-04-26T17:57:15.401 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD76itm8+naFxAAAUXEGkTyO9lJEzFRaCfKrg== 2024-04-26T17:57:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 msgr2=0x7fdca80a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 0x7fdca80a6240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800b5c0 tx=0x7fdcb8003860 comp rx=0 tx=0).stop 2024-04-26T17:57:15.403 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 msgr2=0x7fdcbc199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b560 tx=0x7fdcac00b920 comp rx=0 tx=0).stop 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 shutdown_connections 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fdca80a3d80 0x7fdca80a6240 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdcbc109230 0x7fdcbc1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdcbc103fd0 0x7fdcbc199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 --2- 172.21.15.92:0/1037114466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdcbc106900 0x7fdcbc199ba0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 >> 172.21.15.92:0/1037114466 conn(0x7fdcbc0fd980 msgr2=0x7fdcbc104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.402+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 shutdown_connections 2024-04-26T17:57:15.404 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:15.403+0000 7fdcc3a7a700 1 -- 172.21.15.92:0/1037114466 wait complete. 2024-04-26T17:57:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:15 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T17:57:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:15 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T17:57:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:15 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T17:57:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:15 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T17:57:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:15 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-26T17:57:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:15 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1037114466' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-26T17:57:16.144 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:57:16.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:16.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:16.181 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T17:57:16.182 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-26T17:57:16.182 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-26T17:57:16.459 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:16.835 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:16 smithi092 ceph-mon[29156]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-26T17:57:16.835 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:16 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:16 smithi156 ceph-mon[32679]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-26T17:57:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:16 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:16 smithi189 ceph-mon[32756]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-26T17:57:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:16 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:57:18.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 -- 172.21.15.92:0/3891113408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 msgr2=0x7f73801098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 --2- 172.21.15.92:0/3891113408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73801098c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f737c00b0a0 tx=0x7f737c00b3b0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 -- 172.21.15.92:0/3891113408 shutdown_connections 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 --2- 172.21.15.92:0/3891113408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7380103e40 0x7f7380110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 --2- 172.21.15.92:0/3891113408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73801098c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 --2- 172.21.15.92:0/3891113408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73801034a0 0x7f7380103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 -- 172.21.15.92:0/3891113408 >> 172.21.15.92:0/3891113408 conn(0x7f738007a4f0 msgr2=0x7f738007a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 -- 172.21.15.92:0/3891113408 shutdown_connections 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.161+0000 7f7387d6a700 1 -- 172.21.15.92:0/3891113408 wait complete. 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 Processor -- start 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 -- start start 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73801034a0 0x7f7380075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7380103e40 0x7f7380075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:18.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73801136d0 con 0x7f73801094e0 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7380113550 con 0x7f73801034a0 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7387d6a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7380113850 con 0x7f7380103e40 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36800/0 (socket says 172.21.15.92:36800) 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 -- 172.21.15.92:0/2801201744 learned_addr learned my addr 172.21.15.92:0/2801201744 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7385b06700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73801034a0 0x7f7380075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7385305700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7380103e40 0x7f7380075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 -- 172.21.15.92:0/2801201744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7380103e40 msgr2=0x7f7380075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7380103e40 0x7f7380075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 -- 172.21.15.92:0/2801201744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73801034a0 msgr2=0x7f7380075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.162+0000 7f7386307700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73801034a0 0x7f7380075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.170 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7386307700 1 -- 172.21.15.92:0/2801201744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73801a8170 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7386307700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f737800b550 tx=0x7f737800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378015020 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73801a8460 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7378011ce0 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7378010c90 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.163+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73801a89a0 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.164+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738006a110 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.165+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7378018020 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.165+0000 7f7376ffd700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 0x7f736c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.166+0000 7f7385b06700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 0x7f736c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.166+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f73780cff60 con 0x7f73801094e0 2024-04-26T17:57:18.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.166+0000 7f7385b06700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 0x7f736c0a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f737c009fd0 tx=0x7f737c00b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:18.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.170+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f737801f020 con 0x7f73801094e0 2024-04-26T17:57:18.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.454+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f738002e490 con 0x7f73801094e0 2024-04-26T17:57:18.459 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.459+0000 7f7376ffd700 1 -- 172.21.15.92:0/2801201744 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264996 (secure 0 0 0) 0x7f737809c9f0 con 0x7f73801094e0 2024-04-26T17:57:18.462 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:18.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 msgr2=0x7f736c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 0x7f736c0a6190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f737c009fd0 tx=0x7f737c00b7b0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 msgr2=0x7f73800761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f737800b550 tx=0x7f737800b860 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 shutdown_connections 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f736c0a3cd0 0x7f736c0a6190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73801034a0 0x7f7380075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f73801094e0 0x7f73800761a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 --2- 172.21.15.92:0/2801201744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7380103e40 0x7f7380075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 >> 172.21.15.92:0/2801201744 conn(0x7f738007a4f0 msgr2=0x7f73801016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 shutdown_connections 2024-04-26T17:57:18.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:18.463+0000 7f7387d6a700 1 -- 172.21.15.92:0/2801201744 wait complete. 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2801201744' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:18 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2801201744' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:18 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 682 B/s wr, 5 op/s 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2801201744' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:18 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:19.621 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":3474750194},{"type":"v1","addr":"172.21.15.92:6801","nonce":3474750194}]},"active_addr":"172.21.15.92:6801/3474750194","active_change":"2024-04-26T17:48:57.534319+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.92:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2102193738}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":2513488882}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":820323492}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":698745886}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.92:0","nonce":3885570608}]}]} 2024-04-26T17:57:19.631 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-26T17:57:19.631 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-26T17:57:19.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:57:19.889 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:20 smithi156 ceph-mon[32679]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-26T17:57:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:20 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:20 smithi092 ceph-mon[29156]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-26T17:57:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:20 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:20 smithi189 ceph-mon[32756]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-04-26T17:57:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:20 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 -- 172.21.15.92:0/3752437337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c1094a0 msgr2=0x7f166c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 --2- 172.21.15.92:0/3752437337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c1094a0 0x7f166c109880 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f165c009990 tx=0x7f165c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 -- 172.21.15.92:0/3752437337 shutdown_connections 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 --2- 172.21.15.92:0/3752437337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 0x7f166c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 --2- 172.21.15.92:0/3752437337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c1094a0 0x7f166c109880 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 --2- 172.21.15.92:0/3752437337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c06bb70 0x7f166c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 -- 172.21.15.92:0/3752437337 >> 172.21.15.92:0/3752437337 conn(0x7f166c0792f0 msgr2=0x7f166c079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 -- 172.21.15.92:0/3752437337 shutdown_connections 2024-04-26T17:57:21.643 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.642+0000 7f16718e1700 1 -- 172.21.15.92:0/3752437337 wait complete. 2024-04-26T17:57:21.645 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.643+0000 7f16718e1700 1 Processor -- start 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.643+0000 7f16718e1700 1 -- start start 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.643+0000 7f16718e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.643+0000 7f16718e1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 0x7f166c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c1094a0 0x7f166c1999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f166c1135e0 con 0x7f166c06bb70 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f166c113460 con 0x7f166c1094a0 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f166c113760 con 0x7f166c06c510 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36808/0 (socket says 172.21.15.92:36808) 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 -- 172.21.15.92:0/1517149192 learned_addr learned my addr 172.21.15.92:0/1517149192 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166b7fe700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c1094a0 0x7f166c1999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:21.646 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166a7fc700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 0x7f166c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 -- 172.21.15.92:0/1517149192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 msgr2=0x7f166c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 0x7f166c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 -- 172.21.15.92:0/1517149192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c1094a0 msgr2=0x7f166c1999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c1094a0 0x7f166c1999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 -- 172.21.15.92:0/1517149192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c19a100 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f166affd700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c026070 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c19a390 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f165c003f20 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00fc30 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.644+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c1a66b0 con 0x7f166c06bb70 2024-04-26T17:57:21.647 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.645+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c06a110 con 0x7f166c06bb70 2024-04-26T17:57:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.647+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f165c029070 con 0x7f166c06bb70 2024-04-26T17:57:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.647+0000 7f16708df700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 0x7f16540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.647+0000 7f166a7fc700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 0x7f16540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.647+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f165c0d0da0 con 0x7f166c06bb70 2024-04-26T17:57:21.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.648+0000 7f166a7fc700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 0x7f16540a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f166c0799f0 tx=0x7f166000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:21.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.652+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f165c05dff0 con 0x7f166c06bb70 2024-04-26T17:57:21.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.870+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f166c02e490 con 0x7f166c06bb70 2024-04-26T17:57:21.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.872+0000 7f16708df700 1 -- 172.21.15.92:0/1517149192 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22478 (secure 0 0 0) 0x7f165c013070 con 0x7f166c06bb70 2024-04-26T17:57:21.873 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:21.874 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":90,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:58.617254+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:21.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 msgr2=0x7f16540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:21.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 0x7f16540a6190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f166c0799f0 tx=0x7f166000a300 comp rx=0 tx=0).stop 2024-04-26T17:57:21.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 msgr2=0x7f166c19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:21.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c0057c0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 shutdown_connections 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f16540a3cd0 0x7f16540a6190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c1094a0 0x7f166c1999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f166c06bb70 0x7f166c19f7e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 --2- 172.21.15.92:0/1517149192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f166c06c510 0x7f166c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 >> 172.21.15.92:0/1517149192 conn(0x7f166c0792f0 msgr2=0x7f166c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 shutdown_connections 2024-04-26T17:57:21.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:21.875+0000 7f16718e1700 1 -- 172.21.15.92:0/1517149192 wait complete. 2024-04-26T17:57:22.584 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-26T17:57:22.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:57:22.831 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:22.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:22 smithi092 ceph-mon[29156]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:22.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:22.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:22.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:22.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:22 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1517149192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:22 smithi156 ceph-mon[32679]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:22 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1517149192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:22 smithi189 ceph-mon[32756]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:57:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:57:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:57:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:22 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1517149192' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 -- 172.21.15.92:0/4231244437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 msgr2=0x7f2e2c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 --2- 172.21.15.92:0/4231244437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c108770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009990 tx=0x7f2e20009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 -- 172.21.15.92:0/4231244437 shutdown_connections 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 --2- 172.21.15.92:0/4231244437 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 --2- 172.21.15.92:0/4231244437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c108770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 --2- 172.21.15.92:0/4231244437 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102320 0x7f2e2c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 -- 172.21.15.92:0/4231244437 >> 172.21.15.92:0/4231244437 conn(0x7f2e2c0792d0 msgr2=0x7f2e2c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:24.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 -- 172.21.15.92:0/4231244437 shutdown_connections 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.595+0000 7f2e33014700 1 -- 172.21.15.92:0/4231244437 wait complete. 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 Processor -- start 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 -- start start 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102320 0x7f2e2c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c1124b0 con 0x7f2e2c108390 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c112330 con 0x7f2e2c102ce0 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e33014700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c112630 con 0x7f2e2c102320 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49230/0 (socket says 172.21.15.92:49230) 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 -- 172.21.15.92:0/81739906 learned_addr learned my addr 172.21.15.92:0/81739906 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e30db0700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102320 0x7f2e2c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:24.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e2bfff700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 -- 172.21.15.92:0/81739906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102320 msgr2=0x7f2e2c19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102320 0x7f2e2c19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 -- 172.21.15.92:0/81739906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 msgr2=0x7f2e2c19ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c19ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 -- 172.21.15.92:0/81739906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1a5ed0 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e2bfff700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.596+0000 7f2e315b1700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e24007d70 tx=0x7f2e2400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.597+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24016020 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.597+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e2400ad40 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.597+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240115e0 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.597+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c1a6160 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.597+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c1a66c0 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.598+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c06a110 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.599+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2e24019020 con 0x7f2e2c108390 2024-04-26T17:57:24.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.599+0000 7f2e29ffb700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 0x7f2e1c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:24.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.600+0000 7f2e30db0700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 0x7f2e1c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:24.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.600+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f2e240d01e0 con 0x7f2e2c108390 2024-04-26T17:57:24.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.600+0000 7f2e30db0700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 0x7f2e1c0a6210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e20005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:24.606 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.604+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2e24020020 con 0x7f2e2c108390 2024-04-26T17:57:24.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.810+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e2c02e490 con 0x7f2e2c108390 2024-04-26T17:57:24.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.812+0000 7f2e29ffb700 1 -- 172.21.15.92:0/81739906 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22478 (secure 0 0 0) 0x7f2e2409cc70 con 0x7f2e2c108390 2024-04-26T17:57:24.812 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:57:24.813 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":90,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:58.617254+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:24.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 msgr2=0x7f2e1c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:24.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 0x7f2e1c0a6210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e200098e0 tx=0x7f2e20005960 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 msgr2=0x7f2e2c1a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e24007d70 tx=0x7f2e2400a340 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 shutdown_connections 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2e1c0a3d50 0x7f2e1c0a6210 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e2c108390 0x7f2e2c1a5990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2e2c102320 0x7f2e2c19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 --2- 172.21.15.92:0/81739906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e2c102ce0 0x7f2e2c19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 >> 172.21.15.92:0/81739906 conn(0x7f2e2c0792d0 msgr2=0x7f2e2c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 shutdown_connections 2024-04-26T17:57:24.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:24.814+0000 7f2e33014700 1 -- 172.21.15.92:0/81739906 wait complete. 2024-04-26T17:57:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:24 smithi092 ceph-mon[29156]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:24 smithi189 ceph-mon[32756]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:24 smithi156 ceph-mon[32679]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:25.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-26T17:57:25.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-26T17:57:25.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-26T17:57:25.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-26T17:57:25.521 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-26T17:57:25.522 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-26T17:57:25.522 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-26T17:57:25.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-26T17:57:25.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-26T17:57:25.523 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-26T17:57:25.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-26T17:57:25.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-26T17:57:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:25 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/81739906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:25 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/81739906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:26.166 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:26.175 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:26.176 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:26.178 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:26.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:25 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/81739906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:57:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:26 smithi092 ceph-mon[29156]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:27.004 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.004 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.005 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.006 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.007 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.014 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:26 smithi189 ceph-mon[32756]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:26 smithi156 ceph-mon[32679]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:28 smithi092 ceph-mon[29156]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:28 smithi189 ceph-mon[32756]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:28 smithi156 ceph-mon[32679]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:30.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:30 smithi092 ceph-mon[29156]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:30 smithi189 ceph-mon[32756]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:31.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:30 smithi156 ceph-mon[32679]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:32.478 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:32.948 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:32 smithi092 ceph-mon[29156]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/1829293626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b81094c0 msgr2=0x7fd5b81098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/1829293626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b81094c0 0x7fd5b81098a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009990 tx=0x7fd5a8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/1829293626 shutdown_connections 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/1829293626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b8103e30 0x7fd5b8110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/1829293626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b81094c0 0x7fd5b81098a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/1829293626 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103470 0x7fd5b81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.055+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/1829293626 >> 172.21.15.92:0/1829293626 conn(0x7fd5b807a580 msgr2=0x7fd5b807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.056+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/1829293626 shutdown_connections 2024-04-26T17:57:33.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.056+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/1829293626 wait complete. 2024-04-26T17:57:33.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.056+0000 7fd5bf6e0700 1 Processor -- start 2024-04-26T17:57:33.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.056+0000 7fd5bf6e0700 1 -- start start 2024-04-26T17:57:33.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 0x7fd5b8199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103e30 0x7fd5b819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b81094c0 0x7fd5b819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b81136c0 con 0x7fd5b8103470 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b8113540 con 0x7fd5b81094c0 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b8113840 con 0x7fd5b8103e30 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 0x7fd5b8199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 0x7fd5b8199d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49252/0 (socket says 172.21.15.92:49252) 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 -- 172.21.15.92:0/2998391079 learned_addr learned my addr 172.21.15.92:0/2998391079 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bcc7b700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103e30 0x7fd5b819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bdc7d700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b81094c0 0x7fd5b819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 -- 172.21.15.92:0/2998391079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103e30 msgr2=0x7fd5b819a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103e30 0x7fd5b819a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 -- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b81094c0 msgr2=0x7fd5b819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b81094c0 0x7fd5b819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b819ed20 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bcc7b700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd5b8103e30 0x7fd5b819a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bdc7d700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b81094c0 0x7fd5b819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bd47c700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 0x7fd5b8199d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8000c00 tx=0x7fd5a80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8027070 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5a80041d0 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800f460 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b819efb0 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.057+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b81a6890 con 0x7fd5b8103470 2024-04-26T17:57:33.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.058+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5b8063b30 con 0x7fd5b8103470 2024-04-26T17:57:33.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.059+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd5a802a070 con 0x7fd5b8103470 2024-04-26T17:57:33.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5ae7fc700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd5a40a3d50 0x7fd5a40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:33.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5bcc7b700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd5a40a3d50 0x7fd5a40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:33.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fd5a80d1ae0 con 0x7fd5b8103470 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5ae7fc700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] conn(0x7fd5a40ad790 0x7fd5a40afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5a8019e80 con 0x7fd5a40ad790 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd5a80d1fc0 con 0x7fd5b8103470 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.060+0000 7fd5bcc7b700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd5a40a3d50 0x7fd5a40a6210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5b807aca0 tx=0x7fd5b4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.061+0000 7fd5bdc7d700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] conn(0x7fd5a40ad790 0x7fd5a40afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.061+0000 7fd5bdc7d700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] conn(0x7fd5a40ad790 0x7fd5a40afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:33.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.062+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== osd.4 v2:172.21.15.156:6808/4116221322 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5a8019e80 con 0x7fd5a40ad790 2024-04-26T17:57:33.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.079+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 --> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5b8063f30 con 0x7fd5a40ad790 2024-04-26T17:57:33.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.079+0000 7fd5ae7fc700 1 -- 172.21.15.92:0/2998391079 <== osd.4 v2:172.21.15.156:6808/4116221322 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd5b8063f30 con 0x7fd5a40ad790 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] conn(0x7fd5a40ad790 msgr2=0x7fd5a40afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] conn(0x7fd5a40ad790 0x7fd5a40afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd5a40a3d50 msgr2=0x7fd5a40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd5a40a3d50 0x7fd5a40a6210 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5b807aca0 tx=0x7fd5b4008040 comp rx=0 tx=0).stop 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 msgr2=0x7fd5b8199d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:33.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 --2- 172.21.15.92:0/2998391079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b8103470 0x7fd5b8199d10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8000c00 tx=0x7fd5a80047b0 comp rx=0 tx=0).stop 2024-04-26T17:57:33.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bdc7d700 1 -- 172.21.15.92:0/2998391079 reap_dead start 2024-04-26T17:57:33.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 shutdown_connections 2024-04-26T17:57:33.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 >> 172.21.15.92:0/2998391079 conn(0x7fd5b807a580 msgr2=0x7fd5b8102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:33.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 shutdown_connections 2024-04-26T17:57:33.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:33.080+0000 7fd5bf6e0700 1 -- 172.21.15.92:0/2998391079 wait complete. 2024-04-26T17:57:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:32 smithi189 ceph-mon[32756]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:33.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:32 smithi156 ceph-mon[32679]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:34.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:34 smithi092 ceph-mon[29156]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:34 smithi189 ceph-mon[32756]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:34 smithi156 ceph-mon[32679]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:36.789 INFO:teuthology.orchestra.run.smithi092.stdout:141733920835 2024-04-26T17:57:36.790 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-26T17:57:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:36 smithi092 ceph-mon[29156]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:36 smithi189 ceph-mon[32756]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:36 smithi156 ceph-mon[32679]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 -- 172.21.15.92:0/2767072134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 msgr2=0x7fe29406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 --2- 172.21.15.92:0/2767072134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29406bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe284009990 tx=0x7fe284009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 -- 172.21.15.92:0/2767072134 shutdown_connections 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 --2- 172.21.15.92:0/2767072134 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29410ff00 0x7fe2941122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 --2- 172.21.15.92:0/2767072134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29406bf30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 --2- 172.21.15.92:0/2767072134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29406c470 0x7fe29410f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 -- 172.21.15.92:0/2767072134 >> 172.21.15.92:0/2767072134 conn(0x7fe2940792d0 msgr2=0x7fe2940796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 -- 172.21.15.92:0/2767072134 shutdown_connections 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.959+0000 7fe299edf700 1 -- 172.21.15.92:0/2767072134 wait complete. 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 Processor -- start 2024-04-26T17:57:38.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 -- start start 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29406c470 0x7fe29419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29410ff00 0x7fe2941a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe294115850 con 0x7fe29406bb50 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941156d0 con 0x7fe29410ff00 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe299edf700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe2941159d0 con 0x7fe29406c470 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe2937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe2937fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45154/0 (socket says 172.21.15.92:45154) 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.960+0000 7fe2937fe700 1 -- 172.21.15.92:0/126123651 learned_addr learned my addr 172.21.15.92:0/126123651 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe292ffd700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29406c470 0x7fe29419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe293fff700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29410ff00 0x7fe2941a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 -- 172.21.15.92:0/126123651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29406c470 msgr2=0x7fe29419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29406c470 0x7fe29419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 -- 172.21.15.92:0/126123651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29410ff00 msgr2=0x7fe2941a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29410ff00 0x7fe2941a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2941a0d60 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe292ffd700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe29406c470 0x7fe29419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe293fff700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe29410ff00 0x7fe2941a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe2937fe700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29419bda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2840057f0 tx=0x7fe284003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284027070 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2941a0ff0 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2840041c0 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284022e60 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.961+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2941a88d0 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.962+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe294063bb0 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.963+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fe28402a070 con 0x7fe29406bb50 2024-04-26T17:57:38.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.963+0000 7fe290ff9700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe27c0a3cd0 0x7fe27c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe292ffd700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe27c0a3cd0 0x7fe27c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fe2840d1a10 con 0x7fe29406bb50 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe290ff9700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] conn(0x7fe27c0ad710 0x7fe27c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe28400ce90 con 0x7fe27c0ad710 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe2840d1ef0 con 0x7fe29406bb50 2024-04-26T17:57:38.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe292ffd700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe27c0a3cd0 0x7fe27c0a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2941038d0 tx=0x7fe288008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe293fff700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] conn(0x7fe27c0ad710 0x7fe27c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.964+0000 7fe293fff700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] conn(0x7fe27c0ad710 0x7fe27c0afbb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.965+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== osd.6 v2:172.21.15.92:6818/776474757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe28400ce90 con 0x7fe27c0ad710 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.981+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 --> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe294063fb0 con 0x7fe27c0ad710 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.981+0000 7fe290ff9700 1 -- 172.21.15.92:0/126123651 <== osd.6 v2:172.21.15.92:6818/776474757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe294063fb0 con 0x7fe27c0ad710 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] conn(0x7fe27c0ad710 msgr2=0x7fe27c0afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] conn(0x7fe27c0ad710 0x7fe27c0afbb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe27c0a3cd0 msgr2=0x7fe27c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe27c0a3cd0 0x7fe27c0a6190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2941038d0 tx=0x7fe288008040 comp rx=0 tx=0).stop 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 msgr2=0x7fe29419bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 --2- 172.21.15.92:0/126123651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe29406bb50 0x7fe29419bda0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2840057f0 tx=0x7fe284003730 comp rx=0 tx=0).stop 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe293fff700 1 -- 172.21.15.92:0/126123651 reap_dead start 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 shutdown_connections 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 >> 172.21.15.92:0/126123651 conn(0x7fe2940792d0 msgr2=0x7fe294111550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:38.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 shutdown_connections 2024-04-26T17:57:38.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:37.982+0000 7fe299edf700 1 -- 172.21.15.92:0/126123651 wait complete. 2024-04-26T17:57:38.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 -- 172.21.15.92:0/4201945142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb41083d0 msgr2=0x7f7bb41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/4201945142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb41083d0 0x7f7bb41087b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009990 tx=0x7f7bac009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 -- 172.21.15.92:0/4201945142 shutdown_connections 2024-04-26T17:57:38.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/4201945142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bb4102d10 0x7f7bb410f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/4201945142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb41083d0 0x7f7bb41087b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/4201945142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb4102350 0x7f7bb41027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 -- 172.21.15.92:0/4201945142 >> 172.21.15.92:0/4201945142 conn(0x7f7bb4078390 msgr2=0x7f7bb40787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 -- 172.21.15.92:0/4201945142 shutdown_connections 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.495+0000 7f7bbafe2700 1 -- 172.21.15.92:0/4201945142 wait complete. 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 Processor -- start 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 -- start start 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bb4102350 0x7f7bb419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 0x7f7bb419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb41083d0 0x7f7bb4199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb41124e0 con 0x7f7bb4102d10 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4112360 con 0x7f7bb41083d0 2024-04-26T17:57:38.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb4112660 con 0x7f7bb4102350 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 0x7f7bb419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 0x7f7bb419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45180/0 (socket says 172.21.15.92:45180) 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 -- 172.21.15.92:0/3864398507 learned_addr learned my addr 172.21.15.92:0/3864398507 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb8d7e700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bb4102350 0x7f7bb419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb957f700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb41083d0 0x7f7bb4199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 -- 172.21.15.92:0/3864398507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bb4102350 msgr2=0x7f7bb419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7bb4102350 0x7f7bb419f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 -- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb41083d0 msgr2=0x7f7bb4199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb41083d0 0x7f7bb4199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb419a0b0 con 0x7f7bb4102d10 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb957f700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bb41083d0 0x7f7bb4199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb3fff700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 0x7f7bb419fcd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4007f10 tx=0x7f7ba400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba400dc90 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ba400de30 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.496+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb419a3a0 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.497+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40133f0 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.497+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb41a6660 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.497+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bb406be40 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7ba401a020 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7ba00a3cd0 0x7f7ba00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb8d7e700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7ba00a3cd0 0x7f7ba00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7ba40d0430 con 0x7f7bb4102d10 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] conn(0x7f7ba00ad770 0x7f7ba00afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ba400ee50 con 0x7f7ba00ad770 2024-04-26T17:57:38.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.499+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f7ba40d0910 con 0x7f7bb4102d10 2024-04-26T17:57:38.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.500+0000 7f7bb8d7e700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7ba00a3cd0 0x7f7ba00a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00b5c0 tx=0x7f7bac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.500+0000 7f7bb957f700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] conn(0x7f7ba00ad770 0x7f7ba00afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.500+0000 7f7bb957f700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] conn(0x7f7ba00ad770 0x7f7ba00afc10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.501+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== osd.1 v2:172.21.15.156:6800/2277484225 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ba400ee50 con 0x7f7ba00ad770 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.518+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 --> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7bb4103a40 con 0x7f7ba00ad770 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bb1ffb700 1 -- 172.21.15.92:0/3864398507 <== osd.1 v2:172.21.15.156:6800/2277484225 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7bb4103a40 con 0x7f7ba00ad770 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] conn(0x7f7ba00ad770 msgr2=0x7f7ba00afc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] conn(0x7f7ba00ad770 0x7f7ba00afc10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7ba00a3cd0 msgr2=0x7f7ba00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7ba00a3cd0 0x7f7ba00a6190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00b5c0 tx=0x7f7bac005fb0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 msgr2=0x7f7bb419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 --2- 172.21.15.92:0/3864398507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bb4102d10 0x7f7bb419fcd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7ba4007f10 tx=0x7f7ba400d3b0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bb957f700 1 -- 172.21.15.92:0/3864398507 reap_dead start 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 shutdown_connections 2024-04-26T17:57:38.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.519+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 >> 172.21.15.92:0/3864398507 conn(0x7f7bb4078390 msgr2=0x7f7bb41016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:38.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.520+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 shutdown_connections 2024-04-26T17:57:38.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.520+0000 7f7bbafe2700 1 -- 172.21.15.92:0/3864398507 wait complete. 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 -- 172.21.15.92:0/800986322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188103470 msgr2=0x7f51881038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 --2- 172.21.15.92:0/800986322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188103470 0x7f51881038f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5184009990 tx=0x7f5184009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 -- 172.21.15.92:0/800986322 shutdown_connections 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 --2- 172.21.15.92:0/800986322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51881094c0 0x7f51881098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 --2- 172.21.15.92:0/800986322 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188103e30 0x7f5188110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 --2- 172.21.15.92:0/800986322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5188103470 0x7f51881038f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.982 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 -- 172.21.15.92:0/800986322 >> 172.21.15.92:0/800986322 conn(0x7f518807a580 msgr2=0x7f518807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:38.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:38 smithi092 ceph-mon[29156]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:38.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 -- 172.21.15.92:0/800986322 shutdown_connections 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 -- 172.21.15.92:0/800986322 wait complete. 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.983+0000 7f518fa47700 1 Processor -- start 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 -- start start 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188103470 0x7f518819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5188103e30 0x7f518819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 0x7f5188199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51881135f0 con 0x7f51881094c0 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5188113470 con 0x7f5188103e30 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518fa47700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5188113770 con 0x7f5188103470 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 0x7f5188199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 0x7f5188199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45188/0 (socket says 172.21.15.92:45188) 2024-04-26T17:57:38.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 -- 172.21.15.92:0/232307763 learned_addr learned my addr 172.21.15.92:0/232307763 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518d7e3700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188103470 0x7f518819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518cfe2700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5188103e30 0x7f518819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 -- 172.21.15.92:0/232307763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188103470 msgr2=0x7f518819f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5188103470 0x7f518819f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 -- 172.21.15.92:0/232307763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5188103e30 msgr2=0x7f518819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5188103e30 0x7f518819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518819a090 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f518dfe4700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 0x7f5188199930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5180007ee0 tx=0x7f518000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.984+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518000dbd0 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.985+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518819a380 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.985+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f518000dd70 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.985+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180005990 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.985+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881a6640 con 0x7f51881094c0 2024-04-26T17:57:38.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.985+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5188063b70 con 0x7f51881094c0 2024-04-26T17:57:38.987 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:38 smithi156 ceph-mon[32679]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.987+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f518001a020 con 0x7f51881094c0 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.987+0000 7f517e7fc700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51740a3cd0 0x7f51740a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.987+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f51800d02f0 con 0x7f51881094c0 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.987+0000 7f518d7e3700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51740a3cd0 0x7f51740a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f517e7fc700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] conn(0x7f51740ad710 0x7f51740afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:38.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51740b0280 con 0x7f51740ad710 2024-04-26T17:57:38.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f51800d07d0 con 0x7f51881094c0 2024-04-26T17:57:38.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f518cfe2700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] conn(0x7f51740ad710 0x7f51740afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:38.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f518d7e3700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51740a3cd0 0x7f51740a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5178005950 tx=0x7f517800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.988+0000 7f518cfe2700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] conn(0x7f51740ad710 0x7f51740afbb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:38.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:38.989+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== osd.0 v2:172.21.15.92:6802/2855272540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f51740b0280 con 0x7f51740ad710 2024-04-26T17:57:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 --> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5188063f70 con 0x7f51740ad710 2024-04-26T17:57:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f517e7fc700 1 -- 172.21.15.92:0/232307763 <== osd.0 v2:172.21.15.92:6802/2855272540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5188063f70 con 0x7f51740ad710 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] conn(0x7f51740ad710 msgr2=0x7f51740afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] conn(0x7f51740ad710 0x7f51740afbb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51740a3cd0 msgr2=0x7f51740a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51740a3cd0 0x7f51740a6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5178005950 tx=0x7f517800a300 comp rx=0 tx=0).stop 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 msgr2=0x7f5188199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 --2- 172.21.15.92:0/232307763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51881094c0 0x7f5188199930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5180007ee0 tx=0x7f518000d3b0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518dfe4700 1 -- 172.21.15.92:0/232307763 reap_dead start 2024-04-26T17:57:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 shutdown_connections 2024-04-26T17:57:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 >> 172.21.15.92:0/232307763 conn(0x7f518807a580 msgr2=0x7f51881022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 shutdown_connections 2024-04-26T17:57:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.005+0000 7f518fa47700 1 -- 172.21.15.92:0/232307763 wait complete. 2024-04-26T17:57:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:38 smithi189 ceph-mon[32756]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.158+0000 7f3655ac4700 1 -- 172.21.15.92:0/2001521812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650102f60 msgr2=0x7f3650106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.158+0000 7f3655ac4700 1 --2- 172.21.15.92:0/2001521812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650102f60 0x7f3650106f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36440099c0 tx=0x7f3644009cd0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.158+0000 7f3655ac4700 1 -- 172.21.15.92:0/2001521812 shutdown_connections 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.158+0000 7f3655ac4700 1 --2- 172.21.15.92:0/2001521812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36501025b0 0x7f3650102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 --2- 172.21.15.92:0/2001521812 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3650107640 0x7f365010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 --2- 172.21.15.92:0/2001521812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650102f60 0x7f3650106f60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 -- 172.21.15.92:0/2001521812 >> 172.21.15.92:0/2001521812 conn(0x7f36500792d0 msgr2=0x7f36500796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 -- 172.21.15.92:0/2001521812 shutdown_connections 2024-04-26T17:57:39.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 -- 172.21.15.92:0/2001521812 wait complete. 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.159+0000 7f3655ac4700 1 Processor -- start 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 -- start start 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36501025b0 0x7f365019e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3650102f60 0x7f365019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 0x7f3650198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3650112580 con 0x7f3650107640 2024-04-26T17:57:39.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3650112400 con 0x7f36501025b0 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f3655ac4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3650112700 con 0x7f3650102f60 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 0x7f3650198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 0x7f3650198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45210/0 (socket says 172.21.15.92:45210) 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 -- 172.21.15.92:0/269371936 learned_addr learned my addr 172.21.15.92:0/269371936 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364f7fe700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36501025b0 0x7f365019e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364effd700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3650102f60 0x7f365019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 -- 172.21.15.92:0/269371936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3650102f60 msgr2=0x7f365019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3650102f60 0x7f365019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 -- 172.21.15.92:0/269371936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36501025b0 msgr2=0x7f365019e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36501025b0 0x7f365019e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.160+0000 7f364ffff700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3650199060 con 0x7f3650107640 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f364ffff700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 0x7f3650198900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f364800b550 tx=0x7f364800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648015020 con 0x7f3650107640 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3650199350 con 0x7f3650107640 2024-04-26T17:57:39.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3648011ce0 con 0x7f3650107640 2024-04-26T17:57:39.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648010c90 con 0x7f3650107640 2024-04-26T17:57:39.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.161+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501a5610 con 0x7f3650107640 2024-04-26T17:57:39.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.162+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3650063bb0 con 0x7f3650107640 2024-04-26T17:57:39.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.164+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3648018020 con 0x7f3650107640 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364cff9700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36380a3d50 0x7f36380a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f36480cfac0 con 0x7f3650107640 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364f7fe700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36380a3d50 0x7f36380a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364cff9700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] conn(0x7f36380ad790 0x7f36380afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3648007e50 con 0x7f36380ad790 2024-04-26T17:57:39.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f36480d42a0 con 0x7f3650107640 2024-04-26T17:57:39.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.165+0000 7f364effd700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] conn(0x7f36380ad790 0x7f36380afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:39.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.166+0000 7f364f7fe700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36380a3d50 0x7f36380a6210 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3650199a40 tx=0x7f364000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:39.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.166+0000 7f364effd700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] conn(0x7f36380ad790 0x7f36380afc30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:39.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.167+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== osd.9 v2:172.21.15.92:6826/452175931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3648007e50 con 0x7f36380ad790 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 --> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3650063fe0 con 0x7f36380ad790 2024-04-26T17:57:39.183 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f364cff9700 1 -- 172.21.15.92:0/269371936 <== osd.9 v2:172.21.15.92:6826/452175931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3650063fe0 con 0x7f36380ad790 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] conn(0x7f36380ad790 msgr2=0x7f36380afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] conn(0x7f36380ad790 0x7f36380afc30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36380a3d50 msgr2=0x7f36380a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36380a3d50 0x7f36380a6210 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3650199a40 tx=0x7f364000b040 comp rx=0 tx=0).stop 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 msgr2=0x7f3650198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 --2- 172.21.15.92:0/269371936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3650107640 0x7f3650198900 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f364800b550 tx=0x7f364800b860 comp rx=0 tx=0).stop 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f364ffff700 1 -- 172.21.15.92:0/269371936 reap_dead start 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 shutdown_connections 2024-04-26T17:57:39.184 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.184+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 >> 172.21.15.92:0/269371936 conn(0x7f36500792d0 msgr2=0x7f36501006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.185+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 shutdown_connections 2024-04-26T17:57:39.185 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:39.185+0000 7f3655ac4700 1 -- 172.21.15.92:0/269371936 wait complete. 2024-04-26T17:57:39.730 INFO:teuthology.orchestra.run.smithi092.stdout:197568495674 2024-04-26T17:57:39.730 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-26T17:57:40.622 INFO:teuthology.orchestra.run.smithi092.stdout:34359738456 2024-04-26T17:57:40.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-26T17:57:40.787 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:40 smithi092 ceph-mon[29156]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:40 smithi189 ceph-mon[32756]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:40 smithi156 ceph-mon[32679]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:41.842 INFO:teuthology.orchestra.run.smithi092.stdout:55834574931 2024-04-26T17:57:41.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-26T17:57:42.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:42 smithi092 ceph-mon[29156]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:42 smithi189 ceph-mon[32756]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:42 smithi156 ceph-mon[32679]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:57:43.742 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:44.773 INFO:teuthology.orchestra.run.smithi092.stdout:287762808874 2024-04-26T17:57:44.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-26T17:57:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:44 smithi092 ceph-mon[29156]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 -- 172.21.15.92:0/2198247453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81083b0 msgr2=0x7feec8108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 --2- 172.21.15.92:0/2198247453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81083b0 0x7feec8108790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099c0 tx=0x7feeb8009cd0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 -- 172.21.15.92:0/2198247453 shutdown_connections 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 --2- 172.21.15.92:0/2198247453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feec8103e90 0x7feec8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 --2- 172.21.15.92:0/2198247453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81083b0 0x7feec8108790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 --2- 172.21.15.92:0/2198247453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec81034d0 0x7feec8103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.109 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 -- 172.21.15.92:0/2198247453 >> 172.21.15.92:0/2198247453 conn(0x7feec807a580 msgr2=0x7feec807a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 -- 172.21.15.92:0/2198247453 shutdown_connections 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.103+0000 7feece7de700 1 -- 172.21.15.92:0/2198247453 wait complete. 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 Processor -- start 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 -- start start 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 0x7feec819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8103e90 0x7feec819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feec81083b0 0x7feec8199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feec8113640 con 0x7feec81034d0 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7feec81134c0 con 0x7feec8103e90 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feece7de700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feec81137c0 con 0x7feec81083b0 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feec7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 0x7feec819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feec7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 0x7feec819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60242/0 (socket says 172.21.15.92:60242) 2024-04-26T17:57:45.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feec7fff700 1 -- 172.21.15.92:0/3697237116 learned_addr learned my addr 172.21.15.92:0/3697237116 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feec77fe700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8103e90 0x7feec819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.104+0000 7feeccd7b700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feec81083b0 0x7feec8199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 -- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feec81083b0 msgr2=0x7feec8199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feec81083b0 0x7feec8199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 -- 172.21.15.92:0/3697237116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8103e90 msgr2=0x7feec819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feec8103e90 0x7feec819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec819a0c0 con 0x7feec81034d0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec7fff700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 0x7feec819f7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feeb800b580 tx=0x7feeb80037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8027070 con 0x7feec81034d0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feeb8004110 con 0x7feec81034d0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb800f460 con 0x7feec81034d0 2024-04-26T17:57:45.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec819a350 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.105+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81a6670 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.106+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feec8063b70 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.107+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7feeb802a070 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.107+0000 7feec57fa700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feeb00a3cd0 0x7feeb00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.107+0000 7feec77fe700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feeb00a3cd0 0x7feeb00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7feeb80d1ac0 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feec57fa700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] conn(0x7feeb00ad710 0x7feeb00afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feeb80043d0 con 0x7feeb00ad710 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7feeb80d1fa0 con 0x7feec81034d0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feec77fe700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feeb00a3cd0 0x7feeb00a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feebc005fd0 tx=0x7feebc00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feeccd7b700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] conn(0x7feeb00ad710 0x7feeb00afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.108+0000 7feeccd7b700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] conn(0x7feeb00ad710 0x7feeb00afbb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.109+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== osd.8 v2:172.21.15.189:6816/887620459 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feeb80043d0 con 0x7feeb00ad710 2024-04-26T17:57:45.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.129+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 --> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feec8063ff0 con 0x7feeb00ad710 2024-04-26T17:57:45.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feec57fa700 1 -- 172.21.15.92:0/3697237116 <== osd.8 v2:172.21.15.189:6816/887620459 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feec8063ff0 con 0x7feeb00ad710 2024-04-26T17:57:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] conn(0x7feeb00ad710 msgr2=0x7feeb00afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] conn(0x7feeb00ad710 0x7feeb00afbb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feeb00a3cd0 msgr2=0x7feeb00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7feeb00a3cd0 0x7feeb00a6190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feebc005fd0 tx=0x7feebc00a560 comp rx=0 tx=0).stop 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 msgr2=0x7feec819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feece7de700 1 --2- 172.21.15.92:0/3697237116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feec81034d0 0x7feec819f7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feeb800b580 tx=0x7feeb80037c0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.130+0000 7feeccd7b700 1 -- 172.21.15.92:0/3697237116 reap_dead start 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.131+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 shutdown_connections 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.131+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 >> 172.21.15.92:0/3697237116 conn(0x7feec807a580 msgr2=0x7feec81015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.131+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 shutdown_connections 2024-04-26T17:57:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.131+0000 7feece7de700 1 -- 172.21.15.92:0/3697237116 wait complete. 2024-04-26T17:57:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:44 smithi189 ceph-mon[32756]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:44 smithi156 ceph-mon[32679]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- 172.21.15.92:0/2064993319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c1094a0 msgr2=0x7fb78c109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 --2- 172.21.15.92:0/2064993319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c1094a0 0x7fb78c109880 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb788009990 tx=0x7fb788009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- 172.21.15.92:0/2064993319 shutdown_connections 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 --2- 172.21.15.92:0/2064993319 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb78c06c510 0x7fb78c1102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 --2- 172.21.15.92:0/2064993319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c1094a0 0x7fb78c109880 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 --2- 172.21.15.92:0/2064993319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c06bb70 0x7fb78c06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- 172.21.15.92:0/2064993319 >> 172.21.15.92:0/2064993319 conn(0x7fb78c0792f0 msgr2=0x7fb78c079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- 172.21.15.92:0/2064993319 shutdown_connections 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- 172.21.15.92:0/2064993319 wait complete. 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 Processor -- start 2024-04-26T17:57:45.719 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.717+0000 7fb793cff700 1 -- start start 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb78c06bb70 0x7fb78c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 0x7fb78c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c1094a0 0x7fb78c1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c113610 con 0x7fb78c06c510 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c113490 con 0x7fb78c1094a0 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c113790 con 0x7fb78c06bb70 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 0x7fb78c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 0x7fb78c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60266/0 (socket says 172.21.15.92:60266) 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 -- 172.21.15.92:0/1096384723 learned_addr learned my addr 172.21.15.92:0/1096384723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79229c700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c1094a0 0x7fb78c1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 -- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb78c06bb70 msgr2=0x7fb78c19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.720 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb791a9b700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb78c06bb70 0x7fb78c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb78c06bb70 0x7fb78c19f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 -- 172.21.15.92:0/1096384723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c1094a0 msgr2=0x7fb78c1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c1094a0 0x7fb78c1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c19a150 con 0x7fb78c06c510 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79229c700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb78c1094a0 0x7fb78c1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb79129a700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 0x7fb78c19fd70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00b530 tx=0x7fb77c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c015020 con 0x7fb78c06c510 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c19a440 con 0x7fb78c06c510 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb77c011ce0 con 0x7fb78c06c510 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c010d20 con 0x7fb78c06c510 2024-04-26T17:57:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.718+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c1a6700 con 0x7fb78c06c510 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.719+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb78c063b30 con 0x7fb78c06c510 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.720+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fb77c018020 con 0x7fb78c06c510 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb782ffd700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb7780a3cd0 0x7fb7780a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fb77c0d0310 con 0x7fb78c06c510 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb782ffd700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] conn(0x7fb7780ad710 0x7fb7780afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb77c010ec0 con 0x7fb7780ad710 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fb77c0d07f0 con 0x7fb78c06c510 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.721+0000 7fb791a9b700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb7780a3cd0 0x7fb7780a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.722+0000 7fb79229c700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] conn(0x7fb7780ad710 0x7fb7780afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:45.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.722+0000 7fb791a9b700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb7780a3cd0 0x7fb7780a6190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b5c0 tx=0x7fb788005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.722+0000 7fb79229c700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] conn(0x7fb7780ad710 0x7fb7780afbb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:45.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.723+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== osd.11 v2:172.21.15.189:6824/3211809812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb77c010ec0 con 0x7fb7780ad710 2024-04-26T17:57:45.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.739+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 --> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb78c063f30 con 0x7fb7780ad710 2024-04-26T17:57:45.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb782ffd700 1 -- 172.21.15.92:0/1096384723 <== osd.11 v2:172.21.15.189:6824/3211809812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb78c063f30 con 0x7fb7780ad710 2024-04-26T17:57:45.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] conn(0x7fb7780ad710 msgr2=0x7fb7780afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] conn(0x7fb7780ad710 0x7fb7780afbb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb7780a3cd0 msgr2=0x7fb7780a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fb7780a3cd0 0x7fb7780a6190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b5c0 tx=0x7fb788005fb0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 msgr2=0x7fb78c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 --2- 172.21.15.92:0/1096384723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb78c06c510 0x7fb78c19fd70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00b530 tx=0x7fb77c00b8f0 comp rx=0 tx=0).stop 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb79229c700 1 -- 172.21.15.92:0/1096384723 reap_dead start 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 shutdown_connections 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.740+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 >> 172.21.15.92:0/1096384723 conn(0x7fb78c0792f0 msgr2=0x7fb78c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.741+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 shutdown_connections 2024-04-26T17:57:45.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:45.741+0000 7fb793cff700 1 -- 172.21.15.92:0/1096384723 wait complete. 2024-04-26T17:57:46.508 INFO:teuthology.orchestra.run.smithi092.stdout:343597383712 2024-04-26T17:57:46.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- 172.21.15.92:0/2589850544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff94101a10 msgr2=0x7eff94101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 --2- 172.21.15.92:0/2589850544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff94101a10 0x7eff94101e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7eff84009990 tx=0x7eff84009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- 172.21.15.92:0/2589850544 shutdown_connections 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 --2- 172.21.15.92:0/2589850544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 0x7eff94109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 --2- 172.21.15.92:0/2589850544 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff941023b0 0x7eff941102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 --2- 172.21.15.92:0/2589850544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff94101a10 0x7eff94101e70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- 172.21.15.92:0/2589850544 >> 172.21.15.92:0/2589850544 conn(0x7eff94078990 msgr2=0x7eff940ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- 172.21.15.92:0/2589850544 shutdown_connections 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- 172.21.15.92:0/2589850544 wait complete. 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 Processor -- start 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.718+0000 7eff9b99f700 1 -- start start 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94101a10 0x7eff9419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:46.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 0x7eff9419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 0x7eff94199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff941136a0 con 0x7eff941023b0 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7eff94113520 con 0x7eff941094b0 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7eff94113820 con 0x7eff94101a10 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 0x7eff9419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 0x7eff9419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60280/0 (socket says 172.21.15.92:60280) 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 -- 172.21.15.92:0/1792294169 learned_addr learned my addr 172.21.15.92:0/1792294169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:46.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff99f3c700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 0x7eff94199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9973b700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94101a10 0x7eff9419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 -- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94101a10 msgr2=0x7eff9419f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7eff94101a10 0x7eff9419f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 -- 172.21.15.92:0/1792294169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 msgr2=0x7eff94199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 0x7eff94199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9419a1c0 con 0x7eff941023b0 2024-04-26T17:57:46.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff99f3c700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff941094b0 0x7eff94199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff98f3a700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 0x7eff9419fde0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff840057f0 tx=0x7eff84003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84027070 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff840041c0 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9419a450 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84022e60 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.719+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff941a6770 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.720+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff94063bb0 con 0x7eff941023b0 2024-04-26T17:57:46.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.721+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7eff8402a070 con 0x7eff941023b0 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff8a7fc700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7eff800a3cd0 0x7eff800a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff9973b700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7eff800a3cd0 0x7eff800a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7eff840d1a10 con 0x7eff941023b0 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff8a7fc700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] conn(0x7eff800ad710 0x7eff800afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff8400ce90 con 0x7eff800ad710 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7eff840d1ef0 con 0x7eff941023b0 2024-04-26T17:57:46.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.722+0000 7eff9973b700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7eff800a3cd0 0x7eff800a6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff90006fd0 tx=0x7eff90008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:46.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.723+0000 7eff99f3c700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] conn(0x7eff800ad710 0x7eff800afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:46.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.723+0000 7eff99f3c700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] conn(0x7eff800ad710 0x7eff800afbb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:46.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.724+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== osd.5 v2:172.21.15.189:6808/197850559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff8400ce90 con 0x7eff800ad710 2024-04-26T17:57:46.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:46 smithi092 ceph-mon[29156]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-26T17:57:46.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.745+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 --> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff94064030 con 0x7eff800ad710 2024-04-26T17:57:46.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.746+0000 7eff8a7fc700 1 -- 172.21.15.92:0/1792294169 <== osd.5 v2:172.21.15.189:6808/197850559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7eff94064030 con 0x7eff800ad710 2024-04-26T17:57:46.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] conn(0x7eff800ad710 msgr2=0x7eff800afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] conn(0x7eff800ad710 0x7eff800afbb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:46.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7eff800a3cd0 msgr2=0x7eff800a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7eff800a3cd0 0x7eff800a6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff90006fd0 tx=0x7eff90008040 comp rx=0 tx=0).stop 2024-04-26T17:57:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 msgr2=0x7eff9419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 --2- 172.21.15.92:0/1792294169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff941023b0 0x7eff9419fde0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff840057f0 tx=0x7eff84003730 comp rx=0 tx=0).stop 2024-04-26T17:57:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff99f3c700 1 -- 172.21.15.92:0/1792294169 reap_dead start 2024-04-26T17:57:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 shutdown_connections 2024-04-26T17:57:46.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 >> 172.21.15.92:0/1792294169 conn(0x7eff94078990 msgr2=0x7eff941065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 shutdown_connections 2024-04-26T17:57:46.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:46.747+0000 7eff9b99f700 1 -- 172.21.15.92:0/1792294169 wait complete. 2024-04-26T17:57:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:46 smithi189 ceph-mon[32756]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-26T17:57:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:46 smithi156 ceph-mon[32679]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-26T17:57:47.752 INFO:teuthology.orchestra.run.smithi092.stdout:163208757312 2024-04-26T17:57:47.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 -- 172.21.15.92:0/3172140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f0102f60 msgr2=0x7f09f0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 --2- 172.21.15.92:0/3172140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f0102f60 0x7f09f0106f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0099c0 tx=0x7f09ec009cd0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 -- 172.21.15.92:0/3172140093 shutdown_connections 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 --2- 172.21.15.92:0/3172140093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0107640 0x7f09f010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 --2- 172.21.15.92:0/3172140093 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f01025b0 0x7f09f0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 --2- 172.21.15.92:0/3172140093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f0102f60 0x7f09f0106f60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 -- 172.21.15.92:0/3172140093 >> 172.21.15.92:0/3172140093 conn(0x7f09f00792f0 msgr2=0x7f09f0079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 -- 172.21.15.92:0/3172140093 shutdown_connections 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.041+0000 7f09f8489700 1 -- 172.21.15.92:0/3172140093 wait complete. 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 Processor -- start 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 -- start start 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 0x7f09f019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0102f60 0x7f09f019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0107640 0x7f09f0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09f0112530 con 0x7f09f01025b0 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01123b0 con 0x7f09f0102f60 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f8489700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f09f01126b0 con 0x7f09f0107640 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.042+0000 7f09f6225700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 0x7f09f019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 0x7f09f019e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60294/0 (socket says 172.21.15.92:60294) 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 -- 172.21.15.92:0/2389366506 learned_addr learned my addr 172.21.15.92:0/2389366506 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:48.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6a26700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0107640 0x7f09f0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f5a24700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0102f60 0x7f09f019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 -- 172.21.15.92:0/2389366506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0107640 msgr2=0x7f09f0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f09f0107640 0x7f09f0198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 -- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0102f60 msgr2=0x7f09f019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0102f60 0x7f09f019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f0199030 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f5a24700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09f0102f60 0x7f09f019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f6225700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 0x7f09f019e680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09e000b530 tx=0x7f09e000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0015020 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f0199320 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09e0011ce0 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f01a54e0 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.043+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e0010d20 con 0x7f09f01025b0 2024-04-26T17:57:48.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.044+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09f0063bb0 con 0x7f09f01025b0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.045+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f09e0018020 con 0x7f09f01025b0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09e77fe700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f09dc0a3cd0 0x7f09dc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09f5a24700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f09dc0a3cd0 0x7f09dc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f09e00d02f0 con 0x7f09f01025b0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09e77fe700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] conn(0x7f09dc0ad710 0x7f09dc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09dc0b0280 con 0x7f09dc0ad710 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f09e00d07d0 con 0x7f09f01025b0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09f5a24700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f09dc0a3cd0 0x7f09dc0a6190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006010 tx=0x7f09ec009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.046+0000 7f09f6a26700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] conn(0x7f09dc0ad710 0x7f09dc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.047+0000 7f09f6a26700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] conn(0x7f09dc0ad710 0x7f09dc0afbb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:48.060 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.048+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== osd.7 v2:172.21.15.156:6816/2386131236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09dc0b0280 con 0x7f09dc0ad710 2024-04-26T17:57:48.064 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.064+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 --> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09f0063fb0 con 0x7f09dc0ad710 2024-04-26T17:57:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09e77fe700 1 -- 172.21.15.92:0/2389366506 <== osd.7 v2:172.21.15.156:6816/2386131236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f09f0063fb0 con 0x7f09dc0ad710 2024-04-26T17:57:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] conn(0x7f09dc0ad710 msgr2=0x7f09dc0afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] conn(0x7f09dc0ad710 0x7f09dc0afbb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f09dc0a3cd0 msgr2=0x7f09dc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f09dc0a3cd0 0x7f09dc0a6190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09ec006010 tx=0x7f09ec009f10 comp rx=0 tx=0).stop 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 msgr2=0x7f09f019e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 --2- 172.21.15.92:0/2389366506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f09f01025b0 0x7f09f019e680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09e000b530 tx=0x7f09e000b8f0 comp rx=0 tx=0).stop 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f6a26700 1 -- 172.21.15.92:0/2389366506 reap_dead start 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 shutdown_connections 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 >> 172.21.15.92:0/2389366506 conn(0x7f09f00792f0 msgr2=0x7f09f01003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 shutdown_connections 2024-04-26T17:57:48.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:48.065+0000 7f09f8489700 1 -- 172.21.15.92:0/2389366506 wait complete. 2024-04-26T17:57:48.740 INFO:teuthology.orchestra.run.smithi092.stdout:219043332150 2024-04-26T17:57:48.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-26T17:57:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:48 smithi092 ceph-mon[29156]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:48 smithi189 ceph-mon[32756]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:48 smithi156 ceph-mon[32679]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:49.361 INFO:teuthology.orchestra.run.smithi092.stdout:253403070512 2024-04-26T17:57:49.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-26T17:57:49.847 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 -- 172.21.15.92:0/945454092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58108390 msgr2=0x7f1d58108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/945454092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58108390 0x7f1d58108770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009990 tx=0x7f1d48009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 -- 172.21.15.92:0/945454092 shutdown_connections 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/945454092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d58102ce0 0x7f1d5810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/945454092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58108390 0x7f1d58108770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/945454092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d58102320 0x7f1d581027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 -- 172.21.15.92:0/945454092 >> 172.21.15.92:0/945454092 conn(0x7f1d580792d0 msgr2=0x7f1d580796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 -- 172.21.15.92:0/945454092 shutdown_connections 2024-04-26T17:57:50.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.076+0000 7f1d5d63f700 1 -- 172.21.15.92:0/945454092 wait complete. 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.077+0000 7f1d5d63f700 1 Processor -- start 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.077+0000 7f1d5d63f700 1 -- start start 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 0x7f1d5819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d58102ce0 0x7f1d5819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d58108390 0x7f1d581a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d58112530 con 0x7f1d58102320 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 0x7f1d5819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1d581123b0 con 0x7f1d58102ce0 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d5d63f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1d581126b0 con 0x7f1d58108390 2024-04-26T17:57:50.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 0x7f1d5819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60300/0 (socket says 172.21.15.92:60300) 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 -- 172.21.15.92:0/489192652 learned_addr learned my addr 172.21.15.92:0/489192652 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d567fc700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d58102ce0 0x7f1d5819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d577fe700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d58108390 0x7f1d581a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 -- 172.21.15.92:0/489192652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d58108390 msgr2=0x7f1d581a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1d58108390 0x7f1d581a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 -- 172.21.15.92:0/489192652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d58102ce0 msgr2=0x7f1d5819af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1d58102ce0 0x7f1d5819af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d581a5f90 con 0x7f1d58102320 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d56ffd700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 0x7f1d5819a9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000c00 tx=0x7f1d480047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.078+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48027070 con 0x7f1d58102320 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.079+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d480040e0 con 0x7f1d58102320 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.079+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d581a61c0 con 0x7f1d58102320 2024-04-26T17:57:50.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.079+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d581a6610 con 0x7f1d58102320 2024-04-26T17:57:50.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.079+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800f460 con 0x7f1d58102320 2024-04-26T17:57:50.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.079+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d58063b30 con 0x7f1d58102320 2024-04-26T17:57:50.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.081+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1d4802a070 con 0x7f1d58102320 2024-04-26T17:57:50.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.081+0000 7f1d3ffff700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1d400a3cd0 0x7f1d400a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.081+0000 7f1d567fc700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1d400a3cd0 0x7f1d400a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.081+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f1d480d2130 con 0x7f1d58102320 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d3ffff700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] conn(0x7f1d400ad710 0x7f1d400afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d400b0280 con 0x7f1d400ad710 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f1d480d2610 con 0x7f1d58102320 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d577fe700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] conn(0x7f1d400ad710 0x7f1d400afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d567fc700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1d400a3cd0 0x7f1d400a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d580799f0 tx=0x7f1d4c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.082+0000 7f1d577fe700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] conn(0x7f1d400ad710 0x7f1d400afbb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.083 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.083+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== osd.3 v2:172.21.15.92:6810/581844873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d400b0280 con 0x7f1d400ad710 2024-04-26T17:57:50.110 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.110+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 --> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d58063f30 con 0x7f1d400ad710 2024-04-26T17:57:50.111 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.110+0000 7f1d3ffff700 1 -- 172.21.15.92:0/489192652 <== osd.3 v2:172.21.15.92:6810/581844873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1d58063f30 con 0x7f1d400ad710 2024-04-26T17:57:50.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.110+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] conn(0x7f1d400ad710 msgr2=0x7f1d400afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] conn(0x7f1d400ad710 0x7f1d400afbb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1d400a3cd0 msgr2=0x7f1d400a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f1d400a3cd0 0x7f1d400a6190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d580799f0 tx=0x7f1d4c00a300 comp rx=0 tx=0).stop 2024-04-26T17:57:50.112 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 msgr2=0x7f1d5819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 --2- 172.21.15.92:0/489192652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d58102320 0x7f1d5819a9d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d48000c00 tx=0x7f1d480047b0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d577fe700 1 -- 172.21.15.92:0/489192652 reap_dead start 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 shutdown_connections 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 >> 172.21.15.92:0/489192652 conn(0x7f1d580792d0 msgr2=0x7f1d58101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 shutdown_connections 2024-04-26T17:57:50.113 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.111+0000 7f1d5d63f700 1 -- 172.21.15.92:0/489192652 wait complete. 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 -- 172.21.15.92:0/1007348813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01034d0 msgr2=0x7f3ce0103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 --2- 172.21.15.92:0/1007348813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01034d0 0x7f3ce0103950 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009990 tx=0x7f3cd0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 -- 172.21.15.92:0/1007348813 shutdown_connections 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 --2- 172.21.15.92:0/1007348813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 0x7f3ce01102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 --2- 172.21.15.92:0/1007348813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01094f0 0x7f3ce01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 --2- 172.21.15.92:0/1007348813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01034d0 0x7f3ce0103950 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 -- 172.21.15.92:0/1007348813 >> 172.21.15.92:0/1007348813 conn(0x7f3ce007a4b0 msgr2=0x7f3ce007a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 -- 172.21.15.92:0/1007348813 shutdown_connections 2024-04-26T17:57:50.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 -- 172.21.15.92:0/1007348813 wait complete. 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.374+0000 7f3ce7fca700 1 Processor -- start 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 -- start start 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01034d0 0x7f3ce019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 0x7f3ce019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 0x7f3ce0199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01136c0 con 0x7f3ce01094f0 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0113540 con 0x7f3ce0103e90 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce7fca700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0113840 con 0x7f3ce01034d0 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 0x7f3ce0199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 0x7f3ce0199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60318/0 (socket says 172.21.15.92:60318) 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 -- 172.21.15.92:0/615176274 learned_addr learned my addr 172.21.15.92:0/615176274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:57:50.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce5d66700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01034d0 0x7f3ce019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce5565700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 0x7f3ce019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 -- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01034d0 msgr2=0x7f3ce019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01034d0 0x7f3ce019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 -- 172.21.15.92:0/615176274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 msgr2=0x7f3ce019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 0x7f3ce019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce019a160 con 0x7f3ce01094f0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce5d66700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3ce01034d0 0x7f3ce019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce5565700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3ce0103e90 0x7f3ce019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3ce6567700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 0x7f3ce0199a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c900 tx=0x7f3cd800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.375+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8007b00 con 0x7f3ce01094f0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.376+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cd8007ca0 con 0x7f3ce01094f0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.376+0000 7f3ce7fca700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce019a450 con 0x7f3ce01094f0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.376+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8018660 con 0x7f3ce01094f0 2024-04-26T17:57:50.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.376+0000 7f3ce7fca700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a66c0 con 0x7f3ce01094f0 2024-04-26T17:57:50.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.376+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cc8001030 con 0x7f3ce01094f0 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.378+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f3cd800f450 con 0x7f3ce01094f0 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.378+0000 7f3cd6ffd700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3ccc0a3cd0 0x7f3ccc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3ce5d66700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3ccc0a3cd0 0x7f3ccc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f3cd80d0730 con 0x7f3ce01094f0 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3cd6ffd700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] conn(0x7f3ccc0ad710 0x7f3ccc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cd8015e70 con 0x7f3ccc0ad710 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f3cd80d0c10 con 0x7f3ce01094f0 2024-04-26T17:57:50.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3ce5d66700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3ccc0a3cd0 0x7f3ccc0a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0101c90 tx=0x7f3cdc0073e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3ce5565700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] conn(0x7f3ccc0ad710 0x7f3ccc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.379+0000 7f3ce5565700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] conn(0x7f3ccc0ad710 0x7f3ccc0afbb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.380+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== osd.2 v2:172.21.15.189:6800/2479019407 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cd8015e70 con 0x7f3ccc0ad710 2024-04-26T17:57:50.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.396+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 --> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3cc8002e60 con 0x7f3ccc0ad710 2024-04-26T17:57:50.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd6ffd700 1 -- 172.21.15.92:0/615176274 <== osd.2 v2:172.21.15.189:6800/2479019407 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3cc8002e60 con 0x7f3ccc0ad710 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] conn(0x7f3ccc0ad710 msgr2=0x7f3ccc0afbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] conn(0x7f3ccc0ad710 0x7f3ccc0afbb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3ccc0a3cd0 msgr2=0x7f3ccc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3ccc0a3cd0 0x7f3ccc0a6190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0101c90 tx=0x7f3cdc0073e0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 msgr2=0x7f3ce0199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.398 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3cd4ff9700 1 --2- 172.21.15.92:0/615176274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3ce01094f0 0x7f3ce0199a00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c900 tx=0x7f3cd800ccc0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.397+0000 7f3ce6567700 1 -- 172.21.15.92:0/615176274 reap_dead start 2024-04-26T17:57:50.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.398+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 shutdown_connections 2024-04-26T17:57:50.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.398+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 >> 172.21.15.92:0/615176274 conn(0x7f3ce007a4b0 msgr2=0x7f3ce0102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.398+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 shutdown_connections 2024-04-26T17:57:50.399 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:57:50.398+0000 7f3cd4ff9700 1 -- 172.21.15.92:0/615176274 wait complete. 2024-04-26T17:57:50.924 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.925 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.925 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.926 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.934 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:50 smithi092 ceph-mon[29156]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:50 smithi189 ceph-mon[32756]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:50 smithi156 ceph-mon[32679]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:57:51.215 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:52.031 INFO:teuthology.orchestra.run.smithi092.stdout:107374182476 2024-04-26T17:57:52.031 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-26T17:57:52.862 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:52 smithi092 ceph-mon[29156]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T17:57:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:52 smithi189 ceph-mon[32756]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T17:57:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:52 smithi156 ceph-mon[32679]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T17:57:54.943 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:54 smithi092 ceph-mon[29156]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:54 smithi189 ceph-mon[32756]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:54 smithi156 ceph-mon[32679]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:57:56.633 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:57:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:56 smithi092 ceph-mon[29156]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:56 smithi189 ceph-mon[32756]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:56 smithi156 ceph-mon[32679]: pgmap v349: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:57:58.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:57:58 smithi092 ceph-mon[29156]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:57:58 smithi189 ceph-mon[32756]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:57:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:57:58 smithi156 ceph-mon[32679]: pgmap v350: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:00.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.028+0000 7f5c56354700 1 -- 172.21.15.92:0/605082648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50102320 msgr2=0x7f5c501027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.028+0000 7f5c56354700 1 --2- 172.21.15.92:0/605082648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50102320 0x7f5c501027a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009990 tx=0x7f5c44009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.028+0000 7f5c56354700 1 -- 172.21.15.92:0/605082648 shutdown_connections 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 --2- 172.21.15.92:0/605082648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102ce0 0x7f5c5010f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 --2- 172.21.15.92:0/605082648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50108390 0x7f5c50108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 --2- 172.21.15.92:0/605082648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50102320 0x7f5c501027a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 -- 172.21.15.92:0/605082648 >> 172.21.15.92:0/605082648 conn(0x7f5c500792d0 msgr2=0x7f5c500796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 -- 172.21.15.92:0/605082648 shutdown_connections 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 -- 172.21.15.92:0/605082648 wait complete. 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 Processor -- start 2024-04-26T17:58:00.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.029+0000 7f5c56354700 1 -- start start 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 0x7f5c5019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50102ce0 0x7f5c5019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5c50112530 con 0x7f5c50108390 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5c501123b0 con 0x7f5c50102320 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c56354700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5c501126b0 con 0x7f5c50102ce0 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50326/0 (socket says 172.21.15.92:50326) 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 -- 172.21.15.92:0/3046500337 learned_addr learned my addr 172.21.15.92:0/3046500337 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c4ffff700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 0x7f5c5019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c4f7fe700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50102ce0 0x7f5c5019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 -- 172.21.15.92:0/3046500337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50102ce0 msgr2=0x7f5c5019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50102ce0 0x7f5c5019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 -- 172.21.15.92:0/3046500337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 msgr2=0x7f5c5019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 0x7f5c5019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 -- 172.21.15.92:0/3046500337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c501a5f10 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c4ffff700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 0x7f5c5019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c548f1700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007d70 tx=0x7f5c4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.030+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c48016020 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.031+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c501a6140 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.031+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c4800ad40 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.031+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c480115e0 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.031+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c501a6680 con 0x7f5c50108390 2024-04-26T17:58:00.034 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.032+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5010a900 con 0x7f5c50108390 2024-04-26T17:58:00.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.033+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f5c48019020 con 0x7f5c50108390 2024-04-26T17:58:00.035 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.033+0000 7f5c4d7fa700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 0x7f5c380a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.033+0000 7f5c4ffff700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 0x7f5c380a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.033+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f5c480d0390 con 0x7f5c50108390 2024-04-26T17:58:00.036 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.034+0000 7f5c4ffff700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 0x7f5c380a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099d0 tx=0x7f5c40008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:00.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.038+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5c48020020 con 0x7f5c50108390 2024-04-26T17:58:00.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.253+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5c5010a2e0 con 0x7f5c50108390 2024-04-26T17:58:00.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.253+0000 7f5c4d7fa700 1 -- 172.21.15.92:0/3046500337 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5c4809ce20 con 0x7f5c50108390 2024-04-26T17:58:00.254 INFO:teuthology.orchestra.run.smithi092.stdout:163208757314 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.255+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 msgr2=0x7f5c380a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 0x7f5c380a6190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c400099d0 tx=0x7f5c40008040 comp rx=0 tx=0).stop 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 msgr2=0x7f5c501a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007d70 tx=0x7f5c4800a340 comp rx=0 tx=0).stop 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 shutdown_connections 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f5c380a3cd0 0x7f5c380a6190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c50102320 0x7f5c5019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c50108390 0x7f5c501a59d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 --2- 172.21.15.92:0/3046500337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5c50102ce0 0x7f5c5019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 >> 172.21.15.92:0/3046500337 conn(0x7f5c500792d0 msgr2=0x7f5c50100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:00.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 shutdown_connections 2024-04-26T17:58:00.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:00.256+0000 7f5c56354700 1 -- 172.21.15.92:0/3046500337 wait complete. 2024-04-26T17:58:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:00 smithi189 ceph-mon[32756]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T17:58:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:00 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3046500337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T17:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:00 smithi156 ceph-mon[32679]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T17:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:00 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3046500337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T17:58:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:00 smithi092 ceph-mon[29156]: pgmap v351: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-26T17:58:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:00 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3046500337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-26T17:58:01.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/1320153795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 msgr2=0x7f7e4810f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/1320153795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4810f990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009990 tx=0x7f7e3c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/1320153795 shutdown_connections 2024-04-26T17:58:01.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/1320153795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e4806b130 0x7f7e4806b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.139 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/1320153795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e4810fed0 0x7f7e481122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/1320153795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4810f990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/1320153795 >> 172.21.15.92:0/1320153795 conn(0x7f7e480792d0 msgr2=0x7f7e480796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/1320153795 shutdown_connections 2024-04-26T17:58:01.140 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.139+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/1320153795 wait complete. 2024-04-26T17:58:01.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 Processor -- start 2024-04-26T17:58:01.141 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 -- start start 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e4806b130 0x7f7e4819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e4810fed0 0x7f7e481a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e48115850 con 0x7f7e4806ba50 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7e481156d0 con 0x7f7e4810fed0 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4cdd7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7e481159d0 con 0x7f7e4806b130 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4819c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50346/0 (socket says 172.21.15.92:50346) 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 -- 172.21.15.92:0/2853433658 learned_addr learned my addr 172.21.15.92:0/2853433658 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e4659c700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e4806b130 0x7f7e4819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e46d9d700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e4810fed0 0x7f7e481a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 -- 172.21.15.92:0/2853433658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e4806b130 msgr2=0x7f7e4819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7e4806b130 0x7f7e4819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 -- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e4810fed0 msgr2=0x7f7e481a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e4810fed0 0x7f7e481a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.140+0000 7f7e45d9b700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e481a0d50 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e45d9b700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4819c280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0057f0 tx=0x7f7e3c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c027070 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e481a0fe0 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e3c004020 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c022cf0 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e481a88c0 con 0x7f7e4806ba50 2024-04-26T17:58:01.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.141+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e48063b30 con 0x7f7e4806ba50 2024-04-26T17:58:01.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.143+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7e3c02a070 con 0x7f7e4806ba50 2024-04-26T17:58:01.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.143+0000 7f7e377fe700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7e300a3d50 0x7f7e300a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e4659c700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7e300a3d50 0x7f7e300a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7e3c0d2070 con 0x7f7e4806ba50 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e377fe700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] conn(0x7f7e300ad790 0x7f7e300afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e300b0300 con 0x7f7e300ad790 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f7e3c0d2550 con 0x7f7e4806ba50 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e4659c700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7e300a3d50 0x7f7e300a6210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e380060b0 tx=0x7f7e3800c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e46d9d700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] conn(0x7f7e300ad790 0x7f7e300afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.144+0000 7f7e46d9d700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] conn(0x7f7e300ad790 0x7f7e300afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:01.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.145+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== osd.10 v2:172.21.15.156:6824/3658089432 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e300b0300 con 0x7f7e300ad790 2024-04-26T17:58:01.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.162+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 --> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e48063f30 con 0x7f7e300ad790 2024-04-26T17:58:01.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e377fe700 1 -- 172.21.15.92:0/2853433658 <== osd.10 v2:172.21.15.156:6824/3658089432 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7e48063f30 con 0x7f7e300ad790 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] conn(0x7f7e300ad790 msgr2=0x7f7e300afc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] conn(0x7f7e300ad790 0x7f7e300afc30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7e300a3d50 msgr2=0x7f7e300a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7e300a3d50 0x7f7e300a6210 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e380060b0 tx=0x7f7e3800c040 comp rx=0 tx=0).stop 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 msgr2=0x7f7e4819c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 --2- 172.21.15.92:0/2853433658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e4806ba50 0x7f7e4819c280 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0057f0 tx=0x7f7e3c003680 comp rx=0 tx=0).stop 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e46d9d700 1 -- 172.21.15.92:0/2853433658 reap_dead start 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 shutdown_connections 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 >> 172.21.15.92:0/2853433658 conn(0x7f7e480792d0 msgr2=0x7f7e48111380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 shutdown_connections 2024-04-26T17:58:01.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:01.163+0000 7f7e4cdd7700 1 -- 172.21.15.92:0/2853433658 wait complete. 2024-04-26T17:58:02.841 INFO:teuthology.orchestra.run.smithi092.stdout:309237645353 2024-04-26T17:58:02.841 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-26T17:58:02.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:02 smithi092 ceph-mon[29156]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-26T17:58:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:02 smithi189 ceph-mon[32756]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-26T17:58:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:02 smithi156 ceph-mon[32679]: pgmap v352: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-04-26T17:58:03.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 -- 172.21.15.92:0/115366238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580810fec0 msgr2=0x7f58081122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 --2- 172.21.15.92:0/115366238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580810fec0 0x7f58081122b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f580000b0a0 tx=0x7f580000b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 -- 172.21.15.92:0/115366238 shutdown_connections 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 --2- 172.21.15.92:0/115366238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580806b9c0 0x7f580806bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 --2- 172.21.15.92:0/115366238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580810fec0 0x7f58081122b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 --2- 172.21.15.92:0/115366238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 0x7f580810f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 -- 172.21.15.92:0/115366238 >> 172.21.15.92:0/115366238 conn(0x7f5808079290 msgr2=0x7f58080796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 -- 172.21.15.92:0/115366238 shutdown_connections 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.650+0000 7f580fb1b700 1 -- 172.21.15.92:0/115366238 wait complete. 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 Processor -- start 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 -- start start 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 0x7f580819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580810fec0 0x7f58081a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58081157e0 con 0x7f580806b9c0 2024-04-26T17:58:03.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5808115660 con 0x7f580810fec0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580fb1b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5808115960 con 0x7f580806c2e0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580d8b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580d8b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50360/0 (socket says 172.21.15.92:50360) 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580d8b7700 1 -- 172.21.15.92:0/3508925984 learned_addr learned my addr 172.21.15.92:0/3508925984 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580e0b8700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580810fec0 0x7f58081a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.651+0000 7f580d0b6700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 0x7f580819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 -- 172.21.15.92:0/3508925984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 msgr2=0x7f580819c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 0x7f580819c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 -- 172.21.15.92:0/3508925984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580810fec0 msgr2=0x7f58081a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580810fec0 0x7f58081a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 -- 172.21.15.92:0/3508925984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081a0d20 con 0x7f580806b9c0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580d8b7700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d950 tx=0x7f57f800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8016070 con 0x7f580806b9c0 2024-04-26T17:58:03.654 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081a1010 con 0x7f580806b9c0 2024-04-26T17:58:03.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57f8009df0 con 0x7f580806b9c0 2024-04-26T17:58:03.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f800f3c0 con 0x7f580806b9c0 2024-04-26T17:58:03.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.652+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58081a8890 con 0x7f580806b9c0 2024-04-26T17:58:03.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.653+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580806a110 con 0x7f580806b9c0 2024-04-26T17:58:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.654+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f57f8019070 con 0x7f580806b9c0 2024-04-26T17:58:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.654+0000 7f57feffd700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 0x7f57f40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.655+0000 7f580d0b6700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 0x7f57f40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.655+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f57f80d0060 con 0x7f580806b9c0 2024-04-26T17:58:03.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.655+0000 7f580d0b6700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 0x7f57f40a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5804005950 tx=0x7f58040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:03.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.659+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f57f809c9e0 con 0x7f580806b9c0 2024-04-26T17:58:03.877 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.874+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f580802e490 con 0x7f580806b9c0 2024-04-26T17:58:03.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.874+0000 7f57feffd700 1 -- 172.21.15.92:0/3508925984 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57f809c2e0 con 0x7f580806b9c0 2024-04-26T17:58:03.878 INFO:teuthology.orchestra.run.smithi092.stdout:55834574936 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 msgr2=0x7f57f40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 0x7f57f40a6190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5804005950 tx=0x7f58040058e0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 msgr2=0x7f580819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f57f800d950 tx=0x7f57f800dc60 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 shutdown_connections 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f57f40a3cd0 0x7f57f40a6190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f580810fec0 0x7f58081a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f580806b9c0 0x7f580819bd10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 --2- 172.21.15.92:0/3508925984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f580806c2e0 0x7f580819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 >> 172.21.15.92:0/3508925984 conn(0x7f5808079290 msgr2=0x7f5808111410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:03.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 shutdown_connections 2024-04-26T17:58:03.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:03.876+0000 7f580fb1b700 1 -- 172.21.15.92:0/3508925984 wait complete. 2024-04-26T17:58:03.986 INFO:teuthology.orchestra.run.smithi092.stdout:77309411409 2024-04-26T17:58:03.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-26T17:58:04.719 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574931 got 55834574936 for osd.1 2024-04-26T17:58:04.719 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:04 smithi092 ceph-mon[29156]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T17:58:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:04 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3508925984' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T17:58:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:04 smithi189 ceph-mon[32756]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T17:58:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:04 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3508925984' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T17:58:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:04 smithi156 ceph-mon[32679]: pgmap v353: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T17:58:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:04 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3508925984' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-26T17:58:06.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757312 got 163208757314 for osd.5 2024-04-26T17:58:06.256 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:06 smithi092 ceph-mon[29156]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:06 smithi189 ceph-mon[32756]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:06 smithi156 ceph-mon[32679]: pgmap v354: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 -- 172.21.15.92:0/3887644192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 msgr2=0x7f7d04110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 --2- 172.21.15.92:0/3887644192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04110320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009990 tx=0x7f7cfc009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 -- 172.21.15.92:0/3887644192 shutdown_connections 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 --2- 172.21.15.92:0/3887644192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 0x7f7d041098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 --2- 172.21.15.92:0/3887644192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04110320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 --2- 172.21.15.92:0/3887644192 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 0x7f7d04103900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 -- 172.21.15.92:0/3887644192 >> 172.21.15.92:0/3887644192 conn(0x7f7d0407a4f0 msgr2=0x7f7d0407a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 -- 172.21.15.92:0/3887644192 shutdown_connections 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 -- 172.21.15.92:0/3887644192 wait complete. 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.247+0000 7f7d09f79700 1 Processor -- start 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 -- start start 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 0x7f7d04075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 0x7f7d040761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d041136d0 con 0x7f7d04103e40 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7d04113550 con 0x7f7d041094e0 2024-04-26T17:58:07.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d09f79700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d04113850 con 0x7f7d041034a0 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43860/0 (socket says 172.21.15.92:43860) 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 -- 172.21.15.92:0/714019829 learned_addr learned my addr 172.21.15.92:0/714019829 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d037fe700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 0x7f7d04075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d03fff700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 0x7f7d040761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 -- 172.21.15.92:0/714019829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 msgr2=0x7f7d04075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 0x7f7d04075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 -- 172.21.15.92:0/714019829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 msgr2=0x7f7d040761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 0x7f7d040761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.248+0000 7f7d02ffd700 1 -- 172.21.15.92:0/714019829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d041a8170 con 0x7f7d04103e40 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d02ffd700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800b530 tx=0x7f7cf800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8015020 con 0x7f7d04103e40 2024-04-26T17:58:07.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf8011ce0 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d041a8460 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8010d20 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.249+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d041a89a0 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.250+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0406a110 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.251+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f7cf8018020 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.251+0000 7f7d00ff9700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 0x7f7cec0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.251+0000 7f7d037fe700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 0x7f7cec0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.251+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7cf80cfbc0 con 0x7f7d04103e40 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.252+0000 7f7d037fe700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 0x7f7cec0a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009f20 tx=0x7f7cf40094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.256+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7cf801f020 con 0x7f7d04103e40 2024-04-26T17:58:07.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.462+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7d0402e490 con 0x7f7d04103e40 2024-04-26T17:58:07.463 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.463+0000 7f7d00ff9700 1 -- 172.21.15.92:0/714019829 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7cf809c650 con 0x7f7d04103e40 2024-04-26T17:58:07.463 INFO:teuthology.orchestra.run.smithi092.stdout:343597383716 2024-04-26T17:58:07.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 msgr2=0x7f7cec0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 0x7f7cec0a6190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009f20 tx=0x7f7cf40094f0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 msgr2=0x7f7d04075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800b530 tx=0x7f7cf800b8f0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.464 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 shutdown_connections 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7cec0a3cd0 0x7f7cec0a6190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d041094e0 0x7f7d040761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d041034a0 0x7f7d04075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 --2- 172.21.15.92:0/714019829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d04103e40 0x7f7d04075c60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 >> 172.21.15.92:0/714019829 conn(0x7f7d0407a4f0 msgr2=0x7f7d04101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 shutdown_connections 2024-04-26T17:58:07.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.465+0000 7f7d09f79700 1 -- 172.21.15.92:0/714019829 wait complete. 2024-04-26T17:58:07.905 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 -- 172.21.15.92:0/1627474280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c102310 msgr2=0x7f2c2c102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/1627474280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c102310 0x7f2c2c102790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009990 tx=0x7f2c20009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 -- 172.21.15.92:0/1627474280 shutdown_connections 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/1627474280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 0x7f2c2c10f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/1627474280 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c108380 0x7f2c2c108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/1627474280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c102310 0x7f2c2c102790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 -- 172.21.15.92:0/1627474280 >> 172.21.15.92:0/1627474280 conn(0x7f2c2c079290 msgr2=0x7f2c2c0796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 -- 172.21.15.92:0/1627474280 shutdown_connections 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.904+0000 7f2c30d5a700 1 -- 172.21.15.92:0/1627474280 wait complete. 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 Processor -- start 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 -- start start 2024-04-26T17:58:07.906 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c102310 0x7f2c2c19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 0x7f2c2c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c1125a0 con 0x7f2c2c108380 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c112420 con 0x7f2c2c102cd0 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.905+0000 7f2c30d5a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2c112720 con 0x7f2c2c102310 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43884/0 (socket says 172.21.15.92:43884) 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 -- 172.21.15.92:0/841536949 learned_addr learned my addr 172.21.15.92:0/841536949 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2a59c700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c102310 0x7f2c2c19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c29d9b700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 0x7f2c2c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 -- 172.21.15.92:0/841536949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c102310 msgr2=0x7f2c2c19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c102310 0x7f2c2c19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 -- 172.21.15.92:0/841536949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 msgr2=0x7f2c2c19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 0x7f2c2c19ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.907 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 -- 172.21.15.92:0/841536949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2c1990e0 con 0x7f2c2c108380 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c2ad9d700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b970 tx=0x7f2c2400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24019070 con 0x7f2c2c108380 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2400cde0 con 0x7f2c2c108380 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2c1993d0 con 0x7f2c2c108380 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24007370 con 0x7f2c2c108380 2024-04-26T17:58:07.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.906+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c2c1a5690 con 0x7f2c2c108380 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.907+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c2c06a110 con 0x7f2c2c108380 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.908+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f2c2401c070 con 0x7f2c2c108380 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.909+0000 7f2c1b7fe700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 0x7f2c140a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.909+0000 7f2c2a59c700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 0x7f2c140a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.909+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f2c240cf8b0 con 0x7f2c2c108380 2024-04-26T17:58:07.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.909+0000 7f2c2a59c700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 0x7f2c140a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c199ac0 tx=0x7f2c1c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:07.914+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f2c2409c340 con 0x7f2c2c108380 2024-04-26T17:58:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:07 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/714019829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T17:58:08.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:07 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/714019829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T17:58:08.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.121+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2c2c10a2d0 con 0x7f2c2c108380 2024-04-26T17:58:08.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.121+0000 7f2c1b7fe700 1 -- 172.21.15.92:0/841536949 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2c2409bc40 con 0x7f2c2c108380 2024-04-26T17:58:08.121 INFO:teuthology.orchestra.run.smithi092.stdout:197568495680 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 msgr2=0x7f2c140a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 0x7f2c140a6190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c199ac0 tx=0x7f2c1c009190 comp rx=0 tx=0).stop 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 msgr2=0x7f2c2c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2c2400b970 tx=0x7f2c2400bc80 comp rx=0 tx=0).stop 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 shutdown_connections 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f2c140a3cd0 0x7f2c140a6190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c2c108380 0x7f2c2c198980 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2c2c102310 0x7f2c2c19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 --2- 172.21.15.92:0/841536949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c2c102cd0 0x7f2c2c19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.123+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 >> 172.21.15.92:0/841536949 conn(0x7f2c2c079290 msgr2=0x7f2c2c101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:08.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.124+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 shutdown_connections 2024-04-26T17:58:08.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.124+0000 7f2c30d5a700 1 -- 172.21.15.92:0/841536949 wait complete. 2024-04-26T17:58:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:07 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/714019829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-26T17:58:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- 172.21.15.92:0/126747068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c108500 msgr2=0x7f183c1088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 --2- 172.21.15.92:0/126747068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c108500 0x7f183c1088e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f182c009990 tx=0x7f182c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- 172.21.15.92:0/126747068 shutdown_connections 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 --2- 172.21.15.92:0/126747068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c1027a0 0x7f183c110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 --2- 172.21.15.92:0/126747068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c108500 0x7f183c1088e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 --2- 172.21.15.92:0/126747068 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c101de0 0x7f183c102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- 172.21.15.92:0/126747068 >> 172.21.15.92:0/126747068 conn(0x7f183c077640 msgr2=0x7f183c077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- 172.21.15.92:0/126747068 shutdown_connections 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- 172.21.15.92:0/126747068 wait complete. 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 Processor -- start 2024-04-26T17:58:08.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.734+0000 7f18418a8700 1 -- start start 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c101de0 0x7f183c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 0x7f183c199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f183c113660 con 0x7f183c1027a0 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1134e0 con 0x7f183c101de0 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f183c1137e0 con 0x7f183c108500 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43906/0 (socket says 172.21.15.92:43906) 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 -- 172.21.15.92:0/806142121 learned_addr learned my addr 172.21.15.92:0/806142121 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183affd700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c101de0 0x7f183c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183b7fe700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 0x7f183c199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 -- 172.21.15.92:0/806142121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 msgr2=0x7f183c199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 0x7f183c199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 -- 172.21.15.92:0/806142121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c101de0 msgr2=0x7f183c19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c101de0 0x7f183c19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 -- 172.21.15.92:0/806142121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f183c19a1a0 con 0x7f183c1027a0 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183b7fe700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 0x7f183c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f183a7fc700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f183000c970 tx=0x7f183000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830007aa0 con 0x7f183c1027a0 2024-04-26T17:58:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183c19a490 con 0x7f183c1027a0 2024-04-26T17:58:08.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.735+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1830004ce0 con 0x7f183c1027a0 2024-04-26T17:58:08.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.736+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830005510 con 0x7f183c1027a0 2024-04-26T17:58:08.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.736+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183c1a6700 con 0x7f183c1027a0 2024-04-26T17:58:08.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.736+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f183c06a110 con 0x7f183c1027a0 2024-04-26T17:58:08.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.738+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f1830007c40 con 0x7f183c1027a0 2024-04-26T17:58:08.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.739+0000 7f18408a6700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 0x7f18240a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:08.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.739+0000 7f183affd700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 0x7f18240a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:08.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.739+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f18300d04a0 con 0x7f183c1027a0 2024-04-26T17:58:08.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.739+0000 7f183affd700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 0x7f18240a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f183c1004b0 tx=0x7f182c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:08.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.742+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f183009cf40 con 0x7f183c1027a0 2024-04-26T17:58:08.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:08 smithi092 ceph-mon[29156]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:08.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:08 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/841536949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T17:58:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.946+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f183c19af20 con 0x7f183c1027a0 2024-04-26T17:58:08.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.947+0000 7f18408a6700 1 -- 172.21.15.92:0/806142121 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f183009c840 con 0x7f183c1027a0 2024-04-26T17:58:08.946 INFO:teuthology.orchestra.run.smithi092.stdout:141733920842 2024-04-26T17:58:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 msgr2=0x7f18240a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 0x7f18240a6190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f183c1004b0 tx=0x7f182c005fd0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 msgr2=0x7f183c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:08.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f183000c970 tx=0x7f183000cc80 comp rx=0 tx=0).stop 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 shutdown_connections 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f18240a3cd0 0x7f18240a6190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f183c101de0 0x7f183c19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f183c108500 0x7f183c199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 --2- 172.21.15.92:0/806142121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f183c1027a0 0x7f183c19fd70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 >> 172.21.15.92:0/806142121 conn(0x7f183c077640 msgr2=0x7f183c100b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 shutdown_connections 2024-04-26T17:58:08.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:08.949+0000 7f18418a8700 1 -- 172.21.15.92:0/806142121 wait complete. 2024-04-26T17:58:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:08 smithi189 ceph-mon[32756]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:08 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/841536949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T17:58:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:08 smithi156 ceph-mon[32679]: pgmap v355: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:08 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/841536949' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-26T17:58:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:09 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/806142121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T17:58:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:09 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2008735499' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T17:58:09.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495674 got 197568495680 for osd.6 2024-04-26T17:58:09.836 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:10.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:09 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/806142121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T17:58:10.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:09 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2008735499' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T17:58:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:09 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/806142121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-26T17:58:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:09 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2008735499' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-26T17:58:10.576 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920835 got 141733920842 for osd.4 2024-04-26T17:58:10.576 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:10.945 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:10 smithi092 ceph-mon[29156]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:11.054 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383712 got 343597383716 for osd.11 2024-04-26T17:58:11.054 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:10 smithi189 ceph-mon[32756]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:10 smithi156 ceph-mon[32679]: pgmap v356: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 -- 172.21.15.92:0/2823458162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 msgr2=0x7f4e50108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2823458162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e50108760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009990 tx=0x7f4e44009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 -- 172.21.15.92:0/2823458162 shutdown_connections 2024-04-26T17:58:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2823458162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102cd0 0x7f4e5010f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2823458162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e50108760 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2823458162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102310 0x7f4e50102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 -- 172.21.15.92:0/2823458162 >> 172.21.15.92:0/2823458162 conn(0x7f4e50079290 msgr2=0x7f4e500796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.069+0000 7f4e5768a700 1 -- 172.21.15.92:0/2823458162 shutdown_connections 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 -- 172.21.15.92:0/2823458162 wait complete. 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 Processor -- start 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 -- start start 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102310 0x7f4e5019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102cd0 0x7f4e5019c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501124d0 con 0x7f4e50108380 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50112350 con 0x7f4e50102310 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e5768a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50112650 con 0x7f4e50102cd0 2024-04-26T17:58:11.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e55c27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e55c27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43916/0 (socket says 172.21.15.92:43916) 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e55c27700 1 -- 172.21.15.92:0/2008735499 learned_addr learned my addr 172.21.15.92:0/2008735499 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e55426700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102310 0x7f4e5019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.070+0000 7f4e54c25700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102cd0 0x7f4e5019c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 -- 172.21.15.92:0/2008735499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102cd0 msgr2=0x7f4e5019c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102cd0 0x7f4e5019c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 -- 172.21.15.92:0/2008735499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102310 msgr2=0x7f4e5019bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102310 0x7f4e5019bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 -- 172.21.15.92:0/2008735499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e501a0d50 con 0x7f4e50108380 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e55c27700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ef30 tx=0x7f4e4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e480092e0 con 0x7f4e50108380 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e48004bb0 con 0x7f4e50108380 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e501a0fe0 con 0x7f4e50108380 2024-04-26T17:58:11.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48004020 con 0x7f4e50108380 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.071+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a88c0 con 0x7f4e50108380 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.072+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5006a110 con 0x7f4e50108380 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.073+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f4e4801b030 con 0x7f4e50108380 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.074+0000 7f4e427fc700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 0x7f4e3c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stdout:34359738462 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.074+0000 7f4e55426700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 0x7f4e3c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.074+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f4e480cfea0 con 0x7f4e50108380 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.074+0000 7f4e55426700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 0x7f4e3c0a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b2e0 tx=0x7f4e44005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.078+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4e48022020 con 0x7f4e50108380 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.289+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4e501a8a90 con 0x7f4e50108380 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.289+0000 7f4e427fc700 1 -- 172.21.15.92:0/2008735499 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e48010040 con 0x7f4e50108380 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 msgr2=0x7f4e3c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 0x7f4e3c0a6190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b2e0 tx=0x7f4e44005960 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 msgr2=0x7f4e501a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ef30 tx=0x7f4e4800c3a0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 shutdown_connections 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4e3c0a3cd0 0x7f4e3c0a6190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e50102310 0x7f4e5019bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e50108380 0x7f4e501a0610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 --2- 172.21.15.92:0/2008735499 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e50102cd0 0x7f4e5019c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.291+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 >> 172.21.15.92:0/2008735499 conn(0x7f4e50079290 msgr2=0x7f4e5006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.292+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 shutdown_connections 2024-04-26T17:58:11.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:09.292+0000 7f4e5768a700 1 -- 172.21.15.92:0/2008735499 wait complete. 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 -- 172.21.15.92:0/1378977902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64109560 msgr2=0x7fbb64109940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 --2- 172.21.15.92:0/1378977902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64109560 0x7fbb64109940 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbb580099c0 tx=0x7fbb58009cd0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 -- 172.21.15.92:0/1378977902 shutdown_connections 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 --2- 172.21.15.92:0/1378977902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb64103e80 0x7fbb64110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 --2- 172.21.15.92:0/1378977902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64109560 0x7fbb64109940 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 --2- 172.21.15.92:0/1378977902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb641034c0 0x7fbb64103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 -- 172.21.15.92:0/1378977902 >> 172.21.15.92:0/1378977902 conn(0x7fbb6407a5d0 msgr2=0x7fbb6407a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 -- 172.21.15.92:0/1378977902 shutdown_connections 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.888+0000 7fbb6b079700 1 -- 172.21.15.92:0/1378977902 wait complete. 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 Processor -- start 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 -- start start 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb641034c0 0x7fbb64075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb64109560 0x7fbb640761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb641136c0 con 0x7fbb64103e80 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64113540 con 0x7fbb64109560 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb6b079700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb64113840 con 0x7fbb641034c0 2024-04-26T17:58:11.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43938/0 (socket says 172.21.15.92:43938) 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 -- 172.21.15.92:0/3449849003 learned_addr learned my addr 172.21.15.92:0/3449849003 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb69616700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb64109560 0x7fbb640761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb68e15700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb641034c0 0x7fbb64075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 -- 172.21.15.92:0/3449849003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb641034c0 msgr2=0x7fbb64075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb641034c0 0x7fbb64075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 -- 172.21.15.92:0/3449849003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb64109560 msgr2=0x7fbb640761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb64109560 0x7fbb640761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 -- 172.21.15.92:0/3449849003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb641a8100 con 0x7fbb64103e80 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.889+0000 7fbb63fff700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c920 tx=0x7fbb5000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.890+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50007b00 con 0x7fbb64103e80 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.890+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb641a83f0 con 0x7fbb64103e80 2024-04-26T17:58:11.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.890+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb50004ce0 con 0x7fbb64103e80 2024-04-26T17:58:11.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.890+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50005500 con 0x7fbb64103e80 2024-04-26T17:58:11.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.890+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb641a8930 con 0x7fbb64103e80 2024-04-26T17:58:11.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.891+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6410b9f0 con 0x7fbb64103e80 2024-04-26T17:58:11.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.892+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fbb50007ca0 con 0x7fbb64103e80 2024-04-26T17:58:11.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.892+0000 7fbb61ffb700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 0x7fbb540a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.892+0000 7fbb68e15700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 0x7fbb540a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.892+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fbb500d0040 con 0x7fbb64103e80 2024-04-26T17:58:11.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.893+0000 7fbb68e15700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 0x7fbb540a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009fd0 tx=0x7fbb5801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:11.897+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fbb50014030 con 0x7fbb64103e80 2024-04-26T17:58:12.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.099+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fbb64076c50 con 0x7fbb64103e80 2024-04-26T17:58:12.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.100+0000 7fbb61ffb700 1 -- 172.21.15.92:0/3449849003 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbb5009c9c0 con 0x7fbb64103e80 2024-04-26T17:58:12.099 INFO:teuthology.orchestra.run.smithi092.stdout:253403070518 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 msgr2=0x7fbb540a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 0x7fbb540a6190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009fd0 tx=0x7fbb5801a040 comp rx=0 tx=0).stop 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 msgr2=0x7fbb64075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000c920 tx=0x7fbb5000cc30 comp rx=0 tx=0).stop 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 shutdown_connections 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fbb540a3cd0 0x7fbb540a6190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.101 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb64109560 0x7fbb640761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb641034c0 0x7fbb64075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 --2- 172.21.15.92:0/3449849003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb64103e80 0x7fbb64075c60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 >> 172.21.15.92:0/3449849003 conn(0x7fbb6407a5d0 msgr2=0x7fbb64102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 shutdown_connections 2024-04-26T17:58:12.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.102+0000 7fbb6b079700 1 -- 172.21.15.92:0/3449849003 wait complete. 2024-04-26T17:58:12.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738456 got 34359738462 for osd.0 2024-04-26T17:58:12.377 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:12.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 -- 172.21.15.92:0/3264699167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 msgr2=0x7fef7c1102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 --2- 172.21.15.92:0/3264699167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c1102c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fef7400b0a0 tx=0x7fef7400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.637 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 -- 172.21.15.92:0/3264699167 shutdown_connections 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 --2- 172.21.15.92:0/3264699167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1094f0 0x7fef7c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 --2- 172.21.15.92:0/3264699167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c1102c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 --2- 172.21.15.92:0/3264699167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1034d0 0x7fef7c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.629+0000 7fef84679700 1 -- 172.21.15.92:0/3264699167 >> 172.21.15.92:0/3264699167 conn(0x7fef7c07a500 msgr2=0x7fef7c07a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- 172.21.15.92:0/3264699167 shutdown_connections 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- 172.21.15.92:0/3264699167 wait complete. 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 Processor -- start 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- start start 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1034d0 0x7fef7c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.638 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1094f0 0x7fef7c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c113620 con 0x7fef7c103e90 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1134a0 con 0x7fef7c1034d0 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef84679700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1137a0 con 0x7fef7c1094f0 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef81c14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef81c14700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43960/0 (socket says 172.21.15.92:43960) 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.630+0000 7fef81c14700 1 -- 172.21.15.92:0/3520226171 learned_addr learned my addr 172.21.15.92:0/3520226171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef82415700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1034d0 0x7fef7c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef82c16700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1094f0 0x7fef7c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.639 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 -- 172.21.15.92:0/3520226171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1094f0 msgr2=0x7fef7c199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1094f0 0x7fef7c199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 -- 172.21.15.92:0/3520226171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1034d0 msgr2=0x7fef7c19f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1034d0 0x7fef7c19f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 -- 172.21.15.92:0/3520226171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c19a0a0 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef81c14700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d980 tx=0x7fef6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c017070 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef6c005020 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c19a390 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00fa10 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.631+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1a6650 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.632+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7c10b960 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.633+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fef6c004a30 con 0x7fef7c103e90 2024-04-26T17:58:12.640 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.634+0000 7fef737fe700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 0x7fef680a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.634+0000 7fef82415700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 0x7fef680a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.634+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fef6c0d0430 con 0x7fef7c103e90 2024-04-26T17:58:12.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.634+0000 7fef82415700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 0x7fef680a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef78005950 tx=0x7fef7800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.641 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.639+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fef6c020020 con 0x7fef7c103e90 2024-04-26T17:58:12.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.853+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fef7c19ae70 con 0x7fef7c103e90 2024-04-26T17:58:12.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.854+0000 7fef737fe700 1 -- 172.21.15.92:0/3520226171 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fef6c09ccb0 con 0x7fef7c103e90 2024-04-26T17:58:12.853 INFO:teuthology.orchestra.run.smithi092.stdout:219043332155 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 msgr2=0x7fef680a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 0x7fef680a6190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef78005950 tx=0x7fef7800a300 comp rx=0 tx=0).stop 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 msgr2=0x7fef7c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d980 tx=0x7fef6c00dc90 comp rx=0 tx=0).stop 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 shutdown_connections 2024-04-26T17:58:12.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fef680a3cd0 0x7fef680a6190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef7c1034d0 0x7fef7c19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fef7c1094f0 0x7fef7c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 --2- 172.21.15.92:0/3520226171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c103e90 0x7fef7c19fcc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 >> 172.21.15.92:0/3520226171 conn(0x7fef7c07a500 msgr2=0x7fef7c102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 shutdown_connections 2024-04-26T17:58:12.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:12.856+0000 7fef84679700 1 -- 172.21.15.92:0/3520226171 wait complete. 2024-04-26T17:58:12.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:12 smithi092 ceph-mon[29156]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:12.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:12 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3449849003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T17:58:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:12 smithi189 ceph-mon[32756]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:12 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3449849003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T17:58:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:12 smithi156 ceph-mon[32679]: pgmap v357: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:12 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3449849003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-26T17:58:13.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070512 got 253403070518 for osd.8 2024-04-26T17:58:13.311 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.889+0000 7ff25cb44700 1 -- 172.21.15.92:0/4016428166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 msgr2=0x7ff258102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.889+0000 7ff25cb44700 1 --2- 172.21.15.92:0/4016428166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff258102990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff2480099c0 tx=0x7ff248009cd0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 -- 172.21.15.92:0/4016428166 shutdown_connections 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 --2- 172.21.15.92:0/4016428166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258107640 0x7ff25810f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 --2- 172.21.15.92:0/4016428166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff258102990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 --2- 172.21.15.92:0/4016428166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258102f60 0x7ff258106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 -- 172.21.15.92:0/4016428166 >> 172.21.15.92:0/4016428166 conn(0x7ff2580792f0 msgr2=0x7ff258079700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 -- 172.21.15.92:0/4016428166 shutdown_connections 2024-04-26T17:58:13.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 -- 172.21.15.92:0/4016428166 wait complete. 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 Processor -- start 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.890+0000 7ff25cb44700 1 -- start start 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 0x7ff25819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258107640 0x7ff258199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581124f0 con 0x7ff2581025b0 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff258112370 con 0x7ff258107640 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff258112670 con 0x7ff258102f60 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43976/0 (socket says 172.21.15.92:43976) 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 -- 172.21.15.92:0/3052036219 learned_addr learned my addr 172.21.15.92:0/3052036219 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff256d9d700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258107640 0x7ff258199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff255d9b700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 0x7ff25819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 -- 172.21.15.92:0/3052036219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 msgr2=0x7ff25819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 0x7ff25819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 -- 172.21.15.92:0/3052036219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258107640 msgr2=0x7ff258199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258107640 0x7ff258199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 -- 172.21.15.92:0/3052036219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25819a0f0 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff255d9b700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 0x7ff25819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25659c700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff24800b580 tx=0x7ff2480037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248027070 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25819a380 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff248004110 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24800f460 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.891+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581a66a0 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.892+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25806a110 con 0x7ff2581025b0 2024-04-26T17:58:13.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.893+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff24802a070 con 0x7ff2581025b0 2024-04-26T17:58:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.894+0000 7ff2477fe700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 0x7ff2400a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.894+0000 7ff255d9b700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 0x7ff2400a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.894+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7ff2480d1960 con 0x7ff2581025b0 2024-04-26T17:58:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.894+0000 7ff255d9b700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 0x7ff2400a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff24c005fd0 tx=0x7ff24c005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:13.900 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:13.898+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff248031070 con 0x7ff2581025b0 2024-04-26T17:58:13.914 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:13.915 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:13 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3520226171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T17:58:14.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.116+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff25819aec0 con 0x7ff2581025b0 2024-04-26T17:58:14.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.116+0000 7ff2477fe700 1 -- 172.21.15.92:0/3052036219 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff248013070 con 0x7ff2581025b0 2024-04-26T17:58:14.119 INFO:teuthology.orchestra.run.smithi092.stdout:287762808880 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 msgr2=0x7ff2400a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 0x7ff2400a6190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff24c005fd0 tx=0x7ff24c005dc0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 msgr2=0x7ff25819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff24800b580 tx=0x7ff2480037c0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 shutdown_connections 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff2400a3cd0 0x7ff2400a6190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff258107640 0x7ff258199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2581025b0 0x7ff25819f7d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 --2- 172.21.15.92:0/3052036219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff258102f60 0x7ff25819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 >> 172.21.15.92:0/3052036219 conn(0x7ff2580792f0 msgr2=0x7ff25806bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 shutdown_connections 2024-04-26T17:58:14.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:14.118+0000 7ff25cb44700 1 -- 172.21.15.92:0/3052036219 wait complete. 2024-04-26T17:58:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:13 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3520226171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T17:58:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:13 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3520226171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-26T17:58:14.359 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332150 got 219043332155 for osd.7 2024-04-26T17:58:14.359 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:14.590 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:14 smithi092 ceph-mon[29156]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T17:58:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:14 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3052036219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T17:58:15.093 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808874 got 287762808880 for osd.9 2024-04-26T17:58:15.093 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:14 smithi189 ceph-mon[32756]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T17:58:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:14 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3052036219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T17:58:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:14 smithi156 ceph-mon[32679]: pgmap v358: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T17:58:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:14 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3052036219' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-26T17:58:16.906 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:16 smithi092 ceph-mon[29156]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-26T17:58:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:16 smithi189 ceph-mon[32756]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-26T17:58:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:16 smithi156 ceph-mon[32679]: pgmap v359: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 -- 172.21.15.92:0/1908496699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508107640 msgr2=0x7ff50810f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 --2- 172.21.15.92:0/1908496699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508107640 0x7ff50810f210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff50000b0d0 tx=0x7ff50000b3e0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 -- 172.21.15.92:0/1908496699 shutdown_connections 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 --2- 172.21.15.92:0/1908496699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff508107640 0x7ff50810f210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 --2- 172.21.15.92:0/1908496699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5081025b0 0x7ff508102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 --2- 172.21.15.92:0/1908496699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508102f60 0x7ff508106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 -- 172.21.15.92:0/1908496699 >> 172.21.15.92:0/1908496699 conn(0x7ff5080792d0 msgr2=0x7ff5080796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 -- 172.21.15.92:0/1908496699 shutdown_connections 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.042+0000 7ff50e760700 1 -- 172.21.15.92:0/1908496699 wait complete. 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 Processor -- start 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 -- start start 2024-04-26T17:58:18.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 0x7ff50819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508107640 0x7ff5081a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff508112550 con 0x7ff5081025b0 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081123d0 con 0x7ff508107640 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff50e760700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff5081126d0 con 0x7ff508102f60 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff507fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff507fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38464/0 (socket says 172.21.15.92:38464) 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.043+0000 7ff507fff700 1 -- 172.21.15.92:0/3173407326 learned_addr learned my addr 172.21.15.92:0/3173407326 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff5077fe700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 0x7ff50819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 -- 172.21.15.92:0/3173407326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 msgr2=0x7ff50819aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 0x7ff50819aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff50ccfd700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508107640 0x7ff5081a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 -- 172.21.15.92:0/3173407326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508107640 msgr2=0x7ff5081a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508107640 0x7ff5081a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 -- 172.21.15.92:0/3173407326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5081a5f30 con 0x7ff5081025b0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff5077fe700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 0x7ff50819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff507fff700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b530 tx=0x7ff4f800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8015020 con 0x7ff5081025b0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f8011ce0 con 0x7ff5081025b0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8010d20 con 0x7ff5081025b0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5081a61c0 con 0x7ff5081025b0 2024-04-26T17:58:18.047 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.044+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081a6680 con 0x7ff5081025b0 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.045+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50806a110 con 0x7ff5081025b0 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.046+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7ff4f8018020 con 0x7ff5081025b0 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.047+0000 7ff5057fa700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 0x7ff4f00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.047+0000 7ff5077fe700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 0x7ff4f00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.047+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7ff4f80cfb80 con 0x7ff5081025b0 2024-04-26T17:58:18.048 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.047+0000 7ff5077fe700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 0x7ff4f00a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff508108b50 tx=0x7ff4fc005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.051 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.051+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff4f801f020 con 0x7ff5081025b0 2024-04-26T17:58:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.254+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ff50802e5b0 con 0x7ff5081025b0 2024-04-26T17:58:18.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.254+0000 7ff5057fa700 1 -- 172.21.15.92:0/3173407326 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff4f809c610 con 0x7ff5081025b0 2024-04-26T17:58:18.254 INFO:teuthology.orchestra.run.smithi092.stdout:309237645356 2024-04-26T17:58:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 msgr2=0x7ff4f00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 0x7ff4f00a6210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff508108b50 tx=0x7ff4fc005f50 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 msgr2=0x7ff50819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b530 tx=0x7ff4f800b8f0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 shutdown_connections 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff4f00a3d50 0x7ff4f00a6210 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff508107640 0x7ff5081a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5081025b0 0x7ff50819a970 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 --2- 172.21.15.92:0/3173407326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff508102f60 0x7ff50819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 >> 172.21.15.92:0/3173407326 conn(0x7ff5080792d0 msgr2=0x7ff508100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 shutdown_connections 2024-04-26T17:58:18.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:18.256+0000 7ff50e760700 1 -- 172.21.15.92:0/3173407326 wait complete. 2024-04-26T17:58:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:18 smithi092 ceph-mon[29156]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:18 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3173407326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T17:58:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:18 smithi189 ceph-mon[32756]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:18 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3173407326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T17:58:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:18 smithi156 ceph-mon[32679]: pgmap v360: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:18 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3173407326' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-26T17:58:19.588 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645353 got 309237645356 for osd.10 2024-04-26T17:58:19.588 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 -- 172.21.15.92:0/1663832398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204101de0 msgr2=0x7f6204102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 --2- 172.21.15.92:0/1663832398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204101de0 0x7f6204102260 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009990 tx=0x7f61f8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 -- 172.21.15.92:0/1663832398 shutdown_connections 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 --2- 172.21.15.92:0/1663832398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6204107c20 0x7f6204108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 --2- 172.21.15.92:0/1663832398 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f62041027a0 0x7f620410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 --2- 172.21.15.92:0/1663832398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204101de0 0x7f6204102260 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 -- 172.21.15.92:0/1663832398 >> 172.21.15.92:0/1663832398 conn(0x7f6204077640 msgr2=0x7f6204077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 -- 172.21.15.92:0/1663832398 shutdown_connections 2024-04-26T17:58:20.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.157+0000 7f6209c7f700 1 -- 172.21.15.92:0/1663832398 wait complete. 2024-04-26T17:58:20.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.158+0000 7f6209c7f700 1 Processor -- start 2024-04-26T17:58:20.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.158+0000 7f6209c7f700 1 -- start start 2024-04-26T17:58:20.160 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 0x7f620419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62041027a0 0x7f620419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6204112590 con 0x7f6204107c20 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6204112410 con 0x7f62041027a0 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6204112710 con 0x7f6204101de0 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38478/0 (socket says 172.21.15.92:38478) 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 -- 172.21.15.92:0/3438170977 learned_addr learned my addr 172.21.15.92:0/3438170977 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6202ffd700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62041027a0 0x7f620419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f62037fe700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 0x7f620419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 -- 172.21.15.92:0/3438170977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 msgr2=0x7f620419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 0x7f620419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.161 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 -- 172.21.15.92:0/3438170977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62041027a0 msgr2=0x7f620419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62041027a0 0x7f620419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 -- 172.21.15.92:0/3438170977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62041a5eb0 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f62037fe700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 0x7f620419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6203fff700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00b970 tx=0x7f61fc00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc019070 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62041a60e0 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61fc014440 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc00ce60 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.159+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62041a65f0 con 0x7f6204107c20 2024-04-26T17:58:20.162 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.160+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620406a110 con 0x7f6204107c20 2024-04-26T17:58:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.161+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f61fc01c070 con 0x7f6204107c20 2024-04-26T17:58:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.162+0000 7f6200ff9700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 0x7f61ec0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.163 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.162+0000 7f62037fe700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 0x7f61ec0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.162+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f61fc0cfd70 con 0x7f6204107c20 2024-04-26T17:58:20.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.163+0000 7f62037fe700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 0x7f61ec0a6190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005fd0 tx=0x7f61f4005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.166+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f61fc09c700 con 0x7f6204107c20 2024-04-26T17:58:20.373 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.373+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f620410f960 con 0x7f6204107c20 2024-04-26T17:58:20.374 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.373+0000 7f6200ff9700 1 -- 172.21.15.92:0/3438170977 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61fc09c000 con 0x7f6204107c20 2024-04-26T17:58:20.374 INFO:teuthology.orchestra.run.smithi092.stdout:77309411415 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.375+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 msgr2=0x7f61ec0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.375+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 0x7f61ec0a6190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005fd0 tx=0x7f61f4005dc0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.375+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 msgr2=0x7f62041a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.375+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00b970 tx=0x7f61fc00bd30 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 shutdown_connections 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f61ec0a3cd0 0x7f61ec0a6190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6204107c20 0x7f62041a5970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6204101de0 0x7f620419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 --2- 172.21.15.92:0/3438170977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62041027a0 0x7f620419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.376 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 >> 172.21.15.92:0/3438170977 conn(0x7f6204077640 msgr2=0x7f62040ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 shutdown_connections 2024-04-26T17:58:20.377 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.376+0000 7f6209c7f700 1 -- 172.21.15.92:0/3438170977 wait complete. 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 -- 172.21.15.92:0/789825406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860102ce0 msgr2=0x7fa86010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 --2- 172.21.15.92:0/789825406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860102ce0 0x7fa86010f1d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa85800b0a0 tx=0x7fa85800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 -- 172.21.15.92:0/789825406 shutdown_connections 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 --2- 172.21.15.92:0/789825406 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860108390 0x7fa860108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 --2- 172.21.15.92:0/789825406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860102ce0 0x7fa86010f1d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 --2- 172.21.15.92:0/789825406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102320 0x7fa8601027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 -- 172.21.15.92:0/789825406 >> 172.21.15.92:0/789825406 conn(0x7fa8600792d0 msgr2=0x7fa8600796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 -- 172.21.15.92:0/789825406 shutdown_connections 2024-04-26T17:58:20.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.513+0000 7fa868199700 1 -- 172.21.15.92:0/789825406 wait complete. 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 Processor -- start 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 -- start start 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860102320 0x7fa86019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102ce0 0x7fa86019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8601124b0 con 0x7fa860108390 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa860112330 con 0x7fa860102320 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.514+0000 7fa868199700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa860112630 con 0x7fa860102ce0 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38498/0 (socket says 172.21.15.92:38498) 2024-04-26T17:58:20.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 -- 172.21.15.92:0/3913573577 learned_addr learned my addr 172.21.15.92:0/3913573577 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa865734700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102ce0 0x7fa86019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa865f35700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860102320 0x7fa86019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 -- 172.21.15.92:0/3913573577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102ce0 msgr2=0x7fa86019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102ce0 0x7fa86019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 -- 172.21.15.92:0/3913573577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860102320 msgr2=0x7fa86019e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860102320 0x7fa86019e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 -- 172.21.15.92:0/3913573577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa860198f90 con 0x7fa860108390 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa866736700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8580062a0 tx=0x7fa858004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858021070 con 0x7fa860108390 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa858007e30 con 0x7fa860108390 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa860199220 con 0x7fa860108390 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8580046d0 con 0x7fa860108390 2024-04-26T17:58:20.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.515+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86006b100 con 0x7fa860108390 2024-04-26T17:58:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.516+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa860103a40 con 0x7fa860108390 2024-04-26T17:58:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.518+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fa858007980 con 0x7fa860108390 2024-04-26T17:58:20.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.518+0000 7fa856ffd700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 0x7fa84c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.518+0000 7fa865f35700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 0x7fa84c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.518+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa85800f020 con 0x7fa860108390 2024-04-26T17:58:20.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.519+0000 7fa865f35700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 0x7fa84c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009be0 tx=0x7fa85c010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.522+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa85802a020 con 0x7fa860108390 2024-04-26T17:58:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.723+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa860199d10 con 0x7fa860108390 2024-04-26T17:58:20.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.724+0000 7fa856ffd700 1 -- 172.21.15.92:0/3913573577 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa860199d10 con 0x7fa860108390 2024-04-26T17:58:20.724 INFO:teuthology.orchestra.run.smithi092.stdout:107374182482 2024-04-26T17:58:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 msgr2=0x7fa84c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 0x7fa84c0a6190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009be0 tx=0x7fa85c010040 comp rx=0 tx=0).stop 2024-04-26T17:58:20.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 msgr2=0x7fa8601987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa8580062a0 tx=0x7fa858004c80 comp rx=0 tx=0).stop 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 shutdown_connections 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa84c0a3cd0 0x7fa84c0a6190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa860102320 0x7fa86019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa860108390 0x7fa8601987b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 --2- 172.21.15.92:0/3913573577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa860102ce0 0x7fa86019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 >> 172.21.15.92:0/3913573577 conn(0x7fa8600792d0 msgr2=0x7fa860100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 shutdown_connections 2024-04-26T17:58:20.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:20.726+0000 7fa868199700 1 -- 172.21.15.92:0/3913573577 wait complete. 2024-04-26T17:58:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:20 smithi092 ceph-mon[29156]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:20 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3438170977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T17:58:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:20 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3913573577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T17:58:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:20 smithi189 ceph-mon[32756]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:20 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3438170977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T17:58:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:20 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3913573577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T17:58:21.165 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411409 got 77309411415 for osd.2 2024-04-26T17:58:21.165 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:20 smithi156 ceph-mon[32679]: pgmap v361: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:20 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3438170977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-26T17:58:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:20 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3913573577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-26T17:58:21.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182476 got 107374182482 for osd.3 2024-04-26T17:58:21.907 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:21.907 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:21.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:58:22.162 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:22 smithi092 ceph-mon[29156]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:22 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:23.029 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:22 smithi156 ceph-mon[32679]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:23.029 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:22 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:23.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:22 smithi189 ceph-mon[32756]: pgmap v362: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:23.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:22 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:58:23.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.866+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/1323119965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 msgr2=0x7fd4b0103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:23.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.866+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/1323119965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b0103950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd4a00099c0 tx=0x7fd4a0009cd0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/1323119965 shutdown_connections 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/1323119965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/1323119965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 0x7fd4b0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/1323119965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b0103950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/1323119965 >> 172.21.15.92:0/1323119965 conn(0x7fd4b007a580 msgr2=0x7fd4b007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/1323119965 shutdown_connections 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/1323119965 wait complete. 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 Processor -- start 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- start start 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 0x7fd4b019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0113620 con 0x7fd4b01034d0 2024-04-26T17:58:23.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01134a0 con 0x7fd4b01083b0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b7c5c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01137a0 con 0x7fd4b0103e90 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.867+0000 7fd4b59f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38514/0 (socket says 172.21.15.92:38514) 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 -- 172.21.15.92:0/127119669 learned_addr learned my addr 172.21.15.92:0/127119669 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b51f7700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 0x7fd4b019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b61f9700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 -- 172.21.15.92:0/127119669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 msgr2=0x7fd4b019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 0x7fd4b019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 -- 172.21.15.92:0/127119669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 msgr2=0x7fd4b0199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 -- 172.21.15.92:0/127119669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b019a080 con 0x7fd4b01034d0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b61f9700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b59f8700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00d950 tx=0x7fd4ac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac016070 con 0x7fd4b01034d0 2024-04-26T17:58:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b019a370 con 0x7fd4b01034d0 2024-04-26T17:58:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4ac009df0 con 0x7fd4b01034d0 2024-04-26T17:58:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00f3c0 con 0x7fd4b01034d0 2024-04-26T17:58:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.868+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01a6630 con 0x7fd4b01034d0 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.869+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b006a110 con 0x7fd4b01034d0 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.870+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7fd4ac019070 con 0x7fd4b01034d0 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.871+0000 7fd4a6ffd700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 0x7fd49c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.871+0000 7fd4b51f7700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 0x7fd49c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.871+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fd4ac0cfff0 con 0x7fd4b01034d0 2024-04-26T17:58:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.871+0000 7fd4b51f7700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 0x7fd49c0a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009990 tx=0x7fd4a0009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:23.875+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fd4ac09c970 con 0x7fd4b01034d0 2024-04-26T17:58:24.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.082+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4b019ae50 con 0x7fd49c0a3cd0 2024-04-26T17:58:24.089 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.089+0000 7fd4a6ffd700 1 -- 172.21.15.92:0/127119669 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258891 (secure 0 0 0) 0x7fd4b019ae50 con 0x7fd49c0a3cd0 2024-04-26T17:58:24.094 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 msgr2=0x7fd49c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 0x7fd49c0a6190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009990 tx=0x7fd4a0009650 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 msgr2=0x7fd4b019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00d950 tx=0x7fd4ac00dc60 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 shutdown_connections 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fd49c0a3cd0 0x7fd49c0a6190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd4b01083b0 0x7fd4b0199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4b01034d0 0x7fd4b019f760 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 --2- 172.21.15.92:0/127119669 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4b0103e90 0x7fd4b019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 >> 172.21.15.92:0/127119669 conn(0x7fd4b007a580 msgr2=0x7fd4b0101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 shutdown_connections 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:24.092+0000 7fd4b7c5c700 1 -- 172.21.15.92:0/127119669 wait complete. 2024-04-26T17:58:24.096 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:58:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:24 smithi156 ceph-mon[32679]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:24 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:24 smithi092 ceph-mon[29156]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:24.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:24.958 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:24 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:24 smithi189 ceph-mon[32756]: pgmap v363: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:24 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:25.300 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-04-26T17:58:23.653963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655220,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":757,"num_read_kb":495,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365340,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576484,"statfs":{"total":1151940427776,"available":1151566319616,"internally_reserved":0,"allocated":12288000,"data_stored":7715064,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003397"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625150+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:56:58.625150+0000","last_peered":"2024-04-26T17:56:58.625150+0000","last_clean":"2024-04-26T17:56:58.625150+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:56:58.625150+0000","last_undegraded":"2024-04-26T17:56:58.625150+0000","last_fullsized":"2024-04-26T17:56:58.625150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180964+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:56:59.180964+0000","last_peered":"2024-04-26T17:56:59.180964+0000","last_clean":"2024-04-26T17:56:59.180964+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:56:59.180964+0000","last_undegraded":"2024-04-26T17:56:59.180964+0000","last_fullsized":"2024-04-26T17:56:59.180964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180784+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:56:59.180784+0000","last_peered":"2024-04-26T17:56:59.180784+0000","last_clean":"2024-04-26T17:56:59.180784+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:56:59.180784+0000","last_undegraded":"2024-04-26T17:56:59.180784+0000","last_fullsized":"2024-04-26T17:56:59.180784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777001+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:56:58.777001+0000","last_peered":"2024-04-26T17:56:58.777001+0000","last_clean":"2024-04-26T17:56:58.777001+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:56:58.777001+0000","last_undegraded":"2024-04-26T17:56:58.777001+0000","last_fullsized":"2024-04-26T17:56:58.777001+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626212+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:56:58.626212+0000","last_peered":"2024-04-26T17:56:58.626212+0000","last_clean":"2024-04-26T17:56:58.626212+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:56:58.626212+0000","last_undegraded":"2024-04-26T17:56:58.626212+0000","last_fullsized":"2024-04-26T17:56:58.626212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624995+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:56:58.624995+0000","last_peered":"2024-04-26T17:56:58.624995+0000","last_clean":"2024-04-26T17:56:58.624995+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:56:58.624995+0000","last_undegraded":"2024-04-26T17:56:58.624995+0000","last_fullsized":"2024-04-26T17:56:58.624995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.622981+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:56:58.622981+0000","last_peered":"2024-04-26T17:56:58.622981+0000","last_clean":"2024-04-26T17:56:58.622981+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:56:58.622981+0000","last_undegraded":"2024-04-26T17:56:58.622981+0000","last_fullsized":"2024-04-26T17:56:58.622981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627218+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:56:58.627218+0000","last_peered":"2024-04-26T17:56:58.627218+0000","last_clean":"2024-04-26T17:56:58.627218+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:56:58.627218+0000","last_undegraded":"2024-04-26T17:56:58.627218+0000","last_fullsized":"2024-04-26T17:56:58.627218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621734+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:56:58.621734+0000","last_peered":"2024-04-26T17:56:58.621734+0000","last_clean":"2024-04-26T17:56:58.621734+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:56:58.621734+0000","last_undegraded":"2024-04-26T17:56:58.621734+0000","last_fullsized":"2024-04-26T17:56:58.621734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625626+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:56:58.625626+0000","last_peered":"2024-04-26T17:56:58.625626+0000","last_clean":"2024-04-26T17:56:58.625626+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:56:58.625626+0000","last_undegraded":"2024-04-26T17:56:58.625626+0000","last_fullsized":"2024-04-26T17:56:58.625626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623291+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:56:58.623291+0000","last_peered":"2024-04-26T17:56:58.623291+0000","last_clean":"2024-04-26T17:56:58.623291+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:56:58.623291+0000","last_undegraded":"2024-04-26T17:56:58.623291+0000","last_fullsized":"2024-04-26T17:56:58.623291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.632207+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:56:58.632207+0000","last_peered":"2024-04-26T17:56:58.632207+0000","last_clean":"2024-04-26T17:56:58.632207+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:56:58.632207+0000","last_undegraded":"2024-04-26T17:56:58.632207+0000","last_fullsized":"2024-04-26T17:56:58.632207+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620689+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:56:58.620689+0000","last_peered":"2024-04-26T17:56:58.620689+0000","last_clean":"2024-04-26T17:56:58.620689+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:56:58.620689+0000","last_undegraded":"2024-04-26T17:56:58.620689+0000","last_fullsized":"2024-04-26T17:56:58.620689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180696+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:56:59.180696+0000","last_peered":"2024-04-26T17:56:59.180696+0000","last_clean":"2024-04-26T17:56:59.180696+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:56:59.180696+0000","last_undegraded":"2024-04-26T17:56:59.180696+0000","last_fullsized":"2024-04-26T17:56:59.180696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180596+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:56:59.180596+0000","last_peered":"2024-04-26T17:56:59.180596+0000","last_clean":"2024-04-26T17:56:59.180596+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:56:59.180596+0000","last_undegraded":"2024-04-26T17:56:59.180596+0000","last_fullsized":"2024-04-26T17:56:59.180596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621131+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:56:58.621131+0000","last_peered":"2024-04-26T17:56:58.621131+0000","last_clean":"2024-04-26T17:56:58.621131+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:56:58.621131+0000","last_undegraded":"2024-04-26T17:56:58.621131+0000","last_fullsized":"2024-04-26T17:56:58.621131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625284+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:56:58.625284+0000","last_peered":"2024-04-26T17:56:58.625284+0000","last_clean":"2024-04-26T17:56:58.625284+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:56:58.625284+0000","last_undegraded":"2024-04-26T17:56:58.625284+0000","last_fullsized":"2024-04-26T17:56:58.625284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624321+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:56:58.624321+0000","last_peered":"2024-04-26T17:56:58.624321+0000","last_clean":"2024-04-26T17:56:58.624321+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:56:58.624321+0000","last_undegraded":"2024-04-26T17:56:58.624321+0000","last_fullsized":"2024-04-26T17:56:58.624321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628050+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:56:58.628050+0000","last_peered":"2024-04-26T17:56:58.628050+0000","last_clean":"2024-04-26T17:56:58.628050+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:56:58.628050+0000","last_undegraded":"2024-04-26T17:56:58.628050+0000","last_fullsized":"2024-04-26T17:56:58.628050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.783365+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:56:58.783365+0000","last_peered":"2024-04-26T17:56:58.783365+0000","last_clean":"2024-04-26T17:56:58.783365+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:56:58.783365+0000","last_undegraded":"2024-04-26T17:56:58.783365+0000","last_fullsized":"2024-04-26T17:56:58.783365+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627718+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:56:58.627718+0000","last_peered":"2024-04-26T17:56:58.627718+0000","last_clean":"2024-04-26T17:56:58.627718+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:56:58.627718+0000","last_undegraded":"2024-04-26T17:56:58.627718+0000","last_fullsized":"2024-04-26T17:56:58.627718+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627967+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:56:58.627967+0000","last_peered":"2024-04-26T17:56:58.627967+0000","last_clean":"2024-04-26T17:56:58.627967+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:56:58.627967+0000","last_undegraded":"2024-04-26T17:56:58.627967+0000","last_fullsized":"2024-04-26T17:56:58.627967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181165+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:56:59.181165+0000","last_peered":"2024-04-26T17:56:59.181165+0000","last_clean":"2024-04-26T17:56:59.181165+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:56:59.181165+0000","last_undegraded":"2024-04-26T17:56:59.181165+0000","last_fullsized":"2024-04-26T17:56:59.181165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627279+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:56:58.627279+0000","last_peered":"2024-04-26T17:56:58.627279+0000","last_clean":"2024-04-26T17:56:58.627279+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627279+0000","last_undegraded":"2024-04-26T17:56:58.627279+0000","last_fullsized":"2024-04-26T17:56:58.627279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621361+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:56:58.621361+0000","last_peered":"2024-04-26T17:56:58.621361+0000","last_clean":"2024-04-26T17:56:58.621361+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:56:58.621361+0000","last_undegraded":"2024-04-26T17:56:58.621361+0000","last_fullsized":"2024-04-26T17:56:58.621361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627192+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:56:58.627192+0000","last_peered":"2024-04-26T17:56:58.627192+0000","last_clean":"2024-04-26T17:56:58.627192+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627192+0000","last_undegraded":"2024-04-26T17:56:58.627192+0000","last_fullsized":"2024-04-26T17:56:58.627192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621757+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:56:58.621757+0000","last_peered":"2024-04-26T17:56:58.621757+0000","last_clean":"2024-04-26T17:56:58.621757+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:56:58.621757+0000","last_undegraded":"2024-04-26T17:56:58.621757+0000","last_fullsized":"2024-04-26T17:56:58.621757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:21.891913+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:58:21.891913+0000","last_peered":"2024-04-26T17:58:21.891913+0000","last_clean":"2024-04-26T17:58:21.891913+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:58:21.891913+0000","last_undegraded":"2024-04-26T17:58:21.891913+0000","last_fullsized":"2024-04-26T17:58:21.891913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626464+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:56:58.626464+0000","last_peered":"2024-04-26T17:56:58.626464+0000","last_clean":"2024-04-26T17:56:58.626464+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:56:58.626464+0000","last_undegraded":"2024-04-26T17:56:58.626464+0000","last_fullsized":"2024-04-26T17:56:58.626464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625011+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:56:58.625011+0000","last_peered":"2024-04-26T17:56:58.625011+0000","last_clean":"2024-04-26T17:56:58.625011+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:56:58.625011+0000","last_undegraded":"2024-04-26T17:56:58.625011+0000","last_fullsized":"2024-04-26T17:56:58.625011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621485+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:56:58.621485+0000","last_peered":"2024-04-26T17:56:58.621485+0000","last_clean":"2024-04-26T17:56:58.621485+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:56:58.621485+0000","last_undegraded":"2024-04-26T17:56:58.621485+0000","last_fullsized":"2024-04-26T17:56:58.621485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620515+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:56:58.620515+0000","last_peered":"2024-04-26T17:56:58.620515+0000","last_clean":"2024-04-26T17:56:58.620515+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:56:58.620515+0000","last_undegraded":"2024-04-26T17:56:58.620515+0000","last_fullsized":"2024-04-26T17:56:58.620515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627115+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:56:58.627115+0000","last_peered":"2024-04-26T17:56:58.627115+0000","last_clean":"2024-04-26T17:56:58.627115+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:56:58.627115+0000","last_undegraded":"2024-04-26T17:56:58.627115+0000","last_fullsized":"2024-04-26T17:56:58.627115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621197+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:56:58.621197+0000","last_peered":"2024-04-26T17:56:58.621197+0000","last_clean":"2024-04-26T17:56:58.621197+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:56:58.621197+0000","last_undegraded":"2024-04-26T17:56:58.621197+0000","last_fullsized":"2024-04-26T17:56:58.621197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624109+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:56:58.624109+0000","last_peered":"2024-04-26T17:56:58.624109+0000","last_clean":"2024-04-26T17:56:58.624109+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:56:58.624109+0000","last_undegraded":"2024-04-26T17:56:58.624109+0000","last_fullsized":"2024-04-26T17:56:58.624109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":127,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.885598+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:58:17.885598+0000","last_peered":"2024-04-26T17:58:17.885598+0000","last_clean":"2024-04-26T17:58:17.885598+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:58:17.885598+0000","last_undegraded":"2024-04-26T17:58:17.885598+0000","last_fullsized":"2024-04-26T17:58:17.885598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621654+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:56:58.621654+0000","last_peered":"2024-04-26T17:56:58.621654+0000","last_clean":"2024-04-26T17:56:58.621654+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:56:58.621654+0000","last_undegraded":"2024-04-26T17:56:58.621654+0000","last_fullsized":"2024-04-26T17:56:58.621654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623398+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:56:58.623398+0000","last_peered":"2024-04-26T17:56:58.623398+0000","last_clean":"2024-04-26T17:56:58.623398+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:56:58.623398+0000","last_undegraded":"2024-04-26T17:56:58.623398+0000","last_fullsized":"2024-04-26T17:56:58.623398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181116+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:56:59.181116+0000","last_peered":"2024-04-26T17:56:59.181116+0000","last_clean":"2024-04-26T17:56:59.181116+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:56:59.181116+0000","last_undegraded":"2024-04-26T17:56:59.181116+0000","last_fullsized":"2024-04-26T17:56:59.181116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621803+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:56:58.621803+0000","last_peered":"2024-04-26T17:56:58.621803+0000","last_clean":"2024-04-26T17:56:58.621803+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:56:58.621803+0000","last_undegraded":"2024-04-26T17:56:58.621803+0000","last_fullsized":"2024-04-26T17:56:58.621803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621365+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:56:58.621365+0000","last_peered":"2024-04-26T17:56:58.621365+0000","last_clean":"2024-04-26T17:56:58.621365+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:56:58.621365+0000","last_undegraded":"2024-04-26T17:56:58.621365+0000","last_fullsized":"2024-04-26T17:56:58.621365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'29","reported_seq":261,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.886831+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:58:18.886831+0000","last_peered":"2024-04-26T17:58:18.886831+0000","last_clean":"2024-04-26T17:58:18.886831+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:58:18.886831+0000","last_undegraded":"2024-04-26T17:58:18.886831+0000","last_fullsized":"2024-04-26T17:58:18.886831+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60617,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":161,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627072+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:56:58.627072+0000","last_peered":"2024-04-26T17:56:58.627072+0000","last_clean":"2024-04-26T17:56:58.627072+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:56:58.627072+0000","last_undegraded":"2024-04-26T17:56:58.627072+0000","last_fullsized":"2024-04-26T17:56:58.627072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627777+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:56:58.627777+0000","last_peered":"2024-04-26T17:56:58.627777+0000","last_clean":"2024-04-26T17:56:58.627777+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:56:58.627777+0000","last_undegraded":"2024-04-26T17:56:58.627777+0000","last_fullsized":"2024-04-26T17:56:58.627777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620784+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:56:58.620784+0000","last_peered":"2024-04-26T17:56:58.620784+0000","last_clean":"2024-04-26T17:56:58.620784+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:56:58.620784+0000","last_undegraded":"2024-04-26T17:56:58.620784+0000","last_fullsized":"2024-04-26T17:56:58.620784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621467+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:56:58.621467+0000","last_peered":"2024-04-26T17:56:58.621467+0000","last_clean":"2024-04-26T17:56:58.621467+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:56:58.621467+0000","last_undegraded":"2024-04-26T17:56:58.621467+0000","last_fullsized":"2024-04-26T17:56:58.621467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623152+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:56:58.623152+0000","last_peered":"2024-04-26T17:56:58.623152+0000","last_clean":"2024-04-26T17:56:58.623152+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:56:58.623152+0000","last_undegraded":"2024-04-26T17:56:58.623152+0000","last_fullsized":"2024-04-26T17:56:58.623152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":129,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.912209+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:58:17.912209+0000","last_peered":"2024-04-26T17:58:17.912209+0000","last_clean":"2024-04-26T17:58:17.912209+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:58:17.912209+0000","last_undegraded":"2024-04-26T17:58:17.912209+0000","last_fullsized":"2024-04-26T17:58:17.912209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627910+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:56:58.627910+0000","last_peered":"2024-04-26T17:56:58.627910+0000","last_clean":"2024-04-26T17:56:58.627910+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:56:58.627910+0000","last_undegraded":"2024-04-26T17:56:58.627910+0000","last_fullsized":"2024-04-26T17:56:58.627910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626465+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:56:58.626465+0000","last_peered":"2024-04-26T17:56:58.626465+0000","last_clean":"2024-04-26T17:56:58.626465+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:56:58.626465+0000","last_undegraded":"2024-04-26T17:56:58.626465+0000","last_fullsized":"2024-04-26T17:56:58.626465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621381+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:56:58.621381+0000","last_peered":"2024-04-26T17:56:58.621381+0000","last_clean":"2024-04-26T17:56:58.621381+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:56:58.621381+0000","last_undegraded":"2024-04-26T17:56:58.621381+0000","last_fullsized":"2024-04-26T17:56:58.621381+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627296+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:56:58.627296+0000","last_peered":"2024-04-26T17:56:58.627296+0000","last_clean":"2024-04-26T17:56:58.627296+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:56:58.627296+0000","last_undegraded":"2024-04-26T17:56:58.627296+0000","last_fullsized":"2024-04-26T17:56:58.627296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625142+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:56:58.625142+0000","last_peered":"2024-04-26T17:56:58.625142+0000","last_clean":"2024-04-26T17:56:58.625142+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:56:58.625142+0000","last_undegraded":"2024-04-26T17:56:58.625142+0000","last_fullsized":"2024-04-26T17:56:58.625142+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.182031+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:56:59.182031+0000","last_peered":"2024-04-26T17:56:59.182031+0000","last_clean":"2024-04-26T17:56:59.182031+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:56:59.182031+0000","last_undegraded":"2024-04-26T17:56:59.182031+0000","last_fullsized":"2024-04-26T17:56:59.182031+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625251+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:56:58.625251+0000","last_peered":"2024-04-26T17:56:58.625251+0000","last_clean":"2024-04-26T17:56:58.625251+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:56:58.625251+0000","last_undegraded":"2024-04-26T17:56:58.625251+0000","last_fullsized":"2024-04-26T17:56:58.625251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623126+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:56:58.623126+0000","last_peered":"2024-04-26T17:56:58.623126+0000","last_clean":"2024-04-26T17:56:58.623126+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:56:58.623126+0000","last_undegraded":"2024-04-26T17:56:58.623126+0000","last_fullsized":"2024-04-26T17:56:58.623126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181994+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:56:59.181994+0000","last_peered":"2024-04-26T17:56:59.181994+0000","last_clean":"2024-04-26T17:56:59.181994+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:56:59.181994+0000","last_undegraded":"2024-04-26T17:56:59.181994+0000","last_fullsized":"2024-04-26T17:56:59.181994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621636+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:56:58.621636+0000","last_peered":"2024-04-26T17:56:58.621636+0000","last_clean":"2024-04-26T17:56:58.621636+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:56:58.621636+0000","last_undegraded":"2024-04-26T17:56:58.621636+0000","last_fullsized":"2024-04-26T17:56:58.621636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":128,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:17.911099+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:58:17.911099+0000","last_peered":"2024-04-26T17:58:17.911099+0000","last_clean":"2024-04-26T17:58:17.911099+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:58:17.911099+0000","last_undegraded":"2024-04-26T17:58:17.911099+0000","last_fullsized":"2024-04-26T17:58:17.911099+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627275+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:56:58.627275+0000","last_peered":"2024-04-26T17:56:58.627275+0000","last_clean":"2024-04-26T17:56:58.627275+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:56:58.627275+0000","last_undegraded":"2024-04-26T17:56:58.627275+0000","last_fullsized":"2024-04-26T17:56:58.627275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.776753+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:56:58.776753+0000","last_peered":"2024-04-26T17:56:58.776753+0000","last_clean":"2024-04-26T17:56:58.776753+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:56:58.776753+0000","last_undegraded":"2024-04-26T17:56:58.776753+0000","last_fullsized":"2024-04-26T17:56:58.776753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":357,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623774+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:56:58.623774+0000","last_peered":"2024-04-26T17:56:58.623774+0000","last_clean":"2024-04-26T17:56:58.623774+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:56:58.623774+0000","last_undegraded":"2024-04-26T17:56:58.623774+0000","last_fullsized":"2024-04-26T17:56:58.623774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620399+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:56:58.620399+0000","last_peered":"2024-04-26T17:56:58.620399+0000","last_clean":"2024-04-26T17:56:58.620399+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:56:58.620399+0000","last_undegraded":"2024-04-26T17:56:58.620399+0000","last_fullsized":"2024-04-26T17:56:58.620399+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623850+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:56:58.623850+0000","last_peered":"2024-04-26T17:56:58.623850+0000","last_clean":"2024-04-26T17:56:58.623850+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:56:58.623850+0000","last_undegraded":"2024-04-26T17:56:58.623850+0000","last_fullsized":"2024-04-26T17:56:58.623850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627100+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:56:58.627100+0000","last_peered":"2024-04-26T17:56:58.627100+0000","last_clean":"2024-04-26T17:56:58.627100+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:56:58.627100+0000","last_undegraded":"2024-04-26T17:56:58.627100+0000","last_fullsized":"2024-04-26T17:56:58.627100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620703+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:56:58.620703+0000","last_peered":"2024-04-26T17:56:58.620703+0000","last_clean":"2024-04-26T17:56:58.620703+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:56:58.620703+0000","last_undegraded":"2024-04-26T17:56:58.620703+0000","last_fullsized":"2024-04-26T17:56:58.620703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'10","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:03.506362+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:57:03.506362+0000","last_peered":"2024-04-26T17:57:03.506362+0000","last_clean":"2024-04-26T17:57:03.506362+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:57:03.506362+0000","last_undegraded":"2024-04-26T17:57:03.506362+0000","last_fullsized":"2024-04-26T17:57:03.506362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627670+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:56:58.627670+0000","last_peered":"2024-04-26T17:56:58.627670+0000","last_clean":"2024-04-26T17:56:58.627670+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:56:58.627670+0000","last_undegraded":"2024-04-26T17:56:58.627670+0000","last_fullsized":"2024-04-26T17:56:58.627670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777023+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:56:58.777023+0000","last_peered":"2024-04-26T17:56:58.777023+0000","last_clean":"2024-04-26T17:56:58.777023+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:56:58.777023+0000","last_undegraded":"2024-04-26T17:56:58.777023+0000","last_fullsized":"2024-04-26T17:56:58.777023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180997+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:56:59.180997+0000","last_peered":"2024-04-26T17:56:59.180997+0000","last_clean":"2024-04-26T17:56:59.180997+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:56:59.180997+0000","last_undegraded":"2024-04-26T17:56:59.180997+0000","last_fullsized":"2024-04-26T17:56:59.180997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621148+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:56:58.621148+0000","last_peered":"2024-04-26T17:56:58.621148+0000","last_clean":"2024-04-26T17:56:58.621148+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:56:58.621148+0000","last_undegraded":"2024-04-26T17:56:58.621148+0000","last_fullsized":"2024-04-26T17:56:58.621148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626391+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:56:58.626391+0000","last_peered":"2024-04-26T17:56:58.626391+0000","last_clean":"2024-04-26T17:56:58.626391+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:56:58.626391+0000","last_undegraded":"2024-04-26T17:56:58.626391+0000","last_fullsized":"2024-04-26T17:56:58.626391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627494+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:56:58.627494+0000","last_peered":"2024-04-26T17:56:58.627494+0000","last_clean":"2024-04-26T17:56:58.627494+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:56:58.627494+0000","last_undegraded":"2024-04-26T17:56:58.627494+0000","last_fullsized":"2024-04-26T17:56:58.627494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624717+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:56:58.624717+0000","last_peered":"2024-04-26T17:56:58.624717+0000","last_clean":"2024-04-26T17:56:58.624717+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:56:58.624717+0000","last_undegraded":"2024-04-26T17:56:58.624717+0000","last_fullsized":"2024-04-26T17:56:58.624717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.633216+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:56:58.633216+0000","last_peered":"2024-04-26T17:56:58.633216+0000","last_clean":"2024-04-26T17:56:58.633216+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:56:58.633216+0000","last_undegraded":"2024-04-26T17:56:58.633216+0000","last_fullsized":"2024-04-26T17:56:58.633216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627277+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:56:58.627277+0000","last_peered":"2024-04-26T17:56:58.627277+0000","last_clean":"2024-04-26T17:56:58.627277+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:56:58.627277+0000","last_undegraded":"2024-04-26T17:56:58.627277+0000","last_fullsized":"2024-04-26T17:56:58.627277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626611+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:56:58.626611+0000","last_peered":"2024-04-26T17:56:58.626611+0000","last_clean":"2024-04-26T17:56:58.626611+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:56:58.626611+0000","last_undegraded":"2024-04-26T17:56:58.626611+0000","last_fullsized":"2024-04-26T17:56:58.626611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623503+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:56:58.623503+0000","last_peered":"2024-04-26T17:56:58.623503+0000","last_clean":"2024-04-26T17:56:58.623503+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:56:58.623503+0000","last_undegraded":"2024-04-26T17:56:58.623503+0000","last_fullsized":"2024-04-26T17:56:58.623503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628211+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:56:58.628211+0000","last_peered":"2024-04-26T17:56:58.628211+0000","last_clean":"2024-04-26T17:56:58.628211+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:56:58.628211+0000","last_undegraded":"2024-04-26T17:56:58.628211+0000","last_fullsized":"2024-04-26T17:56:58.628211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623431+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:56:58.623431+0000","last_peered":"2024-04-26T17:56:58.623431+0000","last_clean":"2024-04-26T17:56:58.623431+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:56:58.623431+0000","last_undegraded":"2024-04-26T17:56:58.623431+0000","last_fullsized":"2024-04-26T17:56:58.623431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621658+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:56:58.621658+0000","last_peered":"2024-04-26T17:56:58.621658+0000","last_clean":"2024-04-26T17:56:58.621658+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:56:58.621658+0000","last_undegraded":"2024-04-26T17:56:58.621658+0000","last_fullsized":"2024-04-26T17:56:58.621658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623539+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:56:58.623539+0000","last_peered":"2024-04-26T17:56:58.623539+0000","last_clean":"2024-04-26T17:56:58.623539+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:56:58.623539+0000","last_undegraded":"2024-04-26T17:56:58.623539+0000","last_fullsized":"2024-04-26T17:56:58.623539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620783+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:56:58.620783+0000","last_peered":"2024-04-26T17:56:58.620783+0000","last_clean":"2024-04-26T17:56:58.620783+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:56:58.620783+0000","last_undegraded":"2024-04-26T17:56:58.620783+0000","last_fullsized":"2024-04-26T17:56:58.620783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623468+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:56:58.623468+0000","last_peered":"2024-04-26T17:56:58.623468+0000","last_clean":"2024-04-26T17:56:58.623468+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:56:58.623468+0000","last_undegraded":"2024-04-26T17:56:58.623468+0000","last_fullsized":"2024-04-26T17:56:58.623468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624785+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:56:58.624785+0000","last_peered":"2024-04-26T17:56:58.624785+0000","last_clean":"2024-04-26T17:56:58.624785+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:56:58.624785+0000","last_undegraded":"2024-04-26T17:56:58.624785+0000","last_fullsized":"2024-04-26T17:56:58.624785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627640+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:56:58.627640+0000","last_peered":"2024-04-26T17:56:58.627640+0000","last_clean":"2024-04-26T17:56:58.627640+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:56:58.627640+0000","last_undegraded":"2024-04-26T17:56:58.627640+0000","last_fullsized":"2024-04-26T17:56:58.627640+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627616+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:56:58.627616+0000","last_peered":"2024-04-26T17:56:58.627616+0000","last_clean":"2024-04-26T17:56:58.627616+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:56:58.627616+0000","last_undegraded":"2024-04-26T17:56:58.627616+0000","last_fullsized":"2024-04-26T17:56:58.627616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180988+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:56:59.180988+0000","last_peered":"2024-04-26T17:56:59.180988+0000","last_clean":"2024-04-26T17:56:59.180988+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:56:59.180988+0000","last_undegraded":"2024-04-26T17:56:59.180988+0000","last_fullsized":"2024-04-26T17:56:59.180988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620674+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:56:58.620674+0000","last_peered":"2024-04-26T17:56:58.620674+0000","last_clean":"2024-04-26T17:56:58.620674+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:56:58.620674+0000","last_undegraded":"2024-04-26T17:56:58.620674+0000","last_fullsized":"2024-04-26T17:56:58.620674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625102+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:56:58.625102+0000","last_peered":"2024-04-26T17:56:58.625102+0000","last_clean":"2024-04-26T17:56:58.625102+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:56:58.625102+0000","last_undegraded":"2024-04-26T17:56:58.625102+0000","last_fullsized":"2024-04-26T17:56:58.625102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627969+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:56:58.627969+0000","last_peered":"2024-04-26T17:56:58.627969+0000","last_clean":"2024-04-26T17:56:58.627969+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:56:58.627969+0000","last_undegraded":"2024-04-26T17:56:58.627969+0000","last_fullsized":"2024-04-26T17:56:58.627969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627584+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:56:58.627584+0000","last_peered":"2024-04-26T17:56:58.627584+0000","last_clean":"2024-04-26T17:56:58.627584+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:56:58.627584+0000","last_undegraded":"2024-04-26T17:56:58.627584+0000","last_fullsized":"2024-04-26T17:56:58.627584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621281+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:56:58.621281+0000","last_peered":"2024-04-26T17:56:58.621281+0000","last_clean":"2024-04-26T17:56:58.621281+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:56:58.621281+0000","last_undegraded":"2024-04-26T17:56:58.621281+0000","last_fullsized":"2024-04-26T17:56:58.621281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627405+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:56:58.627405+0000","last_peered":"2024-04-26T17:56:58.627405+0000","last_clean":"2024-04-26T17:56:58.627405+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:56:58.627405+0000","last_undegraded":"2024-04-26T17:56:58.627405+0000","last_fullsized":"2024-04-26T17:56:58.627405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621336+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:56:58.621336+0000","last_peered":"2024-04-26T17:56:58.621336+0000","last_clean":"2024-04-26T17:56:58.621336+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:56:58.621336+0000","last_undegraded":"2024-04-26T17:56:58.621336+0000","last_fullsized":"2024-04-26T17:56:58.621336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620631+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:56:58.620631+0000","last_peered":"2024-04-26T17:56:58.620631+0000","last_clean":"2024-04-26T17:56:58.620631+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:56:58.620631+0000","last_undegraded":"2024-04-26T17:56:58.620631+0000","last_fullsized":"2024-04-26T17:56:58.620631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625302+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:56:58.625302+0000","last_peered":"2024-04-26T17:56:58.625302+0000","last_clean":"2024-04-26T17:56:58.625302+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:56:58.625302+0000","last_undegraded":"2024-04-26T17:56:58.625302+0000","last_fullsized":"2024-04-26T17:56:58.625302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284174,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64618,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":621,"num_read_kb":376,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383720,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":479699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645357,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":1131797,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808882,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":479935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070520,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":479273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332157,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1071785,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":479324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1044480,"data_stored":539734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":480595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":541475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":479635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1071469,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:25.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:58:25.580 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:25 smithi156 ceph-mon[32679]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:25 smithi092 ceph-mon[29156]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:25 smithi189 ceph-mon[32756]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:26 smithi092 ceph-mon[29156]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:26 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:26 smithi156 ceph-mon[32679]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:26 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:26 smithi189 ceph-mon[32756]: pgmap v364: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:26 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- 172.21.15.92:0/575364004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e006baf0 msgr2=0x7f14e006bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 --2- 172.21.15.92:0/575364004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e006baf0 0x7f14e006bf50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009990 tx=0x7f14c8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- 172.21.15.92:0/575364004 shutdown_connections 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 --2- 172.21.15.92:0/575364004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e01094c0 0x7f14e01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 --2- 172.21.15.92:0/575364004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 0x7f14e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 --2- 172.21.15.92:0/575364004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e006baf0 0x7f14e006bf50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- 172.21.15.92:0/575364004 >> 172.21.15.92:0/575364004 conn(0x7f14e00792d0 msgr2=0x7f14e00796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- 172.21.15.92:0/575364004 shutdown_connections 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- 172.21.15.92:0/575364004 wait complete. 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 Processor -- start 2024-04-26T17:58:27.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.341+0000 7f14e6c34700 1 -- start start 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e006baf0 0x7f14e019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 0x7f14e019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14e01136b0 con 0x7f14e01094c0 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f14e0113530 con 0x7f14e006baf0 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14e0113830 con 0x7f14e006c490 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44150/0 (socket says 172.21.15.92:44150) 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 -- 172.21.15.92:0/3132626648 learned_addr learned my addr 172.21.15.92:0/3132626648 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e49d0700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e006baf0 0x7f14e019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14dffff700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 0x7f14e019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 -- 172.21.15.92:0/3132626648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 msgr2=0x7f14e019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 0x7f14e019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 -- 172.21.15.92:0/3132626648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e006baf0 msgr2=0x7f14e019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e006baf0 0x7f14e019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 -- 172.21.15.92:0/3132626648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e019a250 con 0x7f14e01094c0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e51d1700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b550 tx=0x7f14d000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0015020 con 0x7f14e01094c0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14d0011ce0 con 0x7f14e01094c0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0010dd0 con 0x7f14e01094c0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.342+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e019a540 con 0x7f14e01094c0 2024-04-26T17:58:27.345 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.343+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e01a67b0 con 0x7f14e01094c0 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.344+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e0104b70 con 0x7f14e01094c0 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.345+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138697+0+0 (secure 0 0 0) 0x7f14d0018020 con 0x7f14e01094c0 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.345+0000 7f14ddffb700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 0x7f14cc0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.345+0000 7f14e49d0700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 0x7f14cc0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.345+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f14d00cfa50 con 0x7f14e01094c0 2024-04-26T17:58:27.346 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.346+0000 7f14e49d0700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 0x7f14cc0a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14e0108980 tx=0x7f14d800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:27.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.350+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f14d001f020 con 0x7f14e01094c0 2024-04-26T17:58:27.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.546+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14e0063860 con 0x7f14cc0a3cd0 2024-04-26T17:58:27.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.553+0000 7f14ddffb700 1 -- 172.21.15.92:0/3132626648 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258895 (secure 0 0 0) 0x7f14e0063860 con 0x7f14cc0a3cd0 2024-04-26T17:58:27.557 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:27.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 msgr2=0x7f14cc0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 0x7f14cc0a6190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14e0108980 tx=0x7f14d800d040 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 msgr2=0x7f14e0199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b550 tx=0x7f14d000b860 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 shutdown_connections 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f14cc0a3cd0 0x7f14cc0a6190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14e006baf0 0x7f14e019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14e01094c0 0x7f14e0199af0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 --2- 172.21.15.92:0/3132626648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14e006c490 0x7f14e019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 >> 172.21.15.92:0/3132626648 conn(0x7f14e00792d0 msgr2=0x7f14e0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 shutdown_connections 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:27.556+0000 7f14e6c34700 1 -- 172.21.15.92:0/3132626648 wait complete. 2024-04-26T17:58:27.559 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:58:27.926 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:27 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:27.926 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:27 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:27.926 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:27 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:27 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:27 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:27 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:27 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:58:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:27 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:58:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:27 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:58:28.273 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-04-26T17:58:25.654371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655220,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":782,"num_read_kb":510,"num_write":345,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365340,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576484,"statfs":{"total":1151940427776,"available":1151566319616,"internally_reserved":0,"allocated":12288000,"data_stored":7715064,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003297"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625150+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:56:58.625150+0000","last_peered":"2024-04-26T17:56:58.625150+0000","last_clean":"2024-04-26T17:56:58.625150+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:56:58.625150+0000","last_undegraded":"2024-04-26T17:56:58.625150+0000","last_fullsized":"2024-04-26T17:56:58.625150+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180964+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:56:59.180964+0000","last_peered":"2024-04-26T17:56:59.180964+0000","last_clean":"2024-04-26T17:56:59.180964+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:56:59.180964+0000","last_undegraded":"2024-04-26T17:56:59.180964+0000","last_fullsized":"2024-04-26T17:56:59.180964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180784+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:56:59.180784+0000","last_peered":"2024-04-26T17:56:59.180784+0000","last_clean":"2024-04-26T17:56:59.180784+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:56:59.180784+0000","last_undegraded":"2024-04-26T17:56:59.180784+0000","last_fullsized":"2024-04-26T17:56:59.180784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777052+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:56:58.777052+0000","last_peered":"2024-04-26T17:56:58.777052+0000","last_clean":"2024-04-26T17:56:58.777052+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:56:58.777052+0000","last_undegraded":"2024-04-26T17:56:58.777052+0000","last_fullsized":"2024-04-26T17:56:58.777052+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626212+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:56:58.626212+0000","last_peered":"2024-04-26T17:56:58.626212+0000","last_clean":"2024-04-26T17:56:58.626212+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:56:58.626212+0000","last_undegraded":"2024-04-26T17:56:58.626212+0000","last_fullsized":"2024-04-26T17:56:58.626212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624995+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:56:58.624995+0000","last_peered":"2024-04-26T17:56:58.624995+0000","last_clean":"2024-04-26T17:56:58.624995+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:56:58.624995+0000","last_undegraded":"2024-04-26T17:56:58.624995+0000","last_fullsized":"2024-04-26T17:56:58.624995+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.622981+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:56:58.622981+0000","last_peered":"2024-04-26T17:56:58.622981+0000","last_clean":"2024-04-26T17:56:58.622981+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:56:58.622981+0000","last_undegraded":"2024-04-26T17:56:58.622981+0000","last_fullsized":"2024-04-26T17:56:58.622981+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627218+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:56:58.627218+0000","last_peered":"2024-04-26T17:56:58.627218+0000","last_clean":"2024-04-26T17:56:58.627218+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:56:58.627218+0000","last_undegraded":"2024-04-26T17:56:58.627218+0000","last_fullsized":"2024-04-26T17:56:58.627218+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621734+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:56:58.621734+0000","last_peered":"2024-04-26T17:56:58.621734+0000","last_clean":"2024-04-26T17:56:58.621734+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:56:58.621734+0000","last_undegraded":"2024-04-26T17:56:58.621734+0000","last_fullsized":"2024-04-26T17:56:58.621734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625626+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:56:58.625626+0000","last_peered":"2024-04-26T17:56:58.625626+0000","last_clean":"2024-04-26T17:56:58.625626+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:56:58.625626+0000","last_undegraded":"2024-04-26T17:56:58.625626+0000","last_fullsized":"2024-04-26T17:56:58.625626+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623291+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:56:58.623291+0000","last_peered":"2024-04-26T17:56:58.623291+0000","last_clean":"2024-04-26T17:56:58.623291+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:56:58.623291+0000","last_undegraded":"2024-04-26T17:56:58.623291+0000","last_fullsized":"2024-04-26T17:56:58.623291+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.632207+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:56:58.632207+0000","last_peered":"2024-04-26T17:56:58.632207+0000","last_clean":"2024-04-26T17:56:58.632207+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:56:58.632207+0000","last_undegraded":"2024-04-26T17:56:58.632207+0000","last_fullsized":"2024-04-26T17:56:58.632207+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620689+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:56:58.620689+0000","last_peered":"2024-04-26T17:56:58.620689+0000","last_clean":"2024-04-26T17:56:58.620689+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:56:58.620689+0000","last_undegraded":"2024-04-26T17:56:58.620689+0000","last_fullsized":"2024-04-26T17:56:58.620689+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180696+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:56:59.180696+0000","last_peered":"2024-04-26T17:56:59.180696+0000","last_clean":"2024-04-26T17:56:59.180696+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:56:59.180696+0000","last_undegraded":"2024-04-26T17:56:59.180696+0000","last_fullsized":"2024-04-26T17:56:59.180696+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180596+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:56:59.180596+0000","last_peered":"2024-04-26T17:56:59.180596+0000","last_clean":"2024-04-26T17:56:59.180596+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:56:59.180596+0000","last_undegraded":"2024-04-26T17:56:59.180596+0000","last_fullsized":"2024-04-26T17:56:59.180596+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621131+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:56:58.621131+0000","last_peered":"2024-04-26T17:56:58.621131+0000","last_clean":"2024-04-26T17:56:58.621131+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:56:58.621131+0000","last_undegraded":"2024-04-26T17:56:58.621131+0000","last_fullsized":"2024-04-26T17:56:58.621131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625284+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:56:58.625284+0000","last_peered":"2024-04-26T17:56:58.625284+0000","last_clean":"2024-04-26T17:56:58.625284+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:56:58.625284+0000","last_undegraded":"2024-04-26T17:56:58.625284+0000","last_fullsized":"2024-04-26T17:56:58.625284+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624321+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:56:58.624321+0000","last_peered":"2024-04-26T17:56:58.624321+0000","last_clean":"2024-04-26T17:56:58.624321+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:56:58.624321+0000","last_undegraded":"2024-04-26T17:56:58.624321+0000","last_fullsized":"2024-04-26T17:56:58.624321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628050+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:56:58.628050+0000","last_peered":"2024-04-26T17:56:58.628050+0000","last_clean":"2024-04-26T17:56:58.628050+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:56:58.628050+0000","last_undegraded":"2024-04-26T17:56:58.628050+0000","last_fullsized":"2024-04-26T17:56:58.628050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.783732+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:56:58.783732+0000","last_peered":"2024-04-26T17:56:58.783732+0000","last_clean":"2024-04-26T17:56:58.783732+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:56:58.783732+0000","last_undegraded":"2024-04-26T17:56:58.783732+0000","last_fullsized":"2024-04-26T17:56:58.783732+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627764+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:56:58.627764+0000","last_peered":"2024-04-26T17:56:58.627764+0000","last_clean":"2024-04-26T17:56:58.627764+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:56:58.627764+0000","last_undegraded":"2024-04-26T17:56:58.627764+0000","last_fullsized":"2024-04-26T17:56:58.627764+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627967+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:56:58.627967+0000","last_peered":"2024-04-26T17:56:58.627967+0000","last_clean":"2024-04-26T17:56:58.627967+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:56:58.627967+0000","last_undegraded":"2024-04-26T17:56:58.627967+0000","last_fullsized":"2024-04-26T17:56:58.627967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181165+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:56:59.181165+0000","last_peered":"2024-04-26T17:56:59.181165+0000","last_clean":"2024-04-26T17:56:59.181165+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:56:59.181165+0000","last_undegraded":"2024-04-26T17:56:59.181165+0000","last_fullsized":"2024-04-26T17:56:59.181165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627279+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:56:58.627279+0000","last_peered":"2024-04-26T17:56:58.627279+0000","last_clean":"2024-04-26T17:56:58.627279+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627279+0000","last_undegraded":"2024-04-26T17:56:58.627279+0000","last_fullsized":"2024-04-26T17:56:58.627279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621361+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:56:58.621361+0000","last_peered":"2024-04-26T17:56:58.621361+0000","last_clean":"2024-04-26T17:56:58.621361+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:56:58.621361+0000","last_undegraded":"2024-04-26T17:56:58.621361+0000","last_fullsized":"2024-04-26T17:56:58.621361+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627192+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:56:58.627192+0000","last_peered":"2024-04-26T17:56:58.627192+0000","last_clean":"2024-04-26T17:56:58.627192+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:56:58.627192+0000","last_undegraded":"2024-04-26T17:56:58.627192+0000","last_fullsized":"2024-04-26T17:56:58.627192+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621757+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:56:58.621757+0000","last_peered":"2024-04-26T17:56:58.621757+0000","last_clean":"2024-04-26T17:56:58.621757+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:56:58.621757+0000","last_undegraded":"2024-04-26T17:56:58.621757+0000","last_fullsized":"2024-04-26T17:56:58.621757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:21.891913+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:58:21.891913+0000","last_peered":"2024-04-26T17:58:21.891913+0000","last_clean":"2024-04-26T17:58:21.891913+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:58:21.891913+0000","last_undegraded":"2024-04-26T17:58:21.891913+0000","last_fullsized":"2024-04-26T17:58:21.891913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626464+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:56:58.626464+0000","last_peered":"2024-04-26T17:56:58.626464+0000","last_clean":"2024-04-26T17:56:58.626464+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:56:58.626464+0000","last_undegraded":"2024-04-26T17:56:58.626464+0000","last_fullsized":"2024-04-26T17:56:58.626464+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625011+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:56:58.625011+0000","last_peered":"2024-04-26T17:56:58.625011+0000","last_clean":"2024-04-26T17:56:58.625011+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:56:58.625011+0000","last_undegraded":"2024-04-26T17:56:58.625011+0000","last_fullsized":"2024-04-26T17:56:58.625011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621485+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:56:58.621485+0000","last_peered":"2024-04-26T17:56:58.621485+0000","last_clean":"2024-04-26T17:56:58.621485+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:56:58.621485+0000","last_undegraded":"2024-04-26T17:56:58.621485+0000","last_fullsized":"2024-04-26T17:56:58.621485+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620515+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:56:58.620515+0000","last_peered":"2024-04-26T17:56:58.620515+0000","last_clean":"2024-04-26T17:56:58.620515+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:56:58.620515+0000","last_undegraded":"2024-04-26T17:56:58.620515+0000","last_fullsized":"2024-04-26T17:56:58.620515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627115+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:56:58.627115+0000","last_peered":"2024-04-26T17:56:58.627115+0000","last_clean":"2024-04-26T17:56:58.627115+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:56:58.627115+0000","last_undegraded":"2024-04-26T17:56:58.627115+0000","last_fullsized":"2024-04-26T17:56:58.627115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621197+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:56:58.621197+0000","last_peered":"2024-04-26T17:56:58.621197+0000","last_clean":"2024-04-26T17:56:58.621197+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:56:58.621197+0000","last_undegraded":"2024-04-26T17:56:58.621197+0000","last_fullsized":"2024-04-26T17:56:58.621197+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624109+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:56:58.624109+0000","last_peered":"2024-04-26T17:56:58.624109+0000","last_clean":"2024-04-26T17:56:58.624109+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:56:58.624109+0000","last_undegraded":"2024-04-26T17:56:58.624109+0000","last_fullsized":"2024-04-26T17:56:58.624109+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:22.892645+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:58:22.892645+0000","last_peered":"2024-04-26T17:58:22.892645+0000","last_clean":"2024-04-26T17:58:22.892645+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:58:22.892645+0000","last_undegraded":"2024-04-26T17:58:22.892645+0000","last_fullsized":"2024-04-26T17:58:22.892645+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621654+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:56:58.621654+0000","last_peered":"2024-04-26T17:56:58.621654+0000","last_clean":"2024-04-26T17:56:58.621654+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:56:58.621654+0000","last_undegraded":"2024-04-26T17:56:58.621654+0000","last_fullsized":"2024-04-26T17:56:58.621654+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623398+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:56:58.623398+0000","last_peered":"2024-04-26T17:56:58.623398+0000","last_clean":"2024-04-26T17:56:58.623398+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:56:58.623398+0000","last_undegraded":"2024-04-26T17:56:58.623398+0000","last_fullsized":"2024-04-26T17:56:58.623398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181116+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:56:59.181116+0000","last_peered":"2024-04-26T17:56:59.181116+0000","last_clean":"2024-04-26T17:56:59.181116+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:56:59.181116+0000","last_undegraded":"2024-04-26T17:56:59.181116+0000","last_fullsized":"2024-04-26T17:56:59.181116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621803+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:56:58.621803+0000","last_peered":"2024-04-26T17:56:58.621803+0000","last_clean":"2024-04-26T17:56:58.621803+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:56:58.621803+0000","last_undegraded":"2024-04-26T17:56:58.621803+0000","last_fullsized":"2024-04-26T17:56:58.621803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621365+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:56:58.621365+0000","last_peered":"2024-04-26T17:56:58.621365+0000","last_clean":"2024-04-26T17:56:58.621365+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:56:58.621365+0000","last_undegraded":"2024-04-26T17:56:58.621365+0000","last_fullsized":"2024-04-26T17:56:58.621365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'29","reported_seq":271,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:23.893756+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:58:23.893756+0000","last_peered":"2024-04-26T17:58:23.893756+0000","last_clean":"2024-04-26T17:58:23.893756+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:58:23.893756+0000","last_undegraded":"2024-04-26T17:58:23.893756+0000","last_fullsized":"2024-04-26T17:58:23.893756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60617,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":166,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627072+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:56:58.627072+0000","last_peered":"2024-04-26T17:56:58.627072+0000","last_clean":"2024-04-26T17:56:58.627072+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:56:58.627072+0000","last_undegraded":"2024-04-26T17:56:58.627072+0000","last_fullsized":"2024-04-26T17:56:58.627072+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627777+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:56:58.627777+0000","last_peered":"2024-04-26T17:56:58.627777+0000","last_clean":"2024-04-26T17:56:58.627777+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:56:58.627777+0000","last_undegraded":"2024-04-26T17:56:58.627777+0000","last_fullsized":"2024-04-26T17:56:58.627777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620784+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:56:58.620784+0000","last_peered":"2024-04-26T17:56:58.620784+0000","last_clean":"2024-04-26T17:56:58.620784+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:56:58.620784+0000","last_undegraded":"2024-04-26T17:56:58.620784+0000","last_fullsized":"2024-04-26T17:56:58.620784+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621467+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:56:58.621467+0000","last_peered":"2024-04-26T17:56:58.621467+0000","last_clean":"2024-04-26T17:56:58.621467+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:56:58.621467+0000","last_undegraded":"2024-04-26T17:56:58.621467+0000","last_fullsized":"2024-04-26T17:56:58.621467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623152+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:56:58.623152+0000","last_peered":"2024-04-26T17:56:58.623152+0000","last_clean":"2024-04-26T17:56:58.623152+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:56:58.623152+0000","last_undegraded":"2024-04-26T17:56:58.623152+0000","last_fullsized":"2024-04-26T17:56:58.623152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:22.920781+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:58:22.920781+0000","last_peered":"2024-04-26T17:58:22.920781+0000","last_clean":"2024-04-26T17:58:22.920781+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:58:22.920781+0000","last_undegraded":"2024-04-26T17:58:22.920781+0000","last_fullsized":"2024-04-26T17:58:22.920781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627910+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:56:58.627910+0000","last_peered":"2024-04-26T17:56:58.627910+0000","last_clean":"2024-04-26T17:56:58.627910+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:56:58.627910+0000","last_undegraded":"2024-04-26T17:56:58.627910+0000","last_fullsized":"2024-04-26T17:56:58.627910+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626465+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:56:58.626465+0000","last_peered":"2024-04-26T17:56:58.626465+0000","last_clean":"2024-04-26T17:56:58.626465+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:56:58.626465+0000","last_undegraded":"2024-04-26T17:56:58.626465+0000","last_fullsized":"2024-04-26T17:56:58.626465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621381+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:56:58.621381+0000","last_peered":"2024-04-26T17:56:58.621381+0000","last_clean":"2024-04-26T17:56:58.621381+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:56:58.621381+0000","last_undegraded":"2024-04-26T17:56:58.621381+0000","last_fullsized":"2024-04-26T17:56:58.621381+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627296+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:56:58.627296+0000","last_peered":"2024-04-26T17:56:58.627296+0000","last_clean":"2024-04-26T17:56:58.627296+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:56:58.627296+0000","last_undegraded":"2024-04-26T17:56:58.627296+0000","last_fullsized":"2024-04-26T17:56:58.627296+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625142+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:56:58.625142+0000","last_peered":"2024-04-26T17:56:58.625142+0000","last_clean":"2024-04-26T17:56:58.625142+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:56:58.625142+0000","last_undegraded":"2024-04-26T17:56:58.625142+0000","last_fullsized":"2024-04-26T17:56:58.625142+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.182495+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:56:59.182495+0000","last_peered":"2024-04-26T17:56:59.182495+0000","last_clean":"2024-04-26T17:56:59.182495+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:56:59.182495+0000","last_undegraded":"2024-04-26T17:56:59.182495+0000","last_fullsized":"2024-04-26T17:56:59.182495+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625251+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:56:58.625251+0000","last_peered":"2024-04-26T17:56:58.625251+0000","last_clean":"2024-04-26T17:56:58.625251+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:56:58.625251+0000","last_undegraded":"2024-04-26T17:56:58.625251+0000","last_fullsized":"2024-04-26T17:56:58.625251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623205+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:56:58.623205+0000","last_peered":"2024-04-26T17:56:58.623205+0000","last_clean":"2024-04-26T17:56:58.623205+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:56:58.623205+0000","last_undegraded":"2024-04-26T17:56:58.623205+0000","last_fullsized":"2024-04-26T17:56:58.623205+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.181994+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:56:59.181994+0000","last_peered":"2024-04-26T17:56:59.181994+0000","last_clean":"2024-04-26T17:56:59.181994+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:56:59.181994+0000","last_undegraded":"2024-04-26T17:56:59.181994+0000","last_fullsized":"2024-04-26T17:56:59.181994+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621636+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:56:58.621636+0000","last_peered":"2024-04-26T17:56:58.621636+0000","last_clean":"2024-04-26T17:56:58.621636+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:56:58.621636+0000","last_undegraded":"2024-04-26T17:56:58.621636+0000","last_fullsized":"2024-04-26T17:56:58.621636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:58:23.921400+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:58:23.921400+0000","last_peered":"2024-04-26T17:58:23.921400+0000","last_clean":"2024-04-26T17:58:23.921400+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:58:23.921400+0000","last_undegraded":"2024-04-26T17:58:23.921400+0000","last_fullsized":"2024-04-26T17:58:23.921400+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627275+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:56:58.627275+0000","last_peered":"2024-04-26T17:56:58.627275+0000","last_clean":"2024-04-26T17:56:58.627275+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:56:58.627275+0000","last_undegraded":"2024-04-26T17:56:58.627275+0000","last_fullsized":"2024-04-26T17:56:58.627275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.776808+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:56:58.776808+0000","last_peered":"2024-04-26T17:56:58.776808+0000","last_clean":"2024-04-26T17:56:58.776808+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:56:58.776808+0000","last_undegraded":"2024-04-26T17:56:58.776808+0000","last_fullsized":"2024-04-26T17:56:58.776808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":357,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623774+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:56:58.623774+0000","last_peered":"2024-04-26T17:56:58.623774+0000","last_clean":"2024-04-26T17:56:58.623774+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:56:58.623774+0000","last_undegraded":"2024-04-26T17:56:58.623774+0000","last_fullsized":"2024-04-26T17:56:58.623774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620459+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:56:58.620459+0000","last_peered":"2024-04-26T17:56:58.620459+0000","last_clean":"2024-04-26T17:56:58.620459+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:56:58.620459+0000","last_undegraded":"2024-04-26T17:56:58.620459+0000","last_fullsized":"2024-04-26T17:56:58.620459+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623850+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:56:58.623850+0000","last_peered":"2024-04-26T17:56:58.623850+0000","last_clean":"2024-04-26T17:56:58.623850+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:56:58.623850+0000","last_undegraded":"2024-04-26T17:56:58.623850+0000","last_fullsized":"2024-04-26T17:56:58.623850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627100+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:56:58.627100+0000","last_peered":"2024-04-26T17:56:58.627100+0000","last_clean":"2024-04-26T17:56:58.627100+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:56:58.627100+0000","last_undegraded":"2024-04-26T17:56:58.627100+0000","last_fullsized":"2024-04-26T17:56:58.627100+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620743+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:56:58.620743+0000","last_peered":"2024-04-26T17:56:58.620743+0000","last_clean":"2024-04-26T17:56:58.620743+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:56:58.620743+0000","last_undegraded":"2024-04-26T17:56:58.620743+0000","last_fullsized":"2024-04-26T17:56:58.620743+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'10","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:57:03.506362+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:57:03.506362+0000","last_peered":"2024-04-26T17:57:03.506362+0000","last_clean":"2024-04-26T17:57:03.506362+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:57:03.506362+0000","last_undegraded":"2024-04-26T17:57:03.506362+0000","last_fullsized":"2024-04-26T17:57:03.506362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627670+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:56:58.627670+0000","last_peered":"2024-04-26T17:56:58.627670+0000","last_clean":"2024-04-26T17:56:58.627670+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:56:58.627670+0000","last_undegraded":"2024-04-26T17:56:58.627670+0000","last_fullsized":"2024-04-26T17:56:58.627670+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.777023+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:56:58.777023+0000","last_peered":"2024-04-26T17:56:58.777023+0000","last_clean":"2024-04-26T17:56:58.777023+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:56:58.777023+0000","last_undegraded":"2024-04-26T17:56:58.777023+0000","last_fullsized":"2024-04-26T17:56:58.777023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180997+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:56:59.180997+0000","last_peered":"2024-04-26T17:56:59.180997+0000","last_clean":"2024-04-26T17:56:59.180997+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:56:59.180997+0000","last_undegraded":"2024-04-26T17:56:59.180997+0000","last_fullsized":"2024-04-26T17:56:59.180997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621148+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:56:58.621148+0000","last_peered":"2024-04-26T17:56:58.621148+0000","last_clean":"2024-04-26T17:56:58.621148+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:56:58.621148+0000","last_undegraded":"2024-04-26T17:56:58.621148+0000","last_fullsized":"2024-04-26T17:56:58.621148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626391+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:56:58.626391+0000","last_peered":"2024-04-26T17:56:58.626391+0000","last_clean":"2024-04-26T17:56:58.626391+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:56:58.626391+0000","last_undegraded":"2024-04-26T17:56:58.626391+0000","last_fullsized":"2024-04-26T17:56:58.626391+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627494+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:56:58.627494+0000","last_peered":"2024-04-26T17:56:58.627494+0000","last_clean":"2024-04-26T17:56:58.627494+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:56:58.627494+0000","last_undegraded":"2024-04-26T17:56:58.627494+0000","last_fullsized":"2024-04-26T17:56:58.627494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624717+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:56:58.624717+0000","last_peered":"2024-04-26T17:56:58.624717+0000","last_clean":"2024-04-26T17:56:58.624717+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:56:58.624717+0000","last_undegraded":"2024-04-26T17:56:58.624717+0000","last_fullsized":"2024-04-26T17:56:58.624717+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.633216+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:56:58.633216+0000","last_peered":"2024-04-26T17:56:58.633216+0000","last_clean":"2024-04-26T17:56:58.633216+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:56:58.633216+0000","last_undegraded":"2024-04-26T17:56:58.633216+0000","last_fullsized":"2024-04-26T17:56:58.633216+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627277+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:56:58.627277+0000","last_peered":"2024-04-26T17:56:58.627277+0000","last_clean":"2024-04-26T17:56:58.627277+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:56:58.627277+0000","last_undegraded":"2024-04-26T17:56:58.627277+0000","last_fullsized":"2024-04-26T17:56:58.627277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.626611+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:56:58.626611+0000","last_peered":"2024-04-26T17:56:58.626611+0000","last_clean":"2024-04-26T17:56:58.626611+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:56:58.626611+0000","last_undegraded":"2024-04-26T17:56:58.626611+0000","last_fullsized":"2024-04-26T17:56:58.626611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623503+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:56:58.623503+0000","last_peered":"2024-04-26T17:56:58.623503+0000","last_clean":"2024-04-26T17:56:58.623503+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:56:58.623503+0000","last_undegraded":"2024-04-26T17:56:58.623503+0000","last_fullsized":"2024-04-26T17:56:58.623503+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.628211+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:56:58.628211+0000","last_peered":"2024-04-26T17:56:58.628211+0000","last_clean":"2024-04-26T17:56:58.628211+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:56:58.628211+0000","last_undegraded":"2024-04-26T17:56:58.628211+0000","last_fullsized":"2024-04-26T17:56:58.628211+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623431+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:56:58.623431+0000","last_peered":"2024-04-26T17:56:58.623431+0000","last_clean":"2024-04-26T17:56:58.623431+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:56:58.623431+0000","last_undegraded":"2024-04-26T17:56:58.623431+0000","last_fullsized":"2024-04-26T17:56:58.623431+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"88'1","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621658+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:56:58.621658+0000","last_peered":"2024-04-26T17:56:58.621658+0000","last_clean":"2024-04-26T17:56:58.621658+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:56:58.621658+0000","last_undegraded":"2024-04-26T17:56:58.621658+0000","last_fullsized":"2024-04-26T17:56:58.621658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"89'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623539+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:56:58.623539+0000","last_peered":"2024-04-26T17:56:58.623539+0000","last_clean":"2024-04-26T17:56:58.623539+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:56:58.623539+0000","last_undegraded":"2024-04-26T17:56:58.623539+0000","last_fullsized":"2024-04-26T17:56:58.623539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620783+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:56:58.620783+0000","last_peered":"2024-04-26T17:56:58.620783+0000","last_clean":"2024-04-26T17:56:58.620783+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:56:58.620783+0000","last_undegraded":"2024-04-26T17:56:58.620783+0000","last_fullsized":"2024-04-26T17:56:58.620783+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.623468+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:56:58.623468+0000","last_peered":"2024-04-26T17:56:58.623468+0000","last_clean":"2024-04-26T17:56:58.623468+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:56:58.623468+0000","last_undegraded":"2024-04-26T17:56:58.623468+0000","last_fullsized":"2024-04-26T17:56:58.623468+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.624785+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:56:58.624785+0000","last_peered":"2024-04-26T17:56:58.624785+0000","last_clean":"2024-04-26T17:56:58.624785+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:56:58.624785+0000","last_undegraded":"2024-04-26T17:56:58.624785+0000","last_fullsized":"2024-04-26T17:56:58.624785+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627640+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:56:58.627640+0000","last_peered":"2024-04-26T17:56:58.627640+0000","last_clean":"2024-04-26T17:56:58.627640+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:56:58.627640+0000","last_undegraded":"2024-04-26T17:56:58.627640+0000","last_fullsized":"2024-04-26T17:56:58.627640+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627616+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:56:58.627616+0000","last_peered":"2024-04-26T17:56:58.627616+0000","last_clean":"2024-04-26T17:56:58.627616+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:56:58.627616+0000","last_undegraded":"2024-04-26T17:56:58.627616+0000","last_fullsized":"2024-04-26T17:56:58.627616+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:59.180988+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:56:59.180988+0000","last_peered":"2024-04-26T17:56:59.180988+0000","last_clean":"2024-04-26T17:56:59.180988+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:56:59.180988+0000","last_undegraded":"2024-04-26T17:56:59.180988+0000","last_fullsized":"2024-04-26T17:56:59.180988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620674+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:56:58.620674+0000","last_peered":"2024-04-26T17:56:58.620674+0000","last_clean":"2024-04-26T17:56:58.620674+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:56:58.620674+0000","last_undegraded":"2024-04-26T17:56:58.620674+0000","last_fullsized":"2024-04-26T17:56:58.620674+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625102+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:56:58.625102+0000","last_peered":"2024-04-26T17:56:58.625102+0000","last_clean":"2024-04-26T17:56:58.625102+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:56:58.625102+0000","last_undegraded":"2024-04-26T17:56:58.625102+0000","last_fullsized":"2024-04-26T17:56:58.625102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627969+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:56:58.627969+0000","last_peered":"2024-04-26T17:56:58.627969+0000","last_clean":"2024-04-26T17:56:58.627969+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:56:58.627969+0000","last_undegraded":"2024-04-26T17:56:58.627969+0000","last_fullsized":"2024-04-26T17:56:58.627969+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627584+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:56:58.627584+0000","last_peered":"2024-04-26T17:56:58.627584+0000","last_clean":"2024-04-26T17:56:58.627584+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:56:58.627584+0000","last_undegraded":"2024-04-26T17:56:58.627584+0000","last_fullsized":"2024-04-26T17:56:58.627584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621281+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:56:58.621281+0000","last_peered":"2024-04-26T17:56:58.621281+0000","last_clean":"2024-04-26T17:56:58.621281+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:56:58.621281+0000","last_undegraded":"2024-04-26T17:56:58.621281+0000","last_fullsized":"2024-04-26T17:56:58.621281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.627405+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:56:58.627405+0000","last_peered":"2024-04-26T17:56:58.627405+0000","last_clean":"2024-04-26T17:56:58.627405+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:56:58.627405+0000","last_undegraded":"2024-04-26T17:56:58.627405+0000","last_fullsized":"2024-04-26T17:56:58.627405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.621336+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:56:58.621336+0000","last_peered":"2024-04-26T17:56:58.621336+0000","last_clean":"2024-04-26T17:56:58.621336+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:56:58.621336+0000","last_undegraded":"2024-04-26T17:56:58.621336+0000","last_fullsized":"2024-04-26T17:56:58.621336+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.620631+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:56:58.620631+0000","last_peered":"2024-04-26T17:56:58.620631+0000","last_clean":"2024-04-26T17:56:58.620631+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:56:58.620631+0000","last_undegraded":"2024-04-26T17:56:58.620631+0000","last_fullsized":"2024-04-26T17:56:58.620631+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T17:56:58.625302+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:56:58.625302+0000","last_peered":"2024-04-26T17:56:58.625302+0000","last_clean":"2024-04-26T17:56:58.625302+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:56:58.625302+0000","last_undegraded":"2024-04-26T17:56:58.625302+0000","last_fullsized":"2024-04-26T17:56:58.625302+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284174,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64618,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":646,"num_read_kb":391,"num_write":162,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":193854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383720,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":479699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":1131797,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":995328,"data_stored":479935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070520,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":479273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332158,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1044480,"data_stored":1071785,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":983040,"data_stored":479324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1044480,"data_stored":539734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":480595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":541475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":479635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":480343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1071469,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34498,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":60617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:28.277 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T17:58:28.277 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T17:58:28.277 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-26T17:58:28.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-26T17:58:28.529 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:28.914 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:28 smithi092 ceph-mon[29156]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:28.914 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:28 smithi092 ceph-mon[29156]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:28 smithi189 ceph-mon[32756]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:28 smithi189 ceph-mon[32756]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:28 smithi156 ceph-mon[32679]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:58:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:28 smithi156 ceph-mon[32679]: pgmap v365: 97 pgs: 97 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:29 smithi092 ceph-mon[29156]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T17:58:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:29 smithi189 ceph-mon[32756]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T17:58:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:29 smithi156 ceph-mon[32679]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- 172.21.15.92:0/2353509717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 msgr2=0x7f985010f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 --2- 172.21.15.92:0/2353509717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f985010f1e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f984800b0a0 tx=0x7f984800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- 172.21.15.92:0/2353509717 shutdown_connections 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 --2- 172.21.15.92:0/2353509717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f985010f1e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 --2- 172.21.15.92:0/2353509717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 0x7f9850108780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 --2- 172.21.15.92:0/2353509717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f98501027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- 172.21.15.92:0/2353509717 >> 172.21.15.92:0/2353509717 conn(0x7f9850079250 msgr2=0x7f9850079660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- 172.21.15.92:0/2353509717 shutdown_connections 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- 172.21.15.92:0/2353509717 wait complete. 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 Processor -- start 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.258+0000 7f98575d7700 1 -- start start 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f9850198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f9850198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 0x7f985019d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9850112590 con 0x7f9850102d00 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9850112410 con 0x7f9850102360 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f98575d7700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9850112710 con 0x7f98501083a0 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9855373700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f9850198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f9850198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9855373700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f9850198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:57622/0 (socket says 172.21.15.92:57622) 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9855373700 1 -- 172.21.15.92:0/3058987299 learned_addr learned my addr 172.21.15.92:0/3058987299 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:30.260 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9855b74700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 0x7f985019d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 -- 172.21.15.92:0/3058987299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 msgr2=0x7f985019d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 0x7f985019d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 -- 172.21.15.92:0/3058987299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 msgr2=0x7f9850198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f9850198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 -- 172.21.15.92:0/3058987299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985019ddd0 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.259+0000 7f9854b72700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f9850198d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f984000b450 tx=0x7f984000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.260+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840015020 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.260+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9840011ce0 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.260+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985019e0c0 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.260+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840010be0 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.260+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985019e650 con 0x7f9850102d00 2024-04-26T17:58:30.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.261+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9850103a50 con 0x7f9850102d00 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.263+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f9840018020 con 0x7f9850102d00 2024-04-26T17:58:30.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.263+0000 7f98467fc700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 0x7f983c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.263+0000 7f9855373700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 0x7f983c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.263+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f98400cf910 con 0x7f9850102d00 2024-04-26T17:58:30.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.264+0000 7f9855373700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 0x7f983c0a6180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f984c009ad0 tx=0x7f984c009290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:30.268 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.268+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f984001f020 con 0x7f9850102d00 2024-04-26T17:58:30.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.523+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f985019e960 con 0x7f9850102d00 2024-04-26T17:58:30.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.524+0000 7f98467fc700 1 -- 172.21.15.92:0/3058987299 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f984009c390 con 0x7f9850102d00 2024-04-26T17:58:30.524 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:30.524 INFO:teuthology.orchestra.run.smithi092.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 msgr2=0x7f983c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 0x7f983c0a6180 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f984c009ad0 tx=0x7f984c009290 comp rx=0 tx=0).stop 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 msgr2=0x7f9850198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f9850198d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f984000b450 tx=0x7f984000b760 comp rx=0 tx=0).stop 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 shutdown_connections 2024-04-26T17:58:30.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f983c0a3cc0 0x7f983c0a6180 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9850102360 0x7f9850198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98501083a0 0x7f985019d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 --2- 172.21.15.92:0/3058987299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9850102d00 0x7f9850198d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 >> 172.21.15.92:0/3058987299 conn(0x7f9850079250 msgr2=0x7f9850101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 shutdown_connections 2024-04-26T17:58:30.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:30.526+0000 7f98575d7700 1 -- 172.21.15.92:0/3058987299 wait complete. 2024-04-26T17:58:30.912 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:30 smithi092 ceph-mon[29156]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:30.913 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:30 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3058987299' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T17:58:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:30 smithi189 ceph-mon[32756]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:30 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3058987299' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T17:58:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:30 smithi156 ceph-mon[32679]: pgmap v366: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:30 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3058987299' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-26T17:58:31.242 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-26T17:58:31.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:58:31.481 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:32.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:32 smithi092 ceph-mon[29156]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:32 smithi189 ceph-mon[32756]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:32 smithi156 ceph-mon[32679]: pgmap v367: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:33.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 -- 172.21.15.92:0/4097247502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c81094d0 msgr2=0x7f52c81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/4097247502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c81094d0 0x7f52c81098b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0099c0 tx=0x7f52bc009cd0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 -- 172.21.15.92:0/4097247502 shutdown_connections 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/4097247502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c8102330 0x7f52c81102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/4097247502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c81094d0 0x7f52c81098b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/4097247502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 0x7f52c8101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 -- 172.21.15.92:0/4097247502 >> 172.21.15.92:0/4097247502 conn(0x7f52c8078920 msgr2=0x7f52c80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 -- 172.21.15.92:0/4097247502 shutdown_connections 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.203+0000 7f52cdc3a700 1 -- 172.21.15.92:0/4097247502 wait complete. 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 Processor -- start 2024-04-26T17:58:33.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 -- start start 2024-04-26T17:58:33.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 0x7f52c819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c81094d0 0x7f52c8199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52c8113610 con 0x7f52c8102330 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f52c8113490 con 0x7f52c81094d0 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.204+0000 7f52cdc3a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f52c8113790 con 0x7f52c8101970 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:44174/0 (socket says 172.21.15.92:44174) 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 -- 172.21.15.92:0/77630622 learned_addr learned my addr 172.21.15.92:0/77630622 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c77fe700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 0x7f52c819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c7fff700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c81094d0 0x7f52c8199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 -- 172.21.15.92:0/77630622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 msgr2=0x7f52c819f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 0x7f52c819f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 -- 172.21.15.92:0/77630622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c81094d0 msgr2=0x7f52c8199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c81094d0 0x7f52c8199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 -- 172.21.15.92:0/77630622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c819a0f0 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c6ffd700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c970 tx=0x7f52b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b80078d0 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c819a3e0 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52b8018480 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b800f6b0 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.205+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c81a6650 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.206+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c806a110 con 0x7f52c8102330 2024-04-26T17:58:33.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.207+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f52b8018930 con 0x7f52c8102330 2024-04-26T17:58:33.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.208+0000 7f52c4ff9700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 0x7f52b00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:33.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.208+0000 7f52c77fe700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 0x7f52b00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:33.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.208+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f52b80d0440 con 0x7f52c8102330 2024-04-26T17:58:33.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.208+0000 7f52c77fe700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 0x7f52b00a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c81085b0 tx=0x7f52bc005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:33.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.212+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f52b809cf50 con 0x7f52c8102330 2024-04-26T17:58:33.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.458+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52c802e490 con 0x7f52c8102330 2024-04-26T17:58:33.458 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.458+0000 7f52c4ff9700 1 -- 172.21.15.92:0/77630622 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7f52b809c850 con 0x7f52c8102330 2024-04-26T17:58:33.459 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:33.459 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 msgr2=0x7f52b00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 0x7f52b00a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f52c81085b0 tx=0x7f52bc005c40 comp rx=0 tx=0).stop 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 msgr2=0x7f52c819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c970 tx=0x7f52b800cc80 comp rx=0 tx=0).stop 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 shutdown_connections 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f52b00a3c40 0x7f52b00a6100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52c81094d0 0x7f52c8199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f52c8101970 0x7f52c819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 --2- 172.21.15.92:0/77630622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8102330 0x7f52c819fcc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.460+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 >> 172.21.15.92:0/77630622 conn(0x7f52c8078920 msgr2=0x7f52c81000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.461+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 shutdown_connections 2024-04-26T17:58:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:33.461+0000 7f52cdc3a700 1 -- 172.21.15.92:0/77630622 wait complete. 2024-04-26T17:58:33.462 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:58:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:33 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/77630622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:33 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/77630622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:33 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/77630622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:34.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:58:34.503 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:34 smithi092 ceph-mon[29156]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:34 smithi189 ceph-mon[32756]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:34 smithi156 ceph-mon[32679]: pgmap v368: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 -- 172.21.15.92:0/3881904072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f0103e30 msgr2=0x7f43f0110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 --2- 172.21.15.92:0/3881904072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f0103e30 0x7f43f0110290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f43e800b0a0 tx=0x7f43e800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 -- 172.21.15.92:0/3881904072 shutdown_connections 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 --2- 172.21.15.92:0/3881904072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f01094c0 0x7f43f01098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 --2- 172.21.15.92:0/3881904072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f0103e30 0x7f43f0110290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.187 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 --2- 172.21.15.92:0/3881904072 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103470 0x7f43f01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 -- 172.21.15.92:0/3881904072 >> 172.21.15.92:0/3881904072 conn(0x7f43f007a580 msgr2=0x7f43f007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 -- 172.21.15.92:0/3881904072 shutdown_connections 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 -- 172.21.15.92:0/3881904072 wait complete. 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.178+0000 7f43f5f01700 1 Processor -- start 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 -- start start 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 0x7f43f019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103e30 0x7f43f019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43f0113640 con 0x7f43f01094c0 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f43f01134c0 con 0x7f43f0103470 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43f5f01700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43f01137c0 con 0x7f43f0103e30 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51328/0 (socket says 172.21.15.92:51328) 2024-04-26T17:58:36.188 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 -- 172.21.15.92:0/2214807647 learned_addr learned my addr 172.21.15.92:0/2214807647 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43eeffd700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103e30 0x7f43f019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43ef7fe700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 0x7f43f019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 -- 172.21.15.92:0/2214807647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103e30 msgr2=0x7f43f019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103e30 0x7f43f019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 -- 172.21.15.92:0/2214807647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 msgr2=0x7f43f019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 0x7f43f019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 -- 172.21.15.92:0/2214807647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f0199fe0 con 0x7f43f01094c0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43ef7fe700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 0x7f43f019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43effff700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43e80062a0 tx=0x7f43e8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.179+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8021070 con 0x7f43f01094c0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.180+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43e8007c80 con 0x7f43f01094c0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.180+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f019a270 con 0x7f43f01094c0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.180+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e801d450 con 0x7f43f01094c0 2024-04-26T17:58:36.189 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.180+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f01a6590 con 0x7f43f01094c0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.180+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f006a110 con 0x7f43f01094c0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.181+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f43e8004020 con 0x7f43f01094c0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.182+0000 7f43ecff9700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 0x7f43d80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.182+0000 7f43ef7fe700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 0x7f43d80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.182+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f43e800f020 con 0x7f43f01094c0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.183+0000 7f43ef7fe700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 0x7f43d80a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43f019a9c0 tx=0x7f43e4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.190 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.187+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f43e802a020 con 0x7f43f01094c0 2024-04-26T17:58:36.430 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.430+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43f002e490 con 0x7f43f01094c0 2024-04-26T17:58:36.431 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.431+0000 7f43ecff9700 1 -- 172.21.15.92:0/2214807647 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7f43e809e520 con 0x7f43f01094c0 2024-04-26T17:58:36.431 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:36.431 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:58:36.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 msgr2=0x7f43d80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 0x7f43d80a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43f019a9c0 tx=0x7f43e4008040 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 msgr2=0x7f43f0199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f43e80062a0 tx=0x7f43e8004e20 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 shutdown_connections 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f43d80a3c40 0x7f43d80a6100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43f0103470 0x7f43f019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43f01094c0 0x7f43f0199880 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 --2- 172.21.15.92:0/2214807647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43f0103e30 0x7f43f019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 >> 172.21.15.92:0/2214807647 conn(0x7f43f007a580 msgr2=0x7f43f01020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 shutdown_connections 2024-04-26T17:58:36.434 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:36.433+0000 7f43f5f01700 1 -- 172.21.15.92:0/2214807647 wait complete. 2024-04-26T17:58:36.435 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:58:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:36 smithi092 ceph-mon[29156]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:36 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2214807647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:37.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:58:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:36 smithi189 ceph-mon[32756]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:36 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2214807647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:36 smithi156 ceph-mon[32679]: pgmap v369: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:36 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2214807647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:37.361 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:38.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:38 smithi092 ceph-mon[29156]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T17:58:38.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:38 smithi156 ceph-mon[32679]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 -- 172.21.15.92:0/4152087205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc103470 msgr2=0x7f98bc1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 --2- 172.21.15.92:0/4152087205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc103470 0x7f98bc1038f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009990 tx=0x7f98a8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 -- 172.21.15.92:0/4152087205 shutdown_connections 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 --2- 172.21.15.92:0/4152087205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc1094c0 0x7f98bc1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 --2- 172.21.15.92:0/4152087205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 0x7f98bc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 --2- 172.21.15.92:0/4152087205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc103470 0x7f98bc1038f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 -- 172.21.15.92:0/4152087205 >> 172.21.15.92:0/4152087205 conn(0x7f98bc07a580 msgr2=0x7f98bc07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.116+0000 7f98c2eae700 1 -- 172.21.15.92:0/4152087205 shutdown_connections 2024-04-26T17:58:39.116 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 -- 172.21.15.92:0/4152087205 wait complete. 2024-04-26T17:58:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 Processor -- start 2024-04-26T17:58:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 -- start start 2024-04-26T17:58:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc103470 0x7f98bc19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 0x7f98bc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.118 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc113640 con 0x7f98bc1094c0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1134c0 con 0x7f98bc103470 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c2eae700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98bc1137c0 con 0x7f98bc103e30 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c144b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c144b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51344/0 (socket says 172.21.15.92:51344) 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.117+0000 7f98c144b700 1 -- 172.21.15.92:0/485792641 learned_addr learned my addr 172.21.15.92:0/485792641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c0c4a700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc103470 0x7f98bc19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98bbfff700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 0x7f98bc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 -- 172.21.15.92:0/485792641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 msgr2=0x7f98bc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 0x7f98bc19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 -- 172.21.15.92:0/485792641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc103470 msgr2=0x7f98bc19f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc103470 0x7f98bc19f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 -- 172.21.15.92:0/485792641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98bc19a0e0 con 0x7f98bc1094c0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c144b700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b970 tx=0x7f98b400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.119 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4019070 con 0x7f98bc1094c0 2024-04-26T17:58:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98bc19a3d0 con 0x7f98bc1094c0 2024-04-26T17:58:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98b400cde0 con 0x7f98bc1094c0 2024-04-26T17:58:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b4007370 con 0x7f98bc1094c0 2024-04-26T17:58:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.118+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98bc1a6690 con 0x7f98bc1094c0 2024-04-26T17:58:39.120 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.119+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98bc06a110 con 0x7f98bc1094c0 2024-04-26T17:58:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.120+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f98b401c070 con 0x7f98bc1094c0 2024-04-26T17:58:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.121+0000 7f98b9ffb700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 0x7f98ac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.121+0000 7f98c0c4a700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 0x7f98ac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.121+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f98b40cf830 con 0x7f98bc1094c0 2024-04-26T17:58:39.121 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.121+0000 7f98c0c4a700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 0x7f98ac0a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98bc19aac0 tx=0x7f98b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.125+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f98b409c2b0 con 0x7f98bc1094c0 2024-04-26T17:58:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:38 smithi189 ceph-mon[32756]: pgmap v370: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T17:58:39.329 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.329+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98bc02e490 con 0x7f98bc1094c0 2024-04-26T17:58:39.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.331+0000 7f98b9ffb700 1 -- 172.21.15.92:0/485792641 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22478 (secure 0 0 0) 0x7f98b409bbb0 con 0x7f98bc1094c0 2024-04-26T17:58:39.330 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:39.331 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":90,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:58.617254+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:39.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 msgr2=0x7f98ac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 0x7f98ac0a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98bc19aac0 tx=0x7f98b000b410 comp rx=0 tx=0).stop 2024-04-26T17:58:39.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 msgr2=0x7f98bc199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b970 tx=0x7f98b400bc80 comp rx=0 tx=0).stop 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 shutdown_connections 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f98ac0a3c40 0x7f98ac0a6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98bc103470 0x7f98bc19f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98bc1094c0 0x7f98bc199980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 --2- 172.21.15.92:0/485792641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98bc103e30 0x7f98bc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 >> 172.21.15.92:0/485792641 conn(0x7f98bc07a580 msgr2=0x7f98bc1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 shutdown_connections 2024-04-26T17:58:39.333 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:39.333+0000 7f98c2eae700 1 -- 172.21.15.92:0/485792641 wait complete. 2024-04-26T17:58:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:39 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/485792641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:58:40.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:58:40.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:39 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/485792641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:58:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:39 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/485792641' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:58:40.244 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:40 smithi092 ceph-mon[29156]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:40 smithi189 ceph-mon[32756]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:40 smithi156 ceph-mon[32679]: pgmap v371: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-04-26T17:58:41.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 -- 172.21.15.92:0/3327953954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c81094f0 msgr2=0x7f87c81098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/3327953954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c81094f0 0x7f87c81098d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009990 tx=0x7f87b8009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 -- 172.21.15.92:0/3327953954 shutdown_connections 2024-04-26T17:58:41.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/3327953954 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103e30 0x7f87c81102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/3327953954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c81094f0 0x7f87c81098d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/3327953954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87c8103470 0x7f87c81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 -- 172.21.15.92:0/3327953954 >> 172.21.15.92:0/3327953954 conn(0x7f87c807a5d0 msgr2=0x7f87c807a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 -- 172.21.15.92:0/3327953954 shutdown_connections 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.891+0000 7f87cdcc6700 1 -- 172.21.15.92:0/3327953954 wait complete. 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 Processor -- start 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 -- start start 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103470 0x7f87c8075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87c81094f0 0x7f87c80761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87c8113620 con 0x7f87c8103e30 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81134a0 con 0x7f87c81094f0 2024-04-26T17:58:41.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87cdcc6700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f87c81137a0 con 0x7f87c8103470 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:51364/0 (socket says 172.21.15.92:51364) 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87bffff700 1 -- 172.21.15.92:0/753221835 learned_addr learned my addr 172.21.15.92:0/753221835 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87c77fe700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103470 0x7f87c8075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87bffff700 1 -- 172.21.15.92:0/753221835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103470 msgr2=0x7f87c8075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.892+0000 7f87bffff700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103470 0x7f87c8075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87bffff700 1 -- 172.21.15.92:0/753221835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87c81094f0 msgr2=0x7f87c80761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87bffff700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87c81094f0 0x7f87c80761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87bffff700 1 -- 172.21.15.92:0/753221835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c81a8010 con 0x7f87c8103e30 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87bffff700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c9b0 tx=0x7f87b000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0007b00 con 0x7f87c8103e30 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c81a8300 con 0x7f87c8103e30 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87b0007ca0 con 0x7f87c8103e30 2024-04-26T17:58:41.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0018660 con 0x7f87c8103e30 2024-04-26T17:58:41.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.893+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c81a8890 con 0x7f87c8103e30 2024-04-26T17:58:41.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.894+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c810b960 con 0x7f87c8103e30 2024-04-26T17:58:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.895+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f87b000f450 con 0x7f87c8103e30 2024-04-26T17:58:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.895+0000 7f87c57fa700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 0x7f87b40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.896+0000 7f87c77fe700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 0x7f87b40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.896+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f87b00d0370 con 0x7f87c8103e30 2024-04-26T17:58:41.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.896+0000 7f87c77fe700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 0x7f87b40a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87b800b5c0 tx=0x7f87b8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:41.900+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f87b0014030 con 0x7f87c8103e30 2024-04-26T17:58:42.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.146+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87c806a110 con 0x7f87c8103e30 2024-04-26T17:58:42.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.147+0000 7f87c57fa700 1 -- 172.21.15.92:0/753221835 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7f87b009cdf0 con 0x7f87c8103e30 2024-04-26T17:58:42.147 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:58:42.147 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 msgr2=0x7f87b40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 0x7f87b40a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87b800b5c0 tx=0x7f87b8005960 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 msgr2=0x7f87c8075c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c9b0 tx=0x7f87b000ccc0 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 shutdown_connections 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.149+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f87b40a3c40 0x7f87b40a6100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f87c81094f0 0x7f87c80761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f87c8103470 0x7f87c8075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 --2- 172.21.15.92:0/753221835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87c8103e30 0x7f87c8075c60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 >> 172.21.15.92:0/753221835 conn(0x7f87c807a5d0 msgr2=0x7f87c81020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:42.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 shutdown_connections 2024-04-26T17:58:42.150 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:42.150+0000 7f87cdcc6700 1 -- 172.21.15.92:0/753221835 wait complete. 2024-04-26T17:58:42.150 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:58:42.821 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:42 smithi092 ceph-mon[29156]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:42.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:42 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/753221835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:42.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T17:56:22.551088+0000', 'modified': '2024-04-26T17:56:44.780595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24437, 'mds_1': 24419, 'mds_2': 24406}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3880754337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3880754337}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3880754337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/1535152997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 1535152997}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 1535152997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6835/1296842780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 1296842780}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 1296842780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24406': {'gid': 24406, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.189:6839/915245244', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 915245244}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 915245244}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.156:6837/1965706259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 1965706259}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 1965706259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.156:6839/2836729853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 2836729853}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 2836729853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24437, 'qdb_cluster': [24419, 24437, 24406]} 2024-04-26T17:58:42.852 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T17:58:42.852 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T17:58:43.097 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:42 smithi189 ceph-mon[32756]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:42 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/753221835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:42 smithi156 ceph-mon[32679]: pgmap v372: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:42 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/753221835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:58:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- 172.21.15.92:0/933162522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4102ce0 msgr2=0x7f8be410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/933162522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4102ce0 0x7f8be410f1d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00b0a0 tx=0x7f8bdc00b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- 172.21.15.92:0/933162522 shutdown_connections 2024-04-26T17:58:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/933162522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4108390 0x7f8be4108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.799 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/933162522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4102ce0 0x7f8be410f1d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/933162522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102320 0x7f8be41027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- 172.21.15.92:0/933162522 >> 172.21.15.92:0/933162522 conn(0x7f8be40792d0 msgr2=0x7f8be40796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- 172.21.15.92:0/933162522 shutdown_connections 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- 172.21.15.92:0/933162522 wait complete. 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 Processor -- start 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.798+0000 7f8be9dcb700 1 -- start start 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4102320 0x7f8be419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102ce0 0x7f8be419aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4112530 con 0x7f8be4108390 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41123b0 con 0x7f8be4102320 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be9dcb700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8be41126b0 con 0x7f8be4102ce0 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41948/0 (socket says 172.21.15.92:41948) 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 -- 172.21.15.92:0/1207976414 learned_addr learned my addr 172.21.15.92:0/1207976414 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102ce0 0x7f8be419aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4102320 0x7f8be419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 -- 172.21.15.92:0/1207976414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102ce0 msgr2=0x7f8be419aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102ce0 0x7f8be419aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 -- 172.21.15.92:0/1207976414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4102320 msgr2=0x7f8be419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4102320 0x7f8be419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 -- 172.21.15.92:0/1207976414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be41a5f30 con 0x7f8be4108390 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.799+0000 7f8be3fff700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009fd0 tx=0x7f8bdc004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.800+0000 7f8be17fa700 1 -- 172.21.15.92:0/1207976414 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc021070 con 0x7f8be4108390 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.800+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be41a6160 con 0x7f8be4108390 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.800+0000 7f8be17fa700 1 -- 172.21.15.92:0/1207976414 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc007b80 con 0x7f8be4108390 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.800+0000 7f8be17fa700 1 -- 172.21.15.92:0/1207976414 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0052a0 con 0x7f8be4108390 2024-04-26T17:58:44.801 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.800+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be41a6610 con 0x7f8be4108390 2024-04-26T17:58:44.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.802+0000 7f8be17fa700 1 -- 172.21.15.92:0/1207976414 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8bdc024070 con 0x7f8be4108390 2024-04-26T17:58:44.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.802+0000 7f8be17fa700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 0x7f8bd00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.803+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 0x7f8bd00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.803+0000 7f8be17fa700 1 -- 172.21.15.92:0/1207976414 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f8bdc00f020 con 0x7f8be4108390 2024-04-26T17:58:44.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.803+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 0x7f8bd00a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005950 tx=0x7f8bd400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 Processor -- start 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 -- start start 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 0x55f544f49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f49be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f544e977e0 con 0x55f544f4ecc0 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f544dfd8e0 con 0x55f544f4f5e0 2024-04-26T17:58:44.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bf465db80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f544e937a0 con 0x55f544f49780 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41958/0 (socket says 172.21.15.92:41958) 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 -- 172.21.15.92:0/1300410050 learned_addr learned my addr 172.21.15.92:0/1300410050 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be3fff700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f49be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 0x55f544f49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 -- 172.21.15.92:0/1300410050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 msgr2=0x55f544f49be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f49be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 -- 172.21.15.92:0/1300410050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 msgr2=0x55f544f49160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 0x55f544f49160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 -- 172.21.15.92:0/1300410050 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f544de4880 con 0x55f544f4ecc0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 0x55f544f49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.804+0000 7f8be37fe700 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4010e60 tx=0x7f8bd4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2af93361f3f00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bd9ffb700 1 -- 172.21.15.92:0/1300410050 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4011db0 con 0x55f544f4ecc0 2024-04-26T17:58:44.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bd9ffb700 1 -- 172.21.15.92:0/1300410050 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd4010e90 con 0x55f544f4ecc0 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bd9ffb700 1 -- 172.21.15.92:0/1300410050 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd401c6d0 con 0x55f544f4ecc0 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 -- 172.21.15.92:0/1300410050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 msgr2=0x55f544f4f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4010e60 tx=0x7f8bd4013000 comp rx=0 tx=0).stop 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 -- 172.21.15.92:0/1300410050 shutdown_connections 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f49be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f4f0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 --2- 172.21.15.92:0/1300410050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4f5e0 0x55f544f49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 -- 172.21.15.92:0/1300410050 >> 172.21.15.92:0/1300410050 conn(0x55f544e73570 msgr2=0x55f544f3f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 -- 172.21.15.92:0/1300410050 shutdown_connections 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.805+0000 7f8bf465db80 1 -- 172.21.15.92:0/1300410050 wait complete. 2024-04-26T17:58:44.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 -- start start 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 Processor -- start 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f55330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f544f560c0 con 0x55f544f4ecc0 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f544e51a30 con 0x55f544f49780 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f544f56240 con 0x55f544f4f5e0 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bf465db80 10 client.0 _ll_register_callbacks cb 0x55f544e2f900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41972/0 (socket says 172.21.15.92:41972) 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.806+0000 7f8bdaffd700 1 -- 172.21.15.92:0/129501748 learned_addr learned my addr 172.21.15.92:0/129501748 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8be3fff700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8be37fe700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f55330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 -- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 msgr2=0x55f544f52c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 -- 172.21.15.92:0/129501748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 msgr2=0x55f544f55330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f55330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 -- 172.21.15.92:0/129501748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f544e55430 con 0x55f544f4ecc0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8be3fff700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00ba00 tx=0x7f8bcc00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a66941a7fa4fbd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc01b440 con 0x55f544f4ecc0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f8bcc01b5e0 con 0x55f544f4ecc0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bd4010e90 con 0x55f544f4ecc0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bcc01b7e0 con 0x55f544f4ecc0 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bf465db80 10 client.14931 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:44.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f544f609b0 con 0x55f544f4ecc0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.807+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bd4010e90 con 0x55f544f4ecc0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f8bcc019020 con 0x55f544f4ecc0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 10 client.14931 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 10 client.14931 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 20 client.14931 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544f62fe0 0x55f544f64450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 4 client.14931 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f544ea51c0 con 0x55f544f62fe0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8be37fe700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544f62fe0 0x55f544f64450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8be37fe700 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544f62fe0 0x55f544f64450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9345d71c4f462659 server_cookie=8aa3009afc6fd78e in_seq=0 out_seq=0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.808+0000 7f8bc2ffd700 10 client.14931 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.809+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/129501748 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f544ea51c0 con 0x55f544f62fe0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.809+0000 7f8bc2ffd700 10 client.14931 handle_command_reply: tid=0 2024-04-26T17:58:44.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.809+0000 7f8bf465db80 1 client.14931 shutdown 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 msgr2=0x55f544f526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00ba00 tx=0x7f8bcc00bdc0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 shutdown_connections 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544f62fe0 0x55f544f64450 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f55330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 --2- 172.21.15.92:0/129501748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f526d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 >> 172.21.15.92:0/129501748 conn(0x55f544e73570 msgr2=0x55f544f43d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bc2ffd700 0 client.14931 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 shutdown_connections 2024-04-26T17:58:44.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 1 -- 172.21.15.92:0/129501748 wait complete. 2024-04-26T17:58:44.815 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:44 smithi092 ceph-mon[29156]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:44.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.810+0000 7f8bf465db80 20 client.14931 trim_cache size 0 max 16384 2024-04-26T17:58:44.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 Processor -- start 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 -- start start 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f62910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4ecc0 0x55f544f3f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.836+0000 7f8bf465db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f544f62790 con 0x55f544f4f5e0 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bf465db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f544f62e60 con 0x55f544f4ecc0 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bf465db80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f544f63530 con 0x55f544f49780 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41986/0 (socket says 172.21.15.92:41986) 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 -- 172.21.15.92:0/2624036256 learned_addr learned my addr 172.21.15.92:0/2624036256 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be37fe700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f62910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4ecc0 0x55f544f3f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 -- 172.21.15.92:0/2624036256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 msgr2=0x55f544f62910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f62910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 -- 172.21.15.92:0/2624036256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4ecc0 msgr2=0x55f544f3f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4ecc0 0x55f544f3f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 -- 172.21.15.92:0/2624036256 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f544f536d0 con 0x55f544f4f5e0 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be37fe700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f62910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8be3fff700 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc09d8c0 tx=0x7f8bdc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfdd6f1305e2723 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bd97fa700 1 -- 172.21.15.92:0/2624036256 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a6510 con 0x55f544f4f5e0 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bd97fa700 1 -- 172.21.15.92:0/2624036256 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc09bc30 con 0x55f544f4f5e0 2024-04-26T17:58:44.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.837+0000 7f8bd97fa700 1 -- 172.21.15.92:0/2624036256 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a4240 con 0x55f544f4f5e0 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- 172.21.15.92:0/2624036256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 msgr2=0x55f544f6d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc09d8c0 tx=0x7f8bdc009b80 comp rx=0 tx=0).stop 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- 172.21.15.92:0/2624036256 shutdown_connections 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4f5e0 0x55f544f6d8b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f49780 0x55f544f62910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 --2- 172.21.15.92:0/2624036256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f4ecc0 0x55f544f3f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- 172.21.15.92:0/2624036256 >> 172.21.15.92:0/2624036256 conn(0x55f544e73570 msgr2=0x55f544f49b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- 172.21.15.92:0/2624036256 shutdown_connections 2024-04-26T17:58:44.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- 172.21.15.92:0/2624036256 wait complete. 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.838+0000 7f8bf465db80 1 -- start start 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 Processor -- start 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f51e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f544f642d0 con 0x55f544f4ecc0 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f544f63c00 con 0x55f544f49780 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f544f649a0 con 0x55f544f4f5e0 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bf465db80 10 client.0 _ll_register_callbacks cb 0x55f544e2f900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41998/0 (socket says 172.21.15.92:41998) 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 -- 172.21.15.92:0/3005430692 learned_addr learned my addr 172.21.15.92:0/3005430692 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8be3fff700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8be37fe700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f51e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 -- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 msgr2=0x55f544f52900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 -- 172.21.15.92:0/3005430692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 msgr2=0x55f544f51e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f51e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 -- 172.21.15.92:0/3005430692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f544f6bc40 con 0x55f544f4ecc0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bdaffd700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000c00 tx=0x7f8bcc00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913e6dd8ee442c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.839+0000 7f8bc2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc02b040 con 0x55f544f4ecc0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f8bcc011640 con 0x55f544f4ecc0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bdc09bc30 con 0x55f544f4ecc0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8bcc011860 con 0x55f544f4ecc0 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 10 client.14937 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:44.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f544fca4e0 con 0x55f544f4ecc0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc09bc30 con 0x55f544f4ecc0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f8bcc019070 con 0x55f544f4ecc0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 10 client.14937 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 10 client.14937 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 20 client.14937 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544fcf0d0 0x55f544fcdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 4 client.14937 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.840+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "status"}) -- 0x55f544e9f260 con 0x55f544fcf0d0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8be37fe700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544fcf0d0 0x55f544fcdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bc2ffd700 10 client.14937 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8be37fe700 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544fcf0d0 0x55f544fcdde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2c07b072a9bf029 server_cookie=d2a4b50cac4523ab in_seq=0 out_seq=0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bc2ffd700 1 -- 172.21.15.92:0/3005430692 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f544e9f260 con 0x55f544fcf0d0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bc2ffd700 10 client.14937 handle_command_reply: tid=0 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 client.14937 shutdown 2024-04-26T17:58:44.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 msgr2=0x55f544f523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000c00 tx=0x7f8bcc00b650 comp rx=0 tx=0).stop 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 shutdown_connections 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x55f544fcf0d0 0x55f544fcdde0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f544f49780 0x55f544f51e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f544f4f5e0 0x55f544f52900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 --2- 172.21.15.92:0/3005430692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f544f4ecc0 0x55f544f523c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 >> 172.21.15.92:0/3005430692 conn(0x55f544e73570 msgr2=0x55f544f3f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.841+0000 7f8bc2ffd700 0 client.14937 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 shutdown_connections 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8bf465db80 1 -- 172.21.15.92:0/3005430692 wait complete. 2024-04-26T17:58:44.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8bf465db80 20 client.14937 trim_cache size 0 max 16384 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24406, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 126.120831501, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 167.41307736300001 2024-04-26T17:58:44.847 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:58:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 msgr2=0x7f8bd00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 0x7f8bd00a6100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005950 tx=0x7f8bd400b410 comp rx=0 tx=0).stop 2024-04-26T17:58:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 msgr2=0x7f8be41a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009fd0 tx=0x7f8bdc004dc0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 shutdown_connections 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8bd00a3c40 0x7f8bd00a6100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8be4102320 0x7f8be419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8be4108390 0x7f8be41a59f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 --2- 172.21.15.92:0/1207976414 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8be4102ce0 0x7f8be419aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 >> 172.21.15.92:0/1207976414 conn(0x7f8be40792d0 msgr2=0x7f8be4100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 shutdown_connections 2024-04-26T17:58:44.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:44.842+0000 7f8be9dcb700 1 -- 172.21.15.92:0/1207976414 wait complete. 2024-04-26T17:58:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:44 smithi189 ceph-mon[32756]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:44 smithi156 ceph-mon[32679]: pgmap v373: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:45.570 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T17:58:45.812 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:46.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:46 smithi092 ceph-mon[29156]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:46 smithi189 ceph-mon[32756]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:46 smithi156 ceph-mon[32679]: pgmap v374: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 -- 172.21.15.92:0/1578319161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c103e30 msgr2=0x7f585c110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1578319161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c103e30 0x7f585c110290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f585400b0a0 tx=0x7f585400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 -- 172.21.15.92:0/1578319161 shutdown_connections 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1578319161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c103e30 0x7f585c110290 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1578319161 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c1094c0 0x7f585c1098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1578319161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 -- 172.21.15.92:0/1578319161 >> 172.21.15.92:0/1578319161 conn(0x7f585c07a580 msgr2=0x7f585c07a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.487 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 -- 172.21.15.92:0/1578319161 shutdown_connections 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.485+0000 7f5863c4a700 1 -- 172.21.15.92:0/1578319161 wait complete. 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 Processor -- start 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 -- start start 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c103e30 0x7f585c075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f585c1136c0 con 0x7f585c1094c0 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113540 con 0x7f585c103470 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f5863c4a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f585c113840 con 0x7f585c103e30 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f58621e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f58621e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42016/0 (socket says 172.21.15.92:42016) 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f58621e7700 1 -- 172.21.15.92:0/1375178930 learned_addr learned my addr 172.21.15.92:0/1375178930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.486+0000 7f58611e5700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c103e30 0x7f585c075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58619e6700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 -- 172.21.15.92:0/1375178930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c103e30 msgr2=0x7f585c075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c103e30 0x7f585c075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 -- 172.21.15.92:0/1375178930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 msgr2=0x7f585c075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 -- 172.21.15.92:0/1375178930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585c1a8180 con 0x7f585c1094c0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58619e6700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f58621e7700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f58540062a0 tx=0x7f5854004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f5852ffd700 1 -- 172.21.15.92:0/1375178930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854021070 con 0x7f585c1094c0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f5852ffd700 1 -- 172.21.15.92:0/1375178930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5854007c80 con 0x7f585c1094c0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585c1a8410 con 0x7f585c1094c0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f5852ffd700 1 -- 172.21.15.92:0/1375178930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585401d450 con 0x7f585c1094c0 2024-04-26T17:58:47.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.487+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585c1a8950 con 0x7f585c1094c0 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.489+0000 7f5852ffd700 1 -- 172.21.15.92:0/1375178930 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f5854004020 con 0x7f585c1094c0 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.490+0000 7f5852ffd700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 0x7f58480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.490+0000 7f58619e6700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 0x7f58480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.490+0000 7f5852ffd700 1 -- 172.21.15.92:0/1375178930 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f585400f020 con 0x7f585c1094c0 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.490+0000 7f58619e6700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 0x7f58480a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5858007900 tx=0x7f5858008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 Processor -- start 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 -- start start 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0cad0 0x564ee8d0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.495 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d07710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ee8c596f0 con 0x564ee8d0d3f0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x564ee8bf8590 con 0x564ee8d0cad0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee8c556b0 con 0x564ee8d072d0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42024/0 (socket says 172.21.15.92:42024) 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 -- 172.21.15.92:0/1432631527 learned_addr learned my addr 172.21.15.92:0/1432631527 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58621e7700 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d07710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58619e6700 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0cad0 0x564ee8d0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 -- 172.21.15.92:0/1432631527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 msgr2=0x564ee8d07710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d07710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 -- 172.21.15.92:0/1432631527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0cad0 msgr2=0x564ee8d0ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0cad0 0x564ee8d0ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.491+0000 7f58611e5700 1 -- 172.21.15.92:0/1432631527 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee8ba6880 con 0x564ee8d0d3f0 2024-04-26T17:58:47.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f58611e5700 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f584c009a80 tx=0x7f584c009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248bc44315d5ad27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f5847fff700 1 -- 172.21.15.92:0/1432631527 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017070 con 0x564ee8d0d3f0 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f5847fff700 1 -- 172.21.15.92:0/1432631527 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c00ed80 con 0x564ee8d0d3f0 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f5847fff700 1 -- 172.21.15.92:0/1432631527 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c013e30 con 0x564ee8d0d3f0 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1432631527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 msgr2=0x564ee8d06cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.492+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f584c009a80 tx=0x7f584c009d90 comp rx=0 tx=0).stop 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1432631527 shutdown_connections 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0cad0 0x564ee8d0ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d07710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1432631527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d06cb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1432631527 >> 172.21.15.92:0/1432631527 conn(0x564ee8c33cf0 msgr2=0x564ee8d021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1432631527 shutdown_connections 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1432631527 wait complete. 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 -- start start 2024-04-26T17:58:47.497 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.493+0000 7f586e4dcb80 1 Processor -- start 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d130f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d10930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d13f10 con 0x564ee8d0cad0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x564ee8bbf900 con 0x564ee8d0d3f0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d14090 con 0x564ee8d072d0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 10 client.0 _ll_register_callbacks cb 0x564ee8bed530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42038/0 (socket says 172.21.15.92:42038) 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 -- 172.21.15.92:0/1600196468 learned_addr learned my addr 172.21.15.92:0/1600196468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58621e7700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d10930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58619e6700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 -- 172.21.15.92:0/1600196468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 msgr2=0x564ee8d130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 -- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 msgr2=0x564ee8d10930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d10930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 -- 172.21.15.92:0/1600196468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee8d10f70 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58611e5700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f584c013d40 tx=0x7f584c013d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ebc50c07ffd565 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58457fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017040 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f584c013880 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.494+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584c00ed80 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f584c01c450 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 10 client.14949 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ee8d1e940 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c00ed80 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f584c023070 con 0x564ee8d0cad0 2024-04-26T17:58:47.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 10 client.14949 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 10 client.14949 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 20 client.14949 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d20b70 0x564ee8d21fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 4 client.14949 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ee8c670d0 con 0x564ee8d20b70 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.495+0000 7f58619e6700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d20b70 0x564ee8d21fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.496+0000 7f58457fa700 10 client.14949 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T17:58:47.500 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.496+0000 7f58619e6700 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d20b70 0x564ee8d21fe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e21f8196fc6f74bb server_cookie=fe778840b94b41f in_seq=0 out_seq=0 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f58457fa700 1 -- 172.21.15.92:0/1600196468 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564ee8c670d0 con 0x564ee8d20b70 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f58457fa700 10 client.14949 handle_command_reply: tid=0 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 client.14949 shutdown 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 msgr2=0x564ee8d103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f584c013d40 tx=0x7f584c013d70 comp rx=0 tx=0).stop 2024-04-26T17:58:47.501 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 shutdown_connections 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d10930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d20b70 0x564ee8d21fe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/1600196468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d103f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f58457fa700 0 client.14949 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 >> 172.21.15.92:0/1600196468 conn(0x564ee8c33cf0 msgr2=0x564ee8d01da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 shutdown_connections 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 1 -- 172.21.15.92:0/1600196468 wait complete. 2024-04-26T17:58:47.502 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.497+0000 7f586e4dcb80 20 client.14949 trim_cache size 0 max 16384 2024-04-26T17:58:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 Processor -- start 2024-04-26T17:58:47.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 -- start start 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d06cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d12d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d20320 con 0x564ee8d0cad0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d209f0 con 0x564ee8d0d3f0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.517+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d210c0 con 0x564ee8d072d0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42050/0 (socket says 172.21.15.92:42050) 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 -- 172.21.15.92:0/3198154901 learned_addr learned my addr 172.21.15.92:0/3198154901 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58619e6700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d06cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58621e7700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d12d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 -- 172.21.15.92:0/3198154901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 msgr2=0x564ee8d06cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d06cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 -- 172.21.15.92:0/3198154901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 msgr2=0x564ee8d12d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d12d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 -- 172.21.15.92:0/3198154901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee8d204a0 con 0x564ee8d0cad0 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58619e6700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d06cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58611e5700 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f584c00e530 tx=0x7f584c009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9053a462854e4b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58477fe700 1 -- 172.21.15.92:0/3198154901 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017070 con 0x564ee8d0cad0 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58477fe700 1 -- 172.21.15.92:0/3198154901 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c006df0 con 0x564ee8d0cad0 2024-04-26T17:58:47.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.518+0000 7f58477fe700 1 -- 172.21.15.92:0/3198154901 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c01c850 con 0x564ee8d0cad0 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- 172.21.15.92:0/3198154901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 msgr2=0x564ee8d01330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f584c00e530 tx=0x7f584c009d90 comp rx=0 tx=0).stop 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- 172.21.15.92:0/3198154901 shutdown_connections 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d0d3f0 0x564ee8d12d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d072d0 0x564ee8d06cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/3198154901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0cad0 0x564ee8d01330 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- 172.21.15.92:0/3198154901 >> 172.21.15.92:0/3198154901 conn(0x564ee8c33cf0 msgr2=0x564ee8cfdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- 172.21.15.92:0/3198154901 shutdown_connections 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- 172.21.15.92:0/3198154901 wait complete. 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 -- start start 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.519+0000 7f586e4dcb80 1 Processor -- start 2024-04-26T17:58:47.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 0x564ee8d1c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d0cad0 0x564ee8d1c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d21e60 con 0x564ee8d0d3f0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d21790 con 0x564ee8d072d0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee8d22530 con 0x564ee8d0cad0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f586e4dcb80 10 client.0 _ll_register_callbacks cb 0x564ee8bed530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42054/0 (socket says 172.21.15.92:42054) 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 -- 172.21.15.92:0/2288465446 learned_addr learned my addr 172.21.15.92:0/2288465446 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58611e5700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d0cad0 0x564ee8d1c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58619e6700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 0x564ee8d1c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 -- 172.21.15.92:0/2288465446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d0cad0 msgr2=0x564ee8d1c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d0cad0 0x564ee8d1c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 -- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 msgr2=0x564ee8d1c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 0x564ee8d1c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 -- 172.21.15.92:0/2288465446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee8d29520 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58619e6700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 0x564ee8d1c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58621e7700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f585409db80 tx=0x7f585400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f30dd096561833 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.520+0000 7f58457fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58540b7060 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f58540b7200 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584c006df0 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f58540a6a60 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 10 client.14955 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ee8d87e80 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c006df0 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f5854011070 con 0x564ee8d0d3f0 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 10 client.14955 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:47.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 10 client.14955 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 20 client.14955 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d8cac0 0x564ee8d8b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 4 client.14955 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.521+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "status"}) -- 0x564ee8c61170 con 0x564ee8d8cac0 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f58619e6700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d8cac0 0x564ee8d8b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f58619e6700 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d8cac0 0x564ee8d8b7d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19859f43411fefd8 server_cookie=e2ea1b15638b4df6 in_seq=0 out_seq=0 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f58457fa700 10 client.14955 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f58457fa700 1 -- 172.21.15.92:0/2288465446 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564ee8c61170 con 0x564ee8d8cac0 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f58457fa700 10 client.14955 handle_command_reply: tid=0 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f586e4dcb80 1 client.14955 shutdown 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 msgr2=0x564ee8d1ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.522+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f585409db80 tx=0x7f585400b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 shutdown_connections 2024-04-26T17:58:47.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564ee8d072d0 0x564ee8d1c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x564ee8d8cac0 0x564ee8d8b7d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564ee8d0d3f0 0x564ee8d1ce00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 --2- 172.21.15.92:0/2288465446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8d0cad0 0x564ee8d1c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f58457fa700 0 client.14955 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 >> 172.21.15.92:0/2288465446 conn(0x564ee8c33cf0 msgr2=0x564ee8d01330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 shutdown_connections 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 1 -- 172.21.15.92:0/2288465446 wait complete. 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f586e4dcb80 20 client.14955 trim_cache size 0 max 16384 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:58:47.527 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24419, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 129.811136592, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 172.914118836 2024-04-26T17:58:47.528 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 msgr2=0x7f58480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 0x7f58480a6100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5858007900 tx=0x7f5858008040 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 msgr2=0x7f585c0761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.523+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f58540062a0 tx=0x7f5854004e20 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 shutdown_connections 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f58480a3c40 0x7f58480a6100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f585c103470 0x7f585c075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f585c1094c0 0x7f585c0761a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 --2- 172.21.15.92:0/1375178930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f585c103e30 0x7f585c075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 >> 172.21.15.92:0/1375178930 conn(0x7f585c07a580 msgr2=0x7f585c1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 shutdown_connections 2024-04-26T17:58:47.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:47.524+0000 7f5863c4a700 1 -- 172.21.15.92:0/1375178930 wait complete. 2024-04-26T17:58:48.245 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T17:58:48.483 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:48.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:48 smithi092 ceph-mon[29156]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:48 smithi189 ceph-mon[32756]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:49.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:48 smithi156 ceph-mon[32679]: pgmap v375: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 -- 172.21.15.92:0/3291794024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c108390 msgr2=0x7fcc2c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/3291794024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c108390 0x7fcc2c108770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009990 tx=0x7fcc14009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 -- 172.21.15.92:0/3291794024 shutdown_connections 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/3291794024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c10f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/3291794024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c108390 0x7fcc2c108770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/3291794024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c102320 0x7fcc2c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.164 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 -- 172.21.15.92:0/3291794024 >> 172.21.15.92:0/3291794024 conn(0x7fcc2c0792d0 msgr2=0x7fcc2c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.163+0000 7fcc31ed3700 1 -- 172.21.15.92:0/3291794024 shutdown_connections 2024-04-26T17:58:50.165 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.164+0000 7fcc31ed3700 1 -- 172.21.15.92:0/3291794024 wait complete. 2024-04-26T17:58:50.166 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.164+0000 7fcc31ed3700 1 Processor -- start 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.164+0000 7fcc31ed3700 1 -- start start 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102320 0x7fcc2c104000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c108390 0x7fcc2c104a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c112600 con 0x7fcc2c102ce0 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c112480 con 0x7fcc2c108390 2024-04-26T17:58:50.167 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc31ed3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c112780 con 0x7fcc2c102320 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2b7fe700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102320 0x7fcc2c104000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42068/0 (socket says 172.21.15.92:42068) 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 -- 172.21.15.92:0/805489084 learned_addr learned my addr 172.21.15.92:0/805489084 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c108390 0x7fcc2c104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 -- 172.21.15.92:0/805489084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102320 msgr2=0x7fcc2c104000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102320 0x7fcc2c104000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 -- 172.21.15.92:0/805489084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c108390 msgr2=0x7fcc2c104a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c108390 0x7fcc2c104a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 -- 172.21.15.92:0/805489084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c1a8190 con 0x7fcc2c102ce0 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc2affd700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00b530 tx=0x7fcc1c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.165+0000 7fcc28ff9700 1 -- 172.21.15.92:0/805489084 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c015020 con 0x7fcc2c102ce0 2024-04-26T17:58:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.166+0000 7fcc28ff9700 1 -- 172.21.15.92:0/805489084 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc1c011ce0 con 0x7fcc2c102ce0 2024-04-26T17:58:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.166+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c1a8480 con 0x7fcc2c102ce0 2024-04-26T17:58:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.166+0000 7fcc28ff9700 1 -- 172.21.15.92:0/805489084 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c010dd0 con 0x7fcc2c102ce0 2024-04-26T17:58:50.169 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.166+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c1a89c0 con 0x7fcc2c102ce0 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.168+0000 7fcc28ff9700 1 -- 172.21.15.92:0/805489084 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcc1c018020 con 0x7fcc2c102ce0 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.168+0000 7fcc28ff9700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 0x7fcc180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.168+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 0x7fcc180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.169+0000 7fcc28ff9700 1 -- 172.21.15.92:0/805489084 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fcc1c0cfa20 con 0x7fcc2c102ce0 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.169+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 0x7fcc180a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009750 tx=0x7fcc14005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 Processor -- start 2024-04-26T17:58:50.171 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 -- start start 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939ead0 0x55b8e939eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e9398cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8e92eb6f0 con 0x55b8e93992d0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b8e928a590 con 0x55b8e939ead0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8e92e76b0 con 0x55b8e939f3f0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42082/0 (socket says 172.21.15.92:42082) 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 -- 172.21.15.92:0/793899254 learned_addr learned my addr 172.21.15.92:0/793899254 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939ead0 0x55b8e939eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2affd700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e9398cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 -- 172.21.15.92:0/793899254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 msgr2=0x55b8e9398cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e9398cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.172 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 -- 172.21.15.92:0/793899254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939ead0 msgr2=0x55b8e939eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939ead0 0x55b8e939eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2bfff700 1 -- 172.21.15.92:0/793899254 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8e9238880 con 0x55b8e93992d0 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.170+0000 7fcc2affd700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e9398cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400a430 tx=0x7fcc24009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9090bbcc59f24e72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc21ffb700 1 -- 172.21.15.92:0/793899254 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24014620 con 0x55b8e93992d0 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc21ffb700 1 -- 172.21.15.92:0/793899254 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc24019070 con 0x55b8e93992d0 2024-04-26T17:58:50.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc21ffb700 1 -- 172.21.15.92:0/793899254 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24013a50 con 0x55b8e93992d0 2024-04-26T17:58:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc3c765b80 1 -- 172.21.15.92:0/793899254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 msgr2=0x55b8e9399710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400a430 tx=0x7fcc24009650 comp rx=0 tx=0).stop 2024-04-26T17:58:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.171+0000 7fcc3c765b80 1 -- 172.21.15.92:0/793899254 shutdown_connections 2024-04-26T17:58:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939ead0 0x55b8e939eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93992d0 0x55b8e9399710 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/793899254 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e9398cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- 172.21.15.92:0/793899254 >> 172.21.15.92:0/793899254 conn(0x55b8e92c5cf0 msgr2=0x55b8e93941b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- 172.21.15.92:0/793899254 shutdown_connections 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- 172.21.15.92:0/793899254 wait complete. 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- start start 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 Processor -- start 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e93a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93a5f10 con 0x55b8e939ead0 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b8e9251900 con 0x55b8e939f3f0 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.172+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93a6090 con 0x55b8e93992d0 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc3c765b80 10 client.0 _ll_register_callbacks cb 0x55b8e927f530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:50.178 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42096/0 (socket says 172.21.15.92:42096) 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 -- 172.21.15.92:0/113845199 learned_addr learned my addr 172.21.15.92:0/113845199 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e93a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 -- 172.21.15.92:0/113845199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 msgr2=0x55b8e93a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e93a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 -- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 msgr2=0x55b8e93a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 -- 172.21.15.92:0/113845199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8e93a3070 con 0x55b8e939ead0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc2affd700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c098770 tx=0x7fcc1c09c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b494560c1d4b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc0affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c09f030 con 0x55b8e939ead0 2024-04-26T17:58:50.179 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fcc1c0b5260 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc24019070 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcc1c0a0150 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc3c765b80 10 client.14967 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8e93b09d0 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.173+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc24019070 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fcc1c09b1f0 con 0x55b8e939ead0 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 10 client.14967 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 10 client.14967 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 20 client.14967 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e93b2f40 0x55b8e93b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 4 client.14967 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:50.180 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8e92f90d0 con 0x55b8e93b2f40 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.174+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e93b2f40 0x55b8e93b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e93b2f40 0x55b8e93b43b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de57f36846fe4a44 server_cookie=af43ca61da2b674c in_seq=0 out_seq=0 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc0affd700 10 client.14967 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc0affd700 1 -- 172.21.15.92:0/113845199 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b8e92f90d0 con 0x55b8e93b2f40 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc0affd700 10 client.14967 handle_command_reply: tid=0 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc3c765b80 1 client.14967 shutdown 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 msgr2=0x55b8e93a2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.175+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c098770 tx=0x7fcc1c09c4a0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 shutdown_connections 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e93b2f40 0x55b8e93b43b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e93a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.181 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/113845199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a2480 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 >> 172.21.15.92:0/113845199 conn(0x55b8e92c5cf0 msgr2=0x55b8e9393390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc0affd700 0 client.14967 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:58:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 shutdown_connections 2024-04-26T17:58:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 1 -- 172.21.15.92:0/113845199 wait complete. 2024-04-26T17:58:50.182 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.176+0000 7fcc3c765b80 20 client.14967 trim_cache size 0 max 16384 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 Processor -- start 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 -- start start 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e9398cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b26f0 con 0x55b8e939ead0 2024-04-26T17:58:50.198 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b2dc0 con 0x55b8e939f3f0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b3490 con 0x55b8e93992d0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2affd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42104/0 (socket says 172.21.15.92:42104) 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2affd700 1 -- 172.21.15.92:0/3205604814 learned_addr learned my addr 172.21.15.92:0/3205604814 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e9398cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2affd700 1 -- 172.21.15.92:0/3205604814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 msgr2=0x55b8e9398cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.196+0000 7fcc2affd700 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e9398cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc2affd700 1 -- 172.21.15.92:0/3205604814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 msgr2=0x55b8e93a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc2affd700 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc2affd700 1 -- 172.21.15.92:0/3205604814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8e93b2500 con 0x55b8e939ead0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc2affd700 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00bb90 tx=0x7fcc1c0bc0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f0cad32d67a688 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc217fa700 1 -- 172.21.15.92:0/3205604814 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c09f070 con 0x55b8e939ead0 2024-04-26T17:58:50.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc217fa700 1 -- 172.21.15.92:0/3205604814 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc1c009300 con 0x55b8e939ead0 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc217fa700 1 -- 172.21.15.92:0/3205604814 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c0a47e0 con 0x55b8e939ead0 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 -- 172.21.15.92:0/3205604814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 msgr2=0x55b8e93a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00bb90 tx=0x7fcc1c0bc0d0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 -- 172.21.15.92:0/3205604814 shutdown_connections 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e939f3f0 0x55b8e93a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e93992d0 0x55b8e9398cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/3205604814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e939ead0 0x55b8e93a0d70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 -- 172.21.15.92:0/3205604814 >> 172.21.15.92:0/3205604814 conn(0x55b8e92c5cf0 msgr2=0x55b8e939c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 -- 172.21.15.92:0/3205604814 shutdown_connections 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.197+0000 7fcc3c765b80 1 -- 172.21.15.92:0/3205604814 wait complete. 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 -- start start 2024-04-26T17:58:50.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 Processor -- start 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 0x55b8e93ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e93aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b4230 con 0x55b8e93aef40 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b3b60 con 0x55b8e93992d0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b8e93b4900 con 0x55b8e939f3f0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc3c765b80 10 client.0 _ll_register_callbacks cb 0x55b8e927f530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc2bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42120/0 (socket says 172.21.15.92:42120) 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc2bfff700 1 -- 172.21.15.92:0/97932984 learned_addr learned my addr 172.21.15.92:0/97932984 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.198+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 0x55b8e93ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2affd700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e93aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.204 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 -- 172.21.15.92:0/97932984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 msgr2=0x55b8e93aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e93aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 -- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 msgr2=0x55b8e93ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 0x55b8e93ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 -- 172.21.15.92:0/97932984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8e93bc240 con 0x55b8e93aef40 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2affd700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e93aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:50.205 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 0x55b8e93ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc2bfff700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009f50 tx=0x7fcc24009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c3f09c5cc4580f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc24013ca0 con 0x55b8e93aef40 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fcc24013e40 con 0x55b8e93aef40 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc1c009300 con 0x55b8e93aef40 2024-04-26T17:58:50.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcc24014420 con 0x55b8e93aef40 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc3c765b80 10 client.14973 fetch_fsmap learned FSMap version 25 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b8e941a970 con 0x55b8e93aef40 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc1c009300 con 0x55b8e93aef40 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fcc24030520 con 0x55b8e93aef40 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.199+0000 7fcc3c765b80 10 client.14973 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:58:50.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc3c765b80 10 client.14973 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc3c765b80 20 client.14973 populate_metadata read hostname 'smithi092' 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e941f310 0x55b8e941e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc3c765b80 4 client.14973 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "status"}) -- 0x55b8e92f3170 con 0x55b8e941f310 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e941f310 0x55b8e941e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc2b7fe700 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e941f310 0x55b8e941e020 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94191ed9aa488f6 server_cookie=fcb6fdaab0b7683 in_seq=0 out_seq=0 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.200+0000 7fcc0affd700 10 client.14973 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc0affd700 1 -- 172.21.15.92:0/97932984 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55b8e92f3170 con 0x55b8e941f310 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc0affd700 10 client.14973 handle_command_reply: tid=0 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 client.14973 shutdown 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 msgr2=0x55b8e93bbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.209 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009f50 tx=0x7fcc24009b40 comp rx=0 tx=0).stop 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 shutdown_connections 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b8e941f310 0x55b8e941e020 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8e93992d0 0x55b8e93ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8e93aef40 0x55b8e93bbc00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc0affd700 0 client.14973 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 --2- 172.21.15.92:0/97932984 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b8e939f3f0 0x55b8e93aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 >> 172.21.15.92:0/97932984 conn(0x55b8e92c5cf0 msgr2=0x55b8e93a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 shutdown_connections 2024-04-26T17:58:50.210 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 1 -- 172.21.15.92:0/97932984 wait complete. 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc3c765b80 20 client.14973 trim_cache size 0 max 16384 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24437, 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 146.70603369, 2024-04-26T17:58:50.211 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 162.120195553 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 msgr2=0x7fcc180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 0x7fcc180a6100 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009750 tx=0x7fcc14005fd0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 msgr2=0x7fcc2c104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.201+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00b530 tx=0x7fcc1c00b840 comp rx=0 tx=0).stop 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 shutdown_connections 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc180a3c40 0x7fcc180a6100 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc2c108390 0x7fcc2c104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc2c102320 0x7fcc2c104000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 --2- 172.21.15.92:0/805489084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcc2c102ce0 0x7fcc2c104540 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 >> 172.21.15.92:0/805489084 conn(0x7fcc2c0792d0 msgr2=0x7fcc2c06b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 shutdown_connections 2024-04-26T17:58:50.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:50.202+0000 7fcc31ed3700 1 -- 172.21.15.92:0/805489084 wait complete. 2024-04-26T17:58:50.927 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:50 smithi092 ceph-mon[29156]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:50.954 INFO:tasks.cephadm:Setup complete, yielding 2024-04-26T17:58:50.954 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T17:58:50.965 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:58:50.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-26T17:58:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:50 smithi189 ceph-mon[32756]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:51.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:50 smithi156 ceph-mon[32679]: pgmap v376: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:58:51.204 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- 172.21.15.92:0/11570215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c010fa60 msgr2=0x7fa7c0111e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/11570215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c010fa60 0x7fa7c0111e50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800b0a0 tx=0x7fa7b800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- 172.21.15.92:0/11570215 shutdown_connections 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/11570215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c010fa60 0x7fa7c0111e50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/11570215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 0x7fa7c00758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/11570215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c0075e80 0x7fa7c0076300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- 172.21.15.92:0/11570215 >> 172.21.15.92:0/11570215 conn(0x7fa7c00fea20 msgr2=0x7fa7c0100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- 172.21.15.92:0/11570215 shutdown_connections 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- 172.21.15.92:0/11570215 wait complete. 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 Processor -- start 2024-04-26T17:58:52.951 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.948+0000 7fa7c63d4700 1 -- start start 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 0x7fa7c01a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 0x7fa7c01a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c01155b0 con 0x7fa7c0075e80 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c0115430 con 0x7fa7c010fa60 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c0115730 con 0x7fa7c0077450 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42126/0 (socket says 172.21.15.92:42126) 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 -- 172.21.15.92:0/547424079 learned_addr learned my addr 172.21.15.92:0/547424079 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c4971700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 0x7fa7c01a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bf7fe700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 0x7fa7c01a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 -- 172.21.15.92:0/547424079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 msgr2=0x7fa7c01a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.952 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 0x7fa7c01a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 -- 172.21.15.92:0/547424079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 msgr2=0x7fa7c01a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 0x7fa7c01a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 -- 172.21.15.92:0/547424079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c01a7860 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c4971700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 0x7fa7c01a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bffff700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c8f0 tx=0x7fa7b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007b00 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7b0007ca0 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c01a7b50 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0018660 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.949+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c01a8090 con 0x7fa7c0075e80 2024-04-26T17:58:52.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.950+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c006a110 con 0x7fa7c0075e80 2024-04-26T17:58:52.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.951+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa7b000f450 con 0x7fa7c0075e80 2024-04-26T17:58:52.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.952+0000 7fa7bd7fa700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 0x7fa7a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.952+0000 7fa7bf7fe700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 0x7fa7a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.952+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa7b00d0330 con 0x7fa7c0075e80 2024-04-26T17:58:52.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.953+0000 7fa7bf7fe700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 0x7fa7a80a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006fd0 tx=0x7fa7b4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:52.957+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa7b0014030 con 0x7fa7c0075e80 2024-04-26T17:58:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:52 smithi092 ceph-mon[29156]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:52 smithi189 ceph-mon[32756]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:53.173 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.172+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fa7c0063860 con 0x7fa7a80a3c40 2024-04-26T17:58:53.174 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.174+0000 7fa7bd7fa700 1 -- 172.21.15.92:0/547424079 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa7c0063860 con 0x7fa7a80a3c40 2024-04-26T17:58:53.174 INFO:teuthology.orchestra.run.smithi092.stdout:Backend: cephadm 2024-04-26T17:58:53.174 INFO:teuthology.orchestra.run.smithi092.stdout:Available: Yes 2024-04-26T17:58:53.174 INFO:teuthology.orchestra.run.smithi092.stdout:Paused: No 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 msgr2=0x7fa7a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 0x7fa7a80a6100 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4006fd0 tx=0x7fa7b4008040 comp rx=0 tx=0).stop 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 msgr2=0x7fa7c019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000c8f0 tx=0x7fa7b000ccb0 comp rx=0 tx=0).stop 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 shutdown_connections 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa7a80a3c40 0x7fa7a80a6100 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:53.176 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c010fa60 0x7fa7c01a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:53.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7c0075e80 0x7fa7c019fc10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:53.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 --2- 172.21.15.92:0/547424079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7c0077450 0x7fa7c01a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:53.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 >> 172.21.15.92:0/547424079 conn(0x7fa7c00fea20 msgr2=0x7fa7c0102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:53.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 shutdown_connections 2024-04-26T17:58:53.177 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:53.176+0000 7fa7c63d4700 1 -- 172.21.15.92:0/547424079 wait complete. 2024-04-26T17:58:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:52 smithi156 ceph-mon[32679]: pgmap v377: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:58:53.819 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-26T17:58:54.062 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:54 smithi092 ceph-mon[29156]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:54 smithi092 ceph-mon[29156]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:54 smithi189 ceph-mon[32756]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:54 smithi189 ceph-mon[32756]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:54 smithi156 ceph-mon[32679]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:54 smithi156 ceph-mon[32679]: pgmap v378: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:58:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 -- 172.21.15.92:0/3896916996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 msgr2=0x7f05a4106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 --2- 172.21.15.92:0/3896916996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a4106350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0594009990 tx=0x7f0594009ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 -- 172.21.15.92:0/3896916996 shutdown_connections 2024-04-26T17:58:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 --2- 172.21.15.92:0/3896916996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 0x7f05a410b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 --2- 172.21.15.92:0/3896916996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a4106350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 --2- 172.21.15.92:0/3896916996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 0x7f05a4108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 -- 172.21.15.92:0/3896916996 >> 172.21.15.92:0/3896916996 conn(0x7f05a40fd910 msgr2=0x7f05a40ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 -- 172.21.15.92:0/3896916996 shutdown_connections 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.812+0000 7f05aa36c700 1 -- 172.21.15.92:0/3896916996 wait complete. 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 Processor -- start 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 -- start start 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 0x7f05a4199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 0x7f05a41a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410eef0 con 0x7f05a4103f60 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410ed70 con 0x7f05a4106890 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05aa36c700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f05a410f070 con 0x7f05a41091c0 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.813+0000 7f05a3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:55.816 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58906/0 (socket says 172.21.15.92:58906) 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 -- 172.21.15.92:0/258065766 learned_addr learned my addr 172.21.15.92:0/258065766 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a8909700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 0x7f05a41a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a37fe700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 0x7f05a4199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 -- 172.21.15.92:0/258065766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 msgr2=0x7f05a41a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 0x7f05a41a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 -- 172.21.15.92:0/258065766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 msgr2=0x7f05a4199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 0x7f05a4199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 -- 172.21.15.92:0/258065766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a41a1220 con 0x7f05a4103f60 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a3fff700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f05940036f0 tx=0x7f05940047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594027070 con 0x7f05a4103f60 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a41a14b0 con 0x7f05a4103f60 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0594004080 con 0x7f05a4103f60 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594022d50 con 0x7f05a4103f60 2024-04-26T17:58:55.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.814+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a41a1900 con 0x7f05a4103f60 2024-04-26T17:58:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.815+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05a406a110 con 0x7f05a4103f60 2024-04-26T17:58:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.816+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f059402a070 con 0x7f05a4103f60 2024-04-26T17:58:55.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.817+0000 7f05a17fa700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 0x7f058c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.817+0000 7f05a37fe700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 0x7f058c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.817+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f05940d1a20 con 0x7f05a4103f60 2024-04-26T17:58:55.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.817+0000 7f05a37fe700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 0x7f058c0a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0598005fd0 tx=0x7f059800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:55.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:55.821+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0594031070 con 0x7f05a4103f60 2024-04-26T17:58:56.028 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.027+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f05a4063860 con 0x7f058c0a3c40 2024-04-26T17:58:56.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.041+0000 7f05a17fa700 1 -- 172.21.15.92:0/258065766 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f05a4063860 con 0x7f058c0a3c40 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.a smithi092 running (2m) 29s ago 2m 15.7M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 9b309429d69a 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.b smithi156 running (2m) 32s ago 2m 25.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b ba7b4dc6705f 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.c smithi189 running (3m) 32s ago 3m 20.5M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b f44f054c795c 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.d smithi092 running (3m) 29s ago 3m 16.9M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b b60db7a0ec9c 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.e smithi156 running (3m) 32s ago 3m 21.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 9c393594945b 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.f smithi189 running (3m) 32s ago 3m 19.1M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b fcde8f43459f 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.g smithi092 running (2m) 29s ago 2m 15.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 865e38cf9178 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.h smithi156 running (3m) 32s ago 3m 23.2M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 5133f1c9c2f7 2024-04-26T17:58:56.042 INFO:teuthology.orchestra.run.smithi092.stdout:mds.i smithi189 running (2m) 32s ago 2m 18.9M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 637bdb1f286d 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mds.j smithi092 running (3m) 29s ago 3m 14.3M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b ed84c618f577 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mds.k smithi156 running (3m) 32s ago 3m 14.5M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 28505c1561ca 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mds.l smithi189 running (3m) 32s ago 3m 16.8M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 33fdc4daca8d 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.x smithi092 *:9283,8765 running (10m) 29s ago 10m 515M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 3b31bd6de705 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.y smithi156 *:8443,8765 running (8m) 32s ago 8m 455M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b a4261903a804 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mgr.z smithi189 *:8443,8765 running (8m) 32s ago 8m 454M - 19.0.0-3267-gbc94a2a9 3a6bde214c5b 14e252f49d4b 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mon.a smithi092 running (10m) 29s ago 10m 50.5M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 97922cfaead7 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mon.b smithi156 running (9m) 32s ago 9m 39.4M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 1887ea051e12 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:mon.c smithi189 running (9m) 32s ago 9m 39.6M 2048M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 0707340a0999 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 smithi092 running (8m) 29s ago 8m 49.0M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b aa7430626374 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 smithi156 running (8m) 32s ago 8m 56.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 8f2fb5ffc50b 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 smithi189 running (7m) 32s ago 7m 57.1M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 6099fc1a477f 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 smithi092 running (7m) 29s ago 7m 44.0M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 8ac00abd7b31 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 smithi156 running (6m) 32s ago 6m 42.3M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 64d3b13ede93 2024-04-26T17:58:56.043 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 smithi189 running (6m) 32s ago 6m 57.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b c7a1dabf84ee 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 smithi092 running (5m) 29s ago 5m 53.6M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b e4026e8b3cc1 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 smithi156 running (5m) 32s ago 5m 43.5M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 4f4090a21606 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 smithi189 running (5m) 32s ago 5m 53.6M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 817d3b223cb1 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 smithi092 running (4m) 29s ago 4m 53.0M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b eb744cbfd2de 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 smithi156 running (4m) 32s ago 4m 46.1M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b 15c7073a987f 2024-04-26T17:58:56.044 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 smithi189 running (3m) 32s ago 3m 42.4M 4272M 19.0.0-3267-gbc94a2a9 3a6bde214c5b fb9c0a461f7d 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 msgr2=0x7f058c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 0x7f058c0a6100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0598005fd0 tx=0x7f059800a560 comp rx=0 tx=0).stop 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 msgr2=0x7f05a41995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f05940036f0 tx=0x7f05940047b0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 shutdown_connections 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f058c0a3c40 0x7f058c0a6100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f05a41091c0 0x7f05a41a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05a4103f60 0x7f05a41995c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 --2- 172.21.15.92:0/258065766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05a4106890 0x7f05a4199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 >> 172.21.15.92:0/258065766 conn(0x7f05a40fd910 msgr2=0x7f05a4104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 shutdown_connections 2024-04-26T17:58:56.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:56.044+0000 7f05aa36c700 1 -- 172.21.15.92:0/258065766 wait complete. 2024-04-26T17:58:56.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-26T17:58:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:56 smithi189 ceph-mon[32756]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:57.164 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:58:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:56 smithi156 ceph-mon[32679]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:56 smithi092 ceph-mon[29156]: pgmap v379: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:58:57.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:57 smithi092 ceph-mon[29156]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:57 smithi189 ceph-mon[32756]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:58.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:57 smithi156 ceph-mon[32679]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:58:58.804 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:58:58 smithi092 ceph-mon[29156]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/3675276138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18103f10 msgr2=0x7f8a1810a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/3675276138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18103f10 0x7f8a1810a7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000b0d0 tx=0x7f8a1000b3e0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/3675276138 shutdown_connections 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/3675276138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18103f10 0x7f8a1810a7c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/3675276138 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18102370 0x7f8a18102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.838 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/3675276138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a181039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/3675276138 >> 172.21.15.92:0/3675276138 conn(0x7f8a180fd910 msgr2=0x7f8a180ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/3675276138 shutdown_connections 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.835+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/3675276138 wait complete. 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 Processor -- start 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 -- start start 2024-04-26T17:58:58.839 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a18104950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18103f10 0x7f8a18104e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810df00 con 0x7f8a18102370 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810dd80 con 0x7f8a18103570 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1d0f5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810e080 con 0x7f8a18103f10 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a16d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a16d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58916/0 (socket says 172.21.15.92:58916) 2024-04-26T17:58:58.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a16d9d700 1 -- 172.21.15.92:0/2453266930 learned_addr learned my addr 172.21.15.92:0/2453266930 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1659c700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a18104950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.836+0000 7f8a1759e700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18103f10 0x7f8a18104e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 -- 172.21.15.92:0/2453266930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18103f10 msgr2=0x7f8a18104e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18103f10 0x7f8a18104e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 -- 172.21.15.92:0/2453266930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 msgr2=0x7f8a18104950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a18104950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 -- 172.21.15.92:0/2453266930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a18105740 con 0x7f8a18102370 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a1659c700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a18104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a16d9d700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b500 tx=0x7f8a0800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:58.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08015020 con 0x7f8a18102370 2024-04-26T17:58:58.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a181a3840 con 0x7f8a18102370 2024-04-26T17:58:58.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a08011ce0 con 0x7f8a18102370 2024-04-26T17:58:58.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08010d60 con 0x7f8a18102370 2024-04-26T17:58:58.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.837+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a181a3d80 con 0x7f8a18102370 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.838+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1806a110 con 0x7f8a18102370 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.839+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f8a08018020 con 0x7f8a18102370 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.840+0000 7f89fffff700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 0x7f8a000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.840+0000 7f8a1659c700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 0x7f8a000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.840+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f8a080cfc30 con 0x7f8a18102370 2024-04-26T17:58:58.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.840+0000 7f8a1659c700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 0x7f8a000a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0099d0 tx=0x7f8a0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:58.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:58.845+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f8a0801f020 con 0x7f8a18102370 2024-04-26T17:58:59.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.061+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8a181a3fe0 con 0x7f8a000a3c40 2024-04-26T17:58:59.067 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.067+0000 7f89fffff700 1 -- 172.21.15.92:0/2453266930 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f8a181a3fe0 con 0x7f8a000a3c40 2024-04-26T17:58:59.067 INFO:teuthology.orchestra.run.smithi092.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-26T17:58:59.068 INFO:teuthology.orchestra.run.smithi092.stdout:mds.all 12/12 35s ago 3m smithi092=a;smithi092=d;smithi092=g;smithi092=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-04-26T17:58:59.068 INFO:teuthology.orchestra.run.smithi092.stdout:mgr 3/3 35s ago 8m smithi092=x;smithi156=y;smithi189=z;count:3 2024-04-26T17:58:59.068 INFO:teuthology.orchestra.run.smithi092.stdout:mon 3/3 35s ago 9m smithi092:172.21.15.92=a;smithi156:172.21.15.156=b;smithi189:172.21.15.189=c;count:3 2024-04-26T17:58:59.068 INFO:teuthology.orchestra.run.smithi092.stdout:osd 12 35s ago - 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 msgr2=0x7f8a000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 0x7f8a000a6100 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0099d0 tx=0x7f8a0c008040 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 msgr2=0x7f8a18106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800b500 tx=0x7f8a0800b8c0 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 shutdown_connections 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f8a000a3c40 0x7f8a000a6100 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a18103f10 0x7f8a18104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a18102370 0x7f8a18106300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 --2- 172.21.15.92:0/2453266930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8a18103570 0x7f8a18104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.070+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 >> 172.21.15.92:0/2453266930 conn(0x7f8a180fd910 msgr2=0x7f8a1806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:59.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.071+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 shutdown_connections 2024-04-26T17:58:59.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:58:59.071+0000 7f8a1d0f5700 1 -- 172.21.15.92:0/2453266930 wait complete. 2024-04-26T17:58:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:58:58 smithi189 ceph-mon[32756]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:58:58 smithi156 ceph-mon[32679]: pgmap v380: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:58:59.757 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-26T17:58:59.997 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:00 smithi189 ceph-mon[32756]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:00 smithi189 ceph-mon[32756]: pgmap v381: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:01.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:00 smithi092 ceph-mon[29156]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:01.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:00 smithi092 ceph-mon[29156]: pgmap v381: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:00 smithi156 ceph-mon[32679]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:00 smithi156 ceph-mon[32679]: pgmap v381: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:01.829 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 -- 172.21.15.92:0/3587270260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 msgr2=0x7f26401039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 --2- 172.21.15.92:0/3587270260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f26401039e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f263c0099c0 tx=0x7f263c009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 -- 172.21.15.92:0/3587270260 shutdown_connections 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 --2- 172.21.15.92:0/3587270260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f26401027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 --2- 172.21.15.92:0/3587270260 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2640103f20 0x7f264010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 --2- 172.21.15.92:0/3587270260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f26401039e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 -- 172.21.15.92:0/3587270260 >> 172.21.15.92:0/3587270260 conn(0x7f26400fd920 msgr2=0x7f26400ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 -- 172.21.15.92:0/3587270260 shutdown_connections 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.827+0000 7f2647691700 1 -- 172.21.15.92:0/3587270260 wait complete. 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 Processor -- start 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 -- start start 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f264006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:01.830 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2640103f20 0x7f26401a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f264010de20 con 0x7f2640103580 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f264010dca0 con 0x7f2640102380 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2647691700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f264010dfa0 con 0x7f2640103f20 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58926/0 (socket says 172.21.15.92:58926) 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 -- 172.21.15.92:0/63320942 learned_addr learned my addr 172.21.15.92:0/63320942 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f264542d700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f264006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 -- 172.21.15.92:0/63320942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2640103f20 msgr2=0x7f26401a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2640103f20 0x7f26401a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 -- 172.21.15.92:0/63320942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 msgr2=0x7f264006bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.828+0000 7f2644c2c700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f264006bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f2644c2c700 1 -- 172.21.15.92:0/63320942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26401a1270 con 0x7f2640103580 2024-04-26T17:59:01.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f264542d700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f264006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f2644c2c700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f263c00b580 tx=0x7f263c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c027070 con 0x7f2640103580 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26401a1500 con 0x7f2640103580 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f263c004120 con 0x7f2640103580 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c022d30 con 0x7f2640103580 2024-04-26T17:59:01.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.829+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26401a19e0 con 0x7f2640103580 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.830+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264006a110 con 0x7f2640103580 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.831+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f263c02a070 con 0x7f2640103580 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.831+0000 7f26367fc700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 0x7f262c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.832+0000 7f264542d700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 0x7f262c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.832+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f263c0d1380 con 0x7f2640103580 2024-04-26T17:59:01.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.832+0000 7f264542d700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 0x7f262c0a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2630005950 tx=0x7f26300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:01.835 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:01.835+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f263c013070 con 0x7f2640103580 2024-04-26T17:59:02.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.041+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2640063860 con 0x7f262c0a3c40 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.043+0000 7f26367fc700 1 -- 172.21.15.92:0/63320942 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2640063860 con 0x7f262c0a3c40 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stdout:HOST ADDR LABELS STATUS 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 172.21.15.92 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stdout:smithi156 172.21.15.156 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stdout:smithi189 172.21.15.189 2024-04-26T17:59:02.043 INFO:teuthology.orchestra.run.smithi092.stdout:3 hosts in cluster 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 msgr2=0x7f262c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 0x7f262c0a6100 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2630005950 tx=0x7f26300058e0 comp rx=0 tx=0).stop 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 msgr2=0x7f264019e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f263c00b580 tx=0x7f263c009580 comp rx=0 tx=0).stop 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 shutdown_connections 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f262c0a3c40 0x7f262c0a6100 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2640102380 0x7f264006bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:02.045 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2640103f20 0x7f26401a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 --2- 172.21.15.92:0/63320942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2640103580 0x7f264019e350 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 >> 172.21.15.92:0/63320942 conn(0x7f26400fd920 msgr2=0x7f26401069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 shutdown_connections 2024-04-26T17:59:02.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:02.045+0000 7f2647691700 1 -- 172.21.15.92:0/63320942 wait complete. 2024-04-26T17:59:02.673 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-26T17:59:02.926 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:02 smithi092 ceph-mon[29156]: pgmap v382: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:02 smithi189 ceph-mon[32756]: pgmap v382: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:02 smithi156 ceph-mon[32679]: pgmap v382: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:04.071 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:03 smithi092 ceph-mon[29156]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:03 smithi189 ceph-mon[32756]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:04.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:03 smithi156 ceph-mon[32679]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:04.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 -- 172.21.15.92:0/1298612823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688104680 msgr2=0x7fa688104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 --2- 172.21.15.92:0/1298612823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688104680 0x7fa688104ae0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa6780099c0 tx=0x7fa678009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 -- 172.21.15.92:0/1298612823 shutdown_connections 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 --2- 172.21.15.92:0/1298612823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688105020 0x7fa68810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 --2- 172.21.15.92:0/1298612823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 0x7fa6881038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 --2- 172.21.15.92:0/1298612823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688104680 0x7fa688104ae0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 -- 172.21.15.92:0/1298612823 >> 172.21.15.92:0/1298612823 conn(0x7fa6880fea20 msgr2=0x7fa688100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 -- 172.21.15.92:0/1298612823 shutdown_connections 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.611+0000 7fa68f18b700 1 -- 172.21.15.92:0/1298612823 wait complete. 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 Processor -- start 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 -- start start 2024-04-26T17:59:04.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 0x7fa68819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 0x7fa68819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa68810f010 con 0x7fa688105020 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa68810ee90 con 0x7fa688104680 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68f18b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa68810f190 con 0x7fa688103480 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57622/0 (socket says 172.21.15.92:57622) 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 -- 172.21.15.92:0/2615330386 learned_addr learned my addr 172.21.15.92:0/2615330386 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa687fff700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 0x7fa68819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68cf27700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 0x7fa68819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 -- 172.21.15.92:0/2615330386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 msgr2=0x7fa68819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 0x7fa68819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 -- 172.21.15.92:0/2615330386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 msgr2=0x7fa68819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:04.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 0x7fa68819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 -- 172.21.15.92:0/2615330386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6881a3530 con 0x7fa688105020 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa687fff700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 0x7fa68819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.612+0000 7fa68d728700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa67000b580 tx=0x7fa67000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.613+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670011830 con 0x7fa688105020 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.613+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa670016070 con 0x7fa688105020 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.613+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6881a3820 con 0x7fa688105020 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.613+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670010d40 con 0x7fa688105020 2024-04-26T17:59:04.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.613+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6881a3d90 con 0x7fa688105020 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.614+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68806a110 con 0x7fa688105020 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.615+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa6700119d0 con 0x7fa688105020 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.615+0000 7fa685ffb700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 0x7fa6740a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.615+0000 7fa68cf27700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 0x7fa6740a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.615+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa6700cf8e0 con 0x7fa688105020 2024-04-26T17:59:04.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.616+0000 7fa68cf27700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 0x7fa6740a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6881044e0 tx=0x7fa6800094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:04.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.620+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa67009c360 con 0x7fa688105020 2024-04-26T17:59:04.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.835+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fa6881a4050 con 0x7fa6740a3c40 2024-04-26T17:59:04.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.837+0000 7fa685ffb700 1 -- 172.21.15.92:0/2615330386 <== mgr.14152 v2:172.21.15.92:6800/3474750194 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fa6881a4050 con 0x7fa6740a3c40 2024-04-26T17:59:04.837 INFO:teuthology.orchestra.run.smithi092.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-26T17:59:04.837 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-04-26T17:59:04.838 INFO:teuthology.orchestra.run.smithi092.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-04-26T17:59:04.838 INFO:teuthology.orchestra.run.smithi092.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 msgr2=0x7fa6740a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 0x7fa6740a6100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa6881044e0 tx=0x7fa6800094f0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 msgr2=0x7fa6881a2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa67000b580 tx=0x7fa67000b940 comp rx=0 tx=0).stop 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 shutdown_connections 2024-04-26T17:59:04.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa6740a3c40 0x7fa6740a6100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa688105020 0x7fa6881a2e90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa688103480 0x7fa68819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 --2- 172.21.15.92:0/2615330386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa688104680 0x7fa68819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 >> 172.21.15.92:0/2615330386 conn(0x7fa6880fea20 msgr2=0x7fa688075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 shutdown_connections 2024-04-26T17:59:04.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:04.840+0000 7fa68f18b700 1 -- 172.21.15.92:0/2615330386 wait complete. 2024-04-26T17:59:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:04 smithi189 ceph-mon[32756]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:04 smithi156 ceph-mon[32679]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:05.188 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:04 smithi092 ceph-mon[29156]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:05.619 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-26T17:59:05.628 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:05.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-26T17:59:05.871 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:07.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:06 smithi092 ceph-mon[29156]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:07.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:06 smithi092 ceph-mon[29156]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:06 smithi189 ceph-mon[32756]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:06 smithi189 ceph-mon[32756]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:06 smithi156 ceph-mon[32679]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:06 smithi156 ceph-mon[32679]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 -- 172.21.15.92:0/1646566656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103580 msgr2=0x7fcca81039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/1646566656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103580 0x7fcca81039e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc980099c0 tx=0x7fcc98009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 -- 172.21.15.92:0/1646566656 shutdown_connections 2024-04-26T17:59:07.622 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/1646566656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8103f20 0x7fcca810a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/1646566656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8102380 0x7fcca81027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/1646566656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103580 0x7fcca81039e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 -- 172.21.15.92:0/1646566656 >> 172.21.15.92:0/1646566656 conn(0x7fcca80fd920 msgr2=0x7fcca80ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:07.623 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 -- 172.21.15.92:0/1646566656 shutdown_connections 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.622+0000 7fccaf5a5700 1 -- 172.21.15.92:0/1646566656 wait complete. 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 Processor -- start 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 -- start start 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8102380 0x7fcca806bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 0x7fcca819e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcca810de70 con 0x7fcca8103f20 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcca810dcf0 con 0x7fcca8102380 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccaf5a5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcca810dff0 con 0x7fcca8103580 2024-04-26T17:59:07.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccadb42700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccadb42700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57638/0 (socket says 172.21.15.92:57638) 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccadb42700 1 -- 172.21.15.92:0/2863113645 learned_addr learned my addr 172.21.15.92:0/2863113645 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.623+0000 7fccad341700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8102380 0x7fcca806bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 -- 172.21.15.92:0/2863113645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 msgr2=0x7fcca819e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccacb40700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 0x7fcca819e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 0x7fcca819e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 -- 172.21.15.92:0/2863113645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8102380 msgr2=0x7fcca806bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8102380 0x7fcca806bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 -- 172.21.15.92:0/2863113645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca81a1250 con 0x7fcca8103f20 2024-04-26T17:59:07.626 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccacb40700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 0x7fcca819e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccadb42700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcca0007d70 tx=0x7fcca000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0016020 con 0x7fcca8103f20 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcca000ad40 con 0x7fcca8103f20 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca81a1540 con 0x7fcca8103f20 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca00115e0 con 0x7fcca8103f20 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.624+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca81a1a80 con 0x7fcca8103f20 2024-04-26T17:59:07.627 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.625+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca806a110 con 0x7fcca8103f20 2024-04-26T17:59:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.626+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fcca0019020 con 0x7fcca8103f20 2024-04-26T17:59:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.627+0000 7fcc9e7fc700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 0x7fcc940a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.627+0000 7fccad341700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 0x7fcc940a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.627+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fcca00d0750 con 0x7fcca8103f20 2024-04-26T17:59:07.628 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.627+0000 7fccad341700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 0x7fcc940a6100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcca4005950 tx=0x7fcca40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:07.631 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.630+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcca0020020 con 0x7fcca8103f20 2024-04-26T17:59:07.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.873+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcca802e510 con 0x7fcca8103f20 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.873+0000 7fcc9e7fc700 1 -- 172.21.15.92:0/2863113645 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3058 (secure 0 0 0) 0x7fcca009d1d0 con 0x7fcca8103f20 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:e25 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:legacy client fscid: 1 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem 'cephfs' (1) 2024-04-26T17:59:07.874 INFO:teuthology.orchestra.run.smithi092.stdout:fs_name cephfs 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 25 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-04-26T17:56:22.551088+0000 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-04-26T17:56:44.780595+0000 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:tableserver 0 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:root 0 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:session_timeout 300 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:session_autoclose 300 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:max_file_size 1099511627776 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:max_xattr_size 65536 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:required_client_features {} 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure 0 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:last_failure_osd_epoch 0 2024-04-26T17:59:07.875 INFO:teuthology.orchestra.run.smithi092.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:max_mds 3 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:in 0,1,2 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:up {0=24437,1=24419,2=24406} 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:failed 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:damaged 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:stopped 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:data_pools [3] 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:metadata_pool 2 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:inline_data disabled 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:balancer 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:bal_rank_mask -1 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:standby_count_wanted 0 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:qdb_cluster leader: 24437 members: 24419,24437,24406 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b{0:24437} state up:active seq 5 addr [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.876 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.e{0:24401} state up:standby-replay seq 1 addr [v2:172.21.15.156:6834/1296842780,v1:172.21.15.156:6835/1296842780] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.h{1:24419} state up:active seq 12 addr [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c{1:24400} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.i{2:24406} state up:active seq 12 addr [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.f{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:Standby daemons: 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.j{-1:14505} state up:standby seq 1 addr [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d{-1:14517} state up:standby seq 1 addr [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.g{-1:14565} state up:standby seq 1 addr [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a{-1:14577} state up:standby seq 1 addr [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.l{-1:24376} state up:standby seq 1 addr [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.k{-1:24386} state up:standby seq 1 addr [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] compat {c=[1],r=[1],i=[1fff]}] 2024-04-26T17:59:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 msgr2=0x7fcc940a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 0x7fcc940a6100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcca4005950 tx=0x7fcca40058e0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 msgr2=0x7fcca81a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcca0007d70 tx=0x7fcca000a340 comp rx=0 tx=0).stop 2024-04-26T17:59:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 shutdown_connections 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fcc940a3c40 0x7fcc940a6100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca8102380 0x7fcca806bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcca8103f20 0x7fcca81a0980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 --2- 172.21.15.92:0/2863113645 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcca8103580 0x7fcca819e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 >> 172.21.15.92:0/2863113645 conn(0x7fcca80fd920 msgr2=0x7fcca81068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 shutdown_connections 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:07.876+0000 7fccaf5a5700 1 -- 172.21.15.92:0/2863113645 wait complete. 2024-04-26T17:59:07.879 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:59:08.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-26T17:59:08.922 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:09.763 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:08 smithi156 ceph-mon[32679]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:09.764 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:08 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2863113645' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T17:59:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:08 smithi189 ceph-mon[32756]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:09.764 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:08 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2863113645' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T17:59:09.764 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:08 smithi092 ceph-mon[29156]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:09.764 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:08 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2863113645' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-26T17:59:10.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 -- 172.21.15.92:0/1793099761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1023a0 msgr2=0x7f363c1027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:10.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 --2- 172.21.15.92:0/1793099761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1023a0 0x7f363c1027c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f362c0099c0 tx=0x7f362c009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 -- 172.21.15.92:0/1793099761 shutdown_connections 2024-04-26T17:59:10.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 --2- 172.21.15.92:0/1793099761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c103f40 0x7f363c10a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 --2- 172.21.15.92:0/1793099761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1023a0 0x7f363c1027c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 --2- 172.21.15.92:0/1793099761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c1035a0 0x7f363c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 -- 172.21.15.92:0/1793099761 >> 172.21.15.92:0/1793099761 conn(0x7f363c0fd980 msgr2=0x7f363c0ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 -- 172.21.15.92:0/1793099761 shutdown_connections 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.720+0000 7f3641fdc700 1 -- 172.21.15.92:0/1793099761 wait complete. 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 Processor -- start 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 -- start start 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c1023a0 0x7f363c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 0x7f363c1a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10de90 con 0x7f363c1035a0 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10dd10 con 0x7f363c1023a0 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3641fdc700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f363c10e010 con 0x7f363c103f40 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:10.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57660/0 (socket says 172.21.15.92:57660) 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 -- 172.21.15.92:0/128349877 learned_addr learned my addr 172.21.15.92:0/128349877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f363b7fe700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c1023a0 0x7f363c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f363bfff700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 0x7f363c1a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 -- 172.21.15.92:0/128349877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 msgr2=0x7f363c1a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 0x7f363c1a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 -- 172.21.15.92:0/128349877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c1023a0 msgr2=0x7f363c1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c1023a0 0x7f363c1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 -- 172.21.15.92:0/128349877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c1a1250 con 0x7f363c1035a0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f363bfff700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 0x7f363c1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.721+0000 7f3633fff700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f362400b560 tx=0x7f362400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.722+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624015020 con 0x7f363c1035a0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.722+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3624011ce0 con 0x7f363c1035a0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.722+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363c1a1540 con 0x7f363c1035a0 2024-04-26T17:59:10.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.722+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624010d20 con 0x7f363c1035a0 2024-04-26T17:59:10.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.722+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363c1a1a80 con 0x7f363c1035a0 2024-04-26T17:59:10.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.723+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f363c06a110 con 0x7f363c1035a0 2024-04-26T17:59:10.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.724+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f3624018020 con 0x7f363c1035a0 2024-04-26T17:59:10.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.724+0000 7f36397fa700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:10.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.724+0000 7f363b7fe700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:10.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.724+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f36240d0050 con 0x7f363c1035a0 2024-04-26T17:59:10.726 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.725+0000 7f363b7fe700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 0x7f36280a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f362c0038c0 tx=0x7f362c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:10.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.728+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f362401f020 con 0x7f363c1035a0 2024-04-26T17:59:10.928 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.928+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f363c1a1f00 con 0x7f363c1035a0 2024-04-26T17:59:10.929 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:10 smithi092 ceph-mon[29156]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:10.929 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.929+0000 7f36397fa700 1 -- 172.21.15.92:0/128349877 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+5223 (secure 0 0 0) 0x7f362409cad0 con 0x7f363c1035a0 2024-04-26T17:59:10.929 INFO:teuthology.orchestra.run.smithi092.stdout:epoch 90 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:fsid fb3c417a-03f4-11ef-bc93-c7b262605968 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:created 2024-04-26T17:48:04.505316+0000 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:modified 2024-04-26T17:56:58.617254+0000 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:crush_version 26 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:full_ratio 0.95 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:backfillfull_ratio 0.9 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:nearfull_ratio 0.85 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:require_min_compat_client luminous 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:min_compat_client luminous 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:require_osd_release squid 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:stretch_mode_enabled false 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-26T17:59:10.930 INFO:teuthology.orchestra.run.smithi092.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:max_osd 12 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6802/2855272540,v1:172.21.15.92:6803/2855272540] [v2:172.21.15.92:6804/2855272540,v1:172.21.15.92:6805/2855272540] exists,up 55536846-f612-4ca4-a1b7-c189c46c0248 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6800/2277484225,v1:172.21.15.156:6801/2277484225] [v2:172.21.15.156:6802/2277484225,v1:172.21.15.156:6803/2277484225] exists,up f315aace-94f0-4e29-bd41-38288afb5d92 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.2 up in weight 1 up_from 18 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/2479019407,v1:172.21.15.189:6801/2479019407] [v2:172.21.15.189:6802/2479019407,v1:172.21.15.189:6803/2479019407] exists,up 6b044658-ea68-41e1-87e3-dc22b4f2684a 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.3 up in weight 1 up_from 25 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6810/581844873,v1:172.21.15.92:6811/581844873] [v2:172.21.15.92:6812/581844873,v1:172.21.15.92:6813/581844873] exists,up b4bd9306-9b9e-45b9-b1d8-2661ac428acb 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.4 up in weight 1 up_from 33 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6808/4116221322,v1:172.21.15.156:6809/4116221322] [v2:172.21.15.156:6810/4116221322,v1:172.21.15.156:6811/4116221322] exists,up 629fcf0c-6485-40a8-b061-830ca371d1a6 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.5 up in weight 1 up_from 38 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/197850559,v1:172.21.15.189:6809/197850559] [v2:172.21.15.189:6810/197850559,v1:172.21.15.189:6811/197850559] exists,up 23e77478-0d7d-40d5-b841-afac85598bda 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.6 up in weight 1 up_from 46 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6818/776474757,v1:172.21.15.92:6819/776474757] [v2:172.21.15.92:6820/776474757,v1:172.21.15.92:6821/776474757] exists,up 93f45cf1-bff5-478b-8032-f981eb9e611e 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.7 up in weight 1 up_from 51 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6816/2386131236,v1:172.21.15.156:6817/2386131236] [v2:172.21.15.156:6818/2386131236,v1:172.21.15.156:6819/2386131236] exists,up 939fcac7-da9c-4597-bb1a-72551333afc2 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.8 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/887620459,v1:172.21.15.189:6817/887620459] [v2:172.21.15.189:6818/887620459,v1:172.21.15.189:6819/887620459] exists,up fde43dbf-ec98-4ffc-952c-a02d99f49c8c 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.9 up in weight 1 up_from 67 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6826/452175931,v1:172.21.15.92:6827/452175931] [v2:172.21.15.92:6828/452175931,v1:172.21.15.92:6829/452175931] exists,up 835333c8-14f9-48e8-a46d-d01933f736e4 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.10 up in weight 1 up_from 72 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6824/3658089432,v1:172.21.15.156:6825/3658089432] [v2:172.21.15.156:6826/3658089432,v1:172.21.15.156:6827/3658089432] exists,up dfe79378-5503-496e-a181-79991a26c848 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:osd.11 up in weight 1 up_from 80 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/3211809812,v1:172.21.15.189:6825/3211809812] [v2:172.21.15.189:6826/3211809812,v1:172.21.15.189:6827/3211809812] exists,up c9c94655-dbf2-4779-a48e-3be47e6d1744 2024-04-26T17:59:10.931 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.4 [2,11] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.a [2,11] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 2.1f [8,4] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.3 [4,9] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.10 [5,9] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:pg_upmap_items 3.34 [4,9] 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/2200342511 expires 2024-04-27T17:48:57.534166+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/2200342511 expires 2024-04-27T17:48:57.534166+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2793875930 expires 2024-04-27T17:48:57.534166+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/3569279594 expires 2024-04-27T17:48:57.534166+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6801/1516469819 expires 2024-04-27T17:48:31.081933+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:6800/1516469819 expires 2024-04-27T17:48:31.081933+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/4287149904 expires 2024-04-27T17:48:31.081933+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/2361401174 expires 2024-04-27T17:48:31.081933+0000 2024-04-26T17:59:10.932 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/271940461 expires 2024-04-27T17:48:31.081933+0000 2024-04-26T17:59:10.933 INFO:teuthology.orchestra.run.smithi092.stdout:blocklist 172.21.15.92:0/378708074 expires 2024-04-27T17:48:57.534166+0000 2024-04-26T17:59:10.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 msgr2=0x7f36280a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:10.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 0x7f36280a6100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f362c0038c0 tx=0x7f362c00b540 comp rx=0 tx=0).stop 2024-04-26T17:59:10.933 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 msgr2=0x7f363c199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f362400b560 tx=0x7f362400b870 comp rx=0 tx=0).stop 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 shutdown_connections 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f36280a3c40 0x7f36280a6100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f363c1023a0 0x7f363c1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c103f40 0x7f363c1a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 --2- 172.21.15.92:0/128349877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f363c1035a0 0x7f363c199b30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 >> 172.21.15.92:0/128349877 conn(0x7f363c0fd980 msgr2=0x7f363c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 shutdown_connections 2024-04-26T17:59:10.934 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:10.932+0000 7f3641fdc700 1 -- 172.21.15.92:0/128349877 wait complete. 2024-04-26T17:59:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:10 smithi189 ceph-mon[32756]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:10 smithi156 ceph-mon[32679]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:11.708 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-26T17:59:11.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:59:11.964 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:11 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/128349877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T17:59:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:11 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/128349877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T17:59:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:11 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/128349877' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-26T17:59:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:12 smithi189 ceph-mon[32756]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:12 smithi156 ceph-mon[32679]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:12 smithi092 ceph-mon[29156]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 -- 172.21.15.92:0/2541801066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8102320 msgr2=0x7f4fa81027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 --2- 172.21.15.92:0/2541801066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8102320 0x7f4fa81027a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009990 tx=0x7f4f94009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 -- 172.21.15.92:0/2541801066 shutdown_connections 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 --2- 172.21.15.92:0/2541801066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 0x7f4fa810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 --2- 172.21.15.92:0/2541801066 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8108390 0x7f4fa8108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 --2- 172.21.15.92:0/2541801066 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8102320 0x7f4fa81027a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 -- 172.21.15.92:0/2541801066 >> 172.21.15.92:0/2541801066 conn(0x7f4fa80792d0 msgr2=0x7f4fa80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 -- 172.21.15.92:0/2541801066 shutdown_connections 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.810+0000 7f4faec0e700 1 -- 172.21.15.92:0/2541801066 wait complete. 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 Processor -- start 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 -- start start 2024-04-26T17:59:13.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8102320 0x7f4fa819e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 0x7f4fa819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa81124d0 con 0x7f4fa8108390 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8112350 con 0x7f4fa8102ce0 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4faec0e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa8112650 con 0x7f4fa8102320 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57690/0 (socket says 172.21.15.92:57690) 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 -- 172.21.15.92:0/1829944717 learned_addr learned my addr 172.21.15.92:0/1829944717 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fac9aa700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8102320 0x7f4fa819e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fa7fff700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 0x7f4fa819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 -- 172.21.15.92:0/1829944717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8102320 msgr2=0x7f4fa819e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8102320 0x7f4fa819e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 -- 172.21.15.92:0/1829944717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 msgr2=0x7f4fa819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:13.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 0x7f4fa819ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.811+0000 7f4fad1ab700 1 -- 172.21.15.92:0/1829944717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa8199030 con 0x7f4fa8108390 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4fad1ab700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007ee0 tx=0x7f4fa000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000dbd0 con 0x7f4fa8108390 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa8199320 con 0x7f4fa8108390 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa000dd70 con 0x7f4fa8108390 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0005990 con 0x7f4fa8108390 2024-04-26T17:59:13.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.812+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa81a5530 con 0x7f4fa8108390 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.813+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa8103a40 con 0x7f4fa8108390 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.814+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f4fa001a020 con 0x7f4fa8108390 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.814+0000 7f4fa5ffb700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 0x7f4f980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.815+0000 7f4fac9aa700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 0x7f4f980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.815+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f4fa00cfbf0 con 0x7f4fa8108390 2024-04-26T17:59:13.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.815+0000 7f4fac9aa700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 0x7f4f980a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009bd0 tx=0x7f4f9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:13.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:13.819+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4fa0010070 con 0x7f4fa8108390 2024-04-26T17:59:13.818 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:13 smithi092 ceph-mon[29156]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:14.065 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.066+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fa802e490 con 0x7f4fa8108390 2024-04-26T17:59:14.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.067+0000 7f4fa5ffb700 1 -- 172.21.15.92:0/1829944717 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7f4fa009c670 con 0x7f4fa8108390 2024-04-26T17:59:14.066 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:14.067 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:59:14.068 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 msgr2=0x7f4f980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 0x7f4f980a6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009bd0 tx=0x7f4f9c009260 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 msgr2=0x7f4fa8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0007ee0 tx=0x7f4fa000d3b0 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 shutdown_connections 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f4f980a3c40 0x7f4f980a6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fa8108390 0x7f4fa8198850 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4fa8102320 0x7f4fa819e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 --2- 172.21.15.92:0/1829944717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fa8102ce0 0x7f4fa819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 >> 172.21.15.92:0/1829944717 conn(0x7f4fa80792d0 msgr2=0x7f4fa8100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 shutdown_connections 2024-04-26T17:59:14.069 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:14.069+0000 7f4faec0e700 1 -- 172.21.15.92:0/1829944717 wait complete. 2024-04-26T17:59:14.070 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:59:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:13 smithi189 ceph-mon[32756]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:13 smithi156 ceph-mon[32679]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:14.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:59:15.076 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:14 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1829944717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:14 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1829944717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:15.198 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:14 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1829944717' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:15 smithi189 ceph-mon[32756]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:16.182 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:15 smithi092 ceph-mon[29156]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:15 smithi156 ceph-mon[32679]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:16.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- 172.21.15.92:0/2340176400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1094d0 msgr2=0x7ff41c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- 172.21.15.92:0/2340176400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1094d0 0x7ff41c1098b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff4100099c0 tx=0x7ff410009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- 172.21.15.92:0/2340176400 shutdown_connections 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- 172.21.15.92:0/2340176400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c102330 0x7ff41c1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- 172.21.15.92:0/2340176400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c1094d0 0x7ff41c1098b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- 172.21.15.92:0/2340176400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c101970 0x7ff41c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- 172.21.15.92:0/2340176400 >> 172.21.15.92:0/2340176400 conn(0x7ff41c078920 msgr2=0x7ff41c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- 172.21.15.92:0/2340176400 shutdown_connections 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- 172.21.15.92:0/2340176400 wait complete. 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 Processor -- start 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 -- start start 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c101970 0x7ff41c19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.736+0000 7ff4231c8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:16.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c1094d0 0x7ff41c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c113610 con 0x7ff41c102330 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c113490 con 0x7ff41c101970 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c113790 con 0x7ff41c1094d0 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43192/0 (socket says 172.21.15.92:43192) 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 -- 172.21.15.92:0/1330625985 learned_addr learned my addr 172.21.15.92:0/1330625985 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff420f64700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c101970 0x7ff41c19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff421765700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c1094d0 0x7ff41c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 -- 172.21.15.92:0/1330625985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c1094d0 msgr2=0x7ff41c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c1094d0 0x7ff41c199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 -- 172.21.15.92:0/1330625985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c101970 msgr2=0x7ff41c19f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c101970 0x7ff41c19f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 -- 172.21.15.92:0/1330625985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c19a0f0 con 0x7ff41c102330 2024-04-26T17:59:16.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff41bfff700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d980 tx=0x7ff40800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408017070 con 0x7ff41c102330 2024-04-26T17:59:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff408005020 con 0x7ff41c102330 2024-04-26T17:59:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408009b50 con 0x7ff41c102330 2024-04-26T17:59:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c19a3e0 con 0x7ff41c102330 2024-04-26T17:59:16.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.737+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1a6650 con 0x7ff41c102330 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.738+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c06a110 con 0x7ff41c102330 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.739+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7ff4080051d0 con 0x7ff41c102330 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.740+0000 7ff419ffb700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 0x7ff40c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.740+0000 7ff420f64700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 0x7ff40c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.740+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7ff4080d0610 con 0x7ff41c102330 2024-04-26T17:59:16.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.740+0000 7ff420f64700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 0x7ff40c0a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff41c1085b0 tx=0x7ff410005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:16.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.744+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7ff408020020 con 0x7ff41c102330 2024-04-26T17:59:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.991+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff41c02e490 con 0x7ff41c102330 2024-04-26T17:59:16.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.992+0000 7ff419ffb700 1 -- 172.21.15.92:0/1330625985 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11883 (secure 0 0 0) 0x7ff40809d090 con 0x7ff41c102330 2024-04-26T17:59:16.992 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:16.992 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:56:44.780595+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24419,24437,24406]},"id":1}]} 2024-04-26T17:59:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 msgr2=0x7ff40c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:16.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 0x7ff40c0a6100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff41c1085b0 tx=0x7ff410005c40 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 msgr2=0x7ff41c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff40800d980 tx=0x7ff40800dc90 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 shutdown_connections 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7ff40c0a3c40 0x7ff40c0a6100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41c101970 0x7ff41c19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff41c1094d0 0x7ff41c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 --2- 172.21.15.92:0/1330625985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff41c102330 0x7ff41c19fcc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 >> 172.21.15.92:0/1330625985 conn(0x7ff41c078920 msgr2=0x7ff41c1000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 shutdown_connections 2024-04-26T17:59:16.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:16.995+0000 7ff4231c8700 1 -- 172.21.15.92:0/1330625985 wait complete. 2024-04-26T17:59:16.996 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 25 2024-04-26T17:59:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:17 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1330625985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:17 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1330625985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:17.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:17 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1330625985' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:17.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:59:18.027 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:18.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:18 smithi092 ceph-mon[29156]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:18 smithi189 ceph-mon[32756]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:18 smithi156 ceph-mon[32679]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:19.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 -- 172.21.15.92:0/3960883974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e01094b0 msgr2=0x7f10e0109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:19.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/3960883974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e01094b0 0x7f10e0109890 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f10d800b0a0 tx=0x7f10d800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 -- 172.21.15.92:0/3960883974 shutdown_connections 2024-04-26T17:59:19.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/3960883974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01023b0 0x7f10e01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/3960883974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e01094b0 0x7f10e0109890 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/3960883974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e0101a10 0x7f10e0101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 -- 172.21.15.92:0/3960883974 >> 172.21.15.92:0/3960883974 conn(0x7f10e0078990 msgr2=0x7f10e00ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 -- 172.21.15.92:0/3960883974 shutdown_connections 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.705+0000 7f10e6f4e700 1 -- 172.21.15.92:0/3960883974 wait complete. 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 Processor -- start 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 -- start start 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e01023b0 0x7f10e019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 0x7f10e0199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01136a0 con 0x7f10e0101a10 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0113520 con 0x7f10e01094b0 2024-04-26T17:59:19.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e6f4e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0113820 con 0x7f10e01023b0 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43214/0 (socket says 172.21.15.92:43214) 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 -- 172.21.15.92:0/2018232169 learned_addr learned my addr 172.21.15.92:0/2018232169 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10dffff700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e01023b0 0x7f10e019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e54eb700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 0x7f10e0199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 -- 172.21.15.92:0/2018232169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e01023b0 msgr2=0x7f10e019fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e01023b0 0x7f10e019fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 -- 172.21.15.92:0/2018232169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 msgr2=0x7f10e0199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 0x7f10e0199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e4cea700 1 -- 172.21.15.92:0/2018232169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e019a220 con 0x7f10e0101a10 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.706+0000 7f10e54eb700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 0x7f10e0199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10e4cea700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006070 tx=0x7f10d8004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8021070 con 0x7f10e0101a10 2024-04-26T17:59:19.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d8007df0 con 0x7f10e0101a10 2024-04-26T17:59:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d801d450 con 0x7f10e0101a10 2024-04-26T17:59:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e019a4b0 con 0x7f10e0101a10 2024-04-26T17:59:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.707+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01a67d0 con 0x7f10e0101a10 2024-04-26T17:59:19.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.708+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e0104d30 con 0x7f10e0101a10 2024-04-26T17:59:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.709+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f10d80040b0 con 0x7f10e0101a10 2024-04-26T17:59:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.710+0000 7f10ddffb700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 0x7f10cc0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.710+0000 7f10dffff700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 0x7f10cc0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.710+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f10d800f020 con 0x7f10e0101a10 2024-04-26T17:59:19.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.710+0000 7f10dffff700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 0x7f10cc0a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:19.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.713+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f10d802a020 con 0x7f10e0101a10 2024-04-26T17:59:19.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.915+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10e002e490 con 0x7f10e0101a10 2024-04-26T17:59:19.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.917+0000 7f10ddffb700 1 -- 172.21.15.92:0/2018232169 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22478 (secure 0 0 0) 0x7f10d809e940 con 0x7f10e0101a10 2024-04-26T17:59:19.917 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:19.917 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":90,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:56:58.617254+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 msgr2=0x7f10cc0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 0x7f10cc0a6180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006fd0 tx=0x7f10d0008040 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 msgr2=0x7f10e019f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f10d8006070 tx=0x7f10d8004ef0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 shutdown_connections 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f10cc0a3cc0 0x7f10cc0a6180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10e01094b0 0x7f10e0199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e0101a10 0x7f10e019f900 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 --2- 172.21.15.92:0/2018232169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10e01023b0 0x7f10e019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 >> 172.21.15.92:0/2018232169 conn(0x7f10e0078990 msgr2=0x7f10e01065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 shutdown_connections 2024-04-26T17:59:19.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:19.919+0000 7f10e6f4e700 1 -- 172.21.15.92:0/2018232169 wait complete. 2024-04-26T17:59:20.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T17:56:22.551088+0000', 'modified': '2024-04-26T17:56:44.780595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24437, 'mds_1': 24419, 'mds_2': 24406}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3880754337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3880754337}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3880754337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/1535152997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 1535152997}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 1535152997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6835/1296842780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 1296842780}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 1296842780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24406': {'gid': 24406, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.189:6839/915245244', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 915245244}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 915245244}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.156:6837/1965706259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 1965706259}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 1965706259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.156:6839/2836729853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 2836729853}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 2836729853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24437, 'qdb_cluster': [24419, 24437, 24406]} 2024-04-26T17:59:20.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T17:59:20.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T17:59:20.954 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:20 smithi092 ceph-mon[29156]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:20 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2018232169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:20 smithi189 ceph-mon[32756]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:20 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2018232169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:20 smithi156 ceph-mon[32679]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:20 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2018232169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:22.805 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:22 smithi092 ceph-mon[29156]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1210312116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 msgr2=0x7fa3d8106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1210312116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d8106fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0099c0 tx=0x7fa3cc009cd0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1210312116 shutdown_connections 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1210312116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d8103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1210312116 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 0x7fa3d810f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1210312116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d8106fc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1210312116 >> 172.21.15.92:0/1210312116 conn(0x7fa3d8078990 msgr2=0x7fa3d80ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1210312116 shutdown_connections 2024-04-26T17:59:22.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.808+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1210312116 wait complete. 2024-04-26T17:59:22.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 Processor -- start 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 -- start start 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 0x7fa3d81a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81125d0 con 0x7fa3d8103730 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8112450 con 0x7fa3d8102d80 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.809+0000 7fa3ddca5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8112750 con 0x7fa3d81076a0 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.811 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43232/0 (socket says 172.21.15.92:43232) 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 -- 172.21.15.92:0/1120605948 learned_addr learned my addr 172.21.15.92:0/1120605948 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 -- 172.21.15.92:0/1120605948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 msgr2=0x7fa3d81a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 0x7fa3d81a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 0x7fa3d81a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 -- 172.21.15.92:0/1120605948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 msgr2=0x7fa3d819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 -- 172.21.15.92:0/1120605948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d81a5f90 con 0x7fa3d8103730 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d6ffd700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009f50 tx=0x7fa3cc0037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d4ff9700 1 -- 172.21.15.92:0/1120605948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc027070 con 0x7fa3d8103730 2024-04-26T17:59:22.812 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d81a6160 con 0x7fa3d8103730 2024-04-26T17:59:22.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d4ff9700 1 -- 172.21.15.92:0/1120605948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3cc004140 con 0x7fa3d8103730 2024-04-26T17:59:22.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.810+0000 7fa3d4ff9700 1 -- 172.21.15.92:0/1120605948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00f460 con 0x7fa3d8103730 2024-04-26T17:59:22.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.811+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d81a65b0 con 0x7fa3d8103730 2024-04-26T17:59:22.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.812+0000 7fa3d4ff9700 1 -- 172.21.15.92:0/1120605948 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fa3cc02a070 con 0x7fa3d8103730 2024-04-26T17:59:22.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.813+0000 7fa3d4ff9700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 0x7fa3c00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.817 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.813+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 0x7fa3c00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.813+0000 7fa3d4ff9700 1 -- 172.21.15.92:0/1120605948 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa3cc0d1160 con 0x7fa3d8103730 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.813+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 0x7fa3c00a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005fd0 tx=0x7fa3c8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.814+0000 7fa3e8537b80 1 Processor -- start 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.814+0000 7fa3e8537b80 1 -- start start 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.814+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.814+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d328465a0 0x557d32840160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.814+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d32840be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d3278e7e0 con 0x557d32845c80 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557d326f48e0 con 0x557d32840780 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d3278a7a0 con 0x557d328465a0 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43240/0 (socket says 172.21.15.92:43240) 2024-04-26T17:59:22.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 -- 172.21.15.92:0/2043877498 learned_addr learned my addr 172.21.15.92:0/2043877498 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d32840be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 -- 172.21.15.92:0/2043877498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d328465a0 msgr2=0x557d32840160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d328465a0 0x557d32840160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 -- 172.21.15.92:0/2043877498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 msgr2=0x557d32840be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d32840be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 -- 172.21.15.92:0/2043877498 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d326db880 con 0x557d32845c80 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d32840be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a5c0 tx=0x7fa3c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed63660bfbf7691b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3bdffb700 1 -- 172.21.15.92:0/2043877498 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8021070 con 0x557d32845c80 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3bdffb700 1 -- 172.21.15.92:0/2043877498 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c8010e50 con 0x557d32845c80 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.815+0000 7fa3bdffb700 1 -- 172.21.15.92:0/2043877498 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800f760 con 0x557d32845c80 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- 172.21.15.92:0/2043877498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 msgr2=0x557d32846060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800a5c0 tx=0x7fa3c8011000 comp rx=0 tx=0).stop 2024-04-26T17:59:22.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- 172.21.15.92:0/2043877498 shutdown_connections 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d32840be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d32845c80 0x557d32846060 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/2043877498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d328465a0 0x557d32840160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- 172.21.15.92:0/2043877498 >> 172.21.15.92:0/2043877498 conn(0x557d3276a570 msgr2=0x557d32836900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- 172.21.15.92:0/2043877498 shutdown_connections 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- 172.21.15.92:0/2043877498 wait complete. 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.816+0000 7fa3e8537b80 1 -- start start 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 Processor -- start 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3284c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d32849580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d3284d0c0 con 0x557d328465a0 2024-04-26T17:59:22.820 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557d32748a30 con 0x557d32845c80 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d3284d240 con 0x557d32840780 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3e8537b80 10 client.0 _ll_register_callbacks cb 0x557d32726900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43244/0 (socket says 172.21.15.92:43244) 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 -- 172.21.15.92:0/3919144494 learned_addr learned my addr 172.21.15.92:0/3919144494 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3284c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d6ffd700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d32849580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 -- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 msgr2=0x557d3284c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3284c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.821 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 -- 172.21.15.92:0/3919144494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 msgr2=0x557d32849580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d32849580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 -- 172.21.15.92:0/3919144494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d3274c430 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e830 tx=0x7fa3d000eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc8d3bb54677f23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.817+0000 7fa3b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0018020 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa3d0014850 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c8010e50 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3d0014a90 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 10 client.15045 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557d32857890 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c8010e50 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa3d0011070 con 0x557d328465a0 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:22.822 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 10 client.15045 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T17:59:22.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 20 client.15045 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:22.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d32859ef0 0x557d3285b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 4 client.15045 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:22.823 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.818+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d3279c1c0 con 0x557d32859ef0 2024-04-26T17:59:22.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.819+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d32859ef0 0x557d3285b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.819+0000 7fa3b6ffd700 10 client.15045 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T17:59:22.824 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.819+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d32859ef0 0x557d3285b360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1cf619684e243111 server_cookie=d5f1898a71370d7a in_seq=0 out_seq=0 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/3919144494 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557d3279c1c0 con 0x557d32859ef0 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3b6ffd700 10 client.15045 handle_command_reply: tid=0 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 client.15045 shutdown 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 msgr2=0x557d32849ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000e830 tx=0x7fa3d000eb40 comp rx=0 tx=0).stop 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 shutdown_connections 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d32859ef0 0x557d3285b360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32849ac0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3284c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/3919144494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d32849580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 >> 172.21.15.92:0/3919144494 conn(0x557d3276a570 msgr2=0x557d3283ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3b6ffd700 0 client.15045 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T17:59:22.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 shutdown_connections 2024-04-26T17:59:22.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.820+0000 7fa3e8537b80 1 -- 172.21.15.92:0/3919144494 wait complete. 2024-04-26T17:59:22.826 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.821+0000 7fa3e8537b80 20 client.15045 trim_cache size 0 max 16384 2024-04-26T17:59:22.840 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.840+0000 7fa3e8537b80 1 Processor -- start 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.840+0000 7fa3e8537b80 1 -- start start 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.840+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d3283fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.840+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32845c80 0x557d32858d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d328596a0 con 0x557d328465a0 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557d32859d70 con 0x557d32840780 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d3285a440 con 0x557d32845c80 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43254/0 (socket says 172.21.15.92:43254) 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 -- 172.21.15.92:0/1827389412 learned_addr learned my addr 172.21.15.92:0/1827389412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d3283fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.841 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 -- 172.21.15.92:0/1827389412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32845c80 msgr2=0x557d32858d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32845c80 0x557d32858d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 -- 172.21.15.92:0/1827389412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 msgr2=0x557d3283fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d3283fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 -- 172.21.15.92:0/1827389412 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d328331f0 con 0x557d328465a0 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0012440 tx=0x7fa3d000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4060f14bb780aaf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3bd7fa700 1 -- 172.21.15.92:0/1827389412 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0018070 con 0x557d328465a0 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3bd7fa700 1 -- 172.21.15.92:0/1827389412 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d000c040 con 0x557d328465a0 2024-04-26T17:59:22.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.841+0000 7fa3bd7fa700 1 -- 172.21.15.92:0/1827389412 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d001c3a0 con 0x557d328465a0 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- 172.21.15.92:0/1827389412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 msgr2=0x557d32848ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0012440 tx=0x7fa3d000ef10 comp rx=0 tx=0).stop 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- 172.21.15.92:0/1827389412 shutdown_connections 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32840780 0x557d3283fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d32848ae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/1827389412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32845c80 0x557d32858d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- 172.21.15.92:0/1827389412 >> 172.21.15.92:0/1827389412 conn(0x557d3276a570 msgr2=0x557d328367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- 172.21.15.92:0/1827389412 shutdown_connections 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- 172.21.15.92:0/1827389412 wait complete. 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 -- start start 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.842+0000 7fa3e8537b80 1 Processor -- start 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3283fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d328647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557d3285b1e0 con 0x557d328465a0 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557d3285ab10 con 0x557d32845c80 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557d3285b8b0 con 0x557d32840780 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 10 client.0 _ll_register_callbacks cb 0x557d32726900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43262/0 (socket says 172.21.15.92:43262) 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 -- 172.21.15.92:0/534180098 learned_addr learned my addr 172.21.15.92:0/534180098 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:22.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d6ffd700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d328647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 -- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 msgr2=0x557d3283fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3283fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 -- 172.21.15.92:0/534180098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 msgr2=0x557d328647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d328647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 -- 172.21.15.92:0/534180098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d32865050 con 0x557d328465a0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3d7fff700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004b10 tx=0x7fa3d001f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89222ae59fd62f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0035020 con 0x557d328465a0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fa3d001fb20 con 0x557d328465a0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.843+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d000c040 con 0x557d328465a0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3d0018070 con 0x557d328465a0 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 10 client.15051 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:22.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557d328c5e20 con 0x557d328465a0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3d000c040 con 0x557d328465a0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fa3d0012710 con 0x557d328465a0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 10 client.15051 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 10 client.15051 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 20 client.15051 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d328ca5b0 0x557d328c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 4 client.15051 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "status"}) -- 0x557d32796260 con 0x557d328ca5b0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.844+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d328ca5b0 0x557d328c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3d77fe700 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d328ca5b0 0x557d328c92c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=459f380199b042f2 server_cookie=727059a0125885e1 in_seq=0 out_seq=0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3b6ffd700 10 client.15051 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3b6ffd700 1 -- 172.21.15.92:0/534180098 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557d32796260 con 0x557d328ca5b0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3b6ffd700 10 client.15051 handle_command_reply: tid=0 2024-04-26T17:59:22.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 client.15051 shutdown 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 msgr2=0x557d3283d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0004b10 tx=0x7fa3d001f430 comp rx=0 tx=0).stop 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 shutdown_connections 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x557d328ca5b0 0x557d328c92c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557d328465a0 0x557d3283d150 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557d32840780 0x557d3283fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 --2- 172.21.15.92:0/534180098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557d32845c80 0x557d328647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 >> 172.21.15.92:0/534180098 conn(0x557d3276a570 msgr2=0x557d32858d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3b6ffd700 0 client.15051 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 shutdown_connections 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.845+0000 7fa3e8537b80 1 -- 172.21.15.92:0/534180098 wait complete. 2024-04-26T17:59:22.850 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3e8537b80 20 client.15051 trim_cache size 0 max 16384 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24406, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 164.12462708499999, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:59:22.851 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 205.416873039 2024-04-26T17:59:22.852 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 msgr2=0x7fa3c00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 0x7fa3c00a6100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8005fd0 tx=0x7fa3c8005e30 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 msgr2=0x7fa3d819af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009f50 tx=0x7fa3cc0037c0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 shutdown_connections 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fa3c00a3c40 0x7fa3c00a6100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa3d8102d80 0x7fa3d819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa3d81076a0 0x7fa3d81a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 --2- 172.21.15.92:0/1120605948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3d8103730 0x7fa3d819af10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 >> 172.21.15.92:0/1120605948 conn(0x7fa3d8078990 msgr2=0x7fa3d8105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 shutdown_connections 2024-04-26T17:59:22.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:22.846+0000 7fa3ddca5700 1 -- 172.21.15.92:0/1120605948 wait complete. 2024-04-26T17:59:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:22 smithi189 ceph-mon[32756]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:22 smithi156 ceph-mon[32679]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T17:59:23.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T17:59:23.911 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:24 smithi092 ceph-mon[29156]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:24 smithi189 ceph-mon[32756]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:24 smithi156 ceph-mon[32679]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-26T17:59:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 -- 172.21.15.92:0/4262987797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 msgr2=0x7f514c103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 --2- 172.21.15.92:0/4262987797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c103960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f513c009990 tx=0x7f513c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 -- 172.21.15.92:0/4262987797 shutdown_connections 2024-04-26T17:59:25.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 --2- 172.21.15.92:0/4262987797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c109480 0x7f514c109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 --2- 172.21.15.92:0/4262987797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c103ea0 0x7f514c1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 --2- 172.21.15.92:0/4262987797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c103960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 -- 172.21.15.92:0/4262987797 >> 172.21.15.92:0/4262987797 conn(0x7f514c07a5e0 msgr2=0x7f514c07a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 -- 172.21.15.92:0/4262987797 shutdown_connections 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.546+0000 7f5151d90700 1 -- 172.21.15.92:0/4262987797 wait complete. 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.547+0000 7f5151d90700 1 Processor -- start 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.547+0000 7f5151d90700 1 -- start start 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c103ea0 0x7f514c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c109480 0x7f514c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f514c1135c0 con 0x7f514c1034e0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f514c113440 con 0x7f514c103ea0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f514c113740 con 0x7f514c109480 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47574/0 (socket says 172.21.15.92:47574) 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 -- 172.21.15.92:0/3910218393 learned_addr learned my addr 172.21.15.92:0/3910218393 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514affd700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c103ea0 0x7f514c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514bfff700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c109480 0x7f514c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 -- 172.21.15.92:0/3910218393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c109480 msgr2=0x7f514c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c109480 0x7f514c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 -- 172.21.15.92:0/3910218393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c103ea0 msgr2=0x7f514c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c103ea0 0x7f514c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 -- 172.21.15.92:0/3910218393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c19a040 con 0x7f514c1034e0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f514b7fe700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f514000c920 tx=0x7f514000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5148ff9700 1 -- 172.21.15.92:0/3910218393 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140007b00 con 0x7f514c1034e0 2024-04-26T17:59:25.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514c19a330 con 0x7f514c1034e0 2024-04-26T17:59:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5148ff9700 1 -- 172.21.15.92:0/3910218393 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5140004ce0 con 0x7f514c1034e0 2024-04-26T17:59:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.548+0000 7f5148ff9700 1 -- 172.21.15.92:0/3910218393 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5140005500 con 0x7f514c1034e0 2024-04-26T17:59:25.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.549+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f514c1a65f0 con 0x7f514c1034e0 2024-04-26T17:59:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.551+0000 7f5148ff9700 1 -- 172.21.15.92:0/3910218393 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f5140007ca0 con 0x7f514c1034e0 2024-04-26T17:59:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.551+0000 7f5148ff9700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 0x7f51340a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f514affd700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 0x7f51340a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f5148ff9700 1 -- 172.21.15.92:0/3910218393 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f51400cff10 con 0x7f514c1034e0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f514affd700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 0x7f51340a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b5c0 tx=0x7f513c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 Processor -- start 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 -- start start 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c13e6f0 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c0dd590 con 0x55bc0c1f1ad0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.552+0000 7f515c622b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c13a6b0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47588/0 (socket says 172.21.15.92:47588) 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 -- 172.21.15.92:0/522418972 learned_addr learned my addr 172.21.15.92:0/522418972 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:25.555 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514b7fe700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514affd700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 -- 172.21.15.92:0/522418972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f23f0 msgr2=0x55bc0c1ebcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1ebcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 -- 172.21.15.92:0/522418972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 msgr2=0x55bc0c1f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 -- 172.21.15.92:0/522418972 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c08b880 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514b7fe700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f514bfff700 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5144009dc0 tx=0x7f51440077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcda969e726f40f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f5131ffb700 1 -- 172.21.15.92:0/522418972 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144014610 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f5131ffb700 1 -- 172.21.15.92:0/522418972 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5144019070 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.553+0000 7f5131ffb700 1 -- 172.21.15.92:0/522418972 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51440138d0 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- 172.21.15.92:0/522418972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 msgr2=0x55bc0c1ec710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5144009dc0 tx=0x7f51440077e0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- 172.21.15.92:0/522418972 shutdown_connections 2024-04-26T17:59:25.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ec710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 --2- 172.21.15.92:0/522418972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1ebcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- 172.21.15.92:0/522418972 >> 172.21.15.92:0/522418972 conn(0x55bc0c118cf0 msgr2=0x55bc0c1e71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- 172.21.15.92:0/522418972 shutdown_connections 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- 172.21.15.92:0/522418972 wait complete. 2024-04-26T17:59:25.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.554+0000 7f515c622b80 1 -- start start 2024-04-26T17:59:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 Processor -- start 2024-04-26T17:59:25.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c1f8f10 con 0x55bc0c1f23f0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c0a4900 con 0x55bc0c1f1ad0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c1f9090 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f515c622b80 10 client.0 _ll_register_callbacks cb 0x55bc0c0d2530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47602/0 (socket says 172.21.15.92:47602) 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 -- 172.21.15.92:0/2989387607 learned_addr learned my addr 172.21.15.92:0/2989387607 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514affd700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 -- 172.21.15.92:0/2989387607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 msgr2=0x55bc0c1f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 -- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 msgr2=0x55bc0c1f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514bfff700 1 -- 172.21.15.92:0/2989387607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0c1f60d0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.555+0000 7f514affd700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f514bfff700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51440090b0 tx=0x7f5144013da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1263a4ae4e13bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144026470 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f5144026610 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5144019070 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5144026810 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 10 client.15063 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc0c203a20 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5144019070 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f5144005410 con 0x55bc0c1f23f0 2024-04-26T17:59:25.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 10 client.15063 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 20 client.15063 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c205cb0 0x55bc0c207120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 4 client.15063 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.556+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc0c14c0d0 con 0x55bc0c205cb0 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.557+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c205cb0 0x55bc0c207120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.557+0000 7f512affd700 10 client.15063 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.557+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c205cb0 0x55bc0c207120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=333fc6b0731c7863 server_cookie=5e0d78e694c48ed9 in_seq=0 out_seq=0 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f512affd700 1 -- 172.21.15.92:0/2989387607 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bc0c14c0d0 con 0x55bc0c205cb0 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f512affd700 10 client.15063 handle_command_reply: tid=0 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 client.15063 shutdown 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 msgr2=0x55bc0c1f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51440090b0 tx=0x7f5144013da0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.563 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 shutdown_connections 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c205cb0 0x55bc0c207120 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f5a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1f81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 --2- 172.21.15.92:0/2989387607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 >> 172.21.15.92:0/2989387607 conn(0x55bc0c118cf0 msgr2=0x55bc0c1e6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.558+0000 7f512affd700 0 client.15063 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.559+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 shutdown_connections 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.559+0000 7f515c622b80 1 -- 172.21.15.92:0/2989387607 wait complete. 2024-04-26T17:59:25.564 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.559+0000 7f515c622b80 20 client.15063 trim_cache size 0 max 16384 2024-04-26T17:59:25.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 Processor -- start 2024-04-26T17:59:25.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 -- start start 2024-04-26T17:59:25.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c205460 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c205b30 con 0x55bc0c1f23f0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.579+0000 7f515c622b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c206200 con 0x55bc0c1f1ad0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47618/0 (socket says 172.21.15.92:47618) 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 -- 172.21.15.92:0/804447075 learned_addr learned my addr 172.21.15.92:0/804447075 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514bfff700 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514affd700 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 -- 172.21.15.92:0/804447075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f1ad0 msgr2=0x55bc0c1f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 -- 172.21.15.92:0/804447075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f23f0 msgr2=0x55bc0c1f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 -- 172.21.15.92:0/804447075 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0c208080 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f514b7fe700 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f514009bef0 tx=0x7f51400cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66813b17c2d54b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f51317fa700 1 -- 172.21.15.92:0/804447075 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514001d040 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f51317fa700 1 -- 172.21.15.92:0/804447075 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51400a4e60 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.580+0000 7f51317fa700 1 -- 172.21.15.92:0/804447075 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514009c450 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- 172.21.15.92:0/804447075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 msgr2=0x55bc0c1ebcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f514009bef0 tx=0x7f51400cf040 comp rx=0 tx=0).stop 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- 172.21.15.92:0/804447075 shutdown_connections 2024-04-26T17:59:25.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f23f0 0x55bc0c1f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c1ebcb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 --2- 172.21.15.92:0/804447075 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c1f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- 172.21.15.92:0/804447075 >> 172.21.15.92:0/804447075 conn(0x55bc0c118cf0 msgr2=0x55bc0c1ef550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- 172.21.15.92:0/804447075 shutdown_connections 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- 172.21.15.92:0/804447075 wait complete. 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.581+0000 7f515c622b80 1 -- start start 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 Processor -- start 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c210980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c20f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c206fa0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c2068d0 con 0x55bc0c1f1ad0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bc0c207670 con 0x55bc0c1ec2d0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f515c622b80 10 client.0 _ll_register_callbacks cb 0x55bc0c0d2530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47622/0 (socket says 172.21.15.92:47622) 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 -- 172.21.15.92:0/2110049821 learned_addr learned my addr 172.21.15.92:0/2110049821 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c210980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514affd700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c20f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 -- 172.21.15.92:0/2110049821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 msgr2=0x55bc0c210980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c210980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 -- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 msgr2=0x55bc0c20f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c20f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 -- 172.21.15.92:0/2110049821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0c210360 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f514bfff700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5144009690 tx=0x7f5144007470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff31fac1d7c799fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f512affd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.582+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144026dc0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f5144004ce0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51400a4e60 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5144013ec0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 10 client.15069 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc0c2711f0 con 0x55bc0c1f23f0 2024-04-26T17:59:25.591 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51400a4e60 con 0x55bc0c1f23f0 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f5144039020 con 0x55bc0c1f23f0 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 10 client.15069 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 20 client.15069 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c275ca0 0x55bc0c2749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 4 client.15069 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "status"}) -- 0x55bc0c146170 con 0x55bc0c275ca0 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.583+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c275ca0 0x55bc0c2749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:25.592 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f512affd700 10 client.15069 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f514b7fe700 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c275ca0 0x55bc0c2749b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d257334cec78a381 server_cookie=1c481a7392616032 in_seq=0 out_seq=0 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f512affd700 1 -- 172.21.15.92:0/2110049821 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bc0c146170 con 0x55bc0c275ca0 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f512affd700 10 client.15069 handle_command_reply: tid=0 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 client.15069 shutdown 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 msgr2=0x55bc0c20fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5144009690 tx=0x7f5144007470 comp rx=0 tx=0).stop 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 shutdown_connections 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x55bc0c275ca0 0x55bc0c2749b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bc0c1f23f0 0x55bc0c20fad0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bc0c1ec2d0 0x55bc0c210980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 --2- 172.21.15.92:0/2110049821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bc0c1f1ad0 0x55bc0c20f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 >> 172.21.15.92:0/2110049821 conn(0x55bc0c118cf0 msgr2=0x55bc0c1f3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f512affd700 0 client.15069 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 shutdown_connections 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 1 -- 172.21.15.92:0/2110049821 wait complete. 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.584+0000 7f515c622b80 20 client.15069 trim_cache size 0 max 16384 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:59:25.594 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24419, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 167.87381785599999, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 210.97679719600001 2024-04-26T17:59:25.595 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:59:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 msgr2=0x7f51340a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 0x7f51340a6100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b5c0 tx=0x7f513c005960 comp rx=0 tx=0).stop 2024-04-26T17:59:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 msgr2=0x7f514c19f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:25.596 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f514000c920 tx=0x7f514000cc30 comp rx=0 tx=0).stop 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 shutdown_connections 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f51340a3c40 0x7f51340a6100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f514c109480 0x7f514c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f514c1034e0 0x7f514c19f720 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 --2- 172.21.15.92:0/3910218393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f514c103ea0 0x7f514c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 >> 172.21.15.92:0/3910218393 conn(0x7f514c07a5e0 msgr2=0x7f514c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 shutdown_connections 2024-04-26T17:59:25.597 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:25.585+0000 7f5151d90700 1 -- 172.21.15.92:0/3910218393 wait complete. 2024-04-26T17:59:26.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T17:59:26.585 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:26 smithi092 ceph-mon[29156]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:26 smithi189 ceph-mon[32756]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:26 smithi156 ceph-mon[32679]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-26T17:59:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:27 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:27 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:28.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:27 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 -- 172.21.15.92:0/1110753498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 msgr2=0x7f7b60109870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 --2- 172.21.15.92:0/1110753498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60109870 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800b0a0 tx=0x7f7b5800b3b0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 -- 172.21.15.92:0/1110753498 shutdown_connections 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 --2- 172.21.15.92:0/1110753498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006c360 0x7f7b601102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 --2- 172.21.15.92:0/1110753498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60109870 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 --2- 172.21.15.92:0/1110753498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006b9c0 0x7f7b6006be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 -- 172.21.15.92:0/1110753498 >> 172.21.15.92:0/1110753498 conn(0x7f7b60079290 msgr2=0x7f7b600796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 -- 172.21.15.92:0/1110753498 shutdown_connections 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.325+0000 7f7b66240700 1 -- 172.21.15.92:0/1110753498 wait complete. 2024-04-26T17:59:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 Processor -- start 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 -- start start 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 0x7f7b601023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 0x7f7b60102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60113580 con 0x7f7b60109490 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.326+0000 7f7b66240700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60113400 con 0x7f7b6006c360 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b66240700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7b60113700 con 0x7f7b6006b9c0 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47636/0 (socket says 172.21.15.92:47636) 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 -- 172.21.15.92:0/910300395 learned_addr learned my addr 172.21.15.92:0/910300395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5effd700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 0x7f7b60102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 0x7f7b601023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 -- 172.21.15.92:0/910300395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 msgr2=0x7f7b601023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 0x7f7b601023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 -- 172.21.15.92:0/910300395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 msgr2=0x7f7b60102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 0x7f7b60102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 -- 172.21.15.92:0/910300395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b601a8000 con 0x7f7b60109490 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 0x7f7b601023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5effd700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 0x7f7b60102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000e940 tx=0x7f7b5000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5cff9700 1 -- 172.21.15.92:0/910300395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b50004a30 con 0x7f7b60109490 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b601a82f0 con 0x7f7b60109490 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5cff9700 1 -- 172.21.15.92:0/910300395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b500054d0 con 0x7f7b60109490 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.327+0000 7f7b5cff9700 1 -- 172.21.15.92:0/910300395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000ccf0 con 0x7f7b60109490 2024-04-26T17:59:28.332 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.328+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b601a8830 con 0x7f7b60109490 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.330+0000 7f7b5cff9700 1 -- 172.21.15.92:0/910300395 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7f7b50021440 con 0x7f7b60109490 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.331+0000 7f7b5cff9700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 0x7f7b480a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.331+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 0x7f7b480a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.331+0000 7f7b5cff9700 1 -- 172.21.15.92:0/910300395 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7b500d04a0 con 0x7f7b60109490 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.331+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 0x7f7b480a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009fd0 tx=0x7f7b5800b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 Processor -- start 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 -- start start 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009c4ad0 0x5579009c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 0x5579009becb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 0x5579009bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579009116f0 con 0x5579009bf2d0 2024-04-26T17:59:28.337 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5579008b0590 con 0x5579009c53f0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55790090d6b0 con 0x5579009c4ad0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 0x5579009bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 0x5579009bf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47644/0 (socket says 172.21.15.92:47644) 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b5ffff700 1 -- 172.21.15.92:0/2032150369 learned_addr learned my addr 172.21.15.92:0/2032150369 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b5effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 0x5579009becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.332+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009c4ad0 0x5579009c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 -- 172.21.15.92:0/2032150369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009c4ad0 msgr2=0x5579009c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009c4ad0 0x5579009c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 -- 172.21.15.92:0/2032150369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 msgr2=0x5579009bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 0x5579009bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 -- 172.21.15.92:0/2032150369 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55790085e880 con 0x5579009c53f0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b5effd700 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 0x5579009becb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b60103e70 tx=0x7f7b540106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150e87fd85ca5f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b45ffb700 1 -- 172.21.15.92:0/2032150369 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54004830 con 0x5579009c53f0 2024-04-26T17:59:28.338 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b45ffb700 1 -- 172.21.15.92:0/2032150369 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b54005020 con 0x5579009c53f0 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.333+0000 7f7b45ffb700 1 -- 172.21.15.92:0/2032150369 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5401a6e0 con 0x5579009c53f0 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/2032150369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 msgr2=0x5579009becb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 0x5579009becb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b60103e70 tx=0x7f7b540106b0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/2032150369 shutdown_connections 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009bf2d0 0x5579009bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009c4ad0 0x5579009c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/2032150369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c53f0 0x5579009becb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/2032150369 >> 172.21.15.92:0/2032150369 conn(0x5579008ebcf0 msgr2=0x5579009ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/2032150369 shutdown_connections 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/2032150369 wait complete. 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 -- start start 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.334+0000 7f7b70ad2b80 1 Processor -- start 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579009cbf10 con 0x5579009c53f0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557900877900 con 0x5579009c4ad0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579009cc090 con 0x5579009bf2d0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b70ad2b80 10 client.0 _ll_register_callbacks cb 0x5579008a5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47658/0 (socket says 172.21.15.92:47658) 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1730420897 learned_addr learned my addr 172.21.15.92:0/1730420897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5effd700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1730420897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 msgr2=0x5579009cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 msgr2=0x5579009c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1730420897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579009c9300 con 0x5579009c53f0 2024-04-26T17:59:28.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5effd700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009fd0 tx=0x7f7b500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8b4d96d2fb1fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.335+0000 7f7b3effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b500d00e0 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7b500d0280 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b54005020 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b50005000 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 10 client.15081 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5579009d6a80 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b54005020 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f7b50099040 con 0x5579009c53f0 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 10 client.15081 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 10 client.15081 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 20 client.15081 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:28.341 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x5579009da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 4 client.15081 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.336+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55790091f0d0 con 0x5579009d9100 2024-04-26T17:59:28.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.337+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x5579009da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.337+0000 7f7b3effd700 10 client.15081 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.337+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x5579009da570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f26cb5923459fd01 server_cookie=f41532ade7137ccd in_seq=0 out_seq=0 2024-04-26T17:59:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b3effd700 1 -- 172.21.15.92:0/1730420897 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55790091f0d0 con 0x5579009d9100 2024-04-26T17:59:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b3effd700 10 client.15081 handle_command_reply: tid=0 2024-04-26T17:59:28.343 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 client.15081 shutdown 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 msgr2=0x5579009c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7b50009fd0 tx=0x7f7b500057f0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 shutdown_connections 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x5579009da570 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b3effd700 0 client.15081 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009c8ac0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1730420897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 >> 172.21.15.92:0/1730420897 conn(0x5579008ebcf0 msgr2=0x5579009b9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 shutdown_connections 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1730420897 wait complete. 2024-04-26T17:59:28.344 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.338+0000 7f7b70ad2b80 20 client.15081 trim_cache size 0 max 16384 2024-04-26T17:59:28.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 Processor -- start 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 -- start start 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009d5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579009d88b0 con 0x5579009c53f0 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5579009d8f80 con 0x5579009c4ad0 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579009d9650 con 0x5579009bf2d0 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47664/0 (socket says 172.21.15.92:47664) 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.380+0000 7f7b5ffff700 1 -- 172.21.15.92:0/3982830944 learned_addr learned my addr 172.21.15.92:0/3982830944 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5effd700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 -- 172.21.15.92:0/3982830944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 msgr2=0x5579009d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 -- 172.21.15.92:0/3982830944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 msgr2=0x5579009cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 -- 172.21.15.92:0/3982830944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579009c9570 con 0x5579009c53f0 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5effd700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7b50099be0 tx=0x7f7b500a5610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3196d6f485c75a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b457fa700 1 -- 172.21.15.92:0/3982830944 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b500051a0 con 0x5579009c53f0 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b457fa700 1 -- 172.21.15.92:0/3982830944 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b50067070 con 0x5579009c53f0 2024-04-26T17:59:28.383 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.381+0000 7f7b457fa700 1 -- 172.21.15.92:0/3982830944 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b500bb9e0 con 0x5579009c53f0 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/3982830944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 msgr2=0x5579009cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7b50099be0 tx=0x7f7b500a5610 comp rx=0 tx=0).stop 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/3982830944 shutdown_connections 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cb300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/3982830944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/3982830944 >> 172.21.15.92:0/3982830944 conn(0x5579008ebcf0 msgr2=0x5579009d7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/3982830944 shutdown_connections 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/3982830944 wait complete. 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.382+0000 7f7b70ad2b80 1 -- start start 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 Processor -- start 2024-04-26T17:59:28.387 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009ca390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579009da3f0 con 0x5579009c53f0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5579009d9d20 con 0x5579009c4ad0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5579009daac0 con 0x5579009bf2d0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b70ad2b80 10 client.0 _ll_register_callbacks cb 0x5579008a5530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47666/0 (socket says 172.21.15.92:47666) 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1108703606 learned_addr learned my addr 172.21.15.92:0/1108703606 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5effd700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1108703606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 msgr2=0x5579009ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 msgr2=0x5579009ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:28.388 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 -- 172.21.15.92:0/1108703606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579009e1d60 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b5ffff700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b500bd010 tx=0x7f7b500053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfe04787db9b2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b3effd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.383+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b500bbbe0 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f7b500994d0 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b50067070 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7b500996d0 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 10 client.15087 fetch_fsmap learned FSMap version 25 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5579009e1d60 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b50067070 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f7b50099040 con 0x5579009c53f0 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 25 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 10 client.15087 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 20 client.15087 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:28.389 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x557900a43650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 4 client.15087 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.384+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "status"}) -- 0x557900919170 con 0x5579009d9100 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x557900a43650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b5f7fe700 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x557900a43650 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=122aed12b7b994c8 server_cookie=6ac73a1550513ed7 in_seq=0 out_seq=0 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b3effd700 10 client.15087 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b3effd700 1 -- 172.21.15.92:0/1108703606 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557900919170 con 0x5579009d9100 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b3effd700 10 client.15087 handle_command_reply: tid=0 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b70ad2b80 1 client.15087 shutdown 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 msgr2=0x5579009cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b500bd010 tx=0x7f7b500053d0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 shutdown_connections 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.385+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5579009d9100 0x557900a43650 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579009c53f0 0x5579009cae10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b3effd700 0 client.15087 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:28.390 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5579009bf2d0 0x5579009ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 --2- 172.21.15.92:0/1108703606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5579009c4ad0 0x5579009ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 >> 172.21.15.92:0/1108703606 conn(0x5579008ebcf0 msgr2=0x5579009c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 shutdown_connections 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 1 -- 172.21.15.92:0/1108703606 wait complete. 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b70ad2b80 20 client.15087 trim_cache size 0 max 16384 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24437, 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T17:59:28.391 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 184.89070210200001, 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 25, 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 90, 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 88, 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 200.304864993 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T17:59:28.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 msgr2=0x7f7b480a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 0x7f7b480a6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009fd0 tx=0x7f7b5800b700 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 msgr2=0x7f7b60102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000e940 tx=0x7f7b5000ec50 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 shutdown_connections 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f7b480a3c40 0x7f7b480a6100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b60109490 0x7f7b60102e60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7b6006b9c0 0x7f7b601023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 --2- 172.21.15.92:0/910300395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b6006c360 0x7f7b60102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.386+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 >> 172.21.15.92:0/910300395 conn(0x7f7b60079290 msgr2=0x7f7b601004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.387+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 shutdown_connections 2024-04-26T17:59:28.393 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:28.387+0000 7f7b66240700 1 -- 172.21.15.92:0/910300395 wait complete. 2024-04-26T17:59:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:28 smithi092 ceph-mon[29156]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:28 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.081 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T17:59:29.091 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T17:59:29.091 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T17:59:29.091 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T17:59:29.091 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-26T17:59:29.092 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T17:59:29.092 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:29.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-26T17:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:28 smithi189 ceph-mon[32756]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:28 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:28 smithi156 ceph-mon[32679]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T17:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:28 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 -- 172.21.15.92:0/845312966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78101280 msgr2=0x7fac781016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 --2- 172.21.15.92:0/845312966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78101280 0x7fac781016a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac68009900 tx=0x7fac6802a480 comp rx=0 tx=0).stop 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 -- 172.21.15.92:0/845312966 shutdown_connections 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 --2- 172.21.15.92:0/845312966 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78102580 0x7fac78102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 --2- 172.21.15.92:0/845312966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 0x7fac78102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 --2- 172.21.15.92:0/845312966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78101280 0x7fac781016a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 -- 172.21.15.92:0/845312966 >> 172.21.15.92:0/845312966 conn(0x7fac780fce00 msgr2=0x7fac780ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:29.199 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 -- 172.21.15.92:0/845312966 shutdown_connections 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 -- 172.21.15.92:0/845312966 wait complete. 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.197+0000 7fac7d704640 1 Processor -- start 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 -- start start 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78101280 0x7fac7819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 0x7fac7819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac781106b0 con 0x7fac78102580 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fac78110530 con 0x7fac78101be0 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac7d704640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fac78110830 con 0x7fac78101280 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47686/0 (socket says 172.21.15.92:47686) 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 -- 172.21.15.92:0/3786557422 learned_addr learned my addr 172.21.15.92:0/3786557422 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:29.200 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac767fc640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 0x7fac7819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac76ffd640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78101280 0x7fac7819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 -- 172.21.15.92:0/3786557422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78101280 msgr2=0x7fac7819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78101280 0x7fac7819ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 -- 172.21.15.92:0/3786557422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 msgr2=0x7fac7819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 0x7fac7819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 -- 172.21.15.92:0/3786557422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781a2970 con 0x7fac78102580 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.198+0000 7fac777fe640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac7000eaa0 tx=0x7fac7000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.199+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7000cdb0 con 0x7fac78102580 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.199+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781a2c60 con 0x7fac78102580 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.199+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac70005020 con 0x7fac78102580 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.199+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac700116d0 con 0x7fac78102580 2024-04-26T17:59:29.201 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.199+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781a3160 con 0x7fac78102580 2024-04-26T17:59:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.200+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7810bfd0 con 0x7fac78102580 2024-04-26T17:59:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.201+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 18) ==== 138646+0+0 (secure 0 0 0) 0x7fac700051d0 con 0x7fac78102580 2024-04-26T17:59:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.202+0000 7fac5ffff640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 0x7fac600a6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.202+0000 7fac76ffd640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 0x7fac600a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:29.202 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.202+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fac700d0850 con 0x7fac78102580 2024-04-26T17:59:29.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.203+0000 7fac76ffd640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 0x7fac600a6110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fac68000c00 tx=0x7fac680314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:29.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.207+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fac70016030 con 0x7fac78102580 2024-04-26T17:59:29.442 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:29.442+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fac7802dd20 con 0x7fac78102580 2024-04-26T17:59:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:29 smithi092 ceph-mon[29156]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:29 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T17:59:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:29 smithi189 ceph-mon[32756]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:29 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T17:59:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:29 smithi156 ceph-mon[32679]: from='mgr.14152 172.21.15.92:0/2948236175' entity='mgr.x' 2024-04-26T17:59:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:29 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-26T17:59:30.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.272+0000 7fac5ffff640 1 -- 172.21.15.92:0/3786557422 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fac7009cc60 con 0x7fac78102580 2024-04-26T17:59:30.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 msgr2=0x7fac600a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 0x7fac600a6110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fac68000c00 tx=0x7fac680314a0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 msgr2=0x7fac781a2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fac7000eaa0 tx=0x7fac7000ef60 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 shutdown_connections 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fac600a3c50 0x7fac600a6110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78102580 0x7fac781a2300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac78101be0 0x7fac7819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 --2- 172.21.15.92:0/3786557422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fac78101280 0x7fac7819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 >> 172.21.15.92:0/3786557422 conn(0x7fac780fce00 msgr2=0x7fac780fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 shutdown_connections 2024-04-26T17:59:30.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.277+0000 7fac7d704640 1 -- 172.21.15.92:0/3786557422 wait complete. 2024-04-26T17:59:30.296 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 -- 172.21.15.92:0/3824975951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10102a80 msgr2=0x7f3b10102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 --2- 172.21.15.92:0/3824975951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10102a80 0x7f3b10102f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009900 tx=0x7f3af802a410 comp rx=0 tx=0).stop 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 -- 172.21.15.92:0/3824975951 shutdown_connections 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 --2- 172.21.15.92:0/3824975951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10103440 0x7f3b10109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 --2- 172.21.15.92:0/3824975951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10102a80 0x7f3b10102f00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 --2- 172.21.15.92:0/3824975951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 0x7f3b10101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.418+0000 7f3b16fda640 1 -- 172.21.15.92:0/3824975951 >> 172.21.15.92:0/3824975951 conn(0x7f3b100fce00 msgr2=0x7f3b100ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:30.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- 172.21.15.92:0/3824975951 shutdown_connections 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- 172.21.15.92:0/3824975951 wait complete. 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 Processor -- start 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- start start 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 0x7f3b10197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 0x7f3b10197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1010d3a0 con 0x7f3b10103440 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1010d220 con 0x7f3b10102a80 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b16fda640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1010d520 con 0x7f3b10101890 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b15577640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b15577640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47714/0 (socket says 172.21.15.92:47714) 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b15577640 1 -- 172.21.15.92:0/2113023054 learned_addr learned my addr 172.21.15.92:0/2113023054 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:30.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b0ffff640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 0x7f3b10197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.419+0000 7f3b14d76640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 0x7f3b10197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 -- 172.21.15.92:0/2113023054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 msgr2=0x7f3b10197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 0x7f3b10197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 -- 172.21.15.92:0/2113023054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 msgr2=0x7f3b10197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 0x7f3b10197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 -- 172.21.15.92:0/2113023054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1019f660 con 0x7f3b10103440 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b0ffff640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 0x7f3b10197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b15577640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e970 tx=0x7f3b0000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000ccc0 con 0x7f3b10103440 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0000ce60 con 0x7f3b10103440 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1019f950 con 0x7f3b10103440 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b00010430 con 0x7f3b10103440 2024-04-26T17:59:30.423 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.420+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1019fe20 con 0x7f3b10103440 2024-04-26T17:59:30.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.421+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b10108c00 con 0x7f3b10103440 2024-04-26T17:59:30.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.422+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f3b00004ff0 con 0x7f3b10103440 2024-04-26T17:59:30.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.423+0000 7f3b0dffb640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 0x7f3afc0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.423+0000 7f3b14d76640 1 -- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 msgr2=0x7f3afc0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:30.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.423+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f3b000d07d0 con 0x7f3b10103440 2024-04-26T17:59:30.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.423+0000 7f3b14d76640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 0x7f3afc0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:59:30.428 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.428+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3b0009d230 con 0x7f3b10103440 2024-04-26T17:59:30.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.611+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f3b10063530 con 0x7f3b10103440 2024-04-26T17:59:30.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.615+0000 7f3b0dffb640 1 -- 172.21.15.92:0/2113023054 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f3b0009cb30 con 0x7f3b10103440 2024-04-26T17:59:30.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 msgr2=0x7f3afc0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:59:30.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 0x7f3afc0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 msgr2=0x7f3b1019eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000e970 tx=0x7f3b0000ed70 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 shutdown_connections 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f3afc0a3ca0 0x7f3afc0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b10103440 0x7f3b1019eff0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b10102a80 0x7f3b10197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 --2- 172.21.15.92:0/2113023054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b10101890 0x7f3b10197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 >> 172.21.15.92:0/2113023054 conn(0x7f3b100fce00 msgr2=0x7f3b10105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 shutdown_connections 2024-04-26T17:59:30.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.617+0000 7f3b16fda640 1 -- 172.21.15.92:0/2113023054 wait complete. 2024-04-26T17:59:30.627 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setuser ceph since I am not root 2024-04-26T17:59:30.627 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: ignoring --setgroup ceph since I am not root 2024-04-26T17:59:30.627 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:30.477+0000 7f25ee46d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:59:30.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-26T17:59:30.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: ignoring --setuser ceph since I am not root 2024-04-26T17:59:30.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: ignoring --setgroup ceph since I am not root 2024-04-26T17:59:30.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-mgr[34627]: -- 172.21.15.189:0/3115016132 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f56b1245a0 con 0x55f56b0f8800 2024-04-26T17:59:30.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:30.458+0000 7f79b51b0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:59:30.642 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: ignoring --setuser ceph since I am not root 2024-04-26T17:59:30.642 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: ignoring --setgroup ceph since I am not root 2024-04-26T17:59:30.642 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-mgr[34075]: -- 172.21.15.156:0/1117467761 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e6077445a0 con 0x55e607718800 2024-04-26T17:59:30.642 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:30.456+0000 7f0df99d1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:59:30.642 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:30.641+0000 7f0df99d1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:30.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 -- 172.21.15.92:0/2568982666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4103440 msgr2=0x7f74a4109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 --2- 172.21.15.92:0/2568982666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4103440 0x7f74a4109cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f749c009ca0 tx=0x7f749c02a8c0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 -- 172.21.15.92:0/2568982666 shutdown_connections 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 --2- 172.21.15.92:0/2568982666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4103440 0x7f74a4109cd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 --2- 172.21.15.92:0/2568982666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4102a80 0x7f74a4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 --2- 172.21.15.92:0/2568982666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4101890 0x7f74a4101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 -- 172.21.15.92:0/2568982666 >> 172.21.15.92:0/2568982666 conn(0x7f74a40fce00 msgr2=0x7f74a40ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 -- 172.21.15.92:0/2568982666 shutdown_connections 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.728+0000 7f74aabf9640 1 -- 172.21.15.92:0/2568982666 wait complete. 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 Processor -- start 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 -- start start 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4101890 0x7f74a406ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.731 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4103440 0x7f74a419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410d3c0 con 0x7f74a4102a80 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410d240 con 0x7f74a4103440 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410d540 con 0x7f74a4101890 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47742/0 (socket says 172.21.15.92:47742) 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 -- 172.21.15.92:0/1170753951 learned_addr learned my addr 172.21.15.92:0/1170753951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a8995640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4101890 0x7f74a406ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a9196640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4103440 0x7f74a419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 -- 172.21.15.92:0/1170753951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4101890 msgr2=0x7f74a406ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4101890 0x7f74a406ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 -- 172.21.15.92:0/1170753951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4103440 msgr2=0x7f74a419fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4103440 0x7f74a419fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 -- 172.21.15.92:0/1170753951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a41a0780 con 0x7f74a4102a80 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a3fff640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f749000e9f0 tx=0x7f749000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749000cd80 con 0x7f74a4102a80 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74900054d0 con 0x7f74a4102a80 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.729+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a41a0a10 con 0x7f74a4102a80 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.730+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490010690 con 0x7f74a4102a80 2024-04-26T17:59:30.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.730+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a41a0f60 con 0x7f74a4102a80 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.731+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a4108bb0 con 0x7f74a4102a80 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.732+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f7490004e30 con 0x7f74a4102a80 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.732+0000 7f74a1ffb640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 0x7f74940a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.732+0000 7f74a8995640 1 -- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 msgr2=0x7f74940a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.733+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f74900d0900 con 0x7f74a4102a80 2024-04-26T17:59:30.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.733+0000 7f74a8995640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 0x7f74940a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:59:30.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.736+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7490053ff0 con 0x7f74a4102a80 2024-04-26T17:59:30.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.919+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f74a40635a0 con 0x7f74a4102a80 2024-04-26T17:59:30.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.923+0000 7f74a1ffb640 1 -- 172.21.15.92:0/1170753951 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f749009d380 con 0x7f74a4102a80 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 msgr2=0x7f74940a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 0x7f74940a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 msgr2=0x7f74a419d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f749000e9f0 tx=0x7f749000edf0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 shutdown_connections 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f74940a3d20 0x7f74940a61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74a4103440 0x7f74a419fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74a4102a80 0x7f74a419d850 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.926 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 --2- 172.21.15.92:0/1170753951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f74a4101890 0x7f74a406ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:30.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 >> 172.21.15.92:0/1170753951 conn(0x7f74a40fce00 msgr2=0x7f74a4105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:30.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 shutdown_connections 2024-04-26T17:59:30.927 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:30.925+0000 7f74aabf9640 1 -- 172.21.15.92:0/1170753951 wait complete. 2024-04-26T17:59:30.932 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:30.747+0000 7f0df99d1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:59:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-mon[32679]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T17:59:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-mon[32679]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T17:59:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:30 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2113023054' entity='client.admin' 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:30.665+0000 7f25ee46d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:30.774+0000 7f25ee46d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-mon[29156]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-mon[29156]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T17:59:30.936 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:30 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2113023054' entity='client.admin' 2024-04-26T17:59:30.937 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T17:59:30.961 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T17:59:30.961 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T17:59:30.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:30.962 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-04-26T17:59:30.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:30.978 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2024-04-26T17:59:31.044 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2024-04-26T17:59:31.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:59:31.046 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-04-26T17:59:31.046 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T17:59:31.046 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-04-26T17:59:31.046 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-04-26T17:59:31.046 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-26T17:59:31.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-mon[32756]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-04-26T17:59:31.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3786557422' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-26T17:59:31.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-mon[32756]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-04-26T17:59:31.053 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2113023054' entity='client.admin' 2024-04-26T17:59:31.053 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:30.643+0000 7f79b51b0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:31.054 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:30.746+0000 7f79b51b0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:59:31.054 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:31 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:31.053+0000 7f79b51b0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:59:31.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:31.094+0000 7f25ee46d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:59:31.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:31.184+0000 7f25ee46d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:59:31.335 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:31.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:31 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:31.138+0000 7f79b51b0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:59:31.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:31.060+0000 7f0df99d1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:59:31.433 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:31.144+0000 7f0df99d1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:59:32.130 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:31 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1170753951' entity='client.admin' 2024-04-26T17:59:32.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:31 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1170753951' entity='client.admin' 2024-04-26T17:59:32.311 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:31 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1170753951' entity='client.admin' 2024-04-26T17:59:32.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:32 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:32.311+0000 7f79b51b0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:59:32.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:32 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:32.480+0000 7f79b51b0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:32.675 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:32 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:32.331+0000 7f0df99d1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:59:32.676 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:32 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:32.503+0000 7f0df99d1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:32.676 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:32 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:32.675+0000 7f0df99d1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:59:32.720 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:32.402+0000 7f25ee46d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:59:32.720 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:32.586+0000 7f25ee46d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:32.937 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:32 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:32.652+0000 7f79b51b0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:59:32.978 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:32.767+0000 7f25ee46d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 -- 172.21.15.92:0/1606173744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f065806bad0 msgr2=0x7f06581102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 --2- 172.21.15.92:0/1606173744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f065806bad0 0x7f06581102e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f065000b0a0 tx=0x7f065000b3b0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 -- 172.21.15.92:0/1606173744 shutdown_connections 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 --2- 172.21.15.92:0/1606173744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f06581094a0 0x7f0658109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 --2- 172.21.15.92:0/1606173744 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f065806bad0 0x7f06581102e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 --2- 172.21.15.92:0/1606173744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806b130 0x7f065806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 -- 172.21.15.92:0/1606173744 >> 172.21.15.92:0/1606173744 conn(0x7f06580792d0 msgr2=0x7f06580796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.978+0000 7f065e317700 1 -- 172.21.15.92:0/1606173744 shutdown_connections 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.979+0000 7f065e317700 1 -- 172.21.15.92:0/1606173744 wait complete. 2024-04-26T17:59:32.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.979+0000 7f065e317700 1 Processor -- start 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.979+0000 7f065e317700 1 -- start start 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f065806b130 0x7f06581023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806bad0 0x7f0658102930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06581135d0 con 0x7f06581094a0 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0658113450 con 0x7f065806b130 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065e317700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0658113750 con 0x7f065806bad0 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47760/0 (socket says 172.21.15.92:47760) 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f0657fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f065806b130 0x7f06581023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 -- 172.21.15.92:0/4816776 learned_addr learned my addr 172.21.15.92:0/4816776 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f06577fe700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806bad0 0x7f0658102930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806bad0 msgr2=0x7f0658102930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:32.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806bad0 0x7f0658102930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f065806b130 msgr2=0x7f06581023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f065806b130 0x7f06581023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 -- 172.21.15.92:0/4816776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06581a7fd0 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.980+0000 7f065c8b4700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f065000b830 tx=0x7f0650004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.981+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650021070 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.981+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06581a8260 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.981+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0650007e30 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.981+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650004700 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.981+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a8710 con 0x7f06581094a0 2024-04-26T17:59:32.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.982+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065806a110 con 0x7f06581094a0 2024-04-26T17:59:32.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.984+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f0650003d70 con 0x7f06581094a0 2024-04-26T17:59:32.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.984+0000 7f06557fa700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 0x7f06400a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:32.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.985+0000 7f0657fff700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 msgr2=0x7f06400a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:32.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.985+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f06500d1370 con 0x7f06581094a0 2024-04-26T17:59:32.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.985+0000 7f0657fff700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 0x7f06400a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:59:32.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:32.988+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f065009de80 con 0x7f06581094a0 2024-04-26T17:59:33.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.186+0000 7f0657fff700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 msgr2=0x7f06400a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:33.186 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.186+0000 7f0657fff700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 0x7f06400a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:59:33.234 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:32 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:32.938+0000 7f79b51b0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:59:33.234 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:33 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:33.030+0000 7f79b51b0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:59:33.239 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.239+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f065802e490 con 0x7f06581094a0 2024-04-26T17:59:33.240 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:33.068+0000 7f25ee46d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:59:33.240 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:33.164+0000 7f25ee46d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:59:33.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.240+0000 7f06557fa700 1 -- 172.21.15.92:0/4816776 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f065009d780 con 0x7f06581094a0 2024-04-26T17:59:33.240 INFO:teuthology.orchestra.run.smithi092.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.242+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 msgr2=0x7f06400a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.242+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 0x7f06400a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.242+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 msgr2=0x7f0658102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.242+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f065000b830 tx=0x7f0650004ce0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 shutdown_connections 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f06400a3c90 0x7f06400a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f065806b130 0x7f06581023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f06581094a0 0x7f0658102e70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 --2- 172.21.15.92:0/4816776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065806bad0 0x7f0658102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:33.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 >> 172.21.15.92:0/4816776 conn(0x7f06580792d0 msgr2=0x7f06581002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:33.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 shutdown_connections 2024-04-26T17:59:33.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:33.243+0000 7f065e317700 1 -- 172.21.15.92:0/4816776 wait complete. 2024-04-26T17:59:33.264 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:32 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:32.964+0000 7f0df99d1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:59:33.264 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:33.057+0000 7f0df99d1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:59:33.264 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:33.263+0000 7f0df99d1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:59:33.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:33.383+0000 7f25ee46d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:59:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:33 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/4816776' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T17:59:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:33 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/4816776' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T17:59:33.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:33 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:33.235+0000 7f79b51b0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:59:33.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:33 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:33.428+0000 7f79b51b0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:33.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:33 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/4816776' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-26T17:59:33.683 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:33.458+0000 7f0df99d1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:33.906 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:33.582+0000 7f25ee46d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T17:59:33.935 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-04-26T17:59:33.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:33.936 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:59:33.952 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f0 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: altname enp7s0f1 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42043sec preferred_lft 42043sec 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::cbcc:f494:f165:35c5/64 scope link noprefixroute 2024-04-26T17:59:33.953 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:59:33.954 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T17:59:33.954 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-04-26T17:59:34.041 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:34.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:34.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:34.139 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T17:59:34.162 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-04-26T17:59:34.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:34.164 DEBUG:teuthology.orchestra.run.smithi092:> route 2024-04-26T17:59:34.234 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2024-04-26T17:59:34.234 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T17:59:34.234 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T17:59:34.234 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T17:59:34.234 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T17:59:34.235 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-04-26T17:59:34.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:34.387 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:34.032+0000 7f79b51b0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:59:34.430 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:34.203+0000 7f25ee46d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:59:34.432 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:34 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:34.061+0000 7f0df99d1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:59:34.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:34.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:34.540 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2024-04-26T17:59:34.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:34.555 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2024-04-26T17:59:34.610 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:59:34.610 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-04-26T17:59:34.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--tmp-cephfs 2024-04-26T17:59:34.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-04-26T17:59:34.610 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-04-26T17:59:34.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:34.706 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:34.651+0000 7f25ee46d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:59:34.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:34.728 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-04-26T17:59:34.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-04-26T17:59:34.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-04-26T17:59:34.729 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-04-26T17:59:34.751 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:34.452+0000 7f79b51b0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:59:34.751 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:34.550+0000 7f79b51b0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:59:34.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:34.782 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:34 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:34.484+0000 7f0df99d1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:59:34.783 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:34 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:34.580+0000 7f0df99d1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:59:34.783 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:34 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:34.782+0000 7f0df99d1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:59:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:34.851 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:59:34.851 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2024-04-26T17:59:34.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2024-04-26T17:59:34.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T17:59:34.852 DEBUG:teuthology.orchestra.run.smithi092:> ') 2024-04-26T17:59:34.899 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:34.921 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:34.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:59:34.927 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /tmp/cephfs 2024-04-26T17:59:34.942 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/tmp/cephfs' 2024-04-26T17:59:34.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:59:34.942 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /tmp/cephfs 2024-04-26T17:59:34.988 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:34.759+0000 7f25ee46d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:59:34.989 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:34.988+0000 7f25ee46d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:59:34.998 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-26T17:59:34.998 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-26T17:59:34.998 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/a702ca5f-ce45-4990-9a25-2c6a38991d13 2024-04-26T17:59:34.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:34.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/a702ca5f-ce45-4990-9a25-2c6a38991d13 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-04-26T17:59:35.096 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-04-26T17:59:35.096 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-26T17:59:35.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:34.751+0000 7f79b51b0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:59:35.211 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-04-26T17:59:35.211 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-04-26T17:59:35.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.92:3300,172.21.15.156:3300,172.21.15.189:3300" 2024-04-26T17:59:35.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with new device syntax: 0@fb3c417a-03f4-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/a702ca5f-ce45-4990-9a25-2c6a38991d13 2024-04-26T17:59:35.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.92:3300/172.21.15.156:3300/172.21.15.189:3300" will pass to kernel 2024-04-26T17:59:35.214 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T17:59:35.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:59:35.215 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /tmp/cephfs 2024-04-26T17:59:35.251 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:59:35.340 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:59:35.342 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:35.348 INFO:teuthology.orchestra.run.smithi092.stdout:client24770 2024-04-26T17:59:35.348 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-26T17:59:35.348 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:59:35.364 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:59:35.452 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:59:35.455 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:35.461 INFO:teuthology.orchestra.run.smithi092.stdout:client24770 2024-04-26T17:59:35.461 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:59:35.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:59:35.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:35.518 INFO:teuthology.orchestra.run.smithi092.stdout:client24770 2024-04-26T17:59:35.518 DEBUG:teuthology.orchestra.run.smithi092:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968.client24770/status') 2024-04-26T17:59:35.569 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:59:35.579 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.24770 (3)172.21.15.92:0/184472292 2024-04-26T17:59:35.579 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2024-04-26T17:59:35.579 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2024-04-26T17:59:35.579 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2024-04-26T17:59:35.579 INFO:teuthology.orchestra.run.smithi092.stderr:70 bytes copied, 2.3731e-05 s, 2.9 MB/s 2024-04-26T17:59:35.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:59:35.587 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T17:59:35.597 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T17:59:35.597 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:35.597 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-26T17:59:35.611 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.276+0000 7f79b51b0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:59:35.611 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.368+0000 7f79b51b0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:59:35.650 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.313+0000 7f0df99d1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:59:35.650 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.406+0000 7f0df99d1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 -- 172.21.15.92:0/693892173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc103410 msgr2=0x7fe3dc105800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 --2- 172.21.15.92:0/693892173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc103410 0x7fe3dc105800 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009900 tx=0x7fe3cc02a410 comp rx=0 tx=0).stop 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 -- 172.21.15.92:0/693892173 shutdown_connections 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 --2- 172.21.15.92:0/693892173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc108670 0x7fe3dc10aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 --2- 172.21.15.92:0/693892173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc105d40 0x7fe3dc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 --2- 172.21.15.92:0/693892173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc103410 0x7fe3dc105800 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 -- 172.21.15.92:0/693892173 >> 172.21.15.92:0/693892173 conn(0x7fe3dc0fce00 msgr2=0x7fe3dc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 -- 172.21.15.92:0/693892173 shutdown_connections 2024-04-26T17:59:35.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.698+0000 7fe3e2558640 1 -- 172.21.15.92:0/693892173 wait complete. 2024-04-26T17:59:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 Processor -- start 2024-04-26T17:59:35.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 -- start start 2024-04-26T17:59:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc103410 0x7fe3dc198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:35.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc108670 0x7fe3dc1a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10e4c0 con 0x7fe3dc105d40 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10e340 con 0x7fe3dc108670 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e2558640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc10e640 con 0x7fe3dc103410 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3db7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3db7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41690/0 (socket says 172.21.15.92:41690) 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3db7fe640 1 -- 172.21.15.92:0/890442939 learned_addr learned my addr 172.21.15.92:0/890442939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3dbfff640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc103410 0x7fe3dc198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.699+0000 7fe3e0af5640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc108670 0x7fe3dc1a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc103410 msgr2=0x7fe3dc198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc103410 0x7fe3dc198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc108670 msgr2=0x7fe3dc1a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:35.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc108670 0x7fe3dc1a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 -- 172.21.15.92:0/890442939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc1a0760 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3db7fe640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d770 tx=0x7fe3d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0017070 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3d0009c30 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc1a0a50 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000f620 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.700+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc1a0fa0 con 0x7fe3dc105d40 2024-04-26T17:59:35.703 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.701+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc0fe8f0 con 0x7fe3dc105d40 2024-04-26T17:59:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.702+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7fe3d001a070 con 0x7fe3dc105d40 2024-04-26T17:59:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.703+0000 7fe3d97fa640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 0x7fe3c40a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.703+0000 7fe3dbfff640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 msgr2=0x7fe3c40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.703+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7fe3d00cfe10 con 0x7fe3dc105d40 2024-04-26T17:59:35.704 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.703+0000 7fe3dbfff640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 0x7fe3c40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:59:35.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.707+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe3d0009de0 con 0x7fe3dc105d40 2024-04-26T17:59:35.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.612+0000 7f79b51b0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:59:35.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.745+0000 7f79b51b0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:59:35.887 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.842+0000 7f79b51b0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:59:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.904+0000 7fe3dbfff640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 msgr2=0x7fe3c40a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:35.904 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.904+0000 7fe3dbfff640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 0x7fe3c40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:59:35.906 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:35.548+0000 7f25ee46d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:59:35.906 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:35.648+0000 7f25ee46d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:59:35.931 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.931+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fe3dc02dd20 con 0x7fe3dc105d40 2024-04-26T17:59:35.932 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.649+0000 7f0df99d1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:59:35.933 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.784+0000 7f0df99d1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:59:35.933 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.880+0000 7f0df99d1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:59:35.984 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.983+0000 7fe3d97fa640 1 -- 172.21.15.92:0/890442939 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7fe3d009c240 con 0x7fe3dc105d40 2024-04-26T17:59:35.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.985+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 msgr2=0x7fe3c40a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:59:35.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.985+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 0x7fe3c40a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 msgr2=0x7fe3dc199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000d770 tx=0x7fe3d000dc30 comp rx=0 tx=0).stop 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 shutdown_connections 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7fe3c40a3ca0 0x7fe3c40a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3dc108670 0x7fe3dc1a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3dc105d40 0x7fe3dc199080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 --2- 172.21.15.92:0/890442939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3dc103410 0x7fe3dc198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 >> 172.21.15.92:0/890442939 conn(0x7fe3dc0fce00 msgr2=0x7fe3dc103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 shutdown_connections 2024-04-26T17:59:35.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:35.986+0000 7fe3e2558640 1 -- 172.21.15.92:0/890442939 wait complete. 2024-04-26T17:59:35.998 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-26T17:59:36.009 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T17:59:36.017 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T17:59:36.018 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:36.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.120+0000 7f24f0052640 1 -- 172.21.15.92:0/1967687855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8103440 msgr2=0x7f24e8109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.120+0000 7f24f0052640 1 --2- 172.21.15.92:0/1967687855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8103440 0x7f24e8109cd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009ca0 tx=0x7f24e002a8c0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- 172.21.15.92:0/1967687855 shutdown_connections 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- 172.21.15.92:0/1967687855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8103440 0x7f24e8109cd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- 172.21.15.92:0/1967687855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8102a80 0x7f24e8102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- 172.21.15.92:0/1967687855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24e8101890 0x7f24e8101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- 172.21.15.92:0/1967687855 >> 172.21.15.92:0/1967687855 conn(0x7f24e80fce00 msgr2=0x7f24e80ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- 172.21.15.92:0/1967687855 shutdown_connections 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- 172.21.15.92:0/1967687855 wait complete. 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 Processor -- start 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- start start 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 0x7f24e810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24e8102a80 0x7f24e810a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8103440 0x7f24e810ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24e810e540 con 0x7f24e8101890 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f24e810e3c0 con 0x7f24e8102a80 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24f0052640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24e810e6c0 con 0x7f24e8103440 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24eddee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 0x7f24e810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:36.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24eddee640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 0x7f24e810c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41698/0 (socket says 172.21.15.92:41698) 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.121+0000 7f24eddee640 1 -- 172.21.15.92:0/263919069 learned_addr learned my addr 172.21.15.92:0/263919069 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24e8102a80 0x7f24e810a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24ee5ef640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8103440 0x7f24e810ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8103440 msgr2=0x7f24e810ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8103440 0x7f24e810ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24e8102a80 msgr2=0x7f24e810a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24e8102a80 0x7f24e810a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e810b650 con 0x7f24e8101890 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24ee5ef640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24e8103440 0x7f24e810ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24eddee640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 0x7f24e810c1c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00e9c0 tx=0x7f24dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc00cd80 con 0x7f24e8101890 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24dc0035f0 con 0x7f24e8101890 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81a2c40 con 0x7f24e8101890 2024-04-26T17:59:36.125 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc010690 con 0x7f24e8101890 2024-04-26T17:59:36.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.122+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81a31b0 con 0x7f24e8101890 2024-04-26T17:59:36.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.123+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e8108bb0 con 0x7f24e8101890 2024-04-26T17:59:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.124+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138663+0+0 (secure 0 0 0) 0x7f24dc0037a0 con 0x7f24e8101890 2024-04-26T17:59:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.125+0000 7f24daffd640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 0x7f24d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.125+0000 7f24ed5ed640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 msgr2=0x7f24d40a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.125+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8153+0+0 (secure 0 0 0) 0x7f24dc0d0770 con 0x7f24e8101890 2024-04-26T17:59:36.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.125+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 0x7f24d40a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:59:36.129 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.129+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f24dc09d1f0 con 0x7f24e8101890 2024-04-26T17:59:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:35 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T17:59:36.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:35.906+0000 7f25ee46d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:59:36.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:36.045+0000 7f25ee46d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:59:36.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:36.149+0000 7f25ee46d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:59:36.263 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T17:59:36.263 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:35.957+0000 7f79b51b0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:36.306 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:35 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-26T17:59:36.306 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:36 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:35.998+0000 7f0df99d1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:36.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.326+0000 7f24ed5ed640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 msgr2=0x7f24d40a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:36.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.326+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 0x7f24d40a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T17:59:36.339 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.338+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f24e8062d70 con 0x7f24d40a3d20 2024-04-26T17:59:36.575 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:36.271+0000 7f25ee46d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:59:36.575 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:36.574+0000 7f25ee46d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:59:36.637 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:36 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:36.264+0000 7f79b51b0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:59:36.683 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:36 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:36.305+0000 7f0df99d1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:59:36.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.727+0000 7f24ed5ed640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 msgr2=0x7f24d40a61e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.92:6800/3474750194 2024-04-26T17:59:36.727 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:36.727+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 0x7f24d40a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T17:59:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:36 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T17:59:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:36 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:59:37.137 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:36 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:36.869+0000 7f79b51b0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:59:37.138 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-z[34603]: 2024-04-26T17:59:37.086+0000 7f79b51b0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:59:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:36 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T17:59:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:36 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:59:37.183 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:36 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:36.906+0000 7f0df99d1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:59:37.183 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-y[34071]: 2024-04-26T17:59:37.124+0000 7f0df99d1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:59:37.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.186+0000 7f25ee46d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:59:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/890442939' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-26T17:59:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:36 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T17:59:37.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:37.417+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 20) ==== 138331+0+0 (secure 0 0 0) 0x7f24dc099160 con 0x7f24e8101890 2024-04-26T17:59:37.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:37.418+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 msgr2=0x7f24d40a61e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:59:37.418 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:37.418+0000 7f24daffd640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/3474750194,v1:172.21.15.92:6801/3474750194] conn(0x7f24d40a3d20 0x7f24d40a61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:37.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.405+0000 7f25ee46d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:59:37.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254f60c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254f60c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254f60c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254f60c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254f60c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:37.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T17:59:37.652+0000 7f254d608700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T17:59:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Standby manager daemon z restarted 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Standby manager daemon z started 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Standby manager daemon y restarted 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Standby manager daemon y started 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Active manager daemon x restarted 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Activating manager daemon x 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: mgrmap e20: x(active, starting, since 0.011211s), standbys: z, y 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:59:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:59:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: Manager daemon x is now available 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:59:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:59:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Standby manager daemon z restarted 2024-04-26T17:59:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Standby manager daemon z started 2024-04-26T17:59:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:59:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Standby manager daemon y restarted 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Standby manager daemon y started 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Active manager daemon x restarted 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Activating manager daemon x 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: mgrmap e20: x(active, starting, since 0.011211s), standbys: z, y 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:59:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:59:38.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: Manager daemon x is now available 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:59:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:59:38.424 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.424+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mon.0 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f24dc098840 con 0x7f24e8101890 2024-04-26T17:59:38.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.425+0000 7f24daffd640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f24d40528d0 0x7f24d4052cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.425+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f24dc0d29c0 con 0x7f24d40528d0 2024-04-26T17:59:38.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.429+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f24d40528d0 0x7f24d4052cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.433+0000 7f24ed5ed640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f24d40528d0 0x7f24d4052cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24e810bf30 tx=0x7f24e400b410 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Standby manager daemon z restarted 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Standby manager daemon z started 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.189:0/1564455419' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Standby manager daemon y restarted 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Standby manager daemon y started 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.? 172.21.15.156:0/652255490' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Active manager daemon x restarted 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Activating manager daemon x 2024-04-26T17:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: osdmap e91: 12 total, 12 up, 12 in 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: mgrmap e20: x(active, starting, since 0.011211s), standbys: z, y 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-26T17:59:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-26T17:59:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: Manager daemon x is now available 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-26T17:59:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-26T17:59:38.496 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.496+0000 7f24daffd640 1 -- 172.21.15.92:0/263919069 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f24dc0d29c0 con 0x7f24d40528d0 2024-04-26T17:59:38.496 INFO:teuthology.orchestra.run.smithi092.stdout:Schedule set for path / 2024-04-26T17:59:38.498 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f24d40528d0 msgr2=0x7f24d4052cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f24d40528d0 0x7f24d4052cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f24e810bf30 tx=0x7f24e400b410 comp rx=0 tx=0).stop 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 msgr2=0x7f24e810c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 --2- 172.21.15.92:0/263919069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24e8101890 0x7f24e810c1c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00e9c0 tx=0x7f24dc00ee80 comp rx=0 tx=0).stop 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24ee5ef640 1 -- 172.21.15.92:0/263919069 reap_dead start 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 shutdown_connections 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 >> 172.21.15.92:0/263919069 conn(0x7f24e80fce00 msgr2=0x7f24e8105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 shutdown_connections 2024-04-26T17:59:38.499 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.498+0000 7f24f0052640 1 -- 172.21.15.92:0/263919069 wait complete. 2024-04-26T17:59:38.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 -- 172.21.15.92:0/3655234795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c108670 msgr2=0x7f7d8c10aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/3655234795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c108670 0x7f7d8c10aac0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009ca0 tx=0x7f7d8402a8c0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 -- 172.21.15.92:0/3655234795 shutdown_connections 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/3655234795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c108670 0x7f7d8c10aac0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/3655234795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 0x7f7d8c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/3655234795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c103410 0x7f7d8c105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 -- 172.21.15.92:0/3655234795 >> 172.21.15.92:0/3655234795 conn(0x7f7d8c0fce00 msgr2=0x7f7d8c0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 -- 172.21.15.92:0/3655234795 shutdown_connections 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.612+0000 7f7d92a1d640 1 -- 172.21.15.92:0/3655234795 wait complete. 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 Processor -- start 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 -- start start 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 0x7f7d8c199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c108670 0x7f7d8c1a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c10e4c0 con 0x7f7d8c103410 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c10e340 con 0x7f7d8c108670 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d92a1d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c10e640 con 0x7f7d8c105d40 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41850/0 (socket says 172.21.15.92:41850) 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.613+0000 7f7d8bfff640 1 -- 172.21.15.92:0/1471528765 learned_addr learned my addr 172.21.15.92:0/1471528765 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8b7fe640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 0x7f7d8c199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d90fba640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c108670 0x7f7d8c1a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 -- 172.21.15.92:0/1471528765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 msgr2=0x7f7d8c199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 0x7f7d8c199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 -- 172.21.15.92:0/1471528765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c108670 msgr2=0x7f7d8c1a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c108670 0x7f7d8c1a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 -- 172.21.15.92:0/1471528765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c1a06e0 con 0x7f7d8c103410 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d8bfff640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00e9f0 tx=0x7f7d7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00cd80 con 0x7f7d8c103410 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c1a09d0 con 0x7f7d8c103410 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d7c0108e0 con 0x7f7d8c103410 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c018980 con 0x7f7d8c103410 2024-04-26T17:59:38.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.614+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1a0f20 con 0x7f7d8c103410 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.615+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c0506c0 con 0x7f7d8c103410 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.616+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f7d7c010430 con 0x7f7d8c103410 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.617+0000 7f7d897fa640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 0x7f7d740a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.617+0000 7f7d8b7fe640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 0x7f7d740a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.617+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f7d7c0d0380 con 0x7f7d8c103410 2024-04-26T17:59:38.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.617+0000 7f7d8b7fe640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 0x7f7d740a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c199fd0 tx=0x7f7d8000b390 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.621+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f7d7c09c950 con 0x7f7d8c103410 2024-04-26T17:59:38.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.832+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f7d8c062f70 con 0x7f7d740a3a60 2024-04-26T17:59:38.886 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.886+0000 7f7d897fa640 1 -- 172.21.15.92:0/1471528765 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f7d8c062f70 con 0x7f7d740a3a60 2024-04-26T17:59:38.886 INFO:teuthology.orchestra.run.smithi092.stdout:Retention added to path / 2024-04-26T17:59:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 msgr2=0x7f7d740a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 0x7f7d740a5f20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c199fd0 tx=0x7f7d8000b390 comp rx=0 tx=0).stop 2024-04-26T17:59:38.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 msgr2=0x7f7d8c198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00e9f0 tx=0x7f7d7c00eeb0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 shutdown_connections 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7d740a3a60 0x7f7d740a5f20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d8c108670 0x7f7d8c1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7d8c105d40 0x7f7d8c199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 --2- 172.21.15.92:0/1471528765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d8c103410 0x7f7d8c198b10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 >> 172.21.15.92:0/1471528765 conn(0x7f7d8c0fce00 msgr2=0x7f7d8c103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 shutdown_connections 2024-04-26T17:59:38.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:38.888+0000 7f7d92a1d640 1 -- 172.21.15.92:0/1471528765 wait complete. 2024-04-26T17:59:38.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 -- 172.21.15.92:0/3277402046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10103440 msgr2=0x7f5a10109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 --2- 172.21.15.92:0/3277402046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10103440 0x7f5a10109cd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009900 tx=0x7f5a0802a410 comp rx=0 tx=0).stop 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 -- 172.21.15.92:0/3277402046 shutdown_connections 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 --2- 172.21.15.92:0/3277402046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10103440 0x7f5a10109cd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 --2- 172.21.15.92:0/3277402046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10102a80 0x7f5a10102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 --2- 172.21.15.92:0/3277402046 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10101890 0x7f5a10101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 -- 172.21.15.92:0/3277402046 >> 172.21.15.92:0/3277402046 conn(0x7f5a100fce00 msgr2=0x7f5a100ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 -- 172.21.15.92:0/3277402046 shutdown_connections 2024-04-26T17:59:39.004 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.001+0000 7f5a16225640 1 -- 172.21.15.92:0/3277402046 wait complete. 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 Processor -- start 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 -- start start 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10102a80 0x7f5a1019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10103440 0x7f5a1019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1010d3c0 con 0x7f5a10101890 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1010d240 con 0x7f5a10103440 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a16225640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5a1010d540 con 0x7f5a10102a80 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41870/0 (socket says 172.21.15.92:41870) 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.002+0000 7f5a0f7fe640 1 -- 172.21.15.92:0/1447990791 learned_addr learned my addr 172.21.15.92:0/1447990791 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0ffff640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10103440 0x7f5a1019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0effd640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10102a80 0x7f5a1019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 -- 172.21.15.92:0/1447990791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10102a80 msgr2=0x7f5a1019d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10102a80 0x7f5a1019d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 -- 172.21.15.92:0/1447990791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10103440 msgr2=0x7f5a1019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10103440 0x7f5a1019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 -- 172.21.15.92:0/1447990791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a101a0710 con 0x7f5a10101890 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0f7fe640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000eaa0 tx=0x7f5a0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000ce10 con 0x7f5a10101890 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a101a0a00 con 0x7f5a10101890 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a00011920 con 0x7f5a10101890 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0001ab00 con 0x7f5a10101890 2024-04-26T17:59:39.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.003+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a101a0f50 con 0x7f5a10101890 2024-04-26T17:59:39.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.004+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a10108bb0 con 0x7f5a10101890 2024-04-26T17:59:39.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.005+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f5a00011ad0 con 0x7f5a10101890 2024-04-26T17:59:39.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.006+0000 7f5a0cff9640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 0x7f59f80a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.006+0000 7f5a0effd640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 0x7f59f80a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.006+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f5a000d06c0 con 0x7f5a10101890 2024-04-26T17:59:39.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.006+0000 7f5a0effd640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 0x7f59f80a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a1006a8e0 tx=0x7f5a04005f90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.010 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.010+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5a00016030 con 0x7f5a10101890 2024-04-26T17:59:39.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.236+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5a10062d70 con 0x7f59f80a3a60 2024-04-26T17:59:39.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.244+0000 7f5a0cff9640 1 -- 172.21.15.92:0/1447990791 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f5a10062d70 con 0x7f59f80a3a60 2024-04-26T17:59:39.244 INFO:teuthology.orchestra.run.smithi092.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-26T00:00:00", "created": "2024-04-26T17:59:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-26T17:59:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 msgr2=0x7f59f80a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 0x7f59f80a5f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5a1006a8e0 tx=0x7f5a04005f90 comp rx=0 tx=0).stop 2024-04-26T17:59:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 msgr2=0x7f5a1006ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000eaa0 tx=0x7f5a0000ef60 comp rx=0 tx=0).stop 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 shutdown_connections 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f59f80a3a60 0x7f59f80a5f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a10103440 0x7f5a1019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5a10102a80 0x7f5a1019d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 --2- 172.21.15.92:0/1447990791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5a10101890 0x7f5a1006ab70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 >> 172.21.15.92:0/1447990791 conn(0x7f5a100fce00 msgr2=0x7f5a10105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 shutdown_connections 2024-04-26T17:59:39.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.246+0000 7f5a16225640 1 -- 172.21.15.92:0/1447990791 wait complete. 2024-04-26T17:59:39.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-26T17:59:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- 172.21.15.92:0/2408792493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768103580 msgr2=0x7f0768105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 --2- 172.21.15.92:0/2408792493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768103580 0x7f0768105970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0764009900 tx=0x7f076402a410 comp rx=0 tx=0).stop 2024-04-26T17:59:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- 172.21.15.92:0/2408792493 shutdown_connections 2024-04-26T17:59:39.378 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 --2- 172.21.15.92:0/2408792493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07681087e0 0x7f076810abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 --2- 172.21.15.92:0/2408792493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0768105eb0 0x7f07681082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 --2- 172.21.15.92:0/2408792493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768103580 0x7f0768105970 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- 172.21.15.92:0/2408792493 >> 172.21.15.92:0/2408792493 conn(0x7f07680fceb0 msgr2=0x7f07680ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- 172.21.15.92:0/2408792493 shutdown_connections 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- 172.21.15.92:0/2408792493 wait complete. 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 Processor -- start 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.376+0000 7f076f647640 1 -- start start 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0768103580 0x7f0768102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07681087e0 0x7f0768101a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f076810e500 con 0x7f0768105eb0 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f076810e380 con 0x7f07681087e0 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076f647640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f076810e680 con 0x7f0768103580 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.379 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41894/0 (socket says 172.21.15.92:41894) 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 -- 172.21.15.92:0/3237173450 learned_addr learned my addr 172.21.15.92:0/3237173450 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076d3e3640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0768103580 0x7f0768102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076dbe4640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07681087e0 0x7f0768101a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 -- 172.21.15.92:0/3237173450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0768103580 msgr2=0x7f0768102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0768103580 0x7f0768102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 -- 172.21.15.92:0/3237173450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07681087e0 msgr2=0x7f0768101a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07681087e0 0x7f0768101a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 -- 172.21.15.92:0/3237173450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0768102300 con 0x7f0768105eb0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f076cbe2640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f075800d770 tx=0x7f075800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.377+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758017070 con 0x7f0768105eb0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.378+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07681a2bf0 con 0x7f0768105eb0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.378+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0758009c30 con 0x7f0768105eb0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.378+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075800f620 con 0x7f0768105eb0 2024-04-26T17:59:39.380 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.378+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07681a3190 con 0x7f0768105eb0 2024-04-26T17:59:39.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.379+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07680fe9a0 con 0x7f0768105eb0 2024-04-26T17:59:39.381 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.380+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 138458+0+0 (secure 0 0 0) 0x7f075801a070 con 0x7f0768105eb0 2024-04-26T17:59:39.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.380+0000 7f075e7fc640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 0x7f07540a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.380+0000 7f076d3e3640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 0x7f07540a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.380+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f07580cfab0 con 0x7f0768105eb0 2024-04-26T17:59:39.382 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.381+0000 7f076d3e3640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 0x7f07540a5fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0764000c00 tx=0x7f07640314a0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.385 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.385+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f0758009de0 con 0x7f0768105eb0 2024-04-26T17:59:39.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.610+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f0768062d70 con 0x7f07540a3ae0 2024-04-26T17:59:39.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.616+0000 7f075e7fc640 1 -- 172.21.15.92:0/3237173450 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f0768062d70 con 0x7f07540a3ae0 2024-04-26T17:59:39.617 INFO:teuthology.orchestra.run.smithi092.stdout:/ 1m 6m3h 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 msgr2=0x7f07540a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 0x7f07540a5fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0764000c00 tx=0x7f07640314a0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 msgr2=0x7f0768101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f075800d770 tx=0x7f075800dc30 comp rx=0 tx=0).stop 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 shutdown_connections 2024-04-26T17:59:39.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f07540a3ae0 0x7f07540a5fa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07681087e0 0x7f0768101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0768105eb0 0x7f0768101530 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 --2- 172.21.15.92:0/3237173450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0768103580 0x7f0768102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 >> 172.21.15.92:0/3237173450 conn(0x7f07680fceb0 msgr2=0x7f0768103ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 shutdown_connections 2024-04-26T17:59:39.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:39.619+0000 7f076f647640 1 -- 172.21.15.92:0/3237173450 wait complete. 2024-04-26T17:59:39.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: mgrmap e21: x(active, since 1.02033s), standbys: z, y 2024-04-26T17:59:39.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: [26/Apr/2024:17:59:38] ENGINE Bus STARTING 2024-04-26T17:59:39.630 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: [26/Apr/2024:17:59:38] ENGINE Serving on https://172.21.15.92:7150 2024-04-26T17:59:39.630 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: [26/Apr/2024:17:59:38] ENGINE Serving on http://172.21.15.92:8765 2024-04-26T17:59:39.630 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: [26/Apr/2024:17:59:38] ENGINE Bus STARTED 2024-04-26T17:59:39.630 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.630 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:39 smithi092 ceph-mon[29156]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: mgrmap e21: x(active, since 1.02033s), standbys: z, y 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: [26/Apr/2024:17:59:38] ENGINE Bus STARTING 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: [26/Apr/2024:17:59:38] ENGINE Serving on https://172.21.15.92:7150 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: [26/Apr/2024:17:59:38] ENGINE Serving on http://172.21.15.92:8765 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: [26/Apr/2024:17:59:38] ENGINE Bus STARTED 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:39 smithi189 ceph-mon[32756]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.657 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-26T17:59:39.668 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-26T17:59:39.678 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:39.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: mgrmap e21: x(active, since 1.02033s), standbys: z, y 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: [26/Apr/2024:17:59:38] ENGINE Bus STARTING 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: [26/Apr/2024:17:59:38] ENGINE Serving on https://172.21.15.92:7150 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: [26/Apr/2024:17:59:38] ENGINE Serving on http://172.21.15.92:8765 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: [26/Apr/2024:17:59:38] ENGINE Bus STARTED 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:39 smithi156 ceph-mon[32679]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:39.699 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-26T17:59:39.712 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-26T17:59:39.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:59:39.958 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:40 smithi092 ceph-mon[29156]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.842 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:40 smithi189 ceph-mon[32756]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:40 smithi156 ceph-mon[32679]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-04-26T17:59:41.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T17:59:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 -- 172.21.15.92:0/498755797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 msgr2=0x7f5d9c102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 --2- 172.21.15.92:0/498755797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c102260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009990 tx=0x7f5d90009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 -- 172.21.15.92:0/498755797 shutdown_connections 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 --2- 172.21.15.92:0/498755797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 0x7f5d9c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 --2- 172.21.15.92:0/498755797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 0x7f5d9c108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 --2- 172.21.15.92:0/498755797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c102260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 -- 172.21.15.92:0/498755797 >> 172.21.15.92:0/498755797 conn(0x7f5d9c077640 msgr2=0x7f5d9c077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 -- 172.21.15.92:0/498755797 shutdown_connections 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.729+0000 7f5da1d76700 1 -- 172.21.15.92:0/498755797 wait complete. 2024-04-26T17:59:41.732 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 Processor -- start 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 -- start start 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 0x7f5d9c198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 0x7f5d9c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c112590 con 0x7f5d9c101de0 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c112410 con 0x7f5d9c1027a0 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5da1d76700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c112710 con 0x7f5d9c107c20 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5d9b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5d9b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41942/0 (socket says 172.21.15.92:41942) 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.730+0000 7f5d9b7fe700 1 -- 172.21.15.92:0/4007110855 learned_addr learned my addr 172.21.15.92:0/4007110855 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9affd700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 0x7f5d9c198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9bfff700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 0x7f5d9c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 -- 172.21.15.92:0/4007110855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 msgr2=0x7f5d9c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 0x7f5d9c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 -- 172.21.15.92:0/4007110855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 msgr2=0x7f5d9c198c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 0x7f5d9c198c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 -- 172.21.15.92:0/4007110855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c1a7f50 con 0x7f5d9c101de0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d9b7fe700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00d950 tx=0x7f5d8c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c016070 con 0x7f5d9c101de0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d8c009df0 con 0x7f5d9c101de0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c1a8240 con 0x7f5d9c101de0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00f3c0 con 0x7f5d9c101de0 2024-04-26T17:59:41.734 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.731+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c1a87d0 con 0x7f5d9c101de0 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.733+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9c06a110 con 0x7f5d9c101de0 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.734+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 22) ==== 138766+0+0 (secure 0 0 0) 0x7f5d8c019070 con 0x7f5d9c101de0 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.734+0000 7f5d98ff9700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 0x7f5d840a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.734+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f5d8c0d02e0 con 0x7f5d9c101de0 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.734+0000 7f5d9affd700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 0x7f5d840a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:41.735 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.735+0000 7f5d9affd700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 0x7f5d840a62f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c19a840 tx=0x7f5d9000b560 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:41.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.739+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f5d8c09c9f0 con 0x7f5d9c101de0 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T17:59:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:41.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.961+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d9c10f960 con 0x7f5d840a3e30 2024-04-26T17:59:41.969 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.969+0000 7f5d98ff9700 1 -- 172.21.15.92:0/4007110855 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257999 (secure 0 0 0) 0x7f5d9c10f960 con 0x7f5d840a3e30 2024-04-26T17:59:41.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:41.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 msgr2=0x7f5d840a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:41.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 0x7f5d840a62f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c19a840 tx=0x7f5d9000b560 comp rx=0 tx=0).stop 2024-04-26T17:59:41.976 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 msgr2=0x7f5d9c1986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00d950 tx=0x7f5d8c00dc60 comp rx=0 tx=0).stop 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 shutdown_connections 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5d840a3e30 0x7f5d840a62f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5d9c107c20 0x7f5d9c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d9c101de0 0x7f5d9c1986e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 --2- 172.21.15.92:0/4007110855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d9c1027a0 0x7f5d9c198c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.972+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 >> 172.21.15.92:0/4007110855 conn(0x7f5d9c077640 msgr2=0x7f5d9c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.973+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 shutdown_connections 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:41.973+0000 7f5da1d76700 1 -- 172.21.15.92:0/4007110855 wait complete. 2024-04-26T17:59:41.977 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:59:42.675 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-26T17:59:41.426088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186529,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1326,"num_read_kb":822,"num_write":476,"num_write_kb":4376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373880,"kb_used_data":12208,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567944,"statfs":{"total":1151940427776,"available":1151557574656,"internally_reserved":0,"allocated":12500992,"data_stored":8740454,"data_compressed":184602,"data_compressed_allocated":237568,"data_compressed_original":2768896,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985844"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740566+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:59:37.740566+0000","last_peered":"2024-04-26T17:59:37.740566+0000","last_clean":"2024-04-26T17:59:37.740566+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:59:37.740566+0000","last_undegraded":"2024-04-26T17:59:37.740566+0000","last_fullsized":"2024-04-26T17:59:37.740566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661342+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:59:37.661342+0000","last_peered":"2024-04-26T17:59:37.661342+0000","last_clean":"2024-04-26T17:59:37.661342+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:59:37.661342+0000","last_undegraded":"2024-04-26T17:59:37.661342+0000","last_fullsized":"2024-04-26T17:59:37.661342+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661566+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:59:37.661566+0000","last_peered":"2024-04-26T17:59:37.661566+0000","last_clean":"2024-04-26T17:59:37.661566+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:59:37.661566+0000","last_undegraded":"2024-04-26T17:59:37.661566+0000","last_fullsized":"2024-04-26T17:59:37.661566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414896+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:59:37.414896+0000","last_peered":"2024-04-26T17:59:37.414896+0000","last_clean":"2024-04-26T17:59:37.414896+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:59:37.414896+0000","last_undegraded":"2024-04-26T17:59:37.414896+0000","last_fullsized":"2024-04-26T17:59:37.414896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433347+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:59:37.433347+0000","last_peered":"2024-04-26T17:59:37.433347+0000","last_clean":"2024-04-26T17:59:37.433347+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:59:37.433347+0000","last_undegraded":"2024-04-26T17:59:37.433347+0000","last_fullsized":"2024-04-26T17:59:37.433347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522929+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:59:37.522929+0000","last_peered":"2024-04-26T17:59:37.522929+0000","last_clean":"2024-04-26T17:59:37.522929+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:59:37.522929+0000","last_undegraded":"2024-04-26T17:59:37.522929+0000","last_fullsized":"2024-04-26T17:59:37.522929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658714+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:59:37.658714+0000","last_peered":"2024-04-26T17:59:37.658714+0000","last_clean":"2024-04-26T17:59:37.658714+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:59:37.658714+0000","last_undegraded":"2024-04-26T17:59:37.658714+0000","last_fullsized":"2024-04-26T17:59:37.658714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513832+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:59:37.513832+0000","last_peered":"2024-04-26T17:59:37.513832+0000","last_clean":"2024-04-26T17:59:37.513832+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:59:37.513832+0000","last_undegraded":"2024-04-26T17:59:37.513832+0000","last_fullsized":"2024-04-26T17:59:37.513832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.667023+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:59:37.667023+0000","last_peered":"2024-04-26T17:59:37.667023+0000","last_clean":"2024-04-26T17:59:37.667023+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:59:37.667023+0000","last_undegraded":"2024-04-26T17:59:37.667023+0000","last_fullsized":"2024-04-26T17:59:37.667023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523173+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:59:37.523173+0000","last_peered":"2024-04-26T17:59:37.523173+0000","last_clean":"2024-04-26T17:59:37.523173+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:59:37.523173+0000","last_undegraded":"2024-04-26T17:59:37.523173+0000","last_fullsized":"2024-04-26T17:59:37.523173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659152+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:59:37.659152+0000","last_peered":"2024-04-26T17:59:37.659152+0000","last_clean":"2024-04-26T17:59:37.659152+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:59:37.659152+0000","last_undegraded":"2024-04-26T17:59:37.659152+0000","last_fullsized":"2024-04-26T17:59:37.659152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413434+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:59:37.413434+0000","last_peered":"2024-04-26T17:59:37.413434+0000","last_clean":"2024-04-26T17:59:37.413434+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:59:37.413434+0000","last_undegraded":"2024-04-26T17:59:37.413434+0000","last_fullsized":"2024-04-26T17:59:37.413434+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659181+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:59:37.659181+0000","last_peered":"2024-04-26T17:59:37.659181+0000","last_clean":"2024-04-26T17:59:37.659181+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:59:37.659181+0000","last_undegraded":"2024-04-26T17:59:37.659181+0000","last_fullsized":"2024-04-26T17:59:37.659181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661084+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:59:37.661084+0000","last_peered":"2024-04-26T17:59:37.661084+0000","last_clean":"2024-04-26T17:59:37.661084+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:59:37.661084+0000","last_undegraded":"2024-04-26T17:59:37.661084+0000","last_fullsized":"2024-04-26T17:59:37.661084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661071+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:59:37.661071+0000","last_peered":"2024-04-26T17:59:37.661071+0000","last_clean":"2024-04-26T17:59:37.661071+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:59:37.661071+0000","last_undegraded":"2024-04-26T17:59:37.661071+0000","last_fullsized":"2024-04-26T17:59:37.661071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666463+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:59:37.666463+0000","last_peered":"2024-04-26T17:59:37.666463+0000","last_clean":"2024-04-26T17:59:37.666463+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:59:37.666463+0000","last_undegraded":"2024-04-26T17:59:37.666463+0000","last_fullsized":"2024-04-26T17:59:37.666463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740636+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:59:37.740636+0000","last_peered":"2024-04-26T17:59:37.740636+0000","last_clean":"2024-04-26T17:59:37.740636+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:59:37.740636+0000","last_undegraded":"2024-04-26T17:59:37.740636+0000","last_fullsized":"2024-04-26T17:59:37.740636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413228+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:59:37.413228+0000","last_peered":"2024-04-26T17:59:37.413228+0000","last_clean":"2024-04-26T17:59:37.413228+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:59:37.413228+0000","last_undegraded":"2024-04-26T17:59:37.413228+0000","last_fullsized":"2024-04-26T17:59:37.413228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416476+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:59:37.416476+0000","last_peered":"2024-04-26T17:59:37.416476+0000","last_clean":"2024-04-26T17:59:37.416476+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:59:37.416476+0000","last_undegraded":"2024-04-26T17:59:37.416476+0000","last_fullsized":"2024-04-26T17:59:37.416476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413183+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:59:37.413183+0000","last_peered":"2024-04-26T17:59:37.413183+0000","last_clean":"2024-04-26T17:59:37.413183+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:59:37.413183+0000","last_undegraded":"2024-04-26T17:59:37.413183+0000","last_fullsized":"2024-04-26T17:59:37.413183+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514519+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:59:37.514519+0000","last_peered":"2024-04-26T17:59:37.514519+0000","last_clean":"2024-04-26T17:59:37.514519+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:59:37.514519+0000","last_undegraded":"2024-04-26T17:59:37.514519+0000","last_fullsized":"2024-04-26T17:59:37.514519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514734+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:59:37.514734+0000","last_peered":"2024-04-26T17:59:37.514734+0000","last_clean":"2024-04-26T17:59:37.514734+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:59:37.514734+0000","last_undegraded":"2024-04-26T17:59:37.514734+0000","last_fullsized":"2024-04-26T17:59:37.514734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661540+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:59:37.661540+0000","last_peered":"2024-04-26T17:59:37.661540+0000","last_clean":"2024-04-26T17:59:37.661540+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:59:37.661540+0000","last_undegraded":"2024-04-26T17:59:37.661540+0000","last_fullsized":"2024-04-26T17:59:37.661540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433648+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:59:37.433648+0000","last_peered":"2024-04-26T17:59:37.433648+0000","last_clean":"2024-04-26T17:59:37.433648+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433648+0000","last_undegraded":"2024-04-26T17:59:37.433648+0000","last_fullsized":"2024-04-26T17:59:37.433648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666554+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:59:37.666554+0000","last_peered":"2024-04-26T17:59:37.666554+0000","last_clean":"2024-04-26T17:59:37.666554+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:59:37.666554+0000","last_undegraded":"2024-04-26T17:59:37.666554+0000","last_fullsized":"2024-04-26T17:59:37.666554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433518+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:59:37.433518+0000","last_peered":"2024-04-26T17:59:37.433518+0000","last_clean":"2024-04-26T17:59:37.433518+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433518+0000","last_undegraded":"2024-04-26T17:59:37.433518+0000","last_fullsized":"2024-04-26T17:59:37.433518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520325+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:59:37.520325+0000","last_peered":"2024-04-26T17:59:37.520325+0000","last_clean":"2024-04-26T17:59:37.520325+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:59:37.520325+0000","last_undegraded":"2024-04-26T17:59:37.520325+0000","last_fullsized":"2024-04-26T17:59:37.520325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'9","reported_seq":221,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.996280+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:59:37.996280+0000","last_peered":"2024-04-26T17:59:37.996280+0000","last_clean":"2024-04-26T17:59:37.996280+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:59:37.996280+0000","last_undegraded":"2024-04-26T17:59:37.996280+0000","last_fullsized":"2024-04-26T17:59:37.996280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":183,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433140+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:59:37.433140+0000","last_peered":"2024-04-26T17:59:37.433140+0000","last_clean":"2024-04-26T17:59:37.433140+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:59:37.433140+0000","last_undegraded":"2024-04-26T17:59:37.433140+0000","last_fullsized":"2024-04-26T17:59:37.433140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522515+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:59:37.522515+0000","last_peered":"2024-04-26T17:59:37.522515+0000","last_clean":"2024-04-26T17:59:37.522515+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:59:37.522515+0000","last_undegraded":"2024-04-26T17:59:37.522515+0000","last_fullsized":"2024-04-26T17:59:37.522515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520206+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:59:37.520206+0000","last_peered":"2024-04-26T17:59:37.520206+0000","last_clean":"2024-04-26T17:59:37.520206+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:59:37.520206+0000","last_undegraded":"2024-04-26T17:59:37.520206+0000","last_fullsized":"2024-04-26T17:59:37.520206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658771+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:59:37.658771+0000","last_peered":"2024-04-26T17:59:37.658771+0000","last_clean":"2024-04-26T17:59:37.658771+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:59:37.658771+0000","last_undegraded":"2024-04-26T17:59:37.658771+0000","last_fullsized":"2024-04-26T17:59:37.658771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513671+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:59:37.513671+0000","last_peered":"2024-04-26T17:59:37.513671+0000","last_clean":"2024-04-26T17:59:37.513671+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:59:37.513671+0000","last_undegraded":"2024-04-26T17:59:37.513671+0000","last_fullsized":"2024-04-26T17:59:37.513671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519825+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:59:37.519825+0000","last_peered":"2024-04-26T17:59:37.519825+0000","last_clean":"2024-04-26T17:59:37.519825+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:59:37.519825+0000","last_undegraded":"2024-04-26T17:59:37.519825+0000","last_fullsized":"2024-04-26T17:59:37.519825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413020+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:59:37.413020+0000","last_peered":"2024-04-26T17:59:37.413020+0000","last_clean":"2024-04-26T17:59:37.413020+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:59:37.413020+0000","last_undegraded":"2024-04-26T17:59:37.413020+0000","last_fullsized":"2024-04-26T17:59:37.413020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522607+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:59:37.522607+0000","last_peered":"2024-04-26T17:59:37.522607+0000","last_clean":"2024-04-26T17:59:37.522607+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:59:37.522607+0000","last_undegraded":"2024-04-26T17:59:37.522607+0000","last_fullsized":"2024-04-26T17:59:37.522607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666847+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:59:37.666847+0000","last_peered":"2024-04-26T17:59:37.666847+0000","last_clean":"2024-04-26T17:59:37.666847+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:59:37.666847+0000","last_undegraded":"2024-04-26T17:59:37.666847+0000","last_fullsized":"2024-04-26T17:59:37.666847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658664+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:59:37.658664+0000","last_peered":"2024-04-26T17:59:37.658664+0000","last_clean":"2024-04-26T17:59:37.658664+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:59:37.658664+0000","last_undegraded":"2024-04-26T17:59:37.658664+0000","last_fullsized":"2024-04-26T17:59:37.658664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661482+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:59:37.661482+0000","last_peered":"2024-04-26T17:59:37.661482+0000","last_clean":"2024-04-26T17:59:37.661482+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:59:37.661482+0000","last_undegraded":"2024-04-26T17:59:37.661482+0000","last_fullsized":"2024-04-26T17:59:37.661482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520367+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:59:37.520367+0000","last_peered":"2024-04-26T17:59:37.520367+0000","last_clean":"2024-04-26T17:59:37.520367+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:59:37.520367+0000","last_undegraded":"2024-04-26T17:59:37.520367+0000","last_fullsized":"2024-04-26T17:59:37.520367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666563+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:59:37.666563+0000","last_peered":"2024-04-26T17:59:37.666563+0000","last_clean":"2024-04-26T17:59:37.666563+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:59:37.666563+0000","last_undegraded":"2024-04-26T17:59:37.666563+0000","last_fullsized":"2024-04-26T17:59:37.666563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":431,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.995975+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:59:37.995975+0000","last_peered":"2024-04-26T17:59:37.995975+0000","last_clean":"2024-04-26T17:59:37.995975+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:59:37.995975+0000","last_undegraded":"2024-04-26T17:59:37.995975+0000","last_fullsized":"2024-04-26T17:59:37.995975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":247,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433484+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:59:37.433484+0000","last_peered":"2024-04-26T17:59:37.433484+0000","last_clean":"2024-04-26T17:59:37.433484+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:59:37.433484+0000","last_undegraded":"2024-04-26T17:59:37.433484+0000","last_fullsized":"2024-04-26T17:59:37.433484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416363+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:59:37.416363+0000","last_peered":"2024-04-26T17:59:37.416363+0000","last_clean":"2024-04-26T17:59:37.416363+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:59:37.416363+0000","last_undegraded":"2024-04-26T17:59:37.416363+0000","last_fullsized":"2024-04-26T17:59:37.416363+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658943+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:59:37.658943+0000","last_peered":"2024-04-26T17:59:37.658943+0000","last_clean":"2024-04-26T17:59:37.658943+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:59:37.658943+0000","last_undegraded":"2024-04-26T17:59:37.658943+0000","last_fullsized":"2024-04-26T17:59:37.658943+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520013+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:59:37.520013+0000","last_peered":"2024-04-26T17:59:37.520013+0000","last_clean":"2024-04-26T17:59:37.520013+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:59:37.520013+0000","last_undegraded":"2024-04-26T17:59:37.520013+0000","last_fullsized":"2024-04-26T17:59:37.520013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659175+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:59:37.659175+0000","last_peered":"2024-04-26T17:59:37.659175+0000","last_clean":"2024-04-26T17:59:37.659175+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:59:37.659175+0000","last_undegraded":"2024-04-26T17:59:37.659175+0000","last_fullsized":"2024-04-26T17:59:37.659175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'4","reported_seq":213,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:38.050848+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:59:38.050848+0000","last_peered":"2024-04-26T17:59:38.050848+0000","last_clean":"2024-04-26T17:59:38.050848+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:59:38.050848+0000","last_undegraded":"2024-04-26T17:59:38.050848+0000","last_fullsized":"2024-04-26T17:59:38.050848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658630+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:59:37.658630+0000","last_peered":"2024-04-26T17:59:37.658630+0000","last_clean":"2024-04-26T17:59:37.658630+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:59:37.658630+0000","last_undegraded":"2024-04-26T17:59:37.658630+0000","last_fullsized":"2024-04-26T17:59:37.658630+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433113+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:59:37.433113+0000","last_peered":"2024-04-26T17:59:37.433113+0000","last_clean":"2024-04-26T17:59:37.433113+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:59:37.433113+0000","last_undegraded":"2024-04-26T17:59:37.433113+0000","last_fullsized":"2024-04-26T17:59:37.433113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519985+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:59:37.519985+0000","last_peered":"2024-04-26T17:59:37.519985+0000","last_clean":"2024-04-26T17:59:37.519985+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:59:37.519985+0000","last_undegraded":"2024-04-26T17:59:37.519985+0000","last_fullsized":"2024-04-26T17:59:37.519985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433698+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:59:37.433698+0000","last_peered":"2024-04-26T17:59:37.433698+0000","last_clean":"2024-04-26T17:59:37.433698+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:59:37.433698+0000","last_undegraded":"2024-04-26T17:59:37.433698+0000","last_fullsized":"2024-04-26T17:59:37.433698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740443+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:59:37.740443+0000","last_peered":"2024-04-26T17:59:37.740443+0000","last_clean":"2024-04-26T17:59:37.740443+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:59:37.740443+0000","last_undegraded":"2024-04-26T17:59:37.740443+0000","last_fullsized":"2024-04-26T17:59:37.740443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413268+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:59:37.413268+0000","last_peered":"2024-04-26T17:59:37.413268+0000","last_clean":"2024-04-26T17:59:37.413268+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:59:37.413268+0000","last_undegraded":"2024-04-26T17:59:37.413268+0000","last_fullsized":"2024-04-26T17:59:37.413268+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523043+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:59:37.523043+0000","last_peered":"2024-04-26T17:59:37.523043+0000","last_clean":"2024-04-26T17:59:37.523043+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:59:37.523043+0000","last_undegraded":"2024-04-26T17:59:37.523043+0000","last_fullsized":"2024-04-26T17:59:37.523043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658887+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:59:37.658887+0000","last_peered":"2024-04-26T17:59:37.658887+0000","last_clean":"2024-04-26T17:59:37.658887+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:59:37.658887+0000","last_undegraded":"2024-04-26T17:59:37.658887+0000","last_fullsized":"2024-04-26T17:59:37.658887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522908+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:59:37.522908+0000","last_peered":"2024-04-26T17:59:37.522908+0000","last_clean":"2024-04-26T17:59:37.522908+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:59:37.522908+0000","last_undegraded":"2024-04-26T17:59:37.522908+0000","last_fullsized":"2024-04-26T17:59:37.522908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520014+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:59:37.520014+0000","last_peered":"2024-04-26T17:59:37.520014+0000","last_clean":"2024-04-26T17:59:37.520014+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:59:37.520014+0000","last_undegraded":"2024-04-26T17:59:37.520014+0000","last_fullsized":"2024-04-26T17:59:37.520014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.660715+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:59:37.660715+0000","last_peered":"2024-04-26T17:59:37.660715+0000","last_clean":"2024-04-26T17:59:37.660715+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:59:37.660715+0000","last_undegraded":"2024-04-26T17:59:37.660715+0000","last_fullsized":"2024-04-26T17:59:37.660715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514153+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:59:37.514153+0000","last_peered":"2024-04-26T17:59:37.514153+0000","last_clean":"2024-04-26T17:59:37.514153+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:59:37.514153+0000","last_undegraded":"2024-04-26T17:59:37.514153+0000","last_fullsized":"2024-04-26T17:59:37.514153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414769+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:59:37.414769+0000","last_peered":"2024-04-26T17:59:37.414769+0000","last_clean":"2024-04-26T17:59:37.414769+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:59:37.414769+0000","last_undegraded":"2024-04-26T17:59:37.414769+0000","last_fullsized":"2024-04-26T17:59:37.414769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":360,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658825+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:59:37.658825+0000","last_peered":"2024-04-26T17:59:37.658825+0000","last_clean":"2024-04-26T17:59:37.658825+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:59:37.658825+0000","last_undegraded":"2024-04-26T17:59:37.658825+0000","last_fullsized":"2024-04-26T17:59:37.658825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659098+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:59:37.659098+0000","last_peered":"2024-04-26T17:59:37.659098+0000","last_clean":"2024-04-26T17:59:37.659098+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:59:37.659098+0000","last_undegraded":"2024-04-26T17:59:37.659098+0000","last_fullsized":"2024-04-26T17:59:37.659098+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658559+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:59:37.658559+0000","last_peered":"2024-04-26T17:59:37.658559+0000","last_clean":"2024-04-26T17:59:37.658559+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:59:37.658559+0000","last_undegraded":"2024-04-26T17:59:37.658559+0000","last_fullsized":"2024-04-26T17:59:37.658559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433495+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:59:37.433495+0000","last_peered":"2024-04-26T17:59:37.433495+0000","last_clean":"2024-04-26T17:59:37.433495+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:59:37.433495+0000","last_undegraded":"2024-04-26T17:59:37.433495+0000","last_fullsized":"2024-04-26T17:59:37.433495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659044+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:59:37.659044+0000","last_peered":"2024-04-26T17:59:37.659044+0000","last_clean":"2024-04-26T17:59:37.659044+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:59:37.659044+0000","last_undegraded":"2024-04-26T17:59:37.659044+0000","last_fullsized":"2024-04-26T17:59:37.659044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'46","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.624123+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:59:37.624123+0000","last_peered":"2024-04-26T17:59:37.624123+0000","last_clean":"2024-04-26T17:59:37.624123+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:59:37.624123+0000","last_undegraded":"2024-04-26T17:59:37.624123+0000","last_fullsized":"2024-04-26T17:59:37.624123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514588+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:59:37.514588+0000","last_peered":"2024-04-26T17:59:37.514588+0000","last_clean":"2024-04-26T17:59:37.514588+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:59:37.514588+0000","last_undegraded":"2024-04-26T17:59:37.514588+0000","last_fullsized":"2024-04-26T17:59:37.514588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.415027+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:59:37.415027+0000","last_peered":"2024-04-26T17:59:37.415027+0000","last_clean":"2024-04-26T17:59:37.415027+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:59:37.415027+0000","last_undegraded":"2024-04-26T17:59:37.415027+0000","last_fullsized":"2024-04-26T17:59:37.415027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661412+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:59:37.661412+0000","last_peered":"2024-04-26T17:59:37.661412+0000","last_clean":"2024-04-26T17:59:37.661412+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:59:37.661412+0000","last_undegraded":"2024-04-26T17:59:37.661412+0000","last_fullsized":"2024-04-26T17:59:37.661412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666413+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:59:37.666413+0000","last_peered":"2024-04-26T17:59:37.666413+0000","last_clean":"2024-04-26T17:59:37.666413+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:59:37.666413+0000","last_undegraded":"2024-04-26T17:59:37.666413+0000","last_fullsized":"2024-04-26T17:59:37.666413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433121+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:59:37.433121+0000","last_peered":"2024-04-26T17:59:37.433121+0000","last_clean":"2024-04-26T17:59:37.433121+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:59:37.433121+0000","last_undegraded":"2024-04-26T17:59:37.433121+0000","last_fullsized":"2024-04-26T17:59:37.433121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513579+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:59:37.513579+0000","last_peered":"2024-04-26T17:59:37.513579+0000","last_clean":"2024-04-26T17:59:37.513579+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:59:37.513579+0000","last_undegraded":"2024-04-26T17:59:37.513579+0000","last_fullsized":"2024-04-26T17:59:37.513579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740174+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:59:37.740174+0000","last_peered":"2024-04-26T17:59:37.740174+0000","last_clean":"2024-04-26T17:59:37.740174+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:59:37.740174+0000","last_undegraded":"2024-04-26T17:59:37.740174+0000","last_fullsized":"2024-04-26T17:59:37.740174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740320+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:59:37.740320+0000","last_peered":"2024-04-26T17:59:37.740320+0000","last_clean":"2024-04-26T17:59:37.740320+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:59:37.740320+0000","last_undegraded":"2024-04-26T17:59:37.740320+0000","last_fullsized":"2024-04-26T17:59:37.740320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514430+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:59:37.514430+0000","last_peered":"2024-04-26T17:59:37.514430+0000","last_clean":"2024-04-26T17:59:37.514430+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:59:37.514430+0000","last_undegraded":"2024-04-26T17:59:37.514430+0000","last_fullsized":"2024-04-26T17:59:37.514430+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433343+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:59:37.433343+0000","last_peered":"2024-04-26T17:59:37.433343+0000","last_clean":"2024-04-26T17:59:37.433343+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:59:37.433343+0000","last_undegraded":"2024-04-26T17:59:37.433343+0000","last_fullsized":"2024-04-26T17:59:37.433343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658964+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:59:37.658964+0000","last_peered":"2024-04-26T17:59:37.658964+0000","last_clean":"2024-04-26T17:59:37.658964+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:59:37.658964+0000","last_undegraded":"2024-04-26T17:59:37.658964+0000","last_fullsized":"2024-04-26T17:59:37.658964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416384+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:59:37.416384+0000","last_peered":"2024-04-26T17:59:37.416384+0000","last_clean":"2024-04-26T17:59:37.416384+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:59:37.416384+0000","last_undegraded":"2024-04-26T17:59:37.416384+0000","last_fullsized":"2024-04-26T17:59:37.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659292+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:59:37.659292+0000","last_peered":"2024-04-26T17:59:37.659292+0000","last_clean":"2024-04-26T17:59:37.659292+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:59:37.659292+0000","last_undegraded":"2024-04-26T17:59:37.659292+0000","last_fullsized":"2024-04-26T17:59:37.659292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'39","reported_seq":76,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.621866+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:59:37.621866+0000","last_peered":"2024-04-26T17:59:37.621866+0000","last_clean":"2024-04-26T17:59:37.621866+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:59:37.621866+0000","last_undegraded":"2024-04-26T17:59:37.621866+0000","last_fullsized":"2024-04-26T17:59:37.621866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658840+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:59:37.658840+0000","last_peered":"2024-04-26T17:59:37.658840+0000","last_clean":"2024-04-26T17:59:37.658840+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:59:37.658840+0000","last_undegraded":"2024-04-26T17:59:37.658840+0000","last_fullsized":"2024-04-26T17:59:37.658840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658842+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:59:37.658842+0000","last_peered":"2024-04-26T17:59:37.658842+0000","last_clean":"2024-04-26T17:59:37.658842+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:59:37.658842+0000","last_undegraded":"2024-04-26T17:59:37.658842+0000","last_fullsized":"2024-04-26T17:59:37.658842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659020+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:59:37.659020+0000","last_peered":"2024-04-26T17:59:37.659020+0000","last_clean":"2024-04-26T17:59:37.659020+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:59:37.659020+0000","last_undegraded":"2024-04-26T17:59:37.659020+0000","last_fullsized":"2024-04-26T17:59:37.659020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740252+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:59:37.740252+0000","last_peered":"2024-04-26T17:59:37.740252+0000","last_clean":"2024-04-26T17:59:37.740252+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:59:37.740252+0000","last_undegraded":"2024-04-26T17:59:37.740252+0000","last_fullsized":"2024-04-26T17:59:37.740252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416182+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:59:37.416182+0000","last_peered":"2024-04-26T17:59:37.416182+0000","last_clean":"2024-04-26T17:59:37.416182+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:59:37.416182+0000","last_undegraded":"2024-04-26T17:59:37.416182+0000","last_fullsized":"2024-04-26T17:59:37.416182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416143+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:59:37.416143+0000","last_peered":"2024-04-26T17:59:37.416143+0000","last_clean":"2024-04-26T17:59:37.416143+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:59:37.416143+0000","last_undegraded":"2024-04-26T17:59:37.416143+0000","last_fullsized":"2024-04-26T17:59:37.416143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661251+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:59:37.661251+0000","last_peered":"2024-04-26T17:59:37.661251+0000","last_clean":"2024-04-26T17:59:37.661251+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:59:37.661251+0000","last_undegraded":"2024-04-26T17:59:37.661251+0000","last_fullsized":"2024-04-26T17:59:37.661251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658982+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:59:37.658982+0000","last_peered":"2024-04-26T17:59:37.658982+0000","last_clean":"2024-04-26T17:59:37.658982+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:59:37.658982+0000","last_undegraded":"2024-04-26T17:59:37.658982+0000","last_fullsized":"2024-04-26T17:59:37.658982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740416+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:59:37.740416+0000","last_peered":"2024-04-26T17:59:37.740416+0000","last_clean":"2024-04-26T17:59:37.740416+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:59:37.740416+0000","last_undegraded":"2024-04-26T17:59:37.740416+0000","last_fullsized":"2024-04-26T17:59:37.740416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416488+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:59:37.416488+0000","last_peered":"2024-04-26T17:59:37.416488+0000","last_clean":"2024-04-26T17:59:37.416488+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:59:37.416488+0000","last_undegraded":"2024-04-26T17:59:37.416488+0000","last_fullsized":"2024-04-26T17:59:37.416488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514666+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:59:37.514666+0000","last_peered":"2024-04-26T17:59:37.514666+0000","last_clean":"2024-04-26T17:59:37.514666+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:59:37.514666+0000","last_undegraded":"2024-04-26T17:59:37.514666+0000","last_fullsized":"2024-04-26T17:59:37.514666+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519901+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:59:37.519901+0000","last_peered":"2024-04-26T17:59:37.519901+0000","last_clean":"2024-04-26T17:59:37.519901+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:59:37.519901+0000","last_undegraded":"2024-04-26T17:59:37.519901+0000","last_fullsized":"2024-04-26T17:59:37.519901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513879+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:59:37.513879+0000","last_peered":"2024-04-26T17:59:37.513879+0000","last_clean":"2024-04-26T17:59:37.513879+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:59:37.513879+0000","last_undegraded":"2024-04-26T17:59:37.513879+0000","last_fullsized":"2024-04-26T17:59:37.513879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666668+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:59:37.666668+0000","last_peered":"2024-04-26T17:59:37.666668+0000","last_clean":"2024-04-26T17:59:37.666668+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:59:37.666668+0000","last_undegraded":"2024-04-26T17:59:37.666668+0000","last_fullsized":"2024-04-26T17:59:37.666668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659179+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:59:37.659179+0000","last_peered":"2024-04-26T17:59:37.659179+0000","last_clean":"2024-04-26T17:59:37.659179+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:59:37.659179+0000","last_undegraded":"2024-04-26T17:59:37.659179+0000","last_fullsized":"2024-04-26T17:59:37.659179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740277+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:59:37.740277+0000","last_peered":"2024-04-26T17:59:37.740277+0000","last_clean":"2024-04-26T17:59:37.740277+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:59:37.740277+0000","last_undegraded":"2024-04-26T17:59:37.740277+0000","last_fullsized":"2024-04-26T17:59:37.740277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595927,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1190,"num_read_kb":703,"num_write":293,"num_write_kb":1436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1787781,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383734,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":488568,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645372,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":1132354,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":882020,"data_compressed":22032,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1028096,"data_stored":881358,"data_compressed":22032,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1081885,"data_compressed":39022,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495698,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":488193,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":553865,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":489464,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1081344,"data_stored":551350,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182497,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":489016,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920860,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":489603,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":1212778,"data_compressed":45178,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134307,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":199448,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:59:42.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:59:42.923 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:43.316 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.317 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:43.318 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:43.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi092:/etc/ceph/ceph.conf 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi156:/etc/ceph/ceph.conf 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi189:/etc/ceph/ceph.conf 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi092:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: Updating smithi189:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T17:59:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T17:59:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T17:59:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T17:59:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:44 smithi189 ceph-mon[32756]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:44 smithi156 ceph-mon[32679]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:44.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:44 smithi092 ceph-mon[29156]: Updating smithi156:/var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-26T17:59:44.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 -- 172.21.15.92:0/2054445751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74681083a0 msgr2=0x7f7468108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 --2- 172.21.15.92:0/2054445751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74681083a0 0x7f7468108780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f745c009990 tx=0x7f745c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 -- 172.21.15.92:0/2054445751 shutdown_connections 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 --2- 172.21.15.92:0/2054445751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7468102d00 0x7f746810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 --2- 172.21.15.92:0/2054445751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74681083a0 0x7f7468108780 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 --2- 172.21.15.92:0/2054445751 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102360 0x7f74681027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 -- 172.21.15.92:0/2054445751 >> 172.21.15.92:0/2054445751 conn(0x7f7468079250 msgr2=0x7f7468079660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 -- 172.21.15.92:0/2054445751 shutdown_connections 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 -- 172.21.15.92:0/2054445751 wait complete. 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.708+0000 7f746d704700 1 Processor -- start 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 -- start start 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:44.711 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102d00 0x7f746819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 0x7f74681a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112590 con 0x7f7468102360 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112410 con 0x7f74681083a0 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f746d704700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7468112710 con 0x7f7468102d00 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36740/0 (socket says 172.21.15.92:36740) 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 -- 172.21.15.92:0/1094364347 learned_addr learned my addr 172.21.15.92:0/1094364347 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f74667fc700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102d00 0x7f746819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f74677fe700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 0x7f74681a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 -- 172.21.15.92:0/1094364347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102d00 msgr2=0x7f746819afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102d00 0x7f746819afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 -- 172.21.15.92:0/1094364347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 msgr2=0x7f74681a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:44.712 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 0x7f74681a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f7466ffd700 1 -- 172.21.15.92:0/1094364347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74681a6030 con 0x7f7468102360 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.709+0000 7f74677fe700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 0x7f74681a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f7466ffd700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f745c0057f0 tx=0x7f745c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c027070 con 0x7f7468102360 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74681a6200 con 0x7f7468102360 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f745c0040a0 con 0x7f7468102360 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c022dc0 con 0x7f7468102360 2024-04-26T17:59:44.713 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.710+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74681a6730 con 0x7f7468102360 2024-04-26T17:59:44.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.711+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468103a50 con 0x7f7468102360 2024-04-26T17:59:44.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.712+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f745c02a070 con 0x7f7468102360 2024-04-26T17:59:44.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.713+0000 7f744ffff700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 0x7f74500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:44.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.713+0000 7f74667fc700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 0x7f74500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:44.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.713+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f745c0d1de0 con 0x7f7468102360 2024-04-26T17:59:44.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.713+0000 7f74667fc700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 0x7f74500a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7468079a00 tx=0x7f7458009190 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:44.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.717+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f745c031020 con 0x7f7468102360 2024-04-26T17:59:44.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.910+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7468063860 con 0x7f74500a3e40 2024-04-26T17:59:44.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.918+0000 7f744ffff700 1 -- 172.21.15.92:0/1094364347 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257999 (secure 0 0 0) 0x7f7468063860 con 0x7f74500a3e40 2024-04-26T17:59:44.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:44.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 msgr2=0x7f74500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:44.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 0x7f74500a6300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7468079a00 tx=0x7f7458009190 comp rx=0 tx=0).stop 2024-04-26T17:59:44.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 msgr2=0x7f746819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:44.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f745c0057f0 tx=0x7f745c003680 comp rx=0 tx=0).stop 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 shutdown_connections 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f74500a3e40 0x7f74500a6300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74681083a0 0x7f74681a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7468102360 0x7f746819aa70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 --2- 172.21.15.92:0/1094364347 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7468102d00 0x7f746819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.920+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 >> 172.21.15.92:0/1094364347 conn(0x7f7468079250 msgr2=0x7f74681012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.921+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 shutdown_connections 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:44.921+0000 7f746d704700 1 -- 172.21.15.92:0/1094364347 wait complete. 2024-04-26T17:59:44.924 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:59:45.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:45 smithi092 ceph-mon[29156]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:45 smithi189 ceph-mon[32756]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:45 smithi156 ceph-mon[32679]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-26T17:59:45.649 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-04-26T17:59:43.426460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186529,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1326,"num_read_kb":822,"num_write":476,"num_write_kb":4376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":373880,"kb_used_data":12208,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567944,"statfs":{"total":1151940427776,"available":1151557574656,"internally_reserved":0,"allocated":12500992,"data_stored":8740454,"data_compressed":184602,"data_compressed_allocated":237568,"data_compressed_original":2768896,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.986217"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740566+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:59:37.740566+0000","last_peered":"2024-04-26T17:59:37.740566+0000","last_clean":"2024-04-26T17:59:37.740566+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:59:37.740566+0000","last_undegraded":"2024-04-26T17:59:37.740566+0000","last_fullsized":"2024-04-26T17:59:37.740566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661342+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:59:37.661342+0000","last_peered":"2024-04-26T17:59:37.661342+0000","last_clean":"2024-04-26T17:59:37.661342+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:59:37.661342+0000","last_undegraded":"2024-04-26T17:59:37.661342+0000","last_fullsized":"2024-04-26T17:59:37.661342+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661566+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:59:37.661566+0000","last_peered":"2024-04-26T17:59:37.661566+0000","last_clean":"2024-04-26T17:59:37.661566+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:59:37.661566+0000","last_undegraded":"2024-04-26T17:59:37.661566+0000","last_fullsized":"2024-04-26T17:59:37.661566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414896+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:59:37.414896+0000","last_peered":"2024-04-26T17:59:37.414896+0000","last_clean":"2024-04-26T17:59:37.414896+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:59:37.414896+0000","last_undegraded":"2024-04-26T17:59:37.414896+0000","last_fullsized":"2024-04-26T17:59:37.414896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433347+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:59:37.433347+0000","last_peered":"2024-04-26T17:59:37.433347+0000","last_clean":"2024-04-26T17:59:37.433347+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:59:37.433347+0000","last_undegraded":"2024-04-26T17:59:37.433347+0000","last_fullsized":"2024-04-26T17:59:37.433347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522929+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:59:37.522929+0000","last_peered":"2024-04-26T17:59:37.522929+0000","last_clean":"2024-04-26T17:59:37.522929+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:59:37.522929+0000","last_undegraded":"2024-04-26T17:59:37.522929+0000","last_fullsized":"2024-04-26T17:59:37.522929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658714+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:59:37.658714+0000","last_peered":"2024-04-26T17:59:37.658714+0000","last_clean":"2024-04-26T17:59:37.658714+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:59:37.658714+0000","last_undegraded":"2024-04-26T17:59:37.658714+0000","last_fullsized":"2024-04-26T17:59:37.658714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513832+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:59:37.513832+0000","last_peered":"2024-04-26T17:59:37.513832+0000","last_clean":"2024-04-26T17:59:37.513832+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:59:37.513832+0000","last_undegraded":"2024-04-26T17:59:37.513832+0000","last_fullsized":"2024-04-26T17:59:37.513832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.667023+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:59:37.667023+0000","last_peered":"2024-04-26T17:59:37.667023+0000","last_clean":"2024-04-26T17:59:37.667023+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:59:37.667023+0000","last_undegraded":"2024-04-26T17:59:37.667023+0000","last_fullsized":"2024-04-26T17:59:37.667023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523173+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:59:37.523173+0000","last_peered":"2024-04-26T17:59:37.523173+0000","last_clean":"2024-04-26T17:59:37.523173+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:59:37.523173+0000","last_undegraded":"2024-04-26T17:59:37.523173+0000","last_fullsized":"2024-04-26T17:59:37.523173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659152+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:59:37.659152+0000","last_peered":"2024-04-26T17:59:37.659152+0000","last_clean":"2024-04-26T17:59:37.659152+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:59:37.659152+0000","last_undegraded":"2024-04-26T17:59:37.659152+0000","last_fullsized":"2024-04-26T17:59:37.659152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413434+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:59:37.413434+0000","last_peered":"2024-04-26T17:59:37.413434+0000","last_clean":"2024-04-26T17:59:37.413434+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:59:37.413434+0000","last_undegraded":"2024-04-26T17:59:37.413434+0000","last_fullsized":"2024-04-26T17:59:37.413434+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659181+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:59:37.659181+0000","last_peered":"2024-04-26T17:59:37.659181+0000","last_clean":"2024-04-26T17:59:37.659181+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:59:37.659181+0000","last_undegraded":"2024-04-26T17:59:37.659181+0000","last_fullsized":"2024-04-26T17:59:37.659181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661084+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:59:37.661084+0000","last_peered":"2024-04-26T17:59:37.661084+0000","last_clean":"2024-04-26T17:59:37.661084+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:59:37.661084+0000","last_undegraded":"2024-04-26T17:59:37.661084+0000","last_fullsized":"2024-04-26T17:59:37.661084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661071+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:59:37.661071+0000","last_peered":"2024-04-26T17:59:37.661071+0000","last_clean":"2024-04-26T17:59:37.661071+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:59:37.661071+0000","last_undegraded":"2024-04-26T17:59:37.661071+0000","last_fullsized":"2024-04-26T17:59:37.661071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666463+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:59:37.666463+0000","last_peered":"2024-04-26T17:59:37.666463+0000","last_clean":"2024-04-26T17:59:37.666463+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:59:37.666463+0000","last_undegraded":"2024-04-26T17:59:37.666463+0000","last_fullsized":"2024-04-26T17:59:37.666463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740636+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:59:37.740636+0000","last_peered":"2024-04-26T17:59:37.740636+0000","last_clean":"2024-04-26T17:59:37.740636+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:59:37.740636+0000","last_undegraded":"2024-04-26T17:59:37.740636+0000","last_fullsized":"2024-04-26T17:59:37.740636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413228+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:59:37.413228+0000","last_peered":"2024-04-26T17:59:37.413228+0000","last_clean":"2024-04-26T17:59:37.413228+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:59:37.413228+0000","last_undegraded":"2024-04-26T17:59:37.413228+0000","last_fullsized":"2024-04-26T17:59:37.413228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416476+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:59:37.416476+0000","last_peered":"2024-04-26T17:59:37.416476+0000","last_clean":"2024-04-26T17:59:37.416476+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:59:37.416476+0000","last_undegraded":"2024-04-26T17:59:37.416476+0000","last_fullsized":"2024-04-26T17:59:37.416476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413183+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:59:37.413183+0000","last_peered":"2024-04-26T17:59:37.413183+0000","last_clean":"2024-04-26T17:59:37.413183+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:59:37.413183+0000","last_undegraded":"2024-04-26T17:59:37.413183+0000","last_fullsized":"2024-04-26T17:59:37.413183+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514519+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:59:37.514519+0000","last_peered":"2024-04-26T17:59:37.514519+0000","last_clean":"2024-04-26T17:59:37.514519+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:59:37.514519+0000","last_undegraded":"2024-04-26T17:59:37.514519+0000","last_fullsized":"2024-04-26T17:59:37.514519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514734+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:59:37.514734+0000","last_peered":"2024-04-26T17:59:37.514734+0000","last_clean":"2024-04-26T17:59:37.514734+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:59:37.514734+0000","last_undegraded":"2024-04-26T17:59:37.514734+0000","last_fullsized":"2024-04-26T17:59:37.514734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661540+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:59:37.661540+0000","last_peered":"2024-04-26T17:59:37.661540+0000","last_clean":"2024-04-26T17:59:37.661540+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:59:37.661540+0000","last_undegraded":"2024-04-26T17:59:37.661540+0000","last_fullsized":"2024-04-26T17:59:37.661540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433648+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:59:37.433648+0000","last_peered":"2024-04-26T17:59:37.433648+0000","last_clean":"2024-04-26T17:59:37.433648+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433648+0000","last_undegraded":"2024-04-26T17:59:37.433648+0000","last_fullsized":"2024-04-26T17:59:37.433648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666554+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:59:37.666554+0000","last_peered":"2024-04-26T17:59:37.666554+0000","last_clean":"2024-04-26T17:59:37.666554+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:59:37.666554+0000","last_undegraded":"2024-04-26T17:59:37.666554+0000","last_fullsized":"2024-04-26T17:59:37.666554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433518+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:59:37.433518+0000","last_peered":"2024-04-26T17:59:37.433518+0000","last_clean":"2024-04-26T17:59:37.433518+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433518+0000","last_undegraded":"2024-04-26T17:59:37.433518+0000","last_fullsized":"2024-04-26T17:59:37.433518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520325+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:59:37.520325+0000","last_peered":"2024-04-26T17:59:37.520325+0000","last_clean":"2024-04-26T17:59:37.520325+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:59:37.520325+0000","last_undegraded":"2024-04-26T17:59:37.520325+0000","last_fullsized":"2024-04-26T17:59:37.520325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'9","reported_seq":221,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.996280+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:59:37.996280+0000","last_peered":"2024-04-26T17:59:37.996280+0000","last_clean":"2024-04-26T17:59:37.996280+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:59:37.996280+0000","last_undegraded":"2024-04-26T17:59:37.996280+0000","last_fullsized":"2024-04-26T17:59:37.996280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":183,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433140+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:59:37.433140+0000","last_peered":"2024-04-26T17:59:37.433140+0000","last_clean":"2024-04-26T17:59:37.433140+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:59:37.433140+0000","last_undegraded":"2024-04-26T17:59:37.433140+0000","last_fullsized":"2024-04-26T17:59:37.433140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522515+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:59:37.522515+0000","last_peered":"2024-04-26T17:59:37.522515+0000","last_clean":"2024-04-26T17:59:37.522515+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:59:37.522515+0000","last_undegraded":"2024-04-26T17:59:37.522515+0000","last_fullsized":"2024-04-26T17:59:37.522515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520206+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:59:37.520206+0000","last_peered":"2024-04-26T17:59:37.520206+0000","last_clean":"2024-04-26T17:59:37.520206+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:59:37.520206+0000","last_undegraded":"2024-04-26T17:59:37.520206+0000","last_fullsized":"2024-04-26T17:59:37.520206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658771+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:59:37.658771+0000","last_peered":"2024-04-26T17:59:37.658771+0000","last_clean":"2024-04-26T17:59:37.658771+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:59:37.658771+0000","last_undegraded":"2024-04-26T17:59:37.658771+0000","last_fullsized":"2024-04-26T17:59:37.658771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513671+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:59:37.513671+0000","last_peered":"2024-04-26T17:59:37.513671+0000","last_clean":"2024-04-26T17:59:37.513671+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:59:37.513671+0000","last_undegraded":"2024-04-26T17:59:37.513671+0000","last_fullsized":"2024-04-26T17:59:37.513671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519825+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:59:37.519825+0000","last_peered":"2024-04-26T17:59:37.519825+0000","last_clean":"2024-04-26T17:59:37.519825+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:59:37.519825+0000","last_undegraded":"2024-04-26T17:59:37.519825+0000","last_fullsized":"2024-04-26T17:59:37.519825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413020+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:59:37.413020+0000","last_peered":"2024-04-26T17:59:37.413020+0000","last_clean":"2024-04-26T17:59:37.413020+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:59:37.413020+0000","last_undegraded":"2024-04-26T17:59:37.413020+0000","last_fullsized":"2024-04-26T17:59:37.413020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522607+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:59:37.522607+0000","last_peered":"2024-04-26T17:59:37.522607+0000","last_clean":"2024-04-26T17:59:37.522607+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:59:37.522607+0000","last_undegraded":"2024-04-26T17:59:37.522607+0000","last_fullsized":"2024-04-26T17:59:37.522607+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666847+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:59:37.666847+0000","last_peered":"2024-04-26T17:59:37.666847+0000","last_clean":"2024-04-26T17:59:37.666847+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:59:37.666847+0000","last_undegraded":"2024-04-26T17:59:37.666847+0000","last_fullsized":"2024-04-26T17:59:37.666847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658664+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:59:37.658664+0000","last_peered":"2024-04-26T17:59:37.658664+0000","last_clean":"2024-04-26T17:59:37.658664+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:59:37.658664+0000","last_undegraded":"2024-04-26T17:59:37.658664+0000","last_fullsized":"2024-04-26T17:59:37.658664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661482+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:59:37.661482+0000","last_peered":"2024-04-26T17:59:37.661482+0000","last_clean":"2024-04-26T17:59:37.661482+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:59:37.661482+0000","last_undegraded":"2024-04-26T17:59:37.661482+0000","last_fullsized":"2024-04-26T17:59:37.661482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520367+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:59:37.520367+0000","last_peered":"2024-04-26T17:59:37.520367+0000","last_clean":"2024-04-26T17:59:37.520367+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:59:37.520367+0000","last_undegraded":"2024-04-26T17:59:37.520367+0000","last_fullsized":"2024-04-26T17:59:37.520367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666563+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:59:37.666563+0000","last_peered":"2024-04-26T17:59:37.666563+0000","last_clean":"2024-04-26T17:59:37.666563+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:59:37.666563+0000","last_undegraded":"2024-04-26T17:59:37.666563+0000","last_fullsized":"2024-04-26T17:59:37.666563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":431,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.995975+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:59:37.995975+0000","last_peered":"2024-04-26T17:59:37.995975+0000","last_clean":"2024-04-26T17:59:37.995975+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:59:37.995975+0000","last_undegraded":"2024-04-26T17:59:37.995975+0000","last_fullsized":"2024-04-26T17:59:37.995975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":367,"num_read_kb":247,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433484+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:59:37.433484+0000","last_peered":"2024-04-26T17:59:37.433484+0000","last_clean":"2024-04-26T17:59:37.433484+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:59:37.433484+0000","last_undegraded":"2024-04-26T17:59:37.433484+0000","last_fullsized":"2024-04-26T17:59:37.433484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416363+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:59:37.416363+0000","last_peered":"2024-04-26T17:59:37.416363+0000","last_clean":"2024-04-26T17:59:37.416363+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:59:37.416363+0000","last_undegraded":"2024-04-26T17:59:37.416363+0000","last_fullsized":"2024-04-26T17:59:37.416363+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658943+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:59:37.658943+0000","last_peered":"2024-04-26T17:59:37.658943+0000","last_clean":"2024-04-26T17:59:37.658943+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:59:37.658943+0000","last_undegraded":"2024-04-26T17:59:37.658943+0000","last_fullsized":"2024-04-26T17:59:37.658943+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520013+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:59:37.520013+0000","last_peered":"2024-04-26T17:59:37.520013+0000","last_clean":"2024-04-26T17:59:37.520013+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:59:37.520013+0000","last_undegraded":"2024-04-26T17:59:37.520013+0000","last_fullsized":"2024-04-26T17:59:37.520013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659175+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:59:37.659175+0000","last_peered":"2024-04-26T17:59:37.659175+0000","last_clean":"2024-04-26T17:59:37.659175+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:59:37.659175+0000","last_undegraded":"2024-04-26T17:59:37.659175+0000","last_fullsized":"2024-04-26T17:59:37.659175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'4","reported_seq":213,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:38.050848+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:59:38.050848+0000","last_peered":"2024-04-26T17:59:38.050848+0000","last_clean":"2024-04-26T17:59:38.050848+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:59:38.050848+0000","last_undegraded":"2024-04-26T17:59:38.050848+0000","last_fullsized":"2024-04-26T17:59:38.050848+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658630+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:59:37.658630+0000","last_peered":"2024-04-26T17:59:37.658630+0000","last_clean":"2024-04-26T17:59:37.658630+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:59:37.658630+0000","last_undegraded":"2024-04-26T17:59:37.658630+0000","last_fullsized":"2024-04-26T17:59:37.658630+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433113+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:59:37.433113+0000","last_peered":"2024-04-26T17:59:37.433113+0000","last_clean":"2024-04-26T17:59:37.433113+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:59:37.433113+0000","last_undegraded":"2024-04-26T17:59:37.433113+0000","last_fullsized":"2024-04-26T17:59:37.433113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519985+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:59:37.519985+0000","last_peered":"2024-04-26T17:59:37.519985+0000","last_clean":"2024-04-26T17:59:37.519985+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:59:37.519985+0000","last_undegraded":"2024-04-26T17:59:37.519985+0000","last_fullsized":"2024-04-26T17:59:37.519985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433698+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:59:37.433698+0000","last_peered":"2024-04-26T17:59:37.433698+0000","last_clean":"2024-04-26T17:59:37.433698+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:59:37.433698+0000","last_undegraded":"2024-04-26T17:59:37.433698+0000","last_fullsized":"2024-04-26T17:59:37.433698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740443+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:59:37.740443+0000","last_peered":"2024-04-26T17:59:37.740443+0000","last_clean":"2024-04-26T17:59:37.740443+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:59:37.740443+0000","last_undegraded":"2024-04-26T17:59:37.740443+0000","last_fullsized":"2024-04-26T17:59:37.740443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413268+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:59:37.413268+0000","last_peered":"2024-04-26T17:59:37.413268+0000","last_clean":"2024-04-26T17:59:37.413268+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:59:37.413268+0000","last_undegraded":"2024-04-26T17:59:37.413268+0000","last_fullsized":"2024-04-26T17:59:37.413268+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523043+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:59:37.523043+0000","last_peered":"2024-04-26T17:59:37.523043+0000","last_clean":"2024-04-26T17:59:37.523043+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:59:37.523043+0000","last_undegraded":"2024-04-26T17:59:37.523043+0000","last_fullsized":"2024-04-26T17:59:37.523043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658887+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:59:37.658887+0000","last_peered":"2024-04-26T17:59:37.658887+0000","last_clean":"2024-04-26T17:59:37.658887+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:59:37.658887+0000","last_undegraded":"2024-04-26T17:59:37.658887+0000","last_fullsized":"2024-04-26T17:59:37.658887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522908+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:59:37.522908+0000","last_peered":"2024-04-26T17:59:37.522908+0000","last_clean":"2024-04-26T17:59:37.522908+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:59:37.522908+0000","last_undegraded":"2024-04-26T17:59:37.522908+0000","last_fullsized":"2024-04-26T17:59:37.522908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520014+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:59:37.520014+0000","last_peered":"2024-04-26T17:59:37.520014+0000","last_clean":"2024-04-26T17:59:37.520014+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:59:37.520014+0000","last_undegraded":"2024-04-26T17:59:37.520014+0000","last_fullsized":"2024-04-26T17:59:37.520014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":211,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.660715+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:59:37.660715+0000","last_peered":"2024-04-26T17:59:37.660715+0000","last_clean":"2024-04-26T17:59:37.660715+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:59:37.660715+0000","last_undegraded":"2024-04-26T17:59:37.660715+0000","last_fullsized":"2024-04-26T17:59:37.660715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514153+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:59:37.514153+0000","last_peered":"2024-04-26T17:59:37.514153+0000","last_clean":"2024-04-26T17:59:37.514153+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:59:37.514153+0000","last_undegraded":"2024-04-26T17:59:37.514153+0000","last_fullsized":"2024-04-26T17:59:37.514153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414769+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:59:37.414769+0000","last_peered":"2024-04-26T17:59:37.414769+0000","last_clean":"2024-04-26T17:59:37.414769+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:59:37.414769+0000","last_undegraded":"2024-04-26T17:59:37.414769+0000","last_fullsized":"2024-04-26T17:59:37.414769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":360,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658825+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:59:37.658825+0000","last_peered":"2024-04-26T17:59:37.658825+0000","last_clean":"2024-04-26T17:59:37.658825+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:59:37.658825+0000","last_undegraded":"2024-04-26T17:59:37.658825+0000","last_fullsized":"2024-04-26T17:59:37.658825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659098+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:59:37.659098+0000","last_peered":"2024-04-26T17:59:37.659098+0000","last_clean":"2024-04-26T17:59:37.659098+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:59:37.659098+0000","last_undegraded":"2024-04-26T17:59:37.659098+0000","last_fullsized":"2024-04-26T17:59:37.659098+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658559+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:59:37.658559+0000","last_peered":"2024-04-26T17:59:37.658559+0000","last_clean":"2024-04-26T17:59:37.658559+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:59:37.658559+0000","last_undegraded":"2024-04-26T17:59:37.658559+0000","last_fullsized":"2024-04-26T17:59:37.658559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433495+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:59:37.433495+0000","last_peered":"2024-04-26T17:59:37.433495+0000","last_clean":"2024-04-26T17:59:37.433495+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:59:37.433495+0000","last_undegraded":"2024-04-26T17:59:37.433495+0000","last_fullsized":"2024-04-26T17:59:37.433495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659044+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:59:37.659044+0000","last_peered":"2024-04-26T17:59:37.659044+0000","last_clean":"2024-04-26T17:59:37.659044+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:59:37.659044+0000","last_undegraded":"2024-04-26T17:59:37.659044+0000","last_fullsized":"2024-04-26T17:59:37.659044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'46","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.624123+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:59:37.624123+0000","last_peered":"2024-04-26T17:59:37.624123+0000","last_clean":"2024-04-26T17:59:37.624123+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:59:37.624123+0000","last_undegraded":"2024-04-26T17:59:37.624123+0000","last_fullsized":"2024-04-26T17:59:37.624123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514588+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:59:37.514588+0000","last_peered":"2024-04-26T17:59:37.514588+0000","last_clean":"2024-04-26T17:59:37.514588+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:59:37.514588+0000","last_undegraded":"2024-04-26T17:59:37.514588+0000","last_fullsized":"2024-04-26T17:59:37.514588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.415027+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:59:37.415027+0000","last_peered":"2024-04-26T17:59:37.415027+0000","last_clean":"2024-04-26T17:59:37.415027+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:59:37.415027+0000","last_undegraded":"2024-04-26T17:59:37.415027+0000","last_fullsized":"2024-04-26T17:59:37.415027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661412+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:59:37.661412+0000","last_peered":"2024-04-26T17:59:37.661412+0000","last_clean":"2024-04-26T17:59:37.661412+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:59:37.661412+0000","last_undegraded":"2024-04-26T17:59:37.661412+0000","last_fullsized":"2024-04-26T17:59:37.661412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666413+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:59:37.666413+0000","last_peered":"2024-04-26T17:59:37.666413+0000","last_clean":"2024-04-26T17:59:37.666413+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:59:37.666413+0000","last_undegraded":"2024-04-26T17:59:37.666413+0000","last_fullsized":"2024-04-26T17:59:37.666413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433121+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:59:37.433121+0000","last_peered":"2024-04-26T17:59:37.433121+0000","last_clean":"2024-04-26T17:59:37.433121+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:59:37.433121+0000","last_undegraded":"2024-04-26T17:59:37.433121+0000","last_fullsized":"2024-04-26T17:59:37.433121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513579+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:59:37.513579+0000","last_peered":"2024-04-26T17:59:37.513579+0000","last_clean":"2024-04-26T17:59:37.513579+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:59:37.513579+0000","last_undegraded":"2024-04-26T17:59:37.513579+0000","last_fullsized":"2024-04-26T17:59:37.513579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740174+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:59:37.740174+0000","last_peered":"2024-04-26T17:59:37.740174+0000","last_clean":"2024-04-26T17:59:37.740174+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:59:37.740174+0000","last_undegraded":"2024-04-26T17:59:37.740174+0000","last_fullsized":"2024-04-26T17:59:37.740174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740320+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:59:37.740320+0000","last_peered":"2024-04-26T17:59:37.740320+0000","last_clean":"2024-04-26T17:59:37.740320+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:59:37.740320+0000","last_undegraded":"2024-04-26T17:59:37.740320+0000","last_fullsized":"2024-04-26T17:59:37.740320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514430+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:59:37.514430+0000","last_peered":"2024-04-26T17:59:37.514430+0000","last_clean":"2024-04-26T17:59:37.514430+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:59:37.514430+0000","last_undegraded":"2024-04-26T17:59:37.514430+0000","last_fullsized":"2024-04-26T17:59:37.514430+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433343+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:59:37.433343+0000","last_peered":"2024-04-26T17:59:37.433343+0000","last_clean":"2024-04-26T17:59:37.433343+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:59:37.433343+0000","last_undegraded":"2024-04-26T17:59:37.433343+0000","last_fullsized":"2024-04-26T17:59:37.433343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658964+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:59:37.658964+0000","last_peered":"2024-04-26T17:59:37.658964+0000","last_clean":"2024-04-26T17:59:37.658964+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:59:37.658964+0000","last_undegraded":"2024-04-26T17:59:37.658964+0000","last_fullsized":"2024-04-26T17:59:37.658964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416384+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:59:37.416384+0000","last_peered":"2024-04-26T17:59:37.416384+0000","last_clean":"2024-04-26T17:59:37.416384+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:59:37.416384+0000","last_undegraded":"2024-04-26T17:59:37.416384+0000","last_fullsized":"2024-04-26T17:59:37.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659292+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:59:37.659292+0000","last_peered":"2024-04-26T17:59:37.659292+0000","last_clean":"2024-04-26T17:59:37.659292+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:59:37.659292+0000","last_undegraded":"2024-04-26T17:59:37.659292+0000","last_fullsized":"2024-04-26T17:59:37.659292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'39","reported_seq":76,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.621866+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:59:37.621866+0000","last_peered":"2024-04-26T17:59:37.621866+0000","last_clean":"2024-04-26T17:59:37.621866+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:59:37.621866+0000","last_undegraded":"2024-04-26T17:59:37.621866+0000","last_fullsized":"2024-04-26T17:59:37.621866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658840+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:59:37.658840+0000","last_peered":"2024-04-26T17:59:37.658840+0000","last_clean":"2024-04-26T17:59:37.658840+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:59:37.658840+0000","last_undegraded":"2024-04-26T17:59:37.658840+0000","last_fullsized":"2024-04-26T17:59:37.658840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658842+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:59:37.658842+0000","last_peered":"2024-04-26T17:59:37.658842+0000","last_clean":"2024-04-26T17:59:37.658842+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:59:37.658842+0000","last_undegraded":"2024-04-26T17:59:37.658842+0000","last_fullsized":"2024-04-26T17:59:37.658842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659020+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:59:37.659020+0000","last_peered":"2024-04-26T17:59:37.659020+0000","last_clean":"2024-04-26T17:59:37.659020+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:59:37.659020+0000","last_undegraded":"2024-04-26T17:59:37.659020+0000","last_fullsized":"2024-04-26T17:59:37.659020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740252+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:59:37.740252+0000","last_peered":"2024-04-26T17:59:37.740252+0000","last_clean":"2024-04-26T17:59:37.740252+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:59:37.740252+0000","last_undegraded":"2024-04-26T17:59:37.740252+0000","last_fullsized":"2024-04-26T17:59:37.740252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416182+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:59:37.416182+0000","last_peered":"2024-04-26T17:59:37.416182+0000","last_clean":"2024-04-26T17:59:37.416182+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:59:37.416182+0000","last_undegraded":"2024-04-26T17:59:37.416182+0000","last_fullsized":"2024-04-26T17:59:37.416182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416143+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:59:37.416143+0000","last_peered":"2024-04-26T17:59:37.416143+0000","last_clean":"2024-04-26T17:59:37.416143+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:59:37.416143+0000","last_undegraded":"2024-04-26T17:59:37.416143+0000","last_fullsized":"2024-04-26T17:59:37.416143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661251+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:59:37.661251+0000","last_peered":"2024-04-26T17:59:37.661251+0000","last_clean":"2024-04-26T17:59:37.661251+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:59:37.661251+0000","last_undegraded":"2024-04-26T17:59:37.661251+0000","last_fullsized":"2024-04-26T17:59:37.661251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658982+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:59:37.658982+0000","last_peered":"2024-04-26T17:59:37.658982+0000","last_clean":"2024-04-26T17:59:37.658982+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:59:37.658982+0000","last_undegraded":"2024-04-26T17:59:37.658982+0000","last_fullsized":"2024-04-26T17:59:37.658982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740416+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:59:37.740416+0000","last_peered":"2024-04-26T17:59:37.740416+0000","last_clean":"2024-04-26T17:59:37.740416+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:59:37.740416+0000","last_undegraded":"2024-04-26T17:59:37.740416+0000","last_fullsized":"2024-04-26T17:59:37.740416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416488+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:59:37.416488+0000","last_peered":"2024-04-26T17:59:37.416488+0000","last_clean":"2024-04-26T17:59:37.416488+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:59:37.416488+0000","last_undegraded":"2024-04-26T17:59:37.416488+0000","last_fullsized":"2024-04-26T17:59:37.416488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514666+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:59:37.514666+0000","last_peered":"2024-04-26T17:59:37.514666+0000","last_clean":"2024-04-26T17:59:37.514666+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:59:37.514666+0000","last_undegraded":"2024-04-26T17:59:37.514666+0000","last_fullsized":"2024-04-26T17:59:37.514666+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519901+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:59:37.519901+0000","last_peered":"2024-04-26T17:59:37.519901+0000","last_clean":"2024-04-26T17:59:37.519901+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:59:37.519901+0000","last_undegraded":"2024-04-26T17:59:37.519901+0000","last_fullsized":"2024-04-26T17:59:37.519901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513879+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:59:37.513879+0000","last_peered":"2024-04-26T17:59:37.513879+0000","last_clean":"2024-04-26T17:59:37.513879+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:59:37.513879+0000","last_undegraded":"2024-04-26T17:59:37.513879+0000","last_fullsized":"2024-04-26T17:59:37.513879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666668+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:59:37.666668+0000","last_peered":"2024-04-26T17:59:37.666668+0000","last_clean":"2024-04-26T17:59:37.666668+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:59:37.666668+0000","last_undegraded":"2024-04-26T17:59:37.666668+0000","last_fullsized":"2024-04-26T17:59:37.666668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659179+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:59:37.659179+0000","last_peered":"2024-04-26T17:59:37.659179+0000","last_clean":"2024-04-26T17:59:37.659179+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:59:37.659179+0000","last_undegraded":"2024-04-26T17:59:37.659179+0000","last_fullsized":"2024-04-26T17:59:37.659179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740277+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:59:37.740277+0000","last_peered":"2024-04-26T17:59:37.740277+0000","last_clean":"2024-04-26T17:59:37.740277+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:59:37.740277+0000","last_undegraded":"2024-04-26T17:59:37.740277+0000","last_fullsized":"2024-04-26T17:59:37.740277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595927,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1190,"num_read_kb":703,"num_write":293,"num_write_kb":1436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1787781,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383734,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":488568,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645372,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1130496,"data_stored":1132354,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808897,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":882020,"data_compressed":22032,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070534,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1028096,"data_stored":881358,"data_compressed":22032,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1081885,"data_compressed":39022,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495698,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":488193,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":553865,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":489464,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411430,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1081344,"data_stored":551350,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182497,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":489016,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920860,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":489603,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757334,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1089536,"data_stored":1212778,"data_compressed":45178,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134307,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":199448,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:59:45.653 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-26T17:59:45.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-26T17:59:45.895 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:46.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:46 smithi092 ceph-mon[29156]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:46 smithi189 ceph-mon[32756]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:46.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:46 smithi156 ceph-mon[32679]: from='client.15213 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:47.356 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:47 smithi092 ceph-mon[29156]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 75 op/s 2024-04-26T17:59:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:47 smithi189 ceph-mon[32756]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 75 op/s 2024-04-26T17:59:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:47 smithi156 ceph-mon[32679]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 131 KiB/s wr, 75 op/s 2024-04-26T17:59:47.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- 172.21.15.92:0/916828949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 msgr2=0x7f445c107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:47.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 --2- 172.21.15.92:0/916828949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c107ea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f444c009990 tx=0x7f444c009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- 172.21.15.92:0/916828949 shutdown_connections 2024-04-26T17:59:47.610 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 --2- 172.21.15.92:0/916828949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c102480 0x7f445c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 --2- 172.21.15.92:0/916828949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c107ea0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 --2- 172.21.15.92:0/916828949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c101ac0 0x7f445c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- 172.21.15.92:0/916828949 >> 172.21.15.92:0/916828949 conn(0x7f445c078920 msgr2=0x7f445c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:47.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- 172.21.15.92:0/916828949 shutdown_connections 2024-04-26T17:59:47.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- 172.21.15.92:0/916828949 wait complete. 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 Processor -- start 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.611+0000 7f4461e06700 1 -- start start 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c101ac0 0x7f445c0fdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c102480 0x7f445c0fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f445c112500 con 0x7f445c107ac0 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f445c112380 con 0x7f445c101ac0 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f4461e06700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f445c112680 con 0x7f445c102480 2024-04-26T17:59:47.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36756/0 (socket says 172.21.15.92:36756) 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445affd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c102480 0x7f445c0fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 -- 172.21.15.92:0/1923432488 learned_addr learned my addr 172.21.15.92:0/1923432488 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445b7fe700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c101ac0 0x7f445c0fdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 -- 172.21.15.92:0/1923432488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c102480 msgr2=0x7f445c0fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c102480 0x7f445c0fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 -- 172.21.15.92:0/1923432488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c101ac0 msgr2=0x7f445c0fdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c101ac0 0x7f445c0fdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 -- 172.21.15.92:0/1923432488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c1a7fd0 con 0x7f445c107ac0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.612+0000 7f445bfff700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f445400cca0 tx=0x7f445400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.613+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454016020 con 0x7f445c107ac0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.613+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454012420 con 0x7f445c107ac0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.613+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c1a82c0 con 0x7f445c107ac0 2024-04-26T17:59:47.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.613+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44540115a0 con 0x7f445c107ac0 2024-04-26T17:59:47.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.613+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1a8800 con 0x7f445c107ac0 2024-04-26T17:59:47.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.614+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c06a110 con 0x7f445c107ac0 2024-04-26T17:59:47.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.615+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f4454019020 con 0x7f445c107ac0 2024-04-26T17:59:47.615 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.615+0000 7f4458ff9700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 0x7f44440a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:47.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.615+0000 7f445b7fe700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 0x7f44440a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:47.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.615+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f44540d0570 con 0x7f445c107ac0 2024-04-26T17:59:47.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.616+0000 7f445b7fe700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 0x7f44440a6300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f444c00b5c0 tx=0x7f444c005960 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:47.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.620+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f4454020020 con 0x7f445c107ac0 2024-04-26T17:59:47.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.819+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 --> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f445c104800 con 0x7f44440a3e40 2024-04-26T17:59:47.825 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.826+0000 7f4458ff9700 1 -- 172.21.15.92:0/1923432488 <== mgr.15111 v2:172.21.15.92:6800/1487524229 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258032 (secure 0 0 0) 0x7f445c104800 con 0x7f44440a3e40 2024-04-26T17:59:47.829 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 msgr2=0x7f44440a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 0x7f44440a6300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f444c00b5c0 tx=0x7f444c005960 comp rx=0 tx=0).stop 2024-04-26T17:59:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 msgr2=0x7f445c0fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f445400cca0 tx=0x7f445400a060 comp rx=0 tx=0).stop 2024-04-26T17:59:47.831 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 shutdown_connections 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f44440a3e40 0x7f44440a6300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f445c101ac0 0x7f445c0fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f445c107ac0 0x7f445c0fe7e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 --2- 172.21.15.92:0/1923432488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f445c102480 0x7f445c0fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 >> 172.21.15.92:0/1923432488 conn(0x7f445c078920 msgr2=0x7f445c10f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 shutdown_connections 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:47.830+0000 7f4461e06700 1 -- 172.21.15.92:0/1923432488 wait complete. 2024-04-26T17:59:47.832 INFO:teuthology.orchestra.run.smithi092.stderr:dumped all 2024-04-26T17:59:48.532 INFO:teuthology.orchestra.run.smithi092.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-04-26T17:59:47.427576+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1383161,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1710,"num_read_kb":1278,"num_write":622,"num_write_kb":5290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":957,"ondisk_log_size":957,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374044,"kb_used_data":12360,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567780,"statfs":{"total":1151940427776,"available":1151557406720,"internally_reserved":0,"allocated":12656640,"data_stored":10005315,"data_compressed":246513,"data_compressed_allocated":319488,"data_compressed_original":3969024,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":384,"num_read_kb":456,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.987332"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740566+0000","last_change":"2024-04-26T17:56:20.484876+0000","last_active":"2024-04-26T17:59:37.740566+0000","last_peered":"2024-04-26T17:59:37.740566+0000","last_clean":"2024-04-26T17:59:37.740566+0000","last_became_active":"2024-04-26T17:56:20.484548+0000","last_became_peered":"2024-04-26T17:56:20.484548+0000","last_unstale":"2024-04-26T17:59:37.740566+0000","last_undegraded":"2024-04-26T17:59:37.740566+0000","last_fullsized":"2024-04-26T17:59:37.740566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:56.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661342+0000","last_change":"2024-04-26T17:56:20.479268+0000","last_active":"2024-04-26T17:59:37.661342+0000","last_peered":"2024-04-26T17:59:37.661342+0000","last_clean":"2024-04-26T17:59:37.661342+0000","last_became_active":"2024-04-26T17:56:20.478933+0000","last_became_peered":"2024-04-26T17:56:20.478933+0000","last_unstale":"2024-04-26T17:59:37.661342+0000","last_undegraded":"2024-04-26T17:59:37.661342+0000","last_fullsized":"2024-04-26T17:59:37.661342+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.895449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661566+0000","last_change":"2024-04-26T17:56:20.482309+0000","last_active":"2024-04-26T17:59:37.661566+0000","last_peered":"2024-04-26T17:59:37.661566+0000","last_clean":"2024-04-26T17:59:37.661566+0000","last_became_active":"2024-04-26T17:56:20.482000+0000","last_became_peered":"2024-04-26T17:56:20.482000+0000","last_unstale":"2024-04-26T17:59:37.661566+0000","last_undegraded":"2024-04-26T17:59:37.661566+0000","last_fullsized":"2024-04-26T17:59:37.661566+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:24.948510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414896+0000","last_change":"2024-04-26T17:56:20.478728+0000","last_active":"2024-04-26T17:59:37.414896+0000","last_peered":"2024-04-26T17:59:37.414896+0000","last_clean":"2024-04-26T17:59:37.414896+0000","last_became_active":"2024-04-26T17:56:20.478409+0000","last_became_peered":"2024-04-26T17:56:20.478409+0000","last_unstale":"2024-04-26T17:59:37.414896+0000","last_undegraded":"2024-04-26T17:59:37.414896+0000","last_fullsized":"2024-04-26T17:59:37.414896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:39.720983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433347+0000","last_change":"2024-04-26T17:56:20.482449+0000","last_active":"2024-04-26T17:59:37.433347+0000","last_peered":"2024-04-26T17:59:37.433347+0000","last_clean":"2024-04-26T17:59:37.433347+0000","last_became_active":"2024-04-26T17:56:20.482080+0000","last_became_peered":"2024-04-26T17:56:20.482080+0000","last_unstale":"2024-04-26T17:59:37.433347+0000","last_undegraded":"2024-04-26T17:59:37.433347+0000","last_fullsized":"2024-04-26T17:59:37.433347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:29.488851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522929+0000","last_change":"2024-04-26T17:56:20.482504+0000","last_active":"2024-04-26T17:59:37.522929+0000","last_peered":"2024-04-26T17:59:37.522929+0000","last_clean":"2024-04-26T17:59:37.522929+0000","last_became_active":"2024-04-26T17:56:20.482184+0000","last_became_peered":"2024-04-26T17:56:20.482184+0000","last_unstale":"2024-04-26T17:59:37.522929+0000","last_undegraded":"2024-04-26T17:59:37.522929+0000","last_fullsized":"2024-04-26T17:59:37.522929+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:19:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658714+0000","last_change":"2024-04-26T17:56:20.488026+0000","last_active":"2024-04-26T17:59:37.658714+0000","last_peered":"2024-04-26T17:59:37.658714+0000","last_clean":"2024-04-26T17:59:37.658714+0000","last_became_active":"2024-04-26T17:56:20.487611+0000","last_became_peered":"2024-04-26T17:56:20.487611+0000","last_unstale":"2024-04-26T17:59:37.658714+0000","last_undegraded":"2024-04-26T17:59:37.658714+0000","last_fullsized":"2024-04-26T17:59:37.658714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:16.502018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513832+0000","last_change":"2024-04-26T17:56:20.480948+0000","last_active":"2024-04-26T17:59:37.513832+0000","last_peered":"2024-04-26T17:59:37.513832+0000","last_clean":"2024-04-26T17:59:37.513832+0000","last_became_active":"2024-04-26T17:56:20.480441+0000","last_became_peered":"2024-04-26T17:56:20.480441+0000","last_unstale":"2024-04-26T17:59:37.513832+0000","last_undegraded":"2024-04-26T17:59:37.513832+0000","last_fullsized":"2024-04-26T17:59:37.513832+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:45.593069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.667023+0000","last_change":"2024-04-26T17:56:20.479108+0000","last_active":"2024-04-26T17:59:37.667023+0000","last_peered":"2024-04-26T17:59:37.667023+0000","last_clean":"2024-04-26T17:59:37.667023+0000","last_became_active":"2024-04-26T17:56:20.478751+0000","last_became_peered":"2024-04-26T17:56:20.478751+0000","last_unstale":"2024-04-26T17:59:37.667023+0000","last_undegraded":"2024-04-26T17:59:37.667023+0000","last_fullsized":"2024-04-26T17:59:37.667023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:52.321461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523173+0000","last_change":"2024-04-26T17:56:20.486553+0000","last_active":"2024-04-26T17:59:37.523173+0000","last_peered":"2024-04-26T17:59:37.523173+0000","last_clean":"2024-04-26T17:59:37.523173+0000","last_became_active":"2024-04-26T17:56:20.486198+0000","last_became_peered":"2024-04-26T17:56:20.486198+0000","last_unstale":"2024-04-26T17:59:37.523173+0000","last_undegraded":"2024-04-26T17:59:37.523173+0000","last_fullsized":"2024-04-26T17:59:37.523173+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:17.660246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659152+0000","last_change":"2024-04-26T17:56:20.486192+0000","last_active":"2024-04-26T17:59:37.659152+0000","last_peered":"2024-04-26T17:59:37.659152+0000","last_clean":"2024-04-26T17:59:37.659152+0000","last_became_active":"2024-04-26T17:56:20.485199+0000","last_became_peered":"2024-04-26T17:56:20.485199+0000","last_unstale":"2024-04-26T17:59:37.659152+0000","last_undegraded":"2024-04-26T17:59:37.659152+0000","last_fullsized":"2024-04-26T17:59:37.659152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:03.835084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413434+0000","last_change":"2024-04-26T17:56:58.628054+0000","last_active":"2024-04-26T17:59:37.413434+0000","last_peered":"2024-04-26T17:59:37.413434+0000","last_clean":"2024-04-26T17:59:37.413434+0000","last_became_active":"2024-04-26T17:56:58.627687+0000","last_became_peered":"2024-04-26T17:56:58.627687+0000","last_unstale":"2024-04-26T17:59:37.413434+0000","last_undegraded":"2024-04-26T17:59:37.413434+0000","last_fullsized":"2024-04-26T17:59:37.413434+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.806592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659181+0000","last_change":"2024-04-26T17:56:20.477099+0000","last_active":"2024-04-26T17:59:37.659181+0000","last_peered":"2024-04-26T17:59:37.659181+0000","last_clean":"2024-04-26T17:59:37.659181+0000","last_became_active":"2024-04-26T17:56:20.476784+0000","last_became_peered":"2024-04-26T17:56:20.476784+0000","last_unstale":"2024-04-26T17:59:37.659181+0000","last_undegraded":"2024-04-26T17:59:37.659181+0000","last_fullsized":"2024-04-26T17:59:37.659181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:03.809606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661084+0000","last_change":"2024-04-26T17:56:20.478558+0000","last_active":"2024-04-26T17:59:37.661084+0000","last_peered":"2024-04-26T17:59:37.661084+0000","last_clean":"2024-04-26T17:59:37.661084+0000","last_became_active":"2024-04-26T17:56:20.477539+0000","last_became_peered":"2024-04-26T17:56:20.477539+0000","last_unstale":"2024-04-26T17:59:37.661084+0000","last_undegraded":"2024-04-26T17:59:37.661084+0000","last_fullsized":"2024-04-26T17:59:37.661084+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:28.354635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661071+0000","last_change":"2024-04-26T17:56:20.487646+0000","last_active":"2024-04-26T17:59:37.661071+0000","last_peered":"2024-04-26T17:59:37.661071+0000","last_clean":"2024-04-26T17:59:37.661071+0000","last_became_active":"2024-04-26T17:56:20.487339+0000","last_became_peered":"2024-04-26T17:56:20.487339+0000","last_unstale":"2024-04-26T17:59:37.661071+0000","last_undegraded":"2024-04-26T17:59:37.661071+0000","last_fullsized":"2024-04-26T17:59:37.661071+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:58.657316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666463+0000","last_change":"2024-04-26T17:56:20.491162+0000","last_active":"2024-04-26T17:59:37.666463+0000","last_peered":"2024-04-26T17:59:37.666463+0000","last_clean":"2024-04-26T17:59:37.666463+0000","last_became_active":"2024-04-26T17:56:20.490817+0000","last_became_peered":"2024-04-26T17:56:20.490817+0000","last_unstale":"2024-04-26T17:59:37.666463+0000","last_undegraded":"2024-04-26T17:59:37.666463+0000","last_fullsized":"2024-04-26T17:59:37.666463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:59:09.596369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740636+0000","last_change":"2024-04-26T17:56:20.485074+0000","last_active":"2024-04-26T17:59:37.740636+0000","last_peered":"2024-04-26T17:59:37.740636+0000","last_clean":"2024-04-26T17:59:37.740636+0000","last_became_active":"2024-04-26T17:56:20.484580+0000","last_became_peered":"2024-04-26T17:56:20.484580+0000","last_unstale":"2024-04-26T17:59:37.740636+0000","last_undegraded":"2024-04-26T17:59:37.740636+0000","last_fullsized":"2024-04-26T17:59:37.740636+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:56.646783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413228+0000","last_change":"2024-04-26T17:56:20.475131+0000","last_active":"2024-04-26T17:59:37.413228+0000","last_peered":"2024-04-26T17:59:37.413228+0000","last_clean":"2024-04-26T17:59:37.413228+0000","last_became_active":"2024-04-26T17:56:20.474844+0000","last_became_peered":"2024-04-26T17:56:20.474844+0000","last_unstale":"2024-04-26T17:59:37.413228+0000","last_undegraded":"2024-04-26T17:59:37.413228+0000","last_fullsized":"2024-04-26T17:59:37.413228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:03.997129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416476+0000","last_change":"2024-04-26T17:56:20.484980+0000","last_active":"2024-04-26T17:59:37.416476+0000","last_peered":"2024-04-26T17:59:37.416476+0000","last_clean":"2024-04-26T17:59:37.416476+0000","last_became_active":"2024-04-26T17:56:20.484638+0000","last_became_peered":"2024-04-26T17:56:20.484638+0000","last_unstale":"2024-04-26T17:59:37.416476+0000","last_undegraded":"2024-04-26T17:59:37.416476+0000","last_fullsized":"2024-04-26T17:59:37.416476+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:22.145223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413183+0000","last_change":"2024-04-26T17:56:58.783365+0000","last_active":"2024-04-26T17:59:37.413183+0000","last_peered":"2024-04-26T17:59:37.413183+0000","last_clean":"2024-04-26T17:59:37.413183+0000","last_became_active":"2024-04-26T17:56:58.777734+0000","last_became_peered":"2024-04-26T17:56:58.777734+0000","last_unstale":"2024-04-26T17:59:37.413183+0000","last_undegraded":"2024-04-26T17:59:37.413183+0000","last_fullsized":"2024-04-26T17:59:37.413183+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:09:08.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514519+0000","last_change":"2024-04-26T17:56:20.479966+0000","last_active":"2024-04-26T17:59:37.514519+0000","last_peered":"2024-04-26T17:59:37.514519+0000","last_clean":"2024-04-26T17:59:37.514519+0000","last_became_active":"2024-04-26T17:56:20.479670+0000","last_became_peered":"2024-04-26T17:56:20.479670+0000","last_unstale":"2024-04-26T17:59:37.514519+0000","last_undegraded":"2024-04-26T17:59:37.514519+0000","last_fullsized":"2024-04-26T17:59:37.514519+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.586091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514734+0000","last_change":"2024-04-26T17:56:17.529063+0000","last_active":"2024-04-26T17:59:37.514734+0000","last_peered":"2024-04-26T17:59:37.514734+0000","last_clean":"2024-04-26T17:59:37.514734+0000","last_became_active":"2024-04-26T17:56:17.528513+0000","last_became_peered":"2024-04-26T17:56:17.528513+0000","last_unstale":"2024-04-26T17:59:37.514734+0000","last_undegraded":"2024-04-26T17:59:37.514734+0000","last_fullsized":"2024-04-26T17:59:37.514734+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:39.230078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661540+0000","last_change":"2024-04-26T17:56:20.482264+0000","last_active":"2024-04-26T17:59:37.661540+0000","last_peered":"2024-04-26T17:59:37.661540+0000","last_clean":"2024-04-26T17:59:37.661540+0000","last_became_active":"2024-04-26T17:56:20.481919+0000","last_became_peered":"2024-04-26T17:56:20.481919+0000","last_unstale":"2024-04-26T17:59:37.661540+0000","last_undegraded":"2024-04-26T17:59:37.661540+0000","last_fullsized":"2024-04-26T17:59:37.661540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:31.155020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433648+0000","last_change":"2024-04-26T17:56:17.458270+0000","last_active":"2024-04-26T17:59:37.433648+0000","last_peered":"2024-04-26T17:59:37.433648+0000","last_clean":"2024-04-26T17:59:37.433648+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433648+0000","last_undegraded":"2024-04-26T17:59:37.433648+0000","last_fullsized":"2024-04-26T17:59:37.433648+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:25:04.571077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666554+0000","last_change":"2024-04-26T17:56:20.483858+0000","last_active":"2024-04-26T17:59:37.666554+0000","last_peered":"2024-04-26T17:59:37.666554+0000","last_clean":"2024-04-26T17:59:37.666554+0000","last_became_active":"2024-04-26T17:56:20.483413+0000","last_became_peered":"2024-04-26T17:56:20.483413+0000","last_unstale":"2024-04-26T17:59:37.666554+0000","last_undegraded":"2024-04-26T17:59:37.666554+0000","last_fullsized":"2024-04-26T17:59:37.666554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:08.941709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433518+0000","last_change":"2024-04-26T17:56:17.458301+0000","last_active":"2024-04-26T17:59:37.433518+0000","last_peered":"2024-04-26T17:59:37.433518+0000","last_clean":"2024-04-26T17:59:37.433518+0000","last_became_active":"2024-04-26T17:56:17.457842+0000","last_became_peered":"2024-04-26T17:56:17.457842+0000","last_unstale":"2024-04-26T17:59:37.433518+0000","last_undegraded":"2024-04-26T17:59:37.433518+0000","last_fullsized":"2024-04-26T17:59:37.433518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:16.202798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520325+0000","last_change":"2024-04-26T17:56:20.477479+0000","last_active":"2024-04-26T17:59:37.520325+0000","last_peered":"2024-04-26T17:59:37.520325+0000","last_clean":"2024-04-26T17:59:37.520325+0000","last_became_active":"2024-04-26T17:56:20.477128+0000","last_became_peered":"2024-04-26T17:56:20.477128+0000","last_unstale":"2024-04-26T17:59:37.520325+0000","last_undegraded":"2024-04-26T17:59:37.520325+0000","last_fullsized":"2024-04-26T17:59:37.520325+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:10.349766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"91'9","reported_seq":226,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:42.001312+0000","last_change":"2024-04-26T17:56:17.460520+0000","last_active":"2024-04-26T17:59:42.001312+0000","last_peered":"2024-04-26T17:59:42.001312+0000","last_clean":"2024-04-26T17:59:42.001312+0000","last_became_active":"2024-04-26T17:56:17.460096+0000","last_became_peered":"2024-04-26T17:56:17.460096+0000","last_unstale":"2024-04-26T17:59:42.001312+0000","last_undegraded":"2024-04-26T17:59:42.001312+0000","last_fullsized":"2024-04-26T17:59:42.001312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":188,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433140+0000","last_change":"2024-04-26T17:56:20.477656+0000","last_active":"2024-04-26T17:59:37.433140+0000","last_peered":"2024-04-26T17:59:37.433140+0000","last_clean":"2024-04-26T17:59:37.433140+0000","last_became_active":"2024-04-26T17:56:20.477284+0000","last_became_peered":"2024-04-26T17:56:20.477284+0000","last_unstale":"2024-04-26T17:59:37.433140+0000","last_undegraded":"2024-04-26T17:59:37.433140+0000","last_fullsized":"2024-04-26T17:59:37.433140+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:36.702308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522515+0000","last_change":"2024-04-26T17:56:17.457175+0000","last_active":"2024-04-26T17:59:37.522515+0000","last_peered":"2024-04-26T17:59:37.522515+0000","last_clean":"2024-04-26T17:59:37.522515+0000","last_became_active":"2024-04-26T17:56:17.456211+0000","last_became_peered":"2024-04-26T17:56:17.456211+0000","last_unstale":"2024-04-26T17:59:37.522515+0000","last_undegraded":"2024-04-26T17:59:37.522515+0000","last_fullsized":"2024-04-26T17:59:37.522515+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:28.492170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520206+0000","last_change":"2024-04-26T17:56:20.467064+0000","last_active":"2024-04-26T17:59:37.520206+0000","last_peered":"2024-04-26T17:59:37.520206+0000","last_clean":"2024-04-26T17:59:37.520206+0000","last_became_active":"2024-04-26T17:56:20.466718+0000","last_became_peered":"2024-04-26T17:56:20.466718+0000","last_unstale":"2024-04-26T17:59:37.520206+0000","last_undegraded":"2024-04-26T17:59:37.520206+0000","last_fullsized":"2024-04-26T17:59:37.520206+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:10.912633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658771+0000","last_change":"2024-04-26T17:56:17.451829+0000","last_active":"2024-04-26T17:59:37.658771+0000","last_peered":"2024-04-26T17:59:37.658771+0000","last_clean":"2024-04-26T17:59:37.658771+0000","last_became_active":"2024-04-26T17:56:17.451507+0000","last_became_peered":"2024-04-26T17:56:17.451507+0000","last_unstale":"2024-04-26T17:59:37.658771+0000","last_undegraded":"2024-04-26T17:59:37.658771+0000","last_fullsized":"2024-04-26T17:59:37.658771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:16.791825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513671+0000","last_change":"2024-04-26T17:56:20.472512+0000","last_active":"2024-04-26T17:59:37.513671+0000","last_peered":"2024-04-26T17:59:37.513671+0000","last_clean":"2024-04-26T17:59:37.513671+0000","last_became_active":"2024-04-26T17:56:20.470819+0000","last_became_peered":"2024-04-26T17:56:20.470819+0000","last_unstale":"2024-04-26T17:59:37.513671+0000","last_undegraded":"2024-04-26T17:59:37.513671+0000","last_fullsized":"2024-04-26T17:59:37.513671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:36.308759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519825+0000","last_change":"2024-04-26T17:56:17.461722+0000","last_active":"2024-04-26T17:59:37.519825+0000","last_peered":"2024-04-26T17:59:37.519825+0000","last_clean":"2024-04-26T17:59:37.519825+0000","last_became_active":"2024-04-26T17:56:17.461354+0000","last_became_peered":"2024-04-26T17:56:17.461354+0000","last_unstale":"2024-04-26T17:59:37.519825+0000","last_undegraded":"2024-04-26T17:59:37.519825+0000","last_fullsized":"2024-04-26T17:59:37.519825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:07.062959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413020+0000","last_change":"2024-04-26T17:56:20.483630+0000","last_active":"2024-04-26T17:59:37.413020+0000","last_peered":"2024-04-26T17:59:37.413020+0000","last_clean":"2024-04-26T17:59:37.413020+0000","last_became_active":"2024-04-26T17:56:20.483318+0000","last_became_peered":"2024-04-26T17:56:20.483318+0000","last_unstale":"2024-04-26T17:59:37.413020+0000","last_undegraded":"2024-04-26T17:59:37.413020+0000","last_fullsized":"2024-04-26T17:59:37.413020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:44:21.314409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":216,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:42.000913+0000","last_change":"2024-04-26T17:56:17.460354+0000","last_active":"2024-04-26T17:59:42.000913+0000","last_peered":"2024-04-26T17:59:42.000913+0000","last_clean":"2024-04-26T17:59:42.000913+0000","last_became_active":"2024-04-26T17:56:17.459975+0000","last_became_peered":"2024-04-26T17:56:17.459975+0000","last_unstale":"2024-04-26T17:59:42.000913+0000","last_undegraded":"2024-04-26T17:59:42.000913+0000","last_fullsized":"2024-04-26T17:59:42.000913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:07.799295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666847+0000","last_change":"2024-04-26T17:56:20.483421+0000","last_active":"2024-04-26T17:59:37.666847+0000","last_peered":"2024-04-26T17:59:37.666847+0000","last_clean":"2024-04-26T17:59:37.666847+0000","last_became_active":"2024-04-26T17:56:20.483057+0000","last_became_peered":"2024-04-26T17:56:20.483057+0000","last_unstale":"2024-04-26T17:59:37.666847+0000","last_undegraded":"2024-04-26T17:59:37.666847+0000","last_fullsized":"2024-04-26T17:59:37.666847+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:04.848349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658664+0000","last_change":"2024-04-26T17:56:17.457216+0000","last_active":"2024-04-26T17:59:37.658664+0000","last_peered":"2024-04-26T17:59:37.658664+0000","last_clean":"2024-04-26T17:59:37.658664+0000","last_became_active":"2024-04-26T17:56:17.456803+0000","last_became_peered":"2024-04-26T17:56:17.456803+0000","last_unstale":"2024-04-26T17:59:37.658664+0000","last_undegraded":"2024-04-26T17:59:37.658664+0000","last_fullsized":"2024-04-26T17:59:37.658664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:44.596010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661482+0000","last_change":"2024-04-26T17:56:20.486811+0000","last_active":"2024-04-26T17:59:37.661482+0000","last_peered":"2024-04-26T17:59:37.661482+0000","last_clean":"2024-04-26T17:59:37.661482+0000","last_became_active":"2024-04-26T17:56:20.486263+0000","last_became_peered":"2024-04-26T17:56:20.486263+0000","last_unstale":"2024-04-26T17:59:37.661482+0000","last_undegraded":"2024-04-26T17:59:37.661482+0000","last_fullsized":"2024-04-26T17:59:37.661482+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:41.727153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520367+0000","last_change":"2024-04-26T17:56:17.530310+0000","last_active":"2024-04-26T17:59:37.520367+0000","last_peered":"2024-04-26T17:59:37.520367+0000","last_clean":"2024-04-26T17:59:37.520367+0000","last_became_active":"2024-04-26T17:56:17.529931+0000","last_became_peered":"2024-04-26T17:56:17.529931+0000","last_unstale":"2024-04-26T17:59:37.520367+0000","last_undegraded":"2024-04-26T17:59:37.520367+0000","last_fullsized":"2024-04-26T17:59:37.520367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:02:59.433254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666563+0000","last_change":"2024-04-26T17:56:20.482738+0000","last_active":"2024-04-26T17:59:37.666563+0000","last_peered":"2024-04-26T17:59:37.666563+0000","last_clean":"2024-04-26T17:59:37.666563+0000","last_became_active":"2024-04-26T17:56:20.482399+0000","last_became_peered":"2024-04-26T17:56:20.482399+0000","last_unstale":"2024-04-26T17:59:37.666563+0000","last_undegraded":"2024-04-26T17:59:37.666563+0000","last_fullsized":"2024-04-26T17:59:37.666563+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:22.311983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":441,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:43.001974+0000","last_change":"2024-04-26T17:56:17.458952+0000","last_active":"2024-04-26T17:59:43.001974+0000","last_peered":"2024-04-26T17:59:43.001974+0000","last_clean":"2024-04-26T17:59:43.001974+0000","last_became_active":"2024-04-26T17:56:17.458340+0000","last_became_peered":"2024-04-26T17:56:17.458340+0000","last_unstale":"2024-04-26T17:59:43.001974+0000","last_undegraded":"2024-04-26T17:59:43.001974+0000","last_fullsized":"2024-04-26T17:59:43.001974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:11.671979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65879,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":377,"num_read_kb":252,"num_write":36,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433484+0000","last_change":"2024-04-26T17:56:20.475457+0000","last_active":"2024-04-26T17:59:37.433484+0000","last_peered":"2024-04-26T17:59:37.433484+0000","last_clean":"2024-04-26T17:59:37.433484+0000","last_became_active":"2024-04-26T17:56:20.474387+0000","last_became_peered":"2024-04-26T17:56:20.474387+0000","last_unstale":"2024-04-26T17:59:37.433484+0000","last_undegraded":"2024-04-26T17:59:37.433484+0000","last_fullsized":"2024-04-26T17:59:37.433484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:15:26.954488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416363+0000","last_change":"2024-04-26T17:56:17.453537+0000","last_active":"2024-04-26T17:59:37.416363+0000","last_peered":"2024-04-26T17:59:37.416363+0000","last_clean":"2024-04-26T17:59:37.416363+0000","last_became_active":"2024-04-26T17:56:17.453168+0000","last_became_peered":"2024-04-26T17:56:17.453168+0000","last_unstale":"2024-04-26T17:59:37.416363+0000","last_undegraded":"2024-04-26T17:59:37.416363+0000","last_fullsized":"2024-04-26T17:59:37.416363+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:04.543311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658943+0000","last_change":"2024-04-26T17:56:20.477121+0000","last_active":"2024-04-26T17:59:37.658943+0000","last_peered":"2024-04-26T17:59:37.658943+0000","last_clean":"2024-04-26T17:59:37.658943+0000","last_became_active":"2024-04-26T17:56:20.476810+0000","last_became_peered":"2024-04-26T17:56:20.476810+0000","last_unstale":"2024-04-26T17:59:37.658943+0000","last_undegraded":"2024-04-26T17:59:37.658943+0000","last_fullsized":"2024-04-26T17:59:37.658943+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:59.935917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520013+0000","last_change":"2024-04-26T17:56:17.460760+0000","last_active":"2024-04-26T17:59:37.520013+0000","last_peered":"2024-04-26T17:59:37.520013+0000","last_clean":"2024-04-26T17:59:37.520013+0000","last_became_active":"2024-04-26T17:56:17.460259+0000","last_became_peered":"2024-04-26T17:56:17.460259+0000","last_unstale":"2024-04-26T17:59:37.520013+0000","last_undegraded":"2024-04-26T17:59:37.520013+0000","last_fullsized":"2024-04-26T17:59:37.520013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:17.303542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659175+0000","last_change":"2024-04-26T17:56:20.489577+0000","last_active":"2024-04-26T17:59:37.659175+0000","last_peered":"2024-04-26T17:59:37.659175+0000","last_clean":"2024-04-26T17:59:37.659175+0000","last_became_active":"2024-04-26T17:56:20.489231+0000","last_became_peered":"2024-04-26T17:56:20.489231+0000","last_unstale":"2024-04-26T17:59:37.659175+0000","last_undegraded":"2024-04-26T17:59:37.659175+0000","last_fullsized":"2024-04-26T17:59:37.659175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:06.568314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"91'4","reported_seq":218,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:42.057411+0000","last_change":"2024-04-26T17:56:17.454983+0000","last_active":"2024-04-26T17:59:42.057411+0000","last_peered":"2024-04-26T17:59:42.057411+0000","last_clean":"2024-04-26T17:59:42.057411+0000","last_became_active":"2024-04-26T17:56:17.454638+0000","last_became_peered":"2024-04-26T17:56:17.454638+0000","last_unstale":"2024-04-26T17:59:42.057411+0000","last_undegraded":"2024-04-26T17:59:42.057411+0000","last_fullsized":"2024-04-26T17:59:42.057411+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:00.874181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658630+0000","last_change":"2024-04-26T17:56:58.627910+0000","last_active":"2024-04-26T17:59:37.658630+0000","last_peered":"2024-04-26T17:59:37.658630+0000","last_clean":"2024-04-26T17:59:37.658630+0000","last_became_active":"2024-04-26T17:56:58.627495+0000","last_became_peered":"2024-04-26T17:56:58.627495+0000","last_unstale":"2024-04-26T17:59:37.658630+0000","last_undegraded":"2024-04-26T17:59:37.658630+0000","last_fullsized":"2024-04-26T17:59:37.658630+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:28.995559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433113+0000","last_change":"2024-04-26T17:56:17.530234+0000","last_active":"2024-04-26T17:59:37.433113+0000","last_peered":"2024-04-26T17:59:37.433113+0000","last_clean":"2024-04-26T17:59:37.433113+0000","last_became_active":"2024-04-26T17:56:17.529703+0000","last_became_peered":"2024-04-26T17:56:17.529703+0000","last_unstale":"2024-04-26T17:59:37.433113+0000","last_undegraded":"2024-04-26T17:59:37.433113+0000","last_fullsized":"2024-04-26T17:59:37.433113+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:23.647519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519985+0000","last_change":"2024-04-26T17:56:20.476387+0000","last_active":"2024-04-26T17:59:37.519985+0000","last_peered":"2024-04-26T17:59:37.519985+0000","last_clean":"2024-04-26T17:59:37.519985+0000","last_became_active":"2024-04-26T17:56:20.476067+0000","last_became_peered":"2024-04-26T17:56:20.476067+0000","last_unstale":"2024-04-26T17:59:37.519985+0000","last_undegraded":"2024-04-26T17:59:37.519985+0000","last_fullsized":"2024-04-26T17:59:37.519985+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:59:20.480914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433698+0000","last_change":"2024-04-26T17:56:17.459485+0000","last_active":"2024-04-26T17:59:37.433698+0000","last_peered":"2024-04-26T17:59:37.433698+0000","last_clean":"2024-04-26T17:59:37.433698+0000","last_became_active":"2024-04-26T17:56:17.459122+0000","last_became_peered":"2024-04-26T17:56:17.459122+0000","last_unstale":"2024-04-26T17:59:37.433698+0000","last_undegraded":"2024-04-26T17:59:37.433698+0000","last_fullsized":"2024-04-26T17:59:37.433698+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:24.859952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740443+0000","last_change":"2024-04-26T17:56:20.487556+0000","last_active":"2024-04-26T17:59:37.740443+0000","last_peered":"2024-04-26T17:59:37.740443+0000","last_clean":"2024-04-26T17:59:37.740443+0000","last_became_active":"2024-04-26T17:56:20.487121+0000","last_became_peered":"2024-04-26T17:56:20.487121+0000","last_unstale":"2024-04-26T17:59:37.740443+0000","last_undegraded":"2024-04-26T17:59:37.740443+0000","last_fullsized":"2024-04-26T17:59:37.740443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:41.953370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.413268+0000","last_change":"2024-04-26T17:56:59.182031+0000","last_active":"2024-04-26T17:59:37.413268+0000","last_peered":"2024-04-26T17:59:37.413268+0000","last_clean":"2024-04-26T17:59:37.413268+0000","last_became_active":"2024-04-26T17:56:59.181645+0000","last_became_peered":"2024-04-26T17:56:59.181645+0000","last_unstale":"2024-04-26T17:59:37.413268+0000","last_undegraded":"2024-04-26T17:59:37.413268+0000","last_fullsized":"2024-04-26T17:59:37.413268+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:03.980847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.523043+0000","last_change":"2024-04-26T17:56:20.479412+0000","last_active":"2024-04-26T17:59:37.523043+0000","last_peered":"2024-04-26T17:59:37.523043+0000","last_clean":"2024-04-26T17:59:37.523043+0000","last_became_active":"2024-04-26T17:56:20.479075+0000","last_became_peered":"2024-04-26T17:56:20.479075+0000","last_unstale":"2024-04-26T17:59:37.523043+0000","last_undegraded":"2024-04-26T17:59:37.523043+0000","last_fullsized":"2024-04-26T17:59:37.523043+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:06.659975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658887+0000","last_change":"2024-04-26T17:56:17.457887+0000","last_active":"2024-04-26T17:59:37.658887+0000","last_peered":"2024-04-26T17:59:37.658887+0000","last_clean":"2024-04-26T17:59:37.658887+0000","last_became_active":"2024-04-26T17:56:17.457197+0000","last_became_peered":"2024-04-26T17:56:17.457197+0000","last_unstale":"2024-04-26T17:59:37.658887+0000","last_undegraded":"2024-04-26T17:59:37.658887+0000","last_fullsized":"2024-04-26T17:59:37.658887+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:04.999633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.522908+0000","last_change":"2024-04-26T17:56:59.181994+0000","last_active":"2024-04-26T17:59:37.522908+0000","last_peered":"2024-04-26T17:59:37.522908+0000","last_clean":"2024-04-26T17:59:37.522908+0000","last_became_active":"2024-04-26T17:56:59.181678+0000","last_became_peered":"2024-04-26T17:56:59.181678+0000","last_unstale":"2024-04-26T17:59:37.522908+0000","last_undegraded":"2024-04-26T17:59:37.522908+0000","last_fullsized":"2024-04-26T17:59:37.522908+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:20:45.885124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.520014+0000","last_change":"2024-04-26T17:56:20.478931+0000","last_active":"2024-04-26T17:59:37.520014+0000","last_peered":"2024-04-26T17:59:37.520014+0000","last_clean":"2024-04-26T17:59:37.520014+0000","last_became_active":"2024-04-26T17:56:20.478583+0000","last_became_peered":"2024-04-26T17:56:20.478583+0000","last_unstale":"2024-04-26T17:59:37.520014+0000","last_undegraded":"2024-04-26T17:59:37.520014+0000","last_fullsized":"2024-04-26T17:59:37.520014+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:06.817980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'5","reported_seq":216,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:42.056749+0000","last_change":"2024-04-26T17:56:17.528901+0000","last_active":"2024-04-26T17:59:42.056749+0000","last_peered":"2024-04-26T17:59:42.056749+0000","last_clean":"2024-04-26T17:59:42.056749+0000","last_became_active":"2024-04-26T17:56:17.528584+0000","last_became_peered":"2024-04-26T17:56:17.528584+0000","last_unstale":"2024-04-26T17:59:42.056749+0000","last_undegraded":"2024-04-26T17:59:42.056749+0000","last_fullsized":"2024-04-26T17:59:42.056749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:13:46.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514153+0000","last_change":"2024-04-26T17:56:20.484308+0000","last_active":"2024-04-26T17:59:37.514153+0000","last_peered":"2024-04-26T17:59:37.514153+0000","last_clean":"2024-04-26T17:59:37.514153+0000","last_became_active":"2024-04-26T17:56:20.481111+0000","last_became_peered":"2024-04-26T17:56:20.481111+0000","last_unstale":"2024-04-26T17:59:37.514153+0000","last_undegraded":"2024-04-26T17:59:37.514153+0000","last_fullsized":"2024-04-26T17:59:37.514153+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:35.841918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.414769+0000","last_change":"2024-04-26T17:56:17.454435+0000","last_active":"2024-04-26T17:59:37.414769+0000","last_peered":"2024-04-26T17:59:37.414769+0000","last_clean":"2024-04-26T17:59:37.414769+0000","last_became_active":"2024-04-26T17:56:17.454012+0000","last_became_peered":"2024-04-26T17:56:17.454012+0000","last_unstale":"2024-04-26T17:59:37.414769+0000","last_undegraded":"2024-04-26T17:59:37.414769+0000","last_fullsized":"2024-04-26T17:59:37.414769+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:03.252038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"91'148","reported_seq":404,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:39.520306+0000","last_change":"2024-04-26T17:54:52.505901+0000","last_active":"2024-04-26T17:59:39.520306+0000","last_peered":"2024-04-26T17:59:39.520306+0000","last_clean":"2024-04-26T17:59:39.520306+0000","last_became_active":"2024-04-26T17:54:52.505429+0000","last_became_peered":"2024-04-26T17:54:52.505429+0000","last_unstale":"2024-04-26T17:59:39.520306+0000","last_undegraded":"2024-04-26T17:59:39.520306+0000","last_fullsized":"2024-04-26T17:59:39.520306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:51:24.281457+0000","last_clean_scrub_stamp":"2024-04-26T17:51:24.281457+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:29.324467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659098+0000","last_change":"2024-04-26T17:56:20.480076+0000","last_active":"2024-04-26T17:59:37.659098+0000","last_peered":"2024-04-26T17:59:37.659098+0000","last_clean":"2024-04-26T17:59:37.659098+0000","last_became_active":"2024-04-26T17:56:20.479765+0000","last_became_peered":"2024-04-26T17:56:20.479765+0000","last_unstale":"2024-04-26T17:59:37.659098+0000","last_undegraded":"2024-04-26T17:59:37.659098+0000","last_fullsized":"2024-04-26T17:59:37.659098+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:47:27.876850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658559+0000","last_change":"2024-04-26T17:56:17.459713+0000","last_active":"2024-04-26T17:59:37.658559+0000","last_peered":"2024-04-26T17:59:37.658559+0000","last_clean":"2024-04-26T17:59:37.658559+0000","last_became_active":"2024-04-26T17:56:17.459332+0000","last_became_peered":"2024-04-26T17:56:17.459332+0000","last_unstale":"2024-04-26T17:59:37.658559+0000","last_undegraded":"2024-04-26T17:59:37.658559+0000","last_fullsized":"2024-04-26T17:59:37.658559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:02.075399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433495+0000","last_change":"2024-04-26T17:56:17.529356+0000","last_active":"2024-04-26T17:59:37.433495+0000","last_peered":"2024-04-26T17:59:37.433495+0000","last_clean":"2024-04-26T17:59:37.433495+0000","last_became_active":"2024-04-26T17:56:17.528968+0000","last_became_peered":"2024-04-26T17:56:17.528968+0000","last_unstale":"2024-04-26T17:59:37.433495+0000","last_undegraded":"2024-04-26T17:59:37.433495+0000","last_fullsized":"2024-04-26T17:59:37.433495+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:23:46.671528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659044+0000","last_change":"2024-04-26T17:56:20.482011+0000","last_active":"2024-04-26T17:59:37.659044+0000","last_peered":"2024-04-26T17:59:37.659044+0000","last_clean":"2024-04-26T17:59:37.659044+0000","last_became_active":"2024-04-26T17:56:20.481720+0000","last_became_peered":"2024-04-26T17:56:20.481720+0000","last_unstale":"2024-04-26T17:59:37.659044+0000","last_undegraded":"2024-04-26T17:59:37.659044+0000","last_fullsized":"2024-04-26T17:59:37.659044+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:57:21.676471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"91'99","reported_seq":219,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:39.616173+0000","last_change":"2024-04-26T17:56:17.455277+0000","last_active":"2024-04-26T17:59:39.616173+0000","last_peered":"2024-04-26T17:59:39.616173+0000","last_clean":"2024-04-26T17:59:39.616173+0000","last_became_active":"2024-04-26T17:56:17.454918+0000","last_became_peered":"2024-04-26T17:56:17.454918+0000","last_unstale":"2024-04-26T17:59:39.616173+0000","last_undegraded":"2024-04-26T17:59:39.616173+0000","last_fullsized":"2024-04-26T17:59:39.616173+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:49.614961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":182,"num_write_kb":1285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514588+0000","last_change":"2024-04-26T17:56:20.477741+0000","last_active":"2024-04-26T17:59:37.514588+0000","last_peered":"2024-04-26T17:59:37.514588+0000","last_clean":"2024-04-26T17:59:37.514588+0000","last_became_active":"2024-04-26T17:56:20.477063+0000","last_became_peered":"2024-04-26T17:56:20.477063+0000","last_unstale":"2024-04-26T17:59:37.514588+0000","last_undegraded":"2024-04-26T17:59:37.514588+0000","last_fullsized":"2024-04-26T17:59:37.514588+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:26.902770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.415027+0000","last_change":"2024-04-26T17:56:17.575495+0000","last_active":"2024-04-26T17:59:37.415027+0000","last_peered":"2024-04-26T17:59:37.415027+0000","last_clean":"2024-04-26T17:59:37.415027+0000","last_became_active":"2024-04-26T17:56:17.575207+0000","last_became_peered":"2024-04-26T17:56:17.575207+0000","last_unstale":"2024-04-26T17:59:37.415027+0000","last_undegraded":"2024-04-26T17:59:37.415027+0000","last_fullsized":"2024-04-26T17:59:37.415027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:24.063563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661412+0000","last_change":"2024-04-26T17:56:20.487612+0000","last_active":"2024-04-26T17:59:37.661412+0000","last_peered":"2024-04-26T17:59:37.661412+0000","last_clean":"2024-04-26T17:59:37.661412+0000","last_became_active":"2024-04-26T17:56:20.487298+0000","last_became_peered":"2024-04-26T17:56:20.487298+0000","last_unstale":"2024-04-26T17:59:37.661412+0000","last_undegraded":"2024-04-26T17:59:37.661412+0000","last_fullsized":"2024-04-26T17:59:37.661412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:19.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666413+0000","last_change":"2024-04-26T17:56:17.530186+0000","last_active":"2024-04-26T17:59:37.666413+0000","last_peered":"2024-04-26T17:59:37.666413+0000","last_clean":"2024-04-26T17:59:37.666413+0000","last_became_active":"2024-04-26T17:56:17.529809+0000","last_became_peered":"2024-04-26T17:56:17.529809+0000","last_unstale":"2024-04-26T17:59:37.666413+0000","last_undegraded":"2024-04-26T17:59:37.666413+0000","last_fullsized":"2024-04-26T17:59:37.666413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:21:27.052819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433121+0000","last_change":"2024-04-26T17:56:20.475165+0000","last_active":"2024-04-26T17:59:37.433121+0000","last_peered":"2024-04-26T17:59:37.433121+0000","last_clean":"2024-04-26T17:59:37.433121+0000","last_became_active":"2024-04-26T17:56:20.474798+0000","last_became_peered":"2024-04-26T17:56:20.474798+0000","last_unstale":"2024-04-26T17:59:37.433121+0000","last_undegraded":"2024-04-26T17:59:37.433121+0000","last_fullsized":"2024-04-26T17:59:37.433121+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:21:53.335120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513579+0000","last_change":"2024-04-26T17:56:17.453881+0000","last_active":"2024-04-26T17:59:37.513579+0000","last_peered":"2024-04-26T17:59:37.513579+0000","last_clean":"2024-04-26T17:59:37.513579+0000","last_became_active":"2024-04-26T17:56:17.453563+0000","last_became_peered":"2024-04-26T17:56:17.453563+0000","last_unstale":"2024-04-26T17:59:37.513579+0000","last_undegraded":"2024-04-26T17:59:37.513579+0000","last_fullsized":"2024-04-26T17:59:37.513579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:44.843513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740174+0000","last_change":"2024-04-26T17:56:20.483349+0000","last_active":"2024-04-26T17:59:37.740174+0000","last_peered":"2024-04-26T17:59:37.740174+0000","last_clean":"2024-04-26T17:59:37.740174+0000","last_became_active":"2024-04-26T17:56:20.483013+0000","last_became_peered":"2024-04-26T17:56:20.483013+0000","last_unstale":"2024-04-26T17:59:37.740174+0000","last_undegraded":"2024-04-26T17:59:37.740174+0000","last_fullsized":"2024-04-26T17:59:37.740174+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:07:48.624683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"91'3","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740320+0000","last_change":"2024-04-26T17:56:58.632796+0000","last_active":"2024-04-26T17:59:37.740320+0000","last_peered":"2024-04-26T17:59:37.740320+0000","last_clean":"2024-04-26T17:59:37.740320+0000","last_became_active":"2024-04-26T17:56:58.629989+0000","last_became_peered":"2024-04-26T17:56:58.629989+0000","last_unstale":"2024-04-26T17:59:37.740320+0000","last_undegraded":"2024-04-26T17:59:37.740320+0000","last_fullsized":"2024-04-26T17:59:37.740320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:54:32.941232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514430+0000","last_change":"2024-04-26T17:56:20.484932+0000","last_active":"2024-04-26T17:59:37.514430+0000","last_peered":"2024-04-26T17:59:37.514430+0000","last_clean":"2024-04-26T17:59:37.514430+0000","last_became_active":"2024-04-26T17:56:20.484626+0000","last_became_peered":"2024-04-26T17:56:20.484626+0000","last_unstale":"2024-04-26T17:59:37.514430+0000","last_undegraded":"2024-04-26T17:59:37.514430+0000","last_fullsized":"2024-04-26T17:59:37.514430+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:04.655230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.433343+0000","last_change":"2024-04-26T17:56:17.456315+0000","last_active":"2024-04-26T17:59:37.433343+0000","last_peered":"2024-04-26T17:59:37.433343+0000","last_clean":"2024-04-26T17:59:37.433343+0000","last_became_active":"2024-04-26T17:56:17.455810+0000","last_became_peered":"2024-04-26T17:56:17.455810+0000","last_unstale":"2024-04-26T17:59:37.433343+0000","last_undegraded":"2024-04-26T17:59:37.433343+0000","last_fullsized":"2024-04-26T17:59:37.433343+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:41:33.872482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658964+0000","last_change":"2024-04-26T17:56:20.489383+0000","last_active":"2024-04-26T17:59:37.658964+0000","last_peered":"2024-04-26T17:59:37.658964+0000","last_clean":"2024-04-26T17:59:37.658964+0000","last_became_active":"2024-04-26T17:56:20.489056+0000","last_became_peered":"2024-04-26T17:56:20.489056+0000","last_unstale":"2024-04-26T17:59:37.658964+0000","last_undegraded":"2024-04-26T17:59:37.658964+0000","last_fullsized":"2024-04-26T17:59:37.658964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:53.721616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416384+0000","last_change":"2024-04-26T17:56:17.575351+0000","last_active":"2024-04-26T17:59:37.416384+0000","last_peered":"2024-04-26T17:59:37.416384+0000","last_clean":"2024-04-26T17:59:37.416384+0000","last_became_active":"2024-04-26T17:56:17.574996+0000","last_became_peered":"2024-04-26T17:56:17.574996+0000","last_unstale":"2024-04-26T17:59:37.416384+0000","last_undegraded":"2024-04-26T17:59:37.416384+0000","last_fullsized":"2024-04-26T17:59:37.416384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:36:42.958612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659292+0000","last_change":"2024-04-26T17:56:20.483363+0000","last_active":"2024-04-26T17:59:37.659292+0000","last_peered":"2024-04-26T17:59:37.659292+0000","last_clean":"2024-04-26T17:59:37.659292+0000","last_became_active":"2024-04-26T17:56:20.483004+0000","last_became_peered":"2024-04-26T17:56:20.483004+0000","last_unstale":"2024-04-26T17:59:37.659292+0000","last_undegraded":"2024-04-26T17:59:37.659292+0000","last_fullsized":"2024-04-26T17:59:37.659292+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:42:15.464734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"91'65","reported_seq":125,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:39.241765+0000","last_change":"2024-04-26T17:56:17.462010+0000","last_active":"2024-04-26T17:59:39.241765+0000","last_peered":"2024-04-26T17:59:39.241765+0000","last_clean":"2024-04-26T17:59:39.241765+0000","last_became_active":"2024-04-26T17:56:17.461612+0000","last_became_peered":"2024-04-26T17:56:17.461612+0000","last_unstale":"2024-04-26T17:59:39.241765+0000","last_undegraded":"2024-04-26T17:59:39.241765+0000","last_fullsized":"2024-04-26T17:59:39.241765+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:47.469935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658840+0000","last_change":"2024-04-26T17:56:20.483602+0000","last_active":"2024-04-26T17:59:37.658840+0000","last_peered":"2024-04-26T17:59:37.658840+0000","last_clean":"2024-04-26T17:59:37.658840+0000","last_became_active":"2024-04-26T17:56:20.483217+0000","last_became_peered":"2024-04-26T17:56:20.483217+0000","last_unstale":"2024-04-26T17:59:37.658840+0000","last_undegraded":"2024-04-26T17:59:37.658840+0000","last_fullsized":"2024-04-26T17:59:37.658840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:55.365477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"88'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658842+0000","last_change":"2024-04-26T17:56:17.453073+0000","last_active":"2024-04-26T17:59:37.658842+0000","last_peered":"2024-04-26T17:59:37.658842+0000","last_clean":"2024-04-26T17:59:37.658842+0000","last_became_active":"2024-04-26T17:56:17.452719+0000","last_became_peered":"2024-04-26T17:56:17.452719+0000","last_unstale":"2024-04-26T17:59:37.658842+0000","last_undegraded":"2024-04-26T17:59:37.658842+0000","last_fullsized":"2024-04-26T17:59:37.658842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:16.438136+0000","last_clean_scrub_stamp":"2024-04-26T17:56:16.438136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:48.579323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659020+0000","last_change":"2024-04-26T17:56:20.476617+0000","last_active":"2024-04-26T17:59:37.659020+0000","last_peered":"2024-04-26T17:59:37.659020+0000","last_clean":"2024-04-26T17:59:37.659020+0000","last_became_active":"2024-04-26T17:56:20.476265+0000","last_became_peered":"2024-04-26T17:56:20.476265+0000","last_unstale":"2024-04-26T17:59:37.659020+0000","last_undegraded":"2024-04-26T17:59:37.659020+0000","last_fullsized":"2024-04-26T17:59:37.659020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:58:45.621880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740252+0000","last_change":"2024-04-26T17:56:20.483385+0000","last_active":"2024-04-26T17:59:37.740252+0000","last_peered":"2024-04-26T17:59:37.740252+0000","last_clean":"2024-04-26T17:59:37.740252+0000","last_became_active":"2024-04-26T17:56:20.483046+0000","last_became_peered":"2024-04-26T17:56:20.483046+0000","last_unstale":"2024-04-26T17:59:37.740252+0000","last_undegraded":"2024-04-26T17:59:37.740252+0000","last_fullsized":"2024-04-26T17:59:37.740252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:40.717164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416182+0000","last_change":"2024-04-26T17:56:20.486180+0000","last_active":"2024-04-26T17:59:37.416182+0000","last_peered":"2024-04-26T17:59:37.416182+0000","last_clean":"2024-04-26T17:59:37.416182+0000","last_became_active":"2024-04-26T17:56:20.485838+0000","last_became_peered":"2024-04-26T17:56:20.485838+0000","last_unstale":"2024-04-26T17:59:37.416182+0000","last_undegraded":"2024-04-26T17:59:37.416182+0000","last_fullsized":"2024-04-26T17:59:37.416182+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:28.071850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416143+0000","last_change":"2024-04-26T17:56:20.486009+0000","last_active":"2024-04-26T17:59:37.416143+0000","last_peered":"2024-04-26T17:59:37.416143+0000","last_clean":"2024-04-26T17:59:37.416143+0000","last_became_active":"2024-04-26T17:56:20.485657+0000","last_became_peered":"2024-04-26T17:56:20.485657+0000","last_unstale":"2024-04-26T17:59:37.416143+0000","last_undegraded":"2024-04-26T17:59:37.416143+0000","last_fullsized":"2024-04-26T17:59:37.416143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:58:19.149097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.661251+0000","last_change":"2024-04-26T17:56:20.489228+0000","last_active":"2024-04-26T17:59:37.661251+0000","last_peered":"2024-04-26T17:59:37.661251+0000","last_clean":"2024-04-26T17:59:37.661251+0000","last_became_active":"2024-04-26T17:56:20.488259+0000","last_became_peered":"2024-04-26T17:56:20.488259+0000","last_unstale":"2024-04-26T17:59:37.661251+0000","last_undegraded":"2024-04-26T17:59:37.661251+0000","last_fullsized":"2024-04-26T17:59:37.661251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:25.772636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.658982+0000","last_change":"2024-04-26T17:56:20.486677+0000","last_active":"2024-04-26T17:59:37.658982+0000","last_peered":"2024-04-26T17:59:37.658982+0000","last_clean":"2024-04-26T17:59:37.658982+0000","last_became_active":"2024-04-26T17:56:20.486350+0000","last_became_peered":"2024-04-26T17:56:20.486350+0000","last_unstale":"2024-04-26T17:59:37.658982+0000","last_undegraded":"2024-04-26T17:59:37.658982+0000","last_fullsized":"2024-04-26T17:59:37.658982+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:22.883003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740416+0000","last_change":"2024-04-26T17:56:20.480426+0000","last_active":"2024-04-26T17:59:37.740416+0000","last_peered":"2024-04-26T17:59:37.740416+0000","last_clean":"2024-04-26T17:59:37.740416+0000","last_became_active":"2024-04-26T17:56:20.480030+0000","last_became_peered":"2024-04-26T17:56:20.480030+0000","last_unstale":"2024-04-26T17:59:37.740416+0000","last_undegraded":"2024-04-26T17:59:37.740416+0000","last_fullsized":"2024-04-26T17:59:37.740416+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:23.992732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.416488+0000","last_change":"2024-04-26T17:56:20.478679+0000","last_active":"2024-04-26T17:59:37.416488+0000","last_peered":"2024-04-26T17:59:37.416488+0000","last_clean":"2024-04-26T17:59:37.416488+0000","last_became_active":"2024-04-26T17:56:20.478358+0000","last_became_peered":"2024-04-26T17:56:20.478358+0000","last_unstale":"2024-04-26T17:59:37.416488+0000","last_undegraded":"2024-04-26T17:59:37.416488+0000","last_fullsized":"2024-04-26T17:59:37.416488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:47.691915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.514666+0000","last_change":"2024-04-26T17:56:20.478483+0000","last_active":"2024-04-26T17:59:37.514666+0000","last_peered":"2024-04-26T17:59:37.514666+0000","last_clean":"2024-04-26T17:59:37.514666+0000","last_became_active":"2024-04-26T17:56:20.478168+0000","last_became_peered":"2024-04-26T17:56:20.478168+0000","last_unstale":"2024-04-26T17:59:37.514666+0000","last_undegraded":"2024-04-26T17:59:37.514666+0000","last_fullsized":"2024-04-26T17:59:37.514666+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:16:40.705769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.519901+0000","last_change":"2024-04-26T17:56:20.473968+0000","last_active":"2024-04-26T17:59:37.519901+0000","last_peered":"2024-04-26T17:59:37.519901+0000","last_clean":"2024-04-26T17:59:37.519901+0000","last_became_active":"2024-04-26T17:56:20.472677+0000","last_became_peered":"2024-04-26T17:56:20.472677+0000","last_unstale":"2024-04-26T17:59:37.519901+0000","last_undegraded":"2024-04-26T17:59:37.519901+0000","last_fullsized":"2024-04-26T17:59:37.519901+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:47.494584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.513879+0000","last_change":"2024-04-26T17:56:20.480656+0000","last_active":"2024-04-26T17:59:37.513879+0000","last_peered":"2024-04-26T17:59:37.513879+0000","last_clean":"2024-04-26T17:59:37.513879+0000","last_became_active":"2024-04-26T17:56:20.480363+0000","last_became_peered":"2024-04-26T17:56:20.480363+0000","last_unstale":"2024-04-26T17:59:37.513879+0000","last_undegraded":"2024-04-26T17:59:37.513879+0000","last_fullsized":"2024-04-26T17:59:37.513879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:41.873443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.666668+0000","last_change":"2024-04-26T17:56:20.485623+0000","last_active":"2024-04-26T17:59:37.666668+0000","last_peered":"2024-04-26T17:59:37.666668+0000","last_clean":"2024-04-26T17:59:37.666668+0000","last_became_active":"2024-04-26T17:56:20.485310+0000","last_became_peered":"2024-04-26T17:56:20.485310+0000","last_unstale":"2024-04-26T17:59:37.666668+0000","last_undegraded":"2024-04-26T17:59:37.666668+0000","last_fullsized":"2024-04-26T17:59:37.666668+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:15.586606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.659179+0000","last_change":"2024-04-26T17:56:20.481566+0000","last_active":"2024-04-26T17:59:37.659179+0000","last_peered":"2024-04-26T17:59:37.659179+0000","last_clean":"2024-04-26T17:59:37.659179+0000","last_became_active":"2024-04-26T17:56:20.481211+0000","last_became_peered":"2024-04-26T17:56:20.481211+0000","last_unstale":"2024-04-26T17:59:37.659179+0000","last_undegraded":"2024-04-26T17:59:37.659179+0000","last_fullsized":"2024-04-26T17:59:37.659179+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:17.981412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T17:59:37.740277+0000","last_change":"2024-04-26T17:56:20.482345+0000","last_active":"2024-04-26T17:59:37.740277+0000","last_peered":"2024-04-26T17:59:37.740277+0000","last_clean":"2024-04-26T17:59:37.740277+0000","last_became_active":"2024-04-26T17:56:20.481998+0000","last_became_peered":"2024-04-26T17:56:20.481998+0000","last_unstale":"2024-04-26T17:59:37.740277+0000","last_undegraded":"2024-04-26T17:59:37.740277+0000","last_fullsized":"2024-04-26T17:59:37.740277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:56:19.453057+0000","last_clean_scrub_stamp":"2024-04-26T17:56:19.453057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:50.408376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":108408,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":792559,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1473,"num_read_kb":948,"num_write":419,"num_write_kb":2350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":638976,"data_stored":2377677,"data_compressed":103473,"data_compressed_allocated":135168,"data_compressed_original":2101248,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383735,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":488568,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645373,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28188,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716964,"statfs":{"total":95995035648,"available":95966171136,"internally_reserved":0,"allocated":1191936,"data_stored":1474551,"data_compressed":54224,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808898,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1032192,"data_stored":882020,"data_compressed":22175,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070535,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1028096,"data_stored":881358,"data_compressed":22175,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":1081885,"data_compressed":39022,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495699,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":995328,"data_stored":488193,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1060864,"data_stored":553865,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":489464,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411431,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1085440,"data_stored":556446,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182498,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1209952,"data_compressed":37377,"data_compressed_allocated":49152,"data_compressed_original":708608,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920861,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1003520,"data_stored":489603,"data_compressed":2886,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757335,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712880,"statfs":{"total":95995035648,"available":95961989120,"internally_reserved":0,"allocated":1114112,"data_stored":1409410,"data_compressed":54224,"data_compressed_allocated":69632,"data_compressed_original":905216,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36136,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":721732,"data_compressed":34491,"data_compressed_allocated":45056,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":330939,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393372,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":396080,"data_compressed":15202,"data_compressed_allocated":20480,"data_compressed_original":307200,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:59:48.536 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:59:48.776 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:49.159 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:49 smithi092 ceph-mon[29156]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 58 op/s 2024-04-26T17:59:49.160 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:49 smithi092 ceph-mon[29156]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:49 smithi189 ceph-mon[32756]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 58 op/s 2024-04-26T17:59:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:49 smithi189 ceph-mon[32756]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:49 smithi156 ceph-mon[32679]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 58 op/s 2024-04-26T17:59:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:49 smithi156 ceph-mon[32679]: from='client.15219 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-26T17:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- 172.21.15.92:0/3216876904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb058105e50 msgr2=0x7fb0581062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/3216876904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb058105e50 0x7fb0581062e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb05000b0a0 tx=0x7fb05000b3b0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- 172.21.15.92:0/3216876904 shutdown_connections 2024-04-26T17:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/3216876904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb05806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.475 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/3216876904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb058105e50 0x7fb0581062e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/3216876904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb05806c0b0 0x7fb05806c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- 172.21.15.92:0/3216876904 >> 172.21.15.92:0/3216876904 conn(0x7fb0580792c0 msgr2=0x7fb0580796d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- 172.21.15.92:0/3216876904 shutdown_connections 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- 172.21.15.92:0/3216876904 wait complete. 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 Processor -- start 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.474+0000 7fb05fd3e700 1 -- start start 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 0x7fb0581a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb058105e50 0x7fb0581a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb058119ba0 con 0x7fb05806c0b0 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb058119a20 con 0x7fb058108340 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05fd3e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb058119d20 con 0x7fb058105e50 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05e2db700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:50.476 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05e2db700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:51278/0 (socket says 172.21.15.92:51278) 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05e2db700 1 -- 172.21.15.92:0/4193236165 learned_addr learned my addr 172.21.15.92:0/4193236165 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 0x7fb0581a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05d2d9700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb058105e50 0x7fb0581a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 -- 172.21.15.92:0/4193236165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb058105e50 msgr2=0x7fb0581a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb058105e50 0x7fb0581a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 -- 172.21.15.92:0/4193236165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 msgr2=0x7fb0581a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 -- 172.21.15.92:0/4193236165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0581a50a0 con 0x7fb05806c0b0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05e2db700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.475+0000 7fb05dada700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 0x7fb0581a0090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb05400d750 tx=0x7fb05400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.476+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb054016070 con 0x7fb05806c0b0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.476+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb054004830 con 0x7fb05806c0b0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.476+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0581a5390 con 0x7fb05806c0b0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.476+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0540055d0 con 0x7fb05806c0b0 2024-04-26T17:59:50.477 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.476+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581acc10 con 0x7fb05806c0b0 2024-04-26T17:59:50.478 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.477+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb058102930 con 0x7fb05806c0b0 2024-04-26T17:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.478+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7fb054004220 con 0x7fb05806c0b0 2024-04-26T17:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.478+0000 7fb04effd700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 0x7fb0440a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.478+0000 7fb05d2d9700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 0x7fb0440a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.479+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb0540d0530 con 0x7fb05806c0b0 2024-04-26T17:59:50.479 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.479+0000 7fb05d2d9700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 0x7fb0440a6380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb05806c7d0 tx=0x7fb048005eb0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:50.482 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.483+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb05401f020 con 0x7fb05806c0b0 2024-04-26T17:59:50.724 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.725+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0581acea0 con 0x7fb05806c0b0 2024-04-26T17:59:50.725 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.725+0000 7fb04effd700 1 -- 172.21.15.92:0/4193236165 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11883 (secure 0 0 0) 0x7fb05409cad0 con 0x7fb05806c0b0 2024-04-26T17:59:50.726 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:50.726 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:59:35.933653+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T17:59:50.728 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 msgr2=0x7fb0440a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 0x7fb0440a6380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb05806c7d0 tx=0x7fb048005eb0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 msgr2=0x7fb0581a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 0x7fb0581a0090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb05400d750 tx=0x7fb05400da60 comp rx=0 tx=0).stop 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 shutdown_connections 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb0440a3ec0 0x7fb0440a6380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.729 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb058108340 0x7fb0581a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05806c0b0 0x7fb0581a0090 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 --2- 172.21.15.92:0/4193236165 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb058105e50 0x7fb0581a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 >> 172.21.15.92:0/4193236165 conn(0x7fb0580792c0 msgr2=0x7fb058104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 shutdown_connections 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:50.728+0000 7fb05fd3e700 1 -- 172.21.15.92:0/4193236165 wait complete. 2024-04-26T17:59:50.730 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 26 2024-04-26T17:59:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:51 smithi189 ceph-mon[32756]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-04-26T17:59:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:51 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/4193236165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:51.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:51 smithi092 ceph-mon[29156]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-04-26T17:59:51.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:51 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/4193236165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:51.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:59:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:51 smithi156 ceph-mon[32679]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 50 op/s 2024-04-26T17:59:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:51 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/4193236165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:51.674 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 -- 172.21.15.92:0/2823303194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 msgr2=0x7f4de810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 --2- 172.21.15.92:0/2823303194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de810e6e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009cd0 tx=0x7f4de002a8e0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 -- 172.21.15.92:0/2823303194 shutdown_connections 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 --2- 172.21.15.92:0/2823303194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de810e6e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 --2- 172.21.15.92:0/2823303194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 0x7f4de8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 --2- 172.21.15.92:0/2823303194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de8107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 -- 172.21.15.92:0/2823303194 >> 172.21.15.92:0/2823303194 conn(0x7f4de80789b0 msgr2=0x7f4de8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 -- 172.21.15.92:0/2823303194 shutdown_connections 2024-04-26T17:59:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.837+0000 7f4def447640 1 -- 172.21.15.92:0/2823303194 wait complete. 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 Processor -- start 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 -- start start 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 0x7f4de8199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de81a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4de8111ae0 con 0x7f4de8102220 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4de8111960 con 0x7f4de8107820 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4def447640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4de8111c60 con 0x7f4de8101860 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36794/0 (socket says 172.21.15.92:36794) 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 -- 172.21.15.92:0/2673569596 learned_addr learned my addr 172.21.15.92:0/2673569596 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 0x7f4de8199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de81a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 -- 172.21.15.92:0/2673569596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 msgr2=0x7f4de8199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 0x7f4de8199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 -- 172.21.15.92:0/2673569596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 msgr2=0x7f4de81a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de81a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4dec9e2640 1 -- 172.21.15.92:0/2673569596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de81a53e0 con 0x7f4de8102220 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.838+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de81a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4de400d770 tx=0x7f4de400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4dde7fc640 1 -- 172.21.15.92:0/2673569596 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4017070 con 0x7f4de8102220 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4dde7fc640 1 -- 172.21.15.92:0/2673569596 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de4009820 con 0x7f4de8102220 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de81a55b0 con 0x7f4de8102220 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4dde7fc640 1 -- 172.21.15.92:0/2673569596 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4004bc0 con 0x7f4de8102220 2024-04-26T17:59:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.839+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de81a5ad0 con 0x7f4de8102220 2024-04-26T17:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 Processor -- start 2024-04-26T17:59:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 -- start start 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e114d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555799d6a460 con 0x555799e0f0e0 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x555799d24590 con 0x555799e03f00 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555799d66420 con 0x555799e04820 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4dde7fc640 1 -- 172.21.15.92:0/2673569596 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f4de40099d0 con 0x7f4de8102220 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4ded1e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4ded1e3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:56856/0 (socket says 172.21.15.92:56856) 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4ded1e3640 1 -- 172.21.15.92:0/1898561887 learned_addr learned my addr 172.21.15.92:0/1898561887 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.842+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e114d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 -- 172.21.15.92:0/1898561887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 msgr2=0x555799e042e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e042e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 -- 172.21.15.92:0/1898561887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 msgr2=0x555799e114d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e114d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 -- 172.21.15.92:0/1898561887 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555799d310d0 con 0x555799e04820 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800ac90 tx=0x7f4dd800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7157b5bd255bfc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4dde7fc640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 0x7f4dd40a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4dd37fe640 1 -- 172.21.15.92:0/1898561887 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd801d070 con 0x555799e04820 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 0x7f4dd40a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4dde7fc640 1 -- 172.21.15.92:0/2673569596 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4de40d0380 con 0x7f4de8102220 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4dd37fe640 1 -- 172.21.15.92:0/1898561887 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dd8018af0 con 0x555799e04820 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.843+0000 7f4dd37fe640 1 -- 172.21.15.92:0/1898561887 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8010ae0 con 0x555799e04820 2024-04-26T17:59:52.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1898561887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 msgr2=0x555799e0eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800ac90 tx=0x7f4dd800f790 comp rx=0 tx=0).stop 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 0x7f4dd40a63a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fe0 tx=0x7f4de0005c50 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1898561887 shutdown_connections 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0eba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1898561887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e042e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1898561887 >> 172.21.15.92:0/1898561887 conn(0x555799e00410 msgr2=0x555799e007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1898561887 shutdown_connections 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1898561887 wait complete. 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 -- start start 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.844+0000 7f4df1dfd740 1 Processor -- start 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e0bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555799e11d10 con 0x555799e0f0e0 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x555799cf1b60 con 0x555799e03f00 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x555799e11e90 con 0x555799e04820 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4df1dfd740 10 client.0 _ll_register_callbacks cb 0x555799d162b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36818/0 (socket says 172.21.15.92:36818) 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 -- 172.21.15.92:0/2146979928 learned_addr learned my addr 172.21.15.92:0/2146979928 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e0bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 -- 172.21.15.92:0/2146979928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 msgr2=0x555799e0c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 -- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 msgr2=0x555799e0bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e0bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.845+0000 7f4ded9e4640 1 -- 172.21.15.92:0/2146979928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555799a7c210 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a60 tx=0x7f4de002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ef833451603444 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0055060 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4de0003e00 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dd8018af0 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4de0004720 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 10 client.15237 fetch_fsmap learned FSMap version 26 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555799b48620 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dd8018af0 con 0x555799e0f0e0 2024-04-26T17:59:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f4de0058020 con 0x555799e0f0e0 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 10 client.15237 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 10 client.15237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 20 client.15237 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e1f180 0x555799e21570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 4 client.15237 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.846+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555799d78070 con 0x555799e1f180 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.847+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e1f180 0x555799e21570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.847+0000 7f4dd0ff9640 10 client.15237 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.847+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e1f180 0x555799e21570 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a9952308562ed3b server_cookie=3ae5b202907d7bef in_seq=0 out_seq=0 2024-04-26T17:59:52.854 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/2146979928 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555799d78070 con 0x555799e1f180 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4dd0ff9640 10 client.15237 handle_command_reply: tid=0 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 client.15237 shutdown 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 msgr2=0x555799e0ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a60 tx=0x7f4de002a8e0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 shutdown_connections 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e1f180 0x555799e21570 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e0f0e0 0x555799e0ca60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e04820 0x555799e0c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4dd0ff9640 0 client.15237 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/2146979928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e0bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 >> 172.21.15.92:0/2146979928 conn(0x555799e00410 msgr2=0x555799e06140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 shutdown_connections 2024-04-26T17:59:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 1 -- 172.21.15.92:0/2146979928 wait complete. 2024-04-26T17:59:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.848+0000 7f4df1dfd740 20 client.15237 trim_cache size 0 max 16384 2024-04-26T17:59:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 Processor -- start 2024-04-26T17:59:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 -- start start 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e1abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e0f0e0 0x555799e273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81b0b40 con 0x555799e04820 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81ae410 con 0x555799e03f00 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81ac260 con 0x555799e0f0e0 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.863+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36824/0 (socket says 172.21.15.92:36824) 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 -- 172.21.15.92:0/1474582583 learned_addr learned my addr 172.21.15.92:0/1474582583 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e1abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e0f0e0 0x555799e273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 -- 172.21.15.92:0/1474582583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e0f0e0 msgr2=0x555799e273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e0f0e0 0x555799e273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 -- 172.21.15.92:0/1474582583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 msgr2=0x555799e1abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e1abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 -- 172.21.15.92:0/1474582583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555799e0a570 con 0x555799e04820 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ce140 tx=0x7f4de400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5abb18e5f810cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dd2ffd640 1 -- 172.21.15.92:0/1474582583 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4020040 con 0x555799e04820 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dd2ffd640 1 -- 172.21.15.92:0/1474582583 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de409c920 con 0x555799e04820 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.864+0000 7f4dd2ffd640 1 -- 172.21.15.92:0/1474582583 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4009cf0 con 0x555799e04820 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1474582583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 msgr2=0x555799e26e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ce140 tx=0x7f4de400b480 comp rx=0 tx=0).stop 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1474582583 shutdown_connections 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e0f0e0 0x555799e273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e26e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/1474582583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e03f00 0x555799e1abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1474582583 >> 172.21.15.92:0/1474582583 conn(0x555799e00410 msgr2=0x555799e073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1474582583 shutdown_connections 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- 172.21.15.92:0/1474582583 wait complete. 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.865+0000 7f4df1dfd740 1 -- start start 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 Processor -- start 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 0x555799e08e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 0x555799e098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81ac8d0 con 0x555799e04820 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81add40 con 0x555799e0f0e0 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4de81acfa0 con 0x555799e03f00 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4df1dfd740 10 client.0 _ll_register_callbacks cb 0x7f4de0031700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4dec9e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36832/0 (socket says 172.21.15.92:36832) 2024-04-26T17:59:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4dec9e2640 1 -- 172.21.15.92:0/4097463520 learned_addr learned my addr 172.21.15.92:0/4097463520 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 0x555799e098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 0x555799e08e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4ded9e4640 1 -- 172.21.15.92:0/4097463520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 msgr2=0x555799e08e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.866+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 0x555799e08e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4ded9e4640 1 -- 172.21.15.92:0/4097463520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 msgr2=0x555799e093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4ded9e4640 1 -- 172.21.15.92:0/4097463520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555799e848c0 con 0x555799e0f0e0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dec9e2640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 0x555799e08e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4ded9e4640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 0x555799e098f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x555799e27900 tx=0x7f4de0009540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89e1de1e6ff93d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0055040 con 0x555799e0f0e0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de409c920 con 0x555799e0f0e0 2024-04-26T17:59:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4de00305a0 con 0x555799e0f0e0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4de0031bf0 con 0x555799e0f0e0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4df1dfd740 10 client.24866 fetch_fsmap learned FSMap version 26 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555799e85b90 con 0x555799e0f0e0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.867+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4de409c920 con 0x555799e0f0e0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f4de0062070 con 0x555799e0f0e0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 10 client.24866 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 10 client.24866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 20 client.24866 populate_metadata read hostname 'smithi092' 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e862b0 0x555799e886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 4 client.24866 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555799d71ee0 con 0x555799e862b0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e862b0 0x555799e886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4dd0ff9640 10 client.24866 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.868+0000 7f4ded1e3640 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e862b0 0x555799e886a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ba6516319bc5fd server_cookie=3d4f8865ebca61ac in_seq=0 out_seq=0 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4dd0ff9640 1 -- 172.21.15.92:0/4097463520 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555799d71ee0 con 0x555799e862b0 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4dd0ff9640 10 client.24866 handle_command_reply: tid=0 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 client.24866 shutdown 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 msgr2=0x555799e098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 0x555799e098f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x555799e27900 tx=0x7f4de0009540 comp rx=0 tx=0).stop 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 shutdown_connections 2024-04-26T17:59:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x555799e862b0 0x555799e886a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555799e0f0e0 0x555799e098f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555799e04820 0x555799e093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4dd0ff9640 0 client.24866 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 --2- 172.21.15.92:0/4097463520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x555799e03f00 0x555799e08e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.880+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 >> 172.21.15.92:0/4097463520 conn(0x555799e00410 msgr2=0x555799e058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 shutdown_connections 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4df1dfd740 1 -- 172.21.15.92:0/4097463520 wait complete. 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4df1dfd740 20 client.24866 trim_cache size 0 max 16384 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T17:59:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T17:59:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T17:59:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T17:59:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 msgr2=0x7f4dd40a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 0x7f4dd40a63a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fe0 tx=0x7f4de0005c50 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 msgr2=0x7f4de819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.881+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4de400d770 tx=0x7f4de400db70 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 shutdown_connections 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4dd40a3ee0 0x7f4dd40a63a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8107820 0x7f4de81a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de8102220 0x7f4de819a360 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 --2- 172.21.15.92:0/2673569596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4de8101860 0x7f4de8199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 >> 172.21.15.92:0/2673569596 conn(0x7f4de80789b0 msgr2=0x7f4de8104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 shutdown_connections 2024-04-26T17:59:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T17:59:52.882+0000 7f4def447640 1 -- 172.21.15.92:0/2673569596 wait complete. 2024-04-26T17:59:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:53 smithi189 ceph-mon[32756]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:53.390 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:53 smithi092 ceph-mon[29156]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 -- 172.21.15.92:0/268394493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 msgr2=0x7f56f81027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/268394493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f81027a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009990 tx=0x7f56e0009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 -- 172.21.15.92:0/268394493 shutdown_connections 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/268394493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8108390 0x7f56f8108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/268394493 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8102ce0 0x7f56f810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/268394493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f81027a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.392+0000 7f56fe0f4700 1 -- 172.21.15.92:0/268394493 >> 172.21.15.92:0/268394493 conn(0x7f56f80792d0 msgr2=0x7f56f80796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 -- 172.21.15.92:0/268394493 shutdown_connections 2024-04-26T17:59:53.392 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 -- 172.21.15.92:0/268394493 wait complete. 2024-04-26T17:59:53.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 Processor -- start 2024-04-26T17:59:53.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 -- start start 2024-04-26T17:59:53.394 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 0x7f56f819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.393+0000 7f56fe0f4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8108390 0x7f56f81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56fe0f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8112500 con 0x7f56f8102320 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56fe0f4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8112380 con 0x7f56f8102ce0 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56fe0f4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8112680 con 0x7f56f8108390 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36844/0 (socket says 172.21.15.92:36844) 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56eeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 0x7f56f819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 -- 172.21.15.92:0/1669334937 learned_addr learned my addr 172.21.15.92:0/1669334937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 -- 172.21.15.92:0/1669334937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8108390 msgr2=0x7f56f81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f7fff700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8108390 0x7f56f81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8108390 0x7f56f81998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 -- 172.21.15.92:0/1669334937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 msgr2=0x7f56f819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:53.395 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 0x7f56f819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 -- 172.21.15.92:0/1669334937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f819a050 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56eeffd700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 0x7f56f819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f77fe700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56e800c920 tx=0x7f56e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007b00 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f819a340 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e8004ce0 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e8005500 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.394+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81a6600 con 0x7f56f8102320 2024-04-26T17:59:53.396 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.395+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f806a110 con 0x7f56f8102320 2024-04-26T17:59:53.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.396+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f56e8007ca0 con 0x7f56f8102320 2024-04-26T17:59:53.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.397+0000 7f56f57fa700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 0x7f56e40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:53.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.397+0000 7f56eeffd700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 0x7f56e40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:53.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.397+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f56e80d0820 con 0x7f56f8102320 2024-04-26T17:59:53.397 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.397+0000 7f56eeffd700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 0x7f56e40a6300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56f8079840 tx=0x7f56e001a040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:53.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.401+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f56e8014030 con 0x7f56f8102320 2024-04-26T17:59:53.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:53 smithi156 ceph-mon[32679]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:53.648 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.649+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56f819ae20 con 0x7f56f8102320 2024-04-26T17:59:53.649 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.650+0000 7f56f57fa700 1 -- 172.21.15.92:0/1669334937 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11883 (secure 0 0 0) 0x7f56f819ae20 con 0x7f56f8102320 2024-04-26T17:59:53.649 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:53.649 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:59:35.933653+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T17:59:53.651 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 msgr2=0x7f56e40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 0x7f56e40a6300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56f8079840 tx=0x7f56e001a040 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 msgr2=0x7f56f819f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f56e800c920 tx=0x7f56e800cc30 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 shutdown_connections 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f56e40a3e40 0x7f56e40a6300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56f8108390 0x7f56f81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56f8102320 0x7f56f819f730 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 --2- 172.21.15.92:0/1669334937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f56f8102ce0 0x7f56f819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 >> 172.21.15.92:0/1669334937 conn(0x7f56f80792d0 msgr2=0x7f56f8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 shutdown_connections 2024-04-26T17:59:53.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:53.652+0000 7f56fe0f4700 1 -- 172.21.15.92:0/1669334937 wait complete. 2024-04-26T17:59:53.653 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 26 2024-04-26T17:59:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:54 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1669334937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:54.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-26T17:59:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:54 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1669334937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:54 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1669334937' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T17:59:54.533 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:55 smithi092 ceph-mon[29156]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:55 smithi189 ceph-mon[32756]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:55 smithi156 ceph-mon[32679]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 46 op/s 2024-04-26T17:59:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 -- 172.21.15.92:0/3131498661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102350 msgr2=0x7f19f81027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/3131498661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102350 0x7f19f81027d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009990 tx=0x7f19f4009ca0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 -- 172.21.15.92:0/3131498661 shutdown_connections 2024-04-26T17:59:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/3131498661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f81083d0 0x7f19f81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.211 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/3131498661 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f8102d10 0x7f19f810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/3131498661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102350 0x7f19f81027d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.209+0000 7f19ffc4a700 1 -- 172.21.15.92:0/3131498661 >> 172.21.15.92:0/3131498661 conn(0x7f19f8078390 msgr2=0x7f19f80787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- 172.21.15.92:0/3131498661 shutdown_connections 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- 172.21.15.92:0/3131498661 wait complete. 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 Processor -- start 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- start start 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f8102350 0x7f19f819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 0x7f19f81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19f81125f0 con 0x7f19f8102d10 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8112470 con 0x7f19f8102350 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19ffc4a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8112770 con 0x7f19f81083d0 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.210+0000 7f19fd1e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:56.212 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54568/0 (socket says 172.21.15.92:54568) 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 -- 172.21.15.92:0/401599822 learned_addr learned my addr 172.21.15.92:0/401599822 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd9e6700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f8102350 0x7f19f819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fe1e7700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 0x7f19f81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 -- 172.21.15.92:0/401599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 msgr2=0x7f19f81a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 0x7f19f81a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 -- 172.21.15.92:0/401599822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f8102350 msgr2=0x7f19f819be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f8102350 0x7f19f819be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 -- 172.21.15.92:0/401599822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f81a0e10 con 0x7f19f8102d10 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fe1e7700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 0x7f19f81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19fd1e5700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f19f4000c00 tx=0x7f19f40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4027070 con 0x7f19f8102d10 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f81a10a0 con 0x7f19f8102d10 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19f4004150 con 0x7f19f8102d10 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f400f460 con 0x7f19f8102d10 2024-04-26T17:59:56.213 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.211+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f81a8980 con 0x7f19f8102d10 2024-04-26T17:59:56.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.212+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f8103a40 con 0x7f19f8102d10 2024-04-26T17:59:56.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.213+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 23) ==== 138822+0+0 (secure 0 0 0) 0x7f19f402a070 con 0x7f19f8102d10 2024-04-26T17:59:56.214 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.214+0000 7f19eeffd700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 0x7f19e40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.214+0000 7f19fd9e6700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 0x7f19e40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.214+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f19f40d1fd0 con 0x7f19f8102d10 2024-04-26T17:59:56.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.214+0000 7f19fd9e6700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 0x7f19e40a6300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8008040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:56.217 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.218+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f19f4031070 con 0x7f19f8102d10 2024-04-26T17:59:56.421 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.421+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19f81a8b50 con 0x7f19f8102d10 2024-04-26T17:59:56.422 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.423+0000 7f19eeffd700 1 -- 172.21.15.92:0/401599822 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+22854 (secure 0 0 0) 0x7f19f4013070 con 0x7f19f8102d10 2024-04-26T17:59:56.422 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T17:59:56.423 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":91,"fsid":"fb3c417a-03f4-11ef-bc93-c7b262605968","created":"2024-04-26T17:48:04.505316+0000","modified":"2024-04-26T17:59:37.408442+0000","last_up_change":"2024-04-26T17:55:15.475257+0000","last_in_change":"2024-04-26T17:54:55.211097+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:51:23.617086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:56:15.527225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:56:19.359811+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55536846-f612-4ca4-a1b7-c189c46c0248","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6803","nonce":2855272540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6805","nonce":2855272540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6809","nonce":2855272540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2855272540},{"type":"v1","addr":"172.21.15.92:6807","nonce":2855272540}]},"public_addr":"172.21.15.92:6803/2855272540","cluster_addr":"172.21.15.92:6805/2855272540","heartbeat_back_addr":"172.21.15.92:6809/2855272540","heartbeat_front_addr":"172.21.15.92:6807/2855272540","state":["exists","up"]},{"osd":1,"uuid":"f315aace-94f0-4e29-bd41-38288afb5d92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6801","nonce":2277484225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6803","nonce":2277484225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6807","nonce":2277484225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":2277484225},{"type":"v1","addr":"172.21.15.156:6805","nonce":2277484225}]},"public_addr":"172.21.15.156:6801/2277484225","cluster_addr":"172.21.15.156:6803/2277484225","heartbeat_back_addr":"172.21.15.156:6807/2277484225","heartbeat_front_addr":"172.21.15.156:6805/2277484225","state":["exists","up"]},{"osd":2,"uuid":"6b044658-ea68-41e1-87e3-dc22b4f2684a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6801","nonce":2479019407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6803","nonce":2479019407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6807","nonce":2479019407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":2479019407},{"type":"v1","addr":"172.21.15.189:6805","nonce":2479019407}]},"public_addr":"172.21.15.189:6801/2479019407","cluster_addr":"172.21.15.189:6803/2479019407","heartbeat_back_addr":"172.21.15.189:6807/2479019407","heartbeat_front_addr":"172.21.15.189:6805/2479019407","state":["exists","up"]},{"osd":3,"uuid":"b4bd9306-9b9e-45b9-b1d8-2661ac428acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6811","nonce":581844873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6813","nonce":581844873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6817","nonce":581844873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":581844873},{"type":"v1","addr":"172.21.15.92:6815","nonce":581844873}]},"public_addr":"172.21.15.92:6811/581844873","cluster_addr":"172.21.15.92:6813/581844873","heartbeat_back_addr":"172.21.15.92:6817/581844873","heartbeat_front_addr":"172.21.15.92:6815/581844873","state":["exists","up"]},{"osd":4,"uuid":"629fcf0c-6485-40a8-b061-830ca371d1a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6809","nonce":4116221322}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6811","nonce":4116221322}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6815","nonce":4116221322}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":4116221322},{"type":"v1","addr":"172.21.15.156:6813","nonce":4116221322}]},"public_addr":"172.21.15.156:6809/4116221322","cluster_addr":"172.21.15.156:6811/4116221322","heartbeat_back_addr":"172.21.15.156:6815/4116221322","heartbeat_front_addr":"172.21.15.156:6813/4116221322","state":["exists","up"]},{"osd":5,"uuid":"23e77478-0d7d-40d5-b841-afac85598bda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6809","nonce":197850559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6811","nonce":197850559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6815","nonce":197850559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":197850559},{"type":"v1","addr":"172.21.15.189:6813","nonce":197850559}]},"public_addr":"172.21.15.189:6809/197850559","cluster_addr":"172.21.15.189:6811/197850559","heartbeat_back_addr":"172.21.15.189:6815/197850559","heartbeat_front_addr":"172.21.15.189:6813/197850559","state":["exists","up"]},{"osd":6,"uuid":"93f45cf1-bff5-478b-8032-f981eb9e611e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6819","nonce":776474757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6821","nonce":776474757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6825","nonce":776474757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":776474757},{"type":"v1","addr":"172.21.15.92:6823","nonce":776474757}]},"public_addr":"172.21.15.92:6819/776474757","cluster_addr":"172.21.15.92:6821/776474757","heartbeat_back_addr":"172.21.15.92:6825/776474757","heartbeat_front_addr":"172.21.15.92:6823/776474757","state":["exists","up"]},{"osd":7,"uuid":"939fcac7-da9c-4597-bb1a-72551333afc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6817","nonce":2386131236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6819","nonce":2386131236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6823","nonce":2386131236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":2386131236},{"type":"v1","addr":"172.21.15.156:6821","nonce":2386131236}]},"public_addr":"172.21.15.156:6817/2386131236","cluster_addr":"172.21.15.156:6819/2386131236","heartbeat_back_addr":"172.21.15.156:6823/2386131236","heartbeat_front_addr":"172.21.15.156:6821/2386131236","state":["exists","up"]},{"osd":8,"uuid":"fde43dbf-ec98-4ffc-952c-a02d99f49c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6817","nonce":887620459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6819","nonce":887620459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6823","nonce":887620459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":887620459},{"type":"v1","addr":"172.21.15.189:6821","nonce":887620459}]},"public_addr":"172.21.15.189:6817/887620459","cluster_addr":"172.21.15.189:6819/887620459","heartbeat_back_addr":"172.21.15.189:6823/887620459","heartbeat_front_addr":"172.21.15.189:6821/887620459","state":["exists","up"]},{"osd":9,"uuid":"835333c8-14f9-48e8-a46d-d01933f736e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6827","nonce":452175931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6829","nonce":452175931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6833","nonce":452175931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":452175931},{"type":"v1","addr":"172.21.15.92:6831","nonce":452175931}]},"public_addr":"172.21.15.92:6827/452175931","cluster_addr":"172.21.15.92:6829/452175931","heartbeat_back_addr":"172.21.15.92:6833/452175931","heartbeat_front_addr":"172.21.15.92:6831/452175931","state":["exists","up"]},{"osd":10,"uuid":"dfe79378-5503-496e-a181-79991a26c848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6825","nonce":3658089432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6827","nonce":3658089432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6831","nonce":3658089432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":3658089432},{"type":"v1","addr":"172.21.15.156:6829","nonce":3658089432}]},"public_addr":"172.21.15.156:6825/3658089432","cluster_addr":"172.21.15.156:6827/3658089432","heartbeat_back_addr":"172.21.15.156:6831/3658089432","heartbeat_front_addr":"172.21.15.156:6829/3658089432","state":["exists","up"]},{"osd":11,"uuid":"c9c94655-dbf2-4779-a48e-3be47e6d1744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6825","nonce":3211809812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6827","nonce":3211809812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6831","nonce":3211809812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":3211809812},{"type":"v1","addr":"172.21.15.189:6829","nonce":3211809812}]},"public_addr":"172.21.15.189:6825/3211809812","cluster_addr":"172.21.15.189:6827/3211809812","heartbeat_back_addr":"172.21.15.189:6831/3211809812","heartbeat_front_addr":"172.21.15.189:6829/3211809812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:33.521045+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:50:57.309067+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:21.006872+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:51:46.222018+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:11.273005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:52:36.204211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:02.155984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:28.270411+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:53:53.949932+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:21.057490+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:54:47.249434+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:55:13.613253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.92:0/820323492":"2024-04-27T17:59:37.408406+0000","172.21.15.92:0/2513488882":"2024-04-27T17:59:37.408406+0000","172.21.15.92:6800/3474750194":"2024-04-27T17:59:37.408406+0000","172.21.15.92:0/2102193738":"2024-04-27T17:59:37.408406+0000","172.21.15.92:0/698745886":"2024-04-27T17:59:37.408406+0000","172.21.15.92:6801/3474750194":"2024-04-27T17:59:37.408406+0000","172.21.15.92:6801/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6800/2200342511":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/2793875930":"2024-04-27T17:48:57.534166+0000","172.21.15.92:0/3569279594":"2024-04-27T17:48:57.534166+0000","172.21.15.92:6801/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:6800/1516469819":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/4287149904":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/2361401174":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/271940461":"2024-04-27T17:48:31.081933+0000","172.21.15.92:0/378708074":"2024-04-27T17:48:57.534166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 msgr2=0x7f19e40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 0x7f19e40a6300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8008040 comp rx=0 tx=0).stop 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 msgr2=0x7f19f819c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f19f4000c00 tx=0x7f19f40047b0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 shutdown_connections 2024-04-26T17:59:56.425 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19e40a3e40 0x7f19e40a6300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f19f8102350 0x7f19f819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f19f81083d0 0x7f19f81a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 --2- 172.21.15.92:0/401599822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19f8102d10 0x7f19f819c340 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 >> 172.21.15.92:0/401599822 conn(0x7f19f8078390 msgr2=0x7f19f806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 shutdown_connections 2024-04-26T17:59:56.426 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T17:59:56.425+0000 7f19ffc4a700 1 -- 172.21.15.92:0/401599822 wait complete. 2024-04-26T17:59:57.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-04-26T17:59:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:57 smithi189 ceph-mon[32756]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 78 KiB/s wr, 53 op/s 2024-04-26T17:59:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:57 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/401599822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:57.398 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T17:59:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:57 smithi156 ceph-mon[32679]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 78 KiB/s wr, 53 op/s 2024-04-26T17:59:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:57 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/401599822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:57 smithi092 ceph-mon[29156]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 78 KiB/s wr, 53 op/s 2024-04-26T17:59:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:57 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/401599822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-26T17:59:59.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 17:59:59 smithi092 ceph-mon[29156]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T17:59:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 17:59:59 smithi189 ceph-mon[32756]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T17:59:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 17:59:59 smithi156 ceph-mon[32679]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T17:59:59.784 INFO:teuthology.orchestra.run.smithi092.stdout:{"run_dir":"/var/run/ceph"} 2024-04-26T17:59:59.784 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-26T17:59:59.784 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 9496 2024-04-26T17:59:59.785 DEBUG:tasks.quiescer:Yielding 2024-04-26T17:59:59.785 INFO:teuthology.run_tasks:Running task exec... 2024-04-26T17:59:59.795 INFO:teuthology.task.exec:Executing custom commands... 2024-04-26T17:59:59.795 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi092.front.sepia.ceph.com 2024-04-26T17:59:59.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-04-26T17:59:59.796 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T17:59:59.831 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T17:59:59.845 INFO:teuthology.orchestra.run.smithi092.stdout:Filesystem Size Used Avail Use% Mounted on 2024-04-26T17:59:59.845 INFO:teuthology.orchestra.run.smithi092.stdout:0@fb3c417a-03f4-11ef-bc93-c7b262605968.cephfs=/volumes/qa/sv_1/a702ca5f-ce45-4990-9a25-2c6a38991d13 340G 0 340G 0% /tmp/cephfs 2024-04-26T17:59:59.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-04-26T17:59:59.936 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-04-26T17:59:59.973 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-04-26T18:00:00.054 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:00 smithi189 ceph-mon[32756]: overall HEALTH_OK 2024-04-26T18:00:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:00 smithi156 ceph-mon[32679]: overall HEALTH_OK 2024-04-26T18:00:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-mon[29156]: overall HEALTH_OK 2024-04-26T18:00:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:01 smithi092 ceph-mon[29156]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T18:00:01.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:00:00.895+0000 7f252e14a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:00:01.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:00:00.896+0000 7f252e14a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:00:01.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:00:00.896+0000 7f252e14a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:00:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:00:00.896+0000 7f252e14a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:00:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:00:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:00:00.896+0000 7f252e14a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:00:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:01 smithi189 ceph-mon[32756]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T18:00:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:01 smithi156 ceph-mon[32679]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-04-26T18:00:01.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-04-26T18:00:01.985 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-04-26T18:00:01.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-04-26T18:00:02.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 . 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 .. 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 17:59 data 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:02.140 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 17:59 . 2024-04-26T18:00:02.141 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 .. 2024-04-26T18:00:02.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-04-26T18:00:02.225 INFO:teuthology.orchestra.run.smithi092.stdout:[Service] 2024-04-26T18:00:02.225 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-04-26T18:00:02.225 INFO:teuthology.orchestra.run.smithi092.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-04-26T18:00:02.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-04-26T18:00:02.350 INFO:teuthology.orchestra.run.smithi092.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- 172.21.15.92:0/4261717940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102ce0 msgr2=0x7fb86410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 --2- 172.21.15.92:0/4261717940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102ce0 0x7fb86410f1d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00b0a0 tx=0x7fb85c00b3b0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- 172.21.15.92:0/4261717940 shutdown_connections 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 --2- 172.21.15.92:0/4261717940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864108390 0x7fb864108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 --2- 172.21.15.92:0/4261717940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102ce0 0x7fb86410f1d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 --2- 172.21.15.92:0/4261717940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864102320 0x7fb8641027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- 172.21.15.92:0/4261717940 >> 172.21.15.92:0/4261717940 conn(0x7fb8640792d0 msgr2=0x7fb8640796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:02.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- 172.21.15.92:0/4261717940 shutdown_connections 2024-04-26T18:00:02.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- 172.21.15.92:0/4261717940 wait complete. 2024-04-26T18:00:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 Processor -- start 2024-04-26T18:00:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.789+0000 7fb86a980700 1 -- start start 2024-04-26T18:00:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:02.791 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864102ce0 0x7fb8641a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864108390 0x7fb86419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb864112530 con 0x7fb864102320 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641123b0 con 0x7fb864102ce0 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb86a980700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8641126b0 con 0x7fb864108390 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54598/0 (socket says 172.21.15.92:54598) 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 -- 172.21.15.92:0/243118148 learned_addr learned my addr 172.21.15.92:0/243118148 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb8637fe700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864102ce0 0x7fb8641a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb868f1d700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864108390 0x7fb86419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 -- 172.21.15.92:0/243118148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864108390 msgr2=0x7fb86419bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864108390 0x7fb86419bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 -- 172.21.15.92:0/243118148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864102ce0 msgr2=0x7fb8641a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:02.792 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864102ce0 0x7fb8641a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.790+0000 7fb863fff700 1 -- 172.21.15.92:0/243118148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86419c3f0 con 0x7fb864102320 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb863fff700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb85400e9a0 tx=0x7fb85400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85400cbd0 con 0x7fb864102320 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb85400cd70 con 0x7fb864102320 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86419c6e0 con 0x7fb864102320 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854018680 con 0x7fb864102320 2024-04-26T18:00:02.793 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.791+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8641a89c0 con 0x7fb864102320 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.792+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb864103a40 con 0x7fb864102320 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.793+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fb854010430 con 0x7fb864102320 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.794+0000 7fb8617fa700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 0x7fb84c0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.794+0000 7fb8637fe700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 0x7fb84c0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.794+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb8540d0c70 con 0x7fb864102320 2024-04-26T18:00:02.794 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.794+0000 7fb8637fe700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 0x7fb84c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb86419d260 tx=0x7fb858009190 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:02.798 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:02.798+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb85409d130 con 0x7fb864102320 2024-04-26T18:00:03.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.058+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8641a8b90 con 0x7fb864102320 2024-04-26T18:00:03.059 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.059+0000 7fb8617fa700 1 -- 172.21.15.92:0/243118148 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11883 (secure 0 0 0) 0x7fb85409ca30 con 0x7fb864102320 2024-04-26T18:00:03.059 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:03.059 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T17:59:35.933653+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:00:03.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 msgr2=0x7fb84c0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:03.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 0x7fb84c0a6390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb86419d260 tx=0x7fb858009190 comp rx=0 tx=0).stop 2024-04-26T18:00:03.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 msgr2=0x7fb8641a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:03.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb85400e9a0 tx=0x7fb85400ecb0 comp rx=0 tx=0).stop 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 shutdown_connections 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb84c0a3ed0 0x7fb84c0a6390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb864108390 0x7fb86419bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb864102320 0x7fb8641a1a40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 --2- 172.21.15.92:0/243118148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb864102ce0 0x7fb8641a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 >> 172.21.15.92:0/243118148 conn(0x7fb8640792d0 msgr2=0x7fb86406b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 shutdown_connections 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:03.061+0000 7fb86a980700 1 -- 172.21.15.92:0/243118148 wait complete. 2024-04-26T18:00:03.062 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 26 2024-04-26T18:00:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:03 smithi156 ceph-mon[32679]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:03 smithi156 ceph-mon[32679]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-04-26T18:00:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:03 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/243118148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:03.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:03 smithi092 ceph-mon[29156]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:03.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:03 smithi092 ceph-mon[29156]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-04-26T18:00:03.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:03 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/243118148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:03 smithi189 ceph-mon[32756]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:03 smithi189 ceph-mon[32756]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-04-26T18:00:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:03 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/243118148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:03.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-26T17:56:22.551088+0000', 'modified': '2024-04-26T17:59:35.933653+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24437, 'mds_1': 24419, 'mds_2': 24406}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24394': {'gid': 24394, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/3880754337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 3880754337}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 3880754337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/1535152997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 1535152997}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 1535152997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24401': {'gid': 24401, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6835/1296842780', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6834', 'nonce': 1296842780}, {'type': 'v1', 'addr': '172.21.15.156:6835', 'nonce': 1296842780}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24406': {'gid': 24406, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.189:6839/915245244', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 915245244}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 915245244}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.156:6837/1965706259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 1965706259}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 1965706259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.156:6839/2836729853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 2836729853}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 2836729853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24437, 'qdb_cluster': [24406, 24419, 24437]} 2024-04-26T18:00:03.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-26T18:00:03.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.i status 2024-04-26T18:00:04.136 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:05 smithi156 ceph-mon[32679]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:05.456 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:05 smithi092 ceph-mon[29156]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:05 smithi189 ceph-mon[32756]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- 172.21.15.92:0/1253766993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 msgr2=0x7f20541038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 --2- 172.21.15.92:0/1253766993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f20541038f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2044009990 tx=0x7f2044009ca0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- 172.21.15.92:0/1253766993 shutdown_connections 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 --2- 172.21.15.92:0/1253766993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20541094c0 0x7f20541098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 --2- 172.21.15.92:0/1253766993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2054103e30 0x7f2054110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 --2- 172.21.15.92:0/1253766993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f20541038f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.878 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- 172.21.15.92:0/1253766993 >> 172.21.15.92:0/1253766993 conn(0x7f205407a580 msgr2=0x7f205407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- 172.21.15.92:0/1253766993 shutdown_connections 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- 172.21.15.92:0/1253766993 wait complete. 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 Processor -- start 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.876+0000 7f205c113700 1 -- start start 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2054103e30 0x7f205419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 0x7f2054199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2054113640 con 0x7f2054103470 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f20541134c0 con 0x7f2054103e30 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205c113700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20541137c0 con 0x7f20541094c0 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58340/0 (socket says 172.21.15.92:58340) 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 -- 172.21.15.92:0/364279876 learned_addr learned my addr 172.21.15.92:0/364279876 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.879 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f20596ae700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2054103e30 0x7f205419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205a6b0700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 0x7f2054199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 -- 172.21.15.92:0/364279876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 msgr2=0x7f2054199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 0x7f2054199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 -- 172.21.15.92:0/364279876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2054103e30 msgr2=0x7f205419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2054103e30 0x7f205419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 -- 172.21.15.92:0/364279876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205419a1a0 con 0x7f2054103470 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f205a6b0700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 0x7f2054199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f2059eaf700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f205000d980 tx=0x7f205000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.877+0000 7f204affd700 1 -- 172.21.15.92:0/364279876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050016070 con 0x7f2054103470 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.878+0000 7f204affd700 1 -- 172.21.15.92:0/364279876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2050004830 con 0x7f2054103470 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.878+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205419a490 con 0x7f2054103470 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.878+0000 7f204affd700 1 -- 172.21.15.92:0/364279876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20500054c0 con 0x7f2054103470 2024-04-26T18:00:05.880 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.878+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541a6750 con 0x7f2054103470 2024-04-26T18:00:05.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.880+0000 7f204affd700 1 -- 172.21.15.92:0/364279876 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f2050004220 con 0x7f2054103470 2024-04-26T18:00:05.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.880+0000 7f204affd700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 0x7f20400a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.880+0000 7f20596ae700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 0x7f20400a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.880+0000 7f204affd700 1 -- 172.21.15.92:0/364279876 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f20500d0850 con 0x7f2054103470 2024-04-26T18:00:05.881 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.881+0000 7f20596ae700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 0x7f20400a6390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20440098e0 tx=0x7f2044005960 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 Processor -- start 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 -- start start 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808043eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560807f906f0 con 0x5608080443f0 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560807f2f590 con 0x56080803e2d0 2024-04-26T18:00:05.883 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20669a5b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560807f8c6b0 con 0x560808043ad0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58354/0 (socket says 172.21.15.92:58354) 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20596ae700 1 -- 172.21.15.92:0/256463635 learned_addr learned my addr 172.21.15.92:0/256463635 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f2059eaf700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808043eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 -- 172.21.15.92:0/256463635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 msgr2=0x560808043eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808043eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 -- 172.21.15.92:0/256463635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 msgr2=0x56080803dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f205a6b0700 1 -- 172.21.15.92:0/256463635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560807edd880 con 0x56080803e2d0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.882+0000 7f20596ae700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.883+0000 7f205a6b0700 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803e710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f204c009ee0 tx=0x7f204c009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354049a4ca45729e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.883+0000 7f203ffff700 1 -- 172.21.15.92:0/256463635 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c01a070 con 0x56080803e2d0 2024-04-26T18:00:05.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.883+0000 7f203ffff700 1 -- 172.21.15.92:0/256463635 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c015410 con 0x56080803e2d0 2024-04-26T18:00:05.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.883+0000 7f203ffff700 1 -- 172.21.15.92:0/256463635 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00ce60 con 0x56080803e2d0 2024-04-26T18:00:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- 172.21.15.92:0/256463635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 msgr2=0x56080803e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.887 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803e710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f204c009ee0 tx=0x7f204c009f10 comp rx=0 tx=0).stop 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- 172.21.15.92:0/256463635 shutdown_connections 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803e710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808043eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 --2- 172.21.15.92:0/256463635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x56080803dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- 172.21.15.92:0/256463635 >> 172.21.15.92:0/256463635 conn(0x560807f6acf0 msgr2=0x5608080391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- 172.21.15.92:0/256463635 shutdown_connections 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- 172.21.15.92:0/256463635 wait complete. 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 -- start start 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.884+0000 7f20669a5b80 1 Processor -- start 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x56080804a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x5608080479a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56080804af10 con 0x560808043ad0 2024-04-26T18:00:05.888 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560807ef6900 con 0x5608080443f0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56080804b090 con 0x56080803e2d0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20669a5b80 10 client.0 _ll_register_callbacks cb 0x560807f24530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58360/0 (socket says 172.21.15.92:58360) 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 -- 172.21.15.92:0/1621428540 learned_addr learned my addr 172.21.15.92:0/1621428540 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f205a6b0700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x5608080479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f2059eaf700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x56080804a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 -- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 msgr2=0x56080804a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x56080804a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 -- 172.21.15.92:0/1621428540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 msgr2=0x5608080479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x5608080479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 -- 172.21.15.92:0/1621428540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560808048010 con 0x560808043ad0 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f205a6b0700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x5608080479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:05.889 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f2059eaf700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x56080804a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f20596ae700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2044006010 tx=0x7f2044009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e78bf813c5a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.885+0000 7f203d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044030460 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f2044030600 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c015410 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f204403e050 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 10 client.15279 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5608080559b0 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c015410 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f204400f8f0 con 0x560808043ad0 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 10 client.15279 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:00:05.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 20 client.15279 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x560808058060 0x5608080594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 4 client.15279 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.886+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560807f9e0d0 con 0x560808058060 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.887+0000 7f2059eaf700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x560808058060 0x5608080594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.887+0000 7f203d7fa700 10 client.15279 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T18:00:05.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.887+0000 7f2059eaf700 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x560808058060 0x5608080594d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=614ac161e09276b9 server_cookie=d0e458893b53195c in_seq=0 out_seq=0 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f203d7fa700 1 -- 172.21.15.92:0/1621428540 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560807f9e0d0 con 0x560808058060 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f203d7fa700 10 client.15279 handle_command_reply: tid=0 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 client.15279 shutdown 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 msgr2=0x560808047460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2044006010 tx=0x7f2044009310 comp rx=0 tx=0).stop 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 shutdown_connections 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x560808058060 0x5608080594d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x5608080479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x56080804a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.892 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 --2- 172.21.15.92:0/1621428540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x560808047460 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f203d7fa700 0 client.15279 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T18:00:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 >> 172.21.15.92:0/1621428540 conn(0x560807f6acf0 msgr2=0x560808038da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 shutdown_connections 2024-04-26T18:00:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 1 -- 172.21.15.92:0/1621428540 wait complete. 2024-04-26T18:00:05.893 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.888+0000 7f20669a5b80 20 client.15279 trim_cache size 0 max 16384 2024-04-26T18:00:05.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 Processor -- start 2024-04-26T18:00:05.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 -- start start 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808062930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560808057810 con 0x5608080443f0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.909+0000 7f20669a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560808057ee0 con 0x56080803e2d0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f20669a5b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608080585b0 con 0x560808043ad0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f205a6b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f205a6b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58372/0 (socket says 172.21.15.92:58372) 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f205a6b0700 1 -- 172.21.15.92:0/4019470223 learned_addr learned my addr 172.21.15.92:0/4019470223 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f20596ae700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808062930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 -- 172.21.15.92:0/4019470223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 msgr2=0x560808062930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808062930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 -- 172.21.15.92:0/4019470223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 msgr2=0x560808062e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 -- 172.21.15.92:0/4019470223 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560808039690 con 0x56080803e2d0 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f20596ae700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808062930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f205a6b0700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f2059eaf700 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803dcb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20500cde90 tx=0x7f20500989e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c178b677b2473bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f203f7fe700 1 -- 172.21.15.92:0/4019470223 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20500a09c0 con 0x56080803e2d0 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f203f7fe700 1 -- 172.21.15.92:0/4019470223 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2050098040 con 0x56080803e2d0 2024-04-26T18:00:05.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.910+0000 7f203f7fe700 1 -- 172.21.15.92:0/4019470223 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2050005730 con 0x56080803e2d0 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 -- 172.21.15.92:0/4019470223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 msgr2=0x56080803dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803dcb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20500cde90 tx=0x7f20500989e0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 -- 172.21.15.92:0/4019470223 shutdown_connections 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56080803e2d0 0x56080803dcb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5608080443f0 0x560808062e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 --2- 172.21.15.92:0/4019470223 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560808043ad0 0x560808062930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 -- 172.21.15.92:0/4019470223 >> 172.21.15.92:0/4019470223 conn(0x560807f6acf0 msgr2=0x560808056e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 -- 172.21.15.92:0/4019470223 shutdown_connections 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.911+0000 7f20669a5b80 1 -- 172.21.15.92:0/4019470223 wait complete. 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 -- start start 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 Processor -- start 2024-04-26T18:00:05.916 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x560808053480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x560808053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560808059350 con 0x560808043ad0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560808058c80 con 0x5608080443f0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560808059a20 con 0x56080803e2d0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20669a5b80 10 client.0 _ll_register_callbacks cb 0x560807f24530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20596ae700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58384/0 (socket says 172.21.15.92:58384) 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f205a6b0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x560808053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f20596ae700 1 -- 172.21.15.92:0/2941247566 learned_addr learned my addr 172.21.15.92:0/2941247566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.912+0000 7f2059eaf700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x560808053480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 -- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 msgr2=0x560808053480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x560808053480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.917 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 -- 172.21.15.92:0/2941247566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 msgr2=0x560808053f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x560808053f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 -- 172.21.15.92:0/2941247566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560808060f00 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20596ae700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f204400fce0 tx=0x7f204402f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a66bedc555f74fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f203d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400f870 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f204400fa10 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2050098040 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2044053050 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20669a5b80 10 client.15285 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5608080bf6b0 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.913+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2050098040 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2044030620 con 0x560808043ad0 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 10 client.15285 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:05.918 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 10 client.15285 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 20 client.15285 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x5608080c4300 0x5608080c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 4 client.15285 mds_command: new command op to 24406 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 --> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] -- command(tid 0: {"prefix": "status"}) -- 0x560807f98170 con 0x5608080c4300 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.914+0000 7f2059eaf700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x5608080c4300 0x5608080c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f203d7fa700 10 client.15285 ms_handle_connect on v2:172.21.15.189:6838/915245244 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f2059eaf700 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x5608080c4300 0x5608080c3010 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0fc5a81eb45c460 server_cookie=a8677b5022064f0e in_seq=0 out_seq=0 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f203d7fa700 1 -- 172.21.15.92:0/2941247566 <== mds.2 v2:172.21.15.189:6838/915245244 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560807f98170 con 0x5608080c4300 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f203d7fa700 10 client.15285 handle_command_reply: tid=0 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 client.15285 shutdown 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 msgr2=0x5608080539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f204400fce0 tx=0x7f204402f670 comp rx=0 tx=0).stop 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 shutdown_connections 2024-04-26T18:00:05.919 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:6838/915245244,v1:172.21.15.189:6839/915245244] conn(0x5608080c4300 0x5608080c3010 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5608080443f0 0x560808053f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56080803e2d0 0x560808053480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 --2- 172.21.15.92:0/2941247566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560808043ad0 0x5608080539c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f203d7fa700 0 client.15285 ms_handle_reset on v2:172.21.15.189:6838/915245244 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 >> 172.21.15.92:0/2941247566 conn(0x560807f6acf0 msgr2=0x560808041620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 shutdown_connections 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 1 -- 172.21.15.92:0/2941247566 wait complete. 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.915+0000 7f20669a5b80 20 client.15285 trim_cache size 0 max 16384 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:00:05.920 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 2, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24406, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 207.195419942, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 26, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 91, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 90, 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 248.48766459800001 2024-04-26T18:00:05.921 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 msgr2=0x7f20400a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 0x7f20400a6390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f20440098e0 tx=0x7f2044005960 comp rx=0 tx=0).stop 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 msgr2=0x7f205419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f205000d980 tx=0x7f205000dc90 comp rx=0 tx=0).stop 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 shutdown_connections 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20400a3ed0 0x7f20400a6390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20541094c0 0x7f2054199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.922 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2054103470 0x7f205419f880 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 --2- 172.21.15.92:0/364279876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2054103e30 0x7f205419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 >> 172.21.15.92:0/364279876 conn(0x7f205407a580 msgr2=0x7f20541021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 shutdown_connections 2024-04-26T18:00:05.923 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:05.916+0000 7f205c113700 1 -- 172.21.15.92:0/364279876 wait complete. 2024-04-26T18:00:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- 172.21.15.92:0/4192990924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 msgr2=0x7f631c10c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 --2- 172.21.15.92:0/4192990924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c10c9c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6310009900 tx=0x7f631002a510 comp rx=0 tx=0).stop 2024-04-26T18:00:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- 172.21.15.92:0/4192990924 shutdown_connections 2024-04-26T18:00:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 --2- 172.21.15.92:0/4192990924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c10cf00 0x7f631c10f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 --2- 172.21.15.92:0/4192990924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c10c9c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 --2- 172.21.15.92:0/4192990924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c103bc0 0x7f631c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- 172.21.15.92:0/4192990924 >> 172.21.15.92:0/4192990924 conn(0x7f631c0789b0 msgr2=0x7f631c078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- 172.21.15.92:0/4192990924 shutdown_connections 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- 172.21.15.92:0/4192990924 wait complete. 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 Processor -- start 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.975+0000 7f6322450640 1 -- start start 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c103bc0 0x7f631c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 0x7f631c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112bb0 con 0x7f631c1044e0 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112a30 con 0x7f631c10cf00 2024-04-26T18:00:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f631c112d30 con 0x7f631c103bc0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58400/0 (socket says 172.21.15.92:58400) 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 -- 172.21.15.92:0/2196030135 learned_addr learned my addr 172.21.15.92:0/2196030135 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631bfff640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c103bc0 0x7f631c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f63209ed640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 0x7f631c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 -- 172.21.15.92:0/2196030135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c103bc0 msgr2=0x7f631c199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c103bc0 0x7f631c199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 -- 172.21.15.92:0/2196030135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 msgr2=0x7f631c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 0x7f631c19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 -- 172.21.15.92:0/2196030135 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c19e140 con 0x7f631c1044e0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f63209ed640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 0x7f631c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6310005940 tx=0x7f6310004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f63197fa640 1 -- 172.21.15.92:0/2196030135 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631003f030 con 0x7f631c1044e0 2024-04-26T18:00:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f63197fa640 1 -- 172.21.15.92:0/2196030135 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6310003aa0 con 0x7f631c1044e0 2024-04-26T18:00:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631c19e3d0 con 0x7f631c1044e0 2024-04-26T18:00:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f63197fa640 1 -- 172.21.15.92:0/2196030135 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310035070 con 0x7f631c1044e0 2024-04-26T18:00:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.976+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631c1a5cc0 con 0x7f631c1044e0 2024-04-26T18:00:05.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.978+0000 7f63197fa640 1 -- 172.21.15.92:0/2196030135 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f6310042030 con 0x7f631c1044e0 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f63197fa640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 0x7f63040a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 Processor -- start 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 -- start start 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f631bfff640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 0x7f63040a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f63197fa640 1 -- 172.21.15.92:0/2196030135 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f63100f1060 con 0x7f631c1044e0 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e15652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e15700e0 0x55e9e15724d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9e14cb460 con 0x55e9e1565820 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55e9e1485590 con 0x55e9e1564f00 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f6325168740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9e14c7420 con 0x55e9e15700e0 2024-04-26T18:00:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58402/0 (socket says 172.21.15.92:58402) 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.979+0000 7f631b7fe640 1 -- 172.21.15.92:0/124298583 learned_addr learned my addr 172.21.15.92:0/124298583 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f63209ed640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e15700e0 0x55e9e15724d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631bfff640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 0x7f63040a63a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f630c009c20 tx=0x7f630c005f90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631bfff640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e15652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 -- 172.21.15.92:0/124298583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e15700e0 msgr2=0x55e9e15724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e15700e0 0x55e9e15724d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 -- 172.21.15.92:0/124298583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 msgr2=0x55e9e15652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e15652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 -- 172.21.15.92:0/124298583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e14920d0 con 0x55e9e1565820 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631bfff640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e15652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f631b7fe640 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f63100b9350 tx=0x7f63100bcaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0edeaf18407b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f63027fc640 1 -- 172.21.15.92:0/124298583 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310049040 con 0x55e9e1565820 2024-04-26T18:00:05.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f63027fc640 1 -- 172.21.15.92:0/124298583 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63100bcef0 con 0x55e9e1565820 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.980+0000 7f63027fc640 1 -- 172.21.15.92:0/124298583 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100c56d0 con 0x55e9e1565820 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- 172.21.15.92:0/124298583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 msgr2=0x55e9e156fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f63100b9350 tx=0x7f63100bcaf0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- 172.21.15.92:0/124298583 shutdown_connections 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e15700e0 0x55e9e15724d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e156fba0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- 172.21.15.92:0/124298583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e15652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- 172.21.15.92:0/124298583 >> 172.21.15.92:0/124298583 conn(0x55e9e1561410 msgr2=0x55e9e15617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- 172.21.15.92:0/124298583 shutdown_connections 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- 172.21.15.92:0/124298583 wait complete. 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- start start 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 Processor -- start 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e156d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e156db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e9e14cb460 con 0x55e9e1564f00 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55e9e1452b60 con 0x55e9e15700e0 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.981+0000 7f6325168740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e9e1572ad0 con 0x55e9e1565820 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f6325168740 10 client.0 _ll_register_callbacks cb 0x55e9e14772b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58408/0 (socket says 172.21.15.92:58408) 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 -- 172.21.15.92:0/2266997947 learned_addr learned my addr 172.21.15.92:0/2266997947 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e156d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f63209ed640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e156db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 -- 172.21.15.92:0/2266997947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 msgr2=0x55e9e156d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e156d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 -- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 msgr2=0x55e9e156db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e156db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 -- 172.21.15.92:0/2266997947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e11dd210 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f63209ed640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e156db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f631bfff640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b960 tx=0x7f630c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bf8838c4160387 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f62fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c029060 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f630c00fad0 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63100bcef0 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f630c00fcd0 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f6325168740 10 client.15297 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e9e12a9620 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.982+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63100bcef0 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f630c02c020 con 0x55e9e1564f00 2024-04-26T18:00:05.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 10 client.15297 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 10 client.15297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 20 client.15297 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e157ff10 0x55e9e1582300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 4 client.15297 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9e14d9070 con 0x55e9e157ff10 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e157ff10 0x55e9e1582300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f631b7fe640 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e157ff10 0x55e9e1582300 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d834b3a1773c2df server_cookie=17408fb9c2361345 in_seq=0 out_seq=0 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.983+0000 7f62fb7fe640 10 client.15297 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f62fb7fe640 1 -- 172.21.15.92:0/2266997947 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9e14d9070 con 0x55e9e157ff10 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f62fb7fe640 10 client.15297 handle_command_reply: tid=0 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 client.15297 shutdown 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 msgr2=0x55e9e156d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f630c01b960 tx=0x7f630c004730 comp rx=0 tx=0).stop 2024-04-26T18:00:05.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 shutdown_connections 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e157ff10 0x55e9e1582300 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e156db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e156d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 --2- 172.21.15.92:0/2266997947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1564f00 0x55e9e156d0b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f62fb7fe640 0 client.15297 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 >> 172.21.15.92:0/2266997947 conn(0x55e9e1561410 msgr2=0x55e9e1567190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 shutdown_connections 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 1 -- 172.21.15.92:0/2266997947 wait complete. 2024-04-26T18:00:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.984+0000 7f6325168740 20 client.15297 trim_cache size 0 max 16384 2024-04-26T18:00:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 Processor -- start 2024-04-26T18:00:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 -- start start 2024-04-26T18:00:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e157b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e1566fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1b0c70 con 0x55e9e15700e0 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ae540 con 0x55e9e1564f00 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:05.999+0000 7f6325168740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ac3d0 con 0x55e9e1565820 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58424/0 (socket says 172.21.15.92:58424) 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 -- 172.21.15.92:0/1341708979 learned_addr learned my addr 172.21.15.92:0/1341708979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f631b7fe640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e1566fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f631bfff640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e157b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 -- 172.21.15.92:0/1341708979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 msgr2=0x55e9e1566fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e1566fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 -- 172.21.15.92:0/1341708979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 msgr2=0x55e9e157b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e157b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 -- 172.21.15.92:0/1341708979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e156b620 con 0x55e9e15700e0 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f631b7fe640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e1566fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f63209ed640 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63140123f0 tx=0x7f63140128b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f225c16f525879 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f6301ffb640 1 -- 172.21.15.92:0/1341708979 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314020070 con 0x55e9e15700e0 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f6301ffb640 1 -- 172.21.15.92:0/1341708979 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f631401b8c0 con 0x55e9e15700e0 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.000+0000 7f6301ffb640 1 -- 172.21.15.92:0/1341708979 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63140109b0 con 0x55e9e15700e0 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- 172.21.15.92:0/1341708979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 msgr2=0x55e9e1587bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f63140123f0 tx=0x7f63140128b0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- 172.21.15.92:0/1341708979 shutdown_connections 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e15700e0 0x55e9e1587bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1565820 0x55e9e1566fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 --2- 172.21.15.92:0/1341708979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e1564f00 0x55e9e157b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- 172.21.15.92:0/1341708979 >> 172.21.15.92:0/1341708979 conn(0x55e9e1561410 msgr2=0x55e9e15668b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- 172.21.15.92:0/1341708979 shutdown_connections 2024-04-26T18:00:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- 172.21.15.92:0/1341708979 wait complete. 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 -- start start 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.001+0000 7f6325168740 1 Processor -- start 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1564f00 0x55e9e15781f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e1575300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1aca20 con 0x55e9e1565820 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ade70 con 0x55e9e15700e0 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f631c1ad0d0 con 0x55e9e1564f00 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 10 client.0 _ll_register_callbacks cb 0x7f630c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58432/0 (socket says 172.21.15.92:58432) 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 -- 172.21.15.92:0/1221523426 learned_addr learned my addr 172.21.15.92:0/1221523426 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f63209ed640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e1575300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631bfff640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1564f00 0x55e9e15781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 -- 172.21.15.92:0/1221523426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1564f00 msgr2=0x55e9e15781f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1564f00 0x55e9e15781f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 -- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 msgr2=0x55e9e1575300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e1575300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 -- 172.21.15.92:0/1221523426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e1575b00 con 0x55e9e1565820 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f63209ed640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e1575300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f631b7fe640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63100ee7b0 tx=0x7f63100bc910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af34ab0118bdb232 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f62fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310049040 con 0x55e9e1565820 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f631003bcc0 con 0x55e9e1565820 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f631401b8c0 con 0x55e9e1565820 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63100b9560 con 0x55e9e1565820 2024-04-26T18:00:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 10 client.15303 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.002+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e9e15e74c0 con 0x55e9e1565820 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f631401b8c0 con 0x55e9e1565820 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f63100c56d0 con 0x55e9e1565820 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 10 client.15303 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 10 client.15303 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 20 client.15303 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e15e78c0 0x55e9e15e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 4 client.15303 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e9e14d2ee0 con 0x55e9e15e78c0 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f631bfff640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e15e78c0 0x55e9e15e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f631bfff640 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e15e78c0 0x55e9e15e9ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c9bb69af37c6bf server_cookie=562e6c932afc3c23 in_seq=0 out_seq=0 2024-04-26T18:00:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.003+0000 7f62fb7fe640 10 client.15303 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.244+0000 7f62fb7fe640 1 -- 172.21.15.92:0/1221523426 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e9e14d2ee0 con 0x55e9e15e78c0 2024-04-26T18:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.244+0000 7f62fb7fe640 10 client.15303 handle_command_reply: tid=0 2024-04-26T18:00:06.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.244+0000 7f6325168740 1 client.15303 shutdown 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.244+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 msgr2=0x55e9e1574cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.244+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f63100ee7b0 tx=0x7f63100bc910 comp rx=0 tx=0).stop 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 shutdown_connections 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e9e15e78c0 0x55e9e15e9ce0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e9e15700e0 0x55e9e1575300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e9e1565820 0x55e9e1574cf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f62fb7fe640 0 client.15303 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 --2- 172.21.15.92:0/1221523426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e9e1564f00 0x55e9e15781f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 >> 172.21.15.92:0/1221523426 conn(0x55e9e1561410 msgr2=0x55e9e15605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 shutdown_connections 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 1 -- 172.21.15.92:0/1221523426 wait complete. 2024-04-26T18:00:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6325168740 20 client.15303 trim_cache size 0 max 16384 2024-04-26T18:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:00:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 msgr2=0x7f63040a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 0x7f63040a63a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f630c009c20 tx=0x7f630c005f90 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 msgr2=0x7f631c199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6310005940 tx=0x7f6310004270 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 shutdown_connections 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f63040a3ee0 0x7f63040a63a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f631c10cf00 0x7f631c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f631c1044e0 0x7f631c199690 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 --2- 172.21.15.92:0/2196030135 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f631c103bc0 0x7f631c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.245+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 >> 172.21.15.92:0/2196030135 conn(0x7f631c0789b0 msgr2=0x7f631c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.246+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 shutdown_connections 2024-04-26T18:00:06.249 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:06.246+0000 7f6322450640 1 -- 172.21.15.92:0/2196030135 wait complete. 2024-04-26T18:00:06.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.h status 2024-04-26T18:00:06.854 INFO:teuthology.orchestra.run.smithi092.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-04-26T18:00:06.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/: 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 . 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 .. 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 data 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data: 2024-04-26T18:00:06.895 INFO:teuthology.orchestra.run.smithi092.stdout:total 35 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 . 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 17:59 .. 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 base 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 26 18:00 global 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 log 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_commit_ts 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_dynshmem 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Apr 26 18:00 pg_hba.conf 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Apr 26 18:00 pg_ident.conf 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 pg_logical 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 pg_multixact 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_notify 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_replslot 2024-04-26T18:00:06.896 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_serial 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_snapshots 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_stat 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_stat_tmp 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 pg_subtrans 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_tblspc 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 pg_twophase 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 PG_VERSION 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 pg_wal 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 pg_xact 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Apr 26 18:00 postgresql.auto.conf 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 Apr 26 18:00 postgresql.conf 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base: 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.897 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 . 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 1 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 13493 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 13494 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/1: 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 . 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 .. 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 112 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 113 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 1247 2024-04-26T18:00:06.898 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1247_fsm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1247_vm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 18:00 1249 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1249_fsm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1249_vm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 18:00 1255 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1255_fsm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1255_vm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 18:00 1259 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1259_fsm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1259_vm 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 18:00 13344 2024-04-26T18:00:06.899 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13344_fsm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13344_vm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13346 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13348 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13349_fsm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349_vm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13351 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13353 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13354_fsm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354_vm 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13356 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13358 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359 2024-04-26T18:00:06.900 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13359_fsm 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359_vm 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13361 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13363 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1417 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1418 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 174 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 175 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2187 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2224 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2328 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2336 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2337 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2579 2024-04-26T18:00:06.901 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2600 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2600_fsm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2600_vm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2601_fsm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601_vm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2602 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2602_fsm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2602_vm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2603 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2603_fsm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2603_vm 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2604 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2605 2024-04-26T18:00:06.902 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2605_fsm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2605_vm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2606_fsm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606_vm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2607 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2607_fsm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2607_vm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 18:00 2608 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2608_fsm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2608_vm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 18:00 2609 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2609_fsm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2609_vm 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2610 2024-04-26T18:00:06.903 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2610_fsm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2610_vm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2611 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2612_fsm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612_vm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2613 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2615_fsm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615_vm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2616 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2616_fsm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2616_vm 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 18:00 2617 2024-04-26T18:00:06.904 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2617_fsm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2617_vm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 18:00 2618 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2618_fsm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2618_vm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 18:00 2619 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2619_fsm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2619_vm 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2620 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2650 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2651 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2652 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2653 2024-04-26T18:00:06.905 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2654 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2655 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2656 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2657 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 18:00 2658 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 2659 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2660 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2661 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2662 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2663 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2664 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2665 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2666 2024-04-26T18:00:06.906 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2667 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2668 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2669 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2670 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 18:00 2673 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 18:00 2674 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 18:00 2675 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2678 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2679 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2680 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2681 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2682 2024-04-26T18:00:06.907 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2683 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2684 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2685 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2686 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2687 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2688 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2689 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 18:00 2690 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 18:00 2691 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2692 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2693 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2696 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2699 2024-04-26T18:00:06.908 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2701 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2702 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2703 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2704 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2753 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2753_fsm 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2753_vm 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2754 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2755 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2756 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2757 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2830 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2831 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2832 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2833 2024-04-26T18:00:06.909 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2834 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2835 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2836 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2837 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 18:00 2838 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2838_fsm 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2838_vm 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2839 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840_fsm 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2840_vm 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2841 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2995 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2996 2024-04-26T18:00:06.910 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3079_fsm 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079_vm 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3080 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3081 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3085 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3118 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3119 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 18:00 3164 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3256 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3257 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3258 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3350 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3351 2024-04-26T18:00:06.911 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3379 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3380 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3381 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3394 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3394_fsm 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3394_vm 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3395 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3429 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3430 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3431 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3433 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3439 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3440 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3455 2024-04-26T18:00:06.912 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 18:00 3456 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3456_fsm 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3456_vm 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3466 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3467 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3468 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3501 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3502 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3503 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3534 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3541_fsm 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541_vm 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3542 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3574 2024-04-26T18:00:06.913 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3575 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3576 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3596 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3597 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3598 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3599 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3600_fsm 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600_vm 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3601_fsm 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601_vm 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3602_fsm 2024-04-26T18:00:06.914 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602_vm 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603_fsm 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3603_vm 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3604 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3605 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3606 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3607 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3608 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 3609 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3712 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3764_fsm 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764_vm 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3766 2024-04-26T18:00:06.915 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3767 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3997 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4143 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4144 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4145 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4146 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4147 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4148 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4149 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4150 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4151 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4152 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4153 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4154 2024-04-26T18:00:06.916 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4155 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4156 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4157 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4158 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4159 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4160 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4161 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4162 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4163 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4164 2024-04-26T18:00:06.917 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4165 2024-04-26T18:00:06.920 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4166 2024-04-26T18:00:06.920 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4167 2024-04-26T18:00:06.920 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4168 2024-04-26T18:00:06.920 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4169 2024-04-26T18:00:06.920 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4170 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4171 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4172 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4173 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4174 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 5002 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 548 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 549 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6102 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6104 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6106 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6110 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6111 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6112 2024-04-26T18:00:06.921 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6113 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6117 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 826 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 827 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 828 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 18:00 pg_filenode.map 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 PG_VERSION 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-04-26T18:00:06.922 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 . 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 .. 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 112 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 113 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 1247 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1247_fsm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1247_vm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 18:00 1249 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1249_fsm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1249_vm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 18:00 1255 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1255_fsm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1255_vm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 18:00 1259 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1259_fsm 2024-04-26T18:00:06.923 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1259_vm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 18:00 13344 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13344_fsm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13344_vm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13346 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13348 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13349_fsm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349_vm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13351 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13353 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13354_fsm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354_vm 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13356 2024-04-26T18:00:06.924 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13358 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13359_fsm 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359_vm 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13361 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13363 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1417 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1418 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 174 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 175 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2187 2024-04-26T18:00:06.925 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2224 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2328 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2336 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2337 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2579 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2600 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2600_fsm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2600_vm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2601_fsm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601_vm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2602 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2602_fsm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2602_vm 2024-04-26T18:00:06.926 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2603 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2603_fsm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2603_vm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2604 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2605 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2605_fsm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2605_vm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2606_fsm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606_vm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2607 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2607_fsm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2607_vm 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 18:00 2608 2024-04-26T18:00:06.927 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2608_fsm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2608_vm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 18:00 2609 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2609_fsm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2609_vm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2610 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2610_fsm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2610_vm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2611 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2612_fsm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612_vm 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2613 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615 2024-04-26T18:00:06.928 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2615_fsm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615_vm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2616 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2616_fsm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2616_vm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 18:00 2617 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2617_fsm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2617_vm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 18:00 2618 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2618_fsm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2618_vm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 18:00 2619 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2619_fsm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2619_vm 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2620 2024-04-26T18:00:06.929 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2650 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2651 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2652 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2653 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2654 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2655 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2656 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2657 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 18:00 2658 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 2659 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2660 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2661 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2662 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2663 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2664 2024-04-26T18:00:06.930 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2665 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2666 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2667 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2668 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2669 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2670 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 18:00 2673 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 18:00 2674 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 18:00 2675 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2678 2024-04-26T18:00:06.931 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2679 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2680 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2681 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2682 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2683 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2684 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2685 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2686 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2687 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2688 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2689 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 18:00 2690 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 18:00 2691 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2692 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2693 2024-04-26T18:00:06.932 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2696 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2699 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2701 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2702 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2703 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2704 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2753 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2753_fsm 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2753_vm 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2754 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2755 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2756 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2757 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2830 2024-04-26T18:00:06.933 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2831 2024-04-26T18:00:06.934 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2832 2024-04-26T18:00:06.934 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2833 2024-04-26T18:00:06.934 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2834 2024-04-26T18:00:06.934 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2835 2024-04-26T18:00:06.934 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2836 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2837 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 18:00 2838 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2838_fsm 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2838_vm 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2839 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840_fsm 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2840_vm 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2841 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2995 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2996 2024-04-26T18:00:06.935 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3079_fsm 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079_vm 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3080 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3081 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3085 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3118 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3119 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 18:00 3164 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3256 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3257 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3258 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3350 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3351 2024-04-26T18:00:06.936 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3379 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3380 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3381 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3394 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3394_fsm 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3394_vm 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3395 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3429 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3430 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3431 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3433 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3439 2024-04-26T18:00:06.937 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3440 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3455 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 18:00 3456 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3456_fsm 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3456_vm 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3466 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3467 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3468 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3501 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3502 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3503 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3534 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541 2024-04-26T18:00:06.938 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3541_fsm 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541_vm 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3542 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3574 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3575 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3576 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3596 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3597 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3598 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3599 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3600_fsm 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600_vm 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601 2024-04-26T18:00:06.939 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3601_fsm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601_vm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3602_fsm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602_vm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603_fsm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3603_vm 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3604 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3605 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3606 2024-04-26T18:00:06.940 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3607 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3608 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 3609 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3712 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3764_fsm 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764_vm 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3766 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3767 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3997 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4143 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4144 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4145 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4146 2024-04-26T18:00:06.941 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4147 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4148 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4149 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4150 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4151 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4152 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4153 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4154 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4155 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4156 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4157 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4158 2024-04-26T18:00:06.942 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4159 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4160 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4161 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4162 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4163 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4164 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4165 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4166 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4167 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4168 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4169 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4170 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4171 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4172 2024-04-26T18:00:06.943 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4173 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4174 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 5002 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 548 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 549 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6102 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6104 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6106 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6110 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6111 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6112 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6113 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6117 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 826 2024-04-26T18:00:06.944 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 827 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 828 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 18:00 pg_filenode.map 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 PG_VERSION 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:total 7777 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Apr 26 18:00 . 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 .. 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 112 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 113 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 1247 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1247_fsm 2024-04-26T18:00:06.945 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1247_vm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Apr 26 18:00 1249 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1249_fsm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1249_vm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Apr 26 18:00 1255 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1255_fsm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1255_vm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Apr 26 18:00 1259 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1259_fsm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1259_vm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Apr 26 18:00 13344 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13344_fsm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13344_vm 2024-04-26T18:00:06.946 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13346 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13348 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13349_fsm 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13349_vm 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13351 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13353 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13354_fsm 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13354_vm 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13356 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13358 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 13359_fsm 2024-04-26T18:00:06.947 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13359_vm 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 13361 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 13363 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1417 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 1418 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 174 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 175 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2187 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2224 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2328 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2336 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2337 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2579 2024-04-26T18:00:06.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2600 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2600_fsm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2600_vm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2601_fsm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2601_vm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2602 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2602_fsm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2602_vm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2603 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2603_fsm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2603_vm 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2604 2024-04-26T18:00:06.949 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2605 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2605_fsm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2605_vm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2606_fsm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2606_vm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2607 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2607_fsm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2607_vm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Apr 26 18:00 2608 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2608_fsm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2608_vm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Apr 26 18:00 2609 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2609_fsm 2024-04-26T18:00:06.950 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2609_vm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2610 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2610_fsm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2610_vm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2611 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2612_fsm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2612_vm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2613 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2615_fsm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2615_vm 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2616 2024-04-26T18:00:06.951 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2616_fsm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2616_vm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Apr 26 18:00 2617 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2617_fsm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2617_vm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Apr 26 18:00 2618 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2618_fsm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2618_vm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Apr 26 18:00 2619 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2619_fsm 2024-04-26T18:00:06.952 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2619_vm 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2620 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2650 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2651 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2652 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2653 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2654 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2655 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2656 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2657 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Apr 26 18:00 2658 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Apr 26 18:00 2659 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2660 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2661 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2662 2024-04-26T18:00:06.953 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2663 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2664 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2665 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2666 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2667 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2668 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2669 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2670 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Apr 26 18:00 2673 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Apr 26 18:00 2674 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Apr 26 18:00 2675 2024-04-26T18:00:06.954 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2678 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2679 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2680 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2681 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2682 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2683 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2684 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2685 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2686 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2687 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2688 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Apr 26 18:00 2689 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Apr 26 18:00 2690 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Apr 26 18:00 2691 2024-04-26T18:00:06.955 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2692 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2693 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2696 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2699 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2701 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2702 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2703 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 2704 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2753 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2753_fsm 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2753_vm 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2754 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2755 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2756 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 2757 2024-04-26T18:00:06.956 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2830 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2831 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2832 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2833 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2834 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2835 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2836 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2837 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Apr 26 18:00 2838 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2838_fsm 2024-04-26T18:00:06.957 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2838_vm 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2839 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2840_fsm 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2840_vm 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2841 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2995 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2996 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3079_fsm 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3079_vm 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3080 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3081 2024-04-26T18:00:06.958 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3085 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3118 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3119 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Apr 26 18:00 3164 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3256 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3257 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3258 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3350 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3351 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3379 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3380 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3381 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3394 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3394_fsm 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3394_vm 2024-04-26T18:00:06.959 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3395 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3429 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3430 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3431 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3433 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3439 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3440 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Apr 26 18:00 3455 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Apr 26 18:00 3456 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3456_fsm 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3456_vm 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3466 2024-04-26T18:00:06.960 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3467 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3468 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3501 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3502 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3503 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3534 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3541_fsm 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3541_vm 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3542 2024-04-26T18:00:06.961 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3574 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3575 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3576 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3596 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3597 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3598 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3599 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3600_fsm 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3600_vm 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601 2024-04-26T18:00:06.962 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3601_fsm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3601_vm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3602_fsm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3602_vm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3603_fsm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3603_vm 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3604 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3605 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3606 2024-04-26T18:00:06.963 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3607 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3608 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Apr 26 18:00 3609 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3712 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 3764_fsm 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3764_vm 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3766 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 3767 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3997 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4143 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4144 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4145 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4146 2024-04-26T18:00:06.964 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4147 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4148 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4149 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4150 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4151 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4152 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4153 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4154 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4155 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4156 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4157 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4158 2024-04-26T18:00:06.965 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4159 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4160 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4161 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4162 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4163 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4164 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4165 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4166 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4167 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4168 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4169 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4170 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4171 2024-04-26T18:00:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4172 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4173 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4174 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 5002 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 548 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 549 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6102 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6104 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6106 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6110 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6111 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6112 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6113 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6117 2024-04-26T18:00:06.967 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 826 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 827 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 828 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 18:00 pg_filenode.map 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 PG_VERSION 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/global: 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:total 537 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Apr 26 18:00 . 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1213 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1213_fsm 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1213_vm 2024-04-26T18:00:06.968 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1214 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1214_fsm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1214_vm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 1232 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 1233 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1260 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1260_fsm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1260_vm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1261 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1261_fsm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1261_vm 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1262 2024-04-26T18:00:06.969 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 1262_fsm 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 1262_vm 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2396 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Apr 26 18:00 2396_fsm 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2396_vm 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2397 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2671 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2672 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2676 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2677 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2694 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2695 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2697 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Apr 26 18:00 2698 2024-04-26T18:00:06.970 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2846 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2847 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2964 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2965 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 2966 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 2967 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 3592 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 3593 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4060 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4061 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4175 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4176 2024-04-26T18:00:06.971 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4177 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4178 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4181 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4182 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4183 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4184 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 4185 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 4186 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6000 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6001 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6002 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 6100 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6114 2024-04-26T18:00:06.972 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 6115 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 pg_control 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Apr 26 18:00 pg_filenode.map 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/log: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-04-26T18:00:06.973 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:total 1 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 . 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 mappings 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Apr 26 18:00 replorigin_checkpoint 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 snapshots 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.974 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 .. 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Apr 26 18:00 .. 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.975 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 . 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 members 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 offsets 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 . 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 .. 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 0000 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 . 2024-04-26T18:00:06.976 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 .. 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 0000 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-04-26T18:00:06.977 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.978 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 . 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 0000 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-04-26T18:00:06.979 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:total 16384 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 . 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Apr 26 18:00 000000010000000000000001 2024-04-26T18:00:06.980 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 archive_status 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:total 0 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Apr 26 18:00 . 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Apr 26 18:00 .. 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:total 8 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Apr 26 18:00 . 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Apr 26 18:00 .. 2024-04-26T18:00:06.981 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Apr 26 18:00 0000 2024-04-26T18:00:06.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-04-26T18:00:07.023 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:07.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-04-26T18:00:07.208 INFO:teuthology.orchestra.run.smithi092.stderr:dropping old tables... 2024-04-26T18:00:07.208 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-04-26T18:00:07.208 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-04-26T18:00:07.209 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-04-26T18:00:07.209 INFO:teuthology.orchestra.run.smithi092.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-04-26T18:00:07.209 INFO:teuthology.orchestra.run.smithi092.stderr:creating tables... 2024-04-26T18:00:07.220 INFO:teuthology.orchestra.run.smithi092.stderr:generating data (client-side)... 2024-04-26T18:00:07.292 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:07 smithi092 ceph-mon[29156]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 92 KiB/s wr, 30 op/s 2024-04-26T18:00:07.294 INFO:teuthology.orchestra.run.smithi092.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.78 s) 2024-04-26T18:00:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:07 smithi156 ceph-mon[32679]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 92 KiB/s wr, 30 op/s 2024-04-26T18:00:07.444 INFO:teuthology.orchestra.run.smithi092.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.21 s, remaining 3.11 s) 2024-04-26T18:00:07.528 INFO:teuthology.orchestra.run.smithi092.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.29 s, remaining 2.82 s) 2024-04-26T18:00:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:07 smithi189 ceph-mon[32756]: pgmap v17: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 92 KiB/s wr, 30 op/s 2024-04-26T18:00:07.652 INFO:teuthology.orchestra.run.smithi092.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.42 s, remaining 2.91 s) 2024-04-26T18:00:07.795 INFO:teuthology.orchestra.run.smithi092.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.56 s, remaining 3.02 s) 2024-04-26T18:00:07.878 INFO:teuthology.orchestra.run.smithi092.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.64 s, remaining 2.78 s) 2024-04-26T18:00:08.021 INFO:teuthology.orchestra.run.smithi092.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.78 s, remaining 2.80 s) 2024-04-26T18:00:08.187 INFO:teuthology.orchestra.run.smithi092.stderr:800000 of 3200000 tuples (25%) done (elapsed 0.95 s, remaining 2.85 s) 2024-04-26T18:00:08.292 INFO:teuthology.orchestra.run.smithi092.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.06 s, remaining 2.70 s) 2024-04-26T18:00:08.418 INFO:teuthology.orchestra.run.smithi092.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.18 s, remaining 2.60 s) 2024-04-26T18:00:08.601 INFO:teuthology.orchestra.run.smithi092.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.36 s, remaining 2.60 s) 2024-04-26T18:00:08.699 INFO:teuthology.orchestra.run.smithi092.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.46 s, remaining 2.44 s) 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/2486342936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c006bb20 msgr2=0x7fb2c006bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/2486342936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c006bb20 0x7fb2c006bf80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009990 tx=0x7fb2ac009ca0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/2486342936 shutdown_connections 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/2486342936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006c4c0 0x7fb2c0110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/2486342936 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c01094d0 0x7fb2c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/2486342936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c006bb20 0x7fb2c006bf80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/2486342936 >> 172.21.15.92:0/2486342936 conn(0x7fb2c0079360 msgr2=0x7fb2c0079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/2486342936 shutdown_connections 2024-04-26T18:00:08.733 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.732+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/2486342936 wait complete. 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.733+0000 7fb2c6b6b700 1 Processor -- start 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.733+0000 7fb2c6b6b700 1 -- start start 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006bb20 0x7fb2c019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c006c4c0 0x7fb2c019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01135e0 con 0x7fb2c01094d0 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0113460 con 0x7fb2c006bb20 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c6b6b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0113760 con 0x7fb2c006c4c0 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58452/0 (socket says 172.21.15.92:58452) 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 -- 172.21.15.92:0/883780255 learned_addr learned my addr 172.21.15.92:0/883780255 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2bffff700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c006c4c0 0x7fb2c019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c4907700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006bb20 0x7fb2c019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 -- 172.21.15.92:0/883780255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c006c4c0 msgr2=0x7fb2c019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c006c4c0 0x7fb2c019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 -- 172.21.15.92:0/883780255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006bb20 msgr2=0x7fb2c019f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006bb20 0x7fb2c019f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 -- 172.21.15.92:0/883780255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c019a0c0 con 0x7fb2c01094d0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.734+0000 7fb2c5108700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800ef30 tx=0x7fb2b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.735+0000 7fb2bdffb700 1 -- 172.21.15.92:0/883780255 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80092e0 con 0x7fb2c01094d0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.735+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c019a350 con 0x7fb2c01094d0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.735+0000 7fb2bdffb700 1 -- 172.21.15.92:0/883780255 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b8004bb0 con 0x7fb2c01094d0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.735+0000 7fb2bdffb700 1 -- 172.21.15.92:0/883780255 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8004020 con 0x7fb2c01094d0 2024-04-26T18:00:08.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.735+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c01a6670 con 0x7fb2c01094d0 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.737+0000 7fb2bdffb700 1 -- 172.21.15.92:0/883780255 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fb2b801b030 con 0x7fb2c01094d0 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.737+0000 7fb2bdffb700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 0x7fb2b00a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.737+0000 7fb2c4907700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 0x7fb2b00a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.738+0000 7fb2bdffb700 1 -- 172.21.15.92:0/883780255 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb2b80d0500 con 0x7fb2c01094d0 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.738+0000 7fb2c4907700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 0x7fb2b00a6390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2c019aaa0 tx=0x7fb2b4009260 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.738+0000 7fb2d13fdb80 1 Processor -- start 2024-04-26T18:00:08.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.738+0000 7fb2d13fdb80 1 -- start start 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 0x56141e1b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b66f0 0x56141e1c2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56141e1087e0 con 0x56141e1bba20 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56141e06e8e0 con 0x56141e1b5d50 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56141e1047a0 con 0x56141e1b66f0 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58456/0 (socket says 172.21.15.92:58456) 2024-04-26T18:00:08.746 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 -- 172.21.15.92:0/1514260960 learned_addr learned my addr 172.21.15.92:0/1514260960 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2bffff700 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 0x56141e1b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 -- 172.21.15.92:0/1514260960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b66f0 msgr2=0x56141e1c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b66f0 0x56141e1c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 -- 172.21.15.92:0/1514260960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 msgr2=0x56141e1b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 0x56141e1b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 -- 172.21.15.92:0/1514260960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141e055880 con 0x56141e1bba20 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2bffff700 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 0x56141e1b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2c4907700 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40046c0 tx=0x7fb2b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8686df29ec9b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.739+0000 7fb2aaffd700 1 -- 172.21.15.92:0/1514260960 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b400eb20 con 0x56141e1bba20 2024-04-26T18:00:08.747 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2aaffd700 1 -- 172.21.15.92:0/1514260960 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b400ecc0 con 0x56141e1bba20 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2aaffd700 1 -- 172.21.15.92:0/1514260960 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b401e650 con 0x56141e1bba20 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/1514260960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 msgr2=0x56141e1bbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40046c0 tx=0x7fb2b4014000 comp rx=0 tx=0).stop 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/1514260960 shutdown_connections 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b66f0 0x56141e1c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bbe00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/1514260960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b5d50 0x56141e1b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/1514260960 >> 172.21.15.92:0/1514260960 conn(0x56141e0e4570 msgr2=0x56141e1b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/1514260960 shutdown_connections 2024-04-26T18:00:08.748 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.740+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/1514260960 wait complete. 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 -- start start 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 Processor -- start 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56141e1c2cb0 con 0x56141e1bba20 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56141e0c2a30 con 0x56141e1b66f0 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56141e1c2e30 con 0x56141e1b5d50 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2d13fdb80 10 client.0 _ll_register_callbacks cb 0x56141e0a0900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:08.749 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58468/0 (socket says 172.21.15.92:58468) 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2c5108700 1 -- 172.21.15.92:0/2269782158 learned_addr learned my addr 172.21.15.92:0/2269782158 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.741+0000 7fb2c4907700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 -- 172.21.15.92:0/2269782158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 msgr2=0x56141e1c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 -- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 msgr2=0x56141e1bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 -- 172.21.15.92:0/2269782158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141e0c6430 con 0x56141e1bba20 2024-04-26T18:00:08.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2bffff700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800d010 tx=0x7fb2b809c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183c037937208822 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb29ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80d02e0 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b400ecc0 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb2b80cde20 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2b801b320 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2d13fdb80 10 client.15315 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56141e1cd6e0 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.742+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b400ecc0 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fb2b80980a0 con 0x56141e1bba20 2024-04-26T18:00:08.751 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 10 client.15315 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 10 client.15315 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 20 client.15315 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e1cfb70 0x56141e1d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 4 client.15315 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56141e1161c0 con 0x56141e1cfb70 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2c4907700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e1cfb70 0x56141e1d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb2c4907700 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e1cfb70 0x56141e1d0fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b8d092d82773d27 server_cookie=94e5db88a9cab33b in_seq=0 out_seq=0 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.743+0000 7fb29ffff700 10 client.15315 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb29ffff700 1 -- 172.21.15.92:0/2269782158 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56141e1161c0 con 0x56141e1cfb70 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb29ffff700 10 client.15315 handle_command_reply: tid=0 2024-04-26T18:00:08.752 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 client.15315 shutdown 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 msgr2=0x56141e1bfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800d010 tx=0x7fb2b809c890 comp rx=0 tx=0).stop 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 shutdown_connections 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e1cfb70 0x56141e1d0fe0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1bfdc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2269782158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 >> 172.21.15.92:0/2269782158 conn(0x56141e0e4570 msgr2=0x56141e1b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb29ffff700 0 client.15315 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T18:00:08.753 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 shutdown_connections 2024-04-26T18:00:08.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.744+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2269782158 wait complete. 2024-04-26T18:00:08.754 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.745+0000 7fb2d13fdb80 20 client.15315 trim_cache size 0 max 16384 2024-04-26T18:00:08.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 Processor -- start 2024-04-26T18:00:08.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 -- start start 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1bba20 0x56141e1b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56141e1cf320 con 0x56141e1b5d50 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56141e1cf9f0 con 0x56141e1b66f0 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56141e1d00c0 con 0x56141e1bba20 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58484/0 (socket says 172.21.15.92:58484) 2024-04-26T18:00:08.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 -- 172.21.15.92:0/3258633395 learned_addr learned my addr 172.21.15.92:0/3258633395 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:08.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 -- 172.21.15.92:0/3258633395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1bba20 msgr2=0x56141e1b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1bba20 0x56141e1b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 -- 172.21.15.92:0/3258633395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 msgr2=0x56141e1b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.766+0000 7fb2c4907700 1 -- 172.21.15.92:0/3258633395 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56141e1d1f40 con 0x56141e1b5d50 2024-04-26T18:00:08.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.767+0000 7fb2c4907700 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40046c0 tx=0x7fb2b4026cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19bd045f2a17e24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.767+0000 7fb2aa7fc700 1 -- 172.21.15.92:0/3258633395 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4005040 con 0x56141e1b5d50 2024-04-26T18:00:08.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.767+0000 7fb2aa7fc700 1 -- 172.21.15.92:0/3258633395 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b4005690 con 0x56141e1b5d50 2024-04-26T18:00:08.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.767+0000 7fb2aa7fc700 1 -- 172.21.15.92:0/3258633395 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4004950 con 0x56141e1b5d50 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/3258633395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 msgr2=0x56141e1c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40046c0 tx=0x7fb2b4026cf0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/3258633395 shutdown_connections 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1bba20 0x56141e1b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1b5d50 0x56141e1c1d20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/3258633395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/3258633395 >> 172.21.15.92:0/3258633395 conn(0x56141e0e4570 msgr2=0x56141e1ceb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/3258633395 shutdown_connections 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.768+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/3258633395 wait complete. 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.769+0000 7fb2d13fdb80 1 -- start start 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.769+0000 7fb2d13fdb80 1 Processor -- start 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1ba080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56141e1d0e60 con 0x56141e1bba20 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56141e1d0790 con 0x56141e1b66f0 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56141e1d1530 con 0x56141e1b5d50 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58486/0 (socket says 172.21.15.92:58486) 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 -- 172.21.15.92:0/2694629888 learned_addr learned my addr 172.21.15.92:0/2694629888 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2d13fdb80 10 client.0 _ll_register_callbacks cb 0x56141e0a0900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 -- 172.21.15.92:0/2694629888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 msgr2=0x56141e1ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 -- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 msgr2=0x56141e1ba5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1ba5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.775 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.770+0000 7fb2c5108700 1 -- 172.21.15.92:0/2694629888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56141e1d9990 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb2c5108700 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009c10 tx=0x7fb2b80a4fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0406c9e2a37a5c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb29ffff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b807c070 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b4005690 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb2b80d0080 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2b809ca50 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb2d13fdb80 10 client.15321 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56141e1dac90 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.771+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b80a6080 con 0x56141e1bba20 2024-04-26T18:00:08.776 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fb2b807f070 con 0x56141e1bba20 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 10 client.15321 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 10 client.15321 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 20 client.15321 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e23b430 0x56141e23a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 4 client.15321 mds_command: new command op to 24419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.772+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 --> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] -- command(tid 0: {"prefix": "status"}) -- 0x56141e110260 con 0x56141e23b430 2024-04-26T18:00:08.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.773+0000 7fb2c4907700 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e23b430 0x56141e23a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.775+0000 7fb2c4907700 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e23b430 0x56141e23a140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d1b8d33833a9815 server_cookie=87ef3802b4d1cf33 in_seq=0 out_seq=0 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.775+0000 7fb29ffff700 10 client.15321 ms_handle_connect on v2:172.21.15.156:6836/1965706259 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.776+0000 7fb29ffff700 1 -- 172.21.15.92:0/2694629888 <== mds.1 v2:172.21.15.156:6836/1965706259 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56141e110260 con 0x56141e23b430 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.776+0000 7fb29ffff700 10 client.15321 handle_command_reply: tid=0 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.776+0000 7fb2d13fdb80 1 client.15321 shutdown 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.776+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 msgr2=0x56141e1d9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.776+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009c10 tx=0x7fb2b80a4fa0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 shutdown_connections 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:6836/1965706259,v1:172.21.15.156:6837/1965706259] conn(0x56141e23b430 0x56141e23a140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56141e1bba20 0x56141e1d9450 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb29ffff700 0 client.15321 ms_handle_reset on v2:172.21.15.156:6836/1965706259 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56141e1b5d50 0x56141e1ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 --2- 172.21.15.92:0/2694629888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56141e1b66f0 0x56141e1ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 >> 172.21.15.92:0/2694629888 conn(0x56141e0e4570 msgr2=0x56141e1b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 shutdown_connections 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 1 -- 172.21.15.92:0/2694629888 wait complete. 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.777+0000 7fb2d13fdb80 20 client.15321 trim_cache size 0 max 16384 2024-04-26T18:00:08.780 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 1, 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24419, 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 211.06489150600001, 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 26, 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 91, 2024-04-26T18:00:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 90, 2024-04-26T18:00:08.782 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 254.16787039499999 2024-04-26T18:00:08.782 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:00:08.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 msgr2=0x7fb2b00a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 0x7fb2b00a6390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb2c019aaa0 tx=0x7fb2b4009260 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 msgr2=0x7fb2c0199960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800ef30 tx=0x7fb2b800c3a0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 shutdown_connections 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb2b00a3ed0 0x7fb2b00a6390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2c006bb20 0x7fb2c019f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2c01094d0 0x7fb2c0199960 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 --2- 172.21.15.92:0/883780255 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2c006c4c0 0x7fb2c019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 >> 172.21.15.92:0/883780255 conn(0x7fb2c0079360 msgr2=0x7fb2c01004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 shutdown_connections 2024-04-26T18:00:08.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:08.778+0000 7fb2c6b6b700 1 -- 172.21.15.92:0/883780255 wait complete. 2024-04-26T18:00:08.846 INFO:teuthology.orchestra.run.smithi092.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.61 s, remaining 2.35 s) 2024-04-26T18:00:09.022 INFO:teuthology.orchestra.run.smithi092.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.78 s, remaining 2.29 s) 2024-04-26T18:00:09.110 INFO:teuthology.orchestra.run.smithi092.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.87 s, remaining 2.12 s) 2024-04-26T18:00:09.247 INFO:teuthology.orchestra.run.smithi092.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.01 s, remaining 2.01 s) 2024-04-26T18:00:09.347 INFO:teuthology.orchestra.run.smithi092.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.11 s, remaining 1.86 s) 2024-04-26T18:00:09.410 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:09 smithi092 ceph-mon[29156]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 23 op/s 2024-04-26T18:00:09.412 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph tell mds.b status 2024-04-26T18:00:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:09 smithi156 ceph-mon[32679]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 23 op/s 2024-04-26T18:00:09.503 INFO:teuthology.orchestra.run.smithi092.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.27 s, remaining 1.76 s) 2024-04-26T18:00:09.634 INFO:teuthology.orchestra.run.smithi092.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.40 s, remaining 1.64 s) 2024-04-26T18:00:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:09 smithi189 ceph-mon[32756]: pgmap v18: 97 pgs: 97 active+clean; 2.0 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 91 KiB/s wr, 23 op/s 2024-04-26T18:00:09.684 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:09.756 INFO:teuthology.orchestra.run.smithi092.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.52 s, remaining 1.51 s) 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi092.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.64 s, remaining 1.38 s) 2024-04-26T18:00:10.041 INFO:teuthology.orchestra.run.smithi092.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.80 s, remaining 1.27 s) 2024-04-26T18:00:10.139 INFO:teuthology.orchestra.run.smithi092.stderr:2300000 of 3200000 tuples (71%) done (elapsed 2.90 s, remaining 1.14 s) 2024-04-26T18:00:10.285 INFO:teuthology.orchestra.run.smithi092.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.05 s, remaining 1.02 s) 2024-04-26T18:00:10.466 INFO:teuthology.orchestra.run.smithi092.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.23 s, remaining 0.90 s) 2024-04-26T18:00:10.525 INFO:teuthology.orchestra.run.smithi092.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.29 s, remaining 0.76 s) 2024-04-26T18:00:10.697 INFO:teuthology.orchestra.run.smithi092.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.46 s, remaining 0.64 s) 2024-04-26T18:00:10.847 INFO:teuthology.orchestra.run.smithi092.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.61 s, remaining 0.52 s) 2024-04-26T18:00:10.928 INFO:teuthology.orchestra.run.smithi092.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.69 s, remaining 0.38 s) 2024-04-26T18:00:11.081 INFO:teuthology.orchestra.run.smithi092.stderr:3000000 of 3200000 tuples (93%) done (elapsed 3.84 s, remaining 0.26 s) 2024-04-26T18:00:11.560 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:11 smithi189 ceph-mon[32756]: pgmap v19: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 19 MiB/s wr, 287 op/s 2024-04-26T18:00:11.560 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:11 smithi156 ceph-mon[32679]: pgmap v19: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 19 MiB/s wr, 287 op/s 2024-04-26T18:00:11.561 INFO:teuthology.orchestra.run.smithi092.stderr:3100000 of 3200000 tuples (96%) done (elapsed 3.94 s, remaining 0.13 s) 2024-04-26T18:00:11.561 INFO:teuthology.orchestra.run.smithi092.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.09 s, remaining 0.00 s) 2024-04-26T18:00:11.561 INFO:teuthology.orchestra.run.smithi092.stderr:vacuuming... 2024-04-26T18:00:11.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:11 smithi092 ceph-mon[29156]: pgmap v19: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 19 MiB/s wr, 287 op/s 2024-04-26T18:00:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 -- 172.21.15.92:0/3999036358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61441094a0 msgr2=0x7f6144109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 --2- 172.21.15.92:0/3999036358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61441094a0 0x7f6144109880 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6138009990 tx=0x7f6138009ca0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 -- 172.21.15.92:0/3999036358 shutdown_connections 2024-04-26T18:00:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 --2- 172.21.15.92:0/3999036358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f61441102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 --2- 172.21.15.92:0/3999036358 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61441094a0 0x7f6144109880 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 --2- 172.21.15.92:0/3999036358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f614406bb50 0x7f614406bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 -- 172.21.15.92:0/3999036358 >> 172.21.15.92:0/3999036358 conn(0x7f61440792d0 msgr2=0x7f61440796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 -- 172.21.15.92:0/3999036358 shutdown_connections 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.402+0000 7f614ae4f700 1 -- 172.21.15.92:0/3999036358 wait complete. 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 Processor -- start 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 -- start start 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f614419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61441094a0 0x7f61441998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61441135b0 con 0x7f614406bb50 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6144113430 con 0x7f614406c4f0 2024-04-26T18:00:11.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f614ae4f700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6144113730 con 0x7f61441094a0 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58514/0 (socket says 172.21.15.92:58514) 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6148beb700 1 -- 172.21.15.92:0/1051034927 learned_addr learned my addr 172.21.15.92:0/1051034927 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6143fff700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f614419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f61493ec700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61441094a0 0x7f61441998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6143fff700 1 -- 172.21.15.92:0/1051034927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61441094a0 msgr2=0x7f61441998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.403+0000 7f6143fff700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61441094a0 0x7f61441998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6143fff700 1 -- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 msgr2=0x7f614419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6143fff700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6143fff700 1 -- 172.21.15.92:0/1051034927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614419a050 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6148beb700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6143fff700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f614419fc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6130009f00 tx=0x7f613000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6141ffb700 1 -- 172.21.15.92:0/1051034927 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130004230 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614419a340 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6141ffb700 1 -- 172.21.15.92:0/1051034927 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61300043d0 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6144102350 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.404+0000 7f6141ffb700 1 -- 172.21.15.92:0/1051034927 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6130005600 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.407+0000 7f6141ffb700 1 -- 172.21.15.92:0/1051034927 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f6130004750 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.407+0000 7f6141ffb700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 0x7f61340a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.407+0000 7f6148beb700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 0x7f61340a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.407+0000 7f6141ffb700 1 -- 172.21.15.92:0/1051034927 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f61300d9120 con 0x7f614406c4f0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 0x7f61340a6390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f613800b2e0 tx=0x7f613801a040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.860 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 Processor -- start 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 -- start start 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad402d0 0x562acad40710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562acac926f0 con 0x562acad463f0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562acac31590 con 0x562acad402d0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61556e1b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562acac8e6b0 con 0x562acad45ad0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6143fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:45924/0 (socket says 172.21.15.92:45924) 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6143fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58524/0 (socket says 172.21.15.92:58524) 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 -- 172.21.15.92:0/836256756 learned_addr learned my addr 172.21.15.92:0/836256756 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f61493ec700 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad402d0 0x562acad40710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 -- 172.21.15.92:0/836256756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad402d0 msgr2=0x562acad40710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad402d0 0x562acad40710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 -- 172.21.15.92:0/836256756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 msgr2=0x562acad3fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.408+0000 7f6148beb700 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f6148beb700 1 -- 172.21.15.92:0/836256756 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562acabdf880 con 0x562acad45ad0 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f6143fff700 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f6148beb700 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6138000c00 tx=0x7f613801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe52cedde402c89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f612effd700 1 -- 172.21.15.92:0/836256756 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138003680 con 0x562acad45ad0 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f612effd700 1 -- 172.21.15.92:0/836256756 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6138003cd0 con 0x562acad45ad0 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.409+0000 7f612effd700 1 -- 172.21.15.92:0/836256756 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800fe50 con 0x562acad45ad0 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- 172.21.15.92:0/836256756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 msgr2=0x562acad45eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6138000c00 tx=0x7f613801f000 comp rx=0 tx=0).stop 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- 172.21.15.92:0/836256756 shutdown_connections 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad402d0 0x562acad40710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad45eb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 --2- 172.21.15.92:0/836256756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad463f0 0x562acad3fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- 172.21.15.92:0/836256756 >> 172.21.15.92:0/836256756 conn(0x562acac6ccf0 msgr2=0x562acad3b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- 172.21.15.92:0/836256756 shutdown_connections 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- 172.21.15.92:0/836256756 wait complete. 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 -- start start 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.410+0000 7f61556e1b80 1 Processor -- start 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad45ad0 0x562acad49430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad463f0 0x562acad49970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562acad4ceb0 con 0x562acad402d0 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562acabf8900 con 0x562acad45ad0 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562acad4d030 con 0x562acad463f0 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 10 client.0 _ll_register_callbacks cb 0x562acac26530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:11.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58526/0 (socket says 172.21.15.92:58526) 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 -- 172.21.15.92:0/4289697974 learned_addr learned my addr 172.21.15.92:0/4289697974 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61493ec700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad463f0 0x562acad49970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6143fff700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad45ad0 0x562acad49430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 -- 172.21.15.92:0/4289697974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad463f0 msgr2=0x562acad49970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad463f0 0x562acad49970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 -- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad45ad0 msgr2=0x562acad49430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad45ad0 0x562acad49430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 -- 172.21.15.92:0/4289697974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562acad49fb0 con 0x562acad402d0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6148beb700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6138006010 tx=0x7f613800fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8781e85ca5a2f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6123fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613800f670 con 0x562acad402d0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6138003680 con 0x562acad402d0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6138003cd0 con 0x562acad402d0 2024-04-26T18:00:11.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6138041050 con 0x562acad402d0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 10 client.15333 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.411+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562acad4ceb0 con 0x562acad402d0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6138003cd0 con 0x562acad402d0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f613803cc90 con 0x562acad402d0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 10 client.15333 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 10 client.15333 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 20 client.15333 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acad59980 0x562acad5adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 4 client.15333 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562acaca00d0 con 0x562acad59980 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f6143fff700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acad59980 0x562acad5adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f6123fff700 10 client.15333 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.412+0000 7f6143fff700 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acad59980 0x562acad5adf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f6d61468e67e29a server_cookie=6e4b78e680b09f82 in_seq=0 out_seq=0 2024-04-26T18:00:11.865 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f6123fff700 1 -- 172.21.15.92:0/4289697974 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562acaca00d0 con 0x562acad59980 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f6123fff700 10 client.15333 handle_command_reply: tid=0 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 client.15333 shutdown 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 msgr2=0x562acad4c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6138006010 tx=0x7f613800fb60 comp rx=0 tx=0).stop 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 shutdown_connections 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acad59980 0x562acad5adf0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad463f0 0x562acad49970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad4c130 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 --2- 172.21.15.92:0/4289697974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad45ad0 0x562acad49430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 >> 172.21.15.92:0/4289697974 conn(0x562acac6ccf0 msgr2=0x562acad3ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.413+0000 7f6123fff700 0 client.15333 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.414+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 shutdown_connections 2024-04-26T18:00:11.866 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.414+0000 7f61556e1b80 1 -- 172.21.15.92:0/4289697974 wait complete. 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.414+0000 7f61556e1b80 20 client.15333 trim_cache size 0 max 16384 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.448+0000 7f61556e1b80 1 Processor -- start 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.448+0000 7f61556e1b80 1 -- start start 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad64250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad64790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562acad59130 con 0x562acad402d0 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562acad59800 con 0x562acad463f0 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f61556e1b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562acad59ed0 con 0x562acad45ad0 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58528/0 (socket says 172.21.15.92:58528) 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 -- 172.21.15.92:0/3214429346 learned_addr learned my addr 172.21.15.92:0/3214429346 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6143fff700 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad64250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.867 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 -- 172.21.15.92:0/3214429346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 msgr2=0x562acad64250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad64250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 -- 172.21.15.92:0/3214429346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 msgr2=0x562acad64790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad64790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 -- 172.21.15.92:0/3214429346 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562acad40d20 con 0x562acad402d0 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6143fff700 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad64250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f6148beb700 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f61380055b0 tx=0x7f6138005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df798765c96dcb34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f612e7fc700 1 -- 172.21.15.92:0/3214429346 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138030820 con 0x562acad402d0 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f612e7fc700 1 -- 172.21.15.92:0/3214429346 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f613800f670 con 0x562acad402d0 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.449+0000 7f612e7fc700 1 -- 172.21.15.92:0/3214429346 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613803c440 con 0x562acad402d0 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 -- 172.21.15.92:0/3214429346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 msgr2=0x562acad3fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f61380055b0 tx=0x7f6138005c40 comp rx=0 tx=0).stop 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 -- 172.21.15.92:0/3214429346 shutdown_connections 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad64790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3fcb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 --2- 172.21.15.92:0/3214429346 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad64250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 -- 172.21.15.92:0/3214429346 >> 172.21.15.92:0/3214429346 conn(0x562acac6ccf0 msgr2=0x562acad3a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 -- 172.21.15.92:0/3214429346 shutdown_connections 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.450+0000 7f61556e1b80 1 -- 172.21.15.92:0/3214429346 wait complete. 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 -- start start 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 Processor -- start 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad3f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad3f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562acad5ac70 con 0x562acad402d0 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562acad5a5a0 con 0x562acad463f0 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562acad5b340 con 0x562acad45ad0 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f61556e1b80 10 client.0 _ll_register_callbacks cb 0x562acac26530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f6148beb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58530/0 (socket says 172.21.15.92:58530) 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f6148beb700 1 -- 172.21.15.92:0/1145719646 learned_addr learned my addr 172.21.15.92:0/1145719646 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.451+0000 7f6143fff700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad3f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f61493ec700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad3f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 -- 172.21.15.92:0/1145719646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 msgr2=0x562acad3f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad3f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 -- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 msgr2=0x562acad3f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad3f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 -- 172.21.15.92:0/1145719646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562acad625b0 con 0x562acad402d0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f61493ec700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad3f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6148beb700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f613802b040 tx=0x7f613800fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b376db3bb62a0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6123fff700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138003bc0 con 0x562acad402d0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f61380309f0 con 0x562acad402d0 2024-04-26T18:00:11.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f613800f670 con 0x562acad402d0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f61380037c0 con 0x562acad402d0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f61556e1b80 10 client.15339 fetch_fsmap learned FSMap version 26 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562acadc0e70 con 0x562acad402d0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.452+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f613800f670 con 0x562acad402d0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f613803cb90 con 0x562acad402d0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 10 client.15339 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 10 client.15339 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 20 client.15339 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acadc57a0 0x562acadc44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 4 client.15339 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "status"}) -- 0x562acac9a170 con 0x562acadc57a0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6143fff700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acadc57a0 0x562acadc44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6143fff700 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acadc57a0 0x562acadc44b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82f4ea182e9844cf server_cookie=951be902e250485c in_seq=0 out_seq=0 2024-04-26T18:00:11.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6123fff700 10 client.15339 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6123fff700 1 -- 172.21.15.92:0/1145719646 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562acac9a170 con 0x562acadc57a0 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f6123fff700 10 client.15339 handle_command_reply: tid=0 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.453+0000 7f61556e1b80 1 client.15339 shutdown 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 msgr2=0x562acad3ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f613802b040 tx=0x7f613800fa50 comp rx=0 tx=0).stop 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 shutdown_connections 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562acadc57a0 0x562acadc44b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562acad463f0 0x562acad3f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562acad402d0 0x562acad3ed80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f6123fff700 0 client.15339 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 --2- 172.21.15.92:0/1145719646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562acad45ad0 0x562acad3f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 >> 172.21.15.92:0/1145719646 conn(0x562acac6ccf0 msgr2=0x562acad43620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 shutdown_connections 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 1 -- 172.21.15.92:0/1145719646 wait complete. 2024-04-26T18:00:11.872 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.454+0000 7f61556e1b80 20 client.15339 trim_cache size 0 max 16384 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "cluster_fsid": "fb3c417a-03f4-11ef-bc93-c7b262605968", 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "whoami": 0, 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "id": 24437, 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "want_state": "up:active", 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "state": "up:active", 2024-04-26T18:00:11.873 INFO:teuthology.orchestra.run.smithi092.stdout: "fs_name": "cephfs", 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "rank_uptime": 227.95895324700001, 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "mdsmap_epoch": 26, 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch": 91, 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_epoch_barrier": 90, 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout: "uptime": 243.373113141 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 msgr2=0x7f61340a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 0x7f61340a6390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f613800b2e0 tx=0x7f613801a040 comp rx=0 tx=0).stop 2024-04-26T18:00:11.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 msgr2=0x7f614419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f614419fc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6130009f00 tx=0x7f613000eca0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 shutdown_connections 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f61340a3ed0 0x7f61340a6390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f61441094a0 0x7f61441998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f614406bb50 0x7f614419f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 --2- 172.21.15.92:0/1051034927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f614406c4f0 0x7f614419fc70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 >> 172.21.15.92:0/1051034927 conn(0x7f61440792d0 msgr2=0x7f6144100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 shutdown_connections 2024-04-26T18:00:11.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:11.455+0000 7f614ae4f700 1 -- 172.21.15.92:0/1051034927 wait complete. 2024-04-26T18:00:11.998 INFO:teuthology.orchestra.run.smithi092.stderr:creating primary keys... 2024-04-26T18:00:12.666 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-26T18:00:13.254 INFO:teuthology.orchestra.run.smithi092.stderr:done in 6.05 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 4.15 s, vacuum 0.63 s, primary keys 1.25 s). 2024-04-26T18:00:13.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-04-26T18:00:13.325 INFO:teuthology.orchestra.run.smithi092.stderr:starting vacuum...end. 2024-04-26T18:00:13.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:13 smithi156 ceph-mon[32679]: pgmap v20: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 19 MiB/s wr, 284 op/s 2024-04-26T18:00:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:13 smithi092 ceph-mon[29156]: pgmap v20: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 19 MiB/s wr, 284 op/s 2024-04-26T18:00:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:13 smithi189 ceph-mon[32756]: pgmap v20: 97 pgs: 97 active+clean; 141 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 19 MiB/s wr, 284 op/s 2024-04-26T18:00:14.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:15 smithi156 ceph-mon[32679]: pgmap v21: 97 pgs: 97 active+clean; 173 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 24 MiB/s wr, 286 op/s 2024-04-26T18:00:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:15 smithi092 ceph-mon[29156]: pgmap v21: 97 pgs: 97 active+clean; 173 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 24 MiB/s wr, 286 op/s 2024-04-26T18:00:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:15 smithi189 ceph-mon[32756]: pgmap v21: 97 pgs: 97 active+clean; 173 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 24 MiB/s wr, 286 op/s 2024-04-26T18:00:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:17 smithi156 ceph-mon[32679]: pgmap v22: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 74 MiB/s wr, 322 op/s 2024-04-26T18:00:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:17 smithi092 ceph-mon[29156]: pgmap v22: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 74 MiB/s wr, 322 op/s 2024-04-26T18:00:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:17 smithi189 ceph-mon[32756]: pgmap v22: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 74 MiB/s wr, 322 op/s 2024-04-26T18:00:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 5.0 s, 3584.2 tps, lat 27.424 ms stddev 27.656 2024-04-26T18:00:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.369+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/887665179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54102220 msgr2=0x7f0e5410e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.369+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/887665179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54102220 0x7f0e5410e6e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c009890 tx=0x7f0e4c02a360 comp rx=0 tx=0).stop 2024-04-26T18:00:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.370+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/887665179 shutdown_connections 2024-04-26T18:00:19.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.370+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/887665179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54102220 0x7f0e5410e6e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.370+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/887665179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54101860 0x7f0e54101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.370+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/887665179 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54107820 0x7f0e54107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.370+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/887665179 >> 172.21.15.92:0/887665179 conn(0x7f0e540789b0 msgr2=0x7f0e54078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.371+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/887665179 shutdown_connections 2024-04-26T18:00:19.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.371+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/887665179 wait complete. 2024-04-26T18:00:19.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.372+0000 7f0e5c4c5640 1 Processor -- start 2024-04-26T18:00:19.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 -- start start 2024-04-26T18:00:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54102220 0x7f0e5419faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54107820 0x7f0e541a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541191b0 con 0x7f0e54101860 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0e54119030 con 0x7f0e54102220 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5c4c5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e54119330 con 0x7f0e54107820 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58426/0 (socket says 172.21.15.92:58426) 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5a261640 1 -- 172.21.15.92:0/2149915318 learned_addr learned my addr 172.21.15.92:0/2149915318 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54102220 0x7f0e5419faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.373+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54107820 0x7f0e541a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 -- 172.21.15.92:0/2149915318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54107820 msgr2=0x7f0e541a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54107820 0x7f0e541a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 -- 172.21.15.92:0/2149915318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54102220 msgr2=0x7f0e5419faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54102220 0x7f0e5419faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 -- 172.21.15.92:0/2149915318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e541a45a0 con 0x7f0e54101860 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cce0 tx=0x7f0e5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e4b7fe640 1 -- 172.21.15.92:0/2149915318 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50004b20 con 0x7f0e54101860 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e541a4890 con 0x7f0e54101860 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e4b7fe640 1 -- 172.21.15.92:0/2149915318 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e50004cc0 con 0x7f0e54101860 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e4b7fe640 1 -- 172.21.15.92:0/2149915318 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000f6b0 con 0x7f0e54101860 2024-04-26T18:00:19.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.374+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e541ac120 con 0x7f0e54101860 2024-04-26T18:00:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.378+0000 7f0e5f1d6740 1 Processor -- start 2024-04-26T18:00:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.378+0000 7f0e4b7fe640 1 -- 172.21.15.92:0/2149915318 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f0e50005020 con 0x7f0e54101860 2024-04-26T18:00:19.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 -- start start 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba6820 0x55f255bb0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 0x55f255bb34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f255b0c460 con 0x55f255bb10e0 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f255ac6590 con 0x55f255ba5f00 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f255b08420 con 0x55f255ba6820 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5aa62640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 0x55f255bb34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5aa62640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:47030/0 (socket says 172.21.15.92:47030) 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5aa62640 1 -- 172.21.15.92:0/2938174876 learned_addr learned my addr 172.21.15.92:0/2938174876 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:19.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.379+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba6820 0x55f255bb0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e4b7fe640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 0x7f0e400a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 -- 172.21.15.92:0/2938174876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba6820 msgr2=0x55f255bb0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba6820 0x55f255bb0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 -- 172.21.15.92:0/2938174876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 msgr2=0x55f255ba62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 -- 172.21.15.92:0/2938174876 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f255ad30d0 con 0x55f255bb10e0 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e4b7fe640 1 -- 172.21.15.92:0/2149915318 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0e500d0970 con 0x7f0e54101860 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:19.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 0x7f0e400a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 0x55f255bb34d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009530 tx=0x7f0e44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3977f777008cb0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e48bfe640 1 -- 172.21.15.92:0/2938174876 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44004020 con 0x55f255bb10e0 2024-04-26T18:00:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e48bfe640 1 -- 172.21.15.92:0/2938174876 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e440041c0 con 0x55f255bb10e0 2024-04-26T18:00:19.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.380+0000 7f0e48bfe640 1 -- 172.21.15.92:0/2938174876 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44019830 con 0x55f255bb10e0 2024-04-26T18:00:19.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.381+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2938174876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 msgr2=0x55f255bb34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.381+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 0x55f255bb34d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009530 tx=0x7f0e44011810 comp rx=0 tx=0).stop 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.381+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 0x7f0e400a63a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c005e00 tx=0x7f0e4c005f90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2938174876 shutdown_connections 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255bb10e0 0x55f255bb34d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba6820 0x55f255bb0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2938174876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255ba62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2938174876 >> 172.21.15.92:0/2938174876 conn(0x55f255ba2410 msgr2=0x55f255ba27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2938174876 shutdown_connections 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.382+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2938174876 wait complete. 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.383+0000 7f0e5f1d6740 1 -- start start 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.383+0000 7f0e5f1d6740 1 Processor -- start 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255baeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f255bb3d10 con 0x55f255ba6820 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f255a93b60 con 0x55f255ba5f00 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f255bb3e90 con 0x55f255bb10e0 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5f1d6740 10 client.0 _ll_register_callbacks cb 0x55f255ab82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:47042/0 (socket says 172.21.15.92:47042) 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5a261640 1 -- 172.21.15.92:0/622760971 learned_addr learned my addr 172.21.15.92:0/622760971 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255baeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.384+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 -- 172.21.15.92:0/622760971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 msgr2=0x55f255baeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255baeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 -- 172.21.15.92:0/622760971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 msgr2=0x55f255bae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 -- 172.21.15.92:0/622760971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25581e210 con 0x55f255ba5f00 2024-04-26T18:00:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5a261640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ccb0 tx=0x7f0e50098a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7accaa8a3a717bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001d040 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0e500ce290 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e440041c0 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e5009c140 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.385+0000 7f0e5f1d6740 10 client.24944 fetch_fsmap learned FSMap version 28 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f2558ea620 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e440041c0 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f0e50098530 con 0x55f255ba5f00 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 10 client.24944 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 10 client.24944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 20 client.24944 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255bc1020 0x55f255bc34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 4 client.24944 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f255b1a070 con 0x55f255bc1020 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.386+0000 7f0e59a60640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255bc1020 0x55f255bc34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.387+0000 7f0e3dffb640 10 client.24944 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.387+0000 7f0e59a60640 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255bc1020 0x55f255bc34b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af303afad2223e72 server_cookie=f6f390ce058763e in_seq=0 out_seq=0 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e3dffb640 1 -- 172.21.15.92:0/622760971 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f255b1a070 con 0x55f255bc1020 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e3dffb640 10 client.24944 handle_command_reply: tid=0 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 client.24944 shutdown 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 msgr2=0x55f255bae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ccb0 tx=0x7f0e50098a80 comp rx=0 tx=0).stop 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 shutdown_connections 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255bc1020 0x55f255bc34b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255baeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e3dffb640 0 client.24944 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/622760971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bae070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 >> 172.21.15.92:0/622760971 conn(0x55f255ba2410 msgr2=0x55f255ba8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 shutdown_connections 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/622760971 wait complete. 2024-04-26T18:00:19.395 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.388+0000 7f0e5f1d6740 20 client.24944 trim_cache size 0 max 16384 2024-04-26T18:00:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 Processor -- start 2024-04-26T18:00:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 -- start start 2024-04-26T18:00:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255bb10e0 0x55f255bc9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b7170 con 0x55f255ba6820 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b4a40 con 0x55f255bb10e0 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b2890 con 0x55f255ba5f00 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:46652/0 (socket says 172.21.15.92:46652) 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58462/0 (socket says 172.21.15.92:58462) 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 -- 172.21.15.92:0/687361330 learned_addr learned my addr 172.21.15.92:0/687361330 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5aa62640 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255bb10e0 0x55f255bc9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 -- 172.21.15.92:0/687361330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255bb10e0 msgr2=0x55f255bc9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255bb10e0 0x55f255bc9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 -- 172.21.15.92:0/687361330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 msgr2=0x55f255bc8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e5a261640 1 -- 172.21.15.92:0/687361330 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f255bb34d0 con 0x55f255ba5f00 2024-04-26T18:00:19.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.410+0000 7f0e59a60640 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.411+0000 7f0e5a261640 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e500991b0 tx=0x7f0e50098bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a136738ff6e28888 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.411+0000 7f0e3ffff640 1 -- 172.21.15.92:0/687361330 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001d070 con 0x55f255ba5f00 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.411+0000 7f0e3ffff640 1 -- 172.21.15.92:0/687361330 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e500cdef0 con 0x55f255ba5f00 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.411+0000 7f0e3ffff640 1 -- 172.21.15.92:0/687361330 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e500870b0 con 0x55f255ba5f00 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.412+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/687361330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 msgr2=0x55f255bbcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.412+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e500991b0 tx=0x7f0e50098bb0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/687361330 shutdown_connections 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255bb10e0 0x55f255bc9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bc8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/687361330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255ba5f00 0x55f255bbcbd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/687361330 >> 172.21.15.92:0/687361330 conn(0x55f255ba2410 msgr2=0x55f255ba27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/687361330 shutdown_connections 2024-04-26T18:00:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/687361330 wait complete. 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.413+0000 7f0e5f1d6740 1 -- start start 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.414+0000 7f0e5f1d6740 1 Processor -- start 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.414+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.414+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bb4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:47066/0 (socket says 172.21.15.92:47066) 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bb4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5f1d6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255bb54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5f1d6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b2f00 con 0x55f255ba6820 2024-04-26T18:00:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e59a60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bb4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58476/0 (socket says 172.21.15.92:58476) 2024-04-26T18:00:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e59a60640 1 -- 172.21.15.92:0/2817292659 learned_addr learned my addr 172.21.15.92:0/2817292659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b4370 con 0x55f255ba5f00 2024-04-26T18:00:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541b35d0 con 0x55f255bb10e0 2024-04-26T18:00:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5f1d6740 10 client.0 _ll_register_callbacks cb 0x7f0e50005c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 -- 172.21.15.92:0/2817292659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 msgr2=0x55f255bb54f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255bb54f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 -- 172.21.15.92:0/2817292659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 msgr2=0x55f255bb4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bb4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.415+0000 7f0e5a261640 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f255c26630 con 0x55f255ba5f00 2024-04-26T18:00:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e5a261640 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ccb0 tx=0x7f0e500057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbb77198422aff63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5001d040 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0e500ce4a0 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e500cdef0 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0e5009c5b0 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e5f1d6740 10 client.24950 fetch_fsmap learned FSMap version 28 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f255c26630 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.416+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e50005310 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) ==== 8346+0+0 (secure 0 0 0) 0x7f0e500a1c70 con 0x55f255ba5f00 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 10 client.24950 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 10 client.24950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 20 client.24950 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255c27af0 0x55f255c29ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 4 client.24950 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:00:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0e500cdef0 con 0x55f255c27af0 2024-04-26T18:00:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.417+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255c27af0 0x55f255c29ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.418+0000 7f0e59a60640 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255c27af0 0x55f255c29ee0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5827f99ff081c03 server_cookie=33ec7f1587657546 in_seq=0 out_seq=0 2024-04-26T18:00:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.418+0000 7f0e3dffb640 10 client.24950 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e3dffb640 1 -- 172.21.15.92:0/2817292659 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0e500cdef0 con 0x55f255c27af0 2024-04-26T18:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e3dffb640 10 client.24950 handle_command_reply: tid=0 2024-04-26T18:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 client.24950 shutdown 2024-04-26T18:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 msgr2=0x55f255bb4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000ccb0 tx=0x7f0e500057e0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 shutdown_connections 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f255c27af0 0x55f255c29ee0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f255bb10e0 0x55f255bb54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f255ba6820 0x55f255bb4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 --2- 172.21.15.92:0/2817292659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f255ba5f00 0x55f255bb4a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 >> 172.21.15.92:0/2817292659 conn(0x55f255ba2410 msgr2=0x55f255ba0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e3dffb640 0 client.24950 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:19.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.448+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 shutdown_connections 2024-04-26T18:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.449+0000 7f0e5f1d6740 1 -- 172.21.15.92:0/2817292659 wait complete. 2024-04-26T18:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.449+0000 7f0e5f1d6740 20 client.24950 trim_cache size 0 max 16384 2024-04-26T18:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:00:19.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.450+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 msgr2=0x7f0e400a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.450+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 0x7f0e400a63a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c005e00 tx=0x7f0e4c005f90 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.450+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 msgr2=0x7f0e5419f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.450+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000cce0 tx=0x7f0e5000a620 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 shutdown_connections 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0e400a3ee0 0x7f0e400a63a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0e54107820 0x7f0e541a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e54102220 0x7f0e5419faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 --2- 172.21.15.92:0/2149915318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0e54101860 0x7f0e5419f5b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 >> 172.21.15.92:0/2149915318 conn(0x7f0e540789b0 msgr2=0x7f0e541042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 shutdown_connections 2024-04-26T18:00:19.452 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:19.451+0000 7f0e5c4c5640 1 -- 172.21.15.92:0/2149915318 wait complete. 2024-04-26T18:00:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:19 smithi092 ceph-mon[29156]: pgmap v23: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 74 MiB/s wr, 301 op/s 2024-04-26T18:00:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:19 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:19 smithi189 ceph-mon[32756]: pgmap v23: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 74 MiB/s wr, 301 op/s 2024-04-26T18:00:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:19 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:19 smithi156 ceph-mon[32679]: pgmap v23: 97 pgs: 97 active+clean; 498 MiB data, 612 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 74 MiB/s wr, 301 op/s 2024-04-26T18:00:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:19 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:21 smithi092 ceph-mon[29156]: pgmap v24: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 78 MiB/s wr, 514 op/s 2024-04-26T18:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:21 smithi189 ceph-mon[32756]: pgmap v24: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 78 MiB/s wr, 514 op/s 2024-04-26T18:00:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:21 smithi156 ceph-mon[32679]: pgmap v24: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 78 MiB/s wr, 514 op/s 2024-04-26T18:00:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 10.0 s, 3684.8 tps, lat 27.187 ms stddev 26.276 2024-04-26T18:00:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:23 smithi092 ceph-mon[29156]: pgmap v25: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 59 MiB/s wr, 251 op/s 2024-04-26T18:00:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:23 smithi189 ceph-mon[32756]: pgmap v25: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 59 MiB/s wr, 251 op/s 2024-04-26T18:00:23.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:23 smithi156 ceph-mon[32679]: pgmap v25: 97 pgs: 97 active+clean; 870 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 59 MiB/s wr, 251 op/s 2024-04-26T18:00:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:24 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:24 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:24.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:24 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:00:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:25 smithi092 ceph-mon[29156]: pgmap v26: 97 pgs: 97 active+clean; 898 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 61 MiB/s wr, 394 op/s 2024-04-26T18:00:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:25 smithi189 ceph-mon[32756]: pgmap v26: 97 pgs: 97 active+clean; 898 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 61 MiB/s wr, 394 op/s 2024-04-26T18:00:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:25 smithi156 ceph-mon[32679]: pgmap v26: 97 pgs: 97 active+clean; 898 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 61 MiB/s wr, 394 op/s 2024-04-26T18:00:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:27 smithi092 ceph-mon[29156]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 59 MiB/s wr, 586 op/s 2024-04-26T18:00:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:27 smithi189 ceph-mon[32756]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 59 MiB/s wr, 586 op/s 2024-04-26T18:00:27.667 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:00:27.668 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:00:27.668 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:00:27.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:27 smithi156 ceph-mon[32679]: pgmap v27: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 59 MiB/s wr, 586 op/s 2024-04-26T18:00:28.049 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 15.0 s, 3645.2 tps, lat 27.364 ms stddev 27.897 2024-04-26T18:00:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:29 smithi092 ceph-mon[29156]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.6 MiB/s wr, 549 op/s 2024-04-26T18:00:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:29 smithi189 ceph-mon[32756]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.6 MiB/s wr, 549 op/s 2024-04-26T18:00:29.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:29 smithi156 ceph-mon[32679]: pgmap v28: 97 pgs: 97 active+clean; 923 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.6 MiB/s wr, 549 op/s 2024-04-26T18:00:30.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 -- 172.21.15.92:0/2408164079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac0101a10 msgr2=0x7f6ac0101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:30.087 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 --2- 172.21.15.92:0/2408164079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac0101a10 0x7f6ac0101e70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009990 tx=0x7f6ab0009ca0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 -- 172.21.15.92:0/2408164079 shutdown_connections 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 --2- 172.21.15.92:0/2408164079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac01094b0 0x7f6ac0109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 --2- 172.21.15.92:0/2408164079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 --2- 172.21.15.92:0/2408164079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac0101a10 0x7f6ac0101e70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.087+0000 7f6ac5299700 1 -- 172.21.15.92:0/2408164079 >> 172.21.15.92:0/2408164079 conn(0x7f6ac0078990 msgr2=0x7f6ac00ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.088+0000 7f6ac5299700 1 -- 172.21.15.92:0/2408164079 shutdown_connections 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.088+0000 7f6ac5299700 1 -- 172.21.15.92:0/2408164079 wait complete. 2024-04-26T18:00:30.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.088+0000 7f6ac5299700 1 Processor -- start 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 -- start start 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0101a10 0x7f6ac01a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 0x7f6ac010f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac01135c0 con 0x7f6ac01094b0 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0113440 con 0x7f6ac0101a10 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6ac5299700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac0113740 con 0x7f6ac01023b0 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6abe7fc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6abe7fc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37754/0 (socket says 172.21.15.92:37754) 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.089+0000 7f6abe7fc700 1 -- 172.21.15.92:0/1878361370 learned_addr learned my addr 172.21.15.92:0/1878361370 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:30.090 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 -- 172.21.15.92:0/1878361370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0101a10 msgr2=0x7f6ac01a06e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0101a10 0x7f6ac01a06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 -- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 msgr2=0x7f6ac010f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abf7fe700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 0x7f6ac010f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 0x7f6ac010f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 -- 172.21.15.92:0/1878361370 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac010fdb0 con 0x7f6ac01023b0 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abf7fe700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 0x7f6ac010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.090+0000 7f6abe7fc700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab0009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:30.091 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.091+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0027070 con 0x7f6ac01023b0 2024-04-26T18:00:30.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.091+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ab0022470 con 0x7f6ac01023b0 2024-04-26T18:00:30.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.092+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0017650 con 0x7f6ac01023b0 2024-04-26T18:00:30.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.092+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac010ffe0 con 0x7f6ac01023b0 2024-04-26T18:00:30.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.092+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac019c300 con 0x7f6ac01023b0 2024-04-26T18:00:30.092 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.093+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac0104d30 con 0x7f6ac01023b0 2024-04-26T18:00:30.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.095+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f6ab002a070 con 0x7f6ac01023b0 2024-04-26T18:00:30.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.095+0000 7f6aa7fff700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 0x7f6aa80a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:30.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.095+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6ab00d17a0 con 0x7f6ac01023b0 2024-04-26T18:00:30.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.095+0000 7f6abeffd700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 0x7f6aa80a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:30.095 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.096+0000 7f6abeffd700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 0x7f6aa80a64e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009a70 tx=0x7f6ab4009260 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:30.100 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.101+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f6ab0013070 con 0x7f6ac01023b0 2024-04-26T18:00:30.460 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.461+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ac01101b0 con 0x7f6ac01023b0 2024-04-26T18:00:30.461 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.462+0000 7f6aa7fff700 1 -- 172.21.15.92:0/1878361370 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11887 (secure 0 0 0) 0x7f6ab009dcf0 con 0x7f6ac01023b0 2024-04-26T18:00:30.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:00:30.461 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:00:22.436646+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:00:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.465+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 msgr2=0x7f6aa80a64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 0x7f6aa80a64e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009a70 tx=0x7f6ab4009260 comp rx=0 tx=0).stop 2024-04-26T18:00:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 msgr2=0x7f6ac01a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0000c00 tx=0x7f6ab0009580 comp rx=0 tx=0).stop 2024-04-26T18:00:30.465 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 shutdown_connections 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6aa80a4020 0x7f6aa80a64e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ac0101a10 0x7f6ac01a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ac01094b0 0x7f6ac010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 --2- 172.21.15.92:0/1878361370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ac01023b0 0x7f6ac01a0c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 >> 172.21.15.92:0/1878361370 conn(0x7f6ac0078990 msgr2=0x7f6ac0106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 shutdown_connections 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:30.466+0000 7f6ac5299700 1 -- 172.21.15.92:0/1878361370 wait complete. 2024-04-26T18:00:30.466 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-04-26T18:00:31.234 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:00:31.235 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:00:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:31 smithi092 ceph-mon[29156]: pgmap v29: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-04-26T18:00:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:31 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1878361370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:31.576 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:00:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:31 smithi189 ceph-mon[32756]: pgmap v29: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-04-26T18:00:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:31 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1878361370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:31 smithi156 ceph-mon[32679]: pgmap v29: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 12 MiB/s wr, 863 op/s 2024-04-26T18:00:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:31 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1878361370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:00:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.572+0000 7fb78b1c1640 1 -- 172.21.15.92:0/1564512204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 msgr2=0x7fb784101c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.572+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/1564512204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784101c90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb770009930 tx=0x7fb77002a420 comp rx=0 tx=0).stop 2024-04-26T18:00:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 -- 172.21.15.92:0/1564512204 shutdown_connections 2024-04-26T18:00:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/1564512204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 0x7fb78410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/1564512204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784101c90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/1564512204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 -- 172.21.15.92:0/1564512204 >> 172.21.15.92:0/1564512204 conn(0x7fb7840fd300 msgr2=0x7fb7840ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 -- 172.21.15.92:0/1564512204 shutdown_connections 2024-04-26T18:00:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 -- 172.21.15.92:0/1564512204 wait complete. 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.573+0000 7fb78b1c1640 1 Processor -- start 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 -- start start 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 0x7fb784117400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784111fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841109c0 con 0x7fb784101810 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb784110840 con 0x7fb7841021d0 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78b1c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb784110b40 con 0x7fb784107820 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34456/0 (socket says 172.21.15.92:34456) 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 -- 172.21.15.92:0/3932462540 learned_addr learned my addr 172.21.15.92:0/3932462540 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb783fff640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 0x7fb784117400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78975e640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784111fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 -- 172.21.15.92:0/3932462540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 msgr2=0x7fb784111fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784111fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 -- 172.21.15.92:0/3932462540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 msgr2=0x7fb784117400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 0x7fb784117400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb788f5d640 1 -- 172.21.15.92:0/3932462540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb784112890 con 0x7fb784101810 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.574+0000 7fb78975e640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9f0 tx=0x7fb77800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb781ffb640 1 -- 172.21.15.92:0/3932462540 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77800cd80 con 0x7fb784101810 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb781ffb640 1 -- 172.21.15.92:0/3932462540 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7780054d0 con 0x7fb784101810 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb781ffb640 1 -- 172.21.15.92:0/3932462540 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778010690 con 0x7fb784101810 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb784112b80 con 0x7fb784101810 2024-04-26T18:00:32.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.575+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78411ada0 con 0x7fb784101810 2024-04-26T18:00:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.578+0000 7fb781ffb640 1 -- 172.21.15.92:0/3932462540 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fb778004e90 con 0x7fb784101810 2024-04-26T18:00:32.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.579+0000 7fb78dfb4740 1 Processor -- start 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb781ffb640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 0x7fb7740a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78975e640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 0x7fb7740a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb781ffb640 1 -- 172.21.15.92:0/3932462540 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb7780d0d90 con 0x7fb784101810 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 -- start start 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde5c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ecddb5460 con 0x558ecde5a0e0 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x558ecdd6f590 con 0x558ecde4f820 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ecddb1420 con 0x558ecde4ef00 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.580+0000 7fb78975e640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 0x7fb7740a6540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ff8d0 tx=0x7fb77c0094a0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb78975e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde5c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37800/0 (socket says 172.21.15.92:37800) 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 -- 172.21.15.92:0/3331777086 learned_addr learned my addr 172.21.15.92:0/3331777086 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb783fff640 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 -- 172.21.15.92:0/3331777086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 msgr2=0x558ecde59ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde59ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 -- 172.21.15.92:0/3331777086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 msgr2=0x558ecde5c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde5c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 -- 172.21.15.92:0/3331777086 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecdd7c0d0 con 0x558ecde4ef00 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7780ceb50 tx=0x7fb77809c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a073360756100cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb76effd640 1 -- 172.21.15.92:0/3331777086 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77809cb50 con 0x558ecde4ef00 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb76effd640 1 -- 172.21.15.92:0/3331777086 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.581+0000 7fb76effd640 1 -- 172.21.15.92:0/3331777086 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780991c0 con 0x558ecde4ef00 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3331777086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 msgr2=0x558ecde4f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7780ceb50 tx=0x7fb77809c4b0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3331777086 shutdown_connections 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde5c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde59ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3331777086 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde4f2e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3331777086 >> 172.21.15.92:0/3331777086 conn(0x558ecde4b410 msgr2=0x558ecde4b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3331777086 shutdown_connections 2024-04-26T18:00:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3331777086 wait complete. 2024-04-26T18:00:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.582+0000 7fb78dfb4740 1 -- start start 2024-04-26T18:00:32.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 Processor -- start 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 0x558ecde57630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde5a0e0 0x558ecde57b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ecde5cd10 con 0x558ecde4f820 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x558ecdd3cb60 con 0x558ecde4ef00 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558ecde5ce90 con 0x558ecde5a0e0 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.583+0000 7fb78dfb4740 10 client.0 _ll_register_callbacks cb 0x558ecdd612b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:60494/0 (socket says 172.21.15.92:60494) 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 -- 172.21.15.92:0/3230280020 learned_addr learned my addr 172.21.15.92:0/3230280020 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb78975e640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde5a0e0 0x558ecde57b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb783fff640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 0x558ecde57630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 -- 172.21.15.92:0/3230280020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde5a0e0 msgr2=0x558ecde57b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde5a0e0 0x558ecde57b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 -- 172.21.15.92:0/3230280020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 msgr2=0x558ecde57630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 0x558ecde57630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 -- 172.21.15.92:0/3230280020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecdac7210 con 0x558ecde4ef00 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb783fff640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 0x558ecde57630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb778009250 tx=0x7fb778005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6059a826baf7f9b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb763fff640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77809cb50 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb7780a5330 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.584+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7780a57c0 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 10 client.24965 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ecdb93620 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fb7780988a0 con 0x558ecde4ef00 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 10 client.24965 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 10 client.24965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 20 client.24965 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:32.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecde6a140 0x558ecde6c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 4 client.24965 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.585+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ecddc3070 con 0x558ecde6a140 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.586+0000 7fb783fff640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecde6a140 0x558ecde6c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.586+0000 7fb783fff640 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecde6a140 0x558ecde6c530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22d22c779dbde4e server_cookie=992c399a68451ed2 in_seq=0 out_seq=0 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.586+0000 7fb763fff640 10 client.24965 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.587+0000 7fb763fff640 1 -- 172.21.15.92:0/3230280020 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558ecddc3070 con 0x558ecde6a140 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.587+0000 7fb763fff640 10 client.24965 handle_command_reply: tid=0 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.587+0000 7fb78dfb4740 1 client.24965 shutdown 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.587+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 msgr2=0x558ecde570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.587+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb778009250 tx=0x7fb778005770 comp rx=0 tx=0).stop 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 shutdown_connections 2024-04-26T18:00:32.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecde6a140 0x558ecde6c530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde5a0e0 0x558ecde57b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde4f820 0x558ecde57630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3230280020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde570f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 >> 172.21.15.92:0/3230280020 conn(0x558ecde4b410 msgr2=0x558ecde51140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb763fff640 0 client.24965 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 shutdown_connections 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3230280020 wait complete. 2024-04-26T18:00:32.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.588+0000 7fb78dfb4740 20 client.24965 trim_cache size 0 max 16384 2024-04-26T18:00:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 Processor -- start 2024-04-26T18:00:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 -- start start 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde52400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4f820 0x558ecde6f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde6f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bf9c0 con 0x558ecde5a0e0 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bd260 con 0x558ecde4ef00 2024-04-26T18:00:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bb0b0 con 0x558ecde4f820 2024-04-26T18:00:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78975e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde6f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78975e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde6f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34474/0 (socket says 172.21.15.92:34474) 2024-04-26T18:00:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb78975e640 1 -- 172.21.15.92:0/3704033545 learned_addr learned my addr 172.21.15.92:0/3704033545 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde52400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb788f5d640 1 -- 172.21.15.92:0/3704033545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4f820 msgr2=0x558ecde6f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4f820 0x558ecde6f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb788f5d640 1 -- 172.21.15.92:0/3704033545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 msgr2=0x558ecde6f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.609+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde6f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.610+0000 7fb788f5d640 1 -- 172.21.15.92:0/3704033545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecde55640 con 0x558ecde4ef00 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.610+0000 7fb788f5d640 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde52400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb77809ae00 tx=0x7fb7780bd050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f3ee94d799eea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.610+0000 7fb76e7fc640 1 -- 172.21.15.92:0/3704033545 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780ce310 con 0x558ecde4ef00 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.610+0000 7fb76e7fc640 1 -- 172.21.15.92:0/3704033545 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.610+0000 7fb76e7fc640 1 -- 172.21.15.92:0/3704033545 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780ce740 con 0x558ecde4ef00 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3704033545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 msgr2=0x558ecde52400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde52400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb77809ae00 tx=0x7fb7780bd050 comp rx=0 tx=0).stop 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3704033545 shutdown_connections 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecde6f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4f820 0x558ecde6f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/3704033545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4ef00 0x558ecde52400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3704033545 >> 172.21.15.92:0/3704033545 conn(0x558ecde4b410 msgr2=0x558ecde65970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3704033545 shutdown_connections 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- 172.21.15.92:0/3704033545 wait complete. 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.611+0000 7fb78dfb4740 1 -- start start 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 Processor -- start 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde6d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde6d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bb720 con 0x558ecde5a0e0 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bcb90 con 0x558ecde4f820 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb7841bbdf0 con 0x558ecde4ef00 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78dfb4740 10 client.0 _ll_register_callbacks cb 0x7fb77c016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78975e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde6d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78975e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34478/0 (socket says 172.21.15.92:34478) 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78975e640 1 -- 172.21.15.92:0/313733466 learned_addr learned my addr 172.21.15.92:0/313733466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb783fff640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde6d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 -- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 msgr2=0x558ecde6d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde6d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 -- 172.21.15.92:0/313733466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 msgr2=0x558ecdecf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb788f5d640 1 -- 172.21.15.92:0/313733466 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecdecf930 con 0x558ecde4ef00 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.612+0000 7fb78975e640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb788f5d640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde6d3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb77809ca90 tx=0x7fb77809c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa24597bc875019 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780ce310 con 0x558ecde4ef00 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb7780a5330 con 0x558ecde4ef00 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb7780b1380 con 0x558ecde4ef00 2024-04-26T18:00:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb78dfb4740 10 client.24922 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558ecdecf930 con 0x558ecde4ef00 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7780a0f00 con 0x558ecde4ef00 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.613+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fb7780a2090 con 0x558ecde4ef00 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 10 client.24922 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 10 client.24922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 20 client.24922 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecded0ee0 0x558ecded32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 4 client.24922 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:00:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.614+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ecddbcee0 con 0x558ecded0ee0 2024-04-26T18:00:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.615+0000 7fb783fff640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecded0ee0 0x558ecded32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.616+0000 7fb763fff640 10 client.24922 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:32.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.616+0000 7fb783fff640 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecded0ee0 0x558ecded32d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f715a3cc7f16ce32 server_cookie=70e1f633424f416c in_seq=0 out_seq=0 2024-04-26T18:00:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.629+0000 7fb763fff640 1 -- 172.21.15.92:0/313733466 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ecddbcee0 con 0x558ecded0ee0 2024-04-26T18:00:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.629+0000 7fb763fff640 10 client.24922 handle_command_reply: tid=0 2024-04-26T18:00:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.629+0000 7fb78dfb4740 1 client.24922 shutdown 2024-04-26T18:00:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 msgr2=0x558ecde6d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde6d3a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb77809ca90 tx=0x7fb77809c4b0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 shutdown_connections 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558ecded0ee0 0x558ecded32d0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ecde5a0e0 0x558ecdecf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ecde4f820 0x558ecde6d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb763fff640 0 client.24922 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 --2- 172.21.15.92:0/313733466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558ecde4ef00 0x558ecde6d3a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 >> 172.21.15.92:0/313733466 conn(0x558ecde4b410 msgr2=0x558ecde49d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 shutdown_connections 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 1 -- 172.21.15.92:0/313733466 wait complete. 2024-04-26T18:00:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.630+0000 7fb78dfb4740 20 client.24922 trim_cache size 0 max 16384 2024-04-26T18:00:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:00:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:00:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:00:32.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 msgr2=0x7fb7740a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 0x7fb7740a6540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7840ff8d0 tx=0x7fb77c0094a0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 msgr2=0x7fb784116ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb77800e9f0 tx=0x7fb77800edf0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 shutdown_connections 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb7740a4080 0x7fb7740a6540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb784107820 0x7fb784111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7841021d0 0x7fb784117400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 --2- 172.21.15.92:0/3932462540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb784101810 0x7fb784116ec0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 >> 172.21.15.92:0/3932462540 conn(0x7fb7840fd300 msgr2=0x7fb7840fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 shutdown_connections 2024-04-26T18:00:32.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:32.631+0000 7fb78b1c1640 1 -- 172.21.15.92:0/3932462540 wait complete. 2024-04-26T18:00:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 20.0 s, 3703.2 tps, lat 26.989 ms stddev 26.284 2024-04-26T18:00:33.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:33 smithi092 ceph-mon[29156]: pgmap v30: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-04-26T18:00:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:33 smithi189 ceph-mon[32756]: pgmap v30: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-04-26T18:00:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:33 smithi156 ceph-mon[32679]: pgmap v30: 97 pgs: 97 active+clean; 932 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 7.9 MiB/s wr, 650 op/s 2024-04-26T18:00:34.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 -- 172.21.15.92:0/3683289112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69981094e0 msgr2=0x7f69981098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 --2- 172.21.15.92:0/3683289112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69981094e0 0x7f69981098c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f69880098f0 tx=0x7f6988009c00 comp rx=0 tx=0).stop 2024-04-26T18:00:34.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 -- 172.21.15.92:0/3683289112 shutdown_connections 2024-04-26T18:00:34.842 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 --2- 172.21.15.92:0/3683289112 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 --2- 172.21.15.92:0/3683289112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f69981094e0 0x7f69981098c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 --2- 172.21.15.92:0/3683289112 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6998103450 0x7f69981038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 -- 172.21.15.92:0/3683289112 >> 172.21.15.92:0/3683289112 conn(0x7f69980fef00 msgr2=0x7f6998101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 -- 172.21.15.92:0/3683289112 shutdown_connections 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.841+0000 7f699d5e5700 1 -- 172.21.15.92:0/3683289112 wait complete. 2024-04-26T18:00:34.843 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.842+0000 7f699d5e5700 1 Processor -- start 2024-04-26T18:00:34.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.842+0000 7f699d5e5700 1 -- start start 2024-04-26T18:00:34.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6998103450 0x7f6998075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.844 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69981135f0 con 0x7f69981094e0 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6998113470 con 0x7f6998103e10 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f699d5e5700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6998113770 con 0x7f6998103450 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50916/0 (socket says 172.21.15.92:50916) 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 -- 172.21.15.92:0/403289998 learned_addr learned my addr 172.21.15.92:0/403289998 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69967fc700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f6996ffd700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6998103450 0x7f6998075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 -- 172.21.15.92:0/403289998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6998103450 msgr2=0x7f6998075720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6998103450 0x7f6998075720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 -- 172.21.15.92:0/403289998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 msgr2=0x7f6998075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69977fe700 1 -- 172.21.15.92:0/403289998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69981a7f80 con 0x7f69981094e0 2024-04-26T18:00:34.845 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.843+0000 7f69967fc700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.844+0000 7f69977fe700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f699000ef30 tx=0x7f699000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.844+0000 7f697ffff700 1 -- 172.21.15.92:0/403289998 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69900092e0 con 0x7f69981094e0 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.844+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69981a8210 con 0x7f69981094e0 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.844+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69981a87a0 con 0x7f69981094e0 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.844+0000 7f697ffff700 1 -- 172.21.15.92:0/403289998 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6990004bb0 con 0x7f69981094e0 2024-04-26T18:00:34.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.845+0000 7f697ffff700 1 -- 172.21.15.92:0/403289998 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69900092e0 con 0x7f69981094e0 2024-04-26T18:00:34.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.848+0000 7f697ffff700 1 -- 172.21.15.92:0/403289998 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7f6990012050 con 0x7f69981094e0 2024-04-26T18:00:34.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.848+0000 7f697ffff700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 0x7f69800a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.848+0000 7f697ffff700 1 -- 172.21.15.92:0/403289998 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6990019070 con 0x7f69981094e0 2024-04-26T18:00:34.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.848+0000 7f6996ffd700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 0x7f69800a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.849+0000 7f6996ffd700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 0x7f69800a6830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6988009810 tx=0x7f6988019040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.849+0000 7f69a7e77b80 1 Processor -- start 2024-04-26T18:00:34.849 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.849+0000 7f69a7e77b80 1 -- start start 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.849+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x56087989f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x5608798992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 0x560879899d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5608797eb9c0 con 0x56087989f850 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560879751ac0 con 0x560879899900 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608797e7980 con 0x56087989ef30 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69967fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x5608798992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69967fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x5608798992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50928/0 (socket says 172.21.15.92:50928) 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69967fc700 1 -- 172.21.15.92:0/4219811561 learned_addr learned my addr 172.21.15.92:0/4219811561 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f6996ffd700 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x56087989f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 0x560879899d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 -- 172.21.15.92:0/4219811561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 msgr2=0x56087989f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x56087989f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 -- 172.21.15.92:0/4219811561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 msgr2=0x5608798992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x5608798992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 -- 172.21.15.92:0/4219811561 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560879738a60 con 0x560879899900 2024-04-26T18:00:34.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.850+0000 7f69977fe700 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 0x560879899d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69900cc800 tx=0x7f699009aac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13514854ad827b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.851+0000 7f697d7fa700 1 -- 172.21.15.92:0/4219811561 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69900cf020 con 0x560879899900 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.851+0000 7f697d7fa700 1 -- 172.21.15.92:0/4219811561 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6990004bb0 con 0x560879899900 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.851+0000 7f697d7fa700 1 -- 172.21.15.92:0/4219811561 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699000cc90 con 0x560879899900 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 -- 172.21.15.92:0/4219811561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 msgr2=0x560879899d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 0x560879899d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f69900cc800 tx=0x7f699009aac0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 -- 172.21.15.92:0/4219811561 shutdown_connections 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560879899900 0x560879899d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x56087989f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/4219811561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x5608798992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.852+0000 7f69a7e77b80 1 -- 172.21.15.92:0/4219811561 >> 172.21.15.92:0/4219811561 conn(0x5608797c7750 msgr2=0x560879894090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:34.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.853+0000 7f69a7e77b80 1 -- 172.21.15.92:0/4219811561 shutdown_connections 2024-04-26T18:00:34.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 -- 172.21.15.92:0/4219811561 wait complete. 2024-04-26T18:00:34.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 -- start start 2024-04-26T18:00:34.854 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 Processor -- start 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989f850 0x5608798a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5608798a62c0 con 0x560879899900 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5608797a5c10 con 0x56087989ef30 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.854+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5608798a6440 con 0x56087989f850 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69a7e77b80 10 client.0 _ll_register_callbacks cb 0x560879783ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50940/0 (socket says 172.21.15.92:50940) 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f6996ffd700 1 -- 172.21.15.92:0/3903376394 learned_addr learned my addr 172.21.15.92:0/3903376394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69977fe700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989f850 0x5608798a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 -- 172.21.15.92:0/3903376394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989f850 msgr2=0x5608798a2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989f850 0x5608798a2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 -- 172.21.15.92:0/3903376394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 msgr2=0x5608798a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 -- 172.21.15.92:0/3903376394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608797a9610 con 0x56087989ef30 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69967fc700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798a2990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f698c004420 tx=0x7f698c003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd1242f01f8b8c37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f697aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c011440 con 0x56087989ef30 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f698c0115e0 con 0x56087989ef30 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.855+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6990004bb0 con 0x56087989ef30 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f698c0117e0 con 0x56087989ef30 2024-04-26T18:00:34.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 10 client.24983 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608798b9460 con 0x56087989ef30 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6990004bb0 con 0x56087989ef30 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f698c01bae0 con 0x56087989ef30 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 10 client.24983 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 10 client.24983 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 20 client.24983 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x5608798bdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 4 client.24983 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608797f93a0 con 0x5608798bbaa0 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.856+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x5608798bdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.857+0000 7f697aff5700 10 client.24983 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:34.859 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.857+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x5608798bdef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eacc35415e4bac6a server_cookie=8e39848a8b758cf7 in_seq=0 out_seq=0 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.857+0000 7f697aff5700 1 -- 172.21.15.92:0/3903376394 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5608797f93a0 con 0x5608798bbaa0 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.857+0000 7f697aff5700 10 client.24983 handle_command_reply: tid=0 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 client.24983 shutdown 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 msgr2=0x5608798a2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798a2990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f698c004420 tx=0x7f698c003960 comp rx=0 tx=0).stop 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 shutdown_connections 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x5608798bdef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f697aff5700 0 client.24983 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989f850 0x5608798a2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x5608798a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3903376394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798a2990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.861 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 >> 172.21.15.92:0/3903376394 conn(0x5608797c7750 msgr2=0x5608798982d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:34.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.858+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 shutdown_connections 2024-04-26T18:00:34.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.859+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3903376394 wait complete. 2024-04-26T18:00:34.862 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.859+0000 7f69a7e77b80 20 client.24983 trim_cache size 0 max 16384 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.888+0000 7f69a7e77b80 1 Processor -- start 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.888+0000 7f69a7e77b80 1 -- start start 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x5608798a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 0x5608798b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f698400fd00 con 0x560879899900 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f698400d560 con 0x56087989f850 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f698400b3b0 con 0x56087989ef30 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50948/0 (socket says 172.21.15.92:50948) 2024-04-26T18:00:34.890 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 -- 172.21.15.92:0/3371637377 learned_addr learned my addr 172.21.15.92:0/3371637377 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69967fc700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x5608798a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69977fe700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 0x5608798b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 -- 172.21.15.92:0/3371637377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 msgr2=0x5608798a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x5608798a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 -- 172.21.15.92:0/3371637377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 msgr2=0x5608798b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 0x5608798b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 -- 172.21.15.92:0/3371637377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560879890880 con 0x560879899900 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69967fc700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x5608798a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f69977fe700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 0x5608798b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.889+0000 7f6996ffd700 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f698800c010 tx=0x7f6988009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb540492a4e4be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.890+0000 7f697cff9700 1 -- 172.21.15.92:0/3371637377 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880351b0 con 0x560879899900 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.890+0000 7f697cff9700 1 -- 172.21.15.92:0/3371637377 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f698803b070 con 0x560879899900 2024-04-26T18:00:34.891 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.890+0000 7f697cff9700 1 -- 172.21.15.92:0/3371637377 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988003e50 con 0x560879899900 2024-04-26T18:00:34.894 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3371637377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 msgr2=0x56087989d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f698800c010 tx=0x7f6988009c00 comp rx=0 tx=0).stop 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3371637377 shutdown_connections 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989f850 0x5608798b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560879899900 0x56087989d0b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/3371637377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56087989ef30 0x5608798a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3371637377 >> 172.21.15.92:0/3371637377 conn(0x5608797c7750 msgr2=0x56087988d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3371637377 shutdown_connections 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- 172.21.15.92:0/3371637377 wait complete. 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 -- start start 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.891+0000 7f69a7e77b80 1 Processor -- start 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560879899900 0x5608798b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.895 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f698400ba20 con 0x56087989f850 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f698400ce90 con 0x56087989ef30 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f698400c0f0 con 0x560879899900 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69a7e77b80 10 client.0 _ll_register_callbacks cb 0x560879783ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f6996ffd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560879899900 0x5608798b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69977fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:50950/0 (socket says 172.21.15.92:50950) 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69977fe700 1 -- 172.21.15.92:0/1085849008 learned_addr learned my addr 172.21.15.92:0/1085849008 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 -- 172.21.15.92:0/1085849008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560879899900 msgr2=0x5608798b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560879899900 0x5608798b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 -- 172.21.15.92:0/1085849008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 msgr2=0x56087991c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:34.896 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 -- 172.21.15.92:0/1085849008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608798b9290 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69977fe700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f69967fc700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798b17c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f698c010490 tx=0x7f698c004340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adef627ac699e683 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.892+0000 7f697aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c028070 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f698c023e50 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f698803b070 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f698c010720 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 10 client.24989 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608799238c0 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f698c029040 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f698c005040 con 0x56087989ef30 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 10 client.24989 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:34.897 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 10 client.24989 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 20 client.24989 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x560879926110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 4 client.24989 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x7f698803b070 con 0x5608798bbaa0 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.893+0000 7f6996ffd700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x560879926110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.894+0000 7f697aff5700 10 client.24989 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:34.898 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:34.894+0000 7f6996ffd700 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x560879926110 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a384846c17dc91 server_cookie=e0c9fe0c57674c2e in_seq=0 out_seq=0 2024-04-26T18:00:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:35 smithi092 ceph-mon[29156]: pgmap v31: 97 pgs: 97 active+clean; 946 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-04-26T18:00:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:35 smithi189 ceph-mon[32756]: pgmap v31: 97 pgs: 97 active+clean; 946 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-04-26T18:00:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:35 smithi156 ceph-mon[32679]: pgmap v31: 97 pgs: 97 active+clean; 946 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-04-26T18:00:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.683+0000 7f697aff5700 1 -- 172.21.15.92:0/1085849008 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x7f698803b070 con 0x5608798bbaa0 2024-04-26T18:00:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.683+0000 7f697aff5700 10 client.24989 handle_command_reply: tid=0 2024-04-26T18:00:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.683+0000 7f69a7e77b80 1 client.24989 shutdown 2024-04-26T18:00:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 msgr2=0x5608798b17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:35.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798b17c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f698c010490 tx=0x7f698c004340 comp rx=0 tx=0).stop 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 shutdown_connections 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5608798bbaa0 0x560879926110 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56087989f850 0x56087991c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560879899900 0x5608798b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 --2- 172.21.15.92:0/1085849008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56087989ef30 0x5608798b17c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f697aff5700 0 client.24989 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 >> 172.21.15.92:0/1085849008 conn(0x5608797c7750 msgr2=0x56087988df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 shutdown_connections 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 1 -- 172.21.15.92:0/1085849008 wait complete. 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f69a7e77b80 20 client.24989 trim_cache size 0 max 16384 2024-04-26T18:00:35.685 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 2, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "9cc381f7": { 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 2, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:00:35.686 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 90.0, 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:00:35.687 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 msgr2=0x7f69800a6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 0x7f69800a6830 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6988009810 tx=0x7f6988019040 comp rx=0 tx=0).stop 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 msgr2=0x7f69980761a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f699000ef30 tx=0x7f699000c3a0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 shutdown_connections 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f69800a4370 0x7f69800a6830 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69981094e0 0x7f69980761a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.688 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6998103450 0x7f6998075720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 --2- 172.21.15.92:0/403289998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6998103e10 0x7f6998075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:35.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.684+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 >> 172.21.15.92:0/403289998 conn(0x7f69980fef00 msgr2=0x7f69980ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:35.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.685+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 shutdown_connections 2024-04-26T18:00:35.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:00:35.685+0000 7f699d5e5700 1 -- 172.21.15.92:0/403289998 wait complete. 2024-04-26T18:00:36.474 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9cc381f7', quiesce took 8.8 seconds. Will release after: 30.0 2024-04-26T18:00:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:37 smithi092 ceph-mon[29156]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-04-26T18:00:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:37 smithi189 ceph-mon[32756]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-04-26T18:00:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:37 smithi156 ceph-mon[32679]: pgmap v32: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 833 op/s 2024-04-26T18:00:38.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 25.0 s, 1420.0 tps, lat 22.620 ms stddev 23.373 2024-04-26T18:00:39.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:39 smithi156 ceph-mon[32679]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-04-26T18:00:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:39 smithi092 ceph-mon[29156]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-04-26T18:00:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:39 smithi189 ceph-mon[32756]: pgmap v33: 97 pgs: 97 active+clean; 953 MiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-04-26T18:00:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:41 smithi092 ceph-mon[29156]: pgmap v34: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-04-26T18:00:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:41 smithi189 ceph-mon[32756]: pgmap v34: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-04-26T18:00:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:41 smithi156 ceph-mon[32679]: pgmap v34: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-04-26T18:00:43.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 30.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:00:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:43 smithi092 ceph-mon[29156]: pgmap v35: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-04-26T18:00:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:43 smithi189 ceph-mon[32756]: pgmap v35: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-04-26T18:00:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:43 smithi156 ceph-mon[32679]: pgmap v35: 97 pgs: 97 active+clean; 956 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-04-26T18:00:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:00:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:00:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:00:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:00:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:00:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:45 smithi092 ceph-mon[29156]: pgmap v36: 97 pgs: 97 active+clean; 978 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 585 op/s 2024-04-26T18:00:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:45 smithi189 ceph-mon[32756]: pgmap v36: 97 pgs: 97 active+clean; 978 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 585 op/s 2024-04-26T18:00:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:45 smithi156 ceph-mon[32679]: pgmap v36: 97 pgs: 97 active+clean; 978 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 11 MiB/s wr, 585 op/s 2024-04-26T18:00:45.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 -- 172.21.15.92:0/1435831956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 msgr2=0x7fcefc10e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/1435831956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc10e6e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009cd0 tx=0x7fcef402a8e0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 -- 172.21.15.92:0/1435831956 shutdown_connections 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/1435831956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc10e6e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/1435831956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 0x7fcefc101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/1435831956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.722+0000 7fcf03cc8640 1 -- 172.21.15.92:0/1435831956 >> 172.21.15.92:0/1435831956 conn(0x7fcefc0789b0 msgr2=0x7fcefc078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- 172.21.15.92:0/1435831956 shutdown_connections 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- 172.21.15.92:0/1435831956 wait complete. 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 Processor -- start 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- start start 2024-04-26T18:00:45.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 0x7fcefc199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc1a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111ae0 con 0x7fcefc102220 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111960 con 0x7fcefc107820 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf03cc8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc111c60 con 0x7fcefc101860 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf01263640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf01263640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52238/0 (socket says 172.21.15.92:52238) 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.723+0000 7fcf01263640 1 -- 172.21.15.92:0/4242782264 learned_addr learned my addr 172.21.15.92:0/4242782264 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf02265640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc1a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01a64640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 0x7fcefc199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 -- 172.21.15.92:0/4242782264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 msgr2=0x7fcefc199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 0x7fcefc199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 -- 172.21.15.92:0/4242782264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 msgr2=0x7fcefc1a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc1a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 -- 172.21.15.92:0/4242782264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc1a54c0 con 0x7fcefc102220 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf02265640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc1a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf01263640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d770 tx=0x7fceec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcef2ffd640 1 -- 172.21.15.92:0/4242782264 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec017070 con 0x7fcefc102220 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcef2ffd640 1 -- 172.21.15.92:0/4242782264 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceec0054d0 con 0x7fcefc102220 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcefc1a5690 con 0x7fcefc102220 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcef2ffd640 1 -- 172.21.15.92:0/4242782264 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec004c30 con 0x7fcefc102220 2024-04-26T18:00:45.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.724+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcefc1a5b00 con 0x7fcefc102220 2024-04-26T18:00:45.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.726+0000 7fcef2ffd640 1 -- 172.21.15.92:0/4242782264 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fceec004e10 con 0x7fcefc102220 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 Processor -- start 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 -- start start 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a9720 0x5621e85b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5621e850f460 con 0x5621e85a8e00 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcef2ffd640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 0x7fcee80a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5621e84c9590 con 0x5621e85a9720 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf069e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5621e850b420 con 0x5621e85b84f0 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf02265640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf02265640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52250/0 (socket says 172.21.15.92:52250) 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf02265640 1 -- 172.21.15.92:0/3111535174 learned_addr learned my addr 172.21.15.92:0/3111535174 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcef2ffd640 1 -- 172.21.15.92:0/4242782264 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fceec0d05c0 con 0x7fcefc102220 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf02265640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 0x7fcee80a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf01263640 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.727+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a9720 0x5621e85b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 -- 172.21.15.92:0/3111535174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 msgr2=0x5621e85ba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85ba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 -- 172.21.15.92:0/3111535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a9720 msgr2=0x5621e85b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a9720 0x5621e85b7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 -- 172.21.15.92:0/3111535174 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621e84d60d0 con 0x5621e85a8e00 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009a60 tx=0x7fcef4031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bc6fe343bc2245 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcf02265640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 0x7fcee80a63a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcef4035000 tx=0x7fcef4048000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcee7fff640 1 -- 172.21.15.92:0/3111535174 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef404d070 con 0x5621e85a8e00 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcee7fff640 1 -- 172.21.15.92:0/3111535174 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef4036040 con 0x5621e85a8e00 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.728+0000 7fcee7fff640 1 -- 172.21.15.92:0/3111535174 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40305a0 con 0x5621e85a8e00 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- 172.21.15.92:0/3111535174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 msgr2=0x5621e85a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009a60 tx=0x7fcef4031bb0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- 172.21.15.92:0/3111535174 shutdown_connections 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a9720 0x5621e85b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3111535174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85a91e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- 172.21.15.92:0/3111535174 >> 172.21.15.92:0/3111535174 conn(0x5621e85a5410 msgr2=0x5621e85a57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- 172.21.15.92:0/3111535174 shutdown_connections 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- 172.21.15.92:0/3111535174 wait complete. 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 -- start start 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.729+0000 7fcf069e3740 1 Processor -- start 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85b84f0 0x5621e85b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5621e85bb0c0 con 0x5621e85a8e00 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5621e8496b60 con 0x5621e85b84f0 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5621e85bb240 con 0x5621e85a9720 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 10 client.0 _ll_register_callbacks cb 0x5621e84bb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52264/0 (socket says 172.21.15.92:52264) 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 -- 172.21.15.92:0/2968276648 learned_addr learned my addr 172.21.15.92:0/2968276648 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01263640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf02265640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85b84f0 0x5621e85b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 -- 172.21.15.92:0/2968276648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 msgr2=0x5621e85b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 -- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85b84f0 msgr2=0x5621e85b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85b84f0 0x5621e85b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 -- 172.21.15.92:0/2968276648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621e8221210 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01263640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf01a64640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcef8010420 tx=0x7fcef80108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680ae1c224ad3b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8012920 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fcef8012ac0 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.730+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcef4036040 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcef8012cc0 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 10 client.15408 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5621e82ed620 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef4036040 con 0x5621e85a8e00 2024-04-26T18:00:45.739 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fcef8024050 con 0x5621e85a8e00 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 10 client.15408 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 20 client.15408 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e85c8700 0x5621e85cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 4 client.15408 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621e851d070 con 0x5621e85c8700 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.731+0000 7fcf01263640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e85c8700 0x5621e85cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.732+0000 7fcee57fa640 10 client.15408 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.732+0000 7fcf01263640 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e85c8700 0x5621e85cab50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd8228fb02d831e server_cookie=4a4da5f3365ea40e in_seq=0 out_seq=0 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcee57fa640 1 -- 172.21.15.92:0/2968276648 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5621e851d070 con 0x5621e85c8700 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcee57fa640 10 client.15408 handle_command_reply: tid=0 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 client.15408 shutdown 2024-04-26T18:00:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 msgr2=0x5621e85b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcef8010420 tx=0x7fcef80108e0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 shutdown_connections 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e85c8700 0x5621e85cab50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85b84f0 0x5621e85b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcee57fa640 0 client.15408 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 --2- 172.21.15.92:0/2968276648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a8e00 0x5621e85b5450 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 >> 172.21.15.92:0/2968276648 conn(0x5621e85a5410 msgr2=0x5621e85ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 shutdown_connections 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 1 -- 172.21.15.92:0/2968276648 wait complete. 2024-04-26T18:00:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.733+0000 7fcf069e3740 20 client.15408 trim_cache size 0 max 16384 2024-04-26T18:00:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 Processor -- start 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 -- start start 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1aea20 con 0x5621e85b84f0 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1ac2c0 con 0x5621e85a8e00 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf069e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1aa110 con 0x5621e85a9720 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52280/0 (socket says 172.21.15.92:52280) 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 -- 172.21.15.92:0/3001234502 learned_addr learned my addr 172.21.15.92:0/3001234502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 -- 172.21.15.92:0/3001234502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 msgr2=0x5621e85a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 -- 172.21.15.92:0/3001234502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 msgr2=0x5621e85c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 -- 172.21.15.92:0/3001234502 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621e85a5240 con 0x5621e85b84f0 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.748+0000 7fcf02265640 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcef4004af0 tx=0x7fcef4003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d1b2a5450e967 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcee77fe640 1 -- 172.21.15.92:0/3001234502 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef404d040 con 0x5621e85b84f0 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcee77fe640 1 -- 172.21.15.92:0/3001234502 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef4036070 con 0x5621e85b84f0 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcee77fe640 1 -- 172.21.15.92:0/3001234502 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40309c0 con 0x5621e85b84f0 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 -- 172.21.15.92:0/3001234502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 msgr2=0x5621e85d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcef4004af0 tx=0x7fcef4003f40 comp rx=0 tx=0).stop 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 -- 172.21.15.92:0/3001234502 shutdown_connections 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85b84f0 0x5621e85d0460 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85a9720 0x5621e85a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3001234502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 -- 172.21.15.92:0/3001234502 >> 172.21.15.92:0/3001234502 conn(0x5621e85a5410 msgr2=0x5621e85a3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 -- 172.21.15.92:0/3001234502 shutdown_connections 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.749+0000 7fcf069e3740 1 -- 172.21.15.92:0/3001234502 wait complete. 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 -- start start 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 Processor -- start 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1aa780 con 0x5621e85a9720 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1abbf0 con 0x5621e85a8e00 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1aae50 con 0x5621e85b84f0 2024-04-26T18:00:45.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf069e3740 10 client.0 _ll_register_callbacks cb 0x7fcef800e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52288/0 (socket says 172.21.15.92:52288) 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 -- 172.21.15.92:0/3387275011 learned_addr learned my addr 172.21.15.92:0/3387275011 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf02265640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 -- 172.21.15.92:0/3387275011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 msgr2=0x5621e85bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 -- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 msgr2=0x5621e85bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 -- 172.21.15.92:0/3387275011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621e862df20 con 0x5621e85a9720 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:45.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf02265640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcf01263640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fceec098d50 tx=0x7fceec018ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372c25a88a08d819 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.750+0000 7fcee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0b5060 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fceec0bb200 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcef4036070 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fceec015030 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 10 client.15414 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5621e862f210 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef4036070 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fceec018b40 con 0x5621e85a9720 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 10 client.15414 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 10 client.15414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:45.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 20 client.15414 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e862f9a0 0x5621e8631dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 4 client.15414 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5621e8516ee0 con 0x5621e862f9a0 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.751+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e862f9a0 0x5621e8631dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.752+0000 7fcee57fa640 10 client.15414 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.752+0000 7fcf01a64640 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e862f9a0 0x5621e8631dc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf4ce85e4761a57 server_cookie=a19a2479973b6a93 in_seq=0 out_seq=0 2024-04-26T18:00:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcee57fa640 1 -- 172.21.15.92:0/3387275011 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621e8516ee0 con 0x5621e862f9a0 2024-04-26T18:00:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcee57fa640 10 client.15414 handle_command_reply: tid=0 2024-04-26T18:00:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 client.15414 shutdown 2024-04-26T18:00:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 msgr2=0x5621e85bc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fceec098d50 tx=0x7fceec018ad0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 shutdown_connections 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5621e862f9a0 0x5621e8631dc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5621e85b84f0 0x5621e85bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcee57fa640 0 client.15414 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621e85a9720 0x5621e85bc620 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 --2- 172.21.15.92:0/3387275011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5621e85a8e00 0x5621e85bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.782+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 >> 172.21.15.92:0/3387275011 conn(0x5621e85a5410 msgr2=0x5621e85a45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 shutdown_connections 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf069e3740 1 -- 172.21.15.92:0/3387275011 wait complete. 2024-04-26T18:00:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf069e3740 20 client.15414 trim_cache size 0 max 16384 2024-04-26T18:00:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:00:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:00:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:00:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 msgr2=0x7fcee80a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 0x7fcee80a63a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcef4035000 tx=0x7fcef4048000 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 msgr2=0x7fcefc19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d770 tx=0x7fceec00dc30 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 shutdown_connections 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcee80a3ee0 0x7fcee80a63a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcefc107820 0x7fcefc1a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcefc102220 0x7fcefc19a440 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 --2- 172.21.15.92:0/4242782264 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcefc101860 0x7fcefc199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 >> 172.21.15.92:0/4242782264 conn(0x7fcefc0789b0 msgr2=0x7fcefc104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 shutdown_connections 2024-04-26T18:00:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:45.783+0000 7fcf03cc8640 1 -- 172.21.15.92:0/4242782264 wait complete. 2024-04-26T18:00:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:47 smithi092 ceph-mon[29156]: pgmap v37: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 13 MiB/s wr, 474 op/s 2024-04-26T18:00:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:47 smithi189 ceph-mon[32756]: pgmap v37: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 13 MiB/s wr, 474 op/s 2024-04-26T18:00:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:47 smithi156 ceph-mon[32679]: pgmap v37: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 13 MiB/s wr, 474 op/s 2024-04-26T18:00:48.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 35.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:00:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:49 smithi092 ceph-mon[29156]: pgmap v38: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 295 op/s 2024-04-26T18:00:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:49 smithi189 ceph-mon[32756]: pgmap v38: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 295 op/s 2024-04-26T18:00:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:49 smithi156 ceph-mon[32679]: pgmap v38: 97 pgs: 97 active+clean; 1006 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 11 MiB/s wr, 295 op/s 2024-04-26T18:00:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:51 smithi092 ceph-mon[29156]: pgmap v39: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 13 MiB/s wr, 324 op/s 2024-04-26T18:00:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:51 smithi189 ceph-mon[32756]: pgmap v39: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 13 MiB/s wr, 324 op/s 2024-04-26T18:00:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:51 smithi156 ceph-mon[32679]: pgmap v39: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 13 MiB/s wr, 324 op/s 2024-04-26T18:00:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 40.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:00:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:53 smithi189 ceph-mon[32756]: pgmap v40: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 132 op/s 2024-04-26T18:00:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:53 smithi156 ceph-mon[32679]: pgmap v40: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 132 op/s 2024-04-26T18:00:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:53 smithi092 ceph-mon[29156]: pgmap v40: 97 pgs: 97 active+clean; 1019 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 132 op/s 2024-04-26T18:00:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:55 smithi189 ceph-mon[32756]: pgmap v41: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 135 op/s 2024-04-26T18:00:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:55 smithi156 ceph-mon[32679]: pgmap v41: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 135 op/s 2024-04-26T18:00:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:55 smithi092 ceph-mon[29156]: pgmap v41: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 135 op/s 2024-04-26T18:00:57.545 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:57 smithi092 ceph-mon[29156]: pgmap v42: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.8 MiB/s wr, 70 op/s 2024-04-26T18:00:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:57 smithi189 ceph-mon[32756]: pgmap v42: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.8 MiB/s wr, 70 op/s 2024-04-26T18:00:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:57 smithi156 ceph-mon[32679]: pgmap v42: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.8 MiB/s wr, 70 op/s 2024-04-26T18:00:58.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 45.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:00:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.877+0000 7fd350809640 1 -- 172.21.15.92:0/2936294844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 msgr2=0x7fd34c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.877+0000 7fd350809640 1 --2- 172.21.15.92:0/2936294844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c103fc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009900 tx=0x7fd33c02a480 comp rx=0 tx=0).stop 2024-04-26T18:00:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 -- 172.21.15.92:0/2936294844 shutdown_connections 2024-04-26T18:00:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 --2- 172.21.15.92:0/2936294844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c10cfb0 0x7fd34c10f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 --2- 172.21.15.92:0/2936294844 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c104500 0x7fd34c10c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 --2- 172.21.15.92:0/2936294844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c103fc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 -- 172.21.15.92:0/2936294844 >> 172.21.15.92:0/2936294844 conn(0x7fd34c077bb0 msgr2=0x7fd34c077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 -- 172.21.15.92:0/2936294844 shutdown_connections 2024-04-26T18:00:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 -- 172.21.15.92:0/2936294844 wait complete. 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 Processor -- start 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.878+0000 7fd350809640 1 -- start start 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c104500 0x7fd34c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 0x7fd34c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c112c50 con 0x7fd34c103be0 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c112ad0 con 0x7fd34c104500 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c112dd0 con 0x7fd34c10cfb0 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56462/0 (socket says 172.21.15.92:56462) 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 -- 172.21.15.92:0/2992344220 learned_addr learned my addr 172.21.15.92:0/2992344220 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd349d9b640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c104500 0x7fd34c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 0x7fd34c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 -- 172.21.15.92:0/2992344220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 msgr2=0x7fd34c19d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 0x7fd34c19d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 -- 172.21.15.92:0/2992344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c104500 msgr2=0x7fd34c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c104500 0x7fd34c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 -- 172.21.15.92:0/2992344220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34c19e0e0 con 0x7fd34c103be0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 0x7fd34c19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd34a59c640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd33c005940 tx=0x7fd33c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd33b7fe640 1 -- 172.21.15.92:0/2992344220 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c03f030 con 0x7fd34c103be0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34c19e370 con 0x7fd34c103be0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd33b7fe640 1 -- 172.21.15.92:0/2992344220 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33c003cb0 con 0x7fd34c103be0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd33b7fe640 1 -- 172.21.15.92:0/2992344220 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c035070 con 0x7fd34c103be0 2024-04-26T18:00:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.879+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd34c1a5c60 con 0x7fd34c103be0 2024-04-26T18:00:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd33b7fe640 1 -- 172.21.15.92:0/2992344220 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fd33c042030 con 0x7fd34c103be0 2024-04-26T18:00:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 Processor -- start 2024-04-26T18:00:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 -- start start 2024-04-26T18:00:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07563c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d0756494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0755a2460 con 0x55d07563c820 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d07555c590 con 0x55d07563bf00 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd3535fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d07559e420 con 0x55d0756470e0 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.882+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56476/0 (socket says 172.21.15.92:56476) 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 -- 172.21.15.92:0/3626043948 learned_addr learned my addr 172.21.15.92:0/3626043948 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd33b7fe640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 0x7fd3340a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd349d9b640 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d0756494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07563c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 0x7fd3340a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 -- 172.21.15.92:0/3626043948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 msgr2=0x55d0756494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d0756494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 -- 172.21.15.92:0/3626043948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 msgr2=0x55d07563c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07563c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 -- 172.21.15.92:0/3626043948 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0755690d0 con 0x55d07563c820 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd33b7fe640 1 -- 172.21.15.92:0/2992344220 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd33c0f1270 con 0x7fd34c103be0 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34a59c640 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ee940 tx=0x7fd33c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70082fee92e6a19a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 0x7fd3340a63a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd344009270 tx=0x7fd344005bd0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd338ff9640 1 -- 172.21.15.92:0/3626043948 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c049070 con 0x55d07563c820 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd338ff9640 1 -- 172.21.15.92:0/3626043948 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33c03b460 con 0x55d07563c820 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.883+0000 7fd338ff9640 1 -- 172.21.15.92:0/3626043948 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0bd800 con 0x55d07563c820 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- 172.21.15.92:0/3626043948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 msgr2=0x55d075646ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ee940 tx=0x7fd33c02a480 comp rx=0 tx=0).stop 2024-04-26T18:00:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- 172.21.15.92:0/3626043948 shutdown_connections 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d0756494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d075646ba0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 --2- 172.21.15.92:0/3626043948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07563c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- 172.21.15.92:0/3626043948 >> 172.21.15.92:0/3626043948 conn(0x55d075638410 msgr2=0x55d0756387f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- 172.21.15.92:0/3626043948 shutdown_connections 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- 172.21.15.92:0/3626043948 wait complete. 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.884+0000 7fd3535fe740 1 -- start start 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 Processor -- start 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d075644520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075644a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d075649ad0 con 0x55d07563bf00 2024-04-26T18:00:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d075529b60 con 0x55d0756470e0 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d075649c50 con 0x55d07563c820 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd3535fe740 10 client.0 _ll_register_callbacks cb 0x55d07554e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56492/0 (socket says 172.21.15.92:56492) 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 -- 172.21.15.92:0/1675051069 learned_addr learned my addr 172.21.15.92:0/1675051069 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd349d9b640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d075644520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 -- 172.21.15.92:0/1675051069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 msgr2=0x55d075644520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d075644520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 -- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 msgr2=0x55d075644a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075644a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 -- 172.21.15.92:0/1675051069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0752b4210 con 0x55d07563bf00 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ef030 tx=0x7fd33c0b99a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d366789d8b5adf5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.885+0000 7fd331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c049040 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd33c0bd570 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0755b0070 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd33c0bd800 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 10 client.15426 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d075380620 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d0755b0070 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fd33c0c58e0 con 0x55d07563bf00 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 10 client.15426 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 10 client.15426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 20 client.15426 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d075656d80 0x55d075659190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 4 client.15426 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:58.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.886+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0755a9ee0 con 0x55d075656d80 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.887+0000 7fd349d9b640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d075656d80 0x55d075659190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.887+0000 7fd349d9b640 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d075656d80 0x55d075659190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460a63438fced2c server_cookie=287a664dd5bbe7b8 in_seq=0 out_seq=0 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.887+0000 7fd331ffb640 10 client.15426 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd331ffb640 1 -- 172.21.15.92:0/1675051069 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0755a9ee0 con 0x55d075656d80 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd331ffb640 10 client.15426 handle_command_reply: tid=0 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 client.15426 shutdown 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 msgr2=0x55d075643fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0ef030 tx=0x7fd33c0b99a0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 shutdown_connections 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d075656d80 0x55d075659190 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075644a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d075644520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd331ffb640 0 client.15426 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1675051069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075643fe0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 >> 172.21.15.92:0/1675051069 conn(0x55d075638410 msgr2=0x55d07563e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 shutdown_connections 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 1 -- 172.21.15.92:0/1675051069 wait complete. 2024-04-26T18:00:58.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.888+0000 7fd3535fe740 20 client.15426 trim_cache size 0 max 16384 2024-04-26T18:00:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 Processor -- start 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 -- start start 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d07563e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075637430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1b0cb0 con 0x55d07563bf00 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1ae550 con 0x55d0756470e0 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd3535fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1ac3a0 con 0x55d07563c820 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56504/0 (socket says 172.21.15.92:56504) 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 -- 172.21.15.92:0/1773950749 learned_addr learned my addr 172.21.15.92:0/1773950749 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075637430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 -- 172.21.15.92:0/1773950749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 msgr2=0x55d07563e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d07563e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 -- 172.21.15.92:0/1773950749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 msgr2=0x55d075637430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075637430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34a59c640 1 -- 172.21.15.92:0/1773950749 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07563c650 con 0x55d07563bf00 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.903+0000 7fd34ad9d640 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075637430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd34a59c640 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b9510 tx=0x7fd33c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e15c7907775d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd333fff640 1 -- 172.21.15.92:0/1773950749 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c049040 con 0x55d07563bf00 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd333fff640 1 -- 172.21.15.92:0/1773950749 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33c0f0040 con 0x55d07563bf00 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd333fff640 1 -- 172.21.15.92:0/1773950749 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0c58e0 con 0x55d07563bf00 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 -- 172.21.15.92:0/1773950749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 msgr2=0x55d075652900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd33c0b9510 tx=0x7fd33c02a480 comp rx=0 tx=0).stop 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 -- 172.21.15.92:0/1773950749 shutdown_connections 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0756470e0 0x55d075637430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d07563c820 0x55d07563e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 --2- 172.21.15.92:0/1773950749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563bf00 0x55d075652900 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 -- 172.21.15.92:0/1773950749 >> 172.21.15.92:0/1773950749 conn(0x55d075638410 msgr2=0x55d075636d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 -- 172.21.15.92:0/1773950749 shutdown_connections 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.904+0000 7fd3535fe740 1 -- 172.21.15.92:0/1773950749 wait complete. 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 -- start start 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 Processor -- start 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07564f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d075640e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1aca10 con 0x55d07563c820 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1ade80 con 0x55d07563bf00 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd34c1ad0e0 con 0x55d0756470e0 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd3535fe740 10 client.0 _ll_register_callbacks cb 0x7fd33c0bcc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56520/0 (socket says 172.21.15.92:56520) 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 -- 172.21.15.92:0/4272502047 learned_addr learned my addr 172.21.15.92:0/4272502047 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd34a59c640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07564f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 -- 172.21.15.92:0/4272502047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 msgr2=0x55d075640e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d075640e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 -- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 msgr2=0x55d07564f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07564f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 -- 172.21.15.92:0/4272502047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0756415e0 con 0x55d07563c820 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd349d9b640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d075639830 tx=0x7fd34001cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ac0582588bb1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.905+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340016a90 con 0x55d07563c820 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd34000f040 con 0x55d07563c820 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd33c0f0040 con 0x55d07563c820 2024-04-26T18:00:58.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd34002c050 con 0x55d07563c820 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 10 client.15432 fetch_fsmap learned FSMap version 29 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0756bd2c0 con 0x55d07563c820 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33c0f0040 con 0x55d07563c820 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fd340024430 con 0x55d07563c820 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 10 client.15432 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 10 client.15432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 20 client.15432 populate_metadata read hostname 'smithi092' 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0756bda80 0x55d0756bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 4 client.15432 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0755255f0 con 0x55d0756bda80 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.906+0000 7fd34a59c640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0756bda80 0x55d0756bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.907+0000 7fd34a59c640 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0756bda80 0x55d0756bfea0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd163a65a886436 server_cookie=3d30d8eb2f1ff8a4 in_seq=0 out_seq=0 2024-04-26T18:00:58.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.907+0000 7fd331ffb640 10 client.15432 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd331ffb640 1 -- 172.21.15.92:0/4272502047 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0755255f0 con 0x55d0756bda80 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd331ffb640 10 client.15432 handle_command_reply: tid=0 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 client.15432 shutdown 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 msgr2=0x55d0756408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d075639830 tx=0x7fd34001cf20 comp rx=0 tx=0).stop 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 shutdown_connections 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0756bda80 0x55d0756bfea0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0756470e0 0x55d075640e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d07563c820 0x55d0756408d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd331ffb640 0 client.15432 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 --2- 172.21.15.92:0/4272502047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d07563bf00 0x55d07564f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 >> 172.21.15.92:0/4272502047 conn(0x55d075638410 msgr2=0x55d0756375b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 shutdown_connections 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 1 -- 172.21.15.92:0/4272502047 wait complete. 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.921+0000 7fd3535fe740 20 client.15432 trim_cache size 0 max 16384 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:00:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 msgr2=0x7fd3340a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 0x7fd3340a63a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd344009270 tx=0x7fd344005bd0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 msgr2=0x7fd34c1990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd33c005940 tx=0x7fd33c0042f0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 shutdown_connections 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd3340a3ee0 0x7fd3340a63a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd34c10cfb0 0x7fd34c19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c104500 0x7fd34c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 --2- 172.21.15.92:0/2992344220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd34c103be0 0x7fd34c1990f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 >> 172.21.15.92:0/2992344220 conn(0x7fd34c077bb0 msgr2=0x7fd34c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 shutdown_connections 2024-04-26T18:00:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:00:58.922+0000 7fd350809640 1 -- 172.21.15.92:0/2992344220 wait complete. 2024-04-26T18:00:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:00:59 smithi189 ceph-mon[32756]: pgmap v43: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.8 MiB/s wr, 33 op/s 2024-04-26T18:00:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:00:59 smithi156 ceph-mon[32679]: pgmap v43: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.8 MiB/s wr, 33 op/s 2024-04-26T18:00:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:00:59 smithi092 ceph-mon[29156]: pgmap v43: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.8 MiB/s wr, 33 op/s 2024-04-26T18:01:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:01 smithi156 ceph-mon[32679]: pgmap v44: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-04-26T18:01:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:01 smithi189 ceph-mon[32756]: pgmap v44: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-04-26T18:01:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:01 smithi092 ceph-mon[29156]: pgmap v44: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 36 op/s 2024-04-26T18:01:03.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:03 smithi189 ceph-mon[32756]: pgmap v45: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-04-26T18:01:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:03 smithi156 ceph-mon[32679]: pgmap v45: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-04-26T18:01:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:03 smithi092 ceph-mon[29156]: pgmap v45: 97 pgs: 97 active+clean; 958 MiB data, 1023 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-04-26T18:01:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:05 smithi189 ceph-mon[32756]: pgmap v46: 97 pgs: 97 active+clean; 959 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 130 op/s 2024-04-26T18:01:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:05 smithi156 ceph-mon[32679]: pgmap v46: 97 pgs: 97 active+clean; 959 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 130 op/s 2024-04-26T18:01:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:05 smithi092 ceph-mon[29156]: pgmap v46: 97 pgs: 97 active+clean; 959 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 130 op/s 2024-04-26T18:01:06.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:01:06.728 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:07 smithi092 ceph-mon[29156]: pgmap v47: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 195 op/s 2024-04-26T18:01:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:07 smithi189 ceph-mon[32756]: pgmap v47: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 195 op/s 2024-04-26T18:01:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:07 smithi156 ceph-mon[32679]: pgmap v47: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 195 op/s 2024-04-26T18:01:08.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 55.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.555+0000 7fe14ceb6700 1 -- 172.21.15.92:0/3670317278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 msgr2=0x7fe148103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.555+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/3670317278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe148103960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe138009990 tx=0x7fe138009ca0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 -- 172.21.15.92:0/3670317278 shutdown_connections 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/3670317278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/3670317278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe1481102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/3670317278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe148103960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.556 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 -- 172.21.15.92:0/3670317278 >> 172.21.15.92:0/3670317278 conn(0x7fe14807a5e0 msgr2=0x7fe14807a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:08.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 -- 172.21.15.92:0/3670317278 shutdown_connections 2024-04-26T18:01:08.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 -- 172.21.15.92:0/3670317278 wait complete. 2024-04-26T18:01:08.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 Processor -- start 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.556+0000 7fe14ceb6700 1 -- start start 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe14819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe148113690 con 0x7fe1481034e0 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe148113510 con 0x7fe148109480 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe148113810 con 0x7fe148103ea0 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58860/0 (socket says 172.21.15.92:58860) 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 -- 172.21.15.92:0/1363261610 learned_addr learned my addr 172.21.15.92:0/1363261610 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe146d9d700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:08.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe145d9b700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe14819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 -- 172.21.15.92:0/1363261610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 msgr2=0x7fe14819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe14819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 -- 172.21.15.92:0/1363261610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 msgr2=0x7fe148199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 -- 172.21.15.92:0/1363261610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14819a1b0 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe145d9b700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe14819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe146d9d700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14659c700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b530 tx=0x7fe13c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c015020 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14819a4a0 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe13c011ce0 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe13c010d20 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.557+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481a6760 con 0x7fe1481034e0 2024-04-26T18:01:08.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.558+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe148104b30 con 0x7fe1481034e0 2024-04-26T18:01:08.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.559+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 24) ==== 138879+0+0 (secure 0 0 0) 0x7fe13c018020 con 0x7fe1481034e0 2024-04-26T18:01:08.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.560+0000 7fe1377fe700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 0x7fe1300a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:08.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.560+0000 7fe145d9b700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 0x7fe1300a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:08.561 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.560+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fe13c0d0180 con 0x7fe1481034e0 2024-04-26T18:01:08.562 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.560+0000 7fe145d9b700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 0x7fe1300a6390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe138006010 tx=0x7fe13800b540 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:08.565 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.565+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe13c01f020 con 0x7fe1481034e0 2024-04-26T18:01:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.814+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe14819af80 con 0x7fe1481034e0 2024-04-26T18:01:08.815 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.815+0000 7fe1377fe700 1 -- 172.21.15.92:0/1363261610 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11887 (secure 0 0 0) 0x7fe13c09c750 con 0x7fe1481034e0 2024-04-26T18:01:08.816 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:01:08.816 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:00:22.436646+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 msgr2=0x7fe1300a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 0x7fe1300a6390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe138006010 tx=0x7fe13800b540 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 msgr2=0x7fe14819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe13c00b530 tx=0x7fe13c00b8f0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 shutdown_connections 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe1300a3ed0 0x7fe1300a6390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe148109480 0x7fe148199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1481034e0 0x7fe14819f890 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 --2- 172.21.15.92:0/1363261610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe148103ea0 0x7fe14819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 >> 172.21.15.92:0/1363261610 conn(0x7fe14807a5e0 msgr2=0x7fe148101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:08.818 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.817+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 shutdown_connections 2024-04-26T18:01:08.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:08.818+0000 7fe14ceb6700 1 -- 172.21.15.92:0/1363261610 wait complete. 2024-04-26T18:01:08.819 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-04-26T18:01:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:09 smithi092 ceph-mon[29156]: pgmap v48: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 193 op/s 2024-04-26T18:01:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:09 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/1363261610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:09.565 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db --set-id 9cc381f7 --release --await' 2024-04-26T18:01:09.565 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db --set-id 9cc381f7 --release --await 2024-04-26T18:01:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:09 smithi189 ceph-mon[32756]: pgmap v48: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 193 op/s 2024-04-26T18:01:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:09 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/1363261610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:09 smithi156 ceph-mon[32679]: pgmap v48: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 193 op/s 2024-04-26T18:01:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:09 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/1363261610' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:09.815 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:11.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 -- 172.21.15.92:0/2547842195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc103ea0 msgr2=0x7f49cc1102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 --2- 172.21.15.92:0/2547842195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc103ea0 0x7f49cc1102c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f49c400b0a0 tx=0x7f49c400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 -- 172.21.15.92:0/2547842195 shutdown_connections 2024-04-26T18:01:11.537 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 --2- 172.21.15.92:0/2547842195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc109480 0x7f49cc109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 --2- 172.21.15.92:0/2547842195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc103ea0 0x7f49cc1102c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 --2- 172.21.15.92:0/2547842195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1034e0 0x7f49cc103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 -- 172.21.15.92:0/2547842195 >> 172.21.15.92:0/2547842195 conn(0x7f49cc07a5e0 msgr2=0x7f49cc07a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 -- 172.21.15.92:0/2547842195 shutdown_connections 2024-04-26T18:01:11.538 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.536+0000 7f49d1e84700 1 -- 172.21.15.92:0/2547842195 wait complete. 2024-04-26T18:01:11.538 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:11 smithi092 ceph-mon[29156]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 197 op/s 2024-04-26T18:01:11.538 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:11 smithi092 ceph-mon[29156]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.537+0000 7f49d1e84700 1 Processor -- start 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.537+0000 7f49d1e84700 1 -- start start 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.537+0000 7f49d1e84700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc103ea0 0x7f49cc075c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 0x7f49cc0761a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1135c0 con 0x7f49cc1034e0 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc113440 con 0x7f49cc103ea0 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc113740 con 0x7f49cc109480 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58882/0 (socket says 172.21.15.92:58882) 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 -- 172.21.15.92:0/164499758 learned_addr learned my addr 172.21.15.92:0/164499758 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49caffd700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc103ea0 0x7f49cc075c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cbfff700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 0x7f49cc0761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 -- 172.21.15.92:0/164499758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 msgr2=0x7f49cc0761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 0x7f49cc0761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 -- 172.21.15.92:0/164499758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc103ea0 msgr2=0x7f49cc075c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc103ea0 0x7f49cc075c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 -- 172.21.15.92:0/164499758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc1a7ef0 con 0x7f49cc1034e0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cbfff700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 0x7f49cc0761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c9b0 tx=0x7f49bc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49c8ff9700 1 -- 172.21.15.92:0/164499758 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc007b00 con 0x7f49cc1034e0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc1a81e0 con 0x7f49cc1034e0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49c8ff9700 1 -- 172.21.15.92:0/164499758 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49bc007ca0 con 0x7f49cc1034e0 2024-04-26T18:01:11.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.538+0000 7f49c8ff9700 1 -- 172.21.15.92:0/164499758 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc018660 con 0x7f49cc1034e0 2024-04-26T18:01:11.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.539+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc1a8770 con 0x7f49cc1034e0 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.541+0000 7f49c8ff9700 1 -- 172.21.15.92:0/164499758 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f49bc00f450 con 0x7f49cc1034e0 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.541+0000 7f49c8ff9700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 0x7f49b40a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.541+0000 7f49caffd700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 0x7f49b40a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.541+0000 7f49c8ff9700 1 -- 172.21.15.92:0/164499758 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f49bc0d06e0 con 0x7f49cc1034e0 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.542+0000 7f49caffd700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 0x7f49b40a62f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49cc07ab50 tx=0x7f49c000b3c0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.542+0000 7f49dc716b80 1 Processor -- start 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.542+0000 7f49dc716b80 1 -- start start 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe35250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.544 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfd87930 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfceda30 con 0x55d4bfe35870 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49dc716b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfd838f0 con 0x55d4bfe3aea0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46138/0 (socket says 172.21.15.92:46138) 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 -- 172.21.15.92:0/2308663616 learned_addr learned my addr 172.21.15.92:0/2308663616 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49caffd700 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe35250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 -- 172.21.15.92:0/2308663616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 msgr2=0x55d4bfe3b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 -- 172.21.15.92:0/2308663616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 msgr2=0x55d4bfe35250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe35250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 -- 172.21.15.92:0/2308663616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4bfcd49d0 con 0x55d4bfe35870 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.543+0000 7f49cbfff700 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006130 tx=0x7f49c40090d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efb79799bda926e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.545 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49b1ffb700 1 -- 172.21.15.92:0/2308663616 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4020030 con 0x55d4bfe35870 2024-04-26T18:01:11.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49b1ffb700 1 -- 172.21.15.92:0/2308663616 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c40092c0 con 0x55d4bfe35870 2024-04-26T18:01:11.546 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49b1ffb700 1 -- 172.21.15.92:0/2308663616 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4007df0 con 0x55d4bfe35870 2024-04-26T18:01:11.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 -- 172.21.15.92:0/2308663616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 msgr2=0x55d4bfe35cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.549 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006130 tx=0x7f49c40090d0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 -- 172.21.15.92:0/2308663616 shutdown_connections 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35cd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 --2- 172.21.15.92:0/2308663616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe35250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 -- 172.21.15.92:0/2308663616 >> 172.21.15.92:0/2308663616 conn(0x55d4bfd636c0 msgr2=0x55d4bfe30000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.544+0000 7f49dc716b80 1 -- 172.21.15.92:0/2308663616 shutdown_connections 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 -- 172.21.15.92:0/2308663616 wait complete. 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 -- start start 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 Processor -- start 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe3ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.550 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfe421d0 con 0x55d4bfe35870 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfd41b80 con 0x55d4bfe3aea0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d4bfe42350 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.545+0000 7f49dc716b80 10 client.0 _ll_register_callbacks cb 0x55d4bfd1fa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cb7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58892/0 (socket says 172.21.15.92:58892) 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cb7fe700 1 -- 172.21.15.92:0/754986000 learned_addr learned my addr 172.21.15.92:0/754986000 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe3ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49caffd700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 -- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe3aea0 msgr2=0x55d4bfe3e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 -- 172.21.15.92:0/754986000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 msgr2=0x55d4bfe41400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 -- 172.21.15.92:0/754986000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4bfd45580 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.551 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49cbfff700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe3ece0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d010 tx=0x7f49c4004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7451ca6b7c09e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c402b070 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c40092c0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f49c40079f0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49c4037050 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49dc716b80 10 client.24967 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.546+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d4bfe421d0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c40092c0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f49c4011070 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 10 client.24967 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 10 client.24967 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 20 client.24967 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:11.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfe4ec80 0x55d4bfe51070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 4 client.24967 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4bfd95310 con 0x55d4bfe4ec80 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.547+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfe4ec80 0x55d4bfe51070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.548+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfe4ec80 0x55d4bfe51070 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c20371bdd840311 server_cookie=5f72b79ecb20d977 in_seq=0 out_seq=0 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.548+0000 7f49aaffd700 10 client.24967 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.548+0000 7f49aaffd700 1 -- 172.21.15.92:0/754986000 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d4bfd95310 con 0x55d4bfe4ec80 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.548+0000 7f49aaffd700 10 client.24967 handle_command_reply: tid=0 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.548+0000 7f49dc716b80 1 client.24967 shutdown 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 msgr2=0x55d4bfe3ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe3ece0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d010 tx=0x7f49c4004d00 comp rx=0 tx=0).stop 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 shutdown_connections 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfe4ec80 0x55d4bfe51070 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe3ece0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe35870 0x55d4bfe41400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49aaffd700 0 client.24967 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 --2- 172.21.15.92:0/754986000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe3e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 >> 172.21.15.92:0/754986000 conn(0x55d4bfd636c0 msgr2=0x55d4bfe34240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 shutdown_connections 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 1 -- 172.21.15.92:0/754986000 wait complete. 2024-04-26T18:01:11.554 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.549+0000 7f49dc716b80 20 client.24967 trim_cache size 0 max 16384 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 Processor -- start 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 -- start start 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe4b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.570 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1b2480 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1afce0 con 0x55d4bfe35870 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49dc716b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1adb70 con 0x55d4bfe3aea0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58906/0 (socket says 172.21.15.92:58906) 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49cbfff700 1 -- 172.21.15.92:0/3255420692 learned_addr learned my addr 172.21.15.92:0/3255420692 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.568+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49caffd700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe4b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 -- 172.21.15.92:0/3255420692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 msgr2=0x55d4bfe4b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe4b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 -- 172.21.15.92:0/3255420692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 msgr2=0x55d4bfe35250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 -- 172.21.15.92:0/3255420692 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4bfe2c7f0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49cbfff700 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009690 tx=0x7f49c400b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea267ac6dff714d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49b17fa700 1 -- 172.21.15.92:0/3255420692 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c402b040 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49b17fa700 1 -- 172.21.15.92:0/3255420692 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c4025910 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.569+0000 7f49b17fa700 1 -- 172.21.15.92:0/3255420692 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4020040 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- 172.21.15.92:0/3255420692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 msgr2=0x55d4bfe29d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009690 tx=0x7f49c400b060 comp rx=0 tx=0).stop 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- 172.21.15.92:0/3255420692 shutdown_connections 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe35250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe29d80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- 172.21.15.92:0/3255420692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe4b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- 172.21.15.92:0/3255420692 >> 172.21.15.92:0/3255420692 conn(0x55d4bfd636c0 msgr2=0x55d4bfe29670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- 172.21.15.92:0/3255420692 shutdown_connections 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- 172.21.15.92:0/3255420692 wait complete. 2024-04-26T18:01:11.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- start start 2024-04-26T18:01:11.573 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 Processor -- start 2024-04-26T18:01:11.578 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1ae1c0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1af610 con 0x55d4bfe35870 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1ae870 con 0x55d4bfe3aea0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.570+0000 7f49dc716b80 10 client.0 _ll_register_callbacks cb 0x55d4bfd1fa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58916/0 (socket says 172.21.15.92:58916) 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 -- 172.21.15.92:0/1271787193 learned_addr learned my addr 172.21.15.92:0/1271787193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49caffd700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 -- 172.21.15.92:0/1271787193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 msgr2=0x55d4bfe445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 -- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 msgr2=0x55d4bfe477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 -- 172.21.15.92:0/1271787193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4bfe45160 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49cbfff700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d010 tx=0x7f49c4025710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97625d04180a55fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4020070 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c4025910 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f49c4007a30 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f49c4049050 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49dc716b80 10 client.15456 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.571+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d4bfeb5ec0 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c4025910 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f49c4011070 con 0x55d4bfe3b7c0 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 10 client.15456 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 10 client.15456 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 20 client.15456 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfeb6500 0x55d4bfeb8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 4 client.15456 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9cc381f7", "release": true, "await": true}] 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9cc381f7", "release": true, "await": true}) -- 0x55d4bfd8f3b0 con 0x55d4bfeb6500 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfeb6500 0x55d4bfeb8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49aaffd700 10 client.15456 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:11.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.572+0000 7f49cb7fe700 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfeb6500 0x55d4bfeb8920 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf204f68c8356e9 server_cookie=16305b1028941caf in_seq=0 out_seq=0 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49aaffd700 1 -- 172.21.15.92:0/1271787193 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d4bfd8f3b0 con 0x55d4bfeb6500 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49aaffd700 10 client.15456 handle_command_reply: tid=0 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 client.15456 shutdown 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 msgr2=0x55d4bfe44b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f49c400d010 tx=0x7f49c4025710 comp rx=0 tx=0).stop 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 shutdown_connections 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d4bfeb6500 0x55d4bfeb8920 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.620 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d4bfe35870 0x55d4bfe477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49aaffd700 0 client.15456 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4bfe3b7c0 0x55d4bfe44b20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 --2- 172.21.15.92:0/1271787193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d4bfe3aea0 0x55d4bfe445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 >> 172.21.15.92:0/1271787193 conn(0x55d4bfd636c0 msgr2=0x55d4bfe29f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 shutdown_connections 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.619+0000 7f49dc716b80 1 -- 172.21.15.92:0/1271787193 wait complete. 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.620+0000 7f49dc716b80 20 client.15456 trim_cache size 0 max 16384 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-04-26T18:01:11.621 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 4, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "9cc381f7": { 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 4, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 90.0, 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:01:11.622 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:11.623 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.620+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 msgr2=0x7f49b40a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.620+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 0x7f49b40a62f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f49cc07ab50 tx=0x7f49c000b3c0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.620+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 msgr2=0x7f49cc075720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.620+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00c9b0 tx=0x7f49bc00ccc0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 shutdown_connections 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f49b40a3e30 0x7f49b40a62f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc109480 0x7f49cc0761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49cc1034e0 0x7f49cc075720 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 --2- 172.21.15.92:0/164499758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49cc103ea0 0x7f49cc075c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:11.624 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 >> 172.21.15.92:0/164499758 conn(0x7f49cc07a5e0 msgr2=0x7f49cc101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 shutdown_connections 2024-04-26T18:01:11.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:11.621+0000 7f49d1e84700 1 -- 172.21.15.92:0/164499758 wait complete. 2024-04-26T18:01:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:11 smithi189 ceph-mon[32756]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 197 op/s 2024-04-26T18:01:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:11 smithi189 ceph-mon[32756]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T18:01:11.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:11 smithi156 ceph-mon[32679]: pgmap v49: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 197 op/s 2024-04-26T18:01:11.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:11 smithi156 ceph-mon[32679]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-04-26T18:01:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 -- 172.21.15.92:0/1773980327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4102910 msgr2=0x7f20f4102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/1773980327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4102910 0x7f20f4102d90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009930 tx=0x7f20e802a420 comp rx=0 tx=0).stop 2024-04-26T18:01:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 -- 172.21.15.92:0/1773980327 shutdown_connections 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/1773980327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/1773980327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4102910 0x7f20f4102d90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/1773980327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4108920 0x7f20f4108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 -- 172.21.15.92:0/1773980327 >> 172.21.15.92:0/1773980327 conn(0x7f20f40fe3e0 msgr2=0x7f20f4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 -- 172.21.15.92:0/1773980327 shutdown_connections 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.022+0000 7f20f9fa4640 1 -- 172.21.15.92:0/1773980327 wait complete. 2024-04-26T18:01:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.023+0000 7f20f9fa4640 1 Processor -- start 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.023+0000 7f20f9fa4640 1 -- start start 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 0x7f20f4074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f4075170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112bb0 con 0x7f20f4108920 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112a30 con 0x7f20f41032d0 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f9fa4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4112d30 con 0x7f20f4102910 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58944/0 (socket says 172.21.15.92:58944) 2024-04-26T18:01:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 -- 172.21.15.92:0/2250172079 learned_addr learned my addr 172.21.15.92:0/2250172079 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f4075170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f37fe640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 0x7f20f4074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 -- 172.21.15.92:0/2250172079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 msgr2=0x7f20f4074c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 0x7f20f4074c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 -- 172.21.15.92:0/2250172079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 msgr2=0x7f20f4075170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f4075170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f3fff640 1 -- 172.21.15.92:0/2250172079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41a7610 con 0x7f20f4108920 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f4075170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.024+0000 7f20f37fe640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 0x7f20f4074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f3fff640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00eb10 tx=0x7f20ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f0ff9640 1 -- 172.21.15.92:0/2250172079 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec004b20 con 0x7f20f4108920 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f0ff9640 1 -- 172.21.15.92:0/2250172079 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20ec004cc0 con 0x7f20f4108920 2024-04-26T18:01:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f0ff9640 1 -- 172.21.15.92:0/2250172079 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec010670 con 0x7f20f4108920 2024-04-26T18:01:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f41a7900 con 0x7f20f4108920 2024-04-26T18:01:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.025+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41a7dd0 con 0x7f20f4108920 2024-04-26T18:01:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.028+0000 7f20f0ff9640 1 -- 172.21.15.92:0/2250172079 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f20ec005020 con 0x7f20f4108920 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 Processor -- start 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 -- start start 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 0x5589a98ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589a9814460 con 0x5589a98b90e0 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5589a97ce590 con 0x5589a98ae820 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20fcd97740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5589a9810420 con 0x5589a98adf00 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f0ff9640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 0x7f20dc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 0x5589a98ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46186/0 (socket says 172.21.15.92:46186) 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 0x5589a98ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44990/0 (socket says 172.21.15.92:44990) 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 -- 172.21.15.92:0/3123810560 learned_addr learned my addr 172.21.15.92:0/3123810560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f3fff640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 0x7f20dc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f0ff9640 1 -- 172.21.15.92:0/2250172079 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f20ec0d0cd0 con 0x7f20f4108920 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 -- 172.21.15.92:0/3123810560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 msgr2=0x5589a98ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 0x5589a98ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 -- 172.21.15.92:0/3123810560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 msgr2=0x5589a98bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.029+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98bb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20f37fe640 1 -- 172.21.15.92:0/3123810560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a97db0d0 con 0x5589a98ae820 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20e40114f0 tx=0x7f20e40119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50c2bf91008ee78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20f3fff640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 0x7f20dc0a6300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ce540 tx=0x7f20ec087810 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20d9ffb640 1 -- 172.21.15.92:0/3123810560 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401e070 con 0x5589a98ae820 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20d9ffb640 1 -- 172.21.15.92:0/3123810560 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e400f9f0 con 0x5589a98ae820 2024-04-26T18:01:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.030+0000 7f20d9ffb640 1 -- 172.21.15.92:0/3123810560 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40199e0 con 0x5589a98ae820 2024-04-26T18:01:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 -- 172.21.15.92:0/3123810560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 msgr2=0x5589a98b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20e40114f0 tx=0x7f20e40119b0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 -- 172.21.15.92:0/3123810560 shutdown_connections 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b8ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3123810560 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98adf00 0x5589a98ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 -- 172.21.15.92:0/3123810560 >> 172.21.15.92:0/3123810560 conn(0x5589a98aa410 msgr2=0x5589a98aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 -- 172.21.15.92:0/3123810560 shutdown_connections 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.031+0000 7f20fcd97740 1 -- 172.21.15.92:0/3123810560 wait complete. 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 -- start start 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 Processor -- start 2024-04-26T18:01:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5589a98bbd10 con 0x5589a98adf00 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5589a979bb60 con 0x5589a98ae820 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5589a98bbe90 con 0x5589a98b90e0 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20fcd97740 10 client.0 _ll_register_callbacks cb 0x5589a97c02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.032+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58962/0 (socket says 172.21.15.92:58962) 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f2ffd640 1 -- 172.21.15.92:0/3479362881 learned_addr learned my addr 172.21.15.92:0/3479362881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 -- 172.21.15.92:0/3479362881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 msgr2=0x5589a98b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 -- 172.21.15.92:0/3479362881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 msgr2=0x5589a98b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 -- 172.21.15.92:0/3479362881 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a9526210 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b65b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20e40114c0 tx=0x7f20e400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e297e0d6b7f87c11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401e040 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f20e4004040 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.033+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e400f9f0 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20e4019410 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 10 client.25046 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5589a95f2620 con 0x5589a98ae820 2024-04-26T18:01:12.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e400f9f0 con 0x5589a98ae820 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f20e4021070 con 0x5589a98ae820 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 10 client.25046 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 10 client.25046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 20 client.25046 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a98cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 4 client.25046 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a9822070 con 0x5589a98c9160 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.034+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a98cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.035+0000 7f20d2ffd640 10 client.25046 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.035+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a98cb550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc373ca94c221e7 server_cookie=1617b8ce066d2ddc in_seq=0 out_seq=0 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.035+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3479362881 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5589a9822070 con 0x5589a98c9160 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.035+0000 7f20d2ffd640 10 client.25046 handle_command_reply: tid=0 2024-04-26T18:01:12.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.035+0000 7f20fcd97740 1 client.25046 shutdown 2024-04-26T18:01:12.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 msgr2=0x5589a98b65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b65b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20e40114c0 tx=0x7f20e400f7f0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 shutdown_connections 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a98cb550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20d2ffd640 0 client.25046 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98ae820 0x5589a98b65b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3479362881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98adf00 0x5589a98b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 >> 172.21.15.92:0/3479362881 conn(0x5589a98aa410 msgr2=0x5589a98b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 shutdown_connections 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 1 -- 172.21.15.92:0/3479362881 wait complete. 2024-04-26T18:01:12.041 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.036+0000 7f20fcd97740 20 client.25046 trim_cache size 0 max 16384 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 Processor -- start 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 -- start start 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 0x5589a98d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41aeac0 con 0x5589a98b90e0 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41ac360 con 0x5589a98adf00 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.054+0000 7f20fcd97740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41aa1d0 con 0x5589a98ae820 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58968/0 (socket says 172.21.15.92:58968) 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f2ffd640 1 -- 172.21.15.92:0/1522614794 learned_addr learned my addr 172.21.15.92:0/1522614794 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:12.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 0x5589a98d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 -- 172.21.15.92:0/1522614794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 msgr2=0x5589a98c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 -- 172.21.15.92:0/1522614794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 msgr2=0x5589a98d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 -- 172.21.15.92:0/1522614794 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a98b0eb0 con 0x5589a98ae820 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.055+0000 7f20f37fe640 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 0x5589a98d0d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e40196f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e85f788007f008 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20d97fa640 1 -- 172.21.15.92:0/1522614794 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401e040 con 0x5589a98ae820 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20d97fa640 1 -- 172.21.15.92:0/1522614794 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e40199c0 con 0x5589a98ae820 2024-04-26T18:01:12.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20d97fa640 1 -- 172.21.15.92:0/1522614794 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4003ac0 con 0x5589a98ae820 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 -- 172.21.15.92:0/1522614794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 msgr2=0x5589a98d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 0x5589a98d0d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e40196f0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 -- 172.21.15.92:0/1522614794 shutdown_connections 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98b90e0 0x5589a98d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98ae820 0x5589a98d0d50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 --2- 172.21.15.92:0/1522614794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 -- 172.21.15.92:0/1522614794 >> 172.21.15.92:0/1522614794 conn(0x5589a98aa410 msgr2=0x5589a98aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.056+0000 7f20fcd97740 1 -- 172.21.15.92:0/1522614794 shutdown_connections 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 -- 172.21.15.92:0/1522614794 wait complete. 2024-04-26T18:01:12.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 -- start start 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 Processor -- start 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 0x5589a98b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41aa820 con 0x5589a98ae820 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41abc90 con 0x5589a98adf00 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41aaef0 con 0x5589a98b90e0 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20fcd97740 10 client.0 _ll_register_callbacks cb 0x7f20e401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 0x5589a98b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46212/0 (socket says 172.21.15.92:46212) 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.057+0000 7f20f2ffd640 1 -- 172.21.15.92:0/3195634995 learned_addr learned my addr 172.21.15.92:0/3195634995 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:12.063 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 -- 172.21.15.92:0/3195634995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 msgr2=0x5589a98b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 -- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 msgr2=0x5589a98c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 -- 172.21.15.92:0/3195634995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a992e5c0 con 0x5589a98ae820 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20f37fe640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 0x5589a98b2b60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20e400f7c0 tx=0x7f20e4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c162a9fd63a8d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e401e040 con 0x5589a98ae820 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f20e402c440 con 0x5589a98ae820 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20e40199c0 con 0x5589a98ae820 2024-04-26T18:01:12.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20e402c660 con 0x5589a98ae820 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20fcd97740 10 client.15474 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5589a992f6b0 con 0x5589a98ae820 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.058+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e40199c0 con 0x5589a98ae820 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f20e4046050 con 0x5589a98ae820 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 10 client.15474 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 20 client.15474 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a9931de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 4 client.15474 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5589a981bee0 con 0x5589a98c9160 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.059+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a9931de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.060+0000 7f20f2ffd640 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a9931de0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1d22fb5752f7526 server_cookie=46956362d90b70f8 in_seq=0 out_seq=0 2024-04-26T18:01:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.060+0000 7f20d2ffd640 10 client.15474 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20d2ffd640 1 -- 172.21.15.92:0/3195634995 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5589a981bee0 con 0x5589a98c9160 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20d2ffd640 10 client.15474 handle_command_reply: tid=0 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 client.15474 shutdown 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 msgr2=0x5589a98b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 0x5589a98b2b60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20e400f7c0 tx=0x7f20e4005e30 comp rx=0 tx=0).stop 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 shutdown_connections 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5589a98c9160 0x5589a9931de0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5589a98b90e0 0x5589a98b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20d2ffd640 0 client.15474 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589a98ae820 0x5589a98b2b60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 --2- 172.21.15.92:0/3195634995 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5589a98adf00 0x5589a98c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 >> 172.21.15.92:0/3195634995 conn(0x5589a98aa410 msgr2=0x5589a98af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 shutdown_connections 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.070+0000 7f20fcd97740 1 -- 172.21.15.92:0/3195634995 wait complete. 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20fcd97740 20 client.15474 trim_cache size 0 max 16384 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:01:12.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:01:12.073 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 msgr2=0x7f20dc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 0x7f20dc0a6300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0ce540 tx=0x7f20ec087810 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 msgr2=0x7f20f40756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00eb10 tx=0x7f20ec00c2d0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 shutdown_connections 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20dc0a3e40 0x7f20dc0a6300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20f4108920 0x7f20f40756b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f20f41032d0 0x7f20f4075170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 --2- 172.21.15.92:0/2250172079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f20f4102910 0x7f20f4074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 >> 172.21.15.92:0/2250172079 conn(0x7f20f40fe3e0 msgr2=0x7f20f40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 shutdown_connections 2024-04-26T18:01:12.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:12.071+0000 7f20f9fa4640 1 -- 172.21.15.92:0/2250172079 wait complete. 2024-04-26T18:01:12.502 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9cc381f7', seconds elapsed: 44.8 2024-04-26T18:01:12.502 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T18:01:12.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:01:12.809 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 60.0 s, 508.2 tps, lat 1511.687 ms stddev 7127.456 2024-04-26T18:01:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:13 smithi092 ceph-mon[29156]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 194 op/s 2024-04-26T18:01:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:13 smithi189 ceph-mon[32756]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 194 op/s 2024-04-26T18:01:13.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:13 smithi156 ceph-mon[32679]: pgmap v50: 97 pgs: 97 active+clean; 960 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 194 op/s 2024-04-26T18:01:14.737 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 -- 172.21.15.92:0/4199218368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 msgr2=0x7fb26410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 --2- 172.21.15.92:0/4199218368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb26410ba40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb2540098f0 tx=0x7fb254009c00 comp rx=0 tx=0).stop 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 -- 172.21.15.92:0/4199218368 shutdown_connections 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 --2- 172.21.15.92:0/4199218368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb26410ba40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 --2- 172.21.15.92:0/4199218368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb264112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 --2- 172.21.15.92:0/4199218368 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 0x7fb264105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 -- 172.21.15.92:0/4199218368 >> 172.21.15.92:0/4199218368 conn(0x7fb264101150 msgr2=0x7fb264103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 -- 172.21.15.92:0/4199218368 shutdown_connections 2024-04-26T18:01:14.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.737+0000 7fb268a2e700 1 -- 172.21.15.92:0/4199218368 wait complete. 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 Processor -- start 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 -- start start 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 0x7fb26419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb2641a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2641158f0 con 0x7fb264106020 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb264115770 con 0x7fb26410b660 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb268a2e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb264115a70 con 0x7fb264105660 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb261d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb262d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb2641a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb261d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38362/0 (socket says 172.21.15.92:38362) 2024-04-26T18:01:14.741 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb261d9b700 1 -- 172.21.15.92:0/3453761581 learned_addr learned my addr 172.21.15.92:0/3453761581 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.738+0000 7fb26259c700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 0x7fb26419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 -- 172.21.15.92:0/3453761581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 msgr2=0x7fb26419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 0x7fb26419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 -- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 msgr2=0x7fb26419c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 -- 172.21.15.92:0/3453761581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2641a0d50 con 0x7fb26410b660 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb261d9b700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.739+0000 7fb262d9d700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb2641a0610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007f10 tx=0x7fb25c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.740+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c004db0 con 0x7fb26410b660 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.740+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb25c009e20 con 0x7fb26410b660 2024-04-26T18:01:14.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.740+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c015400 con 0x7fb26410b660 2024-04-26T18:01:14.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.740+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2641a1040 con 0x7fb26410b660 2024-04-26T18:01:14.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.740+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2641a88c0 con 0x7fb26410b660 2024-04-26T18:01:14.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.743+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26406a110 con 0x7fb26410b660 2024-04-26T18:01:14.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.744+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fb25c005260 con 0x7fb26410b660 2024-04-26T18:01:14.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.745+0000 7fb2537fe700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 0x7fb24c0a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:14.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.745+0000 7fb26259c700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 0x7fb24c0a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:14.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.745+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fb25c005900 con 0x7fb26410b660 2024-04-26T18:01:14.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.745+0000 7fb26259c700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 0x7fb24c0a64a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb254009680 tx=0x7fb254019040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:14.750 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:14.750+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fb25c010070 con 0x7fb26410b660 2024-04-26T18:01:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.142+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb26402e490 con 0x7fb26410b660 2024-04-26T18:01:15.142 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.142+0000 7fb2537fe700 1 -- 172.21.15.92:0/3453761581 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11887 (secure 0 0 0) 0x7fb25c09c580 con 0x7fb26410b660 2024-04-26T18:01:15.143 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:01:15.143 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:00:22.436646+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:01:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.145+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 msgr2=0x7fb24c0a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:15.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.145+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 0x7fb24c0a64a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb254009680 tx=0x7fb254019040 comp rx=0 tx=0).stop 2024-04-26T18:01:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.145+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 msgr2=0x7fb2641a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:15.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.145+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb2641a0610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007f10 tx=0x7fb25c00d3b0 comp rx=0 tx=0).stop 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 shutdown_connections 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb24c0a3fe0 0x7fb24c0a64a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb26410b660 0x7fb2641a0610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb264105660 0x7fb26419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 --2- 172.21.15.92:0/3453761581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb264106020 0x7fb26419c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.146+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 >> 172.21.15.92:0/3453761581 conn(0x7fb264101150 msgr2=0x7fb264101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.147+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 shutdown_connections 2024-04-26T18:01:15.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:15.147+0000 7fb268a2e700 1 -- 172.21.15.92:0/3453761581 wait complete. 2024-04-26T18:01:15.148 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-04-26T18:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:15 smithi092 ceph-mon[29156]: pgmap v51: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 26 MiB/s wr, 442 op/s 2024-04-26T18:01:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:15 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3453761581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:15 smithi189 ceph-mon[32756]: pgmap v51: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 26 MiB/s wr, 442 op/s 2024-04-26T18:01:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:15 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3453761581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:15 smithi156 ceph-mon[32679]: pgmap v51: 97 pgs: 97 active+clean; 966 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 26 MiB/s wr, 442 op/s 2024-04-26T18:01:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:15 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3453761581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:16.189 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T18:01:16.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T18:01:16.549 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:17 smithi189 ceph-mon[32756]: pgmap v52: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 405 op/s 2024-04-26T18:01:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:17 smithi156 ceph-mon[32679]: pgmap v52: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 405 op/s 2024-04-26T18:01:17.707 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:17 smithi092 ceph-mon[29156]: pgmap v52: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 405 op/s 2024-04-26T18:01:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 65.0 s, 3624.0 tps, lat 27.646 ms stddev 27.993 2024-04-26T18:01:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.512+0000 7f8074da4700 1 -- 172.21.15.92:0/3921989821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 msgr2=0x7f80701098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.512+0000 7f8074da4700 1 --2- 172.21.15.92:0/3921989821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 0x7f80701098d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8060009990 tx=0x7f8060009ca0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 -- 172.21.15.92:0/3921989821 shutdown_connections 2024-04-26T18:01:18.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 --2- 172.21.15.92:0/3921989821 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f80701102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 --2- 172.21.15.92:0/3921989821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 0x7f80701098d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 --2- 172.21.15.92:0/3921989821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 0x7f8070103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 -- 172.21.15.92:0/3921989821 >> 172.21.15.92:0/3921989821 conn(0x7f807007a500 msgr2=0x7f807007a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 -- 172.21.15.92:0/3921989821 shutdown_connections 2024-04-26T18:01:18.514 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.513+0000 7f8074da4700 1 -- 172.21.15.92:0/3921989821 wait complete. 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 Processor -- start 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 -- start start 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 0x7f807010d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 0x7f807010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8070077390 con 0x7f80701094f0 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8070077210 con 0x7f80701034d0 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f8074da4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8070077510 con 0x7f8070103e90 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.514+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:60006/0 (socket says 172.21.15.92:60006) 2024-04-26T18:01:18.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 -- 172.21.15.92:0/114049504 learned_addr learned my addr 172.21.15.92:0/114049504 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806e59c700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 0x7f807010d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 -- 172.21.15.92:0/114049504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 msgr2=0x7f807010d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 0x7f807010d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 -- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 msgr2=0x7f807010df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 0x7f807010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 -- 172.21.15.92:0/114049504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8070115de0 con 0x7f8070103e90 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f806dd9b700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f806400e9d0 tx=0x7f806400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.515+0000 7f805f7fe700 1 -- 172.21.15.92:0/114049504 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806400cbd0 con 0x7f8070103e90 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.516+0000 7f805f7fe700 1 -- 172.21.15.92:0/114049504 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f806400cd70 con 0x7f8070103e90 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.516+0000 7f805f7fe700 1 -- 172.21.15.92:0/114049504 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064018680 con 0x7f8070103e90 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.516+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701160d0 con 0x7f8070103e90 2024-04-26T18:01:18.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.516+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701165c0 con 0x7f8070103e90 2024-04-26T18:01:18.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.521+0000 7f805f7fe700 1 -- 172.21.15.92:0/114049504 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f80640188e0 con 0x7f8070103e90 2024-04-26T18:01:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.523+0000 7f805f7fe700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 0x7f80580a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.523+0000 7f805f7fe700 1 -- 172.21.15.92:0/114049504 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f80640d0a80 con 0x7f8070103e90 2024-04-26T18:01:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.523+0000 7f807f636b80 1 Processor -- start 2024-04-26T18:01:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.523+0000 7f807f636b80 1 -- start start 2024-04-26T18:01:18.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806e59c700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 0x7f80580a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eec9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c62ee1c8d0 con 0x55c62eec9230 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55c62edbb770 con 0x55c62eed4a00 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f807f636b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c62ee18890 con 0x55c62eec9b50 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:60012/0 (socket says 172.21.15.92:60012) 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806dd9b700 1 -- 172.21.15.92:0/2551588931 learned_addr learned my addr 172.21.15.92:0/2551588931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:18.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806ed9d700 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806e59c700 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eec9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.524+0000 7f806e59c700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 0x7f80580a6310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8060006010 tx=0x7f8060005ec0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.525+0000 7f806dd9b700 1 -- 172.21.15.92:0/2551588931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 msgr2=0x55c62eed6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.525+0000 7f806dd9b700 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.525+0000 7f806dd9b700 1 -- 172.21.15.92:0/2551588931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 msgr2=0x55c62eec9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.525+0000 7f806dd9b700 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eec9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.525+0000 7f806dd9b700 1 -- 172.21.15.92:0/2551588931 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62ed69a60 con 0x55c62eec9b50 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.526+0000 7f806dd9b700 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8064098ef0 tx=0x7f806409c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c671f233abe3b96e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.526+0000 7f805cff9700 1 -- 172.21.15.92:0/2551588931 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80640a5700 con 0x55c62eec9b50 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.527+0000 7f805cff9700 1 -- 172.21.15.92:0/2551588931 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f806409ad90 con 0x55c62eec9b50 2024-04-26T18:01:18.527 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.527+0000 7f805cff9700 1 -- 172.21.15.92:0/2551588931 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80640a54d0 con 0x55c62eec9b50 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 -- 172.21.15.92:0/2551588931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 msgr2=0x55c62eed44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8064098ef0 tx=0x7f806409c990 comp rx=0 tx=0).stop 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 -- 172.21.15.92:0/2551588931 shutdown_connections 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eec9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.529 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 --2- 172.21.15.92:0/2551588931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed44c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.528+0000 7f807f636b80 1 -- 172.21.15.92:0/2551588931 >> 172.21.15.92:0/2551588931 conn(0x55c62edf6ed0 msgr2=0x55c62eec5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.529+0000 7f807f636b80 1 -- 172.21.15.92:0/2551588931 shutdown_connections 2024-04-26T18:01:18.530 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.529+0000 7f807f636b80 1 -- 172.21.15.92:0/2551588931 wait complete. 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.529+0000 7f807f636b80 1 -- start start 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.529+0000 7f807f636b80 1 Processor -- start 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eed4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c62eed7670 con 0x55c62eec9230 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55c62ed82ae0 con 0x55c62eed4a00 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c62eed77f0 con 0x55c62eec9b50 2024-04-26T18:01:18.531 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.530+0000 7f807f636b80 10 client.0 _ll_register_callbacks cb 0x55c62edb0710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:49700/0 (socket says 172.21.15.92:49700) 2024-04-26T18:01:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 -- 172.21.15.92:0/2160104122 learned_addr learned my addr 172.21.15.92:0/2160104122 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806dd9b700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.532 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806e59c700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eed4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 -- 172.21.15.92:0/2160104122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 msgr2=0x55c62eed1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 -- 172.21.15.92:0/2160104122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 msgr2=0x55c62eed4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.533 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eed4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.532+0000 7f806ed9d700 1 -- 172.21.15.92:0/2160104122 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62eed22a0 con 0x55c62eed4a00 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.533+0000 7f806ed9d700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8068011c20 tx=0x7f806800f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d88371c1d93896a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.533+0000 7f8055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.533+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806801a030 con 0x55c62eed4a00 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.533+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f80680092e0 con 0x55c62eed4a00 2024-04-26T18:01:18.534 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.534+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f806409ad90 con 0x55c62eed4a00 2024-04-26T18:01:18.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.534+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8068024050 con 0x55c62eed4a00 2024-04-26T18:01:18.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 10 client.25067 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:18.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c62eee2260 con 0x55c62eed4a00 2024-04-26T18:01:18.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f806409ad90 con 0x55c62eed4a00 2024-04-26T18:01:18.535 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f8068007990 con 0x55c62eed4a00 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 10 client.25067 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 10 client.25067 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 20 client.25067 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62eee48a0 0x55c62eee6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 4 client.25067 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.535+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c62ee2a2b0 con 0x55c62eee48a0 2024-04-26T18:01:18.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.536+0000 7f806e59c700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62eee48a0 0x55c62eee6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.539 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.539+0000 7f8055ffb700 10 client.25067 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:18.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.539+0000 7f806e59c700 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62eee48a0 0x55c62eee6ce0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3702bd50cdabe824 server_cookie=e59599996adbb081 in_seq=0 out_seq=0 2024-04-26T18:01:18.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.540+0000 7f8055ffb700 1 -- 172.21.15.92:0/2160104122 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c62ee2a2b0 con 0x55c62eee48a0 2024-04-26T18:01:18.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.540+0000 7f8055ffb700 10 client.25067 handle_command_reply: tid=0 2024-04-26T18:01:18.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.540+0000 7f807f636b80 1 client.25067 shutdown 2024-04-26T18:01:18.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.540+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 msgr2=0x55c62eed1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.540+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8068011c20 tx=0x7f806800f130 comp rx=0 tx=0).stop 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 shutdown_connections 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62eee48a0 0x55c62eee6ce0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eed4a00 0x55c62eed1ab0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9230 0x55c62eed4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 --2- 172.21.15.92:0/2160104122 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eed1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 >> 172.21.15.92:0/2160104122 conn(0x55c62edf6ed0 msgr2=0x55c62eec5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f8055ffb700 0 client.25067 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 shutdown_connections 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 1 -- 172.21.15.92:0/2160104122 wait complete. 2024-04-26T18:01:18.542 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.541+0000 7f807f636b80 20 client.25067 trim_cache size 0 max 16384 2024-04-26T18:01:18.571 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.571+0000 7f807f636b80 1 Processor -- start 2024-04-26T18:01:18.572 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.571+0000 7f807f636b80 1 -- start start 2024-04-26T18:01:18.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f807f636b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eec3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f807f636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 0x55c62eed0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.574 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f807f636b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f807f636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80701bf370 con 0x55c62eec9b50 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f807f636b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f807011de50 con 0x55c62eec9230 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f806ed9d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f806ed9d700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:60028/0 (socket says 172.21.15.92:60028) 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.572+0000 7f806ed9d700 1 -- 172.21.15.92:0/1647057298 learned_addr learned my addr 172.21.15.92:0/1647057298 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806e59c700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eec3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f807011bca0 con 0x55c62eed4a00 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806dd9b700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 0x55c62eed0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 -- 172.21.15.92:0/1647057298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 msgr2=0x55c62eec3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eec3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.575 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 -- 172.21.15.92:0/1647057298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 msgr2=0x55c62eed0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 0x55c62eed0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 -- 172.21.15.92:0/1647057298 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62eecfb20 con 0x55c62eed4a00 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806dd9b700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 0x55c62eed0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.573+0000 7f806ed9d700 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8068007d60 tx=0x7f806800f530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25699ef45cdf7834 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.574+0000 7f8057fff700 1 -- 172.21.15.92:0/1647057298 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806801a030 con 0x55c62eed4a00 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.574+0000 7f8057fff700 1 -- 172.21.15.92:0/1647057298 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80680093e0 con 0x55c62eed4a00 2024-04-26T18:01:18.576 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.574+0000 7f8057fff700 1 -- 172.21.15.92:0/1647057298 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068007500 con 0x55c62eed4a00 2024-04-26T18:01:18.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 msgr2=0x55c62eeec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8068007d60 tx=0x7f806800f530 comp rx=0 tx=0).stop 2024-04-26T18:01:18.579 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 shutdown_connections 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eec3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eed4a00 0x55c62eeec640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 --2- 172.21.15.92:0/1647057298 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eec9b50 0x55c62eed0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 >> 172.21.15.92:0/1647057298 conn(0x55c62edf6ed0 msgr2=0x55c62eed2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 shutdown_connections 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- 172.21.15.92:0/1647057298 wait complete. 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 -- start start 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.575+0000 7f807f636b80 1 Processor -- start 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eedac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eed4a00 0x55c62ef49ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.580 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f807011c310 con 0x55c62eed4a00 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f807011d780 con 0x55c62eec9230 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f807011c9e0 con 0x55c62eec9b50 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f807f636b80 10 client.0 _ll_register_callbacks cb 0x55c62edb0710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:60044/0 (socket says 172.21.15.92:60044) 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 -- 172.21.15.92:0/1134994416 learned_addr learned my addr 172.21.15.92:0/1134994416 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806e59c700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eedac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 -- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 msgr2=0x55c62eedac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eedac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 -- 172.21.15.92:0/1134994416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eed4a00 msgr2=0x55c62ef49ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eed4a00 0x55c62ef49ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 -- 172.21.15.92:0/1134994416 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62ef4a480 con 0x55c62eec9b50 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f806dd9b700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8064009230 tx=0x7f806409d190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213cf4d8ccea3579 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:18.581 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.576+0000 7f8055ffb700 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80640a5700 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f80640a5270 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80680093e0 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80640bd0c0 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f807f636b80 10 client.25012 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c62ef4b6e0 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.577+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80680093e0 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f806409b950 con 0x55c62eec9b50 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 10 client.25012 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 10 client.25012 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 20 client.25012 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62ef4b9d0 0x55c62ef4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:18.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 4 client.25012 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T18:01:18.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55c62eed4600 con 0x55c62ef4b9d0 2024-04-26T18:01:18.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.578+0000 7f806e59c700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62ef4b9d0 0x55c62ef4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:18.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.579+0000 7f806e59c700 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62ef4b9d0 0x55c62ef4ddc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62ddb2fe06e580f server_cookie=f657cb61a2777d81 in_seq=0 out_seq=0 2024-04-26T18:01:18.583 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.579+0000 7f8055ffb700 10 client.25012 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f8055ffb700 1 -- 172.21.15.92:0/1134994416 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55c62eed4600 con 0x55c62ef4b9d0 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f8055ffb700 10 client.25012 handle_command_reply: tid=0 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 client.25012 shutdown 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 msgr2=0x55c62eedb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8064009230 tx=0x7f806409d190 comp rx=0 tx=0).stop 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 shutdown_connections 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55c62ef4b9d0 0x55c62ef4ddc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62eec9230 0x55c62eedac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f8055ffb700 0 client.25012 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c62eed4a00 0x55c62ef49ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 --2- 172.21.15.92:0/1134994416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c62eec9b50 0x55c62eedb160 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 >> 172.21.15.92:0/1134994416 conn(0x55c62edf6ed0 msgr2=0x55c62eed05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 shutdown_connections 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 1 -- 172.21.15.92:0/1134994416 wait complete. 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.778+0000 7f807f636b80 20 client.25012 trim_cache size 0 max 16384 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 6, 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "9075dd48": { 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 6, 2024-04-26T18:01:18.780 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 90.0, 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:18.781 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 msgr2=0x7f80580a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 0x7f80580a6310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8060006010 tx=0x7f8060005ec0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 msgr2=0x7f807010d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f806400e9d0 tx=0x7f806400ed90 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 shutdown_connections 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80580a3e50 0x7f80580a6310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80701034d0 0x7f807010d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80701094f0 0x7f807010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 --2- 172.21.15.92:0/114049504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8070103e90 0x7f807010d9e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 >> 172.21.15.92:0/114049504 conn(0x7f807007a500 msgr2=0x7f8070101f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 shutdown_connections 2024-04-26T18:01:18.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:18.779+0000 7f8074da4700 1 -- 172.21.15.92:0/114049504 wait complete. 2024-04-26T18:01:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:19 smithi189 ceph-mon[32756]: pgmap v53: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 18 MiB/s wr, 338 op/s 2024-04-26T18:01:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:19 smithi156 ceph-mon[32679]: pgmap v53: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 18 MiB/s wr, 338 op/s 2024-04-26T18:01:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:19 smithi092 ceph-mon[29156]: pgmap v53: 97 pgs: 97 active+clean; 970 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 18 MiB/s wr, 338 op/s 2024-04-26T18:01:20.284 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9075dd48', quiesce took 7.8 seconds. Will release after: 30.0 2024-04-26T18:01:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:21 smithi189 ceph-mon[32756]: pgmap v54: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 660 op/s 2024-04-26T18:01:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:21 smithi156 ceph-mon[32679]: pgmap v54: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 660 op/s 2024-04-26T18:01:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:21 smithi092 ceph-mon[29156]: pgmap v54: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 660 op/s 2024-04-26T18:01:23.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 70.0 s, 221.2 tps, lat 29.299 ms stddev 33.723 2024-04-26T18:01:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:23 smithi189 ceph-mon[32756]: pgmap v55: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 657 op/s 2024-04-26T18:01:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:23 smithi156 ceph-mon[32679]: pgmap v55: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 657 op/s 2024-04-26T18:01:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:23 smithi092 ceph-mon[29156]: pgmap v55: 97 pgs: 97 active+clean; 1011 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 23 MiB/s wr, 657 op/s 2024-04-26T18:01:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 -- 172.21.15.92:0/150448917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 msgr2=0x7fa184101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 --2- 172.21.15.92:0/150448917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184101ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa178009930 tx=0x7fa17802a420 comp rx=0 tx=0).stop 2024-04-26T18:01:25.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 -- 172.21.15.92:0/150448917 shutdown_connections 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 --2- 172.21.15.92:0/150448917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa18410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 --2- 172.21.15.92:0/150448917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184101ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 --2- 172.21.15.92:0/150448917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 0x7fa184107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 -- 172.21.15.92:0/150448917 >> 172.21.15.92:0/150448917 conn(0x7fa1840789b0 msgr2=0x7fa184078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 -- 172.21.15.92:0/150448917 shutdown_connections 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.164+0000 7fa189bf0640 1 -- 172.21.15.92:0/150448917 wait complete. 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 Processor -- start 2024-04-26T18:01:25.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 -- start start 2024-04-26T18:01:25.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa184199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 0x7fa18419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa184111b30 con 0x7fa184101860 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841119b0 con 0x7fa184107820 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.165+0000 7fa189bf0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa184111cb0 con 0x7fa184102220 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47444/0 (socket says 172.21.15.92:47444) 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 -- 172.21.15.92:0/1343577884 learned_addr learned my addr 172.21.15.92:0/1343577884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa183fff640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 0x7fa18419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa184199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 -- 172.21.15.92:0/1343577884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 msgr2=0x7fa184199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa184199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 -- 172.21.15.92:0/1343577884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 msgr2=0x7fa18419d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 0x7fa18419d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 -- 172.21.15.92:0/1343577884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18419e040 con 0x7fa184101860 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa184199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c920 tx=0x7fa17400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa180ff9640 1 -- 172.21.15.92:0/1343577884 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174007c70 con 0x7fa184101860 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18419e330 con 0x7fa184101860 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa180ff9640 1 -- 172.21.15.92:0/1343577884 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa174007e10 con 0x7fa184101860 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa180ff9640 1 -- 172.21.15.92:0/1343577884 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174018820 con 0x7fa184101860 2024-04-26T18:01:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.166+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1841a5bc0 con 0x7fa184101860 2024-04-26T18:01:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa180ff9640 1 -- 172.21.15.92:0/1343577884 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa17400f450 con 0x7fa184101860 2024-04-26T18:01:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 Processor -- start 2024-04-26T18:01:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 -- start start 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b2d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b3a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558723a93460 con 0x558723b2d820 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x558723a4d590 con 0x558723b380e0 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558723a8f420 con 0x558723b2cf00 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa180ff9640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 0x7fa16c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47446/0 (socket says 172.21.15.92:47446) 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa1837fe640 1 -- 172.21.15.92:0/1991378025 learned_addr learned my addr 172.21.15.92:0/1991378025 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.169+0000 7fa183fff640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 0x7fa16c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa183fff640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b2d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b3a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa180ff9640 1 -- 172.21.15.92:0/1343577884 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa1740d08c0 con 0x7fa184101860 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 -- 172.21.15.92:0/1991378025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 msgr2=0x558723b2d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b2d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 -- 172.21.15.92:0/1991378025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 msgr2=0x558723b3a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b3a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 -- 172.21.15.92:0/1991378025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558723a5a0d0 con 0x558723b2d820 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b3a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa174007590 tx=0x7fa17409c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f2db51f47218af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa183fff640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 0x7fa16c0a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007fd0 tx=0x7fa17c007cc0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa169ffb640 1 -- 172.21.15.92:0/1991378025 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740a0c80 con 0x558723b2d820 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa169ffb640 1 -- 172.21.15.92:0/1991378025 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1740a5540 con 0x558723b2d820 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.170+0000 7fa169ffb640 1 -- 172.21.15.92:0/1991378025 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17400f740 con 0x558723b2d820 2024-04-26T18:01:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1991378025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 msgr2=0x558723b37ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa174007590 tx=0x7fa17409c7d0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1991378025 shutdown_connections 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b3a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b37ba0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1991378025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b2d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1991378025 >> 172.21.15.92:0/1991378025 conn(0x558723b29410 msgr2=0x558723b297f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1991378025 shutdown_connections 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1991378025 wait complete. 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 -- start start 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.171+0000 7fa18c9e5740 1 Processor -- start 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b35b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558723b3ad10 con 0x558723b2d820 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x558723a1ab60 con 0x558723b380e0 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558723b3ae90 con 0x558723b2cf00 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 10 client.0 _ll_register_callbacks cb 0x558723a3f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47460/0 (socket says 172.21.15.92:47460) 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 -- 172.21.15.92:0/1842871910 learned_addr learned my addr 172.21.15.92:0/1842871910 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa183fff640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b35b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 -- 172.21.15.92:0/1842871910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 msgr2=0x558723b350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 -- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 msgr2=0x558723b35b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b35b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 -- 172.21.15.92:0/1842871910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587237a5210 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa17802abd0 tx=0x7fa1780052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f202d255e676993d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178035030 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa1780048c0 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.172+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1740a5540 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa178004ae0 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 10 client.15501 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558723871620 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1740a5540 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fa17804b020 con 0x558723b2d820 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 10 client.15501 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 20 client.15501 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723b482d0 0x558723b4a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 4 client.15501 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558723aa1070 con 0x558723b482d0 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.173+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723b482d0 0x558723b4a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa162ffd640 10 client.15501 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723b482d0 0x558723b4a700 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11d860a962030174 server_cookie=8dd8f505861b0122 in_seq=0 out_seq=0 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa162ffd640 1 -- 172.21.15.92:0/1842871910 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558723aa1070 con 0x558723b482d0 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa162ffd640 10 client.15501 handle_command_reply: tid=0 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 client.15501 shutdown 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 msgr2=0x558723b35610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa17802abd0 tx=0x7fa1780052f0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 shutdown_connections 2024-04-26T18:01:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723b482d0 0x558723b4a700 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b380e0 0x558723b35b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b35610 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa162ffd640 0 client.15501 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1842871910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2cf00 0x558723b350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.174+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 >> 172.21.15.92:0/1842871910 conn(0x558723b29410 msgr2=0x558723b285b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.175+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 shutdown_connections 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.175+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1842871910 wait complete. 2024-04-26T18:01:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.175+0000 7fa18c9e5740 20 client.15501 trim_cache size 0 max 16384 2024-04-26T18:01:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 Processor -- start 2024-04-26T18:01:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 -- start start 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b2f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 0x558723b357a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841b0c20 con 0x558723b380e0 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841ae4c0 con 0x558723b2cf00 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841ac310 con 0x558723b2d820 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa183fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa183fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47466/0 (socket says 172.21.15.92:47466) 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.189+0000 7fa183fff640 1 -- 172.21.15.92:0/1591826045 learned_addr learned my addr 172.21.15.92:0/1591826045 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b2f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 0x558723b357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 -- 172.21.15.92:0/1591826045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 msgr2=0x558723b357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 0x558723b357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 -- 172.21.15.92:0/1591826045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 msgr2=0x558723b2f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b2f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 -- 172.21.15.92:0/1591826045 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558723b3a840 con 0x558723b380e0 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 0x558723b357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b2f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa183fff640 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007b30 tx=0x7fa17c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea85ca90418fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa1697fa640 1 -- 172.21.15.92:0/1591826045 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c004d20 con 0x558723b380e0 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa1697fa640 1 -- 172.21.15.92:0/1591826045 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17c005020 con 0x558723b380e0 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.190+0000 7fa1697fa640 1 -- 172.21.15.92:0/1591826045 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c01f680 con 0x558723b380e0 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1591826045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 msgr2=0x558723b4ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007b30 tx=0x7fa17c004a40 comp rx=0 tx=0).stop 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1591826045 shutdown_connections 2024-04-26T18:01:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b380e0 0x558723b4ffd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b2d820 0x558723b357a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1591826045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b2f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1591826045 >> 172.21.15.92:0/1591826045 conn(0x558723b29410 msgr2=0x558723b35090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1591826045 shutdown_connections 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1591826045 wait complete. 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- start start 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 Processor -- start 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b380e0 0x558723b3d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841ac980 con 0x558723b2d820 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841addf0 con 0x558723b2cf00 2024-04-26T18:01:25.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.191+0000 7fa18c9e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa1841ad050 con 0x558723b380e0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa18c9e5740 10 client.0 _ll_register_callbacks cb 0x7fa178009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47468/0 (socket says 172.21.15.92:47468) 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 -- 172.21.15.92:0/1938366266 learned_addr learned my addr 172.21.15.92:0/1938366266 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa183fff640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b380e0 0x558723b3d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 -- 172.21.15.92:0/1938366266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b380e0 msgr2=0x558723b3d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b380e0 0x558723b3d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 -- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 msgr2=0x558723b400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 -- 172.21.15.92:0/1938366266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558723b3da60 con 0x558723b2d820 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa182ffd640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa17802a940 tx=0x7fa178004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45565f8e3dde96c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178035040 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17c005020 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa178031a10 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa17805f050 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa18c9e5740 10 client.15507 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.192+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558723baf450 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17c005020 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fa178056070 con 0x558723b2d820 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 10 client.15507 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 20 client.15507 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723bafc80 0x558723bb20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 4 client.15507 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:01:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558723a9aee0 con 0x558723bafc80 2024-04-26T18:01:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723bafc80 0x558723bb20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa1837fe640 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723bafc80 0x558723bb20a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34092939baf4251 server_cookie=f627041b9e651113 in_seq=0 out_seq=0 2024-04-26T18:01:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.193+0000 7fa162ffd640 10 client.15507 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.205+0000 7fa162ffd640 1 -- 172.21.15.92:0/1938366266 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558723a9aee0 con 0x558723bafc80 2024-04-26T18:01:25.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.205+0000 7fa162ffd640 10 client.15507 handle_command_reply: tid=0 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.205+0000 7fa18c9e5740 1 client.15507 shutdown 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 msgr2=0x558723b40620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa17802a940 tx=0x7fa178004fb0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 shutdown_connections 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x558723bafc80 0x558723bb20a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558723b380e0 0x558723b3d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558723b2d820 0x558723b40620 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa162ffd640 0 client.15507 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 --2- 172.21.15.92:0/1938366266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558723b2cf00 0x558723b400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 >> 172.21.15.92:0/1938366266 conn(0x558723b29410 msgr2=0x558723b358b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 shutdown_connections 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 1 -- 172.21.15.92:0/1938366266 wait complete. 2024-04-26T18:01:25.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa18c9e5740 20 client.15507 trim_cache size 0 max 16384 2024-04-26T18:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:01:25.208 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 msgr2=0x7fa16c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 0x7fa16c0a6280 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007fd0 tx=0x7fa17c007cc0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 msgr2=0x7fa184199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c920 tx=0x7fa17400cde0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 shutdown_connections 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa16c0a3dc0 0x7fa16c0a6280 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa184107820 0x7fa18419d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa184102220 0x7fa184199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 --2- 172.21.15.92:0/1343577884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa184101860 0x7fa184199050 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.206+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 >> 172.21.15.92:0/1343577884 conn(0x7fa1840789b0 msgr2=0x7fa184100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.207+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 shutdown_connections 2024-04-26T18:01:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:25.207+0000 7fa189bf0640 1 -- 172.21.15.92:0/1343577884 wait complete. 2024-04-26T18:01:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:25 smithi189 ceph-mon[32756]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 30 MiB/s wr, 1.31k op/s 2024-04-26T18:01:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:25 smithi156 ceph-mon[32679]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 30 MiB/s wr, 1.31k op/s 2024-04-26T18:01:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:25 smithi092 ceph-mon[29156]: pgmap v56: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 30 MiB/s wr, 1.31k op/s 2024-04-26T18:01:27.562 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:27 smithi092 ceph-mon[29156]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2024-04-26T18:01:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:27 smithi189 ceph-mon[32756]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2024-04-26T18:01:27.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:27 smithi156 ceph-mon[32679]: pgmap v57: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 20 MiB/s wr, 1.32k op/s 2024-04-26T18:01:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:29 smithi189 ceph-mon[32756]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:29 smithi156 ceph-mon[32679]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:29 smithi092 ceph-mon[29156]: pgmap v58: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:31 smithi189 ceph-mon[32756]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:31 smithi156 ceph-mon[32679]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:31 smithi092 ceph-mon[29156]: pgmap v59: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:01:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:33 smithi189 ceph-mon[32756]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 919 op/s 2024-04-26T18:01:33.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:33 smithi156 ceph-mon[32679]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 919 op/s 2024-04-26T18:01:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:33 smithi092 ceph-mon[29156]: pgmap v60: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.9 MiB/s wr, 919 op/s 2024-04-26T18:01:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:35 smithi189 ceph-mon[32756]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-26T18:01:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:35 smithi156 ceph-mon[32679]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-26T18:01:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:35 smithi092 ceph-mon[29156]: pgmap v61: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-04-26T18:01:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:37 smithi189 ceph-mon[32756]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 423 op/s 2024-04-26T18:01:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:37 smithi156 ceph-mon[32679]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 423 op/s 2024-04-26T18:01:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:37 smithi092 ceph-mon[29156]: pgmap v62: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 423 op/s 2024-04-26T18:01:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- 172.21.15.92:0/3420906716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41019b0 msgr2=0x7fe8f4101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 --2- 172.21.15.92:0/3420906716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41019b0 0x7fe8f4101d90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009900 tx=0x7fe8ec02a510 comp rx=0 tx=0).stop 2024-04-26T18:01:38.305 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- 172.21.15.92:0/3420906716 shutdown_connections 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 --2- 172.21.15.92:0/3420906716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 0x7fe8f4107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 --2- 172.21.15.92:0/3420906716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41022d0 0x7fe8f4106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 --2- 172.21.15.92:0/3420906716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41019b0 0x7fe8f4101d90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- 172.21.15.92:0/3420906716 >> 172.21.15.92:0/3420906716 conn(0x7fe8f40789b0 msgr2=0x7fe8f4078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- 172.21.15.92:0/3420906716 shutdown_connections 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- 172.21.15.92:0/3420906716 wait complete. 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 Processor -- start 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.304+0000 7fe8fb893640 1 -- start start 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 0x7fe8f419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 0x7fe8f41a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41191a0 con 0x7fe8f41022d0 2024-04-26T18:01:38.306 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4119020 con 0x7fe8f4106cd0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4119320 con 0x7fe8f41019b0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43132/0 (socket says 172.21.15.92:43132) 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/687005235 learned_addr learned my addr 172.21.15.92:0/687005235 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f962f640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 0x7fe8f419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 0x7fe8f41a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/687005235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 msgr2=0x7fe8f419f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 0x7fe8f419f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/687005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 msgr2=0x7fe8f41a3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 0x7fe8f41a3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/687005235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41a46b0 con 0x7fe8f41022d0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f962f640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 0x7fe8f419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800d770 tx=0x7fe8e800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f27fc640 1 -- 172.21.15.92:0/687005235 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8017070 con 0x7fe8f41022d0 2024-04-26T18:01:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f27fc640 1 -- 172.21.15.92:0/687005235 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e80054d0 con 0x7fe8f41022d0 2024-04-26T18:01:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8f27fc640 1 -- 172.21.15.92:0/687005235 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8004c30 con 0x7fe8f41022d0 2024-04-26T18:01:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f41a49a0 con 0x7fe8f41022d0 2024-04-26T18:01:38.308 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.305+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f41ac230 con 0x7fe8f41022d0 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.307+0000 7fe8f27fc640 1 -- 172.21.15.92:0/687005235 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe8e8004e10 con 0x7fe8f41022d0 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 Processor -- start 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 -- start start 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede891ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cede7ed460 con 0x55cede8920e0 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cede7a7590 con 0x55cede887820 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cede7e9420 con 0x55cede886f00 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f27fc640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 0x7fe8dc0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43148/0 (socket says 172.21.15.92:43148) 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/2629347778 learned_addr learned my addr 172.21.15.92:0/2629347778 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 0x7fe8dc0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.308+0000 7fe8f962f640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede891ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f27fc640 1 -- 172.21.15.92:0/687005235 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fe8e80d0310 con 0x7fe8f41022d0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/2629347778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 msgr2=0x55cede8872e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8872e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/2629347778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 msgr2=0x55cede891ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede891ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/2629347778 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cede7b40d0 con 0x55cede8920e0 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f962f640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede891ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 0x7fe8dc0a6280 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4013ac0 tx=0x7fe8e400b860 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8098780 tx=0x7fe8e801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5347d5d7d60810 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8db7fe640 1 -- 172.21.15.92:0/2629347778 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8020070 con 0x55cede8920e0 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8db7fe640 1 -- 172.21.15.92:0/2629347778 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e809ca20 con 0x55cede8920e0 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.309+0000 7fe8db7fe640 1 -- 172.21.15.92:0/2629347778 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8098990 con 0x55cede8920e0 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/2629347778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 msgr2=0x55cede8944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8098780 tx=0x7fe8e801e000 comp rx=0 tx=0).stop 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/2629347778 shutdown_connections 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8944d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede891ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/2629347778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8872e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/2629347778 >> 172.21.15.92:0/2629347778 conn(0x55cede883410 msgr2=0x55cede8837f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/2629347778 shutdown_connections 2024-04-26T18:01:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/2629347778 wait complete. 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 -- start start 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.310+0000 7fe8fe5b4740 1 Processor -- start 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede887820 0x55cede88f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cede894cb0 con 0x55cede8920e0 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cede774b60 con 0x55cede886f00 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cede894e30 con 0x55cede887820 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8fe5b4740 10 client.0 _ll_register_callbacks cb 0x55cede7992b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43156/0 (socket says 172.21.15.92:43156) 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 -- 172.21.15.92:0/864215025 learned_addr learned my addr 172.21.15.92:0/864215025 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f962f640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede887820 0x55cede88f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 -- 172.21.15.92:0/864215025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede887820 msgr2=0x55cede88f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede887820 0x55cede88f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 -- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 msgr2=0x55cede88f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 -- 172.21.15.92:0/864215025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cede4ff210 con 0x55cede8920e0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f962f640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400bf60 tx=0x7fe8e400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1842f21f456c91b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.311+0000 7fe8d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4026070 con 0x55cede8920e0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fe8e4004d20 con 0x55cede8920e0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e809ca20 con 0x55cede8920e0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8e4030050 con 0x55cede8920e0 2024-04-26T18:01:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 10 client.15519 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cede5cb620 con 0x55cede8920e0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e809ca20 con 0x55cede8920e0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fe8e40051e0 con 0x55cede8920e0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 10 client.15519 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 20 client.15519 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede8a22b0 0x55cede8a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 4 client.15519 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.312+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cede7fb070 con 0x55cede8a22b0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.313+0000 7fe8f962f640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede8a22b0 0x55cede8a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.313+0000 7fe8d8ff9640 10 client.15519 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.313+0000 7fe8f962f640 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede8a22b0 0x55cede8a46a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82fe4233f99ed7a server_cookie=753905c69071ff5d in_seq=0 out_seq=0 2024-04-26T18:01:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/864215025 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cede7fb070 con 0x55cede8a22b0 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8d8ff9640 10 client.15519 handle_command_reply: tid=0 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 client.15519 shutdown 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 msgr2=0x55cede88fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400bf60 tx=0x7fe8e400b540 comp rx=0 tx=0).stop 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 shutdown_connections 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede8a22b0 0x55cede8a46a0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede88fb20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede887820 0x55cede88f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8d8ff9640 0 client.15519 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/864215025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 >> 172.21.15.92:0/864215025 conn(0x55cede883410 msgr2=0x55cede889140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 shutdown_connections 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/864215025 wait complete. 2024-04-26T18:01:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.314+0000 7fe8fe5b4740 20 client.15519 trim_cache size 0 max 16384 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 Processor -- start 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 -- start start 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede88f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b7270 con 0x55cede8920e0 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b4b10 con 0x55cede887820 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b2960 con 0x55cede886f00 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f9e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f9e30640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43158/0 (socket says 172.21.15.92:43158) 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f9e30640 1 -- 172.21.15.92:0/3983282538 learned_addr learned my addr 172.21.15.92:0/3983282538 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f962f640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f9e30640 1 -- 172.21.15.92:0/3983282538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 msgr2=0x55cede8898c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede88f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.329+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8898c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8f9e30640 1 -- 172.21.15.92:0/3983282538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 msgr2=0x55cede88f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede88f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8f9e30640 1 -- 172.21.15.92:0/3983282538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cede88d610 con 0x55cede8920e0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8f962f640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8f9e30640 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400bb90 tx=0x7fe8e400b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92d9d983ed710a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8daffd640 1 -- 172.21.15.92:0/3983282538 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4026050 con 0x55cede8920e0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8daffd640 1 -- 172.21.15.92:0/3983282538 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e4013020 con 0x55cede8920e0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8daffd640 1 -- 172.21.15.92:0/3983282538 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4004ab0 con 0x55cede8920e0 2024-04-26T18:01:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.330+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3983282538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 msgr2=0x55cede8a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400bb90 tx=0x7fe8e400b9b0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.332 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 85.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:38.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3983282538 shutdown_connections 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede8920e0 0x55cede8a9f90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede887820 0x55cede88f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3983282538 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede886f00 0x55cede8898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3983282538 >> 172.21.15.92:0/3983282538 conn(0x55cede883410 msgr2=0x55cede88f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3983282538 shutdown_connections 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3983282538 wait complete. 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- start start 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 Processor -- start 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede8920e0 0x55cede907800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b2fd0 con 0x55cede887820 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b4440 con 0x55cede886f00 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f41b36a0 con 0x55cede8920e0 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8fe5b4740 10 client.0 _ll_register_callbacks cb 0x7fe8e4010cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.331+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43174/0 (socket says 172.21.15.92:43174) 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/3159646426 learned_addr learned my addr 172.21.15.92:0/3159646426 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f962f640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/3159646426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede8920e0 msgr2=0x55cede907800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede8920e0 0x55cede907800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 msgr2=0x55cede88c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 -- 172.21.15.92:0/3159646426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cede907d70 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8f8e2e640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe8e809c2b0 tx=0x7fe8e80985c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b4b6617594075b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80ba060 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fe8e8098990 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e4013020 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8e8020040 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8fe5b4740 10 client.15525 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cede908ff0 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.332+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8e4013020 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7fe8e80a0150 con 0x55cede887820 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 10 client.15525 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:38.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 20 client.15525 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede909310 0x55cede90b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 4 client.15525 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cede7f4ee0 con 0x55cede909310 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8f962f640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede909310 0x55cede90b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8d8ff9640 10 client.15525 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:38.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.333+0000 7fe8f962f640 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede909310 0x55cede90b700 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2bb0177fbd22cec server_cookie=a1c322e39d453361 in_seq=0 out_seq=0 2024-04-26T18:01:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.345+0000 7fe8d8ff9640 1 -- 172.21.15.92:0/3159646426 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cede7f4ee0 con 0x55cede909310 2024-04-26T18:01:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.345+0000 7fe8d8ff9640 10 client.15525 handle_command_reply: tid=0 2024-04-26T18:01:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.345+0000 7fe8fe5b4740 1 client.15525 shutdown 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 msgr2=0x55cede88ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe8e809c2b0 tx=0x7fe8e80985c0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 shutdown_connections 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cede909310 0x55cede90b700 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cede8920e0 0x55cede907800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8d8ff9640 0 client.15525 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cede887820 0x55cede88ca30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 --2- 172.21.15.92:0/3159646426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cede886f00 0x55cede88c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 >> 172.21.15.92:0/3159646426 conn(0x55cede883410 msgr2=0x55cede88f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 shutdown_connections 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 1 -- 172.21.15.92:0/3159646426 wait complete. 2024-04-26T18:01:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fe5b4740 20 client.15525 trim_cache size 0 max 16384 2024-04-26T18:01:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:01:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:01:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:01:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 msgr2=0x7fe8dc0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 0x7fe8dc0a6280 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4013ac0 tx=0x7fe8e400b860 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 msgr2=0x7fe8f419fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8e800d770 tx=0x7fe8e800dc30 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 shutdown_connections 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe8dc0a3dc0 0x7fe8dc0a6280 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8f4106cd0 0x7fe8f41a3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8f41022d0 0x7fe8f419fc00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 --2- 172.21.15.92:0/687005235 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe8f41019b0 0x7fe8f419f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 >> 172.21.15.92:0/687005235 conn(0x7fe8f40789b0 msgr2=0x7fe8f4104760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 shutdown_connections 2024-04-26T18:01:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:38.346+0000 7fe8fb893640 1 -- 172.21.15.92:0/687005235 wait complete. 2024-04-26T18:01:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:39 smithi189 ceph-mon[32756]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 168 op/s 2024-04-26T18:01:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:39 smithi156 ceph-mon[32679]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 168 op/s 2024-04-26T18:01:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:39 smithi092 ceph-mon[29156]: pgmap v63: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 168 op/s 2024-04-26T18:01:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:41 smithi189 ceph-mon[32756]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 173 op/s 2024-04-26T18:01:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:41 smithi156 ceph-mon[32679]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 173 op/s 2024-04-26T18:01:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:41 smithi092 ceph-mon[29156]: pgmap v64: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 173 op/s 2024-04-26T18:01:43.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 90.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:43 smithi189 ceph-mon[32756]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-04-26T18:01:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:43 smithi156 ceph-mon[32679]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-04-26T18:01:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:43 smithi092 ceph-mon[29156]: pgmap v65: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2024-04-26T18:01:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:44.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:01:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:45 smithi189 ceph-mon[32756]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 171 op/s 2024-04-26T18:01:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:01:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:45 smithi156 ceph-mon[32679]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 171 op/s 2024-04-26T18:01:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:01:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:45 smithi092 ceph-mon[29156]: pgmap v66: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 171 op/s 2024-04-26T18:01:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:01:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:01:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:01:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:47 smithi189 ceph-mon[32756]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 432 KiB/s wr, 46 op/s 2024-04-26T18:01:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:47 smithi156 ceph-mon[32679]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 432 KiB/s wr, 46 op/s 2024-04-26T18:01:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:47 smithi092 ceph-mon[29156]: pgmap v67: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 432 KiB/s wr, 46 op/s 2024-04-26T18:01:48.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 95.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:49 smithi189 ceph-mon[32756]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:01:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:49 smithi156 ceph-mon[32679]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:01:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:49 smithi092 ceph-mon[29156]: pgmap v68: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:01:50.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:01:50.547 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 -- 172.21.15.92:0/4224620529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c81010e0 msgr2=0x7f17c81014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/4224620529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c81010e0 0x7f17c81014c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009900 tx=0x7f17b802a410 comp rx=0 tx=0).stop 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 -- 172.21.15.92:0/4224620529 shutdown_connections 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/4224620529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 0x7f17c810f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/4224620529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c8101a90 0x7f17c81075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/4224620529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c81010e0 0x7f17c81014c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 -- 172.21.15.92:0/4224620529 >> 172.21.15.92:0/4224620529 conn(0x7f17c8077dc0 msgr2=0x7f17c80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 -- 172.21.15.92:0/4224620529 shutdown_connections 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 -- 172.21.15.92:0/4224620529 wait complete. 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.440+0000 7f17cdc2a640 1 Processor -- start 2024-04-26T18:01:51.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 -- start start 2024-04-26T18:01:51.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c81010e0 0x7f17c8102050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 0x7f17c8102590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8112c50 con 0x7f17c8102ad0 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8112ad0 con 0x7f17c8107cf0 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17cdc2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8112dd0 con 0x7f17c81010e0 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41798/0 (socket says 172.21.15.92:41798) 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 -- 172.21.15.92:0/1931732082 learned_addr learned my addr 172.21.15.92:0/1931732082 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:51.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 0x7f17c8102590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c77fe640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c81010e0 0x7f17c8102050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 -- 172.21.15.92:0/1931732082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c81010e0 msgr2=0x7f17c8102050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c81010e0 0x7f17c8102050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 -- 172.21.15.92:0/1931732082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 msgr2=0x7f17c8102590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 0x7f17c8102590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.441+0000 7f17c7fff640 1 -- 172.21.15.92:0/1931732082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c81a79c0 con 0x7f17c8102ad0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17c7fff640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17c000cad0 tx=0x7f17c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17c4ff9640 1 -- 172.21.15.92:0/1931732082 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c000ae20 con 0x7f17c8102ad0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17c4ff9640 1 -- 172.21.15.92:0/1931732082 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c0005020 con 0x7f17c8102ad0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c81a7cb0 con 0x7f17c8102ad0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17c4ff9640 1 -- 172.21.15.92:0/1931732082 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c000f6b0 con 0x7f17c8102ad0 2024-04-26T18:01:51.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.442+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c81a8200 con 0x7f17c8102ad0 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c4ff9640 1 -- 172.21.15.92:0/1931732082 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f17c00051d0 con 0x7f17c8102ad0 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 Processor -- start 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 -- start start 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e2f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e3c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562777d95460 con 0x562777e2f820 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562777d4f590 con 0x562777e2ef00 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17d0a21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562777d91420 con 0x562777e3a0e0 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c4ff9640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 0x7f17b00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41814/0 (socket says 172.21.15.92:41814) 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c77fe640 1 -- 172.21.15.92:0/4080289109 learned_addr learned my addr 172.21.15.92:0/4080289109 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e2f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e3c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.445+0000 7f17c7fff640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 0x7f17b00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c4ff9640 1 -- 172.21.15.92:0/1931732082 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f17c00d0730 con 0x7f17c8102ad0 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 -- 172.21.15.92:0/4080289109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 msgr2=0x562777e3c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e3c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 -- 172.21.15.92:0/4080289109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 msgr2=0x562777e2f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e2f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 -- 172.21.15.92:0/4080289109 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562777d5c0d0 con 0x562777e2f820 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e2f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c77fe640 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009230 tx=0x7f17b8004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e64e64d8b05f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17c7fff640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 0x7f17b00a6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17c00cdfa0 tx=0x7f17c0087040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17adffb640 1 -- 172.21.15.92:0/4080289109 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8035030 con 0x562777e2f820 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17adffb640 1 -- 172.21.15.92:0/4080289109 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b80046c0 con 0x562777e2f820 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.446+0000 7f17adffb640 1 -- 172.21.15.92:0/4080289109 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005d50 con 0x562777e2f820 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- 172.21.15.92:0/4080289109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 msgr2=0x562777e39ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009230 tx=0x7f17b8004390 comp rx=0 tx=0).stop 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- 172.21.15.92:0/4080289109 shutdown_connections 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e3c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e39ba0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 --2- 172.21.15.92:0/4080289109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e2f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- 172.21.15.92:0/4080289109 >> 172.21.15.92:0/4080289109 conn(0x562777e2b410 msgr2=0x562777e2b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- 172.21.15.92:0/4080289109 shutdown_connections 2024-04-26T18:01:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- 172.21.15.92:0/4080289109 wait complete. 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 -- start start 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.447+0000 7f17d0a21740 1 Processor -- start 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e37080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e2f820 0x562777e375c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562777e3ccb0 con 0x562777e3a0e0 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562777d1cb60 con 0x562777e2ef00 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562777e3ce30 con 0x562777e2f820 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17d0a21740 10 client.0 _ll_register_callbacks cb 0x562777d412b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41824/0 (socket says 172.21.15.92:41824) 2024-04-26T18:01:51.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 -- 172.21.15.92:0/3410234289 learned_addr learned my addr 172.21.15.92:0/3410234289 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e2f820 0x562777e375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e37080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 -- 172.21.15.92:0/3410234289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e2f820 msgr2=0x562777e375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e2f820 0x562777e375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 -- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 msgr2=0x562777e37080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e37080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 -- 172.21.15.92:0/3410234289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562777aa7210 con 0x562777e3a0e0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f17c806aa70 tx=0x7f17bc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b568593cf0736 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc010c60 con 0x562777e3a0e0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.448+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f17bc010e00 con 0x562777e3a0e0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17b80046c0 con 0x562777e3a0e0 2024-04-26T18:01:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17bc029050 con 0x562777e3a0e0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 10 client.15537 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562777b73620 con 0x562777e3a0e0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17b80046c0 con 0x562777e3a0e0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f17bc003bf0 con 0x562777e3a0e0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 10 client.15537 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 20 client.15537 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777e4a2b0 0x562777e4c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 4 client.15537 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562777da3070 con 0x562777e4a2b0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.449+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777e4a2b0 0x562777e4c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.450+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777e4a2b0 0x562777e4c6c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb59264ae660d3c1 server_cookie=a58935320fe4ad71 in_seq=0 out_seq=0 2024-04-26T18:01:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.450+0000 7f17a6ffd640 10 client.15537 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3410234289 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562777da3070 con 0x562777e4a2b0 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17a6ffd640 10 client.15537 handle_command_reply: tid=0 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 client.15537 shutdown 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 msgr2=0x562777e37b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f17c806aa70 tx=0x7f17bc014040 comp rx=0 tx=0).stop 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 shutdown_connections 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777e4a2b0 0x562777e4c6c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e3a0e0 0x562777e37b00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e2f820 0x562777e375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3410234289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e37080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17a6ffd640 0 client.15537 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 >> 172.21.15.92:0/3410234289 conn(0x562777e2b410 msgr2=0x562777e31190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 shutdown_connections 2024-04-26T18:01:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 1 -- 172.21.15.92:0/3410234289 wait complete. 2024-04-26T18:01:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.451+0000 7f17d0a21740 20 client.15537 trim_cache size 0 max 16384 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 Processor -- start 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 -- start start 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2f820 0x562777e31010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e52020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81b2e50 con 0x562777e2ef00 2024-04-26T18:01:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81b06f0 con 0x562777e2f820 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17d0a21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81ae580 con 0x562777e3a0e0 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41834/0 (socket says 172.21.15.92:41834) 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 -- 172.21.15.92:0/1359638889 learned_addr learned my addr 172.21.15.92:0/1359638889 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 -- 172.21.15.92:0/1359638889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 msgr2=0x562777e52020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e52020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 -- 172.21.15.92:0/1359638889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2f820 msgr2=0x562777e31010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2f820 0x562777e31010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.466+0000 7f17c6ffd640 1 -- 172.21.15.92:0/1359638889 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562777e35610 con 0x562777e2ef00 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000c00 tx=0x7f17bc024710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d03467b701bfc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17ad7fa640 1 -- 172.21.15.92:0/1359638889 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc031020 con 0x562777e2ef00 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17ad7fa640 1 -- 172.21.15.92:0/1359638889 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17bc012230 con 0x562777e2ef00 2024-04-26T18:01:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17ad7fa640 1 -- 172.21.15.92:0/1359638889 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005020 con 0x562777e2ef00 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 -- 172.21.15.92:0/1359638889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 msgr2=0x562777e45b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f17bc000c00 tx=0x7f17bc024710 comp rx=0 tx=0).stop 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 -- 172.21.15.92:0/1359638889 shutdown_connections 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777e52020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2f820 0x562777e31010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 --2- 172.21.15.92:0/1359638889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2ef00 0x562777e45b70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 -- 172.21.15.92:0/1359638889 >> 172.21.15.92:0/1359638889 conn(0x562777e2b410 msgr2=0x562777e30900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 -- 172.21.15.92:0/1359638889 shutdown_connections 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.467+0000 7f17d0a21740 1 -- 172.21.15.92:0/1359638889 wait complete. 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 -- start start 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 Processor -- start 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777eaf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81aebd0 con 0x562777e2f820 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81b0020 con 0x562777e2ef00 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f17c81af280 con 0x562777e3a0e0 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17d0a21740 10 client.0 _ll_register_callbacks cb 0x7f17bc0126f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41836/0 (socket says 172.21.15.92:41836) 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c77fe640 1 -- 172.21.15.92:0/3178455061 learned_addr learned my addr 172.21.15.92:0/3178455061 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:51.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c77fe640 1 -- 172.21.15.92:0/3178455061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 msgr2=0x562777eaf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.468+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777eaf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17c77fe640 1 -- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 msgr2=0x562777e340c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e340c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17c77fe640 1 -- 172.21.15.92:0/3178455061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562777eafdd0 con 0x562777e2f820 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17c77fe640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000c00 tx=0x7f17b80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46896766b3d8c1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8035040 con 0x562777e2f820 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f17b80318b0 con 0x562777e2f820 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17bc012230 con 0x562777e2f820 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17b8005d50 con 0x562777e2f820 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 10 client.15543 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:51.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562777eb0ee0 con 0x562777e2f820 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17bc012230 con 0x562777e2f820 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f17b80505a0 con 0x562777e2f820 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 10 client.15543 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 20 client.15543 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777eb12d0 0x562777eb36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 4 client.15543 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.469+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562777d9cee0 con 0x562777eb12d0 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.470+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777eb12d0 0x562777eb36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.470+0000 7f17a6ffd640 10 client.15543 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:51.475 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.470+0000 7f17c6ffd640 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777eb12d0 0x562777eb36c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=553983d4911736f1 server_cookie=87bcd45e5d43d3f2 in_seq=0 out_seq=0 2024-04-26T18:01:51.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17a6ffd640 1 -- 172.21.15.92:0/3178455061 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562777d9cee0 con 0x562777eb12d0 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17a6ffd640 10 client.15543 handle_command_reply: tid=0 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 client.15543 shutdown 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 msgr2=0x562777e34600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f17b8000c00 tx=0x7f17b80092d0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 shutdown_connections 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562777eb12d0 0x562777eb36c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562777e3a0e0 0x562777eaf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562777e2f820 0x562777e34600 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 --2- 172.21.15.92:0/3178455061 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562777e2ef00 0x562777e340c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17a6ffd640 0 client.15543 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 >> 172.21.15.92:0/3178455061 conn(0x562777e2b410 msgr2=0x562777e378d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 shutdown_connections 2024-04-26T18:01:51.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 1 -- 172.21.15.92:0/3178455061 wait complete. 2024-04-26T18:01:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.480+0000 7f17d0a21740 20 client.15543 trim_cache size 0 max 16384 2024-04-26T18:01:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:01:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:01:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:01:51.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 msgr2=0x7f17b00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 0x7f17b00a6300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f17c00cdfa0 tx=0x7f17c0087040 comp rx=0 tx=0).stop 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 msgr2=0x7f17c81a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f17c000cad0 tx=0x7f17c000cf90 comp rx=0 tx=0).stop 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 shutdown_connections 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f17b00a3e40 0x7f17b00a6300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17c8102ad0 0x7f17c81a7320 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17c8107cf0 0x7f17c8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 --2- 172.21.15.92:0/1931732082 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f17c81010e0 0x7f17c8102050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 >> 172.21.15.92:0/1931732082 conn(0x7f17c8077dc0 msgr2=0x7f17c80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 shutdown_connections 2024-04-26T18:01:51.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:01:51.481+0000 7f17cdc2a640 1 -- 172.21.15.92:0/1931732082 wait complete. 2024-04-26T18:01:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:51 smithi189 ceph-mon[32756]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:51 smithi156 ceph-mon[32679]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:51 smithi092 ceph-mon[29156]: pgmap v69: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:52.698 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- 172.21.15.92:0/680680516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e01027a0 msgr2=0x7fe5e0110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/680680516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e01027a0 0x7fe5e0110210 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800b0a0 tx=0x7fe5d800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- 172.21.15.92:0/680680516 shutdown_connections 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/680680516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e01027a0 0x7fe5e0110210 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/680680516 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e0108500 0x7fe5e01088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/680680516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0101de0 0x7fe5e0102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- 172.21.15.92:0/680680516 >> 172.21.15.92:0/680680516 conn(0x7fe5e0077640 msgr2=0x7fe5e0077a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- 172.21.15.92:0/680680516 shutdown_connections 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- 172.21.15.92:0/680680516 wait complete. 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 Processor -- start 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.692+0000 7fe5e74aa700 1 -- start start 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:52.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e01027a0 0x7fe5e019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 0x7fe5e0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0113690 con 0x7fe5e0101de0 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0113510 con 0x7fe5e0108500 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0113810 con 0x7fe5e01027a0 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41848/0 (socket says 172.21.15.92:41848) 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 -- 172.21.15.92:0/2250580576 learned_addr learned my addr 172.21.15.92:0/2250580576 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5a47700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 0x7fe5e0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 -- 172.21.15.92:0/2250580576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e01027a0 msgr2=0x7fe5e019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e4a45700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e01027a0 0x7fe5e019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e01027a0 0x7fe5e019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 -- 172.21.15.92:0/2250580576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 msgr2=0x7fe5e0199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 0x7fe5e0199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 -- 172.21.15.92:0/2250580576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e019a0b0 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5a47700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 0x7fe5e0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e5246700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00b500 tx=0x7fe5dc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc015020 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e019a3a0 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5dc011ce0 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc010d60 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.693+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01a6660 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.694+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e006a110 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.695+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe5dc018020 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.696+0000 7fe5d67fc700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 0x7fe5cc0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.696+0000 7fe5e4a45700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 0x7fe5cc0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.696+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fe5dc0d04c0 con 0x7fe5e0101de0 2024-04-26T18:01:52.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.697+0000 7fe5e4a45700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 0x7fe5cc0a6270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0077b40 tx=0x7fe5d0005cf0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:52.702 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.700+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fe5dc01f020 con 0x7fe5e0101de0 2024-04-26T18:01:52.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.944+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5e002e490 con 0x7fe5e0101de0 2024-04-26T18:01:52.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.945+0000 7fe5d67fc700 1 -- 172.21.15.92:0/2250580576 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11887 (secure 0 0 0) 0x7fe5dc09cc80 con 0x7fe5e0101de0 2024-04-26T18:01:52.946 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:01:52.946 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:00:22.436646+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 msgr2=0x7fe5cc0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 0x7fe5cc0a6270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0077b40 tx=0x7fe5d0005cf0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 msgr2=0x7fe5e019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00b500 tx=0x7fe5dc00b8c0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 shutdown_connections 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe5cc0a3db0 0x7fe5cc0a6270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e0108500 0x7fe5e0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5e0101de0 0x7fe5e019f790 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.948 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 --2- 172.21.15.92:0/2250580576 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5e01027a0 0x7fe5e019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:52.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 >> 172.21.15.92:0/2250580576 conn(0x7fe5e0077640 msgr2=0x7fe5e01008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:52.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 shutdown_connections 2024-04-26T18:01:52.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:52.948+0000 7fe5e74aa700 1 -- 172.21.15.92:0/2250580576 wait complete. 2024-04-26T18:01:52.949 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 29 2024-04-26T18:01:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 100.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:01:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:53 smithi189 ceph-mon[32756]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-04-26T18:01:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:53 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2250580576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:53 smithi156 ceph-mon[32679]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-04-26T18:01:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:53 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2250580576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:53.712 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:53 smithi092 ceph-mon[29156]: pgmap v70: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-04-26T18:01:53.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:53 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2250580576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:01:53.741 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db --set-id 9075dd48 --release --await' 2024-04-26T18:01:53.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db --set-id 9075dd48 --release --await 2024-04-26T18:01:54.036 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:01:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:55 smithi189 ceph-mon[32756]: pgmap v71: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:55.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:55 smithi092 ceph-mon[29156]: pgmap v71: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:55 smithi156 ceph-mon[32679]: pgmap v71: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-04-26T18:01:55.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 -- 172.21.15.92:0/3575998045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806c360 msgr2=0x7f6ae81102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/3575998045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806c360 0x7f6ae81102d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000b0a0 tx=0x7f6ae000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 -- 172.21.15.92:0/3575998045 shutdown_connections 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/3575998045 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae8109490 0x7f6ae8109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/3575998045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806c360 0x7f6ae81102d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/3575998045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae806b9c0 0x7f6ae806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 -- 172.21.15.92:0/3575998045 >> 172.21.15.92:0/3575998045 conn(0x7f6ae8079290 msgr2=0x7f6ae80796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 -- 172.21.15.92:0/3575998045 shutdown_connections 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.867+0000 7f6aecf8e700 1 -- 172.21.15.92:0/3575998045 wait complete. 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 Processor -- start 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 -- start start 2024-04-26T18:01:55.986 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 0x7f6ae8102920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae8109490 0x7f6ae8102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8113640 con 0x7f6ae806b9c0 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81134c0 con 0x7f6ae806c360 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6aecf8e700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81137c0 con 0x7f6ae8109490 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6ae659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6ae659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37814/0 (socket says 172.21.15.92:37814) 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.868+0000 7f6ae659c700 1 -- 172.21.15.92:0/1777399804 learned_addr learned my addr 172.21.15.92:0/1777399804 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 0x7f6ae8102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae8109490 0x7f6ae8102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 -- 172.21.15.92:0/1777399804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae8109490 msgr2=0x7f6ae8102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae8109490 0x7f6ae8102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 -- 172.21.15.92:0/1777399804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 msgr2=0x7f6ae8102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.987 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 0x7f6ae8102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 -- 172.21.15.92:0/1777399804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81a8030 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 0x7f6ae8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c920 tx=0x7f6ad800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6adffff700 1 -- 172.21.15.92:0/1777399804 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8007b00 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81a8320 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6adffff700 1 -- 172.21.15.92:0/1777399804 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8004ce0 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6adffff700 1 -- 172.21.15.92:0/1777399804 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8005650 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.869+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a88b0 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.871+0000 7f6adffff700 1 -- 172.21.15.92:0/1777399804 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6ad8007ca0 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.872+0000 7f6adffff700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 0x7f6ad40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.872+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 0x7f6ad40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.872+0000 7f6adffff700 1 -- 172.21.15.92:0/1777399804 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6ad80d0790 con 0x7f6ae806b9c0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.872+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 0x7f6ad40a6270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8079870 tx=0x7f6ad0008040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:55.988 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 Processor -- start 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 -- start start 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513118280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513112250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560513064930 con 0x560513112870 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560512fcaa30 con 0x560513117ea0 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.873+0000 7f6af7820b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5605130608f0 con 0x5605131187c0 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37820/0 (socket says 172.21.15.92:37820) 2024-04-26T18:01:55.989 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/3682904500 learned_addr learned my addr 172.21.15.92:0/3682904500 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae659c700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513118280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6addd9b700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.990 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/3682904500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 msgr2=0x560513112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513112250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/3682904500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 msgr2=0x560513118280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513118280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/3682904500 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560512fb19d0 con 0x560513112870 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae659c700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513118280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00092e0 tx=0x7f6ae0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e0369ce6e9b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6adcd99700 1 -- 172.21.15.92:0/3682904500 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0004a50 con 0x560513112870 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6adcd99700 1 -- 172.21.15.92:0/3682904500 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae0004bf0 con 0x560513112870 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.874+0000 7f6adcd99700 1 -- 172.21.15.92:0/3682904500 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae001c750 con 0x560513112870 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- 172.21.15.92:0/3682904500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 msgr2=0x560513112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00092e0 tx=0x7f6ae0009310 comp rx=0 tx=0).stop 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- 172.21.15.92:0/3682904500 shutdown_connections 2024-04-26T18:01:55.991 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513118280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x560513112cd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 --2- 172.21.15.92:0/3682904500 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- 172.21.15.92:0/3682904500 >> 172.21.15.92:0/3682904500 conn(0x5605130406c0 msgr2=0x56051310d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- 172.21.15.92:0/3682904500 shutdown_connections 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- 172.21.15.92:0/3682904500 wait complete. 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 -- start start 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.875+0000 7f6af7820b80 1 Processor -- start 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513112870 0x56051311e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605131187c0 0x56051311bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56051311f1d0 con 0x560513117ea0 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56051301eb80 con 0x5605131187c0 2024-04-26T18:01:55.992 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56051311f350 con 0x560513112870 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 10 client.0 _ll_register_callbacks cb 0x560512ffca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37832/0 (socket says 172.21.15.92:37832) 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 -- 172.21.15.92:0/52353960 learned_addr learned my addr 172.21.15.92:0/52353960 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605131187c0 0x56051311bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6ae659c700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513112870 0x56051311e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 -- 172.21.15.92:0/52353960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513112870 msgr2=0x56051311e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513112870 0x56051311e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 -- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605131187c0 msgr2=0x56051311bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605131187c0 0x56051311bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 -- 172.21.15.92:0/52353960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560513022580 con 0x560513117ea0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6addd9b700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000ddd0 tx=0x7f6ad0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa7be602ae8d6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:55.993 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6acdffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0014c50 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6ad0014df0 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae0004bf0 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.876+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ad002d050 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 10 client.15561 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605131298e0 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae0004bf0 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f6ad0013070 con 0x560513117ea0 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 10 client.15561 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:55.994 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 10 client.15561 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 20 client.15561 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56051312bff0 0x56051312e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 4 client.15561 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560513072310 con 0x56051312bff0 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.877+0000 7f6ae659c700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56051312bff0 0x56051312e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.878+0000 7f6acdffb700 10 client.15561 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.878+0000 7f6ae659c700 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56051312bff0 0x56051312e430 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54efb9db39a1160 server_cookie=36046f31622f3384 in_seq=0 out_seq=0 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.878+0000 7f6acdffb700 1 -- 172.21.15.92:0/52353960 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560513072310 con 0x56051312bff0 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.878+0000 7f6acdffb700 10 client.15561 handle_command_reply: tid=0 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 client.15561 shutdown 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 msgr2=0x56051311b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000ddd0 tx=0x7f6ad0004750 comp rx=0 tx=0).stop 2024-04-26T18:01:55.995 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 shutdown_connections 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56051312bff0 0x56051312e430 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605131187c0 0x56051311bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513112870 0x56051311e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 --2- 172.21.15.92:0/52353960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513117ea0 0x56051311b7d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 >> 172.21.15.92:0/52353960 conn(0x5605130406c0 msgr2=0x560513111240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6acdffb700 0 client.15561 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 shutdown_connections 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 1 -- 172.21.15.92:0/52353960 wait complete. 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.879+0000 7f6af7820b80 20 client.15561 trim_cache size 0 max 16384 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.898+0000 7f6af7820b80 1 Processor -- start 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.898+0000 7f6af7820b80 1 -- start start 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.898+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 0x560513112250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.898+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513117ea0 0x5605131280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6af7820b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81b2610 con 0x5605131187c0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6af7820b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81afe70 con 0x560513112870 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6af7820b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81add00 con 0x560513117ea0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37838/0 (socket says 172.21.15.92:37838) 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/505756823 learned_addr learned my addr 172.21.15.92:0/505756823 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6addd9b700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513117ea0 0x5605131280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae659c700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 0x560513112250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/505756823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513117ea0 msgr2=0x5605131280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513117ea0 0x5605131280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/505756823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 msgr2=0x560513112250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 0x560513112250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 -- 172.21.15.92:0/505756823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051310df30 con 0x5605131187c0 2024-04-26T18:01:55.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae659c700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 0x560513112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0008f20 tx=0x7f6ae0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a005f0554bbb4d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6acffff700 1 -- 172.21.15.92:0/505756823 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0004e40 con 0x5605131187c0 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6acffff700 1 -- 172.21.15.92:0/505756823 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae0007950 con 0x5605131187c0 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.899+0000 7f6acffff700 1 -- 172.21.15.92:0/505756823 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0031bf0 con 0x5605131187c0 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- 172.21.15.92:0/505756823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 msgr2=0x560513106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0008f20 tx=0x7f6ae0000f40 comp rx=0 tx=0).stop 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- 172.21.15.92:0/505756823 shutdown_connections 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513112870 0x560513112250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5605131187c0 0x560513106d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 --2- 172.21.15.92:0/505756823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560513117ea0 0x5605131280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- 172.21.15.92:0/505756823 >> 172.21.15.92:0/505756823 conn(0x5605130406c0 msgr2=0x560513106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- 172.21.15.92:0/505756823 shutdown_connections 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- 172.21.15.92:0/505756823 wait complete. 2024-04-26T18:01:55.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 -- start start 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 Processor -- start 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.900+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513121af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513122030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ae350 con 0x560513112870 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81af7a0 con 0x560513117ea0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81aea00 con 0x5605131187c0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 10 client.0 _ll_register_callbacks cb 0x560512ffca50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37846/0 (socket says 172.21.15.92:37846) 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 -- 172.21.15.92:0/1563860436 learned_addr learned my addr 172.21.15.92:0/1563860436 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae6d9d700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513122030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:55.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 -- 172.21.15.92:0/1563860436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 msgr2=0x560513122030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513122030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 -- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 msgr2=0x560513121af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513121af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 -- 172.21.15.92:0/1563860436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560513192630 con 0x560513112870 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6ae659c700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8099110 tx=0x7f6ad8007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5404f405d24ef884 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6acdffb700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad801d040 con 0x560513112870 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6ad809a7e0 con 0x560513112870 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ae0007950 con 0x560513112870 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ad80a53b0 con 0x560513112870 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 10 client.15567 fetch_fsmap learned FSMap version 29 2024-04-26T18:01:56.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.901+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560513193920 con 0x560513112870 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 29, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 8, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "9075dd48": { 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 8, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:01:56.001 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 90.0, 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:01:56.002 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:56.003 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:56.003 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:56.003 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:56.003 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:01:56.003 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:01:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae0007950 con 0x560513112870 2024-04-26T18:01:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f6ad809c9a0 con 0x560513112870 2024-04-26T18:01:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 10 client.15567 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:01:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 10 client.15567 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:01:56.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 20 client.15567 populate_metadata read hostname 'smithi092' 2024-04-26T18:01:56.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560513194040 0x560513196460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 4 client.15567 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9075dd48", "release": true, "await": true}] 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9075dd48", "release": true, "await": true}) -- 0x56051306c3b0 con 0x560513194040 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560513194040 0x560513196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6acdffb700 10 client.15567 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.902+0000 7f6addd9b700 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560513194040 0x560513196460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ab90683a7ffd32 server_cookie=e6f2e33f8c82ede3 in_seq=0 out_seq=0 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6acdffb700 1 -- 172.21.15.92:0/1563860436 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x56051306c3b0 con 0x560513194040 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6acdffb700 10 client.15567 handle_command_reply: tid=0 2024-04-26T18:01:56.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 client.15567 shutdown 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 msgr2=0x5605131215b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8099110 tx=0x7f6ad8007610 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 shutdown_connections 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560513194040 0x560513196460 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5605131187c0 0x560513122030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6acdffb700 0 client.15567 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560513112870 0x5605131215b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 --2- 172.21.15.92:0/1563860436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560513117ea0 0x560513121af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 >> 172.21.15.92:0/1563860436 conn(0x5605130406c0 msgr2=0x560513106f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 shutdown_connections 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 1 -- 172.21.15.92:0/1563860436 wait complete. 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.950+0000 7f6af7820b80 20 client.15567 trim_cache size 0 max 16384 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 msgr2=0x7f6ad40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 0x7f6ad40a6270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8079870 tx=0x7f6ad0008040 comp rx=0 tx=0).stop 2024-04-26T18:01:56.008 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 msgr2=0x7f6ae81023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c920 tx=0x7f6ad800cce0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 shutdown_connections 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6ad40a3db0 0x7f6ad40a6270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6ae8109490 0x7f6ae8102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ae806b9c0 0x7f6ae81023e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 --2- 172.21.15.92:0/1777399804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ae806c360 0x7f6ae8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 >> 172.21.15.92:0/1777399804 conn(0x7f6ae8079290 msgr2=0x7f6ae8100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 shutdown_connections 2024-04-26T18:01:56.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:01:55.951+0000 7f6aecf8e700 1 -- 172.21.15.92:0/1777399804 wait complete. 2024-04-26T18:01:56.884 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9075dd48', seconds elapsed: 44.4 2024-04-26T18:01:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:57 smithi189 ceph-mon[32756]: pgmap v72: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-26T18:01:57.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:57 smithi156 ceph-mon[32679]: pgmap v72: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-26T18:01:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:57 smithi092 ceph-mon[29156]: pgmap v72: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-04-26T18:01:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 105.0 s, 2066.5 tps, lat 384.564 ms stddev 3655.071 2024-04-26T18:01:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:01:59 smithi189 ceph-mon[32756]: pgmap v73: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-26T18:01:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:01:59 smithi156 ceph-mon[32679]: pgmap v73: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-26T18:01:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:01:59 smithi092 ceph-mon[29156]: pgmap v73: 97 pgs: 97 active+clean; 1.1 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-04-26T18:02:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:01 smithi189 ceph-mon[32756]: pgmap v74: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-04-26T18:02:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:01 smithi156 ceph-mon[32679]: pgmap v74: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-04-26T18:02:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:01 smithi092 ceph-mon[29156]: pgmap v74: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.7 MiB/s wr, 180 op/s 2024-04-26T18:02:03.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 110.0 s, 3307.6 tps, lat 30.126 ms stddev 44.556 2024-04-26T18:02:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:03 smithi189 ceph-mon[32756]: pgmap v75: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2024-04-26T18:02:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:03 smithi156 ceph-mon[32679]: pgmap v75: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2024-04-26T18:02:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:03 smithi092 ceph-mon[29156]: pgmap v75: 97 pgs: 97 active+clean; 1.1 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 MiB/s wr, 176 op/s 2024-04-26T18:02:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.609+0000 7f93fff6a640 1 -- 172.21.15.92:0/4166034726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f8103bc0 msgr2=0x7f93f8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.609+0000 7f93fff6a640 1 --2- 172.21.15.92:0/4166034726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f8103bc0 0x7f93f8103fa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ca0 tx=0x7f93f402a940 comp rx=0 tx=0).stop 2024-04-26T18:02:04.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 -- 172.21.15.92:0/4166034726 shutdown_connections 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 --2- 172.21.15.92:0/4166034726 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f810cf90 0x7f93f810f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 --2- 172.21.15.92:0/4166034726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 --2- 172.21.15.92:0/4166034726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f8103bc0 0x7f93f8103fa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 -- 172.21.15.92:0/4166034726 >> 172.21.15.92:0/4166034726 conn(0x7f93f8078a40 msgr2=0x7f93f8078e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 -- 172.21.15.92:0/4166034726 shutdown_connections 2024-04-26T18:02:04.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.610+0000 7f93fff6a640 1 -- 172.21.15.92:0/4166034726 wait complete. 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 Processor -- start 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 -- start start 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 0x7f93f810bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.611+0000 7f93fff6a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8112c20 con 0x7f93f810cf90 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fff6a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8112aa0 con 0x7f93f81044e0 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fff6a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8112da0 con 0x7f93f8103bc0 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fe507640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fe507640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45794/0 (socket says 172.21.15.92:45794) 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fe507640 1 -- 172.21.15.92:0/2990383181 learned_addr learned my addr 172.21.15.92:0/2990383181 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:04.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 0x7f93f810bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fd505640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fdd06640 1 -- 172.21.15.92:0/2990383181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 msgr2=0x7f93f810c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fdd06640 1 -- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 msgr2=0x7f93f81a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.612+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fdd06640 1 -- 172.21.15.92:0/2990383181 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f81a4530 con 0x7f93f8103bc0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fd505640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fe507640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 0x7f93f810bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009bf0 tx=0x7f93f4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93eeffd640 1 -- 172.21.15.92:0/2990383181 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4034040 con 0x7f93f8103bc0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93eeffd640 1 -- 172.21.15.92:0/2990383181 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f402fd10 con 0x7f93f8103bc0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f81a47c0 con 0x7f93f8103bc0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.613+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81980b0 con 0x7f93f8103bc0 2024-04-26T18:02:04.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.614+0000 7f93eeffd640 1 -- 172.21.15.92:0/2990383181 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004840 con 0x7f93f8103bc0 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.617+0000 7f9402c82740 1 Processor -- start 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.617+0000 7f93eeffd640 1 -- 172.21.15.92:0/2990383181 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f93f4037020 con 0x7f93f8103bc0 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 -- start start 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d267969ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2678c5460 con 0x55d26796a0e0 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d26787f590 con 0x55d26795f820 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f9402c82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d2678c1420 con 0x55d26795ef00 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f93fe507640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f93fe507640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:51430/0 (socket says 172.21.15.92:51430) 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f93fe507640 1 -- 172.21.15.92:0/1717973539 learned_addr learned my addr 172.21.15.92:0/1717973539 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.618+0000 7f93eeffd640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 0x7f93e40a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fd505640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 -- 172.21.15.92:0/1717973539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 msgr2=0x55d267969ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93eeffd640 1 -- 172.21.15.92:0/2990383181 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f93f41137f0 con 0x7f93f8103bc0 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fdd06640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d267969ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d267969ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 -- 172.21.15.92:0/1717973539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 msgr2=0x55d26796c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 -- 172.21.15.92:0/1717973539 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26788c0d0 con 0x55d26795ef00 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 0x7f93e40a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fd505640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fdd06640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d267969ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93f000f540 tx=0x7f93f000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13cdc40b84cce3ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93e3fff640 1 -- 172.21.15.92:0/1717973539 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f000dcf0 con 0x55d26795ef00 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.619+0000 7f93fe507640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 0x7f93e40a61c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93f0021000 tx=0x7f93f001e000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f93e3fff640 1 -- 172.21.15.92:0/1717973539 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f0012110 con 0x55d26795ef00 2024-04-26T18:02:04.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f93e3fff640 1 -- 172.21.15.92:0/1717973539 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0019e40 con 0x55d26795ef00 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 -- 172.21.15.92:0/1717973539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 msgr2=0x55d26795f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93f000f540 tx=0x7f93f000fa00 comp rx=0 tx=0).stop 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 -- 172.21.15.92:0/1717973539 shutdown_connections 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d267969ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 --2- 172.21.15.92:0/1717973539 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d26795f2e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.620+0000 7f9402c82740 1 -- 172.21.15.92:0/1717973539 >> 172.21.15.92:0/1717973539 conn(0x55d26795b410 msgr2=0x55d26795b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.622+0000 7f9402c82740 1 -- 172.21.15.92:0/1717973539 shutdown_connections 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.622+0000 7f9402c82740 1 -- 172.21.15.92:0/1717973539 wait complete. 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.622+0000 7f9402c82740 1 -- start start 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.622+0000 7f9402c82740 1 Processor -- start 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d267967020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 0x55d267967560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26796a0e0 0x55d267967aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d26796cd10 con 0x55d26795f820 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d26784cb60 con 0x55d26796a0e0 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d26796ce90 con 0x55d26795ef00 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f9402c82740 10 client.0 _ll_register_callbacks cb 0x55d2678712b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f93fdd06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d267967020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f93fd505640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 0x55d267967560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f93fe507640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26796a0e0 0x55d267967aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f93fdd06640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d267967020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:51440/0 (socket says 172.21.15.92:51440) 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.623+0000 7f93fdd06640 1 -- 172.21.15.92:0/267483376 learned_addr learned my addr 172.21.15.92:0/267483376 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.624+0000 7f93fd505640 1 -- 172.21.15.92:0/267483376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 msgr2=0x55d267967020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.624+0000 7f93fd505640 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d267967020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.624+0000 7f93fd505640 1 -- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26796a0e0 msgr2=0x55d267967aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.624+0000 7f93fd505640 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26796a0e0 0x55d267967aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.624+0000 7f93fd505640 1 -- 172.21.15.92:0/267483376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2675d7210 con 0x55d26795f820 2024-04-26T18:02:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f93e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:02:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f93fd505640 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 0x55d267967560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d26795c5a0 tx=0x7f93e800f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3634b0eea1fc8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8005220 con 0x55d26795f820 2024-04-26T18:02:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f93e80053c0 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f0012110 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.625+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93e80055c0 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 10 client.15576 fetch_fsmap learned FSMap version 29 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2676a3620 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f0012110 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f93e8021020 con 0x55d26795f820 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 10 client.15576 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 20 client.15576 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d26797a1d0 0x55d26797c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.626+0000 7f9402c82740 4 client.15576 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.627+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2678d3070 con 0x55d26797a1d0 2024-04-26T18:02:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.627+0000 7f93fdd06640 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d26797a1d0 0x55d26797c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f93e17fa640 10 client.15576 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f93fdd06640 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d26797a1d0 0x55d26797c600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843e0499f64a75b5 server_cookie=b969930b1ec62f34 in_seq=0 out_seq=0 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f93e17fa640 1 -- 172.21.15.92:0/267483376 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d2678d3070 con 0x55d26797a1d0 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f93e17fa640 10 client.15576 handle_command_reply: tid=0 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 client.15576 shutdown 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 msgr2=0x55d267967560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 0x55d267967560 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d26795c5a0 tx=0x7f93e800f870 comp rx=0 tx=0).stop 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 shutdown_connections 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d26797a1d0 0x55d26797c600 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26796a0e0 0x55d267967aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795f820 0x55d267967560 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f93e17fa640 0 client.15576 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 --2- 172.21.15.92:0/267483376 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795ef00 0x55d267967020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.628+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 >> 172.21.15.92:0/267483376 conn(0x55d26795b410 msgr2=0x55d267961140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.629+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 shutdown_connections 2024-04-26T18:02:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.629+0000 7f9402c82740 1 -- 172.21.15.92:0/267483376 wait complete. 2024-04-26T18:02:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.629+0000 7f9402c82740 20 client.15576 trim_cache size 0 max 16384 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 Processor -- start 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 -- start start 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795ef00 0x55d267975bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26796a0e0 0x55d267981ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc010fd0 con 0x55d26795ef00 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00e870 con 0x55d26795f820 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f9402c82740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00c6c0 con 0x55d26796a0e0 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f93fd505640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f93fd505640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:37118/0 (socket says 172.21.15.92:37118) 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f93fd505640 1 -- 172.21.15.92:0/4183817831 learned_addr learned my addr 172.21.15.92:0/4183817831 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.654+0000 7f93fdd06640 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795ef00 0x55d267975bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fe507640 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26796a0e0 0x55d267981ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 -- 172.21.15.92:0/4183817831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26796a0e0 msgr2=0x55d267981ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26796a0e0 0x55d267981ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 -- 172.21.15.92:0/4183817831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795ef00 msgr2=0x55d267975bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795ef00 0x55d267975bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 -- 172.21.15.92:0/4183817831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d267965fd0 con 0x55d26795f820 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93fd505640 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93e8011e70 tx=0x7f93e8011ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d442b9fd0079a459 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93e37fe640 1 -- 172.21.15.92:0/4183817831 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8029040 con 0x55d26795f820 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93e37fe640 1 -- 172.21.15.92:0/4183817831 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e8011710 con 0x55d26795f820 2024-04-26T18:02:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.655+0000 7f93e37fe640 1 -- 172.21.15.92:0/4183817831 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8023da0 con 0x55d26795f820 2024-04-26T18:02:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- 172.21.15.92:0/4183817831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 msgr2=0x55d26795a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93e8011e70 tx=0x7f93e8011ef0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- 172.21.15.92:0/4183817831 shutdown_connections 2024-04-26T18:02:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26796a0e0 0x55d267981ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795f820 0x55d26795a5b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 --2- 172.21.15.92:0/4183817831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26795ef00 0x55d267975bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- 172.21.15.92:0/4183817831 >> 172.21.15.92:0/4183817831 conn(0x55d26795b410 msgr2=0x55d26795b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- 172.21.15.92:0/4183817831 shutdown_connections 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- 172.21.15.92:0/4183817831 wait complete. 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.657+0000 7f9402c82740 1 -- start start 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.658+0000 7f9402c82740 1 Processor -- start 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.658+0000 7f9402c82740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.658+0000 7f9402c82740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795f820 0x55d267972620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f93fdd06640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f93fdd06640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:37132/0 (socket says 172.21.15.92:37132) 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f93fdd06640 1 -- 172.21.15.92:0/2524708021 learned_addr learned my addr 172.21.15.92:0/2524708021 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00cd30 con 0x55d26796a0e0 2024-04-26T18:02:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00e1a0 con 0x55d26795ef00 2024-04-26T18:02:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f93dc00d400 con 0x55d26795f820 2024-04-26T18:02:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f9402c82740 10 client.0 _ll_register_callbacks cb 0x7f93e800a3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.659+0000 7f93fd505640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795f820 0x55d267972620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fe507640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 -- 172.21.15.92:0/2524708021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795f820 msgr2=0x55d267972620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795f820 0x55d267972620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 -- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 msgr2=0x55d26796f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26796f9a0 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fe507640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93fdd06640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93f40dbd70 tx=0x7f93f40095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95505793460c2fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.660+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40df910 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f93f4030a20 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93e8011710 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f93f40e3cc0 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 10 client.25139 fetch_fsmap learned FSMap version 29 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2679e1340 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e8011710 con 0x55d26795ef00 2024-04-26T18:02:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7f93f406d030 con 0x55d26795ef00 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 10 client.25139 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 10 client.25139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 20 client.25139 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d2679e1af0 0x55d2679e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 4 client.25139 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.661+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2678ccee0 con 0x55d2679e1af0 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.662+0000 7f93fd505640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d2679e1af0 0x55d2679e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.662+0000 7f93e17fa640 10 client.25139 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:04.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.662+0000 7f93fd505640 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d2679e1af0 0x55d2679e3f10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690cfc2b82ccdb13 server_cookie=c67c5cb50366c768 in_seq=0 out_seq=0 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f93e17fa640 1 -- 172.21.15.92:0/2524708021 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2678ccee0 con 0x55d2679e1af0 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f93e17fa640 10 client.25139 handle_command_reply: tid=0 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 client.25139 shutdown 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 msgr2=0x55d2679720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f93f40dbd70 tx=0x7f93f40095c0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 shutdown_connections 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d2679e1af0 0x55d2679e3f10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f93e17fa640 0 client.25139 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d26796a0e0 0x55d26796f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d26795f820 0x55d267972620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 --2- 172.21.15.92:0/2524708021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d26795ef00 0x55d2679720e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 >> 172.21.15.92:0/2524708021 conn(0x55d26795b410 msgr2=0x55d267961140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 shutdown_connections 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 1 -- 172.21.15.92:0/2524708021 wait complete. 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.671+0000 7f9402c82740 20 client.25139 trim_cache size 0 max 16384 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:02:04.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 msgr2=0x7f93e40a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 0x7f93e40a61c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93f0021000 tx=0x7f93f001e000 comp rx=0 tx=0).stop 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 msgr2=0x7f93f810bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 0x7f93f810bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009bf0 tx=0x7f93f4003ba0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 shutdown_connections 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f93e40a3d00 0x7f93e40a61c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93f810cf90 0x7f93f81a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f93f81044e0 0x7f93f810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 --2- 172.21.15.92:0/2990383181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f93f8103bc0 0x7f93f810bbc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 >> 172.21.15.92:0/2990383181 conn(0x7f93f8078a40 msgr2=0x7f93f80ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 shutdown_connections 2024-04-26T18:02:04.675 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:04.672+0000 7f93fff6a640 1 -- 172.21.15.92:0/2990383181 wait complete. 2024-04-26T18:02:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:05 smithi189 ceph-mon[32756]: pgmap v76: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-04-26T18:02:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:05 smithi156 ceph-mon[32679]: pgmap v76: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-04-26T18:02:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:05 smithi092 ceph-mon[29156]: pgmap v76: 97 pgs: 97 active+clean; 1.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-04-26T18:02:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:06 smithi189 ceph-mon[32756]: pgmap v77: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:06 smithi156 ceph-mon[32679]: pgmap v77: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:06 smithi092 ceph-mon[29156]: pgmap v77: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 115.0 s, 3552.2 tps, lat 28.152 ms stddev 29.693 2024-04-26T18:02:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:08 smithi189 ceph-mon[32756]: pgmap v78: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:08 smithi156 ceph-mon[32679]: pgmap v78: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:08 smithi092 ceph-mon[29156]: pgmap v78: 97 pgs: 97 active+clean; 1.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.42k op/s 2024-04-26T18:02:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:10 smithi189 ceph-mon[32756]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.74k op/s 2024-04-26T18:02:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:10 smithi156 ceph-mon[32679]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.74k op/s 2024-04-26T18:02:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:10 smithi092 ceph-mon[29156]: pgmap v79: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 MiB/s wr, 1.74k op/s 2024-04-26T18:02:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:12 smithi189 ceph-mon[32756]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2024-04-26T18:02:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:12 smithi156 ceph-mon[32679]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2024-04-26T18:02:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:12 smithi092 ceph-mon[29156]: pgmap v80: 97 pgs: 97 active+clean; 1.3 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.57k op/s 2024-04-26T18:02:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 120.0 s, 3704.4 tps, lat 26.999 ms stddev 27.057 2024-04-26T18:02:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:14 smithi189 ceph-mon[32756]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2024-04-26T18:02:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:14 smithi156 ceph-mon[32679]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2024-04-26T18:02:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:14 smithi092 ceph-mon[29156]: pgmap v81: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 21 MiB/s wr, 1.84k op/s 2024-04-26T18:02:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:16 smithi189 ceph-mon[32756]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-04-26T18:02:16.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:16 smithi156 ceph-mon[32679]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-04-26T18:02:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:16 smithi092 ceph-mon[29156]: pgmap v82: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 14 MiB/s wr, 1.14k op/s 2024-04-26T18:02:17.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.788+0000 7ffabdb33640 1 -- 172.21.15.92:0/1901446991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab810cf30 msgr2=0x7ffab810f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.788+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1901446991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab810cf30 0x7ffab810f3a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009ca0 tx=0x7ffab002a950 comp rx=0 tx=0).stop 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 -- 172.21.15.92:0/1901446991 shutdown_connections 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1901446991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab810cf30 0x7ffab810f3a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1901446991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8104480 0x7ffab810c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1901446991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab8103b60 0x7ffab8103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 -- 172.21.15.92:0/1901446991 >> 172.21.15.92:0/1901446991 conn(0x7ffab80fd300 msgr2=0x7ffab80ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 -- 172.21.15.92:0/1901446991 shutdown_connections 2024-04-26T18:02:17.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.789+0000 7ffabdb33640 1 -- 172.21.15.92:0/1901446991 wait complete. 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.790+0000 7ffabdb33640 1 Processor -- start 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 -- start start 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 0x7ffab810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 0x7ffab8106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffab81109c0 con 0x7ffab8104480 2024-04-26T18:02:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8110840 con 0x7ffab8103b60 2024-04-26T18:02:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffabdb33640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffab8110b40 con 0x7ffab810cf30 2024-04-26T18:02:17.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 0x7ffab8106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 0x7ffab810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58728/0 (socket says 172.21.15.92:58728) 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 0x7ffab8106280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44088/0 (socket says 172.21.15.92:44088) 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.791+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1584197641 learned_addr learned my addr 172.21.15.92:0/1584197641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 -- 172.21.15.92:0/1584197641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 msgr2=0x7ffab8106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 0x7ffab8106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 -- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 msgr2=0x7ffab810c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 -- 172.21.15.92:0/1584197641 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab8106b10 con 0x7ffab8103b60 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:17.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 0x7ffab810c1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e9f0 tx=0x7ffaa800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab4ff9640 1 -- 172.21.15.92:0/1584197641 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800ccc0 con 0x7ffab8103b60 2024-04-26T18:02:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffab4ff9640 1 -- 172.21.15.92:0/1584197641 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa80108e0 con 0x7ffab8103b60 2024-04-26T18:02:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.792+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab8106e00 con 0x7ffab8103b60 2024-04-26T18:02:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.793+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab81b4ab0 con 0x7ffab8103b60 2024-04-26T18:02:17.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.793+0000 7ffab4ff9640 1 -- 172.21.15.92:0/1584197641 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8018880 con 0x7ffab8103b60 2024-04-26T18:02:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.796+0000 7ffab4ff9640 1 -- 172.21.15.92:0/1584197641 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ffaa8018a20 con 0x7ffab8103b60 2024-04-26T18:02:17.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.796+0000 7ffac084b740 1 Processor -- start 2024-04-26T18:02:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 -- start start 2024-04-26T18:02:17.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b262010460 con 0x55b2620b50e0 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b261fca590 con 0x55b2620aa820 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffac084b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b26200c420 con 0x55b2620a9f00 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58738/0 (socket says 172.21.15.92:58738) 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffab6ffd640 1 -- 172.21.15.92:0/4004867364 learned_addr learned my addr 172.21.15.92:0/4004867364 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:17.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.797+0000 7ffab7fff640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab4ff9640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 0x7ffaa00a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab77fe640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab7fff640 1 -- 172.21.15.92:0/4004867364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 msgr2=0x55b2620b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab7fff640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab7fff640 1 -- 172.21.15.92:0/4004867364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 msgr2=0x55b2620b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab7fff640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.798+0000 7ffab7fff640 1 -- 172.21.15.92:0/4004867364 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b261fd70d0 con 0x55b2620a9f00 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffab7fff640 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620aa2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006010 tx=0x7ffab002f500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=358b8699e03670bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffab7fff640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 0x7ffaa00a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffa9dffb640 1 -- 172.21.15.92:0/4004867364 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab004a070 con 0x55b2620a9f00 2024-04-26T18:02:17.800 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffab4ff9640 1 -- 172.21.15.92:0/1584197641 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7ffaa80d0b20 con 0x7ffab8103b60 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.799+0000 7ffa9dffb640 1 -- 172.21.15.92:0/4004867364 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab0003e20 con 0x55b2620a9f00 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffa9dffb640 1 -- 172.21.15.92:0/4004867364 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0041030 con 0x55b2620a9f00 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 -- 172.21.15.92:0/4004867364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 msgr2=0x55b2620aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620aa2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006010 tx=0x7ffab002f500 comp rx=0 tx=0).stop 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffab7fff640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 0x7ffaa00a6370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffab0004490 tx=0x7ffab0004400 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 -- 172.21.15.92:0/4004867364 shutdown_connections 2024-04-26T18:02:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 --2- 172.21.15.92:0/4004867364 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620aa2e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.800+0000 7ffac084b740 1 -- 172.21.15.92:0/4004867364 >> 172.21.15.92:0/4004867364 conn(0x55b2620a6410 msgr2=0x55b2620a67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.802+0000 7ffac084b740 1 -- 172.21.15.92:0/4004867364 shutdown_connections 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.802+0000 7ffac084b740 1 -- 172.21.15.92:0/4004867364 wait complete. 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.802+0000 7ffac084b740 1 -- start start 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.802+0000 7ffac084b740 1 Processor -- start 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620b50e0 0x55b2620b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b2620b7cb0 con 0x55b2620aa820 2024-04-26T18:02:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b261f97b60 con 0x55b2620a9f00 2024-04-26T18:02:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b2620b7e30 con 0x55b2620b50e0 2024-04-26T18:02:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffac084b740 10 client.0 _ll_register_callbacks cb 0x55b261fbc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:17.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620b50e0 0x55b2620b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58744/0 (socket says 172.21.15.92:58744) 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1887103058 learned_addr learned my addr 172.21.15.92:0/1887103058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.803+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1887103058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620b50e0 msgr2=0x55b2620b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620b50e0 0x55b2620b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 msgr2=0x55b2620b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1887103058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b261d22210 con 0x55b2620aa820 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffaac012770 tx=0x7ffaac012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c4fa8e9f2ab825 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.806 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffa96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011bb0 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7ffaac011d50 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffab0003e20 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.804+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffaac00f460 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 10 client.15591 fetch_fsmap learned FSMap version 29 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b261dee620 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffab0003e20 con 0x55b2620aa820 2024-04-26T18:02:17.807 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7ffaac01c6c0 con 0x55b2620aa820 2024-04-26T18:02:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 10 client.15591 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:02:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 10 client.15591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:17.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 20 client.15591 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b2620c5740 0x55b2620c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 4 client.15591 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.805+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b26201e070 con 0x55b2620c5740 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.806+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b2620c5740 0x55b2620c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.806+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b2620c5740 0x55b2620c7c00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f75e3176b7ee77 server_cookie=2ca7a909b3f76a59 in_seq=0 out_seq=0 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.806+0000 7ffa96ffd640 10 client.15591 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1887103058 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b26201e070 con 0x55b2620c5740 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffa96ffd640 10 client.15591 handle_command_reply: tid=0 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 client.15591 shutdown 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 msgr2=0x55b2620b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffaac012770 tx=0x7ffaac012b70 comp rx=0 tx=0).stop 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 shutdown_connections 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b2620c5740 0x55b2620c7c00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620b50e0 0x55b2620b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620aa820 0x55b2620b25c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 --2- 172.21.15.92:0/1887103058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.807+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 >> 172.21.15.92:0/1887103058 conn(0x55b2620a6410 msgr2=0x55b2620ac140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.808+0000 7ffa96ffd640 0 client.15591 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.808+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 shutdown_connections 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.808+0000 7ffac084b740 1 -- 172.21.15.92:0/1887103058 wait complete. 2024-04-26T18:02:17.810 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.808+0000 7ffac084b740 20 client.15591 trim_cache size 0 max 16384 2024-04-26T18:02:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.828+0000 7ffac084b740 1 Processor -- start 2024-04-26T18:02:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 -- start start 2024-04-26T18:02:17.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4010ec0 con 0x55b2620b50e0 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400e760 con 0x55b2620a9f00 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffac084b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400c5b0 con 0x55b2620aa820 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44114/0 (socket says 172.21.15.92:44114) 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1335070286 learned_addr learned my addr 172.21.15.92:0/1335070286 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab7fff640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1335070286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 msgr2=0x55b2620b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1335070286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 msgr2=0x55b2620a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab6ffd640 1 -- 172.21.15.92:0/1335070286 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2620aceb0 con 0x55b2620aa820 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.829+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.830+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffaac012740 tx=0x7ffaac0095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ce8432495806b89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.831+0000 7ffa9d7fa640 1 -- 172.21.15.92:0/1335070286 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac029070 con 0x55b2620aa820 2024-04-26T18:02:17.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.831+0000 7ffa9d7fa640 1 -- 172.21.15.92:0/1335070286 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaac01c8d0 con 0x55b2620aa820 2024-04-26T18:02:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.831+0000 7ffa9d7fa640 1 -- 172.21.15.92:0/1335070286 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0054a0 con 0x55b2620aa820 2024-04-26T18:02:17.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- 172.21.15.92:0/1335070286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 msgr2=0x55b2620c0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffaac012740 tx=0x7ffaac0095b0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- 172.21.15.92:0/1335070286 shutdown_connections 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620aa820 0x55b2620c0ba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 --2- 172.21.15.92:0/1335070286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620a9f00 0x55b2620b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- 172.21.15.92:0/1335070286 >> 172.21.15.92:0/1335070286 conn(0x55b2620a6410 msgr2=0x55b2620a67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- 172.21.15.92:0/1335070286 shutdown_connections 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- 172.21.15.92:0/1335070286 wait complete. 2024-04-26T18:02:17.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.832+0000 7ffac084b740 1 -- start start 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 Processor -- start 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620ae930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400cc20 con 0x55b2620b50e0 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400e090 con 0x55b2620aa820 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa400d2f0 con 0x55b2620a9f00 2024-04-26T18:02:17.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.833+0000 7ffac084b740 10 client.0 _ll_register_callbacks cb 0x7ffaac009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44126/0 (socket says 172.21.15.92:44126) 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 -- 172.21.15.92:0/1681857591 learned_addr learned my addr 172.21.15.92:0/1681857591 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab7fff640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 -- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 msgr2=0x55b2620ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 -- 172.21.15.92:0/1681857591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 msgr2=0x55b2620aee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620aee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 -- 172.21.15.92:0/1681857591 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2620af4e0 con 0x55b2620a9f00 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab7fff640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:17.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffab77fe640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800cfd0 tx=0x7ffaa80bd040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46fbf0faf12568f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffa96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.834+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80d7070 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7ffaa809add0 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaac01c8d0 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffaa80ce500 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 10 client.25087 fetch_fsmap learned FSMap version 29 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b26212bbe0 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaac01c8d0 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 29) ==== 8350+0+0 (secure 0 0 0) 0x7ffaa8098820 con 0x55b2620a9f00 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 10 client.25087 fetch_fsmap finished waiting for FSMap version 29 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 10 client.25087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 20 client.25087 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:17.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b26212c330 0x55b26212e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 4 client.25087 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:02:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b262017ee0 con 0x55b26212c330 2024-04-26T18:02:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.835+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b26212c330 0x55b26212e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.837+0000 7ffa96ffd640 10 client.25087 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:17.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.837+0000 7ffab6ffd640 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b26212c330 0x55b26212e770 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78612c1805a8caa9 server_cookie=27f0aaae32e90c90 in_seq=0 out_seq=0 2024-04-26T18:02:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.848+0000 7ffa96ffd640 1 -- 172.21.15.92:0/1681857591 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b262017ee0 con 0x55b26212c330 2024-04-26T18:02:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.848+0000 7ffa96ffd640 10 client.25087 handle_command_reply: tid=0 2024-04-26T18:02:17.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.848+0000 7ffac084b740 1 client.25087 shutdown 2024-04-26T18:02:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 msgr2=0x55b2620bd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800cfd0 tx=0x7ffaa80bd040 comp rx=0 tx=0).stop 2024-04-26T18:02:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 shutdown_connections 2024-04-26T18:02:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b26212c330 0x55b26212e770 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b2620b50e0 0x55b2620aee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2620aa820 0x55b2620ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffa96ffd640 0 client.25087 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 --2- 172.21.15.92:0/1681857591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b2620a9f00 0x55b2620bd310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 >> 172.21.15.92:0/1681857591 conn(0x55b2620a6410 msgr2=0x55b2620b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 shutdown_connections 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 1 -- 172.21.15.92:0/1681857591 wait complete. 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.849+0000 7ffac084b740 20 client.25087 trim_cache size 0 max 16384 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:02:17.850 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:02:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:02:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:02:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 msgr2=0x7ffaa00a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 0x7ffaa00a6370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffab0004490 tx=0x7ffab0004400 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 msgr2=0x7ffab810c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 0x7ffab810c1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800e9f0 tx=0x7ffaa800eeb0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 shutdown_connections 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ffaa00a3eb0 0x7ffaa00a6370 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffab810cf30 0x7ffab8106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab8104480 0x7ffab810c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 --2- 172.21.15.92:0/1584197641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffab8103b60 0x7ffab810c1c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 >> 172.21.15.92:0/1584197641 conn(0x7ffab80fd300 msgr2=0x7ffab80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 shutdown_connections 2024-04-26T18:02:17.852 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:17.850+0000 7ffabdb33640 1 -- 172.21.15.92:0/1584197641 wait complete. 2024-04-26T18:02:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 125.0 s, 3855.2 tps, lat 25.880 ms stddev 26.160 2024-04-26T18:02:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:18 smithi189 ceph-mon[32756]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 9.1 MiB/s wr, 649 op/s 2024-04-26T18:02:18.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:18 smithi156 ceph-mon[32679]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 9.1 MiB/s wr, 649 op/s 2024-04-26T18:02:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:18 smithi092 ceph-mon[29156]: pgmap v83: 97 pgs: 97 active+clean; 1.3 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 9.1 MiB/s wr, 649 op/s 2024-04-26T18:02:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:20 smithi189 ceph-mon[32756]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-26T18:02:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:20 smithi156 ceph-mon[32679]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-26T18:02:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:20 smithi092 ceph-mon[29156]: pgmap v84: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 972 op/s 2024-04-26T18:02:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:22 smithi189 ceph-mon[32756]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-04-26T18:02:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:22 smithi156 ceph-mon[32679]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-04-26T18:02:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:22 smithi092 ceph-mon[29156]: pgmap v85: 97 pgs: 97 active+clean; 1.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 7.7 MiB/s wr, 648 op/s 2024-04-26T18:02:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 130.0 s, 3410.0 tps, lat 29.387 ms stddev 29.106 2024-04-26T18:02:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:23 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:02:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:23 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:02:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:23 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:02:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:24 smithi189 ceph-mon[32756]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-04-26T18:02:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:24 smithi156 ceph-mon[32679]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-04-26T18:02:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:24 smithi092 ceph-mon[29156]: pgmap v86: 97 pgs: 97 active+clean; 1.3 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-04-26T18:02:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:26 smithi189 ceph-mon[32756]: pgmap v87: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-04-26T18:02:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:26 smithi156 ceph-mon[32679]: pgmap v87: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-04-26T18:02:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:26 smithi092 ceph-mon[29156]: pgmap v87: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.4 MiB/s wr, 693 op/s 2024-04-26T18:02:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 135.0 s, 3364.8 tps, lat 29.615 ms stddev 30.593 2024-04-26T18:02:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:28 smithi189 ceph-mon[32756]: pgmap v88: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 639 op/s 2024-04-26T18:02:28.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:28 smithi156 ceph-mon[32679]: pgmap v88: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 639 op/s 2024-04-26T18:02:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:28 smithi092 ceph-mon[29156]: pgmap v88: 97 pgs: 97 active+clean; 1.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 639 op/s 2024-04-26T18:02:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:30 smithi189 ceph-mon[32756]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-26T18:02:30.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:30 smithi156 ceph-mon[32679]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.967+0000 7f7c7932b640 1 -- 172.21.15.92:0/277035815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741021f0 msgr2=0x7f7c7410e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.967+0000 7f7c7932b640 1 --2- 172.21.15.92:0/277035815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741021f0 0x7f7c7410e700 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009cd0 tx=0x7f7c6c02a8e0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 -- 172.21.15.92:0/277035815 shutdown_connections 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 --2- 172.21.15.92:0/277035815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c741021f0 0x7f7c7410e700 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 --2- 172.21.15.92:0/277035815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c74101830 0x7f7c74101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 --2- 172.21.15.92:0/277035815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74107840 0x7f7c74107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 -- 172.21.15.92:0/277035815 >> 172.21.15.92:0/277035815 conn(0x7f7c74078980 msgr2=0x7f7c74078d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 -- 172.21.15.92:0/277035815 shutdown_connections 2024-04-26T18:02:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.968+0000 7f7c7932b640 1 -- 172.21.15.92:0/277035815 wait complete. 2024-04-26T18:02:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 Processor -- start 2024-04-26T18:02:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 -- start start 2024-04-26T18:02:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74101830 0x7f7c74198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c741021f0 0x7f7c74199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111b00 con 0x7f7c74107840 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111980 con 0x7f7c741021f0 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c7932b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111c80 con 0x7f7c74101830 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74101830 0x7f7c74198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58492/0 (socket says 172.21.15.92:58492) 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 -- 172.21.15.92:0/922922839 learned_addr learned my addr 172.21.15.92:0/922922839 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c741021f0 0x7f7c74199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 -- 172.21.15.92:0/922922839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74101830 msgr2=0x7f7c74198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74101830 0x7f7c74198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 -- 172.21.15.92:0/922922839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c741021f0 msgr2=0x7f7c74199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c741021f0 0x7f7c74199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 -- 172.21.15.92:0/922922839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419dde0 con 0x7f7c74107840 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.969+0000 7f7c737fe640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009620 tx=0x7f7c6c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.970+0000 7f7c70ff9640 1 -- 172.21.15.92:0/922922839 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c004450 con 0x7f7c74107840 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.970+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419e070 con 0x7f7c74107840 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.970+0000 7f7c70ff9640 1 -- 172.21.15.92:0/922922839 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c6c0045f0 con 0x7f7c74107840 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.970+0000 7f7c70ff9640 1 -- 172.21.15.92:0/922922839 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c03a660 con 0x7f7c74107840 2024-04-26T18:02:30.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.970+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a5960 con 0x7f7c74107840 2024-04-26T18:02:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.972+0000 7f7c70ff9640 1 -- 172.21.15.92:0/922922839 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f7c6c0305a0 con 0x7f7c74107840 2024-04-26T18:02:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.972+0000 7f7c7c049740 1 Processor -- start 2024-04-26T18:02:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 -- start start 2024-04-26T18:02:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 0x55eb598c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 0x55eb598d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eb5982c460 con 0x55eb598c5de0 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55eb597e6590 con 0x55eb598d54f0 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c7c049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eb59828420 con 0x55eb598c6700 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 0x55eb598c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 0x55eb598c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58496/0 (socket says 172.21.15.92:58496) 2024-04-26T18:02:30.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c6bfff640 1 -- 172.21.15.92:0/1644880328 learned_addr learned my addr 172.21.15.92:0/1644880328 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c70ff9640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 0x7f7c600a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 0x55eb598d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.973+0000 7f7c70ff9640 1 -- 172.21.15.92:0/922922839 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f7c6c0f1b50 con 0x7f7c74107840 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c72ffd640 1 -- 172.21.15.92:0/1644880328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 msgr2=0x55eb598d78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c72ffd640 1 -- 172.21.15.92:0/1644880328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 msgr2=0x55eb598c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 0x55eb598c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c737fe640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 0x7f7c600a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.974+0000 7f7c72ffd640 1 -- 172.21.15.92:0/1644880328 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb597f30d0 con 0x55eb598c6700 2024-04-26T18:02:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.975+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 0x55eb598d4fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c640099a0 tx=0x7f7c64009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a9f5e6adf62baf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.975+0000 7f7c737fe640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 0x7f7c600a62d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02ae50 tx=0x7f7c6c0de040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.975+0000 7f7c697fa640 1 -- 172.21.15.92:0/1644880328 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64017070 con 0x55eb598c6700 2024-04-26T18:02:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.976+0000 7f7c697fa640 1 -- 172.21.15.92:0/1644880328 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c64013470 con 0x55eb598c6700 2024-04-26T18:02:30.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.976+0000 7f7c697fa640 1 -- 172.21.15.92:0/1644880328 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64017070 con 0x55eb598c6700 2024-04-26T18:02:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- 172.21.15.92:0/1644880328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 msgr2=0x55eb598d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 0x55eb598d4fb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c640099a0 tx=0x7f7c64009e60 comp rx=0 tx=0).stop 2024-04-26T18:02:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- 172.21.15.92:0/1644880328 shutdown_connections 2024-04-26T18:02:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c6700 0x55eb598d4fb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- 172.21.15.92:0/1644880328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c5de0 0x55eb598c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- 172.21.15.92:0/1644880328 >> 172.21.15.92:0/1644880328 conn(0x55eb598c2410 msgr2=0x55eb598c27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- 172.21.15.92:0/1644880328 shutdown_connections 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- 172.21.15.92:0/1644880328 wait complete. 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- start start 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 Processor -- start 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eb598d8120 con 0x55eb598c6700 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55eb597b3b60 con 0x55eb598d54f0 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.977+0000 7f7c7c049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55eb598d82a0 con 0x55eb598c5de0 2024-04-26T18:02:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58500/0 (socket says 172.21.15.92:58500) 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 -- 172.21.15.92:0/4030036766 learned_addr learned my addr 172.21.15.92:0/4030036766 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c7c049740 10 client.0 _ll_register_callbacks cb 0x55eb597d82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 -- 172.21.15.92:0/4030036766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 msgr2=0x55eb598d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 -- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 msgr2=0x55eb598d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 -- 172.21.15.92:0/4030036766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5953e210 con 0x55eb598c6700 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.978+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c64013d70 tx=0x7f7c64013b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c6e153b2ce4554 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.979+0000 7f7c5a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.979+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6402a060 con 0x55eb598c6700 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.979+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f7c6400f040 con 0x55eb598c6700 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.979+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c64013470 con 0x55eb598c6700 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.980+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c64017070 con 0x55eb598c6700 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.980+0000 7f7c7c049740 10 client.15609 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.980+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55eb5960a620 con 0x55eb598c6700 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c64013470 con 0x55eb598c6700 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7c64025410 con 0x55eb598c6700 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 10 client.15609 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 10 client.15609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 20 client.15609 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb598e54f0 0x55eb598e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 4 client.15609 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5983a070 con 0x55eb598e54f0 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.981+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb598e54f0 0x55eb598e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.982+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb598e54f0 0x55eb598e78e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cfa86a0b350c3ec server_cookie=ef5125d3b3d36e0 in_seq=0 out_seq=0 2024-04-26T18:02:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.982+0000 7f7c5a7fc640 10 client.15609 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.982+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/4030036766 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb5983a070 con 0x55eb598e54f0 2024-04-26T18:02:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.982+0000 7f7c5a7fc640 10 client.15609 handle_command_reply: tid=0 2024-04-26T18:02:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 client.15609 shutdown 2024-04-26T18:02:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 msgr2=0x55eb598d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7c64013d70 tx=0x7f7c64013b90 comp rx=0 tx=0).stop 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 shutdown_connections 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb598e54f0 0x55eb598e78e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d2920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c5a7fc640 0 client.15609 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 --2- 172.21.15.92:0/4030036766 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 >> 172.21.15.92:0/4030036766 conn(0x55eb598c2410 msgr2=0x55eb598c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 shutdown_connections 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 1 -- 172.21.15.92:0/4030036766 wait complete. 2024-04-26T18:02:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:30.983+0000 7f7c7c049740 20 client.15609 trim_cache size 0 max 16384 2024-04-26T18:02:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:30 smithi092 ceph-mon[29156]: pgmap v89: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2024-04-26T18:02:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.016+0000 7f7c7c049740 1 Processor -- start 2024-04-26T18:02:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.016+0000 7f7c7c049740 1 -- start start 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598e1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741ae780 con 0x55eb598c6700 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741abff0 con 0x55eb598d54f0 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c7c049740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741a9e80 con 0x55eb598c5de0 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58506/0 (socket says 172.21.15.92:58506) 2024-04-26T18:02:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.017+0000 7f7c72ffd640 1 -- 172.21.15.92:0/2076652899 learned_addr learned my addr 172.21.15.92:0/2076652899 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 -- 172.21.15.92:0/2076652899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 msgr2=0x55eb598e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598e1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 -- 172.21.15.92:0/2076652899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 msgr2=0x55eb598d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 -- 172.21.15.92:0/2076652899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb598c2240 con 0x55eb598c6700 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.018+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098c0 tx=0x7f7c64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd80f9f34733b10e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.019+0000 7f7c68ff9640 1 -- 172.21.15.92:0/2076652899 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6402a040 con 0x55eb598c6700 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.019+0000 7f7c68ff9640 1 -- 172.21.15.92:0/2076652899 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c6400e5a0 con 0x55eb598c6700 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.019+0000 7f7c68ff9640 1 -- 172.21.15.92:0/2076652899 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64034080 con 0x55eb598c6700 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- 172.21.15.92:0/2076652899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 msgr2=0x55eb598d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098c0 tx=0x7f7c64000bc0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- 172.21.15.92:0/2076652899 shutdown_connections 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598d54f0 0x55eb598d2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598c6700 0x55eb598d1540 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2076652899 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- 172.21.15.92:0/2076652899 >> 172.21.15.92:0/2076652899 conn(0x55eb598c2410 msgr2=0x55eb598d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- 172.21.15.92:0/2076652899 shutdown_connections 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- 172.21.15.92:0/2076652899 wait complete. 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 -- start start 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.020+0000 7f7c7c049740 1 Processor -- start 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598c6700 0x55eb598c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 0x55eb598dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 0x55eb598dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 0x55eb598dc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58518/0 (socket says 172.21.15.92:58518) 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 -- 172.21.15.92:0/2700826383 learned_addr learned my addr 172.21.15.92:0/2700826383 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:31.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741aa4d0 con 0x55eb598d54f0 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741ab920 con 0x55eb598c6700 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741aab80 con 0x55eb598c5de0 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598c6700 0x55eb598c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 -- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598c6700 msgr2=0x55eb598c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598c6700 0x55eb598c9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 -- 172.21.15.92:0/2700826383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 msgr2=0x55eb598dc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 0x55eb598dc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb598dcb90 con 0x55eb598c5de0 2024-04-26T18:02:31.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.021+0000 7f7c6bfff640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598c96b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ae80 tx=0x7f7c5c011040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37ddd47aaa0420f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c5a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c7c049740 10 client.0 _ll_register_callbacks cb 0x7f7c640097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c6400e5a0 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/2700826383 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c032050 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/2700826383 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f7c5c021ae0 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/2700826383 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c5c02d420 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c7c049740 10 client.25102 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.022+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55eb598ddd80 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/2700826383 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7c5c035020 con 0x55eb598c5de0 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 10 client.25102 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 10 client.25102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 20 client.25102 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb59950440 0x55eb59952860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 4 client.25102 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:02:31.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7c6400e5a0 con 0x55eb59950440 2024-04-26T18:02:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb59950440 0x55eb59952860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c72ffd640 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb59950440 0x55eb59952860 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f91e8722a5b156 server_cookie=52372797fd3594de in_seq=0 out_seq=0 2024-04-26T18:02:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.023+0000 7f7c5a7fc640 10 client.25102 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.034+0000 7f7c5a7fc640 1 -- 172.21.15.92:0/2700826383 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7c6400e5a0 con 0x55eb59950440 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.034+0000 7f7c5a7fc640 10 client.25102 handle_command_reply: tid=0 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.034+0000 7f7c7c049740 1 client.25102 shutdown 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 msgr2=0x55eb598c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598c96b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00ae80 tx=0x7f7c5c011040 comp rx=0 tx=0).stop 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 shutdown_connections 2024-04-26T18:02:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55eb59950440 0x55eb59952860 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb598d54f0 0x55eb598dc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55eb598c6700 0x55eb598c9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 --2- 172.21.15.92:0/2700826383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55eb598c5de0 0x55eb598c96b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 >> 172.21.15.92:0/2700826383 conn(0x55eb598c2410 msgr2=0x55eb598c78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.035+0000 7f7c5a7fc640 0 client.25102 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.036+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 shutdown_connections 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.036+0000 7f7c7c049740 1 -- 172.21.15.92:0/2700826383 wait complete. 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.036+0000 7f7c7c049740 20 client.25102 trim_cache size 0 max 16384 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:02:31.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 msgr2=0x7f7c600a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 0x7f7c600a62d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c02ae50 tx=0x7f7c6c0de040 comp rx=0 tx=0).stop 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 msgr2=0x7f7c7419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009620 tx=0x7f7c6c003f10 comp rx=0 tx=0).stop 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 shutdown_connections 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f7c600a3e10 0x7f7c600a62d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7c74107840 0x7f7c7419d6b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c741021f0 0x7f7c74199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 --2- 172.21.15.92:0/922922839 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7c74101830 0x7f7c74198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 >> 172.21.15.92:0/922922839 conn(0x7f7c74078980 msgr2=0x7f7c7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 shutdown_connections 2024-04-26T18:02:31.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:31.037+0000 7f7c7932b640 1 -- 172.21.15.92:0/922922839 wait complete. 2024-04-26T18:02:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:32 smithi189 ceph-mon[32756]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-26T18:02:32.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:32 smithi156 ceph-mon[32679]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-26T18:02:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:32 smithi092 ceph-mon[29156]: pgmap v90: 97 pgs: 97 active+clean; 1.4 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 686 op/s 2024-04-26T18:02:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 140.0 s, 4042.8 tps, lat 24.828 ms stddev 26.753 2024-04-26T18:02:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:34 smithi189 ceph-mon[32756]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 960 op/s 2024-04-26T18:02:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:34 smithi156 ceph-mon[32679]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 960 op/s 2024-04-26T18:02:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:34 smithi092 ceph-mon[29156]: pgmap v91: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 960 op/s 2024-04-26T18:02:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:36 smithi189 ceph-mon[32756]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-04-26T18:02:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:36 smithi156 ceph-mon[32679]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-04-26T18:02:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:36 smithi092 ceph-mon[29156]: pgmap v92: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 820 op/s 2024-04-26T18:02:38.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 145.0 s, 3742.0 tps, lat 26.744 ms stddev 27.010 2024-04-26T18:02:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:38 smithi189 ceph-mon[32756]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 706 op/s 2024-04-26T18:02:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:38 smithi156 ceph-mon[32679]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 706 op/s 2024-04-26T18:02:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:38 smithi092 ceph-mon[29156]: pgmap v93: 97 pgs: 97 active+clean; 1.4 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.6 MiB/s wr, 706 op/s 2024-04-26T18:02:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:40 smithi189 ceph-mon[32756]: pgmap v94: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-04-26T18:02:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:40 smithi156 ceph-mon[32679]: pgmap v94: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-04-26T18:02:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:40 smithi092 ceph-mon[29156]: pgmap v94: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2024-04-26T18:02:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:42 smithi189 ceph-mon[32756]: pgmap v95: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-04-26T18:02:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:42 smithi156 ceph-mon[32679]: pgmap v95: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-04-26T18:02:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:42 smithi092 ceph-mon[29156]: pgmap v95: 97 pgs: 97 active+clean; 1.4 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-04-26T18:02:43.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 150.0 s, 3435.0 tps, lat 29.005 ms stddev 30.352 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.157+0000 7f141067e640 1 -- 172.21.15.92:0/3534426434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408101770 msgr2=0x7f14081057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.157+0000 7f141067e640 1 --2- 172.21.15.92:0/3534426434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408101770 0x7f14081057b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1404009860 tx=0x7f140402a340 comp rx=0 tx=0).stop 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.158+0000 7f141067e640 1 -- 172.21.15.92:0/3534426434 shutdown_connections 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.158+0000 7f141067e640 1 --2- 172.21.15.92:0/3534426434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1408105e90 0x7f140810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.158+0000 7f141067e640 1 --2- 172.21.15.92:0/3534426434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408101770 0x7f14081057b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.158+0000 7f141067e640 1 --2- 172.21.15.92:0/3534426434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1408100dc0 0x7f14081011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.158+0000 7f141067e640 1 -- 172.21.15.92:0/3534426434 >> 172.21.15.92:0/3534426434 conn(0x7f1408077930 msgr2=0x7f14080fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.160+0000 7f141067e640 1 -- 172.21.15.92:0/3534426434 shutdown_connections 2024-04-26T18:02:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.162+0000 7f141067e640 1 -- 172.21.15.92:0/3534426434 wait complete. 2024-04-26T18:02:44.163 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.163+0000 7f141067e640 1 Processor -- start 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 -- start start 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1408100dc0 0x7f1408109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 0x7f1408109950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 0x7f14081a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f140806e790 con 0x7f1408105e90 2024-04-26T18:02:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f140806e610 con 0x7f1408100dc0 2024-04-26T18:02:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f141067e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f140806e910 con 0x7f14081a0b00 2024-04-26T18:02:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.168+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 0x7f14081a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 0x7f14081a2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:38190/0 (socket says 172.21.15.92:38190) 2024-04-26T18:02:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140ec1b640 1 -- 172.21.15.92:0/2893792613 learned_addr learned my addr 172.21.15.92:0/2893792613 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 0x7f1408109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 -- 172.21.15.92:0/2893792613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 msgr2=0x7f14081a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 0x7f14081a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 -- 172.21.15.92:0/2893792613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1408100dc0 msgr2=0x7f1408109410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1408100dc0 0x7f1408109410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.169+0000 7f140dc19640 1 -- 172.21.15.92:0/2893792613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14081a3530 con 0x7f1408105e90 2024-04-26T18:02:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.170+0000 7f140dc19640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 0x7f1408109950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1404035040 tx=0x7f1404030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.171+0000 7f13ff7fe640 1 -- 172.21.15.92:0/2893792613 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404042070 con 0x7f1408105e90 2024-04-26T18:02:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.172+0000 7f13ff7fe640 1 -- 172.21.15.92:0/2893792613 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1404030900 con 0x7f1408105e90 2024-04-26T18:02:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.172+0000 7f13ff7fe640 1 -- 172.21.15.92:0/2893792613 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404037040 con 0x7f1408105e90 2024-04-26T18:02:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.172+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14081a37c0 con 0x7f1408105e90 2024-04-26T18:02:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.172+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14081a3c30 con 0x7f1408105e90 2024-04-26T18:02:44.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.177+0000 7f13ff7fe640 1 -- 172.21.15.92:0/2893792613 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f14040054f0 con 0x7f1408105e90 2024-04-26T18:02:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.178+0000 7f13ff7fe640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 0x7f13f40a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.178+0000 7f13ff7fe640 1 -- 172.21.15.92:0/2893792613 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f14040efdb0 con 0x7f1408105e90 2024-04-26T18:02:44.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.180+0000 7f140e41a640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 0x7f13f40a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.181+0000 7f140e41a640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 0x7f13f40a64b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005fd0 tx=0x7f13f801a270 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.181+0000 7f141339a740 1 Processor -- start 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 -- start start 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 0x5618fbfadba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfb04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618fbf09460 con 0x5618fbfa2f00 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5618fbec3590 con 0x5618fbfae0e0 2024-04-26T18:02:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.182+0000 7f141339a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618fbf05420 con 0x5618fbfa3820 2024-04-26T18:02:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.183+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfb04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.183+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfb04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:35098/0 (socket says 172.21.15.92:35098) 2024-04-26T18:02:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.183+0000 7f140ec1b640 1 -- 172.21.15.92:0/3427457379 learned_addr learned my addr 172.21.15.92:0/3427457379 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.183+0000 7f140dc19640 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 0x5618fbfadba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.183+0000 7f140e41a640 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 -- 172.21.15.92:0/3427457379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 msgr2=0x5618fbfb04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfb04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 -- 172.21.15.92:0/3427457379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 msgr2=0x5618fbfa32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 -- 172.21.15.92:0/3427457379 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fbed00d0 con 0x5618fbfa3820 2024-04-26T18:02:44.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.184+0000 7f140dc19640 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 0x5618fbfadba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14040ed620 tx=0x7f14040bbd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95c18d595582fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.185+0000 7f13fcff9640 1 -- 172.21.15.92:0/3427457379 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040bc570 con 0x5618fbfa3820 2024-04-26T18:02:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.185+0000 7f13fcff9640 1 -- 172.21.15.92:0/3427457379 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14040bbe70 con 0x5618fbfa3820 2024-04-26T18:02:44.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.185+0000 7f13fcff9640 1 -- 172.21.15.92:0/3427457379 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404004250 con 0x5618fbfa3820 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 -- 172.21.15.92:0/3427457379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 msgr2=0x5618fbfadba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 0x5618fbfadba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14040ed620 tx=0x7f14040bbd00 comp rx=0 tx=0).stop 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 -- 172.21.15.92:0/3427457379 shutdown_connections 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfb04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa3820 0x5618fbfadba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 --2- 172.21.15.92:0/3427457379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 -- 172.21.15.92:0/3427457379 >> 172.21.15.92:0/3427457379 conn(0x5618fbf9f410 msgr2=0x5618fbf9f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.186+0000 7f141339a740 1 -- 172.21.15.92:0/3427457379 shutdown_connections 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 -- 172.21.15.92:0/3427457379 wait complete. 2024-04-26T18:02:44.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 -- start start 2024-04-26T18:02:44.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 Processor -- start 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa2f00 0x5618fbfab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfaba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618fbfb0ad0 con 0x5618fbfa3820 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5618fbe90b60 con 0x5618fbfae0e0 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5618fbfb0c50 con 0x5618fbfa2f00 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.187+0000 7f141339a740 10 client.0 _ll_register_callbacks cb 0x5618fbeb52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfaba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140ec1b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfaba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:35112/0 (socket says 172.21.15.92:35112) 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140ec1b640 1 -- 172.21.15.92:0/314859378 learned_addr learned my addr 172.21.15.92:0/314859378 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38964/0 (socket says 172.21.15.92:38964) 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140e41a640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa2f00 0x5618fbfab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 -- 172.21.15.92:0/314859378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa2f00 msgr2=0x5618fbfab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa2f00 0x5618fbfab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 -- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 msgr2=0x5618fbfaba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfaba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 -- 172.21.15.92:0/314859378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fbc1b210 con 0x5618fbfa3820 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f140dc19640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5618fbfa44a0 tx=0x7f14040bbd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39588db5641d9516 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f13f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040d9020 con 0x5618fbfa3820 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f14040ed790 con 0x5618fbfa3820 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.188+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14040bbe70 con 0x5618fbfa3820 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.189+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f14040c4ae0 con 0x5618fbfa3820 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.189+0000 7f141339a740 10 client.15627 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.189+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5618fbce7620 con 0x5618fbfa3820 2024-04-26T18:02:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.189+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14040bbe70 con 0x5618fbfa3820 2024-04-26T18:02:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.189+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f14040bb2c0 con 0x5618fbfa3820 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 10 client.15627 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 10 client.15627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 20 client.15627 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fbfbde00 0x5618fbfc01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 4 client.15627 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618fbf17070 con 0x5618fbfbde00 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.190+0000 7f140e41a640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fbfbde00 0x5618fbfc01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.191+0000 7f13f1ffb640 10 client.15627 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.191+0000 7f140e41a640 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fbfbde00 0x5618fbfc01f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee097e5daa908ff server_cookie=cc91611786b8799e in_seq=0 out_seq=0 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.191+0000 7f13f1ffb640 1 -- 172.21.15.92:0/314859378 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5618fbf17070 con 0x5618fbfbde00 2024-04-26T18:02:44.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.191+0000 7f13f1ffb640 10 client.15627 handle_command_reply: tid=0 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 client.15627 shutdown 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 msgr2=0x5618fbfab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x5618fbfa44a0 tx=0x7f14040bbd70 comp rx=0 tx=0).stop 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 shutdown_connections 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fbfbde00 0x5618fbfc01f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfae0e0 0x5618fbfaba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa3820 0x5618fbfab550 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 --2- 172.21.15.92:0/314859378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfa2f00 0x5618fbfab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 >> 172.21.15.92:0/314859378 conn(0x5618fbf9f410 msgr2=0x5618fbfa5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.192+0000 7f13f1ffb640 0 client.15627 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.193+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 shutdown_connections 2024-04-26T18:02:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.193+0000 7f141339a740 1 -- 172.21.15.92:0/314859378 wait complete. 2024-04-26T18:02:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.193+0000 7f141339a740 20 client.15627 trim_cache size 0 max 16384 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 Processor -- start 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 -- start start 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfb97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fbfacf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec011000 con 0x5618fbfa2f00 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec00e870 con 0x5618fbfa3820 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.215+0000 7f141339a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec00c6c0 con 0x5618fbfae0e0 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:35126/0 (socket says 172.21.15.92:35126) 2024-04-26T18:02:44.216 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 -- 172.21.15.92:0/2156529788 learned_addr learned my addr 172.21.15.92:0/2156529788 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140e41a640 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfb97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140ec1b640 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fbfacf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 -- 172.21.15.92:0/2156529788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 msgr2=0x5618fbfacf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fbfacf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 -- 172.21.15.92:0/2156529788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 msgr2=0x5618fbfb97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfb97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 -- 172.21.15.92:0/2156529788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fbfabe30 con 0x5618fbfa3820 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f140dc19640 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1404009780 tx=0x7f1404005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab190ba74659f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.216+0000 7f13f3fff640 1 -- 172.21.15.92:0/2156529788 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040d9070 con 0x5618fbfa3820 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.217+0000 7f13f3fff640 1 -- 172.21.15.92:0/2156529788 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14040bc570 con 0x5618fbfa3820 2024-04-26T18:02:44.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.217+0000 7f13f3fff640 1 -- 172.21.15.92:0/2156529788 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040ba170 con 0x5618fbfa3820 2024-04-26T18:02:44.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 -- 172.21.15.92:0/2156529788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 msgr2=0x5618fbfab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1404009780 tx=0x7f1404005f90 comp rx=0 tx=0).stop 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 -- 172.21.15.92:0/2156529788 shutdown_connections 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fbfacf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfab8f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 --2- 172.21.15.92:0/2156529788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfb97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 -- 172.21.15.92:0/2156529788 >> 172.21.15.92:0/2156529788 conn(0x5618fbf9f410 msgr2=0x5618fbfac840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 -- 172.21.15.92:0/2156529788 shutdown_connections 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.218+0000 7f141339a740 1 -- 172.21.15.92:0/2156529788 wait complete. 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.219+0000 7f141339a740 1 -- start start 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.219+0000 7f141339a740 1 Processor -- start 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.219+0000 7f141339a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.219+0000 7f141339a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfa86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f141339a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fc0230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f141339a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec00cd30 con 0x5618fbfa2f00 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f141339a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec00e1a0 con 0x5618fbfa3820 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f141339a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec00d400 con 0x5618fbfae0e0 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f141339a740 10 client.0 _ll_register_callbacks cb 0x7f140000a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfa86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140e41a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140e41a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38992/0 (socket says 172.21.15.92:38992) 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140e41a640 1 -- 172.21.15.92:0/3909365770 learned_addr learned my addr 172.21.15.92:0/3909365770 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140ec1b640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fc0230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 -- 172.21.15.92:0/3909365770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 msgr2=0x5618fc0230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fc0230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 -- 172.21.15.92:0/3909365770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 msgr2=0x5618fbfa8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.220+0000 7f140dc19640 1 -- 172.21.15.92:0/3909365770 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fc023630 con 0x5618fbfa3820 2024-04-26T18:02:44.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.221+0000 7f140dc19640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfa86c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14040bb630 tx=0x7f1404032e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af3c31b674dc556 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.221+0000 7f13f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:02:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.221+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040d9040 con 0x5618fbfa3820 2024-04-26T18:02:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.221+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f14040c4650 con 0x5618fbfa3820 2024-04-26T18:02:44.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.221+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14040bc570 con 0x5618fbfa3820 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.222+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f14040bbe70 con 0x5618fbfa3820 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.222+0000 7f141339a740 10 client.25181 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.222+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5618fc023630 con 0x5618fbfa3820 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.222+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14040bc570 con 0x5618fbfa3820 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f14040baec0 con 0x5618fbfa3820 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 10 client.25181 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 10 client.25181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 20 client.25181 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fc024b50 0x5618fc026f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 4 client.25181 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618fbf10ee0 con 0x5618fc024b50 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f140e41a640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fc024b50 0x5618fc026f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:44.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f13f1ffb640 10 client.25181 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:44.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.223+0000 7f140e41a640 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fc024b50 0x5618fc026f70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd1628b63f409b86 server_cookie=4a6c8c138f0fcb13 in_seq=0 out_seq=0 2024-04-26T18:02:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.234+0000 7f13f1ffb640 1 -- 172.21.15.92:0/3909365770 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618fbf10ee0 con 0x5618fc024b50 2024-04-26T18:02:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f13f1ffb640 10 client.25181 handle_command_reply: tid=0 2024-04-26T18:02:44.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 client.25181 shutdown 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 msgr2=0x5618fbfa86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfa86c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f14040bb630 tx=0x7f1404032e80 comp rx=0 tx=0).stop 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 shutdown_connections 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5618fc024b50 0x5618fc026f70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5618fbfae0e0 0x5618fc0230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.235+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5618fbfa3820 0x5618fbfa86c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f141339a740 1 --2- 172.21.15.92:0/3909365770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618fbfa2f00 0x5618fbfa8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 >> 172.21.15.92:0/3909365770 conn(0x5618fbf9f410 msgr2=0x5618fbfad0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f13f1ffb640 0 client.25181 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 shutdown_connections 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f141339a740 1 -- 172.21.15.92:0/3909365770 wait complete. 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.236+0000 7f141339a740 20 client.25181 trim_cache size 0 max 16384 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:02:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:02:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 msgr2=0x7f13f40a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 0x7f13f40a64b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005fd0 tx=0x7f13f801a270 comp rx=0 tx=0).stop 2024-04-26T18:02:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 msgr2=0x7f1408109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 0x7f1408109950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1404035040 tx=0x7f1404030d80 comp rx=0 tx=0).stop 2024-04-26T18:02:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 shutdown_connections 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f13f40a3ff0 0x7f13f40a64b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f14081a0b00 0x7f14081a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1408105e90 0x7f1408109950 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 --2- 172.21.15.92:0/2893792613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1408100dc0 0x7f1408109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 >> 172.21.15.92:0/2893792613 conn(0x7f1408077930 msgr2=0x7f1408103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 shutdown_connections 2024-04-26T18:02:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:44.237+0000 7f141067e640 1 -- 172.21.15.92:0/2893792613 wait complete. 2024-04-26T18:02:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:44 smithi189 ceph-mon[32756]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 854 op/s 2024-04-26T18:02:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:44 smithi156 ceph-mon[32679]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 854 op/s 2024-04-26T18:02:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:44 smithi092 ceph-mon[29156]: pgmap v96: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 854 op/s 2024-04-26T18:02:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:02:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:02:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:02:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:02:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:02:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:02:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:47 smithi189 ceph-mon[32756]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 695 op/s 2024-04-26T18:02:47.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:47 smithi156 ceph-mon[32679]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 695 op/s 2024-04-26T18:02:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:47 smithi092 ceph-mon[29156]: pgmap v97: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 695 op/s 2024-04-26T18:02:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 155.0 s, 3286.0 tps, lat 30.559 ms stddev 31.591 2024-04-26T18:02:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:49 smithi189 ceph-mon[32756]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-26T18:02:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:49 smithi156 ceph-mon[32679]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-26T18:02:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:49 smithi092 ceph-mon[29156]: pgmap v98: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-04-26T18:02:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:51 smithi189 ceph-mon[32756]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 943 op/s 2024-04-26T18:02:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:51 smithi156 ceph-mon[32679]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 943 op/s 2024-04-26T18:02:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:51 smithi092 ceph-mon[29156]: pgmap v99: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 943 op/s 2024-04-26T18:02:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 160.0 s, 3538.2 tps, lat 28.183 ms stddev 28.929 2024-04-26T18:02:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:53 smithi189 ceph-mon[32756]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-04-26T18:02:53.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:53 smithi156 ceph-mon[32679]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-04-26T18:02:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:53 smithi092 ceph-mon[29156]: pgmap v100: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.4 MiB/s wr, 616 op/s 2024-04-26T18:02:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:55 smithi189 ceph-mon[32756]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-04-26T18:02:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:55 smithi156 ceph-mon[32679]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-04-26T18:02:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:55 smithi092 ceph-mon[29156]: pgmap v101: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 855 op/s 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 -- 172.21.15.92:0/2209936799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57941044c0 msgr2=0x7f579410c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 --2- 172.21.15.92:0/2209936799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57941044c0 0x7f579410c9a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f577c009900 tx=0x7f577c02a480 comp rx=0 tx=0).stop 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 -- 172.21.15.92:0/2209936799 shutdown_connections 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 --2- 172.21.15.92:0/2209936799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f579410cf70 0x7f579410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 --2- 172.21.15.92:0/2209936799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57941044c0 0x7f579410c9a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 --2- 172.21.15.92:0/2209936799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5794103ba0 0x7f5794103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 -- 172.21.15.92:0/2209936799 >> 172.21.15.92:0/2209936799 conn(0x7f5794078a40 msgr2=0x7f5794078e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 -- 172.21.15.92:0/2209936799 shutdown_connections 2024-04-26T18:02:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.365+0000 7f5798f51640 1 -- 172.21.15.92:0/2209936799 wait complete. 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.366+0000 7f5798f51640 1 Processor -- start 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.366+0000 7f5798f51640 1 -- start start 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 0x7f57941990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57941044c0 0x7f5794199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112ba0 con 0x7f5794103ba0 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112a20 con 0x7f579410cf70 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5798f51640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5794112d20 con 0x7f57941044c0 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f579259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 0x7f57941990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:51448/0 (socket says 172.21.15.92:51448) 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f579259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 0x7f57941990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46606/0 (socket says 172.21.15.92:46606) 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 -- 172.21.15.92:0/4146898130 learned_addr learned my addr 172.21.15.92:0/4146898130 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5789d9b640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57941044c0 0x7f5794199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 -- 172.21.15.92:0/4146898130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57941044c0 msgr2=0x7f5794199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57941044c0 0x7f5794199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 -- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 msgr2=0x7f57941990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 0x7f57941990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.367+0000 7f5792d9d640 1 -- 172.21.15.92:0/4146898130 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579419e060 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f5792d9d640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f578c00eaa0 tx=0x7f578c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f578bfff640 1 -- 172.21.15.92:0/4146898130 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c00cdb0 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f578bfff640 1 -- 172.21.15.92:0/4146898130 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f578c005020 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579419e350 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57941a5be0 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.368+0000 7f578bfff640 1 -- 172.21.15.92:0/4146898130 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c0116d0 con 0x7f579410cf70 2024-04-26T18:02:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.371+0000 7f578bfff640 1 -- 172.21.15.92:0/4146898130 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f578c011870 con 0x7f579410cf70 2024-04-26T18:02:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.372+0000 7f579bc6b740 1 Processor -- start 2024-04-26T18:02:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.372+0000 7f579bc6b740 1 -- start start 2024-04-26T18:02:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc25da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc39780 0x55b35fc3bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b35fb8c460 con 0x55b35fc274b0 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b35fb46590 con 0x55b35fc39780 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579bc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b35fb88420 con 0x55b35fc262e0 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:47486/0 (socket says 172.21.15.92:47486) 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.373+0000 7f579259c640 1 -- 172.21.15.92:0/3889723302 learned_addr learned my addr 172.21.15.92:0/3889723302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f578bfff640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 0x7f57800a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5789d9b640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc39780 0x55b35fc3bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 -- 172.21.15.92:0/3889723302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc39780 msgr2=0x55b35fc3bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc39780 0x55b35fc3bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5789d9b640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc25da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 -- 172.21.15.92:0/3889723302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 msgr2=0x55b35fc25da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5792d9d640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 0x7f57800a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc25da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 -- 172.21.15.92:0/3889723302 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b35fb530d0 con 0x55b35fc262e0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5789d9b640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f578bfff640 1 -- 172.21.15.92:0/4146898130 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f578c0d0760 con 0x7f579410cf70 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f579259c640 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f578400bd10 tx=0x7f57840107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a72290710151d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5792d9d640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 0x7f57800a6300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f578c0ce520 tx=0x7f578c06b1d0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5788d99640 1 -- 172.21.15.92:0/3889723302 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784004030 con 0x55b35fc262e0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5788d99640 1 -- 172.21.15.92:0/3889723302 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57840035f0 con 0x55b35fc262e0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.374+0000 7f5788d99640 1 -- 172.21.15.92:0/3889723302 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57840117b0 con 0x55b35fc262e0 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.375+0000 7f579bc6b740 1 -- 172.21.15.92:0/3889723302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 msgr2=0x55b35fc26760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.375+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f578400bd10 tx=0x7f57840107a0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 -- 172.21.15.92:0/3889723302 shutdown_connections 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc39780 0x55b35fc3bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc26760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3889723302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 -- 172.21.15.92:0/3889723302 >> 172.21.15.92:0/3889723302 conn(0x55b35fc22410 msgr2=0x55b35fc227f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 -- 172.21.15.92:0/3889723302 shutdown_connections 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 -- 172.21.15.92:0/3889723302 wait complete. 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 -- start start 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 Processor -- start 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.376+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc29af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc29af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b35fc3c4e0 con 0x55b35fc39780 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b35fb13b60 con 0x55b35fc274b0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b35fc3c660 con 0x55b35fc262e0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:51474/0 (socket says 172.21.15.92:51474) 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 -- 172.21.15.92:0/1171624110 learned_addr learned my addr 172.21.15.92:0/1171624110 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46612/0 (socket says 172.21.15.92:46612) 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579bc6b740 10 client.0 _ll_register_callbacks cb 0x55b35fb382b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 -- 172.21.15.92:0/1171624110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 msgr2=0x55b35fc29af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc29af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 -- 172.21.15.92:0/1171624110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 msgr2=0x55b35fc2a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 -- 172.21.15.92:0/1171624110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35f89e210 con 0x55b35fc274b0 2024-04-26T18:02:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f5789d9b640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f579259c640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f578400c010 tx=0x7f578400b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f5f3559ea0d642 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.377+0000 7f5779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784029060 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f5784004000 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57840035f0 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5784004200 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f579bc6b740 10 client.25193 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.378+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b35f96a620 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57840035f0 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5784004900 con 0x55b35fc274b0 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 10 client.25193 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 10 client.25193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 20 client.25193 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fc498d0 0x55b35fc4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 4 client.25193 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b35fb9a070 con 0x55b35fc498d0 2024-04-26T18:02:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.379+0000 7f5789d9b640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fc498d0 0x55b35fc4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.380+0000 7f5789d9b640 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fc498d0 0x55b35fc4bcc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315a18e15ec74b9b server_cookie=afbbe4f4f27c4f45 in_seq=0 out_seq=0 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.380+0000 7f5779ffb640 10 client.25193 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f5779ffb640 1 -- 172.21.15.92:0/1171624110 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b35fb9a070 con 0x55b35fc498d0 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f5779ffb640 10 client.25193 handle_command_reply: tid=0 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 client.25193 shutdown 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 msgr2=0x55b35fc2a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f578400c010 tx=0x7f578400b950 comp rx=0 tx=0).stop 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 shutdown_connections 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fc498d0 0x55b35fc4bcc0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc2a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc274b0 0x55b35fc2a030 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 --2- 172.21.15.92:0/1171624110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc262e0 0x55b35fc29af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f5779ffb640 0 client.25193 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 >> 172.21.15.92:0/1171624110 conn(0x55b35fc22410 msgr2=0x55b35fc28250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 shutdown_connections 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 1 -- 172.21.15.92:0/1171624110 wait complete. 2024-04-26T18:02:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.381+0000 7f579bc6b740 20 client.25193 trim_cache size 0 max 16384 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.403+0000 7f579bc6b740 1 Processor -- start 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.403+0000 7f579bc6b740 1 -- start start 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.403+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc45410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.403+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc39780 0x55b35fc35b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579bc6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5774011000 con 0x55b35fc274b0 2024-04-26T18:02:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579bc6b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f577400e870 con 0x55b35fc262e0 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579bc6b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f577400c6c0 con 0x55b35fc39780 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc45410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46628/0 (socket says 172.21.15.92:46628) 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 -- 172.21.15.92:0/3948753845 learned_addr learned my addr 172.21.15.92:0/3948753845 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f5789d9b640 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc39780 0x55b35fc35b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 -- 172.21.15.92:0/3948753845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc39780 msgr2=0x55b35fc35b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc39780 0x55b35fc35b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 -- 172.21.15.92:0/3948753845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 msgr2=0x55b35fc45410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc45410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 -- 172.21.15.92:0/3948753845 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b35fc2aee0 con 0x55b35fc274b0 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f5789d9b640 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc45410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f579259c640 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5784001eb0 tx=0x7f578400b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c15c89c03f5989e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f577bfff640 1 -- 172.21.15.92:0/3948753845 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784029070 con 0x55b35fc274b0 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f577bfff640 1 -- 172.21.15.92:0/3948753845 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5784003b70 con 0x55b35fc274b0 2024-04-26T18:02:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.404+0000 7f577bfff640 1 -- 172.21.15.92:0/3948753845 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784033080 con 0x55b35fc274b0 2024-04-26T18:02:57.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.405+0000 7f579bc6b740 1 -- 172.21.15.92:0/3948753845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 msgr2=0x55b35fc21d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.405+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5784001eb0 tx=0x7f578400b770 comp rx=0 tx=0).stop 2024-04-26T18:02:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 -- 172.21.15.92:0/3948753845 shutdown_connections 2024-04-26T18:02:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc39780 0x55b35fc35b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc274b0 0x55b35fc21d30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 --2- 172.21.15.92:0/3948753845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc45410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 -- 172.21.15.92:0/3948753845 >> 172.21.15.92:0/3948753845 conn(0x55b35fc22410 msgr2=0x55b35fc227f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 -- 172.21.15.92:0/3948753845 shutdown_connections 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 -- 172.21.15.92:0/3948753845 wait complete. 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 -- start start 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 Processor -- start 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.406+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc274b0 0x55b35fc41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579bc6b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579bc6b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f577400cd30 con 0x55b35fc39780 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:51488/0 (socket says 172.21.15.92:51488) 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 -- 172.21.15.92:0/4207335284 learned_addr learned my addr 172.21.15.92:0/4207335284 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f577400e1a0 con 0x55b35fc262e0 2024-04-26T18:02:57.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f577400d400 con 0x55b35fc274b0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579bc6b740 10 client.0 _ll_register_callbacks cb 0x7f578400bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f579259c640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc274b0 0x55b35fc41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 -- 172.21.15.92:0/4207335284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc274b0 msgr2=0x55b35fc41e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc274b0 0x55b35fc41e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 -- 172.21.15.92:0/4207335284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 msgr2=0x55b35fc37bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc37bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35fc383e0 con 0x55b35fc262e0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5789d9b640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f577c031440 tx=0x7f577c005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70168504ec95bdaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:02:57.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.407+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c035040 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5784003b70 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f577c04cae0 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f577c004310 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 10 client.25199 fetch_fsmap learned FSMap version 30 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b35fc51040 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5784003b70 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f577c0038f0 con 0x55b35fc262e0 2024-04-26T18:02:57.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 10 client.25199 fetch_fsmap finished waiting for FSMap version 30 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 10 client.25199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 20 client.25199 populate_metadata read hostname 'smithi092' 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fcaffc0 0x55b35fcb23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 4 client.25199 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.408+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b35fb93ee0 con 0x55b35fcaffc0 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.409+0000 7f579259c640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fcaffc0 0x55b35fcb23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.409+0000 7f5779ffb640 10 client.25199 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:57.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.409+0000 7f579259c640 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fcaffc0 0x55b35fcb23e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c851718014a2acf7 server_cookie=46e47ab9e8d9f715 in_seq=0 out_seq=0 2024-04-26T18:02:57.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.419+0000 7f5779ffb640 1 -- 172.21.15.92:0/4207335284 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b35fb93ee0 con 0x55b35fcaffc0 2024-04-26T18:02:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.419+0000 7f5779ffb640 10 client.25199 handle_command_reply: tid=0 2024-04-26T18:02:57.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.419+0000 7f579bc6b740 1 client.25199 shutdown 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 msgr2=0x55b35fc41920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f577c031440 tx=0x7f577c005b50 comp rx=0 tx=0).stop 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 shutdown_connections 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b35fcaffc0 0x55b35fcb23e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b35fc39780 0x55b35fc37bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b35fc274b0 0x55b35fc41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 --2- 172.21.15.92:0/4207335284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b35fc262e0 0x55b35fc41920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 >> 172.21.15.92:0/4207335284 conn(0x55b35fc22410 msgr2=0x55b35fc35b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f5779ffb640 0 client.25199 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:02:57.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 shutdown_connections 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 1 -- 172.21.15.92:0/4207335284 wait complete. 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.420+0000 7f579bc6b740 20 client.25199 trim_cache size 0 max 16384 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:02:57.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.421+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 msgr2=0x7f57800a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.421+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 0x7f57800a6300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f578c0ce520 tx=0x7f578c06b1d0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.421+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 msgr2=0x7f579419d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.421+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f578c00eaa0 tx=0x7f578c00ef60 comp rx=0 tx=0).stop 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 shutdown_connections 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f57800a3e40 0x7f57800a6300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f579410cf70 0x7f579419d930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f57941044c0 0x7f5794199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 --2- 172.21.15.92:0/4146898130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5794103ba0 0x7f57941990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 >> 172.21.15.92:0/4146898130 conn(0x7f5794078a40 msgr2=0x7f57940fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 shutdown_connections 2024-04-26T18:02:57.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:02:57.422+0000 7f5798f51640 1 -- 172.21.15.92:0/4146898130 wait complete. 2024-04-26T18:02:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:57 smithi189 ceph-mon[32756]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:02:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:57 smithi156 ceph-mon[32679]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:02:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:57 smithi092 ceph-mon[29156]: pgmap v102: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:02:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 165.0 s, 3673.2 tps, lat 27.175 ms stddev 30.629 2024-04-26T18:02:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:02:59 smithi189 ceph-mon[32756]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 618 op/s 2024-04-26T18:02:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:02:59 smithi156 ceph-mon[32679]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 618 op/s 2024-04-26T18:02:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:02:59 smithi092 ceph-mon[29156]: pgmap v103: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 618 op/s 2024-04-26T18:03:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:01 smithi189 ceph-mon[32756]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-04-26T18:03:01.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:01 smithi156 ceph-mon[32679]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-04-26T18:03:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:01 smithi092 ceph-mon[29156]: pgmap v104: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 1.09k op/s 2024-04-26T18:03:03.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 170.0 s, 1625.6 tps, lat 60.332 ms stddev 95.268 2024-04-26T18:03:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:03 smithi189 ceph-mon[32756]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 780 op/s 2024-04-26T18:03:03.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:03 smithi156 ceph-mon[32679]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 780 op/s 2024-04-26T18:03:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:03 smithi092 ceph-mon[29156]: pgmap v105: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 MiB/s wr, 780 op/s 2024-04-26T18:03:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:05 smithi189 ceph-mon[32756]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2024-04-26T18:03:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:05 smithi156 ceph-mon[32679]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2024-04-26T18:03:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:05 smithi092 ceph-mon[29156]: pgmap v106: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 1.07k op/s 2024-04-26T18:03:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:07 smithi189 ceph-mon[32756]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 855 op/s 2024-04-26T18:03:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:07 smithi156 ceph-mon[32679]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 855 op/s 2024-04-26T18:03:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:07 smithi092 ceph-mon[29156]: pgmap v107: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 12 MiB/s wr, 855 op/s 2024-04-26T18:03:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 175.0 s, 1986.2 tps, lat 51.397 ms stddev 118.787 2024-04-26T18:03:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:09 smithi189 ceph-mon[32756]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-04-26T18:03:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:09 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:09 smithi156 ceph-mon[32679]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-04-26T18:03:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:09 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:09 smithi092 ceph-mon[29156]: pgmap v108: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 786 op/s 2024-04-26T18:03:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:09 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 -- 172.21.15.92:0/4079556336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c107850 msgr2=0x7f3d0c107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 --2- 172.21.15.92:0/4079556336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c107850 0x7f3d0c107c30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009900 tx=0x7f3d0802a480 comp rx=0 tx=0).stop 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 -- 172.21.15.92:0/4079556336 shutdown_connections 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 --2- 172.21.15.92:0/4079556336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c102920 0x7f3d0c10e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 --2- 172.21.15.92:0/4079556336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 --2- 172.21.15.92:0/4079556336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c107850 0x7f3d0c107c30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 -- 172.21.15.92:0/4079556336 >> 172.21.15.92:0/4079556336 conn(0x7f3d0c077dc0 msgr2=0x7f3d0c0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 -- 172.21.15.92:0/4079556336 shutdown_connections 2024-04-26T18:03:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.542+0000 7f3d1476a640 1 -- 172.21.15.92:0/4079556336 wait complete. 2024-04-26T18:03:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.543+0000 7f3d1476a640 1 Processor -- start 2024-04-26T18:03:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.544+0000 7f3d1476a640 1 -- start start 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c102920 0x7f3d0c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c107850 0x7f3d0c19c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c111a90 con 0x7f3d0c102920 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c111910 con 0x7f3d0c101f60 2024-04-26T18:03:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d1476a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c111c10 con 0x7f3d0c107850 2024-04-26T18:03:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:42956/0 (socket says 172.21.15.92:42956) 2024-04-26T18:03:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 -- 172.21.15.92:0/1259250222 learned_addr learned my addr 172.21.15.92:0/1259250222 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d11d05640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c102920 0x7f3d0c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12d07640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c107850 0x7f3d0c19c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 -- 172.21.15.92:0/1259250222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c107850 msgr2=0x7f3d0c19c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c107850 0x7f3d0c19c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 -- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c102920 msgr2=0x7f3d0c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c102920 0x7f3d0c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.545+0000 7f3d12506640 1 -- 172.21.15.92:0/1259250222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c19cf20 con 0x7f3d0c101f60 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d12506640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006010 tx=0x7f3d08004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d037fe640 1 -- 172.21.15.92:0/1259250222 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08035030 con 0x7f3d0c101f60 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d037fe640 1 -- 172.21.15.92:0/1259250222 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d08003ca0 con 0x7f3d0c101f60 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0c19d1b0 con 0x7f3d0c101f60 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d037fe640 1 -- 172.21.15.92:0/1259250222 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08040c10 con 0x7f3d0c101f60 2024-04-26T18:03:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.546+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d0c100e50 con 0x7f3d0c101f60 2024-04-26T18:03:10.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d17481740 1 Processor -- start 2024-04-26T18:03:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d17481740 1 -- start start 2024-04-26T18:03:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d037fe640 1 -- 172.21.15.92:0/1259250222 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3d080037f0 con 0x7f3d0c101f60 2024-04-26T18:03:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d17481740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d17481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81fe23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.549+0000 7f3d17481740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d17481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a81f35460 con 0x561a81fd8030 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d17481740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561a81eef590 con 0x561a81fe28f0 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d17481740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561a81f31420 con 0x561a81fd7710 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12506640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81fe23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:56918/0 (socket says 172.21.15.92:56918) 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 -- 172.21.15.92:0/3783899177 learned_addr learned my addr 172.21.15.92:0/3783899177 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 -- 172.21.15.92:0/3783899177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 msgr2=0x561a81fe4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 -- 172.21.15.92:0/3783899177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 msgr2=0x561a81fe23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81fe23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 -- 172.21.15.92:0/3783899177 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a81efc0d0 con 0x561a81fd7710 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.550+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009f40 tx=0x7f3d04010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a06ef2df268066c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.551+0000 7f3d00ff9640 1 -- 172.21.15.92:0/3783899177 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04003b70 con 0x561a81fd7710 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.551+0000 7f3d00ff9640 1 -- 172.21.15.92:0/3783899177 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d04003d10 con 0x561a81fd7710 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.551+0000 7f3d00ff9640 1 -- 172.21.15.92:0/3783899177 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04011a00 con 0x561a81fd7710 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.551+0000 7f3d037fe640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 0x7f3cf80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.551+0000 7f3d037fe640 1 -- 172.21.15.92:0/1259250222 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f3d080f1340 con 0x7f3d0c101f60 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d12506640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 0x7f3cf80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 -- 172.21.15.92:0/3783899177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 msgr2=0x561a81fd7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009f40 tx=0x7f3d04010860 comp rx=0 tx=0).stop 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 -- 172.21.15.92:0/3783899177 shutdown_connections 2024-04-26T18:03:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81fe23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 --2- 172.21.15.92:0/3783899177 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fd7af0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.552+0000 7f3d17481740 1 -- 172.21.15.92:0/3783899177 >> 172.21.15.92:0/3783899177 conn(0x561a81fd3c20 msgr2=0x561a81fd4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d12506640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 0x7f3cf80a6300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561a81fd8cb0 tx=0x7f3d080f4d70 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- 172.21.15.92:0/3783899177 shutdown_connections 2024-04-26T18:03:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- 172.21.15.92:0/3783899177 wait complete. 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- start start 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 Processor -- start 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd7710 0x561a81fdf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd8030 0x561a81fdfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561a81fe5520 con 0x561a81fe28f0 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561a81ebcb60 con 0x561a81fd7710 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561a81fe56a0 con 0x561a81fd8030 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.553+0000 7f3d17481740 10 client.0 _ll_register_callbacks cb 0x561a81ee12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36674/0 (socket says 172.21.15.92:36674) 2024-04-26T18:03:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 -- 172.21.15.92:0/3700849195 learned_addr learned my addr 172.21.15.92:0/3700849195 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd8030 0x561a81fdfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 -- 172.21.15.92:0/3700849195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd8030 msgr2=0x561a81fdfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd8030 0x561a81fdfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 -- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd7710 msgr2=0x561a81fdf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd7710 0x561a81fdf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 -- 172.21.15.92:0/3700849195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a81c47210 con 0x561a81fe28f0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3d040116a0 tx=0x7f3d04000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207cee3cd206779c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d04011b70 con 0x561a81fe28f0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d04003d10 con 0x561a81fe28f0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f3d04011d10 con 0x561a81fe28f0 2024-04-26T18:03:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.554+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3d04003ec0 con 0x561a81fe28f0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 10 client.15660 fetch_fsmap learned FSMap version 31 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561a81d13620 con 0x561a81fe28f0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d04003d10 con 0x561a81fe28f0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 31) ==== 8350+0+0 (secure 0 0 0) 0x7f3d04027750 con 0x561a81fe28f0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 10 client.15660 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 20 client.15660 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81ff4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 4 client.15660 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a81f43070 con 0x561a81ff2a30 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.555+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81ff4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.556+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81ff4e20 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08dbde9d12b0a0e server_cookie=8c176fc77cfbc169 in_seq=0 out_seq=0 2024-04-26T18:03:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.556+0000 7f3cf5ffb640 10 client.15660 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3700849195 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561a81f43070 con 0x561a81ff2a30 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3cf5ffb640 10 client.15660 handle_command_reply: tid=0 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 client.15660 shutdown 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 msgr2=0x561a81fe0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3d040116a0 tx=0x7f3d04000f40 comp rx=0 tx=0).stop 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 shutdown_connections 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81ff4e20 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3cf5ffb640 0 client.15660 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fe28f0 0x561a81fe0390 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd8030 0x561a81fdfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 --2- 172.21.15.92:0/3700849195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd7710 0x561a81fdf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 >> 172.21.15.92:0/3700849195 conn(0x561a81fd3c20 msgr2=0x561a81fca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 shutdown_connections 2024-04-26T18:03:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 1 -- 172.21.15.92:0/3700849195 wait complete. 2024-04-26T18:03:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.557+0000 7f3d17481740 20 client.15660 trim_cache size 0 max 16384 2024-04-26T18:03:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.579+0000 7f3d17481740 1 Processor -- start 2024-04-26T18:03:10.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.579+0000 7f3d17481740 1 -- start start 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.579+0000 7f3d17481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd7710 0x561a81fee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d17481740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d17481740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fe28f0 0x561a81ffa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d17481740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aeaa0 con 0x561a81fd7710 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d17481740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1ac310 con 0x561a81fd8030 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d17481740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aa160 con 0x561a81fe28f0 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d11d05640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d11d05640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:42974/0 (socket says 172.21.15.92:42974) 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d11d05640 1 -- 172.21.15.92:0/2825960684 learned_addr learned my addr 172.21.15.92:0/2825960684 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:10.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.580+0000 7f3d12d07640 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd7710 0x561a81fee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 -- 172.21.15.92:0/2825960684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fe28f0 msgr2=0x561a81ffa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fe28f0 0x561a81ffa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 -- 172.21.15.92:0/2825960684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd7710 msgr2=0x561a81fee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd7710 0x561a81fee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 -- 172.21.15.92:0/2825960684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a81fd7e60 con 0x561a81fd8030 2024-04-26T18:03:10.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.581+0000 7f3d11d05640 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x561a81fd5040 tx=0x7f3cfc00f7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27be155fc1e2b82b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.582+0000 7f3cf7fff640 1 -- 172.21.15.92:0/2825960684 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc023070 con 0x561a81fd8030 2024-04-26T18:03:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.582+0000 7f3cf7fff640 1 -- 172.21.15.92:0/2825960684 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc003d80 con 0x561a81fd8030 2024-04-26T18:03:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.582+0000 7f3cf7fff640 1 -- 172.21.15.92:0/2825960684 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc01e950 con 0x561a81fd8030 2024-04-26T18:03:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 -- 172.21.15.92:0/2825960684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 msgr2=0x561a81fca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x561a81fd5040 tx=0x7f3cfc00f7a0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 -- 172.21.15.92:0/2825960684 shutdown_connections 2024-04-26T18:03:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fe28f0 0x561a81ffa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fd8030 0x561a81fca430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 --2- 172.21.15.92:0/2825960684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd7710 0x561a81fee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.585+0000 7f3d17481740 1 -- 172.21.15.92:0/2825960684 >> 172.21.15.92:0/2825960684 conn(0x561a81fd3c20 msgr2=0x561a81fc9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.588+0000 7f3d17481740 1 -- 172.21.15.92:0/2825960684 shutdown_connections 2024-04-26T18:03:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.588+0000 7f3d17481740 1 -- 172.21.15.92:0/2825960684 wait complete. 2024-04-26T18:03:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.589+0000 7f3d17481740 1 -- start start 2024-04-26T18:03:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.589+0000 7f3d17481740 1 Processor -- start 2024-04-26T18:03:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fea8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81feae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fea8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d12d07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fea8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:56930/0 (socket says 172.21.15.92:56930) 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d12d07640 1 -- 172.21.15.92:0/3935602951 learned_addr learned my addr 172.21.15.92:0/3935602951 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aa7d0 con 0x561a81fd8030 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1abc40 con 0x561a81fe28f0 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c1aaea0 con 0x561a81fd7710 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.590+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d17481740 10 client.0 _ll_register_callbacks cb 0x7f3d080f4c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81feae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 -- 172.21.15.92:0/3935602951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 msgr2=0x561a81fea8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fea8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 -- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 msgr2=0x561a81fe78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.591+0000 7f3d11d05640 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a81fe7fd0 con 0x561a81fd8030 2024-04-26T18:03:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.592+0000 7f3d11d05640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81feae30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x561a81fd5040 tx=0x7f3cfc01e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ab95e3c94f0ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:10.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.592+0000 7f3cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.593+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc023070 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.593+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f3cfc00f470 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.593+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cfc003d80 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.593+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3cfc003b20 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.593+0000 7f3d17481740 10 client.15666 fetch_fsmap learned FSMap version 31 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561a81fcb040 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc01f040 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 31) ==== 8350+0+0 (secure 0 0 0) 0x7f3cfc033470 con 0x561a81fd8030 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 10 client.15666 fetch_fsmap finished waiting for FSMap version 31 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 10 client.15666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 20 client.15666 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81fcd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 4 client.15666 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:03:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.594+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f3cfc003d80 con 0x561a81ff2a30 2024-04-26T18:03:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.595+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81fcd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.595+0000 7f3d12d07640 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81fcd770 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72a776ecd676e39 server_cookie=f2f1c1936ff43a79 in_seq=0 out_seq=0 2024-04-26T18:03:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.595+0000 7f3cf5ffb640 10 client.15666 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3cf5ffb640 1 -- 172.21.15.92:0/3935602951 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f3cfc003d80 con 0x561a81ff2a30 2024-04-26T18:03:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3cf5ffb640 10 client.15666 handle_command_reply: tid=0 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 client.15666 shutdown 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 msgr2=0x561a81feae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81feae30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x561a81fd5040 tx=0x7f3cfc01e800 comp rx=0 tx=0).stop 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 shutdown_connections 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561a81ff2a30 0x561a81fcd770 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561a81fe28f0 0x561a81fe78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561a81fd8030 0x561a81feae30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 --2- 172.21.15.92:0/3935602951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561a81fd7710 0x561a81fea8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 >> 172.21.15.92:0/3935602951 conn(0x561a81fd3c20 msgr2=0x561a81fc9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.605+0000 7f3cf5ffb640 0 client.15666 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.606+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 shutdown_connections 2024-04-26T18:03:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.606+0000 7f3d17481740 1 -- 172.21.15.92:0/3935602951 wait complete. 2024-04-26T18:03:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.606+0000 7f3d17481740 20 client.15666 trim_cache size 0 max 16384 2024-04-26T18:03:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:03:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:03:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:03:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:03:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 msgr2=0x7f3cf80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 0x7f3cf80a6300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561a81fd8cb0 tx=0x7f3d080f4d70 comp rx=0 tx=0).stop 2024-04-26T18:03:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 msgr2=0x7f3d0c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d08006010 tx=0x7f3d08004270 comp rx=0 tx=0).stop 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 shutdown_connections 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3cf80a3e40 0x7f3cf80a6300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3d0c107850 0x7f3d0c19c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d0c102920 0x7f3d0c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 --2- 172.21.15.92:0/1259250222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0c101f60 0x7f3d0c197f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 >> 172.21.15.92:0/1259250222 conn(0x7f3d0c077dc0 msgr2=0x7f3d0c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 shutdown_connections 2024-04-26T18:03:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:10.608+0000 7f3d1476a640 1 -- 172.21.15.92:0/1259250222 wait complete. 2024-04-26T18:03:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:10 smithi156 ceph-mon[32679]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 42 MiB/s wr, 1.77k op/s 2024-04-26T18:03:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:10 smithi092 ceph-mon[29156]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 42 MiB/s wr, 1.77k op/s 2024-04-26T18:03:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:10 smithi189 ceph-mon[32756]: pgmap v109: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 42 MiB/s wr, 1.77k op/s 2024-04-26T18:03:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:12 smithi189 ceph-mon[32756]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-04-26T18:03:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:12 smithi156 ceph-mon[32679]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-04-26T18:03:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:12 smithi092 ceph-mon[29156]: pgmap v110: 97 pgs: 97 active+clean; 1.8 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 32 MiB/s wr, 1.29k op/s 2024-04-26T18:03:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 180.0 s, 3362.0 tps, lat 29.748 ms stddev 31.956 2024-04-26T18:03:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:14 smithi189 ceph-mon[32756]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 MiB/s wr, 1.53k op/s 2024-04-26T18:03:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:14 smithi156 ceph-mon[32679]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 MiB/s wr, 1.53k op/s 2024-04-26T18:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:14 smithi092 ceph-mon[29156]: pgmap v111: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 MiB/s wr, 1.53k op/s 2024-04-26T18:03:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:03:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:16 smithi189 ceph-mon[32756]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 1.32k op/s 2024-04-26T18:03:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:16 smithi156 ceph-mon[32679]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 1.32k op/s 2024-04-26T18:03:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:16 smithi092 ceph-mon[29156]: pgmap v112: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 34 MiB/s wr, 1.32k op/s 2024-04-26T18:03:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 185.0 s, 3951.8 tps, lat 25.328 ms stddev 26.345 2024-04-26T18:03:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:18 smithi189 ceph-mon[32756]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 1.29k op/s 2024-04-26T18:03:18.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:18 smithi156 ceph-mon[32679]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 1.29k op/s 2024-04-26T18:03:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:18 smithi092 ceph-mon[29156]: pgmap v113: 97 pgs: 97 active+clean; 1.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 34 MiB/s wr, 1.29k op/s 2024-04-26T18:03:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:20 smithi189 ceph-mon[32756]: pgmap v114: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.63k op/s 2024-04-26T18:03:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:20 smithi156 ceph-mon[32679]: pgmap v114: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.63k op/s 2024-04-26T18:03:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:20 smithi092 ceph-mon[29156]: pgmap v114: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 MiB/s wr, 1.63k op/s 2024-04-26T18:03:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:22 smithi189 ceph-mon[32756]: pgmap v115: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 645 op/s 2024-04-26T18:03:22.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:22 smithi156 ceph-mon[32679]: pgmap v115: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 645 op/s 2024-04-26T18:03:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:22 smithi092 ceph-mon[29156]: pgmap v115: 97 pgs: 97 active+clean; 1.9 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.7 MiB/s wr, 645 op/s 2024-04-26T18:03:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 190.0 s, 3999.2 tps, lat 25.027 ms stddev 25.635 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 -- 172.21.15.92:0/1589731808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 msgr2=0x7f6b40108d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 --2- 172.21.15.92:0/1589731808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b40108d10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009930 tx=0x7f6b3002a420 comp rx=0 tx=0).stop 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 -- 172.21.15.92:0/1589731808 shutdown_connections 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 --2- 172.21.15.92:0/1589731808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b4010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 --2- 172.21.15.92:0/1589731808 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 0x7f6b40102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 --2- 172.21.15.92:0/1589731808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b40108d10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 -- 172.21.15.92:0/1589731808 >> 172.21.15.92:0/1589731808 conn(0x7f6b400fe3f0 msgr2=0x7f6b40100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 -- 172.21.15.92:0/1589731808 shutdown_connections 2024-04-26T18:03:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.730+0000 7f6b479e6640 1 -- 172.21.15.92:0/1589731808 wait complete. 2024-04-26T18:03:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 Processor -- start 2024-04-26T18:03:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 -- start start 2024-04-26T18:03:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 0x7f6b401990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b40199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112bf0 con 0x7f6b40108930 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112a70 con 0x7f6b401032e0 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.731+0000 7f6b479e6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112d70 con 0x7f6b40102920 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52094/0 (socket says 172.21.15.92:52094) 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b40199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 -- 172.21.15.92:0/2549245204 learned_addr learned my addr 172.21.15.92:0/2549245204 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45782640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 0x7f6b401990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 -- 172.21.15.92:0/2549245204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 msgr2=0x7f6b401990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 0x7f6b401990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 -- 172.21.15.92:0/2549245204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 msgr2=0x7f6b40199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.733 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b40199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 -- 172.21.15.92:0/2549245204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4019e0e0 con 0x7f6b40108930 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b40199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.732+0000 7f6b45f83640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800eb10 tx=0x7f6b3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.733+0000 7f6b367fc640 1 -- 172.21.15.92:0/2549245204 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004b20 con 0x7f6b40108930 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.733+0000 7f6b367fc640 1 -- 172.21.15.92:0/2549245204 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b38004cc0 con 0x7f6b40108930 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.733+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4019e3d0 con 0x7f6b40108930 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.733+0000 7f6b367fc640 1 -- 172.21.15.92:0/2549245204 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38010670 con 0x7f6b40108930 2024-04-26T18:03:23.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.733+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40074b60 con 0x7f6b40108930 2024-04-26T18:03:23.735 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.736+0000 7f6b367fc640 1 -- 172.21.15.92:0/2549245204 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6b380108f0 con 0x7f6b40108930 2024-04-26T18:03:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 Processor -- start 2024-04-26T18:03:23.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 -- start start 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba877024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba8765b460 con 0x55ba876f5820 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ba87615590 con 0x55ba877000e0 2024-04-26T18:03:23.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.737+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba87657420 con 0x55ba876f4f00 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52106/0 (socket says 172.21.15.92:52106) 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 -- 172.21.15.92:0/2532076672 learned_addr learned my addr 172.21.15.92:0/2532076672 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba877024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b367fc640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 0x7f6b2c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 -- 172.21.15.92:0/2532076672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 msgr2=0x55ba876f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 -- 172.21.15.92:0/2532076672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 msgr2=0x55ba877024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba877024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45782640 1 -- 172.21.15.92:0/2532076672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba876220d0 con 0x55ba876f5820 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.738+0000 7f6b45f83640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 0x7f6b2c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b45782640 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b30031440 tx=0x7f6b30032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b726151f6df82b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b45f83640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 0x7f6b2c0a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b38099600 tx=0x7f6b380987a0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b367fc640 1 -- 172.21.15.92:0/2549245204 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6b380d0c20 con 0x7f6b40108930 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b2b7fe640 1 -- 172.21.15.92:0/2532076672 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30035070 con 0x55ba876f5820 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b2b7fe640 1 -- 172.21.15.92:0/2532076672 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b300314a0 con 0x55ba876f5820 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.739+0000 7f6b2b7fe640 1 -- 172.21.15.92:0/2532076672 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30005040 con 0x55ba876f5820 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2532076672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 msgr2=0x55ba876ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6b30031440 tx=0x7f6b30032ba0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2532076672 shutdown_connections 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba877024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876ffba0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2532076672 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2532076672 >> 172.21.15.92:0/2532076672 conn(0x55ba876f1410 msgr2=0x55ba876f17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2532076672 shutdown_connections 2024-04-26T18:03:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.740+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2532076672 wait complete. 2024-04-26T18:03:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 -- start start 2024-04-26T18:03:23.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 Processor -- start 2024-04-26T18:03:23.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f5820 0x55ba876fd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba87702cb0 con 0x55ba876f4f00 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ba875e2b60 con 0x55ba877000e0 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba87702e30 con 0x55ba876f5820 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.741+0000 7f6b4a7d8740 10 client.0 _ll_register_callbacks cb 0x55ba876072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52108/0 (socket says 172.21.15.92:52108) 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 -- 172.21.15.92:0/2271773195 learned_addr learned my addr 172.21.15.92:0/2271773195 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:23.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b45782640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f5820 0x55ba876fd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 -- 172.21.15.92:0/2271773195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f5820 msgr2=0x55ba876fd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f5820 0x55ba876fd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 -- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 msgr2=0x55ba876fda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.742+0000 7f6b44f81640 1 -- 172.21.15.92:0/2271773195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba8736d210 con 0x55ba876f4f00 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c003bb0 tx=0x7f6b3c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677100e0ba1ed4be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c02b040 con 0x55ba876f4f00 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6b3c005020 con 0x55ba876f4f00 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b300314a0 con 0x55ba876f4f00 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6b3c003ea0 con 0x55ba876f4f00 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.743+0000 7f6b4a7d8740 10 client.15678 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:23.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ba87439620 con 0x55ba876f4f00 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b300314a0 con 0x55ba876f4f00 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f6b3c031070 con 0x55ba876f4f00 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 10 client.15678 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 10 client.15678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 20 client.15678 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba877102d0 0x55ba87712730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 4 client.15678 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba87669070 con 0x55ba877102d0 2024-04-26T18:03:23.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.744+0000 7f6b45782640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba877102d0 0x55ba87712730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.745+0000 7f6b45782640 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba877102d0 0x55ba87712730 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ed4be94e7129a3 server_cookie=18f0d597f2eae12c in_seq=0 out_seq=0 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.745+0000 7f6b28ff9640 10 client.15678 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2271773195 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ba87669070 con 0x55ba877102d0 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b28ff9640 10 client.15678 handle_command_reply: tid=0 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 client.15678 shutdown 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 msgr2=0x55ba876fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c003bb0 tx=0x7f6b3c00bf60 comp rx=0 tx=0).stop 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 shutdown_connections 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba877102d0 0x55ba87712730 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f5820 0x55ba876fd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2271773195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f4f00 0x55ba876fd000 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 >> 172.21.15.92:0/2271773195 conn(0x55ba876f1410 msgr2=0x55ba876f7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.746+0000 7f6b28ff9640 0 client.15678 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.747+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 shutdown_connections 2024-04-26T18:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.747+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2271773195 wait complete. 2024-04-26T18:03:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.747+0000 7f6b4a7d8740 20 client.15678 trim_cache size 0 max 16384 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 Processor -- start 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 -- start start 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b24010fb0 con 0x55ba876f5820 2024-04-26T18:03:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2400e820 con 0x55ba877000e0 2024-04-26T18:03:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.778+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2400c670 con 0x55ba876f4f00 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:54266/0 (socket says 172.21.15.92:54266) 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 -- 172.21.15.92:0/1435433657 learned_addr learned my addr 172.21.15.92:0/1435433657 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 -- 172.21.15.92:0/1435433657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 msgr2=0x55ba876f8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 -- 172.21.15.92:0/1435433657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 msgr2=0x55ba876f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 -- 172.21.15.92:0/1435433657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba876f7e00 con 0x55ba877000e0 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.779+0000 7f6b44f81640 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b520 tx=0x7f6b3c014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ccd3d9359f04b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b2affd640 1 -- 172.21.15.92:0/1435433657 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c03f070 con 0x55ba877000e0 2024-04-26T18:03:23.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b2affd640 1 -- 172.21.15.92:0/1435433657 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b3c040040 con 0x55ba877000e0 2024-04-26T18:03:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b2affd640 1 -- 172.21.15.92:0/1435433657 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c005440 con 0x55ba877000e0 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/1435433657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 msgr2=0x55ba876fd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00b520 tx=0x7f6b3c014040 comp rx=0 tx=0).stop 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/1435433657 shutdown_connections 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fd8a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/1435433657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/1435433657 >> 172.21.15.92:0/1435433657 conn(0x55ba876f1410 msgr2=0x55ba876f05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/1435433657 shutdown_connections 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.780+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/1435433657 wait complete. 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 -- start start 2024-04-26T18:03:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 Processor -- start 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2400cce0 con 0x55ba876f5820 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2400e150 con 0x55ba877000e0 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2400d3b0 con 0x55ba876f4f00 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.781+0000 7f6b4a7d8740 10 client.0 _ll_register_callbacks cb 0x7f6b3c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52130/0 (socket says 172.21.15.92:52130) 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 -- 172.21.15.92:0/2810208489 learned_addr learned my addr 172.21.15.92:0/2810208489 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 -- 172.21.15.92:0/2810208489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 msgr2=0x55ba876f9d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f9d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 -- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 msgr2=0x55ba876fa800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fa800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 -- 172.21.15.92:0/2810208489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba87775930 con 0x55ba876f5820 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.782+0000 7f6b45782640 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55ba876f64a0 tx=0x7f6b300058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a07df838ddb933 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30035040 con 0x55ba876f5820 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f6b30031d10 con 0x55ba876f5820 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b3c040040 con 0x55ba876f5820 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6b300314a0 con 0x55ba876f5820 2024-04-26T18:03:23.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b4a7d8740 10 client.15681 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ba87776cb0 con 0x55ba876f5820 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b300054f0 con 0x55ba876f5820 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f6b300046c0 con 0x55ba876f5820 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.783+0000 7f6b4a7d8740 10 client.15681 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b4a7d8740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b4a7d8740 20 client.15681 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba87776ff0 0x55ba87779410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b4a7d8740 4 client.15681 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:03:23.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6b3c040040 con 0x55ba87776ff0 2024-04-26T18:03:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.784+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba87776ff0 0x55ba87779410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.785+0000 7f6b28ff9640 10 client.15681 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:23.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.785+0000 7f6b44f81640 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba87776ff0 0x55ba87779410 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecdc7a70ca66bb1d server_cookie=a6836e71638477a7 in_seq=0 out_seq=0 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.794+0000 7f6b28ff9640 1 -- 172.21.15.92:0/2810208489 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6b3c040040 con 0x55ba87776ff0 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b28ff9640 10 client.15681 handle_command_reply: tid=0 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 client.15681 shutdown 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 msgr2=0x55ba876fa2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55ba876f64a0 tx=0x7f6b300058d0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 shutdown_connections 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba87776ff0 0x55ba87779410 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba877000e0 0x55ba876fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b28ff9640 0 client.15681 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba876f5820 0x55ba876fa2c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 --2- 172.21.15.92:0/2810208489 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba876f4f00 0x55ba876f9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 >> 172.21.15.92:0/2810208489 conn(0x55ba876f1410 msgr2=0x55ba876fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 shutdown_connections 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 1 -- 172.21.15.92:0/2810208489 wait complete. 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.795+0000 7f6b4a7d8740 20 client.15681 trim_cache size 0 max 16384 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:03:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:03:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 msgr2=0x7f6b2c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 0x7f6b2c0a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b38099600 tx=0x7f6b380987a0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 msgr2=0x7f6b4019d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800eb10 tx=0x7f6b3800c2d0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 shutdown_connections 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6b2c0a3e40 0x7f6b2c0a6300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b40108930 0x7f6b4019d9b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b401032e0 0x7f6b40199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 --2- 172.21.15.92:0/2549245204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6b40102920 0x7f6b401990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 >> 172.21.15.92:0/2549245204 conn(0x7f6b400fe3f0 msgr2=0x7f6b400fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 shutdown_connections 2024-04-26T18:03:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:23.797+0000 7f6b479e6640 1 -- 172.21.15.92:0/2549245204 wait complete. 2024-04-26T18:03:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:24 smithi189 ceph-mon[32756]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 966 op/s 2024-04-26T18:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:24 smithi156 ceph-mon[32679]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 966 op/s 2024-04-26T18:03:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:24 smithi092 ceph-mon[29156]: pgmap v116: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 966 op/s 2024-04-26T18:03:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:26 smithi189 ceph-mon[32756]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:03:26.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:26 smithi156 ceph-mon[32679]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:03:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:26 smithi092 ceph-mon[29156]: pgmap v117: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.0 MiB/s wr, 733 op/s 2024-04-26T18:03:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 195.0 s, 3788.4 tps, lat 26.379 ms stddev 27.887 2024-04-26T18:03:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:28 smithi189 ceph-mon[32756]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 655 op/s 2024-04-26T18:03:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:28 smithi156 ceph-mon[32679]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 655 op/s 2024-04-26T18:03:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:28 smithi092 ceph-mon[29156]: pgmap v118: 97 pgs: 97 active+clean; 1.9 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 655 op/s 2024-04-26T18:03:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:30 smithi189 ceph-mon[32756]: pgmap v119: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-04-26T18:03:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:30 smithi156 ceph-mon[32679]: pgmap v119: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-04-26T18:03:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:30 smithi092 ceph-mon[29156]: pgmap v119: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-04-26T18:03:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:32 smithi189 ceph-mon[32756]: pgmap v120: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 674 op/s 2024-04-26T18:03:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:32 smithi156 ceph-mon[32679]: pgmap v120: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 674 op/s 2024-04-26T18:03:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:32 smithi092 ceph-mon[29156]: pgmap v120: 97 pgs: 97 active+clean; 1.9 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 674 op/s 2024-04-26T18:03:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 200.0 s, 3728.8 tps, lat 26.807 ms stddev 28.384 2024-04-26T18:03:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:34 smithi189 ceph-mon[32756]: pgmap v121: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 915 op/s 2024-04-26T18:03:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:34 smithi156 ceph-mon[32679]: pgmap v121: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 915 op/s 2024-04-26T18:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:34 smithi092 ceph-mon[29156]: pgmap v121: 97 pgs: 97 active+clean; 2.0 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 915 op/s 2024-04-26T18:03:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:36 smithi189 ceph-mon[32756]: pgmap v122: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 705 op/s 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 -- 172.21.15.92:0/795201413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c01011f0 msgr2=0x7f99c01015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 --2- 172.21.15.92:0/795201413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c01011f0 0x7f99c01015d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f99b000aa10 tx=0x7f99b002b720 comp rx=0 tx=0).stop 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 -- 172.21.15.92:0/795201413 shutdown_connections 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 --2- 172.21.15.92:0/795201413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01062c0 0x7f99c010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 --2- 172.21.15.92:0/795201413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c0101ba0 0x7f99c0105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 --2- 172.21.15.92:0/795201413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c01011f0 0x7f99c01015d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 -- 172.21.15.92:0/795201413 >> 172.21.15.92:0/795201413 conn(0x7f99c0077dc0 msgr2=0x7f99c00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 -- 172.21.15.92:0/795201413 shutdown_connections 2024-04-26T18:03:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.925+0000 7f99c4bda640 1 -- 172.21.15.92:0/795201413 wait complete. 2024-04-26T18:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.926+0000 7f99c4bda640 1 Processor -- start 2024-04-26T18:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.926+0000 7f99c4bda640 1 -- start start 2024-04-26T18:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.926+0000 7f99c4bda640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01011f0 0x7f99c0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99c4bda640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99c4bda640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c019b710 0x7f99c019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99c4bda640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01109a0 con 0x7f99c019b710 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99c4bda640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0110820 con 0x7f99c01062c0 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99be59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01011f0 0x7f99c0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:38200/0 (socket says 172.21.15.92:38200) 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 -- 172.21.15.92:0/122280931 learned_addr learned my addr 172.21.15.92:0/122280931 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99c4bda640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0110b20 con 0x7f99c01011f0 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bed9d640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c019b710 0x7f99c019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 -- 172.21.15.92:0/122280931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01011f0 msgr2=0x7f99c0196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01011f0 0x7f99c0196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 -- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c019b710 msgr2=0x7f99c019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c019b710 0x7f99c019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.927+0000 7f99bdd9b640 1 -- 172.21.15.92:0/122280931 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c019c200 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009fa0 tx=0x7f99b400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99af7fe640 1 -- 172.21.15.92:0/122280931 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40159e0 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99af7fe640 1 -- 172.21.15.92:0/122280931 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b400cd30 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99af7fe640 1 -- 172.21.15.92:0/122280931 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40054e0 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c019c4f0 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.928+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c006e5d0 con 0x7f99c01062c0 2024-04-26T18:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.930+0000 7f99af7fe640 1 -- 172.21.15.92:0/122280931 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f99b400c880 con 0x7f99c01062c0 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 Processor -- start 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 -- start start 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99af7fe640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 0x7f99a80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf1664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf0bf460 con 0x55b0cf1640e0 2024-04-26T18:03:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf079590 con 0x55b0cf159820 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99c79c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf0bb420 con 0x55b0cf158f00 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99af7fe640 1 -- 172.21.15.92:0/122280931 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f99b40d4b40 con 0x7f99c01062c0 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99bed9d640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 0x7f99a80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:38216/0 (socket says 172.21.15.92:38216) 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.931+0000 7f99bdd9b640 1 -- 172.21.15.92:0/3831109336 learned_addr learned my addr 172.21.15.92:0/3831109336 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bed9d640 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf1664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99be59c640 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 -- 172.21.15.92:0/3831109336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 msgr2=0x55b0cf1592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf1592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 -- 172.21.15.92:0/3831109336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 msgr2=0x55b0cf1664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf1664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 -- 172.21.15.92:0/3831109336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cf0860d0 con 0x55b0cf159820 2024-04-26T18:03:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:36 smithi156 ceph-mon[32679]: pgmap v122: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 705 op/s 2024-04-26T18:03:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99b409d4c0 tx=0x7f99b40a0750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f8782d475378f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.932+0000 7f99acff9640 1 -- 172.21.15.92:0/3831109336 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b400be30 con 0x55b0cf159820 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99acff9640 1 -- 172.21.15.92:0/3831109336 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b4005680 con 0x55b0cf159820 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99acff9640 1 -- 172.21.15.92:0/3831109336 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a4ea0 con 0x55b0cf159820 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 -- 172.21.15.92:0/3831109336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 msgr2=0x55b0cf163ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f99b409d4c0 tx=0x7f99b40a0750 comp rx=0 tx=0).stop 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99bed9d640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 0x7f99a80a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b0cf156830 tx=0x7f99b8009b70 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 -- 172.21.15.92:0/3831109336 shutdown_connections 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf1664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf163ba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 --2- 172.21.15.92:0/3831109336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf1592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.933+0000 7f99c79c9740 1 -- 172.21.15.92:0/3831109336 >> 172.21.15.92:0/3831109336 conn(0x55b0cf155410 msgr2=0x55b0cf1557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.934+0000 7f99c79c9740 1 -- 172.21.15.92:0/3831109336 shutdown_connections 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.934+0000 7f99c79c9740 1 -- 172.21.15.92:0/3831109336 wait complete. 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.934+0000 7f99c79c9740 1 -- start start 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.934+0000 7f99c79c9740 1 Processor -- start 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf159820 0x55b0cf161600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99be59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99be59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:38218/0 (socket says 172.21.15.92:38218) 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99be59c640 1 -- 172.21.15.92:0/2513111042 learned_addr learned my addr 172.21.15.92:0/2513111042 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf1640e0 0x55b0cf161b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf166d10 con 0x55b0cf159820 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf046b60 con 0x55b0cf158f00 2024-04-26T18:03:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b0cf166e90 con 0x55b0cf1640e0 2024-04-26T18:03:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.935+0000 7f99c79c9740 10 client.0 _ll_register_callbacks cb 0x55b0cf06b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf159820 0x55b0cf161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 -- 172.21.15.92:0/2513111042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf1640e0 msgr2=0x55b0cf161b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf1640e0 0x55b0cf161b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 -- 172.21.15.92:0/2513111042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf159820 msgr2=0x55b0cf161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf159820 0x55b0cf161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cedd1210 con 0x55b0cf158f00 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99be59c640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99b002bc40 tx=0x7f99b0040d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27d324720eaf8b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0036040 con 0x55b0cf158f00 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b4005680 con 0x55b0cf158f00 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.936+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f99b00307c0 con 0x55b0cf158f00 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99b00309c0 con 0x55b0cf158f00 2024-04-26T18:03:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 10 client.25241 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0cee9d620 con 0x55b0cf158f00 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b4005680 con 0x55b0cf158f00 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f99b0052050 con 0x55b0cf158f00 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 10 client.25241 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 10 client.25241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 20 client.25241 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf174250 0x55b0cf176660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 4 client.25241 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.937+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0cf0cd070 con 0x55b0cf174250 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.938+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf174250 0x55b0cf176660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.938+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf174250 0x55b0cf176660 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e64b4bcb1990467 server_cookie=713c0c8275c5ab9 in_seq=0 out_seq=0 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.938+0000 7f99a5ffb640 10 client.25241 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99a5ffb640 1 -- 172.21.15.92:0/2513111042 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0cf0cd070 con 0x55b0cf174250 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99a5ffb640 10 client.25241 handle_command_reply: tid=0 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 client.25241 shutdown 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 msgr2=0x55b0cf1610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99b002bc40 tx=0x7f99b0040d10 comp rx=0 tx=0).stop 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 shutdown_connections 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf174250 0x55b0cf176660 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf1640e0 0x55b0cf161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf159820 0x55b0cf161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2513111042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf158f00 0x55b0cf1610c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 >> 172.21.15.92:0/2513111042 conn(0x55b0cf155410 msgr2=0x55b0cf15b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99a5ffb640 0 client.25241 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 shutdown_connections 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 1 -- 172.21.15.92:0/2513111042 wait complete. 2024-04-26T18:03:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.939+0000 7f99c79c9740 20 client.25241 trim_cache size 0 max 16384 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.956+0000 7f99c79c9740 1 Processor -- start 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.956+0000 7f99c79c9740 1 -- start start 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.956+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf16fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.956+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.956+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99c79c9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b7280 con 0x55b0cf1640e0 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99c79c9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b4af0 con 0x55b0cf159820 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99c79c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b29c0 con 0x55b0cf158f00 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56990/0 (socket says 172.21.15.92:56990) 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 -- 172.21.15.92:0/2294959411 learned_addr learned my addr 172.21.15.92:0/2294959411 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99be59c640 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf16fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 -- 172.21.15.92:0/2294959411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 msgr2=0x55b0cf16fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf16fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 -- 172.21.15.92:0/2294959411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 msgr2=0x55b0cf15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 -- 172.21.15.92:0/2294959411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0cf150d60 con 0x55b0cf1640e0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99be59c640 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf16fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.957+0000 7f99bed9d640 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009b00 tx=0x7f99b8009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773dc9cc9621bd2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.958+0000 7f99a7fff640 1 -- 172.21.15.92:0/2294959411 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8024030 con 0x55b0cf1640e0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.958+0000 7f99a7fff640 1 -- 172.21.15.92:0/2294959411 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b8003e00 con 0x55b0cf1640e0 2024-04-26T18:03:36.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.958+0000 7f99a7fff640 1 -- 172.21.15.92:0/2294959411 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b80045d0 con 0x55b0cf1640e0 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- 172.21.15.92:0/2294959411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 msgr2=0x55b0cf154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009b00 tx=0x7f99b8009500 comp rx=0 tx=0).stop 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- 172.21.15.92:0/2294959411 shutdown_connections 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf1640e0 0x55b0cf154430 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf159820 0x55b0cf15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 --2- 172.21.15.92:0/2294959411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf158f00 0x55b0cf16fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- 172.21.15.92:0/2294959411 >> 172.21.15.92:0/2294959411 conn(0x55b0cf155410 msgr2=0x55b0cf153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- 172.21.15.92:0/2294959411 shutdown_connections 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- 172.21.15.92:0/2294959411 wait complete. 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 -- start start 2024-04-26T18:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.959+0000 7f99c79c9740 1 Processor -- start 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 0x55b0cf15e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 0x55b0cf15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 0x55b0cf1d97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b2fb0 con 0x55b0cf158f00 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b4420 con 0x55b0cf1640e0 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01b3680 con 0x55b0cf159820 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99c79c9740 10 client.0 _ll_register_callbacks cb 0x7f99b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 0x55b0cf15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 0x55b0cf1d97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 0x55b0cf15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57006/0 (socket says 172.21.15.92:57006) 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99be59c640 1 -- 172.21.15.92:0/1277117485 learned_addr learned my addr 172.21.15.92:0/1277117485 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 0x55b0cf15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 -- 172.21.15.92:0/1277117485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 msgr2=0x55b0cf15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 0x55b0cf15e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 -- 172.21.15.92:0/1277117485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 msgr2=0x55b0cf15e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 0x55b0cf15e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bed9d640 1 -- 172.21.15.92:0/1277117485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0cf1d9d20 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.960+0000 7f99bdd9b640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 0x55b0cf15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99bed9d640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 0x55b0cf1d97e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99b800fc00 tx=0x7f99b80041e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8463ccfd5a32f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8030070 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f99b8004550 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b8003e00 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99b803a050 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99c79c9740 10 client.25247 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.961+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b0cf1dae30 con 0x55b0cf1640e0 2024-04-26T18:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b8003e00 con 0x55b0cf1640e0 2024-04-26T18:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f99b8005560 con 0x55b0cf1640e0 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 10 client.25247 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 10 client.25247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 20 client.25247 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf1db4d0 0x55b0cf1dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 4 client.25247 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.962+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b0cf0c6ee0 con 0x55b0cf1db4d0 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.963+0000 7f99be59c640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf1db4d0 0x55b0cf1dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.963+0000 7f99be59c640 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf1db4d0 0x55b0cf1dd8f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2168b9c7bf576fbc server_cookie=49f1985480ca985f in_seq=0 out_seq=0 2024-04-26T18:03:36.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.963+0000 7f99a5ffb640 10 client.25247 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99a5ffb640 1 -- 172.21.15.92:0/1277117485 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b0cf0c6ee0 con 0x55b0cf1db4d0 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99a5ffb640 10 client.25247 handle_command_reply: tid=0 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 client.25247 shutdown 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 msgr2=0x55b0cf1d97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 0x55b0cf1d97e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99b800fc00 tx=0x7f99b80041e0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 shutdown_connections 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b0cf1db4d0 0x55b0cf1dd8f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0cf1640e0 0x55b0cf1d97e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b0cf159820 0x55b0cf15e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 --2- 172.21.15.92:0/1277117485 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b0cf158f00 0x55b0cf15e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 >> 172.21.15.92:0/1277117485 conn(0x55b0cf155410 msgr2=0x55b0cf1545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99a5ffb640 0 client.25247 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 shutdown_connections 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.973+0000 7f99c79c9740 1 -- 172.21.15.92:0/1277117485 wait complete. 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c79c9740 20 client.25247 trim_cache size 0 max 16384 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:03:36.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:03:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 msgr2=0x7f99a80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 0x7f99a80a6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b0cf156830 tx=0x7f99b8009b70 comp rx=0 tx=0).stop 2024-04-26T18:03:36.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 msgr2=0x7f99c01973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009fa0 tx=0x7f99b400edd0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 shutdown_connections 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f99a80a3e40 0x7f99a80a6300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99c019b710 0x7f99c019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f99c01062c0 0x7f99c01973e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 --2- 172.21.15.92:0/122280931 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99c01011f0 0x7f99c0196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 >> 172.21.15.92:0/122280931 conn(0x7f99c0077dc0 msgr2=0x7f99c00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 shutdown_connections 2024-04-26T18:03:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:36.974+0000 7f99c4bda640 1 -- 172.21.15.92:0/122280931 wait complete. 2024-04-26T18:03:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:36 smithi092 ceph-mon[29156]: pgmap v122: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 705 op/s 2024-04-26T18:03:38.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 205.0 s, 4087.6 tps, lat 24.502 ms stddev 28.541 2024-04-26T18:03:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:38 smithi189 ceph-mon[32756]: pgmap v123: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-04-26T18:03:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:38 smithi156 ceph-mon[32679]: pgmap v123: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-04-26T18:03:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:38 smithi092 ceph-mon[29156]: pgmap v123: 97 pgs: 97 active+clean; 2.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 702 op/s 2024-04-26T18:03:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:40 smithi189 ceph-mon[32756]: pgmap v124: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-04-26T18:03:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:40 smithi156 ceph-mon[32679]: pgmap v124: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-04-26T18:03:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:40 smithi092 ceph-mon[29156]: pgmap v124: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 15 MiB/s wr, 1.04k op/s 2024-04-26T18:03:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:42 smithi189 ceph-mon[32756]: pgmap v125: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-04-26T18:03:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:42 smithi156 ceph-mon[32679]: pgmap v125: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-04-26T18:03:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:42 smithi092 ceph-mon[29156]: pgmap v125: 97 pgs: 97 active+clean; 2.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.5 MiB/s wr, 692 op/s 2024-04-26T18:03:43.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 210.0 s, 3934.6 tps, lat 25.326 ms stddev 25.729 2024-04-26T18:03:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:44 smithi189 ceph-mon[32756]: pgmap v126: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-04-26T18:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:44 smithi156 ceph-mon[32679]: pgmap v126: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-04-26T18:03:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:44 smithi092 ceph-mon[29156]: pgmap v126: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 874 op/s 2024-04-26T18:03:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:03:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:46 smithi156 ceph-mon[32679]: pgmap v127: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.4 MiB/s wr, 779 op/s 2024-04-26T18:03:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:03:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:03:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:03:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:46 smithi092 ceph-mon[29156]: pgmap v127: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.4 MiB/s wr, 779 op/s 2024-04-26T18:03:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:03:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:03:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:03:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:46 smithi189 ceph-mon[32756]: pgmap v127: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.4 MiB/s wr, 779 op/s 2024-04-26T18:03:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:03:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:03:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:03:48.313 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:03:48.313 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:03:48.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:03:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 215.0 s, 3753.0 tps, lat 26.565 ms stddev 27.114 2024-04-26T18:03:48.677 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:03:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:48 smithi156 ceph-mon[32679]: pgmap v128: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-04-26T18:03:48.950 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:48 smithi092 ceph-mon[29156]: pgmap v128: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-04-26T18:03:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:48 smithi189 ceph-mon[32756]: pgmap v128: 97 pgs: 97 active+clean; 2.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-04-26T18:03:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.110+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/3718836603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4107850 msgr2=0x7fc7e4107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.110+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/3718836603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4107850 0x7fc7e4107c30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009890 tx=0x7fc7d402a380 comp rx=0 tx=0).stop 2024-04-26T18:03:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/3718836603 shutdown_connections 2024-04-26T18:03:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/3718836603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4102250 0x7fc7e410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/3718836603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4101890 0x7fc7e4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/3718836603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4107850 0x7fc7e4107c30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/3718836603 >> 172.21.15.92:0/3718836603 conn(0x7fc7e4078980 msgr2=0x7fc7e4078d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/3718836603 shutdown_connections 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/3718836603 wait complete. 2024-04-26T18:03:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.111+0000 7fc7e9dd4640 1 Processor -- start 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.112+0000 7fc7e9dd4640 1 -- start start 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4102250 0x7fc7e419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 0x7fc7e419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41105a0 con 0x7fc7e4102250 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4110420 con 0x7fc7e4101890 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e9dd4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e4110720 con 0x7fc7e4107850 2024-04-26T18:03:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46214/0 (socket says 172.21.15.92:46214) 2024-04-26T18:03:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e37fe640 1 -- 172.21.15.92:0/572128392 learned_addr learned my addr 172.21.15.92:0/572128392 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.113+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 0x7fc7e419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 -- 172.21.15.92:0/572128392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 msgr2=0x7fc7e419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 0x7fc7e419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 -- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4102250 msgr2=0x7fc7e419b800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4102250 0x7fc7e419b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 -- 172.21.15.92:0/572128392 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41a02b0 con 0x7fc7e4101890 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 0x7fc7e419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009860 tx=0x7fc7d4032e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e0ff9640 1 -- 172.21.15.92:0/572128392 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4040020 con 0x7fc7e4101890 2024-04-26T18:03:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e0ff9640 1 -- 172.21.15.92:0/572128392 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d4030450 con 0x7fc7e4101890 2024-04-26T18:03:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e41a0540 con 0x7fc7e4101890 2024-04-26T18:03:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e0ff9640 1 -- 172.21.15.92:0/572128392 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4037040 con 0x7fc7e4101890 2024-04-26T18:03:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.114+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41a7e30 con 0x7fc7e4101890 2024-04-26T18:03:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.116+0000 7fc7e0ff9640 1 -- 172.21.15.92:0/572128392 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fc7d4043020 con 0x7fc7e4101890 2024-04-26T18:03:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 Processor -- start 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 -- start start 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e0ff9640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 0x7fc7cc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add71102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add711d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55add7076460 con 0x55add710ff00 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55add7030590 con 0x55add7110820 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55add7072420 con 0x55add711b0e0 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add71102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 0x7fc7cc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46224/0 (socket says 172.21.15.92:46224) 2024-04-26T18:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add71102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57152/0 (socket says 172.21.15.92:57152) 2024-04-26T18:03:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1248647502 learned_addr learned my addr 172.21.15.92:0/1248647502 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.117+0000 7fc7e0ff9640 1 -- 172.21.15.92:0/572128392 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fc7d40f0790 con 0x7fc7e4101890 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add711d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1248647502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 msgr2=0x55add711d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add711d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1248647502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 msgr2=0x55add71102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add71102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1248647502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add703d0d0 con 0x55add7110820 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 0x7fc7cc0a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc005fd0 tx=0x7fc7dc009d70 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.118+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009b70 tx=0x7fc7d800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2affccc153e2b09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.119+0000 7fc7c9ffb640 1 -- 172.21.15.92:0/1248647502 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8009e60 con 0x55add7110820 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.119+0000 7fc7c9ffb640 1 -- 172.21.15.92:0/1248647502 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d80054d0 con 0x55add7110820 2024-04-26T18:03:50.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.119+0000 7fc7c9ffb640 1 -- 172.21.15.92:0/1248647502 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8010690 con 0x55add7110820 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.120+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1248647502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 msgr2=0x55add711aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.120+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009b70 tx=0x7fc7d800e720 comp rx=0 tx=0).stop 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.121+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1248647502 shutdown_connections 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.121+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add711d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.121+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add711aba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.121+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1248647502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add71102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.121+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1248647502 >> 172.21.15.92:0/1248647502 conn(0x55add710c410 msgr2=0x55add710c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.122+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1248647502 shutdown_connections 2024-04-26T18:03:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.122+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1248647502 wait complete. 2024-04-26T18:03:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.122+0000 7fc7ecbcd740 1 -- start start 2024-04-26T18:03:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.122+0000 7fc7ecbcd740 1 Processor -- start 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add7118150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add7118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55add711dd10 con 0x55add710ff00 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55add6ffdb60 con 0x55add7110820 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55add711de90 con 0x55add711b0e0 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add7118150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46234/0 (socket says 172.21.15.92:46234) 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add7118150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57164/0 (socket says 172.21.15.92:57164) 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1123351843 learned_addr learned my addr 172.21.15.92:0/1123351843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7ecbcd740 10 client.0 _ll_register_callbacks cb 0x55add70222b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add7118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1123351843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 msgr2=0x55add7118bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add7118bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1123351843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 msgr2=0x55add7118150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add7118150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.123+0000 7fc7e2ffd640 1 -- 172.21.15.92:0/1123351843 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add6d88210 con 0x55add7110820 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.124+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8004bb0 tx=0x7fc7d80096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8745d81b57c89f1a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.124+0000 7fc7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.124+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d801d040 con 0x55add7110820 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.124+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fc7d8005220 con 0x55add7110820 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.124+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d80054d0 con 0x55add7110820 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc7d8030050 con 0x55add7110820 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7ecbcd740 10 client.25259 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55add6e54620 con 0x55add7110820 2024-04-26T18:03:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d80054d0 con 0x55add7110820 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fc7d80042b0 con 0x55add7110820 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.125+0000 7fc7ecbcd740 10 client.25259 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.126+0000 7fc7ecbcd740 10 client.25259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.126+0000 7fc7ecbcd740 20 client.25259 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.126+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add712b1b0 0x55add712d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.126+0000 7fc7ecbcd740 4 client.25259 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.126+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55add7084070 con 0x55add712b1b0 2024-04-26T18:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.127+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add712b1b0 0x55add712d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.128+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add712b1b0 0x55add712d5a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c251022e9f8bc4c0 server_cookie=8dd90cd1124f0475 in_seq=0 out_seq=0 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.128+0000 7fc7c2ffd640 10 client.25259 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.128+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/1123351843 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55add7084070 con 0x55add712b1b0 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.128+0000 7fc7c2ffd640 10 client.25259 handle_command_reply: tid=0 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 client.25259 shutdown 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 msgr2=0x55add7118690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8004bb0 tx=0x7fc7d80096c0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 shutdown_connections 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add712b1b0 0x55add712d5a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add711b0e0 0x55add7118bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add7110820 0x55add7118690 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1123351843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add710ff00 0x55add7118150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 >> 172.21.15.92:0/1123351843 conn(0x55add710c410 msgr2=0x55add7112190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7c2ffd640 0 client.25259 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 shutdown_connections 2024-04-26T18:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1123351843 wait complete. 2024-04-26T18:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.129+0000 7fc7ecbcd740 20 client.25259 trim_cache size 0 max 16384 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.150+0000 7fc7ecbcd740 1 Processor -- start 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.150+0000 7fc7ecbcd740 1 -- start start 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.150+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.150+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add7132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add71330e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b2f90 con 0x55add711b0e0 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b0800 con 0x55add710ff00 2024-04-26T18:03:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41ae650 con 0x55add7110820 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:46236/0 (socket says 172.21.15.92:46236) 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 -- 172.21.15.92:0/1577901080 learned_addr learned my addr 172.21.15.92:0/1577901080 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e3fff640 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add71330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add7132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 -- 172.21.15.92:0/1577901080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 msgr2=0x55add7132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add7132ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 -- 172.21.15.92:0/1577901080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 msgr2=0x55add71330e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add71330e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 -- 172.21.15.92:0/1577901080 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55add7110650 con 0x55add710ff00 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402a940 tx=0x7fc7d40a7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64eab3a245c58296 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7c97fa640 1 -- 172.21.15.92:0/1577901080 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40bae70 con 0x55add710ff00 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7c97fa640 1 -- 172.21.15.92:0/1577901080 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d4030900 con 0x55add710ff00 2024-04-26T18:03:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.151+0000 7fc7c97fa640 1 -- 172.21.15.92:0/1577901080 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40b9f00 con 0x55add710ff00 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1577901080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 msgr2=0x55add7126bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc7d402a940 tx=0x7fc7d40a7040 comp rx=0 tx=0).stop 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1577901080 shutdown_connections 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add71330e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add7132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/1577901080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add7126bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1577901080 >> 172.21.15.92:0/1577901080 conn(0x55add710c410 msgr2=0x55add710c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1577901080 shutdown_connections 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.152+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/1577901080 wait complete. 2024-04-26T18:03:50.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.153+0000 7fc7ecbcd740 1 -- start start 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.153+0000 7fc7ecbcd740 1 Processor -- start 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.153+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add71233b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add711e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add711ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41aecc0 con 0x55add711b0e0 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41b0130 con 0x55add710ff00 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e41af390 con 0x55add7110820 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7ecbcd740 10 client.0 _ll_register_callbacks cb 0x7fc7d4032f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add711ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add711ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57194/0 (socket says 172.21.15.92:57194) 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add71233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e3fff640 1 -- 172.21.15.92:0/2554830337 learned_addr learned my addr 172.21.15.92:0/2554830337 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add711e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 -- 172.21.15.92:0/2554830337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 msgr2=0x55add711e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add711e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 -- 172.21.15.92:0/2554830337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 msgr2=0x55add711ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add711ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 -- 172.21.15.92:0/2554830337 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55add711f350 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.154+0000 7fc7e37fe640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add71233b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55add7111570 tx=0x7fc7d40b8550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4a2c4a761cb6d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40ba0e0 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7d4030900 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fc7d4030600 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc7d40ba9f0 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7ecbcd740 10 client.25265 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55add7199b30 con 0x55add710ff00 2024-04-26T18:03:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.155+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7d4030900 con 0x55add710ff00 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fc7d40b8f20 con 0x55add710ff00 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 10 client.25265 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 10 client.25265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 20 client.25265 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add719a1d0 0x55add719c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 4 client.25265 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55add707dee0 con 0x55add719a1d0 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add719a1d0 0x55add719c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7c2ffd640 10 client.25265 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:50.159 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.156+0000 7fc7e2ffd640 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add719a1d0 0x55add719c5f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b6cae752ab20341 server_cookie=18b07b9c72452bb7 in_seq=0 out_seq=0 2024-04-26T18:03:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.166+0000 7fc7c2ffd640 1 -- 172.21.15.92:0/2554830337 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55add707dee0 con 0x55add719a1d0 2024-04-26T18:03:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.166+0000 7fc7c2ffd640 10 client.25265 handle_command_reply: tid=0 2024-04-26T18:03:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.166+0000 7fc7ecbcd740 1 client.25265 shutdown 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 msgr2=0x55add71233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add71233b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55add7111570 tx=0x7fc7d40b8550 comp rx=0 tx=0).stop 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 shutdown_connections 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55add719a1d0 0x55add719c5f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55add711b0e0 0x55add711ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55add7110820 0x55add711e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 --2- 172.21.15.92:0/2554830337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55add710ff00 0x55add71233b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 >> 172.21.15.92:0/2554830337 conn(0x55add710c410 msgr2=0x55add7116960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7c2ffd640 0 client.25265 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 shutdown_connections 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 1 -- 172.21.15.92:0/2554830337 wait complete. 2024-04-26T18:03:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.167+0000 7fc7ecbcd740 20 client.25265 trim_cache size 0 max 16384 2024-04-26T18:03:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:03:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:03:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:03:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 msgr2=0x7fc7cc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 0x7fc7cc0a6300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc005fd0 tx=0x7fc7dc009d70 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 msgr2=0x7fc7e419b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009860 tx=0x7fc7d4032e10 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 shutdown_connections 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc7cc0a3e40 0x7fc7cc0a6300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc7e4107850 0x7fc7e419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7e4102250 0x7fc7e419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 --2- 172.21.15.92:0/572128392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101890 0x7fc7e419b2c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 >> 172.21.15.92:0/572128392 conn(0x7fc7e4078980 msgr2=0x7fc7e4105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 shutdown_connections 2024-04-26T18:03:50.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:03:50.168+0000 7fc7e9dd4640 1 -- 172.21.15.92:0/572128392 wait complete. 2024-04-26T18:03:50.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:50 smithi092 ceph-mon[29156]: pgmap v129: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 987 op/s 2024-04-26T18:03:50.868 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 -- 172.21.15.92:0/2204904318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c01034a0 msgr2=0x7f02c0103900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 --2- 172.21.15.92:0/2204904318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c01034a0 0x7f02c0103900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009990 tx=0x7f02b0009ca0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 -- 172.21.15.92:0/2204904318 shutdown_connections 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 --2- 172.21.15.92:0/2204904318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c0103e40 0x7f02c0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 --2- 172.21.15.92:0/2204904318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01094e0 0x7f02c01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 --2- 172.21.15.92:0/2204904318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c01034a0 0x7f02c0103900 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 -- 172.21.15.92:0/2204904318 >> 172.21.15.92:0/2204904318 conn(0x7f02c007a4f0 msgr2=0x7f02c007a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 -- 172.21.15.92:0/2204904318 shutdown_connections 2024-04-26T18:03:50.869 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.869+0000 7f02c8466700 1 -- 172.21.15.92:0/2204904318 wait complete. 2024-04-26T18:03:50.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 Processor -- start 2024-04-26T18:03:50.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 -- start start 2024-04-26T18:03:50.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 0x7f02c010cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.870 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c01094e0 0x7f02c010d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0076ce0 con 0x7f02c0103e40 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0076b60 con 0x7f02c01094e0 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.870+0000 7f02c8466700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0076e60 con 0x7f02c01034a0 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.871+0000 7f02c6202700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.871+0000 7f02c6202700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44710/0 (socket says 172.21.15.92:44710) 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.871+0000 7f02c6202700 1 -- 172.21.15.92:0/2887923209 learned_addr learned my addr 172.21.15.92:0/2887923209 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.871+0000 7f02c6a03700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c01094e0 0x7f02c010d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.871 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.871+0000 7f02c5a01700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 0x7f02c010cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 -- 172.21.15.92:0/2887923209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c01094e0 msgr2=0x7f02c010d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c01094e0 0x7f02c010d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 -- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 msgr2=0x7f02c010cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 0x7f02c010cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 -- 172.21.15.92:0/2887923209 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c010da50 con 0x7f02c01034a0 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c5a01700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 0x7f02c010cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:03:50.873 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c6202700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e9f0 tx=0x7f02bc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc00cbd0 con 0x7f02c01034a0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c010dd40 con 0x7f02c01034a0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c01accb0 con 0x7f02c01034a0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.872+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02bc00cd70 con 0x7f02c01034a0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.873+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc005680 con 0x7f02c01034a0 2024-04-26T18:03:50.874 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.874+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a4005330 con 0x7f02c01034a0 2024-04-26T18:03:50.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.876+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f02bc004750 con 0x7f02c01034a0 2024-04-26T18:03:50.875 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.876+0000 7f02b77fe700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 0x7f02ac0a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:50.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.877+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f02bc0d08a0 con 0x7f02c01034a0 2024-04-26T18:03:50.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.877+0000 7f02c5a01700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 0x7f02ac0a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:50.876 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.877+0000 7f02c5a01700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 0x7f02ac0a6370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02b000b2e0 tx=0x7f02b001a040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:50.884 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:50.885+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f02bc09cf50 con 0x7f02c01034a0 2024-04-26T18:03:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:50 smithi156 ceph-mon[32679]: pgmap v129: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 987 op/s 2024-04-26T18:03:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:50 smithi189 ceph-mon[32756]: pgmap v129: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 13 MiB/s wr, 987 op/s 2024-04-26T18:03:51.284 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.285+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02a40058f0 con 0x7f02c01034a0 2024-04-26T18:03:51.285 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.286+0000 7f02b77fe700 1 -- 172.21.15.92:0/2887923209 <== mon.1 v2:172.21.15.189:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7f02bc09c850 con 0x7f02c01034a0 2024-04-26T18:03:51.286 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:03:51.286 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:03:13.093720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 msgr2=0x7f02ac0a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 0x7f02ac0a6370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02b000b2e0 tx=0x7f02b001a040 comp rx=0 tx=0).stop 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 msgr2=0x7f02c010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e9f0 tx=0x7f02bc00ed00 comp rx=0 tx=0).stop 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 shutdown_connections 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f02ac0a3eb0 0x7f02ac0a6370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02c01094e0 0x7f02c010d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f02c01034a0 0x7f02c010fe70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:51.289 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 --2- 172.21.15.92:0/2887923209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c0103e40 0x7f02c010cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.289+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 >> 172.21.15.92:0/2887923209 conn(0x7f02c007a4f0 msgr2=0x7f02c0102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.290+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 shutdown_connections 2024-04-26T18:03:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:51.290+0000 7f02c8466700 1 -- 172.21.15.92:0/2887923209 wait complete. 2024-04-26T18:03:51.290 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 32 2024-04-26T18:03:51.909 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:51 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/2887923209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:03:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:51 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/2887923209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:03:52.124 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:03:52.124 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:03:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:51 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/2887923209' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:03:52.563 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:03:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:52 smithi156 ceph-mon[32679]: pgmap v130: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-04-26T18:03:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:52 smithi092 ceph-mon[29156]: pgmap v130: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-04-26T18:03:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:52 smithi189 ceph-mon[32756]: pgmap v130: 97 pgs: 97 active+clean; 2.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.7 MiB/s wr, 646 op/s 2024-04-26T18:03:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 220.0 s, 3438.4 tps, lat 29.173 ms stddev 30.988 2024-04-26T18:03:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:54 smithi156 ceph-mon[32679]: pgmap v131: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-04-26T18:03:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:54 smithi092 ceph-mon[29156]: pgmap v131: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-04-26T18:03:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:54 smithi189 ceph-mon[32756]: pgmap v131: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-04-26T18:03:55.689 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 -- 172.21.15.92:0/2156009883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c1030c0 msgr2=0x7f831c10f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 --2- 172.21.15.92:0/2156009883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c1030c0 0x7f831c10f170 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f831400b0a0 tx=0x7f831400b3b0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 -- 172.21.15.92:0/2156009883 shutdown_connections 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 --2- 172.21.15.92:0/2156009883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1084c0 0x7f831c1088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 --2- 172.21.15.92:0/2156009883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c1030c0 0x7f831c10f170 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 --2- 172.21.15.92:0/2156009883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c102700 0x7f831c102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.689+0000 7f83222b4700 1 -- 172.21.15.92:0/2156009883 >> 172.21.15.92:0/2156009883 conn(0x7f831c0792d0 msgr2=0x7f831c0796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.690+0000 7f83222b4700 1 -- 172.21.15.92:0/2156009883 shutdown_connections 2024-04-26T18:03:55.690 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.690+0000 7f83222b4700 1 -- 172.21.15.92:0/2156009883 wait complete. 2024-04-26T18:03:55.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 Processor -- start 2024-04-26T18:03:55.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 -- start start 2024-04-26T18:03:55.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 0x7f831c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.691 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1030c0 0x7f831c19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f831c112610 con 0x7f831c102700 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f831c112490 con 0x7f831c1030c0 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f83222b4700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f831c112790 con 0x7f831c1084c0 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f8320851700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.691+0000 7f831bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 0x7f831c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:40558/0 (socket says 172.21.15.92:40558) 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 -- 172.21.15.92:0/3793012232 learned_addr learned my addr 172.21.15.92:0/3793012232 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f831bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 0x7f831c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33938/0 (socket says 172.21.15.92:33938) 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f831b7fe700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1030c0 0x7f831c19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 -- 172.21.15.92:0/3793012232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1030c0 msgr2=0x7f831c19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1030c0 0x7f831c19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 -- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 msgr2=0x7f831c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 0x7f831c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.692 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.692+0000 7f8320851700 1 -- 172.21.15.92:0/3793012232 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c1987c0 con 0x7f831c1084c0 2024-04-26T18:03:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.693+0000 7f8320851700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8314006070 tx=0x7f8314004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.693+0000 7f83197fa700 1 -- 172.21.15.92:0/3793012232 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314021070 con 0x7f831c1084c0 2024-04-26T18:03:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.693+0000 7f83197fa700 1 -- 172.21.15.92:0/3793012232 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8314003c00 con 0x7f831c1084c0 2024-04-26T18:03:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.693+0000 7f83197fa700 1 -- 172.21.15.92:0/3793012232 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314021070 con 0x7f831c1084c0 2024-04-26T18:03:55.693 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.694+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c198a50 con 0x7f831c1084c0 2024-04-26T18:03:55.694 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.694+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c198f40 con 0x7f831c1084c0 2024-04-26T18:03:55.696 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.696+0000 7f83197fa700 1 -- 172.21.15.92:0/3793012232 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8314004570 con 0x7f831c1084c0 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.697+0000 7f83197fa700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 0x7f83040a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.698+0000 7f83197fa700 1 -- 172.21.15.92:0/3793012232 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f831400f020 con 0x7f831c1084c0 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.698+0000 7f831bfff700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 0x7f83040a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.698+0000 7f831bfff700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 0x7f83040a67a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f830c009bd0 tx=0x7f830c009260 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.698+0000 7f832cb46b80 1 Processor -- start 2024-04-26T18:03:55.697 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.698+0000 7f832cb46b80 1 -- start start 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70341310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7033b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559c7028d9c0 con 0x559c70340f30 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559c701f3ac0 con 0x559c70341850 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f832cb46b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c70289980 con 0x559c7033b900 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70341310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7033b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.699 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70341310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33954/0 (socket says 172.21.15.92:33954) 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831bfff700 1 -- 172.21.15.92:0/2293823793 learned_addr learned my addr 172.21.15.92:0/2293823793 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f8320851700 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 -- 172.21.15.92:0/2293823793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 msgr2=0x559c7033bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 -- 172.21.15.92:0/2293823793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 msgr2=0x559c70341310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70341310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 -- 172.21.15.92:0/2293823793 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c701daa60 con 0x559c70341850 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7033b2e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f831c06c650 tx=0x7f831000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60a16ab5084522af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.699+0000 7f83027fc700 1 -- 172.21.15.92:0/2293823793 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310010bb0 con 0x559c70341850 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.700+0000 7f83027fc700 1 -- 172.21.15.92:0/2293823793 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83100044e0 con 0x559c70341850 2024-04-26T18:03:55.700 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.700+0000 7f83027fc700 1 -- 172.21.15.92:0/2293823793 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310005280 con 0x559c70341850 2024-04-26T18:03:55.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.700+0000 7f832cb46b80 1 -- 172.21.15.92:0/2293823793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 msgr2=0x559c7033b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.701 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.700+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7033b2e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f831c06c650 tx=0x7f831000bf40 comp rx=0 tx=0).stop 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 -- 172.21.15.92:0/2293823793 shutdown_connections 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70341310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2293823793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7033b2e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 -- 172.21.15.92:0/2293823793 >> 172.21.15.92:0/2293823793 conn(0x559c70269750 msgr2=0x559c70336090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 -- 172.21.15.92:0/2293823793 shutdown_connections 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 -- 172.21.15.92:0/2293823793 wait complete. 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.702+0000 7f832cb46b80 1 -- start start 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 Processor -- start 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c70347490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.706 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70341850 0x559c70344d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559c703482c0 con 0x559c70340f30 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559c70247c10 con 0x559c7033b900 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559c70348440 con 0x559c70341850 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f832cb46b80 10 client.0 _ll_register_callbacks cb 0x559c70225ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33956/0 (socket says 172.21.15.92:33956) 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831b7fe700 1 -- 172.21.15.92:0/2412817344 learned_addr learned my addr 172.21.15.92:0/2412817344 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c70347490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f8320851700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70341850 0x559c70344d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 -- 172.21.15.92:0/2412817344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70341850 msgr2=0x559c70344d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70341850 0x559c70344d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 -- 172.21.15.92:0/2412817344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 msgr2=0x559c70344830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.707 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831bfff700 1 -- 172.21.15.92:0/2412817344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7024b610 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.703+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f831bfff700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c70347490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f830c0058e0 tx=0x7f830c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1809cff5f841596b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c01f840 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f830c01f9e0 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83100044e0 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f830c01fbe0 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f832cb46b80 10 client.25283 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559c70352aa0 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83100044e0 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f830c030020 con 0x559c7033b900 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f832cb46b80 10 client.25283 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:55.708 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.704+0000 7f832cb46b80 10 client.25283 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f832cb46b80 20 client.25283 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c70355030 0x559c70357460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f832cb46b80 4 client.25283 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c7029b3a0 con 0x559c70355030 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c70355030 0x559c70357460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f831b7fe700 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c70355030 0x559c70357460 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a711e6c8745b43b server_cookie=90890e6dea02d599 in_seq=0 out_seq=0 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.705+0000 7f82fb7fe700 10 client.25283 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f82fb7fe700 1 -- 172.21.15.92:0/2412817344 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559c7029b3a0 con 0x559c70355030 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f82fb7fe700 10 client.25283 handle_command_reply: tid=0 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 client.25283 shutdown 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 msgr2=0x559c70347490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c70347490 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f830c0058e0 tx=0x7f830c0047c0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 shutdown_connections 2024-04-26T18:03:55.709 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c70355030 0x559c70357460 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c70347490 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70341850 0x559c70344d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 --2- 172.21.15.92:0/2412817344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c70344830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 >> 172.21.15.92:0/2412817344 conn(0x559c70269750 msgr2=0x559c7033a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.706+0000 7f82fb7fe700 0 client.25283 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.707+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 shutdown_connections 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.707+0000 7f832cb46b80 1 -- 172.21.15.92:0/2412817344 wait complete. 2024-04-26T18:03:55.710 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.707+0000 7f832cb46b80 20 client.25283 trim_cache size 0 max 16384 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 Processor -- start 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 -- start start 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c703511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b6980 con 0x559c70340f30 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b41b0 con 0x559c70341850 2024-04-26T18:03:55.736 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.736+0000 7f832cb46b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1a97e0 con 0x559c7033b900 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:38300/0 (socket says 172.21.15.92:38300) 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 -- 172.21.15.92:0/1167416051 learned_addr learned my addr 172.21.15.92:0/1167416051 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f831b7fe700 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c703511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f831bfff700 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.738 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 -- 172.21.15.92:0/1167416051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 msgr2=0x559c7033b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 -- 172.21.15.92:0/1167416051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 msgr2=0x559c703511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c703511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 -- 172.21.15.92:0/1167416051 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c70347c90 con 0x559c70341850 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.737+0000 7f8320851700 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f831409d330 tx=0x7f8314088040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=308bb1ee046eede4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f8301ffb700 1 -- 172.21.15.92:0/1167416051 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314021040 con 0x559c70341850 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f8301ffb700 1 -- 172.21.15.92:0/1167416051 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f831402d350 con 0x559c70341850 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f8301ffb700 1 -- 172.21.15.92:0/1167416051 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314004860 con 0x559c70341850 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 -- 172.21.15.92:0/1167416051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 msgr2=0x559c7032fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f831409d330 tx=0x7f8314088040 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 -- 172.21.15.92:0/1167416051 shutdown_connections 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c70341850 0x559c7032fe10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c7033b900 0x559c7033b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 --2- 172.21.15.92:0/1167416051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70340f30 0x559c703511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.739 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.738+0000 7f832cb46b80 1 -- 172.21.15.92:0/1167416051 >> 172.21.15.92:0/1167416051 conn(0x559c70269750 msgr2=0x559c7032f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- 172.21.15.92:0/1167416051 shutdown_connections 2024-04-26T18:03:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- 172.21.15.92:0/1167416051 wait complete. 2024-04-26T18:03:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- start start 2024-04-26T18:03:55.740 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 Processor -- start 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c7034a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70340f30 0x559c7034abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1a9e50 con 0x559c70341850 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b3ae0 con 0x559c7033b900 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.739+0000 7f832cb46b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f831c1b2d40 con 0x559c70340f30 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f832cb46b80 10 client.0 _ll_register_callbacks cb 0x559c70225ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f831bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c7034a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.742 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33968/0 (socket says 172.21.15.92:33968) 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 -- 172.21.15.92:0/3807561166 learned_addr learned my addr 172.21.15.92:0/3807561166 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f831b7fe700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70340f30 0x559c7034abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 -- 172.21.15.92:0/3807561166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70340f30 msgr2=0x559c7034abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70340f30 0x559c7034abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 -- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 msgr2=0x559c7034a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c7034a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 -- 172.21.15.92:0/3807561166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c70332880 con 0x559c70341850 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f8320851700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8314099a90 tx=0x7f831400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce3b1229d79f2a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.740+0000 7f82fb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314021070 con 0x559c70341850 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f8314003db0 con 0x559c70341850 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f831402d350 con 0x559c70341850 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f831409d630 con 0x559c70341850 2024-04-26T18:03:55.743 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f832cb46b80 10 client.15738 fetch_fsmap learned FSMap version 32 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.741+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x559c703bc810 con 0x559c70341850 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f831402d350 con 0x559c70341850 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f8314011070 con 0x559c70341850 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 10 client.15738 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 10 client.15738 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 20 client.15738 populate_metadata read hostname 'smithi092' 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c703bcc40 0x559c703bf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 4 client.15738 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x559c70295440 con 0x559c703bcc40 2024-04-26T18:03:55.744 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.742+0000 7f831bfff700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c703bcc40 0x559c703bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:03:55.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.743+0000 7f831bfff700 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c703bcc40 0x559c703bf030 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e0f723b17ecdec8 server_cookie=aa3a3225fc7eacc9 in_seq=0 out_seq=0 2024-04-26T18:03:55.745 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.744+0000 7f82fb7fe700 10 client.15738 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:55.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.945+0000 7f82fb7fe700 1 -- 172.21.15.92:0/3807561166 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x559c70295440 con 0x559c703bcc40 2024-04-26T18:03:55.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.945+0000 7f82fb7fe700 10 client.15738 handle_command_reply: tid=0 2024-04-26T18:03:55.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.945+0000 7f832cb46b80 1 client.15738 shutdown 2024-04-26T18:03:55.945 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.945+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 msgr2=0x559c7034b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.945+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8314099a90 tx=0x7f831400b720 comp rx=0 tx=0).stop 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 shutdown_connections 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559c703bcc40 0x559c703bf030 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559c7033b900 0x559c7034a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f82fb7fe700 0 client.15738 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559c70341850 0x559c7034b120 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 --2- 172.21.15.92:0/3807561166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559c70340f30 0x559c7034abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 >> 172.21.15.92:0/3807561166 conn(0x559c70269750 msgr2=0x559c70345e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 shutdown_connections 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 1 -- 172.21.15.92:0/3807561166 wait complete. 2024-04-26T18:03:55.946 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.946+0000 7f832cb46b80 20 client.15738 trim_cache size 0 max 16384 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 32, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 10, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "511a903b": { 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 10, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:03:55.947 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 79.5, 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:03:55.948 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 msgr2=0x7f83040a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 0x7f83040a67a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f830c009bd0 tx=0x7f830c009260 comp rx=0 tx=0).stop 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 msgr2=0x7f831c1a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8314006070 tx=0x7f8314004c80 comp rx=0 tx=0).stop 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 shutdown_connections 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f83040a42e0 0x7f83040a67a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f831c1084c0 0x7f831c1a5a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f831c102700 0x7f831c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.949 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 --2- 172.21.15.92:0/3793012232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f831c1030c0 0x7f831c19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:03:55.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 >> 172.21.15.92:0/3793012232 conn(0x7f831c0792d0 msgr2=0x7f831c101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:03:55.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 shutdown_connections 2024-04-26T18:03:55.950 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:03:55.947+0000 7f83222b4700 1 -- 172.21.15.92:0/3793012232 wait complete. 2024-04-26T18:03:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:56 smithi156 ceph-mon[32679]: pgmap v132: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.1 MiB/s wr, 785 op/s 2024-04-26T18:03:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:56 smithi092 ceph-mon[29156]: pgmap v132: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.1 MiB/s wr, 785 op/s 2024-04-26T18:03:57.023 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '511a903b', quiesce took 8.7 seconds. Will release after: 19.5 2024-04-26T18:03:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:56 smithi189 ceph-mon[32756]: pgmap v132: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.1 MiB/s wr, 785 op/s 2024-04-26T18:03:58.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 225.0 s, 1648.2 tps, lat 29.657 ms stddev 37.457 2024-04-26T18:03:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:03:58 smithi156 ceph-mon[32679]: pgmap v133: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 640 op/s 2024-04-26T18:03:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:03:58 smithi092 ceph-mon[29156]: pgmap v133: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 640 op/s 2024-04-26T18:03:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:03:58 smithi189 ceph-mon[32756]: pgmap v133: 97 pgs: 97 active+clean; 2.1 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.7 MiB/s wr, 640 op/s 2024-04-26T18:04:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:00 smithi156 ceph-mon[32679]: pgmap v134: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-04-26T18:04:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:00 smithi092 ceph-mon[29156]: pgmap v134: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-04-26T18:04:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:00 smithi189 ceph-mon[32756]: pgmap v134: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 791 op/s 2024-04-26T18:04:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:02 smithi156 ceph-mon[32679]: pgmap v135: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 471 op/s 2024-04-26T18:04:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:02 smithi092 ceph-mon[29156]: pgmap v135: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 471 op/s 2024-04-26T18:04:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:02 smithi189 ceph-mon[32756]: pgmap v135: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 471 op/s 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 -- 172.21.15.92:0/1384034140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10103300 msgr2=0x7f9b1010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 --2- 172.21.15.92:0/1384034140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10103300 0x7f9b1010f810 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009930 tx=0x7f9b0802a420 comp rx=0 tx=0).stop 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 -- 172.21.15.92:0/1384034140 shutdown_connections 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 --2- 172.21.15.92:0/1384034140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10103300 0x7f9b1010f810 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 --2- 172.21.15.92:0/1384034140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10102940 0x7f9b10102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 --2- 172.21.15.92:0/1384034140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10108950 0x7f9b10108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 -- 172.21.15.92:0/1384034140 >> 172.21.15.92:0/1384034140 conn(0x7f9b10079dc0 msgr2=0x7f9b1007a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 -- 172.21.15.92:0/1384034140 shutdown_connections 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.267+0000 7f9b1566b640 1 -- 172.21.15.92:0/1384034140 wait complete. 2024-04-26T18:04:03.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 Processor -- start 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 -- start start 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10102940 0x7f9b10199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 0x7f9b101995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10112c10 con 0x7f9b10108950 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10112a90 con 0x7f9b10102940 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b1566b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b10112d90 con 0x7f9b10103300 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33994/0 (socket says 172.21.15.92:33994) 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2135432980 learned_addr learned my addr 172.21.15.92:0/2135432980 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 0x7f9b101995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0effd640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10102940 0x7f9b10199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2135432980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 msgr2=0x7f9b101995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.271 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 0x7f9b101995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2135432980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10102940 msgr2=0x7f9b10199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10102940 0x7f9b10199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2135432980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1019e010 con 0x7f9b10108950 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.268+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 0x7f9b101995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009900 tx=0x7f9b080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9af7fff640 1 -- 172.21.15.92:0/2135432980 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803f030 con 0x7f9b10108950 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1019e2a0 con 0x7f9b10108950 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9af7fff640 1 -- 172.21.15.92:0/2135432980 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b08003800 con 0x7f9b10108950 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9af7fff640 1 -- 172.21.15.92:0/2135432980 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08035070 con 0x7f9b10108950 2024-04-26T18:04:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.269+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b101a5b90 con 0x7f9b10108950 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.271+0000 7f9af7fff640 1 -- 172.21.15.92:0/2135432980 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9b08003cb0 con 0x7f9b10108950 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.271+0000 7f9b18389740 1 Processor -- start 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9af7fff640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 0x7f9af80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 -- start start 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439f310 0x55b13439f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 0x7f9af80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439fc30 0x55b1343a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9af7fff640 1 -- 172.21.15.92:0/2135432980 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9b080f10a0 con 0x7f9b10108950 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b134301460 con 0x55b1343aa4f0 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b1342bb590 con 0x55b13439fc30 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b18389740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b1342fd420 con 0x55b13439f310 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34002/0 (socket says 172.21.15.92:34002) 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2618461194 learned_addr learned my addr 172.21.15.92:0/2618461194 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439fc30 0x55b1343a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0effd640 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439f310 0x55b13439f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2618461194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439f310 msgr2=0x55b13439f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439f310 0x55b13439f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2618461194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439fc30 msgr2=0x55b1343a9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439fc30 0x55b1343a9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/2618461194 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1342c80d0 con 0x55b1343aa4f0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 0x7f9af80a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ff900 tx=0x7f9b04014660 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9b080bce50 tx=0x7f9b080bd850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcacb6096b1649f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.272+0000 7f9af57fa640 1 -- 172.21.15.92:0/2618461194 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b080d6070 con 0x55b1343aa4f0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9af57fa640 1 -- 172.21.15.92:0/2618461194 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b080c5dc0 con 0x55b1343aa4f0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9af57fa640 1 -- 172.21.15.92:0/2618461194 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08049040 con 0x55b1343aa4f0 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 -- 172.21.15.92:0/2618461194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 msgr2=0x55b1343ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9b080bce50 tx=0x7f9b080bd850 comp rx=0 tx=0).stop 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 -- 172.21.15.92:0/2618461194 shutdown_connections 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343ac8e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439fc30 0x55b1343a9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 --2- 172.21.15.92:0/2618461194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439f310 0x55b13439f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 -- 172.21.15.92:0/2618461194 >> 172.21.15.92:0/2618461194 conn(0x55b13439b820 msgr2=0x55b13439bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 -- 172.21.15.92:0/2618461194 shutdown_connections 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.273+0000 7f9b18389740 1 -- 172.21.15.92:0/2618461194 wait complete. 2024-04-26T18:04:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 -- start start 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 Processor -- start 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1343acee0 con 0x55b1343aa4f0 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b134288b60 con 0x55b13439f310 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b1343ad060 con 0x55b13439fc30 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b18389740 10 client.0 _ll_register_callbacks cb 0x55b1342ad2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34006/0 (socket says 172.21.15.92:34006) 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/3894422027 learned_addr learned my addr 172.21.15.92:0/3894422027 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0effd640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/3894422027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 msgr2=0x55b1343a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 msgr2=0x55b1343a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 -- 172.21.15.92:0/3894422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b134013210 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9b08004650 tx=0x7f9b080c1410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61969bf1c75754a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.274+0000 7f9af2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08049070 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9b080b97c0 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b080c5dc0 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9b080d6040 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 10 client.15750 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b1340df620 con 0x55b1343aa4f0 2024-04-26T18:04:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b080c5dc0 con 0x55b1343aa4f0 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f9b08031be0 con 0x55b1343aa4f0 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 10 client.15750 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 20 client.15750 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b1343ba240 0x55b1343bc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 4 client.15750 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b13430f070 con 0x55b1343ba240 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.275+0000 7f9b0effd640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b1343ba240 0x55b1343bc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.276+0000 7f9af2ff5640 10 client.15750 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.276+0000 7f9b0effd640 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b1343ba240 0x55b1343bc630 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ae0b2510033be1b server_cookie=41aea84adc9c0f01 in_seq=0 out_seq=0 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.276+0000 7f9af2ff5640 1 -- 172.21.15.92:0/3894422027 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b13430f070 con 0x55b1343ba240 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.276+0000 7f9af2ff5640 10 client.15750 handle_command_reply: tid=0 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 client.15750 shutdown 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 msgr2=0x55b1343a7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9b08004650 tx=0x7f9b080c1410 comp rx=0 tx=0).stop 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 shutdown_connections 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b1343ba240 0x55b1343bc630 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1343aa4f0 0x55b1343a7f50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9af2ff5640 0 client.15750 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 --2- 172.21.15.92:0/3894422027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 >> 172.21.15.92:0/3894422027 conn(0x55b13439b820 msgr2=0x55b1343965b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 shutdown_connections 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 1 -- 172.21.15.92:0/3894422027 wait complete. 2024-04-26T18:04:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.277+0000 7f9b18389740 20 client.15750 trim_cache size 0 max 16384 2024-04-26T18:04:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 Processor -- start 2024-04-26T18:04:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 -- start start 2024-04-26T18:04:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.297 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1343aa4f0 0x55b1343c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101aeaa0 con 0x55b13439fc30 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101ac310 con 0x55b13439f310 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b18389740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101aa1a0 con 0x55b1343aa4f0 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34010/0 (socket says 172.21.15.92:34010) 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 -- 172.21.15.92:0/398427230 learned_addr learned my addr 172.21.15.92:0/398427230 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0effd640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1343aa4f0 0x55b1343c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.298 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 -- 172.21.15.92:0/398427230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1343aa4f0 msgr2=0x55b1343c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1343aa4f0 0x55b1343c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 -- 172.21.15.92:0/398427230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 msgr2=0x55b1343a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 -- 172.21.15.92:0/398427230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1343ac8e0 con 0x55b13439fc30 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0effd640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.292+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55b1343a08b0 tx=0x7f9b0401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3c7f9dd2cb7066 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9af4ff9640 1 -- 172.21.15.92:0/398427230 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0401f040 con 0x55b13439fc30 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9af4ff9640 1 -- 172.21.15.92:0/398427230 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b04017df0 con 0x55b13439fc30 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9af4ff9640 1 -- 172.21.15.92:0/398427230 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04006540 con 0x55b13439fc30 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- 172.21.15.92:0/398427230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 msgr2=0x55b134396430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x55b1343a08b0 tx=0x7f9b0401a000 comp rx=0 tx=0).stop 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- 172.21.15.92:0/398427230 shutdown_connections 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b1343aa4f0 0x55b1343c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439fc30 0x55b134396430 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 --2- 172.21.15.92:0/398427230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b13439f310 0x55b1343a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- 172.21.15.92:0/398427230 >> 172.21.15.92:0/398427230 conn(0x55b13439b820 msgr2=0x55b134395d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- 172.21.15.92:0/398427230 shutdown_connections 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- 172.21.15.92:0/398427230 wait complete. 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.293+0000 7f9b18389740 1 -- start start 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 Processor -- start 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 0x55b1343a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101aa7f0 con 0x55b13439f310 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101abc40 con 0x55b1343aa4f0 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b101aaea0 con 0x55b13439fc30 2024-04-26T18:04:03.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 10 client.0 _ll_register_callbacks cb 0x7f9b080d4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:34016/0 (socket says 172.21.15.92:34016) 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 -- 172.21.15.92:0/1540600469 learned_addr learned my addr 172.21.15.92:0/1540600469 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 0x55b1343a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 -- 172.21.15.92:0/1540600469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 msgr2=0x55b1343a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 -- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 msgr2=0x55b1343a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 0x55b1343a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 -- 172.21.15.92:0/1540600469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13441f880 con 0x55b13439f310 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0f7fe640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 0x55b1343a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:03.301 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b0effd640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55b1343bcd00 tx=0x7f9b0001a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a35723acce84720 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9af2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0001a940 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9b0001adc0 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.294+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b04017df0 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9b00003970 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 10 client.15756 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b134420bf0 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b04017df0 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f9b0002a020 con 0x55b13439f310 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 10 client.15756 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 20 client.15756 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b134421370 0x55b134423790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.302 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 4 client.15756 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:04:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b134308ee0 con 0x55b134421370 2024-04-26T18:04:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.295+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b134421370 0x55b134423790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.296+0000 7f9af2ff5640 10 client.15756 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:03.303 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.296+0000 7f9b0e7fc640 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b134421370 0x55b134423790 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=949fba67b2917e0f server_cookie=f670cd7175c0463b in_seq=0 out_seq=0 2024-04-26T18:04:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9af2ff5640 1 -- 172.21.15.92:0/1540600469 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b134308ee0 con 0x55b134421370 2024-04-26T18:04:03.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9af2ff5640 10 client.15756 handle_command_reply: tid=0 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 client.15756 shutdown 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 msgr2=0x55b1343a43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55b1343bcd00 tx=0x7f9b0001a600 comp rx=0 tx=0).stop 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 shutdown_connections 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b134421370 0x55b134423790 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1343aa4f0 0x55b1343a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b13439fc30 0x55b1343a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 --2- 172.21.15.92:0/1540600469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b13439f310 0x55b1343a43e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9af2ff5640 0 client.15756 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.308+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 >> 172.21.15.92:0/1540600469 conn(0x55b13439b820 msgr2=0x55b1343a7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 shutdown_connections 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b18389740 1 -- 172.21.15.92:0/1540600469 wait complete. 2024-04-26T18:04:03.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b18389740 20 client.15756 trim_cache size 0 max 16384 2024-04-26T18:04:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:04:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:04:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:04:03.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:04:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 msgr2=0x7f9af80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 0x7f9af80a6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b100ff900 tx=0x7f9b04014660 comp rx=0 tx=0).stop 2024-04-26T18:04:03.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 msgr2=0x7f9b1019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009900 tx=0x7f9b080042f0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 shutdown_connections 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9af80a3dc0 0x7f9af80a6280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b10108950 0x7f9b1019d8e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b10103300 0x7f9b101995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 --2- 172.21.15.92:0/2135432980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b10102940 0x7f9b10199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 >> 172.21.15.92:0/2135432980 conn(0x7f9b10079dc0 msgr2=0x7f9b10100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 shutdown_connections 2024-04-26T18:04:03.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:03.309+0000 7f9b1566b640 1 -- 172.21.15.92:0/2135432980 wait complete. 2024-04-26T18:04:03.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 230.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:04 smithi156 ceph-mon[32679]: pgmap v136: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 503 op/s 2024-04-26T18:04:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:04 smithi092 ceph-mon[29156]: pgmap v136: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 503 op/s 2024-04-26T18:04:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:04 smithi189 ceph-mon[32756]: pgmap v136: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.8 MiB/s wr, 503 op/s 2024-04-26T18:04:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:06 smithi092 ceph-mon[29156]: pgmap v137: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 325 op/s 2024-04-26T18:04:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:06 smithi189 ceph-mon[32756]: pgmap v137: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 325 op/s 2024-04-26T18:04:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:06 smithi156 ceph-mon[32679]: pgmap v137: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 325 op/s 2024-04-26T18:04:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:08 smithi092 ceph-mon[29156]: pgmap v138: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 217 op/s 2024-04-26T18:04:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:08 smithi189 ceph-mon[32756]: pgmap v138: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 217 op/s 2024-04-26T18:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:08 smithi156 ceph-mon[32679]: pgmap v138: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 217 op/s 2024-04-26T18:04:10.984 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:10 smithi156 ceph-mon[32679]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 222 op/s 2024-04-26T18:04:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:10 smithi092 ceph-mon[29156]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 222 op/s 2024-04-26T18:04:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:10 smithi189 ceph-mon[32756]: pgmap v139: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 222 op/s 2024-04-26T18:04:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:12 smithi092 ceph-mon[29156]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 71 op/s 2024-04-26T18:04:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:12 smithi189 ceph-mon[32756]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 71 op/s 2024-04-26T18:04:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:12 smithi156 ceph-mon[32679]: pgmap v140: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.0 MiB/s wr, 71 op/s 2024-04-26T18:04:13.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:14 smithi092 ceph-mon[29156]: pgmap v141: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 73 op/s 2024-04-26T18:04:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:14 smithi189 ceph-mon[32756]: pgmap v141: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 73 op/s 2024-04-26T18:04:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:14 smithi156 ceph-mon[32679]: pgmap v141: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.0 MiB/s wr, 73 op/s 2024-04-26T18:04:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 -- 172.21.15.92:0/997355655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c101830 msgr2=0x7f9e0c101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 --2- 172.21.15.92:0/997355655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c101830 0x7f9e0c101cb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009930 tx=0x7f9e0002a420 comp rx=0 tx=0).stop 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 -- 172.21.15.92:0/997355655 shutdown_connections 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 --2- 172.21.15.92:0/997355655 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c10e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 --2- 172.21.15.92:0/997355655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c101830 0x7f9e0c101cb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 --2- 172.21.15.92:0/997355655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 0x7f9e0c107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 -- 172.21.15.92:0/997355655 >> 172.21.15.92:0/997355655 conn(0x7f9e0c078950 msgr2=0x7f9e0c078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 -- 172.21.15.92:0/997355655 shutdown_connections 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 -- 172.21.15.92:0/997355655 wait complete. 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.404+0000 7f9e117c6640 1 Processor -- start 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 -- start start 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c101830 0x7f9e0c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 0x7f9e0c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c111b00 con 0x7f9e0c1021f0 2024-04-26T18:04:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c111980 con 0x7f9e0c107840 2024-04-26T18:04:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e117c6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c111c80 con 0x7f9e0c101830 2024-04-26T18:04:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43398/0 (socket says 172.21.15.92:43398) 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2612294063 learned_addr learned my addr 172.21.15.92:0/2612294063 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0affd640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c101830 0x7f9e0c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 0x7f9e0c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2612294063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c101830 msgr2=0x7f9e0c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c101830 0x7f9e0c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2612294063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 msgr2=0x7f9e0c19d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 0x7f9e0c19d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2612294063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c19e0b0 con 0x7f9e0c1021f0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.405+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9e00005940 tx=0x7f9e000040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.406+0000 7f9df3fff640 1 -- 172.21.15.92:0/2612294063 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0003f030 con 0x7f9e0c1021f0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.406+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c19e340 con 0x7f9e0c1021f0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.406+0000 7f9df3fff640 1 -- 172.21.15.92:0/2612294063 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e000044c0 con 0x7f9e0c1021f0 2024-04-26T18:04:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.406+0000 7f9df3fff640 1 -- 172.21.15.92:0/2612294063 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00035070 con 0x7f9e0c1021f0 2024-04-26T18:04:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.406+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c1a5c30 con 0x7f9e0c1021f0 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9df3fff640 1 -- 172.21.15.92:0/2612294063 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9e00042030 con 0x7f9e0c1021f0 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 Processor -- start 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 -- start start 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba474fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba47463460 con 0x55ba474fd820 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ba4741d590 con 0x55ba475080e0 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e145bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba4745f420 con 0x55ba474fcf00 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e0affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.408+0000 7f9e0affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43414/0 (socket says 172.21.15.92:43414) 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 -- 172.21.15.92:0/1381367175 learned_addr learned my addr 172.21.15.92:0/1381367175 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba474fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 -- 172.21.15.92:0/1381367175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 msgr2=0x55ba474fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba474fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 -- 172.21.15.92:0/1381367175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 msgr2=0x55ba4750a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 -- 172.21.15.92:0/1381367175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba4742a0d0 con 0x55ba474fd820 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9df3fff640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 0x7f9df40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 0x7f9df40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009fd0 tx=0x7f9dfc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f0780aa6f2c6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9df3fff640 1 -- 172.21.15.92:0/2612294063 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9e000f0b70 con 0x7f9e0c1021f0 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9df17fa640 1 -- 172.21.15.92:0/1381367175 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc01e070 con 0x55ba474fd820 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9df17fa640 1 -- 172.21.15.92:0/1381367175 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dfc003c30 con 0x55ba474fd820 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.409+0000 7f9df17fa640 1 -- 172.21.15.92:0/1381367175 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc00f8d0 con 0x55ba474fd820 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- 172.21.15.92:0/1381367175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 msgr2=0x55ba47507ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 0x7f9df40a6280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009cf0 tx=0x7f9e04005f90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009fd0 tx=0x7f9dfc0118d0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- 172.21.15.92:0/1381367175 shutdown_connections 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47507ba0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1381367175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba474fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- 172.21.15.92:0/1381367175 >> 172.21.15.92:0/1381367175 conn(0x55ba474f9410 msgr2=0x55ba474f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- 172.21.15.92:0/1381367175 shutdown_connections 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- 172.21.15.92:0/1381367175 wait complete. 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 -- start start 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.410+0000 7f9e145bf740 1 Processor -- start 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47505050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba47505ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba4750ad10 con 0x55ba474fd820 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ba473eab60 con 0x55ba475080e0 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ba4750ae90 con 0x55ba474fcf00 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 10 client.0 _ll_register_callbacks cb 0x55ba4740f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43424/0 (socket says 172.21.15.92:43424) 2024-04-26T18:04:16.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/1625738193 learned_addr learned my addr 172.21.15.92:0/1625738193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba47505ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47505050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/1625738193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 msgr2=0x55ba47505050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47505050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 msgr2=0x55ba47505ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba47505ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/1625738193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba47175210 con 0x55ba474fd820 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9e000bc880 tx=0x7f9e00009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0b55375de2c868 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9deeff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00049050 con 0x55ba474fd820 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9e00003cc0 con 0x55ba474fd820 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.411+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dfc003c30 con 0x55ba474fd820 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e000bd280 con 0x55ba474fd820 2024-04-26T18:04:16.420 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 10 client.15768 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ba47241620 con 0x55ba474fd820 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dfc003c30 con 0x55ba474fd820 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f9e000ee5b0 con 0x55ba474fd820 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 10 client.15768 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 20 client.15768 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba475181a0 0x55ba4751a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 4 client.15768 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba47471070 con 0x55ba475181a0 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.412+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba475181a0 0x55ba4751a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.413+0000 7f9deeff5640 10 client.15768 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.413+0000 7f9e0affd640 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba475181a0 0x55ba4751a600 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947030125109c0a7 server_cookie=a9f15a03a0d68b05 in_seq=0 out_seq=0 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.413+0000 7f9deeff5640 1 -- 172.21.15.92:0/1625738193 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ba47471070 con 0x55ba475181a0 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.413+0000 7f9deeff5640 10 client.15768 handle_command_reply: tid=0 2024-04-26T18:04:16.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.413+0000 7f9e145bf740 1 client.15768 shutdown 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 msgr2=0x55ba47505590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9e000bc880 tx=0x7f9e00009680 comp rx=0 tx=0).stop 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 shutdown_connections 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba475181a0 0x55ba4751a600 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba47505ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba47505590 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 --2- 172.21.15.92:0/1625738193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47505050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9deeff5640 0 client.15768 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 >> 172.21.15.92:0/1625738193 conn(0x55ba474f9410 msgr2=0x55ba474f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 shutdown_connections 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 1 -- 172.21.15.92:0/1625738193 wait complete. 2024-04-26T18:04:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.414+0000 7f9e145bf740 20 client.15768 trim_cache size 0 max 16384 2024-04-26T18:04:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 Processor -- start 2024-04-26T18:04:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 -- start start 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47513bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4751ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1b0c90 con 0x55ba474fd820 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1ae500 con 0x55ba475080e0 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.428+0000 7f9e145bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1ac370 con 0x55ba474fcf00 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43426/0 (socket says 172.21.15.92:43426) 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/3420735691 learned_addr learned my addr 172.21.15.92:0/3420735691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0affd640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47513bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/3420735691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 msgr2=0x55ba47513bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47513bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4751ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/3420735691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 msgr2=0x55ba4751ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4751ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/3420735691 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba475035e0 con 0x55ba474fd820 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0affd640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47513bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4751ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e000bae30 tx=0x7f9e00005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99dd4eaeb93eb4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9df0ff9640 1 -- 172.21.15.92:0/3420735691 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00049070 con 0x55ba474fd820 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9df0ff9640 1 -- 172.21.15.92:0/3420735691 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e000bcb80 con 0x55ba474fd820 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.429+0000 7f9df0ff9640 1 -- 172.21.15.92:0/3420735691 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e000c5430 con 0x55ba474fd820 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- 172.21.15.92:0/3420735691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 msgr2=0x55ba474f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9e000bae30 tx=0x7f9e00005c90 comp rx=0 tx=0).stop 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- 172.21.15.92:0/3420735691 shutdown_connections 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4751ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba474f8430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- 172.21.15.92:0/3420735691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba47513bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- 172.21.15.92:0/3420735691 >> 172.21.15.92:0/3420735691 conn(0x55ba474f9410 msgr2=0x55ba474f7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- 172.21.15.92:0/3420735691 shutdown_connections 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- 172.21.15.92:0/3420735691 wait complete. 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- start start 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 Processor -- start 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba475102d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1ac9c0 con 0x55ba474fd820 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1ade30 con 0x55ba475080e0 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.430+0000 7f9e145bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c1ad090 con 0x55ba474fcf00 2024-04-26T18:04:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e145bf740 10 client.0 _ll_register_callbacks cb 0x7f9e00009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43428/0 (socket says 172.21.15.92:43428) 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2189937622 learned_addr learned my addr 172.21.15.92:0/2189937622 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0affd640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba475102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2189937622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 msgr2=0x55ba475102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba475102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 msgr2=0x55ba4750d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 -- 172.21.15.92:0/2189937622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba4750db60 con 0x55ba474fd820 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0b7fe640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0affd640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba475102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9deeff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e0a7fc640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b8fe0 tx=0x7f9e0002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c9230301116337 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00049050 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f9e000bc1d0 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e000bcb80 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9e000bc6c0 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e145bf740 10 client.15774 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ba4750db60 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.431+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e000bcb80 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f9e000bba40 con 0x55ba474fd820 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 10 client.15774 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 20 client.15774 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba4757f7c0 0x55ba47581be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 4 client.15774 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:04:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba4746aee0 con 0x55ba4757f7c0 2024-04-26T18:04:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e0affd640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba4757f7c0 0x55ba47581be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9deeff5640 10 client.15774 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.432+0000 7f9e0affd640 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba4757f7c0 0x55ba47581be0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=434aaf8c2b6cae17 server_cookie=a7e4ce269da40409 in_seq=0 out_seq=0 2024-04-26T18:04:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9deeff5640 1 -- 172.21.15.92:0/2189937622 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba4746aee0 con 0x55ba4757f7c0 2024-04-26T18:04:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9deeff5640 10 client.15774 handle_command_reply: tid=0 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 client.15774 shutdown 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 msgr2=0x55ba4750d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b8fe0 tx=0x7f9e0002a420 comp rx=0 tx=0).stop 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 shutdown_connections 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ba4757f7c0 0x55ba47581be0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ba475080e0 0x55ba4750d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba474fd820 0x55ba4750d0b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9deeff5640 0 client.15774 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 --2- 172.21.15.92:0/2189937622 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ba474fcf00 0x55ba475102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 >> 172.21.15.92:0/2189937622 conn(0x55ba474f9410 msgr2=0x55ba475058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 shutdown_connections 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 1 -- 172.21.15.92:0/2189937622 wait complete. 2024-04-26T18:04:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.443+0000 7f9e145bf740 20 client.15774 trim_cache size 0 max 16384 2024-04-26T18:04:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:04:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:04:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:04:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 msgr2=0x7f9df40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 0x7f9df40a6280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009cf0 tx=0x7f9e04005f90 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 msgr2=0x7f9e0c199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9e00005940 tx=0x7f9e000040c0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 shutdown_connections 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9df40a3dc0 0x7f9df40a6280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e0c107840 0x7f9e0c19d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e0c1021f0 0x7f9e0c199600 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 --2- 172.21.15.92:0/2612294063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9e0c101830 0x7f9e0c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:16.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 >> 172.21.15.92:0/2612294063 conn(0x7f9e0c078950 msgr2=0x7f9e0c06af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 shutdown_connections 2024-04-26T18:04:16.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:16.444+0000 7f9e117c6640 1 -- 172.21.15.92:0/2612294063 wait complete. 2024-04-26T18:04:16.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:04:16.767 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:16.889 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:16 smithi092 ceph-mon[29156]: pgmap v142: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2024-04-26T18:04:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:16 smithi189 ceph-mon[32756]: pgmap v142: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2024-04-26T18:04:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:16 smithi156 ceph-mon[32679]: pgmap v142: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.3 MiB/s wr, 43 op/s 2024-04-26T18:04:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 245.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- 172.21.15.92:0/2108825005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c103fe0 msgr2=0x7f1c0c104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 --2- 172.21.15.92:0/2108825005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c104460 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0099c0 tx=0x7f1bfc009cd0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- 172.21.15.92:0/2108825005 shutdown_connections 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 --2- 172.21.15.92:0/2108825005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c1049a0 0x7f1c0c10f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 --2- 172.21.15.92:0/2108825005 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c102700 0x7f1c0c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 --2- 172.21.15.92:0/2108825005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c104460 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.664 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- 172.21.15.92:0/2108825005 >> 172.21.15.92:0/2108825005 conn(0x7f1c0c0783c0 msgr2=0x7f1c0c0787d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- 172.21.15.92:0/2108825005 shutdown_connections 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- 172.21.15.92:0/2108825005 wait complete. 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 Processor -- start 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.648+0000 7f1c12f70700 1 -- start start 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c1049a0 0x7f1c0c199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c112680 con 0x7f1c0c102700 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c112500 con 0x7f1c0c103fe0 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c112800 con 0x7f1c0c1049a0 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43436/0 (socket says 172.21.15.92:43436) 2024-04-26T18:04:18.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 -- 172.21.15.92:0/3961585307 learned_addr learned my addr 172.21.15.92:0/3961585307 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c1150d700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c1049a0 0x7f1c0c199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c03fff700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 -- 172.21.15.92:0/3961585307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c1049a0 msgr2=0x7f1c0c199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c1049a0 0x7f1c0c199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 -- 172.21.15.92:0/3961585307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 msgr2=0x7f1c0c19fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c19fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 -- 172.21.15.92:0/3961585307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c19a160 con 0x7f1c0c102700 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c03fff700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c10d0c700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800d980 tx=0x7f1c0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08017070 con 0x7f1c0c102700 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c08005020 con 0x7f1c0c102700 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c19a450 con 0x7f1c0c102700 2024-04-26T18:04:18.666 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.649+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08009b50 con 0x7f1c0c102700 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.650+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c1a6710 con 0x7f1c0c102700 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.651+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0c06a110 con 0x7f1c0c102700 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.651+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1c080051d0 con 0x7f1c0c102700 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.652+0000 7f1c01ffb700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 0x7f1bf40a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.652+0000 7f1c03fff700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 0x7f1bf40a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.652+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f1c080d0670 con 0x7f1c0c102700 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.653+0000 7f1c03fff700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 0x7f1bf40a62f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c078b00 tx=0x7f1bfc005fd0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:18.667 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.657+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f1c08020020 con 0x7f1c0c102700 2024-04-26T18:04:18.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.911+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c0c02e490 con 0x7f1c0c102700 2024-04-26T18:04:18.911 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:18 smithi092 ceph-mon[29156]: pgmap v143: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-04-26T18:04:18.912 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.911+0000 7f1c01ffb700 1 -- 172.21.15.92:0/3961585307 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7f1c0809cd80 con 0x7f1c0c102700 2024-04-26T18:04:18.912 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:04:18.912 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:03:13.093720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:04:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 msgr2=0x7f1bf40a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 0x7f1bf40a62f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c078b00 tx=0x7f1bfc005fd0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 msgr2=0x7f1c0c19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800d980 tx=0x7f1c0800dc90 comp rx=0 tx=0).stop 2024-04-26T18:04:18.914 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 shutdown_connections 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1bf40a3e30 0x7f1bf40a62f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c0c1049a0 0x7f1c0c199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c0c102700 0x7f1c0c19f840 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 --2- 172.21.15.92:0/3961585307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c0c103fe0 0x7f1c0c19fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 >> 172.21.15.92:0/3961585307 conn(0x7f1c0c0783c0 msgr2=0x7f1c0c06be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 shutdown_connections 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:18.914+0000 7f1c12f70700 1 -- 172.21.15.92:0/3961585307 wait complete. 2024-04-26T18:04:18.915 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 32 2024-04-26T18:04:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:18 smithi189 ceph-mon[32756]: pgmap v143: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-04-26T18:04:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:18 smithi156 ceph-mon[32679]: pgmap v143: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-04-26T18:04:19.725 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db --set-id 511a903b --release --await' 2024-04-26T18:04:19.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db --set-id 511a903b --release --await 2024-04-26T18:04:19.967 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:19 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3961585307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:19 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3961585307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:19 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3961585307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:20 smithi092 ceph-mon[29156]: pgmap v144: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 75 KiB/s wr, 14 op/s 2024-04-26T18:04:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:20 smithi189 ceph-mon[32756]: pgmap v144: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 75 KiB/s wr, 14 op/s 2024-04-26T18:04:21.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:20 smithi156 ceph-mon[32679]: pgmap v144: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 75 KiB/s wr, 14 op/s 2024-04-26T18:04:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3005587883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 msgr2=0x7f0db4102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3005587883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4102790 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009990 tx=0x7f0da8009ca0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3005587883 shutdown_connections 2024-04-26T18:04:21.777 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3005587883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4102cd0 0x7f0db410f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3005587883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4108380 0x7f0db4108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3005587883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4102790 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3005587883 >> 172.21.15.92:0/3005587883 conn(0x7f0db4079290 msgr2=0x7f0db40796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3005587883 shutdown_connections 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.766+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3005587883 wait complete. 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 Processor -- start 2024-04-26T18:04:21.778 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 -- start start 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4102cd0 0x7f0db419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4108380 0x7f0db419e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4112520 con 0x7f0db4102310 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41123a0 con 0x7f0db4108380 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0dba0a3700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41126a0 con 0x7f0db4102cd0 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43452/0 (socket says 172.21.15.92:43452) 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.767+0000 7f0db37fe700 1 -- 172.21.15.92:0/3548585659 learned_addr learned my addr 172.21.15.92:0/3548585659 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db3fff700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4108380 0x7f0db419e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4102cd0 0x7f0db419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.779 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 -- 172.21.15.92:0/3548585659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4102cd0 msgr2=0x7f0db419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4102cd0 0x7f0db419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 -- 172.21.15.92:0/3548585659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4108380 msgr2=0x7f0db419e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4108380 0x7f0db419e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 -- 172.21.15.92:0/3548585659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db419eb80 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db37fe700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b530 tx=0x7f0da400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db0ff9700 1 -- 172.21.15.92:0/3548585659 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4015020 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db419ee70 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db0ff9700 1 -- 172.21.15.92:0/3548585659 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da4011ce0 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0db0ff9700 1 -- 172.21.15.92:0/3548585659 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4010e40 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.768+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db41a6730 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.770+0000 7f0db0ff9700 1 -- 172.21.15.92:0/3548585659 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0da4018020 con 0x7f0db4102310 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.771+0000 7f0db0ff9700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 0x7f0d9c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.771+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 0x7f0d9c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.780 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.771+0000 7f0db0ff9700 1 -- 172.21.15.92:0/3548585659 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0da40cfef0 con 0x7f0db4102310 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.772+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 0x7f0d9c0a6270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006010 tx=0x7f0da801a040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.772+0000 7f0dc4935b80 1 Processor -- start 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.772+0000 7f0dc4935b80 1 -- start start 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 0x56216b559280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b553870 0x56216b553cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56216b4a5930 con 0x56216b5597c0 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56216b40ba30 con 0x56216b553870 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56216b4a18f0 con 0x56216b558ea0 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.781 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43464/0 (socket says 172.21.15.92:43464) 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 -- 172.21.15.92:0/961524000 learned_addr learned my addr 172.21.15.92:0/961524000 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db3fff700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b553870 0x56216b553cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db37fe700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 0x56216b559280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 -- 172.21.15.92:0/961524000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 msgr2=0x56216b559280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 0x56216b559280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 -- 172.21.15.92:0/961524000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b553870 msgr2=0x56216b553cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b553870 0x56216b553cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 -- 172.21.15.92:0/961524000 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216b3f29d0 con 0x56216b5597c0 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db37fe700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 0x56216b559280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015000 tx=0x7f0da801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a505df7bb6c5b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0d99ffb700 1 -- 172.21.15.92:0/961524000 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da800f810 con 0x56216b5597c0 2024-04-26T18:04:21.782 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0d99ffb700 1 -- 172.21.15.92:0/961524000 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da8032070 con 0x56216b5597c0 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.773+0000 7f0d99ffb700 1 -- 172.21.15.92:0/961524000 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8023e30 con 0x56216b5597c0 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 -- 172.21.15.92:0/961524000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 msgr2=0x56216b553250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015000 tx=0x7f0da801e000 comp rx=0 tx=0).stop 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 -- 172.21.15.92:0/961524000 shutdown_connections 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b553870 0x56216b553cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b558ea0 0x56216b559280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/961524000 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b5597c0 0x56216b553250 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 -- 172.21.15.92:0/961524000 >> 172.21.15.92:0/961524000 conn(0x56216b4816c0 msgr2=0x56216b54e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 -- 172.21.15.92:0/961524000 shutdown_connections 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.774+0000 7f0dc4935b80 1 -- 172.21.15.92:0/961524000 wait complete. 2024-04-26T18:04:21.783 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 -- start start 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 Processor -- start 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b553870 0x56216b55f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 0x56216b55cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56216b5601d0 con 0x56216b558ea0 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56216b45fb80 con 0x56216b5597c0 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56216b560350 con 0x56216b553870 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0dc4935b80 10 client.0 _ll_register_callbacks cb 0x56216b43da50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0db2ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43480/0 (socket says 172.21.15.92:43480) 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0db2ffd700 1 -- 172.21.15.92:0/2710562263 learned_addr learned my addr 172.21.15.92:0/2710562263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:21.784 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0db3fff700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 0x56216b55cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.775+0000 7f0db37fe700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b553870 0x56216b55f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 -- 172.21.15.92:0/2710562263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b553870 msgr2=0x56216b55f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b553870 0x56216b55f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 -- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 msgr2=0x56216b55cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 0x56216b55cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 -- 172.21.15.92:0/2710562263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216b463580 con 0x56216b558ea0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db3fff700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 0x56216b55cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0da80096f0 tx=0x7f0da8024a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d2b1a79fd27624 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0d92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da800f810 con 0x56216b558ea0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da8032070 con 0x56216b558ea0 2024-04-26T18:04:21.785 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0da800f9b0 con 0x56216b558ea0 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0da8048050 con 0x56216b558ea0 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0dc4935b80 10 client.15792 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56216b56a9f0 con 0x56216b558ea0 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.776+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da8032070 con 0x56216b558ea0 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f0da8036c10 con 0x56216b558ea0 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 10 client.15792 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 10 client.15792 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 20 client.15792 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b56f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 4 client.15792 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:21.786 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56216b4b3310 con 0x56216b56cec0 2024-04-26T18:04:21.787 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0db37fe700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b56f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0d92ffd700 10 client.15792 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.777+0000 7f0db37fe700 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b56f2b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25143c3712aa363b server_cookie=a1240ace05f53c07 in_seq=0 out_seq=0 2024-04-26T18:04:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0d92ffd700 1 -- 172.21.15.92:0/2710562263 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56216b4b3310 con 0x56216b56cec0 2024-04-26T18:04:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0d92ffd700 10 client.15792 handle_command_reply: tid=0 2024-04-26T18:04:21.788 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 client.15792 shutdown 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 msgr2=0x56216b55c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0da80096f0 tx=0x7f0da8024a80 comp rx=0 tx=0).stop 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 shutdown_connections 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b56f2b0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0d92ffd700 0 client.15792 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:21.789 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b5597c0 0x56216b55cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b553870 0x56216b55f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.778+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/2710562263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b558ea0 0x56216b55c850 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.779+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 >> 172.21.15.92:0/2710562263 conn(0x56216b4816c0 msgr2=0x56216b552240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.779+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 shutdown_connections 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.779+0000 7f0dc4935b80 1 -- 172.21.15.92:0/2710562263 wait complete. 2024-04-26T18:04:21.790 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.779+0000 7f0dc4935b80 20 client.15792 trim_cache size 0 max 16384 2024-04-26T18:04:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.797+0000 7f0dc4935b80 1 Processor -- start 2024-04-26T18:04:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.797+0000 7f0dc4935b80 1 -- start start 2024-04-26T18:04:21.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b547d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b5722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41b04c0 con 0x56216b553870 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41adcf0 con 0x56216b558ea0 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41abb60 con 0x56216b5597c0 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43484/0 (socket says 172.21.15.92:43484) 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 -- 172.21.15.92:0/1042257316 learned_addr learned my addr 172.21.15.92:0/1042257316 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b547d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db3fff700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b5722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 -- 172.21.15.92:0/1042257316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 msgr2=0x56216b5722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b5722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.803 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 -- 172.21.15.92:0/1042257316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 msgr2=0x56216b547d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b547d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 -- 172.21.15.92:0/1042257316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216b5695f0 con 0x56216b553870 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b547d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db3fff700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b5722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0da40989e0 tx=0x7f0da401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485253ef08c4780 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0d997fa700 1 -- 172.21.15.92:0/1042257316 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40b9070 con 0x56216b553870 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.798+0000 7f0d997fa700 1 -- 172.21.15.92:0/1042257316 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da409a310 con 0x56216b553870 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0d997fa700 1 -- 172.21.15.92:0/1042257316 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a4a50 con 0x56216b553870 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1042257316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 msgr2=0x56216b553250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0da40989e0 tx=0x7f0da401c040 comp rx=0 tx=0).stop 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1042257316 shutdown_connections 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b5722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b553250 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1042257316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b547d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1042257316 >> 172.21.15.92:0/1042257316 conn(0x56216b4816c0 msgr2=0x56216b547670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1042257316 shutdown_connections 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1042257316 wait complete. 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.799+0000 7f0dc4935b80 1 -- start start 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 Processor -- start 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b56d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b56d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ac1b0 con 0x56216b553870 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ad620 con 0x56216b558ea0 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ac880 con 0x56216b5597c0 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0dc4935b80 10 client.0 _ll_register_callbacks cb 0x56216b43da50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:21.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43488/0 (socket says 172.21.15.92:43488) 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 -- 172.21.15.92:0/1143918654 learned_addr learned my addr 172.21.15.92:0/1143918654 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db3fff700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b56d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b56d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 -- 172.21.15.92:0/1143918654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 msgr2=0x56216b56d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b56d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 -- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 msgr2=0x56216b56d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:21.806 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b56d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 -- 172.21.15.92:0/1143918654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216b56e0b0 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b56d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0db37fe700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0da40cdc30 tx=0x7f0da4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94493c11d6eaf6da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.800+0000 7f0d92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da407e070 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f0da409c480 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da409a310 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0da40b9050 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 10 client.15798 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56216b5d8530 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da409a310 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f0da4081030 con 0x56216b553870 2024-04-26T18:04:21.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 10 client.15798 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 10 client.15798 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 20 client.15798 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b5dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 4 client.15798 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "511a903b", "release": true, "await": true}] 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "set_id": "511a903b", "release": true, "await": true}) -- 0x56216b4ad3b0 con 0x56216b56cec0 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.801+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b5dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.802+0000 7f0db2ffd700 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b5dac10 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616980bc25611682 server_cookie=84b2873d36d1a24a in_seq=0 out_seq=0 2024-04-26T18:04:21.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.802+0000 7f0d92ffd700 10 client.15798 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:21.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.844+0000 7f0d92ffd700 1 -- 172.21.15.92:0/1143918654 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56216b4ad3b0 con 0x56216b56cec0 2024-04-26T18:04:21.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.844+0000 7f0d92ffd700 10 client.15798 handle_command_reply: tid=0 2024-04-26T18:04:21.846 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.844+0000 7f0dc4935b80 1 client.15798 shutdown 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 msgr2=0x56216b572770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0da40cdc30 tx=0x7f0da4010740 comp rx=0 tx=0).stop 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 shutdown_connections 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56216b56cec0 0x56216b5dac10 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56216b5597c0 0x56216b56d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56216b553870 0x56216b572770 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 --2- 172.21.15.92:0/1143918654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56216b558ea0 0x56216b56d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 >> 172.21.15.92:0/1143918654 conn(0x56216b4816c0 msgr2=0x56216b568e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.847 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0d92ffd700 0 client.15798 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 shutdown_connections 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 1 -- 172.21.15.92:0/1143918654 wait complete. 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.845+0000 7f0dc4935b80 20 client.15798 trim_cache size 0 max 16384 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 32, 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 12, 2024-04-26T18:04:21.848 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "511a903b": { 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 12, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 79.5, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:04:21.849 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:21.850 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:04:21.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 msgr2=0x7f0d9c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 0x7f0d9c0a6270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0da8006010 tx=0x7f0da801a040 comp rx=0 tx=0).stop 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 msgr2=0x7f0db4199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0da400b530 tx=0x7f0da400b840 comp rx=0 tx=0).stop 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 shutdown_connections 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0d9c0a3db0 0x7f0d9c0a6270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0db4108380 0x7f0db419e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0db4102310 0x7f0db4199b80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.852 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 --2- 172.21.15.92:0/3548585659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0db4102cd0 0x7f0db419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 >> 172.21.15.92:0/3548585659 conn(0x7f0db4079290 msgr2=0x7f0db41015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 shutdown_connections 2024-04-26T18:04:21.853 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:21.846+0000 7f0dba0a3700 1 -- 172.21.15.92:0/3548585659 wait complete. 2024-04-26T18:04:22.707 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '511a903b', seconds elapsed: 34.4 2024-04-26T18:04:22.707 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:04:22.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:04:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:22 smithi092 ceph-mon[29156]: pgmap v145: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-04-26T18:04:22.994 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:22 smithi189 ceph-mon[32756]: pgmap v145: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-04-26T18:04:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:22 smithi156 ceph-mon[32679]: pgmap v145: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-04-26T18:04:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 250.0 s, 135.9 tps, lat 4040.299 ms stddev 9173.722 2024-04-26T18:04:24.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:24 smithi092 ceph-mon[29156]: pgmap v146: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 294 KiB/s wr, 56 op/s 2024-04-26T18:04:25.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.070+0000 7f3e30574700 1 -- 172.21.15.92:0/2855348873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102ce0 msgr2=0x7f3e2810f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.070 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.070+0000 7f3e30574700 1 --2- 172.21.15.92:0/2855348873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102ce0 0x7f3e2810f1d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000b0a0 tx=0x7f3e2000b3b0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.071+0000 7f3e30574700 1 -- 172.21.15.92:0/2855348873 shutdown_connections 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.071+0000 7f3e30574700 1 --2- 172.21.15.92:0/2855348873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102ce0 0x7f3e2810f1d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.071+0000 7f3e30574700 1 --2- 172.21.15.92:0/2855348873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e28108390 0x7f3e28108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.071+0000 7f3e30574700 1 --2- 172.21.15.92:0/2855348873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102320 0x7f3e281027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.071+0000 7f3e30574700 1 -- 172.21.15.92:0/2855348873 >> 172.21.15.92:0/2855348873 conn(0x7f3e280792d0 msgr2=0x7f3e280796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.071 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.072+0000 7f3e30574700 1 -- 172.21.15.92:0/2855348873 shutdown_connections 2024-04-26T18:04:25.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.072+0000 7f3e30574700 1 -- 172.21.15.92:0/2855348873 wait complete. 2024-04-26T18:04:25.072 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.073+0000 7f3e30574700 1 Processor -- start 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.073+0000 7f3e30574700 1 -- start start 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.073+0000 7f3e30574700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.073+0000 7f3e30574700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102ce0 0x7f3e28198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.073+0000 7f3e30574700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e28108390 0x7f3e2819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e30574700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281124b0 con 0x7f3e28102320 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e30574700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28112330 con 0x7f3e28102ce0 2024-04-26T18:04:25.073 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e30574700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28112630 con 0x7f3e28108390 2024-04-26T18:04:25.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40288/0 (socket says 172.21.15.92:40288) 2024-04-26T18:04:25.075 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 -- 172.21.15.92:0/3974415563 learned_addr learned my addr 172.21.15.92:0/3974415563 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2db0f700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102ce0 0x7f3e28198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 -- 172.21.15.92:0/3974415563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e28108390 msgr2=0x7f3e2819d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e28108390 0x7f3e2819d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 -- 172.21.15.92:0/3974415563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102ce0 msgr2=0x7f3e28198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102ce0 0x7f3e28198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.074+0000 7f3e2e310700 1 -- 172.21.15.92:0/3974415563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2819dc30 con 0x7f3e28102320 2024-04-26T18:04:25.076 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e2e310700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400d980 tx=0x7f3e2400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24016070 con 0x7f3e28102320 2024-04-26T18:04:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2819df20 con 0x7f3e28102320 2024-04-26T18:04:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e240044d0 con 0x7f3e28102320 2024-04-26T18:04:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24004d00 con 0x7f3e28102320 2024-04-26T18:04:25.077 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.075+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2819e460 con 0x7f3e28102320 2024-04-26T18:04:25.078 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.076+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2806a110 con 0x7f3e28102320 2024-04-26T18:04:25.079 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.080+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3e24004020 con 0x7f3e28102320 2024-04-26T18:04:25.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.081+0000 7f3e1f7fe700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 0x7f3e140a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:25.080 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.081+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f3e240d0b30 con 0x7f3e28102320 2024-04-26T18:04:25.082 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.083+0000 7f3e2db0f700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 0x7f3e140a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:25.088 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.089+0000 7f3e2db0f700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 0x7f3e140a6270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005950 tx=0x7f3e180058e0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:25.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.094+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f3e2401f020 con 0x7f3e28102320 2024-04-26T18:04:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:24 smithi189 ceph-mon[32756]: pgmap v146: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 294 KiB/s wr, 56 op/s 2024-04-26T18:04:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:24 smithi156 ceph-mon[32679]: pgmap v146: 97 pgs: 97 active+clean; 2.1 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 294 KiB/s wr, 56 op/s 2024-04-26T18:04:25.485 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.485+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e2819e6c0 con 0x7f3e28102320 2024-04-26T18:04:25.486 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.486+0000 7f3e1f7fe700 1 -- 172.21.15.92:0/3974415563 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7f3e2409d240 con 0x7f3e28102320 2024-04-26T18:04:25.486 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:04:25.486 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:03:13.093720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:04:25.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.489+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 msgr2=0x7f3e140a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.488 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.489+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 0x7f3e140a6270 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3e18005950 tx=0x7f3e180058e0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.489+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 msgr2=0x7f3e281986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:25.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.489+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400d980 tx=0x7f3e2400dd40 comp rx=0 tx=0).stop 2024-04-26T18:04:25.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 shutdown_connections 2024-04-26T18:04:25.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3e140a3db0 0x7f3e140a6270 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.489 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e28108390 0x7f3e2819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e28102320 0x7f3e281986a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 --2- 172.21.15.92:0/3974415563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3e28102ce0 0x7f3e28198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 >> 172.21.15.92:0/3974415563 conn(0x7f3e280792d0 msgr2=0x7f3e28100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 shutdown_connections 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:25.490+0000 7f3e30574700 1 -- 172.21.15.92:0/3974415563 wait complete. 2024-04-26T18:04:25.490 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 32 2024-04-26T18:04:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:25 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3974415563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:25 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3974415563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:25 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3974415563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:26.731 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:04:26.732 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:04:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:26 smithi092 ceph-mon[29156]: pgmap v147: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2024-04-26T18:04:27.106 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:26 smithi189 ceph-mon[32756]: pgmap v147: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2024-04-26T18:04:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:26 smithi156 ceph-mon[32679]: pgmap v147: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.7 MiB/s wr, 138 op/s 2024-04-26T18:04:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 255.0 s, 2487.4 tps, lat 41.170 ms stddev 85.057 2024-04-26T18:04:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:28 smithi092 ceph-mon[29156]: pgmap v148: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-04-26T18:04:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:28 smithi189 ceph-mon[32756]: pgmap v148: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-04-26T18:04:29.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:28 smithi156 ceph-mon[32679]: pgmap v148: 97 pgs: 97 active+clean; 2.1 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-04-26T18:04:29.215 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- 172.21.15.92:0/1399648245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910102640 msgr2=0x7fd910102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 --2- 172.21.15.92:0/1399648245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910102640 0x7fd910102ac0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd90000b0d0 tx=0x7fd90000b3e0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- 172.21.15.92:0/1399648245 shutdown_connections 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 --2- 172.21.15.92:0/1399648245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910108530 0x7fd910108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 --2- 172.21.15.92:0/1399648245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91010f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 --2- 172.21.15.92:0/1399648245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910102640 0x7fd910102ac0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- 172.21.15.92:0/1399648245 >> 172.21.15.92:0/1399648245 conn(0x7fd910079080 msgr2=0x7fd910079490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- 172.21.15.92:0/1399648245 shutdown_connections 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- 172.21.15.92:0/1399648245 wait complete. 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 Processor -- start 2024-04-26T18:04:29.216 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.216+0000 7fd915a50700 1 -- start start 2024-04-26T18:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 0x7fd91019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 0x7fd910199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd910112580 con 0x7fd910108530 2024-04-26T18:04:29.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd910112400 con 0x7fd910102640 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd915a50700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd910112700 con 0x7fd910103000 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd90f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 0x7fd910199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:59644/0 (socket says 172.21.15.92:59644) 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 -- 172.21.15.92:0/644392447 learned_addr learned my addr 172.21.15.92:0/644392447 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd90effd700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 0x7fd91019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 -- 172.21.15.92:0/644392447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 msgr2=0x7fd91019f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 0x7fd91019f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 -- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 msgr2=0x7fd910199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 0x7fd910199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd9067fc700 1 -- 172.21.15.92:0/644392447 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91019a020 con 0x7fd910103000 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd90effd700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 0x7fd91019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.217+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 0x7fd910199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:04:29.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.218+0000 7fd9067fc700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd900007a30 tx=0x7fd900007a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.218+0000 7fd914a4e700 1 -- 172.21.15.92:0/644392447 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90001f070 con 0x7fd910103000 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.218+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91019a2b0 con 0x7fd910103000 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.218+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101a6520 con 0x7fd910103000 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.218+0000 7fd914a4e700 1 -- 172.21.15.92:0/644392447 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd900004c60 con 0x7fd910103000 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.219+0000 7fd914a4e700 1 -- 172.21.15.92:0/644392447 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90001b690 con 0x7fd910103000 2024-04-26T18:04:29.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.221+0000 7fd914a4e700 1 -- 172.21.15.92:0/644392447 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd900022070 con 0x7fd910103000 2024-04-26T18:04:29.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.222+0000 7fd914a4e700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 0x7fd8fc0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.222+0000 7fd90effd700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 0x7fd8fc0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.222+0000 7fd914a4e700 1 -- 172.21.15.92:0/644392447 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd90000f020 con 0x7fd910103000 2024-04-26T18:04:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.222+0000 7fd9202e2b80 1 Processor -- start 2024-04-26T18:04:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.223+0000 7fd90effd700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 0x7fd8fc0a6390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009cb0 tx=0x7fd8f8009260 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 -- start start 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff0c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff0cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfe5e9c0 con 0x55fcbff1a7d0 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfdc4ac0 con 0x55fcbff0c900 2024-04-26T18:04:29.224 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfe5a980 con 0x55fcbff1b0f0 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd90effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd90effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40322/0 (socket says 172.21.15.92:40322) 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd90effd700 1 -- 172.21.15.92:0/3987950881 learned_addr learned my addr 172.21.15.92:0/3987950881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd9067fc700 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff0c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.224+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff0cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.225+0000 7fd90effd700 1 -- 172.21.15.92:0/3987950881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 msgr2=0x55fcbff0c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.225+0000 7fd90effd700 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff0c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.225+0000 7fd90effd700 1 -- 172.21.15.92:0/3987950881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 msgr2=0x55fcbff0cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.225+0000 7fd90effd700 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff0cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.225 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.225+0000 7fd90effd700 1 -- 172.21.15.92:0/3987950881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbfdaba60 con 0x55fcbff1a7d0 2024-04-26T18:04:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.226+0000 7fd90effd700 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8011fb0 tx=0x7fd8f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af68f633ea568826 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.226+0000 7fd905ffb700 1 -- 172.21.15.92:0/3987950881 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8025070 con 0x55fcbff1a7d0 2024-04-26T18:04:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.226+0000 7fd905ffb700 1 -- 172.21.15.92:0/3987950881 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f8016070 con 0x55fcbff1a7d0 2024-04-26T18:04:29.226 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.226+0000 7fd905ffb700 1 -- 172.21.15.92:0/3987950881 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8012a60 con 0x55fcbff1a7d0 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 -- 172.21.15.92:0/3987950881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 msgr2=0x55fcbff1abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8011fb0 tx=0x7fd8f8014000 comp rx=0 tx=0).stop 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 -- 172.21.15.92:0/3987950881 shutdown_connections 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff0cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1abb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/3987950881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff0c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 -- 172.21.15.92:0/3987950881 >> 172.21.15.92:0/3987950881 conn(0x55fcbfe3a750 msgr2=0x55fcbff072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 -- 172.21.15.92:0/3987950881 shutdown_connections 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.227+0000 7fd9202e2b80 1 -- 172.21.15.92:0/3987950881 wait complete. 2024-04-26T18:04:29.227 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 -- start start 2024-04-26T18:04:29.228 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 Processor -- start 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff1e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fcbff21bb0 con 0x55fcbff1b0f0 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55fcbfe18c10 con 0x55fcbff1a7d0 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fcbff21d30 con 0x55fcbff0c900 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd90effd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9202e2b80 10 client.0 _ll_register_callbacks cb 0x55fcbfdf6ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd90effd700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:59658/0 (socket says 172.21.15.92:59658) 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 -- 172.21.15.92:0/2247844921 learned_addr learned my addr 172.21.15.92:0/2247844921 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.230 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.228+0000 7fd9067fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff1e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 -- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 msgr2=0x55fcbff1e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 -- 172.21.15.92:0/2247844921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 msgr2=0x55fcbff1e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff1e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 -- 172.21.15.92:0/2247844921 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbfe1c610 con 0x55fcbff0c900 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff1e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd90effd700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009fa0 tx=0x7fd8f8003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f8a87450165e64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd8eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8025030 con 0x55fcbff0c900 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd8f8012450 con 0x55fcbff0c900 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f8016070 con 0x55fcbff0c900 2024-04-26T18:04:29.231 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.229+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd8f803a050 con 0x55fcbff0c900 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 10 client.25273 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fcbff2c3d0 con 0x55fcbff0c900 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f8016070 con 0x55fcbff0c900 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fd8f802b070 con 0x55fcbff0c900 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 10 client.25273 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 10 client.25273 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 20 client.25273 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.230+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbff2e950 0x55fcbff30d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.231+0000 7fd9202e2b80 4 client.25273 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.231+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcbfe6c3a0 con 0x55fcbff2e950 2024-04-26T18:04:29.232 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.231+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbff2e950 0x55fcbff30d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.231+0000 7fd8eeffd700 10 client.25273 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.231+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbff2e950 0x55fcbff30d40 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4742c19cc2605c6e server_cookie=3193cb8a75e16bb0 in_seq=0 out_seq=0 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2247844921 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fcbfe6c3a0 con 0x55fcbff2e950 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd8eeffd700 10 client.25273 handle_command_reply: tid=0 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 client.25273 shutdown 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 msgr2=0x55fcbff20dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009fa0 tx=0x7fd8f8003a50 comp rx=0 tx=0).stop 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 shutdown_connections 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbff2e950 0x55fcbff30d40 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff1e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff0c900 0x55fcbff20dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd8eeffd700 0 client.25273 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2247844921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff1a7d0 0x55fcbff1e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.232+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 >> 172.21.15.92:0/2247844921 conn(0x55fcbfe3a750 msgr2=0x55fcbff0b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.233+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 shutdown_connections 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.233+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2247844921 wait complete. 2024-04-26T18:04:29.235 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.233+0000 7fd9202e2b80 20 client.25273 trim_cache size 0 max 16384 2024-04-26T18:04:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.256+0000 7fd9202e2b80 1 Processor -- start 2024-04-26T18:04:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.256+0000 7fd9202e2b80 1 -- start start 2024-04-26T18:04:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff00e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd90effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd90effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:34124/0 (socket says 172.21.15.92:34124) 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff36370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd90effd700 1 -- 172.21.15.92:0/1046762468 learned_addr learned my addr 172.21.15.92:0/1046762468 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000fd80 con 0x55fcbff1a7d0 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000d5b0 con 0x55fcbff0c900 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000b400 con 0x55fcbff1b0f0 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.257+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff36370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd9067fc700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff00e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 -- 172.21.15.92:0/1046762468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 msgr2=0x55fcbff2aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 -- 172.21.15.92:0/1046762468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 msgr2=0x55fcbff00e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff00e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 -- 172.21.15.92:0/1046762468 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcbff07db0 con 0x55fcbff1b0f0 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90effd700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd90f7fe700 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff36370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd908012a80 tx=0x7fd908009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4d173d1f2d3bdf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd9057fa700 1 -- 172.21.15.92:0/1046762468 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908022070 con 0x55fcbff1b0f0 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd9057fa700 1 -- 172.21.15.92:0/1046762468 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9080044e0 con 0x55fcbff1b0f0 2024-04-26T18:04:29.259 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.258+0000 7fd9057fa700 1 -- 172.21.15.92:0/1046762468 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd908003680 con 0x55fcbff1b0f0 2024-04-26T18:04:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 msgr2=0x55fcbff36370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.261 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff36370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd908012a80 tx=0x7fd908009260 comp rx=0 tx=0).stop 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 shutdown_connections 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff2aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1b0f0 0x55fcbff36370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/1046762468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1a7d0 0x55fcbff00e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 >> 172.21.15.92:0/1046762468 conn(0x55fcbfe3a750 msgr2=0x55fcbff00700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 shutdown_connections 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.259+0000 7fd9202e2b80 1 -- 172.21.15.92:0/1046762468 wait complete. 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 -- start start 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 Processor -- start 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.262 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 0x55fcbff23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff24530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000ba70 con 0x55fcbff1b0f0 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000cee0 con 0x55fcbff0c900 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f000c140 con 0x55fcbff1a7d0 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9202e2b80 10 client.0 _ll_register_callbacks cb 0x55fcbfdf6ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd90f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff24530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd9067fc700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 0x55fcbff23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd90f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff24530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40356/0 (socket says 172.21.15.92:40356) 2024-04-26T18:04:29.263 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd90f7fe700 1 -- 172.21.15.92:0/2923103691 learned_addr learned my addr 172.21.15.92:0/2923103691 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.260+0000 7fd90effd700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 -- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 msgr2=0x55fcbff27440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff27440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 -- 172.21.15.92:0/2923103691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 msgr2=0x55fcbff24530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff24530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 -- 172.21.15.92:0/2923103691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcbff24da0 con 0x55fcbff1a7d0 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.261+0000 7fd9067fc700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 0x55fcbff23f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9000cefb0 tx=0x7fd900088040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ceaa0d6ec21e90e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd8eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90009d890 con 0x55fcbff1a7d0 2024-04-26T18:04:29.264 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd9000a40b0 con 0x55fcbff1a7d0 2024-04-26T18:04:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9080044e0 con 0x55fcbff1a7d0 2024-04-26T18:04:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd9000bc020 con 0x55fcbff1a7d0 2024-04-26T18:04:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd9202e2b80 10 client.25279 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:29.265 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.262+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55fcbffa6d20 con 0x55fcbff1a7d0 2024-04-26T18:04:29.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.263+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9080044e0 con 0x55fcbff1a7d0 2024-04-26T18:04:29.266 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.263+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fd900011070 con 0x55fcbff1a7d0 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.263+0000 7fd9202e2b80 10 client.25279 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.263+0000 7fd9202e2b80 10 client.25279 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd9202e2b80 20 client.25279 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbffa73b0 0x55fcbffa97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd9202e2b80 4 client.25279 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x55fcbfe66440 con 0x55fcbffa73b0 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd90effd700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbffa73b0 0x55fcbffa97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.265+0000 7fd8eeffd700 10 client.25279 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.267 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.264+0000 7fd90effd700 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbffa73b0 0x55fcbffa97d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91ba870013026706 server_cookie=4937c025b1720d0a in_seq=0 out_seq=0 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd8eeffd700 1 -- 172.21.15.92:0/2923103691 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55fcbfe66440 con 0x55fcbffa73b0 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd8eeffd700 10 client.25279 handle_command_reply: tid=0 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 client.25279 shutdown 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 msgr2=0x55fcbff23f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 0x55fcbff23f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9000cefb0 tx=0x7fd900088040 comp rx=0 tx=0).stop 2024-04-26T18:04:29.440 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 shutdown_connections 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fcbffa73b0 0x55fcbffa97d0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fcbff0c900 0x55fcbff27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fcbff1b0f0 0x55fcbff24530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 --2- 172.21.15.92:0/2923103691 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fcbff1a7d0 0x55fcbff23f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 >> 172.21.15.92:0/2923103691 conn(0x55fcbfe3a750 msgr2=0x55fcbff1bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd8eeffd700 0 client.25279 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 shutdown_connections 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 1 -- 172.21.15.92:0/2923103691 wait complete. 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.440+0000 7fd9202e2b80 20 client.25279 trim_cache size 0 max 16384 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:04:29.441 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 32, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 14, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "2e112b0c": { 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 14, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 79.5, 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:04:29.442 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCED", 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:29.443 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 msgr2=0x7fd8fc0a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 0x7fd8fc0a6390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009cb0 tx=0x7fd8f8009260 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 msgr2=0x7fd91019fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd900007a30 tx=0x7fd900007a60 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 shutdown_connections 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8fc0a3ed0 0x7fd8fc0a6390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd910102640 0x7fd91019f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd910108530 0x7fd910199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 --2- 172.21.15.92:0/644392447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd910103000 0x7fd91019fc00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 >> 172.21.15.92:0/644392447 conn(0x7fd910079080 msgr2=0x7fd91006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 shutdown_connections 2024-04-26T18:04:29.444 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:29.441+0000 7fd915a50700 1 -- 172.21.15.92:0/644392447 wait complete. 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 -- 172.21.15.92:0/797647088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544107850 msgr2=0x7f4544107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 --2- 172.21.15.92:0/797647088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544107850 0x7f4544107c30 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4540009930 tx=0x7f454002a420 comp rx=0 tx=0).stop 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 -- 172.21.15.92:0/797647088 shutdown_connections 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 --2- 172.21.15.92:0/797647088 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544102250 0x7f454410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 --2- 172.21.15.92:0/797647088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 --2- 172.21.15.92:0/797647088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544107850 0x7f4544107c30 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 -- 172.21.15.92:0/797647088 >> 172.21.15.92:0/797647088 conn(0x7f4544078a40 msgr2=0x7f4544078e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 -- 172.21.15.92:0/797647088 shutdown_connections 2024-04-26T18:04:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.534+0000 7f454bb1c640 1 -- 172.21.15.92:0/797647088 wait complete. 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 Processor -- start 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 -- start start 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 0x7f45441a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4544111ad0 con 0x7f4544102250 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4544111950 con 0x7f4544101890 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f454bb1c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4544111c50 con 0x7f4544107850 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40370/0 (socket says 172.21.15.92:40370) 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.535+0000 7f45490b7640 1 -- 172.21.15.92:0/269986215 learned_addr learned my addr 172.21.15.92:0/269986215 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45498b8640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f454a0b9640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 0x7f45441a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 -- 172.21.15.92:0/269986215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 msgr2=0x7f45441a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 0x7f45441a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 -- 172.21.15.92:0/269986215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 msgr2=0x7f4544199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 -- 172.21.15.92:0/269986215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45441a5470 con 0x7f4544102250 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45498b8640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f454a0b9640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 0x7f45441a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f45490b7640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f453400e9f0 tx=0x7f453400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f453affd640 1 -- 172.21.15.92:0/269986215 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453400cd80 con 0x7f4544102250 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f453affd640 1 -- 172.21.15.92:0/269986215 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45340108e0 con 0x7f4544102250 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f453affd640 1 -- 172.21.15.92:0/269986215 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534018980 con 0x7f4544102250 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45441a5640 con 0x7f4544102250 2024-04-26T18:04:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.536+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45441a5b90 con 0x7f4544102250 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.538+0000 7f453affd640 1 -- 172.21.15.92:0/269986215 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4534010430 con 0x7f4544102250 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.538+0000 7f454e831740 1 Processor -- start 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 -- start start 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ffee842460 con 0x55ffee8dc820 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ffee7fc590 con 0x55ffee8e70e0 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454e831740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ffee83e420 con 0x55ffee8dbf00 2024-04-26T18:04:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40374/0 (socket says 172.21.15.92:40374) 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 -- 172.21.15.92:0/255149815 learned_addr learned my addr 172.21.15.92:0/255149815 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45490b7640 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f453affd640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 0x7f45300a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454a0b9640 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f454a0b9640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 0x7f45300a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 -- 172.21.15.92:0/255149815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 msgr2=0x55ffee8dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8dc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 -- 172.21.15.92:0/255149815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 msgr2=0x55ffee8e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f45498b8640 1 -- 172.21.15.92:0/255149815 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffee8090d0 con 0x55ffee8dc820 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.539+0000 7f453affd640 1 -- 172.21.15.92:0/269986215 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f45340d0bd0 con 0x7f4544102250 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.540+0000 7f45498b8640 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4540031440 tx=0x7f4540032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6ef341be8dd85e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.540+0000 7f454a0b9640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 0x7f45300a6280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f453c005cc0 tx=0x7f453c004ab0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.540+0000 7f452ffff640 1 -- 172.21.15.92:0/255149815 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454003f070 con 0x55ffee8dc820 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.540+0000 7f452ffff640 1 -- 172.21.15.92:0/255149815 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45400316a0 con 0x55ffee8dc820 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.540+0000 7f452ffff640 1 -- 172.21.15.92:0/255149815 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540035070 con 0x55ffee8dc820 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- 172.21.15.92:0/255149815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 msgr2=0x55ffee8e6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4540031440 tx=0x7f4540032de0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- 172.21.15.92:0/255149815 shutdown_connections 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e6ba0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- 172.21.15.92:0/255149815 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- 172.21.15.92:0/255149815 >> 172.21.15.92:0/255149815 conn(0x55ffee8d8410 msgr2=0x55ffee8d87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- 172.21.15.92:0/255149815 shutdown_connections 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- 172.21.15.92:0/255149815 wait complete. 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- start start 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 Processor -- start 2024-04-26T18:04:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ffee8e9cb0 con 0x55ffee8dc820 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ffee7c9b60 con 0x55ffee8e70e0 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.541+0000 7f454e831740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ffee8e9e30 con 0x55ffee8dbf00 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454e831740 10 client.0 _ll_register_callbacks cb 0x55ffee7ee2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40384/0 (socket says 172.21.15.92:40384) 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 -- 172.21.15.92:0/1272606577 learned_addr learned my addr 172.21.15.92:0/1272606577 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45498b8640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454a0b9640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 -- 172.21.15.92:0/1272606577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 msgr2=0x55ffee8e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 -- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 msgr2=0x55ffee8e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 -- 172.21.15.92:0/1272606577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffee554210 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454a0b9640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f45490b7640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f45340ce3f0 tx=0x7f453409c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c970593eb8a173 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f452d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534010720 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4534010a90 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45400316a0 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f453409d2e0 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454e831740 10 client.15834 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffee620620 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.542+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45400316a0 con 0x55ffee8dc820 2024-04-26T18:04:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f4534099250 con 0x55ffee8dc820 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 10 client.15834 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 20 client.15834 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee8f7220 0x55ffee8f9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 4 client.15834 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffee850070 con 0x55ffee8f7220 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f45498b8640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee8f7220 0x55ffee8f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f45498b8640 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee8f7220 0x55ffee8f9610 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a298661cfc510f5b server_cookie=e8ebcc25fda4360a in_seq=0 out_seq=0 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.543+0000 7f452d7fa640 10 client.15834 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f452d7fa640 1 -- 172.21.15.92:0/1272606577 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ffee850070 con 0x55ffee8f7220 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f452d7fa640 10 client.15834 handle_command_reply: tid=0 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 client.15834 shutdown 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 msgr2=0x55ffee8e45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f45340ce3f0 tx=0x7f453409c9b0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 shutdown_connections 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee8f7220 0x55ffee8f9610 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8e45f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f452d7fa640 0 client.15834 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 --2- 172.21.15.92:0/1272606577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 >> 172.21.15.92:0/1272606577 conn(0x55ffee8d8410 msgr2=0x55ffee8de140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 shutdown_connections 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 1 -- 172.21.15.92:0/1272606577 wait complete. 2024-04-26T18:04:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.544+0000 7f454e831740 20 client.15834 trim_cache size 0 max 16384 2024-04-26T18:04:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 Processor -- start 2024-04-26T18:04:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 -- start start 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 0x55ffee8de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45441b0c60 con 0x55ffee8dbf00 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f45441ae4d0 con 0x55ffee8e70e0 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454e831740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45441ac340 con 0x55ffee8dc820 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40398/0 (socket says 172.21.15.92:40398) 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 -- 172.21.15.92:0/3905701902 learned_addr learned my addr 172.21.15.92:0/3905701902 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45490b7640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 0x55ffee8de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454a0b9640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 -- 172.21.15.92:0/3905701902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 msgr2=0x55ffee8de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 0x55ffee8de8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 -- 172.21.15.92:0/3905701902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 msgr2=0x55ffee8e5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45498b8640 1 -- 172.21.15.92:0/3905701902 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffee8f9c90 con 0x55ffee8dbf00 2024-04-26T18:04:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f45490b7640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 0x55ffee8de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.559+0000 7f454a0b9640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f45498b8640 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4540031440 tx=0x7f4540005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f267ef26416f9f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f452f7fe640 1 -- 172.21.15.92:0/3905701902 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540052070 con 0x55ffee8dbf00 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f452f7fe640 1 -- 172.21.15.92:0/3905701902 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4540005580 con 0x55ffee8dbf00 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f452f7fe640 1 -- 172.21.15.92:0/3905701902 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454003f040 con 0x55ffee8dbf00 2024-04-26T18:04:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 -- 172.21.15.92:0/3905701902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 msgr2=0x55ffee8d7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4540031440 tx=0x7f4540005310 comp rx=0 tx=0).stop 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 -- 172.21.15.92:0/3905701902 shutdown_connections 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8e5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dc820 0x55ffee8de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 --2- 172.21.15.92:0/3905701902 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dbf00 0x55ffee8d7d30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 -- 172.21.15.92:0/3905701902 >> 172.21.15.92:0/3905701902 conn(0x55ffee8d8410 msgr2=0x55ffee8e58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 -- 172.21.15.92:0/3905701902 shutdown_connections 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.560+0000 7f454e831740 1 -- 172.21.15.92:0/3905701902 wait complete. 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 -- start start 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 Processor -- start 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45441ac990 con 0x55ffee8dc820 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f45441ade00 con 0x55ffee8e70e0 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45441ad060 con 0x55ffee8dbf00 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454e831740 10 client.0 _ll_register_callbacks cb 0x7f453400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40402/0 (socket says 172.21.15.92:40402) 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 -- 172.21.15.92:0/1499944719 learned_addr learned my addr 172.21.15.92:0/1499944719 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45498b8640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 -- 172.21.15.92:0/1499944719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 msgr2=0x55ffee8ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8ef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 -- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 msgr2=0x55ffee8eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f454a0b9640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.561+0000 7f45490b7640 1 -- 172.21.15.92:0/1499944719 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffee8eb260 con 0x55ffee8dc820 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454a0b9640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f45490b7640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f45340995b0 tx=0x7f453409cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2695ceb1d0133eaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:29.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453409c720 con 0x55ffee8dc820 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f453409c230 con 0x55ffee8dc820 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4540005580 con 0x55ffee8dc820 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f45340b6150 con 0x55ffee8dc820 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 10 client.15840 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ffee95d5e0 con 0x55ffee8dc820 2024-04-26T18:04:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4540005580 con 0x55ffee8dc820 2024-04-26T18:04:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f4534098930 con 0x55ffee8dc820 2024-04-26T18:04:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 10 client.15840 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 10 client.15840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 20 client.15840 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee95dd90 0x55ffee9601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 4 client.15840 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffee849ee0 con 0x55ffee95dd90 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.562+0000 7f45498b8640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee95dd90 0x55ffee9601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.563+0000 7f45498b8640 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee95dd90 0x55ffee9601b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e691799517628c8 server_cookie=b51c033b2fc328aa in_seq=0 out_seq=0 2024-04-26T18:04:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.563+0000 7f452d7fa640 10 client.15840 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.571+0000 7f452d7fa640 1 -- 172.21.15.92:0/1499944719 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffee849ee0 con 0x55ffee95dd90 2024-04-26T18:04:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.571+0000 7f452d7fa640 10 client.15840 handle_command_reply: tid=0 2024-04-26T18:04:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.571+0000 7f454e831740 1 client.15840 shutdown 2024-04-26T18:04:29.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 msgr2=0x55ffee8ea680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f45340995b0 tx=0x7f453409cae0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 shutdown_connections 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ffee95dd90 0x55ffee9601b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffee8e70e0 0x55ffee8eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ffee8dc820 0x55ffee8ea680 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f452d7fa640 0 client.15840 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 --2- 172.21.15.92:0/1499944719 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ffee8dbf00 0x55ffee8ef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 >> 172.21.15.92:0/1499944719 conn(0x55ffee8d8410 msgr2=0x55ffee8e6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 shutdown_connections 2024-04-26T18:04:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 1 -- 172.21.15.92:0/1499944719 wait complete. 2024-04-26T18:04:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454e831740 20 client.15840 trim_cache size 0 max 16384 2024-04-26T18:04:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:04:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:04:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:04:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:04:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 msgr2=0x7f45300a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 0x7f45300a6280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f453c005cc0 tx=0x7f453c004ab0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 msgr2=0x7f454419a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f453400e9f0 tx=0x7f453400eeb0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 shutdown_connections 2024-04-26T18:04:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45300a3dc0 0x7f45300a6280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4544107850 0x7f45441a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4544102250 0x7f454419a3f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 --2- 172.21.15.92:0/269986215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4544101890 0x7f4544199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 >> 172.21.15.92:0/269986215 conn(0x7f4544078a40 msgr2=0x7f4544104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 shutdown_connections 2024-04-26T18:04:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:29.572+0000 7f454bb1c640 1 -- 172.21.15.92:0/269986215 wait complete. 2024-04-26T18:04:30.098 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2e112b0c', quiesce took 7.4 seconds. Will release after: 19.5 2024-04-26T18:04:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:30 smithi092 ceph-mon[29156]: pgmap v149: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-04-26T18:04:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:30 smithi189 ceph-mon[32756]: pgmap v149: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-04-26T18:04:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:30 smithi156 ceph-mon[32679]: pgmap v149: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 1.08k op/s 2024-04-26T18:04:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:32 smithi092 ceph-mon[29156]: pgmap v150: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2024-04-26T18:04:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:32 smithi189 ceph-mon[32756]: pgmap v150: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2024-04-26T18:04:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:32 smithi156 ceph-mon[32679]: pgmap v150: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.07k op/s 2024-04-26T18:04:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 260.0 s, 714.2 tps, lat 26.959 ms stddev 31.235 2024-04-26T18:04:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:34 smithi092 ceph-mon[29156]: pgmap v151: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 1.16k op/s 2024-04-26T18:04:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:34 smithi189 ceph-mon[32756]: pgmap v151: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 1.16k op/s 2024-04-26T18:04:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:34 smithi156 ceph-mon[32679]: pgmap v151: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 1.16k op/s 2024-04-26T18:04:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:36 smithi092 ceph-mon[29156]: pgmap v152: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.25k op/s 2024-04-26T18:04:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:36 smithi189 ceph-mon[32756]: pgmap v152: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.25k op/s 2024-04-26T18:04:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:36 smithi156 ceph-mon[32679]: pgmap v152: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.25k op/s 2024-04-26T18:04:38.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 265.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:38 smithi092 ceph-mon[29156]: pgmap v153: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:38 smithi189 ceph-mon[32756]: pgmap v153: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:38 smithi156 ceph-mon[32679]: pgmap v153: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:40 smithi092 ceph-mon[29156]: pgmap v154: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:40 smithi189 ceph-mon[32756]: pgmap v154: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:40 smithi156 ceph-mon[32679]: pgmap v154: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.17k op/s 2024-04-26T18:04:42.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.720+0000 7fa98b837640 1 -- 172.21.15.92:0/1940946895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984107820 msgr2=0x7fa984107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.720+0000 7fa98b837640 1 --2- 172.21.15.92:0/1940946895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984107820 0x7fa984107c00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa97400d940 tx=0x7fa97402e620 comp rx=0 tx=0).stop 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.722+0000 7fa98b837640 1 -- 172.21.15.92:0/1940946895 shutdown_connections 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.722+0000 7fa98b837640 1 --2- 172.21.15.92:0/1940946895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa984102220 0x7fa98410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.722+0000 7fa98b837640 1 --2- 172.21.15.92:0/1940946895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984101860 0x7fa984101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.722+0000 7fa98b837640 1 --2- 172.21.15.92:0/1940946895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984107820 0x7fa984107c00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.722+0000 7fa98b837640 1 -- 172.21.15.92:0/1940946895 >> 172.21.15.92:0/1940946895 conn(0x7fa9840789b0 msgr2=0x7fa984078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.723+0000 7fa98b837640 1 -- 172.21.15.92:0/1940946895 shutdown_connections 2024-04-26T18:04:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.723+0000 7fa98b837640 1 -- 172.21.15.92:0/1940946895 wait complete. 2024-04-26T18:04:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.724+0000 7fa98b837640 1 Processor -- start 2024-04-26T18:04:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.724+0000 7fa98b837640 1 -- start start 2024-04-26T18:04:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa984102220 0x7fa98406e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984107820 0x7fa98406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa98406cc50 con 0x7fa984101860 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa98406cad0 con 0x7fa984107820 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.725+0000 7fa98b837640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa98406cdd0 con 0x7fa984102220 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.726+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.726+0000 7fa989dd4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984107820 0x7fa98406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.726+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56132/0 (socket says 172.21.15.92:56132) 2024-04-26T18:04:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.726+0000 7fa9895d3640 1 -- 172.21.15.92:0/867306607 learned_addr learned my addr 172.21.15.92:0/867306607 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.726+0000 7fa9895d3640 1 -- 172.21.15.92:0/867306607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa984102220 msgr2=0x7fa98406e2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.727+0000 7fa9895d3640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa984102220 0x7fa98406e2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.727+0000 7fa9895d3640 1 -- 172.21.15.92:0/867306607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984107820 msgr2=0x7fa98406e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.727+0000 7fa9895d3640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984107820 0x7fa98406e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.727+0000 7fa9895d3640 1 -- 172.21.15.92:0/867306607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98406ef50 con 0x7fa984101860 2024-04-26T18:04:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.727+0000 7fa9895d3640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa97402ec10 tx=0x7fa974004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.730+0000 7fa97a7fc640 1 -- 172.21.15.92:0/867306607 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974044030 con 0x7fa984101860 2024-04-26T18:04:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.730+0000 7fa97a7fc640 1 -- 172.21.15.92:0/867306607 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa97400ce20 con 0x7fa984101860 2024-04-26T18:04:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.730+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9841abf30 con 0x7fa984101860 2024-04-26T18:04:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.730+0000 7fa97a7fc640 1 -- 172.21.15.92:0/867306607 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974035420 con 0x7fa984101860 2024-04-26T18:04:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.731+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9841ac2e0 con 0x7fa984101860 2024-04-26T18:04:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.735+0000 7fa98e62e740 1 Processor -- start 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.735+0000 7fa98e62e740 1 -- start start 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 0x556ae14a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ae140e460 con 0x556ae14a8820 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x556ae13c8590 con 0x556ae14b30e0 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.736+0000 7fa98e62e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ae140a420 con 0x556ae14a7f00 2024-04-26T18:04:42.737 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.737+0000 7fa97a7fc640 1 -- 172.21.15.92:0/867306607 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa974047030 con 0x7fa984101860 2024-04-26T18:04:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.738+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.738+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56134/0 (socket says 172.21.15.92:56134) 2024-04-26T18:04:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.738+0000 7fa9895d3640 1 -- 172.21.15.92:0/3567251937 learned_addr learned my addr 172.21.15.92:0/3567251937 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.738+0000 7fa97a7fc640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 0x7fa9700a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.738+0000 7fa989dd4640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 0x556ae14a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 -- 172.21.15.92:0/3567251937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 msgr2=0x556ae14a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 0x556ae14a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa988dd2640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 -- 172.21.15.92:0/3567251937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 msgr2=0x556ae14b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 -- 172.21.15.92:0/3567251937 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae13d50d0 con 0x556ae14a8820 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa989dd4640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 0x556ae14a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa989dd4640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 0x7fa9700a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa97a7fc640 1 -- 172.21.15.92:0/867306607 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa9740f4540 con 0x7fa984101860 2024-04-26T18:04:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.739+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa9740f1be0 tx=0x7fa97404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febeeb59d5a2ed75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.740+0000 7fa989dd4640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 0x7fa9700a64b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa98000b910 tx=0x7fa980004750 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.740+0000 7fa96f7fe640 1 -- 172.21.15.92:0/3567251937 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740c0030 con 0x556ae14a8820 2024-04-26T18:04:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.740+0000 7fa96f7fe640 1 -- 172.21.15.92:0/3567251937 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9740c0bf0 con 0x556ae14a8820 2024-04-26T18:04:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.741+0000 7fa98e62e740 1 -- 172.21.15.92:0/3567251937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 msgr2=0x556ae14b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.741+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa9740f1be0 tx=0x7fa97404f000 comp rx=0 tx=0).stop 2024-04-26T18:04:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.743+0000 7fa98e62e740 1 -- 172.21.15.92:0/3567251937 shutdown_connections 2024-04-26T18:04:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.743+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.743+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b2ba0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.743+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3567251937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a7f00 0x556ae14a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.743+0000 7fa98e62e740 1 -- 172.21.15.92:0/3567251937 >> 172.21.15.92:0/3567251937 conn(0x556ae14a4410 msgr2=0x556ae14a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.744+0000 7fa98e62e740 1 -- 172.21.15.92:0/3567251937 shutdown_connections 2024-04-26T18:04:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.749+0000 7fa98e62e740 1 -- 172.21.15.92:0/3567251937 wait complete. 2024-04-26T18:04:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.750+0000 7fa98e62e740 1 -- start start 2024-04-26T18:04:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.750+0000 7fa98e62e740 1 Processor -- start 2024-04-26T18:04:42.751 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.750+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.750+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa98e62e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ae14b5ad0 con 0x556ae14a8820 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa98e62e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x556ae1395b60 con 0x556ae14a7f00 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa988dd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa988dd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56148/0 (socket says 172.21.15.92:56148) 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa988dd2640 1 -- 172.21.15.92:0/2497306149 learned_addr learned my addr 172.21.15.92:0/2497306149 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ae14b5c50 con 0x556ae14b30e0 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa98e62e740 10 client.0 _ll_register_callbacks cb 0x556ae13ba2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.751+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 -- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 msgr2=0x556ae14b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 -- 172.21.15.92:0/2497306149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 msgr2=0x556ae14b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 -- 172.21.15.92:0/2497306149 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae1120210 con 0x556ae14b30e0 2024-04-26T18:04:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14b0c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa98000e5a0 tx=0x7fa980008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aae07c7844b1c40 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.752+0000 7fa96cff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:04:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.753+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980022020 con 0x556ae14b30e0 2024-04-26T18:04:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.753+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa9800144c0 con 0x556ae14b30e0 2024-04-26T18:04:42.754 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.753+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556ae141c070 con 0x556ae14b30e0 2024-04-26T18:04:42.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.753+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa98001a040 con 0x556ae14b30e0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa98e62e740 10 client.25291 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556ae11ec620 con 0x556ae14b30e0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556ae141c070 con 0x556ae14b30e0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fa98002f020 con 0x556ae14b30e0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa98e62e740 10 client.25291 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa98e62e740 10 client.25291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.754+0000 7fa98e62e740 20 client.25291 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.755+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae14c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.755+0000 7fa98e62e740 4 client.25291 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.755+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ae1415ee0 con 0x556ae14c31b0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.755+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae14c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.756+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae14c55a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b9d77548fb2da server_cookie=822acfdd08c07df2 in_seq=0 out_seq=0 2024-04-26T18:04:42.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.756+0000 7fa96cff9640 10 client.25291 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.756+0000 7fa96cff9640 1 -- 172.21.15.92:0/2497306149 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556ae1415ee0 con 0x556ae14c31b0 2024-04-26T18:04:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.757+0000 7fa96cff9640 10 client.25291 handle_command_reply: tid=0 2024-04-26T18:04:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.757+0000 7fa98e62e740 1 client.25291 shutdown 2024-04-26T18:04:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.757+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 msgr2=0x556ae14b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.757+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14b0c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa98000e5a0 tx=0x7fa980008040 comp rx=0 tx=0).stop 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.757+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 shutdown_connections 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae14c55a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14b0c40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa96cff9640 0 client.25291 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2497306149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 >> 172.21.15.92:0/2497306149 conn(0x556ae14a4410 msgr2=0x556ae14aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 shutdown_connections 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 1 -- 172.21.15.92:0/2497306149 wait complete. 2024-04-26T18:04:42.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.758+0000 7fa98e62e740 20 client.25291 trim_cache size 0 max 16384 2024-04-26T18:04:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 Processor -- start 2024-04-26T18:04:42.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 -- start start 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a8820 0x556ae14a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa98e62e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b7420 con 0x556ae14a7f00 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.775+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa98e62e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b4c90 con 0x556ae14b30e0 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa98e62e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b2b00 con 0x556ae14a8820 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56154/0 (socket says 172.21.15.92:56154) 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 -- 172.21.15.92:0/3867941725 learned_addr learned my addr 172.21.15.92:0/3867941725 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa988dd2640 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a8820 0x556ae14a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa989dd4640 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 -- 172.21.15.92:0/3867941725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a8820 msgr2=0x556ae14a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a8820 0x556ae14a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 -- 172.21.15.92:0/3867941725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 msgr2=0x556ae14caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 -- 172.21.15.92:0/3867941725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae14c5910 con 0x556ae14a7f00 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa9895d3640 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9740bcec0 tx=0x7fa97402e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a223b18d2239f28 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa96effd640 1 -- 172.21.15.92:0/3867941725 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97404c120 con 0x556ae14a7f00 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa96effd640 1 -- 172.21.15.92:0/3867941725 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9740c0bf0 con 0x556ae14a7f00 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.776+0000 7fa96effd640 1 -- 172.21.15.92:0/3867941725 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9740bfe50 con 0x556ae14a7f00 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- 172.21.15.92:0/3867941725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 msgr2=0x556ae14be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9740bcec0 tx=0x7fa97402e620 comp rx=0 tx=0).stop 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- 172.21.15.92:0/3867941725 shutdown_connections 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14b30e0 0x556ae14caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14a8820 0x556ae14a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 --2- 172.21.15.92:0/3867941725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a7f00 0x556ae14be870 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- 172.21.15.92:0/3867941725 >> 172.21.15.92:0/3867941725 conn(0x556ae14a4410 msgr2=0x556ae149f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- 172.21.15.92:0/3867941725 shutdown_connections 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- 172.21.15.92:0/3867941725 wait complete. 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 -- start start 2024-04-26T18:04:42.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.777+0000 7fa98e62e740 1 Processor -- start 2024-04-26T18:04:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14bafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b3150 con 0x556ae14a8820 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56162/0 (socket says 172.21.15.92:56162) 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 -- 172.21.15.92:0/2326630270 learned_addr learned my addr 172.21.15.92:0/2326630270 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b45c0 con 0x556ae14a7f00 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b3820 con 0x556ae14b30e0 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa98e62e740 10 client.0 _ll_register_callbacks cb 0x7fa98000b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14bafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 -- 172.21.15.92:0/2326630270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 msgr2=0x556ae14acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 -- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 msgr2=0x556ae14bafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14bafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa988dd2640 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae14ad590 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.778+0000 7fa989dd4640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa988dd2640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x556ae14b1790 tx=0x7fa97c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a002d857b5f2e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c018030 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fa97c00f040 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9740c0bf0 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa97c007e30 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 10 client.15858 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556ae15295f0 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9740c0bf0 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fa97c025050 con 0x556ae14a8820 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 10 client.15858 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:42.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 20 client.15858 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae152be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 4 client.15858 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.779+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ae13915f0 con 0x556ae14c31b0 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.780+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae152be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.780+0000 7fa96cff9640 10 client.15858 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:42.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.780+0000 7fa9895d3640 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae152be10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5868ea32be2d2d07 server_cookie=85cb702cc7378725 in_seq=0 out_seq=0 2024-04-26T18:04:42.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.790+0000 7fa96cff9640 1 -- 172.21.15.92:0/2326630270 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ae13915f0 con 0x556ae14c31b0 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.790+0000 7fa96cff9640 10 client.15858 handle_command_reply: tid=0 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 client.15858 shutdown 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 msgr2=0x556ae14aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x556ae14b1790 tx=0x7fa97c011d40 comp rx=0 tx=0).stop 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 shutdown_connections 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556ae14c31b0 0x556ae152be10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ae14b30e0 0x556ae14acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa96cff9640 0 client.15858 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ae14a8820 0x556ae14aca10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 --2- 172.21.15.92:0/2326630270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ae14a7f00 0x556ae14bafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 >> 172.21.15.92:0/2326630270 conn(0x556ae14a4410 msgr2=0x556ae14a98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.792 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 shutdown_connections 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 1 -- 172.21.15.92:0/2326630270 wait complete. 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98e62e740 20 client.15858 trim_cache size 0 max 16384 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:04:42.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 msgr2=0x7fa9700a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.791+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 0x7fa9700a64b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa98000b910 tx=0x7fa980004750 comp rx=0 tx=0).stop 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 msgr2=0x7fa984074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa97402ec10 tx=0x7fa974004850 comp rx=0 tx=0).stop 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 shutdown_connections 2024-04-26T18:04:42.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa9700a3ff0 0x7fa9700a64b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa984107820 0x7fa98406e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa984102220 0x7fa98406e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 --2- 172.21.15.92:0/867306607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa984101860 0x7fa984074220 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 >> 172.21.15.92:0/867306607 conn(0x7fa9840789b0 msgr2=0x7fa9841043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 shutdown_connections 2024-04-26T18:04:42.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:42.792+0000 7fa98b837640 1 -- 172.21.15.92:0/867306607 wait complete. 2024-04-26T18:04:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:42 smithi189 ceph-mon[32756]: pgmap v155: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-04-26T18:04:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:42 smithi156 ceph-mon[32679]: pgmap v155: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-04-26T18:04:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:42 smithi092 ceph-mon[29156]: pgmap v155: 97 pgs: 97 active+clean; 2.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2024-04-26T18:04:43.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 270.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:44 smithi189 ceph-mon[32756]: pgmap v156: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-04-26T18:04:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:44 smithi156 ceph-mon[32679]: pgmap v156: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-04-26T18:04:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:44 smithi092 ceph-mon[29156]: pgmap v156: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.2 MiB/s wr, 541 op/s 2024-04-26T18:04:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:46 smithi189 ceph-mon[32756]: pgmap v157: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 769 op/s 2024-04-26T18:04:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:04:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:46 smithi156 ceph-mon[32679]: pgmap v157: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 769 op/s 2024-04-26T18:04:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:04:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:46 smithi092 ceph-mon[29156]: pgmap v157: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 769 op/s 2024-04-26T18:04:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:04:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:04:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:04:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:04:48.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 275.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:49.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:04:49.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:49 smithi092 ceph-mon[29156]: pgmap v158: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:49 smithi189 ceph-mon[32756]: pgmap v158: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:49 smithi156 ceph-mon[32679]: pgmap v158: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:49.853 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:51.545 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:51 smithi092 ceph-mon[29156]: pgmap v159: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-04-26T18:04:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:51 smithi189 ceph-mon[32756]: pgmap v159: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-04-26T18:04:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:51 smithi156 ceph-mon[32679]: pgmap v159: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.765+0000 7fcfa9228700 1 -- 172.21.15.92:0/3026231253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4108370 msgr2=0x7fcfa406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.765+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3026231253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4108370 0x7fcfa406bb90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009990 tx=0x7fcf94009ca0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.765+0000 7fcfa9228700 1 -- 172.21.15.92:0/3026231253 shutdown_connections 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3026231253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa4105e90 0x7fcfa4106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3026231253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4108370 0x7fcfa406bb90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3026231253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa406c0d0 0x7fcfa406c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 -- 172.21.15.92:0/3026231253 >> 172.21.15.92:0/3026231253 conn(0x7fcfa4078390 msgr2=0x7fcfa40787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:51.766 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 -- 172.21.15.92:0/3026231253 shutdown_connections 2024-04-26T18:04:51.767 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 -- 172.21.15.92:0/3026231253 wait complete. 2024-04-26T18:04:51.768 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 Processor -- start 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.766+0000 7fcfa9228700 1 -- start start 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa406c0d0 0x7fcfa41a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 0x7fcfa41a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4119c20 con 0x7fcfa4105e90 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4119aa0 con 0x7fcfa406c0d0 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa9228700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4119da0 con 0x7fcfa4108370 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52392/0 (socket says 172.21.15.92:52392) 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 -- 172.21.15.92:0/3635535521 learned_addr learned my addr 172.21.15.92:0/3635535521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa2d9d700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa406c0d0 0x7fcfa41a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa359e700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 0x7fcfa41a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 -- 172.21.15.92:0/3635535521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 msgr2=0x7fcfa41a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:51.769 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 0x7fcfa41a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 -- 172.21.15.92:0/3635535521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa406c0d0 msgr2=0x7fcfa41a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa406c0d0 0x7fcfa41a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 -- 172.21.15.92:0/3635535521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41a5100 con 0x7fcfa4105e90 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa359e700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 0x7fcfa41a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.767+0000 7fcfa259c700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800b530 tx=0x7fcf9800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.768+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98015020 con 0x7fcfa4105e90 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.768+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41a53f0 con 0x7fcfa4105e90 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.768+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf98011ce0 con 0x7fcfa4105e90 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.768+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98010e40 con 0x7fcfa4105e90 2024-04-26T18:04:51.770 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.768+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41acc70 con 0x7fcfa4105e90 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.769+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa4102970 con 0x7fcfa4105e90 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.770+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fcf98018020 con 0x7fcfa4105e90 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.770+0000 7fcf8bfff700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 0x7fcf8c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.770+0000 7fcfa2d9d700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 0x7fcf8c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.770+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fcf980d0440 con 0x7fcfa4105e90 2024-04-26T18:04:51.771 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.771+0000 7fcfa2d9d700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 0x7fcf8c0a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009750 tx=0x7fcf94005fd0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:51.774 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:51.774+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fcf9801f020 con 0x7fcfa4105e90 2024-04-26T18:04:52.029 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.029+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcfa406a110 con 0x7fcfa4105e90 2024-04-26T18:04:52.030 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.030+0000 7fcf8bfff700 1 -- 172.21.15.92:0/3635535521 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11886 (secure 0 0 0) 0x7fcfa406a110 con 0x7fcfa4105e90 2024-04-26T18:04:52.030 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:04:52.030 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:03:13.093720+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24406},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24406":{"gid":24406,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.189:6839/915245244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":915245244},{"type":"v1","addr":"172.21.15.189:6839","nonce":915245244}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24406,24419,24437]},"id":1}]} 2024-04-26T18:04:52.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 msgr2=0x7fcf8c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:52.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 0x7fcf8c0a6270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009750 tx=0x7fcf94005fd0 comp rx=0 tx=0).stop 2024-04-26T18:04:52.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 msgr2=0x7fcfa41a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800b530 tx=0x7fcf9800b840 comp rx=0 tx=0).stop 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 shutdown_connections 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fcf8c0a3db0 0x7fcf8c0a6270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfa406c0d0 0x7fcfa41a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcfa4108370 0x7fcfa41a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 --2- 172.21.15.92:0/3635535521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfa4105e90 0x7fcfa41a0630 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 >> 172.21.15.92:0/3635535521 conn(0x7fcfa4078390 msgr2=0x7fcfa4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 shutdown_connections 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:52.032+0000 7fcfa9228700 1 -- 172.21.15.92:0/3635535521 wait complete. 2024-04-26T18:04:52.033 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 32 2024-04-26T18:04:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:52 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/3635535521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:52 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/3635535521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:52.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:52 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/3635535521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:04:53.183 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db --set-id 2e112b0c --release --await' 2024-04-26T18:04:53.183 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db --set-id 2e112b0c --release --await 2024-04-26T18:04:53.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 280.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:04:53.467 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:04:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:53 smithi092 ceph-mon[29156]: pgmap v160: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:53 smithi189 ceph-mon[32756]: pgmap v160: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:53 smithi156 ceph-mon[32679]: pgmap v160: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 628 op/s 2024-04-26T18:04:55.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 -- 172.21.15.92:0/1103189978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd130103e90 msgr2=0x7fd130110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 --2- 172.21.15.92:0/1103189978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd130103e90 0x7fd130110360 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b0a0 tx=0x7fd12800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 -- 172.21.15.92:0/1103189978 shutdown_connections 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 --2- 172.21.15.92:0/1103189978 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd130103e90 0x7fd130110360 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 --2- 172.21.15.92:0/1103189978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd1301095d0 0x7fd1301099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 --2- 172.21.15.92:0/1103189978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301034d0 0x7fd130103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 -- 172.21.15.92:0/1103189978 >> 172.21.15.92:0/1103189978 conn(0x7fd13007a5d0 msgr2=0x7fd13007a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 -- 172.21.15.92:0/1103189978 shutdown_connections 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.239+0000 7fd136357700 1 -- 172.21.15.92:0/1103189978 wait complete. 2024-04-26T18:04:55.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 Processor -- start 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 -- start start 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd130103e90 0x7fd13019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 0x7fd130199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd130113720 con 0x7fd1301034d0 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301135a0 con 0x7fd1301095d0 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd136357700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301138a0 con 0x7fd130103e90 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53280/0 (socket says 172.21.15.92:53280) 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd12ffff700 1 -- 172.21.15.92:0/3225962078 learned_addr learned my addr 172.21.15.92:0/3225962078 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd130103e90 0x7fd13019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.240+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 0x7fd130199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 -- 172.21.15.92:0/3225962078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd130103e90 msgr2=0x7fd13019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.243 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd130103e90 0x7fd13019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 -- 172.21.15.92:0/3225962078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 msgr2=0x7fd130199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 0x7fd130199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 -- 172.21.15.92:0/3225962078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13019a0e0 con 0x7fd1301034d0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 0x7fd130199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b530 tx=0x7fd12000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12d7fa700 1 -- 172.21.15.92:0/3225962078 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120015020 con 0x7fd1301034d0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12d7fa700 1 -- 172.21.15.92:0/3225962078 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd120011ce0 con 0x7fd1301034d0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13019a3d0 con 0x7fd1301034d0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd12d7fa700 1 -- 172.21.15.92:0/3225962078 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120010e40 con 0x7fd1301034d0 2024-04-26T18:04:55.244 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.241+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1301a6690 con 0x7fd1301034d0 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.243+0000 7fd12d7fa700 1 -- 172.21.15.92:0/3225962078 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd120018020 con 0x7fd1301034d0 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd12d7fa700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 0x7fd1180a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 0x7fd1180a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd12d7fa700 1 -- 172.21.15.92:0/3225962078 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd1200cff80 con 0x7fd1301034d0 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 0x7fd1180a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd13007ab40 tx=0x7fd124009190 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd140be9b80 1 Processor -- start 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.244+0000 7fd140be9b80 1 -- start start 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x563615552280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x56361554c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56361549e930 con 0x56361554c870 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563615404a30 con 0x563615551ea0 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd140be9b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56361549a8f0 con 0x5636155527c0 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53296/0 (socket says 172.21.15.92:53296) 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 -- 172.21.15.92:0/3009410884 learned_addr learned my addr 172.21.15.92:0/3009410884 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x563615552280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x56361554c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 -- 172.21.15.92:0/3009410884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 msgr2=0x56361554c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x56361554c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 -- 172.21.15.92:0/3009410884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 msgr2=0x563615552280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x563615552280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 -- 172.21.15.92:0/3009410884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636153eb9d0 con 0x56361554c870 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd128009260 tx=0x7fd128009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9dbfd0fcc32026 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1167fc700 1 -- 172.21.15.92:0/3009410884 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128022070 con 0x56361554c870 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1167fc700 1 -- 172.21.15.92:0/3009410884 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd128004c50 con 0x56361554c870 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.245+0000 7fd1167fc700 1 -- 172.21.15.92:0/3009410884 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12801c6a0 con 0x56361554c870 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 -- 172.21.15.92:0/3009410884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 msgr2=0x56361554ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd128009260 tx=0x7fd128009290 comp rx=0 tx=0).stop 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 -- 172.21.15.92:0/3009410884 shutdown_connections 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x563615552280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554ccd0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3009410884 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x56361554c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 -- 172.21.15.92:0/3009410884 >> 172.21.15.92:0/3009410884 conn(0x56361547a6c0 msgr2=0x563615547000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 -- 172.21.15.92:0/3009410884 shutdown_connections 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.246+0000 7fd140be9b80 1 -- 172.21.15.92:0/3009410884 wait complete. 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 -- start start 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 Processor -- start 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x563615558430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x563615555d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5636155591d0 con 0x563615551ea0 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563615458b80 con 0x5636155527c0 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563615559350 con 0x56361554c870 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd140be9b80 10 client.0 _ll_register_callbacks cb 0x563615436a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53302/0 (socket says 172.21.15.92:53302) 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 -- 172.21.15.92:0/3250403761 learned_addr learned my addr 172.21.15.92:0/3250403761 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd1348f4700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x563615555d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x563615558430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 -- 172.21.15.92:0/3250403761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 msgr2=0x563615558430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x563615558430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 -- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 msgr2=0x563615555d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x563615555d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.247+0000 7fd12f7fe700 1 -- 172.21.15.92:0/3250403761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361545c580 con 0x563615551ea0 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd124015700 tx=0x7fd124004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a951dcd1d5c39d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.254 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124025020 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd124015bc0 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd128004c50 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd124030050 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 10 client.15876 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563615563970 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd128004c50 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fd124013450 con 0x563615551ea0 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 10 client.15876 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 10 client.15876 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 20 client.15876 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563615566050 0x563615568470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.255 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 4 client.15876 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.248+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636154ac310 con 0x563615566050 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.249+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563615566050 0x563615568470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.249+0000 7fd10f7fe700 10 client.15876 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.249+0000 7fd12ffff700 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563615566050 0x563615568470 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04bc476db72c37d server_cookie=b03aea5616f480d1 in_seq=0 out_seq=0 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd10f7fe700 1 -- 172.21.15.92:0/3250403761 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5636154ac310 con 0x563615566050 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd10f7fe700 10 client.15876 handle_command_reply: tid=0 2024-04-26T18:04:55.256 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 client.15876 shutdown 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 msgr2=0x5636155557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd124015700 tx=0x7fd124004860 comp rx=0 tx=0).stop 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 shutdown_connections 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563615566050 0x563615568470 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x563615555d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x563615558430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.257 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 --2- 172.21.15.92:0/3250403761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x5636155557d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd10f7fe700 0 client.15876 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 >> 172.21.15.92:0/3250403761 conn(0x56361547a6c0 msgr2=0x56361554b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 shutdown_connections 2024-04-26T18:04:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 1 -- 172.21.15.92:0/3250403761 wait complete. 2024-04-26T18:04:55.258 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.250+0000 7fd140be9b80 20 client.15876 trim_cache size 0 max 16384 2024-04-26T18:04:55.270 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 Processor -- start 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 -- start start 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x5636155620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x563615540d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301b0410 con 0x56361554c870 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301adc40 con 0x563615551ea0 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.269+0000 7fd140be9b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301abaf0 con 0x5636155527c0 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53310/0 (socket says 172.21.15.92:53310) 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 -- 172.21.15.92:0/1204138853 learned_addr learned my addr 172.21.15.92:0/1204138853 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x5636155620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 -- 172.21.15.92:0/1204138853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 msgr2=0x563615540d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x563615540d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 -- 172.21.15.92:0/1204138853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 msgr2=0x5636155620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x5636155620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 -- 172.21.15.92:0/1204138853 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636155537c0 con 0x56361554c870 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd12ffff700 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd120098500 tx=0x7fd120004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87828aad78b53532 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd115ffb700 1 -- 172.21.15.92:0/1204138853 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12009a140 con 0x56361554c870 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd115ffb700 1 -- 172.21.15.92:0/1204138853 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd12009a3a0 con 0x56361554c870 2024-04-26T18:04:55.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.270+0000 7fd115ffb700 1 -- 172.21.15.92:0/1204138853 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1200a4880 con 0x56361554c870 2024-04-26T18:04:55.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- 172.21.15.92:0/1204138853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 msgr2=0x56361554c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.275 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd120098500 tx=0x7fd120004860 comp rx=0 tx=0).stop 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- 172.21.15.92:0/1204138853 shutdown_connections 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5636155527c0 0x563615540d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56361554c870 0x56361554c250 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 --2- 172.21.15.92:0/1204138853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563615551ea0 0x5636155620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- 172.21.15.92:0/1204138853 >> 172.21.15.92:0/1204138853 conn(0x56361547a6c0 msgr2=0x563615540670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- 172.21.15.92:0/1204138853 shutdown_connections 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- 172.21.15.92:0/1204138853 wait complete. 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 -- start start 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.271+0000 7fd140be9b80 1 Processor -- start 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x56361555b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.276 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x5636155cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301ac140 con 0x563615551ea0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301ad570 con 0x5636155527c0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd1301ac7d0 con 0x56361554c870 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 10 client.0 _ll_register_callbacks cb 0x563615436a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53316/0 (socket says 172.21.15.92:53316) 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 -- 172.21.15.92:0/928935994 learned_addr learned my addr 172.21.15.92:0/928935994 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12ffff700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x56361555b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd1348f4700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x5636155cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 -- 172.21.15.92:0/928935994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 msgr2=0x56361555b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.277 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x56361555b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 -- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 msgr2=0x5636155cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x5636155cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 -- 172.21.15.92:0/928935994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361555c3b0 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd1348f4700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x5636155cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd12f7fe700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd12400e4b0 tx=0x7fd124013de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1550c9c6817952 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd10f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124039060 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7fd124021470 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.272+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd12009a3a0 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd124025070 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 10 client.15882 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5636155cdc20 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd12009a3a0 con 0x563615551ea0 2024-04-26T18:04:55.278 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7fd12403c020 con 0x563615551ea0 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 10 client.15882 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 20 client.15882 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5636155ce360 0x5636155d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 4 client.15882 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2e112b0c", "release": true, "await": true}] 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2e112b0c", "release": true, "await": true}) -- 0x5636154a63b0 con 0x5636155ce360 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.273+0000 7fd12ffff700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5636155ce360 0x5636155d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.274+0000 7fd12ffff700 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5636155ce360 0x5636155d0780 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acb903e89a7dd911 server_cookie=82e4303f1aa88104 in_seq=0 out_seq=0 2024-04-26T18:04:55.279 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.274+0000 7fd10f7fe700 10 client.15882 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd10f7fe700 1 -- 172.21.15.92:0/928935994 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5636154a63b0 con 0x5636155ce360 2024-04-26T18:04:55.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd10f7fe700 10 client.15882 handle_command_reply: tid=0 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 client.15882 shutdown 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 msgr2=0x56361555baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd12400e4b0 tx=0x7fd124013de0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 shutdown_connections 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5636155ce360 0x5636155d0780 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636155527c0 0x5636155cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56361554c870 0x56361555b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd140be9b80 1 --2- 172.21.15.92:0/928935994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563615551ea0 0x56361555baf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.318+0000 7fd10f7fe700 0 client.15882 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.319+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 >> 172.21.15.92:0/928935994 conn(0x56361547a6c0 msgr2=0x563615540f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.319+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 shutdown_connections 2024-04-26T18:04:55.320 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.319+0000 7fd140be9b80 1 -- 172.21.15.92:0/928935994 wait complete. 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.319+0000 7fd140be9b80 20 client.15882 trim_cache size 0 max 16384 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 32, 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 16, 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "2e112b0c": { 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 16, 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:04:55.321 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 79.5, 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "RELEASED", 2024-04-26T18:04:55.322 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:04:55.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 msgr2=0x7fd1180a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 0x7fd1180a6270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd13007ab40 tx=0x7fd124009190 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 msgr2=0x7fd13019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd12000b530 tx=0x7fd12000b840 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 shutdown_connections 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd1180a3db0 0x7fd1180a6270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1301095d0 0x7fd130199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1301034d0 0x7fd13019f7c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 --2- 172.21.15.92:0/3225962078 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd130103e90 0x7fd13019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 >> 172.21.15.92:0/3225962078 conn(0x7fd13007a5d0 msgr2=0x7fd130101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 shutdown_connections 2024-04-26T18:04:55.324 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:04:55.320+0000 7fd136357700 1 -- 172.21.15.92:0/3225962078 wait complete. 2024-04-26T18:04:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:55 smithi092 ceph-mon[29156]: pgmap v161: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 631 op/s 2024-04-26T18:04:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:55 smithi189 ceph-mon[32756]: pgmap v161: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 631 op/s 2024-04-26T18:04:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:55 smithi156 ceph-mon[32679]: pgmap v161: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.3 MiB/s wr, 631 op/s 2024-04-26T18:04:55.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.899+0000 7f4c27b1b640 1 -- 172.21.15.92:0/3504763158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c201011f0 msgr2=0x7f4c201015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.899+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/3504763158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c201011f0 0x7f4c201015d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00aa10 tx=0x7f4c1c02b720 comp rx=0 tx=0).stop 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 -- 172.21.15.92:0/3504763158 shutdown_connections 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/3504763158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 0x7f4c2010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/3504763158 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c20101ba0 0x7f4c20105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/3504763158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c201011f0 0x7f4c201015d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 -- 172.21.15.92:0/3504763158 >> 172.21.15.92:0/3504763158 conn(0x7f4c20077dc0 msgr2=0x7f4c200ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 -- 172.21.15.92:0/3504763158 shutdown_connections 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.900+0000 7f4c27b1b640 1 -- 172.21.15.92:0/3504763158 wait complete. 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 Processor -- start 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 -- start start 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 0x7f4c200745f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c2006d290 0x7f4c2006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201109f0 con 0x7f4c2006d290 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20110870 con 0x7f4c201062c0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.901+0000 7f4c27b1b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20110b70 con 0x7f4c201011f0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:39160/0 (socket says 172.21.15.92:39160) 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 -- 172.21.15.92:0/4045413188 learned_addr learned my addr 172.21.15.92:0/4045413188 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c260b8640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c2006d290 0x7f4c2006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c250b6640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 0x7f4c200745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 -- 172.21.15.92:0/4045413188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 msgr2=0x7f4c200745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 0x7f4c200745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 -- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c2006d290 msgr2=0x7f4c2006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c2006d290 0x7f4c2006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 -- 172.21.15.92:0/4045413188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c20071bd0 con 0x7f4c201011f0 2024-04-26T18:04:55.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.902+0000 7f4c258b7640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005ab0 tx=0x7f4c1c003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.903+0000 7f4c16ffd640 1 -- 172.21.15.92:0/4045413188 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c03f070 con 0x7f4c201011f0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.903+0000 7f4c16ffd640 1 -- 172.21.15.92:0/4045413188 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c030e70 con 0x7f4c201011f0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.903+0000 7f4c16ffd640 1 -- 172.21.15.92:0/4045413188 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c036040 con 0x7f4c201011f0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.903+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c20071e60 con 0x7f4c201011f0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.903+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c20072300 con 0x7f4c201011f0 2024-04-26T18:04:55.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.906+0000 7f4c16ffd640 1 -- 172.21.15.92:0/4045413188 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4c1c042070 con 0x7f4c201011f0 2024-04-26T18:04:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.907+0000 7f4c16ffd640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 0x7f4c0c0a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.907+0000 7f4c250b6640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 0x7f4c0c0a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.907+0000 7f4c16ffd640 1 -- 172.21.15.92:0/4045413188 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4c1c0f09e0 con 0x7f4c201011f0 2024-04-26T18:04:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.907+0000 7f4c250b6640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 0x7f4c0c0a63e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c2006e8f0 tx=0x7f4c1000f820 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 Processor -- start 2024-04-26T18:04:55.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 -- start start 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563448e59460 con 0x563448ef2f00 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563448e13590 con 0x563448efe0e0 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c2a832740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563448e55420 con 0x563448ef3820 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53356/0 (socket says 172.21.15.92:53356) 2024-04-26T18:04:55.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 -- 172.21.15.92:0/2596749451 learned_addr learned my addr 172.21.15.92:0/2596749451 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c250b6640 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c260b8640 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 -- 172.21.15.92:0/2596749451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 msgr2=0x563448efdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 -- 172.21.15.92:0/2596749451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 msgr2=0x563448f004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.908+0000 7f4c258b7640 1 -- 172.21.15.92:0/2596749451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563448e200d0 con 0x563448ef2f00 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.909+0000 7f4c258b7640 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0c5130 tx=0x7f4c1c0bc660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2805a4bbf4ee7eb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.909+0000 7f4c0bfff640 1 -- 172.21.15.92:0/2596749451 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c049050 con 0x563448ef2f00 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.909+0000 7f4c0bfff640 1 -- 172.21.15.92:0/2596749451 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c0c0da0 con 0x563448ef2f00 2024-04-26T18:04:55.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.909+0000 7f4c0bfff640 1 -- 172.21.15.92:0/2596749451 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c032620 con 0x563448ef2f00 2024-04-26T18:04:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 -- 172.21.15.92:0/2596749451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 msgr2=0x563448ef32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0c5130 tx=0x7f4c1c0bc660 comp rx=0 tx=0).stop 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 -- 172.21.15.92:0/2596749451 shutdown_connections 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 --2- 172.21.15.92:0/2596749451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef2f00 0x563448ef32e0 secure :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0c5130 tx=0x7f4c1c0bc660 comp rx=0 tx=0).stop 2024-04-26T18:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.913+0000 7f4c2a832740 1 -- 172.21.15.92:0/2596749451 >> 172.21.15.92:0/2596749451 conn(0x563448eef410 msgr2=0x563448eef7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.923+0000 7f4c2a832740 1 -- 172.21.15.92:0/2596749451 shutdown_connections 2024-04-26T18:04:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.924+0000 7f4c2a832740 1 -- 172.21.15.92:0/2596749451 wait complete. 2024-04-26T18:04:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.924+0000 7f4c2a832740 1 -- start start 2024-04-26T18:04:55.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.925+0000 7f4c2a832740 1 Processor -- start 2024-04-26T18:04:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448efb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563448f00ad0 con 0x563448efbe00 2024-04-26T18:04:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563448de0b60 con 0x563448efe0e0 2024-04-26T18:04:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563448f00c50 con 0x563448ef3820 2024-04-26T18:04:55.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.926+0000 7f4c2a832740 10 client.0 _ll_register_callbacks cb 0x563448e052b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.931+0000 7f4c260b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.931+0000 7f4c260b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53370/0 (socket says 172.21.15.92:53370) 2024-04-26T18:04:55.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.931+0000 7f4c260b8640 1 -- 172.21.15.92:0/533758824 learned_addr learned my addr 172.21.15.92:0/533758824 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.933+0000 7f4c250b6640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448efb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.933+0000 7f4c258b7640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.934+0000 7f4c260b8640 1 -- 172.21.15.92:0/533758824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 msgr2=0x563448efb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.934+0000 7f4c260b8640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.934+0000 7f4c260b8640 1 -- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 msgr2=0x563448efb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.934+0000 7f4c260b8640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448efb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.934+0000 7f4c260b8640 1 -- 172.21.15.92:0/533758824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563448b6b210 con 0x563448efbe00 2024-04-26T18:04:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.938+0000 7f4c260b8640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c18012700 tx=0x7f4c18012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d350722b3fc6fbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.939+0000 7f4c097fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:04:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.940+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18010dc0 con 0x563448efbe00 2024-04-26T18:04:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.940+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4c18004b20 con 0x563448efbe00 2024-04-26T18:04:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.941+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c0c0da0 con 0x563448efbe00 2024-04-26T18:04:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.942+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4c18004d20 con 0x563448efbe00 2024-04-26T18:04:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.942+0000 7f4c2a832740 10 client.15894 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.942+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563448c37620 con 0x563448efbe00 2024-04-26T18:04:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c0c0da0 con 0x563448efbe00 2024-04-26T18:04:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f4c18019030 con 0x563448efbe00 2024-04-26T18:04:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 10 client.15894 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 10 client.15894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 20 client.15894 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f0ea60 0x563448f10ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 4 client.15894 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563448e67070 con 0x563448f0ea60 2024-04-26T18:04:55.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.943+0000 7f4c258b7640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f0ea60 0x563448f10ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.945+0000 7f4c258b7640 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f0ea60 0x563448f10ec0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed204e011344d4a8 server_cookie=42d69be823d21438 in_seq=0 out_seq=0 2024-04-26T18:04:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.945+0000 7f4c097fa640 10 client.15894 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.946+0000 7f4c097fa640 1 -- 172.21.15.92:0/533758824 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563448e67070 con 0x563448f0ea60 2024-04-26T18:04:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.946+0000 7f4c097fa640 10 client.15894 handle_command_reply: tid=0 2024-04-26T18:04:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.946+0000 7f4c2a832740 1 client.15894 shutdown 2024-04-26T18:04:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.947+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 msgr2=0x563448f09e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.947+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4c18012700 tx=0x7f4c18012bc0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 shutdown_connections 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f0ea60 0x563448f10ec0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f09e30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448efb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 --2- 172.21.15.92:0/533758824 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448efb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 >> 172.21.15.92:0/533758824 conn(0x563448eef410 msgr2=0x563448ef5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c097fa640 0 client.15894 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.948+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 shutdown_connections 2024-04-26T18:04:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.949+0000 7f4c2a832740 1 -- 172.21.15.92:0/533758824 wait complete. 2024-04-26T18:04:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.950+0000 7f4c2a832740 20 client.15894 trim_cache size 0 max 16384 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 Processor -- start 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 -- start start 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efbe00 0x563448eeed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448efe0e0 0x563448efabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b73e0 con 0x563448ef3820 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b4c50 con 0x563448efbe00 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.972+0000 7f4c2a832740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b2aa0 con 0x563448efe0e0 2024-04-26T18:04:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53378/0 (socket says 172.21.15.92:53378) 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 -- 172.21.15.92:0/3445610734 learned_addr learned my addr 172.21.15.92:0/3445610734 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c260b8640 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448efe0e0 0x563448efabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c250b6640 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efbe00 0x563448eeed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 -- 172.21.15.92:0/3445610734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448efe0e0 msgr2=0x563448efabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448efe0e0 0x563448efabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 -- 172.21.15.92:0/3445610734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efbe00 msgr2=0x563448eeed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efbe00 0x563448eeed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 -- 172.21.15.92:0/3445610734 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563448f00840 con 0x563448ef3820 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c258b7640 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0bc750 tx=0x7f4c1c02b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c141f0e69e7840 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c0b7fe640 1 -- 172.21.15.92:0/3445610734 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0d7070 con 0x563448ef3820 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c0b7fe640 1 -- 172.21.15.92:0/3445610734 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c1c0ee420 con 0x563448ef3820 2024-04-26T18:04:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.973+0000 7f4c0b7fe640 1 -- 172.21.15.92:0/3445610734 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0d5070 con 0x563448ef3820 2024-04-26T18:04:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.974+0000 7f4c2a832740 1 -- 172.21.15.92:0/3445610734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 msgr2=0x563448efdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.974+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0bc750 tx=0x7f4c1c02b720 comp rx=0 tx=0).stop 2024-04-26T18:04:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 -- 172.21.15.92:0/3445610734 shutdown_connections 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448efe0e0 0x563448efabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efbe00 0x563448eeed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3445610734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448ef3820 0x563448efdb00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 -- 172.21.15.92:0/3445610734 >> 172.21.15.92:0/3445610734 conn(0x563448eef410 msgr2=0x563448efd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 -- 172.21.15.92:0/3445610734 shutdown_connections 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.975+0000 7f4c2a832740 1 -- 172.21.15.92:0/3445610734 wait complete. 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 -- start start 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 Processor -- start 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448f05ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f03030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c250b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f03030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f03570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b3110 con 0x563448efbe00 2024-04-26T18:04:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448f05ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c250b6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f03030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53392/0 (socket says 172.21.15.92:53392) 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b4580 con 0x563448efe0e0 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c250b6640 1 -- 172.21.15.92:0/3721696063 learned_addr learned my addr 172.21.15.92:0/3721696063 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c258b7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448f05ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:39190/0 (socket says 172.21.15.92:39190) 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b37e0 con 0x563448ef3820 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c260b8640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f03570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.976+0000 7f4c2a832740 10 client.0 _ll_register_callbacks cb 0x7f4c18009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 -- 172.21.15.92:0/3721696063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 msgr2=0x563448f05ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448f05ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 -- 172.21.15.92:0/3721696063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 msgr2=0x563448f03030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:55.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f03030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 -- 172.21.15.92:0/3721696063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563448f03bb0 con 0x563448efe0e0 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c260b8640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f03570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c180237c0 tx=0x7f4c18009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=517ec577edb2d6e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c097fa640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18031020 con 0x563448efe0e0 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4c18003970 con 0x563448efe0e0 2024-04-26T18:04:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.977+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c0ee420 con 0x563448efe0e0 2024-04-26T18:04:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4c1803c050 con 0x563448efe0e0 2024-04-26T18:04:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 10 client.25418 fetch_fsmap learned FSMap version 32 2024-04-26T18:04:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563448f74e70 con 0x563448efe0e0 2024-04-26T18:04:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c18023ca0 con 0x563448efe0e0 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f4c18019040 con 0x563448efe0e0 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 10 client.25418 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 10 client.25418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 20 client.25418 populate_metadata read hostname 'smithi092' 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f75670 0x563448f77a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 4 client.25418 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f4c1c0ee420 con 0x563448f75670 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.978+0000 7f4c258b7640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f75670 0x563448f77a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.979+0000 7f4c097fa640 10 client.25418 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.979+0000 7f4c258b7640 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f75670 0x563448f77a90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0754826e5d95ad server_cookie=3f723f5ccd73ac43 in_seq=0 out_seq=0 2024-04-26T18:04:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.988+0000 7f4c097fa640 1 -- 172.21.15.92:0/3721696063 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f4c1c0ee420 con 0x563448f75670 2024-04-26T18:04:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.988+0000 7f4c097fa640 10 client.25418 handle_command_reply: tid=0 2024-04-26T18:04:55.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.988+0000 7f4c2a832740 1 client.25418 shutdown 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 msgr2=0x563448f03570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f03570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4c180237c0 tx=0x7f4c18009da0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 shutdown_connections 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563448f75670 0x563448f77a90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563448efe0e0 0x563448f03570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563448efbe00 0x563448f03030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 --2- 172.21.15.92:0/3721696063 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563448ef3820 0x563448f05ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 >> 172.21.15.92:0/3721696063 conn(0x563448eef410 msgr2=0x563448efd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c097fa640 0 client.25418 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.989+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 shutdown_connections 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c2a832740 1 -- 172.21.15.92:0/3721696063 wait complete. 2024-04-26T18:04:55.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c2a832740 20 client.25418 trim_cache size 0 max 16384 2024-04-26T18:04:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:04:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:04:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:04:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:04:55.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 msgr2=0x7f4c0c0a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 0x7f4c0c0a63e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c2006e8f0 tx=0x7f4c1000f820 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 msgr2=0x7f4c200740b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005ab0 tx=0x7f4c1c003cd0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 shutdown_connections 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4c0c0a3f20 0x7f4c0c0a63e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c2006d290 0x7f4c2006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c201062c0 0x7f4c200745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 --2- 172.21.15.92:0/4045413188 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4c201011f0 0x7f4c200740b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.990+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 >> 172.21.15.92:0/4045413188 conn(0x7f4c20077dc0 msgr2=0x7f4c20103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.991+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 shutdown_connections 2024-04-26T18:04:55.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:04:55.991+0000 7f4c27b1b640 1 -- 172.21.15.92:0/4045413188 wait complete. 2024-04-26T18:04:56.036 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2e112b0c', seconds elapsed: 33.3 2024-04-26T18:04:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:57 smithi189 ceph-mon[32756]: pgmap v162: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-04-26T18:04:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:57 smithi156 ceph-mon[32679]: pgmap v162: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-04-26T18:04:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:57 smithi092 ceph-mon[29156]: pgmap v162: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-04-26T18:04:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 285.0 s, 2029.1 tps, lat 286.509 ms stddev 2575.486 2024-04-26T18:04:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:04:59 smithi189 ceph-mon[32756]: pgmap v163: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-04-26T18:04:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:04:59 smithi156 ceph-mon[32679]: pgmap v163: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-04-26T18:04:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:04:59 smithi092 ceph-mon[29156]: pgmap v163: 97 pgs: 97 active+clean; 2.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 KiB/s wr, 6 op/s 2024-04-26T18:05:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:00 smithi092 ceph-mon[29156]: pgmap v164: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-04-26T18:05:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:00 smithi189 ceph-mon[32756]: pgmap v164: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-04-26T18:05:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:00 smithi156 ceph-mon[32679]: pgmap v164: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.1 MiB/s wr, 226 op/s 2024-04-26T18:05:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:02 smithi189 ceph-mon[32756]: pgmap v165: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-04-26T18:05:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:02 smithi156 ceph-mon[32679]: pgmap v165: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-04-26T18:05:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:02 smithi092 ceph-mon[29156]: pgmap v165: 97 pgs: 97 active+clean; 2.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-04-26T18:05:03.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 290.0 s, 2591.2 tps, lat 38.455 ms stddev 49.418 2024-04-26T18:05:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:04 smithi189 ceph-mon[32756]: pgmap v166: 97 pgs: 97 active+clean; 2.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.4 MiB/s wr, 845 op/s 2024-04-26T18:05:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:04 smithi156 ceph-mon[32679]: pgmap v166: 97 pgs: 97 active+clean; 2.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.4 MiB/s wr, 845 op/s 2024-04-26T18:05:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:04 smithi092 ceph-mon[29156]: pgmap v166: 97 pgs: 97 active+clean; 2.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.4 MiB/s wr, 845 op/s 2024-04-26T18:05:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:06 smithi189 ceph-mon[32756]: pgmap v167: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:06 smithi156 ceph-mon[32679]: pgmap v167: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:06 smithi092 ceph-mon[29156]: pgmap v167: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 295.0 s, 3141.4 tps, lat 31.958 ms stddev 33.196 2024-04-26T18:05:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:08 smithi189 ceph-mon[32756]: pgmap v168: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:08 smithi156 ceph-mon[32679]: pgmap v168: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:08 smithi092 ceph-mon[29156]: pgmap v168: 97 pgs: 97 active+clean; 2.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 1.24k op/s 2024-04-26T18:05:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 -- 172.21.15.92:0/148270887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8102220 msgr2=0x7f11f810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/148270887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8102220 0x7f11f810e6e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009ca0 tx=0x7f11f002a8c0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 -- 172.21.15.92:0/148270887 shutdown_connections 2024-04-26T18:05:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/148270887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8102220 0x7f11f810e6e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/148270887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8101860 0x7f11f8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/148270887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8107820 0x7f11f8107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 -- 172.21.15.92:0/148270887 >> 172.21.15.92:0/148270887 conn(0x7f11f80789b0 msgr2=0x7f11f8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 -- 172.21.15.92:0/148270887 shutdown_connections 2024-04-26T18:05:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.130+0000 7f11fdd5f640 1 -- 172.21.15.92:0/148270887 wait complete. 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 Processor -- start 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 -- start start 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 0x7f11f810b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 0x7f11f810bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8110910 con 0x7f11f8107820 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8110790 con 0x7f11f8102220 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11fdd5f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8110a90 con 0x7f11f8101860 2024-04-26T18:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.131+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:50664/0 (socket says 172.21.15.92:50664) 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f77fe640 1 -- 172.21.15.92:0/165275498 learned_addr learned my addr 172.21.15.92:0/165275498 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f7fff640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 0x7f11f810bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 0x7f11f810b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 -- 172.21.15.92:0/165275498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 msgr2=0x7f11f810e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 -- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 msgr2=0x7f11f810bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 0x7f11f810bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f6ffd640 1 -- 172.21.15.92:0/165275498 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f806c350 con 0x7f11f8102220 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f77fe640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.132+0000 7f11f7fff640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 0x7f11f810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 0x7f11f810b6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00e9f0 tx=0x7f11ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11f4ff9640 1 -- 172.21.15.92:0/165275498 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00cd80 con 0x7f11f8102220 2024-04-26T18:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11f4ff9640 1 -- 172.21.15.92:0/165275498 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec0035f0 con 0x7f11f8102220 2024-04-26T18:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f806c640 con 0x7f11f8102220 2024-04-26T18:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11f4ff9640 1 -- 172.21.15.92:0/165275498 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec010690 con 0x7f11f8102220 2024-04-26T18:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.133+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f806cbe0 con 0x7f11f8102220 2024-04-26T18:05:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 Processor -- start 2024-04-26T18:05:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f11f4ff9640 1 -- 172.21.15.92:0/165275498 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f11ec0037a0 con 0x7f11f8102220 2024-04-26T18:05:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 -- start start 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 0x5602d8af52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 0x5602d8b024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5602d8a5b460 con 0x5602d8b000e0 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5602d8a15590 con 0x5602d8af5820 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f1200a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602d8a57420 con 0x5602d8af4f00 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.137+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 0x5602d8b024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:49322/0 (socket says 172.21.15.92:49322) 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 0x5602d8b024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53088/0 (socket says 172.21.15.92:53088) 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 -- 172.21.15.92:0/3171889881 learned_addr learned my addr 172.21.15.92:0/3171889881 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f7fff640 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 0x5602d8af52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 -- 172.21.15.92:0/3171889881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 msgr2=0x5602d8af52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 0x5602d8af52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 -- 172.21.15.92:0/3171889881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 msgr2=0x5602d8b024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 0x5602d8b024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 -- 172.21.15.92:0/3171889881 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d8a220d0 con 0x5602d8af5820 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f7fff640 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 0x5602d8af52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11e80115f0 tx=0x7f11e8011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dba0f650daa2675 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.138+0000 7f11f4ff9640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 0x7f11e00a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.139+0000 7f11ddffb640 1 -- 172.21.15.92:0/3171889881 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e801e070 con 0x5602d8af5820 2024-04-26T18:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.139+0000 7f11f7fff640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 0x7f11e00a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.139+0000 7f11f4ff9640 1 -- 172.21.15.92:0/165275498 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f11ec0d0a30 con 0x7f11f8102220 2024-04-26T18:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.139+0000 7f11ddffb640 1 -- 172.21.15.92:0/3171889881 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11e800fda0 con 0x5602d8af5820 2024-04-26T18:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.139+0000 7f11ddffb640 1 -- 172.21.15.92:0/3171889881 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e800e3b0 con 0x5602d8af5820 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 -- 172.21.15.92:0/3171889881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 msgr2=0x5602d8affba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11e80115f0 tx=0x7f11e8011ab0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f11f7fff640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 0x7f11e00a63d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11f0004ad0 tx=0x7f11f0004a40 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 -- 172.21.15.92:0/3171889881 shutdown_connections 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8b000e0 0x5602d8b024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af5820 0x5602d8affba0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3171889881 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8af4f00 0x5602d8af52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 -- 172.21.15.92:0/3171889881 >> 172.21.15.92:0/3171889881 conn(0x5602d8af1410 msgr2=0x5602d8af17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 -- 172.21.15.92:0/3171889881 shutdown_connections 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.140+0000 7f1200a7c740 1 -- 172.21.15.92:0/3171889881 wait complete. 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 -- start start 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 Processor -- start 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8afd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8afdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5602d8b02d10 con 0x5602d8af5820 2024-04-26T18:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5602d89e2b60 con 0x5602d8af4f00 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5602d8b02e90 con 0x5602d8b000e0 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f1200a7c740 10 client.0 _ll_register_callbacks cb 0x5602d8a072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53100/0 (socket says 172.21.15.92:53100) 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.141+0000 7f11f6ffd640 1 -- 172.21.15.92:0/2648608917 learned_addr learned my addr 172.21.15.92:0/2648608917 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 -- 172.21.15.92:0/2648608917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 msgr2=0x5602d8afdc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8afdc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 -- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 msgr2=0x5602d8afd180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8afd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 -- 172.21.15.92:0/2648608917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d876d210 con 0x5602d8af5820 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c6a0 tx=0x7f11ec09c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fad2d6dc665a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.142+0000 7f11d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:05:09.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.143+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec09d0e0 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.143+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f11ec0ce410 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11e800fda0 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f11ec09c9e0 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 10 client.15912 fetch_fsmap learned FSMap version 32 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5602d8839620 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11e800fda0 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f11ec0bbba0 con 0x5602d8af5820 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 10 client.15912 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 20 client.15912 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b10280 0x5602d8b12670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 4 client.15912 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:09.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.144+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602d8a69070 con 0x5602d8b10280 2024-04-26T18:05:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.146+0000 7f11f77fe640 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b10280 0x5602d8b12670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.146+0000 7f11d6ffd640 10 client.15912 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.146+0000 7f11f77fe640 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b10280 0x5602d8b12670 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f98ac8cc28ba5c server_cookie=db5db785de04103d in_seq=0 out_seq=0 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.147+0000 7f11d6ffd640 1 -- 172.21.15.92:0/2648608917 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5602d8a69070 con 0x5602d8b10280 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.147+0000 7f11d6ffd640 10 client.15912 handle_command_reply: tid=0 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.147+0000 7f1200a7c740 1 client.15912 shutdown 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 msgr2=0x5602d8afd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00c6a0 tx=0x7f11ec09c870 comp rx=0 tx=0).stop 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 shutdown_connections 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b10280 0x5602d8b12670 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8afdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8afd6c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 --2- 172.21.15.92:0/2648608917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8afd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 >> 172.21.15.92:0/2648608917 conn(0x5602d8af1410 msgr2=0x5602d8af7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f11d6ffd640 0 client.15912 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.148+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 shutdown_connections 2024-04-26T18:05:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.149+0000 7f1200a7c740 1 -- 172.21.15.92:0/2648608917 wait complete. 2024-04-26T18:05:09.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.149+0000 7f1200a7c740 20 client.15912 trim_cache size 0 max 16384 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.173+0000 7f1200a7c740 1 Processor -- start 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.173+0000 7f1200a7c740 1 -- start start 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.173+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8af0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.173+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8b17ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f1200a7c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81bfb00 con 0x5602d8af5820 2024-04-26T18:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f1200a7c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81bd370 con 0x5602d8af4f00 2024-04-26T18:05:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f1200a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8102f90 con 0x5602d8b000e0 2024-04-26T18:05:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53108/0 (socket says 172.21.15.92:53108) 2024-04-26T18:05:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3885196847 learned_addr learned my addr 172.21.15.92:0/3885196847 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8af0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3885196847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 msgr2=0x5602d8b17ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8b17ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3885196847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 msgr2=0x5602d8af0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8af0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3885196847 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d8afc170 con 0x5602d8af5820 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.174+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0a5120 tx=0x7f11ec003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44b332df8f1119b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.175+0000 7f11dd7fa640 1 -- 172.21.15.92:0/3885196847 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec09d0e0 con 0x5602d8af5820 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.175+0000 7f11dd7fa640 1 -- 172.21.15.92:0/3885196847 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec0a0d90 con 0x5602d8af5820 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.175+0000 7f11dd7fa640 1 -- 172.21.15.92:0/3885196847 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0bbba0 con 0x5602d8af5820 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- 172.21.15.92:0/3885196847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 msgr2=0x5602d8af78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0a5120 tx=0x7f11ec003d90 comp rx=0 tx=0).stop 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- 172.21.15.92:0/3885196847 shutdown_connections 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b000e0 0x5602d8b17ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af5820 0x5602d8af78c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3885196847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8af4f00 0x5602d8af0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- 172.21.15.92:0/3885196847 >> 172.21.15.92:0/3885196847 conn(0x5602d8af1410 msgr2=0x5602d8aff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- 172.21.15.92:0/3885196847 shutdown_connections 2024-04-26T18:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- 172.21.15.92:0/3885196847 wait complete. 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.176+0000 7f1200a7c740 1 -- start start 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.177+0000 7f1200a7c740 1 Processor -- start 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.177+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 0x5602d8afa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.177+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.177+0000 7f1200a7c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b73750 0x5602d8b75b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.177+0000 7f1200a7c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80739a0 con 0x5602d8af4f00 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f1200a7c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81bcca0 con 0x5602d8b000e0 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f1200a7c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8074050 con 0x5602d8b73750 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f1200a7c740 10 client.0 _ll_register_callbacks cb 0x7f11ec0985f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 0x5602d8afa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:49346/0 (socket says 172.21.15.92:49346) 2024-04-26T18:05:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 0x5602d8afa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53124/0 (socket says 172.21.15.92:53124) 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3826938004 learned_addr learned my addr 172.21.15.92:0/3826938004 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f7fff640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b73750 0x5602d8b75b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3826938004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b73750 msgr2=0x5602d8b75b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b73750 0x5602d8b75b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3826938004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 msgr2=0x5602d8afa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 0x5602d8afa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 -- 172.21.15.92:0/3826938004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d8b760b0 con 0x5602d8b000e0 2024-04-26T18:05:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11f6ffd640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0d62d0 tx=0x7f11ec098d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab8b88257d03487e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.178+0000 7f11d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.179+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec09d0e0 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.179+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f11ec099050 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.179+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11ec0a0d90 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f11ec0870b0 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 10 client.25433 fetch_fsmap learned FSMap version 32 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5602d8b773c0 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec0a0d90 con 0x5602d8b000e0 2024-04-26T18:05:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) ==== 8346+0+0 (secure 0 0 0) 0x7f11ec0a1f20 con 0x5602d8b000e0 2024-04-26T18:05:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 10 client.25433 fetch_fsmap finished waiting for FSMap version 32 2024-04-26T18:05:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 10 client.25433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:09.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 20 client.25433 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b77700 0x5602d8b79af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 4 client.25433 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.180+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602d8a62ee0 con 0x5602d8b77700 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.181+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b77700 0x5602d8b79af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.181+0000 7f11d6ffd640 10 client.25433 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.181+0000 7f11f77fe640 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b77700 0x5602d8b79af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd18fc49b2563eac server_cookie=26458f76a885c64f in_seq=0 out_seq=0 2024-04-26T18:05:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.191+0000 7f11d6ffd640 1 -- 172.21.15.92:0/3826938004 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602d8a62ee0 con 0x5602d8b77700 2024-04-26T18:05:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f11d6ffd640 10 client.25433 handle_command_reply: tid=0 2024-04-26T18:05:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 client.25433 shutdown 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 msgr2=0x5602d8afab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0d62d0 tx=0x7f11ec098d10 comp rx=0 tx=0).stop 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 shutdown_connections 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5602d8b77700 0x5602d8b79af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5602d8b73750 0x5602d8b75b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5602d8b000e0 0x5602d8afab20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 --2- 172.21.15.92:0/3826938004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5602d8af4f00 0x5602d8afa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f11d6ffd640 0 client.25433 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 >> 172.21.15.92:0/3826938004 conn(0x5602d8af1410 msgr2=0x5602d8afe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 shutdown_connections 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.192+0000 7f1200a7c740 1 -- 172.21.15.92:0/3826938004 wait complete. 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f1200a7c740 20 client.25433 trim_cache size 0 max 16384 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:05:09.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 msgr2=0x7f11e00a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 0x7f11e00a63d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f11f0004ad0 tx=0x7f11f0004a40 comp rx=0 tx=0).stop 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 msgr2=0x7f11f810b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 0x7f11f810b6e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00e9f0 tx=0x7f11ec00eeb0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 shutdown_connections 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f11e00a3f10 0x7f11e00a63d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11f8107820 0x7f11f810bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11f8102220 0x7f11f810b6e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 --2- 172.21.15.92:0/165275498 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f11f8101860 0x7f11f810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 >> 172.21.15.92:0/165275498 conn(0x7f11f80789b0 msgr2=0x7f11f81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.193+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 shutdown_connections 2024-04-26T18:05:09.195 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:09.194+0000 7f11fdd5f640 1 -- 172.21.15.92:0/165275498 wait complete. 2024-04-26T18:05:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:10 smithi189 ceph-mon[32756]: pgmap v169: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-04-26T18:05:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:10 smithi156 ceph-mon[32679]: pgmap v169: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-04-26T18:05:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:10 smithi092 ceph-mon[29156]: pgmap v169: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 1.58k op/s 2024-04-26T18:05:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:12 smithi189 ceph-mon[32756]: pgmap v170: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 1.36k op/s 2024-04-26T18:05:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:12 smithi156 ceph-mon[32679]: pgmap v170: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 1.36k op/s 2024-04-26T18:05:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:12 smithi092 ceph-mon[29156]: pgmap v170: 97 pgs: 97 active+clean; 2.7 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 1.36k op/s 2024-04-26T18:05:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 300.0 s, 3481.0 tps, lat 28.727 ms stddev 33.152 2024-04-26T18:05:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:05:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:05:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:05:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:14 smithi189 ceph-mon[32756]: pgmap v171: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 33 MiB/s wr, 1.62k op/s 2024-04-26T18:05:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:14 smithi156 ceph-mon[32679]: pgmap v171: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 33 MiB/s wr, 1.62k op/s 2024-04-26T18:05:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:14 smithi092 ceph-mon[29156]: pgmap v171: 97 pgs: 97 active+clean; 2.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 33 MiB/s wr, 1.62k op/s 2024-04-26T18:05:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:16 smithi189 ceph-mon[32756]: pgmap v172: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 1.14k op/s 2024-04-26T18:05:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:16 smithi156 ceph-mon[32679]: pgmap v172: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 1.14k op/s 2024-04-26T18:05:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:16 smithi092 ceph-mon[29156]: pgmap v172: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 35 MiB/s wr, 1.14k op/s 2024-04-26T18:05:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 305.0 s, 3800.4 tps, lat 26.149 ms stddev 31.444 2024-04-26T18:05:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:18 smithi189 ceph-mon[32756]: pgmap v173: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 30 MiB/s wr, 744 op/s 2024-04-26T18:05:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:18 smithi156 ceph-mon[32679]: pgmap v173: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 30 MiB/s wr, 744 op/s 2024-04-26T18:05:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:18 smithi092 ceph-mon[29156]: pgmap v173: 97 pgs: 97 active+clean; 2.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 30 MiB/s wr, 744 op/s 2024-04-26T18:05:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:20 smithi189 ceph-mon[32756]: pgmap v174: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 48 MiB/s wr, 1.07k op/s 2024-04-26T18:05:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:20 smithi156 ceph-mon[32679]: pgmap v174: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 48 MiB/s wr, 1.07k op/s 2024-04-26T18:05:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:20 smithi092 ceph-mon[29156]: pgmap v174: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 48 MiB/s wr, 1.07k op/s 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 -- 172.21.15.92:0/3388218961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478102220 msgr2=0x7f547810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3388218961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478102220 0x7f547810e6e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5470009930 tx=0x7f547002a420 comp rx=0 tx=0).stop 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 -- 172.21.15.92:0/3388218961 shutdown_connections 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3388218961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478102220 0x7f547810e6e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3388218961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478101860 0x7f5478101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3388218961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 0x7f5478107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 -- 172.21.15.92:0/3388218961 >> 172.21.15.92:0/3388218961 conn(0x7f54780789b0 msgr2=0x7f5478078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 -- 172.21.15.92:0/3388218961 shutdown_connections 2024-04-26T18:05:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.327+0000 7f547cb2b640 1 -- 172.21.15.92:0/3388218961 wait complete. 2024-04-26T18:05:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 Processor -- start 2024-04-26T18:05:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 -- start start 2024-04-26T18:05:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 0x7f547819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 0x7f54781a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5478111af0 con 0x7f5478101860 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5478111970 con 0x7f5478107820 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547cb2b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5478111c70 con 0x7f5478102220 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 0x7f547819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48274/0 (socket says 172.21.15.92:48274) 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f547659c640 1 -- 172.21.15.92:0/3064265378 learned_addr learned my addr 172.21.15.92:0/3064265378 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.328+0000 7f5476d9d640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 0x7f54781a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 -- 172.21.15.92:0/3064265378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 msgr2=0x7f547819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 0x7f547819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 -- 172.21.15.92:0/3064265378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 msgr2=0x7f54781a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 0x7f54781a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 -- 172.21.15.92:0/3064265378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54781a5410 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f5475d9b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 0x7f547819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547659c640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f546800db80 tx=0x7f546800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f54677fe640 1 -- 172.21.15.92:0/3064265378 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468017070 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f54677fe640 1 -- 172.21.15.92:0/3064265378 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546800be30 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54781a55e0 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f54677fe640 1 -- 172.21.15.92:0/3064265378 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468010460 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.329+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54781a5b80 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.331+0000 7f54677fe640 1 -- 172.21.15.92:0/3064265378 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f5468004020 con 0x7f5478101860 2024-04-26T18:05:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 Processor -- start 2024-04-26T18:05:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 -- start start 2024-04-26T18:05:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249d42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 0x5561249deba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55612493a460 con 0x5561249d4820 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5561248f4590 con 0x5561249df0e0 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547f848740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556124936420 con 0x5561249d3f00 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f54677fe640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 0x7f54600a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:57158/0 (socket says 172.21.15.92:57158) 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f5475d9b640 1 -- 172.21.15.92:0/1229044551 learned_addr learned my addr 172.21.15.92:0/1229044551 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f5476d9d640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 0x7f54600a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f54677fe640 1 -- 172.21.15.92:0/3064265378 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f54680d03f0 con 0x7f5478101860 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f547659c640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 0x5561249deba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.332+0000 7f5476d9d640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249d42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 -- 172.21.15.92:0/1229044551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 msgr2=0x5561249d42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249d42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 -- 172.21.15.92:0/1229044551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 msgr2=0x5561249deba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 0x5561249deba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 -- 172.21.15.92:0/1229044551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561249010d0 con 0x5561249df0e0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f547659c640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 0x5561249deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5476d9d640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 0x7f54600a6300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5470005ab0 tx=0x7f5470005bb0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f546c00f470 tx=0x7f546c00f930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b374027a402b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5464ff9640 1 -- 172.21.15.92:0/1229044551 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c005220 con 0x5561249df0e0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.333+0000 7f5464ff9640 1 -- 172.21.15.92:0/1229044551 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c004c50 con 0x5561249df0e0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f5464ff9640 1 -- 172.21.15.92:0/1229044551 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c010c40 con 0x5561249df0e0 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- 172.21.15.92:0/1229044551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 msgr2=0x5561249e14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f546c00f470 tx=0x7f546c00f930 comp rx=0 tx=0).stop 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- 172.21.15.92:0/1229044551 shutdown_connections 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e14d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d4820 0x5561249deba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- 172.21.15.92:0/1229044551 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249d42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- 172.21.15.92:0/1229044551 >> 172.21.15.92:0/1229044551 conn(0x5561249d0410 msgr2=0x5561249d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- 172.21.15.92:0/1229044551 shutdown_connections 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- 172.21.15.92:0/1229044551 wait complete. 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 -- start start 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 Processor -- start 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.334+0000 7f547f848740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x5561249dc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249dca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5561249e1d10 con 0x5561249df0e0 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5561248c1b60 con 0x5561249d3f00 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5561249e1e90 con 0x5561249d4820 2024-04-26T18:05:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 10 client.0 _ll_register_callbacks cb 0x5561248e62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f5476d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:57174/0 (socket says 172.21.15.92:57174) 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 -- 172.21.15.92:0/1924459963 learned_addr learned my addr 172.21.15.92:0/1924459963 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x5561249dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 -- 172.21.15.92:0/1924459963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 msgr2=0x5561249dc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x5561249dc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 -- 172.21.15.92:0/1924459963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 msgr2=0x5561249dca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249dca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 -- 172.21.15.92:0/1924459963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55612464c210 con 0x5561249d3f00 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f5476d9d640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249dca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547659c640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54680cdbb0 tx=0x7f546801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1bc0bab9a56e593 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f545dffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:05:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680b4070 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f54680bb2a0 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c004c50 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f54680cdfd0 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 10 client.25445 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.335+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556124718620 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f546c004c50 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f546809b7f0 con 0x5561249d3f00 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 10 client.25445 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 10 client.25445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 20 client.25445 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x5561249f1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 4 client.25445 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556124948070 con 0x5561249ef240 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x5561249f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.336+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x5561249f1650 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a77e0903e919a8b server_cookie=b12498e06ed1d54a in_seq=0 out_seq=0 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.337+0000 7f545dffb640 10 client.25445 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.337+0000 7f545dffb640 1 -- 172.21.15.92:0/1924459963 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556124948070 con 0x5561249ef240 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.337+0000 7f545dffb640 10 client.25445 handle_command_reply: tid=0 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.337+0000 7f547f848740 1 client.25445 shutdown 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.338+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 msgr2=0x5561249dbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.338+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f54680cdbb0 tx=0x7f546801c000 comp rx=0 tx=0).stop 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.338+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 shutdown_connections 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.338+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x5561249f1650 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.338+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249dca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f545dffb640 0 client.25445 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x5561249dc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 1 --2- 172.21.15.92:0/1924459963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d3f00 0x5561249dbfc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 >> 172.21.15.92:0/1924459963 conn(0x5561249d0410 msgr2=0x5561249d6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 shutdown_connections 2024-04-26T18:05:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 1 -- 172.21.15.92:0/1924459963 wait complete. 2024-04-26T18:05:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.339+0000 7f547f848740 20 client.25445 trim_cache size 0 max 16384 2024-04-26T18:05:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 Processor -- start 2024-04-26T18:05:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 -- start start 2024-04-26T18:05:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d4820 0x5561249d68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54781b0bd0 con 0x5561249df0e0 2024-04-26T18:05:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ae470 con 0x5561249d4820 2024-04-26T18:05:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547f848740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ac2e0 con 0x5561249d3f00 2024-04-26T18:05:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547659c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37364/0 (socket says 172.21.15.92:37364) 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f547659c640 1 -- 172.21.15.92:0/128799396 learned_addr learned my addr 172.21.15.92:0/128799396 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.365+0000 7f5476d9d640 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f547659c640 1 -- 172.21.15.92:0/128799396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d4820 msgr2=0x5561249d68c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f547659c640 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d4820 0x5561249d68c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f547659c640 1 -- 172.21.15.92:0/128799396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 msgr2=0x5561249f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f547659c640 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f547659c640 1 -- 172.21.15.92:0/128799396 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561249d4650 con 0x5561249d3f00 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.366+0000 7f5476d9d640 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.367+0000 7f547659c640 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5468098d70 tx=0x7f5468098ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe43b3e5a4d8d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.367+0000 7f545ffff640 1 -- 172.21.15.92:0/128799396 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680a5010 con 0x5561249d3f00 2024-04-26T18:05:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.367+0000 7f545ffff640 1 -- 172.21.15.92:0/128799396 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54680a0750 con 0x5561249d3f00 2024-04-26T18:05:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.367+0000 7f545ffff640 1 -- 172.21.15.92:0/128799396 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54680980f0 con 0x5561249d3f00 2024-04-26T18:05:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 -- 172.21.15.92:0/128799396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 msgr2=0x5561249eabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5468098d70 tx=0x7f5468098ce0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 -- 172.21.15.92:0/128799396 shutdown_connections 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249df0e0 0x5561249f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249d4820 0x5561249d68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 --2- 172.21.15.92:0/128799396 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d3f00 0x5561249eabd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 -- 172.21.15.92:0/128799396 >> 172.21.15.92:0/128799396 conn(0x5561249d0410 msgr2=0x5561249d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.368+0000 7f547f848740 1 -- 172.21.15.92:0/128799396 shutdown_connections 2024-04-26T18:05:22.369 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.369+0000 7f547f848740 1 -- 172.21.15.92:0/128799396 wait complete. 2024-04-26T18:05:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.369+0000 7f547f848740 1 -- start start 2024-04-26T18:05:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.369+0000 7f547f848740 1 Processor -- start 2024-04-26T18:05:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 0x556124a4dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 0x556124a4dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 0x556124a4dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48314/0 (socket says 172.21.15.92:48314) 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f5475d9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37378/0 (socket says 172.21.15.92:37378) 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547659c640 1 -- 172.21.15.92:0/1553575178 learned_addr learned my addr 172.21.15.92:0/1553575178 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ac930 con 0x5561249d3f00 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f54781adda0 con 0x5561249df0e0 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f54781ad000 con 0x5561249d4820 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.371+0000 7f5476d9d640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f547f848740 10 client.0 _ll_register_callbacks cb 0x7f5468009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 -- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 msgr2=0x5561249e60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 -- 172.21.15.92:0/1553575178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 msgr2=0x556124a4dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 0x556124a4dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556124a4ebd0 con 0x5561249d4820 2024-04-26T18:05:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54680a0750 con 0x5561249d4820 2024-04-26T18:05:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f5475d9b640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f546c00f440 tx=0x7f546c005ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd19b3545034e316 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.372+0000 7f545dffb640 10 client.25354 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.373+0000 7f545dffb640 1 -- 172.21.15.92:0/1553575178 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c038050 con 0x5561249d4820 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.373+0000 7f545dffb640 1 -- 172.21.15.92:0/1553575178 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f546c01e040 con 0x5561249d4820 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.373+0000 7f545dffb640 1 -- 172.21.15.92:0/1553575178 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f546c010a70 con 0x5561249d4820 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.373+0000 7f547f848740 10 client.25354 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.373+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5561249e7630 con 0x5561249d4820 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f545dffb640 1 -- 172.21.15.92:0/1553575178 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f546c010c10 con 0x5561249d4820 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 10 client.25354 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 10 client.25354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 20 client.25354 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x556124a603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 4 client.25354 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556124941ee0 con 0x5561249ef240 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.374+0000 7f547659c640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x556124a603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.375+0000 7f547659c640 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x556124a603b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a807b3d6834751d server_cookie=237ba81308c0f630 in_seq=0 out_seq=0 2024-04-26T18:05:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.375+0000 7f545dffb640 10 client.25354 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f545dffb640 1 -- 172.21.15.92:0/1553575178 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556124941ee0 con 0x5561249ef240 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f545dffb640 10 client.25354 handle_command_reply: tid=0 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 client.25354 shutdown 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 msgr2=0x556124a4e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f546c00f440 tx=0x7f546c005ba0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 shutdown_connections 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561249ef240 0x556124a603b0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561249df0e0 0x5561249e60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561249d4820 0x556124a4e320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 --2- 172.21.15.92:0/1553575178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561249d3f00 0x556124a4dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f545dffb640 0 client.25354 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:22.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 >> 172.21.15.92:0/1553575178 conn(0x5561249d0410 msgr2=0x5561249dbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 shutdown_connections 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 1 -- 172.21.15.92:0/1553575178 wait complete. 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.427+0000 7f547f848740 20 client.25354 trim_cache size 0 max 16384 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:05:22.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.428+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 msgr2=0x7f54600a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.428+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 0x7f54600a6300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5470005ab0 tx=0x7f5470005bb0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.428+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 msgr2=0x7f5478199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.428+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f546800db80 tx=0x7f546800df80 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 shutdown_connections 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f54600a3e40 0x7f54600a6300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5478107820 0x7f54781a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5478102220 0x7f547819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 --2- 172.21.15.92:0/3064265378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5478101860 0x7f5478199e50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 >> 172.21.15.92:0/3064265378 conn(0x7f54780789b0 msgr2=0x7f54781042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:22.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 shutdown_connections 2024-04-26T18:05:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:22.429+0000 7f547cb2b640 1 -- 172.21.15.92:0/3064265378 wait complete. 2024-04-26T18:05:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:22 smithi189 ceph-mon[32756]: pgmap v175: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 42 MiB/s wr, 731 op/s 2024-04-26T18:05:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:22 smithi156 ceph-mon[32679]: pgmap v175: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 42 MiB/s wr, 731 op/s 2024-04-26T18:05:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:22 smithi092 ceph-mon[29156]: pgmap v175: 97 pgs: 97 active+clean; 2.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 42 MiB/s wr, 731 op/s 2024-04-26T18:05:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 310.0 s, 4279.2 tps, lat 23.479 ms stddev 27.832 2024-04-26T18:05:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:24 smithi189 ceph-mon[32756]: pgmap v176: 97 pgs: 97 active+clean; 3.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 54 MiB/s wr, 993 op/s 2024-04-26T18:05:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:24 smithi156 ceph-mon[32679]: pgmap v176: 97 pgs: 97 active+clean; 3.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 54 MiB/s wr, 993 op/s 2024-04-26T18:05:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:24 smithi092 ceph-mon[29156]: pgmap v176: 97 pgs: 97 active+clean; 3.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 54 MiB/s wr, 993 op/s 2024-04-26T18:05:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:26 smithi189 ceph-mon[32756]: pgmap v177: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 42 MiB/s wr, 832 op/s 2024-04-26T18:05:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:26 smithi156 ceph-mon[32679]: pgmap v177: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 42 MiB/s wr, 832 op/s 2024-04-26T18:05:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:26 smithi092 ceph-mon[29156]: pgmap v177: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 42 MiB/s wr, 832 op/s 2024-04-26T18:05:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 315.0 s, 3397.0 tps, lat 29.467 ms stddev 60.461 2024-04-26T18:05:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:28 smithi189 ceph-mon[32756]: pgmap v178: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 690 op/s 2024-04-26T18:05:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:28 smithi156 ceph-mon[32679]: pgmap v178: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 690 op/s 2024-04-26T18:05:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:28 smithi092 ceph-mon[29156]: pgmap v178: 97 pgs: 97 active+clean; 3.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 MiB/s wr, 690 op/s 2024-04-26T18:05:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:30 smithi189 ceph-mon[32756]: pgmap v179: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 68 MiB/s wr, 2.08k op/s 2024-04-26T18:05:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:30 smithi156 ceph-mon[32679]: pgmap v179: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 68 MiB/s wr, 2.08k op/s 2024-04-26T18:05:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:30 smithi092 ceph-mon[29156]: pgmap v179: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 68 MiB/s wr, 2.08k op/s 2024-04-26T18:05:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:32 smithi189 ceph-mon[32756]: pgmap v180: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 50 MiB/s wr, 1.75k op/s 2024-04-26T18:05:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:32 smithi156 ceph-mon[32679]: pgmap v180: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 50 MiB/s wr, 1.75k op/s 2024-04-26T18:05:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:32 smithi092 ceph-mon[29156]: pgmap v180: 97 pgs: 97 active+clean; 3.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 50 MiB/s wr, 1.75k op/s 2024-04-26T18:05:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 320.0 s, 4203.0 tps, lat 23.740 ms stddev 26.687 2024-04-26T18:05:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:34 smithi189 ceph-mon[32756]: pgmap v181: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 54 MiB/s wr, 2.07k op/s 2024-04-26T18:05:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:34 smithi156 ceph-mon[32679]: pgmap v181: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 54 MiB/s wr, 2.07k op/s 2024-04-26T18:05:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:34 smithi092 ceph-mon[29156]: pgmap v181: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 54 MiB/s wr, 2.07k op/s 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 -- 172.21.15.92:0/2044592944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce8109930 msgr2=0x7f4ce8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 --2- 172.21.15.92:0/2044592944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce8109930 0x7f4ce8109d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009890 tx=0x7f4cd802a400 comp rx=0 tx=0).stop 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 -- 172.21.15.92:0/2044592944 shutdown_connections 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 --2- 172.21.15.92:0/2044592944 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8115a80 0x7f4ce8117e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 --2- 172.21.15.92:0/2044592944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce810a250 0x7f4ce8115540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 --2- 172.21.15.92:0/2044592944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce8109930 0x7f4ce8109d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 -- 172.21.15.92:0/2044592944 >> 172.21.15.92:0/2044592944 conn(0x7f4ce806de90 msgr2=0x7f4ce806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 -- 172.21.15.92:0/2044592944 shutdown_connections 2024-04-26T18:05:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.564+0000 7f4ced0da640 1 -- 172.21.15.92:0/2044592944 wait complete. 2024-04-26T18:05:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.565+0000 7f4ced0da640 1 Processor -- start 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.565+0000 7f4ced0da640 1 -- start start 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce810a250 0x7f4ce81a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce8115a80 0x7f4ce819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81191c0 con 0x7f4ce8115a80 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8119040 con 0x7f4ce810a250 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ced0da640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8119340 con 0x7f4ce8109930 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:45800/0 (socket says 172.21.15.92:45800) 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 -- 172.21.15.92:0/1974770716 learned_addr learned my addr 172.21.15.92:0/1974770716 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce8115a80 0x7f4ce819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce810a250 0x7f4ce81a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 -- 172.21.15.92:0/1974770716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce810a250 msgr2=0x7f4ce81a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce810a250 0x7f4ce81a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 -- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce8115a80 msgr2=0x7f4ce819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce8115a80 0x7f4ce819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.566+0000 7f4ce6d9d640 1 -- 172.21.15.92:0/1974770716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce819fd40 con 0x7f4ce8109930 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ce6d9d640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009860 tx=0x7f4cd8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ccffff640 1 -- 172.21.15.92:0/1974770716 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8037050 con 0x7f4ce8109930 2024-04-26T18:05:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ccffff640 1 -- 172.21.15.92:0/1974770716 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cd8043070 con 0x7f4ce8109930 2024-04-26T18:05:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce819ffd0 con 0x7f4ce8109930 2024-04-26T18:05:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce81ac2d0 con 0x7f4ce8109930 2024-04-26T18:05:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.567+0000 7f4ccffff640 1 -- 172.21.15.92:0/1974770716 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8030b70 con 0x7f4ce8109930 2024-04-26T18:05:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 Processor -- start 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 -- start start 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ed3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd34e24460 con 0x55dd34ed18f0 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55dd34dde590 con 0x55dd34ec7030 2024-04-26T18:05:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd34e20420 con 0x55dd34ec6710 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.572+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:45810/0 (socket says 172.21.15.92:45810) 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 -- 172.21.15.92:0/1414059754 learned_addr learned my addr 172.21.15.92:0/1414059754 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ccffff640 1 -- 172.21.15.92:0/1974770716 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4cd802bd10 con 0x7f4ce8109930 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 -- 172.21.15.92:0/1414059754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 msgr2=0x55dd34ed13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 -- 172.21.15.92:0/1414059754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 msgr2=0x55dd34ed3ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ed3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 -- 172.21.15.92:0/1414059754 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd34deb0d0 con 0x55dd34ec6710 2024-04-26T18:05:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.573+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000ae10 tx=0x7f4ce000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7852755af9e540f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.574+0000 7f4ccffff640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 0x7f4cd00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.574+0000 7f4ce6d9d640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 0x7f4cd00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.575+0000 7f4ccffff640 1 -- 172.21.15.92:0/1974770716 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4cd80f0720 con 0x7f4ce8109930 2024-04-26T18:05:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.576+0000 7f4ce6d9d640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 0x7f4cd00a6300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55dd34ec7cb0 tx=0x7f4cd80f61a0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.578+0000 7f4ccd7fa640 1 -- 172.21.15.92:0/1414059754 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0003b70 con 0x55dd34ec6710 2024-04-26T18:05:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.578+0000 7f4ccd7fa640 1 -- 172.21.15.92:0/1414059754 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ce0003d10 con 0x55dd34ec6710 2024-04-26T18:05:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.579+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1414059754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 msgr2=0x55dd34ec6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.579+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000ae10 tx=0x7f4ce000f790 comp rx=0 tx=0).stop 2024-04-26T18:05:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.585+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1414059754 shutdown_connections 2024-04-26T18:05:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.585+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ed3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.585+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.585+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1414059754 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ec6af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.585+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1414059754 >> 172.21.15.92:0/1414059754 conn(0x55dd34ec2c20 msgr2=0x55dd34ec3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.588+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1414059754 shutdown_connections 2024-04-26T18:05:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.588+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1414059754 wait complete. 2024-04-26T18:05:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.589+0000 7f4cefdfa740 1 -- start start 2024-04-26T18:05:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.589+0000 7f4cefdfa740 1 Processor -- start 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.591+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34eced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ecf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:45826/0 (socket says 172.21.15.92:45826) 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4ce759e640 1 -- 172.21.15.92:0/1005336327 learned_addr learned my addr 172.21.15.92:0/1005336327 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd34ed4520 con 0x55dd34ed18f0 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55dd34dabb60 con 0x55dd34ec7030 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dd34ed46a0 con 0x55dd34ec6710 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ecf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.592+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34eced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4cefdfa740 10 client.0 _ll_register_callbacks cb 0x55dd34dd02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4ce759e640 1 -- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 msgr2=0x55dd34eced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34eced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4ce759e640 1 -- 172.21.15.92:0/1005336327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 msgr2=0x55dd34ecf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ecf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.593+0000 7f4ce759e640 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd34b36210 con 0x55dd34ec6710 2024-04-26T18:05:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.594+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34eced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:05:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.594+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00106a0 tx=0x7f4ce00048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cebe5145277080 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.595+0000 7f4ccaff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:05:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.595+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce00041d0 con 0x55dd34ec6710 2024-04-26T18:05:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.595+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce0003d10 con 0x55dd34ec6710 2024-04-26T18:05:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.595+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4ce0004370 con 0x55dd34ec6710 2024-04-26T18:05:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.596+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4ce0004570 con 0x55dd34ec6710 2024-04-26T18:05:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.597+0000 7f4cefdfa740 10 client.25363 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.597+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dd34c02620 con 0x55dd34ec6710 2024-04-26T18:05:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.597+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ce0003d10 con 0x55dd34ec6710 2024-04-26T18:05:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.598+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f4ce0031030 con 0x55dd34ec6710 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 10 client.25363 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 10 client.25363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 20 client.25363 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34ee1a40 0x55dd34ee3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 4 client.25363 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.599+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd34e32070 con 0x55dd34ee1a40 2024-04-26T18:05:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.600+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34ee1a40 0x55dd34ee3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.600+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34ee1a40 0x55dd34ee3e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a90edea8fa3f9274 server_cookie=e9da91b071bf3088 in_seq=0 out_seq=0 2024-04-26T18:05:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.600+0000 7f4ccaff5640 10 client.25363 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.601+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1005336327 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dd34e32070 con 0x55dd34ee1a40 2024-04-26T18:05:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.601+0000 7f4ccaff5640 10 client.25363 handle_command_reply: tid=0 2024-04-26T18:05:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.601+0000 7f4cefdfa740 1 client.25363 shutdown 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.602+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 msgr2=0x55dd34ece810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.602+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00106a0 tx=0x7f4ce00048a0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 shutdown_connections 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34ee1a40 0x55dd34ee3e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34ecf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34eced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1005336327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ece810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 >> 172.21.15.92:0/1005336327 conn(0x55dd34ec2c20 msgr2=0x55dd34eb95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4ccaff5640 0 client.25363 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 shutdown_connections 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1005336327 wait complete. 2024-04-26T18:05:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.603+0000 7f4cefdfa740 20 client.25363 trim_cache size 0 max 16384 2024-04-26T18:05:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4cefdfa740 1 Processor -- start 2024-04-26T18:05:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4cefdfa740 1 -- start start 2024-04-26T18:05:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ec7030 0x55dd34ed0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:56762/0 (socket says 172.21.15.92:56762) 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4ce759e640 1 -- 172.21.15.92:0/3748320142 learned_addr learned my addr 172.21.15.92:0/3748320142 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.627+0000 7f4ce659c640 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ec7030 0x55dd34ed0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ed18f0 0x55dd34ee9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b7470 con 0x55dd34ec7030 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b4d10 con 0x55dd34ec6710 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b2b60 con 0x55dd34ed18f0 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ed18f0 0x55dd34ee9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 -- 172.21.15.92:0/3748320142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ed18f0 msgr2=0x55dd34ee9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ed18f0 0x55dd34ee9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 -- 172.21.15.92:0/3748320142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ec7030 msgr2=0x55dd34ed0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ec7030 0x55dd34ed0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 -- 172.21.15.92:0/3748320142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd34ec79c0 con 0x55dd34ec6710 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.628+0000 7f4ce759e640 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0010730 tx=0x7f4ce000a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddf1535ea5cd8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.629+0000 7f4cccff9640 1 -- 172.21.15.92:0/3748320142 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0003d10 con 0x55dd34ec6710 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.629+0000 7f4cccff9640 1 -- 172.21.15.92:0/3748320142 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ce000fc90 con 0x55dd34ec6710 2024-04-26T18:05:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.629+0000 7f4cccff9640 1 -- 172.21.15.92:0/3748320142 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0004290 con 0x55dd34ec6710 2024-04-26T18:05:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 msgr2=0x55dd34edd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0010730 tx=0x7f4ce000a4d0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 shutdown_connections 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ed18f0 0x55dd34ee9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ec7030 0x55dd34ed0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/3748320142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec6710 0x55dd34edd430 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 >> 172.21.15.92:0/3748320142 conn(0x55dd34ec2c20 msgr2=0x55dd34ed0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 shutdown_connections 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.630+0000 7f4cefdfa740 1 -- 172.21.15.92:0/3748320142 wait complete. 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 -- start start 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 Processor -- start 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34f45cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b31d0 con 0x55dd34ed18f0 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b4640 con 0x55dd34ec7030 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b38a0 con 0x55dd34ec6710 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4cefdfa740 10 client.0 _ll_register_callbacks cb 0x7f4ce000ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4ce759e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:45844/0 (socket says 172.21.15.92:45844) 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4ce759e640 1 -- 172.21.15.92:0/1114069058 learned_addr learned my addr 172.21.15.92:0/1114069058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34f45cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.631+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 -- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 msgr2=0x55dd34ed5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 -- 172.21.15.92:0/1114069058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 msgr2=0x55dd34f45cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34f45cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 -- 172.21.15.92:0/1114069058 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd34f46300 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ce759e640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0013020 tx=0x7f4ce002a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fcc01b49605e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ccaff5640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0018c40 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f4ce0003c80 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce000fc90 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4ce0018de0 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4cefdfa740 10 client.25369 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.632+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55dd34f47580 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ce000fc90 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f4ce0031040 con 0x55dd34ec6710 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 10 client.25369 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 10 client.25369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 20 client.25369 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34f47b80 0x55dd34f49fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 4 client.25369 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd34e2bee0 con 0x55dd34f47b80 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.633+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34f47b80 0x55dd34f49fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.634+0000 7f4ce659c640 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34f47b80 0x55dd34f49fa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c64f977f8d8b6543 server_cookie=37940ac3d24e24f7 in_seq=0 out_seq=0 2024-04-26T18:05:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.634+0000 7f4ccaff5640 10 client.25369 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4ccaff5640 1 -- 172.21.15.92:0/1114069058 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd34e2bee0 con 0x55dd34f47b80 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4ccaff5640 10 client.25369 handle_command_reply: tid=0 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 client.25369 shutdown 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 msgr2=0x55dd34ed4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0013020 tx=0x7f4ce002a040 comp rx=0 tx=0).stop 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 shutdown_connections 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dd34f47b80 0x55dd34f49fa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd34ed18f0 0x55dd34f45cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4ccaff5640 0 client.25369 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dd34ec7030 0x55dd34ed5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 --2- 172.21.15.92:0/1114069058 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dd34ec6710 0x55dd34ed4b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.645+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 >> 172.21.15.92:0/1114069058 conn(0x55dd34ec2c20 msgr2=0x55dd34ecf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.646+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 shutdown_connections 2024-04-26T18:05:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.646+0000 7f4cefdfa740 1 -- 172.21.15.92:0/1114069058 wait complete. 2024-04-26T18:05:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.646+0000 7f4cefdfa740 20 client.25369 trim_cache size 0 max 16384 2024-04-26T18:05:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:05:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:05:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:05:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:05:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 msgr2=0x7f4cd00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 0x7f4cd00a6300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55dd34ec7cb0 tx=0x7f4cd80f61a0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 msgr2=0x7f4ce81a5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009860 tx=0x7f4cd8004270 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 shutdown_connections 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4cd00a3e40 0x7f4cd00a6300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ce8115a80 0x7f4ce819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ce810a250 0x7f4ce81a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 --2- 172.21.15.92:0/1974770716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ce8109930 0x7f4ce81a5410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 >> 172.21.15.92:0/1974770716 conn(0x7f4ce806de90 msgr2=0x7f4ce8072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 shutdown_connections 2024-04-26T18:05:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:35.647+0000 7f4ced0da640 1 -- 172.21.15.92:0/1974770716 wait complete. 2024-04-26T18:05:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:36 smithi189 ceph-mon[32756]: pgmap v182: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2024-04-26T18:05:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:36 smithi156 ceph-mon[32679]: pgmap v182: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2024-04-26T18:05:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:36 smithi092 ceph-mon[29156]: pgmap v182: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 46 MiB/s wr, 2.01k op/s 2024-04-26T18:05:38.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 325.0 s, 3417.0 tps, lat 24.172 ms stddev 26.437 2024-04-26T18:05:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:38 smithi189 ceph-mon[32756]: pgmap v183: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 43 MiB/s wr, 1.92k op/s 2024-04-26T18:05:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:38 smithi156 ceph-mon[32679]: pgmap v183: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 43 MiB/s wr, 1.92k op/s 2024-04-26T18:05:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:38 smithi092 ceph-mon[29156]: pgmap v183: 97 pgs: 97 active+clean; 3.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 43 MiB/s wr, 1.92k op/s 2024-04-26T18:05:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:40 smithi189 ceph-mon[32756]: pgmap v184: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 2.22k op/s 2024-04-26T18:05:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:40 smithi156 ceph-mon[32679]: pgmap v184: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 2.22k op/s 2024-04-26T18:05:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:40 smithi092 ceph-mon[29156]: pgmap v184: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 47 MiB/s wr, 2.22k op/s 2024-04-26T18:05:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:42 smithi189 ceph-mon[32756]: pgmap v185: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-04-26T18:05:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:42 smithi156 ceph-mon[32679]: pgmap v185: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-04-26T18:05:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:42 smithi092 ceph-mon[29156]: pgmap v185: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 834 op/s 2024-04-26T18:05:43.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:05:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:44 smithi189 ceph-mon[32756]: pgmap v186: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 870 op/s 2024-04-26T18:05:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:44 smithi156 ceph-mon[32679]: pgmap v186: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 870 op/s 2024-04-26T18:05:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:44 smithi092 ceph-mon[29156]: pgmap v186: 97 pgs: 97 active+clean; 3.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 13 MiB/s wr, 870 op/s 2024-04-26T18:05:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:46 smithi189 ceph-mon[32756]: pgmap v187: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.5 MiB/s wr, 585 op/s 2024-04-26T18:05:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:46 smithi156 ceph-mon[32679]: pgmap v187: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.5 MiB/s wr, 585 op/s 2024-04-26T18:05:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:46 smithi092 ceph-mon[29156]: pgmap v187: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.5 MiB/s wr, 585 op/s 2024-04-26T18:05:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fed3e9e6700 time 2024-04-26T18:05:47.457218+0000 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fed4900f3dd] 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.888 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: clone() 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.457+0000 7fed3e9e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fed3e9e6700 time 2024-04-26T18:05:47.457218+0000 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:05:47.889 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fed4900f3dd] 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.890 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: clone() 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: *** Caught signal (Aborted) ** 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: in thread 7fed3e9e6700 thread_name:ms_dispatch 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fed47d97d20] 2024-04-26T18:05:47.891 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: gsignal() 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: abort() 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fed4900f437] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.892 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 16: clone() 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.459+0000 7fed3e9e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: in thread 7fed3e9e6700 thread_name:ms_dispatch 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fed47d97d20] 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: gsignal() 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: abort() 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fed4900f437] 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.893 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 16: clone() 2024-04-26T18:05:47.894 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:05:47.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:47.895 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: -1> 2024-04-26T18:05:47.457+0000 7fed3e9e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fed3e9e6700 time 2024-04-26T18:05:47.457218+0000 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fed4900f3dd] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.896 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: clone() 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 0> 2024-04-26T18:05:47.459+0000 7fed3e9e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: in thread 7fed3e9e6700 thread_name:ms_dispatch 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fed47d97d20] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: gsignal() 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: abort() 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fed4900f437] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.897 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 16: clone() 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.898 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: -1> 2024-04-26T18:05:47.457+0000 7fed3e9e6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fed3e9e6700 time 2024-04-26T18:05:47.457218+0000 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fed4900f3dd] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.899 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: clone() 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 0> 2024-04-26T18:05:47.459+0000 7fed3e9e6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: in thread 7fed3e9e6700 thread_name:ms_dispatch 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fed47d97d20] 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2: gsignal() 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 3: abort() 2024-04-26T18:05:47.900 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fed4900f437] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fed4900f5a3] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56531023c822] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5653101ac598] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5653101aec17] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5653100a7d0b] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5653100a82ac] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565310090fad] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fed492a3e20] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 13: (DispatchQueue::entry()+0x51f) [0x7fed492a0fdf] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fed49373fc1] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fed47d8d1ca] 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 16: clone() 2024-04-26T18:05:47.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:05:47.902 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[62926]: 2024-04-26T18:05:47.902 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:47 smithi189 podman[67326]: 2024-04-26 18:05:47.526939279 +0000 UTC m=+0.022234603 container died 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-04-26T18:05:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:05:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 335.0 s, 388.4 tps, lat 559.438 ms stddev 2214.834 2024-04-26T18:05:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 -- 172.21.15.92:0/869151184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81062c0 msgr2=0x7f45f810de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 --2- 172.21.15.92:0/869151184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81062c0 0x7f45f810de90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009be0 tx=0x7f45f002a6c0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 -- 172.21.15.92:0/869151184 shutdown_connections 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 --2- 172.21.15.92:0/869151184 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f81062c0 0x7f45f810de90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 --2- 172.21.15.92:0/869151184 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f8101ba0 0x7f45f8105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 --2- 172.21.15.92:0/869151184 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81011f0 0x7f45f81015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.769+0000 7f4600578640 1 -- 172.21.15.92:0/869151184 >> 172.21.15.92:0/869151184 conn(0x7f45f8077dc0 msgr2=0x7f45f80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.770+0000 7f4600578640 1 -- 172.21.15.92:0/869151184 shutdown_connections 2024-04-26T18:05:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.770+0000 7f4600578640 1 -- 172.21.15.92:0/869151184 wait complete. 2024-04-26T18:05:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 Processor -- start 2024-04-26T18:05:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 -- start start 2024-04-26T18:05:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 0x7f45f80fd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 0x7f45f80fd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 0x7f45f81a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81109a0 con 0x7f45f81062c0 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f45fe314640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 0x7f45f80fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f45fe314640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 0x7f45f80fd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:34386/0 (socket says 172.21.15.92:34386) 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 0x7f45f80fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8110820 con 0x7f45f80fdc80 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8110b20 con 0x7f45f81011f0 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 0x7f45f81a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.771+0000 7f45fe314640 1 -- 172.21.15.92:0/4104494022 learned_addr learned my addr 172.21.15.92:0/4104494022 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 -- 172.21.15.92:0/4104494022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 msgr2=0x7f45f80fd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 0x7f45f80fd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 -- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 msgr2=0x7f45f80fd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 0x7f45f80fd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 -- 172.21.15.92:0/4104494022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f81a7990 con 0x7f45f80fdc80 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45fdb13640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 0x7f45f80fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 0x7f45f81a7290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45f0004af0 tx=0x7f45f0030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45ef7fe640 1 -- 172.21.15.92:0/4104494022 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0041020 con 0x7f45f80fdc80 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45ef7fe640 1 -- 172.21.15.92:0/4104494022 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f0037040 con 0x7f45f80fdc80 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f45ef7fe640 1 -- 172.21.15.92:0/4104494022 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0036070 con 0x7f45f80fdc80 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f81a7c20 con 0x7f45f80fdc80 2024-04-26T18:05:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.772+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81a8160 con 0x7f45f80fdc80 2024-04-26T18:05:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.776+0000 7f460336f740 1 Processor -- start 2024-04-26T18:05:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.777+0000 7f45ef7fe640 1 -- 172.21.15.92:0/4104494022 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f45f0044020 con 0x7f45f80fdc80 2024-04-26T18:05:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 -- start start 2024-04-26T18:05:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ae030 0x55fa654b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa6540b460 con 0x55fa654ad710 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55fa653c5590 con 0x55fa654b88f0 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f460336f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa65407420 con 0x55fa654ae030 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45ef7fe640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 0x7f45e40a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36266/0 (socket says 172.21.15.92:36266) 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45fe314640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ae030 0x55fa654b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45fdb13640 1 -- 172.21.15.92:0/779317758 learned_addr learned my addr 172.21.15.92:0/779317758 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 0x7f45e40a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45fdb13640 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.778+0000 7f45ef7fe640 1 -- 172.21.15.92:0/4104494022 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f45f00f0fb0 con 0x7f45f80fdc80 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 -- 172.21.15.92:0/779317758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ae030 msgr2=0x55fa654b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ae030 0x55fa654b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 -- 172.21.15.92:0/779317758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 msgr2=0x55fa654bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 -- 172.21.15.92:0/779317758 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa653d20d0 con 0x55fa654ad710 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45fdb13640 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009fd0 tx=0x7f45f4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e216b664f9ea223e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45feb15640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 0x7f45e40a6330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ee820 tx=0x7f45f004cf90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45ecbfe640 1 -- 172.21.15.92:0/779317758 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4011050 con 0x55fa654ad710 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45ecbfe640 1 -- 172.21.15.92:0/779317758 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f40111f0 con 0x55fa654ad710 2024-04-26T18:05:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.779+0000 7f45ecbfe640 1 -- 172.21.15.92:0/779317758 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4003850 con 0x55fa654ad710 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 -- 172.21.15.92:0/779317758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 msgr2=0x55fa654adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009fd0 tx=0x7f45f4005850 comp rx=0 tx=0).stop 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 -- 172.21.15.92:0/779317758 shutdown_connections 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ae030 0x55fa654b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 --2- 172.21.15.92:0/779317758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654adaf0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.780+0000 7f460336f740 1 -- 172.21.15.92:0/779317758 >> 172.21.15.92:0/779317758 conn(0x55fa654a9c20 msgr2=0x55fa654aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.781+0000 7f460336f740 1 -- 172.21.15.92:0/779317758 shutdown_connections 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.781+0000 7f460336f740 1 -- 172.21.15.92:0/779317758 wait complete. 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.781+0000 7f460336f740 1 -- start start 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f460336f740 1 Processor -- start 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f460336f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f460336f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f460336f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654b88f0 0x55fa654b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f460336f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fa654bb4c0 con 0x55fa654ad710 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654b57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:36278/0 (socket says 172.21.15.92:36278) 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.782+0000 7f45fdb13640 1 -- 172.21.15.92:0/3968279897 learned_addr learned my addr 172.21.15.92:0/3968279897 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55fa65392b60 con 0x55fa654ae030 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fa654bb640 con 0x55fa654b88f0 2024-04-26T18:05:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fdb13640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654b88f0 0x55fa654b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 -- 172.21.15.92:0/3968279897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654b88f0 msgr2=0x55fa654b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654b88f0 0x55fa654b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 -- 172.21.15.92:0/3968279897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 msgr2=0x55fa654b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6511d210 con 0x55fa654ae030 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f460336f740 10 client.0 _ll_register_callbacks cb 0x55fa653b72b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f40111f0 con 0x55fa654ae030 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45fe314640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654b5cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45e800e810 tx=0x7f45e800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=249e0207f0b7572c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45e1ffb640 10 client.25472 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45e1ffb640 1 -- 172.21.15.92:0/3968279897 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8004300 con 0x55fa654ae030 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.783+0000 7f45e1ffb640 1 -- 172.21.15.92:0/3968279897 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f45e800d9c0 con 0x55fa654ae030 2024-04-26T18:05:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f45e1ffb640 1 -- 172.21.15.92:0/3968279897 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f45e800dbc0 con 0x55fa654ae030 2024-04-26T18:05:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 10 client.25472 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55fa651e9620 con 0x55fa654ae030 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f45e1ffb640 1 -- 172.21.15.92:0/3968279897 <== mon.2 v2:172.21.15.156:3300/0 4 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f45e800b040 con 0x55fa654ae030 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 10 client.25472 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 10 client.25472 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 20 client.25472 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa654c8840 0x55fa654cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 4 client.25472 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa65419070 con 0x55fa654c8840 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.784+0000 7f45fdb13640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa654c8840 0x55fa654cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.786+0000 7f45e1ffb640 10 client.25472 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.786+0000 7f45fdb13640 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa654c8840 0x55fa654cacd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c5254acb15f9fe server_cookie=ce3187167274f3ff in_seq=0 out_seq=0 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f45e1ffb640 1 -- 172.21.15.92:0/3968279897 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fa65419070 con 0x55fa654c8840 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f45e1ffb640 10 client.25472 handle_command_reply: tid=0 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 client.25472 shutdown 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 msgr2=0x55fa654b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654b5cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f45e800e810 tx=0x7f45e800ecd0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 shutdown_connections 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa654c8840 0x55fa654cacd0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654b88f0 0x55fa654b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654b5cf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 --2- 172.21.15.92:0/3968279897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ad710 0x55fa654b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 >> 172.21.15.92:0/3968279897 conn(0x55fa654a9c20 msgr2=0x55fa654a05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f45e1ffb640 0 client.25472 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 shutdown_connections 2024-04-26T18:05:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 1 -- 172.21.15.92:0/3968279897 wait complete. 2024-04-26T18:05:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.787+0000 7f460336f740 20 client.25472 trim_cache size 0 max 16384 2024-04-26T18:05:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 Processor -- start 2024-04-26T18:05:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 -- start start 2024-04-26T18:05:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654b88f0 0x55fa654d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81ae9d0 con 0x55fa654b88f0 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.810+0000 7f460336f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81ac270 con 0x55fa654ae030 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f460336f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81aa0e0 con 0x55fa654ad710 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fe314640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:34410/0 (socket says 172.21.15.92:34410) 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 -- 172.21.15.92:0/2336281171 learned_addr learned my addr 172.21.15.92:0/2336281171 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654b88f0 0x55fa654d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 -- 172.21.15.92:0/2336281171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 msgr2=0x55fa654d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 -- 172.21.15.92:0/2336281171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654b88f0 msgr2=0x55fa654d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654b88f0 0x55fa654d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 -- 172.21.15.92:0/2336281171 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa654c5130 con 0x55fa654ad710 2024-04-26T18:05:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.811+0000 7f45fdb13640 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45f400fdc0 tx=0x7f45f4021040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8008568546b16051 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.812+0000 7f45e3fff640 1 -- 172.21.15.92:0/2336281171 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f40052d0 con 0x55fa654ad710 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.812+0000 7f45e3fff640 1 -- 172.21.15.92:0/2336281171 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f4005470 con 0x55fa654ad710 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.812+0000 7f45e3fff640 1 -- 172.21.15.92:0/2336281171 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f40038e0 con 0x55fa654ad710 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- 172.21.15.92:0/2336281171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 msgr2=0x55fa654c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45f400fdc0 tx=0x7f45f4021040 comp rx=0 tx=0).stop 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- 172.21.15.92:0/2336281171 shutdown_connections 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654b88f0 0x55fa654d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654ae030 0x55fa654d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- 172.21.15.92:0/2336281171 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654c43b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- 172.21.15.92:0/2336281171 >> 172.21.15.92:0/2336281171 conn(0x55fa654a9c20 msgr2=0x55fa654a05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- 172.21.15.92:0/2336281171 shutdown_connections 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- 172.21.15.92:0/2336281171 wait complete. 2024-04-26T18:05:48.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- start start 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 Processor -- start 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 0x55fa654bca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81aa730 con 0x55fa654ae030 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81abba0 con 0x55fa654b88f0 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f45f81aae00 con 0x55fa654ad710 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.813+0000 7f460336f740 10 client.0 _ll_register_callbacks cb 0x7f45e800a9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fe314640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 0x55fa654bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:34426/0 (socket says 172.21.15.92:34426) 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 -- 172.21.15.92:0/1326210069 learned_addr learned my addr 172.21.15.92:0/1326210069 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:05:48.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 -- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 msgr2=0x55fa654bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 -- 172.21.15.92:0/1326210069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 msgr2=0x55fa654bca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 0x55fa654bca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 -- 172.21.15.92:0/1326210069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6553f050 con 0x55fa654ad710 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fe314640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 0x55fa654bca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45fdb13640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009f00 tx=0x7f45f400fd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9c0e717e83b72a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4032040 con 0x55fa654ad710 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f4005470 con 0x55fa654ad710 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8411+0+0 (secure 0 0 0) 0x7f45f402b250 con 0x55fa654ad710 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f45f40052d0 con 0x55fa654ad710 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f460336f740 10 client.25387 fetch_fsmap learned FSMap version 33 2024-04-26T18:05:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.814+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55fa65540320 con 0x55fa654ad710 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45f4005470 con 0x55fa654ad710 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 33) ==== 8342+0+0 (secure 0 0 0) 0x7f45f4003af0 con 0x55fa654ad710 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 10 client.25387 fetch_fsmap finished waiting for FSMap version 33 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 10 client.25387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 20 client.25387 populate_metadata read hostname 'smithi092' 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa65540700 0x55fa65542af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 4 client.25387 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fa65412ee0 con 0x55fa65540700 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.815+0000 7f45fe314640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa65540700 0x55fa65542af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.816+0000 7f45fe314640 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa65540700 0x55fa65542af0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6524ea3320857bbc server_cookie=4f3786e1d013fb2f in_seq=0 out_seq=0 2024-04-26T18:05:48.820 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:05:48.816+0000 7f45e1ffb640 10 client.25387 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:05:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:48 smithi189 ceph-mon[32756]: pgmap v188: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.0 MiB/s wr, 377 op/s 2024-04-26T18:05:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:48 smithi156 ceph-mon[32679]: pgmap v188: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.0 MiB/s wr, 377 op/s 2024-04-26T18:05:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:48 smithi092 ceph-mon[29156]: pgmap v188: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.0 MiB/s wr, 377 op/s 2024-04-26T18:05:49.314 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:49 smithi189 podman[67326]: 2024-04-26 18:05:49.012422795 +0000 UTC m=+1.507718110 container remove 637bdb1f286d7850d827232223ad8969357dd2a709265d8d86901d98e3ea9187 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-26T18:05:49.314 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:05:49.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:05:49.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 6.048s CPU time. 2024-04-26T18:05:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:05:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:05:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:50 smithi092 ceph-mon[29156]: pgmap v189: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.0 MiB/s wr, 464 op/s 2024-04-26T18:05:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:50 smithi189 ceph-mon[32756]: pgmap v189: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.0 MiB/s wr, 464 op/s 2024-04-26T18:05:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:50 smithi156 ceph-mon[32679]: pgmap v189: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 6.0 MiB/s wr, 464 op/s 2024-04-26T18:05:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:52 smithi092 ceph-mon[29156]: pgmap v190: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-04-26T18:05:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:52 smithi189 ceph-mon[32756]: pgmap v190: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-04-26T18:05:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:52 smithi156 ceph-mon[32679]: pgmap v190: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 157 op/s 2024-04-26T18:05:53.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 340.0 s, 1968.5 tps, lat 27.546 ms stddev 29.372 2024-04-26T18:05:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:54 smithi092 ceph-mon[29156]: pgmap v191: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 264 op/s 2024-04-26T18:05:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:54 smithi189 ceph-mon[32756]: pgmap v191: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 264 op/s 2024-04-26T18:05:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:54 smithi156 ceph-mon[32679]: pgmap v191: 97 pgs: 97 active+clean; 3.4 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.7 MiB/s wr, 264 op/s 2024-04-26T18:05:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:56 smithi092 ceph-mon[29156]: pgmap v192: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 363 op/s 2024-04-26T18:05:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:56 smithi189 ceph-mon[32756]: pgmap v192: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 363 op/s 2024-04-26T18:05:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:56 smithi156 ceph-mon[32679]: pgmap v192: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.1 MiB/s wr, 363 op/s 2024-04-26T18:05:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:05:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:05:58 smithi092 ceph-mon[29156]: pgmap v193: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 328 op/s 2024-04-26T18:05:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:05:58 smithi189 ceph-mon[32756]: pgmap v193: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 328 op/s 2024-04-26T18:05:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:05:58 smithi156 ceph-mon[32679]: pgmap v193: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.8 MiB/s wr, 328 op/s 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 systemd[1]: Stopped Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 6.048s CPU time. 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 systemd[1]: Starting Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 podman[67534]: 2024-04-26 18:05:59.522593568 +0000 UTC m=+0.018252135 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:05:59.646 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 podman[67534]: 2024-04-26 18:05:59.647016427 +0000 UTC m=+0.142675009 container create b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-26T18:06:00.178 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 podman[67534]: 2024-04-26 18:05:59.899942767 +0000 UTC m=+0.395601308 container init b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T18:06:00.178 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 podman[67534]: 2024-04-26 18:05:59.902671334 +0000 UTC m=+0.398329882 container start b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:06:00.179 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 ceph-mds[67552]: -- 172.21.15.189:0/2244760231 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562756e85a40 con 0x562756e58800 2024-04-26T18:06:00.179 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:05:59 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: starting mds.i at 2024-04-26T18:06:00.179 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:00 smithi189 bash[67534]: b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 2024-04-26T18:06:00.179 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:00 smithi189 systemd[1]: Started Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: pgmap v194: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 411 op/s 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: daemon mds.i restarted 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:boot 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:01.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: pgmap v194: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 411 op/s 2024-04-26T18:06:01.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: daemon mds.i restarted 2024-04-26T18:06:01.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:boot 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: pgmap v194: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.7 MiB/s wr, 411 op/s 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: daemon mds.i restarted 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: osdmap e92: 12 total, 12 up, 12 in 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:boot 2024-04-26T18:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:02 smithi092 ceph-mon[29156]: pgmap v196: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 389 op/s 2024-04-26T18:06:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:resolve 2024-04-26T18:06:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:02 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:02 smithi189 ceph-mon[32756]: pgmap v196: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 389 op/s 2024-04-26T18:06:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:resolve 2024-04-26T18:06:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:02 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:02 smithi156 ceph-mon[32679]: pgmap v196: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 389 op/s 2024-04-26T18:06:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:resolve 2024-04-26T18:06:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:02 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:03.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f45e1ffb640 1 -- 172.21.15.92:0/1326210069 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fa65412ee0 con 0x55fa65540700 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f45e1ffb640 10 client.25387 handle_command_reply: tid=0 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 client.25387 shutdown 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 msgr2=0x55fa654bc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009f00 tx=0x7f45f400fd10 comp rx=0 tx=0).stop 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 shutdown_connections 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55fa65540700 0x55fa65542af0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa654b88f0 0x55fa654bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fa654ae030 0x55fa654bca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.764 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 --2- 172.21.15.92:0/1326210069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fa654ad710 0x55fa654bc540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f45e1ffb640 0 client.25387 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 >> 172.21.15.92:0/1326210069 conn(0x55fa654a9c20 msgr2=0x55fa654af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 shutdown_connections 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 1 -- 172.21.15.92:0/1326210069 wait complete. 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.763+0000 7f460336f740 20 client.25387 trim_cache size 0 max 16384 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:06:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:06:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 msgr2=0x7f45e40a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 0x7f45e40a6330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f45f00ee820 tx=0x7f45f004cf90 comp rx=0 tx=0).stop 2024-04-26T18:06:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 msgr2=0x7f45f81a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 0x7f45f81a7290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45f0004af0 tx=0x7f45f0030650 comp rx=0 tx=0).stop 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 shutdown_connections 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f45e40a3e70 0x7f45e40a6330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80fdc80 0x7f45f81a7290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45f81062c0 0x7f45f80fd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 --2- 172.21.15.92:0/4104494022 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f45f81011f0 0x7f45f80fd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 >> 172.21.15.92:0/4104494022 conn(0x7f45f8077dc0 msgr2=0x7f45f8104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 shutdown_connections 2024-04-26T18:06:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:03.764+0000 7f4600578640 1 -- 172.21.15.92:0/4104494022 wait complete. 2024-04-26T18:06:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:03 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:03 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:reconnect 2024-04-26T18:06:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:03 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:03 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.0049999 2024-04-26T18:06:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:03 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:03 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:reconnect 2024-04-26T18:06:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:03 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:03 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.0049999 2024-04-26T18:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:03 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:03 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:reconnect 2024-04-26T18:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:03 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:03 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.0049999 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: pgmap v197: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:rejoin 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:06:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:active 2024-04-26T18:06:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:04 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: pgmap v197: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-04-26T18:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:rejoin 2024-04-26T18:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:06:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:active 2024-04-26T18:06:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:04 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: pgmap v197: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:rejoin 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3880754337,v1:172.21.15.189:6835/3880754337] up:active 2024-04-26T18:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:04 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:06 smithi189 ceph-mon[32756]: pgmap v198: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:06 smithi156 ceph-mon[32679]: pgmap v198: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:06 smithi092 ceph-mon[29156]: pgmap v198: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 355.0 s, 1856.4 tps, lat 186.552 ms stddev 1417.228 2024-04-26T18:06:08.465 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-04-26T18:06:08.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:06:08.763 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:06:08 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:06:08.465+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:06:08.835 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:06:09.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:08 smithi092 ceph-mon[29156]: pgmap v199: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:08 smithi189 ceph-mon[32756]: pgmap v199: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:08 smithi156 ceph-mon[32679]: pgmap v199: 97 pgs: 97 active+clean; 3.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.0 MiB/s wr, 182 op/s 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa975970700 time 2024-04-26T18:06:09.696443+0000 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa97ff993dd] 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.037 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: clone() 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:09.697+0000 7fa975970700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa975970700 time 2024-04-26T18:06:09.696443+0000 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:10.038 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.039 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.039 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa97ff993dd] 2024-04-26T18:06:10.039 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: clone() 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.040 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: *** Caught signal (Aborted) ** 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: in thread 7fa975970700 thread_name:ms_dispatch 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa97ed21d20] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: gsignal() 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: abort() 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa97ff99437] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.041 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 16: clone() 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:09.699+0000 7fa975970700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: in thread 7fa975970700 thread_name:ms_dispatch 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa97ed21d20] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: gsignal() 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: abort() 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa97ff99437] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.042 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 16: clone() 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: -1> 2024-04-26T18:06:09.697+0000 7fa975970700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa975970700 time 2024-04-26T18:06:09.696443+0000 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.043 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa97ff993dd] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: clone() 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.044 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 0> 2024-04-26T18:06:09.699+0000 7fa975970700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: in thread 7fa975970700 thread_name:ms_dispatch 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa97ed21d20] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: gsignal() 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: abort() 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa97ff99437] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.045 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 16: clone() 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: -1> 2024-04-26T18:06:09.697+0000 7fa975970700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa975970700 time 2024-04-26T18:06:09.696443+0000 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa97ff993dd] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.046 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: clone() 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 0> 2024-04-26T18:06:09.699+0000 7fa975970700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: in thread 7fa975970700 thread_name:ms_dispatch 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa97ed21d20] 2024-04-26T18:06:10.047 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2: gsignal() 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 3: abort() 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa97ff99437] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa97ff995a3] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b62785a822] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b6277ca598] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b6277ccc17] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b6276c5d0b] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b6276c62ac] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b6276aefad] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa98022de20] 2024-04-26T18:06:10.048 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 13: (DispatchQueue::entry()+0x51f) [0x7fa98022afdf] 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa9802fdfc1] 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa97ed171ca] 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 16: clone() 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[62300]: 2024-04-26T18:06:10.049 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:09 smithi189 podman[67603]: 2024-04-26 18:06:09.757950562 +0000 UTC m=+0.019457167 container died fcde8f43459fedf96c132f5114d6e481533a2090edcb2a3ddff73dac52d09c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True) 2024-04-26T18:06:10.618 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:10 smithi189 podman[67603]: 2024-04-26 18:06:10.363858243 +0000 UTC m=+0.625364873 container remove fcde8f43459fedf96c132f5114d6e481533a2090edcb2a3ddff73dac52d09c13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T18:06:10.618 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 -- 172.21.15.92:0/4100470736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70102ce0 msgr2=0x7f9b7010f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 --2- 172.21.15.92:0/4100470736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70102ce0 0x7f9b7010f1d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800b0a0 tx=0x7f9b6800b3b0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 -- 172.21.15.92:0/4100470736 shutdown_connections 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 --2- 172.21.15.92:0/4100470736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70102ce0 0x7f9b7010f1d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 --2- 172.21.15.92:0/4100470736 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70108390 0x7f9b70108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 --2- 172.21.15.92:0/4100470736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102320 0x7f9b701027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 -- 172.21.15.92:0/4100470736 >> 172.21.15.92:0/4100470736 conn(0x7f9b700792d0 msgr2=0x7f9b700796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 -- 172.21.15.92:0/4100470736 shutdown_connections 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.652+0000 7f9b7819a700 1 -- 172.21.15.92:0/4100470736 wait complete. 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 Processor -- start 2024-04-26T18:06:10.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 -- start start 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70102320 0x7f9b7019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102ce0 0x7f9b7019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b701135d0 con 0x7f9b70108390 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70113450 con 0x7f9b70102ce0 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b7819a700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70113750 con 0x7f9b70102320 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b76737700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b76737700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40828/0 (socket says 172.21.15.92:40828) 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b76737700 1 -- 172.21.15.92:0/772598189 learned_addr learned my addr 172.21.15.92:0/772598189 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b75735700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102ce0 0x7f9b7019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.653+0000 7f9b75f36700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70102320 0x7f9b7019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 -- 172.21.15.92:0/772598189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70102320 msgr2=0x7f9b7019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70102320 0x7f9b7019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.659 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 -- 172.21.15.92:0/772598189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102ce0 msgr2=0x7f9b7019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102ce0 0x7f9b7019fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 -- 172.21.15.92:0/772598189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7019a050 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b76737700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800b830 tx=0x7f9b68004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b68021070 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b68007e30 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7019a2e0 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b680047d0 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.654+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701a6600 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.655+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7006a110 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.657+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9b68007980 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.657+0000 7f9b66ffd700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 0x7f9b5c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.657+0000 7f9b75f36700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 0x7f9b5c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.657+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8497+0+0 (secure 0 0 0) 0x7f9b6800f020 con 0x7f9b70108390 2024-04-26T18:06:10.660 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.658+0000 7f9b75f36700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 0x7f9b5c0a6270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b7019aa30 tx=0x7f9b6000b4d0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:10.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.661+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7f9b6802a020 con 0x7f9b70108390 2024-04-26T18:06:10.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:06:10.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.938s CPU time. 2024-04-26T18:06:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:10 smithi189 ceph-mon[32756]: pgmap v200: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 24 MiB/s wr, 1.70k op/s 2024-04-26T18:06:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:10 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:10.956 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.956+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b7002e490 con 0x7f9b70108390 2024-04-26T18:06:10.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:10 smithi092 ceph-mon[29156]: pgmap v200: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 24 MiB/s wr, 1.70k op/s 2024-04-26T18:06:10.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:10 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:10.957 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.957+0000 7f9b66ffd700 1 -- 172.21.15.92:0/772598189 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11886 (secure 0 0 0) 0x7f9b6809e8c0 con 0x7f9b70108390 2024-04-26T18:06:10.957 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:06:10.957 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:06:08.896606+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":24394},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24394":{"gid":24394,"name":"f","rank":2,"incarnation":35,"state":"up:active","state_seq":157,"addr":"172.21.15.189:6835/3880754337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":3880754337},{"type":"v1","addr":"172.21.15.189:6835","nonce":3880754337}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25393":{"gid":25393,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6839/180692647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":180692647},{"type":"v1","addr":"172.21.15.189:6839","nonce":180692647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[24394,24419,24437]},"id":1}]} 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.959+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 msgr2=0x7f9b5c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.959+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 0x7f9b5c0a6270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9b7019aa30 tx=0x7f9b6000b4d0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.959+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 msgr2=0x7f9b701998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.959+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800b830 tx=0x7f9b68004ce0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 shutdown_connections 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9b5c0a3db0 0x7f9b5c0a6270 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b70108390 0x7f9b701998f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b70102320 0x7f9b7019f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 --2- 172.21.15.92:0/772598189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9b70102ce0 0x7f9b7019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 >> 172.21.15.92:0/772598189 conn(0x7f9b700792d0 msgr2=0x7f9b70100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 shutdown_connections 2024-04-26T18:06:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:10.960+0000 7f9b7819a700 1 -- 172.21.15.92:0/772598189 wait complete. 2024-04-26T18:06:10.960 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 40 2024-04-26T18:06:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:10 smithi156 ceph-mon[32679]: pgmap v200: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 24 MiB/s wr, 1.70k op/s 2024-04-26T18:06:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:10 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:11 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/772598189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:06:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:11 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/772598189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:06:12.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:11 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/772598189' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:06:12.234 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0' 2024-04-26T18:06:12.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0 2024-04-26T18:06:12.474 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:06:12.909 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:12 smithi092 ceph-mon[29156]: pgmap v201: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 21 MiB/s wr, 1.47k op/s 2024-04-26T18:06:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:12 smithi189 ceph-mon[32756]: pgmap v201: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 21 MiB/s wr, 1.47k op/s 2024-04-26T18:06:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:12 smithi156 ceph-mon[32679]: pgmap v201: 97 pgs: 97 active+clean; 3.5 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 21 MiB/s wr, 1.47k op/s 2024-04-26T18:06:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 360.0 s, 1031.2 tps, lat 28.994 ms stddev 28.755 2024-04-26T18:06:14.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:14 smithi092 ceph-mon[29156]: pgmap v202: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 21 MiB/s wr, 1.54k op/s 2024-04-26T18:06:14.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:14 smithi092 ceph-mon[29156]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:14 smithi189 ceph-mon[32756]: pgmap v202: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 21 MiB/s wr, 1.54k op/s 2024-04-26T18:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:14 smithi189 ceph-mon[32756]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:06:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:14 smithi156 ceph-mon[32679]: pgmap v202: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 21 MiB/s wr, 1.54k op/s 2024-04-26T18:06:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:14 smithi156 ceph-mon[32679]: osdmap e93: 12 total, 12 up, 12 in 2024-04-26T18:06:15.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 -- 172.21.15.92:0/2989083937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 msgr2=0x7f0f10102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 --2- 172.21.15.92:0/2989083937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f10102960 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80099c0 tx=0x7f0ef8009cd0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 -- 172.21.15.92:0/2989083937 shutdown_connections 2024-04-26T18:06:15.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 --2- 172.21.15.92:0/2989083937 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10107650 0x7f0f1010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.506 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 --2- 172.21.15.92:0/2989083937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f10102960 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 --2- 172.21.15.92:0/2989083937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10102f30 0x7f0f10106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 -- 172.21.15.92:0/2989083937 >> 172.21.15.92:0/2989083937 conn(0x7f0f10079320 msgr2=0x7f0f10079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 -- 172.21.15.92:0/2989083937 shutdown_connections 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.506+0000 7f0f164e1700 1 -- 172.21.15.92:0/2989083937 wait complete. 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 Processor -- start 2024-04-26T18:06:15.507 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 -- start start 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f101a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10102f30 0x7f0f101a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10107650 0x7f0f1019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10112510 con 0x7f0f10102580 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10112390 con 0x7f0f10107650 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.507+0000 7f0f164e1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10112690 con 0x7f0f10102f30 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f101a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f101a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41680/0 (socket says 172.21.15.92:41680) 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3664485193 learned_addr learned my addr 172.21.15.92:0/3664485193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10107650 0x7f0f1019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10102f30 0x7f0f101a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3664485193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10102f30 msgr2=0x7f0f101a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.509 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10102f30 0x7f0f101a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3664485193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10107650 msgr2=0x7f0f1019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f10107650 0x7f0f1019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3664485193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1019c1d0 con 0x7f0f10102580 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f10102f30 0x7f0f101a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f10102580 0x7f0f101a18b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0ef800b580 tx=0x7f0ef80037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0d7fa700 1 -- 172.21.15.92:0/3664485193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8027070 con 0x7f0f10102580 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f164e1700 1 -- 172.21.15.92:0/3664485193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1019c460 con 0x7f0f10102580 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0d7fa700 1 -- 172.21.15.92:0/3664485193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ef8004110 con 0x7f0f10102580 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f0d7fa700 1 -- 172.21.15.92:0/3664485193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef800f460 con 0x7f0f10102580 2024-04-26T18:06:15.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.508+0000 7f0f164e1700 1 -- 172.21.15.92:0/3664485193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101a8780 con 0x7f0f10102580 2024-04-26T18:06:15.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.510+0000 7f0f0d7fa700 1 -- 172.21.15.92:0/3664485193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0ef802a070 con 0x7f0f10102580 2024-04-26T18:06:15.511 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.511+0000 7f0f0d7fa700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0efc0a3ed0 0x7f0efc0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.511+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0efc0a3ed0 0x7f0efc0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f0d7fa700 1 -- 172.21.15.92:0/3664485193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f0ef80d1760 con 0x7f0f10102580 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3664485193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f0efc0a3ed0 0x7f0efc0a6390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0f00005fd0 tx=0x7f0f00005dc0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 Processor -- start 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 -- start start 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a4a850 0x559933a442e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a44d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5599339969c0 con 0x559933a44900 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5599338fcac0 con 0x559933a4a850 2024-04-26T18:06:15.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.512+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559933992980 con 0x559933a49f30 2024-04-26T18:06:15.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37236/0 (socket says 172.21.15.92:37236) 2024-04-26T18:06:15.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a44d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f0ffff700 1 -- 172.21.15.92:0/995199520 learned_addr learned my addr 172.21.15.92:0/995199520 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:15.515 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a4a850 0x559933a442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 -- 172.21.15.92:0/995199520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 msgr2=0x559933a4a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 -- 172.21.15.92:0/995199520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a4a850 msgr2=0x559933a442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a4a850 0x559933a442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 -- 172.21.15.92:0/995199520 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599338e3a60 con 0x559933a44900 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a44d60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0f08008420 tx=0x7f0f08008730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48bd1471c84897f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f067fc700 1 -- 172.21.15.92:0/995199520 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08003c00 con 0x559933a44900 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f067fc700 1 -- 172.21.15.92:0/995199520 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f08003da0 con 0x559933a44900 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.513+0000 7f0f067fc700 1 -- 172.21.15.92:0/995199520 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080149c0 con 0x559933a44900 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 -- 172.21.15.92:0/995199520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 msgr2=0x559933a44d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a44d60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0f08008420 tx=0x7f0f08008730 comp rx=0 tx=0).stop 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 -- 172.21.15.92:0/995199520 shutdown_connections 2024-04-26T18:06:15.516 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a44d60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a49f30 0x559933a4a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/995199520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a4a850 0x559933a442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 -- 172.21.15.92:0/995199520 >> 172.21.15.92:0/995199520 conn(0x559933972750 msgr2=0x559933a3f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 -- 172.21.15.92:0/995199520 shutdown_connections 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.514+0000 7f0f20d73b80 1 -- 172.21.15.92:0/995199520 wait complete. 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 -- start start 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 Processor -- start 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a4d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 0x559933a4dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559933a512c0 con 0x559933a4a850 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559933950c10 con 0x559933a49f30 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559933a51440 con 0x559933a44900 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f20d73b80 10 client.0 _ll_register_callbacks cb 0x55993392eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f0ffff700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:37240/0 (socket says 172.21.15.92:37240) 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3487218349 learned_addr learned my addr 172.21.15.92:0/3487218349 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a4d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.515+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 0x559933a4dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 msgr2=0x559933a4d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a4d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3487218349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 msgr2=0x559933a4dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 0x559933a4dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 -- 172.21.15.92:0/3487218349 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559933954610 con 0x559933a44900 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 0x559933a4dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cf470 tx=0x7f0ef809d0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc6ffcdfc701f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0eef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a1b00 con 0x559933a44900 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f0ef809d9b0 con 0x559933a44900 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f08003da0 con 0x559933a44900 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0ef80a6330 con 0x559933a44900 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f20d73b80 10 client.25405 fetch_fsmap learned FSMap version 40 2024-04-26T18:06:15.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559933a51320 con 0x559933a44900 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.516+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f08003da0 con 0x559933a44900 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 40) ==== 8342+0+0 (secure 0 0 0) 0x7f0ef8003c60 con 0x559933a44900 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 10 client.25405 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 10 client.25405 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 20 client.25405 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a5e050 0x559933a60490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 4 client.25405 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599339a43a0 con 0x559933a5e050 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a5e050 0x559933a60490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.521 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a5e050 0x559933a60490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bdbbbf93eb6c9ea server_cookie=e7936a1b5fec3c7a in_seq=0 out_seq=0 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.517+0000 7f0eef7fe700 10 client.25405 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3487218349 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5599339a43a0 con 0x559933a5e050 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0eef7fe700 10 client.25405 handle_command_reply: tid=0 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 client.25405 shutdown 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 msgr2=0x559933a504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cf470 tx=0x7f0ef809d0b0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 shutdown_connections 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a5e050 0x559933a60490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a4a850 0x559933a4dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933a44900 0x559933a504a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0eef7fe700 0 client.25405 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3487218349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a4d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.522 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.518+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 >> 172.21.15.92:0/3487218349 conn(0x559933972750 msgr2=0x559933a432d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.519+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 shutdown_connections 2024-04-26T18:06:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.519+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3487218349 wait complete. 2024-04-26T18:06:15.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.519+0000 7f0f20d73b80 20 client.25405 trim_cache size 0 max 16384 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.551+0000 7f0f20d73b80 1 Processor -- start 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.551+0000 7f0f20d73b80 1 -- start start 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a442e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a5a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101b25c0 con 0x559933a44900 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101afe50 con 0x559933a49f30 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101adcc0 con 0x559933972750 2024-04-26T18:06:15.552 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41710/0 (socket says 172.21.15.92:41710) 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 -- 172.21.15.92:0/2554037038 learned_addr learned my addr 172.21.15.92:0/2554037038 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a5a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 -- 172.21.15.92:0/2554037038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 msgr2=0x559933a442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 -- 172.21.15.92:0/2554037038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 msgr2=0x559933a5a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a5a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 -- 172.21.15.92:0/2554037038 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559933a60b10 con 0x559933a44900 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f0f7fe700 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f00005950 tx=0x7f0f00010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c627faa7bf8487 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f05ffb700 1 -- 172.21.15.92:0/2554037038 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00029460 con 0x559933a44900 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f05ffb700 1 -- 172.21.15.92:0/2554037038 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f0001d430 con 0x559933a44900 2024-04-26T18:06:15.553 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.552+0000 7f0f05ffb700 1 -- 172.21.15.92:0/2554037038 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000f680 con 0x559933a44900 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 -- 172.21.15.92:0/2554037038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 msgr2=0x559933a4cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f00005950 tx=0x7f0f00010000 comp rx=0 tx=0).stop 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 -- 172.21.15.92:0/2554037038 shutdown_connections 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a49f30 0x559933a5a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/2554037038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a44900 0x559933a4cb50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 -- 172.21.15.92:0/2554037038 >> 172.21.15.92:0/2554037038 conn(0x559933a3f380 msgr2=0x559933a38f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 -- 172.21.15.92:0/2554037038 shutdown_connections 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.553+0000 7f0f20d73b80 1 -- 172.21.15.92:0/2554037038 wait complete. 2024-04-26T18:06:15.557 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 -- start start 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 Processor -- start 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 0x559933a53e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101ae310 con 0x559933a49f30 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101af780 con 0x559933a44900 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f101ae9e0 con 0x559933972750 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f20d73b80 10 client.0 _ll_register_callbacks cb 0x55993392eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f14a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 0x559933a53e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f14a7e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41712/0 (socket says 172.21.15.92:41712) 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f0f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 0x559933a53e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:49136/0 (socket says 172.21.15.92:49136) 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f14a7e700 1 -- 172.21.15.92:0/3617178036 learned_addr learned my addr 172.21.15.92:0/3617178036 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:15.558 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.554+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 -- 172.21.15.92:0/3617178036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 msgr2=0x559933a538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 -- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 msgr2=0x559933a53e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 0x559933a53e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 -- 172.21.15.92:0/3617178036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559933a3ffc0 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f14a7e700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f08015000 tx=0x7f0f080060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc1a70d0677fdc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0eef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f080055d0 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f0f08005770 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f0001d430 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0f080059b0 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f20d73b80 10 client.15993 fetch_fsmap learned FSMap version 40 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559933a3b880 con 0x559933a49f30 2024-04-26T18:06:15.559 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.555+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f0001d430 con 0x559933a49f30 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 40) ==== 8342+0+0 (secure 0 0 0) 0x7f0f08013070 con 0x559933a49f30 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 10 client.15993 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 20 client.15993 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a4a850 0x559933ac7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 4 client.15993 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}] 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}) -- 0x55993399e440 con 0x559933a4a850 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a4a850 0x559933ac7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0f0ffff700 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a4a850 0x559933ac7f40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e9109976ddb413 server_cookie=1379289e20ceed4c in_seq=0 out_seq=0 2024-04-26T18:06:15.560 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:15.556+0000 7f0eef7fe700 10 client.15993 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 -- 172.21.15.92:0/2413931851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74101b80 msgr2=0x7f2f74102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 --2- 172.21.15.92:0/2413931851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74101b80 0x7f2f74102000 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009900 tx=0x7f2f7002a410 comp rx=0 tx=0).stop 2024-04-26T18:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 -- 172.21.15.92:0/2413931851 shutdown_connections 2024-04-26T18:06:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 --2- 172.21.15.92:0/2413931851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f74102540 0x7f2f7410e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 --2- 172.21.15.92:0/2413931851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74101b80 0x7f2f74102000 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 --2- 172.21.15.92:0/2413931851 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f741067d0 0x7f2f74106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 -- 172.21.15.92:0/2413931851 >> 172.21.15.92:0/2413931851 conn(0x7f2f74077630 msgr2=0x7f2f74077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 -- 172.21.15.92:0/2413931851 shutdown_connections 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.856+0000 7f2f7b322640 1 -- 172.21.15.92:0/2413931851 wait complete. 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 Processor -- start 2024-04-26T18:06:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 -- start start 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 0x7f2f74199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f741067d0 0x7f2f7419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74111ab0 con 0x7f2f74102540 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74111930 con 0x7f2f741067d0 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f7b322640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74111c30 con 0x7f2f74101b80 2024-04-26T18:06:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f788bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f788bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41720/0 (socket says 172.21.15.92:41720) 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f788bd640 1 -- 172.21.15.92:0/973311383 learned_addr learned my addr 172.21.15.92:0/973311383 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f798bf640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f741067d0 0x7f2f7419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f790be640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 0x7f2f74199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.857+0000 7f2f788bd640 1 -- 172.21.15.92:0/973311383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 msgr2=0x7f2f74199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f788bd640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 0x7f2f74199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f788bd640 1 -- 172.21.15.92:0/973311383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f741067d0 msgr2=0x7f2f7419d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f788bd640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f741067d0 0x7f2f7419d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f788bd640 1 -- 172.21.15.92:0/973311383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7419dff0 con 0x7f2f74102540 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f790be640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 0x7f2f74199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f788bd640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2f70005940 tx=0x7f2f700040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f6a7fc640 1 -- 172.21.15.92:0/973311383 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7003f030 con 0x7f2f74102540 2024-04-26T18:06:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f6a7fc640 1 -- 172.21.15.92:0/973311383 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f700044c0 con 0x7f2f74102540 2024-04-26T18:06:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7419e280 con 0x7f2f74102540 2024-04-26T18:06:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f6a7fc640 1 -- 172.21.15.92:0/973311383 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70035070 con 0x7f2f74102540 2024-04-26T18:06:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.858+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f741a5b70 con 0x7f2f74102540 2024-04-26T18:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.860+0000 7f2f6a7fc640 1 -- 172.21.15.92:0/973311383 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2f70042030 con 0x7f2f74102540 2024-04-26T18:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 Processor -- start 2024-04-26T18:06:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 -- start start 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d535f00 0x55ea2d5362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d540ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d49c460 con 0x55ea2d5410e0 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f6a7fc640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 0x7f2f600a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d456590 con 0x55ea2d536820 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f7e033740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d498420 con 0x55ea2d535f00 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f798bf640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 0x7f2f600a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41736/0 (socket says 172.21.15.92:41736) 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 -- 172.21.15.92:0/1882949939 learned_addr learned my addr 172.21.15.92:0/1882949939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f798bf640 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d535f00 0x55ea2d5362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f790be640 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d540ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f6a7fc640 1 -- 172.21.15.92:0/973311383 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f2f700f0880 con 0x7f2f74102540 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 -- 172.21.15.92:0/1882949939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d535f00 msgr2=0x55ea2d5362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d535f00 0x55ea2d5362e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 -- 172.21.15.92:0/1882949939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 msgr2=0x55ea2d540ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d540ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.861+0000 7f2f788bd640 1 -- 172.21.15.92:0/1882949939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea2d4630d0 con 0x55ea2d5410e0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f7008b160 tx=0x7f2f7008f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ec43cd6afe2553 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f798bf640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 0x7f2f600a6280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c005fd0 tx=0x7f2f6c009be0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/1882949939 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700bcee0 con 0x55ea2d5410e0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/1882949939 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f700bc7e0 con 0x55ea2d5410e0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f5f7fe640 1 -- 172.21.15.92:0/1882949939 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b8e50 con 0x55ea2d5410e0 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f7e033740 1 -- 172.21.15.92:0/1882949939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 msgr2=0x55ea2d5434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.862+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2f7008b160 tx=0x7f2f7008f2d0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- 172.21.15.92:0/1882949939 shutdown_connections 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d5410e0 0x55ea2d5434d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d540ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1882949939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d535f00 0x55ea2d5362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- 172.21.15.92:0/1882949939 >> 172.21.15.92:0/1882949939 conn(0x55ea2d532410 msgr2=0x55ea2d5327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- 172.21.15.92:0/1882949939 shutdown_connections 2024-04-26T18:06:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- 172.21.15.92:0/1882949939 wait complete. 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- start start 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 Processor -- start 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d53e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d53eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d543ad0 con 0x55ea2d535f00 2024-04-26T18:06:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d423b60 con 0x55ea2d5410e0 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ea2d543c50 con 0x55ea2d536820 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f7e033740 10 client.0 _ll_register_callbacks cb 0x55ea2d4482b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41746/0 (socket says 172.21.15.92:41746) 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.863+0000 7f2f790be640 1 -- 172.21.15.92:0/3917015584 learned_addr learned my addr 172.21.15.92:0/3917015584 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f788bd640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d53e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f798bf640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d53eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 -- 172.21.15.92:0/3917015584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 msgr2=0x55ea2d53e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d53e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 -- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 msgr2=0x55ea2d53eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d53eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 -- 172.21.15.92:0/3917015584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea2d1ae210 con 0x55ea2d535f00 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f788bd640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d53e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f790be640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2f640137c0 tx=0x7f2f64013bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e2d2ef2f863cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64020060 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f2f64011dd0 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f700bc7e0 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f6400f450 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f7e033740 10 client.16005 fetch_fsmap learned FSMap version 40 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ea2d27a620 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f700bc7e0 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.864+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 40) ==== 8342+0+0 (secure 0 0 0) 0x7f2f6401a030 con 0x55ea2d535f00 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 10 client.16005 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T18:06:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 20 client.16005 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d551010 0x55ea2d5534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 4 client.16005 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea2d4aa070 con 0x55ea2d551010 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f788bd640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d551010 0x55ea2d5534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f5cff9640 10 client.16005 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.865+0000 7f2f788bd640 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d551010 0x55ea2d5534a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76f652b36f8784a8 server_cookie=8490e85b78cc5079 in_seq=0 out_seq=0 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f5cff9640 1 -- 172.21.15.92:0/3917015584 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea2d4aa070 con 0x55ea2d551010 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f5cff9640 10 client.16005 handle_command_reply: tid=0 2024-04-26T18:06:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 client.16005 shutdown 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 msgr2=0x55ea2d53e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2f640137c0 tx=0x7f2f64013bc0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 shutdown_connections 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d551010 0x55ea2d5534a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d53eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d53e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f5cff9640 0 client.16005 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 --2- 172.21.15.92:0/3917015584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d53e080 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 >> 172.21.15.92:0/3917015584 conn(0x55ea2d532410 msgr2=0x55ea2d538190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 shutdown_connections 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 1 -- 172.21.15.92:0/3917015584 wait complete. 2024-04-26T18:06:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.866+0000 7f2f7e033740 20 client.16005 trim_cache size 0 max 16384 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 Processor -- start 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 -- start start 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d558db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d5592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741b0d40 con 0x55ea2d535f00 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741ae610 con 0x55ea2d5410e0 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f7e033740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741ac480 con 0x55ea2d536820 2024-04-26T18:06:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41752/0 (socket says 172.21.15.92:41752) 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.881+0000 7f2f790be640 1 -- 172.21.15.92:0/219148531 learned_addr learned my addr 172.21.15.92:0/219148531 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f798bf640 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d5592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 -- 172.21.15.92:0/219148531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 msgr2=0x55ea2d558db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d558db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 -- 172.21.15.92:0/219148531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 msgr2=0x55ea2d5592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d5592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 -- 172.21.15.92:0/219148531 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea2d54ddd0 con 0x55ea2d535f00 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f790be640 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f640238a0 tx=0x7f2f64011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12db247016fe2d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f5effd640 1 -- 172.21.15.92:0/219148531 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64023e60 con 0x55ea2d535f00 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f5effd640 1 -- 172.21.15.92:0/219148531 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f64023c90 con 0x55ea2d535f00 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f5effd640 1 -- 172.21.15.92:0/219148531 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400fd00 con 0x55ea2d535f00 2024-04-26T18:06:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f7e033740 1 -- 172.21.15.92:0/219148531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 msgr2=0x55ea2d54c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.882+0000 7f2f7e033740 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f640238a0 tx=0x7f2f64011860 comp rx=0 tx=0).stop 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- 172.21.15.92:0/219148531 shutdown_connections 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d5410e0 0x55ea2d5592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d536820 0x55ea2d558db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- 172.21.15.92:0/219148531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d54c900 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- 172.21.15.92:0/219148531 >> 172.21.15.92:0/219148531 conn(0x55ea2d532410 msgr2=0x55ea2d5327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- 172.21.15.92:0/219148531 shutdown_connections 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- 172.21.15.92:0/219148531 wait complete. 2024-04-26T18:06:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- start start 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 Processor -- start 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d544ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d5410e0 0x55ea2d5453e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741acad0 con 0x55ea2d535f00 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741adf40 con 0x55ea2d536820 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2f741ad1a0 con 0x55ea2d5410e0 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f7e033740 10 client.0 _ll_register_callbacks cb 0x7f2f64009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f790be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41760/0 (socket says 172.21.15.92:41760) 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.883+0000 7f2f790be640 1 -- 172.21.15.92:0/1233461629 learned_addr learned my addr 172.21.15.92:0/1233461629 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d544ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 -- 172.21.15.92:0/1233461629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d5410e0 msgr2=0x55ea2d5453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d5410e0 0x55ea2d5453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 -- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 msgr2=0x55ea2d544ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d544ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 -- 172.21.15.92:0/1233461629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea2d5b66f0 con 0x55ea2d535f00 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d544ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f790be640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009870 tx=0x7f2f640118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850037588e649d0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6403c060 con 0x55ea2d535f00 2024-04-26T18:06:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f64023c90 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8585+0+0 (secure 0 0 0) 0x7f2f6400fa00 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2f6400fc00 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f7e033740 10 client.16011 fetch_fsmap learned FSMap version 40 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ea2d5b7a00 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f64023c90 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 40) ==== 8342+0+0 (secure 0 0 0) 0x7f2f6401a040 con 0x55ea2d535f00 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f7e033740 10 client.16011 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.884+0000 7f2f7e033740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f7e033740 20 client.16011 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d5b8050 0x55ea2d5ba470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f7e033740 4 client.16011 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:06:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea2d4a3ee0 con 0x55ea2d5b8050 2024-04-26T18:06:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d5b8050 0x55ea2d5ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f5cff9640 10 client.16011 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:16.885+0000 7f2f788bd640 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d5b8050 0x55ea2d5ba470 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905bd719b9a0997d server_cookie=9b08b4f9c522a8d6 in_seq=0 out_seq=0 2024-04-26T18:06:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:16 smithi189 ceph-mon[32756]: pgmap v204: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:16 smithi156 ceph-mon[32679]: pgmap v204: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:16 smithi092 ceph-mon[29156]: pgmap v204: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:18.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 365.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:18 smithi189 ceph-mon[32756]: pgmap v205: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:18 smithi156 ceph-mon[32679]: pgmap v205: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:18 smithi092 ceph-mon[29156]: pgmap v205: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 25 MiB/s wr, 1.82k op/s 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:20 smithi189 ceph-mon[32756]: pgmap v206: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 266 op/s 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.938s CPU time. 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 systemd[1]: Starting Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:06:20.947 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 podman[67703]: 2024-04-26 18:06:20.771930389 +0000 UTC m=+0.017965086 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:06:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:20 smithi156 ceph-mon[32679]: pgmap v206: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 266 op/s 2024-04-26T18:06:21.216 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:20 smithi189 podman[67703]: 2024-04-26 18:06:20.948007287 +0000 UTC m=+0.194041972 container create 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T18:06:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:20 smithi092 ceph-mon[29156]: pgmap v206: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.5 MiB/s wr, 266 op/s 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 41, 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 18, 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:06:21.250 INFO:teuthology.orchestra.run.smithi092.stdout: "ef692ff5": { 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 18, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "CANCELED", 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 91.7, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": true, 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "QUIESCING", 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 5.7 2024-04-26T18:06:21.251 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.248+0000 7f0eef7fe700 1 -- 172.21.15.92:0/3617178036 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: -125 ) ==== 8+0+590 (crc 0 0 0) 0x55993399e440 con 0x559933a4a850 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.248+0000 7f0eef7fe700 10 client.15993 handle_command_reply: tid=0 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.248+0000 7f0f20d73b80 1 client.15993 shutdown 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 msgr2=0x559933ac4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f08015000 tx=0x7f0f080060e0 comp rx=0 tx=0).stop 2024-04-26T18:06:21.252 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 shutdown_connections 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559933a4a850 0x559933ac7f40 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0eef7fe700 0 client.15993 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559933a49f30 0x559933ac4620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559933972750 0x559933a538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 --2- 172.21.15.92:0/3617178036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559933a44900 0x559933a53e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 >> 172.21.15.92:0/3617178036 conn(0x559933a3f380 msgr2=0x559933a4d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 shutdown_connections 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 1 -- 172.21.15.92:0/3617178036 wait complete. 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:06:21.249+0000 7f0f20d73b80 20 client.15993 trim_cache size 0 max 16384 2024-04-26T18:06:21.253 INFO:teuthology.orchestra.run.smithi092.stderr:Error ECANCELED: 2024-04-26T18:06:21.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 podman[67703]: 2024-04-26 18:06:21.217811853 +0000 UTC m=+0.463846539 container init 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:06:21.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 podman[67703]: 2024-04-26 18:06:21.220526865 +0000 UTC m=+0.466561560 container start 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T18:06:21.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mds[67723]: -- 172.21.15.189:0/3309919705 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3e637fa40 con 0x55b3e6352800 2024-04-26T18:06:21.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: starting mds.f at 2024-04-26T18:06:21.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 bash[67703]: 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 2024-04-26T18:06:21.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:21 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:06:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: daemon mds.f restarted 2024-04-26T18:06:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:boot 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:06:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:21 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:22.045 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-04-26T18:06:22.046 WARNING:tasks.quiescer.fs.[cephfs]:Quiesce set got cancelled (cap = 10).Won't raise an error since this could be a failover, will wait for the next quiesce attempt 2024-04-26T18:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: daemon mds.f restarted 2024-04-26T18:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:boot 2024-04-26T18:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:06:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:06:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:21 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: daemon mds.f restarted 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: osdmap e94: 12 total, 12 up, 12 in 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:boot 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:06:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:21 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:23.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 370.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:23 smithi189 ceph-mon[32756]: pgmap v208: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:06:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:23 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:resolve 2024-04-26T18:06:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:23 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:23 smithi156 ceph-mon[32679]: pgmap v208: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:06:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:23 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:resolve 2024-04-26T18:06:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:23 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:23 smithi092 ceph-mon[29156]: pgmap v208: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:06:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:23 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:resolve 2024-04-26T18:06:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:23 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f5cff9640 1 -- 172.21.15.92:0/1233461629 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea2d4a3ee0 con 0x55ea2d5b8050 2024-04-26T18:06:24.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f5cff9640 10 client.16011 handle_command_reply: tid=0 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 client.16011 shutdown 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 msgr2=0x55ea2d544960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009870 tx=0x7f2f640118d0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 shutdown_connections 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55ea2d5b8050 0x55ea2d5ba470 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ea2d5410e0 0x55ea2d5453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ea2d536820 0x55ea2d544ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f5cff9640 0 client.16011 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 --2- 172.21.15.92:0/1233461629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ea2d535f00 0x55ea2d544960 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 >> 172.21.15.92:0/1233461629 conn(0x55ea2d532410 msgr2=0x55ea2d530d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 shutdown_connections 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.838+0000 7f2f7e033740 1 -- 172.21.15.92:0/1233461629 wait complete. 2024-04-26T18:06:24.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7e033740 20 client.16011 trim_cache size 0 max 16384 2024-04-26T18:06:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:06:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:06:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:06:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:06:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 msgr2=0x7f2f600a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 0x7f2f600a6280 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c005fd0 tx=0x7f2f6c009be0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 msgr2=0x7f2f74199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:24.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2f70005940 tx=0x7f2f700040c0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 shutdown_connections 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2f600a3dc0 0x7f2f600a6280 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f741067d0 0x7f2f7419d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2f74102540 0x7f2f74199540 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 --2- 172.21.15.92:0/973311383 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2f74101b80 0x7f2f74199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 >> 172.21.15.92:0/973311383 conn(0x7f2f74077630 msgr2=0x7f2f7406b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 shutdown_connections 2024-04-26T18:06:24.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:24.839+0000 7f2f7b322640 1 -- 172.21.15.92:0/973311383 wait complete. 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: pgmap v209: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 888 KiB/s wr, 119 op/s 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:reconnect 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:24 smithi189 ceph-mon[32756]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: pgmap v209: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 888 KiB/s wr, 119 op/s 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:reconnect 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:24 smithi156 ceph-mon[32679]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: pgmap v209: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 888 KiB/s wr, 119 op/s 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:reconnect 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:24 smithi092 ceph-mon[29156]: osdmap e95: 12 total, 12 up, 12 in 2024-04-26T18:06:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:25 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:rejoin 2024-04-26T18:06:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:25 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:25 smithi189 ceph-mon[32756]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:06:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:25 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:rejoin 2024-04-26T18:06:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:25 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:25 smithi156 ceph-mon[32679]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:06:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:25 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:rejoin 2024-04-26T18:06:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:25 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:25 smithi092 ceph-mon[29156]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:06:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: pgmap v211: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:06:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:06:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:active 2024-04-26T18:06:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:26 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: pgmap v211: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:active 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:26 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: pgmap v211: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/180692647,v1:172.21.15.189:6839/180692647] up:active 2024-04-26T18:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:26 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:28.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 375.0 s, 2182.0 tps, lat 169.561 ms stddev 1531.014 2024-04-26T18:06:28.827 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:06:28 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:06:28.466+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:06:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:28 smithi189 ceph-mon[32756]: pgmap v212: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 520 KiB/s wr, 67 op/s 2024-04-26T18:06:29.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:28 smithi156 ceph-mon[32679]: pgmap v212: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 520 KiB/s wr, 67 op/s 2024-04-26T18:06:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:28 smithi092 ceph-mon[29156]: pgmap v212: 97 pgs: 97 active+clean; 3.5 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 520 KiB/s wr, 67 op/s 2024-04-26T18:06:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-mon[32756]: pgmap v213: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-04-26T18:06:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efed2222700 time 2024-04-26T18:06:30.843561+0000 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efedc84b3dd] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: clone() 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:30.844+0000 7efed2222700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efed2222700 time 2024-04-26T18:06:30.843561+0000 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efedc84b3dd] 2024-04-26T18:06:31.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: clone() 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: *** Caught signal (Aborted) ** 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: in thread 7efed2222700 thread_name:ms_dispatch 2024-04-26T18:06:31.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efedb5d3d20] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: gsignal() 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: abort() 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efedc84b437] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 16: clone() 2024-04-26T18:06:31.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:30.846+0000 7efed2222700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: in thread 7efed2222700 thread_name:ms_dispatch 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efedb5d3d20] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: gsignal() 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: abort() 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efedc84b437] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 16: clone() 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: -1> 2024-04-26T18:06:30.844+0000 7efed2222700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efed2222700 time 2024-04-26T18:06:30.843561+0000 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efedc84b3dd] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: clone() 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 0> 2024-04-26T18:06:30.846+0000 7efed2222700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: in thread 7efed2222700 thread_name:ms_dispatch 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efedb5d3d20] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: gsignal() 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: abort() 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efedc84b437] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 16: clone() 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: -1> 2024-04-26T18:06:30.844+0000 7efed2222700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efed2222700 time 2024-04-26T18:06:30.843561+0000 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efedc84b3dd] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.147 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: clone() 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 0> 2024-04-26T18:06:30.846+0000 7efed2222700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: in thread 7efed2222700 thread_name:ms_dispatch 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efedb5d3d20] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2: gsignal() 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 3: abort() 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efedc84b437] 2024-04-26T18:06:31.148 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efedc84b5a3] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56275525d822] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5627551cd598] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5627551cfc17] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5627550c8d0b] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5627550c92ac] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5627550b1fad] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efedcadfe20] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 13: (DispatchQueue::entry()+0x51f) [0x7efedcadcfdf] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efedcbaffc1] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efedb5c91ca] 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 16: clone() 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67548]: 2024-04-26T18:06:31.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:30 smithi189 podman[67762]: 2024-04-26 18:06:30.91588602 +0000 UTC m=+0.018584638 container died b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T18:06:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:30 smithi156 ceph-mon[32679]: pgmap v213: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-04-26T18:06:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:30 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:30 smithi092 ceph-mon[29156]: pgmap v213: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 5.0 MiB/s wr, 416 op/s 2024-04-26T18:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:30 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:32.000 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:31 smithi189 podman[67762]: 2024-04-26 18:06:31.748051364 +0000 UTC m=+0.850750026 container remove b450096a2f28b14d0cf113e4a3e6df77b632a5fb335bf6402fb97fc75238a334 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-26T18:06:32.000 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:31 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:06:32.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:31 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:31 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:31 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:32.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:32 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:06:32.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:32 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.169s CPU time. 2024-04-26T18:06:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:32 smithi189 ceph-mon[32756]: pgmap v214: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-04-26T18:06:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:32 smithi156 ceph-mon[32679]: pgmap v214: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-04-26T18:06:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:32 smithi092 ceph-mon[29156]: pgmap v214: 97 pgs: 97 active+clean; 3.5 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 4.1 MiB/s wr, 344 op/s 2024-04-26T18:06:33.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 380.0 s, 2098.6 tps, lat 26.114 ms stddev 31.493 2024-04-26T18:06:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:34 smithi189 ceph-mon[32756]: pgmap v215: 97 pgs: 97 active+clean; 3.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.0 MiB/s wr, 498 op/s 2024-04-26T18:06:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:34 smithi156 ceph-mon[32679]: pgmap v215: 97 pgs: 97 active+clean; 3.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.0 MiB/s wr, 498 op/s 2024-04-26T18:06:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:34 smithi092 ceph-mon[29156]: pgmap v215: 97 pgs: 97 active+clean; 3.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.0 MiB/s wr, 498 op/s 2024-04-26T18:06:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:36 smithi189 ceph-mon[32756]: pgmap v216: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 8.1 MiB/s wr, 577 op/s 2024-04-26T18:06:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:36 smithi156 ceph-mon[32679]: pgmap v216: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 8.1 MiB/s wr, 577 op/s 2024-04-26T18:06:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:36 smithi092 ceph-mon[29156]: pgmap v216: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 8.1 MiB/s wr, 577 op/s 2024-04-26T18:06:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 -- 172.21.15.92:0/4067014561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8101810 msgr2=0x7fd8f810f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/4067014561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8101810 0x7fd8f810f7e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009cd0 tx=0x7fd8f002a8e0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 -- 172.21.15.92:0/4067014561 shutdown_connections 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/4067014561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8101810 0x7fd8f810f7e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/4067014561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 0x7fd8f81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/4067014561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8107930 0x7fd8f8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 -- 172.21.15.92:0/4067014561 >> 172.21.15.92:0/4067014561 conn(0x7fd8f8077d50 msgr2=0x7fd8f80ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 -- 172.21.15.92:0/4067014561 shutdown_connections 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.935+0000 7fd8fe91c640 1 -- 172.21.15.92:0/4067014561 wait complete. 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 Processor -- start 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 -- start start 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 0x7fd8f8199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8101810 0x7fd8f81996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8112cf0 con 0x7fd8f8107930 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8112b70 con 0x7fd8f8101810 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fe91c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8112e70 con 0x7fd8f8100e50 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fceb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.936+0000 7fd8fceb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43388/0 (socket says 172.21.15.92:43388) 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 -- 172.21.15.92:0/3632369895 learned_addr learned my addr 172.21.15.92:0/3632369895 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8101810 0x7fd8f81996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 0x7fd8f8199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 -- 172.21.15.92:0/3632369895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 msgr2=0x7fd8f8199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 0x7fd8f8199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 -- 172.21.15.92:0/3632369895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8101810 msgr2=0x7fd8f81996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8101810 0x7fd8f81996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 -- 172.21.15.92:0/3632369895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f819e180 con 0x7fd8f8107930 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fceb9640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005cc0 tx=0x7fd8f0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8f57fa640 1 -- 172.21.15.92:0/3632369895 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004450 con 0x7fd8f8107930 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8f57fa640 1 -- 172.21.15.92:0/3632369895 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8f0031c90 con 0x7fd8f8107930 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8f57fa640 1 -- 172.21.15.92:0/3632369895 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0030e70 con 0x7fd8f8107930 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f819e410 con 0x7fd8f8107930 2024-04-26T18:06:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.937+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f81a5d00 con 0x7fd8f8107930 2024-04-26T18:06:37.948 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.939+0000 7fd8f57fa640 1 -- 172.21.15.92:0/3632369895 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd8f00045f0 con 0x7fd8f8107930 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 Processor -- start 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 -- start start 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c1002e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c10aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e42c066460 con 0x55e42c10b0e0 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55e42c020590 con 0x55e42c100820 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd901631740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e42c062420 con 0x55e42c0fff00 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8f57fa640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 0x7fd8e40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43390/0 (socket says 172.21.15.92:43390) 2024-04-26T18:06:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8f77fe640 1 -- 172.21.15.92:0/3547544052 learned_addr learned my addr 172.21.15.92:0/3547544052 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8fceb9640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 0x7fd8e40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.940+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c1002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c10aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f57fa640 1 -- 172.21.15.92:0/3632369895 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8627+0+0 (secure 0 0 0) 0x7fd8f002e030 con 0x7fd8f8107930 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 -- 172.21.15.92:0/3547544052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 msgr2=0x55e42c1002e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c1002e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 -- 172.21.15.92:0/3547544052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 msgr2=0x55e42c10aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c10aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 -- 172.21.15.92:0/3547544052 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42c02d0d0 con 0x55e42c10b0e0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006aa0 tx=0x7fd8e8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27f80e2d7d22ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8fceb9640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 0x7fd8e40a6280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00ba910 tx=0x7fd8f0090a30 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8ee7fc640 1 -- 172.21.15.92:0/3547544052 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8015760 con 0x55e42c10b0e0 2024-04-26T18:06:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8ee7fc640 1 -- 172.21.15.92:0/3547544052 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e801d070 con 0x55e42c10b0e0 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.941+0000 7fd8ee7fc640 1 -- 172.21.15.92:0/3547544052 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8018ab0 con 0x55e42c10b0e0 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- 172.21.15.92:0/3547544052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 msgr2=0x55e42c10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8006aa0 tx=0x7fd8e8009510 comp rx=0 tx=0).stop 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- 172.21.15.92:0/3547544052 shutdown_connections 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c10d4d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c10aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 --2- 172.21.15.92:0/3547544052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c1002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- 172.21.15.92:0/3547544052 >> 172.21.15.92:0/3547544052 conn(0x55e42c0fc410 msgr2=0x55e42c0fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- 172.21.15.92:0/3547544052 shutdown_connections 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- 172.21.15.92:0/3547544052 wait complete. 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 -- start start 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.942+0000 7fd901631740 1 Processor -- start 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.951 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c100820 0x55e42c108670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c10b0e0 0x55e42c108bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e42c10dcb0 con 0x55e42c0fff00 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55e42bfedb60 con 0x55e42c10b0e0 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55e42c10de30 con 0x55e42c100820 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 10 client.0 _ll_register_callbacks cb 0x55e42c0122b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43398/0 (socket says 172.21.15.92:43398) 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 -- 172.21.15.92:0/264777128 learned_addr learned my addr 172.21.15.92:0/264777128 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c100820 0x55e42c108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 -- 172.21.15.92:0/264777128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c100820 msgr2=0x55e42c108670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c100820 0x55e42c108670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 -- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c10b0e0 msgr2=0x55e42c108bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c10b0e0 0x55e42c108bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 -- 172.21.15.92:0/264777128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42bd78210 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8004700 tx=0x7fd8e8009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37da14d83db58cac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8026070 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8627+0+0 (secure 0 0 0) 0x7fd8e8015760 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.943+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e801d070 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd8e8019e60 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 10 client.16026 fetch_fsmap learned FSMap version 49 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e42be44620 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e801d070 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8346+0+0 (secure 0 0 0) 0x7fd8e8022660 con 0x55e42c0fff00 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 10 client.16026 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T18:06:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 20 client.16026 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c11b170 0x55e42c11d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 4 client.16026 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e42c074070 con 0x55e42c11b170 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.944+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c11b170 0x55e42c11d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.945+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c11b170 0x55e42c11d560 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2045127b2c6cecf4 server_cookie=aa573c686123aba0 in_seq=0 out_seq=0 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.945+0000 7fd8d77fe640 10 client.16026 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd8d77fe640 1 -- 172.21.15.92:0/264777128 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e42c074070 con 0x55e42c11b170 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd8d77fe640 10 client.16026 handle_command_reply: tid=0 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 client.16026 shutdown 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 msgr2=0x55e42c108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8004700 tx=0x7fd8e8009d80 comp rx=0 tx=0).stop 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 shutdown_connections 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c11b170 0x55e42c11d560 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c10b0e0 0x55e42c108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c100820 0x55e42c108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 --2- 172.21.15.92:0/264777128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c0fff00 0x55e42c108130 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd8d77fe640 0 client.16026 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 >> 172.21.15.92:0/264777128 conn(0x55e42c0fc410 msgr2=0x55e42c102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 shutdown_connections 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 1 -- 172.21.15.92:0/264777128 wait complete. 2024-04-26T18:06:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.946+0000 7fd901631740 20 client.16026 trim_cache size 0 max 16384 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.960+0000 7fd901631740 1 Processor -- start 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 -- start start 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c116b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c0fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81b0e60 con 0x55e42c10b0e0 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ae700 con 0x55e42c100820 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd901631740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ac570 con 0x55e42c0fff00 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43414/0 (socket says 172.21.15.92:43414) 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 -- 172.21.15.92:0/1194564263 learned_addr learned my addr 172.21.15.92:0/1194564263 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c0fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 -- 172.21.15.92:0/1194564263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 msgr2=0x55e42c116b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c116b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 -- 172.21.15.92:0/1194564263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 msgr2=0x55e42c0fbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c0fbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 -- 172.21.15.92:0/1194564263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42c100650 con 0x55e42c10b0e0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x55e42c10a9d0 tx=0x7fd8e8018510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab753326090ff80c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8edffb640 1 -- 172.21.15.92:0/1194564263 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8026040 con 0x55e42c10b0e0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8edffb640 1 -- 172.21.15.92:0/1194564263 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e801d070 con 0x55e42c10b0e0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.961+0000 7fd8edffb640 1 -- 172.21.15.92:0/1194564263 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80195f0 con 0x55e42c10b0e0 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- 172.21.15.92:0/1194564263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 msgr2=0x55e42c113460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x55e42c10a9d0 tx=0x7fd8e8018510 comp rx=0 tx=0).stop 2024-04-26T18:06:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- 172.21.15.92:0/1194564263 shutdown_connections 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c113460 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c0fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 --2- 172.21.15.92:0/1194564263 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c116b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- 172.21.15.92:0/1194564263 >> 172.21.15.92:0/1194564263 conn(0x55e42c0fc410 msgr2=0x55e42c102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- 172.21.15.92:0/1194564263 shutdown_connections 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- 172.21.15.92:0/1194564263 wait complete. 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.962+0000 7fd901631740 1 -- start start 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 Processor -- start 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c105e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c122440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81acbc0 con 0x55e42c10b0e0 2024-04-26T18:06:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ae030 con 0x55e42c100820 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81ad290 con 0x55e42c0fff00 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd901631740 10 client.0 _ll_register_callbacks cb 0x7fd8e8009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43418/0 (socket says 172.21.15.92:43418) 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 -- 172.21.15.92:0/2672069842 learned_addr learned my addr 172.21.15.92:0/2672069842 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c105e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 -- 172.21.15.92:0/2672069842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 msgr2=0x55e42c105e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c105e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 -- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 msgr2=0x55e42c122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 -- 172.21.15.92:0/2672069842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42c1843d0 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8f77fe640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80192d0 tx=0x7fd8e80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4567982a92d10993 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.963+0000 7fd8d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8048060 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8627+0+0 (secure 0 0 0) 0x7fd8e80195a0 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e801d070 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd8e8026070 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 10 client.16032 fetch_fsmap learned FSMap version 49 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55e42c1854f0 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8e801d070 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8346+0+0 (secure 0 0 0) 0x7fd8e8043470 con 0x55e42c10b0e0 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 10 client.16032 fetch_fsmap finished waiting for FSMap version 49 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 10 client.16032 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 20 client.16032 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c185b50 0x55e42c187f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 4 client.16032 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e42c06dee0 con 0x55e42c185b50 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.964+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c185b50 0x55e42c187f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.966+0000 7fd8f7fff640 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c185b50 0x55e42c187f70 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7902d987f0253daf server_cookie=22d07a083eb60552 in_seq=0 out_seq=0 2024-04-26T18:06:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:37.970+0000 7fd8d77fe640 10 client.16032 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:38.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:38 smithi189 ceph-mon[32756]: pgmap v217: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-04-26T18:06:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:38 smithi156 ceph-mon[32679]: pgmap v217: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-04-26T18:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:38 smithi092 ceph-mon[29156]: pgmap v217: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 7.3 MiB/s wr, 523 op/s 2024-04-26T18:06:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:40 smithi189 ceph-mon[32756]: pgmap v218: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 7.7 MiB/s wr, 565 op/s 2024-04-26T18:06:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:40 smithi156 ceph-mon[32679]: pgmap v218: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 7.7 MiB/s wr, 565 op/s 2024-04-26T18:06:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:40 smithi092 ceph-mon[29156]: pgmap v218: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 7.7 MiB/s wr, 565 op/s 2024-04-26T18:06:42.416 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:06:42.416 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 systemd[1]: Stopped Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:06:42.416 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.169s CPU time. 2024-04-26T18:06:42.416 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 systemd[1]: Starting Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:06:42.416 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 podman[67858]: 2024-04-26 18:06:42.280327284 +0000 UTC m=+0.018863832 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:06:42.675 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 podman[67858]: 2024-04-26 18:06:42.41718288 +0000 UTC m=+0.155719423 container create 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:06:42.675 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 podman[67858]: 2024-04-26 18:06:42.65164002 +0000 UTC m=+0.390176561 container init 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424) 2024-04-26T18:06:42.675 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 podman[67858]: 2024-04-26 18:06:42.654387412 +0000 UTC m=+0.392923954 container start 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:06:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: pgmap v219: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 322 op/s 2024-04-26T18:06:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: daemon mds.i restarted 2024-04-26T18:06:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:06:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:boot 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-mds[67877]: -- 172.21.15.189:0/2158462983 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de6a9d5a40 con 0x55de6a9a8800 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: starting mds.i at 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 bash[67858]: 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 2024-04-26T18:06:43.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:06:42 smithi189 systemd[1]: Started Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:06:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: pgmap v219: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 322 op/s 2024-04-26T18:06:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: daemon mds.i restarted 2024-04-26T18:06:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:06:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:boot 2024-04-26T18:06:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:42 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: pgmap v219: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.6 MiB/s wr, 322 op/s 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: daemon mds.i restarted 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: osdmap e96: 12 total, 12 up, 12 in 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:boot 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:06:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:42 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:43.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 390.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:44 smithi189 ceph-mon[32756]: pgmap v221: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 231 op/s 2024-04-26T18:06:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:44 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:resolve 2024-04-26T18:06:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:44 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:44 smithi156 ceph-mon[32679]: pgmap v221: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 231 op/s 2024-04-26T18:06:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:44 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:resolve 2024-04-26T18:06:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:44 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:44 smithi092 ceph-mon[29156]: pgmap v221: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 231 op/s 2024-04-26T18:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:44 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:resolve 2024-04-26T18:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:44 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd8d77fe640 1 -- 172.21.15.92:0/2672069842 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e42c06dee0 con 0x55e42c185b50 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd8d77fe640 10 client.16032 handle_command_reply: tid=0 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 client.16032 shutdown 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 msgr2=0x55e42c122b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80192d0 tx=0x7fd8e80191d0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 shutdown_connections 2024-04-26T18:06:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55e42c185b50 0x55e42c187f70 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e42c10b0e0 0x55e42c122b80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e42c100820 0x55e42c122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 --2- 172.21.15.92:0/2672069842 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55e42c0fff00 0x55e42c105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd8d77fe640 0 client.16032 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 >> 172.21.15.92:0/2672069842 conn(0x55e42c0fc410 msgr2=0x55e42c109960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 shutdown_connections 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 1 -- 172.21.15.92:0/2672069842 wait complete. 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.900+0000 7fd901631740 20 client.16032 trim_cache size 0 max 16384 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:06:45.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:06:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:06:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 msgr2=0x7fd8e40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 0x7fd8e40a6280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00ba910 tx=0x7fd8f0090a30 comp rx=0 tx=0).stop 2024-04-26T18:06:45.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 msgr2=0x7fd8f819da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0005cc0 tx=0x7fd8f0003c20 comp rx=0 tx=0).stop 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 shutdown_connections 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd8e40a3dc0 0x7fd8e40a6280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd8f8107930 0x7fd8f819da50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd8f8101810 0x7fd8f81996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 --2- 172.21.15.92:0/3632369895 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8f8100e50 0x7fd8f8199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 >> 172.21.15.92:0/3632369895 conn(0x7fd8f8077d50 msgr2=0x7fd8f8105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 shutdown_connections 2024-04-26T18:06:45.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:45.901+0000 7fd8fe91c640 1 -- 172.21.15.92:0/3632369895 wait complete. 2024-04-26T18:06:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:45 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:06:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:45 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:reconnect 2024-04-26T18:06:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:45 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:45 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00399992 2024-04-26T18:06:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:45 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:06:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:45 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:reconnect 2024-04-26T18:06:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:45 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:45 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00399992 2024-04-26T18:06:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:45 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:06:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:45 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:reconnect 2024-04-26T18:06:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:45 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:45 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00399992 2024-04-26T18:06:47.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:46 smithi092 ceph-mon[29156]: pgmap v222: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:47.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:rejoin 2024-04-26T18:06:47.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:46 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:47.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:46 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:46 smithi156 ceph-mon[32679]: pgmap v222: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:rejoin 2024-04-26T18:06:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:46 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:46 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:46 smithi189 ceph-mon[32756]: pgmap v222: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:rejoin 2024-04-26T18:06:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:46 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:46 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:06:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:47 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:47 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:06:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:47 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:active 2024-04-26T18:06:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:47 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:47 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:47 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:47 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:06:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:47 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:active 2024-04-26T18:06:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:47 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:47 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 395.0 s, 1379.9 tps, lat 250.578 ms stddev 1899.365 2024-04-26T18:06:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:47 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:06:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:47 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:06:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:47 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3441519497,v1:172.21.15.189:6835/3441519497] up:active 2024-04-26T18:06:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:47 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:06:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:47 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:48.912 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:06:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:06:48.467+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:06:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:48 smithi156 ceph-mon[32679]: pgmap v223: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:48 smithi092 ceph-mon[29156]: pgmap v223: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:48 smithi189 ceph-mon[32756]: pgmap v223: 97 pgs: 97 active+clean; 3.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 793 KiB/s wr, 103 op/s 2024-04-26T18:06:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:06:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:50 smithi156 ceph-mon[32679]: pgmap v224: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:50 smithi092 ceph-mon[29156]: pgmap v224: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:50 smithi189 ceph-mon[32756]: pgmap v224: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f10f083c700 time 2024-04-26T18:06:51.901471+0000 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f10fae653dd] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: clone() 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:51.902+0000 7f10f083c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f10f083c700 time 2024-04-26T18:06:51.901471+0000 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:52.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f10fae653dd] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: clone() 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: *** Caught signal (Aborted) ** 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: in thread 7f10f083c700 thread_name:ms_dispatch 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f10f9bedd20] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: gsignal() 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: abort() 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f10fae65437] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 16: clone() 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:51.903+0000 7f10f083c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: in thread 7f10f083c700 thread_name:ms_dispatch 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f10f9bedd20] 2024-04-26T18:06:52.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: gsignal() 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: abort() 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f10fae65437] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 16: clone() 2024-04-26T18:06:52.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: -1> 2024-04-26T18:06:51.902+0000 7f10f083c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f10f083c700 time 2024-04-26T18:06:51.901471+0000 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f10fae653dd] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: clone() 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 0> 2024-04-26T18:06:51.903+0000 7f10f083c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: in thread 7f10f083c700 thread_name:ms_dispatch 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f10f9bedd20] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: gsignal() 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: abort() 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f10fae65437] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 16: clone() 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: -1> 2024-04-26T18:06:51.902+0000 7f10f083c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f10f083c700 time 2024-04-26T18:06:51.901471+0000 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f10fae653dd] 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: clone() 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 0> 2024-04-26T18:06:51.903+0000 7f10f083c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: in thread 7f10f083c700 thread_name:ms_dispatch 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f10f9bedd20] 2024-04-26T18:06:52.401 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2: gsignal() 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 3: abort() 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f10fae65437] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f10fae655a3] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55b3e4a0d822] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55b3e497d598] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55b3e497fc17] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55b3e4878d0b] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55b3e48792ac] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55b3e4861fad] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f10fb0f9e20] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 13: (DispatchQueue::entry()+0x51f) [0x7f10fb0f6fdf] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f10fb1c9fc1] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f10f9be31ca] 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 16: clone() 2024-04-26T18:06:52.402 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:06:52.403 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[67719]: 2024-04-26T18:06:52.403 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:51 smithi189 podman[68052]: 2024-04-26 18:06:51.995539768 +0000 UTC m=+0.031664500 container died 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:06:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:52 smithi189 ceph-mon[32756]: pgmap v225: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:52 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:53.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:52 smithi189 podman[68052]: 2024-04-26 18:06:52.874467047 +0000 UTC m=+0.910591754 container remove 0e4fab2d6696cf7b26d5d702ec2600722e4d2bddad5a9bf7116fe96f84564f96 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:06:53.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:52 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:06:53.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:53 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:06:53.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:06:53 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.087s CPU time. 2024-04-26T18:06:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:52 smithi156 ceph-mon[32679]: pgmap v225: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:52 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:52 smithi092 ceph-mon[29156]: pgmap v225: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 2.3 MiB/s wr, 228 op/s 2024-04-26T18:06:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:52 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:06:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 400.0 s, 2828.3 tps, lat 26.320 ms stddev 30.716 2024-04-26T18:06:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:54 smithi156 ceph-mon[32679]: pgmap v226: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2024-04-26T18:06:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:54 smithi092 ceph-mon[29156]: pgmap v226: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2024-04-26T18:06:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:54 smithi189 ceph-mon[32756]: pgmap v226: 97 pgs: 97 active+clean; 3.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2024-04-26T18:06:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:56 smithi156 ceph-mon[32679]: pgmap v227: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 4.8 MiB/s wr, 449 op/s 2024-04-26T18:06:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:56 smithi092 ceph-mon[29156]: pgmap v227: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 4.8 MiB/s wr, 449 op/s 2024-04-26T18:06:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:56 smithi189 ceph-mon[32756]: pgmap v227: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 4.8 MiB/s wr, 449 op/s 2024-04-26T18:06:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 405.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 -- 172.21.15.92:0/2922767463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690102920 msgr2=0x7ff690102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 --2- 172.21.15.92:0/2922767463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690102920 0x7ff690102da0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff684009930 tx=0x7ff68402a420 comp rx=0 tx=0).stop 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 -- 172.21.15.92:0/2922767463 shutdown_connections 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 --2- 172.21.15.92:0/2922767463 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 0x7ff69010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 --2- 172.21.15.92:0/2922767463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690102920 0x7ff690102da0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 --2- 172.21.15.92:0/2922767463 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690108930 0x7ff690108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 -- 172.21.15.92:0/2922767463 >> 172.21.15.92:0/2922767463 conn(0x7ff6900fe3f0 msgr2=0x7ff690100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 -- 172.21.15.92:0/2922767463 shutdown_connections 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.993+0000 7ff698766640 1 -- 172.21.15.92:0/2922767463 wait complete. 2024-04-26T18:06:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 Processor -- start 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 -- start start 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690102920 0x7ff690199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 0x7ff6901995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff690112bf0 con 0x7ff690108930 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff690112a70 con 0x7ff6901032e0 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff698766640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff690112d70 con 0x7ff690102920 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff696d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff696d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45636/0 (socket says 172.21.15.92:45636) 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff696d03640 1 -- 172.21.15.92:0/627145979 learned_addr learned my addr 172.21.15.92:0/627145979 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff696502640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690102920 0x7ff690199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.994+0000 7ff695d01640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 0x7ff6901995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 -- 172.21.15.92:0/627145979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690102920 msgr2=0x7ff690199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690102920 0x7ff690199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 -- 172.21.15.92:0/627145979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 msgr2=0x7ff6901995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 0x7ff6901995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 -- 172.21.15.92:0/627145979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69019e080 con 0x7ff690108930 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff696d03640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c970 tx=0x7ff68800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff68f7fe640 1 -- 172.21.15.92:0/627145979 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688007bb0 con 0x7ff690108930 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69019e370 con 0x7ff690108930 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff68f7fe640 1 -- 172.21.15.92:0/627145979 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff688007d50 con 0x7ff690108930 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff68f7fe640 1 -- 172.21.15.92:0/627145979 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688018770 con 0x7ff690108930 2024-04-26T18:06:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.995+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6901a5c00 con 0x7ff690108930 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.997+0000 7ff68f7fe640 1 -- 172.21.15.92:0/627145979 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ff68800f990 con 0x7ff690108930 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.997+0000 7ff69b47e740 1 Processor -- start 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 -- start start 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf829872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf829944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cf828ed460 con 0x55cf82987820 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cf828a7590 con 0x55cf829920e0 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff68f7fe640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 0x7ff6780a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff69b47e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cf828e9420 con 0x55cf82986f00 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45650/0 (socket says 172.21.15.92:45650) 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 -- 172.21.15.92:0/3003944390 learned_addr learned my addr 172.21.15.92:0/3003944390 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696d03640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 0x7ff6780a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff695d01640 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf829944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff695d01640 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf829872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff68f7fe640 1 -- 172.21.15.92:0/627145979 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8669+0+0 (secure 0 0 0) 0x7ff6880d08b0 con 0x7ff690108930 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 -- 172.21.15.92:0/3003944390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 msgr2=0x55cf829872e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf829872e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 -- 172.21.15.92:0/3003944390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 msgr2=0x55cf829944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf829944d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 -- 172.21.15.92:0/3003944390 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf828b40d0 con 0x55cf82987820 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696502640 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff680010370 tx=0x7ff680010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14c9d3094989849 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.998+0000 7ff696d03640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 0x7ff6780a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff68809c750 tx=0x7ff688076040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff68cff9640 1 -- 172.21.15.92:0/3003944390 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680016070 con 0x55cf82987820 2024-04-26T18:06:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff68cff9640 1 -- 172.21.15.92:0/3003944390 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff680004d20 con 0x55cf82987820 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff68cff9640 1 -- 172.21.15.92:0/3003944390 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680005440 con 0x55cf82987820 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 -- 172.21.15.92:0/3003944390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 msgr2=0x55cf82991ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff680010370 tx=0x7ff680010830 comp rx=0 tx=0).stop 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 -- 172.21.15.92:0/3003944390 shutdown_connections 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf829944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf82991ba0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 --2- 172.21.15.92:0/3003944390 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf829872e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:58.999+0000 7ff69b47e740 1 -- 172.21.15.92:0/3003944390 >> 172.21.15.92:0/3003944390 conn(0x55cf82983410 msgr2=0x55cf829837f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- 172.21.15.92:0/3003944390 shutdown_connections 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- 172.21.15.92:0/3003944390 wait complete. 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- start start 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 Processor -- start 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82987820 0x55cf8298f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf8298fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cf82994d10 con 0x55cf82986f00 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cf82874b60 con 0x55cf829920e0 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cf82994e90 con 0x55cf82987820 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff69b47e740 10 client.0 _ll_register_callbacks cb 0x55cf828992b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45662/0 (socket says 172.21.15.92:45662) 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 -- 172.21.15.92:0/323629877 learned_addr learned my addr 172.21.15.92:0/323629877 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf8298fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff696502640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82987820 0x55cf8298f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 -- 172.21.15.92:0/323629877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82987820 msgr2=0x55cf8298f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82987820 0x55cf8298f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 -- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 msgr2=0x55cf8298fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf8298fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.000+0000 7ff695d01640 1 -- 172.21.15.92:0/323629877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf825ff210 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff695d01640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff684009930 tx=0x7ff684009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9979c2f12bf65748 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684035040 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8669+0+0 (secure 0 0 0) 0x7ff684031830 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff680004d20 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7ff684052050 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 10 client.16047 fetch_fsmap learned FSMap version 57 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55cf826cb620 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff680004d20 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 57) ==== 8346+0+0 (secure 0 0 0) 0x7ff684003b50 con 0x55cf82986f00 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 10 client.16047 fetch_fsmap finished waiting for FSMap version 57 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 20 client.16047 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf829a21c0 0x55cf829a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 4 client.16047 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.001+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf828fb070 con 0x55cf829a21c0 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.002+0000 7ff696502640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf829a21c0 0x55cf829a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.002+0000 7ff696502640 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf829a21c0 0x55cf829a45d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6de8acb7d5dae37 server_cookie=8b72ce350eb714e7 in_seq=0 out_seq=0 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.002+0000 7ff675ffb640 10 client.16047 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff675ffb640 1 -- 172.21.15.92:0/323629877 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf828fb070 con 0x55cf829a21c0 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff675ffb640 10 client.16047 handle_command_reply: tid=0 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 client.16047 shutdown 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 msgr2=0x55cf8298f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff684009930 tx=0x7ff684009260 comp rx=0 tx=0).stop 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 shutdown_connections 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf829a21c0 0x55cf829a45d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf829920e0 0x55cf8298fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82987820 0x55cf8298f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff675ffb640 0 client.16047 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 --2- 172.21.15.92:0/323629877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82986f00 0x55cf8298f010 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 >> 172.21.15.92:0/323629877 conn(0x55cf82983410 msgr2=0x55cf829825b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 shutdown_connections 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 1 -- 172.21.15.92:0/323629877 wait complete. 2024-04-26T18:06:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.003+0000 7ff69b47e740 20 client.16047 trim_cache size 0 max 16384 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.017+0000 7ff69b47e740 1 Processor -- start 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.017+0000 7ff69b47e740 1 -- start start 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf8299dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82987820 0x55cf82989140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901b0dd0 con 0x55cf829920e0 2024-04-26T18:06:59.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901ae670 con 0x55cf82987820 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff69b47e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901ac4c0 con 0x55cf82986f00 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45670/0 (socket says 172.21.15.92:45670) 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 -- 172.21.15.92:0/2085879501 learned_addr learned my addr 172.21.15.92:0/2085879501 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff696502640 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82987820 0x55cf82989140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf8299dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 -- 172.21.15.92:0/2085879501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 msgr2=0x55cf8299dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf8299dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 -- 172.21.15.92:0/2085879501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82987820 msgr2=0x55cf82989140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82987820 0x55cf82989140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 -- 172.21.15.92:0/2085879501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf8298e000 con 0x55cf829920e0 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff695d01640 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff684031440 tx=0x7ff684005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67dcc0f5fcc577c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff677fff640 1 -- 172.21.15.92:0/2085879501 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684041040 con 0x55cf829920e0 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff677fff640 1 -- 172.21.15.92:0/2085879501 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff684005850 con 0x55cf829920e0 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.018+0000 7ff677fff640 1 -- 172.21.15.92:0/2085879501 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684000e60 con 0x55cf829920e0 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- 172.21.15.92:0/2085879501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 msgr2=0x55cf829a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff684031440 tx=0x7ff684005780 comp rx=0 tx=0).stop 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- 172.21.15.92:0/2085879501 shutdown_connections 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf829920e0 0x55cf829a9ee0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82987820 0x55cf82989140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2085879501 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf82986f00 0x55cf8299dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- 172.21.15.92:0/2085879501 >> 172.21.15.92:0/2085879501 conn(0x55cf82983410 msgr2=0x55cf829837f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- 172.21.15.92:0/2085879501 shutdown_connections 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- 172.21.15.92:0/2085879501 wait complete. 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 -- start start 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.019+0000 7ff69b47e740 1 Processor -- start 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 0x55cf8299a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf829920e0 0x55cf829970b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901acb30 con 0x55cf82987820 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901adfa0 con 0x55cf82986f00 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff6901ad200 con 0x55cf829920e0 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 10 client.0 _ll_register_callbacks cb 0x7ff684032df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45686/0 (socket says 172.21.15.92:45686) 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 -- 172.21.15.92:0/2365370763 learned_addr learned my addr 172.21.15.92:0/2365370763 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff695d01640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 0x55cf8299a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff695d01640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf829920e0 0x55cf829970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 -- 172.21.15.92:0/2365370763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf829920e0 msgr2=0x55cf829970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf829920e0 0x55cf829970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 -- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 msgr2=0x55cf8299a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 0x55cf8299a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 -- 172.21.15.92:0/2365370763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf829978b0 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff695d01640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 0x55cf8299a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff696502640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff680010370 tx=0x7ff680009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7899db25179f0ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680016040 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8669+0+0 (secure 0 0 0) 0x7ff680003c00 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff684005850 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7ff680036050 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 10 client.16053 fetch_fsmap learned FSMap version 57 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.020+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55cf82a09230 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff684005850 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 57) ==== 8346+0+0 (secure 0 0 0) 0x7ff68000f040 con 0x55cf82987820 2024-04-26T18:06:59.027 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 10 client.16053 fetch_fsmap finished waiting for FSMap version 57 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 20 client.16053 populate_metadata read hostname 'smithi092' 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf82a09780 0x55cf82a0bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 4 client.16053 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf828f4ee0 con 0x55cf82a09780 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff695d01640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf82a09780 0x55cf82a0bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff675ffb640 10 client.16053 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:06:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:06:59.021+0000 7ff695d01640 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf82a09780 0x55cf82a0bba0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7965e926411087 server_cookie=1aa07900504e989c in_seq=0 out_seq=0 2024-04-26T18:06:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:06:58 smithi092 ceph-mon[29156]: pgmap v228: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2024-04-26T18:06:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:06:58 smithi189 ceph-mon[32756]: pgmap v228: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2024-04-26T18:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:06:58 smithi156 ceph-mon[32679]: pgmap v228: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 4.7 MiB/s wr, 433 op/s 2024-04-26T18:07:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:00 smithi092 ceph-mon[29156]: pgmap v229: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 5.5 MiB/s wr, 533 op/s 2024-04-26T18:07:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:00 smithi189 ceph-mon[32756]: pgmap v229: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 5.5 MiB/s wr, 533 op/s 2024-04-26T18:07:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:00 smithi156 ceph-mon[32679]: pgmap v229: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 5.5 MiB/s wr, 533 op/s 2024-04-26T18:07:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:02 smithi092 ceph-mon[29156]: pgmap v230: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 388 op/s 2024-04-26T18:07:03.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 410.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:07:03.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:02 smithi189 ceph-mon[32756]: pgmap v230: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 388 op/s 2024-04-26T18:07:03.381 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:07:03.381 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:03.381 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.087s CPU time. 2024-04-26T18:07:03.381 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 systemd[1]: Starting Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:07:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:02 smithi156 ceph-mon[32679]: pgmap v230: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.9 MiB/s wr, 388 op/s 2024-04-26T18:07:03.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 podman[68150]: 2024-04-26 18:07:03.284755049 +0000 UTC m=+0.018569916 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:07:03.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 podman[68150]: 2024-04-26 18:07:03.408588254 +0000 UTC m=+0.142403123 container create 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:07:03.941 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 podman[68150]: 2024-04-26 18:07:03.66578935 +0000 UTC m=+0.399604220 container init 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:07:03.942 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 podman[68150]: 2024-04-26 18:07:03.668529654 +0000 UTC m=+0.402344525 container start 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-26T18:07:03.942 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mds[68169]: -- 172.21.15.189:0/2238333184 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561041589a40 con 0x56104155d000 2024-04-26T18:07:03.942 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: starting mds.f at 2024-04-26T18:07:03.942 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 bash[68150]: 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 2024-04-26T18:07:03.942 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:03 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: daemon mds.f restarted 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:boot 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:03 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: daemon mds.f restarted 2024-04-26T18:07:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:boot 2024-04-26T18:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:03 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: daemon mds.f restarted 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: osdmap e97: 12 total, 12 up, 12 in 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:boot 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:03 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:05.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:04 smithi092 ceph-mon[29156]: pgmap v231: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 414 op/s 2024-04-26T18:07:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:04 smithi189 ceph-mon[32756]: pgmap v231: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 414 op/s 2024-04-26T18:07:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:04 smithi156 ceph-mon[32679]: pgmap v231: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.1 MiB/s wr, 414 op/s 2024-04-26T18:07:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:05 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:resolve 2024-04-26T18:07:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:05 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:05 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:resolve 2024-04-26T18:07:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:05 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:05 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:resolve 2024-04-26T18:07:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:05 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff675ffb640 1 -- 172.21.15.92:0/2365370763 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf828f4ee0 con 0x55cf82a09780 2024-04-26T18:07:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff675ffb640 10 client.16053 handle_command_reply: tid=0 2024-04-26T18:07:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 client.16053 shutdown 2024-04-26T18:07:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 msgr2=0x55cf8299a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff680010370 tx=0x7ff680009bf0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 shutdown_connections 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cf82a09780 0x55cf82a0bba0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cf829920e0 0x55cf829970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cf82987820 0x55cf8299a620 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff675ffb640 0 client.16053 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 --2- 172.21.15.92:0/2365370763 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf82986f00 0x55cf8299a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 >> 172.21.15.92:0/2365370763 conn(0x55cf82983410 msgr2=0x55cf829910d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 shutdown_connections 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.978+0000 7ff69b47e740 1 -- 172.21.15.92:0/2365370763 wait complete. 2024-04-26T18:07:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff69b47e740 20 client.16053 trim_cache size 0 max 16384 2024-04-26T18:07:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:07:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:07:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:07:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:07:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 msgr2=0x7ff6780a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 0x7ff6780a6280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff68809c750 tx=0x7ff688076040 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 msgr2=0x7ff69019d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff68800c970 tx=0x7ff68800ce30 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 shutdown_connections 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff6780a3dc0 0x7ff6780a6280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff690108930 0x7ff69019d950 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6901032e0 0x7ff6901995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 --2- 172.21.15.92:0/627145979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff690102920 0x7ff690199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 >> 172.21.15.92:0/627145979 conn(0x7ff6900fe3f0 msgr2=0x7ff6900feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 shutdown_connections 2024-04-26T18:07:06.982 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:06.979+0000 7ff698766640 1 -- 172.21.15.92:0/627145979 wait complete. 2024-04-26T18:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:06 smithi092 ceph-mon[29156]: pgmap v233: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:06 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:06 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:06 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:reconnect 2024-04-26T18:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:06 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:06 smithi189 ceph-mon[32756]: pgmap v233: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:06 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:06 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:06 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:reconnect 2024-04-26T18:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:06 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:06 smithi156 ceph-mon[32679]: pgmap v233: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:06 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:06 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:06 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:reconnect 2024-04-26T18:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:06 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:rejoin 2024-04-26T18:07:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:07 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:07 smithi092 ceph-mon[29156]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 415.0 s, 128.4 tps, lat 2522.838 ms stddev 5812.668 2024-04-26T18:07:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:rejoin 2024-04-26T18:07:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:07 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:07 smithi189 ceph-mon[32756]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:rejoin 2024-04-26T18:07:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:07 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:07 smithi156 ceph-mon[32679]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:08.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:07:08.469+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: pgmap v234: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:active 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:08 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: pgmap v234: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:active 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:08 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: pgmap v234: 97 pgs: 97 active+clean; 3.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 256 op/s 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/294834518,v1:172.21.15.189:6839/294834518] up:active 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:08 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:09 smithi092 ceph-mon[29156]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:07:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:09 smithi189 ceph-mon[32756]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:07:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:09 smithi156 ceph-mon[32679]: osdmap e98: 12 total, 12 up, 12 in 2024-04-26T18:07:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:10 smithi092 ceph-mon[29156]: pgmap v236: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 28 MiB/s wr, 1.30k op/s 2024-04-26T18:07:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:10 smithi189 ceph-mon[32756]: pgmap v236: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 28 MiB/s wr, 1.30k op/s 2024-04-26T18:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:10 smithi156 ceph-mon[32679]: pgmap v236: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 28 MiB/s wr, 1.30k op/s 2024-04-26T18:07:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:12 smithi092 ceph-mon[29156]: pgmap v237: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 28 MiB/s wr, 1.26k op/s 2024-04-26T18:07:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 420.0 s, 2184.6 tps, lat 46.550 ms stddev 87.714 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f692f7d6700 time 2024-04-26T18:07:13.000864+0000 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6939dff3dd] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.388 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: clone() 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.001+0000 7f692f7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f692f7d6700 time 2024-04-26T18:07:13.000864+0000 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:13.389 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6939dff3dd] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.390 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: clone() 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: *** Caught signal (Aborted) ** 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: in thread 7f692f7d6700 thread_name:ms_dispatch 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6938b87d20] 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: gsignal() 2024-04-26T18:07:13.391 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: abort() 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6939dff437] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.392 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 16: clone() 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.002+0000 7f692f7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: in thread 7f692f7d6700 thread_name:ms_dispatch 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6938b87d20] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: gsignal() 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: abort() 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6939dff437] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.393 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 16: clone() 2024-04-26T18:07:13.394 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: -1> 2024-04-26T18:07:13.001+0000 7f692f7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f692f7d6700 time 2024-04-26T18:07:13.000864+0000 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6939dff3dd] 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.395 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: clone() 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 0> 2024-04-26T18:07:13.002+0000 7f692f7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: in thread 7f692f7d6700 thread_name:ms_dispatch 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.396 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6938b87d20] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: gsignal() 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: abort() 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6939dff437] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.397 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 16: clone() 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: -1> 2024-04-26T18:07:13.001+0000 7f692f7d6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f692f7d6700 time 2024-04-26T18:07:13.000864+0000 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6939dff3dd] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.398 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: clone() 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 0> 2024-04-26T18:07:13.002+0000 7f692f7d6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: in thread 7f692f7d6700 thread_name:ms_dispatch 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6938b87d20] 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2: gsignal() 2024-04-26T18:07:13.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 3: abort() 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6939dff437] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6939dff5a3] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de68dda822] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de68d4a598] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de68d4cc17] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de68c45d0b] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de68c462ac] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de68c2efad] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f693a093e20] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 13: (DispatchQueue::entry()+0x51f) [0x7f693a090fdf] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f693a163fc1] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6938b7d1ca] 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 16: clone() 2024-04-26T18:07:13.400 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:13.401 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[67873]: 2024-04-26T18:07:13.401 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:13 smithi189 podman[68208]: 2024-04-26 18:07:13.058708069 +0000 UTC m=+0.018827835 container died 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T18:07:13.401 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:12 smithi189 ceph-mon[32756]: pgmap v237: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 28 MiB/s wr, 1.26k op/s 2024-04-26T18:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:12 smithi156 ceph-mon[32679]: pgmap v237: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 28 MiB/s wr, 1.26k op/s 2024-04-26T18:07:14.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:14.373 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:14 smithi189 podman[68208]: 2024-04-26 18:07:14.125919392 +0000 UTC m=+1.086039195 container remove 290dde4d7b818254aba653fff147a0c99fb617990b6c46e720581bf8ed85dfd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T18:07:14.373 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:14 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:07:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:14.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:14 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:07:14.887 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:14 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.220s CPU time. 2024-04-26T18:07:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:15 smithi189 ceph-mon[32756]: pgmap v238: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 24 MiB/s wr, 1.04k op/s 2024-04-26T18:07:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:15 smithi156 ceph-mon[32679]: pgmap v238: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 24 MiB/s wr, 1.04k op/s 2024-04-26T18:07:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:15 smithi092 ceph-mon[29156]: pgmap v238: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 3.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 24 MiB/s wr, 1.04k op/s 2024-04-26T18:07:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:17 smithi189 ceph-mon[32756]: pgmap v239: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:17 smithi156 ceph-mon[32679]: pgmap v239: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:17 smithi092 ceph-mon[29156]: pgmap v239: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:18.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 425.0 s, 1606.4 tps, lat 40.618 ms stddev 40.901 2024-04-26T18:07:19.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:19 smithi092 ceph-mon[29156]: pgmap v240: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:19 smithi189 ceph-mon[32756]: pgmap v240: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:19 smithi156 ceph-mon[32679]: pgmap v240: 97 pgs: 97 active+clean; 3.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 32 MiB/s wr, 1.51k op/s 2024-04-26T18:07:20.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- 172.21.15.92:0/1952927938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc10cf00 msgr2=0x7f70bc10f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 --2- 172.21.15.92:0/1952927938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc10cf00 0x7f70bc10f3a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009ca0 tx=0x7f70b402a9e0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- 172.21.15.92:0/1952927938 shutdown_connections 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 --2- 172.21.15.92:0/1952927938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc10cf00 0x7f70bc10f3a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 --2- 172.21.15.92:0/1952927938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 0x7f70bc10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 --2- 172.21.15.92:0/1952927938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc103bc0 0x7f70bc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- 172.21.15.92:0/1952927938 >> 172.21.15.92:0/1952927938 conn(0x7f70bc0789b0 msgr2=0x7f70bc078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- 172.21.15.92:0/1952927938 shutdown_connections 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- 172.21.15.92:0/1952927938 wait complete. 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 Processor -- start 2024-04-26T18:07:20.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.089+0000 7f70c250a640 1 -- start start 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 0x7f70bc199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc10cf00 0x7f70bc19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc112bf0 con 0x7f70bc103bc0 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc112a70 con 0x7f70bc1044e0 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc112d70 con 0x7f70bc10cf00 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38250/0 (socket says 172.21.15.92:38250) 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 -- 172.21.15.92:0/1179732834 learned_addr learned my addr 172.21.15.92:0/1179732834 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 0x7f70bc199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 -- 172.21.15.92:0/1179732834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc10cf00 msgr2=0x7f70bc19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc10cf00 0x7f70bc19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 -- 172.21.15.92:0/1179732834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 msgr2=0x7f70bc199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 0x7f70bc199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 -- 172.21.15.92:0/1179732834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc19e0d0 con 0x7f70bc103bc0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70bbfff640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00b4a0 tx=0x7f70ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70b97fa640 1 -- 172.21.15.92:0/1179732834 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac014070 con 0x7f70bc103bc0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70b97fa640 1 -- 172.21.15.92:0/1179732834 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70ac010ac0 con 0x7f70bc103bc0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc19e3c0 con 0x7f70bc103bc0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70b97fa640 1 -- 172.21.15.92:0/1179732834 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac017c30 con 0x7f70bc103bc0 2024-04-26T18:07:20.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.090+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1a5c50 con 0x7f70bc103bc0 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 Processor -- start 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 -- start start 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 0x55aa635aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa6350a460 con 0x55aa635af0e0 2024-04-26T18:07:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55aa634c4590 con 0x55aa635a3f00 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70c5228740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aa63506420 con 0x55aa635a4820 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.093+0000 7f70b97fa640 1 -- 172.21.15.92:0/1179732834 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f70ac017070 con 0x7f70bc103bc0 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38266/0 (socket says 172.21.15.92:38266) 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 -- 172.21.15.92:0/478192248 learned_addr learned my addr 172.21.15.92:0/478192248 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bbfff640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 0x55aa635aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 -- 172.21.15.92:0/478192248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 msgr2=0x55aa635aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 0x55aa635aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 -- 172.21.15.92:0/478192248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 msgr2=0x55aa635a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 -- 172.21.15.92:0/478192248 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa634d10d0 con 0x55aa635af0e0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bbfff640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 0x55aa635aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70b000bc90 tx=0x7f70b00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6994fbdbc1f3d47e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70b97fa640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 0x7f70a40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70a27fc640 1 -- 172.21.15.92:0/478192248 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0005020 con 0x55aa635af0e0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70a27fc640 1 -- 172.21.15.92:0/478192248 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b00047a0 con 0x55aa635af0e0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70a27fc640 1 -- 172.21.15.92:0/478192248 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b00116a0 con 0x55aa635af0e0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 0x7f70a40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.094+0000 7f70b97fa640 1 -- 172.21.15.92:0/1179732834 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8799+0+0 (secure 0 0 0) 0x7f70ac0cfb90 con 0x7f70bc103bc0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- 172.21.15.92:0/478192248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 msgr2=0x55aa635b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 0x7f70a40a6280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009a60 tx=0x7f70b403a040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f70b000bc90 tx=0x7f70b00107a0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- 172.21.15.92:0/478192248 shutdown_connections 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b14d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a4820 0x55aa635aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 --2- 172.21.15.92:0/478192248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- 172.21.15.92:0/478192248 >> 172.21.15.92:0/478192248 conn(0x55aa635a0410 msgr2=0x55aa635a07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- 172.21.15.92:0/478192248 shutdown_connections 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- 172.21.15.92:0/478192248 wait complete. 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.095+0000 7f70c5228740 1 -- start start 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 Processor -- start 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635aca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aa635b1d10 con 0x55aa635a4820 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55aa63491b60 con 0x55aa635a3f00 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55aa635b1e90 con 0x55aa635af0e0 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c5228740 10 client.0 _ll_register_callbacks cb 0x55aa634b62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38282/0 (socket says 172.21.15.92:38282) 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 -- 172.21.15.92:0/761049464 learned_addr learned my addr 172.21.15.92:0/761049464 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bbfff640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 -- 172.21.15.92:0/761049464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 msgr2=0x55aa635aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 -- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 msgr2=0x55aa635abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bb7fe640 1 -- 172.21.15.92:0/761049464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6321c210 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.096+0000 7f70bbfff640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f70b0006010 tx=0x7f70b0005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21320ffa36a6319d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f709b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b002a060 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8799+0+0 (secure 0 0 0) 0x7f70b0004950 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b00047a0 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f70b0031050 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f70c5228740 10 client.16068 fetch_fsmap learned FSMap version 65 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55aa632e8620 con 0x55aa635a4820 2024-04-26T18:07:20.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.097+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b00047a0 con 0x55aa635a4820 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 65) ==== 8346+0+0 (secure 0 0 0) 0x7f70b0011440 con 0x55aa635a4820 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 10 client.16068 fetch_fsmap finished waiting for FSMap version 65 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 10 client.16068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 20 client.16068 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa635c13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 4 client.16068 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa63518070 con 0x55aa635bf000 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70bbfff640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa635c13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f70bbfff640 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa635c13f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d513316f69dbc3c8 server_cookie=b43fcc5a400627be in_seq=0 out_seq=0 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.098+0000 7f709b7fe640 10 client.16068 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:20.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f709b7fe640 1 -- 172.21.15.92:0/761049464 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa63518070 con 0x55aa635bf000 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f709b7fe640 10 client.16068 handle_command_reply: tid=0 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 client.16068 shutdown 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 msgr2=0x55aa635ac4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f70b0006010 tx=0x7f70b0005230 comp rx=0 tx=0).stop 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 shutdown_connections 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa635c13f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635ac4f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f709b7fe640 0 client.16068 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 --2- 172.21.15.92:0/761049464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 >> 172.21.15.92:0/761049464 conn(0x55aa635a0410 msgr2=0x55aa635a6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 shutdown_connections 2024-04-26T18:07:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.099+0000 7f70c5228740 1 -- 172.21.15.92:0/761049464 wait complete. 2024-04-26T18:07:20.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.100+0000 7f70c5228740 20 client.16068 trim_cache size 0 max 16384 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 Processor -- start 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 -- start start 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1b1070 con 0x55aa635a4820 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1ae910 con 0x55aa635a3f00 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70c5228740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1ac780 con 0x55aa635af0e0 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70bb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38298/0 (socket says 172.21.15.92:38298) 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.114+0000 7f70bb7fe640 1 -- 172.21.15.92:0/4023531442 learned_addr learned my addr 172.21.15.92:0/4023531442 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 -- 172.21.15.92:0/4023531442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 msgr2=0x55aa635c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 -- 172.21.15.92:0/4023531442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 msgr2=0x55aa635adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 -- 172.21.15.92:0/4023531442 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa635b1e00 con 0x55aa635a4820 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f70b0001eb0 tx=0x7f70b00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdef4a5c5a72c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70a1ffb640 1 -- 172.21.15.92:0/4023531442 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b002a040 con 0x55aa635a4820 2024-04-26T18:07:20.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70a1ffb640 1 -- 172.21.15.92:0/4023531442 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b003a070 con 0x55aa635a4820 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70a1ffb640 1 -- 172.21.15.92:0/4023531442 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0011440 con 0x55aa635a4820 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70c5228740 1 -- 172.21.15.92:0/4023531442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 msgr2=0x55aa635c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.115+0000 7f70c5228740 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f70b0001eb0 tx=0x7f70b00058d0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- 172.21.15.92:0/4023531442 shutdown_connections 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635af0e0 0x55aa635c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635a4820 0x55aa635c69c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- 172.21.15.92:0/4023531442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a3f00 0x55aa635adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- 172.21.15.92:0/4023531442 >> 172.21.15.92:0/4023531442 conn(0x55aa635a0410 msgr2=0x55aa635ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- 172.21.15.92:0/4023531442 shutdown_connections 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- 172.21.15.92:0/4023531442 wait complete. 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- start start 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 Processor -- start 2024-04-26T18:07:20.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a3f00 0x55aa635b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a4820 0x55aa635b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1acdd0 con 0x55aa635af0e0 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1ae240 con 0x55aa635a4820 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1ad4a0 con 0x55aa635a3f00 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c5228740 10 client.0 _ll_register_callbacks cb 0x7f70b4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c0aa7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c0aa7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38306/0 (socket says 172.21.15.92:38306) 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.116+0000 7f70c0aa7640 1 -- 172.21.15.92:0/852636621 learned_addr learned my addr 172.21.15.92:0/852636621 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70bbfff640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a3f00 0x55aa635b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70bb7fe640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a4820 0x55aa635b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 -- 172.21.15.92:0/852636621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a3f00 msgr2=0x55aa635b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a3f00 0x55aa635b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 -- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a4820 msgr2=0x55aa635b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a4820 0x55aa635b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 -- 172.21.15.92:0/852636621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa63628770 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c0aa7640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009ca0 tx=0x7f70b4003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f3712517476978 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4033050 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8799+0+0 (secure 0 0 0) 0x7f70b4004450 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b003a070 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f70b405d050 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c5228740 10 client.16074 fetch_fsmap learned FSMap version 65 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x55aa63629a60 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b003a070 con 0x55aa635af0e0 2024-04-26T18:07:20.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.117+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 65) ==== 8346+0+0 (secure 0 0 0) 0x7f70b4038450 con 0x55aa635af0e0 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 10 client.16074 fetch_fsmap finished waiting for FSMap version 65 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 20 client.16074 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa6362c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 4 client.16074 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa63511ee0 con 0x55aa635bf000 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70bbfff640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa6362c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f709b7fe640 10 client.16074 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:20.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:20.118+0000 7f70bbfff640 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa6362c2a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247e73ecc1e03098 server_cookie=3b9bbce4ecae89a3 in_seq=0 out_seq=0 2024-04-26T18:07:20.918 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.7 2024-04-26T18:07:20.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- ceph fs dump --format=json 2024-04-26T18:07:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:20 smithi156 ceph-mon[32679]: pgmap v241: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 17 MiB/s wr, 978 op/s 2024-04-26T18:07:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:20 smithi156 ceph-mon[32679]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:07:20.943 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:20 smithi092 ceph-mon[29156]: pgmap v241: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 17 MiB/s wr, 978 op/s 2024-04-26T18:07:20.944 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:20 smithi092 ceph-mon[29156]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:07:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:20 smithi189 ceph-mon[32756]: pgmap v241: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 17 MiB/s wr, 978 op/s 2024-04-26T18:07:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:20 smithi189 ceph-mon[32756]: osdmap e99: 12 total, 12 up, 12 in 2024-04-26T18:07:21.166 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:07:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:22 smithi156 ceph-mon[32679]: pgmap v243: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 872 op/s 2024-04-26T18:07:22.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:22 smithi092 ceph-mon[29156]: pgmap v243: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 872 op/s 2024-04-26T18:07:23.093 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 -- 172.21.15.92:0/1958918266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308102320 msgr2=0x7fa3081027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/1958918266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308102320 0x7fa3081027a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009990 tx=0x7fa2fc009ca0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 -- 172.21.15.92:0/1958918266 shutdown_connections 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/1958918266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102ce0 0x7fa30810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/1958918266 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308108390 0x7fa308108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/1958918266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308102320 0x7fa3081027a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 -- 172.21.15.92:0/1958918266 >> 172.21.15.92:0/1958918266 conn(0x7fa3080792d0 msgr2=0x7fa3080796e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 -- 172.21.15.92:0/1958918266 shutdown_connections 2024-04-26T18:07:23.094 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.094+0000 7fa30f8a1700 1 -- 172.21.15.92:0/1958918266 wait complete. 2024-04-26T18:07:23.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 Processor -- start 2024-04-26T18:07:23.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 -- start start 2024-04-26T18:07:23.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102320 0x7fa30819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:23.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308102ce0 0x7fa30819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:23.096 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3081124d0 con 0x7fa308108390 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa308112350 con 0x7fa308102320 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30f8a1700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa308112650 con 0x7fa308102ce0 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30de3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.095+0000 7fa30de3e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:38328/0 (socket says 172.21.15.92:38328) 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 -- 172.21.15.92:0/478904456 learned_addr learned my addr 172.21.15.92:0/478904456 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30d63d700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102320 0x7fa30819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30ce3c700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308102ce0 0x7fa30819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 -- 172.21.15.92:0/478904456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308102ce0 msgr2=0x7fa30819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308102ce0 0x7fa30819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 -- 172.21.15.92:0/478904456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102320 msgr2=0x7fa30819e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102320 0x7fa30819e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 -- 172.21.15.92:0/478904456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa308199050 con 0x7fa308108390 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30de3e700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d980 tx=0x7fa2f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:23.097 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8016070 con 0x7fa308108390 2024-04-26T18:07:23.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2f8004830 con 0x7fa308108390 2024-04-26T18:07:23.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f80054f0 con 0x7fa308108390 2024-04-26T18:07:23.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa308199340 con 0x7fa308108390 2024-04-26T18:07:23.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.096+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3081a5500 con 0x7fa308108390 2024-04-26T18:07:23.098 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.097+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa308103a40 con 0x7fa308108390 2024-04-26T18:07:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.098+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa2f80049e0 con 0x7fa308108390 2024-04-26T18:07:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.099+0000 7fa3067fc700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 0x7fa2f00a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.099+0000 7fa30d63d700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 0x7fa2f00a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.099+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8799+0+0 (secure 0 0 0) 0x7fa2f80d0ae0 con 0x7fa308108390 2024-04-26T18:07:23.099 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.099+0000 7fa30d63d700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 0x7fa2f00a62f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa300003f10 tx=0x7fa300009180 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:23.102 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.103+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188370 (secure 0 0 0) 0x7fa2f801f020 con 0x7fa308108390 2024-04-26T18:07:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:22 smithi189 ceph-mon[32756]: pgmap v243: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 14 MiB/s wr, 872 op/s 2024-04-26T18:07:23.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 430.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:07:23.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.358+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa30802e490 con 0x7fa308108390 2024-04-26T18:07:23.358 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.359+0000 7fa3067fc700 1 -- 172.21.15.92:0/478904456 <== mon.0 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+11886 (secure 0 0 0) 0x7fa2f809d070 con 0x7fa308108390 2024-04-26T18:07:23.359 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-26T18:07:23.359 INFO:teuthology.orchestra.run.smithi092.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14505,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2096672832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":2096672832},{"type":"v1","addr":"172.21.15.92:6835","nonce":2096672832}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14517,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/2507862349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":2507862349},{"type":"v1","addr":"172.21.15.92:6837","nonce":2507862349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14565,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2187446336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2187446336},{"type":"v1","addr":"172.21.15.92:6839","nonce":2187446336}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6841/1068035391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6840","nonce":1068035391},{"type":"v1","addr":"172.21.15.92:6841","nonce":1068035391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24376,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1366605286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1366605286},{"type":"v1","addr":"172.21.15.189:6833","nonce":1366605286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24386,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/2005596570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":2005596570},{"type":"v1","addr":"172.21.15.156:6833","nonce":2005596570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":65,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-26T17:56:22.551088+0000","modified":"2024-04-26T18:07:12.683117+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24437,"mds_1":24419,"mds_2":25444},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24400":{"gid":24400,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/1535152997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":1535152997},{"type":"v1","addr":"172.21.15.189:6837","nonce":1535152997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24401":{"gid":24401,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6835/1296842780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":1296842780},{"type":"v1","addr":"172.21.15.156:6835","nonce":1296842780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.156:6837/1965706259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":1965706259},{"type":"v1","addr":"172.21.15.156:6837","nonce":1965706259}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.156:6839/2836729853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":2836729853},{"type":"v1","addr":"172.21.15.156:6839","nonce":2836729853}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25444":{"gid":25444,"name":"i","rank":2,"incarnation":59,"state":"up:active","state_seq":10,"addr":"172.21.15.189:6839/294834518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":294834518},{"type":"v1","addr":"172.21.15.189:6839","nonce":294834518}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25465":{"gid":25465,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1679611775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1679611775},{"type":"v1","addr":"172.21.15.189:6835","nonce":1679611775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24437,"qdb_cluster":[25444,24419,24437]},"id":1}]} 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 msgr2=0x7fa2f00a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 0x7fa2f00a62f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa300003f10 tx=0x7fa300009180 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 msgr2=0x7fa308198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d980 tx=0x7fa2f800dc90 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 shutdown_connections 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa2f00a3e30 0x7fa2f00a62f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa308102320 0x7fa30819e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa308108390 0x7fa308198870 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.361+0000 7fa30f8a1700 1 --2- 172.21.15.92:0/478904456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa308102ce0 0x7fa30819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.362+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 >> 172.21.15.92:0/478904456 conn(0x7fa3080792d0 msgr2=0x7fa308100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:23.361 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.362+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 shutdown_connections 2024-04-26T18:07:23.362 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:23.362+0000 7fa30f8a1700 1 -- 172.21.15.92:0/478904456 wait complete. 2024-04-26T18:07:23.362 INFO:teuthology.orchestra.run.smithi092.stderr:dumped fsmap epoch 65 2024-04-26T18:07:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:23 smithi156 ceph-mon[32679]: from='client.? 172.21.15.92:0/478904456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:07:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:23 smithi092 ceph-mon[29156]: from='client.? 172.21.15.92:0/478904456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:07:24.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24437 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0' 2024-04-26T18:07:24.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 shell --fsid fb3c417a-03f4-11ef-bc93-c7b262605968 -- timeout 75 ceph tell mds.24437 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0 2024-04-26T18:07:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:23 smithi189 ceph-mon[32756]: from='client.? 172.21.15.92:0/478904456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-26T18:07:24.356 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/fb3c417a-03f4-11ef-bc93-c7b262605968/mon.a/config 2024-04-26T18:07:24.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:24 smithi092 ceph-mon[29156]: pgmap v244: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:24 smithi189 ceph-mon[32756]: pgmap v244: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 systemd[1]: Stopped Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.220s CPU time. 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 systemd[1]: Starting Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:07:24.901 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 podman[68308]: 2024-04-26 18:07:24.778693026 +0000 UTC m=+0.019437335 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:07:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:24 smithi156 ceph-mon[32679]: pgmap v244: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 12 MiB/s wr, 782 op/s 2024-04-26T18:07:25.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:24 smithi189 podman[68308]: 2024-04-26 18:07:24.902129114 +0000 UTC m=+0.142873404 container create 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T18:07:25.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 podman[68308]: 2024-04-26 18:07:25.154742945 +0000 UTC m=+0.395487235 container init 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True) 2024-04-26T18:07:25.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 podman[68308]: 2024-04-26 18:07:25.157593986 +0000 UTC m=+0.398338285 container start 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:07:25.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mds[68328]: -- 172.21.15.189:0/618783550 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bebbfd3a40 con 0x55bebbfa7000 2024-04-26T18:07:25.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: starting mds.i at 2024-04-26T18:07:25.637 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 bash[68308]: 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 2024-04-26T18:07:25.638 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:25 smithi189 systemd[1]: Started Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:25.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: daemon mds.i restarted 2024-04-26T18:07:25.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:boot 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:07:25.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:25 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: daemon mds.i restarted 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:boot 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:07:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:07:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:25 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- 172.21.15.92:0/164981287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 msgr2=0x7f7714109880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 --2- 172.21.15.92:0/164981287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f7714109880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f77100099c0 tx=0x7f7710009cd0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- 172.21.15.92:0/164981287 shutdown_connections 2024-04-26T18:07:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 --2- 172.21.15.92:0/164981287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7714103e90 0x7f77141102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.135 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 --2- 172.21.15.92:0/164981287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f7714109880 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 --2- 172.21.15.92:0/164981287 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77141034d0 0x7f7714103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- 172.21.15.92:0/164981287 >> 172.21.15.92:0/164981287 conn(0x7f771407a4f0 msgr2=0x7f771407a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- 172.21.15.92:0/164981287 shutdown_connections 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- 172.21.15.92:0/164981287 wait complete. 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 Processor -- start 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.134+0000 7f771b71b700 1 -- start start 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77141034d0 0x7f771419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7714103e90 0x7f771419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f77141997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113600 con 0x7f77141094a0 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113480 con 0x7f7714103e90 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f771b71b700 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113780 con 0x7f77141034d0 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f77141997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.136 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f77141997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46350/0 (socket says 172.21.15.92:46350) 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 -- 172.21.15.92:0/1844776143 learned_addr learned my addr 172.21.15.92:0/1844776143 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7718cb6700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7714103e90 0x7f771419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f77194b7700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77141034d0 0x7f771419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 -- 172.21.15.92:0/1844776143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77141034d0 msgr2=0x7f771419f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f77141034d0 0x7f771419f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 -- 172.21.15.92:0/1844776143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7714103e90 msgr2=0x7f771419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7714103e90 0x7f771419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 -- 172.21.15.92:0/1844776143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7714199fa0 con 0x7f77141094a0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f7719cb8700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77141094a0 0x7f77141997c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f770c007d70 tx=0x7f770c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.135+0000 7f770a7fc700 1 -- 172.21.15.92:0/1844776143 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c016020 con 0x7f77141094a0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.136+0000 7f770a7fc700 1 -- 172.21.15.92:0/1844776143 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770c00ac90 con 0x7f77141094a0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.136+0000 7f771b71b700 1 -- 172.21.15.92:0/1844776143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771419a290 con 0x7f77141094a0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.136+0000 7f770a7fc700 1 -- 172.21.15.92:0/1844776143 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0115e0 con 0x7f77141094a0 2024-04-26T18:07:26.137 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.136+0000 7f771b71b700 1 -- 172.21.15.92:0/1844776143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141a64a0 con 0x7f77141094a0 2024-04-26T18:07:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: daemon mds.i restarted 2024-04-26T18:07:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: osdmap e100: 12 total, 12 up, 12 in 2024-04-26T18:07:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:boot 2024-04-26T18:07:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:07:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:07:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:25 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:26.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.138+0000 7f770a7fc700 1 -- 172.21.15.92:0/1844776143 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f770c019020 con 0x7f77141094a0 2024-04-26T18:07:26.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.138+0000 7f770a7fc700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f77000a3ed0 0x7f77000a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f77194b7700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f77000a3ed0 0x7f77000a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.143 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f770a7fc700 1 -- 172.21.15.92:0/1844776143 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f770c0d06b0 con 0x7f77141094a0 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f77194b7700 1 --2- 172.21.15.92:0/1844776143 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f77000a3ed0 0x7f77000a6390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7710003760 tx=0x7f7710005fb0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 Processor -- start 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 -- start start 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd7684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd76adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559ebd6b08d0 con 0x559ebd75d230 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559ebd64f770 con 0x559ebd75db50 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.139+0000 7f7725fadb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ebd6ac890 con 0x559ebd768a00 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46356/0 (socket says 172.21.15.92:46356) 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 -- 172.21.15.92:0/254562700 learned_addr learned my addr 172.21.15.92:0/254562700 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f7719cb8700 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd76adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.144 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f7718cb6700 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd7684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 -- 172.21.15.92:0/254562700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 msgr2=0x559ebd76adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd76adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 -- 172.21.15.92:0/254562700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 msgr2=0x559ebd7684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd7684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 -- 172.21.15.92:0/254562700 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebd5fda60 con 0x559ebd75d230 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f77194b7700 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f77100099c0 tx=0x7f7710020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4d322664fa9049 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f76ff7fe700 1 -- 172.21.15.92:0/254562700 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77100056c0 con 0x559ebd75d230 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f76ff7fe700 1 -- 172.21.15.92:0/254562700 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771000bc40 con 0x559ebd75d230 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.140+0000 7f76ff7fe700 1 -- 172.21.15.92:0/254562700 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710024810 con 0x559ebd75d230 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- 172.21.15.92:0/254562700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 msgr2=0x559ebd75d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f77100099c0 tx=0x7f7710020000 comp rx=0 tx=0).stop 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- 172.21.15.92:0/254562700 shutdown_connections 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd76adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.145 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd75d610 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 --2- 172.21.15.92:0/254562700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd7684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- 172.21.15.92:0/254562700 >> 172.21.15.92:0/254562700 conn(0x559ebd68aed0 msgr2=0x559ebd759720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- 172.21.15.92:0/254562700 shutdown_connections 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- 172.21.15.92:0/254562700 wait complete. 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.141+0000 7f7725fadb80 1 -- start start 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 Processor -- start 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd768190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd765490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559ebd76b510 con 0x559ebd768a00 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559ebd616ae0 con 0x559ebd75d230 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559ebd76b690 con 0x559ebd75db50 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7725fadb80 10 client.0 _ll_register_callbacks cb 0x559ebd644710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:26.146 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46362/0 (socket says 172.21.15.92:46362) 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7719cb8700 1 -- 172.21.15.92:0/3523331422 learned_addr learned my addr 172.21.15.92:0/3523331422 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd768190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7718cb6700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd765490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 -- 172.21.15.92:0/3523331422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 msgr2=0x559ebd765490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd765490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 -- 172.21.15.92:0/3523331422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 msgr2=0x559ebd7659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f77194b7700 1 -- 172.21.15.92:0/3523331422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebd766090 con 0x559ebd75d230 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.142+0000 7f7719cb8700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f77194b7700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd768190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7710031040 tx=0x7f7710005790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e8bdb6625c8a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771003c060 con 0x559ebd75d230 2024-04-26T18:07:26.147 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f77100244b0 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f771000bc40 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) ==== 24+0+0 (secure 0 0 0) 0x7f7710043050 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 10 client.25592 fetch_fsmap learned FSMap version 67 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=4+}) -- 0x559ebd775fa0 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771000bc40 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 67) ==== 8346+0+0 (secure 0 0 0) 0x7f771002f7a0 con 0x559ebd75d230 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 10 client.25592 fetch_fsmap finished waiting for FSMap version 67 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 10 client.25592 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.143+0000 7f7725fadb80 20 client.25592 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd77a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f7725fadb80 4 client.25592 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ebd6be2b0 con 0x559ebd778470 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f7718cb6700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd77a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:26.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f76fcff9700 10 client.25592 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:26.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:26.144+0000 7f7718cb6700 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd77a860 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234dcd2f847d45be server_cookie=b5718e720eba4a42 in_seq=0 out_seq=0 2024-04-26T18:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:27 smithi092 ceph-mon[29156]: pgmap v246: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-04-26T18:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:27 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:resolve 2024-04-26T18:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:27 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:27 smithi189 ceph-mon[32756]: pgmap v246: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-04-26T18:07:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:27 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:resolve 2024-04-26T18:07:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:27 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:27 smithi156 ceph-mon[32679]: pgmap v246: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.9 MiB/s wr, 414 op/s 2024-04-26T18:07:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:27 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:resolve 2024-04-26T18:07:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:27 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.217+0000 7f709b7fe640 1 -- 172.21.15.92:0/852636621 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa63511ee0 con 0x55aa635bf000 2024-04-26T18:07:28.217 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.217+0000 7f709b7fe640 10 client.16074 handle_command_reply: tid=0 2024-04-26T18:07:28.218 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 client.16074 shutdown 2024-04-26T18:07:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.217+0000 7f76fcff9700 1 -- 172.21.15.92:0/3523331422 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559ebd6be2b0 con 0x559ebd778470 2024-04-26T18:07:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f76fcff9700 10 client.25592 handle_command_reply: tid=0 2024-04-26T18:07:28.218 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 client.25592 shutdown 2024-04-26T18:07:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 msgr2=0x55aa635b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009ca0 tx=0x7f70b4003d90 comp rx=0 tx=0).stop 2024-04-26T18:07:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 msgr2=0x559ebd768190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.219 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd768190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7710031040 tx=0x7f7710005790 comp rx=0 tx=0).stop 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 shutdown_connections 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55aa635bf000 0x55aa6362c2a0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aa635af0e0 0x55aa635b36a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aa635a4820 0x55aa635b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 --2- 172.21.15.92:0/852636621 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55aa635a3f00 0x55aa635b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 >> 172.21.15.92:0/852636621 conn(0x55aa635a0410 msgr2=0x55aa635ae070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 shutdown_connections 2024-04-26T18:07:28.220 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd77a860 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f709b7fe640 0 client.16074 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:28.221 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 shutdown_connections 2024-04-26T18:07:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd768190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f76fcff9700 0 client.25592 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:28.221 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd7659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3523331422 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd765490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 >> 172.21.15.92:0/3523331422 conn(0x559ebd68aed0 msgr2=0x559ebd759350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.222 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 1 -- 172.21.15.92:0/852636621 wait complete. 2024-04-26T18:07:28.222 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 shutdown_connections 2024-04-26T18:07:28.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f70c5228740 20 client.16074 trim_cache size 0 max 16384 2024-04-26T18:07:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 1 -- 172.21.15.92:0/3523331422 wait complete. 2024-04-26T18:07:28.223 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.218+0000 7f7725fadb80 20 client.25592 trim_cache size 0 max 16384 2024-04-26T18:07:28.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:07:28.223 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:07:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:07:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:07:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 msgr2=0x7f70a40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.224 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 0x7f70a40a6280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009a60 tx=0x7f70b403a040 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 msgr2=0x7f70bc199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00b4a0 tx=0x7f70ac00b960 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 shutdown_connections 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f70a40a3dc0 0x7f70a40a6280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f70bc10cf00 0x7f70bc19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70bc1044e0 0x7f70bc199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 --2- 172.21.15.92:0/1179732834 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70bc103bc0 0x7f70bc199130 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 >> 172.21.15.92:0/1179732834 conn(0x7f70bc0789b0 msgr2=0x7f70bc0fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 shutdown_connections 2024-04-26T18:07:28.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:28.219+0000 7f70c250a640 1 -- 172.21.15.92:0/1179732834 wait complete. 2024-04-26T18:07:28.240 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 Processor -- start 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 -- start start 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd77d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd77ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ae520 con 0x559ebd75d230 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f77141abcc0 con 0x559ebd75db50 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f7725fadb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ade50 con 0x559ebd768a00 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f77194b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.240+0000 7f77194b7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46378/0 (socket says 172.21.15.92:46378) 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 -- 172.21.15.92:0/2690648236 learned_addr learned my addr 172.21.15.92:0/2690648236 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f7718cb6700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd77d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.241 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f7719cb8700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd77ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 -- 172.21.15.92:0/2690648236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 msgr2=0x559ebd77ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd77ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 -- 172.21.15.92:0/2690648236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 msgr2=0x559ebd77d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd77d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 -- 172.21.15.92:0/2690648236 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ebd750f20 con 0x559ebd75d230 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f7718cb6700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd77d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f77194b7700 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7710009d10 tx=0x7f771000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f751871635d8401 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f76feffd700 1 -- 172.21.15.92:0/2690648236 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710029070 con 0x559ebd75d230 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f76feffd700 1 -- 172.21.15.92:0/2690648236 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771002f8b0 con 0x559ebd75d230 2024-04-26T18:07:28.242 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.241+0000 7f76feffd700 1 -- 172.21.15.92:0/2690648236 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771003c040 con 0x559ebd75d230 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 -- 172.21.15.92:0/2690648236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 msgr2=0x559ebd767cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7710009d10 tx=0x7f771000bd70 comp rx=0 tx=0).stop 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 -- 172.21.15.92:0/2690648236 shutdown_connections 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd768a00 0x559ebd77ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd75d230 0x559ebd767cd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 --2- 172.21.15.92:0/2690648236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75db50 0x559ebd77d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 -- 172.21.15.92:0/2690648236 >> 172.21.15.92:0/2690648236 conn(0x559ebd68aed0 msgr2=0x559ebd760b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 -- 172.21.15.92:0/2690648236 shutdown_connections 2024-04-26T18:07:28.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.242+0000 7f7725fadb80 1 -- 172.21.15.92:0/2690648236 wait complete. 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.243+0000 7f7725fadb80 1 -- start start 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.243+0000 7f7725fadb80 1 Processor -- start 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd77b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd77b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ad780 con 0x559ebd768a00 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ac310 con 0x559ebd75d230 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77141ac9e0 con 0x559ebd75db50 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7725fadb80 10 client.0 _ll_register_callbacks cb 0x559ebd644710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46388/0 (socket says 172.21.15.92:46388) 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 -- 172.21.15.92:0/3646004813 learned_addr learned my addr 172.21.15.92:0/3646004813 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f77194b7700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd77b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.246 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7718cb6700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd77b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 -- 172.21.15.92:0/3646004813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 msgr2=0x559ebd77b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd77b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 -- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 msgr2=0x559ebd77b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd77b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 -- 172.21.15.92:0/3646004813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ebd7dd750 con 0x559ebd768a00 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f7719cb8700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f770c098a80 tx=0x7f770c087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8ec564ee4a8fe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.244+0000 7f76fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0ba060 con 0x559ebd768a00 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f770c085b60 con 0x559ebd768a00 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f771002f8b0 con 0x559ebd768a00 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f770c09c620 con 0x559ebd768a00 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 10 client.16104 fetch_fsmap learned FSMap version 70 2024-04-26T18:07:28.247 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x559ebd7dea70 con 0x559ebd768a00 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f771002f8b0 con 0x559ebd768a00 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 70) ==== 8346+0+0 (secure 0 0 0) 0x7f770c0bb370 con 0x559ebd768a00 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 70 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 10 client.16104 resolve_mds: validated gid 24437 aka daemon mds.b 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 20 client.16104 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd7e1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 4 client.16104 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}] 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.245+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}) -- 0x559ebd6b8350 con 0x559ebd778470 2024-04-26T18:07:28.248 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.246+0000 7f77194b7700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd7e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:28.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.246+0000 7f77194b7700 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd7e1180 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8876096e58f45b50 server_cookie=b8e63a3442587b87 in_seq=0 out_seq=0 2024-04-26T18:07:28.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.246+0000 7f76fcff9700 10 client.16104 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:28.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f76fcff9700 1 -- 172.21.15.92:0/3646004813 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: -9 ) ==== 8+0+586 (crc 0 0 0) 0x559ebd6b8350 con 0x559ebd778470 2024-04-26T18:07:28.249 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f76fcff9700 10 client.16104 handle_command_reply: tid=0 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 client.16104 shutdown 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 msgr2=0x559ebd77bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f770c098a80 tx=0x7f770c087040 comp rx=0 tx=0).stop 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 shutdown_connections 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559ebd778470 0x559ebd7e1180 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559ebd75d230 0x559ebd77b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559ebd768a00 0x559ebd77bdc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 --2- 172.21.15.92:0/3646004813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559ebd75db50 0x559ebd77b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 >> 172.21.15.92:0/3646004813 conn(0x559ebd68aed0 msgr2=0x559ebd760220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f76fcff9700 0 client.16104 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:28.250 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 shutdown_connections 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 1 -- 172.21.15.92:0/3646004813 wait complete. 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-26T18:07:28.247+0000 7f7725fadb80 20 client.16104 trim_cache size 0 max 16384 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "epoch": 70, 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "leader": 24437, 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "set_version": 20, 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "sets": { 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "d549d3c3": { 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "version": 20, 2024-04-26T18:07:28.251 INFO:teuthology.orchestra.run.smithi092.stdout: "age_ref": 0.0, 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FAILED", 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "timeout": 60.0, 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "expiration": 89.7, 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "members": { 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "file:/": { 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "excluded": false, 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "state": { 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "name": "FAILED", 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: "age": 0.0 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:07:28.252 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:07:28.253 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:07:28.253 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-04-26T18:07:28.253 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-04-26T18:07:28.253 INFO:teuthology.orchestra.run.smithi092.stderr:Error EBADF: 2024-04-26T18:07:28.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 435.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:07:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:07:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:07:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:reconnect 2024-04-26T18:07:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:rejoin 2024-04-26T18:07:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:07:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:07:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:reconnect 2024-04-26T18:07:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:rejoin 2024-04-26T18:07:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:reconnect 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:rejoin 2024-04-26T18:07:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:28.886 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-04-26T18:07:28.887 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: 9 (EBADF), stdout: { "epoch": 70, "leader": 24437, "set_version": 20, "sets": { "d549d3c3": { "version": 20, "age_ref": 0.0, "state": { "name": "FAILED", "age": 0.0 }, "timeout": 60.0, "expiration": 89.7, "members": { "file:/": { "excluded": false, "state": { "name": "FAILED", "age": 0.0 } } } } } } 2024-04-26T18:07:28.887 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/quiescer.py", line 354, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/quiescer.py", line 310, in do_quiesce raise RuntimeError(f"Error quiescing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error quiescing set 'd549d3c3': 9 (EBADF) 2024-04-26T18:07:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:29 smithi092 ceph-mon[29156]: pgmap v247: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 558 KiB/s wr, 74 op/s 2024-04-26T18:07:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:29 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:07:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:29 smithi189 ceph-mon[32756]: pgmap v247: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 558 KiB/s wr, 74 op/s 2024-04-26T18:07:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:29 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:07:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:29 smithi156 ceph-mon[32679]: pgmap v247: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 558 KiB/s wr, 74 op/s 2024-04-26T18:07:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:29 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:07:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:30 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:30 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:07:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:active 2024-04-26T18:07:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:30 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:30 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:30 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:30 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:07:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:active 2024-04-26T18:07:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:30 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:30 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:30 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:30 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:07:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1679611775,v1:172.21.15.189:6835/1679611775] up:active 2024-04-26T18:07:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:30 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:30 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:31 smithi092 ceph-mon[29156]: pgmap v248: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 884 KiB/s wr, 118 op/s 2024-04-26T18:07:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:31 smithi189 ceph-mon[32756]: pgmap v248: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 884 KiB/s wr, 118 op/s 2024-04-26T18:07:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:31 smithi156 ceph-mon[32679]: pgmap v248: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 884 KiB/s wr, 118 op/s 2024-04-26T18:07:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 440.0 s, 2521.7 tps, lat 132.553 ms stddev 1125.462 2024-04-26T18:07:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:33 smithi092 ceph-mon[29156]: pgmap v249: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 874 KiB/s wr, 116 op/s 2024-04-26T18:07:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:33 smithi189 ceph-mon[32756]: pgmap v249: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 874 KiB/s wr, 116 op/s 2024-04-26T18:07:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:33 smithi156 ceph-mon[32679]: pgmap v249: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 874 KiB/s wr, 116 op/s 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c140f3700 time 2024-04-26T18:07:34.260950+0000 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c1e71c3dd] 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: clone() 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.260+0000 7f3c140f3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c140f3700 time 2024-04-26T18:07:34.260950+0000 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c1e71c3dd] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.639 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: clone() 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: *** Caught signal (Aborted) ** 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: in thread 7f3c140f3700 thread_name:ms_dispatch 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c1d4a4d20] 2024-04-26T18:07:34.640 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: gsignal() 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: abort() 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c1e71c437] 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.641 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 16: clone() 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.261+0000 7f3c140f3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:34.642 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: in thread 7f3c140f3700 thread_name:ms_dispatch 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c1d4a4d20] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: gsignal() 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: abort() 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c1e71c437] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.643 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 16: clone() 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: -1> 2024-04-26T18:07:34.260+0000 7f3c140f3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c140f3700 time 2024-04-26T18:07:34.260950+0000 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c1e71c3dd] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.644 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: clone() 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 0> 2024-04-26T18:07:34.261+0000 7f3c140f3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: in thread 7f3c140f3700 thread_name:ms_dispatch 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.645 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c1d4a4d20] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: gsignal() 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: abort() 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c1e71c437] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.646 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 16: clone() 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: -1> 2024-04-26T18:07:34.260+0000 7f3c140f3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3c140f3700 time 2024-04-26T18:07:34.260950+0000 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3c1e71c3dd] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.647 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: clone() 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 0> 2024-04-26T18:07:34.261+0000 7f3c140f3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: in thread 7f3c140f3700 thread_name:ms_dispatch 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3c1d4a4d20] 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2: gsignal() 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 3: abort() 2024-04-26T18:07:34.648 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3c1e71c437] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3c1e71c5a3] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56103fb9b822] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56103fb0b598] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56103fb0dc17] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56103fa06d0b] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56103fa072ac] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56103f9effad] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3c1e9b0e20] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 13: (DispatchQueue::entry()+0x51f) [0x7f3c1e9adfdf] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3c1ea80fc1] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3c1d49a1ca] 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 16: clone() 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68164]: 2024-04-26T18:07:34.649 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 podman[68364]: 2024-04-26 18:07:34.326117815 +0000 UTC m=+0.021080564 container died 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-26T18:07:35.233 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 podman[68364]: 2024-04-26 18:07:34.981307072 +0000 UTC m=+0.676269810 container remove 9440e48a9a8c853264ab374e063a9b0587011010d711b27adbd29fc36387cfc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:07:35.233 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:34 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:07:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:35 smithi092 ceph-mon[29156]: pgmap v250: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-04-26T18:07:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:35 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:35.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:35 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:07:35.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:35 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.157s CPU time. 2024-04-26T18:07:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:35 smithi189 ceph-mon[32756]: pgmap v250: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-04-26T18:07:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:35 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:35 smithi156 ceph-mon[32679]: pgmap v250: 97 pgs: 97 active+clean; 3.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.8 MiB/s wr, 194 op/s 2024-04-26T18:07:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:35 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:37 smithi189 ceph-mon[32756]: pgmap v251: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 3.8 MiB/s wr, 381 op/s 2024-04-26T18:07:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:37 smithi156 ceph-mon[32679]: pgmap v251: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 3.8 MiB/s wr, 381 op/s 2024-04-26T18:07:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:37 smithi092 ceph-mon[29156]: pgmap v251: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 3.8 MiB/s wr, 381 op/s 2024-04-26T18:07:38.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 445.0 s, 547.6 tps, lat 42.039 ms stddev 43.365 2024-04-26T18:07:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:39 smithi189 ceph-mon[32756]: pgmap v252: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 3.3 MiB/s wr, 329 op/s 2024-04-26T18:07:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:39 smithi156 ceph-mon[32679]: pgmap v252: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 3.3 MiB/s wr, 329 op/s 2024-04-26T18:07:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:39 smithi092 ceph-mon[29156]: pgmap v252: 97 pgs: 97 active+clean; 3.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 3.3 MiB/s wr, 329 op/s 2024-04-26T18:07:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 -- 172.21.15.92:0/3356425970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 msgr2=0x7f46a010ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 --2- 172.21.15.92:0/3356425970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a010ecb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f468c009900 tx=0x7f468c02a480 comp rx=0 tx=0).stop 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 -- 172.21.15.92:0/3356425970 shutdown_connections 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 --2- 172.21.15.92:0/3356425970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a01115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 --2- 172.21.15.92:0/3356425970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a010ecb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 --2- 172.21.15.92:0/3356425970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 0x7f46a00750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 -- 172.21.15.92:0/3356425970 >> 172.21.15.92:0/3356425970 conn(0x7f46a00fe400 msgr2=0x7f46a0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 -- 172.21.15.92:0/3356425970 shutdown_connections 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.318+0000 7f46a6c45640 1 -- 172.21.15.92:0/3356425970 wait complete. 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 Processor -- start 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 -- start start 2024-04-26T18:07:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 0x7f46a019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0114dc0 con 0x7f46a0075600 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0114c40 con 0x7f46a0074ce0 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a6c45640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0114f40 con 0x7f46a010f1f0 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59142/0 (socket says 172.21.15.92:59142) 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 -- 172.21.15.92:0/373594271 learned_addr learned my addr 172.21.15.92:0/373594271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a49e1640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 0x7f46a019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a51e2640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 -- 172.21.15.92:0/373594271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 msgr2=0x7f46a019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 -- 172.21.15.92:0/373594271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 msgr2=0x7f46a019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 0x7f46a019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f469ffff640 1 -- 172.21.15.92:0/373594271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01a0310 con 0x7f46a0075600 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.319+0000 7f46a51e2640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f469ffff640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468c005940 tx=0x7f468c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f469dffb640 1 -- 172.21.15.92:0/373594271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03f030 con 0x7f46a0075600 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f469dffb640 1 -- 172.21.15.92:0/373594271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f468c003aa0 con 0x7f46a0075600 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a01a05a0 con 0x7f46a0075600 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f469dffb640 1 -- 172.21.15.92:0/373594271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c035070 con 0x7f46a0075600 2024-04-26T18:07:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.320+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a01a7e90 con 0x7f46a0075600 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.322+0000 7f469dffb640 1 -- 172.21.15.92:0/373594271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f468c042030 con 0x7f46a0075600 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.322+0000 7f46a9a3a740 1 Processor -- start 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 -- start start 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d3fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561602c9b460 con 0x561602d400e0 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561602c55590 con 0x561602d34f00 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561602c97420 con 0x561602d35820 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469dffb640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 0x7f46900a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a51e2640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 0x7f46900a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59154/0 (socket says 172.21.15.92:59154) 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 -- 172.21.15.92:0/379455085 learned_addr learned my addr 172.21.15.92:0/379455085 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a51e2640 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a49e1640 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d3fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469dffb640 1 -- 172.21.15.92:0/373594271 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f468c0f0f30 con 0x7f46a0075600 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 -- 172.21.15.92:0/379455085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 msgr2=0x561602d3fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d3fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 -- 172.21.15.92:0/379455085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 msgr2=0x561602d352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 -- 172.21.15.92:0/379455085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561602c620d0 con 0x561602d400e0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f46a51e2640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 0x7f46900a6300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4698005c40 tx=0x7f4698009cd0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.323+0000 7f469ffff640 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f468c08f850 tx=0x7f468c08e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed69b89bba3025d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f468affd640 1 -- 172.21.15.92:0/379455085 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c049020 con 0x561602d400e0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f468affd640 1 -- 172.21.15.92:0/379455085 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f468c0874b0 con 0x561602d400e0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f468affd640 1 -- 172.21.15.92:0/379455085 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03bd00 con 0x561602d400e0 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 -- 172.21.15.92:0/379455085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 msgr2=0x561602d424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f468c08f850 tx=0x7f468c08e7d0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 -- 172.21.15.92:0/379455085 shutdown_connections 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d424d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d3fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/379455085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 -- 172.21.15.92:0/379455085 >> 172.21.15.92:0/379455085 conn(0x561602d31410 msgr2=0x561602d317f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 -- 172.21.15.92:0/379455085 shutdown_connections 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.324+0000 7f46a9a3a740 1 -- 172.21.15.92:0/379455085 wait complete. 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 -- start start 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 Processor -- start 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d3d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561602d42ad0 con 0x561602d35820 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561602c22b60 con 0x561602d34f00 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561602d42c50 con 0x561602d400e0 2024-04-26T18:07:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f46a9a3a740 10 client.0 _ll_register_callbacks cb 0x561602c472b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f469ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59164/0 (socket says 172.21.15.92:59164) 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.325+0000 7f469ffff640 1 -- 172.21.15.92:0/9370331 learned_addr learned my addr 172.21.15.92:0/9370331 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a49e1640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d3d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 -- 172.21.15.92:0/9370331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 msgr2=0x561602d3daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 -- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 msgr2=0x561602d3d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d3d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 -- 172.21.15.92:0/9370331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616029ad210 con 0x561602d35820 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f469ffff640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f468c0ee5f0 tx=0x7f468c03bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a38791f7a4e7e27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c049070 con 0x561602d35820 2024-04-26T18:07:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f468c0b9400 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561602ca9070 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f468c0bc6f0 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 10 client.16116 fetch_fsmap learned FSMap version 73 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x561602a79620 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561602ca9070 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 73) ==== 8346+0+0 (secure 0 0 0) 0x7f468c0c5570 con 0x561602d35820 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 10 client.16116 fetch_fsmap finished waiting for FSMap version 73 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 20 client.16116 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602d4fe10 0x561602d52200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 4 client.16116 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.326+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561602ca2ee0 con 0x561602d4fe10 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.327+0000 7f46a49e1640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602d4fe10 0x561602d52200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.327+0000 7f467ffff640 10 client.16116 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.327+0000 7f46a49e1640 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602d4fe10 0x561602d52200 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66eb9b8c50ed755 server_cookie=45ece65c705dff9 in_seq=0 out_seq=0 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f467ffff640 1 -- 172.21.15.92:0/9370331 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561602ca2ee0 con 0x561602d4fe10 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f467ffff640 10 client.16116 handle_command_reply: tid=0 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 client.16116 shutdown 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 msgr2=0x561602d3d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f468c0ee5f0 tx=0x7f468c03bf30 comp rx=0 tx=0).stop 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 shutdown_connections 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602d4fe10 0x561602d52200 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d35820 0x561602d3d560 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/9370331 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d3d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f467ffff640 0 client.16116 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 >> 172.21.15.92:0/9370331 conn(0x561602d31410 msgr2=0x561602d37190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 shutdown_connections 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 1 -- 172.21.15.92:0/9370331 wait complete. 2024-04-26T18:07:41.338 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.328+0000 7f46a9a3a740 20 client.16116 trim_cache size 0 max 16384 2024-04-26T18:07:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 Processor -- start 2024-04-26T18:07:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 -- start start 2024-04-26T18:07:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d4b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d378c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b3110 con 0x561602d400e0 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b09b0 con 0x561602d34f00 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01ae820 con 0x561602d35820 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59176/0 (socket says 172.21.15.92:59176) 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 -- 172.21.15.92:0/3093873630 learned_addr learned my addr 172.21.15.92:0/3093873630 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a49e1640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d4b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 -- 172.21.15.92:0/3093873630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 msgr2=0x561602d378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f469ffff640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d378c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 -- 172.21.15.92:0/3093873630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 msgr2=0x561602d4b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d4b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a51e2640 1 -- 172.21.15.92:0/3093873630 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561602d527e0 con 0x561602d400e0 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.343+0000 7f46a49e1640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d4b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a51e2640 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4698009f40 tx=0x7f469801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d93ebc87ea53d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f468a7fc640 1 -- 172.21.15.92:0/3093873630 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698024070 con 0x561602d400e0 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f468a7fc640 1 -- 172.21.15.92:0/3093873630 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4698012da0 con 0x561602d400e0 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f468a7fc640 1 -- 172.21.15.92:0/3093873630 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698020a10 con 0x561602d400e0 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 -- 172.21.15.92:0/3093873630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 msgr2=0x561602d3d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4698009f40 tx=0x7f469801b000 comp rx=0 tx=0).stop 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 -- 172.21.15.92:0/3093873630 shutdown_connections 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d400e0 0x561602d3d6f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d35820 0x561602d378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/3093873630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d34f00 0x561602d4b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 -- 172.21.15.92:0/3093873630 >> 172.21.15.92:0/3093873630 conn(0x561602d31410 msgr2=0x561602d3cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 -- 172.21.15.92:0/3093873630 shutdown_connections 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.344+0000 7f46a9a3a740 1 -- 172.21.15.92:0/3093873630 wait complete. 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 -- start start 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 Processor -- start 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d35820 0x561602d3a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01aee70 con 0x561602d34f00 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b02e0 con 0x561602d35820 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01af540 con 0x561602d400e0 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a9a3a740 10 client.0 _ll_register_callbacks cb 0x7f468c0dbf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.351 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59178/0 (socket says 172.21.15.92:59178) 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 -- 172.21.15.92:0/1584047856 learned_addr learned my addr 172.21.15.92:0/1584047856 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a51e2640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 -- 172.21.15.92:0/1584047856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 msgr2=0x561602d3a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 -- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d35820 msgr2=0x561602d3a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d35820 0x561602d3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a49e1640 1 -- 172.21.15.92:0/1584047856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561602db53b0 con 0x561602d34f00 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.345+0000 7f46a51e2640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a49e1640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4694009b00 tx=0x7f4694010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e595781859acbc91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:41.352 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694005020 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8841+0+0 (secure 0 0 0) 0x7f46940051c0 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4698012da0 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f469402c050 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 10 client.16122 fetch_fsmap learned FSMap version 73 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x561602db6720 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4698012da0 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 73) ==== 8346+0+0 (secure 0 0 0) 0x7f46940035f0 con 0x561602d34f00 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 10 client.16122 fetch_fsmap finished waiting for FSMap version 73 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 20 client.16122 populate_metadata read hostname 'smithi092' 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602db6ed0 0x561602db92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:41.353 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 4 client.16122 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:07:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.346+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561602c1e5f0 con 0x561602db6ed0 2024-04-26T18:07:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.347+0000 7f469ffff640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602db6ed0 0x561602db92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.347+0000 7f467ffff640 10 client.16122 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:41.354 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:41.347+0000 7f469ffff640 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602db6ed0 0x561602db92f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac5b91c9ae14febb server_cookie=3540dcb315b01eaa in_seq=0 out_seq=0 2024-04-26T18:07:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:41 smithi189 ceph-mon[32756]: pgmap v253: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 5.0 MiB/s wr, 521 op/s 2024-04-26T18:07:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:41 smithi156 ceph-mon[32679]: pgmap v253: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 5.0 MiB/s wr, 521 op/s 2024-04-26T18:07:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:41 smithi092 ceph-mon[29156]: pgmap v253: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 5.0 MiB/s wr, 521 op/s 2024-04-26T18:07:43.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 450.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:07:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:43 smithi189 ceph-mon[32756]: pgmap v254: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-04-26T18:07:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:43 smithi156 ceph-mon[32679]: pgmap v254: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-04-26T18:07:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:43 smithi092 ceph-mon[29156]: pgmap v254: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 4.6 MiB/s wr, 473 op/s 2024-04-26T18:07:45.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:45 smithi189 ceph-mon[32756]: pgmap v255: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-26T18:07:45.621 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:07:45.621 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:45.621 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.157s CPU time. 2024-04-26T18:07:45.621 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 systemd[1]: Starting Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:07:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:45 smithi156 ceph-mon[32679]: pgmap v255: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-26T18:07:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:45 smithi092 ceph-mon[29156]: pgmap v255: 97 pgs: 97 active+clean; 3.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-26T18:07:45.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 podman[68464]: 2024-04-26 18:07:45.525012431 +0000 UTC m=+0.018670584 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:07:45.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:45 smithi189 podman[68464]: 2024-04-26 18:07:45.638543459 +0000 UTC m=+0.132201601 container create aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 podman[68464]: 2024-04-26 18:07:46.158364419 +0000 UTC m=+0.652022562 container init aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 podman[68464]: 2024-04-26 18:07:46.160984827 +0000 UTC m=+0.654642971 container start aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mds[68482]: -- 172.21.15.189:0/3214086750 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d916ada40 con 0x561d91680c00 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: starting mds.f at 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 bash[68464]: aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c 2024-04-26T18:07:46.275 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:07:46 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:07:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: daemon mds.f restarted 2024-04-26T18:07:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:07:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:boot 2024-04-26T18:07:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:46 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: daemon mds.f restarted 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:boot 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:46 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: daemon mds.f restarted 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: osdmap e101: 12 total, 12 up, 12 in 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:boot 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:46 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:47 smithi189 ceph-mon[32756]: pgmap v256: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 5.3 MiB/s wr, 450 op/s 2024-04-26T18:07:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:47 smithi156 ceph-mon[32679]: pgmap v256: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 5.3 MiB/s wr, 450 op/s 2024-04-26T18:07:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:47 smithi092 ceph-mon[29156]: pgmap v256: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 5.3 MiB/s wr, 450 op/s 2024-04-26T18:07:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 455.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:07:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:resolve 2024-04-26T18:07:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:48 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:resolve 2024-04-26T18:07:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:48 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:resolve 2024-04-26T18:07:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:48 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:49.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.307+0000 7f467ffff640 1 -- 172.21.15.92:0/1584047856 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561602c1e5f0 con 0x561602db6ed0 2024-04-26T18:07:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.307+0000 7f467ffff640 10 client.16122 handle_command_reply: tid=0 2024-04-26T18:07:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.307+0000 7f46a9a3a740 1 client.16122 shutdown 2024-04-26T18:07:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.307+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 msgr2=0x561602d39e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.307+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4694009b00 tx=0x7f4694010800 comp rx=0 tx=0).stop 2024-04-26T18:07:49.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 shutdown_connections 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561602db6ed0 0x561602db92f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561602d400e0 0x561602d3a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561602d35820 0x561602d3a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 --2- 172.21.15.92:0/1584047856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561602d34f00 0x561602d39e00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f467ffff640 0 client.16122 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 >> 172.21.15.92:0/1584047856 conn(0x561602d31410 msgr2=0x561602d305b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:49.311 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 shutdown_connections 2024-04-26T18:07:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 1 -- 172.21.15.92:0/1584047856 wait complete. 2024-04-26T18:07:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.308+0000 7f46a9a3a740 20 client.16122 trim_cache size 0 max 16384 2024-04-26T18:07:49.312 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:07:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:07:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:07:49.313 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:07:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 msgr2=0x7f46900a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:49.314 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 0x7f46900a6300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4698005c40 tx=0x7f4698009cd0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 msgr2=0x7f46a019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468c005940 tx=0x7f468c004270 comp rx=0 tx=0).stop 2024-04-26T18:07:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 shutdown_connections 2024-04-26T18:07:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f46900a3e40 0x7f46900a6300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46a010f1f0 0x7f46a019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46a0075600 0x7f46a019b860 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 --2- 172.21.15.92:0/373594271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46a0074ce0 0x7f46a019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 >> 172.21.15.92:0/373594271 conn(0x7f46a00fe400 msgr2=0x7f46a00ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 shutdown_connections 2024-04-26T18:07:49.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:07:49.309+0000 7f46a6c45640 1 -- 172.21.15.92:0/373594271 wait complete. 2024-04-26T18:07:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:49 smithi189 ceph-mon[32756]: pgmap v258: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-04-26T18:07:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:49 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:49 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:49 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:reconnect 2024-04-26T18:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:49 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:49.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:49 smithi092 ceph-mon[29156]: pgmap v258: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-04-26T18:07:49.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:49 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:07:49.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:49 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:07:49.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:49 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:reconnect 2024-04-26T18:07:49.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:49 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:49 smithi156 ceph-mon[32679]: pgmap v258: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.9 MiB/s wr, 288 op/s 2024-04-26T18:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:49 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:49 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:49 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:reconnect 2024-04-26T18:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:49 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:rejoin 2024-04-26T18:07:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:07:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:active 2024-04-26T18:07:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:rejoin 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:07:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:active 2024-04-26T18:07:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:rejoin 2024-04-26T18:07:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/189541087,v1:172.21.15.189:6839/189541087] up:active 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:07:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:07:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:51 smithi189 ceph-mon[32756]: pgmap v259: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:07:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:51 smithi156 ceph-mon[32679]: pgmap v259: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:07:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:51 smithi092 ceph-mon[29156]: pgmap v259: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:07:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:07:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:07:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 460.0 s, 1911.5 tps, lat 197.518 ms stddev 1560.529 2024-04-26T18:07:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:53 smithi189 ceph-mon[32756]: pgmap v260: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:53 smithi156 ceph-mon[32679]: pgmap v260: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:53.684 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:07:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:07:53.472+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:07:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:53 smithi092 ceph-mon[29156]: pgmap v260: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.3 MiB/s wr, 115 op/s 2024-04-26T18:07:55.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f04ab459700 time 2024-04-26T18:07:54.699032+0000 2024-04-26T18:07:55.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:55.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f04b5a823dd] 2024-04-26T18:07:55.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: clone() 2024-04-26T18:07:55.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:54.699+0000 7f04ab459700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f04ab459700 time 2024-04-26T18:07:54.699032+0000 2024-04-26T18:07:55.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:55.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f04b5a823dd] 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: clone() 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: *** Caught signal (Aborted) ** 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: in thread 7f04ab459700 thread_name:ms_dispatch 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f04b480ad20] 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: gsignal() 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: abort() 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f04b5a82437] 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.149 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.150 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.150 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.150 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.150 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.150 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 16: clone() 2024-04-26T18:07:55.151 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:54.701+0000 7f04ab459700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:55.151 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: in thread 7f04ab459700 thread_name:ms_dispatch 2024-04-26T18:07:55.152 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.152 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.152 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f04b480ad20] 2024-04-26T18:07:55.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: gsignal() 2024-04-26T18:07:55.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: abort() 2024-04-26T18:07:55.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f04b5a82437] 2024-04-26T18:07:55.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.153 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.154 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.154 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.154 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.154 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.154 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.155 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.155 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.155 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.155 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.156 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 16: clone() 2024-04-26T18:07:55.156 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:55.156 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.157 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: -1> 2024-04-26T18:07:54.699+0000 7f04ab459700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f04ab459700 time 2024-04-26T18:07:54.699032+0000 2024-04-26T18:07:55.157 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:55.157 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.157 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.157 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f04b5a823dd] 2024-04-26T18:07:55.158 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.158 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.158 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.158 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.159 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.160 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.160 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: clone() 2024-04-26T18:07:55.160 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.160 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 0> 2024-04-26T18:07:54.701+0000 7f04ab459700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:55.160 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: in thread 7f04ab459700 thread_name:ms_dispatch 2024-04-26T18:07:55.161 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.161 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.161 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f04b480ad20] 2024-04-26T18:07:55.161 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: gsignal() 2024-04-26T18:07:55.161 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: abort() 2024-04-26T18:07:55.162 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f04b5a82437] 2024-04-26T18:07:55.162 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.162 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.162 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.163 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.163 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.163 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.163 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.163 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 16: clone() 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:55.164 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.165 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: -1> 2024-04-26T18:07:54.699+0000 7f04ab459700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f04ab459700 time 2024-04-26T18:07:54.699032+0000 2024-04-26T18:07:55.165 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:07:55.165 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.165 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.166 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f04b5a823dd] 2024-04-26T18:07:55.166 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.166 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.166 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.167 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.168 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: clone() 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 0> 2024-04-26T18:07:54.701+0000 7f04ab459700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: in thread 7f04ab459700 thread_name:ms_dispatch 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f04b480ad20] 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2: gsignal() 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 3: abort() 2024-04-26T18:07:55.169 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f04b5a82437] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f04b5a825a3] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55beb9c60822] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55beb9bd0598] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55beb9bd2c17] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55beb9acbd0b] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55beb9acc2ac] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55beb9ab4fad] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f04b5d16e20] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 13: (DispatchQueue::entry()+0x51f) [0x7f04b5d13fdf] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f04b5de6fc1] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f04b48001ca] 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 16: clone() 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:07:55.170 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68324]: 2024-04-26T18:07:55.171 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:54 smithi189 podman[68649]: 2024-04-26 18:07:54.763359527 +0000 UTC m=+0.019830242 container died 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:07:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:55 smithi189 ceph-mon[32756]: pgmap v261: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 129 op/s 2024-04-26T18:07:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:55 smithi156 ceph-mon[32679]: pgmap v261: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 129 op/s 2024-04-26T18:07:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:55 smithi092 ceph-mon[29156]: pgmap v261: 97 pgs: 97 active+clean; 3.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 129 op/s 2024-04-26T18:07:55.966 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:55 smithi189 podman[68649]: 2024-04-26 18:07:55.690595447 +0000 UTC m=+0.947066144 container remove 50247adead79b65fa6f243009f1aebb4b7d93e99b7c438342a3ede9009df2764 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:07:55.967 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:07:56.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:07:56.387 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:07:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.183s CPU time. 2024-04-26T18:07:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:57 smithi189 ceph-mon[32756]: pgmap v262: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-04-26T18:07:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:57 smithi156 ceph-mon[32679]: pgmap v262: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-04-26T18:07:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:57 smithi092 ceph-mon[29156]: pgmap v262: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2024-04-26T18:07:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 465.0 s, 2786.2 tps, lat 35.952 ms stddev 38.864 2024-04-26T18:07:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:07:59 smithi189 ceph-mon[32756]: pgmap v263: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-04-26T18:07:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:07:59 smithi156 ceph-mon[32679]: pgmap v263: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-04-26T18:07:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:07:59 smithi092 ceph-mon[29156]: pgmap v263: 97 pgs: 97 active+clean; 3.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-04-26T18:08:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:01 smithi189 ceph-mon[32756]: pgmap v264: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-04-26T18:08:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:01 smithi156 ceph-mon[32679]: pgmap v264: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-04-26T18:08:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:01 smithi092 ceph-mon[29156]: pgmap v264: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 -- 172.21.15.92:0/1783187164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa410f220 msgr2=0x7f3fa4111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/1783187164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa410f220 0x7f3fa4111610 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c009900 tx=0x7f3f9c02a480 comp rx=0 tx=0).stop 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 -- 172.21.15.92:0/1783187164 shutdown_connections 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/1783187164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa410f220 0x7f3fa4111610 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/1783187164 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa4075550 0x7f3fa410ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/1783187164 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4074c30 0x7f3fa4075010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 -- 172.21.15.92:0/1783187164 >> 172.21.15.92:0/1783187164 conn(0x7f3fa4079dc0 msgr2=0x7f3fa407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 -- 172.21.15.92:0/1783187164 shutdown_connections 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 -- 172.21.15.92:0/1783187164 wait complete. 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.401+0000 7f3fa9e09640 1 Processor -- start 2024-04-26T18:08:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 -- start start 2024-04-26T18:08:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4075550 0x7f3fa419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 0x7f3fa419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4114e00 con 0x7f3fa4074c30 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4114c80 con 0x7f3fa410f220 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa9e09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa4114f80 con 0x7f3fa4075550 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39860/0 (socket says 172.21.15.92:39860) 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2741496986 learned_addr learned my addr 172.21.15.92:0/2741496986 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4075550 0x7f3fa419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.402+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 0x7f3fa419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2741496986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4075550 msgr2=0x7f3fa419b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4075550 0x7f3fa419b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2741496986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 msgr2=0x7f3fa419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 0x7f3fa419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2741496986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa41a0240 con 0x7f3fa4074c30 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.403+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 0x7f3fa419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.405+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400cce0 tx=0x7f3f9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.412+0000 7f3fa0ff9640 1 -- 172.21.15.92:0/2741496986 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94004b20 con 0x7f3fa4074c30 2024-04-26T18:08:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.412+0000 7f3fa0ff9640 1 -- 172.21.15.92:0/2741496986 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f94004cc0 con 0x7f3fa4074c30 2024-04-26T18:08:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.412+0000 7f3fa0ff9640 1 -- 172.21.15.92:0/2741496986 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400f7c0 con 0x7f3fa4074c30 2024-04-26T18:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.416+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa41a0530 con 0x7f3fa4074c30 2024-04-26T18:08:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.416+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa41a7d70 con 0x7f3fa4074c30 2024-04-26T18:08:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.423+0000 7f3facc02740 1 Processor -- start 2024-04-26T18:08:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.426+0000 7f3fa0ff9640 1 -- 172.21.15.92:0/2741496986 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f3f94005560 con 0x7f3fa4074c30 2024-04-26T18:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.426+0000 7f3fa0ff9640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 0x7f3f8c0a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 -- start start 2024-04-26T18:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3fa0ff9640 1 -- 172.21.15.92:0/2741496986 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8927+0+0 (secure 0 0 0) 0x7f3f940d0bf0 con 0x7f3fa4074c30 2024-04-26T18:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 0x5628543ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543ce720 0x5628543e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562854334460 con 0x5628543ce720 2024-04-26T18:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5628542ee590 con 0x5628543cde00 2024-04-26T18:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3facc02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562854330420 con 0x5628543e18f0 2024-04-26T18:08:02.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 0x7f3f8c0a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:44822/0 (socket says 172.21.15.92:44822) 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.427+0000 7f3fa3fff640 1 -- 172.21.15.92:0/2474940229 learned_addr learned my addr 172.21.15.92:0/2474940229 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 0x5628543ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 -- 172.21.15.92:0/2474940229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 msgr2=0x5628543ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 0x5628543ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 -- 172.21.15.92:0/2474940229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543ce720 msgr2=0x5628543e13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543ce720 0x5628543e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 -- 172.21.15.92:0/2474940229 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628542fb0d0 con 0x5628543e18f0 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 0x5628543ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 0x7f3f8c0a6460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c02a9a0 tx=0x7f3f9c009660 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c033000 tx=0x7f3f9c046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f110931b2a3ad29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.428+0000 7f3f89ffb640 1 -- 172.21.15.92:0/2474940229 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c003bf0 con 0x5628543e18f0 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3f89ffb640 1 -- 172.21.15.92:0/2474940229 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f9c050070 con 0x5628543e18f0 2024-04-26T18:08:02.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3f89ffb640 1 -- 172.21.15.92:0/2474940229 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c03c450 con 0x5628543e18f0 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 -- 172.21.15.92:0/2474940229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 msgr2=0x5628543e3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c033000 tx=0x7f3f9c046000 comp rx=0 tx=0).stop 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 -- 172.21.15.92:0/2474940229 shutdown_connections 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543e3ce0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543ce720 0x5628543e13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 --2- 172.21.15.92:0/2474940229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543cde00 0x5628543ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 -- 172.21.15.92:0/2474940229 >> 172.21.15.92:0/2474940229 conn(0x5628543ca410 msgr2=0x5628543ca7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 -- 172.21.15.92:0/2474940229 shutdown_connections 2024-04-26T18:08:02.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.429+0000 7f3facc02740 1 -- 172.21.15.92:0/2474940229 wait complete. 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 -- start start 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 Processor -- start 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543df300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5628543e44c0 con 0x5628543cde00 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5628542bbb60 con 0x5628543ce720 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5628543e4640 con 0x5628543e18f0 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3facc02740 10 client.0 _ll_register_callbacks cb 0x5628542e02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:02.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39870/0 (socket says 172.21.15.92:39870) 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3fa37fe640 1 -- 172.21.15.92:0/1793869916 learned_addr learned my addr 172.21.15.92:0/1793869916 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.430+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543df300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 -- 172.21.15.92:0/1793869916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 msgr2=0x5628543df300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543df300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 -- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 msgr2=0x5628543dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 -- 172.21.15.92:0/1793869916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562854046210 con 0x5628543cde00 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543df300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3f9409c720 tx=0x7f3f9409d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58293c3c95eca08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3f82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940ce5e0 con 0x5628543cde00 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8927+0+0 (secure 0 0 0) 0x7f3f9409c070 con 0x5628543cde00 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f9c050070 con 0x5628543cde00 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f3f940a5690 con 0x5628543cde00 2024-04-26T18:08:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3facc02740 10 client.16131 fetch_fsmap learned FSMap version 79 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.431+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x562854112620 con 0x5628543cde00 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f9c050070 con 0x5628543cde00 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 79) ==== 8342+0+0 (secure 0 0 0) 0x7f3f940a1f60 con 0x5628543cde00 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 10 client.16131 fetch_fsmap finished waiting for FSMap version 79 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 20 client.16131 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5628543f1af0 0x5628543f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 4 client.16131 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:08:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562854342070 con 0x5628543f1af0 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.432+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5628543f1af0 0x5628543f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.433+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5628543f1af0 0x5628543f3f00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b88149337dddb71 server_cookie=652d14bd50a665a8 in_seq=0 out_seq=0 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.433+0000 7f3f82ffd640 10 client.16131 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.433+0000 7f3f82ffd640 1 -- 172.21.15.92:0/1793869916 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562854342070 con 0x5628543f1af0 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.433+0000 7f3f82ffd640 10 client.16131 handle_command_reply: tid=0 2024-04-26T18:08:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.433+0000 7f3facc02740 1 client.16131 shutdown 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 msgr2=0x5628543de880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3f9409c720 tx=0x7f3f9409d210 comp rx=0 tx=0).stop 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 shutdown_connections 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5628543f1af0 0x5628543f3f00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543e18f0 0x5628543df300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 --2- 172.21.15.92:0/1793869916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543de880 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 >> 172.21.15.92:0/1793869916 conn(0x5628543ca410 msgr2=0x5628543d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3f82ffd640 0 client.16131 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 shutdown_connections 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 1 -- 172.21.15.92:0/1793869916 wait complete. 2024-04-26T18:08:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.434+0000 7f3facc02740 20 client.16131 trim_cache size 0 max 16384 2024-04-26T18:08:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 Processor -- start 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 -- start start 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543ce720 0x5628543c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 0x5628543f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41aedb0 con 0x5628543cde00 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41ac680 con 0x5628543e18f0 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3facc02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41aa4f0 con 0x5628543ce720 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39876/0 (socket says 172.21.15.92:39876) 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2886103238 learned_addr learned my addr 172.21.15.92:0/2886103238 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 0x5628543f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2886103238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543ce720 msgr2=0x5628543c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543ce720 0x5628543c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2886103238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 msgr2=0x5628543f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 0x5628543f9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa37fe640 1 -- 172.21.15.92:0/2886103238 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628543ce550 con 0x5628543cde00 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.449+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 0x5628543f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3f940a22d0 tx=0x7f3f94005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4a0ced66070ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3f897fa640 1 -- 172.21.15.92:0/2886103238 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400f960 con 0x5628543cde00 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3f897fa640 1 -- 172.21.15.92:0/2886103238 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f94098770 con 0x5628543cde00 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3f897fa640 1 -- 172.21.15.92:0/2886103238 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9409bae0 con 0x5628543cde00 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3facc02740 1 -- 172.21.15.92:0/2886103238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 msgr2=0x5628543ed380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.450+0000 7f3facc02740 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3f940a22d0 tx=0x7f3f94005900 comp rx=0 tx=0).stop 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- 172.21.15.92:0/2886103238 shutdown_connections 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543e18f0 0x5628543f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543ce720 0x5628543c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- 172.21.15.92:0/2886103238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543cde00 0x5628543ed380 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- 172.21.15.92:0/2886103238 >> 172.21.15.92:0/2886103238 conn(0x5628543ca410 msgr2=0x5628543c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- 172.21.15.92:0/2886103238 shutdown_connections 2024-04-26T18:08:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- 172.21.15.92:0/2886103238 wait complete. 2024-04-26T18:08:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- start start 2024-04-26T18:08:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 Processor -- start 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 0x5628543db640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41aab40 con 0x5628543e18f0 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41abfb0 con 0x5628543ce720 2024-04-26T18:08:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa41ab210 con 0x5628543cde00 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3facc02740 10 client.0 _ll_register_callbacks cb 0x7f3f9400cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3fa3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39884/0 (socket says 172.21.15.92:39884) 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3fa3fff640 1 -- 172.21.15.92:0/3753546747 learned_addr learned my addr 172.21.15.92:0/3753546747 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.451+0000 7f3fa2ffd640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 0x5628543db640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 -- 172.21.15.92:0/3753546747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 msgr2=0x5628543db640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 0x5628543db640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 -- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 msgr2=0x5628543dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 -- 172.21.15.92:0/3753546747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562854457150 con 0x5628543e18f0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 0x5628543db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3fa3fff640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c032fd0 tx=0x7f3f9c032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b394114b2da92612 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c03d650 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8927+0+0 (secure 0 0 0) 0x7f3f9c03d7f0 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f94098770 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f3f9c063050 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3facc02740 10 client.16137 fetch_fsmap learned FSMap version 79 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x5628544583d0 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f94098770 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 79) ==== 8342+0+0 (secure 0 0 0) 0x7f3f9c04b400 con 0x5628543e18f0 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3facc02740 10 client.16137 fetch_fsmap finished waiting for FSMap version 79 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.452+0000 7f3facc02740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3facc02740 20 client.16137 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562854458660 0x56285445aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3facc02740 4 client.16137 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:08:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56285433bee0 con 0x562854458660 2024-04-26T18:08:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562854458660 0x56285445aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3f82ffd640 10 client.16137 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:02.453+0000 7f3fa37fe640 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562854458660 0x56285445aa50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c72f98baeef35b7 server_cookie=7e7ebef3ec5bd887 in_seq=0 out_seq=0 2024-04-26T18:08:03.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 470.0 s, 2888.0 tps, lat 27.206 ms stddev 29.464 2024-04-26T18:08:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:03 smithi189 ceph-mon[32756]: pgmap v265: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-04-26T18:08:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:03 smithi156 ceph-mon[32679]: pgmap v265: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-04-26T18:08:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:03 smithi092 ceph-mon[29156]: pgmap v265: 97 pgs: 97 active+clean; 3.8 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-04-26T18:08:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:05 smithi189 ceph-mon[32756]: pgmap v266: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 6.0 MiB/s wr, 593 op/s 2024-04-26T18:08:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:05 smithi156 ceph-mon[32679]: pgmap v266: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 6.0 MiB/s wr, 593 op/s 2024-04-26T18:08:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:05 smithi092 ceph-mon[29156]: pgmap v266: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 6.0 MiB/s wr, 593 op/s 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 systemd[1]: Stopped Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.183s CPU time. 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 systemd[1]: Starting Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 podman[68749]: 2024-04-26 18:08:06.282184855 +0000 UTC m=+0.018534677 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:08:06.399 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 podman[68749]: 2024-04-26 18:08:06.399839662 +0000 UTC m=+0.136189460 container create 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:08:06.669 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 podman[68749]: 2024-04-26 18:08:06.645130258 +0000 UTC m=+0.381480056 container init 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:08:06.670 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 podman[68749]: 2024-04-26 18:08:06.647707073 +0000 UTC m=+0.384056874 container start 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T18:08:07.034 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 ceph-mds[68768]: -- 172.21.15.189:0/703315223 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ca4a55a40 con 0x559ca4a29000 2024-04-26T18:08:07.034 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: starting mds.i at 2024-04-26T18:08:07.034 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 bash[68749]: 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a 2024-04-26T18:08:07.034 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:06 smithi189 systemd[1]: Started Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: pgmap v267: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 8.0 MiB/s wr, 798 op/s 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: daemon mds.i restarted 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:boot 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:08:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:07 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: pgmap v267: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 8.0 MiB/s wr, 798 op/s 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: daemon mds.i restarted 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:boot 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:08:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:07 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: pgmap v267: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 8.0 MiB/s wr, 798 op/s 2024-04-26T18:08:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: daemon mds.i restarted 2024-04-26T18:08:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: osdmap e102: 12 total, 12 up, 12 in 2024-04-26T18:08:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:boot 2024-04-26T18:08:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:08:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-26T18:08:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:07 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:08.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 475.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:08:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:08 smithi092 ceph-mon[29156]: pgmap v269: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-04-26T18:08:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:resolve 2024-04-26T18:08:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:08 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:08 smithi189 ceph-mon[32756]: pgmap v269: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-04-26T18:08:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:resolve 2024-04-26T18:08:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:08 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:08 smithi156 ceph-mon[32679]: pgmap v269: 97 pgs: 97 active+clean; 3.8 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.0 MiB/s wr, 698 op/s 2024-04-26T18:08:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:resolve 2024-04-26T18:08:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:08 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.707+0000 7f3f82ffd640 1 -- 172.21.15.92:0/3753546747 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56285433bee0 con 0x562854458660 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.707+0000 7f3f82ffd640 10 client.16137 handle_command_reply: tid=0 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.707+0000 7f3facc02740 1 client.16137 shutdown 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 msgr2=0x5628543dc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c032fd0 tx=0x7f3f9c032ed0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 shutdown_connections 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562854458660 0x56285445aa50 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5628543e18f0 0x5628543dc0c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3f82ffd640 0 client.16137 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628543ce720 0x5628543dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 --2- 172.21.15.92:0/3753546747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5628543cde00 0x5628543db640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 >> 172.21.15.92:0/3753546747 conn(0x5628543ca410 msgr2=0x5628543c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 shutdown_connections 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 1 -- 172.21.15.92:0/3753546747 wait complete. 2024-04-26T18:08:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3facc02740 20 client.16137 trim_cache size 0 max 16384 2024-04-26T18:08:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:08:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:08:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:08:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 msgr2=0x7f3f8c0a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 0x7f3f8c0a6460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c02a9a0 tx=0x7f3f9c009660 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 msgr2=0x7f3fa419b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.708+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400cce0 tx=0x7f3f9400a620 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 shutdown_connections 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f3f8c0a3fa0 0x7f3f8c0a6460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fa410f220 0x7f3fa419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fa4075550 0x7f3fa419b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 --2- 172.21.15.92:0/2741496986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3fa4074c30 0x7f3fa419b200 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 >> 172.21.15.92:0/2741496986 conn(0x7f3fa4079dc0 msgr2=0x7f3fa4100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 shutdown_connections 2024-04-26T18:08:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:09.709+0000 7f3fa9e09640 1 -- 172.21.15.92:0/2741496986 wait complete. 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:reconnect 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:rejoin 2024-04-26T18:08:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:09 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:reconnect 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:rejoin 2024-04-26T18:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:09 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:reconnect 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:rejoin 2024-04-26T18:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:09 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:10 smithi092 ceph-mon[29156]: pgmap v270: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:10 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:08:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:10 smithi189 ceph-mon[32756]: pgmap v270: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:10 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:08:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:10 smithi156 ceph-mon[32679]: pgmap v270: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:10 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:08:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:11 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:11 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:08:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:active 2024-04-26T18:08:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:11 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:11 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:active 2024-04-26T18:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:11 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:11 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:08:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/4214345131,v1:172.21.15.189:6835/4214345131] up:active 2024-04-26T18:08:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:12 smithi092 ceph-mon[29156]: pgmap v271: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:13.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:12 smithi189 ceph-mon[32756]: pgmap v271: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:13.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:12 smithi156 ceph-mon[32679]: pgmap v271: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.8 MiB/s wr, 476 op/s 2024-04-26T18:08:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 480.0 s, 488.7 tps, lat 451.522 ms stddev 1700.779 2024-04-26T18:08:13.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:08:13 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:08:13.474+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:14 smithi092 ceph-mon[29156]: pgmap v272: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-04-26T18:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:14 smithi092 ceph-mon[29156]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:08:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:14 smithi189 ceph-mon[32756]: pgmap v272: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-04-26T18:08:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:14 smithi189 ceph-mon[32756]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:08:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:14 smithi156 ceph-mon[32679]: pgmap v272: 97 pgs: 97 active+clean; 3.8 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.6 MiB/s wr, 503 op/s 2024-04-26T18:08:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:14 smithi156 ceph-mon[32679]: osdmap e103: 12 total, 12 up, 12 in 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3604d9a700 time 2024-04-26T18:08:15.753024+0000 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f360f3c33dd] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.139 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: clone() 2024-04-26T18:08:16.140 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: *** Caught signal (Aborted) ** 2024-04-26T18:08:16.140 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: in thread 7f3604d9a700 thread_name:ms_dispatch 2024-04-26T18:08:16.140 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:15.753+0000 7f3604d9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3604d9a700 time 2024-04-26T18:08:15.753024+0000 2024-04-26T18:08:16.142 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:16.142 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.142 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.142 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f360f3c33dd] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.143 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.144 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: clone() 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f360e14bd20] 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: gsignal() 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: abort() 2024-04-26T18:08:16.145 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f360f3c3437] 2024-04-26T18:08:16.146 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.146 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.146 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.146 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.146 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.147 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 16: clone() 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:15.755+0000 7f3604d9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: in thread 7f3604d9a700 thread_name:ms_dispatch 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f360e14bd20] 2024-04-26T18:08:16.148 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: gsignal() 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: abort() 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f360f3c3437] 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.149 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.150 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 16: clone() 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: -1> 2024-04-26T18:08:15.753+0000 7f3604d9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3604d9a700 time 2024-04-26T18:08:15.753024+0000 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:16.151 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f360f3c33dd] 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.152 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.153 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: clone() 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 0> 2024-04-26T18:08:15.755+0000 7f3604d9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: in thread 7f3604d9a700 thread_name:ms_dispatch 2024-04-26T18:08:16.154 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f360e14bd20] 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: gsignal() 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: abort() 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f360f3c3437] 2024-04-26T18:08:16.155 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.156 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 16: clone() 2024-04-26T18:08:16.157 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: -1> 2024-04-26T18:08:15.753+0000 7f3604d9a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3604d9a700 time 2024-04-26T18:08:15.753024+0000 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.158 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f360f3c33dd] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.159 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.160 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: clone() 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 0> 2024-04-26T18:08:15.755+0000 7f3604d9a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: in thread 7f3604d9a700 thread_name:ms_dispatch 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:16.161 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f360e14bd20] 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2: gsignal() 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 3: abort() 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f360f3c3437] 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f360f3c35a3] 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561d8f6be822] 2024-04-26T18:08:16.162 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561d8f62e598] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561d8f630c17] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561d8f529d0b] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561d8f52a2ac] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561d8f512fad] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f360f657e20] 2024-04-26T18:08:16.163 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 13: (DispatchQueue::entry()+0x51f) [0x7f360f654fdf] 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f360f727fc1] 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f360e1411ca] 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 16: clone() 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68478]: 2024-04-26T18:08:16.164 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:15 smithi189 podman[68820]: 2024-04-26 18:08:15.830366657 +0000 UTC m=+0.034339072 container died aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T18:08:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:16 smithi092 ceph-mon[29156]: pgmap v274: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-04-26T18:08:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:16 smithi189 ceph-mon[32756]: pgmap v274: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-04-26T18:08:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:16 smithi156 ceph-mon[32679]: pgmap v274: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 29 MiB/s wr, 1.89k op/s 2024-04-26T18:08:17.560 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:17 smithi189 podman[68820]: 2024-04-26 18:08:17.29408897 +0000 UTC m=+1.498061386 container remove aa622ad648b4b0da51224c8843daf53ab02e607086b3ba6840a9232ffb3bec4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424) 2024-04-26T18:08:17.560 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:17 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:08:17.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:17 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:08:17.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:17 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.177s CPU time. 2024-04-26T18:08:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 485.0 s, 2490.6 tps, lat 40.561 ms stddev 65.300 2024-04-26T18:08:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:18 smithi092 ceph-mon[29156]: pgmap v275: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2024-04-26T18:08:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:18 smithi189 ceph-mon[32756]: pgmap v275: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2024-04-26T18:08:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:18 smithi156 ceph-mon[32679]: pgmap v275: 97 pgs: 26 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 61 active+clean; 3.9 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 25 MiB/s wr, 1.67k op/s 2024-04-26T18:08:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:20 smithi092 ceph-mon[29156]: pgmap v276: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:20 smithi189 ceph-mon[32756]: pgmap v276: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:20 smithi156 ceph-mon[32679]: pgmap v276: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- 172.21.15.92:0/4219436446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458102220 msgr2=0x7f145810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- 172.21.15.92:0/4219436446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458102220 0x7f145810e6e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1450009930 tx=0x7f145002a420 comp rx=0 tx=0).stop 2024-04-26T18:08:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- 172.21.15.92:0/4219436446 shutdown_connections 2024-04-26T18:08:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- 172.21.15.92:0/4219436446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458102220 0x7f145810e6e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- 172.21.15.92:0/4219436446 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458101860 0x7f1458101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- 172.21.15.92:0/4219436446 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1458107820 0x7f1458107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- 172.21.15.92:0/4219436446 >> 172.21.15.92:0/4219436446 conn(0x7f14580789b0 msgr2=0x7f1458078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- 172.21.15.92:0/4219436446 shutdown_connections 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- 172.21.15.92:0/4219436446 wait complete. 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 Processor -- start 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 -- start start 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.800+0000 7f14605e4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 0x7f14581995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1458107820 0x7f145819d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112be0 con 0x7f1458101860 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112a60 con 0x7f1458102220 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112d60 con 0x7f1458107820 2024-04-26T18:08:22.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46136/0 (socket says 172.21.15.92:46136) 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 -- 172.21.15.92:0/4186814384 learned_addr learned my addr 172.21.15.92:0/4186814384 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145db7f640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 0x7f14581995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 -- 172.21.15.92:0/4186814384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1458107820 msgr2=0x7f145819d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1458107820 0x7f145819d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 -- 172.21.15.92:0/4186814384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 msgr2=0x7f14581995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 0x7f14581995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 -- 172.21.15.92:0/4186814384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145819e050 con 0x7f1458101860 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145db7f640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 0x7f14581995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f145e380640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f145400ba50 tx=0x7f145400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f144f7fe640 1 -- 172.21.15.92:0/4186814384 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454019070 con 0x7f1458101860 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f144f7fe640 1 -- 172.21.15.92:0/4186814384 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f145400cbe0 con 0x7f1458101860 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f145819e340 con 0x7f1458101860 2024-04-26T18:08:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f144f7fe640 1 -- 172.21.15.92:0/4186814384 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540075d0 con 0x7f1458101860 2024-04-26T18:08:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.801+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14581a5bd0 con 0x7f1458101860 2024-04-26T18:08:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.803+0000 7f144f7fe640 1 -- 172.21.15.92:0/4186814384 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f145401c070 con 0x7f1458101860 2024-04-26T18:08:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 Processor -- start 2024-04-26T18:08:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 -- start start 2024-04-26T18:08:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f144f7fe640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 0x7f14440a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a7eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bda59da460 con 0x55bda5a7f0e0 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bda5994590 con 0x55bda5a73f00 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f14633d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bda59d6420 con 0x55bda5a74820 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f145e380640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 0x7f14440a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f145eb81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f144f7fe640 1 -- 172.21.15.92:0/4186814384 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9101+0+0 (secure 0 0 0) 0x7f14540cff70 con 0x7f1458101860 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.804+0000 7f145eb81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46142/0 (socket says 172.21.15.92:46142) 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 -- 172.21.15.92:0/1189831030 learned_addr learned my addr 172.21.15.92:0/1189831030 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145db7f640 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a7eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 -- 172.21.15.92:0/1189831030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 msgr2=0x55bda5a7eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a7eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 -- 172.21.15.92:0/1189831030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 msgr2=0x55bda5a742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 -- 172.21.15.92:0/1189831030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda59a10d0 con 0x55bda5a7f0e0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145e380640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 0x7f14440a6300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f145409bae0 tx=0x7f1454022f90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f145eb81640 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1450005ab0 tx=0x7f1450005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2c9a142bbf85a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f144cbfe640 1 -- 172.21.15.92:0/1189831030 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450035070 con 0x55bda5a7f0e0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f144cbfe640 1 -- 172.21.15.92:0/1189831030 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14500035f0 con 0x55bda5a7f0e0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.805+0000 7f144cbfe640 1 -- 172.21.15.92:0/1189831030 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14500044e0 con 0x55bda5a7f0e0 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- 172.21.15.92:0/1189831030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 msgr2=0x55bda5a814d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1450005ab0 tx=0x7f1450005a20 comp rx=0 tx=0).stop 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- 172.21.15.92:0/1189831030 shutdown_connections 2024-04-26T18:08:22.813 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a7f0e0 0x55bda5a814d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a7eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 --2- 172.21.15.92:0/1189831030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- 172.21.15.92:0/1189831030 >> 172.21.15.92:0/1189831030 conn(0x55bda5a70410 msgr2=0x55bda5a707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- 172.21.15.92:0/1189831030 shutdown_connections 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- 172.21.15.92:0/1189831030 wait complete. 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 -- start start 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.806+0000 7f14633d2740 1 Processor -- start 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a7cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bda5a81cb0 con 0x55bda5a74820 2024-04-26T18:08:22.814 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55bda5961b60 con 0x55bda5a73f00 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55bda5a81e30 con 0x55bda5a7f0e0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 10 client.0 _ll_register_callbacks cb 0x55bda59862b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46144/0 (socket says 172.21.15.92:46144) 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 -- 172.21.15.92:0/1963662816 learned_addr learned my addr 172.21.15.92:0/1963662816 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145eb81640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a7cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145eb81640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 -- 172.21.15.92:0/1963662816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 msgr2=0x55bda5a7cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a7cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 -- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 msgr2=0x55bda5a7c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a7c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 -- 172.21.15.92:0/1963662816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda56ec210 con 0x55bda5a74820 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145eb81640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a7cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f145db7f640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f144800bf50 tx=0x7f14480128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a4927836891cfc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f1441ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14480035f0 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9101+0+0 (secure 0 0 0) 0x7f1448003790 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.807+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14500035f0 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1448024050 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 10 client.16152 fetch_fsmap learned FSMap version 86 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55bda57b8620 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14500035f0 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 86) ==== 8342+0+0 (secure 0 0 0) 0x7f1448019020 con 0x55bda5a74820 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 10 client.16152 fetch_fsmap finished waiting for FSMap version 86 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 20 client.16152 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5a91640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 4 client.16152 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:08:22.816 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bda59e8070 con 0x55bda5a8f250 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.808+0000 7f145eb81640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5a91640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f1441ffb640 10 client.16152 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f145eb81640 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5a91640 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9030c0d0a0c4cd37 server_cookie=f387902a43f937b9 in_seq=0 out_seq=0 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f1441ffb640 1 -- 172.21.15.92:0/1963662816 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55bda59e8070 con 0x55bda5a8f250 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f1441ffb640 10 client.16152 handle_command_reply: tid=0 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 client.16152 shutdown 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 msgr2=0x55bda5a7c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f144800bf50 tx=0x7f14480128e0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 shutdown_connections 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5a91640 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a7cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f1441ffb640 0 client.16152 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.809+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c5e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.810+0000 7f14633d2740 1 --2- 172.21.15.92:0/1963662816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a7c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.810+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 >> 172.21.15.92:0/1963662816 conn(0x55bda5a70410 msgr2=0x55bda5a76140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.810+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 shutdown_connections 2024-04-26T18:08:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.810+0000 7f14633d2740 1 -- 172.21.15.92:0/1963662816 wait complete. 2024-04-26T18:08:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.810+0000 7f14633d2740 20 client.16152 trim_cache size 0 max 16384 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.824+0000 7f14633d2740 1 Processor -- start 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.824+0000 7f14633d2740 1 -- start start 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a6fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a96f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14581b13a0 con 0x55bda5a74820 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f14581aec70 con 0x55bda5a73f00 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f14633d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14581acae0 con 0x55bda5a7f0e0 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46148/0 (socket says 172.21.15.92:46148) 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 -- 172.21.15.92:0/1024025427 learned_addr learned my addr 172.21.15.92:0/1024025427 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:22.829 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 -- 172.21.15.92:0/1024025427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 msgr2=0x55bda5a96f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a96f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 -- 172.21.15.92:0/1024025427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 msgr2=0x55bda5a6fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a6fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 -- 172.21.15.92:0/1024025427 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bda5a7a610 con 0x55bda5a74820 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f145db7f640 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1448010b10 tx=0x7f1448005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2da2551f462ff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f1443fff640 1 -- 172.21.15.92:0/1024025427 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144802c020 con 0x55bda5a74820 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f1443fff640 1 -- 172.21.15.92:0/1024025427 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1448010d00 con 0x55bda5a74820 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.825+0000 7f1443fff640 1 -- 172.21.15.92:0/1024025427 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448005290 con 0x55bda5a74820 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- 172.21.15.92:0/1024025427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 msgr2=0x55bda5a7c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1448010b10 tx=0x7f1448005870 comp rx=0 tx=0).stop 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- 172.21.15.92:0/1024025427 shutdown_connections 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a7f0e0 0x55bda5a96f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a74820 0x55bda5a7c770 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.830 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- 172.21.15.92:0/1024025427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a73f00 0x55bda5a6fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- 172.21.15.92:0/1024025427 >> 172.21.15.92:0/1024025427 conn(0x55bda5a70410 msgr2=0x55bda5a7c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- 172.21.15.92:0/1024025427 shutdown_connections 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- 172.21.15.92:0/1024025427 wait complete. 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- start start 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 Processor -- start 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a84050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a7f0e0 0x55bda5a84590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14581ad130 con 0x55bda5a73f00 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f14581ae5a0 con 0x55bda5a7f0e0 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f14581ad800 con 0x55bda5a74820 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f14633d2740 10 client.0 _ll_register_callbacks cb 0x7f144800b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f145eb81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.831 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.826+0000 7f145eb81640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46152/0 (socket says 172.21.15.92:46152) 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 -- 172.21.15.92:0/3987088740 learned_addr learned my addr 172.21.15.92:0/3987088740 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 -- 172.21.15.92:0/3987088740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 msgr2=0x55bda5a84050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a84050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 -- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a7f0e0 msgr2=0x55bda5a84590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a7f0e0 0x55bda5a84590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 -- 172.21.15.92:0/3987088740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bda5a84b50 con 0x55bda5a73f00 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f145eb81640 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f145002aa10 tx=0x7f1450031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed5908872b36b4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450055030 con 0x55bda5a73f00 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9101+0+0 (secure 0 0 0) 0x7f1450004290 con 0x55bda5a73f00 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1448010d00 con 0x55bda5a73f00 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f1450035040 con 0x55bda5a73f00 2024-04-26T18:08:22.832 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 10 client.16158 fetch_fsmap learned FSMap version 86 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) -- 0x55bda5af6590 con 0x55bda5a73f00 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1448010d00 con 0x55bda5a73f00 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 86) ==== 8342+0+0 (secure 0 0 0) 0x7f145003a040 con 0x55bda5a73f00 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 10 client.16158 fetch_fsmap finished waiting for FSMap version 86 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 10 client.16158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 20 client.16158 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5af87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 4 client.16158 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.827+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bda59e1ee0 con 0x55bda5a8f250 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.828+0000 7f145db7f640 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5af87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.828+0000 7f145db7f640 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5af87c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccea0ea101280038 server_cookie=8d1c997becd12e22 in_seq=0 out_seq=0 2024-04-26T18:08:22.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:22.828+0000 7f1441ffb640 10 client.16158 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:22 smithi092 ceph-mon[29156]: pgmap v277: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:22 smithi189 ceph-mon[32756]: pgmap v277: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:22 smithi156 ceph-mon[32679]: pgmap v277: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 28 MiB/s wr, 1.90k op/s 2024-04-26T18:08:23.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 490.0 s, 657.4 tps, lat 26.112 ms stddev 30.171 2024-04-26T18:08:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:24 smithi189 ceph-mon[32756]: pgmap v278: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-04-26T18:08:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:24 smithi189 ceph-mon[32756]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:08:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:24 smithi156 ceph-mon[32679]: pgmap v278: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-04-26T18:08:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:24 smithi156 ceph-mon[32679]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:08:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:24 smithi092 ceph-mon[29156]: pgmap v278: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 512 KiB/s rd, 26 MiB/s wr, 1.79k op/s 2024-04-26T18:08:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:24 smithi092 ceph-mon[29156]: osdmap e104: 12 total, 12 up, 12 in 2024-04-26T18:08:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:26 smithi189 ceph-mon[32756]: pgmap v280: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:26 smithi156 ceph-mon[32679]: pgmap v280: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:26 smithi092 ceph-mon[29156]: pgmap v280: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:27 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:27 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:27 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.177s CPU time. 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:27 smithi189 systemd[1]: Starting Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:27 smithi189 podman[68917]: 2024-04-26 18:08:27.777414521 +0000 UTC m=+0.019771373 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:08:28.028 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 podman[68917]: 2024-04-26 18:08:28.028869916 +0000 UTC m=+0.271226740 container create 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T18:08:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:08:28.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 podman[68917]: 2024-04-26 18:08:28.290349839 +0000 UTC m=+0.532706663 container init 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:08:28.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 podman[68917]: 2024-04-26 18:08:28.292875468 +0000 UTC m=+0.535232294 container start 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T18:08:28.637 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mds[68936]: -- 172.21.15.189:0/1985964529 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55feaa9dda40 con 0x55feaa9b0c00 2024-04-26T18:08:28.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: starting mds.f at 2024-04-26T18:08:28.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 bash[68917]: 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff 2024-04-26T18:08:28.638 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:08:28 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: pgmap v281: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: daemon mds.f restarted 2024-04-26T18:08:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:08:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:boot 2024-04-26T18:08:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:08:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:08:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: pgmap v281: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: daemon mds.f restarted 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:boot 2024-04-26T18:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:08:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:08:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: pgmap v281: 97 pgs: 97 active+clean; 3.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.0 MiB/s wr, 509 op/s 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: daemon mds.f restarted 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: osdmap e105: 12 total, 12 up, 12 in 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:boot 2024-04-26T18:08:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: Standby daemon mds.i assigned to filesystem cephfs as rank 2 2024-04-26T18:08:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 7 up:standby, 1 failed 2024-04-26T18:08:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:08:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:replay} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:31.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:30 smithi092 ceph-mon[29156]: pgmap v283: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:31.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:resolve 2024-04-26T18:08:31.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:30 smithi189 ceph-mon[32756]: pgmap v283: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:resolve 2024-04-26T18:08:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:30 smithi156 ceph-mon[32679]: pgmap v283: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:resolve 2024-04-26T18:08:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:resolve} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f1441ffb640 1 -- 172.21.15.92:0/3987088740 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bda59e1ee0 con 0x55bda5a8f250 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f1441ffb640 10 client.16158 handle_command_reply: tid=0 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 client.16158 shutdown 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 msgr2=0x55bda5a87270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f145002aa10 tx=0x7f1450031b10 comp rx=0 tx=0).stop 2024-04-26T18:08:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 shutdown_connections 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55bda5a8f250 0x55bda5af87c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bda5a7f0e0 0x55bda5a84590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55bda5a74820 0x55bda5a84050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 --2- 172.21.15.92:0/3987088740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bda5a73f00 0x55bda5a87270 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f1441ffb640 0 client.16158 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 >> 172.21.15.92:0/3987088740 conn(0x55bda5a70410 msgr2=0x55bda5a7c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 shutdown_connections 2024-04-26T18:08:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 1 -- 172.21.15.92:0/3987088740 wait complete. 2024-04-26T18:08:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.792+0000 7f14633d2740 20 client.16158 trim_cache size 0 max 16384 2024-04-26T18:08:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:08:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:08:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:08:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:08:31.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 msgr2=0x7f14440a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 0x7f14440a6300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f145409bae0 tx=0x7f1454022f90 comp rx=0 tx=0).stop 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 msgr2=0x7f1458199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f145400ba50 tx=0x7f145400bf10 comp rx=0 tx=0).stop 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 shutdown_connections 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f14440a3e40 0x7f14440a6300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1458107820 0x7f145819d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1458102220 0x7f14581995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 --2- 172.21.15.92:0/4186814384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1458101860 0x7f1458199060 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 >> 172.21.15.92:0/4186814384 conn(0x7f14580789b0 msgr2=0x7f1458104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 shutdown_connections 2024-04-26T18:08:31.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:31.793+0000 7f14605e4640 1 -- 172.21.15.92:0/4186814384 wait complete. 2024-04-26T18:08:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:reconnect 2024-04-26T18:08:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:rejoin 2024-04-26T18:08:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:31 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:reconnect 2024-04-26T18:08:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:rejoin 2024-04-26T18:08:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:31 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:08:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:08:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:reconnect 2024-04-26T18:08:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:reconnect} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:rejoin 2024-04-26T18:08:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:31 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=i=up:rejoin} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:32 smithi189 ceph-mon[32756]: pgmap v284: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:32 smithi189 ceph-mon[32756]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:08:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:32 smithi156 ceph-mon[32679]: pgmap v284: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:32 smithi156 ceph-mon[32679]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:08:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:32 smithi092 ceph-mon[29156]: pgmap v284: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2024-04-26T18:08:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:32 smithi092 ceph-mon[29156]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-04-26T18:08:33.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 500.0 s, 417.3 tps, lat 678.981 ms stddev 2920.114 2024-04-26T18:08:33.784 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:08:33.475+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:08:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:33 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:33 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:08:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:active 2024-04-26T18:08:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:33 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:33 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:08:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:active 2024-04-26T18:08:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:33 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:33 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:08:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:33 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:08:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6838/2509068358,v1:172.21.15.189:6839/2509068358] up:active 2024-04-26T18:08:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:33 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2024-04-26T18:08:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:33 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:34 smithi189 ceph-mon[32756]: pgmap v285: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 430 KiB/s wr, 60 op/s 2024-04-26T18:08:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:34 smithi156 ceph-mon[32679]: pgmap v285: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 430 KiB/s wr, 60 op/s 2024-04-26T18:08:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:34 smithi092 ceph-mon[29156]: pgmap v285: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 430 KiB/s wr, 60 op/s 2024-04-26T18:08:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:36 smithi189 ceph-mon[32756]: pgmap v286: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:36 smithi156 ceph-mon[32679]: pgmap v286: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:36 smithi092 ceph-mon[29156]: pgmap v286: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:37.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:37.823 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f564431a700 time 2024-04-26T18:08:37.819976+0000 2024-04-26T18:08:37.823 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f564e9433dd] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: clone() 2024-04-26T18:08:37.824 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:37.820+0000 7f564431a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f564431a700 time 2024-04-26T18:08:37.819976+0000 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f564e9433dd] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:37.825 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: clone() 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: *** Caught signal (Aborted) ** 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: in thread 7f564431a700 thread_name:ms_dispatch 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f564d6cbd20] 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: gsignal() 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: abort() 2024-04-26T18:08:37.826 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f564e943437] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:37.827 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 16: clone() 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:37.821+0000 7f564431a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: in thread 7f564431a700 thread_name:ms_dispatch 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f564d6cbd20] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: gsignal() 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: abort() 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f564e943437] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:37.828 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 16: clone() 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:37.829 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.137 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: -1> 2024-04-26T18:08:37.820+0000 7f564431a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f564431a700 time 2024-04-26T18:08:37.819976+0000 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f564e9433dd] 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:38.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: clone() 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.139 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 0> 2024-04-26T18:08:37.821+0000 7f564431a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: in thread 7f564431a700 thread_name:ms_dispatch 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f564d6cbd20] 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: gsignal() 2024-04-26T18:08:38.140 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: abort() 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f564e943437] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:38.141 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 16: clone() 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:38.142 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: -1> 2024-04-26T18:08:37.820+0000 7f564431a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f564431a700 time 2024-04-26T18:08:37.819976+0000 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f564e9433dd] 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:38.143 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: clone() 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 0> 2024-04-26T18:08:37.821+0000 7f564431a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: in thread 7f564431a700 thread_name:ms_dispatch 2024-04-26T18:08:38.144 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f564d6cbd20] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2: gsignal() 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 3: abort() 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f564e943437] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f564e9435a3] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x559ca27eb822] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x559ca275b598] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x559ca275dc17] 2024-04-26T18:08:38.145 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x559ca2656d0b] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x559ca26572ac] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x559ca263ffad] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f564ebd7e20] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 13: (DispatchQueue::entry()+0x51f) [0x7f564ebd4fdf] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f564eca7fc1] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f564d6c11ca] 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 16: clone() 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i[68764]: 2024-04-26T18:08:38.146 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:37 smithi189 podman[68975]: 2024-04-26 18:08:37.8786453 +0000 UTC m=+0.019154262 container died 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-26T18:08:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:37 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:38.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:37 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-04-26T18:08:38.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 505.0 s, 2803.6 tps, lat 35.445 ms stddev 39.494 2024-04-26T18:08:38.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:38 smithi189 ceph-mon[32756]: pgmap v287: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:38.865 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:38 smithi189 podman[68975]: 2024-04-26 18:08:38.613461487 +0000 UTC m=+0.753970435 container remove 70b772c15fafa962c341017e0493cc004dc591605c8246dbd5097ce968f85c6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-i, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:08:38.865 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:38 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:08:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:38 smithi092 ceph-mon[29156]: pgmap v287: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:39.137 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:38 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:08:39.137 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:38 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.113s CPU time. 2024-04-26T18:08:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:38 smithi156 ceph-mon[32679]: pgmap v287: 97 pgs: 97 active+clean; 3.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.7 MiB/s wr, 140 op/s 2024-04-26T18:08:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:40 smithi189 ceph-mon[32756]: pgmap v288: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-04-26T18:08:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:40 smithi156 ceph-mon[32679]: pgmap v288: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-04-26T18:08:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:40 smithi092 ceph-mon[29156]: pgmap v288: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.2 MiB/s wr, 514 op/s 2024-04-26T18:08:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:42 smithi189 ceph-mon[32756]: pgmap v289: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2024-04-26T18:08:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:42 smithi156 ceph-mon[32679]: pgmap v289: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2024-04-26T18:08:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:42 smithi092 ceph-mon[29156]: pgmap v289: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.6 MiB/s wr, 440 op/s 2024-04-26T18:08:43.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 510.0 s, 2927.0 tps, lat 34.293 ms stddev 38.028 2024-04-26T18:08:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 -- 172.21.15.92:0/2908904524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 msgr2=0x7f2ef810f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 --2- 172.21.15.92:0/2908904524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef810f810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009cd0 tx=0x7f2ef002a8e0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 -- 172.21.15.92:0/2908904524 shutdown_connections 2024-04-26T18:08:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 --2- 172.21.15.92:0/2908904524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef810f810 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 --2- 172.21.15.92:0/2908904524 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 0x7f2ef8102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 --2- 172.21.15.92:0/2908904524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 0x7f2ef8108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 -- 172.21.15.92:0/2908904524 >> 172.21.15.92:0/2908904524 conn(0x7f2ef80fe430 msgr2=0x7f2ef8100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 -- 172.21.15.92:0/2908904524 shutdown_connections 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.882+0000 7f2efec8c640 1 -- 172.21.15.92:0/2908904524 wait complete. 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 Processor -- start 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 -- start start 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 0x7f2ef8074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 0x7f2ef80756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8112c60 con 0x7f2ef8103300 2024-04-26T18:08:44.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8112ae0 con 0x7f2ef8108950 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efec8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8112de0 con 0x7f2ef8102940 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49146/0 (socket says 172.21.15.92:49146) 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 -- 172.21.15.92:0/3249433221 learned_addr learned my addr 172.21.15.92:0/3249433221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efd229640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 0x7f2ef80756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2efca28640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 0x7f2ef8074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 -- 172.21.15.92:0/3249433221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 msgr2=0x7f2ef8074c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 0x7f2ef8074c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 -- 172.21.15.92:0/3249433221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 msgr2=0x7f2ef80756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.883+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 0x7f2ef80756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2ef7fff640 1 -- 172.21.15.92:0/3249433221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef81a7560 con 0x7f2ef8103300 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00d770 tx=0x7f2eec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2ef5ffb640 1 -- 172.21.15.92:0/3249433221 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec017070 con 0x7f2ef8103300 2024-04-26T18:08:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef81a7850 con 0x7f2ef8103300 2024-04-26T18:08:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2ef5ffb640 1 -- 172.21.15.92:0/3249433221 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0054d0 con 0x7f2ef8103300 2024-04-26T18:08:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2ef5ffb640 1 -- 172.21.15.92:0/3249433221 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec004c30 con 0x7f2ef8103300 2024-04-26T18:08:44.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.884+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef81a7d50 con 0x7f2ef8103300 2024-04-26T18:08:44.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.892+0000 7f2f019a8740 1 Processor -- start 2024-04-26T18:08:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.899+0000 7f2ef5ffb640 1 -- 172.21.15.92:0/3249433221 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2eec004e10 con 0x7f2ef8103300 2024-04-26T18:08:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.899+0000 7f2ef5ffb640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 0x7f2ee00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.900+0000 7f2ef5ffb640 1 -- 172.21.15.92:0/3249433221 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9099+0+0 (secure 0 0 0) 0x7f2eec0d0570 con 0x7f2ef8103300 2024-04-26T18:08:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2efd229640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 0x7f2ee00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 -- start start 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab865200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab8788f0 0x55d0ab87ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab7cb460 con 0x55d0ab8788f0 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab785590 con 0x55d0ab864e20 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2f019a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab7c7420 con 0x55d0ab865740 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.92:34954/0 (socket says 172.21.15.92:34954) 2024-04-26T18:08:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.902+0000 7f2ef7fff640 1 -- 172.21.15.92:0/2944759959 learned_addr learned my addr 172.21.15.92:0/2944759959 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.905+0000 7f2ef7fff640 1 -- 172.21.15.92:0/2944759959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 msgr2=0x55d0ab865200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:08:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.905+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab865200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.905+0000 7f2ef7fff640 1 -- 172.21.15.92:0/2944759959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab8788f0 msgr2=0x55d0ab87ace0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:08:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.905+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab8788f0 0x55d0ab87ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.905+0000 7f2ef7fff640 1 -- 172.21.15.92:0/2944759959 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ab7920d0 con 0x55d0ab865740 2024-04-26T18:08:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.907+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009610 tx=0x7f2eec09ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3c7dd89be3e46d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.909+0000 7f2edeffd640 1 -- 172.21.15.92:0/2944759959 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0cf050 con 0x55d0ab865740 2024-04-26T18:08:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.910+0000 7f2edeffd640 1 -- 172.21.15.92:0/2944759959 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0a4ee0 con 0x55d0ab865740 2024-04-26T18:08:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.910+0000 7f2edeffd640 1 -- 172.21.15.92:0/2944759959 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec020040 con 0x55d0ab865740 2024-04-26T18:08:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 -- 172.21.15.92:0/2944759959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 msgr2=0x55d0ab8783b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009610 tx=0x7f2eec09ca30 comp rx=0 tx=0).stop 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 -- 172.21.15.92:0/2944759959 shutdown_connections 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab8788f0 0x55d0ab87ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab8783b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2944759959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab865200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2f019a8740 1 -- 172.21.15.92:0/2944759959 >> 172.21.15.92:0/2944759959 conn(0x55d0ab861410 msgr2=0x55d0ab8617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.911+0000 7f2efd229640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 0x7f2ee00a6300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0004af0 tx=0x7f2ef0005d80 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.912+0000 7f2f019a8740 1 -- 172.21.15.92:0/2944759959 shutdown_connections 2024-04-26T18:08:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.912+0000 7f2f019a8740 1 -- 172.21.15.92:0/2944759959 wait complete. 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.912+0000 7f2f019a8740 1 -- start start 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.912+0000 7f2f019a8740 1 Processor -- start 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 0x55d0ab872950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab878130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab867d20 con 0x55d0ab865740 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab752b60 con 0x55d0ab864e20 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d0ab867ea0 con 0x55d0ab8788f0 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2efca28640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 0x55d0ab872950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2efca28640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:51686/0 (socket says 172.21.15.92:51686) 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2efca28640 1 -- 172.21.15.92:0/586580880 learned_addr learned my addr 172.21.15.92:0/586580880 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2f019a8740 10 client.0 _ll_register_callbacks cb 0x55d0ab7772b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.913+0000 7f2efd229640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab878130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 -- 172.21.15.92:0/586580880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 msgr2=0x55d0ab878130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab878130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 -- 172.21.15.92:0/586580880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 msgr2=0x55d0ab872950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 0x55d0ab872950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 -- 172.21.15.92:0/586580880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ab4dd210 con 0x55d0ab864e20 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 0x55d0ab872950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2efca28640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800bd70 tx=0x7f2ee800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1268e633801f39ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2ed7fff640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8015070 con 0x55d0ab864e20 2024-04-26T18:08:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eec0a4ee0 con 0x55d0ab864e20 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9099+0+0 (secure 0 0 0) 0x7f2ee8011650 con 0x55d0ab864e20 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f2ee8023050 con 0x55d0ab864e20 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2f019a8740 10 client.25649 fetch_fsmap learned FSMap version 94 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.914+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) -- 0x55d0ab5a9620 con 0x55d0ab864e20 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0a4ee0 con 0x55d0ab864e20 2024-04-26T18:08:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 94) ==== 8346+0+0 (secure 0 0 0) 0x7f2ee801aa70 con 0x55d0ab864e20 2024-04-26T18:08:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 10 client.25649 fetch_fsmap finished waiting for FSMap version 94 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 20 client.25649 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8912e0 0x55d0ab8936d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 4 client.25649 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0ab7d9070 con 0x55d0ab8912e0 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.915+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8912e0 0x55d0ab8936d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.916+0000 7f2ed7fff640 10 client.25649 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.916+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8912e0 0x55d0ab8936d0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30dc41c055513890 server_cookie=c924379eacf18e20 in_seq=0 out_seq=0 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.916+0000 7f2ed7fff640 1 -- 172.21.15.92:0/586580880 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0ab7d9070 con 0x55d0ab8912e0 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.916+0000 7f2ed7fff640 10 client.25649 handle_command_reply: tid=0 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.916+0000 7f2f019a8740 1 client.25649 shutdown 2024-04-26T18:08:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 msgr2=0x55d0ab872410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800bd70 tx=0x7f2ee800f730 comp rx=0 tx=0).stop 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 shutdown_connections 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8912e0 0x55d0ab8936d0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab878130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab865740 0x55d0ab872950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 --2- 172.21.15.92:0/586580880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab864e20 0x55d0ab872410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 >> 172.21.15.92:0/586580880 conn(0x55d0ab861410 msgr2=0x55d0ab867170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2ed7fff640 0 client.25649 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 shutdown_connections 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 1 -- 172.21.15.92:0/586580880 wait complete. 2024-04-26T18:08:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.917+0000 7f2f019a8740 20 client.25649 trim_cache size 0 max 16384 2024-04-26T18:08:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 Processor -- start 2024-04-26T18:08:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 -- start start 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab898fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab8788f0 0x55d0ab899500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81af160 con 0x55d0ab864e20 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81aca00 con 0x55d0ab8788f0 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2f019a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81aa850 con 0x55d0ab865740 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2efca28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2efca28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49168/0 (socket says 172.21.15.92:49168) 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2efca28640 1 -- 172.21.15.92:0/579375843 learned_addr learned my addr 172.21.15.92:0/579375843 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2efd229640 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab8788f0 0x55d0ab899500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.932+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab898fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 -- 172.21.15.92:0/579375843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 msgr2=0x55d0ab898fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab898fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 -- 172.21.15.92:0/579375843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab8788f0 msgr2=0x55d0ab899500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab8788f0 0x55d0ab899500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 -- 172.21.15.92:0/579375843 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ab86c720 con 0x55d0ab864e20 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2efca28640 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5e0 tx=0x7f2ee800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52fa757a26be304 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2ede7fc640 1 -- 172.21.15.92:0/579375843 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8020040 con 0x55d0ab864e20 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2ede7fc640 1 -- 172.21.15.92:0/579375843 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee801a460 con 0x55d0ab864e20 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.933+0000 7f2ede7fc640 1 -- 172.21.15.92:0/579375843 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8015040 con 0x55d0ab864e20 2024-04-26T18:08:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- 172.21.15.92:0/579375843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 msgr2=0x55d0ab878110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5e0 tx=0x7f2ee800bf80 comp rx=0 tx=0).stop 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- 172.21.15.92:0/579375843 shutdown_connections 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab8788f0 0x55d0ab899500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab865740 0x55d0ab898fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- 172.21.15.92:0/579375843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab878110 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- 172.21.15.92:0/579375843 >> 172.21.15.92:0/579375843 conn(0x55d0ab861410 msgr2=0x55d0ab8617f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- 172.21.15.92:0/579375843 shutdown_connections 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- 172.21.15.92:0/579375843 wait complete. 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- start start 2024-04-26T18:08:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 Processor -- start 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 0x55d0ab86aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab86b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81aaec0 con 0x55d0ab864e20 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81ac330 con 0x55d0ab865740 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef81ab590 con 0x55d0ab8788f0 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.934+0000 7f2f019a8740 10 client.0 _ll_register_callbacks cb 0x7f2ee800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 0x55d0ab86aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49174/0 (socket says 172.21.15.92:49174) 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 -- 172.21.15.92:0/2170726603 learned_addr learned my addr 172.21.15.92:0/2170726603 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efd229640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab86b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 -- 172.21.15.92:0/2170726603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 msgr2=0x55d0ab86b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab86b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 -- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 msgr2=0x55d0ab86aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 0x55d0ab86aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 -- 172.21.15.92:0/2170726603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ab86d5a0 con 0x55d0ab864e20 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 0x55d0ab86aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2efca28640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801a840 tx=0x7f2ee801a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1ca53468d56301 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ed7fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800fc30 con 0x55d0ab864e20 2024-04-26T18:08:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9099+0+0 (secure 0 0 0) 0x7f2ee8004030 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee801a460 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7f2ee8040050 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2f019a8740 10 client.16173 fetch_fsmap learned FSMap version 94 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.935+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) -- 0x55d0ab8f7680 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee801a460 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 94) ==== 8346+0+0 (secure 0 0 0) 0x7f2ee80035f0 con 0x55d0ab864e20 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 10 client.16173 fetch_fsmap finished waiting for FSMap version 94 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 20 client.16173 populate_metadata read hostname 'smithi092' 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8f7c90 0x55d0ab8fa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 4 client.16173 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d0ab7d2ee0 con 0x55d0ab8f7c90 2024-04-26T18:08:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8f7c90 0x55d0ab8fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2ed7fff640 10 client.16173 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:44.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:44.936+0000 7f2ef7fff640 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8f7c90 0x55d0ab8fa080 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff8fe5ba82610d3 server_cookie=82f14eb455092de3 in_seq=0 out_seq=0 2024-04-26T18:08:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:44 smithi189 ceph-mon[32756]: pgmap v290: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.7 MiB/s wr, 446 op/s 2024-04-26T18:08:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:44 smithi156 ceph-mon[32679]: pgmap v290: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.7 MiB/s wr, 446 op/s 2024-04-26T18:08:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:44 smithi092 ceph-mon[29156]: pgmap v290: 97 pgs: 97 active+clean; 3.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 4.7 MiB/s wr, 446 op/s 2024-04-26T18:08:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:46 smithi189 ceph-mon[32756]: pgmap v291: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 7.9 MiB/s wr, 730 op/s 2024-04-26T18:08:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:46 smithi156 ceph-mon[32679]: pgmap v291: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 7.9 MiB/s wr, 730 op/s 2024-04-26T18:08:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:46 smithi092 ceph-mon[29156]: pgmap v291: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 7.9 MiB/s wr, 730 op/s 2024-04-26T18:08:48.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 515.0 s, 384.1 tps, lat 36.181 ms stddev 38.580 2024-04-26T18:08:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:48 smithi189 ceph-mon[32756]: pgmap v292: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 658 op/s 2024-04-26T18:08:49.137 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:08:49.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: Stopped Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:49.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Consumed 1.113s CPU time. 2024-04-26T18:08:49.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Start request repeated too quickly. 2024-04-26T18:08:49.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.i.service: Failed with result 'exit-code'. 2024-04-26T18:08:49.138 INFO:journalctl@ceph.mds.i.smithi189.stdout:Apr 26 18:08:48 smithi189 systemd[1]: Failed to start Ceph mds.i for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:08:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:48 smithi156 ceph-mon[32679]: pgmap v292: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 658 op/s 2024-04-26T18:08:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:48 smithi092 ceph-mon[29156]: pgmap v292: 97 pgs: 97 active+clean; 3.7 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.8 MiB/s wr, 658 op/s 2024-04-26T18:08:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:50 smithi189 ceph-mon[32756]: pgmap v293: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-04-26T18:08:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:50 smithi156 ceph-mon[32679]: pgmap v293: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-04-26T18:08:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:50 smithi092 ceph-mon[29156]: pgmap v293: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 775 op/s 2024-04-26T18:08:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:08:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:52 smithi189 ceph-mon[32756]: pgmap v294: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 410 op/s 2024-04-26T18:08:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:08:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:52 smithi156 ceph-mon[32679]: pgmap v294: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 410 op/s 2024-04-26T18:08:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:08:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:52 smithi092 ceph-mon[29156]: pgmap v294: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 410 op/s 2024-04-26T18:08:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:08:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:08:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:08:53.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:08:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: pgmap v295: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 412 op/s 2024-04-26T18:08:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-04-26T18:08:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T18:08:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:08:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:54 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: pgmap v295: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 412 op/s 2024-04-26T18:08:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-04-26T18:08:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T18:08:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:08:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:54 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: pgmap v295: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 412 op/s 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: Replacing daemon mds.i as rank 2 with standby daemon mds.f 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: MDS daemon mds.i is removed because it is dead or otherwise unavailable. 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: osdmap e106: 12 total, 12 up, 12 in 2024-04-26T18:08:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:54 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:56 smithi189 ceph-mon[32756]: pgmap v297: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:resolve 2024-04-26T18:08:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:56 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:56 smithi156 ceph-mon[32679]: pgmap v297: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:resolve 2024-04-26T18:08:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:56 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:56 smithi092 ceph-mon[29156]: pgmap v297: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:resolve 2024-04-26T18:08:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:56 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2ed7fff640 1 -- 172.21.15.92:0/2170726603 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d0ab7d2ee0 con 0x55d0ab8f7c90 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2ed7fff640 10 client.16173 handle_command_reply: tid=0 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 client.16173 shutdown 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 msgr2=0x55d0ab86a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2ee801a840 tx=0x7f2ee801a870 comp rx=0 tx=0).stop 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 shutdown_connections 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55d0ab8f7c90 0x55d0ab8fa080 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d0ab8788f0 0x55d0ab86b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d0ab865740 0x55d0ab86aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2ed7fff640 0 client.16173 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 --2- 172.21.15.92:0/2170726603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0ab864e20 0x55d0ab86a660 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 >> 172.21.15.92:0/2170726603 conn(0x55d0ab861410 msgr2=0x55d0ab8668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:57.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 shutdown_connections 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 1 -- 172.21.15.92:0/2170726603 wait complete. 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.864+0000 7f2f019a8740 20 client.16173 trim_cache size 0 max 16384 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:08:57.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 msgr2=0x7f2ee00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 0x7f2ee00a6300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0004af0 tx=0x7f2ef0005d80 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 msgr2=0x7f2ef8075170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00d770 tx=0x7f2eec00dc30 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 shutdown_connections 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2ee00a3e40 0x7f2ee00a6300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ef8108950 0x7f2ef80756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ef8103300 0x7f2ef8075170 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 --2- 172.21.15.92:0/3249433221 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2ef8102940 0x7f2ef8074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 >> 172.21.15.92:0/3249433221 conn(0x7f2ef80fe430 msgr2=0x7f2ef80fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 shutdown_connections 2024-04-26T18:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:08:57.865+0000 7f2efec8c640 1 -- 172.21.15.92:0/3249433221 wait complete. 2024-04-26T18:08:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:08:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:08:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:reconnect 2024-04-26T18:08:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:rejoin 2024-04-26T18:08:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:57 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:08:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:08:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:reconnect 2024-04-26T18:08:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:rejoin 2024-04-26T18:08:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:57 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00099998 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:reconnect 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:rejoin 2024-04-26T18:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:57 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:08:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:08:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:58 smithi189 ceph-mon[32756]: pgmap v298: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:58 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:08:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:58 smithi156 ceph-mon[32679]: pgmap v298: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:58 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:08:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:58 smithi092 ceph-mon[29156]: pgmap v298: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.6 MiB/s wr, 197 op/s 2024-04-26T18:08:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:58 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:09:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:59 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:59 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:09:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:59 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:active 2024-04-26T18:09:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:59 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:08:59 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:59 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:59 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:09:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:59 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:active 2024-04-26T18:09:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:59 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:08:59 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:59 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:59 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:59 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/530211968,v1:172.21.15.189:6835/530211968] up:active 2024-04-26T18:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:59 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:08:59 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:00 smithi189 ceph-mon[32756]: pgmap v299: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:01.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:00 smithi092 ceph-mon[29156]: pgmap v299: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:00 smithi156 ceph-mon[32679]: pgmap v299: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:02 smithi189 ceph-mon[32756]: pgmap v300: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:02 smithi156 ceph-mon[32679]: pgmap v300: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:02 smithi092 ceph-mon[29156]: pgmap v300: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 859 KiB/s wr, 116 op/s 2024-04-26T18:09:03.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 530.0 s, 1401.8 tps, lat 273.682 ms stddev 1766.648 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f143ffb6700 time 2024-04-26T18:09:03.891854+0000 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f144a5df3dd] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.292 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: clone() 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:03.892+0000 7f143ffb6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f143ffb6700 time 2024-04-26T18:09:03.891854+0000 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:04.293 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.294 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.294 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f144a5df3dd] 2024-04-26T18:09:04.294 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.294 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.294 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.297 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: clone() 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: *** Caught signal (Aborted) ** 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: in thread 7f143ffb6700 thread_name:ms_dispatch 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1449367d20] 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: gsignal() 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: abort() 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f144a5df437] 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.298 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 16: clone() 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:03.894+0000 7f143ffb6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: in thread 7f143ffb6700 thread_name:ms_dispatch 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.299 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1449367d20] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: gsignal() 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: abort() 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f144a5df437] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.300 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 16: clone() 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: -1> 2024-04-26T18:09:03.892+0000 7f143ffb6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f143ffb6700 time 2024-04-26T18:09:03.891854+0000 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f144a5df3dd] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.301 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: clone() 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 0> 2024-04-26T18:09:03.894+0000 7f143ffb6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: in thread 7f143ffb6700 thread_name:ms_dispatch 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1449367d20] 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: gsignal() 2024-04-26T18:09:04.302 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: abort() 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f144a5df437] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 16: clone() 2024-04-26T18:09:04.303 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: -1> 2024-04-26T18:09:03.892+0000 7f143ffb6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f143ffb6700 time 2024-04-26T18:09:03.891854+0000 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f144a5df3dd] 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.304 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: clone() 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 0> 2024-04-26T18:09:03.894+0000 7f143ffb6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:04.305 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: in thread 7f143ffb6700 thread_name:ms_dispatch 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1449367d20] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2: gsignal() 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 3: abort() 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f144a5df437] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f144a5df5a3] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fea8347822] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fea82b7598] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fea82b9c17] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fea81b2d0b] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fea81b32ac] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fea819bfad] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f144a873e20] 2024-04-26T18:09:04.306 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 13: (DispatchQueue::entry()+0x51f) [0x7f144a870fdf] 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f144a943fc1] 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f144935d1ca] 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 16: clone() 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[68932]: 2024-04-26T18:09:04.307 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:03 smithi189 podman[69161]: 2024-04-26 18:09:03.958892543 +0000 UTC m=+0.019892758 container died 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T18:09:04.880 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:04 smithi189 podman[69161]: 2024-04-26 18:09:04.610231045 +0000 UTC m=+0.671231248 container remove 36ebc49fa13bc6b1d7428ecff29f2a87efedb472c586b7512478df2b3ffd79ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:09:04.880 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:04 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:09:04.880 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:04 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:09:04.880 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:04 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.116s CPU time. 2024-04-26T18:09:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:04 smithi189 ceph-mon[32756]: pgmap v301: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 886 KiB/s wr, 123 op/s 2024-04-26T18:09:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:04 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:04 smithi156 ceph-mon[32679]: pgmap v301: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 886 KiB/s wr, 123 op/s 2024-04-26T18:09:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:04 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:04 smithi092 ceph-mon[29156]: pgmap v301: 97 pgs: 97 active+clean; 3.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 886 KiB/s wr, 123 op/s 2024-04-26T18:09:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:04 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:06 smithi189 ceph-mon[32756]: pgmap v302: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 2.4 MiB/s wr, 335 op/s 2024-04-26T18:09:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:06 smithi156 ceph-mon[32679]: pgmap v302: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 2.4 MiB/s wr, 335 op/s 2024-04-26T18:09:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:06 smithi092 ceph-mon[29156]: pgmap v302: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 2.4 MiB/s wr, 335 op/s 2024-04-26T18:09:08.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 535.0 s, 258.9 tps, lat 261.059 ms stddev 243.027 2024-04-26T18:09:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:08 smithi189 ceph-mon[32756]: pgmap v303: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.1 MiB/s wr, 304 op/s 2024-04-26T18:09:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:08 smithi156 ceph-mon[32679]: pgmap v303: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.1 MiB/s wr, 304 op/s 2024-04-26T18:09:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:08 smithi092 ceph-mon[29156]: pgmap v303: 97 pgs: 97 active+clean; 3.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.1 MiB/s wr, 304 op/s 2024-04-26T18:09:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:09 smithi156 ceph-mon[32679]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T18:09:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:09 smithi092 ceph-mon[29156]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T18:09:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:09 smithi189 ceph-mon[32756]: osdmap e107: 12 total, 12 up, 12 in 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 -- 172.21.15.92:0/2212825412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c1067d0 msgr2=0x7fd42c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 --2- 172.21.15.92:0/2212825412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c1067d0 0x7fd42c106bb0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009900 tx=0x7fd41c02a410 comp rx=0 tx=0).stop 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 -- 172.21.15.92:0/2212825412 shutdown_connections 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 --2- 172.21.15.92:0/2212825412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c102540 0x7fd42c10e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 --2- 172.21.15.92:0/2212825412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c101b80 0x7fd42c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 --2- 172.21.15.92:0/2212825412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c1067d0 0x7fd42c106bb0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 -- 172.21.15.92:0/2212825412 >> 172.21.15.92:0/2212825412 conn(0x7fd42c077630 msgr2=0x7fd42c077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 -- 172.21.15.92:0/2212825412 shutdown_connections 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.958+0000 7fd430c07640 1 -- 172.21.15.92:0/2212825412 wait complete. 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 Processor -- start 2024-04-26T18:09:10.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 -- start start 2024-04-26T18:09:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c101b80 0x7fd42c197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c1067d0 0x7fd42c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c111a70 con 0x7fd42c102540 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1118f0 con 0x7fd42c101b80 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd430c07640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c111bf0 con 0x7fd42c1067d0 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58592/0 (socket says 172.21.15.92:58592) 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 -- 172.21.15.92:0/3792983460 learned_addr learned my addr 172.21.15.92:0/3792983460 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c1067d0 0x7fd42c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd42a59c640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c101b80 0x7fd42c197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 -- 172.21.15.92:0/3792983460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c1067d0 msgr2=0x7fd42c1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c1067d0 0x7fd42c1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 -- 172.21.15.92:0/3792983460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c101b80 msgr2=0x7fd42c197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c101b80 0x7fd42c197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.959+0000 7fd423fff640 1 -- 172.21.15.92:0/3792983460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c1a7490 con 0x7fd42c102540 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd423fff640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd41400d950 tx=0x7fd41400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd4237fe640 1 -- 172.21.15.92:0/3792983460 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd414017030 con 0x7fd42c102540 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd4237fe640 1 -- 172.21.15.92:0/3792983460 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd414004020 con 0x7fd42c102540 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c1a7780 con 0x7fd42c102540 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd4237fe640 1 -- 172.21.15.92:0/3792983460 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140047a0 con 0x7fd42c102540 2024-04-26T18:09:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.960+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c1a7d20 con 0x7fd42c102540 2024-04-26T18:09:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.962+0000 7fd4237fe640 1 -- 172.21.15.92:0/3792983460 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fd414009a30 con 0x7fd42c102540 2024-04-26T18:09:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.962+0000 7fd4339f8740 1 Processor -- start 2024-04-26T18:09:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.962+0000 7fd4339f8740 1 -- start start 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.962+0000 7fd4237fe640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 0x7fd4180a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82abba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559eb8207460 con 0x559eb82a0f00 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559eb81c1590 con 0x559eb82ac0e0 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4339f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559eb8203420 con 0x559eb82a1820 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 0x7fd4180a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd4237fe640 1 -- 172.21.15.92:0/3792983460 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9273+0+0 (secure 0 0 0) 0x7fd4140d04b0 con 0x7fd42c102540 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58602/0 (socket says 172.21.15.92:58602) 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 -- 172.21.15.92:0/87711854 learned_addr learned my addr 172.21.15.92:0/87711854 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd423fff640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 -- 172.21.15.92:0/87711854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 msgr2=0x559eb82abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 -- 172.21.15.92:0/87711854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 msgr2=0x559eb82ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 -- 172.21.15.92:0/87711854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb81ce0d0 con 0x559eb82a0f00 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd423fff640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 0x7fd4180a6300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd42c06c240 tx=0x7fd424014b70 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd42a59c640 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009900 tx=0x7fd41c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fec6fc437bd887 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd420ff9640 1 -- 172.21.15.92:0/87711854 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c040070 con 0x559eb82a0f00 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd420ff9640 1 -- 172.21.15.92:0/87711854 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c004030 con 0x559eb82a0f00 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.963+0000 7fd420ff9640 1 -- 172.21.15.92:0/87711854 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c035040 con 0x559eb82a0f00 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- 172.21.15.92:0/87711854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 msgr2=0x559eb82a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009900 tx=0x7fd41c032bd0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- 172.21.15.92:0/87711854 shutdown_connections 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 --2- 172.21.15.92:0/87711854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82a12e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- 172.21.15.92:0/87711854 >> 172.21.15.92:0/87711854 conn(0x559eb829d410 msgr2=0x559eb829d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- 172.21.15.92:0/87711854 shutdown_connections 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- 172.21.15.92:0/87711854 wait complete. 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.964+0000 7fd4339f8740 1 -- start start 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 Processor -- start 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82a0f00 0x559eb82a9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559eb82aecb0 con 0x559eb82ac0e0 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x559eb818eb60 con 0x559eb82a0f00 2024-04-26T18:09:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x559eb82aee30 con 0x559eb82a1820 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd4339f8740 10 client.0 _ll_register_callbacks cb 0x559eb81b32b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58608/0 (socket says 172.21.15.92:58608) 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 -- 172.21.15.92:0/2615432018 learned_addr learned my addr 172.21.15.92:0/2615432018 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42a59c640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82a0f00 0x559eb82a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd423fff640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 -- 172.21.15.92:0/2615432018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 msgr2=0x559eb82a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 -- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82a0f00 msgr2=0x559eb82a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82a0f00 0x559eb82a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 -- 172.21.15.92:0/2615432018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb7f19210 con 0x559eb82ac0e0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd424012f10 tx=0x7fd424004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb968f08e4ba54ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.965+0000 7fd411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424025070 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9273+0+0 (secure 0 0 0) 0x7fd424021420 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd41c004030 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fd424031050 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 10 client.16185 fetch_fsmap learned FSMap version 101 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) -- 0x559eb7fe5620 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c004030 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 101) ==== 7741+0+0 (secure 0 0 0) 0x7fd42400f040 con 0x559eb82ac0e0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 10 client.16185 fetch_fsmap finished waiting for FSMap version 101 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 20 client.16185 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb82bc0f0 0x559eb82be500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 4 client.16185 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eb8215070 con 0x559eb82bc0f0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.966+0000 7fd42a59c640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb82bc0f0 0x559eb82be500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.967+0000 7fd411ffb640 10 client.16185 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.967+0000 7fd42a59c640 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb82bc0f0 0x559eb82be500 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed2f918267399ca7 server_cookie=178c6465a5f5914b in_seq=0 out_seq=0 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.967+0000 7fd411ffb640 1 -- 172.21.15.92:0/2615432018 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559eb8215070 con 0x559eb82bc0f0 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.967+0000 7fd411ffb640 10 client.16185 handle_command_reply: tid=0 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.967+0000 7fd4339f8740 1 client.16185 shutdown 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 msgr2=0x559eb82a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd424012f10 tx=0x7fd424004ab0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 shutdown_connections 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb82bc0f0 0x559eb82be500 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82ac0e0 0x559eb82a9ac0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd411ffb640 0 client.16185 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 --2- 172.21.15.92:0/2615432018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82a0f00 0x559eb82a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 >> 172.21.15.92:0/2615432018 conn(0x559eb829d410 msgr2=0x559eb82a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 shutdown_connections 2024-04-26T18:09:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 1 -- 172.21.15.92:0/2615432018 wait complete. 2024-04-26T18:09:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.968+0000 7fd4339f8740 20 client.16185 trim_cache size 0 max 16384 2024-04-26T18:09:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 Processor -- start 2024-04-26T18:09:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 -- start start 2024-04-26T18:09:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1b2890 con 0x559eb82a0f00 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1b2f60 con 0x559eb82ac0e0 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd4339f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1b0840 con 0x559eb82a1820 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd42a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd42a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58616/0 (socket says 172.21.15.92:58616) 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.982+0000 7fd42a59c640 1 -- 172.21.15.92:0/228629723 learned_addr learned my addr 172.21.15.92:0/228629723 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42ad9d640 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 -- 172.21.15.92:0/228629723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 msgr2=0x559eb82a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 -- 172.21.15.92:0/228629723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 msgr2=0x559eb82c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 -- 172.21.15.92:0/228629723 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb82a3e00 con 0x559eb82a0f00 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd42a59c640 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd41c005e20 tx=0x7fd41c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc369db1fa7f0d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd413fff640 1 -- 172.21.15.92:0/228629723 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c055070 con 0x559eb82a0f00 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd413fff640 1 -- 172.21.15.92:0/228629723 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c0051c0 con 0x559eb82a0f00 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd413fff640 1 -- 172.21.15.92:0/228629723 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c040040 con 0x559eb82a0f00 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 -- 172.21.15.92:0/228629723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 msgr2=0x559eb82b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd41c005e20 tx=0x7fd41c02a410 comp rx=0 tx=0).stop 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 -- 172.21.15.92:0/228629723 shutdown_connections 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a1820 0x559eb82a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 --2- 172.21.15.92:0/228629723 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a0f00 0x559eb82b7b70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.983+0000 7fd4339f8740 1 -- 172.21.15.92:0/228629723 >> 172.21.15.92:0/228629723 conn(0x559eb829d410 msgr2=0x559eb82a9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- 172.21.15.92:0/228629723 shutdown_connections 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- 172.21.15.92:0/228629723 wait complete. 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- start start 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 Processor -- start 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 0x559eb82afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1b0170 con 0x559eb82a1820 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1aed80 con 0x559eb82ac0e0 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c1af3d0 con 0x559eb82a0f00 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd4339f8740 10 client.0 _ll_register_callbacks cb 0x7fd424012da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:58626/0 (socket says 172.21.15.92:58626) 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 -- 172.21.15.92:0/523900619 learned_addr learned my addr 172.21.15.92:0/523900619 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd42a59c640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 0x559eb82afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 -- 172.21.15.92:0/523900619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 msgr2=0x559eb82afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 0x559eb82afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 -- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 msgr2=0x559eb82b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd423fff640 1 -- 172.21.15.92:0/523900619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb8321680 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.984+0000 7fd42a59c640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 0x559eb82afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd423fff640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd41409be60 tx=0x7fd41409c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e491cead2eec0199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140a4dd0 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9273+0+0 (secure 0 0 0) 0x7fd4140041d0 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd41c0051c0 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7fd414085360 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 10 client.16191 fetch_fsmap learned FSMap version 101 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=4+}) -- 0x559eb83229d0 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd41c0051c0 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 101) ==== 7741+0+0 (secure 0 0 0) 0x7fd414080020 con 0x559eb82a1820 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 10 client.16191 fetch_fsmap finished waiting for FSMap version 101 2024-04-26T18:09:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 20 client.16191 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb8323180 0x559eb83255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 4 client.16191 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.985+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559eb820eee0 con 0x559eb8323180 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.986+0000 7fd42a59c640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb8323180 0x559eb83255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.986+0000 7fd42a59c640 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb8323180 0x559eb83255a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=461a4423b478739 server_cookie=50868eb121eb2b5c in_seq=0 out_seq=0 2024-04-26T18:09:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:10.986+0000 7fd411ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:10 smithi156 ceph-mon[32679]: pgmap v305: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:10 smithi092 ceph-mon[29156]: pgmap v305: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:10 smithi189 ceph-mon[32756]: pgmap v305: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:12 smithi156 ceph-mon[32679]: pgmap v306: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:12 smithi092 ceph-mon[29156]: pgmap v306: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:13.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:12 smithi189 ceph-mon[32756]: pgmap v306: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:14 smithi156 ceph-mon[32679]: pgmap v307: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:15.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:14 smithi189 ceph-mon[32756]: pgmap v307: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:15.189 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:14 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:09:15.189 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:14 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:15.190 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:14 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.116s CPU time. 2024-04-26T18:09:15.190 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:14 smithi189 systemd[1]: Starting Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:09:15.190 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 podman[69258]: 2024-04-26 18:09:15.025982919 +0000 UTC m=+0.018441284 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:09:15.190 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 podman[69258]: 2024-04-26 18:09:15.136039053 +0000 UTC m=+0.128497414 container create 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T18:09:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:14 smithi092 ceph-mon[29156]: pgmap v307: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 3.7 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 23 MiB/s wr, 1.89k op/s 2024-04-26T18:09:15.488 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 podman[69258]: 2024-04-26 18:09:15.389326451 +0000 UTC m=+0.381784815 container init 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T18:09:15.488 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 podman[69258]: 2024-04-26 18:09:15.392160675 +0000 UTC m=+0.384619036 container start 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:09:15.488 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mds[69279]: -- 172.21.15.189:0/1779518347 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56484b9fda40 con 0x56484b9d0c00 2024-04-26T18:09:15.488 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: starting mds.f at 2024-04-26T18:09:15.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 bash[69258]: 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 2024-04-26T18:09:15.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:15 smithi189 systemd[1]: Started Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: daemon mds.f restarted 2024-04-26T18:09:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T18:09:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:boot 2024-04-26T18:09:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:09:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:09:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:15 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: daemon mds.f restarted 2024-04-26T18:09:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T18:09:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:boot 2024-04-26T18:09:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:09:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:09:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:15 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:16.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: daemon mds.f restarted 2024-04-26T18:09:16.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: osdmap e108: 12 total, 12 up, 12 in 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:boot 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-26T18:09:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:15 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:17 smithi156 ceph-mon[32679]: pgmap v309: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 2.09k op/s 2024-04-26T18:09:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:resolve 2024-04-26T18:09:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:17 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:17 smithi092 ceph-mon[29156]: pgmap v309: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 2.09k op/s 2024-04-26T18:09:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:resolve 2024-04-26T18:09:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:17 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:17 smithi189 ceph-mon[32756]: pgmap v309: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 27 MiB/s wr, 2.09k op/s 2024-04-26T18:09:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:resolve 2024-04-26T18:09:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:17 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:18.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 545.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.933+0000 7fd411ffb640 1 -- 172.21.15.92:0/523900619 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559eb820eee0 con 0x559eb8323180 2024-04-26T18:09:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.933+0000 7fd411ffb640 10 client.16191 handle_command_reply: tid=0 2024-04-26T18:09:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.933+0000 7fd4339f8740 1 client.16191 shutdown 2024-04-26T18:09:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 msgr2=0x559eb82affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd41409be60 tx=0x7fd41409c860 comp rx=0 tx=0).stop 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 shutdown_connections 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x559eb8323180 0x559eb83255a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559eb82ac0e0 0x559eb82b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559eb82a1820 0x559eb82affe0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd411ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 --2- 172.21.15.92:0/523900619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x559eb82a0f00 0x559eb82afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 >> 172.21.15.92:0/523900619 conn(0x559eb829d410 msgr2=0x559eb829bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 shutdown_connections 2024-04-26T18:09:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 1 -- 172.21.15.92:0/523900619 wait complete. 2024-04-26T18:09:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.934+0000 7fd4339f8740 20 client.16191 trim_cache size 0 max 16384 2024-04-26T18:09:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:09:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:09:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:09:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:09:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 msgr2=0x7fd4180a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 0x7fd4180a6300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd42c06c240 tx=0x7fd424014b70 comp rx=0 tx=0).stop 2024-04-26T18:09:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 msgr2=0x7fd42c198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd41400d950 tx=0x7fd41400de10 comp rx=0 tx=0).stop 2024-04-26T18:09:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 shutdown_connections 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fd4180a3e40 0x7fd4180a6300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd42c1067d0 0x7fd42c1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd42c102540 0x7fd42c198160 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 --2- 172.21.15.92:0/3792983460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd42c101b80 0x7fd42c197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 >> 172.21.15.92:0/3792983460 conn(0x7fd42c077630 msgr2=0x7fd42c0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:18.942 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 shutdown_connections 2024-04-26T18:09:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:18.935+0000 7fd430c07640 1 -- 172.21.15.92:0/3792983460 wait complete. 2024-04-26T18:09:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:18 smithi156 ceph-mon[32679]: pgmap v310: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-04-26T18:09:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:18 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:09:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:18 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:09:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:reconnect 2024-04-26T18:09:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:18 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:18 smithi092 ceph-mon[29156]: pgmap v310: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-04-26T18:09:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:18 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:09:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:18 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:09:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:reconnect 2024-04-26T18:09:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:18 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:18 smithi189 ceph-mon[32756]: pgmap v310: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 818 op/s 2024-04-26T18:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:18 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:18 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:reconnect 2024-04-26T18:09:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:18 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:rejoin 2024-04-26T18:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:09:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:active 2024-04-26T18:09:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:19 smithi092 ceph-mon[29156]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:rejoin 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:active 2024-04-26T18:09:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:19 smithi156 ceph-mon[32679]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:rejoin 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:09:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2005596570,v1:172.21.15.156:6833/2005596570] up:active 2024-04-26T18:09:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:19 smithi189 ceph-mon[32756]: osdmap e109: 12 total, 12 up, 12 in 2024-04-26T18:09:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:20 smithi156 ceph-mon[32679]: pgmap v311: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 678 KiB/s wr, 91 op/s 2024-04-26T18:09:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:20 smithi092 ceph-mon[29156]: pgmap v311: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 678 KiB/s wr, 91 op/s 2024-04-26T18:09:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:20 smithi189 ceph-mon[32756]: pgmap v311: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 678 KiB/s wr, 91 op/s 2024-04-26T18:09:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:22 smithi092 ceph-mon[29156]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 805 KiB/s wr, 108 op/s 2024-04-26T18:09:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 550.0 s, 1655.5 tps, lat 202.517 ms stddev 1440.950 2024-04-26T18:09:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:22 smithi189 ceph-mon[32756]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 805 KiB/s wr, 108 op/s 2024-04-26T18:09:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:22 smithi156 ceph-mon[32679]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 805 KiB/s wr, 108 op/s 2024-04-26T18:09:23.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:09:23 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:09:23.479+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:09:25.044 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:24 smithi092 ceph-mon[29156]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-04-26T18:09:25.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-mon[32679]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-04-26T18:09:25.124 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4597baa700 time 2024-04-26T18:09:24.711985+0000 2024-04-26T18:09:25.124 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45a21d33dd] 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.125 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.126 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: clone() 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:24.712+0000 7f4597baa700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4597baa700 time 2024-04-26T18:09:24.711985+0000 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45a21d33dd] 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: clone() 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: *** Caught signal (Aborted) ** 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: in thread 7f4597baa700 thread_name:ms_dispatch 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45a0f5bd20] 2024-04-26T18:09:25.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: gsignal() 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: abort() 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45a21d3437] 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 16: clone() 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:24.714+0000 7f4597baa700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: in thread 7f4597baa700 thread_name:ms_dispatch 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45a0f5bd20] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: gsignal() 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: abort() 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45a21d3437] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 16: clone() 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: -1> 2024-04-26T18:09:24.712+0000 7f4597baa700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4597baa700 time 2024-04-26T18:09:24.711985+0000 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45a21d33dd] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: clone() 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 0> 2024-04-26T18:09:24.714+0000 7f4597baa700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: in thread 7f4597baa700 thread_name:ms_dispatch 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45a0f5bd20] 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: gsignal() 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: abort() 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45a21d3437] 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 16: clone() 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: -1> 2024-04-26T18:09:24.712+0000 7f4597baa700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4597baa700 time 2024-04-26T18:09:24.711985+0000 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f45a21d33dd] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: clone() 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 0> 2024-04-26T18:09:24.714+0000 7f4597baa700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: in thread 7f4597baa700 thread_name:ms_dispatch 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f45a0f5bd20] 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2: gsignal() 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 3: abort() 2024-04-26T18:09:25.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f45a21d3437] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f45a21d35a3] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bbe5386822] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bbe52f6598] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bbe52f8c17] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bbe51f1d0b] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bbe51f22ac] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bbe51dafad] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f45a2467e20] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 13: (DispatchQueue::entry()+0x51f) [0x7f45a2464fdf] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f45a2537fc1] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f45a0f511ca] 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 16: clone() 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:25.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[62127]: 2024-04-26T18:09:25.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:24 smithi156 podman[68058]: 2024-04-26 18:09:24.775905646 +0000 UTC m=+0.021128624 container died 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T18:09:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:24 smithi189 ceph-mon[32756]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-04-26T18:09:25.784 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:25 smithi156 podman[68058]: 2024-04-26 18:09:25.517936102 +0000 UTC m=+0.763159067 container remove 28505c1561ca9562258dc8d2de8b1b904ece08013b347f0b1ab8bbfb2877e13f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:09:25.784 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:09:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:25 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:26.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:09:26.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.314s CPU time. 2024-04-26T18:09:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:25 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:25 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:26 smithi092 ceph-mon[29156]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:26 smithi189 ceph-mon[32756]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:26 smithi156 ceph-mon[32679]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:28.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 555.0 s, 738.1 tps, lat 42.466 ms stddev 43.016 2024-04-26T18:09:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:28 smithi092 ceph-mon[29156]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:28 smithi189 ceph-mon[32756]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:28 smithi156 ceph-mon[32679]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 2.7 MiB/s wr, 291 op/s 2024-04-26T18:09:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:30 smithi092 ceph-mon[29156]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-04-26T18:09:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:30 smithi189 ceph-mon[32756]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-04-26T18:09:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:30 smithi156 ceph-mon[32679]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-04-26T18:09:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- 172.21.15.92:0/761102864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8107860 msgr2=0x7f6fb8107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- 172.21.15.92:0/761102864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8107860 0x7f6fb8107c40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009930 tx=0x7f6fb402a420 comp rx=0 tx=0).stop 2024-04-26T18:09:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- 172.21.15.92:0/761102864 shutdown_connections 2024-04-26T18:09:32.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- 172.21.15.92:0/761102864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb810e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- 172.21.15.92:0/761102864 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8101850 0x7f6fb8101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- 172.21.15.92:0/761102864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8107860 0x7f6fb8107c40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- 172.21.15.92:0/761102864 >> 172.21.15.92:0/761102864 conn(0x7f6fb8077bb0 msgr2=0x7f6fb8077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- 172.21.15.92:0/761102864 shutdown_connections 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- 172.21.15.92:0/761102864 wait complete. 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 Processor -- start 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- start start 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 0x7f6fb81a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111b20 con 0x7f6fb8101850 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81119a0 con 0x7f6fb8102210 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.034+0000 7f6fbf132640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8111ca0 con 0x7f6fb8107860 2024-04-26T18:09:32.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53684/0 (socket says 172.21.15.92:53684) 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 -- 172.21.15.92:0/2095588976 learned_addr learned my addr 172.21.15.92:0/2095588976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6faffff640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 0x7f6fb81a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 -- 172.21.15.92:0/2095588976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 msgr2=0x7f6fb81a4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 0x7f6fb81a4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 -- 172.21.15.92:0/2095588976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 msgr2=0x7f6fb819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 -- 172.21.15.92:0/2095588976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb81a5500 con 0x7f6fb8101850 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 0x7f6fb81a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6faffff640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbcece640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4005940 tx=0x7f6fb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fadffb640 1 -- 172.21.15.92:0/2095588976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb403f030 con 0x7f6fb8101850 2024-04-26T18:09:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fadffb640 1 -- 172.21.15.92:0/2095588976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb4003cb0 con 0x7f6fb8101850 2024-04-26T18:09:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb81a56d0 con 0x7f6fb8101850 2024-04-26T18:09:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.035+0000 7f6fadffb640 1 -- 172.21.15.92:0/2095588976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4035070 con 0x7f6fb8101850 2024-04-26T18:09:32.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.036+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb81a5b40 con 0x7f6fb8101850 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fadffb640 1 -- 172.21.15.92:0/2095588976 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f6fb4042030 con 0x7f6fb8101850 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 Processor -- start 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 -- start start 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e3322ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e33254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f1e327e460 con 0x55f1e3317f00 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f1e3238590 con 0x55f1e3318820 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1e327a420 con 0x55f1e33230e0 2024-04-26T18:09:32.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fadffb640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 0x7f6fa00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fbd6cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fbd6cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53696/0 (socket says 172.21.15.92:53696) 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/616179799 learned_addr learned my addr 172.21.15.92:0/616179799 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 0x7f6fa00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6fadffb640 1 -- 172.21.15.92:0/2095588976 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9315+0+0 (secure 0 0 0) 0x7f6fb40f13c0 con 0x7f6fb8101850 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.038+0000 7f6faffff640 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e33254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbcece640 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e3322ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/616179799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 msgr2=0x55f1e33254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e33254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/616179799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 msgr2=0x55f1e3322ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e3322ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/616179799 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e32450d0 con 0x55f1e3317f00 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0014ea0 tx=0x7f6fb0014f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d999205a41eae58 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 0x7f6fa00a6280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0011c40 tx=0x7f6fb001c000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6f9effd640 1 -- 172.21.15.92:0/616179799 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0022070 con 0x55f1e3317f00 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6f9effd640 1 -- 172.21.15.92:0/616179799 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb0003e20 con 0x55f1e3317f00 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.039+0000 7f6f9effd640 1 -- 172.21.15.92:0/616179799 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0004290 con 0x55f1e3317f00 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/616179799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 msgr2=0x55f1e33182e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0014ea0 tx=0x7f6fb0014f90 comp rx=0 tx=0).stop 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/616179799 shutdown_connections 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e33254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e3322ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/616179799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e33182e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/616179799 >> 172.21.15.92:0/616179799 conn(0x55f1e3314410 msgr2=0x55f1e33147f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/616179799 shutdown_connections 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/616179799 wait complete. 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 -- start start 2024-04-26T18:09:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.040+0000 7f6fc1e4d740 1 Processor -- start 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3320170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e33230e0 0x55f1e3320bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f1e3325cb0 con 0x55f1e3318820 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f1e3205b60 con 0x55f1e33230e0 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f1e3325e30 con 0x55f1e3317f00 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fc1e4d740 10 client.0 _ll_register_callbacks cb 0x55f1e322a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53710/0 (socket says 172.21.15.92:53710) 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 -- 172.21.15.92:0/887649676 learned_addr learned my addr 172.21.15.92:0/887649676 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e33230e0 0x55f1e3320bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fbcece640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3320170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 -- 172.21.15.92:0/887649676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 msgr2=0x55f1e3320170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3320170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 -- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e33230e0 msgr2=0x55f1e3320bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e33230e0 0x55f1e3320bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 -- 172.21.15.92:0/887649676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e2f90210 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6fbcece640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3320170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6faffff640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009f60 tx=0x7f6fa8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada4a962f4495eec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6f97fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.041+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8012920 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9315+0+0 (secure 0 0 0) 0x7f6fa8012ac0 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb0003e20 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f6fa8025050 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 10 client.16209 fetch_fsmap learned FSMap version 108 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) -- 0x55f1e305c620 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb0003e20 con 0x55f1e3318820 2024-04-26T18:09:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 108) ==== 7741+0+0 (secure 0 0 0) 0x7f6fa800f040 con 0x55f1e3318820 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 10 client.16209 fetch_fsmap finished waiting for FSMap version 108 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 20 client.16209 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e3333330 0x55f1e3335780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 4 client.16209 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1e328c070 con 0x55f1e3333330 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.042+0000 7f6fbcece640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e3333330 0x55f1e3335780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.043+0000 7f6fbcece640 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e3333330 0x55f1e3335780 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541927992e8a1a16 server_cookie=48bcb1dc95909072 in_seq=0 out_seq=0 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.043+0000 7f6f97fff640 10 client.16209 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.043+0000 7f6f97fff640 1 -- 172.21.15.92:0/887649676 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1e328c070 con 0x55f1e3333330 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.043+0000 7f6f97fff640 10 client.16209 handle_command_reply: tid=0 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 client.16209 shutdown 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 msgr2=0x55f1e33206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009f60 tx=0x7f6fa8009f90 comp rx=0 tx=0).stop 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 shutdown_connections 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e3333330 0x55f1e3335780 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e33230e0 0x55f1e3320bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6f97fff640 0 client.16209 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3318820 0x55f1e33206b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/887649676 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3320170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 >> 172.21.15.92:0/887649676 conn(0x55f1e3314410 msgr2=0x55f1e331a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 shutdown_connections 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/887649676 wait complete. 2024-04-26T18:09:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.044+0000 7f6fc1e4d740 20 client.16209 trim_cache size 0 max 16384 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 Processor -- start 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 -- start start 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3313d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e332b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81b0770 con 0x55f1e33230e0 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81b0e40 con 0x55f1e3318820 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81ae720 con 0x55f1e3317f00 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53722/0 (socket says 172.21.15.92:53722) 2024-04-26T18:09:32.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/2450406833 learned_addr learned my addr 172.21.15.92:0/2450406833 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6faffff640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e332b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbcece640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3313d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/2450406833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 msgr2=0x55f1e3313d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3313d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/2450406833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 msgr2=0x55f1e332b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e332b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 -- 172.21.15.92:0/2450406833 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e3325840 con 0x55f1e33230e0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbcece640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3313d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.059+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0014e70 tx=0x7f6fb0014260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4703815e5237ce9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6f9e7fc640 1 -- 172.21.15.92:0/2450406833 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0022050 con 0x55f1e33230e0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6f9e7fc640 1 -- 172.21.15.92:0/2450406833 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb002b030 con 0x55f1e33230e0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6f9e7fc640 1 -- 172.21.15.92:0/2450406833 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00050b0 con 0x55f1e33230e0 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/2450406833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 msgr2=0x55f1e3319fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:32.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0014e70 tx=0x7f6fb0014260 comp rx=0 tx=0).stop 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/2450406833 shutdown_connections 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e33230e0 0x55f1e3319fc0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e332b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/2450406833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e3317f00 0x55f1e3313d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/2450406833 >> 172.21.15.92:0/2450406833 conn(0x55f1e3314410 msgr2=0x55f1e33198b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/2450406833 shutdown_connections 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/2450406833 wait complete. 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.060+0000 7f6fc1e4d740 1 -- start start 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 Processor -- start 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e331c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e331c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81ae050 con 0x55f1e3317f00 2024-04-26T18:09:32.066 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81acc60 con 0x55f1e3318820 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb81ad2b0 con 0x55f1e33230e0 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fc1e4d740 10 client.0 _ll_register_callbacks cb 0x7f6fa80097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:53730/0 (socket says 172.21.15.92:53730) 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 -- 172.21.15.92:0/576897271 learned_addr learned my addr 172.21.15.92:0/576897271 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6faffff640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e331c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbd6cf640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e331c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 -- 172.21.15.92:0/576897271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 msgr2=0x55f1e331c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e331c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 -- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 msgr2=0x55f1e331c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e331c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6fbcece640 1 -- 172.21.15.92:0/576897271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e331ce60 con 0x55f1e3317f00 2024-04-26T18:09:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.061+0000 7f6faffff640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e331c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fbcece640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40ee850 tx=0x7f6fb402f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b167b7e75b21d90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb409be60 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9315+0+0 (secure 0 0 0) 0x7f6fb40f10b0 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb002b030 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) ==== 24+0+0 (secure 0 0 0) 0x7f6fb4049040 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 10 client.16215 fetch_fsmap learned FSMap version 108 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=4+}) -- 0x55f1e339e6d0 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb002b030 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 108) ==== 7741+0+0 (secure 0 0 0) 0x7f6fb403bb20 con 0x55f1e3317f00 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 10 client.16215 fetch_fsmap finished waiting for FSMap version 108 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 20 client.16215 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e339edf0 0x55f1e33a1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 4 client.16215 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:09:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f1e3285ee0 con 0x55f1e339edf0 2024-04-26T18:09:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.062+0000 7f6faffff640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e339edf0 0x55f1e33a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.063+0000 7f6f97fff640 10 client.16215 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:32.063+0000 7f6faffff640 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e339edf0 0x55f1e33a1210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355600a26d325f6 server_cookie=bc77a8fb361259b6 in_seq=0 out_seq=0 2024-04-26T18:09:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:32 smithi092 ceph-mon[29156]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 3.3 MiB/s wr, 370 op/s 2024-04-26T18:09:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 560.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:32 smithi189 ceph-mon[32756]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 3.3 MiB/s wr, 370 op/s 2024-04-26T18:09:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:32 smithi156 ceph-mon[32679]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 3.3 MiB/s wr, 370 op/s 2024-04-26T18:09:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:34 smithi092 ceph-mon[29156]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 3.3 MiB/s wr, 369 op/s 2024-04-26T18:09:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:34 smithi189 ceph-mon[32756]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 3.3 MiB/s wr, 369 op/s 2024-04-26T18:09:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:34 smithi156 ceph-mon[32679]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 3.3 MiB/s wr, 369 op/s 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:35 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:35 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:35 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.314s CPU time. 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:35 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 podman[68160]: 2024-04-26 18:09:36.07683908 +0000 UTC m=+0.018630757 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:09:36.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 podman[68160]: 2024-04-26 18:09:36.188095442 +0000 UTC m=+0.129887112 container create 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-04-26T18:09:36.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 podman[68160]: 2024-04-26 18:09:36.465997925 +0000 UTC m=+0.407789595 container init 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:09:36.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 podman[68160]: 2024-04-26 18:09:36.46863682 +0000 UTC m=+0.410428494 container start 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T18:09:36.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mds[68178]: -- 172.21.15.156:0/3381262401 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565405c41a40 con 0x565405c14c00 2024-04-26T18:09:36.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: starting mds.k at 2024-04-26T18:09:36.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 bash[68160]: 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc 2024-04-26T18:09:36.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:09:36 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: pgmap v320: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.6 MiB/s wr, 410 op/s 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: daemon mds.k restarted 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:boot 2024-04-26T18:09:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:09:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:09:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:36 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: pgmap v320: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.6 MiB/s wr, 410 op/s 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: daemon mds.k restarted 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:boot 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:09:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:09:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:36 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: pgmap v320: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 3.6 MiB/s wr, 410 op/s 2024-04-26T18:09:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: daemon mds.k restarted 2024-04-26T18:09:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:09:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: osdmap e110: 12 total, 12 up, 12 in 2024-04-26T18:09:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:boot 2024-04-26T18:09:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: Standby daemon mds.f assigned to filesystem cephfs as rank 2 2024-04-26T18:09:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:09:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:09:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:36 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:replay} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:38.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 565.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:38 smithi092 ceph-mon[29156]: pgmap v322: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:38 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:resolve 2024-04-26T18:09:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:38 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:38 smithi189 ceph-mon[32756]: pgmap v322: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:38 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:resolve 2024-04-26T18:09:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:38 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:38 smithi156 ceph-mon[32679]: pgmap v322: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:38 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:resolve 2024-04-26T18:09:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:38 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:resolve} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.013+0000 7f6f97fff640 1 -- 172.21.15.92:0/576897271 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f1e3285ee0 con 0x55f1e339edf0 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6f97fff640 10 client.16215 handle_command_reply: tid=0 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 client.16215 shutdown 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 msgr2=0x55f1e331da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40ee850 tx=0x7f6fb402f4f0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 shutdown_connections 2024-04-26T18:09:40.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f1e339edf0 0x55f1e33a1210 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f1e33230e0 0x55f1e331c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1e3318820 0x55f1e331c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6f97fff640 0 client.16215 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 --2- 172.21.15.92:0/576897271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f1e3317f00 0x55f1e331da10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 >> 172.21.15.92:0/576897271 conn(0x55f1e3314410 msgr2=0x55f1e331a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 shutdown_connections 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 1 -- 172.21.15.92:0/576897271 wait complete. 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.014+0000 7f6fc1e4d740 20 client.16215 trim_cache size 0 max 16384 2024-04-26T18:09:40.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:09:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:09:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:09:40.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 msgr2=0x7f6fa00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 0x7f6fa00a6280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6fb0011c40 tx=0x7f6fb001c000 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 msgr2=0x7f6fb8199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4005940 tx=0x7f6fb40042f0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 shutdown_connections 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f6fa00a3dc0 0x7f6fa00a6280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6fb8107860 0x7f6fb81a4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fb8102210 0x7f6fb819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 --2- 172.21.15.92:0/2095588976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fb8101850 0x7f6fb8199f40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 >> 172.21.15.92:0/2095588976 conn(0x7f6fb8077bb0 msgr2=0x7f6fb80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 shutdown_connections 2024-04-26T18:09:40.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:40.015+0000 7f6fbf132640 1 -- 172.21.15.92:0/2095588976 wait complete. 2024-04-26T18:09:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:39 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:09:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:39 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:09:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:reconnect 2024-04-26T18:09:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:39 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:39 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:09:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:39 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:09:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:reconnect 2024-04-26T18:09:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:39 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:39 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:09:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:39 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:09:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:reconnect 2024-04-26T18:09:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:39 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:reconnect} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:41 smithi189 ceph-mon[32756]: pgmap v323: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:rejoin 2024-04-26T18:09:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:41 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:41 smithi189 ceph-mon[32756]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:40 smithi156 ceph-mon[32679]: pgmap v323: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:rejoin 2024-04-26T18:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:40 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:40 smithi156 ceph-mon[32679]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:40 smithi092 ceph-mon[29156]: pgmap v323: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:rejoin 2024-04-26T18:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:40 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=f=up:rejoin} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:40 smithi092 ceph-mon[29156]: daemon mds.f is now active in filesystem cephfs as rank 2 2024-04-26T18:09:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:42 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:42 smithi189 ceph-mon[32756]: Cluster is now healthy 2024-04-26T18:09:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:active 2024-04-26T18:09:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:42 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:42 smithi156 ceph-mon[32679]: Cluster is now healthy 2024-04-26T18:09:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:active 2024-04-26T18:09:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:42 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:09:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:42 smithi092 ceph-mon[29156]: Cluster is now healthy 2024-04-26T18:09:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3490196515,v1:172.21.15.189:6835/3490196515] up:active 2024-04-26T18:09:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 2 up:standby-replay 6 up:standby 2024-04-26T18:09:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:43.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 570.0 s, 1246.1 tps, lat 295.753 ms stddev 2033.239 2024-04-26T18:09:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:43 smithi189 ceph-mon[32756]: pgmap v324: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:43 smithi156 ceph-mon[32679]: pgmap v324: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:43 smithi092 ceph-mon[29156]: pgmap v324: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 MiB/s wr, 212 op/s 2024-04-26T18:09:43.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:09:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:09:43.480+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:09:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:45 smithi189 ceph-mon[32756]: pgmap v325: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-26T18:09:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:45 smithi156 ceph-mon[32679]: pgmap v325: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-26T18:09:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:45 smithi092 ceph-mon[29156]: pgmap v325: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff9de54e700 time 2024-04-26T18:09:46.016580+0000 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9e8b773dd] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: clone() 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.017+0000 7ff9de54e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff9de54e700 time 2024-04-26T18:09:46.016580+0000 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:46.389 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.390 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.390 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9e8b773dd] 2024-04-26T18:09:46.390 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.390 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.390 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: clone() 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: *** Caught signal (Aborted) ** 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: in thread 7ff9de54e700 thread_name:ms_dispatch 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.391 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff9e78ffd20] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: gsignal() 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: abort() 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9e8b77437] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.392 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 16: clone() 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.018+0000 7ff9de54e700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: in thread 7ff9de54e700 thread_name:ms_dispatch 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff9e78ffd20] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: gsignal() 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: abort() 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9e8b77437] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.393 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 16: clone() 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: -1> 2024-04-26T18:09:46.017+0000 7ff9de54e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff9de54e700 time 2024-04-26T18:09:46.016580+0000 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.394 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9e8b773dd] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: clone() 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.395 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 0> 2024-04-26T18:09:46.018+0000 7ff9de54e700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: in thread 7ff9de54e700 thread_name:ms_dispatch 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff9e78ffd20] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: gsignal() 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: abort() 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9e8b77437] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.396 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 16: clone() 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: -1> 2024-04-26T18:09:46.017+0000 7ff9de54e700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7ff9de54e700 time 2024-04-26T18:09:46.016580+0000 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff9e8b773dd] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.397 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: clone() 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 0> 2024-04-26T18:09:46.018+0000 7ff9de54e700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: in thread 7ff9de54e700 thread_name:ms_dispatch 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:09:46.398 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff9e78ffd20] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2: gsignal() 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 3: abort() 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff9e8b77437] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7ff9e8b775a3] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564849b23822] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564849a93598] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564849a95c17] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56484998ed0b] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56484998f2ac] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564849977fad] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7ff9e8e0be20] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 13: (DispatchQueue::entry()+0x51f) [0x7ff9e8e08fdf] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7ff9e8edbfc1] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7ff9e78f51ca] 2024-04-26T18:09:46.399 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 16: clone() 2024-04-26T18:09:46.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:09:46.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f[69274]: 2024-04-26T18:09:46.400 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:46 smithi189 podman[69333]: 2024-04-26 18:09:46.094107093 +0000 UTC m=+0.036501668 container died 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:09:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:47 smithi092 ceph-mon[29156]: pgmap v326: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 3.3 MiB/s wr, 368 op/s 2024-04-26T18:09:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:47 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:47 smithi189 ceph-mon[32756]: pgmap v326: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 3.3 MiB/s wr, 368 op/s 2024-04-26T18:09:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:47 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:47.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:47 smithi189 podman[69333]: 2024-04-26 18:09:47.128102229 +0000 UTC m=+1.070496800 container remove 1b91b674040f8a2168cc1e0af2f569bbdfce5bb54be833c475693be152199066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-f, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-26T18:09:47.388 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:09:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:47 smithi156 ceph-mon[32679]: pgmap v326: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 3.3 MiB/s wr, 368 op/s 2024-04-26T18:09:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:47 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=f=up:active} 3 up:standby-replay 5 up:standby 2024-04-26T18:09:47.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:09:47.887 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.138s CPU time. 2024-04-26T18:09:48.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 575.0 s, 1599.4 tps, lat 36.936 ms stddev 38.613 2024-04-26T18:09:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:49 smithi189 ceph-mon[32756]: pgmap v327: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-26T18:09:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:49 smithi156 ceph-mon[32679]: pgmap v327: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-26T18:09:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:49 smithi092 ceph-mon[29156]: pgmap v327: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.9 MiB/s wr, 332 op/s 2024-04-26T18:09:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:51 smithi189 ceph-mon[32756]: pgmap v328: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 4.6 MiB/s wr, 518 op/s 2024-04-26T18:09:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:51 smithi156 ceph-mon[32679]: pgmap v328: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 4.6 MiB/s wr, 518 op/s 2024-04-26T18:09:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:51 smithi092 ceph-mon[29156]: pgmap v328: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 4.6 MiB/s wr, 518 op/s 2024-04-26T18:09:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 -- 172.21.15.92:0/296978405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40102220 msgr2=0x7fbb4010e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 --2- 172.21.15.92:0/296978405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40102220 0x7fbb4010e6e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009cd0 tx=0x7fbb3802a8e0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 -- 172.21.15.92:0/296978405 shutdown_connections 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 --2- 172.21.15.92:0/296978405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40102220 0x7fbb4010e6e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 --2- 172.21.15.92:0/296978405 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40101860 0x7fbb40101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 --2- 172.21.15.92:0/296978405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 0x7fbb40107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 -- 172.21.15.92:0/296978405 >> 172.21.15.92:0/296978405 conn(0x7fbb400789b0 msgr2=0x7fbb40078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 -- 172.21.15.92:0/296978405 shutdown_connections 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.107+0000 7fbb468c4640 1 -- 172.21.15.92:0/296978405 wait complete. 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 Processor -- start 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 -- start start 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40102220 0x7fbb40199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 0x7fbb4019d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40111ae0 con 0x7fbb40101860 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40111960 con 0x7fbb40107820 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb468c4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40111c60 con 0x7fbb40102220 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57930/0 (socket says 172.21.15.92:57930) 2024-04-26T18:09:53.111 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb3ffff640 1 -- 172.21.15.92:0/1897906162 learned_addr learned my addr 172.21.15.92:0/1897906162 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40102220 0x7fbb40199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb44e61640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 0x7fbb4019d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.108+0000 7fbb3ffff640 1 -- 172.21.15.92:0/1897906162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40102220 msgr2=0x7fbb40199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40102220 0x7fbb40199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3ffff640 1 -- 172.21.15.92:0/1897906162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 msgr2=0x7fbb4019d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 0x7fbb4019d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3ffff640 1 -- 172.21.15.92:0/1897906162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4019e020 con 0x7fbb40101860 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3d7fa640 1 -- 172.21.15.92:0/1897906162 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400cd80 con 0x7fbb40101860 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3d7fa640 1 -- 172.21.15.92:0/1897906162 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340108e0 con 0x7fbb40101860 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4019e310 con 0x7fbb40101860 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb3d7fa640 1 -- 172.21.15.92:0/1897906162 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34018980 con 0x7fbb40101860 2024-04-26T18:09:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.109+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb401a5ba0 con 0x7fbb40101860 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.111+0000 7fbb3d7fa640 1 -- 172.21.15.92:0/1897906162 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fbb34010430 con 0x7fbb40101860 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.111+0000 7fbb495da740 1 Processor -- start 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.111+0000 7fbb495da740 1 -- start start 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 0x562aac9852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562aac8eb460 con 0x562aac985820 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562aac8a5590 con 0x562aac984f00 2024-04-26T18:09:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb495da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562aac8e7420 con 0x562aac9900e0 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3d7fa640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 0x7fbb280a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57942/0 (socket says 172.21.15.92:57942) 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3ffff640 1 -- 172.21.15.92:0/4184684983 learned_addr learned my addr 172.21.15.92:0/4184684983 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 0x562aac9852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 0x7fbb280a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3d7fa640 1 -- 172.21.15.92:0/1897906162 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9357+0+0 (secure 0 0 0) 0x7fbb340d0e00 con 0x7fbb40101860 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 -- 172.21.15.92:0/4184684983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 msgr2=0x562aac9924d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9924d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.121 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 -- 172.21.15.92:0/4184684983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 msgr2=0x562aac98fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb44e61640 1 -- 172.21.15.92:0/4184684983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aac8b20d0 con 0x562aac984f00 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.112+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.113+0000 7fbb44e61640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 0x7fbb280a6280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb38005e10 tx=0x7fbb38036000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.113+0000 7fbb44e61640 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 0x562aac9852e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009ca0 tx=0x7fbb38031ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aca2707306821883 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.113+0000 7fbb267fc640 1 -- 172.21.15.92:0/4184684983 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3804d070 con 0x562aac984f00 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.113+0000 7fbb267fc640 1 -- 172.21.15.92:0/4184684983 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb38036070 con 0x562aac984f00 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.113+0000 7fbb267fc640 1 -- 172.21.15.92:0/4184684983 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38030b00 con 0x562aac984f00 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- 172.21.15.92:0/4184684983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 msgr2=0x562aac9852e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 0x562aac9852e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009ca0 tx=0x7fbb38031ae0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- 172.21.15.92:0/4184684983 shutdown_connections 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac985820 0x562aac98fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 --2- 172.21.15.92:0/4184684983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac984f00 0x562aac9852e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- 172.21.15.92:0/4184684983 >> 172.21.15.92:0/4184684983 conn(0x562aac981410 msgr2=0x562aac9817f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- 172.21.15.92:0/4184684983 shutdown_connections 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- 172.21.15.92:0/4184684983 wait complete. 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.114+0000 7fbb495da740 1 -- start start 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 Processor -- start 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 0x562aac98d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac9900e0 0x562aac98db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.123 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562aac992c50 con 0x562aac984f00 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562aac872b60 con 0x562aac9900e0 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562aac992dd0 con 0x562aac985820 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb495da740 10 client.0 _ll_register_callbacks cb 0x562aac8972b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57948/0 (socket says 172.21.15.92:57948) 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3f7fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 0x562aac98d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3286406571 learned_addr learned my addr 172.21.15.92:0/3286406571 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb44e61640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac9900e0 0x562aac98db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3286406571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 msgr2=0x562aac98d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 0x562aac98d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac9900e0 msgr2=0x562aac98db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac9900e0 0x562aac98db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.124 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.115+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3286406571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aac5fd210 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 0x562aac98d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c6a0 tx=0x7fbb34000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a94804daccd868 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340ce630 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9357+0+0 (secure 0 0 0) 0x7fbb340bbbc0 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb38036070 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7fbb340a0db0 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 10 client.16233 fetch_fsmap learned FSMap version 116 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) -- 0x562aac6c9620 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb38036070 con 0x562aac984f00 2024-04-26T18:09:53.125 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 116) ==== 7741+0+0 (secure 0 0 0) 0x7fbb34098800 con 0x562aac984f00 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 10 client.16233 fetch_fsmap finished waiting for FSMap version 116 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 20 client.16233 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aac9a01f0 0x562aac9a2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 4 client.16233 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.116+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aac8f9070 con 0x562aac9a01f0 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.117+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aac9a01f0 0x562aac9a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.117+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aac9a01f0 0x562aac9a2620 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a6e6556a1e1624 server_cookie=94069ae3ab2d93a4 in_seq=0 out_seq=0 2024-04-26T18:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.117+0000 7fbb1f7fe640 10 client.16233 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/3286406571 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562aac8f9070 con 0x562aac9a01f0 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb1f7fe640 10 client.16233 handle_command_reply: tid=0 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 client.16233 shutdown 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 msgr2=0x562aac98d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400c6a0 tx=0x7fbb34000bc0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 shutdown_connections 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aac9a01f0 0x562aac9a2620 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac9900e0 0x562aac98db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb1f7fe640 0 client.16233 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac985820 0x562aac98d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 --2- 172.21.15.92:0/3286406571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac98d0f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 >> 172.21.15.92:0/3286406571 conn(0x562aac981410 msgr2=0x562aac987140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 shutdown_connections 2024-04-26T18:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 1 -- 172.21.15.92:0/3286406571 wait complete. 2024-04-26T18:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.118+0000 7fbb495da740 20 client.16233 trim_cache size 0 max 16384 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 Processor -- start 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 -- start start 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac9a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9a8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b0630 con 0x562aac984f00 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401b0d30 con 0x562aac985820 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb495da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ae610 con 0x562aac9900e0 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57956/0 (socket says 172.21.15.92:57956) 2024-04-26T18:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3506133840 learned_addr learned my addr 172.21.15.92:0/3506133840 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac9a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb44e61640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3506133840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 msgr2=0x562aac9a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.135+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3506133840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 msgr2=0x562aac9a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac9a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb3ffff640 1 -- 172.21.15.92:0/3506133840 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aac98c0e0 con 0x562aac984f00 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb44e61640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbb340a0f70 tx=0x7fbb3400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3de935c23c7bab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb25ffb640 1 -- 172.21.15.92:0/3506133840 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34098d50 con 0x562aac984f00 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb25ffb640 1 -- 172.21.15.92:0/3506133840 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340b7020 con 0x562aac984f00 2024-04-26T18:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.136+0000 7fbb25ffb640 1 -- 172.21.15.92:0/3506133840 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb340ce430 con 0x562aac984f00 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- 172.21.15.92:0/3506133840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 msgr2=0x562aac987140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbb340a0f70 tx=0x7fbb3400cf20 comp rx=0 tx=0).stop 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- 172.21.15.92:0/3506133840 shutdown_connections 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac9900e0 0x562aac9a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac9a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 --2- 172.21.15.92:0/3506133840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac984f00 0x562aac987140 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- 172.21.15.92:0/3506133840 >> 172.21.15.92:0/3506133840 conn(0x562aac981410 msgr2=0x562aac97c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- 172.21.15.92:0/3506133840 shutdown_connections 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- 172.21.15.92:0/3506133840 wait complete. 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 -- start start 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.137+0000 7fbb495da740 1 Processor -- start 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 0x562aac98a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac98aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401adf40 con 0x562aac9900e0 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401acb50 con 0x562aac985820 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbb401ad1a0 con 0x562aac984f00 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb495da740 10 client.0 _ll_register_callbacks cb 0x7fbb3400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57960/0 (socket says 172.21.15.92:57960) 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 -- 172.21.15.92:0/2836607787 learned_addr learned my addr 172.21.15.92:0/2836607787 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 0x562aac98a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac98aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 -- 172.21.15.92:0/2836607787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 msgr2=0x562aac98a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 0x562aac98a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 -- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 msgr2=0x562aac98aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac98aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 -- 172.21.15.92:0/2836607787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aaca05ce0 con 0x562aac9900e0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb3f7fe640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac98aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 0x562aac98a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb44e61640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbb3804f000 tx=0x7fbb38004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316367d424de353d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.138+0000 7fbb1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3804d040 con 0x562aac9900e0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9357+0+0 (secure 0 0 0) 0x7fbb38003e00 con 0x562aac9900e0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb340b7020 con 0x562aac9900e0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) ==== 24+0+0 (secure 0 0 0) 0x7fbb380307b0 con 0x562aac9900e0 2024-04-26T18:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 10 client.16239 fetch_fsmap learned FSMap version 116 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) -- 0x562aaca06ff0 con 0x562aac9900e0 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb340b7020 con 0x562aac9900e0 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 116) ==== 7741+0+0 (secure 0 0 0) 0x7fbb38063030 con 0x562aac9900e0 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 10 client.16239 fetch_fsmap finished waiting for FSMap version 116 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 20 client.16239 populate_metadata read hostname 'smithi092' 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aaca07380 0x562aaca09770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 4 client.16239 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562aac981260 con 0x562aaca07380 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.139+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aaca07380 0x562aaca09770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.140+0000 7fbb3ffff640 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aaca07380 0x562aaca09770 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c175b8a129ac131 server_cookie=b4a6df4d1c83b9c0 in_seq=0 out_seq=0 2024-04-26T18:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:09:53.140+0000 7fbb1f7fe640 10 client.16239 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:09:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: pgmap v329: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.5 MiB/s wr, 391 op/s 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.370 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: pgmap v329: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.5 MiB/s wr, 391 op/s 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: pgmap v329: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.5 MiB/s wr, 391 op/s 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:53.379 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: pgmap v330: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-04-26T18:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: pgmap v330: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-04-26T18:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: pgmap v330: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:09:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:09:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: pgmap v331: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-04-26T18:09:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:09:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:09:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:09:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: pgmap v331: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-04-26T18:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:09:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: pgmap v331: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 4.1 MiB/s wr, 456 op/s 2024-04-26T18:09:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:09:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:57 smithi092 ceph-mon[29156]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:09:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:57 smithi189 ceph-mon[32756]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:09:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:57 smithi156 ceph-mon[32679]: Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:09:58.137 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:09:58.137 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: Stopped Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:58.137 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Consumed 1.138s CPU time. 2024-04-26T18:09:58.137 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Start request repeated too quickly. 2024-04-26T18:09:58.137 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.f.service: Failed with result 'exit-code'. 2024-04-26T18:09:58.138 INFO:journalctl@ceph.mds.f.smithi189.stdout:Apr 26 18:09:57 smithi189 systemd[1]: Failed to start Ceph mds.f for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:09:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 585.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:09:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:09:58 smithi092 ceph-mon[29156]: pgmap v332: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 276 op/s 2024-04-26T18:09:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:09:58 smithi189 ceph-mon[32756]: pgmap v332: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 276 op/s 2024-04-26T18:09:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:09:58 smithi156 ceph-mon[32679]: pgmap v332: 97 pgs: 97 active+clean; 3.5 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.5 MiB/s wr, 276 op/s 2024-04-26T18:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: pgmap v333: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-04-26T18:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: Replacing daemon mds.f as rank 2 with standby daemon mds.k 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T18:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:00 smithi189 ceph-mon[32756]: fs cephfs is degraded 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: pgmap v333: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: Replacing daemon mds.f as rank 2 with standby daemon mds.k 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-26T18:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-26T18:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T18:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:00 smithi156 ceph-mon[32679]: fs cephfs is degraded 2024-04-26T18:10:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: pgmap v333: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.8 MiB/s wr, 324 op/s 2024-04-26T18:10:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: Replacing daemon mds.f as rank 2 with standby daemon mds.k 2024-04-26T18:10:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: MDS daemon mds.f is removed because it is dead or otherwise unavailable. 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: osdmap e111: 12 total, 12 up, 12 in 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s); 1 filesystem is degraded 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-26T18:10:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:00 smithi092 ceph-mon[29156]: fs cephfs is degraded 2024-04-26T18:10:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:01 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:resolve 2024-04-26T18:10:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:01 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:01 smithi092 ceph-mon[29156]: pgmap v335: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-04-26T18:10:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:01 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:resolve 2024-04-26T18:10:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:01 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:01 smithi189 ceph-mon[32756]: pgmap v335: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-04-26T18:10:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:01 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:resolve 2024-04-26T18:10:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:01 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:01 smithi156 ceph-mon[32679]: pgmap v335: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2024-04-26T18:10:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.719+0000 7fbb1f7fe640 1 -- 172.21.15.92:0/2836607787 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562aac981260 con 0x562aaca07380 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.719+0000 7fbb1f7fe640 10 client.16239 handle_command_reply: tid=0 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.719+0000 7fbb495da740 1 client.16239 shutdown 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 msgr2=0x562aaca057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbb3804f000 tx=0x7fbb38004920 comp rx=0 tx=0).stop 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 shutdown_connections 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562aaca07380 0x562aaca09770 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562aac9900e0 0x562aaca057a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aac985820 0x562aac98aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb1f7fe640 0 client.16239 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 --2- 172.21.15.92:0/2836607787 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562aac984f00 0x562aac98a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 >> 172.21.15.92:0/2836607787 conn(0x562aac981410 msgr2=0x562aac9805b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 shutdown_connections 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 1 -- 172.21.15.92:0/2836607787 wait complete. 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.720+0000 7fbb495da740 20 client.16239 trim_cache size 0 max 16384 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:10:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 msgr2=0x7fbb280a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 0x7fbb280a6280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb38005e10 tx=0x7fbb38036000 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 msgr2=0x7fbb40199030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400e9f0 tx=0x7fbb3400eeb0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 shutdown_connections 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbb280a3dc0 0x7fbb280a6280 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb40107820 0x7fbb4019d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbb40102220 0x7fbb40199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 --2- 172.21.15.92:0/1897906162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb40101860 0x7fbb40199030 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 >> 172.21.15.92:0/1897906162 conn(0x7fbb400789b0 msgr2=0x7fbb40100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 shutdown_connections 2024-04-26T18:10:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:02.721+0000 7fbb468c4640 1 -- 172.21.15.92:0/1897906162 wait complete. 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199997 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:reconnect 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:rejoin 2024-04-26T18:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:02 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199997 2024-04-26T18:10:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:reconnect 2024-04-26T18:10:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:rejoin 2024-04-26T18:10:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:02 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199997 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:reconnect 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:rejoin 2024-04-26T18:10:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:02 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:03.334 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 590.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:03 smithi092 ceph-mon[29156]: pgmap v336: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-04-26T18:10:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:03 smithi189 ceph-mon[32756]: pgmap v336: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-04-26T18:10:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:03 smithi156 ceph-mon[32679]: pgmap v336: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:clientreplay 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:clientreplay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:active 2024-04-26T18:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:04 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:clientreplay 2024-04-26T18:10:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:clientreplay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:active 2024-04-26T18:10:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:04 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:clientreplay 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=k=up:clientreplay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3006315431,v1:172.21.15.156:6833/3006315431] up:active 2024-04-26T18:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:04 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:05 smithi092 ceph-mon[29156]: pgmap v337: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:05 smithi189 ceph-mon[32756]: pgmap v337: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:05 smithi156 ceph-mon[32679]: pgmap v337: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:07 smithi092 ceph-mon[29156]: pgmap v338: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:07 smithi189 ceph-mon[32756]: pgmap v338: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:07 smithi156 ceph-mon[32679]: pgmap v338: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 833 KiB/s wr, 116 op/s 2024-04-26T18:10:08.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 595.0 s, 1309.5 tps, lat 336.844 ms stddev 2274.373 2024-04-26T18:10:08.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:10:08 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:10:08.481+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:10:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:09 smithi189 ceph-mon[32756]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T18:10:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:09 smithi189 ceph-mon[32756]: pgmap v340: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-04-26T18:10:10.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-mon[32679]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T18:10:10.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-mon[32679]: pgmap v340: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f65d983a700 time 2024-04-26T18:10:09.816946+0000 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f65e3e633dd] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.176 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: clone() 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:09.818+0000 7f65d983a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f65d983a700 time 2024-04-26T18:10:09.816946+0000 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.177 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f65e3e633dd] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: clone() 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.178 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: *** Caught signal (Aborted) ** 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: in thread 7f65d983a700 thread_name:ms_dispatch 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65e2bebd20] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: gsignal() 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: abort() 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f65e3e63437] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.179 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 16: clone() 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:09.820+0000 7f65d983a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:10.180 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: in thread 7f65d983a700 thread_name:ms_dispatch 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65e2bebd20] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: gsignal() 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: abort() 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f65e3e63437] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.181 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 16: clone() 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: -1> 2024-04-26T18:10:09.818+0000 7f65d983a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f65d983a700 time 2024-04-26T18:10:09.816946+0000 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f65e3e633dd] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.182 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: clone() 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 0> 2024-04-26T18:10:09.820+0000 7f65d983a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: in thread 7f65d983a700 thread_name:ms_dispatch 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65e2bebd20] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: gsignal() 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: abort() 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f65e3e63437] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.184 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 16: clone() 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: -1> 2024-04-26T18:10:09.818+0000 7f65d983a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f65d983a700 time 2024-04-26T18:10:09.816946+0000 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f65e3e633dd] 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.185 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: clone() 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 0> 2024-04-26T18:10:09.820+0000 7f65d983a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:10.186 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: in thread 7f65d983a700 thread_name:ms_dispatch 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f65e2bebd20] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2: gsignal() 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 3: abort() 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f65e3e63437] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f65e3e635a3] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x565403d62822] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x565403cd2598] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x565403cd4c17] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x565403bcdd0b] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x565403bce2ac] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x565403bb6fad] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f65e40f7e20] 2024-04-26T18:10:10.187 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 13: (DispatchQueue::entry()+0x51f) [0x7f65e40f4fdf] 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f65e41c7fc1] 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f65e2be11ca] 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 16: clone() 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68174]: 2024-04-26T18:10:10.188 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:09 smithi156 podman[68781]: 2024-04-26 18:10:09.888700384 +0000 UTC m=+0.023212716 container died 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:10:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:09 smithi092 ceph-mon[29156]: osdmap e112: 12 total, 12 up, 12 in 2024-04-26T18:10:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:09 smithi092 ceph-mon[29156]: pgmap v340: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 17 MiB/s wr, 1.52k op/s 2024-04-26T18:10:10.850 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:10 smithi156 podman[68781]: 2024-04-26 18:10:10.551390458 +0000 UTC m=+0.685902835 container remove 374033fdeca8b689a1eb6e1adbccabb59dcfaeb5530d6fa37d51655b6d2712fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T18:10:10.850 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:10 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:10:11.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:10 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:10:11.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:10 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.316s CPU time. 2024-04-26T18:10:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:12 smithi189 ceph-mon[32756]: pgmap v341: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:12 smithi156 ceph-mon[32679]: pgmap v341: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:12 smithi092 ceph-mon[29156]: pgmap v341: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:13.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 600.0 s, 879.7 tps, lat 44.423 ms stddev 54.688 2024-04-26T18:10:14.632 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-mon[32679]: pgmap v342: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:14 smithi189 ceph-mon[32756]: pgmap v342: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:14.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:14 smithi092 ceph-mon[29156]: pgmap v342: 97 pgs: 10 active+clean+snaptrim, 19 active+clean+snaptrim_wait, 68 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3ad2bda700 time 2024-04-26T18:10:14.632658+0000 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3add2033dd] 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.934 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: clone() 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: *** Caught signal (Aborted) ** 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: in thread 7f3ad2bda700 thread_name:ms_dispatch 2024-04-26T18:10:14.935 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.633+0000 7f3ad2bda700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3ad2bda700 time 2024-04-26T18:10:14.632658+0000 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3add2033dd] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.937 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: clone() 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3adbf8bd20] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: gsignal() 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: abort() 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3add203437] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.938 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.939 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 16: clone() 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.635+0000 7f3ad2bda700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: in thread 7f3ad2bda700 thread_name:ms_dispatch 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3adbf8bd20] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: gsignal() 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: abort() 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3add203437] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.940 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 16: clone() 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: -1> 2024-04-26T18:10:14.633+0000 7f3ad2bda700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3ad2bda700 time 2024-04-26T18:10:14.632658+0000 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3add2033dd] 2024-04-26T18:10:14.941 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: clone() 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 0> 2024-04-26T18:10:14.635+0000 7f3ad2bda700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: in thread 7f3ad2bda700 thread_name:ms_dispatch 2024-04-26T18:10:14.942 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3adbf8bd20] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: gsignal() 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: abort() 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3add203437] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.943 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 16: clone() 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: -1> 2024-04-26T18:10:14.633+0000 7f3ad2bda700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f3ad2bda700 time 2024-04-26T18:10:14.632658+0000 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f3add2033dd] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.944 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: clone() 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 0> 2024-04-26T18:10:14.635+0000 7f3ad2bda700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: in thread 7f3ad2bda700 thread_name:ms_dispatch 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f3adbf8bd20] 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2: gsignal() 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 3: abort() 2024-04-26T18:10:14.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f3add203437] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f3add2035a3] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55fc75530822] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55fc754a0598] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55fc754a2c17] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55fc7539bd0b] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55fc7539c2ac] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55fc75384fad] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f3add497e20] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 13: (DispatchQueue::entry()+0x51f) [0x7f3add494fdf] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f3add567fc1] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f3adbf811ca] 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 16: clone() 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[62759]: 2024-04-26T18:10:14.946 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:14 smithi156 podman[68823]: 2024-04-26 18:10:14.699313667 +0000 UTC m=+0.020983422 container died 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T18:10:15.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.823+0000 7f1dde3af640 1 -- 172.21.15.92:0/1059068799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 msgr2=0x7f1dd810f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.823+0000 7f1dde3af640 1 --2- 172.21.15.92:0/1059068799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd810f800 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009cd0 tx=0x7f1dd002a8e0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.823+0000 7f1dde3af640 1 -- 172.21.15.92:0/1059068799 shutdown_connections 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.823+0000 7f1dde3af640 1 --2- 172.21.15.92:0/1059068799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd810f800 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.823+0000 7f1dde3af640 1 --2- 172.21.15.92:0/1059068799 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 0x7f1dd8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 --2- 172.21.15.92:0/1059068799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd8108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 -- 172.21.15.92:0/1059068799 >> 172.21.15.92:0/1059068799 conn(0x7f1dd80fe420 msgr2=0x7f1dd8100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 -- 172.21.15.92:0/1059068799 shutdown_connections 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 -- 172.21.15.92:0/1059068799 wait complete. 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 Processor -- start 2024-04-26T18:10:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.824+0000 7f1dde3af640 1 -- start start 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 0x7f1dd81990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112c00 con 0x7f1dd81032f0 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112a80 con 0x7f1dd8108940 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dde3af640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd8112d80 con 0x7f1dd8102930 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1ddc94c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60424/0 (socket says 172.21.15.92:60424) 2024-04-26T18:10:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 -- 172.21.15.92:0/3256932490 learned_addr learned my addr 172.21.15.92:0/3256932490 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 0x7f1dd81990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 -- 172.21.15.92:0/3256932490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 msgr2=0x7f1dd81990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 0x7f1dd81990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 -- 172.21.15.92:0/3256932490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 msgr2=0x7f1dd819d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd819d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1dd77fe640 1 -- 172.21.15.92:0/3256932490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd819e040 con 0x7f1dd81032f0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.825+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd819d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00e9f0 tx=0x7f1dcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dd57fa640 1 -- 172.21.15.92:0/3256932490 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00cd80 con 0x7f1dd81032f0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dd57fa640 1 -- 172.21.15.92:0/3256932490 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dcc0054d0 con 0x7f1dd81032f0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd819e330 con 0x7f1dd81032f0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dd57fa640 1 -- 172.21.15.92:0/3256932490 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc010690 con 0x7f1dd81032f0 2024-04-26T18:10:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.826+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd81a5bc0 con 0x7f1dd81032f0 2024-04-26T18:10:15.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1dd57fa640 1 -- 172.21.15.92:0/3256932490 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1dcc004e90 con 0x7f1dd81032f0 2024-04-26T18:10:15.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 Processor -- start 2024-04-26T18:10:15.835 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 -- start start 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1dd57fa640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 0x7f1dc00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 0x561f175cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 0x561f175dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561f17532460 con 0x561f175db4f0 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561f174ec590 con 0x561f175cc740 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1de119e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f1752e420 con 0x561f175cbe20 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.829+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 0x7f1dc00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd57fa640 1 -- 172.21.15.92:0/3256932490 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9531+0+0 (secure 0 0 0) 0x7f1dcc0d0f60 con 0x7f1dd81032f0 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1ddc94c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 0x561f175dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 0x561f175cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd77fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 0x561f175dafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:56532/0 (socket says 172.21.15.92:56532) 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd77fe640 1 -- 172.21.15.92:0/449908412 learned_addr learned my addr 172.21.15.92:0/449908412 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1ddc94c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60428/0 (socket says 172.21.15.92:60428) 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 -- 172.21.15.92:0/449908412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 msgr2=0x561f175dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 0x561f175dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 -- 172.21.15.92:0/449908412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 msgr2=0x561f175dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175dd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 -- 172.21.15.92:0/449908412 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f174f90d0 con 0x561f175cbe20 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 0x561f175cc200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009c20 tx=0x7f1dc8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f85c891b24f229a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 0x7f1dc00a6300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005e30 tx=0x7f1dd00098f0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dbe7fc640 1 -- 172.21.15.92:0/449908412 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004030 con 0x561f175cbe20 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dbe7fc640 1 -- 172.21.15.92:0/449908412 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc80035f0 con 0x561f175cbe20 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.830+0000 7f1dbe7fc640 1 -- 172.21.15.92:0/449908412 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8019640 con 0x561f175cbe20 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- 172.21.15.92:0/449908412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 msgr2=0x561f175cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 0x561f175cc200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009c20 tx=0x7f1dc8011810 comp rx=0 tx=0).stop 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- 172.21.15.92:0/449908412 shutdown_connections 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175dd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cc740 0x561f175dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.838 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 --2- 172.21.15.92:0/449908412 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cbe20 0x561f175cc200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- 172.21.15.92:0/449908412 >> 172.21.15.92:0/449908412 conn(0x561f175c8410 msgr2=0x561f175c87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- 172.21.15.92:0/449908412 shutdown_connections 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- 172.21.15.92:0/449908412 wait complete. 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.831+0000 7f1de119e740 1 -- start start 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 Processor -- start 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175d8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175d8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561f175de120 con 0x561f175cbe20 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561f174b9b60 con 0x561f175db4f0 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561f175de2a0 con 0x561f175cc740 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1de119e740 10 client.0 _ll_register_callbacks cb 0x561f174de2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60438/0 (socket says 172.21.15.92:60438) 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1dd7fff640 1 -- 172.21.15.92:0/2875450170 learned_addr learned my addr 172.21.15.92:0/2875450170 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175d8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.832+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175d8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2875450170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 msgr2=0x561f175d8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175d8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2875450170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 msgr2=0x561f175d8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2875450170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f17244210 con 0x561f175db4f0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175d8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175d8ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0033040 tx=0x7f1dd0048000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b962b9a79b8d6dea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1db77fe640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0049950 con 0x561f175db4f0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc80035f0 con 0x561f175db4f0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9531+0+0 (secure 0 0 0) 0x7f1dd0049af0 con 0x561f175db4f0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f1dd0049cf0 con 0x561f175db4f0 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1de119e740 10 client.25724 fetch_fsmap learned FSMap version 123 2024-04-26T18:10:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.833+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=4+}) -- 0x561f17310620 con 0x561f175db4f0 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc80035f0 con 0x561f175db4f0 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 123) ==== 7136+0+0 (secure 0 0 0) 0x7f1dd0030070 con 0x561f175db4f0 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 10 client.25724 fetch_fsmap finished waiting for FSMap version 123 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 10 client.25724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 20 client.25724 populate_metadata read hostname 'smithi092' 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f175eb610 0x561f175eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 4 client.25724 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f17540070 con 0x561f175eb610 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f175eb610 0x561f175eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f175eb610 0x561f175eda20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12842cd0fd59d4a server_cookie=29201fa4537abee3 in_seq=0 out_seq=0 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.834+0000 7f1db77fe640 10 client.25724 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.835+0000 7f1db77fe640 1 -- 172.21.15.92:0/2875450170 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561f17540070 con 0x561f175eb610 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.835+0000 7f1db77fe640 10 client.25724 handle_command_reply: tid=0 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.835+0000 7f1de119e740 1 client.25724 shutdown 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 msgr2=0x561f175d8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175d8ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0033040 tx=0x7f1dd0048000 comp rx=0 tx=0).stop 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 shutdown_connections 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f175eb610 0x561f175eda20 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175d8ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175d8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 --2- 172.21.15.92:0/2875450170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175d8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1db77fe640 0 client.25724 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 >> 172.21.15.92:0/2875450170 conn(0x561f175c8410 msgr2=0x561f175ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 shutdown_connections 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 1 -- 172.21.15.92:0/2875450170 wait complete. 2024-04-26T18:10:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.836+0000 7f1de119e740 20 client.25724 trim_cache size 0 max 16384 2024-04-26T18:10:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.868+0000 7f1de119e740 1 Processor -- start 2024-04-26T18:10:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.868+0000 7f1de119e740 1 -- start start 2024-04-26T18:10:15.869 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175da360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ad8f0 con 0x561f175cbe20 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81adff0 con 0x561f175db4f0 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1de119e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ae6c0 con 0x561f175cc740 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60454/0 (socket says 172.21.15.92:60454) 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.869+0000 7f1dd7fff640 1 -- 172.21.15.92:0/3966304640 learned_addr learned my addr 172.21.15.92:0/3966304640 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1dd7fff640 1 -- 172.21.15.92:0/3966304640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 msgr2=0x561f175da360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175da360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1dd7fff640 1 -- 172.21.15.92:0/3966304640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 msgr2=0x561f175f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.870 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.870+0000 7f1dd7fff640 1 -- 172.21.15.92:0/3966304640 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f175c8240 con 0x561f175cbe20 2024-04-26T18:10:15.871 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.871+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009c20 tx=0x7f1dc8011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5022fd9b11e4f89a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.871+0000 7f1dbdffb640 1 -- 172.21.15.92:0/3966304640 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc801f040 con 0x561f175cbe20 2024-04-26T18:10:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.872+0000 7f1dbdffb640 1 -- 172.21.15.92:0/3966304640 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc802a070 con 0x561f175cbe20 2024-04-26T18:10:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.872+0000 7f1dbdffb640 1 -- 172.21.15.92:0/3966304640 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80055d0 con 0x561f175cbe20 2024-04-26T18:10:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.873+0000 7f1de119e740 1 -- 172.21.15.92:0/3966304640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 msgr2=0x561f175e6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:15.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.873+0000 7f1de119e740 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009c20 tx=0x7f1dc8011d10 comp rx=0 tx=0).stop 2024-04-26T18:10:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 -- 172.21.15.92:0/3966304640 shutdown_connections 2024-04-26T18:10:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175db4f0 0x561f175f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.873 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175da360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 --2- 172.21.15.92:0/3966304640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175cbe20 0x561f175e6fe0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 -- 172.21.15.92:0/3966304640 >> 172.21.15.92:0/3966304640 conn(0x561f175c8410 msgr2=0x561f175d9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 -- 172.21.15.92:0/3966304640 shutdown_connections 2024-04-26T18:10:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 -- 172.21.15.92:0/3966304640 wait complete. 2024-04-26T18:10:15.874 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.874+0000 7f1de119e740 1 -- start start 2024-04-26T18:10:15.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 Processor -- start 2024-04-26T18:10:15.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 0x561f175d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81aabf0 con 0x561f175db4f0 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81abfe0 con 0x561f175cbe20 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd81ab240 con 0x561f175cc740 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1de119e740 10 client.0 _ll_register_callbacks cb 0x7f1dd0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 0x561f175d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1ddc94c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1dd7fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 0x561f175d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:56550/0 (socket says 172.21.15.92:56550) 2024-04-26T18:10:15.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1ddc94c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60468/0 (socket says 172.21.15.92:60468) 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.875+0000 7f1dd7fff640 1 -- 172.21.15.92:0/2451606029 learned_addr learned my addr 172.21.15.92:0/2451606029 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1dd77fe640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2451606029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 msgr2=0x561f175ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 msgr2=0x561f175d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 0x561f175d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 -- 172.21.15.92:0/2451606029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f175cf830 con 0x561f175db4f0 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1ddc94c640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0030360 tx=0x7f1dd0004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dd0c78d7494b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.876+0000 7f1db77fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0067060 con 0x561f175db4f0 2024-04-26T18:10:15.879 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9531+0+0 (secure 0 0 0) 0x7f1dd002e020 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc802a070 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=123) ==== 24+0+0 (secure 0 0 0) 0x7f1dd006e050 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 10 client.16257 fetch_fsmap learned FSMap version 123 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=123,monmap=4+}) -- 0x561f175e3810 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dc802a070 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 123) ==== 7136+0+0 (secure 0 0 0) 0x7f1dd0030040 con 0x561f175db4f0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 10 client.16257 fetch_fsmap finished waiting for FSMap version 123 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 20 client.16257 populate_metadata read hostname 'smithi092' 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f17656390 0x561f17658780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 4 client.16257 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.877+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561f17539ee0 con 0x561f17656390 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.878+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f17656390 0x561f17658780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:15.880 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.878+0000 7f1dd7fff640 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f17656390 0x561f17658780 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7a0e006e75b2f4 server_cookie=f83ca0e6c7e2542 in_seq=0 out_seq=0 2024-04-26T18:10:15.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:15.878+0000 7f1db77fe640 10 client.16257 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:15.969 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:15 smithi156 podman[68823]: 2024-04-26 18:10:15.715495905 +0000 UTC m=+1.037165707 container remove 5133f1c9c2f7c12f4ad592e1f3fda4b3f21246b69d6eb898d8cf6fb425727952 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:10:15.969 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:15 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:10:16.330 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:15 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:10:16.330 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:15 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Consumed 5.574s CPU time. 2024-04-26T18:10:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:16 smithi189 ceph-mon[32756]: pgmap v343: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:16 smithi156 ceph-mon[32679]: pgmap v343: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:16 smithi092 ceph-mon[29156]: pgmap v343: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:18.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 605.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:18 smithi189 ceph-mon[32756]: pgmap v344: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:18 smithi156 ceph-mon[32679]: pgmap v344: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:18 smithi092 ceph-mon[29156]: pgmap v344: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 20 MiB/s wr, 1.63k op/s 2024-04-26T18:10:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:20 smithi189 ceph-mon[32756]: pgmap v345: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-04-26T18:10:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:20 smithi189 ceph-mon[32756]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T18:10:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:20 smithi156 ceph-mon[32679]: pgmap v345: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-04-26T18:10:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:20 smithi156 ceph-mon[32679]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T18:10:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:20 smithi092 ceph-mon[29156]: pgmap v345: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 16 MiB/s wr, 1.32k op/s 2024-04-26T18:10:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:20 smithi092 ceph-mon[29156]: osdmap e113: 12 total, 12 up, 12 in 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:20 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:20 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:20 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.316s CPU time. 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:20 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 podman[68925]: 2024-04-26 18:10:21.068386266 +0000 UTC m=+0.018353341 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:10:21.191 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 podman[68925]: 2024-04-26 18:10:21.191873612 +0000 UTC m=+0.141840675 container create b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:10:21.460 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 podman[68925]: 2024-04-26 18:10:21.436204969 +0000 UTC m=+0.386172031 container init b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T18:10:21.460 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 podman[68925]: 2024-04-26 18:10:21.439009994 +0000 UTC m=+0.388977059 container start b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-26T18:10:21.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 ceph-mds[68944]: -- 172.21.15.156:0/1579060018 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572b07afa40 con 0x5572b0782800 2024-04-26T18:10:21.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: starting mds.k at 2024-04-26T18:10:21.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 bash[68925]: b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d 2024-04-26T18:10:21.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:21 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: pgmap v347: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-04-26T18:10:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: daemon mds.k restarted 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:boot 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:10:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:22 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: pgmap v347: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: daemon mds.k restarted 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:boot 2024-04-26T18:10:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:10:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:10:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:22 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: pgmap v347: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 282 op/s 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: daemon mds.k restarted 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: osdmap e114: 12 total, 12 up, 12 in 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:boot 2024-04-26T18:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:10:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:10:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:22 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:23.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 610.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:23 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:resolve 2024-04-26T18:10:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:23 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:23 smithi092 ceph-mon[29156]: pgmap v349: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-04-26T18:10:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:23 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:resolve 2024-04-26T18:10:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:23 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:23 smithi189 ceph-mon[32756]: pgmap v349: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-04-26T18:10:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:23 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:resolve 2024-04-26T18:10:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:23 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:23 smithi156 ceph-mon[32679]: pgmap v349: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-04-26T18:10:26.445 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:26 smithi156 ceph-mon[32679]: pgmap v350: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-04-26T18:10:26.445 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:10:26.445 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:26.445 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Consumed 5.574s CPU time. 2024-04-26T18:10:26.445 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:10:26.446 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 podman[69015]: 2024-04-26 18:10:26.322397541 +0000 UTC m=+0.018436998 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:10:26.446 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 podman[69015]: 2024-04-26 18:10:26.44582161 +0000 UTC m=+0.141861098 container create 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T18:10:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:26 smithi189 ceph-mon[32756]: pgmap v350: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-04-26T18:10:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:26 smithi092 ceph-mon[29156]: pgmap v350: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.6 MiB/s wr, 124 op/s 2024-04-26T18:10:27.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 podman[69015]: 2024-04-26 18:10:26.723632476 +0000 UTC m=+0.419671922 container init 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:10:27.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 podman[69015]: 2024-04-26 18:10:26.726199183 +0000 UTC m=+0.422238631 container start 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T18:10:27.184 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 ceph-mds[69034]: -- 172.21.15.156:0/1105200097 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556695849a40 con 0x55669581c800 2024-04-26T18:10:27.184 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: starting mds.h at 2024-04-26T18:10:27.184 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 bash[69015]: 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 2024-04-26T18:10:27.184 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:10:26 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: daemon mds.h restarted 2024-04-26T18:10:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T18:10:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:boot 2024-04-26T18:10:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T18:10:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:10:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:27 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: daemon mds.h restarted 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:boot 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:10:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:27 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: daemon mds.h restarted 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: osdmap e115: 12 total, 12 up, 12 in 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:boot 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 1 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:10:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:27 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 615.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:28 smithi189 ceph-mon[32756]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-04-26T18:10:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:resolve 2024-04-26T18:10:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:28 smithi156 ceph-mon[32679]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-04-26T18:10:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:resolve 2024-04-26T18:10:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:28 smithi092 ceph-mon[29156]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-04-26T18:10:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:resolve 2024-04-26T18:10:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1db77fe640 1 -- 172.21.15.92:0/2451606029 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561f17539ee0 con 0x561f17656390 2024-04-26T18:10:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1db77fe640 10 client.16257 handle_command_reply: tid=0 2024-04-26T18:10:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 client.16257 shutdown 2024-04-26T18:10:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 msgr2=0x561f175cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0030360 tx=0x7f1dd0004df0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 shutdown_connections 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561f17656390 0x561f17658780 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561f175db4f0 0x561f175cf080 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561f175cc740 0x561f175ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 --2- 172.21.15.92:0/2451606029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561f175cbe20 0x561f175d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 >> 172.21.15.92:0/2451606029 conn(0x561f175c8410 msgr2=0x561f175c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1db77fe640 0 client.16257 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 shutdown_connections 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 1 -- 172.21.15.92:0/2451606029 wait complete. 2024-04-26T18:10:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.792+0000 7f1de119e740 20 client.16257 trim_cache size 0 max 16384 2024-04-26T18:10:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:10:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:10:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:10:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 msgr2=0x7f1dc00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 0x7f1dc00a6300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0005e30 tx=0x7f1dd00098f0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 msgr2=0x7f1dd81995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00e9f0 tx=0x7f1dcc00edf0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 shutdown_connections 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1dc00a3e40 0x7f1dc00a6300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dd8108940 0x7f1dd819d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1dd81032f0 0x7f1dd81995e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 --2- 172.21.15.92:0/3256932490 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1dd8102930 0x7f1dd81990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 >> 172.21.15.92:0/3256932490 conn(0x7f1dd80fe420 msgr2=0x7f1dd80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 shutdown_connections 2024-04-26T18:10:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:29.793+0000 7f1dde3af640 1 -- 172.21.15.92:0/3256932490 wait complete. 2024-04-26T18:10:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:10:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:reconnect 2024-04-26T18:10:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:reconnect 2024-04-26T18:10:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:29 smithi189 ceph-mon[32756]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:reconnect 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:reconnect 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:29 smithi156 ceph-mon[32679]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:reconnect 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:reconnect 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:29 smithi092 ceph-mon[29156]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 MiB/s wr, 120 op/s 2024-04-26T18:10:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:rejoin 2024-04-26T18:10:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:rejoin 2024-04-26T18:10:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:30 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T18:10:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:30 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:10:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:rejoin 2024-04-26T18:10:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:rejoin 2024-04-26T18:10:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:30 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T18:10:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:30 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:rejoin 2024-04-26T18:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:rejoin 2024-04-26T18:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=c=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:30 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 1 2024-04-26T18:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:30 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:10:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:active 2024-04-26T18:10:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:active 2024-04-26T18:10:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:31 smithi189 ceph-mon[32756]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-04-26T18:10:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:active 2024-04-26T18:10:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:active 2024-04-26T18:10:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:31 smithi156 ceph-mon[32679]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-04-26T18:10:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6836/1535152997,v1:172.21.15.189:6837/1535152997] up:active 2024-04-26T18:10:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/1366605286,v1:172.21.15.189:6833/1366605286] up:active 2024-04-26T18:10:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:31 smithi092 ceph-mon[29156]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-04-26T18:10:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:32 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:34.298 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:32 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:34.299 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:32 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=c=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:34.299 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:33 smithi189 ceph-mon[32756]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-04-26T18:10:34.300 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:10:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:10:33.484+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:10:34.300 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:10:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:10:33.484+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:10:34.300 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 620.0 s, 1446.7 tps, lat 319.167 ms stddev 2410.801 2024-04-26T18:10:34.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:33 smithi092 ceph-mon[29156]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-04-26T18:10:34.300 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:33 smithi156 ceph-mon[32679]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.3 MiB/s wr, 96 op/s 2024-04-26T18:10:36.139 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ec5d8b700 time 2024-04-26T18:10:35.795662+0000 2024-04-26T18:10:36.139 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.139 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.139 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1ed03b43dd] 2024-04-26T18:10:36.139 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.140 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: clone() 2024-04-26T18:10:36.141 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:35.796+0000 7f1ec5d8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ec5d8b700 time 2024-04-26T18:10:35.795662+0000 2024-04-26T18:10:36.142 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.142 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f78bb1a5700 time 2024-04-26T18:10:35.801742+0000 2024-04-26T18:10:36.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f78c57ce3dd] 2024-04-26T18:10:36.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: clone() 2024-04-26T18:10:36.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:35.802+0000 7f78bb1a5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f78bb1a5700 time 2024-04-26T18:10:35.801742+0000 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f78c57ce3dd] 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: clone() 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: *** Caught signal (Aborted) ** 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: in thread 7f78bb1a5700 thread_name:ms_dispatch 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f78c4556d20] 2024-04-26T18:10:36.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: gsignal() 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: abort() 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f78c57ce437] 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1ed03b43dd] 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.150 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.151 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: clone() 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: *** Caught signal (Aborted) ** 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: in thread 7f1ec5d8b700 thread_name:ms_dispatch 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1ecf13cd20] 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: gsignal() 2024-04-26T18:10:36.152 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: abort() 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1ed03b4437] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 16: clone() 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:35.804+0000 7f78bb1a5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: in thread 7f78bb1a5700 thread_name:ms_dispatch 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f78c4556d20] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: gsignal() 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: abort() 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f78c57ce437] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.154 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 16: clone() 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.155 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 16: clone() 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:35.798+0000 7f1ec5d8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: in thread 7f1ec5d8b700 thread_name:ms_dispatch 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.156 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1ecf13cd20] 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: gsignal() 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: abort() 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1ed03b4437] 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.157 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.158 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.159 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.159 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 16: clone() 2024-04-26T18:10:36.159 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.159 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: -1> 2024-04-26T18:10:35.802+0000 7f78bb1a5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f78bb1a5700 time 2024-04-26T18:10:35.801742+0000 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f78c57ce3dd] 2024-04-26T18:10:36.160 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.161 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: clone() 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.162 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 0> 2024-04-26T18:10:35.804+0000 7f78bb1a5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: in thread 7f78bb1a5700 thread_name:ms_dispatch 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f78c4556d20] 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.163 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: -1> 2024-04-26T18:10:35.796+0000 7f1ec5d8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ec5d8b700 time 2024-04-26T18:10:35.795662+0000 2024-04-26T18:10:36.164 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.164 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.164 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.164 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1ed03b43dd] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.165 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.166 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: clone() 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 0> 2024-04-26T18:10:35.798+0000 7f1ec5d8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: in thread 7f1ec5d8b700 thread_name:ms_dispatch 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.167 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1ecf13cd20] 2024-04-26T18:10:36.168 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: gsignal() 2024-04-26T18:10:36.168 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: abort() 2024-04-26T18:10:36.168 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f78c57ce437] 2024-04-26T18:10:36.168 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.169 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 16: clone() 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: -1> 2024-04-26T18:10:35.802+0000 7f78bb1a5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f78bb1a5700 time 2024-04-26T18:10:35.801742+0000 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.170 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f78c57ce3dd] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: gsignal() 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: abort() 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1ed03b4437] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.171 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 16: clone() 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.172 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: -1> 2024-04-26T18:10:35.796+0000 7f1ec5d8b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1ec5d8b700 time 2024-04-26T18:10:35.795662+0000 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1ed03b43dd] 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.173 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.174 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.174 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.174 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.174 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.174 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: clone() 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 0> 2024-04-26T18:10:35.804+0000 7f78bb1a5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: in thread 7f78bb1a5700 thread_name:ms_dispatch 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.175 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f78c4556d20] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2: gsignal() 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 3: abort() 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f78c57ce437] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f78c57ce5a3] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55927f0de822] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55927f04e598] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55927f050c17] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55927ef49d0b] 2024-04-26T18:10:36.176 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55927ef4a2ac] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55927ef32fad] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f78c5a62e20] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 13: (DispatchQueue::entry()+0x51f) [0x7f78c5a5ffdf] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f78c5b32fc1] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f78c454c1ca] 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 16: clone() 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[61990]: 2024-04-26T18:10:36.177 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:35 smithi189 podman[70004]: 2024-04-26 18:10:35.882739469 +0000 UTC m=+0.023196300 container died 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.178 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: clone() 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 0> 2024-04-26T18:10:35.798+0000 7f1ec5d8b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: in thread 7f1ec5d8b700 thread_name:ms_dispatch 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1ecf13cd20] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2: gsignal() 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 3: abort() 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1ed03b4437] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1ed03b45a3] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c374636822] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c3745a6598] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c3745a8c17] 2024-04-26T18:10:36.179 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c3744a1d0b] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3744a22ac] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c37448afad] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1ed0648e20] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 13: (DispatchQueue::entry()+0x51f) [0x7f1ed0645fdf] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1ed0718fc1] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1ecf1321ca] 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 16: clone() 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[62615]: 2024-04-26T18:10:36.180 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:35 smithi189 podman[70003]: 2024-04-26 18:10:35.882941104 +0000 UTC m=+0.023533424 container died f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-04-26T18:10:36.570 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:36 smithi189 ceph-mon[32756]: pgmap v356: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 8.7 MiB/s wr, 318 op/s 2024-04-26T18:10:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:36 smithi156 ceph-mon[32679]: pgmap v356: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 8.7 MiB/s wr, 318 op/s 2024-04-26T18:10:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:36 smithi092 ceph-mon[29156]: pgmap v356: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 8.7 MiB/s wr, 318 op/s 2024-04-26T18:10:36.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:36 smithi189 podman[70004]: 2024-04-26 18:10:36.571139213 +0000 UTC m=+0.711596043 container remove 33fdc4daca8d937c64d1a83a56511425c24dfd6d9cf844233ef6ebf7ce30d1e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:10:36.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:36 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:10:37.568 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:37 smithi189 podman[70003]: 2024-04-26 18:10:37.293218265 +0000 UTC m=+1.433810587 container remove f44f054c795c5611b97a3ab21d36062d8deec1252ab66b215e7fdb27297be934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T18:10:37.568 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:37 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:10:37.887 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:37 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:10:37.887 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:37 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 2.193s CPU time. 2024-04-26T18:10:37.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:37 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:10:37.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:37 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.468s CPU time. 2024-04-26T18:10:38.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 625.0 s, 1634.1 tps, lat 34.326 ms stddev 38.189 2024-04-26T18:10:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:38 smithi189 ceph-mon[32756]: pgmap v357: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 8.3 MiB/s wr, 302 op/s 2024-04-26T18:10:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:38 smithi156 ceph-mon[32679]: pgmap v357: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 8.3 MiB/s wr, 302 op/s 2024-04-26T18:10:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:38 smithi092 ceph-mon[29156]: pgmap v357: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 8.3 MiB/s wr, 302 op/s 2024-04-26T18:10:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:40 smithi189 ceph-mon[32756]: pgmap v358: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-04-26T18:10:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:40 smithi156 ceph-mon[32679]: pgmap v358: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-04-26T18:10:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:40 smithi092 ceph-mon[29156]: pgmap v358: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 569 op/s 2024-04-26T18:10:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:42 smithi189 ceph-mon[32756]: pgmap v359: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:42 smithi156 ceph-mon[32679]: pgmap v359: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:42 smithi092 ceph-mon[29156]: pgmap v359: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 -- 172.21.15.92:0/3832488780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a8108b30 msgr2=0x7f08a8108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/3832488780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a8108b30 0x7f08a8108f10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0898009900 tx=0x7f089802a480 comp rx=0 tx=0).stop 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 -- 172.21.15.92:0/3832488780 shutdown_connections 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/3832488780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806bb20 0x7f08a810f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/3832488780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a806b160 0x7f08a806b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/3832488780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a8108b30 0x7f08a8108f10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 -- 172.21.15.92:0/3832488780 >> 172.21.15.92:0/3832488780 conn(0x7f08a8077630 msgr2=0x7f08a8077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 -- 172.21.15.92:0/3832488780 shutdown_connections 2024-04-26T18:10:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.889+0000 7f08ad1e9640 1 -- 172.21.15.92:0/3832488780 wait complete. 2024-04-26T18:10:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 Processor -- start 2024-04-26T18:10:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 -- start start 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806b160 0x7f08a8198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a8108b30 0x7f08a819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112c00 con 0x7f08a806bb20 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112a80 con 0x7f08a806b160 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f08ad1e9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112d80 con 0x7f08a8108b30 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f089ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f089ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56942/0 (socket says 172.21.15.92:56942) 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.890+0000 7f089ffff640 1 -- 172.21.15.92:0/2954738307 learned_addr learned my addr 172.21.15.92:0/2954738307 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806b160 0x7f08a8198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 -- 172.21.15.92:0/2954738307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a8108b30 msgr2=0x7f08a819d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08a759e640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a8108b30 0x7f08a819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a8108b30 0x7f08a819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 -- 172.21.15.92:0/2954738307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806b160 msgr2=0x7f08a8198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806b160 0x7f08a8198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 -- 172.21.15.92:0/2954738307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a819df80 con 0x7f08a806bb20 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f089ffff640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f089000c970 tx=0x7f089000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08a4d99640 1 -- 172.21.15.92:0/2954738307 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890007bb0 con 0x7f08a806bb20 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08a4d99640 1 -- 172.21.15.92:0/2954738307 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0890007d50 con 0x7f08a806bb20 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08a4d99640 1 -- 172.21.15.92:0/2954738307 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089000f450 con 0x7f08a806bb20 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a819e270 con 0x7f08a806bb20 2024-04-26T18:10:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.891+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a81a5b00 con 0x7f08a806bb20 2024-04-26T18:10:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 Processor -- start 2024-04-26T18:10:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08a4d99640 1 -- 172.21.15.92:0/2954738307 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f0890004f20 con 0x7f08a806bb20 2024-04-26T18:10:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 -- start start 2024-04-26T18:10:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f19ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f1c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562e87e75460 con 0x562e87f0ef00 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562e87e2f590 con 0x562e87f1a0e0 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.894+0000 7f08affde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562e87e71420 con 0x562e87f0f820 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56950/0 (socket says 172.21.15.92:56950) 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 -- 172.21.15.92:0/3590818110 learned_addr learned my addr 172.21.15.92:0/3590818110 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f19ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f089ffff640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f1c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 -- 172.21.15.92:0/3590818110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 msgr2=0x562e87f19ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f19ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 -- 172.21.15.92:0/3590818110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 msgr2=0x562e87f1c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f1c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 -- 172.21.15.92:0/3590818110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e87e3c0d0 con 0x562e87f0ef00 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f089ffff640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f1c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a4d99640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 0x7f08940a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a759e640 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f08a0008da0 tx=0x7f08a000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40290c6b8d728e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 0x7f08940a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f08a4d99640 1 -- 172.21.15.92:0/2954738307 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9615+0+0 (secure 0 0 0) 0x7f08900d0a50 con 0x7f08a806bb20 2024-04-26T18:10:42.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f089d7fa640 1 -- 172.21.15.92:0/3590818110 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a000f830 con 0x562e87f0ef00 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f089d7fa640 1 -- 172.21.15.92:0/3590818110 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08a000de20 con 0x562e87f0ef00 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.895+0000 7f089d7fa640 1 -- 172.21.15.92:0/3590818110 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0018dd0 con 0x562e87f0ef00 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- 172.21.15.92:0/3590818110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 msgr2=0x562e87f0f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 0x7f08940a6280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562e87f104a0 tx=0x7f0898005a20 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f08a0008da0 tx=0x7f08a000d710 comp rx=0 tx=0).stop 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- 172.21.15.92:0/3590818110 shutdown_connections 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f1c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f19ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 --2- 172.21.15.92:0/3590818110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f0f2e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- 172.21.15.92:0/3590818110 >> 172.21.15.92:0/3590818110 conn(0x562e87f0b410 msgr2=0x562e87f0b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- 172.21.15.92:0/3590818110 shutdown_connections 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- 172.21.15.92:0/3590818110 wait complete. 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.896+0000 7f08affde740 1 -- start start 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 Processor -- start 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0ef00 0x562e87f16fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f17a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562e87f1cd10 con 0x562e87f0f820 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x562e87dfcb60 con 0x562e87f0ef00 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562e87f1ce90 con 0x562e87f1a0e0 2024-04-26T18:10:42.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08affde740 10 client.0 _ll_register_callbacks cb 0x562e87e212b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56956/0 (socket says 172.21.15.92:56956) 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 -- 172.21.15.92:0/1323344788 learned_addr learned my addr 172.21.15.92:0/1323344788 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08a759e640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0ef00 0x562e87f16fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 -- 172.21.15.92:0/1323344788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 msgr2=0x562e87f17a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f17a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 -- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0ef00 msgr2=0x562e87f16fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0ef00 0x562e87f16fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 -- 172.21.15.92:0/1323344788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e87b87210 con 0x562e87f0f820 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f089ffff640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f08900cddc0 tx=0x7f089009c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee70f244b8ac176 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.897+0000 7f088e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089001d040 con 0x562e87f0f820 2024-04-26T18:10:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9615+0+0 (secure 0 0 0) 0x7f0890005210 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08a000de20 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) ==== 24+0+0 (secure 0 0 0) 0x7f0890005410 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 10 client.16269 fetch_fsmap learned FSMap version 134 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) -- 0x562e87c53620 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08a000de20 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 134) ==== 7132+0+0 (secure 0 0 0) 0x7f0890085af0 con 0x562e87f0f820 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 10 client.16269 fetch_fsmap finished waiting for FSMap version 134 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 20 client.16269 populate_metadata read hostname 'smithi092' 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f2a0a0 0x562e87f2c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 4 client.16269 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.898+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e87e83070 con 0x562e87f2a0a0 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.899+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f2a0a0 0x562e87f2c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.899+0000 7f088e7fc640 10 client.16269 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.899+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f2a0a0 0x562e87f2c490 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e45dc7248006fa6f server_cookie=3113a0fd3b0eb5c5 in_seq=0 out_seq=0 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f088e7fc640 1 -- 172.21.15.92:0/1323344788 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562e87e83070 con 0x562e87f2a0a0 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f088e7fc640 10 client.16269 handle_command_reply: tid=0 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 client.16269 shutdown 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 msgr2=0x562e87f17520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f08900cddc0 tx=0x7f089009c1e0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 shutdown_connections 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f2a0a0 0x562e87f2c490 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f17a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0f820 0x562e87f17520 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f088e7fc640 0 client.16269 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 --2- 172.21.15.92:0/1323344788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0ef00 0x562e87f16fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 >> 172.21.15.92:0/1323344788 conn(0x562e87f0b410 msgr2=0x562e87f11140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 shutdown_connections 2024-04-26T18:10:42.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 1 -- 172.21.15.92:0/1323344788 wait complete. 2024-04-26T18:10:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.900+0000 7f08affde740 20 client.16269 trim_cache size 0 max 16384 2024-04-26T18:10:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 Processor -- start 2024-04-26T18:10:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 -- start start 2024-04-26T18:10:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f31d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f322a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81af8e0 con 0x562e87f0ef00 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81affb0 con 0x562e87f1a0e0 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08affde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81b0680 con 0x562e87f0f820 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56966/0 (socket says 172.21.15.92:56966) 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 -- 172.21.15.92:0/715935466 learned_addr learned my addr 172.21.15.92:0/715935466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a759e640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f322a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f089ffff640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f31d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 -- 172.21.15.92:0/715935466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 msgr2=0x562e87f31d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f31d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 -- 172.21.15.92:0/715935466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 msgr2=0x562e87f322a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f322a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a6d9d640 1 -- 172.21.15.92:0/715935466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e87f10190 con 0x562e87f0ef00 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f08a759e640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.915+0000 7f089ffff640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f31d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f089802a9a0 tx=0x7f089803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a5b912fd9e87ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f089cff9640 1 -- 172.21.15.92:0/715935466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898035050 con 0x562e87f0ef00 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f089cff9640 1 -- 172.21.15.92:0/715935466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08980035f0 con 0x562e87f0ef00 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f089cff9640 1 -- 172.21.15.92:0/715935466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089803b670 con 0x562e87f0ef00 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 -- 172.21.15.92:0/715935466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 msgr2=0x562e87f18f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f089802a9a0 tx=0x7f089803d000 comp rx=0 tx=0).stop 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 -- 172.21.15.92:0/715935466 shutdown_connections 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f1a0e0 0x562e87f322a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f0f820 0x562e87f31d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 --2- 172.21.15.92:0/715935466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f18f20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.916+0000 7f08affde740 1 -- 172.21.15.92:0/715935466 >> 172.21.15.92:0/715935466 conn(0x562e87f0b410 msgr2=0x562e87f18810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- 172.21.15.92:0/715935466 shutdown_connections 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- 172.21.15.92:0/715935466 wait complete. 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- start start 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 Processor -- start 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0f820 0x562e87f1e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81acbc0 con 0x562e87f0ef00 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81adfd0 con 0x562e87f0f820 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f08a81ad230 con 0x562e87f1a0e0 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08affde740 10 client.0 _ll_register_callbacks cb 0x7f0890007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:56974/0 (socket says 172.21.15.92:56974) 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 -- 172.21.15.92:0/2836137704 learned_addr learned my addr 172.21.15.92:0/2836137704 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a759e640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f089ffff640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0f820 0x562e87f1e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 -- 172.21.15.92:0/2836137704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 msgr2=0x562e87f1e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f1e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 -- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0f820 msgr2=0x562e87f1e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0f820 0x562e87f1e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.917+0000 7f08a6d9d640 1 -- 172.21.15.92:0/2836137704 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e87f8f7d0 con 0x562e87f0ef00 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08a6d9d640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0898005ec0 tx=0x7f08980513b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6579b1a09dc2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898061060 con 0x562e87f0ef00 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9615+0+0 (secure 0 0 0) 0x7f08980037a0 con 0x562e87f0ef00 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08980035f0 con 0x562e87f0ef00 2024-04-26T18:10:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) ==== 24+0+0 (secure 0 0 0) 0x7f0898068050 con 0x562e87f0ef00 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 10 client.16275 fetch_fsmap learned FSMap version 134 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=4+}) -- 0x562e87f90a30 con 0x562e87f0ef00 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08980035f0 con 0x562e87f0ef00 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 134) ==== 7132+0+0 (secure 0 0 0) 0x7f089803baf0 con 0x562e87f0ef00 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 10 client.16275 fetch_fsmap finished waiting for FSMap version 134 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 20 client.16275 populate_metadata read hostname 'smithi092' 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f910f0 0x562e87f93510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:10:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 4 client.16275 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:10:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.918+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e87e7cee0 con 0x562e87f910f0 2024-04-26T18:10:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.919+0000 7f089ffff640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f910f0 0x562e87f93510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:10:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.919+0000 7f088e7fc640 10 client.16275 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:42.919+0000 7f089ffff640 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f910f0 0x562e87f93510 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74821d30429091d server_cookie=8475445e4be43095 in_seq=0 out_seq=0 2024-04-26T18:10:43.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:44 smithi189 ceph-mon[32756]: pgmap v360: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:44 smithi156 ceph-mon[32679]: pgmap v360: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:44 smithi092 ceph-mon[29156]: pgmap v360: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 13 MiB/s wr, 530 op/s 2024-04-26T18:10:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:46 smithi189 ceph-mon[32756]: pgmap v361: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 579 op/s 2024-04-26T18:10:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:46 smithi156 ceph-mon[32679]: pgmap v361: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 579 op/s 2024-04-26T18:10:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:46 smithi092 ceph-mon[29156]: pgmap v361: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 13 MiB/s wr, 579 op/s 2024-04-26T18:10:47.715 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:10:47.715 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:47.715 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 2.193s CPU time. 2024-04-26T18:10:47.716 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:10:47.716 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:10:47.716 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:47.716 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.468s CPU time. 2024-04-26T18:10:47.716 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:47 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:10:48.056 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:47 smithi189 podman[70190]: 2024-04-26 18:10:47.794878408 +0000 UTC m=+0.026200470 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:10:48.057 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 podman[70180]: 2024-04-26 18:10:47.780752101 +0000 UTC m=+0.021623736 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:10:48.057 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:47 smithi189 podman[70180]: 2024-04-26 18:10:47.936691977 +0000 UTC m=+0.177563613 container create 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T18:10:48.307 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 podman[70190]: 2024-04-26 18:10:48.181413595 +0000 UTC m=+0.412735646 container create cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:10:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 635.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:10:48.619 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 podman[70180]: 2024-04-26 18:10:48.426138747 +0000 UTC m=+0.667010382 container init 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T18:10:48.619 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 podman[70180]: 2024-04-26 18:10:48.428733936 +0000 UTC m=+0.669605571 container start 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T18:10:48.619 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 ceph-mds[70232]: -- 172.21.15.189:0/2166971999 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7a7917a40 con 0x55e7a78eb000 2024-04-26T18:10:48.619 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: starting mds.c at 2024-04-26T18:10:48.620 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 podman[70190]: 2024-04-26 18:10:48.527213841 +0000 UTC m=+0.758535896 container init cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:10:48.620 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 podman[70190]: 2024-04-26 18:10:48.529792437 +0000 UTC m=+0.761114481 container start cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:10:48.620 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 ceph-mds[70253]: -- 172.21.15.189:0/1567728163 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562da5b27a40 con 0x562da5afa800 2024-04-26T18:10:48.620 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: starting mds.l at 2024-04-26T18:10:48.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:48 smithi189 ceph-mon[32756]: pgmap v362: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6.0 MiB/s wr, 352 op/s 2024-04-26T18:10:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:48 smithi156 ceph-mon[32679]: pgmap v362: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6.0 MiB/s wr, 352 op/s 2024-04-26T18:10:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:48 smithi092 ceph-mon[29156]: pgmap v362: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6.0 MiB/s wr, 352 op/s 2024-04-26T18:10:48.887 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 bash[70180]: 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a 2024-04-26T18:10:48.887 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:10:48 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:48.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 bash[70190]: cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 2024-04-26T18:10:48.888 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:10:48 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: daemon mds.c restarted 2024-04-26T18:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T18:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:boot 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: daemon mds.l restarted 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:boot 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:10:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:49 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: daemon mds.c restarted 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:boot 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: daemon mds.l restarted 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:boot 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:10:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:49 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: daemon mds.c restarted 2024-04-26T18:10:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:10:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: osdmap e116: 12 total, 12 up, 12 in 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:boot 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=l=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: daemon mds.l restarted 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: osdmap e117: 12 total, 12 up, 12 in 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:boot 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:10:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:49 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:50 smithi189 ceph-mon[32756]: pgmap v365: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:resolve 2024-04-26T18:10:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:resolve 2024-04-26T18:10:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:50 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:50 smithi156 ceph-mon[32679]: pgmap v365: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:resolve 2024-04-26T18:10:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:resolve 2024-04-26T18:10:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:50 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:50 smithi092 ceph-mon[29156]: pgmap v365: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:50 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:resolve 2024-04-26T18:10:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:50 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:resolve 2024-04-26T18:10:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:50 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f088e7fc640 1 -- 172.21.15.92:0/2836137704 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e87e7cee0 con 0x562e87f910f0 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f088e7fc640 10 client.16275 handle_command_reply: tid=0 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 client.16275 shutdown 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 msgr2=0x562e87f1dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0898005ec0 tx=0x7f08980513b0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 shutdown_connections 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x562e87f910f0 0x562e87f93510 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562e87f1a0e0 0x562e87f1e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e87f0f820 0x562e87f1e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 --2- 172.21.15.92:0/2836137704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562e87f0ef00 0x562e87f1dce0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f088e7fc640 0 client.16275 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 >> 172.21.15.92:0/2836137704 conn(0x562e87f0b410 msgr2=0x562e87f190a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 shutdown_connections 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 1 -- 172.21.15.92:0/2836137704 wait complete. 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.600+0000 7f08affde740 20 client.16275 trim_cache size 0 max 16384 2024-04-26T18:10:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 msgr2=0x7f08940a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 0x7f08940a6280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562e87f104a0 tx=0x7f0898005a20 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 msgr2=0x7f08a8199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f089000c970 tx=0x7f089000ce30 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 shutdown_connections 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f08940a3dc0 0x7f08940a6280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f08a8108b30 0x7f08a819d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a806bb20 0x7f08a8199520 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 --2- 172.21.15.92:0/2954738307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08a806b160 0x7f08a8198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 >> 172.21.15.92:0/2954738307 conn(0x7f08a8077630 msgr2=0x7f08a81006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.601+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 shutdown_connections 2024-04-26T18:10:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:10:51.602+0000 7f08ad1e9640 1 -- 172.21.15.92:0/2954738307 wait complete. 2024-04-26T18:10:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:reconnect 2024-04-26T18:10:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:reconnect 2024-04-26T18:10:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:51 smithi189 ceph-mon[32756]: pgmap v366: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:reconnect 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:reconnect 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:51 smithi156 ceph-mon[32679]: pgmap v366: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999984 2024-04-26T18:10:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:10:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:reconnect 2024-04-26T18:10:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:reconnect 2024-04-26T18:10:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:51 smithi092 ceph-mon[29156]: pgmap v366: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.1 MiB/s wr, 144 op/s 2024-04-26T18:10:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:rejoin 2024-04-26T18:10:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:rejoin 2024-04-26T18:10:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:52 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:52 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:10:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:52 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:rejoin 2024-04-26T18:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:rejoin 2024-04-26T18:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:52 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:52 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:52 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:rejoin 2024-04-26T18:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:rejoin 2024-04-26T18:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:52 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:52 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:52 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:10:53.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 640.0 s, 467.3 tps, lat 736.199 ms stddev 3351.692 2024-04-26T18:10:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:active 2024-04-26T18:10:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:active 2024-04-26T18:10:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:53 smithi189 ceph-mon[32756]: pgmap v367: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 563 KiB/s wr, 70 op/s 2024-04-26T18:10:53.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:10:53.485+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:10:53.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:10:53.485+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:10:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:active 2024-04-26T18:10:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:active 2024-04-26T18:10:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:53 smithi156 ceph-mon[32679]: pgmap v367: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 563 KiB/s wr, 70 op/s 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/2445294700,v1:172.21.15.156:6837/2445294700] up:active 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/2908823349,v1:172.21.15.156:6833/2908823349] up:active 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:53 smithi092 ceph-mon[29156]: pgmap v367: 97 pgs: 97 active+clean; 3.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 563 KiB/s wr, 70 op/s 2024-04-26T18:10:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:56 smithi189 ceph-mon[32756]: pgmap v368: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 4.4 MiB/s wr, 258 op/s 2024-04-26T18:10:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:56 smithi156 ceph-mon[32679]: pgmap v368: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 4.4 MiB/s wr, 258 op/s 2024-04-26T18:10:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:56 smithi092 ceph-mon[29156]: pgmap v368: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 4.4 MiB/s wr, 258 op/s 2024-04-26T18:10:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:10:57.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:57.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:57.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-mon[32679]: pgmap v369: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-04-26T18:10:57.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-mon[32679]: pgmap v370: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 265 op/s 2024-04-26T18:10:57.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:10:57.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:57.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:57.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:57 smithi092 ceph-mon[29156]: pgmap v369: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-04-26T18:10:57.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:57 smithi092 ceph-mon[29156]: pgmap v370: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 265 op/s 2024-04-26T18:10:57.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:10:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:10:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:10:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:57 smithi189 ceph-mon[32756]: pgmap v369: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 4.5 MiB/s wr, 262 op/s 2024-04-26T18:10:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:57 smithi189 ceph-mon[32756]: pgmap v370: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 265 op/s 2024-04-26T18:10:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f28cd0da700 time 2024-04-26T18:10:57.601960+0000 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f28d77033dd] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: clone() 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.601+0000 7f28cd0da700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f28cd0da700 time 2024-04-26T18:10:57.601960+0000 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:57.935 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f28d77033dd] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.936 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: clone() 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: *** Caught signal (Aborted) ** 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: in thread 7f28cd0da700 thread_name:ms_dispatch 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f28d648bd20] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: gsignal() 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: abort() 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f28d7703437] 2024-04-26T18:10:57.937 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 16: clone() 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.603+0000 7f28cd0da700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: in thread 7f28cd0da700 thread_name:ms_dispatch 2024-04-26T18:10:57.938 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f28d648bd20] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: gsignal() 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: abort() 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f28d7703437] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.939 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 16: clone() 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: -1> 2024-04-26T18:10:57.601+0000 7f28cd0da700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f28cd0da700 time 2024-04-26T18:10:57.601960+0000 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f28d77033dd] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.940 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: clone() 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 0> 2024-04-26T18:10:57.603+0000 7f28cd0da700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: in thread 7f28cd0da700 thread_name:ms_dispatch 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.941 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f28d648bd20] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: gsignal() 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: abort() 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f28d7703437] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.942 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 16: clone() 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: -1> 2024-04-26T18:10:57.601+0000 7f28cd0da700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f28cd0da700 time 2024-04-26T18:10:57.601960+0000 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f28d77033dd] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.943 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.944 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.944 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.944 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.944 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.944 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: clone() 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 0> 2024-04-26T18:10:57.603+0000 7f28cd0da700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: in thread 7f28cd0da700 thread_name:ms_dispatch 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f28d648bd20] 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2: gsignal() 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 3: abort() 2024-04-26T18:10:57.945 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f28d7703437] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f28d77035a3] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5572ae9ac822] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5572ae91c598] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5572ae91ec17] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5572ae817d0b] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5572ae8182ac] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5572ae800fad] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f28d7997e20] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 13: (DispatchQueue::entry()+0x51f) [0x7f28d7994fdf] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f28d7a67fc1] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f28d64811ca] 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 16: clone() 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:10:57.946 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[68940]: 2024-04-26T18:10:57.947 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:57 smithi156 podman[69225]: 2024-04-26 18:10:57.660869621 +0000 UTC m=+0.019322328 container died b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-26T18:10:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 645.0 s, 2503.2 tps, lat 34.525 ms stddev 40.042 2024-04-26T18:10:58.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:58 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:58.610 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:58 smithi156 podman[69225]: 2024-04-26 18:10:58.359693557 +0000 UTC m=+0.718146278 container remove b857de19b5665e3d9891a7f727db6f1868edaffeb31ac243dfd47e8234963a2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:10:58.610 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:58 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:10:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:58 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:58 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:10:58.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:58 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:10:58.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:10:58 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.223s CPU time. 2024-04-26T18:10:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:10:59 smithi189 ceph-mon[32756]: pgmap v371: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2024-04-26T18:10:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:10:59 smithi156 ceph-mon[32679]: pgmap v371: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2024-04-26T18:10:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:10:59 smithi092 ceph-mon[29156]: pgmap v371: 97 pgs: 97 active+clean; 3.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2024-04-26T18:11:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:01 smithi189 ceph-mon[32756]: pgmap v372: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:01.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:01 smithi092 ceph-mon[29156]: pgmap v372: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:01 smithi156 ceph-mon[32679]: pgmap v372: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:03.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:03 smithi189 ceph-mon[32756]: pgmap v373: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:03 smithi156 ceph-mon[32679]: pgmap v373: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:03 smithi092 ceph-mon[29156]: pgmap v373: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 12 MiB/s wr, 534 op/s 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 -- 172.21.15.92:0/4104816013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c106800 msgr2=0x7f206c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 --2- 172.21.15.92:0/4104816013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c106800 0x7f206c106be0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f205c009900 tx=0x7f205c02a410 comp rx=0 tx=0).stop 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 -- 172.21.15.92:0/4104816013 shutdown_connections 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 --2- 172.21.15.92:0/4104816013 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c102980 0x7f206c10e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 --2- 172.21.15.92:0/4104816013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c101fc0 0x7f206c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 --2- 172.21.15.92:0/4104816013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c106800 0x7f206c106be0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 -- 172.21.15.92:0/4104816013 >> 172.21.15.92:0/4104816013 conn(0x7f206c077dc0 msgr2=0x7f206c0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 -- 172.21.15.92:0/4104816013 shutdown_connections 2024-04-26T18:11:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.704+0000 7f207141d640 1 -- 172.21.15.92:0/4104816013 wait complete. 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 Processor -- start 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 -- start start 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c102980 0x7f206c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c106800 0x7f206c1a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f206c111ab0 con 0x7f206c101fc0 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f206c111930 con 0x7f206c102980 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f207141d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f206c111c30 con 0x7f206c106800 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57236/0 (socket says 172.21.15.92:57236) 2024-04-26T18:11:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 -- 172.21.15.92:0/1642737900 learned_addr learned my addr 172.21.15.92:0/1642737900 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206b7fe640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c106800 0x7f206c1a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 -- 172.21.15.92:0/1642737900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c106800 msgr2=0x7f206c1a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c106800 0x7f206c1a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 -- 172.21.15.92:0/1642737900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c102980 msgr2=0x7f206c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f2063fff640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c102980 0x7f206c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.705+0000 7f206affd640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c102980 0x7f206c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f206affd640 1 -- 172.21.15.92:0/1642737900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206c1a5470 con 0x7f206c101fc0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f206affd640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f205c006010 tx=0x7f205c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f2068ff9640 1 -- 172.21.15.92:0/1642737900 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c03f030 con 0x7f206c101fc0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f2068ff9640 1 -- 172.21.15.92:0/1642737900 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c003cb0 con 0x7f206c101fc0 2024-04-26T18:11:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f206c1a5640 con 0x7f206c101fc0 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f2068ff9640 1 -- 172.21.15.92:0/1642737900 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c035070 con 0x7f206c101fc0 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.706+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f206c1a5a40 con 0x7f206c101fc0 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.708+0000 7f2068ff9640 1 -- 172.21.15.92:0/1642737900 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f205c042030 con 0x7f206c101fc0 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.708+0000 7f207420f740 1 Processor -- start 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.708+0000 7f207420f740 1 -- start start 2024-04-26T18:11:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650d1c14460 con 0x5650d1cae700 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5650d1bce590 con 0x5650d1cadde0 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f207420f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5650d1c10420 con 0x5650d1cbd4f0 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f2068ff9640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 0x7f20580a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206b7fe640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 0x7f20580a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57250/0 (socket says 172.21.15.92:57250) 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 -- 172.21.15.92:0/2026615394 learned_addr learned my addr 172.21.15.92:0/2026615394 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206b7fe640 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f2063fff640 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f2068ff9640 1 -- 172.21.15.92:0/1642737900 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9787+0+0 (secure 0 0 0) 0x7f205c0f1250 con 0x7f206c101fc0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 -- 172.21.15.92:0/2026615394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 msgr2=0x5650d1cbf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 -- 172.21.15.92:0/2026615394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 msgr2=0x5650d1cae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.709+0000 7f206affd640 1 -- 172.21.15.92:0/2026615394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d1bdb0d0 con 0x5650d1cae700 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f206b7fe640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 0x7f20580a6280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2064005fd0 tx=0x7f2064009d50 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f206affd640 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f205c0c53e0 tx=0x7f205c0e7db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c001a85359a0766e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f20617fa640 1 -- 172.21.15.92:0/2026615394 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c049070 con 0x5650d1cae700 2024-04-26T18:11:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f20617fa640 1 -- 172.21.15.92:0/2026615394 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c0bd3a0 con 0x5650d1cae700 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f20617fa640 1 -- 172.21.15.92:0/2026615394 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c0dbe60 con 0x5650d1cae700 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f207420f740 1 -- 172.21.15.92:0/2026615394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 msgr2=0x5650d1cbcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.710+0000 7f207420f740 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f205c0c53e0 tx=0x7f205c0e7db0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- 172.21.15.92:0/2026615394 shutdown_connections 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cbcfb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- 172.21.15.92:0/2026615394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- 172.21.15.92:0/2026615394 >> 172.21.15.92:0/2026615394 conn(0x5650d1caa410 msgr2=0x5650d1caa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- 172.21.15.92:0/2026615394 shutdown_connections 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- 172.21.15.92:0/2026615394 wait complete. 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- start start 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 Processor -- start 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5650d1c14460 con 0x5650d1cae700 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5650d1b9bb60 con 0x5650d1cadde0 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5650d1cbfee0 con 0x5650d1cbd4f0 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f207420f740 10 client.0 _ll_register_callbacks cb 0x5650d1bc02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f2063fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f2063fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57256/0 (socket says 172.21.15.92:57256) 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f2063fff640 1 -- 172.21.15.92:0/2609519646 learned_addr learned my addr 172.21.15.92:0/2609519646 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.711+0000 7f206affd640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 -- 172.21.15.92:0/2609519646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 msgr2=0x5650d1cbaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 -- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 msgr2=0x5650d1cba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 -- 172.21.15.92:0/2609519646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d1926210 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f2063fff640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f20540117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f02e71b335a3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054012860 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9787+0+0 (secure 0 0 0) 0x7f2054012a00 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c0bd3a0 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f2054025050 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 10 client.16296 fetch_fsmap learned FSMap version 144 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=4+}) -- 0x5650d19f2620 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c0bd3a0 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 144) ==== 7132+0+0 (secure 0 0 0) 0x7f205400f040 con 0x5650d1cae700 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 10 client.16296 fetch_fsmap finished waiting for FSMap version 144 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 20 client.16296 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1ccd480 0x5650d1ccf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 4 client.16296 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.712+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650d1c22070 con 0x5650d1ccd480 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.713+0000 7f206affd640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1ccd480 0x5650d1ccf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.713+0000 7f20527fc640 10 client.16296 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.713+0000 7f206affd640 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1ccd480 0x5650d1ccf870 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79a0ce5cf21702e3 server_cookie=3cc64a9c098026bb in_seq=0 out_seq=0 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f20527fc640 1 -- 172.21.15.92:0/2609519646 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5650d1c22070 con 0x5650d1ccd480 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f20527fc640 10 client.16296 handle_command_reply: tid=0 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 client.16296 shutdown 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 msgr2=0x5650d1cba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f20540117b0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 shutdown_connections 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1ccd480 0x5650d1ccf870 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cbd4f0 0x5650d1cbaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cba9f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 --2- 172.21.15.92:0/2609519646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f20527fc640 0 client.16296 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 >> 172.21.15.92:0/2609519646 conn(0x5650d1caa410 msgr2=0x5650d1cb0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 shutdown_connections 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 1 -- 172.21.15.92:0/2609519646 wait complete. 2024-04-26T18:11:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.714+0000 7f207420f740 20 client.16296 trim_cache size 0 max 16384 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 Processor -- start 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 -- start start 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cbad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cae700 0x5650d1cd5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1ad990 con 0x5650d1cbd4f0 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1ae060 con 0x5650d1cadde0 2024-04-26T18:11:04.741 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f207420f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1ae760 con 0x5650d1cae700 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f206b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f206b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57268/0 (socket says 172.21.15.92:57268) 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.729+0000 7f206b7fe640 1 -- 172.21.15.92:0/765507314 learned_addr learned my addr 172.21.15.92:0/765507314 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f2063fff640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cae700 0x5650d1cd5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206affd640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cbad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 -- 172.21.15.92:0/765507314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cae700 msgr2=0x5650d1cd5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cae700 0x5650d1cd5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 -- 172.21.15.92:0/765507314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 msgr2=0x5650d1cbad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cbad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 -- 172.21.15.92:0/765507314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d1ca5d60 con 0x5650d1cbd4f0 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206affd640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cbad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f206b7fe640 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2064014540 tx=0x7f206401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c4b466ff2d82c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f2060ff9640 1 -- 172.21.15.92:0/765507314 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2064025030 con 0x5650d1cbd4f0 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f2060ff9640 1 -- 172.21.15.92:0/765507314 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2064014110 con 0x5650d1cbd4f0 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.730+0000 7f2060ff9640 1 -- 172.21.15.92:0/765507314 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20640216c0 con 0x5650d1cbd4f0 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- 172.21.15.92:0/765507314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 msgr2=0x5650d1cd5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2064014540 tx=0x7f206401b000 comp rx=0 tx=0).stop 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- 172.21.15.92:0/765507314 shutdown_connections 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cbd4f0 0x5650d1cd5680 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cae700 0x5650d1cd5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- 172.21.15.92:0/765507314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cadde0 0x5650d1cbad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- 172.21.15.92:0/765507314 >> 172.21.15.92:0/765507314 conn(0x5650d1caa410 msgr2=0x5650d1ca8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- 172.21.15.92:0/765507314 shutdown_connections 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- 172.21.15.92:0/765507314 wait complete. 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- start start 2024-04-26T18:11:04.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 Processor -- start 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 0x5650d1cc0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 0x5650d1cc1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1aacb0 con 0x5650d1cae700 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1ac080 con 0x5650d1cbd4f0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f206c1ab300 con 0x5650d1cadde0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f207420f740 10 client.0 _ll_register_callbacks cb 0x7f2054009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f2063fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f2063fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57276/0 (socket says 172.21.15.92:57276) 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.731+0000 7f2063fff640 1 -- 172.21.15.92:0/2322656574 learned_addr learned my addr 172.21.15.92:0/2322656574 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f206b7fe640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 0x5650d1cc1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f206affd640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 0x5650d1cc0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 -- 172.21.15.92:0/2322656574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 msgr2=0x5650d1cc0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 0x5650d1cc0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 -- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 msgr2=0x5650d1cc1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 0x5650d1cc1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 -- 172.21.15.92:0/2322656574 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d1d32c50 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f206affd640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 0x5650d1cc0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f206b7fe640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 0x5650d1cc1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f2063fff640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f2054005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3725a217b2d3dece server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205401a5f0 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9787+0+0 (secure 0 0 0) 0x7f205401a790 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2064014110 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) ==== 24+0+0 (secure 0 0 0) 0x7f205403c050 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f207420f740 10 client.16302 fetch_fsmap learned FSMap version 144 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=4+}) -- 0x5650d1d33eb0 con 0x5650d1cae700 2024-04-26T18:11:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2064014110 con 0x5650d1cae700 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.732+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 144) ==== 7132+0+0 (secure 0 0 0) 0x7f2054012c30 con 0x5650d1cae700 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 10 client.16302 fetch_fsmap finished waiting for FSMap version 144 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 20 client.16302 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1d345d0 0x5650d1d369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 4 client.16302 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5650d1c1bee0 con 0x5650d1d345d0 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f206affd640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1d345d0 0x5650d1d369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f20527fc640 10 client.16302 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:04.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:04.733+0000 7f206affd640 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1d345d0 0x5650d1d369f0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16433c8fd76d8a1d server_cookie=a25da8965c5a3118 in_seq=0 out_seq=0 2024-04-26T18:11:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:05 smithi189 ceph-mon[32756]: pgmap v374: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.7 MiB/s wr, 456 op/s 2024-04-26T18:11:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:05 smithi156 ceph-mon[32679]: pgmap v374: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.7 MiB/s wr, 456 op/s 2024-04-26T18:11:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:05 smithi092 ceph-mon[29156]: pgmap v374: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.7 MiB/s wr, 456 op/s 2024-04-26T18:11:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:07 smithi189 ceph-mon[32756]: pgmap v375: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 MiB/s wr, 413 op/s 2024-04-26T18:11:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:07 smithi156 ceph-mon[32679]: pgmap v375: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 MiB/s wr, 413 op/s 2024-04-26T18:11:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:07 smithi092 ceph-mon[29156]: pgmap v375: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.8 MiB/s wr, 413 op/s 2024-04-26T18:11:08.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 655.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.223s CPU time. 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 podman[69326]: 2024-04-26 18:11:08.840075022 +0000 UTC m=+0.030151828 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:11:08.979 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:08 smithi156 podman[69326]: 2024-04-26 18:11:08.97995378 +0000 UTC m=+0.170030569 container create 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:11:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:09 smithi189 ceph-mon[32756]: pgmap v376: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 MiB/s wr, 344 op/s 2024-04-26T18:11:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:09 smithi156 ceph-mon[32679]: pgmap v376: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 MiB/s wr, 344 op/s 2024-04-26T18:11:09.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 podman[69326]: 2024-04-26 18:11:09.458524661 +0000 UTC m=+0.648601463 container init 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True) 2024-04-26T18:11:09.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 podman[69326]: 2024-04-26 18:11:09.463624054 +0000 UTC m=+0.653700854 container start 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD) 2024-04-26T18:11:09.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 ceph-mds[69346]: -- 172.21.15.156:0/3895029792 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6ed6b7a40 con 0x55d6ed68b000 2024-04-26T18:11:09.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: starting mds.k at 2024-04-26T18:11:09.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 bash[69326]: 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff 2024-04-26T18:11:09.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:09 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:09 smithi092 ceph-mon[29156]: pgmap v376: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.3 MiB/s wr, 344 op/s 2024-04-26T18:11:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: daemon mds.k restarted 2024-04-26T18:11:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T18:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:boot 2024-04-26T18:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:10 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: daemon mds.k restarted 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:boot 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:10 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: daemon mds.k restarted 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: osdmap e118: 12 total, 12 up, 12 in 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:boot 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:10 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:11 smithi189 ceph-mon[32756]: pgmap v378: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:resolve 2024-04-26T18:11:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:11 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:11 smithi156 ceph-mon[32679]: pgmap v378: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:resolve 2024-04-26T18:11:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:11 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:11 smithi092 ceph-mon[29156]: pgmap v378: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:resolve 2024-04-26T18:11:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:11 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.520+0000 7f20527fc640 1 -- 172.21.15.92:0/2322656574 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5650d1c1bee0 con 0x5650d1d345d0 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.520+0000 7f20527fc640 10 client.16302 handle_command_reply: tid=0 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.520+0000 7f207420f740 1 client.16302 shutdown 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.520+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 msgr2=0x5650d1cc1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.520+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2054009d90 tx=0x7f2054005270 comp rx=0 tx=0).stop 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 shutdown_connections 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5650d1d345d0 0x5650d1d369f0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5650d1cbd4f0 0x5650d1cc1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5650d1cae700 0x5650d1cc1340 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 --2- 172.21.15.92:0/2322656574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5650d1cadde0 0x5650d1cc0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f20527fc640 0 client.16302 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 >> 172.21.15.92:0/2322656574 conn(0x5650d1caa410 msgr2=0x5650d1ca95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 shutdown_connections 2024-04-26T18:11:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 1 -- 172.21.15.92:0/2322656574 wait complete. 2024-04-26T18:11:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207420f740 20 client.16302 trim_cache size 0 max 16384 2024-04-26T18:11:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:11:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:11:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:11:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 msgr2=0x7f20580a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 0x7f20580a6280 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2064005fd0 tx=0x7f2064009d50 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.521+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 msgr2=0x7f206c199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f205c006010 tx=0x7f205c0042f0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 shutdown_connections 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f20580a3dc0 0x7f20580a6280 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f206c106800 0x7f206c1a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f206c102980 0x7f206c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 --2- 172.21.15.92:0/1642737900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f206c101fc0 0x7f206c199eb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:12.524 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 >> 172.21.15.92:0/1642737900 conn(0x7f206c077dc0 msgr2=0x7f206c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 shutdown_connections 2024-04-26T18:11:12.525 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:12.522+0000 7f207141d640 1 -- 172.21.15.92:0/1642737900 wait complete. 2024-04-26T18:11:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:12 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:12 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:12 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:reconnect 2024-04-26T18:11:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:12 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:12 smithi189 ceph-mon[32756]: pgmap v379: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:12 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:12 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:12 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:reconnect 2024-04-26T18:11:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:12 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:12 smithi156 ceph-mon[32679]: pgmap v379: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:12 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:12 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:12 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:reconnect 2024-04-26T18:11:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:12 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:reconnect} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:12 smithi092 ceph-mon[29156]: pgmap v379: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 140 op/s 2024-04-26T18:11:13.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:rejoin 2024-04-26T18:11:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:13 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:13 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:rejoin 2024-04-26T18:11:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:13 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:13 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:rejoin 2024-04-26T18:11:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:13 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:rejoin} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:13 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:14 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:active 2024-04-26T18:11:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:14 smithi189 ceph-mon[32756]: pgmap v380: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 2.3 MiB/s wr, 246 op/s 2024-04-26T18:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:14 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:active 2024-04-26T18:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:14 smithi156 ceph-mon[32679]: pgmap v380: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 2.3 MiB/s wr, 246 op/s 2024-04-26T18:11:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:14 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2582935280,v1:172.21.15.189:6833/2582935280] up:active 2024-04-26T18:11:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:14 smithi092 ceph-mon[29156]: pgmap v380: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 2.3 MiB/s wr, 246 op/s 2024-04-26T18:11:17.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f01c0784700 time 2024-04-26T18:11:16.758594+0000 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f01cadad3dd] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: clone() 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: *** Caught signal (Aborted) ** 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: in thread 7f01c0784700 thread_name:ms_dispatch 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:16.759+0000 7f01c0784700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f01c0784700 time 2024-04-26T18:11:16.758594+0000 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f01cadad3dd] 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: clone() 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f01c9b35d20] 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: gsignal() 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: abort() 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f01cadad437] 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 16: clone() 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:16.761+0000 7f01c0784700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: in thread 7f01c0784700 thread_name:ms_dispatch 2024-04-26T18:11:17.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f01c9b35d20] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: gsignal() 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: abort() 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f01cadad437] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 16: clone() 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: -1> 2024-04-26T18:11:16.759+0000 7f01c0784700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f01c0784700 time 2024-04-26T18:11:16.758594+0000 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f01cadad3dd] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.196 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: clone() 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 0> 2024-04-26T18:11:16.761+0000 7f01c0784700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: in thread 7f01c0784700 thread_name:ms_dispatch 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f01c9b35d20] 2024-04-26T18:11:17.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: gsignal() 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: abort() 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f01cadad437] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 16: clone() 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: -2> 2024-04-26T18:11:16.759+0000 7f01c0784700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f01c0784700 time 2024-04-26T18:11:16.758594+0000 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f01cadad3dd] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: clone() 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: -1> 2024-04-26T18:11:16.761+0000 7f01c0784700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: in thread 7f01c0784700 thread_name:ms_dispatch 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f01c9b35d20] 2024-04-26T18:11:17.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2: gsignal() 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 3: abort() 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f01cadad437] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f01cadad5a3] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556692aff822] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x556692a6f598] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x556692a71c17] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55669296ad0b] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55669296b2ac] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x556692953fad] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f01cb041e20] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 13: (DispatchQueue::entry()+0x51f) [0x7f01cb03efdf] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f01cb111fc1] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f01c9b2b1ca] 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 16: clone() 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:17.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69030]: 2024-04-26T18:11:17.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:16 smithi156 podman[69382]: 2024-04-26 18:11:16.845360564 +0000 UTC m=+0.023572948 container died 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-26T18:11:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:17 smithi156 ceph-mon[32679]: pgmap v381: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:17 smithi092 ceph-mon[29156]: pgmap v381: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:17 smithi189 ceph-mon[32756]: pgmap v381: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 665.0 s, 2394.3 tps, lat 173.067 ms stddev 1452.126 2024-04-26T18:11:18.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7f56086700 time 2024-04-26T18:11:18.587091+0000 2024-04-26T18:11:18.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:18.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7f606af3dd] 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: clone() 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: *** Caught signal (Aborted) ** 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: in thread 7f7f56086700 thread_name:ms_dispatch 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.588+0000 7f7f56086700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7f56086700 time 2024-04-26T18:11:18.587091+0000 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:18.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7f606af3dd] 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: clone() 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7f5f437d20] 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: gsignal() 2024-04-26T18:11:18.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: abort() 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7f606af437] 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 16: clone() 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.592+0000 7f7f56086700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: in thread 7f7f56086700 thread_name:ms_dispatch 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7f5f437d20] 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: gsignal() 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: abort() 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7f606af437] 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 16: clone() 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: -1> 2024-04-26T18:11:18.588+0000 7f7f56086700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7f56086700 time 2024-04-26T18:11:18.587091+0000 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7f606af3dd] 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: clone() 2024-04-26T18:11:18.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 0> 2024-04-26T18:11:18.592+0000 7f7f56086700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: in thread 7f7f56086700 thread_name:ms_dispatch 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7f5f437d20] 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: gsignal() 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: abort() 2024-04-26T18:11:18.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7f606af437] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.904 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 16: clone() 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: -1> 2024-04-26T18:11:18.588+0000 7f7f56086700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7f56086700 time 2024-04-26T18:11:18.587091+0000 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.905 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7f606af3dd] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: clone() 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 0> 2024-04-26T18:11:18.592+0000 7f7f56086700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: in thread 7f7f56086700 thread_name:ms_dispatch 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7f5f437d20] 2024-04-26T18:11:18.907 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2: gsignal() 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 3: abort() 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7f606af437] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7f606af5a3] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55e7a4de2822] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55e7a4d52598] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55e7a4d54c17] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55e7a4c4dd0b] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55e7a4c4e2ac] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55e7a4c36fad] 2024-04-26T18:11:18.908 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7f60943e20] 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 13: (DispatchQueue::entry()+0x51f) [0x7f7f60940fdf] 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7f60a13fc1] 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7f5f42d1ca] 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 16: clone() 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70221]: 2024-04-26T18:11:18.909 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:18 smithi189 podman[70439]: 2024-04-26 18:11:18.696788273 +0000 UTC m=+0.037167694 container died 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0) 2024-04-26T18:11:18.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:18 smithi156 podman[69382]: 2024-04-26 18:11:18.632310909 +0000 UTC m=+1.810523299 container remove 18fd5f9acb11b9648fc9697451dc6264a2cb0c76a54881892cba9c02f60806c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:11:18.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:18 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:11:19.423 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:19 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:11:19.423 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:19 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Consumed 1.186s CPU time. 2024-04-26T18:11:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:19 smithi156 ceph-mon[32679]: pgmap v382: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:19 smithi156 ceph-mon[32679]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T18:11:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:19 smithi092 ceph-mon[29156]: pgmap v382: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:19 smithi092 ceph-mon[29156]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T18:11:19.799 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:19 smithi189 ceph-mon[32756]: pgmap v382: 97 pgs: 97 active+clean; 3.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 4.9 MiB/s wr, 493 op/s 2024-04-26T18:11:19.800 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:19 smithi189 ceph-mon[32756]: osdmap e119: 12 total, 12 up, 12 in 2024-04-26T18:11:19.800 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:19 smithi189 podman[70439]: 2024-04-26 18:11:19.535449285 +0000 UTC m=+0.875828702 container remove 3b376b1a99829ebdfbac44fb7d25beefe4681b7a1978ecbd827087af348ba66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:11:19.800 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:19 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:11:20.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:19 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:11:20.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:19 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.411s CPU time. 2024-04-26T18:11:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:20 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:20 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:20 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:21 smithi092 ceph-mon[29156]: pgmap v384: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:21 smithi189 ceph-mon[32756]: pgmap v384: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:21 smithi156 ceph-mon[32679]: pgmap v384: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:23.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 670.0 s, 854.7 tps, lat 47.522 ms stddev 65.302 2024-04-26T18:11:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:23 smithi092 ceph-mon[29156]: pgmap v385: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:23 smithi189 ceph-mon[32756]: pgmap v385: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:23 smithi156 ceph-mon[32679]: pgmap v385: 97 pgs: 11 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 76 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 21 MiB/s wr, 1.53k op/s 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- 172.21.15.92:0/2561822714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28103300 msgr2=0x7fbf2810f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 --2- 172.21.15.92:0/2561822714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28103300 0x7fbf2810f810 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009cd0 tx=0x7fbf2002a8e0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- 172.21.15.92:0/2561822714 shutdown_connections 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 --2- 172.21.15.92:0/2561822714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28103300 0x7fbf2810f810 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 --2- 172.21.15.92:0/2561822714 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28102940 0x7fbf28102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 --2- 172.21.15.92:0/2561822714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28108950 0x7fbf28108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- 172.21.15.92:0/2561822714 >> 172.21.15.92:0/2561822714 conn(0x7fbf28079dc0 msgr2=0x7fbf2807a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- 172.21.15.92:0/2561822714 shutdown_connections 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- 172.21.15.92:0/2561822714 wait complete. 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 Processor -- start 2024-04-26T18:11:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.614+0000 7fbf2e989640 1 -- start start 2024-04-26T18:11:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 0x7fbf28199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28103300 0x7fbf281995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28112c10 con 0x7fbf28108950 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28112a90 con 0x7fbf28102940 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2e989640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28112d90 con 0x7fbf28103300 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33574/0 (socket says 172.21.15.92:33574) 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28103300 0x7fbf281995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 -- 172.21.15.92:0/1947479724 learned_addr learned my addr 172.21.15.92:0/1947479724 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 0x7fbf28199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 -- 172.21.15.92:0/1947479724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28103300 msgr2=0x7fbf281995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28103300 0x7fbf281995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 -- 172.21.15.92:0/1947479724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 msgr2=0x7fbf28199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 0x7fbf28199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 -- 172.21.15.92:0/1947479724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2819e060 con 0x7fbf28108950 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 0x7fbf28199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf2cf26640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbf20033040 tx=0x7fbf20003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.615+0000 7fbf257fa640 1 -- 172.21.15.92:0/1947479724 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20004040 con 0x7fbf28108950 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.616+0000 7fbf257fa640 1 -- 172.21.15.92:0/1947479724 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf20004690 con 0x7fbf28108950 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.616+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2819e2f0 con 0x7fbf28108950 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.616+0000 7fbf257fa640 1 -- 172.21.15.92:0/1947479724 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20030e20 con 0x7fbf28108950 2024-04-26T18:11:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.616+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf281a5be0 con 0x7fbf28108950 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf257fa640 1 -- 172.21.15.92:0/1947479724 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fbf200305a0 con 0x7fbf28108950 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 Processor -- start 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 -- start start 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc6760 0x557a29cd4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a29c2c460 con 0x557a29cc5e40 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557a29be6590 con 0x557a29cc6760 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf31779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a29c28420 con 0x557a29cd54f0 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf257fa640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 0x7fbf100a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33584/0 (socket says 172.21.15.92:33584) 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf277fe640 1 -- 172.21.15.92:0/3941640077 learned_addr learned my addr 172.21.15.92:0/3941640077 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf2cf26640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 0x7fbf100a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf277fe640 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf27fff640 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc6760 0x557a29cd4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.618+0000 7fbf257fa640 1 -- 172.21.15.92:0/1947479724 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9917+0+0 (secure 0 0 0) 0x7fbf2002e030 con 0x7fbf28108950 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 -- 172.21.15.92:0/3941640077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 msgr2=0x557a29cd78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 -- 172.21.15.92:0/3941640077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc6760 msgr2=0x557a29cd4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc6760 0x557a29cd4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 -- 172.21.15.92:0/3941640077 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a29bf30d0 con 0x557a29cc5e40 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf277fe640 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800af60 tx=0x7fbf1800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52df7ab95067c1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf2cf26640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 0x7fbf100a6280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf200bde90 tx=0x7fbf200ba2d0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf0e7fc640 1 -- 172.21.15.92:0/3941640077 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18019030 con 0x557a29cc5e40 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf0e7fc640 1 -- 172.21.15.92:0/3941640077 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf180110d0 con 0x557a29cc5e40 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.619+0000 7fbf0e7fc640 1 -- 172.21.15.92:0/3941640077 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18004bc0 con 0x557a29cc5e40 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- 172.21.15.92:0/3941640077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 msgr2=0x557a29cc6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800af60 tx=0x7fbf1800a780 comp rx=0 tx=0).stop 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- 172.21.15.92:0/3941640077 shutdown_connections 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc6760 0x557a29cd4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- 172.21.15.92:0/3941640077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cc6220 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- 172.21.15.92:0/3941640077 >> 172.21.15.92:0/3941640077 conn(0x557a29cc2410 msgr2=0x557a29cc27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- 172.21.15.92:0/3941640077 shutdown_connections 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- 172.21.15.92:0/3941640077 wait complete. 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- start start 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 Processor -- start 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cc6760 0x557a29cd2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cd54f0 0x557a29cd2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a29cd80c0 con 0x557a29cc5e40 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x557a29bb3b60 con 0x557a29cd54f0 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a29cd8240 con 0x557a29cc6760 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.620+0000 7fbf31779740 10 client.0 _ll_register_callbacks cb 0x557a29bd82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33600/0 (socket says 172.21.15.92:33600) 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 -- 172.21.15.92:0/2296096663 learned_addr learned my addr 172.21.15.92:0/2296096663 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf27fff640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cc6760 0x557a29cd2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cd54f0 0x557a29cd2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 -- 172.21.15.92:0/2296096663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cc6760 msgr2=0x557a29cd2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cc6760 0x557a29cd2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 -- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cd54f0 msgr2=0x557a29cd2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cd54f0 0x557a29cd2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 -- 172.21.15.92:0/2296096663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a2993e210 con 0x557a29cc5e40 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf277fe640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbf18004fc0 tx=0x7fbf1800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a5e072dbcec288 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf18019040 con 0x557a29cc5e40 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf180110d0 con 0x557a29cc5e40 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9917+0+0 (secure 0 0 0) 0x7fbf18005200 con 0x557a29cc5e40 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fbf18031050 con 0x557a29cc5e40 2024-04-26T18:11:25.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf31779740 10 client.16314 fetch_fsmap learned FSMap version 152 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.621+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=4+}) -- 0x557a29a0a620 con 0x557a29cc5e40 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf180110d0 con 0x557a29cc5e40 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 152) ==== 7132+0+0 (secure 0 0 0) 0x7fbf1801e460 con 0x557a29cc5e40 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 10 client.16314 fetch_fsmap finished waiting for FSMap version 152 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 20 client.16314 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29ce5740 0x557a29ce7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 4 client.16314 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a29c3a070 con 0x557a29ce5740 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf27fff640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29ce5740 0x557a29ce7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf27fff640 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29ce5740 0x557a29ce7b80 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c5fc93c37d280f server_cookie=eb108660678dfca6 in_seq=0 out_seq=0 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.622+0000 7fbf077fe640 10 client.16314 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:25.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf077fe640 1 -- 172.21.15.92:0/2296096663 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557a29c3a070 con 0x557a29ce5740 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf077fe640 10 client.16314 handle_command_reply: tid=0 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 client.16314 shutdown 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 msgr2=0x557a29cd2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbf18004fc0 tx=0x7fbf1800af90 comp rx=0 tx=0).stop 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 shutdown_connections 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29ce5740 0x557a29ce7b80 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cd54f0 0x557a29cd2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf077fe640 0 client.16314 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cc6760 0x557a29cd2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 --2- 172.21.15.92:0/2296096663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc5e40 0x557a29cd2400 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 >> 172.21.15.92:0/2296096663 conn(0x557a29cc2410 msgr2=0x557a29cc8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 shutdown_connections 2024-04-26T18:11:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.623+0000 7fbf31779740 1 -- 172.21.15.92:0/2296096663 wait complete. 2024-04-26T18:11:25.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.624+0000 7fbf31779740 20 client.16314 trim_cache size 0 max 16384 2024-04-26T18:11:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 Processor -- start 2024-04-26T18:11:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 -- start start 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cc1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281ada80 con 0x557a29cc6760 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281ae150 con 0x557a29cc5e40 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf31779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281ae820 con 0x557a29cd54f0 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33614/0 (socket says 172.21.15.92:33614) 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf27fff640 1 -- 172.21.15.92:0/1128281657 learned_addr learned my addr 172.21.15.92:0/1128281657 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cc1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.638+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 -- 172.21.15.92:0/1128281657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 msgr2=0x557a29cd2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 -- 172.21.15.92:0/1128281657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 msgr2=0x557a29cc1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cc1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 -- 172.21.15.92:0/1128281657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a29c283b0 con 0x557a29cc6760 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x557a29cd39d0 tx=0x7fbf1c005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afee4b9bcb9a91c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf0dffb640 1 -- 172.21.15.92:0/1128281657 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c014ac0 con 0x557a29cc6760 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf0dffb640 1 -- 172.21.15.92:0/1128281657 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf1c021070 con 0x557a29cc6760 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.639+0000 7fbf0dffb640 1 -- 172.21.15.92:0/1128281657 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c01b800 con 0x557a29cc6760 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- 172.21.15.92:0/1128281657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 msgr2=0x557a29ce0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x557a29cd39d0 tx=0x7fbf1c005d10 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- 172.21.15.92:0/1128281657 shutdown_connections 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29cd2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ce0ff0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- 172.21.15.92:0/1128281657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cc1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- 172.21.15.92:0/1128281657 >> 172.21.15.92:0/1128281657 conn(0x557a29cc2410 msgr2=0x557a29cd23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- 172.21.15.92:0/1128281657 shutdown_connections 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- 172.21.15.92:0/1128281657 wait complete. 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- start start 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 Processor -- start 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cdd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29ccf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281aad80 con 0x557a29cc6760 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281ac170 con 0x557a29cc5e40 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281ab3d0 con 0x557a29cd54f0 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.640+0000 7fbf31779740 10 client.0 _ll_register_callbacks cb 0x7fbf18013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33628/0 (socket says 172.21.15.92:33628) 2024-04-26T18:11:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 -- 172.21.15.92:0/1401388608 learned_addr learned my addr 172.21.15.92:0/1401388608 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cdd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29ccf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 -- 172.21.15.92:0/1401388608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 msgr2=0x557a29ccf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29ccf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 -- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 msgr2=0x557a29cdd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cdd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 -- 172.21.15.92:0/1401388608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a29ccf650 con 0x557a29cc6760 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf27fff640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0057a0 tx=0x7fbf1c01b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e31b6d24aed4308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf077fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c029070 con 0x557a29cc6760 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9917+0+0 (secure 0 0 0) 0x7fbf1c004030 con 0x557a29cc6760 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf1c021070 con 0x557a29cc6760 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fbf1c035050 con 0x557a29cc6760 2024-04-26T18:11:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf31779740 10 client.16320 fetch_fsmap learned FSMap version 152 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=152,monmap=4+}) -- 0x557a29d4b990 con 0x557a29cc6760 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.641+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf1c021070 con 0x557a29cc6760 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 152) ==== 7132+0+0 (secure 0 0 0) 0x7fbf1c003680 con 0x557a29cc6760 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 10 client.16320 fetch_fsmap finished waiting for FSMap version 152 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 10 client.16320 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 20 client.16320 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29d4c020 0x557a29d4e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 4 client.16320 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a29c33ee0 con 0x557a29d4c020 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29d4c020 0x557a29d4e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf277fe640 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29d4c020 0x557a29d4e440 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ded41486f17709 server_cookie=9fd6284bca88f977 in_seq=0 out_seq=0 2024-04-26T18:11:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:25.642+0000 7fbf077fe640 10 client.16320 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:25 smithi092 ceph-mon[29156]: pgmap v386: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-26T18:11:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:25 smithi092 ceph-mon[29156]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T18:11:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:25 smithi189 ceph-mon[32756]: pgmap v386: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-26T18:11:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:25 smithi189 ceph-mon[32756]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T18:11:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:25 smithi156 ceph-mon[32679]: pgmap v386: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 21 MiB/s wr, 1.48k op/s 2024-04-26T18:11:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:25 smithi156 ceph-mon[32679]: osdmap e120: 12 total, 12 up, 12 in 2024-04-26T18:11:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:27 smithi092 ceph-mon[29156]: pgmap v388: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 24 MiB/s wr, 1.59k op/s 2024-04-26T18:11:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:27 smithi189 ceph-mon[32756]: pgmap v388: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 24 MiB/s wr, 1.59k op/s 2024-04-26T18:11:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:27 smithi156 ceph-mon[32679]: pgmap v388: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 24 MiB/s wr, 1.59k op/s 2024-04-26T18:11:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:29.451 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:11:29.451 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:29.451 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Consumed 1.186s CPU time. 2024-04-26T18:11:29.452 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:11:29.452 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 podman[69478]: 2024-04-26 18:11:29.31550544 +0000 UTC m=+0.018067418 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:11:29.452 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 podman[69478]: 2024-04-26 18:11:29.432956673 +0000 UTC m=+0.135518680 container create 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:11:29.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:29 smithi156 ceph-mon[32679]: pgmap v389: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2024-04-26T18:11:29.734 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 podman[69478]: 2024-04-26 18:11:29.693982457 +0000 UTC m=+0.396544429 container init 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T18:11:29.735 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 podman[69478]: 2024-04-26 18:11:29.698032629 +0000 UTC m=+0.400594606 container start 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T18:11:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:29 smithi092 ceph-mon[29156]: pgmap v389: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2024-04-26T18:11:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:29 smithi189 ceph-mon[32756]: pgmap v389: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 19 MiB/s wr, 1.28k op/s 2024-04-26T18:11:30.185 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 ceph-mds[69496]: -- 172.21.15.156:0/3186602861 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1ca897a40 con 0x55c1ca86a800 2024-04-26T18:11:30.185 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: starting mds.h at 2024-04-26T18:11:30.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 bash[69478]: 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda 2024-04-26T18:11:30.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:11:29 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:30.250 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:29 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:11:30.250 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:29 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:30.250 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:29 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.411s CPU time. 2024-04-26T18:11:30.251 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:29 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:11:30.251 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 podman[70530]: 2024-04-26 18:11:30.020089857 +0000 UTC m=+0.018450986 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:11:30.251 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 podman[70530]: 2024-04-26 18:11:30.136912515 +0000 UTC m=+0.135273646 container create 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: daemon mds.h restarted 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:boot 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: daemon mds.c restarted 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:resolve 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:boot 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 podman[70530]: 2024-04-26 18:11:30.364825914 +0000 UTC m=+0.363187046 container init 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 podman[70530]: 2024-04-26 18:11:30.367423598 +0000 UTC m=+0.365784729 container start 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-mds[70549]: -- 172.21.15.189:0/1232133823 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566f3461a40 con 0x5566f3434800 2024-04-26T18:11:30.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: starting mds.c at 2024-04-26T18:11:30.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 bash[70530]: 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e 2024-04-26T18:11:30.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:11:30 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: daemon mds.h restarted 2024-04-26T18:11:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:boot 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: daemon mds.c restarted 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:resolve 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:boot 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:11:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: daemon mds.h restarted 2024-04-26T18:11:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: osdmap e121: 12 total, 12 up, 12 in 2024-04-26T18:11:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:boot 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: daemon mds.c restarted 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: osdmap e122: 12 total, 12 up, 12 in 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:resolve 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:boot 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: Standby daemon mds.k assigned to filesystem cephfs as rank 2 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:11:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:31 smithi092 ceph-mon[29156]: pgmap v391: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-04-26T18:11:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:31 smithi189 ceph-mon[32756]: pgmap v391: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-04-26T18:11:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:31 smithi156 ceph-mon[32679]: pgmap v391: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.8 MiB/s wr, 298 op/s 2024-04-26T18:11:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:32 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:resolve 2024-04-26T18:11:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:32 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:32 smithi189 ceph-mon[32756]: pgmap v393: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 576 KiB/s wr, 76 op/s 2024-04-26T18:11:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:32 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:resolve 2024-04-26T18:11:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:32 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:32 smithi156 ceph-mon[32679]: pgmap v393: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 576 KiB/s wr, 76 op/s 2024-04-26T18:11:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:32 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:resolve 2024-04-26T18:11:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:32 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=k=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:32 smithi092 ceph-mon[29156]: pgmap v393: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 576 KiB/s wr, 76 op/s 2024-04-26T18:11:33.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 680.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf077fe640 1 -- 172.21.15.92:0/1401388608 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a29c33ee0 con 0x557a29d4c020 2024-04-26T18:11:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf077fe640 10 client.16320 handle_command_reply: tid=0 2024-04-26T18:11:33.784 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 client.16320 shutdown 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 msgr2=0x557a29ccebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c0057a0 tx=0x7fbf1c01b490 comp rx=0 tx=0).stop 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 shutdown_connections 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x557a29d4c020 0x557a29d4e440 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a29cd54f0 0x557a29ccf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a29cc6760 0x557a29ccebd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 --2- 172.21.15.92:0/1401388608 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557a29cc5e40 0x557a29cdd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf077fe640 0 client.16320 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.783+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 >> 172.21.15.92:0/1401388608 conn(0x557a29cc2410 msgr2=0x557a29cc8120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 shutdown_connections 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf31779740 1 -- 172.21.15.92:0/1401388608 wait complete. 2024-04-26T18:11:33.785 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf31779740 20 client.16320 trim_cache size 0 max 16384 2024-04-26T18:11:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:11:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:11:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:11:33.786 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 msgr2=0x7fbf100a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 0x7fbf100a6280 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf200bde90 tx=0x7fbf200ba2d0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 msgr2=0x7fbf2819d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbf20033040 tx=0x7fbf20003970 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 shutdown_connections 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fbf100a3dc0 0x7fbf100a6280 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf28108950 0x7fbf2819d930 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf28103300 0x7fbf281995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 --2- 172.21.15.92:0/1947479724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf28102940 0x7fbf28199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 >> 172.21.15.92:0/1947479724 conn(0x7fbf28079dc0 msgr2=0x7fbf28100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:33.787 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.784+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 shutdown_connections 2024-04-26T18:11:33.788 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:33.785+0000 7fbf2e989640 1 -- 172.21.15.92:0/1947479724 wait complete. 2024-04-26T18:11:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:11:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:reconnect 2024-04-26T18:11:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:reconnect 2024-04-26T18:11:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:33 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.0109998 2024-04-26T18:11:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:11:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:reconnect 2024-04-26T18:11:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:reconnect 2024-04-26T18:11:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:33 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.0109998 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199996 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:reconnect 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:reconnect 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=k=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:33 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.0109998 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:rejoin 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:rejoin 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: pgmap v394: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 929 KiB/s wr, 123 op/s 2024-04-26T18:11:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:active 2024-04-26T18:11:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:active 2024-04-26T18:11:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:34 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:rejoin 2024-04-26T18:11:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:rejoin 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: pgmap v394: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 929 KiB/s wr, 123 op/s 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:active 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:active 2024-04-26T18:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:34 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:rejoin 2024-04-26T18:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:rejoin 2024-04-26T18:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=k=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 2 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: pgmap v394: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 929 KiB/s wr, 123 op/s 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1881516485,v1:172.21.15.156:6833/1881516485] up:active 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/2591222329,v1:172.21.15.189:6835/2591222329] up:active 2024-04-26T18:11:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:34 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:37 smithi156 ceph-mon[32679]: pgmap v395: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:11:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:37 smithi092 ceph-mon[29156]: pgmap v395: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:11:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:37 smithi189 ceph-mon[32756]: pgmap v395: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 141 op/s 2024-04-26T18:11:38.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 685.0 s, 1902.3 tps, lat 189.131 ms stddev 1476.758 2024-04-26T18:11:38.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:11:38 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:11:38.490+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:11:38.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:11:38 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:11:38.490+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:11:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-mon[32679]: pgmap v396: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 476 KiB/s wr, 63 op/s 2024-04-26T18:11:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:39 smithi092 ceph-mon[29156]: pgmap v396: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 476 KiB/s wr, 63 op/s 2024-04-26T18:11:39.833 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-mon[32756]: pgmap v396: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 476 KiB/s wr, 63 op/s 2024-04-26T18:11:40.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f75aafe5700 time 2024-04-26T18:11:39.744347+0000 2024-04-26T18:11:40.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.127 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75b560e3dd] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: clone() 2024-04-26T18:11:40.128 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:39.745+0000 7f75aafe5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f75aafe5700 time 2024-04-26T18:11:39.744347+0000 2024-04-26T18:11:40.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75b560e3dd] 2024-04-26T18:11:40.129 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.130 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: clone() 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: *** Caught signal (Aborted) ** 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: in thread 7f75aafe5700 thread_name:ms_dispatch 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75b4396d20] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: gsignal() 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: abort() 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75b560e437] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.131 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 16: clone() 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:39.746+0000 7f75aafe5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: in thread 7f75aafe5700 thread_name:ms_dispatch 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75b4396d20] 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: gsignal() 2024-04-26T18:11:40.132 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: abort() 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75b560e437] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 16: clone() 2024-04-26T18:11:40.133 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: -1> 2024-04-26T18:11:39.745+0000 7f75aafe5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f75aafe5700 time 2024-04-26T18:11:39.744347+0000 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75b560e3dd] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.134 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: clone() 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 0> 2024-04-26T18:11:39.746+0000 7f75aafe5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: in thread 7f75aafe5700 thread_name:ms_dispatch 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.135 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75b4396d20] 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: gsignal() 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: abort() 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75b560e437] 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.136 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 16: clone() 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.137 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: -1> 2024-04-26T18:11:39.745+0000 7f75aafe5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f75aafe5700 time 2024-04-26T18:11:39.744347+0000 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f75b560e3dd] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.138 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: clone() 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 0> 2024-04-26T18:11:39.746+0000 7f75aafe5700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: in thread 7f75aafe5700 thread_name:ms_dispatch 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f75b4396d20] 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2: gsignal() 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 3: abort() 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f75b560e437] 2024-04-26T18:11:40.139 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f75b560e5a3] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55d6eb2fe822] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55d6eb26e598] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55d6eb270c17] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55d6eb169d0b] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55d6eb16a2ac] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55d6eb152fad] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f75b58a2e20] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 13: (DispatchQueue::entry()+0x51f) [0x7f75b589ffdf] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f75b5972fc1] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f75b438c1ca] 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 16: clone() 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.140 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69342]: 2024-04-26T18:11:40.141 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:39 smithi156 podman[69536]: 2024-04-26 18:11:39.807629325 +0000 UTC m=+0.020146935 container died 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f292ebed700 time 2024-04-26T18:11:39.834213+0000 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f29392163dd] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: clone() 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:39.834+0000 7f292ebed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f292ebed700 time 2024-04-26T18:11:39.834213+0000 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f29392163dd] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: clone() 2024-04-26T18:11:40.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: *** Caught signal (Aborted) ** 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: in thread 7f292ebed700 thread_name:ms_dispatch 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2937f9ed20] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: gsignal() 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: abort() 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2939216437] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 16: clone() 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:39.836+0000 7f292ebed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: in thread 7f292ebed700 thread_name:ms_dispatch 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2937f9ed20] 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: gsignal() 2024-04-26T18:11:40.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: abort() 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2939216437] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 16: clone() 2024-04-26T18:11:40.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: -1> 2024-04-26T18:11:39.834+0000 7f292ebed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f292ebed700 time 2024-04-26T18:11:39.834213+0000 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f29392163dd] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: clone() 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 0> 2024-04-26T18:11:39.836+0000 7f292ebed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: in thread 7f292ebed700 thread_name:ms_dispatch 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2937f9ed20] 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: gsignal() 2024-04-26T18:11:40.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: abort() 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2939216437] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 16: clone() 2024-04-26T18:11:40.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: -1> 2024-04-26T18:11:39.834+0000 7f292ebed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f292ebed700 time 2024-04-26T18:11:39.834213+0000 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f29392163dd] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.151 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: clone() 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 0> 2024-04-26T18:11:39.836+0000 7f292ebed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: in thread 7f292ebed700 thread_name:ms_dispatch 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2937f9ed20] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2: gsignal() 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 3: abort() 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2939216437] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f29392165a3] 2024-04-26T18:11:40.152 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562da417b822] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562da40eb598] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562da40edc17] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562da3fe6d0b] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562da3fe72ac] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562da3fcffad] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f29394aae20] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 13: (DispatchQueue::entry()+0x51f) [0x7f29394a7fdf] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f293957afc1] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2937f941ca] 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 16: clone() 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70228]: 2024-04-26T18:11:40.153 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:39 smithi189 podman[70598]: 2024-04-26 18:11:39.902771389 +0000 UTC m=+0.019619061 container died cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T18:11:40.914 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:40 smithi189 podman[70598]: 2024-04-26 18:11:40.648535227 +0000 UTC m=+0.765382893 container remove cd014ce56ae4bb80b0487ca35d1550a6ada988ea87774965f84b60cd72ccc7d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-26T18:11:40.914 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:40 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:11:41.011 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:40 smithi156 podman[69536]: 2024-04-26 18:11:40.733997304 +0000 UTC m=+0.946514952 container remove 69605545559f80f504287c7dadb2c79dadf1477942922d3d1c861f882ea3f8ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:11:41.011 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:40 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:11:41.387 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:40 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:11:41.387 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:40 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.010s CPU time. 2024-04-26T18:11:41.432 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:41 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:11:41.432 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:41 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.285s CPU time. 2024-04-26T18:11:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:41 smithi156 ceph-mon[32679]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-04-26T18:11:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:41 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:41 smithi092 ceph-mon[29156]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-04-26T18:11:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:41 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:41.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:41 smithi189 ceph-mon[32756]: pgmap v397: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-04-26T18:11:41.762 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:41 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=k=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:43.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 690.0 s, 1032.6 tps, lat 37.807 ms stddev 45.262 2024-04-26T18:11:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:43 smithi092 ceph-mon[29156]: pgmap v398: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-04-26T18:11:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:43 smithi189 ceph-mon[32756]: pgmap v398: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-04-26T18:11:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:43 smithi156 ceph-mon[32679]: pgmap v398: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 5.4 MiB/s wr, 319 op/s 2024-04-26T18:11:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:45 smithi092 ceph-mon[29156]: pgmap v399: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 7.8 MiB/s wr, 497 op/s 2024-04-26T18:11:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:45 smithi189 ceph-mon[32756]: pgmap v399: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 7.8 MiB/s wr, 497 op/s 2024-04-26T18:11:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:45 smithi156 ceph-mon[32679]: pgmap v399: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 7.8 MiB/s wr, 497 op/s 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 -- 172.21.15.92:0/446108892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0078101a50 msgr2=0x7f00781075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 --2- 172.21.15.92:0/446108892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0078101a50 0x7f00781075e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0068009900 tx=0x7f006802a410 comp rx=0 tx=0).stop 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 -- 172.21.15.92:0/446108892 shutdown_connections 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 --2- 172.21.15.92:0/446108892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 0x7f007810f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 --2- 172.21.15.92:0/446108892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0078101a50 0x7f00781075e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 --2- 172.21.15.92:0/446108892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f00781010a0 0x7f0078101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 -- 172.21.15.92:0/446108892 >> 172.21.15.92:0/446108892 conn(0x7f0078077d90 msgr2=0x7f00780ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 -- 172.21.15.92:0/446108892 shutdown_connections 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.878+0000 7f007f5c6640 1 -- 172.21.15.92:0/446108892 wait complete. 2024-04-26T18:11:46.881 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 Processor -- start 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 -- start start 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 0x7f0078199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f007819d9e0 0x7f007819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0078112c20 con 0x7f00781010a0 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f0078112aa0 con 0x7f0078107d10 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007f5c6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0078112da0 con 0x7f007819d9e0 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49632/0 (socket says 172.21.15.92:49632) 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 -- 172.21.15.92:0/2782500305 learned_addr learned my addr 172.21.15.92:0/2782500305 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007cb61640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 0x7f0078199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007db63640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f007819d9e0 0x7f007819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 -- 172.21.15.92:0/2782500305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f007819d9e0 msgr2=0x7f007819de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f007819d9e0 0x7f007819de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 -- 172.21.15.92:0/2782500305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 msgr2=0x7f0078199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 0x7f0078199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.879+0000 7f007d362640 1 -- 172.21.15.92:0/2782500305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007819e4d0 con 0x7f00781010a0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f007d362640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f007400c890 tx=0x7f007400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f006e7fc640 1 -- 172.21.15.92:0/2782500305 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004220 con 0x7f00781010a0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007819e7c0 con 0x7f00781010a0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f006e7fc640 1 -- 172.21.15.92:0/2782500305 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00740043c0 con 0x7f00781010a0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f006e7fc640 1 -- 172.21.15.92:0/2782500305 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004a00 con 0x7f00781010a0 2024-04-26T18:11:46.883 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.880+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00781a5fd0 con 0x7f00781010a0 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.882+0000 7f006e7fc640 1 -- 172.21.15.92:0/2782500305 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f00740079b0 con 0x7f00781010a0 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.882+0000 7f00823bf740 1 Processor -- start 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 -- start start 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f6a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5ed0460 con 0x55dbd5f6a820 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5e8a590 con 0x55dbd5f69f00 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f00823bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5ecc420 con 0x55dbd5f750e0 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f006e7fc640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 0x7f00640a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49636/0 (socket says 172.21.15.92:49636) 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 -- 172.21.15.92:0/2288012797 learned_addr learned my addr 172.21.15.92:0/2288012797 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007db63640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f6a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007cb61640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007db63640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 0x7f00640a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f006e7fc640 1 -- 172.21.15.92:0/2782500305 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 10045+0+0 (secure 0 0 0) 0x7f00740d0b40 con 0x7f00781010a0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 -- 172.21.15.92:0/2288012797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 msgr2=0x55dbd5f774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 -- 172.21.15.92:0/2288012797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 msgr2=0x55dbd5f6a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f6a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 -- 172.21.15.92:0/2288012797 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd5e970d0 con 0x55dbd5f6a820 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007db63640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f6a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007d362640 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f00740058c0 tx=0x7f0074000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70688207f8f67f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.883+0000 7f007db63640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 0x7f00640a6280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0070009370 tx=0x7f0070009240 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00637fe640 1 -- 172.21.15.92:0/2288012797 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007401d050 con 0x55dbd5f6a820 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00637fe640 1 -- 172.21.15.92:0/2288012797 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f007409cbf0 con 0x55dbd5f6a820 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00637fe640 1 -- 172.21.15.92:0/2288012797 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740cdf20 con 0x55dbd5f6a820 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 -- 172.21.15.92:0/2288012797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 msgr2=0x55dbd5f74ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f00740058c0 tx=0x7f0074000bc0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 -- 172.21.15.92:0/2288012797 shutdown_connections 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f74ba0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 --2- 172.21.15.92:0/2288012797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f6a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 -- 172.21.15.92:0/2288012797 >> 172.21.15.92:0/2288012797 conn(0x55dbd5f66410 msgr2=0x55dbd5f667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 -- 172.21.15.92:0/2288012797 shutdown_connections 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.884+0000 7f00823bf740 1 -- 172.21.15.92:0/2288012797 wait complete. 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 -- start start 2024-04-26T18:11:46.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 Processor -- start 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f72120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f6a820 0x55dbd5f72660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5f77cb0 con 0x55dbd5f750e0 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5e57b60 con 0x55dbd5f6a820 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55dbd5f77e30 con 0x55dbd5f69f00 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f00823bf740 10 client.0 _ll_register_callbacks cb 0x55dbd5e7c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f007db63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f007db63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49650/0 (socket says 172.21.15.92:49650) 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f007db63640 1 -- 172.21.15.92:0/707519243 learned_addr learned my addr 172.21.15.92:0/707519243 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.885+0000 7f007d362640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f72120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007cb61640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f6a820 0x55dbd5f72660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.893 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 -- 172.21.15.92:0/707519243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 msgr2=0x55dbd5f72120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f72120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 -- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f6a820 msgr2=0x55dbd5f72660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f6a820 0x55dbd5f72660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 -- 172.21.15.92:0/707519243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd5be2210 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f007db63640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0070003ba0 tx=0x7f0070004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2462ac4d03383e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f0060ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070026030 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 10045+0+0 (secure 0 0 0) 0x7f0070004b20 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f007409cbf0 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f0070030050 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f00823bf740 10 client.16341 fetch_fsmap learned FSMap version 161 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=4+}) -- 0x55dbd5cae620 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.886+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f007409cbf0 con 0x55dbd5f750e0 2024-04-26T18:11:46.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 161) ==== 7132+0+0 (secure 0 0 0) 0x7f0070005700 con 0x55dbd5f750e0 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 10 client.16341 fetch_fsmap finished waiting for FSMap version 161 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 10 client.16341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 20 client.16341 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5f85330 0x55dbd5f87720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 4 client.16341 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbd5ede070 con 0x55dbd5f85330 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f007d362640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5f85330 0x55dbd5f87720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f007d362640 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5f85330 0x55dbd5f87720 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47003de7a5c0aad8 server_cookie=75c5bd7b3b20b940 in_seq=0 out_seq=0 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.887+0000 7f0060ff9640 10 client.16341 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f0060ff9640 1 -- 172.21.15.92:0/707519243 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dbd5ede070 con 0x55dbd5f85330 2024-04-26T18:11:46.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f0060ff9640 10 client.16341 handle_command_reply: tid=0 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 client.16341 shutdown 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 msgr2=0x55dbd5f72ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0070003ba0 tx=0x7f0070004a40 comp rx=0 tx=0).stop 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 shutdown_connections 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5f85330 0x55dbd5f87720 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f750e0 0x55dbd5f72ba0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f0060ff9640 0 client.16341 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f6a820 0x55dbd5f72660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 --2- 172.21.15.92:0/707519243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f72120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 >> 172.21.15.92:0/707519243 conn(0x55dbd5f66410 msgr2=0x55dbd5f6c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 shutdown_connections 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 1 -- 172.21.15.92:0/707519243 wait complete. 2024-04-26T18:11:46.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.888+0000 7f00823bf740 20 client.16341 trim_cache size 0 max 16384 2024-04-26T18:11:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.903+0000 7f00823bf740 1 Processor -- start 2024-04-26T18:11:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.903+0000 7f00823bf740 1 -- start start 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f80b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f74060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00781afe90 con 0x55dbd5f6a820 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f00781b0560 con 0x55dbd5f69f00 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f00823bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00781b0c60 con 0x55dbd5f750e0 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49658/0 (socket says 172.21.15.92:49658) 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 -- 172.21.15.92:0/2265574566 learned_addr learned my addr 172.21.15.92:0/2265574566 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007db63640 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f74060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007d362640 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f80b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 -- 172.21.15.92:0/2265574566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 msgr2=0x55dbd5f74060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f74060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 -- 172.21.15.92:0/2265574566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 msgr2=0x55dbd5f80b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f80b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 -- 172.21.15.92:0/2265574566 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd5f6a640 con 0x55dbd5f6a820 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f007cb61640 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0068009900 tx=0x7f0068000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee1c843b6c2873d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f0062ffd640 1 -- 172.21.15.92:0/2265574566 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068035040 con 0x55dbd5f6a820 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f0062ffd640 1 -- 172.21.15.92:0/2265574566 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0068031dd0 con 0x55dbd5f6a820 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.904+0000 7f0062ffd640 1 -- 172.21.15.92:0/2265574566 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00680053e0 con 0x55dbd5f6a820 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- 172.21.15.92:0/2265574566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 msgr2=0x55dbd5f6c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0068009900 tx=0x7f0068000bc0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- 172.21.15.92:0/2265574566 shutdown_connections 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f750e0 0x55dbd5f74060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f6c910 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 --2- 172.21.15.92:0/2265574566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f69f00 0x55dbd5f80b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- 172.21.15.92:0/2265574566 >> 172.21.15.92:0/2265574566 conn(0x55dbd5f66410 msgr2=0x55dbd5f73950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- 172.21.15.92:0/2265574566 shutdown_connections 2024-04-26T18:11:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- 172.21.15.92:0/2265574566 wait complete. 2024-04-26T18:11:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 -- start start 2024-04-26T18:11:46.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.905+0000 7f00823bf740 1 Processor -- start 2024-04-26T18:11:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f78a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f750e0 0x55dbd5f794c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ad1f0 con 0x55dbd5f6a820 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ae580 con 0x55dbd5f750e0 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00781ad840 con 0x55dbd5f69f00 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 10 client.0 _ll_register_callbacks cb 0x7f0070014500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49670/0 (socket says 172.21.15.92:49670) 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 -- 172.21.15.92:0/688973023 learned_addr learned my addr 172.21.15.92:0/688973023 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007db63640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f750e0 0x55dbd5f794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007d362640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f78a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 -- 172.21.15.92:0/688973023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 msgr2=0x55dbd5f78a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f78a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 -- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f750e0 msgr2=0x55dbd5f794c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f750e0 0x55dbd5f794c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 -- 172.21.15.92:0/688973023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd5fea8a0 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f007cb61640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f006802a450 tx=0x7f00680316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dce625b9a26154 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f0060ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068035050 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0068031dd0 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.906+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 10045+0+0 (secure 0 0 0) 0x7f0068005330 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=161) ==== 24+0+0 (secure 0 0 0) 0x7f0068058050 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 10 client.16347 fetch_fsmap learned FSMap version 161 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=161,monmap=4+}) -- 0x55dbd5febaf0 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0068031dd0 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 161) ==== 7132+0+0 (secure 0 0 0) 0x7f006803c560 con 0x55dbd5f6a820 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 10 client.16347 fetch_fsmap finished waiting for FSMap version 161 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 10 client.16347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:11:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 20 client.16347 populate_metadata read hostname 'smithi092' 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5fec1a0 0x55dbd5fee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 4 client.16347 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbd5ed7ee0 con 0x55dbd5fec1a0 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.907+0000 7f007d362640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5fec1a0 0x55dbd5fee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.908+0000 7f0060ff9640 10 client.16347 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:46.908+0000 7f007d362640 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5fec1a0 0x55dbd5fee5c0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d456e38857900941 server_cookie=3dfd95a9aee40407 in_seq=0 out_seq=0 2024-04-26T18:11:47.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:47 smithi156 ceph-mon[32679]: pgmap v400: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-04-26T18:11:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:47 smithi092 ceph-mon[29156]: pgmap v400: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-04-26T18:11:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:47 smithi189 ceph-mon[32756]: pgmap v400: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-04-26T18:11:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 695.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:49 smithi092 ceph-mon[29156]: pgmap v401: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 8.1 MiB/s wr, 531 op/s 2024-04-26T18:11:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:49 smithi189 ceph-mon[32756]: pgmap v401: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 8.1 MiB/s wr, 531 op/s 2024-04-26T18:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:49 smithi156 ceph-mon[32679]: pgmap v401: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 717 KiB/s rd, 8.1 MiB/s wr, 531 op/s 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Consumed 1.285s CPU time. 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 podman[69632]: 2024-04-26 18:11:51.322669029 +0000 UTC m=+0.018142900 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:11:51.443 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 podman[69632]: 2024-04-26 18:11:51.443550112 +0000 UTC m=+0.139024029 container create ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-26T18:11:51.451 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:11:51.451 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:51.451 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.010s CPU time. 2024-04-26T18:11:51.451 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:11:51.452 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 podman[70693]: 2024-04-26 18:11:51.273415418 +0000 UTC m=+0.018743461 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:11:51.452 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 podman[70693]: 2024-04-26 18:11:51.383346897 +0000 UTC m=+0.128674934 container create c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T18:11:51.702 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:51 smithi189 ceph-mon[32756]: pgmap v402: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 8.3 MiB/s wr, 557 op/s 2024-04-26T18:11:51.702 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 podman[70693]: 2024-04-26 18:11:51.611063645 +0000 UTC m=+0.356391682 container init c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-26T18:11:51.702 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 podman[70693]: 2024-04-26 18:11:51.61353604 +0000 UTC m=+0.358864075 container start c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T18:11:51.702 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 ceph-mds[70712]: -- 172.21.15.189:0/2190555733 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55670bd45a40 con 0x55670bd19000 2024-04-26T18:11:51.702 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: starting mds.l at 2024-04-26T18:11:51.703 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 bash[70693]: c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e 2024-04-26T18:11:51.703 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:51 smithi156 ceph-mon[32679]: pgmap v402: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 8.3 MiB/s wr, 557 op/s 2024-04-26T18:11:51.703 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 podman[69632]: 2024-04-26 18:11:51.679468219 +0000 UTC m=+0.374942077 container init ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-26T18:11:51.703 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 podman[69632]: 2024-04-26 18:11:51.682099702 +0000 UTC m=+0.377573560 container start ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-04-26T18:11:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:51 smithi092 ceph-mon[29156]: pgmap v402: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 8.3 MiB/s wr, 557 op/s 2024-04-26T18:11:52.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:11:51 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:52.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 ceph-mds[69650]: -- 172.21.15.156:0/704602026 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56406096da40 con 0x564060941000 2024-04-26T18:11:52.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: starting mds.k at 2024-04-26T18:11:52.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 bash[69632]: ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 2024-04-26T18:11:52.183 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:11:51 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:11:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: daemon mds.l restarted 2024-04-26T18:11:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T18:11:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:boot 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: daemon mds.k restarted 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:boot 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:52 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: daemon mds.l restarted 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:boot 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: daemon mds.k restarted 2024-04-26T18:11:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T18:11:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:boot 2024-04-26T18:11:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:52 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: daemon mds.l restarted 2024-04-26T18:11:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:11:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: osdmap e123: 12 total, 12 up, 12 in 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:boot 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=k=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: daemon mds.k restarted 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: osdmap e124: 12 total, 12 up, 12 in 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:boot 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:replay} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:11:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:52 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:53.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 700.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:11:53.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:53 smithi092 ceph-mon[29156]: pgmap v405: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-04-26T18:11:53.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:resolve 2024-04-26T18:11:53.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:resolve 2024-04-26T18:11:53.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:53 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:53 smithi189 ceph-mon[32756]: pgmap v405: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-04-26T18:11:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:resolve 2024-04-26T18:11:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:resolve 2024-04-26T18:11:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:53 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:53 smithi156 ceph-mon[32679]: pgmap v405: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-04-26T18:11:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:resolve 2024-04-26T18:11:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:resolve 2024-04-26T18:11:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:53 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f0060ff9640 1 -- 172.21.15.92:0/688973023 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbd5ed7ee0 con 0x55dbd5fec1a0 2024-04-26T18:11:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f0060ff9640 10 client.16347 handle_command_reply: tid=0 2024-04-26T18:11:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 client.16347 shutdown 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 msgr2=0x55dbd5f78f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f006802a450 tx=0x7f00680316d0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 shutdown_connections 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55dbd5fec1a0 0x55dbd5fee5c0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dbd5f750e0 0x55dbd5f794c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dbd5f6a820 0x55dbd5f78f80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f0060ff9640 0 client.16347 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.755+0000 7f00823bf740 1 --2- 172.21.15.92:0/688973023 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55dbd5f69f00 0x55dbd5f78a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 >> 172.21.15.92:0/688973023 conn(0x55dbd5f66410 msgr2=0x55dbd5f741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 shutdown_connections 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f00823bf740 1 -- 172.21.15.92:0/688973023 wait complete. 2024-04-26T18:11:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f00823bf740 20 client.16347 trim_cache size 0 max 16384 2024-04-26T18:11:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:11:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:11:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:11:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 msgr2=0x7f00640a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 0x7f00640a6280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0070009370 tx=0x7f0070009240 comp rx=0 tx=0).stop 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 msgr2=0x7f0078199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.756+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f007400c890 tx=0x7f007400cd50 comp rx=0 tx=0).stop 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 shutdown_connections 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f00640a3dc0 0x7f00640a6280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f007819d9e0 0x7f007819de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0078107d10 0x7f0078199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 --2- 172.21.15.92:0/2782500305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00781010a0 0x7f0078199120 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:11:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 >> 172.21.15.92:0/2782500305 conn(0x7f0078077d90 msgr2=0x7f0078105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:11:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 shutdown_connections 2024-04-26T18:11:54.760 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:11:54.757+0000 7f007f5c6640 1 -- 172.21.15.92:0/2782500305 wait complete. 2024-04-26T18:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:reconnect 2024-04-26T18:11:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:reconnect 2024-04-26T18:11:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:54 smithi092 ceph-mon[29156]: pgmap v406: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 272 KiB/s wr, 41 op/s 2024-04-26T18:11:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:11:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:reconnect 2024-04-26T18:11:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:reconnect 2024-04-26T18:11:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:54 smithi189 ceph-mon[32756]: pgmap v406: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 272 KiB/s wr, 41 op/s 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:reconnect 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:reconnect 2024-04-26T18:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:54 smithi156 ceph-mon[32679]: pgmap v406: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 272 KiB/s wr, 41 op/s 2024-04-26T18:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:rejoin 2024-04-26T18:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:rejoin 2024-04-26T18:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:55 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:55 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:55 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:rejoin 2024-04-26T18:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:rejoin 2024-04-26T18:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:55 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:55 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:55 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:rejoin 2024-04-26T18:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:rejoin 2024-04-26T18:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:55 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:55 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:55 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:11:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:active 2024-04-26T18:11:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:active 2024-04-26T18:11:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: pgmap v407: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 272 KiB/s wr, 43 op/s 2024-04-26T18:11:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:active 2024-04-26T18:11:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:active 2024-04-26T18:11:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: pgmap v407: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 272 KiB/s wr, 43 op/s 2024-04-26T18:11:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:11:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3330512242,v1:172.21.15.156:6837/3330512242] up:active 2024-04-26T18:11:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3204998784,v1:172.21.15.189:6833/3204998784] up:active 2024-04-26T18:11:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:11:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:11:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: pgmap v407: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 272 KiB/s wr, 43 op/s 2024-04-26T18:11:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:11:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:11:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:11:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:11:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:11:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:11:58.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 705.0 s, 849.7 tps, lat 424.859 ms stddev 2353.928 2024-04-26T18:11:58.759 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:11:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:11:58.490+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:11:58.759 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:11:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:11:58.490+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:11:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:11:58 smithi189 ceph-mon[32756]: pgmap v408: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-26T18:11:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:11:58 smithi156 ceph-mon[32679]: pgmap v408: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-26T18:11:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:11:58 smithi092 ceph-mon[29156]: pgmap v408: 97 pgs: 97 active+clean; 3.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-26T18:12:01.044 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:00 smithi092 ceph-mon[29156]: pgmap v409: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-04-26T18:12:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:00 smithi189 ceph-mon[32756]: pgmap v409: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-04-26T18:12:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:00 smithi156 ceph-mon[32679]: pgmap v409: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-04-26T18:12:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:01 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:01 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:01 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:02 smithi189 ceph-mon[32756]: pgmap v410: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-04-26T18:12:03.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:02 smithi092 ceph-mon[29156]: pgmap v410: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-04-26T18:12:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-mon[32679]: pgmap v410: 97 pgs: 97 active+clean; 3.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 15 MiB/s wr, 1.27k op/s 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4145cf3700 time 2024-04-26T18:12:02.895534+0000 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f415031c3dd] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.186 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: clone() 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:02.895+0000 7f4145cf3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4145cf3700 time 2024-04-26T18:12:02.895534+0000 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f415031c3dd] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.187 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: clone() 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: *** Caught signal (Aborted) ** 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: in thread 7f4145cf3700 thread_name:ms_dispatch 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f414f0a4d20] 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: gsignal() 2024-04-26T18:12:03.188 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: abort() 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f415031c437] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.189 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.190 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 16: clone() 2024-04-26T18:12:03.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:02.896+0000 7f4145cf3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:03.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: in thread 7f4145cf3700 thread_name:ms_dispatch 2024-04-26T18:12:03.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.191 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f414f0a4d20] 2024-04-26T18:12:03.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: gsignal() 2024-04-26T18:12:03.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: abort() 2024-04-26T18:12:03.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f415031c437] 2024-04-26T18:12:03.192 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.193 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.194 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 16: clone() 2024-04-26T18:12:03.195 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:03.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: -1> 2024-04-26T18:12:02.895+0000 7f4145cf3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4145cf3700 time 2024-04-26T18:12:02.895534+0000 2024-04-26T18:12:03.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:03.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.197 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f415031c3dd] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.198 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: clone() 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 0> 2024-04-26T18:12:02.896+0000 7f4145cf3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: in thread 7f4145cf3700 thread_name:ms_dispatch 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.199 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f414f0a4d20] 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: gsignal() 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: abort() 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f415031c437] 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.200 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.201 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 16: clone() 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: -1> 2024-04-26T18:12:02.895+0000 7f4145cf3700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f4145cf3700 time 2024-04-26T18:12:02.895534+0000 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:03.202 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f415031c3dd] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.203 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: clone() 2024-04-26T18:12:03.204 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 0> 2024-04-26T18:12:02.896+0000 7f4145cf3700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: in thread 7f4145cf3700 thread_name:ms_dispatch 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f414f0a4d20] 2024-04-26T18:12:03.205 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2: gsignal() 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 3: abort() 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f415031c437] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f415031c5a3] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c1c956f822] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c1c94df598] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c1c94e1c17] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c1c93dad0b] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c1c93db2ac] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c1c93c3fad] 2024-04-26T18:12:03.206 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41505b0e20] 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 13: (DispatchQueue::entry()+0x51f) [0x7f41505adfdf] 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f4150680fc1] 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f414f09a1ca] 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 16: clone() 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69492]: 2024-04-26T18:12:03.207 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:02 smithi156 podman[69820]: 2024-04-26 18:12:02.956367031 +0000 UTC m=+0.019311621 container died 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T18:12:03.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 710.0 s, 744.8 tps, lat 27.298 ms stddev 33.947 2024-04-26T18:12:04.797 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:04 smithi156 podman[69820]: 2024-04-26 18:12:04.502026413 +0000 UTC m=+1.564971004 container remove 290b9f0a87fa791d8f6d890d372ad65839d106455fc446fe732fd4bdf2b6ddda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:12:04.798 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:04 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:04.798 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:04 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:12:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:04 smithi189 ceph-mon[32756]: pgmap v411: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 14 MiB/s wr, 1.21k op/s 2024-04-26T18:12:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:04 smithi156 ceph-mon[32679]: pgmap v411: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 14 MiB/s wr, 1.21k op/s 2024-04-26T18:12:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:04 smithi092 ceph-mon[29156]: pgmap v411: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 14 MiB/s wr, 1.21k op/s 2024-04-26T18:12:05.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f2249734700 time 2024-04-26T18:12:05.399841+0000 2024-04-26T18:12:05.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:05.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2253d5d3dd] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: clone() 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: *** Caught signal (Aborted) ** 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: in thread 7f2249734700 thread_name:ms_dispatch 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.400+0000 7f2249734700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f2249734700 time 2024-04-26T18:12:05.399841+0000 2024-04-26T18:12:05.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2253d5d3dd] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: clone() 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2252ae5d20] 2024-04-26T18:12:05.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: gsignal() 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: abort() 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2253d5d437] 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 16: clone() 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.401+0000 7f2249734700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: in thread 7f2249734700 thread_name:ms_dispatch 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2252ae5d20] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: gsignal() 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: abort() 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2253d5d437] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 16: clone() 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: -1> 2024-04-26T18:12:05.400+0000 7f2249734700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f2249734700 time 2024-04-26T18:12:05.399841+0000 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2253d5d3dd] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: clone() 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 0> 2024-04-26T18:12:05.401+0000 7f2249734700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: in thread 7f2249734700 thread_name:ms_dispatch 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2252ae5d20] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: gsignal() 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: abort() 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2253d5d437] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 16: clone() 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: -2> 2024-04-26T18:12:05.400+0000 7f2249734700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f2249734700 time 2024-04-26T18:12:05.399841+0000 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f2253d5d3dd] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: clone() 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: -1> 2024-04-26T18:12:05.401+0000 7f2249734700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:05.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: in thread 7f2249734700 thread_name:ms_dispatch 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f2252ae5d20] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2: gsignal() 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 3: abort() 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2253d5d437] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f2253d5d5a3] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5566f1def822] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5566f1d5f598] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5566f1d61c17] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5566f1c5ad0b] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5566f1c5b2ac] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5566f1c43fad] 2024-04-26T18:12:05.902 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2253ff1e20] 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 13: (DispatchQueue::entry()+0x51f) [0x7f2253feefdf] 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f22540c1fc1] 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f2252adb1ca] 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 16: clone() 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70545]: 2024-04-26T18:12:05.903 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:05 smithi189 podman[70879]: 2024-04-26 18:12:05.469368284 +0000 UTC m=+0.021530342 container died 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-26T18:12:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:06 smithi189 ceph-mon[32756]: pgmap v412: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:06 smithi156 ceph-mon[32679]: pgmap v412: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:06 smithi092 ceph-mon[29156]: pgmap v412: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:07.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:07 smithi189 podman[70879]: 2024-04-26 18:12:07.316746632 +0000 UTC m=+1.868908687 container remove 148e2e27552b5e2b80f14297912e4f51fc854a0bac6bbdfe8e873cda34d88a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:12:07.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:07 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:07.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:07 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:12:07.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:07 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.463s CPU time. 2024-04-26T18:12:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- 172.21.15.92:0/3349687930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 msgr2=0x7f951010e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 --2- 172.21.15.92:0/3349687930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951010e6e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9508009cd0 tx=0x7f950802a8e0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- 172.21.15.92:0/3349687930 shutdown_connections 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 --2- 172.21.15.92:0/3349687930 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951010e6e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 --2- 172.21.15.92:0/3349687930 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510101860 0x7f9510101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 --2- 172.21.15.92:0/3349687930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510107820 0x7f9510107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- 172.21.15.92:0/3349687930 >> 172.21.15.92:0/3349687930 conn(0x7f95100789b0 msgr2=0x7f9510078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- 172.21.15.92:0/3349687930 shutdown_connections 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- 172.21.15.92:0/3349687930 wait complete. 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 Processor -- start 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.873+0000 7f951682a640 1 -- start start 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 0x7f9510199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510107820 0x7f95101a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9510111b30 con 0x7f9510102220 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f95101119b0 con 0x7f9510101860 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9510111cb0 con 0x7f9510107820 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59524/0 (socket says 172.21.15.92:59524) 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 -- 172.21.15.92:0/2194705526 learned_addr learned my addr 172.21.15.92:0/2194705526 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f9514dc7640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510107820 0x7f95101a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950ffff640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 0x7f9510199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 -- 172.21.15.92:0/2194705526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510107820 msgr2=0x7f95101a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510107820 0x7f95101a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 -- 172.21.15.92:0/2194705526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 msgr2=0x7f9510199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 0x7f9510199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 -- 172.21.15.92:0/2194705526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95101a5450 con 0x7f9510102220 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950ffff640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 0x7f9510199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f950400d770 tx=0x7f950400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950d7fa640 1 -- 172.21.15.92:0/2194705526 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504017070 con 0x7f9510102220 2024-04-26T18:12:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95101a5620 con 0x7f9510102220 2024-04-26T18:12:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950d7fa640 1 -- 172.21.15.92:0/2194705526 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040054d0 con 0x7f9510102220 2024-04-26T18:12:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f950d7fa640 1 -- 172.21.15.92:0/2194705526 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504004c30 con 0x7f9510102220 2024-04-26T18:12:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.874+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101a5b40 con 0x7f9510102220 2024-04-26T18:12:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 Processor -- start 2024-04-26T18:12:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 -- start start 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f950d7fa640 1 -- 172.21.15.92:0/2194705526 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9504004e10 con 0x7f9510102220 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f36862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3690ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5581f35ec460 con 0x5581f36910e0 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5581f35a6590 con 0x5581f3686820 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.877+0000 7f9519625740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5581f35e8420 con 0x5581f3685f00 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59530/0 (socket says 172.21.15.92:59530) 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 -- 172.21.15.92:0/4239455278 learned_addr learned my addr 172.21.15.92:0/4239455278 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f9514dc7640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f36862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950ffff640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3690ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 -- 172.21.15.92:0/4239455278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 msgr2=0x5581f36862e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f36862e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 -- 172.21.15.92:0/4239455278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 msgr2=0x5581f3690ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3690ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 -- 172.21.15.92:0/4239455278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f35b30d0 con 0x5581f36910e0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950d7fa640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 0x7f94f80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950ffff640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3690ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f9514dc7640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 0x7f94f80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950f7fe640 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f95040cd9c0 tx=0x7f95040d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c73ab1fca02f137 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f950d7fa640 1 -- 172.21.15.92:0/2194705526 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 10217+0+0 (secure 0 0 0) 0x7f95040d0970 con 0x7f9510102220 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f94f67fc640 1 -- 172.21.15.92:0/4239455278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504020020 con 0x5581f36910e0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f94f67fc640 1 -- 172.21.15.92:0/4239455278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9504005680 con 0x5581f36910e0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.878+0000 7f94f67fc640 1 -- 172.21.15.92:0/4239455278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950409bdb0 con 0x5581f36910e0 2024-04-26T18:12:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- 172.21.15.92:0/4239455278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 msgr2=0x5581f36934d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f95040cd9c0 tx=0x7f95040d8670 comp rx=0 tx=0).stop 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9514dc7640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 0x7f94f80a6280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9508004af0 tx=0x7f9508005d80 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- 172.21.15.92:0/4239455278 shutdown_connections 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36934d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3690ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 --2- 172.21.15.92:0/4239455278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f36862e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- 172.21.15.92:0/4239455278 >> 172.21.15.92:0/4239455278 conn(0x5581f3682410 msgr2=0x5581f36827f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- 172.21.15.92:0/4239455278 shutdown_connections 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- 172.21.15.92:0/4239455278 wait complete. 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.879+0000 7f9519625740 1 -- start start 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 Processor -- start 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f368e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f36910e0 0x5581f368ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5581f3693d10 con 0x5581f3686820 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5581f3573b60 con 0x5581f36910e0 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5581f3693e90 con 0x5581f3685f00 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 10 client.0 _ll_register_callbacks cb 0x5581f35982b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59538/0 (socket says 172.21.15.92:59538) 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 -- 172.21.15.92:0/2523162315 learned_addr learned my addr 172.21.15.92:0/2523162315 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9514dc7640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f36910e0 0x5581f368ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950ffff640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f368e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 -- 172.21.15.92:0/2523162315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 msgr2=0x5581f368e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f368e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 -- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f36910e0 msgr2=0x5581f368ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f36910e0 0x5581f368ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 -- 172.21.15.92:0/2523162315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f32fe210 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f950f7fe640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f95040cdad0 tx=0x7f9504009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a370109816e548c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f94ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95040cf070 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 10217+0+0 (secure 0 0 0) 0x7f95040d66f0 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.880+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9504005680 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=171) ==== 24+0+0 (secure 0 0 0) 0x7f9504020040 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 10 client.16368 fetch_fsmap learned FSMap version 171 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=171,monmap=4+}) -- 0x5581f33ca620 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f950407e050 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 171) ==== 7132+0+0 (secure 0 0 0) 0x7f9504081080 con 0x5581f3686820 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 10 client.16368 fetch_fsmap finished waiting for FSMap version 171 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:07.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 20 client.16368 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f36a1090 0x5581f36a3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 4 client.16368 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9504005680 con 0x5581f36a1090 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.881+0000 7f950ffff640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f36a1090 0x5581f36a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.882+0000 7f950ffff640 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f36a1090 0x5581f36a3480 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bace94cfb5e354c server_cookie=4e862f12dce1aba3 in_seq=0 out_seq=0 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.882+0000 7f94ef7fe640 10 client.16368 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.882+0000 7f94ef7fe640 1 -- 172.21.15.92:0/2523162315 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f9504005680 con 0x5581f36a1090 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.882+0000 7f94ef7fe640 10 client.16368 handle_command_reply: tid=0 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.882+0000 7f9519625740 1 client.16368 shutdown 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 msgr2=0x5581f368e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f95040cdad0 tx=0x7f9504009f00 comp rx=0 tx=0).stop 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 shutdown_connections 2024-04-26T18:12:07.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f36a1090 0x5581f36a3480 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f36910e0 0x5581f368ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f94ef7fe640 0 client.16368 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3686820 0x5581f368e590 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 --2- 172.21.15.92:0/2523162315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3685f00 0x5581f368e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 >> 172.21.15.92:0/2523162315 conn(0x5581f3682410 msgr2=0x5581f36815b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 shutdown_connections 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 1 -- 172.21.15.92:0/2523162315 wait complete. 2024-04-26T18:12:07.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.883+0000 7f9519625740 20 client.16368 trim_cache size 0 max 16384 2024-04-26T18:12:07.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.897+0000 7f9519625740 1 Processor -- start 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.897+0000 7f9519625740 1 -- start start 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.897+0000 7f9519625740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 0x5581f367d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.897+0000 7f9519625740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3686820 0x5581f369cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9519625740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9519625740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95101afee0 con 0x5581f36910e0 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9519625740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f95101b05b0 con 0x5581f3685f00 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9519625740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95101b0c80 con 0x5581f3686820 2024-04-26T18:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59540/0 (socket says 172.21.15.92:59540) 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 -- 172.21.15.92:0/3525869841 learned_addr learned my addr 172.21.15.92:0/3525869841 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f950ffff640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 0x5581f367d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f950f7fe640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3686820 0x5581f369cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 -- 172.21.15.92:0/3525869841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3686820 msgr2=0x5581f369cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3686820 0x5581f369cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 -- 172.21.15.92:0/3525869841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 msgr2=0x5581f367d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 0x5581f367d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 -- 172.21.15.92:0/3525869841 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f368d000 con 0x5581f36910e0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f950ffff640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 0x5581f367d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f9514dc7640 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9508009cd0 tx=0x7f9508044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb93d4fd7ee77e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f94f5ffb640 1 -- 172.21.15.92:0/3525869841 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508031b80 con 0x5581f36910e0 2024-04-26T18:12:07.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f94f5ffb640 1 -- 172.21.15.92:0/3525869841 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9508056070 con 0x5581f36910e0 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.898+0000 7f94f5ffb640 1 -- 172.21.15.92:0/3525869841 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9508030a60 con 0x5581f36910e0 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- 172.21.15.92:0/3525869841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 msgr2=0x5581f36888c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9508009cd0 tx=0x7f9508044000 comp rx=0 tx=0).stop 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- 172.21.15.92:0/3525869841 shutdown_connections 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f36910e0 0x5581f36888c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f3686820 0x5581f369cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 --2- 172.21.15.92:0/3525869841 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3685f00 0x5581f367d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- 172.21.15.92:0/3525869841 >> 172.21.15.92:0/3525869841 conn(0x5581f3682410 msgr2=0x5581f36815b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- 172.21.15.92:0/3525869841 shutdown_connections 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- 172.21.15.92:0/3525869841 wait complete. 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 -- start start 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.899+0000 7f9519625740 1 Processor -- start 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3699620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 0x5581f36960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95101ad1c0 con 0x5581f3685f00 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f95101ae5d0 con 0x5581f3686820 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95101ad830 con 0x5581f36910e0 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 10 client.0 _ll_register_callbacks cb 0x7f9508031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59542/0 (socket says 172.21.15.92:59542) 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 -- 172.21.15.92:0/390225698 learned_addr learned my addr 172.21.15.92:0/390225698 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950f7fe640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3699620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9514dc7640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 0x5581f36960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 -- 172.21.15.92:0/390225698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 msgr2=0x5581f36960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 0x5581f36960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 -- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 msgr2=0x5581f3699620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3699620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 -- 172.21.15.92:0/390225698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f3696640 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950f7fe640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3699620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9514dc7640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 0x5581f36960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f950ffff640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f950000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e066a2bb657b73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f94ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950001e5f0 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(124..124 src has 1..124) ==== 10217+0+0 (secure 0 0 0) 0x7f950001e790 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9508056070 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=171) ==== 24+0+0 (secure 0 0 0) 0x7f9500003e90 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 10 client.16374 fetch_fsmap learned FSMap version 171 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.900+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=171,monmap=4+}) -- 0x5581f3707c20 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9508056070 con 0x5581f3685f00 2024-04-26T18:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 171) ==== 7132+0+0 (secure 0 0 0) 0x7f9500004c20 con 0x5581f3685f00 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 10 client.16374 fetch_fsmap finished waiting for FSMap version 171 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 10 client.16374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 20 client.16374 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f3708350 0x5581f370a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 4 client.16374 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5581f35fa070 con 0x5581f3708350 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f950f7fe640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f3708350 0x5581f370a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f94ef7fe640 10 client.16374 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:07.901+0000 7f950f7fe640 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f3708350 0x5581f370a770 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfb6f73bab6a4f40 server_cookie=3ab855fc4d49d005 in_seq=0 out_seq=0 2024-04-26T18:12:08.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 715.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:08 smithi189 ceph-mon[32756]: pgmap v413: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:08 smithi156 ceph-mon[32679]: pgmap v413: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:08 smithi092 ceph-mon[29156]: pgmap v413: 97 pgs: 97 active+clean; 3.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-04-26T18:12:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:09 smithi189 ceph-mon[32756]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T18:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:09 smithi156 ceph-mon[32679]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T18:12:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:09 smithi092 ceph-mon[29156]: osdmap e125: 12 total, 12 up, 12 in 2024-04-26T18:12:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:10 smithi189 ceph-mon[32756]: pgmap v415: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:10 smithi156 ceph-mon[32679]: pgmap v415: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:10 smithi092 ceph-mon[29156]: pgmap v415: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:12 smithi189 ceph-mon[32756]: pgmap v416: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:12 smithi156 ceph-mon[32679]: pgmap v416: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:12 smithi092 ceph-mon[29156]: pgmap v416: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.5 MiB/s wr, 532 op/s 2024-04-26T18:12:13.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 720.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:14 smithi189 ceph-mon[32756]: pgmap v417: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.5 MiB/s wr, 435 op/s 2024-04-26T18:12:15.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:14 smithi156 ceph-mon[32679]: pgmap v417: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.5 MiB/s wr, 435 op/s 2024-04-26T18:12:15.168 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:14 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:12:15.168 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:14 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:15.168 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:14 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:12:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:14 smithi092 ceph-mon[29156]: pgmap v417: 97 pgs: 7 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 76 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.5 MiB/s wr, 435 op/s 2024-04-26T18:12:15.430 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 podman[69922]: 2024-04-26 18:12:15.071642556 +0000 UTC m=+0.018316495 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:12:15.430 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 podman[69922]: 2024-04-26 18:12:15.194519534 +0000 UTC m=+0.141193459 container create 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:12:15.683 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 podman[69922]: 2024-04-26 18:12:15.430887369 +0000 UTC m=+0.377561295 container init 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-26T18:12:15.683 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 podman[69922]: 2024-04-26 18:12:15.433592077 +0000 UTC m=+0.380266004 container start 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T18:12:15.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mds[69941]: -- 172.21.15.156:0/1747232446 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557494643a40 con 0x557494617000 2024-04-26T18:12:15.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: starting mds.h at 2024-04-26T18:12:15.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 bash[69922]: 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 2024-04-26T18:12:15.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:15 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: daemon mds.h restarted 2024-04-26T18:12:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:boot 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:15 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: daemon mds.h restarted 2024-04-26T18:12:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T18:12:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:boot 2024-04-26T18:12:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:12:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:12:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:15 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: daemon mds.h restarted 2024-04-26T18:12:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: osdmap e126: 12 total, 12 up, 12 in 2024-04-26T18:12:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:boot 2024-04-26T18:12:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:12:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:12:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:15 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:17 smithi092 ceph-mon[29156]: pgmap v419: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-04-26T18:12:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:resolve 2024-04-26T18:12:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:17 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:17 smithi189 ceph-mon[32756]: pgmap v419: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-04-26T18:12:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:resolve 2024-04-26T18:12:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:17 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:12:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.463s CPU time. 2024-04-26T18:12:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:17 smithi156 ceph-mon[32679]: pgmap v419: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2024-04-26T18:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:resolve 2024-04-26T18:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:17 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=c=up:active} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:18.168 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 podman[70974]: 2024-04-26 18:12:17.792054634 +0000 UTC m=+0.018337415 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:12:18.168 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:17 smithi189 podman[70974]: 2024-04-26 18:12:17.944522855 +0000 UTC m=+0.170805622 container create 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T18:12:18.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 725.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:18.479 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 podman[70974]: 2024-04-26 18:12:18.220839059 +0000 UTC m=+0.447121827 container init 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-26T18:12:18.480 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 podman[70974]: 2024-04-26 18:12:18.223560661 +0000 UTC m=+0.449843430 container start 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T18:12:18.480 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mds[70994]: -- 172.21.15.189:0/1536005704 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb6f8efa40 con 0x55bb6f8c2800 2024-04-26T18:12:18.480 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: starting mds.c at 2024-04-26T18:12:18.480 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 bash[70974]: 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 2024-04-26T18:12:18.480 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:18 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: pgmap v420: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 886 KiB/s wr, 117 op/s 2024-04-26T18:12:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: daemon mds.c restarted 2024-04-26T18:12:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T18:12:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:boot 2024-04-26T18:12:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:12:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:12:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:18 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: pgmap v420: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 886 KiB/s wr, 117 op/s 2024-04-26T18:12:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: daemon mds.c restarted 2024-04-26T18:12:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T18:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:boot 2024-04-26T18:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:18 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: pgmap v420: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 886 KiB/s wr, 117 op/s 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: daemon mds.c restarted 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: osdmap e127: 12 total, 12 up, 12 in 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:boot 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:12:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:18 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:replay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:20 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:resolve 2024-04-26T18:12:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:20 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:20 smithi092 ceph-mon[29156]: pgmap v422: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T18:12:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:20 smithi092 ceph-mon[29156]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T18:12:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:20 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:resolve 2024-04-26T18:12:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:20 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:20 smithi189 ceph-mon[32756]: pgmap v422: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T18:12:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:20 smithi189 ceph-mon[32756]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T18:12:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:20 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:resolve 2024-04-26T18:12:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:20 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:20 smithi156 ceph-mon[32679]: pgmap v422: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2024-04-26T18:12:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:20 smithi156 ceph-mon[32679]: osdmap e128: 12 total, 12 up, 12 in 2024-04-26T18:12:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f94ef7fe640 1 -- 172.21.15.92:0/390225698 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5581f35fa070 con 0x5581f3708350 2024-04-26T18:12:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f94ef7fe640 10 client.16374 handle_command_reply: tid=0 2024-04-26T18:12:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 client.16374 shutdown 2024-04-26T18:12:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 msgr2=0x5581f36990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9500000c00 tx=0x7f950000def0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 shutdown_connections 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5581f3708350 0x5581f370a770 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5581f36910e0 0x5581f36960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581f3686820 0x5581f3699620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 --2- 172.21.15.92:0/390225698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5581f3685f00 0x5581f36990e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f94ef7fe640 0 client.16374 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 >> 172.21.15.92:0/390225698 conn(0x5581f3682410 msgr2=0x5581f36815b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 shutdown_connections 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 1 -- 172.21.15.92:0/390225698 wait complete. 2024-04-26T18:12:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.509+0000 7f9519625740 20 client.16374 trim_cache size 0 max 16384 2024-04-26T18:12:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:12:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:12:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:12:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 msgr2=0x7f94f80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 0x7f94f80a6280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9508004af0 tx=0x7f9508005d80 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 msgr2=0x7f951019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f950400d770 tx=0x7f950400dc30 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 shutdown_connections 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f94f80a3dc0 0x7f94f80a6280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9510107820 0x7f95101a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9510102220 0x7f951019a3d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 --2- 172.21.15.92:0/2194705526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9510101860 0x7f9510199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 >> 172.21.15.92:0/2194705526 conn(0x7f95100789b0 msgr2=0x7f95101042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 shutdown_connections 2024-04-26T18:12:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:21.510+0000 7f951682a640 1 -- 172.21.15.92:0/2194705526 wait complete. 2024-04-26T18:12:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:12:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:12:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:reconnect 2024-04-26T18:12:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:reconnect 2024-04-26T18:12:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:21 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:reconnect 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:reconnect 2024-04-26T18:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:21 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999985 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:reconnect 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:reconnect 2024-04-26T18:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:21 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:rejoin 2024-04-26T18:12:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:rejoin 2024-04-26T18:12:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:12:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:12:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-mon[32756]: pgmap v424: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 707 KiB/s wr, 86 op/s 2024-04-26T18:12:22.889 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f70699df700 time 2024-04-26T18:12:22.564344+0000 2024-04-26T18:12:22.889 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f70740083dd] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.890 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: clone() 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.565+0000 7f70699df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f70699df700 time 2024-04-26T18:12:22.564344+0000 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f70740083dd] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.891 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: clone() 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: *** Caught signal (Aborted) ** 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: in thread 7f70699df700 thread_name:ms_dispatch 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7072d90d20] 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: gsignal() 2024-04-26T18:12:22.892 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: abort() 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7074008437] 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.893 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.895 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.895 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 16: clone() 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.567+0000 7f70699df700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:22.896 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: in thread 7f70699df700 thread_name:ms_dispatch 2024-04-26T18:12:22.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7072d90d20] 2024-04-26T18:12:22.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: gsignal() 2024-04-26T18:12:22.897 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: abort() 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7074008437] 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.898 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.899 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 16: clone() 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: -1> 2024-04-26T18:12:22.565+0000 7f70699df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f70699df700 time 2024-04-26T18:12:22.564344+0000 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.900 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.901 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f70740083dd] 2024-04-26T18:12:22.901 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.901 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.901 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.901 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: clone() 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.902 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 0> 2024-04-26T18:12:22.567+0000 7f70699df700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: in thread 7f70699df700 thread_name:ms_dispatch 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7072d90d20] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: gsignal() 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: abort() 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7074008437] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.903 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 16: clone() 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: -1> 2024-04-26T18:12:22.565+0000 7f70699df700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f70699df700 time 2024-04-26T18:12:22.564344+0000 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f70740083dd] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.904 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: clone() 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 0> 2024-04-26T18:12:22.567+0000 7f70699df700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: in thread 7f70699df700 thread_name:ms_dispatch 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:22.905 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7072d90d20] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2: gsignal() 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 3: abort() 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7074008437] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f70740085a3] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x556709588822] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5567094f8598] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5567094fac17] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5567093f3d0b] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5567093f42ac] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5567093dcfad] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f707429ce20] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 13: (DispatchQueue::entry()+0x51f) [0x7f7074299fdf] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f707436cfc1] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7072d861ca] 2024-04-26T18:12:22.906 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 16: clone() 2024-04-26T18:12:22.907 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:22.907 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[70708]: 2024-04-26T18:12:22.907 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:22 smithi189 podman[71039]: 2024-04-26 18:12:22.651218252 +0000 UTC m=+0.023761036 container died c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:rejoin 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:rejoin 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:22 smithi156 ceph-mon[32679]: pgmap v424: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 707 KiB/s wr, 86 op/s 2024-04-26T18:12:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:rejoin 2024-04-26T18:12:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:rejoin 2024-04-26T18:12:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:12:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:12:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:22 smithi092 ceph-mon[29156]: pgmap v424: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 707 KiB/s wr, 86 op/s 2024-04-26T18:12:23.327 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 730.0 s, 1.4 tps, lat 23282.228 ms stddev 34.036 2024-04-26T18:12:23.842 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:23 smithi189 podman[71039]: 2024-04-26 18:12:23.610432296 +0000 UTC m=+0.982975124 container remove c12c81cb2439b5396a493b291b7dd95deb6d187ccdfa7aa5eda224126ddd215e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-26T18:12:23.842 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:23 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:23.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:23 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:23.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:23 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:active 2024-04-26T18:12:23.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:23 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:active 2024-04-26T18:12:23.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:23 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:23.843 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:23 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:active 2024-04-26T18:12:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:active 2024-04-26T18:12:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:23.934 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:12:23.493+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:12:23.934 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:12:23 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:12:23.493+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:12:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:23 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:23 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3303750504,v1:172.21.15.189:6835/3303750504] up:active 2024-04-26T18:12:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:23 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/3587229726,v1:172.21.15.156:6833/3587229726] up:active 2024-04-26T18:12:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:23 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:23 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:24.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:23 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:12:24.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:23 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.245s CPU time. 2024-04-26T18:12:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:24 smithi189 ceph-mon[32756]: pgmap v425: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 600 KiB/s wr, 79 op/s 2024-04-26T18:12:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:24 smithi156 ceph-mon[32679]: pgmap v425: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 600 KiB/s wr, 79 op/s 2024-04-26T18:12:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:24 smithi092 ceph-mon[29156]: pgmap v425: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 600 KiB/s wr, 79 op/s 2024-04-26T18:12:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:26 smithi092 ceph-mon[29156]: pgmap v426: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 118 op/s 2024-04-26T18:12:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:26 smithi189 ceph-mon[32756]: pgmap v426: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 118 op/s 2024-04-26T18:12:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:26 smithi156 ceph-mon[32679]: pgmap v426: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 746 KiB/s wr, 118 op/s 2024-04-26T18:12:28.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:28 smithi189 ceph-mon[32756]: pgmap v427: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 634 KiB/s wr, 100 op/s 2024-04-26T18:12:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:28 smithi156 ceph-mon[32679]: pgmap v427: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 634 KiB/s wr, 100 op/s 2024-04-26T18:12:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:28 smithi092 ceph-mon[29156]: pgmap v427: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 634 KiB/s wr, 100 op/s 2024-04-26T18:12:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:30 smithi092 ceph-mon[29156]: pgmap v428: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 168 KiB/s wr, 44 op/s 2024-04-26T18:12:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:30 smithi189 ceph-mon[32756]: pgmap v428: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 168 KiB/s wr, 44 op/s 2024-04-26T18:12:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:30 smithi156 ceph-mon[32679]: pgmap v428: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 168 KiB/s wr, 44 op/s 2024-04-26T18:12:32.067 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa8181f2700 time 2024-04-26T18:12:31.714821+0000 2024-04-26T18:12:32.067 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:32.067 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.067 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa82281b3dd] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.068 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: clone() 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:31.715+0000 7fa8181f2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa8181f2700 time 2024-04-26T18:12:31.714821+0000 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:32.069 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.070 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.070 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa82281b3dd] 2024-04-26T18:12:32.070 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.070 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.070 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: clone() 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: *** Caught signal (Aborted) ** 2024-04-26T18:12:32.071 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: in thread 7fa8181f2700 thread_name:ms_dispatch 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa8215a3d20] 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: gsignal() 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: abort() 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa82281b437] 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.072 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 16: clone() 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:31.717+0000 7fa8181f2700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: in thread 7fa8181f2700 thread_name:ms_dispatch 2024-04-26T18:12:32.073 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa8215a3d20] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: gsignal() 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: abort() 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa82281b437] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.074 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 16: clone() 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: -1> 2024-04-26T18:12:31.715+0000 7fa8181f2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa8181f2700 time 2024-04-26T18:12:31.714821+0000 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa82281b3dd] 2024-04-26T18:12:32.075 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: clone() 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 0> 2024-04-26T18:12:31.717+0000 7fa8181f2700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:32.076 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: in thread 7fa8181f2700 thread_name:ms_dispatch 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa8215a3d20] 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: gsignal() 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: abort() 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa82281b437] 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.077 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 16: clone() 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: -4> 2024-04-26T18:12:31.715+0000 7fa8181f2700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fa8181f2700 time 2024-04-26T18:12:31.714821+0000 2024-04-26T18:12:32.078 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa82281b3dd] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.079 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: clone() 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: -3> 2024-04-26T18:12:31.717+0000 7fa8181f2700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: in thread 7fa8181f2700 thread_name:ms_dispatch 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa8215a3d20] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2: gsignal() 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 3: abort() 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa82281b437] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fa82281b5a3] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x56405f857822] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x56405f7c7598] 2024-04-26T18:12:32.080 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x56405f7c9c17] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x56405f6c2d0b] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x56405f6c32ac] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x56405f6abfad] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fa822aafe20] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 13: (DispatchQueue::entry()+0x51f) [0x7fa822aacfdf] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fa822b7ffc1] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa8215991ca] 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 16: clone() 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[69646]: 2024-04-26T18:12:32.081 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:31 smithi156 podman[69992]: 2024-04-26 18:12:31.776825928 +0000 UTC m=+0.021760880 container died ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T18:12:32.637 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:32 smithi156 podman[69992]: 2024-04-26 18:12:32.3858859 +0000 UTC m=+0.630820824 container remove ea9d5ba79cba2a651410968c15c58604cbfa9a15accc3a40f57033d3ada5bea1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-26T18:12:32.638 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:32 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:32.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:32 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:12:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:32 smithi156 ceph-mon[32679]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:32.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:32 smithi092 ceph-mon[29156]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:32 smithi189 ceph-mon[32756]: pgmap v429: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:34.202 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:33 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:12:34.202 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:33 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:34.202 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:33 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.245s CPU time. 2024-04-26T18:12:34.202 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:33 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:12:34.202 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 podman[71132]: 2024-04-26 18:12:34.026270503 +0000 UTC m=+0.018442861 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:12:34.455 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 podman[71132]: 2024-04-26 18:12:34.202827232 +0000 UTC m=+0.194999581 container create 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-26T18:12:34.455 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 podman[71132]: 2024-04-26 18:12:34.430436822 +0000 UTC m=+0.422609164 container init 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, ceph=True) 2024-04-26T18:12:34.455 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 podman[71132]: 2024-04-26 18:12:34.433671586 +0000 UTC m=+0.425843932 container start 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-04-26T18:12:34.455 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mds[71151]: -- 172.21.15.189:0/466552574 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd50567a40 con 0x55dd5053a800 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 -- 172.21.15.92:0/4147455118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 msgr2=0x7fb81810e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/4147455118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81810e650 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb810009ca0 tx=0x7fb81002a8c0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 -- 172.21.15.92:0/4147455118 shutdown_connections 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/4147455118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81810e650 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/4147455118 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 0x7fb818102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/4147455118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 0x7fb818106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 -- 172.21.15.92:0/4147455118 >> 172.21.15.92:0/4147455118 conn(0x7fb818077630 msgr2=0x7fb818077a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 -- 172.21.15.92:0/4147455118 shutdown_connections 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.607+0000 7fb81f6a0640 1 -- 172.21.15.92:0/4147455118 wait complete. 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 Processor -- start 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 -- start start 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 0x7fb818199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 0x7fb8181a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb818111ab0 con 0x7fb818102540 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb818111930 con 0x7fb8181067d0 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81f6a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb818111c30 con 0x7fb818101b80 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81cc3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81cc3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45478/0 (socket says 172.21.15.92:45478) 2024-04-26T18:12:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81cc3b640 1 -- 172.21.15.92:0/2463926200 learned_addr learned my addr 172.21.15.92:0/2463926200 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 0x7fb8181a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.608+0000 7fb81d43c640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 0x7fb818199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 -- 172.21.15.92:0/2463926200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 msgr2=0x7fb818199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 0x7fb818199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 -- 172.21.15.92:0/2463926200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 msgr2=0x7fb8181a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 0x7fb8181a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 -- 172.21.15.92:0/2463926200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8181a5370 con 0x7fb818102540 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d950 tx=0x7fb80800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb80e7fc640 1 -- 172.21.15.92:0/2463926200 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808017030 con 0x7fb818102540 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb80e7fc640 1 -- 172.21.15.92:0/2463926200 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb808004020 con 0x7fb818102540 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8181a5540 con 0x7fb818102540 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb80e7fc640 1 -- 172.21.15.92:0/2463926200 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8080047a0 con 0x7fb818102540 2024-04-26T18:12:34.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.609+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8181a5a60 con 0x7fb818102540 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.611+0000 7fb80e7fc640 1 -- 172.21.15.92:0/2463926200 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fb808009a30 con 0x7fb818102540 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 Processor -- start 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 -- start start 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604ad90d460 con 0x5604ad9b20e0 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5604ad8c7590 con 0x5604ad9a6f00 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb8223bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5604ad909420 con 0x5604ad9a7820 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45482/0 (socket says 172.21.15.92:45482) 2024-04-26T18:12:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 -- 172.21.15.92:0/1794157633 learned_addr learned my addr 172.21.15.92:0/1794157633 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81dc3d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81d43c640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb80e7fc640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 0x7fb8040a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 -- 172.21.15.92:0/1794157633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 msgr2=0x5604ad9b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 -- 172.21.15.92:0/1794157633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 msgr2=0x5604ad9a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81cc3b640 1 -- 172.21.15.92:0/1794157633 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ad8d40d0 con 0x5604ad9b20e0 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81d43c640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.612+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 0x7fb8040a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb80e7fc640 1 -- 172.21.15.92:0/2463926200 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 10475+0+0 (secure 0 0 0) 0x7fb8080d0950 con 0x7fb818102540 2024-04-26T18:12:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb8080cd870 tx=0x7fb8080915e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6728f443c6fed94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb8037fe640 1 -- 172.21.15.92:0/1794157633 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80809bf20 con 0x5604ad9b20e0 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 0x7fb8040a6280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb81002f500 tx=0x7fb8100095c0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb8037fe640 1 -- 172.21.15.92:0/1794157633 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80809c850 con 0x5604ad9b20e0 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb8037fe640 1 -- 172.21.15.92:0/1794157633 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80809bab0 con 0x5604ad9b20e0 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb8223bf740 1 -- 172.21.15.92:0/1794157633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 msgr2=0x5604ad9b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.613+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb8080cd870 tx=0x7fb8080915e0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- 172.21.15.92:0/1794157633 shutdown_connections 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9b44d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1794157633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- 172.21.15.92:0/1794157633 >> 172.21.15.92:0/1794157633 conn(0x5604ad9a3410 msgr2=0x5604ad9a37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- 172.21.15.92:0/1794157633 shutdown_connections 2024-04-26T18:12:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- 172.21.15.92:0/1794157633 wait complete. 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- start start 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 Processor -- start 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9b20e0 0x5604ad9afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5604ad9b4cb0 con 0x5604ad9a6f00 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5604ad894b60 con 0x5604ad9b20e0 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5604ad9b4e30 con 0x5604ad9a7820 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb8223bf740 10 client.0 _ll_register_callbacks cb 0x5604ad8b92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.614+0000 7fb81d43c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81dc3d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9b20e0 0x5604ad9afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45498/0 (socket says 172.21.15.92:45498) 2024-04-26T18:12:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 -- 172.21.15.92:0/1135533509 learned_addr learned my addr 172.21.15.92:0/1135533509 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 -- 172.21.15.92:0/1135533509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 msgr2=0x5604ad9af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 -- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9b20e0 msgr2=0x5604ad9afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9b20e0 0x5604ad9afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 -- 172.21.15.92:0/1135533509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ad61f210 con 0x5604ad9a6f00 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb81d43c640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb8140126e0 tx=0x7fb814012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e38b322c03dff7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb800ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814012190 con 0x5604ad9a6f00 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 10475+0+0 (secure 0 0 0) 0x7fb814004020 con 0x5604ad9a6f00 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb80809c850 con 0x5604ad9a6f00 2024-04-26T18:12:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fb814004220 con 0x5604ad9a6f00 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb8223bf740 10 client.16401 fetch_fsmap learned FSMap version 183 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.615+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=4+}) -- 0x5604ad6eb620 con 0x5604ad9a6f00 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80809c850 con 0x5604ad9a6f00 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 183) ==== 7132+0+0 (secure 0 0 0) 0x7fb8140038c0 con 0x5604ad9a6f00 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 10 client.16401 fetch_fsmap finished waiting for FSMap version 183 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 20 client.16401 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ad9c22b0 0x5604ad9c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 4 client.16401 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604ad91b070 con 0x5604ad9c22b0 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ad9c22b0 0x5604ad9c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb800ff9640 10 client.16401 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.616+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ad9c22b0 0x5604ad9c4700 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=399c980a491210ee server_cookie=87e1a147bcc28c17 in_seq=0 out_seq=0 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb800ff9640 1 -- 172.21.15.92:0/1135533509 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604ad91b070 con 0x5604ad9c22b0 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb800ff9640 10 client.16401 handle_command_reply: tid=0 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 client.16401 shutdown 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 msgr2=0x5604ad9af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb8140126e0 tx=0x7fb814012ba0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 shutdown_connections 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ad9c22b0 0x5604ad9c4700 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9b20e0 0x5604ad9afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb800ff9640 0 client.16401 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 --2- 172.21.15.92:0/1135533509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9af110 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 >> 172.21.15.92:0/1135533509 conn(0x5604ad9a3410 msgr2=0x5604ad9a9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 shutdown_connections 2024-04-26T18:12:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.617+0000 7fb8223bf740 1 -- 172.21.15.92:0/1135533509 wait complete. 2024-04-26T18:12:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.618+0000 7fb8223bf740 20 client.16401 trim_cache size 0 max 16384 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 Processor -- start 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 -- start start 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181b0c10 con 0x5604ad9b20e0 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181b12e0 con 0x5604ad9a6f00 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.632+0000 7fb8223bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181af2e0 con 0x5604ad9a7820 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45514/0 (socket says 172.21.15.92:45514) 2024-04-26T18:12:34.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 -- 172.21.15.92:0/3477942374 learned_addr learned my addr 172.21.15.92:0/3477942374 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81d43c640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 -- 172.21.15.92:0/3477942374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 msgr2=0x5604ad9ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 -- 172.21.15.92:0/3477942374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 msgr2=0x5604ad9a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 -- 172.21.15.92:0/3477942374 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ad9bf070 con 0x5604ad9b20e0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb810009ca0 tx=0x7fb81003e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d1bb12b55b2694 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb802ffd640 1 -- 172.21.15.92:0/3477942374 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810058070 con 0x5604ad9b20e0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb802ffd640 1 -- 172.21.15.92:0/3477942374 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb810036040 con 0x5604ad9b20e0 2024-04-26T18:12:34.638 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.633+0000 7fb802ffd640 1 -- 172.21.15.92:0/3477942374 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810004860 con 0x5604ad9b20e0 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- 172.21.15.92:0/3477942374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 msgr2=0x5604ad9ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb810009ca0 tx=0x7fb81003e030 comp rx=0 tx=0).stop 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- 172.21.15.92:0/3477942374 shutdown_connections 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9b20e0 0x5604ad9ca550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9a7820 0x5604ad9ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3477942374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a6f00 0x5604ad9a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- 172.21.15.92:0/3477942374 >> 172.21.15.92:0/3477942374 conn(0x5604ad9a3410 msgr2=0x5604ad9a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- 172.21.15.92:0/3477942374 shutdown_connections 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- 172.21.15.92:0/3477942374 wait complete. 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- start start 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 Processor -- start 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 0x5604ad9b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.639 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9b20e0 0x5604ada21850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181aec10 con 0x5604ad9a6f00 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181ad800 con 0x5604ad9a7820 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181ade70 con 0x5604ad9b20e0 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.634+0000 7fb8223bf740 10 client.0 _ll_register_callbacks cb 0x7fb814009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81cc3b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 0x5604ad9b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45522/0 (socket says 172.21.15.92:45522) 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 -- 172.21.15.92:0/3801841080 learned_addr learned my addr 172.21.15.92:0/3801841080 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81dc3d640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9b20e0 0x5604ada21850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 -- 172.21.15.92:0/3801841080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9b20e0 msgr2=0x5604ada21850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9b20e0 0x5604ada21850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 -- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 msgr2=0x5604ad9b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:34.640 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 0x5604ad9b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 -- 172.21.15.92:0/3801841080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ada21e40 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 0x5604ad9b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb81d43c640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb814003ea0 tx=0x7fb81400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1dfce95716f991 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb800ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140035f0 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 10475+0+0 (secure 0 0 0) 0x7fb814003790 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb810036040 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=183) ==== 24+0+0 (secure 0 0 0) 0x7fb814036050 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb8223bf740 10 client.16407 fetch_fsmap learned FSMap version 183 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.635+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=183,monmap=4+}) -- 0x5604ada29140 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb810036040 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 183) ==== 7132+0+0 (secure 0 0 0) 0x7fb814031030 con 0x5604ad9a6f00 2024-04-26T18:12:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 10 client.16407 fetch_fsmap finished waiting for FSMap version 183 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 20 client.16407 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ada298b0 0x5604ada2bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 4 client.16407 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604ad914ee0 con 0x5604ada298b0 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ada298b0 0x5604ada2bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb800ff9640 10 client.16407 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:34.636+0000 7fb81cc3b640 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ada298b0 0x5604ada2bcd0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc31515b22e72bc6 server_cookie=99e9519962358c4a in_seq=0 out_seq=0 2024-04-26T18:12:34.731 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: starting mds.l at 2024-04-26T18:12:34.731 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 bash[71132]: 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda 2024-04-26T18:12:34.731 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:12:34 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: pgmap v430: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: daemon mds.l restarted 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:boot 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:12:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:34 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: pgmap v430: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: daemon mds.l restarted 2024-04-26T18:12:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T18:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:boot 2024-04-26T18:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:34 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: pgmap v430: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 141 KiB/s wr, 37 op/s 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: daemon mds.l restarted 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: osdmap e129: 12 total, 12 up, 12 in 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:boot 2024-04-26T18:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:12:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:12:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:12:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:34 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:36 smithi092 ceph-mon[29156]: pgmap v432: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:36 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:resolve 2024-04-26T18:12:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:36 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:36 smithi189 ceph-mon[32756]: pgmap v432: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:36 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:resolve 2024-04-26T18:12:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:36 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:36 smithi156 ceph-mon[32679]: pgmap v432: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:36 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:resolve 2024-04-26T18:12:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:36 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:12:38.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 745.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:38 smithi092 ceph-mon[29156]: pgmap v433: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:38 smithi189 ceph-mon[32756]: pgmap v433: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:38 smithi156 ceph-mon[32679]: pgmap v433: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-04-26T18:12:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:40 smithi092 ceph-mon[29156]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:40 smithi189 ceph-mon[32756]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:40 smithi156 ceph-mon[32679]: pgmap v434: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:42.977 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:42 smithi156 ceph-mon[32679]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:42.977 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:42 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:12:42.977 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:42 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:42.978 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:42 smithi156 systemd[1]: Starting Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:12:42.978 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:42 smithi156 podman[70088]: 2024-04-26 18:12:42.811728219 +0000 UTC m=+0.018339086 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:12:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:42 smithi189 ceph-mon[32756]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:42 smithi092 ceph-mon[29156]: pgmap v435: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-04-26T18:12:43.246 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:42 smithi156 podman[70088]: 2024-04-26 18:12:42.97835006 +0000 UTC m=+0.184960915 container create 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:12:43.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 750.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:43.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 podman[70088]: 2024-04-26 18:12:43.247839068 +0000 UTC m=+0.454449926 container init 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-26T18:12:43.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 podman[70088]: 2024-04-26 18:12:43.250740616 +0000 UTC m=+0.457351478 container start 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-26T18:12:43.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mds[70107]: -- 172.21.15.156:0/2365684548 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f8a047a40 con 0x555f8a01ac00 2024-04-26T18:12:43.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: starting mds.k at 2024-04-26T18:12:43.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 bash[70088]: 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 2024-04-26T18:12:43.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:12:43 smithi156 systemd[1]: Started Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: daemon mds.k restarted 2024-04-26T18:12:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T18:12:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:boot 2024-04-26T18:12:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:12:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:12:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:43 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: daemon mds.k restarted 2024-04-26T18:12:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T18:12:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:boot 2024-04-26T18:12:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:12:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:12:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:43 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: daemon mds.k restarted 2024-04-26T18:12:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: osdmap e130: 12 total, 12 up, 12 in 2024-04-26T18:12:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:boot 2024-04-26T18:12:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:12:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:12:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-26T18:12:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:43 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:45 smithi189 ceph-mon[32756]: pgmap v437: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-04-26T18:12:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:45 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:resolve 2024-04-26T18:12:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:45 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:45 smithi156 ceph-mon[32679]: pgmap v437: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-04-26T18:12:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:45 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:resolve 2024-04-26T18:12:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:45 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:45 smithi092 ceph-mon[29156]: pgmap v437: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-04-26T18:12:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:45 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:resolve 2024-04-26T18:12:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:45 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb800ff9640 1 -- 172.21.15.92:0/3801841080 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604ad914ee0 con 0x5604ada298b0 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb800ff9640 10 client.16407 handle_command_reply: tid=0 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 client.16407 shutdown 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 msgr2=0x5604ad9b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb814003ea0 tx=0x7fb81400f790 comp rx=0 tx=0).stop 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 shutdown_connections 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5604ada298b0 0x5604ada2bcd0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5604ad9b20e0 0x5604ada21850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5604ad9a7820 0x5604ad9b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 --2- 172.21.15.92:0/3801841080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5604ad9a6f00 0x5604ad9b62c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb800ff9640 0 client.16407 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.318+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 >> 172.21.15.92:0/3801841080 conn(0x5604ad9a3410 msgr2=0x5604ad9a25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 shutdown_connections 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb8223bf740 1 -- 172.21.15.92:0/3801841080 wait complete. 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb8223bf740 20 client.16407 trim_cache size 0 max 16384 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:12:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:12:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 msgr2=0x7fb8040a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 0x7fb8040a6280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb81002f500 tx=0x7fb8100095c0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 msgr2=0x7fb81819a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.319+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d950 tx=0x7fb80800de10 comp rx=0 tx=0).stop 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 shutdown_connections 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fb8040a3dc0 0x7fb8040a6280 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8181067d0 0x7fb8181a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb818102540 0x7fb81819a2f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 --2- 172.21.15.92:0/2463926200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb818101b80 0x7fb818199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 >> 172.21.15.92:0/2463926200 conn(0x7fb818077630 msgr2=0x7fb8180ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 shutdown_connections 2024-04-26T18:12:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:46.320+0000 7fb81f6a0640 1 -- 172.21.15.92:0/2463926200 wait complete. 2024-04-26T18:12:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:12:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:12:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:reconnect 2024-04-26T18:12:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:reconnect 2024-04-26T18:12:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:46 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:12:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:12:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:reconnect 2024-04-26T18:12:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:reconnect 2024-04-26T18:12:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:46 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:12:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:12:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:12:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:reconnect 2024-04-26T18:12:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:reconnect 2024-04-26T18:12:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:46 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:47.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:47 smithi156 ceph-mon[32679]: pgmap v438: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:47.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:47 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:rejoin 2024-04-26T18:12:47.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:47 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:rejoin 2024-04-26T18:12:47.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:47 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:47.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:47 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:12:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:47 smithi189 ceph-mon[32756]: pgmap v438: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:47 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:rejoin 2024-04-26T18:12:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:47 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:rejoin 2024-04-26T18:12:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:47 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:47 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:12:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:47 smithi092 ceph-mon[29156]: pgmap v438: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:47 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:rejoin 2024-04-26T18:12:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:47 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:rejoin 2024-04-26T18:12:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:47 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:47 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:12:48.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 755.0 s, 0.4 tps, lat 49006.637 ms stddev 0.047 2024-04-26T18:12:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:clientreplay 2024-04-26T18:12:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:active 2024-04-26T18:12:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:clientreplay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f60efb9d700 time 2024-04-26T18:12:48.340150+0000 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f60fa1c63dd] 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.638 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: clone() 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.340+0000 7f60efb9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f60efb9d700 time 2024-04-26T18:12:48.340150+0000 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:48.639 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f60fa1c63dd] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: clone() 2024-04-26T18:12:48.640 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: *** Caught signal (Aborted) ** 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: in thread 7f60efb9d700 thread_name:ms_dispatch 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f60f8f4ed20] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: gsignal() 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: abort() 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f60fa1c6437] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.641 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.642 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 16: clone() 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.342+0000 7f60efb9d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: in thread 7f60efb9d700 thread_name:ms_dispatch 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f60f8f4ed20] 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: gsignal() 2024-04-26T18:12:48.643 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: abort() 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f60fa1c6437] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 16: clone() 2024-04-26T18:12:48.644 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: -1> 2024-04-26T18:12:48.340+0000 7f60efb9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f60efb9d700 time 2024-04-26T18:12:48.340150+0000 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f60fa1c63dd] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.645 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: clone() 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 0> 2024-04-26T18:12:48.342+0000 7f60efb9d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: in thread 7f60efb9d700 thread_name:ms_dispatch 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f60f8f4ed20] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: gsignal() 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: abort() 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f60fa1c6437] 2024-04-26T18:12:48.646 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 16: clone() 2024-04-26T18:12:48.647 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: -1> 2024-04-26T18:12:48.340+0000 7f60efb9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f60efb9d700 time 2024-04-26T18:12:48.340150+0000 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f60fa1c63dd] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.648 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: clone() 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 0> 2024-04-26T18:12:48.342+0000 7f60efb9d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: in thread 7f60efb9d700 thread_name:ms_dispatch 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f60f8f4ed20] 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2: gsignal() 2024-04-26T18:12:48.649 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 3: abort() 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f60fa1c6437] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f60fa1c65a3] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55bb6d90c822] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55bb6d87c598] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55bb6d87ec17] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55bb6d777d0b] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55bb6d7782ac] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55bb6d760fad] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f60fa45ae20] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 13: (DispatchQueue::entry()+0x51f) [0x7f60fa457fdf] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f60fa52afc1] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f60f8f441ca] 2024-04-26T18:12:48.650 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 16: clone() 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[70990]: 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:48 smithi189 podman[71185]: 2024-04-26 18:12:48.407277827 +0000 UTC m=+0.021779148 container died 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:clientreplay 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:active 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:48 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:clientreplay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:48.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:48 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:12:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:clientreplay 2024-04-26T18:12:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3765382321,v1:172.21.15.156:6837/3765382321] up:active 2024-04-26T18:12:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=c=up:clientreplay} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:12:48.683 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:12:48.495+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:12:48.684 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:12:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:12:48.495+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:12:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:49 smithi189 ceph-mon[32756]: pgmap v439: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:49 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:49 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:active 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:49 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:49 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:49 smithi189 podman[71185]: 2024-04-26 18:12:49.11902908 +0000 UTC m=+0.733530459 container remove 86b222fb41f5ade9e8ecae36017e3de994709e7805d40c069121265cf9534c82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:12:49.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:49 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.146s CPU time. 2024-04-26T18:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:49 smithi092 ceph-mon[29156]: pgmap v439: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:49 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:49 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:active 2024-04-26T18:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:49 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:49 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:49 smithi156 ceph-mon[32679]: pgmap v439: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 33 KiB/s wr, 10 op/s 2024-04-26T18:12:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:49 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:12:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:49 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2666620105,v1:172.21.15.189:6833/2666620105] up:active 2024-04-26T18:12:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:49 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:12:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:49 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:12:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:51 smithi189 ceph-mon[32756]: pgmap v440: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:51 smithi156 ceph-mon[32679]: pgmap v440: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:51 smithi092 ceph-mon[29156]: pgmap v440: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:53.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 760.0 s, 42.0 tps, lat 22143.432 ms stddev 23977.858 2024-04-26T18:12:53.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-mon[32679]: pgmap v441: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f261f147700 time 2024-04-26T18:12:53.329849+0000 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26297703dd] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.334 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: clone() 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.329+0000 7f261f147700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f261f147700 time 2024-04-26T18:12:53.329849+0000 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.335 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26297703dd] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: clone() 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.336 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: *** Caught signal (Aborted) ** 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: in thread 7f261f147700 thread_name:ms_dispatch 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26284f8d20] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: gsignal() 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: abort() 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2629770437] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.337 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 16: clone() 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.331+0000 7f261f147700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:53.338 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: in thread 7f261f147700 thread_name:ms_dispatch 2024-04-26T18:12:53.339 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.339 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.339 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26284f8d20] 2024-04-26T18:12:53.339 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: gsignal() 2024-04-26T18:12:53.339 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: abort() 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2629770437] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.340 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 16: clone() 2024-04-26T18:12:53.341 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:53.341 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:53 smithi189 ceph-mon[32756]: pgmap v441: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: -1> 2024-04-26T18:12:53.329+0000 7f261f147700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f261f147700 time 2024-04-26T18:12:53.329849+0000 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26297703dd] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: clone() 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 0> 2024-04-26T18:12:53.331+0000 7f261f147700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: in thread 7f261f147700 thread_name:ms_dispatch 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26284f8d20] 2024-04-26T18:12:53.685 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: gsignal() 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: abort() 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2629770437] 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.686 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 16: clone() 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: -1> 2024-04-26T18:12:53.329+0000 7f261f147700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f261f147700 time 2024-04-26T18:12:53.329849+0000 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.687 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f26297703dd] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: clone() 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 0> 2024-04-26T18:12:53.331+0000 7f261f147700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:12:53.688 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: in thread 7f261f147700 thread_name:ms_dispatch 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f26284f8d20] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2: gsignal() 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 3: abort() 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f2629770437] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f26297705a3] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557492e79822] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557492de9598] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557492debc17] 2024-04-26T18:12:53.689 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557492ce4d0b] 2024-04-26T18:12:53.690 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557492ce52ac] 2024-04-26T18:12:53.690 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557492ccdfad] 2024-04-26T18:12:53.690 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f2629a04e20] 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 13: (DispatchQueue::entry()+0x51f) [0x7f2629a01fdf] 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f2629ad4fc1] 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f26284ee1ca] 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 16: clone() 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[69937]: 2024-04-26T18:12:53.691 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 podman[70146]: 2024-04-26 18:12:53.394723102 +0000 UTC m=+0.020939359 container died 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T18:12:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:53 smithi092 ceph-mon[29156]: pgmap v441: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-04-26T18:12:54.221 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 podman[70146]: 2024-04-26 18:12:53.971602693 +0000 UTC m=+0.597818939 container remove 59e95bcda474e07cf20f8927a4ee8e63200e0c7011b49dc11a37236f77f8d5f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:12:54.222 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:53 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:12:54.683 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:12:54 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:12:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:55 smithi189 ceph-mon[32756]: pgmap v442: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 199 KiB/s wr, 34 op/s 2024-04-26T18:12:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:55 smithi156 ceph-mon[32679]: pgmap v442: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 199 KiB/s wr, 34 op/s 2024-04-26T18:12:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:55 smithi092 ceph-mon[29156]: pgmap v442: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 199 KiB/s wr, 34 op/s 2024-04-26T18:12:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:57 smithi189 ceph-mon[32756]: pgmap v443: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 241 KiB/s wr, 39 op/s 2024-04-26T18:12:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:57 smithi156 ceph-mon[32679]: pgmap v443: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 241 KiB/s wr, 39 op/s 2024-04-26T18:12:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:57 smithi092 ceph-mon[29156]: pgmap v443: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 241 KiB/s wr, 39 op/s 2024-04-26T18:12:58.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 765.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:12:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 -- 172.21.15.92:0/861220718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988101860 msgr2=0x7f1988101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 --2- 172.21.15.92:0/861220718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988101860 0x7f1988101ce0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f1978009930 tx=0x7f197802a420 comp rx=0 tx=0).stop 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 -- 172.21.15.92:0/861220718 shutdown_connections 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 --2- 172.21.15.92:0/861220718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 0x7f198810e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 --2- 172.21.15.92:0/861220718 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988101860 0x7f1988101ce0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 --2- 172.21.15.92:0/861220718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988107820 0x7f1988107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 -- 172.21.15.92:0/861220718 >> 172.21.15.92:0/861220718 conn(0x7f19880789b0 msgr2=0x7f1988078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 -- 172.21.15.92:0/861220718 shutdown_connections 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 -- 172.21.15.92:0/861220718 wait complete. 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.414+0000 7f198fbc1640 1 Processor -- start 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 -- start start 2024-04-26T18:12:59.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988101860 0x7f19880fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 0x7f19880fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1988111ae0 con 0x7f1988107820 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1988111960 con 0x7f1988102220 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198fbc1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1988111c60 con 0x7f1988101860 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43798/0 (socket says 172.21.15.92:43798) 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 -- 172.21.15.92:0/3576527423 learned_addr learned my addr 172.21.15.92:0/3576527423 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198d95d640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988101860 0x7f19880fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198d15c640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 0x7f19880fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 -- 172.21.15.92:0/3576527423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988101860 msgr2=0x7f19880fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988101860 0x7f19880fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 -- 172.21.15.92:0/3576527423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 msgr2=0x7f19880fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 0x7f19880fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 -- 172.21.15.92:0/3576527423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19881a7600 con 0x7f1988107820 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.415+0000 7f198e15e640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1980009fd0 tx=0x7f198000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.416+0000 7f197effd640 1 -- 172.21.15.92:0/3576527423 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980017070 con 0x7f1988107820 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.416+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19881a78f0 con 0x7f1988107820 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.416+0000 7f197effd640 1 -- 172.21.15.92:0/3576527423 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1980003e20 con 0x7f1988107820 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.416+0000 7f197effd640 1 -- 172.21.15.92:0/3576527423 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980010460 con 0x7f1988107820 2024-04-26T18:12:59.419 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.416+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19881a7e10 con 0x7f1988107820 2024-04-26T18:12:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.418+0000 7f197effd640 1 -- 172.21.15.92:0/3576527423 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1980003970 con 0x7f1988107820 2024-04-26T18:12:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.418+0000 7f19929b1740 1 Processor -- start 2024-04-26T18:12:59.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.418+0000 7f19929b1740 1 -- start start 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee52002e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee520d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ee5166460 con 0x560ee5200820 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560ee5120590 con 0x560ee520b0e0 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f19929b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ee5162420 con 0x560ee51fff00 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f197effd640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 0x7f19740a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198e15e640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 0x7f19740a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43802/0 (socket says 172.21.15.92:43802) 2024-04-26T18:12:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 -- 172.21.15.92:0/3439239894 learned_addr learned my addr 172.21.15.92:0/3439239894 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d15c640 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee52002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d15c640 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee520d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f197effd640 1 -- 172.21.15.92:0/3576527423 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 10561+0+0 (secure 0 0 0) 0x7f19800d0cc0 con 0x7f1988107820 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 -- 172.21.15.92:0/3439239894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 msgr2=0x560ee52002e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee52002e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 -- 172.21.15.92:0/3439239894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 msgr2=0x560ee520d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee520d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 -- 172.21.15.92:0/3439239894 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee512d0d0 con 0x560ee5200820 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198e15e640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 0x7f19740a62b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f198009c4a0 tx=0x7f1980087040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f198d95d640 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f198400aba0 tx=0x7f198400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db1d0bd1339bc94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f1973fff640 1 -- 172.21.15.92:0/3439239894 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198401d070 con 0x560ee5200820 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.419+0000 7f1973fff640 1 -- 172.21.15.92:0/3439239894 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1984018af0 con 0x560ee5200820 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f1973fff640 1 -- 172.21.15.92:0/3439239894 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984010a20 con 0x560ee5200820 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 -- 172.21.15.92:0/3439239894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 msgr2=0x560ee520aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f198400aba0 tx=0x7f198400f790 comp rx=0 tx=0).stop 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 -- 172.21.15.92:0/3439239894 shutdown_connections 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee520d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee5200820 0x560ee520aba0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 --2- 172.21.15.92:0/3439239894 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee52002e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 -- 172.21.15.92:0/3439239894 >> 172.21.15.92:0/3439239894 conn(0x560ee51fc410 msgr2=0x560ee51fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 -- 172.21.15.92:0/3439239894 shutdown_connections 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.420+0000 7f19929b1740 1 -- 172.21.15.92:0/3439239894 wait complete. 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 -- start start 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 Processor -- start 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee51fff00 0x560ee5208060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ee520dd10 con 0x560ee520b0e0 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560ee50edb60 con 0x560ee51fff00 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560ee520de90 con 0x560ee5200820 2024-04-26T18:12:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f19929b1740 10 client.0 _ll_register_callbacks cb 0x560ee51122b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43816/0 (socket says 172.21.15.92:43816) 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f198d15c640 1 -- 172.21.15.92:0/4032549294 learned_addr learned my addr 172.21.15.92:0/4032549294 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f198d95d640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.421+0000 7f198d15c640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee51fff00 0x560ee5208060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 -- 172.21.15.92:0/4032549294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 msgr2=0x560ee52085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 -- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee51fff00 msgr2=0x560ee5208060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee51fff00 0x560ee5208060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 -- 172.21.15.92:0/4032549294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee4e78210 con 0x560ee520b0e0 2024-04-26T18:12:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f198d15c640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1978009930 tx=0x7f1978009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc4c8b80d9cc8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978035070 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 10561+0+0 (secure 0 0 0) 0x7f1978005020 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1984018af0 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=192) ==== 24+0+0 (secure 0 0 0) 0x7f1978053050 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 10 client.16419 fetch_fsmap learned FSMap version 192 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=192,monmap=4+}) -- 0x560ee4f44620 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1984018af0 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 192) ==== 7128+0+0 (secure 0 0 0) 0x7f19780035f0 con 0x560ee520b0e0 2024-04-26T18:12:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 10 client.16419 fetch_fsmap finished waiting for FSMap version 192 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 20 client.16419 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee521b1b0 0x560ee521d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 4 client.16419 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.422+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ee5174070 con 0x560ee521b1b0 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.423+0000 7f198d95d640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee521b1b0 0x560ee521d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.423+0000 7f19717fa640 10 client.16419 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.423+0000 7f198d95d640 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee521b1b0 0x560ee521d5a0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74768d2bd484126d server_cookie=a52282afe4dc4bce in_seq=0 out_seq=0 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19717fa640 1 -- 172.21.15.92:0/4032549294 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560ee5174070 con 0x560ee521b1b0 2024-04-26T18:12:59.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19717fa640 10 client.16419 handle_command_reply: tid=0 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 client.16419 shutdown 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 msgr2=0x560ee5208ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1978009930 tx=0x7f1978009260 comp rx=0 tx=0).stop 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 shutdown_connections 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee521b1b0 0x560ee521d5a0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5208ae0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19717fa640 0 client.16419 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:59.434 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 --2- 172.21.15.92:0/4032549294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee51fff00 0x560ee5208060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 >> 172.21.15.92:0/4032549294 conn(0x560ee51fc410 msgr2=0x560ee51fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 shutdown_connections 2024-04-26T18:12:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 1 -- 172.21.15.92:0/4032549294 wait complete. 2024-04-26T18:12:59.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.424+0000 7f19929b1740 20 client.16419 trim_cache size 0 max 16384 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 Processor -- start 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 -- start start 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee5222eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19881b27d0 con 0x560ee51fff00 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f19881b2ea0 con 0x560ee520b0e0 2024-04-26T18:12:59.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f19929b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19881b3570 con 0x560ee5200820 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43830/0 (socket says 172.21.15.92:43830) 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 -- 172.21.15.92:0/3206106990 learned_addr learned my addr 172.21.15.92:0/3206106990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d95d640 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 -- 172.21.15.92:0/3206106990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 msgr2=0x560ee52028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 -- 172.21.15.92:0/3206106990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 msgr2=0x560ee5222eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee5222eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 -- 172.21.15.92:0/3206106990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee521d910 con 0x560ee51fff00 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.439+0000 7f198d15c640 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f1978005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4ba1decdb34aae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19737fe640 1 -- 172.21.15.92:0/3206106990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978035070 con 0x560ee51fff00 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19737fe640 1 -- 172.21.15.92:0/3206106990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1978003d40 con 0x560ee51fff00 2024-04-26T18:12:59.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19737fe640 1 -- 172.21.15.92:0/3206106990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780052a0 con 0x560ee51fff00 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 -- 172.21.15.92:0/3206106990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 msgr2=0x560ee5216bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f1978006010 tx=0x7f1978005e30 comp rx=0 tx=0).stop 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 -- 172.21.15.92:0/3206106990 shutdown_connections 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee520b0e0 0x560ee5222eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee5200820 0x560ee52028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 --2- 172.21.15.92:0/3206106990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee51fff00 0x560ee5216bd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 -- 172.21.15.92:0/3206106990 >> 172.21.15.92:0/3206106990 conn(0x560ee51fc410 msgr2=0x560ee51fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 -- 172.21.15.92:0/3206106990 shutdown_connections 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.440+0000 7f19929b1740 1 -- 172.21.15.92:0/3206106990 wait complete. 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 -- start start 2024-04-26T18:12:59.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 Processor -- start 2024-04-26T18:12:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee5213650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee5200820 0x560ee5204bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19881afab0 con 0x560ee520b0e0 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f19881b0ec0 con 0x560ee5200820 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f19881b0120 con 0x560ee51fff00 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f19929b1740 10 client.0 _ll_register_callbacks cb 0x7f1978009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:43840/0 (socket says 172.21.15.92:43840) 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 -- 172.21.15.92:0/1319939996 learned_addr learned my addr 172.21.15.92:0/1319939996 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee5213650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d95d640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee5200820 0x560ee5204bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 -- 172.21.15.92:0/1319939996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 msgr2=0x560ee5213650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee5213650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 -- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee5200820 msgr2=0x560ee5204bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee5200820 0x560ee5204bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:12:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.441+0000 7f198d15c640 1 -- 172.21.15.92:0/1319939996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee5280720 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f198d15c640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1978003800 tx=0x7f1978003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806d0a8eebee47f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978035070 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1978003d40 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 10561+0+0 (secure 0 0 0) 0x7f1978003b40 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=192) ==== 24+0+0 (secure 0 0 0) 0x7f1978041040 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 10 client.16425 fetch_fsmap learned FSMap version 192 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=192,monmap=4+}) -- 0x560ee52818d0 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1978003d40 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 192) ==== 7128+0+0 (secure 0 0 0) 0x7f1978004bc0 con 0x560ee520b0e0 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 10 client.16425 fetch_fsmap finished waiting for FSMap version 192 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:12:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 20 client.16425 populate_metadata read hostname 'smithi092' 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee5281f60 0x560ee5284380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 4 client.16425 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ee516dee0 con 0x560ee5281f60 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.442+0000 7f198d95d640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee5281f60 0x560ee5284380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.443+0000 7f19717fa640 10 client.16425 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:12:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:12:59.443+0000 7f198d95d640 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee5281f60 0x560ee5284380 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de02a40686b63198 server_cookie=6528bc81163e304c in_seq=0 out_seq=0 2024-04-26T18:12:59.616 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:12:59.616 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:12:59.616 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.146s CPU time. 2024-04-26T18:12:59.616 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:12:59.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-mon[32756]: pgmap v444: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 227 KiB/s wr, 36 op/s 2024-04-26T18:12:59.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:59.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:59.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:12:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:59 smithi156 ceph-mon[32679]: pgmap v444: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 227 KiB/s wr, 36 op/s 2024-04-26T18:12:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:12:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:12:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:59 smithi092 ceph-mon[29156]: pgmap v444: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 227 KiB/s wr, 36 op/s 2024-04-26T18:12:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:12:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:12:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:12:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:12:59.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 podman[71408]: 2024-04-26 18:12:59.519995312 +0000 UTC m=+0.018120124 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:12:59.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 podman[71408]: 2024-04-26 18:12:59.677838598 +0000 UTC m=+0.175963393 container create e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 podman[71408]: 2024-04-26 18:12:59.947824298 +0000 UTC m=+0.445949094 container init e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 podman[71408]: 2024-04-26 18:12:59.95041094 +0000 UTC m=+0.448535747 container start e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-mds[71427]: -- 172.21.15.189:0/1498451754 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557378a11a40 con 0x5573789e4c00 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:12:59 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: starting mds.c at 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:00 smithi189 bash[71408]: e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 2024-04-26T18:13:00.343 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:00 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: pgmap v445: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 250 KiB/s wr, 40 op/s 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: pgmap v446: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 127 KiB/s wr, 18 op/s 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: daemon mds.c restarted 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T18:13:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:boot 2024-04-26T18:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: pgmap v445: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 250 KiB/s wr, 40 op/s 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: pgmap v446: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 127 KiB/s wr, 18 op/s 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: daemon mds.c restarted 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:boot 2024-04-26T18:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:13:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: pgmap v445: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 250 KiB/s wr, 40 op/s 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: pgmap v446: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 127 KiB/s wr, 18 op/s 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: daemon mds.c restarted 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: osdmap e131: 12 total, 12 up, 12 in 2024-04-26T18:13:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:boot 2024-04-26T18:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: Standby daemon mds.l assigned to filesystem cephfs as rank 2 2024-04-26T18:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:02 smithi189 ceph-mon[32756]: pgmap v448: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 154 KiB/s wr, 26 op/s 2024-04-26T18:13:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:resolve 2024-04-26T18:13:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:02 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:02 smithi156 ceph-mon[32679]: pgmap v448: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 154 KiB/s wr, 26 op/s 2024-04-26T18:13:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:resolve 2024-04-26T18:13:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:02 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:02 smithi092 ceph-mon[29156]: pgmap v448: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 154 KiB/s wr, 26 op/s 2024-04-26T18:13:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:resolve 2024-04-26T18:13:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:02 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=l=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:03.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 770.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:04 smithi189 ceph-mon[32756]: pgmap v449: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-04-26T18:13:04.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:04 smithi156 ceph-mon[32679]: pgmap v449: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-04-26T18:13:04.678 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:13:04.678 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:04.678 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:13:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:04 smithi092 ceph-mon[29156]: pgmap v449: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-04-26T18:13:04.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 podman[70376]: 2024-04-26 18:13:04.581470183 +0000 UTC m=+0.018492198 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:13:04.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 podman[70376]: 2024-04-26 18:13:04.705915242 +0000 UTC m=+0.142937246 container create abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 podman[70376]: 2024-04-26 18:13:04.934102417 +0000 UTC m=+0.371124418 container init abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 podman[70376]: 2024-04-26 18:13:04.936877551 +0000 UTC m=+0.373899562 container start abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 ceph-mds[70395]: -- 172.21.15.156:0/3964308334 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604bed53a40 con 0x5604bed27000 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:04 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: starting mds.h at 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:05 smithi156 bash[70376]: abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 2024-04-26T18:13:05.358 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:05 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: daemon mds.h restarted 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:boot 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:05 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: daemon mds.h restarted 2024-04-26T18:13:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T18:13:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:boot 2024-04-26T18:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:05 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: daemon mds.h restarted 2024-04-26T18:13:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: osdmap e132: 12 total, 12 up, 12 in 2024-04-26T18:13:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:boot 2024-04-26T18:13:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: Standby daemon mds.k assigned to filesystem cephfs as rank 1 2024-04-26T18:13:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=l=up:resolve} 2 up:standby-replay 6 up:standby, 1 failed 2024-04-26T18:13:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:05 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:replay,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:06 smithi189 ceph-mon[32756]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-26T18:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:06 smithi156 ceph-mon[32679]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-26T18:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:06 smithi092 ceph-mon[29156]: pgmap v450: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-04-26T18:13:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:resolve 2024-04-26T18:13:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:07 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:07.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:resolve 2024-04-26T18:13:07.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:07 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:resolve 2024-04-26T18:13:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:07 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:resolve,2=l=up:resolve} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:08.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 775.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19717fa640 1 -- 172.21.15.92:0/1319939996 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ee516dee0 con 0x560ee5281f60 2024-04-26T18:13:08.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19717fa640 10 client.16425 handle_command_reply: tid=0 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 client.16425 shutdown 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 msgr2=0x560ee5205310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1978003800 tx=0x7f1978003700 comp rx=0 tx=0).stop 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 shutdown_connections 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560ee5281f60 0x560ee5284380 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ee520b0e0 0x560ee5205310 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560ee5200820 0x560ee5204bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.397+0000 7f19717fa640 0 client.16425 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f19929b1740 1 --2- 172.21.15.92:0/1319939996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560ee51fff00 0x560ee5213650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 >> 172.21.15.92:0/1319939996 conn(0x560ee51fc410 msgr2=0x560ee51fad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 shutdown_connections 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f19929b1740 1 -- 172.21.15.92:0/1319939996 wait complete. 2024-04-26T18:13:08.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f19929b1740 20 client.16425 trim_cache size 0 max 16384 2024-04-26T18:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:13:08.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 msgr2=0x7f19740a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 0x7f19740a62b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f198009c4a0 tx=0x7f1980087040 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 msgr2=0x7f19880ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.398+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1980009fd0 tx=0x7f198000b260 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 shutdown_connections 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f19740a3df0 0x7f19740a62b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1988107820 0x7f19880ff270 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1988102220 0x7f19880fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 --2- 172.21.15.92:0/3576527423 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1988101860 0x7f19880fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:08.400 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 >> 172.21.15.92:0/3576527423 conn(0x7f19880789b0 msgr2=0x7f198806a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 shutdown_connections 2024-04-26T18:13:08.401 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:08.399+0000 7f198fbc1640 1 -- 172.21.15.92:0/3576527423 wait complete. 2024-04-26T18:13:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-04-26T18:13:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:13:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:13:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:reconnect 2024-04-26T18:13:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:reconnect 2024-04-26T18:13:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:08 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:reconnect 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:reconnect 2024-04-26T18:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:08 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: pgmap v452: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 57 KiB/s wr, 17 op/s 2024-04-26T18:13:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999981 2024-04-26T18:13:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:13:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:reconnect 2024-04-26T18:13:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:reconnect 2024-04-26T18:13:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:08 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:reconnect,2=l=up:reconnect} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:rejoin 2024-04-26T18:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:rejoin 2024-04-26T18:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-mon[32756]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efd465ca700 time 2024-04-26T18:13:09.428335+0000 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efd50bf33dd] 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: clone() 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.429+0000 7efd465ca700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efd465ca700 time 2024-04-26T18:13:09.428335+0000 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:09.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efd50bf33dd] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: clone() 2024-04-26T18:13:09.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: *** Caught signal (Aborted) ** 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: in thread 7efd465ca700 thread_name:ms_dispatch 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efd4f97bd20] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: gsignal() 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: abort() 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efd50bf3437] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 16: clone() 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.431+0000 7efd465ca700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: in thread 7efd465ca700 thread_name:ms_dispatch 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efd4f97bd20] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: gsignal() 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: abort() 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efd50bf3437] 2024-04-26T18:13:09.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 16: clone() 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: -1> 2024-04-26T18:13:09.429+0000 7efd465ca700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efd465ca700 time 2024-04-26T18:13:09.428335+0000 2024-04-26T18:13:09.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efd50bf33dd] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: clone() 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 0> 2024-04-26T18:13:09.431+0000 7efd465ca700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: in thread 7efd465ca700 thread_name:ms_dispatch 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efd4f97bd20] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: gsignal() 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: abort() 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efd50bf3437] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 16: clone() 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: -1> 2024-04-26T18:13:09.429+0000 7efd465ca700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7efd465ca700 time 2024-04-26T18:13:09.428335+0000 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7efd50bf33dd] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: clone() 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 0> 2024-04-26T18:13:09.431+0000 7efd465ca700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:09.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: in thread 7efd465ca700 thread_name:ms_dispatch 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7efd4f97bd20] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2: gsignal() 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 3: abort() 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7efd50bf3437] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7efd50bf35a3] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55dd4d89f822] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55dd4d80f598] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55dd4d811c17] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55dd4d70ad0b] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55dd4d70b2ac] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55dd4d6f3fad] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7efd50e87e20] 2024-04-26T18:13:09.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 13: (DispatchQueue::entry()+0x51f) [0x7efd50e84fdf] 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efd50f57fc1] 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7efd4f9711ca] 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 16: clone() 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71147]: 2024-04-26T18:13:09.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:09 smithi189 podman[71461]: 2024-04-26 18:13:09.499151877 +0000 UTC m=+0.024429687 container died 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:rejoin 2024-04-26T18:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:rejoin 2024-04-26T18:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:09 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:09 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:09 smithi156 ceph-mon[32679]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:13:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:rejoin 2024-04-26T18:13:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:rejoin 2024-04-26T18:13:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:09 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:rejoin,2=l=up:rejoin} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:09 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 2 2024-04-26T18:13:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:09 smithi092 ceph-mon[29156]: daemon mds.k is now active in filesystem cephfs as rank 1 2024-04-26T18:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-04-26T18:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:active 2024-04-26T18:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:active 2024-04-26T18:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:10 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:13:10.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:10 smithi189 podman[71461]: 2024-04-26 18:13:10.178068042 +0000 UTC m=+0.703345843 container remove 932f3b9119da053474aec0abf4dd84c5525a834b995b7894e77d68b15ba0bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:13:10.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:13:10.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:13:10.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:10 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.121s CPU time. 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:active 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:active 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:10 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:13:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: pgmap v453: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-04-26T18:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1045784688,v1:172.21.15.189:6835/1045784688] up:active 2024-04-26T18:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/1651998430,v1:172.21.15.156:6833/1651998430] up:active 2024-04-26T18:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 1 up:standby-replay 6 up:standby 2024-04-26T18:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:10 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=k=up:active,2=l=up:active} 3 up:standby-replay 4 up:standby 2024-04-26T18:13:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:12 smithi156 ceph-mon[32679]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:12 smithi092 ceph-mon[29156]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:12 smithi189 ceph-mon[32756]: pgmap v454: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:13.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 780.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-mon[32679]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:14.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd678e4c700 time 2024-04-26T18:13:14.430522+0000 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6834753dd] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.684 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: clone() 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.430+0000 7fd678e4c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd678e4c700 time 2024-04-26T18:13:14.430522+0000 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:14.685 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6834753dd] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.686 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: clone() 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: *** Caught signal (Aborted) ** 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: in thread 7fd678e4c700 thread_name:ms_dispatch 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.687 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6821fdd20] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: gsignal() 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: abort() 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd683475437] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.688 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 16: clone() 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.431+0000 7fd678e4c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: in thread 7fd678e4c700 thread_name:ms_dispatch 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6821fdd20] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: gsignal() 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: abort() 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd683475437] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.689 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 16: clone() 2024-04-26T18:13:14.690 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:14.691 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.691 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: -1> 2024-04-26T18:13:14.430+0000 7fd678e4c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd678e4c700 time 2024-04-26T18:13:14.430522+0000 2024-04-26T18:13:14.691 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:14.691 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.691 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6834753dd] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: clone() 2024-04-26T18:13:14.692 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 0> 2024-04-26T18:13:14.431+0000 7fd678e4c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: in thread 7fd678e4c700 thread_name:ms_dispatch 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6821fdd20] 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: gsignal() 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: abort() 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd683475437] 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.693 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 16: clone() 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: -1> 2024-04-26T18:13:14.430+0000 7fd678e4c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd678e4c700 time 2024-04-26T18:13:14.430522+0000 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:14.694 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd6834753dd] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.695 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: clone() 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 0> 2024-04-26T18:13:14.431+0000 7fd678e4c700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: in thread 7fd678e4c700 thread_name:ms_dispatch 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd6821fdd20] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2: gsignal() 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 3: abort() 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd683475437] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd6834755a3] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555f878ec822] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555f8785c598] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555f8785ec17] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555f87757d0b] 2024-04-26T18:13:14.696 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555f877582ac] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555f87740fad] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd683709e20] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 13: (DispatchQueue::entry()+0x51f) [0x7fd683706fdf] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd6837d9fc1] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd6821f31ca] 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 16: clone() 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k[70103]: 2024-04-26T18:13:14.697 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:14 smithi156 podman[70434]: 2024-04-26 18:13:14.491727366 +0000 UTC m=+0.020962336 container died 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T18:13:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:14 smithi092 ceph-mon[29156]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:14 smithi189 ceph-mon[32756]: pgmap v455: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-04-26T18:13:15.382 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:15 smithi156 podman[70434]: 2024-04-26 18:13:15.131409969 +0000 UTC m=+0.660644925 container remove 32d02ca82727b7e073712997ed6ce4df1eca6a47bc80b8acdcadbb2be7037b00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-26T18:13:15.382 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:15 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:13:15.683 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:15 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:13:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:16 smithi156 ceph-mon[32679]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 64 KiB/s wr, 40 op/s 2024-04-26T18:13:16.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:16 smithi092 ceph-mon[29156]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 64 KiB/s wr, 40 op/s 2024-04-26T18:13:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:16 smithi189 ceph-mon[32756]: pgmap v456: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 64 KiB/s wr, 40 op/s 2024-04-26T18:13:18.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 785.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:18 smithi156 ceph-mon[32679]: pgmap v457: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 55 KiB/s wr, 35 op/s 2024-04-26T18:13:18.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:18 smithi092 ceph-mon[29156]: pgmap v457: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 55 KiB/s wr, 35 op/s 2024-04-26T18:13:18.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:18 smithi189 ceph-mon[32756]: pgmap v457: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 55 KiB/s wr, 35 op/s 2024-04-26T18:13:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:20 smithi156 ceph-mon[32679]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 53 KiB/s wr, 33 op/s 2024-04-26T18:13:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:20 smithi092 ceph-mon[29156]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 53 KiB/s wr, 33 op/s 2024-04-26T18:13:20.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:20 smithi189 ceph-mon[32756]: pgmap v458: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 53 KiB/s wr, 33 op/s 2024-04-26T18:13:20.873 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:13:20.873 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:20.873 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Consumed 1.121s CPU time. 2024-04-26T18:13:20.873 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:13:21.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 podman[71561]: 2024-04-26 18:13:20.777076846 +0000 UTC m=+0.018886378 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:13:21.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:20 smithi189 podman[71561]: 2024-04-26 18:13:20.920262 +0000 UTC m=+0.162071532 container create 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 -- 172.21.15.92:0/1291316059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557410cf90 msgr2=0x7f557410f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 --2- 172.21.15.92:0/1291316059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557410cf90 0x7f557410f3c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f556c009ca0 tx=0x7f556c02a950 comp rx=0 tx=0).stop 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 -- 172.21.15.92:0/1291316059 shutdown_connections 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 --2- 172.21.15.92:0/1291316059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f557410cf90 0x7f557410f3c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 --2- 172.21.15.92:0/1291316059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55741044e0 0x7f557410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 --2- 172.21.15.92:0/1291316059 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5574103bc0 0x7f5574103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 -- 172.21.15.92:0/1291316059 >> 172.21.15.92:0/1291316059 conn(0x7f5574078a40 msgr2=0x7f5574078e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:21.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 -- 172.21.15.92:0/1291316059 shutdown_connections 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.496+0000 7f5578d46640 1 -- 172.21.15.92:0/1291316059 wait complete. 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 Processor -- start 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 -- start start 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55741044e0 0x7f5574101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f557410cf90 0x7f5574102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112bd0 con 0x7f5574103bc0 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112a50 con 0x7f557410cf90 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.497+0000 7f5578d46640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5574112d50 con 0x7f55741044e0 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33778/0 (socket says 172.21.15.92:33778) 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 -- 172.21.15.92:0/1977098848 learned_addr learned my addr 172.21.15.92:0/1977098848 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f556bfff640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55741044e0 0x7f5574101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.500 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f557410cf90 0x7f5574102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 -- 172.21.15.92:0/1977098848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55741044e0 msgr2=0x7f5574101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55741044e0 0x7f5574101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 -- 172.21.15.92:0/1977098848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f557410cf90 msgr2=0x7f5574102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f557410cf90 0x7f5574102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 -- 172.21.15.92:0/1977098848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741a7510 con 0x7f5574103bc0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f557259c640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f556400e9f0 tx=0x7f556400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f556b7fe640 1 -- 172.21.15.92:0/1977098848 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556400cd80 con 0x7f5574103bc0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55741a7800 con 0x7f5574103bc0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f556b7fe640 1 -- 172.21.15.92:0/1977098848 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55640054d0 con 0x7f5574103bc0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f556b7fe640 1 -- 172.21.15.92:0/1977098848 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564010690 con 0x7f5574103bc0 2024-04-26T18:13:21.501 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.498+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741a7d50 con 0x7f5574103bc0 2024-04-26T18:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f556b7fe640 1 -- 172.21.15.92:0/1977098848 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f5564004e90 con 0x7f5574103bc0 2024-04-26T18:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 Processor -- start 2024-04-26T18:13:21.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 -- start start 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f556b7fe640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 0x7f55600a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faf1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faf44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561c5fa4d460 con 0x561c5fae6f00 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561c5fa07590 con 0x561c5faf20e0 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.501+0000 7f557ba65740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561c5fa49420 con 0x561c5fae7820 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 0x7f55600a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33794/0 (socket says 172.21.15.92:33794) 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 -- 172.21.15.92:0/4024556504 learned_addr learned my addr 172.21.15.92:0/4024556504 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5572d9d640 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faf44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f556b7fe640 1 -- 172.21.15.92:0/1977098848 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 10819+0+0 (secure 0 0 0) 0x7f55640d1500 con 0x7f5574103bc0 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f556bfff640 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faf1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 -- 172.21.15.92:0/4024556504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 msgr2=0x561c5faf1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faf1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 -- 172.21.15.92:0/4024556504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 msgr2=0x561c5faf44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faf44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 -- 172.21.15.92:0/4024556504 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5fa140d0 con 0x561c5fae6f00 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 0x7f55600a6280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f556c030040 tx=0x7f556c0099c0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f557259c640 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f556400c6a0 tx=0x7f556409ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94797be115bd858 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5568ff9640 1 -- 172.21.15.92:0/4024556504 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55640b0020 con 0x561c5fae6f00 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5568ff9640 1 -- 172.21.15.92:0/4024556504 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f556409d2a0 con 0x561c5fae6f00 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.502+0000 7f5568ff9640 1 -- 172.21.15.92:0/4024556504 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556400a250 con 0x561c5fae6f00 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- 172.21.15.92:0/4024556504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 msgr2=0x561c5fae72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f556400c6a0 tx=0x7f556409ca30 comp rx=0 tx=0).stop 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- 172.21.15.92:0/4024556504 shutdown_connections 2024-04-26T18:13:21.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faf44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faf1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 --2- 172.21.15.92:0/4024556504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fae72e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- 172.21.15.92:0/4024556504 >> 172.21.15.92:0/4024556504 conn(0x561c5fae3410 msgr2=0x561c5fae37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- 172.21.15.92:0/4024556504 shutdown_connections 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- 172.21.15.92:0/4024556504 wait complete. 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 -- start start 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.503+0000 7f557ba65740 1 Processor -- start 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faefa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561c5faf4d10 con 0x561c5fae6f00 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x561c5f9d4b60 con 0x561c5faf20e0 2024-04-26T18:13:21.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x561c5faf4e90 con 0x561c5fae7820 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557ba65740 10 client.0 _ll_register_callbacks cb 0x561c5f9f92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33810/0 (socket says 172.21.15.92:33810) 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557259c640 1 -- 172.21.15.92:0/1208940313 learned_addr learned my addr 172.21.15.92:0/1208940313 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faefa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f556bfff640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 -- 172.21.15.92:0/1208940313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 msgr2=0x561c5faef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 -- 172.21.15.92:0/1208940313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 msgr2=0x561c5faeefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 -- 172.21.15.92:0/1208940313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5f75f210 con 0x561c5faf20e0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f557259c640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5572d9d640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faefa20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f556c005cc0 tx=0x7f556c005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0d92a4b9f89823 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:13:21.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.504+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556c050070 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 10819+0+0 (secure 0 0 0) 0x7f556c0053d0 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f556409d2a0 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=204) ==== 24+0+0 (secure 0 0 0) 0x7f556c05c050 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 10 client.25934 fetch_fsmap learned FSMap version 204 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=204,monmap=4+}) -- 0x561c5f82b620 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f556409d2a0 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 204) ==== 7132+0+0 (secure 0 0 0) 0x7f556c04ab30 con 0x561c5faf20e0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 10 client.25934 fetch_fsmap finished waiting for FSMap version 204 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 10 client.25934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 20 client.25934 populate_metadata read hostname 'smithi092' 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb022b0 0x561c5fb04730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 4 client.25934 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c5fa5b070 con 0x561c5fb022b0 2024-04-26T18:13:21.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.505+0000 7f557259c640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb022b0 0x561c5fb04730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.506+0000 7f5559ffb640 10 client.25934 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.506+0000 7f557259c640 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb022b0 0x561c5fb04730 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad432ffd772285c server_cookie=7ca05bae9546d5ab in_seq=0 out_seq=0 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f5559ffb640 1 -- 172.21.15.92:0/1208940313 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561c5fa5b070 con 0x561c5fb022b0 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f5559ffb640 10 client.25934 handle_command_reply: tid=0 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 client.25934 shutdown 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 msgr2=0x561c5faefa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faefa20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f556c005cc0 tx=0x7f556c005c50 comp rx=0 tx=0).stop 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 shutdown_connections 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb022b0 0x561c5fb04730 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5faf20e0 0x561c5faefa20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5fae7820 0x561c5faef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f5559ffb640 0 client.25934 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 --2- 172.21.15.92:0/1208940313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5faeefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 >> 172.21.15.92:0/1208940313 conn(0x561c5fae3410 msgr2=0x561c5fae9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 shutdown_connections 2024-04-26T18:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 1 -- 172.21.15.92:0/1208940313 wait complete. 2024-04-26T18:13:21.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.507+0000 7f557ba65740 20 client.25934 trim_cache size 0 max 16384 2024-04-26T18:13:21.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.523+0000 7f557ba65740 1 Processor -- start 2024-04-26T18:13:21.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.523+0000 7f557ba65740 1 -- start start 2024-04-26T18:13:21.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 0x561c5fae98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b30a0 con 0x561c5fae7820 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b3770 con 0x561c5fae6f00 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557ba65740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b1770 con 0x561c5faf20e0 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33822/0 (socket says 172.21.15.92:33822) 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 -- 172.21.15.92:0/2497257408 learned_addr learned my addr 172.21.15.92:0/2497257408 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557259c640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 0x561c5fae98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f5572d9d640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 -- 172.21.15.92:0/2497257408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 msgr2=0x561c5faf0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 -- 172.21.15.92:0/2497257408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 msgr2=0x561c5fae98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 0x561c5fae98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 -- 172.21.15.92:0/2497257408 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c5faed4f0 con 0x561c5fae7820 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f557259c640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 0x561c5fae98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f556bfff640 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d30 tx=0x7f555c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c99abb24775ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f555bfff640 1 -- 172.21.15.92:0/2497257408 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0120d0 con 0x561c5fae7820 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f555bfff640 1 -- 172.21.15.92:0/2497257408 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f555c012270 con 0x561c5fae7820 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.524+0000 7f555bfff640 1 -- 172.21.15.92:0/2497257408 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c004e10 con 0x561c5fae7820 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- 172.21.15.92:0/2497257408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 msgr2=0x561c5faee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d30 tx=0x7f555c005f90 comp rx=0 tx=0).stop 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- 172.21.15.92:0/2497257408 shutdown_connections 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae7820 0x561c5faee100 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 --2- 172.21.15.92:0/2497257408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae6f00 0x561c5fae98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- 172.21.15.92:0/2497257408 >> 172.21.15.92:0/2497257408 conn(0x561c5fae3410 msgr2=0x561c5faf07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:21.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- 172.21.15.92:0/2497257408 shutdown_connections 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- 172.21.15.92:0/2497257408 wait complete. 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.525+0000 7f557ba65740 1 -- start start 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 Processor -- start 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae7820 0x561c5faf56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b10a0 con 0x561c5fae6f00 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f55741afcb0 con 0x561c5fae7820 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b0300 con 0x561c5faf20e0 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 10 client.0 _ll_register_callbacks cb 0x7f5564005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33834/0 (socket says 172.21.15.92:33834) 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 -- 172.21.15.92:0/137685935 learned_addr learned my addr 172.21.15.92:0/137685935 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f556bfff640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae7820 0x561c5faf56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f5572d9d640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 -- 172.21.15.92:0/137685935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 msgr2=0x561c5faf5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 -- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae7820 msgr2=0x561c5faf56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae7820 0x561c5faf56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 -- 172.21.15.92:0/137685935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c5faf61f0 con 0x561c5fae6f00 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557259c640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f556409c670 tx=0x7f556409c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6638b38e914250 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f5559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55640b5020 con 0x561c5fae6f00 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 10819+0+0 (secure 0 0 0) 0x7f556409aea0 con 0x561c5fae6f00 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.526+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f555c012270 con 0x561c5fae6f00 2024-04-26T18:13:21.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=204) ==== 24+0+0 (secure 0 0 0) 0x7f5564005180 con 0x561c5fae6f00 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 10 client.16452 fetch_fsmap learned FSMap version 204 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=204,monmap=4+}) -- 0x561c5fb68660 con 0x561c5fae6f00 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f555c012270 con 0x561c5fae6f00 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 204) ==== 7132+0+0 (secure 0 0 0) 0x7f5564099210 con 0x561c5fae6f00 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 10 client.16452 fetch_fsmap finished waiting for FSMap version 204 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 20 client.16452 populate_metadata read hostname 'smithi092' 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb68ab0 0x561c5fb6aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 4 client.16452 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561c5fa54ee0 con 0x561c5fb68ab0 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f556bfff640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb68ab0 0x561c5fb6aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f5559ffb640 10 client.16452 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:21.533 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:21.527+0000 7f556bfff640 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb68ab0 0x561c5fb6aed0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00f9ae4c0c96b84 server_cookie=537e40653d73ea15 in_seq=0 out_seq=0 2024-04-26T18:13:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: daemon mds.l restarted 2024-04-26T18:13:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T18:13:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:boot 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 podman[71561]: 2024-04-26 18:13:21.222968034 +0000 UTC m=+0.464777565 container init 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True) 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 podman[71561]: 2024-04-26 18:13:21.22565129 +0000 UTC m=+0.467460830 container start 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-mds[71580]: -- 172.21.15.189:0/3670156220 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de86b19a40 con 0x55de86aed000 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: starting mds.l at 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 bash[71561]: 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef 2024-04-26T18:13:21.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:13:21 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: daemon mds.l restarted 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:boot 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:21 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: daemon mds.l restarted 2024-04-26T18:13:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: osdmap e133: 12 total, 12 up, 12 in 2024-04-26T18:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:boot 2024-04-26T18:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=k=up:active} 3 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:21 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:replay} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:22 smithi156 ceph-mon[32679]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 60 KiB/s wr, 36 op/s 2024-04-26T18:13:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:22 smithi092 ceph-mon[29156]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 60 KiB/s wr, 36 op/s 2024-04-26T18:13:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:22 smithi189 ceph-mon[32756]: pgmap v459: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 60 KiB/s wr, 36 op/s 2024-04-26T18:13:23.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:23 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:resolve 2024-04-26T18:13:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:23 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:23 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:resolve 2024-04-26T18:13:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:23 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:23 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:resolve 2024-04-26T18:13:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:23 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=k=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby 2024-04-26T18:13:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:24 smithi156 ceph-mon[32679]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-04-26T18:13:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:24 smithi092 ceph-mon[29156]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-04-26T18:13:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:24 smithi189 ceph-mon[32756]: pgmap v461: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 973 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-04-26T18:13:25.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:13:25.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:25 smithi156 systemd[1]: Stopped Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:25.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Start request repeated too quickly. 2024-04-26T18:13:25.933 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:25 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.k.service: Failed with result 'exit-code'. 2024-04-26T18:13:25.934 INFO:journalctl@ceph.mds.k.smithi156.stdout:Apr 26 18:13:25 smithi156 systemd[1]: Failed to start Ceph mds.k for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:26 smithi156 ceph-mon[32679]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:26 smithi092 ceph-mon[29156]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:26 smithi189 ceph-mon[32756]: pgmap v462: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:28 smithi156 ceph-mon[32679]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:28 smithi092 ceph-mon[29156]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:28 smithi189 ceph-mon[32756]: pgmap v463: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:30 smithi156 ceph-mon[32679]: pgmap v464: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:30 smithi156 ceph-mon[32679]: Replacing daemon mds.k as rank 1 with standby daemon mds.h 2024-04-26T18:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:30 smithi156 ceph-mon[32679]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T18:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:30 smithi156 ceph-mon[32679]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T18:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:30 smithi092 ceph-mon[29156]: pgmap v464: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:30 smithi092 ceph-mon[29156]: Replacing daemon mds.k as rank 1 with standby daemon mds.h 2024-04-26T18:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:30 smithi092 ceph-mon[29156]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T18:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:30 smithi092 ceph-mon[29156]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T18:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:30 smithi189 ceph-mon[32756]: pgmap v464: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-04-26T18:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:30 smithi189 ceph-mon[32756]: Replacing daemon mds.k as rank 1 with standby daemon mds.h 2024-04-26T18:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:30 smithi189 ceph-mon[32756]: MDS daemon mds.k is removed because it is dead or otherwise unavailable. 2024-04-26T18:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:30 smithi189 ceph-mon[32756]: osdmap e134: 12 total, 12 up, 12 in 2024-04-26T18:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:32 smithi092 ceph-mon[29156]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T18:13:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:32 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:resolve 2024-04-26T18:13:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:32 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:32 smithi189 ceph-mon[32756]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T18:13:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:32 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:resolve 2024-04-26T18:13:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:32 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:32 smithi156 ceph-mon[32679]: pgmap v466: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 11 op/s 2024-04-26T18:13:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:32 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:resolve 2024-04-26T18:13:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:32 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f5559ffb640 1 -- 172.21.15.92:0/137685935 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561c5fa54ee0 con 0x561c5fb68ab0 2024-04-26T18:13:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f5559ffb640 10 client.16452 handle_command_reply: tid=0 2024-04-26T18:13:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 client.16452 shutdown 2024-04-26T18:13:33.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 msgr2=0x561c5fafa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f556409c670 tx=0x7f556409c600 comp rx=0 tx=0).stop 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 shutdown_connections 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x561c5fb68ab0 0x561c5fb6aed0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x561c5faf20e0 0x561c5faf5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f5559ffb640 0 client.16452 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561c5fae7820 0x561c5faf56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 --2- 172.21.15.92:0/137685935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561c5fae6f00 0x561c5fafa260 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 >> 172.21.15.92:0/137685935 conn(0x561c5fae3410 msgr2=0x561c5faeef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 shutdown_connections 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 1 -- 172.21.15.92:0/137685935 wait complete. 2024-04-26T18:13:33.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.469+0000 7f557ba65740 20 client.16452 trim_cache size 0 max 16384 2024-04-26T18:13:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:13:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:13:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:13:33.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 msgr2=0x7f55600a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 0x7f55600a6280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f556c030040 tx=0x7f556c0099c0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 msgr2=0x7f5574101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f556400e9f0 tx=0x7f556400edf0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 shutdown_connections 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f55600a3dc0 0x7f55600a6280 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f557410cf90 0x7f5574102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.473 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f55741044e0 0x7f5574101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 --2- 172.21.15.92:0/1977098848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5574103bc0 0x7f5574101810 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 >> 172.21.15.92:0/1977098848 conn(0x7f5574078a40 msgr2=0x7f55740fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 shutdown_connections 2024-04-26T18:13:33.474 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:33.470+0000 7f5578d46640 1 -- 172.21.15.92:0/1977098848 wait complete. 2024-04-26T18:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:reconnect 2024-04-26T18:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:reconnect 2024-04-26T18:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00899986 2024-04-26T18:13:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:33 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00999981 2024-04-26T18:13:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:13:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:reconnect 2024-04-26T18:13:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:reconnect 2024-04-26T18:13:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00899986 2024-04-26T18:13:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:33 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00999981 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00099998 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:reconnect 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:reconnect 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00899986 2024-04-26T18:13:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:33 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00999981 2024-04-26T18:13:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T18:13:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:rejoin 2024-04-26T18:13:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:rejoin 2024-04-26T18:13:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:13:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:34 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T18:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:rejoin 2024-04-26T18:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:rejoin 2024-04-26T18:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:13:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:13:34.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5491979700 time 2024-04-26T18:13:34.493898+0000 2024-04-26T18:13:34.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:34.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f549bfa23dd] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: clone() 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.493+0000 7f5491979700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5491979700 time 2024-04-26T18:13:34.493898+0000 2024-04-26T18:13:34.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f549bfa23dd] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: clone() 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: *** Caught signal (Aborted) ** 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: in thread 7f5491979700 thread_name:ms_dispatch 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f549ad2ad20] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: gsignal() 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: abort() 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f549bfa2437] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 16: clone() 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.495+0000 7f5491979700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: in thread 7f5491979700 thread_name:ms_dispatch 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f549ad2ad20] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: gsignal() 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: abort() 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f549bfa2437] 2024-04-26T18:13:34.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 16: clone() 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: -1> 2024-04-26T18:13:34.493+0000 7f5491979700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5491979700 time 2024-04-26T18:13:34.493898+0000 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f549bfa23dd] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: clone() 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 0> 2024-04-26T18:13:34.495+0000 7f5491979700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: in thread 7f5491979700 thread_name:ms_dispatch 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f549ad2ad20] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: gsignal() 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: abort() 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f549bfa2437] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 16: clone() 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: -1> 2024-04-26T18:13:34.493+0000 7f5491979700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f5491979700 time 2024-04-26T18:13:34.493898+0000 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f549bfa23dd] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: clone() 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 0> 2024-04-26T18:13:34.495+0000 7f5491979700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: in thread 7f5491979700 thread_name:ms_dispatch 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f549ad2ad20] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2: gsignal() 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 3: abort() 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f549bfa2437] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f549bfa25a3] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557376332822] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5573762a2598] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5573762a4c17] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55737619dd0b] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55737619e2ac] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557376186fad] 2024-04-26T18:13:34.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f549c236e20] 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 13: (DispatchQueue::entry()+0x51f) [0x7f549c233fdf] 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f549c306fc1] 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f549ad201ca] 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 16: clone() 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71423]: 2024-04-26T18:13:34.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:34 smithi189 podman[71614]: 2024-04-26 18:13:34.578877822 +0000 UTC m=+0.019945166 container died e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: pgmap v467: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-04-26T18:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:rejoin 2024-04-26T18:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:rejoin 2024-04-26T18:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:13:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:34 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:13:35.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:35 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:35.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:35 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:active 2024-04-26T18:13:35.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:35 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:active 2024-04-26T18:13:35.588 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:35 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:35.589 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:35 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:35 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:35 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:active 2024-04-26T18:13:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:35 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:active 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:35 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:35 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:35 smithi189 podman[71614]: 2024-04-26 18:13:35.403558857 +0000 UTC m=+0.844626183 container remove e6ae4e1384473adf963662b5e5184ba21a5b8520b3d68dad36d8cd5c1f224a17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:35 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:35 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:13:35.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:35 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.128s CPU time. 2024-04-26T18:13:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:35 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:35 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/3250344888,v1:172.21.15.189:6833/3250344888] up:active 2024-04-26T18:13:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:35 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6836/3561484733,v1:172.21.15.156:6837/3561484733] up:active 2024-04-26T18:13:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:35 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:35 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:36 smithi092 ceph-mon[29156]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-04-26T18:13:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:36 smithi189 ceph-mon[32756]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-04-26T18:13:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:36 smithi156 ceph-mon[32679]: pgmap v468: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-04-26T18:13:38.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 805.0 s, 409.8 tps, lat 2291.852 ms stddev 9931.731 2024-04-26T18:13:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:38 smithi092 ceph-mon[29156]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 87 KiB/s wr, 10 op/s 2024-04-26T18:13:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:38 smithi189 ceph-mon[32756]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 87 KiB/s wr, 10 op/s 2024-04-26T18:13:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:38 smithi156 ceph-mon[32679]: pgmap v469: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 87 KiB/s wr, 10 op/s 2024-04-26T18:13:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:39 smithi092 ceph-mon[29156]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T18:13:39.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-mon[32679]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T18:13:39.826 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1c91d74700 time 2024-04-26T18:13:39.471402+0000 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1c9c39d3dd] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.827 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: clone() 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.472+0000 7f1c91d74700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1c91d74700 time 2024-04-26T18:13:39.471402+0000 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:39.828 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.829 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.829 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1c9c39d3dd] 2024-04-26T18:13:39.829 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.829 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.829 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: clone() 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.830 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: *** Caught signal (Aborted) ** 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: in thread 7f1c91d74700 thread_name:ms_dispatch 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1c9b125d20] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: gsignal() 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: abort() 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1c9c39d437] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.831 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 16: clone() 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.473+0000 7f1c91d74700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: in thread 7f1c91d74700 thread_name:ms_dispatch 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1c9b125d20] 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: gsignal() 2024-04-26T18:13:39.832 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: abort() 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1c9c39d437] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.833 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 16: clone() 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: -1> 2024-04-26T18:13:39.472+0000 7f1c91d74700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1c91d74700 time 2024-04-26T18:13:39.471402+0000 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1c9c39d3dd] 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.834 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: clone() 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.835 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 0> 2024-04-26T18:13:39.473+0000 7f1c91d74700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: in thread 7f1c91d74700 thread_name:ms_dispatch 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1c9b125d20] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: gsignal() 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: abort() 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1c9c39d437] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.836 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 16: clone() 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.837 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: -1> 2024-04-26T18:13:39.472+0000 7f1c91d74700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1c91d74700 time 2024-04-26T18:13:39.471402+0000 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1c9c39d3dd] 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.838 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: clone() 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.839 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 0> 2024-04-26T18:13:39.473+0000 7f1c91d74700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: in thread 7f1c91d74700 thread_name:ms_dispatch 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1c9b125d20] 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2: gsignal() 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 3: abort() 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1c9c39d437] 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1c9c39d5a3] 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5604bc8b0822] 2024-04-26T18:13:39.840 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5604bc820598] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5604bc822c17] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5604bc71bd0b] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5604bc71c2ac] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5604bc704fad] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1c9c631e20] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 13: (DispatchQueue::entry()+0x51f) [0x7f1c9c62efdf] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1c9c701fc1] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1c9b11b1ca] 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 16: clone() 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70391]: 2024-04-26T18:13:39.841 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:39 smithi156 podman[70496]: 2024-04-26 18:13:39.528699074 +0000 UTC m=+0.019488505 container died abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-26T18:13:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:39 smithi189 ceph-mon[32756]: osdmap e135: 12 total, 12 up, 12 in 2024-04-26T18:13:40.433 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:40 smithi156 podman[70496]: 2024-04-26 18:13:40.178666939 +0000 UTC m=+0.669456369 container remove abb0e33098d9109bcb645658e9ae1e98b0fea82d21a0259e66d3e53c12e8b028 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-26T18:13:40.433 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:40 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:13:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:40 smithi092 ceph-mon[29156]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 80 KiB/s wr, 7 op/s 2024-04-26T18:13:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:40 smithi189 ceph-mon[32756]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 80 KiB/s wr, 7 op/s 2024-04-26T18:13:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:40 smithi156 ceph-mon[32679]: pgmap v471: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 80 KiB/s wr, 7 op/s 2024-04-26T18:13:40.933 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:40 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:13:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:42 smithi092 ceph-mon[29156]: pgmap v472: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:42 smithi189 ceph-mon[32756]: pgmap v472: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:42 smithi156 ceph-mon[32679]: pgmap v472: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:43.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 810.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:43 smithi092 ceph-mon[29156]: pgmap v473: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:43 smithi189 ceph-mon[32756]: pgmap v473: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:43 smithi156 ceph-mon[32679]: pgmap v473: 97 pgs: 5 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 89 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 85 op/s 2024-04-26T18:13:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:45 smithi092 ceph-mon[29156]: pgmap v474: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-04-26T18:13:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:45 smithi092 ceph-mon[29156]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T18:13:46.125 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:45 smithi189 ceph-mon[32756]: pgmap v474: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-04-26T18:13:46.125 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:45 smithi189 ceph-mon[32756]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T18:13:46.125 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:13:46.126 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:45 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:46.126 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.128s CPU time. 2024-04-26T18:13:46.126 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:45 smithi189 systemd[1]: Starting Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:13:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:45 smithi156 ceph-mon[32679]: pgmap v474: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 132 op/s 2024-04-26T18:13:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:45 smithi156 ceph-mon[32679]: osdmap e136: 12 total, 12 up, 12 in 2024-04-26T18:13:46.387 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 podman[71712]: 2024-04-26 18:13:46.029012004 +0000 UTC m=+0.018657904 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:13:46.387 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 podman[71712]: 2024-04-26 18:13:46.162097115 +0000 UTC m=+0.151743000 container create 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:13:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 -- 172.21.15.92:0/2493237003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b81022f0 msgr2=0x7f47b81067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/2493237003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b81022f0 0x7f47b81067b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009930 tx=0x7f47a802a4d0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 -- 172.21.15.92:0/2493237003 shutdown_connections 2024-04-26T18:13:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/2493237003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b8106dd0 0x7f47b8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/2493237003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b81022f0 0x7f47b81067b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/2493237003 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81019d0 0x7f47b8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 -- 172.21.15.92:0/2493237003 >> 172.21.15.92:0/2493237003 conn(0x7f47b8077bb0 msgr2=0x7f47b8077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.567+0000 7f47bf4c8640 1 -- 172.21.15.92:0/2493237003 shutdown_connections 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 -- 172.21.15.92:0/2493237003 wait complete. 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 Processor -- start 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 -- start start 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 0x7f47b819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81022f0 0x7f47b819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81191d0 con 0x7f47b8106dd0 2024-04-26T18:13:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8119050 con 0x7f47b81019d0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bf4c8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8119350 con 0x7f47b81022f0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bda65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bd264640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 0x7f47b819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bda65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49476/0 (socket says 172.21.15.92:49476) 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.568+0000 7f47bda65640 1 -- 172.21.15.92:0/3636931193 learned_addr learned my addr 172.21.15.92:0/3636931193 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bca63640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81022f0 0x7f47b819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 -- 172.21.15.92:0/3636931193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81022f0 msgr2=0x7f47b819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81022f0 0x7f47b819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 -- 172.21.15.92:0/3636931193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 msgr2=0x7f47b819f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 0x7f47b819f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 -- 172.21.15.92:0/3636931193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81a4670 con 0x7f47b8106dd0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bd264640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 0x7f47b819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bda65640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e970 tx=0x7f47b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47ae7fc640 1 -- 172.21.15.92:0/3636931193 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ccc0 con 0x7f47b8106dd0 2024-04-26T18:13:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47ae7fc640 1 -- 172.21.15.92:0/3636931193 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b000ce60 con 0x7f47b8106dd0 2024-04-26T18:13:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47ae7fc640 1 -- 172.21.15.92:0/3636931193 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0010430 con 0x7f47b8106dd0 2024-04-26T18:13:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81a4960 con 0x7f47b8106dd0 2024-04-26T18:13:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.569+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81ac1f0 con 0x7f47b8106dd0 2024-04-26T18:13:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.571+0000 7f47ae7fc640 1 -- 172.21.15.92:0/3636931193 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f47b0004ff0 con 0x7f47b8106dd0 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 Processor -- start 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 -- start start 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 0x55f5602372e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f560241ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f5602444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f56019d460 con 0x55f560236f00 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f560157590 con 0x55f560237820 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47c21e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f560199420 con 0x55f5602420e0 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47ae7fc640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 0x7f47a40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bca63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 0x55f5602372e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f560241ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bca63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 0x55f5602372e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49486/0 (socket says 172.21.15.92:49486) 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bca63640 1 -- 172.21.15.92:0/402777017 learned_addr learned my addr 172.21.15.92:0/402777017 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bda65640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 0x7f47a40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bca63640 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f5602444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47ae7fc640 1 -- 172.21.15.92:0/3636931193 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 10991+0+0 (secure 0 0 0) 0x7f47b00d1600 con 0x7f47b8106dd0 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 -- 172.21.15.92:0/402777017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 msgr2=0x55f5602444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f5602444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 -- 172.21.15.92:0/402777017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 msgr2=0x55f5602372e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 0x55f5602372e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.572+0000 7f47bd264640 1 -- 172.21.15.92:0/402777017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5601640d0 con 0x55f560237820 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47bd264640 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f560241ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005fd0 tx=0x7f47b4011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f8dd79c148da1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47bda65640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 0x7f47a40a6280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ce460 tx=0x7f47b006b5b0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47a37fe640 1 -- 172.21.15.92:0/402777017 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004d20 con 0x55f560237820 2024-04-26T18:13:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47a37fe640 1 -- 172.21.15.92:0/402777017 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b400f9a0 con 0x55f560237820 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47a37fe640 1 -- 172.21.15.92:0/402777017 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40043e0 con 0x55f560237820 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 -- 172.21.15.92:0/402777017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 msgr2=0x55f560241ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f560241ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005fd0 tx=0x7f47b4011c70 comp rx=0 tx=0).stop 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 -- 172.21.15.92:0/402777017 shutdown_connections 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f5602444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f560241ba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 --2- 172.21.15.92:0/402777017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560236f00 0x55f5602372e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.573+0000 7f47c21e5740 1 -- 172.21.15.92:0/402777017 >> 172.21.15.92:0/402777017 conn(0x55f560233410 msgr2=0x55f5602337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- 172.21.15.92:0/402777017 shutdown_connections 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- 172.21.15.92:0/402777017 wait complete. 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- start start 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 Processor -- start 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560236f00 0x55f56023f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f56023fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f560244d10 con 0x55f560237820 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55f560124b60 con 0x55f560236f00 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f560244e90 con 0x55f5602420e0 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47c21e5740 10 client.0 _ll_register_callbacks cb 0x55f5601492b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47bd264640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47bd264640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49488/0 (socket says 172.21.15.92:49488) 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47bd264640 1 -- 172.21.15.92:0/840483940 learned_addr learned my addr 172.21.15.92:0/840483940 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.574+0000 7f47bca63640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560236f00 0x55f56023f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bca63640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f56023fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 -- 172.21.15.92:0/840483940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 msgr2=0x55f56023fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f56023fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 -- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560236f00 msgr2=0x55f56023f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560236f00 0x55f56023f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 -- 172.21.15.92:0/840483940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f55feaf210 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bca63640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f56023fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47bd264640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005c40 tx=0x7f47b400fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c6d281a132dae2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4003a30 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 10991+0+0 (secure 0 0 0) 0x7f47b4003bd0 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b400f9a0 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=213) ==== 24+0+0 (secure 0 0 0) 0x7f47b4032050 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47c21e5740 10 client.16470 fetch_fsmap learned FSMap version 213 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=213,monmap=4+}) -- 0x55f55ff7b620 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.575+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b400f9a0 con 0x55f560237820 2024-04-26T18:13:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 213) ==== 6527+0+0 (secure 0 0 0) 0x7f47b4018070 con 0x55f560237820 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 10 client.16470 fetch_fsmap finished waiting for FSMap version 213 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 10 client.16470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 20 client.16470 populate_metadata read hostname 'smithi092' 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f560252230 0x55f5602546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 4 client.16470 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5601ab070 con 0x55f560252230 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47bca63640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f560252230 0x55f5602546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47bca63640 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f560252230 0x55f5602546a0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d629ed155e1115 server_cookie=725d214536f3ec25 in_seq=0 out_seq=0 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.576+0000 7f47a0ff9640 10 client.16470 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47a0ff9640 1 -- 172.21.15.92:0/840483940 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f5601ab070 con 0x55f560252230 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47a0ff9640 10 client.16470 handle_command_reply: tid=0 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 client.16470 shutdown 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 msgr2=0x55f56023f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005c40 tx=0x7f47b400fe00 comp rx=0 tx=0).stop 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 shutdown_connections 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f560252230 0x55f5602546a0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f5602420e0 0x55f56023fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f56023f580 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 --2- 172.21.15.92:0/840483940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560236f00 0x55f56023f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47a0ff9640 0 client.16470 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 >> 172.21.15.92:0/840483940 conn(0x55f560233410 msgr2=0x55f560239190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 shutdown_connections 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 1 -- 172.21.15.92:0/840483940 wait complete. 2024-04-26T18:13:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.577+0000 7f47c21e5740 20 client.16470 trim_cache size 0 max 16384 2024-04-26T18:13:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 Processor -- start 2024-04-26T18:13:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 -- start start 2024-04-26T18:13:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5602420e0 0x55f56025a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b7c10 con 0x55f560237820 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b6e70 con 0x55f5602420e0 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47c21e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b7540 con 0x55f560236f00 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49500/0 (socket says 172.21.15.92:49500) 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 -- 172.21.15.92:0/1085390558 learned_addr learned my addr 172.21.15.92:0/1085390558 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bca63640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5602420e0 0x55f56025a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bca63640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 -- 172.21.15.92:0/1085390558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 msgr2=0x55f56024dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 -- 172.21.15.92:0/1085390558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5602420e0 msgr2=0x55f56025a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5602420e0 0x55f56025a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bd264640 1 -- 172.21.15.92:0/1085390558 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f560232d30 con 0x55f560237820 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.592+0000 7f47bca63640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47bd264640 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f47b4011cb0 tx=0x7f47b4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fcaefea8976aeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47a2ffd640 1 -- 172.21.15.92:0/1085390558 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4011320 con 0x55f560237820 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47a2ffd640 1 -- 172.21.15.92:0/1085390558 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b4029070 con 0x55f560237820 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47a2ffd640 1 -- 172.21.15.92:0/1085390558 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b40368e0 con 0x55f560237820 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 -- 172.21.15.92:0/1085390558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 msgr2=0x55f560259fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f47b4011cb0 tx=0x7f47b4009ee0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 -- 172.21.15.92:0/1085390558 shutdown_connections 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f5602420e0 0x55f56025a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f560237820 0x55f560259fb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1085390558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 -- 172.21.15.92:0/1085390558 >> 172.21.15.92:0/1085390558 conn(0x55f560233410 msgr2=0x55f5602337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 -- 172.21.15.92:0/1085390558 shutdown_connections 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.593+0000 7f47c21e5740 1 -- 172.21.15.92:0/1085390558 wait complete. 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 -- start start 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 Processor -- start 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f56023b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b4170 con 0x55f5602420e0 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b5580 con 0x55f560237820 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81b47e0 con 0x55f560236f00 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47c21e5740 10 client.0 _ll_register_callbacks cb 0x7f47b0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:13:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47bca63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47bca63640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:49506/0 (socket says 172.21.15.92:49506) 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47bca63640 1 -- 172.21.15.92:0/1136945656 learned_addr learned my addr 172.21.15.92:0/1136945656 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47bd264640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f56023b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.594+0000 7f47bca63640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 -- 172.21.15.92:0/1136945656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 msgr2=0x55f56024a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 -- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 msgr2=0x55f56023b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f56023b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 -- 172.21.15.92:0/1136945656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f56023c650 con 0x55f5602420e0 2024-04-26T18:13:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47bca63640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009930 tx=0x7f47a802a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d7bed23f04f7a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8035040 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 10991+0+0 (secure 0 0 0) 0x7f47a8048360 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b4029070 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=213) ==== 24+0+0 (secure 0 0 0) 0x7f47a8048560 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 10 client.16476 fetch_fsmap learned FSMap version 213 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=213,monmap=4+}) -- 0x55f5602b8770 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47b4029070 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 213) ==== 6527+0+0 (secure 0 0 0) 0x7f47a8050070 con 0x55f5602420e0 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 10 client.16476 fetch_fsmap finished waiting for FSMap version 213 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 10 client.16476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 20 client.16476 populate_metadata read hostname 'smithi092' 2024-04-26T18:13:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f5602b8ef0 0x55f5602bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:13:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 4 client.16476 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:13:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.595+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5601a4ee0 con 0x55f5602b8ef0 2024-04-26T18:13:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.596+0000 7f47bd264640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f5602b8ef0 0x55f5602bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:13:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.596+0000 7f47a0ff9640 10 client.16476 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:46.596+0000 7f47bd264640 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f5602b8ef0 0x55f5602bb310 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1573a584614981f server_cookie=a42f8a8e49a76ca6 in_seq=0 out_seq=0 2024-04-26T18:13:46.747 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 podman[71712]: 2024-04-26 18:13:46.398355898 +0000 UTC m=+0.388001782 container init 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:13:46.748 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 podman[71712]: 2024-04-26 18:13:46.401040519 +0000 UTC m=+0.390686404 container start 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:13:46.748 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mds[71731]: -- 172.21.15.189:0/66597936 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5589f586fa40 con 0x5589f5842800 2024-04-26T18:13:46.748 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: starting mds.c at 2024-04-26T18:13:46.748 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 bash[71712]: 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 2024-04-26T18:13:46.748 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:13:46 smithi189 systemd[1]: Started Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: daemon mds.c restarted 2024-04-26T18:13:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:boot 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:46 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: daemon mds.c restarted 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:boot 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T18:13:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:13:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:46 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: daemon mds.c restarted 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: osdmap e137: 12 total, 12 up, 12 in 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:boot 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: Standby daemon mds.a assigned to filesystem cephfs as rank 2 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=h=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:13:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-26T18:13:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:46 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:48.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 815.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:48 smithi092 ceph-mon[29156]: pgmap v477: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 172 op/s 2024-04-26T18:13:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:resolve 2024-04-26T18:13:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:48 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:48 smithi189 ceph-mon[32756]: pgmap v477: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 172 op/s 2024-04-26T18:13:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:resolve 2024-04-26T18:13:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:48 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:48 smithi156 ceph-mon[32679]: pgmap v477: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 172 op/s 2024-04-26T18:13:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:resolve 2024-04-26T18:13:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:48 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:13:50.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:50 smithi156 ceph-mon[32679]: pgmap v478: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 554 KiB/s wr, 73 op/s 2024-04-26T18:13:50.694 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:50 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:13:50.694 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:50 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:50 smithi092 ceph-mon[29156]: pgmap v478: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 554 KiB/s wr, 73 op/s 2024-04-26T18:13:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:50 smithi189 ceph-mon[32756]: pgmap v478: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 554 KiB/s wr, 73 op/s 2024-04-26T18:13:50.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:50 smithi156 systemd[1]: Starting Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:13:50.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:50 smithi156 podman[70590]: 2024-04-26 18:13:50.820388388 +0000 UTC m=+0.018509471 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:13:50.945 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:50 smithi156 podman[70590]: 2024-04-26 18:13:50.94627229 +0000 UTC m=+0.144393359 container create 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-26T18:13:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: daemon mds.h restarted 2024-04-26T18:13:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T18:13:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:boot 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 podman[70590]: 2024-04-26 18:13:51.199235248 +0000 UTC m=+0.397356314 container init 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 podman[70590]: 2024-04-26 18:13:51.201940668 +0000 UTC m=+0.400061744 container start 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-mds[70608]: -- 172.21.15.156:0/2120310599 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae07caba40 con 0x55ae07c7f000 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: starting mds.h at 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 bash[70590]: 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c 2024-04-26T18:13:51.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:13:51 smithi156 systemd[1]: Started Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:13:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: daemon mds.h restarted 2024-04-26T18:13:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T18:13:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:boot 2024-04-26T18:13:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:13:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:51 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: daemon mds.h restarted 2024-04-26T18:13:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: osdmap e138: 12 total, 12 up, 12 in 2024-04-26T18:13:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:boot 2024-04-26T18:13:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: Standby daemon mds.l assigned to filesystem cephfs as rank 1 2024-04-26T18:13:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=a=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:13:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-26T18:13:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:51 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:52 smithi092 ceph-mon[29156]: pgmap v479: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-04-26T18:13:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:52 smithi189 ceph-mon[32756]: pgmap v479: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-04-26T18:13:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:52 smithi156 ceph-mon[32679]: pgmap v479: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-04-26T18:13:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 820.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:resolve 2024-04-26T18:13:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:53 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:resolve 2024-04-26T18:13:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:53 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:resolve 2024-04-26T18:13:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:53 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47a0ff9640 1 -- 172.21.15.92:0/1136945656 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5601a4ee0 con 0x55f5602b8ef0 2024-04-26T18:13:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47a0ff9640 10 client.16476 handle_command_reply: tid=0 2024-04-26T18:13:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 client.16476 shutdown 2024-04-26T18:13:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 msgr2=0x55f56023bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009930 tx=0x7f47a802a4d0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 shutdown_connections 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55f5602b8ef0 0x55f5602bb310 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f5602420e0 0x55f56023bf10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f560237820 0x55f56023b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47a0ff9640 0 client.16476 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.494+0000 7f47c21e5740 1 --2- 172.21.15.92:0/1136945656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f560236f00 0x55f56024a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.495+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 >> 172.21.15.92:0/1136945656 conn(0x55f560233410 msgr2=0x55f560240870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.495+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 shutdown_connections 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.495+0000 7f47c21e5740 1 -- 172.21.15.92:0/1136945656 wait complete. 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.495+0000 7f47c21e5740 20 client.16476 trim_cache size 0 max 16384 2024-04-26T18:13:54.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:13:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:13:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:13:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:13:54.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 msgr2=0x7f47a40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 0x7f47a40a6280 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ce460 tx=0x7f47b006b5b0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 msgr2=0x7f47b81a3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47b000e970 tx=0x7f47b000ed70 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 shutdown_connections 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f47a40a3dc0 0x7f47a40a6280 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8106dd0 0x7f47b81a3f40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f47b81022f0 0x7f47b819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 --2- 172.21.15.92:0/3636931193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47b81019d0 0x7f47b819f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:13:54.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 >> 172.21.15.92:0/3636931193 conn(0x7f47b8077bb0 msgr2=0x7f47b8104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 shutdown_connections 2024-04-26T18:13:54.499 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:13:54.496+0000 7f47bf4c8640 1 -- 172.21.15.92:0/3636931193 wait complete. 2024-04-26T18:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: pgmap v481: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 522 KiB/s wr, 71 op/s 2024-04-26T18:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:reconnect 2024-04-26T18:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:reconnect 2024-04-26T18:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:54 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: pgmap v481: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 522 KiB/s wr, 71 op/s 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:reconnect 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:reconnect 2024-04-26T18:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:54 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: pgmap v481: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 522 KiB/s wr, 71 op/s 2024-04-26T18:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:13:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:reconnect 2024-04-26T18:13:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:reconnect 2024-04-26T18:13:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:54 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:rejoin 2024-04-26T18:13:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:rejoin 2024-04-26T18:13:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:55 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:55 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:13:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:rejoin 2024-04-26T18:13:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:rejoin 2024-04-26T18:13:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:55 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:55.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:55 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:13:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:rejoin 2024-04-26T18:13:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:rejoin 2024-04-26T18:13:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:55 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:55 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-mon[29156]: pgmap v482: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 551 KiB/s wr, 77 op/s 2024-04-26T18:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:clientreplay 2024-04-26T18:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:active 2024-04-26T18:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:clientreplay} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-mon[29156]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe743584700 time 2024-04-26T18:13:56.501704+0000 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe74dbad3dd] 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: clone() 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.502+0000 7fe743584700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe743584700 time 2024-04-26T18:13:56.501704+0000 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe74dbad3dd] 2024-04-26T18:13:56.745 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: clone() 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: *** Caught signal (Aborted) ** 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: in thread 7fe743584700 thread_name:ms_dispatch 2024-04-26T18:13:56.746 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe74c935d20] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: gsignal() 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: abort() 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe74dbad437] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.747 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 16: clone() 2024-04-26T18:13:56.748 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.503+0000 7fe743584700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: in thread 7fe743584700 thread_name:ms_dispatch 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe74c935d20] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: gsignal() 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: abort() 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe74dbad437] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.749 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 16: clone() 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: -1> 2024-04-26T18:13:56.502+0000 7fe743584700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe743584700 time 2024-04-26T18:13:56.501704+0000 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe74dbad3dd] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.750 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: clone() 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 0> 2024-04-26T18:13:56.503+0000 7fe743584700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: in thread 7fe743584700 thread_name:ms_dispatch 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.751 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe74c935d20] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: gsignal() 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: abort() 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe74dbad437] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 16: clone() 2024-04-26T18:13:56.752 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: -1> 2024-04-26T18:13:56.502+0000 7fe743584700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe743584700 time 2024-04-26T18:13:56.501704+0000 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe74dbad3dd] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.753 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: clone() 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 0> 2024-04-26T18:13:56.503+0000 7fe743584700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: in thread 7fe743584700 thread_name:ms_dispatch 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe74c935d20] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2: gsignal() 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 3: abort() 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe74dbad437] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe74dbad5a3] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x564ba9f23822] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x564ba9e93598] 2024-04-26T18:13:56.754 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x564ba9e95c17] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x564ba9d8ed0b] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x564ba9d8f2ac] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x564ba9d77fad] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe74de41e20] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 13: (DispatchQueue::entry()+0x51f) [0x7fe74de3efdf] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe74df11fc1] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe74c92b1ca] 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 16: clone() 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[71220]: 2024-04-26T18:13:56.755 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:56 smithi092 podman[97601]: 2024-04-26 18:13:56.572807458 +0000 UTC m=+0.021846166 container died 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:13:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:56 smithi189 ceph-mon[32756]: pgmap v482: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 551 KiB/s wr, 77 op/s 2024-04-26T18:13:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:clientreplay 2024-04-26T18:13:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:active 2024-04-26T18:13:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:56 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:clientreplay} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:56 smithi189 ceph-mon[32756]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:13:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:56 smithi156 ceph-mon[32679]: pgmap v482: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 551 KiB/s wr, 77 op/s 2024-04-26T18:13:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:clientreplay 2024-04-26T18:13:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/1782342710,v1:172.21.15.189:6835/1782342710] up:active 2024-04-26T18:13:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:56 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=a=up:clientreplay} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:56 smithi156 ceph-mon[32679]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:13:57.726 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:57 smithi092 podman[97601]: 2024-04-26 18:13:57.476637814 +0000 UTC m=+0.925676525 container remove 9b309429d69afb4f98931698b07afcf85373992528e937933eacdd6ecc927148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T18:13:57.726 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:57 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:13:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:57 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:active 2024-04-26T18:13:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:57 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:57 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:57 smithi092 ceph-mon[29156]: pgmap v483: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:57 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:active 2024-04-26T18:13:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:57 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:57 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:57 smithi189 ceph-mon[32756]: pgmap v483: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:57 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1068035391,v1:172.21.15.92:6841/1068035391] up:active 2024-04-26T18:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:57 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:57 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:57 smithi156 ceph-mon[32679]: pgmap v483: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:57.993 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:57 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T18:13:57.993 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:13:57 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.387s CPU time. 2024-04-26T18:13:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 825.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:13:58.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:13:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:13:58.500+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:13:58.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:13:58 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:13:58.500+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:13:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: pgmap v484: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: pgmap v485: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 67 KiB/s wr, 23 op/s 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: pgmap v486: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 73 KiB/s wr, 25 op/s 2024-04-26T18:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:13:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: pgmap v484: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: pgmap v485: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 67 KiB/s wr, 23 op/s 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: pgmap v486: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 73 KiB/s wr, 25 op/s 2024-04-26T18:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:13:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: pgmap v484: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 448 KiB/s wr, 63 op/s 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: pgmap v485: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 67 KiB/s wr, 23 op/s 2024-04-26T18:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: pgmap v486: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 73 KiB/s wr, 25 op/s 2024-04-26T18:13:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:13:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:14:01.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd8e6590700 time 2024-04-26T18:14:01.264902+0000 2024-04-26T18:14:01.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:01.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd8f0bb93dd] 2024-04-26T18:14:01.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: clone() 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.265+0000 7fd8e6590700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd8e6590700 time 2024-04-26T18:14:01.264902+0000 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:01.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.640 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd8f0bb93dd] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.641 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: clone() 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: *** Caught signal (Aborted) ** 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: in thread 7fd8e6590700 thread_name:ms_dispatch 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd8ef941d20] 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: gsignal() 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: abort() 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd8f0bb9437] 2024-04-26T18:14:01.642 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.643 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 16: clone() 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.266+0000 7fd8e6590700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: in thread 7fd8e6590700 thread_name:ms_dispatch 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd8ef941d20] 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: gsignal() 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: abort() 2024-04-26T18:14:01.644 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd8f0bb9437] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 16: clone() 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:01.645 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: -1> 2024-04-26T18:14:01.265+0000 7fd8e6590700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd8e6590700 time 2024-04-26T18:14:01.264902+0000 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd8f0bb93dd] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.646 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: clone() 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 0> 2024-04-26T18:14:01.266+0000 7fd8e6590700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: in thread 7fd8e6590700 thread_name:ms_dispatch 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd8ef941d20] 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: gsignal() 2024-04-26T18:14:01.647 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: abort() 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd8f0bb9437] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.648 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 16: clone() 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: -1> 2024-04-26T18:14:01.265+0000 7fd8e6590700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd8e6590700 time 2024-04-26T18:14:01.264902+0000 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd8f0bb93dd] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.649 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: clone() 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 0> 2024-04-26T18:14:01.266+0000 7fd8e6590700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: in thread 7fd8e6590700 thread_name:ms_dispatch 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd8ef941d20] 2024-04-26T18:14:01.650 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2: gsignal() 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 3: abort() 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd8f0bb9437] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd8f0bb95a3] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55de84c54822] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55de84bc4598] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55de84bc6c17] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55de84abfd0b] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55de84ac02ac] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55de84aa8fad] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd8f0e4de20] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 13: (DispatchQueue::entry()+0x51f) [0x7fd8f0e4afdf] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd8f0f1dfc1] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd8ef9371ca] 2024-04-26T18:14:01.651 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 16: clone() 2024-04-26T18:14:01.652 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:01.652 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[71576]: 2024-04-26T18:14:01.652 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:01 smithi189 podman[71896]: 2024-04-26 18:14:01.327128193 +0000 UTC m=+0.021163498 container died 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:14:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:02 smithi189 ceph-mon[32756]: pgmap v487: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 79 KiB/s wr, 29 op/s 2024-04-26T18:14:02.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:02 smithi189 podman[71896]: 2024-04-26 18:14:02.195905324 +0000 UTC m=+0.889940674 container remove 69d4b5e6222120a2fc7cb0f5f840f0369480fc41ee8f78a6e805ba7d282a9bef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True) 2024-04-26T18:14:02.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:02 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:14:02.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:02 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:14:02.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:02 smithi092 ceph-mon[29156]: pgmap v487: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 79 KiB/s wr, 29 op/s 2024-04-26T18:14:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:02 smithi156 ceph-mon[32679]: pgmap v487: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 79 KiB/s wr, 29 op/s 2024-04-26T18:14:03.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 830.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:04 smithi156 ceph-mon[32679]: pgmap v488: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-26T18:14:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:04 smithi092 ceph-mon[29156]: pgmap v488: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-26T18:14:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:04 smithi189 ceph-mon[32756]: pgmap v488: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 33 KiB/s wr, 20 op/s 2024-04-26T18:14:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:06 smithi156 ceph-mon[32679]: pgmap v489: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:06 smithi092 ceph-mon[29156]: pgmap v489: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:06 smithi189 ceph-mon[32756]: pgmap v489: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- 172.21.15.92:0/1989318191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79010cfb0 msgr2=0x7ff79010f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 --2- 172.21.15.92:0/1989318191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79010cfb0 0x7ff79010f3e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff788009ca0 tx=0x7ff78802a950 comp rx=0 tx=0).stop 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- 172.21.15.92:0/1989318191 shutdown_connections 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 --2- 172.21.15.92:0/1989318191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff79010cfb0 0x7ff79010f3e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 --2- 172.21.15.92:0/1989318191 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff790104500 0x7ff79010c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 --2- 172.21.15.92:0/1989318191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790103be0 0x7ff790103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- 172.21.15.92:0/1989318191 >> 172.21.15.92:0/1989318191 conn(0x7ff790077bb0 msgr2=0x7ff790077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- 172.21.15.92:0/1989318191 shutdown_connections 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- 172.21.15.92:0/1989318191 wait complete. 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 Processor -- start 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.592+0000 7ff796e72640 1 -- start start 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790104500 0x7ff790199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 0x7ff79019d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff790112bf0 con 0x7ff790103be0 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff790112a70 con 0x7ff790104500 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff790112d70 con 0x7ff79010cfb0 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37842/0 (socket says 172.21.15.92:37842) 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 -- 172.21.15.92:0/4052966344 learned_addr learned my addr 172.21.15.92:0/4052966344 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff78ffff640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790104500 0x7ff790199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff79540f640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 0x7ff79019d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 -- 172.21.15.92:0/4052966344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 msgr2=0x7ff79019d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 0x7ff79019d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 -- 172.21.15.92:0/4052966344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790104500 msgr2=0x7ff790199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790104500 0x7ff790199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 -- 172.21.15.92:0/4052966344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79019dff0 con 0x7ff790103be0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff79540f640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 0x7ff79019d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff794c0e640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e9f0 tx=0x7ff78000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff78dffb640 1 -- 172.21.15.92:0/4052966344 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78000cd80 con 0x7ff790103be0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79019e2e0 con 0x7ff790103be0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff78dffb640 1 -- 172.21.15.92:0/4052966344 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7800108e0 con 0x7ff790103be0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.593+0000 7ff78dffb640 1 -- 172.21.15.92:0/4052966344 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780018980 con 0x7ff790103be0 2024-04-26T18:14:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.594+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901a5b70 con 0x7ff790103be0 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff78dffb640 1 -- 172.21.15.92:0/4052966344 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7ff780010430 con 0x7ff790103be0 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 Processor -- start 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 -- start start 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff78dffb640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 0x7ff7780a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f96ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f970e0 0x55cb17f994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cb17ef2460 con 0x55cb17f8bf00 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cb17eac590 con 0x55cb17f970e0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff799b8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb17eee420 con 0x55cb17f8c820 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff794c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff79540f640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 0x7ff7780a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff794c0e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37848/0 (socket says 172.21.15.92:37848) 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.596+0000 7ff794c0e640 1 -- 172.21.15.92:0/813006968 learned_addr learned my addr 172.21.15.92:0/813006968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff78dffb640 1 -- 172.21.15.92:0/4052966344 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 11077+0+0 (secure 0 0 0) 0x7ff7800d1570 con 0x7ff790103be0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff78ffff640 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f96ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff79540f640 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f970e0 0x55cb17f994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 -- 172.21.15.92:0/813006968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 msgr2=0x55cb17f96ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f96ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 -- 172.21.15.92:0/813006968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f970e0 msgr2=0x55cb17f994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f970e0 0x55cb17f994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 -- 172.21.15.92:0/813006968 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb17eb90d0 con 0x55cb17f8bf00 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff79540f640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 0x7ff7780a6280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff788005fc0 tx=0x7ff788009a20 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff794c0e640 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c6a0 tx=0x7ff78001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb277583ca98db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff776ffd640 1 -- 172.21.15.92:0/813006968 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780026040 con 0x55cb17f8bf00 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff776ffd640 1 -- 172.21.15.92:0/813006968 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff780010720 con 0x55cb17f8bf00 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.597+0000 7ff776ffd640 1 -- 172.21.15.92:0/813006968 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78009e070 con 0x55cb17f8bf00 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- 172.21.15.92:0/813006968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 msgr2=0x55cb17f8c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff78000c6a0 tx=0x7ff78001f000 comp rx=0 tx=0).stop 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- 172.21.15.92:0/813006968 shutdown_connections 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f970e0 0x55cb17f994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f96ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 --2- 172.21.15.92:0/813006968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f8bf00 0x55cb17f8c2e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- 172.21.15.92:0/813006968 >> 172.21.15.92:0/813006968 conn(0x55cb17f88410 msgr2=0x55cb17f887f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- 172.21.15.92:0/813006968 shutdown_connections 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- 172.21.15.92:0/813006968 wait complete. 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 -- start start 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.598+0000 7ff799b8d740 1 Processor -- start 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17f94020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f94560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cb17f99c50 con 0x55cb17f970e0 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55cb17e79b60 con 0x55cb17f8bf00 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55cb17f99dd0 con 0x55cb17f8c820 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff799b8d740 10 client.0 _ll_register_callbacks cb 0x55cb17e9e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff794c0e640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17f94020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37854/0 (socket says 172.21.15.92:37854) 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 -- 172.21.15.92:0/530088628 learned_addr learned my addr 172.21.15.92:0/530088628 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff78ffff640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f94560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 -- 172.21.15.92:0/530088628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 msgr2=0x55cb17f94560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f94560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 -- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 msgr2=0x55cb17f94020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17f94020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 -- 172.21.15.92:0/530088628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb17c04210 con 0x55cb17f970e0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff794c0e640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17f94020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff79540f640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff78802f780 tx=0x7ff78802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533abba49d00c705 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff76ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.599+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788034040 con 0x55cb17f970e0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 11077+0+0 (secure 0 0 0) 0x7ff78802f870 con 0x55cb17f970e0 2024-04-26T18:14:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb17f00070 con 0x55cb17f970e0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=222) ==== 24+0+0 (secure 0 0 0) 0x7ff788059050 con 0x55cb17f970e0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 10 client.16488 fetch_fsmap learned FSMap version 222 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=222,monmap=4+}) -- 0x55cb17cd0620 con 0x55cb17f970e0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cb17f00070 con 0x55cb17f970e0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 222) ==== 6523+0+0 (secure 0 0 0) 0x7ff78804a070 con 0x55cb17f970e0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 10 client.16488 fetch_fsmap finished waiting for FSMap version 222 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 20 client.16488 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb17fa7320 0x55cb17fa97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 4 client.16488 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb17ef9ee0 con 0x55cb17fa7320 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.600+0000 7ff794c0e640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb17fa7320 0x55cb17fa97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff76ffff640 10 client.16488 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff794c0e640 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb17fa7320 0x55cb17fa97c0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e11ae83dd6a25350 server_cookie=a7d3cf59665775b6 in_seq=0 out_seq=0 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff76ffff640 1 -- 172.21.15.92:0/530088628 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cb17ef9ee0 con 0x55cb17fa7320 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff76ffff640 10 client.16488 handle_command_reply: tid=0 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 client.16488 shutdown 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 msgr2=0x55cb17f94aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff78802f780 tx=0x7ff78802a950 comp rx=0 tx=0).stop 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 shutdown_connections 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb17fa7320 0x55cb17fa97c0 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17f94aa0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17f94560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff76ffff640 0 client.16488 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 --2- 172.21.15.92:0/530088628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17f94020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.601+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 >> 172.21.15.92:0/530088628 conn(0x55cb17f88410 msgr2=0x55cb17f8e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.602+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 shutdown_connections 2024-04-26T18:14:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.602+0000 7ff799b8d740 1 -- 172.21.15.92:0/530088628 wait complete. 2024-04-26T18:14:07.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.602+0000 7ff799b8d740 20 client.16488 trim_cache size 0 max 16384 2024-04-26T18:14:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 Processor -- start 2024-04-26T18:14:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 -- start start 2024-04-26T18:14:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17fa2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17faf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901b16b0 con 0x55cb17f970e0 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901b0240 con 0x55cb17f8bf00 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.616+0000 7ff799b8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901b0910 con 0x55cb17f8c820 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37864/0 (socket says 172.21.15.92:37864) 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 -- 172.21.15.92:0/4237819765 learned_addr learned my addr 172.21.15.92:0/4237819765 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff794c0e640 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17fa2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff78ffff640 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17faf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 -- 172.21.15.92:0/4237819765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 msgr2=0x55cb17faf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17faf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 -- 172.21.15.92:0/4237819765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 msgr2=0x55cb17fa2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17fa2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.622 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 -- 172.21.15.92:0/4237819765 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb17f8d190 con 0x55cb17f970e0 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff79540f640 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff788006010 tx=0x7ff788005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35c6524007a63c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff7767fc640 1 -- 172.21.15.92:0/4237819765 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788062070 con 0x55cb17f970e0 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff7767fc640 1 -- 172.21.15.92:0/4237819765 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff788050070 con 0x55cb17f970e0 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.617+0000 7ff7767fc640 1 -- 172.21.15.92:0/4237819765 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78803e070 con 0x55cb17f970e0 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- 172.21.15.92:0/4237819765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 msgr2=0x55cb17faf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff788006010 tx=0x7ff788005ef0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- 172.21.15.92:0/4237819765 shutdown_connections 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf5d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8c820 0x55cb17faf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- 172.21.15.92:0/4237819765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8bf00 0x55cb17fa2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- 172.21.15.92:0/4237819765 >> 172.21.15.92:0/4237819765 conn(0x55cb17f88410 msgr2=0x55cb17f94870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- 172.21.15.92:0/4237819765 shutdown_connections 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- 172.21.15.92:0/4237819765 wait complete. 2024-04-26T18:14:07.623 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- start start 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 Processor -- start 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8bf00 0x55cb17f91d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8c820 0x55cb17fae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901ae970 con 0x55cb17f970e0 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.618+0000 7ff799b8d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901b0fe0 con 0x55cb17f8c820 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff799b8d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff7901adc30 con 0x55cb17f8bf00 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff799b8d740 10 client.0 _ll_register_callbacks cb 0x7ff78802ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:37880/0 (socket says 172.21.15.92:37880) 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 -- 172.21.15.92:0/3442899829 learned_addr learned my addr 172.21.15.92:0/3442899829 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff78ffff640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8c820 0x55cb17fae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff794c0e640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8bf00 0x55cb17f91d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.624 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 -- 172.21.15.92:0/3442899829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8bf00 msgr2=0x55cb17f91d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8bf00 0x55cb17f91d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 -- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8c820 msgr2=0x55cb17fae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8c820 0x55cb17fae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 -- 172.21.15.92:0/3442899829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb18010930 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff79540f640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff788054910 tx=0x7ff7880545c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f84f8ea27d2e5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff76ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788062070 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 11077+0+0 (secure 0 0 0) 0x7ff788054990 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff788050070 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=222) ==== 24+0+0 (secure 0 0 0) 0x7ff78803e040 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff799b8d740 10 client.16494 fetch_fsmap learned FSMap version 222 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=222,monmap=4+}) -- 0x55cb18011b00 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.619+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff788050070 con 0x55cb17f970e0 2024-04-26T18:14:07.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 222) ==== 6523+0+0 (secure 0 0 0) 0x7ff78806ab30 con 0x55cb17f970e0 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 10 client.16494 fetch_fsmap finished waiting for FSMap version 222 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 20 client.16494 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb18012100 0x55cb18014520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 4 client.16494 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb17e755f0 con 0x55cb18012100 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff794c0e640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb18012100 0x55cb18014520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff76ffff640 10 client.16494 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:07.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:07.620+0000 7ff794c0e640 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb18012100 0x55cb18014520 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c75b6faf6aabafe server_cookie=1c83c73b2d0b689a in_seq=0 out_seq=0 2024-04-26T18:14:07.971 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:07 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:14:07.972 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:07 smithi092 systemd[1]: Stopped Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:07.972 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:07 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.387s CPU time. 2024-04-26T18:14:07.972 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:07 smithi092 systemd[1]: Starting Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:14:08.243 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:07 smithi092 podman[97882]: 2024-04-26 18:14:07.875346366 +0000 UTC m=+0.018143539 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:14:08.243 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 podman[97882]: 2024-04-26 18:14:08.019203768 +0000 UTC m=+0.162000932 container create 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-26T18:14:08.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 835.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: pgmap v490: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: daemon mds.a restarted 2024-04-26T18:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T18:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:boot 2024-04-26T18:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:08 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: pgmap v490: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: daemon mds.a restarted 2024-04-26T18:14:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:boot 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 podman[97882]: 2024-04-26 18:14:08.271960318 +0000 UTC m=+0.414757483 container init 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 podman[97882]: 2024-04-26 18:14:08.274662405 +0000 UTC m=+0.417459573 container start 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-mds[97901]: -- 172.21.15.92:0/191134287 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1fcd1da40 con 0x55a1fccf0800 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: starting mds.a at 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 bash[97882]: 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f 2024-04-26T18:14:08.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:08 smithi092 systemd[1]: Started Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: pgmap v490: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 41 KiB/s wr, 26 op/s 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: daemon mds.a restarted 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: osdmap e139: 12 total, 12 up, 12 in 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:boot 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: Standby daemon mds.c assigned to filesystem cephfs as rank 2 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 4 up:standby, 1 failed 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:08 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:replay} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:10 smithi156 ceph-mon[32679]: pgmap v492: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-04-26T18:14:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:resolve 2024-04-26T18:14:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:10 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:10 smithi092 ceph-mon[29156]: pgmap v492: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-04-26T18:14:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:resolve 2024-04-26T18:14:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:10 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:10 smithi189 ceph-mon[32756]: pgmap v492: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-04-26T18:14:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:resolve 2024-04-26T18:14:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:10 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=c=up:resolve} 2 up:standby-replay 4 up:standby 2024-04-26T18:14:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:12 smithi156 ceph-mon[32679]: pgmap v493: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:12 smithi092 ceph-mon[29156]: pgmap v493: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:12.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:12 smithi189 ceph-mon[32756]: pgmap v493: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:12.872 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:12 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:14:12.872 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:12 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:12.873 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:12 smithi189 systemd[1]: Starting Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:14:13.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:12 smithi189 podman[71990]: 2024-04-26 18:14:12.77588281 +0000 UTC m=+0.018392736 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:14:13.137 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:12 smithi189 podman[71990]: 2024-04-26 18:14:12.954873244 +0000 UTC m=+0.197383140 container create ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-26T18:14:13.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 840.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: daemon mds.l restarted 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:boot 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:13.638 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 podman[71990]: 2024-04-26 18:14:13.191288323 +0000 UTC m=+0.433798217 container init ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-26T18:14:13.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 podman[71990]: 2024-04-26 18:14:13.193901076 +0000 UTC m=+0.436410971 container start ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-26T18:14:13.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-mds[72010]: -- 172.21.15.189:0/1940310972 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55568a1a5a40 con 0x55568a178800 2024-04-26T18:14:13.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: starting mds.l at 2024-04-26T18:14:13.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 bash[71990]: ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c 2024-04-26T18:14:13.639 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:13 smithi189 systemd[1]: Started Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: daemon mds.l restarted 2024-04-26T18:14:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T18:14:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:boot 2024-04-26T18:14:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:14:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:14:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:14:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:13 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: daemon mds.l restarted 2024-04-26T18:14:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: osdmap e140: 12 total, 12 up, 12 in 2024-04-26T18:14:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:boot 2024-04-26T18:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: Standby daemon mds.h assigned to filesystem cephfs as rank 1 2024-04-26T18:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=c=up:resolve} 2 up:standby-replay 5 up:standby, 1 failed 2024-04-26T18:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-26T18:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:13 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:replay,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:14 smithi156 ceph-mon[32679]: pgmap v495: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-04-26T18:14:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:14 smithi092 ceph-mon[29156]: pgmap v495: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-04-26T18:14:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:14 smithi189 ceph-mon[32756]: pgmap v495: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-04-26T18:14:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:resolve 2024-04-26T18:14:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:15 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:resolve 2024-04-26T18:14:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:15 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:resolve 2024-04-26T18:14:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:15 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:resolve,2=c=up:resolve} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff76ffff640 1 -- 172.21.15.92:0/3442899829 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb17e755f0 con 0x55cb18012100 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff76ffff640 10 client.16494 handle_command_reply: tid=0 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 client.16494 shutdown 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 msgr2=0x55cb17faf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff788054910 tx=0x7ff7880545c0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 shutdown_connections 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55cb18012100 0x55cb18014520 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb17f970e0 0x55cb17faf0f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.456 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cb17f8c820 0x55cb17fae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff76ffff640 0 client.16494 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 --2- 172.21.15.92:0/3442899829 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55cb17f8bf00 0x55cb17f91d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 >> 172.21.15.92:0/3442899829 conn(0x55cb17f88410 msgr2=0x55cb17f8d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 shutdown_connections 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 1 -- 172.21.15.92:0/3442899829 wait complete. 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.456+0000 7ff799b8d740 20 client.16494 trim_cache size 0 max 16384 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:14:16.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:14:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 msgr2=0x7ff7780a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 0x7ff7780a6280 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff788005fc0 tx=0x7ff788009a20 comp rx=0 tx=0).stop 2024-04-26T18:14:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 msgr2=0x7ff790199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e9f0 tx=0x7ff78000eeb0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.458 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 shutdown_connections 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7ff7780a3dc0 0x7ff7780a6280 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff79010cfb0 0x7ff79019d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff790104500 0x7ff790199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 --2- 172.21.15.92:0/4052966344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff790103be0 0x7ff790199050 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 >> 172.21.15.92:0/4052966344 conn(0x7ff790077bb0 msgr2=0x7ff7900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 shutdown_connections 2024-04-26T18:14:16.459 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:16.457+0000 7ff796e72640 1 -- 172.21.15.92:0/4052966344 wait complete. 2024-04-26T18:14:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: pgmap v496: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 KiB/s wr, 18 op/s 2024-04-26T18:14:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:reconnect 2024-04-26T18:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:reconnect 2024-04-26T18:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:16 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: pgmap v496: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 KiB/s wr, 18 op/s 2024-04-26T18:14:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:reconnect 2024-04-26T18:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:reconnect 2024-04-26T18:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:16 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: pgmap v496: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 76 KiB/s wr, 18 op/s 2024-04-26T18:14:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:14:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999984 2024-04-26T18:14:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0 2024-04-26T18:14:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:reconnect 2024-04-26T18:14:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:reconnect 2024-04-26T18:14:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:16 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:reconnect,2=c=up:reconnect} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:rejoin 2024-04-26T18:14:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:rejoin 2024-04-26T18:14:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:17 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:17 smithi092 ceph-mon[29156]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:14:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:17 smithi092 ceph-mon[29156]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:14:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:rejoin 2024-04-26T18:14:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:rejoin 2024-04-26T18:14:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-mon[32756]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:14:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-mon[32756]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fba8ccdf700 time 2024-04-26T18:14:17.497473+0000 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fba973083dd] 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.888 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: clone() 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.498+0000 7fba8ccdf700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fba8ccdf700 time 2024-04-26T18:14:17.497473+0000 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:17.889 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fba973083dd] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.890 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: clone() 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: *** Caught signal (Aborted) ** 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: in thread 7fba8ccdf700 thread_name:ms_dispatch 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fba96090d20] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: gsignal() 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: abort() 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fba97308437] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.891 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.892 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 16: clone() 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.500+0000 7fba8ccdf700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: in thread 7fba8ccdf700 thread_name:ms_dispatch 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fba96090d20] 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: gsignal() 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: abort() 2024-04-26T18:14:17.893 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fba97308437] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.894 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 16: clone() 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: -1> 2024-04-26T18:14:17.498+0000 7fba8ccdf700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fba8ccdf700 time 2024-04-26T18:14:17.497473+0000 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fba973083dd] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.895 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: clone() 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 0> 2024-04-26T18:14:17.500+0000 7fba8ccdf700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: in thread 7fba8ccdf700 thread_name:ms_dispatch 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.896 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fba96090d20] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: gsignal() 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: abort() 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fba97308437] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.897 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 16: clone() 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: -1> 2024-04-26T18:14:17.498+0000 7fba8ccdf700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fba8ccdf700 time 2024-04-26T18:14:17.497473+0000 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fba973083dd] 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.898 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: clone() 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 0> 2024-04-26T18:14:17.500+0000 7fba8ccdf700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: in thread 7fba8ccdf700 thread_name:ms_dispatch 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fba96090d20] 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2: gsignal() 2024-04-26T18:14:17.899 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 3: abort() 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fba97308437] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fba973085a3] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5589f3fd7822] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5589f3f47598] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5589f3f49c17] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5589f3e42d0b] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5589f3e432ac] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5589f3e2bfad] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fba9759ce20] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 13: (DispatchQueue::entry()+0x51f) [0x7fba97599fdf] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fba9766cfc1] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fba960861ca] 2024-04-26T18:14:17.900 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 16: clone() 2024-04-26T18:14:17.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:17.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c[71727]: 2024-04-26T18:14:17.901 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:17 smithi189 podman[72044]: 2024-04-26 18:14:17.572593772 +0000 UTC m=+0.025278644 container died 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:rejoin 2024-04-26T18:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:rejoin 2024-04-26T18:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:17 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:rejoin,2=c=up:rejoin} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:17 smithi156 ceph-mon[32679]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-26T18:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:17 smithi156 ceph-mon[32679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-26T18:14:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 845.0 s, 410.0 tps, lat 2089.892 ms stddev 9077.795 2024-04-26T18:14:18.700 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:18 smithi189 podman[72044]: 2024-04-26 18:14:18.455759648 +0000 UTC m=+0.908444522 container remove 0cf65dfe2e1959137a58e274243782a5ffee9105932f435031275f5e68d3b202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:18 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: pgmap v497: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:active 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:active 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:18.701 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: pgmap v497: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:active 2024-04-26T18:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:active 2024-04-26T18:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:14:18.834 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:14:18.501+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:14:18.501+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: pgmap v497: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 68 KiB/s wr, 16 op/s 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6832/2260011962,v1:172.21.15.189:6833/2260011962] up:active 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6832/630207370,v1:172.21.15.156:6833/630207370] up:active 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 1 up:standby-replay 5 up:standby 2024-04-26T18:14:18.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=c=up:active} 3 up:standby-replay 3 up:standby 2024-04-26T18:14:19.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:18 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:14:19.137 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:18 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.132s CPU time. 2024-04-26T18:14:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:20 smithi092 ceph-mon[29156]: pgmap v498: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 817 KiB/s wr, 68 op/s 2024-04-26T18:14:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:20 smithi189 ceph-mon[32756]: pgmap v498: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 817 KiB/s wr, 68 op/s 2024-04-26T18:14:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:20 smithi156 ceph-mon[32679]: pgmap v498: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 817 KiB/s wr, 68 op/s 2024-04-26T18:14:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:22 smithi092 ceph-mon[29156]: pgmap v499: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 848 KiB/s wr, 75 op/s 2024-04-26T18:14:22.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-mon[32679]: pgmap v499: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 848 KiB/s wr, 75 op/s 2024-04-26T18:14:22.844 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7ec04f0700 time 2024-04-26T18:14:22.475153+0000 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7ecab193dd] 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.845 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: clone() 2024-04-26T18:14:22.846 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.475+0000 7f7ec04f0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7ec04f0700 time 2024-04-26T18:14:22.475153+0000 2024-04-26T18:14:22.847 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:22.847 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7ecab193dd] 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.848 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: clone() 2024-04-26T18:14:22.849 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: *** Caught signal (Aborted) ** 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: in thread 7f7ec04f0700 thread_name:ms_dispatch 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7ec98a1d20] 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: gsignal() 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: abort() 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7ecab19437] 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.850 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 16: clone() 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.477+0000 7f7ec04f0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: in thread 7f7ec04f0700 thread_name:ms_dispatch 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.851 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7ec98a1d20] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: gsignal() 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: abort() 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7ecab19437] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.852 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 16: clone() 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: -1> 2024-04-26T18:14:22.475+0000 7f7ec04f0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7ec04f0700 time 2024-04-26T18:14:22.475153+0000 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7ecab193dd] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.853 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: clone() 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 0> 2024-04-26T18:14:22.477+0000 7f7ec04f0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: in thread 7f7ec04f0700 thread_name:ms_dispatch 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.854 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7ec98a1d20] 2024-04-26T18:14:22.855 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: gsignal() 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: abort() 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7ecab19437] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.856 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 16: clone() 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: -1> 2024-04-26T18:14:22.475+0000 7f7ec04f0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f7ec04f0700 time 2024-04-26T18:14:22.475153+0000 2024-04-26T18:14:22.857 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f7ecab193dd] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.858 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: clone() 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 0> 2024-04-26T18:14:22.477+0000 7f7ec04f0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: in thread 7f7ec04f0700 thread_name:ms_dispatch 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f7ec98a1d20] 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2: gsignal() 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 3: abort() 2024-04-26T18:14:22.859 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f7ecab19437] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f7ecab195a3] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55ae05c74822] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55ae05be4598] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55ae05be6c17] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55ae05adfd0b] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55ae05ae02ac] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55ae05ac8fad] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f7ecadade20] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 13: (DispatchQueue::entry()+0x51f) [0x7f7ecadaafdf] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f7ecae7dfc1] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f7ec98971ca] 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 16: clone() 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h[70604]: 2024-04-26T18:14:22.860 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:22 smithi156 podman[70794]: 2024-04-26 18:14:22.534342619 +0000 UTC m=+0.019367566 container died 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-26T18:14:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:22 smithi189 ceph-mon[32756]: pgmap v499: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 848 KiB/s wr, 75 op/s 2024-04-26T18:14:23.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:23.683 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:23 smithi156 podman[70794]: 2024-04-26 18:14:23.288945213 +0000 UTC m=+0.773970161 container remove 409e269acb5a78fee50316c01caf9e2bfb43fd4e456b72190c6cf0a8cbacaa5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-h, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:14:23.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:23 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:14:23.684 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:23 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:14:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:24 smithi092 ceph-mon[29156]: pgmap v500: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 839 KiB/s wr, 75 op/s 2024-04-26T18:14:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:24 smithi189 ceph-mon[32756]: pgmap v500: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 839 KiB/s wr, 75 op/s 2024-04-26T18:14:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:24 smithi156 ceph-mon[32679]: pgmap v500: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 839 KiB/s wr, 75 op/s 2024-04-26T18:14:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:26 smithi092 ceph-mon[29156]: pgmap v501: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.0 MiB/s wr, 109 op/s 2024-04-26T18:14:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:26 smithi189 ceph-mon[32756]: pgmap v501: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.0 MiB/s wr, 109 op/s 2024-04-26T18:14:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:26 smithi156 ceph-mon[32679]: pgmap v501: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 1.0 MiB/s wr, 109 op/s 2024-04-26T18:14:28.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:28 smithi092 ceph-mon[29156]: pgmap v502: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-04-26T18:14:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:28 smithi189 ceph-mon[32756]: pgmap v502: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-04-26T18:14:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:28 smithi156 ceph-mon[32679]: pgmap v502: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: Stopped Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Consumed 1.132s CPU time. 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Start request repeated too quickly. 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-04-26T18:14:29.388 INFO:journalctl@ceph.mds.c.smithi189.stdout:Apr 26 18:14:28 smithi189 systemd[1]: Failed to start Ceph mds.c for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- 172.21.15.92:0/4080216673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 msgr2=0x7f81c0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/4080216673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c0107ce0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f81b0009900 tx=0x7f81b002a410 comp rx=0 tx=0).stop 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- 172.21.15.92:0/4080216673 shutdown_connections 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/4080216673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 0x7f81c010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/4080216673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 0x7f81c006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/4080216673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c0107ce0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- 172.21.15.92:0/4080216673 >> 172.21.15.92:0/4080216673 conn(0x7f81c0078610 msgr2=0x7f81c0078a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- 172.21.15.92:0/4080216673 shutdown_connections 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- 172.21.15.92:0/4080216673 wait complete. 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 Processor -- start 2024-04-26T18:14:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.551+0000 7f81c4cb8640 1 -- start start 2024-04-26T18:14:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 0x7f81c01990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 0x7f81c0199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0112c20 con 0x7f81c0107900 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0112aa0 con 0x7f81c006bab0 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0112da0 con 0x7f81c006b110 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40050/0 (socket says 172.21.15.92:40050) 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 -- 172.21.15.92:0/1729347641 learned_addr learned my addr 172.21.15.92:0/1729347641 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 0x7f81c0199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81be59c640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 0x7f81c01990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 -- 172.21.15.92:0/1729347641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 msgr2=0x7f81c01990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 0x7f81c01990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 -- 172.21.15.92:0/1729347641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 msgr2=0x7f81c0199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 0x7f81c0199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 -- 172.21.15.92:0/1729347641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c019e0b0 con 0x7f81c0107900 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81bed9d640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f81b800efd0 tx=0x7f81b800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81af7fe640 1 -- 172.21.15.92:0/1729347641 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b8003b70 con 0x7f81c0107900 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81af7fe640 1 -- 172.21.15.92:0/1729347641 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b8003d10 con 0x7f81c0107900 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81af7fe640 1 -- 172.21.15.92:0/1729347641 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80108a0 con 0x7f81c0107900 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.552+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c019e3a0 con 0x7f81c0107900 2024-04-26T18:14:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.553+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01a5c30 con 0x7f81c0107900 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.555+0000 7f81af7fe640 1 -- 172.21.15.92:0/1729347641 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f81b8004020 con 0x7f81c0107900 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.555+0000 7f81c79cc740 1 Processor -- start 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.555+0000 7f81c79cc740 1 -- start start 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81af7fe640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 0x7f81a80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a3382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a342ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a3454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56001a29e460 con 0x56001a338820 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56001a258590 con 0x56001a3430e0 2024-04-26T18:14:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81c79cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56001a29a420 con 0x56001a337f00 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 0x7f81a80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81af7fe640 1 -- 172.21.15.92:0/1729347641 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 11249+0+0 (secure 0 0 0) 0x7f81b80d16a0 con 0x7f81c0107900 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a3454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a342ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a342ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40062/0 (socket says 172.21.15.92:40062) 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bdd9b640 1 -- 172.21.15.92:0/2538168108 learned_addr learned my addr 172.21.15.92:0/2538168108 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81be59c640 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a3382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 -- 172.21.15.92:0/2538168108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 msgr2=0x56001a3382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a3382e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 -- 172.21.15.92:0/2538168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 msgr2=0x56001a342ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a342ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 -- 172.21.15.92:0/2538168108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001a2650d0 con 0x56001a3430e0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 0x7f81a80a6280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005d00 tx=0x7f81b400bb90 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81bed9d640 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a3454d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ce340 tx=0x7f81b8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df1674e8fa76555 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.556+0000 7f81acff9640 1 -- 172.21.15.92:0/2538168108 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b809d290 con 0x56001a3430e0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81acff9640 1 -- 172.21.15.92:0/2538168108 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b809cb90 con 0x56001a3430e0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81acff9640 1 -- 172.21.15.92:0/2538168108 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80bd110 con 0x56001a3430e0 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 -- 172.21.15.92:0/2538168108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 msgr2=0x56001a3454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a3454d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ce340 tx=0x7f81b8009bf0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 -- 172.21.15.92:0/2538168108 shutdown_connections 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a3454d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a342ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 --2- 172.21.15.92:0/2538168108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a3382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 -- 172.21.15.92:0/2538168108 >> 172.21.15.92:0/2538168108 conn(0x56001a334410 msgr2=0x56001a3347f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 -- 172.21.15.92:0/2538168108 shutdown_connections 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.557+0000 7f81c79cc740 1 -- 172.21.15.92:0/2538168108 wait complete. 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 -- start start 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 Processor -- start 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a337f00 0x56001a340160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a3406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56001a345cb0 con 0x56001a3430e0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56001a225b60 con 0x56001a337f00 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56001a345e30 con 0x56001a338820 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81c79cc740 10 client.0 _ll_register_callbacks cb 0x56001a24a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40072/0 (socket says 172.21.15.92:40072) 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 -- 172.21.15.92:0/3214495186 learned_addr learned my addr 172.21.15.92:0/3214495186 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81be59c640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a337f00 0x56001a340160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a3406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 -- 172.21.15.92:0/3214495186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 msgr2=0x56001a3406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a3406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 -- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a337f00 msgr2=0x56001a340160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a337f00 0x56001a340160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.558+0000 7f81bed9d640 1 -- 172.21.15.92:0/3214495186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560019fb0210 con 0x56001a3430e0 2024-04-26T18:14:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81bed9d640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ce3f0 tx=0x7f81b8004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadc93ba435d9e37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b80b5020 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 11249+0+0 (secure 0 0 0) 0x7f81b8099200 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b809cb90 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=232) ==== 24+0+0 (secure 0 0 0) 0x7f81b8080050 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 10 client.16512 fetch_fsmap learned FSMap version 232 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=232,monmap=4+}) -- 0x56001a07c620 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b809cb90 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 232) ==== 6523+0+0 (secure 0 0 0) 0x7f81b801f020 con 0x56001a3430e0 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 10 client.16512 fetch_fsmap finished waiting for FSMap version 232 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 20 client.16512 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a353140 0x56001a355530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 4 client.16512 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56001a2ac070 con 0x56001a353140 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.559+0000 7f81be59c640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a353140 0x56001a355530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.560+0000 7f81be59c640 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a353140 0x56001a355530 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89b5feddf034f59 server_cookie=36fff22fdeeb4d97 in_seq=0 out_seq=0 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.560+0000 7f81a5ffb640 10 client.16512 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.560+0000 7f81a5ffb640 1 -- 172.21.15.92:0/3214495186 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56001a2ac070 con 0x56001a353140 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.560+0000 7f81a5ffb640 10 client.16512 handle_command_reply: tid=0 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.560+0000 7f81c79cc740 1 client.16512 shutdown 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 msgr2=0x56001a340be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ce3f0 tx=0x7f81b8004790 comp rx=0 tx=0).stop 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 shutdown_connections 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a353140 0x56001a355530 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a3430e0 0x56001a340be0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81a5ffb640 0 client.16512 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a3406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 --2- 172.21.15.92:0/3214495186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a337f00 0x56001a340160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 >> 172.21.15.92:0/3214495186 conn(0x56001a334410 msgr2=0x56001a33a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 shutdown_connections 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 1 -- 172.21.15.92:0/3214495186 wait complete. 2024-04-26T18:14:29.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.561+0000 7f81c79cc740 20 client.16512 trim_cache size 0 max 16384 2024-04-26T18:14:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.575+0000 7f81c79cc740 1 Processor -- start 2024-04-26T18:14:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.575+0000 7f81c79cc740 1 -- start start 2024-04-26T18:14:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a333d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a35ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01b16f0 con 0x56001a338820 2024-04-26T18:14:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01b0280 con 0x56001a3430e0 2024-04-26T18:14:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81c79cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01b0950 con 0x56001a337f00 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40084/0 (socket says 172.21.15.92:40084) 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 -- 172.21.15.92:0/1993785028 learned_addr learned my addr 172.21.15.92:0/1993785028 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bed9d640 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a35ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 -- 172.21.15.92:0/1993785028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 msgr2=0x56001a333d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a333d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 -- 172.21.15.92:0/1993785028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 msgr2=0x56001a35ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a35ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 -- 172.21.15.92:0/1993785028 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56001a345700 con 0x56001a338820 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x56001a3394a0 tx=0x7f81b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f15b2da96ce3308 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81a7fff640 1 -- 172.21.15.92:0/1993785028 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4010970 con 0x56001a338820 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81a7fff640 1 -- 172.21.15.92:0/1993785028 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b402c480 con 0x56001a338820 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.576+0000 7f81a7fff640 1 -- 172.21.15.92:0/1993785028 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4021670 con 0x56001a338820 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- 172.21.15.92:0/1993785028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 msgr2=0x56001a33a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x56001a3394a0 tx=0x7f81b4004730 comp rx=0 tx=0).stop 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- 172.21.15.92:0/1993785028 shutdown_connections 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a35ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a338820 0x56001a33a8c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 --2- 172.21.15.92:0/1993785028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a337f00 0x56001a333d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- 172.21.15.92:0/1993785028 >> 172.21.15.92:0/1993785028 conn(0x56001a334410 msgr2=0x56001a342220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- 172.21.15.92:0/1993785028 shutdown_connections 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- 172.21.15.92:0/1993785028 wait complete. 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 -- start start 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.577+0000 7f81c79cc740 1 Processor -- start 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a33d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a33dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01ae9b0 con 0x56001a337f00 2024-04-26T18:14:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01b1020 con 0x56001a3430e0 2024-04-26T18:14:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01adc70 con 0x56001a338820 2024-04-26T18:14:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 10 client.0 _ll_register_callbacks cb 0x7f81b40124f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:40090/0 (socket says 172.21.15.92:40090) 2024-04-26T18:14:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 -- 172.21.15.92:0/290970110 learned_addr learned my addr 172.21.15.92:0/290970110 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81bed9d640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a33dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a33d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 -- 172.21.15.92:0/290970110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 msgr2=0x56001a33d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a33d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 -- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 msgr2=0x56001a33dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a33dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 -- 172.21.15.92:0/290970110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56001a3b8810 con 0x56001a337f00 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81be59c640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f81b002a930 tx=0x7f81b0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692ee8db68b95616 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b004b060 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 11249+0+0 (secure 0 0 0) 0x7f81b0046bc0 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b402c480 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=232) ==== 24+0+0 (secure 0 0 0) 0x7f81b0052050 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 10 client.16518 fetch_fsmap learned FSMap version 232 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.578+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=232,monmap=4+}) -- 0x56001a3b9ae0 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81b402c480 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 232) ==== 6523+0+0 (secure 0 0 0) 0x7f81b0004750 con 0x56001a337f00 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 10 client.16518 fetch_fsmap finished waiting for FSMap version 232 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 20 client.16518 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a3ba1e0 0x56001a3bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 4 client.16518 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:14:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56001a2a5ee0 con 0x56001a3ba1e0 2024-04-26T18:14:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a3ba1e0 0x56001a3bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81a5ffb640 10 client.16518 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:29.579+0000 7f81bdd9b640 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a3ba1e0 0x56001a3bc600 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d42a934321945b server_cookie=4043195d69613465 in_seq=0 out_seq=0 2024-04-26T18:14:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:30 smithi092 ceph-mon[29156]: pgmap v503: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-04-26T18:14:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:30 smithi189 ceph-mon[32756]: pgmap v503: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-04-26T18:14:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:30 smithi156 ceph-mon[32679]: pgmap v503: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 1.3 MiB/s wr, 142 op/s 2024-04-26T18:14:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:32 smithi092 ceph-mon[29156]: pgmap v504: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 751 KiB/s wr, 101 op/s 2024-04-26T18:14:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:32 smithi189 ceph-mon[32756]: pgmap v504: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 751 KiB/s wr, 101 op/s 2024-04-26T18:14:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:32 smithi156 ceph-mon[32679]: pgmap v504: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 751 KiB/s wr, 101 op/s 2024-04-26T18:14:33.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:34.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:33 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:14:34.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:33 smithi156 systemd[1]: Stopped Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:34.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:33 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Start request repeated too quickly. 2024-04-26T18:14:34.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:33 smithi156 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-04-26T18:14:34.183 INFO:journalctl@ceph.mds.h.smithi156.stdout:Apr 26 18:14:33 smithi156 systemd[1]: Failed to start Ceph mds.h for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:34 smithi092 ceph-mon[29156]: pgmap v505: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 707 KiB/s wr, 92 op/s 2024-04-26T18:14:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:34 smithi189 ceph-mon[32756]: pgmap v505: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 707 KiB/s wr, 92 op/s 2024-04-26T18:14:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:34 smithi156 ceph-mon[32679]: pgmap v505: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 707 KiB/s wr, 92 op/s 2024-04-26T18:14:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:35 smithi092 ceph-mon[29156]: Replacing daemon mds.c as rank 2 with standby daemon mds.a 2024-04-26T18:14:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:35 smithi092 ceph-mon[29156]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:35 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:35 smithi092 ceph-mon[29156]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T18:14:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:35 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:35 smithi189 ceph-mon[32756]: Replacing daemon mds.c as rank 2 with standby daemon mds.a 2024-04-26T18:14:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:35 smithi189 ceph-mon[32756]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:35 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:35 smithi189 ceph-mon[32756]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T18:14:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:35 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:35 smithi156 ceph-mon[32679]: Replacing daemon mds.c as rank 2 with standby daemon mds.a 2024-04-26T18:14:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:35 smithi156 ceph-mon[32679]: MDS daemon mds.c is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:35 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:35 smithi156 ceph-mon[32679]: osdmap e141: 12 total, 12 up, 12 in 2024-04-26T18:14:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:35 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:replay} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: pgmap v507: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 771 KiB/s wr, 103 op/s 2024-04-26T18:14:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:resolve 2024-04-26T18:14:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: Replacing daemon mds.h as rank 1 with standby daemon mds.l 2024-04-26T18:14:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T18:14:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:36 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: pgmap v507: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 771 KiB/s wr, 103 op/s 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:resolve 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: Replacing daemon mds.h as rank 1 with standby daemon mds.l 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T18:14:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:36 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: pgmap v507: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 771 KiB/s wr, 103 op/s 2024-04-26T18:14:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:resolve 2024-04-26T18:14:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: Replacing daemon mds.h as rank 1 with standby daemon mds.l 2024-04-26T18:14:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: MDS daemon mds.h is removed because it is dead or otherwise unavailable. 2024-04-26T18:14:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=h=up:active,2=a=up:resolve} 2 up:standby-replay 3 up:standby 2024-04-26T18:14:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: osdmap e142: 12 total, 12 up, 12 in 2024-04-26T18:14:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:36 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:replay,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:38.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:38 smithi092 ceph-mon[29156]: pgmap v509: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 565 KiB/s wr, 77 op/s 2024-04-26T18:14:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:38 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:resolve 2024-04-26T18:14:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:38 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:38 smithi189 ceph-mon[32756]: pgmap v509: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 565 KiB/s wr, 77 op/s 2024-04-26T18:14:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:38 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:resolve 2024-04-26T18:14:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:38 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:38 smithi156 ceph-mon[32679]: pgmap v509: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 565 KiB/s wr, 77 op/s 2024-04-26T18:14:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:38 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:resolve 2024-04-26T18:14:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:38 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:resolve,2=a=up:resolve} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81a5ffb640 1 -- 172.21.15.92:0/290970110 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56001a2a5ee0 con 0x56001a3ba1e0 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81a5ffb640 10 client.16518 handle_command_reply: tid=0 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 client.16518 shutdown 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 msgr2=0x56001a33d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f81b002a930 tx=0x7f81b0009680 comp rx=0 tx=0).stop 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 shutdown_connections 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56001a3ba1e0 0x56001a3bc600 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56001a3430e0 0x56001a33dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56001a338820 0x56001a33d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81a5ffb640 0 client.16518 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.509+0000 7f81c79cc740 1 --2- 172.21.15.92:0/290970110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56001a337f00 0x56001a33d040 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 >> 172.21.15.92:0/290970110 conn(0x56001a334410 msgr2=0x56001a340090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 shutdown_connections 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c79cc740 1 -- 172.21.15.92:0/290970110 wait complete. 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c79cc740 20 client.16518 trim_cache size 0 max 16384 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:14:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 msgr2=0x7f81a80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 0x7f81a80a6280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005d00 tx=0x7f81b400bb90 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 msgr2=0x7f81c019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f81b800efd0 tx=0x7f81b800c6a0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 shutdown_connections 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f81a80a3dc0 0x7f81a80a6280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81c0107900 0x7f81c019d980 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c006bab0 0x7f81c0199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 --2- 172.21.15.92:0/1729347641 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c006b110 0x7f81c01990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.510+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 >> 172.21.15.92:0/1729347641 conn(0x7f81c0078610 msgr2=0x7f81c00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.511+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 shutdown_connections 2024-04-26T18:14:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:39.511+0000 7f81c4cb8640 1 -- 172.21.15.92:0/1729347641 wait complete. 2024-04-26T18:14:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:14:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:14:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00199994 2024-04-26T18:14:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:reconnect 2024-04-26T18:14:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:reconnect 2024-04-26T18:14:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:14:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:14:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00199994 2024-04-26T18:14:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:reconnect 2024-04-26T18:14:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:reconnect 2024-04-26T18:14:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:39 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999981 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.00199994 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:reconnect 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:reconnect 2024-04-26T18:14:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:39 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:reconnect,2=a=up:reconnect} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f62b8a0d700 time 2024-04-26T18:14:39.807821+0000 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62c30363dd] 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.198 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: clone() 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: *** Caught signal (Aborted) ** 2024-04-26T18:14:40.199 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: in thread 7f62b8a0d700 thread_name:ms_dispatch 2024-04-26T18:14:40.200 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:39.810+0000 7f62b8a0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f62b8a0d700 time 2024-04-26T18:14:39.807821+0000 2024-04-26T18:14:40.200 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:40.200 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62c30363dd] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.201 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: clone() 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f62c1dbed20] 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: gsignal() 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: abort() 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62c3036437] 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.202 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 16: clone() 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:39.812+0000 7f62b8a0d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: in thread 7f62b8a0d700 thread_name:ms_dispatch 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.203 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f62c1dbed20] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: gsignal() 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: abort() 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62c3036437] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.204 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 16: clone() 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: -1> 2024-04-26T18:14:39.810+0000 7f62b8a0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f62b8a0d700 time 2024-04-26T18:14:39.807821+0000 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62c30363dd] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.205 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: clone() 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 0> 2024-04-26T18:14:39.812+0000 7f62b8a0d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: in thread 7f62b8a0d700 thread_name:ms_dispatch 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.206 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f62c1dbed20] 2024-04-26T18:14:40.207 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: gsignal() 2024-04-26T18:14:40.207 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: abort() 2024-04-26T18:14:40.207 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62c3036437] 2024-04-26T18:14:40.207 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.207 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 16: clone() 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: -11> 2024-04-26T18:14:39.810+0000 7f62b8a0d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f62b8a0d700 time 2024-04-26T18:14:39.807821+0000 2024-04-26T18:14:40.208 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f62c30363dd] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.209 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: clone() 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: -10> 2024-04-26T18:14:39.812+0000 7f62b8a0d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: in thread 7f62b8a0d700 thread_name:ms_dispatch 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f62c1dbed20] 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2: gsignal() 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 3: abort() 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f62c3036437] 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f62c30365a3] 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a1fbf12822] 2024-04-26T18:14:40.210 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a1fbe82598] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a1fbe84c17] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a1fbd7dd0b] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a1fbd7e2ac] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a1fbd66fad] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f62c32cae20] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 13: (DispatchQueue::entry()+0x51f) [0x7f62c32c7fdf] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f62c339afc1] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f62c1db41ca] 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 16: clone() 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[97897]: 2024-04-26T18:14:40.211 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:39 smithi092 podman[98009]: 2024-04-26 18:14:39.915613133 +0000 UTC m=+0.036010984 container died 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-26T18:14:40.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:40 smithi092 podman[98009]: 2024-04-26 18:14:40.540613988 +0000 UTC m=+0.661011829 container remove 73b303c12e9a01b6a4ecd33b2517cff79fdc9d760a30d201fbb60f85d690816f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:14:40.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:40 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:14:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: pgmap v510: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 437 KiB/s wr, 61 op/s 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:rejoin 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:rejoin 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:active 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:active 2024-04-26T18:14:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:40 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T18:14:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: pgmap v510: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 437 KiB/s wr, 61 op/s 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:rejoin 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:rejoin 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:active 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:active 2024-04-26T18:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:40 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T18:14:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: pgmap v510: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 437 KiB/s wr, 61 op/s 2024-04-26T18:14:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:rejoin 2024-04-26T18:14:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:rejoin 2024-04-26T18:14:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:rejoin,2=a=up:rejoin} 1 up:standby-replay 3 up:standby 2024-04-26T18:14:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: daemon mds.a is now active in filesystem cephfs as rank 2 2024-04-26T18:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: daemon mds.l is now active in filesystem cephfs as rank 1 2024-04-26T18:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/1574376841,v1:172.21.15.92:6841/1574376841] up:active 2024-04-26T18:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.189:6834/3033366218,v1:172.21.15.189:6835/3033366218] up:active 2024-04-26T18:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:40 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=l=up:active,2=a=up:active} 3 up:standby-replay 1 up:standby 2024-04-26T18:14:41.052 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:40 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T18:14:41.052 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:40 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.242s CPU time. 2024-04-26T18:14:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:42 smithi092 ceph-mon[29156]: pgmap v511: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 437 KiB/s wr, 63 op/s 2024-04-26T18:14:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:42 smithi189 ceph-mon[32756]: pgmap v511: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 437 KiB/s wr, 63 op/s 2024-04-26T18:14:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:42 smithi156 ceph-mon[32679]: pgmap v511: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 437 KiB/s wr, 63 op/s 2024-04-26T18:14:43.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 870.0 s, 281.6 tps, lat 1571.673 ms stddev 5566.515 2024-04-26T18:14:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:43 smithi189 ceph-mon[32756]: pgmap v512: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-04-26T18:14:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:43 smithi156 ceph-mon[32679]: pgmap v512: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-04-26T18:14:43.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:14:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:14:43.504+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:14:43.934 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:14:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:14:43.504+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:14:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:43 smithi092 ceph-mon[29156]: pgmap v512: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3 op/s 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe7f3d8a700 time 2024-04-26T18:14:44.806559+0000 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe7fe3b33dd] 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.138 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: clone() 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:44.807+0000 7fe7f3d8a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe7f3d8a700 time 2024-04-26T18:14:44.806559+0000 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:45.139 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.140 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.140 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe7fe3b33dd] 2024-04-26T18:14:45.140 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.140 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.140 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: clone() 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: *** Caught signal (Aborted) ** 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: in thread 7fe7f3d8a700 thread_name:ms_dispatch 2024-04-26T18:14:45.141 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe7fd13bd20] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: gsignal() 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: abort() 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe7fe3b3437] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.142 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 16: clone() 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:44.808+0000 7fe7f3d8a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: in thread 7fe7f3d8a700 thread_name:ms_dispatch 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe7fd13bd20] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: gsignal() 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: abort() 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe7fe3b3437] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.143 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 16: clone() 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: -1> 2024-04-26T18:14:44.807+0000 7fe7f3d8a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe7f3d8a700 time 2024-04-26T18:14:44.806559+0000 2024-04-26T18:14:45.144 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe7fe3b33dd] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.145 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: clone() 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 0> 2024-04-26T18:14:44.808+0000 7fe7f3d8a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: in thread 7fe7f3d8a700 thread_name:ms_dispatch 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe7fd13bd20] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: gsignal() 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: abort() 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe7fe3b3437] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.146 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 16: clone() 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: -1> 2024-04-26T18:14:44.807+0000 7fe7f3d8a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe7f3d8a700 time 2024-04-26T18:14:44.806559+0000 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.147 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe7fe3b33dd] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: clone() 2024-04-26T18:14:45.148 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 0> 2024-04-26T18:14:44.808+0000 7fe7f3d8a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: in thread 7fe7f3d8a700 thread_name:ms_dispatch 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe7fd13bd20] 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2: gsignal() 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 3: abort() 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe7fe3b3437] 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe7fe3b35a3] 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55568749d822] 2024-04-26T18:14:45.149 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55568740d598] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55568740fc17] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555687308d0b] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5556873092ac] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5556872f1fad] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe7fe647e20] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 13: (DispatchQueue::entry()+0x51f) [0x7fe7fe644fdf] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe7fe717fc1] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe7fd1311ca] 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 16: clone() 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l[72006]: 2024-04-26T18:14:45.150 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:44 smithi189 podman[72094]: 2024-04-26 18:14:44.893606465 +0000 UTC m=+0.021201326 container died ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:14:45.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:45 smithi189 podman[72094]: 2024-04-26 18:14:45.559187169 +0000 UTC m=+0.686782012 container remove ce1c3c602f5906da53fd27ecd86702b79274b6704c9a763ee7196ae8bb556f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-l, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2) 2024-04-26T18:14:45.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:14:45.887 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:45 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:14:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:46 smithi156 ceph-mon[32679]: pgmap v513: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 724 KiB/s wr, 68 op/s 2024-04-26T18:14:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:46 smithi092 ceph-mon[29156]: pgmap v513: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 724 KiB/s wr, 68 op/s 2024-04-26T18:14:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:46 smithi189 ceph-mon[32756]: pgmap v513: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 724 KiB/s wr, 68 op/s 2024-04-26T18:14:48.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 875.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:48 smithi092 ceph-mon[29156]: pgmap v514: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 626 KiB/s wr, 59 op/s 2024-04-26T18:14:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:48 smithi156 ceph-mon[32679]: pgmap v514: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 626 KiB/s wr, 59 op/s 2024-04-26T18:14:48.688 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:48 smithi189 ceph-mon[32756]: pgmap v514: 97 pgs: 97 active+clean; 2.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 626 KiB/s wr, 59 op/s 2024-04-26T18:14:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:49 smithi156 ceph-mon[32679]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T18:14:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:49 smithi092 ceph-mon[29156]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T18:14:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:49 smithi189 ceph-mon[32756]: osdmap e143: 12 total, 12 up, 12 in 2024-04-26T18:14:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:50 smithi156 ceph-mon[32679]: pgmap v516: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-04-26T18:14:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:50 smithi092 ceph-mon[29156]: pgmap v516: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-04-26T18:14:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:50 smithi189 ceph-mon[32756]: pgmap v516: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.0 MiB/s wr, 104 op/s 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:50 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:50 smithi092 systemd[1]: Stopped Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:50 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.242s CPU time. 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 systemd[1]: Starting Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 podman[98109]: 2024-04-26 18:14:51.131840423 +0000 UTC m=+0.018736665 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:14:51.248 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 podman[98109]: 2024-04-26 18:14:51.248943504 +0000 UTC m=+0.135839732 container create edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:14:51.993 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 podman[98109]: 2024-04-26 18:14:51.568672555 +0000 UTC m=+0.455568784 container init edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=) 2024-04-26T18:14:51.994 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 podman[98109]: 2024-04-26 18:14:51.571422661 +0000 UTC m=+0.458318894 container start edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:14:51.994 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 ceph-mds[98129]: -- 172.21.15.92:0/984397853 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558e28139a40 con 0x558e2810c800 2024-04-26T18:14:51.994 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: starting mds.a at 2024-04-26T18:14:51.994 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 bash[98109]: edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf 2024-04-26T18:14:51.994 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:14:51 smithi092 systemd[1]: Started Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 -- 172.21.15.92:0/717301326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58102220 msgr2=0x7f5e5810e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 --2- 172.21.15.92:0/717301326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58102220 0x7f5e5810e6e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009cd0 tx=0x7f5e5002a8e0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 -- 172.21.15.92:0/717301326 shutdown_connections 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 --2- 172.21.15.92:0/717301326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58102220 0x7f5e5810e6e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 --2- 172.21.15.92:0/717301326 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58101860 0x7f5e58101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.614+0000 7f5e5c862640 1 --2- 172.21.15.92:0/717301326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58107820 0x7f5e58107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.615+0000 7f5e5c862640 1 -- 172.21.15.92:0/717301326 >> 172.21.15.92:0/717301326 conn(0x7f5e580789b0 msgr2=0x7f5e58078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.615+0000 7f5e5c862640 1 -- 172.21.15.92:0/717301326 shutdown_connections 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.615+0000 7f5e5c862640 1 -- 172.21.15.92:0/717301326 wait complete. 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.615+0000 7f5e5c862640 1 Processor -- start 2024-04-26T18:14:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.615+0000 7f5e5c862640 1 -- start start 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58101860 0x7f5e58197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58102220 0x7f5e58198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58111ae0 con 0x7f5e58107820 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58111960 con 0x7f5e58101860 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5c862640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58111c60 con 0x7f5e58102220 2024-04-26T18:14:52.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42144/0 (socket says 172.21.15.92:42144) 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3258663453 learned_addr learned my addr 172.21.15.92:0/3258663453 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e5659c640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58101860 0x7f5e58197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58102220 0x7f5e58198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3258663453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58102220 msgr2=0x7f5e58198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58102220 0x7f5e58198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3258663453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58101860 msgr2=0x7f5e58197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58101860 0x7f5e58197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3258663453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5819cf10 con 0x7f5e58107820 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5e50033040 tx=0x7f5e50003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.616+0000 7f5e4f7fe640 1 -- 172.21.15.92:0/3258663453 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50004040 con 0x7f5e58107820 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.617+0000 7f5e4f7fe640 1 -- 172.21.15.92:0/3258663453 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e50004690 con 0x7f5e58107820 2024-04-26T18:14:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.617+0000 7f5e4f7fe640 1 -- 172.21.15.92:0/3258663453 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e50030e20 con 0x7f5e58107820 2024-04-26T18:14:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.617+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5819d1a0 con 0x7f5e58107820 2024-04-26T18:14:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.617+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e58069fe0 con 0x7f5e58107820 2024-04-26T18:14:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.619+0000 7f5e4f7fe640 1 -- 172.21.15.92:0/3258663453 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f5e500305a0 con 0x7f5e58107820 2024-04-26T18:14:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.619+0000 7f5e5f577740 1 Processor -- start 2024-04-26T18:14:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 -- start start 2024-04-26T18:14:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4f7fe640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 0x7f5e440a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c32511ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c325144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c3246d460 con 0x556c32506f00 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x556c32427590 con 0x556c32507820 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5f577740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c32469420 con 0x556c325120e0 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e5659c640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 0x7f5e440a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42146/0 (socket says 172.21.15.92:42146) 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1762019933 learned_addr learned my addr 172.21.15.92:0/1762019933 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c325144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4f7fe640 1 -- 172.21.15.92:0/3258663453 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 11551+0+0 (secure 0 0 0) 0x7f5e5002e030 con 0x7f5e58107820 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c32511ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.626 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1762019933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 msgr2=0x556c325144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c325144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1762019933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 msgr2=0x556c32511ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c32511ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.620+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1762019933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c324340d0 con 0x556c32506f00 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.621+0000 7f5e5659c640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 0x7f5e440a6280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009b50 tx=0x7f5e48010040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.621+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5e40005d90 tx=0x7f5e4000c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1683c56df01eb48b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.621+0000 7f5e4cff9640 1 -- 172.21.15.92:0/1762019933 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40018030 con 0x556c32506f00 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.621+0000 7f5e4cff9640 1 -- 172.21.15.92:0/1762019933 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e400054d0 con 0x556c32506f00 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.621+0000 7f5e4cff9640 1 -- 172.21.15.92:0/1762019933 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000d550 con 0x556c32506f00 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- 172.21.15.92:0/1762019933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 msgr2=0x556c325072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5e40005d90 tx=0x7f5e4000c5e0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- 172.21.15.92:0/1762019933 shutdown_connections 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c325144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c32511ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1762019933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32506f00 0x556c325072e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- 172.21.15.92:0/1762019933 >> 172.21.15.92:0/1762019933 conn(0x556c32503410 msgr2=0x556c325037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- 172.21.15.92:0/1762019933 shutdown_connections 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- 172.21.15.92:0/1762019933 wait complete. 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- start start 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 Processor -- start 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 0x556c3250ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c3250fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556c32514d10 con 0x556c32507820 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x556c323f4b60 con 0x556c32506f00 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556c32514e90 con 0x556c325120e0 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e5f577740 10 client.0 _ll_register_callbacks cb 0x556c324192b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.622+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42158/0 (socket says 172.21.15.92:42158) 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1406395487 learned_addr learned my addr 172.21.15.92:0/1406395487 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e5659c640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 0x556c3250ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c3250fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1406395487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 msgr2=0x556c3250fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c3250fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 msgr2=0x556c3250ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 0x556c3250ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 -- 172.21.15.92:0/1406395487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c3217f210 con 0x556c32507820 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e5659c640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 0x556c3250ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004fd0 tx=0x7f5e40004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48975f2a717592d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4000d550 con 0x556c32507820 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 11551+0+0 (secure 0 0 0) 0x7f5e4000d6f0 con 0x556c32507820 2024-04-26T18:14:52.629 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e400054d0 con 0x556c32507820 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=242) ==== 24+0+0 (secure 0 0 0) 0x7f5e4000d8f0 con 0x556c32507820 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e5f577740 10 client.16536 fetch_fsmap learned FSMap version 242 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=242,monmap=4+}) -- 0x556c3224b620 con 0x556c32507820 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.623+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e400054d0 con 0x556c32507820 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 242) ==== 5317+0+0 (secure 0 0 0) 0x7f5e40026a90 con 0x556c32507820 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 10 client.16536 fetch_fsmap finished waiting for FSMap version 242 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 10 client.16536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 20 client.16536 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c325223e0 0x556c32524880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 4 client.16536 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c3247b070 con 0x556c325223e0 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5659c640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c325223e0 0x556c32524880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.630 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e3dffb640 10 client.16536 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.624+0000 7f5e5659c640 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c325223e0 0x556c32524880 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3dadafb5b557969 server_cookie=8163df3f821e571f in_seq=0 out_seq=0 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e3dffb640 1 -- 172.21.15.92:0/1406395487 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556c3247b070 con 0x556c325223e0 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e3dffb640 10 client.16536 handle_command_reply: tid=0 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 client.16536 shutdown 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 msgr2=0x556c3250f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004fd0 tx=0x7f5e40004aa0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 shutdown_connections 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c325223e0 0x556c32524880 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c325120e0 0x556c3250fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c32507820 0x556c3250f4d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.625+0000 7f5e5f577740 1 --2- 172.21.15.92:0/1406395487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32506f00 0x556c3250ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.626+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 >> 172.21.15.92:0/1406395487 conn(0x556c32503410 msgr2=0x556c32509190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.626+0000 7f5e3dffb640 0 client.16536 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.626+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 shutdown_connections 2024-04-26T18:14:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.626+0000 7f5e5f577740 1 -- 172.21.15.92:0/1406395487 wait complete. 2024-04-26T18:14:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.626+0000 7f5e5f577740 20 client.16536 trim_cache size 0 max 16384 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.640+0000 7f5e5f577740 1 Processor -- start 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.640+0000 7f5e5f577740 1 -- start start 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3252a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3252a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581aef50 con 0x556c325120e0 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581ad410 con 0x556c32507820 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5f577740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581ae880 con 0x556c32506f00 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42162/0 (socket says 172.21.15.92:42162) 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3242273292 learned_addr learned my addr 172.21.15.92:0/3242273292 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e5659c640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3252a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3252a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3242273292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 msgr2=0x556c3252a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3252a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3242273292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 msgr2=0x556c3252a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3252a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 -- 172.21.15.92:0/3242273292 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c32503240 con 0x556c325120e0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3252a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5e50005cc0 tx=0x7f5e50042920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eac1ec551b82db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e3ffff640 1 -- 172.21.15.92:0/3242273292 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e500bd8b0 con 0x556c325120e0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e3ffff640 1 -- 172.21.15.92:0/3242273292 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e50036040 con 0x556c325120e0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.641+0000 7f5e3ffff640 1 -- 172.21.15.92:0/3242273292 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e500d1010 con 0x556c325120e0 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- 172.21.15.92:0/3242273292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 msgr2=0x556c3250d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5e50005cc0 tx=0x7f5e50042920 comp rx=0 tx=0).stop 2024-04-26T18:14:52.646 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- 172.21.15.92:0/3242273292 shutdown_connections 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250d880 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3252a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 --2- 172.21.15.92:0/3242273292 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3252a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- 172.21.15.92:0/3242273292 >> 172.21.15.92:0/3242273292 conn(0x556c32503410 msgr2=0x556c325037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- 172.21.15.92:0/3242273292 shutdown_connections 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- 172.21.15.92:0/3242273292 wait complete. 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 -- start start 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.642+0000 7f5e5f577740 1 Processor -- start 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3250cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3250b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581ae1b0 con 0x556c325120e0 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581adae0 con 0x556c32507820 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5e581abc20 con 0x556c32506f00 2024-04-26T18:14:52.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 10 client.0 _ll_register_callbacks cb 0x7f5e4000cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:42166/0 (socket says 172.21.15.92:42166) 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 -- 172.21.15.92:0/909652094 learned_addr learned my addr 172.21.15.92:0/909652094 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5659c640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3250cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e4ffff640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3250b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 -- 172.21.15.92:0/909652094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 msgr2=0x556c3250cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3250cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 -- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 msgr2=0x556c3250b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3250b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 -- 172.21.15.92:0/909652094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c3250abb0 con 0x556c325120e0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e56d9d640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ba3b0 tx=0x7f5e50003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59a4ffe758e2921 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:14:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e500ca030 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(144..144 src has 1..144) ==== 11551+0+0 (secure 0 0 0) 0x7f5e500d0da0 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e50036040 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=242) ==== 24+0+0 (secure 0 0 0) 0x7f5e500d0050 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 10 client.16542 fetch_fsmap learned FSMap version 242 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.643+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=242,monmap=4+}) -- 0x556c32519f90 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e50036040 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 242) ==== 5317+0+0 (secure 0 0 0) 0x7f5e5004e070 con 0x556c325120e0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 10 client.16542 fetch_fsmap finished waiting for FSMap version 242 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 20 client.16542 populate_metadata read hostname 'smithi092' 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c3251a610 0x556c325935d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 4 client.16542 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c32474ee0 con 0x556c3251a610 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5659c640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c3251a610 0x556c325935d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:14:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e3dffb640 10 client.16542 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:14:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:14:52.644+0000 7f5e5659c640 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c3251a610 0x556c325935d0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c36098fd68390907 server_cookie=6252d6bdcfd6b860 in_seq=0 out_seq=0 2024-04-26T18:14:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: pgmap v517: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-04-26T18:14:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: daemon mds.a restarted 2024-04-26T18:14:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T18:14:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:boot 2024-04-26T18:14:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:14:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:14:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:52 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:replay} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: pgmap v517: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-04-26T18:14:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: daemon mds.a restarted 2024-04-26T18:14:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:boot 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:52 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:replay} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: pgmap v517: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-04-26T18:14:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: daemon mds.a restarted 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: osdmap e144: 12 total, 12 up, 12 in 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:boot 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=l=up:active} 3 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:14:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:52 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:replay} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:53.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 880.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:53 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:resolve 2024-04-26T18:14:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:53 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:53 smithi189 ceph-mon[32756]: pgmap v519: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 501 KiB/s wr, 60 op/s 2024-04-26T18:14:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:53 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:resolve 2024-04-26T18:14:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:53 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:53 smithi156 ceph-mon[32679]: pgmap v519: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 501 KiB/s wr, 60 op/s 2024-04-26T18:14:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:53 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:resolve 2024-04-26T18:14:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:53 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=l=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby 2024-04-26T18:14:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:53 smithi092 ceph-mon[29156]: pgmap v519: 97 pgs: 6 active+clean+snaptrim, 15 active+clean+snaptrim_wait, 76 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 501 KiB/s wr, 60 op/s 2024-04-26T18:14:56.387 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:14:56.388 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:55 smithi189 systemd[1]: Stopped Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:56.388 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Start request repeated too quickly. 2024-04-26T18:14:56.388 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:55 smithi189 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.l.service: Failed with result 'exit-code'. 2024-04-26T18:14:56.388 INFO:journalctl@ceph.mds.l.smithi189.stdout:Apr 26 18:14:55 smithi189 systemd[1]: Failed to start Ceph mds.l for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:14:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:56 smithi156 ceph-mon[32679]: pgmap v520: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 521 KiB/s wr, 68 op/s 2024-04-26T18:14:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:56 smithi092 ceph-mon[29156]: pgmap v520: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 521 KiB/s wr, 68 op/s 2024-04-26T18:14:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:56 smithi189 ceph-mon[32756]: pgmap v520: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 521 KiB/s wr, 68 op/s 2024-04-26T18:14:58.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 885.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:14:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:14:58 smithi156 ceph-mon[32679]: pgmap v521: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 466 KiB/s wr, 61 op/s 2024-04-26T18:14:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:14:58 smithi092 ceph-mon[29156]: pgmap v521: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 466 KiB/s wr, 61 op/s 2024-04-26T18:14:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:14:58 smithi189 ceph-mon[32756]: pgmap v521: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 466 KiB/s wr, 61 op/s 2024-04-26T18:15:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: pgmap v522: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 96 KiB/s wr, 18 op/s 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: Replacing daemon mds.l as rank 1 with standby daemon mds.g 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:15:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: pgmap v522: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 96 KiB/s wr, 18 op/s 2024-04-26T18:15:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: Replacing daemon mds.l as rank 1 with standby daemon mds.g 2024-04-26T18:15:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T18:15:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T18:15:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:15:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: pgmap v522: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 96 KiB/s wr, 18 op/s 2024-04-26T18:15:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:15:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: Replacing daemon mds.l as rank 1 with standby daemon mds.g 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: MDS daemon mds.l is removed because it is dead or otherwise unavailable. 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: osdmap e145: 12 total, 12 up, 12 in 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:15:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:15:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:01 smithi156 ceph-mon[32679]: pgmap v524: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-04-26T18:15:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:01 smithi156 ceph-mon[32679]: pgmap v525: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-26T18:15:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:01 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:resolve 2024-04-26T18:15:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:01 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:01 smithi092 ceph-mon[29156]: pgmap v524: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-04-26T18:15:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:01 smithi092 ceph-mon[29156]: pgmap v525: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-26T18:15:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:01 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:resolve 2024-04-26T18:15:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:01 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:01 smithi189 ceph-mon[32756]: pgmap v524: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-04-26T18:15:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:01 smithi189 ceph-mon[32756]: pgmap v525: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-04-26T18:15:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:01 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:resolve 2024-04-26T18:15:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:01 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.800+0000 7f5e3dffb640 1 -- 172.21.15.92:0/909652094 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c32474ee0 con 0x556c3251a610 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.800+0000 7f5e3dffb640 10 client.16542 handle_command_reply: tid=0 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.800+0000 7f5e5f577740 1 client.16542 shutdown 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 msgr2=0x556c3250b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ba3b0 tx=0x7f5e50003f70 comp rx=0 tx=0).stop 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 shutdown_connections 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x556c3251a610 0x556c325935d0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556c325120e0 0x556c3250b800 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556c32507820 0x556c3250b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e3dffb640 0 client.16542 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 --2- 172.21.15.92:0/909652094 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556c32506f00 0x556c3250cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 >> 172.21.15.92:0/909652094 conn(0x556c32503410 msgr2=0x556c3250d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 shutdown_connections 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 1 -- 172.21.15.92:0/909652094 wait complete. 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5f577740 20 client.16542 trim_cache size 0 max 16384 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:15:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.801+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 msgr2=0x7f5e440a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 0x7f5e440a6280 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009b50 tx=0x7f5e48010040 comp rx=0 tx=0).stop 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 msgr2=0x7f5e5819c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5e50033040 tx=0x7f5e50003970 comp rx=0 tx=0).stop 2024-04-26T18:15:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 shutdown_connections 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f5e440a3dc0 0x7f5e440a6280 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e58107820 0x7f5e5819c7e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5e58102220 0x7f5e58198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 --2- 172.21.15.92:0/3258663453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e58101860 0x7f5e58197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 >> 172.21.15.92:0/3258663453 conn(0x7f5e580789b0 msgr2=0x7f5e58104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 shutdown_connections 2024-04-26T18:15:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:02.802+0000 7f5e5c862640 1 -- 172.21.15.92:0/3258663453 wait complete. 2024-04-26T18:15:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:reconnect 2024-04-26T18:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:reconnect 2024-04-26T18:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:02 smithi189 ceph-mon[32756]: pgmap v526: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:reconnect 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:reconnect 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:03.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:02 smithi092 ceph-mon[29156]: pgmap v526: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T18:15:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:reconnect 2024-04-26T18:15:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:reconnect 2024-04-26T18:15:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:02 smithi156 ceph-mon[32679]: pgmap v526: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T18:15:03.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 890.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:03 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:rejoin 2024-04-26T18:15:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:03 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:rejoin 2024-04-26T18:15:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:03 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:03 smithi189 ceph-mon[32756]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:15:04.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:03 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:rejoin 2024-04-26T18:15:04.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:03 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:rejoin 2024-04-26T18:15:04.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:03 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:04.162 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:03 smithi092 ceph-mon[29156]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:15:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:03 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:rejoin 2024-04-26T18:15:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:03 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:rejoin 2024-04-26T18:15:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:03 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:03 smithi156 ceph-mon[32679]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:15:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:active 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:clientreplay 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: pgmap v527: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:active 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:04 smithi189 ceph-mon[32756]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:active 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:clientreplay 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: pgmap v527: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:active 2024-04-26T18:15:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:04 smithi156 ceph-mon[32679]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T18:15:05.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2187446336,v1:172.21.15.92:6839/2187446336] up:active 2024-04-26T18:15:05.212 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:clientreplay 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: pgmap v527: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2507862349,v1:172.21.15.92:6837/2507862349] up:active 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:05.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:04 smithi092 ceph-mon[29156]: osdmap e146: 12 total, 12 up, 12 in 2024-04-26T18:15:06.243 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:05 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.490s CPU time. 2024-04-26T18:15:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:07 smithi156 ceph-mon[32679]: pgmap v529: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 KiB/s wr, 21 op/s 2024-04-26T18:15:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:07 smithi092 ceph-mon[29156]: pgmap v529: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 KiB/s wr, 21 op/s 2024-04-26T18:15:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:07 smithi189 ceph-mon[32756]: pgmap v529: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 31 KiB/s wr, 21 op/s 2024-04-26T18:15:08.329 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 895.0 s, 122.6 tps, lat 4039.633 ms stddev 9058.535 2024-04-26T18:15:08.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:15:08 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:15:08.506+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:15:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:09 smithi156 ceph-mon[32679]: pgmap v530: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-26T18:15:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:09 smithi092 ceph-mon[29156]: pgmap v530: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-26T18:15:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:09 smithi189 ceph-mon[32756]: pgmap v530: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-04-26T18:15:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:11 smithi156 ceph-mon[32679]: pgmap v531: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:11 smithi092 ceph-mon[29156]: pgmap v531: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:11 smithi189 ceph-mon[32756]: pgmap v531: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:13.326 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 900.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:13 smithi156 ceph-mon[32679]: pgmap v532: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:13.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:13 smithi092 ceph-mon[29156]: pgmap v532: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:13 smithi189 ceph-mon[32756]: pgmap v532: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 635 KiB/s wr, 78 op/s 2024-04-26T18:15:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:15 smithi156 ceph-mon[32679]: pgmap v533: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 906 KiB/s wr, 105 op/s 2024-04-26T18:15:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:15 smithi092 ceph-mon[29156]: pgmap v533: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 906 KiB/s wr, 105 op/s 2024-04-26T18:15:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:15 smithi189 ceph-mon[32756]: pgmap v533: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 906 KiB/s wr, 105 op/s 2024-04-26T18:15:15.894 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1782101893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 msgr2=0x7fe5a4101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1782101893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a4101ce0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe598009930 tx=0x7fe59802a420 comp rx=0 tx=0).stop 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1782101893 shutdown_connections 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1782101893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4102220 0x7fe5a410e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1782101893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a4101ce0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1782101893 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4107820 0x7fe5a4107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1782101893 >> 172.21.15.92:0/1782101893 conn(0x7fe5a40789b0 msgr2=0x7fe5a4078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1782101893 shutdown_connections 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.891+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1782101893 wait complete. 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 Processor -- start 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 -- start start 2024-04-26T18:15:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 0x7fe5a4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 0x7fe5a419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111b00 con 0x7fe5a4101860 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111980 con 0x7fe5a4107820 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.892+0000 7fe5a9d7f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4111c80 con 0x7fe5a4102220 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41578/0 (socket says 172.21.15.92:41578) 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 -- 172.21.15.92:0/1001090564 learned_addr learned my addr 172.21.15.92:0/1001090564 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 0x7fe5a4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 -- 172.21.15.92:0/1001090564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 msgr2=0x7fe5a4199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 0x7fe5a4199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 -- 172.21.15.92:0/1001090564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 msgr2=0x7fe5a419da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 0x7fe5a419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 0x7fe5a419da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 -- 172.21.15.92:0/1001090564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a419e1b0 con 0x7fe5a4101860 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 0x7fe5a4199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 0x7fe5a419da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe59400d770 tx=0x7fe59400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a0ff9640 1 -- 172.21.15.92:0/1001090564 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594017070 con 0x7fe5a4101860 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a0ff9640 1 -- 172.21.15.92:0/1001090564 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5940054d0 con 0x7fe5a4101860 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a419e4a0 con 0x7fe5a4101860 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a0ff9640 1 -- 172.21.15.92:0/1001090564 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594004c30 con 0x7fe5a4101860 2024-04-26T18:15:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.893+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a41a5d30 con 0x7fe5a4101860 2024-04-26T18:15:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.895+0000 7fe5a0ff9640 1 -- 172.21.15.92:0/1001090564 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe594004e10 con 0x7fe5a4101860 2024-04-26T18:15:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.895+0000 7fe5acb75740 1 Processor -- start 2024-04-26T18:15:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 -- start start 2024-04-26T18:15:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564715735460 con 0x5647157da0e0 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5647156ef590 con 0x5647157cf820 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5acb75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564715731420 con 0x5647157cef00 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41584/0 (socket says 172.21.15.92:41584) 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 -- 172.21.15.92:0/667571257 learned_addr learned my addr 172.21.15.92:0/667571257 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a0ff9640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 0x7fe58c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 -- 172.21.15.92:0/667571257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 msgr2=0x5647157cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 -- 172.21.15.92:0/667571257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 msgr2=0x5647157d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 0x7fe58c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 -- 172.21.15.92:0/667571257 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647156fc0d0 con 0x5647157da0e0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a0ff9640 1 -- 172.21.15.92:0/1001090564 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 11637+0+0 (secure 0 0 0) 0x7fe5940d0fb0 con 0x7fe5a4101860 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.896+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe598006010 tx=0x7fe598032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55915e9e1f988ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 0x7fe58c0a6280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00f4f0 tx=0x7fe59c004b50 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe589ffb640 1 -- 172.21.15.92:0/667571257 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59803f070 con 0x5647157da0e0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe589ffb640 1 -- 172.21.15.92:0/667571257 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5980316a0 con 0x5647157da0e0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe589ffb640 1 -- 172.21.15.92:0/667571257 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598035070 con 0x5647157da0e0 2024-04-26T18:15:15.906 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 -- 172.21.15.92:0/667571257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 msgr2=0x5647157dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe598006010 tx=0x7fe598032ce0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 -- 172.21.15.92:0/667571257 shutdown_connections 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157dc4d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 --2- 172.21.15.92:0/667571257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 -- 172.21.15.92:0/667571257 >> 172.21.15.92:0/667571257 conn(0x5647157cb410 msgr2=0x5647157cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 -- 172.21.15.92:0/667571257 shutdown_connections 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.897+0000 7fe5acb75740 1 -- 172.21.15.92:0/667571257 wait complete. 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 -- start start 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 Processor -- start 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cef00 0x5647157d6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.907 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5647157dccb0 con 0x5647157da0e0 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5647156bcb60 con 0x5647157cef00 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5647157dce30 con 0x5647157cf820 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5acb75740 10 client.0 _ll_register_callbacks cb 0x5647156e12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41592/0 (socket says 172.21.15.92:41592) 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2576972644 learned_addr learned my addr 172.21.15.92:0/2576972644 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.898+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cef00 0x5647157d6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2576972644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 msgr2=0x5647157d7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cef00 msgr2=0x5647157d6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cef00 0x5647157d6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2576972644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564715447210 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe59c011b20 tx=0x7fe59c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bd2937d4c75334 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c01a450 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 11637+0+0 (secure 0 0 0) 0x7fe59c01a5f0 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5980316a0 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=248) ==== 24+0+0 (secure 0 0 0) 0x7fe59c01a830 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 10 client.16554 fetch_fsmap learned FSMap version 248 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=248,monmap=4+}) -- 0x564715513620 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5980316a0 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 248) ==== 4708+0+0 (secure 0 0 0) 0x7fe59c023070 con 0x5647157da0e0 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 10 client.16554 fetch_fsmap finished waiting for FSMap version 248 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 20 client.16554 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5647157ea610 0x5647157eca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 4 client.16554 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.899+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564715743070 con 0x5647157ea610 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.900+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5647157ea610 0x5647157eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.900+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5647157ea610 0x5647157eca90 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf72871a3277b20 server_cookie=8e0c4100d4d0aa8a in_seq=0 out_seq=0 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.900+0000 7fe582ffd640 10 client.16554 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe582ffd640 1 -- 172.21.15.92:0/2576972644 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564715743070 con 0x5647157ea610 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe582ffd640 10 client.16554 handle_command_reply: tid=0 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 client.16554 shutdown 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 msgr2=0x5647157d7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe59c011b20 tx=0x7fe59c004a40 comp rx=0 tx=0).stop 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 shutdown_connections 2024-04-26T18:15:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5647157ea610 0x5647157eca90 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d7a40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe582ffd640 0 client.16554 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2576972644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cef00 0x5647157d6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 >> 172.21.15.92:0/2576972644 conn(0x5647157cb410 msgr2=0x5647157d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 shutdown_connections 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 1 -- 172.21.15.92:0/2576972644 wait complete. 2024-04-26T18:15:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.901+0000 7fe5acb75740 20 client.16554 trim_cache size 0 max 16384 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 Processor -- start 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 -- start start 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41b0bb0 con 0x5647157da0e0 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41ae9a0 con 0x5647157cf820 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5acb75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41b04e0 con 0x5647157cef00 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41598/0 (socket says 172.21.15.92:41598) 2024-04-26T18:15:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2007865803 learned_addr learned my addr 172.21.15.92:0/2007865803 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2007865803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 msgr2=0x5647157e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2007865803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 msgr2=0x5647157d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 -- 172.21.15.92:0/2007865803 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647157dc840 con 0x5647157da0e0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe59c025cc0 tx=0x7fe59c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80ab5cece2496df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5897fa640 1 -- 172.21.15.92:0/2007865803 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c038070 con 0x5647157da0e0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5897fa640 1 -- 172.21.15.92:0/2007865803 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe59c01c0c0 con 0x5647157da0e0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.916+0000 7fe5897fa640 1 -- 172.21.15.92:0/2007865803 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0256a0 con 0x5647157da0e0 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- 172.21.15.92:0/2007865803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 msgr2=0x5647157d8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:15.923 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe59c025cc0 tx=0x7fe59c0117b0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- 172.21.15.92:0/2007865803 shutdown_connections 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157da0e0 0x5647157d8f00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157cf820 0x5647157d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 --2- 172.21.15.92:0/2007865803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cef00 0x5647157e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- 172.21.15.92:0/2007865803 >> 172.21.15.92:0/2007865803 conn(0x5647157cb410 msgr2=0x5647157d87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- 172.21.15.92:0/2007865803 shutdown_connections 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- 172.21.15.92:0/2007865803 wait complete. 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.917+0000 7fe5acb75740 1 -- start start 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 Processor -- start 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157da0e0 0x56471584fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41af740 con 0x5647157cef00 2024-04-26T18:15:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41af070 con 0x5647157da0e0 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a41afe10 con 0x5647157cf820 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5acb75740 10 client.0 _ll_register_callbacks cb 0x7fe59c007d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:41614/0 (socket says 172.21.15.92:41614) 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 -- 172.21.15.92:0/953806785 learned_addr learned my addr 172.21.15.92:0/953806785 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a3fff640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157da0e0 0x56471584fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 -- 172.21.15.92:0/953806785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 msgr2=0x5647157d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 -- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157da0e0 msgr2=0x56471584fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157da0e0 0x56471584fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 -- 172.21.15.92:0/953806785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564715850150 con 0x5647157cef00 2024-04-26T18:15:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe5a37fe640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe594098780 tx=0x7fe59409bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecad3b850f8c085a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe582ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.918+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594020040 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(146..146 src has 1..146) ==== 11637+0+0 (secure 0 0 0) 0x7fe5940cdd50 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe59c01c0c0 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=248) ==== 24+0+0 (secure 0 0 0) 0x7fe594005680 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 10 client.16560 fetch_fsmap learned FSMap version 248 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=248,monmap=4+}) -- 0x5647158513e0 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe59c01c0c0 con 0x5647157cef00 2024-04-26T18:15:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 248) ==== 4708+0+0 (secure 0 0 0) 0x7fe594098990 con 0x5647157cef00 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 10 client.16560 fetch_fsmap finished waiting for FSMap version 248 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 20 client.16560 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x564715851ab0 0x564715853ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 4 client.16560 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56471573cee0 con 0x564715851ab0 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.919+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x564715851ab0 0x564715853ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.920+0000 7fe582ffd640 10 client.16560 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:15.920+0000 7fe5a2ffd640 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x564715851ab0 0x564715853ed0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0ab8223753504d server_cookie=943d6aa5c7562996 in_seq=0 out_seq=0 2024-04-26T18:15:16.376 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:15:16.377 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:15 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:16.377 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.490s CPU time. 2024-04-26T18:15:16.377 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 systemd[1]: Starting Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:15:16.377 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 podman[98509]: 2024-04-26 18:15:16.124676292 +0000 UTC m=+0.018352122 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:15:16.377 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 podman[98509]: 2024-04-26 18:15:16.232498585 +0000 UTC m=+0.126174400 container create 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:15:16.628 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 podman[98509]: 2024-04-26 18:15:16.511683551 +0000 UTC m=+0.405359371 container init 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:15:16.629 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 podman[98509]: 2024-04-26 18:15:16.521277069 +0000 UTC m=+0.414952888 container start 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-04-26T18:15:16.629 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 ceph-mds[98528]: -- 172.21.15.92:0/1409828487 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f49647da40 con 0x55f496450c00 2024-04-26T18:15:16.629 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: starting mds.d at 2024-04-26T18:15:16.629 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 bash[98509]: 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a 2024-04-26T18:15:16.993 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:16 smithi092 systemd[1]: Started Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: pgmap v534: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 903 KiB/s wr, 103 op/s 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: daemon mds.d restarted 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:boot 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:17.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:17 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: pgmap v534: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 903 KiB/s wr, 103 op/s 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: daemon mds.d restarted 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:boot 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:17 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: pgmap v534: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 903 KiB/s wr, 103 op/s 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: daemon mds.d restarted 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: osdmap e147: 12 total, 12 up, 12 in 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:boot 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:17 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:18.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 905.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:resolve 2024-04-26T18:15:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:18 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:18 smithi189 ceph-mon[32756]: pgmap v536: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1024 KiB/s wr, 116 op/s 2024-04-26T18:15:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:resolve 2024-04-26T18:15:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:18 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:18 smithi156 ceph-mon[32679]: pgmap v536: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1024 KiB/s wr, 116 op/s 2024-04-26T18:15:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:resolve 2024-04-26T18:15:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:18 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:18 smithi092 ceph-mon[29156]: pgmap v536: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 1024 KiB/s wr, 116 op/s 2024-04-26T18:15:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.591+0000 7fe582ffd640 1 -- 172.21.15.92:0/953806785 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56471573cee0 con 0x564715851ab0 2024-04-26T18:15:19.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.591+0000 7fe582ffd640 10 client.16560 handle_command_reply: tid=0 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.591+0000 7fe5acb75740 1 client.16560 shutdown 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 msgr2=0x5647157d4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe594098780 tx=0x7fe59409bd40 comp rx=0 tx=0).stop 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 shutdown_connections 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x564715851ab0 0x564715853ed0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5647157da0e0 0x56471584fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5647157cf820 0x5647157d48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe582ffd640 0 client.16560 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 --2- 172.21.15.92:0/953806785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5647157cef00 0x5647157d4380 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 >> 172.21.15.92:0/953806785 conn(0x5647157cb410 msgr2=0x5647157d7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 shutdown_connections 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 1 -- 172.21.15.92:0/953806785 wait complete. 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.592+0000 7fe5acb75740 20 client.16560 trim_cache size 0 max 16384 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:15:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:15:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 msgr2=0x7fe58c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 0x7fe58c0a6280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00f4f0 tx=0x7fe59c004b50 comp rx=0 tx=0).stop 2024-04-26T18:15:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 msgr2=0x7fe5a41991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe59400d770 tx=0x7fe59400dc30 comp rx=0 tx=0).stop 2024-04-26T18:15:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 shutdown_connections 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe58c0a3dc0 0x7fe58c0a6280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a4107820 0x7fe5a419da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5a4102220 0x7fe5a4199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 --2- 172.21.15.92:0/1001090564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5a4101860 0x7fe5a41991c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 >> 172.21.15.92:0/1001090564 conn(0x7fe5a40789b0 msgr2=0x7fe5a406a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 shutdown_connections 2024-04-26T18:15:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:19.593+0000 7fe5a9d7f640 1 -- 172.21.15.92:0/1001090564 wait complete. 2024-04-26T18:15:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:19 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:15:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:19 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:15:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:19 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:reconnect 2024-04-26T18:15:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:19 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:19 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:15:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:19 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:15:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:19 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:reconnect 2024-04-26T18:15:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:19 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:19 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:19 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:19 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:reconnect 2024-04-26T18:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:19 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:20 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:rejoin 2024-04-26T18:15:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:20 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:20 smithi189 ceph-mon[32756]: pgmap v537: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:20 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:rejoin 2024-04-26T18:15:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:20 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:20 smithi156 ceph-mon[32679]: pgmap v537: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:20 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:rejoin 2024-04-26T18:15:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:20 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:20 smithi092 ceph-mon[29156]: pgmap v537: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:clientreplay 2024-04-26T18:15:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:21 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:21 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:15:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:clientreplay 2024-04-26T18:15:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:21 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:21 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:15:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:clientreplay 2024-04-26T18:15:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:15:21.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6e8d967700 time 2024-04-26T18:15:21.655092+0000 2024-04-26T18:15:21.995 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:21.995 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:21.995 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6e97f903dd] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:21.996 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: clone() 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:21.655+0000 7f6e8d967700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6e8d967700 time 2024-04-26T18:15:21.655092+0000 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6e97f903dd] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:21.997 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: clone() 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: *** Caught signal (Aborted) ** 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: in thread 7f6e8d967700 thread_name:ms_dispatch 2024-04-26T18:15:21.998 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6e96d18d20] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: gsignal() 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: abort() 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6e97f90437] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:21.999 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 16: clone() 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:21.657+0000 7f6e8d967700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: in thread 7f6e8d967700 thread_name:ms_dispatch 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6e96d18d20] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: gsignal() 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: abort() 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6e97f90437] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:22.000 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:22.001 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.002 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.002 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.002 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 16: clone() 2024-04-26T18:15:22.002 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: -1> 2024-04-26T18:15:21.655+0000 7f6e8d967700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6e8d967700 time 2024-04-26T18:15:21.655092+0000 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6e97f903dd] 2024-04-26T18:15:22.003 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.004 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: clone() 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 0> 2024-04-26T18:15:21.657+0000 7f6e8d967700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: in thread 7f6e8d967700 thread_name:ms_dispatch 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.005 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6e96d18d20] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: gsignal() 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: abort() 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6e97f90437] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:22.006 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 16: clone() 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: -1> 2024-04-26T18:15:21.655+0000 7f6e8d967700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6e8d967700 time 2024-04-26T18:15:21.655092+0000 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:22.007 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6e97f903dd] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:22.008 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: clone() 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 0> 2024-04-26T18:15:21.657+0000 7f6e8d967700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: in thread 7f6e8d967700 thread_name:ms_dispatch 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6e96d18d20] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2: gsignal() 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 3: abort() 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6e97f90437] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6e97f905a3] 2024-04-26T18:15:22.009 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561c78b87822] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561c78af7598] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561c78af9c17] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561c789f2d0b] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561c789f32ac] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561c789dbfad] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6e98224e20] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 13: (DispatchQueue::entry()+0x51f) [0x7f6e98221fdf] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6e982f4fc1] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6e96d0e1ca] 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 16: clone() 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[69502]: 2024-04-26T18:15:22.010 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:21 smithi092 podman[98565]: 2024-04-26 18:15:21.755390161 +0000 UTC m=+0.027044386 container died ed84c618f5770e32f0ad3ebd10a45f1c03c4209469163428cc766112f4ec3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-26T18:15:22.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:22 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:active 2024-04-26T18:15:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:22 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:22 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:22 smithi092 ceph-mon[29156]: pgmap v538: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:22 smithi092 podman[98565]: 2024-04-26 18:15:22.423703031 +0000 UTC m=+0.695357263 container remove ed84c618f5770e32f0ad3ebd10a45f1c03c4209469163428cc766112f4ec3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:15:22.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.494s CPU time. 2024-04-26T18:15:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:22 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:active 2024-04-26T18:15:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:22 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:22 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:15:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:22 smithi189 ceph-mon[32756]: pgmap v538: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:22 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2096672832,v1:172.21.15.92:6835/2096672832] up:active 2024-04-26T18:15:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:22 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:22 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:15:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:22 smithi156 ceph-mon[32679]: pgmap v538: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 821 KiB/s wr, 108 op/s 2024-04-26T18:15:23.328 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 910.0 s, 15.4 tps, lat 16618.412 ms stddev 66.535 2024-04-26T18:15:23.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:15:23 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:15:23.507+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:15:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:25 smithi156 ceph-mon[32679]: pgmap v539: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 637 KiB/s wr, 102 op/s 2024-04-26T18:15:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:25 smithi092 ceph-mon[29156]: pgmap v539: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 637 KiB/s wr, 102 op/s 2024-04-26T18:15:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:25 smithi189 ceph-mon[32756]: pgmap v539: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 637 KiB/s wr, 102 op/s 2024-04-26T18:15:26.994 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f89d9bf6700 time 2024-04-26T18:15:26.622957+0000 2024-04-26T18:15:26.994 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:26.994 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:26.994 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f89e421f3dd] 2024-04-26T18:15:26.994 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: clone() 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: *** Caught signal (Aborted) ** 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: in thread 7f89d9bf6700 thread_name:ms_dispatch 2024-04-26T18:15:26.995 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:26.623+0000 7f89d9bf6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f89d9bf6700 time 2024-04-26T18:15:26.622957+0000 2024-04-26T18:15:26.996 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:26.996 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f89e421f3dd] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:26.997 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: clone() 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f89e2fa7d20] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: gsignal() 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: abort() 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f89e421f437] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:26.998 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 16: clone() 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:26.625+0000 7f89d9bf6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: in thread 7f89d9bf6700 thread_name:ms_dispatch 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f89e2fa7d20] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: gsignal() 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: abort() 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f89e421f437] 2024-04-26T18:15:26.999 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 16: clone() 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.000 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: -1> 2024-04-26T18:15:26.623+0000 7f89d9bf6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f89d9bf6700 time 2024-04-26T18:15:26.622957+0000 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f89e421f3dd] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:27.001 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: clone() 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 0> 2024-04-26T18:15:26.625+0000 7f89d9bf6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: in thread 7f89d9bf6700 thread_name:ms_dispatch 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f89e2fa7d20] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: gsignal() 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: abort() 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f89e421f437] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:27.002 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 16: clone() 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: -1> 2024-04-26T18:15:26.623+0000 7f89d9bf6700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f89d9bf6700 time 2024-04-26T18:15:26.622957+0000 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:27.003 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f89e421f3dd] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:27.004 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: clone() 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 0> 2024-04-26T18:15:26.625+0000 7f89d9bf6700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: in thread 7f89d9bf6700 thread_name:ms_dispatch 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f89e2fa7d20] 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2: gsignal() 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 3: abort() 2024-04-26T18:15:27.005 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f89e421f437] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f89e421f5a3] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55a746b85822] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55a746af5598] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55a746af7c17] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55a7469f0d0b] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55a7469f12ac] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55a7469d9fad] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f89e44b3e20] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 13: (DispatchQueue::entry()+0x51f) [0x7f89e44b0fdf] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f89e4583fc1] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f89e2f9d1ca] 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 16: clone() 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:27.006 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[70781]: 2024-04-26T18:15:27.007 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:26 smithi092 podman[98610]: 2024-04-26 18:15:26.687123165 +0000 UTC m=+0.020616995 container died 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T18:15:27.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:27 smithi092 ceph-mon[29156]: pgmap v540: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 514 KiB/s wr, 89 op/s 2024-04-26T18:15:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:27 smithi156 ceph-mon[32679]: pgmap v540: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 514 KiB/s wr, 89 op/s 2024-04-26T18:15:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:27 smithi189 ceph-mon[32756]: pgmap v540: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 514 KiB/s wr, 89 op/s 2024-04-26T18:15:27.648 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:27 smithi092 podman[98610]: 2024-04-26 18:15:27.395324082 +0000 UTC m=+0.728817904 container remove 865e38cf91786893a9daf2040f5e3ddee5e5ebf3fb7b1c1d68aabec165ced569 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T18:15:27.648 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:27 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:15:27.993 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:27 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-04-26T18:15:27.993 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:27 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Consumed 1.254s CPU time. 2024-04-26T18:15:28.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 915.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:29 smithi156 ceph-mon[32679]: pgmap v541: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 444 KiB/s wr, 77 op/s 2024-04-26T18:15:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:29 smithi092 ceph-mon[29156]: pgmap v541: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 444 KiB/s wr, 77 op/s 2024-04-26T18:15:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:29 smithi189 ceph-mon[32756]: pgmap v541: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 444 KiB/s wr, 77 op/s 2024-04-26T18:15:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:31 smithi156 ceph-mon[32679]: pgmap v542: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 428 KiB/s wr, 77 op/s 2024-04-26T18:15:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:31 smithi092 ceph-mon[29156]: pgmap v542: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 428 KiB/s wr, 77 op/s 2024-04-26T18:15:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:31 smithi189 ceph-mon[32756]: pgmap v542: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 428 KiB/s wr, 77 op/s 2024-04-26T18:15:32.697 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.695+0000 7fc9c44ea640 1 -- 172.21.15.92:0/1452473391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc103b60 msgr2=0x7fc9bc103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.695+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/1452473391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc103b60 0x7fc9bc103f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009900 tx=0x7fc9b802a480 comp rx=0 tx=0).stop 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- 172.21.15.92:0/1452473391 shutdown_connections 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/1452473391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc10cf30 0x7fc9bc10f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/1452473391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc104480 0x7fc9bc10c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/1452473391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc103b60 0x7fc9bc103f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- 172.21.15.92:0/1452473391 >> 172.21.15.92:0/1452473391 conn(0x7fc9bc0789b0 msgr2=0x7fc9bc078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- 172.21.15.92:0/1452473391 shutdown_connections 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- 172.21.15.92:0/1452473391 wait complete. 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 Processor -- start 2024-04-26T18:15:32.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- start start 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 0x7fc9bc1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc10cf30 0x7fc9bc19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112bc0 con 0x7fc9bc103b60 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112a40 con 0x7fc9bc10cf30 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.696+0000 7fc9c44ea640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc112d40 con 0x7fc9bc104480 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33510/0 (socket says 172.21.15.92:33510) 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 -- 172.21.15.92:0/686016901 learned_addr learned my addr 172.21.15.92:0/686016901 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc10cf30 0x7fc9bc19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 0x7fc9bc1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 -- 172.21.15.92:0/686016901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 msgr2=0x7fc9bc1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.699 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 0x7fc9bc1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 -- 172.21.15.92:0/686016901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc10cf30 msgr2=0x7fc9bc19d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc10cf30 0x7fc9bc19d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 -- 172.21.15.92:0/686016901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc19e090 con 0x7fc9bc103b60 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 0x7fc9bc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c2286640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8005940 tx=0x7fc9b80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9b37fe640 1 -- 172.21.15.92:0/686016901 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b803f030 con 0x7fc9bc103b60 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc19e320 con 0x7fc9bc103b60 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9b37fe640 1 -- 172.21.15.92:0/686016901 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b80044c0 con 0x7fc9bc103b60 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9b37fe640 1 -- 172.21.15.92:0/686016901 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8035070 con 0x7fc9bc103b60 2024-04-26T18:15:32.700 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.697+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc1a5c10 con 0x7fc9bc103b60 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.700+0000 7fc9b37fe640 1 -- 172.21.15.92:0/686016901 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fc9b8042030 con 0x7fc9bc103b60 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.700+0000 7fc9c7203740 1 Processor -- start 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 -- start start 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff4820 0x5561acffeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 0x5561ad0014d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5561acf5a460 con 0x5561acff4820 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5561acf14590 con 0x5561acff3f00 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c7203740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5561acf56420 con 0x5561acfff0e0 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9b37fe640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 0x7fc9a80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff4820 0x5561acffeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:47630/0 (socket says 172.21.15.92:47630) 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 -- 172.21.15.92:0/347852943 learned_addr learned my addr 172.21.15.92:0/347852943 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 0x7fc9a80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 0x5561ad0014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9b37fe640 1 -- 172.21.15.92:0/686016901 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 11679+0+0 (secure 0 0 0) 0x7fc9b80f1850 con 0x7fc9bc103b60 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 -- 172.21.15.92:0/347852943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 msgr2=0x5561ad0014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 0x5561ad0014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 -- 172.21.15.92:0/347852943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff4820 msgr2=0x5561acffeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff4820 0x5561acffeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c2a87640 1 -- 172.21.15.92:0/347852943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561acf210d0 con 0x5561acff3f00 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.701+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 0x5561ad0014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.702+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 0x7fc9a80a6280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400fc90 tx=0x7fc9b4018000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.702+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005f40 tx=0x7fc9b400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3543fa7f2f023b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.702+0000 7fc9b0bfe640 1 -- 172.21.15.92:0/347852943 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4022070 con 0x5561acff3f00 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.702+0000 7fc9b0bfe640 1 -- 172.21.15.92:0/347852943 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b4011e50 con 0x5561acff3f00 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.702+0000 7fc9b0bfe640 1 -- 172.21.15.92:0/347852943 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4004050 con 0x5561acff3f00 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- 172.21.15.92:0/347852943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 msgr2=0x5561acff42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4005f40 tx=0x7fc9b400f790 comp rx=0 tx=0).stop 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- 172.21.15.92:0/347852943 shutdown_connections 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acfff0e0 0x5561ad0014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff4820 0x5561acffeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- 172.21.15.92:0/347852943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff3f00 0x5561acff42e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- 172.21.15.92:0/347852943 >> 172.21.15.92:0/347852943 conn(0x5561acff0410 msgr2=0x5561acff07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- 172.21.15.92:0/347852943 shutdown_connections 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- 172.21.15.92:0/347852943 wait complete. 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 -- start start 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 Processor -- start 2024-04-26T18:15:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.703+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561acffc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561acffcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5561ad001cb0 con 0x5561acff3f00 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5561acee1b60 con 0x5561acfff0e0 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5561ad001e30 con 0x5561acff4820 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 10 client.0 _ll_register_callbacks cb 0x5561acf062b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33526/0 (socket says 172.21.15.92:33526) 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 -- 172.21.15.92:0/3828465727 learned_addr learned my addr 172.21.15.92:0/3828465727 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561acffcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561acffc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 -- 172.21.15.92:0/3828465727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 msgr2=0x5561acffc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561acffc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 -- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 msgr2=0x5561acffcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561acffcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 -- 172.21.15.92:0/3828465727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561acc6c210 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80b9000 tx=0x7fc9b808c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94ace4c1733f558 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8049040 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 11679+0+0 (secure 0 0 0) 0x7fc9b80ee5d0 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b4011e50 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.704+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (secure 0 0 0) 0x7fc9b80d6050 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 10 client.16578 fetch_fsmap learned FSMap version 256 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=256,monmap=4+}) -- 0x5561acd38620 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b4011e50 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 256) ==== 4708+0+0 (secure 0 0 0) 0x7fc9b80b9210 con 0x5561acff3f00 2024-04-26T18:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 10 client.16578 fetch_fsmap finished waiting for FSMap version 256 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 20 client.16578 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad00f420 0x5561ad011830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 4 client.16578 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561acf68070 con 0x5561ad00f420 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad00f420 0x5561ad011830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9a5ffb640 10 client.16578 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.705+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad00f420 0x5561ad011830 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bce58a74103c581 server_cookie=6ae693a664369787 in_seq=0 out_seq=0 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3828465727 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5561acf68070 con 0x5561ad00f420 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9a5ffb640 10 client.16578 handle_command_reply: tid=0 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 client.16578 shutdown 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 msgr2=0x5561acffc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80b9000 tx=0x7fc9b808c480 comp rx=0 tx=0).stop 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 shutdown_connections 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad00f420 0x5561ad011830 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561acffcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561acffc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9a5ffb640 0 client.16578 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3828465727 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffc0f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 >> 172.21.15.92:0/3828465727 conn(0x5561acff0410 msgr2=0x5561acff6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 shutdown_connections 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.706+0000 7fc9c7203740 1 -- 172.21.15.92:0/3828465727 wait complete. 2024-04-26T18:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.707+0000 7fc9c7203740 20 client.16578 trim_cache size 0 max 16384 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.721+0000 7fc9c7203740 1 Processor -- start 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 -- start start 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561ad017140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561ad017680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1b0b00 con 0x5561acff3f00 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1ae8f0 con 0x5561acfff0e0 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c7203740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1b0430 con 0x5561acff4820 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:33542/0 (socket says 172.21.15.92:33542) 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 -- 172.21.15.92:0/1953036466 learned_addr learned my addr 172.21.15.92:0/1953036466 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561ad017680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561ad017140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 -- 172.21.15.92:0/1953036466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 msgr2=0x5561ad017140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561ad017140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 -- 172.21.15.92:0/1953036466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 msgr2=0x5561ad017680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561ad017680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 -- 172.21.15.92:0/1953036466 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561acffb0e0 con 0x5561acff3f00 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9c2286640 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8031440 tx=0x7fc9b803b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179c2951bc494193 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9a7fff640 1 -- 172.21.15.92:0/1953036466 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8049070 con 0x5561acff3f00 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9a7fff640 1 -- 172.21.15.92:0/1953036466 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b80bcba0 con 0x5561acff3f00 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.722+0000 7fc9a7fff640 1 -- 172.21.15.92:0/1953036466 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80ee5d0 con 0x5561acff3f00 2024-04-26T18:15:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- 172.21.15.92:0/1953036466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 msgr2=0x5561acffe1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8031440 tx=0x7fc9b803b460 comp rx=0 tx=0).stop 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- 172.21.15.92:0/1953036466 shutdown_connections 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acfff0e0 0x5561ad017680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff4820 0x5561ad017140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 --2- 172.21.15.92:0/1953036466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acff3f00 0x5561acffe1b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- 172.21.15.92:0/1953036466 >> 172.21.15.92:0/1953036466 conn(0x5561acff0410 msgr2=0x5561acff07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- 172.21.15.92:0/1953036466 shutdown_connections 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- 172.21.15.92:0/1953036466 wait complete. 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 -- start start 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.723+0000 7fc9c7203740 1 Processor -- start 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff3f00 0x5561ad007080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 0x5561ad004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1af690 con 0x5561acfff0e0 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1aefc0 con 0x5561acff4820 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc1afd60 con 0x5561acff3f00 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c7203740 10 client.0 _ll_register_callbacks cb 0x7fc9b80f1b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c2a87640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 0x5561ad004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:47666/0 (socket says 172.21.15.92:47666) 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 -- 172.21.15.92:0/3472367521 learned_addr learned my addr 172.21.15.92:0/3472367521 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff3f00 0x5561ad007080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 -- 172.21.15.92:0/3472367521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff3f00 msgr2=0x5561ad007080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff3f00 0x5561ad007080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 -- 172.21.15.92:0/3472367521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 msgr2=0x5561ad004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 0x5561ad004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 -- 172.21.15.92:0/3472367521 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561ad004610 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c2a87640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 0x5561ad004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9c1a85640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac000c00 tx=0x7fc9ac012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3bcf29784fe500 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.724+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac004460 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 11679+0+0 (secure 0 0 0) 0x7fc9ac01e3f0 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9b80bcba0 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (secure 0 0 0) 0x7fc9ac02f050 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 10 client.26069 fetch_fsmap learned FSMap version 256 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=256,monmap=4+}) -- 0x5561ad076320 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9b80bcba0 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 256) ==== 4708+0+0 (secure 0 0 0) 0x7fc9ac00f040 con 0x5561acff4820 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 10 client.26069 fetch_fsmap finished waiting for FSMap version 256 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 10 client.26069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 20 client.26069 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad076ad0 0x5561ad078ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 4 client.26069 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561acff0260 con 0x5561ad076ad0 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.725+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad076ad0 0x5561ad078ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.726+0000 7fc9a5ffb640 10 client.26069 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:32.726+0000 7fc9c2286640 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad076ad0 0x5561ad078ef0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2838915712ba34b4 server_cookie=c73e0afc57917db4 in_seq=0 out_seq=0 2024-04-26T18:15:32.969 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:32 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:15:32.969 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:32 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:32.969 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:32 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.494s CPU time. 2024-04-26T18:15:32.969 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:32 smithi092 systemd[1]: Starting Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:15:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:33 smithi092 ceph-mon[29156]: pgmap v543: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-04-26T18:15:33.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:32 smithi092 podman[98752]: 2024-04-26 18:15:32.872744622 +0000 UTC m=+0.017765932 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:15:33.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 podman[98752]: 2024-04-26 18:15:33.062974499 +0000 UTC m=+0.207995809 container create 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-26T18:15:33.332 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 920.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:33 smithi189 ceph-mon[32756]: pgmap v543: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-04-26T18:15:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:33 smithi156 ceph-mon[32679]: pgmap v543: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 84 KiB/s wr, 30 op/s 2024-04-26T18:15:33.743 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 podman[98752]: 2024-04-26 18:15:33.349213052 +0000 UTC m=+0.494234362 container init 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:15:33.743 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 podman[98752]: 2024-04-26 18:15:33.351865542 +0000 UTC m=+0.496886853 container start 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-26T18:15:33.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 ceph-mds[98770]: -- 172.21.15.92:0/1833781155 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e43a39a40 con 0x557e43a0cc00 2024-04-26T18:15:33.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: starting mds.j at 2024-04-26T18:15:33.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 bash[98752]: 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a 2024-04-26T18:15:33.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:33 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: daemon mds.j restarted 2024-04-26T18:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T18:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:boot 2024-04-26T18:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:34 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: daemon mds.j restarted 2024-04-26T18:15:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T18:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:boot 2024-04-26T18:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:34 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: daemon mds.j restarted 2024-04-26T18:15:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: osdmap e148: 12 total, 12 up, 12 in 2024-04-26T18:15:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:boot 2024-04-26T18:15:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:15:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:15:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:34 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:35 smithi156 ceph-mon[32679]: pgmap v545: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-26T18:15:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:35 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:resolve 2024-04-26T18:15:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:35 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:35 smithi092 ceph-mon[29156]: pgmap v545: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-26T18:15:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:35 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:resolve 2024-04-26T18:15:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:35 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:35 smithi189 ceph-mon[32756]: pgmap v545: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-04-26T18:15:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:35 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:resolve 2024-04-26T18:15:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:35 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:37 smithi156 ceph-mon[32679]: pgmap v546: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:37 smithi092 ceph-mon[29156]: pgmap v546: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:37 smithi189 ceph-mon[32756]: pgmap v546: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:38.016 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:37 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-04-26T18:15:38.016 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:37 smithi092 systemd[1]: Stopped Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:38.016 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:37 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Consumed 1.254s CPU time. 2024-04-26T18:15:38.016 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:37 smithi092 systemd[1]: Starting Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:15:38.016 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:37 smithi092 podman[98843]: 2024-04-26 18:15:37.882418895 +0000 UTC m=+0.018291937 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:15:38.017 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 podman[98843]: 2024-04-26 18:15:38.017012905 +0000 UTC m=+0.152885972 container create c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-26T18:15:38.330 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 925.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:38.569 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 podman[98843]: 2024-04-26 18:15:38.469884243 +0000 UTC m=+0.605757267 container init c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T18:15:38.569 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 podman[98843]: 2024-04-26 18:15:38.472613575 +0000 UTC m=+0.608486610 container start c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-26T18:15:38.570 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 ceph-mds[98863]: -- 172.21.15.92:0/2534376817 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56290b3e5a40 con 0x56290b3b8c00 2024-04-26T18:15:38.570 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: starting mds.g at 2024-04-26T18:15:38.993 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 bash[98843]: c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 2024-04-26T18:15:38.993 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:15:38 smithi092 systemd[1]: Started Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: pgmap v547: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: daemon mds.g restarted 2024-04-26T18:15:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T18:15:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:boot 2024-04-26T18:15:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:15:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:15:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:15:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:39 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: pgmap v547: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: daemon mds.g restarted 2024-04-26T18:15:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T18:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:boot 2024-04-26T18:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:39 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: pgmap v547: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-04-26T18:15:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: daemon mds.g restarted 2024-04-26T18:15:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: osdmap e149: 12 total, 12 up, 12 in 2024-04-26T18:15:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:boot 2024-04-26T18:15:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:15:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:15:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:15:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:39 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:40 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:resolve 2024-04-26T18:15:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:40 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:40 smithi189 ceph-mon[32756]: pgmap v549: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 115 KiB/s wr, 23 op/s 2024-04-26T18:15:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:40 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:resolve 2024-04-26T18:15:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:40 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:40 smithi156 ceph-mon[32679]: pgmap v549: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 115 KiB/s wr, 23 op/s 2024-04-26T18:15:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:40 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:resolve 2024-04-26T18:15:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:40 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:40 smithi092 ceph-mon[29156]: pgmap v549: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 115 KiB/s wr, 23 op/s 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9a5ffb640 1 -- 172.21.15.92:0/3472367521 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561acff0260 con 0x5561ad076ad0 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9a5ffb640 10 client.26069 handle_command_reply: tid=0 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 client.26069 shutdown 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 msgr2=0x5561ad0075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac000c00 tx=0x7fc9ac012820 comp rx=0 tx=0).stop 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 shutdown_connections 2024-04-26T18:15:41.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5561ad076ad0 0x5561ad078ef0 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5561acfff0e0 0x5561ad004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561acff4820 0x5561ad0075c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 --2- 172.21.15.92:0/3472367521 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5561acff3f00 0x5561ad007080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9a5ffb640 0 client.26069 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 >> 172.21.15.92:0/3472367521 conn(0x5561acff0410 msgr2=0x5561acff6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 shutdown_connections 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 1 -- 172.21.15.92:0/3472367521 wait complete. 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.549+0000 7fc9c7203740 20 client.26069 trim_cache size 0 max 16384 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:15:41.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:15:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:15:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:15:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 msgr2=0x7fc9a80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 0x7fc9a80a6280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400fc90 tx=0x7fc9b4018000 comp rx=0 tx=0).stop 2024-04-26T18:15:41.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 msgr2=0x7fc9bc1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8005940 tx=0x7fc9b80040c0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 shutdown_connections 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fc9a80a3dc0 0x7fc9a80a6280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc9bc10cf30 0x7fc9bc19d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc9bc104480 0x7fc9bc1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 --2- 172.21.15.92:0/686016901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9bc103b60 0x7fc9bc1990a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 >> 172.21.15.92:0/686016901 conn(0x7fc9bc0789b0 msgr2=0x7fc9bc0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 shutdown_connections 2024-04-26T18:15:41.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:41.550+0000 7fc9c44ea640 1 -- 172.21.15.92:0/686016901 wait complete. 2024-04-26T18:15:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:reconnect 2024-04-26T18:15:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:reconnect 2024-04-26T18:15:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:41 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:reconnect 2024-04-26T18:15:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:reconnect 2024-04-26T18:15:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:41 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:15:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:15:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:reconnect 2024-04-26T18:15:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:reconnect 2024-04-26T18:15:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:41 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:rejoin 2024-04-26T18:15:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:rejoin 2024-04-26T18:15:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:42 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:42 smithi189 ceph-mon[32756]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:15:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:42 smithi189 ceph-mon[32756]: pgmap v550: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 105 KiB/s wr, 21 op/s 2024-04-26T18:15:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:rejoin 2024-04-26T18:15:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:rejoin 2024-04-26T18:15:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:42 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:42 smithi156 ceph-mon[32679]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:15:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:42 smithi156 ceph-mon[32679]: pgmap v550: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 105 KiB/s wr, 21 op/s 2024-04-26T18:15:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:rejoin 2024-04-26T18:15:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:rejoin 2024-04-26T18:15:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:42 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:42 smithi092 ceph-mon[29156]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:15:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:42 smithi092 ceph-mon[29156]: pgmap v550: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 105 KiB/s wr, 21 op/s 2024-04-26T18:15:43.331 INFO:teuthology.orchestra.run.smithi092.stderr:progress: 930.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-04-26T18:15:43.641 INFO:teuthology.orchestra.run.smithi092.stdout:transaction type: 2024-04-26T18:15:43.641 INFO:teuthology.orchestra.run.smithi092.stdout:scaling factor: 32 2024-04-26T18:15:43.641 INFO:teuthology.orchestra.run.smithi092.stdout:query mode: simple 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:number of clients: 100 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:number of threads: 4 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:duration: 900 s 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:number of transactions actually processed: 1005098 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:latency average = 90.866 ms 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:latency stddev = 1263.365 ms 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 1080.384401 (including connections establishing) 2024-04-26T18:15:43.642 INFO:teuthology.orchestra.run.smithi092.stdout:tps = 1080.387109 (excluding connections establishing) 2024-04-26T18:15:43.646 DEBUG:teuthology.orchestra.run.smithi092:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-04-26T18:15:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:clientreplay 2024-04-26T18:15:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:active 2024-04-26T18:15:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:43 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:43 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:43.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:15:43 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:15:43.510+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:15:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:clientreplay 2024-04-26T18:15:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:active 2024-04-26T18:15:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:43 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:43 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:clientreplay 2024-04-26T18:15:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/989296838,v1:172.21.15.92:6841/989296838] up:active 2024-04-26T18:15:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6d3a13a700 time 2024-04-26T18:15:43.554544+0000 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d447633dd] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:43.995 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: clone() 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: *** Caught signal (Aborted) ** 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: in thread 7f6d3a13a700 thread_name:ms_dispatch 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:43.554+0000 7f6d3a13a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6d3a13a700 time 2024-04-26T18:15:43.554544+0000 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d447633dd] 2024-04-26T18:15:43.996 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: clone() 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d434ebd20] 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: gsignal() 2024-04-26T18:15:43.997 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: abort() 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d44763437] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 16: clone() 2024-04-26T18:15:43.998 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:43.557+0000 7f6d3a13a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: in thread 7f6d3a13a700 thread_name:ms_dispatch 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d434ebd20] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: gsignal() 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: abort() 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d44763437] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:43.999 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 16: clone() 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: -3> 2024-04-26T18:15:43.554+0000 7f6d3a13a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6d3a13a700 time 2024-04-26T18:15:43.554544+0000 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d447633dd] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:44.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: clone() 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 0> 2024-04-26T18:15:43.557+0000 7f6d3a13a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: in thread 7f6d3a13a700 thread_name:ms_dispatch 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:44.001 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d434ebd20] 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: gsignal() 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: abort() 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d44763437] 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:44.002 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 16: clone() 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: -3> 2024-04-26T18:15:43.554+0000 7f6d3a13a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f6d3a13a700 time 2024-04-26T18:15:43.554544+0000 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:44.003 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f6d447633dd] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: clone() 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.004 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 0> 2024-04-26T18:15:43.557+0000 7f6d3a13a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: in thread 7f6d3a13a700 thread_name:ms_dispatch 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f6d434ebd20] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2: gsignal() 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 3: abort() 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f6d44763437] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f6d447635a3] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55f493949822] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55f4938b9598] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55f4938bbc17] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55f4937b4d0b] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55f4937b52ac] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55f49379dfad] 2024-04-26T18:15:44.005 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f6d449f7e20] 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 13: (DispatchQueue::entry()+0x51f) [0x7f6d449f4fdf] 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f6d44ac7fc1] 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f6d434e11ca] 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 16: clone() 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[98524]: 2024-04-26T18:15:44.006 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:43 smithi092 podman[98913]: 2024-04-26 18:15:43.655784926 +0000 UTC m=+0.031623072 container died 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424) 2024-04-26T18:15:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:44 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:44 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:active 2024-04-26T18:15:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:44 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:44 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:44 smithi092 ceph-mon[29156]: pgmap v551: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 123 KiB/s wr, 28 op/s 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:44 smithi092 podman[98913]: 2024-04-26 18:15:44.34245966 +0000 UTC m=+0.718297801 container remove 61a54016c4489b8b31b8dd769cb5de94fcb95b123fccc1803c0a50ad9c9fda0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:44 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:44 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:15:44.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:44 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.171s CPU time. 2024-04-26T18:15:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:44 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:44 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:active 2024-04-26T18:15:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:44 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:44 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:44 smithi189 ceph-mon[32756]: pgmap v551: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 123 KiB/s wr, 28 op/s 2024-04-26T18:15:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:44 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:15:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:44 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1391914233,v1:172.21.15.92:6837/1391914233] up:active 2024-04-26T18:15:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:44 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:15:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:44 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:15:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:44 smithi156 ceph-mon[32679]: pgmap v551: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 123 KiB/s wr, 28 op/s 2024-04-26T18:15:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:47 smithi156 ceph-mon[32679]: pgmap v552: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:47 smithi092 ceph-mon[29156]: pgmap v552: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:47 smithi189 ceph-mon[32756]: pgmap v552: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:49.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:49 smithi189 ceph-mon[32756]: pgmap v553: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:49 smithi092 ceph-mon[29156]: pgmap v553: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:49 smithi156 ceph-mon[32679]: pgmap v553: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 710 KiB/s rd, 110 KiB/s wr, 31 op/s 2024-04-26T18:15:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:51 smithi092 ceph-mon[29156]: pgmap v554: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 93 KiB/s wr, 29 op/s 2024-04-26T18:15:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:51 smithi189 ceph-mon[32756]: pgmap v554: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 93 KiB/s wr, 29 op/s 2024-04-26T18:15:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:51 smithi156 ceph-mon[32679]: pgmap v554: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 855 KiB/s rd, 93 KiB/s wr, 29 op/s 2024-04-26T18:15:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:53 smithi092 ceph-mon[29156]: pgmap v555: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-04-26T18:15:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:53 smithi189 ceph-mon[32756]: pgmap v555: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-04-26T18:15:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:53 smithi156 ceph-mon[32679]: pgmap v555: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-04-26T18:15:54.647 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/1536099083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 msgr2=0x7f9ea410f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/1536099083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea410f800 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009cd0 tx=0x7f9e9c02a8e0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/1536099083 shutdown_connections 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/1536099083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea410f800 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/1536099083 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 0x7f9ea4102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/1536099083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea4108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/1536099083 >> 172.21.15.92:0/1536099083 conn(0x7f9ea40fe400 msgr2=0x7f9ea4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/1536099083 shutdown_connections 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.646+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/1536099083 wait complete. 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.647+0000 7f9ea9eb0640 1 Processor -- start 2024-04-26T18:15:54.648 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.647+0000 7f9ea9eb0640 1 -- start start 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 0x7f9ea4199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4112c00 con 0x7f9ea41032f0 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4112a80 con 0x7f9ea4108940 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea9eb0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea4112d80 con 0x7f9ea4102930 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47436/0 (socket says 172.21.15.92:47436) 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 -- 172.21.15.92:0/4246985794 learned_addr learned my addr 172.21.15.92:0/4246985794 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 0x7f9ea4199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 -- 172.21.15.92:0/4246985794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 msgr2=0x7f9ea4199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 0x7f9ea4199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 -- 172.21.15.92:0/4246985794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 msgr2=0x7f9ea419d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea419d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 -- 172.21.15.92:0/4246985794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea419e030 con 0x7f9ea41032f0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9e9affd640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c970 tx=0x7f9e8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea17fa640 1 -- 172.21.15.92:0/4246985794 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c007bb0 con 0x7f9ea41032f0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.648+0000 7f9ea17fa640 1 -- 172.21.15.92:0/4246985794 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c007d50 con 0x7f9ea41032f0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.649+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea419e320 con 0x7f9ea41032f0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.649+0000 7f9ea17fa640 1 -- 172.21.15.92:0/4246985794 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00f450 con 0x7f9ea41032f0 2024-04-26T18:15:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.649+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea41a5bb0 con 0x7f9ea41032f0 2024-04-26T18:15:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9ea17fa640 1 -- 172.21.15.92:0/4246985794 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f9e8c004f20 con 0x7f9ea41032f0 2024-04-26T18:15:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 Processor -- start 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 -- start start 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 0x55b3a4e70ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e734d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4dcc460 con 0x55b3a4e710e0 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4d86590 con 0x55b3a4e65f00 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.651+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4dc8420 con 0x55b3a4e66820 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea17fa640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 0x7f9e900a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:49774/0 (socket says 172.21.15.92:49774) 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2241994026 learned_addr learned my addr 172.21.15.92:0/2241994026 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 0x7f9e900a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 0x55b3a4e70ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea17fa640 1 -- 172.21.15.92:0/4246985794 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 11851+0+0 (secure 0 0 0) 0x7f9e8c0d12c0 con 0x7f9ea41032f0 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2241994026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 msgr2=0x55b3a4e70ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 0x55b3a4e70ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2241994026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 msgr2=0x55b3a4e734d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e734d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2241994026 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a4d930d0 con 0x55b3a4e65f00 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 0x55b3a4e70ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e734d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 0x7f9e900a6300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c004af0 tx=0x7f9e9c036000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009cd0 tx=0x7f9e9c003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a350092929e7490 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9e99ffb640 1 -- 172.21.15.92:0/2241994026 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c04d070 con 0x55b3a4e65f00 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9e99ffb640 1 -- 172.21.15.92:0/2241994026 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e9c036070 con 0x55b3a4e65f00 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.652+0000 7f9e99ffb640 1 -- 172.21.15.92:0/2241994026 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c049660 con 0x55b3a4e65f00 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2241994026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 msgr2=0x55b3a4e662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009cd0 tx=0x7f9e9c003bb0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2241994026 shutdown_connections 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e734d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e66820 0x55b3a4e70ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2241994026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e662e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2241994026 >> 172.21.15.92:0/2241994026 conn(0x55b3a4e62410 msgr2=0x55b3a4e627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2241994026 shutdown_connections 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2241994026 wait complete. 2024-04-26T18:15:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.653+0000 7f9eacbc7740 1 -- start start 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 Processor -- start 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4e73c50 con 0x55b3a4e710e0 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4d53b60 con 0x55b3a4e66820 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55b3a4e73dd0 con 0x55b3a4e65f00 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9eacbc7740 10 client.0 _ll_register_callbacks cb 0x55b3a4d782b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47448/0 (socket says 172.21.15.92:47448) 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2293224278 learned_addr learned my addr 172.21.15.92:0/2293224278 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2293224278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 msgr2=0x55b3a4e6e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 msgr2=0x55b3a4e6e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.654+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2293224278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a4ade210 con 0x55b3a4e710e0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009620 tx=0x7f9e9c031a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da17a7552583892 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c060060 con 0x55b3a4e710e0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 11851+0+0 (secure 0 0 0) 0x7f9e9c049610 con 0x55b3a4e710e0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e9c036070 con 0x55b3a4e710e0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=267) ==== 24+0+0 (secure 0 0 0) 0x7f9e9c068050 con 0x55b3a4e710e0 2024-04-26T18:15:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 10 client.16608 fetch_fsmap learned FSMap version 267 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=267,monmap=4+}) -- 0x55b3a4baa620 con 0x55b3a4e710e0 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e9c036070 con 0x55b3a4e710e0 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 267) ==== 4708+0+0 (secure 0 0 0) 0x7f9e9c030070 con 0x55b3a4e710e0 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 10 client.16608 fetch_fsmap finished waiting for FSMap version 267 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 20 client.16608 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4e81140 0x55b3a4e83530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 4 client.16608 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3a4dda070 con 0x55b3a4e81140 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.655+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4e81140 0x55b3a4e83530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.656+0000 7f9e82ffd640 10 client.16608 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.656+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4e81140 0x55b3a4e83530 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04d9dc50e2e1b91 server_cookie=cd86620f2d0b75e in_seq=0 out_seq=0 2024-04-26T18:15:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.656+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2293224278 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b3a4dda070 con 0x55b3a4e81140 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.656+0000 7f9e82ffd640 10 client.16608 handle_command_reply: tid=0 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.656+0000 7f9eacbc7740 1 client.16608 shutdown 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 msgr2=0x55b3a4e6eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009620 tx=0x7f9e9c031a80 comp rx=0 tx=0).stop 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 shutdown_connections 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4e81140 0x55b3a4e83530 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6eb70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9e82ffd640 0 client.16608 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2293224278 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 >> 172.21.15.92:0/2293224278 conn(0x55b3a4e62410 msgr2=0x55b3a4e68190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 shutdown_connections 2024-04-26T18:15:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2293224278 wait complete. 2024-04-26T18:15:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.657+0000 7f9eacbc7740 20 client.16608 trim_cache size 0 max 16384 2024-04-26T18:15:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 Processor -- start 2024-04-26T18:15:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 -- start start 2024-04-26T18:15:54.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e79400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41b0c60 con 0x55b3a4e66820 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41aea50 con 0x55b3a4e65f00 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41b0590 con 0x55b3a4e710e0 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9e9affd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47458/0 (socket says 172.21.15.92:47458) 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9e9affd640 1 -- 172.21.15.92:0/379774939 learned_addr learned my addr 172.21.15.92:0/379774939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e79400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.672+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 -- 172.21.15.92:0/379774939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e710e0 msgr2=0x55b3a4e6e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 -- 172.21.15.92:0/379774939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 msgr2=0x55b3a4e79400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e79400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 -- 172.21.15.92:0/379774939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a4e83b60 con 0x55b3a4e66820 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e79400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e9affd640 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c09c490 tx=0x7f9e8c0d3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11d26227cf35fed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e997fa640 1 -- 172.21.15.92:0/379774939 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c01d040 con 0x55b3a4e66820 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e997fa640 1 -- 172.21.15.92:0/379774939 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c09c500 con 0x55b3a4e66820 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9e997fa640 1 -- 172.21.15.92:0/379774939 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c098b70 con 0x55b3a4e66820 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 -- 172.21.15.92:0/379774939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 msgr2=0x55b3a4e68910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:54.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c09c490 tx=0x7f9e8c0d3040 comp rx=0 tx=0).stop 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 -- 172.21.15.92:0/379774939 shutdown_connections 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e66820 0x55b3a4e68910 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/379774939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e65f00 0x55b3a4e79400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.673+0000 7f9eacbc7740 1 -- 172.21.15.92:0/379774939 >> 172.21.15.92:0/379774939 conn(0x55b3a4e62410 msgr2=0x55b3a4e615b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- 172.21.15.92:0/379774939 shutdown_connections 2024-04-26T18:15:54.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- 172.21.15.92:0/379774939 wait complete. 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- start start 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 Processor -- start 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41af7f0 con 0x55b3a4e710e0 2024-04-26T18:15:54.681 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41af120 con 0x55b3a4e66820 2024-04-26T18:15:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea41afec0 con 0x55b3a4e65f00 2024-04-26T18:15:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9eacbc7740 10 client.0 _ll_register_callbacks cb 0x7f9e8c098100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:15:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9ea3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:47460/0 (socket says 172.21.15.92:47460) 2024-04-26T18:15:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9ea3fff640 1 -- 172.21.15.92:0/2838597362 learned_addr learned my addr 172.21.15.92:0/2838597362 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.674+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 -- 172.21.15.92:0/2838597362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 msgr2=0x55b3a4e6a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 -- 172.21.15.92:0/2838597362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 msgr2=0x55b3a4e6ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:15:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 -- 172.21.15.92:0/2838597362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a4e6b4d0 con 0x55b3a4e66820 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9ea3fff640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e9affd640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6a8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55b3a4e6c8d0 tx=0x7f9e8c09cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f70982a546a6fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0b5060 con 0x55b3a4e66820 2024-04-26T18:15:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8c09c500 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 11851+0+0 (secure 0 0 0) 0x7f9e8c005210 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=267) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c01d070 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9eacbc7740 10 client.26099 fetch_fsmap learned FSMap version 267 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=267,monmap=4+}) -- 0x55b3a4eebb20 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c09c500 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 267) ==== 4708+0+0 (secure 0 0 0) 0x7f9e8c0982e0 con 0x55b3a4e66820 2024-04-26T18:15:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9eacbc7740 10 client.26099 fetch_fsmap finished waiting for FSMap version 267 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.675+0000 7f9eacbc7740 10 client.26099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9eacbc7740 20 client.26099 populate_metadata read hostname 'smithi092' 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4eec1b0 0x55b3a4eee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9eacbc7740 4 client.26099 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3a4dd3ee0 con 0x55b3a4eec1b0 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4eec1b0 0x55b3a4eee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9e82ffd640 10 client.26099 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:54.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:54.676+0000 7f9ea37fe640 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4eec1b0 0x55b3a4eee5d0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66cfff2b27b47522 server_cookie=63b44fb616eadb20 in_seq=0 out_seq=0 2024-04-26T18:15:55.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:54 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:15:55.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:54 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:55.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:54 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.171s CPU time. 2024-04-26T18:15:55.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:54 smithi092 systemd[1]: Starting Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:15:55.000 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:54 smithi092 podman[99071]: 2024-04-26 18:15:54.872135283 +0000 UTC m=+0.018464673 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:15:55.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:55 smithi092 ceph-mon[29156]: pgmap v556: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-04-26T18:15:55.262 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 podman[99071]: 2024-04-26 18:15:55.001053145 +0000 UTC m=+0.147382526 container create ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-26T18:15:55.262 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 podman[99071]: 2024-04-26 18:15:55.23682014 +0000 UTC m=+0.383149522 container init ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:15:55.262 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 podman[99071]: 2024-04-26 18:15:55.239704299 +0000 UTC m=+0.386033683 container start ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:15:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:55 smithi189 ceph-mon[32756]: pgmap v556: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-04-26T18:15:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:55 smithi156 ceph-mon[32679]: pgmap v556: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 41 KiB/s wr, 21 op/s 2024-04-26T18:15:55.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 ceph-mds[99090]: -- 172.21.15.92:0/79486117 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561876c33a40 con 0x561876c06800 2024-04-26T18:15:55.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: starting mds.d at 2024-04-26T18:15:55.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 bash[99071]: ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca 2024-04-26T18:15:55.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:15:55 smithi092 systemd[1]: Started Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:15:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: daemon mds.d restarted 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:boot 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:56 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: daemon mds.d restarted 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:boot 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:56 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: daemon mds.d restarted 2024-04-26T18:15:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:15:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: osdmap e150: 12 total, 12 up, 12 in 2024-04-26T18:15:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:boot 2024-04-26T18:15:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:15:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:15:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:15:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:56 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:57 smithi189 ceph-mon[32756]: pgmap v558: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:resolve 2024-04-26T18:15:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:57 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:57 smithi156 ceph-mon[32679]: pgmap v558: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:resolve 2024-04-26T18:15:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:57 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:57 smithi092 ceph-mon[29156]: pgmap v558: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:resolve 2024-04-26T18:15:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:57 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9e82ffd640 1 -- 172.21.15.92:0/2838597362 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3a4dd3ee0 con 0x55b3a4eec1b0 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9e82ffd640 10 client.26099 handle_command_reply: tid=0 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 client.26099 shutdown 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 msgr2=0x55b3a4e6a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6a8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55b3a4e6c8d0 tx=0x7f9e8c09cd30 comp rx=0 tx=0).stop 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 shutdown_connections 2024-04-26T18:15:58.316 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55b3a4eec1b0 0x55b3a4eee5d0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b3a4e710e0 0x55b3a4e6ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b3a4e66820 0x55b3a4e6a8a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 --2- 172.21.15.92:0/2838597362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55b3a4e65f00 0x55b3a4e6a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 >> 172.21.15.92:0/2838597362 conn(0x55b3a4e62410 msgr2=0x55b3a4e6f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9e82ffd640 0 client.26099 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 shutdown_connections 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.315+0000 7f9eacbc7740 1 -- 172.21.15.92:0/2838597362 wait complete. 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.316+0000 7f9eacbc7740 20 client.26099 trim_cache size 0 max 16384 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:15:58.317 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.316+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 msgr2=0x7f9e900a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:58.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.316+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 0x7f9e900a6300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c004af0 tx=0x7f9e9c036000 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.316+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 msgr2=0x7f9ea4199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.316+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c970 tx=0x7f9e8c00ce30 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 shutdown_connections 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f9e900a3e40 0x7f9e900a6300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ea4108940 0x7f9ea419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ea41032f0 0x7f9ea4199580 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 --2- 172.21.15.92:0/4246985794 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ea4102930 0x7f9ea4199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 >> 172.21.15.92:0/4246985794 conn(0x7f9ea40fe400 msgr2=0x7f9ea40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 shutdown_connections 2024-04-26T18:15:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:15:58.317+0000 7f9ea9eb0640 1 -- 172.21.15.92:0/4246985794 wait complete. 2024-04-26T18:15:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:58 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:58 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:58 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:reconnect 2024-04-26T18:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:58 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:58 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:15:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:58 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:15:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:58 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:reconnect 2024-04-26T18:15:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:58 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:58 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0 2024-04-26T18:15:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:58 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:15:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:58 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:reconnect 2024-04-26T18:15:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:58 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:59 smithi189 ceph-mon[32756]: pgmap v559: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:59 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:rejoin 2024-04-26T18:15:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:15:59 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:59 smithi156 ceph-mon[32679]: pgmap v559: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:59 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:rejoin 2024-04-26T18:15:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:15:59 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:15:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-mon[29156]: pgmap v559: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-04-26T18:15:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:rejoin 2024-04-26T18:15:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:00.232 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc3cda1a700 time 2024-04-26T18:15:59.793021+0000 2024-04-26T18:16:00.232 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:00.232 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc3d80433dd] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: clone() 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: *** Caught signal (Aborted) ** 2024-04-26T18:16:00.233 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: in thread 7fc3cda1a700 thread_name:ms_dispatch 2024-04-26T18:16:00.234 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:15:59.794+0000 7fc3cda1a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc3cda1a700 time 2024-04-26T18:15:59.793021+0000 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc3d80433dd] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.235 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: clone() 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc3d6dcbd20] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: gsignal() 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: abort() 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc3d8043437] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.236 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 16: clone() 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:15:59.795+0000 7fc3cda1a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: in thread 7fc3cda1a700 thread_name:ms_dispatch 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.237 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc3d6dcbd20] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: gsignal() 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: abort() 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc3d8043437] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.238 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 16: clone() 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: -1> 2024-04-26T18:15:59.794+0000 7fc3cda1a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc3cda1a700 time 2024-04-26T18:15:59.793021+0000 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc3d80433dd] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.239 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: clone() 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 0> 2024-04-26T18:15:59.795+0000 7fc3cda1a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: in thread 7fc3cda1a700 thread_name:ms_dispatch 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc3d6dcbd20] 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: gsignal() 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: abort() 2024-04-26T18:16:00.240 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc3d8043437] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 16: clone() 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.241 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: -1> 2024-04-26T18:15:59.794+0000 7fc3cda1a700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc3cda1a700 time 2024-04-26T18:15:59.793021+0000 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc3d80433dd] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.242 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: clone() 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 0> 2024-04-26T18:15:59.795+0000 7fc3cda1a700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: in thread 7fc3cda1a700 thread_name:ms_dispatch 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc3d6dcbd20] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2: gsignal() 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 3: abort() 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc3d8043437] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc3d80435a3] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x557e4255f822] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x557e424cf598] 2024-04-26T18:16:00.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x557e424d1c17] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x557e423cad0b] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x557e423cb2ac] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x557e423b3fad] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc3d82d7e20] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 13: (DispatchQueue::entry()+0x51f) [0x7fc3d82d4fdf] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc3d83a7fc1] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc3d6dc11ca] 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 16: clone() 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[98766]: 2024-04-26T18:16:00.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:15:59 smithi092 podman[99128]: 2024-04-26 18:15:59.882985153 +0000 UTC m=+0.019081790 container died 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-04-26T18:16:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:clientreplay 2024-04-26T18:16:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:active 2024-04-26T18:16:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:clientreplay 2024-04-26T18:16:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:active 2024-04-26T18:16:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:clientreplay 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:clientreplay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/2560099448,v1:172.21.15.92:6835/2560099448] up:active 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:16:00.851 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:00 smithi092 podman[99128]: 2024-04-26 18:16:00.58455937 +0000 UTC m=+0.720655992 container remove 5842b7dc3f87dad889082056723421efb5099101ff95f0c3aaa1a0f70631ea0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-26T18:16:00.852 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:16:01.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:16:01.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.160s CPU time. 2024-04-26T18:16:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:01 smithi189 ceph-mon[32756]: pgmap v560: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-04-26T18:16:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:16:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:01 smithi156 ceph-mon[32679]: pgmap v560: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-04-26T18:16:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:16:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:01 smithi092 ceph-mon[29156]: pgmap v560: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-04-26T18:16:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:16:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:16:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:16:02.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:02 smithi092 ceph-mon[29156]: pgmap v561: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-26T18:16:02.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:02 smithi092 ceph-mon[29156]: pgmap v562: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-26T18:16:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:02 smithi189 ceph-mon[32756]: pgmap v561: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-26T18:16:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:02 smithi189 ceph-mon[32756]: pgmap v562: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-26T18:16:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:02 smithi156 ceph-mon[32679]: pgmap v561: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-04-26T18:16:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:02 smithi156 ceph-mon[32679]: pgmap v562: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-04-26T18:16:03.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:16:03 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:16:03.513+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:16:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:04 smithi189 ceph-mon[32756]: pgmap v563: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-04-26T18:16:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:04 smithi189 ceph-mon[32756]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T18:16:04.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:04 smithi092 ceph-mon[29156]: pgmap v563: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-04-26T18:16:04.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:04 smithi092 ceph-mon[29156]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T18:16:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:04 smithi156 ceph-mon[32679]: pgmap v563: 97 pgs: 97 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-04-26T18:16:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:04 smithi156 ceph-mon[32679]: osdmap e151: 12 total, 12 up, 12 in 2024-04-26T18:16:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:06 smithi189 ceph-mon[32756]: pgmap v565: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 108 KiB/s wr, 35 op/s 2024-04-26T18:16:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:06 smithi156 ceph-mon[32679]: pgmap v565: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 108 KiB/s wr, 35 op/s 2024-04-26T18:16:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:06 smithi092 ceph-mon[29156]: pgmap v565: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 108 KiB/s wr, 35 op/s 2024-04-26T18:16:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:08 smithi189 ceph-mon[32756]: pgmap v566: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 66 KiB/s wr, 21 op/s 2024-04-26T18:16:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:08 smithi156 ceph-mon[32679]: pgmap v566: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 66 KiB/s wr, 21 op/s 2024-04-26T18:16:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:08 smithi092 ceph-mon[29156]: pgmap v566: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 66 KiB/s wr, 21 op/s 2024-04-26T18:16:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:10 smithi189 ceph-mon[32756]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-04-26T18:16:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:10 smithi189 ceph-mon[32756]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T18:16:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:10 smithi156 ceph-mon[32679]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-04-26T18:16:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:10 smithi156 ceph-mon[32679]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T18:16:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:10 smithi092 ceph-mon[29156]: pgmap v567: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 56 KiB/s wr, 19 op/s 2024-04-26T18:16:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:10 smithi092 ceph-mon[29156]: osdmap e152: 12 total, 12 up, 12 in 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:10 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:10 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:10 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.160s CPU time. 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 systemd[1]: Starting Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 podman[99369]: 2024-04-26 18:16:11.136104048 +0000 UTC m=+0.018659835 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:16:11.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 podman[99369]: 2024-04-26 18:16:11.259921361 +0000 UTC m=+0.142477131 container create c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T18:16:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 -- 172.21.15.92:0/3517178720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8107820 msgr2=0x7f80f8107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 --2- 172.21.15.92:0/3517178720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8107820 0x7f80f8107c00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009930 tx=0x7f80e802a420 comp rx=0 tx=0).stop 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 -- 172.21.15.92:0/3517178720 shutdown_connections 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 --2- 172.21.15.92:0/3517178720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8102220 0x7f80f810e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 --2- 172.21.15.92:0/3517178720 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8101860 0x7f80f8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 --2- 172.21.15.92:0/3517178720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8107820 0x7f80f8107c00 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 -- 172.21.15.92:0/3517178720 >> 172.21.15.92:0/3517178720 conn(0x7f80f80789b0 msgr2=0x7f80f8078dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 -- 172.21.15.92:0/3517178720 shutdown_connections 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.409+0000 7f80fdc59640 1 -- 172.21.15.92:0/3517178720 wait complete. 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 Processor -- start 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 -- start start 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8102220 0x7f80f819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8107820 0x7f80f81a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8111b00 con 0x7f80f8101860 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8111980 con 0x7f80f8107820 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80fdc59640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8111c80 con 0x7f80f8102220 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39904/0 (socket says 172.21.15.92:39904) 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 -- 172.21.15.92:0/4076508040 learned_addr learned my addr 172.21.15.92:0/4076508040 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f7fff640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8107820 0x7f80f81a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8102220 0x7f80f819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 -- 172.21.15.92:0/4076508040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8102220 msgr2=0x7f80f819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8102220 0x7f80f819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 -- 172.21.15.92:0/4076508040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8107820 msgr2=0x7f80f81a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8107820 0x7f80f81a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.410+0000 7f80f77fe640 1 -- 172.21.15.92:0/4076508040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f81a55c0 con 0x7f80f8101860 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80f77fe640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004770 tx=0x7f80e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80f4ff9640 1 -- 172.21.15.92:0/4076508040 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e803f070 con 0x7f80f8101860 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f81a5790 con 0x7f80f8101860 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80f4ff9640 1 -- 172.21.15.92:0/4076508040 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80e803b460 con 0x7f80f8101860 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80f4ff9640 1 -- 172.21.15.92:0/4076508040 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8035070 con 0x7f80f8101860 2024-04-26T18:16:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.411+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f81a5bf0 con 0x7f80f8101860 2024-04-26T18:16:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f4ff9640 1 -- 172.21.15.92:0/4076508040 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f80e803b8d0 con 0x7f80f8101860 2024-04-26T18:16:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 Processor -- start 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 -- start start 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a626e00 0x56392a6271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a6364f0 0x56392a6388e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56392a58d460 con 0x56392a627720 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56392a547590 con 0x56392a626e00 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f8100972740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56392a589420 con 0x56392a6364f0 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39912/0 (socket says 172.21.15.92:39912) 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 -- 172.21.15.92:0/1449640565 learned_addr learned my addr 172.21.15.92:0/1449640565 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f4ff9640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 0x7f80e00a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a6364f0 0x56392a6388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f7fff640 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a626e00 0x56392a6271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 -- 172.21.15.92:0/1449640565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a6364f0 msgr2=0x56392a6388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f7fff640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 0x7f80e00a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a6364f0 0x56392a6388e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 -- 172.21.15.92:0/1449640565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a626e00 msgr2=0x56392a6271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a626e00 0x56392a6271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.414+0000 7f80f77fe640 1 -- 172.21.15.92:0/1449640565 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56392a5540d0 con 0x56392a627720 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80f4ff9640 1 -- 172.21.15.92:0/4076508040 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 11981+0+0 (secure 0 0 0) 0x7f80e80f1970 con 0x7f80f8101860 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80f77fe640 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ee2e0 tx=0x7f80e802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c78382e3fb78b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80f7fff640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 0x7f80e00a6280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80f00070b0 tx=0x7f80f000c040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80ddffb640 1 -- 172.21.15.92:0/1449640565 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8048020 con 0x56392a627720 2024-04-26T18:16:11.424 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80ddffb640 1 -- 172.21.15.92:0/1449640565 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80e80bd290 con 0x56392a627720 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.415+0000 7f80ddffb640 1 -- 172.21.15.92:0/1449640565 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80c0f40 con 0x56392a627720 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- 172.21.15.92:0/1449640565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 msgr2=0x56392a635fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ee2e0 tx=0x7f80e802a420 comp rx=0 tx=0).stop 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- 172.21.15.92:0/1449640565 shutdown_connections 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a6364f0 0x56392a6388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a635fb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- 172.21.15.92:0/1449640565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a626e00 0x56392a6271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- 172.21.15.92:0/1449640565 >> 172.21.15.92:0/1449640565 conn(0x56392a623410 msgr2=0x56392a6237f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- 172.21.15.92:0/1449640565 shutdown_connections 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- 172.21.15.92:0/1449640565 wait complete. 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- start start 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 Processor -- start 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a626e00 0x56392a633380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.425 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56392a58d460 con 0x56392a627720 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56392a514b60 con 0x56392a6364f0 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.416+0000 7f8100972740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56392a638ee0 con 0x56392a626e00 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f8100972740 10 client.0 _ll_register_callbacks cb 0x56392a5392b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39918/0 (socket says 172.21.15.92:39918) 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 -- 172.21.15.92:0/3495591819 learned_addr learned my addr 172.21.15.92:0/3495591819 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f7fff640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a626e00 0x56392a633380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 -- 172.21.15.92:0/3495591819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a626e00 msgr2=0x56392a633380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a626e00 0x56392a633380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 -- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 msgr2=0x56392a633e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 -- 172.21.15.92:0/3495591819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56392a29f210 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f7fff640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00bdd0 tx=0x7f80ec0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7617353e02f5df4c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec012650 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e80bd290 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 11981+0+0 (secure 0 0 0) 0x7f80ec0127f0 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=274) ==== 24+0+0 (secure 0 0 0) 0x7f80ec0129f0 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f8100972740 10 client.16632 fetch_fsmap learned FSMap version 274 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.417+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=274,monmap=4+}) -- 0x56392a36b620 con 0x56392a627720 2024-04-26T18:16:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80e80bd290 con 0x56392a627720 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 274) ==== 4708+0+0 (secure 0 0 0) 0x7f80ec01bc10 con 0x56392a627720 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 10 client.16632 fetch_fsmap finished waiting for FSMap version 274 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 10 client.16632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 20 client.16632 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6467a0 0x56392a648c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 4 client.16632 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56392a59b070 con 0x56392a6467a0 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6467a0 0x56392a648c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f80d6ffd640 10 client.16632 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.418+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6467a0 0x56392a648c20 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ea3e44ab933c65b server_cookie=e1a15795c8788b4a in_seq=0 out_seq=0 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3495591819 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56392a59b070 con 0x56392a6467a0 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f80d6ffd640 10 client.16632 handle_command_reply: tid=0 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f8100972740 1 client.16632 shutdown 2024-04-26T18:16:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 msgr2=0x56392a6338c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f80ec00bdd0 tx=0x7f80ec0117b0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.419+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 shutdown_connections 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6467a0 0x56392a648c20 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f80d6ffd640 0 client.16632 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a627720 0x56392a6338c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 --2- 172.21.15.92:0/3495591819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a626e00 0x56392a633380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 >> 172.21.15.92:0/3495591819 conn(0x56392a623410 msgr2=0x56392a629280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 shutdown_connections 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 1 -- 172.21.15.92:0/3495591819 wait complete. 2024-04-26T18:16:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.420+0000 7f8100972740 20 client.16632 trim_cache size 0 max 16384 2024-04-26T18:16:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 Processor -- start 2024-04-26T18:16:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 -- start start 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81aec20 con 0x56392a626e00 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81aca10 con 0x56392a6364f0 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.434+0000 7f8100972740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ae550 con 0x56392a627720 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39932/0 (socket says 172.21.15.92:39932) 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 -- 172.21.15.92:0/839668914 learned_addr learned my addr 172.21.15.92:0/839668914 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 -- 172.21.15.92:0/839668914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 msgr2=0x56392a6324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 -- 172.21.15.92:0/839668914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 msgr2=0x56392a633a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 -- 172.21.15.92:0/839668914 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56392a627550 con 0x56392a626e00 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80f77fe640 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ee940 tx=0x7f80e803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afad987a9d4dd3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80dd7fa640 1 -- 172.21.15.92:0/839668914 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8048040 con 0x56392a626e00 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80dd7fa640 1 -- 172.21.15.92:0/839668914 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80e80bd290 con 0x56392a626e00 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.435+0000 7f80dd7fa640 1 -- 172.21.15.92:0/839668914 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80bae90 con 0x56392a626e00 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- 172.21.15.92:0/839668914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 msgr2=0x56392a641c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ee940 tx=0x7f80e803d040 comp rx=0 tx=0).stop 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- 172.21.15.92:0/839668914 shutdown_connections 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a633a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- 172.21.15.92:0/839668914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a641c20 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- 172.21.15.92:0/839668914 >> 172.21.15.92:0/839668914 conn(0x56392a623410 msgr2=0x56392a633340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- 172.21.15.92:0/839668914 shutdown_connections 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- 172.21.15.92:0/839668914 wait complete. 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- start start 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 Processor -- start 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a639bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ad7b0 con 0x56392a626e00 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ad0e0 con 0x56392a6364f0 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.436+0000 7f8100972740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81ade80 con 0x56392a627720 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f8100972740 10 client.0 _ll_register_callbacks cb 0x7f80ec005f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39946/0 (socket says 172.21.15.92:39946) 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 -- 172.21.15.92:0/3793512076 learned_addr learned my addr 172.21.15.92:0/3793512076 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 -- 172.21.15.92:0/3793512076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 msgr2=0x56392a6396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 -- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 msgr2=0x56392a639bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f7fff640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a639bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a639bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 -- 172.21.15.92:0/3793512076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56392a63a1e0 con 0x56392a626e00 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f7fff640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a639bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80f77fe640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f80e802a460 tx=0x7f80e80c1030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366136a87712c149 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80d5070 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 11981+0+0 (secure 0 0 0) 0x7f80e80bae90 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80e80bd290 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=274) ==== 24+0+0 (secure 0 0 0) 0x7f80e8048070 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f8100972740 10 client.16638 fetch_fsmap learned FSMap version 274 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=274,monmap=4+}) -- 0x56392a6acbb0 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.437+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80e80bd290 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 274) ==== 4708+0+0 (secure 0 0 0) 0x7f80e804b060 con 0x56392a626e00 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 10 client.16638 fetch_fsmap finished waiting for FSMap version 274 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 10 client.16638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 20 client.16638 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6ad030 0x56392a6af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 4 client.16638 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:16:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56392a594ee0 con 0x56392a6ad030 2024-04-26T18:16:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6ad030 0x56392a6af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f80f6ffd640 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6ad030 0x56392a6af420 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9d642b0fc4477 server_cookie=126ea37df1a510fb in_seq=0 out_seq=0 2024-04-26T18:16:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:11.438+0000 7f80d6ffd640 10 client.16638 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:11.530 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 podman[99369]: 2024-04-26 18:16:11.504796137 +0000 UTC m=+0.387351906 container init c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-26T18:16:11.530 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 podman[99369]: 2024-04-26 18:16:11.507891016 +0000 UTC m=+0.390446794 container start c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-04-26T18:16:11.530 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 ceph-mds[99433]: -- 172.21.15.92:0/1884569840 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580930dda40 con 0x5580930b0800 2024-04-26T18:16:11.993 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: starting mds.j at 2024-04-26T18:16:11.993 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 bash[99369]: c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b 2024-04-26T18:16:11.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:11 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: daemon mds.j restarted 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:boot 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:12 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-04-26T18:16:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: daemon mds.j restarted 2024-04-26T18:16:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T18:16:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:boot 2024-04-26T18:16:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:12 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: pgmap v569: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-04-26T18:16:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: daemon mds.j restarted 2024-04-26T18:16:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: osdmap e153: 12 total, 12 up, 12 in 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:boot 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:12 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:resolve 2024-04-26T18:16:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:13 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:13 smithi189 ceph-mon[32756]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-26T18:16:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:resolve 2024-04-26T18:16:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:13 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:13 smithi156 ceph-mon[32679]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-26T18:16:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:resolve 2024-04-26T18:16:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:13 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:13 smithi092 ceph-mon[29156]: pgmap v571: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-26T18:16:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f80d6ffd640 1 -- 172.21.15.92:0/3793512076 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56392a594ee0 con 0x56392a6ad030 2024-04-26T18:16:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f80d6ffd640 10 client.16638 handle_command_reply: tid=0 2024-04-26T18:16:14.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 client.16638 shutdown 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 msgr2=0x56392a63e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f80e802a460 tx=0x7f80e80c1030 comp rx=0 tx=0).stop 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 shutdown_connections 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56392a6ad030 0x56392a6af420 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56392a6364f0 0x56392a639bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56392a627720 0x56392a6396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 --2- 172.21.15.92:0/3793512076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56392a626e00 0x56392a63e2f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f80d6ffd640 0 client.16638 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 >> 172.21.15.92:0/3793512076 conn(0x56392a623410 msgr2=0x56392a632360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 shutdown_connections 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 1 -- 172.21.15.92:0/3793512076 wait complete. 2024-04-26T18:16:14.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.577+0000 7f8100972740 20 client.16638 trim_cache size 0 max 16384 2024-04-26T18:16:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:16:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:16:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:16:14.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 msgr2=0x7f80e00a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 0x7f80e00a6280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f80f00070b0 tx=0x7f80f000c040 comp rx=0 tx=0).stop 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 msgr2=0x7f80f819a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f80e8004770 tx=0x7f80e80042f0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 shutdown_connections 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f80e00a3dc0 0x7f80e00a6280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f80f8107820 0x7f80f81a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f80f8102220 0x7f80f819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 --2- 172.21.15.92:0/4076508040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f8101860 0x7f80f819a000 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 >> 172.21.15.92:0/4076508040 conn(0x7f80f80789b0 msgr2=0x7f80f8104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 shutdown_connections 2024-04-26T18:16:14.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:14.578+0000 7f80fdc59640 1 -- 172.21.15.92:0/4076508040 wait complete. 2024-04-26T18:16:14.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:14.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:14.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:reconnect 2024-04-26T18:16:14.822 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:14 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:14 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:reconnect 2024-04-26T18:16:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:14 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:14 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:14 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:reconnect 2024-04-26T18:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:14 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:15.208 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f97c199b700 time 2024-04-26T18:16:14.822721+0000 2024-04-26T18:16:15.208 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:15.208 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.208 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f97cbfc43dd] 2024-04-26T18:16:15.208 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: clone() 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:14.822+0000 7f97c199b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f97c199b700 time 2024-04-26T18:16:14.822721+0000 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:15.209 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.210 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.210 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f97cbfc43dd] 2024-04-26T18:16:15.210 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: clone() 2024-04-26T18:16:15.211 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: *** Caught signal (Aborted) ** 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: in thread 7f97c199b700 thread_name:ms_dispatch 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f97cad4cd20] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: gsignal() 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: abort() 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f97cbfc4437] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.212 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 16: clone() 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:14.824+0000 7f97c199b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: in thread 7f97c199b700 thread_name:ms_dispatch 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f97cad4cd20] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: gsignal() 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: abort() 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f97cbfc4437] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.213 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 16: clone() 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: -1> 2024-04-26T18:16:14.822+0000 7f97c199b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f97c199b700 time 2024-04-26T18:16:14.822721+0000 2024-04-26T18:16:15.214 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f97cbfc43dd] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.215 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: clone() 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 0> 2024-04-26T18:16:14.824+0000 7f97c199b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: in thread 7f97c199b700 thread_name:ms_dispatch 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f97cad4cd20] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: gsignal() 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: abort() 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f97cbfc4437] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.216 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 16: clone() 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: -1> 2024-04-26T18:16:14.822+0000 7f97c199b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f97c199b700 time 2024-04-26T18:16:14.822721+0000 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f97cbfc43dd] 2024-04-26T18:16:15.217 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.218 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: clone() 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 0> 2024-04-26T18:16:14.824+0000 7f97c199b700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: in thread 7f97c199b700 thread_name:ms_dispatch 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f97cad4cd20] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2: gsignal() 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 3: abort() 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f97cbfc4437] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f97cbfc45a3] 2024-04-26T18:16:15.219 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x561875db1822] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x561875d21598] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x561875d23c17] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x561875c1cd0b] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x561875c1d2ac] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x561875c05fad] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f97cc258e20] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 13: (DispatchQueue::entry()+0x51f) [0x7f97cc255fdf] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f97cc328fc1] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f97cad421ca] 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 16: clone() 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99086]: 2024-04-26T18:16:15.220 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:14 smithi092 podman[99470]: 2024-04-26 18:16:14.896447296 +0000 UTC m=+0.021828880 container died ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-04-26T18:16:15.809 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:rejoin 2024-04-26T18:16:15.809 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:15.809 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:16:15.809 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:15.809 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:active 2024-04-26T18:16:15.810 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:16:15.810 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:15 smithi092 ceph-mon[29156]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-04-26T18:16:15.810 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:15 smithi092 podman[99470]: 2024-04-26 18:16:15.568566816 +0000 UTC m=+0.693948451 container remove ff53000f785e9cc79fedd4630a6eee40af1aaeabfacd6b2b2eaedc183fe583ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T18:16:15.810 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:16:15.811 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:16:15.811 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.108s CPU time. 2024-04-26T18:16:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:rejoin 2024-04-26T18:16:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:active 2024-04-26T18:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:15 smithi189 ceph-mon[32756]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-04-26T18:16:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:rejoin 2024-04-26T18:16:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:16:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/1653792275,v1:172.21.15.92:6837/1653792275] up:active 2024-04-26T18:16:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:16:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:15 smithi156 ceph-mon[32679]: pgmap v572: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-04-26T18:16:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:17 smithi092 ceph-mon[29156]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:17 smithi189 ceph-mon[32756]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:17 smithi156 ceph-mon[32679]: pgmap v573: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:18.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:16:18 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:16:18.515+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:16:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:19 smithi092 ceph-mon[29156]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 70 KiB/s wr, 29 op/s 2024-04-26T18:16:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:19 smithi189 ceph-mon[32756]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 70 KiB/s wr, 29 op/s 2024-04-26T18:16:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:19 smithi156 ceph-mon[32679]: pgmap v574: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 70 KiB/s wr, 29 op/s 2024-04-26T18:16:21.938 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f59c14ac700 time 2024-04-26T18:16:21.602894+0000 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59cbad53dd] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.939 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: clone() 2024-04-26T18:16:21.940 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.603+0000 7f59c14ac700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f59c14ac700 time 2024-04-26T18:16:21.602894+0000 2024-04-26T18:16:21.940 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:21.940 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.940 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59cbad53dd] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: clone() 2024-04-26T18:16:21.941 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: *** Caught signal (Aborted) ** 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: in thread 7f59c14ac700 thread_name:ms_dispatch 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59ca85dd20] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: gsignal() 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: abort() 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59cbad5437] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.942 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 16: clone() 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.604+0000 7f59c14ac700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: in thread 7f59c14ac700 thread_name:ms_dispatch 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59ca85dd20] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: gsignal() 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: abort() 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59cbad5437] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.943 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 16: clone() 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: -1> 2024-04-26T18:16:21.603+0000 7f59c14ac700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f59c14ac700 time 2024-04-26T18:16:21.602894+0000 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:21.944 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59cbad53dd] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: clone() 2024-04-26T18:16:21.945 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 0> 2024-04-26T18:16:21.604+0000 7f59c14ac700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: in thread 7f59c14ac700 thread_name:ms_dispatch 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59ca85dd20] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: gsignal() 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: abort() 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59cbad5437] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.946 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 16: clone() 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: -5> 2024-04-26T18:16:21.603+0000 7f59c14ac700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f59c14ac700 time 2024-04-26T18:16:21.602894+0000 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f59cbad53dd] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.947 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.948 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: clone() 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: -4> 2024-04-26T18:16:21.604+0000 7f59c14ac700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: in thread 7f59c14ac700 thread_name:ms_dispatch 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f59ca85dd20] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2: gsignal() 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 3: abort() 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f59cbad5437] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f59cbad55a3] 2024-04-26T18:16:21.949 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558e26cad822] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558e26c1d598] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558e26c1fc17] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558e26b18d0b] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558e26b192ac] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558e26b01fad] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f59cbd69e20] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 13: (DispatchQueue::entry()+0x51f) [0x7f59cbd66fdf] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f59cbe39fc1] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f59ca8531ca] 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 16: clone() 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[98125]: 2024-04-26T18:16:21.950 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:21 smithi092 podman[99515]: 2024-04-26 18:16:21.671384929 +0000 UTC m=+0.020340344 container died edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:16:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:21 smithi092 ceph-mon[29156]: pgmap v575: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 73 KiB/s wr, 34 op/s 2024-04-26T18:16:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:21 smithi189 ceph-mon[32756]: pgmap v575: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 73 KiB/s wr, 34 op/s 2024-04-26T18:16:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:21 smithi156 ceph-mon[32679]: pgmap v575: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 73 KiB/s wr, 34 op/s 2024-04-26T18:16:22.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:22 smithi092 podman[99515]: 2024-04-26 18:16:22.264291215 +0000 UTC m=+0.613246630 container remove edaeb4b9d11133a3437a69ebf396a89b5882da68c2f7e7cbbb99262f97517faf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-26T18:16:22.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:16:22.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Failed with result 'exit-code'. 2024-04-26T18:16:22.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:22 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.088s CPU time. 2024-04-26T18:16:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:23 smithi092 ceph-mon[29156]: pgmap v576: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 64 KiB/s wr, 30 op/s 2024-04-26T18:16:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:23 smithi189 ceph-mon[32756]: pgmap v576: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 64 KiB/s wr, 30 op/s 2024-04-26T18:16:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:23 smithi156 ceph-mon[32679]: pgmap v576: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 647 KiB/s rd, 64 KiB/s wr, 30 op/s 2024-04-26T18:16:26.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:25 smithi092 ceph-mon[29156]: pgmap v577: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-04-26T18:16:26.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:25 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:16:26.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:25 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:26.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:25 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.108s CPU time. 2024-04-26T18:16:26.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 systemd[1]: Starting Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:16:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:25 smithi189 ceph-mon[32756]: pgmap v577: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-04-26T18:16:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:25 smithi156 ceph-mon[32679]: pgmap v577: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 64 KiB/s wr, 31 op/s 2024-04-26T18:16:26.485 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 podman[99611]: 2024-04-26 18:16:26.130518451 +0000 UTC m=+0.018112246 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:16:26.486 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 podman[99611]: 2024-04-26 18:16:26.256753071 +0000 UTC m=+0.144346913 container create 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T18:16:26.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 podman[99611]: 2024-04-26 18:16:26.486428973 +0000 UTC m=+0.374022755 container init 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-26T18:16:26.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 podman[99611]: 2024-04-26 18:16:26.489257607 +0000 UTC m=+0.376851389 container start 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-26T18:16:26.743 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mds[99630]: -- 172.21.15.92:0/2626382478 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c32c005a40 con 0x55c32bfd8800 2024-04-26T18:16:26.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: starting mds.d at 2024-04-26T18:16:26.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 bash[99611]: 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b 2024-04-26T18:16:26.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:26 smithi092 systemd[1]: Started Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: daemon mds.d restarted 2024-04-26T18:16:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T18:16:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:boot 2024-04-26T18:16:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:16:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:16:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:26 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: daemon mds.d restarted 2024-04-26T18:16:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:boot 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:16:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:26 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: daemon mds.d restarted 2024-04-26T18:16:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: osdmap e154: 12 total, 12 up, 12 in 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:boot 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:16:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:26 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 -- 172.21.15.92:0/3517528276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4107930 msgr2=0x7f4ba4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 --2- 172.21.15.92:0/3517528276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4107930 0x7f4ba4107d10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009930 tx=0x7f4b9802a420 comp rx=0 tx=0).stop 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 -- 172.21.15.92:0/3517528276 shutdown_connections 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 --2- 172.21.15.92:0/3517528276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4101810 0x7f4ba410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 --2- 172.21.15.92:0/3517528276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 0x7f4ba41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 --2- 172.21.15.92:0/3517528276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4107930 0x7f4ba4107d10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 -- 172.21.15.92:0/3517528276 >> 172.21.15.92:0/3517528276 conn(0x7f4ba4077d50 msgr2=0x7f4ba40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 -- 172.21.15.92:0/3517528276 shutdown_connections 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.674+0000 7f4bab72b640 1 -- 172.21.15.92:0/3517528276 wait complete. 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 Processor -- start 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 -- start start 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 0x7f4ba4199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4107930 0x7f4ba419da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4112cb0 con 0x7f4ba4101810 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4112b30 con 0x7f4ba4100e50 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4bab72b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba4112e30 con 0x7f4ba4107930 2024-04-26T18:16:27.678 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39554/0 (socket says 172.21.15.92:39554) 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 -- 172.21.15.92:0/4258545837 learned_addr learned my addr 172.21.15.92:0/4258545837 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 0x7f4ba4199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4107930 0x7f4ba419da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 -- 172.21.15.92:0/4258545837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4107930 msgr2=0x7f4ba419da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4107930 0x7f4ba419da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 -- 172.21.15.92:0/4258545837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 msgr2=0x7f4ba4199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 0x7f4ba4199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 -- 172.21.15.92:0/4258545837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba419e130 con 0x7f4ba4101810 2024-04-26T18:16:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.675+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000e9f0 tx=0x7f4ba000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.676+0000 7f4b967fc640 1 -- 172.21.15.92:0/4258545837 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000cd80 con 0x7f4ba4101810 2024-04-26T18:16:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.676+0000 7f4b967fc640 1 -- 172.21.15.92:0/4258545837 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ba00108e0 con 0x7f4ba4101810 2024-04-26T18:16:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.676+0000 7f4b967fc640 1 -- 172.21.15.92:0/4258545837 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0018980 con 0x7f4ba4101810 2024-04-26T18:16:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.676+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba419e420 con 0x7f4ba4101810 2024-04-26T18:16:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.676+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba41a5cb0 con 0x7f4ba4101810 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.678+0000 7f4b967fc640 1 -- 172.21.15.92:0/4258545837 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f4ba0010430 con 0x7f4ba4101810 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.678+0000 7f4bae449740 1 Processor -- start 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 -- start start 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21606820 0x563e21610ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e216134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563e2156c460 con 0x563e216110e0 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563e21526590 con 0x563e21605f00 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4bae449740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563e21568420 con 0x563e21606820 2024-04-26T18:16:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4b967fc640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 0x7f4b900a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba8cc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e216134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:45622/0 (socket says 172.21.15.92:45622) 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/95328767 learned_addr learned my addr 172.21.15.92:0/95328767 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 0x7f4b900a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21606820 0x563e21610ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4b967fc640 1 -- 172.21.15.92:0/4258545837 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 12109+0+0 (secure 0 0 0) 0x7f4ba00d1970 con 0x7f4ba4101810 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/95328767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21606820 msgr2=0x563e21610ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21606820 0x563e21610ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/95328767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 msgr2=0x563e216134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e216134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/95328767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e215330d0 con 0x563e21605f00 2024-04-26T18:16:27.688 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.679+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c012d00 tx=0x7f4b9c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad31d567109e239e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 0x7f4b900a6280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009fd0 tx=0x7f4b9c017000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4b8f7fe640 1 -- 172.21.15.92:0/95328767 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c022070 con 0x563e21605f00 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4b8f7fe640 1 -- 172.21.15.92:0/95328767 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b9c0124f0 con 0x563e21605f00 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4b8f7fe640 1 -- 172.21.15.92:0/95328767 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004d80 con 0x563e21605f00 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 -- 172.21.15.92:0/95328767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 msgr2=0x563e216062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c012d00 tx=0x7f4b9c010740 comp rx=0 tx=0).stop 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 -- 172.21.15.92:0/95328767 shutdown_connections 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e216134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21606820 0x563e21610ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 --2- 172.21.15.92:0/95328767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21605f00 0x563e216062e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.680+0000 7f4bae449740 1 -- 172.21.15.92:0/95328767 >> 172.21.15.92:0/95328767 conn(0x563e21602410 msgr2=0x563e216027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- 172.21.15.92:0/95328767 shutdown_connections 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- 172.21.15.92:0/95328767 wait complete. 2024-04-26T18:16:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- start start 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 Processor -- start 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563e21613cb0 con 0x563e21605f00 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x563e214f3b60 con 0x563e21606820 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563e21613e30 con 0x563e216110e0 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4bae449740 10 client.0 _ll_register_callbacks cb 0x563e215182b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4ba94c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4ba94c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39582/0 (socket says 172.21.15.92:39582) 2024-04-26T18:16:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4ba94c7640 1 -- 172.21.15.92:0/4086752337 learned_addr learned my addr 172.21.15.92:0/4086752337 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.681+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 -- 172.21.15.92:0/4086752337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 msgr2=0x563e2160eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 -- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 msgr2=0x563e2160e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 -- 172.21.15.92:0/4086752337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e2127e210 con 0x563e21605f00 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802a940 tx=0x7f4b98009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eaf37fd2864f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4b8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98035040 con 0x563e21605f00 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b9c0124f0 con 0x563e21605f00 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 12109+0+0 (secure 0 0 0) 0x7f4b98031860 con 0x563e21605f00 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=282) ==== 24+0+0 (secure 0 0 0) 0x7f4b98004040 con 0x563e21605f00 2024-04-26T18:16:27.691 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4bae449740 10 client.16662 fetch_fsmap learned FSMap version 282 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=282,monmap=4+}) -- 0x563e2134a620 con 0x563e21605f00 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.682+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b9c0124f0 con 0x563e21605f00 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 282) ==== 4712+0+0 (secure 0 0 0) 0x7f4b98046480 con 0x563e21605f00 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 10 client.16662 fetch_fsmap finished waiting for FSMap version 282 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 20 client.16662 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21621650 0x563e21623af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 4 client.16662 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e2157a070 con 0x563e21621650 2024-04-26T18:16:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21621650 0x563e21623af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21621650 0x563e21623af0 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55079e597a3cf030 server_cookie=6a68a971d0f7c4b3 in_seq=0 out_seq=0 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.683+0000 7f4b8cff9640 10 client.16662 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4b8cff9640 1 -- 172.21.15.92:0/4086752337 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563e2157a070 con 0x563e21621650 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4b8cff9640 10 client.16662 handle_command_reply: tid=0 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 client.16662 shutdown 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 msgr2=0x563e2160e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802a940 tx=0x7f4b98009670 comp rx=0 tx=0).stop 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 shutdown_connections 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21621650 0x563e21623af0 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 --2- 172.21.15.92:0/4086752337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160e0f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4b8cff9640 0 client.16662 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 >> 172.21.15.92:0/4086752337 conn(0x563e21602410 msgr2=0x563e21608190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 shutdown_connections 2024-04-26T18:16:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 1 -- 172.21.15.92:0/4086752337 wait complete. 2024-04-26T18:16:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.684+0000 7f4bae449740 20 client.16662 trim_cache size 0 max 16384 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 Processor -- start 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 -- start start 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21605f00 0x563e21610930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2161cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41b0e20 con 0x563e216110e0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41af2e0 con 0x563e21606820 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4bae449740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41b0750 con 0x563e21605f00 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39592/0 (socket says 172.21.15.92:39592) 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/612778961 learned_addr learned my addr 172.21.15.92:0/612778961 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2161cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21605f00 0x563e21610930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/612778961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21605f00 msgr2=0x563e21610930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21605f00 0x563e21610930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/612778961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 msgr2=0x563e2161cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2161cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.699+0000 7f4ba9cc8640 1 -- 172.21.15.92:0/612778961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e216071b0 con 0x563e216110e0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c012cd0 tx=0x7f4b9c0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5abc7a3eadef32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.705 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4b8effd640 1 -- 172.21.15.92:0/612778961 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c022050 con 0x563e216110e0 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4b8effd640 1 -- 172.21.15.92:0/612778961 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b9c02a070 con 0x563e216110e0 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4b8effd640 1 -- 172.21.15.92:0/612778961 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004c40 con 0x563e216110e0 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 -- 172.21.15.92:0/612778961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 msgr2=0x563e21601430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c012cd0 tx=0x7f4b9c0094a0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 -- 172.21.15.92:0/612778961 shutdown_connections 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e216110e0 0x563e21601430 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2161cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 --2- 172.21.15.92:0/612778961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e21605f00 0x563e21610930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 -- 172.21.15.92:0/612778961 >> 172.21.15.92:0/612778961 conn(0x563e21602410 msgr2=0x563e21600d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 -- 172.21.15.92:0/612778961 shutdown_connections 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.700+0000 7f4bae449740 1 -- 172.21.15.92:0/612778961 wait complete. 2024-04-26T18:16:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 -- start start 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 Processor -- start 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41b0080 con 0x563e21605f00 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41af9b0 con 0x563e21606820 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba41ae280 con 0x563e216110e0 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4bae449740 10 client.0 _ll_register_callbacks cb 0x7f4b98031c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4ba94c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4ba94c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39598/0 (socket says 172.21.15.92:39598) 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4ba94c7640 1 -- 172.21.15.92:0/1465159785 learned_addr learned my addr 172.21.15.92:0/1465159785 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.701+0000 7f4ba9cc8640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 -- 172.21.15.92:0/1465159785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 msgr2=0x563e2160b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 -- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 msgr2=0x563e2160b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 -- 172.21.15.92:0/1465159785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e21686d70 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4ba94c7640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802a940 tx=0x7f4b98046730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9fa2e9c08335ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b980041e0 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 12109+0+0 (secure 0 0 0) 0x7f4b98004380 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b9c02a070 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=282) ==== 24+0+0 (secure 0 0 0) 0x7f4b98031660 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 10 client.16668 fetch_fsmap learned FSMap version 282 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=282,monmap=4+}) -- 0x563e21688020 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b9c02a070 con 0x563e21605f00 2024-04-26T18:16:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 282) ==== 4712+0+0 (secure 0 0 0) 0x7f4b98060030 con 0x563e21605f00 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 10 client.16668 fetch_fsmap finished waiting for FSMap version 282 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 10 client.16668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 20 client.16668 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21688790 0x563e2168abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 4 client.16668 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.702+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e21573ee0 con 0x563e21688790 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.703+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21688790 0x563e2168abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.703+0000 7f4b8cff9640 10 client.16668 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:27.703+0000 7f4ba8cc6640 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21688790 0x563e2168abb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eae68b33dfe8fec server_cookie=76e4c3bb6e4b48e6 in_seq=0 out_seq=0 2024-04-26T18:16:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:27 smithi092 ceph-mon[29156]: pgmap v579: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-26T18:16:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:27 smithi189 ceph-mon[32756]: pgmap v579: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-26T18:16:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:27 smithi156 ceph-mon[32679]: pgmap v579: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 62 KiB/s wr, 31 op/s 2024-04-26T18:16:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:resolve 2024-04-26T18:16:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:resolve 2024-04-26T18:16:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:resolve 2024-04-26T18:16:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:29 smithi092 ceph-mon[29156]: pgmap v580: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-04-26T18:16:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:29 smithi189 ceph-mon[32756]: pgmap v580: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-04-26T18:16:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:29 smithi156 ceph-mon[32679]: pgmap v580: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-04-26T18:16:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:31 smithi092 ceph-mon[29156]: pgmap v581: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:31 smithi189 ceph-mon[32756]: pgmap v581: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:31 smithi156 ceph-mon[32679]: pgmap v581: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:32.979 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:32 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:16:32.979 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:32 smithi092 systemd[1]: Stopped Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:32.979 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:32 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.a.service: Consumed 1.088s CPU time. 2024-04-26T18:16:32.979 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:32 smithi092 systemd[1]: Starting Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:16:33.243 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:32 smithi092 podman[99747]: 2024-04-26 18:16:32.882805178 +0000 UTC m=+0.018767105 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:16:33.243 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 podman[99747]: 2024-04-26 18:16:33.021178432 +0000 UTC m=+0.157140407 container create 1f185d01b7be7ce6b68ec851c0d2d1ad22acc054bbf9fb0843a704ff8acb57d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-26T18:16:33.743 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 podman[99747]: 2024-04-26 18:16:33.298652828 +0000 UTC m=+0.434614740 container init 1f185d01b7be7ce6b68ec851c0d2d1ad22acc054bbf9fb0843a704ff8acb57d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-26T18:16:33.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 podman[99747]: 2024-04-26 18:16:33.301180442 +0000 UTC m=+0.437142356 container start 1f185d01b7be7ce6b68ec851c0d2d1ad22acc054bbf9fb0843a704ff8acb57d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2) 2024-04-26T18:16:33.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mds[99765]: -- 172.21.15.92:0/3374875271 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da48e65a40 con 0x55da48e38c00 2024-04-26T18:16:33.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-a[99761]: starting mds.a at 2024-04-26T18:16:33.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 bash[99747]: 1f185d01b7be7ce6b68ec851c0d2d1ad22acc054bbf9fb0843a704ff8acb57d3 2024-04-26T18:16:33.744 INFO:journalctl@ceph.mds.a.smithi092.stdout:Apr 26 18:16:33 smithi092 systemd[1]: Started Ceph mds.a for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: pgmap v582: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: daemon mds.a restarted 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:boot 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:16:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:33 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: pgmap v582: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: daemon mds.a restarted 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:boot 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:16:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:33 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: pgmap v582: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-04-26T18:16:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: daemon mds.a restarted 2024-04-26T18:16:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: osdmap e155: 12 total, 12 up, 12 in 2024-04-26T18:16:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:boot 2024-04-26T18:16:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: Standby daemon mds.g assigned to filesystem cephfs as rank 1 2024-04-26T18:16:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=j=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-26T18:16:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:33 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:replay,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:35 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:resolve 2024-04-26T18:16:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:35 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:35 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:resolve 2024-04-26T18:16:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:35 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:35 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:resolve 2024-04-26T18:16:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:35 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:resolve,2=j=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4b8cff9640 1 -- 172.21.15.92:0/1465159785 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e21573ee0 con 0x563e21688790 2024-04-26T18:16:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4b8cff9640 10 client.16668 handle_command_reply: tid=0 2024-04-26T18:16:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 client.16668 shutdown 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 msgr2=0x563e2160aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4b9802a940 tx=0x7f4b98046730 comp rx=0 tx=0).stop 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 shutdown_connections 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x563e21688790 0x563e2168abb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563e216110e0 0x563e2160b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e21606820 0x563e2160b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 --2- 172.21.15.92:0/1465159785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563e21605f00 0x563e2160aed0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4b8cff9640 0 client.16668 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 >> 172.21.15.92:0/1465159785 conn(0x563e21602410 msgr2=0x563e216015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 shutdown_connections 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.376+0000 7f4bae449740 1 -- 172.21.15.92:0/1465159785 wait complete. 2024-04-26T18:16:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bae449740 20 client.16668 trim_cache size 0 max 16384 2024-04-26T18:16:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:16:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:16:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:16:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 msgr2=0x7f4b900a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 0x7f4b900a6280 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009fd0 tx=0x7f4b9c017000 comp rx=0 tx=0).stop 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 msgr2=0x7f4ba41996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000e9f0 tx=0x7f4ba000eeb0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 shutdown_connections 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f4b900a3dc0 0x7f4b900a6280 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4ba4107930 0x7f4ba419da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ba4101810 0x7f4ba41996d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 --2- 172.21.15.92:0/4258545837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ba4100e50 0x7f4ba4199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 >> 172.21.15.92:0/4258545837 conn(0x7f4ba4077d50 msgr2=0x7f4ba4105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 shutdown_connections 2024-04-26T18:16:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:36.377+0000 7f4bab72b640 1 -- 172.21.15.92:0/4258545837 wait complete. 2024-04-26T18:16:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: pgmap v584: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:16:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:reconnect 2024-04-26T18:16:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:reconnect 2024-04-26T18:16:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:36 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: pgmap v584: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:16:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:reconnect 2024-04-26T18:16:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:reconnect 2024-04-26T18:16:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:36 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: pgmap v584: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-04-26T18:16:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:reconnect 2024-04-26T18:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:reconnect 2024-04-26T18:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:36 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:reconnect,2=j=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:37 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:rejoin 2024-04-26T18:16:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:37 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:rejoin 2024-04-26T18:16:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:37 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:37 smithi189 ceph-mon[32756]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:16:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:37 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:rejoin 2024-04-26T18:16:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:37 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:rejoin 2024-04-26T18:16:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:37 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:37 smithi156 ceph-mon[32679]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:16:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:37 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:rejoin 2024-04-26T18:16:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:37 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:rejoin 2024-04-26T18:16:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:37 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:rejoin,2=j=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:37 smithi092 ceph-mon[29156]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-04-26T18:16:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:38 smithi189 ceph-mon[32756]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 8 op/s 2024-04-26T18:16:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:38 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:clientreplay 2024-04-26T18:16:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:38 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:active 2024-04-26T18:16:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:38 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:38 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:38.683 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:16:38.517+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-26T18:16:38.683 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:16:38.517+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:16:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-mon[32679]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 8 op/s 2024-04-26T18:16:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:clientreplay 2024-04-26T18:16:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:active 2024-04-26T18:16:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:38 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-mon[29156]: pgmap v585: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 8 op/s 2024-04-26T18:16:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:clientreplay 2024-04-26T18:16:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/2205174458,v1:172.21.15.92:6839/2205174458] up:active 2024-04-26T18:16:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=j=up:clientreplay} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1f0d6af700 time 2024-04-26T18:16:38.392747+0000 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1f17cd83dd] 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.744 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: clone() 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.394+0000 7f1f0d6af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1f0d6af700 time 2024-04-26T18:16:38.392747+0000 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1f17cd83dd] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.745 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: clone() 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: *** Caught signal (Aborted) ** 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: in thread 7f1f0d6af700 thread_name:ms_dispatch 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1f16a60d20] 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: gsignal() 2024-04-26T18:16:38.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: abort() 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1f17cd8437] 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.747 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 16: clone() 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.396+0000 7f1f0d6af700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: in thread 7f1f0d6af700 thread_name:ms_dispatch 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.748 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1f16a60d20] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: gsignal() 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: abort() 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1f17cd8437] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.749 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 16: clone() 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: -1> 2024-04-26T18:16:38.394+0000 7f1f0d6af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1f0d6af700 time 2024-04-26T18:16:38.392747+0000 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1f17cd83dd] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.750 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: clone() 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 0> 2024-04-26T18:16:38.396+0000 7f1f0d6af700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: in thread 7f1f0d6af700 thread_name:ms_dispatch 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1f16a60d20] 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: gsignal() 2024-04-26T18:16:38.751 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: abort() 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1f17cd8437] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 16: clone() 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:38.752 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: -1> 2024-04-26T18:16:38.394+0000 7f1f0d6af700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f1f0d6af700 time 2024-04-26T18:16:38.392747+0000 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f1f17cd83dd] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.753 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: clone() 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 0> 2024-04-26T18:16:38.396+0000 7f1f0d6af700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: in thread 7f1f0d6af700 thread_name:ms_dispatch 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1f16a60d20] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2: gsignal() 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 3: abort() 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f1f17cd8437] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f1f17cd85a3] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x558090fbc822] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x558090f2c598] 2024-04-26T18:16:38.754 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x558090f2ec17] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x558090e27d0b] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x558090e282ac] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x558090e10fad] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f1f17f6ce20] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 13: (DispatchQueue::entry()+0x51f) [0x7f1f17f69fdf] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f1f1803cfc1] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f1f16a561ca] 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 16: clone() 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[99385]: 2024-04-26T18:16:38.755 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:38 smithi092 podman[99827]: 2024-04-26 18:16:38.48478331 +0000 UTC m=+0.028467623 container died c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-26T18:16:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:39 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:39 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:active 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:39 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:39 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:39 smithi092 podman[99827]: 2024-04-26 18:16:39.146139215 +0000 UTC m=+0.689823529 container remove c2db8310d0c47d83d52b46f6e380719a64d1f16a40d9996abf590884937e574b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:39 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:39 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:16:39.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:39 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.165s CPU time. 2024-04-26T18:16:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:39 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:39 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:active 2024-04-26T18:16:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:39 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:39 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:39 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:16:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:39 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/3475939129,v1:172.21.15.92:6835/3475939129] up:active 2024-04-26T18:16:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:39 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:39 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:16:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:40 smithi189 ceph-mon[32756]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-04-26T18:16:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:40 smithi156 ceph-mon[32679]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-04-26T18:16:41.788 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:40 smithi092 ceph-mon[29156]: pgmap v586: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-04-26T18:16:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:42 smithi189 ceph-mon[32756]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:42 smithi156 ceph-mon[32679]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:42 smithi092 ceph-mon[29156]: pgmap v587: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f419b536700 time 2024-04-26T18:16:43.507515+0000 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f41a5b5f3dd] 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.950 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: clone() 2024-04-26T18:16:43.951 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: *** Caught signal (Aborted) ** 2024-04-26T18:16:43.952 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: in thread 7f419b536700 thread_name:ms_dispatch 2024-04-26T18:16:43.952 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.510+0000 7f419b536700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f419b536700 time 2024-04-26T18:16:43.507515+0000 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f41a5b5f3dd] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.953 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: clone() 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f41a48e7d20] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: gsignal() 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: abort() 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f41a5b5f437] 2024-04-26T18:16:43.954 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 16: clone() 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.512+0000 7f419b536700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: in thread 7f419b536700 thread_name:ms_dispatch 2024-04-26T18:16:43.955 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f41a48e7d20] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: gsignal() 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: abort() 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f41a5b5f437] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.956 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 16: clone() 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: -2> 2024-04-26T18:16:43.510+0000 7f419b536700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f419b536700 time 2024-04-26T18:16:43.507515+0000 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f41a5b5f3dd] 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.957 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: clone() 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 0> 2024-04-26T18:16:43.512+0000 7f419b536700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: in thread 7f419b536700 thread_name:ms_dispatch 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.958 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f41a48e7d20] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: gsignal() 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: abort() 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f41a5b5f437] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.959 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 16: clone() 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: -4> 2024-04-26T18:16:43.510+0000 7f419b536700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f419b536700 time 2024-04-26T18:16:43.507515+0000 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f41a5b5f3dd] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.960 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: clone() 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: -2> 2024-04-26T18:16:43.512+0000 7f419b536700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: in thread 7f419b536700 thread_name:ms_dispatch 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f41a48e7d20] 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2: gsignal() 2024-04-26T18:16:43.961 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 3: abort() 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f41a5b5f437] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f41a5b5f5a3] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562909c67822] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562909bd7598] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562909bd9c17] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562909ad2d0b] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562909ad32ac] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562909abbfad] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f41a5df3e20] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 13: (DispatchQueue::entry()+0x51f) [0x7f41a5df0fdf] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f41a5ec3fc1] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f41a48dd1ca] 2024-04-26T18:16:43.962 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 16: clone() 2024-04-26T18:16:43.963 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:43.963 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[98859]: 2024-04-26T18:16:43.963 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:43 smithi092 podman[99873]: 2024-04-26 18:16:43.615065139 +0000 UTC m=+0.037817501 container died c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-26T18:16:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:44 smithi189 ceph-mon[32756]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:44 smithi189 ceph-mon[32756]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T18:16:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:44 smithi156 ceph-mon[32679]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:44 smithi156 ceph-mon[32679]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T18:16:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:44 smithi092 ceph-mon[29156]: pgmap v588: 97 pgs: 97 active+clean; 2.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-04-26T18:16:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:44 smithi092 ceph-mon[29156]: osdmap e156: 12 total, 12 up, 12 in 2024-04-26T18:16:44.743 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:44 smithi092 podman[99873]: 2024-04-26 18:16:44.260090129 +0000 UTC m=+0.682842512 container remove c9b0ab4ab7446cd7d3c70e59f94632e01e5a60475edc1d05684db1bca22683d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:16:44.744 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:44 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:16:44.744 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:44 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-04-26T18:16:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:46 smithi189 ceph-mon[32756]: pgmap v590: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:46.652 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:46 smithi092 ceph-mon[29156]: pgmap v590: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:46 smithi156 ceph-mon[32679]: pgmap v590: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:48 smithi156 ceph-mon[32679]: pgmap v591: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:48 smithi092 ceph-mon[29156]: pgmap v591: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:48 smithi189 ceph-mon[32756]: pgmap v591: 97 pgs: 15 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 76 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 59 KiB/s wr, 24 op/s 2024-04-26T18:16:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.475+0000 7fe7c4d78640 1 -- 172.21.15.92:0/3310838166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0101f80 msgr2=0x7fe7c0102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.475+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/3310838166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0101f80 0x7fe7c0102400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009860 tx=0x7fe7b402a3d0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 -- 172.21.15.92:0/3310838166 shutdown_connections 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/3310838166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0102940 0x7fe7c0100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/3310838166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0101f80 0x7fe7c0102400 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/3310838166 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0107870 0x7fe7c0107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 -- 172.21.15.92:0/3310838166 >> 172.21.15.92:0/3310838166 conn(0x7fe7c0077dc0 msgr2=0x7fe7c00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 -- 172.21.15.92:0/3310838166 shutdown_connections 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 -- 172.21.15.92:0/3310838166 wait complete. 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 Processor -- start 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.476+0000 7fe7c4d78640 1 -- start start 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0102940 0x7fe7c01995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 0x7fe7c019d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0112c50 con 0x7fe7c0101f80 2024-04-26T18:16:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0112ad0 con 0x7fe7c0107870 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7c4d78640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0112dd0 con 0x7fe7c0102940 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59246/0 (socket says 172.21.15.92:59246) 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 -- 172.21.15.92:0/1909600313 learned_addr learned my addr 172.21.15.92:0/1909600313 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 0x7fe7c019d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0102940 0x7fe7c01995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 -- 172.21.15.92:0/1909600313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0102940 msgr2=0x7fe7c01995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0102940 0x7fe7c01995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 -- 172.21.15.92:0/1909600313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 msgr2=0x7fe7c019d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 0x7fe7c019d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 -- 172.21.15.92:0/1909600313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c019e080 con 0x7fe7c0101f80 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 0x7fe7c019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.477+0000 7fe7be59c640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000d770 tx=0x7fe7b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.478+0000 7fe7af7fe640 1 -- 172.21.15.92:0/1909600313 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0017070 con 0x7fe7c0101f80 2024-04-26T18:16:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.478+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c019e370 con 0x7fe7c0101f80 2024-04-26T18:16:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.478+0000 7fe7af7fe640 1 -- 172.21.15.92:0/1909600313 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b00054d0 con 0x7fe7c0101f80 2024-04-26T18:16:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.478+0000 7fe7af7fe640 1 -- 172.21.15.92:0/1909600313 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0004c30 con 0x7fe7c0101f80 2024-04-26T18:16:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.478+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c01a5c00 con 0x7fe7c0101f80 2024-04-26T18:16:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.480+0000 7fe7af7fe640 1 -- 172.21.15.92:0/1909600313 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fe7b0004df0 con 0x7fe7c0101f80 2024-04-26T18:16:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.480+0000 7fe7c7b6c740 1 Processor -- start 2024-04-26T18:16:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 -- start start 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7af7fe640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 0x7fe7a80a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89314820 0x560e8931eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e8927a460 con 0x560e89313f00 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560e89234590 con 0x560e8931f0e0 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560e89276420 con 0x560e89314820 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7af7fe640 1 -- 172.21.15.92:0/1909600313 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 12283+0+0 (secure 0 0 0) 0x7fe7b00d0fa0 con 0x7fe7c0101f80 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 0x7fe7a80a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59250/0 (socket says 172.21.15.92:59250) 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 -- 172.21.15.92:0/2476905627 learned_addr learned my addr 172.21.15.92:0/2476905627 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89314820 0x560e8931eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 -- 172.21.15.92:0/2476905627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89314820 msgr2=0x560e8931eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89314820 0x560e8931eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 -- 172.21.15.92:0/2476905627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 msgr2=0x560e893214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893214d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 -- 172.21.15.92:0/2476905627 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e892410d0 con 0x560e89313f00 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.481+0000 7fe7be59c640 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009610 tx=0x7fe7b004a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39445a0407d2cf32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 0x7fe7a80a6280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x560e89311830 tx=0x7fe7b8010040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7acff9640 1 -- 172.21.15.92:0/2476905627 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0020040 con 0x560e89313f00 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7acff9640 1 -- 172.21.15.92:0/2476905627 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b009c1e0 con 0x560e89313f00 2024-04-26T18:16:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7acff9640 1 -- 172.21.15.92:0/2476905627 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b00cdb60 con 0x560e89313f00 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/2476905627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 msgr2=0x560e893142e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009610 tx=0x7fe7b004a6c0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/2476905627 shutdown_connections 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89314820 0x560e8931eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/2476905627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e893142e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.482+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/2476905627 >> 172.21.15.92:0/2476905627 conn(0x560e89310410 msgr2=0x560e893107f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/2476905627 shutdown_connections 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/2476905627 wait complete. 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- start start 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 Processor -- start 2024-04-26T18:16:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e8931c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e8931f0e0 0x560e8931cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e89321c50 con 0x560e89313f00 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x560e89201b60 con 0x560e89314820 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560e89321dd0 con 0x560e8931f0e0 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7c7b6c740 10 client.0 _ll_register_callbacks cb 0x560e892262b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59258/0 (socket says 172.21.15.92:59258) 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7be59c640 1 -- 172.21.15.92:0/673460548 learned_addr learned my addr 172.21.15.92:0/673460548 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.483+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e8931c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 -- 172.21.15.92:0/673460548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e8931f0e0 msgr2=0x560e8931cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e8931f0e0 0x560e8931cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 -- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 msgr2=0x560e8931c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e8931c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 -- 172.21.15.92:0/673460548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e88f8c210 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7be59c640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0098bb0 tx=0x7fe7b000dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb214ae40111025 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0020050 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 12283+0+0 (secure 0 0 0) 0x7fe7b00cdb60 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7b009c1e0 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=291) ==== 24+0+0 (secure 0 0 0) 0x7fe7b00a4da0 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 10 client.16686 fetch_fsmap learned FSMap version 291 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=291,monmap=4+}) -- 0x560e89058620 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b009c1e0 con 0x560e89313f00 2024-04-26T18:16:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 291) ==== 4708+0+0 (secure 0 0 0) 0x7fe7b00bc040 con 0x560e89313f00 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 10 client.16686 fetch_fsmap finished waiting for FSMap version 291 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 10 client.16686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 20 client.16686 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e89331750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 4 client.16686 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.484+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e89288070 con 0x560e8932f320 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.485+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e89331750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.485+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e89331750 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e499254c7282911 server_cookie=12fc81eab378e269 in_seq=0 out_seq=0 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.485+0000 7fe7a5ffb640 10 client.16686 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/673460548 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560e89288070 con 0x560e8932f320 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7a5ffb640 10 client.16686 handle_command_reply: tid=0 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 client.16686 shutdown 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 msgr2=0x560e8931c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0098bb0 tx=0x7fe7b000dec0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 shutdown_connections 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e89331750 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e8931f0e0 0x560e8931cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7a5ffb640 0 client.16686 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e8931c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/673460548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89313f00 0x560e8931c0f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 >> 172.21.15.92:0/673460548 conn(0x560e89310410 msgr2=0x560e89316190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 shutdown_connections 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/673460548 wait complete. 2024-04-26T18:16:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.486+0000 7fe7c7b6c740 20 client.16686 trim_cache size 0 max 16384 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 Processor -- start 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 -- start start 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e89337000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01b1080 con 0x560e89314820 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01aee70 con 0x560e8931f0e0 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01b09b0 con 0x560e89313f00 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59272/0 (socket says 172.21.15.92:59272) 2024-04-26T18:16:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 -- 172.21.15.92:0/1768563825 learned_addr learned my addr 172.21.15.92:0/1768563825 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7be59c640 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e89337000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 -- 172.21.15.92:0/1768563825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 msgr2=0x560e89337000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e89337000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 -- 172.21.15.92:0/1768563825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 msgr2=0x560e893193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893193b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 -- 172.21.15.92:0/1768563825 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8931a680 con 0x560e89314820 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.502+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009860 tx=0x7fe7b40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5468c77807c139 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7a7fff640 1 -- 172.21.15.92:0/1768563825 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4004240 con 0x560e89314820 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7a7fff640 1 -- 172.21.15.92:0/1768563825 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b4048900 con 0x560e89314820 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7a7fff640 1 -- 172.21.15.92:0/1768563825 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4005050 con 0x560e89314820 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/1768563825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 msgr2=0x560e89337540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009860 tx=0x7fe7b40058b0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/1768563825 shutdown_connections 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e8931f0e0 0x560e893193b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e89314820 0x560e89337540 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/1768563825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e89337000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/1768563825 >> 172.21.15.92:0/1768563825 conn(0x560e89310410 msgr2=0x560e8930f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/1768563825 shutdown_connections 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.503+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/1768563825 wait complete. 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 -- start start 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 Processor -- start 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e893191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e89319700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01afc10 con 0x560e8931f0e0 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01af540 con 0x560e89314820 2024-04-26T18:16:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c01b02e0 con 0x560e89313f00 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7c7b6c740 10 client.0 _ll_register_callbacks cb 0x7fe7b009bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:59280/0 (socket says 172.21.15.92:59280) 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e893191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bdd9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e89319700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 -- 172.21.15.92:0/645092745 learned_addr learned my addr 172.21.15.92:0/645092745 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 -- 172.21.15.92:0/645092745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 msgr2=0x560e893191c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e893191c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 -- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 msgr2=0x560e89319700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e89319700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bed9d640 1 -- 172.21.15.92:0/645092745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e89319fd0 con 0x560e8931f0e0 2024-04-26T18:16:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.504+0000 7fe7bdd9b640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e89319700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7bed9d640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8003e20 tx=0x7fe7b8009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee5c3612168e439 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b802b020 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7b4048900 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 12283+0+0 (secure 0 0 0) 0x7fe7b8027650 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=291) ==== 24+0+0 (secure 0 0 0) 0x7fe7b8003e50 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 10 client.16692 fetch_fsmap learned FSMap version 291 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=291,monmap=4+}) -- 0x560e89395f20 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b4048900 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 291) ==== 4708+0+0 (secure 0 0 0) 0x7fe7b800b040 con 0x560e8931f0e0 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 10 client.16692 fetch_fsmap finished waiting for FSMap version 291 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:16:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 20 client.16692 populate_metadata read hostname 'smithi092' 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.505+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e893986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.506+0000 7fe7c7b6c740 4 client.16692 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.506+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e89281ee0 con 0x560e8932f320 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.506+0000 7fe7be59c640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e893986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.506+0000 7fe7be59c640 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e893986d0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b44151b78b979 server_cookie=8ca9a443f81aa37c in_seq=0 out_seq=0 2024-04-26T18:16:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:49.506+0000 7fe7a5ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:49.835 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 3. 2024-04-26T18:16:49.835 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:49.835 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.165s CPU time. 2024-04-26T18:16:49.835 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 systemd[1]: Starting Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:16:49.836 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 podman[100017]: 2024-04-26 18:16:49.627954146 +0000 UTC m=+0.018183514 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:16:49.836 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:49 smithi092 podman[100017]: 2024-04-26 18:16:49.835789343 +0000 UTC m=+0.226018695 container create f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: pgmap v592: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: daemon mds.j restarted 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:boot 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 podman[100017]: 2024-04-26 18:16:50.231018248 +0000 UTC m=+0.621247598 container init f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 podman[100017]: 2024-04-26 18:16:50.233525406 +0000 UTC m=+0.623754765 container start f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-mds[100036]: -- 172.21.15.92:0/1393044059 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601ea899a40 con 0x5601ea86cc00 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: starting mds.j at 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 bash[100017]: f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e 2024-04-26T18:16:50.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:16:50 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: pgmap v592: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-26T18:16:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T18:16:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: daemon mds.j restarted 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:boot 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:50 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:50.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: pgmap v592: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: osdmap e157: 12 total, 12 up, 12 in 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: daemon mds.j restarted 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: osdmap e158: 12 total, 12 up, 12 in 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:boot 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=g=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:16:50.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:50 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:52 smithi156 ceph-mon[32679]: pgmap v595: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 544 B/s wr, 9 op/s 2024-04-26T18:16:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:52 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:resolve 2024-04-26T18:16:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:52 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:52 smithi092 ceph-mon[29156]: pgmap v595: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 544 B/s wr, 9 op/s 2024-04-26T18:16:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:52 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:resolve 2024-04-26T18:16:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:52 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:52 smithi189 ceph-mon[32756]: pgmap v595: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 544 B/s wr, 9 op/s 2024-04-26T18:16:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:52 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:resolve 2024-04-26T18:16:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:52 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=g=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:16:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:54 smithi156 ceph-mon[32679]: pgmap v596: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:16:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:54 smithi092 ceph-mon[29156]: pgmap v596: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:16:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:54 smithi189 ceph-mon[32756]: pgmap v596: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:16:55.109 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:54 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-04-26T18:16:55.109 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:54 smithi092 systemd[1]: Stopped Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:55.110 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:54 smithi092 systemd[1]: Starting Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:16:55.110 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:54 smithi092 podman[100112]: 2024-04-26 18:16:54.885799996 +0000 UTC m=+0.018610491 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:16:55.110 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:54 smithi092 podman[100112]: 2024-04-26 18:16:54.990384588 +0000 UTC m=+0.123195106 container create 71a2161721337bb0fb2bb51b02d4390f1524c5747215014cc8312ce359e3dc56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-26T18:16:55.405 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 podman[100112]: 2024-04-26 18:16:55.243144492 +0000 UTC m=+0.375954969 container init 71a2161721337bb0fb2bb51b02d4390f1524c5747215014cc8312ce359e3dc56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:16:55.406 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 podman[100112]: 2024-04-26 18:16:55.245883557 +0000 UTC m=+0.378694038 container start 71a2161721337bb0fb2bb51b02d4390f1524c5747215014cc8312ce359e3dc56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-26T18:16:55.406 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mds[100130]: -- 172.21.15.92:0/249702216 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cc1b53a40 con 0x559cc1b26800 2024-04-26T18:16:55.406 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-g[100126]: starting mds.g at 2024-04-26T18:16:55.406 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 bash[100112]: 71a2161721337bb0fb2bb51b02d4390f1524c5747215014cc8312ce359e3dc56 2024-04-26T18:16:55.406 INFO:journalctl@ceph.mds.g.smithi092.stdout:Apr 26 18:16:55 smithi092 systemd[1]: Started Ceph mds.g for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:16:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: daemon mds.g restarted 2024-04-26T18:16:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T18:16:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6838/1851738946,v1:172.21.15.92:6839/1851738946] up:boot 2024-04-26T18:16:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:16:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:16:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:55 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: daemon mds.g restarted 2024-04-26T18:16:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T18:16:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6838/1851738946,v1:172.21.15.92:6839/1851738946] up:boot 2024-04-26T18:16:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:16:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:16:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:55 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: daemon mds.g restarted 2024-04-26T18:16:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: osdmap e159: 12 total, 12 up, 12 in 2024-04-26T18:16:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6838/1851738946,v1:172.21.15.92:6839/1851738946] up:boot 2024-04-26T18:16:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: Standby daemon mds.a assigned to filesystem cephfs as rank 1 2024-04-26T18:16:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,2=d=up:resolve} 2 up:standby-replay 2 up:standby, 1 failed 2024-04-26T18:16:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-26T18:16:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:55 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:replay,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:56 smithi156 ceph-mon[32679]: pgmap v597: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-04-26T18:16:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:56 smithi092 ceph-mon[29156]: pgmap v597: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-04-26T18:16:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:56 smithi189 ceph-mon[32756]: pgmap v597: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-04-26T18:16:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:resolve 2024-04-26T18:16:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:57 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:resolve 2024-04-26T18:16:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:57 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:resolve 2024-04-26T18:16:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:57 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:resolve,2=d=up:resolve} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.446+0000 7fe7a5ffb640 1 -- 172.21.15.92:0/645092745 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e89281ee0 con 0x560e8932f320 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.446+0000 7fe7a5ffb640 10 client.16692 handle_command_reply: tid=0 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.446+0000 7fe7c7b6c740 1 client.16692 shutdown 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 msgr2=0x560e89394870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8003e20 tx=0x7fe7b8009e50 comp rx=0 tx=0).stop 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 shutdown_connections 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x560e8932f320 0x560e893986d0 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e8931f0e0 0x560e89394870 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560e89314820 0x560e89319700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.448 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 --2- 172.21.15.92:0/645092745 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560e89313f00 0x560e893191c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7a5ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 >> 172.21.15.92:0/645092745 conn(0x560e89310410 msgr2=0x560e893158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 shutdown_connections 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 1 -- 172.21.15.92:0/645092745 wait complete. 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.447+0000 7fe7c7b6c740 20 client.16692 trim_cache size 0 max 16384 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:16:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:16:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 msgr2=0x7fe7a80a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 0x7fe7a80a6280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x560e89311830 tx=0x7fe7b8010040 comp rx=0 tx=0).stop 2024-04-26T18:16:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 msgr2=0x7fe7c0199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:16:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000d770 tx=0x7fe7b000dc30 comp rx=0 tx=0).stop 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 shutdown_connections 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fe7a80a3dc0 0x7fe7a80a6280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7c0107870 0x7fe7c019d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7c0102940 0x7fe7c01995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 --2- 172.21.15.92:0/1909600313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7c0101f80 0x7fe7c0199090 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 >> 172.21.15.92:0/1909600313 conn(0x7fe7c0077dc0 msgr2=0x7fe7c0103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 shutdown_connections 2024-04-26T18:16:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:16:58.448+0000 7fe7c4d78640 1 -- 172.21.15.92:0/1909600313 wait complete. 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: pgmap v599: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:reconnect 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:reconnect 2024-04-26T18:16:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:58 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: pgmap v599: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-26T18:16:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:reconnect 2024-04-26T18:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:reconnect 2024-04-26T18:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:58 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: pgmap v599: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 22 KiB/s wr, 8 op/s 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.00199994 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:reconnect 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:reconnect 2024-04-26T18:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:58 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:reconnect,2=d=up:reconnect} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:59 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:rejoin 2024-04-26T18:16:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:59 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:rejoin 2024-04-26T18:16:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:59 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:59 smithi156 ceph-mon[32679]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:16:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:16:59 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:16:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:rejoin 2024-04-26T18:16:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:rejoin 2024-04-26T18:16:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-mon[29156]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:16:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:16:59.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1e1307700 time 2024-04-26T18:16:59.465385+0000 2024-04-26T18:16:59.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:59.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1eb9303dd] 2024-04-26T18:16:59.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: clone() 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.465+0000 7fd1e1307700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1e1307700 time 2024-04-26T18:16:59.465385+0000 2024-04-26T18:16:59.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1eb9303dd] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.746 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: clone() 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: *** Caught signal (Aborted) ** 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: in thread 7fd1e1307700 thread_name:ms_dispatch 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1ea6b8d20] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: gsignal() 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: abort() 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1eb930437] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.747 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.748 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 16: clone() 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.467+0000 7fd1e1307700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: in thread 7fd1e1307700 thread_name:ms_dispatch 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1ea6b8d20] 2024-04-26T18:16:59.749 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: gsignal() 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: abort() 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1eb930437] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.750 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 16: clone() 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: -1> 2024-04-26T18:16:59.465+0000 7fd1e1307700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1e1307700 time 2024-04-26T18:16:59.465385+0000 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1eb9303dd] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.751 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: clone() 2024-04-26T18:16:59.752 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 0> 2024-04-26T18:16:59.467+0000 7fd1e1307700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: in thread 7fd1e1307700 thread_name:ms_dispatch 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1ea6b8d20] 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: gsignal() 2024-04-26T18:16:59.753 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: abort() 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1eb930437] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.754 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 16: clone() 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:59.755 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: -1> 2024-04-26T18:16:59.465+0000 7fd1e1307700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fd1e1307700 time 2024-04-26T18:16:59.465385+0000 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fd1eb9303dd] 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.756 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: clone() 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 0> 2024-04-26T18:16:59.467+0000 7fd1e1307700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: in thread 7fd1e1307700 thread_name:ms_dispatch 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fd1ea6b8d20] 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2: gsignal() 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 3: abort() 2024-04-26T18:16:59.757 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fd1eb930437] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fd1eb9305a3] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55c3296cb822] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55c32963b598] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55c32963dc17] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55c329536d0b] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55c3295372ac] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55c32951ffad] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fd1ebbc4e20] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 13: (DispatchQueue::entry()+0x51f) [0x7fd1ebbc1fdf] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fd1ebc94fc1] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fd1ea6ae1ca] 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 16: clone() 2024-04-26T18:16:59.758 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:16:59.759 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[99626]: 2024-04-26T18:16:59.759 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:16:59 smithi092 podman[100180]: 2024-04-26 18:16:59.55008475 +0000 UTC m=+0.025841299 container died 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:16:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:59 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:rejoin 2024-04-26T18:16:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:59 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:rejoin 2024-04-26T18:16:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:59 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:rejoin,2=d=up:rejoin} 1 up:standby-replay 2 up:standby 2024-04-26T18:16:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:59 smithi189 ceph-mon[32756]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-04-26T18:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:16:59 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:17:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-04-26T18:17:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:17:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:active 2024-04-26T18:17:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:17:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:00 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-04-26T18:17:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:active 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:00 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:00 smithi092 podman[100180]: 2024-04-26 18:17:00.332048536 +0000 UTC m=+0.807805082 container remove 23520febdbbfcc1d05afbf85af9e86b2c67f49ee696ebc854af25163aae6ec4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:17:00.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:00 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.187s CPU time. 2024-04-26T18:17:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: pgmap v600: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-04-26T18:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/2116064079,v1:172.21.15.92:6837/2116064079] up:active 2024-04-26T18:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 1 up:standby-replay 2 up:standby 2024-04-26T18:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:00 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:17:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:02 smithi092 ceph-mon[29156]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-26T18:17:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:17:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:02 smithi189 ceph-mon[32756]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-26T18:17:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:17:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:02 smithi156 ceph-mon[32679]: pgmap v601: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-04-26T18:17:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:17:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:17:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:17:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:03 smithi092 ceph-mon[29156]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T18:17:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:03 smithi092 ceph-mon[29156]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-04-26T18:17:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:03 smithi189 ceph-mon[32756]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T18:17:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:03 smithi189 ceph-mon[32756]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-04-26T18:17:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:03 smithi156 ceph-mon[32679]: pgmap v602: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-04-26T18:17:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:03 smithi156 ceph-mon[32679]: pgmap v603: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-04-26T18:17:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:05 smithi092 ceph-mon[29156]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:05 smithi189 ceph-mon[32756]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:05 smithi156 ceph-mon[32679]: pgmap v604: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:07 smithi092 ceph-mon[29156]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-26T18:17:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:07 smithi189 ceph-mon[32756]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-26T18:17:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:07 smithi156 ceph-mon[32679]: pgmap v605: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 40 KiB/s wr, 26 op/s 2024-04-26T18:17:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:09 smithi092 ceph-mon[29156]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 39 KiB/s wr, 25 op/s 2024-04-26T18:17:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:09 smithi189 ceph-mon[32756]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 39 KiB/s wr, 25 op/s 2024-04-26T18:17:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:09 smithi156 ceph-mon[32679]: pgmap v606: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 39 KiB/s wr, 25 op/s 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:10 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:10 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:10 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.187s CPU time. 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:10 smithi092 systemd[1]: Starting Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:10 smithi092 podman[100420]: 2024-04-26 18:17:10.886165377 +0000 UTC m=+0.018784321 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:17:11.015 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 podman[100420]: 2024-04-26 18:17:11.015566668 +0000 UTC m=+0.148185604 container create c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424) 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/28505167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb01010e0 msgr2=0x7f2cb01014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/28505167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb01010e0 0x7f2cb01014c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009900 tx=0x7f2ca002a410 comp rx=0 tx=0).stop 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/28505167 shutdown_connections 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/28505167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb0107cf0 0x7f2cb010f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/28505167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0101a90 0x7f2cb01075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/28505167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb01010e0 0x7f2cb01014c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/28505167 >> 172.21.15.92:0/28505167 conn(0x7f2cb0077dc0 msgr2=0x7f2cb00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/28505167 shutdown_connections 2024-04-26T18:17:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/28505167 wait complete. 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.538+0000 7f2cb5ebd640 1 Processor -- start 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- start start 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb01010e0 0x7f2cb0199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0107cf0 0x7f2cb0199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0112c00 con 0x7f2cb019d9e0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0112a80 con 0x7f2cb01010e0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0112d80 con 0x7f2cb0107cf0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54168/0 (socket says 172.21.15.92:54168) 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 -- 172.21.15.92:0/2875920863 learned_addr learned my addr 172.21.15.92:0/2875920863 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb01010e0 0x7f2cb0199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caeffd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0107cf0 0x7f2cb0199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 -- 172.21.15.92:0/2875920863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0107cf0 msgr2=0x7f2cb0199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0107cf0 0x7f2cb0199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 -- 172.21.15.92:0/2875920863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb01010e0 msgr2=0x7f2cb0199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb01010e0 0x7f2cb0199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 -- 172.21.15.92:0/2875920863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb019e4d0 con 0x7f2cb019d9e0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2caffff640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800eb10 tx=0x7f2ca800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cacff9640 1 -- 172.21.15.92:0/2875920863 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004b20 con 0x7f2cb019d9e0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb019e7c0 con 0x7f2cb019d9e0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cacff9640 1 -- 172.21.15.92:0/2875920863 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca8004cc0 con 0x7f2cb019d9e0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cacff9640 1 -- 172.21.15.92:0/2875920863 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8010670 con 0x7f2cb019d9e0 2024-04-26T18:17:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.539+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb01a5f60 con 0x7f2cb019d9e0 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cacff9640 1 -- 172.21.15.92:0/2875920863 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2ca8005020 con 0x7f2cb019d9e0 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 Processor -- start 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 -- start start 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af987ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af98a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564af8e3460 con 0x5564af97cf00 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5564af89d590 con 0x5564af97d820 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564af8df420 con 0x5564af9880e0 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cacff9640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 0x7f2c980a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54174/0 (socket says 172.21.15.92:54174) 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2caeffd640 1 -- 172.21.15.92:0/3112276031 learned_addr learned my addr 172.21.15.92:0/3112276031 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af987ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2cacff9640 1 -- 172.21.15.92:0/2875920863 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 12453+0+0 (secure 0 0 0) 0x7f2ca80d1cf0 con 0x7f2cb019d9e0 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.542+0000 7f2caffff640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 0x7f2c980a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 -- 172.21.15.92:0/3112276031 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 msgr2=0x5564af98a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af98a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 -- 172.21.15.92:0/3112276031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 msgr2=0x5564af97d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 -- 172.21.15.92:0/3112276031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564af8aa0d0 con 0x5564af97d820 2024-04-26T18:17:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caeffd640 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af987ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009230 tx=0x7f2ca0032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0aba6cc27fb7e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2caffff640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 0x7f2c980a6280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a5470 tx=0x7f2ca800cee0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2c95ffb640 1 -- 172.21.15.92:0/3112276031 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0040070 con 0x5564af97d820 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2c95ffb640 1 -- 172.21.15.92:0/3112276031 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca0004030 con 0x5564af97d820 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.543+0000 7f2c95ffb640 1 -- 172.21.15.92:0/3112276031 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0035040 con 0x5564af97d820 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3112276031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 msgr2=0x5564af987ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af987ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009230 tx=0x7f2ca0032bd0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3112276031 shutdown_connections 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af98a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af987ba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3112276031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af97d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3112276031 >> 172.21.15.92:0/3112276031 conn(0x5564af979410 msgr2=0x5564af9797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3112276031 shutdown_connections 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3112276031 wait complete. 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 -- start start 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 Processor -- start 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.544+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af985650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af985b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564af98acb0 con 0x5564af97cf00 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5564af86ab60 con 0x5564af97d820 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5564af98ae30 con 0x5564af9880e0 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 10 client.0 _ll_register_callbacks cb 0x5564af88f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54180/0 (socket says 172.21.15.92:54180) 2024-04-26T18:17:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 -- 172.21.15.92:0/3452253912 learned_addr learned my addr 172.21.15.92:0/3452253912 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af985650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 -- 172.21.15.92:0/3452253912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 msgr2=0x5564af985b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af985b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 -- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 msgr2=0x5564af985650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af985650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 -- 172.21.15.92:0/3452253912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564af5f5210 con 0x5564af97cf00 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2caeffd640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40126a0 tx=0x7f2ca4012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2423f2d257a64f12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4011ae0 con 0x5564af97cf00 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 12453+0+0 (secure 0 0 0) 0x7f2ca4011c80 con 0x5564af97cf00 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca0004030 con 0x5564af97cf00 2024-04-26T18:17:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=303) ==== 24+0+0 (secure 0 0 0) 0x7f2ca4011e80 con 0x5564af97cf00 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 10 client.16722 fetch_fsmap learned FSMap version 303 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=303,monmap=4+}) -- 0x5564af6c1620 con 0x5564af97cf00 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.545+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca0004030 con 0x5564af97cf00 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 303) ==== 4712+0+0 (secure 0 0 0) 0x7f2ca4019030 con 0x5564af97cf00 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 10 client.16722 fetch_fsmap finished waiting for FSMap version 303 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 10 client.16722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 20 client.16722 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af998720 0x5564af99ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 4 client.16722 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564af8f1070 con 0x5564af998720 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af998720 0x5564af99ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2c8effd640 10 client.16722 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.546+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af998720 0x5564af99ab40 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8e58960e7e3187 server_cookie=ad34caaa94fa93a4 in_seq=0 out_seq=0 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2c8effd640 1 -- 172.21.15.92:0/3452253912 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5564af8f1070 con 0x5564af998720 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2c8effd640 10 client.16722 handle_command_reply: tid=0 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 client.16722 shutdown 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 msgr2=0x5564af985110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40126a0 tx=0x7f2ca4012b60 comp rx=0 tx=0).stop 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 shutdown_connections 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af998720 0x5564af99ab40 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af9880e0 0x5564af985b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2c8effd640 0 client.16722 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af985650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/3452253912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af97cf00 0x5564af985110 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 >> 172.21.15.92:0/3452253912 conn(0x5564af979410 msgr2=0x5564af97f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 shutdown_connections 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/3452253912 wait complete. 2024-04-26T18:17:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.547+0000 7f2cb8bcf740 20 client.16722 trim_cache size 0 max 16384 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 Processor -- start 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 -- start start 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97cf00 0x5564af993b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97d820 0x5564af97f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b1190 con 0x5564af9880e0 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01af650 con 0x5564af97cf00 2024-04-26T18:17:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b0ac0 con 0x5564af97d820 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54190/0 (socket says 172.21.15.92:54190) 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 -- 172.21.15.92:0/400691750 learned_addr learned my addr 172.21.15.92:0/400691750 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97cf00 0x5564af993b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 -- 172.21.15.92:0/400691750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97d820 msgr2=0x5564af97f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97d820 0x5564af97f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 -- 172.21.15.92:0/400691750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97cf00 msgr2=0x5564af993b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97cf00 0x5564af993b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 -- 172.21.15.92:0/400691750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564af980d10 con 0x5564af9880e0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2caeffd640 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005fd0 tx=0x7f2ca4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b92f642acb9cae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.562+0000 7f2c957fa640 1 -- 172.21.15.92:0/400691750 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40117b0 con 0x5564af9880e0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2c957fa640 1 -- 172.21.15.92:0/400691750 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca4005070 con 0x5564af9880e0 2024-04-26T18:17:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2c957fa640 1 -- 172.21.15.92:0/400691750 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca401aa00 con 0x5564af9880e0 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/400691750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 msgr2=0x5564af9a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005fd0 tx=0x7f2ca4005970 comp rx=0 tx=0).stop 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/400691750 shutdown_connections 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9a0410 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97d820 0x5564af97f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/400691750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97cf00 0x5564af993b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/400691750 >> 172.21.15.92:0/400691750 conn(0x5564af979410 msgr2=0x5564af97e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/400691750 shutdown_connections 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/400691750 wait complete. 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.563+0000 7f2cb8bcf740 1 -- start start 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 Processor -- start 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 0x5564af982090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9fdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01b03f0 con 0x5564af9880e0 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01afd20 con 0x5564af97d820 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb01ae5b0 con 0x5564af97cf00 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2cb8bcf740 10 client.0 _ll_register_callbacks cb 0x7f2ca400b890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9fdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:38742/0 (socket says 172.21.15.92:38742) 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 -- 172.21.15.92:0/78968391 learned_addr learned my addr 172.21.15.92:0/78968391 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caeffd640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9fdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:54206/0 (socket says 172.21.15.92:54206) 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caeffd640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 0x5564af982090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 -- 172.21.15.92:0/78968391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 msgr2=0x5564af982090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 0x5564af982090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 -- 172.21.15.92:0/78968391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 msgr2=0x5564af9fdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9fdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 -- 172.21.15.92:0/78968391 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564af9fe1c0 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caeffd640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 0x5564af982090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2caf7fe640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009900 tx=0x7f2ca0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8338a59c6b21053c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.564+0000 7f2c8effd640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0040040 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ca4005070 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(160..160 src has 1..160) ==== 12453+0+0 (secure 0 0 0) 0x7f2ca0005460 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=303) ==== 24+0+0 (secure 0 0 0) 0x7f2ca0035040 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 10 client.26198 fetch_fsmap learned FSMap version 303 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=303,monmap=4+}) -- 0x5564af9ff230 con 0x5564af97d820 2024-04-26T18:17:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ca4005070 con 0x5564af97d820 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 303) ==== 4712+0+0 (secure 0 0 0) 0x7f2ca0004a20 con 0x5564af97d820 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 10 client.26198 fetch_fsmap finished waiting for FSMap version 303 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 10 client.26198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 20 client.26198 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af9ff980 0x5564afa01da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 4 client.26198 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564af8eaee0 con 0x5564af9ff980 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.565+0000 7f2caeffd640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af9ff980 0x5564afa01da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.566+0000 7f2c8effd640 10 client.26198 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:11.566+0000 7f2caeffd640 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af9ff980 0x5564afa01da0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d2b11beb8a9735 server_cookie=df8aaf4595caf206 in_seq=0 out_seq=0 2024-04-26T18:17:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: pgmap v607: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: daemon mds.d restarted 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:boot 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 podman[100420]: 2024-04-26 18:17:11.312632197 +0000 UTC m=+0.445251131 container init c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-26T18:17:11.744 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 podman[100420]: 2024-04-26 18:17:11.315506069 +0000 UTC m=+0.448125012 container start c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:17:11.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-mds[100439]: -- 172.21.15.92:0/371537016 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e983f9a40 con 0x560e983ccc00 2024-04-26T18:17:11.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: starting mds.d at 2024-04-26T18:17:11.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 bash[100420]: c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad 2024-04-26T18:17:11.745 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:11 smithi092 systemd[1]: Started Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: pgmap v607: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: daemon mds.d restarted 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:boot 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:11 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: pgmap v607: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 33 KiB/s wr, 25 op/s 2024-04-26T18:17:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: daemon mds.d restarted 2024-04-26T18:17:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: osdmap e160: 12 total, 12 up, 12 in 2024-04-26T18:17:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:boot 2024-04-26T18:17:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:11 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:13 smithi092 ceph-mon[29156]: pgmap v609: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-04-26T18:17:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:resolve 2024-04-26T18:17:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:13 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:13 smithi189 ceph-mon[32756]: pgmap v609: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-04-26T18:17:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:resolve 2024-04-26T18:17:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:13 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:13 smithi156 ceph-mon[32679]: pgmap v609: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 29 KiB/s wr, 22 op/s 2024-04-26T18:17:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:resolve 2024-04-26T18:17:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:13 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2c8effd640 1 -- 172.21.15.92:0/78968391 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564af8eaee0 con 0x5564af9ff980 2024-04-26T18:17:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2c8effd640 10 client.26198 handle_command_reply: tid=0 2024-04-26T18:17:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 client.26198 shutdown 2024-04-26T18:17:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 msgr2=0x5564af9825d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:14.482 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009900 tx=0x7f2ca0009260 comp rx=0 tx=0).stop 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 shutdown_connections 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5564af9ff980 0x5564afa01da0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5564af9880e0 0x5564af9fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5564af97d820 0x5564af9825d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 --2- 172.21.15.92:0/78968391 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5564af97cf00 0x5564af982090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2c8effd640 0 client.26198 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 >> 172.21.15.92:0/78968391 conn(0x5564af979410 msgr2=0x5564af985940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 shutdown_connections 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 1 -- 172.21.15.92:0/78968391 wait complete. 2024-04-26T18:17:14.483 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.482+0000 7f2cb8bcf740 20 client.26198 trim_cache size 0 max 16384 2024-04-26T18:17:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:17:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:17:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:17:14.484 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 msgr2=0x7f2c980a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 0x7f2c980a6280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80a5470 tx=0x7f2ca800cee0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 msgr2=0x7f2cb019de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800eb10 tx=0x7f2ca800c2d0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 shutdown_connections 2024-04-26T18:17:14.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2c980a3dc0 0x7f2c980a6280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cb019d9e0 0x7f2cb019de90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cb0107cf0 0x7f2cb0199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 --2- 172.21.15.92:0/2875920863 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb01010e0 0x7f2cb0199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 >> 172.21.15.92:0/2875920863 conn(0x7f2cb0077dc0 msgr2=0x7f2cb00ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 shutdown_connections 2024-04-26T18:17:14.486 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:14.483+0000 7f2cb5ebd640 1 -- 172.21.15.92:0/2875920863 wait complete. 2024-04-26T18:17:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:reconnect 2024-04-26T18:17:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:rejoin 2024-04-26T18:17:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:14 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:14 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:reconnect 2024-04-26T18:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:14 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:rejoin 2024-04-26T18:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:14 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:14 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:reconnect 2024-04-26T18:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:14 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:rejoin 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc46011d700 time 2024-04-26T18:17:14.819301+0000 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc46a7463dd] 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.189 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: clone() 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:14.820+0000 7fc46011d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc46011d700 time 2024-04-26T18:17:14.819301+0000 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:15.190 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc46a7463dd] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.192 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: clone() 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: *** Caught signal (Aborted) ** 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: in thread 7fc46011d700 thread_name:ms_dispatch 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4694ced20] 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: gsignal() 2024-04-26T18:17:15.193 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: abort() 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc46a746437] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.194 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 16: clone() 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:14.822+0000 7fc46011d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: in thread 7fc46011d700 thread_name:ms_dispatch 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4694ced20] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: gsignal() 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: abort() 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc46a746437] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.195 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 16: clone() 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: -1> 2024-04-26T18:17:14.820+0000 7fc46011d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc46011d700 time 2024-04-26T18:17:14.819301+0000 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.196 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.197 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc46a7463dd] 2024-04-26T18:17:15.197 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.197 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.197 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.198 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: clone() 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 0> 2024-04-26T18:17:14.822+0000 7fc46011d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:15.199 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: in thread 7fc46011d700 thread_name:ms_dispatch 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4694ced20] 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: gsignal() 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: abort() 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc46a746437] 2024-04-26T18:17:15.200 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.201 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 16: clone() 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.202 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: -1> 2024-04-26T18:17:14.820+0000 7fc46011d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fc46011d700 time 2024-04-26T18:17:14.819301+0000 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc46a7463dd] 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.203 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.204 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: clone() 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 0> 2024-04-26T18:17:14.822+0000 7fc46011d700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: in thread 7fc46011d700 thread_name:ms_dispatch 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:15.205 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fc4694ced20] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2: gsignal() 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 3: abort() 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc46a746437] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fc46a7465a3] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x5601e7d7a822] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x5601e7cea598] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x5601e7cecc17] 2024-04-26T18:17:15.206 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x5601e7be5d0b] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x5601e7be62ac] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x5601e7bcefad] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fc46a9dae20] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 13: (DispatchQueue::entry()+0x51f) [0x7fc46a9d7fdf] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fc46aaaafc1] 2024-04-26T18:17:15.207 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc4694c41ca] 2024-04-26T18:17:15.208 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 16: clone() 2024-04-26T18:17:15.208 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:15.208 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100032]: 2024-04-26T18:17:15.208 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:14 smithi092 podman[100520]: 2024-04-26 18:17:14.895226114 +0000 UTC m=+0.022681071 container died f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-26T18:17:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: pgmap v610: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-04-26T18:17:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:active 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:15 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:15 smithi092 podman[100520]: 2024-04-26 18:17:15.549546338 +0000 UTC m=+0.677001343 container remove f6417f2ea0b6556338c9104ce4cf0861b93755a4f6d563198b9a07378372379e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-26T18:17:15.746 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:17:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: pgmap v610: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-04-26T18:17:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:active 2024-04-26T18:17:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:15 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: pgmap v610: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 13 KiB/s wr, 17 op/s 2024-04-26T18:17:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1548149603,v1:172.21.15.92:6835/1548149603] up:active 2024-04-26T18:17:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:15 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:16.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:17:16.243 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:15 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.159s CPU time. 2024-04-26T18:17:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:17 smithi092 ceph-mon[29156]: pgmap v611: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:17 smithi189 ceph-mon[32756]: pgmap v611: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:17 smithi156 ceph-mon[32679]: pgmap v611: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:18.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:17:18 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:17:18.520+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:17:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:19 smithi092 ceph-mon[29156]: pgmap v612: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:19 smithi189 ceph-mon[32756]: pgmap v612: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:19 smithi156 ceph-mon[32679]: pgmap v612: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:17:21.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:21 smithi156 ceph-mon[32679]: pgmap v613: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T18:17:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:21 smithi092 ceph-mon[29156]: pgmap v613: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T18:17:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:21 smithi189 ceph-mon[32756]: pgmap v613: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 63 KiB/s wr, 33 op/s 2024-04-26T18:17:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:23 smithi092 ceph-mon[29156]: pgmap v614: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-04-26T18:17:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:23 smithi189 ceph-mon[32756]: pgmap v614: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-04-26T18:17:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:23 smithi156 ceph-mon[32679]: pgmap v614: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 61 KiB/s wr, 32 op/s 2024-04-26T18:17:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:25 smithi092 ceph-mon[29156]: pgmap v615: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-04-26T18:17:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:25 smithi189 ceph-mon[32756]: pgmap v615: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-04-26T18:17:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:25 smithi156 ceph-mon[32679]: pgmap v615: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 52 KiB/s wr, 28 op/s 2024-04-26T18:17:26.324 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:25 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 4. 2024-04-26T18:17:26.324 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:25 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:26.324 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:25 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.159s CPU time. 2024-04-26T18:17:26.324 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 systemd[1]: Starting Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:17:26.325 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 podman[100620]: 2024-04-26 18:17:26.13226706 +0000 UTC m=+0.018347633 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:17:26.325 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 podman[100620]: 2024-04-26 18:17:26.324882325 +0000 UTC m=+0.210962874 container create 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-26T18:17:26.627 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 podman[100620]: 2024-04-26 18:17:26.544461929 +0000 UTC m=+0.430542481 container init 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-04-26T18:17:26.627 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 podman[100620]: 2024-04-26 18:17:26.547190684 +0000 UTC m=+0.433271234 container start 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:17:26.627 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 ceph-mds[100639]: -- 172.21.15.92:0/2259802669 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562efc4f5a40 con 0x562efc4c8c00 2024-04-26T18:17:26.627 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: starting mds.j at 2024-04-26T18:17:26.993 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 bash[100620]: 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c 2024-04-26T18:17:26.993 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:26 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:27.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/1119376518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68108950 msgr2=0x7f8d68108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/1119376518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68108950 0x7f8d68108d30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009930 tx=0x7f8d5c02a420 comp rx=0 tx=0).stop 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/1119376518 shutdown_connections 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/1119376518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d6810f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/1119376518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68102940 0x7f8d68102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/1119376518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68108950 0x7f8d68108d30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/1119376518 >> 172.21.15.92:0/1119376518 conn(0x7f8d68079dc0 msgr2=0x7f8d6807a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:27.579 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/1119376518 shutdown_connections 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.574+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/1119376518 wait complete. 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 Processor -- start 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 -- start start 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d681995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68108950 0x7f8d6819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d68112c10 con 0x7f8d68102940 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8d68112a90 con 0x7f8d68103300 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6cc2a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d68112d90 con 0x7f8d68108950 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45798/0 (socket says 172.21.15.92:45798) 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d65d9b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d681995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d6659c640 1 -- 172.21.15.92:0/3833986505 learned_addr learned my addr 172.21.15.92:0/3833986505 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:27.580 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.575+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68108950 0x7f8d6819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 -- 172.21.15.92:0/3833986505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68108950 msgr2=0x7f8d6819d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68108950 0x7f8d6819d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 -- 172.21.15.92:0/3833986505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 msgr2=0x7f8d681995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d681995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 -- 172.21.15.92:0/3833986505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6819e0a0 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d681995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c005940 tx=0x7f8d5c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d577fe640 1 -- 172.21.15.92:0/3833986505 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c03f030 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6819e330 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d577fe640 1 -- 172.21.15.92:0/3833986505 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d5c0044c0 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d577fe640 1 -- 172.21.15.92:0/3833986505 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c035070 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.576+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d681a5c20 con 0x7f8d68102940 2024-04-26T18:17:27.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.578+0000 7f8d577fe640 1 -- 172.21.15.92:0/3833986505 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f8d5c042030 con 0x7f8d68102940 2024-04-26T18:17:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 Processor -- start 2024-04-26T18:17:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 -- start start 2024-04-26T18:17:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d577fe640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 0x7f8d500a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740a21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a874008460 con 0x55a8740a2700 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55a873fc2590 con 0x55a8740b14f0 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a874004420 con 0x55a8740a1de0 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 0x7f8d500a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45810/0 (socket says 172.21.15.92:45810) 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d65d9b640 1 -- 172.21.15.92:0/3128238320 learned_addr learned my addr 172.21.15.92:0/3128238320 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d577fe640 1 -- 172.21.15.92:0/3833986505 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 12539+0+0 (secure 0 0 0) 0x7f8d5c0f1ae0 con 0x7f8d68102940 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740a21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.579+0000 7f8d65d9b640 1 -- 172.21.15.92:0/3128238320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 msgr2=0x55a8740a21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740a21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d65d9b640 1 -- 172.21.15.92:0/3128238320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 msgr2=0x55a8740b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d65d9b640 1 -- 172.21.15.92:0/3128238320 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a873fcf0d0 con 0x55a8740a2700 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8d58011520 tx=0x7f8d580119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558be57450dc4f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 0x7f8d500a6280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55a8740a3370 tx=0x7f8d60009a80 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d54ff9640 1 -- 172.21.15.92:0/3128238320 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58004020 con 0x55a8740a2700 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d54ff9640 1 -- 172.21.15.92:0/3128238320 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d580041c0 con 0x55a8740a2700 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.580+0000 7f8d54ff9640 1 -- 172.21.15.92:0/3128238320 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800f8f0 con 0x55a8740a2700 2024-04-26T18:17:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3128238320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 msgr2=0x55a8740b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f8d58011520 tx=0x7f8d580119e0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3128238320 shutdown_connections 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a2700 0x55a8740b0fb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3128238320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740a21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3128238320 >> 172.21.15.92:0/3128238320 conn(0x55a87409e410 msgr2=0x55a87409e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3128238320 shutdown_connections 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3128238320 wait complete. 2024-04-26T18:17:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- start start 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 Processor -- start 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740ae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a8740b4120 con 0x55a8740a1de0 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x55a873f8fb60 con 0x55a8740b14f0 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55a8740b42a0 con 0x55a8740a2700 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6fa23740 10 client.0 _ll_register_callbacks cb 0x55a873fb42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45824/0 (socket says 172.21.15.92:45824) 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.581+0000 7f8d6659c640 1 -- 172.21.15.92:0/376322481 learned_addr learned my addr 172.21.15.92:0/376322481 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 -- 172.21.15.92:0/376322481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 msgr2=0x55a8740ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 -- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 msgr2=0x55a8740aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 -- 172.21.15.92:0/376322481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a873d1a210 con 0x55a8740a1de0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6659c640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0b9550 tx=0x7f8d5c03b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef44d5836367cbd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c049040 con 0x55a8740a1de0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(161..161 src has 1..161) ==== 12539+0+0 (secure 0 0 0) 0x7f8d5c003cc0 con 0x55a8740a1de0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d580041c0 con 0x55a8740a1de0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=309) ==== 24+0+0 (secure 0 0 0) 0x7f8d5c0c6600 con 0x55a8740a1de0 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6fa23740 10 client.16746 fetch_fsmap learned FSMap version 309 2024-04-26T18:17:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.582+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=309,monmap=4+}) -- 0x55a873de6620 con 0x55a8740a1de0 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d580041c0 con 0x55a8740a1de0 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 309) ==== 4712+0+0 (secure 0 0 0) 0x7f8d5c0b91f0 con 0x55a8740a1de0 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 10 client.16746 fetch_fsmap finished waiting for FSMap version 309 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 20 client.16746 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8740c17e0 0x55a8740c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 4 client.16746 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a874016070 con 0x55a8740c17e0 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8740c17e0 0x55a8740c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d4dffb640 10 client.16746 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.583+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8740c17e0 0x55a8740c3c30 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455447c4ab179a03 server_cookie=182f21c89be9b7ea in_seq=0 out_seq=0 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d4dffb640 1 -- 172.21.15.92:0/376322481 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a874016070 con 0x55a8740c17e0 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d4dffb640 10 client.16746 handle_command_reply: tid=0 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 client.16746 shutdown 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 msgr2=0x55a8740ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0b9550 tx=0x7f8d5c03b460 comp rx=0 tx=0).stop 2024-04-26T18:17:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 shutdown_connections 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8740c17e0 0x55a8740c3c30 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d4dffb640 0 client.16746 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/376322481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740ae3d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 >> 172.21.15.92:0/376322481 conn(0x55a87409e410 msgr2=0x55a8740a4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 shutdown_connections 2024-04-26T18:17:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 1 -- 172.21.15.92:0/376322481 wait complete. 2024-04-26T18:17:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.584+0000 7f8d6fa23740 20 client.16746 trim_cache size 0 max 16384 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 Processor -- start 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 -- start start 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740bd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 0x55a87409d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681aefa0 con 0x55a8740b14f0 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681ad460 con 0x55a8740a2700 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681ae8d0 con 0x55a8740a1de0 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d66d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d66d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45828/0 (socket says 172.21.15.92:45828) 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d66d9d640 1 -- 172.21.15.92:0/3757310302 learned_addr learned my addr 172.21.15.92:0/3757310302 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 0x55a87409d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.600+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.609 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 -- 172.21.15.92:0/3757310302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 msgr2=0x55a8740bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 -- 172.21.15.92:0/3757310302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 msgr2=0x55a87409d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 0x55a87409d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 -- 172.21.15.92:0/3757310302 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8740c1590 con 0x55a8740b14f0 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 0x55a87409d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d6659c640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8d600123a0 tx=0x7f8d60015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8f0dbf016678f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.610 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d4ffff640 1 -- 172.21.15.92:0/3757310302 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000fe00 con 0x55a8740b14f0 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d4ffff640 1 -- 172.21.15.92:0/3757310302 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d60027070 con 0x55a8740b14f0 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.601+0000 7f8d4ffff640 1 -- 172.21.15.92:0/3757310302 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60010e60 con 0x55a8740b14f0 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3757310302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 msgr2=0x55a8740c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8d600123a0 tx=0x7f8d60015040 comp rx=0 tx=0).stop 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3757310302 shutdown_connections 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740b14f0 0x55a8740c9540 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740a2700 0x55a87409d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/3757310302 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a1de0 0x55a8740bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.611 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3757310302 >> 172.21.15.92:0/3757310302 conn(0x55a87409e410 msgr2=0x55a87409cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3757310302 shutdown_connections 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- 172.21.15.92:0/3757310302 wait complete. 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- start start 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 Processor -- start 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681ae200 con 0x55a8740a1de0 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681adb30 con 0x55a8740b14f0 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d681ac3e0 con 0x55a8740a2700 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6fa23740 10 client.0 _ll_register_callbacks cb 0x7f8d5c0b8ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:45842/0 (socket says 172.21.15.92:45842) 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d6659c640 1 -- 172.21.15.92:0/2185642401 learned_addr learned my addr 172.21.15.92:0/2185642401 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.602+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 -- 172.21.15.92:0/2185642401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 msgr2=0x55a8740b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 -- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 msgr2=0x55a8740b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 -- 172.21.15.92:0/2185642401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a874126e60 con 0x55a8740a1de0 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d66d9d640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6659c640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009900 tx=0x7f8d5c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c59590a4a98bb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:27.614 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c049070 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(161..161 src has 1..161) ==== 12539+0+0 (secure 0 0 0) 0x7f8d5c0ca110 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d60027070 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=310) ==== 24+0+0 (secure 0 0 0) 0x7f8d5c0d6020 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 10 client.16752 fetch_fsmap learned FSMap version 310 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=310,monmap=4+}) -- 0x55a874128150 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d60027070 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 310) ==== 4712+0+0 (secure 0 0 0) 0x7f8d5c0d8020 con 0x55a8740a1de0 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 10 client.16752 fetch_fsmap finished waiting for FSMap version 310 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 10 client.16752 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 20 client.16752 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:27.615 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8741286e0 0x55a87412aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 4 client.16752 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:17:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.603+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a87400fee0 con 0x55a8741286e0 2024-04-26T18:17:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.604+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8741286e0 0x55a87412aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.604+0000 7f8d4dffb640 10 client.16752 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:27.616 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:27.604+0000 7f8d65d9b640 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8741286e0 0x55a87412aaf0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62cc423794ef3821 server_cookie=939929f30abfdc2f in_seq=0 out_seq=0 2024-04-26T18:17:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: pgmap v616: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-26T18:17:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: daemon mds.j restarted 2024-04-26T18:17:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:boot 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:27 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: pgmap v616: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-26T18:17:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: daemon mds.j restarted 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:boot 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:27 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: pgmap v616: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: daemon mds.j restarted 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: osdmap e161: 12 total, 12 up, 12 in 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:boot 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:27 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:28 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:resolve 2024-04-26T18:17:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:28 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:28 smithi189 ceph-mon[32756]: pgmap v618: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-04-26T18:17:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:28 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:resolve 2024-04-26T18:17:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:28 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:28 smithi156 ceph-mon[32679]: pgmap v618: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-04-26T18:17:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:28 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:resolve 2024-04-26T18:17:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:28 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:28 smithi092 ceph-mon[29156]: pgmap v618: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 48 KiB/s wr, 30 op/s 2024-04-26T18:17:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d4dffb640 1 -- 172.21.15.92:0/2185642401 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a87400fee0 con 0x55a8741286e0 2024-04-26T18:17:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d4dffb640 10 client.16752 handle_command_reply: tid=0 2024-04-26T18:17:29.617 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 client.16752 shutdown 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 msgr2=0x55a8740b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009900 tx=0x7f8d5c02a420 comp rx=0 tx=0).stop 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 shutdown_connections 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x55a8741286e0 0x55a87412aaf0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8740b14f0 0x55a8740b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d4dffb640 0 client.16752 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55a8740a2700 0x55a8740b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 --2- 172.21.15.92:0/2185642401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a8740a1de0 0x55a8740b5080 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 >> 172.21.15.92:0/2185642401 conn(0x55a87409e410 msgr2=0x55a8740aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 shutdown_connections 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 1 -- 172.21.15.92:0/2185642401 wait complete. 2024-04-26T18:17:29.618 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.616+0000 7f8d6fa23740 20 client.16752 trim_cache size 0 max 16384 2024-04-26T18:17:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:17:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:17:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:17:29.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 msgr2=0x7f8d500a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 0x7f8d500a6280 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55a8740a3370 tx=0x7f8d60009a80 comp rx=0 tx=0).stop 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 msgr2=0x7f8d681990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c005940 tx=0x7f8d5c0040c0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 shutdown_connections 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f8d500a3dc0 0x7f8d500a6280 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d68108950 0x7f8d6819d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d68103300 0x7f8d681995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.620 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 --2- 172.21.15.92:0/3833986505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d68102940 0x7f8d681990b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 >> 172.21.15.92:0/3833986505 conn(0x7f8d68079dc0 msgr2=0x7f8d68100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 shutdown_connections 2024-04-26T18:17:29.621 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:29.617+0000 7f8d6cc2a640 1 -- 172.21.15.92:0/3833986505 wait complete. 2024-04-26T18:17:29.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:17:29.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:17:29.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:reconnect 2024-04-26T18:17:29.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0970fae700 time 2024-04-26T18:17:29.820562+0000 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f097b5d73dd] 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.854 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: clone() 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.820+0000 7f0970fae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0970fae700 time 2024-04-26T18:17:29.820562+0000 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:29.855 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f097b5d73dd] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.856 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: clone() 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: *** Caught signal (Aborted) ** 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: in thread 7f0970fae700 thread_name:ms_dispatch 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f097a35fd20] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: gsignal() 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: abort() 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f097b5d7437] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.857 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 16: clone() 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.822+0000 7f0970fae700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: in thread 7f0970fae700 thread_name:ms_dispatch 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.858 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f097a35fd20] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: gsignal() 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: abort() 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f097b5d7437] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.859 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 16: clone() 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: -1> 2024-04-26T18:17:29.820+0000 7f0970fae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0970fae700 time 2024-04-26T18:17:29.820562+0000 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.860 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f097b5d73dd] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: clone() 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 0> 2024-04-26T18:17:29.822+0000 7f0970fae700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:29.861 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: in thread 7f0970fae700 thread_name:ms_dispatch 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f097a35fd20] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: gsignal() 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: abort() 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f097b5d7437] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.862 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 16: clone() 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: -1> 2024-04-26T18:17:29.820+0000 7f0970fae700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f0970fae700 time 2024-04-26T18:17:29.820562+0000 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f097b5d73dd] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:29.863 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:29.864 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:29 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:17:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:29 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:17:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:29 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:reconnect 2024-04-26T18:17:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:29 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:29 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:17:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:29 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:17:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:29 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:reconnect 2024-04-26T18:17:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:29 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: clone() 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 0> 2024-04-26T18:17:29.822+0000 7f0970fae700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: in thread 7f0970fae700 thread_name:ms_dispatch 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f097a35fd20] 2024-04-26T18:17:30.203 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2: gsignal() 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 3: abort() 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f097b5d7437] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f097b5d75a3] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x560e96e42822] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x560e96db2598] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x560e96db4c17] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x560e96cadd0b] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x560e96cae2ac] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x560e96c96fad] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f097b86be20] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 13: (DispatchQueue::entry()+0x51f) [0x7f097b868fdf] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f097b93bfc1] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f097a3551ca] 2024-04-26T18:17:30.204 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 16: clone() 2024-04-26T18:17:30.205 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:30.205 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100435]: 2024-04-26T18:17:30.205 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:29 smithi092 podman[100720]: 2024-04-26 18:17:29.901140488 +0000 UTC m=+0.025684375 container died c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-26T18:17:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:rejoin 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: pgmap v619: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:active 2024-04-26T18:17:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:30 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:rejoin 2024-04-26T18:17:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:17:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: pgmap v619: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:active 2024-04-26T18:17:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:30 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:30.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:rejoin 2024-04-26T18:17:30.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:30.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:17:30.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: pgmap v619: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:30.940 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/4040733841,v1:172.21.15.92:6837/4040733841] up:active 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:30 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:30 smithi092 podman[100720]: 2024-04-26 18:17:30.507508066 +0000 UTC m=+0.632051946 container remove c5030a42383b9fdc005e1389007869d2d28c2403caa2bd406cbf0e13e692f1ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:30 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:30 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:17:30.941 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:30 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.106s CPU time. 2024-04-26T18:17:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:32 smithi092 ceph-mon[29156]: pgmap v620: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:32 smithi189 ceph-mon[32756]: pgmap v620: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:32 smithi156 ceph-mon[32679]: pgmap v620: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-04-26T18:17:33.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:17:33 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:17:33.523+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:17:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:34 smithi092 ceph-mon[29156]: pgmap v621: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T18:17:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:34 smithi189 ceph-mon[32756]: pgmap v621: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T18:17:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:34 smithi156 ceph-mon[32679]: pgmap v621: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-04-26T18:17:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:36 smithi092 ceph-mon[29156]: pgmap v622: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-04-26T18:17:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:36 smithi189 ceph-mon[32756]: pgmap v622: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-04-26T18:17:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:36 smithi156 ceph-mon[32679]: pgmap v622: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 733 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-04-26T18:17:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:38 smithi189 ceph-mon[32756]: pgmap v623: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-04-26T18:17:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:38 smithi156 ceph-mon[32679]: pgmap v623: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-04-26T18:17:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:38 smithi092 ceph-mon[29156]: pgmap v623: 97 pgs: 97 active+clean; 2.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-04-26T18:17:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:39 smithi189 ceph-mon[32756]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T18:17:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:39 smithi156 ceph-mon[32679]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T18:17:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:39 smithi092 ceph-mon[29156]: osdmap e162: 12 total, 12 up, 12 in 2024-04-26T18:17:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:40 smithi189 ceph-mon[32756]: pgmap v625: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-04-26T18:17:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:40 smithi156 ceph-mon[32679]: pgmap v625: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-04-26T18:17:41.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:40 smithi092 ceph-mon[29156]: pgmap v625: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 47 KiB/s wr, 16 op/s 2024-04-26T18:17:41.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:40 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:17:41.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:40 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:41.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:40 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.106s CPU time. 2024-04-26T18:17:41.227 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 systemd[1]: Starting Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:17:41.493 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 podman[100815]: 2024-04-26 18:17:41.130088903 +0000 UTC m=+0.018386908 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:17:41.493 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 podman[100815]: 2024-04-26 18:17:41.266038538 +0000 UTC m=+0.154336527 container create dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 podman[100815]: 2024-04-26 18:17:41.518529678 +0000 UTC m=+0.406827671 container init dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 podman[100815]: 2024-04-26 18:17:41.521221634 +0000 UTC m=+0.409519625 container start dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a) 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mds[100835]: -- 172.21.15.92:0/231063973 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558431da7a40 con 0x558431d7a800 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: starting mds.d at 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 bash[100815]: dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 2024-04-26T18:17:41.762 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:17:41 smithi092 systemd[1]: Started Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: daemon mds.d restarted 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:boot 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:41 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: daemon mds.d restarted 2024-04-26T18:17:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T18:17:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:boot 2024-04-26T18:17:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:41 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: daemon mds.d restarted 2024-04-26T18:17:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: osdmap e163: 12 total, 12 up, 12 in 2024-04-26T18:17:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:boot 2024-04-26T18:17:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: Standby daemon mds.j assigned to filesystem cephfs as rank 2 2024-04-26T18:17:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-26T18:17:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:41 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 -- 172.21.15.92:0/1598923905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c100e30 msgr2=0x7fa79c1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 --2- 172.21.15.92:0/1598923905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c100e30 0x7fa79c1012b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009930 tx=0x7fa78c02a420 comp rx=0 tx=0).stop 2024-04-26T18:17:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 -- 172.21.15.92:0/1598923905 shutdown_connections 2024-04-26T18:17:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 --2- 172.21.15.92:0/1598923905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c1017f0 0x7fa79c10f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 --2- 172.21.15.92:0/1598923905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c100e30 0x7fa79c1012b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 --2- 172.21.15.92:0/1598923905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c107910 0x7fa79c107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 -- 172.21.15.92:0/1598923905 >> 172.21.15.92:0/1598923905 conn(0x7fa79c077db0 msgr2=0x7fa79c0ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 -- 172.21.15.92:0/1598923905 shutdown_connections 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.712+0000 7fa7a371c640 1 -- 172.21.15.92:0/1598923905 wait complete. 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 Processor -- start 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 -- start start 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 0x7fa79c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c1017f0 0x7fa79c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112cd0 con 0x7fa79c107910 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112b50 con 0x7fa79c1017f0 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a371c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c112e50 con 0x7fa79c100e30 2024-04-26T18:17:42.716 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a1cb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a1cb9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39300/0 (socket says 172.21.15.92:39300) 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.713+0000 7fa7a1cb9640 1 -- 172.21.15.92:0/292164590 learned_addr learned my addr 172.21.15.92:0/292164590 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c1017f0 0x7fa79c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 0x7fa79c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 -- 172.21.15.92:0/292164590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 msgr2=0x7fa79c199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 0x7fa79c199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 -- 172.21.15.92:0/292164590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c1017f0 msgr2=0x7fa79c199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c1017f0 0x7fa79c199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 -- 172.21.15.92:0/292164590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c19e140 con 0x7fa79c107910 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 0x7fa79c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a1cb9640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa79400eaa0 tx=0x7fa79400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7927fc640 1 -- 172.21.15.92:0/292164590 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79400cdb0 con 0x7fa79c107910 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7927fc640 1 -- 172.21.15.92:0/292164590 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa794005020 con 0x7fa79c107910 2024-04-26T18:17:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c19e430 con 0x7fa79c107910 2024-04-26T18:17:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7927fc640 1 -- 172.21.15.92:0/292164590 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7940116d0 con 0x7fa79c107910 2024-04-26T18:17:42.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.714+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c1a5cc0 con 0x7fa79c107910 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.716+0000 7fa7927fc640 1 -- 172.21.15.92:0/292164590 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7fa7940051d0 con 0x7fa79c107910 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 Processor -- start 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 -- start start 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d16054d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597d155e460 con 0x5597d15f8820 2024-04-26T18:17:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5597d1518590 con 0x5597d16030e0 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a6430740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5597d155a420 con 0x5597d15f7f00 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7927fc640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 0x7fa7880a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39316/0 (socket says 172.21.15.92:39316) 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 -- 172.21.15.92:0/3161657556 learned_addr learned my addr 172.21.15.92:0/3161657556 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a1cb9640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 0x7fa7880a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d16054d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7927fc640 1 -- 172.21.15.92:0/292164590 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 12669+0+0 (secure 0 0 0) 0x7fa7940d1a60 con 0x7fa79c107910 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 -- 172.21.15.92:0/3161657556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 msgr2=0x5597d15f82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15f82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 -- 172.21.15.92:0/3161657556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 msgr2=0x5597d16054d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d16054d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a14b8640 1 -- 172.21.15.92:0/3161657556 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d15250d0 con 0x5597d15f8820 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.717+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d16054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.718+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa798009c50 tx=0x7fa79800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa81bfeeced5fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.718+0000 7fa7a1cb9640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 0x7fa7880a6300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa7940ce780 tx=0x7fa7940bd040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.718+0000 7fa7877fe640 1 -- 172.21.15.92:0/3161657556 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798016070 con 0x5597d15f8820 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.718+0000 7fa7877fe640 1 -- 172.21.15.92:0/3161657556 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7980054d0 con 0x5597d15f8820 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.718+0000 7fa7877fe640 1 -- 172.21.15.92:0/3161657556 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798011470 con 0x5597d15f8820 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- 172.21.15.92:0/3161657556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 msgr2=0x5597d1602ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa798009c50 tx=0x7fa79800e6c0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- 172.21.15.92:0/3161657556 shutdown_connections 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d16054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d1602ba0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3161657556 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15f82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- 172.21.15.92:0/3161657556 >> 172.21.15.92:0/3161657556 conn(0x5597d15f4410 msgr2=0x5597d15f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- 172.21.15.92:0/3161657556 shutdown_connections 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- 172.21.15.92:0/3161657556 wait complete. 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- start start 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 Processor -- start 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d1600a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5597d1605d10 con 0x5597d15f8820 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5597d14e5b60 con 0x5597d16030e0 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.719+0000 7fa7a6430740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5597d1605e90 con 0x5597d15f7f00 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a6430740 10 client.0 _ll_register_callbacks cb 0x5597d150a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39324/0 (socket says 172.21.15.92:39324) 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 -- 172.21.15.92:0/1585077827 learned_addr learned my addr 172.21.15.92:0/1585077827 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 -- 172.21.15.92:0/1585077827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 msgr2=0x5597d15fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 -- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 msgr2=0x5597d1600a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d1600a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 -- 172.21.15.92:0/1585077827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d1270210 con 0x5597d15f8820 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa798005480 tx=0x7fa7980058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112bc45edc23b3ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa784ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798016040 con 0x5597d15f8820 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7980054d0 con 0x5597d15f8820 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 12669+0+0 (secure 0 0 0) 0x7fa798005680 con 0x5597d15f8820 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=315) ==== 24+0+0 (secure 0 0 0) 0x7fa798009760 con 0x5597d15f8820 2024-04-26T18:17:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a6430740 10 client.16770 fetch_fsmap learned FSMap version 315 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=315,monmap=4+}) -- 0x5597d133c620 con 0x5597d15f8820 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.720+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7980054d0 con 0x5597d15f8820 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 315) ==== 4712+0+0 (secure 0 0 0) 0x7fa79800f040 con 0x5597d15f8820 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 10 client.16770 fetch_fsmap finished waiting for FSMap version 315 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 10 client.16770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 20 client.16770 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d1613530 0x5597d1615990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 4 client.16770 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597d156c070 con 0x5597d1613530 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d1613530 0x5597d1615990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa784ff9640 10 client.16770 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.721+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d1613530 0x5597d1615990 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90b02f19fb37af4 server_cookie=c197b72f189b57a7 in_seq=0 out_seq=0 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa784ff9640 1 -- 172.21.15.92:0/1585077827 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5597d156c070 con 0x5597d1613530 2024-04-26T18:17:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa784ff9640 10 client.16770 handle_command_reply: tid=0 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 client.16770 shutdown 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 msgr2=0x5597d16004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa798005480 tx=0x7fa7980058f0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 shutdown_connections 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d1613530 0x5597d1615990 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d16030e0 0x5597d1600a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d16004e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa784ff9640 0 client.16770 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 --2- 172.21.15.92:0/1585077827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d15fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 >> 172.21.15.92:0/1585077827 conn(0x5597d15f4410 msgr2=0x5597d15fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 shutdown_connections 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 1 -- 172.21.15.92:0/1585077827 wait complete. 2024-04-26T18:17:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.722+0000 7fa7a6430740 20 client.16770 trim_cache size 0 max 16384 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 Processor -- start 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 -- start start 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d161b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 0x5597d161b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1b1400 con 0x5597d16030e0 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1af8c0 con 0x5597d15f8820 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a6430740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1b0d30 con 0x5597d15f7f00 2024-04-26T18:17:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a0cb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a0cb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39332/0 (socket says 172.21.15.92:39332) 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.737+0000 7fa7a0cb7640 1 -- 172.21.15.92:0/3427520550 learned_addr learned my addr 172.21.15.92:0/3427520550 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 0x5597d161b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 -- 172.21.15.92:0/3427520550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 msgr2=0x5597d161b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d161b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 -- 172.21.15.92:0/3427520550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 msgr2=0x5597d161b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 0x5597d161b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 -- 172.21.15.92:0/3427520550 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d15f8650 con 0x5597d16030e0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 0x5597d161b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa78c031440 tx=0x7fa78c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93681d9d63428ac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa786ffd640 1 -- 172.21.15.92:0/3427520550 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c04d020 con 0x5597d16030e0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa786ffd640 1 -- 172.21.15.92:0/3427520550 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c032940 con 0x5597d16030e0 2024-04-26T18:17:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.738+0000 7fa786ffd640 1 -- 172.21.15.92:0/3427520550 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c035040 con 0x5597d16030e0 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- 172.21.15.92:0/3427520550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 msgr2=0x5597d15f98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa78c031440 tx=0x7fa78c005dd0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- 172.21.15.92:0/3427520550 shutdown_connections 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d16030e0 0x5597d15f98b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f8820 0x5597d161b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- 172.21.15.92:0/3427520550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d15f7f00 0x5597d161b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- 172.21.15.92:0/3427520550 >> 172.21.15.92:0/3427520550 conn(0x5597d15f4410 msgr2=0x5597d15f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- 172.21.15.92:0/3427520550 shutdown_connections 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- 172.21.15.92:0/3427520550 wait complete. 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- start start 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 Processor -- start 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f7f00 0x5597d15fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 0x5597d15fd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1b0660 con 0x5597d15f8820 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1aff90 con 0x5597d15f7f00 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.739+0000 7fa7a6430740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c1ae800 con 0x5597d16030e0 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a6430740 10 client.0 _ll_register_callbacks cb 0x7fa78c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39342/0 (socket says 172.21.15.92:39342) 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 -- 172.21.15.92:0/432049990 learned_addr learned my addr 172.21.15.92:0/432049990 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f7f00 0x5597d15fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 0x5597d15fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 -- 172.21.15.92:0/432049990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 msgr2=0x5597d15fd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 0x5597d15fd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 -- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f7f00 msgr2=0x5597d15fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f7f00 0x5597d15fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 -- 172.21.15.92:0/432049990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d1678b10 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 0x5597d15fd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a14b8640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa798001eb0 tx=0x7fa79800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d69d3d2a7fd9a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa784ff9640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798016070 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa78c032940 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 12669+0+0 (secure 0 0 0) 0x7fa7980054b0 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=315) ==== 24+0+0 (secure 0 0 0) 0x7fa79803d050 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a6430740 10 client.16776 fetch_fsmap learned FSMap version 315 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=315,monmap=4+}) -- 0x5597d1679d30 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.740+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c032940 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 315) ==== 4712+0+0 (secure 0 0 0) 0x7fa7980366f0 con 0x5597d15f8820 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 10 client.16776 fetch_fsmap finished waiting for FSMap version 315 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 10 client.16776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 20 client.16776 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d167a480 0x5597d167c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 4 client.16776 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597d1565ee0 con 0x5597d167a480 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d167a480 0x5597d167c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa784ff9640 10 client.16776 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:42.741+0000 7fa7a0cb7640 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d167a480 0x5597d167c8a0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a1e5996f4a93bf server_cookie=9124d0cb4b7eddc0 in_seq=0 out_seq=0 2024-04-26T18:17:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:42 smithi189 ceph-mon[32756]: pgmap v627: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-26T18:17:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:42 smithi156 ceph-mon[32679]: pgmap v627: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-26T18:17:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:42 smithi092 ceph-mon[29156]: pgmap v627: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-04-26T18:17:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:resolve 2024-04-26T18:17:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:43 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:resolve 2024-04-26T18:17:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:43 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:resolve 2024-04-26T18:17:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:43 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa784ff9640 1 -- 172.21.15.92:0/432049990 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597d1565ee0 con 0x5597d167a480 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa784ff9640 10 client.16776 handle_command_reply: tid=0 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 client.16776 shutdown 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 msgr2=0x5597d15fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa798001eb0 tx=0x7fa79800ebc0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 shutdown_connections 2024-04-26T18:17:44.796 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5597d167a480 0x5597d167c8a0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5597d16030e0 0x5597d15fd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5597d15f8820 0x5597d15fd130 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 --2- 172.21.15.92:0/432049990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5597d15f7f00 0x5597d15fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa784ff9640 0 client.16776 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 >> 172.21.15.92:0/432049990 conn(0x5597d15f4410 msgr2=0x5597d15f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 shutdown_connections 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.796+0000 7fa7a6430740 1 -- 172.21.15.92:0/432049990 wait complete. 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a6430740 20 client.16776 trim_cache size 0 max 16384 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:17:44.797 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:17:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 msgr2=0x7fa7880a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 0x7fa7880a6300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa7940ce780 tx=0x7fa7940bd040 comp rx=0 tx=0).stop 2024-04-26T18:17:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 msgr2=0x7fa79c19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa79400eaa0 tx=0x7fa79400ef60 comp rx=0 tx=0).stop 2024-04-26T18:17:44.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 shutdown_connections 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7fa7880a3e40 0x7fa7880a6300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa79c107910 0x7fa79c19da10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa79c1017f0 0x7fa79c199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 --2- 172.21.15.92:0/292164590 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa79c100e30 0x7fa79c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 >> 172.21.15.92:0/292164590 conn(0x7fa79c077db0 msgr2=0x7fa79c105a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 shutdown_connections 2024-04-26T18:17:44.799 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:44.797+0000 7fa7a371c640 1 -- 172.21.15.92:0/292164590 wait complete. 2024-04-26T18:17:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:44 smithi189 ceph-mon[32756]: pgmap v628: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-04-26T18:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:44 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:44 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:44 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:reconnect 2024-04-26T18:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:44 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:44 smithi156 ceph-mon[32679]: pgmap v628: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-04-26T18:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:44 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:44 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:44 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:reconnect 2024-04-26T18:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:44 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-mon[29156]: pgmap v628: 97 pgs: 9 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 84 active+clean; 1.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-04-26T18:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999971 2024-04-26T18:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999971 2024-04-26T18:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:reconnect 2024-04-26T18:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:45.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f479d1fb700 time 2024-04-26T18:17:44.824060+0000 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47a78243dd] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: clone() 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:44.825+0000 7f479d1fb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f479d1fb700 time 2024-04-26T18:17:44.824060+0000 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47a78243dd] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: clone() 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: *** Caught signal (Aborted) ** 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: in thread 7f479d1fb700 thread_name:ms_dispatch 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47a65acd20] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: gsignal() 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: abort() 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f47a7824437] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 16: clone() 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:44.826+0000 7f479d1fb700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: in thread 7f479d1fb700 thread_name:ms_dispatch 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47a65acd20] 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: gsignal() 2024-04-26T18:17:45.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: abort() 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f47a7824437] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 16: clone() 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: -1> 2024-04-26T18:17:44.825+0000 7f479d1fb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f479d1fb700 time 2024-04-26T18:17:44.824060+0000 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47a78243dd] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: clone() 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 0> 2024-04-26T18:17:44.826+0000 7f479d1fb700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: in thread 7f479d1fb700 thread_name:ms_dispatch 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47a65acd20] 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: gsignal() 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: abort() 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f47a7824437] 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 16: clone() 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: -1> 2024-04-26T18:17:44.825+0000 7f479d1fb700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7f479d1fb700 time 2024-04-26T18:17:44.824060+0000 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f47a78243dd] 2024-04-26T18:17:45.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: clone() 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 0> 2024-04-26T18:17:44.826+0000 7f479d1fb700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:17:45.257 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: in thread 7f479d1fb700 thread_name:ms_dispatch 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f47a65acd20] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2: gsignal() 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 3: abort() 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f47a7824437] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7f47a78245a3] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x562efb104822] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x562efb074598] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x562efb076c17] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x562efaf6fd0b] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x562efaf702ac] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x562efaf58fad] 2024-04-26T18:17:45.258 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7f47a7ab8e20] 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 13: (DispatchQueue::entry()+0x51f) [0x7f47a7ab5fdf] 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7f47a7b88fc1] 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7f47a65a21ca] 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 16: clone() 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[100635]: 2024-04-26T18:17:45.259 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:44 smithi092 podman[100916]: 2024-04-26 18:17:44.888116946 +0000 UTC m=+0.023177242 container died 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-26T18:17:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:rejoin 2024-04-26T18:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:active 2024-04-26T18:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:45 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:rejoin 2024-04-26T18:17:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:active 2024-04-26T18:17:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:45 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:rejoin 2024-04-26T18:17:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:17:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:17:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1588444605,v1:172.21.15.92:6835/1588444605] up:active 2024-04-26T18:17:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:45 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 3 up:standby-replay 2024-04-26T18:17:46.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:45 smithi092 podman[100916]: 2024-04-26 18:17:45.767110973 +0000 UTC m=+0.902171267 container remove 716efd6ba6d8779e0c9d330af9267bf3e6a3cccc25e0eed99699163f84c9655c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-26T18:17:46.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:45 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:17:46.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:46 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:17:46.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:46 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.091s CPU time. 2024-04-26T18:17:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:46 smithi189 ceph-mon[32756]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-04-26T18:17:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:46 smithi156 ceph-mon[32679]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-04-26T18:17:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:46 smithi092 ceph-mon[29156]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-04-26T18:17:48.806 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:17:48 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:17:48.524+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:17:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:48 smithi189 ceph-mon[32756]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-26T18:17:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:48 smithi156 ceph-mon[32679]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-26T18:17:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:48 smithi092 ceph-mon[29156]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-04-26T18:17:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:50 smithi189 ceph-mon[32756]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:50 smithi189 ceph-mon[32756]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T18:17:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:50 smithi156 ceph-mon[32679]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:50 smithi156 ceph-mon[32679]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T18:17:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:50 smithi092 ceph-mon[29156]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:50 smithi092 ceph-mon[29156]: osdmap e164: 12 total, 12 up, 12 in 2024-04-26T18:17:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:52 smithi189 ceph-mon[32756]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:52 smithi156 ceph-mon[32679]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:52 smithi092 ceph-mon[29156]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-04-26T18:17:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:54 smithi189 ceph-mon[32756]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:54 smithi156 ceph-mon[32679]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:54 smithi092 ceph-mon[29156]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-04-26T18:17:56.525 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 5. 2024-04-26T18:17:56.526 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:56.526 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.091s CPU time. 2024-04-26T18:17:56.526 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 systemd[1]: Starting Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968... 2024-04-26T18:17:56.526 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 podman[101012]: 2024-04-26 18:17:56.381112972 +0000 UTC m=+0.018320203 image pull 3a6bde214c5b0b19fc991f4bf5457f79505becbb4a5f8542663f01cefd0dd555 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc 2024-04-26T18:17:56.526 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 podman[101012]: 2024-04-26 18:17:56.525948214 +0000 UTC m=+0.163155430 container create b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5) 2024-04-26T18:17:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:56 smithi189 ceph-mon[32756]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-04-26T18:17:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:56 smithi189 ceph-mon[32756]: daemon mds.j restarted 2024-04-26T18:17:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:56 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:56 smithi156 ceph-mon[32679]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-04-26T18:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:56 smithi156 ceph-mon[32679]: daemon mds.j restarted 2024-04-26T18:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:56 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:56 smithi092 ceph-mon[29156]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 18 KiB/s wr, 12 op/s 2024-04-26T18:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:56 smithi092 ceph-mon[29156]: daemon mds.j restarted 2024-04-26T18:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:56 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 podman[101012]: 2024-04-26 18:17:56.778927117 +0000 UTC m=+0.416134334 container init b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 podman[101012]: 2024-04-26 18:17:56.781589741 +0000 UTC m=+0.418796968 container start b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 ceph-mds[101031]: -- 172.21.15.92:0/317612043 <== mon.0 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555bbf1fda40 con 0x555bbf1d0800 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: starting mds.j at 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 bash[101012]: b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 2024-04-26T18:17:57.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:17:56 smithi092 systemd[1]: Started Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- 172.21.15.92:0/160911397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24102940 msgr2=0x7f1c24102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 --2- 172.21.15.92:0/160911397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24102940 0x7f1c24102dc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009930 tx=0x7f1c1802a420 comp rx=0 tx=0).stop 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- 172.21.15.92:0/160911397 shutdown_connections 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 --2- 172.21.15.92:0/160911397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24103300 0x7f1c2410f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 --2- 172.21.15.92:0/160911397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24102940 0x7f1c24102dc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 --2- 172.21.15.92:0/160911397 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24108950 0x7f1c24108d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- 172.21.15.92:0/160911397 >> 172.21.15.92:0/160911397 conn(0x7f1c24079dc0 msgr2=0x7f1c2407a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- 172.21.15.92:0/160911397 shutdown_connections 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- 172.21.15.92:0/160911397 wait complete. 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 Processor -- start 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.899+0000 7f1c29e45640 1 -- start start 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24102940 0x7f1c241990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 0x7f1c2419d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24112c10 con 0x7f1c24103300 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24112a90 con 0x7f1c24108950 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c29e45640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24112d90 con 0x7f1c24102940 2024-04-26T18:17:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46320/0 (socket says 172.21.15.92:46320) 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 -- 172.21.15.92:0/4271519976 learned_addr learned my addr 172.21.15.92:0/4271519976 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c23fff640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 0x7f1c2419d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c237fe640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24102940 0x7f1c241990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 -- 172.21.15.92:0/4271519976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24102940 msgr2=0x7f1c241990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24102940 0x7f1c241990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 -- 172.21.15.92:0/4271519976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 msgr2=0x7f1c2419d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 0x7f1c2419d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 -- 172.21.15.92:0/4271519976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2419e0c0 con 0x7f1c24103300 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c23fff640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 0x7f1c2419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005940 tx=0x7f1c180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c20ff9640 1 -- 172.21.15.92:0/4271519976 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1803f030 con 0x7f1c24103300 2024-04-26T18:17:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.900+0000 7f1c20ff9640 1 -- 172.21.15.92:0/4271519976 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c18003cb0 con 0x7f1c24103300 2024-04-26T18:17:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.901+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2419e350 con 0x7f1c24103300 2024-04-26T18:17:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.901+0000 7f1c20ff9640 1 -- 172.21.15.92:0/4271519976 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18035070 con 0x7f1c24103300 2024-04-26T18:17:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.901+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241a5c40 con 0x7f1c24103300 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c20ff9640 1 -- 172.21.15.92:0/4271519976 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1c18042030 con 0x7f1c24103300 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 Processor -- start 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 -- start start 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464db00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464db014f0 0x56464db038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56464da58460 con 0x56464daf1e00 2024-04-26T18:17:57.915 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56464da12590 con 0x56464daf2720 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56464da54420 con 0x56464db014f0 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c20ff9640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 0x7f1c0c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46322/0 (socket says 172.21.15.92:46322) 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c23fff640 1 -- 172.21.15.92:0/3556240104 learned_addr learned my addr 172.21.15.92:0/3556240104 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.903+0000 7f1c237fe640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464db00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464db014f0 0x56464db038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c23fff640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 0x7f1c0c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c20ff9640 1 -- 172.21.15.92:0/4271519976 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f1c180f2060 con 0x7f1c24103300 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 -- 172.21.15.92:0/3556240104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464db014f0 msgr2=0x56464db038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464db014f0 0x56464db038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 -- 172.21.15.92:0/3556240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 msgr2=0x56464daf21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.916 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 -- 172.21.15.92:0/3556240104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464da1f0d0 con 0x56464daf2720 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c23fff640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c237fe640 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464db00fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c140058c0 tx=0x7f1c1400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838af15f9faff694 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c23fff640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 0x7f1c0c0a6280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00fe80 tx=0x7f1c1c004ab0 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c09ffb640 1 -- 172.21.15.92:0/3556240104 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14010430 con 0x56464daf2720 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c09ffb640 1 -- 172.21.15.92:0/3556240104 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c14010a80 con 0x56464daf2720 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.904+0000 7f1c09ffb640 1 -- 172.21.15.92:0/3556240104 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1401aa70 con 0x56464daf2720 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- 172.21.15.92:0/3556240104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 msgr2=0x56464db00fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464db00fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c140058c0 tx=0x7f1c1400cf30 comp rx=0 tx=0).stop 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- 172.21.15.92:0/3556240104 shutdown_connections 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464db014f0 0x56464db038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464db00fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/3556240104 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464daf21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- 172.21.15.92:0/3556240104 >> 172.21.15.92:0/3556240104 conn(0x56464daee410 msgr2=0x56464daee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:57.917 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- 172.21.15.92:0/3556240104 shutdown_connections 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- 172.21.15.92:0/3556240104 wait complete. 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 -- start start 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.905+0000 7f1c2cc37740 1 Processor -- start 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf2720 0x56464dafe990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464dafeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56464db04120 con 0x56464daf1e00 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56464d9dfb60 con 0x56464db014f0 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56464db042a0 con 0x56464daf2720 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 10 client.0 _ll_register_callbacks cb 0x56464da042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46328/0 (socket says 172.21.15.92:46328) 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 -- 172.21.15.92:0/1113587549 learned_addr learned my addr 172.21.15.92:0/1113587549 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c23fff640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464dafeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf2720 0x56464dafe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 -- 172.21.15.92:0/1113587549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf2720 msgr2=0x56464dafe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf2720 0x56464dafe990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 -- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 msgr2=0x56464dafeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464dafeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 -- 172.21.15.92:0/1113587549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464d76a210 con 0x56464daf1e00 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c237fe640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1c14011e70 tx=0x7f1c14011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3a5379ff965032 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402a060 con 0x56464daf1e00 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c14010a80 con 0x56464daf1e00 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.906+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f1c14010430 con 0x56464daf1e00 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7f1c14010630 con 0x56464daf1e00 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 10 client.16794 fetch_fsmap learned FSMap version 322 2024-04-26T18:17:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=322,monmap=4+}) -- 0x56464d836620 con 0x56464daf1e00 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c14010a80 con 0x56464daf1e00 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 322) ==== 4712+0+0 (secure 0 0 0) 0x7f1c1401a9b0 con 0x56464daf1e00 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 10 client.16794 fetch_fsmap finished waiting for FSMap version 322 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 20 client.16794 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db11940 0x56464db13d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 4 client.16794 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56464da66070 con 0x56464db11940 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db11940 0x56464db13d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c02ffd640 10 client.16794 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.907+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db11940 0x56464db13d70 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0c7cee298c4305 server_cookie=1624f6b450ee060b in_seq=0 out_seq=0 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.908+0000 7f1c02ffd640 1 -- 172.21.15.92:0/1113587549 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56464da66070 con 0x56464db11940 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c02ffd640 10 client.16794 handle_command_reply: tid=0 2024-04-26T18:17:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 client.16794 shutdown 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 msgr2=0x56464dafe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f1c14011e70 tx=0x7f1c14011ea0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 shutdown_connections 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db11940 0x56464db13d70 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464dafeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf2720 0x56464dafe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/1113587549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf1e00 0x56464dafe450 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c02ffd640 0 client.16794 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 >> 172.21.15.92:0/1113587549 conn(0x56464daee410 msgr2=0x56464daf4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 shutdown_connections 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 1 -- 172.21.15.92:0/1113587549 wait complete. 2024-04-26T18:17:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.909+0000 7f1c2cc37740 20 client.16794 trim_cache size 0 max 16384 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 Processor -- start 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 -- start start 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db0cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464daf41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241af140 con 0x56464db014f0 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241ad600 con 0x56464daf2720 2024-04-26T18:17:57.929 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241aea70 con 0x56464daf1e00 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46330/0 (socket says 172.21.15.92:46330) 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c23fff640 1 -- 172.21.15.92:0/2000709939 learned_addr learned my addr 172.21.15.92:0/2000709939 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464daf41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.924+0000 7f1c237fe640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db0cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 -- 172.21.15.92:0/2000709939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 msgr2=0x56464db0cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db0cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 -- 172.21.15.92:0/2000709939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 msgr2=0x56464daf41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464daf41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 -- 172.21.15.92:0/2000709939 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464dafd400 con 0x56464db014f0 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464daf41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c23fff640 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c012240 tx=0x7f1c1c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a03cf8d38878a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.930 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c097fa640 1 -- 172.21.15.92:0/2000709939 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c004b20 con 0x56464db014f0 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c097fa640 1 -- 172.21.15.92:0/2000709939 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c004cc0 con 0x56464db014f0 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c097fa640 1 -- 172.21.15.92:0/2000709939 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0059d0 con 0x56464db014f0 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.925+0000 7f1c2cc37740 1 -- 172.21.15.92:0/2000709939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 msgr2=0x56464db19680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c012240 tx=0x7f1c1c00f3c0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- 172.21.15.92:0/2000709939 shutdown_connections 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464db014f0 0x56464db19680 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464daf2720 0x56464daf41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/2000709939 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db0cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- 172.21.15.92:0/2000709939 >> 172.21.15.92:0/2000709939 conn(0x56464daee410 msgr2=0x56464daee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- 172.21.15.92:0/2000709939 shutdown_connections 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- 172.21.15.92:0/2000709939 wait complete. 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- start start 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 Processor -- start 2024-04-26T18:17:57.931 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db09810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464db05110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241ae3a0 con 0x56464daf2720 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241adcd0 con 0x56464db014f0 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241ac560 con 0x56464daf1e00 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c2cc37740 10 client.0 _ll_register_callbacks cb 0x7f1c14014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c22ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46344/0 (socket says 172.21.15.92:46344) 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.926+0000 7f1c22ffd640 1 -- 172.21.15.92:0/718824924 learned_addr learned my addr 172.21.15.92:0/718824924 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c237fe640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db09810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c23fff640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464db05110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 -- 172.21.15.92:0/718824924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 msgr2=0x56464db09810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db09810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.932 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 -- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 msgr2=0x56464db05110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464db05110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 -- 172.21.15.92:0/718824924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464db05910 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c22ffd640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000c00 tx=0x7f1c1804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f2417dcf8dd45e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18049040 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f1c1803bb20 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c1c004cc0 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7f1c180bcfa0 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 10 client.16800 fetch_fsmap learned FSMap version 322 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=322,monmap=4+}) -- 0x56464db77ed0 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c004cc0 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 322) ==== 4712+0+0 (secure 0 0 0) 0x7f1c180b9610 con 0x56464daf2720 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 10 client.16800 fetch_fsmap finished waiting for FSMap version 322 2024-04-26T18:17:57.933 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 10 client.16800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.927+0000 7f1c2cc37740 20 client.16800 populate_metadata read hostname 'smithi092' 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db78650 0x56464db7aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c2cc37740 4 client.16800 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56464da5fee0 con 0x56464db78650 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c237fe640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db78650 0x56464db7aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c237fe640 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db78650 0x56464db7aa70 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3ba5aedb083736 server_cookie=27353b3392af22e7 in_seq=0 out_seq=0 2024-04-26T18:17:57.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:57.928+0000 7f1c02ffd640 10 client.16800 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T18:17:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:boot 2024-04-26T18:17:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:57 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:boot 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:57 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: osdmap e165: 12 total, 12 up, 12 in 2024-04-26T18:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:boot 2024-04-26T18:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: Standby daemon mds.d assigned to filesystem cephfs as rank 2 2024-04-26T18:17:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: fsmap cephfs:2/3 {0=b=up:active,1=a=up:active} 3 up:standby-replay 1 up:standby, 1 failed 2024-04-26T18:17:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-26T18:17:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:57 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:replay} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:58 smithi189 ceph-mon[32756]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:17:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:58 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:resolve 2024-04-26T18:17:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:58 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:58 smithi156 ceph-mon[32679]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:17:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:58 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:resolve 2024-04-26T18:17:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:58 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:58 smithi092 ceph-mon[29156]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:58 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:resolve 2024-04-26T18:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:58 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:resolve} 2 up:standby-replay 1 up:standby 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.844+0000 7f1c02ffd640 1 -- 172.21.15.92:0/718824924 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56464da5fee0 con 0x56464db78650 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.844+0000 7f1c02ffd640 10 client.16800 handle_command_reply: tid=0 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.844+0000 7f1c2cc37740 1 client.16800 shutdown 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 msgr2=0x56464db04bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1c18000c00 tx=0x7f1c1804cf90 comp rx=0 tx=0).stop 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 shutdown_connections 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56464db78650 0x56464db7aa70 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56464db014f0 0x56464db05110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56464daf2720 0x56464db04bd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c02ffd640 0 client.16800 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 --2- 172.21.15.92:0/718824924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56464daf1e00 0x56464db09810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 >> 172.21.15.92:0/718824924 conn(0x56464daee410 msgr2=0x56464dafec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 shutdown_connections 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 1 -- 172.21.15.92:0/718824924 wait complete. 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.845+0000 7f1c2cc37740 20 client.16800 trim_cache size 0 max 16384 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:17:59.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:17:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 msgr2=0x7f1c0c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 0x7f1c0c0a6280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00fe80 tx=0x7f1c1c004ab0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 msgr2=0x7f1c24199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:17:59.848 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1c18005940 tx=0x7f1c180042f0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 shutdown_connections 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c0c0a3dc0 0x7f1c0c0a6280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c24108950 0x7f1c2419d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c24103300 0x7f1c24199610 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 --2- 172.21.15.92:0/4271519976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c24102940 0x7f1c241990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 >> 172.21.15.92:0/4271519976 conn(0x7f1c24079dc0 msgr2=0x7f1c241002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 shutdown_connections 2024-04-26T18:17:59.849 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:17:59.846+0000 7f1c29e45640 1 -- 172.21.15.92:0/4271519976 wait complete. 2024-04-26T18:18:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:59 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:59 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:59 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:reconnect 2024-04-26T18:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:17:59 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:59 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:59 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:59 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:reconnect 2024-04-26T18:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:17:59 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:59 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:59 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:59 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:reconnect 2024-04-26T18:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:17:59 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:reconnect} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:00 smithi189 ceph-mon[32756]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:00 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:rejoin 2024-04-26T18:18:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:00 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:00 smithi189 ceph-mon[32756]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:18:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:00 smithi156 ceph-mon[32679]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:00 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:rejoin 2024-04-26T18:18:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:00 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:00 smithi156 ceph-mon[32679]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:18:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-mon[29156]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:rejoin 2024-04-26T18:18:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=d=up:rejoin} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-mon[29156]: daemon mds.d is now active in filesystem cephfs as rank 2 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fcbe4ee0700 time 2024-04-26T18:18:00.863131+0000 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fcbef5093dd] 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: clone() 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:00.863+0000 7fcbe4ee0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fcbe4ee0700 time 2024-04-26T18:18:00.863131+0000 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.245 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fcbef5093dd] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.246 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: clone() 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: *** Caught signal (Aborted) ** 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: in thread 7fcbe4ee0700 thread_name:ms_dispatch 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fcbee291d20] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: gsignal() 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: abort() 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fcbef509437] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.247 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.248 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.248 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 16: clone() 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:00.865+0000 7fcbe4ee0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: in thread 7fcbe4ee0700 thread_name:ms_dispatch 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fcbee291d20] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: gsignal() 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: abort() 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fcbef509437] 2024-04-26T18:18:01.249 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 16: clone() 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:01.250 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: -1> 2024-04-26T18:18:00.863+0000 7fcbe4ee0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fcbe4ee0700 time 2024-04-26T18:18:00.863131+0000 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fcbef5093dd] 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.251 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: clone() 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 0> 2024-04-26T18:18:00.865+0000 7fcbe4ee0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: in thread 7fcbe4ee0700 thread_name:ms_dispatch 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fcbee291d20] 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: gsignal() 2024-04-26T18:18:01.252 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: abort() 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fcbef509437] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 16: clone() 2024-04-26T18:18:01.253 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: -1> 2024-04-26T18:18:00.863+0000 7fcbe4ee0700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fcbe4ee0700 time 2024-04-26T18:18:00.863131+0000 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fcbef5093dd] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.254 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: clone() 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 0> 2024-04-26T18:18:00.865+0000 7fcbe4ee0700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: in thread 7fcbe4ee0700 thread_name:ms_dispatch 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fcbee291d20] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2: gsignal() 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 3: abort() 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fcbef509437] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fcbef5095a3] 2024-04-26T18:18:01.255 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x55842f763822] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x55842f6d3598] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x55842f6d5c17] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x55842f5ced0b] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x55842f5cf2ac] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x55842f5b7fad] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fcbef79de20] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 13: (DispatchQueue::entry()+0x51f) [0x7fcbef79afdf] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fcbef86dfc1] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fcbee2871ca] 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 16: clone() 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d[100831]: 2024-04-26T18:18:01.256 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:00 smithi092 podman[101112]: 2024-04-26 18:18:00.945259175 +0000 UTC m=+0.023286718 container died dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-26T18:18:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:01 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:01 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:active 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:01 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:01 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:01 smithi092 podman[101112]: 2024-04-26 18:18:01.626020124 +0000 UTC m=+0.704047721 container remove dbeacf1e322b5c1c6b63c71037c1ecf0d2ac51e4a21a5f86ee860596264d0d69 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-d, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, GIT_CLEAN=True) 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:01 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:01 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:18:01.994 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:01 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.093s CPU time. 2024-04-26T18:18:02.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:01 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:02.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:01 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:active 2024-04-26T18:18:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:01 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:01 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:18:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:02.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:01 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:02.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:01 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6836/499714136,v1:172.21.15.92:6837/499714136] up:active 2024-04-26T18:18:02.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:01 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 2 up:standby-replay 1 up:standby 2024-04-26T18:18:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:01 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=d=up:active} 3 up:standby-replay 2024-04-26T18:18:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:18:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:18:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T18:18:03.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T18:18:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:18:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-04-26T18:18:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:18:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:18:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 9 op/s 2024-04-26T18:18:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 21 KiB/s wr, 8 op/s 2024-04-26T18:18:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:18:03.933 INFO:journalctl@ceph.mds.b.smithi156.stdout:Apr 26 18:18:03 smithi156 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-b[63071]: 2024-04-26T18:18:03.525+0000 7f72f2f03700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-26T18:18:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:05 smithi189 ceph-mon[32756]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-04-26T18:18:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:05 smithi156 ceph-mon[32679]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-04-26T18:18:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:05 smithi092 ceph-mon[29156]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 43 KiB/s wr, 22 op/s 2024-04-26T18:18:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:07 smithi092 ceph-mon[29156]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-04-26T18:18:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:07 smithi189 ceph-mon[32756]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-04-26T18:18:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:07 smithi156 ceph-mon[32679]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 38 KiB/s wr, 20 op/s 2024-04-26T18:18:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:09 smithi189 ceph-mon[32756]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-26T18:18:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:09 smithi156 ceph-mon[32679]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-26T18:18:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:09 smithi092 ceph-mon[29156]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-04-26T18:18:11.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:11 smithi092 ceph-mon[29156]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-26T18:18:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:11 smithi189 ceph-mon[32756]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-26T18:18:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:11 smithi156 ceph-mon[32679]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-04-26T18:18:12.243 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:18:12.243 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: Stopped Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:18:12.243 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Consumed 1.093s CPU time. 2024-04-26T18:18:12.243 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Start request repeated too quickly. 2024-04-26T18:18:12.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.d.service: Failed with result 'exit-code'. 2024-04-26T18:18:12.244 INFO:journalctl@ceph.mds.d.smithi092.stdout:Apr 26 18:18:11 smithi092 systemd[1]: Failed to start Ceph mds.d for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- 172.21.15.92:0/4189508868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 msgr2=0x7f2cc4103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 --2- 172.21.15.92:0/4189508868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc4103fa0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009ca0 tx=0x7f2cb402a950 comp rx=0 tx=0).stop 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- 172.21.15.92:0/4189508868 shutdown_connections 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 --2- 172.21.15.92:0/4189508868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 0x7f2cc410f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 --2- 172.21.15.92:0/4189508868 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 0x7f2cc410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 --2- 172.21.15.92:0/4189508868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc4103fa0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- 172.21.15.92:0/4189508868 >> 172.21.15.92:0/4189508868 conn(0x7f2cc4078950 msgr2=0x7f2cc4078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- 172.21.15.92:0/4189508868 shutdown_connections 2024-04-26T18:18:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- 172.21.15.92:0/4189508868 wait complete. 2024-04-26T18:18:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 Processor -- start 2024-04-26T18:18:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.942+0000 7f2cc9647640 1 -- start start 2024-04-26T18:18:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 0x7f2cc41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 0x7f2cc419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4112bd0 con 0x7f2cc4103bc0 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4112a50 con 0x7f2cc410cf90 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc9647640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4112d50 con 0x7f2cc41044e0 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48054/0 (socket says 172.21.15.92:48054) 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 -- 172.21.15.92:0/1572882288 learned_addr learned my addr 172.21.15.92:0/1572882288 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 0x7f2cc419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 0x7f2cc41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 -- 172.21.15.92:0/1572882288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 msgr2=0x7f2cc41995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 0x7f2cc41995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 -- 172.21.15.92:0/1572882288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 msgr2=0x7f2cc419d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 0x7f2cc419d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 -- 172.21.15.92:0/1572882288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc419e0a0 con 0x7f2cc4103bc0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005cc0 tx=0x7f2cb402f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.943+0000 7f2cabfff640 1 -- 172.21.15.92:0/1572882288 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4034040 con 0x7f2cc4103bc0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.944+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc419e330 con 0x7f2cc4103bc0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.944+0000 7f2cabfff640 1 -- 172.21.15.92:0/1572882288 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cb402fe80 con 0x7f2cc4103bc0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.944+0000 7f2cabfff640 1 -- 172.21.15.92:0/1572882288 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40046a0 con 0x7f2cc4103bc0 2024-04-26T18:18:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.944+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc41a5c20 con 0x7f2cc4103bc0 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cabfff640 1 -- 172.21.15.92:0/1572882288 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f2cb4037020 con 0x7f2cc4103bc0 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 Processor -- start 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 -- start start 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 0x56253bf66ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.954 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf670e0 0x56253bf694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56253bec2460 con 0x56253bf5c820 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56253be7c590 con 0x56253bf5bf00 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2ccc363740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56253bebe420 con 0x56253bf670e0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cabfff640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 0x7f2cac0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 0x56253bf66ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.92:45110/0 (socket says 172.21.15.92:45110) 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 0x56253bf66ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48068/0 (socket says 172.21.15.92:48068) 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.946+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3438536126 learned_addr learned my addr 172.21.15.92:0/3438536126 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 0x7f2cac0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cabfff640 1 -- 172.21.15.92:0/1572882288 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f2cb40f2580 con 0x7f2cc4103bc0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf670e0 0x56253bf694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3438536126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf670e0 msgr2=0x56253bf694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.955 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf670e0 0x56253bf694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3438536126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 msgr2=0x56253bf66ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 0x56253bf66ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3438536126 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56253be890d0 con 0x56253bf5bf00 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 0x7f2cac0a6280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00f790 tx=0x7f2cbc018000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0119f0 tx=0x7f2cbc011eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6509e386c44b4843 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2ca97fa640 1 -- 172.21.15.92:0/3438536126 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc022070 con 0x56253bf5bf00 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2ca97fa640 1 -- 172.21.15.92:0/3438536126 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc00e7c0 con 0x56253bf5bf00 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.947+0000 7f2ca97fa640 1 -- 172.21.15.92:0/3438536126 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0044e0 con 0x56253bf5bf00 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- 172.21.15.92:0/3438536126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 msgr2=0x56253bf5c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0119f0 tx=0x7f2cbc011eb0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- 172.21.15.92:0/3438536126 shutdown_connections 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf670e0 0x56253bf694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf5c820 0x56253bf66ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3438536126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf5c2e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.956 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- 172.21.15.92:0/3438536126 >> 172.21.15.92:0/3438536126 conn(0x56253bf58410 msgr2=0x56253bf587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- 172.21.15.92:0/3438536126 shutdown_connections 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- 172.21.15.92:0/3438536126 wait complete. 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 -- start start 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.948+0000 7f2ccc363740 1 Processor -- start 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56253bf69cb0 con 0x56253bf670e0 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x56253be49b60 con 0x56253bf5c820 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56253bf69e30 con 0x56253bf5bf00 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 10 client.0 _ll_register_callbacks cb 0x56253be6e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48074/0 (socket says 172.21.15.92:48074) 2024-04-26T18:18:12.957 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 -- 172.21.15.92:0/2676155597 learned_addr learned my addr 172.21.15.92:0/2676155597 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 -- 172.21.15.92:0/2676155597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 msgr2=0x56253bf710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 -- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 msgr2=0x56253bf71610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf71610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 -- 172.21.15.92:0/2676155597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56253bbd4210 con 0x56253bf670e0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ee70 tx=0x7f2cbc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1fff746afa6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ca6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc022040 con 0x56253bf670e0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f2cbc003bf0 con 0x56253bf670e0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cbc00e7c0 con 0x56253bf670e0 2024-04-26T18:18:12.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=326) ==== 24+0+0 (secure 0 0 0) 0x7f2cbc003df0 con 0x56253bf670e0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 10 client.16812 fetch_fsmap learned FSMap version 326 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.949+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=326,monmap=4+}) -- 0x56253bca0620 con 0x56253bf670e0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc00e7c0 con 0x56253bf670e0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 326) ==== 4708+0+0 (secure 0 0 0) 0x7f2cbc0387a0 con 0x56253bf670e0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 10 client.16812 fetch_fsmap finished waiting for FSMap version 326 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 20 client.16812 populate_metadata read hostname 'smithi092' 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bf7b960 0x56253bf7ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 4 client.16812 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56253bed0070 con 0x56253bf7b960 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bf7b960 0x56253bf7ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bf7b960 0x56253bf7ddc0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce9aef2b812fc97d server_cookie=200e24f380ffed11 in_seq=0 out_seq=0 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.950+0000 7f2ca6ff5640 10 client.16812 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:12.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.951+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/2676155597 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56253bed0070 con 0x56253bf7b960 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.951+0000 7f2ca6ff5640 10 client.16812 handle_command_reply: tid=0 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.951+0000 7f2ccc363740 1 client.16812 shutdown 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.951+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 msgr2=0x56253bf6b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.951+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ee70 tx=0x7f2cbc00eea0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 shutdown_connections 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bf7b960 0x56253bf7ddc0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf6b440 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ca6ff5640 0 client.16812 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 --2- 172.21.15.92:0/2676155597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 >> 172.21.15.92:0/2676155597 conn(0x56253bf58410 msgr2=0x56253bf5e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 shutdown_connections 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 1 -- 172.21.15.92:0/2676155597 wait complete. 2024-04-26T18:18:12.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.952+0000 7f2ccc363740 20 client.16812 trim_cache size 0 max 16384 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.966+0000 7f2ccc363740 1 Processor -- start 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.966+0000 7f2ccc363740 1 -- start start 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf83690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41af0b0 con 0x56253bf670e0 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41acea0 con 0x56253bf5c820 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ccc363740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41ae9e0 con 0x56253bf5bf00 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48078/0 (socket says 172.21.15.92:48078) 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3444597816 learned_addr learned my addr 172.21.15.92:0/3444597816 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf83690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3444597816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 msgr2=0x56253bf714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3444597816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 msgr2=0x56253bf83690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf83690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 -- 172.21.15.92:0/3444597816 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56253bf5d1b0 con 0x56253bf670e0 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:12.972 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009850 tx=0x7f2cbc001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a73d3036a76264c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ca8ff9640 1 -- 172.21.15.92:0/3444597816 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc03d030 con 0x56253bf670e0 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ca8ff9640 1 -- 172.21.15.92:0/3444597816 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc00e790 con 0x56253bf670e0 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.967+0000 7f2ca8ff9640 1 -- 172.21.15.92:0/3444597816 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc022040 con 0x56253bf670e0 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- 172.21.15.92:0/3444597816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 msgr2=0x56253bf83bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009850 tx=0x7f2cbc001e50 comp rx=0 tx=0).stop 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- 172.21.15.92:0/3444597816 shutdown_connections 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf83bd0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5c820 0x56253bf83690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 --2- 172.21.15.92:0/3444597816 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5bf00 0x56253bf714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- 172.21.15.92:0/3444597816 >> 172.21.15.92:0/3444597816 conn(0x56253bf58410 msgr2=0x56253bf70d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- 172.21.15.92:0/3444597816 shutdown_connections 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- 172.21.15.92:0/3444597816 wait complete. 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 -- start start 2024-04-26T18:18:12.973 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.968+0000 7f2ccc363740 1 Processor -- start 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf77810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5c820 0x56253bf74ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41adc40 con 0x56253bf670e0 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41ad570 con 0x56253bf5bf00 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41ae310 con 0x56253bf5c820 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 10 client.0 _ll_register_callbacks cb 0x7f2cb4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48092/0 (socket says 172.21.15.92:48092) 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc2ffd640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf77810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 -- 172.21.15.92:0/1220987253 learned_addr learned my addr 172.21.15.92:0/1220987253 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc27fc640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5c820 0x56253bf74ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 -- 172.21.15.92:0/1220987253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5c820 msgr2=0x56253bf74ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5c820 0x56253bf74ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 -- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 msgr2=0x56253bf77810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf77810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 -- 172.21.15.92:0/1220987253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56253bf758e0 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf77810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2cc37fe640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc011730 tx=0x7f2cbc0117f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddfa90556256edb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ca6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc03d040 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 12711+0+0 (secure 0 0 0) 0x7f2cbc003bf0 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cbc00e790 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=326) ==== 24+0+0 (secure 0 0 0) 0x7f2cbc04f050 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 10 client.16818 fetch_fsmap learned FSMap version 326 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.969+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=326,monmap=4+}) -- 0x56253bfe1ec0 con 0x56253bf670e0 2024-04-26T18:18:12.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc00e790 con 0x56253bf670e0 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 326) ==== 4708+0+0 (secure 0 0 0) 0x7f2cbc005050 con 0x56253bf670e0 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 10 client.16818 fetch_fsmap finished waiting for FSMap version 326 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 20 client.16818 populate_metadata read hostname 'smithi092' 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bfe2550 0x56253bfe4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 4 client.16818 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56253bec9ee0 con 0x56253bfe2550 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bfe2550 0x56253bfe4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2ca6ff5640 10 client.16818 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:12.976 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:12.970+0000 7f2cc2ffd640 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bfe2550 0x56253bfe4970 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f1a1f9b7bba6910 server_cookie=5fd1b47701f8b9ee in_seq=0 out_seq=0 2024-04-26T18:18:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:13 smithi189 ceph-mon[32756]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-04-26T18:18:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:13 smithi156 ceph-mon[32679]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-04-26T18:18:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:13 smithi092 ceph-mon[29156]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-04-26T18:18:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:15 smithi189 ceph-mon[32756]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-26T18:18:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:15 smithi156 ceph-mon[32679]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-26T18:18:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:15 smithi092 ceph-mon[29156]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-04-26T18:18:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:17 smithi189 ceph-mon[32756]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:17 smithi156 ceph-mon[32679]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:17 smithi092 ceph-mon[29156]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:18 smithi189 ceph-mon[32756]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:18 smithi156 ceph-mon[32679]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:18 smithi092 ceph-mon[29156]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-04-26T18:18:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:19 smithi189 ceph-mon[32756]: Replacing daemon mds.d as rank 2 with standby daemon mds.j 2024-04-26T18:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:19 smithi189 ceph-mon[32756]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T18:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:19 smithi189 ceph-mon[32756]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:19 smithi189 ceph-mon[32756]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T18:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:19 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 2024-04-26T18:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:19 smithi156 ceph-mon[32679]: Replacing daemon mds.d as rank 2 with standby daemon mds.j 2024-04-26T18:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:19 smithi156 ceph-mon[32679]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T18:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:19 smithi156 ceph-mon[32679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:19 smithi156 ceph-mon[32679]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T18:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:19 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 2024-04-26T18:18:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:19 smithi092 ceph-mon[29156]: Replacing daemon mds.d as rank 2 with standby daemon mds.j 2024-04-26T18:18:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:19 smithi092 ceph-mon[29156]: MDS daemon mds.d is removed because it is dead or otherwise unavailable. 2024-04-26T18:18:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:19 smithi092 ceph-mon[29156]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-26T18:18:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:19 smithi092 ceph-mon[29156]: osdmap e166: 12 total, 12 up, 12 in 2024-04-26T18:18:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:19 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:replay} 2 up:standby-replay 2024-04-26T18:18:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:20 smithi189 ceph-mon[32756]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:20 smithi156 ceph-mon[32679]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:20 smithi092 ceph-mon[29156]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:21 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:resolve 2024-04-26T18:18:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:21 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 2024-04-26T18:18:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:21 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:resolve 2024-04-26T18:18:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:21 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 2024-04-26T18:18:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:21 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:resolve 2024-04-26T18:18:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:21 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:resolve} 2 up:standby-replay 2024-04-26T18:18:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ca6ff5640 1 -- 172.21.15.92:0/1220987253 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56253bec9ee0 con 0x56253bfe2550 2024-04-26T18:18:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ca6ff5640 10 client.16818 handle_command_reply: tid=0 2024-04-26T18:18:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 client.16818 shutdown 2024-04-26T18:18:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 msgr2=0x56253bf750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc011730 tx=0x7f2cbc0117f0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 shutdown_connections 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x56253bfe2550 0x56253bfe4970 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56253bf670e0 0x56253bf750e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56253bf5c820 0x56253bf74ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ca6ff5640 0 client.16818 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 --2- 172.21.15.92:0/1220987253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56253bf5bf00 0x56253bf77810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 >> 172.21.15.92:0/1220987253 conn(0x56253bf58410 msgr2=0x56253bf56d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 shutdown_connections 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 1 -- 172.21.15.92:0/1220987253 wait complete. 2024-04-26T18:18:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.889+0000 7f2ccc363740 20 client.16818 trim_cache size 0 max 16384 2024-04-26T18:18:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:{ 2024-04-26T18:18:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "message": "", 2024-04-26T18:18:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout: "return_code": 0 2024-04-26T18:18:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stdout:} 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 msgr2=0x7f2cac0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 0x7f2cac0a6280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00f790 tx=0x7f2cbc018000 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 msgr2=0x7f2cc41990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005cc0 tx=0x7f2cb402f650 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 shutdown_connections 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f2cac0a3dc0 0x7f2cac0a6280 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cc410cf90 0x7f2cc419d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41044e0 0x7f2cc41995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 --2- 172.21.15.92:0/1572882288 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cc4103bc0 0x7f2cc41990b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 >> 172.21.15.92:0/1572882288 conn(0x7f2cc4078950 msgr2=0x7f2cc40fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 shutdown_connections 2024-04-26T18:18:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:22.890+0000 7f2cc9647640 1 -- 172.21.15.92:0/1572882288 wait complete. 2024-04-26T18:18:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:reconnect 2024-04-26T18:18:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 2024-04-26T18:18:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:rejoin 2024-04-26T18:18:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:22 smithi189 ceph-mon[32756]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 2024-04-26T18:18:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:reconnect 2024-04-26T18:18:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 2024-04-26T18:18:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:rejoin 2024-04-26T18:18:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:22 smithi156 ceph-mon[32679]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 2024-04-26T18:18:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: reconnect by client.15261 172.21.15.92:0/1023087954 after 0.000999972 2024-04-26T18:18:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: reconnect by client.24770 172.21.15.92:0/184472292 after 0.000999972 2024-04-26T18:18:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:reconnect 2024-04-26T18:18:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:reconnect} 2 up:standby-replay 2024-04-26T18:18:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-04-26T18:18:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:rejoin 2024-04-26T18:18:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:22 smithi092 ceph-mon[29156]: fsmap cephfs:3/3 {0=b=up:active,1=a=up:active,2=j=up:rejoin} 2 up:standby-replay 2024-04-26T18:18:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:23 smithi156 ceph-mon[32679]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:18:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-mon[29156]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe9198ed700 time 2024-04-26T18:18:23.916305+0000 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe923f163dd] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.244 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: clone() 2024-04-26T18:18:24.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:23.918+0000 7fe9198ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe9198ed700 time 2024-04-26T18:18:23.916305+0000 2024-04-26T18:18:24.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:24.245 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe923f163dd] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.246 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: clone() 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: *** Caught signal (Aborted) ** 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: in thread 7fe9198ed700 thread_name:ms_dispatch 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe922c9ed20] 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: gsignal() 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: abort() 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe923f16437] 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.247 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 16: clone() 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:23.919+0000 7fe9198ed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: in thread 7fe9198ed700 thread_name:ms_dispatch 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.248 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe922c9ed20] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: gsignal() 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: abort() 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe923f16437] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.249 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 16: clone() 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: -1> 2024-04-26T18:18:23.918+0000 7fe9198ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe9198ed700 time 2024-04-26T18:18:23.916305+0000 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe923f163dd] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.250 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: clone() 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 0> 2024-04-26T18:18:23.919+0000 7fe9198ed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: in thread 7fe9198ed700 thread_name:ms_dispatch 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.251 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe922c9ed20] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: gsignal() 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: abort() 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe923f16437] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.252 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 16: clone() 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: -1> 2024-04-26T18:18:23.918+0000 7fe9198ed700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: In function 'MDRequestRef MDCache::request_get(metareqid_t)' thread 7fe9198ed700 time 2024-04-26T18:18:23.916305+0000 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-3267-gbc94a2a9/rpm/el8/BUILD/ceph-19.0.0-3267-gbc94a2a9/src/mds/MDCache.cc: 9728: FAILED ceph_assert(p != active_requests.end()) 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fe923f163dd] 2024-04-26T18:18:24.253 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: clone() 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.254 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 0> 2024-04-26T18:18:23.919+0000 7fe9198ed700 -1 *** Caught signal (Aborted) ** 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: in thread 7fe9198ed700 thread_name:ms_dispatch 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev) 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fe922c9ed20] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2: gsignal() 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 3: abort() 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fe923f16437] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2d15a3) [0x7fe923f165a3] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 6: (MDCache::request_get(metareqid_t)+0x1c2) [0x555bbcc1c822] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 7: (Server::handle_peer_request_reply(boost::intrusive_ptr const&)+0xa8) [0x555bbcb8c598] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 8: (Server::dispatch(boost::intrusive_ptr const&)+0x97) [0x555bbcb8ec17] 2024-04-26T18:18:24.255 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x5fb) [0x555bbca87d0b] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x5c) [0x555bbca882ac] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x1bd) [0x555bbca70fad] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 12: (Messenger::ms_deliver_dispatch(boost::intrusive_ptr const&)+0x470) [0x7fe9241aae20] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 13: (DispatchQueue::entry()+0x51f) [0x7fe9241a7fdf] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 14: (DispatchQueue::DispatchThread::entry()+0x11) [0x7fe92427afc1] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fe922c941ca] 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 16: clone() 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j[101027]: 2024-04-26T18:18:24.256 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:23 smithi092 podman[101335]: 2024-04-26 18:18:23.993477567 +0000 UTC m=+0.020824679 container died b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-04-26T18:18:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:23 smithi189 ceph-mon[32756]: daemon mds.j is now active in filesystem cephfs as rank 2 2024-04-26T18:18:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:24 smithi092 ceph-mon[29156]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:24 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:active 2024-04-26T18:18:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:24 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 2 up:standby-replay 2024-04-26T18:18:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:24 smithi092 ceph-mon[29156]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:24.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:24 smithi092 podman[101335]: 2024-04-26 18:18:24.670727059 +0000 UTC m=+0.698074157 container remove b0ab3fcf313c3dc746fc9cc0c97f9b413b5d1212ec56a23528eec631e34f97c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2aadaf96fcd676c1b4c3580ed8dd1b2a67fa40f49767a9535ff3eae823efe0dc, name=ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-lusov-quiescer-fixes-bc94a2a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-26T18:18:24.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:24 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Main process exited, code=exited, status=134/n/a 2024-04-26T18:18:24.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:24 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:18:24.994 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:24 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.116s CPU time. 2024-04-26T18:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:24 smithi156 ceph-mon[32679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:24 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:active 2024-04-26T18:18:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:24 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 2 up:standby-replay 2024-04-26T18:18:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:24 smithi156 ceph-mon[32679]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:24 smithi189 ceph-mon[32756]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T18:18:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:24 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6834/1230136846,v1:172.21.15.92:6835/1230136846] up:active 2024-04-26T18:18:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:24 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active} 2 up:standby-replay 2024-04-26T18:18:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:24 smithi189 ceph-mon[32756]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:27 smithi189 ceph-mon[32756]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:27 smithi156 ceph-mon[32679]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:27 smithi092 ceph-mon[29156]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:29 smithi189 ceph-mon[32756]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:29 smithi156 ceph-mon[32679]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:29 smithi092 ceph-mon[29156]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2024-04-26T18:18:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:31 smithi189 ceph-mon[32756]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-04-26T18:18:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:31 smithi156 ceph-mon[32679]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-04-26T18:18:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:31 smithi092 ceph-mon[29156]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-04-26T18:18:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:33 smithi189 ceph-mon[32756]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-04-26T18:18:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:33 smithi156 ceph-mon[32679]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-04-26T18:18:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:33 smithi092 ceph-mon[29156]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-04-26T18:18:35.493 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Scheduled restart job, restart counter is at 6. 2024-04-26T18:18:35.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: Stopped Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:18:35.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Consumed 1.116s CPU time. 2024-04-26T18:18:35.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Start request repeated too quickly. 2024-04-26T18:18:35.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: ceph-fb3c417a-03f4-11ef-bc93-c7b262605968@mds.j.service: Failed with result 'exit-code'. 2024-04-26T18:18:35.494 INFO:journalctl@ceph.mds.j.smithi092.stdout:Apr 26 18:18:34 smithi092 systemd[1]: Failed to start Ceph mds.j for fb3c417a-03f4-11ef-bc93-c7b262605968. 2024-04-26T18:18:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:35 smithi189 ceph-mon[32756]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-04-26T18:18:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:35 smithi156 ceph-mon[32679]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-04-26T18:18:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 -- 172.21.15.92:0/3151196771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4102930 msgr2=0x7f1cb4102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 --2- 172.21.15.92:0/3151196771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4102930 0x7f1cb4102db0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009930 tx=0x7f1ca802a420 comp rx=0 tx=0).stop 2024-04-26T18:18:35.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 -- 172.21.15.92:0/3151196771 shutdown_connections 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 --2- 172.21.15.92:0/3151196771 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41032f0 0x7f1cb410f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 --2- 172.21.15.92:0/3151196771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4102930 0x7f1cb4102db0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 --2- 172.21.15.92:0/3151196771 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cb4108940 0x7f1cb4108d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.984+0000 7f1cb9283640 1 -- 172.21.15.92:0/3151196771 >> 172.21.15.92:0/3151196771 conn(0x7f1cb40fe400 msgr2=0x7f1cb4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- 172.21.15.92:0/3151196771 shutdown_connections 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- 172.21.15.92:0/3151196771 wait complete. 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 Processor -- start 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- start start 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cb4102930 0x7f1cb41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41032f0 0x7f1cb4199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4108940 0x7f1cb419d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb4112bd0 con 0x7f1cb4108940 2024-04-26T18:18:35.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb4112a50 con 0x7f1cb41032f0 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.985+0000 7f1cb9283640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb4112d50 con 0x7f1cb4102930 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4108940 0x7f1cb419d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4108940 0x7f1cb419d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60590/0 (socket says 172.21.15.92:60590) 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 -- 172.21.15.92:0/2399433965 learned_addr learned my addr 172.21.15.92:0/2399433965 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41032f0 0x7f1cb4199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cb4102930 0x7f1cb41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cb4102930 msgr2=0x7f1cb41990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cb4102930 0x7f1cb41990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41032f0 msgr2=0x7f1cb4199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41032f0 0x7f1cb4199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb419e0e0 con 0x7f1cb4108940 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cb4108940 0x7f1cb419d9b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00eaa0 tx=0x7f1cac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00cdb0 con 0x7f1cb4108940 2024-04-26T18:18:35.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb9283640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb419e3d0 con 0x7f1cb4108940 2024-04-26T18:18:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cac005020 con 0x7f1cb4108940 2024-04-26T18:18:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0116d0 con 0x7f1cb4108940 2024-04-26T18:18:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.986+0000 7f1cb9283640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb41a5c60 con 0x7f1cb4108940 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 138777+0+0 (secure 0 0 0) 0x7f1cac0051d0 con 0x7f1cb4108940 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 Processor -- start 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 -- start start 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb911ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb9144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5617fb86d460 con 0x5617fb906f00 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5617fb827590 con 0x5617fb907820 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5617fb869420 con 0x5617fb9120e0 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60596/0 (socket says 172.21.15.92:60596) 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cb27fc640 1 -- 172.21.15.92:0/4019874384 learned_addr learned my addr 172.21.15.92:0/4019874384 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.989+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb911ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb9144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 12797+0+0 (secure 0 0 0) 0x7f1cac0d1b50 con 0x7f1cb4108940 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 -- 172.21.15.92:0/4019874384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 msgr2=0x5617fb9144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb9144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 -- 172.21.15.92:0/4019874384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 msgr2=0x5617fb911ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb911ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 -- 172.21.15.92:0/4019874384 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fb8340d0 con 0x5617fb906f00 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005ab0 tx=0x7f1ca8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d3284c24ac4bf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0a6280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ce2a0 tx=0x7f1cac0bd040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1c997fa640 1 -- 172.21.15.92:0/4019874384 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8035050 con 0x5617fb906f00 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1c997fa640 1 -- 172.21.15.92:0/4019874384 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ca8009520 con 0x5617fb906f00 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.990+0000 7f1c997fa640 1 -- 172.21.15.92:0/4019874384 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8005400 con 0x5617fb906f00 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/4019874384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 msgr2=0x5617fb9072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005ab0 tx=0x7f1ca8005d50 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/4019874384 shutdown_connections 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb9144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb911ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/4019874384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb9072e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/4019874384 >> 172.21.15.92:0/4019874384 conn(0x5617fb903410 msgr2=0x5617fb9037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/4019874384 shutdown_connections 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/4019874384 wait complete. 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 -- start start 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 Processor -- start 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb906f00 0x5617fb90f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.991+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 0x5617fb90fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5617fb914cb0 con 0x5617fb907820 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x5617fb7f4b60 con 0x5617fb9120e0 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5617fb914e30 con 0x5617fb906f00 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 10 client.0 _ll_register_callbacks cb 0x5617fb8192b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60602/0 (socket says 172.21.15.92:60602) 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/179227777 learned_addr learned my addr 172.21.15.92:0/179227777 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb906f00 0x5617fb90f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/179227777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb906f00 msgr2=0x5617fb90f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb906f00 0x5617fb90f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 0x5617fb90fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 msgr2=0x5617fb90fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 0x5617fb90fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/179227777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fb57f210 con 0x5617fb907820 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 0x5617fb90fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009d90 tx=0x7f1ca40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3641292f072113a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1c96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4012860 con 0x5617fb907820 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 12797+0+0 (secure 0 0 0) 0x7f1ca4012a00 con 0x5617fb907820 2024-04-26T18:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ca8009520 con 0x5617fb907820 2024-04-26T18:18:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7f1ca4012c00 con 0x5617fb907820 2024-04-26T18:18:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 10 client.16830 fetch_fsmap learned FSMap version 331 2024-04-26T18:18:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.992+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=331,monmap=4+}) -- 0x5617fb64b620 con 0x5617fb907820 2024-04-26T18:18:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:35 smithi092 ceph-mon[29156]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ca8009520 con 0x5617fb907820 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 331) ==== 4115+0+0 (secure 0 0 0) 0x7f1ca400f040 con 0x5617fb907820 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 10 client.16830 fetch_fsmap finished waiting for FSMap version 331 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 10 client.16830 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 20 client.16830 populate_metadata read hostname 'smithi092' 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb922760 0x5617fb924bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 4 client.16830 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617fb87b070 con 0x5617fb922760 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb922760 0x5617fb924bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1c96ff5640 10 client.16830 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb922760 0x5617fb924bc0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60454f2b4bb5d14 server_cookie=94ce9fb53f766f26 in_seq=0 out_seq=0 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1c96ff5640 1 -- 172.21.15.92:0/179227777 <== mds.0 v2:172.21.15.156:6838/2836729853 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617fb87b070 con 0x5617fb922760 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1c96ff5640 10 client.16830 handle_command_reply: tid=0 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 client.16830 shutdown 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 msgr2=0x5617fb90f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4009d90 tx=0x7f1ca40117b0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 shutdown_connections 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb922760 0x5617fb924bc0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb9120e0 0x5617fb90fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb907820 0x5617fb90f5d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1c96ff5640 0 client.16830 ms_handle_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/179227777 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb906f00 0x5617fb90f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 >> 172.21.15.92:0/179227777 conn(0x5617fb903410 msgr2=0x5617fb909190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 shutdown_connections 2024-04-26T18:18:36.003 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.994+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/179227777 wait complete. 2024-04-26T18:18:36.004 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:35.995+0000 7f1cbbfa5740 20 client.16830 trim_cache size 0 max 16384 2024-04-26T18:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.009+0000 7f1cbbfa5740 1 Processor -- start 2024-04-26T18:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.009+0000 7f1cbbfa5740 1 -- start start 2024-04-26T18:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb9098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb90f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb41b0c50 con 0x5617fb906f00 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb41af110 con 0x5617fb907820 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb41b0580 con 0x5617fb9120e0 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60610/0 (socket says 172.21.15.92:60610) 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2976276341 learned_addr learned my addr 172.21.15.92:0/2976276341 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb9098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2976276341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 msgr2=0x5617fb90f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb90f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2976276341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 msgr2=0x5617fb9098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb9098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2976276341 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fb90e040 con 0x5617fb906f00 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb9098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8031440 tx=0x7f1ca8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7d70d84b04ddd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1c98ff9640 1 -- 172.21.15.92:0/2976276341 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8057070 con 0x5617fb906f00 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1c98ff9640 1 -- 172.21.15.92:0/2976276341 <== mon.0 v2:172.21.15.92:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ca80319a0 con 0x5617fb906f00 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.010+0000 7f1c98ff9640 1 -- 172.21.15.92:0/2976276341 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8035040 con 0x5617fb906f00 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/2976276341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 msgr2=0x5617fb91dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8031440 tx=0x7f1ca8005d50 comp rx=0 tx=0).stop 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/2976276341 shutdown_connections 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb90f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb9098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/2976276341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91dba0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/2976276341 >> 172.21.15.92:0/2976276341 conn(0x5617fb903410 msgr2=0x5617fb9037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/2976276341 shutdown_connections 2024-04-26T18:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/2976276341 wait complete. 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- start start 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 Processor -- start 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb90bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb90c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb41afeb0 con 0x5617fb906f00 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb41af7e0 con 0x5617fb907820 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5617fb906720 con 0x5617fb9120e0 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.011+0000 7f1cbbfa5740 10 client.0 _ll_register_callbacks cb 0x7f1ca4009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:60620/0 (socket says 172.21.15.92:60620) 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/534035708 learned_addr learned my addr 172.21.15.92:0/534035708 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 msgr2=0x5617fb90c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5617fb9120e0 0x5617fb90c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 msgr2=0x5617fb90bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617fb907820 0x5617fb90bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fb90c900 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617fb906f00 0x5617fb91a4d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8033000 tx=0x7f1ca8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3d34993b9d888e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1c96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8057030 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 12797+0+0 (secure 0 0 0) 0x7f1ca8044050 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ca80319a0 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=331) ==== 24+0+0 (secure 0 0 0) 0x7f1ca8035070 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cbbfa5740 10 client.16836 fetch_fsmap learned FSMap version 331 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=331,monmap=4+}) -- 0x5617fb988d90 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.012+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ca80319a0 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 5 ==== fsmap(e 331) ==== 4115+0+0 (secure 0 0 0) 0x7f1ca80035f0 con 0x5617fb906f00 2024-04-26T18:18:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 10 client.16836 fetch_fsmap finished waiting for FSMap version 331 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 10 client.16836 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 20 client.16836 populate_metadata read hostname 'smithi092' 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 4 client.16836 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cbbfa5740 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617fb874ee0 con 0x5617fb9891b0 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:18:36.013+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2cb3ce8aeed594b server_cookie=74252ff39a4b3644 in_seq=0 out_seq=0 2024-04-26T18:18:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:36 smithi189 ceph-mon[32756]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:36 smithi156 ceph-mon[32679]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:36 smithi092 ceph-mon[29156]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:39 smithi189 ceph-mon[32756]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:39 smithi156 ceph-mon[32679]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:39 smithi092 ceph-mon[29156]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 35 KiB/s wr, 19 op/s 2024-04-26T18:18:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:40 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:18:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:40 smithi189 ceph-mon[32756]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-04-26T18:18:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:40 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:18:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:40 smithi156 ceph-mon[32679]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-04-26T18:18:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:40 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:18:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:40 smithi092 ceph-mon[29156]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-04-26T18:18:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:43 smithi189 ceph-mon[32756]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:43 smithi156 ceph-mon[32679]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:43 smithi092 ceph-mon[29156]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:45 smithi189 ceph-mon[32756]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:45 smithi156 ceph-mon[32679]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:45 smithi092 ceph-mon[29156]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:47 smithi189 ceph-mon[32756]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:47 smithi156 ceph-mon[32679]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:47 smithi092 ceph-mon[29156]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:49 smithi189 ceph-mon[32756]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:49 smithi156 ceph-mon[32679]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:49 smithi092 ceph-mon[29156]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-04-26T18:18:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:50 smithi189 ceph-mon[32756]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:50 smithi156 ceph-mon[32679]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:50 smithi092 ceph-mon[29156]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-04-26T18:18:53.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:53 smithi189 ceph-mon[32756]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:53 smithi156 ceph-mon[32679]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:53 smithi092 ceph-mon[29156]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:55 smithi189 ceph-mon[32756]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:18:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:55 smithi156 ceph-mon[32679]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:18:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:55 smithi092 ceph-mon[29156]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:18:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:57 smithi189 ceph-mon[32756]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:57 smithi156 ceph-mon[32679]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:57 smithi092 ceph-mon[29156]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:18:58 smithi189 ceph-mon[32756]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:18:58 smithi156 ceph-mon[32679]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:18:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:18:58 smithi092 ceph-mon[29156]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:19:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:19:00.988+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:19:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:19:00.988+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:19:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:19:00.988+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:19:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:19:00.988+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:01.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:19:00 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:19:00.988+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:19:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:01 smithi189 ceph-mon[32756]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:01 smithi156 ceph-mon[32679]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:01 smithi092 ceph-mon[29156]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:03 smithi189 ceph-mon[32756]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:19:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:03 smithi156 ceph-mon[32679]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:19:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:03 smithi092 ceph-mon[29156]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:19:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:19:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:19:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:19:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:04 smithi189 ceph-mon[32756]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:19:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:04 smithi156 ceph-mon[32679]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:19:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:04 smithi092 ceph-mon[29156]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:19:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:05 smithi189 ceph-mon[32756]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:05 smithi156 ceph-mon[32679]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:05 smithi092 ceph-mon[29156]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:08 smithi189 ceph-mon[32756]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:08 smithi156 ceph-mon[32679]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:08 smithi092 ceph-mon[29156]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:10.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:10 smithi092 ceph-mon[29156]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:10 smithi189 ceph-mon[32756]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:10 smithi156 ceph-mon[32679]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:12 smithi189 ceph-mon[32756]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:12 smithi156 ceph-mon[32679]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:12 smithi092 ceph-mon[29156]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:14.620 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:14 smithi092 ceph-mon[29156]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:14 smithi189 ceph-mon[32756]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:14 smithi156 ceph-mon[32679]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:19:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:16 smithi189 ceph-mon[32756]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:19:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:16 smithi156 ceph-mon[32679]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:19:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:16 smithi092 ceph-mon[29156]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:19:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:18 smithi189 ceph-mon[32756]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:18 smithi156 ceph-mon[32679]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:18 smithi092 ceph-mon[29156]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:20 smithi189 ceph-mon[32756]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:20 smithi156 ceph-mon[32679]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:20 smithi092 ceph-mon[29156]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:22 smithi189 ceph-mon[32756]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:22 smithi156 ceph-mon[32679]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:22 smithi092 ceph-mon[29156]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:24 smithi189 ceph-mon[32756]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:24 smithi156 ceph-mon[32679]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:24 smithi092 ceph-mon[29156]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:26 smithi189 ceph-mon[32756]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:26 smithi156 ceph-mon[32679]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:26 smithi092 ceph-mon[29156]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:28 smithi189 ceph-mon[32756]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:28 smithi156 ceph-mon[32679]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:28 smithi092 ceph-mon[29156]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:30 smithi189 ceph-mon[32756]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:30 smithi156 ceph-mon[32679]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:30 smithi092 ceph-mon[29156]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:32 smithi189 ceph-mon[32756]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:32 smithi156 ceph-mon[32679]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:32 smithi092 ceph-mon[29156]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:34 smithi189 ceph-mon[32756]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:34 smithi156 ceph-mon[32679]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:34 smithi092 ceph-mon[29156]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:36 smithi189 ceph-mon[32756]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:36 smithi156 ceph-mon[32679]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:36 smithi092 ceph-mon[29156]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:38 smithi189 ceph-mon[32756]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:38 smithi156 ceph-mon[32679]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:38 smithi092 ceph-mon[29156]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:40 smithi189 ceph-mon[32756]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:40 smithi156 ceph-mon[32679]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:40 smithi092 ceph-mon[29156]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:42 smithi189 ceph-mon[32756]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:42 smithi156 ceph-mon[32679]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:42 smithi092 ceph-mon[29156]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:44 smithi189 ceph-mon[32756]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:44 smithi156 ceph-mon[32679]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:44 smithi092 ceph-mon[29156]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:46 smithi189 ceph-mon[32756]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:46 smithi156 ceph-mon[32679]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:46 smithi092 ceph-mon[29156]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:48 smithi189 ceph-mon[32756]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:48 smithi156 ceph-mon[32679]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:48 smithi092 ceph-mon[29156]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:50 smithi189 ceph-mon[32756]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:50 smithi156 ceph-mon[32679]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:50 smithi092 ceph-mon[29156]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:52 smithi189 ceph-mon[32756]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:52 smithi156 ceph-mon[32679]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:52 smithi092 ceph-mon[29156]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:54 smithi189 ceph-mon[32756]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:54 smithi156 ceph-mon[32679]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:54 smithi092 ceph-mon[29156]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:56 smithi189 ceph-mon[32756]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:56 smithi156 ceph-mon[32679]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:56 smithi092 ceph-mon[29156]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:19:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:19:58 smithi189 ceph-mon[32756]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:19:58 smithi156 ceph-mon[32679]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:19:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:19:58 smithi092 ceph-mon[29156]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:00 smithi189 ceph-mon[32756]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-04-26T18:20:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:20:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:20:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-26T18:20:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:00 smithi156 ceph-mon[32679]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-04-26T18:20:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:20:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:20:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-26T18:20:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:00 smithi092 ceph-mon[29156]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 2 failed cephadm daemon(s) 2024-04-26T18:20:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2024-04-26T18:20:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in unknown state 2024-04-26T18:20:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-26T18:20:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:02 smithi189 ceph-mon[32756]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:02 smithi156 ceph-mon[32679]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:02 smithi092 ceph-mon[29156]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:20:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.655 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:04.655 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.655 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.656 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:07.393 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:20:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:20:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:20:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:20:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:20:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:08 smithi156 ceph-mon[32679]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:08 smithi156 ceph-mon[32679]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:08 smithi156 ceph-mon[32679]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:20:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:20:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:08 smithi092 ceph-mon[29156]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:08 smithi092 ceph-mon[29156]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:08 smithi092 ceph-mon[29156]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:20:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:20:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:20:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:08 smithi189 ceph-mon[32756]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:08 smithi189 ceph-mon[32756]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:08 smithi189 ceph-mon[32756]: Health check update: 8 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-04-26T18:20:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:10 smithi156 ceph-mon[32679]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:10 smithi092 ceph-mon[29156]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:10 smithi189 ceph-mon[32756]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:12 smithi156 ceph-mon[32679]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:12 smithi092 ceph-mon[29156]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:12 smithi189 ceph-mon[32756]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:14 smithi156 ceph-mon[32679]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:14 smithi092 ceph-mon[29156]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:14 smithi189 ceph-mon[32756]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:16 smithi156 ceph-mon[32679]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:16 smithi092 ceph-mon[29156]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:16 smithi189 ceph-mon[32756]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:20:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:18 smithi156 ceph-mon[32679]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:20:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:18 smithi092 ceph-mon[29156]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:20:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:18 smithi189 ceph-mon[32756]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:20:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:20 smithi156 ceph-mon[32679]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:20 smithi092 ceph-mon[29156]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:20 smithi189 ceph-mon[32756]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:22 smithi156 ceph-mon[32679]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:22 smithi092 ceph-mon[29156]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:22 smithi189 ceph-mon[32756]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:24 smithi156 ceph-mon[32679]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:24.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:24 smithi189 ceph-mon[32756]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:24 smithi092 ceph-mon[29156]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:26 smithi156 ceph-mon[32679]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:26 smithi092 ceph-mon[29156]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:26 smithi189 ceph-mon[32756]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:28 smithi156 ceph-mon[32679]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:28 smithi092 ceph-mon[29156]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:28 smithi189 ceph-mon[32756]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:30 smithi156 ceph-mon[32679]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:30 smithi092 ceph-mon[29156]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:30 smithi189 ceph-mon[32756]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:32 smithi156 ceph-mon[32679]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:32 smithi092 ceph-mon[29156]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:32 smithi189 ceph-mon[32756]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:34 smithi156 ceph-mon[32679]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:34 smithi092 ceph-mon[29156]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:34 smithi189 ceph-mon[32756]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:36 smithi092 ceph-mon[29156]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:36 smithi189 ceph-mon[32756]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:36 smithi156 ceph-mon[32679]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:38 smithi092 ceph-mon[29156]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:38 smithi189 ceph-mon[32756]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:38 smithi156 ceph-mon[32679]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:40 smithi092 ceph-mon[29156]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:40 smithi189 ceph-mon[32756]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:40 smithi156 ceph-mon[32679]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:42 smithi092 ceph-mon[29156]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:42 smithi189 ceph-mon[32756]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:42 smithi156 ceph-mon[32679]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:44 smithi092 ceph-mon[29156]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:44 smithi189 ceph-mon[32756]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:44 smithi156 ceph-mon[32679]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:46 smithi092 ceph-mon[29156]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:46 smithi189 ceph-mon[32756]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:46 smithi156 ceph-mon[32679]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:48 smithi092 ceph-mon[29156]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:48 smithi189 ceph-mon[32756]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:48 smithi156 ceph-mon[32679]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:50 smithi092 ceph-mon[29156]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:50 smithi189 ceph-mon[32756]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:50 smithi156 ceph-mon[32679]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:52 smithi092 ceph-mon[29156]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:52 smithi189 ceph-mon[32756]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:52 smithi156 ceph-mon[32679]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:54.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:54 smithi156 ceph-mon[32679]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:54 smithi092 ceph-mon[29156]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:54 smithi189 ceph-mon[32756]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:55 smithi189 ceph-mon[32756]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:55 smithi156 ceph-mon[32679]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:55 smithi092 ceph-mon[29156]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:20:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:57 smithi092 ceph-mon[29156]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:57 smithi189 ceph-mon[32756]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:20:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:57 smithi156 ceph-mon[32679]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:20:59 smithi092 ceph-mon[29156]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:20:59 smithi189 ceph-mon[32756]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:20:59 smithi156 ceph-mon[32679]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:01 smithi092 ceph-mon[29156]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:01 smithi189 ceph-mon[32756]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:01 smithi156 ceph-mon[32679]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:03 smithi092 ceph-mon[29156]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:03 smithi189 ceph-mon[32756]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:03 smithi156 ceph-mon[32679]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:05 smithi189 ceph-mon[32756]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:05 smithi156 ceph-mon[32679]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:05 smithi092 ceph-mon[29156]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:07 smithi092 ceph-mon[29156]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:21:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:07 smithi189 ceph-mon[32756]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:21:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:07 smithi156 ceph-mon[32679]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:21:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:21:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:21:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:21:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:08 smithi092 ceph-mon[29156]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:21:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:08 smithi092 ceph-mon[29156]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:21:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:08 smithi189 ceph-mon[32756]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:21:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:08 smithi189 ceph-mon[32756]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:21:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:08 smithi156 ceph-mon[32679]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:21:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:08 smithi156 ceph-mon[32679]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:21:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:10 smithi092 ceph-mon[29156]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:10 smithi189 ceph-mon[32756]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:10 smithi156 ceph-mon[32679]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:12 smithi092 ceph-mon[29156]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:12 smithi189 ceph-mon[32756]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:12 smithi156 ceph-mon[32679]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:14 smithi092 ceph-mon[29156]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:21:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:14 smithi189 ceph-mon[32756]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:21:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:14 smithi156 ceph-mon[32679]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:21:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:16 smithi092 ceph-mon[29156]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:16 smithi189 ceph-mon[32756]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:16 smithi156 ceph-mon[32679]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:21:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:18 smithi092 ceph-mon[29156]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:21:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:18 smithi189 ceph-mon[32756]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:21:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:18 smithi156 ceph-mon[32679]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:21:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:20 smithi092 ceph-mon[29156]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:20 smithi189 ceph-mon[32756]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:20 smithi156 ceph-mon[32679]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:22 smithi092 ceph-mon[29156]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:22 smithi189 ceph-mon[32756]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:22 smithi156 ceph-mon[32679]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:25.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:24 smithi156 ceph-mon[32679]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:24 smithi092 ceph-mon[29156]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:24 smithi189 ceph-mon[32756]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:26 smithi092 ceph-mon[29156]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:26 smithi189 ceph-mon[32756]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:26 smithi156 ceph-mon[32679]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:28 smithi092 ceph-mon[29156]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:28 smithi092 ceph-mon[29156]: 1 slow requests, 1 included below; oldest blocked for > 184.199771 secs 2024-04-26T18:21:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:28 smithi092 ceph-mon[29156]: slow request 184.131541 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:21:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:28 smithi189 ceph-mon[32756]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:28 smithi189 ceph-mon[32756]: 1 slow requests, 1 included below; oldest blocked for > 184.199771 secs 2024-04-26T18:21:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:28 smithi189 ceph-mon[32756]: slow request 184.131541 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:21:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:28 smithi156 ceph-mon[32679]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:28 smithi156 ceph-mon[32679]: 1 slow requests, 1 included below; oldest blocked for > 184.199771 secs 2024-04-26T18:21:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:28 smithi156 ceph-mon[32679]: slow request 184.131541 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:21:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:30 smithi092 ceph-mon[29156]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:30 smithi189 ceph-mon[32756]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:30 smithi156 ceph-mon[32679]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:32 smithi189 ceph-mon[32756]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:21:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:32 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:21:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:32 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:21:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:32 smithi156 ceph-mon[32679]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:21:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:32 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:21:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:32 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:21:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:32 smithi092 ceph-mon[29156]: Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:21:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:32 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:21:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:32 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:21:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:33 smithi189 ceph-mon[32756]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:33 smithi156 ceph-mon[32679]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:33 smithi092 ceph-mon[29156]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 189.199914 secs 2024-04-26T18:21:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 189.199914 secs 2024-04-26T18:21:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 189.199914 secs 2024-04-26T18:21:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:35 smithi189 ceph-mon[32756]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:35 smithi156 ceph-mon[32679]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:35 smithi092 ceph-mon[29156]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:21:36.010+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880034f0 con 0x7f1cb4108940 2024-04-26T18:21:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:21:36.010+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880034f0 con 0x7f1cb4108940 2024-04-26T18:21:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:21:36.032+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0034c0 con 0x5617fb906f00 2024-04-26T18:21:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:21:36.033+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 6 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0034c0 con 0x5617fb906f00 2024-04-26T18:21:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:37 smithi189 ceph-mon[32756]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:37 smithi156 ceph-mon[32679]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:37 smithi092 ceph-mon[29156]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:39 smithi189 ceph-mon[32756]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 194.200005 secs 2024-04-26T18:21:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:39 smithi156 ceph-mon[32679]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 194.200005 secs 2024-04-26T18:21:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:39 smithi092 ceph-mon[29156]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 194.200005 secs 2024-04-26T18:21:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:41 smithi189 ceph-mon[32756]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:41 smithi156 ceph-mon[32679]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:41 smithi092 ceph-mon[29156]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:43 smithi189 ceph-mon[32756]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:43 smithi156 ceph-mon[32679]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:43 smithi092 ceph-mon[29156]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 199.200101 secs 2024-04-26T18:21:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 199.200101 secs 2024-04-26T18:21:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 199.200101 secs 2024-04-26T18:21:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:45 smithi189 ceph-mon[32756]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:45 smithi156 ceph-mon[32679]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:45 smithi092 ceph-mon[29156]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:47 smithi189 ceph-mon[32756]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:47 smithi156 ceph-mon[32679]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:47 smithi092 ceph-mon[29156]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:49 smithi189 ceph-mon[32756]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 204.200228 secs 2024-04-26T18:21:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:49 smithi156 ceph-mon[32679]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 204.200228 secs 2024-04-26T18:21:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:49 smithi092 ceph-mon[29156]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 204.200228 secs 2024-04-26T18:21:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:51 smithi189 ceph-mon[32756]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:51 smithi156 ceph-mon[32679]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:51 smithi092 ceph-mon[29156]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:53 smithi189 ceph-mon[32756]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:53 smithi156 ceph-mon[32679]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:53 smithi092 ceph-mon[29156]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 209.200341 secs 2024-04-26T18:21:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 209.200341 secs 2024-04-26T18:21:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 209.200341 secs 2024-04-26T18:21:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:55 smithi189 ceph-mon[32756]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:55 smithi156 ceph-mon[32679]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:55 smithi092 ceph-mon[29156]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:57 smithi189 ceph-mon[32756]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:57 smithi156 ceph-mon[32679]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:57 smithi092 ceph-mon[29156]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:21:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:59 smithi189 ceph-mon[32756]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:21:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 214.200499 secs 2024-04-26T18:21:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:59 smithi156 ceph-mon[32679]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:21:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 214.200499 secs 2024-04-26T18:21:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:59 smithi092 ceph-mon[29156]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:21:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:21:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 214.200499 secs 2024-04-26T18:22:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:01 smithi189 ceph-mon[32756]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:01 smithi156 ceph-mon[32679]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:01 smithi092 ceph-mon[29156]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:03 smithi189 ceph-mon[32756]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:03 smithi156 ceph-mon[32679]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:03 smithi092 ceph-mon[29156]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:04 smithi189 ceph-mon[32756]: 3 slow requests, 2 included below; oldest blocked for > 219.200651 secs 2024-04-26T18:22:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:04 smithi189 ceph-mon[32756]: slow request 183.136962 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:22:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:04 smithi189 ceph-mon[32756]: slow request 219.200650 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:22:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:04 smithi156 ceph-mon[32679]: 3 slow requests, 2 included below; oldest blocked for > 219.200651 secs 2024-04-26T18:22:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:04 smithi156 ceph-mon[32679]: slow request 183.136962 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:22:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:04 smithi156 ceph-mon[32679]: slow request 219.200650 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:22:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:04 smithi092 ceph-mon[29156]: 3 slow requests, 2 included below; oldest blocked for > 219.200651 secs 2024-04-26T18:22:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:04 smithi092 ceph-mon[29156]: slow request 183.136962 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:22:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:04 smithi092 ceph-mon[29156]: slow request 219.200650 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:22:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:05 smithi189 ceph-mon[32756]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:05 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:22:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:05 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:22:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:05 smithi156 ceph-mon[32679]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:05 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:22:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:05 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:22:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:05 smithi092 ceph-mon[29156]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:05 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T18:22:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:05 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:22:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:07 smithi189 ceph-mon[32756]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:07 smithi156 ceph-mon[32679]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:07 smithi092 ceph-mon[29156]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:22:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 224.200738 secs 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:22:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 224.200738 secs 2024-04-26T18:22:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:22:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:22:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 224.200738 secs 2024-04-26T18:22:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:22:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:22:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:22:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:22:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:11 smithi092 ceph-mon[29156]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:11 smithi189 ceph-mon[32756]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:11 smithi156 ceph-mon[32679]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:13 smithi092 ceph-mon[29156]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 229.200891 secs 2024-04-26T18:22:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:13 smithi189 ceph-mon[32756]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 229.200891 secs 2024-04-26T18:22:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:13 smithi156 ceph-mon[32679]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 229.200891 secs 2024-04-26T18:22:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:15 smithi189 ceph-mon[32756]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:15 smithi156 ceph-mon[32679]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:15 smithi092 ceph-mon[29156]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:22:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:17 smithi189 ceph-mon[32756]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:17 smithi156 ceph-mon[32679]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:17 smithi092 ceph-mon[29156]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:22:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 234.201019 secs 2024-04-26T18:22:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 234.201019 secs 2024-04-26T18:22:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 234.201019 secs 2024-04-26T18:22:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:19 smithi189 ceph-mon[32756]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:22:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:19 smithi156 ceph-mon[32679]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:22:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:19 smithi092 ceph-mon[29156]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:22:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:21 smithi189 ceph-mon[32756]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:21 smithi156 ceph-mon[32679]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:21 smithi092 ceph-mon[29156]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:23 smithi189 ceph-mon[32756]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 239.201083 secs 2024-04-26T18:22:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:23 smithi156 ceph-mon[32679]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 239.201083 secs 2024-04-26T18:22:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:23 smithi092 ceph-mon[29156]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 239.201083 secs 2024-04-26T18:22:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:25 smithi189 ceph-mon[32756]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:25 smithi156 ceph-mon[32679]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:25 smithi092 ceph-mon[29156]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:27 smithi189 ceph-mon[32756]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:27 smithi156 ceph-mon[32679]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:27 smithi092 ceph-mon[29156]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 244.201187 secs 2024-04-26T18:22:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 244.201187 secs 2024-04-26T18:22:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 244.201187 secs 2024-04-26T18:22:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:29 smithi189 ceph-mon[32756]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:29 smithi156 ceph-mon[32679]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:29 smithi092 ceph-mon[29156]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:31 smithi189 ceph-mon[32756]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:31 smithi156 ceph-mon[32679]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:31 smithi092 ceph-mon[29156]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:33 smithi189 ceph-mon[32756]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 249.201267 secs 2024-04-26T18:22:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:33 smithi156 ceph-mon[32679]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 249.201267 secs 2024-04-26T18:22:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:33 smithi092 ceph-mon[29156]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 249.201267 secs 2024-04-26T18:22:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:35 smithi189 ceph-mon[32756]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:35 smithi156 ceph-mon[32679]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:35 smithi092 ceph-mon[29156]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:37 smithi189 ceph-mon[32756]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:37 smithi156 ceph-mon[32679]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:37 smithi092 ceph-mon[29156]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 254.201404 secs 2024-04-26T18:22:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 254.201404 secs 2024-04-26T18:22:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 254.201404 secs 2024-04-26T18:22:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:39 smithi189 ceph-mon[32756]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:39 smithi156 ceph-mon[32679]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:39 smithi092 ceph-mon[29156]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:41 smithi189 ceph-mon[32756]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:41 smithi156 ceph-mon[32679]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:41 smithi092 ceph-mon[29156]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:43 smithi189 ceph-mon[32756]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 259.201538 secs 2024-04-26T18:22:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:43 smithi156 ceph-mon[32679]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 259.201538 secs 2024-04-26T18:22:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:43 smithi092 ceph-mon[29156]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 259.201538 secs 2024-04-26T18:22:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:45 smithi189 ceph-mon[32756]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:45 smithi156 ceph-mon[32679]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:45 smithi092 ceph-mon[29156]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:47 smithi189 ceph-mon[32756]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:47 smithi156 ceph-mon[32679]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:47 smithi092 ceph-mon[29156]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 264.201640 secs 2024-04-26T18:22:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 264.201640 secs 2024-04-26T18:22:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 264.201640 secs 2024-04-26T18:22:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:49 smithi189 ceph-mon[32756]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:49 smithi156 ceph-mon[32679]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:49 smithi092 ceph-mon[29156]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:50 smithi189 ceph-mon[32756]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:50 smithi156 ceph-mon[32679]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:50 smithi092 ceph-mon[29156]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:53 smithi189 ceph-mon[32756]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 269.201774 secs 2024-04-26T18:22:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:53 smithi156 ceph-mon[32679]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 269.201774 secs 2024-04-26T18:22:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:53 smithi092 ceph-mon[29156]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 269.201774 secs 2024-04-26T18:22:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:55 smithi189 ceph-mon[32756]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:55 smithi156 ceph-mon[32679]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:55 smithi092 ceph-mon[29156]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:57 smithi189 ceph-mon[32756]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:57 smithi156 ceph-mon[32679]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:57 smithi092 ceph-mon[29156]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:22:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 274.201887 secs 2024-04-26T18:22:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 274.201887 secs 2024-04-26T18:22:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 274.201887 secs 2024-04-26T18:22:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:22:59 smithi189 ceph-mon[32756]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:22:59 smithi156 ceph-mon[32679]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:22:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:22:59 smithi092 ceph-mon[29156]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:01 smithi189 ceph-mon[32756]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:01 smithi156 ceph-mon[32679]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:01 smithi092 ceph-mon[29156]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:03 smithi189 ceph-mon[32756]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 279.202004 secs 2024-04-26T18:23:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:03 smithi156 ceph-mon[32679]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 279.202004 secs 2024-04-26T18:23:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:03 smithi092 ceph-mon[29156]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 279.202004 secs 2024-04-26T18:23:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:05 smithi189 ceph-mon[32756]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:05 smithi156 ceph-mon[32679]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:05 smithi092 ceph-mon[29156]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:07 smithi189 ceph-mon[32756]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:07 smithi156 ceph-mon[32679]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:07 smithi092 ceph-mon[29156]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 284.202065 secs 2024-04-26T18:23:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 284.202065 secs 2024-04-26T18:23:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 284.202065 secs 2024-04-26T18:23:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:09 smithi189 ceph-mon[32756]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:23:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:09 smithi156 ceph-mon[32679]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:23:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:09 smithi092 ceph-mon[29156]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:23:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:23:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:23:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:23:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:10 smithi189 ceph-mon[32756]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:23:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:10 smithi189 ceph-mon[32756]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:23:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:10 smithi156 ceph-mon[32679]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:23:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:10 smithi156 ceph-mon[32679]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:23:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:10 smithi092 ceph-mon[29156]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:23:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:10 smithi092 ceph-mon[29156]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:23:12.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:12 smithi092 ceph-mon[29156]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:12 smithi189 ceph-mon[32756]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:12 smithi156 ceph-mon[32679]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 289.202169 secs 2024-04-26T18:23:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 289.202169 secs 2024-04-26T18:23:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 289.202169 secs 2024-04-26T18:23:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:14 smithi189 ceph-mon[32756]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:23:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:14 smithi156 ceph-mon[32679]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:23:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:14 smithi092 ceph-mon[29156]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:23:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:16 smithi189 ceph-mon[32756]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:16 smithi156 ceph-mon[32679]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:16 smithi092 ceph-mon[29156]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:18 smithi189 ceph-mon[32756]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 294.202287 secs 2024-04-26T18:23:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:18 smithi156 ceph-mon[32679]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 294.202287 secs 2024-04-26T18:23:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:18 smithi092 ceph-mon[29156]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:23:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 294.202287 secs 2024-04-26T18:23:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:20 smithi189 ceph-mon[32756]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:23:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:20 smithi156 ceph-mon[32679]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:23:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:20 smithi092 ceph-mon[29156]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:23:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:22 smithi189 ceph-mon[32756]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:22 smithi156 ceph-mon[32679]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:22 smithi092 ceph-mon[29156]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 299.202405 secs 2024-04-26T18:23:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 299.202405 secs 2024-04-26T18:23:23.964 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 299.202405 secs 2024-04-26T18:23:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:24 smithi189 ceph-mon[32756]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:24 smithi156 ceph-mon[32679]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:24 smithi092 ceph-mon[29156]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:25 smithi189 ceph-mon[32756]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:25 smithi156 ceph-mon[32679]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:25 smithi092 ceph-mon[29156]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:28 smithi189 ceph-mon[32756]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:28 smithi156 ceph-mon[32679]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:28 smithi092 ceph-mon[29156]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 304.202550 secs 2024-04-26T18:23:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 304.202550 secs 2024-04-26T18:23:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 304.202550 secs 2024-04-26T18:23:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:30 smithi189 ceph-mon[32756]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:30 smithi156 ceph-mon[32679]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:30 smithi092 ceph-mon[29156]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:32 smithi189 ceph-mon[32756]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:32 smithi156 ceph-mon[32679]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:32 smithi092 ceph-mon[29156]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 309.202659 secs 2024-04-26T18:23:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:34 smithi189 ceph-mon[32756]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 309.202659 secs 2024-04-26T18:23:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:34 smithi156 ceph-mon[32679]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 309.202659 secs 2024-04-26T18:23:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:34 smithi092 ceph-mon[29156]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:36 smithi189 ceph-mon[32756]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:36 smithi156 ceph-mon[32679]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:36 smithi092 ceph-mon[29156]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:38 smithi189 ceph-mon[32756]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:38 smithi156 ceph-mon[32679]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:38 smithi092 ceph-mon[29156]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 314.202727 secs 2024-04-26T18:23:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 314.202727 secs 2024-04-26T18:23:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 314.202727 secs 2024-04-26T18:23:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:40 smithi189 ceph-mon[32756]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:40 smithi156 ceph-mon[32679]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:40 smithi092 ceph-mon[29156]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:42 smithi189 ceph-mon[32756]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:42 smithi156 ceph-mon[32679]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:42 smithi092 ceph-mon[29156]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 319.202836 secs 2024-04-26T18:23:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:44 smithi189 ceph-mon[32756]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 319.202836 secs 2024-04-26T18:23:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:44 smithi156 ceph-mon[32679]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 319.202836 secs 2024-04-26T18:23:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:44 smithi092 ceph-mon[29156]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:46 smithi189 ceph-mon[32756]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:46 smithi156 ceph-mon[32679]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:46 smithi092 ceph-mon[29156]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:48 smithi189 ceph-mon[32756]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 324.202935 secs 2024-04-26T18:23:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:48 smithi156 ceph-mon[32679]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 324.202935 secs 2024-04-26T18:23:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:48 smithi092 ceph-mon[29156]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 324.202935 secs 2024-04-26T18:23:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:50 smithi189 ceph-mon[32756]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:50 smithi156 ceph-mon[32679]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:50 smithi092 ceph-mon[29156]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:23:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:52 smithi189 ceph-mon[32756]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:52 smithi156 ceph-mon[32679]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:52 smithi092 ceph-mon[29156]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:23:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 329.203039 secs 2024-04-26T18:23:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 329.203039 secs 2024-04-26T18:23:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 329.203039 secs 2024-04-26T18:23:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:54 smithi189 ceph-mon[32756]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:54 smithi156 ceph-mon[32679]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:54 smithi092 ceph-mon[29156]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:56 smithi189 ceph-mon[32756]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:56 smithi156 ceph-mon[32679]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:56 smithi092 ceph-mon[29156]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:23:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:58 smithi189 ceph-mon[32756]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:23:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 334.203175 secs 2024-04-26T18:23:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:58 smithi156 ceph-mon[32679]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:23:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 334.203175 secs 2024-04-26T18:23:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:58 smithi092 ceph-mon[29156]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:23:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:23:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 334.203175 secs 2024-04-26T18:24:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:00 smithi189 ceph-mon[32756]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:00 smithi156 ceph-mon[32679]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:00 smithi092 ceph-mon[29156]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:02 smithi189 ceph-mon[32756]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:02 smithi156 ceph-mon[32679]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:02 smithi092 ceph-mon[29156]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 339.203329 secs 2024-04-26T18:24:03.784 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 339.203329 secs 2024-04-26T18:24:03.784 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 339.203329 secs 2024-04-26T18:24:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:04 smithi189 ceph-mon[32756]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:04 smithi156 ceph-mon[32679]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:04 smithi092 ceph-mon[29156]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:06 smithi189 ceph-mon[32756]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:06 smithi156 ceph-mon[32679]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:06 smithi092 ceph-mon[29156]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:08 smithi189 ceph-mon[32756]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 344.203445 secs 2024-04-26T18:24:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:08 smithi156 ceph-mon[32679]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 344.203445 secs 2024-04-26T18:24:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:08 smithi092 ceph-mon[29156]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 344.203445 secs 2024-04-26T18:24:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:24:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:10 smithi189 ceph-mon[32756]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:24:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:10 smithi156 ceph-mon[32679]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:24:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:10 smithi092 ceph-mon[29156]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:24:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:24:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:24:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:11 smithi189 ceph-mon[32756]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:24:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:11 smithi189 ceph-mon[32756]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:11 smithi156 ceph-mon[32679]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:24:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:11 smithi156 ceph-mon[32679]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:11 smithi092 ceph-mon[29156]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:24:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:11 smithi092 ceph-mon[29156]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:13 smithi189 ceph-mon[32756]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 349.203567 secs 2024-04-26T18:24:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:13 smithi156 ceph-mon[32679]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 349.203567 secs 2024-04-26T18:24:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:13 smithi092 ceph-mon[29156]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 349.203567 secs 2024-04-26T18:24:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:15 smithi189 ceph-mon[32756]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:24:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:15 smithi156 ceph-mon[32679]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:24:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:15 smithi092 ceph-mon[29156]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:24:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:17 smithi189 ceph-mon[32756]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:17 smithi156 ceph-mon[32679]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:17 smithi092 ceph-mon[29156]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:24:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 354.203652 secs 2024-04-26T18:24:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 354.203652 secs 2024-04-26T18:24:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 354.203652 secs 2024-04-26T18:24:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:19 smithi156 ceph-mon[32679]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:24:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:19 smithi092 ceph-mon[29156]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:24:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:19 smithi189 ceph-mon[32756]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:24:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:21 smithi156 ceph-mon[32679]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:24:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:21 smithi092 ceph-mon[29156]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:24:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:21 smithi189 ceph-mon[32756]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:24:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:23 smithi156 ceph-mon[32679]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 359.203778 secs 2024-04-26T18:24:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:23 smithi092 ceph-mon[29156]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 359.203778 secs 2024-04-26T18:24:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:23 smithi189 ceph-mon[32756]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 359.203778 secs 2024-04-26T18:24:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:25 smithi156 ceph-mon[32679]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:25 smithi092 ceph-mon[29156]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:25 smithi189 ceph-mon[32756]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:27 smithi156 ceph-mon[32679]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:27.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:27 smithi189 ceph-mon[32756]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:27 smithi092 ceph-mon[29156]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:28 smithi156 ceph-mon[32679]: 3 slow requests, 2 included below; oldest blocked for > 364.203896 secs 2024-04-26T18:24:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:28 smithi156 ceph-mon[32679]: slow request 364.135667 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:24:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:28 smithi156 ceph-mon[32679]: slow request 364.203896 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:24:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:28 smithi092 ceph-mon[29156]: 3 slow requests, 2 included below; oldest blocked for > 364.203896 secs 2024-04-26T18:24:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:28 smithi092 ceph-mon[29156]: slow request 364.135667 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:24:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:28 smithi092 ceph-mon[29156]: slow request 364.203896 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:24:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:28 smithi189 ceph-mon[32756]: 3 slow requests, 2 included below; oldest blocked for > 364.203896 secs 2024-04-26T18:24:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:28 smithi189 ceph-mon[32756]: slow request 364.135667 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:24:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:28 smithi189 ceph-mon[32756]: slow request 364.203896 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:24:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:29 smithi156 ceph-mon[32679]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:29 smithi092 ceph-mon[29156]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:29 smithi189 ceph-mon[32756]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:31.416 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:24:31.088+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:31.416 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:24:31.088+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:31.416 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:24:31.088+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:31.416 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:24:31.088+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:31.416 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:24:31.088+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:24:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:31 smithi156 ceph-mon[32679]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:31 smithi092 ceph-mon[29156]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:31 smithi189 ceph-mon[32756]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:33 smithi156 ceph-mon[32679]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 369.204009 secs 2024-04-26T18:24:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:33 smithi092 ceph-mon[29156]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 369.204009 secs 2024-04-26T18:24:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:33 smithi189 ceph-mon[32756]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 369.204009 secs 2024-04-26T18:24:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:35 smithi156 ceph-mon[32679]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:35 smithi092 ceph-mon[29156]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:35 smithi189 ceph-mon[32756]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:24:36.034+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88005880 con 0x7f1cb4108940 2024-04-26T18:24:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:24:36.035+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88005880 con 0x7f1cb4108940 2024-04-26T18:24:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:24:36.055+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c005850 con 0x5617fb906f00 2024-04-26T18:24:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:24:36.055+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c005850 con 0x5617fb906f00 2024-04-26T18:24:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:37 smithi156 ceph-mon[32679]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T18:24:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:37 smithi092 ceph-mon[29156]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T18:24:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:37 smithi189 ceph-mon[32756]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 15 op/s 2024-04-26T18:24:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 374.204126 secs 2024-04-26T18:24:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 374.204126 secs 2024-04-26T18:24:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 374.204126 secs 2024-04-26T18:24:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:39 smithi092 ceph-mon[29156]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:39 smithi189 ceph-mon[32756]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:39 smithi156 ceph-mon[32679]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:41 smithi092 ceph-mon[29156]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T18:24:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:41 smithi189 ceph-mon[32756]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T18:24:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:41 smithi156 ceph-mon[32679]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T18:24:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:43 smithi092 ceph-mon[29156]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 379.204242 secs 2024-04-26T18:24:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:43 smithi189 ceph-mon[32756]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 379.204242 secs 2024-04-26T18:24:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:43 smithi156 ceph-mon[32679]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 379.204242 secs 2024-04-26T18:24:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:45 smithi092 ceph-mon[29156]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:45 smithi189 ceph-mon[32756]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:45 smithi156 ceph-mon[32679]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T18:24:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:47 smithi092 ceph-mon[29156]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:47 smithi189 ceph-mon[32756]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:47 smithi156 ceph-mon[32679]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 384.204322 secs 2024-04-26T18:24:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 384.204322 secs 2024-04-26T18:24:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 384.204322 secs 2024-04-26T18:24:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:49 smithi092 ceph-mon[29156]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:24:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:49 smithi189 ceph-mon[32756]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:24:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:49 smithi156 ceph-mon[32679]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:24:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:51 smithi092 ceph-mon[29156]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:51 smithi189 ceph-mon[32756]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:51 smithi156 ceph-mon[32679]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:24:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:53 smithi092 ceph-mon[29156]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 389.204443 secs 2024-04-26T18:24:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:53 smithi189 ceph-mon[32756]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 389.204443 secs 2024-04-26T18:24:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:53 smithi156 ceph-mon[32679]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 389.204443 secs 2024-04-26T18:24:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:55 smithi092 ceph-mon[29156]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:55 smithi189 ceph-mon[32756]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:55 smithi156 ceph-mon[32679]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:57.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:57 smithi156 ceph-mon[32679]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:57 smithi092 ceph-mon[29156]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:57 smithi189 ceph-mon[32756]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:24:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 394.204575 secs 2024-04-26T18:24:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 394.204575 secs 2024-04-26T18:24:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 394.204575 secs 2024-04-26T18:24:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:24:59 smithi092 ceph-mon[29156]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:24:59 smithi189 ceph-mon[32756]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:24:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:24:59 smithi156 ceph-mon[32679]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:01 smithi092 ceph-mon[29156]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:01 smithi189 ceph-mon[32756]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:01 smithi156 ceph-mon[32679]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:03 smithi092 ceph-mon[29156]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:03 smithi092 ceph-mon[29156]: 3 slow requests, 1 included below; oldest blocked for > 399.204691 secs 2024-04-26T18:25:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:03 smithi092 ceph-mon[29156]: slow request 363.141002 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:25:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:03 smithi189 ceph-mon[32756]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:03 smithi189 ceph-mon[32756]: 3 slow requests, 1 included below; oldest blocked for > 399.204691 secs 2024-04-26T18:25:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:03 smithi189 ceph-mon[32756]: slow request 363.141002 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:25:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:03 smithi156 ceph-mon[32679]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:03 smithi156 ceph-mon[32679]: 3 slow requests, 1 included below; oldest blocked for > 399.204691 secs 2024-04-26T18:25:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:03 smithi156 ceph-mon[32679]: slow request 363.141002 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:25:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:05 smithi092 ceph-mon[29156]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:05 smithi189 ceph-mon[32756]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:05 smithi156 ceph-mon[32679]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:07 smithi092 ceph-mon[29156]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:25:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:07 smithi189 ceph-mon[32756]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:25:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:07 smithi156 ceph-mon[32679]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:25:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 404.204801 secs 2024-04-26T18:25:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 404.204801 secs 2024-04-26T18:25:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 404.204801 secs 2024-04-26T18:25:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:09 smithi092 ceph-mon[29156]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:09 smithi189 ceph-mon[32756]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:09 smithi156 ceph-mon[32679]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:25:11.666 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:11 smithi092 ceph-mon[29156]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:25:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:11 smithi156 ceph-mon[32679]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:25:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:11 smithi189 ceph-mon[32756]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:25:13.567 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:13 smithi156 ceph-mon[32679]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:13.567 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 409.204884 secs 2024-04-26T18:25:13.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:13 smithi092 ceph-mon[29156]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:13.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 409.204884 secs 2024-04-26T18:25:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:13 smithi189 ceph-mon[32756]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 409.204884 secs 2024-04-26T18:25:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:25:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:25:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:25:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:16 smithi189 ceph-mon[32756]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:25:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:16 smithi189 ceph-mon[32756]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:16 smithi156 ceph-mon[32679]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:25:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:16 smithi156 ceph-mon[32679]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:16 smithi092 ceph-mon[29156]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:25:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:16 smithi092 ceph-mon[29156]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:18 smithi189 ceph-mon[32756]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 414.204998 secs 2024-04-26T18:25:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:18 smithi156 ceph-mon[32679]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 414.204998 secs 2024-04-26T18:25:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:18 smithi092 ceph-mon[29156]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 414.204998 secs 2024-04-26T18:25:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:20 smithi189 ceph-mon[32756]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:25:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:20 smithi156 ceph-mon[32679]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:25:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:20 smithi092 ceph-mon[29156]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:25:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:22 smithi189 ceph-mon[32756]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:22 smithi156 ceph-mon[32679]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:22 smithi092 ceph-mon[29156]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:25:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 419.205122 secs 2024-04-26T18:25:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 419.205122 secs 2024-04-26T18:25:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 419.205122 secs 2024-04-26T18:25:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:24 smithi092 ceph-mon[29156]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:25:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:24 smithi189 ceph-mon[32756]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:25:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:24 smithi156 ceph-mon[32679]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:25:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:26 smithi189 ceph-mon[32756]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:25:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:26 smithi156 ceph-mon[32679]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:25:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:26 smithi092 ceph-mon[29156]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:25:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:28 smithi189 ceph-mon[32756]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 424.205235 secs 2024-04-26T18:25:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:28 smithi156 ceph-mon[32679]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 424.205235 secs 2024-04-26T18:25:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:28 smithi092 ceph-mon[29156]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 424.205235 secs 2024-04-26T18:25:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:30 smithi189 ceph-mon[32756]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:30 smithi156 ceph-mon[32679]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:30 smithi092 ceph-mon[29156]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:32 smithi189 ceph-mon[32756]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:32 smithi156 ceph-mon[32679]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:32 smithi092 ceph-mon[29156]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 429.205369 secs 2024-04-26T18:25:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 429.205369 secs 2024-04-26T18:25:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 429.205369 secs 2024-04-26T18:25:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:34 smithi189 ceph-mon[32756]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:34 smithi156 ceph-mon[32679]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:34 smithi092 ceph-mon[29156]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:36 smithi189 ceph-mon[32756]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:36 smithi156 ceph-mon[32679]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:36 smithi092 ceph-mon[29156]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:38 smithi189 ceph-mon[32756]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 434.205510 secs 2024-04-26T18:25:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:38 smithi156 ceph-mon[32679]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 434.205510 secs 2024-04-26T18:25:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:38 smithi092 ceph-mon[29156]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 434.205510 secs 2024-04-26T18:25:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:40 smithi189 ceph-mon[32756]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:40 smithi156 ceph-mon[32679]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:40 smithi092 ceph-mon[29156]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:42 smithi189 ceph-mon[32756]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:42 smithi156 ceph-mon[32679]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:42 smithi092 ceph-mon[29156]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 439.205626 secs 2024-04-26T18:25:43.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 439.205626 secs 2024-04-26T18:25:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 439.205626 secs 2024-04-26T18:25:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:44 smithi189 ceph-mon[32756]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:44 smithi156 ceph-mon[32679]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:44 smithi092 ceph-mon[29156]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:46 smithi189 ceph-mon[32756]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:46 smithi156 ceph-mon[32679]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:46 smithi092 ceph-mon[29156]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:48 smithi189 ceph-mon[32756]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 444.205714 secs 2024-04-26T18:25:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:48 smithi156 ceph-mon[32679]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 444.205714 secs 2024-04-26T18:25:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:48 smithi092 ceph-mon[29156]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 444.205714 secs 2024-04-26T18:25:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:50 smithi189 ceph-mon[32756]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:50 smithi156 ceph-mon[32679]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:50 smithi092 ceph-mon[29156]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:52 smithi189 ceph-mon[32756]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:52 smithi156 ceph-mon[32679]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:52 smithi092 ceph-mon[29156]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 449.205857 secs 2024-04-26T18:25:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 449.205857 secs 2024-04-26T18:25:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 449.205857 secs 2024-04-26T18:25:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:54 smithi189 ceph-mon[32756]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:54 smithi156 ceph-mon[32679]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:54 smithi092 ceph-mon[29156]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:56 smithi189 ceph-mon[32756]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:56 smithi156 ceph-mon[32679]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:56 smithi092 ceph-mon[29156]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:25:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:58 smithi189 ceph-mon[32756]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:25:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 454.205968 secs 2024-04-26T18:25:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:58 smithi156 ceph-mon[32679]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:25:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 454.205968 secs 2024-04-26T18:25:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:58 smithi092 ceph-mon[29156]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:25:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:25:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 454.205968 secs 2024-04-26T18:26:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:00 smithi189 ceph-mon[32756]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:00 smithi156 ceph-mon[32679]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:00 smithi092 ceph-mon[29156]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:02 smithi189 ceph-mon[32756]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:02 smithi156 ceph-mon[32679]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:02 smithi092 ceph-mon[29156]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 459.206086 secs 2024-04-26T18:26:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 459.206086 secs 2024-04-26T18:26:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 459.206086 secs 2024-04-26T18:26:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:04 smithi189 ceph-mon[32756]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:04 smithi156 ceph-mon[32679]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:04 smithi092 ceph-mon[29156]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:06 smithi189 ceph-mon[32756]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:06 smithi156 ceph-mon[32679]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:06 smithi092 ceph-mon[29156]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:08 smithi189 ceph-mon[32756]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 464.206203 secs 2024-04-26T18:26:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:08 smithi156 ceph-mon[32679]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 464.206203 secs 2024-04-26T18:26:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:08 smithi092 ceph-mon[29156]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 464.206203 secs 2024-04-26T18:26:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:09 smithi189 ceph-mon[32756]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:09 smithi156 ceph-mon[32679]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:09 smithi092 ceph-mon[29156]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:11 smithi189 ceph-mon[32756]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:11 smithi156 ceph-mon[32679]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:11 smithi092 ceph-mon[29156]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:13 smithi189 ceph-mon[32756]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 469.206340 secs 2024-04-26T18:26:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:13 smithi156 ceph-mon[32679]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 469.206340 secs 2024-04-26T18:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:13 smithi092 ceph-mon[29156]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 469.206340 secs 2024-04-26T18:26:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:15 smithi189 ceph-mon[32756]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:15 smithi156 ceph-mon[32679]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:15 smithi092 ceph-mon[29156]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:26:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:17 smithi189 ceph-mon[32756]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:17 smithi156 ceph-mon[32679]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:17 smithi092 ceph-mon[29156]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:19.077 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 474.206479 secs 2024-04-26T18:26:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 474.206479 secs 2024-04-26T18:26:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 474.206479 secs 2024-04-26T18:26:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T18:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:26:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T18:26:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-26T18:26:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:26:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:22 smithi092 ceph-mon[29156]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:22 smithi189 ceph-mon[32756]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:22 smithi156 ceph-mon[32679]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 479.206595 secs 2024-04-26T18:26:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:24 smithi092 ceph-mon[29156]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 479.206595 secs 2024-04-26T18:26:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:24 smithi189 ceph-mon[32756]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 479.206595 secs 2024-04-26T18:26:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:24 smithi156 ceph-mon[32679]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:26:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:26 smithi092 ceph-mon[29156]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:26 smithi189 ceph-mon[32756]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:26 smithi156 ceph-mon[32679]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:28.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:28 smithi156 ceph-mon[32679]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:28 smithi092 ceph-mon[29156]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:28 smithi189 ceph-mon[32756]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:26:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 484.206719 secs 2024-04-26T18:26:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 484.206719 secs 2024-04-26T18:26:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 484.206719 secs 2024-04-26T18:26:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:30 smithi092 ceph-mon[29156]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:26:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:30 smithi189 ceph-mon[32756]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:26:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:30 smithi156 ceph-mon[32679]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:26:32.460 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:32 smithi092 ceph-mon[29156]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:32 smithi189 ceph-mon[32756]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:32 smithi156 ceph-mon[32679]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 489.206819 secs 2024-04-26T18:26:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:34 smithi092 ceph-mon[29156]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 489.206819 secs 2024-04-26T18:26:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:34 smithi189 ceph-mon[32756]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 489.206819 secs 2024-04-26T18:26:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:34 smithi156 ceph-mon[32679]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:36 smithi092 ceph-mon[29156]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:36 smithi189 ceph-mon[32756]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:36 smithi156 ceph-mon[32679]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:38 smithi092 ceph-mon[29156]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:38 smithi189 ceph-mon[32756]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:38 smithi156 ceph-mon[32679]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 494.206931 secs 2024-04-26T18:26:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 494.206931 secs 2024-04-26T18:26:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 494.206931 secs 2024-04-26T18:26:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:40 smithi092 ceph-mon[29156]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:40 smithi189 ceph-mon[32756]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:40 smithi156 ceph-mon[32679]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:42 smithi092 ceph-mon[29156]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:42 smithi189 ceph-mon[32756]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:42 smithi156 ceph-mon[32679]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 499.207044 secs 2024-04-26T18:26:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:44 smithi092 ceph-mon[29156]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 499.207044 secs 2024-04-26T18:26:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:44 smithi189 ceph-mon[32756]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 499.207044 secs 2024-04-26T18:26:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:44 smithi156 ceph-mon[32679]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:46 smithi092 ceph-mon[29156]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:46 smithi189 ceph-mon[32756]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:46 smithi156 ceph-mon[32679]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:48 smithi092 ceph-mon[29156]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:48 smithi189 ceph-mon[32756]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:48 smithi156 ceph-mon[32679]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 504.207163 secs 2024-04-26T18:26:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 504.207163 secs 2024-04-26T18:26:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 504.207163 secs 2024-04-26T18:26:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:50 smithi092 ceph-mon[29156]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:50 smithi189 ceph-mon[32756]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:50 smithi156 ceph-mon[32679]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:26:51.053+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88005b80 con 0x7f1cb4108940 2024-04-26T18:26:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:26:51.053+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88005b80 con 0x7f1cb4108940 2024-04-26T18:26:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:26:51.071+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c005b30 con 0x5617fb906f00 2024-04-26T18:26:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:26:51.072+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c005b30 con 0x5617fb906f00 2024-04-26T18:26:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:52 smithi189 ceph-mon[32756]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:52 smithi156 ceph-mon[32679]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:52 smithi092 ceph-mon[29156]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 509.207290 secs 2024-04-26T18:26:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:54 smithi189 ceph-mon[32756]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 509.207290 secs 2024-04-26T18:26:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:54 smithi156 ceph-mon[32679]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 509.207290 secs 2024-04-26T18:26:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:54 smithi092 ceph-mon[29156]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:56 smithi189 ceph-mon[32756]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:56 smithi156 ceph-mon[32679]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:56 smithi092 ceph-mon[29156]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:26:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:58 smithi189 ceph-mon[32756]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:58 smithi156 ceph-mon[32679]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:58 smithi092 ceph-mon[29156]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:26:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:26:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 514.207391 secs 2024-04-26T18:26:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:26:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 514.207391 secs 2024-04-26T18:26:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:26:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 514.207391 secs 2024-04-26T18:27:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:00 smithi189 ceph-mon[32756]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:00 smithi156 ceph-mon[32679]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:00 smithi092 ceph-mon[29156]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:02 smithi189 ceph-mon[32756]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:02 smithi156 ceph-mon[32679]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:02 smithi092 ceph-mon[29156]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 519.207491 secs 2024-04-26T18:27:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:04 smithi189 ceph-mon[32756]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 519.207491 secs 2024-04-26T18:27:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:04 smithi156 ceph-mon[32679]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 519.207491 secs 2024-04-26T18:27:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:04 smithi092 ceph-mon[29156]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:06 smithi189 ceph-mon[32756]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:06 smithi156 ceph-mon[32679]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:06 smithi092 ceph-mon[29156]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:08 smithi189 ceph-mon[32756]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:08 smithi156 ceph-mon[32679]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:08 smithi092 ceph-mon[29156]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 524.207611 secs 2024-04-26T18:27:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 524.207611 secs 2024-04-26T18:27:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 524.207611 secs 2024-04-26T18:27:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:10 smithi189 ceph-mon[32756]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:10 smithi156 ceph-mon[32679]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:10 smithi092 ceph-mon[29156]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:12 smithi189 ceph-mon[32756]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:12 smithi156 ceph-mon[32679]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:12 smithi092 ceph-mon[29156]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:14.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 529.207726 secs 2024-04-26T18:27:14.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:14 smithi092 ceph-mon[29156]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 529.207726 secs 2024-04-26T18:27:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:14 smithi189 ceph-mon[32756]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 529.207726 secs 2024-04-26T18:27:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:14 smithi156 ceph-mon[32679]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:16 smithi189 ceph-mon[32756]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:16 smithi156 ceph-mon[32679]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:16 smithi092 ceph-mon[29156]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:18 smithi189 ceph-mon[32756]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:18 smithi156 ceph-mon[32679]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:18 smithi092 ceph-mon[29156]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 534.207859 secs 2024-04-26T18:27:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 534.207859 secs 2024-04-26T18:27:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 534.207859 secs 2024-04-26T18:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:20 smithi189 ceph-mon[32756]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:27:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:20 smithi156 ceph-mon[32679]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:27:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:20 smithi092 ceph-mon[29156]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:27:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:27:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:27:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:27:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:21 smithi189 ceph-mon[32756]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:21 smithi156 ceph-mon[32679]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:21 smithi092 ceph-mon[29156]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:23 smithi189 ceph-mon[32756]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:23 smithi156 ceph-mon[32679]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:23 smithi092 ceph-mon[29156]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 539.207962 secs 2024-04-26T18:27:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 539.207962 secs 2024-04-26T18:27:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 539.207962 secs 2024-04-26T18:27:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:25 smithi189 ceph-mon[32756]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-04-26T18:27:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:25 smithi156 ceph-mon[32679]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-04-26T18:27:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:25 smithi092 ceph-mon[29156]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4 op/s 2024-04-26T18:27:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:27 smithi189 ceph-mon[32756]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:27 smithi156 ceph-mon[32679]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:27 smithi092 ceph-mon[29156]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:29 smithi189 ceph-mon[32756]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 544.208043 secs 2024-04-26T18:27:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:29 smithi156 ceph-mon[32679]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 544.208043 secs 2024-04-26T18:27:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:29 smithi092 ceph-mon[29156]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:27:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 544.208043 secs 2024-04-26T18:27:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:31 smithi189 ceph-mon[32756]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:31 smithi156 ceph-mon[32679]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:31 smithi092 ceph-mon[29156]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:27:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:33 smithi189 ceph-mon[32756]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:33 smithi156 ceph-mon[32679]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:33 smithi092 ceph-mon[29156]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 549.208154 secs 2024-04-26T18:27:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 549.208154 secs 2024-04-26T18:27:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 549.208154 secs 2024-04-26T18:27:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:35 smithi189 ceph-mon[32756]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:35 smithi156 ceph-mon[32679]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:35 smithi092 ceph-mon[29156]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:27:36.059+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88005ee0 con 0x7f1cb4108940 2024-04-26T18:27:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:27:36.059+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88005ee0 con 0x7f1cb4108940 2024-04-26T18:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:27:36.078+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c005e30 con 0x5617fb906f00 2024-04-26T18:27:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:27:36.078+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c005e30 con 0x5617fb906f00 2024-04-26T18:27:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:37 smithi189 ceph-mon[32756]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:37 smithi156 ceph-mon[32679]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:37 smithi092 ceph-mon[29156]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 554.208272 secs 2024-04-26T18:27:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 554.208272 secs 2024-04-26T18:27:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 554.208272 secs 2024-04-26T18:27:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:39 smithi189 ceph-mon[32756]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:39 smithi156 ceph-mon[32679]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:39 smithi092 ceph-mon[29156]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:41 smithi189 ceph-mon[32756]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:41 smithi156 ceph-mon[32679]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:41 smithi092 ceph-mon[29156]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:43 smithi189 ceph-mon[32756]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 559.208351 secs 2024-04-26T18:27:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:43 smithi156 ceph-mon[32679]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 559.208351 secs 2024-04-26T18:27:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:43 smithi092 ceph-mon[29156]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:43.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 559.208351 secs 2024-04-26T18:27:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:45 smithi189 ceph-mon[32756]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:45 smithi156 ceph-mon[32679]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:45 smithi092 ceph-mon[29156]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:47 smithi189 ceph-mon[32756]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:47 smithi156 ceph-mon[32679]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:47 smithi092 ceph-mon[29156]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 564.208467 secs 2024-04-26T18:27:48.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 564.208467 secs 2024-04-26T18:27:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 564.208467 secs 2024-04-26T18:27:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:49 smithi189 ceph-mon[32756]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:49 smithi156 ceph-mon[32679]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:49 smithi092 ceph-mon[29156]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:50 smithi092 ceph-mon[29156]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:50 smithi189 ceph-mon[32756]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:50 smithi156 ceph-mon[32679]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:53 smithi189 ceph-mon[32756]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:53 smithi156 ceph-mon[32679]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:53 smithi092 ceph-mon[29156]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 569.208594 secs 2024-04-26T18:27:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 569.208594 secs 2024-04-26T18:27:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 569.208594 secs 2024-04-26T18:27:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:55 smithi189 ceph-mon[32756]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:55 smithi156 ceph-mon[32679]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:55 smithi092 ceph-mon[29156]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:57 smithi189 ceph-mon[32756]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:57 smithi156 ceph-mon[32679]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:57 smithi092 ceph-mon[29156]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:27:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:59 smithi189 ceph-mon[32756]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:27:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 574.208721 secs 2024-04-26T18:27:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:59 smithi156 ceph-mon[32679]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:27:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 574.208721 secs 2024-04-26T18:27:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:59 smithi092 ceph-mon[29156]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:27:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:27:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 574.208721 secs 2024-04-26T18:28:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:01 smithi189 ceph-mon[32756]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:01 smithi156 ceph-mon[32679]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:01 smithi092 ceph-mon[29156]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:03 smithi189 ceph-mon[32756]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:03 smithi156 ceph-mon[32679]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:03 smithi092 ceph-mon[29156]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 579.208865 secs 2024-04-26T18:28:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 579.208865 secs 2024-04-26T18:28:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 579.208865 secs 2024-04-26T18:28:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:05 smithi189 ceph-mon[32756]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:05 smithi156 ceph-mon[32679]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:05 smithi092 ceph-mon[29156]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:07 smithi189 ceph-mon[32756]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:07 smithi156 ceph-mon[32679]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:07 smithi092 ceph-mon[29156]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:09 smithi189 ceph-mon[32756]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 584.208983 secs 2024-04-26T18:28:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:09 smithi156 ceph-mon[32679]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:09.652 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 584.208983 secs 2024-04-26T18:28:09.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:09 smithi092 ceph-mon[29156]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:09.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 584.208983 secs 2024-04-26T18:28:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:10 smithi092 ceph-mon[29156]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:10 smithi189 ceph-mon[32756]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:10 smithi156 ceph-mon[32679]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:13 smithi189 ceph-mon[32756]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:13 smithi156 ceph-mon[32679]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:13 smithi092 ceph-mon[29156]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 589.209107 secs 2024-04-26T18:28:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 589.209107 secs 2024-04-26T18:28:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 589.209107 secs 2024-04-26T18:28:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:15 smithi189 ceph-mon[32756]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:15.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:15 smithi092 ceph-mon[29156]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:15 smithi156 ceph-mon[32679]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:17 smithi189 ceph-mon[32756]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:17 smithi156 ceph-mon[32679]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:17 smithi092 ceph-mon[29156]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:19 smithi092 ceph-mon[29156]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 594.209236 secs 2024-04-26T18:28:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:19 smithi189 ceph-mon[32756]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 594.209236 secs 2024-04-26T18:28:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:19 smithi156 ceph-mon[32679]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 594.209236 secs 2024-04-26T18:28:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:21 smithi189 ceph-mon[32756]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:21 smithi156 ceph-mon[32679]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:21 smithi092 ceph-mon[29156]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:28:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:22 smithi189 ceph-mon[32756]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:28:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:22 smithi189 ceph-mon[32756]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:22 smithi156 ceph-mon[32679]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:28:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:22 smithi156 ceph-mon[32679]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:22 smithi092 ceph-mon[29156]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:28:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:22 smithi092 ceph-mon[29156]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:24 smithi189 ceph-mon[32756]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:28:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 599.209378 secs 2024-04-26T18:28:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:24 smithi156 ceph-mon[32679]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:28:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 599.209378 secs 2024-04-26T18:28:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:24 smithi092 ceph-mon[29156]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:28:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 599.209378 secs 2024-04-26T18:28:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:26 smithi189 ceph-mon[32756]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:26 smithi156 ceph-mon[32679]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:26 smithi092 ceph-mon[29156]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:28 smithi189 ceph-mon[32756]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:28 smithi156 ceph-mon[32679]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:28 smithi092 ceph-mon[29156]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:28:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 604.209451 secs 2024-04-26T18:28:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 604.209451 secs 2024-04-26T18:28:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 604.209451 secs 2024-04-26T18:28:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:30 smithi189 ceph-mon[32756]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:30 smithi156 ceph-mon[32679]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:30 smithi092 ceph-mon[29156]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:28:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:32 smithi189 ceph-mon[32756]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:28:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:32 smithi156 ceph-mon[32679]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:28:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:32 smithi092 ceph-mon[29156]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:28:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:34 smithi189 ceph-mon[32756]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 609.209586 secs 2024-04-26T18:28:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:34 smithi156 ceph-mon[32679]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 609.209586 secs 2024-04-26T18:28:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:34 smithi092 ceph-mon[29156]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 609.209586 secs 2024-04-26T18:28:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:36 smithi189 ceph-mon[32756]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:36 smithi156 ceph-mon[32679]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:36 smithi092 ceph-mon[29156]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:38 smithi189 ceph-mon[32756]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:38 smithi156 ceph-mon[32679]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:38 smithi092 ceph-mon[29156]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 614.209708 secs 2024-04-26T18:28:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 614.209708 secs 2024-04-26T18:28:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 614.209708 secs 2024-04-26T18:28:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:40 smithi156 ceph-mon[32679]: pgmap v974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:40 smithi092 ceph-mon[29156]: pgmap v974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:40 smithi189 ceph-mon[32756]: pgmap v974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:42 smithi156 ceph-mon[32679]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:42 smithi092 ceph-mon[29156]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:42 smithi189 ceph-mon[32756]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:44 smithi156 ceph-mon[32679]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 619.209849 secs 2024-04-26T18:28:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:44 smithi092 ceph-mon[29156]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 619.209849 secs 2024-04-26T18:28:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:44 smithi189 ceph-mon[32756]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 619.209849 secs 2024-04-26T18:28:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:46 smithi156 ceph-mon[32679]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:46 smithi092 ceph-mon[29156]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:46 smithi189 ceph-mon[32756]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:48 smithi156 ceph-mon[32679]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:48 smithi092 ceph-mon[29156]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:48 smithi189 ceph-mon[32756]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 624.209964 secs 2024-04-26T18:28:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 624.209964 secs 2024-04-26T18:28:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 624.209964 secs 2024-04-26T18:28:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:50 smithi156 ceph-mon[32679]: pgmap v979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:50 smithi092 ceph-mon[29156]: pgmap v979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:50 smithi189 ceph-mon[32756]: pgmap v979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:52 smithi156 ceph-mon[32679]: pgmap v980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:52 smithi092 ceph-mon[29156]: pgmap v980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:52 smithi189 ceph-mon[32756]: pgmap v980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:54 smithi156 ceph-mon[32679]: pgmap v981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 629.210080 secs 2024-04-26T18:28:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:54 smithi092 ceph-mon[29156]: pgmap v981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 629.210080 secs 2024-04-26T18:28:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:54 smithi189 ceph-mon[32756]: pgmap v981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 629.210080 secs 2024-04-26T18:28:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:56 smithi156 ceph-mon[32679]: pgmap v982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:56 smithi092 ceph-mon[29156]: pgmap v982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:56 smithi189 ceph-mon[32756]: pgmap v982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:28:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:58 smithi156 ceph-mon[32679]: pgmap v983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:58 smithi092 ceph-mon[29156]: pgmap v983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:58 smithi189 ceph-mon[32756]: pgmap v983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:28:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:28:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 634.210193 secs 2024-04-26T18:28:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:28:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 634.210193 secs 2024-04-26T18:28:59.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:28:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 634.210193 secs 2024-04-26T18:29:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:00 smithi092 ceph-mon[29156]: pgmap v984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:00 smithi189 ceph-mon[32756]: pgmap v984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:00 smithi156 ceph-mon[32679]: pgmap v984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:02 smithi092 ceph-mon[29156]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:02 smithi189 ceph-mon[32756]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:02 smithi156 ceph-mon[32679]: pgmap v985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:04 smithi092 ceph-mon[29156]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 639.210296 secs 2024-04-26T18:29:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:04 smithi189 ceph-mon[32756]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 639.210296 secs 2024-04-26T18:29:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:04 smithi156 ceph-mon[32679]: pgmap v986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 639.210296 secs 2024-04-26T18:29:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:06 smithi092 ceph-mon[29156]: pgmap v987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:06 smithi189 ceph-mon[32756]: pgmap v987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:06 smithi156 ceph-mon[32679]: pgmap v987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:08 smithi092 ceph-mon[29156]: pgmap v988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:08 smithi189 ceph-mon[32756]: pgmap v988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:08 smithi156 ceph-mon[32679]: pgmap v988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 644.210431 secs 2024-04-26T18:29:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 644.210431 secs 2024-04-26T18:29:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 644.210431 secs 2024-04-26T18:29:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:10 smithi092 ceph-mon[29156]: pgmap v989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:10 smithi189 ceph-mon[32756]: pgmap v989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:10 smithi156 ceph-mon[32679]: pgmap v989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:12 smithi092 ceph-mon[29156]: pgmap v990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:12 smithi189 ceph-mon[32756]: pgmap v990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:12 smithi156 ceph-mon[32679]: pgmap v990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:14 smithi092 ceph-mon[29156]: pgmap v991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 649.210567 secs 2024-04-26T18:29:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:14 smithi189 ceph-mon[32756]: pgmap v991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 649.210567 secs 2024-04-26T18:29:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:14 smithi156 ceph-mon[32679]: pgmap v991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 649.210567 secs 2024-04-26T18:29:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:16 smithi092 ceph-mon[29156]: pgmap v992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:16 smithi189 ceph-mon[32756]: pgmap v992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:16 smithi156 ceph-mon[32679]: pgmap v992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:18 smithi092 ceph-mon[29156]: pgmap v993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:18 smithi189 ceph-mon[32756]: pgmap v993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:18 smithi156 ceph-mon[32679]: pgmap v993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 654.210677 secs 2024-04-26T18:29:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 654.210677 secs 2024-04-26T18:29:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 654.210677 secs 2024-04-26T18:29:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:20 smithi092 ceph-mon[29156]: pgmap v994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:20 smithi189 ceph-mon[32756]: pgmap v994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:20 smithi156 ceph-mon[32679]: pgmap v994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:29:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: pgmap v995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: pgmap v996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:29:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: pgmap v997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:29:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: pgmap v995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: pgmap v996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:29:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: pgmap v997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:29:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: pgmap v995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:29:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:29:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: pgmap v996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:29:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: pgmap v997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:29:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 659.210796 secs 2024-04-26T18:29:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 659.210796 secs 2024-04-26T18:29:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 659.210796 secs 2024-04-26T18:29:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:24 smithi156 ceph-mon[32679]: pgmap v998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:24 smithi092 ceph-mon[29156]: pgmap v998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:24 smithi189 ceph-mon[32756]: pgmap v998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:29:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:26 smithi189 ceph-mon[32756]: pgmap v999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:26 smithi156 ceph-mon[32679]: pgmap v999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:26 smithi092 ceph-mon[29156]: pgmap v999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:27 smithi156 ceph-mon[32679]: pgmap v1000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:27 smithi092 ceph-mon[29156]: pgmap v1000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:27 smithi189 ceph-mon[32756]: pgmap v1000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 664.210914 secs 2024-04-26T18:29:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 664.210914 secs 2024-04-26T18:29:29.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 664.210914 secs 2024-04-26T18:29:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:29 smithi092 ceph-mon[29156]: pgmap v1001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:29 smithi189 ceph-mon[32756]: pgmap v1001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:29 smithi156 ceph-mon[32679]: pgmap v1001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:32 smithi189 ceph-mon[32756]: pgmap v1002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:29:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:32 smithi156 ceph-mon[32679]: pgmap v1002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:29:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:32 smithi092 ceph-mon[29156]: pgmap v1002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:29:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 669.210993 secs 2024-04-26T18:29:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:33 smithi189 ceph-mon[32756]: pgmap v1003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 669.210993 secs 2024-04-26T18:29:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:33 smithi156 ceph-mon[32679]: pgmap v1003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 669.210993 secs 2024-04-26T18:29:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:33 smithi092 ceph-mon[29156]: pgmap v1003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:36 smithi189 ceph-mon[32756]: pgmap v1004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:36 smithi156 ceph-mon[32679]: pgmap v1004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:36 smithi092 ceph-mon[29156]: pgmap v1004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:37 smithi189 ceph-mon[32756]: pgmap v1005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:37.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:37 smithi092 ceph-mon[29156]: pgmap v1005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:37 smithi156 ceph-mon[32679]: pgmap v1005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 674.211074 secs 2024-04-26T18:29:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 674.211074 secs 2024-04-26T18:29:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 674.211074 secs 2024-04-26T18:29:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:39 smithi156 ceph-mon[32679]: pgmap v1006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:39 smithi092 ceph-mon[29156]: pgmap v1006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:39 smithi189 ceph-mon[32756]: pgmap v1006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:41 smithi156 ceph-mon[32679]: pgmap v1007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:41 smithi092 ceph-mon[29156]: pgmap v1007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:41 smithi189 ceph-mon[32756]: pgmap v1007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 679.211185 secs 2024-04-26T18:29:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 679.211185 secs 2024-04-26T18:29:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 679.211185 secs 2024-04-26T18:29:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:44 smithi156 ceph-mon[32679]: pgmap v1008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:44 smithi092 ceph-mon[29156]: pgmap v1008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:44 smithi189 ceph-mon[32756]: pgmap v1008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:45 smithi156 ceph-mon[32679]: pgmap v1009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:45 smithi092 ceph-mon[29156]: pgmap v1009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:45 smithi189 ceph-mon[32756]: pgmap v1009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:47 smithi156 ceph-mon[32679]: pgmap v1010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:47 smithi092 ceph-mon[29156]: pgmap v1010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:47 smithi189 ceph-mon[32756]: pgmap v1010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T18:29:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 684.211322 secs 2024-04-26T18:29:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 684.211322 secs 2024-04-26T18:29:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 684.211322 secs 2024-04-26T18:29:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:49 smithi092 ceph-mon[29156]: pgmap v1011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:49 smithi189 ceph-mon[32756]: pgmap v1011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:49 smithi156 ceph-mon[32679]: pgmap v1011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:29:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:51 smithi092 ceph-mon[29156]: pgmap v1012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:51 smithi189 ceph-mon[32756]: pgmap v1012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:51 smithi156 ceph-mon[32679]: pgmap v1012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 689.211461 secs 2024-04-26T18:29:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 689.211461 secs 2024-04-26T18:29:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 689.211461 secs 2024-04-26T18:29:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:54 smithi156 ceph-mon[32679]: pgmap v1013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:54 smithi092 ceph-mon[29156]: pgmap v1013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:54 smithi189 ceph-mon[32756]: pgmap v1013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:29:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:55 smithi092 ceph-mon[29156]: pgmap v1014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:55 smithi189 ceph-mon[32756]: pgmap v1014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:55 smithi156 ceph-mon[32679]: pgmap v1014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:57 smithi092 ceph-mon[29156]: pgmap v1015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:57 smithi189 ceph-mon[32756]: pgmap v1015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:57 smithi156 ceph-mon[32679]: pgmap v1015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:29:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 694.211546 secs 2024-04-26T18:29:59.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 694.211546 secs 2024-04-26T18:29:59.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 694.211546 secs 2024-04-26T18:29:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:29:59 smithi092 ceph-mon[29156]: pgmap v1016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:29:59 smithi189 ceph-mon[32756]: pgmap v1016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:29:59 smithi156 ceph-mon[32679]: pgmap v1016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-26T18:30:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.j on smithi092 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.d on smithi092 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.k on smithi156 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.h on smithi156 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.l on smithi189 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.c on smithi189 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T18:30:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:00 smithi092 ceph-mon[29156]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:30:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-26T18:30:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.j on smithi092 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.d on smithi092 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.k on smithi156 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.h on smithi156 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.l on smithi189 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.c on smithi189 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T18:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:00 smithi189 ceph-mon[32756]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:30:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-26T18:30:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.j on smithi092 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.d on smithi092 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.k on smithi156 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.h on smithi156 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.l on smithi189 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.c on smithi189 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-26T18:30:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:00 smithi156 ceph-mon[32679]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:30:01.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:30:01.139+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:30:01.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:30:01.139+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:30:01.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:30:01.139+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:30:01.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:30:01.139+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:30:01.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:30:01.139+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:30:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:01 smithi092 ceph-mon[29156]: pgmap v1017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:01 smithi189 ceph-mon[32756]: pgmap v1017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:01 smithi156 ceph-mon[32679]: pgmap v1017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 699.211664 secs 2024-04-26T18:30:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 699.211664 secs 2024-04-26T18:30:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 699.211664 secs 2024-04-26T18:30:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:04 smithi156 ceph-mon[32679]: pgmap v1018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:04 smithi092 ceph-mon[29156]: pgmap v1018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:04 smithi189 ceph-mon[32756]: pgmap v1018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:05 smithi092 ceph-mon[29156]: pgmap v1019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:05 smithi189 ceph-mon[32756]: pgmap v1019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:05 smithi156 ceph-mon[32679]: pgmap v1019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:07 smithi092 ceph-mon[29156]: pgmap v1020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:07 smithi189 ceph-mon[32756]: pgmap v1020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:07 smithi156 ceph-mon[32679]: pgmap v1020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 704.211798 secs 2024-04-26T18:30:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 704.211798 secs 2024-04-26T18:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 704.211798 secs 2024-04-26T18:30:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:09 smithi092 ceph-mon[29156]: pgmap v1021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:09 smithi189 ceph-mon[32756]: pgmap v1021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:09 smithi156 ceph-mon[32679]: pgmap v1021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:11 smithi092 ceph-mon[29156]: pgmap v1022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:11 smithi189 ceph-mon[32756]: pgmap v1022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:11 smithi156 ceph-mon[32679]: pgmap v1022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:30:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 709.211891 secs 2024-04-26T18:30:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 709.211891 secs 2024-04-26T18:30:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 709.211891 secs 2024-04-26T18:30:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:14 smithi156 ceph-mon[32679]: pgmap v1023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:14 smithi092 ceph-mon[29156]: pgmap v1023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:14 smithi189 ceph-mon[32756]: pgmap v1023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:30:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:15 smithi092 ceph-mon[29156]: pgmap v1024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:15 smithi189 ceph-mon[32756]: pgmap v1024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:15 smithi156 ceph-mon[32679]: pgmap v1024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:17 smithi092 ceph-mon[29156]: pgmap v1025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:17 smithi189 ceph-mon[32756]: pgmap v1025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:17 smithi156 ceph-mon[32679]: pgmap v1025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 714.212011 secs 2024-04-26T18:30:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 714.212011 secs 2024-04-26T18:30:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 714.212011 secs 2024-04-26T18:30:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:19 smithi092 ceph-mon[29156]: pgmap v1026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:19 smithi189 ceph-mon[32756]: pgmap v1026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:19 smithi156 ceph-mon[32679]: pgmap v1026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:21 smithi092 ceph-mon[29156]: pgmap v1027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:21 smithi189 ceph-mon[32756]: pgmap v1027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:21 smithi156 ceph-mon[32679]: pgmap v1027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:30:23.294 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.294 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 719.212078 secs 2024-04-26T18:30:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:24 smithi092 ceph-mon[29156]: pgmap v1028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 719.212078 secs 2024-04-26T18:30:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:24 smithi189 ceph-mon[32756]: pgmap v1028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 719.212078 secs 2024-04-26T18:30:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:24 smithi156 ceph-mon[32679]: pgmap v1028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: pgmap v1029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: pgmap v1029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: pgmap v1029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:30:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: pgmap v1030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:27 smithi189 ceph-mon[32756]: pgmap v1031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:30:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:30:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:30:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: pgmap v1030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:27 smithi156 ceph-mon[32679]: pgmap v1031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: pgmap v1030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:27 smithi092 ceph-mon[29156]: pgmap v1031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:29 smithi189 ceph-mon[32756]: pgmap v1032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:29 smithi189 ceph-mon[32756]: 3 slow requests, 2 included below; oldest blocked for > 724.212205 secs 2024-04-26T18:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:29 smithi189 ceph-mon[32756]: slow request 724.143975 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:29 smithi189 ceph-mon[32756]: slow request 724.212204 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:29 smithi156 ceph-mon[32679]: pgmap v1032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:29 smithi156 ceph-mon[32679]: 3 slow requests, 2 included below; oldest blocked for > 724.212205 secs 2024-04-26T18:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:29 smithi156 ceph-mon[32679]: slow request 724.143975 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:29 smithi156 ceph-mon[32679]: slow request 724.212204 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:30:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:29 smithi092 ceph-mon[29156]: pgmap v1032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:29 smithi092 ceph-mon[29156]: 3 slow requests, 2 included below; oldest blocked for > 724.212205 secs 2024-04-26T18:30:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:29 smithi092 ceph-mon[29156]: slow request 724.143975 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:30:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:29 smithi092 ceph-mon[29156]: slow request 724.212204 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:30:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:31 smithi189 ceph-mon[32756]: pgmap v1033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:31.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:31 smithi156 ceph-mon[32679]: pgmap v1033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:31 smithi092 ceph-mon[29156]: pgmap v1033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:33 smithi189 ceph-mon[32756]: pgmap v1034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:33 smithi156 ceph-mon[32679]: pgmap v1034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:33 smithi092 ceph-mon[29156]: pgmap v1034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:30:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 729.212319 secs 2024-04-26T18:30:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 729.212319 secs 2024-04-26T18:30:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 729.212319 secs 2024-04-26T18:30:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:35 smithi189 ceph-mon[32756]: pgmap v1035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:35 smithi156 ceph-mon[32679]: pgmap v1035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:35 smithi092 ceph-mon[29156]: pgmap v1035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:30:36.085+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006160 con 0x7f1cb4108940 2024-04-26T18:30:36.085 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:30:36.085+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006160 con 0x7f1cb4108940 2024-04-26T18:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:30:36.101+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006050 con 0x5617fb906f00 2024-04-26T18:30:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:30:36.101+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006050 con 0x5617fb906f00 2024-04-26T18:30:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:37 smithi189 ceph-mon[32756]: pgmap v1036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:37 smithi156 ceph-mon[32679]: pgmap v1036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:37 smithi092 ceph-mon[29156]: pgmap v1036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:30:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:39 smithi189 ceph-mon[32756]: pgmap v1037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 734.212412 secs 2024-04-26T18:30:39.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:39 smithi092 ceph-mon[29156]: pgmap v1037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:39.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 734.212412 secs 2024-04-26T18:30:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:39 smithi156 ceph-mon[32679]: pgmap v1037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 734.212412 secs 2024-04-26T18:30:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:41 smithi156 ceph-mon[32679]: pgmap v1038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:41 smithi189 ceph-mon[32756]: pgmap v1038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:41 smithi092 ceph-mon[29156]: pgmap v1038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:43 smithi189 ceph-mon[32756]: pgmap v1039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:43 smithi156 ceph-mon[32679]: pgmap v1039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:43 smithi092 ceph-mon[29156]: pgmap v1039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 739.212523 secs 2024-04-26T18:30:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 739.212523 secs 2024-04-26T18:30:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 739.212523 secs 2024-04-26T18:30:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:45 smithi189 ceph-mon[32756]: pgmap v1040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:45 smithi156 ceph-mon[32679]: pgmap v1040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:45 smithi092 ceph-mon[29156]: pgmap v1040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:47 smithi189 ceph-mon[32756]: pgmap v1041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:47 smithi156 ceph-mon[32679]: pgmap v1041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:47 smithi092 ceph-mon[29156]: pgmap v1041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:49 smithi189 ceph-mon[32756]: pgmap v1042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 744.212643 secs 2024-04-26T18:30:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:49 smithi156 ceph-mon[32679]: pgmap v1042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 744.212643 secs 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:49 smithi092 ceph-mon[29156]: pgmap v1042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 744.212643 secs 2024-04-26T18:30:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:51 smithi189 ceph-mon[32756]: pgmap v1043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:51 smithi156 ceph-mon[32679]: pgmap v1043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:51 smithi092 ceph-mon[29156]: pgmap v1043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:53 smithi189 ceph-mon[32756]: pgmap v1044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:53 smithi156 ceph-mon[32679]: pgmap v1044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:53 smithi092 ceph-mon[29156]: pgmap v1044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 749.212765 secs 2024-04-26T18:30:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 749.212765 secs 2024-04-26T18:30:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 749.212765 secs 2024-04-26T18:30:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:55 smithi189 ceph-mon[32756]: pgmap v1045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:55 smithi156 ceph-mon[32679]: pgmap v1045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:55 smithi092 ceph-mon[29156]: pgmap v1045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:30:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:57 smithi189 ceph-mon[32756]: pgmap v1046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:57 smithi156 ceph-mon[32679]: pgmap v1046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:57 smithi092 ceph-mon[29156]: pgmap v1046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:59 smithi189 ceph-mon[32756]: pgmap v1047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:30:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 754.212883 secs 2024-04-26T18:30:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:59 smithi156 ceph-mon[32679]: pgmap v1047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:30:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 754.212883 secs 2024-04-26T18:30:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:59 smithi092 ceph-mon[29156]: pgmap v1047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:30:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:30:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 754.212883 secs 2024-04-26T18:31:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:01 smithi189 ceph-mon[32756]: pgmap v1048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:01 smithi156 ceph-mon[32679]: pgmap v1048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:01 smithi092 ceph-mon[29156]: pgmap v1048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:03 smithi189 ceph-mon[32756]: pgmap v1049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:03 smithi156 ceph-mon[32679]: pgmap v1049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:03 smithi092 ceph-mon[29156]: pgmap v1049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:04 smithi189 ceph-mon[32756]: 3 slow requests, 1 included below; oldest blocked for > 759.213005 secs 2024-04-26T18:31:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:04 smithi189 ceph-mon[32756]: slow request 723.149315 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:31:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:04 smithi156 ceph-mon[32679]: 3 slow requests, 1 included below; oldest blocked for > 759.213005 secs 2024-04-26T18:31:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:04 smithi156 ceph-mon[32679]: slow request 723.149315 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:31:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:04 smithi092 ceph-mon[29156]: 3 slow requests, 1 included below; oldest blocked for > 759.213005 secs 2024-04-26T18:31:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:04 smithi092 ceph-mon[29156]: slow request 723.149315 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:31:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:05 smithi189 ceph-mon[32756]: pgmap v1050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:05 smithi156 ceph-mon[32679]: pgmap v1050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:05 smithi092 ceph-mon[29156]: pgmap v1050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:07 smithi189 ceph-mon[32756]: pgmap v1051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:07 smithi156 ceph-mon[32679]: pgmap v1051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:07 smithi092 ceph-mon[29156]: pgmap v1051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 764.213073 secs 2024-04-26T18:31:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 764.213073 secs 2024-04-26T18:31:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 764.213073 secs 2024-04-26T18:31:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:09 smithi189 ceph-mon[32756]: pgmap v1052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:09 smithi156 ceph-mon[32679]: pgmap v1052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:09 smithi092 ceph-mon[29156]: pgmap v1052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:11 smithi189 ceph-mon[32756]: pgmap v1053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:11 smithi156 ceph-mon[32679]: pgmap v1053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:11 smithi092 ceph-mon[29156]: pgmap v1053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:13 smithi156 ceph-mon[32679]: pgmap v1054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 769.213212 secs 2024-04-26T18:31:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:13 smithi092 ceph-mon[29156]: pgmap v1054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 769.213212 secs 2024-04-26T18:31:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:13 smithi189 ceph-mon[32756]: pgmap v1054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 769.213212 secs 2024-04-26T18:31:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:15 smithi156 ceph-mon[32679]: pgmap v1055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:15 smithi092 ceph-mon[29156]: pgmap v1055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:15 smithi189 ceph-mon[32756]: pgmap v1055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:17 smithi156 ceph-mon[32679]: pgmap v1056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:17 smithi092 ceph-mon[29156]: pgmap v1056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:17 smithi189 ceph-mon[32756]: pgmap v1056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 774.213315 secs 2024-04-26T18:31:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 774.213315 secs 2024-04-26T18:31:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 774.213315 secs 2024-04-26T18:31:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:19 smithi156 ceph-mon[32679]: pgmap v1057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:19 smithi092 ceph-mon[29156]: pgmap v1057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:19 smithi189 ceph-mon[32756]: pgmap v1057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:21 smithi156 ceph-mon[32679]: pgmap v1058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:21 smithi092 ceph-mon[29156]: pgmap v1058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:21 smithi189 ceph-mon[32756]: pgmap v1058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:23 smithi156 ceph-mon[32679]: pgmap v1059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 779.213454 secs 2024-04-26T18:31:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:23 smithi092 ceph-mon[29156]: pgmap v1059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 779.213454 secs 2024-04-26T18:31:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:23 smithi189 ceph-mon[32756]: pgmap v1059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 779.213454 secs 2024-04-26T18:31:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:25 smithi156 ceph-mon[32679]: pgmap v1060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:25 smithi092 ceph-mon[29156]: pgmap v1060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:25 smithi189 ceph-mon[32756]: pgmap v1060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:31:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: pgmap v1061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: pgmap v1062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:31:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: pgmap v1063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:31:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: pgmap v1061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: pgmap v1062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:31:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: pgmap v1063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:31:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: pgmap v1061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:31:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:31:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: pgmap v1062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:31:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: pgmap v1063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:31:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 784.213528 secs 2024-04-26T18:31:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 784.213528 secs 2024-04-26T18:31:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 784.213528 secs 2024-04-26T18:31:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:29 smithi156 ceph-mon[32679]: pgmap v1064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:29 smithi092 ceph-mon[29156]: pgmap v1064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:29.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:29 smithi189 ceph-mon[32756]: pgmap v1064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:31 smithi189 ceph-mon[32756]: pgmap v1065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:31 smithi156 ceph-mon[32679]: pgmap v1065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:31 smithi092 ceph-mon[29156]: pgmap v1065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:33 smithi189 ceph-mon[32756]: pgmap v1066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 789.213640 secs 2024-04-26T18:31:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:33 smithi156 ceph-mon[32679]: pgmap v1066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 789.213640 secs 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:33 smithi092 ceph-mon[29156]: pgmap v1066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:31:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 789.213640 secs 2024-04-26T18:31:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:35 smithi189 ceph-mon[32756]: pgmap v1067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:35 smithi156 ceph-mon[32679]: pgmap v1067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:35 smithi092 ceph-mon[29156]: pgmap v1067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:31:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:37 smithi189 ceph-mon[32756]: pgmap v1068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:31:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:37 smithi156 ceph-mon[32679]: pgmap v1068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:31:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:37 smithi092 ceph-mon[29156]: pgmap v1068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:31:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 794.213794 secs 2024-04-26T18:31:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 794.213794 secs 2024-04-26T18:31:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 794.213794 secs 2024-04-26T18:31:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:39 smithi189 ceph-mon[32756]: pgmap v1069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:39 smithi156 ceph-mon[32679]: pgmap v1069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:39 smithi092 ceph-mon[29156]: pgmap v1069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:41 smithi189 ceph-mon[32756]: pgmap v1070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:41 smithi156 ceph-mon[32679]: pgmap v1070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:41 smithi092 ceph-mon[29156]: pgmap v1070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:43 smithi189 ceph-mon[32756]: pgmap v1071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 799.213943 secs 2024-04-26T18:31:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:43 smithi156 ceph-mon[32679]: pgmap v1071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 799.213943 secs 2024-04-26T18:31:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:43 smithi092 ceph-mon[29156]: pgmap v1071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 799.213943 secs 2024-04-26T18:31:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:45 smithi189 ceph-mon[32756]: pgmap v1072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:45 smithi156 ceph-mon[32679]: pgmap v1072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:45 smithi092 ceph-mon[29156]: pgmap v1072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:47 smithi189 ceph-mon[32756]: pgmap v1073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:47 smithi156 ceph-mon[32679]: pgmap v1073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:47 smithi092 ceph-mon[29156]: pgmap v1073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 804.214062 secs 2024-04-26T18:31:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 804.214062 secs 2024-04-26T18:31:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 804.214062 secs 2024-04-26T18:31:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:49 smithi189 ceph-mon[32756]: pgmap v1074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:49 smithi156 ceph-mon[32679]: pgmap v1074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:49 smithi092 ceph-mon[29156]: pgmap v1074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:51 smithi189 ceph-mon[32756]: pgmap v1075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:51 smithi156 ceph-mon[32679]: pgmap v1075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:51 smithi092 ceph-mon[29156]: pgmap v1075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:53 smithi189 ceph-mon[32756]: pgmap v1076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 809.214179 secs 2024-04-26T18:31:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:53 smithi156 ceph-mon[32679]: pgmap v1076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 809.214179 secs 2024-04-26T18:31:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:53 smithi092 ceph-mon[29156]: pgmap v1076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 809.214179 secs 2024-04-26T18:31:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:55 smithi189 ceph-mon[32756]: pgmap v1077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:55 smithi156 ceph-mon[32679]: pgmap v1077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:55 smithi092 ceph-mon[29156]: pgmap v1077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:57 smithi189 ceph-mon[32756]: pgmap v1078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:57 smithi156 ceph-mon[32679]: pgmap v1078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:57 smithi092 ceph-mon[29156]: pgmap v1078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:31:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 814.214299 secs 2024-04-26T18:31:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 814.214299 secs 2024-04-26T18:31:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 814.214299 secs 2024-04-26T18:31:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:31:59 smithi189 ceph-mon[32756]: pgmap v1079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:31:59 smithi156 ceph-mon[32679]: pgmap v1079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:31:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:31:59 smithi092 ceph-mon[29156]: pgmap v1079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:01 smithi189 ceph-mon[32756]: pgmap v1080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:01 smithi156 ceph-mon[32679]: pgmap v1080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:01 smithi092 ceph-mon[29156]: pgmap v1080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:03 smithi189 ceph-mon[32756]: pgmap v1081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 819.214418 secs 2024-04-26T18:32:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:03 smithi156 ceph-mon[32679]: pgmap v1081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 819.214418 secs 2024-04-26T18:32:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:03 smithi092 ceph-mon[29156]: pgmap v1081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 819.214418 secs 2024-04-26T18:32:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:05 smithi189 ceph-mon[32756]: pgmap v1082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:05 smithi156 ceph-mon[32679]: pgmap v1082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:05 smithi092 ceph-mon[29156]: pgmap v1082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:07 smithi189 ceph-mon[32756]: pgmap v1083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:07 smithi156 ceph-mon[32679]: pgmap v1083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:07 smithi092 ceph-mon[29156]: pgmap v1083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 824.214534 secs 2024-04-26T18:32:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 824.214534 secs 2024-04-26T18:32:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 824.214534 secs 2024-04-26T18:32:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:09 smithi156 ceph-mon[32679]: pgmap v1084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:09 smithi092 ceph-mon[29156]: pgmap v1084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:09 smithi189 ceph-mon[32756]: pgmap v1084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:10 smithi189 ceph-mon[32756]: pgmap v1085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:10 smithi156 ceph-mon[32679]: pgmap v1085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:10 smithi092 ceph-mon[29156]: pgmap v1085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:13 smithi189 ceph-mon[32756]: pgmap v1086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 829.214657 secs 2024-04-26T18:32:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:13 smithi156 ceph-mon[32679]: pgmap v1086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 829.214657 secs 2024-04-26T18:32:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:13 smithi092 ceph-mon[29156]: pgmap v1086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 829.214657 secs 2024-04-26T18:32:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:15 smithi189 ceph-mon[32756]: pgmap v1087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:15 smithi156 ceph-mon[32679]: pgmap v1087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:15 smithi092 ceph-mon[29156]: pgmap v1087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:17 smithi189 ceph-mon[32756]: pgmap v1088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:17 smithi156 ceph-mon[32679]: pgmap v1088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:17 smithi092 ceph-mon[29156]: pgmap v1088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 834.214754 secs 2024-04-26T18:32:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 834.214754 secs 2024-04-26T18:32:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 834.214754 secs 2024-04-26T18:32:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:19 smithi189 ceph-mon[32756]: pgmap v1089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:19 smithi156 ceph-mon[32679]: pgmap v1089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:19 smithi092 ceph-mon[29156]: pgmap v1089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:21 smithi189 ceph-mon[32756]: pgmap v1090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:21 smithi156 ceph-mon[32679]: pgmap v1090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:21 smithi092 ceph-mon[29156]: pgmap v1090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:23 smithi189 ceph-mon[32756]: pgmap v1091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 839.214881 secs 2024-04-26T18:32:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:23 smithi156 ceph-mon[32679]: pgmap v1091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 839.214881 secs 2024-04-26T18:32:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:23 smithi092 ceph-mon[29156]: pgmap v1091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 839.214881 secs 2024-04-26T18:32:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:25 smithi189 ceph-mon[32756]: pgmap v1092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:25 smithi156 ceph-mon[32679]: pgmap v1092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:25 smithi092 ceph-mon[29156]: pgmap v1092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:27 smithi189 ceph-mon[32756]: pgmap v1093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:27 smithi156 ceph-mon[32679]: pgmap v1093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:27 smithi092 ceph-mon[29156]: pgmap v1093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:32:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:28 smithi189 ceph-mon[32756]: pgmap v1094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:32:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:28 smithi189 ceph-mon[32756]: pgmap v1095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 844.215002 secs 2024-04-26T18:32:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:28 smithi156 ceph-mon[32679]: pgmap v1094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:32:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:28 smithi156 ceph-mon[32679]: pgmap v1095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 844.215002 secs 2024-04-26T18:32:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:28 smithi092 ceph-mon[29156]: pgmap v1094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:32:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:28 smithi092 ceph-mon[29156]: pgmap v1095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 844.215002 secs 2024-04-26T18:32:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:30 smithi189 ceph-mon[32756]: pgmap v1096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:30 smithi156 ceph-mon[32679]: pgmap v1096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:30 smithi092 ceph-mon[29156]: pgmap v1096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:32 smithi189 ceph-mon[32756]: pgmap v1097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:32 smithi156 ceph-mon[32679]: pgmap v1097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:32 smithi092 ceph-mon[29156]: pgmap v1097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 849.215121 secs 2024-04-26T18:32:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 849.215121 secs 2024-04-26T18:32:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 849.215121 secs 2024-04-26T18:32:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:34 smithi189 ceph-mon[32756]: pgmap v1098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:34 smithi156 ceph-mon[32679]: pgmap v1098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:34 smithi092 ceph-mon[29156]: pgmap v1098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:32:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:36 smithi189 ceph-mon[32756]: pgmap v1099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:36 smithi156 ceph-mon[32679]: pgmap v1099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:36 smithi092 ceph-mon[29156]: pgmap v1099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:32:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:38 smithi189 ceph-mon[32756]: pgmap v1100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:32:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 854.215243 secs 2024-04-26T18:32:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:38 smithi156 ceph-mon[32679]: pgmap v1100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:32:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 854.215243 secs 2024-04-26T18:32:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:38 smithi092 ceph-mon[29156]: pgmap v1100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:32:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 854.215243 secs 2024-04-26T18:32:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:40 smithi156 ceph-mon[32679]: pgmap v1101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:40 smithi092 ceph-mon[29156]: pgmap v1101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:40 smithi189 ceph-mon[32756]: pgmap v1101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:42 smithi156 ceph-mon[32679]: pgmap v1102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:42 smithi092 ceph-mon[29156]: pgmap v1102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:42 smithi189 ceph-mon[32756]: pgmap v1102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 859.215310 secs 2024-04-26T18:32:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 859.215310 secs 2024-04-26T18:32:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 859.215310 secs 2024-04-26T18:32:44.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:44 smithi092 ceph-mon[29156]: pgmap v1103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:44 smithi156 ceph-mon[32679]: pgmap v1103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:44 smithi189 ceph-mon[32756]: pgmap v1103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:46 smithi156 ceph-mon[32679]: pgmap v1104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:46 smithi092 ceph-mon[29156]: pgmap v1104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:46 smithi189 ceph-mon[32756]: pgmap v1104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:48 smithi156 ceph-mon[32679]: pgmap v1105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 864.215445 secs 2024-04-26T18:32:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:48 smithi092 ceph-mon[29156]: pgmap v1105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 864.215445 secs 2024-04-26T18:32:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:48 smithi189 ceph-mon[32756]: pgmap v1105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 864.215445 secs 2024-04-26T18:32:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:50 smithi156 ceph-mon[32679]: pgmap v1106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:50 smithi092 ceph-mon[29156]: pgmap v1106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:50 smithi189 ceph-mon[32756]: pgmap v1106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:52 smithi156 ceph-mon[32679]: pgmap v1107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:52 smithi092 ceph-mon[29156]: pgmap v1107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:52 smithi189 ceph-mon[32756]: pgmap v1107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 869.215582 secs 2024-04-26T18:32:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:53 smithi156 ceph-mon[32679]: pgmap v1108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 869.215582 secs 2024-04-26T18:32:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:53 smithi092 ceph-mon[29156]: pgmap v1108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 869.215582 secs 2024-04-26T18:32:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:53 smithi189 ceph-mon[32756]: pgmap v1108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:56 smithi189 ceph-mon[32756]: pgmap v1109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:56 smithi156 ceph-mon[32679]: pgmap v1109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:56 smithi092 ceph-mon[29156]: pgmap v1109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:32:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:58 smithi189 ceph-mon[32756]: pgmap v1110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:58 smithi156 ceph-mon[32679]: pgmap v1110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:58 smithi092 ceph-mon[29156]: pgmap v1110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:32:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:32:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 874.215685 secs 2024-04-26T18:32:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:32:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 874.215685 secs 2024-04-26T18:32:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:32:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 874.215685 secs 2024-04-26T18:33:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:00 smithi189 ceph-mon[32756]: pgmap v1111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:00 smithi156 ceph-mon[32679]: pgmap v1111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:00 smithi092 ceph-mon[29156]: pgmap v1111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:02 smithi189 ceph-mon[32756]: pgmap v1112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:02 smithi156 ceph-mon[32679]: pgmap v1112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:02 smithi092 ceph-mon[29156]: pgmap v1112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 879.215809 secs 2024-04-26T18:33:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:04 smithi189 ceph-mon[32756]: pgmap v1113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:04 smithi189 ceph-mon[32756]: 1 slow requests, 1 included below; oldest blocked for > 182.202867 secs 2024-04-26T18:33:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:04 smithi189 ceph-mon[32756]: slow request 182.202866 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T18:33:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 879.215809 secs 2024-04-26T18:33:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:04 smithi156 ceph-mon[32679]: pgmap v1113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:04 smithi156 ceph-mon[32679]: 1 slow requests, 1 included below; oldest blocked for > 182.202867 secs 2024-04-26T18:33:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:04 smithi156 ceph-mon[32679]: slow request 182.202866 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T18:33:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 879.215809 secs 2024-04-26T18:33:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:04 smithi092 ceph-mon[29156]: pgmap v1113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:04 smithi092 ceph-mon[29156]: 1 slow requests, 1 included below; oldest blocked for > 182.202867 secs 2024-04-26T18:33:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:04 smithi092 ceph-mon[29156]: slow request 182.202866 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T18:33:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:06 smithi189 ceph-mon[32756]: pgmap v1114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:06 smithi156 ceph-mon[32679]: pgmap v1114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:06 smithi092 ceph-mon[29156]: pgmap v1114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:07 smithi156 ceph-mon[32679]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:33:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:33:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:33:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:07 smithi092 ceph-mon[29156]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:33:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:33:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:33:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:07 smithi189 ceph-mon[32756]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-26T18:33:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:33:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:33:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:08 smithi092 ceph-mon[29156]: pgmap v1115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 884.215921 secs 2024-04-26T18:33:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:08 smithi189 ceph-mon[32756]: pgmap v1115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 884.215921 secs 2024-04-26T18:33:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:08 smithi156 ceph-mon[32679]: pgmap v1115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 884.215921 secs 2024-04-26T18:33:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 187.202937 secs 2024-04-26T18:33:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 187.202937 secs 2024-04-26T18:33:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 187.202937 secs 2024-04-26T18:33:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:10 smithi092 ceph-mon[29156]: pgmap v1116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:10 smithi189 ceph-mon[32756]: pgmap v1116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:10 smithi156 ceph-mon[32679]: pgmap v1116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:12 smithi092 ceph-mon[29156]: pgmap v1117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:12 smithi189 ceph-mon[32756]: pgmap v1117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:12 smithi156 ceph-mon[32679]: pgmap v1117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 889.216055 secs 2024-04-26T18:33:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 889.216055 secs 2024-04-26T18:33:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 889.216055 secs 2024-04-26T18:33:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:14 smithi092 ceph-mon[29156]: pgmap v1118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 192.203035 secs 2024-04-26T18:33:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:14 smithi189 ceph-mon[32756]: pgmap v1118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 192.203035 secs 2024-04-26T18:33:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:14 smithi156 ceph-mon[32679]: pgmap v1118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:33:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 192.203035 secs 2024-04-26T18:33:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:16 smithi092 ceph-mon[29156]: pgmap v1119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:16 smithi189 ceph-mon[32756]: pgmap v1119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:16 smithi156 ceph-mon[32679]: pgmap v1119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:33:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:18 smithi092 ceph-mon[29156]: pgmap v1120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 894.216146 secs 2024-04-26T18:33:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:18 smithi189 ceph-mon[32756]: pgmap v1120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 894.216146 secs 2024-04-26T18:33:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:18 smithi156 ceph-mon[32679]: pgmap v1120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 894.216146 secs 2024-04-26T18:33:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 197.203157 secs 2024-04-26T18:33:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 197.203157 secs 2024-04-26T18:33:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 197.203157 secs 2024-04-26T18:33:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:20 smithi092 ceph-mon[29156]: pgmap v1121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:20 smithi189 ceph-mon[32756]: pgmap v1121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:20 smithi156 ceph-mon[32679]: pgmap v1121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:22 smithi092 ceph-mon[29156]: pgmap v1122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:22 smithi189 ceph-mon[32756]: pgmap v1122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:22 smithi156 ceph-mon[32679]: pgmap v1122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 899.216265 secs 2024-04-26T18:33:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 202.203307 secs 2024-04-26T18:33:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 899.216265 secs 2024-04-26T18:33:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 202.203307 secs 2024-04-26T18:33:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 899.216265 secs 2024-04-26T18:33:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 202.203307 secs 2024-04-26T18:33:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:24 smithi092 ceph-mon[29156]: pgmap v1123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:24 smithi189 ceph-mon[32756]: pgmap v1123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:24 smithi156 ceph-mon[32679]: pgmap v1123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:26 smithi092 ceph-mon[29156]: pgmap v1124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:26 smithi189 ceph-mon[32756]: pgmap v1124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:26 smithi156 ceph-mon[32679]: pgmap v1124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:33:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: pgmap v1125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 904.216332 secs 2024-04-26T18:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 207.203395 secs 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: pgmap v1125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 904.216332 secs 2024-04-26T18:33:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 207.203395 secs 2024-04-26T18:33:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: pgmap v1125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:33:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:33:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:33:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 904.216332 secs 2024-04-26T18:33:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 207.203395 secs 2024-04-26T18:33:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:29 smithi189 ceph-mon[32756]: pgmap v1126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:33:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:29 smithi189 ceph-mon[32756]: pgmap v1127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:33:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:29 smithi156 ceph-mon[32679]: pgmap v1126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:33:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:29 smithi156 ceph-mon[32679]: pgmap v1127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:33:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:29 smithi092 ceph-mon[29156]: pgmap v1126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:33:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:29 smithi092 ceph-mon[29156]: pgmap v1127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:33:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:31 smithi189 ceph-mon[32756]: pgmap v1128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:31 smithi156 ceph-mon[32679]: pgmap v1128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:31 smithi092 ceph-mon[29156]: pgmap v1128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:33 smithi189 ceph-mon[32756]: pgmap v1129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 909.216458 secs 2024-04-26T18:33:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 212.203472 secs 2024-04-26T18:33:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:33 smithi156 ceph-mon[32679]: pgmap v1129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 909.216458 secs 2024-04-26T18:33:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 212.203472 secs 2024-04-26T18:33:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:33 smithi092 ceph-mon[29156]: pgmap v1129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 909.216458 secs 2024-04-26T18:33:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 212.203472 secs 2024-04-26T18:33:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:35 smithi189 ceph-mon[32756]: pgmap v1130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:35 smithi156 ceph-mon[32679]: pgmap v1130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1cb37fe640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000023) for more than 900000000 us, fault. 2024-04-26T18:33:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1cb37fe640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0a6280 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0ce2a0 tx=0x7f1cac0bd040 comp rx=0 tx=0).stop 2024-04-26T18:33:35.990 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0a6280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:33:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0a6280 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:33:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:33:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:35.991 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:35.990+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca806c000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:33:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:35 smithi092 ceph-mon[29156]: pgmap v1130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T18:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=SESSION_RECONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-04-26T18:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=SESSION_RECONNECTING pgs=520 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-04-26T18:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1c96ff5640 0 client.16836 ms_handle_remote_reset on v2:172.21.15.156:6838/2836729853 2024-04-26T18:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.016+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T18:33:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.107+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006380 con 0x7f1cb4108940 2024-04-26T18:33:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.108+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006380 con 0x7f1cb4108940 2024-04-26T18:33:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.121+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0062c0 con 0x5617fb906f00 2024-04-26T18:33:36.122 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:33:36.122+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0062c0 con 0x5617fb906f00 2024-04-26T18:33:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:37 smithi189 ceph-mon[32756]: pgmap v1131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:37 smithi156 ceph-mon[32679]: pgmap v1131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:37 smithi092 ceph-mon[29156]: pgmap v1131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:33:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 914.216591 secs 2024-04-26T18:33:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 217.203549 secs 2024-04-26T18:33:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 914.216591 secs 2024-04-26T18:33:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 217.203549 secs 2024-04-26T18:33:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 914.216591 secs 2024-04-26T18:33:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 217.203549 secs 2024-04-26T18:33:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:39 smithi189 ceph-mon[32756]: pgmap v1132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:33:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:39 smithi156 ceph-mon[32679]: pgmap v1132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:33:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:39 smithi092 ceph-mon[29156]: pgmap v1132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:33:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:41 smithi189 ceph-mon[32756]: pgmap v1133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:41 smithi156 ceph-mon[32679]: pgmap v1133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:41 smithi092 ceph-mon[29156]: pgmap v1133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:43 smithi189 ceph-mon[32756]: pgmap v1134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 919.216712 secs 2024-04-26T18:33:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 222.203617 secs 2024-04-26T18:33:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:43 smithi156 ceph-mon[32679]: pgmap v1134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 919.216712 secs 2024-04-26T18:33:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 222.203617 secs 2024-04-26T18:33:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:43 smithi092 ceph-mon[29156]: pgmap v1134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 919.216712 secs 2024-04-26T18:33:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 222.203617 secs 2024-04-26T18:33:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:45 smithi189 ceph-mon[32756]: pgmap v1135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:45 smithi156 ceph-mon[32679]: pgmap v1135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:45 smithi092 ceph-mon[29156]: pgmap v1135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:47 smithi189 ceph-mon[32756]: pgmap v1136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:47 smithi156 ceph-mon[32679]: pgmap v1136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:47 smithi092 ceph-mon[29156]: pgmap v1136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 924.216854 secs 2024-04-26T18:33:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 227.203686 secs 2024-04-26T18:33:48.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 924.216854 secs 2024-04-26T18:33:48.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 227.203686 secs 2024-04-26T18:33:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 924.216854 secs 2024-04-26T18:33:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 227.203686 secs 2024-04-26T18:33:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:49 smithi189 ceph-mon[32756]: pgmap v1137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:49 smithi156 ceph-mon[32679]: pgmap v1137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:49 smithi092 ceph-mon[29156]: pgmap v1137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:51 smithi189 ceph-mon[32756]: pgmap v1138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:51 smithi156 ceph-mon[32679]: pgmap v1138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:51 smithi092 ceph-mon[29156]: pgmap v1138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:53 smithi189 ceph-mon[32756]: pgmap v1139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 929.216968 secs 2024-04-26T18:33:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 232.203755 secs 2024-04-26T18:33:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:53 smithi156 ceph-mon[32679]: pgmap v1139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 929.216968 secs 2024-04-26T18:33:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 232.203755 secs 2024-04-26T18:33:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:53 smithi092 ceph-mon[29156]: pgmap v1139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 929.216968 secs 2024-04-26T18:33:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 232.203755 secs 2024-04-26T18:33:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:55 smithi189 ceph-mon[32756]: pgmap v1140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:55 smithi156 ceph-mon[32679]: pgmap v1140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:55 smithi092 ceph-mon[29156]: pgmap v1140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:33:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:57 smithi189 ceph-mon[32756]: pgmap v1141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:57 smithi156 ceph-mon[32679]: pgmap v1141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:57 smithi092 ceph-mon[29156]: pgmap v1141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 934.217049 secs 2024-04-26T18:33:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 237.203815 secs 2024-04-26T18:33:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 934.217049 secs 2024-04-26T18:33:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 237.203815 secs 2024-04-26T18:33:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 934.217049 secs 2024-04-26T18:33:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 237.203815 secs 2024-04-26T18:33:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:33:59 smithi189 ceph-mon[32756]: pgmap v1142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:33:59 smithi156 ceph-mon[32679]: pgmap v1142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:33:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:33:59 smithi092 ceph-mon[29156]: pgmap v1142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:01 smithi189 ceph-mon[32756]: pgmap v1143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:01.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:01 smithi092 ceph-mon[29156]: pgmap v1143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:01 smithi156 ceph-mon[32679]: pgmap v1143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:03 smithi189 ceph-mon[32756]: pgmap v1144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 939.217162 secs 2024-04-26T18:34:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 242.203890 secs 2024-04-26T18:34:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:03 smithi156 ceph-mon[32679]: pgmap v1144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 939.217162 secs 2024-04-26T18:34:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 242.203890 secs 2024-04-26T18:34:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:03 smithi092 ceph-mon[29156]: pgmap v1144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 939.217162 secs 2024-04-26T18:34:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 242.203890 secs 2024-04-26T18:34:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:05 smithi189 ceph-mon[32756]: pgmap v1145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:05 smithi156 ceph-mon[32679]: pgmap v1145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:05 smithi092 ceph-mon[29156]: pgmap v1145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:07 smithi189 ceph-mon[32756]: pgmap v1146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:07 smithi156 ceph-mon[32679]: pgmap v1146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:07 smithi092 ceph-mon[29156]: pgmap v1146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 944.217279 secs 2024-04-26T18:34:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 247.203974 secs 2024-04-26T18:34:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 944.217279 secs 2024-04-26T18:34:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 247.203974 secs 2024-04-26T18:34:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 944.217279 secs 2024-04-26T18:34:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 247.203974 secs 2024-04-26T18:34:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:09 smithi189 ceph-mon[32756]: pgmap v1147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:09 smithi156 ceph-mon[32679]: pgmap v1147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:09 smithi092 ceph-mon[29156]: pgmap v1147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:11 smithi189 ceph-mon[32756]: pgmap v1148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:11 smithi156 ceph-mon[32679]: pgmap v1148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:11 smithi092 ceph-mon[29156]: pgmap v1148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:13 smithi189 ceph-mon[32756]: pgmap v1149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 949.217406 secs 2024-04-26T18:34:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 252.204069 secs 2024-04-26T18:34:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:13 smithi156 ceph-mon[32679]: pgmap v1149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 949.217406 secs 2024-04-26T18:34:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 252.204069 secs 2024-04-26T18:34:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:13 smithi092 ceph-mon[29156]: pgmap v1149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 949.217406 secs 2024-04-26T18:34:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 252.204069 secs 2024-04-26T18:34:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:15 smithi189 ceph-mon[32756]: pgmap v1150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:15 smithi156 ceph-mon[32679]: pgmap v1150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:15 smithi092 ceph-mon[29156]: pgmap v1150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:17 smithi189 ceph-mon[32756]: pgmap v1151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:17 smithi156 ceph-mon[32679]: pgmap v1151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:17 smithi092 ceph-mon[29156]: pgmap v1151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 954.217546 secs 2024-04-26T18:34:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 257.204138 secs 2024-04-26T18:34:18.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 954.217546 secs 2024-04-26T18:34:18.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 257.204138 secs 2024-04-26T18:34:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 954.217546 secs 2024-04-26T18:34:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 257.204138 secs 2024-04-26T18:34:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:19 smithi189 ceph-mon[32756]: pgmap v1152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:19 smithi156 ceph-mon[32679]: pgmap v1152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:19 smithi092 ceph-mon[29156]: pgmap v1152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:21 smithi189 ceph-mon[32756]: pgmap v1153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:21 smithi156 ceph-mon[32679]: pgmap v1153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:21 smithi092 ceph-mon[29156]: pgmap v1153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:23 smithi189 ceph-mon[32756]: pgmap v1154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 959.217660 secs 2024-04-26T18:34:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 262.204208 secs 2024-04-26T18:34:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:23 smithi156 ceph-mon[32679]: pgmap v1154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 959.217660 secs 2024-04-26T18:34:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 262.204208 secs 2024-04-26T18:34:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:23 smithi092 ceph-mon[29156]: pgmap v1154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 959.217660 secs 2024-04-26T18:34:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 262.204208 secs 2024-04-26T18:34:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:25 smithi189 ceph-mon[32756]: pgmap v1155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:25 smithi156 ceph-mon[32679]: pgmap v1155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:25 smithi092 ceph-mon[29156]: pgmap v1155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:27 smithi189 ceph-mon[32756]: pgmap v1156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:27 smithi156 ceph-mon[32679]: pgmap v1156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:27 smithi092 ceph-mon[29156]: pgmap v1156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 964.217797 secs 2024-04-26T18:34:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 267.204272 secs 2024-04-26T18:34:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 964.217797 secs 2024-04-26T18:34:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 267.204272 secs 2024-04-26T18:34:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 964.217797 secs 2024-04-26T18:34:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:34:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 267.204272 secs 2024-04-26T18:34:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:29 smithi189 ceph-mon[32756]: pgmap v1157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:34:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:29 smithi156 ceph-mon[32679]: pgmap v1157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:34:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:29 smithi092 ceph-mon[29156]: pgmap v1157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:34:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:34:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:34:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:30 smithi189 ceph-mon[32756]: pgmap v1158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:34:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:30 smithi189 ceph-mon[32756]: pgmap v1159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:30 smithi156 ceph-mon[32679]: pgmap v1158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:34:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:30 smithi156 ceph-mon[32679]: pgmap v1159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:30 smithi092 ceph-mon[29156]: pgmap v1158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:34:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:30 smithi092 ceph-mon[29156]: pgmap v1159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:32 smithi189 ceph-mon[32756]: pgmap v1160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:32 smithi156 ceph-mon[32679]: pgmap v1160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:32 smithi092 ceph-mon[29156]: pgmap v1160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 969.217900 secs 2024-04-26T18:34:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 272.204344 secs 2024-04-26T18:34:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 969.217900 secs 2024-04-26T18:34:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 272.204344 secs 2024-04-26T18:34:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 969.217900 secs 2024-04-26T18:34:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 272.204344 secs 2024-04-26T18:34:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:34 smithi189 ceph-mon[32756]: pgmap v1161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:34:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:34 smithi156 ceph-mon[32679]: pgmap v1161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:34:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:34 smithi092 ceph-mon[29156]: pgmap v1161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:34:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:36 smithi156 ceph-mon[32679]: pgmap v1162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:36 smithi092 ceph-mon[29156]: pgmap v1162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:36 smithi189 ceph-mon[32756]: pgmap v1162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:38 smithi156 ceph-mon[32679]: pgmap v1163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 974.217995 secs 2024-04-26T18:34:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 277.204427 secs 2024-04-26T18:34:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:38 smithi092 ceph-mon[29156]: pgmap v1163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 974.217995 secs 2024-04-26T18:34:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 277.204427 secs 2024-04-26T18:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:38 smithi189 ceph-mon[32756]: pgmap v1163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 974.217995 secs 2024-04-26T18:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 277.204427 secs 2024-04-26T18:34:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:40 smithi156 ceph-mon[32679]: pgmap v1164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:34:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:40 smithi092 ceph-mon[29156]: pgmap v1164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:34:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:40 smithi189 ceph-mon[32756]: pgmap v1164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:34:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:42 smithi156 ceph-mon[32679]: pgmap v1165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:42 smithi092 ceph-mon[29156]: pgmap v1165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:42 smithi189 ceph-mon[32756]: pgmap v1165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 979.218069 secs 2024-04-26T18:34:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 282.204540 secs 2024-04-26T18:34:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 979.218069 secs 2024-04-26T18:34:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 282.204540 secs 2024-04-26T18:34:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 979.218069 secs 2024-04-26T18:34:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 282.204540 secs 2024-04-26T18:34:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:44 smithi156 ceph-mon[32679]: pgmap v1166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:44 smithi092 ceph-mon[29156]: pgmap v1166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:44 smithi189 ceph-mon[32756]: pgmap v1166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:46 smithi156 ceph-mon[32679]: pgmap v1167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:46 smithi092 ceph-mon[29156]: pgmap v1167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:46 smithi189 ceph-mon[32756]: pgmap v1167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:34:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:47 smithi092 ceph-mon[29156]: pgmap v1168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:47 smithi189 ceph-mon[32756]: pgmap v1168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:47 smithi156 ceph-mon[32679]: pgmap v1168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:34:48.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 984.218167 secs 2024-04-26T18:34:48.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 287.204658 secs 2024-04-26T18:34:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 984.218167 secs 2024-04-26T18:34:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 287.204658 secs 2024-04-26T18:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 984.218167 secs 2024-04-26T18:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 287.204658 secs 2024-04-26T18:34:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:49 smithi092 ceph-mon[29156]: pgmap v1169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:49 smithi189 ceph-mon[32756]: pgmap v1169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:49 smithi156 ceph-mon[32679]: pgmap v1169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:51 smithi092 ceph-mon[29156]: pgmap v1170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:51 smithi189 ceph-mon[32756]: pgmap v1170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:51 smithi156 ceph-mon[32679]: pgmap v1170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:53 smithi092 ceph-mon[29156]: pgmap v1171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 989.218300 secs 2024-04-26T18:34:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 292.204769 secs 2024-04-26T18:34:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:53 smithi189 ceph-mon[32756]: pgmap v1171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 989.218300 secs 2024-04-26T18:34:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 292.204769 secs 2024-04-26T18:34:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:53 smithi156 ceph-mon[32679]: pgmap v1171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 989.218300 secs 2024-04-26T18:34:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 292.204769 secs 2024-04-26T18:34:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:55 smithi092 ceph-mon[29156]: pgmap v1172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:55 smithi189 ceph-mon[32756]: pgmap v1172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:55 smithi156 ceph-mon[32679]: pgmap v1172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:34:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:57 smithi092 ceph-mon[29156]: pgmap v1173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:57 smithi189 ceph-mon[32756]: pgmap v1173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:57 smithi156 ceph-mon[32679]: pgmap v1173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:34:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 994.218440 secs 2024-04-26T18:34:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 297.204863 secs 2024-04-26T18:34:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 994.218440 secs 2024-04-26T18:34:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 297.204863 secs 2024-04-26T18:34:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 994.218440 secs 2024-04-26T18:34:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 297.204863 secs 2024-04-26T18:35:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:34:59 smithi092 ceph-mon[29156]: pgmap v1174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:35:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:34:59 smithi189 ceph-mon[32756]: pgmap v1174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:35:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:34:59 smithi156 ceph-mon[32679]: pgmap v1174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:35:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:35:01.244+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:35:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:35:01.244+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:35:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:35:01.244+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:35:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:35:01.244+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:35:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:35:01.244+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:35:02.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:01 smithi156 ceph-mon[32679]: pgmap v1175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:01 smithi092 ceph-mon[29156]: pgmap v1175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:01 smithi189 ceph-mon[32756]: pgmap v1175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:03 smithi092 ceph-mon[29156]: pgmap v1176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 999.218557 secs 2024-04-26T18:35:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 302.204977 secs 2024-04-26T18:35:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:03 smithi189 ceph-mon[32756]: pgmap v1176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 999.218557 secs 2024-04-26T18:35:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 302.204977 secs 2024-04-26T18:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:03 smithi156 ceph-mon[32679]: pgmap v1176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 999.218557 secs 2024-04-26T18:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 302.204977 secs 2024-04-26T18:35:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:35:06.120+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006640 con 0x7f1cb4108940 2024-04-26T18:35:06.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:35:06.120+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006640 con 0x7f1cb4108940 2024-04-26T18:35:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:35:06.134+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:35:06.133 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:35:06.134+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:35:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:05 smithi092 ceph-mon[29156]: pgmap v1177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:05 smithi189 ceph-mon[32756]: pgmap v1177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:05 smithi156 ceph-mon[32679]: pgmap v1177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:07 smithi092 ceph-mon[29156]: pgmap v1178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:07 smithi189 ceph-mon[32756]: pgmap v1178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:07 smithi156 ceph-mon[32679]: pgmap v1178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1004.218693 secs 2024-04-26T18:35:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 307.205085 secs 2024-04-26T18:35:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1004.218693 secs 2024-04-26T18:35:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 307.205085 secs 2024-04-26T18:35:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1004.218693 secs 2024-04-26T18:35:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 307.205085 secs 2024-04-26T18:35:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:09 smithi092 ceph-mon[29156]: pgmap v1179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:09 smithi189 ceph-mon[32756]: pgmap v1179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:09 smithi156 ceph-mon[32679]: pgmap v1179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:11 smithi092 ceph-mon[29156]: pgmap v1180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:11 smithi189 ceph-mon[32756]: pgmap v1180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:11 smithi156 ceph-mon[32679]: pgmap v1180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:13 smithi189 ceph-mon[32756]: pgmap v1181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1009.218859 secs 2024-04-26T18:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 312.205179 secs 2024-04-26T18:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:13 smithi156 ceph-mon[32679]: pgmap v1181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1009.218859 secs 2024-04-26T18:35:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 312.205179 secs 2024-04-26T18:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:13 smithi092 ceph-mon[29156]: pgmap v1181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T18:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1009.218859 secs 2024-04-26T18:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 312.205179 secs 2024-04-26T18:35:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:15 smithi189 ceph-mon[32756]: pgmap v1182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:15 smithi156 ceph-mon[32679]: pgmap v1182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:15 smithi092 ceph-mon[29156]: pgmap v1182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T18:35:18.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:18 smithi092 ceph-mon[29156]: pgmap v1183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:18 smithi189 ceph-mon[32756]: pgmap v1183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:18 smithi156 ceph-mon[32679]: pgmap v1183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1014.218955 secs 2024-04-26T18:35:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 317.205261 secs 2024-04-26T18:35:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1014.218955 secs 2024-04-26T18:35:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 317.205261 secs 2024-04-26T18:35:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1014.218955 secs 2024-04-26T18:35:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 317.205261 secs 2024-04-26T18:35:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:20 smithi189 ceph-mon[32756]: pgmap v1184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:20 smithi156 ceph-mon[32679]: pgmap v1184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:20 smithi092 ceph-mon[29156]: pgmap v1184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:22 smithi189 ceph-mon[32756]: pgmap v1185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:22 smithi156 ceph-mon[32679]: pgmap v1185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:22 smithi092 ceph-mon[29156]: pgmap v1185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:24 smithi189 ceph-mon[32756]: pgmap v1186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1019.219080 secs 2024-04-26T18:35:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 322.205345 secs 2024-04-26T18:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:24 smithi156 ceph-mon[32679]: pgmap v1186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1019.219080 secs 2024-04-26T18:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 322.205345 secs 2024-04-26T18:35:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:24 smithi092 ceph-mon[29156]: pgmap v1186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1019.219080 secs 2024-04-26T18:35:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 322.205345 secs 2024-04-26T18:35:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:26 smithi189 ceph-mon[32756]: pgmap v1187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:26 smithi156 ceph-mon[32679]: pgmap v1187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:26 smithi092 ceph-mon[29156]: pgmap v1187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:28 smithi189 ceph-mon[32756]: pgmap v1188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:28 smithi156 ceph-mon[32679]: pgmap v1188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:28 smithi092 ceph-mon[29156]: pgmap v1188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1024.219185 secs 2024-04-26T18:35:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 327.205438 secs 2024-04-26T18:35:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1024.219185 secs 2024-04-26T18:35:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 327.205438 secs 2024-04-26T18:35:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1024.219185 secs 2024-04-26T18:35:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 327.205438 secs 2024-04-26T18:35:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:35:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: pgmap v1189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: pgmap v1190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:35:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: pgmap v1191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: pgmap v1189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: pgmap v1190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: pgmap v1191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:35:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: pgmap v1189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:35:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:35:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: pgmap v1190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:35:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: pgmap v1191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:35:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:31 smithi092 ceph-mon[29156]: pgmap v1192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:31 smithi189 ceph-mon[32756]: pgmap v1192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:31 smithi156 ceph-mon[32679]: pgmap v1192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1029.219258 secs 2024-04-26T18:35:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1029.219258 secs 2024-04-26T18:35:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1029.219258 secs 2024-04-26T18:35:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 332.205568 secs 2024-04-26T18:35:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:34 smithi092 ceph-mon[29156]: pgmap v1193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 332.205568 secs 2024-04-26T18:35:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:34 smithi189 ceph-mon[32756]: pgmap v1193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 332.205568 secs 2024-04-26T18:35:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:34 smithi156 ceph-mon[32679]: pgmap v1193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:35 smithi092 ceph-mon[29156]: pgmap v1194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:35 smithi189 ceph-mon[32756]: pgmap v1194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:35 smithi156 ceph-mon[32679]: pgmap v1194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:35:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:37 smithi092 ceph-mon[29156]: pgmap v1195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:35:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:37 smithi189 ceph-mon[32756]: pgmap v1195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:35:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:37 smithi156 ceph-mon[32679]: pgmap v1195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:35:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1034.219386 secs 2024-04-26T18:35:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 337.205665 secs 2024-04-26T18:35:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1034.219386 secs 2024-04-26T18:35:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 337.205665 secs 2024-04-26T18:35:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1034.219386 secs 2024-04-26T18:35:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 337.205665 secs 2024-04-26T18:35:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:39 smithi189 ceph-mon[32756]: pgmap v1196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:35:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:39 smithi156 ceph-mon[32679]: pgmap v1196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:35:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:39 smithi092 ceph-mon[29156]: pgmap v1196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:35:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:41 smithi092 ceph-mon[29156]: pgmap v1197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:41 smithi189 ceph-mon[32756]: pgmap v1197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:41 smithi156 ceph-mon[32679]: pgmap v1197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1039.219506 secs 2024-04-26T18:35:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1039.219506 secs 2024-04-26T18:35:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1039.219506 secs 2024-04-26T18:35:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 342.205776 secs 2024-04-26T18:35:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:44 smithi092 ceph-mon[29156]: pgmap v1198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 342.205776 secs 2024-04-26T18:35:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:44 smithi189 ceph-mon[32756]: pgmap v1198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 342.205776 secs 2024-04-26T18:35:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:44 smithi156 ceph-mon[32679]: pgmap v1198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:45 smithi092 ceph-mon[29156]: pgmap v1199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:45 smithi189 ceph-mon[32756]: pgmap v1199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:45 smithi156 ceph-mon[32679]: pgmap v1199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:47 smithi092 ceph-mon[29156]: pgmap v1200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:47 smithi189 ceph-mon[32756]: pgmap v1200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:47 smithi156 ceph-mon[32679]: pgmap v1200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1044.219642 secs 2024-04-26T18:35:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 347.205890 secs 2024-04-26T18:35:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1044.219642 secs 2024-04-26T18:35:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 347.205890 secs 2024-04-26T18:35:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1044.219642 secs 2024-04-26T18:35:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 347.205890 secs 2024-04-26T18:35:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:49 smithi189 ceph-mon[32756]: pgmap v1201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:49 smithi156 ceph-mon[32679]: pgmap v1201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:49 smithi092 ceph-mon[29156]: pgmap v1201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:51 smithi092 ceph-mon[29156]: pgmap v1202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:51 smithi189 ceph-mon[32756]: pgmap v1202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:51 smithi156 ceph-mon[32679]: pgmap v1202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1049.219750 secs 2024-04-26T18:35:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1049.219750 secs 2024-04-26T18:35:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1049.219750 secs 2024-04-26T18:35:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 352.206013 secs 2024-04-26T18:35:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:54 smithi092 ceph-mon[29156]: pgmap v1203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 352.206013 secs 2024-04-26T18:35:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:54 smithi189 ceph-mon[32756]: pgmap v1203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 352.206013 secs 2024-04-26T18:35:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:54 smithi156 ceph-mon[32679]: pgmap v1203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:35:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:55 smithi092 ceph-mon[29156]: pgmap v1204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:55 smithi189 ceph-mon[32756]: pgmap v1204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:55 smithi156 ceph-mon[32679]: pgmap v1204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:57 smithi092 ceph-mon[29156]: pgmap v1205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:57 smithi189 ceph-mon[32756]: pgmap v1205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:57 smithi156 ceph-mon[32679]: pgmap v1205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:35:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1054.219892 secs 2024-04-26T18:35:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 357.206123 secs 2024-04-26T18:35:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1054.219892 secs 2024-04-26T18:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 357.206123 secs 2024-04-26T18:35:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1054.219892 secs 2024-04-26T18:35:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 357.206123 secs 2024-04-26T18:36:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:35:59 smithi189 ceph-mon[32756]: pgmap v1206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:35:59 smithi156 ceph-mon[32679]: pgmap v1206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:35:59 smithi092 ceph-mon[29156]: pgmap v1206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:01 smithi092 ceph-mon[29156]: pgmap v1207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:01 smithi189 ceph-mon[32756]: pgmap v1207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:01 smithi156 ceph-mon[32679]: pgmap v1207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1059.220012 secs 2024-04-26T18:36:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1059.220012 secs 2024-04-26T18:36:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1059.220012 secs 2024-04-26T18:36:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:04 smithi092 ceph-mon[29156]: 1 slow requests, 1 included below; oldest blocked for > 362.206233 secs 2024-04-26T18:36:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:04 smithi092 ceph-mon[29156]: slow request 362.206232 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:36:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:04 smithi092 ceph-mon[29156]: pgmap v1208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:04 smithi189 ceph-mon[32756]: 1 slow requests, 1 included below; oldest blocked for > 362.206233 secs 2024-04-26T18:36:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:04 smithi189 ceph-mon[32756]: slow request 362.206232 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:36:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:04 smithi189 ceph-mon[32756]: pgmap v1208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:04 smithi156 ceph-mon[32679]: 1 slow requests, 1 included below; oldest blocked for > 362.206233 secs 2024-04-26T18:36:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:04 smithi156 ceph-mon[32679]: slow request 362.206232 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:36:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:04 smithi156 ceph-mon[32679]: pgmap v1208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:05 smithi092 ceph-mon[29156]: pgmap v1209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:05 smithi189 ceph-mon[32756]: pgmap v1209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:05 smithi156 ceph-mon[32679]: pgmap v1209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:07 smithi092 ceph-mon[29156]: pgmap v1210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:07 smithi189 ceph-mon[32756]: pgmap v1210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:07 smithi156 ceph-mon[32679]: pgmap v1210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1064.220121 secs 2024-04-26T18:36:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 367.206323 secs 2024-04-26T18:36:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1064.220121 secs 2024-04-26T18:36:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 367.206323 secs 2024-04-26T18:36:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1064.220121 secs 2024-04-26T18:36:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 367.206323 secs 2024-04-26T18:36:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:09 smithi189 ceph-mon[32756]: pgmap v1211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:09 smithi156 ceph-mon[32679]: pgmap v1211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:09 smithi092 ceph-mon[29156]: pgmap v1211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:11 smithi092 ceph-mon[29156]: pgmap v1212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:11 smithi189 ceph-mon[32756]: pgmap v1212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:11 smithi156 ceph-mon[32679]: pgmap v1212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:36:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1069.220265 secs 2024-04-26T18:36:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1069.220265 secs 2024-04-26T18:36:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1069.220265 secs 2024-04-26T18:36:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 372.206432 secs 2024-04-26T18:36:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:14 smithi092 ceph-mon[29156]: pgmap v1213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 372.206432 secs 2024-04-26T18:36:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:14 smithi189 ceph-mon[32756]: pgmap v1213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 372.206432 secs 2024-04-26T18:36:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:14 smithi156 ceph-mon[32679]: pgmap v1213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:36:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:15 smithi189 ceph-mon[32756]: pgmap v1214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:15 smithi156 ceph-mon[32679]: pgmap v1214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:15 smithi092 ceph-mon[29156]: pgmap v1214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:18.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:17 smithi092 ceph-mon[29156]: pgmap v1215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:17 smithi189 ceph-mon[32756]: pgmap v1215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:17 smithi156 ceph-mon[32679]: pgmap v1215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1074.220388 secs 2024-04-26T18:36:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 377.206546 secs 2024-04-26T18:36:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1074.220388 secs 2024-04-26T18:36:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 377.206546 secs 2024-04-26T18:36:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1074.220388 secs 2024-04-26T18:36:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 377.206546 secs 2024-04-26T18:36:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:19 smithi189 ceph-mon[32756]: pgmap v1216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:19 smithi156 ceph-mon[32679]: pgmap v1216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:19 smithi092 ceph-mon[29156]: pgmap v1216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:21 smithi189 ceph-mon[32756]: pgmap v1217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:21 smithi156 ceph-mon[32679]: pgmap v1217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:21 smithi092 ceph-mon[29156]: pgmap v1217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1079.220485 secs 2024-04-26T18:36:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1079.220485 secs 2024-04-26T18:36:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1079.220485 secs 2024-04-26T18:36:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 382.206670 secs 2024-04-26T18:36:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:24 smithi092 ceph-mon[29156]: pgmap v1218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 382.206670 secs 2024-04-26T18:36:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:24 smithi189 ceph-mon[32756]: pgmap v1218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 382.206670 secs 2024-04-26T18:36:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:24 smithi156 ceph-mon[32679]: pgmap v1218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:25 smithi189 ceph-mon[32756]: pgmap v1219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:25 smithi156 ceph-mon[32679]: pgmap v1219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:25 smithi092 ceph-mon[29156]: pgmap v1219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:27 smithi189 ceph-mon[32756]: pgmap v1220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:27 smithi156 ceph-mon[32679]: pgmap v1220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:27 smithi092 ceph-mon[29156]: pgmap v1220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1084.220559 secs 2024-04-26T18:36:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 387.206835 secs 2024-04-26T18:36:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1084.220559 secs 2024-04-26T18:36:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 387.206835 secs 2024-04-26T18:36:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1084.220559 secs 2024-04-26T18:36:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 387.206835 secs 2024-04-26T18:36:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:29 smithi189 ceph-mon[32756]: pgmap v1221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:29 smithi156 ceph-mon[32679]: pgmap v1221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:29 smithi092 ceph-mon[29156]: pgmap v1221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: pgmap v1222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:36:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: pgmap v1223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: pgmap v1222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: pgmap v1223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:36:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:36:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:36:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:36:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: pgmap v1222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:36:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: pgmap v1223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:36:33.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:33 smithi189 ceph-mon[32756]: pgmap v1224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:33.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1089.220675 secs 2024-04-26T18:36:33.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 392.206930 secs 2024-04-26T18:36:33.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:33 smithi156 ceph-mon[32679]: pgmap v1224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:33.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1089.220675 secs 2024-04-26T18:36:33.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 392.206930 secs 2024-04-26T18:36:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:33 smithi092 ceph-mon[29156]: pgmap v1224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1089.220675 secs 2024-04-26T18:36:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 392.206930 secs 2024-04-26T18:36:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:35 smithi189 ceph-mon[32756]: pgmap v1225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:35 smithi156 ceph-mon[32679]: pgmap v1225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:35 smithi092 ceph-mon[29156]: pgmap v1225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:36:36.131+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:36:36.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:36:36.131+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:36:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:36:36.144+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:36:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:36:36.144+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 13 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:36:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:37 smithi189 ceph-mon[32756]: pgmap v1226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:37 smithi156 ceph-mon[32679]: pgmap v1226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:37 smithi092 ceph-mon[29156]: pgmap v1226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:36:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1094.220814 secs 2024-04-26T18:36:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 397.207071 secs 2024-04-26T18:36:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1094.220814 secs 2024-04-26T18:36:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 397.207071 secs 2024-04-26T18:36:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1094.220814 secs 2024-04-26T18:36:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 397.207071 secs 2024-04-26T18:36:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:39 smithi189 ceph-mon[32756]: pgmap v1227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:39 smithi156 ceph-mon[32679]: pgmap v1227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:39 smithi092 ceph-mon[29156]: pgmap v1227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:36:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:41 smithi189 ceph-mon[32756]: pgmap v1228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:36:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:41 smithi156 ceph-mon[32679]: pgmap v1228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:36:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:41 smithi092 ceph-mon[29156]: pgmap v1228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:36:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:43 smithi189 ceph-mon[32756]: pgmap v1229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1099.220934 secs 2024-04-26T18:36:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 402.207154 secs 2024-04-26T18:36:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:43 smithi156 ceph-mon[32679]: pgmap v1229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1099.220934 secs 2024-04-26T18:36:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 402.207154 secs 2024-04-26T18:36:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:43 smithi092 ceph-mon[29156]: pgmap v1229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1099.220934 secs 2024-04-26T18:36:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 402.207154 secs 2024-04-26T18:36:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:45 smithi189 ceph-mon[32756]: pgmap v1230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:45 smithi156 ceph-mon[32679]: pgmap v1230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:45 smithi092 ceph-mon[29156]: pgmap v1230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:47 smithi189 ceph-mon[32756]: pgmap v1231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:47 smithi156 ceph-mon[32679]: pgmap v1231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:47 smithi092 ceph-mon[29156]: pgmap v1231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1104.221029 secs 2024-04-26T18:36:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 407.207287 secs 2024-04-26T18:36:48.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1104.221029 secs 2024-04-26T18:36:48.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 407.207287 secs 2024-04-26T18:36:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1104.221029 secs 2024-04-26T18:36:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 407.207287 secs 2024-04-26T18:36:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:49 smithi189 ceph-mon[32756]: pgmap v1232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:49 smithi156 ceph-mon[32679]: pgmap v1232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:49 smithi092 ceph-mon[29156]: pgmap v1232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:51 smithi189 ceph-mon[32756]: pgmap v1233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:51 smithi156 ceph-mon[32679]: pgmap v1233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:51 smithi092 ceph-mon[29156]: pgmap v1233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:53 smithi189 ceph-mon[32756]: pgmap v1234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1109.221149 secs 2024-04-26T18:36:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 412.207384 secs 2024-04-26T18:36:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:53 smithi156 ceph-mon[32679]: pgmap v1234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1109.221149 secs 2024-04-26T18:36:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 412.207384 secs 2024-04-26T18:36:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:53 smithi092 ceph-mon[29156]: pgmap v1234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1109.221149 secs 2024-04-26T18:36:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 412.207384 secs 2024-04-26T18:36:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:55 smithi189 ceph-mon[32756]: pgmap v1235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:55 smithi156 ceph-mon[32679]: pgmap v1235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:55 smithi092 ceph-mon[29156]: pgmap v1235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:36:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:57 smithi189 ceph-mon[32756]: pgmap v1236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:57 smithi156 ceph-mon[32679]: pgmap v1236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:57 smithi092 ceph-mon[29156]: pgmap v1236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1114.221263 secs 2024-04-26T18:36:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 417.207504 secs 2024-04-26T18:36:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1114.221263 secs 2024-04-26T18:36:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 417.207504 secs 2024-04-26T18:36:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1114.221263 secs 2024-04-26T18:36:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 417.207504 secs 2024-04-26T18:36:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:36:59 smithi189 ceph-mon[32756]: pgmap v1237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:36:59 smithi156 ceph-mon[32679]: pgmap v1237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:36:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:36:59 smithi092 ceph-mon[29156]: pgmap v1237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:01 smithi189 ceph-mon[32756]: pgmap v1238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:01.909 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:01 smithi092 ceph-mon[29156]: pgmap v1238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:01 smithi156 ceph-mon[32679]: pgmap v1238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:03 smithi189 ceph-mon[32756]: pgmap v1239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1119.221377 secs 2024-04-26T18:37:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 422.207647 secs 2024-04-26T18:37:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:03 smithi156 ceph-mon[32679]: pgmap v1239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1119.221377 secs 2024-04-26T18:37:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 422.207647 secs 2024-04-26T18:37:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:03 smithi092 ceph-mon[29156]: pgmap v1239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1119.221377 secs 2024-04-26T18:37:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 422.207647 secs 2024-04-26T18:37:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:05 smithi189 ceph-mon[32756]: pgmap v1240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:05 smithi156 ceph-mon[32679]: pgmap v1240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:05 smithi092 ceph-mon[29156]: pgmap v1240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:07 smithi189 ceph-mon[32756]: pgmap v1241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:07 smithi156 ceph-mon[32679]: pgmap v1241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:07 smithi092 ceph-mon[29156]: pgmap v1241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1124.221514 secs 2024-04-26T18:37:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 427.207731 secs 2024-04-26T18:37:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1124.221514 secs 2024-04-26T18:37:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 427.207731 secs 2024-04-26T18:37:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1124.221514 secs 2024-04-26T18:37:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 427.207731 secs 2024-04-26T18:37:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:09 smithi189 ceph-mon[32756]: pgmap v1242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:09 smithi156 ceph-mon[32679]: pgmap v1242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:09 smithi092 ceph-mon[29156]: pgmap v1242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:11 smithi189 ceph-mon[32756]: pgmap v1243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:11 smithi156 ceph-mon[32679]: pgmap v1243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:11 smithi092 ceph-mon[29156]: pgmap v1243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:13 smithi189 ceph-mon[32756]: pgmap v1244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1129.221653 secs 2024-04-26T18:37:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 432.207806 secs 2024-04-26T18:37:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:13 smithi156 ceph-mon[32679]: pgmap v1244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1129.221653 secs 2024-04-26T18:37:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 432.207806 secs 2024-04-26T18:37:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:13 smithi092 ceph-mon[29156]: pgmap v1244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1129.221653 secs 2024-04-26T18:37:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 432.207806 secs 2024-04-26T18:37:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:15 smithi189 ceph-mon[32756]: pgmap v1245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:15 smithi156 ceph-mon[32679]: pgmap v1245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:15 smithi092 ceph-mon[29156]: pgmap v1245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:17 smithi189 ceph-mon[32756]: pgmap v1246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:17 smithi156 ceph-mon[32679]: pgmap v1246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:17 smithi092 ceph-mon[29156]: pgmap v1246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1134.221765 secs 2024-04-26T18:37:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 437.207954 secs 2024-04-26T18:37:18.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1134.221765 secs 2024-04-26T18:37:18.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 437.207954 secs 2024-04-26T18:37:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1134.221765 secs 2024-04-26T18:37:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 437.207954 secs 2024-04-26T18:37:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:19 smithi189 ceph-mon[32756]: pgmap v1247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:19 smithi156 ceph-mon[32679]: pgmap v1247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:19 smithi092 ceph-mon[29156]: pgmap v1247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:21 smithi189 ceph-mon[32756]: pgmap v1248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:21 smithi156 ceph-mon[32679]: pgmap v1248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:21 smithi092 ceph-mon[29156]: pgmap v1248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:23 smithi189 ceph-mon[32756]: pgmap v1249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1139.221918 secs 2024-04-26T18:37:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 442.208063 secs 2024-04-26T18:37:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:23 smithi156 ceph-mon[32679]: pgmap v1249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1139.221918 secs 2024-04-26T18:37:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 442.208063 secs 2024-04-26T18:37:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:23 smithi092 ceph-mon[29156]: pgmap v1249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1139.221918 secs 2024-04-26T18:37:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 442.208063 secs 2024-04-26T18:37:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:25 smithi189 ceph-mon[32756]: pgmap v1250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:25 smithi156 ceph-mon[32679]: pgmap v1250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:25 smithi092 ceph-mon[29156]: pgmap v1250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:27 smithi189 ceph-mon[32756]: pgmap v1251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:27 smithi156 ceph-mon[32679]: pgmap v1251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:27 smithi092 ceph-mon[29156]: pgmap v1251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1144.222016 secs 2024-04-26T18:37:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 447.208184 secs 2024-04-26T18:37:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1144.222016 secs 2024-04-26T18:37:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 447.208184 secs 2024-04-26T18:37:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1144.222016 secs 2024-04-26T18:37:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 447.208184 secs 2024-04-26T18:37:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:29 smithi189 ceph-mon[32756]: pgmap v1252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:29 smithi156 ceph-mon[32679]: pgmap v1252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:29 smithi092 ceph-mon[29156]: pgmap v1252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:37:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:31 smithi189 ceph-mon[32756]: pgmap v1253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:37:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:31 smithi156 ceph-mon[32679]: pgmap v1253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:37:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:31 smithi092 ceph-mon[29156]: pgmap v1253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:37:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:37:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:37:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:32 smithi189 ceph-mon[32756]: pgmap v1254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:37:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:32 smithi189 ceph-mon[32756]: pgmap v1255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:32 smithi156 ceph-mon[32679]: pgmap v1254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:37:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:32 smithi156 ceph-mon[32679]: pgmap v1255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:32 smithi092 ceph-mon[29156]: pgmap v1254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:37:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:32 smithi092 ceph-mon[29156]: pgmap v1255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1149.222083 secs 2024-04-26T18:37:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 452.208268 secs 2024-04-26T18:37:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1149.222083 secs 2024-04-26T18:37:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 452.208268 secs 2024-04-26T18:37:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1149.222083 secs 2024-04-26T18:37:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 452.208268 secs 2024-04-26T18:37:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:34 smithi156 ceph-mon[32679]: pgmap v1256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:37:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:34 smithi092 ceph-mon[29156]: pgmap v1256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:37:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:34 smithi189 ceph-mon[32756]: pgmap v1256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:37:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:36 smithi156 ceph-mon[32679]: pgmap v1257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:36 smithi092 ceph-mon[29156]: pgmap v1257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:36 smithi189 ceph-mon[32756]: pgmap v1257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:38 smithi156 ceph-mon[32679]: pgmap v1258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1154.222184 secs 2024-04-26T18:37:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 457.208375 secs 2024-04-26T18:37:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:38 smithi092 ceph-mon[29156]: pgmap v1258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1154.222184 secs 2024-04-26T18:37:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 457.208375 secs 2024-04-26T18:37:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:38 smithi189 ceph-mon[32756]: pgmap v1258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1154.222184 secs 2024-04-26T18:37:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 457.208375 secs 2024-04-26T18:37:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:40 smithi156 ceph-mon[32679]: pgmap v1259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:40 smithi092 ceph-mon[29156]: pgmap v1259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:40 smithi189 ceph-mon[32756]: pgmap v1259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:37:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:42 smithi156 ceph-mon[32679]: pgmap v1260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:37:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:42 smithi092 ceph-mon[29156]: pgmap v1260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:37:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:42 smithi189 ceph-mon[32756]: pgmap v1260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:37:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1159.222310 secs 2024-04-26T18:37:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 462.208468 secs 2024-04-26T18:37:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1159.222310 secs 2024-04-26T18:37:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 462.208468 secs 2024-04-26T18:37:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1159.222310 secs 2024-04-26T18:37:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 462.208468 secs 2024-04-26T18:37:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:44 smithi156 ceph-mon[32679]: pgmap v1261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:44 smithi092 ceph-mon[29156]: pgmap v1261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:44 smithi189 ceph-mon[32756]: pgmap v1261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:46 smithi156 ceph-mon[32679]: pgmap v1262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:46 smithi092 ceph-mon[29156]: pgmap v1262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:46 smithi189 ceph-mon[32756]: pgmap v1262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:48 smithi156 ceph-mon[32679]: pgmap v1263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1164.222415 secs 2024-04-26T18:37:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 467.208581 secs 2024-04-26T18:37:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:48 smithi092 ceph-mon[29156]: pgmap v1263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1164.222415 secs 2024-04-26T18:37:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 467.208581 secs 2024-04-26T18:37:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:48 smithi189 ceph-mon[32756]: pgmap v1263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1164.222415 secs 2024-04-26T18:37:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 467.208581 secs 2024-04-26T18:37:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:50 smithi156 ceph-mon[32679]: pgmap v1264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:50 smithi092 ceph-mon[29156]: pgmap v1264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:50 smithi189 ceph-mon[32756]: pgmap v1264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:52 smithi156 ceph-mon[32679]: pgmap v1265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:52 smithi092 ceph-mon[29156]: pgmap v1265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:52 smithi189 ceph-mon[32756]: pgmap v1265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1169.222532 secs 2024-04-26T18:37:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 472.208690 secs 2024-04-26T18:37:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1169.222532 secs 2024-04-26T18:37:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 472.208690 secs 2024-04-26T18:37:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1169.222532 secs 2024-04-26T18:37:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 472.208690 secs 2024-04-26T18:37:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:54 smithi156 ceph-mon[32679]: pgmap v1266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:54 smithi092 ceph-mon[29156]: pgmap v1266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:54 smithi189 ceph-mon[32756]: pgmap v1266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:56 smithi156 ceph-mon[32679]: pgmap v1267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:56 smithi092 ceph-mon[29156]: pgmap v1267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:56 smithi189 ceph-mon[32756]: pgmap v1267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:37:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:58 smithi092 ceph-mon[29156]: pgmap v1268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1174.222649 secs 2024-04-26T18:37:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:37:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 477.208752 secs 2024-04-26T18:37:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:58 smithi189 ceph-mon[32756]: pgmap v1268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1174.222649 secs 2024-04-26T18:37:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:37:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 477.208752 secs 2024-04-26T18:37:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:58 smithi156 ceph-mon[32679]: pgmap v1268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:37:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1174.222649 secs 2024-04-26T18:37:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:37:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 477.208752 secs 2024-04-26T18:38:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:00 smithi092 ceph-mon[29156]: pgmap v1269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:00 smithi189 ceph-mon[32756]: pgmap v1269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:00 smithi156 ceph-mon[32679]: pgmap v1269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:02 smithi092 ceph-mon[29156]: pgmap v1270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:02 smithi189 ceph-mon[32756]: pgmap v1270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:02 smithi156 ceph-mon[32679]: pgmap v1270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1179.222781 secs 2024-04-26T18:38:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 482.208837 secs 2024-04-26T18:38:04.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1179.222781 secs 2024-04-26T18:38:04.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 482.208837 secs 2024-04-26T18:38:04.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1179.222781 secs 2024-04-26T18:38:04.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 482.208837 secs 2024-04-26T18:38:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:04 smithi092 ceph-mon[29156]: pgmap v1271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:04 smithi189 ceph-mon[32756]: pgmap v1271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:04 smithi156 ceph-mon[32679]: pgmap v1271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:06 smithi092 ceph-mon[29156]: pgmap v1272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:06 smithi189 ceph-mon[32756]: pgmap v1272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:06 smithi156 ceph-mon[32679]: pgmap v1272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:08 smithi092 ceph-mon[29156]: pgmap v1273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1184.222901 secs 2024-04-26T18:38:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 487.208963 secs 2024-04-26T18:38:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:08 smithi189 ceph-mon[32756]: pgmap v1273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1184.222901 secs 2024-04-26T18:38:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 487.208963 secs 2024-04-26T18:38:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:08 smithi156 ceph-mon[32679]: pgmap v1273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1184.222901 secs 2024-04-26T18:38:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 487.208963 secs 2024-04-26T18:38:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:10 smithi092 ceph-mon[29156]: pgmap v1274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:10 smithi189 ceph-mon[32756]: pgmap v1274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:10 smithi156 ceph-mon[32679]: pgmap v1274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:11 smithi092 ceph-mon[29156]: pgmap v1275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:11 smithi189 ceph-mon[32756]: pgmap v1275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:11 smithi156 ceph-mon[32679]: pgmap v1275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1189.223013 secs 2024-04-26T18:38:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:14 smithi189 ceph-mon[32756]: pgmap v1276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 492.209102 secs 2024-04-26T18:38:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1189.223013 secs 2024-04-26T18:38:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:14 smithi156 ceph-mon[32679]: pgmap v1276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 492.209102 secs 2024-04-26T18:38:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1189.223013 secs 2024-04-26T18:38:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:14 smithi092 ceph-mon[29156]: pgmap v1276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 492.209102 secs 2024-04-26T18:38:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:16 smithi189 ceph-mon[32756]: pgmap v1277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:16 smithi156 ceph-mon[32679]: pgmap v1277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:16 smithi092 ceph-mon[29156]: pgmap v1277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:18 smithi189 ceph-mon[32756]: pgmap v1278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:18 smithi156 ceph-mon[32679]: pgmap v1278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:18 smithi092 ceph-mon[29156]: pgmap v1278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1194.223128 secs 2024-04-26T18:38:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 497.209178 secs 2024-04-26T18:38:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1194.223128 secs 2024-04-26T18:38:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 497.209178 secs 2024-04-26T18:38:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1194.223128 secs 2024-04-26T18:38:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 497.209178 secs 2024-04-26T18:38:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:20 smithi189 ceph-mon[32756]: pgmap v1279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:20 smithi156 ceph-mon[32679]: pgmap v1279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:20 smithi092 ceph-mon[29156]: pgmap v1279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:22 smithi189 ceph-mon[32756]: pgmap v1280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:22 smithi156 ceph-mon[32679]: pgmap v1280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:22 smithi092 ceph-mon[29156]: pgmap v1280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1199.223242 secs 2024-04-26T18:38:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:24 smithi189 ceph-mon[32756]: pgmap v1281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 502.209308 secs 2024-04-26T18:38:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1199.223242 secs 2024-04-26T18:38:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:24 smithi156 ceph-mon[32679]: pgmap v1281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 502.209308 secs 2024-04-26T18:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1199.223242 secs 2024-04-26T18:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:24 smithi092 ceph-mon[29156]: pgmap v1281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 502.209308 secs 2024-04-26T18:38:26.620 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:26 smithi092 ceph-mon[29156]: pgmap v1282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:26 smithi189 ceph-mon[32756]: pgmap v1282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:26 smithi156 ceph-mon[32679]: pgmap v1282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:28 smithi189 ceph-mon[32756]: pgmap v1283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:28 smithi156 ceph-mon[32679]: pgmap v1283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:28 smithi092 ceph-mon[29156]: pgmap v1283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1204.223344 secs 2024-04-26T18:38:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 507.209428 secs 2024-04-26T18:38:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1204.223344 secs 2024-04-26T18:38:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 507.209428 secs 2024-04-26T18:38:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1204.223344 secs 2024-04-26T18:38:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 507.209428 secs 2024-04-26T18:38:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:30 smithi189 ceph-mon[32756]: pgmap v1284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:30 smithi156 ceph-mon[32679]: pgmap v1284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:30 smithi092 ceph-mon[29156]: pgmap v1284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:38:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:32 smithi189 ceph-mon[32756]: pgmap v1285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:38:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:32 smithi156 ceph-mon[32679]: pgmap v1285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:38:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:32 smithi092 ceph-mon[29156]: pgmap v1285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:38:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:38:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:38:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:33 smithi189 ceph-mon[32756]: pgmap v1286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:38:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:33 smithi189 ceph-mon[32756]: pgmap v1287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:33 smithi156 ceph-mon[32679]: pgmap v1286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:38:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:33 smithi156 ceph-mon[32679]: pgmap v1287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:33 smithi092 ceph-mon[29156]: pgmap v1286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:38:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:33 smithi092 ceph-mon[29156]: pgmap v1287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1209.223478 secs 2024-04-26T18:38:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 512.209519 secs 2024-04-26T18:38:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1209.223478 secs 2024-04-26T18:38:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 512.209519 secs 2024-04-26T18:38:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1209.223478 secs 2024-04-26T18:38:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 512.209519 secs 2024-04-26T18:38:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:35 smithi189 ceph-mon[32756]: pgmap v1288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:35 smithi156 ceph-mon[32679]: pgmap v1288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:35 smithi092 ceph-mon[29156]: pgmap v1288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:37 smithi189 ceph-mon[32756]: pgmap v1289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:37 smithi156 ceph-mon[32679]: pgmap v1289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:37 smithi092 ceph-mon[29156]: pgmap v1289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:39 smithi189 ceph-mon[32756]: pgmap v1290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:38:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1214.223593 secs 2024-04-26T18:38:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 517.209612 secs 2024-04-26T18:38:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:39 smithi156 ceph-mon[32679]: pgmap v1290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:38:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1214.223593 secs 2024-04-26T18:38:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 517.209612 secs 2024-04-26T18:38:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:39 smithi092 ceph-mon[29156]: pgmap v1290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:38:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1214.223593 secs 2024-04-26T18:38:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 517.209612 secs 2024-04-26T18:38:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:41 smithi189 ceph-mon[32756]: pgmap v1291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:41 smithi156 ceph-mon[32679]: pgmap v1291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:41 smithi092 ceph-mon[29156]: pgmap v1291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:38:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:43 smithi189 ceph-mon[32756]: pgmap v1292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:38:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:43 smithi156 ceph-mon[32679]: pgmap v1292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:38:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:43 smithi092 ceph-mon[29156]: pgmap v1292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:38:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1219.223708 secs 2024-04-26T18:38:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 522.209699 secs 2024-04-26T18:38:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1219.223708 secs 2024-04-26T18:38:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 522.209699 secs 2024-04-26T18:38:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1219.223708 secs 2024-04-26T18:38:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 522.209699 secs 2024-04-26T18:38:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:45 smithi189 ceph-mon[32756]: pgmap v1293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:45 smithi156 ceph-mon[32679]: pgmap v1293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:45 smithi092 ceph-mon[29156]: pgmap v1293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:47 smithi156 ceph-mon[32679]: pgmap v1294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:47 smithi092 ceph-mon[29156]: pgmap v1294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:47 smithi189 ceph-mon[32756]: pgmap v1294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:49 smithi156 ceph-mon[32679]: pgmap v1295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1224.223844 secs 2024-04-26T18:38:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 527.209780 secs 2024-04-26T18:38:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:49 smithi092 ceph-mon[29156]: pgmap v1295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1224.223844 secs 2024-04-26T18:38:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 527.209780 secs 2024-04-26T18:38:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:49 smithi189 ceph-mon[32756]: pgmap v1295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1224.223844 secs 2024-04-26T18:38:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 527.209780 secs 2024-04-26T18:38:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:51 smithi156 ceph-mon[32679]: pgmap v1296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:51 smithi092 ceph-mon[29156]: pgmap v1296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:51 smithi189 ceph-mon[32756]: pgmap v1296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:53 smithi156 ceph-mon[32679]: pgmap v1297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:53 smithi092 ceph-mon[29156]: pgmap v1297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:53 smithi189 ceph-mon[32756]: pgmap v1297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1229.223934 secs 2024-04-26T18:38:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 532.209895 secs 2024-04-26T18:38:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1229.223934 secs 2024-04-26T18:38:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 532.209895 secs 2024-04-26T18:38:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1229.223934 secs 2024-04-26T18:38:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 532.209895 secs 2024-04-26T18:38:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:55 smithi156 ceph-mon[32679]: pgmap v1298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:55 smithi092 ceph-mon[29156]: pgmap v1298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:55 smithi189 ceph-mon[32756]: pgmap v1298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:38:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:57 smithi156 ceph-mon[32679]: pgmap v1299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:57 smithi092 ceph-mon[29156]: pgmap v1299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:57 smithi189 ceph-mon[32756]: pgmap v1299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:59 smithi156 ceph-mon[32679]: pgmap v1300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1234.224013 secs 2024-04-26T18:38:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:38:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 537.209997 secs 2024-04-26T18:38:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:59 smithi092 ceph-mon[29156]: pgmap v1300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1234.224013 secs 2024-04-26T18:38:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:38:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 537.209997 secs 2024-04-26T18:38:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:59 smithi189 ceph-mon[32756]: pgmap v1300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:38:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1234.224013 secs 2024-04-26T18:38:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:38:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 537.209997 secs 2024-04-26T18:39:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:01 smithi156 ceph-mon[32679]: pgmap v1301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:01 smithi092 ceph-mon[29156]: pgmap v1301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:01 smithi189 ceph-mon[32756]: pgmap v1301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:03 smithi156 ceph-mon[32679]: pgmap v1302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:03 smithi092 ceph-mon[29156]: pgmap v1302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:03 smithi189 ceph-mon[32756]: pgmap v1302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1239.224104 secs 2024-04-26T18:39:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:04 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 542.210146 secs 2024-04-26T18:39:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1239.224104 secs 2024-04-26T18:39:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:04 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 542.210146 secs 2024-04-26T18:39:04.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1239.224104 secs 2024-04-26T18:39:04.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:04 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 542.210146 secs 2024-04-26T18:39:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:05 smithi156 ceph-mon[32679]: pgmap v1303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:05 smithi092 ceph-mon[29156]: pgmap v1303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:05 smithi189 ceph-mon[32756]: pgmap v1303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:07 smithi156 ceph-mon[32679]: pgmap v1304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:07 smithi092 ceph-mon[29156]: pgmap v1304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:07 smithi189 ceph-mon[32756]: pgmap v1304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:09 smithi156 ceph-mon[32679]: pgmap v1305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1244.224225 secs 2024-04-26T18:39:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 547.210287 secs 2024-04-26T18:39:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:09 smithi092 ceph-mon[29156]: pgmap v1305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1244.224225 secs 2024-04-26T18:39:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 547.210287 secs 2024-04-26T18:39:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:09 smithi189 ceph-mon[32756]: pgmap v1305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1244.224225 secs 2024-04-26T18:39:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 547.210287 secs 2024-04-26T18:39:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:11 smithi092 ceph-mon[29156]: pgmap v1306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:11 smithi189 ceph-mon[32756]: pgmap v1306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:11 smithi156 ceph-mon[32679]: pgmap v1306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:13.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:13 smithi092 ceph-mon[29156]: pgmap v1307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:13 smithi189 ceph-mon[32756]: pgmap v1307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:13 smithi156 ceph-mon[32679]: pgmap v1307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1249.224320 secs 2024-04-26T18:39:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 552.210399 secs 2024-04-26T18:39:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1249.224320 secs 2024-04-26T18:39:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 552.210399 secs 2024-04-26T18:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1249.224320 secs 2024-04-26T18:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 552.210399 secs 2024-04-26T18:39:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:15 smithi092 ceph-mon[29156]: pgmap v1308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:15 smithi189 ceph-mon[32756]: pgmap v1308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:15 smithi156 ceph-mon[32679]: pgmap v1308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:17 smithi092 ceph-mon[29156]: pgmap v1309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:17 smithi189 ceph-mon[32756]: pgmap v1309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:17 smithi156 ceph-mon[32679]: pgmap v1309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:19 smithi092 ceph-mon[29156]: pgmap v1310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1254.224417 secs 2024-04-26T18:39:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 557.210520 secs 2024-04-26T18:39:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:19 smithi189 ceph-mon[32756]: pgmap v1310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1254.224417 secs 2024-04-26T18:39:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 557.210520 secs 2024-04-26T18:39:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:19 smithi156 ceph-mon[32679]: pgmap v1310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1254.224417 secs 2024-04-26T18:39:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 557.210520 secs 2024-04-26T18:39:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:21 smithi092 ceph-mon[29156]: pgmap v1311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:21 smithi189 ceph-mon[32756]: pgmap v1311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:21 smithi156 ceph-mon[32679]: pgmap v1311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:23 smithi092 ceph-mon[29156]: pgmap v1312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1259.224532 secs 2024-04-26T18:39:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:23 smithi189 ceph-mon[32756]: pgmap v1312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1259.224532 secs 2024-04-26T18:39:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:23 smithi156 ceph-mon[32679]: pgmap v1312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1259.224532 secs 2024-04-26T18:39:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 562.210641 secs 2024-04-26T18:39:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 562.210641 secs 2024-04-26T18:39:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 562.210641 secs 2024-04-26T18:39:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:25 smithi092 ceph-mon[29156]: pgmap v1313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:25 smithi189 ceph-mon[32756]: pgmap v1313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:25 smithi156 ceph-mon[32679]: pgmap v1313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:27 smithi092 ceph-mon[29156]: pgmap v1314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:27 smithi189 ceph-mon[32756]: pgmap v1314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:27 smithi156 ceph-mon[32679]: pgmap v1314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1264.224662 secs 2024-04-26T18:39:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1264.224662 secs 2024-04-26T18:39:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1264.224662 secs 2024-04-26T18:39:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:29 smithi092 ceph-mon[29156]: pgmap v1315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 567.210749 secs 2024-04-26T18:39:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:29 smithi189 ceph-mon[32756]: pgmap v1315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 567.210749 secs 2024-04-26T18:39:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:29 smithi156 ceph-mon[32679]: pgmap v1315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 567.210749 secs 2024-04-26T18:39:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:31 smithi092 ceph-mon[29156]: pgmap v1316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:31 smithi189 ceph-mon[32756]: pgmap v1316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:31 smithi156 ceph-mon[32679]: pgmap v1316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:39:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:33 smithi092 ceph-mon[29156]: pgmap v1317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:39:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1269.224775 secs 2024-04-26T18:39:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:33 smithi189 ceph-mon[32756]: pgmap v1317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1269.224775 secs 2024-04-26T18:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:33 smithi156 ceph-mon[32679]: pgmap v1317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1269.224775 secs 2024-04-26T18:39:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:34 smithi092 ceph-mon[29156]: pgmap v1318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:39:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:34 smithi092 ceph-mon[29156]: pgmap v1319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 572.210841 secs 2024-04-26T18:39:34.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:34 smithi189 ceph-mon[32756]: pgmap v1318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:39:34.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:34 smithi189 ceph-mon[32756]: pgmap v1319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:34.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 572.210841 secs 2024-04-26T18:39:34.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:34 smithi156 ceph-mon[32679]: pgmap v1318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:39:34.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:34 smithi156 ceph-mon[32679]: pgmap v1319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:39:34.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 572.210841 secs 2024-04-26T18:39:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:39:36.155+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:39:36.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:39:36.155+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:39:36.166 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:39:36.167+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:39:36.167 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:39:36.167+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 14 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:39:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:36 smithi092 ceph-mon[29156]: pgmap v1320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:36 smithi189 ceph-mon[32756]: pgmap v1320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:36 smithi156 ceph-mon[32679]: pgmap v1320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:38 smithi189 ceph-mon[32756]: pgmap v1321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1274.224889 secs 2024-04-26T18:39:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:38 smithi156 ceph-mon[32679]: pgmap v1321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1274.224889 secs 2024-04-26T18:39:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:38 smithi092 ceph-mon[29156]: pgmap v1321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1274.224889 secs 2024-04-26T18:39:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 577.210961 secs 2024-04-26T18:39:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 577.210961 secs 2024-04-26T18:39:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 577.210961 secs 2024-04-26T18:39:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:40 smithi189 ceph-mon[32756]: pgmap v1322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:40 smithi156 ceph-mon[32679]: pgmap v1322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:40 smithi092 ceph-mon[29156]: pgmap v1322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:42 smithi189 ceph-mon[32756]: pgmap v1323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:42 smithi156 ceph-mon[32679]: pgmap v1323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:42 smithi092 ceph-mon[29156]: pgmap v1323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:39:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1279.224969 secs 2024-04-26T18:39:43.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1279.224969 secs 2024-04-26T18:39:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1279.224969 secs 2024-04-26T18:39:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:44 smithi189 ceph-mon[32756]: pgmap v1324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:39:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 582.211075 secs 2024-04-26T18:39:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:44 smithi156 ceph-mon[32679]: pgmap v1324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:39:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 582.211075 secs 2024-04-26T18:39:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:44 smithi092 ceph-mon[29156]: pgmap v1324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:39:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 582.211075 secs 2024-04-26T18:39:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:46 smithi189 ceph-mon[32756]: pgmap v1325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:46 smithi156 ceph-mon[32679]: pgmap v1325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:46 smithi092 ceph-mon[29156]: pgmap v1325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:48 smithi189 ceph-mon[32756]: pgmap v1326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1284.225087 secs 2024-04-26T18:39:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:48 smithi156 ceph-mon[32679]: pgmap v1326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1284.225087 secs 2024-04-26T18:39:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:48 smithi092 ceph-mon[29156]: pgmap v1326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1284.225087 secs 2024-04-26T18:39:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 587.211184 secs 2024-04-26T18:39:49.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 587.211184 secs 2024-04-26T18:39:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 587.211184 secs 2024-04-26T18:39:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:50 smithi189 ceph-mon[32756]: pgmap v1327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:50 smithi156 ceph-mon[32679]: pgmap v1327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:50 smithi092 ceph-mon[29156]: pgmap v1327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:52 smithi189 ceph-mon[32756]: pgmap v1328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:52 smithi156 ceph-mon[32679]: pgmap v1328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:52 smithi092 ceph-mon[29156]: pgmap v1328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1289.225171 secs 2024-04-26T18:39:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 592.211330 secs 2024-04-26T18:39:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1289.225171 secs 2024-04-26T18:39:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 592.211330 secs 2024-04-26T18:39:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1289.225171 secs 2024-04-26T18:39:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 592.211330 secs 2024-04-26T18:39:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:54 smithi189 ceph-mon[32756]: pgmap v1329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:54 smithi156 ceph-mon[32679]: pgmap v1329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:54 smithi092 ceph-mon[29156]: pgmap v1329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:56 smithi189 ceph-mon[32756]: pgmap v1330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:56 smithi156 ceph-mon[32679]: pgmap v1330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:56 smithi092 ceph-mon[29156]: pgmap v1330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:39:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:58 smithi189 ceph-mon[32756]: pgmap v1331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1294.225296 secs 2024-04-26T18:39:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:39:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 597.211406 secs 2024-04-26T18:39:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:58 smithi156 ceph-mon[32679]: pgmap v1331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1294.225296 secs 2024-04-26T18:39:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:39:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 597.211406 secs 2024-04-26T18:39:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:58 smithi092 ceph-mon[29156]: pgmap v1331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:39:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1294.225296 secs 2024-04-26T18:39:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:39:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 597.211406 secs 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: pgmap v1332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.j on smithi092 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.d on smithi092 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.k on smithi156 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.h on smithi156 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.l on smithi189 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.c on smithi189 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-26T18:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-26T18:40:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: mds.a(mds.1): 1 slow requests are blocked > 180 secs 2024-04-26T18:40:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:00 smithi189 ceph-mon[32756]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:40:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: pgmap v1332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:40:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:40:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.j on smithi092 is in error state 2024-04-26T18:40:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.d on smithi092 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.k on smithi156 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.h on smithi156 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.l on smithi189 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.c on smithi189 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: mds.a(mds.1): 1 slow requests are blocked > 180 secs 2024-04-26T18:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:00 smithi156 ceph-mon[32679]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:40:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: pgmap v1332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.j on smithi092 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.d on smithi092 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.k on smithi156 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.h on smithi156 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.l on smithi189 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.c on smithi189 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: mds.a(mds.1): 1 slow requests are blocked > 180 secs 2024-04-26T18:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:00 smithi092 ceph-mon[29156]: mds.b(mds.0): 3 slow requests are blocked > 180 secs 2024-04-26T18:40:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:02 smithi189 ceph-mon[32756]: pgmap v1333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:02 smithi156 ceph-mon[32679]: pgmap v1333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:02 smithi092 ceph-mon[29156]: pgmap v1333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1299.225430 secs 2024-04-26T18:40:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 602.211517 secs 2024-04-26T18:40:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1299.225430 secs 2024-04-26T18:40:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 602.211517 secs 2024-04-26T18:40:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1299.225430 secs 2024-04-26T18:40:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 602.211517 secs 2024-04-26T18:40:04.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:04 smithi156 ceph-mon[32679]: pgmap v1334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:04 smithi189 ceph-mon[32756]: pgmap v1334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:04 smithi092 ceph-mon[29156]: pgmap v1334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:06 smithi189 ceph-mon[32756]: pgmap v1335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:06 smithi156 ceph-mon[32679]: pgmap v1335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:06 smithi092 ceph-mon[29156]: pgmap v1335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:08 smithi189 ceph-mon[32756]: pgmap v1336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1304.225545 secs 2024-04-26T18:40:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 607.211599 secs 2024-04-26T18:40:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:08 smithi156 ceph-mon[32679]: pgmap v1336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1304.225545 secs 2024-04-26T18:40:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 607.211599 secs 2024-04-26T18:40:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:08 smithi092 ceph-mon[29156]: pgmap v1336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1304.225545 secs 2024-04-26T18:40:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 607.211599 secs 2024-04-26T18:40:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:10 smithi189 ceph-mon[32756]: pgmap v1337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:10 smithi156 ceph-mon[32679]: pgmap v1337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:10 smithi092 ceph-mon[29156]: pgmap v1337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:12 smithi189 ceph-mon[32756]: pgmap v1338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:12 smithi156 ceph-mon[32679]: pgmap v1338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:12 smithi092 ceph-mon[29156]: pgmap v1338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1309.225660 secs 2024-04-26T18:40:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 612.211752 secs 2024-04-26T18:40:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1309.225660 secs 2024-04-26T18:40:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 612.211752 secs 2024-04-26T18:40:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1309.225660 secs 2024-04-26T18:40:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 612.211752 secs 2024-04-26T18:40:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:14 smithi189 ceph-mon[32756]: pgmap v1339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:14 smithi156 ceph-mon[32679]: pgmap v1339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:14 smithi092 ceph-mon[29156]: pgmap v1339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T18:40:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:16 smithi189 ceph-mon[32756]: pgmap v1340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:16 smithi156 ceph-mon[32679]: pgmap v1340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:16 smithi092 ceph-mon[29156]: pgmap v1340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T18:40:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:18 smithi189 ceph-mon[32756]: pgmap v1341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1314.225783 secs 2024-04-26T18:40:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 617.211876 secs 2024-04-26T18:40:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:18 smithi156 ceph-mon[32679]: pgmap v1341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1314.225783 secs 2024-04-26T18:40:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 617.211876 secs 2024-04-26T18:40:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:18 smithi092 ceph-mon[29156]: pgmap v1341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1314.225783 secs 2024-04-26T18:40:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 617.211876 secs 2024-04-26T18:40:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:20 smithi189 ceph-mon[32756]: pgmap v1342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:20 smithi156 ceph-mon[32679]: pgmap v1342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:20 smithi092 ceph-mon[29156]: pgmap v1342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:22 smithi189 ceph-mon[32756]: pgmap v1343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:22 smithi156 ceph-mon[32679]: pgmap v1343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:22 smithi092 ceph-mon[29156]: pgmap v1343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1319.225911 secs 2024-04-26T18:40:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 622.211949 secs 2024-04-26T18:40:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1319.225911 secs 2024-04-26T18:40:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 622.211949 secs 2024-04-26T18:40:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1319.225911 secs 2024-04-26T18:40:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 622.211949 secs 2024-04-26T18:40:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:24 smithi189 ceph-mon[32756]: pgmap v1344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:24 smithi156 ceph-mon[32679]: pgmap v1344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:24 smithi092 ceph-mon[29156]: pgmap v1344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:26 smithi189 ceph-mon[32756]: pgmap v1345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:26 smithi156 ceph-mon[32679]: pgmap v1345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:26 smithi092 ceph-mon[29156]: pgmap v1345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:28 smithi189 ceph-mon[32756]: pgmap v1346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1324.225962 secs 2024-04-26T18:40:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 627.212067 secs 2024-04-26T18:40:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:28 smithi156 ceph-mon[32679]: pgmap v1346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1324.225962 secs 2024-04-26T18:40:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 627.212067 secs 2024-04-26T18:40:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:28 smithi092 ceph-mon[29156]: pgmap v1346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1324.225962 secs 2024-04-26T18:40:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 627.212067 secs 2024-04-26T18:40:30.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:30 smithi092 ceph-mon[29156]: pgmap v1347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:30 smithi189 ceph-mon[32756]: pgmap v1347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:30 smithi156 ceph-mon[32679]: pgmap v1347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:31.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:40:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:40:31.311+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:40:31.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:40:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:40:31.311+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:40:31.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:40:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:40:31.311+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:40:31.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:40:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:40:31.311+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:40:31.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:40:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:40:31.311+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:40:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:32 smithi189 ceph-mon[32756]: pgmap v1348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:32 smithi156 ceph-mon[32679]: pgmap v1348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:32 smithi092 ceph-mon[29156]: pgmap v1348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1329.226031 secs 2024-04-26T18:40:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 632.212139 secs 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1329.226031 secs 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 632.212139 secs 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:40:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1329.226031 secs 2024-04-26T18:40:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 632.212139 secs 2024-04-26T18:40:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:34 smithi092 ceph-mon[29156]: pgmap v1349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:34.799 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:34 smithi156 ceph-mon[32679]: pgmap v1349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:34 smithi189 ceph-mon[32756]: pgmap v1349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: pgmap v1350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: pgmap v1350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: pgmap v1350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:40:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:40:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:40:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:40:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:40:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:40:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: pgmap v1351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 355 B/s wr, 3 op/s 2024-04-26T18:40:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:37 smithi092 ceph-mon[29156]: pgmap v1352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:40:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: pgmap v1351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 355 B/s wr, 3 op/s 2024-04-26T18:40:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:37 smithi189 ceph-mon[32756]: pgmap v1352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:40:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:40:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:40:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:40:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:40:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: pgmap v1351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 355 B/s wr, 3 op/s 2024-04-26T18:40:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:37 smithi156 ceph-mon[32679]: pgmap v1352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1334.226129 secs 2024-04-26T18:40:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1334.226129 secs 2024-04-26T18:40:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1334.226129 secs 2024-04-26T18:40:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:39 smithi189 ceph-mon[32756]: pgmap v1353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 429 B/s wr, 2 op/s 2024-04-26T18:40:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 637.212323 secs 2024-04-26T18:40:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:39 smithi156 ceph-mon[32679]: pgmap v1353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 429 B/s wr, 2 op/s 2024-04-26T18:40:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 637.212323 secs 2024-04-26T18:40:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:39 smithi092 ceph-mon[29156]: pgmap v1353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 429 B/s wr, 2 op/s 2024-04-26T18:40:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 637.212323 secs 2024-04-26T18:40:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:41 smithi189 ceph-mon[32756]: pgmap v1354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:41 smithi156 ceph-mon[32679]: pgmap v1354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:41 smithi092 ceph-mon[29156]: pgmap v1354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:43 smithi189 ceph-mon[32756]: pgmap v1355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1339.226240 secs 2024-04-26T18:40:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:43 smithi156 ceph-mon[32679]: pgmap v1355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1339.226240 secs 2024-04-26T18:40:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:43 smithi092 ceph-mon[29156]: pgmap v1355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 429 B/s wr, 4 op/s 2024-04-26T18:40:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1339.226240 secs 2024-04-26T18:40:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 642.212379 secs 2024-04-26T18:40:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 642.212379 secs 2024-04-26T18:40:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 642.212379 secs 2024-04-26T18:40:45.884 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:45 smithi092 ceph-mon[29156]: pgmap v1356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:40:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:45 smithi189 ceph-mon[32756]: pgmap v1356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:40:45.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:45 smithi156 ceph-mon[32679]: pgmap v1356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:40:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:47 smithi189 ceph-mon[32756]: pgmap v1357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:40:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:47 smithi156 ceph-mon[32679]: pgmap v1357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:40:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:47 smithi092 ceph-mon[29156]: pgmap v1357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:40:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1344.226330 secs 2024-04-26T18:40:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1344.226330 secs 2024-04-26T18:40:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1344.226330 secs 2024-04-26T18:40:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:49 smithi189 ceph-mon[32756]: pgmap v1358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 647.212494 secs 2024-04-26T18:40:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:49 smithi156 ceph-mon[32679]: pgmap v1358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 647.212494 secs 2024-04-26T18:40:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:49 smithi092 ceph-mon[29156]: pgmap v1358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 647.212494 secs 2024-04-26T18:40:51.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:51 smithi092 ceph-mon[29156]: pgmap v1359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:51 smithi189 ceph-mon[32756]: pgmap v1359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:51 smithi156 ceph-mon[32679]: pgmap v1359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:53 smithi189 ceph-mon[32756]: pgmap v1360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1349.226403 secs 2024-04-26T18:40:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 652.212561 secs 2024-04-26T18:40:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:53 smithi156 ceph-mon[32679]: pgmap v1360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1349.226403 secs 2024-04-26T18:40:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 652.212561 secs 2024-04-26T18:40:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:53 smithi092 ceph-mon[29156]: pgmap v1360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1349.226403 secs 2024-04-26T18:40:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 652.212561 secs 2024-04-26T18:40:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:55 smithi189 ceph-mon[32756]: pgmap v1361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:55 smithi156 ceph-mon[32679]: pgmap v1361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:55 smithi092 ceph-mon[29156]: pgmap v1361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:40:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:57 smithi189 ceph-mon[32756]: pgmap v1362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:57 smithi156 ceph-mon[32679]: pgmap v1362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:57 smithi092 ceph-mon[29156]: pgmap v1362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1354.226521 secs 2024-04-26T18:40:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 657.212684 secs 2024-04-26T18:40:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1354.226521 secs 2024-04-26T18:40:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 657.212684 secs 2024-04-26T18:40:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1354.226521 secs 2024-04-26T18:40:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 657.212684 secs 2024-04-26T18:40:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:40:59 smithi189 ceph-mon[32756]: pgmap v1363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:40:59 smithi156 ceph-mon[32679]: pgmap v1363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:40:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:40:59 smithi092 ceph-mon[29156]: pgmap v1363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:01 smithi189 ceph-mon[32756]: pgmap v1364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:01 smithi156 ceph-mon[32679]: pgmap v1364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:01 smithi092 ceph-mon[29156]: pgmap v1364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:03 smithi189 ceph-mon[32756]: pgmap v1365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1359.226640 secs 2024-04-26T18:41:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 662.212803 secs 2024-04-26T18:41:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:03 smithi156 ceph-mon[32679]: pgmap v1365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1359.226640 secs 2024-04-26T18:41:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 662.212803 secs 2024-04-26T18:41:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:03 smithi092 ceph-mon[29156]: pgmap v1365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1359.226640 secs 2024-04-26T18:41:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 662.212803 secs 2024-04-26T18:41:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:05 smithi189 ceph-mon[32756]: pgmap v1366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:05 smithi156 ceph-mon[32679]: pgmap v1366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:05 smithi092 ceph-mon[29156]: pgmap v1366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:07 smithi189 ceph-mon[32756]: pgmap v1367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:07 smithi156 ceph-mon[32679]: pgmap v1367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:07 smithi092 ceph-mon[29156]: pgmap v1367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1364.226776 secs 2024-04-26T18:41:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 667.212928 secs 2024-04-26T18:41:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1364.226776 secs 2024-04-26T18:41:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 667.212928 secs 2024-04-26T18:41:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1364.226776 secs 2024-04-26T18:41:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 667.212928 secs 2024-04-26T18:41:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:09 smithi189 ceph-mon[32756]: pgmap v1368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:09 smithi156 ceph-mon[32679]: pgmap v1368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:09 smithi092 ceph-mon[29156]: pgmap v1368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:11 smithi189 ceph-mon[32756]: pgmap v1369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:11 smithi156 ceph-mon[32679]: pgmap v1369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:11 smithi092 ceph-mon[29156]: pgmap v1369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:13 smithi189 ceph-mon[32756]: pgmap v1370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1369.226840 secs 2024-04-26T18:41:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 672.213051 secs 2024-04-26T18:41:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:13 smithi156 ceph-mon[32679]: pgmap v1370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1369.226840 secs 2024-04-26T18:41:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 672.213051 secs 2024-04-26T18:41:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:13 smithi092 ceph-mon[29156]: pgmap v1370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1369.226840 secs 2024-04-26T18:41:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 672.213051 secs 2024-04-26T18:41:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:15 smithi189 ceph-mon[32756]: pgmap v1371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:15 smithi156 ceph-mon[32679]: pgmap v1371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:15 smithi092 ceph-mon[29156]: pgmap v1371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:17 smithi189 ceph-mon[32756]: pgmap v1372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:17 smithi156 ceph-mon[32679]: pgmap v1372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:17 smithi092 ceph-mon[29156]: pgmap v1372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1374.226959 secs 2024-04-26T18:41:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 677.213146 secs 2024-04-26T18:41:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1374.226959 secs 2024-04-26T18:41:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 677.213146 secs 2024-04-26T18:41:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1374.226959 secs 2024-04-26T18:41:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 677.213146 secs 2024-04-26T18:41:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:19 smithi189 ceph-mon[32756]: pgmap v1373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:19 smithi156 ceph-mon[32679]: pgmap v1373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:19 smithi092 ceph-mon[29156]: pgmap v1373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:21 smithi189 ceph-mon[32756]: pgmap v1374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:21 smithi156 ceph-mon[32679]: pgmap v1374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:21 smithi092 ceph-mon[29156]: pgmap v1374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:23 smithi189 ceph-mon[32756]: pgmap v1375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1379.227083 secs 2024-04-26T18:41:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 682.213263 secs 2024-04-26T18:41:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:23 smithi156 ceph-mon[32679]: pgmap v1375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1379.227083 secs 2024-04-26T18:41:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 682.213263 secs 2024-04-26T18:41:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:23 smithi092 ceph-mon[29156]: pgmap v1375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1379.227083 secs 2024-04-26T18:41:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 682.213263 secs 2024-04-26T18:41:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:25 smithi189 ceph-mon[32756]: pgmap v1376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:25 smithi156 ceph-mon[32679]: pgmap v1376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:25 smithi092 ceph-mon[29156]: pgmap v1376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:27 smithi189 ceph-mon[32756]: pgmap v1377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:27 smithi156 ceph-mon[32679]: pgmap v1377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:27 smithi092 ceph-mon[29156]: pgmap v1377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1384.227164 secs 2024-04-26T18:41:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 687.213371 secs 2024-04-26T18:41:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1384.227164 secs 2024-04-26T18:41:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 687.213371 secs 2024-04-26T18:41:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1384.227164 secs 2024-04-26T18:41:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 687.213371 secs 2024-04-26T18:41:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:29 smithi189 ceph-mon[32756]: pgmap v1378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:29 smithi156 ceph-mon[32679]: pgmap v1378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:29 smithi092 ceph-mon[29156]: pgmap v1378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:31 smithi189 ceph-mon[32756]: pgmap v1379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:31 smithi156 ceph-mon[32679]: pgmap v1379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:31 smithi092 ceph-mon[29156]: pgmap v1379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:33 smithi189 ceph-mon[32756]: pgmap v1380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1389.227282 secs 2024-04-26T18:41:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 692.213473 secs 2024-04-26T18:41:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:33 smithi156 ceph-mon[32679]: pgmap v1380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1389.227282 secs 2024-04-26T18:41:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 692.213473 secs 2024-04-26T18:41:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:33 smithi092 ceph-mon[29156]: pgmap v1380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1389.227282 secs 2024-04-26T18:41:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 692.213473 secs 2024-04-26T18:41:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:35 smithi189 ceph-mon[32756]: pgmap v1381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:35 smithi156 ceph-mon[32679]: pgmap v1381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:35 smithi092 ceph-mon[29156]: pgmap v1381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:41:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:37 smithi156 ceph-mon[32679]: pgmap v1382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:41:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:37 smithi092 ceph-mon[29156]: pgmap v1382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:41:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:37 smithi189 ceph-mon[32756]: pgmap v1382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:41:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:41:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:41:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:38 smithi156 ceph-mon[32679]: pgmap v1383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:41:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:38 smithi156 ceph-mon[32679]: pgmap v1384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1394.227410 secs 2024-04-26T18:41:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 697.213593 secs 2024-04-26T18:41:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:38 smithi092 ceph-mon[29156]: pgmap v1383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:41:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:38 smithi092 ceph-mon[29156]: pgmap v1384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1394.227410 secs 2024-04-26T18:41:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 697.213593 secs 2024-04-26T18:41:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:38 smithi189 ceph-mon[32756]: pgmap v1383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:41:39.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:38 smithi189 ceph-mon[32756]: pgmap v1384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:39.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1394.227410 secs 2024-04-26T18:41:39.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 697.213593 secs 2024-04-26T18:41:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:40 smithi156 ceph-mon[32679]: pgmap v1385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:40 smithi092 ceph-mon[29156]: pgmap v1385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:40 smithi189 ceph-mon[32756]: pgmap v1385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:42 smithi156 ceph-mon[32679]: pgmap v1386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:42 smithi092 ceph-mon[29156]: pgmap v1386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:42 smithi189 ceph-mon[32756]: pgmap v1386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1399.227524 secs 2024-04-26T18:41:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 702.213698 secs 2024-04-26T18:41:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1399.227524 secs 2024-04-26T18:41:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 702.213698 secs 2024-04-26T18:41:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1399.227524 secs 2024-04-26T18:41:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 702.213698 secs 2024-04-26T18:41:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:44 smithi156 ceph-mon[32679]: pgmap v1387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:41:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:44 smithi092 ceph-mon[29156]: pgmap v1387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:41:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:44 smithi189 ceph-mon[32756]: pgmap v1387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:41:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:46 smithi156 ceph-mon[32679]: pgmap v1388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:46 smithi092 ceph-mon[29156]: pgmap v1388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:46 smithi189 ceph-mon[32756]: pgmap v1388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:41:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:48 smithi156 ceph-mon[32679]: pgmap v1389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:41:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1404.227624 secs 2024-04-26T18:41:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 707.213845 secs 2024-04-26T18:41:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:48 smithi092 ceph-mon[29156]: pgmap v1389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:41:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1404.227624 secs 2024-04-26T18:41:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 707.213845 secs 2024-04-26T18:41:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:48 smithi189 ceph-mon[32756]: pgmap v1389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:41:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1404.227624 secs 2024-04-26T18:41:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 707.213845 secs 2024-04-26T18:41:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:50 smithi156 ceph-mon[32679]: pgmap v1390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:50 smithi092 ceph-mon[29156]: pgmap v1390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:50 smithi189 ceph-mon[32756]: pgmap v1390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:52 smithi156 ceph-mon[32679]: pgmap v1391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:52 smithi092 ceph-mon[29156]: pgmap v1391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:52 smithi189 ceph-mon[32756]: pgmap v1391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1409.227757 secs 2024-04-26T18:41:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 712.213982 secs 2024-04-26T18:41:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1409.227757 secs 2024-04-26T18:41:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 712.213982 secs 2024-04-26T18:41:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1409.227757 secs 2024-04-26T18:41:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 712.213982 secs 2024-04-26T18:41:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:54 smithi156 ceph-mon[32679]: pgmap v1392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:54 smithi092 ceph-mon[29156]: pgmap v1392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:54 smithi189 ceph-mon[32756]: pgmap v1392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:56 smithi156 ceph-mon[32679]: pgmap v1393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:56 smithi092 ceph-mon[29156]: pgmap v1393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:56 smithi189 ceph-mon[32756]: pgmap v1393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:41:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:58 smithi156 ceph-mon[32679]: pgmap v1394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1414.227871 secs 2024-04-26T18:41:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:41:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 717.214069 secs 2024-04-26T18:41:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:58 smithi092 ceph-mon[29156]: pgmap v1394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1414.227871 secs 2024-04-26T18:41:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:41:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 717.214069 secs 2024-04-26T18:41:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:58 smithi189 ceph-mon[32756]: pgmap v1394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:41:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1414.227871 secs 2024-04-26T18:41:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:41:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 717.214069 secs 2024-04-26T18:42:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:00 smithi092 ceph-mon[29156]: pgmap v1395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:00 smithi189 ceph-mon[32756]: pgmap v1395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:00 smithi156 ceph-mon[32679]: pgmap v1395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:02 smithi092 ceph-mon[29156]: pgmap v1396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:02 smithi189 ceph-mon[32756]: pgmap v1396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:02 smithi156 ceph-mon[32679]: pgmap v1396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1419.227979 secs 2024-04-26T18:42:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:03 smithi092 ceph-mon[29156]: 1 slow requests, 1 included below; oldest blocked for > 722.214188 secs 2024-04-26T18:42:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:03 smithi092 ceph-mon[29156]: slow request 722.214187 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:42:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1419.227979 secs 2024-04-26T18:42:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:03 smithi189 ceph-mon[32756]: 1 slow requests, 1 included below; oldest blocked for > 722.214188 secs 2024-04-26T18:42:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:03 smithi189 ceph-mon[32756]: slow request 722.214187 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:42:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1419.227979 secs 2024-04-26T18:42:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:03 smithi156 ceph-mon[32679]: 1 slow requests, 1 included below; oldest blocked for > 722.214188 secs 2024-04-26T18:42:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:03 smithi156 ceph-mon[32679]: slow request 722.214187 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:42:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:04 smithi092 ceph-mon[29156]: pgmap v1397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:05.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:04 smithi189 ceph-mon[32756]: pgmap v1397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:05.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:04 smithi156 ceph-mon[32679]: pgmap v1397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:06 smithi092 ceph-mon[29156]: pgmap v1398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:06 smithi189 ceph-mon[32756]: pgmap v1398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:06 smithi156 ceph-mon[32679]: pgmap v1398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:08 smithi092 ceph-mon[29156]: pgmap v1399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1424.228100 secs 2024-04-26T18:42:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 727.214320 secs 2024-04-26T18:42:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:08 smithi189 ceph-mon[32756]: pgmap v1399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1424.228100 secs 2024-04-26T18:42:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 727.214320 secs 2024-04-26T18:42:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:08 smithi156 ceph-mon[32679]: pgmap v1399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1424.228100 secs 2024-04-26T18:42:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 727.214320 secs 2024-04-26T18:42:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:10 smithi092 ceph-mon[29156]: pgmap v1400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:10 smithi189 ceph-mon[32756]: pgmap v1400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:10 smithi156 ceph-mon[32679]: pgmap v1400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:12 smithi092 ceph-mon[29156]: pgmap v1401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:12 smithi189 ceph-mon[32756]: pgmap v1401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:12 smithi156 ceph-mon[32679]: pgmap v1401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1429.228234 secs 2024-04-26T18:42:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 732.214460 secs 2024-04-26T18:42:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1429.228234 secs 2024-04-26T18:42:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 732.214460 secs 2024-04-26T18:42:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1429.228234 secs 2024-04-26T18:42:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 732.214460 secs 2024-04-26T18:42:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:14 smithi092 ceph-mon[29156]: pgmap v1402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:14 smithi189 ceph-mon[32756]: pgmap v1402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:14 smithi156 ceph-mon[32679]: pgmap v1402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:42:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:16 smithi092 ceph-mon[29156]: pgmap v1403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:16 smithi189 ceph-mon[32756]: pgmap v1403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:16 smithi156 ceph-mon[32679]: pgmap v1403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:42:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:18 smithi092 ceph-mon[29156]: pgmap v1404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1434.228352 secs 2024-04-26T18:42:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 737.214550 secs 2024-04-26T18:42:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:18 smithi189 ceph-mon[32756]: pgmap v1404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1434.228352 secs 2024-04-26T18:42:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 737.214550 secs 2024-04-26T18:42:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:18 smithi156 ceph-mon[32679]: pgmap v1404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1434.228352 secs 2024-04-26T18:42:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 737.214550 secs 2024-04-26T18:42:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:20 smithi092 ceph-mon[29156]: pgmap v1405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:20 smithi189 ceph-mon[32756]: pgmap v1405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:20 smithi156 ceph-mon[32679]: pgmap v1405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:22 smithi092 ceph-mon[29156]: pgmap v1406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:22 smithi189 ceph-mon[32756]: pgmap v1406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:22 smithi156 ceph-mon[32679]: pgmap v1406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1439.228484 secs 2024-04-26T18:42:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 742.214670 secs 2024-04-26T18:42:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1439.228484 secs 2024-04-26T18:42:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 742.214670 secs 2024-04-26T18:42:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1439.228484 secs 2024-04-26T18:42:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 742.214670 secs 2024-04-26T18:42:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:24 smithi092 ceph-mon[29156]: pgmap v1407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:24 smithi189 ceph-mon[32756]: pgmap v1407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:24 smithi156 ceph-mon[32679]: pgmap v1407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:26 smithi092 ceph-mon[29156]: pgmap v1408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:26 smithi189 ceph-mon[32756]: pgmap v1408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:26 smithi156 ceph-mon[32679]: pgmap v1408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:28 smithi092 ceph-mon[29156]: pgmap v1409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:28 smithi092 ceph-mon[29156]: 3 slow requests, 2 included below; oldest blocked for > 1444.228584 secs 2024-04-26T18:42:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:28 smithi092 ceph-mon[29156]: slow request 1444.160354 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:42:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:28 smithi092 ceph-mon[29156]: slow request 1444.228583 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:42:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 747.214787 secs 2024-04-26T18:42:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:28 smithi189 ceph-mon[32756]: pgmap v1409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:28 smithi189 ceph-mon[32756]: 3 slow requests, 2 included below; oldest blocked for > 1444.228584 secs 2024-04-26T18:42:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:28 smithi189 ceph-mon[32756]: slow request 1444.160354 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:42:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:28 smithi189 ceph-mon[32756]: slow request 1444.228583 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:42:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 747.214787 secs 2024-04-26T18:42:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:28 smithi156 ceph-mon[32679]: pgmap v1409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:28 smithi156 ceph-mon[32679]: 3 slow requests, 2 included below; oldest blocked for > 1444.228584 secs 2024-04-26T18:42:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:28 smithi156 ceph-mon[32679]: slow request 1444.160354 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T18:42:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:28 smithi156 ceph-mon[32679]: slow request 1444.228583 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T18:42:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 747.214787 secs 2024-04-26T18:42:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:30 smithi189 ceph-mon[32756]: pgmap v1410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:30 smithi156 ceph-mon[32679]: pgmap v1410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:30 smithi092 ceph-mon[29156]: pgmap v1410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:32 smithi189 ceph-mon[32756]: pgmap v1411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:32 smithi156 ceph-mon[32679]: pgmap v1411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:32 smithi092 ceph-mon[29156]: pgmap v1411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1449.228726 secs 2024-04-26T18:42:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 752.214921 secs 2024-04-26T18:42:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1449.228726 secs 2024-04-26T18:42:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 752.214921 secs 2024-04-26T18:42:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1449.228726 secs 2024-04-26T18:42:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 752.214921 secs 2024-04-26T18:42:35.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:34 smithi189 ceph-mon[32756]: pgmap v1412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:35.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:34 smithi156 ceph-mon[32679]: pgmap v1412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:34 smithi092 ceph-mon[29156]: pgmap v1412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:35 smithi189 ceph-mon[32756]: pgmap v1413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:36.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:35 smithi092 ceph-mon[29156]: pgmap v1413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:42:36.180+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:42:36.179 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:42:36.180+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:42:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:35 smithi156 ceph-mon[32679]: pgmap v1413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:36.187 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:42:36.188+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:42:36.188 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:42:36.188+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 15 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0066b0 con 0x5617fb906f00 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:38 smithi092 ceph-mon[29156]: pgmap v1414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:42:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:38 smithi189 ceph-mon[32756]: pgmap v1414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:42:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:38 smithi156 ceph-mon[32679]: pgmap v1414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:42:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:42:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:42:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:42:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:39 smithi092 ceph-mon[29156]: pgmap v1415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:42:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:39 smithi092 ceph-mon[29156]: pgmap v1416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:42:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1454.228885 secs 2024-04-26T18:42:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 757.215052 secs 2024-04-26T18:42:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:39 smithi189 ceph-mon[32756]: pgmap v1415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:42:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:39 smithi189 ceph-mon[32756]: pgmap v1416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:42:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1454.228885 secs 2024-04-26T18:42:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 757.215052 secs 2024-04-26T18:42:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:39 smithi156 ceph-mon[32679]: pgmap v1415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:42:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:39 smithi156 ceph-mon[32679]: pgmap v1416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:42:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1454.228885 secs 2024-04-26T18:42:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 757.215052 secs 2024-04-26T18:42:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:41 smithi092 ceph-mon[29156]: pgmap v1417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:41 smithi189 ceph-mon[32756]: pgmap v1417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:41 smithi156 ceph-mon[32679]: pgmap v1417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:43 smithi092 ceph-mon[29156]: pgmap v1418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:43 smithi189 ceph-mon[32756]: pgmap v1418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:43 smithi156 ceph-mon[32679]: pgmap v1418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1459.229013 secs 2024-04-26T18:42:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 762.215157 secs 2024-04-26T18:42:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1459.229013 secs 2024-04-26T18:42:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 762.215157 secs 2024-04-26T18:42:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1459.229013 secs 2024-04-26T18:42:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 762.215157 secs 2024-04-26T18:42:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:45 smithi092 ceph-mon[29156]: pgmap v1419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:45 smithi189 ceph-mon[32756]: pgmap v1419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:45 smithi156 ceph-mon[32679]: pgmap v1419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:47 smithi092 ceph-mon[29156]: pgmap v1420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:47 smithi189 ceph-mon[32756]: pgmap v1420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:47 smithi156 ceph-mon[32679]: pgmap v1420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:42:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:49 smithi092 ceph-mon[29156]: pgmap v1421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:42:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1464.229134 secs 2024-04-26T18:42:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 767.215286 secs 2024-04-26T18:42:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:49 smithi189 ceph-mon[32756]: pgmap v1421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:42:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1464.229134 secs 2024-04-26T18:42:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 767.215286 secs 2024-04-26T18:42:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:49 smithi156 ceph-mon[32679]: pgmap v1421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:42:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1464.229134 secs 2024-04-26T18:42:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 767.215286 secs 2024-04-26T18:42:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:51 smithi092 ceph-mon[29156]: pgmap v1422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:51 smithi189 ceph-mon[32756]: pgmap v1422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:51 smithi156 ceph-mon[32679]: pgmap v1422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:53 smithi092 ceph-mon[29156]: pgmap v1423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:53 smithi189 ceph-mon[32756]: pgmap v1423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:53 smithi156 ceph-mon[32679]: pgmap v1423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1469.229220 secs 2024-04-26T18:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 772.215409 secs 2024-04-26T18:42:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1469.229220 secs 2024-04-26T18:42:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 772.215409 secs 2024-04-26T18:42:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1469.229220 secs 2024-04-26T18:42:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 772.215409 secs 2024-04-26T18:42:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:55 smithi092 ceph-mon[29156]: pgmap v1424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:55 smithi189 ceph-mon[32756]: pgmap v1424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:55 smithi156 ceph-mon[32679]: pgmap v1424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:42:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:57 smithi092 ceph-mon[29156]: pgmap v1425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:57 smithi189 ceph-mon[32756]: pgmap v1425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:57 smithi156 ceph-mon[32679]: pgmap v1425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:59 smithi092 ceph-mon[29156]: pgmap v1426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1474.229373 secs 2024-04-26T18:42:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:42:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 777.215524 secs 2024-04-26T18:42:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:59 smithi189 ceph-mon[32756]: pgmap v1426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1474.229373 secs 2024-04-26T18:42:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:42:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 777.215524 secs 2024-04-26T18:42:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:59 smithi156 ceph-mon[32679]: pgmap v1426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:42:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1474.229373 secs 2024-04-26T18:42:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:42:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 777.215524 secs 2024-04-26T18:43:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:01 smithi092 ceph-mon[29156]: pgmap v1427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:01 smithi189 ceph-mon[32756]: pgmap v1427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:01 smithi156 ceph-mon[32679]: pgmap v1427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:03 smithi189 ceph-mon[32756]: pgmap v1428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:03 smithi156 ceph-mon[32679]: pgmap v1428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:03 smithi092 ceph-mon[29156]: pgmap v1428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:04 smithi189 ceph-mon[32756]: 3 slow requests, 1 included below; oldest blocked for > 1479.229514 secs 2024-04-26T18:43:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:04 smithi189 ceph-mon[32756]: slow request 1443.165824 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:04 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 782.215644 secs 2024-04-26T18:43:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:04 smithi156 ceph-mon[32679]: 3 slow requests, 1 included below; oldest blocked for > 1479.229514 secs 2024-04-26T18:43:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:04 smithi156 ceph-mon[32679]: slow request 1443.165824 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:43:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:04 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 782.215644 secs 2024-04-26T18:43:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:04 smithi092 ceph-mon[29156]: 3 slow requests, 1 included below; oldest blocked for > 1479.229514 secs 2024-04-26T18:43:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:04 smithi092 ceph-mon[29156]: slow request 1443.165824 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T18:43:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:04 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 782.215644 secs 2024-04-26T18:43:05.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:05 smithi189 ceph-mon[32756]: pgmap v1429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:05.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:05 smithi156 ceph-mon[32679]: pgmap v1429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:05 smithi092 ceph-mon[29156]: pgmap v1429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:07 smithi189 ceph-mon[32756]: pgmap v1430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:07 smithi156 ceph-mon[32679]: pgmap v1430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:07.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:07 smithi092 ceph-mon[29156]: pgmap v1430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:09 smithi189 ceph-mon[32756]: pgmap v1431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1484.229659 secs 2024-04-26T18:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 787.215785 secs 2024-04-26T18:43:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:09 smithi156 ceph-mon[32679]: pgmap v1431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1484.229659 secs 2024-04-26T18:43:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 787.215785 secs 2024-04-26T18:43:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:09 smithi092 ceph-mon[29156]: pgmap v1431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1484.229659 secs 2024-04-26T18:43:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 787.215785 secs 2024-04-26T18:43:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:11 smithi189 ceph-mon[32756]: pgmap v1432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:11 smithi156 ceph-mon[32679]: pgmap v1432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:11 smithi092 ceph-mon[29156]: pgmap v1432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:13 smithi189 ceph-mon[32756]: pgmap v1433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:13 smithi156 ceph-mon[32679]: pgmap v1433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:13 smithi092 ceph-mon[29156]: pgmap v1433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1489.229784 secs 2024-04-26T18:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 792.215921 secs 2024-04-26T18:43:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1489.229784 secs 2024-04-26T18:43:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 792.215921 secs 2024-04-26T18:43:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1489.229784 secs 2024-04-26T18:43:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 792.215921 secs 2024-04-26T18:43:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:15 smithi189 ceph-mon[32756]: pgmap v1434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:15 smithi156 ceph-mon[32679]: pgmap v1434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:15 smithi092 ceph-mon[29156]: pgmap v1434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:17 smithi189 ceph-mon[32756]: pgmap v1435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:17 smithi156 ceph-mon[32679]: pgmap v1435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:17 smithi092 ceph-mon[29156]: pgmap v1435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:19 smithi189 ceph-mon[32756]: pgmap v1436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1494.229913 secs 2024-04-26T18:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 797.216048 secs 2024-04-26T18:43:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:19 smithi156 ceph-mon[32679]: pgmap v1436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1494.229913 secs 2024-04-26T18:43:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 797.216048 secs 2024-04-26T18:43:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:19 smithi092 ceph-mon[29156]: pgmap v1436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1494.229913 secs 2024-04-26T18:43:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 797.216048 secs 2024-04-26T18:43:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:43:21.185+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:43:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:43:21.185+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:43:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:43:21.193+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:43:21.193 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:43:21.193+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 16 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:43:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:21 smithi189 ceph-mon[32756]: pgmap v1437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:21 smithi156 ceph-mon[32679]: pgmap v1437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:21 smithi092 ceph-mon[29156]: pgmap v1437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:23 smithi189 ceph-mon[32756]: pgmap v1438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:23 smithi156 ceph-mon[32679]: pgmap v1438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:23 smithi092 ceph-mon[29156]: pgmap v1438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1499.230000 secs 2024-04-26T18:43:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 802.216155 secs 2024-04-26T18:43:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1499.230000 secs 2024-04-26T18:43:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 802.216155 secs 2024-04-26T18:43:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1499.230000 secs 2024-04-26T18:43:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 802.216155 secs 2024-04-26T18:43:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:25 smithi189 ceph-mon[32756]: pgmap v1439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:25 smithi156 ceph-mon[32679]: pgmap v1439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:25 smithi092 ceph-mon[29156]: pgmap v1439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:27 smithi189 ceph-mon[32756]: pgmap v1440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:27 smithi156 ceph-mon[32679]: pgmap v1440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:27 smithi092 ceph-mon[29156]: pgmap v1440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:29 smithi189 ceph-mon[32756]: pgmap v1441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1504.230130 secs 2024-04-26T18:43:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 807.216275 secs 2024-04-26T18:43:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:29 smithi156 ceph-mon[32679]: pgmap v1441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1504.230130 secs 2024-04-26T18:43:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 807.216275 secs 2024-04-26T18:43:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:29 smithi092 ceph-mon[29156]: pgmap v1441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1504.230130 secs 2024-04-26T18:43:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 807.216275 secs 2024-04-26T18:43:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:31 smithi189 ceph-mon[32756]: pgmap v1442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:31 smithi156 ceph-mon[32679]: pgmap v1442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:31 smithi092 ceph-mon[29156]: pgmap v1442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:33 smithi189 ceph-mon[32756]: pgmap v1443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:33 smithi156 ceph-mon[32679]: pgmap v1443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:33 smithi092 ceph-mon[29156]: pgmap v1443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1509.230256 secs 2024-04-26T18:43:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 812.216390 secs 2024-04-26T18:43:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1509.230256 secs 2024-04-26T18:43:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 812.216390 secs 2024-04-26T18:43:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1509.230256 secs 2024-04-26T18:43:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 812.216390 secs 2024-04-26T18:43:35.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:35 smithi156 ceph-mon[32679]: pgmap v1444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:35 smithi189 ceph-mon[32756]: pgmap v1444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:35 smithi092 ceph-mon[29156]: pgmap v1444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:37 smithi189 ceph-mon[32756]: pgmap v1445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:37 smithi156 ceph-mon[32679]: pgmap v1445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:37 smithi092 ceph-mon[29156]: pgmap v1445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:43:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: pgmap v1446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1514.230329 secs 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 817.216477 secs 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: pgmap v1447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: pgmap v1448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:43:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: pgmap v1446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1514.230329 secs 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 817.216477 secs 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: pgmap v1447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: pgmap v1448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:43:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: pgmap v1446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1514.230329 secs 2024-04-26T18:43:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 817.216477 secs 2024-04-26T18:43:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: pgmap v1447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: pgmap v1448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:43:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:40 smithi189 ceph-mon[32756]: pgmap v1449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:40 smithi156 ceph-mon[32679]: pgmap v1449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:40 smithi092 ceph-mon[29156]: pgmap v1449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:42 smithi189 ceph-mon[32756]: pgmap v1450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:42 smithi156 ceph-mon[32679]: pgmap v1450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:42 smithi092 ceph-mon[29156]: pgmap v1450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:43:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1519.230456 secs 2024-04-26T18:43:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 822.216618 secs 2024-04-26T18:43:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1519.230456 secs 2024-04-26T18:43:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 822.216618 secs 2024-04-26T18:43:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1519.230456 secs 2024-04-26T18:43:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 822.216618 secs 2024-04-26T18:43:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:44 smithi189 ceph-mon[32756]: pgmap v1451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:44 smithi156 ceph-mon[32679]: pgmap v1451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:44 smithi092 ceph-mon[29156]: pgmap v1451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:46 smithi189 ceph-mon[32756]: pgmap v1452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:46 smithi156 ceph-mon[32679]: pgmap v1452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:46 smithi092 ceph-mon[29156]: pgmap v1452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:43:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1524.230598 secs 2024-04-26T18:43:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1524.230598 secs 2024-04-26T18:43:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1524.230598 secs 2024-04-26T18:43:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 827.216722 secs 2024-04-26T18:43:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:49 smithi189 ceph-mon[32756]: pgmap v1453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:43:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 827.216722 secs 2024-04-26T18:43:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:49 smithi156 ceph-mon[32679]: pgmap v1453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:43:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 827.216722 secs 2024-04-26T18:43:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:49 smithi092 ceph-mon[29156]: pgmap v1453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:43:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:50 smithi189 ceph-mon[32756]: pgmap v1454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:50 smithi156 ceph-mon[32679]: pgmap v1454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:50 smithi092 ceph-mon[29156]: pgmap v1454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:52 smithi189 ceph-mon[32756]: pgmap v1455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:52 smithi156 ceph-mon[32679]: pgmap v1455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:52 smithi092 ceph-mon[29156]: pgmap v1455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1529.230723 secs 2024-04-26T18:43:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 832.216796 secs 2024-04-26T18:43:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1529.230723 secs 2024-04-26T18:43:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 832.216796 secs 2024-04-26T18:43:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1529.230723 secs 2024-04-26T18:43:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 832.216796 secs 2024-04-26T18:43:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:54 smithi189 ceph-mon[32756]: pgmap v1456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:54 smithi156 ceph-mon[32679]: pgmap v1456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:54 smithi092 ceph-mon[29156]: pgmap v1456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:56 smithi189 ceph-mon[32756]: pgmap v1457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:56 smithi156 ceph-mon[32679]: pgmap v1457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:56 smithi092 ceph-mon[29156]: pgmap v1457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:43:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1534.230785 secs 2024-04-26T18:43:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1534.230785 secs 2024-04-26T18:43:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1534.230785 secs 2024-04-26T18:43:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 837.216903 secs 2024-04-26T18:43:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:43:59 smithi189 ceph-mon[32756]: pgmap v1458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 837.216903 secs 2024-04-26T18:43:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:43:59 smithi156 ceph-mon[32679]: pgmap v1458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:43:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 837.216903 secs 2024-04-26T18:43:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:43:59 smithi092 ceph-mon[29156]: pgmap v1458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:00 smithi189 ceph-mon[32756]: pgmap v1459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:00 smithi156 ceph-mon[32679]: pgmap v1459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:00 smithi092 ceph-mon[29156]: pgmap v1459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:02 smithi189 ceph-mon[32756]: pgmap v1460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:02 smithi156 ceph-mon[32679]: pgmap v1460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:02 smithi092 ceph-mon[29156]: pgmap v1460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1539.230846 secs 2024-04-26T18:44:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 842.217024 secs 2024-04-26T18:44:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1539.230846 secs 2024-04-26T18:44:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 842.217024 secs 2024-04-26T18:44:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1539.230846 secs 2024-04-26T18:44:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 842.217024 secs 2024-04-26T18:44:05.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:04 smithi156 ceph-mon[32679]: pgmap v1461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:04 smithi189 ceph-mon[32756]: pgmap v1461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:04 smithi092 ceph-mon[29156]: pgmap v1461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:06 smithi189 ceph-mon[32756]: pgmap v1462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:06 smithi156 ceph-mon[32679]: pgmap v1462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:06 smithi092 ceph-mon[29156]: pgmap v1462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1544.230909 secs 2024-04-26T18:44:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1544.230909 secs 2024-04-26T18:44:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1544.230909 secs 2024-04-26T18:44:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 847.217115 secs 2024-04-26T18:44:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:09 smithi189 ceph-mon[32756]: pgmap v1463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:09.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 847.217115 secs 2024-04-26T18:44:09.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:09 smithi092 ceph-mon[29156]: pgmap v1463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 847.217115 secs 2024-04-26T18:44:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:09 smithi156 ceph-mon[32679]: pgmap v1463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:11 smithi156 ceph-mon[32679]: pgmap v1464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:11 smithi092 ceph-mon[29156]: pgmap v1464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:11 smithi189 ceph-mon[32756]: pgmap v1464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:12 smithi189 ceph-mon[32756]: pgmap v1465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:12 smithi156 ceph-mon[32679]: pgmap v1465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:12 smithi092 ceph-mon[29156]: pgmap v1465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1549.230994 secs 2024-04-26T18:44:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 852.217235 secs 2024-04-26T18:44:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1549.230994 secs 2024-04-26T18:44:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 852.217235 secs 2024-04-26T18:44:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1549.230994 secs 2024-04-26T18:44:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 852.217235 secs 2024-04-26T18:44:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:14 smithi189 ceph-mon[32756]: pgmap v1466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:14 smithi156 ceph-mon[32679]: pgmap v1466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:14 smithi092 ceph-mon[29156]: pgmap v1466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:16 smithi189 ceph-mon[32756]: pgmap v1467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:16 smithi156 ceph-mon[32679]: pgmap v1467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:16 smithi092 ceph-mon[29156]: pgmap v1467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1554.231066 secs 2024-04-26T18:44:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1554.231066 secs 2024-04-26T18:44:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1554.231066 secs 2024-04-26T18:44:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 857.217356 secs 2024-04-26T18:44:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:19 smithi189 ceph-mon[32756]: pgmap v1468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 857.217356 secs 2024-04-26T18:44:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:19 smithi156 ceph-mon[32679]: pgmap v1468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 857.217356 secs 2024-04-26T18:44:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:19 smithi092 ceph-mon[29156]: pgmap v1468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:20 smithi189 ceph-mon[32756]: pgmap v1469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:20 smithi156 ceph-mon[32679]: pgmap v1469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:20 smithi092 ceph-mon[29156]: pgmap v1469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:22 smithi189 ceph-mon[32756]: pgmap v1470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:22 smithi156 ceph-mon[32679]: pgmap v1470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:22 smithi092 ceph-mon[29156]: pgmap v1470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1559.231184 secs 2024-04-26T18:44:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 862.217483 secs 2024-04-26T18:44:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1559.231184 secs 2024-04-26T18:44:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 862.217483 secs 2024-04-26T18:44:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1559.231184 secs 2024-04-26T18:44:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 862.217483 secs 2024-04-26T18:44:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:24 smithi189 ceph-mon[32756]: pgmap v1471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:24 smithi156 ceph-mon[32679]: pgmap v1471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:24 smithi092 ceph-mon[29156]: pgmap v1471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:26 smithi189 ceph-mon[32756]: pgmap v1472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:26 smithi156 ceph-mon[32679]: pgmap v1472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:26 smithi092 ceph-mon[29156]: pgmap v1472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1564.231314 secs 2024-04-26T18:44:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1564.231314 secs 2024-04-26T18:44:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1564.231314 secs 2024-04-26T18:44:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 867.217553 secs 2024-04-26T18:44:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:29 smithi189 ceph-mon[32756]: pgmap v1473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 867.217553 secs 2024-04-26T18:44:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:29 smithi156 ceph-mon[32679]: pgmap v1473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 867.217553 secs 2024-04-26T18:44:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:29 smithi092 ceph-mon[29156]: pgmap v1473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:30 smithi189 ceph-mon[32756]: pgmap v1474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:30 smithi156 ceph-mon[32679]: pgmap v1474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:30 smithi092 ceph-mon[29156]: pgmap v1474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:32 smithi189 ceph-mon[32756]: pgmap v1475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:32 smithi156 ceph-mon[32679]: pgmap v1475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:32 smithi092 ceph-mon[29156]: pgmap v1475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1569.231384 secs 2024-04-26T18:44:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 872.217639 secs 2024-04-26T18:44:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1569.231384 secs 2024-04-26T18:44:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 872.217639 secs 2024-04-26T18:44:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1569.231384 secs 2024-04-26T18:44:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 872.217639 secs 2024-04-26T18:44:35.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:34 smithi156 ceph-mon[32679]: pgmap v1476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:34 smithi189 ceph-mon[32756]: pgmap v1476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:34 smithi092 ceph-mon[29156]: pgmap v1476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:36 smithi189 ceph-mon[32756]: pgmap v1477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:36 smithi156 ceph-mon[32679]: pgmap v1477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:36 smithi092 ceph-mon[29156]: pgmap v1477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1574.231468 secs 2024-04-26T18:44:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1574.231468 secs 2024-04-26T18:44:39.115 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1574.231468 secs 2024-04-26T18:44:39.868 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 877.217703 secs 2024-04-26T18:44:39.868 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: pgmap v1478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:39.868 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 877.217703 secs 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: pgmap v1478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 877.217703 secs 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: pgmap v1478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:44:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:44:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:40 smithi189 ceph-mon[32756]: pgmap v1479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:44:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:40 smithi189 ceph-mon[32756]: pgmap v1480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:40 smithi156 ceph-mon[32679]: pgmap v1479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:44:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:40 smithi156 ceph-mon[32679]: pgmap v1480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:40 smithi092 ceph-mon[29156]: pgmap v1479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:44:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:40 smithi092 ceph-mon[29156]: pgmap v1480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:42 smithi189 ceph-mon[32756]: pgmap v1481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:42 smithi156 ceph-mon[32679]: pgmap v1481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:42 smithi092 ceph-mon[29156]: pgmap v1481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1579.231582 secs 2024-04-26T18:44:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1579.231582 secs 2024-04-26T18:44:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1579.231582 secs 2024-04-26T18:44:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 882.217811 secs 2024-04-26T18:44:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:44 smithi189 ceph-mon[32756]: pgmap v1482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 882.217811 secs 2024-04-26T18:44:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:44 smithi156 ceph-mon[32679]: pgmap v1482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 882.217811 secs 2024-04-26T18:44:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:44 smithi092 ceph-mon[29156]: pgmap v1482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:46 smithi189 ceph-mon[32756]: pgmap v1483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:46 smithi156 ceph-mon[32679]: pgmap v1483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:46 smithi092 ceph-mon[29156]: pgmap v1483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:44:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:48 smithi189 ceph-mon[32756]: pgmap v1484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1584.231696 secs 2024-04-26T18:44:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 887.217946 secs 2024-04-26T18:44:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:48 smithi156 ceph-mon[32679]: pgmap v1484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1584.231696 secs 2024-04-26T18:44:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 887.217946 secs 2024-04-26T18:44:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:48 smithi092 ceph-mon[29156]: pgmap v1484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:44:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1584.231696 secs 2024-04-26T18:44:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 887.217946 secs 2024-04-26T18:44:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:50 smithi189 ceph-mon[32756]: pgmap v1485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:44:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:50 smithi156 ceph-mon[32679]: pgmap v1485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:44:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:50 smithi092 ceph-mon[29156]: pgmap v1485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:44:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:52 smithi189 ceph-mon[32756]: pgmap v1486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:52 smithi156 ceph-mon[32679]: pgmap v1486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:52 smithi092 ceph-mon[29156]: pgmap v1486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1589.231811 secs 2024-04-26T18:44:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 892.218086 secs 2024-04-26T18:44:53.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1589.231811 secs 2024-04-26T18:44:53.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 892.218086 secs 2024-04-26T18:44:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1589.231811 secs 2024-04-26T18:44:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 892.218086 secs 2024-04-26T18:44:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:54 smithi189 ceph-mon[32756]: pgmap v1487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:54 smithi156 ceph-mon[32679]: pgmap v1487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:54 smithi092 ceph-mon[29156]: pgmap v1487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:56 smithi189 ceph-mon[32756]: pgmap v1488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:56 smithi156 ceph-mon[32679]: pgmap v1488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:56 smithi092 ceph-mon[29156]: pgmap v1488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:44:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:58 smithi189 ceph-mon[32756]: pgmap v1489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1594.231928 secs 2024-04-26T18:44:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:44:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 897.218205 secs 2024-04-26T18:44:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:58 smithi156 ceph-mon[32679]: pgmap v1489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1594.231928 secs 2024-04-26T18:44:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:44:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 897.218205 secs 2024-04-26T18:44:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:58 smithi092 ceph-mon[29156]: pgmap v1489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:44:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1594.231928 secs 2024-04-26T18:44:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:44:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 897.218205 secs 2024-04-26T18:45:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:00 smithi189 ceph-mon[32756]: pgmap v1490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:00 smithi156 ceph-mon[32679]: pgmap v1490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:00 smithi092 ceph-mon[29156]: pgmap v1490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:02 smithi189 ceph-mon[32756]: pgmap v1491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:02 smithi156 ceph-mon[32679]: pgmap v1491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:02 smithi092 ceph-mon[29156]: pgmap v1491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1599.232041 secs 2024-04-26T18:45:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 902.218332 secs 2024-04-26T18:45:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1599.232041 secs 2024-04-26T18:45:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 902.218332 secs 2024-04-26T18:45:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1599.232041 secs 2024-04-26T18:45:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 902.218332 secs 2024-04-26T18:45:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:04 smithi189 ceph-mon[32756]: pgmap v1492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:04 smithi156 ceph-mon[32679]: pgmap v1492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:04 smithi092 ceph-mon[29156]: pgmap v1492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:06 smithi189 ceph-mon[32756]: pgmap v1493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:06 smithi156 ceph-mon[32679]: pgmap v1493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:06 smithi092 ceph-mon[29156]: pgmap v1493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:08 smithi189 ceph-mon[32756]: pgmap v1494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1604.232191 secs 2024-04-26T18:45:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 907.218454 secs 2024-04-26T18:45:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:08 smithi156 ceph-mon[32679]: pgmap v1494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1604.232191 secs 2024-04-26T18:45:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 907.218454 secs 2024-04-26T18:45:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:08 smithi092 ceph-mon[29156]: pgmap v1494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1604.232191 secs 2024-04-26T18:45:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 907.218454 secs 2024-04-26T18:45:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:10 smithi189 ceph-mon[32756]: pgmap v1495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:10 smithi156 ceph-mon[32679]: pgmap v1495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:10 smithi092 ceph-mon[29156]: pgmap v1495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:12 smithi189 ceph-mon[32756]: pgmap v1496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:12 smithi156 ceph-mon[32679]: pgmap v1496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:12 smithi092 ceph-mon[29156]: pgmap v1496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1609.232310 secs 2024-04-26T18:45:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 912.218586 secs 2024-04-26T18:45:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1609.232310 secs 2024-04-26T18:45:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 912.218586 secs 2024-04-26T18:45:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1609.232310 secs 2024-04-26T18:45:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 912.218586 secs 2024-04-26T18:45:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:14 smithi189 ceph-mon[32756]: pgmap v1497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:14 smithi156 ceph-mon[32679]: pgmap v1497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:14 smithi092 ceph-mon[29156]: pgmap v1497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:16 smithi189 ceph-mon[32756]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:16 smithi156 ceph-mon[32679]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:16 smithi092 ceph-mon[29156]: pgmap v1498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:18 smithi189 ceph-mon[32756]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1614.232438 secs 2024-04-26T18:45:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 917.218712 secs 2024-04-26T18:45:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:18 smithi156 ceph-mon[32679]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1614.232438 secs 2024-04-26T18:45:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 917.218712 secs 2024-04-26T18:45:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:18 smithi092 ceph-mon[29156]: pgmap v1499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1614.232438 secs 2024-04-26T18:45:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 917.218712 secs 2024-04-26T18:45:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:20 smithi156 ceph-mon[32679]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:20 smithi092 ceph-mon[29156]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:20 smithi189 ceph-mon[32756]: pgmap v1500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:22 smithi156 ceph-mon[32679]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:22 smithi092 ceph-mon[29156]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:22 smithi189 ceph-mon[32756]: pgmap v1501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1619.232582 secs 2024-04-26T18:45:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 922.218841 secs 2024-04-26T18:45:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1619.232582 secs 2024-04-26T18:45:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 922.218841 secs 2024-04-26T18:45:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1619.232582 secs 2024-04-26T18:45:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 922.218841 secs 2024-04-26T18:45:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:24 smithi156 ceph-mon[32679]: pgmap v1502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:24 smithi092 ceph-mon[29156]: pgmap v1502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:24 smithi189 ceph-mon[32756]: pgmap v1502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:26 smithi156 ceph-mon[32679]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:26.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:26 smithi092 ceph-mon[29156]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:26 smithi189 ceph-mon[32756]: pgmap v1503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:28 smithi156 ceph-mon[32679]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1624.232675 secs 2024-04-26T18:45:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 927.218916 secs 2024-04-26T18:45:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:28 smithi092 ceph-mon[29156]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1624.232675 secs 2024-04-26T18:45:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 927.218916 secs 2024-04-26T18:45:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:28 smithi189 ceph-mon[32756]: pgmap v1504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1624.232675 secs 2024-04-26T18:45:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 927.218916 secs 2024-04-26T18:45:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:30 smithi156 ceph-mon[32679]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:30 smithi092 ceph-mon[29156]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:30 smithi189 ceph-mon[32756]: pgmap v1505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:32 smithi156 ceph-mon[32679]: pgmap v1506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:32 smithi092 ceph-mon[29156]: pgmap v1506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:32 smithi189 ceph-mon[32756]: pgmap v1506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1629.232796 secs 2024-04-26T18:45:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 932.219036 secs 2024-04-26T18:45:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1629.232796 secs 2024-04-26T18:45:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 932.219036 secs 2024-04-26T18:45:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1629.232796 secs 2024-04-26T18:45:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 932.219036 secs 2024-04-26T18:45:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:34 smithi156 ceph-mon[32679]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T18:45:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:34 smithi092 ceph-mon[29156]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T18:45:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:34 smithi189 ceph-mon[32756]: pgmap v1507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T18:45:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:45:36.203+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:45:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:45:36.203+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:45:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:45:36.209+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:45:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:45:36.209+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 17 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:45:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:36 smithi156 ceph-mon[32679]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:36.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:36 smithi189 ceph-mon[32756]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:36 smithi092 ceph-mon[29156]: pgmap v1508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:38 smithi156 ceph-mon[32679]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T18:45:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1634.232914 secs 2024-04-26T18:45:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 937.219151 secs 2024-04-26T18:45:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:38 smithi092 ceph-mon[29156]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T18:45:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1634.232914 secs 2024-04-26T18:45:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 937.219151 secs 2024-04-26T18:45:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:38 smithi189 ceph-mon[32756]: pgmap v1509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T18:45:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1634.232914 secs 2024-04-26T18:45:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 937.219151 secs 2024-04-26T18:45:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:45:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:40 smithi092 ceph-mon[29156]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:45:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:40 smithi189 ceph-mon[32756]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:45:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:40 smithi156 ceph-mon[32679]: pgmap v1510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T18:45:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:45:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:45:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:45:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:41 smithi092 ceph-mon[29156]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-26T18:45:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:41 smithi092 ceph-mon[29156]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T18:45:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:41 smithi189 ceph-mon[32756]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-26T18:45:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:41 smithi189 ceph-mon[32756]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T18:45:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:41 smithi156 ceph-mon[32679]: pgmap v1511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-26T18:45:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:41 smithi156 ceph-mon[32679]: pgmap v1512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T18:45:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:43 smithi092 ceph-mon[29156]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 350 B/s wr, 4 op/s 2024-04-26T18:45:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1639.233005 secs 2024-04-26T18:45:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 942.219285 secs 2024-04-26T18:45:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:43 smithi189 ceph-mon[32756]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 350 B/s wr, 4 op/s 2024-04-26T18:45:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1639.233005 secs 2024-04-26T18:45:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 942.219285 secs 2024-04-26T18:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:43 smithi156 ceph-mon[32679]: pgmap v1513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 350 B/s wr, 4 op/s 2024-04-26T18:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1639.233005 secs 2024-04-26T18:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 942.219285 secs 2024-04-26T18:45:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:45 smithi092 ceph-mon[29156]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:45 smithi189 ceph-mon[32756]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:45 smithi156 ceph-mon[32679]: pgmap v1514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:47 smithi092 ceph-mon[29156]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:47 smithi189 ceph-mon[32756]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:47 smithi156 ceph-mon[32679]: pgmap v1515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:45:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1644.233126 secs 2024-04-26T18:45:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 947.219394 secs 2024-04-26T18:45:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1644.233126 secs 2024-04-26T18:45:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 947.219394 secs 2024-04-26T18:45:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1644.233126 secs 2024-04-26T18:45:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 947.219394 secs 2024-04-26T18:45:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:49 smithi092 ceph-mon[29156]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:45:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:49 smithi189 ceph-mon[32756]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:45:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:49 smithi156 ceph-mon[32679]: pgmap v1516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:45:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:51 smithi092 ceph-mon[29156]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:45:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:51 smithi189 ceph-mon[32756]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:45:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:51 smithi156 ceph-mon[32679]: pgmap v1517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:45:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:53 smithi092 ceph-mon[29156]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1649.233217 secs 2024-04-26T18:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 952.219517 secs 2024-04-26T18:45:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:53 smithi189 ceph-mon[32756]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1649.233217 secs 2024-04-26T18:45:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 952.219517 secs 2024-04-26T18:45:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:53 smithi156 ceph-mon[32679]: pgmap v1518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1649.233217 secs 2024-04-26T18:45:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 952.219517 secs 2024-04-26T18:45:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:55 smithi092 ceph-mon[29156]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:55 smithi189 ceph-mon[32756]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:55 smithi156 ceph-mon[32679]: pgmap v1519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:45:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:57 smithi092 ceph-mon[29156]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:57 smithi189 ceph-mon[32756]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:57 smithi156 ceph-mon[32679]: pgmap v1520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:45:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1654.233338 secs 2024-04-26T18:45:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 957.219597 secs 2024-04-26T18:45:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1654.233338 secs 2024-04-26T18:45:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 957.219597 secs 2024-04-26T18:45:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1654.233338 secs 2024-04-26T18:45:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 957.219597 secs 2024-04-26T18:45:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:45:59 smithi092 ceph-mon[29156]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:45:59 smithi189 ceph-mon[32756]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:45:59 smithi156 ceph-mon[32679]: pgmap v1521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:01.725 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:46:01.434+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:46:01.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:46:01.434+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:46:01.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:46:01.434+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:46:01.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:46:01.434+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:46:01.726 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:46:01.434+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:46:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:01 smithi092 ceph-mon[29156]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:01 smithi189 ceph-mon[32756]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:01 smithi156 ceph-mon[32679]: pgmap v1522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:03 smithi092 ceph-mon[29156]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1659.233451 secs 2024-04-26T18:46:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:03 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 962.219740 secs 2024-04-26T18:46:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:03 smithi189 ceph-mon[32756]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1659.233451 secs 2024-04-26T18:46:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:03 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 962.219740 secs 2024-04-26T18:46:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:03 smithi156 ceph-mon[32679]: pgmap v1523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1659.233451 secs 2024-04-26T18:46:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:03 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 962.219740 secs 2024-04-26T18:46:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:05 smithi092 ceph-mon[29156]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:05 smithi189 ceph-mon[32756]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:05 smithi156 ceph-mon[32679]: pgmap v1524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:07.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:07 smithi156 ceph-mon[32679]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:07 smithi092 ceph-mon[29156]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:07 smithi189 ceph-mon[32756]: pgmap v1525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1664.233555 secs 2024-04-26T18:46:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:08 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 967.219806 secs 2024-04-26T18:46:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1664.233555 secs 2024-04-26T18:46:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:08 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 967.219806 secs 2024-04-26T18:46:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1664.233555 secs 2024-04-26T18:46:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:08 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 967.219806 secs 2024-04-26T18:46:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:09 smithi092 ceph-mon[29156]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:09 smithi189 ceph-mon[32756]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:09 smithi156 ceph-mon[32679]: pgmap v1526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:11 smithi189 ceph-mon[32756]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:11 smithi156 ceph-mon[32679]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:11 smithi092 ceph-mon[29156]: pgmap v1527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:13 smithi092 ceph-mon[29156]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1669.233691 secs 2024-04-26T18:46:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:13 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 972.219941 secs 2024-04-26T18:46:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:13 smithi189 ceph-mon[32756]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1669.233691 secs 2024-04-26T18:46:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:13 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 972.219941 secs 2024-04-26T18:46:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:13 smithi156 ceph-mon[32679]: pgmap v1528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T18:46:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1669.233691 secs 2024-04-26T18:46:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:13 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 972.219941 secs 2024-04-26T18:46:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:15 smithi189 ceph-mon[32756]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:15 smithi156 ceph-mon[32679]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:15 smithi092 ceph-mon[29156]: pgmap v1529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T18:46:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:17 smithi189 ceph-mon[32756]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:17 smithi156 ceph-mon[32679]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:17 smithi092 ceph-mon[29156]: pgmap v1530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1674.233843 secs 2024-04-26T18:46:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:18 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 977.220021 secs 2024-04-26T18:46:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1674.233843 secs 2024-04-26T18:46:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:18 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 977.220021 secs 2024-04-26T18:46:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1674.233843 secs 2024-04-26T18:46:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:18 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 977.220021 secs 2024-04-26T18:46:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:19 smithi189 ceph-mon[32756]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:19 smithi156 ceph-mon[32679]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:19 smithi092 ceph-mon[29156]: pgmap v1531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:21 smithi189 ceph-mon[32756]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:21 smithi156 ceph-mon[32679]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:21 smithi092 ceph-mon[29156]: pgmap v1532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:24.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:23 smithi092 ceph-mon[29156]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:24.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1679.233966 secs 2024-04-26T18:46:24.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:23 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 982.220165 secs 2024-04-26T18:46:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:23 smithi189 ceph-mon[32756]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1679.233966 secs 2024-04-26T18:46:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:23 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 982.220165 secs 2024-04-26T18:46:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:23 smithi156 ceph-mon[32679]: pgmap v1533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1679.233966 secs 2024-04-26T18:46:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:23 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 982.220165 secs 2024-04-26T18:46:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:25 smithi189 ceph-mon[32756]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:25 smithi156 ceph-mon[32679]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:25 smithi092 ceph-mon[29156]: pgmap v1534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:27 smithi189 ceph-mon[32756]: pgmap v1535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:27 smithi156 ceph-mon[32679]: pgmap v1535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:27 smithi092 ceph-mon[29156]: pgmap v1535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1684.234079 secs 2024-04-26T18:46:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 987.220239 secs 2024-04-26T18:46:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1684.234079 secs 2024-04-26T18:46:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 987.220239 secs 2024-04-26T18:46:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1684.234079 secs 2024-04-26T18:46:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 987.220239 secs 2024-04-26T18:46:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:29 smithi189 ceph-mon[32756]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:29 smithi156 ceph-mon[32679]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:29 smithi092 ceph-mon[29156]: pgmap v1536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:31 smithi189 ceph-mon[32756]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:31 smithi156 ceph-mon[32679]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:31 smithi092 ceph-mon[29156]: pgmap v1537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:33 smithi189 ceph-mon[32756]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1689.234199 secs 2024-04-26T18:46:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 992.220350 secs 2024-04-26T18:46:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:33 smithi156 ceph-mon[32679]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1689.234199 secs 2024-04-26T18:46:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 992.220350 secs 2024-04-26T18:46:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:33 smithi092 ceph-mon[29156]: pgmap v1538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1689.234199 secs 2024-04-26T18:46:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 992.220350 secs 2024-04-26T18:46:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:35 smithi189 ceph-mon[32756]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:35 smithi156 ceph-mon[32679]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:35 smithi092 ceph-mon[29156]: pgmap v1539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:36 smithi189 ceph-mon[32756]: pgmap v1540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:36 smithi156 ceph-mon[32679]: pgmap v1540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:36 smithi092 ceph-mon[29156]: pgmap v1540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1694.234340 secs 2024-04-26T18:46:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:39 smithi189 ceph-mon[32756]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 997.220468 secs 2024-04-26T18:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1694.234340 secs 2024-04-26T18:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:39 smithi156 ceph-mon[32679]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 997.220468 secs 2024-04-26T18:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1694.234340 secs 2024-04-26T18:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:39 smithi092 ceph-mon[29156]: pgmap v1541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 997.220468 secs 2024-04-26T18:46:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:41 smithi189 ceph-mon[32756]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:41 smithi156 ceph-mon[32679]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:41 smithi092 ceph-mon[29156]: pgmap v1542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:46:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:42 smithi189 ceph-mon[32756]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:46:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:42 smithi189 ceph-mon[32756]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:42 smithi156 ceph-mon[32679]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:46:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:42 smithi156 ceph-mon[32679]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:42 smithi092 ceph-mon[29156]: pgmap v1543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:46:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:42 smithi092 ceph-mon[29156]: pgmap v1544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:44 smithi189 ceph-mon[32756]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1699.234458 secs 2024-04-26T18:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1002.220531 secs 2024-04-26T18:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:44 smithi156 ceph-mon[32679]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1699.234458 secs 2024-04-26T18:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1002.220531 secs 2024-04-26T18:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:44 smithi092 ceph-mon[29156]: pgmap v1545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1699.234458 secs 2024-04-26T18:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1002.220531 secs 2024-04-26T18:46:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:46 smithi189 ceph-mon[32756]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:46 smithi156 ceph-mon[32679]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:46 smithi092 ceph-mon[29156]: pgmap v1546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:48 smithi189 ceph-mon[32756]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:48 smithi156 ceph-mon[32679]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:48 smithi092 ceph-mon[29156]: pgmap v1547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1704.234566 secs 2024-04-26T18:46:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1007.220653 secs 2024-04-26T18:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1704.234566 secs 2024-04-26T18:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1007.220653 secs 2024-04-26T18:46:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1704.234566 secs 2024-04-26T18:46:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1007.220653 secs 2024-04-26T18:46:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:50 smithi189 ceph-mon[32756]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:50 smithi156 ceph-mon[32679]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:50 smithi092 ceph-mon[29156]: pgmap v1548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:46:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:52 smithi189 ceph-mon[32756]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:46:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:52 smithi156 ceph-mon[32679]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:46:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:52 smithi092 ceph-mon[29156]: pgmap v1549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:46:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:54 smithi156 ceph-mon[32679]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1709.234687 secs 2024-04-26T18:46:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1012.220730 secs 2024-04-26T18:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:54 smithi092 ceph-mon[29156]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1709.234687 secs 2024-04-26T18:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1012.220730 secs 2024-04-26T18:46:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:54 smithi189 ceph-mon[32756]: pgmap v1550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1709.234687 secs 2024-04-26T18:46:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1012.220730 secs 2024-04-26T18:46:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:56 smithi156 ceph-mon[32679]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:56 smithi092 ceph-mon[29156]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:56 smithi189 ceph-mon[32756]: pgmap v1551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:46:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:58 smithi156 ceph-mon[32679]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:58 smithi092 ceph-mon[29156]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:58 smithi189 ceph-mon[32756]: pgmap v1552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:46:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1714.234783 secs 2024-04-26T18:46:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:46:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1017.220845 secs 2024-04-26T18:46:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1714.234783 secs 2024-04-26T18:46:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:46:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1017.220845 secs 2024-04-26T18:46:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1714.234783 secs 2024-04-26T18:46:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:46:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1017.220845 secs 2024-04-26T18:47:00.668 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:00 smithi092 ceph-mon[29156]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:47:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:00 smithi156 ceph-mon[32679]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:47:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:00 smithi189 ceph-mon[32756]: pgmap v1553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:47:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:02 smithi156 ceph-mon[32679]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:02 smithi092 ceph-mon[29156]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:02 smithi189 ceph-mon[32756]: pgmap v1554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:04 smithi156 ceph-mon[32679]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1719.234892 secs 2024-04-26T18:47:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:04 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1022.220971 secs 2024-04-26T18:47:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:04 smithi092 ceph-mon[29156]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1719.234892 secs 2024-04-26T18:47:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:04 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1022.220971 secs 2024-04-26T18:47:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:04 smithi189 ceph-mon[32756]: pgmap v1555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:47:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1719.234892 secs 2024-04-26T18:47:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:04 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1022.220971 secs 2024-04-26T18:47:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:06 smithi156 ceph-mon[32679]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:06 smithi092 ceph-mon[29156]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:06 smithi189 ceph-mon[32756]: pgmap v1556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:08 smithi156 ceph-mon[32679]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:08.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:08 smithi189 ceph-mon[32756]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:08 smithi092 ceph-mon[29156]: pgmap v1557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1724.235043 secs 2024-04-26T18:47:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1027.221100 secs 2024-04-26T18:47:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1724.235043 secs 2024-04-26T18:47:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1027.221100 secs 2024-04-26T18:47:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1724.235043 secs 2024-04-26T18:47:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1027.221100 secs 2024-04-26T18:47:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:10 smithi156 ceph-mon[32679]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:10 smithi092 ceph-mon[29156]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:10 smithi189 ceph-mon[32756]: pgmap v1558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:12 smithi156 ceph-mon[32679]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:12 smithi092 ceph-mon[29156]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:12 smithi189 ceph-mon[32756]: pgmap v1559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:14 smithi156 ceph-mon[32679]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1729.235176 secs 2024-04-26T18:47:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1032.221201 secs 2024-04-26T18:47:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:14 smithi092 ceph-mon[29156]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1729.235176 secs 2024-04-26T18:47:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1032.221201 secs 2024-04-26T18:47:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:14 smithi189 ceph-mon[32756]: pgmap v1560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:47:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1729.235176 secs 2024-04-26T18:47:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1032.221201 secs 2024-04-26T18:47:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:16 smithi156 ceph-mon[32679]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:16 smithi092 ceph-mon[29156]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:16 smithi189 ceph-mon[32756]: pgmap v1561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:47:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:18 smithi092 ceph-mon[29156]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:18 smithi189 ceph-mon[32756]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:18 smithi156 ceph-mon[32679]: pgmap v1562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1734.235293 secs 2024-04-26T18:47:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1037.221334 secs 2024-04-26T18:47:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1734.235293 secs 2024-04-26T18:47:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1037.221334 secs 2024-04-26T18:47:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1734.235293 secs 2024-04-26T18:47:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1037.221334 secs 2024-04-26T18:47:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:20 smithi092 ceph-mon[29156]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:20 smithi189 ceph-mon[32756]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:20 smithi156 ceph-mon[32679]: pgmap v1563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:22 smithi092 ceph-mon[29156]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:22 smithi189 ceph-mon[32756]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:22 smithi156 ceph-mon[32679]: pgmap v1564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:24 smithi092 ceph-mon[29156]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1739.235443 secs 2024-04-26T18:47:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1042.221424 secs 2024-04-26T18:47:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:24 smithi189 ceph-mon[32756]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1739.235443 secs 2024-04-26T18:47:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1042.221424 secs 2024-04-26T18:47:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:24 smithi156 ceph-mon[32679]: pgmap v1565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1739.235443 secs 2024-04-26T18:47:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1042.221424 secs 2024-04-26T18:47:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:26 smithi092 ceph-mon[29156]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:26 smithi189 ceph-mon[32756]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:26 smithi156 ceph-mon[32679]: pgmap v1566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:28 smithi092 ceph-mon[29156]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:28 smithi189 ceph-mon[32756]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:28 smithi156 ceph-mon[32679]: pgmap v1567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1744.235578 secs 2024-04-26T18:47:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:29 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1047.221544 secs 2024-04-26T18:47:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1744.235578 secs 2024-04-26T18:47:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:29 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1047.221544 secs 2024-04-26T18:47:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1744.235578 secs 2024-04-26T18:47:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:29 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1047.221544 secs 2024-04-26T18:47:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:30 smithi092 ceph-mon[29156]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:30 smithi189 ceph-mon[32756]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:30 smithi156 ceph-mon[32679]: pgmap v1568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:32 smithi092 ceph-mon[29156]: pgmap v1569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:32 smithi189 ceph-mon[32756]: pgmap v1569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:32 smithi156 ceph-mon[32679]: pgmap v1569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:34 smithi092 ceph-mon[29156]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1749.235697 secs 2024-04-26T18:47:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:34 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1052.221619 secs 2024-04-26T18:47:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:34 smithi189 ceph-mon[32756]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1749.235697 secs 2024-04-26T18:47:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:34 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1052.221619 secs 2024-04-26T18:47:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:34 smithi156 ceph-mon[32679]: pgmap v1570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1749.235697 secs 2024-04-26T18:47:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:34 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1052.221619 secs 2024-04-26T18:47:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:36 smithi092 ceph-mon[29156]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:36 smithi189 ceph-mon[32756]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:36 smithi156 ceph-mon[32679]: pgmap v1571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:38.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:38 smithi156 ceph-mon[32679]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:38 smithi092 ceph-mon[29156]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:38 smithi189 ceph-mon[32756]: pgmap v1572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1754.235844 secs 2024-04-26T18:47:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:39 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1057.221737 secs 2024-04-26T18:47:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1754.235844 secs 2024-04-26T18:47:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:39 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1057.221737 secs 2024-04-26T18:47:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1754.235844 secs 2024-04-26T18:47:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:39 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1057.221737 secs 2024-04-26T18:47:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:40 smithi092 ceph-mon[29156]: pgmap v1573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:40 smithi189 ceph-mon[32756]: pgmap v1573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:40 smithi156 ceph-mon[32679]: pgmap v1573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:47:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:42 smithi189 ceph-mon[32756]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:47:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:42 smithi156 ceph-mon[32679]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:47:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:42 smithi092 ceph-mon[29156]: pgmap v1574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:47:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:47:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:47:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:43 smithi189 ceph-mon[32756]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:47:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:43 smithi189 ceph-mon[32756]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:43 smithi156 ceph-mon[32679]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:47:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:43 smithi156 ceph-mon[32679]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:43 smithi092 ceph-mon[29156]: pgmap v1575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:47:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:43 smithi092 ceph-mon[29156]: pgmap v1576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1759.235941 secs 2024-04-26T18:47:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:44 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1062.221872 secs 2024-04-26T18:47:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1759.235941 secs 2024-04-26T18:47:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:44 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1062.221872 secs 2024-04-26T18:47:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1759.235941 secs 2024-04-26T18:47:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:44 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1062.221872 secs 2024-04-26T18:47:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:45 smithi189 ceph-mon[32756]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:45 smithi156 ceph-mon[32679]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:45 smithi092 ceph-mon[29156]: pgmap v1577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:47 smithi189 ceph-mon[32756]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:47 smithi156 ceph-mon[32679]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:47 smithi092 ceph-mon[29156]: pgmap v1578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:49 smithi189 ceph-mon[32756]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1764.236053 secs 2024-04-26T18:47:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:49 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1067.222016 secs 2024-04-26T18:47:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:49 smithi156 ceph-mon[32679]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1764.236053 secs 2024-04-26T18:47:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:49 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1067.222016 secs 2024-04-26T18:47:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:49 smithi092 ceph-mon[29156]: pgmap v1579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:47:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1764.236053 secs 2024-04-26T18:47:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:49 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1067.222016 secs 2024-04-26T18:47:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:51 smithi189 ceph-mon[32756]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:51 smithi156 ceph-mon[32679]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:51 smithi092 ceph-mon[29156]: pgmap v1580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:47:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:53 smithi189 ceph-mon[32756]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:47:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:53 smithi156 ceph-mon[32679]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:47:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:53 smithi092 ceph-mon[29156]: pgmap v1581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:47:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1769.236208 secs 2024-04-26T18:47:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:54 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1072.222144 secs 2024-04-26T18:47:54.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1769.236208 secs 2024-04-26T18:47:54.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:54 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1072.222144 secs 2024-04-26T18:47:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1769.236208 secs 2024-04-26T18:47:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:54 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1072.222144 secs 2024-04-26T18:47:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:55 smithi189 ceph-mon[32756]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:55 smithi156 ceph-mon[32679]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:55 smithi092 ceph-mon[29156]: pgmap v1582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:47:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:57 smithi189 ceph-mon[32756]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:57 smithi156 ceph-mon[32679]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:57 smithi092 ceph-mon[29156]: pgmap v1583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1774.236307 secs 2024-04-26T18:47:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1774.236307 secs 2024-04-26T18:47:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1774.236307 secs 2024-04-26T18:47:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:59 smithi189 ceph-mon[32756]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:47:59 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1077.222287 secs 2024-04-26T18:47:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:59 smithi156 ceph-mon[32679]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:47:59 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1077.222287 secs 2024-04-26T18:47:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:59 smithi092 ceph-mon[29156]: pgmap v1584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:47:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:47:59 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1077.222287 secs 2024-04-26T18:48:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:01 smithi189 ceph-mon[32756]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:01 smithi156 ceph-mon[32679]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:01 smithi092 ceph-mon[29156]: pgmap v1585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:03 smithi189 ceph-mon[32756]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1779.236431 secs 2024-04-26T18:48:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:03 smithi156 ceph-mon[32679]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1779.236431 secs 2024-04-26T18:48:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:03 smithi092 ceph-mon[29156]: pgmap v1586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1779.236431 secs 2024-04-26T18:48:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:04 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1082.222408 secs 2024-04-26T18:48:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:04 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1082.222408 secs 2024-04-26T18:48:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:04 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1082.222408 secs 2024-04-26T18:48:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:05 smithi189 ceph-mon[32756]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:05 smithi156 ceph-mon[32679]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:05 smithi092 ceph-mon[29156]: pgmap v1587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:07 smithi189 ceph-mon[32756]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:07 smithi156 ceph-mon[32679]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:07 smithi092 ceph-mon[29156]: pgmap v1588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:08.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1784.236545 secs 2024-04-26T18:48:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1784.236545 secs 2024-04-26T18:48:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1784.236545 secs 2024-04-26T18:48:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:09 smithi189 ceph-mon[32756]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:09 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1087.222509 secs 2024-04-26T18:48:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:09 smithi156 ceph-mon[32679]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:09 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1087.222509 secs 2024-04-26T18:48:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:09 smithi092 ceph-mon[29156]: pgmap v1589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:09 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1087.222509 secs 2024-04-26T18:48:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:11 smithi189 ceph-mon[32756]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:11 smithi156 ceph-mon[32679]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:11 smithi092 ceph-mon[29156]: pgmap v1590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:13 smithi189 ceph-mon[32756]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1789.236658 secs 2024-04-26T18:48:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:13 smithi156 ceph-mon[32679]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1789.236658 secs 2024-04-26T18:48:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:13 smithi092 ceph-mon[29156]: pgmap v1591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1789.236658 secs 2024-04-26T18:48:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:14 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1092.222574 secs 2024-04-26T18:48:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:14 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1092.222574 secs 2024-04-26T18:48:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:14 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1092.222574 secs 2024-04-26T18:48:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:15 smithi189 ceph-mon[32756]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:15 smithi156 ceph-mon[32679]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:15 smithi092 ceph-mon[29156]: pgmap v1592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:17 smithi189 ceph-mon[32756]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:17 smithi156 ceph-mon[32679]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:17.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:17 smithi092 ceph-mon[29156]: pgmap v1593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1794.236775 secs 2024-04-26T18:48:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1794.236775 secs 2024-04-26T18:48:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1794.236775 secs 2024-04-26T18:48:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:19 smithi189 ceph-mon[32756]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:19 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1097.222697 secs 2024-04-26T18:48:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:19 smithi156 ceph-mon[32679]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:19 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1097.222697 secs 2024-04-26T18:48:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:19 smithi092 ceph-mon[29156]: pgmap v1594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:19 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1097.222697 secs 2024-04-26T18:48:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:21 smithi189 ceph-mon[32756]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:21 smithi156 ceph-mon[32679]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:21 smithi092 ceph-mon[29156]: pgmap v1595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:23 smithi189 ceph-mon[32756]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1799.236893 secs 2024-04-26T18:48:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:23 smithi156 ceph-mon[32679]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1799.236893 secs 2024-04-26T18:48:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:23 smithi092 ceph-mon[29156]: pgmap v1596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1799.236893 secs 2024-04-26T18:48:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:24 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1102.222816 secs 2024-04-26T18:48:24.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:24 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1102.222816 secs 2024-04-26T18:48:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:24 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1102.222816 secs 2024-04-26T18:48:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:25 smithi189 ceph-mon[32756]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:25 smithi156 ceph-mon[32679]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:25 smithi092 ceph-mon[29156]: pgmap v1597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:27 smithi189 ceph-mon[32756]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:27 smithi156 ceph-mon[32679]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:27 smithi092 ceph-mon[29156]: pgmap v1598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1804.237026 secs 2024-04-26T18:48:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:28 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1107.222957 secs 2024-04-26T18:48:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1804.237026 secs 2024-04-26T18:48:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:28 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1107.222957 secs 2024-04-26T18:48:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1804.237026 secs 2024-04-26T18:48:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:28 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1107.222957 secs 2024-04-26T18:48:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:29 smithi189 ceph-mon[32756]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:29 smithi156 ceph-mon[32679]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:29 smithi092 ceph-mon[29156]: pgmap v1599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:31 smithi189 ceph-mon[32756]: pgmap v1600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:31 smithi156 ceph-mon[32679]: pgmap v1600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:31 smithi092 ceph-mon[29156]: pgmap v1600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:33 smithi189 ceph-mon[32756]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1809.237156 secs 2024-04-26T18:48:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:33 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1112.223078 secs 2024-04-26T18:48:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:33 smithi156 ceph-mon[32679]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1809.237156 secs 2024-04-26T18:48:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:33 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1112.223078 secs 2024-04-26T18:48:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:33 smithi092 ceph-mon[29156]: pgmap v1601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1809.237156 secs 2024-04-26T18:48:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:33 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1112.223078 secs 2024-04-26T18:48:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:35 smithi189 ceph-mon[32756]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:35 smithi156 ceph-mon[32679]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T18:48:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T18:48:35.992 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca806c000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca806c000 comp rx=0 tx=0).stop 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:48:35.993 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:35.992+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca8070000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:48:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:35 smithi092 ceph-mon[29156]: pgmap v1602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.018+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T18:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.018+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.018+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.018+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T18:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.018+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:48:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.019+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T18:48:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.019+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T18:48:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.227+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:48:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.227+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:48:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.229+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:48:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:48:36.230+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 18 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:48:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:37 smithi189 ceph-mon[32756]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:37 smithi156 ceph-mon[32679]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:37 smithi092 ceph-mon[29156]: pgmap v1603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1814.237267 secs 2024-04-26T18:48:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:38 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1117.223174 secs 2024-04-26T18:48:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1814.237267 secs 2024-04-26T18:48:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:38 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1117.223174 secs 2024-04-26T18:48:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1814.237267 secs 2024-04-26T18:48:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:38 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1117.223174 secs 2024-04-26T18:48:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:39 smithi189 ceph-mon[32756]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:39 smithi156 ceph-mon[32679]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:39 smithi092 ceph-mon[29156]: pgmap v1604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:41 smithi156 ceph-mon[32679]: pgmap v1605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:41 smithi092 ceph-mon[29156]: pgmap v1605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:41 smithi189 ceph-mon[32756]: pgmap v1605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:48:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:48:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:48:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:48:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:48:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:48:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:43 smithi156 ceph-mon[32679]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:43 smithi156 ceph-mon[32679]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:48:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:43 smithi156 ceph-mon[32679]: pgmap v1608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:48:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1819.237362 secs 2024-04-26T18:48:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:43 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1122.223321 secs 2024-04-26T18:48:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:43 smithi092 ceph-mon[29156]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:43 smithi092 ceph-mon[29156]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:48:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:43 smithi092 ceph-mon[29156]: pgmap v1608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:48:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1819.237362 secs 2024-04-26T18:48:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:43 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1122.223321 secs 2024-04-26T18:48:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:43 smithi189 ceph-mon[32756]: pgmap v1606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:43 smithi189 ceph-mon[32756]: pgmap v1607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:48:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:43 smithi189 ceph-mon[32756]: pgmap v1608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:48:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1819.237362 secs 2024-04-26T18:48:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:43 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1122.223321 secs 2024-04-26T18:48:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:45 smithi156 ceph-mon[32679]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:45 smithi092 ceph-mon[29156]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:45 smithi189 ceph-mon[32756]: pgmap v1609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:47 smithi156 ceph-mon[32679]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:47 smithi092 ceph-mon[29156]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:47 smithi189 ceph-mon[32756]: pgmap v1610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1824.237476 secs 2024-04-26T18:48:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:48 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1127.223406 secs 2024-04-26T18:48:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1824.237476 secs 2024-04-26T18:48:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:48 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1127.223406 secs 2024-04-26T18:48:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1824.237476 secs 2024-04-26T18:48:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:48 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1127.223406 secs 2024-04-26T18:48:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:49 smithi156 ceph-mon[32679]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:49 smithi092 ceph-mon[29156]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:49 smithi189 ceph-mon[32756]: pgmap v1611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:51 smithi156 ceph-mon[32679]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:51 smithi092 ceph-mon[29156]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:51 smithi189 ceph-mon[32756]: pgmap v1612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:48:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:53 smithi156 ceph-mon[32679]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:48:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1829.237592 secs 2024-04-26T18:48:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:53 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1132.223564 secs 2024-04-26T18:48:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:53 smithi092 ceph-mon[29156]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:48:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1829.237592 secs 2024-04-26T18:48:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:53 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1132.223564 secs 2024-04-26T18:48:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:53 smithi189 ceph-mon[32756]: pgmap v1613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:48:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1829.237592 secs 2024-04-26T18:48:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:53 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1132.223564 secs 2024-04-26T18:48:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:55 smithi156 ceph-mon[32679]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:55 smithi092 ceph-mon[29156]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:55 smithi189 ceph-mon[32756]: pgmap v1614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:57 smithi156 ceph-mon[32679]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:57 smithi092 ceph-mon[29156]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:57 smithi189 ceph-mon[32756]: pgmap v1615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:48:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1834.237709 secs 2024-04-26T18:48:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:58 smithi156 ceph-mon[32679]: 1 slow requests, 0 included below; oldest blocked for > 1137.223689 secs 2024-04-26T18:48:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1834.237709 secs 2024-04-26T18:48:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:58 smithi092 ceph-mon[29156]: 1 slow requests, 0 included below; oldest blocked for > 1137.223689 secs 2024-04-26T18:48:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1834.237709 secs 2024-04-26T18:48:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:58 smithi189 ceph-mon[32756]: 1 slow requests, 0 included below; oldest blocked for > 1137.223689 secs 2024-04-26T18:48:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:48:59 smithi156 ceph-mon[32679]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:48:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:48:59 smithi092 ceph-mon[29156]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:48:59 smithi189 ceph-mon[32756]: pgmap v1616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:01 smithi156 ceph-mon[32679]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:01 smithi092 ceph-mon[29156]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:01 smithi189 ceph-mon[32756]: pgmap v1617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:03 smithi156 ceph-mon[32679]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1839.237865 secs 2024-04-26T18:49:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:03 smithi156 ceph-mon[32679]: 2 slow requests, 1 included below; oldest blocked for > 1142.223800 secs 2024-04-26T18:49:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:03 smithi156 ceph-mon[32679]: slow request 181.929167 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:49:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:03 smithi092 ceph-mon[29156]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1839.237865 secs 2024-04-26T18:49:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:03 smithi092 ceph-mon[29156]: 2 slow requests, 1 included below; oldest blocked for > 1142.223800 secs 2024-04-26T18:49:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:03 smithi092 ceph-mon[29156]: slow request 181.929167 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:49:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:03 smithi189 ceph-mon[32756]: pgmap v1618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1839.237865 secs 2024-04-26T18:49:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:03 smithi189 ceph-mon[32756]: 2 slow requests, 1 included below; oldest blocked for > 1142.223800 secs 2024-04-26T18:49:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:03 smithi189 ceph-mon[32756]: slow request 181.929167 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:49:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:05 smithi092 ceph-mon[29156]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:05 smithi189 ceph-mon[32756]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:05 smithi156 ceph-mon[32679]: pgmap v1619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:07 smithi092 ceph-mon[29156]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:49:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:49:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:07 smithi189 ceph-mon[32756]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:49:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:49:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:07 smithi156 ceph-mon[32679]: pgmap v1620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:49:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:49:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1844.237982 secs 2024-04-26T18:49:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1147.223880 secs 2024-04-26T18:49:09.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1844.237982 secs 2024-04-26T18:49:09.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1147.223880 secs 2024-04-26T18:49:09.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1844.237982 secs 2024-04-26T18:49:09.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1147.223880 secs 2024-04-26T18:49:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:09 smithi092 ceph-mon[29156]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:09 smithi189 ceph-mon[32756]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:09 smithi156 ceph-mon[32679]: pgmap v1621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:11 smithi092 ceph-mon[29156]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:11 smithi189 ceph-mon[32756]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:11 smithi156 ceph-mon[32679]: pgmap v1622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:13 smithi092 ceph-mon[29156]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1849.238095 secs 2024-04-26T18:49:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1152.224022 secs 2024-04-26T18:49:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:13 smithi189 ceph-mon[32756]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1849.238095 secs 2024-04-26T18:49:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1152.224022 secs 2024-04-26T18:49:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:13 smithi156 ceph-mon[32679]: pgmap v1623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1849.238095 secs 2024-04-26T18:49:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1152.224022 secs 2024-04-26T18:49:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:15 smithi092 ceph-mon[29156]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:15 smithi189 ceph-mon[32756]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:15 smithi156 ceph-mon[32679]: pgmap v1624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:17 smithi092 ceph-mon[29156]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:17 smithi189 ceph-mon[32756]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:17 smithi156 ceph-mon[32679]: pgmap v1625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1854.238172 secs 2024-04-26T18:49:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:18 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1157.224084 secs 2024-04-26T18:49:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1854.238172 secs 2024-04-26T18:49:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:18 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1157.224084 secs 2024-04-26T18:49:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1854.238172 secs 2024-04-26T18:49:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:18 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1157.224084 secs 2024-04-26T18:49:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:19 smithi092 ceph-mon[29156]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:19 smithi189 ceph-mon[32756]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:19 smithi156 ceph-mon[32679]: pgmap v1626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:21 smithi092 ceph-mon[29156]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:21 smithi189 ceph-mon[32756]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:21 smithi156 ceph-mon[32679]: pgmap v1627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:23 smithi092 ceph-mon[29156]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1859.238296 secs 2024-04-26T18:49:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:23 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1162.224160 secs 2024-04-26T18:49:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:23 smithi189 ceph-mon[32756]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1859.238296 secs 2024-04-26T18:49:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:23 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1162.224160 secs 2024-04-26T18:49:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:23 smithi156 ceph-mon[32679]: pgmap v1628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1859.238296 secs 2024-04-26T18:49:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:23 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1162.224160 secs 2024-04-26T18:49:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:25 smithi092 ceph-mon[29156]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:25 smithi189 ceph-mon[32756]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:25 smithi156 ceph-mon[32679]: pgmap v1629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:27 smithi092 ceph-mon[29156]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:27 smithi189 ceph-mon[32756]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:27 smithi156 ceph-mon[32679]: pgmap v1630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1864.238398 secs 2024-04-26T18:49:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1167.224287 secs 2024-04-26T18:49:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1864.238398 secs 2024-04-26T18:49:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1167.224287 secs 2024-04-26T18:49:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1864.238398 secs 2024-04-26T18:49:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1167.224287 secs 2024-04-26T18:49:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:29 smithi092 ceph-mon[29156]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:29 smithi189 ceph-mon[32756]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:29 smithi156 ceph-mon[32679]: pgmap v1631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:31 smithi092 ceph-mon[29156]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:31 smithi189 ceph-mon[32756]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:31 smithi156 ceph-mon[32679]: pgmap v1632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:33 smithi189 ceph-mon[32756]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1869.238518 secs 2024-04-26T18:49:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1172.224416 secs 2024-04-26T18:49:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:33 smithi156 ceph-mon[32679]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1869.238518 secs 2024-04-26T18:49:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1172.224416 secs 2024-04-26T18:49:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:33 smithi092 ceph-mon[29156]: pgmap v1633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1869.238518 secs 2024-04-26T18:49:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1172.224416 secs 2024-04-26T18:49:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:35 smithi189 ceph-mon[32756]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:35 smithi156 ceph-mon[32679]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:35 smithi092 ceph-mon[29156]: pgmap v1634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:37 smithi189 ceph-mon[32756]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:37 smithi156 ceph-mon[32679]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:37 smithi092 ceph-mon[29156]: pgmap v1635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1874.238659 secs 2024-04-26T18:49:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1177.224495 secs 2024-04-26T18:49:39.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1874.238659 secs 2024-04-26T18:49:39.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1177.224495 secs 2024-04-26T18:49:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1874.238659 secs 2024-04-26T18:49:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1177.224495 secs 2024-04-26T18:49:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:39 smithi189 ceph-mon[32756]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:39 smithi156 ceph-mon[32679]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:39 smithi092 ceph-mon[29156]: pgmap v1636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:41 smithi189 ceph-mon[32756]: pgmap v1637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:41 smithi156 ceph-mon[32679]: pgmap v1637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:41 smithi092 ceph-mon[29156]: pgmap v1637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:49:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1879.238725 secs 2024-04-26T18:49:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1182.224552 secs 2024-04-26T18:49:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1879.238725 secs 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1182.224552 secs 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:49:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: pgmap v1638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1879.238725 secs 2024-04-26T18:49:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1182.224552 secs 2024-04-26T18:49:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:49:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:49:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:49:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:44 smithi189 ceph-mon[32756]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:49:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:44 smithi189 ceph-mon[32756]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:44 smithi156 ceph-mon[32679]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:49:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:44 smithi156 ceph-mon[32679]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:44 smithi092 ceph-mon[29156]: pgmap v1639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:49:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:44 smithi092 ceph-mon[29156]: pgmap v1640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:46 smithi189 ceph-mon[32756]: pgmap v1641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:46 smithi156 ceph-mon[32679]: pgmap v1641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:46 smithi092 ceph-mon[29156]: pgmap v1641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:48 smithi189 ceph-mon[32756]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1884.238790 secs 2024-04-26T18:49:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1187.224675 secs 2024-04-26T18:49:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:48 smithi156 ceph-mon[32679]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1884.238790 secs 2024-04-26T18:49:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1187.224675 secs 2024-04-26T18:49:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:48 smithi092 ceph-mon[29156]: pgmap v1642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:49:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1884.238790 secs 2024-04-26T18:49:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1187.224675 secs 2024-04-26T18:49:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:50 smithi189 ceph-mon[32756]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:50 smithi156 ceph-mon[32679]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:50 smithi092 ceph-mon[29156]: pgmap v1643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:52 smithi189 ceph-mon[32756]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:52 smithi156 ceph-mon[32679]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:52 smithi092 ceph-mon[29156]: pgmap v1644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:49:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1889.238903 secs 2024-04-26T18:49:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1192.224799 secs 2024-04-26T18:49:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1889.238903 secs 2024-04-26T18:49:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1192.224799 secs 2024-04-26T18:49:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1889.238903 secs 2024-04-26T18:49:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1192.224799 secs 2024-04-26T18:49:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:54 smithi189 ceph-mon[32756]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:49:55.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:54 smithi092 ceph-mon[29156]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:49:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:54 smithi156 ceph-mon[32679]: pgmap v1645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:49:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:56 smithi189 ceph-mon[32756]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:56 smithi156 ceph-mon[32679]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:56 smithi092 ceph-mon[29156]: pgmap v1646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:49:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:58 smithi189 ceph-mon[32756]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1894.239047 secs 2024-04-26T18:49:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:49:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1197.224921 secs 2024-04-26T18:49:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:58 smithi156 ceph-mon[32679]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1894.239047 secs 2024-04-26T18:49:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:49:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1197.224921 secs 2024-04-26T18:49:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:58 smithi092 ceph-mon[29156]: pgmap v1647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:49:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1894.239047 secs 2024-04-26T18:49:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:49:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1197.224921 secs 2024-04-26T18:50:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:00 smithi189 ceph-mon[32756]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:50:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:00 smithi156 ceph-mon[32679]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:50:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:00 smithi092 ceph-mon[29156]: pgmap v1648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T18:50:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:02 smithi189 ceph-mon[32756]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:02 smithi156 ceph-mon[32679]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:02 smithi092 ceph-mon[29156]: pgmap v1649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1899.239129 secs 2024-04-26T18:50:04.159 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:03 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1202.224997 secs 2024-04-26T18:50:04.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1899.239129 secs 2024-04-26T18:50:04.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:03 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1202.224997 secs 2024-04-26T18:50:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1899.239129 secs 2024-04-26T18:50:04.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:03 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1202.224997 secs 2024-04-26T18:50:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:04 smithi189 ceph-mon[32756]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:04 smithi156 ceph-mon[32679]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:04 smithi092 ceph-mon[29156]: pgmap v1650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:06 smithi189 ceph-mon[32756]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:06 smithi156 ceph-mon[32679]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:06 smithi092 ceph-mon[29156]: pgmap v1651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:08 smithi189 ceph-mon[32756]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:09.177 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1904.239247 secs 2024-04-26T18:50:09.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1207.225156 secs 2024-04-26T18:50:09.194 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:08 smithi156 ceph-mon[32679]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:09.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1904.239247 secs 2024-04-26T18:50:09.282 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1207.225156 secs 2024-04-26T18:50:09.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:08 smithi092 ceph-mon[29156]: pgmap v1652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:09.377 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1904.239247 secs 2024-04-26T18:50:09.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1207.225156 secs 2024-04-26T18:50:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:10 smithi189 ceph-mon[32756]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:10 smithi156 ceph-mon[32679]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:10 smithi092 ceph-mon[29156]: pgmap v1653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:12 smithi189 ceph-mon[32756]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:12 smithi156 ceph-mon[32679]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:12 smithi092 ceph-mon[29156]: pgmap v1654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1909.239351 secs 2024-04-26T18:50:14.201 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1212.225272 secs 2024-04-26T18:50:14.225 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:13 smithi189 ceph-mon[32756]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:14.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1909.239351 secs 2024-04-26T18:50:14.246 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1212.225272 secs 2024-04-26T18:50:14.253 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:13 smithi156 ceph-mon[32679]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:14.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1909.239351 secs 2024-04-26T18:50:14.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1212.225272 secs 2024-04-26T18:50:14.312 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:13 smithi092 ceph-mon[29156]: pgmap v1655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:16 smithi092 ceph-mon[29156]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:16 smithi189 ceph-mon[32756]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:16 smithi156 ceph-mon[32679]: pgmap v1656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:18 smithi092 ceph-mon[29156]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:18 smithi189 ceph-mon[32756]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:18 smithi156 ceph-mon[32679]: pgmap v1657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1914.239511 secs 2024-04-26T18:50:19.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:19 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1217.225395 secs 2024-04-26T18:50:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1914.239511 secs 2024-04-26T18:50:19.920 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:19 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1217.225395 secs 2024-04-26T18:50:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1914.239511 secs 2024-04-26T18:50:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:19 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1217.225395 secs 2024-04-26T18:50:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:20 smithi092 ceph-mon[29156]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:20 smithi189 ceph-mon[32756]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:20 smithi156 ceph-mon[32679]: pgmap v1658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:22 smithi092 ceph-mon[29156]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:22 smithi189 ceph-mon[32756]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:22 smithi156 ceph-mon[32679]: pgmap v1659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1919.239645 secs 2024-04-26T18:50:24.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:24 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1222.225453 secs 2024-04-26T18:50:24.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:24 smithi092 ceph-mon[29156]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1919.239645 secs 2024-04-26T18:50:24.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:24 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1222.225453 secs 2024-04-26T18:50:24.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:24 smithi189 ceph-mon[32756]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1919.239645 secs 2024-04-26T18:50:24.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:24 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1222.225453 secs 2024-04-26T18:50:24.950 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:24 smithi156 ceph-mon[32679]: pgmap v1660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:26 smithi092 ceph-mon[29156]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:26 smithi189 ceph-mon[32756]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:26 smithi156 ceph-mon[32679]: pgmap v1661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:28 smithi092 ceph-mon[29156]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:28 smithi189 ceph-mon[32756]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:28 smithi156 ceph-mon[32679]: pgmap v1662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1924.239763 secs 2024-04-26T18:50:29.763 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:29 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1227.225517 secs 2024-04-26T18:50:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1924.239763 secs 2024-04-26T18:50:29.901 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:29 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1227.225517 secs 2024-04-26T18:50:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1924.239763 secs 2024-04-26T18:50:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:29 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1227.225517 secs 2024-04-26T18:50:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:30 smithi092 ceph-mon[29156]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:30 smithi189 ceph-mon[32756]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:30 smithi156 ceph-mon[32679]: pgmap v1663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:32 smithi189 ceph-mon[32756]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:32.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:32 smithi156 ceph-mon[32679]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:32 smithi092 ceph-mon[29156]: pgmap v1664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1929.239898 secs 2024-04-26T18:50:34.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:34 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1232.225606 secs 2024-04-26T18:50:34.969 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:34 smithi189 ceph-mon[32756]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:34.979 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1929.239898 secs 2024-04-26T18:50:34.988 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:34 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1232.225606 secs 2024-04-26T18:50:35.048 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:34 smithi156 ceph-mon[32679]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:35.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1929.239898 secs 2024-04-26T18:50:35.068 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:34 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1232.225606 secs 2024-04-26T18:50:35.113 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:34 smithi092 ceph-mon[29156]: pgmap v1665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:36 smithi189 ceph-mon[32756]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:36 smithi156 ceph-mon[32679]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:37.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:36 smithi092 ceph-mon[29156]: pgmap v1666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:38 smithi189 ceph-mon[32756]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:38 smithi156 ceph-mon[32679]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:38 smithi092 ceph-mon[29156]: pgmap v1667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1934.239972 secs 2024-04-26T18:50:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:39 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1237.225667 secs 2024-04-26T18:50:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1934.239972 secs 2024-04-26T18:50:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:39 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1237.225667 secs 2024-04-26T18:50:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1934.239972 secs 2024-04-26T18:50:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:39 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1237.225667 secs 2024-04-26T18:50:40.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:40 smithi189 ceph-mon[32756]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:40.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:40 smithi156 ceph-mon[32679]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:40 smithi092 ceph-mon[29156]: pgmap v1668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:42 smithi189 ceph-mon[32756]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:42 smithi156 ceph-mon[32679]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:42 smithi092 ceph-mon[29156]: pgmap v1669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:50:44.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1939.240065 secs 2024-04-26T18:50:44.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1242.225803 secs 2024-04-26T18:50:44.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: pgmap v1670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:44.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.830 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1939.240065 secs 2024-04-26T18:50:44.830 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1242.225803 secs 2024-04-26T18:50:44.830 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: pgmap v1670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:44.830 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1939.240065 secs 2024-04-26T18:50:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1242.225803 secs 2024-04-26T18:50:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: pgmap v1670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: pgmap v1671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:50:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:50:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:50:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T18:50:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:50:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:50:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:50:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:50:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:48 smithi189 ceph-mon[32756]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:48 smithi189 ceph-mon[32756]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:50:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:48 smithi156 ceph-mon[32679]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:48 smithi156 ceph-mon[32679]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T18:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T18:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:48 smithi092 ceph-mon[29156]: pgmap v1672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:50:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:48 smithi092 ceph-mon[29156]: pgmap v1673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1944.240191 secs 2024-04-26T18:50:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:49 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1247.225921 secs 2024-04-26T18:50:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1944.240191 secs 2024-04-26T18:50:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:49 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1247.225921 secs 2024-04-26T18:50:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1944.240191 secs 2024-04-26T18:50:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:49 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1247.225921 secs 2024-04-26T18:50:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:50 smithi189 ceph-mon[32756]: pgmap v1674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:50 smithi156 ceph-mon[32679]: pgmap v1674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:50 smithi092 ceph-mon[29156]: pgmap v1674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:52 smithi189 ceph-mon[32756]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:52 smithi156 ceph-mon[32679]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:52 smithi092 ceph-mon[29156]: pgmap v1675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:54 smithi189 ceph-mon[32756]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1949.240269 secs 2024-04-26T18:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:54 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1252.226021 secs 2024-04-26T18:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:54 smithi156 ceph-mon[32679]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1949.240269 secs 2024-04-26T18:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:54 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1252.226021 secs 2024-04-26T18:50:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:54 smithi092 ceph-mon[29156]: pgmap v1676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1949.240269 secs 2024-04-26T18:50:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:54 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1252.226021 secs 2024-04-26T18:50:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:56 smithi189 ceph-mon[32756]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:56 smithi156 ceph-mon[32679]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:56 smithi092 ceph-mon[29156]: pgmap v1677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T18:50:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:58 smithi189 ceph-mon[32756]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:50:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1954.240425 secs 2024-04-26T18:50:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:58 smithi156 ceph-mon[32679]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:50:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1954.240425 secs 2024-04-26T18:50:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:58 smithi092 ceph-mon[29156]: pgmap v1678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:50:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1954.240425 secs 2024-04-26T18:50:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:50:59 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1257.226145 secs 2024-04-26T18:50:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:50:59 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1257.226145 secs 2024-04-26T18:50:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:50:59 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1257.226145 secs 2024-04-26T18:51:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:00 smithi189 ceph-mon[32756]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:00 smithi156 ceph-mon[32679]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:00 smithi092 ceph-mon[29156]: pgmap v1679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:01.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:51:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:51:01.485+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:51:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:51:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:51:01.485+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:51:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:51:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:51:01.485+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:51:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:51:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:51:01.485+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:51:01.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:51:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:51:01.485+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:51:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:02 smithi189 ceph-mon[32756]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:02 smithi156 ceph-mon[32679]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:02 smithi092 ceph-mon[29156]: pgmap v1680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1959.240546 secs 2024-04-26T18:51:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1959.240546 secs 2024-04-26T18:51:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1959.240546 secs 2024-04-26T18:51:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:04 smithi189 ceph-mon[32756]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:04 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1262.226287 secs 2024-04-26T18:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:04 smithi156 ceph-mon[32679]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:04 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1262.226287 secs 2024-04-26T18:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:04 smithi092 ceph-mon[29156]: pgmap v1681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:04 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1262.226287 secs 2024-04-26T18:51:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:06 smithi189 ceph-mon[32756]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:06 smithi156 ceph-mon[32679]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:06 smithi092 ceph-mon[29156]: pgmap v1682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:08 smithi189 ceph-mon[32756]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1964.240662 secs 2024-04-26T18:51:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:08 smithi156 ceph-mon[32679]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1964.240662 secs 2024-04-26T18:51:08.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:08 smithi092 ceph-mon[29156]: pgmap v1683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:08.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1964.240662 secs 2024-04-26T18:51:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:09 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1267.226378 secs 2024-04-26T18:51:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:09 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1267.226378 secs 2024-04-26T18:51:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:09 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1267.226378 secs 2024-04-26T18:51:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:10 smithi189 ceph-mon[32756]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:10 smithi156 ceph-mon[32679]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:10 smithi092 ceph-mon[29156]: pgmap v1684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:12 smithi189 ceph-mon[32756]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:12 smithi156 ceph-mon[32679]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:12 smithi092 ceph-mon[29156]: pgmap v1685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1969.240781 secs 2024-04-26T18:51:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1969.240781 secs 2024-04-26T18:51:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1969.240781 secs 2024-04-26T18:51:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:14 smithi189 ceph-mon[32756]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:14 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1272.226458 secs 2024-04-26T18:51:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:14 smithi156 ceph-mon[32679]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:14 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1272.226458 secs 2024-04-26T18:51:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:14 smithi092 ceph-mon[29156]: pgmap v1686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T18:51:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:14 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1272.226458 secs 2024-04-26T18:51:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:16 smithi189 ceph-mon[32756]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:16 smithi156 ceph-mon[32679]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:16 smithi092 ceph-mon[29156]: pgmap v1687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T18:51:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:18 smithi189 ceph-mon[32756]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1974.240875 secs 2024-04-26T18:51:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:18 smithi156 ceph-mon[32679]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1974.240875 secs 2024-04-26T18:51:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:18 smithi092 ceph-mon[29156]: pgmap v1688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1974.240875 secs 2024-04-26T18:51:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:19 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1277.226617 secs 2024-04-26T18:51:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:19 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1277.226617 secs 2024-04-26T18:51:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:19 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1277.226617 secs 2024-04-26T18:51:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:20 smithi189 ceph-mon[32756]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:20 smithi156 ceph-mon[32679]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:20 smithi092 ceph-mon[29156]: pgmap v1689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:22 smithi189 ceph-mon[32756]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:22 smithi156 ceph-mon[32679]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:22 smithi092 ceph-mon[29156]: pgmap v1690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1979.240938 secs 2024-04-26T18:51:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1979.240938 secs 2024-04-26T18:51:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1979.240938 secs 2024-04-26T18:51:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:24 smithi189 ceph-mon[32756]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:24 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1282.226737 secs 2024-04-26T18:51:24.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:24 smithi092 ceph-mon[29156]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:24.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:24 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1282.226737 secs 2024-04-26T18:51:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:24 smithi156 ceph-mon[32679]: pgmap v1691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:24 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1282.226737 secs 2024-04-26T18:51:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:26 smithi189 ceph-mon[32756]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:26 smithi156 ceph-mon[32679]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:26 smithi092 ceph-mon[29156]: pgmap v1692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:28 smithi189 ceph-mon[32756]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1984.241054 secs 2024-04-26T18:51:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1287.226815 secs 2024-04-26T18:51:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:28 smithi156 ceph-mon[32679]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1984.241054 secs 2024-04-26T18:51:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1287.226815 secs 2024-04-26T18:51:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:28 smithi092 ceph-mon[29156]: pgmap v1693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1984.241054 secs 2024-04-26T18:51:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1287.226815 secs 2024-04-26T18:51:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:30 smithi189 ceph-mon[32756]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:30 smithi156 ceph-mon[32679]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:30 smithi092 ceph-mon[29156]: pgmap v1694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:32 smithi189 ceph-mon[32756]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:32 smithi156 ceph-mon[32679]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:32 smithi092 ceph-mon[29156]: pgmap v1695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1989.241134 secs 2024-04-26T18:51:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1292.226956 secs 2024-04-26T18:51:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1989.241134 secs 2024-04-26T18:51:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1292.226956 secs 2024-04-26T18:51:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1989.241134 secs 2024-04-26T18:51:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1292.226956 secs 2024-04-26T18:51:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:34 smithi156 ceph-mon[32679]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:34 smithi092 ceph-mon[29156]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:34 smithi189 ceph-mon[32756]: pgmap v1696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.251+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:51:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.251+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:51:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.251+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T18:51:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.251+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006640 con 0x7f1cb4108940 2024-04-26T18:51:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.251+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 19 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T18:51:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.252+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:51:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.252+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006640 con 0x7f1cb4108940 2024-04-26T18:51:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:51:36.252+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 20 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:51:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:36 smithi156 ceph-mon[32679]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:36 smithi092 ceph-mon[29156]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:36 smithi189 ceph-mon[32756]: pgmap v1697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:38 smithi156 ceph-mon[32679]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:38.970 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1994.241230 secs 2024-04-26T18:51:38.981 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1297.227057 secs 2024-04-26T18:51:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:38 smithi092 ceph-mon[29156]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:39.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1994.241230 secs 2024-04-26T18:51:39.037 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1297.227057 secs 2024-04-26T18:51:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:38 smithi189 ceph-mon[32756]: pgmap v1698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:39.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1994.241230 secs 2024-04-26T18:51:39.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1297.227057 secs 2024-04-26T18:51:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:40 smithi156 ceph-mon[32679]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:40.964 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:40 smithi189 ceph-mon[32756]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:40 smithi092 ceph-mon[29156]: pgmap v1699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:42 smithi156 ceph-mon[32679]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:42 smithi092 ceph-mon[29156]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:42 smithi189 ceph-mon[32756]: pgmap v1700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1999.241355 secs 2024-04-26T18:51:43.971 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1302.227175 secs 2024-04-26T18:51:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1999.241355 secs 2024-04-26T18:51:44.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1302.227175 secs 2024-04-26T18:51:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1999.241355 secs 2024-04-26T18:51:44.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1302.227175 secs 2024-04-26T18:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:44 smithi156 ceph-mon[32679]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:44 smithi092 ceph-mon[29156]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:44 smithi189 ceph-mon[32756]: pgmap v1701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:46 smithi156 ceph-mon[32679]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:46 smithi092 ceph-mon[29156]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:46 smithi189 ceph-mon[32756]: pgmap v1702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:51:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: pgmap v1703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:48.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:49.019 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:49.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:51:49.035 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2004.241497 secs 2024-04-26T18:51:49.042 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1307.227331 secs 2024-04-26T18:51:49.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: pgmap v1703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:49.060 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:49.163 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:49.213 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:51:49.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2004.241497 secs 2024-04-26T18:51:49.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1307.227331 secs 2024-04-26T18:51:49.304 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: pgmap v1703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:51:49.337 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:51:49.346 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:51:49.462 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:51:49.470 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2004.241497 secs 2024-04-26T18:51:49.477 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1307.227331 secs 2024-04-26T18:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:49 smithi156 ceph-mon[32679]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:51:49.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:49 smithi156 ceph-mon[32679]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:51:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:49 smithi092 ceph-mon[29156]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:51:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:49 smithi092 ceph-mon[29156]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:51:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:49 smithi189 ceph-mon[32756]: pgmap v1704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:51:50.158 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:49 smithi189 ceph-mon[32756]: pgmap v1705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:51 smithi092 ceph-mon[29156]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:51 smithi189 ceph-mon[32756]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:52.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:51 smithi156 ceph-mon[32679]: pgmap v1706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:53 smithi092 ceph-mon[29156]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:54.023 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2009.241617 secs 2024-04-26T18:51:54.072 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1312.227396 secs 2024-04-26T18:51:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:53 smithi189 ceph-mon[32756]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:54.249 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2009.241617 secs 2024-04-26T18:51:54.299 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1312.227396 secs 2024-04-26T18:51:54.307 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:53 smithi156 ceph-mon[32679]: pgmap v1707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:54.314 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2009.241617 secs 2024-04-26T18:51:54.320 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1312.227396 secs 2024-04-26T18:51:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:55 smithi092 ceph-mon[29156]: pgmap v1708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:55 smithi189 ceph-mon[32756]: pgmap v1708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:55 smithi156 ceph-mon[32679]: pgmap v1708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:57 smithi092 ceph-mon[29156]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:57 smithi189 ceph-mon[32756]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:57 smithi156 ceph-mon[32679]: pgmap v1709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:51:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2014.241712 secs 2024-04-26T18:51:59.034 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1317.227486 secs 2024-04-26T18:51:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2014.241712 secs 2024-04-26T18:51:59.159 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1317.227486 secs 2024-04-26T18:51:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2014.241712 secs 2024-04-26T18:51:59.227 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1317.227486 secs 2024-04-26T18:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:51:59 smithi092 ceph-mon[29156]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:52:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:51:59 smithi189 ceph-mon[32756]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:52:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:51:59 smithi156 ceph-mon[32679]: pgmap v1710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:01 smithi092 ceph-mon[29156]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:01 smithi189 ceph-mon[32756]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:01 smithi156 ceph-mon[32679]: pgmap v1711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:03 smithi092 ceph-mon[29156]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:04.012 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2019.241855 secs 2024-04-26T18:52:04.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:03 smithi092 ceph-mon[29156]: 2 slow requests, 1 included below; oldest blocked for > 1322.227747 secs 2024-04-26T18:52:04.044 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:03 smithi092 ceph-mon[29156]: slow request 361.933114 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:52:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:03 smithi189 ceph-mon[32756]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:04.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2019.241855 secs 2024-04-26T18:52:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:03 smithi189 ceph-mon[32756]: 2 slow requests, 1 included below; oldest blocked for > 1322.227747 secs 2024-04-26T18:52:04.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:03 smithi189 ceph-mon[32756]: slow request 361.933114 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:52:04.226 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:03 smithi156 ceph-mon[32679]: pgmap v1712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:04.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2019.241855 secs 2024-04-26T18:52:04.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:03 smithi156 ceph-mon[32679]: 2 slow requests, 1 included below; oldest blocked for > 1322.227747 secs 2024-04-26T18:52:04.251 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:03 smithi156 ceph-mon[32679]: slow request 361.933114 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:52:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:05 smithi092 ceph-mon[29156]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:05 smithi189 ceph-mon[32756]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:05 smithi156 ceph-mon[32679]: pgmap v1713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:07 smithi092 ceph-mon[29156]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:07 smithi189 ceph-mon[32756]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:07 smithi156 ceph-mon[32679]: pgmap v1714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2024.241984 secs 2024-04-26T18:52:09.032 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1327.227837 secs 2024-04-26T18:52:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2024.241984 secs 2024-04-26T18:52:09.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1327.227837 secs 2024-04-26T18:52:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2024.241984 secs 2024-04-26T18:52:09.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1327.227837 secs 2024-04-26T18:52:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:09 smithi092 ceph-mon[29156]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:10.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:09 smithi189 ceph-mon[32756]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:10.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:09 smithi156 ceph-mon[32679]: pgmap v1715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:11 smithi092 ceph-mon[29156]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:11 smithi189 ceph-mon[32756]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:11 smithi156 ceph-mon[32679]: pgmap v1716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:13 smithi092 ceph-mon[29156]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:14.088 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2029.242050 secs 2024-04-26T18:52:14.108 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1332.227965 secs 2024-04-26T18:52:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:13 smithi189 ceph-mon[32756]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:14.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2029.242050 secs 2024-04-26T18:52:14.155 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1332.227965 secs 2024-04-26T18:52:14.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:13 smithi156 ceph-mon[32679]: pgmap v1717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:14.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2029.242050 secs 2024-04-26T18:52:14.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1332.227965 secs 2024-04-26T18:52:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:15 smithi092 ceph-mon[29156]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:15 smithi189 ceph-mon[32756]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:15 smithi156 ceph-mon[32679]: pgmap v1718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:17 smithi092 ceph-mon[29156]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:17 smithi189 ceph-mon[32756]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:17 smithi156 ceph-mon[32679]: pgmap v1719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2034.242147 secs 2024-04-26T18:52:19.151 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:18 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1337.228085 secs 2024-04-26T18:52:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2034.242147 secs 2024-04-26T18:52:19.246 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:18 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1337.228085 secs 2024-04-26T18:52:19.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2034.242147 secs 2024-04-26T18:52:19.262 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:18 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1337.228085 secs 2024-04-26T18:52:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:19 smithi189 ceph-mon[32756]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:20.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:19 smithi156 ceph-mon[32679]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:19 smithi092 ceph-mon[29156]: pgmap v1720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:21 smithi189 ceph-mon[32756]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:21 smithi156 ceph-mon[32679]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:21 smithi092 ceph-mon[29156]: pgmap v1721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:23 smithi189 ceph-mon[32756]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:24.166 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2039.242266 secs 2024-04-26T18:52:24.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:23 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1342.228209 secs 2024-04-26T18:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:23 smithi156 ceph-mon[32679]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:24.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2039.242266 secs 2024-04-26T18:52:24.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:23 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1342.228209 secs 2024-04-26T18:52:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:23 smithi092 ceph-mon[29156]: pgmap v1722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:24.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2039.242266 secs 2024-04-26T18:52:24.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:23 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1342.228209 secs 2024-04-26T18:52:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:25 smithi189 ceph-mon[32756]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:25 smithi156 ceph-mon[32679]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:25 smithi092 ceph-mon[29156]: pgmap v1723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:28.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:27 smithi092 ceph-mon[29156]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:27 smithi189 ceph-mon[32756]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:27 smithi156 ceph-mon[32679]: pgmap v1724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2044.242338 secs 2024-04-26T18:52:29.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1347.228353 secs 2024-04-26T18:52:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2044.242338 secs 2024-04-26T18:52:29.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1347.228353 secs 2024-04-26T18:52:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2044.242338 secs 2024-04-26T18:52:29.256 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1347.228353 secs 2024-04-26T18:52:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:29 smithi189 ceph-mon[32756]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:30.777 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:29 smithi092 ceph-mon[29156]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:31.010 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:29 smithi156 ceph-mon[32679]: pgmap v1725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:31 smithi189 ceph-mon[32756]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:32.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:31 smithi156 ceph-mon[32679]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:31 smithi092 ceph-mon[29156]: pgmap v1726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:33 smithi189 ceph-mon[32756]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:34.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2049.242439 secs 2024-04-26T18:52:34.156 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1352.228476 secs 2024-04-26T18:52:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:33 smithi156 ceph-mon[32679]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:34.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2049.242439 secs 2024-04-26T18:52:34.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1352.228476 secs 2024-04-26T18:52:34.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:33 smithi092 ceph-mon[29156]: pgmap v1727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:34.263 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2049.242439 secs 2024-04-26T18:52:34.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1352.228476 secs 2024-04-26T18:52:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:35 smithi189 ceph-mon[32756]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:35 smithi156 ceph-mon[32679]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:35 smithi092 ceph-mon[29156]: pgmap v1728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:37 smithi189 ceph-mon[32756]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:37 smithi156 ceph-mon[32679]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:37 smithi092 ceph-mon[29156]: pgmap v1729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2054.242555 secs 2024-04-26T18:52:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1357.228595 secs 2024-04-26T18:52:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2054.242555 secs 2024-04-26T18:52:39.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1357.228595 secs 2024-04-26T18:52:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2054.242555 secs 2024-04-26T18:52:39.267 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1357.228595 secs 2024-04-26T18:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:39 smithi189 ceph-mon[32756]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:40.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:39 smithi156 ceph-mon[32679]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:39 smithi092 ceph-mon[29156]: pgmap v1730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:41 smithi189 ceph-mon[32756]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:42.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:41 smithi156 ceph-mon[32679]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:41 smithi092 ceph-mon[29156]: pgmap v1731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:43 smithi092 ceph-mon[29156]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:44.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2059.242668 secs 2024-04-26T18:52:44.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1362.228657 secs 2024-04-26T18:52:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:43 smithi189 ceph-mon[32756]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:44.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2059.242668 secs 2024-04-26T18:52:44.153 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1362.228657 secs 2024-04-26T18:52:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:43 smithi156 ceph-mon[32679]: pgmap v1732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:44.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2059.242668 secs 2024-04-26T18:52:44.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1362.228657 secs 2024-04-26T18:52:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:45 smithi189 ceph-mon[32756]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:45 smithi156 ceph-mon[32679]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:45 smithi092 ceph-mon[29156]: pgmap v1733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:52:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:47 smithi189 ceph-mon[32756]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:48.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:47 smithi156 ceph-mon[32679]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:47 smithi092 ceph-mon[29156]: pgmap v1734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:49.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2064.242742 secs 2024-04-26T18:52:49.183 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1367.228718 secs 2024-04-26T18:52:49.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:49.201 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:49.210 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:52:49.226 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:49.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2064.242742 secs 2024-04-26T18:52:49.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1367.228718 secs 2024-04-26T18:52:49.252 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:49.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:49.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:52:49.279 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:52:49.305 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2064.242742 secs 2024-04-26T18:52:49.314 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1367.228718 secs 2024-04-26T18:52:49.430 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:52:49.452 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:52:49.461 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:52:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:49 smithi189 ceph-mon[32756]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:49 smithi189 ceph-mon[32756]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:52:50.156 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:49 smithi189 ceph-mon[32756]: pgmap v1737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:50.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:49 smithi156 ceph-mon[32679]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:50.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:49 smithi156 ceph-mon[32679]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:52:50.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:49 smithi156 ceph-mon[32679]: pgmap v1737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:49 smithi092 ceph-mon[29156]: pgmap v1735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:52:50.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:49 smithi092 ceph-mon[29156]: pgmap v1736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T18:52:50.259 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:49 smithi092 ceph-mon[29156]: pgmap v1737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:51 smithi189 ceph-mon[32756]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:51 smithi156 ceph-mon[32679]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:51 smithi092 ceph-mon[29156]: pgmap v1738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:53 smithi189 ceph-mon[32756]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:52:54.199 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2069.242860 secs 2024-04-26T18:52:54.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1372.228836 secs 2024-04-26T18:52:54.259 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:53 smithi092 ceph-mon[29156]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:52:54.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2069.242860 secs 2024-04-26T18:52:54.277 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1372.228836 secs 2024-04-26T18:52:54.285 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:53 smithi156 ceph-mon[32679]: pgmap v1739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:52:54.301 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2069.242860 secs 2024-04-26T18:52:54.312 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1372.228836 secs 2024-04-26T18:52:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:55 smithi189 ceph-mon[32756]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:56.687 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:55 smithi092 ceph-mon[29156]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:56.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:55 smithi156 ceph-mon[32679]: pgmap v1740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:57 smithi189 ceph-mon[32756]: pgmap v1741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:57 smithi156 ceph-mon[32679]: pgmap v1741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:57 smithi092 ceph-mon[29156]: pgmap v1741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:52:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2074.242984 secs 2024-04-26T18:52:59.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1377.228945 secs 2024-04-26T18:52:59.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2074.242984 secs 2024-04-26T18:52:59.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1377.228945 secs 2024-04-26T18:52:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2074.242984 secs 2024-04-26T18:52:59.281 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1377.228945 secs 2024-04-26T18:53:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:52:59 smithi189 ceph-mon[32756]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:53:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:52:59 smithi156 ceph-mon[32679]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:53:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:52:59 smithi092 ceph-mon[29156]: pgmap v1742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:53:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:01 smithi189 ceph-mon[32756]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:01 smithi156 ceph-mon[32679]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:01 smithi092 ceph-mon[29156]: pgmap v1743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:03 smithi189 ceph-mon[32756]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:04.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2079.243097 secs 2024-04-26T18:53:04.155 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:03 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1382.229083 secs 2024-04-26T18:53:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:03 smithi156 ceph-mon[32679]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:04.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2079.243097 secs 2024-04-26T18:53:04.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:03 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1382.229083 secs 2024-04-26T18:53:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:03 smithi092 ceph-mon[29156]: pgmap v1744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:04.310 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2079.243097 secs 2024-04-26T18:53:04.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:03 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1382.229083 secs 2024-04-26T18:53:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:05 smithi189 ceph-mon[32756]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:05 smithi156 ceph-mon[32679]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:05 smithi092 ceph-mon[29156]: pgmap v1745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:07 smithi189 ceph-mon[32756]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:08.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:07 smithi156 ceph-mon[32679]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:07 smithi092 ceph-mon[29156]: pgmap v1746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2084.243216 secs 2024-04-26T18:53:09.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1387.229217 secs 2024-04-26T18:53:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2084.243216 secs 2024-04-26T18:53:09.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1387.229217 secs 2024-04-26T18:53:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2084.243216 secs 2024-04-26T18:53:09.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1387.229217 secs 2024-04-26T18:53:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:09 smithi189 ceph-mon[32756]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:09 smithi156 ceph-mon[32679]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:09 smithi092 ceph-mon[29156]: pgmap v1747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:11 smithi189 ceph-mon[32756]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:11 smithi156 ceph-mon[32679]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:11 smithi092 ceph-mon[29156]: pgmap v1748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:13 smithi189 ceph-mon[32756]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:14.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2089.243287 secs 2024-04-26T18:53:14.208 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1392.229329 secs 2024-04-26T18:53:14.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:13 smithi156 ceph-mon[32679]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:14.226 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2089.243287 secs 2024-04-26T18:53:14.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1392.229329 secs 2024-04-26T18:53:14.274 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:13 smithi092 ceph-mon[29156]: pgmap v1749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:14.283 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2089.243287 secs 2024-04-26T18:53:14.292 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1392.229329 secs 2024-04-26T18:53:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:15 smithi189 ceph-mon[32756]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:15 smithi156 ceph-mon[32679]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:15 smithi092 ceph-mon[29156]: pgmap v1750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:17 smithi189 ceph-mon[32756]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:17 smithi156 ceph-mon[32679]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:17 smithi092 ceph-mon[29156]: pgmap v1751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2094.243438 secs 2024-04-26T18:53:19.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:18 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1397.229393 secs 2024-04-26T18:53:19.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2094.243438 secs 2024-04-26T18:53:19.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:18 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1397.229393 secs 2024-04-26T18:53:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2094.243438 secs 2024-04-26T18:53:19.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:18 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1397.229393 secs 2024-04-26T18:53:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:19 smithi189 ceph-mon[32756]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:19 smithi156 ceph-mon[32679]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:19 smithi092 ceph-mon[29156]: pgmap v1752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:20 smithi189 ceph-mon[32756]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:20 smithi156 ceph-mon[32679]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:20 smithi092 ceph-mon[29156]: pgmap v1753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:23 smithi189 ceph-mon[32756]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:24.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2099.243556 secs 2024-04-26T18:53:24.178 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:23 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1402.229470 secs 2024-04-26T18:53:24.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:23 smithi156 ceph-mon[32679]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:24.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2099.243556 secs 2024-04-26T18:53:24.245 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:23 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1402.229470 secs 2024-04-26T18:53:24.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:23 smithi092 ceph-mon[29156]: pgmap v1754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:24.300 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2099.243556 secs 2024-04-26T18:53:24.309 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:23 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1402.229470 secs 2024-04-26T18:53:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:25 smithi189 ceph-mon[32756]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:25 smithi156 ceph-mon[32679]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:25 smithi092 ceph-mon[29156]: pgmap v1755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:27 smithi189 ceph-mon[32756]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:27 smithi156 ceph-mon[32679]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:27 smithi092 ceph-mon[29156]: pgmap v1756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2104.243651 secs 2024-04-26T18:53:29.204 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1407.229551 secs 2024-04-26T18:53:29.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2104.243651 secs 2024-04-26T18:53:29.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1407.229551 secs 2024-04-26T18:53:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2104.243651 secs 2024-04-26T18:53:29.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1407.229551 secs 2024-04-26T18:53:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:29 smithi189 ceph-mon[32756]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:30.163 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:29 smithi092 ceph-mon[29156]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:30.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:29 smithi156 ceph-mon[32679]: pgmap v1757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:31 smithi189 ceph-mon[32756]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:31 smithi156 ceph-mon[32679]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:31 smithi092 ceph-mon[29156]: pgmap v1758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:33 smithi189 ceph-mon[32756]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:34.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2109.243798 secs 2024-04-26T18:53:34.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1412.229625 secs 2024-04-26T18:53:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:33 smithi156 ceph-mon[32679]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:34.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2109.243798 secs 2024-04-26T18:53:34.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1412.229625 secs 2024-04-26T18:53:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:33 smithi092 ceph-mon[29156]: pgmap v1759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:34.274 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2109.243798 secs 2024-04-26T18:53:34.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1412.229625 secs 2024-04-26T18:53:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:35 smithi189 ceph-mon[32756]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:35 smithi156 ceph-mon[32679]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:36.270 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:35 smithi092 ceph-mon[29156]: pgmap v1760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:37 smithi189 ceph-mon[32756]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:37 smithi156 ceph-mon[32679]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:37 smithi092 ceph-mon[29156]: pgmap v1761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2114.243912 secs 2024-04-26T18:53:39.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1417.229689 secs 2024-04-26T18:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2114.243912 secs 2024-04-26T18:53:39.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1417.229689 secs 2024-04-26T18:53:39.287 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2114.243912 secs 2024-04-26T18:53:39.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1417.229689 secs 2024-04-26T18:53:40.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:39 smithi156 ceph-mon[32679]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:39 smithi189 ceph-mon[32756]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:39 smithi092 ceph-mon[29156]: pgmap v1762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:41 smithi189 ceph-mon[32756]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:41 smithi156 ceph-mon[32679]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:41 smithi092 ceph-mon[29156]: pgmap v1763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:43 smithi189 ceph-mon[32756]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:44.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2119.244030 secs 2024-04-26T18:53:44.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1422.229749 secs 2024-04-26T18:53:44.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:43 smithi092 ceph-mon[29156]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:44.403 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2119.244030 secs 2024-04-26T18:53:44.412 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1422.229749 secs 2024-04-26T18:53:44.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:43 smithi156 ceph-mon[32679]: pgmap v1764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:44.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2119.244030 secs 2024-04-26T18:53:44.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1422.229749 secs 2024-04-26T18:53:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:45 smithi092 ceph-mon[29156]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:45 smithi189 ceph-mon[32756]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:45 smithi156 ceph-mon[32679]: pgmap v1765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:47 smithi189 ceph-mon[32756]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:47 smithi156 ceph-mon[32679]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:47 smithi092 ceph-mon[29156]: pgmap v1766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:53:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2124.244105 secs 2024-04-26T18:53:49.204 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1427.229838 secs 2024-04-26T18:53:49.213 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:49.222 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2124.244105 secs 2024-04-26T18:53:49.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1427.229838 secs 2024-04-26T18:53:49.267 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:49.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2124.244105 secs 2024-04-26T18:53:49.285 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1427.229838 secs 2024-04-26T18:53:49.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:53:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:49 smithi189 ceph-mon[32756]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:50.313 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:50.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:50.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:53:50.358 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:49 smithi092 ceph-mon[29156]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:50.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:50.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:50.384 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:53:50.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:49 smithi156 ceph-mon[32679]: pgmap v1767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:53:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:53:50.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:53:50.453 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:53:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:50 smithi189 ceph-mon[32756]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:53:51.210 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:50 smithi189 ceph-mon[32756]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:51.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:50 smithi156 ceph-mon[32679]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:53:51.257 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:50 smithi156 ceph-mon[32679]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:51.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:50 smithi092 ceph-mon[29156]: pgmap v1768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:53:51.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:50 smithi092 ceph-mon[29156]: pgmap v1769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:52 smithi189 ceph-mon[32756]: pgmap v1770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:53.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:52 smithi156 ceph-mon[32679]: pgmap v1770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:52 smithi092 ceph-mon[29156]: pgmap v1770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2129.244191 secs 2024-04-26T18:53:54.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1432.229905 secs 2024-04-26T18:53:54.194 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2129.244191 secs 2024-04-26T18:53:54.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1432.229905 secs 2024-04-26T18:53:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2129.244191 secs 2024-04-26T18:53:54.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1432.229905 secs 2024-04-26T18:53:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:54 smithi189 ceph-mon[32756]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:54 smithi156 ceph-mon[32679]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:54 smithi092 ceph-mon[29156]: pgmap v1771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:56 smithi189 ceph-mon[32756]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:57.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:56 smithi092 ceph-mon[29156]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:57.284 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:56 smithi156 ceph-mon[32679]: pgmap v1772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:53:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:58 smithi189 ceph-mon[32756]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:59.177 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2134.244302 secs 2024-04-26T18:53:59.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 1437.230019 secs 2024-04-26T18:53:59.201 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:58 smithi156 ceph-mon[32679]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:59.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2134.244302 secs 2024-04-26T18:53:59.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 1437.230019 secs 2024-04-26T18:53:59.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:58 smithi092 ceph-mon[29156]: pgmap v1773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:53:59.286 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2134.244302 secs 2024-04-26T18:53:59.348 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 1437.230019 secs 2024-04-26T18:54:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:53:59 smithi189 ceph-mon[32756]: pgmap v1774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:54:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:53:59 smithi156 ceph-mon[32679]: pgmap v1774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:54:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:53:59 smithi092 ceph-mon[29156]: pgmap v1774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:54:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:02 smithi189 ceph-mon[32756]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:02 smithi156 ceph-mon[32679]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:02 smithi092 ceph-mon[29156]: pgmap v1775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2139.244426 secs 2024-04-26T18:54:04.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:04 smithi189 ceph-mon[32756]: 3 slow requests, 2 included below; oldest blocked for > 1442.230116 secs 2024-04-26T18:54:04.934 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:04 smithi189 ceph-mon[32756]: slow request 1442.230116 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:54:04.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:04 smithi189 ceph-mon[32756]: slow request 181.883853 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:54:04.957 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:04 smithi189 ceph-mon[32756]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:04.969 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2139.244426 secs 2024-04-26T18:54:04.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:04 smithi156 ceph-mon[32679]: 3 slow requests, 2 included below; oldest blocked for > 1442.230116 secs 2024-04-26T18:54:05.038 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:04 smithi156 ceph-mon[32679]: slow request 1442.230116 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:54:05.046 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:04 smithi156 ceph-mon[32679]: slow request 181.883853 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:54:05.053 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:04 smithi156 ceph-mon[32679]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:05.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2139.244426 secs 2024-04-26T18:54:05.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:04 smithi092 ceph-mon[29156]: 3 slow requests, 2 included below; oldest blocked for > 1442.230116 secs 2024-04-26T18:54:05.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:04 smithi092 ceph-mon[29156]: slow request 1442.230116 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:54:05.112 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:04 smithi092 ceph-mon[29156]: slow request 181.883853 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:54:05.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:04 smithi092 ceph-mon[29156]: pgmap v1776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:06 smithi189 ceph-mon[32756]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:06 smithi156 ceph-mon[32679]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:06.775 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:06 smithi092 ceph-mon[29156]: pgmap v1777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:54:08.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:08 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:54:08.672 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:08 smithi189 ceph-mon[32756]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:54:08.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:08 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:54:08.754 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:08 smithi156 ceph-mon[32679]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:08.763 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:54:08.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:08 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:54:08.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:08 smithi092 ceph-mon[29156]: pgmap v1778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2144.244508 secs 2024-04-26T18:54:09.663 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1447.230230 secs 2024-04-26T18:54:09.766 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2144.244508 secs 2024-04-26T18:54:09.906 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1447.230230 secs 2024-04-26T18:54:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2144.244508 secs 2024-04-26T18:54:09.927 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1447.230230 secs 2024-04-26T18:54:10.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:10 smithi156 ceph-mon[32679]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:10.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:10 smithi092 ceph-mon[29156]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:10.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:10 smithi189 ceph-mon[32756]: pgmap v1779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:12 smithi189 ceph-mon[32756]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:12.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:12 smithi156 ceph-mon[32679]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:12 smithi092 ceph-mon[29156]: pgmap v1780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2149.244620 secs 2024-04-26T18:54:14.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1452.230378 secs 2024-04-26T18:54:14.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:14 smithi189 ceph-mon[32756]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:14.970 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2149.244620 secs 2024-04-26T18:54:14.980 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1452.230378 secs 2024-04-26T18:54:14.989 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:14 smithi156 ceph-mon[32679]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:14.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2149.244620 secs 2024-04-26T18:54:15.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1452.230378 secs 2024-04-26T18:54:15.087 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:14 smithi092 ceph-mon[29156]: pgmap v1781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:16 smithi189 ceph-mon[32756]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:16 smithi156 ceph-mon[32679]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:16 smithi092 ceph-mon[29156]: pgmap v1782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:18 smithi189 ceph-mon[32756]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:18.954 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2154.244749 secs 2024-04-26T18:54:19.017 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:18 smithi092 ceph-mon[29156]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:19.029 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2154.244749 secs 2024-04-26T18:54:19.061 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:18 smithi156 ceph-mon[32679]: pgmap v1783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:19.120 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2154.244749 secs 2024-04-26T18:54:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1457.230490 secs 2024-04-26T18:54:19.964 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1457.230490 secs 2024-04-26T18:54:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1457.230490 secs 2024-04-26T18:54:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:20 smithi189 ceph-mon[32756]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:20.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:20 smithi156 ceph-mon[32679]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:20 smithi092 ceph-mon[29156]: pgmap v1784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:22 smithi189 ceph-mon[32756]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:22.947 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:22 smithi156 ceph-mon[32679]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:22 smithi092 ceph-mon[29156]: pgmap v1785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2159.244889 secs 2024-04-26T18:54:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2159.244889 secs 2024-04-26T18:54:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2159.244889 secs 2024-04-26T18:54:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1462.230641 secs 2024-04-26T18:54:24.951 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:24 smithi189 ceph-mon[32756]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:24.960 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1462.230641 secs 2024-04-26T18:54:24.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:24 smithi156 ceph-mon[32679]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1462.230641 secs 2024-04-26T18:54:25.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:24 smithi092 ceph-mon[29156]: pgmap v1786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:26 smithi189 ceph-mon[32756]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:26 smithi156 ceph-mon[32679]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:26 smithi092 ceph-mon[29156]: pgmap v1787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:28 smithi189 ceph-mon[32756]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:28.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2164.244955 secs 2024-04-26T18:54:28.987 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:28 smithi156 ceph-mon[32679]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:28.994 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2164.244955 secs 2024-04-26T18:54:29.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:28 smithi092 ceph-mon[29156]: pgmap v1788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:29.008 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2164.244955 secs 2024-04-26T18:54:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1467.230752 secs 2024-04-26T18:54:29.966 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1467.230752 secs 2024-04-26T18:54:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1467.230752 secs 2024-04-26T18:54:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:30 smithi189 ceph-mon[32756]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:30.958 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:30 smithi156 ceph-mon[32679]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:30 smithi092 ceph-mon[29156]: pgmap v1789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:32 smithi189 ceph-mon[32756]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:32 smithi156 ceph-mon[32679]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:32 smithi092 ceph-mon[29156]: pgmap v1790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2169.245072 secs 2024-04-26T18:54:33.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2169.245072 secs 2024-04-26T18:54:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2169.245072 secs 2024-04-26T18:54:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1472.230868 secs 2024-04-26T18:54:34.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:34 smithi189 ceph-mon[32756]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:34.981 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1472.230868 secs 2024-04-26T18:54:34.993 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:34 smithi156 ceph-mon[32679]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:35.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1472.230868 secs 2024-04-26T18:54:35.017 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:34 smithi092 ceph-mon[29156]: pgmap v1791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:54:36.275+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:54:36.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:54:36.275+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:54:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:54:36.276+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:54:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:54:36.276+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 21 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:54:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:36 smithi189 ceph-mon[32756]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:36 smithi156 ceph-mon[32679]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:36 smithi092 ceph-mon[29156]: pgmap v1792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:38 smithi189 ceph-mon[32756]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:38.922 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2174.245186 secs 2024-04-26T18:54:38.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:38 smithi156 ceph-mon[32679]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:38.982 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2174.245186 secs 2024-04-26T18:54:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:38 smithi092 ceph-mon[29156]: pgmap v1793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:39.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2174.245186 secs 2024-04-26T18:54:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1477.231041 secs 2024-04-26T18:54:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1477.231041 secs 2024-04-26T18:54:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1477.231041 secs 2024-04-26T18:54:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:40 smithi156 ceph-mon[32679]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:40 smithi092 ceph-mon[29156]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:41.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:40 smithi189 ceph-mon[32756]: pgmap v1794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:42 smithi156 ceph-mon[32679]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:42 smithi092 ceph-mon[29156]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:42 smithi189 ceph-mon[32756]: pgmap v1795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2179.245263 secs 2024-04-26T18:54:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2179.245263 secs 2024-04-26T18:54:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2179.245263 secs 2024-04-26T18:54:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1482.231136 secs 2024-04-26T18:54:44.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:44 smithi156 ceph-mon[32679]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1482.231136 secs 2024-04-26T18:54:45.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:44 smithi092 ceph-mon[29156]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1482.231136 secs 2024-04-26T18:54:45.153 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:44 smithi189 ceph-mon[32756]: pgmap v1796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:46 smithi156 ceph-mon[32679]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:46 smithi092 ceph-mon[29156]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:46 smithi189 ceph-mon[32756]: pgmap v1797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:48 smithi156 ceph-mon[32679]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:48.958 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2184.245376 secs 2024-04-26T18:54:48.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1487.231272 secs 2024-04-26T18:54:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:48 smithi092 ceph-mon[29156]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:49.049 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2184.245376 secs 2024-04-26T18:54:49.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1487.231272 secs 2024-04-26T18:54:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:48 smithi189 ceph-mon[32756]: pgmap v1798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:54:49.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2184.245376 secs 2024-04-26T18:54:49.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1487.231272 secs 2024-04-26T18:54:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:54:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:50 smithi156 ceph-mon[32679]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:50.948 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:50.959 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:51.002 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:54:51.010 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:50 smithi092 ceph-mon[29156]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:51.019 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:51.110 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:51.120 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:54:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:50 smithi189 ceph-mon[32756]: pgmap v1799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:54:51.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:54:51.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:54:51.203 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:54:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:51 smithi156 ceph-mon[32679]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:54:51.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:51 smithi156 ceph-mon[32679]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:51 smithi092 ceph-mon[29156]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:54:52.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:51 smithi092 ceph-mon[29156]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:51 smithi189 ceph-mon[32756]: pgmap v1800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:54:52.202 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:51 smithi189 ceph-mon[32756]: pgmap v1801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:53 smithi156 ceph-mon[32679]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:54:53.959 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2189.245498 secs 2024-04-26T18:54:54.007 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1492.231340 secs 2024-04-26T18:54:54.017 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:53 smithi092 ceph-mon[29156]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:54:54.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2189.245498 secs 2024-04-26T18:54:54.171 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1492.231340 secs 2024-04-26T18:54:54.180 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:53 smithi189 ceph-mon[32756]: pgmap v1802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T18:54:54.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2189.245498 secs 2024-04-26T18:54:54.198 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1492.231340 secs 2024-04-26T18:54:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:55 smithi156 ceph-mon[32679]: pgmap v1803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:55 smithi092 ceph-mon[29156]: pgmap v1803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:55 smithi189 ceph-mon[32756]: pgmap v1803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:57 smithi092 ceph-mon[29156]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:57 smithi189 ceph-mon[32756]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:57 smithi156 ceph-mon[32679]: pgmap v1804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:54:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2194.245640 secs 2024-04-26T18:54:59.091 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1497.231465 secs 2024-04-26T18:54:59.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2194.245640 secs 2024-04-26T18:54:59.203 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1497.231465 secs 2024-04-26T18:54:59.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2194.245640 secs 2024-04-26T18:54:59.295 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1497.231465 secs 2024-04-26T18:54:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:54:59 smithi092 ceph-mon[29156]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:55:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:54:59 smithi189 ceph-mon[32756]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:55:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:54:59 smithi156 ceph-mon[32679]: pgmap v1805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:55:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:01 smithi092 ceph-mon[29156]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:55:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:01 smithi189 ceph-mon[32756]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:55:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:01 smithi156 ceph-mon[32679]: pgmap v1806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:55:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:03 smithi092 ceph-mon[29156]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:04.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2199.245775 secs 2024-04-26T18:55:04.071 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1502.231567 secs 2024-04-26T18:55:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:03 smithi189 ceph-mon[32756]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:04.152 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2199.245775 secs 2024-04-26T18:55:04.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1502.231567 secs 2024-04-26T18:55:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:03 smithi156 ceph-mon[32679]: pgmap v1807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:04.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2199.245775 secs 2024-04-26T18:55:04.221 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1502.231567 secs 2024-04-26T18:55:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:05 smithi092 ceph-mon[29156]: pgmap v1808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:05 smithi189 ceph-mon[32756]: pgmap v1808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:05 smithi156 ceph-mon[32679]: pgmap v1808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:07 smithi092 ceph-mon[29156]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:07 smithi189 ceph-mon[32756]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:07 smithi156 ceph-mon[32679]: pgmap v1809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2204.245894 secs 2024-04-26T18:55:09.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1507.231700 secs 2024-04-26T18:55:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2204.245894 secs 2024-04-26T18:55:09.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1507.231700 secs 2024-04-26T18:55:09.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2204.245894 secs 2024-04-26T18:55:09.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1507.231700 secs 2024-04-26T18:55:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:09 smithi092 ceph-mon[29156]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:10.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:09 smithi156 ceph-mon[32679]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:09 smithi189 ceph-mon[32756]: pgmap v1810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:11 smithi092 ceph-mon[29156]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:11 smithi189 ceph-mon[32756]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:11 smithi156 ceph-mon[32679]: pgmap v1811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:13 smithi092 ceph-mon[29156]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:14.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2209.246012 secs 2024-04-26T18:55:14.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1512.231834 secs 2024-04-26T18:55:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:13 smithi189 ceph-mon[32756]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:14.174 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2209.246012 secs 2024-04-26T18:55:14.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1512.231834 secs 2024-04-26T18:55:14.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:13 smithi156 ceph-mon[32679]: pgmap v1812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:14.253 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2209.246012 secs 2024-04-26T18:55:14.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1512.231834 secs 2024-04-26T18:55:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:15 smithi092 ceph-mon[29156]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:15 smithi189 ceph-mon[32756]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:15 smithi156 ceph-mon[32679]: pgmap v1813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:17 smithi092 ceph-mon[29156]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:17 smithi189 ceph-mon[32756]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:17 smithi156 ceph-mon[32679]: pgmap v1814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2214.246125 secs 2024-04-26T18:55:19.095 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1517.231920 secs 2024-04-26T18:55:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2214.246125 secs 2024-04-26T18:55:19.152 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1517.231920 secs 2024-04-26T18:55:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2214.246125 secs 2024-04-26T18:55:19.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1517.231920 secs 2024-04-26T18:55:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:19 smithi092 ceph-mon[29156]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:19 smithi189 ceph-mon[32756]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:19 smithi156 ceph-mon[32679]: pgmap v1815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:21 smithi092 ceph-mon[29156]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:21 smithi189 ceph-mon[32756]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:21 smithi156 ceph-mon[32679]: pgmap v1816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:23 smithi092 ceph-mon[29156]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:24.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2219.246204 secs 2024-04-26T18:55:24.042 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1522.232092 secs 2024-04-26T18:55:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:23 smithi189 ceph-mon[32756]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:24.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2219.246204 secs 2024-04-26T18:55:24.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1522.232092 secs 2024-04-26T18:55:24.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:23 smithi156 ceph-mon[32679]: pgmap v1817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:24.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2219.246204 secs 2024-04-26T18:55:24.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1522.232092 secs 2024-04-26T18:55:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:25 smithi092 ceph-mon[29156]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:25 smithi189 ceph-mon[32756]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:25 smithi156 ceph-mon[32679]: pgmap v1818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:27 smithi189 ceph-mon[32756]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:27 smithi156 ceph-mon[32679]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:27 smithi092 ceph-mon[29156]: pgmap v1819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2224.246316 secs 2024-04-26T18:55:29.207 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1527.232219 secs 2024-04-26T18:55:29.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2224.246316 secs 2024-04-26T18:55:29.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1527.232219 secs 2024-04-26T18:55:29.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2224.246316 secs 2024-04-26T18:55:29.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1527.232219 secs 2024-04-26T18:55:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:29 smithi189 ceph-mon[32756]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:29 smithi156 ceph-mon[32679]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:29 smithi092 ceph-mon[29156]: pgmap v1820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:31 smithi189 ceph-mon[32756]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:32.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:31 smithi156 ceph-mon[32679]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:31 smithi092 ceph-mon[29156]: pgmap v1821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:33 smithi189 ceph-mon[32756]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:34.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2229.246450 secs 2024-04-26T18:55:34.154 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1532.232333 secs 2024-04-26T18:55:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:33 smithi156 ceph-mon[32679]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:34.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2229.246450 secs 2024-04-26T18:55:34.226 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1532.232333 secs 2024-04-26T18:55:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:33 smithi092 ceph-mon[29156]: pgmap v1822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:34.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2229.246450 secs 2024-04-26T18:55:34.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1532.232333 secs 2024-04-26T18:55:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:35 smithi189 ceph-mon[32756]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:35 smithi156 ceph-mon[32679]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:35 smithi092 ceph-mon[29156]: pgmap v1823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:37 smithi189 ceph-mon[32756]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:37 smithi156 ceph-mon[32679]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:37 smithi092 ceph-mon[29156]: pgmap v1824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2234.246573 secs 2024-04-26T18:55:39.159 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1537.232423 secs 2024-04-26T18:55:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2234.246573 secs 2024-04-26T18:55:39.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1537.232423 secs 2024-04-26T18:55:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2234.246573 secs 2024-04-26T18:55:39.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1537.232423 secs 2024-04-26T18:55:40.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:39 smithi156 ceph-mon[32679]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:39 smithi189 ceph-mon[32756]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:39 smithi092 ceph-mon[29156]: pgmap v1825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:41 smithi189 ceph-mon[32756]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:42.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:41 smithi156 ceph-mon[32679]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:41 smithi092 ceph-mon[29156]: pgmap v1826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:43 smithi189 ceph-mon[32756]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:44.167 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2239.246692 secs 2024-04-26T18:55:44.187 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1542.232504 secs 2024-04-26T18:55:44.196 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:43 smithi156 ceph-mon[32679]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:44.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2239.246692 secs 2024-04-26T18:55:44.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1542.232504 secs 2024-04-26T18:55:44.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:43 smithi092 ceph-mon[29156]: pgmap v1827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:44.313 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2239.246692 secs 2024-04-26T18:55:44.323 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1542.232504 secs 2024-04-26T18:55:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:45 smithi189 ceph-mon[32756]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:46.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:45 smithi092 ceph-mon[29156]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:46.415 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:45 smithi156 ceph-mon[32679]: pgmap v1828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:47 smithi189 ceph-mon[32756]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:47 smithi156 ceph-mon[32679]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:47 smithi092 ceph-mon[29156]: pgmap v1829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2244.246806 secs 2024-04-26T18:55:49.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1547.232607 secs 2024-04-26T18:55:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2244.246806 secs 2024-04-26T18:55:49.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1547.232607 secs 2024-04-26T18:55:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2244.246806 secs 2024-04-26T18:55:49.291 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1547.232607 secs 2024-04-26T18:55:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:49 smithi092 ceph-mon[29156]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:49 smithi189 ceph-mon[32756]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:49 smithi156 ceph-mon[32679]: pgmap v1830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:51 smithi189 ceph-mon[32756]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:51.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:51.705 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:51 smithi092 ceph-mon[29156]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:51.712 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:51.720 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:51 smithi156 ceph-mon[32679]: pgmap v1831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:51.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:55:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:53 smithi189 ceph-mon[32756]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:53 smithi156 ceph-mon[32679]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:53 smithi092 ceph-mon[29156]: pgmap v1832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:55:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2249.246905 secs 2024-04-26T18:55:54.697 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1552.232675 secs 2024-04-26T18:55:54.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2249.246905 secs 2024-04-26T18:55:54.747 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1552.232675 secs 2024-04-26T18:55:54.756 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2249.246905 secs 2024-04-26T18:55:54.764 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1552.232675 secs 2024-04-26T18:55:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:56.188 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.234 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.243 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.252 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.261 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:56.307 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:56.316 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.348 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:56.358 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.366 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.516 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.524 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:56.533 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:56.569 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.578 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: pgmap v1833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:55:56.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.713 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.719 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:56.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:55:56.745 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:55:56.754 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:55:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:56 smithi189 ceph-mon[32756]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:55:57.164 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:56 smithi189 ceph-mon[32756]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:57.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:56 smithi156 ceph-mon[32679]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:55:57.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:56 smithi156 ceph-mon[32679]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:56 smithi092 ceph-mon[29156]: pgmap v1834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:55:57.307 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:56 smithi092 ceph-mon[29156]: pgmap v1835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:58 smithi189 ceph-mon[32756]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:59.181 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2254.247028 secs 2024-04-26T18:55:59.227 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:55:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1557.232797 secs 2024-04-26T18:55:59.258 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:58 smithi092 ceph-mon[29156]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:59.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2254.247028 secs 2024-04-26T18:55:59.383 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:55:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1557.232797 secs 2024-04-26T18:55:59.390 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:58 smithi156 ceph-mon[32679]: pgmap v1836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:55:59.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2254.247028 secs 2024-04-26T18:55:59.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:55:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1557.232797 secs 2024-04-26T18:56:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:00 smithi189 ceph-mon[32756]: pgmap v1837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:00 smithi156 ceph-mon[32679]: pgmap v1837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:00 smithi092 ceph-mon[29156]: pgmap v1837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:01.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:56:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:56:01.590+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:56:02.020 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:56:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:56:01.590+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:56:02.027 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:56:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:56:01.590+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:56:02.035 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:56:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:56:01.590+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:56:02.109 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 18:56:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T18:56:01.590+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T18:56:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:02 smithi189 ceph-mon[32756]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:03.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:02 smithi156 ceph-mon[32679]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:02 smithi092 ceph-mon[29156]: pgmap v1838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:56:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2259.247152 secs 2024-04-26T18:56:04.149 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1562.232861 secs 2024-04-26T18:56:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2259.247152 secs 2024-04-26T18:56:04.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1562.232861 secs 2024-04-26T18:56:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2259.247152 secs 2024-04-26T18:56:04.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1562.232861 secs 2024-04-26T18:56:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:04 smithi189 ceph-mon[32756]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:05.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:04 smithi092 ceph-mon[29156]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:04 smithi156 ceph-mon[32679]: pgmap v1839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:56:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:06 smithi189 ceph-mon[32756]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T18:56:07.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:06 smithi156 ceph-mon[32679]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T18:56:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:06 smithi092 ceph-mon[29156]: pgmap v1840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T18:56:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:08 smithi189 ceph-mon[32756]: pgmap v1841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:09.213 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2264.247231 secs 2024-04-26T18:56:09.234 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1567.232966 secs 2024-04-26T18:56:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:08 smithi092 ceph-mon[29156]: pgmap v1841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:09.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2264.247231 secs 2024-04-26T18:56:09.260 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1567.232966 secs 2024-04-26T18:56:09.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:08 smithi156 ceph-mon[32679]: pgmap v1841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:09.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2264.247231 secs 2024-04-26T18:56:09.284 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1567.232966 secs 2024-04-26T18:56:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:10 smithi189 ceph-mon[32756]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:10 smithi156 ceph-mon[32679]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:10 smithi092 ceph-mon[29156]: pgmap v1842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:12 smithi189 ceph-mon[32756]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:12 smithi156 ceph-mon[32679]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:12 smithi092 ceph-mon[29156]: pgmap v1843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2269.247350 secs 2024-04-26T18:56:14.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1572.233102 secs 2024-04-26T18:56:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2269.247350 secs 2024-04-26T18:56:14.263 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1572.233102 secs 2024-04-26T18:56:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2269.247350 secs 2024-04-26T18:56:14.417 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1572.233102 secs 2024-04-26T18:56:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:14 smithi156 ceph-mon[32679]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:14 smithi092 ceph-mon[29156]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:14 smithi189 ceph-mon[32756]: pgmap v1844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T18:56:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:15 smithi156 ceph-mon[32679]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:16.196 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:15 smithi092 ceph-mon[29156]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:15 smithi189 ceph-mon[32756]: pgmap v1845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T18:56:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:17 smithi092 ceph-mon[29156]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:17 smithi189 ceph-mon[32756]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:17 smithi156 ceph-mon[32679]: pgmap v1846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2274.247481 secs 2024-04-26T18:56:19.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1577.233254 secs 2024-04-26T18:56:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2274.247481 secs 2024-04-26T18:56:19.447 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1577.233254 secs 2024-04-26T18:56:19.457 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2274.247481 secs 2024-04-26T18:56:19.465 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1577.233254 secs 2024-04-26T18:56:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:19 smithi092 ceph-mon[29156]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:19 smithi189 ceph-mon[32756]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:19 smithi156 ceph-mon[32679]: pgmap v1847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:21 smithi092 ceph-mon[29156]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:21 smithi189 ceph-mon[32756]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:22.445 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:21 smithi156 ceph-mon[32679]: pgmap v1848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:23 smithi092 ceph-mon[29156]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:24.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2279.247602 secs 2024-04-26T18:56:24.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1582.233375 secs 2024-04-26T18:56:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:23 smithi189 ceph-mon[32756]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:24.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2279.247602 secs 2024-04-26T18:56:24.482 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1582.233375 secs 2024-04-26T18:56:24.495 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:23 smithi156 ceph-mon[32679]: pgmap v1849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:24.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2279.247602 secs 2024-04-26T18:56:24.516 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1582.233375 secs 2024-04-26T18:56:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:25 smithi092 ceph-mon[29156]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:25 smithi189 ceph-mon[32756]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:25 smithi156 ceph-mon[32679]: pgmap v1850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:27 smithi092 ceph-mon[29156]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:27 smithi189 ceph-mon[32756]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:27 smithi156 ceph-mon[32679]: pgmap v1851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2284.247717 secs 2024-04-26T18:56:29.409 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1587.233490 secs 2024-04-26T18:56:29.448 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2284.247717 secs 2024-04-26T18:56:29.456 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1587.233490 secs 2024-04-26T18:56:29.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2284.247717 secs 2024-04-26T18:56:29.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1587.233490 secs 2024-04-26T18:56:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:30 smithi189 ceph-mon[32756]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:30.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:30 smithi156 ceph-mon[32679]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:30 smithi092 ceph-mon[29156]: pgmap v1852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:32 smithi189 ceph-mon[32756]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:32 smithi156 ceph-mon[32679]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:32 smithi092 ceph-mon[29156]: pgmap v1853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:34 smithi189 ceph-mon[32756]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:34.417 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2289.247854 secs 2024-04-26T18:56:34.434 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1592.233620 secs 2024-04-26T18:56:34.481 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:34 smithi156 ceph-mon[32679]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:34.490 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2289.247854 secs 2024-04-26T18:56:34.539 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1592.233620 secs 2024-04-26T18:56:34.586 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:34 smithi092 ceph-mon[29156]: pgmap v1854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:34.598 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2289.247854 secs 2024-04-26T18:56:34.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1592.233620 secs 2024-04-26T18:56:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:36 smithi189 ceph-mon[32756]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:36.461 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:36 smithi156 ceph-mon[32679]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:36.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:36 smithi092 ceph-mon[29156]: pgmap v1855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:38 smithi189 ceph-mon[32756]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:38 smithi156 ceph-mon[32679]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:38 smithi092 ceph-mon[29156]: pgmap v1856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2294.247904 secs 2024-04-26T18:56:39.431 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1597.233738 secs 2024-04-26T18:56:39.452 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2294.247904 secs 2024-04-26T18:56:39.484 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1597.233738 secs 2024-04-26T18:56:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2294.247904 secs 2024-04-26T18:56:39.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1597.233738 secs 2024-04-26T18:56:40.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:40 smithi156 ceph-mon[32679]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:40 smithi189 ceph-mon[32756]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:40 smithi092 ceph-mon[29156]: pgmap v1857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:42 smithi189 ceph-mon[32756]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:42 smithi156 ceph-mon[32679]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:42 smithi092 ceph-mon[29156]: pgmap v1858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:44 smithi189 ceph-mon[32756]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:44.419 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2299.248016 secs 2024-04-26T18:56:44.428 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1602.233853 secs 2024-04-26T18:56:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:44 smithi092 ceph-mon[29156]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:44.506 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2299.248016 secs 2024-04-26T18:56:44.523 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1602.233853 secs 2024-04-26T18:56:44.533 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:44 smithi156 ceph-mon[32679]: pgmap v1859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:44.548 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2299.248016 secs 2024-04-26T18:56:44.568 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1602.233853 secs 2024-04-26T18:56:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:46 smithi189 ceph-mon[32756]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:46 smithi156 ceph-mon[32679]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:46 smithi092 ceph-mon[29156]: pgmap v1860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:48 smithi189 ceph-mon[32756]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:48.472 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:48 smithi156 ceph-mon[32679]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:48 smithi092 ceph-mon[29156]: pgmap v1861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2304.248133 secs 2024-04-26T18:56:49.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1607.233970 secs 2024-04-26T18:56:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2304.248133 secs 2024-04-26T18:56:49.466 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1607.233970 secs 2024-04-26T18:56:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2304.248133 secs 2024-04-26T18:56:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1607.233970 secs 2024-04-26T18:56:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:50 smithi189 ceph-mon[32756]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:50 smithi156 ceph-mon[32679]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:50 smithi092 ceph-mon[29156]: pgmap v1862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:52 smithi189 ceph-mon[32756]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:52.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:52 smithi156 ceph-mon[32679]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:52 smithi092 ceph-mon[29156]: pgmap v1863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:54 smithi189 ceph-mon[32756]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:54.429 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2309.248245 secs 2024-04-26T18:56:54.509 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1612.234103 secs 2024-04-26T18:56:54.553 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:54 smithi092 ceph-mon[29156]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:54.565 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2309.248245 secs 2024-04-26T18:56:54.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1612.234103 secs 2024-04-26T18:56:54.610 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:54 smithi156 ceph-mon[32679]: pgmap v1864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:54.617 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2309.248245 secs 2024-04-26T18:56:54.654 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1612.234103 secs 2024-04-26T18:56:56.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:56 smithi189 ceph-mon[32756]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:56.409 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:56 smithi156 ceph-mon[32679]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:56.446 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:56 smithi092 ceph-mon[29156]: pgmap v1865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:56:56.505 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:56:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:58 smithi189 ceph-mon[32756]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:58.462 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:58 smithi156 ceph-mon[32679]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:58 smithi092 ceph-mon[29156]: pgmap v1866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:56:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2314.248324 secs 2024-04-26T18:56:59.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:56:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1617.234182 secs 2024-04-26T18:56:59.425 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2314.248324 secs 2024-04-26T18:56:59.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:56:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1617.234182 secs 2024-04-26T18:56:59.483 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2314.248324 secs 2024-04-26T18:56:59.491 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:56:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1617.234182 secs 2024-04-26T18:57:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:00.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:00.802 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:00.811 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:57:00.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:57:00.872 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: pgmap v1868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:57:00.888 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:00.928 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:00.946 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:00.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:01.061 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:57:01.108 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:57:01.116 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: pgmap v1868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:57:01.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:01.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:01.168 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: pgmap v1867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:01.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:01.304 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:01.333 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:57:01.340 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:57:01.348 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: pgmap v1868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:57:01.355 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: pgmap v1869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:01.420 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:57:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:02 smithi189 ceph-mon[32756]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:02 smithi156 ceph-mon[32679]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:02 smithi092 ceph-mon[29156]: pgmap v1870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:57:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2319.248406 secs 2024-04-26T18:57:04.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:04 smithi189 ceph-mon[32756]: 3 slow requests, 1 included below; oldest blocked for > 1622.234332 secs 2024-04-26T18:57:04.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:04 smithi189 ceph-mon[32756]: slow request 361.888069 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:57:04.912 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:04 smithi189 ceph-mon[32756]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2319.248406 secs 2024-04-26T18:57:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:04 smithi156 ceph-mon[32679]: 3 slow requests, 1 included below; oldest blocked for > 1622.234332 secs 2024-04-26T18:57:04.949 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:04 smithi156 ceph-mon[32679]: slow request 361.888069 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:57:04.958 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:04 smithi156 ceph-mon[32679]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2319.248406 secs 2024-04-26T18:57:05.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:04 smithi092 ceph-mon[29156]: 3 slow requests, 1 included below; oldest blocked for > 1622.234332 secs 2024-04-26T18:57:05.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:04 smithi092 ceph-mon[29156]: slow request 361.888069 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:57:05.098 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:04 smithi092 ceph-mon[29156]: pgmap v1871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T18:57:06.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:06 smithi092 ceph-mon[29156]: pgmap v1872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:06.909 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:06 smithi189 ceph-mon[32756]: pgmap v1872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:06.953 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:06 smithi156 ceph-mon[32679]: pgmap v1872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:08 smithi189 ceph-mon[32756]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:08 smithi156 ceph-mon[32679]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:08 smithi092 ceph-mon[29156]: pgmap v1873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2324.248522 secs 2024-04-26T18:57:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1627.234411 secs 2024-04-26T18:57:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2324.248522 secs 2024-04-26T18:57:09.949 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1627.234411 secs 2024-04-26T18:57:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2324.248522 secs 2024-04-26T18:57:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1627.234411 secs 2024-04-26T18:57:10.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:10 smithi156 ceph-mon[32679]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:57:11.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:10 smithi092 ceph-mon[29156]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:57:11.782 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:10 smithi189 ceph-mon[32756]: pgmap v1874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T18:57:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:12 smithi189 ceph-mon[32756]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:12 smithi156 ceph-mon[32679]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:12 smithi092 ceph-mon[29156]: pgmap v1875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2329.248639 secs 2024-04-26T18:57:14.951 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1632.234533 secs 2024-04-26T18:57:14.961 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:14 smithi189 ceph-mon[32756]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2329.248639 secs 2024-04-26T18:57:15.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1632.234533 secs 2024-04-26T18:57:15.017 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:14 smithi092 ceph-mon[29156]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:15.025 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2329.248639 secs 2024-04-26T18:57:15.076 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1632.234533 secs 2024-04-26T18:57:15.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:14 smithi156 ceph-mon[32679]: pgmap v1876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T18:57:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:16 smithi189 ceph-mon[32756]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:16 smithi156 ceph-mon[32679]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:16 smithi092 ceph-mon[29156]: pgmap v1877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T18:57:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:18 smithi189 ceph-mon[32756]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:19.049 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:18 smithi092 ceph-mon[29156]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:19.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:18 smithi156 ceph-mon[32679]: pgmap v1878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2334.248758 secs 2024-04-26T18:57:19.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1637.234614 secs 2024-04-26T18:57:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2334.248758 secs 2024-04-26T18:57:19.948 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1637.234614 secs 2024-04-26T18:57:20.007 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2334.248758 secs 2024-04-26T18:57:20.014 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1637.234614 secs 2024-04-26T18:57:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:20 smithi189 ceph-mon[32756]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:20.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:20 smithi156 ceph-mon[32679]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:21.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:20 smithi092 ceph-mon[29156]: pgmap v1879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:22 smithi189 ceph-mon[32756]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:22 smithi156 ceph-mon[32679]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:22 smithi092 ceph-mon[29156]: pgmap v1880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2339.248834 secs 2024-04-26T18:57:24.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1642.234693 secs 2024-04-26T18:57:24.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:24 smithi189 ceph-mon[32756]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:24.946 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2339.248834 secs 2024-04-26T18:57:24.957 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1642.234693 secs 2024-04-26T18:57:24.965 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:24 smithi156 ceph-mon[32679]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2339.248834 secs 2024-04-26T18:57:25.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1642.234693 secs 2024-04-26T18:57:25.035 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:24 smithi092 ceph-mon[29156]: pgmap v1881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:26 smithi189 ceph-mon[32756]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:26.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:26 smithi156 ceph-mon[32679]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:26 smithi092 ceph-mon[29156]: pgmap v1882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:28 smithi189 ceph-mon[32756]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:28 smithi156 ceph-mon[32679]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:28 smithi092 ceph-mon[29156]: pgmap v1883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2344.248937 secs 2024-04-26T18:57:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1647.234758 secs 2024-04-26T18:57:29.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2344.248937 secs 2024-04-26T18:57:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1647.234758 secs 2024-04-26T18:57:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2344.248937 secs 2024-04-26T18:57:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1647.234758 secs 2024-04-26T18:57:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:30 smithi189 ceph-mon[32756]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:30 smithi156 ceph-mon[32679]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:30 smithi092 ceph-mon[29156]: pgmap v1884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:32 smithi189 ceph-mon[32756]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:32 smithi156 ceph-mon[32679]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:32 smithi092 ceph-mon[29156]: pgmap v1885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2349.249090 secs 2024-04-26T18:57:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1652.234878 secs 2024-04-26T18:57:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:34 smithi189 ceph-mon[32756]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2349.249090 secs 2024-04-26T18:57:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1652.234878 secs 2024-04-26T18:57:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:34 smithi156 ceph-mon[32679]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2349.249090 secs 2024-04-26T18:57:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1652.234878 secs 2024-04-26T18:57:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:34 smithi092 ceph-mon[29156]: pgmap v1886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:57:36.298+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:57:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:57:36.298+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:57:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:57:36.299+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:57:36.299 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:57:36.299+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 22 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:57:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:36 smithi189 ceph-mon[32756]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:36 smithi156 ceph-mon[32679]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:36 smithi092 ceph-mon[29156]: pgmap v1887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:38 smithi189 ceph-mon[32756]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:38 smithi156 ceph-mon[32679]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:38 smithi092 ceph-mon[29156]: pgmap v1888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2354.249203 secs 2024-04-26T18:57:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1657.234976 secs 2024-04-26T18:57:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2354.249203 secs 2024-04-26T18:57:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1657.234976 secs 2024-04-26T18:57:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2354.249203 secs 2024-04-26T18:57:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1657.234976 secs 2024-04-26T18:57:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:40 smithi189 ceph-mon[32756]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:40 smithi156 ceph-mon[32679]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:40 smithi092 ceph-mon[29156]: pgmap v1889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:42 smithi189 ceph-mon[32756]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:42 smithi156 ceph-mon[32679]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:42 smithi092 ceph-mon[29156]: pgmap v1890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2359.249318 secs 2024-04-26T18:57:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1662.235096 secs 2024-04-26T18:57:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:44 smithi189 ceph-mon[32756]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2359.249318 secs 2024-04-26T18:57:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1662.235096 secs 2024-04-26T18:57:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:44 smithi156 ceph-mon[32679]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2359.249318 secs 2024-04-26T18:57:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1662.235096 secs 2024-04-26T18:57:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:44 smithi092 ceph-mon[29156]: pgmap v1891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:46 smithi189 ceph-mon[32756]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:46 smithi156 ceph-mon[32679]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:46 smithi092 ceph-mon[29156]: pgmap v1892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:48 smithi189 ceph-mon[32756]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2364.249415 secs 2024-04-26T18:57:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:48 smithi156 ceph-mon[32679]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2364.249415 secs 2024-04-26T18:57:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:48 smithi092 ceph-mon[29156]: pgmap v1893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2364.249415 secs 2024-04-26T18:57:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1667.235224 secs 2024-04-26T18:57:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1667.235224 secs 2024-04-26T18:57:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1667.235224 secs 2024-04-26T18:57:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:50 smithi189 ceph-mon[32756]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:50 smithi156 ceph-mon[32679]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:50 smithi092 ceph-mon[29156]: pgmap v1894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:52 smithi189 ceph-mon[32756]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:52 smithi156 ceph-mon[32679]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:52 smithi092 ceph-mon[29156]: pgmap v1895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2369.249547 secs 2024-04-26T18:57:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2369.249547 secs 2024-04-26T18:57:53.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2369.249547 secs 2024-04-26T18:57:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1672.235346 secs 2024-04-26T18:57:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:54 smithi189 ceph-mon[32756]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1672.235346 secs 2024-04-26T18:57:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:54 smithi156 ceph-mon[32679]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1672.235346 secs 2024-04-26T18:57:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:54 smithi092 ceph-mon[29156]: pgmap v1896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:56 smithi156 ceph-mon[32679]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:56 smithi092 ceph-mon[29156]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:56 smithi189 ceph-mon[32756]: pgmap v1897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:57:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:58 smithi156 ceph-mon[32679]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2374.249686 secs 2024-04-26T18:57:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:58 smithi092 ceph-mon[29156]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2374.249686 secs 2024-04-26T18:57:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:58 smithi189 ceph-mon[32756]: pgmap v1898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:57:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2374.249686 secs 2024-04-26T18:57:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:57:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1677.235485 secs 2024-04-26T18:57:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:57:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1677.235485 secs 2024-04-26T18:58:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:57:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1677.235485 secs 2024-04-26T18:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:00 smithi156 ceph-mon[32679]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:58:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:00 smithi092 ceph-mon[29156]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:58:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:58:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:00 smithi189 ceph-mon[32756]: pgmap v1899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:58:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:58:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:58:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:58:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:01 smithi156 ceph-mon[32679]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:58:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:01 smithi156 ceph-mon[32679]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:01 smithi092 ceph-mon[29156]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:58:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:01 smithi092 ceph-mon[29156]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:01 smithi189 ceph-mon[32756]: pgmap v1900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T18:58:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:01 smithi189 ceph-mon[32756]: pgmap v1901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:03 smithi156 ceph-mon[32679]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2379.249841 secs 2024-04-26T18:58:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:03 smithi092 ceph-mon[29156]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2379.249841 secs 2024-04-26T18:58:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:03 smithi189 ceph-mon[32756]: pgmap v1902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2379.249841 secs 2024-04-26T18:58:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:04 smithi156 ceph-mon[32679]: 3 slow requests, 1 included below; oldest blocked for > 1682.235574 secs 2024-04-26T18:58:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:04 smithi156 ceph-mon[32679]: slow request 721.940941 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:04 smithi092 ceph-mon[29156]: 3 slow requests, 1 included below; oldest blocked for > 1682.235574 secs 2024-04-26T18:58:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:04 smithi092 ceph-mon[29156]: slow request 721.940941 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:04 smithi189 ceph-mon[32756]: 3 slow requests, 1 included below; oldest blocked for > 1682.235574 secs 2024-04-26T18:58:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:04 smithi189 ceph-mon[32756]: slow request 721.940941 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T18:58:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:05 smithi156 ceph-mon[32679]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:05 smithi092 ceph-mon[29156]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:05 smithi189 ceph-mon[32756]: pgmap v1903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:07 smithi156 ceph-mon[32679]: pgmap v1904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:07 smithi092 ceph-mon[29156]: pgmap v1904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:07 smithi189 ceph-mon[32756]: pgmap v1904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:58:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2384.249860 secs 2024-04-26T18:58:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2384.249860 secs 2024-04-26T18:58:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2384.249860 secs 2024-04-26T18:58:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:09 smithi156 ceph-mon[32679]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1687.235696 secs 2024-04-26T18:58:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:09 smithi092 ceph-mon[29156]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1687.235696 secs 2024-04-26T18:58:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:09 smithi189 ceph-mon[32756]: pgmap v1905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:58:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1687.235696 secs 2024-04-26T18:58:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:11 smithi092 ceph-mon[29156]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:58:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:11 smithi189 ceph-mon[32756]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:58:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:11 smithi156 ceph-mon[32679]: pgmap v1906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T18:58:13.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:13 smithi189 ceph-mon[32756]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:13.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2389.249931 secs 2024-04-26T18:58:13.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1692.235821 secs 2024-04-26T18:58:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:13 smithi092 ceph-mon[29156]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2389.249931 secs 2024-04-26T18:58:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1692.235821 secs 2024-04-26T18:58:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:13 smithi156 ceph-mon[32679]: pgmap v1907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2389.249931 secs 2024-04-26T18:58:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1692.235821 secs 2024-04-26T18:58:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:15 smithi092 ceph-mon[29156]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:15 smithi189 ceph-mon[32756]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:15 smithi156 ceph-mon[32679]: pgmap v1908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:17 smithi092 ceph-mon[29156]: pgmap v1909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:17 smithi189 ceph-mon[32756]: pgmap v1909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:17 smithi156 ceph-mon[32679]: pgmap v1909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2394.250005 secs 2024-04-26T18:58:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1697.235917 secs 2024-04-26T18:58:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2394.250005 secs 2024-04-26T18:58:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1697.235917 secs 2024-04-26T18:58:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2394.250005 secs 2024-04-26T18:58:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1697.235917 secs 2024-04-26T18:58:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:19 smithi092 ceph-mon[29156]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:19 smithi189 ceph-mon[32756]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:19 smithi156 ceph-mon[32679]: pgmap v1910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:21 smithi092 ceph-mon[29156]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:21 smithi189 ceph-mon[32756]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:21 smithi156 ceph-mon[32679]: pgmap v1911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:23 smithi092 ceph-mon[29156]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2399.250067 secs 2024-04-26T18:58:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1702.236031 secs 2024-04-26T18:58:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:23 smithi189 ceph-mon[32756]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2399.250067 secs 2024-04-26T18:58:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1702.236031 secs 2024-04-26T18:58:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:23 smithi156 ceph-mon[32679]: pgmap v1912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2399.250067 secs 2024-04-26T18:58:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1702.236031 secs 2024-04-26T18:58:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:25 smithi092 ceph-mon[29156]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:25 smithi189 ceph-mon[32756]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:25 smithi156 ceph-mon[32679]: pgmap v1913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:27 smithi092 ceph-mon[29156]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:27 smithi189 ceph-mon[32756]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:27 smithi156 ceph-mon[32679]: pgmap v1914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2404.250185 secs 2024-04-26T18:58:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1707.236153 secs 2024-04-26T18:58:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2404.250185 secs 2024-04-26T18:58:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1707.236153 secs 2024-04-26T18:58:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2404.250185 secs 2024-04-26T18:58:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1707.236153 secs 2024-04-26T18:58:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:29 smithi092 ceph-mon[29156]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:29 smithi189 ceph-mon[32756]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:29 smithi156 ceph-mon[32679]: pgmap v1915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:31 smithi092 ceph-mon[29156]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:31 smithi189 ceph-mon[32756]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:31 smithi156 ceph-mon[32679]: pgmap v1916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:33 smithi092 ceph-mon[29156]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2409.250305 secs 2024-04-26T18:58:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1712.236258 secs 2024-04-26T18:58:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:33 smithi189 ceph-mon[32756]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2409.250305 secs 2024-04-26T18:58:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1712.236258 secs 2024-04-26T18:58:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:33 smithi156 ceph-mon[32679]: pgmap v1917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2409.250305 secs 2024-04-26T18:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1712.236258 secs 2024-04-26T18:58:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:35 smithi092 ceph-mon[29156]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:35 smithi189 ceph-mon[32756]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:35 smithi156 ceph-mon[32679]: pgmap v1918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:37 smithi092 ceph-mon[29156]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:37 smithi189 ceph-mon[32756]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:37 smithi156 ceph-mon[32679]: pgmap v1919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2414.250429 secs 2024-04-26T18:58:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1717.236401 secs 2024-04-26T18:58:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2414.250429 secs 2024-04-26T18:58:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1717.236401 secs 2024-04-26T18:58:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2414.250429 secs 2024-04-26T18:58:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1717.236401 secs 2024-04-26T18:58:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:39 smithi092 ceph-mon[29156]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:39 smithi189 ceph-mon[32756]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:39 smithi156 ceph-mon[32679]: pgmap v1920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:41 smithi189 ceph-mon[32756]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:41 smithi156 ceph-mon[32679]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:41 smithi092 ceph-mon[29156]: pgmap v1921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:43 smithi189 ceph-mon[32756]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2419.250550 secs 2024-04-26T18:58:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1722.236537 secs 2024-04-26T18:58:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:43 smithi156 ceph-mon[32679]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2419.250550 secs 2024-04-26T18:58:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1722.236537 secs 2024-04-26T18:58:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:43 smithi092 ceph-mon[29156]: pgmap v1922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2419.250550 secs 2024-04-26T18:58:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1722.236537 secs 2024-04-26T18:58:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:45 smithi189 ceph-mon[32756]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:45 smithi156 ceph-mon[32679]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:45 smithi092 ceph-mon[29156]: pgmap v1923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:47 smithi189 ceph-mon[32756]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:47 smithi156 ceph-mon[32679]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:47 smithi092 ceph-mon[29156]: pgmap v1924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2424.250660 secs 2024-04-26T18:58:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1727.236602 secs 2024-04-26T18:58:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2424.250660 secs 2024-04-26T18:58:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1727.236602 secs 2024-04-26T18:58:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2424.250660 secs 2024-04-26T18:58:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1727.236602 secs 2024-04-26T18:58:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:49 smithi189 ceph-mon[32756]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:49 smithi156 ceph-mon[32679]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:49 smithi092 ceph-mon[29156]: pgmap v1925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:51 smithi189 ceph-mon[32756]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:51 smithi156 ceph-mon[32679]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:51 smithi092 ceph-mon[29156]: pgmap v1926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:53 smithi189 ceph-mon[32756]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2429.250799 secs 2024-04-26T18:58:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1732.236715 secs 2024-04-26T18:58:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:53 smithi156 ceph-mon[32679]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2429.250799 secs 2024-04-26T18:58:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1732.236715 secs 2024-04-26T18:58:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:53 smithi092 ceph-mon[29156]: pgmap v1927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2429.250799 secs 2024-04-26T18:58:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1732.236715 secs 2024-04-26T18:58:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:55 smithi189 ceph-mon[32756]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:55 smithi156 ceph-mon[32679]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:55 smithi092 ceph-mon[29156]: pgmap v1928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:58:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:57 smithi189 ceph-mon[32756]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:57 smithi156 ceph-mon[32679]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:57 smithi092 ceph-mon[29156]: pgmap v1929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:58:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2434.250907 secs 2024-04-26T18:58:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 1737.236829 secs 2024-04-26T18:58:59.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2434.250907 secs 2024-04-26T18:58:59.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 1737.236829 secs 2024-04-26T18:58:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2434.250907 secs 2024-04-26T18:58:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 1737.236829 secs 2024-04-26T18:59:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:58:59 smithi189 ceph-mon[32756]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:58:59 smithi156 ceph-mon[32679]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:58:59 smithi092 ceph-mon[29156]: pgmap v1930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T18:59:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:01 smithi189 ceph-mon[32756]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:59:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:01 smithi156 ceph-mon[32679]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:59:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:01 smithi092 ceph-mon[29156]: pgmap v1931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T18:59:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T18:59:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T18:59:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:02 smithi189 ceph-mon[32756]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:02 smithi189 ceph-mon[32756]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:02 smithi156 ceph-mon[32679]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:02 smithi156 ceph-mon[32679]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:02 smithi092 ceph-mon[29156]: pgmap v1932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:02 smithi092 ceph-mon[29156]: pgmap v1933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2439.251028 secs 2024-04-26T18:59:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 1742.236954 secs 2024-04-26T18:59:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:03 smithi189 ceph-mon[32756]: slow request 181.783376 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:59:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2439.251028 secs 2024-04-26T18:59:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 1742.236954 secs 2024-04-26T18:59:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:03 smithi156 ceph-mon[32679]: slow request 181.783376 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:59:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2439.251028 secs 2024-04-26T18:59:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 1742.236954 secs 2024-04-26T18:59:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:03 smithi092 ceph-mon[29156]: slow request 181.783376 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T18:59:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:04 smithi189 ceph-mon[32756]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:59:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:04 smithi156 ceph-mon[32679]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:59:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:04 smithi092 ceph-mon[29156]: pgmap v1934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T18:59:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:06 smithi189 ceph-mon[32756]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:06 smithi156 ceph-mon[32679]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:06 smithi092 ceph-mon[29156]: pgmap v1935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:59:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:59:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:59:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:59:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T18:59:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T18:59:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:08 smithi189 ceph-mon[32756]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2444.251133 secs 2024-04-26T18:59:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1747.237044 secs 2024-04-26T18:59:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:08 smithi156 ceph-mon[32679]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2444.251133 secs 2024-04-26T18:59:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1747.237044 secs 2024-04-26T18:59:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:08 smithi092 ceph-mon[29156]: pgmap v1936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T18:59:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2444.251133 secs 2024-04-26T18:59:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1747.237044 secs 2024-04-26T18:59:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:10 smithi189 ceph-mon[32756]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T18:59:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:10 smithi156 ceph-mon[32679]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T18:59:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:10 smithi092 ceph-mon[29156]: pgmap v1937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T18:59:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:12 smithi189 ceph-mon[32756]: pgmap v1938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:12 smithi156 ceph-mon[32679]: pgmap v1938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:12 smithi092 ceph-mon[29156]: pgmap v1938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T18:59:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2449.251252 secs 2024-04-26T18:59:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1752.237158 secs 2024-04-26T18:59:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2449.251252 secs 2024-04-26T18:59:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1752.237158 secs 2024-04-26T18:59:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2449.251252 secs 2024-04-26T18:59:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1752.237158 secs 2024-04-26T18:59:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:14 smithi189 ceph-mon[32756]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:14 smithi156 ceph-mon[32679]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:14 smithi092 ceph-mon[29156]: pgmap v1939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:16 smithi189 ceph-mon[32756]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:16 smithi156 ceph-mon[32679]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:16 smithi092 ceph-mon[29156]: pgmap v1940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:18 smithi189 ceph-mon[32756]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2454.251369 secs 2024-04-26T18:59:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1757.237278 secs 2024-04-26T18:59:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:18 smithi156 ceph-mon[32679]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2454.251369 secs 2024-04-26T18:59:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1757.237278 secs 2024-04-26T18:59:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:18 smithi092 ceph-mon[29156]: pgmap v1941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2454.251369 secs 2024-04-26T18:59:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1757.237278 secs 2024-04-26T18:59:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:20 smithi189 ceph-mon[32756]: pgmap v1942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:20 smithi156 ceph-mon[32679]: pgmap v1942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:20 smithi092 ceph-mon[29156]: pgmap v1942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:22 smithi189 ceph-mon[32756]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:22 smithi156 ceph-mon[32679]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:22 smithi092 ceph-mon[29156]: pgmap v1943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2459.251487 secs 2024-04-26T18:59:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1762.237399 secs 2024-04-26T18:59:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2459.251487 secs 2024-04-26T18:59:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1762.237399 secs 2024-04-26T18:59:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2459.251487 secs 2024-04-26T18:59:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1762.237399 secs 2024-04-26T18:59:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:24 smithi189 ceph-mon[32756]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:24 smithi156 ceph-mon[32679]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:24 smithi092 ceph-mon[29156]: pgmap v1944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:26 smithi189 ceph-mon[32756]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:26 smithi156 ceph-mon[32679]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:26 smithi092 ceph-mon[29156]: pgmap v1945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:28 smithi189 ceph-mon[32756]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2464.251601 secs 2024-04-26T18:59:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1767.237523 secs 2024-04-26T18:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:28 smithi156 ceph-mon[32679]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2464.251601 secs 2024-04-26T18:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1767.237523 secs 2024-04-26T18:59:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:28 smithi092 ceph-mon[29156]: pgmap v1946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2464.251601 secs 2024-04-26T18:59:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1767.237523 secs 2024-04-26T18:59:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:30 smithi189 ceph-mon[32756]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:30 smithi156 ceph-mon[32679]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:30 smithi092 ceph-mon[29156]: pgmap v1947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:32 smithi156 ceph-mon[32679]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:32 smithi092 ceph-mon[29156]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:32 smithi189 ceph-mon[32756]: pgmap v1948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2469.251717 secs 2024-04-26T18:59:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1772.237647 secs 2024-04-26T18:59:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2469.251717 secs 2024-04-26T18:59:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1772.237647 secs 2024-04-26T18:59:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2469.251717 secs 2024-04-26T18:59:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1772.237647 secs 2024-04-26T18:59:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:34 smithi156 ceph-mon[32679]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:34 smithi092 ceph-mon[29156]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:34 smithi189 ceph-mon[32756]: pgmap v1949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:36 smithi156 ceph-mon[32679]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:36 smithi092 ceph-mon[29156]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:36 smithi189 ceph-mon[32756]: pgmap v1950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:38 smithi156 ceph-mon[32679]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2474.251851 secs 2024-04-26T18:59:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1777.237770 secs 2024-04-26T18:59:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:38 smithi092 ceph-mon[29156]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2474.251851 secs 2024-04-26T18:59:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1777.237770 secs 2024-04-26T18:59:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:38 smithi189 ceph-mon[32756]: pgmap v1951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2474.251851 secs 2024-04-26T18:59:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1777.237770 secs 2024-04-26T18:59:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:40 smithi156 ceph-mon[32679]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:40 smithi092 ceph-mon[29156]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:40 smithi189 ceph-mon[32756]: pgmap v1952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:42 smithi156 ceph-mon[32679]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:42 smithi092 ceph-mon[29156]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:42 smithi189 ceph-mon[32756]: pgmap v1953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2479.251972 secs 2024-04-26T18:59:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1782.237833 secs 2024-04-26T18:59:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2479.251972 secs 2024-04-26T18:59:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1782.237833 secs 2024-04-26T18:59:44.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2479.251972 secs 2024-04-26T18:59:44.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1782.237833 secs 2024-04-26T18:59:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:44 smithi156 ceph-mon[32679]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:44 smithi092 ceph-mon[29156]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:44 smithi189 ceph-mon[32756]: pgmap v1954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:46 smithi156 ceph-mon[32679]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:46 smithi092 ceph-mon[29156]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:46 smithi189 ceph-mon[32756]: pgmap v1955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:47 smithi092 ceph-mon[29156]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:47 smithi189 ceph-mon[32756]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:47 smithi156 ceph-mon[32679]: pgmap v1956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T18:59:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2484.252056 secs 2024-04-26T18:59:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1787.237954 secs 2024-04-26T18:59:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2484.252056 secs 2024-04-26T18:59:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1787.237954 secs 2024-04-26T18:59:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2484.252056 secs 2024-04-26T18:59:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1787.237954 secs 2024-04-26T18:59:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:49 smithi092 ceph-mon[29156]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:49 smithi189 ceph-mon[32756]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:49 smithi156 ceph-mon[32679]: pgmap v1957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T18:59:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:59:51.317+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:59:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:59:51.317+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:59:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:59:51.317+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T18:59:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T18:59:51.317+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 23 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T18:59:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:52 smithi092 ceph-mon[29156]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:52 smithi189 ceph-mon[32756]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:52 smithi156 ceph-mon[32679]: pgmap v1958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:54 smithi092 ceph-mon[29156]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2489.252178 secs 2024-04-26T18:59:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1792.238091 secs 2024-04-26T18:59:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:54 smithi189 ceph-mon[32756]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2489.252178 secs 2024-04-26T18:59:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1792.238091 secs 2024-04-26T18:59:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:54 smithi156 ceph-mon[32679]: pgmap v1959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2489.252178 secs 2024-04-26T18:59:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1792.238091 secs 2024-04-26T18:59:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:56 smithi092 ceph-mon[29156]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:56 smithi189 ceph-mon[32756]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:56 smithi156 ceph-mon[32679]: pgmap v1960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T18:59:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:58 smithi092 ceph-mon[29156]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:58 smithi189 ceph-mon[32756]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:58 smithi156 ceph-mon[32679]: pgmap v1961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T18:59:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2494.252291 secs 2024-04-26T18:59:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 18:59:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1797.238209 secs 2024-04-26T18:59:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2494.252291 secs 2024-04-26T18:59:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 18:59:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1797.238209 secs 2024-04-26T18:59:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2494.252291 secs 2024-04-26T18:59:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 18:59:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1797.238209 secs 2024-04-26T19:00:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:00 smithi092 ceph-mon[29156]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:00:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:00 smithi189 ceph-mon[32756]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:00:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:00 smithi156 ceph-mon[32679]: pgmap v1962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:00:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:00:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:00:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: pgmap v1963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:00:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:00:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:00:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: pgmap v1964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:00:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: pgmap v1965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:00:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:03 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2499.252409 secs 2024-04-26T19:00:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:03 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2499.252409 secs 2024-04-26T19:00:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:03 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2499.252409 secs 2024-04-26T19:00:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1802.238331 secs 2024-04-26T19:00:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:04 smithi092 ceph-mon[29156]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1802.238331 secs 2024-04-26T19:00:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:04 smithi189 ceph-mon[32756]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1802.238331 secs 2024-04-26T19:00:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:04 smithi156 ceph-mon[32679]: pgmap v1966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:05 smithi092 ceph-mon[29156]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:05 smithi189 ceph-mon[32756]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:05 smithi156 ceph-mon[32679]: pgmap v1967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:07 smithi092 ceph-mon[29156]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:07 smithi189 ceph-mon[32756]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:07 smithi156 ceph-mon[32679]: pgmap v1968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:00:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2504.252531 secs 2024-04-26T19:00:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1807.238453 secs 2024-04-26T19:00:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2504.252531 secs 2024-04-26T19:00:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1807.238453 secs 2024-04-26T19:00:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2504.252531 secs 2024-04-26T19:00:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1807.238453 secs 2024-04-26T19:00:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:09 smithi092 ceph-mon[29156]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:09 smithi189 ceph-mon[32756]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:09 smithi156 ceph-mon[32679]: pgmap v1969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:00:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:11 smithi092 ceph-mon[29156]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:00:12.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:11 smithi156 ceph-mon[32679]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:00:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:11 smithi189 ceph-mon[32756]: pgmap v1970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:00:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:13 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2509.252649 secs 2024-04-26T19:00:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:13 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2509.252649 secs 2024-04-26T19:00:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:13 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2509.252649 secs 2024-04-26T19:00:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1812.238548 secs 2024-04-26T19:00:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:14 smithi092 ceph-mon[29156]: pgmap v1971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1812.238548 secs 2024-04-26T19:00:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:14 smithi189 ceph-mon[32756]: pgmap v1971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1812.238548 secs 2024-04-26T19:00:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:14 smithi156 ceph-mon[32679]: pgmap v1971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:15 smithi092 ceph-mon[29156]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:15 smithi189 ceph-mon[32756]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:15 smithi156 ceph-mon[32679]: pgmap v1972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:17 smithi092 ceph-mon[29156]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:17 smithi189 ceph-mon[32756]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:17 smithi156 ceph-mon[32679]: pgmap v1973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2514.252784 secs 2024-04-26T19:00:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1817.238676 secs 2024-04-26T19:00:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2514.252784 secs 2024-04-26T19:00:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1817.238676 secs 2024-04-26T19:00:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2514.252784 secs 2024-04-26T19:00:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1817.238676 secs 2024-04-26T19:00:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:19 smithi092 ceph-mon[29156]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:19 smithi189 ceph-mon[32756]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:19 smithi156 ceph-mon[32679]: pgmap v1974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:21 smithi092 ceph-mon[29156]: pgmap v1975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:21 smithi189 ceph-mon[32756]: pgmap v1975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:21 smithi156 ceph-mon[32679]: pgmap v1975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:23 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2519.252848 secs 2024-04-26T19:00:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:23 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2519.252848 secs 2024-04-26T19:00:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:23 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2519.252848 secs 2024-04-26T19:00:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1822.238807 secs 2024-04-26T19:00:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:24 smithi092 ceph-mon[29156]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1822.238807 secs 2024-04-26T19:00:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:24 smithi189 ceph-mon[32756]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1822.238807 secs 2024-04-26T19:00:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:24 smithi156 ceph-mon[32679]: pgmap v1976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:25 smithi092 ceph-mon[29156]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:25 smithi189 ceph-mon[32756]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:25 smithi156 ceph-mon[32679]: pgmap v1977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:27 smithi092 ceph-mon[29156]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:27 smithi189 ceph-mon[32756]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:27 smithi156 ceph-mon[32679]: pgmap v1978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2524.252986 secs 2024-04-26T19:00:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1827.238885 secs 2024-04-26T19:00:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2524.252986 secs 2024-04-26T19:00:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1827.238885 secs 2024-04-26T19:00:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2524.252986 secs 2024-04-26T19:00:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1827.238885 secs 2024-04-26T19:00:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:29 smithi092 ceph-mon[29156]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:29 smithi189 ceph-mon[32756]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:29 smithi156 ceph-mon[32679]: pgmap v1979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:31 smithi092 ceph-mon[29156]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:31 smithi189 ceph-mon[32756]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:31 smithi156 ceph-mon[32679]: pgmap v1980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:33 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2529.253081 secs 2024-04-26T19:00:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:33 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2529.253081 secs 2024-04-26T19:00:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:33 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2529.253081 secs 2024-04-26T19:00:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1832.238988 secs 2024-04-26T19:00:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:34 smithi092 ceph-mon[29156]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1832.238988 secs 2024-04-26T19:00:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:34 smithi189 ceph-mon[32756]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1832.238988 secs 2024-04-26T19:00:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:34 smithi156 ceph-mon[32679]: pgmap v1981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:35 smithi092 ceph-mon[29156]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:00:36.323+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:00:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:00:36.323+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:00:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:00:36.323+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:00:36.324 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:00:36.323+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 24 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:00:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:35 smithi189 ceph-mon[32756]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:35 smithi156 ceph-mon[32679]: pgmap v1982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:37 smithi092 ceph-mon[29156]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:37 smithi189 ceph-mon[32756]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:37 smithi156 ceph-mon[32679]: pgmap v1983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2534.253192 secs 2024-04-26T19:00:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1837.239120 secs 2024-04-26T19:00:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2534.253192 secs 2024-04-26T19:00:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1837.239120 secs 2024-04-26T19:00:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2534.253192 secs 2024-04-26T19:00:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1837.239120 secs 2024-04-26T19:00:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:39 smithi092 ceph-mon[29156]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:39 smithi189 ceph-mon[32756]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:39 smithi156 ceph-mon[32679]: pgmap v1984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:42.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:41 smithi156 ceph-mon[32679]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:41 smithi092 ceph-mon[29156]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:41 smithi189 ceph-mon[32756]: pgmap v1985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:43 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2539.253270 secs 2024-04-26T19:00:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:43 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2539.253270 secs 2024-04-26T19:00:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:43 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2539.253270 secs 2024-04-26T19:00:44.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1842.239269 secs 2024-04-26T19:00:44.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:44 smithi092 ceph-mon[29156]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1842.239269 secs 2024-04-26T19:00:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:44 smithi189 ceph-mon[32756]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1842.239269 secs 2024-04-26T19:00:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:44 smithi156 ceph-mon[32679]: pgmap v1986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:45 smithi092 ceph-mon[29156]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:45 smithi189 ceph-mon[32756]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:45 smithi156 ceph-mon[32679]: pgmap v1987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:47 smithi092 ceph-mon[29156]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:47 smithi189 ceph-mon[32756]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:47 smithi156 ceph-mon[32679]: pgmap v1988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2544.253390 secs 2024-04-26T19:00:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1847.239357 secs 2024-04-26T19:00:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2544.253390 secs 2024-04-26T19:00:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1847.239357 secs 2024-04-26T19:00:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2544.253390 secs 2024-04-26T19:00:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1847.239357 secs 2024-04-26T19:00:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:49 smithi092 ceph-mon[29156]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:49 smithi189 ceph-mon[32756]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:49 smithi156 ceph-mon[32679]: pgmap v1989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:51 smithi092 ceph-mon[29156]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:51 smithi189 ceph-mon[32756]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:51 smithi156 ceph-mon[32679]: pgmap v1990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:53 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2549.253526 secs 2024-04-26T19:00:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:53 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2549.253526 secs 2024-04-26T19:00:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:53 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2549.253526 secs 2024-04-26T19:00:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1852.239434 secs 2024-04-26T19:00:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:54 smithi092 ceph-mon[29156]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1852.239434 secs 2024-04-26T19:00:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:54 smithi189 ceph-mon[32756]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1852.239434 secs 2024-04-26T19:00:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:54 smithi156 ceph-mon[32679]: pgmap v1991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:00:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:55 smithi092 ceph-mon[29156]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:55 smithi189 ceph-mon[32756]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:55 smithi156 ceph-mon[32679]: pgmap v1992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:57 smithi092 ceph-mon[29156]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:57 smithi189 ceph-mon[32756]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:57 smithi156 ceph-mon[32679]: pgmap v1993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:00:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 2554.253664 secs 2024-04-26T19:00:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1857.239561 secs 2024-04-26T19:00:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 2554.253664 secs 2024-04-26T19:00:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1857.239561 secs 2024-04-26T19:00:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 2554.253664 secs 2024-04-26T19:00:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1857.239561 secs 2024-04-26T19:01:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:00:59 smithi092 ceph-mon[29156]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:00:59 smithi189 ceph-mon[32756]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:00:59 smithi156 ceph-mon[32679]: pgmap v1994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:01.923 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:01:01.653+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:01:01.923 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:01:01.653+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:01:01.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:01:01.653+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:01:01.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:01:01.653+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:01:01.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:01:01.653+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:01:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:01 smithi189 ceph-mon[32756]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:01 smithi092 ceph-mon[29156]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:01 smithi156 ceph-mon[32679]: pgmap v1995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.314 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:01:03.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:03.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:03 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2559.253740 secs 2024-04-26T19:01:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1862.239667 secs 2024-04-26T19:01:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:03 smithi092 ceph-mon[29156]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T19:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:03 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2559.253740 secs 2024-04-26T19:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1862.239667 secs 2024-04-26T19:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:03 smithi189 ceph-mon[32756]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T19:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:03 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2559.253740 secs 2024-04-26T19:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1862.239667 secs 2024-04-26T19:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:03 smithi156 ceph-mon[32679]: pgmap v1996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T19:01:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:01:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:01:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:01:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: pgmap v1997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:01:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:01:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:01:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:07 smithi092 ceph-mon[29156]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 509 B/s wr, 4 op/s 2024-04-26T19:01:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:07 smithi092 ceph-mon[29156]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:01:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:07 smithi189 ceph-mon[32756]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 509 B/s wr, 4 op/s 2024-04-26T19:01:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:07 smithi189 ceph-mon[32756]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:01:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:01:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:07 smithi156 ceph-mon[32679]: pgmap v1998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 509 B/s wr, 4 op/s 2024-04-26T19:01:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:07 smithi156 ceph-mon[32679]: pgmap v1999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2564.253862 secs 2024-04-26T19:01:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2564.253862 secs 2024-04-26T19:01:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2564.253862 secs 2024-04-26T19:01:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:09 smithi092 ceph-mon[29156]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 635 B/s wr, 3 op/s 2024-04-26T19:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1867.239829 secs 2024-04-26T19:01:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:09 smithi189 ceph-mon[32756]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 635 B/s wr, 3 op/s 2024-04-26T19:01:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1867.239829 secs 2024-04-26T19:01:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:09 smithi156 ceph-mon[32679]: pgmap v2000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 635 B/s wr, 3 op/s 2024-04-26T19:01:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1867.239829 secs 2024-04-26T19:01:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:11 smithi092 ceph-mon[29156]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:11 smithi189 ceph-mon[32756]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:11 smithi156 ceph-mon[32679]: pgmap v2001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 635 B/s wr, 5 op/s 2024-04-26T19:01:13.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:13 smithi156 ceph-mon[32679]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:13.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2569.253924 secs 2024-04-26T19:01:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:13 smithi092 ceph-mon[29156]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2569.253924 secs 2024-04-26T19:01:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:13 smithi189 ceph-mon[32756]: pgmap v2002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:01:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2569.253924 secs 2024-04-26T19:01:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1872.239958 secs 2024-04-26T19:01:15.000 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1872.239958 secs 2024-04-26T19:01:15.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1872.239958 secs 2024-04-26T19:01:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:15 smithi092 ceph-mon[29156]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:15 smithi189 ceph-mon[32756]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:15 smithi156 ceph-mon[32679]: pgmap v2003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:17 smithi092 ceph-mon[29156]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:01:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:17 smithi189 ceph-mon[32756]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:01:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:17 smithi156 ceph-mon[32679]: pgmap v2004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:01:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:18 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2574.254043 secs 2024-04-26T19:01:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1877.240064 secs 2024-04-26T19:01:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:18 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2574.254043 secs 2024-04-26T19:01:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1877.240064 secs 2024-04-26T19:01:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:18 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2574.254043 secs 2024-04-26T19:01:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1877.240064 secs 2024-04-26T19:01:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:19 smithi092 ceph-mon[29156]: pgmap v2005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:19 smithi189 ceph-mon[32756]: pgmap v2005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:19 smithi156 ceph-mon[32679]: pgmap v2005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:21 smithi092 ceph-mon[29156]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:21 smithi189 ceph-mon[32756]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:21 smithi156 ceph-mon[32679]: pgmap v2006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:23 smithi092 ceph-mon[29156]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:23 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2579.254162 secs 2024-04-26T19:01:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1882.240178 secs 2024-04-26T19:01:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:23 smithi189 ceph-mon[32756]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:23 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2579.254162 secs 2024-04-26T19:01:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1882.240178 secs 2024-04-26T19:01:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:23 smithi156 ceph-mon[32679]: pgmap v2007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:23 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2579.254162 secs 2024-04-26T19:01:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1882.240178 secs 2024-04-26T19:01:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:25 smithi092 ceph-mon[29156]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:25 smithi189 ceph-mon[32756]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:25 smithi156 ceph-mon[32679]: pgmap v2008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:27 smithi092 ceph-mon[29156]: pgmap v2009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:27 smithi189 ceph-mon[32756]: pgmap v2009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:27 smithi156 ceph-mon[32679]: pgmap v2009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2584.254265 secs 2024-04-26T19:01:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1887.240243 secs 2024-04-26T19:01:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2584.254265 secs 2024-04-26T19:01:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1887.240243 secs 2024-04-26T19:01:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2584.254265 secs 2024-04-26T19:01:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1887.240243 secs 2024-04-26T19:01:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:29 smithi092 ceph-mon[29156]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:29 smithi189 ceph-mon[32756]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:29 smithi156 ceph-mon[32679]: pgmap v2010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:31 smithi092 ceph-mon[29156]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:31 smithi189 ceph-mon[32756]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:31 smithi156 ceph-mon[32679]: pgmap v2011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:33 smithi189 ceph-mon[32756]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2589.254360 secs 2024-04-26T19:01:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1892.240366 secs 2024-04-26T19:01:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:33 smithi156 ceph-mon[32679]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2589.254360 secs 2024-04-26T19:01:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1892.240366 secs 2024-04-26T19:01:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:33 smithi092 ceph-mon[29156]: pgmap v2012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2589.254360 secs 2024-04-26T19:01:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1892.240366 secs 2024-04-26T19:01:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:35 smithi189 ceph-mon[32756]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:35 smithi156 ceph-mon[32679]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:35 smithi092 ceph-mon[29156]: pgmap v2013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:37 smithi189 ceph-mon[32756]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:37 smithi156 ceph-mon[32679]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:37 smithi092 ceph-mon[29156]: pgmap v2014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2594.254476 secs 2024-04-26T19:01:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1897.240430 secs 2024-04-26T19:01:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2594.254476 secs 2024-04-26T19:01:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1897.240430 secs 2024-04-26T19:01:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2594.254476 secs 2024-04-26T19:01:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1897.240430 secs 2024-04-26T19:01:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:39 smithi189 ceph-mon[32756]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:39 smithi156 ceph-mon[32679]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:39 smithi092 ceph-mon[29156]: pgmap v2015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:41 smithi189 ceph-mon[32756]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:41 smithi156 ceph-mon[32679]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:41 smithi092 ceph-mon[29156]: pgmap v2016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:43 smithi189 ceph-mon[32756]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2599.254624 secs 2024-04-26T19:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1902.240494 secs 2024-04-26T19:01:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:43 smithi156 ceph-mon[32679]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2599.254624 secs 2024-04-26T19:01:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1902.240494 secs 2024-04-26T19:01:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:43 smithi092 ceph-mon[29156]: pgmap v2017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2599.254624 secs 2024-04-26T19:01:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1902.240494 secs 2024-04-26T19:01:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:45 smithi189 ceph-mon[32756]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:45 smithi156 ceph-mon[32679]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:45 smithi092 ceph-mon[29156]: pgmap v2018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:48.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:47 smithi092 ceph-mon[29156]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:47 smithi189 ceph-mon[32756]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:47 smithi156 ceph-mon[32679]: pgmap v2019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2604.254731 secs 2024-04-26T19:01:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1907.240611 secs 2024-04-26T19:01:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2604.254731 secs 2024-04-26T19:01:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1907.240611 secs 2024-04-26T19:01:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2604.254731 secs 2024-04-26T19:01:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1907.240611 secs 2024-04-26T19:01:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:49 smithi189 ceph-mon[32756]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:49 smithi156 ceph-mon[32679]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:49 smithi092 ceph-mon[29156]: pgmap v2020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:51 smithi189 ceph-mon[32756]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:51 smithi156 ceph-mon[32679]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:51 smithi092 ceph-mon[29156]: pgmap v2021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:53 smithi189 ceph-mon[32756]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2609.254873 secs 2024-04-26T19:01:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1912.240727 secs 2024-04-26T19:01:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:53 smithi156 ceph-mon[32679]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2609.254873 secs 2024-04-26T19:01:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1912.240727 secs 2024-04-26T19:01:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:53 smithi092 ceph-mon[29156]: pgmap v2022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2609.254873 secs 2024-04-26T19:01:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1912.240727 secs 2024-04-26T19:01:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:55 smithi189 ceph-mon[32756]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:55 smithi156 ceph-mon[32679]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:55 smithi092 ceph-mon[29156]: pgmap v2023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:01:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:57 smithi189 ceph-mon[32756]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:57 smithi156 ceph-mon[32679]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:57 smithi092 ceph-mon[29156]: pgmap v2024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:01:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2614.254988 secs 2024-04-26T19:01:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1917.240846 secs 2024-04-26T19:01:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2614.254988 secs 2024-04-26T19:01:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1917.240846 secs 2024-04-26T19:01:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2614.254988 secs 2024-04-26T19:01:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1917.240846 secs 2024-04-26T19:02:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:01:59 smithi189 ceph-mon[32756]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:01:59 smithi156 ceph-mon[32679]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:01:59 smithi092 ceph-mon[29156]: pgmap v2025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:01 smithi189 ceph-mon[32756]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:01 smithi156 ceph-mon[32679]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:01 smithi092 ceph-mon[29156]: pgmap v2026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:03 smithi189 ceph-mon[32756]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:03 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2619.255103 secs 2024-04-26T19:02:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 1922.240936 secs 2024-04-26T19:02:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:03 smithi189 ceph-mon[32756]: slow request 361.787358 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:02:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:03 smithi156 ceph-mon[32679]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:03 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2619.255103 secs 2024-04-26T19:02:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 1922.240936 secs 2024-04-26T19:02:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:03 smithi156 ceph-mon[32679]: slow request 361.787358 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:02:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:03 smithi092 ceph-mon[29156]: pgmap v2027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:03 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2619.255103 secs 2024-04-26T19:02:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 1922.240936 secs 2024-04-26T19:02:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:03 smithi092 ceph-mon[29156]: slow request 361.787358 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:02:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:05 smithi189 ceph-mon[32756]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:05 smithi156 ceph-mon[32679]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:05 smithi092 ceph-mon[29156]: pgmap v2028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:02:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:02:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:02:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:02:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:02:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:02:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:07 smithi189 ceph-mon[32756]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:07 smithi189 ceph-mon[32756]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:02:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:07 smithi189 ceph-mon[32756]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:07 smithi156 ceph-mon[32679]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:07 smithi156 ceph-mon[32679]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:02:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:07 smithi156 ceph-mon[32679]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:07 smithi092 ceph-mon[29156]: pgmap v2029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:07 smithi092 ceph-mon[29156]: pgmap v2030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:02:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:07 smithi092 ceph-mon[29156]: pgmap v2031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2624.255194 secs 2024-04-26T19:02:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1927.241062 secs 2024-04-26T19:02:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2624.255194 secs 2024-04-26T19:02:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1927.241062 secs 2024-04-26T19:02:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2624.255194 secs 2024-04-26T19:02:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1927.241062 secs 2024-04-26T19:02:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:09 smithi189 ceph-mon[32756]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:09 smithi156 ceph-mon[32679]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:09 smithi092 ceph-mon[29156]: pgmap v2032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:11 smithi189 ceph-mon[32756]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:11 smithi156 ceph-mon[32679]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:11 smithi092 ceph-mon[29156]: pgmap v2033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:13 smithi189 ceph-mon[32756]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:13 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2629.255312 secs 2024-04-26T19:02:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1932.241181 secs 2024-04-26T19:02:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:13 smithi156 ceph-mon[32679]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:13 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2629.255312 secs 2024-04-26T19:02:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1932.241181 secs 2024-04-26T19:02:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:13 smithi092 ceph-mon[29156]: pgmap v2034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:02:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:13 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2629.255312 secs 2024-04-26T19:02:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1932.241181 secs 2024-04-26T19:02:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:15 smithi189 ceph-mon[32756]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:15 smithi156 ceph-mon[32679]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:15 smithi092 ceph-mon[29156]: pgmap v2035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:02:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:17 smithi189 ceph-mon[32756]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:02:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:17 smithi156 ceph-mon[32679]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:02:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:17 smithi092 ceph-mon[29156]: pgmap v2036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:02:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:18 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2634.255404 secs 2024-04-26T19:02:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1937.241316 secs 2024-04-26T19:02:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:18 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2634.255404 secs 2024-04-26T19:02:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1937.241316 secs 2024-04-26T19:02:19.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:18 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2634.255404 secs 2024-04-26T19:02:19.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1937.241316 secs 2024-04-26T19:02:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:19 smithi092 ceph-mon[29156]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:19 smithi189 ceph-mon[32756]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:19 smithi156 ceph-mon[32679]: pgmap v2037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:21 smithi189 ceph-mon[32756]: pgmap v2038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:21 smithi156 ceph-mon[32679]: pgmap v2038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:21 smithi092 ceph-mon[29156]: pgmap v2038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:23 smithi189 ceph-mon[32756]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:23 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2639.255499 secs 2024-04-26T19:02:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1942.241448 secs 2024-04-26T19:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:23 smithi156 ceph-mon[32679]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:23 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2639.255499 secs 2024-04-26T19:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1942.241448 secs 2024-04-26T19:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:23 smithi092 ceph-mon[29156]: pgmap v2039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:23 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2639.255499 secs 2024-04-26T19:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1942.241448 secs 2024-04-26T19:02:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:25 smithi189 ceph-mon[32756]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:25 smithi156 ceph-mon[32679]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:25 smithi092 ceph-mon[29156]: pgmap v2040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:27 smithi189 ceph-mon[32756]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:27 smithi156 ceph-mon[32679]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:27 smithi092 ceph-mon[29156]: pgmap v2041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:28 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2644.255640 secs 2024-04-26T19:02:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1947.241586 secs 2024-04-26T19:02:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:28 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2644.255640 secs 2024-04-26T19:02:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1947.241586 secs 2024-04-26T19:02:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:28 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2644.255640 secs 2024-04-26T19:02:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1947.241586 secs 2024-04-26T19:02:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:29 smithi189 ceph-mon[32756]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:29 smithi156 ceph-mon[32679]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:29 smithi092 ceph-mon[29156]: pgmap v2042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:31 smithi189 ceph-mon[32756]: pgmap v2043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:31 smithi156 ceph-mon[32679]: pgmap v2043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:31 smithi092 ceph-mon[29156]: pgmap v2043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:33 smithi189 ceph-mon[32756]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:33 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2649.255757 secs 2024-04-26T19:02:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1952.241688 secs 2024-04-26T19:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:33 smithi156 ceph-mon[32679]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:33 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2649.255757 secs 2024-04-26T19:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1952.241688 secs 2024-04-26T19:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:33 smithi092 ceph-mon[29156]: pgmap v2044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:33 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2649.255757 secs 2024-04-26T19:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1952.241688 secs 2024-04-26T19:02:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:35 smithi156 ceph-mon[32679]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:35 smithi092 ceph-mon[29156]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:35 smithi189 ceph-mon[32756]: pgmap v2045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:37 smithi156 ceph-mon[32679]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:37 smithi092 ceph-mon[29156]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:37 smithi189 ceph-mon[32756]: pgmap v2046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:38 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2654.255895 secs 2024-04-26T19:02:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1957.241785 secs 2024-04-26T19:02:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:38 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2654.255895 secs 2024-04-26T19:02:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1957.241785 secs 2024-04-26T19:02:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:38 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2654.255895 secs 2024-04-26T19:02:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1957.241785 secs 2024-04-26T19:02:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:39 smithi156 ceph-mon[32679]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:39 smithi092 ceph-mon[29156]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:39 smithi189 ceph-mon[32756]: pgmap v2047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:41 smithi156 ceph-mon[32679]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:41 smithi092 ceph-mon[29156]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:41 smithi189 ceph-mon[32756]: pgmap v2048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:43 smithi156 ceph-mon[32679]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:43 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2659.255984 secs 2024-04-26T19:02:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1962.241858 secs 2024-04-26T19:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:43 smithi092 ceph-mon[29156]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:43 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2659.255984 secs 2024-04-26T19:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1962.241858 secs 2024-04-26T19:02:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:43 smithi189 ceph-mon[32756]: pgmap v2049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:43 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2659.255984 secs 2024-04-26T19:02:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1962.241858 secs 2024-04-26T19:02:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:45 smithi156 ceph-mon[32679]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:46.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:45 smithi189 ceph-mon[32756]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:45 smithi092 ceph-mon[29156]: pgmap v2050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:47 smithi156 ceph-mon[32679]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:47 smithi092 ceph-mon[29156]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:47 smithi189 ceph-mon[32756]: pgmap v2051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2664.256108 secs 2024-04-26T19:02:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1967.241947 secs 2024-04-26T19:02:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2664.256108 secs 2024-04-26T19:02:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1967.241947 secs 2024-04-26T19:02:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2664.256108 secs 2024-04-26T19:02:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1967.241947 secs 2024-04-26T19:02:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:49 smithi156 ceph-mon[32679]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:49 smithi092 ceph-mon[29156]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:49 smithi189 ceph-mon[32756]: pgmap v2052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:51 smithi156 ceph-mon[32679]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:51 smithi092 ceph-mon[29156]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:51 smithi189 ceph-mon[32756]: pgmap v2053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:53 smithi156 ceph-mon[32679]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2669.256241 secs 2024-04-26T19:02:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1972.242055 secs 2024-04-26T19:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:53 smithi092 ceph-mon[29156]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2669.256241 secs 2024-04-26T19:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1972.242055 secs 2024-04-26T19:02:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:53 smithi189 ceph-mon[32756]: pgmap v2054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2669.256241 secs 2024-04-26T19:02:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1972.242055 secs 2024-04-26T19:02:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:55 smithi156 ceph-mon[32679]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:55 smithi092 ceph-mon[29156]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:55 smithi189 ceph-mon[32756]: pgmap v2055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:02:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:57 smithi092 ceph-mon[29156]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:57 smithi189 ceph-mon[32756]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:57 smithi156 ceph-mon[32679]: pgmap v2056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:02:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2674.256359 secs 2024-04-26T19:02:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1977.242164 secs 2024-04-26T19:02:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2674.256359 secs 2024-04-26T19:02:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1977.242164 secs 2024-04-26T19:02:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2674.256359 secs 2024-04-26T19:02:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1977.242164 secs 2024-04-26T19:03:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:02:59 smithi092 ceph-mon[29156]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:02:59 smithi189 ceph-mon[32756]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:02:59 smithi156 ceph-mon[32679]: pgmap v2057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:01 smithi092 ceph-mon[29156]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:01 smithi189 ceph-mon[32756]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:01 smithi156 ceph-mon[32679]: pgmap v2058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:03 smithi092 ceph-mon[29156]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:03 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2679.256481 secs 2024-04-26T19:03:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 1982.242261 secs 2024-04-26T19:03:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:03 smithi092 ceph-mon[29156]: slow request 721.895998 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:03:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:03 smithi189 ceph-mon[32756]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:03 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2679.256481 secs 2024-04-26T19:03:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 1982.242261 secs 2024-04-26T19:03:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:03 smithi189 ceph-mon[32756]: slow request 721.895998 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:03:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:03 smithi156 ceph-mon[32679]: pgmap v2059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:03 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2679.256481 secs 2024-04-26T19:03:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 1982.242261 secs 2024-04-26T19:03:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:03 smithi156 ceph-mon[32679]: slow request 721.895998 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:03:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:05 smithi092 ceph-mon[29156]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:05 smithi189 ceph-mon[32756]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:05 smithi156 ceph-mon[32679]: pgmap v2060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:03:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:03:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:03:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: pgmap v2061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: pgmap v2062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: pgmap v2063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:03:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:03:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:08 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2684.256597 secs 2024-04-26T19:03:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1987.242394 secs 2024-04-26T19:03:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:08 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2684.256597 secs 2024-04-26T19:03:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1987.242394 secs 2024-04-26T19:03:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:08 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2684.256597 secs 2024-04-26T19:03:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1987.242394 secs 2024-04-26T19:03:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:09 smithi092 ceph-mon[29156]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:09 smithi189 ceph-mon[32756]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:09 smithi156 ceph-mon[32679]: pgmap v2064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:12 smithi189 ceph-mon[32756]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:12 smithi156 ceph-mon[32679]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:12 smithi092 ceph-mon[29156]: pgmap v2065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:14 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2689.256711 secs 2024-04-26T19:03:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1992.242482 secs 2024-04-26T19:03:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:14 smithi189 ceph-mon[32756]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:14 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2689.256711 secs 2024-04-26T19:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1992.242482 secs 2024-04-26T19:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:14 smithi156 ceph-mon[32679]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:14 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2689.256711 secs 2024-04-26T19:03:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1992.242482 secs 2024-04-26T19:03:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:14 smithi092 ceph-mon[29156]: pgmap v2066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:16 smithi189 ceph-mon[32756]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:16 smithi156 ceph-mon[32679]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:16 smithi092 ceph-mon[29156]: pgmap v2067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:03:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:18 smithi189 ceph-mon[32756]: pgmap v2068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:03:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:18 smithi156 ceph-mon[32679]: pgmap v2068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:03:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:18 smithi092 ceph-mon[29156]: pgmap v2068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:03:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:19 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2694.256872 secs 2024-04-26T19:03:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 1997.242614 secs 2024-04-26T19:03:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:19 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2694.256872 secs 2024-04-26T19:03:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 1997.242614 secs 2024-04-26T19:03:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:19 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2694.256872 secs 2024-04-26T19:03:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 1997.242614 secs 2024-04-26T19:03:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:20 smithi189 ceph-mon[32756]: pgmap v2069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:20 smithi156 ceph-mon[32679]: pgmap v2069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:20 smithi092 ceph-mon[29156]: pgmap v2069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:22 smithi189 ceph-mon[32756]: pgmap v2070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:22 smithi156 ceph-mon[32679]: pgmap v2070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:22 smithi092 ceph-mon[29156]: pgmap v2070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:24 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2699.256985 secs 2024-04-26T19:03:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2002.242735 secs 2024-04-26T19:03:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:24 smithi189 ceph-mon[32756]: pgmap v2071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:24 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2699.256985 secs 2024-04-26T19:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2002.242735 secs 2024-04-26T19:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:24 smithi156 ceph-mon[32679]: pgmap v2071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:24 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2699.256985 secs 2024-04-26T19:03:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2002.242735 secs 2024-04-26T19:03:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:24 smithi092 ceph-mon[29156]: pgmap v2071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:26 smithi189 ceph-mon[32756]: pgmap v2072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:26 smithi156 ceph-mon[32679]: pgmap v2072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:26 smithi092 ceph-mon[29156]: pgmap v2072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:28 smithi189 ceph-mon[32756]: pgmap v2073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:28 smithi156 ceph-mon[32679]: pgmap v2073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:28 smithi092 ceph-mon[29156]: pgmap v2073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:29 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2704.257062 secs 2024-04-26T19:03:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2007.242873 secs 2024-04-26T19:03:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:29 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2704.257062 secs 2024-04-26T19:03:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2007.242873 secs 2024-04-26T19:03:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:29 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2704.257062 secs 2024-04-26T19:03:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2007.242873 secs 2024-04-26T19:03:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:30 smithi189 ceph-mon[32756]: pgmap v2074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:30 smithi156 ceph-mon[32679]: pgmap v2074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:30 smithi092 ceph-mon[29156]: pgmap v2074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:32 smithi189 ceph-mon[32756]: pgmap v2075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:32 smithi156 ceph-mon[32679]: pgmap v2075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:32 smithi092 ceph-mon[29156]: pgmap v2075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:34 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2709.257125 secs 2024-04-26T19:03:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2012.242981 secs 2024-04-26T19:03:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:34 smithi156 ceph-mon[32679]: pgmap v2076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:34 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2709.257125 secs 2024-04-26T19:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2012.242981 secs 2024-04-26T19:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:34 smithi092 ceph-mon[29156]: pgmap v2076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:34 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2709.257125 secs 2024-04-26T19:03:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2012.242981 secs 2024-04-26T19:03:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:34 smithi189 ceph-mon[32756]: pgmap v2076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca8070000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca8070000 comp rx=0 tx=0).stop 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0b2b80 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 msgr2=0x7f1c9c0b2b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a3dc0 0x7f1c9c0b2b80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:03:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:03:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:35.993+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005b00 tx=0x7f1ca8094000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:03:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.018+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T19:03:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.018+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:03:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.018+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:03:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.018+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:03:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.019+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.019+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T19:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.019+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T19:03:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.348+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:03:36.348 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.348+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:03:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.348+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:03:36.349 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:03:36.348+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 25 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:03:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:36 smithi156 ceph-mon[32679]: pgmap v2077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:36 smithi092 ceph-mon[29156]: pgmap v2077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:36 smithi189 ceph-mon[32756]: pgmap v2077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:38 smithi156 ceph-mon[32679]: pgmap v2078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:38 smithi092 ceph-mon[29156]: pgmap v2078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:38 smithi189 ceph-mon[32756]: pgmap v2078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:39 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2714.257206 secs 2024-04-26T19:03:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2017.243128 secs 2024-04-26T19:03:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:39 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2714.257206 secs 2024-04-26T19:03:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2017.243128 secs 2024-04-26T19:03:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:39 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2714.257206 secs 2024-04-26T19:03:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2017.243128 secs 2024-04-26T19:03:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:40 smithi156 ceph-mon[32679]: pgmap v2079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:40 smithi092 ceph-mon[29156]: pgmap v2079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:40 smithi189 ceph-mon[32756]: pgmap v2079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:42 smithi156 ceph-mon[32679]: pgmap v2080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:42 smithi092 ceph-mon[29156]: pgmap v2080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:42 smithi189 ceph-mon[32756]: pgmap v2080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:44 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2719.257338 secs 2024-04-26T19:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2022.243239 secs 2024-04-26T19:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:44 smithi156 ceph-mon[32679]: pgmap v2081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:44 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2719.257338 secs 2024-04-26T19:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2022.243239 secs 2024-04-26T19:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:44 smithi092 ceph-mon[29156]: pgmap v2081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:44 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2719.257338 secs 2024-04-26T19:03:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2022.243239 secs 2024-04-26T19:03:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:44 smithi189 ceph-mon[32756]: pgmap v2081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:46 smithi156 ceph-mon[32679]: pgmap v2082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:46.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:46 smithi189 ceph-mon[32756]: pgmap v2082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:46 smithi092 ceph-mon[29156]: pgmap v2082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:48 smithi156 ceph-mon[32679]: pgmap v2083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:48 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2724.257416 secs 2024-04-26T19:03:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:48 smithi092 ceph-mon[29156]: pgmap v2083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:48 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2724.257416 secs 2024-04-26T19:03:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:48 smithi189 ceph-mon[32756]: pgmap v2083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:48 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2724.257416 secs 2024-04-26T19:03:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2027.243383 secs 2024-04-26T19:03:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2027.243383 secs 2024-04-26T19:03:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2027.243383 secs 2024-04-26T19:03:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:50 smithi156 ceph-mon[32679]: pgmap v2084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:50 smithi092 ceph-mon[29156]: pgmap v2084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:50 smithi189 ceph-mon[32756]: pgmap v2084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:52 smithi156 ceph-mon[32679]: pgmap v2085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:52 smithi092 ceph-mon[29156]: pgmap v2085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:52 smithi189 ceph-mon[32756]: pgmap v2085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:53 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2729.257503 secs 2024-04-26T19:03:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:53 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2729.257503 secs 2024-04-26T19:03:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:53 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2729.257503 secs 2024-04-26T19:03:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2032.243484 secs 2024-04-26T19:03:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:54 smithi156 ceph-mon[32679]: pgmap v2086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2032.243484 secs 2024-04-26T19:03:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:54 smithi092 ceph-mon[29156]: pgmap v2086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2032.243484 secs 2024-04-26T19:03:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:54 smithi189 ceph-mon[32756]: pgmap v2086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:03:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:56 smithi092 ceph-mon[29156]: pgmap v2087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:56 smithi189 ceph-mon[32756]: pgmap v2087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:56 smithi156 ceph-mon[32679]: pgmap v2087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:58 smithi092 ceph-mon[29156]: pgmap v2088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:58 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 2734.257636 secs 2024-04-26T19:03:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:58 smithi189 ceph-mon[32756]: pgmap v2088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:58 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 2734.257636 secs 2024-04-26T19:03:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:58 smithi156 ceph-mon[32679]: pgmap v2088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:03:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:58 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 2734.257636 secs 2024-04-26T19:03:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:03:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2037.243599 secs 2024-04-26T19:04:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:03:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2037.243599 secs 2024-04-26T19:04:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:03:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2037.243599 secs 2024-04-26T19:04:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:00 smithi092 ceph-mon[29156]: pgmap v2089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:00 smithi189 ceph-mon[32756]: pgmap v2089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:00 smithi156 ceph-mon[32679]: pgmap v2089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:02 smithi092 ceph-mon[29156]: pgmap v2090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:02 smithi189 ceph-mon[32756]: pgmap v2090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:02 smithi156 ceph-mon[32679]: pgmap v2090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 2739.257783 secs 2024-04-26T19:04:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:03 smithi092 ceph-mon[29156]: slow request 181.513902 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T19:04:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 2739.257783 secs 2024-04-26T19:04:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:03 smithi189 ceph-mon[32756]: slow request 181.513902 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T19:04:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 2739.257783 secs 2024-04-26T19:04:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:03 smithi156 ceph-mon[32679]: slow request 181.513902 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently failed to acquire snap lock 2024-04-26T19:04:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2042.243719 secs 2024-04-26T19:04:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:04 smithi092 ceph-mon[29156]: pgmap v2091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2042.243719 secs 2024-04-26T19:04:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:04 smithi189 ceph-mon[32756]: pgmap v2091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2042.243719 secs 2024-04-26T19:04:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:04 smithi156 ceph-mon[32679]: pgmap v2091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:05 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:04:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:05 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:04:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:05 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:04:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:05 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:04:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:05 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T19:04:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:05 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:04:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:06 smithi092 ceph-mon[29156]: pgmap v2092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:06 smithi189 ceph-mon[32756]: pgmap v2092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:06 smithi156 ceph-mon[32679]: pgmap v2092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:08 smithi092 ceph-mon[29156]: pgmap v2093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2744.257871 secs 2024-04-26T19:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:04:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:08 smithi189 ceph-mon[32756]: pgmap v2093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2744.257871 secs 2024-04-26T19:04:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:08 smithi156 ceph-mon[32679]: pgmap v2093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2744.257871 secs 2024-04-26T19:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:04:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:04:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:09 smithi092 ceph-mon[29156]: pgmap v2094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:04:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:09 smithi092 ceph-mon[29156]: pgmap v2095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2047.243778 secs 2024-04-26T19:04:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:09 smithi189 ceph-mon[32756]: pgmap v2094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:04:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:09 smithi189 ceph-mon[32756]: pgmap v2095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2047.243778 secs 2024-04-26T19:04:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:09 smithi156 ceph-mon[32679]: pgmap v2094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:04:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:09 smithi156 ceph-mon[32679]: pgmap v2095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2047.243778 secs 2024-04-26T19:04:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:11 smithi092 ceph-mon[29156]: pgmap v2096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:11 smithi189 ceph-mon[32756]: pgmap v2096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:11 smithi156 ceph-mon[32679]: pgmap v2096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:13 smithi092 ceph-mon[29156]: pgmap v2097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2749.257937 secs 2024-04-26T19:04:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2052.243896 secs 2024-04-26T19:04:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:13 smithi189 ceph-mon[32756]: pgmap v2097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2749.257937 secs 2024-04-26T19:04:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2052.243896 secs 2024-04-26T19:04:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:13 smithi156 ceph-mon[32679]: pgmap v2097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:04:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2749.257937 secs 2024-04-26T19:04:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2052.243896 secs 2024-04-26T19:04:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:15 smithi189 ceph-mon[32756]: pgmap v2098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:15 smithi156 ceph-mon[32679]: pgmap v2098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:15 smithi092 ceph-mon[29156]: pgmap v2098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:17 smithi189 ceph-mon[32756]: pgmap v2099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:17 smithi156 ceph-mon[32679]: pgmap v2099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:17 smithi092 ceph-mon[29156]: pgmap v2099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:04:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2754.258021 secs 2024-04-26T19:04:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2057.244035 secs 2024-04-26T19:04:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2754.258021 secs 2024-04-26T19:04:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2057.244035 secs 2024-04-26T19:04:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2754.258021 secs 2024-04-26T19:04:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2057.244035 secs 2024-04-26T19:04:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:19 smithi189 ceph-mon[32756]: pgmap v2100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:04:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:19 smithi156 ceph-mon[32679]: pgmap v2100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:04:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:19 smithi092 ceph-mon[29156]: pgmap v2100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:04:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:21 smithi189 ceph-mon[32756]: pgmap v2101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:21 smithi156 ceph-mon[32679]: pgmap v2101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:22.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:21 smithi092 ceph-mon[29156]: pgmap v2101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:23 smithi092 ceph-mon[29156]: pgmap v2102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2759.258149 secs 2024-04-26T19:04:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2062.244153 secs 2024-04-26T19:04:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:23 smithi189 ceph-mon[32756]: pgmap v2102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2759.258149 secs 2024-04-26T19:04:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2062.244153 secs 2024-04-26T19:04:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:23 smithi156 ceph-mon[32679]: pgmap v2102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2759.258149 secs 2024-04-26T19:04:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2062.244153 secs 2024-04-26T19:04:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:25 smithi189 ceph-mon[32756]: pgmap v2103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:25 smithi156 ceph-mon[32679]: pgmap v2103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:25 smithi092 ceph-mon[29156]: pgmap v2103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:27 smithi189 ceph-mon[32756]: pgmap v2104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:27 smithi156 ceph-mon[32679]: pgmap v2104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:27 smithi092 ceph-mon[29156]: pgmap v2104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2764.258250 secs 2024-04-26T19:04:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2067.244269 secs 2024-04-26T19:04:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2764.258250 secs 2024-04-26T19:04:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2067.244269 secs 2024-04-26T19:04:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2764.258250 secs 2024-04-26T19:04:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2067.244269 secs 2024-04-26T19:04:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:29 smithi189 ceph-mon[32756]: pgmap v2105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:29 smithi156 ceph-mon[32679]: pgmap v2105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:29 smithi092 ceph-mon[29156]: pgmap v2105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:31 smithi189 ceph-mon[32756]: pgmap v2106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:31 smithi156 ceph-mon[32679]: pgmap v2106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:31 smithi092 ceph-mon[29156]: pgmap v2106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:34.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:33 smithi092 ceph-mon[29156]: pgmap v2107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:34.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2769.258372 secs 2024-04-26T19:04:34.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2072.244372 secs 2024-04-26T19:04:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:33 smithi189 ceph-mon[32756]: pgmap v2107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2769.258372 secs 2024-04-26T19:04:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2072.244372 secs 2024-04-26T19:04:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:33 smithi156 ceph-mon[32679]: pgmap v2107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2769.258372 secs 2024-04-26T19:04:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2072.244372 secs 2024-04-26T19:04:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:35 smithi189 ceph-mon[32756]: pgmap v2108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:35 smithi156 ceph-mon[32679]: pgmap v2108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:35 smithi092 ceph-mon[29156]: pgmap v2108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:37 smithi189 ceph-mon[32756]: pgmap v2109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:37 smithi156 ceph-mon[32679]: pgmap v2109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:37 smithi092 ceph-mon[29156]: pgmap v2109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2774.258506 secs 2024-04-26T19:04:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2077.244509 secs 2024-04-26T19:04:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2774.258506 secs 2024-04-26T19:04:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2077.244509 secs 2024-04-26T19:04:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2774.258506 secs 2024-04-26T19:04:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2077.244509 secs 2024-04-26T19:04:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:39 smithi189 ceph-mon[32756]: pgmap v2110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:39 smithi156 ceph-mon[32679]: pgmap v2110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:39 smithi092 ceph-mon[29156]: pgmap v2110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:41 smithi189 ceph-mon[32756]: pgmap v2111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:41 smithi156 ceph-mon[32679]: pgmap v2111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:41 smithi092 ceph-mon[29156]: pgmap v2111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:43 smithi189 ceph-mon[32756]: pgmap v2112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2779.258585 secs 2024-04-26T19:04:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2082.244605 secs 2024-04-26T19:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:43 smithi156 ceph-mon[32679]: pgmap v2112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2779.258585 secs 2024-04-26T19:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2082.244605 secs 2024-04-26T19:04:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:43 smithi092 ceph-mon[29156]: pgmap v2112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2779.258585 secs 2024-04-26T19:04:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2082.244605 secs 2024-04-26T19:04:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:45 smithi189 ceph-mon[32756]: pgmap v2113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:45 smithi156 ceph-mon[32679]: pgmap v2113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:45 smithi092 ceph-mon[29156]: pgmap v2113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:47 smithi189 ceph-mon[32756]: pgmap v2114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:47 smithi156 ceph-mon[32679]: pgmap v2114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:47 smithi092 ceph-mon[29156]: pgmap v2114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2784.258708 secs 2024-04-26T19:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2087.244719 secs 2024-04-26T19:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2784.258708 secs 2024-04-26T19:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2087.244719 secs 2024-04-26T19:04:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2784.258708 secs 2024-04-26T19:04:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2087.244719 secs 2024-04-26T19:04:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:49 smithi189 ceph-mon[32756]: pgmap v2115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:49 smithi156 ceph-mon[32679]: pgmap v2115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:49 smithi092 ceph-mon[29156]: pgmap v2115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:51 smithi189 ceph-mon[32756]: pgmap v2116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:51 smithi156 ceph-mon[32679]: pgmap v2116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:51 smithi092 ceph-mon[29156]: pgmap v2116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:53 smithi189 ceph-mon[32756]: pgmap v2117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2789.258821 secs 2024-04-26T19:04:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2092.244808 secs 2024-04-26T19:04:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:53 smithi156 ceph-mon[32679]: pgmap v2117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2789.258821 secs 2024-04-26T19:04:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2092.244808 secs 2024-04-26T19:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:53 smithi092 ceph-mon[29156]: pgmap v2117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2789.258821 secs 2024-04-26T19:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2092.244808 secs 2024-04-26T19:04:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:55 smithi189 ceph-mon[32756]: pgmap v2118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:55 smithi156 ceph-mon[32679]: pgmap v2118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:55 smithi092 ceph-mon[29156]: pgmap v2118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:04:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:57 smithi189 ceph-mon[32756]: pgmap v2119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:57 smithi156 ceph-mon[32679]: pgmap v2119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:57 smithi092 ceph-mon[29156]: pgmap v2119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:04:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2794.258958 secs 2024-04-26T19:04:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2097.244914 secs 2024-04-26T19:04:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2794.258958 secs 2024-04-26T19:04:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2097.244914 secs 2024-04-26T19:04:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2794.258958 secs 2024-04-26T19:04:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2097.244914 secs 2024-04-26T19:05:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:04:59 smithi189 ceph-mon[32756]: pgmap v2120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:04:59 smithi156 ceph-mon[32679]: pgmap v2120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:04:59 smithi092 ceph-mon[29156]: pgmap v2120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:01 smithi189 ceph-mon[32756]: pgmap v2121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:01 smithi156 ceph-mon[32679]: pgmap v2121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:01 smithi092 ceph-mon[29156]: pgmap v2121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:03 smithi189 ceph-mon[32756]: pgmap v2122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2799.259021 secs 2024-04-26T19:05:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2102.244977 secs 2024-04-26T19:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:03 smithi156 ceph-mon[32679]: pgmap v2122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2799.259021 secs 2024-04-26T19:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2102.244977 secs 2024-04-26T19:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:03 smithi092 ceph-mon[29156]: pgmap v2122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2799.259021 secs 2024-04-26T19:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2102.244977 secs 2024-04-26T19:05:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:05 smithi189 ceph-mon[32756]: pgmap v2123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:05 smithi156 ceph-mon[32679]: pgmap v2123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:05 smithi092 ceph-mon[29156]: pgmap v2123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:07 smithi189 ceph-mon[32756]: pgmap v2124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:07 smithi156 ceph-mon[32679]: pgmap v2124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:07 smithi092 ceph-mon[29156]: pgmap v2124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2804.259143 secs 2024-04-26T19:05:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2107.245040 secs 2024-04-26T19:05:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2804.259143 secs 2024-04-26T19:05:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2107.245040 secs 2024-04-26T19:05:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2804.259143 secs 2024-04-26T19:05:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2107.245040 secs 2024-04-26T19:05:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:05:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:09 smithi189 ceph-mon[32756]: pgmap v2125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:09 smithi156 ceph-mon[32679]: pgmap v2125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:05:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:09 smithi092 ceph-mon[29156]: pgmap v2125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:05:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:05:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:05:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:10 smithi092 ceph-mon[29156]: pgmap v2126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:05:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:10 smithi092 ceph-mon[29156]: pgmap v2127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:10 smithi189 ceph-mon[32756]: pgmap v2126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:05:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:10 smithi189 ceph-mon[32756]: pgmap v2127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:10 smithi156 ceph-mon[32679]: pgmap v2126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:05:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:10 smithi156 ceph-mon[32679]: pgmap v2127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:12 smithi189 ceph-mon[32756]: pgmap v2128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:12 smithi156 ceph-mon[32679]: pgmap v2128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:12 smithi092 ceph-mon[29156]: pgmap v2128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2809.259220 secs 2024-04-26T19:05:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2112.245185 secs 2024-04-26T19:05:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2809.259220 secs 2024-04-26T19:05:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2112.245185 secs 2024-04-26T19:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2809.259220 secs 2024-04-26T19:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2112.245185 secs 2024-04-26T19:05:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:14 smithi189 ceph-mon[32756]: pgmap v2129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:14 smithi156 ceph-mon[32679]: pgmap v2129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:14 smithi092 ceph-mon[29156]: pgmap v2129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:05:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:16 smithi189 ceph-mon[32756]: pgmap v2130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:16 smithi156 ceph-mon[32679]: pgmap v2130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:16 smithi092 ceph-mon[29156]: pgmap v2130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:18 smithi189 ceph-mon[32756]: pgmap v2131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2814.259334 secs 2024-04-26T19:05:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2117.245244 secs 2024-04-26T19:05:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:18 smithi156 ceph-mon[32679]: pgmap v2131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2814.259334 secs 2024-04-26T19:05:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2117.245244 secs 2024-04-26T19:05:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:18 smithi092 ceph-mon[29156]: pgmap v2131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:05:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2814.259334 secs 2024-04-26T19:05:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2117.245244 secs 2024-04-26T19:05:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:20 smithi189 ceph-mon[32756]: pgmap v2132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:05:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:20 smithi156 ceph-mon[32679]: pgmap v2132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:05:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:20 smithi092 ceph-mon[29156]: pgmap v2132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:05:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:22 smithi189 ceph-mon[32756]: pgmap v2133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:22 smithi156 ceph-mon[32679]: pgmap v2133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:23.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:22 smithi092 ceph-mon[29156]: pgmap v2133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2819.259469 secs 2024-04-26T19:05:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2122.245366 secs 2024-04-26T19:05:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2819.259469 secs 2024-04-26T19:05:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2122.245366 secs 2024-04-26T19:05:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2819.259469 secs 2024-04-26T19:05:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2122.245366 secs 2024-04-26T19:05:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:24 smithi156 ceph-mon[32679]: pgmap v2134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:24 smithi092 ceph-mon[29156]: pgmap v2134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:24 smithi189 ceph-mon[32756]: pgmap v2134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:26 smithi156 ceph-mon[32679]: pgmap v2135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:26 smithi092 ceph-mon[29156]: pgmap v2135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:26 smithi189 ceph-mon[32756]: pgmap v2135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:28 smithi156 ceph-mon[32679]: pgmap v2136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2824.259618 secs 2024-04-26T19:05:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2127.245430 secs 2024-04-26T19:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:28 smithi092 ceph-mon[29156]: pgmap v2136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2824.259618 secs 2024-04-26T19:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2127.245430 secs 2024-04-26T19:05:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:28 smithi189 ceph-mon[32756]: pgmap v2136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2824.259618 secs 2024-04-26T19:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2127.245430 secs 2024-04-26T19:05:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:30 smithi156 ceph-mon[32679]: pgmap v2137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:30 smithi092 ceph-mon[29156]: pgmap v2137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:30 smithi189 ceph-mon[32756]: pgmap v2137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:32 smithi156 ceph-mon[32679]: pgmap v2138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:32 smithi092 ceph-mon[29156]: pgmap v2138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:32 smithi189 ceph-mon[32756]: pgmap v2138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2829.259738 secs 2024-04-26T19:05:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2132.245572 secs 2024-04-26T19:05:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2829.259738 secs 2024-04-26T19:05:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2132.245572 secs 2024-04-26T19:05:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2829.259738 secs 2024-04-26T19:05:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2132.245572 secs 2024-04-26T19:05:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:34 smithi156 ceph-mon[32679]: pgmap v2139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:34 smithi092 ceph-mon[29156]: pgmap v2139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:34 smithi189 ceph-mon[32756]: pgmap v2139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:36 smithi156 ceph-mon[32679]: pgmap v2140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:36 smithi092 ceph-mon[29156]: pgmap v2140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:36 smithi189 ceph-mon[32756]: pgmap v2140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:38 smithi156 ceph-mon[32679]: pgmap v2141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2834.259851 secs 2024-04-26T19:05:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2137.245694 secs 2024-04-26T19:05:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:38 smithi092 ceph-mon[29156]: pgmap v2141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2834.259851 secs 2024-04-26T19:05:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2137.245694 secs 2024-04-26T19:05:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:38 smithi189 ceph-mon[32756]: pgmap v2141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2834.259851 secs 2024-04-26T19:05:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2137.245694 secs 2024-04-26T19:05:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:40 smithi156 ceph-mon[32679]: pgmap v2142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:40 smithi092 ceph-mon[29156]: pgmap v2142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:40 smithi189 ceph-mon[32756]: pgmap v2142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:42 smithi156 ceph-mon[32679]: pgmap v2143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:42 smithi092 ceph-mon[29156]: pgmap v2143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:42 smithi189 ceph-mon[32756]: pgmap v2143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2839.259966 secs 2024-04-26T19:05:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2142.245775 secs 2024-04-26T19:05:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2839.259966 secs 2024-04-26T19:05:44.269 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2142.245775 secs 2024-04-26T19:05:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2839.259966 secs 2024-04-26T19:05:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2142.245775 secs 2024-04-26T19:05:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:44 smithi156 ceph-mon[32679]: pgmap v2144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:44 smithi092 ceph-mon[29156]: pgmap v2144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:44 smithi189 ceph-mon[32756]: pgmap v2144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:46 smithi092 ceph-mon[29156]: pgmap v2145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:46 smithi189 ceph-mon[32756]: pgmap v2145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:46 smithi156 ceph-mon[32679]: pgmap v2145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:49.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:48 smithi189 ceph-mon[32756]: pgmap v2146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:49.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2844.260075 secs 2024-04-26T19:05:49.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2147.245855 secs 2024-04-26T19:05:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:48 smithi092 ceph-mon[29156]: pgmap v2146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2844.260075 secs 2024-04-26T19:05:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2147.245855 secs 2024-04-26T19:05:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:48 smithi156 ceph-mon[32679]: pgmap v2146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2844.260075 secs 2024-04-26T19:05:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2147.245855 secs 2024-04-26T19:05:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:50 smithi092 ceph-mon[29156]: pgmap v2147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:50 smithi189 ceph-mon[32756]: pgmap v2147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:50 smithi156 ceph-mon[32679]: pgmap v2147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:52 smithi092 ceph-mon[29156]: pgmap v2148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:52 smithi189 ceph-mon[32756]: pgmap v2148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:52 smithi156 ceph-mon[32679]: pgmap v2148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2849.260193 secs 2024-04-26T19:05:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2152.245926 secs 2024-04-26T19:05:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2849.260193 secs 2024-04-26T19:05:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2152.245926 secs 2024-04-26T19:05:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2849.260193 secs 2024-04-26T19:05:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2152.245926 secs 2024-04-26T19:05:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:54 smithi092 ceph-mon[29156]: pgmap v2149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:54 smithi189 ceph-mon[32756]: pgmap v2149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:54 smithi156 ceph-mon[32679]: pgmap v2149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:56 smithi092 ceph-mon[29156]: pgmap v2150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:56 smithi189 ceph-mon[32756]: pgmap v2150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:56 smithi156 ceph-mon[32679]: pgmap v2150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:05:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:58 smithi092 ceph-mon[29156]: pgmap v2151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2854.260271 secs 2024-04-26T19:05:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:05:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2157.246043 secs 2024-04-26T19:05:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:58 smithi189 ceph-mon[32756]: pgmap v2151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2854.260271 secs 2024-04-26T19:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:05:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2157.246043 secs 2024-04-26T19:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:58 smithi156 ceph-mon[32679]: pgmap v2151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2854.260271 secs 2024-04-26T19:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:05:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2157.246043 secs 2024-04-26T19:06:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:00 smithi092 ceph-mon[29156]: pgmap v2152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:00 smithi189 ceph-mon[32756]: pgmap v2152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:00 smithi156 ceph-mon[32679]: pgmap v2152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:06:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:06:01.768+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:06:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:06:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:06:01.768+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:06:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:06:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:06:01.768+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:06:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:06:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:06:01.768+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:06:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:06:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:06:01.768+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:06:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:02 smithi092 ceph-mon[29156]: pgmap v2153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:02 smithi189 ceph-mon[32756]: pgmap v2153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:02 smithi156 ceph-mon[32679]: pgmap v2153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2859.260393 secs 2024-04-26T19:06:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2162.246165 secs 2024-04-26T19:06:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2859.260393 secs 2024-04-26T19:06:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2162.246165 secs 2024-04-26T19:06:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2859.260393 secs 2024-04-26T19:06:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2162.246165 secs 2024-04-26T19:06:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:04 smithi092 ceph-mon[29156]: pgmap v2154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:04 smithi189 ceph-mon[32756]: pgmap v2154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:04 smithi156 ceph-mon[32679]: pgmap v2154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:06 smithi092 ceph-mon[29156]: pgmap v2155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:06 smithi189 ceph-mon[32756]: pgmap v2155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:06 smithi156 ceph-mon[32679]: pgmap v2155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:07 smithi092 ceph-mon[29156]: pgmap v2156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:06:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:07 smithi189 ceph-mon[32756]: pgmap v2156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:06:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:07 smithi156 ceph-mon[32679]: pgmap v2156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:06:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2864.260510 secs 2024-04-26T19:06:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2167.246333 secs 2024-04-26T19:06:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2864.260510 secs 2024-04-26T19:06:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2167.246333 secs 2024-04-26T19:06:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2864.260510 secs 2024-04-26T19:06:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2167.246333 secs 2024-04-26T19:06:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: pgmap v2157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: pgmap v2158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T19:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: pgmap v2159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:06:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: pgmap v2157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: pgmap v2158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T19:06:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: pgmap v2159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: pgmap v2157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: pgmap v2158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T19:06:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: pgmap v2159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:06:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:12 smithi156 ceph-mon[32679]: pgmap v2160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:12 smithi092 ceph-mon[29156]: pgmap v2160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:12 smithi189 ceph-mon[32756]: pgmap v2160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:06:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2869.260629 secs 2024-04-26T19:06:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2172.246448 secs 2024-04-26T19:06:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2869.260629 secs 2024-04-26T19:06:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2172.246448 secs 2024-04-26T19:06:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2869.260629 secs 2024-04-26T19:06:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2172.246448 secs 2024-04-26T19:06:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:14 smithi092 ceph-mon[29156]: pgmap v2161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:14 smithi156 ceph-mon[32679]: pgmap v2161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:14 smithi189 ceph-mon[32756]: pgmap v2161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:16 smithi092 ceph-mon[29156]: pgmap v2162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:16 smithi189 ceph-mon[32756]: pgmap v2162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:16 smithi156 ceph-mon[32679]: pgmap v2162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:18 smithi092 ceph-mon[29156]: pgmap v2163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2874.260764 secs 2024-04-26T19:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2177.246561 secs 2024-04-26T19:06:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:18 smithi189 ceph-mon[32756]: pgmap v2163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:06:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2874.260764 secs 2024-04-26T19:06:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2177.246561 secs 2024-04-26T19:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:18 smithi156 ceph-mon[32679]: pgmap v2163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2874.260764 secs 2024-04-26T19:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2177.246561 secs 2024-04-26T19:06:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:20 smithi092 ceph-mon[29156]: pgmap v2164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:06:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:20 smithi189 ceph-mon[32756]: pgmap v2164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:06:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:20 smithi156 ceph-mon[32679]: pgmap v2164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:06:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:22 smithi092 ceph-mon[29156]: pgmap v2165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:22 smithi189 ceph-mon[32756]: pgmap v2165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:22 smithi156 ceph-mon[32679]: pgmap v2165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2879.260904 secs 2024-04-26T19:06:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2182.246681 secs 2024-04-26T19:06:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2879.260904 secs 2024-04-26T19:06:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2182.246681 secs 2024-04-26T19:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2879.260904 secs 2024-04-26T19:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2182.246681 secs 2024-04-26T19:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:24 smithi092 ceph-mon[29156]: pgmap v2166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:24 smithi189 ceph-mon[32756]: pgmap v2166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:24 smithi156 ceph-mon[32679]: pgmap v2166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:26 smithi092 ceph-mon[29156]: pgmap v2167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:26 smithi189 ceph-mon[32756]: pgmap v2167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:26 smithi156 ceph-mon[32679]: pgmap v2167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:28 smithi092 ceph-mon[29156]: pgmap v2168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:28 smithi092 ceph-mon[29156]: 4 slow requests, 2 included below; oldest blocked for > 2884.261020 secs 2024-04-26T19:06:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:28 smithi092 ceph-mon[29156]: slow request 2884.192790 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:06:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:28 smithi092 ceph-mon[29156]: slow request 2884.261020 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:06:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2187.246758 secs 2024-04-26T19:06:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:28 smithi189 ceph-mon[32756]: pgmap v2168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:28 smithi189 ceph-mon[32756]: 4 slow requests, 2 included below; oldest blocked for > 2884.261020 secs 2024-04-26T19:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:28 smithi189 ceph-mon[32756]: slow request 2884.192790 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:28 smithi189 ceph-mon[32756]: slow request 2884.261020 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2187.246758 secs 2024-04-26T19:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:28 smithi156 ceph-mon[32679]: pgmap v2168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:28 smithi156 ceph-mon[32679]: 4 slow requests, 2 included below; oldest blocked for > 2884.261020 secs 2024-04-26T19:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:28 smithi156 ceph-mon[32679]: slow request 2884.192790 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:06:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:28 smithi156 ceph-mon[32679]: slow request 2884.261020 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:06:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2187.246758 secs 2024-04-26T19:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:30 smithi092 ceph-mon[29156]: pgmap v2169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:30 smithi189 ceph-mon[32756]: pgmap v2169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:30 smithi156 ceph-mon[32679]: pgmap v2169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:32 smithi092 ceph-mon[29156]: pgmap v2170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:32 smithi189 ceph-mon[32756]: pgmap v2170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:32 smithi156 ceph-mon[32679]: pgmap v2170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2889.261136 secs 2024-04-26T19:06:34.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2192.246830 secs 2024-04-26T19:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2889.261136 secs 2024-04-26T19:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2192.246830 secs 2024-04-26T19:06:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2889.261136 secs 2024-04-26T19:06:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2192.246830 secs 2024-04-26T19:06:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:34 smithi092 ceph-mon[29156]: pgmap v2171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:34 smithi189 ceph-mon[32756]: pgmap v2171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:34 smithi156 ceph-mon[32679]: pgmap v2171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:06:36.373+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:06:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:06:36.373+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:06:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:06:36.374+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:06:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:06:36.374+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 26 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:06:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:36 smithi092 ceph-mon[29156]: pgmap v2172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:36 smithi189 ceph-mon[32756]: pgmap v2172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:36 smithi156 ceph-mon[32679]: pgmap v2172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:38 smithi092 ceph-mon[29156]: pgmap v2173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2894.261227 secs 2024-04-26T19:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2197.246922 secs 2024-04-26T19:06:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:38 smithi189 ceph-mon[32756]: pgmap v2173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2894.261227 secs 2024-04-26T19:06:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2197.246922 secs 2024-04-26T19:06:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:38 smithi156 ceph-mon[32679]: pgmap v2173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2894.261227 secs 2024-04-26T19:06:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2197.246922 secs 2024-04-26T19:06:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:40 smithi092 ceph-mon[29156]: pgmap v2174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:40 smithi189 ceph-mon[32756]: pgmap v2174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:40 smithi156 ceph-mon[32679]: pgmap v2174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:42 smithi092 ceph-mon[29156]: pgmap v2175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:42 smithi189 ceph-mon[32756]: pgmap v2175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:42 smithi156 ceph-mon[32679]: pgmap v2175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2899.261346 secs 2024-04-26T19:06:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2202.247060 secs 2024-04-26T19:06:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2899.261346 secs 2024-04-26T19:06:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2202.247060 secs 2024-04-26T19:06:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2899.261346 secs 2024-04-26T19:06:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2202.247060 secs 2024-04-26T19:06:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:44 smithi156 ceph-mon[32679]: pgmap v2176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:44 smithi189 ceph-mon[32756]: pgmap v2176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:44 smithi092 ceph-mon[29156]: pgmap v2176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:46 smithi189 ceph-mon[32756]: pgmap v2177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:46 smithi156 ceph-mon[32679]: pgmap v2177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:46 smithi092 ceph-mon[29156]: pgmap v2177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:48 smithi092 ceph-mon[29156]: pgmap v2178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2904.261409 secs 2024-04-26T19:06:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2207.247169 secs 2024-04-26T19:06:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:48 smithi189 ceph-mon[32756]: pgmap v2178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2904.261409 secs 2024-04-26T19:06:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2207.247169 secs 2024-04-26T19:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:48 smithi156 ceph-mon[32679]: pgmap v2178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2904.261409 secs 2024-04-26T19:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2207.247169 secs 2024-04-26T19:06:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:50 smithi092 ceph-mon[29156]: pgmap v2179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:50 smithi189 ceph-mon[32756]: pgmap v2179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:50 smithi156 ceph-mon[32679]: pgmap v2179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:52 smithi092 ceph-mon[29156]: pgmap v2180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:52 smithi189 ceph-mon[32756]: pgmap v2180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:52 smithi156 ceph-mon[32679]: pgmap v2180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2909.261487 secs 2024-04-26T19:06:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2212.247289 secs 2024-04-26T19:06:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2909.261487 secs 2024-04-26T19:06:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2212.247289 secs 2024-04-26T19:06:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2909.261487 secs 2024-04-26T19:06:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2212.247289 secs 2024-04-26T19:06:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:54 smithi092 ceph-mon[29156]: pgmap v2181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:54 smithi189 ceph-mon[32756]: pgmap v2181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:54 smithi156 ceph-mon[32679]: pgmap v2181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:06:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:56 smithi092 ceph-mon[29156]: pgmap v2182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:56 smithi189 ceph-mon[32756]: pgmap v2182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:56 smithi156 ceph-mon[32679]: pgmap v2182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:59.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:58 smithi092 ceph-mon[29156]: pgmap v2183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:59.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2914.261605 secs 2024-04-26T19:06:59.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:06:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2217.247399 secs 2024-04-26T19:06:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:58 smithi189 ceph-mon[32756]: pgmap v2183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2914.261605 secs 2024-04-26T19:06:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:06:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2217.247399 secs 2024-04-26T19:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:58 smithi156 ceph-mon[32679]: pgmap v2183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2914.261605 secs 2024-04-26T19:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:06:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2217.247399 secs 2024-04-26T19:07:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:00 smithi092 ceph-mon[29156]: pgmap v2184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:00 smithi189 ceph-mon[32756]: pgmap v2184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:00 smithi156 ceph-mon[32679]: pgmap v2184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:02 smithi092 ceph-mon[29156]: pgmap v2185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:02 smithi189 ceph-mon[32756]: pgmap v2185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:02 smithi156 ceph-mon[32679]: pgmap v2185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:03 smithi092 ceph-mon[29156]: 4 slow requests, 2 included below; oldest blocked for > 2919.261724 secs 2024-04-26T19:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:03 smithi092 ceph-mon[29156]: slow request 2883.198034 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:03 smithi092 ceph-mon[29156]: slow request 361.517843 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:07:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2222.247462 secs 2024-04-26T19:07:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:03 smithi189 ceph-mon[32756]: 4 slow requests, 2 included below; oldest blocked for > 2919.261724 secs 2024-04-26T19:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:03 smithi189 ceph-mon[32756]: slow request 2883.198034 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:03 smithi189 ceph-mon[32756]: slow request 361.517843 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:07:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2222.247462 secs 2024-04-26T19:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:03 smithi156 ceph-mon[32679]: 4 slow requests, 2 included below; oldest blocked for > 2919.261724 secs 2024-04-26T19:07:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:03 smithi156 ceph-mon[32679]: slow request 2883.198034 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:07:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:03 smithi156 ceph-mon[32679]: slow request 361.517843 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:07:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2222.247462 secs 2024-04-26T19:07:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:04 smithi092 ceph-mon[29156]: pgmap v2186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:04 smithi189 ceph-mon[32756]: pgmap v2186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:04 smithi156 ceph-mon[32679]: pgmap v2186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:06 smithi092 ceph-mon[29156]: pgmap v2187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:06 smithi189 ceph-mon[32756]: pgmap v2187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:06 smithi156 ceph-mon[32679]: pgmap v2187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:08 smithi092 ceph-mon[29156]: pgmap v2188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2924.261859 secs 2024-04-26T19:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2227.247578 secs 2024-04-26T19:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:08 smithi189 ceph-mon[32756]: pgmap v2188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2924.261859 secs 2024-04-26T19:07:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2227.247578 secs 2024-04-26T19:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:08 smithi156 ceph-mon[32679]: pgmap v2188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2924.261859 secs 2024-04-26T19:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2227.247578 secs 2024-04-26T19:07:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:10 smithi189 ceph-mon[32756]: pgmap v2189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:10 smithi156 ceph-mon[32679]: pgmap v2189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:10 smithi092 ceph-mon[29156]: pgmap v2189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:07:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:11 smithi189 ceph-mon[32756]: pgmap v2190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:07:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:11 smithi189 ceph-mon[32756]: pgmap v2191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:11 smithi156 ceph-mon[32679]: pgmap v2190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:11 smithi156 ceph-mon[32679]: pgmap v2191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:11 smithi092 ceph-mon[29156]: pgmap v2190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:11 smithi092 ceph-mon[29156]: pgmap v2191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:07:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:13 smithi092 ceph-mon[29156]: pgmap v2192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:07:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2929.261985 secs 2024-04-26T19:07:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:13 smithi189 ceph-mon[32756]: pgmap v2192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:07:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2929.261985 secs 2024-04-26T19:07:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:13 smithi156 ceph-mon[32679]: pgmap v2192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:07:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2929.261985 secs 2024-04-26T19:07:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2232.247693 secs 2024-04-26T19:07:15.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2232.247693 secs 2024-04-26T19:07:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2232.247693 secs 2024-04-26T19:07:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:15 smithi092 ceph-mon[29156]: pgmap v2193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:15 smithi189 ceph-mon[32756]: pgmap v2193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:15 smithi156 ceph-mon[32679]: pgmap v2193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:17 smithi092 ceph-mon[29156]: pgmap v2194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:17 smithi189 ceph-mon[32756]: pgmap v2194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:17 smithi156 ceph-mon[32679]: pgmap v2194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2934.262104 secs 2024-04-26T19:07:19.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2934.262104 secs 2024-04-26T19:07:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2934.262104 secs 2024-04-26T19:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2237.247810 secs 2024-04-26T19:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:19 smithi092 ceph-mon[29156]: pgmap v2195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2237.247810 secs 2024-04-26T19:07:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:19 smithi189 ceph-mon[32756]: pgmap v2195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2237.247810 secs 2024-04-26T19:07:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:19 smithi156 ceph-mon[32679]: pgmap v2195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:07:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:21 smithi092 ceph-mon[29156]: pgmap v2196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:07:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:21 smithi189 ceph-mon[32756]: pgmap v2196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:07:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:21 smithi156 ceph-mon[32679]: pgmap v2196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:07:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:23 smithi092 ceph-mon[29156]: pgmap v2197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2939.262221 secs 2024-04-26T19:07:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:23 smithi189 ceph-mon[32756]: pgmap v2197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2939.262221 secs 2024-04-26T19:07:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:23 smithi156 ceph-mon[32679]: pgmap v2197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2939.262221 secs 2024-04-26T19:07:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2242.247933 secs 2024-04-26T19:07:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2242.247933 secs 2024-04-26T19:07:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2242.247933 secs 2024-04-26T19:07:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:25 smithi092 ceph-mon[29156]: pgmap v2198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:25 smithi189 ceph-mon[32756]: pgmap v2198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:25 smithi156 ceph-mon[32679]: pgmap v2198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:27 smithi092 ceph-mon[29156]: pgmap v2199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:27 smithi189 ceph-mon[32756]: pgmap v2199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:27 smithi156 ceph-mon[32679]: pgmap v2199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2944.262342 secs 2024-04-26T19:07:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2944.262342 secs 2024-04-26T19:07:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2944.262342 secs 2024-04-26T19:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2247.248069 secs 2024-04-26T19:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:29 smithi092 ceph-mon[29156]: pgmap v2200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2247.248069 secs 2024-04-26T19:07:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:29 smithi189 ceph-mon[32756]: pgmap v2200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2247.248069 secs 2024-04-26T19:07:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:29 smithi156 ceph-mon[32679]: pgmap v2200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:31 smithi092 ceph-mon[29156]: pgmap v2201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:31 smithi189 ceph-mon[32756]: pgmap v2201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:31 smithi156 ceph-mon[32679]: pgmap v2201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:33 smithi092 ceph-mon[29156]: pgmap v2202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2949.262460 secs 2024-04-26T19:07:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:33 smithi189 ceph-mon[32756]: pgmap v2202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2949.262460 secs 2024-04-26T19:07:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:33 smithi156 ceph-mon[32679]: pgmap v2202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:07:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2949.262460 secs 2024-04-26T19:07:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2252.248189 secs 2024-04-26T19:07:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2252.248189 secs 2024-04-26T19:07:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2252.248189 secs 2024-04-26T19:07:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:35 smithi189 ceph-mon[32756]: pgmap v2203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:35 smithi156 ceph-mon[32679]: pgmap v2203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:35 smithi092 ceph-mon[29156]: pgmap v2203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:07:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:37 smithi189 ceph-mon[32756]: pgmap v2204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:37 smithi156 ceph-mon[32679]: pgmap v2204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:37 smithi092 ceph-mon[29156]: pgmap v2204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2954.262513 secs 2024-04-26T19:07:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2954.262513 secs 2024-04-26T19:07:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2954.262513 secs 2024-04-26T19:07:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2257.248341 secs 2024-04-26T19:07:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:39 smithi189 ceph-mon[32756]: pgmap v2205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2257.248341 secs 2024-04-26T19:07:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:39 smithi156 ceph-mon[32679]: pgmap v2205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2257.248341 secs 2024-04-26T19:07:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:39 smithi092 ceph-mon[29156]: pgmap v2205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:41 smithi189 ceph-mon[32756]: pgmap v2206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:41 smithi156 ceph-mon[32679]: pgmap v2206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:41 smithi092 ceph-mon[29156]: pgmap v2206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:43 smithi189 ceph-mon[32756]: pgmap v2207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2959.262634 secs 2024-04-26T19:07:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:43 smithi156 ceph-mon[32679]: pgmap v2207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2959.262634 secs 2024-04-26T19:07:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:43 smithi092 ceph-mon[29156]: pgmap v2207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2959.262634 secs 2024-04-26T19:07:45.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2262.248433 secs 2024-04-26T19:07:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2262.248433 secs 2024-04-26T19:07:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2262.248433 secs 2024-04-26T19:07:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:45 smithi189 ceph-mon[32756]: pgmap v2208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:45 smithi156 ceph-mon[32679]: pgmap v2208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:45 smithi092 ceph-mon[29156]: pgmap v2208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:47 smithi189 ceph-mon[32756]: pgmap v2209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:47 smithi156 ceph-mon[32679]: pgmap v2209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:47 smithi092 ceph-mon[29156]: pgmap v2209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:49.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2964.262752 secs 2024-04-26T19:07:49.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2267.248511 secs 2024-04-26T19:07:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2964.262752 secs 2024-04-26T19:07:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2267.248511 secs 2024-04-26T19:07:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2964.262752 secs 2024-04-26T19:07:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2267.248511 secs 2024-04-26T19:07:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:49 smithi189 ceph-mon[32756]: pgmap v2210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:49 smithi156 ceph-mon[32679]: pgmap v2210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:49 smithi092 ceph-mon[29156]: pgmap v2210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:51 smithi189 ceph-mon[32756]: pgmap v2211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:51 smithi156 ceph-mon[32679]: pgmap v2211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:51 smithi092 ceph-mon[29156]: pgmap v2211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:53 smithi189 ceph-mon[32756]: pgmap v2212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2969.262887 secs 2024-04-26T19:07:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2272.248629 secs 2024-04-26T19:07:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:53 smithi156 ceph-mon[32679]: pgmap v2212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2969.262887 secs 2024-04-26T19:07:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2272.248629 secs 2024-04-26T19:07:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:53 smithi092 ceph-mon[29156]: pgmap v2212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2969.262887 secs 2024-04-26T19:07:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2272.248629 secs 2024-04-26T19:07:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:55 smithi189 ceph-mon[32756]: pgmap v2213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:55 smithi156 ceph-mon[32679]: pgmap v2213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:55 smithi092 ceph-mon[29156]: pgmap v2213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:07:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:57 smithi189 ceph-mon[32756]: pgmap v2214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:57 smithi156 ceph-mon[32679]: pgmap v2214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:57 smithi092 ceph-mon[29156]: pgmap v2214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:07:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2974.262966 secs 2024-04-26T19:07:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2277.248750 secs 2024-04-26T19:07:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2974.262966 secs 2024-04-26T19:07:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2277.248750 secs 2024-04-26T19:07:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2974.262966 secs 2024-04-26T19:07:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2277.248750 secs 2024-04-26T19:08:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:07:59 smithi189 ceph-mon[32756]: pgmap v2215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:07:59 smithi156 ceph-mon[32679]: pgmap v2215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:07:59 smithi092 ceph-mon[29156]: pgmap v2215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:01 smithi092 ceph-mon[29156]: pgmap v2216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:01 smithi189 ceph-mon[32756]: pgmap v2216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:01 smithi156 ceph-mon[32679]: pgmap v2216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:03 smithi189 ceph-mon[32756]: pgmap v2217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2979.263079 secs 2024-04-26T19:08:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 2282.248869 secs 2024-04-26T19:08:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:03 smithi189 ceph-mon[32756]: slow request 721.795290 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:08:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:03 smithi156 ceph-mon[32679]: pgmap v2217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2979.263079 secs 2024-04-26T19:08:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 2282.248869 secs 2024-04-26T19:08:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:03 smithi156 ceph-mon[32679]: slow request 721.795290 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:08:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:03 smithi092 ceph-mon[29156]: pgmap v2217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2979.263079 secs 2024-04-26T19:08:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 2282.248869 secs 2024-04-26T19:08:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:03 smithi092 ceph-mon[29156]: slow request 721.795290 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:08:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:05 smithi189 ceph-mon[32756]: pgmap v2218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:05 smithi156 ceph-mon[32679]: pgmap v2218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:05 smithi092 ceph-mon[29156]: pgmap v2218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:08:06.384+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:08:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:08:06.384+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:08:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:08:06.385+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:08:06.386 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:08:06.385+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 27 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:08:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:07 smithi189 ceph-mon[32756]: pgmap v2219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:07 smithi156 ceph-mon[32679]: pgmap v2219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:07 smithi092 ceph-mon[29156]: pgmap v2219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2984.263195 secs 2024-04-26T19:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2287.248968 secs 2024-04-26T19:08:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2984.263195 secs 2024-04-26T19:08:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2287.248968 secs 2024-04-26T19:08:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2984.263195 secs 2024-04-26T19:08:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2287.248968 secs 2024-04-26T19:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:09 smithi189 ceph-mon[32756]: pgmap v2220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:09 smithi156 ceph-mon[32679]: pgmap v2220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:09 smithi092 ceph-mon[29156]: pgmap v2220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:11 smithi092 ceph-mon[29156]: pgmap v2221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:08:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:11 smithi189 ceph-mon[32756]: pgmap v2221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:11 smithi156 ceph-mon[32679]: pgmap v2221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:08:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:12 smithi092 ceph-mon[29156]: pgmap v2222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:08:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:12 smithi092 ceph-mon[29156]: pgmap v2223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:12 smithi189 ceph-mon[32756]: pgmap v2222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:08:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:12 smithi189 ceph-mon[32756]: pgmap v2223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:12 smithi156 ceph-mon[32679]: pgmap v2222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:08:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:12 smithi156 ceph-mon[32679]: pgmap v2223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2989.263288 secs 2024-04-26T19:08:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2292.249087 secs 2024-04-26T19:08:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:14 smithi092 ceph-mon[29156]: pgmap v2224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2989.263288 secs 2024-04-26T19:08:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2292.249087 secs 2024-04-26T19:08:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:14 smithi189 ceph-mon[32756]: pgmap v2224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2989.263288 secs 2024-04-26T19:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2292.249087 secs 2024-04-26T19:08:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:14 smithi156 ceph-mon[32679]: pgmap v2224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:16.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:16 smithi156 ceph-mon[32679]: pgmap v2225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:16 smithi092 ceph-mon[29156]: pgmap v2225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:16 smithi189 ceph-mon[32756]: pgmap v2225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:18 smithi092 ceph-mon[29156]: pgmap v2226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:18 smithi189 ceph-mon[32756]: pgmap v2226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:18 smithi156 ceph-mon[32679]: pgmap v2226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:08:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2994.263416 secs 2024-04-26T19:08:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2297.249226 secs 2024-04-26T19:08:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2994.263416 secs 2024-04-26T19:08:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2297.249226 secs 2024-04-26T19:08:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2994.263416 secs 2024-04-26T19:08:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2297.249226 secs 2024-04-26T19:08:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:20 smithi092 ceph-mon[29156]: pgmap v2227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:20 smithi189 ceph-mon[32756]: pgmap v2227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:20 smithi156 ceph-mon[32679]: pgmap v2227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:08:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:22 smithi092 ceph-mon[29156]: pgmap v2228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:08:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:22 smithi189 ceph-mon[32756]: pgmap v2228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:08:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:22 smithi156 ceph-mon[32679]: pgmap v2228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:08:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2999.263525 secs 2024-04-26T19:08:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2302.249372 secs 2024-04-26T19:08:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:24 smithi092 ceph-mon[29156]: pgmap v2229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2999.263525 secs 2024-04-26T19:08:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2302.249372 secs 2024-04-26T19:08:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:24 smithi189 ceph-mon[32756]: pgmap v2229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2999.263525 secs 2024-04-26T19:08:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2302.249372 secs 2024-04-26T19:08:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:24 smithi156 ceph-mon[32679]: pgmap v2229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:26 smithi189 ceph-mon[32756]: pgmap v2230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:26 smithi156 ceph-mon[32679]: pgmap v2230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:26 smithi092 ceph-mon[29156]: pgmap v2230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:28 smithi189 ceph-mon[32756]: pgmap v2231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:28 smithi156 ceph-mon[32679]: pgmap v2231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:28 smithi092 ceph-mon[29156]: pgmap v2231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3004.263618 secs 2024-04-26T19:08:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2307.249489 secs 2024-04-26T19:08:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3004.263618 secs 2024-04-26T19:08:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2307.249489 secs 2024-04-26T19:08:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3004.263618 secs 2024-04-26T19:08:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2307.249489 secs 2024-04-26T19:08:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:30 smithi189 ceph-mon[32756]: pgmap v2232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:30 smithi156 ceph-mon[32679]: pgmap v2232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:30 smithi092 ceph-mon[29156]: pgmap v2232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:32 smithi189 ceph-mon[32756]: pgmap v2233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:32 smithi156 ceph-mon[32679]: pgmap v2233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:32 smithi092 ceph-mon[29156]: pgmap v2233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3009.263737 secs 2024-04-26T19:08:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2312.249567 secs 2024-04-26T19:08:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:34 smithi092 ceph-mon[29156]: pgmap v2234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3009.263737 secs 2024-04-26T19:08:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2312.249567 secs 2024-04-26T19:08:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:34 smithi189 ceph-mon[32756]: pgmap v2234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3009.263737 secs 2024-04-26T19:08:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2312.249567 secs 2024-04-26T19:08:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:34 smithi156 ceph-mon[32679]: pgmap v2234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:36 smithi189 ceph-mon[32756]: pgmap v2235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:36 smithi156 ceph-mon[32679]: pgmap v2235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:36 smithi092 ceph-mon[29156]: pgmap v2235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:38 smithi189 ceph-mon[32756]: pgmap v2236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:38 smithi156 ceph-mon[32679]: pgmap v2236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:38 smithi092 ceph-mon[29156]: pgmap v2236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3014.263851 secs 2024-04-26T19:08:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2317.249689 secs 2024-04-26T19:08:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3014.263851 secs 2024-04-26T19:08:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2317.249689 secs 2024-04-26T19:08:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3014.263851 secs 2024-04-26T19:08:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2317.249689 secs 2024-04-26T19:08:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:40 smithi189 ceph-mon[32756]: pgmap v2237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:40 smithi156 ceph-mon[32679]: pgmap v2237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:40 smithi092 ceph-mon[29156]: pgmap v2237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:42 smithi189 ceph-mon[32756]: pgmap v2238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:42 smithi156 ceph-mon[32679]: pgmap v2238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:42 smithi092 ceph-mon[29156]: pgmap v2238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3019.263909 secs 2024-04-26T19:08:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2322.249781 secs 2024-04-26T19:08:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:44 smithi189 ceph-mon[32756]: pgmap v2239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3019.263909 secs 2024-04-26T19:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2322.249781 secs 2024-04-26T19:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:44 smithi156 ceph-mon[32679]: pgmap v2239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3019.263909 secs 2024-04-26T19:08:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2322.249781 secs 2024-04-26T19:08:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:44 smithi092 ceph-mon[29156]: pgmap v2239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:46 smithi189 ceph-mon[32756]: pgmap v2240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:46 smithi156 ceph-mon[32679]: pgmap v2240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:46 smithi092 ceph-mon[29156]: pgmap v2240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:48 smithi189 ceph-mon[32756]: pgmap v2241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:48 smithi156 ceph-mon[32679]: pgmap v2241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:48 smithi092 ceph-mon[29156]: pgmap v2241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3024.264011 secs 2024-04-26T19:08:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2327.249877 secs 2024-04-26T19:08:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3024.264011 secs 2024-04-26T19:08:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2327.249877 secs 2024-04-26T19:08:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3024.264011 secs 2024-04-26T19:08:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2327.249877 secs 2024-04-26T19:08:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:50 smithi189 ceph-mon[32756]: pgmap v2242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:50 smithi156 ceph-mon[32679]: pgmap v2242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:50 smithi092 ceph-mon[29156]: pgmap v2242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:52 smithi189 ceph-mon[32756]: pgmap v2243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:52 smithi156 ceph-mon[32679]: pgmap v2243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:52 smithi092 ceph-mon[29156]: pgmap v2243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3029.264119 secs 2024-04-26T19:08:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2332.249997 secs 2024-04-26T19:08:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:54 smithi189 ceph-mon[32756]: pgmap v2244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3029.264119 secs 2024-04-26T19:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2332.249997 secs 2024-04-26T19:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:54 smithi156 ceph-mon[32679]: pgmap v2244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3029.264119 secs 2024-04-26T19:08:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2332.249997 secs 2024-04-26T19:08:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:54 smithi092 ceph-mon[29156]: pgmap v2244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:56 smithi189 ceph-mon[32756]: pgmap v2245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:56 smithi156 ceph-mon[32679]: pgmap v2245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:56 smithi092 ceph-mon[29156]: pgmap v2245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:08:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:58 smithi189 ceph-mon[32756]: pgmap v2246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:58 smithi156 ceph-mon[32679]: pgmap v2246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:58 smithi092 ceph-mon[29156]: pgmap v2246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:08:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3034.264232 secs 2024-04-26T19:08:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:08:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2337.250133 secs 2024-04-26T19:08:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3034.264232 secs 2024-04-26T19:08:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:08:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2337.250133 secs 2024-04-26T19:08:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3034.264232 secs 2024-04-26T19:08:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:08:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2337.250133 secs 2024-04-26T19:09:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:00 smithi189 ceph-mon[32756]: pgmap v2247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:00 smithi156 ceph-mon[32679]: pgmap v2247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:00 smithi092 ceph-mon[29156]: pgmap v2247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:02 smithi189 ceph-mon[32756]: pgmap v2248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:02 smithi156 ceph-mon[32679]: pgmap v2248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:02 smithi092 ceph-mon[29156]: pgmap v2248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3039.264349 secs 2024-04-26T19:09:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2342.250245 secs 2024-04-26T19:09:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:04 smithi189 ceph-mon[32756]: pgmap v2249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3039.264349 secs 2024-04-26T19:09:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2342.250245 secs 2024-04-26T19:09:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:04 smithi156 ceph-mon[32679]: pgmap v2249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3039.264349 secs 2024-04-26T19:09:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2342.250245 secs 2024-04-26T19:09:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:04 smithi092 ceph-mon[29156]: pgmap v2249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:06 smithi189 ceph-mon[32756]: pgmap v2250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:06 smithi156 ceph-mon[32679]: pgmap v2250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:06 smithi092 ceph-mon[29156]: pgmap v2250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:08 smithi189 ceph-mon[32756]: pgmap v2251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:08 smithi156 ceph-mon[32679]: pgmap v2251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:08 smithi092 ceph-mon[29156]: pgmap v2251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3044.264489 secs 2024-04-26T19:09:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2347.250381 secs 2024-04-26T19:09:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3044.264489 secs 2024-04-26T19:09:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2347.250381 secs 2024-04-26T19:09:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3044.264489 secs 2024-04-26T19:09:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2347.250381 secs 2024-04-26T19:09:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:10 smithi189 ceph-mon[32756]: pgmap v2252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:10 smithi156 ceph-mon[32679]: pgmap v2252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:10 smithi092 ceph-mon[29156]: pgmap v2252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:09:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:09:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:12 smithi189 ceph-mon[32756]: pgmap v2253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:09:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:12 smithi156 ceph-mon[32679]: pgmap v2253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:09:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:12 smithi092 ceph-mon[29156]: pgmap v2253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:09:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:09:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:09:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:09:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:13 smithi189 ceph-mon[32756]: pgmap v2254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:09:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:13 smithi189 ceph-mon[32756]: pgmap v2255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:09:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:13 smithi156 ceph-mon[32679]: pgmap v2254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:09:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:13 smithi156 ceph-mon[32679]: pgmap v2255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:09:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:13 smithi092 ceph-mon[29156]: pgmap v2254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:09:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:13 smithi092 ceph-mon[29156]: pgmap v2255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:09:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3049.264622 secs 2024-04-26T19:09:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2352.250507 secs 2024-04-26T19:09:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3049.264622 secs 2024-04-26T19:09:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2352.250507 secs 2024-04-26T19:09:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3049.264622 secs 2024-04-26T19:09:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2352.250507 secs 2024-04-26T19:09:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:15 smithi189 ceph-mon[32756]: pgmap v2256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:15 smithi156 ceph-mon[32679]: pgmap v2256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:15 smithi092 ceph-mon[29156]: pgmap v2256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:17 smithi189 ceph-mon[32756]: pgmap v2257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:17 smithi156 ceph-mon[32679]: pgmap v2257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:17 smithi092 ceph-mon[29156]: pgmap v2257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3054.264733 secs 2024-04-26T19:09:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:19 smithi189 ceph-mon[32756]: pgmap v2258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2357.250580 secs 2024-04-26T19:09:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3054.264733 secs 2024-04-26T19:09:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:19 smithi156 ceph-mon[32679]: pgmap v2258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2357.250580 secs 2024-04-26T19:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3054.264733 secs 2024-04-26T19:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:19 smithi092 ceph-mon[29156]: pgmap v2258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2357.250580 secs 2024-04-26T19:09:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:21 smithi189 ceph-mon[32756]: pgmap v2259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:21 smithi156 ceph-mon[32679]: pgmap v2259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:21 smithi092 ceph-mon[29156]: pgmap v2259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:09:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:23 smithi189 ceph-mon[32756]: pgmap v2260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:09:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:23 smithi156 ceph-mon[32679]: pgmap v2260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:09:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:23 smithi092 ceph-mon[29156]: pgmap v2260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:09:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3059.264833 secs 2024-04-26T19:09:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2362.250651 secs 2024-04-26T19:09:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3059.264833 secs 2024-04-26T19:09:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2362.250651 secs 2024-04-26T19:09:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3059.264833 secs 2024-04-26T19:09:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2362.250651 secs 2024-04-26T19:09:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:25 smithi189 ceph-mon[32756]: pgmap v2261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:25 smithi156 ceph-mon[32679]: pgmap v2261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:25 smithi092 ceph-mon[29156]: pgmap v2261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:27 smithi189 ceph-mon[32756]: pgmap v2262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:27 smithi156 ceph-mon[32679]: pgmap v2262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:27 smithi092 ceph-mon[29156]: pgmap v2262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3064.264950 secs 2024-04-26T19:09:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:29 smithi189 ceph-mon[32756]: pgmap v2263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2367.250729 secs 2024-04-26T19:09:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3064.264950 secs 2024-04-26T19:09:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:29 smithi156 ceph-mon[32679]: pgmap v2263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2367.250729 secs 2024-04-26T19:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3064.264950 secs 2024-04-26T19:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:29 smithi092 ceph-mon[29156]: pgmap v2263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2367.250729 secs 2024-04-26T19:09:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:31 smithi189 ceph-mon[32756]: pgmap v2264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:31 smithi156 ceph-mon[32679]: pgmap v2264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:31 smithi092 ceph-mon[29156]: pgmap v2264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:33 smithi156 ceph-mon[32679]: pgmap v2265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:33 smithi092 ceph-mon[29156]: pgmap v2265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:33 smithi189 ceph-mon[32756]: pgmap v2265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3069.265068 secs 2024-04-26T19:09:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2372.250824 secs 2024-04-26T19:09:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3069.265068 secs 2024-04-26T19:09:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2372.250824 secs 2024-04-26T19:09:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3069.265068 secs 2024-04-26T19:09:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2372.250824 secs 2024-04-26T19:09:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:35 smithi156 ceph-mon[32679]: pgmap v2266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:35 smithi092 ceph-mon[29156]: pgmap v2266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:35 smithi189 ceph-mon[32756]: pgmap v2266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:09:36.397+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:09:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:09:36.397+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:09:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:09:36.397+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:09:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:09:36.397+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 28 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:09:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:37 smithi156 ceph-mon[32679]: pgmap v2267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:37 smithi092 ceph-mon[29156]: pgmap v2267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:37 smithi189 ceph-mon[32756]: pgmap v2267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3074.265203 secs 2024-04-26T19:09:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:39 smithi156 ceph-mon[32679]: pgmap v2268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2377.250955 secs 2024-04-26T19:09:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3074.265203 secs 2024-04-26T19:09:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:39 smithi092 ceph-mon[29156]: pgmap v2268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2377.250955 secs 2024-04-26T19:09:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3074.265203 secs 2024-04-26T19:09:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:39 smithi189 ceph-mon[32756]: pgmap v2268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2377.250955 secs 2024-04-26T19:09:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:41 smithi156 ceph-mon[32679]: pgmap v2269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:41 smithi092 ceph-mon[29156]: pgmap v2269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:41 smithi189 ceph-mon[32756]: pgmap v2269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:43 smithi156 ceph-mon[32679]: pgmap v2270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:43 smithi092 ceph-mon[29156]: pgmap v2270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:43 smithi189 ceph-mon[32756]: pgmap v2270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3079.265325 secs 2024-04-26T19:09:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2382.251075 secs 2024-04-26T19:09:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3079.265325 secs 2024-04-26T19:09:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2382.251075 secs 2024-04-26T19:09:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3079.265325 secs 2024-04-26T19:09:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2382.251075 secs 2024-04-26T19:09:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:45 smithi156 ceph-mon[32679]: pgmap v2271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:45 smithi092 ceph-mon[29156]: pgmap v2271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:45 smithi189 ceph-mon[32756]: pgmap v2271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:47 smithi156 ceph-mon[32679]: pgmap v2272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:47 smithi092 ceph-mon[29156]: pgmap v2272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:47 smithi189 ceph-mon[32756]: pgmap v2272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3084.265439 secs 2024-04-26T19:09:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:49 smithi156 ceph-mon[32679]: pgmap v2273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2387.251214 secs 2024-04-26T19:09:49.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3084.265439 secs 2024-04-26T19:09:49.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:49 smithi189 ceph-mon[32756]: pgmap v2273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:49.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2387.251214 secs 2024-04-26T19:09:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3084.265439 secs 2024-04-26T19:09:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:49 smithi092 ceph-mon[29156]: pgmap v2273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2387.251214 secs 2024-04-26T19:09:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:51 smithi156 ceph-mon[32679]: pgmap v2274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:51 smithi092 ceph-mon[29156]: pgmap v2274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:51 smithi189 ceph-mon[32756]: pgmap v2274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:53 smithi156 ceph-mon[32679]: pgmap v2275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:53 smithi092 ceph-mon[29156]: pgmap v2275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:53 smithi189 ceph-mon[32756]: pgmap v2275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3089.265556 secs 2024-04-26T19:09:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2392.251327 secs 2024-04-26T19:09:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3089.265556 secs 2024-04-26T19:09:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2392.251327 secs 2024-04-26T19:09:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3089.265556 secs 2024-04-26T19:09:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2392.251327 secs 2024-04-26T19:09:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:55 smithi092 ceph-mon[29156]: pgmap v2276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:55 smithi189 ceph-mon[32756]: pgmap v2276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:55 smithi156 ceph-mon[32679]: pgmap v2276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:09:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:57 smithi092 ceph-mon[29156]: pgmap v2277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:57 smithi189 ceph-mon[32756]: pgmap v2277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:57 smithi156 ceph-mon[32679]: pgmap v2277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3094.265676 secs 2024-04-26T19:09:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:59 smithi092 ceph-mon[29156]: pgmap v2278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:09:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:09:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2397.251445 secs 2024-04-26T19:10:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3094.265676 secs 2024-04-26T19:10:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:59 smithi189 ceph-mon[32756]: pgmap v2278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:09:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2397.251445 secs 2024-04-26T19:10:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3094.265676 secs 2024-04-26T19:10:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:59 smithi156 ceph-mon[32679]: pgmap v2278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:09:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2397.251445 secs 2024-04-26T19:10:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:10:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:10:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:10:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:01 smithi092 ceph-mon[29156]: pgmap v2279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:01 smithi189 ceph-mon[32756]: pgmap v2279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:01 smithi156 ceph-mon[32679]: pgmap v2279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:03 smithi092 ceph-mon[29156]: pgmap v2280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:03 smithi189 ceph-mon[32756]: pgmap v2280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:03 smithi156 ceph-mon[32679]: pgmap v2280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3099.265792 secs 2024-04-26T19:10:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 2402.251545 secs 2024-04-26T19:10:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:04 smithi092 ceph-mon[29156]: slow request 1441.956912 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:10:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3099.265792 secs 2024-04-26T19:10:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 2402.251545 secs 2024-04-26T19:10:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:04 smithi189 ceph-mon[32756]: slow request 1441.956912 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3099.265792 secs 2024-04-26T19:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 2402.251545 secs 2024-04-26T19:10:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:04 smithi156 ceph-mon[32679]: slow request 1441.956912 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:10:05.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:05 smithi092 ceph-mon[29156]: pgmap v2281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:05 smithi189 ceph-mon[32756]: pgmap v2281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:05 smithi156 ceph-mon[32679]: pgmap v2281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:07 smithi092 ceph-mon[29156]: pgmap v2282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:07 smithi189 ceph-mon[32756]: pgmap v2282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:07 smithi156 ceph-mon[32679]: pgmap v2282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3104.265919 secs 2024-04-26T19:10:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:09 smithi092 ceph-mon[29156]: pgmap v2283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2407.251667 secs 2024-04-26T19:10:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3104.265919 secs 2024-04-26T19:10:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:09 smithi189 ceph-mon[32756]: pgmap v2283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2407.251667 secs 2024-04-26T19:10:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3104.265919 secs 2024-04-26T19:10:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:09 smithi156 ceph-mon[32679]: pgmap v2283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2407.251667 secs 2024-04-26T19:10:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:11 smithi092 ceph-mon[29156]: pgmap v2284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:11 smithi189 ceph-mon[32756]: pgmap v2284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:11 smithi156 ceph-mon[32679]: pgmap v2284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:10:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: pgmap v2285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: pgmap v2286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: pgmap v2287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3109.266035 secs 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: pgmap v2285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: pgmap v2286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: pgmap v2287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3109.266035 secs 2024-04-26T19:10:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: pgmap v2285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:10:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: pgmap v2286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: pgmap v2287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3109.266035 secs 2024-04-26T19:10:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2412.251790 secs 2024-04-26T19:10:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2412.251790 secs 2024-04-26T19:10:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2412.251790 secs 2024-04-26T19:10:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:15 smithi092 ceph-mon[29156]: pgmap v2288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:15 smithi189 ceph-mon[32756]: pgmap v2288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:15 smithi156 ceph-mon[32679]: pgmap v2288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:17 smithi189 ceph-mon[32756]: pgmap v2289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:17 smithi156 ceph-mon[32679]: pgmap v2289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:17 smithi092 ceph-mon[29156]: pgmap v2289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3114.266153 secs 2024-04-26T19:10:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3114.266153 secs 2024-04-26T19:10:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3114.266153 secs 2024-04-26T19:10:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2417.251902 secs 2024-04-26T19:10:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:19 smithi189 ceph-mon[32756]: pgmap v2290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2417.251902 secs 2024-04-26T19:10:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:19 smithi156 ceph-mon[32679]: pgmap v2290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2417.251902 secs 2024-04-26T19:10:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:19 smithi092 ceph-mon[29156]: pgmap v2290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:21 smithi092 ceph-mon[29156]: pgmap v2291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:21 smithi189 ceph-mon[32756]: pgmap v2291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:21 smithi156 ceph-mon[32679]: pgmap v2291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:10:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:23 smithi189 ceph-mon[32756]: pgmap v2292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:10:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:23 smithi156 ceph-mon[32679]: pgmap v2292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:10:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:23 smithi092 ceph-mon[29156]: pgmap v2292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:10:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3119.266228 secs 2024-04-26T19:10:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2422.252027 secs 2024-04-26T19:10:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3119.266228 secs 2024-04-26T19:10:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2422.252027 secs 2024-04-26T19:10:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3119.266228 secs 2024-04-26T19:10:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2422.252027 secs 2024-04-26T19:10:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:25 smithi189 ceph-mon[32756]: pgmap v2293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:25 smithi156 ceph-mon[32679]: pgmap v2293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:25 smithi092 ceph-mon[29156]: pgmap v2293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:27 smithi189 ceph-mon[32756]: pgmap v2294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:27 smithi156 ceph-mon[32679]: pgmap v2294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:27 smithi092 ceph-mon[29156]: pgmap v2294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3124.266341 secs 2024-04-26T19:10:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3124.266341 secs 2024-04-26T19:10:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3124.266341 secs 2024-04-26T19:10:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2427.252115 secs 2024-04-26T19:10:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:29 smithi189 ceph-mon[32756]: pgmap v2295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2427.252115 secs 2024-04-26T19:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:29 smithi156 ceph-mon[32679]: pgmap v2295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2427.252115 secs 2024-04-26T19:10:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:29 smithi092 ceph-mon[29156]: pgmap v2295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:31 smithi189 ceph-mon[32756]: pgmap v2296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:31 smithi156 ceph-mon[32679]: pgmap v2296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:31 smithi092 ceph-mon[29156]: pgmap v2296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:33 smithi189 ceph-mon[32756]: pgmap v2297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:33 smithi156 ceph-mon[32679]: pgmap v2297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:33 smithi092 ceph-mon[29156]: pgmap v2297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3129.266457 secs 2024-04-26T19:10:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2432.252218 secs 2024-04-26T19:10:34.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3129.266457 secs 2024-04-26T19:10:34.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2432.252218 secs 2024-04-26T19:10:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3129.266457 secs 2024-04-26T19:10:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2432.252218 secs 2024-04-26T19:10:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:35 smithi189 ceph-mon[32756]: pgmap v2298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:35 smithi156 ceph-mon[32679]: pgmap v2298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:35 smithi092 ceph-mon[29156]: pgmap v2298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:37 smithi092 ceph-mon[29156]: pgmap v2299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:37 smithi189 ceph-mon[32756]: pgmap v2299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:37 smithi156 ceph-mon[32679]: pgmap v2299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3134.266563 secs 2024-04-26T19:10:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3134.266563 secs 2024-04-26T19:10:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3134.266563 secs 2024-04-26T19:10:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2437.252342 secs 2024-04-26T19:10:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:39 smithi189 ceph-mon[32756]: pgmap v2300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2437.252342 secs 2024-04-26T19:10:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:39 smithi156 ceph-mon[32679]: pgmap v2300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2437.252342 secs 2024-04-26T19:10:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:39 smithi092 ceph-mon[29156]: pgmap v2300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:41 smithi189 ceph-mon[32756]: pgmap v2301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:41 smithi156 ceph-mon[32679]: pgmap v2301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:41 smithi092 ceph-mon[29156]: pgmap v2301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:43 smithi189 ceph-mon[32756]: pgmap v2302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:43 smithi156 ceph-mon[32679]: pgmap v2302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:43 smithi092 ceph-mon[29156]: pgmap v2302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3139.266699 secs 2024-04-26T19:10:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2442.252426 secs 2024-04-26T19:10:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3139.266699 secs 2024-04-26T19:10:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2442.252426 secs 2024-04-26T19:10:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3139.266699 secs 2024-04-26T19:10:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2442.252426 secs 2024-04-26T19:10:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:45 smithi189 ceph-mon[32756]: pgmap v2303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:45 smithi156 ceph-mon[32679]: pgmap v2303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:45 smithi092 ceph-mon[29156]: pgmap v2303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:47 smithi189 ceph-mon[32756]: pgmap v2304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:47 smithi156 ceph-mon[32679]: pgmap v2304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:47 smithi092 ceph-mon[29156]: pgmap v2304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3144.266805 secs 2024-04-26T19:10:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3144.266805 secs 2024-04-26T19:10:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3144.266805 secs 2024-04-26T19:10:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2447.252510 secs 2024-04-26T19:10:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2447.252510 secs 2024-04-26T19:10:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2447.252510 secs 2024-04-26T19:10:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:50 smithi189 ceph-mon[32756]: pgmap v2305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:50 smithi156 ceph-mon[32679]: pgmap v2305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:50 smithi092 ceph-mon[29156]: pgmap v2305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:52 smithi092 ceph-mon[29156]: pgmap v2306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:52 smithi189 ceph-mon[32756]: pgmap v2306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:52 smithi156 ceph-mon[32679]: pgmap v2306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3149.266907 secs 2024-04-26T19:10:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3149.266907 secs 2024-04-26T19:10:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3149.266907 secs 2024-04-26T19:10:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:54 smithi189 ceph-mon[32756]: pgmap v2307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2452.252629 secs 2024-04-26T19:10:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:54 smithi156 ceph-mon[32679]: pgmap v2307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2452.252629 secs 2024-04-26T19:10:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:54 smithi092 ceph-mon[29156]: pgmap v2307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2452.252629 secs 2024-04-26T19:10:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:56 smithi189 ceph-mon[32756]: pgmap v2308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:56 smithi156 ceph-mon[32679]: pgmap v2308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:56 smithi092 ceph-mon[29156]: pgmap v2308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:10:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:58 smithi189 ceph-mon[32756]: pgmap v2309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3154.266987 secs 2024-04-26T19:10:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:10:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2457.252691 secs 2024-04-26T19:10:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:58 smithi156 ceph-mon[32679]: pgmap v2309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3154.266987 secs 2024-04-26T19:10:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:10:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2457.252691 secs 2024-04-26T19:10:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:58 smithi092 ceph-mon[29156]: pgmap v2309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:10:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3154.266987 secs 2024-04-26T19:10:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:10:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2457.252691 secs 2024-04-26T19:11:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:00 smithi189 ceph-mon[32756]: pgmap v2310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:00 smithi156 ceph-mon[32679]: pgmap v2310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:00 smithi092 ceph-mon[29156]: pgmap v2310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:02 smithi189 ceph-mon[32756]: pgmap v2311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:02 smithi156 ceph-mon[32679]: pgmap v2311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:02 smithi092 ceph-mon[29156]: pgmap v2311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3159.267073 secs 2024-04-26T19:11:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2462.252755 secs 2024-04-26T19:11:04.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3159.267073 secs 2024-04-26T19:11:04.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2462.252755 secs 2024-04-26T19:11:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3159.267073 secs 2024-04-26T19:11:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2462.252755 secs 2024-04-26T19:11:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:04 smithi189 ceph-mon[32756]: pgmap v2312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:04 smithi156 ceph-mon[32679]: pgmap v2312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:04 smithi092 ceph-mon[29156]: pgmap v2312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:06 smithi189 ceph-mon[32756]: pgmap v2313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:06 smithi156 ceph-mon[32679]: pgmap v2313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:06 smithi092 ceph-mon[29156]: pgmap v2313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:08 smithi092 ceph-mon[29156]: pgmap v2314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3164.267188 secs 2024-04-26T19:11:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2467.252828 secs 2024-04-26T19:11:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:08 smithi189 ceph-mon[32756]: pgmap v2314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3164.267188 secs 2024-04-26T19:11:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2467.252828 secs 2024-04-26T19:11:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:08 smithi156 ceph-mon[32679]: pgmap v2314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3164.267188 secs 2024-04-26T19:11:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2467.252828 secs 2024-04-26T19:11:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:10 smithi189 ceph-mon[32756]: pgmap v2315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:10 smithi156 ceph-mon[32679]: pgmap v2315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:10 smithi092 ceph-mon[29156]: pgmap v2315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:12 smithi189 ceph-mon[32756]: pgmap v2316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:12 smithi156 ceph-mon[32679]: pgmap v2316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:12 smithi092 ceph-mon[29156]: pgmap v2316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3169.267259 secs 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2472.252915 secs 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3169.267259 secs 2024-04-26T19:11:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2472.252915 secs 2024-04-26T19:11:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:11:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3169.267259 secs 2024-04-26T19:11:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2472.252915 secs 2024-04-26T19:11:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:14 smithi189 ceph-mon[32756]: pgmap v2317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:14 smithi156 ceph-mon[32679]: pgmap v2317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:14 smithi092 ceph-mon[29156]: pgmap v2317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: pgmap v2318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: pgmap v2318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: pgmap v2318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:11:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: pgmap v2319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:17 smithi092 ceph-mon[29156]: pgmap v2320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: pgmap v2319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:17 smithi189 ceph-mon[32756]: pgmap v2320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:11:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: pgmap v2319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:17 smithi156 ceph-mon[32679]: pgmap v2320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3174.267383 secs 2024-04-26T19:11:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2477.253034 secs 2024-04-26T19:11:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3174.267383 secs 2024-04-26T19:11:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2477.253034 secs 2024-04-26T19:11:19.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3174.267383 secs 2024-04-26T19:11:19.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2477.253034 secs 2024-04-26T19:11:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:19 smithi092 ceph-mon[29156]: pgmap v2321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:19 smithi189 ceph-mon[32756]: pgmap v2321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:19 smithi156 ceph-mon[32679]: pgmap v2321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:21 smithi092 ceph-mon[29156]: pgmap v2322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:21 smithi189 ceph-mon[32756]: pgmap v2322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:21 smithi156 ceph-mon[32679]: pgmap v2322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:23 smithi092 ceph-mon[29156]: pgmap v2323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3179.267498 secs 2024-04-26T19:11:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2482.253157 secs 2024-04-26T19:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:23 smithi189 ceph-mon[32756]: pgmap v2323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3179.267498 secs 2024-04-26T19:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2482.253157 secs 2024-04-26T19:11:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:23 smithi156 ceph-mon[32679]: pgmap v2323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3179.267498 secs 2024-04-26T19:11:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2482.253157 secs 2024-04-26T19:11:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:25 smithi092 ceph-mon[29156]: pgmap v2324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:25 smithi189 ceph-mon[32756]: pgmap v2324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:25 smithi156 ceph-mon[32679]: pgmap v2324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:11:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:27 smithi092 ceph-mon[29156]: pgmap v2325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:11:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:27 smithi189 ceph-mon[32756]: pgmap v2325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:11:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:27 smithi156 ceph-mon[32679]: pgmap v2325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:11:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3184.267613 secs 2024-04-26T19:11:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2487.253280 secs 2024-04-26T19:11:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3184.267613 secs 2024-04-26T19:11:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2487.253280 secs 2024-04-26T19:11:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3184.267613 secs 2024-04-26T19:11:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2487.253280 secs 2024-04-26T19:11:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:29 smithi092 ceph-mon[29156]: pgmap v2326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:29 smithi189 ceph-mon[32756]: pgmap v2326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:29 smithi156 ceph-mon[32679]: pgmap v2326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-mon[29156]: pgmap v2327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:32.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:11:31.815+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:11:32.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:11:31.815+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:11:32.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:11:31.815+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:11:32.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:11:31.815+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:11:32.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:11:31 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:11:31.815+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:11:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:31 smithi189 ceph-mon[32756]: pgmap v2327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:32.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:31 smithi156 ceph-mon[32679]: pgmap v2327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:33 smithi092 ceph-mon[29156]: pgmap v2328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3189.267679 secs 2024-04-26T19:11:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2492.253421 secs 2024-04-26T19:11:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:33 smithi189 ceph-mon[32756]: pgmap v2328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3189.267679 secs 2024-04-26T19:11:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2492.253421 secs 2024-04-26T19:11:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:33 smithi156 ceph-mon[32679]: pgmap v2328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3189.267679 secs 2024-04-26T19:11:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2492.253421 secs 2024-04-26T19:11:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:35 smithi092 ceph-mon[29156]: pgmap v2329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:35 smithi189 ceph-mon[32756]: pgmap v2329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:35 smithi156 ceph-mon[32679]: pgmap v2329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:37 smithi092 ceph-mon[29156]: pgmap v2330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:37 smithi189 ceph-mon[32756]: pgmap v2330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:37 smithi156 ceph-mon[32679]: pgmap v2330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3194.267757 secs 2024-04-26T19:11:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2497.253496 secs 2024-04-26T19:11:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3194.267757 secs 2024-04-26T19:11:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2497.253496 secs 2024-04-26T19:11:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3194.267757 secs 2024-04-26T19:11:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2497.253496 secs 2024-04-26T19:11:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:39 smithi092 ceph-mon[29156]: pgmap v2331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:39 smithi189 ceph-mon[32756]: pgmap v2331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:39 smithi156 ceph-mon[32679]: pgmap v2331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:42 smithi189 ceph-mon[32756]: pgmap v2332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:42 smithi156 ceph-mon[32679]: pgmap v2332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:42 smithi092 ceph-mon[29156]: pgmap v2332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:44 smithi189 ceph-mon[32756]: pgmap v2333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3199.267874 secs 2024-04-26T19:11:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2502.253618 secs 2024-04-26T19:11:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:44 smithi156 ceph-mon[32679]: pgmap v2333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3199.267874 secs 2024-04-26T19:11:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2502.253618 secs 2024-04-26T19:11:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:44 smithi092 ceph-mon[29156]: pgmap v2333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:11:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3199.267874 secs 2024-04-26T19:11:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2502.253618 secs 2024-04-26T19:11:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:46 smithi189 ceph-mon[32756]: pgmap v2334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:46 smithi156 ceph-mon[32679]: pgmap v2334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:46 smithi092 ceph-mon[29156]: pgmap v2334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:11:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:48 smithi189 ceph-mon[32756]: pgmap v2335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:48 smithi156 ceph-mon[32679]: pgmap v2335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:48 smithi092 ceph-mon[29156]: pgmap v2335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:49.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3204.267993 secs 2024-04-26T19:11:49.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2507.253731 secs 2024-04-26T19:11:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3204.267993 secs 2024-04-26T19:11:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2507.253731 secs 2024-04-26T19:11:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3204.267993 secs 2024-04-26T19:11:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2507.253731 secs 2024-04-26T19:11:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:50 smithi189 ceph-mon[32756]: pgmap v2336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:50 smithi156 ceph-mon[32679]: pgmap v2336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:50 smithi092 ceph-mon[29156]: pgmap v2336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:52 smithi189 ceph-mon[32756]: pgmap v2337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:52 smithi156 ceph-mon[32679]: pgmap v2337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:52 smithi092 ceph-mon[29156]: pgmap v2337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:54 smithi189 ceph-mon[32756]: pgmap v2338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3209.268130 secs 2024-04-26T19:11:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2512.253849 secs 2024-04-26T19:11:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:54 smithi156 ceph-mon[32679]: pgmap v2338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3209.268130 secs 2024-04-26T19:11:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2512.253849 secs 2024-04-26T19:11:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:54 smithi092 ceph-mon[29156]: pgmap v2338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3209.268130 secs 2024-04-26T19:11:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2512.253849 secs 2024-04-26T19:11:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:56 smithi189 ceph-mon[32756]: pgmap v2339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:56 smithi156 ceph-mon[32679]: pgmap v2339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:56 smithi092 ceph-mon[29156]: pgmap v2339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:11:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:58 smithi189 ceph-mon[32756]: pgmap v2340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:58 smithi156 ceph-mon[32679]: pgmap v2340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:58 smithi092 ceph-mon[29156]: pgmap v2340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:11:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3214.268248 secs 2024-04-26T19:11:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:11:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2517.253954 secs 2024-04-26T19:11:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3214.268248 secs 2024-04-26T19:11:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:11:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2517.253954 secs 2024-04-26T19:11:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3214.268248 secs 2024-04-26T19:11:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:11:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2517.253954 secs 2024-04-26T19:12:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:00 smithi189 ceph-mon[32756]: pgmap v2341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:00 smithi156 ceph-mon[32679]: pgmap v2341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:00 smithi092 ceph-mon[29156]: pgmap v2341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:02 smithi189 ceph-mon[32756]: pgmap v2342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:02 smithi156 ceph-mon[32679]: pgmap v2342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:02 smithi092 ceph-mon[29156]: pgmap v2342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:03 smithi189 ceph-mon[32756]: pgmap v2343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:03 smithi156 ceph-mon[32679]: pgmap v2343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:03 smithi092 ceph-mon[29156]: pgmap v2343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3219.268371 secs 2024-04-26T19:12:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2522.254083 secs 2024-04-26T19:12:04.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3219.268371 secs 2024-04-26T19:12:04.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2522.254083 secs 2024-04-26T19:12:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3219.268371 secs 2024-04-26T19:12:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2522.254083 secs 2024-04-26T19:12:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:05 smithi189 ceph-mon[32756]: pgmap v2344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:05 smithi156 ceph-mon[32679]: pgmap v2344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:05 smithi092 ceph-mon[29156]: pgmap v2344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:07 smithi189 ceph-mon[32756]: pgmap v2345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:07 smithi156 ceph-mon[32679]: pgmap v2345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:07 smithi092 ceph-mon[29156]: pgmap v2345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3224.268470 secs 2024-04-26T19:12:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2527.254201 secs 2024-04-26T19:12:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:09 smithi189 ceph-mon[32756]: pgmap v2346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3224.268470 secs 2024-04-26T19:12:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2527.254201 secs 2024-04-26T19:12:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:09 smithi156 ceph-mon[32679]: pgmap v2346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3224.268470 secs 2024-04-26T19:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2527.254201 secs 2024-04-26T19:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:09 smithi092 ceph-mon[29156]: pgmap v2346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:11 smithi189 ceph-mon[32756]: pgmap v2347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:11 smithi156 ceph-mon[32679]: pgmap v2347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:11 smithi092 ceph-mon[29156]: pgmap v2347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:13 smithi189 ceph-mon[32756]: pgmap v2348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:13 smithi156 ceph-mon[32679]: pgmap v2348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:13 smithi092 ceph-mon[29156]: pgmap v2348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3229.268597 secs 2024-04-26T19:12:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2532.254352 secs 2024-04-26T19:12:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3229.268597 secs 2024-04-26T19:12:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2532.254352 secs 2024-04-26T19:12:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3229.268597 secs 2024-04-26T19:12:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2532.254352 secs 2024-04-26T19:12:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:15 smithi189 ceph-mon[32756]: pgmap v2349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:15 smithi156 ceph-mon[32679]: pgmap v2349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:15 smithi092 ceph-mon[29156]: pgmap v2349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:17 smithi189 ceph-mon[32756]: pgmap v2350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:17 smithi156 ceph-mon[32679]: pgmap v2350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:17 smithi092 ceph-mon[29156]: pgmap v2350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:12:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:18 smithi189 ceph-mon[32756]: pgmap v2351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:18 smithi189 ceph-mon[32756]: pgmap v2352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:18 smithi156 ceph-mon[32679]: pgmap v2351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:12:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:18 smithi156 ceph-mon[32679]: pgmap v2352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:18 smithi092 ceph-mon[29156]: pgmap v2351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:12:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:18 smithi092 ceph-mon[29156]: pgmap v2352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3234.268717 secs 2024-04-26T19:12:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2537.254462 secs 2024-04-26T19:12:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3234.268717 secs 2024-04-26T19:12:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2537.254462 secs 2024-04-26T19:12:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3234.268717 secs 2024-04-26T19:12:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2537.254462 secs 2024-04-26T19:12:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:20 smithi189 ceph-mon[32756]: pgmap v2353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:20 smithi156 ceph-mon[32679]: pgmap v2353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:20 smithi092 ceph-mon[29156]: pgmap v2353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:22 smithi189 ceph-mon[32756]: pgmap v2354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:22 smithi156 ceph-mon[32679]: pgmap v2354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:22 smithi092 ceph-mon[29156]: pgmap v2354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3239.268841 secs 2024-04-26T19:12:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:24 smithi189 ceph-mon[32756]: pgmap v2355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2542.254574 secs 2024-04-26T19:12:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3239.268841 secs 2024-04-26T19:12:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:24 smithi156 ceph-mon[32679]: pgmap v2355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2542.254574 secs 2024-04-26T19:12:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3239.268841 secs 2024-04-26T19:12:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:24 smithi092 ceph-mon[29156]: pgmap v2355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:12:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2542.254574 secs 2024-04-26T19:12:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:26 smithi189 ceph-mon[32756]: pgmap v2356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:26 smithi156 ceph-mon[32679]: pgmap v2356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:26 smithi092 ceph-mon[29156]: pgmap v2356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:12:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:28 smithi189 ceph-mon[32756]: pgmap v2357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:12:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:28 smithi156 ceph-mon[32679]: pgmap v2357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:12:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:28 smithi092 ceph-mon[29156]: pgmap v2357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:12:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3244.268961 secs 2024-04-26T19:12:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2547.254712 secs 2024-04-26T19:12:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3244.268961 secs 2024-04-26T19:12:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2547.254712 secs 2024-04-26T19:12:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3244.268961 secs 2024-04-26T19:12:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2547.254712 secs 2024-04-26T19:12:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:30 smithi189 ceph-mon[32756]: pgmap v2358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:30 smithi156 ceph-mon[32679]: pgmap v2358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:30 smithi092 ceph-mon[29156]: pgmap v2358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:32 smithi189 ceph-mon[32756]: pgmap v2359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:32 smithi156 ceph-mon[32679]: pgmap v2359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:32 smithi092 ceph-mon[29156]: pgmap v2359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3249.269084 secs 2024-04-26T19:12:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:34 smithi156 ceph-mon[32679]: pgmap v2360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2552.254831 secs 2024-04-26T19:12:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3249.269084 secs 2024-04-26T19:12:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:34 smithi092 ceph-mon[29156]: pgmap v2360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2552.254831 secs 2024-04-26T19:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3249.269084 secs 2024-04-26T19:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:34 smithi189 ceph-mon[32756]: pgmap v2360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2552.254831 secs 2024-04-26T19:12:36.421 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:12:36.421+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:12:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:12:36.421+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:12:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:12:36.421+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:12:36.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:12:36.421+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 29 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:12:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:36 smithi156 ceph-mon[32679]: pgmap v2361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:36 smithi092 ceph-mon[29156]: pgmap v2361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:36 smithi189 ceph-mon[32756]: pgmap v2361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:38 smithi156 ceph-mon[32679]: pgmap v2362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:38 smithi092 ceph-mon[29156]: pgmap v2362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:38 smithi189 ceph-mon[32756]: pgmap v2362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3254.269201 secs 2024-04-26T19:12:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2557.254947 secs 2024-04-26T19:12:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3254.269201 secs 2024-04-26T19:12:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2557.254947 secs 2024-04-26T19:12:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3254.269201 secs 2024-04-26T19:12:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2557.254947 secs 2024-04-26T19:12:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:40 smithi156 ceph-mon[32679]: pgmap v2363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:40 smithi092 ceph-mon[29156]: pgmap v2363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:40 smithi189 ceph-mon[32756]: pgmap v2363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:42 smithi156 ceph-mon[32679]: pgmap v2364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:42 smithi092 ceph-mon[29156]: pgmap v2364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:42 smithi189 ceph-mon[32756]: pgmap v2364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3259.269337 secs 2024-04-26T19:12:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:44 smithi156 ceph-mon[32679]: pgmap v2365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2562.255079 secs 2024-04-26T19:12:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3259.269337 secs 2024-04-26T19:12:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:44 smithi092 ceph-mon[29156]: pgmap v2365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2562.255079 secs 2024-04-26T19:12:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3259.269337 secs 2024-04-26T19:12:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:44 smithi189 ceph-mon[32756]: pgmap v2365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2562.255079 secs 2024-04-26T19:12:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:46 smithi156 ceph-mon[32679]: pgmap v2366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:46 smithi092 ceph-mon[29156]: pgmap v2366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:46 smithi189 ceph-mon[32756]: pgmap v2366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:48 smithi156 ceph-mon[32679]: pgmap v2367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:48 smithi092 ceph-mon[29156]: pgmap v2367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:48 smithi189 ceph-mon[32756]: pgmap v2367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3264.269456 secs 2024-04-26T19:12:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2567.255166 secs 2024-04-26T19:12:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3264.269456 secs 2024-04-26T19:12:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2567.255166 secs 2024-04-26T19:12:50.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3264.269456 secs 2024-04-26T19:12:50.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2567.255166 secs 2024-04-26T19:12:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:50 smithi156 ceph-mon[32679]: pgmap v2368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:50 smithi092 ceph-mon[29156]: pgmap v2368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:51.051 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:50 smithi189 ceph-mon[32756]: pgmap v2368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:52 smithi156 ceph-mon[32679]: pgmap v2369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:52 smithi092 ceph-mon[29156]: pgmap v2369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:52 smithi189 ceph-mon[32756]: pgmap v2369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3269.269595 secs 2024-04-26T19:12:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:54 smithi156 ceph-mon[32679]: pgmap v2370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2572.255288 secs 2024-04-26T19:12:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3269.269595 secs 2024-04-26T19:12:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:54 smithi092 ceph-mon[29156]: pgmap v2370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2572.255288 secs 2024-04-26T19:12:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3269.269595 secs 2024-04-26T19:12:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:54 smithi189 ceph-mon[32756]: pgmap v2370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2572.255288 secs 2024-04-26T19:12:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:56 smithi092 ceph-mon[29156]: pgmap v2371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:56 smithi189 ceph-mon[32756]: pgmap v2371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:56 smithi156 ceph-mon[32679]: pgmap v2371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:12:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:58 smithi092 ceph-mon[29156]: pgmap v2372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:58 smithi189 ceph-mon[32756]: pgmap v2372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:59.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:58 smithi156 ceph-mon[32679]: pgmap v2372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:12:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3274.269708 secs 2024-04-26T19:12:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:12:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2577.255433 secs 2024-04-26T19:13:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3274.269708 secs 2024-04-26T19:13:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:12:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2577.255433 secs 2024-04-26T19:13:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3274.269708 secs 2024-04-26T19:13:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:12:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2577.255433 secs 2024-04-26T19:13:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:00 smithi092 ceph-mon[29156]: pgmap v2373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:00 smithi189 ceph-mon[32756]: pgmap v2373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:00 smithi156 ceph-mon[32679]: pgmap v2373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:02 smithi092 ceph-mon[29156]: pgmap v2374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:02 smithi189 ceph-mon[32756]: pgmap v2374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:02 smithi156 ceph-mon[32679]: pgmap v2374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 3279.269820 secs 2024-04-26T19:13:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:04 smithi092 ceph-mon[29156]: slow request 721.525939 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:13:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:04 smithi092 ceph-mon[29156]: pgmap v2375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2582.255578 secs 2024-04-26T19:13:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 3279.269820 secs 2024-04-26T19:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:04 smithi189 ceph-mon[32756]: slow request 721.525939 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:04 smithi189 ceph-mon[32756]: pgmap v2375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2582.255578 secs 2024-04-26T19:13:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 3279.269820 secs 2024-04-26T19:13:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:04 smithi156 ceph-mon[32679]: slow request 721.525939 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:13:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:04 smithi156 ceph-mon[32679]: pgmap v2375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2582.255578 secs 2024-04-26T19:13:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:06 smithi092 ceph-mon[29156]: pgmap v2376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:06 smithi189 ceph-mon[32756]: pgmap v2376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:06 smithi156 ceph-mon[32679]: pgmap v2376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:08 smithi092 ceph-mon[29156]: pgmap v2377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:08 smithi189 ceph-mon[32756]: pgmap v2377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:08 smithi156 ceph-mon[32679]: pgmap v2377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3284.269938 secs 2024-04-26T19:13:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2587.255717 secs 2024-04-26T19:13:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3284.269938 secs 2024-04-26T19:13:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2587.255717 secs 2024-04-26T19:13:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3284.269938 secs 2024-04-26T19:13:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2587.255717 secs 2024-04-26T19:13:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:10 smithi092 ceph-mon[29156]: pgmap v2378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:10 smithi189 ceph-mon[32756]: pgmap v2378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:10 smithi156 ceph-mon[32679]: pgmap v2378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:12.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:12 smithi092 ceph-mon[29156]: pgmap v2379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:12 smithi189 ceph-mon[32756]: pgmap v2379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:12 smithi156 ceph-mon[32679]: pgmap v2379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3289.270004 secs 2024-04-26T19:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:14 smithi092 ceph-mon[29156]: pgmap v2380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2592.255846 secs 2024-04-26T19:13:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3289.270004 secs 2024-04-26T19:13:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:14 smithi189 ceph-mon[32756]: pgmap v2380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2592.255846 secs 2024-04-26T19:13:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3289.270004 secs 2024-04-26T19:13:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:14 smithi156 ceph-mon[32679]: pgmap v2380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2592.255846 secs 2024-04-26T19:13:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:16 smithi092 ceph-mon[29156]: pgmap v2381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:16 smithi189 ceph-mon[32756]: pgmap v2381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:16 smithi156 ceph-mon[32679]: pgmap v2381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:18.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:13:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:18 smithi092 ceph-mon[29156]: pgmap v2382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:13:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:18 smithi189 ceph-mon[32756]: pgmap v2382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:13:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:18 smithi156 ceph-mon[32679]: pgmap v2382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:13:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:13:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:13:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:19 smithi092 ceph-mon[29156]: pgmap v2383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:13:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:19 smithi092 ceph-mon[29156]: pgmap v2384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:13:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3294.270085 secs 2024-04-26T19:13:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2597.255908 secs 2024-04-26T19:13:20.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:19 smithi189 ceph-mon[32756]: pgmap v2383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:13:20.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:19 smithi189 ceph-mon[32756]: pgmap v2384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:13:20.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3294.270085 secs 2024-04-26T19:13:20.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2597.255908 secs 2024-04-26T19:13:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:19 smithi156 ceph-mon[32679]: pgmap v2383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:13:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:19 smithi156 ceph-mon[32679]: pgmap v2384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:13:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3294.270085 secs 2024-04-26T19:13:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2597.255908 secs 2024-04-26T19:13:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:21 smithi189 ceph-mon[32756]: pgmap v2385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:21 smithi156 ceph-mon[32679]: pgmap v2385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:21 smithi092 ceph-mon[29156]: pgmap v2385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:23 smithi189 ceph-mon[32756]: pgmap v2386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3299.270197 secs 2024-04-26T19:13:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:23 smithi156 ceph-mon[32679]: pgmap v2386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3299.270197 secs 2024-04-26T19:13:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:23 smithi092 ceph-mon[29156]: pgmap v2386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3299.270197 secs 2024-04-26T19:13:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2602.256042 secs 2024-04-26T19:13:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2602.256042 secs 2024-04-26T19:13:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2602.256042 secs 2024-04-26T19:13:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:25 smithi189 ceph-mon[32756]: pgmap v2387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:25 smithi156 ceph-mon[32679]: pgmap v2387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:25 smithi092 ceph-mon[29156]: pgmap v2387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:27 smithi189 ceph-mon[32756]: pgmap v2388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:27 smithi156 ceph-mon[32679]: pgmap v2388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:27 smithi092 ceph-mon[29156]: pgmap v2388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:13:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3304.270290 secs 2024-04-26T19:13:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3304.270290 secs 2024-04-26T19:13:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3304.270290 secs 2024-04-26T19:13:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:29 smithi189 ceph-mon[32756]: pgmap v2389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:13:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2607.256169 secs 2024-04-26T19:13:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:29 smithi156 ceph-mon[32679]: pgmap v2389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:13:30.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2607.256169 secs 2024-04-26T19:13:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:29 smithi092 ceph-mon[29156]: pgmap v2389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:13:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2607.256169 secs 2024-04-26T19:13:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:31 smithi189 ceph-mon[32756]: pgmap v2390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:31 smithi156 ceph-mon[32679]: pgmap v2390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:31 smithi092 ceph-mon[29156]: pgmap v2390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:34.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:33 smithi092 ceph-mon[29156]: pgmap v2391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:34.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3309.270389 secs 2024-04-26T19:13:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:33 smithi189 ceph-mon[32756]: pgmap v2391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3309.270389 secs 2024-04-26T19:13:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:33 smithi156 ceph-mon[32679]: pgmap v2391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3309.270389 secs 2024-04-26T19:13:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2612.256285 secs 2024-04-26T19:13:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2612.256285 secs 2024-04-26T19:13:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2612.256285 secs 2024-04-26T19:13:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:35 smithi189 ceph-mon[32756]: pgmap v2392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:35 smithi156 ceph-mon[32679]: pgmap v2392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:35 smithi092 ceph-mon[29156]: pgmap v2392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:37 smithi189 ceph-mon[32756]: pgmap v2393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:38.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:37 smithi156 ceph-mon[32679]: pgmap v2393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:37 smithi092 ceph-mon[29156]: pgmap v2393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3314.270527 secs 2024-04-26T19:13:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3314.270527 secs 2024-04-26T19:13:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3314.270527 secs 2024-04-26T19:13:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:39 smithi189 ceph-mon[32756]: pgmap v2394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2617.256402 secs 2024-04-26T19:13:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:39 smithi156 ceph-mon[32679]: pgmap v2394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2617.256402 secs 2024-04-26T19:13:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:39 smithi092 ceph-mon[29156]: pgmap v2394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2617.256402 secs 2024-04-26T19:13:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:41 smithi189 ceph-mon[32756]: pgmap v2395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:41 smithi156 ceph-mon[32679]: pgmap v2395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:41 smithi092 ceph-mon[29156]: pgmap v2395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:43 smithi092 ceph-mon[29156]: pgmap v2396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3319.270644 secs 2024-04-26T19:13:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:43 smithi189 ceph-mon[32756]: pgmap v2396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3319.270644 secs 2024-04-26T19:13:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:43 smithi156 ceph-mon[32679]: pgmap v2396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3319.270644 secs 2024-04-26T19:13:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2622.256528 secs 2024-04-26T19:13:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2622.256528 secs 2024-04-26T19:13:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2622.256528 secs 2024-04-26T19:13:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:45 smithi189 ceph-mon[32756]: pgmap v2397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:45 smithi156 ceph-mon[32679]: pgmap v2397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:45 smithi092 ceph-mon[29156]: pgmap v2397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:47 smithi189 ceph-mon[32756]: pgmap v2398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:47 smithi156 ceph-mon[32679]: pgmap v2398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:47 smithi092 ceph-mon[29156]: pgmap v2398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:49.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3324.270769 secs 2024-04-26T19:13:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3324.270769 secs 2024-04-26T19:13:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3324.270769 secs 2024-04-26T19:13:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:49 smithi189 ceph-mon[32756]: pgmap v2399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2627.256620 secs 2024-04-26T19:13:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:49 smithi156 ceph-mon[32679]: pgmap v2399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2627.256620 secs 2024-04-26T19:13:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:49 smithi092 ceph-mon[29156]: pgmap v2399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2627.256620 secs 2024-04-26T19:13:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:51 smithi189 ceph-mon[32756]: pgmap v2400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:51 smithi156 ceph-mon[32679]: pgmap v2400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:51 smithi092 ceph-mon[29156]: pgmap v2400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:53 smithi189 ceph-mon[32756]: pgmap v2401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3329.270904 secs 2024-04-26T19:13:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2632.256716 secs 2024-04-26T19:13:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:53 smithi156 ceph-mon[32679]: pgmap v2401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3329.270904 secs 2024-04-26T19:13:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2632.256716 secs 2024-04-26T19:13:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:53 smithi092 ceph-mon[29156]: pgmap v2401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3329.270904 secs 2024-04-26T19:13:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2632.256716 secs 2024-04-26T19:13:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:55 smithi189 ceph-mon[32756]: pgmap v2402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:55 smithi156 ceph-mon[32679]: pgmap v2402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:55 smithi092 ceph-mon[29156]: pgmap v2402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:13:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:57 smithi189 ceph-mon[32756]: pgmap v2403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:57 smithi156 ceph-mon[32679]: pgmap v2403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:57 smithi092 ceph-mon[29156]: pgmap v2403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:13:59.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3334.270992 secs 2024-04-26T19:13:59.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2637.256832 secs 2024-04-26T19:13:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3334.270992 secs 2024-04-26T19:13:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2637.256832 secs 2024-04-26T19:13:59.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3334.270992 secs 2024-04-26T19:13:59.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2637.256832 secs 2024-04-26T19:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:13:59 smithi092 ceph-mon[29156]: pgmap v2404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:13:59 smithi189 ceph-mon[32756]: pgmap v2404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:13:59 smithi156 ceph-mon[32679]: pgmap v2404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:01 smithi189 ceph-mon[32756]: pgmap v2405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:01 smithi156 ceph-mon[32679]: pgmap v2405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:01 smithi092 ceph-mon[29156]: pgmap v2405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:03 smithi189 ceph-mon[32756]: pgmap v2406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3339.271104 secs 2024-04-26T19:14:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2642.256941 secs 2024-04-26T19:14:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:03 smithi156 ceph-mon[32679]: pgmap v2406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3339.271104 secs 2024-04-26T19:14:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2642.256941 secs 2024-04-26T19:14:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:03 smithi092 ceph-mon[29156]: pgmap v2406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3339.271104 secs 2024-04-26T19:14:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2642.256941 secs 2024-04-26T19:14:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:05 smithi189 ceph-mon[32756]: pgmap v2407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:05 smithi156 ceph-mon[32679]: pgmap v2407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:05 smithi092 ceph-mon[29156]: pgmap v2407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:07 smithi189 ceph-mon[32756]: pgmap v2408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:07 smithi156 ceph-mon[32679]: pgmap v2408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:07 smithi092 ceph-mon[29156]: pgmap v2408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3344.271171 secs 2024-04-26T19:14:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2647.257104 secs 2024-04-26T19:14:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3344.271171 secs 2024-04-26T19:14:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2647.257104 secs 2024-04-26T19:14:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3344.271171 secs 2024-04-26T19:14:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2647.257104 secs 2024-04-26T19:14:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:09 smithi189 ceph-mon[32756]: pgmap v2409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:09 smithi156 ceph-mon[32679]: pgmap v2409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:09 smithi092 ceph-mon[29156]: pgmap v2409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:11 smithi189 ceph-mon[32756]: pgmap v2410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:12.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:11 smithi156 ceph-mon[32679]: pgmap v2410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:11 smithi092 ceph-mon[29156]: pgmap v2410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:13 smithi189 ceph-mon[32756]: pgmap v2411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3349.271290 secs 2024-04-26T19:14:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2652.257215 secs 2024-04-26T19:14:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:13 smithi156 ceph-mon[32679]: pgmap v2411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3349.271290 secs 2024-04-26T19:14:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2652.257215 secs 2024-04-26T19:14:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:13 smithi092 ceph-mon[29156]: pgmap v2411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3349.271290 secs 2024-04-26T19:14:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2652.257215 secs 2024-04-26T19:14:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:15 smithi189 ceph-mon[32756]: pgmap v2412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:15 smithi156 ceph-mon[32679]: pgmap v2412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:15 smithi092 ceph-mon[29156]: pgmap v2412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:17 smithi189 ceph-mon[32756]: pgmap v2413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:17 smithi156 ceph-mon[32679]: pgmap v2413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:17 smithi092 ceph-mon[29156]: pgmap v2413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3354.271357 secs 2024-04-26T19:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2657.257323 secs 2024-04-26T19:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3354.271357 secs 2024-04-26T19:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2657.257323 secs 2024-04-26T19:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:14:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:14:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3354.271357 secs 2024-04-26T19:14:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2657.257323 secs 2024-04-26T19:14:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:14:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:14:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:14:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:19 smithi189 ceph-mon[32756]: pgmap v2414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:19 smithi189 ceph-mon[32756]: pgmap v2415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:14:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:19 smithi189 ceph-mon[32756]: pgmap v2416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:19 smithi156 ceph-mon[32679]: pgmap v2414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:19 smithi156 ceph-mon[32679]: pgmap v2415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:14:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:19 smithi156 ceph-mon[32679]: pgmap v2416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:19 smithi092 ceph-mon[29156]: pgmap v2414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:19 smithi092 ceph-mon[29156]: pgmap v2415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:14:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:19 smithi092 ceph-mon[29156]: pgmap v2416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:21 smithi189 ceph-mon[32756]: pgmap v2417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:21 smithi156 ceph-mon[32679]: pgmap v2417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:21 smithi092 ceph-mon[29156]: pgmap v2417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:23 smithi156 ceph-mon[32679]: pgmap v2418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:14:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3359.271473 secs 2024-04-26T19:14:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2662.257385 secs 2024-04-26T19:14:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:23 smithi092 ceph-mon[29156]: pgmap v2418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:14:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3359.271473 secs 2024-04-26T19:14:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2662.257385 secs 2024-04-26T19:14:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:23 smithi189 ceph-mon[32756]: pgmap v2418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:14:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3359.271473 secs 2024-04-26T19:14:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2662.257385 secs 2024-04-26T19:14:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:25 smithi156 ceph-mon[32679]: pgmap v2419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:25 smithi092 ceph-mon[29156]: pgmap v2419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:25 smithi189 ceph-mon[32756]: pgmap v2419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:27 smithi156 ceph-mon[32679]: pgmap v2420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:27 smithi092 ceph-mon[29156]: pgmap v2420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:27 smithi189 ceph-mon[32756]: pgmap v2420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:14:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3364.271608 secs 2024-04-26T19:14:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2667.257463 secs 2024-04-26T19:14:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3364.271608 secs 2024-04-26T19:14:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2667.257463 secs 2024-04-26T19:14:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3364.271608 secs 2024-04-26T19:14:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2667.257463 secs 2024-04-26T19:14:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:29 smithi156 ceph-mon[32679]: pgmap v2421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:14:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:29 smithi092 ceph-mon[29156]: pgmap v2421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:14:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:29 smithi189 ceph-mon[32756]: pgmap v2421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:14:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:31 smithi156 ceph-mon[32679]: pgmap v2422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:31 smithi092 ceph-mon[29156]: pgmap v2422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:31 smithi189 ceph-mon[32756]: pgmap v2422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:33 smithi156 ceph-mon[32679]: pgmap v2423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3369.271729 secs 2024-04-26T19:14:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2672.257573 secs 2024-04-26T19:14:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:33 smithi092 ceph-mon[29156]: pgmap v2423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3369.271729 secs 2024-04-26T19:14:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2672.257573 secs 2024-04-26T19:14:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:33 smithi189 ceph-mon[32756]: pgmap v2423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3369.271729 secs 2024-04-26T19:14:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2672.257573 secs 2024-04-26T19:14:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:35 smithi156 ceph-mon[32679]: pgmap v2424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:35 smithi092 ceph-mon[29156]: pgmap v2424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:35 smithi189 ceph-mon[32756]: pgmap v2424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:37 smithi156 ceph-mon[32679]: pgmap v2425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:37 smithi092 ceph-mon[29156]: pgmap v2425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:37 smithi189 ceph-mon[32756]: pgmap v2425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3374.271869 secs 2024-04-26T19:14:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2677.257656 secs 2024-04-26T19:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3374.271869 secs 2024-04-26T19:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2677.257656 secs 2024-04-26T19:14:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3374.271869 secs 2024-04-26T19:14:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2677.257656 secs 2024-04-26T19:14:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:39 smithi156 ceph-mon[32679]: pgmap v2426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:39 smithi092 ceph-mon[29156]: pgmap v2426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:39 smithi189 ceph-mon[32756]: pgmap v2426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:41 smithi156 ceph-mon[32679]: pgmap v2427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:41 smithi092 ceph-mon[29156]: pgmap v2427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:41 smithi189 ceph-mon[32756]: pgmap v2427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:43 smithi092 ceph-mon[29156]: pgmap v2428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3379.271991 secs 2024-04-26T19:14:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2682.257720 secs 2024-04-26T19:14:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:43 smithi189 ceph-mon[32756]: pgmap v2428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3379.271991 secs 2024-04-26T19:14:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2682.257720 secs 2024-04-26T19:14:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:43 smithi156 ceph-mon[32679]: pgmap v2428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3379.271991 secs 2024-04-26T19:14:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2682.257720 secs 2024-04-26T19:14:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:45 smithi092 ceph-mon[29156]: pgmap v2429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:45 smithi189 ceph-mon[32756]: pgmap v2429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:45 smithi156 ceph-mon[32679]: pgmap v2429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:47 smithi092 ceph-mon[29156]: pgmap v2430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:47 smithi189 ceph-mon[32756]: pgmap v2430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:47 smithi156 ceph-mon[32679]: pgmap v2430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3384.272103 secs 2024-04-26T19:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2687.257787 secs 2024-04-26T19:14:49.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3384.272103 secs 2024-04-26T19:14:49.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2687.257787 secs 2024-04-26T19:14:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3384.272103 secs 2024-04-26T19:14:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2687.257787 secs 2024-04-26T19:14:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:49 smithi092 ceph-mon[29156]: pgmap v2431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:50.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:49 smithi189 ceph-mon[32756]: pgmap v2431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:49 smithi156 ceph-mon[32679]: pgmap v2431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:51 smithi092 ceph-mon[29156]: pgmap v2432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:51 smithi189 ceph-mon[32756]: pgmap v2432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:51 smithi156 ceph-mon[32679]: pgmap v2432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:53 smithi092 ceph-mon[29156]: pgmap v2433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3389.272203 secs 2024-04-26T19:14:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2692.257899 secs 2024-04-26T19:14:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:53 smithi189 ceph-mon[32756]: pgmap v2433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3389.272203 secs 2024-04-26T19:14:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2692.257899 secs 2024-04-26T19:14:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:53 smithi156 ceph-mon[32679]: pgmap v2433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3389.272203 secs 2024-04-26T19:14:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2692.257899 secs 2024-04-26T19:14:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:55 smithi092 ceph-mon[29156]: pgmap v2434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:55 smithi189 ceph-mon[32756]: pgmap v2434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:55 smithi156 ceph-mon[32679]: pgmap v2434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:14:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:57 smithi092 ceph-mon[29156]: pgmap v2435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:57 smithi189 ceph-mon[32756]: pgmap v2435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:57 smithi156 ceph-mon[32679]: pgmap v2435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:14:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3394.272345 secs 2024-04-26T19:14:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2697.258021 secs 2024-04-26T19:14:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3394.272345 secs 2024-04-26T19:14:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2697.258021 secs 2024-04-26T19:14:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3394.272345 secs 2024-04-26T19:14:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2697.258021 secs 2024-04-26T19:15:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:14:59 smithi092 ceph-mon[29156]: pgmap v2436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:14:59 smithi189 ceph-mon[32756]: pgmap v2436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:14:59 smithi156 ceph-mon[32679]: pgmap v2436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:01 smithi092 ceph-mon[29156]: pgmap v2437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:01 smithi189 ceph-mon[32756]: pgmap v2437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:01 smithi156 ceph-mon[32679]: pgmap v2437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:03 smithi092 ceph-mon[29156]: pgmap v2438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3399.272459 secs 2024-04-26T19:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 2702.258155 secs 2024-04-26T19:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:03 smithi092 ceph-mon[29156]: slow request 1441.911892 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:03 smithi189 ceph-mon[32756]: pgmap v2438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3399.272459 secs 2024-04-26T19:15:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 2702.258155 secs 2024-04-26T19:15:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:03 smithi189 ceph-mon[32756]: slow request 1441.911892 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:03 smithi156 ceph-mon[32679]: pgmap v2438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3399.272459 secs 2024-04-26T19:15:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 2702.258155 secs 2024-04-26T19:15:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:03 smithi156 ceph-mon[32679]: slow request 1441.911892 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:15:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:05 smithi092 ceph-mon[29156]: pgmap v2439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:05 smithi189 ceph-mon[32756]: pgmap v2439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:05 smithi156 ceph-mon[32679]: pgmap v2439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:07 smithi092 ceph-mon[29156]: pgmap v2440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:07 smithi189 ceph-mon[32756]: pgmap v2440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:07 smithi156 ceph-mon[32679]: pgmap v2440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3404.272575 secs 2024-04-26T19:15:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2707.258272 secs 2024-04-26T19:15:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3404.272575 secs 2024-04-26T19:15:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2707.258272 secs 2024-04-26T19:15:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3404.272575 secs 2024-04-26T19:15:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2707.258272 secs 2024-04-26T19:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:09 smithi092 ceph-mon[29156]: pgmap v2441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:09 smithi189 ceph-mon[32756]: pgmap v2441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:09 smithi156 ceph-mon[32679]: pgmap v2441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:11 smithi092 ceph-mon[29156]: pgmap v2442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:12.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:11 smithi189 ceph-mon[32756]: pgmap v2442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:11 smithi156 ceph-mon[32679]: pgmap v2442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:13 smithi092 ceph-mon[29156]: pgmap v2443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3409.272692 secs 2024-04-26T19:15:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2712.258386 secs 2024-04-26T19:15:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:13 smithi189 ceph-mon[32756]: pgmap v2443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3409.272692 secs 2024-04-26T19:15:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2712.258386 secs 2024-04-26T19:15:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:13 smithi156 ceph-mon[32679]: pgmap v2443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3409.272692 secs 2024-04-26T19:15:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2712.258386 secs 2024-04-26T19:15:16.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:15 smithi189 ceph-mon[32756]: pgmap v2444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:15 smithi156 ceph-mon[32679]: pgmap v2444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:15 smithi092 ceph-mon[29156]: pgmap v2444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:17 smithi189 ceph-mon[32756]: pgmap v2445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:17 smithi156 ceph-mon[32679]: pgmap v2445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:17 smithi092 ceph-mon[29156]: pgmap v2445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:19.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3414.272809 secs 2024-04-26T19:15:19.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2717.258486 secs 2024-04-26T19:15:19.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3414.272809 secs 2024-04-26T19:15:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2717.258486 secs 2024-04-26T19:15:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3414.272809 secs 2024-04-26T19:15:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2717.258486 secs 2024-04-26T19:15:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:15:20.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:20 smithi189 ceph-mon[32756]: pgmap v2446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:20.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:20.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:20.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:15:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:20 smithi156 ceph-mon[32679]: pgmap v2446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:15:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:20 smithi092 ceph-mon[29156]: pgmap v2446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:15:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:15:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:15:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:21 smithi189 ceph-mon[32756]: pgmap v2447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:15:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:21 smithi189 ceph-mon[32756]: pgmap v2448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:21 smithi156 ceph-mon[32679]: pgmap v2447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:15:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:21 smithi156 ceph-mon[32679]: pgmap v2448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:21 smithi092 ceph-mon[29156]: pgmap v2447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:15:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:21 smithi092 ceph-mon[29156]: pgmap v2448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:23 smithi189 ceph-mon[32756]: pgmap v2449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:23 smithi156 ceph-mon[32679]: pgmap v2449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:23 smithi092 ceph-mon[29156]: pgmap v2449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3419.272925 secs 2024-04-26T19:15:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2722.258606 secs 2024-04-26T19:15:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3419.272925 secs 2024-04-26T19:15:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2722.258606 secs 2024-04-26T19:15:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3419.272925 secs 2024-04-26T19:15:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2722.258606 secs 2024-04-26T19:15:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:25 smithi189 ceph-mon[32756]: pgmap v2450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:25 smithi156 ceph-mon[32679]: pgmap v2450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:25 smithi092 ceph-mon[29156]: pgmap v2450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:27 smithi189 ceph-mon[32756]: pgmap v2451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:27 smithi156 ceph-mon[32679]: pgmap v2451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:27 smithi092 ceph-mon[29156]: pgmap v2451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:15:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:29 smithi189 ceph-mon[32756]: pgmap v2452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3424.273043 secs 2024-04-26T19:15:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2727.258718 secs 2024-04-26T19:15:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:29 smithi156 ceph-mon[32679]: pgmap v2452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3424.273043 secs 2024-04-26T19:15:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2727.258718 secs 2024-04-26T19:15:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:29 smithi092 ceph-mon[29156]: pgmap v2452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:15:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3424.273043 secs 2024-04-26T19:15:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2727.258718 secs 2024-04-26T19:15:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:31 smithi189 ceph-mon[32756]: pgmap v2453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:15:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:31 smithi156 ceph-mon[32679]: pgmap v2453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:15:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:31 smithi092 ceph-mon[29156]: pgmap v2453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:15:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:33 smithi092 ceph-mon[29156]: pgmap v2454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:33 smithi189 ceph-mon[32756]: pgmap v2454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:33 smithi156 ceph-mon[32679]: pgmap v2454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3429.273163 secs 2024-04-26T19:15:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2732.258795 secs 2024-04-26T19:15:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3429.273163 secs 2024-04-26T19:15:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2732.258795 secs 2024-04-26T19:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3429.273163 secs 2024-04-26T19:15:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2732.258795 secs 2024-04-26T19:15:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:35 smithi189 ceph-mon[32756]: pgmap v2455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:35 smithi156 ceph-mon[32679]: pgmap v2455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:35 smithi092 ceph-mon[29156]: pgmap v2455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:15:36.446+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:15:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:15:36.446+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:15:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:15:36.446+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:15:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:15:36.446+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 30 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:15:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:37 smithi189 ceph-mon[32756]: pgmap v2456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:37 smithi156 ceph-mon[32679]: pgmap v2456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:37 smithi092 ceph-mon[29156]: pgmap v2456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:39 smithi189 ceph-mon[32756]: pgmap v2457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3434.273282 secs 2024-04-26T19:15:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2737.258939 secs 2024-04-26T19:15:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:39 smithi156 ceph-mon[32679]: pgmap v2457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3434.273282 secs 2024-04-26T19:15:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2737.258939 secs 2024-04-26T19:15:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:39 smithi092 ceph-mon[29156]: pgmap v2457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3434.273282 secs 2024-04-26T19:15:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2737.258939 secs 2024-04-26T19:15:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:41 smithi189 ceph-mon[32756]: pgmap v2458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:41 smithi156 ceph-mon[32679]: pgmap v2458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:41 smithi092 ceph-mon[29156]: pgmap v2458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:43 smithi189 ceph-mon[32756]: pgmap v2459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:43 smithi156 ceph-mon[32679]: pgmap v2459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:43 smithi092 ceph-mon[29156]: pgmap v2459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:15:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3439.273418 secs 2024-04-26T19:15:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2742.259012 secs 2024-04-26T19:15:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3439.273418 secs 2024-04-26T19:15:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2742.259012 secs 2024-04-26T19:15:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3439.273418 secs 2024-04-26T19:15:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2742.259012 secs 2024-04-26T19:15:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:45 smithi189 ceph-mon[32756]: pgmap v2460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:45 smithi156 ceph-mon[32679]: pgmap v2460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:45 smithi092 ceph-mon[29156]: pgmap v2460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:15:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:47 smithi189 ceph-mon[32756]: pgmap v2461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:47 smithi156 ceph-mon[32679]: pgmap v2461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:47 smithi092 ceph-mon[29156]: pgmap v2461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:49 smithi189 ceph-mon[32756]: pgmap v2462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3444.273542 secs 2024-04-26T19:15:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2747.259080 secs 2024-04-26T19:15:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:49 smithi156 ceph-mon[32679]: pgmap v2462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3444.273542 secs 2024-04-26T19:15:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2747.259080 secs 2024-04-26T19:15:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:49 smithi092 ceph-mon[29156]: pgmap v2462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3444.273542 secs 2024-04-26T19:15:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2747.259080 secs 2024-04-26T19:15:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:51 smithi189 ceph-mon[32756]: pgmap v2463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:51 smithi156 ceph-mon[32679]: pgmap v2463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:51 smithi092 ceph-mon[29156]: pgmap v2463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:53 smithi189 ceph-mon[32756]: pgmap v2464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:53 smithi156 ceph-mon[32679]: pgmap v2464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:53 smithi092 ceph-mon[29156]: pgmap v2464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3449.273682 secs 2024-04-26T19:15:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2752.259153 secs 2024-04-26T19:15:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3449.273682 secs 2024-04-26T19:15:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2752.259153 secs 2024-04-26T19:15:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3449.273682 secs 2024-04-26T19:15:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2752.259153 secs 2024-04-26T19:15:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:55 smithi189 ceph-mon[32756]: pgmap v2465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:55 smithi156 ceph-mon[32679]: pgmap v2465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:55 smithi092 ceph-mon[29156]: pgmap v2465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:15:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:56 smithi189 ceph-mon[32756]: pgmap v2466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:56 smithi156 ceph-mon[32679]: pgmap v2466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:56 smithi092 ceph-mon[29156]: pgmap v2466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:58 smithi092 ceph-mon[29156]: pgmap v2467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:58 smithi189 ceph-mon[32756]: pgmap v2467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:58 smithi156 ceph-mon[32679]: pgmap v2467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:15:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3454.273817 secs 2024-04-26T19:15:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:15:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2757.259265 secs 2024-04-26T19:16:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3454.273817 secs 2024-04-26T19:16:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:15:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2757.259265 secs 2024-04-26T19:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3454.273817 secs 2024-04-26T19:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:15:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2757.259265 secs 2024-04-26T19:16:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:00 smithi092 ceph-mon[29156]: pgmap v2468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:00 smithi189 ceph-mon[32756]: pgmap v2468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:00 smithi156 ceph-mon[32679]: pgmap v2468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:02 smithi092 ceph-mon[29156]: pgmap v2469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:02 smithi189 ceph-mon[32756]: pgmap v2469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:02 smithi156 ceph-mon[32679]: pgmap v2469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3459.273878 secs 2024-04-26T19:16:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2762.259396 secs 2024-04-26T19:16:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:04 smithi092 ceph-mon[29156]: pgmap v2470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3459.273878 secs 2024-04-26T19:16:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2762.259396 secs 2024-04-26T19:16:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:04 smithi189 ceph-mon[32756]: pgmap v2470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3459.273878 secs 2024-04-26T19:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2762.259396 secs 2024-04-26T19:16:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:04 smithi156 ceph-mon[32679]: pgmap v2470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:06 smithi189 ceph-mon[32756]: pgmap v2471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:06 smithi156 ceph-mon[32679]: pgmap v2471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:06 smithi092 ceph-mon[29156]: pgmap v2471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:08 smithi092 ceph-mon[29156]: pgmap v2472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:08 smithi189 ceph-mon[32756]: pgmap v2472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:08 smithi156 ceph-mon[32679]: pgmap v2472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3464.273954 secs 2024-04-26T19:16:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2767.259466 secs 2024-04-26T19:16:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3464.273954 secs 2024-04-26T19:16:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2767.259466 secs 2024-04-26T19:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3464.273954 secs 2024-04-26T19:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2767.259466 secs 2024-04-26T19:16:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:10 smithi092 ceph-mon[29156]: pgmap v2473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:10 smithi189 ceph-mon[32756]: pgmap v2473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:10 smithi156 ceph-mon[32679]: pgmap v2473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:12 smithi092 ceph-mon[29156]: pgmap v2474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:12 smithi189 ceph-mon[32756]: pgmap v2474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:12 smithi156 ceph-mon[32679]: pgmap v2474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3469.274028 secs 2024-04-26T19:16:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2772.259552 secs 2024-04-26T19:16:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:14 smithi092 ceph-mon[29156]: pgmap v2475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3469.274028 secs 2024-04-26T19:16:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2772.259552 secs 2024-04-26T19:16:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:14 smithi189 ceph-mon[32756]: pgmap v2475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3469.274028 secs 2024-04-26T19:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2772.259552 secs 2024-04-26T19:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:14 smithi156 ceph-mon[32679]: pgmap v2475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:16 smithi092 ceph-mon[29156]: pgmap v2476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:16 smithi189 ceph-mon[32756]: pgmap v2476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:16 smithi156 ceph-mon[32679]: pgmap v2476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:18 smithi092 ceph-mon[29156]: pgmap v2477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:18 smithi189 ceph-mon[32756]: pgmap v2477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:18 smithi156 ceph-mon[32679]: pgmap v2477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3474.274105 secs 2024-04-26T19:16:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2777.259663 secs 2024-04-26T19:16:20.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3474.274105 secs 2024-04-26T19:16:20.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2777.259663 secs 2024-04-26T19:16:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3474.274105 secs 2024-04-26T19:16:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2777.259663 secs 2024-04-26T19:16:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:20 smithi092 ceph-mon[29156]: pgmap v2478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:16:21.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:20 smithi189 ceph-mon[32756]: pgmap v2478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:21.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:21.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:21.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:21.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:16:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:20 smithi156 ceph-mon[32679]: pgmap v2478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:16:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:16:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:16:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:16:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:16:21.453+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:16:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:16:21.453+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:16:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:16:21.453+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:16:21.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:16:21.453+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 31 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:16:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:21 smithi092 ceph-mon[29156]: pgmap v2479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:16:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:21 smithi092 ceph-mon[29156]: pgmap v2480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:21 smithi189 ceph-mon[32756]: pgmap v2479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:16:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:21 smithi189 ceph-mon[32756]: pgmap v2480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:21 smithi156 ceph-mon[32679]: pgmap v2479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:16:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:21 smithi156 ceph-mon[32679]: pgmap v2480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:23 smithi092 ceph-mon[29156]: pgmap v2481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:23 smithi189 ceph-mon[32756]: pgmap v2481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:23 smithi156 ceph-mon[32679]: pgmap v2481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3479.274223 secs 2024-04-26T19:16:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2782.259750 secs 2024-04-26T19:16:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3479.274223 secs 2024-04-26T19:16:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2782.259750 secs 2024-04-26T19:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3479.274223 secs 2024-04-26T19:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2782.259750 secs 2024-04-26T19:16:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:25 smithi092 ceph-mon[29156]: pgmap v2482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:25 smithi189 ceph-mon[32756]: pgmap v2482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:25 smithi156 ceph-mon[32679]: pgmap v2482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:27 smithi189 ceph-mon[32756]: pgmap v2483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:27 smithi156 ceph-mon[32679]: pgmap v2483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:27 smithi092 ceph-mon[29156]: pgmap v2483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:16:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3484.274287 secs 2024-04-26T19:16:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2787.259862 secs 2024-04-26T19:16:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:29 smithi189 ceph-mon[32756]: pgmap v2484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3484.274287 secs 2024-04-26T19:16:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2787.259862 secs 2024-04-26T19:16:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:29 smithi156 ceph-mon[32679]: pgmap v2484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3484.274287 secs 2024-04-26T19:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2787.259862 secs 2024-04-26T19:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:29 smithi092 ceph-mon[29156]: pgmap v2484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:16:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:31 smithi189 ceph-mon[32756]: pgmap v2485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:16:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:31 smithi156 ceph-mon[32679]: pgmap v2485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:16:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:31 smithi092 ceph-mon[29156]: pgmap v2485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:16:34.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:33 smithi092 ceph-mon[29156]: pgmap v2486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:33 smithi189 ceph-mon[32756]: pgmap v2486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:33 smithi156 ceph-mon[32679]: pgmap v2486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3489.274456 secs 2024-04-26T19:16:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2792.259996 secs 2024-04-26T19:16:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3489.274456 secs 2024-04-26T19:16:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2792.259996 secs 2024-04-26T19:16:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3489.274456 secs 2024-04-26T19:16:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2792.259996 secs 2024-04-26T19:16:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:35 smithi189 ceph-mon[32756]: pgmap v2487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:35 smithi156 ceph-mon[32679]: pgmap v2487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:35 smithi092 ceph-mon[29156]: pgmap v2487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:37 smithi189 ceph-mon[32756]: pgmap v2488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:37 smithi156 ceph-mon[32679]: pgmap v2488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:37 smithi092 ceph-mon[29156]: pgmap v2488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3494.274576 secs 2024-04-26T19:16:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2797.260097 secs 2024-04-26T19:16:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:39 smithi189 ceph-mon[32756]: pgmap v2489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3494.274576 secs 2024-04-26T19:16:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2797.260097 secs 2024-04-26T19:16:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:39 smithi156 ceph-mon[32679]: pgmap v2489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3494.274576 secs 2024-04-26T19:16:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2797.260097 secs 2024-04-26T19:16:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:39 smithi092 ceph-mon[29156]: pgmap v2489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:41 smithi189 ceph-mon[32756]: pgmap v2490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:41 smithi156 ceph-mon[32679]: pgmap v2490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:41 smithi092 ceph-mon[29156]: pgmap v2490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:43 smithi189 ceph-mon[32756]: pgmap v2491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3499.274697 secs 2024-04-26T19:16:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:43 smithi156 ceph-mon[32679]: pgmap v2491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:44.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3499.274697 secs 2024-04-26T19:16:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:43 smithi092 ceph-mon[29156]: pgmap v2491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T19:16:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3499.274697 secs 2024-04-26T19:16:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2802.260229 secs 2024-04-26T19:16:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2802.260229 secs 2024-04-26T19:16:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2802.260229 secs 2024-04-26T19:16:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:45 smithi189 ceph-mon[32756]: pgmap v2492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:45 smithi156 ceph-mon[32679]: pgmap v2492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:45 smithi092 ceph-mon[29156]: pgmap v2492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T19:16:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:47 smithi189 ceph-mon[32756]: pgmap v2493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:47 smithi156 ceph-mon[32679]: pgmap v2493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:47 smithi092 ceph-mon[29156]: pgmap v2493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3504.274855 secs 2024-04-26T19:16:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3504.274855 secs 2024-04-26T19:16:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3504.274855 secs 2024-04-26T19:16:50.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2807.260349 secs 2024-04-26T19:16:50.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:49 smithi156 ceph-mon[32679]: pgmap v2494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2807.260349 secs 2024-04-26T19:16:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:49 smithi189 ceph-mon[32756]: pgmap v2494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2807.260349 secs 2024-04-26T19:16:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:49 smithi092 ceph-mon[29156]: pgmap v2494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:51 smithi189 ceph-mon[32756]: pgmap v2495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:51 smithi156 ceph-mon[32679]: pgmap v2495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:51 smithi092 ceph-mon[29156]: pgmap v2495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:53 smithi189 ceph-mon[32756]: pgmap v2496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3509.274927 secs 2024-04-26T19:16:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:53 smithi156 ceph-mon[32679]: pgmap v2496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3509.274927 secs 2024-04-26T19:16:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:53 smithi092 ceph-mon[29156]: pgmap v2496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3509.274927 secs 2024-04-26T19:16:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2812.260437 secs 2024-04-26T19:16:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2812.260437 secs 2024-04-26T19:16:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2812.260437 secs 2024-04-26T19:16:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:55 smithi189 ceph-mon[32756]: pgmap v2497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:55 smithi156 ceph-mon[32679]: pgmap v2497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:55 smithi092 ceph-mon[29156]: pgmap v2497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:16:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:57 smithi189 ceph-mon[32756]: pgmap v2498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:57 smithi156 ceph-mon[32679]: pgmap v2498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:57 smithi092 ceph-mon[29156]: pgmap v2498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:16:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3514.275011 secs 2024-04-26T19:16:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3514.275011 secs 2024-04-26T19:16:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3514.275011 secs 2024-04-26T19:17:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2817.260587 secs 2024-04-26T19:17:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:16:59 smithi189 ceph-mon[32756]: pgmap v2499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2817.260587 secs 2024-04-26T19:17:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:16:59 smithi156 ceph-mon[32679]: pgmap v2499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2817.260587 secs 2024-04-26T19:17:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:16:59 smithi092 ceph-mon[29156]: pgmap v2499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:01 smithi189 ceph-mon[32756]: pgmap v2500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:01 smithi156 ceph-mon[32679]: pgmap v2500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-mon[29156]: pgmap v2500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:17:01.929+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:17:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:17:01.929+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:17:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:17:01.929+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:17:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:17:01.929+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:17:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:17:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:17:01.929+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:17:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:03 smithi189 ceph-mon[32756]: pgmap v2501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3519.275079 secs 2024-04-26T19:17:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:03 smithi156 ceph-mon[32679]: pgmap v2501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3519.275079 secs 2024-04-26T19:17:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:03 smithi092 ceph-mon[29156]: pgmap v2501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3519.275079 secs 2024-04-26T19:17:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2822.260650 secs 2024-04-26T19:17:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2822.260650 secs 2024-04-26T19:17:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2822.260650 secs 2024-04-26T19:17:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:05 smithi189 ceph-mon[32756]: pgmap v2502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:05 smithi156 ceph-mon[32679]: pgmap v2502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:05 smithi092 ceph-mon[29156]: pgmap v2502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:07 smithi189 ceph-mon[32756]: pgmap v2503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:07 smithi156 ceph-mon[32679]: pgmap v2503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:07 smithi092 ceph-mon[29156]: pgmap v2503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3524.275158 secs 2024-04-26T19:17:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2827.260751 secs 2024-04-26T19:17:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3524.275158 secs 2024-04-26T19:17:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2827.260751 secs 2024-04-26T19:17:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3524.275158 secs 2024-04-26T19:17:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2827.260751 secs 2024-04-26T19:17:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:09 smithi189 ceph-mon[32756]: pgmap v2504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:09 smithi156 ceph-mon[32679]: pgmap v2504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:09 smithi092 ceph-mon[29156]: pgmap v2504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:11 smithi189 ceph-mon[32756]: pgmap v2505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:11 smithi156 ceph-mon[32679]: pgmap v2505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:11 smithi092 ceph-mon[29156]: pgmap v2505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:13 smithi189 ceph-mon[32756]: pgmap v2506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3529.275225 secs 2024-04-26T19:17:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2832.260852 secs 2024-04-26T19:17:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:13 smithi156 ceph-mon[32679]: pgmap v2506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3529.275225 secs 2024-04-26T19:17:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2832.260852 secs 2024-04-26T19:17:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:13 smithi092 ceph-mon[29156]: pgmap v2506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:17:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3529.275225 secs 2024-04-26T19:17:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2832.260852 secs 2024-04-26T19:17:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:15 smithi189 ceph-mon[32756]: pgmap v2507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:15 smithi156 ceph-mon[32679]: pgmap v2507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:15 smithi092 ceph-mon[29156]: pgmap v2507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:17:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:17 smithi189 ceph-mon[32756]: pgmap v2508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:17 smithi156 ceph-mon[32679]: pgmap v2508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:17 smithi092 ceph-mon[29156]: pgmap v2508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3534.275354 secs 2024-04-26T19:17:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2837.260970 secs 2024-04-26T19:17:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3534.275354 secs 2024-04-26T19:17:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2837.260970 secs 2024-04-26T19:17:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3534.275354 secs 2024-04-26T19:17:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2837.260970 secs 2024-04-26T19:17:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:19 smithi189 ceph-mon[32756]: pgmap v2509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:19 smithi156 ceph-mon[32679]: pgmap v2509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:19 smithi092 ceph-mon[29156]: pgmap v2509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:17:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:21 smithi189 ceph-mon[32756]: pgmap v2510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:17:22.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:21 smithi092 ceph-mon[29156]: pgmap v2510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:22.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:22.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:22.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:17:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:21 smithi156 ceph-mon[32679]: pgmap v2510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:17:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:17:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:17:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:22 smithi189 ceph-mon[32756]: pgmap v2511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:17:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:22 smithi189 ceph-mon[32756]: pgmap v2512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:22 smithi156 ceph-mon[32679]: pgmap v2511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:17:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:22 smithi156 ceph-mon[32679]: pgmap v2512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:22 smithi092 ceph-mon[29156]: pgmap v2511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:17:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:22 smithi092 ceph-mon[29156]: pgmap v2512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3539.275423 secs 2024-04-26T19:17:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2842.261110 secs 2024-04-26T19:17:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3539.275423 secs 2024-04-26T19:17:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2842.261110 secs 2024-04-26T19:17:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3539.275423 secs 2024-04-26T19:17:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2842.261110 secs 2024-04-26T19:17:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:24 smithi156 ceph-mon[32679]: pgmap v2513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:17:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:24 smithi092 ceph-mon[29156]: pgmap v2513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:17:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:24 smithi189 ceph-mon[32756]: pgmap v2513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:17:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:26 smithi156 ceph-mon[32679]: pgmap v2514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:26 smithi092 ceph-mon[29156]: pgmap v2514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:26 smithi189 ceph-mon[32756]: pgmap v2514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:28 smithi156 ceph-mon[32679]: pgmap v2515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3544.275543 secs 2024-04-26T19:17:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2847.261244 secs 2024-04-26T19:17:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:28 smithi092 ceph-mon[29156]: pgmap v2515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3544.275543 secs 2024-04-26T19:17:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2847.261244 secs 2024-04-26T19:17:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:28 smithi189 ceph-mon[32756]: pgmap v2515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3544.275543 secs 2024-04-26T19:17:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2847.261244 secs 2024-04-26T19:17:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:30 smithi156 ceph-mon[32679]: pgmap v2516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:30 smithi092 ceph-mon[29156]: pgmap v2516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:30 smithi189 ceph-mon[32756]: pgmap v2516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:17:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:32 smithi156 ceph-mon[32679]: pgmap v2517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:17:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:32 smithi092 ceph-mon[29156]: pgmap v2517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:17:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:32 smithi189 ceph-mon[32756]: pgmap v2517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:17:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3549.275686 secs 2024-04-26T19:17:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2852.261360 secs 2024-04-26T19:17:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3549.275686 secs 2024-04-26T19:17:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2852.261360 secs 2024-04-26T19:17:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3549.275686 secs 2024-04-26T19:17:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2852.261360 secs 2024-04-26T19:17:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:34 smithi156 ceph-mon[32679]: pgmap v2518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:34 smithi092 ceph-mon[29156]: pgmap v2518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:34 smithi189 ceph-mon[32756]: pgmap v2518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:36 smithi156 ceph-mon[32679]: pgmap v2519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:36 smithi092 ceph-mon[29156]: pgmap v2519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:36 smithi189 ceph-mon[32756]: pgmap v2519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:38 smithi156 ceph-mon[32679]: pgmap v2520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3554.275750 secs 2024-04-26T19:17:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2857.261499 secs 2024-04-26T19:17:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:38 smithi092 ceph-mon[29156]: pgmap v2520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3554.275750 secs 2024-04-26T19:17:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2857.261499 secs 2024-04-26T19:17:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:38 smithi189 ceph-mon[32756]: pgmap v2520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3554.275750 secs 2024-04-26T19:17:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2857.261499 secs 2024-04-26T19:17:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:40 smithi156 ceph-mon[32679]: pgmap v2521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:40 smithi092 ceph-mon[29156]: pgmap v2521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:40 smithi189 ceph-mon[32756]: pgmap v2521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:42 smithi156 ceph-mon[32679]: pgmap v2522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:42 smithi092 ceph-mon[29156]: pgmap v2522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:42 smithi189 ceph-mon[32756]: pgmap v2522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3559.275855 secs 2024-04-26T19:17:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2862.261615 secs 2024-04-26T19:17:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3559.275855 secs 2024-04-26T19:17:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2862.261615 secs 2024-04-26T19:17:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3559.275855 secs 2024-04-26T19:17:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2862.261615 secs 2024-04-26T19:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:44 smithi156 ceph-mon[32679]: pgmap v2523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:44 smithi092 ceph-mon[29156]: pgmap v2523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:44 smithi189 ceph-mon[32756]: pgmap v2523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:46 smithi092 ceph-mon[29156]: pgmap v2524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:46 smithi189 ceph-mon[32756]: pgmap v2524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:46 smithi156 ceph-mon[32679]: pgmap v2524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:48 smithi092 ceph-mon[29156]: pgmap v2525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3564.275974 secs 2024-04-26T19:17:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2867.261696 secs 2024-04-26T19:17:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:48 smithi189 ceph-mon[32756]: pgmap v2525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3564.275974 secs 2024-04-26T19:17:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2867.261696 secs 2024-04-26T19:17:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:48 smithi156 ceph-mon[32679]: pgmap v2525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3564.275974 secs 2024-04-26T19:17:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2867.261696 secs 2024-04-26T19:17:51.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:50 smithi156 ceph-mon[32679]: pgmap v2526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:50 smithi092 ceph-mon[29156]: pgmap v2526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:50 smithi189 ceph-mon[32756]: pgmap v2526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:52 smithi092 ceph-mon[29156]: pgmap v2527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:52 smithi189 ceph-mon[32756]: pgmap v2527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:52 smithi156 ceph-mon[32679]: pgmap v2527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3569.276075 secs 2024-04-26T19:17:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2872.261827 secs 2024-04-26T19:17:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3569.276075 secs 2024-04-26T19:17:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2872.261827 secs 2024-04-26T19:17:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3569.276075 secs 2024-04-26T19:17:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2872.261827 secs 2024-04-26T19:17:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:54 smithi092 ceph-mon[29156]: pgmap v2528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:54 smithi189 ceph-mon[32756]: pgmap v2528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:54 smithi156 ceph-mon[32679]: pgmap v2528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:56 smithi092 ceph-mon[29156]: pgmap v2529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:56 smithi189 ceph-mon[32756]: pgmap v2529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:56 smithi156 ceph-mon[32679]: pgmap v2529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:58 smithi092 ceph-mon[29156]: pgmap v2530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3574.276138 secs 2024-04-26T19:17:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:17:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2877.261945 secs 2024-04-26T19:17:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:58 smithi189 ceph-mon[32756]: pgmap v2530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3574.276138 secs 2024-04-26T19:17:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:17:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2877.261945 secs 2024-04-26T19:17:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:58 smithi156 ceph-mon[32679]: pgmap v2530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:17:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3574.276138 secs 2024-04-26T19:17:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:17:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2877.261945 secs 2024-04-26T19:18:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:00 smithi092 ceph-mon[29156]: pgmap v2531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:00 smithi189 ceph-mon[32756]: pgmap v2531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:00 smithi156 ceph-mon[32679]: pgmap v2531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:02 smithi092 ceph-mon[29156]: pgmap v2532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:02 smithi189 ceph-mon[32756]: pgmap v2532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:02 smithi156 ceph-mon[32679]: pgmap v2532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3579.276255 secs 2024-04-26T19:18:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 2882.262073 secs 2024-04-26T19:18:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:03 smithi092 ceph-mon[29156]: slow request 2882.262072 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:18:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3579.276255 secs 2024-04-26T19:18:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 2882.262073 secs 2024-04-26T19:18:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:03 smithi189 ceph-mon[32756]: slow request 2882.262072 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:18:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3579.276255 secs 2024-04-26T19:18:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 2882.262073 secs 2024-04-26T19:18:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:03 smithi156 ceph-mon[32679]: slow request 2882.262072 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:18:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:04 smithi092 ceph-mon[29156]: pgmap v2533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:04 smithi189 ceph-mon[32756]: pgmap v2533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:04 smithi156 ceph-mon[32679]: pgmap v2533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:06 smithi092 ceph-mon[29156]: pgmap v2534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:06 smithi189 ceph-mon[32756]: pgmap v2534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:06 smithi156 ceph-mon[32679]: pgmap v2534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:08 smithi092 ceph-mon[29156]: pgmap v2535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3584.276328 secs 2024-04-26T19:18:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2887.262194 secs 2024-04-26T19:18:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:08 smithi189 ceph-mon[32756]: pgmap v2535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3584.276328 secs 2024-04-26T19:18:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2887.262194 secs 2024-04-26T19:18:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:08 smithi156 ceph-mon[32679]: pgmap v2535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3584.276328 secs 2024-04-26T19:18:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2887.262194 secs 2024-04-26T19:18:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:10 smithi092 ceph-mon[29156]: pgmap v2536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:10 smithi189 ceph-mon[32756]: pgmap v2536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:10 smithi156 ceph-mon[32679]: pgmap v2536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:12 smithi189 ceph-mon[32756]: pgmap v2537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:12 smithi156 ceph-mon[32679]: pgmap v2537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:12 smithi092 ceph-mon[29156]: pgmap v2537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3589.276432 secs 2024-04-26T19:18:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2892.262325 secs 2024-04-26T19:18:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3589.276432 secs 2024-04-26T19:18:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2892.262325 secs 2024-04-26T19:18:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3589.276432 secs 2024-04-26T19:18:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2892.262325 secs 2024-04-26T19:18:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:15 smithi189 ceph-mon[32756]: pgmap v2538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:15 smithi156 ceph-mon[32679]: pgmap v2538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:15 smithi092 ceph-mon[29156]: pgmap v2538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:18:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:17 smithi189 ceph-mon[32756]: pgmap v2539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:17 smithi156 ceph-mon[32679]: pgmap v2539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:17 smithi092 ceph-mon[29156]: pgmap v2539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:18:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:19 smithi189 ceph-mon[32756]: pgmap v2540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3594.276569 secs 2024-04-26T19:18:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2897.262428 secs 2024-04-26T19:18:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:19 smithi156 ceph-mon[32679]: pgmap v2540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3594.276569 secs 2024-04-26T19:18:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2897.262428 secs 2024-04-26T19:18:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:19 smithi092 ceph-mon[29156]: pgmap v2540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3594.276569 secs 2024-04-26T19:18:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2897.262428 secs 2024-04-26T19:18:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:21 smithi189 ceph-mon[32756]: pgmap v2541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:21 smithi156 ceph-mon[32679]: pgmap v2541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:21 smithi092 ceph-mon[29156]: pgmap v2541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:18:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:18:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:18:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:18:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:18:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:18:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:23 smithi189 ceph-mon[32756]: pgmap v2542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:23 smithi189 ceph-mon[32756]: pgmap v2543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:18:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:23 smithi189 ceph-mon[32756]: pgmap v2544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:23 smithi156 ceph-mon[32679]: pgmap v2542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:23 smithi156 ceph-mon[32679]: pgmap v2543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:18:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:23 smithi156 ceph-mon[32679]: pgmap v2544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:23 smithi092 ceph-mon[29156]: pgmap v2542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:23 smithi092 ceph-mon[29156]: pgmap v2543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:18:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:23 smithi092 ceph-mon[29156]: pgmap v2544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3599.276693 secs 2024-04-26T19:18:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2902.262545 secs 2024-04-26T19:18:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3599.276693 secs 2024-04-26T19:18:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2902.262545 secs 2024-04-26T19:18:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3599.276693 secs 2024-04-26T19:18:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2902.262545 secs 2024-04-26T19:18:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:25 smithi189 ceph-mon[32756]: pgmap v2545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:25 smithi156 ceph-mon[32679]: pgmap v2545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:25 smithi092 ceph-mon[29156]: pgmap v2545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:27 smithi189 ceph-mon[32756]: pgmap v2546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:27 smithi156 ceph-mon[32679]: pgmap v2546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:27 smithi092 ceph-mon[29156]: pgmap v2546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:29 smithi189 ceph-mon[32756]: pgmap v2547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:18:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3604.276792 secs 2024-04-26T19:18:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2907.262661 secs 2024-04-26T19:18:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:29 smithi156 ceph-mon[32679]: pgmap v2547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:18:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3604.276792 secs 2024-04-26T19:18:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2907.262661 secs 2024-04-26T19:18:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:29 smithi092 ceph-mon[29156]: pgmap v2547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:18:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3604.276792 secs 2024-04-26T19:18:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2907.262661 secs 2024-04-26T19:18:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:31 smithi189 ceph-mon[32756]: pgmap v2548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:31 smithi156 ceph-mon[32679]: pgmap v2548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:31 smithi092 ceph-mon[29156]: pgmap v2548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:18:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:33 smithi189 ceph-mon[32756]: pgmap v2549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:18:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:33 smithi156 ceph-mon[32679]: pgmap v2549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:18:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:33 smithi092 ceph-mon[29156]: pgmap v2549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:18:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3609.276901 secs 2024-04-26T19:18:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2912.262778 secs 2024-04-26T19:18:34.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3609.276901 secs 2024-04-26T19:18:34.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2912.262778 secs 2024-04-26T19:18:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3609.276901 secs 2024-04-26T19:18:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2912.262778 secs 2024-04-26T19:18:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:35 smithi189 ceph-mon[32756]: pgmap v2550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:35 smithi156 ceph-mon[32679]: pgmap v2550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:35 smithi092 ceph-mon[29156]: pgmap v2550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T19:18:35.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005b00 tx=0x7f1ca8094000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005b00 tx=0x7f1ca8094000 comp rx=0 tx=0).stop 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:18:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:35.994+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803dec0 tx=0x7f1ca80a5000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:18:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.023+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T19:18:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.023+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:18:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.023+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:18:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.023+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:18:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.023+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:18:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T19:18:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.024+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T19:18:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.470+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:18:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.470+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:18:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.471+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:18:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:18:36.471+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 32 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:18:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:37 smithi189 ceph-mon[32756]: pgmap v2551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:37 smithi156 ceph-mon[32679]: pgmap v2551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:37 smithi092 ceph-mon[29156]: pgmap v2551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:39 smithi189 ceph-mon[32756]: pgmap v2552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3614.277034 secs 2024-04-26T19:18:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2917.262911 secs 2024-04-26T19:18:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:39 smithi156 ceph-mon[32679]: pgmap v2552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3614.277034 secs 2024-04-26T19:18:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2917.262911 secs 2024-04-26T19:18:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:39 smithi092 ceph-mon[29156]: pgmap v2552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3614.277034 secs 2024-04-26T19:18:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2917.262911 secs 2024-04-26T19:18:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:41 smithi189 ceph-mon[32756]: pgmap v2553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:41 smithi156 ceph-mon[32679]: pgmap v2553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:41 smithi092 ceph-mon[29156]: pgmap v2553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:43 smithi189 ceph-mon[32756]: pgmap v2554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:43 smithi156 ceph-mon[32679]: pgmap v2554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:43 smithi092 ceph-mon[29156]: pgmap v2554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3619.277133 secs 2024-04-26T19:18:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2922.262971 secs 2024-04-26T19:18:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3619.277133 secs 2024-04-26T19:18:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2922.262971 secs 2024-04-26T19:18:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3619.277133 secs 2024-04-26T19:18:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2922.262971 secs 2024-04-26T19:18:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:45 smithi189 ceph-mon[32756]: pgmap v2555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:45 smithi156 ceph-mon[32679]: pgmap v2555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:45 smithi092 ceph-mon[29156]: pgmap v2555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:47 smithi189 ceph-mon[32756]: pgmap v2556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:47 smithi156 ceph-mon[32679]: pgmap v2556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:47 smithi092 ceph-mon[29156]: pgmap v2556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:49 smithi189 ceph-mon[32756]: pgmap v2557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3624.277255 secs 2024-04-26T19:18:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2927.263061 secs 2024-04-26T19:18:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:49 smithi156 ceph-mon[32679]: pgmap v2557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3624.277255 secs 2024-04-26T19:18:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2927.263061 secs 2024-04-26T19:18:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:49 smithi092 ceph-mon[29156]: pgmap v2557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3624.277255 secs 2024-04-26T19:18:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2927.263061 secs 2024-04-26T19:18:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:51 smithi189 ceph-mon[32756]: pgmap v2558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:51 smithi156 ceph-mon[32679]: pgmap v2558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:51 smithi092 ceph-mon[29156]: pgmap v2558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:53 smithi189 ceph-mon[32756]: pgmap v2559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:53 smithi156 ceph-mon[32679]: pgmap v2559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:53 smithi092 ceph-mon[29156]: pgmap v2559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3629.277398 secs 2024-04-26T19:18:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2932.263201 secs 2024-04-26T19:18:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3629.277398 secs 2024-04-26T19:18:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2932.263201 secs 2024-04-26T19:18:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3629.277398 secs 2024-04-26T19:18:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2932.263201 secs 2024-04-26T19:18:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:55 smithi189 ceph-mon[32756]: pgmap v2560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:55 smithi156 ceph-mon[32679]: pgmap v2560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:55 smithi092 ceph-mon[29156]: pgmap v2560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:18:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:57 smithi189 ceph-mon[32756]: pgmap v2561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:57 smithi156 ceph-mon[32679]: pgmap v2561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:57 smithi092 ceph-mon[29156]: pgmap v2561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:59 smithi189 ceph-mon[32756]: pgmap v2562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3634.277534 secs 2024-04-26T19:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:18:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2937.263318 secs 2024-04-26T19:18:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:59 smithi156 ceph-mon[32679]: pgmap v2562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3634.277534 secs 2024-04-26T19:18:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:18:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2937.263318 secs 2024-04-26T19:18:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:59 smithi092 ceph-mon[29156]: pgmap v2562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:18:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3634.277534 secs 2024-04-26T19:18:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:18:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2937.263318 secs 2024-04-26T19:19:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:01 smithi189 ceph-mon[32756]: pgmap v2563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:01 smithi156 ceph-mon[32679]: pgmap v2563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:01 smithi092 ceph-mon[29156]: pgmap v2563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:03 smithi189 ceph-mon[32756]: pgmap v2564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:03 smithi156 ceph-mon[32679]: pgmap v2564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:03 smithi092 ceph-mon[29156]: pgmap v2564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3639.277653 secs 2024-04-26T19:19:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2942.263434 secs 2024-04-26T19:19:04.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3639.277653 secs 2024-04-26T19:19:04.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2942.263434 secs 2024-04-26T19:19:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3639.277653 secs 2024-04-26T19:19:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2942.263434 secs 2024-04-26T19:19:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:05 smithi189 ceph-mon[32756]: pgmap v2565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:05 smithi156 ceph-mon[32679]: pgmap v2565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:05 smithi092 ceph-mon[29156]: pgmap v2565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:06 smithi189 ceph-mon[32756]: pgmap v2566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:06 smithi156 ceph-mon[32679]: pgmap v2566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:06 smithi092 ceph-mon[29156]: pgmap v2566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:09 smithi189 ceph-mon[32756]: pgmap v2567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3644.277721 secs 2024-04-26T19:19:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2947.263544 secs 2024-04-26T19:19:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:09 smithi156 ceph-mon[32679]: pgmap v2567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3644.277721 secs 2024-04-26T19:19:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2947.263544 secs 2024-04-26T19:19:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:09 smithi092 ceph-mon[29156]: pgmap v2567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3644.277721 secs 2024-04-26T19:19:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2947.263544 secs 2024-04-26T19:19:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:11 smithi189 ceph-mon[32756]: pgmap v2568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:11 smithi156 ceph-mon[32679]: pgmap v2568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:11 smithi092 ceph-mon[29156]: pgmap v2568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:13 smithi189 ceph-mon[32756]: pgmap v2569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:13 smithi156 ceph-mon[32679]: pgmap v2569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:13 smithi092 ceph-mon[29156]: pgmap v2569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3649.277857 secs 2024-04-26T19:19:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2952.263607 secs 2024-04-26T19:19:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3649.277857 secs 2024-04-26T19:19:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2952.263607 secs 2024-04-26T19:19:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3649.277857 secs 2024-04-26T19:19:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2952.263607 secs 2024-04-26T19:19:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:15 smithi189 ceph-mon[32756]: pgmap v2570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:15 smithi156 ceph-mon[32679]: pgmap v2570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:15 smithi092 ceph-mon[29156]: pgmap v2570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:17 smithi189 ceph-mon[32756]: pgmap v2571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:17 smithi156 ceph-mon[32679]: pgmap v2571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:17 smithi092 ceph-mon[29156]: pgmap v2571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:19 smithi189 ceph-mon[32756]: pgmap v2572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3654.277977 secs 2024-04-26T19:19:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2957.263672 secs 2024-04-26T19:19:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:19 smithi156 ceph-mon[32679]: pgmap v2572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3654.277977 secs 2024-04-26T19:19:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2957.263672 secs 2024-04-26T19:19:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:19 smithi092 ceph-mon[29156]: pgmap v2572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3654.277977 secs 2024-04-26T19:19:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2957.263672 secs 2024-04-26T19:19:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:21 smithi189 ceph-mon[32756]: pgmap v2573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:21 smithi156 ceph-mon[32679]: pgmap v2573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:21 smithi092 ceph-mon[29156]: pgmap v2573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:23 smithi189 ceph-mon[32756]: pgmap v2574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:19:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:23 smithi156 ceph-mon[32679]: pgmap v2574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:23 smithi092 ceph-mon[29156]: pgmap v2574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:19:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:24 smithi189 ceph-mon[32756]: pgmap v2575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:19:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:24 smithi189 ceph-mon[32756]: pgmap v2576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:19:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3659.278101 secs 2024-04-26T19:19:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2962.263769 secs 2024-04-26T19:19:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:24 smithi156 ceph-mon[32679]: pgmap v2575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:19:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:24 smithi156 ceph-mon[32679]: pgmap v2576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:19:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3659.278101 secs 2024-04-26T19:19:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2962.263769 secs 2024-04-26T19:19:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:24 smithi092 ceph-mon[29156]: pgmap v2575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:19:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:24 smithi092 ceph-mon[29156]: pgmap v2576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:19:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3659.278101 secs 2024-04-26T19:19:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2962.263769 secs 2024-04-26T19:19:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:26 smithi189 ceph-mon[32756]: pgmap v2577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:26 smithi156 ceph-mon[32679]: pgmap v2577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:26 smithi092 ceph-mon[29156]: pgmap v2577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:28 smithi189 ceph-mon[32756]: pgmap v2578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:28 smithi156 ceph-mon[32679]: pgmap v2578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:28 smithi092 ceph-mon[29156]: pgmap v2578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3664.278197 secs 2024-04-26T19:19:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2967.263832 secs 2024-04-26T19:19:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3664.278197 secs 2024-04-26T19:19:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2967.263832 secs 2024-04-26T19:19:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3664.278197 secs 2024-04-26T19:19:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2967.263832 secs 2024-04-26T19:19:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:30 smithi189 ceph-mon[32756]: pgmap v2579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:30 smithi156 ceph-mon[32679]: pgmap v2579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:30 smithi092 ceph-mon[29156]: pgmap v2579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:32 smithi189 ceph-mon[32756]: pgmap v2580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:32 smithi156 ceph-mon[32679]: pgmap v2580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:32 smithi092 ceph-mon[29156]: pgmap v2580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:19:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:34 smithi189 ceph-mon[32756]: pgmap v2581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3669.278316 secs 2024-04-26T19:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2972.263947 secs 2024-04-26T19:19:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:34 smithi156 ceph-mon[32679]: pgmap v2581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:19:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3669.278316 secs 2024-04-26T19:19:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2972.263947 secs 2024-04-26T19:19:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:34 smithi092 ceph-mon[29156]: pgmap v2581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:19:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3669.278316 secs 2024-04-26T19:19:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2972.263947 secs 2024-04-26T19:19:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:36 smithi189 ceph-mon[32756]: pgmap v2582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:36 smithi156 ceph-mon[32679]: pgmap v2582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:36 smithi092 ceph-mon[29156]: pgmap v2582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:38 smithi189 ceph-mon[32756]: pgmap v2583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:38 smithi156 ceph-mon[32679]: pgmap v2583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:38 smithi092 ceph-mon[29156]: pgmap v2583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3674.278447 secs 2024-04-26T19:19:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2977.264034 secs 2024-04-26T19:19:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3674.278447 secs 2024-04-26T19:19:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2977.264034 secs 2024-04-26T19:19:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3674.278447 secs 2024-04-26T19:19:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2977.264034 secs 2024-04-26T19:19:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:40 smithi189 ceph-mon[32756]: pgmap v2584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:40 smithi156 ceph-mon[32679]: pgmap v2584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:40 smithi092 ceph-mon[29156]: pgmap v2584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:41 smithi189 ceph-mon[32756]: pgmap v2585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:41 smithi156 ceph-mon[32679]: pgmap v2585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:41 smithi092 ceph-mon[29156]: pgmap v2585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:43 smithi189 ceph-mon[32756]: pgmap v2586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3679.278543 secs 2024-04-26T19:19:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:43 smithi156 ceph-mon[32679]: pgmap v2586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3679.278543 secs 2024-04-26T19:19:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:43 smithi092 ceph-mon[29156]: pgmap v2586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3679.278543 secs 2024-04-26T19:19:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2982.264194 secs 2024-04-26T19:19:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2982.264194 secs 2024-04-26T19:19:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2982.264194 secs 2024-04-26T19:19:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:45 smithi189 ceph-mon[32756]: pgmap v2587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:45 smithi156 ceph-mon[32679]: pgmap v2587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:45 smithi092 ceph-mon[29156]: pgmap v2587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:47 smithi189 ceph-mon[32756]: pgmap v2588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:47 smithi156 ceph-mon[32679]: pgmap v2588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:47 smithi092 ceph-mon[29156]: pgmap v2588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3684.278662 secs 2024-04-26T19:19:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3684.278662 secs 2024-04-26T19:19:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3684.278662 secs 2024-04-26T19:19:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2987.264333 secs 2024-04-26T19:19:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:49 smithi189 ceph-mon[32756]: pgmap v2589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2987.264333 secs 2024-04-26T19:19:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:49 smithi156 ceph-mon[32679]: pgmap v2589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2987.264333 secs 2024-04-26T19:19:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:49 smithi092 ceph-mon[29156]: pgmap v2589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:51 smithi189 ceph-mon[32756]: pgmap v2590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:51 smithi156 ceph-mon[32679]: pgmap v2590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:51 smithi092 ceph-mon[29156]: pgmap v2590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:53 smithi189 ceph-mon[32756]: pgmap v2591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3689.278779 secs 2024-04-26T19:19:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:53 smithi156 ceph-mon[32679]: pgmap v2591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3689.278779 secs 2024-04-26T19:19:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:53 smithi092 ceph-mon[29156]: pgmap v2591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3689.278779 secs 2024-04-26T19:19:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2992.264457 secs 2024-04-26T19:19:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2992.264457 secs 2024-04-26T19:19:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2992.264457 secs 2024-04-26T19:19:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:55 smithi189 ceph-mon[32756]: pgmap v2592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:55 smithi156 ceph-mon[32679]: pgmap v2592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:55 smithi092 ceph-mon[29156]: pgmap v2592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:19:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:57 smithi189 ceph-mon[32756]: pgmap v2593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:57 smithi156 ceph-mon[32679]: pgmap v2593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:57 smithi092 ceph-mon[29156]: pgmap v2593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:19:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3694.278901 secs 2024-04-26T19:19:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3694.278901 secs 2024-04-26T19:19:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3694.278901 secs 2024-04-26T19:20:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 2997.264572 secs 2024-04-26T19:20:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:19:59 smithi189 ceph-mon[32756]: pgmap v2594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 2997.264572 secs 2024-04-26T19:20:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:19:59 smithi156 ceph-mon[32679]: pgmap v2594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 2997.264572 secs 2024-04-26T19:20:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:19:59 smithi092 ceph-mon[29156]: pgmap v2594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:20:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:20:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:20:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:01 smithi189 ceph-mon[32756]: pgmap v2595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:01 smithi156 ceph-mon[32679]: pgmap v2595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:01 smithi092 ceph-mon[29156]: pgmap v2595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:03 smithi189 ceph-mon[32756]: pgmap v2596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3699.279018 secs 2024-04-26T19:20:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:03 smithi156 ceph-mon[32679]: pgmap v2596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3699.279018 secs 2024-04-26T19:20:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:03 smithi092 ceph-mon[29156]: pgmap v2596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3699.279018 secs 2024-04-26T19:20:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:04 smithi189 ceph-mon[32756]: 5 slow requests, 2 included below; oldest blocked for > 3002.264683 secs 2024-04-26T19:20:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:04 smithi189 ceph-mon[32756]: slow request 1441.811104 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:20:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:04 smithi189 ceph-mon[32756]: slow request 181.475160 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:04 smithi156 ceph-mon[32679]: 5 slow requests, 2 included below; oldest blocked for > 3002.264683 secs 2024-04-26T19:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:04 smithi156 ceph-mon[32679]: slow request 1441.811104 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:04 smithi156 ceph-mon[32679]: slow request 181.475160 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:20:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:04 smithi092 ceph-mon[29156]: 5 slow requests, 2 included below; oldest blocked for > 3002.264683 secs 2024-04-26T19:20:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:04 smithi092 ceph-mon[29156]: slow request 1441.811104 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:20:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:04 smithi092 ceph-mon[29156]: slow request 181.475160 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:20:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:05 smithi189 ceph-mon[32756]: pgmap v2597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:05 smithi156 ceph-mon[32679]: pgmap v2597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:05 smithi092 ceph-mon[29156]: pgmap v2597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:07 smithi189 ceph-mon[32756]: pgmap v2598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:20:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:20:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:07 smithi156 ceph-mon[32679]: pgmap v2598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:20:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:20:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:07 smithi092 ceph-mon[29156]: pgmap v2598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:20:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:20:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:20:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3704.279098 secs 2024-04-26T19:20:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:08 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3007.264784 secs 2024-04-26T19:20:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3704.279098 secs 2024-04-26T19:20:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:08 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3007.264784 secs 2024-04-26T19:20:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3704.279098 secs 2024-04-26T19:20:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:08 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3007.264784 secs 2024-04-26T19:20:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:09 smithi189 ceph-mon[32756]: pgmap v2599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:09 smithi156 ceph-mon[32679]: pgmap v2599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:09 smithi092 ceph-mon[29156]: pgmap v2599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:20:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:11 smithi189 ceph-mon[32756]: pgmap v2600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:11 smithi156 ceph-mon[32679]: pgmap v2600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:11 smithi092 ceph-mon[29156]: pgmap v2600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:13 smithi189 ceph-mon[32756]: pgmap v2601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3709.279239 secs 2024-04-26T19:20:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:13 smithi156 ceph-mon[32679]: pgmap v2601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3709.279239 secs 2024-04-26T19:20:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:13 smithi092 ceph-mon[29156]: pgmap v2601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3709.279239 secs 2024-04-26T19:20:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3012.264857 secs 2024-04-26T19:20:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3012.264857 secs 2024-04-26T19:20:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3012.264857 secs 2024-04-26T19:20:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:15 smithi189 ceph-mon[32756]: pgmap v2602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:15 smithi156 ceph-mon[32679]: pgmap v2602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:15 smithi092 ceph-mon[29156]: pgmap v2602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:17 smithi189 ceph-mon[32756]: pgmap v2603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:17 smithi156 ceph-mon[32679]: pgmap v2603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:17 smithi092 ceph-mon[29156]: pgmap v2603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3714.279317 secs 2024-04-26T19:20:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3714.279317 secs 2024-04-26T19:20:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3714.279317 secs 2024-04-26T19:20:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3017.264974 secs 2024-04-26T19:20:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:19 smithi189 ceph-mon[32756]: pgmap v2604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3017.264974 secs 2024-04-26T19:20:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:19 smithi156 ceph-mon[32679]: pgmap v2604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3017.264974 secs 2024-04-26T19:20:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:19 smithi092 ceph-mon[29156]: pgmap v2604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:21 smithi189 ceph-mon[32756]: pgmap v2605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:21 smithi156 ceph-mon[32679]: pgmap v2605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:21 smithi092 ceph-mon[29156]: pgmap v2605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: pgmap v2606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3719.279405 secs 2024-04-26T19:20:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:20:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: pgmap v2606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3719.279405 secs 2024-04-26T19:20:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:20:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: pgmap v2606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:20:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3719.279405 secs 2024-04-26T19:20:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:20:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:20:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:20:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3022.265044 secs 2024-04-26T19:20:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:24 smithi189 ceph-mon[32756]: pgmap v2607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:20:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:24 smithi189 ceph-mon[32756]: pgmap v2608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3022.265044 secs 2024-04-26T19:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:24 smithi156 ceph-mon[32679]: pgmap v2607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:24 smithi156 ceph-mon[32679]: pgmap v2608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:20:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3022.265044 secs 2024-04-26T19:20:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:24 smithi092 ceph-mon[29156]: pgmap v2607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:20:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:24 smithi092 ceph-mon[29156]: pgmap v2608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:20:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:26 smithi189 ceph-mon[32756]: pgmap v2609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:26 smithi156 ceph-mon[32679]: pgmap v2609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:26 smithi092 ceph-mon[29156]: pgmap v2609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:28 smithi092 ceph-mon[29156]: pgmap v2610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3724.279516 secs 2024-04-26T19:20:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:28 smithi189 ceph-mon[32756]: pgmap v2610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3724.279516 secs 2024-04-26T19:20:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:28 smithi156 ceph-mon[32679]: pgmap v2610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:20:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3724.279516 secs 2024-04-26T19:20:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3027.265166 secs 2024-04-26T19:20:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3027.265166 secs 2024-04-26T19:20:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3027.265166 secs 2024-04-26T19:20:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:30 smithi189 ceph-mon[32756]: pgmap v2611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:30 smithi156 ceph-mon[32679]: pgmap v2611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:30 smithi092 ceph-mon[29156]: pgmap v2611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:32 smithi189 ceph-mon[32756]: pgmap v2612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:32 smithi156 ceph-mon[32679]: pgmap v2612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:32 smithi092 ceph-mon[29156]: pgmap v2612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:20:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3729.279651 secs 2024-04-26T19:20:34.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3729.279651 secs 2024-04-26T19:20:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3729.279651 secs 2024-04-26T19:20:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3032.265288 secs 2024-04-26T19:20:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:34 smithi189 ceph-mon[32756]: pgmap v2613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:20:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3032.265288 secs 2024-04-26T19:20:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:34 smithi156 ceph-mon[32679]: pgmap v2613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:20:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3032.265288 secs 2024-04-26T19:20:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:34 smithi092 ceph-mon[29156]: pgmap v2613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:20:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:36 smithi189 ceph-mon[32756]: pgmap v2614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:36 smithi156 ceph-mon[32679]: pgmap v2614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:36 smithi092 ceph-mon[29156]: pgmap v2614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:38 smithi189 ceph-mon[32756]: pgmap v2615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3734.279765 secs 2024-04-26T19:20:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:38 smithi156 ceph-mon[32679]: pgmap v2615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3734.279765 secs 2024-04-26T19:20:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:38 smithi092 ceph-mon[29156]: pgmap v2615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3734.279765 secs 2024-04-26T19:20:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3037.265425 secs 2024-04-26T19:20:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3037.265425 secs 2024-04-26T19:20:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3037.265425 secs 2024-04-26T19:20:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:40 smithi189 ceph-mon[32756]: pgmap v2616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:40 smithi156 ceph-mon[32679]: pgmap v2616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:40 smithi092 ceph-mon[29156]: pgmap v2616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:42 smithi189 ceph-mon[32756]: pgmap v2617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:42 smithi156 ceph-mon[32679]: pgmap v2617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:42 smithi092 ceph-mon[29156]: pgmap v2617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3739.279921 secs 2024-04-26T19:20:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:43 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3042.265544 secs 2024-04-26T19:20:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3739.279921 secs 2024-04-26T19:20:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:43 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3042.265544 secs 2024-04-26T19:20:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3739.279921 secs 2024-04-26T19:20:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:43 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3042.265544 secs 2024-04-26T19:20:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:44 smithi156 ceph-mon[32679]: pgmap v2618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:44 smithi092 ceph-mon[29156]: pgmap v2618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:44 smithi189 ceph-mon[32756]: pgmap v2618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:46 smithi156 ceph-mon[32679]: pgmap v2619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:46 smithi092 ceph-mon[29156]: pgmap v2619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:46 smithi189 ceph-mon[32756]: pgmap v2619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:48 smithi156 ceph-mon[32679]: pgmap v2620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3744.280042 secs 2024-04-26T19:20:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:48 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3047.265679 secs 2024-04-26T19:20:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:48 smithi092 ceph-mon[29156]: pgmap v2620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3744.280042 secs 2024-04-26T19:20:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:48 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3047.265679 secs 2024-04-26T19:20:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:48 smithi189 ceph-mon[32756]: pgmap v2620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3744.280042 secs 2024-04-26T19:20:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:48 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3047.265679 secs 2024-04-26T19:20:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:50 smithi156 ceph-mon[32679]: pgmap v2621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:51.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:50 smithi189 ceph-mon[32756]: pgmap v2621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:50 smithi092 ceph-mon[29156]: pgmap v2621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:52 smithi156 ceph-mon[32679]: pgmap v2622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:52 smithi092 ceph-mon[29156]: pgmap v2622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:52 smithi189 ceph-mon[32756]: pgmap v2622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3749.280111 secs 2024-04-26T19:20:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:53 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3052.265792 secs 2024-04-26T19:20:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3749.280111 secs 2024-04-26T19:20:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:53 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3052.265792 secs 2024-04-26T19:20:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3749.280111 secs 2024-04-26T19:20:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:53 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3052.265792 secs 2024-04-26T19:20:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:54 smithi156 ceph-mon[32679]: pgmap v2623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:54 smithi092 ceph-mon[29156]: pgmap v2623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:54 smithi189 ceph-mon[32756]: pgmap v2623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:20:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:56 smithi156 ceph-mon[32679]: pgmap v2624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:56 smithi092 ceph-mon[29156]: pgmap v2624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:56 smithi189 ceph-mon[32756]: pgmap v2624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:58 smithi156 ceph-mon[32679]: pgmap v2625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3754.280177 secs 2024-04-26T19:20:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:20:58 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3057.265908 secs 2024-04-26T19:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:58 smithi092 ceph-mon[29156]: pgmap v2625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3754.280177 secs 2024-04-26T19:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:20:58 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3057.265908 secs 2024-04-26T19:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:58 smithi189 ceph-mon[32756]: pgmap v2625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3754.280177 secs 2024-04-26T19:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:20:58 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3057.265908 secs 2024-04-26T19:21:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:00 smithi156 ceph-mon[32679]: pgmap v2626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:00 smithi092 ceph-mon[29156]: pgmap v2626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:00 smithi189 ceph-mon[32756]: pgmap v2626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:02 smithi156 ceph-mon[32679]: pgmap v2627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:02 smithi092 ceph-mon[29156]: pgmap v2627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:02 smithi189 ceph-mon[32756]: pgmap v2627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:04.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3759.280256 secs 2024-04-26T19:21:04.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:03 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3062.266046 secs 2024-04-26T19:21:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3759.280256 secs 2024-04-26T19:21:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:03 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3062.266046 secs 2024-04-26T19:21:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3759.280256 secs 2024-04-26T19:21:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:03 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3062.266046 secs 2024-04-26T19:21:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:04 smithi156 ceph-mon[32679]: pgmap v2628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:04 smithi092 ceph-mon[29156]: pgmap v2628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:04 smithi189 ceph-mon[32756]: pgmap v2628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:06 smithi092 ceph-mon[29156]: pgmap v2629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:06 smithi189 ceph-mon[32756]: pgmap v2629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:06 smithi156 ceph-mon[32679]: pgmap v2629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:08 smithi092 ceph-mon[29156]: pgmap v2630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3764.280371 secs 2024-04-26T19:21:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:08 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3067.266154 secs 2024-04-26T19:21:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:08 smithi189 ceph-mon[32756]: pgmap v2630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3764.280371 secs 2024-04-26T19:21:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:08 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3067.266154 secs 2024-04-26T19:21:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:08 smithi156 ceph-mon[32679]: pgmap v2630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3764.280371 secs 2024-04-26T19:21:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:08 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3067.266154 secs 2024-04-26T19:21:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:10 smithi092 ceph-mon[29156]: pgmap v2631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:10 smithi189 ceph-mon[32756]: pgmap v2631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:10 smithi156 ceph-mon[32679]: pgmap v2631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:12 smithi092 ceph-mon[29156]: pgmap v2632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:12 smithi189 ceph-mon[32756]: pgmap v2632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:12 smithi156 ceph-mon[32679]: pgmap v2632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3769.280506 secs 2024-04-26T19:21:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:13 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3072.266226 secs 2024-04-26T19:21:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3769.280506 secs 2024-04-26T19:21:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:13 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3072.266226 secs 2024-04-26T19:21:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3769.280506 secs 2024-04-26T19:21:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:13 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3072.266226 secs 2024-04-26T19:21:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:14 smithi092 ceph-mon[29156]: pgmap v2633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:14 smithi189 ceph-mon[32756]: pgmap v2633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:14 smithi156 ceph-mon[32679]: pgmap v2633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:16 smithi092 ceph-mon[29156]: pgmap v2634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:16 smithi189 ceph-mon[32756]: pgmap v2634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:16 smithi156 ceph-mon[32679]: pgmap v2634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:18 smithi092 ceph-mon[29156]: pgmap v2635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3774.280619 secs 2024-04-26T19:21:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:18 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3077.266288 secs 2024-04-26T19:21:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:18 smithi189 ceph-mon[32756]: pgmap v2635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3774.280619 secs 2024-04-26T19:21:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:18 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3077.266288 secs 2024-04-26T19:21:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:18 smithi156 ceph-mon[32679]: pgmap v2635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3774.280619 secs 2024-04-26T19:21:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:18 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3077.266288 secs 2024-04-26T19:21:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:20 smithi092 ceph-mon[29156]: pgmap v2636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:20 smithi189 ceph-mon[32756]: pgmap v2636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:20 smithi156 ceph-mon[32679]: pgmap v2636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:23.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:22 smithi156 ceph-mon[32679]: pgmap v2637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:22 smithi092 ceph-mon[29156]: pgmap v2637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:22 smithi189 ceph-mon[32756]: pgmap v2637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3779.280718 secs 2024-04-26T19:21:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:23 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3082.266382 secs 2024-04-26T19:21:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3779.280718 secs 2024-04-26T19:21:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:23 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3082.266382 secs 2024-04-26T19:21:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3779.280718 secs 2024-04-26T19:21:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:23 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3082.266382 secs 2024-04-26T19:21:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:21:25.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: pgmap v2638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:25.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: pgmap v2638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: pgmap v2638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: pgmap v2639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: pgmap v2639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: pgmap v2639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: pgmap v2640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: pgmap v2641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: pgmap v2640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: pgmap v2641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:21:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:21:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: pgmap v2640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: pgmap v2641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:21:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3784.280819 secs 2024-04-26T19:21:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:28 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3087.266493 secs 2024-04-26T19:21:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3784.280819 secs 2024-04-26T19:21:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:28 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3087.266493 secs 2024-04-26T19:21:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3784.280819 secs 2024-04-26T19:21:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:28 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3087.266493 secs 2024-04-26T19:21:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:29 smithi189 ceph-mon[32756]: pgmap v2642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:29 smithi156 ceph-mon[32679]: pgmap v2642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:29 smithi092 ceph-mon[29156]: pgmap v2642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:31 smithi156 ceph-mon[32679]: pgmap v2643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:31 smithi092 ceph-mon[29156]: pgmap v2643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:31 smithi189 ceph-mon[32756]: pgmap v2643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:33 smithi156 ceph-mon[32679]: pgmap v2644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:21:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:33 smithi092 ceph-mon[29156]: pgmap v2644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:21:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:33 smithi189 ceph-mon[32756]: pgmap v2644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:21:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3789.280980 secs 2024-04-26T19:21:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3092.266609 secs 2024-04-26T19:21:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3789.280980 secs 2024-04-26T19:21:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3092.266609 secs 2024-04-26T19:21:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3789.280980 secs 2024-04-26T19:21:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3092.266609 secs 2024-04-26T19:21:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:35 smithi092 ceph-mon[29156]: pgmap v2645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:35 smithi189 ceph-mon[32756]: pgmap v2645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:35 smithi156 ceph-mon[32679]: pgmap v2645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:21:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:21:36.495+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:21:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:21:36.495+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:21:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:21:36.496+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:21:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:21:36.496+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 33 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:21:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:37 smithi156 ceph-mon[32679]: pgmap v2646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:21:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:37 smithi092 ceph-mon[29156]: pgmap v2646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:21:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:37 smithi189 ceph-mon[32756]: pgmap v2646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:21:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3794.281114 secs 2024-04-26T19:21:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3794.281114 secs 2024-04-26T19:21:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3794.281114 secs 2024-04-26T19:21:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3097.266712 secs 2024-04-26T19:21:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:39 smithi189 ceph-mon[32756]: pgmap v2647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3097.266712 secs 2024-04-26T19:21:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:39 smithi156 ceph-mon[32679]: pgmap v2647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3097.266712 secs 2024-04-26T19:21:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:39 smithi092 ceph-mon[29156]: pgmap v2647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:41 smithi156 ceph-mon[32679]: pgmap v2648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:41 smithi092 ceph-mon[29156]: pgmap v2648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:41 smithi189 ceph-mon[32756]: pgmap v2648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:43 smithi156 ceph-mon[32679]: pgmap v2649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:43 smithi092 ceph-mon[29156]: pgmap v2649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:43 smithi189 ceph-mon[32756]: pgmap v2649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3799.281198 secs 2024-04-26T19:21:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3102.266806 secs 2024-04-26T19:21:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3799.281198 secs 2024-04-26T19:21:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3102.266806 secs 2024-04-26T19:21:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3799.281198 secs 2024-04-26T19:21:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3102.266806 secs 2024-04-26T19:21:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:45 smithi092 ceph-mon[29156]: pgmap v2650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:45 smithi189 ceph-mon[32756]: pgmap v2650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:45 smithi156 ceph-mon[32679]: pgmap v2650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:47 smithi156 ceph-mon[32679]: pgmap v2651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:47 smithi092 ceph-mon[29156]: pgmap v2651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:47 smithi189 ceph-mon[32756]: pgmap v2651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3804.281258 secs 2024-04-26T19:21:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3804.281258 secs 2024-04-26T19:21:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3804.281258 secs 2024-04-26T19:21:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3107.266869 secs 2024-04-26T19:21:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:49 smithi189 ceph-mon[32756]: pgmap v2652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3107.266869 secs 2024-04-26T19:21:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:49 smithi156 ceph-mon[32679]: pgmap v2652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3107.266869 secs 2024-04-26T19:21:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:49 smithi092 ceph-mon[29156]: pgmap v2652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:51 smithi156 ceph-mon[32679]: pgmap v2653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:51 smithi092 ceph-mon[29156]: pgmap v2653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:51 smithi189 ceph-mon[32756]: pgmap v2653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:53 smithi156 ceph-mon[32679]: pgmap v2654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:53 smithi092 ceph-mon[29156]: pgmap v2654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:53 smithi189 ceph-mon[32756]: pgmap v2654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3809.281400 secs 2024-04-26T19:21:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3112.266982 secs 2024-04-26T19:21:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3809.281400 secs 2024-04-26T19:21:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3112.266982 secs 2024-04-26T19:21:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3809.281400 secs 2024-04-26T19:21:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3112.266982 secs 2024-04-26T19:21:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:55 smithi092 ceph-mon[29156]: pgmap v2655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:55 smithi189 ceph-mon[32756]: pgmap v2655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:55 smithi156 ceph-mon[32679]: pgmap v2655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:21:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:57 smithi156 ceph-mon[32679]: pgmap v2656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:57 smithi092 ceph-mon[29156]: pgmap v2656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:57 smithi189 ceph-mon[32756]: pgmap v2656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:21:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3814.281537 secs 2024-04-26T19:21:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3814.281537 secs 2024-04-26T19:21:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3814.281537 secs 2024-04-26T19:22:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3117.267107 secs 2024-04-26T19:22:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:21:59 smithi189 ceph-mon[32756]: pgmap v2657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3117.267107 secs 2024-04-26T19:22:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:21:59 smithi156 ceph-mon[32679]: pgmap v2657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3117.267107 secs 2024-04-26T19:22:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:21:59 smithi092 ceph-mon[29156]: pgmap v2657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:01 smithi156 ceph-mon[32679]: pgmap v2658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-mon[29156]: pgmap v2658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:01 smithi189 ceph-mon[32756]: pgmap v2658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:22:01.981+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:22:02.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:22:01.981+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:22:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:22:01.981+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:22:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:22:01.981+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:22:02.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:22:01 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:22:01.981+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:22:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:03 smithi156 ceph-mon[32679]: pgmap v2659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:03 smithi092 ceph-mon[29156]: pgmap v2659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:03 smithi189 ceph-mon[32756]: pgmap v2659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3819.281605 secs 2024-04-26T19:22:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3122.267225 secs 2024-04-26T19:22:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3819.281605 secs 2024-04-26T19:22:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3122.267225 secs 2024-04-26T19:22:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3819.281605 secs 2024-04-26T19:22:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3122.267225 secs 2024-04-26T19:22:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:05 smithi092 ceph-mon[29156]: pgmap v2660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:05 smithi189 ceph-mon[32756]: pgmap v2660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:05 smithi156 ceph-mon[32679]: pgmap v2660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:07 smithi092 ceph-mon[29156]: pgmap v2661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:07 smithi189 ceph-mon[32756]: pgmap v2661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:07 smithi156 ceph-mon[32679]: pgmap v2661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3824.281747 secs 2024-04-26T19:22:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3824.281747 secs 2024-04-26T19:22:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3824.281747 secs 2024-04-26T19:22:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3127.267344 secs 2024-04-26T19:22:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:09 smithi189 ceph-mon[32756]: pgmap v2662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3127.267344 secs 2024-04-26T19:22:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:09 smithi156 ceph-mon[32679]: pgmap v2662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3127.267344 secs 2024-04-26T19:22:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:09 smithi092 ceph-mon[29156]: pgmap v2662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:11 smithi092 ceph-mon[29156]: pgmap v2663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:11 smithi189 ceph-mon[32756]: pgmap v2663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:11 smithi156 ceph-mon[32679]: pgmap v2663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:13 smithi092 ceph-mon[29156]: pgmap v2664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:13 smithi189 ceph-mon[32756]: pgmap v2664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:13 smithi156 ceph-mon[32679]: pgmap v2664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-26T19:22:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3829.281913 secs 2024-04-26T19:22:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3132.267388 secs 2024-04-26T19:22:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3829.281913 secs 2024-04-26T19:22:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3132.267388 secs 2024-04-26T19:22:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3829.281913 secs 2024-04-26T19:22:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3132.267388 secs 2024-04-26T19:22:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:15 smithi092 ceph-mon[29156]: pgmap v2665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:15 smithi189 ceph-mon[32756]: pgmap v2665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:15 smithi156 ceph-mon[32679]: pgmap v2665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-26T19:22:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:17 smithi092 ceph-mon[29156]: pgmap v2666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:17 smithi189 ceph-mon[32756]: pgmap v2666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:17 smithi156 ceph-mon[32679]: pgmap v2666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3834.282037 secs 2024-04-26T19:22:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3834.282037 secs 2024-04-26T19:22:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3834.282037 secs 2024-04-26T19:22:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3137.267492 secs 2024-04-26T19:22:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:19 smithi189 ceph-mon[32756]: pgmap v2667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3137.267492 secs 2024-04-26T19:22:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:19 smithi156 ceph-mon[32679]: pgmap v2667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3137.267492 secs 2024-04-26T19:22:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:19 smithi092 ceph-mon[29156]: pgmap v2667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:21 smithi092 ceph-mon[29156]: pgmap v2668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:21 smithi189 ceph-mon[32756]: pgmap v2668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:21 smithi156 ceph-mon[32679]: pgmap v2668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:23.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:23 smithi156 ceph-mon[32679]: pgmap v2669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:23 smithi092 ceph-mon[29156]: pgmap v2669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:23 smithi189 ceph-mon[32756]: pgmap v2669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3839.282136 secs 2024-04-26T19:22:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3142.267556 secs 2024-04-26T19:22:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3839.282136 secs 2024-04-26T19:22:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3142.267556 secs 2024-04-26T19:22:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3839.282136 secs 2024-04-26T19:22:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3142.267556 secs 2024-04-26T19:22:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:25 smithi092 ceph-mon[29156]: pgmap v2670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:25 smithi189 ceph-mon[32756]: pgmap v2670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:25 smithi156 ceph-mon[32679]: pgmap v2670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:27 smithi092 ceph-mon[29156]: pgmap v2671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:27 smithi189 ceph-mon[32756]: pgmap v2671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:27 smithi156 ceph-mon[32679]: pgmap v2671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: pgmap v2672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:22:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: pgmap v2673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: pgmap v2672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: pgmap v2673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:22:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:22:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:22:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:22:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: pgmap v2672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:22:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: pgmap v2673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:22:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:22:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3844.282198 secs 2024-04-26T19:22:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3147.267643 secs 2024-04-26T19:22:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3844.282198 secs 2024-04-26T19:22:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3147.267643 secs 2024-04-26T19:22:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3844.282198 secs 2024-04-26T19:22:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3147.267643 secs 2024-04-26T19:22:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:30 smithi092 ceph-mon[29156]: pgmap v2674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:30 smithi189 ceph-mon[32756]: pgmap v2674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:30 smithi156 ceph-mon[32679]: pgmap v2674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:32 smithi156 ceph-mon[32679]: pgmap v2675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:32 smithi092 ceph-mon[29156]: pgmap v2675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:32 smithi189 ceph-mon[32756]: pgmap v2675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3849.282348 secs 2024-04-26T19:22:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:33 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3152.267761 secs 2024-04-26T19:22:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3849.282348 secs 2024-04-26T19:22:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:33 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3152.267761 secs 2024-04-26T19:22:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3849.282348 secs 2024-04-26T19:22:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:33 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3152.267761 secs 2024-04-26T19:22:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:34 smithi092 ceph-mon[29156]: pgmap v2676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:34 smithi189 ceph-mon[32756]: pgmap v2676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:34 smithi156 ceph-mon[32679]: pgmap v2676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:36 smithi092 ceph-mon[29156]: pgmap v2677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:36 smithi189 ceph-mon[32756]: pgmap v2677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:36 smithi156 ceph-mon[32679]: pgmap v2677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:22:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:38 smithi092 ceph-mon[29156]: pgmap v2678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:22:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3854.282482 secs 2024-04-26T19:22:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:38 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3157.267877 secs 2024-04-26T19:22:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:38 smithi189 ceph-mon[32756]: pgmap v2678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:22:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3854.282482 secs 2024-04-26T19:22:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:38 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3157.267877 secs 2024-04-26T19:22:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:38 smithi156 ceph-mon[32679]: pgmap v2678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:22:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3854.282482 secs 2024-04-26T19:22:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:38 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3157.267877 secs 2024-04-26T19:22:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:40 smithi092 ceph-mon[29156]: pgmap v2679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:40 smithi189 ceph-mon[32756]: pgmap v2679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:40 smithi156 ceph-mon[32679]: pgmap v2679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:42 smithi092 ceph-mon[29156]: pgmap v2680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:42 smithi189 ceph-mon[32756]: pgmap v2680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:42 smithi156 ceph-mon[32679]: pgmap v2680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3859.282604 secs 2024-04-26T19:22:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:43 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3162.268006 secs 2024-04-26T19:22:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3859.282604 secs 2024-04-26T19:22:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:43 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3162.268006 secs 2024-04-26T19:22:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3859.282604 secs 2024-04-26T19:22:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:43 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3162.268006 secs 2024-04-26T19:22:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:44 smithi092 ceph-mon[29156]: pgmap v2681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:44 smithi189 ceph-mon[32756]: pgmap v2681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:44 smithi156 ceph-mon[32679]: pgmap v2681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:46 smithi092 ceph-mon[29156]: pgmap v2682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:46 smithi189 ceph-mon[32756]: pgmap v2682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:46 smithi156 ceph-mon[32679]: pgmap v2682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:48 smithi092 ceph-mon[29156]: pgmap v2683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3864.282744 secs 2024-04-26T19:22:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:48 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3167.268151 secs 2024-04-26T19:22:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:48 smithi189 ceph-mon[32756]: pgmap v2683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3864.282744 secs 2024-04-26T19:22:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:48 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3167.268151 secs 2024-04-26T19:22:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:48 smithi156 ceph-mon[32679]: pgmap v2683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3864.282744 secs 2024-04-26T19:22:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:48 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3167.268151 secs 2024-04-26T19:22:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:50 smithi092 ceph-mon[29156]: pgmap v2684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:50 smithi189 ceph-mon[32756]: pgmap v2684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:50 smithi156 ceph-mon[32679]: pgmap v2684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:53.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:52 smithi156 ceph-mon[32679]: pgmap v2685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:52 smithi092 ceph-mon[29156]: pgmap v2685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:52 smithi189 ceph-mon[32756]: pgmap v2685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3869.282871 secs 2024-04-26T19:22:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:53 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3172.268327 secs 2024-04-26T19:22:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3869.282871 secs 2024-04-26T19:22:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:53 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3172.268327 secs 2024-04-26T19:22:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3869.282871 secs 2024-04-26T19:22:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:53 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3172.268327 secs 2024-04-26T19:22:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:54 smithi092 ceph-mon[29156]: pgmap v2686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:54 smithi189 ceph-mon[32756]: pgmap v2686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:54 smithi156 ceph-mon[32679]: pgmap v2686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:22:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:56 smithi092 ceph-mon[29156]: pgmap v2687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:56 smithi189 ceph-mon[32756]: pgmap v2687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:56 smithi156 ceph-mon[32679]: pgmap v2687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:58 smithi092 ceph-mon[29156]: pgmap v2688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3874.282983 secs 2024-04-26T19:22:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:22:58 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3177.268405 secs 2024-04-26T19:22:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:58 smithi189 ceph-mon[32756]: pgmap v2688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3874.282983 secs 2024-04-26T19:22:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:22:58 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3177.268405 secs 2024-04-26T19:22:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:58 smithi156 ceph-mon[32679]: pgmap v2688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:22:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3874.282983 secs 2024-04-26T19:22:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:22:58 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3177.268405 secs 2024-04-26T19:23:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:00 smithi092 ceph-mon[29156]: pgmap v2689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:00 smithi189 ceph-mon[32756]: pgmap v2689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:00 smithi156 ceph-mon[32679]: pgmap v2689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:02 smithi092 ceph-mon[29156]: pgmap v2690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:02 smithi189 ceph-mon[32756]: pgmap v2690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:02 smithi156 ceph-mon[32679]: pgmap v2690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:04.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3879.283133 secs 2024-04-26T19:23:04.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:03 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 3182.268519 secs 2024-04-26T19:23:04.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:03 smithi092 ceph-mon[29156]: slow request 361.478996 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:23:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3879.283133 secs 2024-04-26T19:23:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:04 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 3182.268519 secs 2024-04-26T19:23:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:04 smithi189 ceph-mon[32756]: slow request 361.478996 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:23:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3879.283133 secs 2024-04-26T19:23:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:03 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 3182.268519 secs 2024-04-26T19:23:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:03 smithi156 ceph-mon[32679]: slow request 361.478996 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:23:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:04 smithi189 ceph-mon[32756]: pgmap v2691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:04 smithi156 ceph-mon[32679]: pgmap v2691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:04 smithi092 ceph-mon[29156]: pgmap v2691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:07 smithi189 ceph-mon[32756]: pgmap v2692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:07 smithi156 ceph-mon[32679]: pgmap v2692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:07 smithi092 ceph-mon[29156]: pgmap v2692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:09 smithi189 ceph-mon[32756]: pgmap v2693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3884.283260 secs 2024-04-26T19:23:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3187.268618 secs 2024-04-26T19:23:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:09 smithi156 ceph-mon[32679]: pgmap v2693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3884.283260 secs 2024-04-26T19:23:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3187.268618 secs 2024-04-26T19:23:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:09 smithi092 ceph-mon[29156]: pgmap v2693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3884.283260 secs 2024-04-26T19:23:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3187.268618 secs 2024-04-26T19:23:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:11 smithi189 ceph-mon[32756]: pgmap v2694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:11 smithi156 ceph-mon[32679]: pgmap v2694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:11 smithi092 ceph-mon[29156]: pgmap v2694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:13 smithi189 ceph-mon[32756]: pgmap v2695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:13 smithi156 ceph-mon[32679]: pgmap v2695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:13 smithi092 ceph-mon[29156]: pgmap v2695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3889.283390 secs 2024-04-26T19:23:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3192.268738 secs 2024-04-26T19:23:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3889.283390 secs 2024-04-26T19:23:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3192.268738 secs 2024-04-26T19:23:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3889.283390 secs 2024-04-26T19:23:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3192.268738 secs 2024-04-26T19:23:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:15 smithi189 ceph-mon[32756]: pgmap v2696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:15 smithi156 ceph-mon[32679]: pgmap v2696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:15 smithi092 ceph-mon[29156]: pgmap v2696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:17 smithi189 ceph-mon[32756]: pgmap v2697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:17 smithi156 ceph-mon[32679]: pgmap v2697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:17 smithi092 ceph-mon[29156]: pgmap v2697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:19 smithi189 ceph-mon[32756]: pgmap v2698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3894.283518 secs 2024-04-26T19:23:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3197.268879 secs 2024-04-26T19:23:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:19 smithi156 ceph-mon[32679]: pgmap v2698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3894.283518 secs 2024-04-26T19:23:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3197.268879 secs 2024-04-26T19:23:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:19 smithi092 ceph-mon[29156]: pgmap v2698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3894.283518 secs 2024-04-26T19:23:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3197.268879 secs 2024-04-26T19:23:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:21 smithi189 ceph-mon[32756]: pgmap v2699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:21 smithi156 ceph-mon[32679]: pgmap v2699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:21 smithi092 ceph-mon[29156]: pgmap v2699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:23 smithi189 ceph-mon[32756]: pgmap v2700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:23 smithi156 ceph-mon[32679]: pgmap v2700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:23 smithi092 ceph-mon[29156]: pgmap v2700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3899.283620 secs 2024-04-26T19:23:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3202.269000 secs 2024-04-26T19:23:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3899.283620 secs 2024-04-26T19:23:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3202.269000 secs 2024-04-26T19:23:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3899.283620 secs 2024-04-26T19:23:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3202.269000 secs 2024-04-26T19:23:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:25 smithi189 ceph-mon[32756]: pgmap v2701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:25 smithi156 ceph-mon[32679]: pgmap v2701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:25 smithi092 ceph-mon[29156]: pgmap v2701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:27 smithi189 ceph-mon[32756]: pgmap v2702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:27 smithi156 ceph-mon[32679]: pgmap v2702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:27 smithi092 ceph-mon[29156]: pgmap v2702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:23:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: pgmap v2703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3904.283710 secs 2024-04-26T19:23:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3207.269093 secs 2024-04-26T19:23:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:23:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: pgmap v2703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3904.283710 secs 2024-04-26T19:23:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3207.269093 secs 2024-04-26T19:23:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:23:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: pgmap v2703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3904.283710 secs 2024-04-26T19:23:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3207.269093 secs 2024-04-26T19:23:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:23:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:23:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:23:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:30 smithi189 ceph-mon[32756]: pgmap v2704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:23:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:30 smithi189 ceph-mon[32756]: pgmap v2705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:30 smithi156 ceph-mon[32679]: pgmap v2704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:23:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:30 smithi156 ceph-mon[32679]: pgmap v2705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:30 smithi092 ceph-mon[29156]: pgmap v2704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:23:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:30 smithi092 ceph-mon[29156]: pgmap v2705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:32 smithi189 ceph-mon[32756]: pgmap v2706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:32 smithi156 ceph-mon[32679]: pgmap v2706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:32 smithi092 ceph-mon[29156]: pgmap v2706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:34 smithi189 ceph-mon[32756]: pgmap v2707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:23:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3909.283860 secs 2024-04-26T19:23:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3212.269229 secs 2024-04-26T19:23:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:34 smithi156 ceph-mon[32679]: pgmap v2707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:23:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3909.283860 secs 2024-04-26T19:23:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3212.269229 secs 2024-04-26T19:23:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:34 smithi092 ceph-mon[29156]: pgmap v2707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:23:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3909.283860 secs 2024-04-26T19:23:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3212.269229 secs 2024-04-26T19:23:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:36 smithi189 ceph-mon[32756]: pgmap v2708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:36 smithi156 ceph-mon[32679]: pgmap v2708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:36 smithi092 ceph-mon[29156]: pgmap v2708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:38 smithi189 ceph-mon[32756]: pgmap v2709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:38 smithi156 ceph-mon[32679]: pgmap v2709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:38 smithi092 ceph-mon[29156]: pgmap v2709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:23:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3914.283982 secs 2024-04-26T19:23:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3217.269384 secs 2024-04-26T19:23:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3914.283982 secs 2024-04-26T19:23:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3217.269384 secs 2024-04-26T19:23:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3914.283982 secs 2024-04-26T19:23:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3217.269384 secs 2024-04-26T19:23:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:40 smithi189 ceph-mon[32756]: pgmap v2710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:23:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:40 smithi156 ceph-mon[32679]: pgmap v2710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:23:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:40 smithi092 ceph-mon[29156]: pgmap v2710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:23:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:42 smithi189 ceph-mon[32756]: pgmap v2711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:42 smithi156 ceph-mon[32679]: pgmap v2711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:42 smithi092 ceph-mon[29156]: pgmap v2711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:44 smithi189 ceph-mon[32756]: pgmap v2712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3919.284097 secs 2024-04-26T19:23:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3222.269492 secs 2024-04-26T19:23:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:44 smithi156 ceph-mon[32679]: pgmap v2712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3919.284097 secs 2024-04-26T19:23:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3222.269492 secs 2024-04-26T19:23:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:44 smithi092 ceph-mon[29156]: pgmap v2712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3919.284097 secs 2024-04-26T19:23:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3222.269492 secs 2024-04-26T19:23:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:46 smithi189 ceph-mon[32756]: pgmap v2713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:46 smithi156 ceph-mon[32679]: pgmap v2713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:46 smithi092 ceph-mon[29156]: pgmap v2713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:48 smithi189 ceph-mon[32756]: pgmap v2714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:48 smithi156 ceph-mon[32679]: pgmap v2714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:48 smithi092 ceph-mon[29156]: pgmap v2714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3924.284223 secs 2024-04-26T19:23:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3227.269579 secs 2024-04-26T19:23:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3924.284223 secs 2024-04-26T19:23:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3227.269579 secs 2024-04-26T19:23:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3924.284223 secs 2024-04-26T19:23:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3227.269579 secs 2024-04-26T19:23:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:50 smithi189 ceph-mon[32756]: pgmap v2715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:50 smithi156 ceph-mon[32679]: pgmap v2715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:50 smithi092 ceph-mon[29156]: pgmap v2715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:52 smithi189 ceph-mon[32756]: pgmap v2716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:52 smithi156 ceph-mon[32679]: pgmap v2716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:52 smithi092 ceph-mon[29156]: pgmap v2716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:54 smithi189 ceph-mon[32756]: pgmap v2717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3929.284355 secs 2024-04-26T19:23:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3232.269656 secs 2024-04-26T19:23:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:54 smithi156 ceph-mon[32679]: pgmap v2717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3929.284355 secs 2024-04-26T19:23:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3232.269656 secs 2024-04-26T19:23:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:54 smithi092 ceph-mon[29156]: pgmap v2717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3929.284355 secs 2024-04-26T19:23:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3232.269656 secs 2024-04-26T19:23:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:56 smithi189 ceph-mon[32756]: pgmap v2718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:56 smithi156 ceph-mon[32679]: pgmap v2718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:56 smithi092 ceph-mon[29156]: pgmap v2718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:23:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:58 smithi189 ceph-mon[32756]: pgmap v2719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:58 smithi156 ceph-mon[32679]: pgmap v2719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:58 smithi092 ceph-mon[29156]: pgmap v2719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:23:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3934.284484 secs 2024-04-26T19:23:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:23:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3237.269765 secs 2024-04-26T19:23:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3934.284484 secs 2024-04-26T19:23:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:23:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3237.269765 secs 2024-04-26T19:23:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3934.284484 secs 2024-04-26T19:23:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:23:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3237.269765 secs 2024-04-26T19:24:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:00 smithi189 ceph-mon[32756]: pgmap v2720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:00 smithi156 ceph-mon[32679]: pgmap v2720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:00 smithi092 ceph-mon[29156]: pgmap v2720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:02 smithi189 ceph-mon[32756]: pgmap v2721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:02 smithi156 ceph-mon[32679]: pgmap v2721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:02 smithi092 ceph-mon[29156]: pgmap v2721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:04 smithi189 ceph-mon[32756]: pgmap v2722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3939.284630 secs 2024-04-26T19:24:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3242.269893 secs 2024-04-26T19:24:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:04 smithi156 ceph-mon[32679]: pgmap v2722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3939.284630 secs 2024-04-26T19:24:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3242.269893 secs 2024-04-26T19:24:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:04 smithi092 ceph-mon[29156]: pgmap v2722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3939.284630 secs 2024-04-26T19:24:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3242.269893 secs 2024-04-26T19:24:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:06 smithi189 ceph-mon[32756]: pgmap v2723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:06 smithi156 ceph-mon[32679]: pgmap v2723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:06 smithi092 ceph-mon[29156]: pgmap v2723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:08 smithi189 ceph-mon[32756]: pgmap v2724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:08 smithi156 ceph-mon[32679]: pgmap v2724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:08 smithi092 ceph-mon[29156]: pgmap v2724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3944.284775 secs 2024-04-26T19:24:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3247.270026 secs 2024-04-26T19:24:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3944.284775 secs 2024-04-26T19:24:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3247.270026 secs 2024-04-26T19:24:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3944.284775 secs 2024-04-26T19:24:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3247.270026 secs 2024-04-26T19:24:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:10 smithi156 ceph-mon[32679]: pgmap v2725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:10 smithi092 ceph-mon[29156]: pgmap v2725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:10 smithi189 ceph-mon[32756]: pgmap v2725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:11 smithi156 ceph-mon[32679]: pgmap v2726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:11 smithi092 ceph-mon[29156]: pgmap v2726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:11 smithi189 ceph-mon[32756]: pgmap v2726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:13 smithi156 ceph-mon[32679]: pgmap v2727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:13 smithi092 ceph-mon[29156]: pgmap v2727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:13 smithi189 ceph-mon[32756]: pgmap v2727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3949.284855 secs 2024-04-26T19:24:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3252.270154 secs 2024-04-26T19:24:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3949.284855 secs 2024-04-26T19:24:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3252.270154 secs 2024-04-26T19:24:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3949.284855 secs 2024-04-26T19:24:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3252.270154 secs 2024-04-26T19:24:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:15 smithi092 ceph-mon[29156]: pgmap v2728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:15 smithi189 ceph-mon[32756]: pgmap v2728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:15 smithi156 ceph-mon[32679]: pgmap v2728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:17 smithi092 ceph-mon[29156]: pgmap v2729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:17 smithi189 ceph-mon[32756]: pgmap v2729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:17 smithi156 ceph-mon[32679]: pgmap v2729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3954.284951 secs 2024-04-26T19:24:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3257.270327 secs 2024-04-26T19:24:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:19 smithi092 ceph-mon[29156]: pgmap v2730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3954.284951 secs 2024-04-26T19:24:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3257.270327 secs 2024-04-26T19:24:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:19 smithi189 ceph-mon[32756]: pgmap v2730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3954.284951 secs 2024-04-26T19:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3257.270327 secs 2024-04-26T19:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:19 smithi156 ceph-mon[32679]: pgmap v2730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:21 smithi092 ceph-mon[29156]: pgmap v2731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:21 smithi189 ceph-mon[32756]: pgmap v2731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:21 smithi156 ceph-mon[32679]: pgmap v2731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:23 smithi092 ceph-mon[29156]: pgmap v2732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:23 smithi189 ceph-mon[32756]: pgmap v2732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:23 smithi156 ceph-mon[32679]: pgmap v2732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3959.285073 secs 2024-04-26T19:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3262.270446 secs 2024-04-26T19:24:25.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3959.285073 secs 2024-04-26T19:24:25.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3262.270446 secs 2024-04-26T19:24:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3959.285073 secs 2024-04-26T19:24:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3262.270446 secs 2024-04-26T19:24:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:25 smithi092 ceph-mon[29156]: pgmap v2733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:25 smithi189 ceph-mon[32756]: pgmap v2733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:25 smithi156 ceph-mon[32679]: pgmap v2733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:27 smithi092 ceph-mon[29156]: pgmap v2734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:27 smithi189 ceph-mon[32756]: pgmap v2734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:27 smithi156 ceph-mon[32679]: pgmap v2734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3964.285202 secs 2024-04-26T19:24:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3267.270518 secs 2024-04-26T19:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: pgmap v2735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:24:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3964.285202 secs 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3267.270518 secs 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: pgmap v2735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:24:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3964.285202 secs 2024-04-26T19:24:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3267.270518 secs 2024-04-26T19:24:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: pgmap v2735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:24:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:30 smithi092 ceph-mon[29156]: pgmap v2736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:30 smithi092 ceph-mon[29156]: pgmap v2737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:30 smithi189 ceph-mon[32756]: pgmap v2736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:30 smithi189 ceph-mon[32756]: pgmap v2737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:30 smithi156 ceph-mon[32679]: pgmap v2736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:30 smithi156 ceph-mon[32679]: pgmap v2737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:32 smithi092 ceph-mon[29156]: pgmap v2738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:32 smithi189 ceph-mon[32756]: pgmap v2738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:32 smithi156 ceph-mon[32679]: pgmap v2738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3969.285326 secs 2024-04-26T19:24:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3272.270604 secs 2024-04-26T19:24:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:34 smithi092 ceph-mon[29156]: pgmap v2739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3969.285326 secs 2024-04-26T19:24:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3272.270604 secs 2024-04-26T19:24:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:34 smithi189 ceph-mon[32756]: pgmap v2739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3969.285326 secs 2024-04-26T19:24:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3272.270604 secs 2024-04-26T19:24:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:34 smithi156 ceph-mon[32679]: pgmap v2739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:36.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 34 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:24:36.521 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:24:36.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 35 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:24:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:36 smithi092 ceph-mon[29156]: pgmap v2740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:36 smithi189 ceph-mon[32756]: pgmap v2740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:36 smithi156 ceph-mon[32679]: pgmap v2740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:24:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:38 smithi092 ceph-mon[29156]: pgmap v2741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:38 smithi189 ceph-mon[32756]: pgmap v2741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:38 smithi156 ceph-mon[32679]: pgmap v2741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:24:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3974.285392 secs 2024-04-26T19:24:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3277.270681 secs 2024-04-26T19:24:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3974.285392 secs 2024-04-26T19:24:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3277.270681 secs 2024-04-26T19:24:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3974.285392 secs 2024-04-26T19:24:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3277.270681 secs 2024-04-26T19:24:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:40 smithi189 ceph-mon[32756]: pgmap v2742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:40 smithi156 ceph-mon[32679]: pgmap v2742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:40 smithi092 ceph-mon[29156]: pgmap v2742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:24:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:42 smithi189 ceph-mon[32756]: pgmap v2743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:42 smithi156 ceph-mon[32679]: pgmap v2743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:42 smithi092 ceph-mon[29156]: pgmap v2743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3979.285514 secs 2024-04-26T19:24:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3282.270752 secs 2024-04-26T19:24:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:44 smithi189 ceph-mon[32756]: pgmap v2744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3979.285514 secs 2024-04-26T19:24:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3282.270752 secs 2024-04-26T19:24:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:44 smithi156 ceph-mon[32679]: pgmap v2744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3979.285514 secs 2024-04-26T19:24:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3282.270752 secs 2024-04-26T19:24:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:44 smithi092 ceph-mon[29156]: pgmap v2744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:46 smithi189 ceph-mon[32756]: pgmap v2745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:46 smithi156 ceph-mon[32679]: pgmap v2745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:46 smithi092 ceph-mon[29156]: pgmap v2745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:48 smithi189 ceph-mon[32756]: pgmap v2746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:48 smithi156 ceph-mon[32679]: pgmap v2746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:48 smithi092 ceph-mon[29156]: pgmap v2746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:24:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3984.285647 secs 2024-04-26T19:24:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3287.270873 secs 2024-04-26T19:24:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3984.285647 secs 2024-04-26T19:24:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3287.270873 secs 2024-04-26T19:24:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3984.285647 secs 2024-04-26T19:24:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3287.270873 secs 2024-04-26T19:24:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:50 smithi189 ceph-mon[32756]: pgmap v2747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:50 smithi156 ceph-mon[32679]: pgmap v2747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:50 smithi092 ceph-mon[29156]: pgmap v2747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:24:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:52 smithi189 ceph-mon[32756]: pgmap v2748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:52 smithi156 ceph-mon[32679]: pgmap v2748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:52 smithi092 ceph-mon[29156]: pgmap v2748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3989.285776 secs 2024-04-26T19:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3292.270973 secs 2024-04-26T19:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:54 smithi189 ceph-mon[32756]: pgmap v2749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3989.285776 secs 2024-04-26T19:24:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3292.270973 secs 2024-04-26T19:24:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:54 smithi156 ceph-mon[32679]: pgmap v2749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3989.285776 secs 2024-04-26T19:24:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3292.270973 secs 2024-04-26T19:24:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:54 smithi092 ceph-mon[29156]: pgmap v2749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:56 smithi189 ceph-mon[32756]: pgmap v2750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:56 smithi156 ceph-mon[32679]: pgmap v2750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:56 smithi092 ceph-mon[29156]: pgmap v2750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:24:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:58 smithi189 ceph-mon[32756]: pgmap v2751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:58 smithi156 ceph-mon[32679]: pgmap v2751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:24:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:58 smithi092 ceph-mon[29156]: pgmap v2751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 3994.285894 secs 2024-04-26T19:25:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:24:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 3297.271088 secs 2024-04-26T19:25:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 3994.285894 secs 2024-04-26T19:25:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:24:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 3297.271088 secs 2024-04-26T19:25:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 3994.285894 secs 2024-04-26T19:25:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:24:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 3297.271088 secs 2024-04-26T19:25:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:00 smithi189 ceph-mon[32756]: pgmap v2752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:00 smithi156 ceph-mon[32679]: pgmap v2752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:00 smithi092 ceph-mon[29156]: pgmap v2752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:02 smithi189 ceph-mon[32756]: pgmap v2753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:02 smithi156 ceph-mon[32679]: pgmap v2753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:02 smithi092 ceph-mon[29156]: pgmap v2753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:05.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 3999.286010 secs 2024-04-26T19:25:05.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:04 smithi092 ceph-mon[29156]: slow request 1441.542129 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:05.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 3302.271167 secs 2024-04-26T19:25:05.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:04 smithi092 ceph-mon[29156]: slow request 181.429071 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:25:05.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:04 smithi092 ceph-mon[29156]: pgmap v2754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 3999.286010 secs 2024-04-26T19:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:04 smithi189 ceph-mon[32756]: slow request 1441.542129 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 3302.271167 secs 2024-04-26T19:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:04 smithi189 ceph-mon[32756]: slow request 181.429071 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:04 smithi189 ceph-mon[32756]: pgmap v2754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 3999.286010 secs 2024-04-26T19:25:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:04 smithi156 ceph-mon[32679]: slow request 1441.542129 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:25:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 3302.271167 secs 2024-04-26T19:25:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:04 smithi156 ceph-mon[32679]: slow request 181.429071 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:25:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:04 smithi156 ceph-mon[32679]: pgmap v2754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:06 smithi189 ceph-mon[32756]: pgmap v2755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:06 smithi156 ceph-mon[32679]: pgmap v2755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:06 smithi092 ceph-mon[29156]: pgmap v2755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:07 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:07 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:25:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:07 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:25:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:07 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:25:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:07 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:25:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:07 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:25:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:08 smithi189 ceph-mon[32756]: pgmap v2756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:09.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:08 smithi092 ceph-mon[29156]: pgmap v2756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:08 smithi156 ceph-mon[32679]: pgmap v2756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4004.286132 secs 2024-04-26T19:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3307.271323 secs 2024-04-26T19:25:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4004.286132 secs 2024-04-26T19:25:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3307.271323 secs 2024-04-26T19:25:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4004.286132 secs 2024-04-26T19:25:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3307.271323 secs 2024-04-26T19:25:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:10 smithi189 ceph-mon[32756]: pgmap v2757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:10 smithi156 ceph-mon[32679]: pgmap v2757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:10 smithi092 ceph-mon[29156]: pgmap v2757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:12 smithi189 ceph-mon[32756]: pgmap v2758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:12 smithi156 ceph-mon[32679]: pgmap v2758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:12 smithi092 ceph-mon[29156]: pgmap v2758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4009.286255 secs 2024-04-26T19:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3312.271407 secs 2024-04-26T19:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:14 smithi189 ceph-mon[32756]: pgmap v2759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4009.286255 secs 2024-04-26T19:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3312.271407 secs 2024-04-26T19:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:14 smithi156 ceph-mon[32679]: pgmap v2759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4009.286255 secs 2024-04-26T19:25:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3312.271407 secs 2024-04-26T19:25:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:14 smithi092 ceph-mon[29156]: pgmap v2759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:16 smithi189 ceph-mon[32756]: pgmap v2760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:16 smithi156 ceph-mon[32679]: pgmap v2760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:16 smithi092 ceph-mon[29156]: pgmap v2760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:18 smithi189 ceph-mon[32756]: pgmap v2761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:18 smithi156 ceph-mon[32679]: pgmap v2761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:18 smithi092 ceph-mon[29156]: pgmap v2761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4014.286395 secs 2024-04-26T19:25:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3317.271544 secs 2024-04-26T19:25:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4014.286395 secs 2024-04-26T19:25:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3317.271544 secs 2024-04-26T19:25:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4014.286395 secs 2024-04-26T19:25:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3317.271544 secs 2024-04-26T19:25:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:20 smithi189 ceph-mon[32756]: pgmap v2762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:20 smithi156 ceph-mon[32679]: pgmap v2762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:20 smithi092 ceph-mon[29156]: pgmap v2762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:22 smithi189 ceph-mon[32756]: pgmap v2763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:22 smithi156 ceph-mon[32679]: pgmap v2763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:22 smithi092 ceph-mon[29156]: pgmap v2763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4019.286529 secs 2024-04-26T19:25:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3322.271687 secs 2024-04-26T19:25:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:24 smithi092 ceph-mon[29156]: pgmap v2764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4019.286529 secs 2024-04-26T19:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3322.271687 secs 2024-04-26T19:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:24 smithi189 ceph-mon[32756]: pgmap v2764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4019.286529 secs 2024-04-26T19:25:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3322.271687 secs 2024-04-26T19:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:24 smithi156 ceph-mon[32679]: pgmap v2764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:26 smithi189 ceph-mon[32756]: pgmap v2765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:26 smithi156 ceph-mon[32679]: pgmap v2765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:26 smithi092 ceph-mon[29156]: pgmap v2765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:28 smithi189 ceph-mon[32756]: pgmap v2766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:28 smithi156 ceph-mon[32679]: pgmap v2766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:28 smithi092 ceph-mon[29156]: pgmap v2766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4024.286652 secs 2024-04-26T19:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3327.271826 secs 2024-04-26T19:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:25:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4024.286652 secs 2024-04-26T19:25:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3327.271826 secs 2024-04-26T19:25:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:25:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4024.286652 secs 2024-04-26T19:25:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3327.271826 secs 2024-04-26T19:25:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:25:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:30 smithi189 ceph-mon[32756]: pgmap v2767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:25:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:25:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:25:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:30 smithi156 ceph-mon[32679]: pgmap v2767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:25:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:25:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:25:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:30 smithi092 ceph-mon[29156]: pgmap v2767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:25:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:25:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:25:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:31 smithi189 ceph-mon[32756]: pgmap v2768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:25:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:31 smithi189 ceph-mon[32756]: pgmap v2769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:31 smithi156 ceph-mon[32679]: pgmap v2768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:25:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:31 smithi156 ceph-mon[32679]: pgmap v2769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:32.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:31 smithi092 ceph-mon[29156]: pgmap v2768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:25:32.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:31 smithi092 ceph-mon[29156]: pgmap v2769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:33 smithi189 ceph-mon[32756]: pgmap v2770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4029.286765 secs 2024-04-26T19:25:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:33 smithi156 ceph-mon[32679]: pgmap v2770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4029.286765 secs 2024-04-26T19:25:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:33 smithi092 ceph-mon[29156]: pgmap v2770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4029.286765 secs 2024-04-26T19:25:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3332.271943 secs 2024-04-26T19:25:35.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3332.271943 secs 2024-04-26T19:25:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3332.271943 secs 2024-04-26T19:25:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:35 smithi189 ceph-mon[32756]: pgmap v2771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:35 smithi156 ceph-mon[32679]: pgmap v2771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:35 smithi092 ceph-mon[29156]: pgmap v2771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:37 smithi189 ceph-mon[32756]: pgmap v2772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:37 smithi156 ceph-mon[32679]: pgmap v2772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:37 smithi092 ceph-mon[29156]: pgmap v2772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:25:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4034.286905 secs 2024-04-26T19:25:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4034.286905 secs 2024-04-26T19:25:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4034.286905 secs 2024-04-26T19:25:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:39 smithi189 ceph-mon[32756]: pgmap v2773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3337.272022 secs 2024-04-26T19:25:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:39 smithi156 ceph-mon[32679]: pgmap v2773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3337.272022 secs 2024-04-26T19:25:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:39 smithi092 ceph-mon[29156]: pgmap v2773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:25:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3337.272022 secs 2024-04-26T19:25:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:41 smithi156 ceph-mon[32679]: pgmap v2774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:25:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:41 smithi092 ceph-mon[29156]: pgmap v2774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:25:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:41 smithi189 ceph-mon[32756]: pgmap v2774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:25:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:43 smithi156 ceph-mon[32679]: pgmap v2775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4039.287023 secs 2024-04-26T19:25:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:43 smithi092 ceph-mon[29156]: pgmap v2775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4039.287023 secs 2024-04-26T19:25:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:43 smithi189 ceph-mon[32756]: pgmap v2775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4039.287023 secs 2024-04-26T19:25:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3342.272127 secs 2024-04-26T19:25:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3342.272127 secs 2024-04-26T19:25:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3342.272127 secs 2024-04-26T19:25:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:45 smithi156 ceph-mon[32679]: pgmap v2776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:45 smithi092 ceph-mon[29156]: pgmap v2776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:45 smithi189 ceph-mon[32756]: pgmap v2776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:47 smithi156 ceph-mon[32679]: pgmap v2777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:47 smithi092 ceph-mon[29156]: pgmap v2777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:47 smithi189 ceph-mon[32756]: pgmap v2777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4044.287111 secs 2024-04-26T19:25:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4044.287111 secs 2024-04-26T19:25:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4044.287111 secs 2024-04-26T19:25:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:49 smithi156 ceph-mon[32679]: pgmap v2778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3347.272250 secs 2024-04-26T19:25:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:49 smithi092 ceph-mon[29156]: pgmap v2778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3347.272250 secs 2024-04-26T19:25:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:49 smithi189 ceph-mon[32756]: pgmap v2778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3347.272250 secs 2024-04-26T19:25:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:51 smithi156 ceph-mon[32679]: pgmap v2779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:51 smithi092 ceph-mon[29156]: pgmap v2779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:51 smithi189 ceph-mon[32756]: pgmap v2779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:53 smithi156 ceph-mon[32679]: pgmap v2780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4049.287237 secs 2024-04-26T19:25:54.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:53 smithi189 ceph-mon[32756]: pgmap v2780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:54.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4049.287237 secs 2024-04-26T19:25:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:53 smithi092 ceph-mon[29156]: pgmap v2780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4049.287237 secs 2024-04-26T19:25:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3352.272368 secs 2024-04-26T19:25:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3352.272368 secs 2024-04-26T19:25:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3352.272368 secs 2024-04-26T19:25:56.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:55 smithi156 ceph-mon[32679]: pgmap v2781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:55 smithi092 ceph-mon[29156]: pgmap v2781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:55 smithi189 ceph-mon[32756]: pgmap v2781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:25:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:57 smithi156 ceph-mon[32679]: pgmap v2782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:57 smithi092 ceph-mon[29156]: pgmap v2782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:57 smithi189 ceph-mon[32756]: pgmap v2782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:25:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4054.287375 secs 2024-04-26T19:25:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:58 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3357.272520 secs 2024-04-26T19:25:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4054.287375 secs 2024-04-26T19:25:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:58 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3357.272520 secs 2024-04-26T19:25:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4054.287375 secs 2024-04-26T19:25:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:58 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3357.272520 secs 2024-04-26T19:26:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:25:59 smithi092 ceph-mon[29156]: pgmap v2783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:25:59 smithi189 ceph-mon[32756]: pgmap v2783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:25:59 smithi156 ceph-mon[32679]: pgmap v2783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:01 smithi092 ceph-mon[29156]: pgmap v2784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:01 smithi189 ceph-mon[32756]: pgmap v2784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:01 smithi156 ceph-mon[32679]: pgmap v2784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:03 smithi092 ceph-mon[29156]: pgmap v2785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4059.287509 secs 2024-04-26T19:26:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:03 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3362.272640 secs 2024-04-26T19:26:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:03 smithi189 ceph-mon[32756]: pgmap v2785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4059.287509 secs 2024-04-26T19:26:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:03 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3362.272640 secs 2024-04-26T19:26:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:03 smithi156 ceph-mon[32679]: pgmap v2785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4059.287509 secs 2024-04-26T19:26:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:03 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3362.272640 secs 2024-04-26T19:26:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:05 smithi092 ceph-mon[29156]: pgmap v2786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:05 smithi189 ceph-mon[32756]: pgmap v2786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:05 smithi156 ceph-mon[32679]: pgmap v2786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:07 smithi092 ceph-mon[29156]: pgmap v2787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:07 smithi189 ceph-mon[32756]: pgmap v2787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:07 smithi156 ceph-mon[32679]: pgmap v2787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4064.287619 secs 2024-04-26T19:26:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:08 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3367.272744 secs 2024-04-26T19:26:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4064.287619 secs 2024-04-26T19:26:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:08 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3367.272744 secs 2024-04-26T19:26:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4064.287619 secs 2024-04-26T19:26:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:08 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3367.272744 secs 2024-04-26T19:26:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:09 smithi092 ceph-mon[29156]: pgmap v2788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:09 smithi189 ceph-mon[32756]: pgmap v2788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:09 smithi156 ceph-mon[32679]: pgmap v2788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:11 smithi092 ceph-mon[29156]: pgmap v2789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:11 smithi189 ceph-mon[32756]: pgmap v2789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:11 smithi156 ceph-mon[32679]: pgmap v2789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:13 smithi092 ceph-mon[29156]: pgmap v2790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4069.287717 secs 2024-04-26T19:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:13 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3372.272845 secs 2024-04-26T19:26:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:13 smithi189 ceph-mon[32756]: pgmap v2790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4069.287717 secs 2024-04-26T19:26:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:13 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3372.272845 secs 2024-04-26T19:26:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:13 smithi156 ceph-mon[32679]: pgmap v2790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4069.287717 secs 2024-04-26T19:26:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:13 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3372.272845 secs 2024-04-26T19:26:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:15 smithi092 ceph-mon[29156]: pgmap v2791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:15 smithi189 ceph-mon[32756]: pgmap v2791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:15 smithi156 ceph-mon[32679]: pgmap v2791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:17 smithi092 ceph-mon[29156]: pgmap v2792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:17 smithi189 ceph-mon[32756]: pgmap v2792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:17 smithi156 ceph-mon[32679]: pgmap v2792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4074.287860 secs 2024-04-26T19:26:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:18 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3377.272972 secs 2024-04-26T19:26:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4074.287860 secs 2024-04-26T19:26:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:18 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3377.272972 secs 2024-04-26T19:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4074.287860 secs 2024-04-26T19:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:18 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3377.272972 secs 2024-04-26T19:26:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:19 smithi092 ceph-mon[29156]: pgmap v2793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:19 smithi189 ceph-mon[32756]: pgmap v2793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:19 smithi156 ceph-mon[32679]: pgmap v2793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:21 smithi092 ceph-mon[29156]: pgmap v2794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:21 smithi189 ceph-mon[32756]: pgmap v2794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:21 smithi156 ceph-mon[32679]: pgmap v2794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:23 smithi092 ceph-mon[29156]: pgmap v2795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4079.287984 secs 2024-04-26T19:26:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:23 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3382.273088 secs 2024-04-26T19:26:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:23 smithi189 ceph-mon[32756]: pgmap v2795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4079.287984 secs 2024-04-26T19:26:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:23 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3382.273088 secs 2024-04-26T19:26:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:23 smithi156 ceph-mon[32679]: pgmap v2795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4079.287984 secs 2024-04-26T19:26:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:23 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3382.273088 secs 2024-04-26T19:26:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:25 smithi092 ceph-mon[29156]: pgmap v2796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:25 smithi189 ceph-mon[32756]: pgmap v2796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:25 smithi156 ceph-mon[32679]: pgmap v2796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:27 smithi092 ceph-mon[29156]: pgmap v2797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:27 smithi189 ceph-mon[32756]: pgmap v2797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:27 smithi156 ceph-mon[32679]: pgmap v2797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4084.288120 secs 2024-04-26T19:26:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:28 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3387.273179 secs 2024-04-26T19:26:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4084.288120 secs 2024-04-26T19:26:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:28 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3387.273179 secs 2024-04-26T19:26:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4084.288120 secs 2024-04-26T19:26:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:28 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3387.273179 secs 2024-04-26T19:26:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:30 smithi189 ceph-mon[32756]: pgmap v2798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:30 smithi156 ceph-mon[32679]: pgmap v2798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:30 smithi092 ceph-mon[29156]: pgmap v2798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:26:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:26:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:26:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:32 smithi156 ceph-mon[32679]: pgmap v2799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:32 smithi092 ceph-mon[29156]: pgmap v2799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:32 smithi189 ceph-mon[32756]: pgmap v2799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:34 smithi156 ceph-mon[32679]: pgmap v2800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4089.288211 secs 2024-04-26T19:26:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3392.273267 secs 2024-04-26T19:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:34 smithi092 ceph-mon[29156]: pgmap v2800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4089.288211 secs 2024-04-26T19:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3392.273267 secs 2024-04-26T19:26:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:34 smithi189 ceph-mon[32756]: pgmap v2800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4089.288211 secs 2024-04-26T19:26:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3392.273267 secs 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: pgmap v2801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: pgmap v2802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:26:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: pgmap v2803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: pgmap v2801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: pgmap v2802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: pgmap v2803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: pgmap v2801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: pgmap v2802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: pgmap v2803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:26:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:37 smithi092 ceph-mon[29156]: pgmap v2804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:37 smithi189 ceph-mon[32756]: pgmap v2804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:37 smithi156 ceph-mon[32679]: pgmap v2804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4094.288310 secs 2024-04-26T19:26:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3397.273360 secs 2024-04-26T19:26:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:39 smithi092 ceph-mon[29156]: pgmap v2805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4094.288310 secs 2024-04-26T19:26:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3397.273360 secs 2024-04-26T19:26:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:39 smithi189 ceph-mon[32756]: pgmap v2805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4094.288310 secs 2024-04-26T19:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3397.273360 secs 2024-04-26T19:26:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:39 smithi156 ceph-mon[32679]: pgmap v2805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:41 smithi092 ceph-mon[29156]: pgmap v2806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:41 smithi189 ceph-mon[32756]: pgmap v2806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:41 smithi156 ceph-mon[32679]: pgmap v2806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:26:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:43 smithi092 ceph-mon[29156]: pgmap v2807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:43 smithi189 ceph-mon[32756]: pgmap v2807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:43 smithi156 ceph-mon[32679]: pgmap v2807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:26:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4099.288416 secs 2024-04-26T19:26:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3402.273471 secs 2024-04-26T19:26:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4099.288416 secs 2024-04-26T19:26:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3402.273471 secs 2024-04-26T19:26:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4099.288416 secs 2024-04-26T19:26:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3402.273471 secs 2024-04-26T19:26:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:45 smithi092 ceph-mon[29156]: pgmap v2808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:26:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:45 smithi189 ceph-mon[32756]: pgmap v2808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:26:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:45 smithi156 ceph-mon[32679]: pgmap v2808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:26:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:47 smithi092 ceph-mon[29156]: pgmap v2809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:47 smithi189 ceph-mon[32756]: pgmap v2809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:47 smithi156 ceph-mon[32679]: pgmap v2809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4104.288558 secs 2024-04-26T19:26:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3407.273593 secs 2024-04-26T19:26:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:49 smithi092 ceph-mon[29156]: pgmap v2810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4104.288558 secs 2024-04-26T19:26:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3407.273593 secs 2024-04-26T19:26:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:49 smithi189 ceph-mon[32756]: pgmap v2810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4104.288558 secs 2024-04-26T19:26:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3407.273593 secs 2024-04-26T19:26:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:49 smithi156 ceph-mon[32679]: pgmap v2810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:51 smithi092 ceph-mon[29156]: pgmap v2811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:51 smithi189 ceph-mon[32756]: pgmap v2811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:51 smithi156 ceph-mon[32679]: pgmap v2811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:53 smithi092 ceph-mon[29156]: pgmap v2812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:53 smithi189 ceph-mon[32756]: pgmap v2812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:53 smithi156 ceph-mon[32679]: pgmap v2812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4109.288687 secs 2024-04-26T19:26:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3412.273711 secs 2024-04-26T19:26:55.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4109.288687 secs 2024-04-26T19:26:55.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3412.273711 secs 2024-04-26T19:26:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4109.288687 secs 2024-04-26T19:26:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3412.273711 secs 2024-04-26T19:26:56.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:55 smithi156 ceph-mon[32679]: pgmap v2813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:55 smithi189 ceph-mon[32756]: pgmap v2813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:55 smithi092 ceph-mon[29156]: pgmap v2813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:26:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:57 smithi189 ceph-mon[32756]: pgmap v2814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:57 smithi156 ceph-mon[32679]: pgmap v2814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:26:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:57 smithi092 ceph-mon[29156]: pgmap v2814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4114.288787 secs 2024-04-26T19:27:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3417.273828 secs 2024-04-26T19:27:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:26:59 smithi189 ceph-mon[32756]: pgmap v2815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4114.288787 secs 2024-04-26T19:27:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3417.273828 secs 2024-04-26T19:27:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:26:59 smithi156 ceph-mon[32679]: pgmap v2815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4114.288787 secs 2024-04-26T19:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3417.273828 secs 2024-04-26T19:27:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:26:59 smithi092 ceph-mon[29156]: pgmap v2815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:02.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:01 smithi092 ceph-mon[29156]: pgmap v2816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:01 smithi189 ceph-mon[32756]: pgmap v2816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:01 smithi156 ceph-mon[32679]: pgmap v2816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:02.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:27:02.086+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:27:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:27:02.086+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:27:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:27:02.086+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:27:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:27:02.086+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:27:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:27:02.086+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:27:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:03 smithi189 ceph-mon[32756]: pgmap v2817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:03 smithi156 ceph-mon[32679]: pgmap v2817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:03 smithi092 ceph-mon[29156]: pgmap v2817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4119.288881 secs 2024-04-26T19:27:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3422.273944 secs 2024-04-26T19:27:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4119.288881 secs 2024-04-26T19:27:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3422.273944 secs 2024-04-26T19:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4119.288881 secs 2024-04-26T19:27:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3422.273944 secs 2024-04-26T19:27:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:05 smithi189 ceph-mon[32756]: pgmap v2818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:05 smithi156 ceph-mon[32679]: pgmap v2818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:05 smithi092 ceph-mon[29156]: pgmap v2818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:08.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:07 smithi092 ceph-mon[29156]: pgmap v2819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:07 smithi189 ceph-mon[32756]: pgmap v2819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:07 smithi156 ceph-mon[32679]: pgmap v2819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4124.288997 secs 2024-04-26T19:27:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3427.274052 secs 2024-04-26T19:27:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:09 smithi189 ceph-mon[32756]: pgmap v2820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4124.288997 secs 2024-04-26T19:27:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3427.274052 secs 2024-04-26T19:27:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:09 smithi156 ceph-mon[32679]: pgmap v2820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4124.288997 secs 2024-04-26T19:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3427.274052 secs 2024-04-26T19:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:09 smithi092 ceph-mon[29156]: pgmap v2820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:11 smithi189 ceph-mon[32756]: pgmap v2821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:11 smithi156 ceph-mon[32679]: pgmap v2821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:11 smithi092 ceph-mon[29156]: pgmap v2821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:13 smithi092 ceph-mon[29156]: pgmap v2822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:13 smithi189 ceph-mon[32756]: pgmap v2822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:13 smithi156 ceph-mon[32679]: pgmap v2822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T19:27:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4129.289081 secs 2024-04-26T19:27:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3432.274142 secs 2024-04-26T19:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4129.289081 secs 2024-04-26T19:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3432.274142 secs 2024-04-26T19:27:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4129.289081 secs 2024-04-26T19:27:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3432.274142 secs 2024-04-26T19:27:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:15 smithi189 ceph-mon[32756]: pgmap v2823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:15 smithi156 ceph-mon[32679]: pgmap v2823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:15 smithi092 ceph-mon[29156]: pgmap v2823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T19:27:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:17 smithi189 ceph-mon[32756]: pgmap v2824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:17 smithi156 ceph-mon[32679]: pgmap v2824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:17 smithi092 ceph-mon[29156]: pgmap v2824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4134.289192 secs 2024-04-26T19:27:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3437.274263 secs 2024-04-26T19:27:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:19 smithi189 ceph-mon[32756]: pgmap v2825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4134.289192 secs 2024-04-26T19:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3437.274263 secs 2024-04-26T19:27:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:19 smithi156 ceph-mon[32679]: pgmap v2825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4134.289192 secs 2024-04-26T19:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3437.274263 secs 2024-04-26T19:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:19 smithi092 ceph-mon[29156]: pgmap v2825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:21 smithi189 ceph-mon[32756]: pgmap v2826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:21 smithi156 ceph-mon[32679]: pgmap v2826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:21 smithi092 ceph-mon[29156]: pgmap v2826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:23 smithi189 ceph-mon[32756]: pgmap v2827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:23 smithi156 ceph-mon[32679]: pgmap v2827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:23 smithi092 ceph-mon[29156]: pgmap v2827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4139.289285 secs 2024-04-26T19:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3442.274369 secs 2024-04-26T19:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4139.289285 secs 2024-04-26T19:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3442.274369 secs 2024-04-26T19:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4139.289285 secs 2024-04-26T19:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3442.274369 secs 2024-04-26T19:27:26.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:25 smithi156 ceph-mon[32679]: pgmap v2828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:25 smithi189 ceph-mon[32756]: pgmap v2828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:25 smithi092 ceph-mon[29156]: pgmap v2828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:27 smithi189 ceph-mon[32756]: pgmap v2829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:27 smithi156 ceph-mon[32679]: pgmap v2829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:27 smithi092 ceph-mon[29156]: pgmap v2829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4144.289349 secs 2024-04-26T19:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3447.274490 secs 2024-04-26T19:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:29 smithi189 ceph-mon[32756]: pgmap v2830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4144.289349 secs 2024-04-26T19:27:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3447.274490 secs 2024-04-26T19:27:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:29 smithi156 ceph-mon[32679]: pgmap v2830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4144.289349 secs 2024-04-26T19:27:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3447.274490 secs 2024-04-26T19:27:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:29 smithi092 ceph-mon[29156]: pgmap v2830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:31 smithi189 ceph-mon[32756]: pgmap v2831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:31 smithi156 ceph-mon[32679]: pgmap v2831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:31 smithi092 ceph-mon[29156]: pgmap v2831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:33 smithi189 ceph-mon[32756]: pgmap v2832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:33 smithi156 ceph-mon[32679]: pgmap v2832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:33 smithi092 ceph-mon[29156]: pgmap v2832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4149.289429 secs 2024-04-26T19:27:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3452.274568 secs 2024-04-26T19:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4149.289429 secs 2024-04-26T19:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3452.274568 secs 2024-04-26T19:27:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4149.289429 secs 2024-04-26T19:27:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3452.274568 secs 2024-04-26T19:27:36.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:35 smithi189 ceph-mon[32756]: pgmap v2833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:36.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:35 smithi156 ceph-mon[32679]: pgmap v2833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:35 smithi092 ceph-mon[29156]: pgmap v2833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:27:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:27:36.544+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:27:36.545 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:27:36.544+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:27:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:27:36.545+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:27:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:27:36.545+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 36 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:27:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:37 smithi189 ceph-mon[32756]: pgmap v2834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:37 smithi156 ceph-mon[32679]: pgmap v2834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:37 smithi092 ceph-mon[29156]: pgmap v2834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4154.289542 secs 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3457.274654 secs 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: pgmap v2835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: pgmap v2836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:27:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: pgmap v2837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4154.289542 secs 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3457.274654 secs 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: pgmap v2835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: pgmap v2836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: pgmap v2837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4154.289542 secs 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3457.274654 secs 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: pgmap v2835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: pgmap v2836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: pgmap v2837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:27:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:42 smithi189 ceph-mon[32756]: pgmap v2838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:42 smithi156 ceph-mon[32679]: pgmap v2838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:42 smithi092 ceph-mon[29156]: pgmap v2838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:44 smithi092 ceph-mon[29156]: pgmap v2839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4159.289666 secs 2024-04-26T19:27:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3462.274771 secs 2024-04-26T19:27:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:44 smithi189 ceph-mon[32756]: pgmap v2839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4159.289666 secs 2024-04-26T19:27:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3462.274771 secs 2024-04-26T19:27:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:44 smithi156 ceph-mon[32679]: pgmap v2839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4159.289666 secs 2024-04-26T19:27:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3462.274771 secs 2024-04-26T19:27:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:46 smithi189 ceph-mon[32756]: pgmap v2840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:46 smithi156 ceph-mon[32679]: pgmap v2840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:46 smithi092 ceph-mon[29156]: pgmap v2840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:27:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:48 smithi189 ceph-mon[32756]: pgmap v2841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:48 smithi156 ceph-mon[32679]: pgmap v2841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:48 smithi092 ceph-mon[29156]: pgmap v2841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:27:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4164.289812 secs 2024-04-26T19:27:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3467.274874 secs 2024-04-26T19:27:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4164.289812 secs 2024-04-26T19:27:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3467.274874 secs 2024-04-26T19:27:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4164.289812 secs 2024-04-26T19:27:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3467.274874 secs 2024-04-26T19:27:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:50 smithi189 ceph-mon[32756]: pgmap v2842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:27:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:50 smithi156 ceph-mon[32679]: pgmap v2842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:27:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:50 smithi092 ceph-mon[29156]: pgmap v2842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:27:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:52 smithi189 ceph-mon[32756]: pgmap v2843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:52 smithi156 ceph-mon[32679]: pgmap v2843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:52 smithi092 ceph-mon[29156]: pgmap v2843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:54 smithi189 ceph-mon[32756]: pgmap v2844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4169.289944 secs 2024-04-26T19:27:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3472.274973 secs 2024-04-26T19:27:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:54 smithi156 ceph-mon[32679]: pgmap v2844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4169.289944 secs 2024-04-26T19:27:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3472.274973 secs 2024-04-26T19:27:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:54 smithi092 ceph-mon[29156]: pgmap v2844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4169.289944 secs 2024-04-26T19:27:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3472.274973 secs 2024-04-26T19:27:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:56 smithi156 ceph-mon[32679]: pgmap v2845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:56 smithi092 ceph-mon[29156]: pgmap v2845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:56 smithi189 ceph-mon[32756]: pgmap v2845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:27:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:58 smithi156 ceph-mon[32679]: pgmap v2846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:58 smithi092 ceph-mon[29156]: pgmap v2846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:58 smithi189 ceph-mon[32756]: pgmap v2846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:27:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4174.290072 secs 2024-04-26T19:27:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:27:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3477.275115 secs 2024-04-26T19:27:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4174.290072 secs 2024-04-26T19:27:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:27:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3477.275115 secs 2024-04-26T19:27:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4174.290072 secs 2024-04-26T19:27:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:27:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3477.275115 secs 2024-04-26T19:28:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:00 smithi156 ceph-mon[32679]: pgmap v2847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:00 smithi092 ceph-mon[29156]: pgmap v2847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:00 smithi189 ceph-mon[32756]: pgmap v2847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:02 smithi156 ceph-mon[32679]: pgmap v2848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:02 smithi092 ceph-mon[29156]: pgmap v2848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:02 smithi189 ceph-mon[32756]: pgmap v2848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:04 smithi156 ceph-mon[32679]: pgmap v2849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4179.290198 secs 2024-04-26T19:28:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 3482.275248 secs 2024-04-26T19:28:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:04 smithi156 ceph-mon[32679]: slow request 361.433152 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:04 smithi092 ceph-mon[29156]: pgmap v2849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4179.290198 secs 2024-04-26T19:28:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 3482.275248 secs 2024-04-26T19:28:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:04 smithi092 ceph-mon[29156]: slow request 361.433152 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:04 smithi189 ceph-mon[32756]: pgmap v2849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4179.290198 secs 2024-04-26T19:28:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 3482.275248 secs 2024-04-26T19:28:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:04 smithi189 ceph-mon[32756]: slow request 361.433152 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:28:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:06 smithi156 ceph-mon[32679]: pgmap v2850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:06 smithi092 ceph-mon[29156]: pgmap v2850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:06 smithi189 ceph-mon[32756]: pgmap v2850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:08 smithi156 ceph-mon[32679]: pgmap v2851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:08.450 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:08 smithi189 ceph-mon[32756]: pgmap v2851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:08 smithi092 ceph-mon[29156]: pgmap v2851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4184.290334 secs 2024-04-26T19:28:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3487.275365 secs 2024-04-26T19:28:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4184.290334 secs 2024-04-26T19:28:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3487.275365 secs 2024-04-26T19:28:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4184.290334 secs 2024-04-26T19:28:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3487.275365 secs 2024-04-26T19:28:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:10 smithi156 ceph-mon[32679]: pgmap v2852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:10 smithi092 ceph-mon[29156]: pgmap v2852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:10 smithi189 ceph-mon[32756]: pgmap v2852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:11 smithi092 ceph-mon[29156]: pgmap v2853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:11 smithi189 ceph-mon[32756]: pgmap v2853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:11 smithi156 ceph-mon[32679]: pgmap v2853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:14 smithi189 ceph-mon[32756]: pgmap v2854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4189.290465 secs 2024-04-26T19:28:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3492.275476 secs 2024-04-26T19:28:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:14 smithi156 ceph-mon[32679]: pgmap v2854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4189.290465 secs 2024-04-26T19:28:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3492.275476 secs 2024-04-26T19:28:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:14 smithi092 ceph-mon[29156]: pgmap v2854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:28:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4189.290465 secs 2024-04-26T19:28:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3492.275476 secs 2024-04-26T19:28:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:16 smithi189 ceph-mon[32756]: pgmap v2855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:16 smithi156 ceph-mon[32679]: pgmap v2855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:16 smithi092 ceph-mon[29156]: pgmap v2855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:28:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:18 smithi189 ceph-mon[32756]: pgmap v2856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:18 smithi156 ceph-mon[32679]: pgmap v2856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:18 smithi092 ceph-mon[29156]: pgmap v2856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4194.290595 secs 2024-04-26T19:28:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3497.275598 secs 2024-04-26T19:28:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4194.290595 secs 2024-04-26T19:28:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3497.275598 secs 2024-04-26T19:28:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4194.290595 secs 2024-04-26T19:28:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3497.275598 secs 2024-04-26T19:28:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:20 smithi156 ceph-mon[32679]: pgmap v2857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:20 smithi092 ceph-mon[29156]: pgmap v2857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:20 smithi189 ceph-mon[32756]: pgmap v2857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:22 smithi156 ceph-mon[32679]: pgmap v2858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:22 smithi092 ceph-mon[29156]: pgmap v2858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:22 smithi189 ceph-mon[32756]: pgmap v2858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:24 smithi156 ceph-mon[32679]: pgmap v2859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4199.290684 secs 2024-04-26T19:28:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3502.275721 secs 2024-04-26T19:28:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:24 smithi092 ceph-mon[29156]: pgmap v2859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4199.290684 secs 2024-04-26T19:28:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3502.275721 secs 2024-04-26T19:28:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:24 smithi189 ceph-mon[32756]: pgmap v2859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4199.290684 secs 2024-04-26T19:28:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3502.275721 secs 2024-04-26T19:28:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:26 smithi156 ceph-mon[32679]: pgmap v2860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:26.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:26 smithi189 ceph-mon[32756]: pgmap v2860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:26 smithi092 ceph-mon[29156]: pgmap v2860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:28 smithi156 ceph-mon[32679]: pgmap v2861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:28 smithi092 ceph-mon[29156]: pgmap v2861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:28 smithi189 ceph-mon[32756]: pgmap v2861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4204.290791 secs 2024-04-26T19:28:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3507.275846 secs 2024-04-26T19:28:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4204.290791 secs 2024-04-26T19:28:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3507.275846 secs 2024-04-26T19:28:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4204.290791 secs 2024-04-26T19:28:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3507.275846 secs 2024-04-26T19:28:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:30 smithi156 ceph-mon[32679]: pgmap v2862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:30 smithi092 ceph-mon[29156]: pgmap v2862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:30 smithi189 ceph-mon[32756]: pgmap v2862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:32 smithi156 ceph-mon[32679]: pgmap v2863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:32 smithi092 ceph-mon[29156]: pgmap v2863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:32 smithi189 ceph-mon[32756]: pgmap v2863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:34 smithi156 ceph-mon[32679]: pgmap v2864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4209.290929 secs 2024-04-26T19:28:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3512.275963 secs 2024-04-26T19:28:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:34 smithi092 ceph-mon[29156]: pgmap v2864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4209.290929 secs 2024-04-26T19:28:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3512.275963 secs 2024-04-26T19:28:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:34 smithi189 ceph-mon[32756]: pgmap v2864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4209.290929 secs 2024-04-26T19:28:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3512.275963 secs 2024-04-26T19:28:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:36 smithi156 ceph-mon[32679]: pgmap v2865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:36 smithi092 ceph-mon[29156]: pgmap v2865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:36 smithi189 ceph-mon[32756]: pgmap v2865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:38 smithi156 ceph-mon[32679]: pgmap v2866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:38 smithi092 ceph-mon[29156]: pgmap v2866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:38 smithi189 ceph-mon[32756]: pgmap v2866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4214.291033 secs 2024-04-26T19:28:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3517.276087 secs 2024-04-26T19:28:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4214.291033 secs 2024-04-26T19:28:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3517.276087 secs 2024-04-26T19:28:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4214.291033 secs 2024-04-26T19:28:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3517.276087 secs 2024-04-26T19:28:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:40 smithi092 ceph-mon[29156]: pgmap v2867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:28:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:40 smithi189 ceph-mon[32756]: pgmap v2867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:28:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:40 smithi156 ceph-mon[32679]: pgmap v2867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:28:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:28:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:28:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:28:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:41 smithi092 ceph-mon[29156]: pgmap v2868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:28:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:41 smithi092 ceph-mon[29156]: pgmap v2869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:41 smithi189 ceph-mon[32756]: pgmap v2868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:28:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:41 smithi189 ceph-mon[32756]: pgmap v2869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:41 smithi156 ceph-mon[32679]: pgmap v2868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:28:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:41 smithi156 ceph-mon[32679]: pgmap v2869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:43 smithi092 ceph-mon[29156]: pgmap v2870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:43 smithi189 ceph-mon[32756]: pgmap v2870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:43 smithi156 ceph-mon[32679]: pgmap v2870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4219.291149 secs 2024-04-26T19:28:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3522.276212 secs 2024-04-26T19:28:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:44 smithi092 ceph-mon[29156]: pgmap v2871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4219.291149 secs 2024-04-26T19:28:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3522.276212 secs 2024-04-26T19:28:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:44 smithi189 ceph-mon[32756]: pgmap v2871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4219.291149 secs 2024-04-26T19:28:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3522.276212 secs 2024-04-26T19:28:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:44 smithi156 ceph-mon[32679]: pgmap v2871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:46 smithi189 ceph-mon[32756]: pgmap v2872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:46 smithi156 ceph-mon[32679]: pgmap v2872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:46 smithi092 ceph-mon[29156]: pgmap v2872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:28:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:49 smithi189 ceph-mon[32756]: pgmap v2873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4224.291278 secs 2024-04-26T19:28:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3527.276318 secs 2024-04-26T19:28:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:49 smithi156 ceph-mon[32679]: pgmap v2873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4224.291278 secs 2024-04-26T19:28:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3527.276318 secs 2024-04-26T19:28:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:49 smithi092 ceph-mon[29156]: pgmap v2873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:28:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4224.291278 secs 2024-04-26T19:28:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3527.276318 secs 2024-04-26T19:28:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:51 smithi189 ceph-mon[32756]: pgmap v2874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:28:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:51 smithi156 ceph-mon[32679]: pgmap v2874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:28:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:51 smithi092 ceph-mon[29156]: pgmap v2874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:28:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:53 smithi189 ceph-mon[32756]: pgmap v2875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:53 smithi156 ceph-mon[32679]: pgmap v2875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:53 smithi092 ceph-mon[29156]: pgmap v2875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4229.291430 secs 2024-04-26T19:28:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3532.276398 secs 2024-04-26T19:28:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4229.291430 secs 2024-04-26T19:28:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3532.276398 secs 2024-04-26T19:28:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4229.291430 secs 2024-04-26T19:28:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3532.276398 secs 2024-04-26T19:28:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:55 smithi189 ceph-mon[32756]: pgmap v2876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:55 smithi156 ceph-mon[32679]: pgmap v2876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:55 smithi092 ceph-mon[29156]: pgmap v2876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:28:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:57 smithi189 ceph-mon[32756]: pgmap v2877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:57 smithi156 ceph-mon[32679]: pgmap v2877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:57 smithi092 ceph-mon[29156]: pgmap v2877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:59 smithi189 ceph-mon[32756]: pgmap v2878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4234.291552 secs 2024-04-26T19:28:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:28:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3537.276479 secs 2024-04-26T19:28:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:59 smithi156 ceph-mon[32679]: pgmap v2878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4234.291552 secs 2024-04-26T19:28:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:28:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3537.276479 secs 2024-04-26T19:28:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:59 smithi092 ceph-mon[29156]: pgmap v2878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:28:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4234.291552 secs 2024-04-26T19:28:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:28:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3537.276479 secs 2024-04-26T19:29:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:01 smithi189 ceph-mon[32756]: pgmap v2879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:01 smithi156 ceph-mon[32679]: pgmap v2879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:01 smithi092 ceph-mon[29156]: pgmap v2879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:03 smithi189 ceph-mon[32756]: pgmap v2880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:03 smithi156 ceph-mon[32679]: pgmap v2880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:03 smithi092 ceph-mon[29156]: pgmap v2880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4239.291685 secs 2024-04-26T19:29:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 3542.276549 secs 2024-04-26T19:29:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:04 smithi189 ceph-mon[32756]: slow request 721.487026 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:29:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4239.291685 secs 2024-04-26T19:29:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 3542.276549 secs 2024-04-26T19:29:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:04 smithi156 ceph-mon[32679]: slow request 721.487026 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:29:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4239.291685 secs 2024-04-26T19:29:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 3542.276549 secs 2024-04-26T19:29:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:04 smithi092 ceph-mon[29156]: slow request 721.487026 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:29:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:05 smithi189 ceph-mon[32756]: pgmap v2881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:05 smithi156 ceph-mon[32679]: pgmap v2881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:05 smithi092 ceph-mon[29156]: pgmap v2881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:07 smithi189 ceph-mon[32756]: pgmap v2882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:07 smithi156 ceph-mon[32679]: pgmap v2882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:07 smithi092 ceph-mon[29156]: pgmap v2882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:09.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:09 smithi092 ceph-mon[29156]: pgmap v2883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:09.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4244.291806 secs 2024-04-26T19:29:09.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3547.276626 secs 2024-04-26T19:29:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:09 smithi189 ceph-mon[32756]: pgmap v2883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4244.291806 secs 2024-04-26T19:29:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3547.276626 secs 2024-04-26T19:29:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:09 smithi156 ceph-mon[32679]: pgmap v2883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4244.291806 secs 2024-04-26T19:29:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3547.276626 secs 2024-04-26T19:29:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:11 smithi189 ceph-mon[32756]: pgmap v2884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:11 smithi156 ceph-mon[32679]: pgmap v2884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:11 smithi092 ceph-mon[29156]: pgmap v2884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:13 smithi189 ceph-mon[32756]: pgmap v2885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:13 smithi156 ceph-mon[32679]: pgmap v2885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:13 smithi092 ceph-mon[29156]: pgmap v2885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4249.291925 secs 2024-04-26T19:29:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3552.276703 secs 2024-04-26T19:29:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4249.291925 secs 2024-04-26T19:29:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3552.276703 secs 2024-04-26T19:29:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4249.291925 secs 2024-04-26T19:29:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3552.276703 secs 2024-04-26T19:29:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:15 smithi189 ceph-mon[32756]: pgmap v2886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:15 smithi156 ceph-mon[32679]: pgmap v2886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:15 smithi092 ceph-mon[29156]: pgmap v2886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:17 smithi189 ceph-mon[32756]: pgmap v2887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:17 smithi156 ceph-mon[32679]: pgmap v2887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:17 smithi092 ceph-mon[29156]: pgmap v2887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:19 smithi189 ceph-mon[32756]: pgmap v2888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4254.291988 secs 2024-04-26T19:29:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3557.276791 secs 2024-04-26T19:29:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:19 smithi156 ceph-mon[32679]: pgmap v2888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4254.291988 secs 2024-04-26T19:29:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3557.276791 secs 2024-04-26T19:29:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:19 smithi092 ceph-mon[29156]: pgmap v2888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4254.291988 secs 2024-04-26T19:29:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3557.276791 secs 2024-04-26T19:29:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:21 smithi189 ceph-mon[32756]: pgmap v2889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:21 smithi156 ceph-mon[32679]: pgmap v2889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:21 smithi092 ceph-mon[29156]: pgmap v2889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:23 smithi189 ceph-mon[32756]: pgmap v2890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:23 smithi156 ceph-mon[32679]: pgmap v2890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:23 smithi092 ceph-mon[29156]: pgmap v2890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4259.292062 secs 2024-04-26T19:29:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3562.276859 secs 2024-04-26T19:29:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4259.292062 secs 2024-04-26T19:29:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3562.276859 secs 2024-04-26T19:29:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4259.292062 secs 2024-04-26T19:29:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3562.276859 secs 2024-04-26T19:29:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:25 smithi189 ceph-mon[32756]: pgmap v2891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:25 smithi156 ceph-mon[32679]: pgmap v2891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:25 smithi092 ceph-mon[29156]: pgmap v2891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:27 smithi189 ceph-mon[32756]: pgmap v2892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:27 smithi156 ceph-mon[32679]: pgmap v2892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:27 smithi092 ceph-mon[29156]: pgmap v2892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:29 smithi189 ceph-mon[32756]: pgmap v2893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4264.292172 secs 2024-04-26T19:29:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3567.276956 secs 2024-04-26T19:29:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:29 smithi156 ceph-mon[32679]: pgmap v2893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4264.292172 secs 2024-04-26T19:29:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3567.276956 secs 2024-04-26T19:29:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:29 smithi092 ceph-mon[29156]: pgmap v2893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4264.292172 secs 2024-04-26T19:29:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3567.276956 secs 2024-04-26T19:29:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:31 smithi189 ceph-mon[32756]: pgmap v2894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:31 smithi156 ceph-mon[32679]: pgmap v2894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:31 smithi092 ceph-mon[29156]: pgmap v2894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:33 smithi092 ceph-mon[29156]: pgmap v2895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:33 smithi189 ceph-mon[32756]: pgmap v2895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:33 smithi156 ceph-mon[32679]: pgmap v2895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4269.292291 secs 2024-04-26T19:29:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3572.277067 secs 2024-04-26T19:29:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4269.292291 secs 2024-04-26T19:29:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3572.277067 secs 2024-04-26T19:29:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4269.292291 secs 2024-04-26T19:29:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3572.277067 secs 2024-04-26T19:29:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:35 smithi189 ceph-mon[32756]: pgmap v2896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:35 smithi156 ceph-mon[32679]: pgmap v2896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:35 smithi092 ceph-mon[29156]: pgmap v2896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:37 smithi189 ceph-mon[32756]: pgmap v2897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:37 smithi156 ceph-mon[32679]: pgmap v2897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:37 smithi092 ceph-mon[29156]: pgmap v2897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:39 smithi189 ceph-mon[32756]: pgmap v2898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4274.292407 secs 2024-04-26T19:29:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3577.277177 secs 2024-04-26T19:29:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:39 smithi156 ceph-mon[32679]: pgmap v2898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4274.292407 secs 2024-04-26T19:29:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3577.277177 secs 2024-04-26T19:29:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:39 smithi092 ceph-mon[29156]: pgmap v2898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4274.292407 secs 2024-04-26T19:29:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3577.277177 secs 2024-04-26T19:29:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:29:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:41 smithi189 ceph-mon[32756]: pgmap v2899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:29:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:41 smithi156 ceph-mon[32679]: pgmap v2899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:29:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:41 smithi092 ceph-mon[29156]: pgmap v2899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:29:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:29:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:29:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:42 smithi189 ceph-mon[32756]: pgmap v2900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:29:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:42 smithi189 ceph-mon[32756]: pgmap v2901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:42 smithi156 ceph-mon[32679]: pgmap v2900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:29:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:42 smithi156 ceph-mon[32679]: pgmap v2901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:42 smithi092 ceph-mon[29156]: pgmap v2900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:29:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:42 smithi092 ceph-mon[29156]: pgmap v2901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:44 smithi189 ceph-mon[32756]: pgmap v2902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:29:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4279.292523 secs 2024-04-26T19:29:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3582.277318 secs 2024-04-26T19:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:44 smithi156 ceph-mon[32679]: pgmap v2902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4279.292523 secs 2024-04-26T19:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3582.277318 secs 2024-04-26T19:29:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:44 smithi092 ceph-mon[29156]: pgmap v2902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:29:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4279.292523 secs 2024-04-26T19:29:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3582.277318 secs 2024-04-26T19:29:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:46 smithi189 ceph-mon[32756]: pgmap v2903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:46 smithi156 ceph-mon[32679]: pgmap v2903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:46 smithi092 ceph-mon[29156]: pgmap v2903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:48 smithi189 ceph-mon[32756]: pgmap v2904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:48 smithi156 ceph-mon[32679]: pgmap v2904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:48 smithi092 ceph-mon[29156]: pgmap v2904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4284.292638 secs 2024-04-26T19:29:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3587.277440 secs 2024-04-26T19:29:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4284.292638 secs 2024-04-26T19:29:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3587.277440 secs 2024-04-26T19:29:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4284.292638 secs 2024-04-26T19:29:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3587.277440 secs 2024-04-26T19:29:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:50 smithi189 ceph-mon[32756]: pgmap v2905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:50 smithi156 ceph-mon[32679]: pgmap v2905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:50 smithi092 ceph-mon[29156]: pgmap v2905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:29:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:52 smithi156 ceph-mon[32679]: pgmap v2906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:29:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:52 smithi092 ceph-mon[29156]: pgmap v2906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:29:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:52 smithi189 ceph-mon[32756]: pgmap v2906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:29:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:54 smithi156 ceph-mon[32679]: pgmap v2907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4289.292773 secs 2024-04-26T19:29:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3592.277534 secs 2024-04-26T19:29:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:54 smithi092 ceph-mon[29156]: pgmap v2907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4289.292773 secs 2024-04-26T19:29:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3592.277534 secs 2024-04-26T19:29:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:54 smithi189 ceph-mon[32756]: pgmap v2907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4289.292773 secs 2024-04-26T19:29:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3592.277534 secs 2024-04-26T19:29:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:56 smithi156 ceph-mon[32679]: pgmap v2908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:56 smithi092 ceph-mon[29156]: pgmap v2908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:56 smithi189 ceph-mon[32756]: pgmap v2908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:29:58.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:58 smithi156 ceph-mon[32679]: pgmap v2909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:58.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:58 smithi189 ceph-mon[32756]: pgmap v2909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:58.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:58 smithi092 ceph-mon[29156]: pgmap v2909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:29:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4294.292912 secs 2024-04-26T19:29:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:29:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3597.277644 secs 2024-04-26T19:29:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4294.292912 secs 2024-04-26T19:29:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:29:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3597.277644 secs 2024-04-26T19:29:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4294.292912 secs 2024-04-26T19:29:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:29:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3597.277644 secs 2024-04-26T19:30:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:00 smithi156 ceph-mon[32679]: pgmap v2910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:30:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:00 smithi092 ceph-mon[29156]: pgmap v2910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:00 smithi189 ceph-mon[32756]: pgmap v2910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:30:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:02 smithi156 ceph-mon[32679]: pgmap v2911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:02 smithi092 ceph-mon[29156]: pgmap v2911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:02 smithi189 ceph-mon[32756]: pgmap v2911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:04 smithi156 ceph-mon[32679]: pgmap v2912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4299.293029 secs 2024-04-26T19:30:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3602.277794 secs 2024-04-26T19:30:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:04 smithi092 ceph-mon[29156]: pgmap v2912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4299.293029 secs 2024-04-26T19:30:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3602.277794 secs 2024-04-26T19:30:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:04 smithi189 ceph-mon[32756]: pgmap v2912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4299.293029 secs 2024-04-26T19:30:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3602.277794 secs 2024-04-26T19:30:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:06 smithi156 ceph-mon[32679]: pgmap v2913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:06 smithi092 ceph-mon[29156]: pgmap v2913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:06 smithi189 ceph-mon[32756]: pgmap v2913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:08 smithi156 ceph-mon[32679]: pgmap v2914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:08 smithi092 ceph-mon[29156]: pgmap v2914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:08 smithi189 ceph-mon[32756]: pgmap v2914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4304.293102 secs 2024-04-26T19:30:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3607.277906 secs 2024-04-26T19:30:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4304.293102 secs 2024-04-26T19:30:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3607.277906 secs 2024-04-26T19:30:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4304.293102 secs 2024-04-26T19:30:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3607.277906 secs 2024-04-26T19:30:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:10 smithi156 ceph-mon[32679]: pgmap v2915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:10 smithi092 ceph-mon[29156]: pgmap v2915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:10 smithi189 ceph-mon[32756]: pgmap v2915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:12 smithi156 ceph-mon[32679]: pgmap v2916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:12 smithi092 ceph-mon[29156]: pgmap v2916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:12 smithi189 ceph-mon[32756]: pgmap v2916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:14 smithi156 ceph-mon[32679]: pgmap v2917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4309.293213 secs 2024-04-26T19:30:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3612.278015 secs 2024-04-26T19:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:14 smithi092 ceph-mon[29156]: pgmap v2917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4309.293213 secs 2024-04-26T19:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3612.278015 secs 2024-04-26T19:30:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:14 smithi189 ceph-mon[32756]: pgmap v2917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4309.293213 secs 2024-04-26T19:30:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3612.278015 secs 2024-04-26T19:30:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:16 smithi092 ceph-mon[29156]: pgmap v2918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:16 smithi189 ceph-mon[32756]: pgmap v2918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:16 smithi156 ceph-mon[32679]: pgmap v2918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:18 smithi092 ceph-mon[29156]: pgmap v2919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:18 smithi189 ceph-mon[32756]: pgmap v2919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:18 smithi156 ceph-mon[32679]: pgmap v2919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4314.293321 secs 2024-04-26T19:30:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3617.278134 secs 2024-04-26T19:30:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4314.293321 secs 2024-04-26T19:30:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3617.278134 secs 2024-04-26T19:30:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4314.293321 secs 2024-04-26T19:30:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3617.278134 secs 2024-04-26T19:30:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:20 smithi092 ceph-mon[29156]: pgmap v2920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:20 smithi189 ceph-mon[32756]: pgmap v2920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:20.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:20 smithi156 ceph-mon[32679]: pgmap v2920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:22 smithi092 ceph-mon[29156]: pgmap v2921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:22 smithi189 ceph-mon[32756]: pgmap v2921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:22 smithi156 ceph-mon[32679]: pgmap v2921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:24 smithi092 ceph-mon[29156]: pgmap v2922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4319.293456 secs 2024-04-26T19:30:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3622.278268 secs 2024-04-26T19:30:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:24 smithi189 ceph-mon[32756]: pgmap v2922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4319.293456 secs 2024-04-26T19:30:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3622.278268 secs 2024-04-26T19:30:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:24 smithi156 ceph-mon[32679]: pgmap v2922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4319.293456 secs 2024-04-26T19:30:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3622.278268 secs 2024-04-26T19:30:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:26 smithi092 ceph-mon[29156]: pgmap v2923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:26.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:26 smithi189 ceph-mon[32756]: pgmap v2923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:26 smithi156 ceph-mon[32679]: pgmap v2923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:28.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:28 smithi156 ceph-mon[32679]: pgmap v2924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:28 smithi092 ceph-mon[29156]: pgmap v2924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:28 smithi189 ceph-mon[32756]: pgmap v2924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4324.293580 secs 2024-04-26T19:30:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3627.278380 secs 2024-04-26T19:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4324.293580 secs 2024-04-26T19:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3627.278380 secs 2024-04-26T19:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4324.293580 secs 2024-04-26T19:30:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3627.278380 secs 2024-04-26T19:30:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:30 smithi092 ceph-mon[29156]: pgmap v2925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:30 smithi189 ceph-mon[32756]: pgmap v2925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:30 smithi156 ceph-mon[32679]: pgmap v2925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:31 smithi092 ceph-mon[29156]: pgmap v2926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:31 smithi189 ceph-mon[32756]: pgmap v2926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:31 smithi156 ceph-mon[32679]: pgmap v2926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:33 smithi189 ceph-mon[32756]: pgmap v2927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:33 smithi156 ceph-mon[32679]: pgmap v2927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:33 smithi092 ceph-mon[29156]: pgmap v2927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4329.293725 secs 2024-04-26T19:30:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3632.278445 secs 2024-04-26T19:30:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4329.293725 secs 2024-04-26T19:30:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3632.278445 secs 2024-04-26T19:30:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4329.293725 secs 2024-04-26T19:30:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3632.278445 secs 2024-04-26T19:30:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:35 smithi189 ceph-mon[32756]: pgmap v2928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:35 smithi156 ceph-mon[32679]: pgmap v2928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:35 smithi092 ceph-mon[29156]: pgmap v2928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:30:36.570+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:30:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:30:36.570+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:30:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:30:36.570+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:30:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:30:36.570+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 37 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:30:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:37 smithi189 ceph-mon[32756]: pgmap v2929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:37 smithi156 ceph-mon[32679]: pgmap v2929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:37 smithi092 ceph-mon[29156]: pgmap v2929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4334.293787 secs 2024-04-26T19:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3637.278559 secs 2024-04-26T19:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:39 smithi189 ceph-mon[32756]: pgmap v2930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4334.293787 secs 2024-04-26T19:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3637.278559 secs 2024-04-26T19:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:39 smithi156 ceph-mon[32679]: pgmap v2930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4334.293787 secs 2024-04-26T19:30:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3637.278559 secs 2024-04-26T19:30:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:39 smithi092 ceph-mon[29156]: pgmap v2930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:41 smithi189 ceph-mon[32756]: pgmap v2931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:41 smithi156 ceph-mon[32679]: pgmap v2931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:30:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:41 smithi092 ceph-mon[29156]: pgmap v2931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:30:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:30:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:30:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:30:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:42 smithi189 ceph-mon[32756]: pgmap v2932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:30:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:42 smithi189 ceph-mon[32756]: pgmap v2933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:42 smithi156 ceph-mon[32679]: pgmap v2932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:30:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:42 smithi156 ceph-mon[32679]: pgmap v2933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:42 smithi092 ceph-mon[29156]: pgmap v2932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:30:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:42 smithi092 ceph-mon[29156]: pgmap v2933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4339.293911 secs 2024-04-26T19:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3642.278675 secs 2024-04-26T19:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:44 smithi189 ceph-mon[32756]: pgmap v2934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4339.293911 secs 2024-04-26T19:30:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3642.278675 secs 2024-04-26T19:30:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:44 smithi156 ceph-mon[32679]: pgmap v2934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4339.293911 secs 2024-04-26T19:30:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3642.278675 secs 2024-04-26T19:30:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:44 smithi092 ceph-mon[29156]: pgmap v2934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:46 smithi189 ceph-mon[32756]: pgmap v2935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:46 smithi156 ceph-mon[32679]: pgmap v2935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:46 smithi092 ceph-mon[29156]: pgmap v2935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:48 smithi189 ceph-mon[32756]: pgmap v2936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:48 smithi156 ceph-mon[32679]: pgmap v2936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:48 smithi092 ceph-mon[29156]: pgmap v2936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4344.294041 secs 2024-04-26T19:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3647.278734 secs 2024-04-26T19:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4344.294041 secs 2024-04-26T19:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3647.278734 secs 2024-04-26T19:30:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4344.294041 secs 2024-04-26T19:30:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3647.278734 secs 2024-04-26T19:30:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:50 smithi189 ceph-mon[32756]: pgmap v2937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:50 smithi156 ceph-mon[32679]: pgmap v2937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:50 smithi092 ceph-mon[29156]: pgmap v2937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:30:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:52 smithi189 ceph-mon[32756]: pgmap v2938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:30:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:52 smithi156 ceph-mon[32679]: pgmap v2938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:30:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:52 smithi092 ceph-mon[29156]: pgmap v2938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4349.294178 secs 2024-04-26T19:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3652.278881 secs 2024-04-26T19:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:54 smithi189 ceph-mon[32756]: pgmap v2939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4349.294178 secs 2024-04-26T19:30:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3652.278881 secs 2024-04-26T19:30:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:54 smithi156 ceph-mon[32679]: pgmap v2939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4349.294178 secs 2024-04-26T19:30:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3652.278881 secs 2024-04-26T19:30:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:54 smithi092 ceph-mon[29156]: pgmap v2939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:30:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:56 smithi189 ceph-mon[32756]: pgmap v2940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:56 smithi156 ceph-mon[32679]: pgmap v2940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:56 smithi092 ceph-mon[29156]: pgmap v2940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:58 smithi189 ceph-mon[32756]: pgmap v2941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:58 smithi156 ceph-mon[32679]: pgmap v2941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:30:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:58 smithi092 ceph-mon[29156]: pgmap v2941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4354.294294 secs 2024-04-26T19:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:30:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3657.279035 secs 2024-04-26T19:31:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4354.294294 secs 2024-04-26T19:31:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:30:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3657.279035 secs 2024-04-26T19:31:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4354.294294 secs 2024-04-26T19:31:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:30:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3657.279035 secs 2024-04-26T19:31:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:00 smithi189 ceph-mon[32756]: pgmap v2942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:00 smithi156 ceph-mon[32679]: pgmap v2942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:00 smithi092 ceph-mon[29156]: pgmap v2942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:02 smithi189 ceph-mon[32756]: pgmap v2943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:02 smithi156 ceph-mon[32679]: pgmap v2943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:02 smithi092 ceph-mon[29156]: pgmap v2943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4359.294410 secs 2024-04-26T19:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3662.279108 secs 2024-04-26T19:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:04 smithi189 ceph-mon[32756]: pgmap v2944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4359.294410 secs 2024-04-26T19:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3662.279108 secs 2024-04-26T19:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:04 smithi156 ceph-mon[32679]: pgmap v2944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4359.294410 secs 2024-04-26T19:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3662.279108 secs 2024-04-26T19:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:04 smithi092 ceph-mon[29156]: pgmap v2944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:06 smithi189 ceph-mon[32756]: pgmap v2945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:06 smithi156 ceph-mon[32679]: pgmap v2945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:06 smithi092 ceph-mon[29156]: pgmap v2945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:08 smithi189 ceph-mon[32756]: pgmap v2946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:08 smithi156 ceph-mon[32679]: pgmap v2946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:08 smithi092 ceph-mon[29156]: pgmap v2946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4364.294548 secs 2024-04-26T19:31:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3667.279170 secs 2024-04-26T19:31:10.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4364.294548 secs 2024-04-26T19:31:10.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3667.279170 secs 2024-04-26T19:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4364.294548 secs 2024-04-26T19:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3667.279170 secs 2024-04-26T19:31:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:10 smithi189 ceph-mon[32756]: pgmap v2947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:10 smithi156 ceph-mon[32679]: pgmap v2947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:10 smithi092 ceph-mon[29156]: pgmap v2947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:12 smithi189 ceph-mon[32756]: pgmap v2948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:12 smithi156 ceph-mon[32679]: pgmap v2948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:12 smithi092 ceph-mon[29156]: pgmap v2948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:31:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4369.294687 secs 2024-04-26T19:31:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3672.279288 secs 2024-04-26T19:31:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:14 smithi189 ceph-mon[32756]: pgmap v2949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4369.294687 secs 2024-04-26T19:31:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3672.279288 secs 2024-04-26T19:31:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:14 smithi156 ceph-mon[32679]: pgmap v2949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4369.294687 secs 2024-04-26T19:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3672.279288 secs 2024-04-26T19:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:14 smithi092 ceph-mon[29156]: pgmap v2949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:31:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:16 smithi156 ceph-mon[32679]: pgmap v2950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:16 smithi092 ceph-mon[29156]: pgmap v2950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:16 smithi189 ceph-mon[32756]: pgmap v2950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:18 smithi156 ceph-mon[32679]: pgmap v2951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:18 smithi092 ceph-mon[29156]: pgmap v2951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:18 smithi189 ceph-mon[32756]: pgmap v2951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4374.294810 secs 2024-04-26T19:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3677.279377 secs 2024-04-26T19:31:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4374.294810 secs 2024-04-26T19:31:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3677.279377 secs 2024-04-26T19:31:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4374.294810 secs 2024-04-26T19:31:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3677.279377 secs 2024-04-26T19:31:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:20 smithi156 ceph-mon[32679]: pgmap v2952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:20 smithi092 ceph-mon[29156]: pgmap v2952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:20 smithi189 ceph-mon[32756]: pgmap v2952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:22 smithi156 ceph-mon[32679]: pgmap v2953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:22 smithi092 ceph-mon[29156]: pgmap v2953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:22 smithi189 ceph-mon[32756]: pgmap v2953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4379.294934 secs 2024-04-26T19:31:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3682.279447 secs 2024-04-26T19:31:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:24 smithi156 ceph-mon[32679]: pgmap v2954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4379.294934 secs 2024-04-26T19:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3682.279447 secs 2024-04-26T19:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:24 smithi092 ceph-mon[29156]: pgmap v2954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4379.294934 secs 2024-04-26T19:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3682.279447 secs 2024-04-26T19:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:24 smithi189 ceph-mon[32756]: pgmap v2954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:26 smithi156 ceph-mon[32679]: pgmap v2955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:26 smithi092 ceph-mon[29156]: pgmap v2955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:26 smithi189 ceph-mon[32756]: pgmap v2955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:28 smithi156 ceph-mon[32679]: pgmap v2956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4384.295049 secs 2024-04-26T19:31:29.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:28 smithi189 ceph-mon[32756]: pgmap v2956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:29.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4384.295049 secs 2024-04-26T19:31:29.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:28 smithi092 ceph-mon[29156]: pgmap v2956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:29.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4384.295049 secs 2024-04-26T19:31:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3687.279567 secs 2024-04-26T19:31:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3687.279567 secs 2024-04-26T19:31:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3687.279567 secs 2024-04-26T19:31:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:30 smithi156 ceph-mon[32679]: pgmap v2957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:30 smithi092 ceph-mon[29156]: pgmap v2957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:30 smithi189 ceph-mon[32756]: pgmap v2957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:32 smithi156 ceph-mon[32679]: pgmap v2958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:32 smithi092 ceph-mon[29156]: pgmap v2958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:32 smithi189 ceph-mon[32756]: pgmap v2958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4389.295127 secs 2024-04-26T19:31:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4389.295127 secs 2024-04-26T19:31:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4389.295127 secs 2024-04-26T19:31:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3692.279650 secs 2024-04-26T19:31:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:34 smithi092 ceph-mon[29156]: pgmap v2959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3692.279650 secs 2024-04-26T19:31:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:34 smithi189 ceph-mon[32756]: pgmap v2959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3692.279650 secs 2024-04-26T19:31:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:34 smithi156 ceph-mon[32679]: pgmap v2959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:36 smithi092 ceph-mon[29156]: pgmap v2960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:36 smithi189 ceph-mon[32756]: pgmap v2960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:36 smithi156 ceph-mon[32679]: pgmap v2960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:38 smithi092 ceph-mon[29156]: pgmap v2961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4394.295198 secs 2024-04-26T19:31:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:38 smithi189 ceph-mon[32756]: pgmap v2961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4394.295198 secs 2024-04-26T19:31:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:38 smithi156 ceph-mon[32679]: pgmap v2961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4394.295198 secs 2024-04-26T19:31:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3697.279738 secs 2024-04-26T19:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3697.279738 secs 2024-04-26T19:31:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3697.279738 secs 2024-04-26T19:31:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:40 smithi092 ceph-mon[29156]: pgmap v2962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:41.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:40 smithi189 ceph-mon[32756]: pgmap v2962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:40 smithi156 ceph-mon[32679]: pgmap v2962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:31:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: pgmap v2963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: pgmap v2963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:43.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: pgmap v2963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4399.295787 secs 2024-04-26T19:31:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3702.279831 secs 2024-04-26T19:31:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4399.295787 secs 2024-04-26T19:31:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3702.279831 secs 2024-04-26T19:31:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4399.295787 secs 2024-04-26T19:31:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3702.279831 secs 2024-04-26T19:31:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: pgmap v2964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: pgmap v2964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: pgmap v2964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: pgmap v2965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: pgmap v2966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: pgmap v2967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: pgmap v2965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: pgmap v2966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: pgmap v2967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: pgmap v2965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:31:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: pgmap v2966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: pgmap v2967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:31:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:48 smithi189 ceph-mon[32756]: pgmap v2968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:48 smithi156 ceph-mon[32679]: pgmap v2968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:48 smithi092 ceph-mon[29156]: pgmap v2968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4404.295885 secs 2024-04-26T19:31:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3707.279945 secs 2024-04-26T19:31:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4404.295885 secs 2024-04-26T19:31:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3707.279945 secs 2024-04-26T19:31:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4404.295885 secs 2024-04-26T19:31:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3707.279945 secs 2024-04-26T19:31:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:50 smithi189 ceph-mon[32756]: pgmap v2969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:50 smithi156 ceph-mon[32679]: pgmap v2969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:50 smithi092 ceph-mon[29156]: pgmap v2969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:52 smithi156 ceph-mon[32679]: pgmap v2970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:52 smithi092 ceph-mon[29156]: pgmap v2970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:52 smithi189 ceph-mon[32756]: pgmap v2970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:31:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4409.295990 secs 2024-04-26T19:31:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3712.280024 secs 2024-04-26T19:31:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:54 smithi156 ceph-mon[32679]: pgmap v2971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4409.295990 secs 2024-04-26T19:31:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3712.280024 secs 2024-04-26T19:31:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:54 smithi092 ceph-mon[29156]: pgmap v2971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4409.295990 secs 2024-04-26T19:31:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3712.280024 secs 2024-04-26T19:31:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:54 smithi189 ceph-mon[32756]: pgmap v2971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:31:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:56 smithi156 ceph-mon[32679]: pgmap v2972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:56 smithi092 ceph-mon[29156]: pgmap v2972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:56 smithi189 ceph-mon[32756]: pgmap v2972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:31:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:58 smithi156 ceph-mon[32679]: pgmap v2973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:58 smithi092 ceph-mon[29156]: pgmap v2973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:58 smithi189 ceph-mon[32756]: pgmap v2973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:31:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4414.296118 secs 2024-04-26T19:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:31:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3717.280087 secs 2024-04-26T19:31:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4414.296118 secs 2024-04-26T19:31:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:31:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3717.280087 secs 2024-04-26T19:32:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4414.296118 secs 2024-04-26T19:32:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:31:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3717.280087 secs 2024-04-26T19:32:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:00 smithi156 ceph-mon[32679]: pgmap v2974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:00 smithi092 ceph-mon[29156]: pgmap v2974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:01.052 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:00 smithi189 ceph-mon[32756]: pgmap v2974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:02 smithi156 ceph-mon[32679]: pgmap v2975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:02 smithi092 ceph-mon[29156]: pgmap v2975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:02 smithi189 ceph-mon[32756]: pgmap v2975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4419.296220 secs 2024-04-26T19:32:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3722.280200 secs 2024-04-26T19:32:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:04 smithi156 ceph-mon[32679]: pgmap v2976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4419.296220 secs 2024-04-26T19:32:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3722.280200 secs 2024-04-26T19:32:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:04 smithi092 ceph-mon[29156]: pgmap v2976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4419.296220 secs 2024-04-26T19:32:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3722.280200 secs 2024-04-26T19:32:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:04 smithi189 ceph-mon[32756]: pgmap v2976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:06 smithi156 ceph-mon[32679]: pgmap v2977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:06 smithi092 ceph-mon[29156]: pgmap v2977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:06 smithi189 ceph-mon[32756]: pgmap v2977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:08 smithi156 ceph-mon[32679]: pgmap v2978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:08 smithi092 ceph-mon[29156]: pgmap v2978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:08 smithi189 ceph-mon[32756]: pgmap v2978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4424.296333 secs 2024-04-26T19:32:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3727.280333 secs 2024-04-26T19:32:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4424.296333 secs 2024-04-26T19:32:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3727.280333 secs 2024-04-26T19:32:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4424.296333 secs 2024-04-26T19:32:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3727.280333 secs 2024-04-26T19:32:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:10 smithi156 ceph-mon[32679]: pgmap v2979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:10 smithi092 ceph-mon[29156]: pgmap v2979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:10 smithi189 ceph-mon[32756]: pgmap v2979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:13.105 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:12 smithi092 ceph-mon[29156]: pgmap v2980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:12 smithi189 ceph-mon[32756]: pgmap v2980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:12 smithi156 ceph-mon[32679]: pgmap v2980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:32:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4429.296448 secs 2024-04-26T19:32:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3732.280438 secs 2024-04-26T19:32:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:14 smithi189 ceph-mon[32756]: pgmap v2981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4429.296448 secs 2024-04-26T19:32:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3732.280438 secs 2024-04-26T19:32:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:14 smithi156 ceph-mon[32679]: pgmap v2981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4429.296448 secs 2024-04-26T19:32:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3732.280438 secs 2024-04-26T19:32:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:14 smithi092 ceph-mon[29156]: pgmap v2981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:32:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:16 smithi189 ceph-mon[32756]: pgmap v2982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:16 smithi156 ceph-mon[32679]: pgmap v2982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:16 smithi092 ceph-mon[29156]: pgmap v2982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:18 smithi189 ceph-mon[32756]: pgmap v2983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:18 smithi156 ceph-mon[32679]: pgmap v2983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:18 smithi092 ceph-mon[29156]: pgmap v2983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4434.296535 secs 2024-04-26T19:32:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3737.280515 secs 2024-04-26T19:32:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4434.296535 secs 2024-04-26T19:32:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3737.280515 secs 2024-04-26T19:32:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4434.296535 secs 2024-04-26T19:32:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3737.280515 secs 2024-04-26T19:32:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:20 smithi189 ceph-mon[32756]: pgmap v2984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:20 smithi156 ceph-mon[32679]: pgmap v2984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:20 smithi092 ceph-mon[29156]: pgmap v2984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:22 smithi092 ceph-mon[29156]: pgmap v2985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:22 smithi189 ceph-mon[32756]: pgmap v2985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:22 smithi156 ceph-mon[32679]: pgmap v2985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4439.296626 secs 2024-04-26T19:32:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3742.280609 secs 2024-04-26T19:32:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:24 smithi189 ceph-mon[32756]: pgmap v2986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4439.296626 secs 2024-04-26T19:32:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3742.280609 secs 2024-04-26T19:32:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:24 smithi156 ceph-mon[32679]: pgmap v2986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4439.296626 secs 2024-04-26T19:32:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3742.280609 secs 2024-04-26T19:32:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:24 smithi092 ceph-mon[29156]: pgmap v2986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:26 smithi189 ceph-mon[32756]: pgmap v2987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:26 smithi156 ceph-mon[32679]: pgmap v2987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:26 smithi092 ceph-mon[29156]: pgmap v2987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:28 smithi189 ceph-mon[32756]: pgmap v2988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:28 smithi156 ceph-mon[32679]: pgmap v2988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:28 smithi092 ceph-mon[29156]: pgmap v2988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4444.296735 secs 2024-04-26T19:32:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3747.280688 secs 2024-04-26T19:32:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4444.296735 secs 2024-04-26T19:32:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3747.280688 secs 2024-04-26T19:32:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4444.296735 secs 2024-04-26T19:32:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3747.280688 secs 2024-04-26T19:32:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:30 smithi189 ceph-mon[32756]: pgmap v2989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:30 smithi156 ceph-mon[32679]: pgmap v2989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:30 smithi092 ceph-mon[29156]: pgmap v2989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:32.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:32:32.152+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:32:32.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:32:32.152+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:32:32.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:32:32.152+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:32:32.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:32:32.152+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:32:32.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:32:32.152+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:32:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:32 smithi189 ceph-mon[32756]: pgmap v2990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:32 smithi156 ceph-mon[32679]: pgmap v2990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:32 smithi092 ceph-mon[29156]: pgmap v2990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4449.296853 secs 2024-04-26T19:32:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3752.280818 secs 2024-04-26T19:32:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:34 smithi189 ceph-mon[32756]: pgmap v2991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4449.296853 secs 2024-04-26T19:32:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3752.280818 secs 2024-04-26T19:32:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:34 smithi156 ceph-mon[32679]: pgmap v2991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4449.296853 secs 2024-04-26T19:32:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3752.280818 secs 2024-04-26T19:32:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:34 smithi092 ceph-mon[29156]: pgmap v2991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:36 smithi189 ceph-mon[32756]: pgmap v2992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:36 smithi156 ceph-mon[32679]: pgmap v2992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:36 smithi092 ceph-mon[29156]: pgmap v2992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:38 smithi189 ceph-mon[32756]: pgmap v2993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:38 smithi156 ceph-mon[32679]: pgmap v2993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:38 smithi092 ceph-mon[29156]: pgmap v2993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4454.296944 secs 2024-04-26T19:32:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3757.280929 secs 2024-04-26T19:32:40.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4454.296944 secs 2024-04-26T19:32:40.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3757.280929 secs 2024-04-26T19:32:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4454.296944 secs 2024-04-26T19:32:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3757.280929 secs 2024-04-26T19:32:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:40 smithi189 ceph-mon[32756]: pgmap v2994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:40 smithi156 ceph-mon[32679]: pgmap v2994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:40 smithi092 ceph-mon[29156]: pgmap v2994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:32:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:42 smithi189 ceph-mon[32756]: pgmap v2995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:42 smithi156 ceph-mon[32679]: pgmap v2995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:42 smithi092 ceph-mon[29156]: pgmap v2995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:32:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4459.297024 secs 2024-04-26T19:32:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3762.281059 secs 2024-04-26T19:32:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:44 smithi189 ceph-mon[32756]: pgmap v2996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:32:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4459.297024 secs 2024-04-26T19:32:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3762.281059 secs 2024-04-26T19:32:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:44 smithi156 ceph-mon[32679]: pgmap v2996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:32:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4459.297024 secs 2024-04-26T19:32:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3762.281059 secs 2024-04-26T19:32:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:44 smithi092 ceph-mon[29156]: pgmap v2996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:32:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:32:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:46 smithi189 ceph-mon[32756]: pgmap v2997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:32:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:32:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:46 smithi156 ceph-mon[32679]: pgmap v2997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:32:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:32:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:46 smithi092 ceph-mon[29156]: pgmap v2997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:32:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:32:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:32:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:32:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:47 smithi189 ceph-mon[32756]: pgmap v2998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:32:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:47 smithi189 ceph-mon[32756]: pgmap v2999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:47 smithi156 ceph-mon[32679]: pgmap v2998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:32:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:47 smithi156 ceph-mon[32679]: pgmap v2999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:47 smithi092 ceph-mon[29156]: pgmap v2998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:32:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:47 smithi092 ceph-mon[29156]: pgmap v2999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4464.297143 secs 2024-04-26T19:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:49 smithi189 ceph-mon[32756]: pgmap v3000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3767.281176 secs 2024-04-26T19:32:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4464.297143 secs 2024-04-26T19:32:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:49 smithi156 ceph-mon[32679]: pgmap v3000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3767.281176 secs 2024-04-26T19:32:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4464.297143 secs 2024-04-26T19:32:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:49 smithi092 ceph-mon[29156]: pgmap v3000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T19:32:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3767.281176 secs 2024-04-26T19:32:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:32:51.587+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:32:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:32:51.587+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:32:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:32:51.588+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:32:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:32:51.588+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 38 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1ca80d20e0 con 0x5617fb906f00 2024-04-26T19:32:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:51 smithi189 ceph-mon[32756]: pgmap v3001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:51 smithi156 ceph-mon[32679]: pgmap v3001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:51 smithi092 ceph-mon[29156]: pgmap v3001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T19:32:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:53 smithi189 ceph-mon[32756]: pgmap v3002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:32:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:53 smithi156 ceph-mon[32679]: pgmap v3002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:32:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:53 smithi092 ceph-mon[29156]: pgmap v3002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:32:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4469.297235 secs 2024-04-26T19:32:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3772.281330 secs 2024-04-26T19:32:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4469.297235 secs 2024-04-26T19:32:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3772.281330 secs 2024-04-26T19:32:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4469.297235 secs 2024-04-26T19:32:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3772.281330 secs 2024-04-26T19:32:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:55 smithi092 ceph-mon[29156]: pgmap v3003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:32:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:55 smithi189 ceph-mon[32756]: pgmap v3003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:32:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:55 smithi156 ceph-mon[32679]: pgmap v3003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:32:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:57 smithi189 ceph-mon[32756]: pgmap v3004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:32:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:57 smithi156 ceph-mon[32679]: pgmap v3004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:32:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:57 smithi092 ceph-mon[29156]: pgmap v3004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4474.297345 secs 2024-04-26T19:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:59 smithi189 ceph-mon[32756]: pgmap v3005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:32:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3777.281447 secs 2024-04-26T19:33:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4474.297345 secs 2024-04-26T19:33:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:59 smithi156 ceph-mon[32679]: pgmap v3005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:32:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3777.281447 secs 2024-04-26T19:33:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4474.297345 secs 2024-04-26T19:33:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:59 smithi092 ceph-mon[29156]: pgmap v3005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:32:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3777.281447 secs 2024-04-26T19:33:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:01 smithi189 ceph-mon[32756]: pgmap v3006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:01 smithi156 ceph-mon[32679]: pgmap v3006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:01 smithi092 ceph-mon[29156]: pgmap v3006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:03 smithi189 ceph-mon[32756]: pgmap v3007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:03 smithi156 ceph-mon[32679]: pgmap v3007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:03 smithi092 ceph-mon[29156]: pgmap v3007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4479.297456 secs 2024-04-26T19:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3782.281567 secs 2024-04-26T19:33:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4479.297456 secs 2024-04-26T19:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3782.281567 secs 2024-04-26T19:33:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4479.297456 secs 2024-04-26T19:33:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3782.281567 secs 2024-04-26T19:33:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:05 smithi189 ceph-mon[32756]: pgmap v3008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:05 smithi156 ceph-mon[32679]: pgmap v3008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:05 smithi092 ceph-mon[29156]: pgmap v3008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:07 smithi156 ceph-mon[32679]: pgmap v3009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:07 smithi092 ceph-mon[29156]: pgmap v3009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:07 smithi189 ceph-mon[32756]: pgmap v3009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4484.297566 secs 2024-04-26T19:33:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:09 smithi156 ceph-mon[32679]: pgmap v3010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3787.281644 secs 2024-04-26T19:33:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4484.297566 secs 2024-04-26T19:33:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:09 smithi092 ceph-mon[29156]: pgmap v3010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3787.281644 secs 2024-04-26T19:33:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4484.297566 secs 2024-04-26T19:33:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:09 smithi189 ceph-mon[32756]: pgmap v3010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3787.281644 secs 2024-04-26T19:33:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:11 smithi156 ceph-mon[32679]: pgmap v3011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:11 smithi092 ceph-mon[29156]: pgmap v3011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:11 smithi189 ceph-mon[32756]: pgmap v3011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:13 smithi156 ceph-mon[32679]: pgmap v3012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:13 smithi092 ceph-mon[29156]: pgmap v3012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:13 smithi189 ceph-mon[32756]: pgmap v3012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4489.297685 secs 2024-04-26T19:33:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3792.281722 secs 2024-04-26T19:33:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4489.297685 secs 2024-04-26T19:33:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3792.281722 secs 2024-04-26T19:33:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4489.297685 secs 2024-04-26T19:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3792.281722 secs 2024-04-26T19:33:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:15 smithi156 ceph-mon[32679]: pgmap v3013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:15 smithi092 ceph-mon[29156]: pgmap v3013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:15 smithi189 ceph-mon[32756]: pgmap v3013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:17 smithi156 ceph-mon[32679]: pgmap v3014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:17 smithi092 ceph-mon[29156]: pgmap v3014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:17 smithi189 ceph-mon[32756]: pgmap v3014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4494.297801 secs 2024-04-26T19:33:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:19 smithi156 ceph-mon[32679]: pgmap v3015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3797.281844 secs 2024-04-26T19:33:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4494.297801 secs 2024-04-26T19:33:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:19 smithi092 ceph-mon[29156]: pgmap v3015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3797.281844 secs 2024-04-26T19:33:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4494.297801 secs 2024-04-26T19:33:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:19 smithi189 ceph-mon[32756]: pgmap v3015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3797.281844 secs 2024-04-26T19:33:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:21 smithi156 ceph-mon[32679]: pgmap v3016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:21 smithi092 ceph-mon[29156]: pgmap v3016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:21 smithi189 ceph-mon[32756]: pgmap v3016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:23 smithi156 ceph-mon[32679]: pgmap v3017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:23 smithi092 ceph-mon[29156]: pgmap v3017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:23 smithi189 ceph-mon[32756]: pgmap v3017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4499.297926 secs 2024-04-26T19:33:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3802.281965 secs 2024-04-26T19:33:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4499.297926 secs 2024-04-26T19:33:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3802.281965 secs 2024-04-26T19:33:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4499.297926 secs 2024-04-26T19:33:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3802.281965 secs 2024-04-26T19:33:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:25 smithi156 ceph-mon[32679]: pgmap v3018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:25 smithi092 ceph-mon[29156]: pgmap v3018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:25 smithi189 ceph-mon[32756]: pgmap v3018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:27 smithi092 ceph-mon[29156]: pgmap v3019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:27 smithi189 ceph-mon[32756]: pgmap v3019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:27 smithi156 ceph-mon[32679]: pgmap v3019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4504.298034 secs 2024-04-26T19:33:29.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4504.298034 secs 2024-04-26T19:33:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4504.298034 secs 2024-04-26T19:33:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:29 smithi092 ceph-mon[29156]: pgmap v3020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3807.282040 secs 2024-04-26T19:33:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:29 smithi189 ceph-mon[32756]: pgmap v3020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3807.282040 secs 2024-04-26T19:33:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:29 smithi156 ceph-mon[32679]: pgmap v3020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3807.282040 secs 2024-04-26T19:33:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:31 smithi092 ceph-mon[29156]: pgmap v3021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:31 smithi189 ceph-mon[32756]: pgmap v3021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:31 smithi156 ceph-mon[32679]: pgmap v3021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:33 smithi092 ceph-mon[29156]: pgmap v3022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4509.298147 secs 2024-04-26T19:33:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:33 smithi189 ceph-mon[32756]: pgmap v3022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4509.298147 secs 2024-04-26T19:33:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:33 smithi156 ceph-mon[32679]: pgmap v3022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4509.298147 secs 2024-04-26T19:33:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3812.282160 secs 2024-04-26T19:33:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3812.282160 secs 2024-04-26T19:33:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3812.282160 secs 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803dec0 tx=0x7f1ca80a5000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803dec0 tx=0x7f1ca80a5000 comp rx=0 tx=0).stop 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a4b40 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a4b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a4b40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:33:35.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:33:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:35.995+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80a9000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.024+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.024+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=3 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.025+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T19:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.025+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T19:33:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:35 smithi092 ceph-mon[29156]: pgmap v3023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:35 smithi189 ceph-mon[32756]: pgmap v3023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:35 smithi156 ceph-mon[32679]: pgmap v3023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.595+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:33:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.595+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:33:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.595+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:33:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:33:36.595+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 39 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:33:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:37 smithi092 ceph-mon[29156]: pgmap v3024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:37 smithi189 ceph-mon[32756]: pgmap v3024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:37 smithi156 ceph-mon[32679]: pgmap v3024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4514.298264 secs 2024-04-26T19:33:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4514.298264 secs 2024-04-26T19:33:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4514.298264 secs 2024-04-26T19:33:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:39 smithi092 ceph-mon[29156]: pgmap v3025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3817.282250 secs 2024-04-26T19:33:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:39 smithi189 ceph-mon[32756]: pgmap v3025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3817.282250 secs 2024-04-26T19:33:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:39 smithi156 ceph-mon[32679]: pgmap v3025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3817.282250 secs 2024-04-26T19:33:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:41 smithi092 ceph-mon[29156]: pgmap v3026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:41 smithi189 ceph-mon[32756]: pgmap v3026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:41 smithi156 ceph-mon[32679]: pgmap v3026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:43 smithi092 ceph-mon[29156]: pgmap v3027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4519.298401 secs 2024-04-26T19:33:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:43 smithi189 ceph-mon[32756]: pgmap v3027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4519.298401 secs 2024-04-26T19:33:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:43 smithi156 ceph-mon[32679]: pgmap v3027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4519.298401 secs 2024-04-26T19:33:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3822.282371 secs 2024-04-26T19:33:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3822.282371 secs 2024-04-26T19:33:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3822.282371 secs 2024-04-26T19:33:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:45 smithi092 ceph-mon[29156]: pgmap v3028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:45 smithi189 ceph-mon[32756]: pgmap v3028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:45 smithi156 ceph-mon[32679]: pgmap v3028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:33:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: pgmap v3029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: pgmap v3030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: pgmap v3031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:33:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: pgmap v3029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: pgmap v3030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: pgmap v3031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:33:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: pgmap v3029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:33:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:33:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:33:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: pgmap v3030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:33:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: pgmap v3031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:33:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4524.298463 secs 2024-04-26T19:33:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3827.282478 secs 2024-04-26T19:33:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4524.298463 secs 2024-04-26T19:33:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3827.282478 secs 2024-04-26T19:33:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4524.298463 secs 2024-04-26T19:33:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3827.282478 secs 2024-04-26T19:33:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:50 smithi189 ceph-mon[32756]: pgmap v3032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:50 smithi156 ceph-mon[32679]: pgmap v3032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:50 smithi092 ceph-mon[29156]: pgmap v3032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:52 smithi092 ceph-mon[29156]: pgmap v3033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:52 smithi189 ceph-mon[32756]: pgmap v3033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:52 smithi156 ceph-mon[32679]: pgmap v3033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:54 smithi092 ceph-mon[29156]: pgmap v3034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:33:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4529.298583 secs 2024-04-26T19:33:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3832.282600 secs 2024-04-26T19:33:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:54 smithi189 ceph-mon[32756]: pgmap v3034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:33:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4529.298583 secs 2024-04-26T19:33:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3832.282600 secs 2024-04-26T19:33:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:54 smithi156 ceph-mon[32679]: pgmap v3034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:33:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4529.298583 secs 2024-04-26T19:33:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3832.282600 secs 2024-04-26T19:33:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:56 smithi092 ceph-mon[29156]: pgmap v3035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:56 smithi189 ceph-mon[32756]: pgmap v3035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:56 smithi156 ceph-mon[32679]: pgmap v3035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:33:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:58 smithi092 ceph-mon[29156]: pgmap v3036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:33:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:58 smithi189 ceph-mon[32756]: pgmap v3036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:33:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:58 smithi156 ceph-mon[32679]: pgmap v3036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:33:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4534.298700 secs 2024-04-26T19:33:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:33:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3837.282685 secs 2024-04-26T19:33:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4534.298700 secs 2024-04-26T19:33:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:33:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3837.282685 secs 2024-04-26T19:33:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4534.298700 secs 2024-04-26T19:33:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:33:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3837.282685 secs 2024-04-26T19:34:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:00 smithi092 ceph-mon[29156]: pgmap v3037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:00 smithi189 ceph-mon[32756]: pgmap v3037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:00 smithi156 ceph-mon[32679]: pgmap v3037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:02 smithi092 ceph-mon[29156]: pgmap v3038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:02 smithi189 ceph-mon[32756]: pgmap v3038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:02 smithi156 ceph-mon[32679]: pgmap v3038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:04 smithi092 ceph-mon[29156]: pgmap v3039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4539.298764 secs 2024-04-26T19:34:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:04 smithi092 ceph-mon[29156]: 6 slow requests, 2 included below; oldest blocked for > 3842.282798 secs 2024-04-26T19:34:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:04 smithi092 ceph-mon[29156]: slow request 2881.988165 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:04 smithi092 ceph-mon[29156]: slow request 721.440702 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:04 smithi189 ceph-mon[32756]: pgmap v3039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4539.298764 secs 2024-04-26T19:34:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:04 smithi189 ceph-mon[32756]: 6 slow requests, 2 included below; oldest blocked for > 3842.282798 secs 2024-04-26T19:34:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:04 smithi189 ceph-mon[32756]: slow request 2881.988165 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:04 smithi189 ceph-mon[32756]: slow request 721.440702 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:04 smithi156 ceph-mon[32679]: pgmap v3039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4539.298764 secs 2024-04-26T19:34:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:04 smithi156 ceph-mon[32679]: 6 slow requests, 2 included below; oldest blocked for > 3842.282798 secs 2024-04-26T19:34:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:04 smithi156 ceph-mon[32679]: slow request 2881.988165 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:04 smithi156 ceph-mon[32679]: slow request 721.440702 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:34:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:06 smithi092 ceph-mon[29156]: pgmap v3040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:06 smithi189 ceph-mon[32756]: pgmap v3040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:06 smithi156 ceph-mon[32679]: pgmap v3040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:08 smithi092 ceph-mon[29156]: pgmap v3041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:08 smithi189 ceph-mon[32756]: pgmap v3041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:08 smithi156 ceph-mon[32679]: pgmap v3041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4544.298887 secs 2024-04-26T19:34:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3847.282897 secs 2024-04-26T19:34:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4544.298887 secs 2024-04-26T19:34:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3847.282897 secs 2024-04-26T19:34:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4544.298887 secs 2024-04-26T19:34:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3847.282897 secs 2024-04-26T19:34:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:10 smithi092 ceph-mon[29156]: pgmap v3042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:10 smithi189 ceph-mon[32756]: pgmap v3042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:10 smithi156 ceph-mon[32679]: pgmap v3042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:12 smithi092 ceph-mon[29156]: pgmap v3043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:12 smithi189 ceph-mon[32756]: pgmap v3043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:12 smithi156 ceph-mon[32679]: pgmap v3043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:14 smithi092 ceph-mon[29156]: pgmap v3044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4549.299001 secs 2024-04-26T19:34:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3852.283042 secs 2024-04-26T19:34:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:14 smithi189 ceph-mon[32756]: pgmap v3044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4549.299001 secs 2024-04-26T19:34:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3852.283042 secs 2024-04-26T19:34:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:14 smithi156 ceph-mon[32679]: pgmap v3044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4549.299001 secs 2024-04-26T19:34:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3852.283042 secs 2024-04-26T19:34:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:16 smithi092 ceph-mon[29156]: pgmap v3045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:16 smithi189 ceph-mon[32756]: pgmap v3045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:16 smithi156 ceph-mon[32679]: pgmap v3045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:18 smithi092 ceph-mon[29156]: pgmap v3046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:18 smithi189 ceph-mon[32756]: pgmap v3046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:18 smithi156 ceph-mon[32679]: pgmap v3046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4554.299152 secs 2024-04-26T19:34:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3857.283166 secs 2024-04-26T19:34:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4554.299152 secs 2024-04-26T19:34:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3857.283166 secs 2024-04-26T19:34:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4554.299152 secs 2024-04-26T19:34:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3857.283166 secs 2024-04-26T19:34:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:20 smithi189 ceph-mon[32756]: pgmap v3047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:20 smithi156 ceph-mon[32679]: pgmap v3047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:20 smithi092 ceph-mon[29156]: pgmap v3047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:22 smithi189 ceph-mon[32756]: pgmap v3048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:22 smithi156 ceph-mon[32679]: pgmap v3048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:22 smithi092 ceph-mon[29156]: pgmap v3048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:23 smithi189 ceph-mon[32756]: pgmap v3049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:23 smithi156 ceph-mon[32679]: pgmap v3049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:23 smithi092 ceph-mon[29156]: pgmap v3049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4559.299278 secs 2024-04-26T19:34:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3862.283290 secs 2024-04-26T19:34:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4559.299278 secs 2024-04-26T19:34:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3862.283290 secs 2024-04-26T19:34:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4559.299278 secs 2024-04-26T19:34:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3862.283290 secs 2024-04-26T19:34:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:25 smithi189 ceph-mon[32756]: pgmap v3050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:25 smithi156 ceph-mon[32679]: pgmap v3050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:25 smithi092 ceph-mon[29156]: pgmap v3050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:28 smithi092 ceph-mon[29156]: pgmap v3051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:28 smithi189 ceph-mon[32756]: pgmap v3051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:28 smithi156 ceph-mon[32679]: pgmap v3051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4564.299397 secs 2024-04-26T19:34:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3867.283407 secs 2024-04-26T19:34:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4564.299397 secs 2024-04-26T19:34:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3867.283407 secs 2024-04-26T19:34:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4564.299397 secs 2024-04-26T19:34:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3867.283407 secs 2024-04-26T19:34:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:30 smithi092 ceph-mon[29156]: pgmap v3052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:30 smithi189 ceph-mon[32756]: pgmap v3052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:30 smithi156 ceph-mon[32679]: pgmap v3052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:32 smithi092 ceph-mon[29156]: pgmap v3053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:32 smithi189 ceph-mon[32756]: pgmap v3053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:32 smithi156 ceph-mon[32679]: pgmap v3053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:34 smithi092 ceph-mon[29156]: pgmap v3054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4569.299489 secs 2024-04-26T19:34:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3872.283526 secs 2024-04-26T19:34:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:34 smithi189 ceph-mon[32756]: pgmap v3054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4569.299489 secs 2024-04-26T19:34:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3872.283526 secs 2024-04-26T19:34:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:34 smithi156 ceph-mon[32679]: pgmap v3054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4569.299489 secs 2024-04-26T19:34:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3872.283526 secs 2024-04-26T19:34:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:36 smithi092 ceph-mon[29156]: pgmap v3055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:36 smithi189 ceph-mon[32756]: pgmap v3055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:36 smithi156 ceph-mon[32679]: pgmap v3055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:38 smithi092 ceph-mon[29156]: pgmap v3056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:38 smithi189 ceph-mon[32756]: pgmap v3056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:38 smithi156 ceph-mon[32679]: pgmap v3056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4574.299630 secs 2024-04-26T19:34:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3877.283644 secs 2024-04-26T19:34:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4574.299630 secs 2024-04-26T19:34:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3877.283644 secs 2024-04-26T19:34:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4574.299630 secs 2024-04-26T19:34:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3877.283644 secs 2024-04-26T19:34:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:40 smithi092 ceph-mon[29156]: pgmap v3057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:40 smithi189 ceph-mon[32756]: pgmap v3057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:40 smithi156 ceph-mon[32679]: pgmap v3057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:42 smithi092 ceph-mon[29156]: pgmap v3058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:42 smithi189 ceph-mon[32756]: pgmap v3058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:42 smithi156 ceph-mon[32679]: pgmap v3058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:44 smithi092 ceph-mon[29156]: pgmap v3059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4579.299752 secs 2024-04-26T19:34:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3882.283802 secs 2024-04-26T19:34:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:44 smithi189 ceph-mon[32756]: pgmap v3059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4579.299752 secs 2024-04-26T19:34:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3882.283802 secs 2024-04-26T19:34:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:44 smithi156 ceph-mon[32679]: pgmap v3059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4579.299752 secs 2024-04-26T19:34:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3882.283802 secs 2024-04-26T19:34:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:46 smithi092 ceph-mon[29156]: pgmap v3060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:46 smithi189 ceph-mon[32756]: pgmap v3060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:46 smithi156 ceph-mon[32679]: pgmap v3060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:34:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:48 smithi189 ceph-mon[32756]: pgmap v3061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:34:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:48 smithi156 ceph-mon[32679]: pgmap v3061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:34:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:48 smithi092 ceph-mon[29156]: pgmap v3061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:34:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:34:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:34:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:34:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:34:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:49 smithi189 ceph-mon[32756]: pgmap v3062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:34:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:49 smithi189 ceph-mon[32756]: pgmap v3063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:34:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4584.299844 secs 2024-04-26T19:34:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3887.283921 secs 2024-04-26T19:34:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:49 smithi156 ceph-mon[32679]: pgmap v3062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:34:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:49 smithi156 ceph-mon[32679]: pgmap v3063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:34:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4584.299844 secs 2024-04-26T19:34:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3887.283921 secs 2024-04-26T19:34:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:49 smithi092 ceph-mon[29156]: pgmap v3062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:34:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:49 smithi092 ceph-mon[29156]: pgmap v3063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:34:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4584.299844 secs 2024-04-26T19:34:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3887.283921 secs 2024-04-26T19:34:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:51 smithi189 ceph-mon[32756]: pgmap v3064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:51 smithi156 ceph-mon[32679]: pgmap v3064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:51 smithi092 ceph-mon[29156]: pgmap v3064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:53 smithi189 ceph-mon[32756]: pgmap v3065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:53 smithi156 ceph-mon[32679]: pgmap v3065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:53 smithi092 ceph-mon[29156]: pgmap v3065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4589.299927 secs 2024-04-26T19:34:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3892.284008 secs 2024-04-26T19:34:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4589.299927 secs 2024-04-26T19:34:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3892.284008 secs 2024-04-26T19:34:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4589.299927 secs 2024-04-26T19:34:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3892.284008 secs 2024-04-26T19:34:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:55 smithi189 ceph-mon[32756]: pgmap v3066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:55 smithi156 ceph-mon[32679]: pgmap v3066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:55 smithi092 ceph-mon[29156]: pgmap v3066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:56 smithi189 ceph-mon[32756]: pgmap v3067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:56 smithi156 ceph-mon[32679]: pgmap v3067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:56 smithi092 ceph-mon[29156]: pgmap v3067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:34:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:58 smithi092 ceph-mon[29156]: pgmap v3068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:34:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4594.300057 secs 2024-04-26T19:34:59.387 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:58 smithi156 ceph-mon[32679]: pgmap v3068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:34:59.387 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4594.300057 secs 2024-04-26T19:34:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:58 smithi189 ceph-mon[32756]: pgmap v3068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:34:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4594.300057 secs 2024-04-26T19:35:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:34:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3897.284149 secs 2024-04-26T19:35:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:34:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3897.284149 secs 2024-04-26T19:35:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:34:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3897.284149 secs 2024-04-26T19:35:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:00 smithi092 ceph-mon[29156]: pgmap v3069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:00 smithi189 ceph-mon[32756]: pgmap v3069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:00 smithi156 ceph-mon[32679]: pgmap v3069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:02 smithi092 ceph-mon[29156]: pgmap v3070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:02 smithi189 ceph-mon[32756]: pgmap v3070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:02 smithi156 ceph-mon[32679]: pgmap v3070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4599.300119 secs 2024-04-26T19:35:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4599.300119 secs 2024-04-26T19:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4599.300119 secs 2024-04-26T19:35:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3902.284273 secs 2024-04-26T19:35:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:04 smithi092 ceph-mon[29156]: pgmap v3071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3902.284273 secs 2024-04-26T19:35:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:04 smithi189 ceph-mon[32756]: pgmap v3071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3902.284273 secs 2024-04-26T19:35:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:04 smithi156 ceph-mon[32679]: pgmap v3071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:06 smithi189 ceph-mon[32756]: pgmap v3072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:06 smithi156 ceph-mon[32679]: pgmap v3072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:06 smithi092 ceph-mon[29156]: pgmap v3072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:09 smithi189 ceph-mon[32756]: pgmap v3073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4604.300240 secs 2024-04-26T19:35:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:08 smithi156 ceph-mon[32679]: pgmap v3073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4604.300240 secs 2024-04-26T19:35:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:08 smithi092 ceph-mon[29156]: pgmap v3073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4604.300240 secs 2024-04-26T19:35:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3907.284398 secs 2024-04-26T19:35:10.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3907.284398 secs 2024-04-26T19:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3907.284398 secs 2024-04-26T19:35:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:11 smithi189 ceph-mon[32756]: pgmap v3074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:11 smithi156 ceph-mon[32679]: pgmap v3074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:11 smithi092 ceph-mon[29156]: pgmap v3074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:13 smithi189 ceph-mon[32756]: pgmap v3075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:13 smithi156 ceph-mon[32679]: pgmap v3075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:13 smithi092 ceph-mon[29156]: pgmap v3075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4609.300306 secs 2024-04-26T19:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3912.284523 secs 2024-04-26T19:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4609.300306 secs 2024-04-26T19:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3912.284523 secs 2024-04-26T19:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4609.300306 secs 2024-04-26T19:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3912.284523 secs 2024-04-26T19:35:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:15 smithi189 ceph-mon[32756]: pgmap v3076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:15 smithi156 ceph-mon[32679]: pgmap v3076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:15 smithi092 ceph-mon[29156]: pgmap v3076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:17 smithi189 ceph-mon[32756]: pgmap v3077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:17 smithi156 ceph-mon[32679]: pgmap v3077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:17 smithi092 ceph-mon[29156]: pgmap v3077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:19 smithi189 ceph-mon[32756]: pgmap v3078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4614.300425 secs 2024-04-26T19:35:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3917.284630 secs 2024-04-26T19:35:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:19 smithi156 ceph-mon[32679]: pgmap v3078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4614.300425 secs 2024-04-26T19:35:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3917.284630 secs 2024-04-26T19:35:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:19 smithi092 ceph-mon[29156]: pgmap v3078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4614.300425 secs 2024-04-26T19:35:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3917.284630 secs 2024-04-26T19:35:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:21 smithi189 ceph-mon[32756]: pgmap v3079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:21 smithi156 ceph-mon[32679]: pgmap v3079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:21 smithi092 ceph-mon[29156]: pgmap v3079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:23 smithi189 ceph-mon[32756]: pgmap v3080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:23 smithi156 ceph-mon[32679]: pgmap v3080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:23 smithi092 ceph-mon[29156]: pgmap v3080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4619.300526 secs 2024-04-26T19:35:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3922.284718 secs 2024-04-26T19:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4619.300526 secs 2024-04-26T19:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3922.284718 secs 2024-04-26T19:35:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4619.300526 secs 2024-04-26T19:35:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3922.284718 secs 2024-04-26T19:35:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:25 smithi189 ceph-mon[32756]: pgmap v3081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:25 smithi156 ceph-mon[32679]: pgmap v3081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:25 smithi092 ceph-mon[29156]: pgmap v3081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:27 smithi189 ceph-mon[32756]: pgmap v3082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:27 smithi156 ceph-mon[32679]: pgmap v3082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:27 smithi092 ceph-mon[29156]: pgmap v3082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:29 smithi189 ceph-mon[32756]: pgmap v3083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4624.300671 secs 2024-04-26T19:35:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3927.284797 secs 2024-04-26T19:35:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:29 smithi156 ceph-mon[32679]: pgmap v3083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4624.300671 secs 2024-04-26T19:35:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3927.284797 secs 2024-04-26T19:35:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:29 smithi092 ceph-mon[29156]: pgmap v3083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4624.300671 secs 2024-04-26T19:35:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3927.284797 secs 2024-04-26T19:35:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:31 smithi092 ceph-mon[29156]: pgmap v3084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:31 smithi189 ceph-mon[32756]: pgmap v3084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:31 smithi156 ceph-mon[32679]: pgmap v3084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:33 smithi189 ceph-mon[32756]: pgmap v3085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:33 smithi156 ceph-mon[32679]: pgmap v3085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:33 smithi092 ceph-mon[29156]: pgmap v3085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4629.300773 secs 2024-04-26T19:35:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3932.284914 secs 2024-04-26T19:35:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4629.300773 secs 2024-04-26T19:35:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3932.284914 secs 2024-04-26T19:35:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4629.300773 secs 2024-04-26T19:35:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3932.284914 secs 2024-04-26T19:35:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:35 smithi189 ceph-mon[32756]: pgmap v3086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:35 smithi156 ceph-mon[32679]: pgmap v3086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:35 smithi092 ceph-mon[29156]: pgmap v3086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:37 smithi189 ceph-mon[32756]: pgmap v3087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:37 smithi156 ceph-mon[32679]: pgmap v3087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:37 smithi092 ceph-mon[29156]: pgmap v3087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:39 smithi189 ceph-mon[32756]: pgmap v3088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4634.300856 secs 2024-04-26T19:35:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3937.285056 secs 2024-04-26T19:35:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:39 smithi156 ceph-mon[32679]: pgmap v3088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4634.300856 secs 2024-04-26T19:35:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3937.285056 secs 2024-04-26T19:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:39 smithi092 ceph-mon[29156]: pgmap v3088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4634.300856 secs 2024-04-26T19:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3937.285056 secs 2024-04-26T19:35:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:41 smithi189 ceph-mon[32756]: pgmap v3089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:41 smithi156 ceph-mon[32679]: pgmap v3089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:41 smithi092 ceph-mon[29156]: pgmap v3089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:43 smithi189 ceph-mon[32756]: pgmap v3090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:43 smithi156 ceph-mon[32679]: pgmap v3090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:43 smithi092 ceph-mon[29156]: pgmap v3090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4639.300999 secs 2024-04-26T19:35:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3942.285199 secs 2024-04-26T19:35:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4639.300999 secs 2024-04-26T19:35:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3942.285199 secs 2024-04-26T19:35:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4639.300999 secs 2024-04-26T19:35:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3942.285199 secs 2024-04-26T19:35:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:45 smithi189 ceph-mon[32756]: pgmap v3091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:45 smithi156 ceph-mon[32679]: pgmap v3091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:45 smithi092 ceph-mon[29156]: pgmap v3091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:35:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:47 smithi189 ceph-mon[32756]: pgmap v3092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:47 smithi156 ceph-mon[32679]: pgmap v3092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:47 smithi092 ceph-mon[29156]: pgmap v3092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: pgmap v3093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4644.301092 secs 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3947.285282 secs 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:35:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: pgmap v3093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4644.301092 secs 2024-04-26T19:35:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3947.285282 secs 2024-04-26T19:35:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:35:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: pgmap v3093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:35:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4644.301092 secs 2024-04-26T19:35:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3947.285282 secs 2024-04-26T19:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:35:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:50 smithi189 ceph-mon[32756]: pgmap v3094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:35:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:50 smithi189 ceph-mon[32756]: pgmap v3095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:50 smithi156 ceph-mon[32679]: pgmap v3094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:35:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:50 smithi156 ceph-mon[32679]: pgmap v3095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:50 smithi092 ceph-mon[29156]: pgmap v3094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:35:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:50 smithi092 ceph-mon[29156]: pgmap v3095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:52 smithi189 ceph-mon[32756]: pgmap v3096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:52 smithi156 ceph-mon[32679]: pgmap v3096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:52 smithi092 ceph-mon[29156]: pgmap v3096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:54 smithi189 ceph-mon[32756]: pgmap v3097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:35:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4649.301216 secs 2024-04-26T19:35:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3952.285379 secs 2024-04-26T19:35:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:54 smithi156 ceph-mon[32679]: pgmap v3097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:35:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4649.301216 secs 2024-04-26T19:35:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3952.285379 secs 2024-04-26T19:35:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:54 smithi092 ceph-mon[29156]: pgmap v3097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:35:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4649.301216 secs 2024-04-26T19:35:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3952.285379 secs 2024-04-26T19:35:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:56 smithi189 ceph-mon[32756]: pgmap v3098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:56 smithi156 ceph-mon[32679]: pgmap v3098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:56 smithi092 ceph-mon[29156]: pgmap v3098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:58 smithi189 ceph-mon[32756]: pgmap v3099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:58 smithi156 ceph-mon[32679]: pgmap v3099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:58 smithi092 ceph-mon[29156]: pgmap v3099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:35:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4654.301336 secs 2024-04-26T19:35:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:35:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3957.285507 secs 2024-04-26T19:35:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4654.301336 secs 2024-04-26T19:35:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:35:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3957.285507 secs 2024-04-26T19:35:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4654.301336 secs 2024-04-26T19:35:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:35:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3957.285507 secs 2024-04-26T19:36:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:00 smithi189 ceph-mon[32756]: pgmap v3100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:36:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:00 smithi156 ceph-mon[32679]: pgmap v3100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:36:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:00 smithi092 ceph-mon[29156]: pgmap v3100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:36:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:02 smithi189 ceph-mon[32756]: pgmap v3101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:02 smithi156 ceph-mon[32679]: pgmap v3101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:02 smithi092 ceph-mon[29156]: pgmap v3101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:04 smithi189 ceph-mon[32756]: pgmap v3102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4659.301401 secs 2024-04-26T19:36:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3962.285618 secs 2024-04-26T19:36:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:04 smithi156 ceph-mon[32679]: pgmap v3102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4659.301401 secs 2024-04-26T19:36:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3962.285618 secs 2024-04-26T19:36:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:04 smithi092 ceph-mon[29156]: pgmap v3102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4659.301401 secs 2024-04-26T19:36:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3962.285618 secs 2024-04-26T19:36:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:06 smithi189 ceph-mon[32756]: pgmap v3103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:06 smithi156 ceph-mon[32679]: pgmap v3103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:06 smithi092 ceph-mon[29156]: pgmap v3103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:08 smithi156 ceph-mon[32679]: pgmap v3104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:08 smithi092 ceph-mon[29156]: pgmap v3104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:08 smithi189 ceph-mon[32756]: pgmap v3104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4664.301541 secs 2024-04-26T19:36:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3967.285760 secs 2024-04-26T19:36:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4664.301541 secs 2024-04-26T19:36:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3967.285760 secs 2024-04-26T19:36:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4664.301541 secs 2024-04-26T19:36:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3967.285760 secs 2024-04-26T19:36:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:10 smithi156 ceph-mon[32679]: pgmap v3105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:10 smithi092 ceph-mon[29156]: pgmap v3105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:10 smithi189 ceph-mon[32756]: pgmap v3105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:12 smithi156 ceph-mon[32679]: pgmap v3106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:12 smithi092 ceph-mon[29156]: pgmap v3106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:12 smithi189 ceph-mon[32756]: pgmap v3106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:14 smithi156 ceph-mon[32679]: pgmap v3107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4669.301645 secs 2024-04-26T19:36:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3972.285903 secs 2024-04-26T19:36:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:14 smithi092 ceph-mon[29156]: pgmap v3107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4669.301645 secs 2024-04-26T19:36:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3972.285903 secs 2024-04-26T19:36:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:14 smithi189 ceph-mon[32756]: pgmap v3107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4669.301645 secs 2024-04-26T19:36:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3972.285903 secs 2024-04-26T19:36:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:16 smithi156 ceph-mon[32679]: pgmap v3108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:16 smithi092 ceph-mon[29156]: pgmap v3108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:16 smithi189 ceph-mon[32756]: pgmap v3108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:18 smithi092 ceph-mon[29156]: pgmap v3109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:18 smithi156 ceph-mon[32679]: pgmap v3109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:18 smithi189 ceph-mon[32756]: pgmap v3109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4674.301780 secs 2024-04-26T19:36:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3977.286044 secs 2024-04-26T19:36:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4674.301780 secs 2024-04-26T19:36:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3977.286044 secs 2024-04-26T19:36:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4674.301780 secs 2024-04-26T19:36:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3977.286044 secs 2024-04-26T19:36:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:20 smithi156 ceph-mon[32679]: pgmap v3110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:20 smithi092 ceph-mon[29156]: pgmap v3110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:20 smithi189 ceph-mon[32756]: pgmap v3110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:22 smithi156 ceph-mon[32679]: pgmap v3111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:22 smithi092 ceph-mon[29156]: pgmap v3111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:22 smithi189 ceph-mon[32756]: pgmap v3111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:24 smithi156 ceph-mon[32679]: pgmap v3112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4679.301910 secs 2024-04-26T19:36:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3982.286190 secs 2024-04-26T19:36:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:24 smithi092 ceph-mon[29156]: pgmap v3112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4679.301910 secs 2024-04-26T19:36:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3982.286190 secs 2024-04-26T19:36:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:24 smithi189 ceph-mon[32756]: pgmap v3112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4679.301910 secs 2024-04-26T19:36:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3982.286190 secs 2024-04-26T19:36:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:26 smithi156 ceph-mon[32679]: pgmap v3113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:26 smithi092 ceph-mon[29156]: pgmap v3113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:26 smithi189 ceph-mon[32756]: pgmap v3113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:28 smithi156 ceph-mon[32679]: pgmap v3114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:28 smithi092 ceph-mon[29156]: pgmap v3114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:28 smithi189 ceph-mon[32756]: pgmap v3114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4684.302049 secs 2024-04-26T19:36:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3987.286274 secs 2024-04-26T19:36:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4684.302049 secs 2024-04-26T19:36:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3987.286274 secs 2024-04-26T19:36:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4684.302049 secs 2024-04-26T19:36:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3987.286274 secs 2024-04-26T19:36:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:30 smithi092 ceph-mon[29156]: pgmap v3115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:30 smithi189 ceph-mon[32756]: pgmap v3115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:30 smithi156 ceph-mon[32679]: pgmap v3115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:32 smithi092 ceph-mon[29156]: pgmap v3116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:32 smithi189 ceph-mon[32756]: pgmap v3116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:32 smithi156 ceph-mon[32679]: pgmap v3116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:34 smithi092 ceph-mon[29156]: pgmap v3117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4689.302146 secs 2024-04-26T19:36:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3992.286433 secs 2024-04-26T19:36:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:34 smithi189 ceph-mon[32756]: pgmap v3117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4689.302146 secs 2024-04-26T19:36:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3992.286433 secs 2024-04-26T19:36:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:34 smithi156 ceph-mon[32679]: pgmap v3117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4689.302146 secs 2024-04-26T19:36:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3992.286433 secs 2024-04-26T19:36:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:36 smithi092 ceph-mon[29156]: pgmap v3118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:36:36.619+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:36:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:36:36.619+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:36:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:36:36.619+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:36:36.619 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:36:36.619+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 40 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:36:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:36 smithi189 ceph-mon[32756]: pgmap v3118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:36 smithi156 ceph-mon[32679]: pgmap v3118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:38 smithi092 ceph-mon[29156]: pgmap v3119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:38 smithi189 ceph-mon[32756]: pgmap v3119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:38 smithi156 ceph-mon[32679]: pgmap v3119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4694.302294 secs 2024-04-26T19:36:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 3997.286577 secs 2024-04-26T19:36:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4694.302294 secs 2024-04-26T19:36:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 3997.286577 secs 2024-04-26T19:36:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4694.302294 secs 2024-04-26T19:36:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 3997.286577 secs 2024-04-26T19:36:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:40 smithi092 ceph-mon[29156]: pgmap v3120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:40 smithi189 ceph-mon[32756]: pgmap v3120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:40 smithi156 ceph-mon[32679]: pgmap v3120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:42 smithi092 ceph-mon[29156]: pgmap v3121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:42 smithi189 ceph-mon[32756]: pgmap v3121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:42 smithi156 ceph-mon[32679]: pgmap v3121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:44 smithi092 ceph-mon[29156]: pgmap v3122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4699.302385 secs 2024-04-26T19:36:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4002.286715 secs 2024-04-26T19:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:44 smithi189 ceph-mon[32756]: pgmap v3122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4699.302385 secs 2024-04-26T19:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4002.286715 secs 2024-04-26T19:36:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:44 smithi156 ceph-mon[32679]: pgmap v3122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4699.302385 secs 2024-04-26T19:36:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4002.286715 secs 2024-04-26T19:36:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:46 smithi092 ceph-mon[29156]: pgmap v3123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:46 smithi189 ceph-mon[32756]: pgmap v3123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:46 smithi156 ceph-mon[32679]: pgmap v3123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:48 smithi092 ceph-mon[29156]: pgmap v3124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:48 smithi189 ceph-mon[32756]: pgmap v3124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:48 smithi156 ceph-mon[32679]: pgmap v3124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:36:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4704.302462 secs 2024-04-26T19:36:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4007.286840 secs 2024-04-26T19:36:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4704.302462 secs 2024-04-26T19:36:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4007.286840 secs 2024-04-26T19:36:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4704.302462 secs 2024-04-26T19:36:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4007.286840 secs 2024-04-26T19:36:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:36:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:50 smithi092 ceph-mon[29156]: pgmap v3125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:36:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:50 smithi189 ceph-mon[32756]: pgmap v3125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:36:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:50 smithi156 ceph-mon[32679]: pgmap v3125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:36:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:36:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:36:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:36:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:51 smithi092 ceph-mon[29156]: pgmap v3126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:36:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:51 smithi092 ceph-mon[29156]: pgmap v3127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:51 smithi189 ceph-mon[32756]: pgmap v3126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:36:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:51 smithi189 ceph-mon[32756]: pgmap v3127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:51 smithi156 ceph-mon[32679]: pgmap v3126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:36:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:51 smithi156 ceph-mon[32679]: pgmap v3127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:53 smithi092 ceph-mon[29156]: pgmap v3128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:53 smithi189 ceph-mon[32756]: pgmap v3128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:53 smithi156 ceph-mon[32679]: pgmap v3128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4709.302541 secs 2024-04-26T19:36:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4012.286912 secs 2024-04-26T19:36:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4709.302541 secs 2024-04-26T19:36:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4012.286912 secs 2024-04-26T19:36:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4709.302541 secs 2024-04-26T19:36:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4012.286912 secs 2024-04-26T19:36:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:55 smithi092 ceph-mon[29156]: pgmap v3129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:36:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:55 smithi189 ceph-mon[32756]: pgmap v3129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:36:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:55 smithi156 ceph-mon[32679]: pgmap v3129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:36:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:57 smithi092 ceph-mon[29156]: pgmap v3130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:57 smithi189 ceph-mon[32756]: pgmap v3130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:57 smithi156 ceph-mon[32679]: pgmap v3130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:36:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:59 smithi189 ceph-mon[32756]: pgmap v3131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:36:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4714.302676 secs 2024-04-26T19:36:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:36:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4017.287037 secs 2024-04-26T19:36:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:59 smithi156 ceph-mon[32679]: pgmap v3131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:36:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4714.302676 secs 2024-04-26T19:36:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:36:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4017.287037 secs 2024-04-26T19:36:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:59 smithi092 ceph-mon[29156]: pgmap v3131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:36:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4714.302676 secs 2024-04-26T19:36:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:36:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4017.287037 secs 2024-04-26T19:37:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:01 smithi189 ceph-mon[32756]: pgmap v3132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:37:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:01 smithi156 ceph-mon[32679]: pgmap v3132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:37:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:01 smithi092 ceph-mon[29156]: pgmap v3132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:37:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:03 smithi189 ceph-mon[32756]: pgmap v3133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:03 smithi156 ceph-mon[32679]: pgmap v3133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:03 smithi092 ceph-mon[29156]: pgmap v3133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:04.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4719.302791 secs 2024-04-26T19:37:04.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4022.287113 secs 2024-04-26T19:37:04.572 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4719.302791 secs 2024-04-26T19:37:04.573 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4022.287113 secs 2024-04-26T19:37:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4719.302791 secs 2024-04-26T19:37:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4022.287113 secs 2024-04-26T19:37:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:05 smithi189 ceph-mon[32756]: pgmap v3134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:05 smithi156 ceph-mon[32679]: pgmap v3134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:05 smithi092 ceph-mon[29156]: pgmap v3134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:07 smithi189 ceph-mon[32756]: pgmap v3135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:07 smithi156 ceph-mon[32679]: pgmap v3135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:07 smithi092 ceph-mon[29156]: pgmap v3135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:09 smithi189 ceph-mon[32756]: pgmap v3136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4724.302910 secs 2024-04-26T19:37:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4027.287252 secs 2024-04-26T19:37:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:09 smithi156 ceph-mon[32679]: pgmap v3136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4724.302910 secs 2024-04-26T19:37:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4027.287252 secs 2024-04-26T19:37:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:09 smithi092 ceph-mon[29156]: pgmap v3136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4724.302910 secs 2024-04-26T19:37:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4027.287252 secs 2024-04-26T19:37:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:11 smithi189 ceph-mon[32756]: pgmap v3137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:11 smithi156 ceph-mon[32679]: pgmap v3137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:11 smithi092 ceph-mon[29156]: pgmap v3137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:13.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:13 smithi092 ceph-mon[29156]: pgmap v3138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:13 smithi189 ceph-mon[32756]: pgmap v3138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:13 smithi156 ceph-mon[32679]: pgmap v3138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4729.302989 secs 2024-04-26T19:37:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4032.287391 secs 2024-04-26T19:37:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4729.302989 secs 2024-04-26T19:37:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4032.287391 secs 2024-04-26T19:37:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4729.302989 secs 2024-04-26T19:37:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4032.287391 secs 2024-04-26T19:37:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:15 smithi189 ceph-mon[32756]: pgmap v3139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:15 smithi156 ceph-mon[32679]: pgmap v3139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:15 smithi092 ceph-mon[29156]: pgmap v3139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:16 smithi189 ceph-mon[32756]: pgmap v3140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:16 smithi156 ceph-mon[32679]: pgmap v3140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:16 smithi092 ceph-mon[29156]: pgmap v3140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:18 smithi189 ceph-mon[32756]: pgmap v3141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:18 smithi156 ceph-mon[32679]: pgmap v3141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:18 smithi092 ceph-mon[29156]: pgmap v3141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4734.303104 secs 2024-04-26T19:37:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4037.287494 secs 2024-04-26T19:37:19.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4734.303104 secs 2024-04-26T19:37:19.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4037.287494 secs 2024-04-26T19:37:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4734.303104 secs 2024-04-26T19:37:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4037.287494 secs 2024-04-26T19:37:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:20 smithi189 ceph-mon[32756]: pgmap v3142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:20 smithi156 ceph-mon[32679]: pgmap v3142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:20 smithi092 ceph-mon[29156]: pgmap v3142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:22 smithi189 ceph-mon[32756]: pgmap v3143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:22 smithi156 ceph-mon[32679]: pgmap v3143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:22 smithi092 ceph-mon[29156]: pgmap v3143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4739.303221 secs 2024-04-26T19:37:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4042.287615 secs 2024-04-26T19:37:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:24 smithi189 ceph-mon[32756]: pgmap v3144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4739.303221 secs 2024-04-26T19:37:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4042.287615 secs 2024-04-26T19:37:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:24 smithi156 ceph-mon[32679]: pgmap v3144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4739.303221 secs 2024-04-26T19:37:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4042.287615 secs 2024-04-26T19:37:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:24 smithi092 ceph-mon[29156]: pgmap v3144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:26 smithi189 ceph-mon[32756]: pgmap v3145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:26 smithi156 ceph-mon[32679]: pgmap v3145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:26 smithi092 ceph-mon[29156]: pgmap v3145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:28 smithi189 ceph-mon[32756]: pgmap v3146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:28 smithi156 ceph-mon[32679]: pgmap v3146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:28 smithi092 ceph-mon[29156]: pgmap v3146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:29.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4744.303336 secs 2024-04-26T19:37:29.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4047.287674 secs 2024-04-26T19:37:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4744.303336 secs 2024-04-26T19:37:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4047.287674 secs 2024-04-26T19:37:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4744.303336 secs 2024-04-26T19:37:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4047.287674 secs 2024-04-26T19:37:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:30 smithi189 ceph-mon[32756]: pgmap v3147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:30 smithi156 ceph-mon[32679]: pgmap v3147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:30 smithi092 ceph-mon[29156]: pgmap v3147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:32 smithi189 ceph-mon[32756]: pgmap v3148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:32 smithi156 ceph-mon[32679]: pgmap v3148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:32 smithi092 ceph-mon[29156]: pgmap v3148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4749.303452 secs 2024-04-26T19:37:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4052.287781 secs 2024-04-26T19:37:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:34 smithi189 ceph-mon[32756]: pgmap v3149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4749.303452 secs 2024-04-26T19:37:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4052.287781 secs 2024-04-26T19:37:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:34 smithi156 ceph-mon[32679]: pgmap v3149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4749.303452 secs 2024-04-26T19:37:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4052.287781 secs 2024-04-26T19:37:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:34 smithi092 ceph-mon[29156]: pgmap v3149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:36 smithi189 ceph-mon[32756]: pgmap v3150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:36 smithi156 ceph-mon[32679]: pgmap v3150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:36 smithi092 ceph-mon[29156]: pgmap v3150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:38 smithi189 ceph-mon[32756]: pgmap v3151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:38 smithi156 ceph-mon[32679]: pgmap v3151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:38 smithi092 ceph-mon[29156]: pgmap v3151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4754.303582 secs 2024-04-26T19:37:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4057.287860 secs 2024-04-26T19:37:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4754.303582 secs 2024-04-26T19:37:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4057.287860 secs 2024-04-26T19:37:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4754.303582 secs 2024-04-26T19:37:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4057.287860 secs 2024-04-26T19:37:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:40 smithi189 ceph-mon[32756]: pgmap v3152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:40 smithi156 ceph-mon[32679]: pgmap v3152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:40 smithi092 ceph-mon[29156]: pgmap v3152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:42 smithi189 ceph-mon[32756]: pgmap v3153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:42 smithi156 ceph-mon[32679]: pgmap v3153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:42 smithi092 ceph-mon[29156]: pgmap v3153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4759.303699 secs 2024-04-26T19:37:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4062.287977 secs 2024-04-26T19:37:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:44 smithi189 ceph-mon[32756]: pgmap v3154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4759.303699 secs 2024-04-26T19:37:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4062.287977 secs 2024-04-26T19:37:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:44 smithi156 ceph-mon[32679]: pgmap v3154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4759.303699 secs 2024-04-26T19:37:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4062.287977 secs 2024-04-26T19:37:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:44 smithi092 ceph-mon[29156]: pgmap v3154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:46 smithi189 ceph-mon[32756]: pgmap v3155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:46 smithi156 ceph-mon[32679]: pgmap v3155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:46 smithi092 ceph-mon[29156]: pgmap v3155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:48 smithi189 ceph-mon[32756]: pgmap v3156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:48 smithi156 ceph-mon[32679]: pgmap v3156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:48 smithi092 ceph-mon[29156]: pgmap v3156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:37:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4764.303767 secs 2024-04-26T19:37:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4067.288078 secs 2024-04-26T19:37:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4764.303767 secs 2024-04-26T19:37:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4067.288078 secs 2024-04-26T19:37:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4764.303767 secs 2024-04-26T19:37:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4067.288078 secs 2024-04-26T19:37:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:50 smithi189 ceph-mon[32756]: pgmap v3157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:37:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:50 smithi156 ceph-mon[32679]: pgmap v3157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:37:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:50 smithi092 ceph-mon[29156]: pgmap v3157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:37:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:37:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:37:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:37:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:37:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:51 smithi189 ceph-mon[32756]: pgmap v3158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:37:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:51 smithi189 ceph-mon[32756]: pgmap v3159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:51 smithi156 ceph-mon[32679]: pgmap v3158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:37:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:51 smithi156 ceph-mon[32679]: pgmap v3159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:51 smithi092 ceph-mon[29156]: pgmap v3158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:37:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:51 smithi092 ceph-mon[29156]: pgmap v3159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:53 smithi189 ceph-mon[32756]: pgmap v3160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:37:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:53 smithi156 ceph-mon[32679]: pgmap v3160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:37:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:53 smithi092 ceph-mon[29156]: pgmap v3160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:37:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4769.303877 secs 2024-04-26T19:37:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4072.288222 secs 2024-04-26T19:37:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4769.303877 secs 2024-04-26T19:37:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4072.288222 secs 2024-04-26T19:37:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4769.303877 secs 2024-04-26T19:37:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4072.288222 secs 2024-04-26T19:37:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:55 smithi189 ceph-mon[32756]: pgmap v3161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:55 smithi156 ceph-mon[32679]: pgmap v3161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:55 smithi092 ceph-mon[29156]: pgmap v3161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:57 smithi189 ceph-mon[32756]: pgmap v3162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:57 smithi156 ceph-mon[32679]: pgmap v3162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:57 smithi092 ceph-mon[29156]: pgmap v3162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:37:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4774.304017 secs 2024-04-26T19:37:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:59 smithi156 ceph-mon[32679]: pgmap v3163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:37:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:37:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4077.288344 secs 2024-04-26T19:37:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4774.304017 secs 2024-04-26T19:37:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:59 smithi092 ceph-mon[29156]: pgmap v3163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:37:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:37:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4077.288344 secs 2024-04-26T19:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4774.304017 secs 2024-04-26T19:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:59 smithi189 ceph-mon[32756]: pgmap v3163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:37:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4077.288344 secs 2024-04-26T19:38:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:01 smithi156 ceph-mon[32679]: pgmap v3164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:38:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:01 smithi092 ceph-mon[29156]: pgmap v3164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:38:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:01 smithi189 ceph-mon[32756]: pgmap v3164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:38:02.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:38:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:38:02.254+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:38:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:38:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:38:02.254+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:38:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:38:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:38:02.254+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:38:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:38:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:38:02.254+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:38:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:38:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:38:02.254+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:38:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:03 smithi156 ceph-mon[32679]: pgmap v3165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:03 smithi092 ceph-mon[29156]: pgmap v3165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:03 smithi189 ceph-mon[32756]: pgmap v3165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4779.304149 secs 2024-04-26T19:38:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4082.288458 secs 2024-04-26T19:38:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4779.304149 secs 2024-04-26T19:38:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4082.288458 secs 2024-04-26T19:38:05.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4779.304149 secs 2024-04-26T19:38:05.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4082.288458 secs 2024-04-26T19:38:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:05 smithi156 ceph-mon[32679]: pgmap v3166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:05 smithi092 ceph-mon[29156]: pgmap v3166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:05 smithi189 ceph-mon[32756]: pgmap v3166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:07 smithi189 ceph-mon[32756]: pgmap v3167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:07 smithi156 ceph-mon[32679]: pgmap v3167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:07 smithi092 ceph-mon[29156]: pgmap v3167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4784.304233 secs 2024-04-26T19:38:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:09 smithi189 ceph-mon[32756]: pgmap v3168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4087.288574 secs 2024-04-26T19:38:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4784.304233 secs 2024-04-26T19:38:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:09 smithi156 ceph-mon[32679]: pgmap v3168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4087.288574 secs 2024-04-26T19:38:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4784.304233 secs 2024-04-26T19:38:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:09 smithi092 ceph-mon[29156]: pgmap v3168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4087.288574 secs 2024-04-26T19:38:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:11 smithi189 ceph-mon[32756]: pgmap v3169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:11 smithi156 ceph-mon[32679]: pgmap v3169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:11 smithi092 ceph-mon[29156]: pgmap v3169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:13 smithi189 ceph-mon[32756]: pgmap v3170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:13 smithi156 ceph-mon[32679]: pgmap v3170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:13 smithi092 ceph-mon[29156]: pgmap v3170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T19:38:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4789.304380 secs 2024-04-26T19:38:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4092.288693 secs 2024-04-26T19:38:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4789.304380 secs 2024-04-26T19:38:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4092.288693 secs 2024-04-26T19:38:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4789.304380 secs 2024-04-26T19:38:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4092.288693 secs 2024-04-26T19:38:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:15 smithi189 ceph-mon[32756]: pgmap v3171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:15 smithi156 ceph-mon[32679]: pgmap v3171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:15 smithi092 ceph-mon[29156]: pgmap v3171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T19:38:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:17 smithi189 ceph-mon[32756]: pgmap v3172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:17 smithi156 ceph-mon[32679]: pgmap v3172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:17 smithi092 ceph-mon[29156]: pgmap v3172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4794.304441 secs 2024-04-26T19:38:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:19 smithi189 ceph-mon[32756]: pgmap v3173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4097.288795 secs 2024-04-26T19:38:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4794.304441 secs 2024-04-26T19:38:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:19 smithi156 ceph-mon[32679]: pgmap v3173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4097.288795 secs 2024-04-26T19:38:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4794.304441 secs 2024-04-26T19:38:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:19 smithi092 ceph-mon[29156]: pgmap v3173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4097.288795 secs 2024-04-26T19:38:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:21 smithi189 ceph-mon[32756]: pgmap v3174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:21 smithi156 ceph-mon[32679]: pgmap v3174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:21 smithi092 ceph-mon[29156]: pgmap v3174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:23 smithi189 ceph-mon[32756]: pgmap v3175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:23 smithi156 ceph-mon[32679]: pgmap v3175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:23 smithi092 ceph-mon[29156]: pgmap v3175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4799.304557 secs 2024-04-26T19:38:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4102.288934 secs 2024-04-26T19:38:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4799.304557 secs 2024-04-26T19:38:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4102.288934 secs 2024-04-26T19:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4799.304557 secs 2024-04-26T19:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4102.288934 secs 2024-04-26T19:38:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:25 smithi156 ceph-mon[32679]: pgmap v3176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:25 smithi092 ceph-mon[29156]: pgmap v3176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:25 smithi189 ceph-mon[32756]: pgmap v3176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:27 smithi156 ceph-mon[32679]: pgmap v3177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:27 smithi092 ceph-mon[29156]: pgmap v3177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:27 smithi189 ceph-mon[32756]: pgmap v3177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4804.304676 secs 2024-04-26T19:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:29 smithi156 ceph-mon[32679]: pgmap v3178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4107.289027 secs 2024-04-26T19:38:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4804.304676 secs 2024-04-26T19:38:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:29 smithi092 ceph-mon[29156]: pgmap v3178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4107.289027 secs 2024-04-26T19:38:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4804.304676 secs 2024-04-26T19:38:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:29 smithi189 ceph-mon[32756]: pgmap v3178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4107.289027 secs 2024-04-26T19:38:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:31 smithi156 ceph-mon[32679]: pgmap v3179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:31 smithi092 ceph-mon[29156]: pgmap v3179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:31 smithi189 ceph-mon[32756]: pgmap v3179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:33 smithi156 ceph-mon[32679]: pgmap v3180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:33 smithi092 ceph-mon[29156]: pgmap v3180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:33 smithi189 ceph-mon[32756]: pgmap v3180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4809.304800 secs 2024-04-26T19:38:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4112.289152 secs 2024-04-26T19:38:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4809.304800 secs 2024-04-26T19:38:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4112.289152 secs 2024-04-26T19:38:35.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4809.304800 secs 2024-04-26T19:38:35.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4112.289152 secs 2024-04-26T19:38:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:35 smithi156 ceph-mon[32679]: pgmap v3181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:35 smithi092 ceph-mon[29156]: pgmap v3181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:35 smithi189 ceph-mon[32756]: pgmap v3181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:38.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:37 smithi092 ceph-mon[29156]: pgmap v3182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:37 smithi156 ceph-mon[32679]: pgmap v3182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:37 smithi189 ceph-mon[32756]: pgmap v3182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4814.304914 secs 2024-04-26T19:38:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:39 smithi156 ceph-mon[32679]: pgmap v3183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4117.289303 secs 2024-04-26T19:38:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4814.304914 secs 2024-04-26T19:38:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:39 smithi092 ceph-mon[29156]: pgmap v3183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4117.289303 secs 2024-04-26T19:38:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4814.304914 secs 2024-04-26T19:38:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:39 smithi189 ceph-mon[32756]: pgmap v3183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4117.289303 secs 2024-04-26T19:38:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:41 smithi156 ceph-mon[32679]: pgmap v3184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:41 smithi092 ceph-mon[29156]: pgmap v3184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:41 smithi189 ceph-mon[32756]: pgmap v3184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:43 smithi156 ceph-mon[32679]: pgmap v3185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:43 smithi092 ceph-mon[29156]: pgmap v3185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:43 smithi189 ceph-mon[32756]: pgmap v3185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4819.304979 secs 2024-04-26T19:38:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4122.289376 secs 2024-04-26T19:38:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4819.304979 secs 2024-04-26T19:38:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4122.289376 secs 2024-04-26T19:38:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4819.304979 secs 2024-04-26T19:38:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4122.289376 secs 2024-04-26T19:38:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:45 smithi156 ceph-mon[32679]: pgmap v3186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:45 smithi092 ceph-mon[29156]: pgmap v3186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:45 smithi189 ceph-mon[32756]: pgmap v3186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:47 smithi092 ceph-mon[29156]: pgmap v3187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:47 smithi189 ceph-mon[32756]: pgmap v3187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:47 smithi156 ceph-mon[32679]: pgmap v3187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4824.305118 secs 2024-04-26T19:38:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:49 smithi092 ceph-mon[29156]: pgmap v3188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4127.289517 secs 2024-04-26T19:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4824.305118 secs 2024-04-26T19:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:49 smithi189 ceph-mon[32756]: pgmap v3188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4127.289517 secs 2024-04-26T19:38:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4824.305118 secs 2024-04-26T19:38:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:49 smithi156 ceph-mon[32679]: pgmap v3188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:38:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4127.289517 secs 2024-04-26T19:38:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: pgmap v3189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: pgmap v3190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: pgmap v3191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:38:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: pgmap v3189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: pgmap v3190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: pgmap v3191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:38:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: pgmap v3189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:38:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:38:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:38:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: pgmap v3190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:38:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: pgmap v3191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:38:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:54 smithi189 ceph-mon[32756]: pgmap v3192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:38:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4829.305216 secs 2024-04-26T19:38:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4132.289600 secs 2024-04-26T19:38:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:54 smithi156 ceph-mon[32679]: pgmap v3192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:38:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4829.305216 secs 2024-04-26T19:38:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4132.289600 secs 2024-04-26T19:38:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:54 smithi092 ceph-mon[29156]: pgmap v3192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:38:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4829.305216 secs 2024-04-26T19:38:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4132.289600 secs 2024-04-26T19:38:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:56 smithi189 ceph-mon[32756]: pgmap v3193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:56 smithi156 ceph-mon[32679]: pgmap v3193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:56 smithi092 ceph-mon[29156]: pgmap v3193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:58 smithi189 ceph-mon[32756]: pgmap v3194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:58 smithi156 ceph-mon[32679]: pgmap v3194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:58 smithi092 ceph-mon[29156]: pgmap v3194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:38:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4834.305355 secs 2024-04-26T19:38:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:38:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4137.289728 secs 2024-04-26T19:38:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4834.305355 secs 2024-04-26T19:38:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:38:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4137.289728 secs 2024-04-26T19:38:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4834.305355 secs 2024-04-26T19:38:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:38:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4137.289728 secs 2024-04-26T19:39:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:00 smithi156 ceph-mon[32679]: pgmap v3195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:00 smithi092 ceph-mon[29156]: pgmap v3195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:00 smithi189 ceph-mon[32756]: pgmap v3195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:02 smithi156 ceph-mon[32679]: pgmap v3196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:39:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:02 smithi092 ceph-mon[29156]: pgmap v3196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:39:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:02 smithi189 ceph-mon[32756]: pgmap v3196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:39:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:04 smithi156 ceph-mon[32679]: pgmap v3197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4839.305490 secs 2024-04-26T19:39:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 4142.289834 secs 2024-04-26T19:39:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:04 smithi156 ceph-mon[32679]: slow request 2881.943571 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:39:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:04 smithi092 ceph-mon[29156]: pgmap v3197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4839.305490 secs 2024-04-26T19:39:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 4142.289834 secs 2024-04-26T19:39:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:04 smithi092 ceph-mon[29156]: slow request 2881.943571 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:39:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:04 smithi189 ceph-mon[32756]: pgmap v3197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4839.305490 secs 2024-04-26T19:39:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 4142.289834 secs 2024-04-26T19:39:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:04 smithi189 ceph-mon[32756]: slow request 2881.943571 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:39:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:06 smithi156 ceph-mon[32679]: pgmap v3198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:06.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:06 smithi189 ceph-mon[32756]: pgmap v3198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:06 smithi092 ceph-mon[29156]: pgmap v3198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:08 smithi156 ceph-mon[32679]: pgmap v3199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:08 smithi092 ceph-mon[29156]: pgmap v3199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:08 smithi189 ceph-mon[32756]: pgmap v3199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4844.305584 secs 2024-04-26T19:39:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4147.289953 secs 2024-04-26T19:39:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4844.305584 secs 2024-04-26T19:39:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4147.289953 secs 2024-04-26T19:39:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4844.305584 secs 2024-04-26T19:39:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4147.289953 secs 2024-04-26T19:39:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:10 smithi156 ceph-mon[32679]: pgmap v3200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:10 smithi092 ceph-mon[29156]: pgmap v3200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:10 smithi189 ceph-mon[32756]: pgmap v3200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:12 smithi156 ceph-mon[32679]: pgmap v3201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:12 smithi092 ceph-mon[29156]: pgmap v3201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:12 smithi189 ceph-mon[32756]: pgmap v3201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:14 smithi156 ceph-mon[32679]: pgmap v3202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4849.305688 secs 2024-04-26T19:39:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4152.290084 secs 2024-04-26T19:39:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:14 smithi092 ceph-mon[29156]: pgmap v3202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4849.305688 secs 2024-04-26T19:39:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4152.290084 secs 2024-04-26T19:39:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:14 smithi189 ceph-mon[32756]: pgmap v3202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T19:39:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4849.305688 secs 2024-04-26T19:39:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4152.290084 secs 2024-04-26T19:39:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:16 smithi156 ceph-mon[32679]: pgmap v3203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:16 smithi092 ceph-mon[29156]: pgmap v3203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:16 smithi189 ceph-mon[32756]: pgmap v3203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:39:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:18 smithi156 ceph-mon[32679]: pgmap v3204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:18 smithi092 ceph-mon[29156]: pgmap v3204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:18 smithi189 ceph-mon[32756]: pgmap v3204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4854.305812 secs 2024-04-26T19:39:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4157.290201 secs 2024-04-26T19:39:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4854.305812 secs 2024-04-26T19:39:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4157.290201 secs 2024-04-26T19:39:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4854.305812 secs 2024-04-26T19:39:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4157.290201 secs 2024-04-26T19:39:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:20 smithi092 ceph-mon[29156]: pgmap v3205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:20 smithi189 ceph-mon[32756]: pgmap v3205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:20 smithi156 ceph-mon[32679]: pgmap v3205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:22 smithi092 ceph-mon[29156]: pgmap v3206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:22 smithi189 ceph-mon[32756]: pgmap v3206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:22 smithi156 ceph-mon[32679]: pgmap v3206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:24 smithi092 ceph-mon[29156]: pgmap v3207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4859.305950 secs 2024-04-26T19:39:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4162.290345 secs 2024-04-26T19:39:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:24 smithi189 ceph-mon[32756]: pgmap v3207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4859.305950 secs 2024-04-26T19:39:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4162.290345 secs 2024-04-26T19:39:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:24 smithi156 ceph-mon[32679]: pgmap v3207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4859.305950 secs 2024-04-26T19:39:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4162.290345 secs 2024-04-26T19:39:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:26 smithi092 ceph-mon[29156]: pgmap v3208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:26 smithi189 ceph-mon[32756]: pgmap v3208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:26 smithi156 ceph-mon[32679]: pgmap v3208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:28 smithi092 ceph-mon[29156]: pgmap v3209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:28 smithi189 ceph-mon[32756]: pgmap v3209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:28 smithi156 ceph-mon[32679]: pgmap v3209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4864.306058 secs 2024-04-26T19:39:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4167.290461 secs 2024-04-26T19:39:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4864.306058 secs 2024-04-26T19:39:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4167.290461 secs 2024-04-26T19:39:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4864.306058 secs 2024-04-26T19:39:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4167.290461 secs 2024-04-26T19:39:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:30 smithi092 ceph-mon[29156]: pgmap v3210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:30 smithi189 ceph-mon[32756]: pgmap v3210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:30 smithi156 ceph-mon[32679]: pgmap v3210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:32 smithi092 ceph-mon[29156]: pgmap v3211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:32 smithi189 ceph-mon[32756]: pgmap v3211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:32 smithi156 ceph-mon[32679]: pgmap v3211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:34 smithi092 ceph-mon[29156]: pgmap v3212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4869.306202 secs 2024-04-26T19:39:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4172.290587 secs 2024-04-26T19:39:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:34 smithi189 ceph-mon[32756]: pgmap v3212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4869.306202 secs 2024-04-26T19:39:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4172.290587 secs 2024-04-26T19:39:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:34 smithi156 ceph-mon[32679]: pgmap v3212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4869.306202 secs 2024-04-26T19:39:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4172.290587 secs 2024-04-26T19:39:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:36 smithi092 ceph-mon[29156]: pgmap v3213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:36 smithi189 ceph-mon[32756]: pgmap v3213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:39:36.643+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:39:36.643+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:39:36.643+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:39:36.644 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:39:36.643+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 41 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:39:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:36 smithi156 ceph-mon[32679]: pgmap v3213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:38 smithi092 ceph-mon[29156]: pgmap v3214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:38 smithi189 ceph-mon[32756]: pgmap v3214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:38 smithi156 ceph-mon[32679]: pgmap v3214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4874.306264 secs 2024-04-26T19:39:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4177.290716 secs 2024-04-26T19:39:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4874.306264 secs 2024-04-26T19:39:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4177.290716 secs 2024-04-26T19:39:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4874.306264 secs 2024-04-26T19:39:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4177.290716 secs 2024-04-26T19:39:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:40 smithi092 ceph-mon[29156]: pgmap v3215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:40 smithi189 ceph-mon[32756]: pgmap v3215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:40 smithi156 ceph-mon[32679]: pgmap v3215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:42 smithi092 ceph-mon[29156]: pgmap v3216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:42 smithi189 ceph-mon[32756]: pgmap v3216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:42 smithi156 ceph-mon[32679]: pgmap v3216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:44 smithi092 ceph-mon[29156]: pgmap v3217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4879.306387 secs 2024-04-26T19:39:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4182.290778 secs 2024-04-26T19:39:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:44 smithi189 ceph-mon[32756]: pgmap v3217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4879.306387 secs 2024-04-26T19:39:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4182.290778 secs 2024-04-26T19:39:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:44 smithi156 ceph-mon[32679]: pgmap v3217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4879.306387 secs 2024-04-26T19:39:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4182.290778 secs 2024-04-26T19:39:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:46 smithi092 ceph-mon[29156]: pgmap v3218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:46 smithi189 ceph-mon[32756]: pgmap v3218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:46 smithi156 ceph-mon[32679]: pgmap v3218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:48 smithi092 ceph-mon[29156]: pgmap v3219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:48 smithi189 ceph-mon[32756]: pgmap v3219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:48 smithi156 ceph-mon[32679]: pgmap v3219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4884.306483 secs 2024-04-26T19:39:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4187.290918 secs 2024-04-26T19:39:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4884.306483 secs 2024-04-26T19:39:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4187.290918 secs 2024-04-26T19:39:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4884.306483 secs 2024-04-26T19:39:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4187.290918 secs 2024-04-26T19:39:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:50 smithi189 ceph-mon[32756]: pgmap v3220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:50 smithi156 ceph-mon[32679]: pgmap v3220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:50 smithi092 ceph-mon[29156]: pgmap v3220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:39:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:39:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:52 smithi189 ceph-mon[32756]: pgmap v3221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:39:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:52 smithi156 ceph-mon[32679]: pgmap v3221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:39:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:52 smithi092 ceph-mon[29156]: pgmap v3221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:39:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:39:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:39:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:39:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:53 smithi189 ceph-mon[32756]: pgmap v3222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:39:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:53 smithi189 ceph-mon[32756]: pgmap v3223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:53 smithi156 ceph-mon[32679]: pgmap v3222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:39:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:53 smithi156 ceph-mon[32679]: pgmap v3223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:53 smithi092 ceph-mon[29156]: pgmap v3222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:39:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:53 smithi092 ceph-mon[29156]: pgmap v3223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4889.306605 secs 2024-04-26T19:39:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4192.291051 secs 2024-04-26T19:39:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4889.306605 secs 2024-04-26T19:39:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4192.291051 secs 2024-04-26T19:39:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4889.306605 secs 2024-04-26T19:39:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4192.291051 secs 2024-04-26T19:39:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:55 smithi189 ceph-mon[32756]: pgmap v3224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:55 smithi156 ceph-mon[32679]: pgmap v3224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:55 smithi092 ceph-mon[29156]: pgmap v3224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:57 smithi189 ceph-mon[32756]: pgmap v3225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:57 smithi156 ceph-mon[32679]: pgmap v3225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:57 smithi092 ceph-mon[29156]: pgmap v3225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:39:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:59 smithi189 ceph-mon[32756]: pgmap v3226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:39:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4894.306744 secs 2024-04-26T19:39:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:39:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4197.291174 secs 2024-04-26T19:39:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:59 smithi156 ceph-mon[32679]: pgmap v3226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:39:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4894.306744 secs 2024-04-26T19:39:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:39:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4197.291174 secs 2024-04-26T19:39:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:59 smithi092 ceph-mon[29156]: pgmap v3226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:39:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4894.306744 secs 2024-04-26T19:39:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:39:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4197.291174 secs 2024-04-26T19:40:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:40:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:40:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:40:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:01 smithi189 ceph-mon[32756]: pgmap v3227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:01 smithi156 ceph-mon[32679]: pgmap v3227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:01 smithi092 ceph-mon[29156]: pgmap v3227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:03 smithi189 ceph-mon[32756]: pgmap v3228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:40:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:03 smithi156 ceph-mon[32679]: pgmap v3228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:40:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:03 smithi092 ceph-mon[29156]: pgmap v3228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:40:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4899.306845 secs 2024-04-26T19:40:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4202.291341 secs 2024-04-26T19:40:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4899.306845 secs 2024-04-26T19:40:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4202.291341 secs 2024-04-26T19:40:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4899.306845 secs 2024-04-26T19:40:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4202.291341 secs 2024-04-26T19:40:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:05 smithi189 ceph-mon[32756]: pgmap v3229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:05 smithi156 ceph-mon[32679]: pgmap v3229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:05 smithi092 ceph-mon[29156]: pgmap v3229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:07 smithi189 ceph-mon[32756]: pgmap v3230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:07 smithi156 ceph-mon[32679]: pgmap v3230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:07 smithi092 ceph-mon[29156]: pgmap v3230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:09 smithi189 ceph-mon[32756]: pgmap v3231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4904.306898 secs 2024-04-26T19:40:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4207.291442 secs 2024-04-26T19:40:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:09 smithi156 ceph-mon[32679]: pgmap v3231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4904.306898 secs 2024-04-26T19:40:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4207.291442 secs 2024-04-26T19:40:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:09 smithi092 ceph-mon[29156]: pgmap v3231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4904.306898 secs 2024-04-26T19:40:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4207.291442 secs 2024-04-26T19:40:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:11 smithi189 ceph-mon[32756]: pgmap v3232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:11 smithi156 ceph-mon[32679]: pgmap v3232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:11 smithi092 ceph-mon[29156]: pgmap v3232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:12 smithi189 ceph-mon[32756]: pgmap v3233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:12 smithi156 ceph-mon[32679]: pgmap v3233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:12 smithi092 ceph-mon[29156]: pgmap v3233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4909.306995 secs 2024-04-26T19:40:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4212.291553 secs 2024-04-26T19:40:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:14 smithi156 ceph-mon[32679]: pgmap v3234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4909.306995 secs 2024-04-26T19:40:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4212.291553 secs 2024-04-26T19:40:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:14 smithi092 ceph-mon[29156]: pgmap v3234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4909.306995 secs 2024-04-26T19:40:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4212.291553 secs 2024-04-26T19:40:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:14 smithi189 ceph-mon[32756]: pgmap v3234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:16 smithi156 ceph-mon[32679]: pgmap v3235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:16 smithi092 ceph-mon[29156]: pgmap v3235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:16 smithi189 ceph-mon[32756]: pgmap v3235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:18 smithi156 ceph-mon[32679]: pgmap v3236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:18 smithi092 ceph-mon[29156]: pgmap v3236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:18 smithi189 ceph-mon[32756]: pgmap v3236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4914.307124 secs 2024-04-26T19:40:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4217.291634 secs 2024-04-26T19:40:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4914.307124 secs 2024-04-26T19:40:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4217.291634 secs 2024-04-26T19:40:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4914.307124 secs 2024-04-26T19:40:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4217.291634 secs 2024-04-26T19:40:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:20 smithi092 ceph-mon[29156]: pgmap v3237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:20 smithi189 ceph-mon[32756]: pgmap v3237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:20 smithi156 ceph-mon[32679]: pgmap v3237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:22 smithi092 ceph-mon[29156]: pgmap v3238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:22 smithi189 ceph-mon[32756]: pgmap v3238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:22 smithi156 ceph-mon[32679]: pgmap v3238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4919.307248 secs 2024-04-26T19:40:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4222.291711 secs 2024-04-26T19:40:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:24 smithi092 ceph-mon[29156]: pgmap v3239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4919.307248 secs 2024-04-26T19:40:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4222.291711 secs 2024-04-26T19:40:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:24 smithi189 ceph-mon[32756]: pgmap v3239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4919.307248 secs 2024-04-26T19:40:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4222.291711 secs 2024-04-26T19:40:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:24 smithi156 ceph-mon[32679]: pgmap v3239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:26 smithi092 ceph-mon[29156]: pgmap v3240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:26 smithi189 ceph-mon[32756]: pgmap v3240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:26 smithi156 ceph-mon[32679]: pgmap v3240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:29.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:28 smithi156 ceph-mon[32679]: pgmap v3241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:28 smithi092 ceph-mon[29156]: pgmap v3241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:28 smithi189 ceph-mon[32756]: pgmap v3241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4924.307387 secs 2024-04-26T19:40:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4227.291831 secs 2024-04-26T19:40:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4924.307387 secs 2024-04-26T19:40:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4227.291831 secs 2024-04-26T19:40:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4924.307387 secs 2024-04-26T19:40:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4227.291831 secs 2024-04-26T19:40:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:30 smithi092 ceph-mon[29156]: pgmap v3242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:30 smithi189 ceph-mon[32756]: pgmap v3242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:30 smithi156 ceph-mon[32679]: pgmap v3242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:32 smithi092 ceph-mon[29156]: pgmap v3243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:32 smithi189 ceph-mon[32756]: pgmap v3243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:32 smithi156 ceph-mon[32679]: pgmap v3243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4929.307512 secs 2024-04-26T19:40:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4232.291984 secs 2024-04-26T19:40:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:34 smithi092 ceph-mon[29156]: pgmap v3244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4929.307512 secs 2024-04-26T19:40:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4232.291984 secs 2024-04-26T19:40:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:34 smithi189 ceph-mon[32756]: pgmap v3244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4929.307512 secs 2024-04-26T19:40:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4232.291984 secs 2024-04-26T19:40:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:34 smithi156 ceph-mon[32679]: pgmap v3244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:36 smithi092 ceph-mon[29156]: pgmap v3245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:36 smithi189 ceph-mon[32756]: pgmap v3245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:36 smithi156 ceph-mon[32679]: pgmap v3245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:38 smithi092 ceph-mon[29156]: pgmap v3246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:38 smithi189 ceph-mon[32756]: pgmap v3246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:38 smithi156 ceph-mon[32679]: pgmap v3246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4934.307647 secs 2024-04-26T19:40:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4237.292101 secs 2024-04-26T19:40:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4934.307647 secs 2024-04-26T19:40:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4237.292101 secs 2024-04-26T19:40:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4934.307647 secs 2024-04-26T19:40:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4237.292101 secs 2024-04-26T19:40:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:40 smithi092 ceph-mon[29156]: pgmap v3247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:40 smithi189 ceph-mon[32756]: pgmap v3247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:40 smithi156 ceph-mon[32679]: pgmap v3247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:42 smithi092 ceph-mon[29156]: pgmap v3248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:42 smithi189 ceph-mon[32756]: pgmap v3248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:42 smithi156 ceph-mon[32679]: pgmap v3248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4939.307771 secs 2024-04-26T19:40:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4242.292224 secs 2024-04-26T19:40:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:44 smithi092 ceph-mon[29156]: pgmap v3249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4939.307771 secs 2024-04-26T19:40:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4242.292224 secs 2024-04-26T19:40:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:44 smithi189 ceph-mon[32756]: pgmap v3249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4939.307771 secs 2024-04-26T19:40:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4242.292224 secs 2024-04-26T19:40:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:44 smithi156 ceph-mon[32679]: pgmap v3249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:46 smithi092 ceph-mon[29156]: pgmap v3250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:46 smithi189 ceph-mon[32756]: pgmap v3250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:46 smithi156 ceph-mon[32679]: pgmap v3250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:48 smithi092 ceph-mon[29156]: pgmap v3251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:48 smithi189 ceph-mon[32756]: pgmap v3251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:48 smithi156 ceph-mon[32679]: pgmap v3251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4944.307899 secs 2024-04-26T19:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4247.292344 secs 2024-04-26T19:40:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4944.307899 secs 2024-04-26T19:40:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4247.292344 secs 2024-04-26T19:40:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4944.307899 secs 2024-04-26T19:40:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4247.292344 secs 2024-04-26T19:40:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:50 smithi092 ceph-mon[29156]: pgmap v3252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:50 smithi189 ceph-mon[32756]: pgmap v3252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:50 smithi156 ceph-mon[32679]: pgmap v3252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:40:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:40:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:53 smithi189 ceph-mon[32756]: pgmap v3253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:40:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:53 smithi156 ceph-mon[32679]: pgmap v3253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:40:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:53 smithi092 ceph-mon[29156]: pgmap v3253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:40:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:40:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:40:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:40:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:54 smithi189 ceph-mon[32756]: pgmap v3254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:40:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:54 smithi189 ceph-mon[32756]: pgmap v3255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:40:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4949.308050 secs 2024-04-26T19:40:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:54 smithi156 ceph-mon[32679]: pgmap v3254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:40:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:54 smithi156 ceph-mon[32679]: pgmap v3255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:40:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4949.308050 secs 2024-04-26T19:40:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:54 smithi092 ceph-mon[29156]: pgmap v3254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:40:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:54 smithi092 ceph-mon[29156]: pgmap v3255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:40:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4949.308050 secs 2024-04-26T19:40:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:55 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4252.292438 secs 2024-04-26T19:40:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:55 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4252.292438 secs 2024-04-26T19:40:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:55 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4252.292438 secs 2024-04-26T19:40:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:56 smithi189 ceph-mon[32756]: pgmap v3256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:56 smithi156 ceph-mon[32679]: pgmap v3256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:56 smithi092 ceph-mon[29156]: pgmap v3256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:58 smithi189 ceph-mon[32756]: pgmap v3257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:58 smithi156 ceph-mon[32679]: pgmap v3257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:58 smithi092 ceph-mon[29156]: pgmap v3257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:40:59.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:40:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4954.308172 secs 2024-04-26T19:40:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:40:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4954.308172 secs 2024-04-26T19:40:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:40:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4954.308172 secs 2024-04-26T19:41:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:00 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4257.292499 secs 2024-04-26T19:41:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:00 smithi189 ceph-mon[32756]: pgmap v3258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:00 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4257.292499 secs 2024-04-26T19:41:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:00 smithi156 ceph-mon[32679]: pgmap v3258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:00 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4257.292499 secs 2024-04-26T19:41:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:00 smithi092 ceph-mon[29156]: pgmap v3258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:02 smithi189 ceph-mon[32756]: pgmap v3259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:02 smithi156 ceph-mon[32679]: pgmap v3259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:02 smithi092 ceph-mon[29156]: pgmap v3259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:41:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:04 smithi189 ceph-mon[32756]: pgmap v3260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4959.308261 secs 2024-04-26T19:41:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:04 smithi156 ceph-mon[32679]: pgmap v3260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4959.308261 secs 2024-04-26T19:41:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:04 smithi092 ceph-mon[29156]: pgmap v3260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4959.308261 secs 2024-04-26T19:41:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:05 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 4262.292617 secs 2024-04-26T19:41:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:05 smithi189 ceph-mon[32756]: slow request 1441.503094 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:41:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:05 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 4262.292617 secs 2024-04-26T19:41:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:05 smithi156 ceph-mon[32679]: slow request 1441.503094 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:41:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:05 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 4262.292617 secs 2024-04-26T19:41:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:05 smithi092 ceph-mon[29156]: slow request 1441.503094 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:41:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:06 smithi189 ceph-mon[32756]: pgmap v3261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:06 smithi156 ceph-mon[32679]: pgmap v3261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:06 smithi092 ceph-mon[29156]: pgmap v3261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:41:06.656+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:41:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:41:06.656+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:41:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:41:06.657+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:41:06.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:41:06.657+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 42 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:41:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:08 smithi189 ceph-mon[32756]: pgmap v3262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:08 smithi156 ceph-mon[32679]: pgmap v3262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:08 smithi092 ceph-mon[29156]: pgmap v3262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4964.308369 secs 2024-04-26T19:41:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4964.308369 secs 2024-04-26T19:41:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4964.308369 secs 2024-04-26T19:41:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4267.292747 secs 2024-04-26T19:41:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:10 smithi189 ceph-mon[32756]: pgmap v3263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4267.292747 secs 2024-04-26T19:41:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:10 smithi156 ceph-mon[32679]: pgmap v3263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4267.292747 secs 2024-04-26T19:41:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:10 smithi092 ceph-mon[29156]: pgmap v3263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:12 smithi189 ceph-mon[32756]: pgmap v3264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:12 smithi156 ceph-mon[32679]: pgmap v3264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:12 smithi092 ceph-mon[29156]: pgmap v3264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:14 smithi092 ceph-mon[29156]: pgmap v3265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4969.308487 secs 2024-04-26T19:41:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4272.292873 secs 2024-04-26T19:41:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:14 smithi189 ceph-mon[32756]: pgmap v3265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4969.308487 secs 2024-04-26T19:41:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4272.292873 secs 2024-04-26T19:41:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:14 smithi156 ceph-mon[32679]: pgmap v3265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4969.308487 secs 2024-04-26T19:41:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4272.292873 secs 2024-04-26T19:41:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:16 smithi189 ceph-mon[32756]: pgmap v3266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:16 smithi156 ceph-mon[32679]: pgmap v3266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:16 smithi092 ceph-mon[29156]: pgmap v3266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:18 smithi189 ceph-mon[32756]: pgmap v3267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:18 smithi156 ceph-mon[32679]: pgmap v3267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:18 smithi092 ceph-mon[29156]: pgmap v3267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4974.308613 secs 2024-04-26T19:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4277.293028 secs 2024-04-26T19:41:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4974.308613 secs 2024-04-26T19:41:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4277.293028 secs 2024-04-26T19:41:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4974.308613 secs 2024-04-26T19:41:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4277.293028 secs 2024-04-26T19:41:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:20 smithi189 ceph-mon[32756]: pgmap v3268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:20 smithi156 ceph-mon[32679]: pgmap v3268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:20 smithi092 ceph-mon[29156]: pgmap v3268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:22 smithi189 ceph-mon[32756]: pgmap v3269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:22 smithi156 ceph-mon[32679]: pgmap v3269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:22 smithi092 ceph-mon[29156]: pgmap v3269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:24 smithi189 ceph-mon[32756]: pgmap v3270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4979.308705 secs 2024-04-26T19:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4282.293165 secs 2024-04-26T19:41:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:24 smithi156 ceph-mon[32679]: pgmap v3270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4979.308705 secs 2024-04-26T19:41:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4282.293165 secs 2024-04-26T19:41:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:24 smithi092 ceph-mon[29156]: pgmap v3270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4979.308705 secs 2024-04-26T19:41:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4282.293165 secs 2024-04-26T19:41:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:26 smithi189 ceph-mon[32756]: pgmap v3271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:26 smithi156 ceph-mon[32679]: pgmap v3271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:26 smithi092 ceph-mon[29156]: pgmap v3271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:28 smithi189 ceph-mon[32756]: pgmap v3272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:28 smithi156 ceph-mon[32679]: pgmap v3272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:28 smithi092 ceph-mon[29156]: pgmap v3272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4984.308849 secs 2024-04-26T19:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4287.293350 secs 2024-04-26T19:41:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4984.308849 secs 2024-04-26T19:41:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4287.293350 secs 2024-04-26T19:41:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4984.308849 secs 2024-04-26T19:41:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4287.293350 secs 2024-04-26T19:41:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:30 smithi189 ceph-mon[32756]: pgmap v3273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:30 smithi156 ceph-mon[32679]: pgmap v3273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:30 smithi092 ceph-mon[29156]: pgmap v3273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:32 smithi189 ceph-mon[32756]: pgmap v3274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:32 smithi156 ceph-mon[32679]: pgmap v3274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:32 smithi092 ceph-mon[29156]: pgmap v3274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:34 smithi189 ceph-mon[32756]: pgmap v3275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4989.308959 secs 2024-04-26T19:41:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4292.293496 secs 2024-04-26T19:41:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:34 smithi156 ceph-mon[32679]: pgmap v3275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4989.308959 secs 2024-04-26T19:41:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4292.293496 secs 2024-04-26T19:41:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:34 smithi092 ceph-mon[29156]: pgmap v3275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4989.308959 secs 2024-04-26T19:41:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4292.293496 secs 2024-04-26T19:41:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:36 smithi189 ceph-mon[32756]: pgmap v3276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:36 smithi156 ceph-mon[32679]: pgmap v3276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:36 smithi092 ceph-mon[29156]: pgmap v3276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:38 smithi189 ceph-mon[32756]: pgmap v3277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:38 smithi156 ceph-mon[32679]: pgmap v3277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:38 smithi092 ceph-mon[29156]: pgmap v3277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4994.309020 secs 2024-04-26T19:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4297.293634 secs 2024-04-26T19:41:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4994.309020 secs 2024-04-26T19:41:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4297.293634 secs 2024-04-26T19:41:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4994.309020 secs 2024-04-26T19:41:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4297.293634 secs 2024-04-26T19:41:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:40 smithi189 ceph-mon[32756]: pgmap v3278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:40 smithi156 ceph-mon[32679]: pgmap v3278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:40 smithi092 ceph-mon[29156]: pgmap v3278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:42 smithi189 ceph-mon[32756]: pgmap v3279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:42 smithi156 ceph-mon[32679]: pgmap v3279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:42 smithi092 ceph-mon[29156]: pgmap v3279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:44 smithi189 ceph-mon[32756]: pgmap v3280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 4999.309124 secs 2024-04-26T19:41:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4302.293764 secs 2024-04-26T19:41:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:44 smithi156 ceph-mon[32679]: pgmap v3280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 4999.309124 secs 2024-04-26T19:41:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4302.293764 secs 2024-04-26T19:41:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:44 smithi092 ceph-mon[29156]: pgmap v3280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 4999.309124 secs 2024-04-26T19:41:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4302.293764 secs 2024-04-26T19:41:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:46 smithi189 ceph-mon[32756]: pgmap v3281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:46 smithi156 ceph-mon[32679]: pgmap v3281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:46 smithi092 ceph-mon[29156]: pgmap v3281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:48 smithi189 ceph-mon[32756]: pgmap v3282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:48 smithi156 ceph-mon[32679]: pgmap v3282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:48 smithi092 ceph-mon[29156]: pgmap v3282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5004.309239 secs 2024-04-26T19:41:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4307.293897 secs 2024-04-26T19:41:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5004.309239 secs 2024-04-26T19:41:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4307.293897 secs 2024-04-26T19:41:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5004.309239 secs 2024-04-26T19:41:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4307.293897 secs 2024-04-26T19:41:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:50 smithi189 ceph-mon[32756]: pgmap v3283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:50 smithi156 ceph-mon[32679]: pgmap v3283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:50 smithi092 ceph-mon[29156]: pgmap v3283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:41:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:52 smithi156 ceph-mon[32679]: pgmap v3284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:52 smithi092 ceph-mon[29156]: pgmap v3284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:52 smithi189 ceph-mon[32756]: pgmap v3284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:41:54.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: pgmap v3285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:54.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5009.309321 secs 2024-04-26T19:41:54.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.290 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.291 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4312.294001 secs 2024-04-26T19:41:54.346 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: pgmap v3285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5009.309321 secs 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.347 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4312.294001 secs 2024-04-26T19:41:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: pgmap v3285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:41:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5009.309321 secs 2024-04-26T19:41:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4312.294001 secs 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: pgmap v3286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: pgmap v3286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: pgmap v3286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: pgmap v3287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: pgmap v3288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: pgmap v3287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:41:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: pgmap v3288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: pgmap v3287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: pgmap v3288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:41:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:41:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:58 smithi189 ceph-mon[32756]: pgmap v3289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 955 B/s rd, 1 op/s 2024-04-26T19:41:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:58 smithi156 ceph-mon[32679]: pgmap v3289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 955 B/s rd, 1 op/s 2024-04-26T19:41:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:58 smithi092 ceph-mon[29156]: pgmap v3289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 955 B/s rd, 1 op/s 2024-04-26T19:41:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5014.309458 secs 2024-04-26T19:41:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:41:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4317.294122 secs 2024-04-26T19:41:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5014.309458 secs 2024-04-26T19:41:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:41:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4317.294122 secs 2024-04-26T19:41:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5014.309458 secs 2024-04-26T19:41:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:41:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4317.294122 secs 2024-04-26T19:42:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:00 smithi189 ceph-mon[32756]: pgmap v3290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:00 smithi156 ceph-mon[32679]: pgmap v3290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:00 smithi092 ceph-mon[29156]: pgmap v3290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:02 smithi189 ceph-mon[32756]: pgmap v3291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:02 smithi156 ceph-mon[32679]: pgmap v3291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:02 smithi092 ceph-mon[29156]: pgmap v3291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5019.309522 secs 2024-04-26T19:42:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5019.309522 secs 2024-04-26T19:42:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5019.309522 secs 2024-04-26T19:42:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:05 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4322.294241 secs 2024-04-26T19:42:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:05 smithi189 ceph-mon[32756]: pgmap v3292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:42:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:05 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4322.294241 secs 2024-04-26T19:42:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:05 smithi156 ceph-mon[32679]: pgmap v3292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:42:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:05 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4322.294241 secs 2024-04-26T19:42:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:05 smithi092 ceph-mon[29156]: pgmap v3292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:42:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:06 smithi189 ceph-mon[32756]: pgmap v3293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:06 smithi156 ceph-mon[32679]: pgmap v3293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:06 smithi092 ceph-mon[29156]: pgmap v3293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:42:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:08 smithi189 ceph-mon[32756]: pgmap v3294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:08 smithi156 ceph-mon[32679]: pgmap v3294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:08 smithi092 ceph-mon[29156]: pgmap v3294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5024.309665 secs 2024-04-26T19:42:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4327.294345 secs 2024-04-26T19:42:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5024.309665 secs 2024-04-26T19:42:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4327.294345 secs 2024-04-26T19:42:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5024.309665 secs 2024-04-26T19:42:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4327.294345 secs 2024-04-26T19:42:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:10 smithi189 ceph-mon[32756]: pgmap v3295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:10 smithi156 ceph-mon[32679]: pgmap v3295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:10 smithi092 ceph-mon[29156]: pgmap v3295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:12 smithi189 ceph-mon[32756]: pgmap v3296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:12 smithi156 ceph-mon[32679]: pgmap v3296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:12 smithi092 ceph-mon[29156]: pgmap v3296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5029.309806 secs 2024-04-26T19:42:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5029.309806 secs 2024-04-26T19:42:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5029.309806 secs 2024-04-26T19:42:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:15 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4332.294472 secs 2024-04-26T19:42:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:15 smithi189 ceph-mon[32756]: pgmap v3297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:15 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4332.294472 secs 2024-04-26T19:42:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:15 smithi156 ceph-mon[32679]: pgmap v3297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:15 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4332.294472 secs 2024-04-26T19:42:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:15 smithi092 ceph-mon[29156]: pgmap v3297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:16.520 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:16 smithi092 ceph-mon[29156]: pgmap v3298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:16 smithi189 ceph-mon[32756]: pgmap v3298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:16 smithi156 ceph-mon[32679]: pgmap v3298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:18 smithi189 ceph-mon[32756]: pgmap v3299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:18 smithi156 ceph-mon[32679]: pgmap v3299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:18 smithi092 ceph-mon[29156]: pgmap v3299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5034.309920 secs 2024-04-26T19:42:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4337.294549 secs 2024-04-26T19:42:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5034.309920 secs 2024-04-26T19:42:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4337.294549 secs 2024-04-26T19:42:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5034.309920 secs 2024-04-26T19:42:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4337.294549 secs 2024-04-26T19:42:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:20 smithi189 ceph-mon[32756]: pgmap v3300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:20 smithi156 ceph-mon[32679]: pgmap v3300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:20 smithi092 ceph-mon[29156]: pgmap v3300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:22 smithi189 ceph-mon[32756]: pgmap v3301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:22 smithi156 ceph-mon[32679]: pgmap v3301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:22 smithi092 ceph-mon[29156]: pgmap v3301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5039.310011 secs 2024-04-26T19:42:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5039.310011 secs 2024-04-26T19:42:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5039.310011 secs 2024-04-26T19:42:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:25 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4342.294666 secs 2024-04-26T19:42:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:25 smithi189 ceph-mon[32756]: pgmap v3302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:25 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4342.294666 secs 2024-04-26T19:42:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:25 smithi156 ceph-mon[32679]: pgmap v3302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:25 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4342.294666 secs 2024-04-26T19:42:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:25 smithi092 ceph-mon[29156]: pgmap v3302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:26 smithi189 ceph-mon[32756]: pgmap v3303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:26 smithi156 ceph-mon[32679]: pgmap v3303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:26 smithi092 ceph-mon[29156]: pgmap v3303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:28 smithi189 ceph-mon[32756]: pgmap v3304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:28 smithi156 ceph-mon[32679]: pgmap v3304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:28 smithi092 ceph-mon[29156]: pgmap v3304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5044.310075 secs 2024-04-26T19:42:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4347.294811 secs 2024-04-26T19:42:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5044.310075 secs 2024-04-26T19:42:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4347.294811 secs 2024-04-26T19:42:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5044.310075 secs 2024-04-26T19:42:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4347.294811 secs 2024-04-26T19:42:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:30 smithi189 ceph-mon[32756]: pgmap v3305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:30 smithi156 ceph-mon[32679]: pgmap v3305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:30 smithi092 ceph-mon[29156]: pgmap v3305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:32 smithi189 ceph-mon[32756]: pgmap v3306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:32 smithi156 ceph-mon[32679]: pgmap v3306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:32 smithi092 ceph-mon[29156]: pgmap v3306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5049.310199 secs 2024-04-26T19:42:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5049.310199 secs 2024-04-26T19:42:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5049.310199 secs 2024-04-26T19:42:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:35 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4352.294981 secs 2024-04-26T19:42:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:35 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4352.294981 secs 2024-04-26T19:42:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:35 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4352.294981 secs 2024-04-26T19:42:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:36 smithi189 ceph-mon[32756]: pgmap v3307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:36 smithi156 ceph-mon[32679]: pgmap v3307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:36 smithi092 ceph-mon[29156]: pgmap v3307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:42:36.667+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:42:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:42:36.667+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:42:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:42:36.668+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:42:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:42:36.668+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 43 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:42:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:38 smithi189 ceph-mon[32756]: pgmap v3308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:38 smithi156 ceph-mon[32679]: pgmap v3308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:38 smithi092 ceph-mon[29156]: pgmap v3308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5054.310317 secs 2024-04-26T19:42:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5054.310317 secs 2024-04-26T19:42:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5054.310317 secs 2024-04-26T19:42:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:40 smithi189 ceph-mon[32756]: pgmap v3309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4357.295091 secs 2024-04-26T19:42:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:40 smithi156 ceph-mon[32679]: pgmap v3309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4357.295091 secs 2024-04-26T19:42:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:40 smithi092 ceph-mon[29156]: pgmap v3309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4357.295091 secs 2024-04-26T19:42:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:42 smithi189 ceph-mon[32756]: pgmap v3310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:42 smithi156 ceph-mon[32679]: pgmap v3310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:42 smithi092 ceph-mon[29156]: pgmap v3310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:44 smithi189 ceph-mon[32756]: pgmap v3311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5059.310434 secs 2024-04-26T19:42:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4362.295178 secs 2024-04-26T19:42:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:44 smithi156 ceph-mon[32679]: pgmap v3311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5059.310434 secs 2024-04-26T19:42:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4362.295178 secs 2024-04-26T19:42:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:44 smithi092 ceph-mon[29156]: pgmap v3311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5059.310434 secs 2024-04-26T19:42:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4362.295178 secs 2024-04-26T19:42:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:46 smithi189 ceph-mon[32756]: pgmap v3312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:46 smithi156 ceph-mon[32679]: pgmap v3312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:46 smithi092 ceph-mon[29156]: pgmap v3312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:48 smithi189 ceph-mon[32756]: pgmap v3313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:48 smithi156 ceph-mon[32679]: pgmap v3313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:48 smithi092 ceph-mon[29156]: pgmap v3313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5064.310551 secs 2024-04-26T19:42:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4367.295338 secs 2024-04-26T19:42:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5064.310551 secs 2024-04-26T19:42:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4367.295338 secs 2024-04-26T19:42:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5064.310551 secs 2024-04-26T19:42:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4367.295338 secs 2024-04-26T19:42:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:50 smithi189 ceph-mon[32756]: pgmap v3314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:50 smithi156 ceph-mon[32679]: pgmap v3314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:50 smithi092 ceph-mon[29156]: pgmap v3314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:52 smithi189 ceph-mon[32756]: pgmap v3315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:52 smithi156 ceph-mon[32679]: pgmap v3315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:52 smithi092 ceph-mon[29156]: pgmap v3315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:54 smithi189 ceph-mon[32756]: pgmap v3316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5069.310697 secs 2024-04-26T19:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4372.295501 secs 2024-04-26T19:42:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:54 smithi156 ceph-mon[32679]: pgmap v3316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5069.310697 secs 2024-04-26T19:42:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4372.295501 secs 2024-04-26T19:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:54 smithi092 ceph-mon[29156]: pgmap v3316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5069.310697 secs 2024-04-26T19:42:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4372.295501 secs 2024-04-26T19:42:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:56 smithi189 ceph-mon[32756]: pgmap v3317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:56 smithi156 ceph-mon[32679]: pgmap v3317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:56 smithi092 ceph-mon[29156]: pgmap v3317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:42:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: pgmap v3318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: pgmap v3319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: pgmap v3320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:42:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: pgmap v3318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: pgmap v3319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:42:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: pgmap v3320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:42:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:42:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: pgmap v3318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:42:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:42:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:42:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: pgmap v3319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:42:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: pgmap v3320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:42:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:42:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5074.310788 secs 2024-04-26T19:42:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:42:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4377.295644 secs 2024-04-26T19:42:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5074.310788 secs 2024-04-26T19:42:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:42:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4377.295644 secs 2024-04-26T19:42:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5074.310788 secs 2024-04-26T19:42:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:42:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4377.295644 secs 2024-04-26T19:43:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:00 smithi189 ceph-mon[32756]: pgmap v3321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:00 smithi156 ceph-mon[32679]: pgmap v3321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:00 smithi092 ceph-mon[29156]: pgmap v3321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:02 smithi092 ceph-mon[29156]: pgmap v3322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:02 smithi189 ceph-mon[32756]: pgmap v3322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:02 smithi156 ceph-mon[32679]: pgmap v3322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:04 smithi092 ceph-mon[29156]: pgmap v3323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5079.310904 secs 2024-04-26T19:43:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4382.295784 secs 2024-04-26T19:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:04 smithi189 ceph-mon[32756]: pgmap v3323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5079.310904 secs 2024-04-26T19:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4382.295784 secs 2024-04-26T19:43:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:04 smithi156 ceph-mon[32679]: pgmap v3323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5079.310904 secs 2024-04-26T19:43:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4382.295784 secs 2024-04-26T19:43:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:06 smithi092 ceph-mon[29156]: pgmap v3324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:06 smithi189 ceph-mon[32756]: pgmap v3324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:06 smithi156 ceph-mon[32679]: pgmap v3324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:43:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:08 smithi092 ceph-mon[29156]: pgmap v3325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:43:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:08 smithi189 ceph-mon[32756]: pgmap v3325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:43:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:08 smithi156 ceph-mon[32679]: pgmap v3325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:43:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5084.310980 secs 2024-04-26T19:43:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4387.295944 secs 2024-04-26T19:43:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5084.310980 secs 2024-04-26T19:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4387.295944 secs 2024-04-26T19:43:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5084.310980 secs 2024-04-26T19:43:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4387.295944 secs 2024-04-26T19:43:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:10 smithi092 ceph-mon[29156]: pgmap v3326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:10 smithi189 ceph-mon[32756]: pgmap v3326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:10 smithi156 ceph-mon[32679]: pgmap v3326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:12 smithi092 ceph-mon[29156]: pgmap v3327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:12 smithi189 ceph-mon[32756]: pgmap v3327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:12 smithi156 ceph-mon[32679]: pgmap v3327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:14 smithi092 ceph-mon[29156]: pgmap v3328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5089.311047 secs 2024-04-26T19:43:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4392.296104 secs 2024-04-26T19:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:14 smithi189 ceph-mon[32756]: pgmap v3328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5089.311047 secs 2024-04-26T19:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4392.296104 secs 2024-04-26T19:43:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:14 smithi156 ceph-mon[32679]: pgmap v3328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5089.311047 secs 2024-04-26T19:43:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4392.296104 secs 2024-04-26T19:43:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:16 smithi092 ceph-mon[29156]: pgmap v3329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:16 smithi189 ceph-mon[32756]: pgmap v3329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:16 smithi156 ceph-mon[32679]: pgmap v3329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:18 smithi092 ceph-mon[29156]: pgmap v3330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:18 smithi189 ceph-mon[32756]: pgmap v3330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:18 smithi156 ceph-mon[32679]: pgmap v3330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5094.311167 secs 2024-04-26T19:43:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4397.296231 secs 2024-04-26T19:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5094.311167 secs 2024-04-26T19:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4397.296231 secs 2024-04-26T19:43:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5094.311167 secs 2024-04-26T19:43:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4397.296231 secs 2024-04-26T19:43:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:20 smithi092 ceph-mon[29156]: pgmap v3331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:20 smithi189 ceph-mon[32756]: pgmap v3331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:20 smithi156 ceph-mon[32679]: pgmap v3331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:22 smithi092 ceph-mon[29156]: pgmap v3332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:22 smithi189 ceph-mon[32756]: pgmap v3332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:22 smithi156 ceph-mon[32679]: pgmap v3332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:24 smithi092 ceph-mon[29156]: pgmap v3333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5099.311234 secs 2024-04-26T19:43:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4402.296367 secs 2024-04-26T19:43:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:24 smithi189 ceph-mon[32756]: pgmap v3333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5099.311234 secs 2024-04-26T19:43:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4402.296367 secs 2024-04-26T19:43:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:24 smithi156 ceph-mon[32679]: pgmap v3333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:43:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5099.311234 secs 2024-04-26T19:43:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4402.296367 secs 2024-04-26T19:43:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:26 smithi092 ceph-mon[29156]: pgmap v3334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:26 smithi189 ceph-mon[32756]: pgmap v3334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:26 smithi156 ceph-mon[32679]: pgmap v3334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:43:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:28 smithi092 ceph-mon[29156]: pgmap v3335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:28 smithi189 ceph-mon[32756]: pgmap v3335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:28 smithi156 ceph-mon[32679]: pgmap v3335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5104.311367 secs 2024-04-26T19:43:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4407.296507 secs 2024-04-26T19:43:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5104.311367 secs 2024-04-26T19:43:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4407.296507 secs 2024-04-26T19:43:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5104.311367 secs 2024-04-26T19:43:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4407.296507 secs 2024-04-26T19:43:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:30 smithi189 ceph-mon[32756]: pgmap v3336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:30 smithi156 ceph-mon[32679]: pgmap v3336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:30 smithi092 ceph-mon[29156]: pgmap v3336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:32 smithi189 ceph-mon[32756]: pgmap v3337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:32 smithi156 ceph-mon[32679]: pgmap v3337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-mon[29156]: pgmap v3337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:32.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:43:32.304+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:43:32.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:43:32.304+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:43:32.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:43:32.304+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:43:32.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:43:32.304+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:43:32.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:43:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:43:32.304+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:43:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:34 smithi189 ceph-mon[32756]: pgmap v3338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5109.311464 secs 2024-04-26T19:43:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4412.296648 secs 2024-04-26T19:43:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:34 smithi156 ceph-mon[32679]: pgmap v3338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5109.311464 secs 2024-04-26T19:43:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4412.296648 secs 2024-04-26T19:43:34.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:34 smithi092 ceph-mon[29156]: pgmap v3338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:34.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5109.311464 secs 2024-04-26T19:43:34.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4412.296648 secs 2024-04-26T19:43:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:36 smithi189 ceph-mon[32756]: pgmap v3339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:36 smithi156 ceph-mon[32679]: pgmap v3339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:36 smithi092 ceph-mon[29156]: pgmap v3339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:38 smithi189 ceph-mon[32756]: pgmap v3340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:38 smithi156 ceph-mon[32679]: pgmap v3340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:38 smithi092 ceph-mon[29156]: pgmap v3340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5114.311594 secs 2024-04-26T19:43:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4417.296725 secs 2024-04-26T19:43:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5114.311594 secs 2024-04-26T19:43:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4417.296725 secs 2024-04-26T19:43:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5114.311594 secs 2024-04-26T19:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4417.296725 secs 2024-04-26T19:43:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:40 smithi189 ceph-mon[32756]: pgmap v3341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:40 smithi156 ceph-mon[32679]: pgmap v3341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:40 smithi092 ceph-mon[29156]: pgmap v3341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:42 smithi189 ceph-mon[32756]: pgmap v3342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:42 smithi156 ceph-mon[32679]: pgmap v3342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:42 smithi092 ceph-mon[29156]: pgmap v3342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:44 smithi189 ceph-mon[32756]: pgmap v3343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5119.311716 secs 2024-04-26T19:43:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4422.296834 secs 2024-04-26T19:43:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:44 smithi156 ceph-mon[32679]: pgmap v3343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5119.311716 secs 2024-04-26T19:43:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4422.296834 secs 2024-04-26T19:43:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:44 smithi092 ceph-mon[29156]: pgmap v3343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5119.311716 secs 2024-04-26T19:43:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4422.296834 secs 2024-04-26T19:43:46.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:46 smithi092 ceph-mon[29156]: pgmap v3344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:46 smithi189 ceph-mon[32756]: pgmap v3344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:46 smithi156 ceph-mon[32679]: pgmap v3344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:48 smithi189 ceph-mon[32756]: pgmap v3345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:48 smithi156 ceph-mon[32679]: pgmap v3345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:48 smithi092 ceph-mon[29156]: pgmap v3345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:49.565 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5124.311847 secs 2024-04-26T19:43:49.565 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4427.296942 secs 2024-04-26T19:43:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5124.311847 secs 2024-04-26T19:43:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4427.296942 secs 2024-04-26T19:43:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5124.311847 secs 2024-04-26T19:43:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4427.296942 secs 2024-04-26T19:43:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:50 smithi189 ceph-mon[32756]: pgmap v3346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:50 smithi156 ceph-mon[32679]: pgmap v3346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:50 smithi092 ceph-mon[29156]: pgmap v3346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:52 smithi189 ceph-mon[32756]: pgmap v3347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:52 smithi156 ceph-mon[32679]: pgmap v3347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:52 smithi092 ceph-mon[29156]: pgmap v3347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:54 smithi189 ceph-mon[32756]: pgmap v3348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5129.311919 secs 2024-04-26T19:43:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4432.297060 secs 2024-04-26T19:43:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:54 smithi156 ceph-mon[32679]: pgmap v3348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5129.311919 secs 2024-04-26T19:43:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4432.297060 secs 2024-04-26T19:43:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:54 smithi092 ceph-mon[29156]: pgmap v3348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5129.311919 secs 2024-04-26T19:43:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4432.297060 secs 2024-04-26T19:43:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:56 smithi189 ceph-mon[32756]: pgmap v3349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:56 smithi156 ceph-mon[32679]: pgmap v3349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:56 smithi092 ceph-mon[29156]: pgmap v3349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:43:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:43:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:58 smithi189 ceph-mon[32756]: pgmap v3350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:43:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:58 smithi156 ceph-mon[32679]: pgmap v3350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:43:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:58 smithi092 ceph-mon[29156]: pgmap v3350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:43:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:43:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:43:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:43:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:59 smithi156 ceph-mon[32679]: pgmap v3351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:43:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:59 smithi156 ceph-mon[32679]: pgmap v3352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5134.312000 secs 2024-04-26T19:43:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:43:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4437.297198 secs 2024-04-26T19:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:59 smithi189 ceph-mon[32756]: pgmap v3351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:59 smithi189 ceph-mon[32756]: pgmap v3352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5134.312000 secs 2024-04-26T19:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:43:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4437.297198 secs 2024-04-26T19:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:59 smithi092 ceph-mon[29156]: pgmap v3351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:59 smithi092 ceph-mon[29156]: pgmap v3352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5134.312000 secs 2024-04-26T19:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:43:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4437.297198 secs 2024-04-26T19:44:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:01 smithi189 ceph-mon[32756]: pgmap v3353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:01 smithi156 ceph-mon[32679]: pgmap v3353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:01 smithi092 ceph-mon[29156]: pgmap v3353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:03 smithi189 ceph-mon[32756]: pgmap v3354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:03 smithi156 ceph-mon[32679]: pgmap v3354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:03 smithi092 ceph-mon[29156]: pgmap v3354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5139.312109 secs 2024-04-26T19:44:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 4442.297307 secs 2024-04-26T19:44:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:04 smithi189 ceph-mon[32756]: slow request 2881.843728 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:44:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5139.312109 secs 2024-04-26T19:44:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 4442.297307 secs 2024-04-26T19:44:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:04 smithi156 ceph-mon[32679]: slow request 2881.843728 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:44:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5139.312109 secs 2024-04-26T19:44:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 4442.297307 secs 2024-04-26T19:44:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:04 smithi092 ceph-mon[29156]: slow request 2881.843728 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:44:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:05 smithi189 ceph-mon[32756]: pgmap v3355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:05 smithi156 ceph-mon[32679]: pgmap v3355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:05 smithi092 ceph-mon[29156]: pgmap v3355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:07 smithi189 ceph-mon[32756]: pgmap v3356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:07 smithi156 ceph-mon[32679]: pgmap v3356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:07 smithi092 ceph-mon[29156]: pgmap v3356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:44:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:09 smithi189 ceph-mon[32756]: pgmap v3357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:44:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5144.312223 secs 2024-04-26T19:44:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4447.297419 secs 2024-04-26T19:44:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:09 smithi156 ceph-mon[32679]: pgmap v3357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:44:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5144.312223 secs 2024-04-26T19:44:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4447.297419 secs 2024-04-26T19:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:09 smithi092 ceph-mon[29156]: pgmap v3357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5144.312223 secs 2024-04-26T19:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4447.297419 secs 2024-04-26T19:44:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:11 smithi189 ceph-mon[32756]: pgmap v3358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:11 smithi156 ceph-mon[32679]: pgmap v3358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:11 smithi092 ceph-mon[29156]: pgmap v3358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:13 smithi189 ceph-mon[32756]: pgmap v3359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:13 smithi156 ceph-mon[32679]: pgmap v3359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:13 smithi092 ceph-mon[29156]: pgmap v3359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5149.312352 secs 2024-04-26T19:44:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4452.297496 secs 2024-04-26T19:44:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5149.312352 secs 2024-04-26T19:44:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4452.297496 secs 2024-04-26T19:44:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5149.312352 secs 2024-04-26T19:44:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4452.297496 secs 2024-04-26T19:44:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:15 smithi189 ceph-mon[32756]: pgmap v3360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:15 smithi156 ceph-mon[32679]: pgmap v3360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:15 smithi092 ceph-mon[29156]: pgmap v3360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:16 smithi189 ceph-mon[32756]: pgmap v3361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:16.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:16 smithi092 ceph-mon[29156]: pgmap v3361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:16 smithi156 ceph-mon[32679]: pgmap v3361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:18 smithi092 ceph-mon[29156]: pgmap v3362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:18 smithi189 ceph-mon[32756]: pgmap v3362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:18 smithi156 ceph-mon[32679]: pgmap v3362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5154.312466 secs 2024-04-26T19:44:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4457.297611 secs 2024-04-26T19:44:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5154.312466 secs 2024-04-26T19:44:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4457.297611 secs 2024-04-26T19:44:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5154.312466 secs 2024-04-26T19:44:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4457.297611 secs 2024-04-26T19:44:21.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:20 smithi092 ceph-mon[29156]: pgmap v3363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:20 smithi189 ceph-mon[32756]: pgmap v3363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:20 smithi156 ceph-mon[32679]: pgmap v3363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:23.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:22 smithi092 ceph-mon[29156]: pgmap v3364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:22 smithi189 ceph-mon[32756]: pgmap v3364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:22 smithi156 ceph-mon[32679]: pgmap v3364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5159.312562 secs 2024-04-26T19:44:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4462.297715 secs 2024-04-26T19:44:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:24 smithi092 ceph-mon[29156]: pgmap v3365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5159.312562 secs 2024-04-26T19:44:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4462.297715 secs 2024-04-26T19:44:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:24 smithi189 ceph-mon[32756]: pgmap v3365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5159.312562 secs 2024-04-26T19:44:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4462.297715 secs 2024-04-26T19:44:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:24 smithi156 ceph-mon[32679]: pgmap v3365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:26 smithi092 ceph-mon[29156]: pgmap v3366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:26 smithi189 ceph-mon[32756]: pgmap v3366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:26 smithi156 ceph-mon[32679]: pgmap v3366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:28 smithi189 ceph-mon[32756]: pgmap v3367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:28 smithi156 ceph-mon[32679]: pgmap v3367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:28 smithi092 ceph-mon[29156]: pgmap v3367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5164.312701 secs 2024-04-26T19:44:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:30 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4467.297822 secs 2024-04-26T19:44:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5164.312701 secs 2024-04-26T19:44:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:30 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4467.297822 secs 2024-04-26T19:44:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5164.312701 secs 2024-04-26T19:44:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:30 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4467.297822 secs 2024-04-26T19:44:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:31 smithi189 ceph-mon[32756]: pgmap v3368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:31 smithi156 ceph-mon[32679]: pgmap v3368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:31 smithi092 ceph-mon[29156]: pgmap v3368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:33 smithi189 ceph-mon[32756]: pgmap v3369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:33 smithi156 ceph-mon[32679]: pgmap v3369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:33 smithi092 ceph-mon[29156]: pgmap v3369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5169.312797 secs 2024-04-26T19:44:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:35 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4472.297962 secs 2024-04-26T19:44:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:35 smithi189 ceph-mon[32756]: pgmap v3370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5169.312797 secs 2024-04-26T19:44:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:35 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4472.297962 secs 2024-04-26T19:44:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:35 smithi156 ceph-mon[32679]: pgmap v3370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5169.312797 secs 2024-04-26T19:44:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:35 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4472.297962 secs 2024-04-26T19:44:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:35 smithi092 ceph-mon[29156]: pgmap v3370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:37 smithi189 ceph-mon[32756]: pgmap v3371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:37 smithi156 ceph-mon[32679]: pgmap v3371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:37 smithi092 ceph-mon[29156]: pgmap v3371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:39 smithi189 ceph-mon[32756]: pgmap v3372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:39 smithi156 ceph-mon[32679]: pgmap v3372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:39 smithi092 ceph-mon[29156]: pgmap v3372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5174.312911 secs 2024-04-26T19:44:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4477.298026 secs 2024-04-26T19:44:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5174.312911 secs 2024-04-26T19:44:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4477.298026 secs 2024-04-26T19:44:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5174.312911 secs 2024-04-26T19:44:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4477.298026 secs 2024-04-26T19:44:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:41 smithi189 ceph-mon[32756]: pgmap v3373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:41 smithi156 ceph-mon[32679]: pgmap v3373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:41 smithi092 ceph-mon[29156]: pgmap v3373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:43 smithi189 ceph-mon[32756]: pgmap v3374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:43 smithi156 ceph-mon[32679]: pgmap v3374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:43 smithi092 ceph-mon[29156]: pgmap v3374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5179.313023 secs 2024-04-26T19:44:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5179.313023 secs 2024-04-26T19:44:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5179.313023 secs 2024-04-26T19:44:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:45 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4482.298184 secs 2024-04-26T19:44:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:45 smithi189 ceph-mon[32756]: pgmap v3375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:45 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4482.298184 secs 2024-04-26T19:44:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:45 smithi156 ceph-mon[32679]: pgmap v3375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:45 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4482.298184 secs 2024-04-26T19:44:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:45 smithi092 ceph-mon[29156]: pgmap v3375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:47 smithi189 ceph-mon[32756]: pgmap v3376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:47 smithi156 ceph-mon[32679]: pgmap v3376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:47 smithi092 ceph-mon[29156]: pgmap v3376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:49 smithi189 ceph-mon[32756]: pgmap v3377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5184.313085 secs 2024-04-26T19:44:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:49 smithi156 ceph-mon[32679]: pgmap v3377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5184.313085 secs 2024-04-26T19:44:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:49 smithi092 ceph-mon[29156]: pgmap v3377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5184.313085 secs 2024-04-26T19:44:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:50 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4487.298347 secs 2024-04-26T19:44:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:50 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4487.298347 secs 2024-04-26T19:44:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:50 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4487.298347 secs 2024-04-26T19:44:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:51 smithi189 ceph-mon[32756]: pgmap v3378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:51 smithi156 ceph-mon[32679]: pgmap v3378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:51 smithi092 ceph-mon[29156]: pgmap v3378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:53 smithi189 ceph-mon[32756]: pgmap v3379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:53 smithi156 ceph-mon[32679]: pgmap v3379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:53 smithi092 ceph-mon[29156]: pgmap v3379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5189.313168 secs 2024-04-26T19:44:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4492.298465 secs 2024-04-26T19:44:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5189.313168 secs 2024-04-26T19:44:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4492.298465 secs 2024-04-26T19:44:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5189.313168 secs 2024-04-26T19:44:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4492.298465 secs 2024-04-26T19:44:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:55 smithi189 ceph-mon[32756]: pgmap v3380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:55 smithi156 ceph-mon[32679]: pgmap v3380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:55 smithi092 ceph-mon[29156]: pgmap v3380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:44:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:57 smithi189 ceph-mon[32756]: pgmap v3381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:57 smithi156 ceph-mon[32679]: pgmap v3381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:57 smithi092 ceph-mon[29156]: pgmap v3381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: pgmap v3382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5194.313259 secs 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4497.298533 secs 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:44:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:44:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: pgmap v3382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5194.313259 secs 2024-04-26T19:44:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4497.298533 secs 2024-04-26T19:44:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:44:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:44:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: pgmap v3382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5194.313259 secs 2024-04-26T19:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4497.298533 secs 2024-04-26T19:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:44:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:45:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:00 smithi189 ceph-mon[32756]: pgmap v3383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:45:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:00 smithi189 ceph-mon[32756]: pgmap v3384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:00 smithi156 ceph-mon[32679]: pgmap v3383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:45:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:00 smithi156 ceph-mon[32679]: pgmap v3384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:00 smithi092 ceph-mon[29156]: pgmap v3383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T19:45:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:00 smithi092 ceph-mon[29156]: pgmap v3384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:02 smithi189 ceph-mon[32756]: pgmap v3385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:02 smithi156 ceph-mon[32679]: pgmap v3385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:02 smithi092 ceph-mon[29156]: pgmap v3385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:04 smithi189 ceph-mon[32756]: pgmap v3386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:45:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5199.313325 secs 2024-04-26T19:45:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4502.298644 secs 2024-04-26T19:45:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:04 smithi156 ceph-mon[32679]: pgmap v3386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:45:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5199.313325 secs 2024-04-26T19:45:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4502.298644 secs 2024-04-26T19:45:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:04 smithi092 ceph-mon[29156]: pgmap v3386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:45:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5199.313325 secs 2024-04-26T19:45:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4502.298644 secs 2024-04-26T19:45:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:06 smithi189 ceph-mon[32756]: pgmap v3387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:06 smithi156 ceph-mon[32679]: pgmap v3387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:06 smithi092 ceph-mon[29156]: pgmap v3387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:08 smithi189 ceph-mon[32756]: pgmap v3388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:08 smithi156 ceph-mon[32679]: pgmap v3388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:08 smithi092 ceph-mon[29156]: pgmap v3388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:45:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5204.313440 secs 2024-04-26T19:45:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4507.298725 secs 2024-04-26T19:45:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5204.313440 secs 2024-04-26T19:45:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4507.298725 secs 2024-04-26T19:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5204.313440 secs 2024-04-26T19:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4507.298725 secs 2024-04-26T19:45:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:10 smithi156 ceph-mon[32679]: pgmap v3389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:45:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:10 smithi092 ceph-mon[29156]: pgmap v3389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:45:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:10 smithi189 ceph-mon[32756]: pgmap v3389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:45:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:12 smithi156 ceph-mon[32679]: pgmap v3390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:12 smithi092 ceph-mon[29156]: pgmap v3390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:12 smithi189 ceph-mon[32756]: pgmap v3390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:14 smithi156 ceph-mon[32679]: pgmap v3391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5209.313557 secs 2024-04-26T19:45:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4512.298804 secs 2024-04-26T19:45:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:14 smithi092 ceph-mon[29156]: pgmap v3391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5209.313557 secs 2024-04-26T19:45:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4512.298804 secs 2024-04-26T19:45:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:14 smithi189 ceph-mon[32756]: pgmap v3391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5209.313557 secs 2024-04-26T19:45:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4512.298804 secs 2024-04-26T19:45:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:16 smithi156 ceph-mon[32679]: pgmap v3392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:16 smithi092 ceph-mon[29156]: pgmap v3392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:16 smithi189 ceph-mon[32756]: pgmap v3392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:18 smithi156 ceph-mon[32679]: pgmap v3393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:18 smithi092 ceph-mon[29156]: pgmap v3393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:18 smithi189 ceph-mon[32756]: pgmap v3393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5214.313694 secs 2024-04-26T19:45:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4517.298934 secs 2024-04-26T19:45:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5214.313694 secs 2024-04-26T19:45:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4517.298934 secs 2024-04-26T19:45:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5214.313694 secs 2024-04-26T19:45:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4517.298934 secs 2024-04-26T19:45:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:20 smithi156 ceph-mon[32679]: pgmap v3394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:20 smithi092 ceph-mon[29156]: pgmap v3394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:20 smithi189 ceph-mon[32756]: pgmap v3394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:22 smithi156 ceph-mon[32679]: pgmap v3395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:22 smithi092 ceph-mon[29156]: pgmap v3395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:22 smithi189 ceph-mon[32756]: pgmap v3395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:24 smithi156 ceph-mon[32679]: pgmap v3396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5219.313850 secs 2024-04-26T19:45:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4522.299054 secs 2024-04-26T19:45:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:24 smithi092 ceph-mon[29156]: pgmap v3396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5219.313850 secs 2024-04-26T19:45:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4522.299054 secs 2024-04-26T19:45:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:24 smithi189 ceph-mon[32756]: pgmap v3396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5219.313850 secs 2024-04-26T19:45:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4522.299054 secs 2024-04-26T19:45:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:26 smithi156 ceph-mon[32679]: pgmap v3397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:26 smithi092 ceph-mon[29156]: pgmap v3397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:26 smithi189 ceph-mon[32756]: pgmap v3397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:28 smithi156 ceph-mon[32679]: pgmap v3398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:28 smithi092 ceph-mon[29156]: pgmap v3398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:28 smithi189 ceph-mon[32756]: pgmap v3398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5224.313958 secs 2024-04-26T19:45:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4527.299192 secs 2024-04-26T19:45:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5224.313958 secs 2024-04-26T19:45:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4527.299192 secs 2024-04-26T19:45:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5224.313958 secs 2024-04-26T19:45:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4527.299192 secs 2024-04-26T19:45:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:30 smithi156 ceph-mon[32679]: pgmap v3399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:30 smithi092 ceph-mon[29156]: pgmap v3399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:30 smithi189 ceph-mon[32756]: pgmap v3399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:32 smithi156 ceph-mon[32679]: pgmap v3400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:32 smithi092 ceph-mon[29156]: pgmap v3400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:32 smithi189 ceph-mon[32756]: pgmap v3400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:34 smithi156 ceph-mon[32679]: pgmap v3401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5229.314085 secs 2024-04-26T19:45:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4532.299288 secs 2024-04-26T19:45:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:34 smithi092 ceph-mon[29156]: pgmap v3401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5229.314085 secs 2024-04-26T19:45:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4532.299288 secs 2024-04-26T19:45:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:34 smithi189 ceph-mon[32756]: pgmap v3401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5229.314085 secs 2024-04-26T19:45:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4532.299288 secs 2024-04-26T19:45:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:36 smithi092 ceph-mon[29156]: pgmap v3402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:36 smithi189 ceph-mon[32756]: pgmap v3402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:36 smithi156 ceph-mon[32679]: pgmap v3402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:45:36.693+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:45:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:45:36.693+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:45:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:45:36.693+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:45:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:45:36.693+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 44 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:45:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:38 smithi092 ceph-mon[29156]: pgmap v3403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:38 smithi189 ceph-mon[32756]: pgmap v3403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:38 smithi156 ceph-mon[32679]: pgmap v3403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5234.314204 secs 2024-04-26T19:45:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4537.299368 secs 2024-04-26T19:45:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5234.314204 secs 2024-04-26T19:45:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4537.299368 secs 2024-04-26T19:45:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5234.314204 secs 2024-04-26T19:45:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4537.299368 secs 2024-04-26T19:45:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:40 smithi092 ceph-mon[29156]: pgmap v3404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:40 smithi189 ceph-mon[32756]: pgmap v3404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:40 smithi156 ceph-mon[32679]: pgmap v3404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:42 smithi092 ceph-mon[29156]: pgmap v3405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:42 smithi189 ceph-mon[32756]: pgmap v3405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:42 smithi156 ceph-mon[32679]: pgmap v3405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:44 smithi092 ceph-mon[29156]: pgmap v3406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5239.314320 secs 2024-04-26T19:45:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4542.299433 secs 2024-04-26T19:45:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:44 smithi189 ceph-mon[32756]: pgmap v3406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5239.314320 secs 2024-04-26T19:45:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4542.299433 secs 2024-04-26T19:45:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:44 smithi156 ceph-mon[32679]: pgmap v3406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5239.314320 secs 2024-04-26T19:45:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4542.299433 secs 2024-04-26T19:45:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:46 smithi092 ceph-mon[29156]: pgmap v3407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:46 smithi189 ceph-mon[32756]: pgmap v3407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:46 smithi156 ceph-mon[32679]: pgmap v3407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:48 smithi092 ceph-mon[29156]: pgmap v3408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:48 smithi189 ceph-mon[32756]: pgmap v3408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:48 smithi156 ceph-mon[32679]: pgmap v3408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5244.314466 secs 2024-04-26T19:45:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4547.299510 secs 2024-04-26T19:45:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5244.314466 secs 2024-04-26T19:45:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4547.299510 secs 2024-04-26T19:45:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5244.314466 secs 2024-04-26T19:45:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4547.299510 secs 2024-04-26T19:45:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:50 smithi092 ceph-mon[29156]: pgmap v3409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:50 smithi189 ceph-mon[32756]: pgmap v3409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:50 smithi156 ceph-mon[32679]: pgmap v3409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:52 smithi092 ceph-mon[29156]: pgmap v3410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:52 smithi189 ceph-mon[32756]: pgmap v3410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:52 smithi156 ceph-mon[32679]: pgmap v3410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:54 smithi092 ceph-mon[29156]: pgmap v3411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5249.314590 secs 2024-04-26T19:45:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4552.299594 secs 2024-04-26T19:45:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:54 smithi189 ceph-mon[32756]: pgmap v3411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5249.314590 secs 2024-04-26T19:45:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4552.299594 secs 2024-04-26T19:45:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:54 smithi156 ceph-mon[32679]: pgmap v3411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5249.314590 secs 2024-04-26T19:45:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4552.299594 secs 2024-04-26T19:45:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:56 smithi092 ceph-mon[29156]: pgmap v3412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:56 smithi189 ceph-mon[32756]: pgmap v3412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:56 smithi156 ceph-mon[32679]: pgmap v3412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:45:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:58 smithi092 ceph-mon[29156]: pgmap v3413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:58 smithi189 ceph-mon[32756]: pgmap v3413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:58 smithi156 ceph-mon[32679]: pgmap v3413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:45:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5254.314657 secs 2024-04-26T19:45:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4557.299665 secs 2024-04-26T19:45:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:45:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:45:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5254.314657 secs 2024-04-26T19:45:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4557.299665 secs 2024-04-26T19:45:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:45:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5254.314657 secs 2024-04-26T19:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4557.299665 secs 2024-04-26T19:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:45:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:46:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:00 smithi092 ceph-mon[29156]: pgmap v3414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:00 smithi189 ceph-mon[32756]: pgmap v3414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:46:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:00 smithi156 ceph-mon[32679]: pgmap v3414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:46:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:46:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:46:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:01 smithi092 ceph-mon[29156]: pgmap v3415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:46:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:01 smithi092 ceph-mon[29156]: pgmap v3416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:01 smithi189 ceph-mon[32756]: pgmap v3415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:46:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:01 smithi189 ceph-mon[32756]: pgmap v3416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:01 smithi156 ceph-mon[32679]: pgmap v3415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:46:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:01 smithi156 ceph-mon[32679]: pgmap v3416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:03 smithi189 ceph-mon[32756]: pgmap v3417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:03 smithi156 ceph-mon[32679]: pgmap v3417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:03 smithi092 ceph-mon[29156]: pgmap v3417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5259.314776 secs 2024-04-26T19:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 4562.299727 secs 2024-04-26T19:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:04 smithi189 ceph-mon[32756]: slow request 1441.457632 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:46:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5259.314776 secs 2024-04-26T19:46:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 4562.299727 secs 2024-04-26T19:46:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:04 smithi156 ceph-mon[32679]: slow request 1441.457632 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:46:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5259.314776 secs 2024-04-26T19:46:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 4562.299727 secs 2024-04-26T19:46:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:04 smithi092 ceph-mon[29156]: slow request 1441.457632 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:46:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:05 smithi189 ceph-mon[32756]: pgmap v3418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:46:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:05 smithi156 ceph-mon[32679]: pgmap v3418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:46:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:05 smithi092 ceph-mon[29156]: pgmap v3418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T19:46:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:07 smithi189 ceph-mon[32756]: pgmap v3419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:07 smithi156 ceph-mon[32679]: pgmap v3419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:07 smithi092 ceph-mon[29156]: pgmap v3419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:09 smithi189 ceph-mon[32756]: pgmap v3420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5264.314906 secs 2024-04-26T19:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4567.299791 secs 2024-04-26T19:46:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:09 smithi156 ceph-mon[32679]: pgmap v3420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:46:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5264.314906 secs 2024-04-26T19:46:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4567.299791 secs 2024-04-26T19:46:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:09 smithi092 ceph-mon[29156]: pgmap v3420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:46:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5264.314906 secs 2024-04-26T19:46:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4567.299791 secs 2024-04-26T19:46:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:11 smithi189 ceph-mon[32756]: pgmap v3421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:46:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:11 smithi156 ceph-mon[32679]: pgmap v3421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:46:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:11 smithi092 ceph-mon[29156]: pgmap v3421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:46:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:13 smithi189 ceph-mon[32756]: pgmap v3422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:13 smithi156 ceph-mon[32679]: pgmap v3422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:13 smithi092 ceph-mon[29156]: pgmap v3422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5269.315013 secs 2024-04-26T19:46:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4572.299856 secs 2024-04-26T19:46:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5269.315013 secs 2024-04-26T19:46:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4572.299856 secs 2024-04-26T19:46:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5269.315013 secs 2024-04-26T19:46:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4572.299856 secs 2024-04-26T19:46:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:15 smithi189 ceph-mon[32756]: pgmap v3423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:15 smithi156 ceph-mon[32679]: pgmap v3423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:15 smithi092 ceph-mon[29156]: pgmap v3423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:17 smithi189 ceph-mon[32756]: pgmap v3424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:17 smithi156 ceph-mon[32679]: pgmap v3424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:17 smithi092 ceph-mon[29156]: pgmap v3424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:19 smithi092 ceph-mon[29156]: pgmap v3425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5274.315104 secs 2024-04-26T19:46:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4577.299917 secs 2024-04-26T19:46:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:19 smithi189 ceph-mon[32756]: pgmap v3425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5274.315104 secs 2024-04-26T19:46:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4577.299917 secs 2024-04-26T19:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:19 smithi156 ceph-mon[32679]: pgmap v3425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5274.315104 secs 2024-04-26T19:46:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4577.299917 secs 2024-04-26T19:46:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:21 smithi189 ceph-mon[32756]: pgmap v3426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:21 smithi156 ceph-mon[32679]: pgmap v3426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:21 smithi092 ceph-mon[29156]: pgmap v3426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:23 smithi189 ceph-mon[32756]: pgmap v3427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:23 smithi156 ceph-mon[32679]: pgmap v3427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:23 smithi092 ceph-mon[29156]: pgmap v3427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5279.315224 secs 2024-04-26T19:46:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4582.300032 secs 2024-04-26T19:46:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5279.315224 secs 2024-04-26T19:46:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4582.300032 secs 2024-04-26T19:46:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5279.315224 secs 2024-04-26T19:46:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4582.300032 secs 2024-04-26T19:46:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:25 smithi189 ceph-mon[32756]: pgmap v3428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:25 smithi156 ceph-mon[32679]: pgmap v3428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:25.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:25 smithi092 ceph-mon[29156]: pgmap v3428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:27 smithi189 ceph-mon[32756]: pgmap v3429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:27 smithi156 ceph-mon[32679]: pgmap v3429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:27 smithi092 ceph-mon[29156]: pgmap v3429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:29 smithi189 ceph-mon[32756]: pgmap v3430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5284.315342 secs 2024-04-26T19:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4587.300098 secs 2024-04-26T19:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:29 smithi156 ceph-mon[32679]: pgmap v3430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5284.315342 secs 2024-04-26T19:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4587.300098 secs 2024-04-26T19:46:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:29 smithi092 ceph-mon[29156]: pgmap v3430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5284.315342 secs 2024-04-26T19:46:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4587.300098 secs 2024-04-26T19:46:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:31 smithi189 ceph-mon[32756]: pgmap v3431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:31 smithi156 ceph-mon[32679]: pgmap v3431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:31 smithi092 ceph-mon[29156]: pgmap v3431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:33 smithi189 ceph-mon[32756]: pgmap v3432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:33 smithi156 ceph-mon[32679]: pgmap v3432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:33 smithi092 ceph-mon[29156]: pgmap v3432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5289.315437 secs 2024-04-26T19:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4592.300222 secs 2024-04-26T19:46:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5289.315437 secs 2024-04-26T19:46:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4592.300222 secs 2024-04-26T19:46:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5289.315437 secs 2024-04-26T19:46:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4592.300222 secs 2024-04-26T19:46:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:35 smithi189 ceph-mon[32756]: pgmap v3433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:35 smithi156 ceph-mon[32679]: pgmap v3433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:35 smithi092 ceph-mon[29156]: pgmap v3433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:37 smithi189 ceph-mon[32756]: pgmap v3434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:37 smithi156 ceph-mon[32679]: pgmap v3434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:37 smithi092 ceph-mon[29156]: pgmap v3434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:39 smithi189 ceph-mon[32756]: pgmap v3435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5294.315554 secs 2024-04-26T19:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4597.300281 secs 2024-04-26T19:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:39 smithi156 ceph-mon[32679]: pgmap v3435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5294.315554 secs 2024-04-26T19:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4597.300281 secs 2024-04-26T19:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:39 smithi092 ceph-mon[29156]: pgmap v3435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5294.315554 secs 2024-04-26T19:46:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4597.300281 secs 2024-04-26T19:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:41 smithi189 ceph-mon[32756]: pgmap v3436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:41 smithi156 ceph-mon[32679]: pgmap v3436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:41 smithi092 ceph-mon[29156]: pgmap v3436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:43 smithi189 ceph-mon[32756]: pgmap v3437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:43 smithi156 ceph-mon[32679]: pgmap v3437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:43 smithi092 ceph-mon[29156]: pgmap v3437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5299.315650 secs 2024-04-26T19:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4602.300400 secs 2024-04-26T19:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5299.315650 secs 2024-04-26T19:46:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4602.300400 secs 2024-04-26T19:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5299.315650 secs 2024-04-26T19:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4602.300400 secs 2024-04-26T19:46:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:45 smithi189 ceph-mon[32756]: pgmap v3438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:45 smithi156 ceph-mon[32679]: pgmap v3438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:45 smithi092 ceph-mon[29156]: pgmap v3438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:47 smithi189 ceph-mon[32756]: pgmap v3439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:47 smithi156 ceph-mon[32679]: pgmap v3439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:47 smithi092 ceph-mon[29156]: pgmap v3439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:49 smithi189 ceph-mon[32756]: pgmap v3440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5304.315763 secs 2024-04-26T19:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4607.300465 secs 2024-04-26T19:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:49 smithi156 ceph-mon[32679]: pgmap v3440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5304.315763 secs 2024-04-26T19:46:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4607.300465 secs 2024-04-26T19:46:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:49 smithi092 ceph-mon[29156]: pgmap v3440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5304.315763 secs 2024-04-26T19:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4607.300465 secs 2024-04-26T19:46:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:51 smithi189 ceph-mon[32756]: pgmap v3441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:51 smithi156 ceph-mon[32679]: pgmap v3441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:51 smithi092 ceph-mon[29156]: pgmap v3441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:53.350 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:53 smithi189 ceph-mon[32756]: pgmap v3442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:53 smithi156 ceph-mon[32679]: pgmap v3442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:53 smithi092 ceph-mon[29156]: pgmap v3442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5309.315878 secs 2024-04-26T19:46:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4612.300529 secs 2024-04-26T19:46:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5309.315878 secs 2024-04-26T19:46:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4612.300529 secs 2024-04-26T19:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5309.315878 secs 2024-04-26T19:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4612.300529 secs 2024-04-26T19:46:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:55 smithi189 ceph-mon[32756]: pgmap v3443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:55 smithi156 ceph-mon[32679]: pgmap v3443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:55 smithi092 ceph-mon[29156]: pgmap v3443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:46:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:57 smithi189 ceph-mon[32756]: pgmap v3444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:57 smithi156 ceph-mon[32679]: pgmap v3444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:57 smithi092 ceph-mon[29156]: pgmap v3444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:59 smithi189 ceph-mon[32756]: pgmap v3445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5314.315936 secs 2024-04-26T19:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:46:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4617.300591 secs 2024-04-26T19:46:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:59 smithi156 ceph-mon[32679]: pgmap v3445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5314.315936 secs 2024-04-26T19:46:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:46:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4617.300591 secs 2024-04-26T19:46:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:59 smithi092 ceph-mon[29156]: pgmap v3445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:46:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5314.315936 secs 2024-04-26T19:46:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:46:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4617.300591 secs 2024-04-26T19:47:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:47:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:47:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:47:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:47:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:47:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:47:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:01 smithi189 ceph-mon[32756]: pgmap v3446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:01 smithi189 ceph-mon[32756]: pgmap v3447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:47:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:01 smithi189 ceph-mon[32756]: pgmap v3448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:01 smithi156 ceph-mon[32679]: pgmap v3446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:01 smithi156 ceph-mon[32679]: pgmap v3447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:47:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:01 smithi156 ceph-mon[32679]: pgmap v3448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:01 smithi092 ceph-mon[29156]: pgmap v3446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:01 smithi092 ceph-mon[29156]: pgmap v3447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:47:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:01 smithi092 ceph-mon[29156]: pgmap v3448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:02 smithi156 ceph-mon[32679]: pgmap v3449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:02 smithi092 ceph-mon[29156]: pgmap v3449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:02 smithi189 ceph-mon[32756]: pgmap v3449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5319.316054 secs 2024-04-26T19:47:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5319.316054 secs 2024-04-26T19:47:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5319.316054 secs 2024-04-26T19:47:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:05 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4622.300720 secs 2024-04-26T19:47:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:05 smithi189 ceph-mon[32756]: pgmap v3450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:05 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4622.300720 secs 2024-04-26T19:47:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:05 smithi156 ceph-mon[32679]: pgmap v3450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:05 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4622.300720 secs 2024-04-26T19:47:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:05 smithi092 ceph-mon[29156]: pgmap v3450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:07 smithi189 ceph-mon[32756]: pgmap v3451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:07 smithi156 ceph-mon[32679]: pgmap v3451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:07 smithi092 ceph-mon[29156]: pgmap v3451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5324.316175 secs 2024-04-26T19:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:09 smithi189 ceph-mon[32756]: pgmap v3452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4627.300786 secs 2024-04-26T19:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5324.316175 secs 2024-04-26T19:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:09 smithi156 ceph-mon[32679]: pgmap v3452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4627.300786 secs 2024-04-26T19:47:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5324.316175 secs 2024-04-26T19:47:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:09 smithi092 ceph-mon[29156]: pgmap v3452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:47:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4627.300786 secs 2024-04-26T19:47:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:11 smithi189 ceph-mon[32756]: pgmap v3453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:47:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:11 smithi156 ceph-mon[32679]: pgmap v3453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:47:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:11 smithi092 ceph-mon[29156]: pgmap v3453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:47:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:13 smithi189 ceph-mon[32756]: pgmap v3454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:13 smithi156 ceph-mon[32679]: pgmap v3454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:13 smithi092 ceph-mon[29156]: pgmap v3454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5329.316268 secs 2024-04-26T19:47:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4632.300923 secs 2024-04-26T19:47:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5329.316268 secs 2024-04-26T19:47:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4632.300923 secs 2024-04-26T19:47:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5329.316268 secs 2024-04-26T19:47:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4632.300923 secs 2024-04-26T19:47:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:15 smithi189 ceph-mon[32756]: pgmap v3455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:15 smithi156 ceph-mon[32679]: pgmap v3455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:15 smithi092 ceph-mon[29156]: pgmap v3455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:17 smithi189 ceph-mon[32756]: pgmap v3456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:17 smithi156 ceph-mon[32679]: pgmap v3456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:17 smithi092 ceph-mon[29156]: pgmap v3456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5334.316396 secs 2024-04-26T19:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:19 smithi189 ceph-mon[32756]: pgmap v3457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4637.301036 secs 2024-04-26T19:47:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5334.316396 secs 2024-04-26T19:47:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:19 smithi156 ceph-mon[32679]: pgmap v3457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4637.301036 secs 2024-04-26T19:47:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5334.316396 secs 2024-04-26T19:47:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:19 smithi092 ceph-mon[29156]: pgmap v3457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4637.301036 secs 2024-04-26T19:47:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:21 smithi189 ceph-mon[32756]: pgmap v3458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:21 smithi156 ceph-mon[32679]: pgmap v3458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:21 smithi092 ceph-mon[29156]: pgmap v3458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:23 smithi189 ceph-mon[32756]: pgmap v3459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:23 smithi156 ceph-mon[32679]: pgmap v3459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:23 smithi092 ceph-mon[29156]: pgmap v3459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5339.316459 secs 2024-04-26T19:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4642.301099 secs 2024-04-26T19:47:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5339.316459 secs 2024-04-26T19:47:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4642.301099 secs 2024-04-26T19:47:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5339.316459 secs 2024-04-26T19:47:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4642.301099 secs 2024-04-26T19:47:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:25 smithi189 ceph-mon[32756]: pgmap v3460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:25 smithi156 ceph-mon[32679]: pgmap v3460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:25 smithi092 ceph-mon[29156]: pgmap v3460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:27 smithi189 ceph-mon[32756]: pgmap v3461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:27.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:27 smithi092 ceph-mon[29156]: pgmap v3461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:27 smithi156 ceph-mon[32679]: pgmap v3461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5344.316568 secs 2024-04-26T19:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:29 smithi189 ceph-mon[32756]: pgmap v3462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4647.301208 secs 2024-04-26T19:47:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5344.316568 secs 2024-04-26T19:47:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:29 smithi156 ceph-mon[32679]: pgmap v3462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4647.301208 secs 2024-04-26T19:47:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5344.316568 secs 2024-04-26T19:47:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:29 smithi092 ceph-mon[29156]: pgmap v3462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4647.301208 secs 2024-04-26T19:47:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:31 smithi189 ceph-mon[32756]: pgmap v3463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:31 smithi156 ceph-mon[32679]: pgmap v3463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:31 smithi092 ceph-mon[29156]: pgmap v3463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:33 smithi189 ceph-mon[32756]: pgmap v3464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:33 smithi156 ceph-mon[32679]: pgmap v3464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:33 smithi092 ceph-mon[29156]: pgmap v3464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5349.316689 secs 2024-04-26T19:47:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4652.301354 secs 2024-04-26T19:47:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5349.316689 secs 2024-04-26T19:47:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4652.301354 secs 2024-04-26T19:47:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5349.316689 secs 2024-04-26T19:47:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4652.301354 secs 2024-04-26T19:47:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:35 smithi189 ceph-mon[32756]: pgmap v3465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:35 smithi156 ceph-mon[32679]: pgmap v3465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:35 smithi092 ceph-mon[29156]: pgmap v3465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:37 smithi189 ceph-mon[32756]: pgmap v3466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:37 smithi156 ceph-mon[32679]: pgmap v3466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:37 smithi092 ceph-mon[29156]: pgmap v3466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5354.316790 secs 2024-04-26T19:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:39 smithi189 ceph-mon[32756]: pgmap v3467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4657.301434 secs 2024-04-26T19:47:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5354.316790 secs 2024-04-26T19:47:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:39 smithi156 ceph-mon[32679]: pgmap v3467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4657.301434 secs 2024-04-26T19:47:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5354.316790 secs 2024-04-26T19:47:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:39 smithi092 ceph-mon[29156]: pgmap v3467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4657.301434 secs 2024-04-26T19:47:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:40 smithi156 ceph-mon[32679]: pgmap v3468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:40 smithi092 ceph-mon[29156]: pgmap v3468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:40 smithi189 ceph-mon[32756]: pgmap v3468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:43 smithi189 ceph-mon[32756]: pgmap v3469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:43 smithi156 ceph-mon[32679]: pgmap v3469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:43 smithi092 ceph-mon[29156]: pgmap v3469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5359.316907 secs 2024-04-26T19:47:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4662.301499 secs 2024-04-26T19:47:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5359.316907 secs 2024-04-26T19:47:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4662.301499 secs 2024-04-26T19:47:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5359.316907 secs 2024-04-26T19:47:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4662.301499 secs 2024-04-26T19:47:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:45 smithi189 ceph-mon[32756]: pgmap v3470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:45 smithi156 ceph-mon[32679]: pgmap v3470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:45 smithi092 ceph-mon[29156]: pgmap v3470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:47 smithi189 ceph-mon[32756]: pgmap v3471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:47 smithi156 ceph-mon[32679]: pgmap v3471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:47 smithi092 ceph-mon[29156]: pgmap v3471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5364.317021 secs 2024-04-26T19:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:49 smithi189 ceph-mon[32756]: pgmap v3472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4667.301615 secs 2024-04-26T19:47:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5364.317021 secs 2024-04-26T19:47:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:49 smithi156 ceph-mon[32679]: pgmap v3472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4667.301615 secs 2024-04-26T19:47:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5364.317021 secs 2024-04-26T19:47:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:49 smithi092 ceph-mon[29156]: pgmap v3472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4667.301615 secs 2024-04-26T19:47:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:51 smithi189 ceph-mon[32756]: pgmap v3473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:51 smithi156 ceph-mon[32679]: pgmap v3473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:51 smithi092 ceph-mon[29156]: pgmap v3473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:53 smithi189 ceph-mon[32756]: pgmap v3474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:53 smithi156 ceph-mon[32679]: pgmap v3474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:53 smithi092 ceph-mon[29156]: pgmap v3474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5369.317138 secs 2024-04-26T19:47:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4672.301730 secs 2024-04-26T19:47:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5369.317138 secs 2024-04-26T19:47:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4672.301730 secs 2024-04-26T19:47:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5369.317138 secs 2024-04-26T19:47:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4672.301730 secs 2024-04-26T19:47:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:55 smithi189 ceph-mon[32756]: pgmap v3475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:55 smithi156 ceph-mon[32679]: pgmap v3475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:55 smithi092 ceph-mon[29156]: pgmap v3475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:47:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:57 smithi189 ceph-mon[32756]: pgmap v3476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:57 smithi156 ceph-mon[32679]: pgmap v3476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:57 smithi092 ceph-mon[29156]: pgmap v3476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5374.317256 secs 2024-04-26T19:47:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:59 smithi189 ceph-mon[32756]: pgmap v3477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:47:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4677.301793 secs 2024-04-26T19:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5374.317256 secs 2024-04-26T19:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:59 smithi156 ceph-mon[32679]: pgmap v3477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:47:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4677.301793 secs 2024-04-26T19:47:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5374.317256 secs 2024-04-26T19:47:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:59 smithi092 ceph-mon[29156]: pgmap v3477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:47:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:47:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4677.301793 secs 2024-04-26T19:48:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:01 smithi189 ceph-mon[32756]: pgmap v3478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:48:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:01 smithi156 ceph-mon[32679]: pgmap v3478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:01 smithi092 ceph-mon[29156]: pgmap v3478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:48:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:02 smithi189 ceph-mon[32756]: pgmap v3479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:48:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:02 smithi189 ceph-mon[32756]: pgmap v3480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:02 smithi156 ceph-mon[32679]: pgmap v3479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:48:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:02 smithi156 ceph-mon[32679]: pgmap v3480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:02 smithi092 ceph-mon[29156]: pgmap v3479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:48:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:02 smithi092 ceph-mon[29156]: pgmap v3480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:04 smithi189 ceph-mon[32756]: pgmap v3481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:48:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5379.317392 secs 2024-04-26T19:48:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4682.301913 secs 2024-04-26T19:48:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:04 smithi156 ceph-mon[32679]: pgmap v3481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:48:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5379.317392 secs 2024-04-26T19:48:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4682.301913 secs 2024-04-26T19:48:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:04 smithi092 ceph-mon[29156]: pgmap v3481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:48:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5379.317392 secs 2024-04-26T19:48:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4682.301913 secs 2024-04-26T19:48:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:06 smithi189 ceph-mon[32756]: pgmap v3482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:06 smithi156 ceph-mon[32679]: pgmap v3482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:06 smithi092 ceph-mon[29156]: pgmap v3482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:08 smithi189 ceph-mon[32756]: pgmap v3483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:08 smithi156 ceph-mon[32679]: pgmap v3483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:08 smithi092 ceph-mon[29156]: pgmap v3483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5384.317506 secs 2024-04-26T19:48:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4687.302029 secs 2024-04-26T19:48:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5384.317506 secs 2024-04-26T19:48:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4687.302029 secs 2024-04-26T19:48:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5384.317506 secs 2024-04-26T19:48:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4687.302029 secs 2024-04-26T19:48:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:10 smithi189 ceph-mon[32756]: pgmap v3484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:10 smithi156 ceph-mon[32679]: pgmap v3484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:10 smithi092 ceph-mon[29156]: pgmap v3484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:48:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:11 smithi092 ceph-mon[29156]: pgmap v3485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:48:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:11 smithi189 ceph-mon[32756]: pgmap v3485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:48:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:11 smithi156 ceph-mon[32679]: pgmap v3485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:48:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:14 smithi189 ceph-mon[32756]: pgmap v3486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5389.317643 secs 2024-04-26T19:48:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:14 smithi156 ceph-mon[32679]: pgmap v3486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5389.317643 secs 2024-04-26T19:48:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:14 smithi092 ceph-mon[29156]: pgmap v3486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5389.317643 secs 2024-04-26T19:48:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:15 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4692.302139 secs 2024-04-26T19:48:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:15 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4692.302139 secs 2024-04-26T19:48:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:15 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4692.302139 secs 2024-04-26T19:48:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:16 smithi189 ceph-mon[32756]: pgmap v3487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:16 smithi156 ceph-mon[32679]: pgmap v3487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:16 smithi092 ceph-mon[29156]: pgmap v3487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:18 smithi189 ceph-mon[32756]: pgmap v3488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:18 smithi156 ceph-mon[32679]: pgmap v3488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:18 smithi092 ceph-mon[29156]: pgmap v3488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5394.317765 secs 2024-04-26T19:48:19.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5394.317765 secs 2024-04-26T19:48:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5394.317765 secs 2024-04-26T19:48:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:20 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4697.302270 secs 2024-04-26T19:48:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:20 smithi189 ceph-mon[32756]: pgmap v3489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:20 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4697.302270 secs 2024-04-26T19:48:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:20 smithi156 ceph-mon[32679]: pgmap v3489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:20 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4697.302270 secs 2024-04-26T19:48:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:20 smithi092 ceph-mon[29156]: pgmap v3489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:22 smithi189 ceph-mon[32756]: pgmap v3490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:22 smithi156 ceph-mon[32679]: pgmap v3490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:22 smithi092 ceph-mon[29156]: pgmap v3490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:24 smithi189 ceph-mon[32756]: pgmap v3491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5399.317914 secs 2024-04-26T19:48:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:24 smithi156 ceph-mon[32679]: pgmap v3491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5399.317914 secs 2024-04-26T19:48:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:24 smithi092 ceph-mon[29156]: pgmap v3491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5399.317914 secs 2024-04-26T19:48:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:25 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4702.302385 secs 2024-04-26T19:48:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:25 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4702.302385 secs 2024-04-26T19:48:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:25 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4702.302385 secs 2024-04-26T19:48:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:26 smithi189 ceph-mon[32756]: pgmap v3492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:26 smithi156 ceph-mon[32679]: pgmap v3492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:26 smithi092 ceph-mon[29156]: pgmap v3492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:28 smithi189 ceph-mon[32756]: pgmap v3493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:28 smithi156 ceph-mon[32679]: pgmap v3493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:28 smithi092 ceph-mon[29156]: pgmap v3493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5404.318026 secs 2024-04-26T19:48:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4707.302474 secs 2024-04-26T19:48:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5404.318026 secs 2024-04-26T19:48:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4707.302474 secs 2024-04-26T19:48:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5404.318026 secs 2024-04-26T19:48:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4707.302474 secs 2024-04-26T19:48:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:30 smithi156 ceph-mon[32679]: pgmap v3494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:30 smithi092 ceph-mon[29156]: pgmap v3494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:30 smithi189 ceph-mon[32756]: pgmap v3494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:32 smithi156 ceph-mon[32679]: pgmap v3495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:32 smithi092 ceph-mon[29156]: pgmap v3495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:32 smithi189 ceph-mon[32756]: pgmap v3495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:34 smithi156 ceph-mon[32679]: pgmap v3496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5409.318146 secs 2024-04-26T19:48:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4712.302595 secs 2024-04-26T19:48:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:34 smithi092 ceph-mon[29156]: pgmap v3496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5409.318146 secs 2024-04-26T19:48:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4712.302595 secs 2024-04-26T19:48:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:34 smithi189 ceph-mon[32756]: pgmap v3496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5409.318146 secs 2024-04-26T19:48:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4712.302595 secs 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80a9000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80a9000 comp rx=0 tx=0).stop 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0b01b0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T19:48:35.996 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T19:48:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.996+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:48:35.997 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:35.997+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c006020 tx=0x7f1ca8089000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T19:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.024+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T19:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.024+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T19:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T19:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=4 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T19:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.024+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T19:48:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.025+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T19:48:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.025+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T19:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:36 smithi156 ceph-mon[32679]: pgmap v3497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:36 smithi092 ceph-mon[29156]: pgmap v3497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:36 smithi189 ceph-mon[32756]: pgmap v3497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.717+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:48:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.717+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006680 con 0x5617fb906f00 2024-04-26T19:48:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.718+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:48:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:48:36.718+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 45 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:48:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:38 smithi156 ceph-mon[32679]: pgmap v3498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:38 smithi092 ceph-mon[29156]: pgmap v3498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:38 smithi189 ceph-mon[32756]: pgmap v3498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5414.318237 secs 2024-04-26T19:48:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4717.302711 secs 2024-04-26T19:48:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5414.318237 secs 2024-04-26T19:48:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4717.302711 secs 2024-04-26T19:48:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5414.318237 secs 2024-04-26T19:48:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4717.302711 secs 2024-04-26T19:48:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:40 smithi156 ceph-mon[32679]: pgmap v3499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:40 smithi092 ceph-mon[29156]: pgmap v3499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:40 smithi189 ceph-mon[32756]: pgmap v3499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:42 smithi156 ceph-mon[32679]: pgmap v3500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:42 smithi092 ceph-mon[29156]: pgmap v3500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:42 smithi189 ceph-mon[32756]: pgmap v3500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:44 smithi156 ceph-mon[32679]: pgmap v3501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5419.318353 secs 2024-04-26T19:48:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4722.302790 secs 2024-04-26T19:48:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:44 smithi092 ceph-mon[29156]: pgmap v3501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5419.318353 secs 2024-04-26T19:48:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4722.302790 secs 2024-04-26T19:48:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:44 smithi189 ceph-mon[32756]: pgmap v3501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5419.318353 secs 2024-04-26T19:48:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4722.302790 secs 2024-04-26T19:48:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:46 smithi156 ceph-mon[32679]: pgmap v3502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:46 smithi092 ceph-mon[29156]: pgmap v3502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:46 smithi189 ceph-mon[32756]: pgmap v3502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:48 smithi156 ceph-mon[32679]: pgmap v3503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:48 smithi092 ceph-mon[29156]: pgmap v3503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:48 smithi189 ceph-mon[32756]: pgmap v3503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5424.318470 secs 2024-04-26T19:48:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4727.302905 secs 2024-04-26T19:48:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5424.318470 secs 2024-04-26T19:48:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4727.302905 secs 2024-04-26T19:48:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5424.318470 secs 2024-04-26T19:48:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4727.302905 secs 2024-04-26T19:48:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:50 smithi156 ceph-mon[32679]: pgmap v3504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:50 smithi092 ceph-mon[29156]: pgmap v3504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:50 smithi189 ceph-mon[32756]: pgmap v3504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:52 smithi092 ceph-mon[29156]: pgmap v3505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:52 smithi189 ceph-mon[32756]: pgmap v3505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:52 smithi156 ceph-mon[32679]: pgmap v3505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:54 smithi092 ceph-mon[29156]: pgmap v3506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5429.318584 secs 2024-04-26T19:48:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4732.303022 secs 2024-04-26T19:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:54 smithi189 ceph-mon[32756]: pgmap v3506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5429.318584 secs 2024-04-26T19:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4732.303022 secs 2024-04-26T19:48:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:54 smithi156 ceph-mon[32679]: pgmap v3506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5429.318584 secs 2024-04-26T19:48:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4732.303022 secs 2024-04-26T19:48:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:56 smithi092 ceph-mon[29156]: pgmap v3507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:56 smithi189 ceph-mon[32756]: pgmap v3507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:56 smithi156 ceph-mon[32679]: pgmap v3507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:48:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:58 smithi092 ceph-mon[29156]: pgmap v3508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:58 smithi189 ceph-mon[32756]: pgmap v3508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:58 smithi156 ceph-mon[32679]: pgmap v3508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:48:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5434.318726 secs 2024-04-26T19:48:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:48:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4737.303157 secs 2024-04-26T19:48:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5434.318726 secs 2024-04-26T19:48:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:48:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4737.303157 secs 2024-04-26T19:48:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5434.318726 secs 2024-04-26T19:48:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:48:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4737.303157 secs 2024-04-26T19:49:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:00 smithi092 ceph-mon[29156]: pgmap v3509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:00 smithi189 ceph-mon[32756]: pgmap v3509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:00 smithi156 ceph-mon[32679]: pgmap v3509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:49:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-mon[29156]: pgmap v3510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:49:02.397+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:49:02.397+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:49:02.397+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:49:02.397+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:02.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:49:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:49:02.397+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:02 smithi189 ceph-mon[32756]: pgmap v3510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:49:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:02 smithi156 ceph-mon[32679]: pgmap v3510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:49:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:49:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:49:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:03 smithi092 ceph-mon[29156]: pgmap v3511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:49:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:03 smithi092 ceph-mon[29156]: pgmap v3512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:49:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:03 smithi189 ceph-mon[32756]: pgmap v3511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:49:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:03 smithi189 ceph-mon[32756]: pgmap v3512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:49:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:03 smithi156 ceph-mon[32679]: pgmap v3511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:49:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:03 smithi156 ceph-mon[32679]: pgmap v3512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:49:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 5439.318865 secs 2024-04-26T19:49:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:04 smithi092 ceph-mon[29156]: slow request 2881.574985 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:49:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4742.303269 secs 2024-04-26T19:49:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 5439.318865 secs 2024-04-26T19:49:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:04 smithi189 ceph-mon[32756]: slow request 2881.574985 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:49:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4742.303269 secs 2024-04-26T19:49:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 5439.318865 secs 2024-04-26T19:49:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:04 smithi156 ceph-mon[32679]: slow request 2881.574985 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:49:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4742.303269 secs 2024-04-26T19:49:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:05 smithi092 ceph-mon[29156]: pgmap v3513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:05 smithi189 ceph-mon[32756]: pgmap v3513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:05 smithi156 ceph-mon[32679]: pgmap v3513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:07 smithi092 ceph-mon[29156]: pgmap v3514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:07 smithi189 ceph-mon[32756]: pgmap v3514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:07 smithi156 ceph-mon[32679]: pgmap v3514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:09 smithi092 ceph-mon[29156]: pgmap v3515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T19:49:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5444.318958 secs 2024-04-26T19:49:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4747.303372 secs 2024-04-26T19:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:09 smithi189 ceph-mon[32756]: pgmap v3515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T19:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5444.318958 secs 2024-04-26T19:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4747.303372 secs 2024-04-26T19:49:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:09 smithi156 ceph-mon[32679]: pgmap v3515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T19:49:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5444.318958 secs 2024-04-26T19:49:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4747.303372 secs 2024-04-26T19:49:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:11 smithi092 ceph-mon[29156]: pgmap v3516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:11 smithi189 ceph-mon[32756]: pgmap v3516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:11 smithi156 ceph-mon[32679]: pgmap v3516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T19:49:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:13 smithi092 ceph-mon[29156]: pgmap v3517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T19:49:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:13 smithi189 ceph-mon[32756]: pgmap v3517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T19:49:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:13 smithi156 ceph-mon[32679]: pgmap v3517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T19:49:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5449.319042 secs 2024-04-26T19:49:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4752.303524 secs 2024-04-26T19:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5449.319042 secs 2024-04-26T19:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4752.303524 secs 2024-04-26T19:49:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5449.319042 secs 2024-04-26T19:49:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4752.303524 secs 2024-04-26T19:49:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:15 smithi092 ceph-mon[29156]: pgmap v3518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:49:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:15 smithi189 ceph-mon[32756]: pgmap v3518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:49:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:15 smithi156 ceph-mon[32679]: pgmap v3518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:49:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:17 smithi189 ceph-mon[32756]: pgmap v3519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:17 smithi156 ceph-mon[32679]: pgmap v3519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:17 smithi092 ceph-mon[29156]: pgmap v3519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:19 smithi092 ceph-mon[29156]: pgmap v3520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5454.319168 secs 2024-04-26T19:49:19.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4757.303647 secs 2024-04-26T19:49:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:19 smithi189 ceph-mon[32756]: pgmap v3520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5454.319168 secs 2024-04-26T19:49:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4757.303647 secs 2024-04-26T19:49:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:19 smithi156 ceph-mon[32679]: pgmap v3520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5454.319168 secs 2024-04-26T19:49:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4757.303647 secs 2024-04-26T19:49:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:21 smithi189 ceph-mon[32756]: pgmap v3521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:21 smithi156 ceph-mon[32679]: pgmap v3521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:49:21.723+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:49:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:49:21.723+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T19:49:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:49:21.723+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:49:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:49:21.723+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 46 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:49:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:21 smithi092 ceph-mon[29156]: pgmap v3521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:23 smithi189 ceph-mon[32756]: pgmap v3522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:23 smithi156 ceph-mon[32679]: pgmap v3522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:23 smithi092 ceph-mon[29156]: pgmap v3522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5459.319269 secs 2024-04-26T19:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4762.303726 secs 2024-04-26T19:49:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5459.319269 secs 2024-04-26T19:49:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4762.303726 secs 2024-04-26T19:49:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5459.319269 secs 2024-04-26T19:49:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4762.303726 secs 2024-04-26T19:49:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:25 smithi189 ceph-mon[32756]: pgmap v3523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:25 smithi156 ceph-mon[32679]: pgmap v3523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:25 smithi092 ceph-mon[29156]: pgmap v3523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:27 smithi189 ceph-mon[32756]: pgmap v3524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:27 smithi156 ceph-mon[32679]: pgmap v3524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:27 smithi092 ceph-mon[29156]: pgmap v3524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:29 smithi189 ceph-mon[32756]: pgmap v3525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5464.319344 secs 2024-04-26T19:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4767.303804 secs 2024-04-26T19:49:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:29 smithi156 ceph-mon[32679]: pgmap v3525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5464.319344 secs 2024-04-26T19:49:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4767.303804 secs 2024-04-26T19:49:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:29 smithi092 ceph-mon[29156]: pgmap v3525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5464.319344 secs 2024-04-26T19:49:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4767.303804 secs 2024-04-26T19:49:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:31 smithi189 ceph-mon[32756]: pgmap v3526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:31 smithi156 ceph-mon[32679]: pgmap v3526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:31 smithi092 ceph-mon[29156]: pgmap v3526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:33 smithi189 ceph-mon[32756]: pgmap v3527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:33 smithi156 ceph-mon[32679]: pgmap v3527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:33 smithi092 ceph-mon[29156]: pgmap v3527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5469.319480 secs 2024-04-26T19:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4772.303869 secs 2024-04-26T19:49:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5469.319480 secs 2024-04-26T19:49:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4772.303869 secs 2024-04-26T19:49:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5469.319480 secs 2024-04-26T19:49:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4772.303869 secs 2024-04-26T19:49:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:35 smithi189 ceph-mon[32756]: pgmap v3528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:35 smithi156 ceph-mon[32679]: pgmap v3528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:35 smithi092 ceph-mon[29156]: pgmap v3528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:37 smithi189 ceph-mon[32756]: pgmap v3529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:37 smithi156 ceph-mon[32679]: pgmap v3529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:37 smithi092 ceph-mon[29156]: pgmap v3529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:39 smithi189 ceph-mon[32756]: pgmap v3530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5474.319600 secs 2024-04-26T19:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4777.303981 secs 2024-04-26T19:49:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:39 smithi156 ceph-mon[32679]: pgmap v3530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5474.319600 secs 2024-04-26T19:49:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4777.303981 secs 2024-04-26T19:49:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:39 smithi092 ceph-mon[29156]: pgmap v3530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5474.319600 secs 2024-04-26T19:49:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4777.303981 secs 2024-04-26T19:49:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:41 smithi189 ceph-mon[32756]: pgmap v3531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:41 smithi156 ceph-mon[32679]: pgmap v3531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:41 smithi092 ceph-mon[29156]: pgmap v3531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:43 smithi189 ceph-mon[32756]: pgmap v3532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:43 smithi156 ceph-mon[32679]: pgmap v3532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:43 smithi092 ceph-mon[29156]: pgmap v3532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5479.319664 secs 2024-04-26T19:49:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4782.304044 secs 2024-04-26T19:49:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5479.319664 secs 2024-04-26T19:49:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4782.304044 secs 2024-04-26T19:49:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5479.319664 secs 2024-04-26T19:49:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4782.304044 secs 2024-04-26T19:49:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:45 smithi189 ceph-mon[32756]: pgmap v3533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:45 smithi156 ceph-mon[32679]: pgmap v3533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:45 smithi092 ceph-mon[29156]: pgmap v3533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:47 smithi189 ceph-mon[32756]: pgmap v3534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:47 smithi156 ceph-mon[32679]: pgmap v3534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:47 smithi092 ceph-mon[29156]: pgmap v3534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:49 smithi189 ceph-mon[32756]: pgmap v3535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5484.319783 secs 2024-04-26T19:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4787.304107 secs 2024-04-26T19:49:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:49 smithi156 ceph-mon[32679]: pgmap v3535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5484.319783 secs 2024-04-26T19:49:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4787.304107 secs 2024-04-26T19:49:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:49 smithi092 ceph-mon[29156]: pgmap v3535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5484.319783 secs 2024-04-26T19:49:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4787.304107 secs 2024-04-26T19:49:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:51 smithi189 ceph-mon[32756]: pgmap v3536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:51 smithi156 ceph-mon[32679]: pgmap v3536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:51 smithi092 ceph-mon[29156]: pgmap v3536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:53 smithi189 ceph-mon[32756]: pgmap v3537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:53 smithi156 ceph-mon[32679]: pgmap v3537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:53 smithi092 ceph-mon[29156]: pgmap v3537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5489.319885 secs 2024-04-26T19:49:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4792.304214 secs 2024-04-26T19:49:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5489.319885 secs 2024-04-26T19:49:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4792.304214 secs 2024-04-26T19:49:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5489.319885 secs 2024-04-26T19:49:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4792.304214 secs 2024-04-26T19:49:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:55 smithi189 ceph-mon[32756]: pgmap v3538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:55 smithi156 ceph-mon[32679]: pgmap v3538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:55 smithi092 ceph-mon[29156]: pgmap v3538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:49:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:57 smithi189 ceph-mon[32756]: pgmap v3539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:57 smithi156 ceph-mon[32679]: pgmap v3539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:57 smithi092 ceph-mon[29156]: pgmap v3539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:59 smithi189 ceph-mon[32756]: pgmap v3540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5494.320001 secs 2024-04-26T19:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:49:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4797.304308 secs 2024-04-26T19:49:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:59 smithi156 ceph-mon[32679]: pgmap v3540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5494.320001 secs 2024-04-26T19:49:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:49:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4797.304308 secs 2024-04-26T19:49:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:59 smithi092 ceph-mon[29156]: pgmap v3540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:49:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5494.320001 secs 2024-04-26T19:49:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:49:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4797.304308 secs 2024-04-26T19:50:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:50:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:50:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T19:50:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:01 smithi189 ceph-mon[32756]: pgmap v3541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:01 smithi156 ceph-mon[32679]: pgmap v3541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:01 smithi092 ceph-mon[29156]: pgmap v3541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:50:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:50:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:50:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:03 smithi189 ceph-mon[32756]: pgmap v3542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:50:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:03 smithi156 ceph-mon[32679]: pgmap v3542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:50:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:03 smithi092 ceph-mon[29156]: pgmap v3542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:50:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:50:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:04 smithi189 ceph-mon[32756]: pgmap v3543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:04 smithi189 ceph-mon[32756]: pgmap v3544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5499.320059 secs 2024-04-26T19:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4802.304360 secs 2024-04-26T19:50:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:04 smithi156 ceph-mon[32679]: pgmap v3543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:50:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:04 smithi156 ceph-mon[32679]: pgmap v3544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5499.320059 secs 2024-04-26T19:50:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4802.304360 secs 2024-04-26T19:50:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:04 smithi092 ceph-mon[29156]: pgmap v3543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:50:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:04 smithi092 ceph-mon[29156]: pgmap v3544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:50:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5499.320059 secs 2024-04-26T19:50:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4802.304360 secs 2024-04-26T19:50:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:06 smithi189 ceph-mon[32756]: pgmap v3545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:06 smithi156 ceph-mon[32679]: pgmap v3545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:06 smithi092 ceph-mon[29156]: pgmap v3545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:08 smithi189 ceph-mon[32756]: pgmap v3546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:08 smithi156 ceph-mon[32679]: pgmap v3546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:08 smithi092 ceph-mon[29156]: pgmap v3546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5504.320177 secs 2024-04-26T19:50:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4807.304424 secs 2024-04-26T19:50:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5504.320177 secs 2024-04-26T19:50:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4807.304424 secs 2024-04-26T19:50:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5504.320177 secs 2024-04-26T19:50:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4807.304424 secs 2024-04-26T19:50:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:10 smithi189 ceph-mon[32756]: pgmap v3547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:10 smithi156 ceph-mon[32679]: pgmap v3547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:10 smithi092 ceph-mon[29156]: pgmap v3547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:12 smithi189 ceph-mon[32756]: pgmap v3548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:12 smithi156 ceph-mon[32679]: pgmap v3548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:12 smithi092 ceph-mon[29156]: pgmap v3548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:14 smithi189 ceph-mon[32756]: pgmap v3549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:50:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5509.320292 secs 2024-04-26T19:50:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4812.304540 secs 2024-04-26T19:50:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:14 smithi156 ceph-mon[32679]: pgmap v3549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:50:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5509.320292 secs 2024-04-26T19:50:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4812.304540 secs 2024-04-26T19:50:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:14 smithi092 ceph-mon[29156]: pgmap v3549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T19:50:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5509.320292 secs 2024-04-26T19:50:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4812.304540 secs 2024-04-26T19:50:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:16 smithi189 ceph-mon[32756]: pgmap v3550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:16 smithi156 ceph-mon[32679]: pgmap v3550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:16 smithi092 ceph-mon[29156]: pgmap v3550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T19:50:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:18 smithi189 ceph-mon[32756]: pgmap v3551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:18 smithi156 ceph-mon[32679]: pgmap v3551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:18 smithi092 ceph-mon[29156]: pgmap v3551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5514.320402 secs 2024-04-26T19:50:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4817.304651 secs 2024-04-26T19:50:19.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5514.320402 secs 2024-04-26T19:50:19.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4817.304651 secs 2024-04-26T19:50:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5514.320402 secs 2024-04-26T19:50:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4817.304651 secs 2024-04-26T19:50:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:20 smithi189 ceph-mon[32756]: pgmap v3552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:20 smithi156 ceph-mon[32679]: pgmap v3552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:20 smithi092 ceph-mon[29156]: pgmap v3552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:22 smithi189 ceph-mon[32756]: pgmap v3553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:22 smithi156 ceph-mon[32679]: pgmap v3553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:22 smithi092 ceph-mon[29156]: pgmap v3553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:24 smithi156 ceph-mon[32679]: pgmap v3554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5519.320537 secs 2024-04-26T19:50:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4822.304739 secs 2024-04-26T19:50:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:24 smithi092 ceph-mon[29156]: pgmap v3554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5519.320537 secs 2024-04-26T19:50:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4822.304739 secs 2024-04-26T19:50:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:24 smithi189 ceph-mon[32756]: pgmap v3554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5519.320537 secs 2024-04-26T19:50:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4822.304739 secs 2024-04-26T19:50:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:26 smithi156 ceph-mon[32679]: pgmap v3555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:26 smithi092 ceph-mon[29156]: pgmap v3555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:26 smithi189 ceph-mon[32756]: pgmap v3555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:28 smithi156 ceph-mon[32679]: pgmap v3556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:28 smithi092 ceph-mon[29156]: pgmap v3556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:28 smithi189 ceph-mon[32756]: pgmap v3556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5524.320670 secs 2024-04-26T19:50:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4827.304813 secs 2024-04-26T19:50:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5524.320670 secs 2024-04-26T19:50:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4827.304813 secs 2024-04-26T19:50:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5524.320670 secs 2024-04-26T19:50:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4827.304813 secs 2024-04-26T19:50:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:30 smithi156 ceph-mon[32679]: pgmap v3557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:30 smithi092 ceph-mon[29156]: pgmap v3557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:30 smithi189 ceph-mon[32756]: pgmap v3557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:31 smithi156 ceph-mon[32679]: pgmap v3558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:31 smithi092 ceph-mon[29156]: pgmap v3558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:31 smithi189 ceph-mon[32756]: pgmap v3558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:33 smithi156 ceph-mon[32679]: pgmap v3559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:33 smithi092 ceph-mon[29156]: pgmap v3559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:33 smithi189 ceph-mon[32756]: pgmap v3559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:34.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5529.320785 secs 2024-04-26T19:50:34.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4832.304896 secs 2024-04-26T19:50:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5529.320785 secs 2024-04-26T19:50:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4832.304896 secs 2024-04-26T19:50:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5529.320785 secs 2024-04-26T19:50:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4832.304896 secs 2024-04-26T19:50:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:35 smithi156 ceph-mon[32679]: pgmap v3560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:35 smithi092 ceph-mon[29156]: pgmap v3560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:35 smithi189 ceph-mon[32756]: pgmap v3560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:37 smithi156 ceph-mon[32679]: pgmap v3561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:37 smithi092 ceph-mon[29156]: pgmap v3561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:37 smithi189 ceph-mon[32756]: pgmap v3561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5534.320913 secs 2024-04-26T19:50:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4837.305038 secs 2024-04-26T19:50:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:39 smithi156 ceph-mon[32679]: pgmap v3562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:39.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5534.320913 secs 2024-04-26T19:50:39.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4837.305038 secs 2024-04-26T19:50:39.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:39 smithi189 ceph-mon[32756]: pgmap v3562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5534.320913 secs 2024-04-26T19:50:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4837.305038 secs 2024-04-26T19:50:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:39 smithi092 ceph-mon[29156]: pgmap v3562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:41 smithi156 ceph-mon[32679]: pgmap v3563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:41 smithi092 ceph-mon[29156]: pgmap v3563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:41 smithi189 ceph-mon[32756]: pgmap v3563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:43 smithi156 ceph-mon[32679]: pgmap v3564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:43 smithi092 ceph-mon[29156]: pgmap v3564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:43 smithi189 ceph-mon[32756]: pgmap v3564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5539.321036 secs 2024-04-26T19:50:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4842.305100 secs 2024-04-26T19:50:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5539.321036 secs 2024-04-26T19:50:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4842.305100 secs 2024-04-26T19:50:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5539.321036 secs 2024-04-26T19:50:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4842.305100 secs 2024-04-26T19:50:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:45 smithi156 ceph-mon[32679]: pgmap v3565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:45 smithi092 ceph-mon[29156]: pgmap v3565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:45 smithi189 ceph-mon[32756]: pgmap v3565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:47 smithi092 ceph-mon[29156]: pgmap v3566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:47 smithi189 ceph-mon[32756]: pgmap v3566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:47 smithi156 ceph-mon[32679]: pgmap v3566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5544.321150 secs 2024-04-26T19:50:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4847.305163 secs 2024-04-26T19:50:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:49 smithi092 ceph-mon[29156]: pgmap v3567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5544.321150 secs 2024-04-26T19:50:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4847.305163 secs 2024-04-26T19:50:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:49 smithi189 ceph-mon[32756]: pgmap v3567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5544.321150 secs 2024-04-26T19:50:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4847.305163 secs 2024-04-26T19:50:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:49 smithi156 ceph-mon[32679]: pgmap v3567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:51 smithi092 ceph-mon[29156]: pgmap v3568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:51 smithi189 ceph-mon[32756]: pgmap v3568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:51 smithi156 ceph-mon[32679]: pgmap v3568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:53 smithi092 ceph-mon[29156]: pgmap v3569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:53 smithi189 ceph-mon[32756]: pgmap v3569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:53 smithi156 ceph-mon[32679]: pgmap v3569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5549.321261 secs 2024-04-26T19:50:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4852.305291 secs 2024-04-26T19:50:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5549.321261 secs 2024-04-26T19:50:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4852.305291 secs 2024-04-26T19:50:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5549.321261 secs 2024-04-26T19:50:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4852.305291 secs 2024-04-26T19:50:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:55 smithi092 ceph-mon[29156]: pgmap v3570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:55 smithi189 ceph-mon[32756]: pgmap v3570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:55 smithi156 ceph-mon[32679]: pgmap v3570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:57 smithi092 ceph-mon[29156]: pgmap v3571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:57 smithi189 ceph-mon[32756]: pgmap v3571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:57 smithi156 ceph-mon[32679]: pgmap v3571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:50:59.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5554.321355 secs 2024-04-26T19:50:59.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4857.305406 secs 2024-04-26T19:50:59.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:50:59 smithi156 ceph-mon[32679]: pgmap v3572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:50:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5554.321355 secs 2024-04-26T19:50:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4857.305406 secs 2024-04-26T19:50:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:50:59 smithi092 ceph-mon[29156]: pgmap v3572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5554.321355 secs 2024-04-26T19:51:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4857.305406 secs 2024-04-26T19:51:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:50:59 smithi189 ceph-mon[32756]: pgmap v3572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:01 smithi092 ceph-mon[29156]: pgmap v3573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:01 smithi189 ceph-mon[32756]: pgmap v3573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:01 smithi156 ceph-mon[32679]: pgmap v3573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:51:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: pgmap v3574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: pgmap v3575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:51:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: pgmap v3576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: pgmap v3574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: pgmap v3575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: pgmap v3576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: pgmap v3574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: pgmap v3575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: pgmap v3576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5559.321427 secs 2024-04-26T19:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4862.305515 secs 2024-04-26T19:51:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5559.321427 secs 2024-04-26T19:51:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4862.305515 secs 2024-04-26T19:51:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5559.321427 secs 2024-04-26T19:51:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4862.305515 secs 2024-04-26T19:51:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:05 smithi092 ceph-mon[29156]: pgmap v3577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:05 smithi189 ceph-mon[32756]: pgmap v3577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:05 smithi156 ceph-mon[32679]: pgmap v3577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:07 smithi092 ceph-mon[29156]: pgmap v3578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:07 smithi189 ceph-mon[32756]: pgmap v3578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:07 smithi156 ceph-mon[32679]: pgmap v3578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:51:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5564.321497 secs 2024-04-26T19:51:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5564.321497 secs 2024-04-26T19:51:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5564.321497 secs 2024-04-26T19:51:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4867.305653 secs 2024-04-26T19:51:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:10 smithi156 ceph-mon[32679]: pgmap v3579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4867.305653 secs 2024-04-26T19:51:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:10 smithi092 ceph-mon[29156]: pgmap v3579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4867.305653 secs 2024-04-26T19:51:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:10 smithi189 ceph-mon[32756]: pgmap v3579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:11 smithi092 ceph-mon[29156]: pgmap v3580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:11 smithi189 ceph-mon[32756]: pgmap v3580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:11 smithi156 ceph-mon[32679]: pgmap v3580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:51:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:13 smithi092 ceph-mon[29156]: pgmap v3581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:51:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:13 smithi189 ceph-mon[32756]: pgmap v3581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:51:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:13 smithi156 ceph-mon[32679]: pgmap v3581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:51:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5569.321638 secs 2024-04-26T19:51:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4872.305769 secs 2024-04-26T19:51:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5569.321638 secs 2024-04-26T19:51:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4872.305769 secs 2024-04-26T19:51:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5569.321638 secs 2024-04-26T19:51:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4872.305769 secs 2024-04-26T19:51:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:15 smithi092 ceph-mon[29156]: pgmap v3582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:15 smithi189 ceph-mon[32756]: pgmap v3582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:15 smithi156 ceph-mon[32679]: pgmap v3582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:17 smithi092 ceph-mon[29156]: pgmap v3583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:17 smithi189 ceph-mon[32756]: pgmap v3583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:17 smithi156 ceph-mon[32679]: pgmap v3583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5574.321773 secs 2024-04-26T19:51:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5574.321773 secs 2024-04-26T19:51:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5574.321773 secs 2024-04-26T19:51:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:20 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4877.305899 secs 2024-04-26T19:51:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:20 smithi156 ceph-mon[32679]: pgmap v3584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:20 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4877.305899 secs 2024-04-26T19:51:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:20 smithi092 ceph-mon[29156]: pgmap v3584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:20 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4877.305899 secs 2024-04-26T19:51:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:20 smithi189 ceph-mon[32756]: pgmap v3584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:21 smithi092 ceph-mon[29156]: pgmap v3585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:21 smithi189 ceph-mon[32756]: pgmap v3585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:21 smithi156 ceph-mon[32679]: pgmap v3585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:23 smithi092 ceph-mon[29156]: pgmap v3586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:23 smithi189 ceph-mon[32756]: pgmap v3586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:23 smithi156 ceph-mon[32679]: pgmap v3586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5579.321906 secs 2024-04-26T19:51:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4882.305966 secs 2024-04-26T19:51:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5579.321906 secs 2024-04-26T19:51:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4882.305966 secs 2024-04-26T19:51:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5579.321906 secs 2024-04-26T19:51:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4882.305966 secs 2024-04-26T19:51:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:25 smithi092 ceph-mon[29156]: pgmap v3587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:25 smithi189 ceph-mon[32756]: pgmap v3587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:25 smithi156 ceph-mon[32679]: pgmap v3587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:27 smithi092 ceph-mon[29156]: pgmap v3588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:27 smithi189 ceph-mon[32756]: pgmap v3588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:27 smithi156 ceph-mon[32679]: pgmap v3588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5584.322013 secs 2024-04-26T19:51:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5584.322013 secs 2024-04-26T19:51:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5584.322013 secs 2024-04-26T19:51:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:30 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4887.306057 secs 2024-04-26T19:51:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:30 smithi156 ceph-mon[32679]: pgmap v3589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:30 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4887.306057 secs 2024-04-26T19:51:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:30 smithi092 ceph-mon[29156]: pgmap v3589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:30 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4887.306057 secs 2024-04-26T19:51:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:30 smithi189 ceph-mon[32756]: pgmap v3589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:31 smithi092 ceph-mon[29156]: pgmap v3590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:31 smithi189 ceph-mon[32756]: pgmap v3590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:31 smithi156 ceph-mon[32679]: pgmap v3590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:33 smithi092 ceph-mon[29156]: pgmap v3591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:33 smithi189 ceph-mon[32756]: pgmap v3591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:33 smithi156 ceph-mon[32679]: pgmap v3591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5589.322077 secs 2024-04-26T19:51:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4892.306181 secs 2024-04-26T19:51:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5589.322077 secs 2024-04-26T19:51:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4892.306181 secs 2024-04-26T19:51:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5589.322077 secs 2024-04-26T19:51:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4892.306181 secs 2024-04-26T19:51:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:35 smithi092 ceph-mon[29156]: pgmap v3592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:35 smithi189 ceph-mon[32756]: pgmap v3592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:35 smithi156 ceph-mon[32679]: pgmap v3592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:51:36.741+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T19:51:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:51:36.741+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:51:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:51:36.741+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:51:36.742 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:51:36.741+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 47 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:51:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:37 smithi092 ceph-mon[29156]: pgmap v3593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:37 smithi189 ceph-mon[32756]: pgmap v3593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:37 smithi156 ceph-mon[32679]: pgmap v3593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5594.322194 secs 2024-04-26T19:51:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5594.322194 secs 2024-04-26T19:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5594.322194 secs 2024-04-26T19:51:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4897.306292 secs 2024-04-26T19:51:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:40 smithi156 ceph-mon[32679]: pgmap v3594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4897.306292 secs 2024-04-26T19:51:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:40 smithi092 ceph-mon[29156]: pgmap v3594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4897.306292 secs 2024-04-26T19:51:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:40 smithi189 ceph-mon[32756]: pgmap v3594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:41 smithi092 ceph-mon[29156]: pgmap v3595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:41 smithi189 ceph-mon[32756]: pgmap v3595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:41 smithi156 ceph-mon[32679]: pgmap v3595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:43 smithi092 ceph-mon[29156]: pgmap v3596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:43 smithi189 ceph-mon[32756]: pgmap v3596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:43 smithi156 ceph-mon[32679]: pgmap v3596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5599.322269 secs 2024-04-26T19:51:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4902.306415 secs 2024-04-26T19:51:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5599.322269 secs 2024-04-26T19:51:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4902.306415 secs 2024-04-26T19:51:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5599.322269 secs 2024-04-26T19:51:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4902.306415 secs 2024-04-26T19:51:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:45 smithi092 ceph-mon[29156]: pgmap v3597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:45 smithi189 ceph-mon[32756]: pgmap v3597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:45 smithi156 ceph-mon[32679]: pgmap v3597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:47 smithi092 ceph-mon[29156]: pgmap v3598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:47 smithi189 ceph-mon[32756]: pgmap v3598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:47 smithi156 ceph-mon[32679]: pgmap v3598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5604.322388 secs 2024-04-26T19:51:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5604.322388 secs 2024-04-26T19:51:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5604.322388 secs 2024-04-26T19:51:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:50 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4907.306523 secs 2024-04-26T19:51:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:50 smithi156 ceph-mon[32679]: pgmap v3599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:50 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4907.306523 secs 2024-04-26T19:51:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:50 smithi092 ceph-mon[29156]: pgmap v3599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:50 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4907.306523 secs 2024-04-26T19:51:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:50 smithi189 ceph-mon[32756]: pgmap v3599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:51 smithi092 ceph-mon[29156]: pgmap v3600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:51 smithi189 ceph-mon[32756]: pgmap v3600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:51 smithi156 ceph-mon[32679]: pgmap v3600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:53 smithi092 ceph-mon[29156]: pgmap v3601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:53 smithi189 ceph-mon[32756]: pgmap v3601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:53 smithi156 ceph-mon[32679]: pgmap v3601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5609.322505 secs 2024-04-26T19:51:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4912.306634 secs 2024-04-26T19:51:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5609.322505 secs 2024-04-26T19:51:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4912.306634 secs 2024-04-26T19:51:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5609.322505 secs 2024-04-26T19:51:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4912.306634 secs 2024-04-26T19:51:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:55 smithi092 ceph-mon[29156]: pgmap v3602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:55 smithi189 ceph-mon[32756]: pgmap v3602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:55 smithi156 ceph-mon[32679]: pgmap v3602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:51:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:57 smithi092 ceph-mon[29156]: pgmap v3603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:57 smithi189 ceph-mon[32756]: pgmap v3603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:57 smithi156 ceph-mon[32679]: pgmap v3603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:51:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:51:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5614.322625 secs 2024-04-26T19:51:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:51:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5614.322625 secs 2024-04-26T19:51:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:51:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5614.322625 secs 2024-04-26T19:52:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:00 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 4917.306706 secs 2024-04-26T19:52:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:00 smithi156 ceph-mon[32679]: pgmap v3604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:00 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 4917.306706 secs 2024-04-26T19:52:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:00 smithi092 ceph-mon[29156]: pgmap v3604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:00 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 4917.306706 secs 2024-04-26T19:52:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:00 smithi189 ceph-mon[32756]: pgmap v3604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:01 smithi092 ceph-mon[29156]: pgmap v3605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:01 smithi189 ceph-mon[32756]: pgmap v3605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:01 smithi156 ceph-mon[32679]: pgmap v3605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:03 smithi092 ceph-mon[29156]: pgmap v3606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:03 smithi189 ceph-mon[32756]: pgmap v3606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:03 smithi156 ceph-mon[32679]: pgmap v3606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5619.322723 secs 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 4922.306816 secs 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: slow request 181.050175 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5619.322723 secs 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 4922.306816 secs 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: slow request 181.050175 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5619.322723 secs 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 4922.306816 secs 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: slow request 181.050175 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:05 smithi092 ceph-mon[29156]: pgmap v3607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:05 smithi189 ceph-mon[32756]: pgmap v3607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:05 smithi156 ceph-mon[32679]: pgmap v3607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:52:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:52:07.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:52:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:52:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:52:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:52:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:52:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: pgmap v3608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: pgmap v3609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:52:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:08 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: pgmap v3608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: pgmap v3609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:52:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:08 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: pgmap v3608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: pgmap v3609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T19:52:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:08 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T19:52:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5624.322863 secs 2024-04-26T19:52:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4927.306934 secs 2024-04-26T19:52:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5624.322863 secs 2024-04-26T19:52:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4927.306934 secs 2024-04-26T19:52:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5624.322863 secs 2024-04-26T19:52:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4927.306934 secs 2024-04-26T19:52:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:10 smithi092 ceph-mon[29156]: pgmap v3610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:10 smithi189 ceph-mon[32756]: pgmap v3610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:10 smithi156 ceph-mon[32679]: pgmap v3610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:12 smithi189 ceph-mon[32756]: pgmap v3611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:12 smithi156 ceph-mon[32679]: pgmap v3611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:12 smithi092 ceph-mon[29156]: pgmap v3611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:14 smithi189 ceph-mon[32756]: pgmap v3612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5629.322986 secs 2024-04-26T19:52:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4932.307064 secs 2024-04-26T19:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:14 smithi156 ceph-mon[32679]: pgmap v3612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5629.322986 secs 2024-04-26T19:52:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4932.307064 secs 2024-04-26T19:52:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:14 smithi092 ceph-mon[29156]: pgmap v3612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5629.322986 secs 2024-04-26T19:52:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4932.307064 secs 2024-04-26T19:52:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:16 smithi189 ceph-mon[32756]: pgmap v3613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:16 smithi156 ceph-mon[32679]: pgmap v3613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:16 smithi092 ceph-mon[29156]: pgmap v3613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T19:52:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:18 smithi189 ceph-mon[32756]: pgmap v3614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:52:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:18 smithi156 ceph-mon[32679]: pgmap v3614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:52:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:18 smithi092 ceph-mon[29156]: pgmap v3614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:52:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5634.323080 secs 2024-04-26T19:52:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4937.307201 secs 2024-04-26T19:52:19.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5634.323080 secs 2024-04-26T19:52:19.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4937.307201 secs 2024-04-26T19:52:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5634.323080 secs 2024-04-26T19:52:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4937.307201 secs 2024-04-26T19:52:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:20 smithi156 ceph-mon[32679]: pgmap v3615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:20 smithi092 ceph-mon[29156]: pgmap v3615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:20 smithi189 ceph-mon[32756]: pgmap v3615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:22 smithi156 ceph-mon[32679]: pgmap v3616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:22 smithi092 ceph-mon[29156]: pgmap v3616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:22 smithi189 ceph-mon[32756]: pgmap v3616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:24 smithi156 ceph-mon[32679]: pgmap v3617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5639.323232 secs 2024-04-26T19:52:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4942.307324 secs 2024-04-26T19:52:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:24 smithi092 ceph-mon[29156]: pgmap v3617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5639.323232 secs 2024-04-26T19:52:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4942.307324 secs 2024-04-26T19:52:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:24 smithi189 ceph-mon[32756]: pgmap v3617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5639.323232 secs 2024-04-26T19:52:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4942.307324 secs 2024-04-26T19:52:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:26 smithi156 ceph-mon[32679]: pgmap v3618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:26 smithi092 ceph-mon[29156]: pgmap v3618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:26 smithi189 ceph-mon[32756]: pgmap v3618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:28 smithi156 ceph-mon[32679]: pgmap v3619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:28 smithi092 ceph-mon[29156]: pgmap v3619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:28 smithi189 ceph-mon[32756]: pgmap v3619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5644.323371 secs 2024-04-26T19:52:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4947.307406 secs 2024-04-26T19:52:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5644.323371 secs 2024-04-26T19:52:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4947.307406 secs 2024-04-26T19:52:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5644.323371 secs 2024-04-26T19:52:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4947.307406 secs 2024-04-26T19:52:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:30 smithi156 ceph-mon[32679]: pgmap v3620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:30 smithi092 ceph-mon[29156]: pgmap v3620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:30 smithi189 ceph-mon[32756]: pgmap v3620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:32 smithi156 ceph-mon[32679]: pgmap v3621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:32 smithi092 ceph-mon[29156]: pgmap v3621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:32 smithi189 ceph-mon[32756]: pgmap v3621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:34 smithi156 ceph-mon[32679]: pgmap v3622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5649.323501 secs 2024-04-26T19:52:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4952.307545 secs 2024-04-26T19:52:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:34 smithi092 ceph-mon[29156]: pgmap v3622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5649.323501 secs 2024-04-26T19:52:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4952.307545 secs 2024-04-26T19:52:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:34 smithi189 ceph-mon[32756]: pgmap v3622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5649.323501 secs 2024-04-26T19:52:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4952.307545 secs 2024-04-26T19:52:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:36 smithi156 ceph-mon[32679]: pgmap v3623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:36 smithi092 ceph-mon[29156]: pgmap v3623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:36 smithi189 ceph-mon[32756]: pgmap v3623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:38 smithi156 ceph-mon[32679]: pgmap v3624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:38 smithi092 ceph-mon[29156]: pgmap v3624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:38 smithi189 ceph-mon[32756]: pgmap v3624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5654.323640 secs 2024-04-26T19:52:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4957.307629 secs 2024-04-26T19:52:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5654.323640 secs 2024-04-26T19:52:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4957.307629 secs 2024-04-26T19:52:39.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5654.323640 secs 2024-04-26T19:52:39.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4957.307629 secs 2024-04-26T19:52:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:40 smithi156 ceph-mon[32679]: pgmap v3625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:40 smithi092 ceph-mon[29156]: pgmap v3625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:40 smithi189 ceph-mon[32756]: pgmap v3625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:41 smithi156 ceph-mon[32679]: pgmap v3626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:41 smithi092 ceph-mon[29156]: pgmap v3626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:41 smithi189 ceph-mon[32756]: pgmap v3626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:43 smithi189 ceph-mon[32756]: pgmap v3627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:43 smithi156 ceph-mon[32679]: pgmap v3627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:43 smithi092 ceph-mon[29156]: pgmap v3627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5659.323759 secs 2024-04-26T19:52:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4962.307692 secs 2024-04-26T19:52:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5659.323759 secs 2024-04-26T19:52:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4962.307692 secs 2024-04-26T19:52:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5659.323759 secs 2024-04-26T19:52:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4962.307692 secs 2024-04-26T19:52:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:46 smithi189 ceph-mon[32756]: pgmap v3628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:46 smithi156 ceph-mon[32679]: pgmap v3628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:46 smithi092 ceph-mon[29156]: pgmap v3628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:48 smithi189 ceph-mon[32756]: pgmap v3629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:48 smithi156 ceph-mon[32679]: pgmap v3629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:48 smithi092 ceph-mon[29156]: pgmap v3629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5664.323879 secs 2024-04-26T19:52:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4967.307766 secs 2024-04-26T19:52:50.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:50 smithi092 ceph-mon[29156]: pgmap v3630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5664.323879 secs 2024-04-26T19:52:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4967.307766 secs 2024-04-26T19:52:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:50 smithi189 ceph-mon[32756]: pgmap v3630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5664.323879 secs 2024-04-26T19:52:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4967.307766 secs 2024-04-26T19:52:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:50 smithi156 ceph-mon[32679]: pgmap v3630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:52.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:52 smithi189 ceph-mon[32756]: pgmap v3631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:52 smithi156 ceph-mon[32679]: pgmap v3631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:52 smithi092 ceph-mon[29156]: pgmap v3631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:54 smithi189 ceph-mon[32756]: pgmap v3632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:54 smithi156 ceph-mon[32679]: pgmap v3632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:54 smithi092 ceph-mon[29156]: pgmap v3632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5669.323996 secs 2024-04-26T19:52:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4972.307886 secs 2024-04-26T19:52:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5669.323996 secs 2024-04-26T19:52:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4972.307886 secs 2024-04-26T19:52:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5669.323996 secs 2024-04-26T19:52:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4972.307886 secs 2024-04-26T19:52:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:56 smithi189 ceph-mon[32756]: pgmap v3633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:56 smithi156 ceph-mon[32679]: pgmap v3633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:56 smithi092 ceph-mon[29156]: pgmap v3633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:52:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:52:58 smithi189 ceph-mon[32756]: pgmap v3634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:52:58 smithi156 ceph-mon[32679]: pgmap v3634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:52:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:52:58 smithi092 ceph-mon[29156]: pgmap v3634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5674.324110 secs 2024-04-26T19:53:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4977.308021 secs 2024-04-26T19:53:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:00 smithi189 ceph-mon[32756]: pgmap v3635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5674.324110 secs 2024-04-26T19:53:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4977.308021 secs 2024-04-26T19:53:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:00 smithi156 ceph-mon[32679]: pgmap v3635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5674.324110 secs 2024-04-26T19:53:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4977.308021 secs 2024-04-26T19:53:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:00 smithi092 ceph-mon[29156]: pgmap v3635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:02 smithi189 ceph-mon[32756]: pgmap v3636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:02 smithi156 ceph-mon[32679]: pgmap v3636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:02 smithi092 ceph-mon[29156]: pgmap v3636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:04 smithi189 ceph-mon[32756]: pgmap v3637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:04 smithi156 ceph-mon[32679]: pgmap v3637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:04 smithi092 ceph-mon[29156]: pgmap v3637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5679.324232 secs 2024-04-26T19:53:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4982.308162 secs 2024-04-26T19:53:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5679.324232 secs 2024-04-26T19:53:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4982.308162 secs 2024-04-26T19:53:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5679.324232 secs 2024-04-26T19:53:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4982.308162 secs 2024-04-26T19:53:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:06 smithi189 ceph-mon[32756]: pgmap v3638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:06 smithi156 ceph-mon[32679]: pgmap v3638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:06 smithi092 ceph-mon[29156]: pgmap v3638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:53:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:08 smithi189 ceph-mon[32756]: pgmap v3639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:53:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:08 smithi156 ceph-mon[32679]: pgmap v3639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:53:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:08 smithi092 ceph-mon[29156]: pgmap v3639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:53:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:53:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:09 smithi189 ceph-mon[32756]: pgmap v3640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:09 smithi189 ceph-mon[32756]: pgmap v3641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:09 smithi156 ceph-mon[32679]: pgmap v3640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:53:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:09 smithi156 ceph-mon[32679]: pgmap v3641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:09 smithi092 ceph-mon[29156]: pgmap v3640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:53:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:09 smithi092 ceph-mon[29156]: pgmap v3641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:53:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5684.324343 secs 2024-04-26T19:53:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4987.308315 secs 2024-04-26T19:53:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5684.324343 secs 2024-04-26T19:53:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4987.308315 secs 2024-04-26T19:53:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5684.324343 secs 2024-04-26T19:53:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4987.308315 secs 2024-04-26T19:53:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:11 smithi189 ceph-mon[32756]: pgmap v3642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:11 smithi156 ceph-mon[32679]: pgmap v3642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:11 smithi092 ceph-mon[29156]: pgmap v3642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:13 smithi189 ceph-mon[32756]: pgmap v3643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:13 smithi156 ceph-mon[32679]: pgmap v3643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:13 smithi092 ceph-mon[29156]: pgmap v3643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5689.324469 secs 2024-04-26T19:53:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4992.308412 secs 2024-04-26T19:53:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:15 smithi189 ceph-mon[32756]: pgmap v3644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5689.324469 secs 2024-04-26T19:53:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4992.308412 secs 2024-04-26T19:53:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:15 smithi156 ceph-mon[32679]: pgmap v3644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5689.324469 secs 2024-04-26T19:53:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4992.308412 secs 2024-04-26T19:53:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:15 smithi092 ceph-mon[29156]: pgmap v3644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:17 smithi189 ceph-mon[32756]: pgmap v3645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:17 smithi156 ceph-mon[32679]: pgmap v3645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:17 smithi092 ceph-mon[29156]: pgmap v3645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:53:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:19 smithi189 ceph-mon[32756]: pgmap v3646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:53:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:19 smithi156 ceph-mon[32679]: pgmap v3646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:53:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:19 smithi092 ceph-mon[29156]: pgmap v3646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:53:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5694.324594 secs 2024-04-26T19:53:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 4997.308521 secs 2024-04-26T19:53:20.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5694.324594 secs 2024-04-26T19:53:20.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 4997.308521 secs 2024-04-26T19:53:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5694.324594 secs 2024-04-26T19:53:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 4997.308521 secs 2024-04-26T19:53:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:21 smithi189 ceph-mon[32756]: pgmap v3647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:21 smithi156 ceph-mon[32679]: pgmap v3647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:21 smithi092 ceph-mon[29156]: pgmap v3647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:23 smithi189 ceph-mon[32756]: pgmap v3648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:23 smithi156 ceph-mon[32679]: pgmap v3648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:23 smithi092 ceph-mon[29156]: pgmap v3648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5699.324713 secs 2024-04-26T19:53:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5002.308584 secs 2024-04-26T19:53:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:25 smithi189 ceph-mon[32756]: pgmap v3649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5699.324713 secs 2024-04-26T19:53:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5002.308584 secs 2024-04-26T19:53:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:25 smithi156 ceph-mon[32679]: pgmap v3649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5699.324713 secs 2024-04-26T19:53:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5002.308584 secs 2024-04-26T19:53:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:25 smithi092 ceph-mon[29156]: pgmap v3649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:27 smithi189 ceph-mon[32756]: pgmap v3650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:27 smithi156 ceph-mon[32679]: pgmap v3650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:27 smithi092 ceph-mon[29156]: pgmap v3650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:29 smithi189 ceph-mon[32756]: pgmap v3651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:29 smithi156 ceph-mon[32679]: pgmap v3651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:29 smithi092 ceph-mon[29156]: pgmap v3651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5704.324847 secs 2024-04-26T19:53:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5007.308721 secs 2024-04-26T19:53:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5704.324847 secs 2024-04-26T19:53:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5007.308721 secs 2024-04-26T19:53:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5704.324847 secs 2024-04-26T19:53:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5007.308721 secs 2024-04-26T19:53:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:31 smithi189 ceph-mon[32756]: pgmap v3652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:31 smithi156 ceph-mon[32679]: pgmap v3652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:31 smithi092 ceph-mon[29156]: pgmap v3652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:33 smithi189 ceph-mon[32756]: pgmap v3653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:33 smithi156 ceph-mon[32679]: pgmap v3653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:33 smithi092 ceph-mon[29156]: pgmap v3653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5709.324903 secs 2024-04-26T19:53:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5709.324903 secs 2024-04-26T19:53:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5709.324903 secs 2024-04-26T19:53:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5012.308858 secs 2024-04-26T19:53:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:35 smithi189 ceph-mon[32756]: pgmap v3654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5012.308858 secs 2024-04-26T19:53:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:35 smithi156 ceph-mon[32679]: pgmap v3654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5012.308858 secs 2024-04-26T19:53:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:35 smithi092 ceph-mon[29156]: pgmap v3654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:37 smithi189 ceph-mon[32756]: pgmap v3655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:37 smithi156 ceph-mon[32679]: pgmap v3655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:37 smithi092 ceph-mon[29156]: pgmap v3655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:39 smithi189 ceph-mon[32756]: pgmap v3656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5714.325028 secs 2024-04-26T19:53:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:39 smithi156 ceph-mon[32679]: pgmap v3656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5714.325028 secs 2024-04-26T19:53:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:39 smithi092 ceph-mon[29156]: pgmap v3656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5714.325028 secs 2024-04-26T19:53:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5017.309025 secs 2024-04-26T19:53:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5017.309025 secs 2024-04-26T19:53:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5017.309025 secs 2024-04-26T19:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:41 smithi092 ceph-mon[29156]: pgmap v3657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:41 smithi189 ceph-mon[32756]: pgmap v3657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:41 smithi156 ceph-mon[32679]: pgmap v3657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:43 smithi189 ceph-mon[32756]: pgmap v3658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:43 smithi156 ceph-mon[32679]: pgmap v3658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:43 smithi092 ceph-mon[29156]: pgmap v3658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5719.325146 secs 2024-04-26T19:53:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5719.325146 secs 2024-04-26T19:53:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5719.325146 secs 2024-04-26T19:53:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5022.309170 secs 2024-04-26T19:53:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:45 smithi156 ceph-mon[32679]: pgmap v3659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5022.309170 secs 2024-04-26T19:53:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:45 smithi092 ceph-mon[29156]: pgmap v3659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5022.309170 secs 2024-04-26T19:53:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:45 smithi189 ceph-mon[32756]: pgmap v3659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:47 smithi156 ceph-mon[32679]: pgmap v3660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:47 smithi092 ceph-mon[29156]: pgmap v3660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:47 smithi189 ceph-mon[32756]: pgmap v3660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:49 smithi156 ceph-mon[32679]: pgmap v3661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5724.325262 secs 2024-04-26T19:53:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:49 smithi092 ceph-mon[29156]: pgmap v3661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5724.325262 secs 2024-04-26T19:53:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:49 smithi189 ceph-mon[32756]: pgmap v3661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5724.325262 secs 2024-04-26T19:53:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5027.309246 secs 2024-04-26T19:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5027.309246 secs 2024-04-26T19:53:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5027.309246 secs 2024-04-26T19:53:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:51 smithi156 ceph-mon[32679]: pgmap v3662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:51 smithi092 ceph-mon[29156]: pgmap v3662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:51 smithi189 ceph-mon[32756]: pgmap v3662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:53 smithi156 ceph-mon[32679]: pgmap v3663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:53 smithi092 ceph-mon[29156]: pgmap v3663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:53 smithi189 ceph-mon[32756]: pgmap v3663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5729.325339 secs 2024-04-26T19:53:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5729.325339 secs 2024-04-26T19:53:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5729.325339 secs 2024-04-26T19:53:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5032.309312 secs 2024-04-26T19:53:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:55 smithi156 ceph-mon[32679]: pgmap v3664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5032.309312 secs 2024-04-26T19:53:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:55 smithi092 ceph-mon[29156]: pgmap v3664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5032.309312 secs 2024-04-26T19:53:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:55 smithi189 ceph-mon[32756]: pgmap v3664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:53:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:57 smithi156 ceph-mon[32679]: pgmap v3665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:57 smithi092 ceph-mon[29156]: pgmap v3665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:57 smithi189 ceph-mon[32756]: pgmap v3665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:59 smithi092 ceph-mon[29156]: pgmap v3666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5734.325435 secs 2024-04-26T19:53:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:53:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5037.309451 secs 2024-04-26T19:53:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:59 smithi189 ceph-mon[32756]: pgmap v3666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5734.325435 secs 2024-04-26T19:53:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:53:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5037.309451 secs 2024-04-26T19:53:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:59 smithi156 ceph-mon[32679]: pgmap v3666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:53:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5734.325435 secs 2024-04-26T19:53:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:53:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5037.309451 secs 2024-04-26T19:54:01.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:01 smithi156 ceph-mon[32679]: pgmap v3667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:01 smithi092 ceph-mon[29156]: pgmap v3667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:01 smithi189 ceph-mon[32756]: pgmap v3667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:54:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:54:02.449+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:54:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:54:02.449+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:54:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:54:02.449+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:54:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:54:02.449+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:54:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:54:02.449+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:54:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:03 smithi092 ceph-mon[29156]: pgmap v3668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:03 smithi189 ceph-mon[32756]: pgmap v3668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:03 smithi156 ceph-mon[32679]: pgmap v3668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5739.325554 secs 2024-04-26T19:54:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5042.309563 secs 2024-04-26T19:54:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5739.325554 secs 2024-04-26T19:54:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5042.309563 secs 2024-04-26T19:54:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5739.325554 secs 2024-04-26T19:54:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5042.309563 secs 2024-04-26T19:54:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:05 smithi092 ceph-mon[29156]: pgmap v3669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:54:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:05 smithi189 ceph-mon[32756]: pgmap v3669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:54:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:05 smithi156 ceph-mon[32679]: pgmap v3669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T19:54:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:07 smithi092 ceph-mon[29156]: pgmap v3670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:07 smithi189 ceph-mon[32756]: pgmap v3670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:07 smithi156 ceph-mon[32679]: pgmap v3670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:54:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: pgmap v3671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5744.325643 secs 2024-04-26T19:54:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5047.309659 secs 2024-04-26T19:54:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: pgmap v3671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5744.325643 secs 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5047.309659 secs 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: pgmap v3671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5744.325643 secs 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5047.309659 secs 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:54:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:54:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:10 smithi092 ceph-mon[29156]: pgmap v3672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T19:54:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:10 smithi092 ceph-mon[29156]: pgmap v3673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-26T19:54:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:10 smithi189 ceph-mon[32756]: pgmap v3672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T19:54:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:10 smithi189 ceph-mon[32756]: pgmap v3673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-26T19:54:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:10 smithi156 ceph-mon[32679]: pgmap v3672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T19:54:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:10 smithi156 ceph-mon[32679]: pgmap v3673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-26T19:54:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:12 smithi092 ceph-mon[29156]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T19:54:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:12 smithi189 ceph-mon[32756]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T19:54:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:12 smithi156 ceph-mon[32679]: pgmap v3674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T19:54:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:14 smithi092 ceph-mon[29156]: pgmap v3675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:54:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5749.325743 secs 2024-04-26T19:54:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5052.309794 secs 2024-04-26T19:54:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:14 smithi189 ceph-mon[32756]: pgmap v3675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:54:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5749.325743 secs 2024-04-26T19:54:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5052.309794 secs 2024-04-26T19:54:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:14 smithi156 ceph-mon[32679]: pgmap v3675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:54:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5749.325743 secs 2024-04-26T19:54:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5052.309794 secs 2024-04-26T19:54:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:16 smithi092 ceph-mon[29156]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:16 smithi189 ceph-mon[32756]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:16 smithi156 ceph-mon[32679]: pgmap v3676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:18 smithi092 ceph-mon[29156]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:18 smithi189 ceph-mon[32756]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:18 smithi156 ceph-mon[32679]: pgmap v3677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:54:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5754.325906 secs 2024-04-26T19:54:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5057.309857 secs 2024-04-26T19:54:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5754.325906 secs 2024-04-26T19:54:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5057.309857 secs 2024-04-26T19:54:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5754.325906 secs 2024-04-26T19:54:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5057.309857 secs 2024-04-26T19:54:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:20 smithi092 ceph-mon[29156]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:54:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:20 smithi189 ceph-mon[32756]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:54:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:20 smithi156 ceph-mon[32679]: pgmap v3678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:54:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:22 smithi092 ceph-mon[29156]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:22 smithi189 ceph-mon[32756]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:22 smithi156 ceph-mon[32679]: pgmap v3679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:24.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:24 smithi156 ceph-mon[32679]: pgmap v3680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:24.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5759.326025 secs 2024-04-26T19:54:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:24 smithi189 ceph-mon[32756]: pgmap v3680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5759.326025 secs 2024-04-26T19:54:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5062.309994 secs 2024-04-26T19:54:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5062.309994 secs 2024-04-26T19:54:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:24 smithi092 ceph-mon[29156]: pgmap v3680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5759.326025 secs 2024-04-26T19:54:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5062.309994 secs 2024-04-26T19:54:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:26 smithi189 ceph-mon[32756]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:26 smithi156 ceph-mon[32679]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:26 smithi092 ceph-mon[29156]: pgmap v3681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:28 smithi189 ceph-mon[32756]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:28 smithi156 ceph-mon[32679]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:28 smithi092 ceph-mon[29156]: pgmap v3682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:29 smithi189 ceph-mon[32756]: 4 slow requests, 2 included below; oldest blocked for > 5764.326146 secs 2024-04-26T19:54:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:29 smithi189 ceph-mon[32756]: slow request 5764.257916 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:54:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:29 smithi189 ceph-mon[32756]: slow request 5764.326145 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:54:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5067.310144 secs 2024-04-26T19:54:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:29 smithi156 ceph-mon[32679]: 4 slow requests, 2 included below; oldest blocked for > 5764.326146 secs 2024-04-26T19:54:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:29 smithi156 ceph-mon[32679]: slow request 5764.257916 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:54:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:29 smithi156 ceph-mon[32679]: slow request 5764.326145 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:54:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5067.310144 secs 2024-04-26T19:54:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:29 smithi092 ceph-mon[29156]: 4 slow requests, 2 included below; oldest blocked for > 5764.326146 secs 2024-04-26T19:54:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:29 smithi092 ceph-mon[29156]: slow request 5764.257916 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T19:54:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:29 smithi092 ceph-mon[29156]: slow request 5764.326145 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T19:54:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5067.310144 secs 2024-04-26T19:54:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:30 smithi189 ceph-mon[32756]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:30 smithi156 ceph-mon[32679]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:30 smithi092 ceph-mon[29156]: pgmap v3683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:54:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:32 smithi189 ceph-mon[32756]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:32 smithi156 ceph-mon[32679]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:32 smithi092 ceph-mon[29156]: pgmap v3684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:54:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:34 smithi189 ceph-mon[32756]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5769.326223 secs 2024-04-26T19:54:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5072.310265 secs 2024-04-26T19:54:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:34 smithi156 ceph-mon[32679]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5769.326223 secs 2024-04-26T19:54:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5072.310265 secs 2024-04-26T19:54:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:34 smithi092 ceph-mon[29156]: pgmap v3685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5769.326223 secs 2024-04-26T19:54:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5072.310265 secs 2024-04-26T19:54:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:36 smithi189 ceph-mon[32756]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:36 smithi156 ceph-mon[32679]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:36 smithi092 ceph-mon[29156]: pgmap v3686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:54:36.765+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:54:36.765 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:54:36.765+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T19:54:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:54:36.765+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:54:36.766 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:54:36.765+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 48 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:54:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:38 smithi189 ceph-mon[32756]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:38 smithi156 ceph-mon[32679]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:38 smithi092 ceph-mon[29156]: pgmap v3687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5774.326339 secs 2024-04-26T19:54:39.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5077.310406 secs 2024-04-26T19:54:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5774.326339 secs 2024-04-26T19:54:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5077.310406 secs 2024-04-26T19:54:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5774.326339 secs 2024-04-26T19:54:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5077.310406 secs 2024-04-26T19:54:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:40 smithi189 ceph-mon[32756]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:40 smithi156 ceph-mon[32679]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:40 smithi092 ceph-mon[29156]: pgmap v3688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:42 smithi189 ceph-mon[32756]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:42 smithi156 ceph-mon[32679]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:42 smithi092 ceph-mon[29156]: pgmap v3689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:44 smithi189 ceph-mon[32756]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5779.326478 secs 2024-04-26T19:54:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5082.310520 secs 2024-04-26T19:54:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:44 smithi156 ceph-mon[32679]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5779.326478 secs 2024-04-26T19:54:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5082.310520 secs 2024-04-26T19:54:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:44 smithi092 ceph-mon[29156]: pgmap v3690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5779.326478 secs 2024-04-26T19:54:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5082.310520 secs 2024-04-26T19:54:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:46 smithi189 ceph-mon[32756]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:46 smithi156 ceph-mon[32679]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:46 smithi092 ceph-mon[29156]: pgmap v3691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:48 smithi189 ceph-mon[32756]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:48 smithi156 ceph-mon[32679]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:48 smithi092 ceph-mon[29156]: pgmap v3692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5784.326611 secs 2024-04-26T19:54:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5087.310600 secs 2024-04-26T19:54:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5784.326611 secs 2024-04-26T19:54:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5087.310600 secs 2024-04-26T19:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5784.326611 secs 2024-04-26T19:54:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5087.310600 secs 2024-04-26T19:54:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:50 smithi189 ceph-mon[32756]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:50.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:50 smithi092 ceph-mon[29156]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:50 smithi156 ceph-mon[32679]: pgmap v3693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:52 smithi189 ceph-mon[32756]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:52 smithi156 ceph-mon[32679]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:52 smithi092 ceph-mon[29156]: pgmap v3694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:54 smithi189 ceph-mon[32756]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:54.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5789.326730 secs 2024-04-26T19:54:54.709 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5092.310674 secs 2024-04-26T19:54:54.709 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:54 smithi156 ceph-mon[32679]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:54.710 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5789.326730 secs 2024-04-26T19:54:54.710 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5092.310674 secs 2024-04-26T19:54:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:54 smithi092 ceph-mon[29156]: pgmap v3695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5789.326730 secs 2024-04-26T19:54:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5092.310674 secs 2024-04-26T19:54:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:56 smithi189 ceph-mon[32756]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:56 smithi156 ceph-mon[32679]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:56 smithi092 ceph-mon[29156]: pgmap v3696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:54:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:58 smithi189 ceph-mon[32756]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:58 smithi156 ceph-mon[32679]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:58 smithi092 ceph-mon[29156]: pgmap v3697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:54:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5794.326874 secs 2024-04-26T19:54:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:54:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5097.310768 secs 2024-04-26T19:54:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5794.326874 secs 2024-04-26T19:54:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:54:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5097.310768 secs 2024-04-26T19:54:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5794.326874 secs 2024-04-26T19:54:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:54:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5097.310768 secs 2024-04-26T19:55:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:00 smithi189 ceph-mon[32756]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:00 smithi156 ceph-mon[32679]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:00 smithi092 ceph-mon[29156]: pgmap v3698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:02 smithi189 ceph-mon[32756]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:02 smithi156 ceph-mon[32679]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:02 smithi092 ceph-mon[29156]: pgmap v3699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:04 smithi189 ceph-mon[32756]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 5799.327024 secs 2024-04-26T19:55:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:04 smithi189 ceph-mon[32756]: slow request 5763.263335 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:55:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 5102.310862 secs 2024-04-26T19:55:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:04 smithi189 ceph-mon[32756]: slow request 361.054221 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:55:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:04 smithi156 ceph-mon[32679]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 5799.327024 secs 2024-04-26T19:55:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:04 smithi156 ceph-mon[32679]: slow request 5763.263335 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:55:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 5102.310862 secs 2024-04-26T19:55:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:04 smithi156 ceph-mon[32679]: slow request 361.054221 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:55:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:04 smithi092 ceph-mon[29156]: pgmap v3700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 5799.327024 secs 2024-04-26T19:55:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:04 smithi092 ceph-mon[29156]: slow request 5763.263335 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T19:55:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 5102.310862 secs 2024-04-26T19:55:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:04 smithi092 ceph-mon[29156]: slow request 361.054221 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T19:55:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:06 smithi189 ceph-mon[32756]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:06 smithi156 ceph-mon[32679]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:06 smithi092 ceph-mon[29156]: pgmap v3701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:08 smithi189 ceph-mon[32756]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:08 smithi156 ceph-mon[32679]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:08 smithi092 ceph-mon[29156]: pgmap v3702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5804.327104 secs 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5107.311005 secs 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5804.327104 secs 2024-04-26T19:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5107.311005 secs 2024-04-26T19:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5804.327104 secs 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5107.311005 secs 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:55:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:55:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:10 smithi189 ceph-mon[32756]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:10 smithi189 ceph-mon[32756]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T19:55:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:10 smithi189 ceph-mon[32756]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:10 smithi156 ceph-mon[32679]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:10 smithi156 ceph-mon[32679]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T19:55:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:10 smithi156 ceph-mon[32679]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:10 smithi092 ceph-mon[29156]: pgmap v3703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:10 smithi092 ceph-mon[29156]: pgmap v3704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-26T19:55:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:10 smithi092 ceph-mon[29156]: pgmap v3705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:12 smithi189 ceph-mon[32756]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:12 smithi156 ceph-mon[32679]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:12 smithi092 ceph-mon[29156]: pgmap v3706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5809.327236 secs 2024-04-26T19:55:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:14 smithi092 ceph-mon[29156]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5112.311141 secs 2024-04-26T19:55:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5809.327236 secs 2024-04-26T19:55:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:14 smithi189 ceph-mon[32756]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5112.311141 secs 2024-04-26T19:55:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5809.327236 secs 2024-04-26T19:55:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:14 smithi156 ceph-mon[32679]: pgmap v3707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5112.311141 secs 2024-04-26T19:55:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:16 smithi189 ceph-mon[32756]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:16 smithi156 ceph-mon[32679]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:16 smithi092 ceph-mon[29156]: pgmap v3708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:55:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:18 smithi189 ceph-mon[32756]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:18 smithi156 ceph-mon[32679]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:18 smithi092 ceph-mon[29156]: pgmap v3709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:55:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5814.327313 secs 2024-04-26T19:55:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5117.311248 secs 2024-04-26T19:55:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5814.327313 secs 2024-04-26T19:55:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5117.311248 secs 2024-04-26T19:55:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5814.327313 secs 2024-04-26T19:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5117.311248 secs 2024-04-26T19:55:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:20 smithi189 ceph-mon[32756]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:55:20.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:20 smithi092 ceph-mon[29156]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:55:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:20 smithi156 ceph-mon[32679]: pgmap v3710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:55:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:22 smithi189 ceph-mon[32756]: pgmap v3711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:22 smithi156 ceph-mon[32679]: pgmap v3711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:22 smithi092 ceph-mon[29156]: pgmap v3711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5819.327447 secs 2024-04-26T19:55:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:24 smithi189 ceph-mon[32756]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5122.311362 secs 2024-04-26T19:55:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5819.327447 secs 2024-04-26T19:55:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:24 smithi156 ceph-mon[32679]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5122.311362 secs 2024-04-26T19:55:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5819.327447 secs 2024-04-26T19:55:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:24 smithi092 ceph-mon[29156]: pgmap v3712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5122.311362 secs 2024-04-26T19:55:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:26 smithi189 ceph-mon[32756]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:26 smithi156 ceph-mon[32679]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:26 smithi092 ceph-mon[29156]: pgmap v3713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:28 smithi189 ceph-mon[32756]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:28 smithi156 ceph-mon[32679]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:28 smithi092 ceph-mon[29156]: pgmap v3714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5824.327564 secs 2024-04-26T19:55:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5127.311473 secs 2024-04-26T19:55:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5824.327564 secs 2024-04-26T19:55:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5127.311473 secs 2024-04-26T19:55:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5824.327564 secs 2024-04-26T19:55:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5127.311473 secs 2024-04-26T19:55:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:30 smithi156 ceph-mon[32679]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:30 smithi092 ceph-mon[29156]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:30 smithi189 ceph-mon[32756]: pgmap v3715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:32 smithi156 ceph-mon[32679]: pgmap v3716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:32 smithi092 ceph-mon[29156]: pgmap v3716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:32 smithi189 ceph-mon[32756]: pgmap v3716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5829.327639 secs 2024-04-26T19:55:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:34 smithi156 ceph-mon[32679]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5132.311594 secs 2024-04-26T19:55:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5829.327639 secs 2024-04-26T19:55:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:34 smithi092 ceph-mon[29156]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5132.311594 secs 2024-04-26T19:55:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5829.327639 secs 2024-04-26T19:55:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:34 smithi189 ceph-mon[32756]: pgmap v3717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5132.311594 secs 2024-04-26T19:55:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:36 smithi156 ceph-mon[32679]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:36 smithi092 ceph-mon[29156]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:36 smithi189 ceph-mon[32756]: pgmap v3718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:38 smithi156 ceph-mon[32679]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:38 smithi092 ceph-mon[29156]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:38 smithi189 ceph-mon[32756]: pgmap v3719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5834.327755 secs 2024-04-26T19:55:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5137.311680 secs 2024-04-26T19:55:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5834.327755 secs 2024-04-26T19:55:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5137.311680 secs 2024-04-26T19:55:39.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5834.327755 secs 2024-04-26T19:55:39.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5137.311680 secs 2024-04-26T19:55:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:40 smithi156 ceph-mon[32679]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:40 smithi092 ceph-mon[29156]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:40 smithi189 ceph-mon[32756]: pgmap v3720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:42 smithi156 ceph-mon[32679]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:42 smithi092 ceph-mon[29156]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:42 smithi189 ceph-mon[32756]: pgmap v3721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5839.327881 secs 2024-04-26T19:55:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:44 smithi156 ceph-mon[32679]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5142.311798 secs 2024-04-26T19:55:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5839.327881 secs 2024-04-26T19:55:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:44 smithi092 ceph-mon[29156]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5142.311798 secs 2024-04-26T19:55:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5839.327881 secs 2024-04-26T19:55:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:44 smithi189 ceph-mon[32756]: pgmap v3722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5142.311798 secs 2024-04-26T19:55:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:46 smithi156 ceph-mon[32679]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:46 smithi092 ceph-mon[29156]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:46 smithi189 ceph-mon[32756]: pgmap v3723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:48 smithi156 ceph-mon[32679]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:48 smithi092 ceph-mon[29156]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:48 smithi189 ceph-mon[32756]: pgmap v3724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5844.327997 secs 2024-04-26T19:55:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5147.311876 secs 2024-04-26T19:55:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5844.327997 secs 2024-04-26T19:55:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5147.311876 secs 2024-04-26T19:55:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5844.327997 secs 2024-04-26T19:55:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5147.311876 secs 2024-04-26T19:55:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:50 smithi092 ceph-mon[29156]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:50 smithi189 ceph-mon[32756]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:50 smithi156 ceph-mon[32679]: pgmap v3725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:52 smithi092 ceph-mon[29156]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:52 smithi189 ceph-mon[32756]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:52 smithi156 ceph-mon[32679]: pgmap v3726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5849.328121 secs 2024-04-26T19:55:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:54 smithi092 ceph-mon[29156]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5152.312001 secs 2024-04-26T19:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5849.328121 secs 2024-04-26T19:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:54 smithi189 ceph-mon[32756]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5152.312001 secs 2024-04-26T19:55:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5849.328121 secs 2024-04-26T19:55:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:54 smithi156 ceph-mon[32679]: pgmap v3727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5152.312001 secs 2024-04-26T19:55:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:56 smithi092 ceph-mon[29156]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:56 smithi189 ceph-mon[32756]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:56 smithi156 ceph-mon[32679]: pgmap v3728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:55:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:58 smithi092 ceph-mon[29156]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:58 smithi189 ceph-mon[32756]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:58 smithi156 ceph-mon[32679]: pgmap v3729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:55:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5854.328227 secs 2024-04-26T19:55:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:55:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5157.312067 secs 2024-04-26T19:55:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5854.328227 secs 2024-04-26T19:55:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:55:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5157.312067 secs 2024-04-26T19:55:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5854.328227 secs 2024-04-26T19:55:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:55:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5157.312067 secs 2024-04-26T19:56:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:00 smithi092 ceph-mon[29156]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:00 smithi189 ceph-mon[32756]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:00 smithi156 ceph-mon[32679]: pgmap v3730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:01.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:01 smithi092 ceph-mon[29156]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:01 smithi189 ceph-mon[32756]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:01 smithi156 ceph-mon[32679]: pgmap v3731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:04.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5859.328345 secs 2024-04-26T19:56:04.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:04 smithi156 ceph-mon[32679]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:04.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5162.312177 secs 2024-04-26T19:56:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5859.328345 secs 2024-04-26T19:56:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:04 smithi189 ceph-mon[32756]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5162.312177 secs 2024-04-26T19:56:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5859.328345 secs 2024-04-26T19:56:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:04 smithi092 ceph-mon[29156]: pgmap v3732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5162.312177 secs 2024-04-26T19:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:06 smithi189 ceph-mon[32756]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:06 smithi156 ceph-mon[32679]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:06 smithi092 ceph-mon[29156]: pgmap v3733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:08 smithi189 ceph-mon[32756]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:08 smithi156 ceph-mon[32679]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:08 smithi092 ceph-mon[29156]: pgmap v3734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5864.328490 secs 2024-04-26T19:56:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5167.312288 secs 2024-04-26T19:56:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5864.328490 secs 2024-04-26T19:56:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5167.312288 secs 2024-04-26T19:56:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5864.328490 secs 2024-04-26T19:56:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5167.312288 secs 2024-04-26T19:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:10 smithi189 ceph-mon[32756]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:10 smithi156 ceph-mon[32679]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:56:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:10 smithi092 ceph-mon[29156]: pgmap v3735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:56:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:56:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:56:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:56:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:11 smithi189 ceph-mon[32756]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:56:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:11 smithi189 ceph-mon[32756]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:11 smithi156 ceph-mon[32679]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:56:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:11 smithi156 ceph-mon[32679]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:11 smithi092 ceph-mon[29156]: pgmap v3736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:56:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:11 smithi092 ceph-mon[29156]: pgmap v3737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:13 smithi189 ceph-mon[32756]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:13 smithi156 ceph-mon[32679]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:13 smithi092 ceph-mon[29156]: pgmap v3738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5869.328638 secs 2024-04-26T19:56:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5172.312390 secs 2024-04-26T19:56:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5869.328638 secs 2024-04-26T19:56:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5172.312390 secs 2024-04-26T19:56:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5869.328638 secs 2024-04-26T19:56:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5172.312390 secs 2024-04-26T19:56:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:15 smithi189 ceph-mon[32756]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:15 smithi156 ceph-mon[32679]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:15 smithi092 ceph-mon[29156]: pgmap v3739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:17 smithi189 ceph-mon[32756]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:17 smithi156 ceph-mon[32679]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:17 smithi092 ceph-mon[29156]: pgmap v3740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:56:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:19 smithi189 ceph-mon[32756]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:56:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5874.328758 secs 2024-04-26T19:56:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5177.312471 secs 2024-04-26T19:56:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:19 smithi156 ceph-mon[32679]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:56:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5874.328758 secs 2024-04-26T19:56:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5177.312471 secs 2024-04-26T19:56:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:19 smithi092 ceph-mon[29156]: pgmap v3741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:56:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5874.328758 secs 2024-04-26T19:56:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5177.312471 secs 2024-04-26T19:56:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:21 smithi189 ceph-mon[32756]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:56:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:21 smithi156 ceph-mon[32679]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:56:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:21 smithi092 ceph-mon[29156]: pgmap v3742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:56:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:23 smithi156 ceph-mon[32679]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:23 smithi092 ceph-mon[29156]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:23 smithi189 ceph-mon[32756]: pgmap v3743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5879.328888 secs 2024-04-26T19:56:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5182.312584 secs 2024-04-26T19:56:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5879.328888 secs 2024-04-26T19:56:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5182.312584 secs 2024-04-26T19:56:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5879.328888 secs 2024-04-26T19:56:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5182.312584 secs 2024-04-26T19:56:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:25 smithi156 ceph-mon[32679]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:25 smithi092 ceph-mon[29156]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:25 smithi189 ceph-mon[32756]: pgmap v3744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:27 smithi156 ceph-mon[32679]: pgmap v3745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:27 smithi092 ceph-mon[29156]: pgmap v3745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:27 smithi189 ceph-mon[32756]: pgmap v3745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:29 smithi156 ceph-mon[32679]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5884.329010 secs 2024-04-26T19:56:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5187.312700 secs 2024-04-26T19:56:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:29 smithi092 ceph-mon[29156]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5884.329010 secs 2024-04-26T19:56:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5187.312700 secs 2024-04-26T19:56:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:29 smithi189 ceph-mon[32756]: pgmap v3746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5884.329010 secs 2024-04-26T19:56:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5187.312700 secs 2024-04-26T19:56:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:31 smithi156 ceph-mon[32679]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:31 smithi092 ceph-mon[29156]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:31 smithi189 ceph-mon[32756]: pgmap v3747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:33 smithi156 ceph-mon[32679]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:33 smithi092 ceph-mon[29156]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:33 smithi189 ceph-mon[32756]: pgmap v3748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5889.329105 secs 2024-04-26T19:56:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5192.312820 secs 2024-04-26T19:56:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5889.329105 secs 2024-04-26T19:56:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5192.312820 secs 2024-04-26T19:56:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5889.329105 secs 2024-04-26T19:56:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5192.312820 secs 2024-04-26T19:56:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:35 smithi156 ceph-mon[32679]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:35 smithi092 ceph-mon[29156]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:35 smithi189 ceph-mon[32756]: pgmap v3749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:37 smithi156 ceph-mon[32679]: pgmap v3750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:37 smithi092 ceph-mon[29156]: pgmap v3750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:37 smithi189 ceph-mon[32756]: pgmap v3750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:39 smithi156 ceph-mon[32679]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5894.329177 secs 2024-04-26T19:56:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5197.312945 secs 2024-04-26T19:56:39.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:39 smithi189 ceph-mon[32756]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:39.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5894.329177 secs 2024-04-26T19:56:39.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5197.312945 secs 2024-04-26T19:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:39 smithi092 ceph-mon[29156]: pgmap v3751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5894.329177 secs 2024-04-26T19:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5197.312945 secs 2024-04-26T19:56:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:41 smithi156 ceph-mon[32679]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:41 smithi092 ceph-mon[29156]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:41 smithi189 ceph-mon[32756]: pgmap v3752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:43 smithi092 ceph-mon[29156]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:43 smithi189 ceph-mon[32756]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:43 smithi156 ceph-mon[32679]: pgmap v3753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5899.329330 secs 2024-04-26T19:56:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5202.313064 secs 2024-04-26T19:56:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5899.329330 secs 2024-04-26T19:56:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5202.313064 secs 2024-04-26T19:56:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5899.329330 secs 2024-04-26T19:56:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5202.313064 secs 2024-04-26T19:56:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:45 smithi092 ceph-mon[29156]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:45 smithi189 ceph-mon[32756]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:45 smithi156 ceph-mon[32679]: pgmap v3754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:47 smithi092 ceph-mon[29156]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:47 smithi189 ceph-mon[32756]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:47 smithi156 ceph-mon[32679]: pgmap v3755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:49 smithi092 ceph-mon[29156]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5904.329482 secs 2024-04-26T19:56:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5207.313210 secs 2024-04-26T19:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:49 smithi189 ceph-mon[32756]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5904.329482 secs 2024-04-26T19:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5207.313210 secs 2024-04-26T19:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:49 smithi156 ceph-mon[32679]: pgmap v3756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5904.329482 secs 2024-04-26T19:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5207.313210 secs 2024-04-26T19:56:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:51 smithi092 ceph-mon[29156]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:51.790 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:51 smithi156 ceph-mon[32679]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:51 smithi189 ceph-mon[32756]: pgmap v3757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:53 smithi092 ceph-mon[29156]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:53 smithi189 ceph-mon[32756]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:53 smithi156 ceph-mon[32679]: pgmap v3758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5909.329611 secs 2024-04-26T19:56:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5212.313328 secs 2024-04-26T19:56:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5909.329611 secs 2024-04-26T19:56:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5212.313328 secs 2024-04-26T19:56:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5909.329611 secs 2024-04-26T19:56:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5212.313328 secs 2024-04-26T19:56:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:55 smithi092 ceph-mon[29156]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:55 smithi189 ceph-mon[32756]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:55 smithi156 ceph-mon[32679]: pgmap v3759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:56:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:57 smithi092 ceph-mon[29156]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:57 smithi189 ceph-mon[32756]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:57 smithi156 ceph-mon[32679]: pgmap v3760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:58 smithi092 ceph-mon[29156]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:58 smithi189 ceph-mon[32756]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:58 smithi156 ceph-mon[32679]: pgmap v3761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:56:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5914.329750 secs 2024-04-26T19:56:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:56:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5217.313391 secs 2024-04-26T19:56:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5914.329750 secs 2024-04-26T19:56:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:56:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5217.313391 secs 2024-04-26T19:56:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5914.329750 secs 2024-04-26T19:56:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:56:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5217.313391 secs 2024-04-26T19:57:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:00 smithi092 ceph-mon[29156]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:00 smithi189 ceph-mon[32756]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:00 smithi156 ceph-mon[32679]: pgmap v3762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:03 smithi189 ceph-mon[32756]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:03 smithi156 ceph-mon[32679]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:03 smithi092 ceph-mon[29156]: pgmap v3763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5919.329870 secs 2024-04-26T19:57:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5222.313500 secs 2024-04-26T19:57:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:05 smithi189 ceph-mon[32756]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5919.329870 secs 2024-04-26T19:57:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5222.313500 secs 2024-04-26T19:57:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:05 smithi156 ceph-mon[32679]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5919.329870 secs 2024-04-26T19:57:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5222.313500 secs 2024-04-26T19:57:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:05 smithi092 ceph-mon[29156]: pgmap v3764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:07 smithi189 ceph-mon[32756]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:07 smithi156 ceph-mon[32679]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:07 smithi092 ceph-mon[29156]: pgmap v3765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:09 smithi156 ceph-mon[32679]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5924.329997 secs 2024-04-26T19:57:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:09 smithi092 ceph-mon[29156]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5924.329997 secs 2024-04-26T19:57:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:09 smithi189 ceph-mon[32756]: pgmap v3766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5924.329997 secs 2024-04-26T19:57:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5227.313611 secs 2024-04-26T19:57:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5227.313611 secs 2024-04-26T19:57:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5227.313611 secs 2024-04-26T19:57:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:11 smithi156 ceph-mon[32679]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:11.447 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:11 smithi092 ceph-mon[29156]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:11.447 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:11 smithi189 ceph-mon[32756]: pgmap v3767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:57:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:13 smithi156 ceph-mon[32679]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:13 smithi092 ceph-mon[29156]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:13 smithi189 ceph-mon[32756]: pgmap v3768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:14.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5929.330092 secs 2024-04-26T19:57:14.428 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5929.330092 secs 2024-04-26T19:57:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5929.330092 secs 2024-04-26T19:57:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5232.313680 secs 2024-04-26T19:57:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5232.313680 secs 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5232.313680 secs 2024-04-26T19:57:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: pgmap v3769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:57:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:16 smithi156 ceph-mon[32679]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:57:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:16 smithi156 ceph-mon[32679]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:16 smithi092 ceph-mon[29156]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:57:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:16 smithi092 ceph-mon[29156]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:16 smithi189 ceph-mon[32756]: pgmap v3770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T19:57:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:16 smithi189 ceph-mon[32756]: pgmap v3771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:18 smithi156 ceph-mon[32679]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:18 smithi092 ceph-mon[29156]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:18 smithi189 ceph-mon[32756]: pgmap v3772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:19.267 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5934.330218 secs 2024-04-26T19:57:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5934.330218 secs 2024-04-26T19:57:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5934.330218 secs 2024-04-26T19:57:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5237.313770 secs 2024-04-26T19:57:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:20 smithi156 ceph-mon[32679]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5237.313770 secs 2024-04-26T19:57:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:20 smithi092 ceph-mon[29156]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5237.313770 secs 2024-04-26T19:57:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:20 smithi189 ceph-mon[32756]: pgmap v3773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:22 smithi156 ceph-mon[32679]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:22 smithi092 ceph-mon[29156]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:22 smithi189 ceph-mon[32756]: pgmap v3774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:57:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:24 smithi156 ceph-mon[32679]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5939.330341 secs 2024-04-26T19:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:24 smithi092 ceph-mon[29156]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5939.330341 secs 2024-04-26T19:57:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:24 smithi189 ceph-mon[32756]: pgmap v3775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:57:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5939.330341 secs 2024-04-26T19:57:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5242.313951 secs 2024-04-26T19:57:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5242.313951 secs 2024-04-26T19:57:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5242.313951 secs 2024-04-26T19:57:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:26 smithi156 ceph-mon[32679]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:57:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:26 smithi092 ceph-mon[29156]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:57:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:26 smithi189 ceph-mon[32756]: pgmap v3776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:57:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:28 smithi092 ceph-mon[29156]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:28 smithi189 ceph-mon[32756]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:28 smithi156 ceph-mon[32679]: pgmap v3777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5944.330471 secs 2024-04-26T19:57:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5944.330471 secs 2024-04-26T19:57:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5944.330471 secs 2024-04-26T19:57:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5247.314099 secs 2024-04-26T19:57:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:30 smithi092 ceph-mon[29156]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5247.314099 secs 2024-04-26T19:57:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:30 smithi189 ceph-mon[32756]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5247.314099 secs 2024-04-26T19:57:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:30 smithi156 ceph-mon[32679]: pgmap v3778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:32 smithi092 ceph-mon[29156]: pgmap v3779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:32 smithi189 ceph-mon[32756]: pgmap v3779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:32 smithi156 ceph-mon[32679]: pgmap v3779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:34 smithi092 ceph-mon[29156]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5949.330620 secs 2024-04-26T19:57:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:34 smithi189 ceph-mon[32756]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5949.330620 secs 2024-04-26T19:57:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:34 smithi156 ceph-mon[32679]: pgmap v3780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5949.330620 secs 2024-04-26T19:57:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5252.314228 secs 2024-04-26T19:57:35.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5252.314228 secs 2024-04-26T19:57:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5252.314228 secs 2024-04-26T19:57:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:36 smithi092 ceph-mon[29156]: pgmap v3781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:36 smithi189 ceph-mon[32756]: pgmap v3781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:36 smithi156 ceph-mon[32679]: pgmap v3781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 49 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T19:57:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T19:57:36.790+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 50 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T19:57:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:38 smithi092 ceph-mon[29156]: pgmap v3782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:38 smithi189 ceph-mon[32756]: pgmap v3782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:38 smithi156 ceph-mon[32679]: pgmap v3782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5954.330732 secs 2024-04-26T19:57:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5257.314339 secs 2024-04-26T19:57:39.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5954.330732 secs 2024-04-26T19:57:39.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5257.314339 secs 2024-04-26T19:57:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5954.330732 secs 2024-04-26T19:57:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5257.314339 secs 2024-04-26T19:57:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:40 smithi092 ceph-mon[29156]: pgmap v3783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:40 smithi189 ceph-mon[32756]: pgmap v3783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:40 smithi156 ceph-mon[32679]: pgmap v3783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:42 smithi092 ceph-mon[29156]: pgmap v3784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:42 smithi189 ceph-mon[32756]: pgmap v3784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:42 smithi156 ceph-mon[32679]: pgmap v3784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:44 smithi092 ceph-mon[29156]: pgmap v3785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5959.330864 secs 2024-04-26T19:57:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5262.314460 secs 2024-04-26T19:57:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:44 smithi189 ceph-mon[32756]: pgmap v3785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5959.330864 secs 2024-04-26T19:57:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5262.314460 secs 2024-04-26T19:57:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:44 smithi156 ceph-mon[32679]: pgmap v3785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5959.330864 secs 2024-04-26T19:57:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5262.314460 secs 2024-04-26T19:57:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:46 smithi092 ceph-mon[29156]: pgmap v3786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:46 smithi189 ceph-mon[32756]: pgmap v3786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:46 smithi156 ceph-mon[32679]: pgmap v3786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:48 smithi092 ceph-mon[29156]: pgmap v3787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:48 smithi189 ceph-mon[32756]: pgmap v3787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:48 smithi156 ceph-mon[32679]: pgmap v3787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5964.330945 secs 2024-04-26T19:57:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5267.314553 secs 2024-04-26T19:57:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5964.330945 secs 2024-04-26T19:57:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5267.314553 secs 2024-04-26T19:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5964.330945 secs 2024-04-26T19:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5267.314553 secs 2024-04-26T19:57:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:50 smithi092 ceph-mon[29156]: pgmap v3788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:50 smithi189 ceph-mon[32756]: pgmap v3788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:50 smithi156 ceph-mon[32679]: pgmap v3788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:52 smithi092 ceph-mon[29156]: pgmap v3789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:52 smithi189 ceph-mon[32756]: pgmap v3789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:52 smithi156 ceph-mon[32679]: pgmap v3789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:54 smithi189 ceph-mon[32756]: pgmap v3790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5969.331042 secs 2024-04-26T19:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5272.314624 secs 2024-04-26T19:57:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:54 smithi156 ceph-mon[32679]: pgmap v3790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5969.331042 secs 2024-04-26T19:57:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5272.314624 secs 2024-04-26T19:57:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:54 smithi092 ceph-mon[29156]: pgmap v3790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5969.331042 secs 2024-04-26T19:57:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5272.314624 secs 2024-04-26T19:57:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:56 smithi189 ceph-mon[32756]: pgmap v3791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:56 smithi156 ceph-mon[32679]: pgmap v3791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:56 smithi092 ceph-mon[29156]: pgmap v3791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:57:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:58 smithi189 ceph-mon[32756]: pgmap v3792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:58 smithi156 ceph-mon[32679]: pgmap v3792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:58 smithi092 ceph-mon[29156]: pgmap v3792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:57:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5974.331164 secs 2024-04-26T19:57:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:57:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5277.314697 secs 2024-04-26T19:57:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5974.331164 secs 2024-04-26T19:57:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:57:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5277.314697 secs 2024-04-26T19:57:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5974.331164 secs 2024-04-26T19:57:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:57:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5277.314697 secs 2024-04-26T19:58:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:00 smithi189 ceph-mon[32756]: pgmap v3793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:00 smithi156 ceph-mon[32679]: pgmap v3793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:00 smithi092 ceph-mon[29156]: pgmap v3793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:02 smithi189 ceph-mon[32756]: pgmap v3794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:02 smithi156 ceph-mon[32679]: pgmap v3794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:02 smithi092 ceph-mon[29156]: pgmap v3794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:04 smithi189 ceph-mon[32756]: pgmap v3795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5979.331280 secs 2024-04-26T19:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5282.314785 secs 2024-04-26T19:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:04 smithi156 ceph-mon[32679]: pgmap v3795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5979.331280 secs 2024-04-26T19:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5282.314785 secs 2024-04-26T19:58:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:04 smithi092 ceph-mon[29156]: pgmap v3795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5979.331280 secs 2024-04-26T19:58:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5282.314785 secs 2024-04-26T19:58:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:06 smithi189 ceph-mon[32756]: pgmap v3796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:06 smithi156 ceph-mon[32679]: pgmap v3796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:06 smithi092 ceph-mon[29156]: pgmap v3796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:08 smithi189 ceph-mon[32756]: pgmap v3797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:08 smithi156 ceph-mon[32679]: pgmap v3797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:08 smithi092 ceph-mon[29156]: pgmap v3797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5984.331404 secs 2024-04-26T19:58:09.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5287.314875 secs 2024-04-26T19:58:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5984.331404 secs 2024-04-26T19:58:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5287.314875 secs 2024-04-26T19:58:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5984.331404 secs 2024-04-26T19:58:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5287.314875 secs 2024-04-26T19:58:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:10 smithi189 ceph-mon[32756]: pgmap v3798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:10 smithi156 ceph-mon[32679]: pgmap v3798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:10 smithi092 ceph-mon[29156]: pgmap v3798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:12 smithi189 ceph-mon[32756]: pgmap v3799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:12 smithi156 ceph-mon[32679]: pgmap v3799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:12 smithi092 ceph-mon[29156]: pgmap v3799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:14 smithi189 ceph-mon[32756]: pgmap v3800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5989.331504 secs 2024-04-26T19:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5292.315006 secs 2024-04-26T19:58:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:14 smithi156 ceph-mon[32679]: pgmap v3800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5989.331504 secs 2024-04-26T19:58:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5292.315006 secs 2024-04-26T19:58:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:14 smithi092 ceph-mon[29156]: pgmap v3800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5989.331504 secs 2024-04-26T19:58:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5292.315006 secs 2024-04-26T19:58:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:58:16.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:16 smithi189 ceph-mon[32756]: pgmap v3801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:16 smithi156 ceph-mon[32679]: pgmap v3801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:16 smithi092 ceph-mon[29156]: pgmap v3801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:18 smithi189 ceph-mon[32756]: pgmap v3802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:18 smithi156 ceph-mon[32679]: pgmap v3802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:18 smithi092 ceph-mon[29156]: pgmap v3802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5994.331597 secs 2024-04-26T19:58:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5297.315120 secs 2024-04-26T19:58:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: pgmap v3803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: pgmap v3804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: pgmap v3805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5994.331597 secs 2024-04-26T19:58:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5297.315120 secs 2024-04-26T19:58:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: pgmap v3803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: pgmap v3804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T19:58:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: pgmap v3805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5994.331597 secs 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5297.315120 secs 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: pgmap v3803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: pgmap v3804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: pgmap v3805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:58:22.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:21 smithi092 ceph-mon[29156]: pgmap v3806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:21 smithi156 ceph-mon[32679]: pgmap v3806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:21 smithi189 ceph-mon[32756]: pgmap v3806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:23 smithi156 ceph-mon[32679]: pgmap v3807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:23 smithi092 ceph-mon[29156]: pgmap v3807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:23 smithi189 ceph-mon[32756]: pgmap v3807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T19:58:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 5999.331723 secs 2024-04-26T19:58:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5302.315257 secs 2024-04-26T19:58:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 5999.331723 secs 2024-04-26T19:58:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5302.315257 secs 2024-04-26T19:58:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 5999.331723 secs 2024-04-26T19:58:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5302.315257 secs 2024-04-26T19:58:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:25 smithi156 ceph-mon[32679]: pgmap v3808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:25 smithi092 ceph-mon[29156]: pgmap v3808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:25 smithi189 ceph-mon[32756]: pgmap v3808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:27 smithi156 ceph-mon[32679]: pgmap v3809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:27 smithi092 ceph-mon[29156]: pgmap v3809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:27 smithi189 ceph-mon[32756]: pgmap v3809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:58:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6004.331867 secs 2024-04-26T19:58:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5307.315373 secs 2024-04-26T19:58:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:29 smithi156 ceph-mon[32679]: pgmap v3810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:58:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6004.331867 secs 2024-04-26T19:58:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5307.315373 secs 2024-04-26T19:58:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:29 smithi092 ceph-mon[29156]: pgmap v3810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:58:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6004.331867 secs 2024-04-26T19:58:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5307.315373 secs 2024-04-26T19:58:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:29 smithi189 ceph-mon[32756]: pgmap v3810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:58:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:31 smithi156 ceph-mon[32679]: pgmap v3811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:31 smithi092 ceph-mon[29156]: pgmap v3811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:31 smithi189 ceph-mon[32756]: pgmap v3811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:33 smithi156 ceph-mon[32679]: pgmap v3812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:33 smithi092 ceph-mon[29156]: pgmap v3812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:33 smithi189 ceph-mon[32756]: pgmap v3812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6009.331971 secs 2024-04-26T19:58:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5312.315455 secs 2024-04-26T19:58:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6009.331971 secs 2024-04-26T19:58:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5312.315455 secs 2024-04-26T19:58:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6009.331971 secs 2024-04-26T19:58:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5312.315455 secs 2024-04-26T19:58:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:35 smithi156 ceph-mon[32679]: pgmap v3813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:35 smithi092 ceph-mon[29156]: pgmap v3813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:35 smithi189 ceph-mon[32756]: pgmap v3813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:37 smithi156 ceph-mon[32679]: pgmap v3814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:37 smithi092 ceph-mon[29156]: pgmap v3814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:37 smithi189 ceph-mon[32756]: pgmap v3814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6014.332092 secs 2024-04-26T19:58:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5317.315549 secs 2024-04-26T19:58:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:39 smithi156 ceph-mon[32679]: pgmap v3815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:40.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6014.332092 secs 2024-04-26T19:58:40.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5317.315549 secs 2024-04-26T19:58:40.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:39 smithi189 ceph-mon[32756]: pgmap v3815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6014.332092 secs 2024-04-26T19:58:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5317.315549 secs 2024-04-26T19:58:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:39 smithi092 ceph-mon[29156]: pgmap v3815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:41 smithi156 ceph-mon[32679]: pgmap v3816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:41 smithi092 ceph-mon[29156]: pgmap v3816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:41 smithi189 ceph-mon[32756]: pgmap v3816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:43 smithi156 ceph-mon[32679]: pgmap v3817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:43 smithi092 ceph-mon[29156]: pgmap v3817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:43 smithi189 ceph-mon[32756]: pgmap v3817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6019.332214 secs 2024-04-26T19:58:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5322.315678 secs 2024-04-26T19:58:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6019.332214 secs 2024-04-26T19:58:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5322.315678 secs 2024-04-26T19:58:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6019.332214 secs 2024-04-26T19:58:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5322.315678 secs 2024-04-26T19:58:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:45 smithi092 ceph-mon[29156]: pgmap v3818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:45 smithi189 ceph-mon[32756]: pgmap v3818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:45 smithi156 ceph-mon[32679]: pgmap v3818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:47 smithi092 ceph-mon[29156]: pgmap v3819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:47 smithi189 ceph-mon[32756]: pgmap v3819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:47 smithi156 ceph-mon[32679]: pgmap v3819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6024.332301 secs 2024-04-26T19:58:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5327.315757 secs 2024-04-26T19:58:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:49 smithi092 ceph-mon[29156]: pgmap v3820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6024.332301 secs 2024-04-26T19:58:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5327.315757 secs 2024-04-26T19:58:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:49 smithi189 ceph-mon[32756]: pgmap v3820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6024.332301 secs 2024-04-26T19:58:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5327.315757 secs 2024-04-26T19:58:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:49 smithi156 ceph-mon[32679]: pgmap v3820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:51 smithi092 ceph-mon[29156]: pgmap v3821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:51 smithi189 ceph-mon[32756]: pgmap v3821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:51 smithi156 ceph-mon[32679]: pgmap v3821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:53 smithi092 ceph-mon[29156]: pgmap v3822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:53 smithi189 ceph-mon[32756]: pgmap v3822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:53 smithi156 ceph-mon[32679]: pgmap v3822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6029.332430 secs 2024-04-26T19:58:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5332.315830 secs 2024-04-26T19:58:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6029.332430 secs 2024-04-26T19:58:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5332.315830 secs 2024-04-26T19:58:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6029.332430 secs 2024-04-26T19:58:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5332.315830 secs 2024-04-26T19:58:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:55 smithi092 ceph-mon[29156]: pgmap v3823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:55 smithi189 ceph-mon[32756]: pgmap v3823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:55 smithi156 ceph-mon[32679]: pgmap v3823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:58:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:57 smithi092 ceph-mon[29156]: pgmap v3824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:57 smithi189 ceph-mon[32756]: pgmap v3824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:58:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:57 smithi156 ceph-mon[32679]: pgmap v3824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6034.332552 secs 2024-04-26T19:59:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5337.315956 secs 2024-04-26T19:59:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:58:59 smithi092 ceph-mon[29156]: pgmap v3825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6034.332552 secs 2024-04-26T19:59:00.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5337.315956 secs 2024-04-26T19:59:00.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:58:59 smithi189 ceph-mon[32756]: pgmap v3825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:00.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6034.332552 secs 2024-04-26T19:59:00.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5337.315956 secs 2024-04-26T19:59:00.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:58:59 smithi156 ceph-mon[32679]: pgmap v3825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:01 smithi092 ceph-mon[29156]: pgmap v3826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:01 smithi189 ceph-mon[32756]: pgmap v3826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:01 smithi156 ceph-mon[32679]: pgmap v3826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:03 smithi092 ceph-mon[29156]: pgmap v3827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:03 smithi189 ceph-mon[32756]: pgmap v3827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:03 smithi156 ceph-mon[32679]: pgmap v3827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6039.332684 secs 2024-04-26T19:59:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5342.316033 secs 2024-04-26T19:59:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6039.332684 secs 2024-04-26T19:59:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5342.316033 secs 2024-04-26T19:59:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6039.332684 secs 2024-04-26T19:59:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5342.316033 secs 2024-04-26T19:59:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:05 smithi092 ceph-mon[29156]: pgmap v3828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:06.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:05 smithi156 ceph-mon[32679]: pgmap v3828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:05 smithi189 ceph-mon[32756]: pgmap v3828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:07 smithi092 ceph-mon[29156]: pgmap v3829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:07 smithi189 ceph-mon[32756]: pgmap v3829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:07 smithi156 ceph-mon[32679]: pgmap v3829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T19:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6044.332766 secs 2024-04-26T19:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5347.316144 secs 2024-04-26T19:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:09 smithi092 ceph-mon[29156]: pgmap v3830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6044.332766 secs 2024-04-26T19:59:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5347.316144 secs 2024-04-26T19:59:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:09 smithi189 ceph-mon[32756]: pgmap v3830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6044.332766 secs 2024-04-26T19:59:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5347.316144 secs 2024-04-26T19:59:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:09 smithi156 ceph-mon[32679]: pgmap v3830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T19:59:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:11 smithi092 ceph-mon[29156]: pgmap v3831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:11 smithi189 ceph-mon[32756]: pgmap v3831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:11 smithi156 ceph-mon[32679]: pgmap v3831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:13 smithi092 ceph-mon[29156]: pgmap v3832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:13 smithi189 ceph-mon[32756]: pgmap v3832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:13 smithi156 ceph-mon[32679]: pgmap v3832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6049.332883 secs 2024-04-26T19:59:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5352.316273 secs 2024-04-26T19:59:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6049.332883 secs 2024-04-26T19:59:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5352.316273 secs 2024-04-26T19:59:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6049.332883 secs 2024-04-26T19:59:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5352.316273 secs 2024-04-26T19:59:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:15 smithi189 ceph-mon[32756]: pgmap v3833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:15 smithi156 ceph-mon[32679]: pgmap v3833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:15 smithi092 ceph-mon[29156]: pgmap v3833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:18 smithi189 ceph-mon[32756]: pgmap v3834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:18 smithi156 ceph-mon[32679]: pgmap v3834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:18 smithi092 ceph-mon[29156]: pgmap v3834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6054.333013 secs 2024-04-26T19:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5357.316397 secs 2024-04-26T19:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: pgmap v3835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6054.333013 secs 2024-04-26T19:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5357.316397 secs 2024-04-26T19:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: pgmap v3835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:59:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6054.333013 secs 2024-04-26T19:59:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5357.316397 secs 2024-04-26T19:59:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: pgmap v3835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T19:59:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T19:59:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T19:59:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T19:59:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:21 smithi189 ceph-mon[32756]: pgmap v3836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:59:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:21 smithi189 ceph-mon[32756]: pgmap v3837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:21 smithi156 ceph-mon[32679]: pgmap v3836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:59:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:21 smithi156 ceph-mon[32679]: pgmap v3837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:21 smithi092 ceph-mon[29156]: pgmap v3836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T19:59:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:21 smithi092 ceph-mon[29156]: pgmap v3837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:23.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:23 smithi092 ceph-mon[29156]: pgmap v3838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:23 smithi189 ceph-mon[32756]: pgmap v3838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:23 smithi156 ceph-mon[32679]: pgmap v3838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6059.333127 secs 2024-04-26T19:59:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5362.316475 secs 2024-04-26T19:59:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:25 smithi189 ceph-mon[32756]: pgmap v3839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6059.333127 secs 2024-04-26T19:59:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5362.316475 secs 2024-04-26T19:59:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:25 smithi156 ceph-mon[32679]: pgmap v3839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6059.333127 secs 2024-04-26T19:59:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5362.316475 secs 2024-04-26T19:59:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:25 smithi092 ceph-mon[29156]: pgmap v3839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:27 smithi189 ceph-mon[32756]: pgmap v3840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:27 smithi156 ceph-mon[32679]: pgmap v3840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:27 smithi092 ceph-mon[29156]: pgmap v3840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T19:59:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:29 smithi189 ceph-mon[32756]: pgmap v3841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:59:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:29 smithi156 ceph-mon[32679]: pgmap v3841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:59:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:29 smithi092 ceph-mon[29156]: pgmap v3841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T19:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6064.333257 secs 2024-04-26T19:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5367.316592 secs 2024-04-26T19:59:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6064.333257 secs 2024-04-26T19:59:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5367.316592 secs 2024-04-26T19:59:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6064.333257 secs 2024-04-26T19:59:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5367.316592 secs 2024-04-26T19:59:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:31 smithi189 ceph-mon[32756]: pgmap v3842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:59:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:31 smithi156 ceph-mon[32679]: pgmap v3842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:59:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:31 smithi092 ceph-mon[29156]: pgmap v3842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T19:59:32.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:59:32.551+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:32.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:59:32.551+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:32.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:59:32.551+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:32.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:59:32.551+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:32.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 19:59:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T19:59:32.551+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T19:59:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:33 smithi189 ceph-mon[32756]: pgmap v3843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:33 smithi156 ceph-mon[32679]: pgmap v3843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:33 smithi092 ceph-mon[29156]: pgmap v3843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6069.333322 secs 2024-04-26T19:59:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5372.316650 secs 2024-04-26T19:59:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:35 smithi189 ceph-mon[32756]: pgmap v3844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6069.333322 secs 2024-04-26T19:59:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5372.316650 secs 2024-04-26T19:59:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:35 smithi156 ceph-mon[32679]: pgmap v3844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6069.333322 secs 2024-04-26T19:59:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5372.316650 secs 2024-04-26T19:59:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:35 smithi092 ceph-mon[29156]: pgmap v3844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:37 smithi189 ceph-mon[32756]: pgmap v3845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:37 smithi156 ceph-mon[32679]: pgmap v3845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:37 smithi092 ceph-mon[29156]: pgmap v3845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:39 smithi189 ceph-mon[32756]: pgmap v3846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:39 smithi156 ceph-mon[32679]: pgmap v3846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:39 smithi092 ceph-mon[29156]: pgmap v3846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6074.333467 secs 2024-04-26T19:59:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5377.316714 secs 2024-04-26T19:59:40.304 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6074.333467 secs 2024-04-26T19:59:40.304 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5377.316714 secs 2024-04-26T19:59:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6074.333467 secs 2024-04-26T19:59:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5377.316714 secs 2024-04-26T19:59:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:41 smithi189 ceph-mon[32756]: pgmap v3847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:41 smithi156 ceph-mon[32679]: pgmap v3847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:41 smithi092 ceph-mon[29156]: pgmap v3847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:43 smithi189 ceph-mon[32756]: pgmap v3848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:43 smithi156 ceph-mon[32679]: pgmap v3848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:43 smithi092 ceph-mon[29156]: pgmap v3848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T19:59:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6079.333583 secs 2024-04-26T19:59:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5382.316858 secs 2024-04-26T19:59:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:45 smithi189 ceph-mon[32756]: pgmap v3849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6079.333583 secs 2024-04-26T19:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5382.316858 secs 2024-04-26T19:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:45 smithi156 ceph-mon[32679]: pgmap v3849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6079.333583 secs 2024-04-26T19:59:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5382.316858 secs 2024-04-26T19:59:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:45 smithi092 ceph-mon[29156]: pgmap v3849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T19:59:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:47 smithi189 ceph-mon[32756]: pgmap v3850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:47 smithi156 ceph-mon[32679]: pgmap v3850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:47 smithi092 ceph-mon[29156]: pgmap v3850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:49 smithi189 ceph-mon[32756]: pgmap v3851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:49 smithi156 ceph-mon[32679]: pgmap v3851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:49 smithi092 ceph-mon[29156]: pgmap v3851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6084.333680 secs 2024-04-26T19:59:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5387.316920 secs 2024-04-26T19:59:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6084.333680 secs 2024-04-26T19:59:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5387.316920 secs 2024-04-26T19:59:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6084.333680 secs 2024-04-26T19:59:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5387.316920 secs 2024-04-26T19:59:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:51 smithi189 ceph-mon[32756]: pgmap v3852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:51 smithi156 ceph-mon[32679]: pgmap v3852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:51 smithi092 ceph-mon[29156]: pgmap v3852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:53 smithi189 ceph-mon[32756]: pgmap v3853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:53 smithi156 ceph-mon[32679]: pgmap v3853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:53 smithi092 ceph-mon[29156]: pgmap v3853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6089.333831 secs 2024-04-26T19:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5392.317025 secs 2024-04-26T19:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:55 smithi189 ceph-mon[32756]: pgmap v3854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6089.333831 secs 2024-04-26T19:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5392.317025 secs 2024-04-26T19:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:55 smithi156 ceph-mon[32679]: pgmap v3854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6089.333831 secs 2024-04-26T19:59:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5392.317025 secs 2024-04-26T19:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:55 smithi092 ceph-mon[29156]: pgmap v3854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T19:59:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:57 smithi189 ceph-mon[32756]: pgmap v3855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:57 smithi156 ceph-mon[32679]: pgmap v3855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:57 smithi092 ceph-mon[29156]: pgmap v3855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 19:59:59 smithi189 ceph-mon[32756]: pgmap v3856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 19:59:59 smithi156 ceph-mon[32679]: pgmap v3856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T19:59:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 19:59:59 smithi092 ceph-mon[29156]: pgmap v3856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6094.333975 secs 2024-04-26T20:00:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5397.317135 secs 2024-04-26T20:00:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6094.333975 secs 2024-04-26T20:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5397.317135 secs 2024-04-26T20:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:00:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6094.333975 secs 2024-04-26T20:00:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5397.317135 secs 2024-04-26T20:00:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:00:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:01 smithi189 ceph-mon[32756]: pgmap v3857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:01 smithi156 ceph-mon[32679]: pgmap v3857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:01 smithi092 ceph-mon[29156]: pgmap v3857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:03 smithi189 ceph-mon[32756]: pgmap v3858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:03 smithi156 ceph-mon[32679]: pgmap v3858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:03 smithi092 ceph-mon[29156]: pgmap v3858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6099.334056 secs 2024-04-26T20:00:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5402.317256 secs 2024-04-26T20:00:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:05 smithi189 ceph-mon[32756]: pgmap v3859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6099.334056 secs 2024-04-26T20:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5402.317256 secs 2024-04-26T20:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:05 smithi156 ceph-mon[32679]: pgmap v3859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6099.334056 secs 2024-04-26T20:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5402.317256 secs 2024-04-26T20:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:05 smithi092 ceph-mon[29156]: pgmap v3859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:07 smithi189 ceph-mon[32756]: pgmap v3860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:07 smithi156 ceph-mon[32679]: pgmap v3860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:07 smithi092 ceph-mon[29156]: pgmap v3860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:09 smithi156 ceph-mon[32679]: pgmap v3861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:09 smithi092 ceph-mon[29156]: pgmap v3861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:09 smithi189 ceph-mon[32756]: pgmap v3861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6104.334173 secs 2024-04-26T20:00:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5407.317377 secs 2024-04-26T20:00:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6104.334173 secs 2024-04-26T20:00:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5407.317377 secs 2024-04-26T20:00:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6104.334173 secs 2024-04-26T20:00:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5407.317377 secs 2024-04-26T20:00:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:11 smithi156 ceph-mon[32679]: pgmap v3862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:11 smithi092 ceph-mon[29156]: pgmap v3862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:11 smithi189 ceph-mon[32756]: pgmap v3862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:13 smithi156 ceph-mon[32679]: pgmap v3863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:13 smithi092 ceph-mon[29156]: pgmap v3863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:13 smithi189 ceph-mon[32756]: pgmap v3863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:00:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6109.334302 secs 2024-04-26T20:00:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5412.317459 secs 2024-04-26T20:00:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:15 smithi156 ceph-mon[32679]: pgmap v3864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6109.334302 secs 2024-04-26T20:00:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5412.317459 secs 2024-04-26T20:00:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:15 smithi092 ceph-mon[29156]: pgmap v3864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6109.334302 secs 2024-04-26T20:00:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5412.317459 secs 2024-04-26T20:00:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:15 smithi189 ceph-mon[32756]: pgmap v3864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:00:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:17 smithi156 ceph-mon[32679]: pgmap v3865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:17 smithi092 ceph-mon[29156]: pgmap v3865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:17 smithi189 ceph-mon[32756]: pgmap v3865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:19 smithi156 ceph-mon[32679]: pgmap v3866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:19 smithi092 ceph-mon[29156]: pgmap v3866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:19 smithi189 ceph-mon[32756]: pgmap v3866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6114.334413 secs 2024-04-26T20:00:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5417.317572 secs 2024-04-26T20:00:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6114.334413 secs 2024-04-26T20:00:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5417.317572 secs 2024-04-26T20:00:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6114.334413 secs 2024-04-26T20:00:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5417.317572 secs 2024-04-26T20:00:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:00:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: pgmap v3867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: pgmap v3868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:00:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: pgmap v3869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:00:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: pgmap v3867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: pgmap v3868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:00:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: pgmap v3869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:00:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: pgmap v3867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: pgmap v3868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: pgmap v3869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:00:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:22 smithi189 ceph-mon[32756]: pgmap v3870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:22 smithi156 ceph-mon[32679]: pgmap v3870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:22 smithi092 ceph-mon[29156]: pgmap v3870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6119.334535 secs 2024-04-26T20:00:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6119.334535 secs 2024-04-26T20:00:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6119.334535 secs 2024-04-26T20:00:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5422.317632 secs 2024-04-26T20:00:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:25 smithi092 ceph-mon[29156]: pgmap v3871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5422.317632 secs 2024-04-26T20:00:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:25 smithi189 ceph-mon[32756]: pgmap v3871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5422.317632 secs 2024-04-26T20:00:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:25 smithi156 ceph-mon[32679]: pgmap v3871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:26 smithi189 ceph-mon[32756]: pgmap v3872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:26 smithi156 ceph-mon[32679]: pgmap v3872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:26 smithi092 ceph-mon[29156]: pgmap v3872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:00:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:28 smithi189 ceph-mon[32756]: pgmap v3873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:28 smithi156 ceph-mon[32679]: pgmap v3873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:28 smithi092 ceph-mon[29156]: pgmap v3873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:00:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6124.334651 secs 2024-04-26T20:00:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5427.317754 secs 2024-04-26T20:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6124.334651 secs 2024-04-26T20:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5427.317754 secs 2024-04-26T20:00:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6124.334651 secs 2024-04-26T20:00:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5427.317754 secs 2024-04-26T20:00:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:30 smithi189 ceph-mon[32756]: pgmap v3874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:00:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:30 smithi156 ceph-mon[32679]: pgmap v3874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:00:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:30 smithi092 ceph-mon[29156]: pgmap v3874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:00:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:32 smithi189 ceph-mon[32756]: pgmap v3875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:32 smithi156 ceph-mon[32679]: pgmap v3875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:32 smithi092 ceph-mon[29156]: pgmap v3875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6129.334772 secs 2024-04-26T20:00:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6129.334772 secs 2024-04-26T20:00:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6129.334772 secs 2024-04-26T20:00:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5432.317832 secs 2024-04-26T20:00:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:35 smithi092 ceph-mon[29156]: pgmap v3876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5432.317832 secs 2024-04-26T20:00:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:35 smithi189 ceph-mon[32756]: pgmap v3876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5432.317832 secs 2024-04-26T20:00:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:35 smithi156 ceph-mon[32679]: pgmap v3876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:00:36.815+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:00:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:00:36.815+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:00:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:00:36.815+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:00:36.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:00:36.815+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 51 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:00:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:36 smithi189 ceph-mon[32756]: pgmap v3877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:36 smithi156 ceph-mon[32679]: pgmap v3877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:36 smithi092 ceph-mon[29156]: pgmap v3877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:38 smithi189 ceph-mon[32756]: pgmap v3878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:38 smithi156 ceph-mon[32679]: pgmap v3878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:38 smithi092 ceph-mon[29156]: pgmap v3878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6134.334886 secs 2024-04-26T20:00:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5437.317955 secs 2024-04-26T20:00:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6134.334886 secs 2024-04-26T20:00:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5437.317955 secs 2024-04-26T20:00:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6134.334886 secs 2024-04-26T20:00:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5437.317955 secs 2024-04-26T20:00:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:40 smithi189 ceph-mon[32756]: pgmap v3879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:40 smithi156 ceph-mon[32679]: pgmap v3879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:40 smithi092 ceph-mon[29156]: pgmap v3879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:42 smithi189 ceph-mon[32756]: pgmap v3880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:42 smithi156 ceph-mon[32679]: pgmap v3880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:42 smithi092 ceph-mon[29156]: pgmap v3880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6139.335004 secs 2024-04-26T20:00:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6139.335004 secs 2024-04-26T20:00:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6139.335004 secs 2024-04-26T20:00:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5442.318086 secs 2024-04-26T20:00:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:45 smithi092 ceph-mon[29156]: pgmap v3881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5442.318086 secs 2024-04-26T20:00:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:45 smithi189 ceph-mon[32756]: pgmap v3881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5442.318086 secs 2024-04-26T20:00:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:45 smithi156 ceph-mon[32679]: pgmap v3881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:46 smithi189 ceph-mon[32756]: pgmap v3882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:46 smithi156 ceph-mon[32679]: pgmap v3882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:46 smithi092 ceph-mon[29156]: pgmap v3882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6144.335119 secs 2024-04-26T20:00:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5447.318241 secs 2024-04-26T20:00:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:49 smithi189 ceph-mon[32756]: pgmap v3883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6144.335119 secs 2024-04-26T20:00:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5447.318241 secs 2024-04-26T20:00:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:49 smithi156 ceph-mon[32679]: pgmap v3883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6144.335119 secs 2024-04-26T20:00:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5447.318241 secs 2024-04-26T20:00:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:49 smithi092 ceph-mon[29156]: pgmap v3883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:51 smithi189 ceph-mon[32756]: pgmap v3884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:51 smithi156 ceph-mon[32679]: pgmap v3884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:51 smithi092 ceph-mon[29156]: pgmap v3884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:53 smithi189 ceph-mon[32756]: pgmap v3885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:53 smithi156 ceph-mon[32679]: pgmap v3885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:53 smithi092 ceph-mon[29156]: pgmap v3885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6149.335184 secs 2024-04-26T20:00:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5452.318392 secs 2024-04-26T20:00:54.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6149.335184 secs 2024-04-26T20:00:54.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5452.318392 secs 2024-04-26T20:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6149.335184 secs 2024-04-26T20:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5452.318392 secs 2024-04-26T20:00:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:55 smithi189 ceph-mon[32756]: pgmap v3886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:55 smithi156 ceph-mon[32679]: pgmap v3886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:55 smithi092 ceph-mon[29156]: pgmap v3886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:00:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:57 smithi189 ceph-mon[32756]: pgmap v3887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:57 smithi156 ceph-mon[32679]: pgmap v3887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:57 smithi092 ceph-mon[29156]: pgmap v3887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6154.335279 secs 2024-04-26T20:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5457.318499 secs 2024-04-26T20:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:00:59 smithi189 ceph-mon[32756]: pgmap v3888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6154.335279 secs 2024-04-26T20:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5457.318499 secs 2024-04-26T20:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:00:59 smithi156 ceph-mon[32679]: pgmap v3888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6154.335279 secs 2024-04-26T20:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5457.318499 secs 2024-04-26T20:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:00:59 smithi092 ceph-mon[29156]: pgmap v3888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:01 smithi189 ceph-mon[32756]: pgmap v3889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:01 smithi156 ceph-mon[32679]: pgmap v3889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:01.949 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:01 smithi092 ceph-mon[29156]: pgmap v3889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:03 smithi189 ceph-mon[32756]: pgmap v3890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:03 smithi156 ceph-mon[32679]: pgmap v3890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:03 smithi092 ceph-mon[29156]: pgmap v3890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6159.335404 secs 2024-04-26T20:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 5462.318562 secs 2024-04-26T20:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:04 smithi189 ceph-mon[32756]: slow request 721.061921 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:01:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6159.335404 secs 2024-04-26T20:01:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 5462.318562 secs 2024-04-26T20:01:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:04 smithi156 ceph-mon[32679]: slow request 721.061921 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6159.335404 secs 2024-04-26T20:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 5462.318562 secs 2024-04-26T20:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:04 smithi092 ceph-mon[29156]: slow request 721.061921 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:01:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:05 smithi189 ceph-mon[32756]: pgmap v3891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:05 smithi156 ceph-mon[32679]: pgmap v3891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:05 smithi092 ceph-mon[29156]: pgmap v3891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:07 smithi189 ceph-mon[32756]: pgmap v3892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:07 smithi156 ceph-mon[32679]: pgmap v3892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:07 smithi092 ceph-mon[29156]: pgmap v3892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6164.335465 secs 2024-04-26T20:01:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5467.318707 secs 2024-04-26T20:01:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:09 smithi189 ceph-mon[32756]: pgmap v3893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6164.335465 secs 2024-04-26T20:01:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5467.318707 secs 2024-04-26T20:01:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:09 smithi156 ceph-mon[32679]: pgmap v3893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6164.335465 secs 2024-04-26T20:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5467.318707 secs 2024-04-26T20:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:09 smithi092 ceph-mon[29156]: pgmap v3893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:11 smithi189 ceph-mon[32756]: pgmap v3894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:11 smithi156 ceph-mon[32679]: pgmap v3894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:11 smithi092 ceph-mon[29156]: pgmap v3894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:13 smithi189 ceph-mon[32756]: pgmap v3895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:13 smithi156 ceph-mon[32679]: pgmap v3895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:13 smithi092 ceph-mon[29156]: pgmap v3895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6169.335589 secs 2024-04-26T20:01:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5472.318837 secs 2024-04-26T20:01:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6169.335589 secs 2024-04-26T20:01:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5472.318837 secs 2024-04-26T20:01:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6169.335589 secs 2024-04-26T20:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5472.318837 secs 2024-04-26T20:01:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:15 smithi189 ceph-mon[32756]: pgmap v3896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:15 smithi156 ceph-mon[32679]: pgmap v3896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:15 smithi092 ceph-mon[29156]: pgmap v3896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:17 smithi189 ceph-mon[32756]: pgmap v3897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:17 smithi156 ceph-mon[32679]: pgmap v3897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:17 smithi092 ceph-mon[29156]: pgmap v3897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6174.335722 secs 2024-04-26T20:01:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5477.318901 secs 2024-04-26T20:01:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:19 smithi189 ceph-mon[32756]: pgmap v3898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6174.335722 secs 2024-04-26T20:01:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5477.318901 secs 2024-04-26T20:01:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:19 smithi156 ceph-mon[32679]: pgmap v3898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6174.335722 secs 2024-04-26T20:01:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5477.318901 secs 2024-04-26T20:01:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:19 smithi092 ceph-mon[29156]: pgmap v3898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:01:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:21 smithi189 ceph-mon[32756]: pgmap v3899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:21 smithi189 ceph-mon[32756]: pgmap v3900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:01:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:21 smithi156 ceph-mon[32679]: pgmap v3899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:21 smithi156 ceph-mon[32679]: pgmap v3900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:01:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:21 smithi092 ceph-mon[29156]: pgmap v3899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:01:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:01:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:21 smithi092 ceph-mon[29156]: pgmap v3900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:01:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6179.335846 secs 2024-04-26T20:01:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:24 smithi189 ceph-mon[32756]: pgmap v3901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5482.319027 secs 2024-04-26T20:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6179.335846 secs 2024-04-26T20:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:24 smithi156 ceph-mon[32679]: pgmap v3901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5482.319027 secs 2024-04-26T20:01:24.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6179.335846 secs 2024-04-26T20:01:24.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:24 smithi092 ceph-mon[29156]: pgmap v3901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:24.697 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5482.319027 secs 2024-04-26T20:01:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:26 smithi189 ceph-mon[32756]: pgmap v3902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:26 smithi156 ceph-mon[32679]: pgmap v3902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:26 smithi092 ceph-mon[29156]: pgmap v3902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:28 smithi189 ceph-mon[32756]: pgmap v3903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:28 smithi156 ceph-mon[32679]: pgmap v3903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:28 smithi092 ceph-mon[29156]: pgmap v3903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6184.335926 secs 2024-04-26T20:01:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5487.319151 secs 2024-04-26T20:01:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6184.335926 secs 2024-04-26T20:01:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5487.319151 secs 2024-04-26T20:01:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6184.335926 secs 2024-04-26T20:01:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5487.319151 secs 2024-04-26T20:01:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:30 smithi189 ceph-mon[32756]: pgmap v3904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:01:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:30 smithi156 ceph-mon[32679]: pgmap v3904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:01:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:30 smithi092 ceph-mon[29156]: pgmap v3904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:01:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:32 smithi189 ceph-mon[32756]: pgmap v3905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:32 smithi156 ceph-mon[32679]: pgmap v3905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:32 smithi092 ceph-mon[29156]: pgmap v3905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:01:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6189.336038 secs 2024-04-26T20:01:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:34 smithi189 ceph-mon[32756]: pgmap v3906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5492.319278 secs 2024-04-26T20:01:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6189.336038 secs 2024-04-26T20:01:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:34 smithi156 ceph-mon[32679]: pgmap v3906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5492.319278 secs 2024-04-26T20:01:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6189.336038 secs 2024-04-26T20:01:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:34 smithi092 ceph-mon[29156]: pgmap v3906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5492.319278 secs 2024-04-26T20:01:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:36 smithi189 ceph-mon[32756]: pgmap v3907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:36 smithi156 ceph-mon[32679]: pgmap v3907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:36 smithi092 ceph-mon[29156]: pgmap v3907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:38 smithi189 ceph-mon[32756]: pgmap v3908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:38 smithi156 ceph-mon[32679]: pgmap v3908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:38 smithi092 ceph-mon[29156]: pgmap v3908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6194.336150 secs 2024-04-26T20:01:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5497.319374 secs 2024-04-26T20:01:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6194.336150 secs 2024-04-26T20:01:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5497.319374 secs 2024-04-26T20:01:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6194.336150 secs 2024-04-26T20:01:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5497.319374 secs 2024-04-26T20:01:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:40 smithi189 ceph-mon[32756]: pgmap v3909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:40 smithi156 ceph-mon[32679]: pgmap v3909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:40 smithi092 ceph-mon[29156]: pgmap v3909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:42 smithi189 ceph-mon[32756]: pgmap v3910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:42 smithi156 ceph-mon[32679]: pgmap v3910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:42 smithi092 ceph-mon[29156]: pgmap v3910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6199.336274 secs 2024-04-26T20:01:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:44 smithi189 ceph-mon[32756]: pgmap v3911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5502.319450 secs 2024-04-26T20:01:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6199.336274 secs 2024-04-26T20:01:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:44 smithi156 ceph-mon[32679]: pgmap v3911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5502.319450 secs 2024-04-26T20:01:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6199.336274 secs 2024-04-26T20:01:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:44 smithi092 ceph-mon[29156]: pgmap v3911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5502.319450 secs 2024-04-26T20:01:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:46 smithi189 ceph-mon[32756]: pgmap v3912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:46 smithi156 ceph-mon[32679]: pgmap v3912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:46 smithi092 ceph-mon[29156]: pgmap v3912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:48 smithi189 ceph-mon[32756]: pgmap v3913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:48 smithi156 ceph-mon[32679]: pgmap v3913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:48 smithi092 ceph-mon[29156]: pgmap v3913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6204.336408 secs 2024-04-26T20:01:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5507.319582 secs 2024-04-26T20:01:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6204.336408 secs 2024-04-26T20:01:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5507.319582 secs 2024-04-26T20:01:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6204.336408 secs 2024-04-26T20:01:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5507.319582 secs 2024-04-26T20:01:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:50 smithi189 ceph-mon[32756]: pgmap v3914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:50 smithi156 ceph-mon[32679]: pgmap v3914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:50 smithi092 ceph-mon[29156]: pgmap v3914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:52 smithi156 ceph-mon[32679]: pgmap v3915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:52 smithi092 ceph-mon[29156]: pgmap v3915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:52 smithi189 ceph-mon[32756]: pgmap v3915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6209.336522 secs 2024-04-26T20:01:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:54 smithi156 ceph-mon[32679]: pgmap v3916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5512.319730 secs 2024-04-26T20:01:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6209.336522 secs 2024-04-26T20:01:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:54 smithi092 ceph-mon[29156]: pgmap v3916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5512.319730 secs 2024-04-26T20:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6209.336522 secs 2024-04-26T20:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:54 smithi189 ceph-mon[32756]: pgmap v3916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5512.319730 secs 2024-04-26T20:01:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:56 smithi156 ceph-mon[32679]: pgmap v3917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:56 smithi092 ceph-mon[29156]: pgmap v3917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:56 smithi189 ceph-mon[32756]: pgmap v3917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:01:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:58 smithi156 ceph-mon[32679]: pgmap v3918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:58 smithi092 ceph-mon[29156]: pgmap v3918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:58 smithi189 ceph-mon[32756]: pgmap v3918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:01:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6214.336656 secs 2024-04-26T20:01:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:01:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5517.319793 secs 2024-04-26T20:01:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6214.336656 secs 2024-04-26T20:01:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:01:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5517.319793 secs 2024-04-26T20:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6214.336656 secs 2024-04-26T20:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:01:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5517.319793 secs 2024-04-26T20:02:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:00 smithi156 ceph-mon[32679]: pgmap v3919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:00 smithi092 ceph-mon[29156]: pgmap v3919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:00 smithi189 ceph-mon[32756]: pgmap v3919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:02 smithi156 ceph-mon[32679]: pgmap v3920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:02 smithi092 ceph-mon[29156]: pgmap v3920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:02 smithi189 ceph-mon[32756]: pgmap v3920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6219.336780 secs 2024-04-26T20:02:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:04 smithi156 ceph-mon[32679]: pgmap v3921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5522.319873 secs 2024-04-26T20:02:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6219.336780 secs 2024-04-26T20:02:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:04 smithi092 ceph-mon[29156]: pgmap v3921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5522.319873 secs 2024-04-26T20:02:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6219.336780 secs 2024-04-26T20:02:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:04 smithi189 ceph-mon[32756]: pgmap v3921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5522.319873 secs 2024-04-26T20:02:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:06 smithi156 ceph-mon[32679]: pgmap v3922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:06 smithi092 ceph-mon[29156]: pgmap v3922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:06 smithi189 ceph-mon[32756]: pgmap v3922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:08 smithi156 ceph-mon[32679]: pgmap v3923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:08 smithi092 ceph-mon[29156]: pgmap v3923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:08 smithi189 ceph-mon[32756]: pgmap v3923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6224.336905 secs 2024-04-26T20:02:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5527.320016 secs 2024-04-26T20:02:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6224.336905 secs 2024-04-26T20:02:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5527.320016 secs 2024-04-26T20:02:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6224.336905 secs 2024-04-26T20:02:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5527.320016 secs 2024-04-26T20:02:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:10 smithi092 ceph-mon[29156]: pgmap v3924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:10 smithi189 ceph-mon[32756]: pgmap v3924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:10 smithi156 ceph-mon[32679]: pgmap v3924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:12 smithi092 ceph-mon[29156]: pgmap v3925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:12 smithi189 ceph-mon[32756]: pgmap v3925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:12 smithi156 ceph-mon[32679]: pgmap v3925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6229.336997 secs 2024-04-26T20:02:14.767 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:14 smithi092 ceph-mon[29156]: pgmap v3926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:14.789 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5532.320109 secs 2024-04-26T20:02:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6229.336997 secs 2024-04-26T20:02:14.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:14 smithi189 ceph-mon[32756]: pgmap v3926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:14.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5532.320109 secs 2024-04-26T20:02:14.973 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6229.336997 secs 2024-04-26T20:02:14.982 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:14 smithi156 ceph-mon[32679]: pgmap v3926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:14.989 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5532.320109 secs 2024-04-26T20:02:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:16 smithi092 ceph-mon[29156]: pgmap v3927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:16 smithi189 ceph-mon[32756]: pgmap v3927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:16 smithi156 ceph-mon[32679]: pgmap v3927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:18 smithi092 ceph-mon[29156]: pgmap v3928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:18 smithi189 ceph-mon[32756]: pgmap v3928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:18 smithi156 ceph-mon[32679]: pgmap v3928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6234.337133 secs 2024-04-26T20:02:19.768 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5537.320265 secs 2024-04-26T20:02:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6234.337133 secs 2024-04-26T20:02:19.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5537.320265 secs 2024-04-26T20:02:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6234.337133 secs 2024-04-26T20:02:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5537.320265 secs 2024-04-26T20:02:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:20 smithi092 ceph-mon[29156]: pgmap v3929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:20 smithi189 ceph-mon[32756]: pgmap v3929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:20 smithi156 ceph-mon[32679]: pgmap v3929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:21.951 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:02:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: pgmap v3930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:22.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.758 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.765 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.785 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.850 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: pgmap v3930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:22.858 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.865 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.872 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.879 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.887 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:22.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: pgmap v3930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:23.007 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:23.076 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:23.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:23.188 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:23.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:23.202 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6239.337200 secs 2024-04-26T20:02:24.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: pgmap v3931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:24.760 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5542.320315 secs 2024-04-26T20:02:24.769 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.778 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.812 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6239.337200 secs 2024-04-26T20:02:24.911 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: pgmap v3931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:25.006 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5542.320315 secs 2024-04-26T20:02:25.071 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.080 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.151 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.160 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.178 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6239.337200 secs 2024-04-26T20:02:25.196 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: pgmap v3931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:25.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5542.320315 secs 2024-04-26T20:02:25.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.226 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:25.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.406 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.476 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.484 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.492 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.553 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:02:26.573 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:26.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.600 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:02:26.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:02:26.661 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: pgmap v3932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:26.707 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.807 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.849 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.859 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.911 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:26.921 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:02:26.930 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:26.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:26.950 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:26.960 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: pgmap v3933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:26.969 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: pgmap v3934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:26.979 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.006 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.166 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:02:27.173 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:27.185 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.257 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.265 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.273 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:02:27.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:02:27.288 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: pgmap v3932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:27.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.303 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.311 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.319 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.367 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:02:27.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:27.507 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:27.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:27.523 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: pgmap v3933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:27.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: pgmap v3934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:27.539 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.547 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.556 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.564 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.581 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.594 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.603 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:02:27.612 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:27.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.741 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.749 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.805 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.814 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.822 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:02:27.830 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:02:27.839 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: pgmap v3932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:27.848 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.858 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:27.867 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.879 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.888 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:02:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:02:27.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:02:27.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:02:27.995 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:02:28.032 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: pgmap v3933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:28.042 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: pgmap v3934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:28.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:02:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:28 smithi156 ceph-mon[32679]: pgmap v3935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:28 smithi092 ceph-mon[29156]: pgmap v3935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:28 smithi189 ceph-mon[32756]: pgmap v3935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6244.337314 secs 2024-04-26T20:02:29.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5547.320367 secs 2024-04-26T20:02:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6244.337314 secs 2024-04-26T20:02:29.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5547.320367 secs 2024-04-26T20:02:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6244.337314 secs 2024-04-26T20:02:29.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5547.320367 secs 2024-04-26T20:02:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:30 smithi156 ceph-mon[32679]: pgmap v3936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:30 smithi092 ceph-mon[29156]: pgmap v3936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:30 smithi189 ceph-mon[32756]: pgmap v3936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:32 smithi156 ceph-mon[32679]: pgmap v3937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:32 smithi092 ceph-mon[29156]: pgmap v3937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:32 smithi189 ceph-mon[32756]: pgmap v3937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6249.337450 secs 2024-04-26T20:02:34.714 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:34 smithi156 ceph-mon[32679]: pgmap v3938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:34.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5552.320441 secs 2024-04-26T20:02:34.777 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6249.337450 secs 2024-04-26T20:02:34.787 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:34 smithi092 ceph-mon[29156]: pgmap v3938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5552.320441 secs 2024-04-26T20:02:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6249.337450 secs 2024-04-26T20:02:34.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:34 smithi189 ceph-mon[32756]: pgmap v3938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:02:34.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5552.320441 secs 2024-04-26T20:02:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:36 smithi156 ceph-mon[32679]: pgmap v3939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:36 smithi092 ceph-mon[29156]: pgmap v3939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:36 smithi189 ceph-mon[32756]: pgmap v3939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:02:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:38 smithi156 ceph-mon[32679]: pgmap v3940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:38 smithi092 ceph-mon[29156]: pgmap v3940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:38 smithi189 ceph-mon[32756]: pgmap v3940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6254.337596 secs 2024-04-26T20:02:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5557.320517 secs 2024-04-26T20:02:39.862 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6254.337596 secs 2024-04-26T20:02:39.886 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5557.320517 secs 2024-04-26T20:02:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6254.337596 secs 2024-04-26T20:02:39.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5557.320517 secs 2024-04-26T20:02:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:40 smithi092 ceph-mon[29156]: pgmap v3941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:40.926 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:40 smithi189 ceph-mon[32756]: pgmap v3941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:40 smithi156 ceph-mon[32679]: pgmap v3941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:42.707 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:42 smithi189 ceph-mon[32756]: pgmap v3942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:42 smithi092 ceph-mon[29156]: pgmap v3942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:42 smithi156 ceph-mon[32679]: pgmap v3942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6259.337713 secs 2024-04-26T20:02:44.763 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:44 smithi092 ceph-mon[29156]: pgmap v3943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:44.771 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5562.320582 secs 2024-04-26T20:02:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6259.337713 secs 2024-04-26T20:02:44.906 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:44 smithi189 ceph-mon[32756]: pgmap v3943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:44.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5562.320582 secs 2024-04-26T20:02:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6259.337713 secs 2024-04-26T20:02:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:44 smithi156 ceph-mon[32679]: pgmap v3943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:44.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5562.320582 secs 2024-04-26T20:02:46.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:46 smithi092 ceph-mon[29156]: pgmap v3944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:46 smithi189 ceph-mon[32756]: pgmap v3944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:46 smithi156 ceph-mon[32679]: pgmap v3944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:48 smithi092 ceph-mon[29156]: pgmap v3945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:48 smithi189 ceph-mon[32756]: pgmap v3945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:48 smithi156 ceph-mon[32679]: pgmap v3945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6264.337868 secs 2024-04-26T20:02:49.820 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5567.320650 secs 2024-04-26T20:02:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6264.337868 secs 2024-04-26T20:02:49.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5567.320650 secs 2024-04-26T20:02:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6264.337868 secs 2024-04-26T20:02:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5567.320650 secs 2024-04-26T20:02:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:50 smithi156 ceph-mon[32679]: pgmap v3946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:50 smithi092 ceph-mon[29156]: pgmap v3946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:50 smithi189 ceph-mon[32756]: pgmap v3946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:52 smithi092 ceph-mon[29156]: pgmap v3947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:52 smithi189 ceph-mon[32756]: pgmap v3947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:52 smithi156 ceph-mon[32679]: pgmap v3947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6269.337915 secs 2024-04-26T20:02:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:54 smithi092 ceph-mon[29156]: pgmap v3948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:54.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5572.320725 secs 2024-04-26T20:02:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6269.337915 secs 2024-04-26T20:02:54.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:54 smithi189 ceph-mon[32756]: pgmap v3948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:54.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5572.320725 secs 2024-04-26T20:02:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6269.337915 secs 2024-04-26T20:02:54.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:54 smithi156 ceph-mon[32679]: pgmap v3948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:54.951 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5572.320725 secs 2024-04-26T20:02:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:56 smithi092 ceph-mon[29156]: pgmap v3949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:56 smithi189 ceph-mon[32756]: pgmap v3949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:56.953 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:56 smithi156 ceph-mon[32679]: pgmap v3949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:02:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:58 smithi092 ceph-mon[29156]: pgmap v3950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:58 smithi189 ceph-mon[32756]: pgmap v3950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:58 smithi156 ceph-mon[32679]: pgmap v3950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:02:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6274.338036 secs 2024-04-26T20:02:59.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:02:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5577.320835 secs 2024-04-26T20:02:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6274.338036 secs 2024-04-26T20:02:59.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:02:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5577.320835 secs 2024-04-26T20:02:59.945 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6274.338036 secs 2024-04-26T20:02:59.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:02:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5577.320835 secs 2024-04-26T20:03:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:00 smithi092 ceph-mon[29156]: pgmap v3951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:00 smithi189 ceph-mon[32756]: pgmap v3951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:00 smithi156 ceph-mon[32679]: pgmap v3951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:02 smithi092 ceph-mon[29156]: pgmap v3952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:02 smithi189 ceph-mon[32756]: pgmap v3952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:02.977 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:02 smithi156 ceph-mon[32679]: pgmap v3952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6279.338151 secs 2024-04-26T20:03:04.758 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:04 smithi092 ceph-mon[29156]: pgmap v3953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:04.767 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5582.320912 secs 2024-04-26T20:03:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6279.338151 secs 2024-04-26T20:03:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:04 smithi189 ceph-mon[32756]: pgmap v3953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:04.906 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5582.320912 secs 2024-04-26T20:03:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6279.338151 secs 2024-04-26T20:03:04.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:04 smithi156 ceph-mon[32679]: pgmap v3953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:04.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5582.320912 secs 2024-04-26T20:03:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:06 smithi092 ceph-mon[29156]: pgmap v3954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:06 smithi189 ceph-mon[32756]: pgmap v3954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:06 smithi156 ceph-mon[32679]: pgmap v3954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:08 smithi092 ceph-mon[29156]: pgmap v3955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:08 smithi189 ceph-mon[32756]: pgmap v3955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:09.018 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:08 smithi156 ceph-mon[32679]: pgmap v3955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:09.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6284.338228 secs 2024-04-26T20:03:09.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5587.321028 secs 2024-04-26T20:03:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6284.338228 secs 2024-04-26T20:03:09.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5587.321028 secs 2024-04-26T20:03:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6284.338228 secs 2024-04-26T20:03:10.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5587.321028 secs 2024-04-26T20:03:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:10 smithi189 ceph-mon[32756]: pgmap v3956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:10 smithi156 ceph-mon[32679]: pgmap v3956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:10 smithi092 ceph-mon[29156]: pgmap v3956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:12 smithi189 ceph-mon[32756]: pgmap v3957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:12 smithi156 ceph-mon[32679]: pgmap v3957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:12 smithi092 ceph-mon[29156]: pgmap v3957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6289.338343 secs 2024-04-26T20:03:14.977 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:14 smithi189 ceph-mon[32756]: pgmap v3958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:14.985 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5592.321147 secs 2024-04-26T20:03:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6289.338343 secs 2024-04-26T20:03:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:14 smithi092 ceph-mon[29156]: pgmap v3958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:15.013 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5592.321147 secs 2024-04-26T20:03:15.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6289.338343 secs 2024-04-26T20:03:15.034 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:14 smithi156 ceph-mon[32679]: pgmap v3958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:15.042 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5592.321147 secs 2024-04-26T20:03:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:16 smithi189 ceph-mon[32756]: pgmap v3959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:16.924 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:16 smithi092 ceph-mon[29156]: pgmap v3959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:16 smithi156 ceph-mon[32679]: pgmap v3959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:18 smithi189 ceph-mon[32756]: pgmap v3960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:18 smithi156 ceph-mon[32679]: pgmap v3960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:18 smithi092 ceph-mon[29156]: pgmap v3960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6294.338490 secs 2024-04-26T20:03:19.918 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5597.321263 secs 2024-04-26T20:03:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6294.338490 secs 2024-04-26T20:03:19.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5597.321263 secs 2024-04-26T20:03:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6294.338490 secs 2024-04-26T20:03:20.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5597.321263 secs 2024-04-26T20:03:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:20 smithi189 ceph-mon[32756]: pgmap v3961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:20 smithi156 ceph-mon[32679]: pgmap v3961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:21.049 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:20 smithi092 ceph-mon[29156]: pgmap v3961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:22 smithi189 ceph-mon[32756]: pgmap v3962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:22.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:22 smithi156 ceph-mon[32679]: pgmap v3962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:22 smithi092 ceph-mon[29156]: pgmap v3962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:23 smithi189 ceph-mon[32756]: pgmap v3963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:23 smithi156 ceph-mon[32679]: pgmap v3963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:24.075 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:23 smithi092 ceph-mon[29156]: pgmap v3963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6299.338553 secs 2024-04-26T20:03:25.498 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5602.321382 secs 2024-04-26T20:03:25.519 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6299.338553 secs 2024-04-26T20:03:25.526 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5602.321382 secs 2024-04-26T20:03:25.533 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6299.338553 secs 2024-04-26T20:03:25.540 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5602.321382 secs 2024-04-26T20:03:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:25 smithi189 ceph-mon[32756]: pgmap v3964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:26.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:26.081 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:25 smithi092 ceph-mon[29156]: pgmap v3964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:26.090 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:26.099 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:25 smithi156 ceph-mon[32679]: pgmap v3964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:26.107 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:03:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:26.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:26.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:26 smithi189 ceph-mon[32756]: pgmap v3965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:03:26.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:26 smithi189 ceph-mon[32756]: pgmap v3966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:27.008 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:03:27.018 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:27.028 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:27.087 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:26 smithi092 ceph-mon[29156]: pgmap v3965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:03:27.096 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:26 smithi092 ceph-mon[29156]: pgmap v3966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:27.104 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:03:27.112 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:03:27.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:03:27.129 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:26 smithi156 ceph-mon[32679]: pgmap v3965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:03:27.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:26 smithi156 ceph-mon[32679]: pgmap v3966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:27.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:03:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:29 smithi092 ceph-mon[29156]: pgmap v3967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:03:29.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6304.338658 secs 2024-04-26T20:03:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:29 smithi189 ceph-mon[32756]: pgmap v3967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:03:29.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6304.338658 secs 2024-04-26T20:03:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:29 smithi156 ceph-mon[32679]: pgmap v3967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:03:29.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6304.338658 secs 2024-04-26T20:03:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5607.321493 secs 2024-04-26T20:03:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5607.321493 secs 2024-04-26T20:03:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5607.321493 secs 2024-04-26T20:03:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:31 smithi092 ceph-mon[29156]: pgmap v3968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:31 smithi189 ceph-mon[32756]: pgmap v3968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:31 smithi156 ceph-mon[32679]: pgmap v3968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:33 smithi092 ceph-mon[29156]: pgmap v3969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:33 smithi189 ceph-mon[32756]: pgmap v3969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:33.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:33 smithi156 ceph-mon[32679]: pgmap v3969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6309.338778 secs 2024-04-26T20:03:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6309.338778 secs 2024-04-26T20:03:34.711 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6309.338778 secs 2024-04-26T20:03:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5612.321566 secs 2024-04-26T20:03:35.554 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:35 smithi092 ceph-mon[29156]: pgmap v3970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5612.321566 secs 2024-04-26T20:03:35.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:35 smithi189 ceph-mon[32756]: pgmap v3970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5612.321566 secs 2024-04-26T20:03:35.694 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:35 smithi156 ceph-mon[32679]: pgmap v3970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:03:35.998 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T20:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:03:36.074 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c006020 tx=0x7f1ca8089000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:03:36.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c006020 tx=0x7f1ca8089000 comp rx=0 tx=0).stop 2024-04-26T20:03:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a53a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T20:03:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a53a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:03:36.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a53a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:03:36.168 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:03:36.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:03:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:35.997+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:03:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:03:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:03:36.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:03:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=5 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:03:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:03:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T20:03:36.389 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.026+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T20:03:36.839 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.839+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:03:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.839+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:03:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.839+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:03:36.839+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 52 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:03:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:37 smithi092 ceph-mon[29156]: pgmap v3971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:03:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:37 smithi189 ceph-mon[32756]: pgmap v3971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:03:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:37 smithi156 ceph-mon[32679]: pgmap v3971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:03:39.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:39 smithi156 ceph-mon[32679]: pgmap v3972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:39.497 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6314.338895 secs 2024-04-26T20:03:39.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:39 smithi092 ceph-mon[29156]: pgmap v3972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:39.558 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6314.338895 secs 2024-04-26T20:03:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:39 smithi189 ceph-mon[32756]: pgmap v3972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:39.719 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6314.338895 secs 2024-04-26T20:03:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5617.321678 secs 2024-04-26T20:03:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5617.321678 secs 2024-04-26T20:03:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5617.321678 secs 2024-04-26T20:03:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:41 smithi092 ceph-mon[29156]: pgmap v3973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:41 smithi189 ceph-mon[32756]: pgmap v3973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:41 smithi156 ceph-mon[32679]: pgmap v3973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:43 smithi092 ceph-mon[29156]: pgmap v3974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:43 smithi189 ceph-mon[32756]: pgmap v3974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:43 smithi156 ceph-mon[32679]: pgmap v3974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6319.339040 secs 2024-04-26T20:03:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6319.339040 secs 2024-04-26T20:03:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6319.339040 secs 2024-04-26T20:03:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5622.321759 secs 2024-04-26T20:03:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:45 smithi189 ceph-mon[32756]: pgmap v3975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:45.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5622.321759 secs 2024-04-26T20:03:45.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:45 smithi092 ceph-mon[29156]: pgmap v3975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:45.767 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5622.321759 secs 2024-04-26T20:03:45.775 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:45 smithi156 ceph-mon[32679]: pgmap v3975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:47 smithi189 ceph-mon[32756]: pgmap v3976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:47 smithi156 ceph-mon[32679]: pgmap v3976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:47 smithi092 ceph-mon[29156]: pgmap v3976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:49 smithi189 ceph-mon[32756]: pgmap v3977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:49.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6324.339105 secs 2024-04-26T20:03:49.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:49 smithi156 ceph-mon[32679]: pgmap v3977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:49.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6324.339105 secs 2024-04-26T20:03:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:49 smithi092 ceph-mon[29156]: pgmap v3977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:49.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6324.339105 secs 2024-04-26T20:03:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5627.321836 secs 2024-04-26T20:03:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5627.321836 secs 2024-04-26T20:03:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5627.321836 secs 2024-04-26T20:03:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:51 smithi189 ceph-mon[32756]: pgmap v3978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:51 smithi156 ceph-mon[32679]: pgmap v3978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:51 smithi092 ceph-mon[29156]: pgmap v3978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:53 smithi189 ceph-mon[32756]: pgmap v3979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:53 smithi156 ceph-mon[32679]: pgmap v3979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:53 smithi092 ceph-mon[29156]: pgmap v3979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6329.339215 secs 2024-04-26T20:03:54.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5632.321913 secs 2024-04-26T20:03:54.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6329.339215 secs 2024-04-26T20:03:54.675 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5632.321913 secs 2024-04-26T20:03:54.711 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6329.339215 secs 2024-04-26T20:03:54.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5632.321913 secs 2024-04-26T20:03:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:55 smithi189 ceph-mon[32756]: pgmap v3980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:55 smithi156 ceph-mon[32679]: pgmap v3980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:55 smithi092 ceph-mon[29156]: pgmap v3980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:03:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:57 smithi189 ceph-mon[32756]: pgmap v3981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:57 smithi156 ceph-mon[32679]: pgmap v3981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:57 smithi092 ceph-mon[29156]: pgmap v3981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:59 smithi189 ceph-mon[32756]: pgmap v3982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:59.672 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6334.339308 secs 2024-04-26T20:03:59.681 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:03:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5637.321977 secs 2024-04-26T20:03:59.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:59 smithi156 ceph-mon[32679]: pgmap v3982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:59.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6334.339308 secs 2024-04-26T20:03:59.709 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:03:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5637.321977 secs 2024-04-26T20:03:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:59 smithi092 ceph-mon[29156]: pgmap v3982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:03:59.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6334.339308 secs 2024-04-26T20:03:59.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:03:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5637.321977 secs 2024-04-26T20:04:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:01 smithi189 ceph-mon[32756]: pgmap v3983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:01 smithi156 ceph-mon[32679]: pgmap v3983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:01 smithi092 ceph-mon[29156]: pgmap v3983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:03.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:03 smithi092 ceph-mon[29156]: pgmap v3984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:03 smithi189 ceph-mon[32756]: pgmap v3984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:03 smithi156 ceph-mon[32679]: pgmap v3984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6339.339425 secs 2024-04-26T20:04:04.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5642.322129 secs 2024-04-26T20:04:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6339.339425 secs 2024-04-26T20:04:04.697 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5642.322129 secs 2024-04-26T20:04:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6339.339425 secs 2024-04-26T20:04:04.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5642.322129 secs 2024-04-26T20:04:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:05 smithi189 ceph-mon[32756]: pgmap v3985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:05 smithi156 ceph-mon[32679]: pgmap v3985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:05 smithi092 ceph-mon[29156]: pgmap v3985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:07 smithi189 ceph-mon[32756]: pgmap v3986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:07.703 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:07 smithi156 ceph-mon[32679]: pgmap v3986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:07 smithi092 ceph-mon[29156]: pgmap v3986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:09 smithi189 ceph-mon[32756]: pgmap v3987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:09.656 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6344.339560 secs 2024-04-26T20:04:09.664 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5647.322244 secs 2024-04-26T20:04:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:09 smithi156 ceph-mon[32679]: pgmap v3987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:09.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6344.339560 secs 2024-04-26T20:04:09.702 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5647.322244 secs 2024-04-26T20:04:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:09 smithi092 ceph-mon[29156]: pgmap v3987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:09.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6344.339560 secs 2024-04-26T20:04:09.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5647.322244 secs 2024-04-26T20:04:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:11 smithi189 ceph-mon[32756]: pgmap v3988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:11 smithi156 ceph-mon[32679]: pgmap v3988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:11 smithi092 ceph-mon[29156]: pgmap v3988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:13 smithi189 ceph-mon[32756]: pgmap v3989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:13 smithi156 ceph-mon[32679]: pgmap v3989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:13 smithi092 ceph-mon[29156]: pgmap v3989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6349.339677 secs 2024-04-26T20:04:14.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5652.322368 secs 2024-04-26T20:04:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6349.339677 secs 2024-04-26T20:04:14.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5652.322368 secs 2024-04-26T20:04:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6349.339677 secs 2024-04-26T20:04:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5652.322368 secs 2024-04-26T20:04:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:15 smithi189 ceph-mon[32756]: pgmap v3990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:15 smithi156 ceph-mon[32679]: pgmap v3990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:15 smithi092 ceph-mon[29156]: pgmap v3990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:17 smithi189 ceph-mon[32756]: pgmap v3991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:17 smithi156 ceph-mon[32679]: pgmap v3991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:17 smithi092 ceph-mon[29156]: pgmap v3991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:19 smithi189 ceph-mon[32756]: pgmap v3992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:19.662 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6354.339792 secs 2024-04-26T20:04:19.664 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5657.322428 secs 2024-04-26T20:04:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:19 smithi156 ceph-mon[32679]: pgmap v3992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6354.339792 secs 2024-04-26T20:04:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5657.322428 secs 2024-04-26T20:04:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:19 smithi092 ceph-mon[29156]: pgmap v3992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6354.339792 secs 2024-04-26T20:04:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5657.322428 secs 2024-04-26T20:04:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:21 smithi189 ceph-mon[32756]: pgmap v3993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:21 smithi156 ceph-mon[32679]: pgmap v3993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:21 smithi092 ceph-mon[29156]: pgmap v3993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:23 smithi189 ceph-mon[32756]: pgmap v3994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:23 smithi156 ceph-mon[32679]: pgmap v3994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:23 smithi092 ceph-mon[29156]: pgmap v3994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6359.339934 secs 2024-04-26T20:04:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5662.322496 secs 2024-04-26T20:04:24.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6359.339934 secs 2024-04-26T20:04:24.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5662.322496 secs 2024-04-26T20:04:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6359.339934 secs 2024-04-26T20:04:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5662.322496 secs 2024-04-26T20:04:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:25 smithi189 ceph-mon[32756]: pgmap v3995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:25 smithi156 ceph-mon[32679]: pgmap v3995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:25 smithi092 ceph-mon[29156]: pgmap v3995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:04:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:27 smithi189 ceph-mon[32756]: pgmap v3996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:04:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:27 smithi156 ceph-mon[32679]: pgmap v3996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:04:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:27 smithi092 ceph-mon[29156]: pgmap v3996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:04:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:04:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:04:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:28 smithi189 ceph-mon[32756]: pgmap v3997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:04:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:28 smithi189 ceph-mon[32756]: pgmap v3998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:28 smithi156 ceph-mon[32679]: pgmap v3997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:04:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:28 smithi156 ceph-mon[32679]: pgmap v3998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:28 smithi092 ceph-mon[29156]: pgmap v3997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:04:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:28 smithi092 ceph-mon[29156]: pgmap v3998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6364.340057 secs 2024-04-26T20:04:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5667.322607 secs 2024-04-26T20:04:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6364.340057 secs 2024-04-26T20:04:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5667.322607 secs 2024-04-26T20:04:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6364.340057 secs 2024-04-26T20:04:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5667.322607 secs 2024-04-26T20:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:30 smithi189 ceph-mon[32756]: pgmap v3999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:30 smithi156 ceph-mon[32679]: pgmap v3999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:30 smithi092 ceph-mon[29156]: pgmap v3999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:32 smithi189 ceph-mon[32756]: pgmap v4000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:32 smithi156 ceph-mon[32679]: pgmap v4000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:32 smithi092 ceph-mon[29156]: pgmap v4000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:04:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:34 smithi189 ceph-mon[32756]: pgmap v4001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:04:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6369.340178 secs 2024-04-26T20:04:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5672.322667 secs 2024-04-26T20:04:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:34 smithi156 ceph-mon[32679]: pgmap v4001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:04:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6369.340178 secs 2024-04-26T20:04:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5672.322667 secs 2024-04-26T20:04:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:34 smithi092 ceph-mon[29156]: pgmap v4001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:04:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6369.340178 secs 2024-04-26T20:04:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5672.322667 secs 2024-04-26T20:04:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:36 smithi189 ceph-mon[32756]: pgmap v4002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T20:04:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:36 smithi156 ceph-mon[32679]: pgmap v4002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T20:04:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:36 smithi092 ceph-mon[29156]: pgmap v4002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T20:04:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:38 smithi189 ceph-mon[32756]: pgmap v4003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T20:04:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:38 smithi156 ceph-mon[32679]: pgmap v4003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T20:04:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:38 smithi092 ceph-mon[29156]: pgmap v4003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T20:04:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6374.340296 secs 2024-04-26T20:04:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5677.322776 secs 2024-04-26T20:04:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6374.340296 secs 2024-04-26T20:04:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5677.322776 secs 2024-04-26T20:04:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6374.340296 secs 2024-04-26T20:04:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5677.322776 secs 2024-04-26T20:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:40 smithi189 ceph-mon[32756]: pgmap v4004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:40 smithi156 ceph-mon[32679]: pgmap v4004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:40 smithi092 ceph-mon[29156]: pgmap v4004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:42 smithi189 ceph-mon[32756]: pgmap v4005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:42 smithi156 ceph-mon[32679]: pgmap v4005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:42 smithi092 ceph-mon[29156]: pgmap v4005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:44 smithi189 ceph-mon[32756]: pgmap v4006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6379.340388 secs 2024-04-26T20:04:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5682.322857 secs 2024-04-26T20:04:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:44 smithi156 ceph-mon[32679]: pgmap v4006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6379.340388 secs 2024-04-26T20:04:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5682.322857 secs 2024-04-26T20:04:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:44 smithi092 ceph-mon[29156]: pgmap v4006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:04:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6379.340388 secs 2024-04-26T20:04:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5682.322857 secs 2024-04-26T20:04:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:46 smithi189 ceph-mon[32756]: pgmap v4007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:46 smithi156 ceph-mon[32679]: pgmap v4007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:46 smithi092 ceph-mon[29156]: pgmap v4007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:04:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:48 smithi189 ceph-mon[32756]: pgmap v4008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:48 smithi156 ceph-mon[32679]: pgmap v4008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:48 smithi092 ceph-mon[29156]: pgmap v4008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6384.340504 secs 2024-04-26T20:04:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5687.322924 secs 2024-04-26T20:04:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6384.340504 secs 2024-04-26T20:04:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5687.322924 secs 2024-04-26T20:04:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6384.340504 secs 2024-04-26T20:04:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5687.322924 secs 2024-04-26T20:04:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:50 smithi156 ceph-mon[32679]: pgmap v4009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:50 smithi092 ceph-mon[29156]: pgmap v4009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:50 smithi189 ceph-mon[32756]: pgmap v4009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:52 smithi156 ceph-mon[32679]: pgmap v4010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:52 smithi092 ceph-mon[29156]: pgmap v4010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:52 smithi189 ceph-mon[32756]: pgmap v4010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:54 smithi156 ceph-mon[32679]: pgmap v4011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6389.340626 secs 2024-04-26T20:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5692.323063 secs 2024-04-26T20:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:54 smithi092 ceph-mon[29156]: pgmap v4011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6389.340626 secs 2024-04-26T20:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5692.323063 secs 2024-04-26T20:04:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:54 smithi189 ceph-mon[32756]: pgmap v4011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6389.340626 secs 2024-04-26T20:04:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5692.323063 secs 2024-04-26T20:04:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:56 smithi156 ceph-mon[32679]: pgmap v4012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:56 smithi092 ceph-mon[29156]: pgmap v4012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:56 smithi189 ceph-mon[32756]: pgmap v4012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:04:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:58 smithi156 ceph-mon[32679]: pgmap v4013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:58 smithi092 ceph-mon[29156]: pgmap v4013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:58 smithi189 ceph-mon[32756]: pgmap v4013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:04:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6394.340796 secs 2024-04-26T20:04:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:04:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5697.323208 secs 2024-04-26T20:04:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6394.340796 secs 2024-04-26T20:04:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:04:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5697.323208 secs 2024-04-26T20:04:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6394.340796 secs 2024-04-26T20:04:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:04:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5697.323208 secs 2024-04-26T20:05:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:00 smithi156 ceph-mon[32679]: pgmap v4014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:00 smithi092 ceph-mon[29156]: pgmap v4014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:00 smithi189 ceph-mon[32756]: pgmap v4014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:02 smithi156 ceph-mon[32679]: pgmap v4015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-mon[29156]: pgmap v4015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:05:02.617+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:05:02.617+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:05:02.617+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:05:02.617+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:05:02.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:05:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:05:02.617+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:05:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:02 smithi189 ceph-mon[32756]: pgmap v4015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:04 smithi156 ceph-mon[32679]: pgmap v4016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6399.340929 secs 2024-04-26T20:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 5702.323351 secs 2024-04-26T20:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:04 smithi156 ceph-mon[32679]: slow request 2881.533827 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:04 smithi092 ceph-mon[29156]: pgmap v4016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6399.340929 secs 2024-04-26T20:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 5702.323351 secs 2024-04-26T20:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:04 smithi092 ceph-mon[29156]: slow request 2881.533827 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:05:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:04 smithi189 ceph-mon[32756]: pgmap v4016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6399.340929 secs 2024-04-26T20:05:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 5702.323351 secs 2024-04-26T20:05:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:04 smithi189 ceph-mon[32756]: slow request 2881.533827 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:05:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:06 smithi156 ceph-mon[32679]: pgmap v4017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:06 smithi092 ceph-mon[29156]: pgmap v4017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:06 smithi189 ceph-mon[32756]: pgmap v4017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:08 smithi156 ceph-mon[32679]: pgmap v4018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:08 smithi092 ceph-mon[29156]: pgmap v4018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:08 smithi189 ceph-mon[32756]: pgmap v4018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6404.341013 secs 2024-04-26T20:05:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5707.323463 secs 2024-04-26T20:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6404.341013 secs 2024-04-26T20:05:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5707.323463 secs 2024-04-26T20:05:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6404.341013 secs 2024-04-26T20:05:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5707.323463 secs 2024-04-26T20:05:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:10 smithi092 ceph-mon[29156]: pgmap v4019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:10 smithi189 ceph-mon[32756]: pgmap v4019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:10 smithi156 ceph-mon[32679]: pgmap v4019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:12 smithi092 ceph-mon[29156]: pgmap v4020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:12 smithi189 ceph-mon[32756]: pgmap v4020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:12 smithi156 ceph-mon[32679]: pgmap v4020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:14 smithi092 ceph-mon[29156]: pgmap v4021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6409.341168 secs 2024-04-26T20:05:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5712.323526 secs 2024-04-26T20:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:14 smithi189 ceph-mon[32756]: pgmap v4021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6409.341168 secs 2024-04-26T20:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5712.323526 secs 2024-04-26T20:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:14 smithi156 ceph-mon[32679]: pgmap v4021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6409.341168 secs 2024-04-26T20:05:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5712.323526 secs 2024-04-26T20:05:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:16 smithi092 ceph-mon[29156]: pgmap v4022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:16 smithi189 ceph-mon[32756]: pgmap v4022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:16 smithi156 ceph-mon[32679]: pgmap v4022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:05:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:18 smithi092 ceph-mon[29156]: pgmap v4023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:18 smithi189 ceph-mon[32756]: pgmap v4023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:18 smithi156 ceph-mon[32679]: pgmap v4023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6414.341266 secs 2024-04-26T20:05:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5717.323606 secs 2024-04-26T20:05:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6414.341266 secs 2024-04-26T20:05:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5717.323606 secs 2024-04-26T20:05:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6414.341266 secs 2024-04-26T20:05:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5717.323606 secs 2024-04-26T20:05:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:20 smithi092 ceph-mon[29156]: pgmap v4024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:20 smithi189 ceph-mon[32756]: pgmap v4024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:20 smithi156 ceph-mon[32679]: pgmap v4024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:22 smithi092 ceph-mon[29156]: pgmap v4025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:22 smithi189 ceph-mon[32756]: pgmap v4025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:22 smithi156 ceph-mon[32679]: pgmap v4025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:24 smithi092 ceph-mon[29156]: pgmap v4026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6419.341390 secs 2024-04-26T20:05:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5722.323677 secs 2024-04-26T20:05:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:24 smithi189 ceph-mon[32756]: pgmap v4026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6419.341390 secs 2024-04-26T20:05:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5722.323677 secs 2024-04-26T20:05:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:24 smithi156 ceph-mon[32679]: pgmap v4026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6419.341390 secs 2024-04-26T20:05:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5722.323677 secs 2024-04-26T20:05:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:26 smithi092 ceph-mon[29156]: pgmap v4027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:26 smithi189 ceph-mon[32756]: pgmap v4027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:26 smithi156 ceph-mon[32679]: pgmap v4027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:05:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:28 smithi092 ceph-mon[29156]: pgmap v4028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:05:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:28 smithi189 ceph-mon[32756]: pgmap v4028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:05:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:28 smithi156 ceph-mon[32679]: pgmap v4028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:05:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:05:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:05:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:29 smithi092 ceph-mon[29156]: pgmap v4029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:29 smithi092 ceph-mon[29156]: pgmap v4030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6424.341537 secs 2024-04-26T20:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5727.323748 secs 2024-04-26T20:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:29 smithi189 ceph-mon[32756]: pgmap v4029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:29 smithi189 ceph-mon[32756]: pgmap v4030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6424.341537 secs 2024-04-26T20:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5727.323748 secs 2024-04-26T20:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:29 smithi156 ceph-mon[32679]: pgmap v4029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:29 smithi156 ceph-mon[32679]: pgmap v4030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6424.341537 secs 2024-04-26T20:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5727.323748 secs 2024-04-26T20:05:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:31 smithi092 ceph-mon[29156]: pgmap v4031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:31 smithi189 ceph-mon[32756]: pgmap v4031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:31 smithi156 ceph-mon[32679]: pgmap v4031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:33 smithi092 ceph-mon[29156]: pgmap v4032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:33 smithi189 ceph-mon[32756]: pgmap v4032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:33 smithi156 ceph-mon[32679]: pgmap v4032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6429.341662 secs 2024-04-26T20:05:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5732.323813 secs 2024-04-26T20:05:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6429.341662 secs 2024-04-26T20:05:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5732.323813 secs 2024-04-26T20:05:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6429.341662 secs 2024-04-26T20:05:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5732.323813 secs 2024-04-26T20:05:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:35 smithi189 ceph-mon[32756]: pgmap v4033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:35 smithi156 ceph-mon[32679]: pgmap v4033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:35 smithi092 ceph-mon[29156]: pgmap v4033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:37.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:37 smithi092 ceph-mon[29156]: pgmap v4034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:37 smithi189 ceph-mon[32756]: pgmap v4034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:37 smithi156 ceph-mon[32679]: pgmap v4034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:05:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:39 smithi189 ceph-mon[32756]: pgmap v4035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:05:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6434.341789 secs 2024-04-26T20:05:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5737.323923 secs 2024-04-26T20:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:39 smithi156 ceph-mon[32679]: pgmap v4035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6434.341789 secs 2024-04-26T20:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5737.323923 secs 2024-04-26T20:05:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:39 smithi092 ceph-mon[29156]: pgmap v4035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:05:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6434.341789 secs 2024-04-26T20:05:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5737.323923 secs 2024-04-26T20:05:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:41 smithi189 ceph-mon[32756]: pgmap v4036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:41 smithi156 ceph-mon[32679]: pgmap v4036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:41 smithi092 ceph-mon[29156]: pgmap v4036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:43 smithi189 ceph-mon[32756]: pgmap v4037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:43 smithi156 ceph-mon[32679]: pgmap v4037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:43 smithi092 ceph-mon[29156]: pgmap v4037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:44.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6439.341922 secs 2024-04-26T20:05:44.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5742.324017 secs 2024-04-26T20:05:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6439.341922 secs 2024-04-26T20:05:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5742.324017 secs 2024-04-26T20:05:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6439.341922 secs 2024-04-26T20:05:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5742.324017 secs 2024-04-26T20:05:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:45 smithi189 ceph-mon[32756]: pgmap v4038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:45 smithi156 ceph-mon[32679]: pgmap v4038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:45 smithi092 ceph-mon[29156]: pgmap v4038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:47 smithi189 ceph-mon[32756]: pgmap v4039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:47 smithi156 ceph-mon[32679]: pgmap v4039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:47 smithi092 ceph-mon[29156]: pgmap v4039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:49 smithi189 ceph-mon[32756]: pgmap v4040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6444.342047 secs 2024-04-26T20:05:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5747.324127 secs 2024-04-26T20:05:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:49 smithi156 ceph-mon[32679]: pgmap v4040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6444.342047 secs 2024-04-26T20:05:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5747.324127 secs 2024-04-26T20:05:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:49 smithi092 ceph-mon[29156]: pgmap v4040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6444.342047 secs 2024-04-26T20:05:50.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5747.324127 secs 2024-04-26T20:05:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:05:51.858+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:05:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:05:51.858+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:05:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:05:51.858+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:05:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:05:51.858+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 53 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:05:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:51 smithi189 ceph-mon[32756]: pgmap v4041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:51 smithi156 ceph-mon[32679]: pgmap v4041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:51 smithi092 ceph-mon[29156]: pgmap v4041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:53 smithi189 ceph-mon[32756]: pgmap v4042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:53 smithi156 ceph-mon[32679]: pgmap v4042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:53 smithi092 ceph-mon[29156]: pgmap v4042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6449.342182 secs 2024-04-26T20:05:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5752.324196 secs 2024-04-26T20:05:54.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6449.342182 secs 2024-04-26T20:05:54.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5752.324196 secs 2024-04-26T20:05:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6449.342182 secs 2024-04-26T20:05:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5752.324196 secs 2024-04-26T20:05:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:55 smithi189 ceph-mon[32756]: pgmap v4043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:55 smithi156 ceph-mon[32679]: pgmap v4043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:55 smithi092 ceph-mon[29156]: pgmap v4043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:05:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:57 smithi189 ceph-mon[32756]: pgmap v4044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:57 smithi156 ceph-mon[32679]: pgmap v4044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:57 smithi092 ceph-mon[29156]: pgmap v4044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:59 smithi189 ceph-mon[32756]: pgmap v4045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6454.342297 secs 2024-04-26T20:05:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:05:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5757.324277 secs 2024-04-26T20:05:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:59 smithi156 ceph-mon[32679]: pgmap v4045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6454.342297 secs 2024-04-26T20:05:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:05:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5757.324277 secs 2024-04-26T20:05:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:59 smithi092 ceph-mon[29156]: pgmap v4045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:05:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6454.342297 secs 2024-04-26T20:05:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:05:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5757.324277 secs 2024-04-26T20:06:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:00 smithi189 ceph-mon[32756]: pgmap v4046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:00 smithi156 ceph-mon[32679]: pgmap v4046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:00 smithi092 ceph-mon[29156]: pgmap v4046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:02 smithi189 ceph-mon[32756]: pgmap v4047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:02 smithi156 ceph-mon[32679]: pgmap v4047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:02 smithi092 ceph-mon[29156]: pgmap v4047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6459.342392 secs 2024-04-26T20:06:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 5762.324397 secs 2024-04-26T20:06:05.152 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:04 smithi189 ceph-mon[32756]: slow request 5762.324396 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:06:05.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:04 smithi189 ceph-mon[32756]: pgmap v4048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6459.342392 secs 2024-04-26T20:06:05.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 5762.324397 secs 2024-04-26T20:06:05.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:04 smithi156 ceph-mon[32679]: slow request 5762.324396 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:06:05.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:04 smithi156 ceph-mon[32679]: pgmap v4048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6459.342392 secs 2024-04-26T20:06:05.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 5762.324397 secs 2024-04-26T20:06:05.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:04 smithi092 ceph-mon[29156]: slow request 5762.324396 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:06:05.270 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:04 smithi092 ceph-mon[29156]: pgmap v4048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:06 smithi189 ceph-mon[32756]: pgmap v4049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:06 smithi156 ceph-mon[32679]: pgmap v4049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:06 smithi092 ceph-mon[29156]: pgmap v4049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:08 smithi189 ceph-mon[32756]: pgmap v4050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:08 smithi156 ceph-mon[32679]: pgmap v4050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:08 smithi092 ceph-mon[29156]: pgmap v4050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:10.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6464.342516 secs 2024-04-26T20:06:10.104 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5767.324495 secs 2024-04-26T20:06:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6464.342516 secs 2024-04-26T20:06:10.271 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5767.324495 secs 2024-04-26T20:06:10.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6464.342516 secs 2024-04-26T20:06:10.346 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5767.324495 secs 2024-04-26T20:06:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:10 smithi189 ceph-mon[32756]: pgmap v4051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:11.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:10 smithi156 ceph-mon[32679]: pgmap v4051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:10 smithi092 ceph-mon[29156]: pgmap v4051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:12 smithi189 ceph-mon[32756]: pgmap v4052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:13.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:12 smithi156 ceph-mon[32679]: pgmap v4052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:13.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:12 smithi092 ceph-mon[29156]: pgmap v4052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6469.342657 secs 2024-04-26T20:06:15.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5772.324635 secs 2024-04-26T20:06:15.203 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:14 smithi189 ceph-mon[32756]: pgmap v4053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:15.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6469.342657 secs 2024-04-26T20:06:15.223 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5772.324635 secs 2024-04-26T20:06:15.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:14 smithi156 ceph-mon[32679]: pgmap v4053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6469.342657 secs 2024-04-26T20:06:15.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5772.324635 secs 2024-04-26T20:06:15.263 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:14 smithi092 ceph-mon[29156]: pgmap v4053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:16 smithi189 ceph-mon[32756]: pgmap v4054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:17.254 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:16 smithi092 ceph-mon[29156]: pgmap v4054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:17.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:16 smithi156 ceph-mon[32679]: pgmap v4054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:18 smithi189 ceph-mon[32756]: pgmap v4055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:18 smithi156 ceph-mon[32679]: pgmap v4055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:18 smithi092 ceph-mon[29156]: pgmap v4055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6474.342802 secs 2024-04-26T20:06:20.163 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5777.324707 secs 2024-04-26T20:06:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6474.342802 secs 2024-04-26T20:06:20.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5777.324707 secs 2024-04-26T20:06:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6474.342802 secs 2024-04-26T20:06:20.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5777.324707 secs 2024-04-26T20:06:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:20 smithi189 ceph-mon[32756]: pgmap v4056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:20 smithi156 ceph-mon[32679]: pgmap v4056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:20 smithi092 ceph-mon[29156]: pgmap v4056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:22 smithi189 ceph-mon[32756]: pgmap v4057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:22 smithi156 ceph-mon[32679]: pgmap v4057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:22 smithi092 ceph-mon[29156]: pgmap v4057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6479.342920 secs 2024-04-26T20:06:25.179 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5782.324802 secs 2024-04-26T20:06:25.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:24 smithi189 ceph-mon[32756]: pgmap v4058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:25.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6479.342920 secs 2024-04-26T20:06:25.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5782.324802 secs 2024-04-26T20:06:25.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:24 smithi156 ceph-mon[32679]: pgmap v4058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:25.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6479.342920 secs 2024-04-26T20:06:25.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5782.324802 secs 2024-04-26T20:06:25.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:24 smithi092 ceph-mon[29156]: pgmap v4058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:26 smithi189 ceph-mon[32756]: pgmap v4059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:26 smithi156 ceph-mon[32679]: pgmap v4059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:26 smithi092 ceph-mon[29156]: pgmap v4059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:06:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: pgmap v4060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:29.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:29.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:29.179 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: pgmap v4061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:06:29.187 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: pgmap v4062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:29.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:06:29.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: pgmap v4060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:29.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:29.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:29.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: pgmap v4061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:06:29.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: pgmap v4062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:29.286 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:06:29.403 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: pgmap v4060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:29.409 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:06:29.418 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:06:29.426 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: pgmap v4061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:06:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: pgmap v4062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:29.515 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:06:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6484.342993 secs 2024-04-26T20:06:30.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5787.324925 secs 2024-04-26T20:06:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6484.342993 secs 2024-04-26T20:06:30.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5787.324925 secs 2024-04-26T20:06:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6484.342993 secs 2024-04-26T20:06:30.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5787.324925 secs 2024-04-26T20:06:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:30 smithi189 ceph-mon[32756]: pgmap v4063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:30 smithi156 ceph-mon[32679]: pgmap v4063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:30 smithi092 ceph-mon[29156]: pgmap v4063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:33 smithi189 ceph-mon[32756]: pgmap v4064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:33 smithi156 ceph-mon[32679]: pgmap v4064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:33 smithi092 ceph-mon[29156]: pgmap v4064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:06:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6489.343120 secs 2024-04-26T20:06:34.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5792.325058 secs 2024-04-26T20:06:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6489.343120 secs 2024-04-26T20:06:34.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5792.325058 secs 2024-04-26T20:06:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6489.343120 secs 2024-04-26T20:06:35.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5792.325058 secs 2024-04-26T20:06:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:35 smithi189 ceph-mon[32756]: pgmap v4065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:35 smithi156 ceph-mon[32679]: pgmap v4065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:35 smithi092 ceph-mon[29156]: pgmap v4065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:06:36.864+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:06:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:06:36.864+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:06:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:06:36.864+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:06:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:06:36.864+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 54 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:06:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:37 smithi189 ceph-mon[32756]: pgmap v4066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:37 smithi156 ceph-mon[32679]: pgmap v4066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:37 smithi092 ceph-mon[29156]: pgmap v4066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:06:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6494.343253 secs 2024-04-26T20:06:39.916 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5797.325185 secs 2024-04-26T20:06:39.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:39 smithi189 ceph-mon[32756]: pgmap v4067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T20:06:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6494.343253 secs 2024-04-26T20:06:39.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5797.325185 secs 2024-04-26T20:06:39.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:39 smithi156 ceph-mon[32679]: pgmap v4067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T20:06:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6494.343253 secs 2024-04-26T20:06:40.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5797.325185 secs 2024-04-26T20:06:40.009 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:39 smithi092 ceph-mon[29156]: pgmap v4067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T20:06:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:41 smithi189 ceph-mon[32756]: pgmap v4068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:42.087 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:41 smithi092 ceph-mon[29156]: pgmap v4068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:42.749 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:41 smithi156 ceph-mon[32679]: pgmap v4068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:42 smithi189 ceph-mon[32756]: pgmap v4069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:42 smithi156 ceph-mon[32679]: pgmap v4069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:42 smithi092 ceph-mon[29156]: pgmap v4069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6499.343388 secs 2024-04-26T20:06:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6499.343388 secs 2024-04-26T20:06:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6499.343388 secs 2024-04-26T20:06:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5802.325331 secs 2024-04-26T20:06:45.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:45 smithi189 ceph-mon[32756]: pgmap v4070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5802.325331 secs 2024-04-26T20:06:45.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:45 smithi156 ceph-mon[32679]: pgmap v4070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5802.325331 secs 2024-04-26T20:06:45.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:45 smithi092 ceph-mon[29156]: pgmap v4070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:47 smithi189 ceph-mon[32756]: pgmap v4071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:47 smithi156 ceph-mon[32679]: pgmap v4071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:47 smithi092 ceph-mon[29156]: pgmap v4071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6504.343510 secs 2024-04-26T20:06:49.908 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5807.325453 secs 2024-04-26T20:06:49.919 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:49 smithi189 ceph-mon[32756]: pgmap v4072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6504.343510 secs 2024-04-26T20:06:49.948 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5807.325453 secs 2024-04-26T20:06:49.959 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:49 smithi156 ceph-mon[32679]: pgmap v4072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6504.343510 secs 2024-04-26T20:06:50.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5807.325453 secs 2024-04-26T20:06:50.015 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:49 smithi092 ceph-mon[29156]: pgmap v4072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:06:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:51 smithi189 ceph-mon[32756]: pgmap v4073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:51 smithi156 ceph-mon[32679]: pgmap v4073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:51 smithi092 ceph-mon[29156]: pgmap v4073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:06:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:53 smithi189 ceph-mon[32756]: pgmap v4074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:53 smithi156 ceph-mon[32679]: pgmap v4074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:53 smithi092 ceph-mon[29156]: pgmap v4074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6509.343639 secs 2024-04-26T20:06:54.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5812.325515 secs 2024-04-26T20:06:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6509.343639 secs 2024-04-26T20:06:54.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5812.325515 secs 2024-04-26T20:06:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6509.343639 secs 2024-04-26T20:06:55.004 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5812.325515 secs 2024-04-26T20:06:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:55 smithi189 ceph-mon[32756]: pgmap v4075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:55.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:55 smithi092 ceph-mon[29156]: pgmap v4075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:55 smithi156 ceph-mon[32679]: pgmap v4075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:06:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:56 smithi189 ceph-mon[32756]: pgmap v4076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:56 smithi156 ceph-mon[32679]: pgmap v4076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:56 smithi092 ceph-mon[29156]: pgmap v4076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6514.343763 secs 2024-04-26T20:06:59.956 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5817.325578 secs 2024-04-26T20:06:59.963 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:06:59 smithi189 ceph-mon[32756]: pgmap v4077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:59.972 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6514.343763 secs 2024-04-26T20:06:59.979 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5817.325578 secs 2024-04-26T20:06:59.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:06:59 smithi156 ceph-mon[32679]: pgmap v4077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:06:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6514.343763 secs 2024-04-26T20:07:00.020 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5817.325578 secs 2024-04-26T20:07:00.029 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:06:59 smithi092 ceph-mon[29156]: pgmap v4077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:01 smithi189 ceph-mon[32756]: pgmap v4078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:01 smithi156 ceph-mon[32679]: pgmap v4078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:01 smithi092 ceph-mon[29156]: pgmap v4078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:03 smithi189 ceph-mon[32756]: pgmap v4079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:03.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:03 smithi156 ceph-mon[32679]: pgmap v4079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:03 smithi092 ceph-mon[29156]: pgmap v4079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6519.343879 secs 2024-04-26T20:07:04.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5822.325691 secs 2024-04-26T20:07:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6519.343879 secs 2024-04-26T20:07:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5822.325691 secs 2024-04-26T20:07:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6519.343879 secs 2024-04-26T20:07:05.057 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5822.325691 secs 2024-04-26T20:07:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:05 smithi189 ceph-mon[32756]: pgmap v4080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:05 smithi156 ceph-mon[32679]: pgmap v4080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:05 smithi092 ceph-mon[29156]: pgmap v4080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:06 smithi189 ceph-mon[32756]: pgmap v4081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:06 smithi156 ceph-mon[32679]: pgmap v4081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:06 smithi092 ceph-mon[29156]: pgmap v4081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:09.885 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6524.343992 secs 2024-04-26T20:07:09.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5827.325759 secs 2024-04-26T20:07:09.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:09 smithi092 ceph-mon[29156]: pgmap v4082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:09.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6524.343992 secs 2024-04-26T20:07:09.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5827.325759 secs 2024-04-26T20:07:09.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:09 smithi189 ceph-mon[32756]: pgmap v4082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6524.343992 secs 2024-04-26T20:07:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5827.325759 secs 2024-04-26T20:07:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:09 smithi156 ceph-mon[32679]: pgmap v4082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:11 smithi189 ceph-mon[32756]: pgmap v4083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:11 smithi156 ceph-mon[32679]: pgmap v4083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:11 smithi092 ceph-mon[29156]: pgmap v4083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:13 smithi189 ceph-mon[32756]: pgmap v4084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:13 smithi156 ceph-mon[32679]: pgmap v4084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:13 smithi092 ceph-mon[29156]: pgmap v4084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6529.344104 secs 2024-04-26T20:07:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5832.325849 secs 2024-04-26T20:07:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6529.344104 secs 2024-04-26T20:07:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5832.325849 secs 2024-04-26T20:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6529.344104 secs 2024-04-26T20:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5832.325849 secs 2024-04-26T20:07:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:15 smithi189 ceph-mon[32756]: pgmap v4085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:15 smithi156 ceph-mon[32679]: pgmap v4085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:15 smithi092 ceph-mon[29156]: pgmap v4085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:16 smithi189 ceph-mon[32756]: pgmap v4086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:16 smithi156 ceph-mon[32679]: pgmap v4086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:16 smithi092 ceph-mon[29156]: pgmap v4086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6534.344202 secs 2024-04-26T20:07:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5837.325939 secs 2024-04-26T20:07:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:19 smithi189 ceph-mon[32756]: pgmap v4087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6534.344202 secs 2024-04-26T20:07:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5837.325939 secs 2024-04-26T20:07:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:19 smithi156 ceph-mon[32679]: pgmap v4087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6534.344202 secs 2024-04-26T20:07:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5837.325939 secs 2024-04-26T20:07:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:19 smithi092 ceph-mon[29156]: pgmap v4087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:21 smithi189 ceph-mon[32756]: pgmap v4088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:21 smithi156 ceph-mon[32679]: pgmap v4088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:21 smithi092 ceph-mon[29156]: pgmap v4088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:23 smithi189 ceph-mon[32756]: pgmap v4089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:23 smithi156 ceph-mon[32679]: pgmap v4089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:23 smithi092 ceph-mon[29156]: pgmap v4089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6539.344321 secs 2024-04-26T20:07:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5842.326052 secs 2024-04-26T20:07:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6539.344321 secs 2024-04-26T20:07:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5842.326052 secs 2024-04-26T20:07:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6539.344321 secs 2024-04-26T20:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5842.326052 secs 2024-04-26T20:07:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:25 smithi189 ceph-mon[32756]: pgmap v4090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:25.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:25 smithi092 ceph-mon[29156]: pgmap v4090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:25 smithi156 ceph-mon[32679]: pgmap v4090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:26 smithi189 ceph-mon[32756]: pgmap v4091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:26 smithi156 ceph-mon[32679]: pgmap v4091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:26 smithi092 ceph-mon[29156]: pgmap v4091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6544.344443 secs 2024-04-26T20:07:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5847.326136 secs 2024-04-26T20:07:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: pgmap v4092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6544.344443 secs 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5847.326136 secs 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: pgmap v4092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6544.344443 secs 2024-04-26T20:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5847.326136 secs 2024-04-26T20:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: pgmap v4092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:07:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:30 smithi189 ceph-mon[32756]: pgmap v4093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:07:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:30 smithi189 ceph-mon[32756]: pgmap v4094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:30 smithi156 ceph-mon[32679]: pgmap v4093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:07:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:30 smithi156 ceph-mon[32679]: pgmap v4094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:30 smithi092 ceph-mon[29156]: pgmap v4093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:07:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:30 smithi092 ceph-mon[29156]: pgmap v4094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:31 smithi189 ceph-mon[32756]: pgmap v4095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:31 smithi156 ceph-mon[32679]: pgmap v4095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:31 smithi092 ceph-mon[29156]: pgmap v4095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6549.344584 secs 2024-04-26T20:07:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:34 smithi189 ceph-mon[32756]: pgmap v4096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5852.326284 secs 2024-04-26T20:07:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6549.344584 secs 2024-04-26T20:07:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:34 smithi156 ceph-mon[32679]: pgmap v4096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5852.326284 secs 2024-04-26T20:07:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6549.344584 secs 2024-04-26T20:07:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:34 smithi092 ceph-mon[29156]: pgmap v4096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:07:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5852.326284 secs 2024-04-26T20:07:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:36 smithi189 ceph-mon[32756]: pgmap v4097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:36 smithi156 ceph-mon[32679]: pgmap v4097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:36 smithi092 ceph-mon[29156]: pgmap v4097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:07:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:38 smithi189 ceph-mon[32756]: pgmap v4098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:07:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:38 smithi156 ceph-mon[32679]: pgmap v4098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:07:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:38 smithi092 ceph-mon[29156]: pgmap v4098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:07:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6554.344697 secs 2024-04-26T20:07:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5857.326376 secs 2024-04-26T20:07:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6554.344697 secs 2024-04-26T20:07:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5857.326376 secs 2024-04-26T20:07:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6554.344697 secs 2024-04-26T20:07:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5857.326376 secs 2024-04-26T20:07:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:40 smithi189 ceph-mon[32756]: pgmap v4099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:07:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:40 smithi156 ceph-mon[32679]: pgmap v4099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:07:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:40 smithi092 ceph-mon[29156]: pgmap v4099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:07:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:42 smithi189 ceph-mon[32756]: pgmap v4100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:42 smithi156 ceph-mon[32679]: pgmap v4100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:42 smithi092 ceph-mon[29156]: pgmap v4100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6559.344857 secs 2024-04-26T20:07:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:44 smithi189 ceph-mon[32756]: pgmap v4101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5862.326460 secs 2024-04-26T20:07:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6559.344857 secs 2024-04-26T20:07:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:44 smithi156 ceph-mon[32679]: pgmap v4101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5862.326460 secs 2024-04-26T20:07:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6559.344857 secs 2024-04-26T20:07:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:44 smithi092 ceph-mon[29156]: pgmap v4101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5862.326460 secs 2024-04-26T20:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:46 smithi189 ceph-mon[32756]: pgmap v4102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:46 smithi156 ceph-mon[32679]: pgmap v4102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:46 smithi092 ceph-mon[29156]: pgmap v4102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:48 smithi189 ceph-mon[32756]: pgmap v4103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:48 smithi156 ceph-mon[32679]: pgmap v4103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:48 smithi092 ceph-mon[29156]: pgmap v4103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6564.345205 secs 2024-04-26T20:07:49.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5867.326525 secs 2024-04-26T20:07:49.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6564.345205 secs 2024-04-26T20:07:49.707 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5867.326525 secs 2024-04-26T20:07:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6564.345205 secs 2024-04-26T20:07:49.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5867.326525 secs 2024-04-26T20:07:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:50 smithi189 ceph-mon[32756]: pgmap v4104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:50.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:50 smithi092 ceph-mon[29156]: pgmap v4104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:50.803 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:50 smithi156 ceph-mon[32679]: pgmap v4104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:07:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:52 smithi189 ceph-mon[32756]: pgmap v4105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:52.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:52 smithi092 ceph-mon[29156]: pgmap v4105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:52.758 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:52 smithi156 ceph-mon[32679]: pgmap v4105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6569.345300 secs 2024-04-26T20:07:54.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:54 smithi189 ceph-mon[32756]: pgmap v4106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:54.669 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5872.326588 secs 2024-04-26T20:07:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6569.345300 secs 2024-04-26T20:07:54.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:54 smithi156 ceph-mon[32679]: pgmap v4106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:54.710 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5872.326588 secs 2024-04-26T20:07:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6569.345300 secs 2024-04-26T20:07:54.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:54 smithi092 ceph-mon[29156]: pgmap v4106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:07:54.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5872.326588 secs 2024-04-26T20:07:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:56 smithi189 ceph-mon[32756]: pgmap v4107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:07:56.713 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:56 smithi156 ceph-mon[32679]: pgmap v4107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:07:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:56 smithi092 ceph-mon[29156]: pgmap v4107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:07:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:58 smithi189 ceph-mon[32756]: pgmap v4108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:07:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:58 smithi156 ceph-mon[32679]: pgmap v4108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:07:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:58 smithi092 ceph-mon[29156]: pgmap v4108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:07:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6574.345411 secs 2024-04-26T20:07:59.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:07:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5877.326654 secs 2024-04-26T20:07:59.696 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6574.345411 secs 2024-04-26T20:07:59.703 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:07:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5877.326654 secs 2024-04-26T20:07:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6574.345411 secs 2024-04-26T20:07:59.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:07:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5877.326654 secs 2024-04-26T20:08:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:00 smithi189 ceph-mon[32756]: pgmap v4109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:00 smithi156 ceph-mon[32679]: pgmap v4109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:00 smithi092 ceph-mon[29156]: pgmap v4109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:02 smithi189 ceph-mon[32756]: pgmap v4110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:02.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:02 smithi092 ceph-mon[29156]: pgmap v4110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:02.818 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:02 smithi156 ceph-mon[32679]: pgmap v4110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6579.345534 secs 2024-04-26T20:08:04.744 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:04 smithi189 ceph-mon[32756]: pgmap v4111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:04.751 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5882.326738 secs 2024-04-26T20:08:04.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6579.345534 secs 2024-04-26T20:08:04.767 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:04 smithi092 ceph-mon[29156]: pgmap v4111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:04.774 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5882.326738 secs 2024-04-26T20:08:04.781 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6579.345534 secs 2024-04-26T20:08:04.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:04 smithi156 ceph-mon[32679]: pgmap v4111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:08:04.795 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5882.326738 secs 2024-04-26T20:08:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:06 smithi189 ceph-mon[32756]: pgmap v4112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:06 smithi156 ceph-mon[32679]: pgmap v4112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:06 smithi092 ceph-mon[29156]: pgmap v4112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:08:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:08 smithi156 ceph-mon[32679]: pgmap v4113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:08 smithi092 ceph-mon[29156]: pgmap v4113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:08 smithi189 ceph-mon[32756]: pgmap v4113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6584.345624 secs 2024-04-26T20:08:09.747 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5887.326829 secs 2024-04-26T20:08:09.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6584.345624 secs 2024-04-26T20:08:09.762 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5887.326829 secs 2024-04-26T20:08:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6584.345624 secs 2024-04-26T20:08:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5887.326829 secs 2024-04-26T20:08:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:10 smithi156 ceph-mon[32679]: pgmap v4114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:10 smithi092 ceph-mon[29156]: pgmap v4114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:10 smithi189 ceph-mon[32756]: pgmap v4114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:12 smithi189 ceph-mon[32756]: pgmap v4115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:12.707 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:12 smithi156 ceph-mon[32679]: pgmap v4115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:12 smithi092 ceph-mon[29156]: pgmap v4115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6589.345732 secs 2024-04-26T20:08:14.657 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:14 smithi189 ceph-mon[32756]: pgmap v4116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:14.662 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5892.326977 secs 2024-04-26T20:08:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6589.345732 secs 2024-04-26T20:08:14.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:14 smithi156 ceph-mon[32679]: pgmap v4116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:14.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5892.326977 secs 2024-04-26T20:08:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6589.345732 secs 2024-04-26T20:08:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:14 smithi092 ceph-mon[29156]: pgmap v4116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:14.759 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5892.326977 secs 2024-04-26T20:08:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:16 smithi189 ceph-mon[32756]: pgmap v4117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:16.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:16 smithi156 ceph-mon[32679]: pgmap v4117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:16 smithi092 ceph-mon[29156]: pgmap v4117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:18 smithi189 ceph-mon[32756]: pgmap v4118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:18.715 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:18 smithi156 ceph-mon[32679]: pgmap v4118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:18 smithi092 ceph-mon[29156]: pgmap v4118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6594.345851 secs 2024-04-26T20:08:19.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5897.327103 secs 2024-04-26T20:08:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6594.345851 secs 2024-04-26T20:08:19.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5897.327103 secs 2024-04-26T20:08:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6594.345851 secs 2024-04-26T20:08:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5897.327103 secs 2024-04-26T20:08:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:20 smithi189 ceph-mon[32756]: pgmap v4119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:20 smithi156 ceph-mon[32679]: pgmap v4119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:20 smithi092 ceph-mon[29156]: pgmap v4119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:22 smithi189 ceph-mon[32756]: pgmap v4120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:22 smithi156 ceph-mon[32679]: pgmap v4120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:22 smithi092 ceph-mon[29156]: pgmap v4120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6599.345927 secs 2024-04-26T20:08:24.699 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:24 smithi189 ceph-mon[32756]: pgmap v4121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:24.705 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5902.327163 secs 2024-04-26T20:08:24.713 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6599.345927 secs 2024-04-26T20:08:24.720 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:24 smithi156 ceph-mon[32679]: pgmap v4121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:24.727 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5902.327163 secs 2024-04-26T20:08:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6599.345927 secs 2024-04-26T20:08:24.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:24 smithi092 ceph-mon[29156]: pgmap v4121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:24.757 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5902.327163 secs 2024-04-26T20:08:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:26 smithi189 ceph-mon[32756]: pgmap v4122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:26 smithi156 ceph-mon[32679]: pgmap v4122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:26 smithi092 ceph-mon[29156]: pgmap v4122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:28 smithi189 ceph-mon[32756]: pgmap v4123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:28 smithi156 ceph-mon[32679]: pgmap v4123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:28.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:28 smithi092 ceph-mon[29156]: pgmap v4123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6604.346054 secs 2024-04-26T20:08:29.666 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5907.327227 secs 2024-04-26T20:08:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6604.346054 secs 2024-04-26T20:08:29.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5907.327227 secs 2024-04-26T20:08:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6604.346054 secs 2024-04-26T20:08:29.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5907.327227 secs 2024-04-26T20:08:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:30 smithi189 ceph-mon[32756]: pgmap v4124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:30.661 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:30.668 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:30.676 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:30.684 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:08:30.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:30 smithi156 ceph-mon[32679]: pgmap v4124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:30.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:30.708 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:30.714 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:30.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:08:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:30 smithi092 ceph-mon[29156]: pgmap v4124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:30.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:08:30.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:08:30.805 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:08:30.814 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:08:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:31 smithi189 ceph-mon[32756]: pgmap v4125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:08:31.678 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:31 smithi189 ceph-mon[32756]: pgmap v4126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:31 smithi156 ceph-mon[32679]: pgmap v4125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:08:31.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:31 smithi156 ceph-mon[32679]: pgmap v4126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:31 smithi092 ceph-mon[29156]: pgmap v4125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:08:31.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:31 smithi092 ceph-mon[29156]: pgmap v4126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:33 smithi189 ceph-mon[32756]: pgmap v4127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:33 smithi156 ceph-mon[32679]: pgmap v4127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:33 smithi092 ceph-mon[29156]: pgmap v4127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6609.346186 secs 2024-04-26T20:08:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5912.327292 secs 2024-04-26T20:08:34.699 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6609.346186 secs 2024-04-26T20:08:34.707 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5912.327292 secs 2024-04-26T20:08:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6609.346186 secs 2024-04-26T20:08:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5912.327292 secs 2024-04-26T20:08:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:35 smithi189 ceph-mon[32756]: pgmap v4128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:35 smithi156 ceph-mon[32679]: pgmap v4128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:35 smithi092 ceph-mon[29156]: pgmap v4128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:37 smithi189 ceph-mon[32756]: pgmap v4129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:37 smithi156 ceph-mon[32679]: pgmap v4129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:37 smithi092 ceph-mon[29156]: pgmap v4129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:08:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:39 smithi189 ceph-mon[32756]: pgmap v4130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:08:39.655 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6614.346306 secs 2024-04-26T20:08:39.664 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5917.327316 secs 2024-04-26T20:08:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:39 smithi156 ceph-mon[32679]: pgmap v4130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:08:39.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6614.346306 secs 2024-04-26T20:08:39.700 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5917.327316 secs 2024-04-26T20:08:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:39 smithi092 ceph-mon[29156]: pgmap v4130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:08:39.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6614.346306 secs 2024-04-26T20:08:39.761 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5917.327316 secs 2024-04-26T20:08:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:41 smithi156 ceph-mon[32679]: pgmap v4131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:08:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:41 smithi092 ceph-mon[29156]: pgmap v4131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:08:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:41 smithi189 ceph-mon[32756]: pgmap v4131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:08:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:43 smithi156 ceph-mon[32679]: pgmap v4132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:43 smithi092 ceph-mon[29156]: pgmap v4132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:43 smithi189 ceph-mon[32756]: pgmap v4132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6619.346436 secs 2024-04-26T20:08:44.701 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5922.327380 secs 2024-04-26T20:08:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6619.346436 secs 2024-04-26T20:08:44.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5922.327380 secs 2024-04-26T20:08:44.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6619.346436 secs 2024-04-26T20:08:44.798 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5922.327380 secs 2024-04-26T20:08:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:45 smithi156 ceph-mon[32679]: pgmap v4133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:45 smithi092 ceph-mon[29156]: pgmap v4133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:45 smithi189 ceph-mon[32756]: pgmap v4133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:47 smithi156 ceph-mon[32679]: pgmap v4134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:47 smithi092 ceph-mon[29156]: pgmap v4134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:47 smithi189 ceph-mon[32756]: pgmap v4134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:49 smithi156 ceph-mon[32679]: pgmap v4135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:49.707 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6624.346550 secs 2024-04-26T20:08:49.714 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5927.327453 secs 2024-04-26T20:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:49 smithi092 ceph-mon[29156]: pgmap v4135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:49.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6624.346550 secs 2024-04-26T20:08:49.811 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5927.327453 secs 2024-04-26T20:08:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:49 smithi189 ceph-mon[32756]: pgmap v4135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:49.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6624.346550 secs 2024-04-26T20:08:49.954 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5927.327453 secs 2024-04-26T20:08:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:51 smithi156 ceph-mon[32679]: pgmap v4136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:51.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:51 smithi092 ceph-mon[29156]: pgmap v4136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:51 smithi189 ceph-mon[32756]: pgmap v4136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:53 smithi156 ceph-mon[32679]: pgmap v4137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:53.971 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:53 smithi189 ceph-mon[32756]: pgmap v4137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:54.023 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:53 smithi092 ceph-mon[29156]: pgmap v4137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6629.346642 secs 2024-04-26T20:08:54.707 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5932.327533 secs 2024-04-26T20:08:54.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6629.346642 secs 2024-04-26T20:08:54.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5932.327533 secs 2024-04-26T20:08:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6629.346642 secs 2024-04-26T20:08:54.929 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5932.327533 secs 2024-04-26T20:08:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:55 smithi156 ceph-mon[32679]: pgmap v4138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:55.761 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:55 smithi092 ceph-mon[29156]: pgmap v4138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:55 smithi189 ceph-mon[32756]: pgmap v4138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:08:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:57 smithi156 ceph-mon[32679]: pgmap v4139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:57 smithi092 ceph-mon[29156]: pgmap v4139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:57 smithi189 ceph-mon[32756]: pgmap v4139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:59 smithi156 ceph-mon[32679]: pgmap v4140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:59.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6634.346768 secs 2024-04-26T20:08:59.747 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:08:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5937.327605 secs 2024-04-26T20:08:59.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:59 smithi092 ceph-mon[29156]: pgmap v4140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:59.762 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6634.346768 secs 2024-04-26T20:08:59.769 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:08:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5937.327605 secs 2024-04-26T20:08:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:59 smithi189 ceph-mon[32756]: pgmap v4140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:08:59.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6634.346768 secs 2024-04-26T20:08:59.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:08:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5937.327605 secs 2024-04-26T20:09:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:01 smithi156 ceph-mon[32679]: pgmap v4141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:01.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:01 smithi092 ceph-mon[29156]: pgmap v4141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:01 smithi189 ceph-mon[32756]: pgmap v4141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:03 smithi092 ceph-mon[29156]: pgmap v4142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:03 smithi189 ceph-mon[32756]: pgmap v4142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:03 smithi156 ceph-mon[32679]: pgmap v4142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6639.346897 secs 2024-04-26T20:09:04.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5942.327679 secs 2024-04-26T20:09:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6639.346897 secs 2024-04-26T20:09:04.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5942.327679 secs 2024-04-26T20:09:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6639.346897 secs 2024-04-26T20:09:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5942.327679 secs 2024-04-26T20:09:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:05 smithi092 ceph-mon[29156]: pgmap v4143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:05 smithi189 ceph-mon[32756]: pgmap v4143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:05 smithi156 ceph-mon[32679]: pgmap v4143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:07 smithi092 ceph-mon[29156]: pgmap v4144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:07 smithi189 ceph-mon[32756]: pgmap v4144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:07 smithi156 ceph-mon[32679]: pgmap v4144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:09 smithi092 ceph-mon[29156]: pgmap v4145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:09.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6644.347031 secs 2024-04-26T20:09:09.787 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5947.327817 secs 2024-04-26T20:09:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:09 smithi189 ceph-mon[32756]: pgmap v4145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6644.347031 secs 2024-04-26T20:09:09.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5947.327817 secs 2024-04-26T20:09:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:09 smithi156 ceph-mon[32679]: pgmap v4145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:09.969 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6644.347031 secs 2024-04-26T20:09:09.999 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5947.327817 secs 2024-04-26T20:09:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:11 smithi092 ceph-mon[29156]: pgmap v4146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:11 smithi189 ceph-mon[32756]: pgmap v4146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:11 smithi156 ceph-mon[32679]: pgmap v4146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:13.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:13 smithi156 ceph-mon[32679]: pgmap v4147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:13 smithi092 ceph-mon[29156]: pgmap v4147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:13 smithi189 ceph-mon[32756]: pgmap v4147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6649.347172 secs 2024-04-26T20:09:14.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5952.327960 secs 2024-04-26T20:09:14.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6649.347172 secs 2024-04-26T20:09:14.798 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5952.327960 secs 2024-04-26T20:09:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6649.347172 secs 2024-04-26T20:09:14.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5952.327960 secs 2024-04-26T20:09:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:15 smithi092 ceph-mon[29156]: pgmap v4148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:15 smithi189 ceph-mon[32756]: pgmap v4148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:15 smithi156 ceph-mon[32679]: pgmap v4148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:17 smithi092 ceph-mon[29156]: pgmap v4149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:17 smithi189 ceph-mon[32756]: pgmap v4149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:17 smithi156 ceph-mon[32679]: pgmap v4149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:19 smithi092 ceph-mon[29156]: pgmap v4150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:19.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6654.347298 secs 2024-04-26T20:09:19.792 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5957.328036 secs 2024-04-26T20:09:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:19 smithi189 ceph-mon[32756]: pgmap v4150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:19.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6654.347298 secs 2024-04-26T20:09:19.907 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5957.328036 secs 2024-04-26T20:09:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:19 smithi156 ceph-mon[32679]: pgmap v4150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:19.946 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6654.347298 secs 2024-04-26T20:09:19.970 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5957.328036 secs 2024-04-26T20:09:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:21 smithi092 ceph-mon[29156]: pgmap v4151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:21 smithi189 ceph-mon[32756]: pgmap v4151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:21.949 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:21 smithi156 ceph-mon[32679]: pgmap v4151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:23 smithi092 ceph-mon[29156]: pgmap v4152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:23 smithi189 ceph-mon[32756]: pgmap v4152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:23 smithi156 ceph-mon[32679]: pgmap v4152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6659.347421 secs 2024-04-26T20:09:24.807 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5962.328173 secs 2024-04-26T20:09:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6659.347421 secs 2024-04-26T20:09:24.905 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5962.328173 secs 2024-04-26T20:09:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6659.347421 secs 2024-04-26T20:09:24.945 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5962.328173 secs 2024-04-26T20:09:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:25 smithi092 ceph-mon[29156]: pgmap v4153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:25 smithi189 ceph-mon[32756]: pgmap v4153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:25 smithi156 ceph-mon[32679]: pgmap v4153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:27 smithi092 ceph-mon[29156]: pgmap v4154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:27 smithi189 ceph-mon[32756]: pgmap v4154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:27 smithi156 ceph-mon[32679]: pgmap v4154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:29 smithi092 ceph-mon[29156]: pgmap v4155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:29.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6664.347493 secs 2024-04-26T20:09:29.786 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5967.328334 secs 2024-04-26T20:09:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:29 smithi189 ceph-mon[32756]: pgmap v4155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6664.347493 secs 2024-04-26T20:09:29.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5967.328334 secs 2024-04-26T20:09:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:29 smithi156 ceph-mon[32679]: pgmap v4155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:29.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6664.347493 secs 2024-04-26T20:09:29.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5967.328334 secs 2024-04-26T20:09:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:09:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:31 smithi189 ceph-mon[32756]: pgmap v4156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:31.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:31.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:31.966 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:09:31.973 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:31 smithi156 ceph-mon[32679]: pgmap v4156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:31.980 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:32.050 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:32.056 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:09:32.064 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:31 smithi092 ceph-mon[29156]: pgmap v4156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:32.073 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:09:32.082 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:09:32.089 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:09:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:32 smithi189 ceph-mon[32756]: pgmap v4157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:09:32.908 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:32 smithi189 ceph-mon[32756]: pgmap v4158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:32 smithi156 ceph-mon[32679]: pgmap v4157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:09:32.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:32 smithi156 ceph-mon[32679]: pgmap v4158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:32 smithi092 ceph-mon[29156]: pgmap v4157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:09:33.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:32 smithi092 ceph-mon[29156]: pgmap v4158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:34 smithi189 ceph-mon[32756]: pgmap v4159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:09:34.933 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6669.347589 secs 2024-04-26T20:09:34.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5972.328462 secs 2024-04-26T20:09:34.945 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:34 smithi156 ceph-mon[32679]: pgmap v4159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:09:35.003 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6669.347589 secs 2024-04-26T20:09:35.009 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5972.328462 secs 2024-04-26T20:09:35.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:34 smithi092 ceph-mon[29156]: pgmap v4159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:09:35.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6669.347589 secs 2024-04-26T20:09:35.030 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5972.328462 secs 2024-04-26T20:09:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:36 smithi189 ceph-mon[32756]: pgmap v4160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:36.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:36 smithi156 ceph-mon[32679]: pgmap v4160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:09:36.890+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:09:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:09:36.890+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:09:36.979 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:09:36.890+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:09:36.987 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:09:36.890+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 55 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:09:37.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:36 smithi092 ceph-mon[29156]: pgmap v4160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:38 smithi189 ceph-mon[32756]: pgmap v4161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:38 smithi156 ceph-mon[32679]: pgmap v4161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:38 smithi092 ceph-mon[29156]: pgmap v4161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6674.347706 secs 2024-04-26T20:09:39.906 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5977.328572 secs 2024-04-26T20:09:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6674.347706 secs 2024-04-26T20:09:39.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5977.328572 secs 2024-04-26T20:09:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6674.347706 secs 2024-04-26T20:09:40.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5977.328572 secs 2024-04-26T20:09:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:40 smithi189 ceph-mon[32756]: pgmap v4162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:40.964 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:40 smithi156 ceph-mon[32679]: pgmap v4162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:40 smithi092 ceph-mon[29156]: pgmap v4162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:09:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:42 smithi189 ceph-mon[32756]: pgmap v4163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:09:43.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:42 smithi092 ceph-mon[29156]: pgmap v4163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:09:43.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:42 smithi156 ceph-mon[32679]: pgmap v4163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:09:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:44 smithi189 ceph-mon[32756]: pgmap v4164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:44.903 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6679.347860 secs 2024-04-26T20:09:44.910 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5982.328660 secs 2024-04-26T20:09:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:44 smithi156 ceph-mon[32679]: pgmap v4164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6679.347860 secs 2024-04-26T20:09:44.946 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5982.328660 secs 2024-04-26T20:09:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:44 smithi092 ceph-mon[29156]: pgmap v4164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:45.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6679.347860 secs 2024-04-26T20:09:45.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5982.328660 secs 2024-04-26T20:09:46.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:46 smithi092 ceph-mon[29156]: pgmap v4165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:46 smithi189 ceph-mon[32756]: pgmap v4165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:46 smithi156 ceph-mon[32679]: pgmap v4165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:48 smithi189 ceph-mon[32756]: pgmap v4166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:48 smithi156 ceph-mon[32679]: pgmap v4166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:48 smithi092 ceph-mon[29156]: pgmap v4166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6684.347967 secs 2024-04-26T20:09:49.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5987.328734 secs 2024-04-26T20:09:49.949 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6684.347967 secs 2024-04-26T20:09:49.955 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5987.328734 secs 2024-04-26T20:09:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6684.347967 secs 2024-04-26T20:09:50.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5987.328734 secs 2024-04-26T20:09:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:50 smithi189 ceph-mon[32756]: pgmap v4167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:50.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:50 smithi156 ceph-mon[32679]: pgmap v4167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:50 smithi092 ceph-mon[29156]: pgmap v4167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:52 smithi189 ceph-mon[32756]: pgmap v4168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:52 smithi156 ceph-mon[32679]: pgmap v4168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:52 smithi092 ceph-mon[29156]: pgmap v4168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:54 smithi189 ceph-mon[32756]: pgmap v4169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:54.919 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6689.348063 secs 2024-04-26T20:09:54.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5992.328804 secs 2024-04-26T20:09:54.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:54 smithi156 ceph-mon[32679]: pgmap v4169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:54.982 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6689.348063 secs 2024-04-26T20:09:54.989 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5992.328804 secs 2024-04-26T20:09:55.050 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:54 smithi092 ceph-mon[29156]: pgmap v4169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:55.167 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6689.348063 secs 2024-04-26T20:09:55.174 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5992.328804 secs 2024-04-26T20:09:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:56 smithi189 ceph-mon[32756]: pgmap v4170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:56 smithi156 ceph-mon[32679]: pgmap v4170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:56 smithi092 ceph-mon[29156]: pgmap v4170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:09:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:58 smithi189 ceph-mon[32756]: pgmap v4171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:58 smithi156 ceph-mon[32679]: pgmap v4171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:58 smithi092 ceph-mon[29156]: pgmap v4171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:09:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6694.348178 secs 2024-04-26T20:09:59.904 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:09:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 5997.328924 secs 2024-04-26T20:09:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6694.348178 secs 2024-04-26T20:09:59.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:09:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 5997.328924 secs 2024-04-26T20:09:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6694.348178 secs 2024-04-26T20:10:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:09:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 5997.328924 secs 2024-04-26T20:10:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:00 smithi189 ceph-mon[32756]: pgmap v4172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:00.920 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:10:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:00 smithi156 ceph-mon[32679]: pgmap v4172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:00.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:10:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:00 smithi092 ceph-mon[29156]: pgmap v4172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:01.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:10:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:02 smithi189 ceph-mon[32756]: pgmap v4173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:02 smithi156 ceph-mon[32679]: pgmap v4173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:02 smithi092 ceph-mon[29156]: pgmap v4173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:04 smithi189 ceph-mon[32756]: pgmap v4174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:04.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6699.348250 secs 2024-04-26T20:10:04.906 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 6002.329025 secs 2024-04-26T20:10:04.915 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:04 smithi189 ceph-mon[32756]: slow request 2881.486929 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:04 smithi156 ceph-mon[32679]: pgmap v4174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:05.032 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6699.348250 secs 2024-04-26T20:10:05.061 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 6002.329025 secs 2024-04-26T20:10:05.074 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:04 smithi156 ceph-mon[32679]: slow request 2881.486929 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:05.091 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:04 smithi092 ceph-mon[29156]: pgmap v4174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:05.099 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6699.348250 secs 2024-04-26T20:10:05.107 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 6002.329025 secs 2024-04-26T20:10:05.116 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:04 smithi092 ceph-mon[29156]: slow request 2881.486929 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:10:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:06 smithi189 ceph-mon[32756]: pgmap v4175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:06.977 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:06 smithi156 ceph-mon[32679]: pgmap v4175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:06 smithi092 ceph-mon[29156]: pgmap v4175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:08 smithi189 ceph-mon[32756]: pgmap v4176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:08 smithi156 ceph-mon[32679]: pgmap v4176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:08 smithi092 ceph-mon[29156]: pgmap v4176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6704.348339 secs 2024-04-26T20:10:09.963 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6007.329149 secs 2024-04-26T20:10:10.015 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6704.348339 secs 2024-04-26T20:10:10.022 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6007.329149 secs 2024-04-26T20:10:10.030 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6704.348339 secs 2024-04-26T20:10:10.036 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6007.329149 secs 2024-04-26T20:10:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:10 smithi189 ceph-mon[32756]: pgmap v4177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:10 smithi156 ceph-mon[32679]: pgmap v4177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:10 smithi092 ceph-mon[29156]: pgmap v4177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:12 smithi189 ceph-mon[32756]: pgmap v4178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:12 smithi156 ceph-mon[32679]: pgmap v4178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:12 smithi092 ceph-mon[29156]: pgmap v4178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:13 smithi156 ceph-mon[32679]: pgmap v4179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:13 smithi092 ceph-mon[29156]: pgmap v4179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:13 smithi189 ceph-mon[32756]: pgmap v4179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T20:10:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6709.348405 secs 2024-04-26T20:10:14.956 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6012.329330 secs 2024-04-26T20:10:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6709.348405 secs 2024-04-26T20:10:15.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6012.329330 secs 2024-04-26T20:10:15.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6709.348405 secs 2024-04-26T20:10:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6012.329330 secs 2024-04-26T20:10:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:15 smithi156 ceph-mon[32679]: pgmap v4180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:15 smithi092 ceph-mon[29156]: pgmap v4180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:15 smithi189 ceph-mon[32756]: pgmap v4180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T20:10:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:17 smithi189 ceph-mon[32756]: pgmap v4181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:17 smithi156 ceph-mon[32679]: pgmap v4181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:17 smithi092 ceph-mon[29156]: pgmap v4181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6714.348527 secs 2024-04-26T20:10:20.246 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6017.329475 secs 2024-04-26T20:10:20.258 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:19 smithi189 ceph-mon[32756]: pgmap v4182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:20.267 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6714.348527 secs 2024-04-26T20:10:20.276 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6017.329475 secs 2024-04-26T20:10:20.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:19 smithi092 ceph-mon[29156]: pgmap v4182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:20.292 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6714.348527 secs 2024-04-26T20:10:20.300 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6017.329475 secs 2024-04-26T20:10:20.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:19 smithi156 ceph-mon[32679]: pgmap v4182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:21 smithi156 ceph-mon[32679]: pgmap v4183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:21 smithi092 ceph-mon[29156]: pgmap v4183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:21 smithi189 ceph-mon[32756]: pgmap v4183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:23 smithi156 ceph-mon[32679]: pgmap v4184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:23 smithi092 ceph-mon[29156]: pgmap v4184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:23 smithi189 ceph-mon[32756]: pgmap v4184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6719.348642 secs 2024-04-26T20:10:25.295 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6022.329606 secs 2024-04-26T20:10:25.302 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6719.348642 secs 2024-04-26T20:10:25.310 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6022.329606 secs 2024-04-26T20:10:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6719.348642 secs 2024-04-26T20:10:25.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6022.329606 secs 2024-04-26T20:10:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:25 smithi156 ceph-mon[32679]: pgmap v4185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:25 smithi092 ceph-mon[29156]: pgmap v4185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:25 smithi189 ceph-mon[32756]: pgmap v4185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:27 smithi156 ceph-mon[32679]: pgmap v4186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:28.270 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:27 smithi092 ceph-mon[29156]: pgmap v4186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:27 smithi189 ceph-mon[32756]: pgmap v4186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6724.348758 secs 2024-04-26T20:10:30.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6027.329730 secs 2024-04-26T20:10:30.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:29 smithi156 ceph-mon[32679]: pgmap v4187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6724.348758 secs 2024-04-26T20:10:30.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6027.329730 secs 2024-04-26T20:10:30.260 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:29 smithi092 ceph-mon[29156]: pgmap v4187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6724.348758 secs 2024-04-26T20:10:30.420 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6027.329730 secs 2024-04-26T20:10:30.428 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:29 smithi189 ceph-mon[32756]: pgmap v4187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:31 smithi156 ceph-mon[32679]: pgmap v4188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:32.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:32.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:32.251 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:32.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:10:32.263 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:31 smithi092 ceph-mon[29156]: pgmap v4188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:32.269 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:32.275 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:32.284 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:32.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:10:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:31 smithi189 ceph-mon[32756]: pgmap v4188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:32.434 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:10:32.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:10:32.449 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:10:32.457 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:10:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-mon[29156]: pgmap v4189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:10:33.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-mon[29156]: pgmap v4190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:10:33.008 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:10:32.719+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:10:33.016 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:10:32.719+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:10:33.084 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:10:32.719+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:10:33.091 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:10:32.719+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:10:33.099 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:10:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:10:32.719+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:10:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:32 smithi156 ceph-mon[32679]: pgmap v4189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:10:33.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:32 smithi156 ceph-mon[32679]: pgmap v4190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:10:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:32 smithi189 ceph-mon[32756]: pgmap v4189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:10:33.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:32 smithi189 ceph-mon[32756]: pgmap v4190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:10:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6729.348867 secs 2024-04-26T20:10:35.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6032.329790 secs 2024-04-26T20:10:35.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:34 smithi156 ceph-mon[32679]: pgmap v4191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T20:10:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6729.348867 secs 2024-04-26T20:10:35.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6032.329790 secs 2024-04-26T20:10:35.261 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:34 smithi092 ceph-mon[29156]: pgmap v4191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T20:10:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6729.348867 secs 2024-04-26T20:10:35.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6032.329790 secs 2024-04-26T20:10:35.407 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:34 smithi189 ceph-mon[32756]: pgmap v4191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 18 op/s 2024-04-26T20:10:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:36 smithi156 ceph-mon[32679]: pgmap v4192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:37.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:36 smithi092 ceph-mon[29156]: pgmap v4192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:36 smithi189 ceph-mon[32756]: pgmap v4192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:38 smithi156 ceph-mon[32679]: pgmap v4193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:38 smithi092 ceph-mon[29156]: pgmap v4193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:38 smithi189 ceph-mon[32756]: pgmap v4193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6734.348983 secs 2024-04-26T20:10:40.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6037.329915 secs 2024-04-26T20:10:40.326 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6734.348983 secs 2024-04-26T20:10:40.333 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6037.329915 secs 2024-04-26T20:10:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6734.348983 secs 2024-04-26T20:10:40.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6037.329915 secs 2024-04-26T20:10:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:40 smithi156 ceph-mon[32679]: pgmap v4194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:40 smithi092 ceph-mon[29156]: pgmap v4194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:40 smithi189 ceph-mon[32756]: pgmap v4194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-26T20:10:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:42 smithi156 ceph-mon[32679]: pgmap v4195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:42 smithi092 ceph-mon[29156]: pgmap v4195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:42 smithi189 ceph-mon[32756]: pgmap v4195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-26T20:10:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6739.349085 secs 2024-04-26T20:10:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6042.330038 secs 2024-04-26T20:10:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:44 smithi156 ceph-mon[32679]: pgmap v4196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:10:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6739.349085 secs 2024-04-26T20:10:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6042.330038 secs 2024-04-26T20:10:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:44 smithi189 ceph-mon[32756]: pgmap v4196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:10:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6739.349085 secs 2024-04-26T20:10:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6042.330038 secs 2024-04-26T20:10:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:44 smithi092 ceph-mon[29156]: pgmap v4196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:10:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:46 smithi156 ceph-mon[32679]: pgmap v4197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:46 smithi092 ceph-mon[29156]: pgmap v4197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:46 smithi189 ceph-mon[32756]: pgmap v4197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:48 smithi092 ceph-mon[29156]: pgmap v4198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:48 smithi189 ceph-mon[32756]: pgmap v4198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:48 smithi156 ceph-mon[32679]: pgmap v4198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6744.349202 secs 2024-04-26T20:10:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6047.330114 secs 2024-04-26T20:10:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6744.349202 secs 2024-04-26T20:10:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6047.330114 secs 2024-04-26T20:10:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6744.349202 secs 2024-04-26T20:10:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6047.330114 secs 2024-04-26T20:10:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:50 smithi092 ceph-mon[29156]: pgmap v4199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:50 smithi189 ceph-mon[32756]: pgmap v4199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:50 smithi156 ceph-mon[32679]: pgmap v4199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:52 smithi092 ceph-mon[29156]: pgmap v4200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:52 smithi189 ceph-mon[32756]: pgmap v4200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:52 smithi156 ceph-mon[32679]: pgmap v4200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6749.349284 secs 2024-04-26T20:10:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6052.330176 secs 2024-04-26T20:10:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:54 smithi092 ceph-mon[29156]: pgmap v4201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6749.349284 secs 2024-04-26T20:10:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6052.330176 secs 2024-04-26T20:10:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:54 smithi189 ceph-mon[32756]: pgmap v4201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6749.349284 secs 2024-04-26T20:10:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6052.330176 secs 2024-04-26T20:10:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:54 smithi156 ceph-mon[32679]: pgmap v4201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:56 smithi092 ceph-mon[29156]: pgmap v4202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:56 smithi189 ceph-mon[32756]: pgmap v4202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:56 smithi156 ceph-mon[32679]: pgmap v4202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:10:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:58 smithi092 ceph-mon[29156]: pgmap v4203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:58 smithi189 ceph-mon[32756]: pgmap v4203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:10:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:58 smithi156 ceph-mon[32679]: pgmap v4203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6754.349378 secs 2024-04-26T20:11:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:10:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6057.330319 secs 2024-04-26T20:11:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6754.349378 secs 2024-04-26T20:11:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:10:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6057.330319 secs 2024-04-26T20:11:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6754.349378 secs 2024-04-26T20:11:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:10:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6057.330319 secs 2024-04-26T20:11:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:00 smithi092 ceph-mon[29156]: pgmap v4204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:00 smithi189 ceph-mon[32756]: pgmap v4204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:00 smithi156 ceph-mon[32679]: pgmap v4204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:02 smithi092 ceph-mon[29156]: pgmap v4205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:02 smithi189 ceph-mon[32756]: pgmap v4205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:02 smithi156 ceph-mon[32679]: pgmap v4205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6759.349493 secs 2024-04-26T20:11:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6062.330441 secs 2024-04-26T20:11:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:04 smithi092 ceph-mon[29156]: pgmap v4206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6759.349493 secs 2024-04-26T20:11:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6062.330441 secs 2024-04-26T20:11:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:04 smithi189 ceph-mon[32756]: pgmap v4206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6759.349493 secs 2024-04-26T20:11:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6062.330441 secs 2024-04-26T20:11:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:04 smithi156 ceph-mon[32679]: pgmap v4206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:07 smithi189 ceph-mon[32756]: pgmap v4207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:11:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:07 smithi156 ceph-mon[32679]: pgmap v4207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:11:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:07 smithi092 ceph-mon[29156]: pgmap v4207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:11:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:09 smithi189 ceph-mon[32756]: pgmap v4208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6764.349604 secs 2024-04-26T20:11:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:09 smithi156 ceph-mon[32679]: pgmap v4208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6764.349604 secs 2024-04-26T20:11:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:09 smithi092 ceph-mon[29156]: pgmap v4208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6764.349604 secs 2024-04-26T20:11:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6067.330640 secs 2024-04-26T20:11:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6067.330640 secs 2024-04-26T20:11:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6067.330640 secs 2024-04-26T20:11:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:11 smithi189 ceph-mon[32756]: pgmap v4209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:11 smithi156 ceph-mon[32679]: pgmap v4209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:11 smithi092 ceph-mon[29156]: pgmap v4209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:13 smithi189 ceph-mon[32756]: pgmap v4210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:13 smithi156 ceph-mon[32679]: pgmap v4210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:13 smithi092 ceph-mon[29156]: pgmap v4210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:11:14.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6769.349715 secs 2024-04-26T20:11:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6769.349715 secs 2024-04-26T20:11:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6769.349715 secs 2024-04-26T20:11:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6072.330700 secs 2024-04-26T20:11:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:15 smithi189 ceph-mon[32756]: pgmap v4211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6072.330700 secs 2024-04-26T20:11:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:15 smithi156 ceph-mon[32679]: pgmap v4211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6072.330700 secs 2024-04-26T20:11:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:15 smithi092 ceph-mon[29156]: pgmap v4211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:11:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:17 smithi189 ceph-mon[32756]: pgmap v4212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:17 smithi156 ceph-mon[32679]: pgmap v4212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:17 smithi092 ceph-mon[29156]: pgmap v4212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:19 smithi189 ceph-mon[32756]: pgmap v4213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6774.349819 secs 2024-04-26T20:11:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:19 smithi156 ceph-mon[32679]: pgmap v4213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6774.349819 secs 2024-04-26T20:11:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:19 smithi092 ceph-mon[29156]: pgmap v4213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6774.349819 secs 2024-04-26T20:11:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6077.330767 secs 2024-04-26T20:11:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6077.330767 secs 2024-04-26T20:11:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6077.330767 secs 2024-04-26T20:11:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:21 smithi189 ceph-mon[32756]: pgmap v4214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:21 smithi156 ceph-mon[32679]: pgmap v4214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:21 smithi092 ceph-mon[29156]: pgmap v4214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:23 smithi189 ceph-mon[32756]: pgmap v4215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:23 smithi156 ceph-mon[32679]: pgmap v4215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:23 smithi092 ceph-mon[29156]: pgmap v4215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6779.349868 secs 2024-04-26T20:11:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6779.349868 secs 2024-04-26T20:11:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6779.349868 secs 2024-04-26T20:11:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6082.330906 secs 2024-04-26T20:11:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:25 smithi189 ceph-mon[32756]: pgmap v4216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6082.330906 secs 2024-04-26T20:11:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:25 smithi156 ceph-mon[32679]: pgmap v4216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6082.330906 secs 2024-04-26T20:11:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:25 smithi092 ceph-mon[29156]: pgmap v4216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:27 smithi189 ceph-mon[32756]: pgmap v4217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:27 smithi156 ceph-mon[32679]: pgmap v4217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:27 smithi092 ceph-mon[29156]: pgmap v4217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:29 smithi189 ceph-mon[32756]: pgmap v4218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6784.350004 secs 2024-04-26T20:11:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6087.330981 secs 2024-04-26T20:11:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:29 smithi156 ceph-mon[32679]: pgmap v4218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6784.350004 secs 2024-04-26T20:11:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6087.330981 secs 2024-04-26T20:11:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:29 smithi092 ceph-mon[29156]: pgmap v4218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6784.350004 secs 2024-04-26T20:11:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6087.330981 secs 2024-04-26T20:11:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:31 smithi189 ceph-mon[32756]: pgmap v4219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:31 smithi156 ceph-mon[32679]: pgmap v4219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:31 smithi092 ceph-mon[29156]: pgmap v4219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:11:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: pgmap v4220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: pgmap v4221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:11:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: pgmap v4222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: pgmap v4220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: pgmap v4221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: pgmap v4222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: pgmap v4220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: pgmap v4221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: pgmap v4222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:11:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6789.350086 secs 2024-04-26T20:11:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6092.331098 secs 2024-04-26T20:11:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6789.350086 secs 2024-04-26T20:11:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6092.331098 secs 2024-04-26T20:11:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6789.350086 secs 2024-04-26T20:11:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6092.331098 secs 2024-04-26T20:11:35.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:35 smithi092 ceph-mon[29156]: pgmap v4223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:35 smithi189 ceph-mon[32756]: pgmap v4223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:35 smithi156 ceph-mon[32679]: pgmap v4223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:37 smithi092 ceph-mon[29156]: pgmap v4224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:37 smithi189 ceph-mon[32756]: pgmap v4224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:37 smithi156 ceph-mon[32679]: pgmap v4224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6794.350224 secs 2024-04-26T20:11:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6794.350224 secs 2024-04-26T20:11:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6794.350224 secs 2024-04-26T20:11:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:39 smithi092 ceph-mon[29156]: pgmap v4225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6097.331215 secs 2024-04-26T20:11:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:39 smithi189 ceph-mon[32756]: pgmap v4225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6097.331215 secs 2024-04-26T20:11:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:39 smithi156 ceph-mon[32679]: pgmap v4225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:11:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6097.331215 secs 2024-04-26T20:11:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:41 smithi092 ceph-mon[29156]: pgmap v4226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:41 smithi189 ceph-mon[32756]: pgmap v4226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:41 smithi156 ceph-mon[32679]: pgmap v4226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:11:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:43 smithi092 ceph-mon[29156]: pgmap v4227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:11:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6799.350349 secs 2024-04-26T20:11:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:43 smithi189 ceph-mon[32756]: pgmap v4227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:11:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6799.350349 secs 2024-04-26T20:11:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:43 smithi156 ceph-mon[32679]: pgmap v4227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:11:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6799.350349 secs 2024-04-26T20:11:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6102.331332 secs 2024-04-26T20:11:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6102.331332 secs 2024-04-26T20:11:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6102.331332 secs 2024-04-26T20:11:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:45 smithi092 ceph-mon[29156]: pgmap v4228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:45 smithi189 ceph-mon[32756]: pgmap v4228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:45 smithi156 ceph-mon[32679]: pgmap v4228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:47 smithi092 ceph-mon[29156]: pgmap v4229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:47 smithi189 ceph-mon[32756]: pgmap v4229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:47 smithi156 ceph-mon[32679]: pgmap v4229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6804.350477 secs 2024-04-26T20:11:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6804.350477 secs 2024-04-26T20:11:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6804.350477 secs 2024-04-26T20:11:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:49 smithi092 ceph-mon[29156]: pgmap v4230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6107.331355 secs 2024-04-26T20:11:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:49 smithi189 ceph-mon[32756]: pgmap v4230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6107.331355 secs 2024-04-26T20:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:49 smithi156 ceph-mon[32679]: pgmap v4230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6107.331355 secs 2024-04-26T20:11:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:51 smithi092 ceph-mon[29156]: pgmap v4231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:51 smithi189 ceph-mon[32756]: pgmap v4231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:51 smithi156 ceph-mon[32679]: pgmap v4231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:53 smithi092 ceph-mon[29156]: pgmap v4232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6809.350596 secs 2024-04-26T20:11:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:53 smithi189 ceph-mon[32756]: pgmap v4232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6809.350596 secs 2024-04-26T20:11:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:53 smithi156 ceph-mon[32679]: pgmap v4232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6809.350596 secs 2024-04-26T20:11:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6112.331419 secs 2024-04-26T20:11:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6112.331419 secs 2024-04-26T20:11:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6112.331419 secs 2024-04-26T20:11:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:55 smithi092 ceph-mon[29156]: pgmap v4233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:55 smithi189 ceph-mon[32756]: pgmap v4233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:55 smithi156 ceph-mon[32679]: pgmap v4233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:11:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:57 smithi092 ceph-mon[29156]: pgmap v4234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:57 smithi189 ceph-mon[32756]: pgmap v4234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:57 smithi156 ceph-mon[32679]: pgmap v4234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6814.350697 secs 2024-04-26T20:11:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6814.350697 secs 2024-04-26T20:11:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6814.350697 secs 2024-04-26T20:11:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:59 smithi189 ceph-mon[32756]: pgmap v4235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:11:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6117.331537 secs 2024-04-26T20:11:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:59 smithi156 ceph-mon[32679]: pgmap v4235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:11:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6117.331537 secs 2024-04-26T20:11:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:59 smithi092 ceph-mon[29156]: pgmap v4235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:11:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:11:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6117.331537 secs 2024-04-26T20:12:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:01 smithi189 ceph-mon[32756]: pgmap v4236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:01 smithi156 ceph-mon[32679]: pgmap v4236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:01 smithi092 ceph-mon[29156]: pgmap v4236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:03 smithi189 ceph-mon[32756]: pgmap v4237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6819.350794 secs 2024-04-26T20:12:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:03 smithi156 ceph-mon[32679]: pgmap v4237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6819.350794 secs 2024-04-26T20:12:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:03 smithi092 ceph-mon[29156]: pgmap v4237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6819.350794 secs 2024-04-26T20:12:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6122.331638 secs 2024-04-26T20:12:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6122.331638 secs 2024-04-26T20:12:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6122.331638 secs 2024-04-26T20:12:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:05 smithi189 ceph-mon[32756]: pgmap v4238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:05 smithi156 ceph-mon[32679]: pgmap v4238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:05 smithi092 ceph-mon[29156]: pgmap v4238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:07 smithi189 ceph-mon[32756]: pgmap v4239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:07 smithi156 ceph-mon[32679]: pgmap v4239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:07 smithi092 ceph-mon[29156]: pgmap v4239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6824.350892 secs 2024-04-26T20:12:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6824.350892 secs 2024-04-26T20:12:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6824.350892 secs 2024-04-26T20:12:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:09 smithi189 ceph-mon[32756]: pgmap v4240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6127.331734 secs 2024-04-26T20:12:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:09 smithi156 ceph-mon[32679]: pgmap v4240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6127.331734 secs 2024-04-26T20:12:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:09 smithi092 ceph-mon[29156]: pgmap v4240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6127.331734 secs 2024-04-26T20:12:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:11 smithi189 ceph-mon[32756]: pgmap v4241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:11 smithi156 ceph-mon[32679]: pgmap v4241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:11 smithi092 ceph-mon[29156]: pgmap v4241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:13 smithi189 ceph-mon[32756]: pgmap v4242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6829.351009 secs 2024-04-26T20:12:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:13 smithi156 ceph-mon[32679]: pgmap v4242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6829.351009 secs 2024-04-26T20:12:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:13 smithi092 ceph-mon[29156]: pgmap v4242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:13.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6829.351009 secs 2024-04-26T20:12:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6132.331840 secs 2024-04-26T20:12:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6132.331840 secs 2024-04-26T20:12:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6132.331840 secs 2024-04-26T20:12:15.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:15 smithi189 ceph-mon[32756]: pgmap v4243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:15 smithi156 ceph-mon[32679]: pgmap v4243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:15 smithi092 ceph-mon[29156]: pgmap v4243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:17 smithi189 ceph-mon[32756]: pgmap v4244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:17 smithi156 ceph-mon[32679]: pgmap v4244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:17 smithi092 ceph-mon[29156]: pgmap v4244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6834.351114 secs 2024-04-26T20:12:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6834.351114 secs 2024-04-26T20:12:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6834.351114 secs 2024-04-26T20:12:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:19 smithi189 ceph-mon[32756]: pgmap v4245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6137.331977 secs 2024-04-26T20:12:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:19 smithi156 ceph-mon[32679]: pgmap v4245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6137.331977 secs 2024-04-26T20:12:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:19 smithi092 ceph-mon[29156]: pgmap v4245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6137.331977 secs 2024-04-26T20:12:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:21 smithi189 ceph-mon[32756]: pgmap v4246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:21 smithi156 ceph-mon[32679]: pgmap v4246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:21 smithi092 ceph-mon[29156]: pgmap v4246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:23 smithi189 ceph-mon[32756]: pgmap v4247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6839.351211 secs 2024-04-26T20:12:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:23 smithi156 ceph-mon[32679]: pgmap v4247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6839.351211 secs 2024-04-26T20:12:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:23 smithi092 ceph-mon[29156]: pgmap v4247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6839.351211 secs 2024-04-26T20:12:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6142.332076 secs 2024-04-26T20:12:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6142.332076 secs 2024-04-26T20:12:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6142.332076 secs 2024-04-26T20:12:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:25 smithi189 ceph-mon[32756]: pgmap v4248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:25 smithi156 ceph-mon[32679]: pgmap v4248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:25 smithi092 ceph-mon[29156]: pgmap v4248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:27 smithi189 ceph-mon[32756]: pgmap v4249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:27 smithi156 ceph-mon[32679]: pgmap v4249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:27 smithi092 ceph-mon[29156]: pgmap v4249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6844.351361 secs 2024-04-26T20:12:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6844.351361 secs 2024-04-26T20:12:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6844.351361 secs 2024-04-26T20:12:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:29 smithi189 ceph-mon[32756]: pgmap v4250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6147.332236 secs 2024-04-26T20:12:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:29 smithi092 ceph-mon[29156]: pgmap v4250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6147.332236 secs 2024-04-26T20:12:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:29 smithi156 ceph-mon[32679]: pgmap v4250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6147.332236 secs 2024-04-26T20:12:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:31 smithi189 ceph-mon[32756]: pgmap v4251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:31 smithi156 ceph-mon[32679]: pgmap v4251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:31 smithi092 ceph-mon[29156]: pgmap v4251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: pgmap v4252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.849 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6849.351452 secs 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: pgmap v4252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6849.351452 secs 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: pgmap v4252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6849.351452 secs 2024-04-26T20:12:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6152.332335 secs 2024-04-26T20:12:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6152.332335 secs 2024-04-26T20:12:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6152.332335 secs 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: pgmap v4253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: pgmap v4253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: pgmap v4253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:12:36.914+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:12:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:12:36.914+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:12:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:12:36.914+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:12:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:12:36.914+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 56 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:12:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:12:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:12:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:12:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:12:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:12:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:12:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:12:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:12:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: pgmap v4254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:37 smithi189 ceph-mon[32756]: pgmap v4255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: pgmap v4254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:37 smithi156 ceph-mon[32679]: pgmap v4255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: pgmap v4254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:37 smithi092 ceph-mon[29156]: pgmap v4255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6854.351569 secs 2024-04-26T20:12:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6854.351569 secs 2024-04-26T20:12:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6854.351569 secs 2024-04-26T20:12:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:39 smithi189 ceph-mon[32756]: pgmap v4256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6157.332457 secs 2024-04-26T20:12:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:39 smithi156 ceph-mon[32679]: pgmap v4256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6157.332457 secs 2024-04-26T20:12:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:39 smithi092 ceph-mon[29156]: pgmap v4256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6157.332457 secs 2024-04-26T20:12:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:41 smithi189 ceph-mon[32756]: pgmap v4257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:41 smithi156 ceph-mon[32679]: pgmap v4257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:41 smithi092 ceph-mon[29156]: pgmap v4257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:43 smithi189 ceph-mon[32756]: pgmap v4258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6859.351686 secs 2024-04-26T20:12:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:43 smithi156 ceph-mon[32679]: pgmap v4258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6859.351686 secs 2024-04-26T20:12:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:43 smithi092 ceph-mon[29156]: pgmap v4258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6859.351686 secs 2024-04-26T20:12:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6162.332573 secs 2024-04-26T20:12:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6162.332573 secs 2024-04-26T20:12:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6162.332573 secs 2024-04-26T20:12:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:45 smithi189 ceph-mon[32756]: pgmap v4259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:45 smithi156 ceph-mon[32679]: pgmap v4259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:45 smithi092 ceph-mon[29156]: pgmap v4259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:12:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:46 smithi189 ceph-mon[32756]: pgmap v4260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:12:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:46 smithi156 ceph-mon[32679]: pgmap v4260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:12:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:46 smithi092 ceph-mon[29156]: pgmap v4260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:12:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:49 smithi189 ceph-mon[32756]: pgmap v4261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6864.351782 secs 2024-04-26T20:12:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:49 smithi156 ceph-mon[32679]: pgmap v4261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6864.351782 secs 2024-04-26T20:12:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:49 smithi092 ceph-mon[29156]: pgmap v4261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6864.351782 secs 2024-04-26T20:12:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6167.332688 secs 2024-04-26T20:12:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6167.332688 secs 2024-04-26T20:12:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6167.332688 secs 2024-04-26T20:12:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:51 smithi189 ceph-mon[32756]: pgmap v4262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:51 smithi156 ceph-mon[32679]: pgmap v4262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:51 smithi092 ceph-mon[29156]: pgmap v4262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:53 smithi092 ceph-mon[29156]: pgmap v4263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:53 smithi189 ceph-mon[32756]: pgmap v4263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:53 smithi156 ceph-mon[32679]: pgmap v4263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6869.351926 secs 2024-04-26T20:12:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6869.351926 secs 2024-04-26T20:12:54.447 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6869.351926 secs 2024-04-26T20:12:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6172.332776 secs 2024-04-26T20:12:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:55 smithi189 ceph-mon[32756]: pgmap v4264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6172.332776 secs 2024-04-26T20:12:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:55 smithi156 ceph-mon[32679]: pgmap v4264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6172.332776 secs 2024-04-26T20:12:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:55 smithi092 ceph-mon[29156]: pgmap v4264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:12:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:57 smithi189 ceph-mon[32756]: pgmap v4265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:57 smithi156 ceph-mon[32679]: pgmap v4265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:57 smithi092 ceph-mon[29156]: pgmap v4265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:59 smithi189 ceph-mon[32756]: pgmap v4266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:12:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6874.352066 secs 2024-04-26T20:12:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:59 smithi156 ceph-mon[32679]: pgmap v4266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:12:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6874.352066 secs 2024-04-26T20:12:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:59 smithi092 ceph-mon[29156]: pgmap v4266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:12:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:12:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6874.352066 secs 2024-04-26T20:13:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6177.332888 secs 2024-04-26T20:13:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6177.332888 secs 2024-04-26T20:13:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6177.332888 secs 2024-04-26T20:13:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:01 smithi189 ceph-mon[32756]: pgmap v4267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:01 smithi156 ceph-mon[32679]: pgmap v4267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:01 smithi092 ceph-mon[29156]: pgmap v4267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:03 smithi189 ceph-mon[32756]: pgmap v4268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:03 smithi156 ceph-mon[32679]: pgmap v4268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:03 smithi092 ceph-mon[29156]: pgmap v4268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6879.352213 secs 2024-04-26T20:13:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6879.352213 secs 2024-04-26T20:13:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6879.352213 secs 2024-04-26T20:13:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:05 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 6182.333027 secs 2024-04-26T20:13:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:05 smithi189 ceph-mon[32756]: slow request 1441.076385 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:13:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:05 smithi189 ceph-mon[32756]: pgmap v4269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:05 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 6182.333027 secs 2024-04-26T20:13:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:05 smithi156 ceph-mon[32679]: slow request 1441.076385 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:13:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:05 smithi156 ceph-mon[32679]: pgmap v4269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:05 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 6182.333027 secs 2024-04-26T20:13:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:05 smithi092 ceph-mon[29156]: slow request 1441.076385 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:13:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:05 smithi092 ceph-mon[29156]: pgmap v4269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:07 smithi189 ceph-mon[32756]: pgmap v4270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:07 smithi156 ceph-mon[32679]: pgmap v4270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:07 smithi092 ceph-mon[29156]: pgmap v4270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:09 smithi189 ceph-mon[32756]: pgmap v4271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6884.352281 secs 2024-04-26T20:13:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:09 smithi156 ceph-mon[32679]: pgmap v4271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6884.352281 secs 2024-04-26T20:13:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:09 smithi092 ceph-mon[29156]: pgmap v4271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6884.352281 secs 2024-04-26T20:13:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6187.333164 secs 2024-04-26T20:13:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6187.333164 secs 2024-04-26T20:13:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6187.333164 secs 2024-04-26T20:13:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:11 smithi189 ceph-mon[32756]: pgmap v4272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:11 smithi156 ceph-mon[32679]: pgmap v4272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:11 smithi092 ceph-mon[29156]: pgmap v4272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:13 smithi189 ceph-mon[32756]: pgmap v4273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:13 smithi156 ceph-mon[32679]: pgmap v4273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:13 smithi092 ceph-mon[29156]: pgmap v4273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6889.352409 secs 2024-04-26T20:13:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6889.352409 secs 2024-04-26T20:13:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6889.352409 secs 2024-04-26T20:13:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6192.333330 secs 2024-04-26T20:13:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:15 smithi189 ceph-mon[32756]: pgmap v4274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6192.333330 secs 2024-04-26T20:13:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:15 smithi156 ceph-mon[32679]: pgmap v4274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6192.333330 secs 2024-04-26T20:13:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:15 smithi092 ceph-mon[29156]: pgmap v4274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:17 smithi189 ceph-mon[32756]: pgmap v4275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:17 smithi156 ceph-mon[32679]: pgmap v4275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:17 smithi092 ceph-mon[29156]: pgmap v4275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:19 smithi189 ceph-mon[32756]: pgmap v4276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6894.352545 secs 2024-04-26T20:13:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:19 smithi156 ceph-mon[32679]: pgmap v4276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6894.352545 secs 2024-04-26T20:13:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:19 smithi092 ceph-mon[29156]: pgmap v4276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6894.352545 secs 2024-04-26T20:13:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6197.333447 secs 2024-04-26T20:13:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6197.333447 secs 2024-04-26T20:13:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6197.333447 secs 2024-04-26T20:13:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:21 smithi189 ceph-mon[32756]: pgmap v4277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:21 smithi156 ceph-mon[32679]: pgmap v4277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:21 smithi092 ceph-mon[29156]: pgmap v4277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:23 smithi189 ceph-mon[32756]: pgmap v4278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6899.352683 secs 2024-04-26T20:13:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:23 smithi156 ceph-mon[32679]: pgmap v4278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6899.352683 secs 2024-04-26T20:13:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:23 smithi092 ceph-mon[29156]: pgmap v4278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6899.352683 secs 2024-04-26T20:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6202.333575 secs 2024-04-26T20:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:25 smithi189 ceph-mon[32756]: pgmap v4279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6202.333575 secs 2024-04-26T20:13:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:25 smithi156 ceph-mon[32679]: pgmap v4279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6202.333575 secs 2024-04-26T20:13:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:25 smithi092 ceph-mon[29156]: pgmap v4279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:27 smithi189 ceph-mon[32756]: pgmap v4280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:27 smithi156 ceph-mon[32679]: pgmap v4280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:27 smithi092 ceph-mon[29156]: pgmap v4280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6904.352806 secs 2024-04-26T20:13:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6904.352806 secs 2024-04-26T20:13:28.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6904.352806 secs 2024-04-26T20:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:29 smithi189 ceph-mon[32756]: pgmap v4281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:29.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:29 smithi092 ceph-mon[29156]: pgmap v4281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:29 smithi156 ceph-mon[32679]: pgmap v4281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6207.333704 secs 2024-04-26T20:13:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6207.333704 secs 2024-04-26T20:13:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6207.333704 secs 2024-04-26T20:13:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:31 smithi189 ceph-mon[32756]: pgmap v4282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:31 smithi156 ceph-mon[32679]: pgmap v4282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:31 smithi092 ceph-mon[29156]: pgmap v4282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:33 smithi189 ceph-mon[32756]: pgmap v4283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6909.352928 secs 2024-04-26T20:13:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:33 smithi156 ceph-mon[32679]: pgmap v4283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6909.352928 secs 2024-04-26T20:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:33 smithi092 ceph-mon[29156]: pgmap v4283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6909.352928 secs 2024-04-26T20:13:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6212.333829 secs 2024-04-26T20:13:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:35 smithi189 ceph-mon[32756]: pgmap v4284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6212.333829 secs 2024-04-26T20:13:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:35 smithi156 ceph-mon[32679]: pgmap v4284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6212.333829 secs 2024-04-26T20:13:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:35 smithi092 ceph-mon[29156]: pgmap v4284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:13:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:37 smithi189 ceph-mon[32756]: pgmap v4285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:13:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:37 smithi156 ceph-mon[32679]: pgmap v4285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:13:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:37 smithi092 ceph-mon[29156]: pgmap v4285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:13:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:13:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:13:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:38 smithi189 ceph-mon[32756]: pgmap v4286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:13:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:38 smithi189 ceph-mon[32756]: pgmap v4287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6914.353038 secs 2024-04-26T20:13:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:38 smithi156 ceph-mon[32679]: pgmap v4286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:13:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:38 smithi156 ceph-mon[32679]: pgmap v4287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6914.353038 secs 2024-04-26T20:13:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:38 smithi092 ceph-mon[29156]: pgmap v4286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:13:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:38 smithi092 ceph-mon[29156]: pgmap v4287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6914.353038 secs 2024-04-26T20:13:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6217.333901 secs 2024-04-26T20:13:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6217.333901 secs 2024-04-26T20:13:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6217.333901 secs 2024-04-26T20:13:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:40 smithi189 ceph-mon[32756]: pgmap v4288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:40 smithi156 ceph-mon[32679]: pgmap v4288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:40 smithi092 ceph-mon[29156]: pgmap v4288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:42 smithi189 ceph-mon[32756]: pgmap v4289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:42 smithi156 ceph-mon[32679]: pgmap v4289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:42 smithi092 ceph-mon[29156]: pgmap v4289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6919.353176 secs 2024-04-26T20:13:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6919.353176 secs 2024-04-26T20:13:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6919.353176 secs 2024-04-26T20:13:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:44 smithi189 ceph-mon[32756]: pgmap v4290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:13:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6222.334016 secs 2024-04-26T20:13:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:44 smithi156 ceph-mon[32679]: pgmap v4290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:13:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6222.334016 secs 2024-04-26T20:13:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:44 smithi092 ceph-mon[29156]: pgmap v4290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:13:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6222.334016 secs 2024-04-26T20:13:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:46 smithi189 ceph-mon[32756]: pgmap v4291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:46 smithi156 ceph-mon[32679]: pgmap v4291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:46 smithi092 ceph-mon[29156]: pgmap v4291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:13:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:48 smithi189 ceph-mon[32756]: pgmap v4292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:13:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6924.353318 secs 2024-04-26T20:13:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:48 smithi156 ceph-mon[32679]: pgmap v4292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:13:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6924.353318 secs 2024-04-26T20:13:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:48 smithi092 ceph-mon[29156]: pgmap v4292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:13:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6924.353318 secs 2024-04-26T20:13:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6227.334126 secs 2024-04-26T20:13:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6227.334126 secs 2024-04-26T20:13:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6227.334126 secs 2024-04-26T20:13:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:50 smithi189 ceph-mon[32756]: pgmap v4293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:50 smithi156 ceph-mon[32679]: pgmap v4293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:50 smithi092 ceph-mon[29156]: pgmap v4293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:52 smithi156 ceph-mon[32679]: pgmap v4294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:52 smithi092 ceph-mon[29156]: pgmap v4294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:52 smithi189 ceph-mon[32756]: pgmap v4294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6929.353451 secs 2024-04-26T20:13:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6929.353451 secs 2024-04-26T20:13:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6929.353451 secs 2024-04-26T20:13:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:54 smithi156 ceph-mon[32679]: pgmap v4295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6232.334216 secs 2024-04-26T20:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:54 smithi092 ceph-mon[29156]: pgmap v4295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6232.334216 secs 2024-04-26T20:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:54 smithi189 ceph-mon[32756]: pgmap v4295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6232.334216 secs 2024-04-26T20:13:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:56 smithi156 ceph-mon[32679]: pgmap v4296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:56 smithi092 ceph-mon[29156]: pgmap v4296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:56 smithi189 ceph-mon[32756]: pgmap v4296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:13:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:58 smithi156 ceph-mon[32679]: pgmap v4297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6934.353566 secs 2024-04-26T20:13:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:58 smithi092 ceph-mon[29156]: pgmap v4297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6934.353566 secs 2024-04-26T20:13:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:58 smithi189 ceph-mon[32756]: pgmap v4297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:13:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6934.353566 secs 2024-04-26T20:13:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:13:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6237.334336 secs 2024-04-26T20:13:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:13:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6237.334336 secs 2024-04-26T20:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:13:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6237.334336 secs 2024-04-26T20:14:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:00 smithi156 ceph-mon[32679]: pgmap v4298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:00 smithi092 ceph-mon[29156]: pgmap v4298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:00 smithi189 ceph-mon[32756]: pgmap v4298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:02 smithi156 ceph-mon[32679]: pgmap v4299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:02 smithi092 ceph-mon[29156]: pgmap v4299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:02 smithi189 ceph-mon[32756]: pgmap v4299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6939.353657 secs 2024-04-26T20:14:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6939.353657 secs 2024-04-26T20:14:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6939.353657 secs 2024-04-26T20:14:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:04 smithi156 ceph-mon[32679]: pgmap v4300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6242.334461 secs 2024-04-26T20:14:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:04 smithi092 ceph-mon[29156]: pgmap v4300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6242.334461 secs 2024-04-26T20:14:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:04 smithi189 ceph-mon[32756]: pgmap v4300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6242.334461 secs 2024-04-26T20:14:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:06 smithi156 ceph-mon[32679]: pgmap v4301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:06 smithi092 ceph-mon[29156]: pgmap v4301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:06 smithi189 ceph-mon[32756]: pgmap v4301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:14:06.926+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:14:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:14:06.926+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:14:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:14:06.926+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:14:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:14:06.926+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 57 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:08 smithi156 ceph-mon[32679]: pgmap v4302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6944.353797 secs 2024-04-26T20:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:08 smithi092 ceph-mon[29156]: pgmap v4302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6944.353797 secs 2024-04-26T20:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:08 smithi189 ceph-mon[32756]: pgmap v4302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6944.353797 secs 2024-04-26T20:14:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6247.334527 secs 2024-04-26T20:14:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6247.334527 secs 2024-04-26T20:14:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6247.334527 secs 2024-04-26T20:14:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:10 smithi092 ceph-mon[29156]: pgmap v4303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:10 smithi189 ceph-mon[32756]: pgmap v4303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:10 smithi156 ceph-mon[32679]: pgmap v4303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:12 smithi092 ceph-mon[29156]: pgmap v4304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:12 smithi189 ceph-mon[32756]: pgmap v4304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:12 smithi156 ceph-mon[32679]: pgmap v4304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6949.353924 secs 2024-04-26T20:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6949.353924 secs 2024-04-26T20:14:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6949.353924 secs 2024-04-26T20:14:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:14 smithi092 ceph-mon[29156]: pgmap v4305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6252.334638 secs 2024-04-26T20:14:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:14 smithi156 ceph-mon[32679]: pgmap v4305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6252.334638 secs 2024-04-26T20:14:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:14 smithi189 ceph-mon[32756]: pgmap v4305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6252.334638 secs 2024-04-26T20:14:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:16 smithi092 ceph-mon[29156]: pgmap v4306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:16 smithi189 ceph-mon[32756]: pgmap v4306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:16 smithi156 ceph-mon[32679]: pgmap v4306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:18 smithi092 ceph-mon[29156]: pgmap v4307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6954.354024 secs 2024-04-26T20:14:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:18 smithi189 ceph-mon[32756]: pgmap v4307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6954.354024 secs 2024-04-26T20:14:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:18 smithi156 ceph-mon[32679]: pgmap v4307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6954.354024 secs 2024-04-26T20:14:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6257.334712 secs 2024-04-26T20:14:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6257.334712 secs 2024-04-26T20:14:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6257.334712 secs 2024-04-26T20:14:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:20 smithi092 ceph-mon[29156]: pgmap v4308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:20 smithi189 ceph-mon[32756]: pgmap v4308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:20 smithi156 ceph-mon[32679]: pgmap v4308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:22 smithi092 ceph-mon[29156]: pgmap v4309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:22 smithi189 ceph-mon[32756]: pgmap v4309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:22 smithi156 ceph-mon[32679]: pgmap v4309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6959.354091 secs 2024-04-26T20:14:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6959.354091 secs 2024-04-26T20:14:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6959.354091 secs 2024-04-26T20:14:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:24 smithi092 ceph-mon[29156]: pgmap v4310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6262.334835 secs 2024-04-26T20:14:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:24 smithi189 ceph-mon[32756]: pgmap v4310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6262.334835 secs 2024-04-26T20:14:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:24 smithi156 ceph-mon[32679]: pgmap v4310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6262.334835 secs 2024-04-26T20:14:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:26 smithi092 ceph-mon[29156]: pgmap v4311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:26 smithi189 ceph-mon[32756]: pgmap v4311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:26 smithi156 ceph-mon[32679]: pgmap v4311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:28 smithi092 ceph-mon[29156]: pgmap v4312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6964.354226 secs 2024-04-26T20:14:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:28 smithi189 ceph-mon[32756]: pgmap v4312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6964.354226 secs 2024-04-26T20:14:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:28 smithi156 ceph-mon[32679]: pgmap v4312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6964.354226 secs 2024-04-26T20:14:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6267.334899 secs 2024-04-26T20:14:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6267.334899 secs 2024-04-26T20:14:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6267.334899 secs 2024-04-26T20:14:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:30 smithi092 ceph-mon[29156]: pgmap v4313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:30 smithi189 ceph-mon[32756]: pgmap v4313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:30 smithi156 ceph-mon[32679]: pgmap v4313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:32 smithi092 ceph-mon[29156]: pgmap v4314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:32 smithi189 ceph-mon[32756]: pgmap v4314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:32 smithi156 ceph-mon[32679]: pgmap v4314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6969.354313 secs 2024-04-26T20:14:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6969.354313 secs 2024-04-26T20:14:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6969.354313 secs 2024-04-26T20:14:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:34 smithi189 ceph-mon[32756]: pgmap v4315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6272.334970 secs 2024-04-26T20:14:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:34 smithi156 ceph-mon[32679]: pgmap v4315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6272.334970 secs 2024-04-26T20:14:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:34 smithi092 ceph-mon[29156]: pgmap v4315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6272.334970 secs 2024-04-26T20:14:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:36 smithi189 ceph-mon[32756]: pgmap v4316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:36 smithi156 ceph-mon[32679]: pgmap v4316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:36 smithi092 ceph-mon[29156]: pgmap v4316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:14:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: pgmap v4317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: pgmap v4318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:14:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: pgmap v4319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:14:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:14:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6974.354432 secs 2024-04-26T20:14:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: pgmap v4317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: pgmap v4318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:14:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: pgmap v4319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:14:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:14:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6974.354432 secs 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: pgmap v4317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: pgmap v4318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: pgmap v4319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:14:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6974.354432 secs 2024-04-26T20:14:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6277.335045 secs 2024-04-26T20:14:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6277.335045 secs 2024-04-26T20:14:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6277.335045 secs 2024-04-26T20:14:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:40 smithi189 ceph-mon[32756]: pgmap v4320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:40 smithi156 ceph-mon[32679]: pgmap v4320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:40 smithi092 ceph-mon[29156]: pgmap v4320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:41 smithi156 ceph-mon[32679]: pgmap v4321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:41 smithi092 ceph-mon[29156]: pgmap v4321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:41 smithi189 ceph-mon[32756]: pgmap v4321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6979.354586 secs 2024-04-26T20:14:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6979.354586 secs 2024-04-26T20:14:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6979.354586 secs 2024-04-26T20:14:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:44 smithi189 ceph-mon[32756]: pgmap v4322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:44 smithi156 ceph-mon[32679]: pgmap v4322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:44 smithi092 ceph-mon[29156]: pgmap v4322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6282.335177 secs 2024-04-26T20:14:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6282.335177 secs 2024-04-26T20:14:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6282.335177 secs 2024-04-26T20:14:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:46 smithi189 ceph-mon[32756]: pgmap v4323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:46 smithi156 ceph-mon[32679]: pgmap v4323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:46 smithi092 ceph-mon[29156]: pgmap v4323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:14:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:47 smithi156 ceph-mon[32679]: pgmap v4324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:14:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:47 smithi092 ceph-mon[29156]: pgmap v4324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:14:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:47 smithi189 ceph-mon[32756]: pgmap v4324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:14:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6984.354711 secs 2024-04-26T20:14:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6984.354711 secs 2024-04-26T20:14:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6984.354711 secs 2024-04-26T20:14:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6287.335304 secs 2024-04-26T20:14:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:49 smithi092 ceph-mon[29156]: pgmap v4325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6287.335304 secs 2024-04-26T20:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:49 smithi189 ceph-mon[32756]: pgmap v4325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6287.335304 secs 2024-04-26T20:14:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:49 smithi156 ceph-mon[32679]: pgmap v4325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:51 smithi156 ceph-mon[32679]: pgmap v4326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:51 smithi092 ceph-mon[29156]: pgmap v4326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:51 smithi189 ceph-mon[32756]: pgmap v4326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6989.354851 secs 2024-04-26T20:14:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6989.354851 secs 2024-04-26T20:14:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6989.354851 secs 2024-04-26T20:14:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:54 smithi189 ceph-mon[32756]: pgmap v4327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:54 smithi156 ceph-mon[32679]: pgmap v4327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:54 smithi092 ceph-mon[29156]: pgmap v4327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:14:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6292.335357 secs 2024-04-26T20:14:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6292.335357 secs 2024-04-26T20:14:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6292.335357 secs 2024-04-26T20:14:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:56 smithi189 ceph-mon[32756]: pgmap v4328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:56 smithi156 ceph-mon[32679]: pgmap v4328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:56 smithi092 ceph-mon[29156]: pgmap v4328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:57 smithi156 ceph-mon[32679]: pgmap v4329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:57 smithi092 ceph-mon[29156]: pgmap v4329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:57 smithi189 ceph-mon[32756]: pgmap v4329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:14:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6994.354961 secs 2024-04-26T20:14:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6994.354961 secs 2024-04-26T20:14:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6994.354961 secs 2024-04-26T20:14:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6297.335430 secs 2024-04-26T20:14:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:14:59 smithi092 ceph-mon[29156]: pgmap v4330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6297.335430 secs 2024-04-26T20:15:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:14:59 smithi189 ceph-mon[32756]: pgmap v4330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6297.335430 secs 2024-04-26T20:15:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:14:59 smithi156 ceph-mon[32679]: pgmap v4330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:01 smithi156 ceph-mon[32679]: pgmap v4331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:01 smithi092 ceph-mon[29156]: pgmap v4331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:01 smithi189 ceph-mon[32756]: pgmap v4331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 6999.355092 secs 2024-04-26T20:15:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 6999.355092 secs 2024-04-26T20:15:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 6999.355092 secs 2024-04-26T20:15:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:04 smithi189 ceph-mon[32756]: pgmap v4332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:04 smithi156 ceph-mon[32679]: pgmap v4332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:04 smithi092 ceph-mon[29156]: pgmap v4332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6302.335496 secs 2024-04-26T20:15:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6302.335496 secs 2024-04-26T20:15:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6302.335496 secs 2024-04-26T20:15:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:06 smithi189 ceph-mon[32756]: pgmap v4333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:06 smithi156 ceph-mon[32679]: pgmap v4333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:06 smithi092 ceph-mon[29156]: pgmap v4333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:07 smithi156 ceph-mon[32679]: pgmap v4334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:07 smithi092 ceph-mon[29156]: pgmap v4334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:07 smithi189 ceph-mon[32756]: pgmap v4334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7004.355234 secs 2024-04-26T20:15:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7004.355234 secs 2024-04-26T20:15:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7004.355234 secs 2024-04-26T20:15:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6307.335570 secs 2024-04-26T20:15:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:09 smithi092 ceph-mon[29156]: pgmap v4335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6307.335570 secs 2024-04-26T20:15:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:09 smithi189 ceph-mon[32756]: pgmap v4335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6307.335570 secs 2024-04-26T20:15:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:09 smithi156 ceph-mon[32679]: pgmap v4335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:11 smithi156 ceph-mon[32679]: pgmap v4336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:11 smithi092 ceph-mon[29156]: pgmap v4336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:11 smithi189 ceph-mon[32756]: pgmap v4336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7009.355343 secs 2024-04-26T20:15:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7009.355343 secs 2024-04-26T20:15:13.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7009.355343 secs 2024-04-26T20:15:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:14 smithi189 ceph-mon[32756]: pgmap v4337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:14 smithi156 ceph-mon[32679]: pgmap v4337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:14 smithi092 ceph-mon[29156]: pgmap v4337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6312.335631 secs 2024-04-26T20:15:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6312.335631 secs 2024-04-26T20:15:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6312.335631 secs 2024-04-26T20:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:16 smithi189 ceph-mon[32756]: pgmap v4338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:16 smithi156 ceph-mon[32679]: pgmap v4338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:16 smithi092 ceph-mon[29156]: pgmap v4338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:17 smithi156 ceph-mon[32679]: pgmap v4339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:17 smithi092 ceph-mon[29156]: pgmap v4339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:17 smithi189 ceph-mon[32756]: pgmap v4339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7014.355445 secs 2024-04-26T20:15:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7014.355445 secs 2024-04-26T20:15:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7014.355445 secs 2024-04-26T20:15:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6317.335712 secs 2024-04-26T20:15:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:19 smithi092 ceph-mon[29156]: pgmap v4340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6317.335712 secs 2024-04-26T20:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:19 smithi189 ceph-mon[32756]: pgmap v4340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6317.335712 secs 2024-04-26T20:15:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:19 smithi156 ceph-mon[32679]: pgmap v4340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:21 smithi156 ceph-mon[32679]: pgmap v4341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:21 smithi092 ceph-mon[29156]: pgmap v4341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:21 smithi189 ceph-mon[32756]: pgmap v4341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:15:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7019.355549 secs 2024-04-26T20:15:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7019.355549 secs 2024-04-26T20:15:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7019.355549 secs 2024-04-26T20:15:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:24 smithi189 ceph-mon[32756]: pgmap v4342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:24 smithi156 ceph-mon[32679]: pgmap v4342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:24 smithi092 ceph-mon[29156]: pgmap v4342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:15:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6322.335857 secs 2024-04-26T20:15:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6322.335857 secs 2024-04-26T20:15:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6322.335857 secs 2024-04-26T20:15:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:26 smithi189 ceph-mon[32756]: pgmap v4343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:26 smithi156 ceph-mon[32679]: pgmap v4343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:26 smithi092 ceph-mon[29156]: pgmap v4343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:27 smithi092 ceph-mon[29156]: pgmap v4344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:27 smithi189 ceph-mon[32756]: pgmap v4344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:27 smithi156 ceph-mon[32679]: pgmap v4344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:28.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7024.355661 secs 2024-04-26T20:15:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7024.355661 secs 2024-04-26T20:15:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7024.355661 secs 2024-04-26T20:15:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6327.335976 secs 2024-04-26T20:15:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:29 smithi092 ceph-mon[29156]: pgmap v4345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6327.335976 secs 2024-04-26T20:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:29 smithi189 ceph-mon[32756]: pgmap v4345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6327.335976 secs 2024-04-26T20:15:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:29 smithi156 ceph-mon[32679]: pgmap v4345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:31 smithi092 ceph-mon[29156]: pgmap v4346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:31 smithi189 ceph-mon[32756]: pgmap v4346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:31 smithi156 ceph-mon[32679]: pgmap v4346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7029.355782 secs 2024-04-26T20:15:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7029.355782 secs 2024-04-26T20:15:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7029.355782 secs 2024-04-26T20:15:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:34 smithi189 ceph-mon[32756]: pgmap v4347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:34 smithi156 ceph-mon[32679]: pgmap v4347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:34 smithi092 ceph-mon[29156]: pgmap v4347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6332.336110 secs 2024-04-26T20:15:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6332.336110 secs 2024-04-26T20:15:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6332.336110 secs 2024-04-26T20:15:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:36 smithi189 ceph-mon[32756]: pgmap v4348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:36 smithi156 ceph-mon[32679]: pgmap v4348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:36 smithi092 ceph-mon[29156]: pgmap v4348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:15:36.938+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:15:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:15:36.938+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:15:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:15:36.938+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:15:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:15:36.938+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 58 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:15:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:37 smithi092 ceph-mon[29156]: pgmap v4349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:37 smithi189 ceph-mon[32756]: pgmap v4349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:37 smithi156 ceph-mon[32679]: pgmap v4349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7034.355893 secs 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: pgmap v4350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: pgmap v4351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:15:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7034.355893 secs 2024-04-26T20:15:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: pgmap v4350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:15:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: pgmap v4351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7034.355893 secs 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: pgmap v4350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: pgmap v4351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:15:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6337.336192 secs 2024-04-26T20:15:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6337.336192 secs 2024-04-26T20:15:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6337.336192 secs 2024-04-26T20:15:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:40 smithi092 ceph-mon[29156]: pgmap v4352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:40 smithi189 ceph-mon[32756]: pgmap v4352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:40 smithi156 ceph-mon[32679]: pgmap v4352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:43 smithi156 ceph-mon[32679]: pgmap v4353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7039.356019 secs 2024-04-26T20:15:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:43 smithi092 ceph-mon[29156]: pgmap v4353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7039.356019 secs 2024-04-26T20:15:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:43 smithi189 ceph-mon[32756]: pgmap v4353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:15:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7039.356019 secs 2024-04-26T20:15:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6342.336337 secs 2024-04-26T20:15:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6342.336337 secs 2024-04-26T20:15:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6342.336337 secs 2024-04-26T20:15:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:45 smithi156 ceph-mon[32679]: pgmap v4354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:45 smithi092 ceph-mon[29156]: pgmap v4354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:45 smithi189 ceph-mon[32756]: pgmap v4354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:47 smithi156 ceph-mon[32679]: pgmap v4355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:47.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:47 smithi189 ceph-mon[32756]: pgmap v4355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:47 smithi092 ceph-mon[29156]: pgmap v4355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:15:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7044.356134 secs 2024-04-26T20:15:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7044.356134 secs 2024-04-26T20:15:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7044.356134 secs 2024-04-26T20:15:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:49 smithi092 ceph-mon[29156]: pgmap v4356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:15:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6347.336452 secs 2024-04-26T20:15:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:49 smithi189 ceph-mon[32756]: pgmap v4356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:15:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6347.336452 secs 2024-04-26T20:15:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:49 smithi156 ceph-mon[32679]: pgmap v4356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:15:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6347.336452 secs 2024-04-26T20:15:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:51 smithi092 ceph-mon[29156]: pgmap v4357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:51 smithi189 ceph-mon[32756]: pgmap v4357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:51 smithi156 ceph-mon[32679]: pgmap v4357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:53 smithi092 ceph-mon[29156]: pgmap v4358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7049.356253 secs 2024-04-26T20:15:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:53 smithi189 ceph-mon[32756]: pgmap v4358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7049.356253 secs 2024-04-26T20:15:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:53 smithi156 ceph-mon[32679]: pgmap v4358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7049.356253 secs 2024-04-26T20:15:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6352.336564 secs 2024-04-26T20:15:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6352.336564 secs 2024-04-26T20:15:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6352.336564 secs 2024-04-26T20:15:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:55 smithi092 ceph-mon[29156]: pgmap v4359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:55 smithi189 ceph-mon[32756]: pgmap v4359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:55 smithi156 ceph-mon[32679]: pgmap v4359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:15:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:57 smithi092 ceph-mon[29156]: pgmap v4360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:57 smithi189 ceph-mon[32756]: pgmap v4360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:57 smithi156 ceph-mon[32679]: pgmap v4360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7054.356372 secs 2024-04-26T20:15:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7054.356372 secs 2024-04-26T20:15:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7054.356372 secs 2024-04-26T20:15:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:59 smithi092 ceph-mon[29156]: pgmap v4361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:15:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6357.336646 secs 2024-04-26T20:15:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:59 smithi189 ceph-mon[32756]: pgmap v4361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:15:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6357.336646 secs 2024-04-26T20:15:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:59 smithi156 ceph-mon[32679]: pgmap v4361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:15:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:15:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6357.336646 secs 2024-04-26T20:16:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:01 smithi092 ceph-mon[29156]: pgmap v4362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:01 smithi189 ceph-mon[32756]: pgmap v4362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:01 smithi156 ceph-mon[32679]: pgmap v4362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:16:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:16:02.769+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:16:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:16:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:16:02.769+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:16:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:16:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:16:02.769+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:16:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:16:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:16:02.769+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:16:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:16:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:16:02.769+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:16:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:03 smithi092 ceph-mon[29156]: pgmap v4363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7059.356439 secs 2024-04-26T20:16:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:03 smithi189 ceph-mon[32756]: pgmap v4363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7059.356439 secs 2024-04-26T20:16:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:03 smithi156 ceph-mon[32679]: pgmap v4363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7059.356439 secs 2024-04-26T20:16:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6362.336728 secs 2024-04-26T20:16:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6362.336728 secs 2024-04-26T20:16:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6362.336728 secs 2024-04-26T20:16:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:05 smithi092 ceph-mon[29156]: pgmap v4364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:05 smithi189 ceph-mon[32756]: pgmap v4364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:05 smithi156 ceph-mon[32679]: pgmap v4364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:07 smithi092 ceph-mon[29156]: pgmap v4365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:07 smithi189 ceph-mon[32756]: pgmap v4365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:07 smithi156 ceph-mon[32679]: pgmap v4365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7064.356547 secs 2024-04-26T20:16:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7064.356547 secs 2024-04-26T20:16:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7064.356547 secs 2024-04-26T20:16:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:09 smithi092 ceph-mon[29156]: pgmap v4366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6367.336823 secs 2024-04-26T20:16:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:09 smithi189 ceph-mon[32756]: pgmap v4366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6367.336823 secs 2024-04-26T20:16:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:09 smithi156 ceph-mon[32679]: pgmap v4366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6367.336823 secs 2024-04-26T20:16:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:11 smithi092 ceph-mon[29156]: pgmap v4367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:11 smithi189 ceph-mon[32756]: pgmap v4367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:11 smithi156 ceph-mon[32679]: pgmap v4367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:13 smithi092 ceph-mon[29156]: pgmap v4368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7069.356685 secs 2024-04-26T20:16:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:13 smithi189 ceph-mon[32756]: pgmap v4368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7069.356685 secs 2024-04-26T20:16:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:13 smithi156 ceph-mon[32679]: pgmap v4368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7069.356685 secs 2024-04-26T20:16:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6372.336893 secs 2024-04-26T20:16:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6372.336893 secs 2024-04-26T20:16:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6372.336893 secs 2024-04-26T20:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:15 smithi189 ceph-mon[32756]: pgmap v4369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:15 smithi156 ceph-mon[32679]: pgmap v4369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:15 smithi092 ceph-mon[29156]: pgmap v4369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:17 smithi189 ceph-mon[32756]: pgmap v4370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:17 smithi156 ceph-mon[32679]: pgmap v4370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:17 smithi092 ceph-mon[29156]: pgmap v4370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7074.356798 secs 2024-04-26T20:16:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7074.356798 secs 2024-04-26T20:16:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7074.356798 secs 2024-04-26T20:16:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:19 smithi189 ceph-mon[32756]: pgmap v4371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6377.336971 secs 2024-04-26T20:16:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:19 smithi156 ceph-mon[32679]: pgmap v4371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6377.336971 secs 2024-04-26T20:16:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:19 smithi092 ceph-mon[29156]: pgmap v4371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6377.336971 secs 2024-04-26T20:16:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:21 smithi189 ceph-mon[32756]: pgmap v4372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:21 smithi156 ceph-mon[32679]: pgmap v4372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:21 smithi092 ceph-mon[29156]: pgmap v4372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:23 smithi189 ceph-mon[32756]: pgmap v4373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7079.356916 secs 2024-04-26T20:16:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:23 smithi156 ceph-mon[32679]: pgmap v4373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7079.356916 secs 2024-04-26T20:16:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:23 smithi092 ceph-mon[29156]: pgmap v4373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7079.356916 secs 2024-04-26T20:16:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6382.337108 secs 2024-04-26T20:16:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6382.337108 secs 2024-04-26T20:16:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6382.337108 secs 2024-04-26T20:16:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:25 smithi189 ceph-mon[32756]: pgmap v4374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:25 smithi156 ceph-mon[32679]: pgmap v4374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:25 smithi092 ceph-mon[29156]: pgmap v4374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:27 smithi189 ceph-mon[32756]: pgmap v4375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:27 smithi156 ceph-mon[32679]: pgmap v4375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:27 smithi092 ceph-mon[29156]: pgmap v4375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7084.357033 secs 2024-04-26T20:16:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7084.357033 secs 2024-04-26T20:16:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7084.357033 secs 2024-04-26T20:16:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:29 smithi189 ceph-mon[32756]: pgmap v4376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6387.337185 secs 2024-04-26T20:16:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:29 smithi092 ceph-mon[29156]: pgmap v4376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6387.337185 secs 2024-04-26T20:16:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:29 smithi156 ceph-mon[32679]: pgmap v4376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6387.337185 secs 2024-04-26T20:16:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:31 smithi189 ceph-mon[32756]: pgmap v4377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:31 smithi156 ceph-mon[32679]: pgmap v4377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:31 smithi092 ceph-mon[29156]: pgmap v4377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:33 smithi189 ceph-mon[32756]: pgmap v4378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7089.357162 secs 2024-04-26T20:16:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:33 smithi156 ceph-mon[32679]: pgmap v4378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7089.357162 secs 2024-04-26T20:16:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:33 smithi092 ceph-mon[29156]: pgmap v4378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:16:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7089.357162 secs 2024-04-26T20:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6392.337268 secs 2024-04-26T20:16:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6392.337268 secs 2024-04-26T20:16:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6392.337268 secs 2024-04-26T20:16:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:35 smithi189 ceph-mon[32756]: pgmap v4379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:35 smithi156 ceph-mon[32679]: pgmap v4379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:35 smithi092 ceph-mon[29156]: pgmap v4379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:16:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:37 smithi189 ceph-mon[32756]: pgmap v4380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:37 smithi156 ceph-mon[32679]: pgmap v4380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:37 smithi092 ceph-mon[29156]: pgmap v4380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7094.357276 secs 2024-04-26T20:16:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7094.357276 secs 2024-04-26T20:16:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7094.357276 secs 2024-04-26T20:16:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:39 smithi189 ceph-mon[32756]: pgmap v4381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6397.337322 secs 2024-04-26T20:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:39 smithi156 ceph-mon[32679]: pgmap v4381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6397.337322 secs 2024-04-26T20:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:39 smithi092 ceph-mon[29156]: pgmap v4381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6397.337322 secs 2024-04-26T20:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:16:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:40 smithi189 ceph-mon[32756]: pgmap v4382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:16:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:40 smithi189 ceph-mon[32756]: pgmap v4383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:40 smithi156 ceph-mon[32679]: pgmap v4382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:16:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:40 smithi156 ceph-mon[32679]: pgmap v4383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:40 smithi092 ceph-mon[29156]: pgmap v4382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:16:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:40 smithi092 ceph-mon[29156]: pgmap v4383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:42 smithi189 ceph-mon[32756]: pgmap v4384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:42 smithi156 ceph-mon[32679]: pgmap v4384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:42 smithi092 ceph-mon[29156]: pgmap v4384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7099.357390 secs 2024-04-26T20:16:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7099.357390 secs 2024-04-26T20:16:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7099.357390 secs 2024-04-26T20:16:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:44 smithi156 ceph-mon[32679]: pgmap v4385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:16:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6402.337384 secs 2024-04-26T20:16:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:44 smithi189 ceph-mon[32756]: pgmap v4385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:16:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6402.337384 secs 2024-04-26T20:16:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:44 smithi092 ceph-mon[29156]: pgmap v4385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:16:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6402.337384 secs 2024-04-26T20:16:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:46 smithi189 ceph-mon[32756]: pgmap v4386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:46 smithi156 ceph-mon[32679]: pgmap v4386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:46 smithi092 ceph-mon[29156]: pgmap v4386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:48 smithi189 ceph-mon[32756]: pgmap v4387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7104.357510 secs 2024-04-26T20:16:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:48 smithi156 ceph-mon[32679]: pgmap v4387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7104.357510 secs 2024-04-26T20:16:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:48 smithi092 ceph-mon[29156]: pgmap v4387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:16:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7104.357510 secs 2024-04-26T20:16:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6407.337449 secs 2024-04-26T20:16:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6407.337449 secs 2024-04-26T20:16:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6407.337449 secs 2024-04-26T20:16:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:50 smithi189 ceph-mon[32756]: pgmap v4388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:16:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:50 smithi156 ceph-mon[32679]: pgmap v4388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:16:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:50 smithi092 ceph-mon[29156]: pgmap v4388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:16:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:52 smithi189 ceph-mon[32756]: pgmap v4389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:52 smithi156 ceph-mon[32679]: pgmap v4389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:52 smithi092 ceph-mon[29156]: pgmap v4389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7109.357615 secs 2024-04-26T20:16:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7109.357615 secs 2024-04-26T20:16:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7109.357615 secs 2024-04-26T20:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:54 smithi189 ceph-mon[32756]: pgmap v4390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6412.337512 secs 2024-04-26T20:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:54 smithi156 ceph-mon[32679]: pgmap v4390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6412.337512 secs 2024-04-26T20:16:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:54 smithi092 ceph-mon[29156]: pgmap v4390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6412.337512 secs 2024-04-26T20:16:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:56 smithi189 ceph-mon[32756]: pgmap v4391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:56 smithi156 ceph-mon[32679]: pgmap v4391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:56 smithi092 ceph-mon[29156]: pgmap v4391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:58 smithi189 ceph-mon[32756]: pgmap v4392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7114.357751 secs 2024-04-26T20:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:58 smithi156 ceph-mon[32679]: pgmap v4392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7114.357751 secs 2024-04-26T20:16:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:58 smithi092 ceph-mon[29156]: pgmap v4392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:16:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7114.357751 secs 2024-04-26T20:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:16:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6417.337576 secs 2024-04-26T20:16:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:16:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6417.337576 secs 2024-04-26T20:16:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:16:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6417.337576 secs 2024-04-26T20:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:00 smithi189 ceph-mon[32756]: pgmap v4393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:00 smithi156 ceph-mon[32679]: pgmap v4393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:00 smithi092 ceph-mon[29156]: pgmap v4393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:02 smithi189 ceph-mon[32756]: pgmap v4394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:02 smithi156 ceph-mon[32679]: pgmap v4394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:02 smithi092 ceph-mon[29156]: pgmap v4394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7119.357869 secs 2024-04-26T20:17:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7119.357869 secs 2024-04-26T20:17:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7119.357869 secs 2024-04-26T20:17:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:04 smithi189 ceph-mon[32756]: pgmap v4395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6422.337640 secs 2024-04-26T20:17:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:04 smithi156 ceph-mon[32679]: pgmap v4395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6422.337640 secs 2024-04-26T20:17:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:04 smithi092 ceph-mon[29156]: pgmap v4395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6422.337640 secs 2024-04-26T20:17:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:06 smithi189 ceph-mon[32756]: pgmap v4396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:06 smithi156 ceph-mon[32679]: pgmap v4396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:06 smithi092 ceph-mon[29156]: pgmap v4396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:08 smithi189 ceph-mon[32756]: pgmap v4397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7124.357978 secs 2024-04-26T20:17:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:08 smithi156 ceph-mon[32679]: pgmap v4397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7124.357978 secs 2024-04-26T20:17:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:08 smithi092 ceph-mon[29156]: pgmap v4397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7124.357978 secs 2024-04-26T20:17:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6427.337718 secs 2024-04-26T20:17:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6427.337718 secs 2024-04-26T20:17:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6427.337718 secs 2024-04-26T20:17:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:10 smithi189 ceph-mon[32756]: pgmap v4398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:10 smithi156 ceph-mon[32679]: pgmap v4398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:10 smithi092 ceph-mon[29156]: pgmap v4398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:12 smithi156 ceph-mon[32679]: pgmap v4399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:12 smithi092 ceph-mon[29156]: pgmap v4399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:12 smithi189 ceph-mon[32756]: pgmap v4399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7129.358126 secs 2024-04-26T20:17:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7129.358126 secs 2024-04-26T20:17:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7129.358126 secs 2024-04-26T20:17:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:14 smithi156 ceph-mon[32679]: pgmap v4400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6432.337796 secs 2024-04-26T20:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:14 smithi092 ceph-mon[29156]: pgmap v4400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6432.337796 secs 2024-04-26T20:17:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:14 smithi189 ceph-mon[32756]: pgmap v4400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6432.337796 secs 2024-04-26T20:17:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:15 smithi092 ceph-mon[29156]: pgmap v4401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:15 smithi189 ceph-mon[32756]: pgmap v4401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:15 smithi156 ceph-mon[32679]: pgmap v4401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:18 smithi092 ceph-mon[29156]: pgmap v4402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:18 smithi189 ceph-mon[32756]: pgmap v4402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:18 smithi156 ceph-mon[32679]: pgmap v4402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7134.358267 secs 2024-04-26T20:17:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7134.358267 secs 2024-04-26T20:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7134.358267 secs 2024-04-26T20:17:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6437.337869 secs 2024-04-26T20:17:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:20 smithi092 ceph-mon[29156]: pgmap v4403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6437.337869 secs 2024-04-26T20:17:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:20 smithi189 ceph-mon[32756]: pgmap v4403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6437.337869 secs 2024-04-26T20:17:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:20 smithi156 ceph-mon[32679]: pgmap v4403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:22 smithi092 ceph-mon[29156]: pgmap v4404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:22 smithi189 ceph-mon[32756]: pgmap v4404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:22 smithi156 ceph-mon[32679]: pgmap v4404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:24 smithi092 ceph-mon[29156]: pgmap v4405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7139.358410 secs 2024-04-26T20:17:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:24 smithi189 ceph-mon[32756]: pgmap v4405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7139.358410 secs 2024-04-26T20:17:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:24 smithi156 ceph-mon[32679]: pgmap v4405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7139.358410 secs 2024-04-26T20:17:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6442.337976 secs 2024-04-26T20:17:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6442.337976 secs 2024-04-26T20:17:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6442.337976 secs 2024-04-26T20:17:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:26 smithi092 ceph-mon[29156]: pgmap v4406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:26 smithi189 ceph-mon[32756]: pgmap v4406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:26 smithi156 ceph-mon[32679]: pgmap v4406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:28 smithi092 ceph-mon[29156]: pgmap v4407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:28 smithi189 ceph-mon[32756]: pgmap v4407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:28 smithi156 ceph-mon[32679]: pgmap v4407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7144.358533 secs 2024-04-26T20:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7144.358533 secs 2024-04-26T20:17:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7144.358533 secs 2024-04-26T20:17:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6447.338047 secs 2024-04-26T20:17:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:30 smithi092 ceph-mon[29156]: pgmap v4408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6447.338047 secs 2024-04-26T20:17:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:30 smithi189 ceph-mon[32756]: pgmap v4408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6447.338047 secs 2024-04-26T20:17:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:30 smithi156 ceph-mon[32679]: pgmap v4408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:32 smithi092 ceph-mon[29156]: pgmap v4409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:32 smithi189 ceph-mon[32756]: pgmap v4409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:32 smithi156 ceph-mon[32679]: pgmap v4409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:34 smithi092 ceph-mon[29156]: pgmap v4410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7149.358665 secs 2024-04-26T20:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:34 smithi189 ceph-mon[32756]: pgmap v4410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7149.358665 secs 2024-04-26T20:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:34 smithi156 ceph-mon[32679]: pgmap v4410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7149.358665 secs 2024-04-26T20:17:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6452.338187 secs 2024-04-26T20:17:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6452.338187 secs 2024-04-26T20:17:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6452.338187 secs 2024-04-26T20:17:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:36 smithi189 ceph-mon[32756]: pgmap v4411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:36 smithi156 ceph-mon[32679]: pgmap v4411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:36 smithi092 ceph-mon[29156]: pgmap v4411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:38 smithi189 ceph-mon[32756]: pgmap v4412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:38 smithi156 ceph-mon[32679]: pgmap v4412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:38 smithi092 ceph-mon[29156]: pgmap v4412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7154.358782 secs 2024-04-26T20:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7154.358782 secs 2024-04-26T20:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7154.358782 secs 2024-04-26T20:17:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:17:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6457.338323 secs 2024-04-26T20:17:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:40 smithi189 ceph-mon[32756]: pgmap v4413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6457.338323 secs 2024-04-26T20:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:40 smithi156 ceph-mon[32679]: pgmap v4413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6457.338323 secs 2024-04-26T20:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:40 smithi092 ceph-mon[29156]: pgmap v4413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:17:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:41 smithi189 ceph-mon[32756]: pgmap v4414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:17:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:41 smithi189 ceph-mon[32756]: pgmap v4415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:41 smithi156 ceph-mon[32679]: pgmap v4414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:17:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:41 smithi156 ceph-mon[32679]: pgmap v4415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:41 smithi092 ceph-mon[29156]: pgmap v4414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:17:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:41 smithi092 ceph-mon[29156]: pgmap v4415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:43 smithi189 ceph-mon[32756]: pgmap v4416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:43 smithi156 ceph-mon[32679]: pgmap v4416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:43 smithi092 ceph-mon[29156]: pgmap v4416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:44.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7159.358859 secs 2024-04-26T20:17:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7159.358859 secs 2024-04-26T20:17:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7159.358859 secs 2024-04-26T20:17:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6462.338361 secs 2024-04-26T20:17:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:45 smithi189 ceph-mon[32756]: pgmap v4417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6462.338361 secs 2024-04-26T20:17:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:45 smithi156 ceph-mon[32679]: pgmap v4417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6462.338361 secs 2024-04-26T20:17:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:45 smithi092 ceph-mon[29156]: pgmap v4417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:47 smithi189 ceph-mon[32756]: pgmap v4418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:47 smithi156 ceph-mon[32679]: pgmap v4418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:47 smithi092 ceph-mon[29156]: pgmap v4418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:49 smithi189 ceph-mon[32756]: pgmap v4419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7164.358973 secs 2024-04-26T20:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:49 smithi156 ceph-mon[32679]: pgmap v4419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7164.358973 secs 2024-04-26T20:17:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:49 smithi092 ceph-mon[29156]: pgmap v4419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:17:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7164.358973 secs 2024-04-26T20:17:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6467.338478 secs 2024-04-26T20:17:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6467.338478 secs 2024-04-26T20:17:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6467.338478 secs 2024-04-26T20:17:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:51 smithi189 ceph-mon[32756]: pgmap v4420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:17:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:51 smithi156 ceph-mon[32679]: pgmap v4420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:17:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:51 smithi092 ceph-mon[29156]: pgmap v4420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:17:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:53 smithi189 ceph-mon[32756]: pgmap v4421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:53 smithi156 ceph-mon[32679]: pgmap v4421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:53 smithi092 ceph-mon[29156]: pgmap v4421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7169.359038 secs 2024-04-26T20:17:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7169.359038 secs 2024-04-26T20:17:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7169.359038 secs 2024-04-26T20:17:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6472.338568 secs 2024-04-26T20:17:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:55 smithi189 ceph-mon[32756]: pgmap v4422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6472.338568 secs 2024-04-26T20:17:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:55 smithi156 ceph-mon[32679]: pgmap v4422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6472.338568 secs 2024-04-26T20:17:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:55 smithi092 ceph-mon[29156]: pgmap v4422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:17:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:57 smithi189 ceph-mon[32756]: pgmap v4423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:57 smithi156 ceph-mon[32679]: pgmap v4423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:57 smithi092 ceph-mon[29156]: pgmap v4423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:59 smithi189 ceph-mon[32756]: pgmap v4424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:17:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7174.359154 secs 2024-04-26T20:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:59 smithi156 ceph-mon[32679]: pgmap v4424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:17:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7174.359154 secs 2024-04-26T20:17:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:59 smithi092 ceph-mon[29156]: pgmap v4424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:17:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:17:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7174.359154 secs 2024-04-26T20:18:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6477.338657 secs 2024-04-26T20:18:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6477.338657 secs 2024-04-26T20:18:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6477.338657 secs 2024-04-26T20:18:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:01 smithi189 ceph-mon[32756]: pgmap v4425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:01 smithi156 ceph-mon[32679]: pgmap v4425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:01 smithi092 ceph-mon[29156]: pgmap v4425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:03 smithi189 ceph-mon[32756]: pgmap v4426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:03 smithi156 ceph-mon[32679]: pgmap v4426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:03 smithi092 ceph-mon[29156]: pgmap v4426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7179.359250 secs 2024-04-26T20:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7179.359250 secs 2024-04-26T20:18:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7179.359250 secs 2024-04-26T20:18:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6482.338795 secs 2024-04-26T20:18:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:05 smithi189 ceph-mon[32756]: pgmap v4427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6482.338795 secs 2024-04-26T20:18:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:05 smithi156 ceph-mon[32679]: pgmap v4427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6482.338795 secs 2024-04-26T20:18:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:05 smithi092 ceph-mon[29156]: pgmap v4427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:07 smithi189 ceph-mon[32756]: pgmap v4428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:07 smithi156 ceph-mon[32679]: pgmap v4428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:07 smithi092 ceph-mon[29156]: pgmap v4428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7184.359370 secs 2024-04-26T20:18:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7184.359370 secs 2024-04-26T20:18:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7184.359370 secs 2024-04-26T20:18:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:09 smithi189 ceph-mon[32756]: pgmap v4429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:09 smithi156 ceph-mon[32679]: pgmap v4429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:09 smithi092 ceph-mon[29156]: pgmap v4429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6487.338880 secs 2024-04-26T20:18:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6487.338880 secs 2024-04-26T20:18:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6487.338880 secs 2024-04-26T20:18:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:11 smithi189 ceph-mon[32756]: pgmap v4430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:11 smithi156 ceph-mon[32679]: pgmap v4430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:11 smithi092 ceph-mon[29156]: pgmap v4430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:13 smithi189 ceph-mon[32756]: pgmap v4431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7189.359490 secs 2024-04-26T20:18:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:13 smithi156 ceph-mon[32679]: pgmap v4431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7189.359490 secs 2024-04-26T20:18:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:13 smithi092 ceph-mon[29156]: pgmap v4431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7189.359490 secs 2024-04-26T20:18:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6492.338999 secs 2024-04-26T20:18:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:15 smithi189 ceph-mon[32756]: pgmap v4432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6492.338999 secs 2024-04-26T20:18:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:15 smithi156 ceph-mon[32679]: pgmap v4432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6492.338999 secs 2024-04-26T20:18:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:15 smithi092 ceph-mon[29156]: pgmap v4432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:17 smithi189 ceph-mon[32756]: pgmap v4433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:17 smithi156 ceph-mon[32679]: pgmap v4433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:17 smithi092 ceph-mon[29156]: pgmap v4433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7194.359602 secs 2024-04-26T20:18:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7194.359602 secs 2024-04-26T20:18:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7194.359602 secs 2024-04-26T20:18:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:19 smithi156 ceph-mon[32679]: pgmap v4434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6497.339121 secs 2024-04-26T20:18:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:19 smithi092 ceph-mon[29156]: pgmap v4434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6497.339121 secs 2024-04-26T20:18:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:19 smithi189 ceph-mon[32756]: pgmap v4434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:19.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6497.339121 secs 2024-04-26T20:18:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:21 smithi156 ceph-mon[32679]: pgmap v4435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:21 smithi092 ceph-mon[29156]: pgmap v4435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:21 smithi189 ceph-mon[32756]: pgmap v4435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:23 smithi156 ceph-mon[32679]: pgmap v4436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7199.359721 secs 2024-04-26T20:18:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:23 smithi092 ceph-mon[29156]: pgmap v4436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7199.359721 secs 2024-04-26T20:18:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:23 smithi189 ceph-mon[32756]: pgmap v4436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7199.359721 secs 2024-04-26T20:18:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6502.339195 secs 2024-04-26T20:18:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6502.339195 secs 2024-04-26T20:18:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6502.339195 secs 2024-04-26T20:18:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:25 smithi156 ceph-mon[32679]: pgmap v4437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:25 smithi092 ceph-mon[29156]: pgmap v4437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:25 smithi189 ceph-mon[32756]: pgmap v4437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:27 smithi156 ceph-mon[32679]: pgmap v4438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:27 smithi092 ceph-mon[29156]: pgmap v4438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:27 smithi189 ceph-mon[32756]: pgmap v4438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7204.359900 secs 2024-04-26T20:18:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7204.359900 secs 2024-04-26T20:18:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7204.359900 secs 2024-04-26T20:18:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:29 smithi156 ceph-mon[32679]: pgmap v4439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6507.339354 secs 2024-04-26T20:18:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:29 smithi092 ceph-mon[29156]: pgmap v4439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6507.339354 secs 2024-04-26T20:18:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:29 smithi189 ceph-mon[32756]: pgmap v4439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6507.339354 secs 2024-04-26T20:18:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:31 smithi156 ceph-mon[32679]: pgmap v4440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:31 smithi092 ceph-mon[29156]: pgmap v4440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:31 smithi189 ceph-mon[32756]: pgmap v4440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:33 smithi156 ceph-mon[32679]: pgmap v4441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7209.359981 secs 2024-04-26T20:18:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:33 smithi092 ceph-mon[29156]: pgmap v4441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7209.359981 secs 2024-04-26T20:18:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:33 smithi189 ceph-mon[32756]: pgmap v4441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7209.359981 secs 2024-04-26T20:18:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6512.339463 secs 2024-04-26T20:18:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6512.339463 secs 2024-04-26T20:18:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6512.339463 secs 2024-04-26T20:18:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:35 smithi156 ceph-mon[32679]: pgmap v4442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:35 smithi092 ceph-mon[29156]: pgmap v4442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:35 smithi189 ceph-mon[32756]: pgmap v4442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:18:35.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:35.998+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca8082000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:18:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:18:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:18:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:18:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=6 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:18:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:18:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T20:18:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.029+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T20:18:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.962+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:18:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.962+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:18:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.962+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:18:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:18:36.963+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 59 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:18:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:37 smithi092 ceph-mon[29156]: pgmap v4443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:37 smithi189 ceph-mon[32756]: pgmap v4443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:37 smithi156 ceph-mon[32679]: pgmap v4443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7214.360056 secs 2024-04-26T20:18:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7214.360056 secs 2024-04-26T20:18:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7214.360056 secs 2024-04-26T20:18:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:39 smithi092 ceph-mon[29156]: pgmap v4444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6517.339546 secs 2024-04-26T20:18:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:39 smithi189 ceph-mon[32756]: pgmap v4444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6517.339546 secs 2024-04-26T20:18:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:39 smithi156 ceph-mon[32679]: pgmap v4444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6517.339546 secs 2024-04-26T20:18:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:18:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:41 smithi092 ceph-mon[29156]: pgmap v4445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:18:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:41 smithi189 ceph-mon[32756]: pgmap v4445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:18:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:41 smithi156 ceph-mon[32679]: pgmap v4445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:18:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:18:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:18:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:42 smithi092 ceph-mon[29156]: pgmap v4446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:18:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:42 smithi092 ceph-mon[29156]: pgmap v4447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:42 smithi189 ceph-mon[32756]: pgmap v4446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:18:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:42 smithi189 ceph-mon[32756]: pgmap v4447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:42 smithi156 ceph-mon[32679]: pgmap v4446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:18:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:42 smithi156 ceph-mon[32679]: pgmap v4447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7219.360183 secs 2024-04-26T20:18:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7219.360183 secs 2024-04-26T20:18:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7219.360183 secs 2024-04-26T20:18:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:44 smithi092 ceph-mon[29156]: pgmap v4448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:18:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6522.339614 secs 2024-04-26T20:18:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:44 smithi189 ceph-mon[32756]: pgmap v4448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:18:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6522.339614 secs 2024-04-26T20:18:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:44 smithi156 ceph-mon[32679]: pgmap v4448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:18:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6522.339614 secs 2024-04-26T20:18:46.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:46 smithi156 ceph-mon[32679]: pgmap v4449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:46 smithi092 ceph-mon[29156]: pgmap v4449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:46 smithi189 ceph-mon[32756]: pgmap v4449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:48 smithi092 ceph-mon[29156]: pgmap v4450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7224.360299 secs 2024-04-26T20:18:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:48 smithi189 ceph-mon[32756]: pgmap v4450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7224.360299 secs 2024-04-26T20:18:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:48 smithi156 ceph-mon[32679]: pgmap v4450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7224.360299 secs 2024-04-26T20:18:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6527.339688 secs 2024-04-26T20:18:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6527.339688 secs 2024-04-26T20:18:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6527.339688 secs 2024-04-26T20:18:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:50 smithi092 ceph-mon[29156]: pgmap v4451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:50 smithi189 ceph-mon[32756]: pgmap v4451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:50 smithi156 ceph-mon[32679]: pgmap v4451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:18:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:52 smithi092 ceph-mon[29156]: pgmap v4452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:18:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:52 smithi189 ceph-mon[32756]: pgmap v4452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:18:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:52 smithi156 ceph-mon[32679]: pgmap v4452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:18:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7229.360416 secs 2024-04-26T20:18:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7229.360416 secs 2024-04-26T20:18:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7229.360416 secs 2024-04-26T20:18:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:54 smithi092 ceph-mon[29156]: pgmap v4453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6532.339754 secs 2024-04-26T20:18:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:54 smithi189 ceph-mon[32756]: pgmap v4453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6532.339754 secs 2024-04-26T20:18:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:54 smithi156 ceph-mon[32679]: pgmap v4453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6532.339754 secs 2024-04-26T20:18:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:56 smithi189 ceph-mon[32756]: pgmap v4454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:56 smithi156 ceph-mon[32679]: pgmap v4454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:56 smithi092 ceph-mon[29156]: pgmap v4454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:18:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:58 smithi189 ceph-mon[32756]: pgmap v4455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7234.360512 secs 2024-04-26T20:18:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:58 smithi156 ceph-mon[32679]: pgmap v4455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7234.360512 secs 2024-04-26T20:18:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:58 smithi092 ceph-mon[29156]: pgmap v4455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:18:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7234.360512 secs 2024-04-26T20:18:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:18:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6537.339896 secs 2024-04-26T20:18:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:18:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6537.339896 secs 2024-04-26T20:18:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:18:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6537.339896 secs 2024-04-26T20:19:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:00 smithi189 ceph-mon[32756]: pgmap v4456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:00 smithi156 ceph-mon[32679]: pgmap v4456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:00 smithi092 ceph-mon[29156]: pgmap v4456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:02 smithi189 ceph-mon[32756]: pgmap v4457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:02 smithi156 ceph-mon[32679]: pgmap v4457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:02 smithi092 ceph-mon[29156]: pgmap v4457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7239.360640 secs 2024-04-26T20:19:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7239.360640 secs 2024-04-26T20:19:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7239.360640 secs 2024-04-26T20:19:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:04 smithi189 ceph-mon[32756]: pgmap v4458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6542.340036 secs 2024-04-26T20:19:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:04 smithi156 ceph-mon[32679]: pgmap v4458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6542.340036 secs 2024-04-26T20:19:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:04 smithi092 ceph-mon[29156]: pgmap v4458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6542.340036 secs 2024-04-26T20:19:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:06 smithi189 ceph-mon[32756]: pgmap v4459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:06 smithi156 ceph-mon[32679]: pgmap v4459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:06 smithi092 ceph-mon[29156]: pgmap v4459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:08 smithi189 ceph-mon[32756]: pgmap v4460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7244.360768 secs 2024-04-26T20:19:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:08 smithi156 ceph-mon[32679]: pgmap v4460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7244.360768 secs 2024-04-26T20:19:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:08 smithi092 ceph-mon[29156]: pgmap v4460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7244.360768 secs 2024-04-26T20:19:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6547.340186 secs 2024-04-26T20:19:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6547.340186 secs 2024-04-26T20:19:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6547.340186 secs 2024-04-26T20:19:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:10 smithi189 ceph-mon[32756]: pgmap v4461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:10 smithi156 ceph-mon[32679]: pgmap v4461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:10 smithi092 ceph-mon[29156]: pgmap v4461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:12 smithi189 ceph-mon[32756]: pgmap v4462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:12 smithi156 ceph-mon[32679]: pgmap v4462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:12 smithi092 ceph-mon[29156]: pgmap v4462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7249.360895 secs 2024-04-26T20:19:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7249.360895 secs 2024-04-26T20:19:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7249.360895 secs 2024-04-26T20:19:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:14 smithi189 ceph-mon[32756]: pgmap v4463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6552.340327 secs 2024-04-26T20:19:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:14 smithi156 ceph-mon[32679]: pgmap v4463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6552.340327 secs 2024-04-26T20:19:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:14 smithi092 ceph-mon[29156]: pgmap v4463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6552.340327 secs 2024-04-26T20:19:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:16 smithi189 ceph-mon[32756]: pgmap v4464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:16 smithi156 ceph-mon[32679]: pgmap v4464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:16 smithi092 ceph-mon[29156]: pgmap v4464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:18 smithi189 ceph-mon[32756]: pgmap v4465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7254.361032 secs 2024-04-26T20:19:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:18 smithi156 ceph-mon[32679]: pgmap v4465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7254.361032 secs 2024-04-26T20:19:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:18 smithi092 ceph-mon[29156]: pgmap v4465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:19.082 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7254.361032 secs 2024-04-26T20:19:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6557.340444 secs 2024-04-26T20:19:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6557.340444 secs 2024-04-26T20:19:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6557.340444 secs 2024-04-26T20:19:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:20 smithi189 ceph-mon[32756]: pgmap v4466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:20 smithi156 ceph-mon[32679]: pgmap v4466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:20 smithi092 ceph-mon[29156]: pgmap v4466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:22 smithi189 ceph-mon[32756]: pgmap v4467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:22 smithi156 ceph-mon[32679]: pgmap v4467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:22 smithi092 ceph-mon[29156]: pgmap v4467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7259.361100 secs 2024-04-26T20:19:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7259.361100 secs 2024-04-26T20:19:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7259.361100 secs 2024-04-26T20:19:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:24 smithi189 ceph-mon[32756]: pgmap v4468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6562.340563 secs 2024-04-26T20:19:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:24 smithi156 ceph-mon[32679]: pgmap v4468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6562.340563 secs 2024-04-26T20:19:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:24 smithi092 ceph-mon[29156]: pgmap v4468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6562.340563 secs 2024-04-26T20:19:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:26 smithi189 ceph-mon[32756]: pgmap v4469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:26 smithi156 ceph-mon[32679]: pgmap v4469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:26 smithi092 ceph-mon[29156]: pgmap v4469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:28 smithi189 ceph-mon[32756]: pgmap v4470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7264.361238 secs 2024-04-26T20:19:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:28 smithi156 ceph-mon[32679]: pgmap v4470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7264.361238 secs 2024-04-26T20:19:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:28 smithi092 ceph-mon[29156]: pgmap v4470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7264.361238 secs 2024-04-26T20:19:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6567.340705 secs 2024-04-26T20:19:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6567.340705 secs 2024-04-26T20:19:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6567.340705 secs 2024-04-26T20:19:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:30 smithi189 ceph-mon[32756]: pgmap v4471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:30 smithi156 ceph-mon[32679]: pgmap v4471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:30 smithi092 ceph-mon[29156]: pgmap v4471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:32 smithi189 ceph-mon[32756]: pgmap v4472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:32 smithi156 ceph-mon[32679]: pgmap v4472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:32 smithi092 ceph-mon[29156]: pgmap v4472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7269.361379 secs 2024-04-26T20:19:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7269.361379 secs 2024-04-26T20:19:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7269.361379 secs 2024-04-26T20:19:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:34 smithi189 ceph-mon[32756]: pgmap v4473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6572.340769 secs 2024-04-26T20:19:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:34 smithi156 ceph-mon[32679]: pgmap v4473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6572.340769 secs 2024-04-26T20:19:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:34 smithi092 ceph-mon[29156]: pgmap v4473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6572.340769 secs 2024-04-26T20:19:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:36 smithi189 ceph-mon[32756]: pgmap v4474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:36 smithi156 ceph-mon[32679]: pgmap v4474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:36 smithi092 ceph-mon[29156]: pgmap v4474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:38 smithi189 ceph-mon[32756]: pgmap v4475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7274.361531 secs 2024-04-26T20:19:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:38 smithi156 ceph-mon[32679]: pgmap v4475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7274.361531 secs 2024-04-26T20:19:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:38 smithi092 ceph-mon[29156]: pgmap v4475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7274.361531 secs 2024-04-26T20:19:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6577.340912 secs 2024-04-26T20:19:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6577.340912 secs 2024-04-26T20:19:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6577.340912 secs 2024-04-26T20:19:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:40 smithi189 ceph-mon[32756]: pgmap v4476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:40 smithi156 ceph-mon[32679]: pgmap v4476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:40 smithi092 ceph-mon[29156]: pgmap v4476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:19:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:19:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:19:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:19:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:19:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:19:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:42 smithi189 ceph-mon[32756]: pgmap v4477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:42 smithi189 ceph-mon[32756]: pgmap v4478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:19:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:42 smithi189 ceph-mon[32756]: pgmap v4479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:42 smithi156 ceph-mon[32679]: pgmap v4477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:42 smithi156 ceph-mon[32679]: pgmap v4478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:19:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:42 smithi156 ceph-mon[32679]: pgmap v4479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:42 smithi092 ceph-mon[29156]: pgmap v4477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:42 smithi092 ceph-mon[29156]: pgmap v4478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:19:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:42 smithi092 ceph-mon[29156]: pgmap v4479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7279.361646 secs 2024-04-26T20:19:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7279.361646 secs 2024-04-26T20:19:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7279.361646 secs 2024-04-26T20:19:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6582.341048 secs 2024-04-26T20:19:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:44 smithi189 ceph-mon[32756]: pgmap v4480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6582.341048 secs 2024-04-26T20:19:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:44 smithi156 ceph-mon[32679]: pgmap v4480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6582.341048 secs 2024-04-26T20:19:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:44 smithi092 ceph-mon[29156]: pgmap v4480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:46 smithi189 ceph-mon[32756]: pgmap v4481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:46 smithi156 ceph-mon[32679]: pgmap v4481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:46 smithi092 ceph-mon[29156]: pgmap v4481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:48 smithi189 ceph-mon[32756]: pgmap v4482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:19:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7284.361761 secs 2024-04-26T20:19:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:48 smithi156 ceph-mon[32679]: pgmap v4482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:19:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7284.361761 secs 2024-04-26T20:19:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:48 smithi092 ceph-mon[29156]: pgmap v4482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:19:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7284.361761 secs 2024-04-26T20:19:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6587.341183 secs 2024-04-26T20:19:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6587.341183 secs 2024-04-26T20:19:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6587.341183 secs 2024-04-26T20:19:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:50 smithi189 ceph-mon[32756]: pgmap v4483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:50 smithi156 ceph-mon[32679]: pgmap v4483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:50 smithi092 ceph-mon[29156]: pgmap v4483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:19:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:52 smithi156 ceph-mon[32679]: pgmap v4484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:19:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:52 smithi092 ceph-mon[29156]: pgmap v4484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:19:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:52 smithi189 ceph-mon[32756]: pgmap v4484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:19:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7289.361872 secs 2024-04-26T20:19:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7289.361872 secs 2024-04-26T20:19:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7289.361872 secs 2024-04-26T20:19:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6592.341323 secs 2024-04-26T20:19:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:54 smithi156 ceph-mon[32679]: pgmap v4485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6592.341323 secs 2024-04-26T20:19:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:54 smithi092 ceph-mon[29156]: pgmap v4485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6592.341323 secs 2024-04-26T20:19:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:54 smithi189 ceph-mon[32756]: pgmap v4485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:19:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:56 smithi156 ceph-mon[32679]: pgmap v4486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:56 smithi092 ceph-mon[29156]: pgmap v4486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:56 smithi189 ceph-mon[32756]: pgmap v4486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:58 smithi156 ceph-mon[32679]: pgmap v4487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7294.361989 secs 2024-04-26T20:19:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:58 smithi092 ceph-mon[29156]: pgmap v4487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7294.361989 secs 2024-04-26T20:19:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:58 smithi189 ceph-mon[32756]: pgmap v4487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:19:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7294.361989 secs 2024-04-26T20:19:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:19:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6597.341470 secs 2024-04-26T20:19:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:19:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6597.341470 secs 2024-04-26T20:20:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:19:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6597.341470 secs 2024-04-26T20:20:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:00 smithi156 ceph-mon[32679]: pgmap v4488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:20:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:00 smithi092 ceph-mon[29156]: pgmap v4488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:20:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:00 smithi189 ceph-mon[32756]: pgmap v4488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:20:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:02 smithi156 ceph-mon[32679]: pgmap v4489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:02 smithi092 ceph-mon[29156]: pgmap v4489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:02 smithi189 ceph-mon[32756]: pgmap v4489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7299.362111 secs 2024-04-26T20:20:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7299.362111 secs 2024-04-26T20:20:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7299.362111 secs 2024-04-26T20:20:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6602.341587 secs 2024-04-26T20:20:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:04 smithi156 ceph-mon[32679]: pgmap v4490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6602.341587 secs 2024-04-26T20:20:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:04 smithi092 ceph-mon[29156]: pgmap v4490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6602.341587 secs 2024-04-26T20:20:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:04 smithi189 ceph-mon[32756]: pgmap v4490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:06 smithi156 ceph-mon[32679]: pgmap v4491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:06 smithi092 ceph-mon[29156]: pgmap v4491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:06 smithi189 ceph-mon[32756]: pgmap v4491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:08 smithi156 ceph-mon[32679]: pgmap v4492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7304.362244 secs 2024-04-26T20:20:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:08 smithi092 ceph-mon[29156]: pgmap v4492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7304.362244 secs 2024-04-26T20:20:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:08 smithi189 ceph-mon[32756]: pgmap v4492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7304.362244 secs 2024-04-26T20:20:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6607.341701 secs 2024-04-26T20:20:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6607.341701 secs 2024-04-26T20:20:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6607.341701 secs 2024-04-26T20:20:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:10 smithi156 ceph-mon[32679]: pgmap v4493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:10 smithi092 ceph-mon[29156]: pgmap v4493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:10 smithi189 ceph-mon[32756]: pgmap v4493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:12 smithi156 ceph-mon[32679]: pgmap v4494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:12 smithi092 ceph-mon[29156]: pgmap v4494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:12 smithi189 ceph-mon[32756]: pgmap v4494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7309.362362 secs 2024-04-26T20:20:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7309.362362 secs 2024-04-26T20:20:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7309.362362 secs 2024-04-26T20:20:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6612.341841 secs 2024-04-26T20:20:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:14 smithi156 ceph-mon[32679]: pgmap v4495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6612.341841 secs 2024-04-26T20:20:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:14 smithi092 ceph-mon[29156]: pgmap v4495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6612.341841 secs 2024-04-26T20:20:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:14 smithi189 ceph-mon[32756]: pgmap v4495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:16 smithi189 ceph-mon[32756]: pgmap v4496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:16 smithi156 ceph-mon[32679]: pgmap v4496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:16 smithi092 ceph-mon[29156]: pgmap v4496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:18 smithi189 ceph-mon[32756]: pgmap v4497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7314.362477 secs 2024-04-26T20:20:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:18 smithi156 ceph-mon[32679]: pgmap v4497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7314.362477 secs 2024-04-26T20:20:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:18 smithi092 ceph-mon[29156]: pgmap v4497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7314.362477 secs 2024-04-26T20:20:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6617.341950 secs 2024-04-26T20:20:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6617.341950 secs 2024-04-26T20:20:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6617.341950 secs 2024-04-26T20:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:20 smithi189 ceph-mon[32756]: pgmap v4498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:20 smithi156 ceph-mon[32679]: pgmap v4498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:20 smithi092 ceph-mon[29156]: pgmap v4498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:22 smithi189 ceph-mon[32756]: pgmap v4499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:22 smithi156 ceph-mon[32679]: pgmap v4499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:22 smithi092 ceph-mon[29156]: pgmap v4499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7319.362589 secs 2024-04-26T20:20:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7319.362589 secs 2024-04-26T20:20:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7319.362589 secs 2024-04-26T20:20:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6622.342058 secs 2024-04-26T20:20:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:24 smithi189 ceph-mon[32756]: pgmap v4500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6622.342058 secs 2024-04-26T20:20:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:24 smithi156 ceph-mon[32679]: pgmap v4500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6622.342058 secs 2024-04-26T20:20:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:24 smithi092 ceph-mon[29156]: pgmap v4500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:26 smithi189 ceph-mon[32756]: pgmap v4501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:26 smithi156 ceph-mon[32679]: pgmap v4501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:26 smithi092 ceph-mon[29156]: pgmap v4501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:28 smithi189 ceph-mon[32756]: pgmap v4502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7324.362704 secs 2024-04-26T20:20:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:28 smithi156 ceph-mon[32679]: pgmap v4502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7324.362704 secs 2024-04-26T20:20:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:28 smithi092 ceph-mon[29156]: pgmap v4502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7324.362704 secs 2024-04-26T20:20:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6627.342191 secs 2024-04-26T20:20:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6627.342191 secs 2024-04-26T20:20:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6627.342191 secs 2024-04-26T20:20:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:30 smithi189 ceph-mon[32756]: pgmap v4503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:30 smithi156 ceph-mon[32679]: pgmap v4503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:30 smithi092 ceph-mon[29156]: pgmap v4503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:32 smithi189 ceph-mon[32756]: pgmap v4504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:32 smithi156 ceph-mon[32679]: pgmap v4504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:32 smithi092 ceph-mon[29156]: pgmap v4504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7329.362848 secs 2024-04-26T20:20:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7329.362848 secs 2024-04-26T20:20:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7329.362848 secs 2024-04-26T20:20:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6632.342329 secs 2024-04-26T20:20:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:34 smithi189 ceph-mon[32756]: pgmap v4505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6632.342329 secs 2024-04-26T20:20:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:34 smithi156 ceph-mon[32679]: pgmap v4505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6632.342329 secs 2024-04-26T20:20:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:34 smithi092 ceph-mon[29156]: pgmap v4505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:36 smithi189 ceph-mon[32756]: pgmap v4506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:36 smithi156 ceph-mon[32679]: pgmap v4506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:36 smithi092 ceph-mon[29156]: pgmap v4506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:38 smithi189 ceph-mon[32756]: pgmap v4507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7334.362941 secs 2024-04-26T20:20:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:38 smithi156 ceph-mon[32679]: pgmap v4507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7334.362941 secs 2024-04-26T20:20:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:38 smithi092 ceph-mon[29156]: pgmap v4507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7334.362941 secs 2024-04-26T20:20:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6637.342368 secs 2024-04-26T20:20:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6637.342368 secs 2024-04-26T20:20:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6637.342368 secs 2024-04-26T20:20:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:40 smithi189 ceph-mon[32756]: pgmap v4508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:40 smithi156 ceph-mon[32679]: pgmap v4508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:40 smithi092 ceph-mon[29156]: pgmap v4508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:20:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:42 smithi189 ceph-mon[32756]: pgmap v4509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:20:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:42 smithi156 ceph-mon[32679]: pgmap v4509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:20:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:42 smithi092 ceph-mon[29156]: pgmap v4509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:20:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:20:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:20:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:43 smithi189 ceph-mon[32756]: pgmap v4510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:20:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:43 smithi189 ceph-mon[32756]: pgmap v4511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7339.363060 secs 2024-04-26T20:20:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:43 smithi156 ceph-mon[32679]: pgmap v4510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:20:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:43 smithi156 ceph-mon[32679]: pgmap v4511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7339.363060 secs 2024-04-26T20:20:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:43 smithi092 ceph-mon[29156]: pgmap v4510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:20:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:43 smithi092 ceph-mon[29156]: pgmap v4511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7339.363060 secs 2024-04-26T20:20:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6642.342448 secs 2024-04-26T20:20:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6642.342448 secs 2024-04-26T20:20:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6642.342448 secs 2024-04-26T20:20:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:45 smithi156 ceph-mon[32679]: pgmap v4512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:45 smithi092 ceph-mon[29156]: pgmap v4512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:45 smithi189 ceph-mon[32756]: pgmap v4512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:47 smithi156 ceph-mon[32679]: pgmap v4513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:47 smithi092 ceph-mon[29156]: pgmap v4513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:47 smithi189 ceph-mon[32756]: pgmap v4513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7344.363150 secs 2024-04-26T20:20:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7344.363150 secs 2024-04-26T20:20:49.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7344.363150 secs 2024-04-26T20:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:49 smithi156 ceph-mon[32679]: pgmap v4514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6647.342524 secs 2024-04-26T20:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:49 smithi092 ceph-mon[29156]: pgmap v4514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6647.342524 secs 2024-04-26T20:20:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:49 smithi189 ceph-mon[32756]: pgmap v4514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:20:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6647.342524 secs 2024-04-26T20:20:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:51 smithi156 ceph-mon[32679]: pgmap v4515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:51 smithi092 ceph-mon[29156]: pgmap v4515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:51 smithi189 ceph-mon[32756]: pgmap v4515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:20:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:53 smithi156 ceph-mon[32679]: pgmap v4516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:20:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7349.363298 secs 2024-04-26T20:20:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:53 smithi092 ceph-mon[29156]: pgmap v4516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:20:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7349.363298 secs 2024-04-26T20:20:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:53 smithi189 ceph-mon[32756]: pgmap v4516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:20:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7349.363298 secs 2024-04-26T20:20:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6652.342619 secs 2024-04-26T20:20:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6652.342619 secs 2024-04-26T20:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6652.342619 secs 2024-04-26T20:20:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:55 smithi156 ceph-mon[32679]: pgmap v4517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:55 smithi092 ceph-mon[29156]: pgmap v4517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:55 smithi189 ceph-mon[32756]: pgmap v4517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:20:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:57 smithi156 ceph-mon[32679]: pgmap v4518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:57 smithi092 ceph-mon[29156]: pgmap v4518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:57 smithi189 ceph-mon[32756]: pgmap v4518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7354.363432 secs 2024-04-26T20:20:59.008 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7354.363432 secs 2024-04-26T20:20:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7354.363432 secs 2024-04-26T20:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:59 smithi092 ceph-mon[29156]: pgmap v4519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:20:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6657.342672 secs 2024-04-26T20:21:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:59 smithi189 ceph-mon[32756]: pgmap v4519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:20:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6657.342672 secs 2024-04-26T20:21:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:59 smithi156 ceph-mon[32679]: pgmap v4519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:20:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6657.342672 secs 2024-04-26T20:21:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:00 smithi092 ceph-mon[29156]: pgmap v4520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:00 smithi189 ceph-mon[32756]: pgmap v4520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:00 smithi156 ceph-mon[32679]: pgmap v4520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:03 smithi189 ceph-mon[32756]: pgmap v4521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:03 smithi156 ceph-mon[32679]: pgmap v4521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:03 smithi092 ceph-mon[29156]: pgmap v4521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7359.363510 secs 2024-04-26T20:21:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7359.363510 secs 2024-04-26T20:21:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7359.363510 secs 2024-04-26T20:21:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6662.342733 secs 2024-04-26T20:21:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:05 smithi189 ceph-mon[32756]: pgmap v4522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6662.342733 secs 2024-04-26T20:21:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:05 smithi156 ceph-mon[32679]: pgmap v4522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6662.342733 secs 2024-04-26T20:21:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:05 smithi092 ceph-mon[29156]: pgmap v4522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:07 smithi189 ceph-mon[32756]: pgmap v4523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:07 smithi156 ceph-mon[32679]: pgmap v4523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:07 smithi092 ceph-mon[29156]: pgmap v4523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7364.363626 secs 2024-04-26T20:21:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:09 smithi189 ceph-mon[32756]: pgmap v4524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7364.363626 secs 2024-04-26T20:21:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:09 smithi156 ceph-mon[32679]: pgmap v4524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7364.363626 secs 2024-04-26T20:21:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:09 smithi092 ceph-mon[29156]: pgmap v4524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6667.342820 secs 2024-04-26T20:21:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6667.342820 secs 2024-04-26T20:21:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6667.342820 secs 2024-04-26T20:21:11.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:11 smithi092 ceph-mon[29156]: pgmap v4525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:11 smithi189 ceph-mon[32756]: pgmap v4525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:11 smithi156 ceph-mon[32679]: pgmap v4525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:13 smithi189 ceph-mon[32756]: pgmap v4526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7369.363755 secs 2024-04-26T20:21:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:13 smithi156 ceph-mon[32679]: pgmap v4526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7369.363755 secs 2024-04-26T20:21:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:13 smithi092 ceph-mon[29156]: pgmap v4526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7369.363755 secs 2024-04-26T20:21:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6672.342891 secs 2024-04-26T20:21:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:15 smithi189 ceph-mon[32756]: pgmap v4527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6672.342891 secs 2024-04-26T20:21:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:15 smithi156 ceph-mon[32679]: pgmap v4527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6672.342891 secs 2024-04-26T20:21:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:15 smithi092 ceph-mon[29156]: pgmap v4527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:17 smithi189 ceph-mon[32756]: pgmap v4528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:17 smithi156 ceph-mon[32679]: pgmap v4528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:17 smithi092 ceph-mon[29156]: pgmap v4528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7374.363866 secs 2024-04-26T20:21:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7374.363866 secs 2024-04-26T20:21:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7374.363866 secs 2024-04-26T20:21:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:19 smithi189 ceph-mon[32756]: pgmap v4529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:19 smithi156 ceph-mon[32679]: pgmap v4529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:19 smithi092 ceph-mon[29156]: pgmap v4529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6677.342963 secs 2024-04-26T20:21:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6677.342963 secs 2024-04-26T20:21:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6677.342963 secs 2024-04-26T20:21:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:21 smithi189 ceph-mon[32756]: pgmap v4530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:21 smithi156 ceph-mon[32679]: pgmap v4530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:21 smithi092 ceph-mon[29156]: pgmap v4530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:23 smithi189 ceph-mon[32756]: pgmap v4531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7379.363989 secs 2024-04-26T20:21:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:23 smithi156 ceph-mon[32679]: pgmap v4531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7379.363989 secs 2024-04-26T20:21:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:23 smithi092 ceph-mon[29156]: pgmap v4531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7379.363989 secs 2024-04-26T20:21:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6682.343028 secs 2024-04-26T20:21:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:25 smithi189 ceph-mon[32756]: pgmap v4532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6682.343028 secs 2024-04-26T20:21:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:25 smithi156 ceph-mon[32679]: pgmap v4532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6682.343028 secs 2024-04-26T20:21:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:25 smithi092 ceph-mon[29156]: pgmap v4532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:27 smithi156 ceph-mon[32679]: pgmap v4533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:27 smithi092 ceph-mon[29156]: pgmap v4533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:27 smithi189 ceph-mon[32756]: pgmap v4533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7384.364106 secs 2024-04-26T20:21:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7384.364106 secs 2024-04-26T20:21:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7384.364106 secs 2024-04-26T20:21:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:29 smithi156 ceph-mon[32679]: pgmap v4534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:29 smithi092 ceph-mon[29156]: pgmap v4534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:29 smithi189 ceph-mon[32756]: pgmap v4534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6687.343112 secs 2024-04-26T20:21:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6687.343112 secs 2024-04-26T20:21:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6687.343112 secs 2024-04-26T20:21:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:31 smithi156 ceph-mon[32679]: pgmap v4535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:31 smithi092 ceph-mon[29156]: pgmap v4535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:31 smithi189 ceph-mon[32756]: pgmap v4535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:33.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:21:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:21:32.873+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:21:33.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:21:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:21:32.873+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:21:33.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:21:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:21:32.873+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:21:33.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:21:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:21:32.873+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:21:33.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:21:32 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:21:32.873+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:21:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:33 smithi156 ceph-mon[32679]: pgmap v4536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7389.364232 secs 2024-04-26T20:21:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:33 smithi092 ceph-mon[29156]: pgmap v4536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7389.364232 secs 2024-04-26T20:21:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:33 smithi189 ceph-mon[32756]: pgmap v4536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7389.364232 secs 2024-04-26T20:21:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6692.343226 secs 2024-04-26T20:21:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:35 smithi156 ceph-mon[32679]: pgmap v4537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6692.343226 secs 2024-04-26T20:21:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:35 smithi092 ceph-mon[29156]: pgmap v4537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6692.343226 secs 2024-04-26T20:21:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:35 smithi189 ceph-mon[32756]: pgmap v4537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:21:36.988+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:21:36.988 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:21:36.988+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:21:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:21:36.988+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:21:36.989 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:21:36.988+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 60 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:21:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:37 smithi156 ceph-mon[32679]: pgmap v4538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:37 smithi092 ceph-mon[29156]: pgmap v4538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:37 smithi189 ceph-mon[32756]: pgmap v4538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7394.364347 secs 2024-04-26T20:21:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7394.364347 secs 2024-04-26T20:21:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7394.364347 secs 2024-04-26T20:21:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:39 smithi156 ceph-mon[32679]: pgmap v4539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6697.343360 secs 2024-04-26T20:21:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:39 smithi092 ceph-mon[29156]: pgmap v4539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6697.343360 secs 2024-04-26T20:21:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:39 smithi189 ceph-mon[32756]: pgmap v4539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6697.343360 secs 2024-04-26T20:21:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:41 smithi156 ceph-mon[32679]: pgmap v4540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:41 smithi092 ceph-mon[29156]: pgmap v4540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:41 smithi189 ceph-mon[32756]: pgmap v4540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:43 smithi156 ceph-mon[32679]: pgmap v4541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7399.364459 secs 2024-04-26T20:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:43 smithi092 ceph-mon[29156]: pgmap v4541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7399.364459 secs 2024-04-26T20:21:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:43 smithi189 ceph-mon[32756]: pgmap v4541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:21:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:21:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:21:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:21:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7399.364459 secs 2024-04-26T20:21:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:44 smithi092 ceph-mon[29156]: pgmap v4542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:44 smithi092 ceph-mon[29156]: pgmap v4543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:21:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6702.343438 secs 2024-04-26T20:21:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:44 smithi189 ceph-mon[32756]: pgmap v4542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:44 smithi189 ceph-mon[32756]: pgmap v4543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:21:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6702.343438 secs 2024-04-26T20:21:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:44 smithi156 ceph-mon[32679]: pgmap v4542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:21:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:44 smithi156 ceph-mon[32679]: pgmap v4543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:21:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6702.343438 secs 2024-04-26T20:21:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:46 smithi092 ceph-mon[29156]: pgmap v4544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:46 smithi189 ceph-mon[32756]: pgmap v4544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:46 smithi156 ceph-mon[32679]: pgmap v4544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:48.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:48 smithi156 ceph-mon[32679]: pgmap v4545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:48.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7404.364555 secs 2024-04-26T20:21:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:48 smithi092 ceph-mon[29156]: pgmap v4545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7404.364555 secs 2024-04-26T20:21:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:48 smithi189 ceph-mon[32756]: pgmap v4545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7404.364555 secs 2024-04-26T20:21:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6707.343505 secs 2024-04-26T20:21:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6707.343505 secs 2024-04-26T20:21:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6707.343505 secs 2024-04-26T20:21:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:50 smithi092 ceph-mon[29156]: pgmap v4546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:50 smithi189 ceph-mon[32756]: pgmap v4546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:50 smithi156 ceph-mon[32679]: pgmap v4546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:52 smithi092 ceph-mon[29156]: pgmap v4547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:52 smithi189 ceph-mon[32756]: pgmap v4547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:52 smithi156 ceph-mon[32679]: pgmap v4547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:21:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7409.364685 secs 2024-04-26T20:21:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7409.364685 secs 2024-04-26T20:21:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7409.364685 secs 2024-04-26T20:21:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:54 smithi092 ceph-mon[29156]: pgmap v4548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:21:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6712.343643 secs 2024-04-26T20:21:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:54 smithi189 ceph-mon[32756]: pgmap v4548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:21:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6712.343643 secs 2024-04-26T20:21:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:54 smithi156 ceph-mon[32679]: pgmap v4548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:21:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6712.343643 secs 2024-04-26T20:21:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:56 smithi092 ceph-mon[29156]: pgmap v4549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:56 smithi189 ceph-mon[32756]: pgmap v4549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:56 smithi156 ceph-mon[32679]: pgmap v4549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:21:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:58 smithi092 ceph-mon[29156]: pgmap v4550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7414.364783 secs 2024-04-26T20:21:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:58 smithi189 ceph-mon[32756]: pgmap v4550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7414.364783 secs 2024-04-26T20:21:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:58 smithi156 ceph-mon[32679]: pgmap v4550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:21:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7414.364783 secs 2024-04-26T20:21:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:21:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6717.343725 secs 2024-04-26T20:21:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:21:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6717.343725 secs 2024-04-26T20:21:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:21:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6717.343725 secs 2024-04-26T20:22:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:00 smithi092 ceph-mon[29156]: pgmap v4551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:00 smithi189 ceph-mon[32756]: pgmap v4551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:00 smithi156 ceph-mon[32679]: pgmap v4551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:02 smithi092 ceph-mon[29156]: pgmap v4552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:02 smithi189 ceph-mon[32756]: pgmap v4552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:02 smithi156 ceph-mon[32679]: pgmap v4552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7419.364905 secs 2024-04-26T20:22:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7419.364905 secs 2024-04-26T20:22:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7419.364905 secs 2024-04-26T20:22:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:04 smithi092 ceph-mon[29156]: pgmap v4553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 6722.343793 secs 2024-04-26T20:22:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:04 smithi092 ceph-mon[29156]: slow request 5762.049160 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:22:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:04 smithi189 ceph-mon[32756]: pgmap v4553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 6722.343793 secs 2024-04-26T20:22:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:04 smithi189 ceph-mon[32756]: slow request 5762.049160 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:22:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:04 smithi156 ceph-mon[32679]: pgmap v4553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 6722.343793 secs 2024-04-26T20:22:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:04 smithi156 ceph-mon[32679]: slow request 5762.049160 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:22:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:06 smithi092 ceph-mon[29156]: pgmap v4554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:06 smithi189 ceph-mon[32756]: pgmap v4554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:06 smithi156 ceph-mon[32679]: pgmap v4554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:08 smithi092 ceph-mon[29156]: pgmap v4555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7424.364981 secs 2024-04-26T20:22:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:08 smithi189 ceph-mon[32756]: pgmap v4555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7424.364981 secs 2024-04-26T20:22:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:08 smithi156 ceph-mon[32679]: pgmap v4555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7424.364981 secs 2024-04-26T20:22:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6727.343902 secs 2024-04-26T20:22:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6727.343902 secs 2024-04-26T20:22:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6727.343902 secs 2024-04-26T20:22:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:10 smithi189 ceph-mon[32756]: pgmap v4556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:10 smithi156 ceph-mon[32679]: pgmap v4556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:10 smithi092 ceph-mon[29156]: pgmap v4556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:12 smithi189 ceph-mon[32756]: pgmap v4557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:12 smithi156 ceph-mon[32679]: pgmap v4557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:12 smithi092 ceph-mon[29156]: pgmap v4557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7429.365060 secs 2024-04-26T20:22:13.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7429.365060 secs 2024-04-26T20:22:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7429.365060 secs 2024-04-26T20:22:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:14 smithi189 ceph-mon[32756]: pgmap v4558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6732.344045 secs 2024-04-26T20:22:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:14 smithi156 ceph-mon[32679]: pgmap v4558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6732.344045 secs 2024-04-26T20:22:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:14 smithi092 ceph-mon[29156]: pgmap v4558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:22:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6732.344045 secs 2024-04-26T20:22:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:16 smithi189 ceph-mon[32756]: pgmap v4559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:16 smithi156 ceph-mon[32679]: pgmap v4559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:16 smithi092 ceph-mon[29156]: pgmap v4559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:22:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:18 smithi189 ceph-mon[32756]: pgmap v4560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7434.365138 secs 2024-04-26T20:22:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:18 smithi156 ceph-mon[32679]: pgmap v4560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7434.365138 secs 2024-04-26T20:22:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:18 smithi092 ceph-mon[29156]: pgmap v4560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7434.365138 secs 2024-04-26T20:22:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6737.344154 secs 2024-04-26T20:22:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6737.344154 secs 2024-04-26T20:22:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6737.344154 secs 2024-04-26T20:22:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:20 smithi189 ceph-mon[32756]: pgmap v4561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:20 smithi156 ceph-mon[32679]: pgmap v4561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:20 smithi092 ceph-mon[29156]: pgmap v4561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:22:21.993+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:22:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:22:21.993+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:22:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:22:21.993+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:22:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:22:21.993+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 61 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:22:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:22 smithi189 ceph-mon[32756]: pgmap v4562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:22 smithi156 ceph-mon[32679]: pgmap v4562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:22 smithi092 ceph-mon[29156]: pgmap v4562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7439.365257 secs 2024-04-26T20:22:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7439.365257 secs 2024-04-26T20:22:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7439.365257 secs 2024-04-26T20:22:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:24 smithi189 ceph-mon[32756]: pgmap v4563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6742.344236 secs 2024-04-26T20:22:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:24 smithi156 ceph-mon[32679]: pgmap v4563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6742.344236 secs 2024-04-26T20:22:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:24 smithi092 ceph-mon[29156]: pgmap v4563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6742.344236 secs 2024-04-26T20:22:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:26 smithi189 ceph-mon[32756]: pgmap v4564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:26 smithi156 ceph-mon[32679]: pgmap v4564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:26 smithi092 ceph-mon[29156]: pgmap v4564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:28 smithi189 ceph-mon[32756]: pgmap v4565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7444.365366 secs 2024-04-26T20:22:28.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:28 smithi092 ceph-mon[29156]: pgmap v4565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:28.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7444.365366 secs 2024-04-26T20:22:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:28 smithi156 ceph-mon[32679]: pgmap v4565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7444.365366 secs 2024-04-26T20:22:29.826 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6747.344311 secs 2024-04-26T20:22:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6747.344311 secs 2024-04-26T20:22:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6747.344311 secs 2024-04-26T20:22:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:30 smithi189 ceph-mon[32756]: pgmap v4566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:30 smithi156 ceph-mon[32679]: pgmap v4566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:30 smithi092 ceph-mon[29156]: pgmap v4566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:32 smithi189 ceph-mon[32756]: pgmap v4567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:32 smithi156 ceph-mon[32679]: pgmap v4567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:32 smithi092 ceph-mon[29156]: pgmap v4567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7449.365490 secs 2024-04-26T20:22:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7449.365490 secs 2024-04-26T20:22:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7449.365490 secs 2024-04-26T20:22:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:34 smithi189 ceph-mon[32756]: pgmap v4568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6752.344421 secs 2024-04-26T20:22:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:34 smithi156 ceph-mon[32679]: pgmap v4568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6752.344421 secs 2024-04-26T20:22:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:34 smithi092 ceph-mon[29156]: pgmap v4568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6752.344421 secs 2024-04-26T20:22:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:36 smithi189 ceph-mon[32756]: pgmap v4569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:36 smithi156 ceph-mon[32679]: pgmap v4569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:36 smithi092 ceph-mon[29156]: pgmap v4569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:38 smithi189 ceph-mon[32756]: pgmap v4570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7454.365604 secs 2024-04-26T20:22:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:38 smithi156 ceph-mon[32679]: pgmap v4570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7454.365604 secs 2024-04-26T20:22:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:38 smithi092 ceph-mon[29156]: pgmap v4570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7454.365604 secs 2024-04-26T20:22:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6757.344529 secs 2024-04-26T20:22:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6757.344529 secs 2024-04-26T20:22:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6757.344529 secs 2024-04-26T20:22:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:40 smithi189 ceph-mon[32756]: pgmap v4571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:40 smithi156 ceph-mon[32679]: pgmap v4571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:40 smithi092 ceph-mon[29156]: pgmap v4571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:42 smithi189 ceph-mon[32756]: pgmap v4572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:42 smithi156 ceph-mon[32679]: pgmap v4572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:42 smithi092 ceph-mon[29156]: pgmap v4572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7459.365698 secs 2024-04-26T20:22:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7459.365698 secs 2024-04-26T20:22:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:22:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7459.365698 secs 2024-04-26T20:22:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: pgmap v4573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6762.344593 secs 2024-04-26T20:22:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: pgmap v4573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6762.344593 secs 2024-04-26T20:22:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: pgmap v4573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6762.344593 secs 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: pgmap v4574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: pgmap v4574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: pgmap v4574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:22:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:22:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: pgmap v4575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:47 smithi092 ceph-mon[29156]: pgmap v4576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:48.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: pgmap v4575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:48.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:47 smithi156 ceph-mon[32679]: pgmap v4576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:22:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:22:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:22:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:22:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:22:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: pgmap v4575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:22:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:47 smithi189 ceph-mon[32756]: pgmap v4576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7464.365817 secs 2024-04-26T20:22:49.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7464.365817 secs 2024-04-26T20:22:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7464.365817 secs 2024-04-26T20:22:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6767.344680 secs 2024-04-26T20:22:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:49 smithi092 ceph-mon[29156]: pgmap v4577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:50.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6767.344680 secs 2024-04-26T20:22:50.061 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:49 smithi189 ceph-mon[32756]: pgmap v4577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6767.344680 secs 2024-04-26T20:22:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:49 smithi156 ceph-mon[32679]: pgmap v4577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:50 smithi092 ceph-mon[29156]: pgmap v4578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:50 smithi189 ceph-mon[32756]: pgmap v4578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:50 smithi156 ceph-mon[32679]: pgmap v4578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:53 smithi156 ceph-mon[32679]: pgmap v4579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7469.365898 secs 2024-04-26T20:22:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:53 smithi092 ceph-mon[29156]: pgmap v4579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7469.365898 secs 2024-04-26T20:22:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:53 smithi189 ceph-mon[32756]: pgmap v4579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7469.365898 secs 2024-04-26T20:22:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6772.344776 secs 2024-04-26T20:22:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6772.344776 secs 2024-04-26T20:22:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6772.344776 secs 2024-04-26T20:22:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:55 smithi156 ceph-mon[32679]: pgmap v4580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:55 smithi092 ceph-mon[29156]: pgmap v4580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:55 smithi189 ceph-mon[32756]: pgmap v4580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:22:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:57 smithi156 ceph-mon[32679]: pgmap v4581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:22:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:57 smithi092 ceph-mon[29156]: pgmap v4581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:22:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:57 smithi189 ceph-mon[32756]: pgmap v4581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:22:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7474.366010 secs 2024-04-26T20:22:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7474.366010 secs 2024-04-26T20:22:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7474.366010 secs 2024-04-26T20:22:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6777.344867 secs 2024-04-26T20:22:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:22:59 smithi156 ceph-mon[32679]: pgmap v4582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:22:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6777.344867 secs 2024-04-26T20:22:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:22:59 smithi092 ceph-mon[29156]: pgmap v4582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6777.344867 secs 2024-04-26T20:23:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:22:59 smithi189 ceph-mon[32756]: pgmap v4582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:01 smithi092 ceph-mon[29156]: pgmap v4583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:01 smithi189 ceph-mon[32756]: pgmap v4583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:01 smithi156 ceph-mon[32679]: pgmap v4583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:03 smithi092 ceph-mon[29156]: pgmap v4584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7479.366132 secs 2024-04-26T20:23:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:03 smithi189 ceph-mon[32756]: pgmap v4584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7479.366132 secs 2024-04-26T20:23:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:03 smithi156 ceph-mon[32679]: pgmap v4584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7479.366132 secs 2024-04-26T20:23:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6782.344945 secs 2024-04-26T20:23:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6782.344945 secs 2024-04-26T20:23:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6782.344945 secs 2024-04-26T20:23:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:05 smithi092 ceph-mon[29156]: pgmap v4585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:05 smithi189 ceph-mon[32756]: pgmap v4585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:05 smithi156 ceph-mon[32679]: pgmap v4585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:07 smithi092 ceph-mon[29156]: pgmap v4586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:07 smithi189 ceph-mon[32756]: pgmap v4586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:07 smithi156 ceph-mon[32679]: pgmap v4586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7484.366251 secs 2024-04-26T20:23:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7484.366251 secs 2024-04-26T20:23:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7484.366251 secs 2024-04-26T20:23:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6787.345053 secs 2024-04-26T20:23:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:09 smithi092 ceph-mon[29156]: pgmap v4587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6787.345053 secs 2024-04-26T20:23:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:09 smithi189 ceph-mon[32756]: pgmap v4587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6787.345053 secs 2024-04-26T20:23:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:09 smithi156 ceph-mon[32679]: pgmap v4587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:10 smithi092 ceph-mon[29156]: pgmap v4588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:10 smithi189 ceph-mon[32756]: pgmap v4588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:10 smithi156 ceph-mon[32679]: pgmap v4588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:13 smithi156 ceph-mon[32679]: pgmap v4589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7489.366328 secs 2024-04-26T20:23:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:13 smithi092 ceph-mon[29156]: pgmap v4589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7489.366328 secs 2024-04-26T20:23:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:13 smithi189 ceph-mon[32756]: pgmap v4589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7489.366328 secs 2024-04-26T20:23:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6792.345139 secs 2024-04-26T20:23:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6792.345139 secs 2024-04-26T20:23:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6792.345139 secs 2024-04-26T20:23:15.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:15 smithi092 ceph-mon[29156]: pgmap v4590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:15 smithi156 ceph-mon[32679]: pgmap v4590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:15 smithi189 ceph-mon[32756]: pgmap v4590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:17 smithi156 ceph-mon[32679]: pgmap v4591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:17 smithi092 ceph-mon[29156]: pgmap v4591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:17 smithi189 ceph-mon[32756]: pgmap v4591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7494.366451 secs 2024-04-26T20:23:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7494.366451 secs 2024-04-26T20:23:19.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7494.366451 secs 2024-04-26T20:23:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6797.345259 secs 2024-04-26T20:23:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:19 smithi092 ceph-mon[29156]: pgmap v4592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6797.345259 secs 2024-04-26T20:23:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:19 smithi189 ceph-mon[32756]: pgmap v4592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6797.345259 secs 2024-04-26T20:23:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:19 smithi156 ceph-mon[32679]: pgmap v4592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:21 smithi092 ceph-mon[29156]: pgmap v4593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:21 smithi189 ceph-mon[32756]: pgmap v4593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:21 smithi156 ceph-mon[32679]: pgmap v4593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:23 smithi092 ceph-mon[29156]: pgmap v4594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7499.366569 secs 2024-04-26T20:23:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:23 smithi189 ceph-mon[32756]: pgmap v4594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7499.366569 secs 2024-04-26T20:23:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:23 smithi156 ceph-mon[32679]: pgmap v4594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7499.366569 secs 2024-04-26T20:23:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6802.345373 secs 2024-04-26T20:23:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6802.345373 secs 2024-04-26T20:23:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6802.345373 secs 2024-04-26T20:23:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:25 smithi092 ceph-mon[29156]: pgmap v4595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:25 smithi189 ceph-mon[32756]: pgmap v4595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:25 smithi156 ceph-mon[32679]: pgmap v4595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:27 smithi092 ceph-mon[29156]: pgmap v4596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:27 smithi189 ceph-mon[32756]: pgmap v4596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:27 smithi156 ceph-mon[32679]: pgmap v4596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7504.366715 secs 2024-04-26T20:23:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7504.366715 secs 2024-04-26T20:23:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7504.366715 secs 2024-04-26T20:23:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6807.345489 secs 2024-04-26T20:23:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:29 smithi092 ceph-mon[29156]: pgmap v4597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6807.345489 secs 2024-04-26T20:23:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:29 smithi189 ceph-mon[32756]: pgmap v4597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6807.345489 secs 2024-04-26T20:23:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:29 smithi156 ceph-mon[32679]: pgmap v4597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:30 smithi092 ceph-mon[29156]: pgmap v4598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:30 smithi189 ceph-mon[32756]: pgmap v4598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:30 smithi156 ceph-mon[32679]: pgmap v4598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:33 smithi156 ceph-mon[32679]: pgmap v4599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7509.366808 secs 2024-04-26T20:23:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:33 smithi092 ceph-mon[29156]: pgmap v4599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7509.366808 secs 2024-04-26T20:23:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:33 smithi189 ceph-mon[32756]: pgmap v4599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7509.366808 secs 2024-04-26T20:23:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6812.345548 secs 2024-04-26T20:23:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6812.345548 secs 2024-04-26T20:23:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6812.345548 secs 2024-04-26T20:23:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:35 smithi156 ceph-mon[32679]: pgmap v4600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:35 smithi092 ceph-mon[29156]: pgmap v4600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:35 smithi189 ceph-mon[32756]: pgmap v4600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:37 smithi156 ceph-mon[32679]: pgmap v4601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:37 smithi092 ceph-mon[29156]: pgmap v4601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:37 smithi189 ceph-mon[32756]: pgmap v4601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7514.366927 secs 2024-04-26T20:23:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7514.366927 secs 2024-04-26T20:23:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7514.366927 secs 2024-04-26T20:23:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6817.345639 secs 2024-04-26T20:23:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:39 smithi092 ceph-mon[29156]: pgmap v4602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6817.345639 secs 2024-04-26T20:23:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:39 smithi189 ceph-mon[32756]: pgmap v4602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6817.345639 secs 2024-04-26T20:23:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:39 smithi156 ceph-mon[32679]: pgmap v4602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:41 smithi092 ceph-mon[29156]: pgmap v4603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:41 smithi189 ceph-mon[32756]: pgmap v4603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:41 smithi156 ceph-mon[32679]: pgmap v4603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:43 smithi092 ceph-mon[29156]: pgmap v4604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7519.367055 secs 2024-04-26T20:23:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:43 smithi189 ceph-mon[32756]: pgmap v4604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7519.367055 secs 2024-04-26T20:23:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:43 smithi156 ceph-mon[32679]: pgmap v4604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7519.367055 secs 2024-04-26T20:23:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6822.345744 secs 2024-04-26T20:23:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6822.345744 secs 2024-04-26T20:23:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6822.345744 secs 2024-04-26T20:23:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:45 smithi092 ceph-mon[29156]: pgmap v4605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:45 smithi189 ceph-mon[32756]: pgmap v4605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:45 smithi156 ceph-mon[32679]: pgmap v4605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:47 smithi092 ceph-mon[29156]: pgmap v4606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:47 smithi189 ceph-mon[32756]: pgmap v4606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:47 smithi156 ceph-mon[32679]: pgmap v4606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:23:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:48 smithi092 ceph-mon[29156]: pgmap v4607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:23:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:48 smithi092 ceph-mon[29156]: pgmap v4608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7524.367166 secs 2024-04-26T20:23:49.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:48 smithi189 ceph-mon[32756]: pgmap v4607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:23:49.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:48 smithi189 ceph-mon[32756]: pgmap v4608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:49.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7524.367166 secs 2024-04-26T20:23:49.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:48 smithi156 ceph-mon[32679]: pgmap v4607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:23:49.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:48 smithi156 ceph-mon[32679]: pgmap v4608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:49.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7524.367166 secs 2024-04-26T20:23:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6827.345902 secs 2024-04-26T20:23:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:49 smithi092 ceph-mon[29156]: pgmap v4609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6827.345902 secs 2024-04-26T20:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:49 smithi189 ceph-mon[32756]: pgmap v4609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6827.345902 secs 2024-04-26T20:23:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:49 smithi156 ceph-mon[32679]: pgmap v4609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:52 smithi092 ceph-mon[29156]: pgmap v4610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:52 smithi189 ceph-mon[32756]: pgmap v4610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:52 smithi156 ceph-mon[32679]: pgmap v4610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7529.367282 secs 2024-04-26T20:23:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7529.367282 secs 2024-04-26T20:23:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7529.367282 secs 2024-04-26T20:23:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:54 smithi092 ceph-mon[29156]: pgmap v4611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6832.346053 secs 2024-04-26T20:23:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:54 smithi189 ceph-mon[32756]: pgmap v4611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6832.346053 secs 2024-04-26T20:23:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:54 smithi156 ceph-mon[32679]: pgmap v4611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:23:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6832.346053 secs 2024-04-26T20:23:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:56 smithi092 ceph-mon[29156]: pgmap v4612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:56 smithi189 ceph-mon[32756]: pgmap v4612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:56 smithi156 ceph-mon[32679]: pgmap v4612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:23:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:58 smithi092 ceph-mon[29156]: pgmap v4613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:23:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7534.367374 secs 2024-04-26T20:23:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:58 smithi189 ceph-mon[32756]: pgmap v4613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:23:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7534.367374 secs 2024-04-26T20:23:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:58 smithi156 ceph-mon[32679]: pgmap v4613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:23:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7534.367374 secs 2024-04-26T20:23:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:23:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6837.346129 secs 2024-04-26T20:23:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:23:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6837.346129 secs 2024-04-26T20:23:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:23:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6837.346129 secs 2024-04-26T20:24:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:00 smithi189 ceph-mon[32756]: pgmap v4614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:00 smithi156 ceph-mon[32679]: pgmap v4614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:00 smithi092 ceph-mon[29156]: pgmap v4614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:02 smithi189 ceph-mon[32756]: pgmap v4615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:02 smithi156 ceph-mon[32679]: pgmap v4615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:02 smithi092 ceph-mon[29156]: pgmap v4615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7539.367498 secs 2024-04-26T20:24:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7539.367498 secs 2024-04-26T20:24:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7539.367498 secs 2024-04-26T20:24:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:04 smithi189 ceph-mon[32756]: pgmap v4616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6842.346246 secs 2024-04-26T20:24:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:04 smithi156 ceph-mon[32679]: pgmap v4616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6842.346246 secs 2024-04-26T20:24:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:04 smithi092 ceph-mon[29156]: pgmap v4616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6842.346246 secs 2024-04-26T20:24:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:06 smithi189 ceph-mon[32756]: pgmap v4617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:06 smithi156 ceph-mon[32679]: pgmap v4617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:06 smithi092 ceph-mon[29156]: pgmap v4617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:08 smithi189 ceph-mon[32756]: pgmap v4618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7544.367622 secs 2024-04-26T20:24:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:08 smithi156 ceph-mon[32679]: pgmap v4618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7544.367622 secs 2024-04-26T20:24:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:08 smithi092 ceph-mon[29156]: pgmap v4618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7544.367622 secs 2024-04-26T20:24:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6847.346320 secs 2024-04-26T20:24:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6847.346320 secs 2024-04-26T20:24:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6847.346320 secs 2024-04-26T20:24:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:10 smithi189 ceph-mon[32756]: pgmap v4619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:10 smithi156 ceph-mon[32679]: pgmap v4619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:10 smithi092 ceph-mon[29156]: pgmap v4619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:12 smithi189 ceph-mon[32756]: pgmap v4620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:12 smithi156 ceph-mon[32679]: pgmap v4620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:12 smithi092 ceph-mon[29156]: pgmap v4620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7549.367751 secs 2024-04-26T20:24:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7549.367751 secs 2024-04-26T20:24:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7549.367751 secs 2024-04-26T20:24:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:14 smithi189 ceph-mon[32756]: pgmap v4621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6852.346423 secs 2024-04-26T20:24:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:14 smithi156 ceph-mon[32679]: pgmap v4621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6852.346423 secs 2024-04-26T20:24:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:14 smithi092 ceph-mon[29156]: pgmap v4621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6852.346423 secs 2024-04-26T20:24:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:16 smithi189 ceph-mon[32756]: pgmap v4622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:16 smithi156 ceph-mon[32679]: pgmap v4622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:17.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:16 smithi092 ceph-mon[29156]: pgmap v4622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:18 smithi189 ceph-mon[32756]: pgmap v4623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7554.367892 secs 2024-04-26T20:24:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:18 smithi156 ceph-mon[32679]: pgmap v4623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7554.367892 secs 2024-04-26T20:24:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:18 smithi092 ceph-mon[29156]: pgmap v4623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7554.367892 secs 2024-04-26T20:24:19.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6857.346467 secs 2024-04-26T20:24:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6857.346467 secs 2024-04-26T20:24:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6857.346467 secs 2024-04-26T20:24:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:20 smithi189 ceph-mon[32756]: pgmap v4624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:20 smithi156 ceph-mon[32679]: pgmap v4624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:20 smithi092 ceph-mon[29156]: pgmap v4624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:22 smithi189 ceph-mon[32756]: pgmap v4625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:22 smithi156 ceph-mon[32679]: pgmap v4625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:22 smithi092 ceph-mon[29156]: pgmap v4625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7559.367993 secs 2024-04-26T20:24:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7559.367993 secs 2024-04-26T20:24:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7559.367993 secs 2024-04-26T20:24:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:24 smithi189 ceph-mon[32756]: pgmap v4626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6862.346529 secs 2024-04-26T20:24:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:24 smithi156 ceph-mon[32679]: pgmap v4626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6862.346529 secs 2024-04-26T20:24:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:24 smithi092 ceph-mon[29156]: pgmap v4626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6862.346529 secs 2024-04-26T20:24:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:26 smithi189 ceph-mon[32756]: pgmap v4627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:26 smithi156 ceph-mon[32679]: pgmap v4627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:26 smithi092 ceph-mon[29156]: pgmap v4627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:28 smithi189 ceph-mon[32756]: pgmap v4628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7564.368139 secs 2024-04-26T20:24:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:28 smithi156 ceph-mon[32679]: pgmap v4628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7564.368139 secs 2024-04-26T20:24:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:28 smithi092 ceph-mon[29156]: pgmap v4628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7564.368139 secs 2024-04-26T20:24:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6867.346653 secs 2024-04-26T20:24:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6867.346653 secs 2024-04-26T20:24:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6867.346653 secs 2024-04-26T20:24:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:30 smithi189 ceph-mon[32756]: pgmap v4629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:30 smithi156 ceph-mon[32679]: pgmap v4629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:30 smithi092 ceph-mon[29156]: pgmap v4629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:32 smithi189 ceph-mon[32756]: pgmap v4630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:32 smithi156 ceph-mon[32679]: pgmap v4630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:32 smithi092 ceph-mon[29156]: pgmap v4630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:33.853 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7569.368276 secs 2024-04-26T20:24:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7569.368276 secs 2024-04-26T20:24:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7569.368276 secs 2024-04-26T20:24:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:34 smithi189 ceph-mon[32756]: pgmap v4631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6872.346778 secs 2024-04-26T20:24:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:34 smithi156 ceph-mon[32679]: pgmap v4631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6872.346778 secs 2024-04-26T20:24:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:34 smithi092 ceph-mon[29156]: pgmap v4631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:24:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6872.346778 secs 2024-04-26T20:24:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:36 smithi189 ceph-mon[32756]: pgmap v4632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:36 smithi156 ceph-mon[32679]: pgmap v4632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:36 smithi092 ceph-mon[29156]: pgmap v4632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:24:37.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:24:37.011+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:24:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:24:37.011+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:24:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:24:37.011+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:24:37.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:24:37.011+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 62 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:24:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:38 smithi189 ceph-mon[32756]: pgmap v4633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7574.368417 secs 2024-04-26T20:24:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:38 smithi156 ceph-mon[32679]: pgmap v4633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7574.368417 secs 2024-04-26T20:24:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:38 smithi092 ceph-mon[29156]: pgmap v4633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7574.368417 secs 2024-04-26T20:24:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6877.346855 secs 2024-04-26T20:24:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6877.346855 secs 2024-04-26T20:24:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6877.346855 secs 2024-04-26T20:24:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:40 smithi189 ceph-mon[32756]: pgmap v4634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:40 smithi156 ceph-mon[32679]: pgmap v4634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:40 smithi092 ceph-mon[29156]: pgmap v4634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:42 smithi189 ceph-mon[32756]: pgmap v4635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:42 smithi156 ceph-mon[32679]: pgmap v4635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:42 smithi092 ceph-mon[29156]: pgmap v4635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7579.368568 secs 2024-04-26T20:24:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7579.368568 secs 2024-04-26T20:24:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7579.368568 secs 2024-04-26T20:24:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:44 smithi189 ceph-mon[32756]: pgmap v4636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6882.346926 secs 2024-04-26T20:24:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:44 smithi156 ceph-mon[32679]: pgmap v4636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6882.346926 secs 2024-04-26T20:24:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:44 smithi092 ceph-mon[29156]: pgmap v4636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6882.346926 secs 2024-04-26T20:24:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:46 smithi189 ceph-mon[32756]: pgmap v4637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:46 smithi156 ceph-mon[32679]: pgmap v4637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:46 smithi092 ceph-mon[29156]: pgmap v4637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:24:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:24:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:48 smithi189 ceph-mon[32756]: pgmap v4638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:24:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7584.368700 secs 2024-04-26T20:24:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:48 smithi156 ceph-mon[32679]: pgmap v4638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:24:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7584.368700 secs 2024-04-26T20:24:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:48 smithi092 ceph-mon[29156]: pgmap v4638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:24:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:24:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:24:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:24:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7584.368700 secs 2024-04-26T20:24:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:49 smithi189 ceph-mon[32756]: pgmap v4639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:24:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:49 smithi189 ceph-mon[32756]: pgmap v4640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:24:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6887.347027 secs 2024-04-26T20:24:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:49 smithi092 ceph-mon[29156]: pgmap v4639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:24:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:49 smithi092 ceph-mon[29156]: pgmap v4640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:24:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6887.347027 secs 2024-04-26T20:24:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:49 smithi156 ceph-mon[32679]: pgmap v4639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:24:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:49 smithi156 ceph-mon[32679]: pgmap v4640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:24:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6887.347027 secs 2024-04-26T20:24:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:51 smithi189 ceph-mon[32756]: pgmap v4641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:51 smithi156 ceph-mon[32679]: pgmap v4641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:51 smithi092 ceph-mon[29156]: pgmap v4641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:53 smithi189 ceph-mon[32756]: pgmap v4642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7589.368817 secs 2024-04-26T20:24:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:53 smithi156 ceph-mon[32679]: pgmap v4642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7589.368817 secs 2024-04-26T20:24:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:53 smithi092 ceph-mon[29156]: pgmap v4642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7589.368817 secs 2024-04-26T20:24:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6892.347115 secs 2024-04-26T20:24:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6892.347115 secs 2024-04-26T20:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6892.347115 secs 2024-04-26T20:24:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:55 smithi156 ceph-mon[32679]: pgmap v4643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:55 smithi092 ceph-mon[29156]: pgmap v4643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:55 smithi189 ceph-mon[32756]: pgmap v4643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:57 smithi156 ceph-mon[32679]: pgmap v4644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:57 smithi092 ceph-mon[29156]: pgmap v4644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:57 smithi189 ceph-mon[32756]: pgmap v4644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:24:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7594.368931 secs 2024-04-26T20:24:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7594.368931 secs 2024-04-26T20:24:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7594.368931 secs 2024-04-26T20:24:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:59 smithi156 ceph-mon[32679]: pgmap v4645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:24:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:24:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6897.347221 secs 2024-04-26T20:24:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:59 smithi092 ceph-mon[29156]: pgmap v4645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:24:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:24:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6897.347221 secs 2024-04-26T20:25:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:59 smithi189 ceph-mon[32756]: pgmap v4645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:25:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:24:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6897.347221 secs 2024-04-26T20:25:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:01 smithi156 ceph-mon[32679]: pgmap v4646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:01 smithi092 ceph-mon[29156]: pgmap v4646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:01 smithi189 ceph-mon[32756]: pgmap v4646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:03 smithi156 ceph-mon[32679]: pgmap v4647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7599.369049 secs 2024-04-26T20:25:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:03 smithi092 ceph-mon[29156]: pgmap v4647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7599.369049 secs 2024-04-26T20:25:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:03 smithi189 ceph-mon[32756]: pgmap v4647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7599.369049 secs 2024-04-26T20:25:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6902.347339 secs 2024-04-26T20:25:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6902.347339 secs 2024-04-26T20:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6902.347339 secs 2024-04-26T20:25:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:05 smithi156 ceph-mon[32679]: pgmap v4648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:05 smithi092 ceph-mon[29156]: pgmap v4648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:05 smithi189 ceph-mon[32756]: pgmap v4648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:07 smithi156 ceph-mon[32679]: pgmap v4649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:07 smithi092 ceph-mon[29156]: pgmap v4649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:07 smithi189 ceph-mon[32756]: pgmap v4649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7604.369163 secs 2024-04-26T20:25:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7604.369163 secs 2024-04-26T20:25:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7604.369163 secs 2024-04-26T20:25:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:09 smithi156 ceph-mon[32679]: pgmap v4650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6907.347426 secs 2024-04-26T20:25:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:09 smithi092 ceph-mon[29156]: pgmap v4650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6907.347426 secs 2024-04-26T20:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:09 smithi189 ceph-mon[32756]: pgmap v4650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6907.347426 secs 2024-04-26T20:25:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:11 smithi156 ceph-mon[32679]: pgmap v4651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:11 smithi092 ceph-mon[29156]: pgmap v4651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:11 smithi189 ceph-mon[32756]: pgmap v4651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:13 smithi092 ceph-mon[29156]: pgmap v4652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7609.369247 secs 2024-04-26T20:25:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:13 smithi189 ceph-mon[32756]: pgmap v4652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7609.369247 secs 2024-04-26T20:25:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:13 smithi156 ceph-mon[32679]: pgmap v4652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7609.369247 secs 2024-04-26T20:25:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6912.347546 secs 2024-04-26T20:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6912.347546 secs 2024-04-26T20:25:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6912.347546 secs 2024-04-26T20:25:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:15 smithi092 ceph-mon[29156]: pgmap v4653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:15 smithi189 ceph-mon[32756]: pgmap v4653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:15 smithi156 ceph-mon[32679]: pgmap v4653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:17 smithi092 ceph-mon[29156]: pgmap v4654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:17 smithi189 ceph-mon[32756]: pgmap v4654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:17 smithi156 ceph-mon[32679]: pgmap v4654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7614.369341 secs 2024-04-26T20:25:19.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7614.369341 secs 2024-04-26T20:25:19.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7614.369341 secs 2024-04-26T20:25:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:19 smithi092 ceph-mon[29156]: pgmap v4655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6917.347673 secs 2024-04-26T20:25:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:19 smithi189 ceph-mon[32756]: pgmap v4655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6917.347673 secs 2024-04-26T20:25:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:19 smithi156 ceph-mon[32679]: pgmap v4655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6917.347673 secs 2024-04-26T20:25:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:21 smithi092 ceph-mon[29156]: pgmap v4656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:21 smithi189 ceph-mon[32756]: pgmap v4656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:21 smithi156 ceph-mon[32679]: pgmap v4656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:23 smithi092 ceph-mon[29156]: pgmap v4657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7619.369477 secs 2024-04-26T20:25:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:23 smithi189 ceph-mon[32756]: pgmap v4657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7619.369477 secs 2024-04-26T20:25:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:23 smithi156 ceph-mon[32679]: pgmap v4657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7619.369477 secs 2024-04-26T20:25:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6922.347770 secs 2024-04-26T20:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6922.347770 secs 2024-04-26T20:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6922.347770 secs 2024-04-26T20:25:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:25 smithi092 ceph-mon[29156]: pgmap v4658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:25 smithi189 ceph-mon[32756]: pgmap v4658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:25 smithi156 ceph-mon[32679]: pgmap v4658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:27 smithi092 ceph-mon[29156]: pgmap v4659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:27 smithi189 ceph-mon[32756]: pgmap v4659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:27 smithi156 ceph-mon[32679]: pgmap v4659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:28 smithi092 ceph-mon[29156]: pgmap v4660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7624.369618 secs 2024-04-26T20:25:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:28 smithi189 ceph-mon[32756]: pgmap v4660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7624.369618 secs 2024-04-26T20:25:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:28 smithi156 ceph-mon[32679]: pgmap v4660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7624.369618 secs 2024-04-26T20:25:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6927.347895 secs 2024-04-26T20:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6927.347895 secs 2024-04-26T20:25:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6927.347895 secs 2024-04-26T20:25:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:30 smithi092 ceph-mon[29156]: pgmap v4661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:30 smithi189 ceph-mon[32756]: pgmap v4661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:30 smithi156 ceph-mon[32679]: pgmap v4661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:33 smithi189 ceph-mon[32756]: pgmap v4662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:33 smithi156 ceph-mon[32679]: pgmap v4662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:33 smithi092 ceph-mon[29156]: pgmap v4662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7629.369759 secs 2024-04-26T20:25:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7629.369759 secs 2024-04-26T20:25:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7629.369759 secs 2024-04-26T20:25:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6932.348012 secs 2024-04-26T20:25:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:35 smithi189 ceph-mon[32756]: pgmap v4663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6932.348012 secs 2024-04-26T20:25:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:35 smithi156 ceph-mon[32679]: pgmap v4663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6932.348012 secs 2024-04-26T20:25:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:35 smithi092 ceph-mon[29156]: pgmap v4663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:37 smithi189 ceph-mon[32756]: pgmap v4664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:37 smithi156 ceph-mon[32679]: pgmap v4664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:37 smithi092 ceph-mon[29156]: pgmap v4664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:39 smithi189 ceph-mon[32756]: pgmap v4665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7634.369828 secs 2024-04-26T20:25:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:39 smithi156 ceph-mon[32679]: pgmap v4665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7634.369828 secs 2024-04-26T20:25:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:39 smithi092 ceph-mon[29156]: pgmap v4665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7634.369828 secs 2024-04-26T20:25:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6937.348147 secs 2024-04-26T20:25:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6937.348147 secs 2024-04-26T20:25:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6937.348147 secs 2024-04-26T20:25:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:41 smithi189 ceph-mon[32756]: pgmap v4666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:41 smithi156 ceph-mon[32679]: pgmap v4666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:41 smithi092 ceph-mon[29156]: pgmap v4666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:43 smithi189 ceph-mon[32756]: pgmap v4667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:43 smithi156 ceph-mon[32679]: pgmap v4667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:43 smithi092 ceph-mon[29156]: pgmap v4667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7639.369848 secs 2024-04-26T20:25:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7639.369848 secs 2024-04-26T20:25:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7639.369848 secs 2024-04-26T20:25:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6942.348267 secs 2024-04-26T20:25:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:45 smithi189 ceph-mon[32756]: pgmap v4668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6942.348267 secs 2024-04-26T20:25:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:45 smithi156 ceph-mon[32679]: pgmap v4668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6942.348267 secs 2024-04-26T20:25:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:45 smithi092 ceph-mon[29156]: pgmap v4668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:25:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:47 smithi189 ceph-mon[32756]: pgmap v4669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:47 smithi156 ceph-mon[32679]: pgmap v4669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:47 smithi092 ceph-mon[29156]: pgmap v4669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: pgmap v4670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7644.369963 secs 2024-04-26T20:25:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: pgmap v4670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7644.369963 secs 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: pgmap v4670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7644.369963 secs 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:25:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6947.348348 secs 2024-04-26T20:25:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:50 smithi189 ceph-mon[32756]: pgmap v4671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:25:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:50 smithi189 ceph-mon[32756]: pgmap v4672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6947.348348 secs 2024-04-26T20:25:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:50 smithi156 ceph-mon[32679]: pgmap v4671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:25:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:50 smithi156 ceph-mon[32679]: pgmap v4672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6947.348348 secs 2024-04-26T20:25:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:50 smithi092 ceph-mon[29156]: pgmap v4671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:25:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:50 smithi092 ceph-mon[29156]: pgmap v4672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:52 smithi189 ceph-mon[32756]: pgmap v4673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:52 smithi156 ceph-mon[32679]: pgmap v4673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:52 smithi092 ceph-mon[29156]: pgmap v4673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:54 smithi189 ceph-mon[32756]: pgmap v4674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7649.370070 secs 2024-04-26T20:25:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:54 smithi156 ceph-mon[32679]: pgmap v4674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7649.370070 secs 2024-04-26T20:25:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:54 smithi092 ceph-mon[29156]: pgmap v4674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:25:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7649.370070 secs 2024-04-26T20:25:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6952.348444 secs 2024-04-26T20:25:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6952.348444 secs 2024-04-26T20:25:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6952.348444 secs 2024-04-26T20:25:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:56 smithi189 ceph-mon[32756]: pgmap v4675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:56 smithi156 ceph-mon[32679]: pgmap v4675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:56 smithi092 ceph-mon[29156]: pgmap v4675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:58 smithi189 ceph-mon[32756]: pgmap v4676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:58 smithi156 ceph-mon[32679]: pgmap v4676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:58 smithi092 ceph-mon[29156]: pgmap v4676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:25:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:25:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7654.370151 secs 2024-04-26T20:25:59.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:25:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7654.370151 secs 2024-04-26T20:25:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:25:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7654.370151 secs 2024-04-26T20:26:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6957.348527 secs 2024-04-26T20:26:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:00 smithi189 ceph-mon[32756]: pgmap v4677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:26:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6957.348527 secs 2024-04-26T20:26:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:00 smithi156 ceph-mon[32679]: pgmap v4677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:26:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6957.348527 secs 2024-04-26T20:26:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:00 smithi092 ceph-mon[29156]: pgmap v4677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:26:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:02 smithi189 ceph-mon[32756]: pgmap v4678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:02 smithi156 ceph-mon[32679]: pgmap v4678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:02 smithi092 ceph-mon[29156]: pgmap v4678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:04 smithi189 ceph-mon[32756]: pgmap v4679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7659.370230 secs 2024-04-26T20:26:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:04 smithi156 ceph-mon[32679]: pgmap v4679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7659.370230 secs 2024-04-26T20:26:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:04 smithi092 ceph-mon[29156]: pgmap v4679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7659.370230 secs 2024-04-26T20:26:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6962.348590 secs 2024-04-26T20:26:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6962.348590 secs 2024-04-26T20:26:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6962.348590 secs 2024-04-26T20:26:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:06 smithi189 ceph-mon[32756]: pgmap v4680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:06 smithi156 ceph-mon[32679]: pgmap v4680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:06 smithi092 ceph-mon[29156]: pgmap v4680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:08 smithi189 ceph-mon[32756]: pgmap v4681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:08 smithi156 ceph-mon[32679]: pgmap v4681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:08 smithi092 ceph-mon[29156]: pgmap v4681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7664.370345 secs 2024-04-26T20:26:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7664.370345 secs 2024-04-26T20:26:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7664.370345 secs 2024-04-26T20:26:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6967.348713 secs 2024-04-26T20:26:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:10 smithi189 ceph-mon[32756]: pgmap v4682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6967.348713 secs 2024-04-26T20:26:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:10 smithi156 ceph-mon[32679]: pgmap v4682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6967.348713 secs 2024-04-26T20:26:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:10 smithi092 ceph-mon[29156]: pgmap v4682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:12 smithi189 ceph-mon[32756]: pgmap v4683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:12 smithi156 ceph-mon[32679]: pgmap v4683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:12 smithi092 ceph-mon[29156]: pgmap v4683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:14 smithi189 ceph-mon[32756]: pgmap v4684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7669.370480 secs 2024-04-26T20:26:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:14 smithi156 ceph-mon[32679]: pgmap v4684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7669.370480 secs 2024-04-26T20:26:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:14 smithi092 ceph-mon[29156]: pgmap v4684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7669.370480 secs 2024-04-26T20:26:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6972.348793 secs 2024-04-26T20:26:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6972.348793 secs 2024-04-26T20:26:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6972.348793 secs 2024-04-26T20:26:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:16 smithi189 ceph-mon[32756]: pgmap v4685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:16 smithi156 ceph-mon[32679]: pgmap v4685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:16 smithi092 ceph-mon[29156]: pgmap v4685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:18 smithi156 ceph-mon[32679]: pgmap v4686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:18 smithi092 ceph-mon[29156]: pgmap v4686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:18 smithi189 ceph-mon[32756]: pgmap v4686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7674.370596 secs 2024-04-26T20:26:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7674.370596 secs 2024-04-26T20:26:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7674.370596 secs 2024-04-26T20:26:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6977.348928 secs 2024-04-26T20:26:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:20 smithi156 ceph-mon[32679]: pgmap v4687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6977.348928 secs 2024-04-26T20:26:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:20 smithi092 ceph-mon[29156]: pgmap v4687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6977.348928 secs 2024-04-26T20:26:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:20 smithi189 ceph-mon[32756]: pgmap v4687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:22 smithi156 ceph-mon[32679]: pgmap v4688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:22 smithi092 ceph-mon[29156]: pgmap v4688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:22 smithi189 ceph-mon[32756]: pgmap v4688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7679.370713 secs 2024-04-26T20:26:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7679.370713 secs 2024-04-26T20:26:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7679.370713 secs 2024-04-26T20:26:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:24 smithi092 ceph-mon[29156]: pgmap v4689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:24 smithi189 ceph-mon[32756]: pgmap v4689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:24 smithi156 ceph-mon[32679]: pgmap v4689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6982.349000 secs 2024-04-26T20:26:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6982.349000 secs 2024-04-26T20:26:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6982.349000 secs 2024-04-26T20:26:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:26 smithi092 ceph-mon[29156]: pgmap v4690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:26 smithi189 ceph-mon[32756]: pgmap v4690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:26 smithi156 ceph-mon[32679]: pgmap v4690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:28 smithi092 ceph-mon[29156]: pgmap v4691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7684.370785 secs 2024-04-26T20:26:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:28 smithi189 ceph-mon[32756]: pgmap v4691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7684.370785 secs 2024-04-26T20:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:28 smithi156 ceph-mon[32679]: pgmap v4691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7684.370785 secs 2024-04-26T20:26:29.516 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6987.349063 secs 2024-04-26T20:26:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6987.349063 secs 2024-04-26T20:26:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6987.349063 secs 2024-04-26T20:26:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:30 smithi092 ceph-mon[29156]: pgmap v4692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:30 smithi189 ceph-mon[32756]: pgmap v4692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:30 smithi156 ceph-mon[32679]: pgmap v4692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:32 smithi189 ceph-mon[32756]: pgmap v4693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:32 smithi156 ceph-mon[32679]: pgmap v4693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:32 smithi092 ceph-mon[29156]: pgmap v4693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7689.370907 secs 2024-04-26T20:26:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7689.370907 secs 2024-04-26T20:26:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7689.370907 secs 2024-04-26T20:26:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:34 smithi189 ceph-mon[32756]: pgmap v4694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6992.349178 secs 2024-04-26T20:26:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:34 smithi156 ceph-mon[32679]: pgmap v4694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6992.349178 secs 2024-04-26T20:26:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:34 smithi092 ceph-mon[29156]: pgmap v4694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6992.349178 secs 2024-04-26T20:26:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:36 smithi189 ceph-mon[32756]: pgmap v4695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:36 smithi156 ceph-mon[32679]: pgmap v4695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:36 smithi092 ceph-mon[29156]: pgmap v4695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:38 smithi189 ceph-mon[32756]: pgmap v4696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7694.371033 secs 2024-04-26T20:26:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:38 smithi156 ceph-mon[32679]: pgmap v4696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7694.371033 secs 2024-04-26T20:26:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:38 smithi092 ceph-mon[29156]: pgmap v4696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7694.371033 secs 2024-04-26T20:26:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 6997.349271 secs 2024-04-26T20:26:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 6997.349271 secs 2024-04-26T20:26:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 6997.349271 secs 2024-04-26T20:26:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:40 smithi189 ceph-mon[32756]: pgmap v4697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:40 smithi156 ceph-mon[32679]: pgmap v4697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:40 smithi092 ceph-mon[29156]: pgmap v4697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:42 smithi189 ceph-mon[32756]: pgmap v4698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:42 smithi156 ceph-mon[32679]: pgmap v4698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:42 smithi092 ceph-mon[29156]: pgmap v4698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7699.371150 secs 2024-04-26T20:26:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7699.371150 secs 2024-04-26T20:26:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7699.371150 secs 2024-04-26T20:26:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:44 smithi189 ceph-mon[32756]: pgmap v4699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7002.349361 secs 2024-04-26T20:26:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:44 smithi156 ceph-mon[32679]: pgmap v4699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7002.349361 secs 2024-04-26T20:26:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:44 smithi092 ceph-mon[29156]: pgmap v4699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7002.349361 secs 2024-04-26T20:26:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:46 smithi189 ceph-mon[32756]: pgmap v4700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:46 smithi156 ceph-mon[32679]: pgmap v4700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:46 smithi092 ceph-mon[29156]: pgmap v4700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:48 smithi189 ceph-mon[32756]: pgmap v4701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7704.371270 secs 2024-04-26T20:26:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:48 smithi156 ceph-mon[32679]: pgmap v4701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7704.371270 secs 2024-04-26T20:26:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:48 smithi092 ceph-mon[29156]: pgmap v4701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:26:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7704.371270 secs 2024-04-26T20:26:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7007.349474 secs 2024-04-26T20:26:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:49.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7007.349474 secs 2024-04-26T20:26:49.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7007.349474 secs 2024-04-26T20:26:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:26:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:50 smithi189 ceph-mon[32756]: pgmap v4702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:26:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:50 smithi156 ceph-mon[32679]: pgmap v4702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:26:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:50 smithi092 ceph-mon[29156]: pgmap v4702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:26:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:26:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:26:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:26:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:51 smithi189 ceph-mon[32756]: pgmap v4703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:26:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:51 smithi189 ceph-mon[32756]: pgmap v4704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:51 smithi156 ceph-mon[32679]: pgmap v4703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:26:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:51 smithi156 ceph-mon[32679]: pgmap v4704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:51 smithi092 ceph-mon[29156]: pgmap v4703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:26:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:51 smithi092 ceph-mon[29156]: pgmap v4704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:53.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:53 smithi092 ceph-mon[29156]: pgmap v4705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:53.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7709.371419 secs 2024-04-26T20:26:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:53 smithi189 ceph-mon[32756]: pgmap v4705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7709.371419 secs 2024-04-26T20:26:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:53 smithi156 ceph-mon[32679]: pgmap v4705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7709.371419 secs 2024-04-26T20:26:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7012.349534 secs 2024-04-26T20:26:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7012.349534 secs 2024-04-26T20:26:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7012.349534 secs 2024-04-26T20:26:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:55 smithi189 ceph-mon[32756]: pgmap v4706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:55 smithi156 ceph-mon[32679]: pgmap v4706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:55 smithi092 ceph-mon[29156]: pgmap v4706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:57 smithi189 ceph-mon[32756]: pgmap v4707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:57 smithi156 ceph-mon[32679]: pgmap v4707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:57 smithi092 ceph-mon[29156]: pgmap v4707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:26:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7714.371531 secs 2024-04-26T20:26:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7714.371531 secs 2024-04-26T20:26:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7714.371531 secs 2024-04-26T20:26:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:59 smithi189 ceph-mon[32756]: pgmap v4708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:26:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:26:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7017.349605 secs 2024-04-26T20:26:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:59 smithi092 ceph-mon[29156]: pgmap v4708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:26:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:26:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7017.349605 secs 2024-04-26T20:26:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:59 smithi156 ceph-mon[32679]: pgmap v4708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:26:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:26:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7017.349605 secs 2024-04-26T20:27:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:01 smithi189 ceph-mon[32756]: pgmap v4709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:27:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:01 smithi156 ceph-mon[32679]: pgmap v4709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:27:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:01 smithi092 ceph-mon[29156]: pgmap v4709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:27:03.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:27:02.923+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:03.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:27:02.923+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:03.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:27:02.923+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:03.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:27:02.923+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:03.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:27:02 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:27:02.923+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:27:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:03 smithi189 ceph-mon[32756]: pgmap v4710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7719.371656 secs 2024-04-26T20:27:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:03 smithi156 ceph-mon[32679]: pgmap v4710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7719.371656 secs 2024-04-26T20:27:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:03 smithi092 ceph-mon[29156]: pgmap v4710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7719.371656 secs 2024-04-26T20:27:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 7022.349684 secs 2024-04-26T20:27:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:04 smithi189 ceph-mon[32756]: slow request 5762.003421 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:27:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 7022.349684 secs 2024-04-26T20:27:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:04 smithi156 ceph-mon[32679]: slow request 5762.003421 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:27:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 7022.349684 secs 2024-04-26T20:27:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:04 smithi092 ceph-mon[29156]: slow request 5762.003421 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:27:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:05 smithi189 ceph-mon[32756]: pgmap v4711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:05 smithi156 ceph-mon[32679]: pgmap v4711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:05 smithi092 ceph-mon[29156]: pgmap v4711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:07 smithi189 ceph-mon[32756]: pgmap v4712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:07 smithi156 ceph-mon[32679]: pgmap v4712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:07 smithi092 ceph-mon[29156]: pgmap v4712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7724.371777 secs 2024-04-26T20:27:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7724.371777 secs 2024-04-26T20:27:08.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7724.371777 secs 2024-04-26T20:27:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:09 smithi189 ceph-mon[32756]: pgmap v4713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7027.349793 secs 2024-04-26T20:27:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:09 smithi156 ceph-mon[32679]: pgmap v4713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7027.349793 secs 2024-04-26T20:27:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:09 smithi092 ceph-mon[29156]: pgmap v4713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7027.349793 secs 2024-04-26T20:27:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:11 smithi189 ceph-mon[32756]: pgmap v4714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:11 smithi156 ceph-mon[32679]: pgmap v4714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:11 smithi092 ceph-mon[29156]: pgmap v4714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:13 smithi189 ceph-mon[32756]: pgmap v4715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7729.371923 secs 2024-04-26T20:27:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:13 smithi156 ceph-mon[32679]: pgmap v4715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7729.371923 secs 2024-04-26T20:27:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:13 smithi092 ceph-mon[29156]: pgmap v4715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T20:27:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7729.371923 secs 2024-04-26T20:27:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7032.349929 secs 2024-04-26T20:27:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7032.349929 secs 2024-04-26T20:27:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7032.349929 secs 2024-04-26T20:27:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:15 smithi189 ceph-mon[32756]: pgmap v4716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:15 smithi156 ceph-mon[32679]: pgmap v4716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:15 smithi092 ceph-mon[29156]: pgmap v4716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T20:27:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:17 smithi189 ceph-mon[32756]: pgmap v4717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:17 smithi156 ceph-mon[32679]: pgmap v4717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:17 smithi092 ceph-mon[29156]: pgmap v4717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7734.372043 secs 2024-04-26T20:27:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7734.372043 secs 2024-04-26T20:27:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7734.372043 secs 2024-04-26T20:27:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:19 smithi189 ceph-mon[32756]: pgmap v4718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7037.350051 secs 2024-04-26T20:27:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:19 smithi156 ceph-mon[32679]: pgmap v4718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7037.350051 secs 2024-04-26T20:27:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:19 smithi092 ceph-mon[29156]: pgmap v4718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7037.350051 secs 2024-04-26T20:27:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:21 smithi189 ceph-mon[32756]: pgmap v4719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:27:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:21 smithi156 ceph-mon[32679]: pgmap v4719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:27:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:21 smithi092 ceph-mon[29156]: pgmap v4719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:27:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:23 smithi189 ceph-mon[32756]: pgmap v4720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7739.372138 secs 2024-04-26T20:27:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:23 smithi156 ceph-mon[32679]: pgmap v4720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7739.372138 secs 2024-04-26T20:27:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:23 smithi092 ceph-mon[29156]: pgmap v4720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7739.372138 secs 2024-04-26T20:27:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7042.350167 secs 2024-04-26T20:27:24.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7042.350167 secs 2024-04-26T20:27:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7042.350167 secs 2024-04-26T20:27:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:25 smithi189 ceph-mon[32756]: pgmap v4721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:25 smithi156 ceph-mon[32679]: pgmap v4721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:25 smithi092 ceph-mon[29156]: pgmap v4721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:27 smithi189 ceph-mon[32756]: pgmap v4722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:27 smithi156 ceph-mon[32679]: pgmap v4722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:27 smithi092 ceph-mon[29156]: pgmap v4722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7744.372261 secs 2024-04-26T20:27:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7744.372261 secs 2024-04-26T20:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7744.372261 secs 2024-04-26T20:27:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:29 smithi092 ceph-mon[29156]: pgmap v4723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7047.350279 secs 2024-04-26T20:27:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:29 smithi156 ceph-mon[32679]: pgmap v4723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7047.350279 secs 2024-04-26T20:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:29 smithi189 ceph-mon[32756]: pgmap v4723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7047.350279 secs 2024-04-26T20:27:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:31 smithi156 ceph-mon[32679]: pgmap v4724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:31 smithi092 ceph-mon[29156]: pgmap v4724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:31 smithi189 ceph-mon[32756]: pgmap v4724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:33 smithi156 ceph-mon[32679]: pgmap v4725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7749.372384 secs 2024-04-26T20:27:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:33 smithi092 ceph-mon[29156]: pgmap v4725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7749.372384 secs 2024-04-26T20:27:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:33 smithi189 ceph-mon[32756]: pgmap v4725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7749.372384 secs 2024-04-26T20:27:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7052.350337 secs 2024-04-26T20:27:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7052.350337 secs 2024-04-26T20:27:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7052.350337 secs 2024-04-26T20:27:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:35 smithi156 ceph-mon[32679]: pgmap v4726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:35 smithi092 ceph-mon[29156]: pgmap v4726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:35 smithi189 ceph-mon[32756]: pgmap v4726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:27:37.035+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:27:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:27:37.035+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:27:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:27:37.035+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:27:37.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:27:37.035+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 63 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:27:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:37 smithi156 ceph-mon[32679]: pgmap v4727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:37 smithi092 ceph-mon[29156]: pgmap v4727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:37 smithi189 ceph-mon[32756]: pgmap v4727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7754.372514 secs 2024-04-26T20:27:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7754.372514 secs 2024-04-26T20:27:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7754.372514 secs 2024-04-26T20:27:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:39 smithi156 ceph-mon[32679]: pgmap v4728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7057.350423 secs 2024-04-26T20:27:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:39 smithi092 ceph-mon[29156]: pgmap v4728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7057.350423 secs 2024-04-26T20:27:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:39 smithi189 ceph-mon[32756]: pgmap v4728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7057.350423 secs 2024-04-26T20:27:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:41 smithi156 ceph-mon[32679]: pgmap v4729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:41 smithi092 ceph-mon[29156]: pgmap v4729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:41 smithi189 ceph-mon[32756]: pgmap v4729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:43 smithi156 ceph-mon[32679]: pgmap v4730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7759.372642 secs 2024-04-26T20:27:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:43 smithi092 ceph-mon[29156]: pgmap v4730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7759.372642 secs 2024-04-26T20:27:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:43 smithi189 ceph-mon[32756]: pgmap v4730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7759.372642 secs 2024-04-26T20:27:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7062.350538 secs 2024-04-26T20:27:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7062.350538 secs 2024-04-26T20:27:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7062.350538 secs 2024-04-26T20:27:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:45 smithi156 ceph-mon[32679]: pgmap v4731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:45 smithi092 ceph-mon[29156]: pgmap v4731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:45 smithi189 ceph-mon[32756]: pgmap v4731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:47 smithi092 ceph-mon[29156]: pgmap v4732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:47 smithi189 ceph-mon[32756]: pgmap v4732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:47 smithi156 ceph-mon[32679]: pgmap v4732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7764.372756 secs 2024-04-26T20:27:49.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7764.372756 secs 2024-04-26T20:27:49.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7764.372756 secs 2024-04-26T20:27:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:49 smithi092 ceph-mon[29156]: pgmap v4733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7067.350617 secs 2024-04-26T20:27:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:49 smithi189 ceph-mon[32756]: pgmap v4733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7067.350617 secs 2024-04-26T20:27:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:49 smithi156 ceph-mon[32679]: pgmap v4733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7067.350617 secs 2024-04-26T20:27:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:27:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:51 smithi092 ceph-mon[29156]: pgmap v4734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:51 smithi189 ceph-mon[32756]: pgmap v4734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:51 smithi156 ceph-mon[32679]: pgmap v4734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:53.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:53 smithi092 ceph-mon[29156]: pgmap v4735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:53.946 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7769.372858 secs 2024-04-26T20:27:54.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:53 smithi156 ceph-mon[32679]: pgmap v4735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:54.124 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7769.372858 secs 2024-04-26T20:27:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:53 smithi189 ceph-mon[32756]: pgmap v4735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:27:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7769.372858 secs 2024-04-26T20:27:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7072.350680 secs 2024-04-26T20:27:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: pgmap v4736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: pgmap v4737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: pgmap v4738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7072.350680 secs 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: pgmap v4736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: pgmap v4737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:27:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: pgmap v4738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7072.350680 secs 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: pgmap v4736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:27:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:27:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: pgmap v4737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:27:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: pgmap v4738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:27:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:57 smithi156 ceph-mon[32679]: pgmap v4739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:57 smithi092 ceph-mon[29156]: pgmap v4739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:57 smithi189 ceph-mon[32756]: pgmap v4739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:27:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7774.372899 secs 2024-04-26T20:27:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7774.372899 secs 2024-04-26T20:27:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7774.372899 secs 2024-04-26T20:27:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:27:59 smithi156 ceph-mon[32679]: pgmap v4740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:27:59 smithi092 ceph-mon[29156]: pgmap v4740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:27:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:27:59 smithi189 ceph-mon[32756]: pgmap v4740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7077.350743 secs 2024-04-26T20:28:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7077.350743 secs 2024-04-26T20:28:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7077.350743 secs 2024-04-26T20:28:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:01 smithi156 ceph-mon[32679]: pgmap v4741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:28:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:01 smithi092 ceph-mon[29156]: pgmap v4741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:28:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:01 smithi189 ceph-mon[32756]: pgmap v4741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:28:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:03 smithi092 ceph-mon[29156]: pgmap v4742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7779.373041 secs 2024-04-26T20:28:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:03 smithi189 ceph-mon[32756]: pgmap v4742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7779.373041 secs 2024-04-26T20:28:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:03 smithi156 ceph-mon[32679]: pgmap v4742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:28:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7779.373041 secs 2024-04-26T20:28:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7082.350824 secs 2024-04-26T20:28:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:05 smithi092 ceph-mon[29156]: pgmap v4743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7082.350824 secs 2024-04-26T20:28:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:05 smithi189 ceph-mon[32756]: pgmap v4743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:28:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7082.350824 secs 2024-04-26T20:28:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:05 smithi156 ceph-mon[32679]: pgmap v4743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:28:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:07 smithi092 ceph-mon[29156]: pgmap v4744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:07 smithi189 ceph-mon[32756]: pgmap v4744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:07 smithi156 ceph-mon[32679]: pgmap v4744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7784.373177 secs 2024-04-26T20:28:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7784.373177 secs 2024-04-26T20:28:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7784.373177 secs 2024-04-26T20:28:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:09 smithi092 ceph-mon[29156]: pgmap v4745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:09 smithi189 ceph-mon[32756]: pgmap v4745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:09 smithi156 ceph-mon[32679]: pgmap v4745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7087.350971 secs 2024-04-26T20:28:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7087.350971 secs 2024-04-26T20:28:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7087.350971 secs 2024-04-26T20:28:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:11 smithi092 ceph-mon[29156]: pgmap v4746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:11 smithi189 ceph-mon[32756]: pgmap v4746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:11 smithi156 ceph-mon[32679]: pgmap v4746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:13 smithi189 ceph-mon[32756]: pgmap v4747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7789.373251 secs 2024-04-26T20:28:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:13 smithi156 ceph-mon[32679]: pgmap v4747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7789.373251 secs 2024-04-26T20:28:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:13 smithi092 ceph-mon[29156]: pgmap v4747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7789.373251 secs 2024-04-26T20:28:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7092.351043 secs 2024-04-26T20:28:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7092.351043 secs 2024-04-26T20:28:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7092.351043 secs 2024-04-26T20:28:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:15 smithi189 ceph-mon[32756]: pgmap v4748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:15 smithi156 ceph-mon[32679]: pgmap v4748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:15 smithi092 ceph-mon[29156]: pgmap v4748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:17 smithi189 ceph-mon[32756]: pgmap v4749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:17 smithi156 ceph-mon[32679]: pgmap v4749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:17 smithi092 ceph-mon[29156]: pgmap v4749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7794.373342 secs 2024-04-26T20:28:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7794.373342 secs 2024-04-26T20:28:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7794.373342 secs 2024-04-26T20:28:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:19 smithi189 ceph-mon[32756]: pgmap v4750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:19.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7097.351180 secs 2024-04-26T20:28:19.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:19 smithi156 ceph-mon[32679]: pgmap v4750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:19.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7097.351180 secs 2024-04-26T20:28:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:19 smithi092 ceph-mon[29156]: pgmap v4750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7097.351180 secs 2024-04-26T20:28:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:21 smithi189 ceph-mon[32756]: pgmap v4751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:21 smithi156 ceph-mon[32679]: pgmap v4751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:21 smithi092 ceph-mon[29156]: pgmap v4751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:23 smithi189 ceph-mon[32756]: pgmap v4752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7799.373472 secs 2024-04-26T20:28:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:23 smithi156 ceph-mon[32679]: pgmap v4752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7799.373472 secs 2024-04-26T20:28:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:23 smithi092 ceph-mon[29156]: pgmap v4752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7799.373472 secs 2024-04-26T20:28:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7102.351332 secs 2024-04-26T20:28:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7102.351332 secs 2024-04-26T20:28:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7102.351332 secs 2024-04-26T20:28:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:25 smithi189 ceph-mon[32756]: pgmap v4753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:25 smithi156 ceph-mon[32679]: pgmap v4753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:25 smithi092 ceph-mon[29156]: pgmap v4753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:27.837 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:27 smithi092 ceph-mon[29156]: pgmap v4754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:27 smithi189 ceph-mon[32756]: pgmap v4754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:27 smithi156 ceph-mon[32679]: pgmap v4754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7804.373572 secs 2024-04-26T20:28:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7804.373572 secs 2024-04-26T20:28:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7804.373572 secs 2024-04-26T20:28:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:29 smithi189 ceph-mon[32756]: pgmap v4755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7107.351453 secs 2024-04-26T20:28:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:29 smithi092 ceph-mon[29156]: pgmap v4755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7107.351453 secs 2024-04-26T20:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:29 smithi156 ceph-mon[32679]: pgmap v4755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7107.351453 secs 2024-04-26T20:28:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:31 smithi189 ceph-mon[32756]: pgmap v4756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:31 smithi156 ceph-mon[32679]: pgmap v4756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:31 smithi092 ceph-mon[29156]: pgmap v4756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:33 smithi189 ceph-mon[32756]: pgmap v4757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7809.373696 secs 2024-04-26T20:28:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:33 smithi156 ceph-mon[32679]: pgmap v4757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7809.373696 secs 2024-04-26T20:28:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:33 smithi092 ceph-mon[29156]: pgmap v4757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7809.373696 secs 2024-04-26T20:28:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7112.351562 secs 2024-04-26T20:28:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7112.351562 secs 2024-04-26T20:28:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7112.351562 secs 2024-04-26T20:28:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:35 smithi189 ceph-mon[32756]: pgmap v4758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:35 smithi156 ceph-mon[32679]: pgmap v4758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:35 smithi092 ceph-mon[29156]: pgmap v4758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:37 smithi189 ceph-mon[32756]: pgmap v4759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:37 smithi156 ceph-mon[32679]: pgmap v4759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:37 smithi092 ceph-mon[29156]: pgmap v4759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7814.373811 secs 2024-04-26T20:28:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7814.373811 secs 2024-04-26T20:28:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7814.373811 secs 2024-04-26T20:28:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:39 smithi189 ceph-mon[32756]: pgmap v4760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7117.351651 secs 2024-04-26T20:28:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:39 smithi156 ceph-mon[32679]: pgmap v4760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7117.351651 secs 2024-04-26T20:28:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:39 smithi092 ceph-mon[29156]: pgmap v4760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:28:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7117.351651 secs 2024-04-26T20:28:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:41 smithi189 ceph-mon[32756]: pgmap v4761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:41 smithi156 ceph-mon[32679]: pgmap v4761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:41 smithi092 ceph-mon[29156]: pgmap v4761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:43 smithi189 ceph-mon[32756]: pgmap v4762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7819.373939 secs 2024-04-26T20:28:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:43 smithi156 ceph-mon[32679]: pgmap v4762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7819.373939 secs 2024-04-26T20:28:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:43 smithi092 ceph-mon[29156]: pgmap v4762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7819.373939 secs 2024-04-26T20:28:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7122.351803 secs 2024-04-26T20:28:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7122.351803 secs 2024-04-26T20:28:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7122.351803 secs 2024-04-26T20:28:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:45 smithi189 ceph-mon[32756]: pgmap v4763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:45 smithi156 ceph-mon[32679]: pgmap v4763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:45 smithi092 ceph-mon[29156]: pgmap v4763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:47 smithi189 ceph-mon[32756]: pgmap v4764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:47 smithi156 ceph-mon[32679]: pgmap v4764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:47 smithi092 ceph-mon[29156]: pgmap v4764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7824.374055 secs 2024-04-26T20:28:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7824.374055 secs 2024-04-26T20:28:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7824.374055 secs 2024-04-26T20:28:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:49 smithi189 ceph-mon[32756]: pgmap v4765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7127.351891 secs 2024-04-26T20:28:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:49 smithi156 ceph-mon[32679]: pgmap v4765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7127.351891 secs 2024-04-26T20:28:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:49 smithi092 ceph-mon[29156]: pgmap v4765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7127.351891 secs 2024-04-26T20:28:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:51 smithi189 ceph-mon[32756]: pgmap v4766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:51 smithi156 ceph-mon[32679]: pgmap v4766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:51 smithi092 ceph-mon[29156]: pgmap v4766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:53 smithi189 ceph-mon[32756]: pgmap v4767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7829.374178 secs 2024-04-26T20:28:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:53 smithi156 ceph-mon[32679]: pgmap v4767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7829.374178 secs 2024-04-26T20:28:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:53 smithi092 ceph-mon[29156]: pgmap v4767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7829.374178 secs 2024-04-26T20:28:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7132.352042 secs 2024-04-26T20:28:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7132.352042 secs 2024-04-26T20:28:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7132.352042 secs 2024-04-26T20:28:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:28:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:55 smithi189 ceph-mon[32756]: pgmap v4768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:55 smithi156 ceph-mon[32679]: pgmap v4768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:55 smithi092 ceph-mon[29156]: pgmap v4768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:28:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:57 smithi189 ceph-mon[32756]: pgmap v4769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:57 smithi156 ceph-mon[32679]: pgmap v4769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:57 smithi092 ceph-mon[29156]: pgmap v4769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7834.374289 secs 2024-04-26T20:28:58.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7834.374289 secs 2024-04-26T20:28:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7834.374289 secs 2024-04-26T20:28:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: pgmap v4770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7137.352168 secs 2024-04-26T20:28:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: pgmap v4771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:28:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: pgmap v4772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:28:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: pgmap v4770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7137.352168 secs 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: pgmap v4771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:28:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: pgmap v4772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:28:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: pgmap v4770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7137.352168 secs 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: pgmap v4771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: pgmap v4772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:28:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:28:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:29:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:01 smithi092 ceph-mon[29156]: pgmap v4773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:01 smithi189 ceph-mon[32756]: pgmap v4773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:01 smithi156 ceph-mon[32679]: pgmap v4773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:03 smithi092 ceph-mon[29156]: pgmap v4774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7839.374352 secs 2024-04-26T20:29:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:03 smithi189 ceph-mon[32756]: pgmap v4774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7839.374352 secs 2024-04-26T20:29:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:03 smithi156 ceph-mon[32679]: pgmap v4774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:29:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7839.374352 secs 2024-04-26T20:29:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7142.352291 secs 2024-04-26T20:29:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7142.352291 secs 2024-04-26T20:29:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7142.352291 secs 2024-04-26T20:29:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:05 smithi092 ceph-mon[29156]: pgmap v4775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:05 smithi189 ceph-mon[32756]: pgmap v4775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:05 smithi156 ceph-mon[32679]: pgmap v4775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:07 smithi092 ceph-mon[29156]: pgmap v4776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:07 smithi189 ceph-mon[32756]: pgmap v4776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:07 smithi156 ceph-mon[32679]: pgmap v4776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:29:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7844.374414 secs 2024-04-26T20:29:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7844.374414 secs 2024-04-26T20:29:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7844.374414 secs 2024-04-26T20:29:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7147.352394 secs 2024-04-26T20:29:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:09 smithi092 ceph-mon[29156]: pgmap v4777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:29:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7147.352394 secs 2024-04-26T20:29:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:09 smithi189 ceph-mon[32756]: pgmap v4777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:29:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7147.352394 secs 2024-04-26T20:29:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:09 smithi156 ceph-mon[32679]: pgmap v4777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:29:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:11 smithi092 ceph-mon[29156]: pgmap v4778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:11 smithi189 ceph-mon[32756]: pgmap v4778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:11 smithi156 ceph-mon[32679]: pgmap v4778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:13 smithi092 ceph-mon[29156]: pgmap v4779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7849.374476 secs 2024-04-26T20:29:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:13 smithi189 ceph-mon[32756]: pgmap v4779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7849.374476 secs 2024-04-26T20:29:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:13 smithi156 ceph-mon[32679]: pgmap v4779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7849.374476 secs 2024-04-26T20:29:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7152.352471 secs 2024-04-26T20:29:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7152.352471 secs 2024-04-26T20:29:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7152.352471 secs 2024-04-26T20:29:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:15 smithi092 ceph-mon[29156]: pgmap v4780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:15 smithi189 ceph-mon[32756]: pgmap v4780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:15 smithi156 ceph-mon[32679]: pgmap v4780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:17 smithi092 ceph-mon[29156]: pgmap v4781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:17 smithi189 ceph-mon[32756]: pgmap v4781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:17 smithi156 ceph-mon[32679]: pgmap v4781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7854.374596 secs 2024-04-26T20:29:19.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7854.374596 secs 2024-04-26T20:29:19.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7854.374596 secs 2024-04-26T20:29:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7157.352573 secs 2024-04-26T20:29:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:19 smithi189 ceph-mon[32756]: pgmap v4782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7157.352573 secs 2024-04-26T20:29:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:19 smithi156 ceph-mon[32679]: pgmap v4782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7157.352573 secs 2024-04-26T20:29:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:19 smithi092 ceph-mon[29156]: pgmap v4782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:21 smithi189 ceph-mon[32756]: pgmap v4783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:21 smithi156 ceph-mon[32679]: pgmap v4783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:21 smithi092 ceph-mon[29156]: pgmap v4783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:23 smithi189 ceph-mon[32756]: pgmap v4784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7859.374699 secs 2024-04-26T20:29:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:23 smithi156 ceph-mon[32679]: pgmap v4784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7859.374699 secs 2024-04-26T20:29:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:23 smithi092 ceph-mon[29156]: pgmap v4784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7859.374699 secs 2024-04-26T20:29:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7162.352659 secs 2024-04-26T20:29:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7162.352659 secs 2024-04-26T20:29:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7162.352659 secs 2024-04-26T20:29:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:25 smithi189 ceph-mon[32756]: pgmap v4785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:25 smithi156 ceph-mon[32679]: pgmap v4785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:25 smithi092 ceph-mon[29156]: pgmap v4785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:27 smithi189 ceph-mon[32756]: pgmap v4786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:27 smithi156 ceph-mon[32679]: pgmap v4786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:27 smithi092 ceph-mon[29156]: pgmap v4786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7864.374815 secs 2024-04-26T20:29:29.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7864.374815 secs 2024-04-26T20:29:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7864.374815 secs 2024-04-26T20:29:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7167.352744 secs 2024-04-26T20:29:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:29 smithi189 ceph-mon[32756]: pgmap v4787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7167.352744 secs 2024-04-26T20:29:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:29 smithi156 ceph-mon[32679]: pgmap v4787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7167.352744 secs 2024-04-26T20:29:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:29 smithi092 ceph-mon[29156]: pgmap v4787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:30 smithi189 ceph-mon[32756]: pgmap v4788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:30 smithi156 ceph-mon[32679]: pgmap v4788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:30 smithi092 ceph-mon[29156]: pgmap v4788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:33 smithi092 ceph-mon[29156]: pgmap v4789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7869.374930 secs 2024-04-26T20:29:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:33 smithi189 ceph-mon[32756]: pgmap v4789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7869.374930 secs 2024-04-26T20:29:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:33 smithi156 ceph-mon[32679]: pgmap v4789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7869.374930 secs 2024-04-26T20:29:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7172.352829 secs 2024-04-26T20:29:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7172.352829 secs 2024-04-26T20:29:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7172.352829 secs 2024-04-26T20:29:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:35 smithi092 ceph-mon[29156]: pgmap v4790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:35 smithi189 ceph-mon[32756]: pgmap v4790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:35 smithi156 ceph-mon[32679]: pgmap v4790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:37 smithi092 ceph-mon[29156]: pgmap v4791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:37 smithi189 ceph-mon[32756]: pgmap v4791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:37 smithi156 ceph-mon[32679]: pgmap v4791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7874.375004 secs 2024-04-26T20:29:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7874.375004 secs 2024-04-26T20:29:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7874.375004 secs 2024-04-26T20:29:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7177.352953 secs 2024-04-26T20:29:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:39 smithi092 ceph-mon[29156]: pgmap v4792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7177.352953 secs 2024-04-26T20:29:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:39 smithi189 ceph-mon[32756]: pgmap v4792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7177.352953 secs 2024-04-26T20:29:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:39 smithi156 ceph-mon[32679]: pgmap v4792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:41 smithi092 ceph-mon[29156]: pgmap v4793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:41 smithi189 ceph-mon[32756]: pgmap v4793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:41 smithi156 ceph-mon[32679]: pgmap v4793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:43 smithi092 ceph-mon[29156]: pgmap v4794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7879.375126 secs 2024-04-26T20:29:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:43 smithi189 ceph-mon[32756]: pgmap v4794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7879.375126 secs 2024-04-26T20:29:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:43 smithi156 ceph-mon[32679]: pgmap v4794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7879.375126 secs 2024-04-26T20:29:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7182.353091 secs 2024-04-26T20:29:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7182.353091 secs 2024-04-26T20:29:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7182.353091 secs 2024-04-26T20:29:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:45 smithi092 ceph-mon[29156]: pgmap v4795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:45 smithi189 ceph-mon[32756]: pgmap v4795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:45 smithi156 ceph-mon[32679]: pgmap v4795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:47 smithi092 ceph-mon[29156]: pgmap v4796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:47 smithi189 ceph-mon[32756]: pgmap v4796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:47 smithi156 ceph-mon[32679]: pgmap v4796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:49.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7884.375229 secs 2024-04-26T20:29:49.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7884.375229 secs 2024-04-26T20:29:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7884.375229 secs 2024-04-26T20:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7187.353215 secs 2024-04-26T20:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:49 smithi189 ceph-mon[32756]: pgmap v4797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7187.353215 secs 2024-04-26T20:29:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:49 smithi156 ceph-mon[32679]: pgmap v4797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7187.353215 secs 2024-04-26T20:29:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:49 smithi092 ceph-mon[29156]: pgmap v4797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:51 smithi189 ceph-mon[32756]: pgmap v4798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:51 smithi156 ceph-mon[32679]: pgmap v4798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:51 smithi092 ceph-mon[29156]: pgmap v4798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:53 smithi189 ceph-mon[32756]: pgmap v4799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7889.375320 secs 2024-04-26T20:29:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:53 smithi156 ceph-mon[32679]: pgmap v4799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7889.375320 secs 2024-04-26T20:29:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:53 smithi092 ceph-mon[29156]: pgmap v4799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7889.375320 secs 2024-04-26T20:29:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7192.353336 secs 2024-04-26T20:29:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7192.353336 secs 2024-04-26T20:29:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7192.353336 secs 2024-04-26T20:29:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:55 smithi189 ceph-mon[32756]: pgmap v4800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:55 smithi156 ceph-mon[32679]: pgmap v4800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:55 smithi092 ceph-mon[29156]: pgmap v4800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:56 smithi189 ceph-mon[32756]: pgmap v4801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:56 smithi156 ceph-mon[32679]: pgmap v4801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:56 smithi092 ceph-mon[29156]: pgmap v4801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:29:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7894.375436 secs 2024-04-26T20:29:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7894.375436 secs 2024-04-26T20:29:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7894.375436 secs 2024-04-26T20:29:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:59 smithi092 ceph-mon[29156]: pgmap v4802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:29:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:59 smithi189 ceph-mon[32756]: pgmap v4802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:29:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:29:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:59 smithi156 ceph-mon[32679]: pgmap v4802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:29:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:29:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 7197.353463 secs 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: pgmap v4803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: pgmap v4804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:30:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:30:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 7197.353463 secs 2024-04-26T20:30:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: pgmap v4803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T20:30:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: pgmap v4804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:30:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 7197.353463 secs 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: pgmap v4803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: pgmap v4804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:30:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:30:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:02 smithi189 ceph-mon[32756]: pgmap v4805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:02 smithi156 ceph-mon[32679]: pgmap v4805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:02 smithi092 ceph-mon[29156]: pgmap v4805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7899.375552 secs 2024-04-26T20:30:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7899.375552 secs 2024-04-26T20:30:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7899.375552 secs 2024-04-26T20:30:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:04 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 7202.353603 secs 2024-04-26T20:30:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:04 smithi189 ceph-mon[32756]: slow request 180.566268 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:30:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:04 smithi189 ceph-mon[32756]: pgmap v4806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:04 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 7202.353603 secs 2024-04-26T20:30:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:04 smithi156 ceph-mon[32679]: slow request 180.566268 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:30:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:04 smithi156 ceph-mon[32679]: pgmap v4806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:04 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 7202.353603 secs 2024-04-26T20:30:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:04 smithi092 ceph-mon[29156]: slow request 180.566268 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T20:30:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:04 smithi092 ceph-mon[29156]: pgmap v4806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:06 smithi189 ceph-mon[32756]: pgmap v4807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:06 smithi156 ceph-mon[32679]: pgmap v4807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:06 smithi092 ceph-mon[29156]: pgmap v4807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:30:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:08 smithi189 ceph-mon[32756]: pgmap v4808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:08 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T20:30:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:08 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T20:30:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7904.375631 secs 2024-04-26T20:30:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:08 smithi156 ceph-mon[32679]: pgmap v4808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:08 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T20:30:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:08 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T20:30:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7904.375631 secs 2024-04-26T20:30:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:08 smithi092 ceph-mon[29156]: pgmap v4808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:30:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:08 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T20:30:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:08 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T20:30:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7904.375631 secs 2024-04-26T20:30:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7207.353737 secs 2024-04-26T20:30:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7207.353737 secs 2024-04-26T20:30:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7207.353737 secs 2024-04-26T20:30:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:10 smithi189 ceph-mon[32756]: pgmap v4809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:30:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:10 smithi156 ceph-mon[32679]: pgmap v4809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:30:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:10 smithi092 ceph-mon[29156]: pgmap v4809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:30:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:12 smithi189 ceph-mon[32756]: pgmap v4810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:12 smithi156 ceph-mon[32679]: pgmap v4810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:12 smithi092 ceph-mon[29156]: pgmap v4810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7909.375770 secs 2024-04-26T20:30:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7909.375770 secs 2024-04-26T20:30:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7909.375770 secs 2024-04-26T20:30:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7212.353865 secs 2024-04-26T20:30:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:14 smithi189 ceph-mon[32756]: pgmap v4811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7212.353865 secs 2024-04-26T20:30:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:14 smithi156 ceph-mon[32679]: pgmap v4811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7212.353865 secs 2024-04-26T20:30:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:14 smithi092 ceph-mon[29156]: pgmap v4811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:16 smithi189 ceph-mon[32756]: pgmap v4812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:16 smithi156 ceph-mon[32679]: pgmap v4812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:16 smithi092 ceph-mon[29156]: pgmap v4812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:18 smithi189 ceph-mon[32756]: pgmap v4813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7914.375878 secs 2024-04-26T20:30:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:18 smithi156 ceph-mon[32679]: pgmap v4813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7914.375878 secs 2024-04-26T20:30:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:18 smithi092 ceph-mon[29156]: pgmap v4813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7914.375878 secs 2024-04-26T20:30:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7217.353986 secs 2024-04-26T20:30:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7217.353986 secs 2024-04-26T20:30:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7217.353986 secs 2024-04-26T20:30:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:20 smithi156 ceph-mon[32679]: pgmap v4814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:20 smithi092 ceph-mon[29156]: pgmap v4814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:20 smithi189 ceph-mon[32756]: pgmap v4814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:22 smithi156 ceph-mon[32679]: pgmap v4815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:22 smithi092 ceph-mon[29156]: pgmap v4815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:22 smithi189 ceph-mon[32756]: pgmap v4815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7919.375994 secs 2024-04-26T20:30:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7919.375994 secs 2024-04-26T20:30:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7919.375994 secs 2024-04-26T20:30:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7222.354075 secs 2024-04-26T20:30:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:24 smithi156 ceph-mon[32679]: pgmap v4816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:24.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7222.354075 secs 2024-04-26T20:30:24.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:24 smithi189 ceph-mon[32756]: pgmap v4816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7222.354075 secs 2024-04-26T20:30:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:24 smithi092 ceph-mon[29156]: pgmap v4816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:26 smithi156 ceph-mon[32679]: pgmap v4817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:26 smithi092 ceph-mon[29156]: pgmap v4817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:26 smithi189 ceph-mon[32756]: pgmap v4817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:28 smithi156 ceph-mon[32679]: pgmap v4818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7924.376090 secs 2024-04-26T20:30:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:28 smithi092 ceph-mon[29156]: pgmap v4818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7924.376090 secs 2024-04-26T20:30:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:28 smithi189 ceph-mon[32756]: pgmap v4818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7924.376090 secs 2024-04-26T20:30:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7227.354193 secs 2024-04-26T20:30:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7227.354193 secs 2024-04-26T20:30:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7227.354193 secs 2024-04-26T20:30:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:30 smithi156 ceph-mon[32679]: pgmap v4819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:30 smithi092 ceph-mon[29156]: pgmap v4819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:30 smithi189 ceph-mon[32756]: pgmap v4819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:32 smithi156 ceph-mon[32679]: pgmap v4820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:32 smithi092 ceph-mon[29156]: pgmap v4820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:32 smithi189 ceph-mon[32756]: pgmap v4820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7929.376204 secs 2024-04-26T20:30:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7929.376204 secs 2024-04-26T20:30:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7929.376204 secs 2024-04-26T20:30:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7232.354326 secs 2024-04-26T20:30:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:34 smithi156 ceph-mon[32679]: pgmap v4821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7232.354326 secs 2024-04-26T20:30:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:34 smithi092 ceph-mon[29156]: pgmap v4821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7232.354326 secs 2024-04-26T20:30:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:34 smithi189 ceph-mon[32756]: pgmap v4821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:36 smithi156 ceph-mon[32679]: pgmap v4822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:36 smithi092 ceph-mon[29156]: pgmap v4822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 64 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T20:30:37.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T20:30:37.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.058+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:30:37.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:30:37.059+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 65 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d2070 con 0x5617fb906f00 2024-04-26T20:30:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:36 smithi189 ceph-mon[32756]: pgmap v4822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:38 smithi156 ceph-mon[32679]: pgmap v4823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7934.376344 secs 2024-04-26T20:30:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:38 smithi092 ceph-mon[29156]: pgmap v4823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7934.376344 secs 2024-04-26T20:30:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:38 smithi189 ceph-mon[32756]: pgmap v4823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7934.376344 secs 2024-04-26T20:30:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7237.354443 secs 2024-04-26T20:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7237.354443 secs 2024-04-26T20:30:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7237.354443 secs 2024-04-26T20:30:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:40 smithi092 ceph-mon[29156]: pgmap v4824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:40 smithi189 ceph-mon[32756]: pgmap v4824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:40 smithi156 ceph-mon[32679]: pgmap v4824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:42 smithi092 ceph-mon[29156]: pgmap v4825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:42 smithi189 ceph-mon[32756]: pgmap v4825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:42 smithi156 ceph-mon[32679]: pgmap v4825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7939.376429 secs 2024-04-26T20:30:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7939.376429 secs 2024-04-26T20:30:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7939.376429 secs 2024-04-26T20:30:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7242.354558 secs 2024-04-26T20:30:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:44 smithi092 ceph-mon[29156]: pgmap v4826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7242.354558 secs 2024-04-26T20:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:44 smithi189 ceph-mon[32756]: pgmap v4826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7242.354558 secs 2024-04-26T20:30:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:44 smithi156 ceph-mon[32679]: pgmap v4826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:46 smithi092 ceph-mon[29156]: pgmap v4827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:46 smithi189 ceph-mon[32756]: pgmap v4827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:46 smithi156 ceph-mon[32679]: pgmap v4827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:48 smithi092 ceph-mon[29156]: pgmap v4828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7944.376542 secs 2024-04-26T20:30:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:48 smithi189 ceph-mon[32756]: pgmap v4828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7944.376542 secs 2024-04-26T20:30:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:48 smithi156 ceph-mon[32679]: pgmap v4828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7944.376542 secs 2024-04-26T20:30:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7247.354638 secs 2024-04-26T20:30:50.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7247.354638 secs 2024-04-26T20:30:50.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7247.354638 secs 2024-04-26T20:30:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:50 smithi092 ceph-mon[29156]: pgmap v4829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:50 smithi189 ceph-mon[32756]: pgmap v4829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:50 smithi156 ceph-mon[32679]: pgmap v4829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:52 smithi092 ceph-mon[29156]: pgmap v4830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:52 smithi189 ceph-mon[32756]: pgmap v4830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:52 smithi156 ceph-mon[32679]: pgmap v4830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7949.376655 secs 2024-04-26T20:30:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7949.376655 secs 2024-04-26T20:30:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7949.376655 secs 2024-04-26T20:30:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7252.354712 secs 2024-04-26T20:30:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:54 smithi092 ceph-mon[29156]: pgmap v4831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7252.354712 secs 2024-04-26T20:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:54 smithi189 ceph-mon[32756]: pgmap v4831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7252.354712 secs 2024-04-26T20:30:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:54 smithi156 ceph-mon[32679]: pgmap v4831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:30:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:56 smithi092 ceph-mon[29156]: pgmap v4832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:56 smithi189 ceph-mon[32756]: pgmap v4832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:56 smithi156 ceph-mon[32679]: pgmap v4832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:58 smithi092 ceph-mon[29156]: pgmap v4833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7954.376772 secs 2024-04-26T20:30:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:58 smithi189 ceph-mon[32756]: pgmap v4833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7954.376772 secs 2024-04-26T20:30:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:58 smithi156 ceph-mon[32679]: pgmap v4833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:30:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7954.376772 secs 2024-04-26T20:30:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7257.354812 secs 2024-04-26T20:30:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:30:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7257.354812 secs 2024-04-26T20:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:30:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7257.354812 secs 2024-04-26T20:31:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:30:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:31:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:00 smithi092 ceph-mon[29156]: pgmap v4834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:31:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:00 smithi189 ceph-mon[32756]: pgmap v4834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:31:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:00 smithi156 ceph-mon[32679]: pgmap v4834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:31:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:31:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:31:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:01 smithi092 ceph-mon[29156]: pgmap v4835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:31:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:01 smithi092 ceph-mon[29156]: pgmap v4836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:01 smithi189 ceph-mon[32756]: pgmap v4835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:31:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:01 smithi189 ceph-mon[32756]: pgmap v4836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:01 smithi156 ceph-mon[32679]: pgmap v4835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:31:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:01 smithi156 ceph-mon[32679]: pgmap v4836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:03 smithi189 ceph-mon[32756]: pgmap v4837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7959.376896 secs 2024-04-26T20:31:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:03 smithi156 ceph-mon[32679]: pgmap v4837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7959.376896 secs 2024-04-26T20:31:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:03 smithi092 ceph-mon[29156]: pgmap v4837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7959.376896 secs 2024-04-26T20:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7262.354923 secs 2024-04-26T20:31:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7262.354923 secs 2024-04-26T20:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7262.354923 secs 2024-04-26T20:31:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:05 smithi189 ceph-mon[32756]: pgmap v4838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:05 smithi156 ceph-mon[32679]: pgmap v4838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:05 smithi092 ceph-mon[29156]: pgmap v4838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:07 smithi189 ceph-mon[32756]: pgmap v4839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:07 smithi156 ceph-mon[32679]: pgmap v4839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:07 smithi092 ceph-mon[29156]: pgmap v4839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:31:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7964.377000 secs 2024-04-26T20:31:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7964.377000 secs 2024-04-26T20:31:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7964.377000 secs 2024-04-26T20:31:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:09 smithi189 ceph-mon[32756]: pgmap v4840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7267.354992 secs 2024-04-26T20:31:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:09 smithi156 ceph-mon[32679]: pgmap v4840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7267.354992 secs 2024-04-26T20:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:09 smithi092 ceph-mon[29156]: pgmap v4840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7267.354992 secs 2024-04-26T20:31:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:11 smithi189 ceph-mon[32756]: pgmap v4841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:31:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:11 smithi156 ceph-mon[32679]: pgmap v4841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:31:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:11 smithi092 ceph-mon[29156]: pgmap v4841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:31:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:13 smithi189 ceph-mon[32756]: pgmap v4842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7969.377121 secs 2024-04-26T20:31:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7272.355114 secs 2024-04-26T20:31:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:13 smithi156 ceph-mon[32679]: pgmap v4842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7969.377121 secs 2024-04-26T20:31:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7272.355114 secs 2024-04-26T20:31:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:13 smithi092 ceph-mon[29156]: pgmap v4842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7969.377121 secs 2024-04-26T20:31:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7272.355114 secs 2024-04-26T20:31:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:15 smithi189 ceph-mon[32756]: pgmap v4843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:15 smithi156 ceph-mon[32679]: pgmap v4843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:15 smithi092 ceph-mon[29156]: pgmap v4843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:17 smithi189 ceph-mon[32756]: pgmap v4844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:17 smithi156 ceph-mon[32679]: pgmap v4844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:17 smithi092 ceph-mon[29156]: pgmap v4844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7974.377216 secs 2024-04-26T20:31:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7277.355231 secs 2024-04-26T20:31:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7974.377216 secs 2024-04-26T20:31:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7277.355231 secs 2024-04-26T20:31:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7974.377216 secs 2024-04-26T20:31:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7277.355231 secs 2024-04-26T20:31:20.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:19 smithi189 ceph-mon[32756]: pgmap v4845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:20.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:19 smithi156 ceph-mon[32679]: pgmap v4845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:19 smithi092 ceph-mon[29156]: pgmap v4845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:20 smithi189 ceph-mon[32756]: pgmap v4846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:20 smithi156 ceph-mon[32679]: pgmap v4846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:20 smithi092 ceph-mon[29156]: pgmap v4846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:23 smithi189 ceph-mon[32756]: pgmap v4847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:23 smithi156 ceph-mon[32679]: pgmap v4847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:23 smithi092 ceph-mon[29156]: pgmap v4847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7979.377362 secs 2024-04-26T20:31:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7282.355375 secs 2024-04-26T20:31:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7979.377362 secs 2024-04-26T20:31:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7282.355375 secs 2024-04-26T20:31:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7979.377362 secs 2024-04-26T20:31:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7282.355375 secs 2024-04-26T20:31:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:25 smithi189 ceph-mon[32756]: pgmap v4848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:25 smithi156 ceph-mon[32679]: pgmap v4848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:25 smithi092 ceph-mon[29156]: pgmap v4848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:27 smithi189 ceph-mon[32756]: pgmap v4849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:27 smithi156 ceph-mon[32679]: pgmap v4849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:27 smithi092 ceph-mon[29156]: pgmap v4849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7984.377433 secs 2024-04-26T20:31:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:29 smithi189 ceph-mon[32756]: pgmap v4850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7287.355524 secs 2024-04-26T20:31:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7984.377433 secs 2024-04-26T20:31:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:29 smithi156 ceph-mon[32679]: pgmap v4850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7287.355524 secs 2024-04-26T20:31:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7984.377433 secs 2024-04-26T20:31:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:29 smithi092 ceph-mon[29156]: pgmap v4850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7287.355524 secs 2024-04-26T20:31:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:31 smithi189 ceph-mon[32756]: pgmap v4851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:31 smithi156 ceph-mon[32679]: pgmap v4851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:31 smithi092 ceph-mon[29156]: pgmap v4851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:33 smithi156 ceph-mon[32679]: pgmap v4852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:33 smithi092 ceph-mon[29156]: pgmap v4852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:33 smithi189 ceph-mon[32756]: pgmap v4852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7989.377558 secs 2024-04-26T20:31:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7292.355618 secs 2024-04-26T20:31:34.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7989.377558 secs 2024-04-26T20:31:34.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7292.355618 secs 2024-04-26T20:31:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7989.377558 secs 2024-04-26T20:31:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7292.355618 secs 2024-04-26T20:31:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:35 smithi156 ceph-mon[32679]: pgmap v4853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:35 smithi092 ceph-mon[29156]: pgmap v4853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:35 smithi189 ceph-mon[32756]: pgmap v4853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:37 smithi156 ceph-mon[32679]: pgmap v4854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:37 smithi092 ceph-mon[29156]: pgmap v4854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:37 smithi189 ceph-mon[32756]: pgmap v4854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7994.377675 secs 2024-04-26T20:31:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:39 smithi156 ceph-mon[32679]: pgmap v4855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7297.355687 secs 2024-04-26T20:31:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7994.377675 secs 2024-04-26T20:31:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:39 smithi092 ceph-mon[29156]: pgmap v4855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7297.355687 secs 2024-04-26T20:31:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7994.377675 secs 2024-04-26T20:31:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:39 smithi189 ceph-mon[32756]: pgmap v4855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7297.355687 secs 2024-04-26T20:31:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:41 smithi156 ceph-mon[32679]: pgmap v4856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:41 smithi092 ceph-mon[29156]: pgmap v4856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:41 smithi189 ceph-mon[32756]: pgmap v4856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:43 smithi156 ceph-mon[32679]: pgmap v4857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:43 smithi092 ceph-mon[29156]: pgmap v4857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:43 smithi189 ceph-mon[32756]: pgmap v4857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 7999.377781 secs 2024-04-26T20:31:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7302.355766 secs 2024-04-26T20:31:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 7999.377781 secs 2024-04-26T20:31:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7302.355766 secs 2024-04-26T20:31:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 7999.377781 secs 2024-04-26T20:31:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7302.355766 secs 2024-04-26T20:31:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:45 smithi156 ceph-mon[32679]: pgmap v4858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:45 smithi092 ceph-mon[29156]: pgmap v4858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:45 smithi189 ceph-mon[32756]: pgmap v4858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:47 smithi156 ceph-mon[32679]: pgmap v4859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:47 smithi092 ceph-mon[29156]: pgmap v4859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:47 smithi189 ceph-mon[32756]: pgmap v4859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8004.377914 secs 2024-04-26T20:31:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:49 smithi156 ceph-mon[32679]: pgmap v4860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7307.355899 secs 2024-04-26T20:31:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8004.377914 secs 2024-04-26T20:31:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:49 smithi092 ceph-mon[29156]: pgmap v4860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7307.355899 secs 2024-04-26T20:31:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8004.377914 secs 2024-04-26T20:31:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:49 smithi189 ceph-mon[32756]: pgmap v4860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7307.355899 secs 2024-04-26T20:31:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:51 smithi156 ceph-mon[32679]: pgmap v4861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:51.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:51 smithi189 ceph-mon[32756]: pgmap v4861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:51 smithi092 ceph-mon[29156]: pgmap v4861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:53 smithi156 ceph-mon[32679]: pgmap v4862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:53 smithi092 ceph-mon[29156]: pgmap v4862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:53 smithi189 ceph-mon[32756]: pgmap v4862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8009.377987 secs 2024-04-26T20:31:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7312.356065 secs 2024-04-26T20:31:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8009.377987 secs 2024-04-26T20:31:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7312.356065 secs 2024-04-26T20:31:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8009.377987 secs 2024-04-26T20:31:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7312.356065 secs 2024-04-26T20:31:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:55 smithi092 ceph-mon[29156]: pgmap v4863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:55 smithi189 ceph-mon[32756]: pgmap v4863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:55 smithi156 ceph-mon[32679]: pgmap v4863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:31:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:57 smithi092 ceph-mon[29156]: pgmap v4864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:57 smithi189 ceph-mon[32756]: pgmap v4864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:57 smithi156 ceph-mon[32679]: pgmap v4864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8014.378117 secs 2024-04-26T20:31:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:59 smithi092 ceph-mon[29156]: pgmap v4865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:31:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7317.356144 secs 2024-04-26T20:31:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8014.378117 secs 2024-04-26T20:31:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:59 smithi189 ceph-mon[32756]: pgmap v4865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:31:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7317.356144 secs 2024-04-26T20:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8014.378117 secs 2024-04-26T20:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:59 smithi156 ceph-mon[32679]: pgmap v4865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:31:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7317.356144 secs 2024-04-26T20:32:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:32:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:01 smithi092 ceph-mon[29156]: pgmap v4866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:32:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:01 smithi189 ceph-mon[32756]: pgmap v4866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:32:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:01 smithi156 ceph-mon[32679]: pgmap v4866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:32:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:32:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:32:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:02 smithi092 ceph-mon[29156]: pgmap v4867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:32:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:02 smithi092 ceph-mon[29156]: pgmap v4868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:32:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:02 smithi189 ceph-mon[32756]: pgmap v4867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:32:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:02 smithi189 ceph-mon[32756]: pgmap v4868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:32:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:02 smithi156 ceph-mon[32679]: pgmap v4867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:32:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:02 smithi156 ceph-mon[32679]: pgmap v4868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:32:03.461 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:32:03.046+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:32:03.461 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:32:03.046+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:32:03.461 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:32:03.046+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:32:03.461 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:32:03.046+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:32:03.461 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:32:03.046+0000 7f254056e700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:32:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8019.378223 secs 2024-04-26T20:32:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8019.378223 secs 2024-04-26T20:32:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8019.378223 secs 2024-04-26T20:32:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:04 smithi092 ceph-mon[29156]: pgmap v4869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:32:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:04 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 7322.356291 secs 2024-04-26T20:32:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:04 smithi092 ceph-mon[29156]: slow request 5761.902712 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:04 smithi189 ceph-mon[32756]: pgmap v4869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:32:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:04 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 7322.356291 secs 2024-04-26T20:32:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:04 smithi189 ceph-mon[32756]: slow request 5761.902712 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:04 smithi156 ceph-mon[32679]: pgmap v4869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:32:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:04 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 7322.356291 secs 2024-04-26T20:32:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:04 smithi156 ceph-mon[32679]: slow request 5761.902712 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:32:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:06 smithi092 ceph-mon[29156]: pgmap v4870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:06 smithi189 ceph-mon[32756]: pgmap v4870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:06 smithi156 ceph-mon[32679]: pgmap v4870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:08 smithi092 ceph-mon[29156]: pgmap v4871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8024.378352 secs 2024-04-26T20:32:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:08 smithi189 ceph-mon[32756]: pgmap v4871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8024.378352 secs 2024-04-26T20:32:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:08 smithi156 ceph-mon[32679]: pgmap v4871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8024.378352 secs 2024-04-26T20:32:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7327.356407 secs 2024-04-26T20:32:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7327.356407 secs 2024-04-26T20:32:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7327.356407 secs 2024-04-26T20:32:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:10 smithi092 ceph-mon[29156]: pgmap v4872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:10 smithi189 ceph-mon[32756]: pgmap v4872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:10 smithi156 ceph-mon[32679]: pgmap v4872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T20:32:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:12 smithi189 ceph-mon[32756]: pgmap v4873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T20:32:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:12 smithi156 ceph-mon[32679]: pgmap v4873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T20:32:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:12 smithi092 ceph-mon[29156]: pgmap v4873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T20:32:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8029.378470 secs 2024-04-26T20:32:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7332.356469 secs 2024-04-26T20:32:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8029.378470 secs 2024-04-26T20:32:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7332.356469 secs 2024-04-26T20:32:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8029.378470 secs 2024-04-26T20:32:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7332.356469 secs 2024-04-26T20:32:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:14 smithi189 ceph-mon[32756]: pgmap v4874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T20:32:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:14 smithi156 ceph-mon[32679]: pgmap v4874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T20:32:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:14 smithi092 ceph-mon[29156]: pgmap v4874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T20:32:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:16 smithi189 ceph-mon[32756]: pgmap v4875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T20:32:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:16 smithi156 ceph-mon[32679]: pgmap v4875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T20:32:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:16 smithi092 ceph-mon[29156]: pgmap v4875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T20:32:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:18 smithi189 ceph-mon[32756]: pgmap v4876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8034.378581 secs 2024-04-26T20:32:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7337.356569 secs 2024-04-26T20:32:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:18 smithi156 ceph-mon[32679]: pgmap v4876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8034.378581 secs 2024-04-26T20:32:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7337.356569 secs 2024-04-26T20:32:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:18 smithi092 ceph-mon[29156]: pgmap v4876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8034.378581 secs 2024-04-26T20:32:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7337.356569 secs 2024-04-26T20:32:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:20 smithi189 ceph-mon[32756]: pgmap v4877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:32:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:20 smithi156 ceph-mon[32679]: pgmap v4877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:32:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:20 smithi092 ceph-mon[29156]: pgmap v4877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-26T20:32:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:22 smithi189 ceph-mon[32756]: pgmap v4878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:22 smithi156 ceph-mon[32679]: pgmap v4878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:22 smithi092 ceph-mon[29156]: pgmap v4878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8039.378699 secs 2024-04-26T20:32:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7342.356694 secs 2024-04-26T20:32:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8039.378699 secs 2024-04-26T20:32:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7342.356694 secs 2024-04-26T20:32:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8039.378699 secs 2024-04-26T20:32:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7342.356694 secs 2024-04-26T20:32:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:24 smithi189 ceph-mon[32756]: pgmap v4879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:24 smithi156 ceph-mon[32679]: pgmap v4879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:24 smithi092 ceph-mon[29156]: pgmap v4879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:26 smithi189 ceph-mon[32756]: pgmap v4880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:26 smithi156 ceph-mon[32679]: pgmap v4880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:26 smithi092 ceph-mon[29156]: pgmap v4880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:28 smithi189 ceph-mon[32756]: pgmap v4881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8044.378849 secs 2024-04-26T20:32:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7347.356770 secs 2024-04-26T20:32:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:28 smithi156 ceph-mon[32679]: pgmap v4881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8044.378849 secs 2024-04-26T20:32:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7347.356770 secs 2024-04-26T20:32:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:28 smithi092 ceph-mon[29156]: pgmap v4881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8044.378849 secs 2024-04-26T20:32:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7347.356770 secs 2024-04-26T20:32:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:30 smithi189 ceph-mon[32756]: pgmap v4882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:30 smithi156 ceph-mon[32679]: pgmap v4882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:30 smithi092 ceph-mon[29156]: pgmap v4882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:32 smithi189 ceph-mon[32756]: pgmap v4883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:32 smithi156 ceph-mon[32679]: pgmap v4883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:32 smithi092 ceph-mon[29156]: pgmap v4883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8049.378987 secs 2024-04-26T20:32:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7352.356896 secs 2024-04-26T20:32:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8049.378987 secs 2024-04-26T20:32:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7352.356896 secs 2024-04-26T20:32:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8049.378987 secs 2024-04-26T20:32:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7352.356896 secs 2024-04-26T20:32:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:34 smithi189 ceph-mon[32756]: pgmap v4884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:34 smithi156 ceph-mon[32679]: pgmap v4884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:34 smithi092 ceph-mon[29156]: pgmap v4884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:36 smithi189 ceph-mon[32756]: pgmap v4885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:36 smithi156 ceph-mon[32679]: pgmap v4885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:36 smithi092 ceph-mon[29156]: pgmap v4885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:38 smithi189 ceph-mon[32756]: pgmap v4886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8054.379095 secs 2024-04-26T20:32:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7357.357045 secs 2024-04-26T20:32:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:38 smithi156 ceph-mon[32679]: pgmap v4886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8054.379095 secs 2024-04-26T20:32:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7357.357045 secs 2024-04-26T20:32:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:38 smithi092 ceph-mon[29156]: pgmap v4886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8054.379095 secs 2024-04-26T20:32:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7357.357045 secs 2024-04-26T20:32:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:40 smithi189 ceph-mon[32756]: pgmap v4887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:40 smithi156 ceph-mon[32679]: pgmap v4887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:40 smithi092 ceph-mon[29156]: pgmap v4887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:42 smithi189 ceph-mon[32756]: pgmap v4888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:42 smithi156 ceph-mon[32679]: pgmap v4888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:42 smithi092 ceph-mon[29156]: pgmap v4888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8059.379192 secs 2024-04-26T20:32:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7362.357149 secs 2024-04-26T20:32:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8059.379192 secs 2024-04-26T20:32:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7362.357149 secs 2024-04-26T20:32:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8059.379192 secs 2024-04-26T20:32:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7362.357149 secs 2024-04-26T20:32:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:44 smithi189 ceph-mon[32756]: pgmap v4889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:45.282 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:44 smithi092 ceph-mon[29156]: pgmap v4889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:45.282 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:44 smithi156 ceph-mon[32679]: pgmap v4889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:46 smithi189 ceph-mon[32756]: pgmap v4890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:46 smithi156 ceph-mon[32679]: pgmap v4890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:46 smithi092 ceph-mon[29156]: pgmap v4890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:48 smithi189 ceph-mon[32756]: pgmap v4891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8064.379337 secs 2024-04-26T20:32:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7367.357317 secs 2024-04-26T20:32:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:48 smithi156 ceph-mon[32679]: pgmap v4891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8064.379337 secs 2024-04-26T20:32:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7367.357317 secs 2024-04-26T20:32:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:48 smithi092 ceph-mon[29156]: pgmap v4891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8064.379337 secs 2024-04-26T20:32:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7367.357317 secs 2024-04-26T20:32:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:50 smithi189 ceph-mon[32756]: pgmap v4892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:50 smithi156 ceph-mon[32679]: pgmap v4892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:50 smithi092 ceph-mon[29156]: pgmap v4892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:52 smithi156 ceph-mon[32679]: pgmap v4893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:52 smithi092 ceph-mon[29156]: pgmap v4893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:52 smithi189 ceph-mon[32756]: pgmap v4893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8069.379476 secs 2024-04-26T20:32:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7372.357446 secs 2024-04-26T20:32:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8069.379476 secs 2024-04-26T20:32:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7372.357446 secs 2024-04-26T20:32:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8069.379476 secs 2024-04-26T20:32:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7372.357446 secs 2024-04-26T20:32:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:54 smithi156 ceph-mon[32679]: pgmap v4894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:54 smithi092 ceph-mon[29156]: pgmap v4894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:54 smithi189 ceph-mon[32756]: pgmap v4894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:56 smithi156 ceph-mon[32679]: pgmap v4895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:56 smithi092 ceph-mon[29156]: pgmap v4895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:56 smithi189 ceph-mon[32756]: pgmap v4895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:32:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:58 smithi156 ceph-mon[32679]: pgmap v4896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8074.379595 secs 2024-04-26T20:32:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:32:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7377.357545 secs 2024-04-26T20:32:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:58 smithi092 ceph-mon[29156]: pgmap v4896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8074.379595 secs 2024-04-26T20:32:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:32:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7377.357545 secs 2024-04-26T20:32:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:58 smithi189 ceph-mon[32756]: pgmap v4896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:32:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8074.379595 secs 2024-04-26T20:32:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:32:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7377.357545 secs 2024-04-26T20:33:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:00 smithi156 ceph-mon[32679]: pgmap v4897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:00 smithi092 ceph-mon[29156]: pgmap v4897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:00 smithi189 ceph-mon[32756]: pgmap v4897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: pgmap v4898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: pgmap v4898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: pgmap v4898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8079.379663 secs 2024-04-26T20:33:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:03 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 7382.357608 secs 2024-04-26T20:33:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:03 smithi092 ceph-mon[29156]: slow request 360.570273 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:33:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8079.379663 secs 2024-04-26T20:33:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:03 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 7382.357608 secs 2024-04-26T20:33:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:03 smithi189 ceph-mon[32756]: slow request 360.570273 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:33:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8079.379663 secs 2024-04-26T20:33:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:03 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 7382.357608 secs 2024-04-26T20:33:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:03 smithi156 ceph-mon[32679]: slow request 360.570273 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:33:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: pgmap v4899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: pgmap v4899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: pgmap v4899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: pgmap v4900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: pgmap v4901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: pgmap v4902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: pgmap v4900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:06.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:06.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: pgmap v4901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:33:06.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: pgmap v4902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: pgmap v4900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: pgmap v4901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: pgmap v4902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:33:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:08 smithi189 ceph-mon[32756]: pgmap v4903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:33:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8084.379777 secs 2024-04-26T20:33:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7387.357722 secs 2024-04-26T20:33:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:08 smithi156 ceph-mon[32679]: pgmap v4903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:33:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8084.379777 secs 2024-04-26T20:33:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7387.357722 secs 2024-04-26T20:33:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:08 smithi092 ceph-mon[29156]: pgmap v4903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:33:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8084.379777 secs 2024-04-26T20:33:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7387.357722 secs 2024-04-26T20:33:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:10 smithi189 ceph-mon[32756]: pgmap v4904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:10 smithi156 ceph-mon[32679]: pgmap v4904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:10 smithi092 ceph-mon[29156]: pgmap v4904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:12 smithi189 ceph-mon[32756]: pgmap v4905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:12 smithi156 ceph-mon[32679]: pgmap v4905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:12 smithi092 ceph-mon[29156]: pgmap v4905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:33:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8089.379900 secs 2024-04-26T20:33:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7392.357823 secs 2024-04-26T20:33:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8089.379900 secs 2024-04-26T20:33:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7392.357823 secs 2024-04-26T20:33:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8089.379900 secs 2024-04-26T20:33:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7392.357823 secs 2024-04-26T20:33:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:14 smithi189 ceph-mon[32756]: pgmap v4906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:14 smithi156 ceph-mon[32679]: pgmap v4906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:14 smithi092 ceph-mon[29156]: pgmap v4906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:33:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:16 smithi189 ceph-mon[32756]: pgmap v4907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:33:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:16 smithi156 ceph-mon[32679]: pgmap v4907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:33:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:16 smithi092 ceph-mon[29156]: pgmap v4907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:33:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:18 smithi189 ceph-mon[32756]: pgmap v4908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8094.380019 secs 2024-04-26T20:33:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7397.357960 secs 2024-04-26T20:33:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:18 smithi156 ceph-mon[32679]: pgmap v4908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8094.380019 secs 2024-04-26T20:33:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7397.357960 secs 2024-04-26T20:33:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:18 smithi092 ceph-mon[29156]: pgmap v4908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8094.380019 secs 2024-04-26T20:33:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7397.357960 secs 2024-04-26T20:33:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:20 smithi189 ceph-mon[32756]: pgmap v4909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:20 smithi156 ceph-mon[32679]: pgmap v4909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:20 smithi092 ceph-mon[29156]: pgmap v4909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:22 smithi189 ceph-mon[32756]: pgmap v4910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:22 smithi156 ceph-mon[32679]: pgmap v4910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:22 smithi092 ceph-mon[29156]: pgmap v4910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8099.380127 secs 2024-04-26T20:33:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7402.358084 secs 2024-04-26T20:33:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8099.380127 secs 2024-04-26T20:33:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7402.358084 secs 2024-04-26T20:33:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8099.380127 secs 2024-04-26T20:33:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7402.358084 secs 2024-04-26T20:33:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:24 smithi189 ceph-mon[32756]: pgmap v4911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:24 smithi156 ceph-mon[32679]: pgmap v4911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:24 smithi092 ceph-mon[29156]: pgmap v4911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:26 smithi189 ceph-mon[32756]: pgmap v4912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:26 smithi156 ceph-mon[32679]: pgmap v4912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:26 smithi092 ceph-mon[29156]: pgmap v4912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:28 smithi189 ceph-mon[32756]: pgmap v4913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8104.380268 secs 2024-04-26T20:33:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7407.358206 secs 2024-04-26T20:33:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:28 smithi156 ceph-mon[32679]: pgmap v4913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8104.380268 secs 2024-04-26T20:33:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7407.358206 secs 2024-04-26T20:33:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:28 smithi092 ceph-mon[29156]: pgmap v4913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8104.380268 secs 2024-04-26T20:33:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7407.358206 secs 2024-04-26T20:33:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:30 smithi189 ceph-mon[32756]: pgmap v4914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:30 smithi156 ceph-mon[32679]: pgmap v4914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:30 smithi092 ceph-mon[29156]: pgmap v4914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:32 smithi189 ceph-mon[32756]: pgmap v4915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:32 smithi156 ceph-mon[32679]: pgmap v4915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:32 smithi092 ceph-mon[29156]: pgmap v4915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8109.380346 secs 2024-04-26T20:33:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7412.358345 secs 2024-04-26T20:33:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8109.380346 secs 2024-04-26T20:33:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7412.358345 secs 2024-04-26T20:33:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8109.380346 secs 2024-04-26T20:33:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7412.358345 secs 2024-04-26T20:33:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:34 smithi189 ceph-mon[32756]: pgmap v4916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:34 smithi156 ceph-mon[32679]: pgmap v4916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:34 smithi092 ceph-mon[29156]: pgmap v4916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca8082000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca8082000 comp rx=0 tx=0).stop 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:33:36.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:35.999+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca8089000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:33:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=7 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T20:33:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:36.029+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T20:33:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:36 smithi189 ceph-mon[32756]: pgmap v4917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:36 smithi156 ceph-mon[32679]: pgmap v4917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:36 smithi092 ceph-mon[29156]: pgmap v4917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:33:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:37.083+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:33:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:37.083+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:33:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:37.083+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:33:37.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:33:37.083+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 66 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:33:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:38 smithi189 ceph-mon[32756]: pgmap v4918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8114.380458 secs 2024-04-26T20:33:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7417.358494 secs 2024-04-26T20:33:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:38 smithi156 ceph-mon[32679]: pgmap v4918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8114.380458 secs 2024-04-26T20:33:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7417.358494 secs 2024-04-26T20:33:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:38 smithi092 ceph-mon[29156]: pgmap v4918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8114.380458 secs 2024-04-26T20:33:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7417.358494 secs 2024-04-26T20:33:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:40 smithi189 ceph-mon[32756]: pgmap v4919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:40 smithi156 ceph-mon[32679]: pgmap v4919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:40 smithi092 ceph-mon[29156]: pgmap v4919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:42 smithi189 ceph-mon[32756]: pgmap v4920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:42 smithi156 ceph-mon[32679]: pgmap v4920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:42 smithi092 ceph-mon[29156]: pgmap v4920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8119.380576 secs 2024-04-26T20:33:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7422.358619 secs 2024-04-26T20:33:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8119.380576 secs 2024-04-26T20:33:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7422.358619 secs 2024-04-26T20:33:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8119.380576 secs 2024-04-26T20:33:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7422.358619 secs 2024-04-26T20:33:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:44 smithi156 ceph-mon[32679]: pgmap v4921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:44 smithi092 ceph-mon[29156]: pgmap v4921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:44 smithi189 ceph-mon[32756]: pgmap v4921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:46 smithi156 ceph-mon[32679]: pgmap v4922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:46 smithi092 ceph-mon[29156]: pgmap v4922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:46 smithi189 ceph-mon[32756]: pgmap v4922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:48 smithi156 ceph-mon[32679]: pgmap v4923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8124.380638 secs 2024-04-26T20:33:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7427.358700 secs 2024-04-26T20:33:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:48 smithi092 ceph-mon[29156]: pgmap v4923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8124.380638 secs 2024-04-26T20:33:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7427.358700 secs 2024-04-26T20:33:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:48 smithi189 ceph-mon[32756]: pgmap v4923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8124.380638 secs 2024-04-26T20:33:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7427.358700 secs 2024-04-26T20:33:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:50 smithi156 ceph-mon[32679]: pgmap v4924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:50 smithi092 ceph-mon[29156]: pgmap v4924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:50 smithi189 ceph-mon[32756]: pgmap v4924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:52 smithi156 ceph-mon[32679]: pgmap v4925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:52.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:52 smithi189 ceph-mon[32756]: pgmap v4925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:52 smithi092 ceph-mon[29156]: pgmap v4925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8129.380752 secs 2024-04-26T20:33:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7432.358810 secs 2024-04-26T20:33:53.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8129.380752 secs 2024-04-26T20:33:53.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7432.358810 secs 2024-04-26T20:33:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8129.380752 secs 2024-04-26T20:33:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7432.358810 secs 2024-04-26T20:33:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:54 smithi156 ceph-mon[32679]: pgmap v4926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:54 smithi092 ceph-mon[29156]: pgmap v4926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:54 smithi189 ceph-mon[32756]: pgmap v4926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:56 smithi156 ceph-mon[32679]: pgmap v4927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:56 smithi092 ceph-mon[29156]: pgmap v4927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:56 smithi189 ceph-mon[32756]: pgmap v4927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:33:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:58 smithi156 ceph-mon[32679]: pgmap v4928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8134.380893 secs 2024-04-26T20:33:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:33:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7437.358929 secs 2024-04-26T20:33:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:58 smithi092 ceph-mon[29156]: pgmap v4928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8134.380893 secs 2024-04-26T20:33:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:33:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7437.358929 secs 2024-04-26T20:33:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:58 smithi189 ceph-mon[32756]: pgmap v4928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:33:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8134.380893 secs 2024-04-26T20:33:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:33:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7437.358929 secs 2024-04-26T20:34:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:00 smithi156 ceph-mon[32679]: pgmap v4929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:00 smithi092 ceph-mon[29156]: pgmap v4929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:00 smithi189 ceph-mon[32756]: pgmap v4929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:02 smithi156 ceph-mon[32679]: pgmap v4930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:02 smithi092 ceph-mon[29156]: pgmap v4930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:02 smithi189 ceph-mon[32756]: pgmap v4930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8139.380969 secs 2024-04-26T20:34:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7442.359045 secs 2024-04-26T20:34:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8139.380969 secs 2024-04-26T20:34:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7442.359045 secs 2024-04-26T20:34:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8139.380969 secs 2024-04-26T20:34:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7442.359045 secs 2024-04-26T20:34:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:04 smithi092 ceph-mon[29156]: pgmap v4931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:04 smithi189 ceph-mon[32756]: pgmap v4931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:04 smithi156 ceph-mon[32679]: pgmap v4931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:34:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:06 smithi092 ceph-mon[29156]: pgmap v4932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:34:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:06 smithi189 ceph-mon[32756]: pgmap v4932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:34:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:06 smithi156 ceph-mon[32679]: pgmap v4932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:34:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:34:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:34:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:07 smithi092 ceph-mon[29156]: pgmap v4933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:34:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:07 smithi092 ceph-mon[29156]: pgmap v4934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:07 smithi189 ceph-mon[32756]: pgmap v4933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:34:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:07 smithi189 ceph-mon[32756]: pgmap v4934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:07 smithi156 ceph-mon[32679]: pgmap v4933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:34:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:07 smithi156 ceph-mon[32679]: pgmap v4934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8144.381076 secs 2024-04-26T20:34:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7447.359107 secs 2024-04-26T20:34:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8144.381076 secs 2024-04-26T20:34:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7447.359107 secs 2024-04-26T20:34:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8144.381076 secs 2024-04-26T20:34:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7447.359107 secs 2024-04-26T20:34:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:09 smithi092 ceph-mon[29156]: pgmap v4935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:34:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:09 smithi189 ceph-mon[32756]: pgmap v4935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:34:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:09 smithi156 ceph-mon[32679]: pgmap v4935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:34:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:11 smithi092 ceph-mon[29156]: pgmap v4936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:11 smithi189 ceph-mon[32756]: pgmap v4936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:11 smithi156 ceph-mon[32679]: pgmap v4936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:13 smithi092 ceph-mon[29156]: pgmap v4937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8149.381151 secs 2024-04-26T20:34:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7452.359246 secs 2024-04-26T20:34:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:13 smithi189 ceph-mon[32756]: pgmap v4937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8149.381151 secs 2024-04-26T20:34:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7452.359246 secs 2024-04-26T20:34:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:13 smithi156 ceph-mon[32679]: pgmap v4937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8149.381151 secs 2024-04-26T20:34:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7452.359246 secs 2024-04-26T20:34:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:15 smithi092 ceph-mon[29156]: pgmap v4938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:15 smithi189 ceph-mon[32756]: pgmap v4938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:15 smithi156 ceph-mon[32679]: pgmap v4938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:34:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:17 smithi092 ceph-mon[29156]: pgmap v4939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:34:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:17 smithi189 ceph-mon[32756]: pgmap v4939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:34:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:17 smithi156 ceph-mon[32679]: pgmap v4939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:34:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8154.381284 secs 2024-04-26T20:34:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7457.359359 secs 2024-04-26T20:34:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8154.381284 secs 2024-04-26T20:34:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7457.359359 secs 2024-04-26T20:34:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8154.381284 secs 2024-04-26T20:34:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7457.359359 secs 2024-04-26T20:34:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:19 smithi092 ceph-mon[29156]: pgmap v4940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:19 smithi189 ceph-mon[32756]: pgmap v4940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:19 smithi156 ceph-mon[32679]: pgmap v4940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:21 smithi092 ceph-mon[29156]: pgmap v4941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:21 smithi189 ceph-mon[32756]: pgmap v4941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:21 smithi156 ceph-mon[32679]: pgmap v4941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:23 smithi092 ceph-mon[29156]: pgmap v4942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8159.381419 secs 2024-04-26T20:34:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7462.359484 secs 2024-04-26T20:34:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:23 smithi189 ceph-mon[32756]: pgmap v4942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8159.381419 secs 2024-04-26T20:34:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7462.359484 secs 2024-04-26T20:34:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:23 smithi156 ceph-mon[32679]: pgmap v4942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8159.381419 secs 2024-04-26T20:34:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7462.359484 secs 2024-04-26T20:34:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:25 smithi092 ceph-mon[29156]: pgmap v4943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:25 smithi189 ceph-mon[32756]: pgmap v4943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:25 smithi156 ceph-mon[32679]: pgmap v4943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:27 smithi092 ceph-mon[29156]: pgmap v4944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:27 smithi189 ceph-mon[32756]: pgmap v4944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:27 smithi156 ceph-mon[32679]: pgmap v4944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8164.381537 secs 2024-04-26T20:34:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7467.359611 secs 2024-04-26T20:34:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8164.381537 secs 2024-04-26T20:34:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7467.359611 secs 2024-04-26T20:34:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8164.381537 secs 2024-04-26T20:34:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7467.359611 secs 2024-04-26T20:34:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:29 smithi189 ceph-mon[32756]: pgmap v4945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:30.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:29 smithi092 ceph-mon[29156]: pgmap v4945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:29 smithi156 ceph-mon[32679]: pgmap v4945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:31 smithi189 ceph-mon[32756]: pgmap v4946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:31 smithi156 ceph-mon[32679]: pgmap v4946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:31 smithi092 ceph-mon[29156]: pgmap v4946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:33 smithi189 ceph-mon[32756]: pgmap v4947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8169.381658 secs 2024-04-26T20:34:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7472.359730 secs 2024-04-26T20:34:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:33 smithi156 ceph-mon[32679]: pgmap v4947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8169.381658 secs 2024-04-26T20:34:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7472.359730 secs 2024-04-26T20:34:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:33 smithi092 ceph-mon[29156]: pgmap v4947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8169.381658 secs 2024-04-26T20:34:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7472.359730 secs 2024-04-26T20:34:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:35 smithi189 ceph-mon[32756]: pgmap v4948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:35 smithi156 ceph-mon[32679]: pgmap v4948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:35 smithi092 ceph-mon[29156]: pgmap v4948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:37 smithi189 ceph-mon[32756]: pgmap v4949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:37 smithi156 ceph-mon[32679]: pgmap v4949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:37 smithi092 ceph-mon[29156]: pgmap v4949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8174.381776 secs 2024-04-26T20:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7477.359848 secs 2024-04-26T20:34:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8174.381776 secs 2024-04-26T20:34:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7477.359848 secs 2024-04-26T20:34:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8174.381776 secs 2024-04-26T20:34:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7477.359848 secs 2024-04-26T20:34:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:39 smithi189 ceph-mon[32756]: pgmap v4950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:39 smithi156 ceph-mon[32679]: pgmap v4950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:39 smithi092 ceph-mon[29156]: pgmap v4950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:41 smithi189 ceph-mon[32756]: pgmap v4951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:41 smithi156 ceph-mon[32679]: pgmap v4951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:41 smithi092 ceph-mon[29156]: pgmap v4951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:43 smithi189 ceph-mon[32756]: pgmap v4952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8179.381910 secs 2024-04-26T20:34:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7482.359920 secs 2024-04-26T20:34:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:43 smithi156 ceph-mon[32679]: pgmap v4952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8179.381910 secs 2024-04-26T20:34:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7482.359920 secs 2024-04-26T20:34:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:43 smithi092 ceph-mon[29156]: pgmap v4952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8179.381910 secs 2024-04-26T20:34:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7482.359920 secs 2024-04-26T20:34:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:45 smithi189 ceph-mon[32756]: pgmap v4953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:45 smithi156 ceph-mon[32679]: pgmap v4953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:45 smithi092 ceph-mon[29156]: pgmap v4953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:47 smithi189 ceph-mon[32756]: pgmap v4954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:47 smithi156 ceph-mon[32679]: pgmap v4954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:47 smithi092 ceph-mon[29156]: pgmap v4954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8184.381986 secs 2024-04-26T20:34:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7487.359978 secs 2024-04-26T20:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8184.381986 secs 2024-04-26T20:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7487.359978 secs 2024-04-26T20:34:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8184.381986 secs 2024-04-26T20:34:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7487.359978 secs 2024-04-26T20:34:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:49 smithi189 ceph-mon[32756]: pgmap v4955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:49 smithi156 ceph-mon[32679]: pgmap v4955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:49 smithi092 ceph-mon[29156]: pgmap v4955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:51 smithi189 ceph-mon[32756]: pgmap v4956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:51 smithi156 ceph-mon[32679]: pgmap v4956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:51 smithi092 ceph-mon[29156]: pgmap v4956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:53 smithi189 ceph-mon[32756]: pgmap v4957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8189.382049 secs 2024-04-26T20:34:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7492.360115 secs 2024-04-26T20:34:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:53 smithi156 ceph-mon[32679]: pgmap v4957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8189.382049 secs 2024-04-26T20:34:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7492.360115 secs 2024-04-26T20:34:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:53 smithi092 ceph-mon[29156]: pgmap v4957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8189.382049 secs 2024-04-26T20:34:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7492.360115 secs 2024-04-26T20:34:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:55 smithi189 ceph-mon[32756]: pgmap v4958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:55 smithi156 ceph-mon[32679]: pgmap v4958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:55 smithi092 ceph-mon[29156]: pgmap v4958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:34:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:57 smithi189 ceph-mon[32756]: pgmap v4959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:57 smithi156 ceph-mon[32679]: pgmap v4959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:57 smithi092 ceph-mon[29156]: pgmap v4959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:34:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8194.382167 secs 2024-04-26T20:34:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7497.360252 secs 2024-04-26T20:34:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8194.382167 secs 2024-04-26T20:34:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7497.360252 secs 2024-04-26T20:34:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8194.382167 secs 2024-04-26T20:34:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7497.360252 secs 2024-04-26T20:35:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:34:59 smithi189 ceph-mon[32756]: pgmap v4960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:00.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:34:59 smithi092 ceph-mon[29156]: pgmap v4960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:34:59 smithi156 ceph-mon[32679]: pgmap v4960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:01 smithi189 ceph-mon[32756]: pgmap v4961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:01 smithi156 ceph-mon[32679]: pgmap v4961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:01 smithi092 ceph-mon[29156]: pgmap v4961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:03 smithi189 ceph-mon[32756]: pgmap v4962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8199.382267 secs 2024-04-26T20:35:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7502.360376 secs 2024-04-26T20:35:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:03 smithi156 ceph-mon[32679]: pgmap v4962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8199.382267 secs 2024-04-26T20:35:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7502.360376 secs 2024-04-26T20:35:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:03 smithi092 ceph-mon[29156]: pgmap v4962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8199.382267 secs 2024-04-26T20:35:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7502.360376 secs 2024-04-26T20:35:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:04 smithi189 ceph-mon[32756]: pgmap v4963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:04 smithi156 ceph-mon[32679]: pgmap v4963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:04 smithi092 ceph-mon[29156]: pgmap v4963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: pgmap v4964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: pgmap v4965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: pgmap v4966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:35:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: pgmap v4964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: pgmap v4965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:35:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: pgmap v4966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: pgmap v4964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: pgmap v4965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: pgmap v4966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:35:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8204.382347 secs 2024-04-26T20:35:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8204.382347 secs 2024-04-26T20:35:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8204.382347 secs 2024-04-26T20:35:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7507.360496 secs 2024-04-26T20:35:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:09 smithi189 ceph-mon[32756]: pgmap v4967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7507.360496 secs 2024-04-26T20:35:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:09 smithi156 ceph-mon[32679]: pgmap v4967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7507.360496 secs 2024-04-26T20:35:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:09 smithi092 ceph-mon[29156]: pgmap v4967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:11 smithi189 ceph-mon[32756]: pgmap v4968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:11 smithi156 ceph-mon[32679]: pgmap v4968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:11 smithi092 ceph-mon[29156]: pgmap v4968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:13 smithi189 ceph-mon[32756]: pgmap v4969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:35:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8209.382469 secs 2024-04-26T20:35:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7512.360566 secs 2024-04-26T20:35:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:13 smithi156 ceph-mon[32679]: pgmap v4969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:35:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8209.382469 secs 2024-04-26T20:35:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7512.360566 secs 2024-04-26T20:35:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:13 smithi092 ceph-mon[29156]: pgmap v4969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:35:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8209.382469 secs 2024-04-26T20:35:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7512.360566 secs 2024-04-26T20:35:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:15 smithi189 ceph-mon[32756]: pgmap v4970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:15 smithi156 ceph-mon[32679]: pgmap v4970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:15 smithi092 ceph-mon[29156]: pgmap v4970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:35:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:17 smithi189 ceph-mon[32756]: pgmap v4971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:35:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:17 smithi156 ceph-mon[32679]: pgmap v4971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:35:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:17 smithi092 ceph-mon[29156]: pgmap v4971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:35:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8214.382587 secs 2024-04-26T20:35:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7517.360656 secs 2024-04-26T20:35:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8214.382587 secs 2024-04-26T20:35:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7517.360656 secs 2024-04-26T20:35:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8214.382587 secs 2024-04-26T20:35:19.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7517.360656 secs 2024-04-26T20:35:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:19 smithi189 ceph-mon[32756]: pgmap v4972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:19 smithi156 ceph-mon[32679]: pgmap v4972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:19 smithi092 ceph-mon[29156]: pgmap v4972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:20 smithi189 ceph-mon[32756]: pgmap v4973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:20 smithi156 ceph-mon[32679]: pgmap v4973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:20 smithi092 ceph-mon[29156]: pgmap v4973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:23 smithi189 ceph-mon[32756]: pgmap v4974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8219.382705 secs 2024-04-26T20:35:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7522.360730 secs 2024-04-26T20:35:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:23 smithi156 ceph-mon[32679]: pgmap v4974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8219.382705 secs 2024-04-26T20:35:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7522.360730 secs 2024-04-26T20:35:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:23 smithi092 ceph-mon[29156]: pgmap v4974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8219.382705 secs 2024-04-26T20:35:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7522.360730 secs 2024-04-26T20:35:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:25 smithi189 ceph-mon[32756]: pgmap v4975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:25 smithi156 ceph-mon[32679]: pgmap v4975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:25 smithi092 ceph-mon[29156]: pgmap v4975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:27 smithi092 ceph-mon[29156]: pgmap v4976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:27 smithi189 ceph-mon[32756]: pgmap v4976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:27 smithi156 ceph-mon[32679]: pgmap v4976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8224.382859 secs 2024-04-26T20:35:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7527.360822 secs 2024-04-26T20:35:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8224.382859 secs 2024-04-26T20:35:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7527.360822 secs 2024-04-26T20:35:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8224.382859 secs 2024-04-26T20:35:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7527.360822 secs 2024-04-26T20:35:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:29 smithi189 ceph-mon[32756]: pgmap v4977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:30.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:29 smithi092 ceph-mon[29156]: pgmap v4977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:29 smithi156 ceph-mon[32679]: pgmap v4977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:30 smithi189 ceph-mon[32756]: pgmap v4978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:30 smithi156 ceph-mon[32679]: pgmap v4978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:30 smithi092 ceph-mon[29156]: pgmap v4978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:33 smithi189 ceph-mon[32756]: pgmap v4979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8229.382933 secs 2024-04-26T20:35:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7532.360944 secs 2024-04-26T20:35:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:33 smithi156 ceph-mon[32679]: pgmap v4979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8229.382933 secs 2024-04-26T20:35:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7532.360944 secs 2024-04-26T20:35:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:33 smithi092 ceph-mon[29156]: pgmap v4979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8229.382933 secs 2024-04-26T20:35:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7532.360944 secs 2024-04-26T20:35:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:35 smithi189 ceph-mon[32756]: pgmap v4980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:35 smithi156 ceph-mon[32679]: pgmap v4980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:35 smithi092 ceph-mon[29156]: pgmap v4980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:37 smithi189 ceph-mon[32756]: pgmap v4981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:37 smithi156 ceph-mon[32679]: pgmap v4981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:37 smithi092 ceph-mon[29156]: pgmap v4981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8234.383078 secs 2024-04-26T20:35:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7537.361077 secs 2024-04-26T20:35:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8234.383078 secs 2024-04-26T20:35:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7537.361077 secs 2024-04-26T20:35:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8234.383078 secs 2024-04-26T20:35:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7537.361077 secs 2024-04-26T20:35:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:39 smithi189 ceph-mon[32756]: pgmap v4982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:39 smithi156 ceph-mon[32679]: pgmap v4982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:39 smithi092 ceph-mon[29156]: pgmap v4982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:40 smithi189 ceph-mon[32756]: pgmap v4983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:40 smithi156 ceph-mon[32679]: pgmap v4983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:40 smithi092 ceph-mon[29156]: pgmap v4983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:43 smithi189 ceph-mon[32756]: pgmap v4984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8239.383141 secs 2024-04-26T20:35:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7542.361140 secs 2024-04-26T20:35:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:43 smithi156 ceph-mon[32679]: pgmap v4984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8239.383141 secs 2024-04-26T20:35:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7542.361140 secs 2024-04-26T20:35:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:43 smithi092 ceph-mon[29156]: pgmap v4984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8239.383141 secs 2024-04-26T20:35:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7542.361140 secs 2024-04-26T20:35:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:45 smithi189 ceph-mon[32756]: pgmap v4985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:45 smithi156 ceph-mon[32679]: pgmap v4985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:45 smithi092 ceph-mon[29156]: pgmap v4985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:47 smithi189 ceph-mon[32756]: pgmap v4986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:47 smithi156 ceph-mon[32679]: pgmap v4986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:47 smithi092 ceph-mon[29156]: pgmap v4986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8244.383271 secs 2024-04-26T20:35:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7547.361252 secs 2024-04-26T20:35:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8244.383271 secs 2024-04-26T20:35:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7547.361252 secs 2024-04-26T20:35:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8244.383271 secs 2024-04-26T20:35:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7547.361252 secs 2024-04-26T20:35:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:49 smithi189 ceph-mon[32756]: pgmap v4987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:49 smithi156 ceph-mon[32679]: pgmap v4987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:49 smithi092 ceph-mon[29156]: pgmap v4987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:50 smithi189 ceph-mon[32756]: pgmap v4988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:50 smithi156 ceph-mon[32679]: pgmap v4988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:50 smithi092 ceph-mon[29156]: pgmap v4988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:53 smithi189 ceph-mon[32756]: pgmap v4989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8249.383408 secs 2024-04-26T20:35:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7552.361366 secs 2024-04-26T20:35:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:53 smithi156 ceph-mon[32679]: pgmap v4989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8249.383408 secs 2024-04-26T20:35:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7552.361366 secs 2024-04-26T20:35:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:53 smithi092 ceph-mon[29156]: pgmap v4989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8249.383408 secs 2024-04-26T20:35:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7552.361366 secs 2024-04-26T20:35:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:55 smithi189 ceph-mon[32756]: pgmap v4990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:55 smithi156 ceph-mon[32679]: pgmap v4990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:55 smithi092 ceph-mon[29156]: pgmap v4990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:57 smithi189 ceph-mon[32756]: pgmap v4991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:57 smithi156 ceph-mon[32679]: pgmap v4991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:57 smithi092 ceph-mon[29156]: pgmap v4991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8254.383470 secs 2024-04-26T20:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7557.361443 secs 2024-04-26T20:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:35:58 smithi189 ceph-mon[32756]: pgmap v4992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8254.383470 secs 2024-04-26T20:35:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7557.361443 secs 2024-04-26T20:35:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:35:58 smithi156 ceph-mon[32679]: pgmap v4992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:35:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8254.383470 secs 2024-04-26T20:35:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7557.361443 secs 2024-04-26T20:35:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:35:58 smithi092 ceph-mon[29156]: pgmap v4992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:01 smithi189 ceph-mon[32756]: pgmap v4993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:01 smithi156 ceph-mon[32679]: pgmap v4993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:01 smithi092 ceph-mon[29156]: pgmap v4993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:03 smithi189 ceph-mon[32756]: pgmap v4994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8259.383574 secs 2024-04-26T20:36:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7562.361565 secs 2024-04-26T20:36:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:03 smithi156 ceph-mon[32679]: pgmap v4994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8259.383574 secs 2024-04-26T20:36:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7562.361565 secs 2024-04-26T20:36:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:03 smithi092 ceph-mon[29156]: pgmap v4994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8259.383574 secs 2024-04-26T20:36:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7562.361565 secs 2024-04-26T20:36:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:04 smithi189 ceph-mon[32756]: pgmap v4995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:04 smithi156 ceph-mon[32679]: pgmap v4995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:04 smithi092 ceph-mon[29156]: pgmap v4995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:07 smithi189 ceph-mon[32756]: pgmap v4996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:36:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:07 smithi156 ceph-mon[32679]: pgmap v4996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:36:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:07 smithi092 ceph-mon[29156]: pgmap v4996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:36:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:36:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:36:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:36:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:08 smithi189 ceph-mon[32756]: pgmap v4997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:36:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:08 smithi189 ceph-mon[32756]: pgmap v4998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8264.383687 secs 2024-04-26T20:36:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7567.361682 secs 2024-04-26T20:36:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:08 smithi156 ceph-mon[32679]: pgmap v4997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:36:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:08 smithi156 ceph-mon[32679]: pgmap v4998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8264.383687 secs 2024-04-26T20:36:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7567.361682 secs 2024-04-26T20:36:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:08 smithi092 ceph-mon[29156]: pgmap v4997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:36:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:08 smithi092 ceph-mon[29156]: pgmap v4998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8264.383687 secs 2024-04-26T20:36:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7567.361682 secs 2024-04-26T20:36:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:09 smithi189 ceph-mon[32756]: pgmap v4999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:09 smithi156 ceph-mon[32679]: pgmap v4999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:09 smithi092 ceph-mon[29156]: pgmap v4999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:12 smithi189 ceph-mon[32756]: pgmap v5000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:12 smithi156 ceph-mon[32679]: pgmap v5000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:12 smithi092 ceph-mon[29156]: pgmap v5000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8269.383835 secs 2024-04-26T20:36:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7572.361810 secs 2024-04-26T20:36:13.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8269.383835 secs 2024-04-26T20:36:13.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7572.361810 secs 2024-04-26T20:36:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8269.383835 secs 2024-04-26T20:36:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7572.361810 secs 2024-04-26T20:36:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:14 smithi189 ceph-mon[32756]: pgmap v5001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:14 smithi156 ceph-mon[32679]: pgmap v5001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:14 smithi092 ceph-mon[29156]: pgmap v5001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:36:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:16 smithi189 ceph-mon[32756]: pgmap v5002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:16 smithi156 ceph-mon[32679]: pgmap v5002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:16 smithi092 ceph-mon[29156]: pgmap v5002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:36:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:18 smithi189 ceph-mon[32756]: pgmap v5003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:36:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8274.383959 secs 2024-04-26T20:36:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7577.361955 secs 2024-04-26T20:36:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:18 smithi156 ceph-mon[32679]: pgmap v5003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:36:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8274.383959 secs 2024-04-26T20:36:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7577.361955 secs 2024-04-26T20:36:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:18 smithi092 ceph-mon[29156]: pgmap v5003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:36:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8274.383959 secs 2024-04-26T20:36:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7577.361955 secs 2024-04-26T20:36:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:20 smithi189 ceph-mon[32756]: pgmap v5004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:20 smithi156 ceph-mon[32679]: pgmap v5004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:20 smithi092 ceph-mon[29156]: pgmap v5004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:22 smithi189 ceph-mon[32756]: pgmap v5005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:22 smithi156 ceph-mon[32679]: pgmap v5005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:22 smithi092 ceph-mon[29156]: pgmap v5005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8279.384022 secs 2024-04-26T20:36:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7582.362075 secs 2024-04-26T20:36:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8279.384022 secs 2024-04-26T20:36:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7582.362075 secs 2024-04-26T20:36:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8279.384022 secs 2024-04-26T20:36:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7582.362075 secs 2024-04-26T20:36:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:24 smithi189 ceph-mon[32756]: pgmap v5006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:24 smithi156 ceph-mon[32679]: pgmap v5006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:24 smithi092 ceph-mon[29156]: pgmap v5006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:26 smithi156 ceph-mon[32679]: pgmap v5007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:26 smithi092 ceph-mon[29156]: pgmap v5007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:26 smithi189 ceph-mon[32756]: pgmap v5007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:28 smithi156 ceph-mon[32679]: pgmap v5008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8284.384137 secs 2024-04-26T20:36:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7587.362165 secs 2024-04-26T20:36:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:28 smithi092 ceph-mon[29156]: pgmap v5008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8284.384137 secs 2024-04-26T20:36:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7587.362165 secs 2024-04-26T20:36:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:28 smithi189 ceph-mon[32756]: pgmap v5008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8284.384137 secs 2024-04-26T20:36:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7587.362165 secs 2024-04-26T20:36:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:30 smithi156 ceph-mon[32679]: pgmap v5009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:30 smithi092 ceph-mon[29156]: pgmap v5009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:30 smithi189 ceph-mon[32756]: pgmap v5009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:32 smithi156 ceph-mon[32679]: pgmap v5010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:32 smithi092 ceph-mon[29156]: pgmap v5010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:32 smithi189 ceph-mon[32756]: pgmap v5010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8289.384198 secs 2024-04-26T20:36:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7592.362232 secs 2024-04-26T20:36:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8289.384198 secs 2024-04-26T20:36:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7592.362232 secs 2024-04-26T20:36:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8289.384198 secs 2024-04-26T20:36:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7592.362232 secs 2024-04-26T20:36:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:34 smithi156 ceph-mon[32679]: pgmap v5011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:34 smithi092 ceph-mon[29156]: pgmap v5011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:34 smithi189 ceph-mon[32756]: pgmap v5011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:36 smithi156 ceph-mon[32679]: pgmap v5012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:36 smithi092 ceph-mon[29156]: pgmap v5012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:36:37.109+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:36:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:36:37.109+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:36:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:36:37.109+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:36:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:36:37.109+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 67 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:36:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:36 smithi189 ceph-mon[32756]: pgmap v5012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:38 smithi156 ceph-mon[32679]: pgmap v5013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8294.384319 secs 2024-04-26T20:36:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7597.362375 secs 2024-04-26T20:36:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:38 smithi092 ceph-mon[29156]: pgmap v5013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8294.384319 secs 2024-04-26T20:36:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7597.362375 secs 2024-04-26T20:36:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:38 smithi189 ceph-mon[32756]: pgmap v5013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8294.384319 secs 2024-04-26T20:36:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7597.362375 secs 2024-04-26T20:36:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:40 smithi156 ceph-mon[32679]: pgmap v5014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:40 smithi092 ceph-mon[29156]: pgmap v5014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:40 smithi189 ceph-mon[32756]: pgmap v5014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:42 smithi156 ceph-mon[32679]: pgmap v5015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:42 smithi092 ceph-mon[29156]: pgmap v5015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:42 smithi189 ceph-mon[32756]: pgmap v5015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8299.384439 secs 2024-04-26T20:36:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7602.362498 secs 2024-04-26T20:36:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8299.384439 secs 2024-04-26T20:36:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7602.362498 secs 2024-04-26T20:36:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8299.384439 secs 2024-04-26T20:36:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7602.362498 secs 2024-04-26T20:36:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:44 smithi156 ceph-mon[32679]: pgmap v5016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:44.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:44 smithi092 ceph-mon[29156]: pgmap v5016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:44 smithi189 ceph-mon[32756]: pgmap v5016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:46 smithi092 ceph-mon[29156]: pgmap v5017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:46 smithi189 ceph-mon[32756]: pgmap v5017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:46 smithi156 ceph-mon[32679]: pgmap v5017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:48 smithi092 ceph-mon[29156]: pgmap v5018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8304.384559 secs 2024-04-26T20:36:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7607.362594 secs 2024-04-26T20:36:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:48 smithi189 ceph-mon[32756]: pgmap v5018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8304.384559 secs 2024-04-26T20:36:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7607.362594 secs 2024-04-26T20:36:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:48 smithi156 ceph-mon[32679]: pgmap v5018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8304.384559 secs 2024-04-26T20:36:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7607.362594 secs 2024-04-26T20:36:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:50 smithi092 ceph-mon[29156]: pgmap v5019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:50 smithi189 ceph-mon[32756]: pgmap v5019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:50 smithi156 ceph-mon[32679]: pgmap v5019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:52 smithi092 ceph-mon[29156]: pgmap v5020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:52 smithi189 ceph-mon[32756]: pgmap v5020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:52 smithi156 ceph-mon[32679]: pgmap v5020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8309.384690 secs 2024-04-26T20:36:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7612.362672 secs 2024-04-26T20:36:54.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8309.384690 secs 2024-04-26T20:36:54.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7612.362672 secs 2024-04-26T20:36:54.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8309.384690 secs 2024-04-26T20:36:54.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7612.362672 secs 2024-04-26T20:36:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:54 smithi092 ceph-mon[29156]: pgmap v5021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:54 smithi189 ceph-mon[32756]: pgmap v5021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:54 smithi156 ceph-mon[32679]: pgmap v5021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:56 smithi092 ceph-mon[29156]: pgmap v5022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:56 smithi189 ceph-mon[32756]: pgmap v5022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:56 smithi156 ceph-mon[32679]: pgmap v5022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:36:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:58 smithi092 ceph-mon[29156]: pgmap v5023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8314.384788 secs 2024-04-26T20:36:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:36:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7617.362805 secs 2024-04-26T20:36:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:58 smithi189 ceph-mon[32756]: pgmap v5023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8314.384788 secs 2024-04-26T20:36:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:36:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7617.362805 secs 2024-04-26T20:36:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:58 smithi156 ceph-mon[32679]: pgmap v5023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:36:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8314.384788 secs 2024-04-26T20:36:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:36:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7617.362805 secs 2024-04-26T20:37:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:00 smithi092 ceph-mon[29156]: pgmap v5024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:00 smithi189 ceph-mon[32756]: pgmap v5024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:00 smithi156 ceph-mon[32679]: pgmap v5024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:02 smithi092 ceph-mon[29156]: pgmap v5025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:02 smithi189 ceph-mon[32756]: pgmap v5025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:02 smithi156 ceph-mon[32679]: pgmap v5025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:03 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 8319.384912 secs 2024-04-26T20:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:03 smithi092 ceph-mon[29156]: slow request 5761.641031 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:03 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 7622.362963 secs 2024-04-26T20:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:03 smithi092 ceph-mon[29156]: slow request 2881.106321 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:03 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 8319.384912 secs 2024-04-26T20:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:03 smithi189 ceph-mon[32756]: slow request 5761.641031 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:03 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 7622.362963 secs 2024-04-26T20:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:03 smithi189 ceph-mon[32756]: slow request 2881.106321 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:03 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 8319.384912 secs 2024-04-26T20:37:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:03 smithi156 ceph-mon[32679]: slow request 5761.641031 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:03 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 7622.362963 secs 2024-04-26T20:37:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:03 smithi156 ceph-mon[32679]: slow request 2881.106321 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:37:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:04 smithi092 ceph-mon[29156]: pgmap v5026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:04 smithi189 ceph-mon[32756]: pgmap v5026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:04 smithi156 ceph-mon[32679]: pgmap v5026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:06 smithi092 ceph-mon[29156]: pgmap v5027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:06 smithi189 ceph-mon[32756]: pgmap v5027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:06 smithi156 ceph-mon[32679]: pgmap v5027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: pgmap v5028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8324.384976 secs 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:37:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7627.363076 secs 2024-04-26T20:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: pgmap v5028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8324.384976 secs 2024-04-26T20:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:37:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7627.363076 secs 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: pgmap v5028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8324.384976 secs 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:37:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7627.363076 secs 2024-04-26T20:37:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:09 smithi092 ceph-mon[29156]: pgmap v5029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:37:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:09 smithi092 ceph-mon[29156]: pgmap v5030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:37:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:09 smithi189 ceph-mon[32756]: pgmap v5029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:37:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:09 smithi189 ceph-mon[32756]: pgmap v5030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:37:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:09 smithi156 ceph-mon[32679]: pgmap v5029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:37:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:09 smithi156 ceph-mon[32679]: pgmap v5030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:37:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:11 smithi092 ceph-mon[29156]: pgmap v5031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:11 smithi189 ceph-mon[32756]: pgmap v5031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:11 smithi156 ceph-mon[32679]: pgmap v5031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:13 smithi189 ceph-mon[32756]: pgmap v5032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8329.385097 secs 2024-04-26T20:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7632.363231 secs 2024-04-26T20:37:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:13 smithi156 ceph-mon[32679]: pgmap v5032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:37:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8329.385097 secs 2024-04-26T20:37:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7632.363231 secs 2024-04-26T20:37:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:13 smithi092 ceph-mon[29156]: pgmap v5032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T20:37:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8329.385097 secs 2024-04-26T20:37:14.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7632.363231 secs 2024-04-26T20:37:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:15 smithi189 ceph-mon[32756]: pgmap v5033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:15 smithi156 ceph-mon[32679]: pgmap v5033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:15 smithi092 ceph-mon[29156]: pgmap v5033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:17 smithi189 ceph-mon[32756]: pgmap v5034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:17 smithi156 ceph-mon[32679]: pgmap v5034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:17 smithi092 ceph-mon[29156]: pgmap v5034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:37:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8334.385208 secs 2024-04-26T20:37:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7637.363364 secs 2024-04-26T20:37:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8334.385208 secs 2024-04-26T20:37:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7637.363364 secs 2024-04-26T20:37:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8334.385208 secs 2024-04-26T20:37:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7637.363364 secs 2024-04-26T20:37:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:19 smithi189 ceph-mon[32756]: pgmap v5035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:37:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:19 smithi156 ceph-mon[32679]: pgmap v5035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:37:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:19 smithi092 ceph-mon[29156]: pgmap v5035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:37:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:21 smithi189 ceph-mon[32756]: pgmap v5036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:21 smithi156 ceph-mon[32679]: pgmap v5036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:21 smithi092 ceph-mon[29156]: pgmap v5036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:23 smithi189 ceph-mon[32756]: pgmap v5037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8339.385327 secs 2024-04-26T20:37:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7642.363517 secs 2024-04-26T20:37:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:23 smithi156 ceph-mon[32679]: pgmap v5037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8339.385327 secs 2024-04-26T20:37:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7642.363517 secs 2024-04-26T20:37:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:23 smithi092 ceph-mon[29156]: pgmap v5037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8339.385327 secs 2024-04-26T20:37:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7642.363517 secs 2024-04-26T20:37:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:25 smithi189 ceph-mon[32756]: pgmap v5038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:25 smithi156 ceph-mon[32679]: pgmap v5038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:25 smithi092 ceph-mon[29156]: pgmap v5038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:27 smithi189 ceph-mon[32756]: pgmap v5039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:27 smithi156 ceph-mon[32679]: pgmap v5039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:27 smithi092 ceph-mon[29156]: pgmap v5039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8344.385441 secs 2024-04-26T20:37:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7647.363594 secs 2024-04-26T20:37:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8344.385441 secs 2024-04-26T20:37:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7647.363594 secs 2024-04-26T20:37:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8344.385441 secs 2024-04-26T20:37:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7647.363594 secs 2024-04-26T20:37:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:29 smithi189 ceph-mon[32756]: pgmap v5040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:29 smithi156 ceph-mon[32679]: pgmap v5040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:29 smithi092 ceph-mon[29156]: pgmap v5040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:32.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:31 smithi092 ceph-mon[29156]: pgmap v5041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:31 smithi189 ceph-mon[32756]: pgmap v5041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:31 smithi156 ceph-mon[32679]: pgmap v5041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:33.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:37:33.096+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:37:33.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:37:33.096+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:37:33.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:37:33.096+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:37:33.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:37:33.096+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:37:33.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:37:33.096+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:37:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:33 smithi189 ceph-mon[32756]: pgmap v5042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8349.385576 secs 2024-04-26T20:37:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7652.363686 secs 2024-04-26T20:37:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:33 smithi156 ceph-mon[32679]: pgmap v5042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8349.385576 secs 2024-04-26T20:37:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7652.363686 secs 2024-04-26T20:37:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-mon[29156]: pgmap v5042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8349.385576 secs 2024-04-26T20:37:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7652.363686 secs 2024-04-26T20:37:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:35 smithi189 ceph-mon[32756]: pgmap v5043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:35 smithi156 ceph-mon[32679]: pgmap v5043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:35 smithi092 ceph-mon[29156]: pgmap v5043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:37 smithi189 ceph-mon[32756]: pgmap v5044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:37 smithi156 ceph-mon[32679]: pgmap v5044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:37 smithi092 ceph-mon[29156]: pgmap v5044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8354.385695 secs 2024-04-26T20:37:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7657.363759 secs 2024-04-26T20:37:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8354.385695 secs 2024-04-26T20:37:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7657.363759 secs 2024-04-26T20:37:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8354.385695 secs 2024-04-26T20:37:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7657.363759 secs 2024-04-26T20:37:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:39 smithi189 ceph-mon[32756]: pgmap v5045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:39 smithi156 ceph-mon[32679]: pgmap v5045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:39 smithi092 ceph-mon[29156]: pgmap v5045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:41 smithi189 ceph-mon[32756]: pgmap v5046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:41 smithi156 ceph-mon[32679]: pgmap v5046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:41 smithi092 ceph-mon[29156]: pgmap v5046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:43 smithi189 ceph-mon[32756]: pgmap v5047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8359.385814 secs 2024-04-26T20:37:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7662.363876 secs 2024-04-26T20:37:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:43 smithi156 ceph-mon[32679]: pgmap v5047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8359.385814 secs 2024-04-26T20:37:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7662.363876 secs 2024-04-26T20:37:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:43 smithi092 ceph-mon[29156]: pgmap v5047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8359.385814 secs 2024-04-26T20:37:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7662.363876 secs 2024-04-26T20:37:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:45 smithi189 ceph-mon[32756]: pgmap v5048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:45 smithi156 ceph-mon[32679]: pgmap v5048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:45 smithi092 ceph-mon[29156]: pgmap v5048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:47 smithi189 ceph-mon[32756]: pgmap v5049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:47 smithi156 ceph-mon[32679]: pgmap v5049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:47 smithi092 ceph-mon[29156]: pgmap v5049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8364.385903 secs 2024-04-26T20:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7667.363979 secs 2024-04-26T20:37:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8364.385903 secs 2024-04-26T20:37:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7667.363979 secs 2024-04-26T20:37:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8364.385903 secs 2024-04-26T20:37:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7667.363979 secs 2024-04-26T20:37:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:49 smithi189 ceph-mon[32756]: pgmap v5050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:49 smithi156 ceph-mon[32679]: pgmap v5050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:49 smithi092 ceph-mon[29156]: pgmap v5050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:51 smithi189 ceph-mon[32756]: pgmap v5051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:51 smithi156 ceph-mon[32679]: pgmap v5051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:51 smithi092 ceph-mon[29156]: pgmap v5051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:53 smithi189 ceph-mon[32756]: pgmap v5052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8369.386030 secs 2024-04-26T20:37:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7672.364099 secs 2024-04-26T20:37:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:53 smithi156 ceph-mon[32679]: pgmap v5052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8369.386030 secs 2024-04-26T20:37:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7672.364099 secs 2024-04-26T20:37:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:53 smithi092 ceph-mon[29156]: pgmap v5052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8369.386030 secs 2024-04-26T20:37:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7672.364099 secs 2024-04-26T20:37:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:55 smithi189 ceph-mon[32756]: pgmap v5053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:55 smithi156 ceph-mon[32679]: pgmap v5053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:55 smithi092 ceph-mon[29156]: pgmap v5053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:37:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:57 smithi189 ceph-mon[32756]: pgmap v5054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:57 smithi156 ceph-mon[32679]: pgmap v5054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:57 smithi092 ceph-mon[29156]: pgmap v5054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:37:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8374.386156 secs 2024-04-26T20:37:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7677.364162 secs 2024-04-26T20:37:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8374.386156 secs 2024-04-26T20:37:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7677.364162 secs 2024-04-26T20:37:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8374.386156 secs 2024-04-26T20:37:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7677.364162 secs 2024-04-26T20:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:37:59 smithi189 ceph-mon[32756]: pgmap v5055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:37:59 smithi156 ceph-mon[32679]: pgmap v5055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:37:59 smithi092 ceph-mon[29156]: pgmap v5055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:01 smithi189 ceph-mon[32756]: pgmap v5056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:01 smithi156 ceph-mon[32679]: pgmap v5056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:01 smithi092 ceph-mon[29156]: pgmap v5056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:03 smithi189 ceph-mon[32756]: pgmap v5057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8379.386265 secs 2024-04-26T20:38:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7682.364276 secs 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:03 smithi156 ceph-mon[32679]: pgmap v5057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8379.386265 secs 2024-04-26T20:38:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7682.364276 secs 2024-04-26T20:38:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:03 smithi092 ceph-mon[29156]: pgmap v5057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8379.386265 secs 2024-04-26T20:38:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7682.364276 secs 2024-04-26T20:38:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:04 smithi189 ceph-mon[32756]: pgmap v5058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:04 smithi156 ceph-mon[32679]: pgmap v5058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:04 smithi092 ceph-mon[29156]: pgmap v5058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:07 smithi189 ceph-mon[32756]: pgmap v5059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:07 smithi156 ceph-mon[32679]: pgmap v5059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:07 smithi092 ceph-mon[29156]: pgmap v5059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8384.386391 secs 2024-04-26T20:38:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: pgmap v5060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7687.364373 secs 2024-04-26T20:38:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8384.386391 secs 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: pgmap v5060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7687.364373 secs 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8384.386391 secs 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: pgmap v5060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7687.364373 secs 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:38:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:38:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:10 smithi189 ceph-mon[32756]: pgmap v5061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:38:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:10 smithi189 ceph-mon[32756]: pgmap v5062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:10 smithi156 ceph-mon[32679]: pgmap v5061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:38:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:10 smithi156 ceph-mon[32679]: pgmap v5062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:10 smithi092 ceph-mon[29156]: pgmap v5061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:38:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:10 smithi092 ceph-mon[29156]: pgmap v5062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:12 smithi156 ceph-mon[32679]: pgmap v5063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:12 smithi092 ceph-mon[29156]: pgmap v5063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:12 smithi189 ceph-mon[32756]: pgmap v5063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:14 smithi156 ceph-mon[32679]: pgmap v5064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:38:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8389.386524 secs 2024-04-26T20:38:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7692.364492 secs 2024-04-26T20:38:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:14 smithi092 ceph-mon[29156]: pgmap v5064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:38:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8389.386524 secs 2024-04-26T20:38:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7692.364492 secs 2024-04-26T20:38:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:14 smithi189 ceph-mon[32756]: pgmap v5064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:38:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8389.386524 secs 2024-04-26T20:38:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7692.364492 secs 2024-04-26T20:38:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:16 smithi156 ceph-mon[32679]: pgmap v5065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:16 smithi092 ceph-mon[29156]: pgmap v5065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:16 smithi189 ceph-mon[32756]: pgmap v5065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:18 smithi156 ceph-mon[32679]: pgmap v5066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:18 smithi092 ceph-mon[29156]: pgmap v5066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:18 smithi189 ceph-mon[32756]: pgmap v5066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:38:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8394.386620 secs 2024-04-26T20:38:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7697.364557 secs 2024-04-26T20:38:19.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8394.386620 secs 2024-04-26T20:38:19.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7697.364557 secs 2024-04-26T20:38:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8394.386620 secs 2024-04-26T20:38:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7697.364557 secs 2024-04-26T20:38:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:20 smithi156 ceph-mon[32679]: pgmap v5067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:38:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:20 smithi092 ceph-mon[29156]: pgmap v5067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:38:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:20 smithi189 ceph-mon[32756]: pgmap v5067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:38:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:22 smithi156 ceph-mon[32679]: pgmap v5068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:22 smithi092 ceph-mon[29156]: pgmap v5068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:22 smithi189 ceph-mon[32756]: pgmap v5068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:24 smithi156 ceph-mon[32679]: pgmap v5069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8399.386741 secs 2024-04-26T20:38:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7702.364688 secs 2024-04-26T20:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:24 smithi092 ceph-mon[29156]: pgmap v5069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8399.386741 secs 2024-04-26T20:38:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7702.364688 secs 2024-04-26T20:38:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:24 smithi189 ceph-mon[32756]: pgmap v5069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8399.386741 secs 2024-04-26T20:38:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7702.364688 secs 2024-04-26T20:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:26 smithi156 ceph-mon[32679]: pgmap v5070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:26.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:26 smithi189 ceph-mon[32756]: pgmap v5070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:26 smithi092 ceph-mon[29156]: pgmap v5070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:28 smithi156 ceph-mon[32679]: pgmap v5071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:28 smithi092 ceph-mon[29156]: pgmap v5071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:28 smithi189 ceph-mon[32756]: pgmap v5071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8404.386864 secs 2024-04-26T20:38:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7707.364780 secs 2024-04-26T20:38:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8404.386864 secs 2024-04-26T20:38:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7707.364780 secs 2024-04-26T20:38:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8404.386864 secs 2024-04-26T20:38:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7707.364780 secs 2024-04-26T20:38:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:30 smithi156 ceph-mon[32679]: pgmap v5072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:30 smithi092 ceph-mon[29156]: pgmap v5072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:30 smithi189 ceph-mon[32756]: pgmap v5072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:32 smithi156 ceph-mon[32679]: pgmap v5073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:32 smithi092 ceph-mon[29156]: pgmap v5073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:32 smithi189 ceph-mon[32756]: pgmap v5073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:34 smithi156 ceph-mon[32679]: pgmap v5074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8409.386977 secs 2024-04-26T20:38:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7712.364869 secs 2024-04-26T20:38:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:34 smithi092 ceph-mon[29156]: pgmap v5074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8409.386977 secs 2024-04-26T20:38:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7712.364869 secs 2024-04-26T20:38:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:34 smithi189 ceph-mon[32756]: pgmap v5074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8409.386977 secs 2024-04-26T20:38:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7712.364869 secs 2024-04-26T20:38:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:36 smithi156 ceph-mon[32679]: pgmap v5075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:36 smithi092 ceph-mon[29156]: pgmap v5075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:36 smithi189 ceph-mon[32756]: pgmap v5075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:38 smithi092 ceph-mon[29156]: pgmap v5076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:38 smithi189 ceph-mon[32756]: pgmap v5076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:38.945 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:38 smithi156 ceph-mon[32679]: pgmap v5076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8414.387074 secs 2024-04-26T20:38:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7717.364996 secs 2024-04-26T20:38:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8414.387074 secs 2024-04-26T20:38:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7717.364996 secs 2024-04-26T20:38:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8414.387074 secs 2024-04-26T20:38:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7717.364996 secs 2024-04-26T20:38:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:40 smithi092 ceph-mon[29156]: pgmap v5077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:40 smithi189 ceph-mon[32756]: pgmap v5077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:40 smithi156 ceph-mon[32679]: pgmap v5077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:42 smithi092 ceph-mon[29156]: pgmap v5078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:42 smithi189 ceph-mon[32756]: pgmap v5078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:42 smithi156 ceph-mon[32679]: pgmap v5078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:44 smithi092 ceph-mon[29156]: pgmap v5079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8419.387172 secs 2024-04-26T20:38:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7722.365070 secs 2024-04-26T20:38:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:44 smithi189 ceph-mon[32756]: pgmap v5079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8419.387172 secs 2024-04-26T20:38:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7722.365070 secs 2024-04-26T20:38:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:44 smithi156 ceph-mon[32679]: pgmap v5079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8419.387172 secs 2024-04-26T20:38:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7722.365070 secs 2024-04-26T20:38:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:46 smithi092 ceph-mon[29156]: pgmap v5080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:46 smithi189 ceph-mon[32756]: pgmap v5080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:46 smithi156 ceph-mon[32679]: pgmap v5080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:48 smithi092 ceph-mon[29156]: pgmap v5081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:48 smithi189 ceph-mon[32756]: pgmap v5081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:48 smithi156 ceph-mon[32679]: pgmap v5081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8424.387250 secs 2024-04-26T20:38:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7727.365144 secs 2024-04-26T20:38:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8424.387250 secs 2024-04-26T20:38:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7727.365144 secs 2024-04-26T20:38:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8424.387250 secs 2024-04-26T20:38:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7727.365144 secs 2024-04-26T20:38:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:50 smithi092 ceph-mon[29156]: pgmap v5082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:50 smithi189 ceph-mon[32756]: pgmap v5082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:50 smithi156 ceph-mon[32679]: pgmap v5082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:38:52.127+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:38:52.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:38:52.127+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:38:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:38:52.127+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:38:52.128 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:38:52.127+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 68 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:38:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:52 smithi092 ceph-mon[29156]: pgmap v5083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:52 smithi189 ceph-mon[32756]: pgmap v5083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:52 smithi156 ceph-mon[32679]: pgmap v5083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:54 smithi092 ceph-mon[29156]: pgmap v5084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8429.387367 secs 2024-04-26T20:38:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7732.365225 secs 2024-04-26T20:38:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:54 smithi189 ceph-mon[32756]: pgmap v5084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8429.387367 secs 2024-04-26T20:38:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7732.365225 secs 2024-04-26T20:38:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:54 smithi156 ceph-mon[32679]: pgmap v5084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8429.387367 secs 2024-04-26T20:38:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7732.365225 secs 2024-04-26T20:38:56.737 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:56 smithi156 ceph-mon[32679]: pgmap v5085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:56 smithi092 ceph-mon[29156]: pgmap v5085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:56 smithi189 ceph-mon[32756]: pgmap v5085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:38:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:58 smithi092 ceph-mon[29156]: pgmap v5086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:58 smithi189 ceph-mon[32756]: pgmap v5086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:58 smithi156 ceph-mon[32679]: pgmap v5086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:38:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8434.387480 secs 2024-04-26T20:38:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:38:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7737.365344 secs 2024-04-26T20:38:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8434.387480 secs 2024-04-26T20:38:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:38:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7737.365344 secs 2024-04-26T20:38:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8434.387480 secs 2024-04-26T20:38:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:38:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7737.365344 secs 2024-04-26T20:39:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:00 smithi092 ceph-mon[29156]: pgmap v5087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:00 smithi189 ceph-mon[32756]: pgmap v5087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:00 smithi156 ceph-mon[32679]: pgmap v5087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:02 smithi092 ceph-mon[29156]: pgmap v5088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:02 smithi189 ceph-mon[32756]: pgmap v5088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:02 smithi156 ceph-mon[32679]: pgmap v5088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:04 smithi092 ceph-mon[29156]: pgmap v5089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8439.387595 secs 2024-04-26T20:39:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:04 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 7742.365458 secs 2024-04-26T20:39:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:04 smithi092 ceph-mon[29156]: slow request 720.578123 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:04 smithi189 ceph-mon[32756]: pgmap v5089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8439.387595 secs 2024-04-26T20:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:04 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 7742.365458 secs 2024-04-26T20:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:04 smithi189 ceph-mon[32756]: slow request 720.578123 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:39:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:04 smithi156 ceph-mon[32679]: pgmap v5089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8439.387595 secs 2024-04-26T20:39:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:04 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 7742.365458 secs 2024-04-26T20:39:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:04 smithi156 ceph-mon[32679]: slow request 720.578123 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:39:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:06 smithi092 ceph-mon[29156]: pgmap v5090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:06 smithi189 ceph-mon[32756]: pgmap v5090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:06 smithi156 ceph-mon[32679]: pgmap v5090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:08 smithi189 ceph-mon[32756]: pgmap v5091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:08 smithi156 ceph-mon[32679]: pgmap v5091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:08 smithi092 ceph-mon[29156]: pgmap v5091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8444.387740 secs 2024-04-26T20:39:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7747.365526 secs 2024-04-26T20:39:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8444.387740 secs 2024-04-26T20:39:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7747.365526 secs 2024-04-26T20:39:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8444.387740 secs 2024-04-26T20:39:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7747.365526 secs 2024-04-26T20:39:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:10 smithi189 ceph-mon[32756]: pgmap v5092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:39:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:10 smithi156 ceph-mon[32679]: pgmap v5092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:39:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:10 smithi092 ceph-mon[29156]: pgmap v5092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:39:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:39:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:39:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:11 smithi189 ceph-mon[32756]: pgmap v5093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:39:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:11 smithi189 ceph-mon[32756]: pgmap v5094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:11 smithi156 ceph-mon[32679]: pgmap v5093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:39:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:11 smithi156 ceph-mon[32679]: pgmap v5094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:11 smithi092 ceph-mon[29156]: pgmap v5093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:39:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:11 smithi092 ceph-mon[29156]: pgmap v5094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:13 smithi189 ceph-mon[32756]: pgmap v5095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8449.387877 secs 2024-04-26T20:39:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:13 smithi156 ceph-mon[32679]: pgmap v5095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8449.387877 secs 2024-04-26T20:39:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:13 smithi092 ceph-mon[29156]: pgmap v5095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8449.387877 secs 2024-04-26T20:39:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7752.365588 secs 2024-04-26T20:39:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7752.365588 secs 2024-04-26T20:39:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7752.365588 secs 2024-04-26T20:39:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:15 smithi189 ceph-mon[32756]: pgmap v5096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:15 smithi156 ceph-mon[32679]: pgmap v5096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:15 smithi092 ceph-mon[29156]: pgmap v5096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:17 smithi189 ceph-mon[32756]: pgmap v5097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:17 smithi156 ceph-mon[32679]: pgmap v5097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:17 smithi092 ceph-mon[29156]: pgmap v5097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:39:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8454.387940 secs 2024-04-26T20:39:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8454.387940 secs 2024-04-26T20:39:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8454.387940 secs 2024-04-26T20:39:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:19 smithi189 ceph-mon[32756]: pgmap v5098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:39:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7757.365719 secs 2024-04-26T20:39:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:19 smithi156 ceph-mon[32679]: pgmap v5098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:39:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7757.365719 secs 2024-04-26T20:39:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:19 smithi092 ceph-mon[29156]: pgmap v5098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:39:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7757.365719 secs 2024-04-26T20:39:21.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:21 smithi092 ceph-mon[29156]: pgmap v5099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:39:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:21 smithi189 ceph-mon[32756]: pgmap v5099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:39:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:21 smithi156 ceph-mon[32679]: pgmap v5099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:39:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:23 smithi189 ceph-mon[32756]: pgmap v5100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8459.388022 secs 2024-04-26T20:39:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:23 smithi156 ceph-mon[32679]: pgmap v5100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8459.388022 secs 2024-04-26T20:39:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:23 smithi092 ceph-mon[29156]: pgmap v5100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8459.388022 secs 2024-04-26T20:39:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7762.365799 secs 2024-04-26T20:39:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7762.365799 secs 2024-04-26T20:39:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7762.365799 secs 2024-04-26T20:39:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:25 smithi189 ceph-mon[32756]: pgmap v5101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:25 smithi156 ceph-mon[32679]: pgmap v5101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:25 smithi092 ceph-mon[29156]: pgmap v5101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:27 smithi189 ceph-mon[32756]: pgmap v5102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:27 smithi156 ceph-mon[32679]: pgmap v5102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:27 smithi092 ceph-mon[29156]: pgmap v5102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8464.388139 secs 2024-04-26T20:39:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8464.388139 secs 2024-04-26T20:39:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8464.388139 secs 2024-04-26T20:39:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:29 smithi189 ceph-mon[32756]: pgmap v5103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7767.365862 secs 2024-04-26T20:39:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:29 smithi156 ceph-mon[32679]: pgmap v5103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7767.365862 secs 2024-04-26T20:39:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:29 smithi092 ceph-mon[29156]: pgmap v5103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7767.365862 secs 2024-04-26T20:39:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:31 smithi189 ceph-mon[32756]: pgmap v5104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:31 smithi156 ceph-mon[32679]: pgmap v5104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:31 smithi092 ceph-mon[29156]: pgmap v5104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:33 smithi189 ceph-mon[32756]: pgmap v5105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8469.388231 secs 2024-04-26T20:39:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:33 smithi156 ceph-mon[32679]: pgmap v5105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8469.388231 secs 2024-04-26T20:39:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:33 smithi092 ceph-mon[29156]: pgmap v5105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8469.388231 secs 2024-04-26T20:39:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7772.365926 secs 2024-04-26T20:39:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7772.365926 secs 2024-04-26T20:39:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7772.365926 secs 2024-04-26T20:39:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:35 smithi189 ceph-mon[32756]: pgmap v5106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:35 smithi156 ceph-mon[32679]: pgmap v5106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:35 smithi092 ceph-mon[29156]: pgmap v5106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:39:37.133+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:39:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:39:37.133+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:39:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:39:37.133+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:39:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:39:37.133+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 69 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:39:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:37 smithi189 ceph-mon[32756]: pgmap v5107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:37 smithi156 ceph-mon[32679]: pgmap v5107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:37 smithi092 ceph-mon[29156]: pgmap v5107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8474.388295 secs 2024-04-26T20:39:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7777.366021 secs 2024-04-26T20:39:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8474.388295 secs 2024-04-26T20:39:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7777.366021 secs 2024-04-26T20:39:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8474.388295 secs 2024-04-26T20:39:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7777.366021 secs 2024-04-26T20:39:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:39 smithi189 ceph-mon[32756]: pgmap v5108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:39 smithi156 ceph-mon[32679]: pgmap v5108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:39 smithi092 ceph-mon[29156]: pgmap v5108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:41 smithi189 ceph-mon[32756]: pgmap v5109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:41 smithi156 ceph-mon[32679]: pgmap v5109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:41 smithi092 ceph-mon[29156]: pgmap v5109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:43 smithi189 ceph-mon[32756]: pgmap v5110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8479.388420 secs 2024-04-26T20:39:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7782.366111 secs 2024-04-26T20:39:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:43 smithi156 ceph-mon[32679]: pgmap v5110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8479.388420 secs 2024-04-26T20:39:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7782.366111 secs 2024-04-26T20:39:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:43 smithi092 ceph-mon[29156]: pgmap v5110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8479.388420 secs 2024-04-26T20:39:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7782.366111 secs 2024-04-26T20:39:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:45 smithi189 ceph-mon[32756]: pgmap v5111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:45 smithi156 ceph-mon[32679]: pgmap v5111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:45 smithi092 ceph-mon[29156]: pgmap v5111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:47 smithi189 ceph-mon[32756]: pgmap v5112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:47 smithi156 ceph-mon[32679]: pgmap v5112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:47 smithi092 ceph-mon[29156]: pgmap v5112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8484.388555 secs 2024-04-26T20:39:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7787.366227 secs 2024-04-26T20:39:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8484.388555 secs 2024-04-26T20:39:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7787.366227 secs 2024-04-26T20:39:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8484.388555 secs 2024-04-26T20:39:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7787.366227 secs 2024-04-26T20:39:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:49 smithi189 ceph-mon[32756]: pgmap v5113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:49 smithi156 ceph-mon[32679]: pgmap v5113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:49 smithi092 ceph-mon[29156]: pgmap v5113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:51.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:51 smithi092 ceph-mon[29156]: pgmap v5114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:51 smithi189 ceph-mon[32756]: pgmap v5114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:51 smithi156 ceph-mon[32679]: pgmap v5114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:53 smithi189 ceph-mon[32756]: pgmap v5115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8489.388620 secs 2024-04-26T20:39:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7792.366292 secs 2024-04-26T20:39:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:53 smithi156 ceph-mon[32679]: pgmap v5115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8489.388620 secs 2024-04-26T20:39:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7792.366292 secs 2024-04-26T20:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:53 smithi092 ceph-mon[29156]: pgmap v5115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8489.388620 secs 2024-04-26T20:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7792.366292 secs 2024-04-26T20:39:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:55 smithi189 ceph-mon[32756]: pgmap v5116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:55 smithi156 ceph-mon[32679]: pgmap v5116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:55 smithi092 ceph-mon[29156]: pgmap v5116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:39:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:57 smithi189 ceph-mon[32756]: pgmap v5117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:57 smithi156 ceph-mon[32679]: pgmap v5117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:57 smithi092 ceph-mon[29156]: pgmap v5117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8494.388728 secs 2024-04-26T20:39:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7797.366348 secs 2024-04-26T20:39:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8494.388728 secs 2024-04-26T20:39:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7797.366348 secs 2024-04-26T20:39:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8494.388728 secs 2024-04-26T20:39:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7797.366348 secs 2024-04-26T20:39:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:39:59 smithi189 ceph-mon[32756]: pgmap v5118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:39:59 smithi156 ceph-mon[32679]: pgmap v5118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:39:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:39:59 smithi092 ceph-mon[29156]: pgmap v5118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:40:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:40:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:40:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:01 smithi189 ceph-mon[32756]: pgmap v5119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:01 smithi156 ceph-mon[32679]: pgmap v5119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:01 smithi092 ceph-mon[29156]: pgmap v5119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:03 smithi156 ceph-mon[32679]: pgmap v5120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8499.388861 secs 2024-04-26T20:40:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7802.366460 secs 2024-04-26T20:40:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:03 smithi092 ceph-mon[29156]: pgmap v5120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8499.388861 secs 2024-04-26T20:40:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7802.366460 secs 2024-04-26T20:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:03 smithi189 ceph-mon[32756]: pgmap v5120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8499.388861 secs 2024-04-26T20:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7802.366460 secs 2024-04-26T20:40:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:05 smithi156 ceph-mon[32679]: pgmap v5121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:05.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:05 smithi092 ceph-mon[29156]: pgmap v5121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:05 smithi189 ceph-mon[32756]: pgmap v5121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:07 smithi156 ceph-mon[32679]: pgmap v5122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:07 smithi092 ceph-mon[29156]: pgmap v5122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:07 smithi189 ceph-mon[32756]: pgmap v5122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8504.388991 secs 2024-04-26T20:40:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7807.366573 secs 2024-04-26T20:40:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8504.388991 secs 2024-04-26T20:40:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7807.366573 secs 2024-04-26T20:40:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8504.388991 secs 2024-04-26T20:40:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7807.366573 secs 2024-04-26T20:40:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:09 smithi156 ceph-mon[32679]: pgmap v5123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:09 smithi092 ceph-mon[29156]: pgmap v5123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:09 smithi189 ceph-mon[32756]: pgmap v5123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:40:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:40:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:40:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:40:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:40:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:40:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:11 smithi156 ceph-mon[32679]: pgmap v5124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:11 smithi156 ceph-mon[32679]: pgmap v5125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:40:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:11 smithi156 ceph-mon[32679]: pgmap v5126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:11 smithi092 ceph-mon[29156]: pgmap v5124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:11 smithi092 ceph-mon[29156]: pgmap v5125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:40:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:11 smithi092 ceph-mon[29156]: pgmap v5126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:11 smithi189 ceph-mon[32756]: pgmap v5124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:11 smithi189 ceph-mon[32756]: pgmap v5125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:40:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:11 smithi189 ceph-mon[32756]: pgmap v5126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:13 smithi156 ceph-mon[32679]: pgmap v5127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:40:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8509.389113 secs 2024-04-26T20:40:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7812.366697 secs 2024-04-26T20:40:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:13 smithi092 ceph-mon[29156]: pgmap v5127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:40:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8509.389113 secs 2024-04-26T20:40:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7812.366697 secs 2024-04-26T20:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:13 smithi189 ceph-mon[32756]: pgmap v5127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8509.389113 secs 2024-04-26T20:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7812.366697 secs 2024-04-26T20:40:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:15 smithi156 ceph-mon[32679]: pgmap v5128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:15 smithi092 ceph-mon[29156]: pgmap v5128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:15 smithi189 ceph-mon[32756]: pgmap v5128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:17 smithi156 ceph-mon[32679]: pgmap v5129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:17 smithi092 ceph-mon[29156]: pgmap v5129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:17 smithi189 ceph-mon[32756]: pgmap v5129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8514.389222 secs 2024-04-26T20:40:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7817.366834 secs 2024-04-26T20:40:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8514.389222 secs 2024-04-26T20:40:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7817.366834 secs 2024-04-26T20:40:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8514.389222 secs 2024-04-26T20:40:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7817.366834 secs 2024-04-26T20:40:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:19 smithi156 ceph-mon[32679]: pgmap v5130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:19 smithi092 ceph-mon[29156]: pgmap v5130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:19 smithi189 ceph-mon[32756]: pgmap v5130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:40:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:21 smithi156 ceph-mon[32679]: pgmap v5131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:40:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:21 smithi092 ceph-mon[29156]: pgmap v5131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:40:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:21 smithi189 ceph-mon[32756]: pgmap v5131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:40:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:23 smithi156 ceph-mon[32679]: pgmap v5132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8519.389363 secs 2024-04-26T20:40:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7822.366970 secs 2024-04-26T20:40:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:23 smithi092 ceph-mon[29156]: pgmap v5132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8519.389363 secs 2024-04-26T20:40:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7822.366970 secs 2024-04-26T20:40:24.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:23 smithi189 ceph-mon[32756]: pgmap v5132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:24.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8519.389363 secs 2024-04-26T20:40:24.104 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7822.366970 secs 2024-04-26T20:40:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:25 smithi092 ceph-mon[29156]: pgmap v5133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:25 smithi189 ceph-mon[32756]: pgmap v5133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:25 smithi156 ceph-mon[32679]: pgmap v5133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:27.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:27 smithi189 ceph-mon[32756]: pgmap v5134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:27.989 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:27 smithi156 ceph-mon[32679]: pgmap v5134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:27 smithi092 ceph-mon[29156]: pgmap v5134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8524.389449 secs 2024-04-26T20:40:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7827.367135 secs 2024-04-26T20:40:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8524.389449 secs 2024-04-26T20:40:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7827.367135 secs 2024-04-26T20:40:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8524.389449 secs 2024-04-26T20:40:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7827.367135 secs 2024-04-26T20:40:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:29 smithi092 ceph-mon[29156]: pgmap v5135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:29 smithi189 ceph-mon[32756]: pgmap v5135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:29 smithi156 ceph-mon[32679]: pgmap v5135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:31 smithi092 ceph-mon[29156]: pgmap v5136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:31 smithi189 ceph-mon[32756]: pgmap v5136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:31 smithi156 ceph-mon[32679]: pgmap v5136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:33 smithi092 ceph-mon[29156]: pgmap v5137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8529.389564 secs 2024-04-26T20:40:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7832.367263 secs 2024-04-26T20:40:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:33 smithi189 ceph-mon[32756]: pgmap v5137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8529.389564 secs 2024-04-26T20:40:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7832.367263 secs 2024-04-26T20:40:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:33 smithi156 ceph-mon[32679]: pgmap v5137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8529.389564 secs 2024-04-26T20:40:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7832.367263 secs 2024-04-26T20:40:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:35 smithi092 ceph-mon[29156]: pgmap v5138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:35 smithi189 ceph-mon[32756]: pgmap v5138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:35 smithi156 ceph-mon[32679]: pgmap v5138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:37 smithi092 ceph-mon[29156]: pgmap v5139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:37 smithi189 ceph-mon[32756]: pgmap v5139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:37 smithi156 ceph-mon[32679]: pgmap v5139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:38.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8534.389645 secs 2024-04-26T20:40:38.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7837.367307 secs 2024-04-26T20:40:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8534.389645 secs 2024-04-26T20:40:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7837.367307 secs 2024-04-26T20:40:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8534.389645 secs 2024-04-26T20:40:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7837.367307 secs 2024-04-26T20:40:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:39 smithi092 ceph-mon[29156]: pgmap v5140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:39 smithi189 ceph-mon[32756]: pgmap v5140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:39 smithi156 ceph-mon[32679]: pgmap v5140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:40:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:41 smithi092 ceph-mon[29156]: pgmap v5141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:41 smithi189 ceph-mon[32756]: pgmap v5141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:41 smithi156 ceph-mon[32679]: pgmap v5141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:43 smithi092 ceph-mon[29156]: pgmap v5142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8539.389741 secs 2024-04-26T20:40:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7842.367418 secs 2024-04-26T20:40:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:43 smithi189 ceph-mon[32756]: pgmap v5142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8539.389741 secs 2024-04-26T20:40:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7842.367418 secs 2024-04-26T20:40:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:43 smithi156 ceph-mon[32679]: pgmap v5142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8539.389741 secs 2024-04-26T20:40:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7842.367418 secs 2024-04-26T20:40:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:45 smithi092 ceph-mon[29156]: pgmap v5143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:45 smithi189 ceph-mon[32756]: pgmap v5143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:45 smithi156 ceph-mon[32679]: pgmap v5143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:47 smithi092 ceph-mon[29156]: pgmap v5144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:47 smithi189 ceph-mon[32756]: pgmap v5144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:47 smithi156 ceph-mon[32679]: pgmap v5144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8544.389902 secs 2024-04-26T20:40:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7847.367480 secs 2024-04-26T20:40:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8544.389902 secs 2024-04-26T20:40:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7847.367480 secs 2024-04-26T20:40:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8544.389902 secs 2024-04-26T20:40:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7847.367480 secs 2024-04-26T20:40:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:49 smithi092 ceph-mon[29156]: pgmap v5145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:49 smithi189 ceph-mon[32756]: pgmap v5145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:49 smithi156 ceph-mon[32679]: pgmap v5145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:51 smithi189 ceph-mon[32756]: pgmap v5146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:51 smithi156 ceph-mon[32679]: pgmap v5146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:51 smithi092 ceph-mon[29156]: pgmap v5146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:53 smithi189 ceph-mon[32756]: pgmap v5147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8549.390013 secs 2024-04-26T20:40:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7852.367584 secs 2024-04-26T20:40:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:53 smithi156 ceph-mon[32679]: pgmap v5147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8549.390013 secs 2024-04-26T20:40:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7852.367584 secs 2024-04-26T20:40:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:53 smithi092 ceph-mon[29156]: pgmap v5147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:40:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8549.390013 secs 2024-04-26T20:40:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7852.367584 secs 2024-04-26T20:40:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:55 smithi189 ceph-mon[32756]: pgmap v5148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:55 smithi156 ceph-mon[32679]: pgmap v5148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:55 smithi092 ceph-mon[29156]: pgmap v5148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:40:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:57 smithi189 ceph-mon[32756]: pgmap v5149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:57 smithi156 ceph-mon[32679]: pgmap v5149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:57 smithi092 ceph-mon[29156]: pgmap v5149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:40:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8554.390078 secs 2024-04-26T20:40:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7857.367703 secs 2024-04-26T20:40:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8554.390078 secs 2024-04-26T20:40:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7857.367703 secs 2024-04-26T20:40:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8554.390078 secs 2024-04-26T20:40:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7857.367703 secs 2024-04-26T20:41:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:40:59 smithi189 ceph-mon[32756]: pgmap v5150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:40:59 smithi156 ceph-mon[32679]: pgmap v5150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:40:59 smithi092 ceph-mon[29156]: pgmap v5150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:01 smithi189 ceph-mon[32756]: pgmap v5151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:01 smithi156 ceph-mon[32679]: pgmap v5151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:01 smithi092 ceph-mon[29156]: pgmap v5151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:04.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:03 smithi092 ceph-mon[29156]: pgmap v5152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:04.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8559.390196 secs 2024-04-26T20:41:04.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7862.367838 secs 2024-04-26T20:41:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:03 smithi189 ceph-mon[32756]: pgmap v5152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8559.390196 secs 2024-04-26T20:41:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7862.367838 secs 2024-04-26T20:41:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:03 smithi156 ceph-mon[32679]: pgmap v5152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8559.390196 secs 2024-04-26T20:41:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7862.367838 secs 2024-04-26T20:41:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:05 smithi189 ceph-mon[32756]: pgmap v5153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:05 smithi156 ceph-mon[32679]: pgmap v5153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:05 smithi092 ceph-mon[29156]: pgmap v5153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:07 smithi189 ceph-mon[32756]: pgmap v5154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:07 smithi156 ceph-mon[32679]: pgmap v5154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:07 smithi092 ceph-mon[29156]: pgmap v5154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8564.390329 secs 2024-04-26T20:41:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7867.367937 secs 2024-04-26T20:41:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8564.390329 secs 2024-04-26T20:41:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7867.367937 secs 2024-04-26T20:41:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8564.390329 secs 2024-04-26T20:41:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7867.367937 secs 2024-04-26T20:41:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:09 smithi189 ceph-mon[32756]: pgmap v5155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:09 smithi156 ceph-mon[32679]: pgmap v5155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:09 smithi092 ceph-mon[29156]: pgmap v5155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:41:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:11 smithi189 ceph-mon[32756]: pgmap v5156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:41:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:41:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:41:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:11 smithi156 ceph-mon[32679]: pgmap v5156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:41:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:41:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:41:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:11 smithi092 ceph-mon[29156]: pgmap v5156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:41:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:41:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:41:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:12 smithi189 ceph-mon[32756]: pgmap v5157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:41:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:12 smithi189 ceph-mon[32756]: pgmap v5158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:12 smithi156 ceph-mon[32679]: pgmap v5157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:41:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:12 smithi156 ceph-mon[32679]: pgmap v5158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:12 smithi092 ceph-mon[29156]: pgmap v5157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:41:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:12 smithi092 ceph-mon[29156]: pgmap v5158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8569.390437 secs 2024-04-26T20:41:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7872.368055 secs 2024-04-26T20:41:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8569.390437 secs 2024-04-26T20:41:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7872.368055 secs 2024-04-26T20:41:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8569.390437 secs 2024-04-26T20:41:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7872.368055 secs 2024-04-26T20:41:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:14 smithi189 ceph-mon[32756]: pgmap v5159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:14 smithi156 ceph-mon[32679]: pgmap v5159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:14 smithi092 ceph-mon[29156]: pgmap v5159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:16 smithi189 ceph-mon[32756]: pgmap v5160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:16 smithi156 ceph-mon[32679]: pgmap v5160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:16 smithi092 ceph-mon[29156]: pgmap v5160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:18 smithi189 ceph-mon[32756]: pgmap v5161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8574.390584 secs 2024-04-26T20:41:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7877.368115 secs 2024-04-26T20:41:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:18 smithi156 ceph-mon[32679]: pgmap v5161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8574.390584 secs 2024-04-26T20:41:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7877.368115 secs 2024-04-26T20:41:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:18 smithi092 ceph-mon[29156]: pgmap v5161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:41:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8574.390584 secs 2024-04-26T20:41:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7877.368115 secs 2024-04-26T20:41:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:20 smithi189 ceph-mon[32756]: pgmap v5162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:20 smithi156 ceph-mon[32679]: pgmap v5162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:20 smithi092 ceph-mon[29156]: pgmap v5162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:41:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:22 smithi189 ceph-mon[32756]: pgmap v5163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:41:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:22 smithi156 ceph-mon[32679]: pgmap v5163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:41:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:22 smithi092 ceph-mon[29156]: pgmap v5163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:41:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8579.390675 secs 2024-04-26T20:41:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7882.368204 secs 2024-04-26T20:41:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8579.390675 secs 2024-04-26T20:41:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7882.368204 secs 2024-04-26T20:41:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8579.390675 secs 2024-04-26T20:41:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7882.368204 secs 2024-04-26T20:41:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:24 smithi189 ceph-mon[32756]: pgmap v5164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:24 smithi156 ceph-mon[32679]: pgmap v5164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:24 smithi092 ceph-mon[29156]: pgmap v5164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:26 smithi189 ceph-mon[32756]: pgmap v5165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:26 smithi156 ceph-mon[32679]: pgmap v5165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:26 smithi092 ceph-mon[29156]: pgmap v5165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:28 smithi189 ceph-mon[32756]: pgmap v5166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8584.390759 secs 2024-04-26T20:41:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7887.368348 secs 2024-04-26T20:41:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:28 smithi156 ceph-mon[32679]: pgmap v5166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8584.390759 secs 2024-04-26T20:41:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7887.368348 secs 2024-04-26T20:41:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:28 smithi092 ceph-mon[29156]: pgmap v5166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8584.390759 secs 2024-04-26T20:41:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7887.368348 secs 2024-04-26T20:41:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:30 smithi189 ceph-mon[32756]: pgmap v5167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:30 smithi156 ceph-mon[32679]: pgmap v5167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:30 smithi092 ceph-mon[29156]: pgmap v5167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:32 smithi189 ceph-mon[32756]: pgmap v5168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:32 smithi156 ceph-mon[32679]: pgmap v5168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:32 smithi092 ceph-mon[29156]: pgmap v5168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8589.390886 secs 2024-04-26T20:41:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7892.368427 secs 2024-04-26T20:41:34.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8589.390886 secs 2024-04-26T20:41:34.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7892.368427 secs 2024-04-26T20:41:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8589.390886 secs 2024-04-26T20:41:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7892.368427 secs 2024-04-26T20:41:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:34 smithi189 ceph-mon[32756]: pgmap v5169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:34 smithi156 ceph-mon[32679]: pgmap v5169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:34 smithi092 ceph-mon[29156]: pgmap v5169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:36 smithi189 ceph-mon[32756]: pgmap v5170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:36 smithi156 ceph-mon[32679]: pgmap v5170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:36 smithi092 ceph-mon[29156]: pgmap v5170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:38 smithi189 ceph-mon[32756]: pgmap v5171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8594.390951 secs 2024-04-26T20:41:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7897.368511 secs 2024-04-26T20:41:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:38 smithi156 ceph-mon[32679]: pgmap v5171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8594.390951 secs 2024-04-26T20:41:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7897.368511 secs 2024-04-26T20:41:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:38 smithi092 ceph-mon[29156]: pgmap v5171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8594.390951 secs 2024-04-26T20:41:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7897.368511 secs 2024-04-26T20:41:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:40 smithi189 ceph-mon[32756]: pgmap v5172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:40 smithi156 ceph-mon[32679]: pgmap v5172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:40 smithi092 ceph-mon[29156]: pgmap v5172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:42 smithi189 ceph-mon[32756]: pgmap v5173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:42 smithi156 ceph-mon[32679]: pgmap v5173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:42 smithi092 ceph-mon[29156]: pgmap v5173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8599.391063 secs 2024-04-26T20:41:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7902.368599 secs 2024-04-26T20:41:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8599.391063 secs 2024-04-26T20:41:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7902.368599 secs 2024-04-26T20:41:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8599.391063 secs 2024-04-26T20:41:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7902.368599 secs 2024-04-26T20:41:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:44 smithi189 ceph-mon[32756]: pgmap v5174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:44 smithi156 ceph-mon[32679]: pgmap v5174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:44 smithi092 ceph-mon[29156]: pgmap v5174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:46 smithi189 ceph-mon[32756]: pgmap v5175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:46 smithi156 ceph-mon[32679]: pgmap v5175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:46 smithi092 ceph-mon[29156]: pgmap v5175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:49.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:48 smithi189 ceph-mon[32756]: pgmap v5176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:49.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8604.391123 secs 2024-04-26T20:41:49.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7907.368669 secs 2024-04-26T20:41:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:48 smithi156 ceph-mon[32679]: pgmap v5176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8604.391123 secs 2024-04-26T20:41:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7907.368669 secs 2024-04-26T20:41:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:48 smithi092 ceph-mon[29156]: pgmap v5176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8604.391123 secs 2024-04-26T20:41:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7907.368669 secs 2024-04-26T20:41:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:50 smithi189 ceph-mon[32756]: pgmap v5177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:50 smithi156 ceph-mon[32679]: pgmap v5177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:50 smithi092 ceph-mon[29156]: pgmap v5177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:52 smithi189 ceph-mon[32756]: pgmap v5178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:52 smithi156 ceph-mon[32679]: pgmap v5178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:52 smithi092 ceph-mon[29156]: pgmap v5178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8609.391222 secs 2024-04-26T20:41:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7912.368785 secs 2024-04-26T20:41:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8609.391222 secs 2024-04-26T20:41:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7912.368785 secs 2024-04-26T20:41:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8609.391222 secs 2024-04-26T20:41:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7912.368785 secs 2024-04-26T20:41:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:54 smithi189 ceph-mon[32756]: pgmap v5179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:54 smithi156 ceph-mon[32679]: pgmap v5179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:54 smithi092 ceph-mon[29156]: pgmap v5179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:55 smithi156 ceph-mon[32679]: pgmap v5180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:55 smithi092 ceph-mon[29156]: pgmap v5180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:55 smithi189 ceph-mon[32756]: pgmap v5180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:41:58.888 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:58 smithi156 ceph-mon[32679]: pgmap v5181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:58 smithi189 ceph-mon[32756]: pgmap v5181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:58 smithi092 ceph-mon[29156]: pgmap v5181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:41:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8614.391339 secs 2024-04-26T20:41:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:41:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7917.368860 secs 2024-04-26T20:41:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8614.391339 secs 2024-04-26T20:41:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:41:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7917.368860 secs 2024-04-26T20:41:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8614.391339 secs 2024-04-26T20:41:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:41:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7917.368860 secs 2024-04-26T20:42:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:00 smithi189 ceph-mon[32756]: pgmap v5182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:00 smithi156 ceph-mon[32679]: pgmap v5182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:00 smithi092 ceph-mon[29156]: pgmap v5182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:02 smithi189 ceph-mon[32756]: pgmap v5183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:02 smithi156 ceph-mon[32679]: pgmap v5183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:02 smithi092 ceph-mon[29156]: pgmap v5183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:04.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8619.391418 secs 2024-04-26T20:42:04.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:04 smithi092 ceph-mon[29156]: pgmap v5184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:04.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7922.368923 secs 2024-04-26T20:42:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8619.391418 secs 2024-04-26T20:42:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:04 smithi189 ceph-mon[32756]: pgmap v5184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7922.368923 secs 2024-04-26T20:42:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8619.391418 secs 2024-04-26T20:42:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:04 smithi156 ceph-mon[32679]: pgmap v5184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7922.368923 secs 2024-04-26T20:42:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:06 smithi189 ceph-mon[32756]: pgmap v5185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:06 smithi156 ceph-mon[32679]: pgmap v5185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:06 smithi092 ceph-mon[29156]: pgmap v5185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:08 smithi189 ceph-mon[32756]: pgmap v5186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:08 smithi156 ceph-mon[32679]: pgmap v5186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:08 smithi092 ceph-mon[29156]: pgmap v5186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8624.391535 secs 2024-04-26T20:42:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7927.368988 secs 2024-04-26T20:42:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8624.391535 secs 2024-04-26T20:42:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7927.368988 secs 2024-04-26T20:42:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8624.391535 secs 2024-04-26T20:42:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7927.368988 secs 2024-04-26T20:42:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:10 smithi189 ceph-mon[32756]: pgmap v5187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:10 smithi156 ceph-mon[32679]: pgmap v5187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:10 smithi092 ceph-mon[29156]: pgmap v5187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:12 smithi189 ceph-mon[32756]: pgmap v5188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:42:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:42:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:12 smithi156 ceph-mon[32679]: pgmap v5188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:42:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:42:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:12 smithi092 ceph-mon[29156]: pgmap v5188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:42:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:42:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:42:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:42:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:13 smithi189 ceph-mon[32756]: pgmap v5189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:13 smithi189 ceph-mon[32756]: pgmap v5190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:13 smithi156 ceph-mon[32679]: pgmap v5189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:13 smithi156 ceph-mon[32679]: pgmap v5190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:13 smithi092 ceph-mon[29156]: pgmap v5189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:13 smithi092 ceph-mon[29156]: pgmap v5190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8629.391671 secs 2024-04-26T20:42:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7932.369070 secs 2024-04-26T20:42:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8629.391671 secs 2024-04-26T20:42:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7932.369070 secs 2024-04-26T20:42:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8629.391671 secs 2024-04-26T20:42:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7932.369070 secs 2024-04-26T20:42:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:15 smithi189 ceph-mon[32756]: pgmap v5191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:15 smithi156 ceph-mon[32679]: pgmap v5191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:15 smithi092 ceph-mon[29156]: pgmap v5191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:17 smithi189 ceph-mon[32756]: pgmap v5192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:17 smithi156 ceph-mon[32679]: pgmap v5192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:17 smithi092 ceph-mon[29156]: pgmap v5192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:42:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:19 smithi189 ceph-mon[32756]: pgmap v5193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:42:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8634.391809 secs 2024-04-26T20:42:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7937.369199 secs 2024-04-26T20:42:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:19 smithi156 ceph-mon[32679]: pgmap v5193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:42:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8634.391809 secs 2024-04-26T20:42:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7937.369199 secs 2024-04-26T20:42:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:19 smithi092 ceph-mon[29156]: pgmap v5193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:42:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8634.391809 secs 2024-04-26T20:42:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7937.369199 secs 2024-04-26T20:42:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:21 smithi189 ceph-mon[32756]: pgmap v5194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T20:42:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:21 smithi156 ceph-mon[32679]: pgmap v5194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T20:42:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:21 smithi092 ceph-mon[29156]: pgmap v5194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T20:42:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:23 smithi189 ceph-mon[32756]: pgmap v5195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8639.391921 secs 2024-04-26T20:42:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:23 smithi156 ceph-mon[32679]: pgmap v5195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8639.391921 secs 2024-04-26T20:42:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:23 smithi092 ceph-mon[29156]: pgmap v5195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:42:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8639.391921 secs 2024-04-26T20:42:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7942.369261 secs 2024-04-26T20:42:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7942.369261 secs 2024-04-26T20:42:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7942.369261 secs 2024-04-26T20:42:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:25 smithi189 ceph-mon[32756]: pgmap v5196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:25 smithi156 ceph-mon[32679]: pgmap v5196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:25 smithi092 ceph-mon[29156]: pgmap v5196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:27.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:27 smithi092 ceph-mon[29156]: pgmap v5197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:27 smithi189 ceph-mon[32756]: pgmap v5197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:27 smithi156 ceph-mon[32679]: pgmap v5197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:28.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8644.392036 secs 2024-04-26T20:42:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8644.392036 secs 2024-04-26T20:42:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8644.392036 secs 2024-04-26T20:42:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:29 smithi189 ceph-mon[32756]: pgmap v5198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7947.369321 secs 2024-04-26T20:42:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:29 smithi156 ceph-mon[32679]: pgmap v5198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7947.369321 secs 2024-04-26T20:42:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:29 smithi092 ceph-mon[29156]: pgmap v5198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:42:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7947.369321 secs 2024-04-26T20:42:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:31 smithi189 ceph-mon[32756]: pgmap v5199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:31 smithi156 ceph-mon[32679]: pgmap v5199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:31 smithi092 ceph-mon[29156]: pgmap v5199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:42:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:33 smithi189 ceph-mon[32756]: pgmap v5200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8649.392104 secs 2024-04-26T20:42:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:33 smithi156 ceph-mon[32679]: pgmap v5200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8649.392104 secs 2024-04-26T20:42:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:33 smithi092 ceph-mon[29156]: pgmap v5200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8649.392104 secs 2024-04-26T20:42:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7952.369431 secs 2024-04-26T20:42:34.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7952.369431 secs 2024-04-26T20:42:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7952.369431 secs 2024-04-26T20:42:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:35 smithi189 ceph-mon[32756]: pgmap v5201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:35 smithi156 ceph-mon[32679]: pgmap v5201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:35 smithi092 ceph-mon[29156]: pgmap v5201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:42:37.159+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:42:37.160 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:42:37.159+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:42:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:42:37.159+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:42:37.161 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:42:37.159+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 70 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:42:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:37 smithi189 ceph-mon[32756]: pgmap v5202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:37 smithi156 ceph-mon[32679]: pgmap v5202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:37 smithi092 ceph-mon[29156]: pgmap v5202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8654.392215 secs 2024-04-26T20:42:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8654.392215 secs 2024-04-26T20:42:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8654.392215 secs 2024-04-26T20:42:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:39 smithi189 ceph-mon[32756]: pgmap v5203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7957.369505 secs 2024-04-26T20:42:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:39 smithi156 ceph-mon[32679]: pgmap v5203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7957.369505 secs 2024-04-26T20:42:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:39 smithi092 ceph-mon[29156]: pgmap v5203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7957.369505 secs 2024-04-26T20:42:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:41 smithi189 ceph-mon[32756]: pgmap v5204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:41 smithi156 ceph-mon[32679]: pgmap v5204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:41 smithi092 ceph-mon[29156]: pgmap v5204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:43 smithi189 ceph-mon[32756]: pgmap v5205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8659.392333 secs 2024-04-26T20:42:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:43 smithi156 ceph-mon[32679]: pgmap v5205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8659.392333 secs 2024-04-26T20:42:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:43 smithi092 ceph-mon[29156]: pgmap v5205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8659.392333 secs 2024-04-26T20:42:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7962.369604 secs 2024-04-26T20:42:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7962.369604 secs 2024-04-26T20:42:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7962.369604 secs 2024-04-26T20:42:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:45 smithi189 ceph-mon[32756]: pgmap v5206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:45 smithi156 ceph-mon[32679]: pgmap v5206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:45 smithi092 ceph-mon[29156]: pgmap v5206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:47 smithi189 ceph-mon[32756]: pgmap v5207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:47 smithi156 ceph-mon[32679]: pgmap v5207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:47 smithi092 ceph-mon[29156]: pgmap v5207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8664.392451 secs 2024-04-26T20:42:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7967.369723 secs 2024-04-26T20:42:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8664.392451 secs 2024-04-26T20:42:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7967.369723 secs 2024-04-26T20:42:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8664.392451 secs 2024-04-26T20:42:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7967.369723 secs 2024-04-26T20:42:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:49 smithi189 ceph-mon[32756]: pgmap v5208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:49 smithi156 ceph-mon[32679]: pgmap v5208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:49 smithi092 ceph-mon[29156]: pgmap v5208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:51 smithi189 ceph-mon[32756]: pgmap v5209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:51 smithi156 ceph-mon[32679]: pgmap v5209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:51 smithi092 ceph-mon[29156]: pgmap v5209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:53 smithi189 ceph-mon[32756]: pgmap v5210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8669.392592 secs 2024-04-26T20:42:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7972.369795 secs 2024-04-26T20:42:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:53 smithi156 ceph-mon[32679]: pgmap v5210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8669.392592 secs 2024-04-26T20:42:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7972.369795 secs 2024-04-26T20:42:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:53 smithi092 ceph-mon[29156]: pgmap v5210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8669.392592 secs 2024-04-26T20:42:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7972.369795 secs 2024-04-26T20:42:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:55 smithi189 ceph-mon[32756]: pgmap v5211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:55 smithi156 ceph-mon[32679]: pgmap v5211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:55 smithi092 ceph-mon[29156]: pgmap v5211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:42:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:57 smithi092 ceph-mon[29156]: pgmap v5212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:57 smithi189 ceph-mon[32756]: pgmap v5212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:57 smithi156 ceph-mon[32679]: pgmap v5212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:42:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8674.392722 secs 2024-04-26T20:42:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7977.369855 secs 2024-04-26T20:42:59.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8674.392722 secs 2024-04-26T20:42:59.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7977.369855 secs 2024-04-26T20:42:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8674.392722 secs 2024-04-26T20:42:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7977.369855 secs 2024-04-26T20:42:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:42:59 smithi092 ceph-mon[29156]: pgmap v5213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:42:59 smithi189 ceph-mon[32756]: pgmap v5213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:42:59 smithi156 ceph-mon[32679]: pgmap v5213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:01 smithi092 ceph-mon[29156]: pgmap v5214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:01 smithi189 ceph-mon[32756]: pgmap v5214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:01 smithi156 ceph-mon[32679]: pgmap v5214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:03.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:43:03.199+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:43:03.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:43:03.199+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:43:03.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:43:03.199+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:43:03.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:43:03.199+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:43:03.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:43:03.199+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:43:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-mon[29156]: pgmap v5215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8679.392870 secs 2024-04-26T20:43:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7982.369945 secs 2024-04-26T20:43:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:03 smithi189 ceph-mon[32756]: pgmap v5215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8679.392870 secs 2024-04-26T20:43:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7982.369945 secs 2024-04-26T20:43:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:03 smithi156 ceph-mon[32679]: pgmap v5215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8679.392870 secs 2024-04-26T20:43:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7982.369945 secs 2024-04-26T20:43:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:05 smithi092 ceph-mon[29156]: pgmap v5216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:05 smithi189 ceph-mon[32756]: pgmap v5216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:05 smithi156 ceph-mon[32679]: pgmap v5216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:07 smithi092 ceph-mon[29156]: pgmap v5217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:07 smithi189 ceph-mon[32756]: pgmap v5217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:07 smithi156 ceph-mon[32679]: pgmap v5217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8684.392959 secs 2024-04-26T20:43:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7987.370021 secs 2024-04-26T20:43:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8684.392959 secs 2024-04-26T20:43:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7987.370021 secs 2024-04-26T20:43:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8684.392959 secs 2024-04-26T20:43:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7987.370021 secs 2024-04-26T20:43:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:09 smithi092 ceph-mon[29156]: pgmap v5218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:09 smithi189 ceph-mon[32756]: pgmap v5218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:09 smithi156 ceph-mon[32679]: pgmap v5218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:11 smithi092 ceph-mon[29156]: pgmap v5219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:11 smithi189 ceph-mon[32756]: pgmap v5219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:11 smithi156 ceph-mon[32679]: pgmap v5219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:43:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: pgmap v5220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8689.393032 secs 2024-04-26T20:43:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7992.370130 secs 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: pgmap v5220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8689.393032 secs 2024-04-26T20:43:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7992.370130 secs 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: pgmap v5220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8689.393032 secs 2024-04-26T20:43:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7992.370130 secs 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: pgmap v5221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: pgmap v5221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: pgmap v5221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:43:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:43:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:43:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:43:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:43:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: pgmap v5222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:16 smithi189 ceph-mon[32756]: pgmap v5223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:43:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:43:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:43:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:43:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: pgmap v5222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:16 smithi156 ceph-mon[32679]: pgmap v5223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: pgmap v5222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:16 smithi092 ceph-mon[29156]: pgmap v5223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:18 smithi189 ceph-mon[32756]: pgmap v5224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8694.393143 secs 2024-04-26T20:43:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 7997.370281 secs 2024-04-26T20:43:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:18 smithi156 ceph-mon[32679]: pgmap v5224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8694.393143 secs 2024-04-26T20:43:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 7997.370281 secs 2024-04-26T20:43:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:18 smithi092 ceph-mon[29156]: pgmap v5224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8694.393143 secs 2024-04-26T20:43:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 7997.370281 secs 2024-04-26T20:43:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:20 smithi189 ceph-mon[32756]: pgmap v5225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:20 smithi156 ceph-mon[32679]: pgmap v5225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:20 smithi092 ceph-mon[29156]: pgmap v5225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:22 smithi156 ceph-mon[32679]: pgmap v5226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:22 smithi092 ceph-mon[29156]: pgmap v5226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:22 smithi189 ceph-mon[32756]: pgmap v5226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8699.393260 secs 2024-04-26T20:43:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8002.370391 secs 2024-04-26T20:43:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8699.393260 secs 2024-04-26T20:43:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8002.370391 secs 2024-04-26T20:43:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8699.393260 secs 2024-04-26T20:43:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8002.370391 secs 2024-04-26T20:43:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:24 smithi156 ceph-mon[32679]: pgmap v5227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:24 smithi092 ceph-mon[29156]: pgmap v5227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:24 smithi189 ceph-mon[32756]: pgmap v5227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:43:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:25 smithi156 ceph-mon[32679]: pgmap v5228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:43:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:25 smithi092 ceph-mon[29156]: pgmap v5228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:43:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:25 smithi189 ceph-mon[32756]: pgmap v5228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:43:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:28 smithi189 ceph-mon[32756]: pgmap v5229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8704.393372 secs 2024-04-26T20:43:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8007.370453 secs 2024-04-26T20:43:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:28 smithi156 ceph-mon[32679]: pgmap v5229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8704.393372 secs 2024-04-26T20:43:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8007.370453 secs 2024-04-26T20:43:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:28 smithi092 ceph-mon[29156]: pgmap v5229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8704.393372 secs 2024-04-26T20:43:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8007.370453 secs 2024-04-26T20:43:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:30 smithi189 ceph-mon[32756]: pgmap v5230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:30 smithi156 ceph-mon[32679]: pgmap v5230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:30 smithi092 ceph-mon[29156]: pgmap v5230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:32 smithi189 ceph-mon[32756]: pgmap v5231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:32 smithi156 ceph-mon[32679]: pgmap v5231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:32 smithi092 ceph-mon[29156]: pgmap v5231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8709.393508 secs 2024-04-26T20:43:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8012.370535 secs 2024-04-26T20:43:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8709.393508 secs 2024-04-26T20:43:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8012.370535 secs 2024-04-26T20:43:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8709.393508 secs 2024-04-26T20:43:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8012.370535 secs 2024-04-26T20:43:35.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:34 smithi092 ceph-mon[29156]: pgmap v5232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:34 smithi156 ceph-mon[32679]: pgmap v5232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:34 smithi189 ceph-mon[32756]: pgmap v5232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:35 smithi156 ceph-mon[32679]: pgmap v5233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:35 smithi092 ceph-mon[29156]: pgmap v5233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:35 smithi189 ceph-mon[32756]: pgmap v5233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:38 smithi189 ceph-mon[32756]: pgmap v5234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8714.393593 secs 2024-04-26T20:43:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8017.370595 secs 2024-04-26T20:43:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:38 smithi156 ceph-mon[32679]: pgmap v5234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8714.393593 secs 2024-04-26T20:43:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8017.370595 secs 2024-04-26T20:43:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:38 smithi092 ceph-mon[29156]: pgmap v5234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8714.393593 secs 2024-04-26T20:43:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8017.370595 secs 2024-04-26T20:43:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:40 smithi189 ceph-mon[32756]: pgmap v5235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:40 smithi156 ceph-mon[32679]: pgmap v5235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:40 smithi092 ceph-mon[29156]: pgmap v5235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:42 smithi156 ceph-mon[32679]: pgmap v5236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:42 smithi092 ceph-mon[29156]: pgmap v5236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:42 smithi189 ceph-mon[32756]: pgmap v5236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8719.393710 secs 2024-04-26T20:43:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8022.370710 secs 2024-04-26T20:43:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8719.393710 secs 2024-04-26T20:43:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8022.370710 secs 2024-04-26T20:43:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8719.393710 secs 2024-04-26T20:43:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8022.370710 secs 2024-04-26T20:43:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:44 smithi156 ceph-mon[32679]: pgmap v5237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:44 smithi092 ceph-mon[29156]: pgmap v5237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:44 smithi189 ceph-mon[32756]: pgmap v5237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:45 smithi156 ceph-mon[32679]: pgmap v5238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:45 smithi092 ceph-mon[29156]: pgmap v5238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:45 smithi189 ceph-mon[32756]: pgmap v5238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:48 smithi189 ceph-mon[32756]: pgmap v5239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8724.393854 secs 2024-04-26T20:43:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8027.370826 secs 2024-04-26T20:43:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:48 smithi156 ceph-mon[32679]: pgmap v5239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8724.393854 secs 2024-04-26T20:43:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8027.370826 secs 2024-04-26T20:43:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:48 smithi092 ceph-mon[29156]: pgmap v5239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8724.393854 secs 2024-04-26T20:43:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8027.370826 secs 2024-04-26T20:43:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:50 smithi156 ceph-mon[32679]: pgmap v5240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:50 smithi092 ceph-mon[29156]: pgmap v5240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:50 smithi189 ceph-mon[32756]: pgmap v5240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:52 smithi156 ceph-mon[32679]: pgmap v5241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:52 smithi092 ceph-mon[29156]: pgmap v5241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:52 smithi189 ceph-mon[32756]: pgmap v5241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8729.393945 secs 2024-04-26T20:43:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8032.370911 secs 2024-04-26T20:43:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8729.393945 secs 2024-04-26T20:43:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8032.370911 secs 2024-04-26T20:43:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8729.393945 secs 2024-04-26T20:43:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8032.370911 secs 2024-04-26T20:43:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:54 smithi156 ceph-mon[32679]: pgmap v5242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:54 smithi092 ceph-mon[29156]: pgmap v5242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:54 smithi189 ceph-mon[32756]: pgmap v5242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:43:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:55 smithi156 ceph-mon[32679]: pgmap v5243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:55 smithi092 ceph-mon[29156]: pgmap v5243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:56.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:55 smithi189 ceph-mon[32756]: pgmap v5243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:58 smithi156 ceph-mon[32679]: pgmap v5244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8734.394028 secs 2024-04-26T20:43:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:43:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8037.371030 secs 2024-04-26T20:43:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:58 smithi092 ceph-mon[29156]: pgmap v5244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8734.394028 secs 2024-04-26T20:43:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:43:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8037.371030 secs 2024-04-26T20:43:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:58 smithi189 ceph-mon[32756]: pgmap v5244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:43:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8734.394028 secs 2024-04-26T20:43:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:43:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8037.371030 secs 2024-04-26T20:44:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:00 smithi156 ceph-mon[32679]: pgmap v5245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:00 smithi092 ceph-mon[29156]: pgmap v5245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:00 smithi189 ceph-mon[32756]: pgmap v5245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:02 smithi156 ceph-mon[32679]: pgmap v5246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:02 smithi092 ceph-mon[29156]: pgmap v5246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:02 smithi189 ceph-mon[32756]: pgmap v5246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8739.394109 secs 2024-04-26T20:44:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8042.371116 secs 2024-04-26T20:44:04.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8739.394109 secs 2024-04-26T20:44:04.206 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8042.371116 secs 2024-04-26T20:44:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8739.394109 secs 2024-04-26T20:44:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8042.371116 secs 2024-04-26T20:44:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:04 smithi156 ceph-mon[32679]: pgmap v5247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:04 smithi092 ceph-mon[29156]: pgmap v5247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:04 smithi189 ceph-mon[32756]: pgmap v5247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:05 smithi156 ceph-mon[32679]: pgmap v5248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:05 smithi092 ceph-mon[29156]: pgmap v5248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:05 smithi189 ceph-mon[32756]: pgmap v5248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:08 smithi156 ceph-mon[32679]: pgmap v5249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8744.394226 secs 2024-04-26T20:44:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8047.371234 secs 2024-04-26T20:44:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:08 smithi092 ceph-mon[29156]: pgmap v5249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8744.394226 secs 2024-04-26T20:44:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8047.371234 secs 2024-04-26T20:44:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:08 smithi189 ceph-mon[32756]: pgmap v5249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8744.394226 secs 2024-04-26T20:44:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8047.371234 secs 2024-04-26T20:44:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:10 smithi156 ceph-mon[32679]: pgmap v5250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:10 smithi092 ceph-mon[29156]: pgmap v5250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:10 smithi189 ceph-mon[32756]: pgmap v5250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:12 smithi092 ceph-mon[29156]: pgmap v5251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:12 smithi189 ceph-mon[32756]: pgmap v5251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:12 smithi156 ceph-mon[32679]: pgmap v5251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:44:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8749.394296 secs 2024-04-26T20:44:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8052.371374 secs 2024-04-26T20:44:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8749.394296 secs 2024-04-26T20:44:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8052.371374 secs 2024-04-26T20:44:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8749.394296 secs 2024-04-26T20:44:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8052.371374 secs 2024-04-26T20:44:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:14 smithi092 ceph-mon[29156]: pgmap v5252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:14 smithi189 ceph-mon[32756]: pgmap v5252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:14 smithi156 ceph-mon[32679]: pgmap v5252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:44:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:16 smithi156 ceph-mon[32679]: pgmap v5253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:44:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:16 smithi092 ceph-mon[29156]: pgmap v5253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:44:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:16 smithi189 ceph-mon[32756]: pgmap v5253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:44:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:44:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:44:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:44:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:17 smithi156 ceph-mon[32679]: pgmap v5254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:44:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:17 smithi156 ceph-mon[32679]: pgmap v5255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:17 smithi092 ceph-mon[29156]: pgmap v5254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:44:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:17 smithi092 ceph-mon[29156]: pgmap v5255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:17 smithi189 ceph-mon[32756]: pgmap v5254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:44:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:17 smithi189 ceph-mon[32756]: pgmap v5255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8754.394416 secs 2024-04-26T20:44:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8057.371519 secs 2024-04-26T20:44:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:18 smithi156 ceph-mon[32679]: pgmap v5256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8754.394416 secs 2024-04-26T20:44:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8057.371519 secs 2024-04-26T20:44:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:18 smithi092 ceph-mon[29156]: pgmap v5256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8754.394416 secs 2024-04-26T20:44:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8057.371519 secs 2024-04-26T20:44:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:18 smithi189 ceph-mon[32756]: pgmap v5256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:21 smithi092 ceph-mon[29156]: pgmap v5257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:21 smithi189 ceph-mon[32756]: pgmap v5257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:21 smithi156 ceph-mon[32679]: pgmap v5257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:23 smithi092 ceph-mon[29156]: pgmap v5258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:44:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8759.394485 secs 2024-04-26T20:44:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8062.371588 secs 2024-04-26T20:44:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:23 smithi189 ceph-mon[32756]: pgmap v5258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:44:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8759.394485 secs 2024-04-26T20:44:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8062.371588 secs 2024-04-26T20:44:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:23 smithi156 ceph-mon[32679]: pgmap v5258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:44:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8759.394485 secs 2024-04-26T20:44:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8062.371588 secs 2024-04-26T20:44:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:25 smithi092 ceph-mon[29156]: pgmap v5259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:25 smithi189 ceph-mon[32756]: pgmap v5259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:25 smithi156 ceph-mon[32679]: pgmap v5259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:44:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:27 smithi092 ceph-mon[29156]: pgmap v5260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:44:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:27 smithi189 ceph-mon[32756]: pgmap v5260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:44:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:27 smithi156 ceph-mon[32679]: pgmap v5260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:44:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8764.394599 secs 2024-04-26T20:44:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8067.371692 secs 2024-04-26T20:44:29.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8764.394599 secs 2024-04-26T20:44:29.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8067.371692 secs 2024-04-26T20:44:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8764.394599 secs 2024-04-26T20:44:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8067.371692 secs 2024-04-26T20:44:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:29 smithi092 ceph-mon[29156]: pgmap v5261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:30.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:29 smithi156 ceph-mon[32679]: pgmap v5261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:29 smithi189 ceph-mon[32756]: pgmap v5261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:31 smithi092 ceph-mon[29156]: pgmap v5262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:31 smithi189 ceph-mon[32756]: pgmap v5262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:31 smithi156 ceph-mon[32679]: pgmap v5262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:33 smithi092 ceph-mon[29156]: pgmap v5263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8769.394717 secs 2024-04-26T20:44:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8072.371775 secs 2024-04-26T20:44:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:33 smithi189 ceph-mon[32756]: pgmap v5263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8769.394717 secs 2024-04-26T20:44:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8072.371775 secs 2024-04-26T20:44:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:33 smithi156 ceph-mon[32679]: pgmap v5263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8769.394717 secs 2024-04-26T20:44:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8072.371775 secs 2024-04-26T20:44:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:35 smithi092 ceph-mon[29156]: pgmap v5264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:35 smithi189 ceph-mon[32756]: pgmap v5264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:35 smithi156 ceph-mon[32679]: pgmap v5264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:37 smithi189 ceph-mon[32756]: pgmap v5265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:37 smithi156 ceph-mon[32679]: pgmap v5265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:37 smithi092 ceph-mon[29156]: pgmap v5265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8774.394848 secs 2024-04-26T20:44:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8077.371856 secs 2024-04-26T20:44:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8774.394848 secs 2024-04-26T20:44:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8077.371856 secs 2024-04-26T20:44:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8774.394848 secs 2024-04-26T20:44:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8077.371856 secs 2024-04-26T20:44:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:39 smithi189 ceph-mon[32756]: pgmap v5266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:39 smithi156 ceph-mon[32679]: pgmap v5266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:39 smithi092 ceph-mon[29156]: pgmap v5266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:41 smithi189 ceph-mon[32756]: pgmap v5267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:41 smithi156 ceph-mon[32679]: pgmap v5267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:41 smithi092 ceph-mon[29156]: pgmap v5267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:43 smithi189 ceph-mon[32756]: pgmap v5268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8779.394887 secs 2024-04-26T20:44:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8082.371997 secs 2024-04-26T20:44:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:43 smithi156 ceph-mon[32679]: pgmap v5268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8779.394887 secs 2024-04-26T20:44:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8082.371997 secs 2024-04-26T20:44:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:43 smithi092 ceph-mon[29156]: pgmap v5268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8779.394887 secs 2024-04-26T20:44:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8082.371997 secs 2024-04-26T20:44:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:45 smithi189 ceph-mon[32756]: pgmap v5269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:45 smithi156 ceph-mon[32679]: pgmap v5269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:45 smithi092 ceph-mon[29156]: pgmap v5269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:47 smithi189 ceph-mon[32756]: pgmap v5270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:47 smithi156 ceph-mon[32679]: pgmap v5270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:47 smithi092 ceph-mon[29156]: pgmap v5270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8784.394951 secs 2024-04-26T20:44:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8087.372119 secs 2024-04-26T20:44:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8784.394951 secs 2024-04-26T20:44:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8087.372119 secs 2024-04-26T20:44:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8784.394951 secs 2024-04-26T20:44:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8087.372119 secs 2024-04-26T20:44:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:49 smithi189 ceph-mon[32756]: pgmap v5271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:49 smithi156 ceph-mon[32679]: pgmap v5271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:49 smithi092 ceph-mon[29156]: pgmap v5271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:51 smithi189 ceph-mon[32756]: pgmap v5272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:51 smithi156 ceph-mon[32679]: pgmap v5272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:51 smithi092 ceph-mon[29156]: pgmap v5272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:53 smithi189 ceph-mon[32756]: pgmap v5273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8789.395040 secs 2024-04-26T20:44:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8092.372202 secs 2024-04-26T20:44:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:53 smithi156 ceph-mon[32679]: pgmap v5273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8789.395040 secs 2024-04-26T20:44:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8092.372202 secs 2024-04-26T20:44:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:53 smithi092 ceph-mon[29156]: pgmap v5273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8789.395040 secs 2024-04-26T20:44:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8092.372202 secs 2024-04-26T20:44:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:55 smithi189 ceph-mon[32756]: pgmap v5274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:55 smithi156 ceph-mon[32679]: pgmap v5274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:55 smithi092 ceph-mon[29156]: pgmap v5274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:44:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:57 smithi189 ceph-mon[32756]: pgmap v5275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:57 smithi156 ceph-mon[32679]: pgmap v5275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:57 smithi092 ceph-mon[29156]: pgmap v5275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:44:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8794.395143 secs 2024-04-26T20:44:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8097.372326 secs 2024-04-26T20:44:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8794.395143 secs 2024-04-26T20:44:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8097.372326 secs 2024-04-26T20:44:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8794.395143 secs 2024-04-26T20:44:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8097.372326 secs 2024-04-26T20:45:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:44:59 smithi156 ceph-mon[32679]: pgmap v5276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:44:59 smithi189 ceph-mon[32756]: pgmap v5276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:44:59 smithi092 ceph-mon[29156]: pgmap v5276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:01 smithi189 ceph-mon[32756]: pgmap v5277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:01 smithi156 ceph-mon[32679]: pgmap v5277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:01 smithi092 ceph-mon[29156]: pgmap v5277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:03 smithi092 ceph-mon[29156]: pgmap v5278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8799.395253 secs 2024-04-26T20:45:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8102.372404 secs 2024-04-26T20:45:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:03 smithi189 ceph-mon[32756]: pgmap v5278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8799.395253 secs 2024-04-26T20:45:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8102.372404 secs 2024-04-26T20:45:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:03 smithi156 ceph-mon[32679]: pgmap v5278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8799.395253 secs 2024-04-26T20:45:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8102.372404 secs 2024-04-26T20:45:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:05 smithi189 ceph-mon[32756]: pgmap v5279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:05 smithi156 ceph-mon[32679]: pgmap v5279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:05 smithi092 ceph-mon[29156]: pgmap v5279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:07 smithi189 ceph-mon[32756]: pgmap v5280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:07 smithi156 ceph-mon[32679]: pgmap v5280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:07 smithi092 ceph-mon[29156]: pgmap v5280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8804.395325 secs 2024-04-26T20:45:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8107.372533 secs 2024-04-26T20:45:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8804.395325 secs 2024-04-26T20:45:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8107.372533 secs 2024-04-26T20:45:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8804.395325 secs 2024-04-26T20:45:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8107.372533 secs 2024-04-26T20:45:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:09 smithi189 ceph-mon[32756]: pgmap v5281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:09 smithi156 ceph-mon[32679]: pgmap v5281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:09 smithi092 ceph-mon[29156]: pgmap v5281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:11 smithi189 ceph-mon[32756]: pgmap v5282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:11 smithi156 ceph-mon[32679]: pgmap v5282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:11 smithi092 ceph-mon[29156]: pgmap v5282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:13 smithi189 ceph-mon[32756]: pgmap v5283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8809.395423 secs 2024-04-26T20:45:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8112.372662 secs 2024-04-26T20:45:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:13 smithi156 ceph-mon[32679]: pgmap v5283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8809.395423 secs 2024-04-26T20:45:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8112.372662 secs 2024-04-26T20:45:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:13 smithi092 ceph-mon[29156]: pgmap v5283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8809.395423 secs 2024-04-26T20:45:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8112.372662 secs 2024-04-26T20:45:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:15 smithi189 ceph-mon[32756]: pgmap v5284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:15 smithi156 ceph-mon[32679]: pgmap v5284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:15 smithi092 ceph-mon[29156]: pgmap v5284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:45:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:17 smithi189 ceph-mon[32756]: pgmap v5285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:45:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:17 smithi156 ceph-mon[32679]: pgmap v5285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:45:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:17 smithi092 ceph-mon[29156]: pgmap v5285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:45:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:45:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:45:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:18 smithi189 ceph-mon[32756]: pgmap v5286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:45:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:18 smithi189 ceph-mon[32756]: pgmap v5287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8814.395557 secs 2024-04-26T20:45:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8117.372754 secs 2024-04-26T20:45:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:18 smithi156 ceph-mon[32679]: pgmap v5286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:45:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:18 smithi156 ceph-mon[32679]: pgmap v5287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8814.395557 secs 2024-04-26T20:45:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8117.372754 secs 2024-04-26T20:45:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:18 smithi092 ceph-mon[29156]: pgmap v5286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:45:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:18 smithi092 ceph-mon[29156]: pgmap v5287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8814.395557 secs 2024-04-26T20:45:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8117.372754 secs 2024-04-26T20:45:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:20 smithi189 ceph-mon[32756]: pgmap v5288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:20 smithi156 ceph-mon[32679]: pgmap v5288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:20 smithi092 ceph-mon[29156]: pgmap v5288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:22 smithi189 ceph-mon[32756]: pgmap v5289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:22 smithi156 ceph-mon[32679]: pgmap v5289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:22 smithi092 ceph-mon[29156]: pgmap v5289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8819.395683 secs 2024-04-26T20:45:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8122.372902 secs 2024-04-26T20:45:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8819.395683 secs 2024-04-26T20:45:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8122.372902 secs 2024-04-26T20:45:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8819.395683 secs 2024-04-26T20:45:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8122.372902 secs 2024-04-26T20:45:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:24 smithi189 ceph-mon[32756]: pgmap v5290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:24 smithi156 ceph-mon[32679]: pgmap v5290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:24 smithi092 ceph-mon[29156]: pgmap v5290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:45:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:26 smithi189 ceph-mon[32756]: pgmap v5291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:26 smithi156 ceph-mon[32679]: pgmap v5291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:26 smithi092 ceph-mon[29156]: pgmap v5291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:45:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:28 smithi189 ceph-mon[32756]: pgmap v5292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:45:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8824.395796 secs 2024-04-26T20:45:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8127.373041 secs 2024-04-26T20:45:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:28 smithi156 ceph-mon[32679]: pgmap v5292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:45:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8824.395796 secs 2024-04-26T20:45:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8127.373041 secs 2024-04-26T20:45:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:28 smithi092 ceph-mon[29156]: pgmap v5292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:45:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8824.395796 secs 2024-04-26T20:45:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8127.373041 secs 2024-04-26T20:45:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:30 smithi189 ceph-mon[32756]: pgmap v5293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:30 smithi156 ceph-mon[32679]: pgmap v5293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:30 smithi092 ceph-mon[29156]: pgmap v5293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:32 smithi189 ceph-mon[32756]: pgmap v5294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:32 smithi156 ceph-mon[32679]: pgmap v5294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:32 smithi092 ceph-mon[29156]: pgmap v5294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8829.395916 secs 2024-04-26T20:45:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8132.373172 secs 2024-04-26T20:45:34.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8829.395916 secs 2024-04-26T20:45:34.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8132.373172 secs 2024-04-26T20:45:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8829.395916 secs 2024-04-26T20:45:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8132.373172 secs 2024-04-26T20:45:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:34 smithi189 ceph-mon[32756]: pgmap v5295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:34 smithi156 ceph-mon[32679]: pgmap v5295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:34 smithi092 ceph-mon[29156]: pgmap v5295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:36 smithi189 ceph-mon[32756]: pgmap v5296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:36 smithi156 ceph-mon[32679]: pgmap v5296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:37.184 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:45:37.184+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:45:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:45:37.184+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:45:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:45:37.184+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:45:37.185 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:45:37.184+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 71 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:45:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:36 smithi092 ceph-mon[29156]: pgmap v5296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:38 smithi189 ceph-mon[32756]: pgmap v5297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8834.396010 secs 2024-04-26T20:45:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8137.373292 secs 2024-04-26T20:45:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:38 smithi156 ceph-mon[32679]: pgmap v5297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8834.396010 secs 2024-04-26T20:45:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8137.373292 secs 2024-04-26T20:45:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:38 smithi092 ceph-mon[29156]: pgmap v5297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8834.396010 secs 2024-04-26T20:45:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8137.373292 secs 2024-04-26T20:45:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:40 smithi189 ceph-mon[32756]: pgmap v5298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:40 smithi156 ceph-mon[32679]: pgmap v5298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:40 smithi092 ceph-mon[29156]: pgmap v5298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:42 smithi189 ceph-mon[32756]: pgmap v5299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:42 smithi156 ceph-mon[32679]: pgmap v5299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:42 smithi092 ceph-mon[29156]: pgmap v5299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8839.396154 secs 2024-04-26T20:45:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8142.373379 secs 2024-04-26T20:45:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8839.396154 secs 2024-04-26T20:45:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8142.373379 secs 2024-04-26T20:45:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8839.396154 secs 2024-04-26T20:45:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8142.373379 secs 2024-04-26T20:45:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:44 smithi189 ceph-mon[32756]: pgmap v5300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:44 smithi156 ceph-mon[32679]: pgmap v5300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:44 smithi092 ceph-mon[29156]: pgmap v5300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:46 smithi156 ceph-mon[32679]: pgmap v5301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:46 smithi092 ceph-mon[29156]: pgmap v5301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:46 smithi189 ceph-mon[32756]: pgmap v5301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:48 smithi156 ceph-mon[32679]: pgmap v5302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8844.396267 secs 2024-04-26T20:45:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8147.373456 secs 2024-04-26T20:45:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:48 smithi092 ceph-mon[29156]: pgmap v5302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8844.396267 secs 2024-04-26T20:45:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8147.373456 secs 2024-04-26T20:45:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:48 smithi189 ceph-mon[32756]: pgmap v5302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8844.396267 secs 2024-04-26T20:45:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8147.373456 secs 2024-04-26T20:45:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:50 smithi156 ceph-mon[32679]: pgmap v5303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:50 smithi092 ceph-mon[29156]: pgmap v5303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:50 smithi189 ceph-mon[32756]: pgmap v5303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:52 smithi156 ceph-mon[32679]: pgmap v5304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:52 smithi092 ceph-mon[29156]: pgmap v5304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:52 smithi189 ceph-mon[32756]: pgmap v5304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8849.396366 secs 2024-04-26T20:45:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8152.373564 secs 2024-04-26T20:45:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8849.396366 secs 2024-04-26T20:45:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8152.373564 secs 2024-04-26T20:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8849.396366 secs 2024-04-26T20:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8152.373564 secs 2024-04-26T20:45:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:54 smithi156 ceph-mon[32679]: pgmap v5305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:54 smithi092 ceph-mon[29156]: pgmap v5305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:54 smithi189 ceph-mon[32756]: pgmap v5305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:56 smithi156 ceph-mon[32679]: pgmap v5306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:56 smithi092 ceph-mon[29156]: pgmap v5306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:56 smithi189 ceph-mon[32756]: pgmap v5306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:45:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:58 smithi156 ceph-mon[32679]: pgmap v5307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8854.396482 secs 2024-04-26T20:45:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8157.373676 secs 2024-04-26T20:45:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:58 smithi092 ceph-mon[29156]: pgmap v5307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8854.396482 secs 2024-04-26T20:45:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8157.373676 secs 2024-04-26T20:45:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:58 smithi189 ceph-mon[32756]: pgmap v5307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:45:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8854.396482 secs 2024-04-26T20:45:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8157.373676 secs 2024-04-26T20:46:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:45:59 smithi156 ceph-mon[32679]: pgmap v5308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:45:59 smithi092 ceph-mon[29156]: pgmap v5308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:00.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:45:59 smithi189 ceph-mon[32756]: pgmap v5308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:02 smithi092 ceph-mon[29156]: pgmap v5309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:02 smithi189 ceph-mon[32756]: pgmap v5309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:02 smithi156 ceph-mon[32679]: pgmap v5309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8859.396597 secs 2024-04-26T20:46:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:04 smithi092 ceph-mon[29156]: pgmap v5310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8162.373759 secs 2024-04-26T20:46:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8859.396597 secs 2024-04-26T20:46:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:04 smithi189 ceph-mon[32756]: pgmap v5310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8162.373759 secs 2024-04-26T20:46:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8859.396597 secs 2024-04-26T20:46:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:04 smithi156 ceph-mon[32679]: pgmap v5310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8162.373759 secs 2024-04-26T20:46:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:06 smithi189 ceph-mon[32756]: pgmap v5311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:06 smithi156 ceph-mon[32679]: pgmap v5311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:06 smithi092 ceph-mon[29156]: pgmap v5311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:08.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:08 smithi092 ceph-mon[29156]: pgmap v5312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:08 smithi189 ceph-mon[32756]: pgmap v5312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:08 smithi156 ceph-mon[32679]: pgmap v5312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8864.396715 secs 2024-04-26T20:46:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8167.373838 secs 2024-04-26T20:46:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8864.396715 secs 2024-04-26T20:46:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8167.373838 secs 2024-04-26T20:46:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8864.396715 secs 2024-04-26T20:46:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8167.373838 secs 2024-04-26T20:46:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:10 smithi189 ceph-mon[32756]: pgmap v5313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:10 smithi156 ceph-mon[32679]: pgmap v5313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:10 smithi092 ceph-mon[29156]: pgmap v5313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:12 smithi189 ceph-mon[32756]: pgmap v5314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:12 smithi156 ceph-mon[32679]: pgmap v5314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:12 smithi092 ceph-mon[29156]: pgmap v5314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8869.396852 secs 2024-04-26T20:46:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:14 smithi189 ceph-mon[32756]: pgmap v5315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8172.373949 secs 2024-04-26T20:46:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8869.396852 secs 2024-04-26T20:46:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:14 smithi156 ceph-mon[32679]: pgmap v5315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8172.373949 secs 2024-04-26T20:46:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8869.396852 secs 2024-04-26T20:46:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:14 smithi092 ceph-mon[29156]: pgmap v5315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8172.373949 secs 2024-04-26T20:46:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:16 smithi189 ceph-mon[32756]: pgmap v5316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:16 smithi156 ceph-mon[32679]: pgmap v5316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:16 smithi092 ceph-mon[29156]: pgmap v5316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:18 smithi189 ceph-mon[32756]: pgmap v5317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:46:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:18 smithi156 ceph-mon[32679]: pgmap v5317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:46:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:18 smithi092 ceph-mon[29156]: pgmap v5317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:46:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:46:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:46:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:46:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:19 smithi189 ceph-mon[32756]: pgmap v5318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:46:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:19 smithi189 ceph-mon[32756]: pgmap v5319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8874.396953 secs 2024-04-26T20:46:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8177.374070 secs 2024-04-26T20:46:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:19 smithi156 ceph-mon[32679]: pgmap v5318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:46:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:19 smithi156 ceph-mon[32679]: pgmap v5319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8874.396953 secs 2024-04-26T20:46:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8177.374070 secs 2024-04-26T20:46:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:19 smithi092 ceph-mon[29156]: pgmap v5318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:46:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:19 smithi092 ceph-mon[29156]: pgmap v5319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:46:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8874.396953 secs 2024-04-26T20:46:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8177.374070 secs 2024-04-26T20:46:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:21 smithi189 ceph-mon[32756]: pgmap v5320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:21 smithi156 ceph-mon[32679]: pgmap v5320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:21 smithi092 ceph-mon[29156]: pgmap v5320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:23 smithi189 ceph-mon[32756]: pgmap v5321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:23 smithi156 ceph-mon[32679]: pgmap v5321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:23 smithi092 ceph-mon[29156]: pgmap v5321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8879.397075 secs 2024-04-26T20:46:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8182.374136 secs 2024-04-26T20:46:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8879.397075 secs 2024-04-26T20:46:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8182.374136 secs 2024-04-26T20:46:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8879.397075 secs 2024-04-26T20:46:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8182.374136 secs 2024-04-26T20:46:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:25 smithi189 ceph-mon[32756]: pgmap v5322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:25 smithi156 ceph-mon[32679]: pgmap v5322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:25 smithi092 ceph-mon[29156]: pgmap v5322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:27 smithi189 ceph-mon[32756]: pgmap v5323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:27 smithi156 ceph-mon[32679]: pgmap v5323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:27 smithi092 ceph-mon[29156]: pgmap v5323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:46:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:29 smithi189 ceph-mon[32756]: pgmap v5324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:46:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8884.397191 secs 2024-04-26T20:46:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8187.374256 secs 2024-04-26T20:46:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:29 smithi156 ceph-mon[32679]: pgmap v5324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:46:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8884.397191 secs 2024-04-26T20:46:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8187.374256 secs 2024-04-26T20:46:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:29 smithi092 ceph-mon[29156]: pgmap v5324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:46:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8884.397191 secs 2024-04-26T20:46:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8187.374256 secs 2024-04-26T20:46:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:31 smithi189 ceph-mon[32756]: pgmap v5325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:31 smithi156 ceph-mon[32679]: pgmap v5325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:31 smithi092 ceph-mon[29156]: pgmap v5325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:33 smithi189 ceph-mon[32756]: pgmap v5326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:33 smithi156 ceph-mon[32679]: pgmap v5326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:33 smithi092 ceph-mon[29156]: pgmap v5326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8889.397303 secs 2024-04-26T20:46:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8192.374391 secs 2024-04-26T20:46:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8889.397303 secs 2024-04-26T20:46:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8192.374391 secs 2024-04-26T20:46:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8889.397303 secs 2024-04-26T20:46:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8192.374391 secs 2024-04-26T20:46:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:35 smithi189 ceph-mon[32756]: pgmap v5327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:35 smithi156 ceph-mon[32679]: pgmap v5327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:35 smithi092 ceph-mon[29156]: pgmap v5327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:37.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:37 smithi189 ceph-mon[32756]: pgmap v5328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:37 smithi156 ceph-mon[32679]: pgmap v5328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:37 smithi092 ceph-mon[29156]: pgmap v5328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:39 smithi189 ceph-mon[32756]: pgmap v5329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8894.397436 secs 2024-04-26T20:46:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8197.374480 secs 2024-04-26T20:46:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:39 smithi156 ceph-mon[32679]: pgmap v5329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8894.397436 secs 2024-04-26T20:46:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8197.374480 secs 2024-04-26T20:46:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:39 smithi092 ceph-mon[29156]: pgmap v5329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8894.397436 secs 2024-04-26T20:46:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8197.374480 secs 2024-04-26T20:46:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:41 smithi189 ceph-mon[32756]: pgmap v5330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:41 smithi156 ceph-mon[32679]: pgmap v5330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:41 smithi092 ceph-mon[29156]: pgmap v5330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:43 smithi189 ceph-mon[32756]: pgmap v5331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:43.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:43 smithi156 ceph-mon[32679]: pgmap v5331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:43 smithi092 ceph-mon[29156]: pgmap v5331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8899.397560 secs 2024-04-26T20:46:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8202.374544 secs 2024-04-26T20:46:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8899.397560 secs 2024-04-26T20:46:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8202.374544 secs 2024-04-26T20:46:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8899.397560 secs 2024-04-26T20:46:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8202.374544 secs 2024-04-26T20:46:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:45 smithi189 ceph-mon[32756]: pgmap v5332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:45 smithi156 ceph-mon[32679]: pgmap v5332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:45 smithi092 ceph-mon[29156]: pgmap v5332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:47 smithi189 ceph-mon[32756]: pgmap v5333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:47 smithi156 ceph-mon[32679]: pgmap v5333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:47 smithi092 ceph-mon[29156]: pgmap v5333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8904.397696 secs 2024-04-26T20:46:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8904.397696 secs 2024-04-26T20:46:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8904.397696 secs 2024-04-26T20:46:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:49 smithi189 ceph-mon[32756]: pgmap v5334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8207.374616 secs 2024-04-26T20:46:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:49 smithi156 ceph-mon[32679]: pgmap v5334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8207.374616 secs 2024-04-26T20:46:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:49 smithi092 ceph-mon[29156]: pgmap v5334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8207.374616 secs 2024-04-26T20:46:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:51 smithi189 ceph-mon[32756]: pgmap v5335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:51 smithi156 ceph-mon[32679]: pgmap v5335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:51 smithi092 ceph-mon[29156]: pgmap v5335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:53 smithi189 ceph-mon[32756]: pgmap v5336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8909.397808 secs 2024-04-26T20:46:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:53 smithi156 ceph-mon[32679]: pgmap v5336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8909.397808 secs 2024-04-26T20:46:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:53 smithi092 ceph-mon[29156]: pgmap v5336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8909.397808 secs 2024-04-26T20:46:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8212.374730 secs 2024-04-26T20:46:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8212.374730 secs 2024-04-26T20:46:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8212.374730 secs 2024-04-26T20:46:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:55 smithi189 ceph-mon[32756]: pgmap v5337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:55 smithi156 ceph-mon[32679]: pgmap v5337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:55 smithi092 ceph-mon[29156]: pgmap v5337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:57 smithi189 ceph-mon[32756]: pgmap v5338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:57 smithi156 ceph-mon[32679]: pgmap v5338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:57 smithi092 ceph-mon[29156]: pgmap v5338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8914.397899 secs 2024-04-26T20:46:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8914.397899 secs 2024-04-26T20:46:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8914.397899 secs 2024-04-26T20:46:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:59 smithi189 ceph-mon[32756]: pgmap v5339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:46:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8217.374841 secs 2024-04-26T20:46:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:59 smithi156 ceph-mon[32679]: pgmap v5339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:46:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8217.374841 secs 2024-04-26T20:46:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:59 smithi092 ceph-mon[29156]: pgmap v5339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:46:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:46:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8217.374841 secs 2024-04-26T20:47:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:01 smithi189 ceph-mon[32756]: pgmap v5340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:01 smithi156 ceph-mon[32679]: pgmap v5340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:01 smithi092 ceph-mon[29156]: pgmap v5340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:03 smithi189 ceph-mon[32756]: pgmap v5341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8919.398013 secs 2024-04-26T20:47:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:03 smithi156 ceph-mon[32679]: pgmap v5341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8919.398013 secs 2024-04-26T20:47:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:03 smithi092 ceph-mon[29156]: pgmap v5341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8919.398013 secs 2024-04-26T20:47:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8222.374987 secs 2024-04-26T20:47:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8222.374987 secs 2024-04-26T20:47:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8222.374987 secs 2024-04-26T20:47:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:05 smithi189 ceph-mon[32756]: pgmap v5342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:05 smithi156 ceph-mon[32679]: pgmap v5342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:05 smithi092 ceph-mon[29156]: pgmap v5342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:47:07.196+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:47:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:47:07.196+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:47:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:47:07.196+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004960 con 0x5617fb906f00 2024-04-26T20:47:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:47:07.197+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 72 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:47:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:07 smithi189 ceph-mon[32756]: pgmap v5343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:07 smithi156 ceph-mon[32679]: pgmap v5343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:07 smithi092 ceph-mon[29156]: pgmap v5343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:08.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8924.398075 secs 2024-04-26T20:47:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8924.398075 secs 2024-04-26T20:47:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8924.398075 secs 2024-04-26T20:47:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:09 smithi156 ceph-mon[32679]: pgmap v5344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8227.375049 secs 2024-04-26T20:47:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:09 smithi092 ceph-mon[29156]: pgmap v5344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8227.375049 secs 2024-04-26T20:47:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:09 smithi189 ceph-mon[32756]: pgmap v5344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8227.375049 secs 2024-04-26T20:47:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:11 smithi156 ceph-mon[32679]: pgmap v5345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:11 smithi092 ceph-mon[29156]: pgmap v5345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:11 smithi189 ceph-mon[32756]: pgmap v5345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:13 smithi156 ceph-mon[32679]: pgmap v5346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8929.398145 secs 2024-04-26T20:47:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8232.375120 secs 2024-04-26T20:47:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:13 smithi092 ceph-mon[29156]: pgmap v5346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8929.398145 secs 2024-04-26T20:47:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8232.375120 secs 2024-04-26T20:47:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:13 smithi189 ceph-mon[32756]: pgmap v5346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8929.398145 secs 2024-04-26T20:47:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8232.375120 secs 2024-04-26T20:47:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:15 smithi156 ceph-mon[32679]: pgmap v5347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:15 smithi092 ceph-mon[29156]: pgmap v5347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:15 smithi189 ceph-mon[32756]: pgmap v5347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:17 smithi156 ceph-mon[32679]: pgmap v5348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:17 smithi092 ceph-mon[29156]: pgmap v5348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:17 smithi189 ceph-mon[32756]: pgmap v5348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8934.398209 secs 2024-04-26T20:47:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8237.375210 secs 2024-04-26T20:47:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8934.398209 secs 2024-04-26T20:47:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8237.375210 secs 2024-04-26T20:47:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:47:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8934.398209 secs 2024-04-26T20:47:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8237.375210 secs 2024-04-26T20:47:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:19 smithi156 ceph-mon[32679]: pgmap v5349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:47:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:19 smithi092 ceph-mon[29156]: pgmap v5349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:47:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:19 smithi189 ceph-mon[32756]: pgmap v5349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:47:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:47:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:47:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:20 smithi156 ceph-mon[32679]: pgmap v5350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:47:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:20 smithi156 ceph-mon[32679]: pgmap v5351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:20 smithi092 ceph-mon[29156]: pgmap v5350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:47:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:20 smithi092 ceph-mon[29156]: pgmap v5351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:20 smithi189 ceph-mon[32756]: pgmap v5350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:47:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:20 smithi189 ceph-mon[32756]: pgmap v5351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:22 smithi156 ceph-mon[32679]: pgmap v5352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:22 smithi092 ceph-mon[29156]: pgmap v5352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:22 smithi189 ceph-mon[32756]: pgmap v5352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8939.398284 secs 2024-04-26T20:47:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8242.375327 secs 2024-04-26T20:47:23.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8939.398284 secs 2024-04-26T20:47:23.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8242.375327 secs 2024-04-26T20:47:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8939.398284 secs 2024-04-26T20:47:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8242.375327 secs 2024-04-26T20:47:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:24 smithi156 ceph-mon[32679]: pgmap v5353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:47:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:24 smithi092 ceph-mon[29156]: pgmap v5353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:47:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:24 smithi189 ceph-mon[32756]: pgmap v5353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:47:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:26 smithi156 ceph-mon[32679]: pgmap v5354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:26 smithi092 ceph-mon[29156]: pgmap v5354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:26 smithi189 ceph-mon[32756]: pgmap v5354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:28 smithi156 ceph-mon[32679]: pgmap v5355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8944.398422 secs 2024-04-26T20:47:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8247.375410 secs 2024-04-26T20:47:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:28 smithi092 ceph-mon[29156]: pgmap v5355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8944.398422 secs 2024-04-26T20:47:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8247.375410 secs 2024-04-26T20:47:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:28 smithi189 ceph-mon[32756]: pgmap v5355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:47:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8944.398422 secs 2024-04-26T20:47:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8247.375410 secs 2024-04-26T20:47:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:30 smithi092 ceph-mon[29156]: pgmap v5356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:47:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:30 smithi189 ceph-mon[32756]: pgmap v5356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:47:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:30 smithi156 ceph-mon[32679]: pgmap v5356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:47:32.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:32 smithi189 ceph-mon[32756]: pgmap v5357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:32.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:32 smithi156 ceph-mon[32679]: pgmap v5357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:32 smithi092 ceph-mon[29156]: pgmap v5357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8949.398508 secs 2024-04-26T20:47:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8252.375511 secs 2024-04-26T20:47:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8949.398508 secs 2024-04-26T20:47:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8252.375511 secs 2024-04-26T20:47:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8949.398508 secs 2024-04-26T20:47:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8252.375511 secs 2024-04-26T20:47:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:34 smithi092 ceph-mon[29156]: pgmap v5358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:34 smithi189 ceph-mon[32756]: pgmap v5358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:34 smithi156 ceph-mon[32679]: pgmap v5358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:36 smithi092 ceph-mon[29156]: pgmap v5359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:36 smithi189 ceph-mon[32756]: pgmap v5359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:36 smithi156 ceph-mon[32679]: pgmap v5359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:38 smithi092 ceph-mon[29156]: pgmap v5360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8954.398629 secs 2024-04-26T20:47:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8257.375636 secs 2024-04-26T20:47:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:38 smithi189 ceph-mon[32756]: pgmap v5360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8954.398629 secs 2024-04-26T20:47:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8257.375636 secs 2024-04-26T20:47:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:38 smithi156 ceph-mon[32679]: pgmap v5360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8954.398629 secs 2024-04-26T20:47:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8257.375636 secs 2024-04-26T20:47:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:40 smithi092 ceph-mon[29156]: pgmap v5361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:40 smithi189 ceph-mon[32756]: pgmap v5361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:40 smithi156 ceph-mon[32679]: pgmap v5361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:42 smithi092 ceph-mon[29156]: pgmap v5362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:42 smithi189 ceph-mon[32756]: pgmap v5362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:42 smithi156 ceph-mon[32679]: pgmap v5362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8959.398729 secs 2024-04-26T20:47:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8262.375725 secs 2024-04-26T20:47:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8959.398729 secs 2024-04-26T20:47:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8262.375725 secs 2024-04-26T20:47:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8959.398729 secs 2024-04-26T20:47:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8262.375725 secs 2024-04-26T20:47:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:44 smithi092 ceph-mon[29156]: pgmap v5363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:44 smithi189 ceph-mon[32756]: pgmap v5363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:44 smithi156 ceph-mon[32679]: pgmap v5363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:46 smithi092 ceph-mon[29156]: pgmap v5364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:46 smithi189 ceph-mon[32756]: pgmap v5364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:46 smithi156 ceph-mon[32679]: pgmap v5364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:48 smithi092 ceph-mon[29156]: pgmap v5365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8964.398861 secs 2024-04-26T20:47:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8267.375846 secs 2024-04-26T20:47:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:48 smithi189 ceph-mon[32756]: pgmap v5365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8964.398861 secs 2024-04-26T20:47:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8267.375846 secs 2024-04-26T20:47:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:48 smithi156 ceph-mon[32679]: pgmap v5365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8964.398861 secs 2024-04-26T20:47:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8267.375846 secs 2024-04-26T20:47:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:50 smithi092 ceph-mon[29156]: pgmap v5366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:50 smithi189 ceph-mon[32756]: pgmap v5366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:50 smithi156 ceph-mon[32679]: pgmap v5366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:52 smithi092 ceph-mon[29156]: pgmap v5367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:52 smithi189 ceph-mon[32756]: pgmap v5367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:52 smithi156 ceph-mon[32679]: pgmap v5367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8969.398979 secs 2024-04-26T20:47:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8272.376023 secs 2024-04-26T20:47:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8969.398979 secs 2024-04-26T20:47:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8272.376023 secs 2024-04-26T20:47:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8969.398979 secs 2024-04-26T20:47:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8272.376023 secs 2024-04-26T20:47:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:54 smithi092 ceph-mon[29156]: pgmap v5368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:54 smithi189 ceph-mon[32756]: pgmap v5368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:54 smithi156 ceph-mon[32679]: pgmap v5368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:56 smithi092 ceph-mon[29156]: pgmap v5369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:56 smithi189 ceph-mon[32756]: pgmap v5369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:56 smithi156 ceph-mon[32679]: pgmap v5369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:47:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:58 smithi189 ceph-mon[32756]: pgmap v5370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8974.399074 secs 2024-04-26T20:47:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:47:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8277.376135 secs 2024-04-26T20:47:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:58 smithi156 ceph-mon[32679]: pgmap v5370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8974.399074 secs 2024-04-26T20:47:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:47:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8277.376135 secs 2024-04-26T20:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:58 smithi092 ceph-mon[29156]: pgmap v5370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8974.399074 secs 2024-04-26T20:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:47:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8277.376135 secs 2024-04-26T20:48:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:00 smithi189 ceph-mon[32756]: pgmap v5371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:00 smithi156 ceph-mon[32679]: pgmap v5371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:00 smithi092 ceph-mon[29156]: pgmap v5371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:02 smithi189 ceph-mon[32756]: pgmap v5372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:02 smithi156 ceph-mon[32679]: pgmap v5372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:02 smithi092 ceph-mon[29156]: pgmap v5372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8979.399195 secs 2024-04-26T20:48:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8282.376254 secs 2024-04-26T20:48:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8979.399195 secs 2024-04-26T20:48:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8282.376254 secs 2024-04-26T20:48:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8979.399195 secs 2024-04-26T20:48:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8282.376254 secs 2024-04-26T20:48:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:04 smithi189 ceph-mon[32756]: pgmap v5373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:04 smithi156 ceph-mon[32679]: pgmap v5373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:04 smithi092 ceph-mon[29156]: pgmap v5373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:06 smithi189 ceph-mon[32756]: pgmap v5374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:06 smithi156 ceph-mon[32679]: pgmap v5374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:06 smithi092 ceph-mon[29156]: pgmap v5374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:08 smithi189 ceph-mon[32756]: pgmap v5375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8984.399312 secs 2024-04-26T20:48:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8287.376370 secs 2024-04-26T20:48:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:08 smithi156 ceph-mon[32679]: pgmap v5375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8984.399312 secs 2024-04-26T20:48:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8287.376370 secs 2024-04-26T20:48:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:08 smithi092 ceph-mon[29156]: pgmap v5375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8984.399312 secs 2024-04-26T20:48:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8287.376370 secs 2024-04-26T20:48:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:10 smithi092 ceph-mon[29156]: pgmap v5376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:10 smithi189 ceph-mon[32756]: pgmap v5376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:10 smithi156 ceph-mon[32679]: pgmap v5376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:12 smithi189 ceph-mon[32756]: pgmap v5377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:12 smithi156 ceph-mon[32679]: pgmap v5377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:12 smithi092 ceph-mon[29156]: pgmap v5377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8989.399435 secs 2024-04-26T20:48:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8292.376442 secs 2024-04-26T20:48:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8989.399435 secs 2024-04-26T20:48:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8292.376442 secs 2024-04-26T20:48:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8989.399435 secs 2024-04-26T20:48:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8292.376442 secs 2024-04-26T20:48:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:14 smithi189 ceph-mon[32756]: pgmap v5378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:14 smithi156 ceph-mon[32679]: pgmap v5378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:14 smithi092 ceph-mon[29156]: pgmap v5378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:16 smithi189 ceph-mon[32756]: pgmap v5379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:16 smithi156 ceph-mon[32679]: pgmap v5379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:16 smithi092 ceph-mon[29156]: pgmap v5379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:18 smithi189 ceph-mon[32756]: pgmap v5380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8994.399571 secs 2024-04-26T20:48:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8297.376533 secs 2024-04-26T20:48:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:18 smithi156 ceph-mon[32679]: pgmap v5380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8994.399571 secs 2024-04-26T20:48:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8297.376533 secs 2024-04-26T20:48:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:18 smithi092 ceph-mon[29156]: pgmap v5380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8994.399571 secs 2024-04-26T20:48:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8297.376533 secs 2024-04-26T20:48:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:48:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:48:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:48:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:48:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:48:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:48:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:20 smithi189 ceph-mon[32756]: pgmap v5381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:20 smithi189 ceph-mon[32756]: pgmap v5382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:48:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:20 smithi189 ceph-mon[32756]: pgmap v5383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:20 smithi156 ceph-mon[32679]: pgmap v5381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:20 smithi156 ceph-mon[32679]: pgmap v5382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:48:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:20 smithi156 ceph-mon[32679]: pgmap v5383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:20 smithi092 ceph-mon[29156]: pgmap v5381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:20 smithi092 ceph-mon[29156]: pgmap v5382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:48:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:20 smithi092 ceph-mon[29156]: pgmap v5383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:22 smithi189 ceph-mon[32756]: pgmap v5384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:22 smithi156 ceph-mon[32679]: pgmap v5384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:22 smithi092 ceph-mon[29156]: pgmap v5384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 8999.399672 secs 2024-04-26T20:48:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8302.376646 secs 2024-04-26T20:48:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 8999.399672 secs 2024-04-26T20:48:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8302.376646 secs 2024-04-26T20:48:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 8999.399672 secs 2024-04-26T20:48:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8302.376646 secs 2024-04-26T20:48:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:24 smithi189 ceph-mon[32756]: pgmap v5385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:24 smithi156 ceph-mon[32679]: pgmap v5385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:24 smithi092 ceph-mon[29156]: pgmap v5385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:26 smithi189 ceph-mon[32756]: pgmap v5386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:26 smithi156 ceph-mon[32679]: pgmap v5386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:26 smithi092 ceph-mon[29156]: pgmap v5386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:48:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:28 smithi189 ceph-mon[32756]: pgmap v5387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9004.399804 secs 2024-04-26T20:48:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8307.376746 secs 2024-04-26T20:48:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:28 smithi156 ceph-mon[32679]: pgmap v5387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9004.399804 secs 2024-04-26T20:48:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8307.376746 secs 2024-04-26T20:48:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:28 smithi092 ceph-mon[29156]: pgmap v5387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:48:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9004.399804 secs 2024-04-26T20:48:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8307.376746 secs 2024-04-26T20:48:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:30 smithi189 ceph-mon[32756]: pgmap v5388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:48:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:30 smithi156 ceph-mon[32679]: pgmap v5388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:48:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:30 smithi092 ceph-mon[29156]: pgmap v5388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:48:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:32 smithi189 ceph-mon[32756]: pgmap v5389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:32 smithi156 ceph-mon[32679]: pgmap v5389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:32 smithi092 ceph-mon[29156]: pgmap v5389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:48:33.251+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:48:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:48:33.251+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:48:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:48:33.251+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:48:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:48:33.251+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:48:33.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:48:33.251+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:48:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9009.399926 secs 2024-04-26T20:48:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8312.376814 secs 2024-04-26T20:48:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9009.399926 secs 2024-04-26T20:48:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8312.376814 secs 2024-04-26T20:48:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9009.399926 secs 2024-04-26T20:48:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8312.376814 secs 2024-04-26T20:48:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:34 smithi189 ceph-mon[32756]: pgmap v5390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:34 smithi156 ceph-mon[32679]: pgmap v5390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:34 smithi092 ceph-mon[29156]: pgmap v5390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:36.001 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca8089000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca8089000 comp rx=0 tx=0).stop 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.001+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:48:36.002 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.002+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8032e70 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T20:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.031+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T20:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.031+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T20:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.031+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T20:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=8 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T20:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T20:48:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T20:48:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:36.032+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T20:48:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:36 smithi189 ceph-mon[32756]: pgmap v5391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:36 smithi156 ceph-mon[32679]: pgmap v5391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:37.210+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:48:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:37.210+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:48:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:37.210+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:48:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:48:37.210+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 73 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:48:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:36 smithi092 ceph-mon[29156]: pgmap v5391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:38 smithi189 ceph-mon[32756]: pgmap v5392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9014.400038 secs 2024-04-26T20:48:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8317.376948 secs 2024-04-26T20:48:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:38 smithi156 ceph-mon[32679]: pgmap v5392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9014.400038 secs 2024-04-26T20:48:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8317.376948 secs 2024-04-26T20:48:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:38 smithi092 ceph-mon[29156]: pgmap v5392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9014.400038 secs 2024-04-26T20:48:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8317.376948 secs 2024-04-26T20:48:41.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:40 smithi189 ceph-mon[32756]: pgmap v5393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:40 smithi156 ceph-mon[32679]: pgmap v5393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:40 smithi092 ceph-mon[29156]: pgmap v5393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:42 smithi189 ceph-mon[32756]: pgmap v5394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:42 smithi156 ceph-mon[32679]: pgmap v5394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:42 smithi092 ceph-mon[29156]: pgmap v5394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9019.400156 secs 2024-04-26T20:48:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8322.377087 secs 2024-04-26T20:48:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9019.400156 secs 2024-04-26T20:48:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8322.377087 secs 2024-04-26T20:48:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9019.400156 secs 2024-04-26T20:48:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8322.377087 secs 2024-04-26T20:48:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:44 smithi189 ceph-mon[32756]: pgmap v5395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:44 smithi156 ceph-mon[32679]: pgmap v5395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:44 smithi092 ceph-mon[29156]: pgmap v5395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:46 smithi189 ceph-mon[32756]: pgmap v5396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:46 smithi156 ceph-mon[32679]: pgmap v5396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:46 smithi092 ceph-mon[29156]: pgmap v5396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:48 smithi189 ceph-mon[32756]: pgmap v5397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9024.400262 secs 2024-04-26T20:48:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8327.377218 secs 2024-04-26T20:48:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:48 smithi156 ceph-mon[32679]: pgmap v5397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9024.400262 secs 2024-04-26T20:48:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8327.377218 secs 2024-04-26T20:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:48 smithi092 ceph-mon[29156]: pgmap v5397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9024.400262 secs 2024-04-26T20:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8327.377218 secs 2024-04-26T20:48:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:50 smithi189 ceph-mon[32756]: pgmap v5398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:50 smithi156 ceph-mon[32679]: pgmap v5398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:50 smithi092 ceph-mon[29156]: pgmap v5398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:52 smithi189 ceph-mon[32756]: pgmap v5399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:52 smithi156 ceph-mon[32679]: pgmap v5399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:52 smithi092 ceph-mon[29156]: pgmap v5399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9029.400397 secs 2024-04-26T20:48:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8332.377358 secs 2024-04-26T20:48:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9029.400397 secs 2024-04-26T20:48:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8332.377358 secs 2024-04-26T20:48:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9029.400397 secs 2024-04-26T20:48:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8332.377358 secs 2024-04-26T20:48:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:54 smithi189 ceph-mon[32756]: pgmap v5400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:54 smithi156 ceph-mon[32679]: pgmap v5400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:54 smithi092 ceph-mon[29156]: pgmap v5400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:48:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:56 smithi189 ceph-mon[32756]: pgmap v5401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:56 smithi156 ceph-mon[32679]: pgmap v5401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:56 smithi092 ceph-mon[29156]: pgmap v5401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:58 smithi189 ceph-mon[32756]: pgmap v5402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9034.400527 secs 2024-04-26T20:48:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:48:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8337.377497 secs 2024-04-26T20:48:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:58 smithi156 ceph-mon[32679]: pgmap v5402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9034.400527 secs 2024-04-26T20:48:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:48:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8337.377497 secs 2024-04-26T20:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:58 smithi092 ceph-mon[29156]: pgmap v5402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9034.400527 secs 2024-04-26T20:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:48:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8337.377497 secs 2024-04-26T20:49:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:00 smithi189 ceph-mon[32756]: pgmap v5403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:00 smithi156 ceph-mon[32679]: pgmap v5403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:00 smithi092 ceph-mon[29156]: pgmap v5403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:02 smithi189 ceph-mon[32756]: pgmap v5404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:02 smithi156 ceph-mon[32679]: pgmap v5404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:02 smithi092 ceph-mon[29156]: pgmap v5404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9039.400665 secs 2024-04-26T20:49:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8342.377641 secs 2024-04-26T20:49:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9039.400665 secs 2024-04-26T20:49:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8342.377641 secs 2024-04-26T20:49:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9039.400665 secs 2024-04-26T20:49:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8342.377641 secs 2024-04-26T20:49:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:04 smithi189 ceph-mon[32756]: pgmap v5405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:04 smithi156 ceph-mon[32679]: pgmap v5405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:04 smithi092 ceph-mon[29156]: pgmap v5405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:06 smithi189 ceph-mon[32756]: pgmap v5406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:06 smithi156 ceph-mon[32679]: pgmap v5406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:06 smithi092 ceph-mon[29156]: pgmap v5406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:08 smithi156 ceph-mon[32679]: pgmap v5407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9044.400781 secs 2024-04-26T20:49:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8347.377774 secs 2024-04-26T20:49:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:08 smithi092 ceph-mon[29156]: pgmap v5407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9044.400781 secs 2024-04-26T20:49:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8347.377774 secs 2024-04-26T20:49:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:08 smithi189 ceph-mon[32756]: pgmap v5407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9044.400781 secs 2024-04-26T20:49:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8347.377774 secs 2024-04-26T20:49:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:10 smithi156 ceph-mon[32679]: pgmap v5408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:10 smithi092 ceph-mon[29156]: pgmap v5408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:10 smithi189 ceph-mon[32756]: pgmap v5408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:12 smithi156 ceph-mon[32679]: pgmap v5409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:12 smithi092 ceph-mon[29156]: pgmap v5409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:12 smithi189 ceph-mon[32756]: pgmap v5409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9049.400902 secs 2024-04-26T20:49:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8352.377891 secs 2024-04-26T20:49:14.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9049.400902 secs 2024-04-26T20:49:14.215 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8352.377891 secs 2024-04-26T20:49:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9049.400902 secs 2024-04-26T20:49:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8352.377891 secs 2024-04-26T20:49:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:14 smithi156 ceph-mon[32679]: pgmap v5410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:14 smithi092 ceph-mon[29156]: pgmap v5410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:14 smithi189 ceph-mon[32756]: pgmap v5410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:16 smithi156 ceph-mon[32679]: pgmap v5411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:16 smithi092 ceph-mon[29156]: pgmap v5411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:16 smithi189 ceph-mon[32756]: pgmap v5411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:18 smithi156 ceph-mon[32679]: pgmap v5412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9054.400995 secs 2024-04-26T20:49:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8357.378026 secs 2024-04-26T20:49:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:18 smithi092 ceph-mon[29156]: pgmap v5412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9054.400995 secs 2024-04-26T20:49:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8357.378026 secs 2024-04-26T20:49:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:18 smithi189 ceph-mon[32756]: pgmap v5412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9054.400995 secs 2024-04-26T20:49:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8357.378026 secs 2024-04-26T20:49:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:49:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:20 smithi156 ceph-mon[32679]: pgmap v5413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:49:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:20 smithi092 ceph-mon[29156]: pgmap v5413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:49:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:20 smithi189 ceph-mon[32756]: pgmap v5413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:49:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:49:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:49:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:21 smithi156 ceph-mon[32679]: pgmap v5414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:49:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:21 smithi156 ceph-mon[32679]: pgmap v5415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:21 smithi092 ceph-mon[29156]: pgmap v5414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:49:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:21 smithi092 ceph-mon[29156]: pgmap v5415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:21 smithi189 ceph-mon[32756]: pgmap v5414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:49:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:21 smithi189 ceph-mon[32756]: pgmap v5415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:23 smithi156 ceph-mon[32679]: pgmap v5416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9059.401101 secs 2024-04-26T20:49:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8362.378143 secs 2024-04-26T20:49:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:23 smithi092 ceph-mon[29156]: pgmap v5416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9059.401101 secs 2024-04-26T20:49:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8362.378143 secs 2024-04-26T20:49:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:23 smithi189 ceph-mon[32756]: pgmap v5416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:49:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9059.401101 secs 2024-04-26T20:49:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8362.378143 secs 2024-04-26T20:49:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:25 smithi092 ceph-mon[29156]: pgmap v5417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:25 smithi189 ceph-mon[32756]: pgmap v5417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:25 smithi156 ceph-mon[32679]: pgmap v5417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:27 smithi092 ceph-mon[29156]: pgmap v5418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:27 smithi189 ceph-mon[32756]: pgmap v5418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:27 smithi156 ceph-mon[32679]: pgmap v5418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9064.401210 secs 2024-04-26T20:49:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8367.378288 secs 2024-04-26T20:49:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9064.401210 secs 2024-04-26T20:49:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8367.378288 secs 2024-04-26T20:49:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9064.401210 secs 2024-04-26T20:49:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8367.378288 secs 2024-04-26T20:49:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:29 smithi092 ceph-mon[29156]: pgmap v5419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:29 smithi189 ceph-mon[32756]: pgmap v5419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:29 smithi156 ceph-mon[32679]: pgmap v5419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:49:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:30 smithi189 ceph-mon[32756]: pgmap v5420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:49:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:30 smithi156 ceph-mon[32679]: pgmap v5420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:49:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:30 smithi092 ceph-mon[29156]: pgmap v5420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:49:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:33 smithi189 ceph-mon[32756]: pgmap v5421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9069.401332 secs 2024-04-26T20:49:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:33 smithi156 ceph-mon[32679]: pgmap v5421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9069.401332 secs 2024-04-26T20:49:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:33 smithi092 ceph-mon[29156]: pgmap v5421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9069.401332 secs 2024-04-26T20:49:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8372.378349 secs 2024-04-26T20:49:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8372.378349 secs 2024-04-26T20:49:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8372.378349 secs 2024-04-26T20:49:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:35 smithi189 ceph-mon[32756]: pgmap v5422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:35 smithi156 ceph-mon[32679]: pgmap v5422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:35 smithi092 ceph-mon[29156]: pgmap v5422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:37 smithi189 ceph-mon[32756]: pgmap v5423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:37 smithi156 ceph-mon[32679]: pgmap v5423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:37 smithi092 ceph-mon[29156]: pgmap v5423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9074.401467 secs 2024-04-26T20:49:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9074.401467 secs 2024-04-26T20:49:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9074.401467 secs 2024-04-26T20:49:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8377.378460 secs 2024-04-26T20:49:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:39 smithi189 ceph-mon[32756]: pgmap v5424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8377.378460 secs 2024-04-26T20:49:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:39 smithi156 ceph-mon[32679]: pgmap v5424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8377.378460 secs 2024-04-26T20:49:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:39 smithi092 ceph-mon[29156]: pgmap v5424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:41 smithi189 ceph-mon[32756]: pgmap v5425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:41 smithi156 ceph-mon[32679]: pgmap v5425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:41 smithi092 ceph-mon[29156]: pgmap v5425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:43 smithi189 ceph-mon[32756]: pgmap v5426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9079.401586 secs 2024-04-26T20:49:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:43 smithi156 ceph-mon[32679]: pgmap v5426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9079.401586 secs 2024-04-26T20:49:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:43 smithi092 ceph-mon[29156]: pgmap v5426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9079.401586 secs 2024-04-26T20:49:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8382.378572 secs 2024-04-26T20:49:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8382.378572 secs 2024-04-26T20:49:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8382.378572 secs 2024-04-26T20:49:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:45 smithi156 ceph-mon[32679]: pgmap v5427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:45 smithi092 ceph-mon[29156]: pgmap v5427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:45 smithi189 ceph-mon[32756]: pgmap v5427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:47 smithi156 ceph-mon[32679]: pgmap v5428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:47 smithi092 ceph-mon[29156]: pgmap v5428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:47 smithi189 ceph-mon[32756]: pgmap v5428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9084.401732 secs 2024-04-26T20:49:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9084.401732 secs 2024-04-26T20:49:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9084.401732 secs 2024-04-26T20:49:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8387.378687 secs 2024-04-26T20:49:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:49 smithi156 ceph-mon[32679]: pgmap v5429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8387.378687 secs 2024-04-26T20:49:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:49 smithi092 ceph-mon[29156]: pgmap v5429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8387.378687 secs 2024-04-26T20:49:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:49 smithi189 ceph-mon[32756]: pgmap v5429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:51 smithi156 ceph-mon[32679]: pgmap v5430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:51 smithi092 ceph-mon[29156]: pgmap v5430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:51 smithi189 ceph-mon[32756]: pgmap v5430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:53 smithi156 ceph-mon[32679]: pgmap v5431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9089.401861 secs 2024-04-26T20:49:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:53 smithi092 ceph-mon[29156]: pgmap v5431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9089.401861 secs 2024-04-26T20:49:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:53 smithi189 ceph-mon[32756]: pgmap v5431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:49:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9089.401861 secs 2024-04-26T20:49:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8392.378791 secs 2024-04-26T20:49:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8392.378791 secs 2024-04-26T20:49:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8392.378791 secs 2024-04-26T20:49:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:55 smithi156 ceph-mon[32679]: pgmap v5432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:55 smithi092 ceph-mon[29156]: pgmap v5432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:55 smithi189 ceph-mon[32756]: pgmap v5432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:49:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:57 smithi156 ceph-mon[32679]: pgmap v5433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:57 smithi092 ceph-mon[29156]: pgmap v5433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:57 smithi189 ceph-mon[32756]: pgmap v5433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:49:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9094.401970 secs 2024-04-26T20:49:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8397.378856 secs 2024-04-26T20:49:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9094.401970 secs 2024-04-26T20:49:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8397.378856 secs 2024-04-26T20:49:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9094.401970 secs 2024-04-26T20:49:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8397.378856 secs 2024-04-26T20:49:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:49:59 smithi156 ceph-mon[32679]: pgmap v5434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:49:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:49:59 smithi092 ceph-mon[29156]: pgmap v5434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:49:59 smithi189 ceph-mon[32756]: pgmap v5434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:50:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:50:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T20:50:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:01 smithi092 ceph-mon[29156]: pgmap v5435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:01 smithi189 ceph-mon[32756]: pgmap v5435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:01 smithi156 ceph-mon[32679]: pgmap v5435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:03.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:03 smithi156 ceph-mon[32679]: pgmap v5436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:03.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9099.402049 secs 2024-04-26T20:50:03.987 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8402.378958 secs 2024-04-26T20:50:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:03 smithi092 ceph-mon[29156]: pgmap v5436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9099.402049 secs 2024-04-26T20:50:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8402.378958 secs 2024-04-26T20:50:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:03 smithi189 ceph-mon[32756]: pgmap v5436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9099.402049 secs 2024-04-26T20:50:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8402.378958 secs 2024-04-26T20:50:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:05 smithi092 ceph-mon[29156]: pgmap v5437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:05 smithi189 ceph-mon[32756]: pgmap v5437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:05 smithi156 ceph-mon[32679]: pgmap v5437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:07 smithi092 ceph-mon[29156]: pgmap v5438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:07 smithi189 ceph-mon[32756]: pgmap v5438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:07 smithi156 ceph-mon[32679]: pgmap v5438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9104.402169 secs 2024-04-26T20:50:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8407.379022 secs 2024-04-26T20:50:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9104.402169 secs 2024-04-26T20:50:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8407.379022 secs 2024-04-26T20:50:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9104.402169 secs 2024-04-26T20:50:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8407.379022 secs 2024-04-26T20:50:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:09 smithi092 ceph-mon[29156]: pgmap v5439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:09 smithi189 ceph-mon[32756]: pgmap v5439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:09 smithi156 ceph-mon[32679]: pgmap v5439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:11 smithi092 ceph-mon[29156]: pgmap v5440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:11 smithi189 ceph-mon[32756]: pgmap v5440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:11 smithi156 ceph-mon[32679]: pgmap v5440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:13 smithi092 ceph-mon[29156]: pgmap v5441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9109.402267 secs 2024-04-26T20:50:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8412.379146 secs 2024-04-26T20:50:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:13 smithi189 ceph-mon[32756]: pgmap v5441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9109.402267 secs 2024-04-26T20:50:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8412.379146 secs 2024-04-26T20:50:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:13 smithi156 ceph-mon[32679]: pgmap v5441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9109.402267 secs 2024-04-26T20:50:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8412.379146 secs 2024-04-26T20:50:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:15 smithi092 ceph-mon[29156]: pgmap v5442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:15 smithi189 ceph-mon[32756]: pgmap v5442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:15 smithi156 ceph-mon[32679]: pgmap v5442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:17 smithi092 ceph-mon[29156]: pgmap v5443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:17 smithi189 ceph-mon[32756]: pgmap v5443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:17 smithi156 ceph-mon[32679]: pgmap v5443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9114.402422 secs 2024-04-26T20:50:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8417.379289 secs 2024-04-26T20:50:19.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9114.402422 secs 2024-04-26T20:50:19.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8417.379289 secs 2024-04-26T20:50:19.899 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9114.402422 secs 2024-04-26T20:50:19.899 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8417.379289 secs 2024-04-26T20:50:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:19 smithi092 ceph-mon[29156]: pgmap v5444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:19 smithi189 ceph-mon[32756]: pgmap v5444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:19 smithi156 ceph-mon[32679]: pgmap v5444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:50:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:21 smithi092 ceph-mon[29156]: pgmap v5445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:50:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:21 smithi189 ceph-mon[32756]: pgmap v5445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:50:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:21 smithi156 ceph-mon[32679]: pgmap v5445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:50:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:50:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:50:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:22 smithi092 ceph-mon[29156]: pgmap v5446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:50:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:22 smithi092 ceph-mon[29156]: pgmap v5447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:22 smithi189 ceph-mon[32756]: pgmap v5446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:50:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:22 smithi189 ceph-mon[32756]: pgmap v5447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:22 smithi156 ceph-mon[32679]: pgmap v5446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:50:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:22 smithi156 ceph-mon[32679]: pgmap v5447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9119.402564 secs 2024-04-26T20:50:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8422.379397 secs 2024-04-26T20:50:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9119.402564 secs 2024-04-26T20:50:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8422.379397 secs 2024-04-26T20:50:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9119.402564 secs 2024-04-26T20:50:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8422.379397 secs 2024-04-26T20:50:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:24 smithi189 ceph-mon[32756]: pgmap v5448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:24 smithi156 ceph-mon[32679]: pgmap v5448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:24 smithi092 ceph-mon[29156]: pgmap v5448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:26 smithi189 ceph-mon[32756]: pgmap v5449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:26 smithi156 ceph-mon[32679]: pgmap v5449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:26 smithi092 ceph-mon[29156]: pgmap v5449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:28 smithi189 ceph-mon[32756]: pgmap v5450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9124.402675 secs 2024-04-26T20:50:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8427.379486 secs 2024-04-26T20:50:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:28 smithi156 ceph-mon[32679]: pgmap v5450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9124.402675 secs 2024-04-26T20:50:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8427.379486 secs 2024-04-26T20:50:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:28 smithi092 ceph-mon[29156]: pgmap v5450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:50:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9124.402675 secs 2024-04-26T20:50:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8427.379486 secs 2024-04-26T20:50:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:30 smithi189 ceph-mon[32756]: pgmap v5451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:30 smithi156 ceph-mon[32679]: pgmap v5451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:30 smithi092 ceph-mon[29156]: pgmap v5451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:50:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:32 smithi189 ceph-mon[32756]: pgmap v5452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:50:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:32 smithi156 ceph-mon[32679]: pgmap v5452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:50:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:32 smithi092 ceph-mon[29156]: pgmap v5452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:50:34.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9129.402793 secs 2024-04-26T20:50:34.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8432.379598 secs 2024-04-26T20:50:34.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9129.402793 secs 2024-04-26T20:50:34.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8432.379598 secs 2024-04-26T20:50:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9129.402793 secs 2024-04-26T20:50:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8432.379598 secs 2024-04-26T20:50:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:34 smithi189 ceph-mon[32756]: pgmap v5453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:34 smithi156 ceph-mon[32679]: pgmap v5453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:34 smithi092 ceph-mon[29156]: pgmap v5453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:36 smithi189 ceph-mon[32756]: pgmap v5454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:36 smithi156 ceph-mon[32679]: pgmap v5454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:36 smithi092 ceph-mon[29156]: pgmap v5454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:38 smithi189 ceph-mon[32756]: pgmap v5455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9134.402910 secs 2024-04-26T20:50:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8437.379663 secs 2024-04-26T20:50:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:38 smithi156 ceph-mon[32679]: pgmap v5455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9134.402910 secs 2024-04-26T20:50:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8437.379663 secs 2024-04-26T20:50:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:38 smithi092 ceph-mon[29156]: pgmap v5455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9134.402910 secs 2024-04-26T20:50:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8437.379663 secs 2024-04-26T20:50:41.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:40 smithi092 ceph-mon[29156]: pgmap v5456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:40 smithi189 ceph-mon[32756]: pgmap v5456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:40 smithi156 ceph-mon[32679]: pgmap v5456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:42 smithi189 ceph-mon[32756]: pgmap v5457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:42 smithi156 ceph-mon[32679]: pgmap v5457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:42 smithi092 ceph-mon[29156]: pgmap v5457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9139.403026 secs 2024-04-26T20:50:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8442.379783 secs 2024-04-26T20:50:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9139.403026 secs 2024-04-26T20:50:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8442.379783 secs 2024-04-26T20:50:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9139.403026 secs 2024-04-26T20:50:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8442.379783 secs 2024-04-26T20:50:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:44 smithi189 ceph-mon[32756]: pgmap v5458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:44 smithi156 ceph-mon[32679]: pgmap v5458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:44 smithi092 ceph-mon[29156]: pgmap v5458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:46 smithi092 ceph-mon[29156]: pgmap v5459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:46 smithi189 ceph-mon[32756]: pgmap v5459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:46 smithi156 ceph-mon[32679]: pgmap v5459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:48 smithi189 ceph-mon[32756]: pgmap v5460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9144.403174 secs 2024-04-26T20:50:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8447.379861 secs 2024-04-26T20:50:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:48 smithi156 ceph-mon[32679]: pgmap v5460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9144.403174 secs 2024-04-26T20:50:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8447.379861 secs 2024-04-26T20:50:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:48 smithi092 ceph-mon[29156]: pgmap v5460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:50:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9144.403174 secs 2024-04-26T20:50:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8447.379861 secs 2024-04-26T20:50:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:50 smithi189 ceph-mon[32756]: pgmap v5461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:50 smithi156 ceph-mon[32679]: pgmap v5461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:50 smithi092 ceph-mon[29156]: pgmap v5461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:50:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:52 smithi189 ceph-mon[32756]: pgmap v5462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:52 smithi156 ceph-mon[32679]: pgmap v5462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:52 smithi092 ceph-mon[29156]: pgmap v5462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9149.403312 secs 2024-04-26T20:50:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8452.379941 secs 2024-04-26T20:50:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9149.403312 secs 2024-04-26T20:50:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8452.379941 secs 2024-04-26T20:50:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9149.403312 secs 2024-04-26T20:50:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8452.379941 secs 2024-04-26T20:50:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:54 smithi189 ceph-mon[32756]: pgmap v5463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:54 smithi156 ceph-mon[32679]: pgmap v5463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:54 smithi092 ceph-mon[29156]: pgmap v5463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:56 smithi189 ceph-mon[32756]: pgmap v5464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:56 smithi156 ceph-mon[32679]: pgmap v5464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:56 smithi092 ceph-mon[29156]: pgmap v5464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:50:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:58 smithi189 ceph-mon[32756]: pgmap v5465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9154.403401 secs 2024-04-26T20:50:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:50:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8457.380017 secs 2024-04-26T20:50:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:58 smithi156 ceph-mon[32679]: pgmap v5465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9154.403401 secs 2024-04-26T20:50:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:50:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8457.380017 secs 2024-04-26T20:50:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:58 smithi092 ceph-mon[29156]: pgmap v5465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:50:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9154.403401 secs 2024-04-26T20:50:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:50:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8457.380017 secs 2024-04-26T20:51:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:00 smithi189 ceph-mon[32756]: pgmap v5466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:00 smithi156 ceph-mon[32679]: pgmap v5466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:00 smithi092 ceph-mon[29156]: pgmap v5466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:02 smithi189 ceph-mon[32756]: pgmap v5467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:03.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:02 smithi156 ceph-mon[32679]: pgmap v5467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:02 smithi092 ceph-mon[29156]: pgmap v5467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:04.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9159.403556 secs 2024-04-26T20:51:04.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:03 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 8462.380153 secs 2024-04-26T20:51:04.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:03 smithi156 ceph-mon[32679]: slow request 1440.592818 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9159.403556 secs 2024-04-26T20:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:03 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 8462.380153 secs 2024-04-26T20:51:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:03 smithi189 ceph-mon[32756]: slow request 1440.592818 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:51:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9159.403556 secs 2024-04-26T20:51:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:03 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 8462.380153 secs 2024-04-26T20:51:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:03 smithi092 ceph-mon[29156]: slow request 1440.592818 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:51:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:04 smithi189 ceph-mon[32756]: pgmap v5468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:04 smithi156 ceph-mon[32679]: pgmap v5468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:04 smithi092 ceph-mon[29156]: pgmap v5468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:06 smithi189 ceph-mon[32756]: pgmap v5469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:06 smithi156 ceph-mon[32679]: pgmap v5469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:06 smithi092 ceph-mon[29156]: pgmap v5469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:08 smithi189 ceph-mon[32756]: pgmap v5470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9164.403674 secs 2024-04-26T20:51:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8467.380299 secs 2024-04-26T20:51:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:08 smithi156 ceph-mon[32679]: pgmap v5470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9164.403674 secs 2024-04-26T20:51:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8467.380299 secs 2024-04-26T20:51:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:08 smithi092 ceph-mon[29156]: pgmap v5470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9164.403674 secs 2024-04-26T20:51:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8467.380299 secs 2024-04-26T20:51:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:10 smithi189 ceph-mon[32756]: pgmap v5471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:10 smithi156 ceph-mon[32679]: pgmap v5471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:10 smithi092 ceph-mon[29156]: pgmap v5471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:12 smithi189 ceph-mon[32756]: pgmap v5472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:12 smithi156 ceph-mon[32679]: pgmap v5472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:12 smithi092 ceph-mon[29156]: pgmap v5472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9169.403812 secs 2024-04-26T20:51:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8472.380407 secs 2024-04-26T20:51:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9169.403812 secs 2024-04-26T20:51:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8472.380407 secs 2024-04-26T20:51:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9169.403812 secs 2024-04-26T20:51:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8472.380407 secs 2024-04-26T20:51:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:14 smithi189 ceph-mon[32756]: pgmap v5473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:14 smithi156 ceph-mon[32679]: pgmap v5473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:14 smithi092 ceph-mon[29156]: pgmap v5473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:16 smithi189 ceph-mon[32756]: pgmap v5474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:16 smithi156 ceph-mon[32679]: pgmap v5474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:16 smithi092 ceph-mon[29156]: pgmap v5474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:18 smithi189 ceph-mon[32756]: pgmap v5475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9174.403933 secs 2024-04-26T20:51:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8477.380535 secs 2024-04-26T20:51:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:18 smithi156 ceph-mon[32679]: pgmap v5475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9174.403933 secs 2024-04-26T20:51:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8477.380535 secs 2024-04-26T20:51:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:18 smithi092 ceph-mon[29156]: pgmap v5475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9174.403933 secs 2024-04-26T20:51:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8477.380535 secs 2024-04-26T20:51:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:20 smithi189 ceph-mon[32756]: pgmap v5476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:20 smithi156 ceph-mon[32679]: pgmap v5476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:20 smithi092 ceph-mon[29156]: pgmap v5476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:51:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:22 smithi189 ceph-mon[32756]: pgmap v5477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:51:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:22 smithi156 ceph-mon[32679]: pgmap v5477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:51:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:22 smithi092 ceph-mon[29156]: pgmap v5477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:51:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:51:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:23 smithi189 ceph-mon[32756]: pgmap v5478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:23 smithi189 ceph-mon[32756]: pgmap v5479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9179.404051 secs 2024-04-26T20:51:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8482.380597 secs 2024-04-26T20:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:23 smithi156 ceph-mon[32679]: pgmap v5478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:23 smithi156 ceph-mon[32679]: pgmap v5479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9179.404051 secs 2024-04-26T20:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8482.380597 secs 2024-04-26T20:51:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:23 smithi092 ceph-mon[29156]: pgmap v5478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:51:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:23 smithi092 ceph-mon[29156]: pgmap v5479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9179.404051 secs 2024-04-26T20:51:24.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8482.380597 secs 2024-04-26T20:51:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:25 smithi189 ceph-mon[32756]: pgmap v5480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:25 smithi156 ceph-mon[32679]: pgmap v5480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:25 smithi092 ceph-mon[29156]: pgmap v5480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:27 smithi189 ceph-mon[32756]: pgmap v5481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:27 smithi156 ceph-mon[32679]: pgmap v5481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:27 smithi092 ceph-mon[29156]: pgmap v5481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9184.404159 secs 2024-04-26T20:51:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8487.380711 secs 2024-04-26T20:51:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9184.404159 secs 2024-04-26T20:51:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8487.380711 secs 2024-04-26T20:51:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9184.404159 secs 2024-04-26T20:51:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8487.380711 secs 2024-04-26T20:51:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:29 smithi156 ceph-mon[32679]: pgmap v5482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:51:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:29 smithi092 ceph-mon[29156]: pgmap v5482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:51:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:29 smithi189 ceph-mon[32756]: pgmap v5482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:51:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:31 smithi156 ceph-mon[32679]: pgmap v5483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:31 smithi092 ceph-mon[29156]: pgmap v5483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:31 smithi189 ceph-mon[32756]: pgmap v5483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:51:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:33 smithi156 ceph-mon[32679]: pgmap v5484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:51:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9189.404303 secs 2024-04-26T20:51:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8492.380774 secs 2024-04-26T20:51:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:33 smithi189 ceph-mon[32756]: pgmap v5484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:51:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9189.404303 secs 2024-04-26T20:51:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8492.380774 secs 2024-04-26T20:51:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:33 smithi092 ceph-mon[29156]: pgmap v5484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:51:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9189.404303 secs 2024-04-26T20:51:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8492.380774 secs 2024-04-26T20:51:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:35 smithi156 ceph-mon[32679]: pgmap v5485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:35 smithi092 ceph-mon[29156]: pgmap v5485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:35 smithi189 ceph-mon[32756]: pgmap v5485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:51:37.233+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:51:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:51:37.233+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:51:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:51:37.234+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:51:37.235 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:51:37.234+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 74 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:51:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:37 smithi156 ceph-mon[32679]: pgmap v5486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:37 smithi092 ceph-mon[29156]: pgmap v5486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:37 smithi189 ceph-mon[32756]: pgmap v5486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9194.404425 secs 2024-04-26T20:51:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8497.380894 secs 2024-04-26T20:51:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9194.404425 secs 2024-04-26T20:51:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8497.380894 secs 2024-04-26T20:51:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9194.404425 secs 2024-04-26T20:51:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8497.380894 secs 2024-04-26T20:51:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:39 smithi156 ceph-mon[32679]: pgmap v5487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:39 smithi092 ceph-mon[29156]: pgmap v5487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:39 smithi189 ceph-mon[32756]: pgmap v5487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:41 smithi156 ceph-mon[32679]: pgmap v5488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:41 smithi092 ceph-mon[29156]: pgmap v5488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:41 smithi189 ceph-mon[32756]: pgmap v5488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:43 smithi156 ceph-mon[32679]: pgmap v5489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9199.404524 secs 2024-04-26T20:51:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8502.381010 secs 2024-04-26T20:51:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:43 smithi092 ceph-mon[29156]: pgmap v5489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9199.404524 secs 2024-04-26T20:51:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8502.381010 secs 2024-04-26T20:51:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:43 smithi189 ceph-mon[32756]: pgmap v5489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9199.404524 secs 2024-04-26T20:51:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8502.381010 secs 2024-04-26T20:51:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:45 smithi156 ceph-mon[32679]: pgmap v5490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:45 smithi092 ceph-mon[29156]: pgmap v5490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:45 smithi189 ceph-mon[32756]: pgmap v5490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:48.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:47 smithi156 ceph-mon[32679]: pgmap v5491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:47 smithi092 ceph-mon[29156]: pgmap v5491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:47 smithi189 ceph-mon[32756]: pgmap v5491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9204.404627 secs 2024-04-26T20:51:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8507.381143 secs 2024-04-26T20:51:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9204.404627 secs 2024-04-26T20:51:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8507.381143 secs 2024-04-26T20:51:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9204.404627 secs 2024-04-26T20:51:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8507.381143 secs 2024-04-26T20:51:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:49 smithi092 ceph-mon[29156]: pgmap v5492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:49 smithi189 ceph-mon[32756]: pgmap v5492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:49 smithi156 ceph-mon[32679]: pgmap v5492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:51 smithi092 ceph-mon[29156]: pgmap v5493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:51 smithi189 ceph-mon[32756]: pgmap v5493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:51 smithi156 ceph-mon[32679]: pgmap v5493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:53 smithi092 ceph-mon[29156]: pgmap v5494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9209.404745 secs 2024-04-26T20:51:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8512.381258 secs 2024-04-26T20:51:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:53 smithi189 ceph-mon[32756]: pgmap v5494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9209.404745 secs 2024-04-26T20:51:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8512.381258 secs 2024-04-26T20:51:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:53 smithi156 ceph-mon[32679]: pgmap v5494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9209.404745 secs 2024-04-26T20:51:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8512.381258 secs 2024-04-26T20:51:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:55 smithi092 ceph-mon[29156]: pgmap v5495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:55 smithi189 ceph-mon[32756]: pgmap v5495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:55 smithi156 ceph-mon[32679]: pgmap v5495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:51:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:57 smithi092 ceph-mon[29156]: pgmap v5496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:57 smithi189 ceph-mon[32756]: pgmap v5496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:57 smithi156 ceph-mon[32679]: pgmap v5496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:51:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9214.404894 secs 2024-04-26T20:51:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8517.381388 secs 2024-04-26T20:51:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9214.404894 secs 2024-04-26T20:51:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8517.381388 secs 2024-04-26T20:51:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9214.404894 secs 2024-04-26T20:51:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8517.381388 secs 2024-04-26T20:52:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:51:59 smithi092 ceph-mon[29156]: pgmap v5497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:51:59 smithi189 ceph-mon[32756]: pgmap v5497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:51:59 smithi156 ceph-mon[32679]: pgmap v5497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:01 smithi092 ceph-mon[29156]: pgmap v5498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:01 smithi189 ceph-mon[32756]: pgmap v5498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:01 smithi156 ceph-mon[32679]: pgmap v5498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:03 smithi092 ceph-mon[29156]: pgmap v5499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9219.405008 secs 2024-04-26T20:52:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8522.381453 secs 2024-04-26T20:52:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:03 smithi189 ceph-mon[32756]: pgmap v5499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9219.405008 secs 2024-04-26T20:52:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8522.381453 secs 2024-04-26T20:52:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:03 smithi156 ceph-mon[32679]: pgmap v5499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9219.405008 secs 2024-04-26T20:52:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8522.381453 secs 2024-04-26T20:52:06.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:05 smithi156 ceph-mon[32679]: pgmap v5500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:05 smithi092 ceph-mon[29156]: pgmap v5500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:05 smithi189 ceph-mon[32756]: pgmap v5500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:07 smithi092 ceph-mon[29156]: pgmap v5501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:07 smithi189 ceph-mon[32756]: pgmap v5501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:07 smithi156 ceph-mon[32679]: pgmap v5501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9224.405117 secs 2024-04-26T20:52:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8527.381533 secs 2024-04-26T20:52:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9224.405117 secs 2024-04-26T20:52:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8527.381533 secs 2024-04-26T20:52:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9224.405117 secs 2024-04-26T20:52:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8527.381533 secs 2024-04-26T20:52:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:09 smithi092 ceph-mon[29156]: pgmap v5502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:09 smithi189 ceph-mon[32756]: pgmap v5502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:09 smithi156 ceph-mon[32679]: pgmap v5502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:10 smithi092 ceph-mon[29156]: pgmap v5503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:10 smithi189 ceph-mon[32756]: pgmap v5503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:10 smithi156 ceph-mon[32679]: pgmap v5503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:13 smithi189 ceph-mon[32756]: pgmap v5504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9229.405185 secs 2024-04-26T20:52:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8532.381625 secs 2024-04-26T20:52:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:13 smithi156 ceph-mon[32679]: pgmap v5504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9229.405185 secs 2024-04-26T20:52:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8532.381625 secs 2024-04-26T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:13 smithi092 ceph-mon[29156]: pgmap v5504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9229.405185 secs 2024-04-26T20:52:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8532.381625 secs 2024-04-26T20:52:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:15 smithi189 ceph-mon[32756]: pgmap v5505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:15 smithi156 ceph-mon[32679]: pgmap v5505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:15 smithi092 ceph-mon[29156]: pgmap v5505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:17 smithi189 ceph-mon[32756]: pgmap v5506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:17 smithi156 ceph-mon[32679]: pgmap v5506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:17 smithi092 ceph-mon[29156]: pgmap v5506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9234.405299 secs 2024-04-26T20:52:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8537.381737 secs 2024-04-26T20:52:19.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9234.405299 secs 2024-04-26T20:52:19.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8537.381737 secs 2024-04-26T20:52:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9234.405299 secs 2024-04-26T20:52:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8537.381737 secs 2024-04-26T20:52:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:19 smithi189 ceph-mon[32756]: pgmap v5507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:19 smithi156 ceph-mon[32679]: pgmap v5507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:19 smithi092 ceph-mon[29156]: pgmap v5507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:21 smithi189 ceph-mon[32756]: pgmap v5508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:21 smithi156 ceph-mon[32679]: pgmap v5508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:21 smithi092 ceph-mon[29156]: pgmap v5508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:52:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: pgmap v5509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: pgmap v5510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:52:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: pgmap v5511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:52:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:52:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9239.405420 secs 2024-04-26T20:52:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8542.381852 secs 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: pgmap v5509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: pgmap v5510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: pgmap v5511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:52:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:52:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9239.405420 secs 2024-04-26T20:52:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8542.381852 secs 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: pgmap v5509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: pgmap v5510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: pgmap v5511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9239.405420 secs 2024-04-26T20:52:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8542.381852 secs 2024-04-26T20:52:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:25 smithi092 ceph-mon[29156]: pgmap v5512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:25 smithi189 ceph-mon[32756]: pgmap v5512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:25 smithi156 ceph-mon[32679]: pgmap v5512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:27 smithi092 ceph-mon[29156]: pgmap v5513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:27 smithi189 ceph-mon[32756]: pgmap v5513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:27 smithi156 ceph-mon[32679]: pgmap v5513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9244.405558 secs 2024-04-26T20:52:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8547.381949 secs 2024-04-26T20:52:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9244.405558 secs 2024-04-26T20:52:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8547.381949 secs 2024-04-26T20:52:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9244.405558 secs 2024-04-26T20:52:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8547.381949 secs 2024-04-26T20:52:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:29 smithi092 ceph-mon[29156]: pgmap v5514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:29 smithi189 ceph-mon[32756]: pgmap v5514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:29 smithi156 ceph-mon[32679]: pgmap v5514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:31 smithi092 ceph-mon[29156]: pgmap v5515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:32.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:31 smithi189 ceph-mon[32756]: pgmap v5515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:31 smithi156 ceph-mon[32679]: pgmap v5515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:52:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:33 smithi092 ceph-mon[29156]: pgmap v5516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:52:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9249.405655 secs 2024-04-26T20:52:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8552.382014 secs 2024-04-26T20:52:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:33 smithi189 ceph-mon[32756]: pgmap v5516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:52:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9249.405655 secs 2024-04-26T20:52:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8552.382014 secs 2024-04-26T20:52:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:33 smithi156 ceph-mon[32679]: pgmap v5516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:52:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9249.405655 secs 2024-04-26T20:52:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8552.382014 secs 2024-04-26T20:52:36.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:35 smithi156 ceph-mon[32679]: pgmap v5517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:35 smithi092 ceph-mon[29156]: pgmap v5517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:35 smithi189 ceph-mon[32756]: pgmap v5517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:37 smithi092 ceph-mon[29156]: pgmap v5518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:37 smithi189 ceph-mon[32756]: pgmap v5518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:37 smithi156 ceph-mon[32679]: pgmap v5518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9254.405776 secs 2024-04-26T20:52:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8557.382143 secs 2024-04-26T20:52:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9254.405776 secs 2024-04-26T20:52:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8557.382143 secs 2024-04-26T20:52:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9254.405776 secs 2024-04-26T20:52:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8557.382143 secs 2024-04-26T20:52:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:39 smithi092 ceph-mon[29156]: pgmap v5519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:39 smithi189 ceph-mon[32756]: pgmap v5519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:39 smithi156 ceph-mon[32679]: pgmap v5519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:41 smithi092 ceph-mon[29156]: pgmap v5520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:41 smithi189 ceph-mon[32756]: pgmap v5520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:41 smithi156 ceph-mon[32679]: pgmap v5520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:43 smithi189 ceph-mon[32756]: pgmap v5521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:43 smithi156 ceph-mon[32679]: pgmap v5521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:43 smithi092 ceph-mon[29156]: pgmap v5521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9259.405895 secs 2024-04-26T20:52:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8562.382246 secs 2024-04-26T20:52:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9259.405895 secs 2024-04-26T20:52:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8562.382246 secs 2024-04-26T20:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9259.405895 secs 2024-04-26T20:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8562.382246 secs 2024-04-26T20:52:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:45 smithi189 ceph-mon[32756]: pgmap v5522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:45 smithi156 ceph-mon[32679]: pgmap v5522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:45 smithi092 ceph-mon[29156]: pgmap v5522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:47 smithi092 ceph-mon[29156]: pgmap v5523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:47 smithi189 ceph-mon[32756]: pgmap v5523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:47 smithi156 ceph-mon[32679]: pgmap v5523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9264.406007 secs 2024-04-26T20:52:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8567.382335 secs 2024-04-26T20:52:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9264.406007 secs 2024-04-26T20:52:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8567.382335 secs 2024-04-26T20:52:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9264.406007 secs 2024-04-26T20:52:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8567.382335 secs 2024-04-26T20:52:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:49 smithi092 ceph-mon[29156]: pgmap v5524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:49 smithi189 ceph-mon[32756]: pgmap v5524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:49 smithi156 ceph-mon[32679]: pgmap v5524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:51 smithi092 ceph-mon[29156]: pgmap v5525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:51 smithi189 ceph-mon[32756]: pgmap v5525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:51 smithi156 ceph-mon[32679]: pgmap v5525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:53 smithi092 ceph-mon[29156]: pgmap v5526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9269.406132 secs 2024-04-26T20:52:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8572.382461 secs 2024-04-26T20:52:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:53 smithi189 ceph-mon[32756]: pgmap v5526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9269.406132 secs 2024-04-26T20:52:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8572.382461 secs 2024-04-26T20:52:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:53 smithi156 ceph-mon[32679]: pgmap v5526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9269.406132 secs 2024-04-26T20:52:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8572.382461 secs 2024-04-26T20:52:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:55 smithi092 ceph-mon[29156]: pgmap v5527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:55 smithi189 ceph-mon[32756]: pgmap v5527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:55 smithi156 ceph-mon[32679]: pgmap v5527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:52:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:57 smithi092 ceph-mon[29156]: pgmap v5528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:57 smithi189 ceph-mon[32756]: pgmap v5528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:57 smithi156 ceph-mon[32679]: pgmap v5528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:52:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9274.406227 secs 2024-04-26T20:52:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8577.382600 secs 2024-04-26T20:52:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9274.406227 secs 2024-04-26T20:52:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8577.382600 secs 2024-04-26T20:52:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9274.406227 secs 2024-04-26T20:52:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8577.382600 secs 2024-04-26T20:53:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:52:59 smithi092 ceph-mon[29156]: pgmap v5529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:52:59 smithi189 ceph-mon[32756]: pgmap v5529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:52:59 smithi156 ceph-mon[32679]: pgmap v5529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:01 smithi092 ceph-mon[29156]: pgmap v5530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:01 smithi189 ceph-mon[32756]: pgmap v5530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:01 smithi156 ceph-mon[32679]: pgmap v5530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:02 smithi092 ceph-mon[29156]: pgmap v5531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:02 smithi189 ceph-mon[32756]: pgmap v5531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:02 smithi156 ceph-mon[32679]: pgmap v5531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9279.406349 secs 2024-04-26T20:53:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:03 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 8582.382747 secs 2024-04-26T20:53:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:03 smithi092 ceph-mon[29156]: slow request 5761.593224 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:04.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9279.406349 secs 2024-04-26T20:53:04.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:03 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 8582.382747 secs 2024-04-26T20:53:04.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:03 smithi189 ceph-mon[32756]: slow request 5761.593224 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9279.406349 secs 2024-04-26T20:53:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:03 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 8582.382747 secs 2024-04-26T20:53:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:03 smithi156 ceph-mon[32679]: slow request 5761.593224 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:53:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:04 smithi189 ceph-mon[32756]: pgmap v5532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:04 smithi156 ceph-mon[32679]: pgmap v5532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:04 smithi092 ceph-mon[29156]: pgmap v5532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:07 smithi092 ceph-mon[29156]: pgmap v5533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:08.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:07 smithi189 ceph-mon[32756]: pgmap v5533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:07 smithi156 ceph-mon[32679]: pgmap v5533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9284.406463 secs 2024-04-26T20:53:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8587.382811 secs 2024-04-26T20:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9284.406463 secs 2024-04-26T20:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8587.382811 secs 2024-04-26T20:53:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9284.406463 secs 2024-04-26T20:53:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8587.382811 secs 2024-04-26T20:53:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:09 smithi092 ceph-mon[29156]: pgmap v5534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:09 smithi189 ceph-mon[32756]: pgmap v5534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:09 smithi156 ceph-mon[32679]: pgmap v5534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:11 smithi092 ceph-mon[29156]: pgmap v5535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:11 smithi189 ceph-mon[32756]: pgmap v5535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:11 smithi156 ceph-mon[32679]: pgmap v5535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:13 smithi092 ceph-mon[29156]: pgmap v5536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9289.406579 secs 2024-04-26T20:53:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8592.382931 secs 2024-04-26T20:53:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:13 smithi189 ceph-mon[32756]: pgmap v5536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9289.406579 secs 2024-04-26T20:53:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8592.382931 secs 2024-04-26T20:53:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:13 smithi156 ceph-mon[32679]: pgmap v5536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9289.406579 secs 2024-04-26T20:53:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8592.382931 secs 2024-04-26T20:53:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:15 smithi092 ceph-mon[29156]: pgmap v5537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:15 smithi189 ceph-mon[32756]: pgmap v5537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:15 smithi156 ceph-mon[32679]: pgmap v5537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:17 smithi092 ceph-mon[29156]: pgmap v5538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:17 smithi189 ceph-mon[32756]: pgmap v5538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:17 smithi156 ceph-mon[32679]: pgmap v5538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9294.406690 secs 2024-04-26T20:53:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8597.383002 secs 2024-04-26T20:53:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9294.406690 secs 2024-04-26T20:53:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8597.383002 secs 2024-04-26T20:53:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9294.406690 secs 2024-04-26T20:53:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8597.383002 secs 2024-04-26T20:53:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:19 smithi092 ceph-mon[29156]: pgmap v5539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:19 smithi189 ceph-mon[32756]: pgmap v5539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:19 smithi156 ceph-mon[32679]: pgmap v5539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:20 smithi092 ceph-mon[29156]: pgmap v5540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:20 smithi189 ceph-mon[32756]: pgmap v5540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:20 smithi156 ceph-mon[32679]: pgmap v5540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: pgmap v5541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9299.406778 secs 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8602.383090 secs 2024-04-26T20:53:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.322 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: pgmap v5541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9299.406778 secs 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8602.383090 secs 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.323 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.341 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: pgmap v5541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:24.341 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:53:24.341 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9299.406778 secs 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8602.383090 secs 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:24.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: pgmap v5542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: pgmap v5542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: pgmap v5542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:53:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: pgmap v5543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:27 smithi092 ceph-mon[29156]: pgmap v5544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:53:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:53:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:53:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:53:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: pgmap v5543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:27 smithi189 ceph-mon[32756]: pgmap v5544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: pgmap v5543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:27 smithi156 ceph-mon[32679]: pgmap v5544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9304.406917 secs 2024-04-26T20:53:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8607.383201 secs 2024-04-26T20:53:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9304.406917 secs 2024-04-26T20:53:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8607.383201 secs 2024-04-26T20:53:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9304.406917 secs 2024-04-26T20:53:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8607.383201 secs 2024-04-26T20:53:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:29 smithi092 ceph-mon[29156]: pgmap v5545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:53:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:29 smithi189 ceph-mon[32756]: pgmap v5545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:53:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:29 smithi156 ceph-mon[32679]: pgmap v5545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T20:53:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:31 smithi092 ceph-mon[29156]: pgmap v5546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:31 smithi189 ceph-mon[32756]: pgmap v5546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:31 smithi156 ceph-mon[32679]: pgmap v5546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:33 smithi092 ceph-mon[29156]: pgmap v5547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9309.407029 secs 2024-04-26T20:53:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8612.383336 secs 2024-04-26T20:53:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:33 smithi189 ceph-mon[32756]: pgmap v5547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9309.407029 secs 2024-04-26T20:53:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8612.383336 secs 2024-04-26T20:53:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:33 smithi156 ceph-mon[32679]: pgmap v5547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9309.407029 secs 2024-04-26T20:53:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8612.383336 secs 2024-04-26T20:53:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:35 smithi092 ceph-mon[29156]: pgmap v5548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:35 smithi189 ceph-mon[32756]: pgmap v5548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:35 smithi156 ceph-mon[32679]: pgmap v5548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T20:53:38.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:37 smithi156 ceph-mon[32679]: pgmap v5549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:53:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:37 smithi092 ceph-mon[29156]: pgmap v5549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:53:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:37 smithi189 ceph-mon[32756]: pgmap v5549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:53:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9314.407095 secs 2024-04-26T20:53:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8617.383389 secs 2024-04-26T20:53:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9314.407095 secs 2024-04-26T20:53:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8617.383389 secs 2024-04-26T20:53:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9314.407095 secs 2024-04-26T20:53:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8617.383389 secs 2024-04-26T20:53:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:39 smithi092 ceph-mon[29156]: pgmap v5550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:39 smithi189 ceph-mon[32756]: pgmap v5550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:39 smithi156 ceph-mon[32679]: pgmap v5550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:41 smithi189 ceph-mon[32756]: pgmap v5551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:41 smithi156 ceph-mon[32679]: pgmap v5551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:41 smithi092 ceph-mon[29156]: pgmap v5551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:43 smithi189 ceph-mon[32756]: pgmap v5552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:43 smithi156 ceph-mon[32679]: pgmap v5552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:43 smithi092 ceph-mon[29156]: pgmap v5552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9319.407212 secs 2024-04-26T20:53:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8622.383478 secs 2024-04-26T20:53:44.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9319.407212 secs 2024-04-26T20:53:44.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8622.383478 secs 2024-04-26T20:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9319.407212 secs 2024-04-26T20:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8622.383478 secs 2024-04-26T20:53:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:45 smithi189 ceph-mon[32756]: pgmap v5553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:45 smithi156 ceph-mon[32679]: pgmap v5553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:45 smithi092 ceph-mon[29156]: pgmap v5553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:47 smithi189 ceph-mon[32756]: pgmap v5554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:47 smithi156 ceph-mon[32679]: pgmap v5554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:47 smithi092 ceph-mon[29156]: pgmap v5554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9324.407348 secs 2024-04-26T20:53:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:49 smithi189 ceph-mon[32756]: pgmap v5555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8627.383595 secs 2024-04-26T20:53:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9324.407348 secs 2024-04-26T20:53:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:49 smithi156 ceph-mon[32679]: pgmap v5555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8627.383595 secs 2024-04-26T20:53:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9324.407348 secs 2024-04-26T20:53:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:49 smithi092 ceph-mon[29156]: pgmap v5555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8627.383595 secs 2024-04-26T20:53:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:51 smithi189 ceph-mon[32756]: pgmap v5556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:51 smithi156 ceph-mon[32679]: pgmap v5556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:51 smithi092 ceph-mon[29156]: pgmap v5556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:53 smithi189 ceph-mon[32756]: pgmap v5557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:53 smithi156 ceph-mon[32679]: pgmap v5557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:53 smithi092 ceph-mon[29156]: pgmap v5557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9329.407494 secs 2024-04-26T20:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8632.383690 secs 2024-04-26T20:53:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9329.407494 secs 2024-04-26T20:53:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8632.383690 secs 2024-04-26T20:53:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9329.407494 secs 2024-04-26T20:53:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8632.383690 secs 2024-04-26T20:53:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:55 smithi189 ceph-mon[32756]: pgmap v5558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:55 smithi156 ceph-mon[32679]: pgmap v5558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:55 smithi092 ceph-mon[29156]: pgmap v5558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:57 smithi189 ceph-mon[32756]: pgmap v5559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:57 smithi156 ceph-mon[32679]: pgmap v5559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:57 smithi092 ceph-mon[29156]: pgmap v5559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:53:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9334.407605 secs 2024-04-26T20:53:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:59 smithi189 ceph-mon[32756]: pgmap v5560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:53:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8637.383808 secs 2024-04-26T20:53:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9334.407605 secs 2024-04-26T20:53:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:59 smithi156 ceph-mon[32679]: pgmap v5560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:53:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8637.383808 secs 2024-04-26T20:53:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9334.407605 secs 2024-04-26T20:53:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:59 smithi092 ceph-mon[29156]: pgmap v5560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:53:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:53:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8637.383808 secs 2024-04-26T20:54:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:01 smithi189 ceph-mon[32756]: pgmap v5561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:01 smithi156 ceph-mon[32679]: pgmap v5561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:01 smithi092 ceph-mon[29156]: pgmap v5561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-mon[29156]: pgmap v5562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:03.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:54:03.353+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:03.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:54:03.353+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:03.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:54:03.353+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:03.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:54:03.353+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:03.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:54:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:54:03.353+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:54:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:03 smithi189 ceph-mon[32756]: pgmap v5562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:03 smithi156 ceph-mon[32679]: pgmap v5562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9339.407719 secs 2024-04-26T20:54:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8642.383926 secs 2024-04-26T20:54:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9339.407719 secs 2024-04-26T20:54:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8642.383926 secs 2024-04-26T20:54:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9339.407719 secs 2024-04-26T20:54:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8642.383926 secs 2024-04-26T20:54:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:05 smithi189 ceph-mon[32756]: pgmap v5563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:05 smithi156 ceph-mon[32679]: pgmap v5563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:05 smithi092 ceph-mon[29156]: pgmap v5563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:07 smithi189 ceph-mon[32756]: pgmap v5564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:07.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:07 smithi092 ceph-mon[29156]: pgmap v5564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:07 smithi156 ceph-mon[32679]: pgmap v5564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9344.407816 secs 2024-04-26T20:54:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:09 smithi189 ceph-mon[32756]: pgmap v5565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8647.384055 secs 2024-04-26T20:54:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9344.407816 secs 2024-04-26T20:54:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:09 smithi156 ceph-mon[32679]: pgmap v5565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8647.384055 secs 2024-04-26T20:54:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9344.407816 secs 2024-04-26T20:54:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:09 smithi092 ceph-mon[29156]: pgmap v5565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8647.384055 secs 2024-04-26T20:54:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:11 smithi189 ceph-mon[32756]: pgmap v5566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:11 smithi156 ceph-mon[32679]: pgmap v5566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:11 smithi092 ceph-mon[29156]: pgmap v5566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:13 smithi189 ceph-mon[32756]: pgmap v5567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:13 smithi156 ceph-mon[32679]: pgmap v5567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:13 smithi092 ceph-mon[29156]: pgmap v5567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T20:54:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9349.407908 secs 2024-04-26T20:54:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8652.384191 secs 2024-04-26T20:54:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9349.407908 secs 2024-04-26T20:54:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8652.384191 secs 2024-04-26T20:54:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9349.407908 secs 2024-04-26T20:54:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8652.384191 secs 2024-04-26T20:54:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:15 smithi189 ceph-mon[32756]: pgmap v5568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:15 smithi156 ceph-mon[32679]: pgmap v5568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:15 smithi092 ceph-mon[29156]: pgmap v5568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T20:54:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:17 smithi189 ceph-mon[32756]: pgmap v5569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:17 smithi156 ceph-mon[32679]: pgmap v5569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:17 smithi092 ceph-mon[29156]: pgmap v5569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9354.407990 secs 2024-04-26T20:54:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:19 smithi189 ceph-mon[32756]: pgmap v5570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8657.384331 secs 2024-04-26T20:54:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9354.407990 secs 2024-04-26T20:54:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:19 smithi156 ceph-mon[32679]: pgmap v5570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8657.384331 secs 2024-04-26T20:54:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9354.407990 secs 2024-04-26T20:54:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:19 smithi092 ceph-mon[29156]: pgmap v5570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8657.384331 secs 2024-04-26T20:54:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:21 smithi189 ceph-mon[32756]: pgmap v5571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:21 smithi156 ceph-mon[32679]: pgmap v5571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:21 smithi092 ceph-mon[29156]: pgmap v5571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:23 smithi189 ceph-mon[32756]: pgmap v5572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:23 smithi156 ceph-mon[32679]: pgmap v5572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:23 smithi092 ceph-mon[29156]: pgmap v5572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9359.408054 secs 2024-04-26T20:54:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8662.384405 secs 2024-04-26T20:54:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9359.408054 secs 2024-04-26T20:54:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8662.384405 secs 2024-04-26T20:54:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9359.408054 secs 2024-04-26T20:54:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8662.384405 secs 2024-04-26T20:54:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:25 smithi156 ceph-mon[32679]: pgmap v5573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:25 smithi092 ceph-mon[29156]: pgmap v5573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:25 smithi189 ceph-mon[32756]: pgmap v5573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:54:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:27 smithi156 ceph-mon[32679]: pgmap v5574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:54:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:27 smithi092 ceph-mon[29156]: pgmap v5574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:54:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:27 smithi189 ceph-mon[32756]: pgmap v5574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:54:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:54:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:54:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:28 smithi156 ceph-mon[32679]: pgmap v5575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:54:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:28 smithi156 ceph-mon[32679]: pgmap v5576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9364.408132 secs 2024-04-26T20:54:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:28 smithi092 ceph-mon[29156]: pgmap v5575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:54:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:28 smithi092 ceph-mon[29156]: pgmap v5576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9364.408132 secs 2024-04-26T20:54:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:28 smithi189 ceph-mon[32756]: pgmap v5575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:54:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:28 smithi189 ceph-mon[32756]: pgmap v5576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9364.408132 secs 2024-04-26T20:54:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8667.384484 secs 2024-04-26T20:54:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8667.384484 secs 2024-04-26T20:54:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8667.384484 secs 2024-04-26T20:54:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:30 smithi156 ceph-mon[32679]: pgmap v5577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:30 smithi092 ceph-mon[29156]: pgmap v5577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:30 smithi189 ceph-mon[32756]: pgmap v5577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:32 smithi156 ceph-mon[32679]: pgmap v5578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:32 smithi092 ceph-mon[29156]: pgmap v5578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:32 smithi189 ceph-mon[32756]: pgmap v5578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9369.408245 secs 2024-04-26T20:54:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9369.408245 secs 2024-04-26T20:54:34.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9369.408245 secs 2024-04-26T20:54:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:34 smithi156 ceph-mon[32679]: pgmap v5579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8672.384575 secs 2024-04-26T20:54:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:34 smithi092 ceph-mon[29156]: pgmap v5579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8672.384575 secs 2024-04-26T20:54:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:34 smithi189 ceph-mon[32756]: pgmap v5579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:54:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8672.384575 secs 2024-04-26T20:54:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:36 smithi156 ceph-mon[32679]: pgmap v5580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:36 smithi092 ceph-mon[29156]: pgmap v5580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:36 smithi189 ceph-mon[32756]: pgmap v5580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:54:37.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:54:37.258+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:54:37.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:54:37.258+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:54:37.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:54:37.258+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:54:37.260 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:54:37.258+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 75 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:54:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:38 smithi156 ceph-mon[32679]: pgmap v5581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:54:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9374.408369 secs 2024-04-26T20:54:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:38 smithi092 ceph-mon[29156]: pgmap v5581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:54:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9374.408369 secs 2024-04-26T20:54:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:38 smithi189 ceph-mon[32756]: pgmap v5581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:54:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9374.408369 secs 2024-04-26T20:54:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8677.384642 secs 2024-04-26T20:54:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8677.384642 secs 2024-04-26T20:54:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8677.384642 secs 2024-04-26T20:54:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:40 smithi092 ceph-mon[29156]: pgmap v5582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:40 smithi189 ceph-mon[32756]: pgmap v5582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:40 smithi156 ceph-mon[32679]: pgmap v5582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:42 smithi092 ceph-mon[29156]: pgmap v5583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:42 smithi189 ceph-mon[32756]: pgmap v5583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:42 smithi156 ceph-mon[32679]: pgmap v5583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9379.408504 secs 2024-04-26T20:54:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9379.408504 secs 2024-04-26T20:54:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9379.408504 secs 2024-04-26T20:54:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:44 smithi092 ceph-mon[29156]: pgmap v5584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8682.384763 secs 2024-04-26T20:54:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:44 smithi189 ceph-mon[32756]: pgmap v5584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8682.384763 secs 2024-04-26T20:54:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:44 smithi156 ceph-mon[32679]: pgmap v5584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8682.384763 secs 2024-04-26T20:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:46 smithi092 ceph-mon[29156]: pgmap v5585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:46 smithi189 ceph-mon[32756]: pgmap v5585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:46 smithi156 ceph-mon[32679]: pgmap v5585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:48 smithi092 ceph-mon[29156]: pgmap v5586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9384.408618 secs 2024-04-26T20:54:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:48 smithi189 ceph-mon[32756]: pgmap v5586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9384.408618 secs 2024-04-26T20:54:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:48 smithi156 ceph-mon[32679]: pgmap v5586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9384.408618 secs 2024-04-26T20:54:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8687.384903 secs 2024-04-26T20:54:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8687.384903 secs 2024-04-26T20:54:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8687.384903 secs 2024-04-26T20:54:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:50 smithi092 ceph-mon[29156]: pgmap v5587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:50 smithi189 ceph-mon[32756]: pgmap v5587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:50 smithi156 ceph-mon[32679]: pgmap v5587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:52 smithi092 ceph-mon[29156]: pgmap v5588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:52 smithi189 ceph-mon[32756]: pgmap v5588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:52 smithi156 ceph-mon[32679]: pgmap v5588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9389.408764 secs 2024-04-26T20:54:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8692.384968 secs 2024-04-26T20:54:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9389.408764 secs 2024-04-26T20:54:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8692.384968 secs 2024-04-26T20:54:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9389.408764 secs 2024-04-26T20:54:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8692.384968 secs 2024-04-26T20:54:54.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:54 smithi092 ceph-mon[29156]: pgmap v5589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:54 smithi189 ceph-mon[32756]: pgmap v5589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:54 smithi156 ceph-mon[32679]: pgmap v5589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:56 smithi092 ceph-mon[29156]: pgmap v5590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:56 smithi189 ceph-mon[32756]: pgmap v5590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:56 smithi156 ceph-mon[32679]: pgmap v5590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:54:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:58 smithi092 ceph-mon[29156]: pgmap v5591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9394.408891 secs 2024-04-26T20:54:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:54:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8697.385069 secs 2024-04-26T20:54:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:58 smithi189 ceph-mon[32756]: pgmap v5591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9394.408891 secs 2024-04-26T20:54:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:54:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8697.385069 secs 2024-04-26T20:54:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:58 smithi156 ceph-mon[32679]: pgmap v5591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:54:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9394.408891 secs 2024-04-26T20:54:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:54:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8697.385069 secs 2024-04-26T20:55:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:00 smithi092 ceph-mon[29156]: pgmap v5592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:00 smithi189 ceph-mon[32756]: pgmap v5592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:00 smithi156 ceph-mon[32679]: pgmap v5592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:02 smithi092 ceph-mon[29156]: pgmap v5593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:02 smithi189 ceph-mon[32756]: pgmap v5593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:02 smithi156 ceph-mon[32679]: pgmap v5593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9399.409002 secs 2024-04-26T20:55:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8702.385190 secs 2024-04-26T20:55:04.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9399.409002 secs 2024-04-26T20:55:04.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8702.385190 secs 2024-04-26T20:55:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9399.409002 secs 2024-04-26T20:55:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8702.385190 secs 2024-04-26T20:55:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:04 smithi092 ceph-mon[29156]: pgmap v5594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:04 smithi189 ceph-mon[32756]: pgmap v5594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:04 smithi156 ceph-mon[32679]: pgmap v5594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:06 smithi189 ceph-mon[32756]: pgmap v5595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:06 smithi156 ceph-mon[32679]: pgmap v5595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:06 smithi092 ceph-mon[29156]: pgmap v5595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:08 smithi189 ceph-mon[32756]: pgmap v5596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9404.409109 secs 2024-04-26T20:55:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8707.385301 secs 2024-04-26T20:55:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:08 smithi156 ceph-mon[32679]: pgmap v5596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9404.409109 secs 2024-04-26T20:55:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8707.385301 secs 2024-04-26T20:55:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:08 smithi092 ceph-mon[29156]: pgmap v5596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9404.409109 secs 2024-04-26T20:55:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8707.385301 secs 2024-04-26T20:55:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:10 smithi189 ceph-mon[32756]: pgmap v5597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:11.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:10 smithi156 ceph-mon[32679]: pgmap v5597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:10 smithi092 ceph-mon[29156]: pgmap v5597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:12 smithi189 ceph-mon[32756]: pgmap v5598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:12 smithi156 ceph-mon[32679]: pgmap v5598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:12 smithi092 ceph-mon[29156]: pgmap v5598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9409.409193 secs 2024-04-26T20:55:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8712.385356 secs 2024-04-26T20:55:14.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9409.409193 secs 2024-04-26T20:55:14.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8712.385356 secs 2024-04-26T20:55:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9409.409193 secs 2024-04-26T20:55:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8712.385356 secs 2024-04-26T20:55:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:14 smithi189 ceph-mon[32756]: pgmap v5599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:14 smithi156 ceph-mon[32679]: pgmap v5599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:14 smithi092 ceph-mon[29156]: pgmap v5599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T20:55:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:16 smithi189 ceph-mon[32756]: pgmap v5600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:16 smithi156 ceph-mon[32679]: pgmap v5600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:16 smithi092 ceph-mon[29156]: pgmap v5600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T20:55:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:18 smithi189 ceph-mon[32756]: pgmap v5601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9414.409267 secs 2024-04-26T20:55:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8717.385433 secs 2024-04-26T20:55:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:18 smithi156 ceph-mon[32679]: pgmap v5601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9414.409267 secs 2024-04-26T20:55:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8717.385433 secs 2024-04-26T20:55:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:18 smithi092 ceph-mon[29156]: pgmap v5601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9414.409267 secs 2024-04-26T20:55:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8717.385433 secs 2024-04-26T20:55:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:20 smithi189 ceph-mon[32756]: pgmap v5602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:20 smithi156 ceph-mon[32679]: pgmap v5602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:20 smithi092 ceph-mon[29156]: pgmap v5602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:55:22.265+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:55:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:55:22.265+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:55:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:55:22.265+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:55:22.266 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:55:22.265+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 76 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:55:23.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:22 smithi189 ceph-mon[32756]: pgmap v5603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:22 smithi156 ceph-mon[32679]: pgmap v5603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:22 smithi092 ceph-mon[29156]: pgmap v5603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9419.409330 secs 2024-04-26T20:55:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8722.385543 secs 2024-04-26T20:55:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9419.409330 secs 2024-04-26T20:55:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8722.385543 secs 2024-04-26T20:55:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9419.409330 secs 2024-04-26T20:55:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8722.385543 secs 2024-04-26T20:55:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:24 smithi156 ceph-mon[32679]: pgmap v5604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:24 smithi092 ceph-mon[29156]: pgmap v5604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:24 smithi189 ceph-mon[32756]: pgmap v5604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:26 smithi156 ceph-mon[32679]: pgmap v5605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:26 smithi092 ceph-mon[29156]: pgmap v5605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:26 smithi189 ceph-mon[32756]: pgmap v5605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:55:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: pgmap v5606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:55:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9424.409423 secs 2024-04-26T20:55:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8727.385602 secs 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: pgmap v5606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9424.409423 secs 2024-04-26T20:55:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8727.385602 secs 2024-04-26T20:55:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: pgmap v5606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:55:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:55:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:55:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9424.409423 secs 2024-04-26T20:55:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8727.385602 secs 2024-04-26T20:55:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:29 smithi156 ceph-mon[32679]: pgmap v5607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:55:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:29 smithi156 ceph-mon[32679]: pgmap v5608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:55:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:29 smithi092 ceph-mon[29156]: pgmap v5607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:55:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:29 smithi092 ceph-mon[29156]: pgmap v5608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:29 smithi189 ceph-mon[32756]: pgmap v5607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:29 smithi189 ceph-mon[32756]: pgmap v5608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:55:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:31 smithi156 ceph-mon[32679]: pgmap v5609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:31 smithi092 ceph-mon[29156]: pgmap v5609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:31 smithi189 ceph-mon[32756]: pgmap v5609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:33 smithi156 ceph-mon[32679]: pgmap v5610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9429.409521 secs 2024-04-26T20:55:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8732.385708 secs 2024-04-26T20:55:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:33 smithi189 ceph-mon[32756]: pgmap v5610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9429.409521 secs 2024-04-26T20:55:34.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8732.385708 secs 2024-04-26T20:55:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:33 smithi092 ceph-mon[29156]: pgmap v5610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9429.409521 secs 2024-04-26T20:55:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8732.385708 secs 2024-04-26T20:55:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:35 smithi156 ceph-mon[32679]: pgmap v5611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:35 smithi092 ceph-mon[29156]: pgmap v5611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:35 smithi189 ceph-mon[32756]: pgmap v5611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:37 smithi156 ceph-mon[32679]: pgmap v5612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:37 smithi092 ceph-mon[29156]: pgmap v5612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:37 smithi189 ceph-mon[32756]: pgmap v5612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:55:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9434.409642 secs 2024-04-26T20:55:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8737.385847 secs 2024-04-26T20:55:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9434.409642 secs 2024-04-26T20:55:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8737.385847 secs 2024-04-26T20:55:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9434.409642 secs 2024-04-26T20:55:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8737.385847 secs 2024-04-26T20:55:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:39 smithi156 ceph-mon[32679]: pgmap v5613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:55:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:39 smithi092 ceph-mon[29156]: pgmap v5613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:55:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:39 smithi189 ceph-mon[32756]: pgmap v5613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:55:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:41 smithi156 ceph-mon[32679]: pgmap v5614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:41 smithi092 ceph-mon[29156]: pgmap v5614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:41 smithi189 ceph-mon[32756]: pgmap v5614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:43 smithi092 ceph-mon[29156]: pgmap v5615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9439.409777 secs 2024-04-26T20:55:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8742.385947 secs 2024-04-26T20:55:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:43 smithi189 ceph-mon[32756]: pgmap v5615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9439.409777 secs 2024-04-26T20:55:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8742.385947 secs 2024-04-26T20:55:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:43 smithi156 ceph-mon[32679]: pgmap v5615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9439.409777 secs 2024-04-26T20:55:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8742.385947 secs 2024-04-26T20:55:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:45 smithi092 ceph-mon[29156]: pgmap v5616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:45 smithi189 ceph-mon[32756]: pgmap v5616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:45 smithi156 ceph-mon[32679]: pgmap v5616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:47 smithi092 ceph-mon[29156]: pgmap v5617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:47 smithi189 ceph-mon[32756]: pgmap v5617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:47 smithi156 ceph-mon[32679]: pgmap v5617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9444.409872 secs 2024-04-26T20:55:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8747.386072 secs 2024-04-26T20:55:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9444.409872 secs 2024-04-26T20:55:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8747.386072 secs 2024-04-26T20:55:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9444.409872 secs 2024-04-26T20:55:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8747.386072 secs 2024-04-26T20:55:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:49 smithi092 ceph-mon[29156]: pgmap v5618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:49 smithi189 ceph-mon[32756]: pgmap v5618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:49 smithi156 ceph-mon[32679]: pgmap v5618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:51 smithi092 ceph-mon[29156]: pgmap v5619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:51 smithi189 ceph-mon[32756]: pgmap v5619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:51 smithi156 ceph-mon[32679]: pgmap v5619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:53 smithi092 ceph-mon[29156]: pgmap v5620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9449.409990 secs 2024-04-26T20:55:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8752.386182 secs 2024-04-26T20:55:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:53 smithi189 ceph-mon[32756]: pgmap v5620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9449.409990 secs 2024-04-26T20:55:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8752.386182 secs 2024-04-26T20:55:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:53 smithi156 ceph-mon[32679]: pgmap v5620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9449.409990 secs 2024-04-26T20:55:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8752.386182 secs 2024-04-26T20:55:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:55 smithi092 ceph-mon[29156]: pgmap v5621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:55 smithi189 ceph-mon[32756]: pgmap v5621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:55 smithi156 ceph-mon[32679]: pgmap v5621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:55:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:57 smithi092 ceph-mon[29156]: pgmap v5622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:57 smithi189 ceph-mon[32756]: pgmap v5622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:57 smithi156 ceph-mon[32679]: pgmap v5622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:55:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9454.410068 secs 2024-04-26T20:55:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8757.386270 secs 2024-04-26T20:55:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9454.410068 secs 2024-04-26T20:55:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8757.386270 secs 2024-04-26T20:55:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9454.410068 secs 2024-04-26T20:55:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8757.386270 secs 2024-04-26T20:56:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:55:59 smithi092 ceph-mon[29156]: pgmap v5623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:55:59 smithi189 ceph-mon[32756]: pgmap v5623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:55:59 smithi156 ceph-mon[32679]: pgmap v5623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:01 smithi092 ceph-mon[29156]: pgmap v5624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:01 smithi189 ceph-mon[32756]: pgmap v5624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:01 smithi156 ceph-mon[32679]: pgmap v5624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:03 smithi092 ceph-mon[29156]: pgmap v5625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9459.410136 secs 2024-04-26T20:56:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8762.386386 secs 2024-04-26T20:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:03 smithi189 ceph-mon[32756]: pgmap v5625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9459.410136 secs 2024-04-26T20:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8762.386386 secs 2024-04-26T20:56:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:03 smithi156 ceph-mon[32679]: pgmap v5625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9459.410136 secs 2024-04-26T20:56:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8762.386386 secs 2024-04-26T20:56:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:05 smithi092 ceph-mon[29156]: pgmap v5626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:05 smithi189 ceph-mon[32756]: pgmap v5626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:05 smithi156 ceph-mon[32679]: pgmap v5626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:07 smithi092 ceph-mon[29156]: pgmap v5627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:07 smithi189 ceph-mon[32756]: pgmap v5627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:07 smithi156 ceph-mon[32679]: pgmap v5627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9464.410251 secs 2024-04-26T20:56:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8767.386457 secs 2024-04-26T20:56:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9464.410251 secs 2024-04-26T20:56:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8767.386457 secs 2024-04-26T20:56:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9464.410251 secs 2024-04-26T20:56:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8767.386457 secs 2024-04-26T20:56:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:09 smithi092 ceph-mon[29156]: pgmap v5628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:10.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:09 smithi156 ceph-mon[32679]: pgmap v5628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:09 smithi189 ceph-mon[32756]: pgmap v5628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:11 smithi092 ceph-mon[29156]: pgmap v5629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:11 smithi189 ceph-mon[32756]: pgmap v5629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:11 smithi156 ceph-mon[32679]: pgmap v5629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:13 smithi092 ceph-mon[29156]: pgmap v5630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9469.410336 secs 2024-04-26T20:56:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8772.386538 secs 2024-04-26T20:56:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:13 smithi189 ceph-mon[32756]: pgmap v5630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9469.410336 secs 2024-04-26T20:56:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8772.386538 secs 2024-04-26T20:56:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:13 smithi156 ceph-mon[32679]: pgmap v5630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9469.410336 secs 2024-04-26T20:56:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8772.386538 secs 2024-04-26T20:56:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:15 smithi092 ceph-mon[29156]: pgmap v5631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:15 smithi189 ceph-mon[32756]: pgmap v5631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:15 smithi156 ceph-mon[32679]: pgmap v5631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:17 smithi189 ceph-mon[32756]: pgmap v5632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:17 smithi156 ceph-mon[32679]: pgmap v5632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:17 smithi092 ceph-mon[29156]: pgmap v5632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9474.410459 secs 2024-04-26T20:56:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8777.386603 secs 2024-04-26T20:56:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9474.410459 secs 2024-04-26T20:56:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8777.386603 secs 2024-04-26T20:56:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9474.410459 secs 2024-04-26T20:56:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8777.386603 secs 2024-04-26T20:56:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:20 smithi189 ceph-mon[32756]: pgmap v5633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:20 smithi156 ceph-mon[32679]: pgmap v5633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:20 smithi092 ceph-mon[29156]: pgmap v5633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:22 smithi189 ceph-mon[32756]: pgmap v5634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:22 smithi156 ceph-mon[32679]: pgmap v5634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:22 smithi092 ceph-mon[29156]: pgmap v5634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:24 smithi189 ceph-mon[32756]: pgmap v5635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9479.410596 secs 2024-04-26T20:56:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8782.386670 secs 2024-04-26T20:56:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:24 smithi156 ceph-mon[32679]: pgmap v5635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9479.410596 secs 2024-04-26T20:56:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8782.386670 secs 2024-04-26T20:56:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:24 smithi092 ceph-mon[29156]: pgmap v5635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9479.410596 secs 2024-04-26T20:56:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8782.386670 secs 2024-04-26T20:56:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:25 smithi189 ceph-mon[32756]: pgmap v5636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:25 smithi156 ceph-mon[32679]: pgmap v5636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:25 smithi092 ceph-mon[29156]: pgmap v5636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:27 smithi189 ceph-mon[32756]: pgmap v5637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:27 smithi156 ceph-mon[32679]: pgmap v5637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:27 smithi092 ceph-mon[29156]: pgmap v5637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: pgmap v5638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9484.410688 secs 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8787.386739 secs 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: pgmap v5639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: pgmap v5640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: pgmap v5638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9484.410688 secs 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8787.386739 secs 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: pgmap v5639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:56:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: pgmap v5640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: pgmap v5638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9484.410688 secs 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8787.386739 secs 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: pgmap v5639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: pgmap v5640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:56:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:31 smithi156 ceph-mon[32679]: pgmap v5641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:31 smithi092 ceph-mon[29156]: pgmap v5641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:31 smithi189 ceph-mon[32756]: pgmap v5641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:33 smithi156 ceph-mon[32679]: pgmap v5642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:56:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9489.410807 secs 2024-04-26T20:56:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8792.386835 secs 2024-04-26T20:56:34.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:33 smithi189 ceph-mon[32756]: pgmap v5642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:56:34.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9489.410807 secs 2024-04-26T20:56:34.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8792.386835 secs 2024-04-26T20:56:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:33 smithi092 ceph-mon[29156]: pgmap v5642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:56:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9489.410807 secs 2024-04-26T20:56:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8792.386835 secs 2024-04-26T20:56:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:35 smithi156 ceph-mon[32679]: pgmap v5643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:35 smithi092 ceph-mon[29156]: pgmap v5643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:35 smithi189 ceph-mon[32756]: pgmap v5643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:37 smithi156 ceph-mon[32679]: pgmap v5644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:37 smithi092 ceph-mon[29156]: pgmap v5644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:37 smithi189 ceph-mon[32756]: pgmap v5644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:56:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9494.410918 secs 2024-04-26T20:56:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8797.386951 secs 2024-04-26T20:56:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9494.410918 secs 2024-04-26T20:56:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8797.386951 secs 2024-04-26T20:56:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9494.410918 secs 2024-04-26T20:56:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8797.386951 secs 2024-04-26T20:56:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:39 smithi156 ceph-mon[32679]: pgmap v5645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:56:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:39 smithi092 ceph-mon[29156]: pgmap v5645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:56:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:39 smithi189 ceph-mon[32756]: pgmap v5645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:56:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:41 smithi156 ceph-mon[32679]: pgmap v5646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:41 smithi092 ceph-mon[29156]: pgmap v5646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:41 smithi189 ceph-mon[32756]: pgmap v5646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:43 smithi156 ceph-mon[32679]: pgmap v5647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9499.410995 secs 2024-04-26T20:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8802.387033 secs 2024-04-26T20:56:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:43 smithi092 ceph-mon[29156]: pgmap v5647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9499.410995 secs 2024-04-26T20:56:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8802.387033 secs 2024-04-26T20:56:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:43 smithi189 ceph-mon[32756]: pgmap v5647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9499.410995 secs 2024-04-26T20:56:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8802.387033 secs 2024-04-26T20:56:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:45 smithi156 ceph-mon[32679]: pgmap v5648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:45 smithi092 ceph-mon[29156]: pgmap v5648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:45 smithi189 ceph-mon[32756]: pgmap v5648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:47 smithi156 ceph-mon[32679]: pgmap v5649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:47 smithi092 ceph-mon[29156]: pgmap v5649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:47 smithi189 ceph-mon[32756]: pgmap v5649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9504.411103 secs 2024-04-26T20:56:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8807.387141 secs 2024-04-26T20:56:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9504.411103 secs 2024-04-26T20:56:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8807.387141 secs 2024-04-26T20:56:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9504.411103 secs 2024-04-26T20:56:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8807.387141 secs 2024-04-26T20:56:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:49 smithi092 ceph-mon[29156]: pgmap v5650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:49 smithi189 ceph-mon[32756]: pgmap v5650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:49 smithi156 ceph-mon[32679]: pgmap v5650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:51 smithi092 ceph-mon[29156]: pgmap v5651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:51 smithi189 ceph-mon[32756]: pgmap v5651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:51 smithi156 ceph-mon[32679]: pgmap v5651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:53 smithi092 ceph-mon[29156]: pgmap v5652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9509.411211 secs 2024-04-26T20:56:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8812.387291 secs 2024-04-26T20:56:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:53 smithi189 ceph-mon[32756]: pgmap v5652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9509.411211 secs 2024-04-26T20:56:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8812.387291 secs 2024-04-26T20:56:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:53 smithi156 ceph-mon[32679]: pgmap v5652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9509.411211 secs 2024-04-26T20:56:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8812.387291 secs 2024-04-26T20:56:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:55 smithi092 ceph-mon[29156]: pgmap v5653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:55 smithi189 ceph-mon[32756]: pgmap v5653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:55 smithi156 ceph-mon[32679]: pgmap v5653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:56:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:57 smithi092 ceph-mon[29156]: pgmap v5654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:57 smithi189 ceph-mon[32756]: pgmap v5654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:57 smithi156 ceph-mon[32679]: pgmap v5654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:56:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9514.411327 secs 2024-04-26T20:56:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8817.387386 secs 2024-04-26T20:56:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9514.411327 secs 2024-04-26T20:56:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8817.387386 secs 2024-04-26T20:56:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9514.411327 secs 2024-04-26T20:56:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8817.387386 secs 2024-04-26T20:57:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:56:59 smithi092 ceph-mon[29156]: pgmap v5655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:56:59 smithi189 ceph-mon[32756]: pgmap v5655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:56:59 smithi156 ceph-mon[32679]: pgmap v5655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:01 smithi092 ceph-mon[29156]: pgmap v5656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:01 smithi189 ceph-mon[32756]: pgmap v5656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:01 smithi156 ceph-mon[32679]: pgmap v5656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:03 smithi092 ceph-mon[29156]: pgmap v5657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9519.411389 secs 2024-04-26T20:57:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8822.387535 secs 2024-04-26T20:57:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:03 smithi189 ceph-mon[32756]: pgmap v5657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9519.411389 secs 2024-04-26T20:57:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8822.387535 secs 2024-04-26T20:57:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:03 smithi156 ceph-mon[32679]: pgmap v5657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9519.411389 secs 2024-04-26T20:57:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8822.387535 secs 2024-04-26T20:57:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:05 smithi092 ceph-mon[29156]: pgmap v5658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:05 smithi189 ceph-mon[32756]: pgmap v5658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:05 smithi156 ceph-mon[32679]: pgmap v5658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:07 smithi092 ceph-mon[29156]: pgmap v5659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:07 smithi189 ceph-mon[32756]: pgmap v5659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:07 smithi156 ceph-mon[32679]: pgmap v5659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9524.411512 secs 2024-04-26T20:57:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8827.387653 secs 2024-04-26T20:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9524.411512 secs 2024-04-26T20:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8827.387653 secs 2024-04-26T20:57:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9524.411512 secs 2024-04-26T20:57:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8827.387653 secs 2024-04-26T20:57:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:09 smithi092 ceph-mon[29156]: pgmap v5660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:10.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:09 smithi156 ceph-mon[32679]: pgmap v5660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:09 smithi189 ceph-mon[32756]: pgmap v5660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:11 smithi092 ceph-mon[29156]: pgmap v5661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:11 smithi189 ceph-mon[32756]: pgmap v5661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:11 smithi156 ceph-mon[32679]: pgmap v5661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:13 smithi092 ceph-mon[29156]: pgmap v5662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9529.411613 secs 2024-04-26T20:57:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8832.387764 secs 2024-04-26T20:57:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:13 smithi189 ceph-mon[32756]: pgmap v5662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9529.411613 secs 2024-04-26T20:57:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8832.387764 secs 2024-04-26T20:57:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:13 smithi156 ceph-mon[32679]: pgmap v5662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9529.411613 secs 2024-04-26T20:57:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8832.387764 secs 2024-04-26T20:57:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:15 smithi092 ceph-mon[29156]: pgmap v5663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:15 smithi189 ceph-mon[32756]: pgmap v5663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:15 smithi156 ceph-mon[32679]: pgmap v5663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:17 smithi092 ceph-mon[29156]: pgmap v5664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:17 smithi189 ceph-mon[32756]: pgmap v5664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:17 smithi156 ceph-mon[32679]: pgmap v5664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9534.411728 secs 2024-04-26T20:57:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8837.387838 secs 2024-04-26T20:57:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9534.411728 secs 2024-04-26T20:57:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8837.387838 secs 2024-04-26T20:57:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9534.411728 secs 2024-04-26T20:57:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8837.387838 secs 2024-04-26T20:57:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:19 smithi189 ceph-mon[32756]: pgmap v5665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:19 smithi156 ceph-mon[32679]: pgmap v5665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:19 smithi092 ceph-mon[29156]: pgmap v5665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:21 smithi189 ceph-mon[32756]: pgmap v5666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:21 smithi156 ceph-mon[32679]: pgmap v5666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:21 smithi092 ceph-mon[29156]: pgmap v5666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:24 smithi189 ceph-mon[32756]: pgmap v5667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9539.411851 secs 2024-04-26T20:57:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8842.388053 secs 2024-04-26T20:57:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:24 smithi156 ceph-mon[32679]: pgmap v5667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9539.411851 secs 2024-04-26T20:57:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8842.388053 secs 2024-04-26T20:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:24 smithi092 ceph-mon[29156]: pgmap v5667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9539.411851 secs 2024-04-26T20:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8842.388053 secs 2024-04-26T20:57:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:26 smithi189 ceph-mon[32756]: pgmap v5668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:26 smithi156 ceph-mon[32679]: pgmap v5668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:26 smithi092 ceph-mon[29156]: pgmap v5668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:28 smithi189 ceph-mon[32756]: pgmap v5669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:28 smithi156 ceph-mon[32679]: pgmap v5669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:28 smithi092 ceph-mon[29156]: pgmap v5669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9544.411960 secs 2024-04-26T20:57:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8847.388170 secs 2024-04-26T20:57:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9544.411960 secs 2024-04-26T20:57:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8847.388170 secs 2024-04-26T20:57:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9544.411960 secs 2024-04-26T20:57:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8847.388170 secs 2024-04-26T20:57:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:57:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:30 smithi189 ceph-mon[32756]: pgmap v5670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:57:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:30 smithi156 ceph-mon[32679]: pgmap v5670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:57:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:30 smithi092 ceph-mon[29156]: pgmap v5670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:57:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:57:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:57:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:31 smithi189 ceph-mon[32756]: pgmap v5671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:57:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:31 smithi189 ceph-mon[32756]: pgmap v5672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:31 smithi156 ceph-mon[32679]: pgmap v5671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:57:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:31 smithi156 ceph-mon[32679]: pgmap v5672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:31 smithi092 ceph-mon[29156]: pgmap v5671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:57:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:31 smithi092 ceph-mon[29156]: pgmap v5672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:32 smithi189 ceph-mon[32756]: pgmap v5673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:32 smithi156 ceph-mon[32679]: pgmap v5673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:32 smithi092 ceph-mon[29156]: pgmap v5673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9549.412086 secs 2024-04-26T20:57:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8852.388232 secs 2024-04-26T20:57:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:34 smithi156 ceph-mon[32679]: pgmap v5674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9549.412086 secs 2024-04-26T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8852.388232 secs 2024-04-26T20:57:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:34 smithi092 ceph-mon[29156]: pgmap v5674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:35.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9549.412086 secs 2024-04-26T20:57:35.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8852.388232 secs 2024-04-26T20:57:35.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:34 smithi189 ceph-mon[32756]: pgmap v5674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:36 smithi156 ceph-mon[32679]: pgmap v5675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:36 smithi092 ceph-mon[29156]: pgmap v5675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:36 smithi189 ceph-mon[32756]: pgmap v5675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:57:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:57:37.284+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:57:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:57:37.284+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:57:37.285 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:57:37.284+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T20:57:37.286 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T20:57:37.284+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 77 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T20:57:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:38 smithi156 ceph-mon[32679]: pgmap v5676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:57:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9554.412222 secs 2024-04-26T20:57:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:38 smithi092 ceph-mon[29156]: pgmap v5676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:57:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9554.412222 secs 2024-04-26T20:57:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:38 smithi189 ceph-mon[32756]: pgmap v5676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T20:57:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9554.412222 secs 2024-04-26T20:57:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8857.388341 secs 2024-04-26T20:57:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8857.388341 secs 2024-04-26T20:57:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8857.388341 secs 2024-04-26T20:57:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:40 smithi092 ceph-mon[29156]: pgmap v5677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:57:41.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:40 smithi156 ceph-mon[32679]: pgmap v5677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:57:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:40 smithi189 ceph-mon[32756]: pgmap v5677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:57:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:42 smithi156 ceph-mon[32679]: pgmap v5678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:42 smithi092 ceph-mon[29156]: pgmap v5678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:42 smithi189 ceph-mon[32756]: pgmap v5678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:44.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9559.412361 secs 2024-04-26T20:57:44.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8862.388405 secs 2024-04-26T20:57:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9559.412361 secs 2024-04-26T20:57:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8862.388405 secs 2024-04-26T20:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9559.412361 secs 2024-04-26T20:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8862.388405 secs 2024-04-26T20:57:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:44 smithi156 ceph-mon[32679]: pgmap v5679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:44 smithi092 ceph-mon[29156]: pgmap v5679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:44 smithi189 ceph-mon[32756]: pgmap v5679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:46 smithi156 ceph-mon[32679]: pgmap v5680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:46 smithi092 ceph-mon[29156]: pgmap v5680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:46 smithi189 ceph-mon[32756]: pgmap v5680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:48 smithi156 ceph-mon[32679]: pgmap v5681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9564.412424 secs 2024-04-26T20:57:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8867.388518 secs 2024-04-26T20:57:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:48 smithi092 ceph-mon[29156]: pgmap v5681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9564.412424 secs 2024-04-26T20:57:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8867.388518 secs 2024-04-26T20:57:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:48 smithi189 ceph-mon[32756]: pgmap v5681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9564.412424 secs 2024-04-26T20:57:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8867.388518 secs 2024-04-26T20:57:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:50 smithi156 ceph-mon[32679]: pgmap v5682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:50 smithi092 ceph-mon[29156]: pgmap v5682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:50 smithi189 ceph-mon[32756]: pgmap v5682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:52 smithi156 ceph-mon[32679]: pgmap v5683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:52 smithi092 ceph-mon[29156]: pgmap v5683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:52 smithi189 ceph-mon[32756]: pgmap v5683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9569.412536 secs 2024-04-26T20:57:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8872.388618 secs 2024-04-26T20:57:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9569.412536 secs 2024-04-26T20:57:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8872.388618 secs 2024-04-26T20:57:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9569.412536 secs 2024-04-26T20:57:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8872.388618 secs 2024-04-26T20:57:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:54 smithi156 ceph-mon[32679]: pgmap v5684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:54 smithi092 ceph-mon[29156]: pgmap v5684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:54 smithi189 ceph-mon[32756]: pgmap v5684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:57:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:56 smithi156 ceph-mon[32679]: pgmap v5685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:56 smithi092 ceph-mon[29156]: pgmap v5685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:56 smithi189 ceph-mon[32756]: pgmap v5685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:58 smithi156 ceph-mon[32679]: pgmap v5686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9574.412662 secs 2024-04-26T20:57:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:57:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8877.388698 secs 2024-04-26T20:57:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:58 smithi092 ceph-mon[29156]: pgmap v5686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9574.412662 secs 2024-04-26T20:57:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:57:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8877.388698 secs 2024-04-26T20:57:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:58 smithi189 ceph-mon[32756]: pgmap v5686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:57:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9574.412662 secs 2024-04-26T20:57:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:57:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8877.388698 secs 2024-04-26T20:58:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:00 smithi156 ceph-mon[32679]: pgmap v5687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:00 smithi092 ceph-mon[29156]: pgmap v5687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:00 smithi189 ceph-mon[32756]: pgmap v5687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:02 smithi092 ceph-mon[29156]: pgmap v5688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:02 smithi189 ceph-mon[32756]: pgmap v5688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:02 smithi156 ceph-mon[32679]: pgmap v5688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9579.412781 secs 2024-04-26T20:58:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:03 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 8882.388784 secs 2024-04-26T20:58:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:03 smithi092 ceph-mon[29156]: slow request 5761.546689 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9579.412781 secs 2024-04-26T20:58:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:03 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 8882.388784 secs 2024-04-26T20:58:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:03 smithi189 ceph-mon[32756]: slow request 5761.546689 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9579.412781 secs 2024-04-26T20:58:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:03 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 8882.388784 secs 2024-04-26T20:58:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:03 smithi156 ceph-mon[32679]: slow request 5761.546689 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T20:58:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:04 smithi092 ceph-mon[29156]: pgmap v5689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:05.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:04 smithi189 ceph-mon[32756]: pgmap v5689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:04 smithi156 ceph-mon[32679]: pgmap v5689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:06 smithi092 ceph-mon[29156]: pgmap v5690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:06 smithi189 ceph-mon[32756]: pgmap v5690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:06 smithi156 ceph-mon[32679]: pgmap v5690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:08 smithi092 ceph-mon[29156]: pgmap v5691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9584.412897 secs 2024-04-26T20:58:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8887.388896 secs 2024-04-26T20:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:08 smithi189 ceph-mon[32756]: pgmap v5691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9584.412897 secs 2024-04-26T20:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8887.388896 secs 2024-04-26T20:58:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:08 smithi156 ceph-mon[32679]: pgmap v5691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9584.412897 secs 2024-04-26T20:58:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8887.388896 secs 2024-04-26T20:58:11.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:10 smithi156 ceph-mon[32679]: pgmap v5692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:10 smithi092 ceph-mon[29156]: pgmap v5692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:10 smithi189 ceph-mon[32756]: pgmap v5692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:12 smithi092 ceph-mon[29156]: pgmap v5693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:12 smithi189 ceph-mon[32756]: pgmap v5693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:12 smithi156 ceph-mon[32679]: pgmap v5693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9589.413018 secs 2024-04-26T20:58:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8892.389013 secs 2024-04-26T20:58:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9589.413018 secs 2024-04-26T20:58:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8892.389013 secs 2024-04-26T20:58:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9589.413018 secs 2024-04-26T20:58:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8892.389013 secs 2024-04-26T20:58:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:14 smithi092 ceph-mon[29156]: pgmap v5694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:14 smithi189 ceph-mon[32756]: pgmap v5694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:14 smithi156 ceph-mon[32679]: pgmap v5694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:16 smithi092 ceph-mon[29156]: pgmap v5695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:16 smithi189 ceph-mon[32756]: pgmap v5695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:16 smithi156 ceph-mon[32679]: pgmap v5695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:18 smithi092 ceph-mon[29156]: pgmap v5696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9594.413135 secs 2024-04-26T20:58:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8897.389104 secs 2024-04-26T20:58:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:18 smithi189 ceph-mon[32756]: pgmap v5696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9594.413135 secs 2024-04-26T20:58:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8897.389104 secs 2024-04-26T20:58:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:18 smithi156 ceph-mon[32679]: pgmap v5696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9594.413135 secs 2024-04-26T20:58:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8897.389104 secs 2024-04-26T20:58:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:20 smithi092 ceph-mon[29156]: pgmap v5697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:20 smithi189 ceph-mon[32756]: pgmap v5697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:20 smithi156 ceph-mon[32679]: pgmap v5697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:22 smithi092 ceph-mon[29156]: pgmap v5698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:22 smithi189 ceph-mon[32756]: pgmap v5698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:22 smithi156 ceph-mon[32679]: pgmap v5698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9599.413272 secs 2024-04-26T20:58:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8902.389197 secs 2024-04-26T20:58:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9599.413272 secs 2024-04-26T20:58:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8902.389197 secs 2024-04-26T20:58:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9599.413272 secs 2024-04-26T20:58:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8902.389197 secs 2024-04-26T20:58:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:24 smithi092 ceph-mon[29156]: pgmap v5699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:24 smithi189 ceph-mon[32756]: pgmap v5699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:24 smithi156 ceph-mon[32679]: pgmap v5699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:26 smithi092 ceph-mon[29156]: pgmap v5700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:26 smithi189 ceph-mon[32756]: pgmap v5700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:26 smithi156 ceph-mon[32679]: pgmap v5700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:28 smithi092 ceph-mon[29156]: pgmap v5701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9604.413387 secs 2024-04-26T20:58:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8907.389315 secs 2024-04-26T20:58:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:28 smithi189 ceph-mon[32756]: pgmap v5701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9604.413387 secs 2024-04-26T20:58:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8907.389315 secs 2024-04-26T20:58:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:28 smithi156 ceph-mon[32679]: pgmap v5701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9604.413387 secs 2024-04-26T20:58:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8907.389315 secs 2024-04-26T20:58:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:58:31.290 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:30 smithi092 ceph-mon[29156]: pgmap v5702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:31.330 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:30 smithi156 ceph-mon[32679]: pgmap v5702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:30 smithi189 ceph-mon[32756]: pgmap v5702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:33.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:32 smithi156 ceph-mon[32679]: pgmap v5703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:32 smithi189 ceph-mon[32756]: pgmap v5703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:33.406 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:32 smithi092 ceph-mon[29156]: pgmap v5703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9609.413451 secs 2024-04-26T20:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8912.389378 secs 2024-04-26T20:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9609.413451 secs 2024-04-26T20:58:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8912.389378 secs 2024-04-26T20:58:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9609.413451 secs 2024-04-26T20:58:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8912.389378 secs 2024-04-26T20:58:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: pgmap v5704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: pgmap v5704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: pgmap v5704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:58:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:36 smithi189 ceph-mon[32756]: pgmap v5705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:58:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:36 smithi189 ceph-mon[32756]: pgmap v5706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:36 smithi156 ceph-mon[32679]: pgmap v5705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:58:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:36 smithi156 ceph-mon[32679]: pgmap v5706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:36 smithi092 ceph-mon[29156]: pgmap v5705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T20:58:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:36 smithi092 ceph-mon[29156]: pgmap v5706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:38 smithi189 ceph-mon[32756]: pgmap v5707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:38 smithi156 ceph-mon[32679]: pgmap v5707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:38 smithi092 ceph-mon[29156]: pgmap v5707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9614.413571 secs 2024-04-26T20:58:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8917.389494 secs 2024-04-26T20:58:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9614.413571 secs 2024-04-26T20:58:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8917.389494 secs 2024-04-26T20:58:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9614.413571 secs 2024-04-26T20:58:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8917.389494 secs 2024-04-26T20:58:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:40 smithi189 ceph-mon[32756]: pgmap v5708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:40 smithi156 ceph-mon[32679]: pgmap v5708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:40 smithi092 ceph-mon[29156]: pgmap v5708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:42 smithi189 ceph-mon[32756]: pgmap v5709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:42 smithi156 ceph-mon[32679]: pgmap v5709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:42 smithi092 ceph-mon[29156]: pgmap v5709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T20:58:44.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:44 smithi092 ceph-mon[29156]: pgmap v5710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:44.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9619.413694 secs 2024-04-26T20:58:44.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8922.389606 secs 2024-04-26T20:58:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:44 smithi189 ceph-mon[32756]: pgmap v5710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9619.413694 secs 2024-04-26T20:58:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8922.389606 secs 2024-04-26T20:58:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:44 smithi156 ceph-mon[32679]: pgmap v5710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:58:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9619.413694 secs 2024-04-26T20:58:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8922.389606 secs 2024-04-26T20:58:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:46 smithi189 ceph-mon[32756]: pgmap v5711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:58:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:46 smithi156 ceph-mon[32679]: pgmap v5711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:58:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:46 smithi092 ceph-mon[29156]: pgmap v5711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:58:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:48 smithi189 ceph-mon[32756]: pgmap v5712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:48 smithi156 ceph-mon[32679]: pgmap v5712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:48 smithi092 ceph-mon[29156]: pgmap v5712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9624.413803 secs 2024-04-26T20:58:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8927.389719 secs 2024-04-26T20:58:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9624.413803 secs 2024-04-26T20:58:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8927.389719 secs 2024-04-26T20:58:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9624.413803 secs 2024-04-26T20:58:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8927.389719 secs 2024-04-26T20:58:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:50 smithi189 ceph-mon[32756]: pgmap v5713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:50 smithi156 ceph-mon[32679]: pgmap v5713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:50 smithi092 ceph-mon[29156]: pgmap v5713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:51 smithi189 ceph-mon[32756]: pgmap v5714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:51 smithi156 ceph-mon[32679]: pgmap v5714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:51 smithi092 ceph-mon[29156]: pgmap v5714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:58:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:53 smithi092 ceph-mon[29156]: pgmap v5715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:53 smithi189 ceph-mon[32756]: pgmap v5715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:53 smithi156 ceph-mon[32679]: pgmap v5715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:58:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9629.413920 secs 2024-04-26T20:58:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8932.389792 secs 2024-04-26T20:58:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9629.413920 secs 2024-04-26T20:58:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8932.389792 secs 2024-04-26T20:58:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9629.413920 secs 2024-04-26T20:58:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8932.389792 secs 2024-04-26T20:58:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:55 smithi189 ceph-mon[32756]: pgmap v5716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:58:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:55 smithi156 ceph-mon[32679]: pgmap v5716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:58:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:55 smithi092 ceph-mon[29156]: pgmap v5716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:58:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:57 smithi189 ceph-mon[32756]: pgmap v5717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:57 smithi156 ceph-mon[32679]: pgmap v5717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:57 smithi092 ceph-mon[29156]: pgmap v5717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:59 smithi189 ceph-mon[32756]: pgmap v5718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9634.414028 secs 2024-04-26T20:58:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:58:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8937.389881 secs 2024-04-26T20:58:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:59 smithi156 ceph-mon[32679]: pgmap v5718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9634.414028 secs 2024-04-26T20:58:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:58:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8937.389881 secs 2024-04-26T20:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:59 smithi092 ceph-mon[29156]: pgmap v5718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9634.414028 secs 2024-04-26T20:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:58:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8937.389881 secs 2024-04-26T20:59:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:01 smithi189 ceph-mon[32756]: pgmap v5719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:01 smithi156 ceph-mon[32679]: pgmap v5719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:01 smithi092 ceph-mon[29156]: pgmap v5719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:03 smithi189 ceph-mon[32756]: pgmap v5720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:59:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:03 smithi156 ceph-mon[32679]: pgmap v5720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:59:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:03 smithi092 ceph-mon[29156]: pgmap v5720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T20:59:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9639.414152 secs 2024-04-26T20:59:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8942.390026 secs 2024-04-26T20:59:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9639.414152 secs 2024-04-26T20:59:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8942.390026 secs 2024-04-26T20:59:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9639.414152 secs 2024-04-26T20:59:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8942.390026 secs 2024-04-26T20:59:05.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:05 smithi189 ceph-mon[32756]: pgmap v5721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:05 smithi156 ceph-mon[32679]: pgmap v5721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:05 smithi092 ceph-mon[29156]: pgmap v5721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:07 smithi189 ceph-mon[32756]: pgmap v5722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:07 smithi156 ceph-mon[32679]: pgmap v5722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:07 smithi092 ceph-mon[29156]: pgmap v5722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:09 smithi189 ceph-mon[32756]: pgmap v5723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9644.414228 secs 2024-04-26T20:59:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8947.390160 secs 2024-04-26T20:59:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:09 smithi156 ceph-mon[32679]: pgmap v5723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9644.414228 secs 2024-04-26T20:59:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8947.390160 secs 2024-04-26T20:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:09 smithi092 ceph-mon[29156]: pgmap v5723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9644.414228 secs 2024-04-26T20:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8947.390160 secs 2024-04-26T20:59:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:11 smithi189 ceph-mon[32756]: pgmap v5724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:11 smithi156 ceph-mon[32679]: pgmap v5724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:11 smithi092 ceph-mon[29156]: pgmap v5724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:13 smithi189 ceph-mon[32756]: pgmap v5725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:13 smithi156 ceph-mon[32679]: pgmap v5725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:13 smithi092 ceph-mon[29156]: pgmap v5725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9649.414363 secs 2024-04-26T20:59:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8952.390321 secs 2024-04-26T20:59:14.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9649.414363 secs 2024-04-26T20:59:14.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8952.390321 secs 2024-04-26T20:59:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9649.414363 secs 2024-04-26T20:59:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8952.390321 secs 2024-04-26T20:59:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:15 smithi189 ceph-mon[32756]: pgmap v5726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:15 smithi156 ceph-mon[32679]: pgmap v5726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:15 smithi092 ceph-mon[29156]: pgmap v5726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:17 smithi189 ceph-mon[32756]: pgmap v5727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:17 smithi156 ceph-mon[32679]: pgmap v5727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:17 smithi092 ceph-mon[29156]: pgmap v5727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:19 smithi189 ceph-mon[32756]: pgmap v5728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9654.414465 secs 2024-04-26T20:59:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8957.390377 secs 2024-04-26T20:59:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:19 smithi156 ceph-mon[32679]: pgmap v5728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9654.414465 secs 2024-04-26T20:59:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8957.390377 secs 2024-04-26T20:59:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:19 smithi092 ceph-mon[29156]: pgmap v5728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9654.414465 secs 2024-04-26T20:59:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8957.390377 secs 2024-04-26T20:59:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:21 smithi189 ceph-mon[32756]: pgmap v5729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:21 smithi156 ceph-mon[32679]: pgmap v5729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:21 smithi092 ceph-mon[29156]: pgmap v5729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:23 smithi156 ceph-mon[32679]: pgmap v5730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9659.414602 secs 2024-04-26T20:59:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8962.390436 secs 2024-04-26T20:59:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:23 smithi092 ceph-mon[29156]: pgmap v5730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9659.414602 secs 2024-04-26T20:59:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8962.390436 secs 2024-04-26T20:59:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:23 smithi189 ceph-mon[32756]: pgmap v5730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9659.414602 secs 2024-04-26T20:59:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8962.390436 secs 2024-04-26T20:59:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:25 smithi156 ceph-mon[32679]: pgmap v5731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:25 smithi092 ceph-mon[29156]: pgmap v5731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:25 smithi189 ceph-mon[32756]: pgmap v5731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:27 smithi156 ceph-mon[32679]: pgmap v5732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:27 smithi092 ceph-mon[29156]: pgmap v5732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:27 smithi189 ceph-mon[32756]: pgmap v5732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9664.414721 secs 2024-04-26T20:59:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8967.390516 secs 2024-04-26T20:59:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9664.414721 secs 2024-04-26T20:59:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8967.390516 secs 2024-04-26T20:59:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9664.414721 secs 2024-04-26T20:59:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8967.390516 secs 2024-04-26T20:59:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:29 smithi156 ceph-mon[32679]: pgmap v5733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:29 smithi092 ceph-mon[29156]: pgmap v5733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:29 smithi189 ceph-mon[32756]: pgmap v5733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:31 smithi156 ceph-mon[32679]: pgmap v5734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:31 smithi092 ceph-mon[29156]: pgmap v5734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:31 smithi189 ceph-mon[32756]: pgmap v5734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:59:33.404+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:59:33.404+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:59:33.404+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:59:33.404+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:33.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T20:59:33.404+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T20:59:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:33 smithi156 ceph-mon[32679]: pgmap v5735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9669.414785 secs 2024-04-26T20:59:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8972.390578 secs 2024-04-26T20:59:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-mon[29156]: pgmap v5735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9669.414785 secs 2024-04-26T20:59:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8972.390578 secs 2024-04-26T20:59:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:33 smithi189 ceph-mon[32756]: pgmap v5735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9669.414785 secs 2024-04-26T20:59:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8972.390578 secs 2024-04-26T20:59:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:35.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T20:59:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:35 smithi092 ceph-mon[29156]: pgmap v5736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:35 smithi189 ceph-mon[32756]: pgmap v5736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:35 smithi156 ceph-mon[32679]: pgmap v5736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:38.091 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:37 smithi189 ceph-mon[32756]: pgmap v5737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:37 smithi092 ceph-mon[29156]: pgmap v5737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:37 smithi156 ceph-mon[32679]: pgmap v5737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: pgmap v5738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9674.414894 secs 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8977.390641 secs 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: pgmap v5739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: pgmap v5740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: pgmap v5738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9674.414894 secs 2024-04-26T20:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8977.390641 secs 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: pgmap v5739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: pgmap v5740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: pgmap v5738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9674.414894 secs 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8977.390641 secs 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T20:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T20:59:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: pgmap v5739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T20:59:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: pgmap v5740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T20:59:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:41 smithi189 ceph-mon[32756]: pgmap v5741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:41 smithi156 ceph-mon[32679]: pgmap v5741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:41 smithi092 ceph-mon[29156]: pgmap v5741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:43 smithi189 ceph-mon[32756]: pgmap v5742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:43 smithi156 ceph-mon[32679]: pgmap v5742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:43 smithi092 ceph-mon[29156]: pgmap v5742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T20:59:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9679.414982 secs 2024-04-26T20:59:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8982.390706 secs 2024-04-26T20:59:44.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9679.414982 secs 2024-04-26T20:59:44.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8982.390706 secs 2024-04-26T20:59:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9679.414982 secs 2024-04-26T20:59:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8982.390706 secs 2024-04-26T20:59:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:45 smithi189 ceph-mon[32756]: pgmap v5743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:45 smithi156 ceph-mon[32679]: pgmap v5743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:45 smithi092 ceph-mon[29156]: pgmap v5743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:47 smithi189 ceph-mon[32756]: pgmap v5744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:47 smithi156 ceph-mon[32679]: pgmap v5744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:47 smithi092 ceph-mon[29156]: pgmap v5744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T20:59:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9684.415064 secs 2024-04-26T20:59:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8987.390823 secs 2024-04-26T20:59:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:49 smithi189 ceph-mon[32756]: pgmap v5745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9684.415064 secs 2024-04-26T20:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8987.390823 secs 2024-04-26T20:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:49 smithi156 ceph-mon[32679]: pgmap v5745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9684.415064 secs 2024-04-26T20:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8987.390823 secs 2024-04-26T20:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:49 smithi092 ceph-mon[29156]: pgmap v5745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T20:59:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:51 smithi189 ceph-mon[32756]: pgmap v5746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:51 smithi156 ceph-mon[32679]: pgmap v5746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:51 smithi092 ceph-mon[29156]: pgmap v5746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:53 smithi189 ceph-mon[32756]: pgmap v5747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:53 smithi156 ceph-mon[32679]: pgmap v5747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:53 smithi092 ceph-mon[29156]: pgmap v5747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9689.415180 secs 2024-04-26T20:59:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8992.390912 secs 2024-04-26T20:59:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9689.415180 secs 2024-04-26T20:59:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8992.390912 secs 2024-04-26T20:59:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9689.415180 secs 2024-04-26T20:59:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8992.390912 secs 2024-04-26T20:59:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:55 smithi189 ceph-mon[32756]: pgmap v5748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:55 smithi156 ceph-mon[32679]: pgmap v5748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:55 smithi092 ceph-mon[29156]: pgmap v5748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:57 smithi189 ceph-mon[32756]: pgmap v5749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:57 smithi156 ceph-mon[32679]: pgmap v5749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:57 smithi092 ceph-mon[29156]: pgmap v5749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T20:59:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9694.415249 secs 2024-04-26T20:59:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 8997.391003 secs 2024-04-26T20:59:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 20:59:59 smithi189 ceph-mon[32756]: pgmap v5750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9694.415249 secs 2024-04-26T20:59:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 8997.391003 secs 2024-04-26T20:59:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 20:59:59 smithi156 ceph-mon[32679]: pgmap v5750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T20:59:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9694.415249 secs 2024-04-26T20:59:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 8997.391003 secs 2024-04-26T20:59:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 20:59:59 smithi092 ceph-mon[29156]: pgmap v5750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:00:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:00:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:00:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:01 smithi156 ceph-mon[32679]: pgmap v5751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:01 smithi092 ceph-mon[29156]: pgmap v5751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:01 smithi189 ceph-mon[32756]: pgmap v5751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:03 smithi156 ceph-mon[32679]: pgmap v5752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:03 smithi092 ceph-mon[29156]: pgmap v5752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:03 smithi189 ceph-mon[32756]: pgmap v5752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9699.415364 secs 2024-04-26T21:00:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9002.391089 secs 2024-04-26T21:00:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9699.415364 secs 2024-04-26T21:00:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9002.391089 secs 2024-04-26T21:00:05.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9699.415364 secs 2024-04-26T21:00:05.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9002.391089 secs 2024-04-26T21:00:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:05 smithi156 ceph-mon[32679]: pgmap v5753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:05 smithi092 ceph-mon[29156]: pgmap v5753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:06.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:05 smithi189 ceph-mon[32756]: pgmap v5753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:07 smithi156 ceph-mon[32679]: pgmap v5754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:07 smithi092 ceph-mon[29156]: pgmap v5754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:07 smithi189 ceph-mon[32756]: pgmap v5754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9704.415424 secs 2024-04-26T21:00:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9007.391156 secs 2024-04-26T21:00:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:09 smithi156 ceph-mon[32679]: pgmap v5755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9704.415424 secs 2024-04-26T21:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9007.391156 secs 2024-04-26T21:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:09 smithi092 ceph-mon[29156]: pgmap v5755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9704.415424 secs 2024-04-26T21:00:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9007.391156 secs 2024-04-26T21:00:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:09 smithi189 ceph-mon[32756]: pgmap v5755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:11 smithi156 ceph-mon[32679]: pgmap v5756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:11 smithi092 ceph-mon[29156]: pgmap v5756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:11 smithi189 ceph-mon[32756]: pgmap v5756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:13 smithi156 ceph-mon[32679]: pgmap v5757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9709.415541 secs 2024-04-26T21:00:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9012.391269 secs 2024-04-26T21:00:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:13 smithi092 ceph-mon[29156]: pgmap v5757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9709.415541 secs 2024-04-26T21:00:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9012.391269 secs 2024-04-26T21:00:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:13 smithi189 ceph-mon[32756]: pgmap v5757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9709.415541 secs 2024-04-26T21:00:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9012.391269 secs 2024-04-26T21:00:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:15 smithi156 ceph-mon[32679]: pgmap v5758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:15 smithi092 ceph-mon[29156]: pgmap v5758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:15 smithi189 ceph-mon[32756]: pgmap v5758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:17 smithi156 ceph-mon[32679]: pgmap v5759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:17 smithi092 ceph-mon[29156]: pgmap v5759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:17 smithi189 ceph-mon[32756]: pgmap v5759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9714.415619 secs 2024-04-26T21:00:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9017.391393 secs 2024-04-26T21:00:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9714.415619 secs 2024-04-26T21:00:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9017.391393 secs 2024-04-26T21:00:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9714.415619 secs 2024-04-26T21:00:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9017.391393 secs 2024-04-26T21:00:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:19 smithi092 ceph-mon[29156]: pgmap v5760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:19 smithi189 ceph-mon[32756]: pgmap v5760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:19 smithi156 ceph-mon[32679]: pgmap v5760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:21 smithi092 ceph-mon[29156]: pgmap v5761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:21 smithi189 ceph-mon[32756]: pgmap v5761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:21 smithi156 ceph-mon[32679]: pgmap v5761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:23 smithi092 ceph-mon[29156]: pgmap v5762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9719.415741 secs 2024-04-26T21:00:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9022.391467 secs 2024-04-26T21:00:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:23 smithi189 ceph-mon[32756]: pgmap v5762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9719.415741 secs 2024-04-26T21:00:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9022.391467 secs 2024-04-26T21:00:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:23 smithi156 ceph-mon[32679]: pgmap v5762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9719.415741 secs 2024-04-26T21:00:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9022.391467 secs 2024-04-26T21:00:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:25 smithi092 ceph-mon[29156]: pgmap v5763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:25 smithi189 ceph-mon[32756]: pgmap v5763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:25 smithi156 ceph-mon[32679]: pgmap v5763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:27 smithi092 ceph-mon[29156]: pgmap v5764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:27 smithi189 ceph-mon[32756]: pgmap v5764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:27 smithi156 ceph-mon[32679]: pgmap v5764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9724.415854 secs 2024-04-26T21:00:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9027.391589 secs 2024-04-26T21:00:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9724.415854 secs 2024-04-26T21:00:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9027.391589 secs 2024-04-26T21:00:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9724.415854 secs 2024-04-26T21:00:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9027.391589 secs 2024-04-26T21:00:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:29 smithi092 ceph-mon[29156]: pgmap v5765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:29 smithi189 ceph-mon[32756]: pgmap v5765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:29 smithi156 ceph-mon[32679]: pgmap v5765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:31 smithi092 ceph-mon[29156]: pgmap v5766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:31 smithi189 ceph-mon[32756]: pgmap v5766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:31 smithi156 ceph-mon[32679]: pgmap v5766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:33 smithi092 ceph-mon[29156]: pgmap v5767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9729.415989 secs 2024-04-26T21:00:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9032.391701 secs 2024-04-26T21:00:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:33 smithi189 ceph-mon[32756]: pgmap v5767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9729.415989 secs 2024-04-26T21:00:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9032.391701 secs 2024-04-26T21:00:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:33 smithi156 ceph-mon[32679]: pgmap v5767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9729.415989 secs 2024-04-26T21:00:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9032.391701 secs 2024-04-26T21:00:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:35 smithi092 ceph-mon[29156]: pgmap v5768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:35 smithi189 ceph-mon[32756]: pgmap v5768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:35 smithi156 ceph-mon[32679]: pgmap v5768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:00:37.309+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:00:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:00:37.309+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:00:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:00:37.309+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:00:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:00:37.309+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 78 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:00:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:37 smithi092 ceph-mon[29156]: pgmap v5769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:37 smithi189 ceph-mon[32756]: pgmap v5769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:37 smithi156 ceph-mon[32679]: pgmap v5769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9734.416087 secs 2024-04-26T21:00:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9037.391803 secs 2024-04-26T21:00:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9734.416087 secs 2024-04-26T21:00:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9037.391803 secs 2024-04-26T21:00:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9734.416087 secs 2024-04-26T21:00:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9037.391803 secs 2024-04-26T21:00:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:00:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:39 smithi092 ceph-mon[29156]: pgmap v5770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:00:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:39 smithi189 ceph-mon[32756]: pgmap v5770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:00:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:39 smithi156 ceph-mon[32679]: pgmap v5770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:00:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:00:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:00:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:40 smithi092 ceph-mon[29156]: pgmap v5771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:00:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:40 smithi092 ceph-mon[29156]: pgmap v5772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:40 smithi189 ceph-mon[32756]: pgmap v5771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:00:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:40 smithi189 ceph-mon[32756]: pgmap v5772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:40 smithi156 ceph-mon[32679]: pgmap v5771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:00:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:40 smithi156 ceph-mon[32679]: pgmap v5772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:42 smithi092 ceph-mon[29156]: pgmap v5773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:42 smithi189 ceph-mon[32756]: pgmap v5773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:42 smithi156 ceph-mon[32679]: pgmap v5773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9739.416223 secs 2024-04-26T21:00:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9042.391907 secs 2024-04-26T21:00:44.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9739.416223 secs 2024-04-26T21:00:44.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9042.391907 secs 2024-04-26T21:00:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9739.416223 secs 2024-04-26T21:00:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9042.391907 secs 2024-04-26T21:00:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:44 smithi092 ceph-mon[29156]: pgmap v5774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:44 smithi189 ceph-mon[32756]: pgmap v5774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:44 smithi156 ceph-mon[32679]: pgmap v5774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:46 smithi189 ceph-mon[32756]: pgmap v5775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:46 smithi156 ceph-mon[32679]: pgmap v5775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:46 smithi092 ceph-mon[29156]: pgmap v5775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:00:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:48 smithi189 ceph-mon[32756]: pgmap v5776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9744.416315 secs 2024-04-26T21:00:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9047.392028 secs 2024-04-26T21:00:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:48 smithi156 ceph-mon[32679]: pgmap v5776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9744.416315 secs 2024-04-26T21:00:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9047.392028 secs 2024-04-26T21:00:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:48 smithi092 ceph-mon[29156]: pgmap v5776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:00:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9744.416315 secs 2024-04-26T21:00:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9047.392028 secs 2024-04-26T21:00:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:51 smithi189 ceph-mon[32756]: pgmap v5777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:00:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:51 smithi156 ceph-mon[32679]: pgmap v5777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:00:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:51 smithi092 ceph-mon[29156]: pgmap v5777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:00:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:53 smithi092 ceph-mon[29156]: pgmap v5778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:53 smithi189 ceph-mon[32756]: pgmap v5778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:53 smithi156 ceph-mon[32679]: pgmap v5778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9749.416469 secs 2024-04-26T21:00:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9052.392129 secs 2024-04-26T21:00:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9749.416469 secs 2024-04-26T21:00:54.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9052.392129 secs 2024-04-26T21:00:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9749.416469 secs 2024-04-26T21:00:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9052.392129 secs 2024-04-26T21:00:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:55 smithi189 ceph-mon[32756]: pgmap v5779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:55 smithi156 ceph-mon[32679]: pgmap v5779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:55 smithi092 ceph-mon[29156]: pgmap v5779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:57 smithi189 ceph-mon[32756]: pgmap v5780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:57 smithi156 ceph-mon[32679]: pgmap v5780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:57 smithi092 ceph-mon[29156]: pgmap v5780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:00:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:59 smithi189 ceph-mon[32756]: pgmap v5781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9754.416572 secs 2024-04-26T21:00:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:00:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9057.392269 secs 2024-04-26T21:00:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:59 smithi156 ceph-mon[32679]: pgmap v5781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9754.416572 secs 2024-04-26T21:00:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:00:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9057.392269 secs 2024-04-26T21:00:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:59 smithi092 ceph-mon[29156]: pgmap v5781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:00:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9754.416572 secs 2024-04-26T21:00:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:00:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9057.392269 secs 2024-04-26T21:01:01.283 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:01 smithi156 ceph-mon[32679]: pgmap v5782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:01 smithi189 ceph-mon[32756]: pgmap v5782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:01 smithi092 ceph-mon[29156]: pgmap v5782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:03 smithi189 ceph-mon[32756]: pgmap v5783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:03 smithi156 ceph-mon[32679]: pgmap v5783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:03 smithi092 ceph-mon[29156]: pgmap v5783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9759.416688 secs 2024-04-26T21:01:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9062.392358 secs 2024-04-26T21:01:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9759.416688 secs 2024-04-26T21:01:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9062.392358 secs 2024-04-26T21:01:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9759.416688 secs 2024-04-26T21:01:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9062.392358 secs 2024-04-26T21:01:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:05 smithi189 ceph-mon[32756]: pgmap v5784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:05 smithi156 ceph-mon[32679]: pgmap v5784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:05 smithi092 ceph-mon[29156]: pgmap v5784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:07 smithi189 ceph-mon[32756]: pgmap v5785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:07 smithi156 ceph-mon[32679]: pgmap v5785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:07 smithi092 ceph-mon[29156]: pgmap v5785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:09 smithi092 ceph-mon[29156]: pgmap v5786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9764.416803 secs 2024-04-26T21:01:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9067.392469 secs 2024-04-26T21:01:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:09 smithi189 ceph-mon[32756]: pgmap v5786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9764.416803 secs 2024-04-26T21:01:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9067.392469 secs 2024-04-26T21:01:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:09 smithi156 ceph-mon[32679]: pgmap v5786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9764.416803 secs 2024-04-26T21:01:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9067.392469 secs 2024-04-26T21:01:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:11 smithi189 ceph-mon[32756]: pgmap v5787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:11 smithi156 ceph-mon[32679]: pgmap v5787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:11 smithi092 ceph-mon[29156]: pgmap v5787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:13 smithi189 ceph-mon[32756]: pgmap v5788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:13 smithi156 ceph-mon[32679]: pgmap v5788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:13 smithi092 ceph-mon[29156]: pgmap v5788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:14.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9769.416904 secs 2024-04-26T21:01:14.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9072.392572 secs 2024-04-26T21:01:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9769.416904 secs 2024-04-26T21:01:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9072.392572 secs 2024-04-26T21:01:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9769.416904 secs 2024-04-26T21:01:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9072.392572 secs 2024-04-26T21:01:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:15 smithi189 ceph-mon[32756]: pgmap v5789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:15 smithi156 ceph-mon[32679]: pgmap v5789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:15 smithi092 ceph-mon[29156]: pgmap v5789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:17 smithi189 ceph-mon[32756]: pgmap v5790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:17 smithi156 ceph-mon[32679]: pgmap v5790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:17 smithi092 ceph-mon[29156]: pgmap v5790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:19 smithi189 ceph-mon[32756]: pgmap v5791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9774.416979 secs 2024-04-26T21:01:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9077.392694 secs 2024-04-26T21:01:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:19 smithi156 ceph-mon[32679]: pgmap v5791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9774.416979 secs 2024-04-26T21:01:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9077.392694 secs 2024-04-26T21:01:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:19 smithi092 ceph-mon[29156]: pgmap v5791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9774.416979 secs 2024-04-26T21:01:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9077.392694 secs 2024-04-26T21:01:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:20 smithi189 ceph-mon[32756]: pgmap v5792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:20 smithi156 ceph-mon[32679]: pgmap v5792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:20 smithi092 ceph-mon[29156]: pgmap v5792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:22 smithi156 ceph-mon[32679]: pgmap v5793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:22 smithi092 ceph-mon[29156]: pgmap v5793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:22 smithi189 ceph-mon[32756]: pgmap v5793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9779.417075 secs 2024-04-26T21:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:24 smithi156 ceph-mon[32679]: pgmap v5794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9082.392789 secs 2024-04-26T21:01:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9779.417075 secs 2024-04-26T21:01:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:24 smithi092 ceph-mon[29156]: pgmap v5794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9082.392789 secs 2024-04-26T21:01:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9779.417075 secs 2024-04-26T21:01:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:24 smithi189 ceph-mon[32756]: pgmap v5794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9082.392789 secs 2024-04-26T21:01:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:26 smithi092 ceph-mon[29156]: pgmap v5795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:26 smithi189 ceph-mon[32756]: pgmap v5795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:26 smithi156 ceph-mon[32679]: pgmap v5795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:28 smithi092 ceph-mon[29156]: pgmap v5796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:28 smithi189 ceph-mon[32756]: pgmap v5796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:28 smithi156 ceph-mon[32679]: pgmap v5796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9784.417211 secs 2024-04-26T21:01:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9087.392871 secs 2024-04-26T21:01:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9784.417211 secs 2024-04-26T21:01:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9087.392871 secs 2024-04-26T21:01:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9784.417211 secs 2024-04-26T21:01:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9087.392871 secs 2024-04-26T21:01:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:30 smithi092 ceph-mon[29156]: pgmap v5797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:30 smithi189 ceph-mon[32756]: pgmap v5797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:30 smithi156 ceph-mon[32679]: pgmap v5797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:32 smithi092 ceph-mon[29156]: pgmap v5798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:32 smithi189 ceph-mon[32756]: pgmap v5798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:32 smithi156 ceph-mon[32679]: pgmap v5798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9789.417362 secs 2024-04-26T21:01:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:34 smithi092 ceph-mon[29156]: pgmap v5799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9092.393001 secs 2024-04-26T21:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9789.417362 secs 2024-04-26T21:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:34 smithi189 ceph-mon[32756]: pgmap v5799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9092.393001 secs 2024-04-26T21:01:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9789.417362 secs 2024-04-26T21:01:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:34 smithi156 ceph-mon[32679]: pgmap v5799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9092.393001 secs 2024-04-26T21:01:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:36 smithi092 ceph-mon[29156]: pgmap v5800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:36 smithi189 ceph-mon[32756]: pgmap v5800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:36 smithi156 ceph-mon[32679]: pgmap v5800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:38 smithi092 ceph-mon[29156]: pgmap v5801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:38 smithi189 ceph-mon[32756]: pgmap v5801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:38 smithi156 ceph-mon[32679]: pgmap v5801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:01:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9794.417467 secs 2024-04-26T21:01:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9097.393122 secs 2024-04-26T21:01:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9794.417467 secs 2024-04-26T21:01:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9097.393122 secs 2024-04-26T21:01:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9794.417467 secs 2024-04-26T21:01:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9097.393122 secs 2024-04-26T21:01:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:40 smithi092 ceph-mon[29156]: pgmap v5802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:01:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:40 smithi189 ceph-mon[32756]: pgmap v5802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:01:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:40 smithi156 ceph-mon[32679]: pgmap v5802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:01:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:01:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:01:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:01:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:01:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:41 smithi092 ceph-mon[29156]: pgmap v5803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:01:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:41 smithi092 ceph-mon[29156]: pgmap v5804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:41 smithi189 ceph-mon[32756]: pgmap v5803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:01:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:41 smithi189 ceph-mon[32756]: pgmap v5804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:41 smithi156 ceph-mon[32679]: pgmap v5803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:01:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:41 smithi156 ceph-mon[32679]: pgmap v5804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:43 smithi092 ceph-mon[29156]: pgmap v5805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:43 smithi189 ceph-mon[32756]: pgmap v5805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:43 smithi156 ceph-mon[32679]: pgmap v5805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9799.417603 secs 2024-04-26T21:01:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9102.393244 secs 2024-04-26T21:01:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9799.417603 secs 2024-04-26T21:01:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9102.393244 secs 2024-04-26T21:01:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9799.417603 secs 2024-04-26T21:01:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9102.393244 secs 2024-04-26T21:01:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:45 smithi092 ceph-mon[29156]: pgmap v5806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:45 smithi189 ceph-mon[32756]: pgmap v5806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:45 smithi156 ceph-mon[32679]: pgmap v5806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:47 smithi092 ceph-mon[29156]: pgmap v5807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:47 smithi189 ceph-mon[32756]: pgmap v5807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:47 smithi156 ceph-mon[32679]: pgmap v5807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:01:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:49 smithi092 ceph-mon[29156]: pgmap v5808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:01:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9804.417732 secs 2024-04-26T21:01:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9107.393396 secs 2024-04-26T21:01:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:49 smithi189 ceph-mon[32756]: pgmap v5808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:01:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9804.417732 secs 2024-04-26T21:01:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9107.393396 secs 2024-04-26T21:01:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:49 smithi156 ceph-mon[32679]: pgmap v5808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:01:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9804.417732 secs 2024-04-26T21:01:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9107.393396 secs 2024-04-26T21:01:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:51 smithi092 ceph-mon[29156]: pgmap v5809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:01:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:51 smithi189 ceph-mon[32756]: pgmap v5809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:01:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:51 smithi156 ceph-mon[32679]: pgmap v5809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:01:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:53 smithi092 ceph-mon[29156]: pgmap v5810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:53 smithi189 ceph-mon[32756]: pgmap v5810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:53 smithi156 ceph-mon[32679]: pgmap v5810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9809.417836 secs 2024-04-26T21:01:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9112.393463 secs 2024-04-26T21:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9809.417836 secs 2024-04-26T21:01:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9112.393463 secs 2024-04-26T21:01:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9809.417836 secs 2024-04-26T21:01:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9112.393463 secs 2024-04-26T21:01:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:55 smithi189 ceph-mon[32756]: pgmap v5811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:55 smithi156 ceph-mon[32679]: pgmap v5811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:55 smithi092 ceph-mon[29156]: pgmap v5811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:01:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:57 smithi189 ceph-mon[32756]: pgmap v5812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:57 smithi156 ceph-mon[32679]: pgmap v5812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:57 smithi092 ceph-mon[29156]: pgmap v5812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:59 smithi189 ceph-mon[32756]: pgmap v5813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9814.417957 secs 2024-04-26T21:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:01:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9117.393560 secs 2024-04-26T21:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:59 smithi156 ceph-mon[32679]: pgmap v5813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9814.417957 secs 2024-04-26T21:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:01:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9117.393560 secs 2024-04-26T21:01:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:59 smithi092 ceph-mon[29156]: pgmap v5813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:01:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9814.417957 secs 2024-04-26T21:01:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:01:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9117.393560 secs 2024-04-26T21:02:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:01 smithi189 ceph-mon[32756]: pgmap v5814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:01 smithi156 ceph-mon[32679]: pgmap v5814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:01 smithi092 ceph-mon[29156]: pgmap v5814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:03 smithi189 ceph-mon[32756]: pgmap v5815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:03 smithi156 ceph-mon[32679]: pgmap v5815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:03 smithi092 ceph-mon[29156]: pgmap v5815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9819.418091 secs 2024-04-26T21:02:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9122.393698 secs 2024-04-26T21:02:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9819.418091 secs 2024-04-26T21:02:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9122.393698 secs 2024-04-26T21:02:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9819.418091 secs 2024-04-26T21:02:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9122.393698 secs 2024-04-26T21:02:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:05 smithi189 ceph-mon[32756]: pgmap v5816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:05 smithi156 ceph-mon[32679]: pgmap v5816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:05 smithi092 ceph-mon[29156]: pgmap v5816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:07 smithi189 ceph-mon[32756]: pgmap v5817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:07 smithi156 ceph-mon[32679]: pgmap v5817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:07 smithi092 ceph-mon[29156]: pgmap v5817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:09 smithi189 ceph-mon[32756]: pgmap v5818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9824.418197 secs 2024-04-26T21:02:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9127.393781 secs 2024-04-26T21:02:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:09 smithi156 ceph-mon[32679]: pgmap v5818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9824.418197 secs 2024-04-26T21:02:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9127.393781 secs 2024-04-26T21:02:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:09 smithi092 ceph-mon[29156]: pgmap v5818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9824.418197 secs 2024-04-26T21:02:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9127.393781 secs 2024-04-26T21:02:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:11 smithi189 ceph-mon[32756]: pgmap v5819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:11 smithi156 ceph-mon[32679]: pgmap v5819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:11 smithi092 ceph-mon[29156]: pgmap v5819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:13 smithi189 ceph-mon[32756]: pgmap v5820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:13 smithi156 ceph-mon[32679]: pgmap v5820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:13 smithi092 ceph-mon[29156]: pgmap v5820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9829.418329 secs 2024-04-26T21:02:14.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9132.393907 secs 2024-04-26T21:02:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9829.418329 secs 2024-04-26T21:02:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9132.393907 secs 2024-04-26T21:02:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9829.418329 secs 2024-04-26T21:02:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9132.393907 secs 2024-04-26T21:02:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:15 smithi189 ceph-mon[32756]: pgmap v5821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:15 smithi156 ceph-mon[32679]: pgmap v5821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:15 smithi092 ceph-mon[29156]: pgmap v5821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:17 smithi189 ceph-mon[32756]: pgmap v5822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:17 smithi156 ceph-mon[32679]: pgmap v5822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:17 smithi092 ceph-mon[29156]: pgmap v5822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:19 smithi189 ceph-mon[32756]: pgmap v5823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9834.418440 secs 2024-04-26T21:02:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9137.394054 secs 2024-04-26T21:02:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:19 smithi156 ceph-mon[32679]: pgmap v5823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9834.418440 secs 2024-04-26T21:02:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9137.394054 secs 2024-04-26T21:02:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:19 smithi092 ceph-mon[29156]: pgmap v5823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9834.418440 secs 2024-04-26T21:02:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9137.394054 secs 2024-04-26T21:02:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:21 smithi189 ceph-mon[32756]: pgmap v5824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:21 smithi156 ceph-mon[32679]: pgmap v5824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:21 smithi092 ceph-mon[29156]: pgmap v5824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:23 smithi189 ceph-mon[32756]: pgmap v5825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:23 smithi156 ceph-mon[32679]: pgmap v5825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:23 smithi092 ceph-mon[29156]: pgmap v5825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9839.418555 secs 2024-04-26T21:02:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9142.394172 secs 2024-04-26T21:02:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9839.418555 secs 2024-04-26T21:02:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9142.394172 secs 2024-04-26T21:02:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9839.418555 secs 2024-04-26T21:02:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9142.394172 secs 2024-04-26T21:02:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:25 smithi189 ceph-mon[32756]: pgmap v5826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:25 smithi156 ceph-mon[32679]: pgmap v5826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:25 smithi092 ceph-mon[29156]: pgmap v5826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:27 smithi189 ceph-mon[32756]: pgmap v5827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:27 smithi156 ceph-mon[32679]: pgmap v5827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:27 smithi092 ceph-mon[29156]: pgmap v5827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:29 smithi189 ceph-mon[32756]: pgmap v5828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9844.418642 secs 2024-04-26T21:02:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9147.394261 secs 2024-04-26T21:02:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:29 smithi156 ceph-mon[32679]: pgmap v5828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9844.418642 secs 2024-04-26T21:02:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9147.394261 secs 2024-04-26T21:02:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:29 smithi092 ceph-mon[29156]: pgmap v5828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9844.418642 secs 2024-04-26T21:02:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9147.394261 secs 2024-04-26T21:02:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:31 smithi189 ceph-mon[32756]: pgmap v5829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:31 smithi156 ceph-mon[32679]: pgmap v5829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:31 smithi092 ceph-mon[29156]: pgmap v5829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:33 smithi189 ceph-mon[32756]: pgmap v5830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:33 smithi156 ceph-mon[32679]: pgmap v5830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:33 smithi092 ceph-mon[29156]: pgmap v5830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9849.418760 secs 2024-04-26T21:02:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9152.394378 secs 2024-04-26T21:02:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9849.418760 secs 2024-04-26T21:02:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9152.394378 secs 2024-04-26T21:02:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9849.418760 secs 2024-04-26T21:02:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9152.394378 secs 2024-04-26T21:02:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:35 smithi189 ceph-mon[32756]: pgmap v5831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:35 smithi156 ceph-mon[32679]: pgmap v5831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:35 smithi092 ceph-mon[29156]: pgmap v5831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:37 smithi189 ceph-mon[32756]: pgmap v5832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:37 smithi156 ceph-mon[32679]: pgmap v5832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:37 smithi092 ceph-mon[29156]: pgmap v5832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:39 smithi189 ceph-mon[32756]: pgmap v5833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9854.418876 secs 2024-04-26T21:02:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9157.394442 secs 2024-04-26T21:02:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:39 smithi156 ceph-mon[32679]: pgmap v5833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9854.418876 secs 2024-04-26T21:02:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9157.394442 secs 2024-04-26T21:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:39 smithi092 ceph-mon[29156]: pgmap v5833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9854.418876 secs 2024-04-26T21:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9157.394442 secs 2024-04-26T21:02:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:02:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: pgmap v5834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: pgmap v5835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:02:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: pgmap v5836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:02:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: pgmap v5834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: pgmap v5835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:02:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: pgmap v5836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: pgmap v5834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: pgmap v5835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: pgmap v5836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:41.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:44 smithi189 ceph-mon[32756]: pgmap v5837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:02:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9859.418993 secs 2024-04-26T21:02:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9162.394564 secs 2024-04-26T21:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:44 smithi156 ceph-mon[32679]: pgmap v5837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9859.418993 secs 2024-04-26T21:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9162.394564 secs 2024-04-26T21:02:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:44 smithi092 ceph-mon[29156]: pgmap v5837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:02:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9859.418993 secs 2024-04-26T21:02:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9162.394564 secs 2024-04-26T21:02:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:46 smithi189 ceph-mon[32756]: pgmap v5838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:46 smithi156 ceph-mon[32679]: pgmap v5838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:46 smithi092 ceph-mon[29156]: pgmap v5838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:48 smithi189 ceph-mon[32756]: pgmap v5839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:48 smithi156 ceph-mon[32679]: pgmap v5839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:48 smithi092 ceph-mon[29156]: pgmap v5839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9864.419117 secs 2024-04-26T21:02:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9167.394674 secs 2024-04-26T21:02:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9864.419117 secs 2024-04-26T21:02:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9167.394674 secs 2024-04-26T21:02:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9864.419117 secs 2024-04-26T21:02:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9167.394674 secs 2024-04-26T21:02:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:50 smithi189 ceph-mon[32756]: pgmap v5840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:50 smithi156 ceph-mon[32679]: pgmap v5840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:50 smithi092 ceph-mon[29156]: pgmap v5840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:02:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:52 smithi189 ceph-mon[32756]: pgmap v5841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:02:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:52 smithi156 ceph-mon[32679]: pgmap v5841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:02:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:52 smithi092 ceph-mon[29156]: pgmap v5841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:02:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:54 smithi189 ceph-mon[32756]: pgmap v5842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9869.419235 secs 2024-04-26T21:02:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9172.394811 secs 2024-04-26T21:02:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:54 smithi156 ceph-mon[32679]: pgmap v5842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9869.419235 secs 2024-04-26T21:02:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9172.394811 secs 2024-04-26T21:02:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:54 smithi092 ceph-mon[29156]: pgmap v5842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9869.419235 secs 2024-04-26T21:02:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9172.394811 secs 2024-04-26T21:02:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:56 smithi189 ceph-mon[32756]: pgmap v5843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:56 smithi156 ceph-mon[32679]: pgmap v5843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:56 smithi092 ceph-mon[29156]: pgmap v5843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:02:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:58 smithi092 ceph-mon[29156]: pgmap v5844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:58 smithi189 ceph-mon[32756]: pgmap v5844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:58 smithi156 ceph-mon[32679]: pgmap v5844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:02:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9874.419368 secs 2024-04-26T21:02:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:02:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9177.394912 secs 2024-04-26T21:02:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9874.419368 secs 2024-04-26T21:02:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:02:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9177.394912 secs 2024-04-26T21:02:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9874.419368 secs 2024-04-26T21:02:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:02:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9177.394912 secs 2024-04-26T21:03:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:00 smithi189 ceph-mon[32756]: pgmap v5845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:00 smithi156 ceph-mon[32679]: pgmap v5845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:00 smithi092 ceph-mon[29156]: pgmap v5845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:02 smithi189 ceph-mon[32756]: pgmap v5846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:02 smithi156 ceph-mon[32679]: pgmap v5846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:02 smithi092 ceph-mon[29156]: pgmap v5846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:04 smithi189 ceph-mon[32756]: pgmap v5847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9879.419494 secs 2024-04-26T21:03:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9182.395047 secs 2024-04-26T21:03:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:04 smithi156 ceph-mon[32679]: pgmap v5847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9879.419494 secs 2024-04-26T21:03:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9182.395047 secs 2024-04-26T21:03:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:04 smithi092 ceph-mon[29156]: pgmap v5847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9879.419494 secs 2024-04-26T21:03:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9182.395047 secs 2024-04-26T21:03:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:06 smithi189 ceph-mon[32756]: pgmap v5848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:06 smithi156 ceph-mon[32679]: pgmap v5848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:06 smithi092 ceph-mon[29156]: pgmap v5848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:08 smithi189 ceph-mon[32756]: pgmap v5849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:08 smithi156 ceph-mon[32679]: pgmap v5849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:08 smithi092 ceph-mon[29156]: pgmap v5849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9884.419614 secs 2024-04-26T21:03:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9187.395194 secs 2024-04-26T21:03:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9884.419614 secs 2024-04-26T21:03:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9187.395194 secs 2024-04-26T21:03:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9884.419614 secs 2024-04-26T21:03:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9187.395194 secs 2024-04-26T21:03:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:10 smithi189 ceph-mon[32756]: pgmap v5850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:10 smithi156 ceph-mon[32679]: pgmap v5850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:10 smithi092 ceph-mon[29156]: pgmap v5850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:12 smithi189 ceph-mon[32756]: pgmap v5851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:12 smithi156 ceph-mon[32679]: pgmap v5851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:12 smithi092 ceph-mon[29156]: pgmap v5851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:14 smithi189 ceph-mon[32756]: pgmap v5852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9889.419727 secs 2024-04-26T21:03:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9192.395333 secs 2024-04-26T21:03:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:14 smithi156 ceph-mon[32679]: pgmap v5852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9889.419727 secs 2024-04-26T21:03:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9192.395333 secs 2024-04-26T21:03:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:14 smithi092 ceph-mon[29156]: pgmap v5852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9889.419727 secs 2024-04-26T21:03:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9192.395333 secs 2024-04-26T21:03:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:16 smithi189 ceph-mon[32756]: pgmap v5853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:16 smithi156 ceph-mon[32679]: pgmap v5853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:16 smithi092 ceph-mon[29156]: pgmap v5853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:18 smithi189 ceph-mon[32756]: pgmap v5854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:18 smithi156 ceph-mon[32679]: pgmap v5854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:18 smithi092 ceph-mon[29156]: pgmap v5854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9894.419887 secs 2024-04-26T21:03:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9197.395477 secs 2024-04-26T21:03:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9894.419887 secs 2024-04-26T21:03:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9197.395477 secs 2024-04-26T21:03:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9894.419887 secs 2024-04-26T21:03:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9197.395477 secs 2024-04-26T21:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:20 smithi189 ceph-mon[32756]: pgmap v5855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:20 smithi156 ceph-mon[32679]: pgmap v5855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:20 smithi092 ceph-mon[29156]: pgmap v5855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:21 smithi189 ceph-mon[32756]: pgmap v5856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:21 smithi156 ceph-mon[32679]: pgmap v5856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:21 smithi092 ceph-mon[29156]: pgmap v5856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:24 smithi189 ceph-mon[32756]: pgmap v5857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9899.420006 secs 2024-04-26T21:03:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9202.395593 secs 2024-04-26T21:03:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:24 smithi156 ceph-mon[32679]: pgmap v5857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9899.420006 secs 2024-04-26T21:03:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9202.395593 secs 2024-04-26T21:03:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:24 smithi092 ceph-mon[29156]: pgmap v5857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9899.420006 secs 2024-04-26T21:03:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9202.395593 secs 2024-04-26T21:03:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:26 smithi189 ceph-mon[32756]: pgmap v5858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:26 smithi156 ceph-mon[32679]: pgmap v5858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:26 smithi092 ceph-mon[29156]: pgmap v5858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:28 smithi189 ceph-mon[32756]: pgmap v5859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:28 smithi156 ceph-mon[32679]: pgmap v5859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:28 smithi092 ceph-mon[29156]: pgmap v5859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9904.420124 secs 2024-04-26T21:03:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9207.395735 secs 2024-04-26T21:03:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9904.420124 secs 2024-04-26T21:03:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9207.395735 secs 2024-04-26T21:03:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9904.420124 secs 2024-04-26T21:03:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9207.395735 secs 2024-04-26T21:03:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:30 smithi189 ceph-mon[32756]: pgmap v5860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:30 smithi156 ceph-mon[32679]: pgmap v5860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:30 smithi092 ceph-mon[29156]: pgmap v5860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:32 smithi189 ceph-mon[32756]: pgmap v5861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:32 smithi156 ceph-mon[32679]: pgmap v5861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:32 smithi092 ceph-mon[29156]: pgmap v5861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:34 smithi189 ceph-mon[32756]: pgmap v5862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9909.420257 secs 2024-04-26T21:03:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9212.395843 secs 2024-04-26T21:03:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:34 smithi156 ceph-mon[32679]: pgmap v5862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9909.420257 secs 2024-04-26T21:03:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9212.395843 secs 2024-04-26T21:03:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:34 smithi092 ceph-mon[29156]: pgmap v5862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9909.420257 secs 2024-04-26T21:03:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9212.395843 secs 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8032e70 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8032e70 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T21:03:36.005 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:03:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:03:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.004+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:03:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.005+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.005+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca80b0070 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:03:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.032+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:03:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.032+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:03:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=9 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.033+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T21:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:36.033+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T21:03:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:36 smithi189 ceph-mon[32756]: pgmap v5863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:36 smithi156 ceph-mon[32679]: pgmap v5863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:36 smithi092 ceph-mon[29156]: pgmap v5863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.334+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:03:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.334+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:03:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:03:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T21:03:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 79 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:03:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:03:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-26T21:03:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:03:37.335+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 80 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:03:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:38 smithi189 ceph-mon[32756]: pgmap v5864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:38 smithi156 ceph-mon[32679]: pgmap v5864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:38 smithi092 ceph-mon[29156]: pgmap v5864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9914.420370 secs 2024-04-26T21:03:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9217.395960 secs 2024-04-26T21:03:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9914.420370 secs 2024-04-26T21:03:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9217.395960 secs 2024-04-26T21:03:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9914.420370 secs 2024-04-26T21:03:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9217.395960 secs 2024-04-26T21:03:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:40 smithi189 ceph-mon[32756]: pgmap v5865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:40 smithi156 ceph-mon[32679]: pgmap v5865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:40 smithi092 ceph-mon[29156]: pgmap v5865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:41 smithi189 ceph-mon[32756]: pgmap v5866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:41 smithi156 ceph-mon[32679]: pgmap v5866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:41 smithi092 ceph-mon[29156]: pgmap v5866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:03:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:43 smithi189 ceph-mon[32756]: pgmap v5867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:43.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:43 smithi092 ceph-mon[29156]: pgmap v5867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:43 smithi156 ceph-mon[32679]: pgmap v5867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9919.420437 secs 2024-04-26T21:03:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9222.396056 secs 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9919.420437 secs 2024-04-26T21:03:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9222.396056 secs 2024-04-26T21:03:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9919.420437 secs 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9222.396056 secs 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: pgmap v5868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:46.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: pgmap v5869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:46.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: pgmap v5870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: pgmap v5868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: pgmap v5869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:46.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: pgmap v5870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: pgmap v5868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:46.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:03:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: pgmap v5869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:46.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: pgmap v5870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:46.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:03:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:47 smithi092 ceph-mon[29156]: pgmap v5871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:47 smithi189 ceph-mon[32756]: pgmap v5871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:47 smithi156 ceph-mon[32679]: pgmap v5871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:49.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9924.420569 secs 2024-04-26T21:03:49.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9227.396201 secs 2024-04-26T21:03:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9924.420569 secs 2024-04-26T21:03:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9227.396201 secs 2024-04-26T21:03:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9924.420569 secs 2024-04-26T21:03:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9227.396201 secs 2024-04-26T21:03:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:49 smithi092 ceph-mon[29156]: pgmap v5872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:49 smithi189 ceph-mon[32756]: pgmap v5872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:49 smithi156 ceph-mon[32679]: pgmap v5872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:51 smithi092 ceph-mon[29156]: pgmap v5873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:51 smithi189 ceph-mon[32756]: pgmap v5873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:51 smithi156 ceph-mon[32679]: pgmap v5873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:03:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:53 smithi092 ceph-mon[29156]: pgmap v5874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9929.420686 secs 2024-04-26T21:03:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9232.396319 secs 2024-04-26T21:03:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:53 smithi189 ceph-mon[32756]: pgmap v5874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9929.420686 secs 2024-04-26T21:03:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9232.396319 secs 2024-04-26T21:03:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:53 smithi156 ceph-mon[32679]: pgmap v5874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:03:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9929.420686 secs 2024-04-26T21:03:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9232.396319 secs 2024-04-26T21:03:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:55 smithi189 ceph-mon[32756]: pgmap v5875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:55 smithi156 ceph-mon[32679]: pgmap v5875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:55 smithi092 ceph-mon[29156]: pgmap v5875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:03:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:57 smithi189 ceph-mon[32756]: pgmap v5876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:57 smithi156 ceph-mon[32679]: pgmap v5876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:57 smithi092 ceph-mon[29156]: pgmap v5876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:03:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9934.420818 secs 2024-04-26T21:03:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:03:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9237.396438 secs 2024-04-26T21:03:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9934.420818 secs 2024-04-26T21:03:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:03:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9237.396438 secs 2024-04-26T21:03:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9934.420818 secs 2024-04-26T21:03:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:03:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9237.396438 secs 2024-04-26T21:04:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:00 smithi092 ceph-mon[29156]: pgmap v5877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:00 smithi189 ceph-mon[32756]: pgmap v5877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:00 smithi156 ceph-mon[32679]: pgmap v5877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:02 smithi189 ceph-mon[32756]: pgmap v5878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:02 smithi156 ceph-mon[32679]: pgmap v5878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:02 smithi092 ceph-mon[29156]: pgmap v5878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:04 smithi189 ceph-mon[32756]: pgmap v5879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:04.447 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9939.420930 secs 2024-04-26T21:04:04.447 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9242.396516 secs 2024-04-26T21:04:04.448 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:04 smithi156 ceph-mon[32679]: pgmap v5879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:04.448 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9939.420930 secs 2024-04-26T21:04:04.448 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9242.396516 secs 2024-04-26T21:04:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:04 smithi092 ceph-mon[29156]: pgmap v5879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9939.420930 secs 2024-04-26T21:04:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9242.396516 secs 2024-04-26T21:04:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:06 smithi189 ceph-mon[32756]: pgmap v5880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:06 smithi156 ceph-mon[32679]: pgmap v5880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:06 smithi092 ceph-mon[29156]: pgmap v5880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:08 smithi189 ceph-mon[32756]: pgmap v5881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:08 smithi156 ceph-mon[32679]: pgmap v5881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:08 smithi092 ceph-mon[29156]: pgmap v5881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:09.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9944.421040 secs 2024-04-26T21:04:09.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9247.396648 secs 2024-04-26T21:04:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9944.421040 secs 2024-04-26T21:04:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9247.396648 secs 2024-04-26T21:04:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9944.421040 secs 2024-04-26T21:04:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9247.396648 secs 2024-04-26T21:04:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:10 smithi189 ceph-mon[32756]: pgmap v5882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:10 smithi156 ceph-mon[32679]: pgmap v5882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:10 smithi092 ceph-mon[29156]: pgmap v5882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:12 smithi189 ceph-mon[32756]: pgmap v5883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:12 smithi156 ceph-mon[32679]: pgmap v5883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:12 smithi092 ceph-mon[29156]: pgmap v5883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:14.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:14 smithi092 ceph-mon[29156]: pgmap v5884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:14.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9949.421121 secs 2024-04-26T21:04:14.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9252.396780 secs 2024-04-26T21:04:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:14 smithi189 ceph-mon[32756]: pgmap v5884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9949.421121 secs 2024-04-26T21:04:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9252.396780 secs 2024-04-26T21:04:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:14 smithi156 ceph-mon[32679]: pgmap v5884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9949.421121 secs 2024-04-26T21:04:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9252.396780 secs 2024-04-26T21:04:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:16 smithi189 ceph-mon[32756]: pgmap v5885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:16 smithi156 ceph-mon[32679]: pgmap v5885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:16 smithi092 ceph-mon[29156]: pgmap v5885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:18 smithi189 ceph-mon[32756]: pgmap v5886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:18 smithi156 ceph-mon[32679]: pgmap v5886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:18 smithi092 ceph-mon[29156]: pgmap v5886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9954.421251 secs 2024-04-26T21:04:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9257.396854 secs 2024-04-26T21:04:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9954.421251 secs 2024-04-26T21:04:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9257.396854 secs 2024-04-26T21:04:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9954.421251 secs 2024-04-26T21:04:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9257.396854 secs 2024-04-26T21:04:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:20 smithi189 ceph-mon[32756]: pgmap v5887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:20 smithi156 ceph-mon[32679]: pgmap v5887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:20 smithi092 ceph-mon[29156]: pgmap v5887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:22 smithi189 ceph-mon[32756]: pgmap v5888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:22 smithi156 ceph-mon[32679]: pgmap v5888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:22 smithi092 ceph-mon[29156]: pgmap v5888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:24 smithi189 ceph-mon[32756]: pgmap v5889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9959.421403 secs 2024-04-26T21:04:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9262.396975 secs 2024-04-26T21:04:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:24 smithi156 ceph-mon[32679]: pgmap v5889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9959.421403 secs 2024-04-26T21:04:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9262.396975 secs 2024-04-26T21:04:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:24 smithi092 ceph-mon[29156]: pgmap v5889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9959.421403 secs 2024-04-26T21:04:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9262.396975 secs 2024-04-26T21:04:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:26 smithi189 ceph-mon[32756]: pgmap v5890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:26 smithi156 ceph-mon[32679]: pgmap v5890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:26 smithi092 ceph-mon[29156]: pgmap v5890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:27 smithi092 ceph-mon[29156]: pgmap v5891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:28.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:27 smithi189 ceph-mon[32756]: pgmap v5891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:27 smithi156 ceph-mon[32679]: pgmap v5891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9964.421536 secs 2024-04-26T21:04:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9267.397113 secs 2024-04-26T21:04:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9964.421536 secs 2024-04-26T21:04:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9267.397113 secs 2024-04-26T21:04:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9964.421536 secs 2024-04-26T21:04:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9267.397113 secs 2024-04-26T21:04:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:29 smithi092 ceph-mon[29156]: pgmap v5892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:29 smithi189 ceph-mon[32756]: pgmap v5892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:29 smithi156 ceph-mon[32679]: pgmap v5892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:32 smithi189 ceph-mon[32756]: pgmap v5893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:32 smithi156 ceph-mon[32679]: pgmap v5893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:32 smithi092 ceph-mon[29156]: pgmap v5893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:34 smithi189 ceph-mon[32756]: pgmap v5894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9969.421658 secs 2024-04-26T21:04:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9272.397219 secs 2024-04-26T21:04:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:34 smithi156 ceph-mon[32679]: pgmap v5894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9969.421658 secs 2024-04-26T21:04:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9272.397219 secs 2024-04-26T21:04:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:34 smithi092 ceph-mon[29156]: pgmap v5894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9969.421658 secs 2024-04-26T21:04:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9272.397219 secs 2024-04-26T21:04:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:36 smithi189 ceph-mon[32756]: pgmap v5895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:36 smithi156 ceph-mon[32679]: pgmap v5895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:36 smithi092 ceph-mon[29156]: pgmap v5895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:38 smithi189 ceph-mon[32756]: pgmap v5896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:38 smithi156 ceph-mon[32679]: pgmap v5896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:38 smithi092 ceph-mon[29156]: pgmap v5896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9974.421755 secs 2024-04-26T21:04:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9277.397335 secs 2024-04-26T21:04:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9974.421755 secs 2024-04-26T21:04:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9277.397335 secs 2024-04-26T21:04:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9974.421755 secs 2024-04-26T21:04:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9277.397335 secs 2024-04-26T21:04:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:40 smithi189 ceph-mon[32756]: pgmap v5897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:40 smithi156 ceph-mon[32679]: pgmap v5897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:40 smithi092 ceph-mon[29156]: pgmap v5897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:42 smithi189 ceph-mon[32756]: pgmap v5898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:42 smithi156 ceph-mon[32679]: pgmap v5898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:42 smithi092 ceph-mon[29156]: pgmap v5898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:44 smithi189 ceph-mon[32756]: pgmap v5899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9979.421877 secs 2024-04-26T21:04:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9282.397475 secs 2024-04-26T21:04:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:44 smithi156 ceph-mon[32679]: pgmap v5899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9979.421877 secs 2024-04-26T21:04:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9282.397475 secs 2024-04-26T21:04:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:44 smithi092 ceph-mon[29156]: pgmap v5899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9979.421877 secs 2024-04-26T21:04:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9282.397475 secs 2024-04-26T21:04:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:46 smithi092 ceph-mon[29156]: pgmap v5900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:04:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:46 smithi189 ceph-mon[32756]: pgmap v5900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:04:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:46 smithi156 ceph-mon[32679]: pgmap v5900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:04:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:04:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:04:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:04:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:04:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:47 smithi189 ceph-mon[32756]: pgmap v5901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:04:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:47 smithi189 ceph-mon[32756]: pgmap v5902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:47 smithi156 ceph-mon[32679]: pgmap v5901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:04:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:47 smithi156 ceph-mon[32679]: pgmap v5902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:47 smithi092 ceph-mon[29156]: pgmap v5901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:04:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:47 smithi092 ceph-mon[29156]: pgmap v5902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:49 smithi189 ceph-mon[32756]: pgmap v5903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:04:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9984.422012 secs 2024-04-26T21:04:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9287.397591 secs 2024-04-26T21:04:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:49 smithi156 ceph-mon[32679]: pgmap v5903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:04:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9984.422012 secs 2024-04-26T21:04:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9287.397591 secs 2024-04-26T21:04:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:49 smithi092 ceph-mon[29156]: pgmap v5903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:04:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9984.422012 secs 2024-04-26T21:04:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9287.397591 secs 2024-04-26T21:04:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:51 smithi189 ceph-mon[32756]: pgmap v5904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:51 smithi156 ceph-mon[32679]: pgmap v5904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:51 smithi092 ceph-mon[29156]: pgmap v5904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:53 smithi189 ceph-mon[32756]: pgmap v5905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:53 smithi156 ceph-mon[32679]: pgmap v5905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:53 smithi092 ceph-mon[29156]: pgmap v5905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9989.422150 secs 2024-04-26T21:04:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9292.397709 secs 2024-04-26T21:04:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9989.422150 secs 2024-04-26T21:04:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9292.397709 secs 2024-04-26T21:04:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9989.422150 secs 2024-04-26T21:04:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9292.397709 secs 2024-04-26T21:04:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:55 smithi189 ceph-mon[32756]: pgmap v5906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:55 smithi156 ceph-mon[32679]: pgmap v5906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:55 smithi092 ceph-mon[29156]: pgmap v5906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:04:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:56 smithi189 ceph-mon[32756]: pgmap v5907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:04:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:56 smithi156 ceph-mon[32679]: pgmap v5907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:04:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:56 smithi092 ceph-mon[29156]: pgmap v5907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:04:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:58 smithi156 ceph-mon[32679]: pgmap v5908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9994.422276 secs 2024-04-26T21:04:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:04:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9297.397844 secs 2024-04-26T21:04:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:58 smithi092 ceph-mon[29156]: pgmap v5908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9994.422276 secs 2024-04-26T21:04:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:04:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9297.397844 secs 2024-04-26T21:04:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:58 smithi189 ceph-mon[32756]: pgmap v5908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:04:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9994.422276 secs 2024-04-26T21:04:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:04:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9297.397844 secs 2024-04-26T21:05:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:00 smithi156 ceph-mon[32679]: pgmap v5909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:00 smithi092 ceph-mon[29156]: pgmap v5909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:00 smithi189 ceph-mon[32756]: pgmap v5909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:02 smithi156 ceph-mon[32679]: pgmap v5910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:02 smithi092 ceph-mon[29156]: pgmap v5910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:02 smithi189 ceph-mon[32756]: pgmap v5910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:03.923 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:05:03.503+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:05:03.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:05:03.503+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:05:03.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:05:03.503+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:05:03.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:05:03.503+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:05:03.924 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:05:03.503+0000 7f254657a700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:05:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 9999.422420 secs 2024-04-26T21:05:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9302.397943 secs 2024-04-26T21:05:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 9999.422420 secs 2024-04-26T21:05:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9302.397943 secs 2024-04-26T21:05:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 9999.422420 secs 2024-04-26T21:05:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9302.397943 secs 2024-04-26T21:05:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:04 smithi156 ceph-mon[32679]: pgmap v5911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T21:05:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:04 smithi092 ceph-mon[29156]: pgmap v5911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T21:05:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:04 smithi189 ceph-mon[32756]: pgmap v5911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-26T21:05:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:06 smithi156 ceph-mon[32679]: pgmap v5912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:06 smithi092 ceph-mon[29156]: pgmap v5912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:06 smithi189 ceph-mon[32756]: pgmap v5912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:08 smithi156 ceph-mon[32679]: pgmap v5913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10004.422532 secs 2024-04-26T21:05:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9307.398022 secs 2024-04-26T21:05:09.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:08 smithi189 ceph-mon[32756]: pgmap v5913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:09.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10004.422532 secs 2024-04-26T21:05:09.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9307.398022 secs 2024-04-26T21:05:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:08 smithi092 ceph-mon[29156]: pgmap v5913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-26T21:05:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10004.422532 secs 2024-04-26T21:05:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9307.398022 secs 2024-04-26T21:05:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:10 smithi156 ceph-mon[32679]: pgmap v5914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:10 smithi092 ceph-mon[29156]: pgmap v5914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:10 smithi189 ceph-mon[32756]: pgmap v5914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:12 smithi092 ceph-mon[29156]: pgmap v5915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:05:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:12 smithi189 ceph-mon[32756]: pgmap v5915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:05:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:12 smithi156 ceph-mon[32679]: pgmap v5915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:05:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10009.422627 secs 2024-04-26T21:05:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9312.398150 secs 2024-04-26T21:05:14.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10009.422627 secs 2024-04-26T21:05:14.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9312.398150 secs 2024-04-26T21:05:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10009.422627 secs 2024-04-26T21:05:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9312.398150 secs 2024-04-26T21:05:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:14 smithi092 ceph-mon[29156]: pgmap v5916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:14 smithi189 ceph-mon[32756]: pgmap v5916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:14 smithi156 ceph-mon[32679]: pgmap v5916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:05:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:16 smithi092 ceph-mon[29156]: pgmap v5917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:16 smithi189 ceph-mon[32756]: pgmap v5917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:16 smithi156 ceph-mon[32679]: pgmap v5917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:18 smithi092 ceph-mon[29156]: pgmap v5918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10014.422743 secs 2024-04-26T21:05:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9317.398262 secs 2024-04-26T21:05:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:18 smithi189 ceph-mon[32756]: pgmap v5918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10014.422743 secs 2024-04-26T21:05:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9317.398262 secs 2024-04-26T21:05:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:18 smithi156 ceph-mon[32679]: pgmap v5918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 85 B/s wr, 10 op/s 2024-04-26T21:05:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10014.422743 secs 2024-04-26T21:05:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9317.398262 secs 2024-04-26T21:05:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:20 smithi092 ceph-mon[29156]: pgmap v5919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T21:05:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:20 smithi189 ceph-mon[32756]: pgmap v5919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T21:05:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:20 smithi156 ceph-mon[32679]: pgmap v5919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-26T21:05:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:22 smithi092 ceph-mon[29156]: pgmap v5920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:22 smithi189 ceph-mon[32756]: pgmap v5920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:22 smithi156 ceph-mon[32679]: pgmap v5920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10019.422862 secs 2024-04-26T21:05:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9322.398336 secs 2024-04-26T21:05:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10019.422862 secs 2024-04-26T21:05:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9322.398336 secs 2024-04-26T21:05:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10019.422862 secs 2024-04-26T21:05:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9322.398336 secs 2024-04-26T21:05:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:24 smithi092 ceph-mon[29156]: pgmap v5921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:24 smithi189 ceph-mon[32756]: pgmap v5921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:24 smithi156 ceph-mon[32679]: pgmap v5921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:26 smithi092 ceph-mon[29156]: pgmap v5922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:26 smithi189 ceph-mon[32756]: pgmap v5922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:26 smithi156 ceph-mon[32679]: pgmap v5922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:28 smithi092 ceph-mon[29156]: pgmap v5923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10024.422969 secs 2024-04-26T21:05:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9327.398454 secs 2024-04-26T21:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:28 smithi189 ceph-mon[32756]: pgmap v5923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10024.422969 secs 2024-04-26T21:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9327.398454 secs 2024-04-26T21:05:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:28 smithi156 ceph-mon[32679]: pgmap v5923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10024.422969 secs 2024-04-26T21:05:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9327.398454 secs 2024-04-26T21:05:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:30 smithi092 ceph-mon[29156]: pgmap v5924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:30 smithi189 ceph-mon[32756]: pgmap v5924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:30 smithi156 ceph-mon[32679]: pgmap v5924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:32 smithi092 ceph-mon[29156]: pgmap v5925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:32 smithi189 ceph-mon[32756]: pgmap v5925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:32 smithi156 ceph-mon[32679]: pgmap v5925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10029.423062 secs 2024-04-26T21:05:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9332.398569 secs 2024-04-26T21:05:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10029.423062 secs 2024-04-26T21:05:34.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9332.398569 secs 2024-04-26T21:05:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10029.423062 secs 2024-04-26T21:05:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9332.398569 secs 2024-04-26T21:05:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:34 smithi092 ceph-mon[29156]: pgmap v5926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:34 smithi189 ceph-mon[32756]: pgmap v5926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:34 smithi156 ceph-mon[32679]: pgmap v5926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:36 smithi092 ceph-mon[29156]: pgmap v5927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:36 smithi189 ceph-mon[32756]: pgmap v5927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:36 smithi156 ceph-mon[32679]: pgmap v5927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:38 smithi092 ceph-mon[29156]: pgmap v5928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10034.423179 secs 2024-04-26T21:05:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:38 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9337.398696 secs 2024-04-26T21:05:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:38 smithi189 ceph-mon[32756]: pgmap v5928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10034.423179 secs 2024-04-26T21:05:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:38 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9337.398696 secs 2024-04-26T21:05:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:38 smithi156 ceph-mon[32679]: pgmap v5928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10034.423179 secs 2024-04-26T21:05:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:38 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9337.398696 secs 2024-04-26T21:05:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:40 smithi189 ceph-mon[32756]: pgmap v5929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:40 smithi156 ceph-mon[32679]: pgmap v5929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:40 smithi092 ceph-mon[29156]: pgmap v5929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:42 smithi189 ceph-mon[32756]: pgmap v5930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:42 smithi156 ceph-mon[32679]: pgmap v5930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:42 smithi092 ceph-mon[29156]: pgmap v5930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:44.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10039.423295 secs 2024-04-26T21:05:44.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9342.398816 secs 2024-04-26T21:05:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10039.423295 secs 2024-04-26T21:05:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9342.398816 secs 2024-04-26T21:05:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10039.423295 secs 2024-04-26T21:05:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9342.398816 secs 2024-04-26T21:05:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:45 smithi189 ceph-mon[32756]: pgmap v5931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:45 smithi156 ceph-mon[32679]: pgmap v5931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:45 smithi092 ceph-mon[29156]: pgmap v5931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:05:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:05:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:47 smithi189 ceph-mon[32756]: pgmap v5932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:47.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:05:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:47 smithi156 ceph-mon[32679]: pgmap v5932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:05:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:47 smithi092 ceph-mon[29156]: pgmap v5932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:05:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:05:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:05:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:05:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:48 smithi189 ceph-mon[32756]: pgmap v5933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:05:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:48 smithi189 ceph-mon[32756]: pgmap v5934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:48 smithi156 ceph-mon[32679]: pgmap v5933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:05:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:48 smithi156 ceph-mon[32679]: pgmap v5934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:48 smithi092 ceph-mon[29156]: pgmap v5933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:05:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:48 smithi092 ceph-mon[29156]: pgmap v5934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10044.423410 secs 2024-04-26T21:05:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9347.398902 secs 2024-04-26T21:05:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10044.423410 secs 2024-04-26T21:05:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9347.398902 secs 2024-04-26T21:05:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10044.423410 secs 2024-04-26T21:05:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9347.398902 secs 2024-04-26T21:05:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:50 smithi189 ceph-mon[32756]: pgmap v5935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:50 smithi156 ceph-mon[32679]: pgmap v5935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:50 smithi092 ceph-mon[29156]: pgmap v5935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:52.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:52 smithi189 ceph-mon[32756]: pgmap v5936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:52 smithi156 ceph-mon[32679]: pgmap v5936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:52 smithi092 ceph-mon[29156]: pgmap v5936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:54 smithi189 ceph-mon[32756]: pgmap v5937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:05:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10049.423532 secs 2024-04-26T21:05:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9352.398995 secs 2024-04-26T21:05:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:54 smithi156 ceph-mon[32679]: pgmap v5937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:05:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10049.423532 secs 2024-04-26T21:05:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9352.398995 secs 2024-04-26T21:05:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:54 smithi092 ceph-mon[29156]: pgmap v5937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:05:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10049.423532 secs 2024-04-26T21:05:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9352.398995 secs 2024-04-26T21:05:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:56 smithi189 ceph-mon[32756]: pgmap v5938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:56 smithi156 ceph-mon[32679]: pgmap v5938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:56 smithi092 ceph-mon[29156]: pgmap v5938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:05:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:58 smithi189 ceph-mon[32756]: pgmap v5939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:05:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:58 smithi156 ceph-mon[32679]: pgmap v5939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:05:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:58 smithi092 ceph-mon[29156]: pgmap v5939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10054.423652 secs 2024-04-26T21:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:05:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9357.399136 secs 2024-04-26T21:05:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10054.423652 secs 2024-04-26T21:05:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:05:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9357.399136 secs 2024-04-26T21:05:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10054.423652 secs 2024-04-26T21:05:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:05:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9357.399136 secs 2024-04-26T21:06:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:00 smithi189 ceph-mon[32756]: pgmap v5940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:00 smithi156 ceph-mon[32679]: pgmap v5940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:00 smithi092 ceph-mon[29156]: pgmap v5940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:02.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:02 smithi189 ceph-mon[32756]: pgmap v5941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:02 smithi156 ceph-mon[32679]: pgmap v5941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:02 smithi092 ceph-mon[29156]: pgmap v5941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:04 smithi189 ceph-mon[32756]: pgmap v5942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10059.423767 secs 2024-04-26T21:06:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9362.399255 secs 2024-04-26T21:06:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:04 smithi156 ceph-mon[32679]: pgmap v5942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10059.423767 secs 2024-04-26T21:06:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9362.399255 secs 2024-04-26T21:06:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:04 smithi092 ceph-mon[29156]: pgmap v5942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10059.423767 secs 2024-04-26T21:06:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9362.399255 secs 2024-04-26T21:06:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:06 smithi189 ceph-mon[32756]: pgmap v5943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:06 smithi156 ceph-mon[32679]: pgmap v5943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:06 smithi092 ceph-mon[29156]: pgmap v5943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:08 smithi189 ceph-mon[32756]: pgmap v5944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:08 smithi156 ceph-mon[32679]: pgmap v5944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:08 smithi092 ceph-mon[29156]: pgmap v5944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10064.423890 secs 2024-04-26T21:06:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9367.399373 secs 2024-04-26T21:06:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10064.423890 secs 2024-04-26T21:06:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9367.399373 secs 2024-04-26T21:06:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10064.423890 secs 2024-04-26T21:06:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9367.399373 secs 2024-04-26T21:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:10 smithi189 ceph-mon[32756]: pgmap v5945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:10 smithi156 ceph-mon[32679]: pgmap v5945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:10 smithi092 ceph-mon[29156]: pgmap v5945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:12 smithi189 ceph-mon[32756]: pgmap v5946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:12 smithi156 ceph-mon[32679]: pgmap v5946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:12 smithi092 ceph-mon[29156]: pgmap v5946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:14 smithi189 ceph-mon[32756]: pgmap v5947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10069.424001 secs 2024-04-26T21:06:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9372.399475 secs 2024-04-26T21:06:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:14 smithi156 ceph-mon[32679]: pgmap v5947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10069.424001 secs 2024-04-26T21:06:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9372.399475 secs 2024-04-26T21:06:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:14 smithi092 ceph-mon[29156]: pgmap v5947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:06:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10069.424001 secs 2024-04-26T21:06:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9372.399475 secs 2024-04-26T21:06:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:16 smithi189 ceph-mon[32756]: pgmap v5948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:16 smithi156 ceph-mon[32679]: pgmap v5948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:16 smithi092 ceph-mon[29156]: pgmap v5948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:06:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:18 smithi189 ceph-mon[32756]: pgmap v5949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:18 smithi156 ceph-mon[32679]: pgmap v5949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:18 smithi092 ceph-mon[29156]: pgmap v5949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10074.424112 secs 2024-04-26T21:06:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9377.399615 secs 2024-04-26T21:06:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10074.424112 secs 2024-04-26T21:06:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9377.399615 secs 2024-04-26T21:06:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10074.424112 secs 2024-04-26T21:06:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9377.399615 secs 2024-04-26T21:06:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:20 smithi189 ceph-mon[32756]: pgmap v5950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:20 smithi156 ceph-mon[32679]: pgmap v5950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:20 smithi092 ceph-mon[29156]: pgmap v5950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:22 smithi189 ceph-mon[32756]: pgmap v5951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:22 smithi156 ceph-mon[32679]: pgmap v5951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:22 smithi092 ceph-mon[29156]: pgmap v5951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:24 smithi189 ceph-mon[32756]: pgmap v5952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10079.424191 secs 2024-04-26T21:06:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9382.399725 secs 2024-04-26T21:06:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:24 smithi156 ceph-mon[32679]: pgmap v5952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10079.424191 secs 2024-04-26T21:06:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9382.399725 secs 2024-04-26T21:06:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:24 smithi092 ceph-mon[29156]: pgmap v5952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10079.424191 secs 2024-04-26T21:06:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9382.399725 secs 2024-04-26T21:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:26 smithi189 ceph-mon[32756]: pgmap v5953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:26 smithi156 ceph-mon[32679]: pgmap v5953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:26 smithi092 ceph-mon[29156]: pgmap v5953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:28 smithi189 ceph-mon[32756]: pgmap v5954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:28 smithi156 ceph-mon[32679]: pgmap v5954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:28 smithi092 ceph-mon[29156]: pgmap v5954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10084.424325 secs 2024-04-26T21:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9387.399842 secs 2024-04-26T21:06:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10084.424325 secs 2024-04-26T21:06:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9387.399842 secs 2024-04-26T21:06:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10084.424325 secs 2024-04-26T21:06:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9387.399842 secs 2024-04-26T21:06:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:30 smithi189 ceph-mon[32756]: pgmap v5955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:30 smithi156 ceph-mon[32679]: pgmap v5955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:30 smithi092 ceph-mon[29156]: pgmap v5955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:32 smithi189 ceph-mon[32756]: pgmap v5956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:32 smithi156 ceph-mon[32679]: pgmap v5956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:32 smithi092 ceph-mon[29156]: pgmap v5956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:34 smithi189 ceph-mon[32756]: pgmap v5957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10089.424444 secs 2024-04-26T21:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9392.399919 secs 2024-04-26T21:06:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:34 smithi156 ceph-mon[32679]: pgmap v5957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10089.424444 secs 2024-04-26T21:06:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9392.399919 secs 2024-04-26T21:06:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:34 smithi092 ceph-mon[29156]: pgmap v5957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10089.424444 secs 2024-04-26T21:06:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9392.399919 secs 2024-04-26T21:06:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:36 smithi092 ceph-mon[29156]: pgmap v5958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:36 smithi189 ceph-mon[32756]: pgmap v5958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:36 smithi156 ceph-mon[32679]: pgmap v5958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:06:37.358+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:06:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:06:37.358+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:06:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:06:37.358+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:06:37.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:06:37.358+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 81 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:06:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:37 smithi189 ceph-mon[32756]: pgmap v5959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:37 smithi156 ceph-mon[32679]: pgmap v5959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:37 smithi092 ceph-mon[29156]: pgmap v5959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10094.424561 secs 2024-04-26T21:06:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9397.400054 secs 2024-04-26T21:06:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:39 smithi092 ceph-mon[29156]: pgmap v5960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:40.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10094.424561 secs 2024-04-26T21:06:40.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9397.400054 secs 2024-04-26T21:06:40.092 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:39 smithi189 ceph-mon[32756]: pgmap v5960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10094.424561 secs 2024-04-26T21:06:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9397.400054 secs 2024-04-26T21:06:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:39 smithi156 ceph-mon[32679]: pgmap v5960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:41 smithi092 ceph-mon[29156]: pgmap v5961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:41 smithi189 ceph-mon[32756]: pgmap v5961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:41 smithi156 ceph-mon[32679]: pgmap v5961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:43 smithi092 ceph-mon[29156]: pgmap v5962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:43 smithi189 ceph-mon[32756]: pgmap v5962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:43 smithi156 ceph-mon[32679]: pgmap v5962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10099.424639 secs 2024-04-26T21:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9402.400203 secs 2024-04-26T21:06:45.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10099.424639 secs 2024-04-26T21:06:45.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9402.400203 secs 2024-04-26T21:06:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10099.424639 secs 2024-04-26T21:06:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9402.400203 secs 2024-04-26T21:06:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:45 smithi092 ceph-mon[29156]: pgmap v5963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:45 smithi189 ceph-mon[32756]: pgmap v5963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:45 smithi156 ceph-mon[32679]: pgmap v5963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:06:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:47 smithi092 ceph-mon[29156]: pgmap v5964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:06:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:47 smithi189 ceph-mon[32756]: pgmap v5964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:06:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:47 smithi156 ceph-mon[32679]: pgmap v5964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:06:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:06:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:06:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:06:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:06:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:48 smithi092 ceph-mon[29156]: pgmap v5965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:06:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:48 smithi092 ceph-mon[29156]: pgmap v5966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:48 smithi189 ceph-mon[32756]: pgmap v5965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:06:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:48 smithi189 ceph-mon[32756]: pgmap v5966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:48 smithi156 ceph-mon[32679]: pgmap v5965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:06:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:48 smithi156 ceph-mon[32679]: pgmap v5966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10104.424746 secs 2024-04-26T21:06:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9407.400291 secs 2024-04-26T21:06:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10104.424746 secs 2024-04-26T21:06:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9407.400291 secs 2024-04-26T21:06:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10104.424746 secs 2024-04-26T21:06:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9407.400291 secs 2024-04-26T21:06:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:50 smithi092 ceph-mon[29156]: pgmap v5967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:50 smithi189 ceph-mon[32756]: pgmap v5967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:50 smithi156 ceph-mon[32679]: pgmap v5967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:52 smithi092 ceph-mon[29156]: pgmap v5968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:52 smithi189 ceph-mon[32756]: pgmap v5968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:52 smithi156 ceph-mon[32679]: pgmap v5968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:06:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10109.424864 secs 2024-04-26T21:06:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:54 smithi092 ceph-mon[29156]: pgmap v5969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9412.400349 secs 2024-04-26T21:06:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10109.424864 secs 2024-04-26T21:06:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:54 smithi189 ceph-mon[32756]: pgmap v5969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9412.400349 secs 2024-04-26T21:06:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10109.424864 secs 2024-04-26T21:06:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:54 smithi156 ceph-mon[32679]: pgmap v5969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:06:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9412.400349 secs 2024-04-26T21:06:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:56 smithi092 ceph-mon[29156]: pgmap v5970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:06:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:56 smithi189 ceph-mon[32756]: pgmap v5970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:06:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:56 smithi156 ceph-mon[32679]: pgmap v5970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:06:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:58 smithi189 ceph-mon[32756]: pgmap v5971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:58 smithi156 ceph-mon[32679]: pgmap v5971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:06:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:58 smithi092 ceph-mon[29156]: pgmap v5971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:07:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10114.424956 secs 2024-04-26T21:07:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:06:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9417.400464 secs 2024-04-26T21:07:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10114.424956 secs 2024-04-26T21:07:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:06:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9417.400464 secs 2024-04-26T21:07:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10114.424956 secs 2024-04-26T21:07:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:06:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9417.400464 secs 2024-04-26T21:07:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:00 smithi189 ceph-mon[32756]: pgmap v5972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:00 smithi156 ceph-mon[32679]: pgmap v5972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:00 smithi092 ceph-mon[29156]: pgmap v5972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:02 smithi189 ceph-mon[32756]: pgmap v5973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:02 smithi156 ceph-mon[32679]: pgmap v5973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:02 smithi092 ceph-mon[29156]: pgmap v5973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10119.425069 secs 2024-04-26T21:07:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10119.425069 secs 2024-04-26T21:07:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10119.425069 secs 2024-04-26T21:07:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:04 smithi189 ceph-mon[32756]: pgmap v5974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9422.400584 secs 2024-04-26T21:07:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:04 smithi156 ceph-mon[32679]: pgmap v5974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9422.400584 secs 2024-04-26T21:07:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:04 smithi092 ceph-mon[29156]: pgmap v5974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:07:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9422.400584 secs 2024-04-26T21:07:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:06 smithi189 ceph-mon[32756]: pgmap v5975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:06 smithi156 ceph-mon[32679]: pgmap v5975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:06 smithi092 ceph-mon[29156]: pgmap v5975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:07:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:08 smithi189 ceph-mon[32756]: pgmap v5976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10124.425183 secs 2024-04-26T21:07:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9427.400696 secs 2024-04-26T21:07:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:08 smithi156 ceph-mon[32679]: pgmap v5976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10124.425183 secs 2024-04-26T21:07:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9427.400696 secs 2024-04-26T21:07:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:08 smithi092 ceph-mon[29156]: pgmap v5976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10124.425183 secs 2024-04-26T21:07:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9427.400696 secs 2024-04-26T21:07:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:10 smithi189 ceph-mon[32756]: pgmap v5977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:10 smithi156 ceph-mon[32679]: pgmap v5977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:10 smithi092 ceph-mon[29156]: pgmap v5977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:12 smithi189 ceph-mon[32756]: pgmap v5978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:12 smithi156 ceph-mon[32679]: pgmap v5978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:12 smithi092 ceph-mon[29156]: pgmap v5978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10129.425259 secs 2024-04-26T21:07:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9432.400813 secs 2024-04-26T21:07:14.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10129.425259 secs 2024-04-26T21:07:14.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9432.400813 secs 2024-04-26T21:07:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10129.425259 secs 2024-04-26T21:07:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9432.400813 secs 2024-04-26T21:07:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:14 smithi189 ceph-mon[32756]: pgmap v5979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:14 smithi156 ceph-mon[32679]: pgmap v5979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:14 smithi092 ceph-mon[29156]: pgmap v5979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:16 smithi189 ceph-mon[32756]: pgmap v5980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:16 smithi156 ceph-mon[32679]: pgmap v5980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:16 smithi092 ceph-mon[29156]: pgmap v5980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:18 smithi189 ceph-mon[32756]: pgmap v5981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10134.425389 secs 2024-04-26T21:07:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9437.400913 secs 2024-04-26T21:07:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:18 smithi156 ceph-mon[32679]: pgmap v5981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10134.425389 secs 2024-04-26T21:07:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9437.400913 secs 2024-04-26T21:07:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:18 smithi092 ceph-mon[29156]: pgmap v5981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10134.425389 secs 2024-04-26T21:07:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9437.400913 secs 2024-04-26T21:07:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:20 smithi189 ceph-mon[32756]: pgmap v5982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:20 smithi156 ceph-mon[32679]: pgmap v5982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:20 smithi092 ceph-mon[29156]: pgmap v5982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:22 smithi189 ceph-mon[32756]: pgmap v5983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:22 smithi156 ceph-mon[32679]: pgmap v5983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:22 smithi092 ceph-mon[29156]: pgmap v5983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10139.425490 secs 2024-04-26T21:07:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9442.401033 secs 2024-04-26T21:07:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10139.425490 secs 2024-04-26T21:07:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9442.401033 secs 2024-04-26T21:07:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10139.425490 secs 2024-04-26T21:07:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9442.401033 secs 2024-04-26T21:07:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:24 smithi189 ceph-mon[32756]: pgmap v5984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:24 smithi156 ceph-mon[32679]: pgmap v5984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:24 smithi092 ceph-mon[29156]: pgmap v5984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:26 smithi189 ceph-mon[32756]: pgmap v5985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:26 smithi156 ceph-mon[32679]: pgmap v5985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:26 smithi092 ceph-mon[29156]: pgmap v5985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:28 smithi189 ceph-mon[32756]: pgmap v5986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10144.425628 secs 2024-04-26T21:07:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9447.401177 secs 2024-04-26T21:07:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:28 smithi156 ceph-mon[32679]: pgmap v5986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10144.425628 secs 2024-04-26T21:07:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9447.401177 secs 2024-04-26T21:07:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:28 smithi092 ceph-mon[29156]: pgmap v5986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10144.425628 secs 2024-04-26T21:07:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9447.401177 secs 2024-04-26T21:07:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:30 smithi189 ceph-mon[32756]: pgmap v5987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:30 smithi156 ceph-mon[32679]: pgmap v5987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:30 smithi092 ceph-mon[29156]: pgmap v5987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:32 smithi189 ceph-mon[32756]: pgmap v5988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:32 smithi156 ceph-mon[32679]: pgmap v5988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:32 smithi092 ceph-mon[29156]: pgmap v5988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10149.425743 secs 2024-04-26T21:07:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:33 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9452.401329 secs 2024-04-26T21:07:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10149.425743 secs 2024-04-26T21:07:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:33 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9452.401329 secs 2024-04-26T21:07:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10149.425743 secs 2024-04-26T21:07:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:33 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9452.401329 secs 2024-04-26T21:07:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:34 smithi189 ceph-mon[32756]: pgmap v5989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:34 smithi156 ceph-mon[32679]: pgmap v5989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:34 smithi092 ceph-mon[29156]: pgmap v5989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:36 smithi189 ceph-mon[32756]: pgmap v5990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:36 smithi156 ceph-mon[32679]: pgmap v5990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:36 smithi092 ceph-mon[29156]: pgmap v5990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:39 smithi189 ceph-mon[32756]: pgmap v5991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10154.425898 secs 2024-04-26T21:07:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9457.401365 secs 2024-04-26T21:07:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:39 smithi156 ceph-mon[32679]: pgmap v5991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10154.425898 secs 2024-04-26T21:07:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9457.401365 secs 2024-04-26T21:07:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:39 smithi092 ceph-mon[29156]: pgmap v5991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10154.425898 secs 2024-04-26T21:07:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9457.401365 secs 2024-04-26T21:07:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:41 smithi189 ceph-mon[32756]: pgmap v5992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:41 smithi156 ceph-mon[32679]: pgmap v5992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:41 smithi092 ceph-mon[29156]: pgmap v5992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:43 smithi189 ceph-mon[32756]: pgmap v5993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:43 smithi156 ceph-mon[32679]: pgmap v5993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:43 smithi092 ceph-mon[29156]: pgmap v5993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10159.426017 secs 2024-04-26T21:07:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9462.401450 secs 2024-04-26T21:07:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10159.426017 secs 2024-04-26T21:07:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9462.401450 secs 2024-04-26T21:07:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10159.426017 secs 2024-04-26T21:07:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9462.401450 secs 2024-04-26T21:07:45.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:45 smithi156 ceph-mon[32679]: pgmap v5994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:45 smithi189 ceph-mon[32756]: pgmap v5994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:45 smithi092 ceph-mon[29156]: pgmap v5994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:47 smithi189 ceph-mon[32756]: pgmap v5995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:47 smithi156 ceph-mon[32679]: pgmap v5995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:47 smithi092 ceph-mon[29156]: pgmap v5995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:07:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:07:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: pgmap v5996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:07:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10164.426097 secs 2024-04-26T21:07:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9467.401561 secs 2024-04-26T21:07:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: pgmap v5996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10164.426097 secs 2024-04-26T21:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9467.401561 secs 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: pgmap v5996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10164.426097 secs 2024-04-26T21:07:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9467.401561 secs 2024-04-26T21:07:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:50 smithi189 ceph-mon[32756]: pgmap v5997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:07:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:50 smithi189 ceph-mon[32756]: pgmap v5998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:07:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:50 smithi156 ceph-mon[32679]: pgmap v5997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:07:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:50 smithi156 ceph-mon[32679]: pgmap v5998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:07:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:50 smithi092 ceph-mon[29156]: pgmap v5997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:07:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:50 smithi092 ceph-mon[29156]: pgmap v5998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:07:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:52 smithi189 ceph-mon[32756]: pgmap v5999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:52 smithi156 ceph-mon[32679]: pgmap v5999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:52 smithi092 ceph-mon[29156]: pgmap v5999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:54 smithi189 ceph-mon[32756]: pgmap v6000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10169.426185 secs 2024-04-26T21:07:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9472.401684 secs 2024-04-26T21:07:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:54 smithi156 ceph-mon[32679]: pgmap v6000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10169.426185 secs 2024-04-26T21:07:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9472.401684 secs 2024-04-26T21:07:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:54 smithi092 ceph-mon[29156]: pgmap v6000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10169.426185 secs 2024-04-26T21:07:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9472.401684 secs 2024-04-26T21:07:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:56 smithi189 ceph-mon[32756]: pgmap v6001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:56 smithi156 ceph-mon[32679]: pgmap v6001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:56 smithi092 ceph-mon[29156]: pgmap v6001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:58 smithi189 ceph-mon[32756]: pgmap v6002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:58 smithi156 ceph-mon[32679]: pgmap v6002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:58 smithi092 ceph-mon[29156]: pgmap v6002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:07:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10174.426305 secs 2024-04-26T21:07:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:07:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 9477.401799 secs 2024-04-26T21:07:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10174.426305 secs 2024-04-26T21:07:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:07:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 9477.401799 secs 2024-04-26T21:07:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10174.426305 secs 2024-04-26T21:07:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:07:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 9477.401799 secs 2024-04-26T21:08:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:00 smithi189 ceph-mon[32756]: pgmap v6003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:08:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:00 smithi156 ceph-mon[32679]: pgmap v6003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:08:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:00 smithi092 ceph-mon[29156]: pgmap v6003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:08:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:02 smithi189 ceph-mon[32756]: pgmap v6004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:02 smithi156 ceph-mon[32679]: pgmap v6004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:02 smithi092 ceph-mon[29156]: pgmap v6004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:04 smithi189 ceph-mon[32756]: pgmap v6005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10179.426377 secs 2024-04-26T21:08:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:04 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 9482.401916 secs 2024-04-26T21:08:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:04 smithi189 ceph-mon[32756]: slow request 180.037996 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:08:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:04 smithi156 ceph-mon[32679]: pgmap v6005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10179.426377 secs 2024-04-26T21:08:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:04 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 9482.401916 secs 2024-04-26T21:08:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:04 smithi156 ceph-mon[32679]: slow request 180.037996 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:08:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:04 smithi092 ceph-mon[29156]: pgmap v6005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10179.426377 secs 2024-04-26T21:08:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:04 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 9482.401916 secs 2024-04-26T21:08:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:04 smithi092 ceph-mon[29156]: slow request 180.037996 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:08:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:06 smithi189 ceph-mon[32756]: pgmap v6006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:06 smithi156 ceph-mon[32679]: pgmap v6006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:06 smithi092 ceph-mon[29156]: pgmap v6006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:08 smithi189 ceph-mon[32756]: pgmap v6007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:08 smithi156 ceph-mon[32679]: pgmap v6007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:08 smithi092 ceph-mon[29156]: pgmap v6007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:09 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:08:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:09 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:08:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10184.426456 secs 2024-04-26T21:08:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9487.402033 secs 2024-04-26T21:08:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:09 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:08:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:09 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:08:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10184.426456 secs 2024-04-26T21:08:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9487.402033 secs 2024-04-26T21:08:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:09 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:08:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:09 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:08:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10184.426456 secs 2024-04-26T21:08:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9487.402033 secs 2024-04-26T21:08:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:10 smithi189 ceph-mon[32756]: pgmap v6008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:10 smithi156 ceph-mon[32679]: pgmap v6008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:10 smithi092 ceph-mon[29156]: pgmap v6008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:12 smithi189 ceph-mon[32756]: pgmap v6009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:12 smithi156 ceph-mon[32679]: pgmap v6009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:12 smithi092 ceph-mon[29156]: pgmap v6009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:14 smithi189 ceph-mon[32756]: pgmap v6010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10189.426573 secs 2024-04-26T21:08:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9492.402151 secs 2024-04-26T21:08:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:14 smithi156 ceph-mon[32679]: pgmap v6010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10189.426573 secs 2024-04-26T21:08:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9492.402151 secs 2024-04-26T21:08:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:14 smithi092 ceph-mon[29156]: pgmap v6010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10189.426573 secs 2024-04-26T21:08:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9492.402151 secs 2024-04-26T21:08:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:16 smithi189 ceph-mon[32756]: pgmap v6011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:16 smithi156 ceph-mon[32679]: pgmap v6011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:16 smithi092 ceph-mon[29156]: pgmap v6011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:18 smithi189 ceph-mon[32756]: pgmap v6012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:18 smithi156 ceph-mon[32679]: pgmap v6012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:18 smithi092 ceph-mon[29156]: pgmap v6012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10194.426679 secs 2024-04-26T21:08:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9497.402263 secs 2024-04-26T21:08:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10194.426679 secs 2024-04-26T21:08:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9497.402263 secs 2024-04-26T21:08:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10194.426679 secs 2024-04-26T21:08:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9497.402263 secs 2024-04-26T21:08:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:20 smithi189 ceph-mon[32756]: pgmap v6013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:20 smithi156 ceph-mon[32679]: pgmap v6013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:20 smithi092 ceph-mon[29156]: pgmap v6013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:22 smithi189 ceph-mon[32756]: pgmap v6014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:22 smithi156 ceph-mon[32679]: pgmap v6014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:22 smithi092 ceph-mon[29156]: pgmap v6014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:24 smithi189 ceph-mon[32756]: pgmap v6015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10199.426781 secs 2024-04-26T21:08:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9502.402413 secs 2024-04-26T21:08:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:24 smithi156 ceph-mon[32679]: pgmap v6015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10199.426781 secs 2024-04-26T21:08:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9502.402413 secs 2024-04-26T21:08:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:24 smithi092 ceph-mon[29156]: pgmap v6015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10199.426781 secs 2024-04-26T21:08:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9502.402413 secs 2024-04-26T21:08:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:26 smithi189 ceph-mon[32756]: pgmap v6016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:26 smithi156 ceph-mon[32679]: pgmap v6016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:26 smithi092 ceph-mon[29156]: pgmap v6016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:28 smithi189 ceph-mon[32756]: pgmap v6017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:28 smithi156 ceph-mon[32679]: pgmap v6017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:28 smithi092 ceph-mon[29156]: pgmap v6017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:29 smithi189 ceph-mon[32756]: pgmap v6018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10204.426917 secs 2024-04-26T21:08:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9507.402477 secs 2024-04-26T21:08:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:29 smithi156 ceph-mon[32679]: pgmap v6018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10204.426917 secs 2024-04-26T21:08:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9507.402477 secs 2024-04-26T21:08:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:29 smithi092 ceph-mon[29156]: pgmap v6018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10204.426917 secs 2024-04-26T21:08:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9507.402477 secs 2024-04-26T21:08:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:31 smithi189 ceph-mon[32756]: pgmap v6019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:31 smithi156 ceph-mon[32679]: pgmap v6019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:31 smithi092 ceph-mon[29156]: pgmap v6019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:33 smithi189 ceph-mon[32756]: pgmap v6020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:33 smithi156 ceph-mon[32679]: pgmap v6020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:33 smithi092 ceph-mon[29156]: pgmap v6020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10209.427053 secs 2024-04-26T21:08:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9512.402604 secs 2024-04-26T21:08:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10209.427053 secs 2024-04-26T21:08:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9512.402604 secs 2024-04-26T21:08:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10209.427053 secs 2024-04-26T21:08:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9512.402604 secs 2024-04-26T21:08:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:35 smithi189 ceph-mon[32756]: pgmap v6021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:35 smithi156 ceph-mon[32679]: pgmap v6021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:35 smithi092 ceph-mon[29156]: pgmap v6021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:37 smithi189 ceph-mon[32756]: pgmap v6022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:37 smithi156 ceph-mon[32679]: pgmap v6022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:37 smithi092 ceph-mon[29156]: pgmap v6022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:39 smithi189 ceph-mon[32756]: pgmap v6023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10214.427194 secs 2024-04-26T21:08:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9517.402720 secs 2024-04-26T21:08:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:39 smithi156 ceph-mon[32679]: pgmap v6023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10214.427194 secs 2024-04-26T21:08:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9517.402720 secs 2024-04-26T21:08:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:39 smithi092 ceph-mon[29156]: pgmap v6023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10214.427194 secs 2024-04-26T21:08:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9517.402720 secs 2024-04-26T21:08:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:41 smithi189 ceph-mon[32756]: pgmap v6024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:41 smithi156 ceph-mon[32679]: pgmap v6024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:41 smithi092 ceph-mon[29156]: pgmap v6024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:43 smithi189 ceph-mon[32756]: pgmap v6025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:43 smithi156 ceph-mon[32679]: pgmap v6025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:43 smithi092 ceph-mon[29156]: pgmap v6025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10219.427315 secs 2024-04-26T21:08:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9522.402826 secs 2024-04-26T21:08:44.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10219.427315 secs 2024-04-26T21:08:44.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9522.402826 secs 2024-04-26T21:08:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10219.427315 secs 2024-04-26T21:08:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9522.402826 secs 2024-04-26T21:08:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:45 smithi189 ceph-mon[32756]: pgmap v6026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:45 smithi156 ceph-mon[32679]: pgmap v6026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:45 smithi092 ceph-mon[29156]: pgmap v6026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:08:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:47 smithi189 ceph-mon[32756]: pgmap v6027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:47 smithi156 ceph-mon[32679]: pgmap v6027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:47 smithi092 ceph-mon[29156]: pgmap v6027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: pgmap v6028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10224.427399 secs 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9527.402889 secs 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: pgmap v6029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: pgmap v6030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: pgmap v6028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10224.427399 secs 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9527.402889 secs 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: pgmap v6029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:08:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: pgmap v6030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: pgmap v6028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10224.427399 secs 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9527.402889 secs 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: pgmap v6029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: pgmap v6030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:08:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:52 smithi189 ceph-mon[32756]: pgmap v6031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:52 smithi156 ceph-mon[32679]: pgmap v6031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:52 smithi092 ceph-mon[29156]: pgmap v6031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:54 smithi189 ceph-mon[32756]: pgmap v6032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:08:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10229.427517 secs 2024-04-26T21:08:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9532.403023 secs 2024-04-26T21:08:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:54 smithi156 ceph-mon[32679]: pgmap v6032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:08:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10229.427517 secs 2024-04-26T21:08:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9532.403023 secs 2024-04-26T21:08:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:54 smithi092 ceph-mon[29156]: pgmap v6032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:08:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10229.427517 secs 2024-04-26T21:08:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9532.403023 secs 2024-04-26T21:08:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:56 smithi189 ceph-mon[32756]: pgmap v6033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:56 smithi156 ceph-mon[32679]: pgmap v6033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:56 smithi092 ceph-mon[29156]: pgmap v6033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:58 smithi189 ceph-mon[32756]: pgmap v6034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:58 smithi156 ceph-mon[32679]: pgmap v6034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:58 smithi092 ceph-mon[29156]: pgmap v6034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:08:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10234.427638 secs 2024-04-26T21:08:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:08:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9537.403090 secs 2024-04-26T21:08:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10234.427638 secs 2024-04-26T21:08:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:08:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9537.403090 secs 2024-04-26T21:08:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10234.427638 secs 2024-04-26T21:08:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:08:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9537.403090 secs 2024-04-26T21:09:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:00 smithi189 ceph-mon[32756]: pgmap v6035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:09:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:00 smithi156 ceph-mon[32679]: pgmap v6035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:09:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:00 smithi092 ceph-mon[29156]: pgmap v6035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:09:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:02 smithi189 ceph-mon[32756]: pgmap v6036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:02 smithi156 ceph-mon[32679]: pgmap v6036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:02 smithi092 ceph-mon[29156]: pgmap v6036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:04 smithi189 ceph-mon[32756]: pgmap v6037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10239.427756 secs 2024-04-26T21:09:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9542.403164 secs 2024-04-26T21:09:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:04 smithi156 ceph-mon[32679]: pgmap v6037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10239.427756 secs 2024-04-26T21:09:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9542.403164 secs 2024-04-26T21:09:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:04 smithi092 ceph-mon[29156]: pgmap v6037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10239.427756 secs 2024-04-26T21:09:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9542.403164 secs 2024-04-26T21:09:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:06 smithi189 ceph-mon[32756]: pgmap v6038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:06 smithi156 ceph-mon[32679]: pgmap v6038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:06 smithi092 ceph-mon[29156]: pgmap v6038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:08 smithi189 ceph-mon[32756]: pgmap v6039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:08 smithi156 ceph-mon[32679]: pgmap v6039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:08 smithi092 ceph-mon[29156]: pgmap v6039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10244.427892 secs 2024-04-26T21:09:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9547.403245 secs 2024-04-26T21:09:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10244.427892 secs 2024-04-26T21:09:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9547.403245 secs 2024-04-26T21:09:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10244.427892 secs 2024-04-26T21:09:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9547.403245 secs 2024-04-26T21:09:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:10 smithi189 ceph-mon[32756]: pgmap v6040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:10 smithi156 ceph-mon[32679]: pgmap v6040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:10 smithi092 ceph-mon[29156]: pgmap v6040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:12 smithi189 ceph-mon[32756]: pgmap v6041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:12 smithi156 ceph-mon[32679]: pgmap v6041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:12 smithi092 ceph-mon[29156]: pgmap v6041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:14 smithi189 ceph-mon[32756]: pgmap v6042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10249.428014 secs 2024-04-26T21:09:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9552.403346 secs 2024-04-26T21:09:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:14 smithi156 ceph-mon[32679]: pgmap v6042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10249.428014 secs 2024-04-26T21:09:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9552.403346 secs 2024-04-26T21:09:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:14 smithi092 ceph-mon[29156]: pgmap v6042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10249.428014 secs 2024-04-26T21:09:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9552.403346 secs 2024-04-26T21:09:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:16 smithi189 ceph-mon[32756]: pgmap v6043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:16 smithi156 ceph-mon[32679]: pgmap v6043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:16 smithi092 ceph-mon[29156]: pgmap v6043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:18 smithi189 ceph-mon[32756]: pgmap v6044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:18 smithi156 ceph-mon[32679]: pgmap v6044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:18 smithi092 ceph-mon[29156]: pgmap v6044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10254.428136 secs 2024-04-26T21:09:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9557.403409 secs 2024-04-26T21:09:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10254.428136 secs 2024-04-26T21:09:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9557.403409 secs 2024-04-26T21:09:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10254.428136 secs 2024-04-26T21:09:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9557.403409 secs 2024-04-26T21:09:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:20 smithi189 ceph-mon[32756]: pgmap v6045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:20 smithi156 ceph-mon[32679]: pgmap v6045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:20 smithi092 ceph-mon[29156]: pgmap v6045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:22 smithi189 ceph-mon[32756]: pgmap v6046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:22 smithi156 ceph-mon[32679]: pgmap v6046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:22 smithi092 ceph-mon[29156]: pgmap v6046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:24 smithi189 ceph-mon[32756]: pgmap v6047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10259.428257 secs 2024-04-26T21:09:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9562.403524 secs 2024-04-26T21:09:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:24 smithi156 ceph-mon[32679]: pgmap v6047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10259.428257 secs 2024-04-26T21:09:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9562.403524 secs 2024-04-26T21:09:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:24 smithi092 ceph-mon[29156]: pgmap v6047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10259.428257 secs 2024-04-26T21:09:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9562.403524 secs 2024-04-26T21:09:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:26 smithi189 ceph-mon[32756]: pgmap v6048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:26 smithi156 ceph-mon[32679]: pgmap v6048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:26 smithi092 ceph-mon[29156]: pgmap v6048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:28 smithi189 ceph-mon[32756]: pgmap v6049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:28 smithi156 ceph-mon[32679]: pgmap v6049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:28 smithi092 ceph-mon[29156]: pgmap v6049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10264.428332 secs 2024-04-26T21:09:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9567.403639 secs 2024-04-26T21:09:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10264.428332 secs 2024-04-26T21:09:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9567.403639 secs 2024-04-26T21:09:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10264.428332 secs 2024-04-26T21:09:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9567.403639 secs 2024-04-26T21:09:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:30 smithi189 ceph-mon[32756]: pgmap v6050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:30 smithi156 ceph-mon[32679]: pgmap v6050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:30 smithi092 ceph-mon[29156]: pgmap v6050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:32 smithi189 ceph-mon[32756]: pgmap v6051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:32 smithi156 ceph-mon[32679]: pgmap v6051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:32 smithi092 ceph-mon[29156]: pgmap v6051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:34 smithi189 ceph-mon[32756]: pgmap v6052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10269.428410 secs 2024-04-26T21:09:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9572.403747 secs 2024-04-26T21:09:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:34 smithi156 ceph-mon[32679]: pgmap v6052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10269.428410 secs 2024-04-26T21:09:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9572.403747 secs 2024-04-26T21:09:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:34 smithi092 ceph-mon[29156]: pgmap v6052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10269.428410 secs 2024-04-26T21:09:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9572.403747 secs 2024-04-26T21:09:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:36 smithi189 ceph-mon[32756]: pgmap v6053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:36 smithi156 ceph-mon[32679]: pgmap v6053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:36 smithi092 ceph-mon[29156]: pgmap v6053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:09:37.383+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:09:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:09:37.383+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:09:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:09:37.383+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:09:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:09:37.383+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 82 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:09:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:38 smithi189 ceph-mon[32756]: pgmap v6054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:38 smithi156 ceph-mon[32679]: pgmap v6054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:38 smithi092 ceph-mon[29156]: pgmap v6054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10274.428526 secs 2024-04-26T21:09:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9577.403858 secs 2024-04-26T21:09:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10274.428526 secs 2024-04-26T21:09:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9577.403858 secs 2024-04-26T21:09:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10274.428526 secs 2024-04-26T21:09:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9577.403858 secs 2024-04-26T21:09:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:40 smithi189 ceph-mon[32756]: pgmap v6055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:40 smithi156 ceph-mon[32679]: pgmap v6055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:40 smithi092 ceph-mon[29156]: pgmap v6055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:42 smithi189 ceph-mon[32756]: pgmap v6056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:42 smithi156 ceph-mon[32679]: pgmap v6056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:42 smithi092 ceph-mon[29156]: pgmap v6056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:44 smithi189 ceph-mon[32756]: pgmap v6057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10279.428648 secs 2024-04-26T21:09:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9582.403965 secs 2024-04-26T21:09:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:44 smithi156 ceph-mon[32679]: pgmap v6057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10279.428648 secs 2024-04-26T21:09:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9582.403965 secs 2024-04-26T21:09:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:44 smithi092 ceph-mon[29156]: pgmap v6057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10279.428648 secs 2024-04-26T21:09:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9582.403965 secs 2024-04-26T21:09:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:46 smithi189 ceph-mon[32756]: pgmap v6058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:46 smithi156 ceph-mon[32679]: pgmap v6058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:46 smithi092 ceph-mon[29156]: pgmap v6058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:48 smithi189 ceph-mon[32756]: pgmap v6059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:48 smithi156 ceph-mon[32679]: pgmap v6059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:48 smithi092 ceph-mon[29156]: pgmap v6059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:09:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10284.428759 secs 2024-04-26T21:09:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9587.404084 secs 2024-04-26T21:09:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10284.428759 secs 2024-04-26T21:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9587.404084 secs 2024-04-26T21:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10284.428759 secs 2024-04-26T21:09:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9587.404084 secs 2024-04-26T21:09:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:09:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:50 smithi189 ceph-mon[32756]: pgmap v6060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:09:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:50 smithi156 ceph-mon[32679]: pgmap v6060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:50 smithi092 ceph-mon[29156]: pgmap v6060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:09:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:51 smithi156 ceph-mon[32679]: pgmap v6061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:09:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:51 smithi156 ceph-mon[32679]: pgmap v6062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:51 smithi092 ceph-mon[29156]: pgmap v6061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:09:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:51 smithi092 ceph-mon[29156]: pgmap v6062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:51 smithi189 ceph-mon[32756]: pgmap v6061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:09:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:51 smithi189 ceph-mon[32756]: pgmap v6062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:52 smithi156 ceph-mon[32679]: pgmap v6063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:52 smithi092 ceph-mon[29156]: pgmap v6063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:52 smithi189 ceph-mon[32756]: pgmap v6063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10289.428889 secs 2024-04-26T21:09:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10289.428889 secs 2024-04-26T21:09:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10289.428889 secs 2024-04-26T21:09:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9592.404226 secs 2024-04-26T21:09:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:54 smithi189 ceph-mon[32756]: pgmap v6064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9592.404226 secs 2024-04-26T21:09:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:54 smithi156 ceph-mon[32679]: pgmap v6064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9592.404226 secs 2024-04-26T21:09:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:54 smithi092 ceph-mon[29156]: pgmap v6064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:56 smithi189 ceph-mon[32756]: pgmap v6065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:56 smithi156 ceph-mon[32679]: pgmap v6065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:56 smithi092 ceph-mon[29156]: pgmap v6065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:09:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:58 smithi092 ceph-mon[29156]: pgmap v6066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:09:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10294.429003 secs 2024-04-26T21:09:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:58 smithi189 ceph-mon[32756]: pgmap v6066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:09:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10294.429003 secs 2024-04-26T21:09:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:58 smithi156 ceph-mon[32679]: pgmap v6066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:09:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10294.429003 secs 2024-04-26T21:10:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:09:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9597.404321 secs 2024-04-26T21:10:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:09:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9597.404321 secs 2024-04-26T21:10:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:09:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9597.404321 secs 2024-04-26T21:10:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:00 smithi189 ceph-mon[32756]: pgmap v6067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:10:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:10:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:00 smithi156 ceph-mon[32679]: pgmap v6067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:10:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:10:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:00 smithi092 ceph-mon[29156]: pgmap v6067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:10:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:10:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:02 smithi189 ceph-mon[32756]: pgmap v6068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:02 smithi156 ceph-mon[32679]: pgmap v6068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:02 smithi092 ceph-mon[29156]: pgmap v6068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:03.858 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:10:03.556+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:10:03.858 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:10:03.556+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:10:03.858 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:10:03.556+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:10:03.858 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:10:03.556+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:10:03.858 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:10:03.556+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:10:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10299.429102 secs 2024-04-26T21:10:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:03 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9602.404383 secs 2024-04-26T21:10:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10299.429102 secs 2024-04-26T21:10:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:03 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9602.404383 secs 2024-04-26T21:10:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10299.429102 secs 2024-04-26T21:10:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:03 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9602.404383 secs 2024-04-26T21:10:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:04 smithi189 ceph-mon[32756]: pgmap v6069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:04 smithi156 ceph-mon[32679]: pgmap v6069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:04 smithi092 ceph-mon[29156]: pgmap v6069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:06 smithi189 ceph-mon[32756]: pgmap v6070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:06 smithi156 ceph-mon[32679]: pgmap v6070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:06 smithi092 ceph-mon[29156]: pgmap v6070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:08 smithi189 ceph-mon[32756]: pgmap v6071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10304.429217 secs 2024-04-26T21:10:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:08 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9607.404496 secs 2024-04-26T21:10:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:08 smithi156 ceph-mon[32679]: pgmap v6071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10304.429217 secs 2024-04-26T21:10:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:08 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9607.404496 secs 2024-04-26T21:10:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:08 smithi092 ceph-mon[29156]: pgmap v6071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10304.429217 secs 2024-04-26T21:10:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:08 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9607.404496 secs 2024-04-26T21:10:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:10 smithi189 ceph-mon[32756]: pgmap v6072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:10 smithi156 ceph-mon[32679]: pgmap v6072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:10 smithi092 ceph-mon[29156]: pgmap v6072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:12 smithi189 ceph-mon[32756]: pgmap v6073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:10:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:12 smithi156 ceph-mon[32679]: pgmap v6073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:10:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:12 smithi092 ceph-mon[29156]: pgmap v6073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10309.429333 secs 2024-04-26T21:10:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:13 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9612.404607 secs 2024-04-26T21:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10309.429333 secs 2024-04-26T21:10:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:13 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9612.404607 secs 2024-04-26T21:10:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10309.429333 secs 2024-04-26T21:10:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:13 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9612.404607 secs 2024-04-26T21:10:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:14 smithi189 ceph-mon[32756]: pgmap v6074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:14 smithi156 ceph-mon[32679]: pgmap v6074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:14 smithi092 ceph-mon[29156]: pgmap v6074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:10:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:16 smithi189 ceph-mon[32756]: pgmap v6075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:17.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:16 smithi156 ceph-mon[32679]: pgmap v6075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:16 smithi092 ceph-mon[29156]: pgmap v6075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:18 smithi189 ceph-mon[32756]: pgmap v6076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10314.429449 secs 2024-04-26T21:10:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:18 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9617.404717 secs 2024-04-26T21:10:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:18 smithi156 ceph-mon[32679]: pgmap v6076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10314.429449 secs 2024-04-26T21:10:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:18 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9617.404717 secs 2024-04-26T21:10:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:18 smithi092 ceph-mon[29156]: pgmap v6076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-04-26T21:10:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10314.429449 secs 2024-04-26T21:10:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:18 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9617.404717 secs 2024-04-26T21:10:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:20 smithi189 ceph-mon[32756]: pgmap v6077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:20 smithi156 ceph-mon[32679]: pgmap v6077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:20 smithi092 ceph-mon[29156]: pgmap v6077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-26T21:10:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:22 smithi156 ceph-mon[32679]: pgmap v6078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:22 smithi092 ceph-mon[29156]: pgmap v6078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:22 smithi189 ceph-mon[32756]: pgmap v6078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10319.429557 secs 2024-04-26T21:10:24.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:23 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9622.404835 secs 2024-04-26T21:10:24.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10319.429557 secs 2024-04-26T21:10:24.683 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:23 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9622.404835 secs 2024-04-26T21:10:24.683 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10319.429557 secs 2024-04-26T21:10:24.684 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:23 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9622.404835 secs 2024-04-26T21:10:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:24 smithi156 ceph-mon[32679]: pgmap v6079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:24 smithi092 ceph-mon[29156]: pgmap v6079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:24 smithi189 ceph-mon[32756]: pgmap v6079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:26 smithi156 ceph-mon[32679]: pgmap v6080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:26 smithi092 ceph-mon[29156]: pgmap v6080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:26 smithi189 ceph-mon[32756]: pgmap v6080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:28 smithi156 ceph-mon[32679]: pgmap v6081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10324.429683 secs 2024-04-26T21:10:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:28 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9627.404976 secs 2024-04-26T21:10:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:28 smithi092 ceph-mon[29156]: pgmap v6081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10324.429683 secs 2024-04-26T21:10:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:28 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9627.404976 secs 2024-04-26T21:10:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:28 smithi189 ceph-mon[32756]: pgmap v6081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10324.429683 secs 2024-04-26T21:10:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:28 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9627.404976 secs 2024-04-26T21:10:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:30 smithi156 ceph-mon[32679]: pgmap v6082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:30 smithi092 ceph-mon[29156]: pgmap v6082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:30 smithi189 ceph-mon[32756]: pgmap v6082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:32 smithi156 ceph-mon[32679]: pgmap v6083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:32 smithi092 ceph-mon[29156]: pgmap v6083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:32 smithi189 ceph-mon[32756]: pgmap v6083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10329.429776 secs 2024-04-26T21:10:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:33 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9632.405097 secs 2024-04-26T21:10:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10329.429776 secs 2024-04-26T21:10:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:33 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9632.405097 secs 2024-04-26T21:10:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10329.429776 secs 2024-04-26T21:10:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:33 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9632.405097 secs 2024-04-26T21:10:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:34 smithi156 ceph-mon[32679]: pgmap v6084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:34 smithi092 ceph-mon[29156]: pgmap v6084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:34 smithi189 ceph-mon[32756]: pgmap v6084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:36 smithi156 ceph-mon[32679]: pgmap v6085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:36 smithi092 ceph-mon[29156]: pgmap v6085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:36 smithi189 ceph-mon[32756]: pgmap v6085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:38 smithi156 ceph-mon[32679]: pgmap v6086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10334.429893 secs 2024-04-26T21:10:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:38 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9637.405235 secs 2024-04-26T21:10:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:38 smithi092 ceph-mon[29156]: pgmap v6086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10334.429893 secs 2024-04-26T21:10:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:38 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9637.405235 secs 2024-04-26T21:10:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:38 smithi189 ceph-mon[32756]: pgmap v6086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10334.429893 secs 2024-04-26T21:10:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:38 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9637.405235 secs 2024-04-26T21:10:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:40 smithi156 ceph-mon[32679]: pgmap v6087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:40 smithi092 ceph-mon[29156]: pgmap v6087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:40 smithi189 ceph-mon[32756]: pgmap v6087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:42 smithi156 ceph-mon[32679]: pgmap v6088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:42 smithi092 ceph-mon[29156]: pgmap v6088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:42 smithi189 ceph-mon[32756]: pgmap v6088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10339.429970 secs 2024-04-26T21:10:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:43 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9642.405374 secs 2024-04-26T21:10:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10339.429970 secs 2024-04-26T21:10:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:43 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9642.405374 secs 2024-04-26T21:10:44.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10339.429970 secs 2024-04-26T21:10:44.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:43 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9642.405374 secs 2024-04-26T21:10:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:44 smithi092 ceph-mon[29156]: pgmap v6089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:44 smithi189 ceph-mon[32756]: pgmap v6089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:44 smithi156 ceph-mon[32679]: pgmap v6089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:46 smithi092 ceph-mon[29156]: pgmap v6090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:46 smithi189 ceph-mon[32756]: pgmap v6090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:46 smithi156 ceph-mon[32679]: pgmap v6090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:49.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:48 smithi156 ceph-mon[32679]: pgmap v6091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:49.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10344.430084 secs 2024-04-26T21:10:49.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:48 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9647.405453 secs 2024-04-26T21:10:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:48 smithi092 ceph-mon[29156]: pgmap v6091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10344.430084 secs 2024-04-26T21:10:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:48 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9647.405453 secs 2024-04-26T21:10:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:48 smithi189 ceph-mon[32756]: pgmap v6091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:10:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10344.430084 secs 2024-04-26T21:10:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:48 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9647.405453 secs 2024-04-26T21:10:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:10:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:50 smithi092 ceph-mon[29156]: pgmap v6092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:10:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:50 smithi189 ceph-mon[32756]: pgmap v6092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:10:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:50 smithi156 ceph-mon[32679]: pgmap v6092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:10:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:10:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:10:51.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:10:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:51 smithi092 ceph-mon[29156]: pgmap v6093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:10:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:51 smithi092 ceph-mon[29156]: pgmap v6094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:51 smithi189 ceph-mon[32756]: pgmap v6093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:10:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:51 smithi189 ceph-mon[32756]: pgmap v6094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:51 smithi156 ceph-mon[32679]: pgmap v6093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:10:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:51 smithi156 ceph-mon[32679]: pgmap v6094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:53 smithi092 ceph-mon[29156]: pgmap v6095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:10:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10349.430147 secs 2024-04-26T21:10:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:53 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9652.405532 secs 2024-04-26T21:10:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:53 smithi189 ceph-mon[32756]: pgmap v6095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:10:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10349.430147 secs 2024-04-26T21:10:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:53 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9652.405532 secs 2024-04-26T21:10:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:53 smithi156 ceph-mon[32679]: pgmap v6095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:10:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10349.430147 secs 2024-04-26T21:10:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:53 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9652.405532 secs 2024-04-26T21:10:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:55 smithi092 ceph-mon[29156]: pgmap v6096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:55 smithi189 ceph-mon[32756]: pgmap v6096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:55 smithi156 ceph-mon[32679]: pgmap v6096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:57 smithi092 ceph-mon[29156]: pgmap v6097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:57 smithi189 ceph-mon[32756]: pgmap v6097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:57 smithi156 ceph-mon[32679]: pgmap v6097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:10:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10354.430277 secs 2024-04-26T21:10:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:58 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9657.405623 secs 2024-04-26T21:10:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10354.430277 secs 2024-04-26T21:10:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:58 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9657.405623 secs 2024-04-26T21:10:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10354.430277 secs 2024-04-26T21:10:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:58 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9657.405623 secs 2024-04-26T21:11:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:10:59 smithi092 ceph-mon[29156]: pgmap v6098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:11:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:10:59 smithi189 ceph-mon[32756]: pgmap v6098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:11:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:10:59 smithi156 ceph-mon[32679]: pgmap v6098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:11:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:01 smithi092 ceph-mon[29156]: pgmap v6099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:11:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:01 smithi189 ceph-mon[32756]: pgmap v6099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:11:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:01 smithi156 ceph-mon[32679]: pgmap v6099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:11:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:03 smithi092 ceph-mon[29156]: pgmap v6100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10359.430395 secs 2024-04-26T21:11:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:03 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 9662.405725 secs 2024-04-26T21:11:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:03 smithi092 ceph-mon[29156]: slow request 360.041804 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:03 smithi189 ceph-mon[32756]: pgmap v6100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10359.430395 secs 2024-04-26T21:11:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:03 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 9662.405725 secs 2024-04-26T21:11:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:03 smithi189 ceph-mon[32756]: slow request 360.041804 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:03 smithi156 ceph-mon[32679]: pgmap v6100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10359.430395 secs 2024-04-26T21:11:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:03 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 9662.405725 secs 2024-04-26T21:11:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:03 smithi156 ceph-mon[32679]: slow request 360.041804 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:11:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:05 smithi092 ceph-mon[29156]: pgmap v6101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:05 smithi189 ceph-mon[32756]: pgmap v6101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:05 smithi156 ceph-mon[32679]: pgmap v6101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:07 smithi092 ceph-mon[29156]: pgmap v6102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:07 smithi189 ceph-mon[32756]: pgmap v6102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:07 smithi156 ceph-mon[32679]: pgmap v6102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10364.430510 secs 2024-04-26T21:11:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:08 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9667.405873 secs 2024-04-26T21:11:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10364.430510 secs 2024-04-26T21:11:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:08 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9667.405873 secs 2024-04-26T21:11:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10364.430510 secs 2024-04-26T21:11:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:08 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9667.405873 secs 2024-04-26T21:11:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:09 smithi189 ceph-mon[32756]: pgmap v6103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:09 smithi156 ceph-mon[32679]: pgmap v6103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:09 smithi092 ceph-mon[29156]: pgmap v6103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:11 smithi189 ceph-mon[32756]: pgmap v6104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:11 smithi156 ceph-mon[32679]: pgmap v6104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:11 smithi092 ceph-mon[29156]: pgmap v6104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:14 smithi189 ceph-mon[32756]: pgmap v6105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10369.430626 secs 2024-04-26T21:11:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9672.406005 secs 2024-04-26T21:11:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:14 smithi156 ceph-mon[32679]: pgmap v6105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10369.430626 secs 2024-04-26T21:11:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9672.406005 secs 2024-04-26T21:11:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:14 smithi092 ceph-mon[29156]: pgmap v6105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10369.430626 secs 2024-04-26T21:11:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9672.406005 secs 2024-04-26T21:11:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:16 smithi189 ceph-mon[32756]: pgmap v6106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:16 smithi156 ceph-mon[32679]: pgmap v6106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:16 smithi092 ceph-mon[29156]: pgmap v6106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:18 smithi189 ceph-mon[32756]: pgmap v6107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:18 smithi156 ceph-mon[32679]: pgmap v6107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:18 smithi092 ceph-mon[29156]: pgmap v6107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:19.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10374.430761 secs 2024-04-26T21:11:19.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9677.406115 secs 2024-04-26T21:11:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10374.430761 secs 2024-04-26T21:11:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9677.406115 secs 2024-04-26T21:11:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10374.430761 secs 2024-04-26T21:11:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9677.406115 secs 2024-04-26T21:11:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:20 smithi189 ceph-mon[32756]: pgmap v6108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:20 smithi156 ceph-mon[32679]: pgmap v6108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:20 smithi092 ceph-mon[29156]: pgmap v6108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:22 smithi189 ceph-mon[32756]: pgmap v6109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:22 smithi156 ceph-mon[32679]: pgmap v6109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:22 smithi092 ceph-mon[29156]: pgmap v6109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:24 smithi189 ceph-mon[32756]: pgmap v6110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10379.430883 secs 2024-04-26T21:11:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9682.406251 secs 2024-04-26T21:11:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:24 smithi156 ceph-mon[32679]: pgmap v6110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10379.430883 secs 2024-04-26T21:11:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9682.406251 secs 2024-04-26T21:11:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:24 smithi092 ceph-mon[29156]: pgmap v6110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10379.430883 secs 2024-04-26T21:11:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9682.406251 secs 2024-04-26T21:11:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:26 smithi189 ceph-mon[32756]: pgmap v6111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:26 smithi156 ceph-mon[32679]: pgmap v6111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:26 smithi092 ceph-mon[29156]: pgmap v6111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:28 smithi189 ceph-mon[32756]: pgmap v6112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:28 smithi156 ceph-mon[32679]: pgmap v6112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:28 smithi092 ceph-mon[29156]: pgmap v6112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10384.430942 secs 2024-04-26T21:11:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9687.406368 secs 2024-04-26T21:11:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10384.430942 secs 2024-04-26T21:11:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9687.406368 secs 2024-04-26T21:11:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10384.430942 secs 2024-04-26T21:11:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9687.406368 secs 2024-04-26T21:11:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:30 smithi189 ceph-mon[32756]: pgmap v6113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:30 smithi156 ceph-mon[32679]: pgmap v6113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:30 smithi092 ceph-mon[29156]: pgmap v6113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:32 smithi189 ceph-mon[32756]: pgmap v6114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:32 smithi156 ceph-mon[32679]: pgmap v6114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:32 smithi092 ceph-mon[29156]: pgmap v6114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:34 smithi189 ceph-mon[32756]: pgmap v6115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10389.431044 secs 2024-04-26T21:11:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9692.406488 secs 2024-04-26T21:11:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:34 smithi156 ceph-mon[32679]: pgmap v6115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10389.431044 secs 2024-04-26T21:11:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9692.406488 secs 2024-04-26T21:11:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:34 smithi092 ceph-mon[29156]: pgmap v6115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10389.431044 secs 2024-04-26T21:11:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9692.406488 secs 2024-04-26T21:11:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:36 smithi189 ceph-mon[32756]: pgmap v6116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:36 smithi156 ceph-mon[32679]: pgmap v6116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:36 smithi092 ceph-mon[29156]: pgmap v6116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:38 smithi189 ceph-mon[32756]: pgmap v6117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:38 smithi156 ceph-mon[32679]: pgmap v6117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:38 smithi092 ceph-mon[29156]: pgmap v6117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10394.431164 secs 2024-04-26T21:11:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9697.406556 secs 2024-04-26T21:11:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10394.431164 secs 2024-04-26T21:11:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9697.406556 secs 2024-04-26T21:11:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10394.431164 secs 2024-04-26T21:11:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9697.406556 secs 2024-04-26T21:11:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:40 smithi189 ceph-mon[32756]: pgmap v6118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:40 smithi156 ceph-mon[32679]: pgmap v6118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:40 smithi092 ceph-mon[29156]: pgmap v6118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:42 smithi189 ceph-mon[32756]: pgmap v6119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:42 smithi156 ceph-mon[32679]: pgmap v6119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:42 smithi092 ceph-mon[29156]: pgmap v6119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:44 smithi189 ceph-mon[32756]: pgmap v6120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10399.431281 secs 2024-04-26T21:11:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9702.406668 secs 2024-04-26T21:11:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:44 smithi156 ceph-mon[32679]: pgmap v6120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10399.431281 secs 2024-04-26T21:11:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9702.406668 secs 2024-04-26T21:11:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:44 smithi092 ceph-mon[29156]: pgmap v6120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10399.431281 secs 2024-04-26T21:11:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9702.406668 secs 2024-04-26T21:11:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:46 smithi189 ceph-mon[32756]: pgmap v6121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:46 smithi156 ceph-mon[32679]: pgmap v6121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:46 smithi092 ceph-mon[29156]: pgmap v6121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:48 smithi189 ceph-mon[32756]: pgmap v6122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:48 smithi156 ceph-mon[32679]: pgmap v6122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:48 smithi092 ceph-mon[29156]: pgmap v6122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10404.431389 secs 2024-04-26T21:11:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9707.406787 secs 2024-04-26T21:11:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10404.431389 secs 2024-04-26T21:11:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9707.406787 secs 2024-04-26T21:11:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10404.431389 secs 2024-04-26T21:11:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9707.406787 secs 2024-04-26T21:11:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:50 smithi156 ceph-mon[32679]: pgmap v6123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:50 smithi092 ceph-mon[29156]: pgmap v6123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:50 smithi189 ceph-mon[32756]: pgmap v6123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:11:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:11:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:11:52.402+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:11:52.403 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:11:52.402+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:11:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:11:52.402+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:11:52.404 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:11:52.402+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 83 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:11:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:52 smithi156 ceph-mon[32679]: pgmap v6124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:11:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:52 smithi092 ceph-mon[29156]: pgmap v6124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:11:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:52 smithi189 ceph-mon[32756]: pgmap v6124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:11:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:11:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:11:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:11:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:53 smithi156 ceph-mon[32679]: pgmap v6125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:11:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:53 smithi156 ceph-mon[32679]: pgmap v6126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:53 smithi092 ceph-mon[29156]: pgmap v6125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:11:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:53 smithi092 ceph-mon[29156]: pgmap v6126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:53 smithi189 ceph-mon[32756]: pgmap v6125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:11:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:53 smithi189 ceph-mon[32756]: pgmap v6126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10409.431506 secs 2024-04-26T21:11:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9712.406988 secs 2024-04-26T21:11:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10409.431506 secs 2024-04-26T21:11:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9712.406988 secs 2024-04-26T21:11:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10409.431506 secs 2024-04-26T21:11:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9712.406988 secs 2024-04-26T21:11:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:55 smithi156 ceph-mon[32679]: pgmap v6127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:55 smithi092 ceph-mon[29156]: pgmap v6127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:55 smithi189 ceph-mon[32756]: pgmap v6127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:56 smithi156 ceph-mon[32679]: pgmap v6128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:56 smithi092 ceph-mon[29156]: pgmap v6128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:56 smithi189 ceph-mon[32756]: pgmap v6128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:11:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:58 smithi189 ceph-mon[32756]: pgmap v6129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:58 smithi156 ceph-mon[32679]: pgmap v6129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:58 smithi092 ceph-mon[29156]: pgmap v6129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:11:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10414.431620 secs 2024-04-26T21:11:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:11:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9717.407103 secs 2024-04-26T21:11:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10414.431620 secs 2024-04-26T21:11:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:11:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9717.407103 secs 2024-04-26T21:11:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10414.431620 secs 2024-04-26T21:11:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:11:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9717.407103 secs 2024-04-26T21:12:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:00 smithi189 ceph-mon[32756]: pgmap v6130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:00 smithi156 ceph-mon[32679]: pgmap v6130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:00 smithi092 ceph-mon[29156]: pgmap v6130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:02.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:02 smithi092 ceph-mon[29156]: pgmap v6131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:12:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:02 smithi189 ceph-mon[32756]: pgmap v6131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:12:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:02 smithi156 ceph-mon[32679]: pgmap v6131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:12:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:04 smithi189 ceph-mon[32756]: pgmap v6132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10419.431746 secs 2024-04-26T21:12:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9722.407229 secs 2024-04-26T21:12:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:04 smithi156 ceph-mon[32679]: pgmap v6132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10419.431746 secs 2024-04-26T21:12:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9722.407229 secs 2024-04-26T21:12:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:04 smithi092 ceph-mon[29156]: pgmap v6132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10419.431746 secs 2024-04-26T21:12:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9722.407229 secs 2024-04-26T21:12:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:06 smithi189 ceph-mon[32756]: pgmap v6133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:06 smithi156 ceph-mon[32679]: pgmap v6133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:06 smithi092 ceph-mon[29156]: pgmap v6133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:08 smithi189 ceph-mon[32756]: pgmap v6134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:08 smithi156 ceph-mon[32679]: pgmap v6134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:08 smithi092 ceph-mon[29156]: pgmap v6134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10424.431877 secs 2024-04-26T21:12:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9727.407377 secs 2024-04-26T21:12:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10424.431877 secs 2024-04-26T21:12:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9727.407377 secs 2024-04-26T21:12:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10424.431877 secs 2024-04-26T21:12:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9727.407377 secs 2024-04-26T21:12:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:10 smithi189 ceph-mon[32756]: pgmap v6135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:10 smithi156 ceph-mon[32679]: pgmap v6135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:10 smithi092 ceph-mon[29156]: pgmap v6135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:13 smithi189 ceph-mon[32756]: pgmap v6136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:13 smithi156 ceph-mon[32679]: pgmap v6136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:13 smithi092 ceph-mon[29156]: pgmap v6136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10429.432014 secs 2024-04-26T21:12:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9732.407493 secs 2024-04-26T21:12:14.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10429.432014 secs 2024-04-26T21:12:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9732.407493 secs 2024-04-26T21:12:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10429.432014 secs 2024-04-26T21:12:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9732.407493 secs 2024-04-26T21:12:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:15 smithi189 ceph-mon[32756]: pgmap v6137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:15 smithi156 ceph-mon[32679]: pgmap v6137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:15 smithi092 ceph-mon[29156]: pgmap v6137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:17 smithi189 ceph-mon[32756]: pgmap v6138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:17 smithi156 ceph-mon[32679]: pgmap v6138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:17 smithi092 ceph-mon[29156]: pgmap v6138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:19 smithi189 ceph-mon[32756]: pgmap v6139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10434.432139 secs 2024-04-26T21:12:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9737.407567 secs 2024-04-26T21:12:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:19 smithi156 ceph-mon[32679]: pgmap v6139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10434.432139 secs 2024-04-26T21:12:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9737.407567 secs 2024-04-26T21:12:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:19 smithi092 ceph-mon[29156]: pgmap v6139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10434.432139 secs 2024-04-26T21:12:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9737.407567 secs 2024-04-26T21:12:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:21 smithi189 ceph-mon[32756]: pgmap v6140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:21 smithi156 ceph-mon[32679]: pgmap v6140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:21 smithi092 ceph-mon[29156]: pgmap v6140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:23 smithi189 ceph-mon[32756]: pgmap v6141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:23 smithi156 ceph-mon[32679]: pgmap v6141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:23 smithi092 ceph-mon[29156]: pgmap v6141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10439.432258 secs 2024-04-26T21:12:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9742.407677 secs 2024-04-26T21:12:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10439.432258 secs 2024-04-26T21:12:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9742.407677 secs 2024-04-26T21:12:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10439.432258 secs 2024-04-26T21:12:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9742.407677 secs 2024-04-26T21:12:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:25 smithi189 ceph-mon[32756]: pgmap v6142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:25 smithi156 ceph-mon[32679]: pgmap v6142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:25 smithi092 ceph-mon[29156]: pgmap v6142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:27 smithi189 ceph-mon[32756]: pgmap v6143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:27 smithi156 ceph-mon[32679]: pgmap v6143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:27 smithi092 ceph-mon[29156]: pgmap v6143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:29 smithi189 ceph-mon[32756]: pgmap v6144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10444.432393 secs 2024-04-26T21:12:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9747.407785 secs 2024-04-26T21:12:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:29 smithi156 ceph-mon[32679]: pgmap v6144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10444.432393 secs 2024-04-26T21:12:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9747.407785 secs 2024-04-26T21:12:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:29 smithi092 ceph-mon[29156]: pgmap v6144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10444.432393 secs 2024-04-26T21:12:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9747.407785 secs 2024-04-26T21:12:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:31 smithi189 ceph-mon[32756]: pgmap v6145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:31 smithi156 ceph-mon[32679]: pgmap v6145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:31 smithi092 ceph-mon[29156]: pgmap v6145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:33.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:33 smithi189 ceph-mon[32756]: pgmap v6146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:33 smithi156 ceph-mon[32679]: pgmap v6146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:33 smithi092 ceph-mon[29156]: pgmap v6146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10449.432518 secs 2024-04-26T21:12:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9752.407939 secs 2024-04-26T21:12:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10449.432518 secs 2024-04-26T21:12:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9752.407939 secs 2024-04-26T21:12:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10449.432518 secs 2024-04-26T21:12:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9752.407939 secs 2024-04-26T21:12:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:35 smithi189 ceph-mon[32756]: pgmap v6147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:35 smithi156 ceph-mon[32679]: pgmap v6147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:35 smithi092 ceph-mon[29156]: pgmap v6147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:37 smithi189 ceph-mon[32756]: pgmap v6148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:12:37.409+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:12:37.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:12:37.409+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:12:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:12:37.409+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:12:37.410 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:12:37.409+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 84 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:12:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:37 smithi156 ceph-mon[32679]: pgmap v6148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:37 smithi092 ceph-mon[29156]: pgmap v6148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:39 smithi189 ceph-mon[32756]: pgmap v6149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10454.432632 secs 2024-04-26T21:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9757.408042 secs 2024-04-26T21:12:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:39 smithi156 ceph-mon[32679]: pgmap v6149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10454.432632 secs 2024-04-26T21:12:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9757.408042 secs 2024-04-26T21:12:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:39 smithi092 ceph-mon[29156]: pgmap v6149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10454.432632 secs 2024-04-26T21:12:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9757.408042 secs 2024-04-26T21:12:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:41 smithi189 ceph-mon[32756]: pgmap v6150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:41 smithi156 ceph-mon[32679]: pgmap v6150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:41 smithi092 ceph-mon[29156]: pgmap v6150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:43 smithi189 ceph-mon[32756]: pgmap v6151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:43 smithi156 ceph-mon[32679]: pgmap v6151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:43 smithi092 ceph-mon[29156]: pgmap v6151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:44.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10459.432726 secs 2024-04-26T21:12:44.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9762.408165 secs 2024-04-26T21:12:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10459.432726 secs 2024-04-26T21:12:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9762.408165 secs 2024-04-26T21:12:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10459.432726 secs 2024-04-26T21:12:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9762.408165 secs 2024-04-26T21:12:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:45 smithi156 ceph-mon[32679]: pgmap v6152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:45 smithi092 ceph-mon[29156]: pgmap v6152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:45 smithi189 ceph-mon[32756]: pgmap v6152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:47 smithi156 ceph-mon[32679]: pgmap v6153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:47 smithi092 ceph-mon[29156]: pgmap v6153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:47 smithi189 ceph-mon[32756]: pgmap v6153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:49 smithi156 ceph-mon[32679]: pgmap v6154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10464.432869 secs 2024-04-26T21:12:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9767.408321 secs 2024-04-26T21:12:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:49 smithi092 ceph-mon[29156]: pgmap v6154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10464.432869 secs 2024-04-26T21:12:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9767.408321 secs 2024-04-26T21:12:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:49 smithi189 ceph-mon[32756]: pgmap v6154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10464.432869 secs 2024-04-26T21:12:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9767.408321 secs 2024-04-26T21:12:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:51 smithi156 ceph-mon[32679]: pgmap v6155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:51 smithi092 ceph-mon[29156]: pgmap v6155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:51 smithi189 ceph-mon[32756]: pgmap v6155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:12:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:12:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:12:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:12:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:12:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:12:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:12:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:53 smithi156 ceph-mon[32679]: pgmap v6156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:53 smithi156 ceph-mon[32679]: pgmap v6157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:12:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:53 smithi156 ceph-mon[32679]: pgmap v6158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:53 smithi092 ceph-mon[29156]: pgmap v6156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:53 smithi092 ceph-mon[29156]: pgmap v6157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:12:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:53 smithi092 ceph-mon[29156]: pgmap v6158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:53 smithi189 ceph-mon[32756]: pgmap v6156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:12:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:53 smithi189 ceph-mon[32756]: pgmap v6157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:12:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:53 smithi189 ceph-mon[32756]: pgmap v6158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10469.433000 secs 2024-04-26T21:12:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9772.408465 secs 2024-04-26T21:12:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10469.433000 secs 2024-04-26T21:12:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9772.408465 secs 2024-04-26T21:12:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10469.433000 secs 2024-04-26T21:12:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9772.408465 secs 2024-04-26T21:12:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:55 smithi156 ceph-mon[32679]: pgmap v6159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:55 smithi092 ceph-mon[29156]: pgmap v6159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:55 smithi189 ceph-mon[32756]: pgmap v6159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:56 smithi156 ceph-mon[32679]: pgmap v6160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:56 smithi092 ceph-mon[29156]: pgmap v6160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:56 smithi189 ceph-mon[32756]: pgmap v6160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:12:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:59 smithi189 ceph-mon[32756]: pgmap v6161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:12:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10474.433061 secs 2024-04-26T21:12:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:12:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9777.408603 secs 2024-04-26T21:12:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:59 smithi156 ceph-mon[32679]: pgmap v6161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:12:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10474.433061 secs 2024-04-26T21:12:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:12:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9777.408603 secs 2024-04-26T21:12:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:59 smithi092 ceph-mon[29156]: pgmap v6161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:12:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10474.433061 secs 2024-04-26T21:12:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:12:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9777.408603 secs 2024-04-26T21:13:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:01 smithi156 ceph-mon[32679]: pgmap v6162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:13:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:01 smithi092 ceph-mon[29156]: pgmap v6162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:13:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:01 smithi189 ceph-mon[32756]: pgmap v6162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:13:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:03 smithi156 ceph-mon[32679]: pgmap v6163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:13:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:03 smithi092 ceph-mon[29156]: pgmap v6163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:13:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:03 smithi189 ceph-mon[32756]: pgmap v6163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:13:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10479.433193 secs 2024-04-26T21:13:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9782.408696 secs 2024-04-26T21:13:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10479.433193 secs 2024-04-26T21:13:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9782.408696 secs 2024-04-26T21:13:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10479.433193 secs 2024-04-26T21:13:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9782.408696 secs 2024-04-26T21:13:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:05 smithi156 ceph-mon[32679]: pgmap v6164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:05 smithi092 ceph-mon[29156]: pgmap v6164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:05 smithi189 ceph-mon[32756]: pgmap v6164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:07 smithi156 ceph-mon[32679]: pgmap v6165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:07 smithi092 ceph-mon[29156]: pgmap v6165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:07 smithi189 ceph-mon[32756]: pgmap v6165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:09 smithi156 ceph-mon[32679]: pgmap v6166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10484.433310 secs 2024-04-26T21:13:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9787.408810 secs 2024-04-26T21:13:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:09 smithi092 ceph-mon[29156]: pgmap v6166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10484.433310 secs 2024-04-26T21:13:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9787.408810 secs 2024-04-26T21:13:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:09 smithi189 ceph-mon[32756]: pgmap v6166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10484.433310 secs 2024-04-26T21:13:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9787.408810 secs 2024-04-26T21:13:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:11 smithi156 ceph-mon[32679]: pgmap v6167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:11 smithi092 ceph-mon[29156]: pgmap v6167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:11 smithi189 ceph-mon[32756]: pgmap v6167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:13 smithi156 ceph-mon[32679]: pgmap v6168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:13 smithi092 ceph-mon[29156]: pgmap v6168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:13 smithi189 ceph-mon[32756]: pgmap v6168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10489.433442 secs 2024-04-26T21:13:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9792.408931 secs 2024-04-26T21:13:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10489.433442 secs 2024-04-26T21:13:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9792.408931 secs 2024-04-26T21:13:14.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10489.433442 secs 2024-04-26T21:13:14.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9792.408931 secs 2024-04-26T21:13:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:15 smithi156 ceph-mon[32679]: pgmap v6169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:15 smithi092 ceph-mon[29156]: pgmap v6169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:15 smithi189 ceph-mon[32756]: pgmap v6169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:17 smithi156 ceph-mon[32679]: pgmap v6170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:17 smithi092 ceph-mon[29156]: pgmap v6170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:17 smithi189 ceph-mon[32756]: pgmap v6170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:18 smithi156 ceph-mon[32679]: pgmap v6171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:18 smithi092 ceph-mon[29156]: pgmap v6171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:18 smithi189 ceph-mon[32756]: pgmap v6171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10494.433555 secs 2024-04-26T21:13:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9797.409076 secs 2024-04-26T21:13:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10494.433555 secs 2024-04-26T21:13:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9797.409076 secs 2024-04-26T21:13:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10494.433555 secs 2024-04-26T21:13:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9797.409076 secs 2024-04-26T21:13:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:20 smithi092 ceph-mon[29156]: pgmap v6172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:20 smithi189 ceph-mon[32756]: pgmap v6172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:20 smithi156 ceph-mon[32679]: pgmap v6172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:23 smithi156 ceph-mon[32679]: pgmap v6173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:23 smithi092 ceph-mon[29156]: pgmap v6173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:23 smithi189 ceph-mon[32756]: pgmap v6173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10499.433679 secs 2024-04-26T21:13:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9802.409220 secs 2024-04-26T21:13:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10499.433679 secs 2024-04-26T21:13:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9802.409220 secs 2024-04-26T21:13:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10499.433679 secs 2024-04-26T21:13:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9802.409220 secs 2024-04-26T21:13:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:25 smithi156 ceph-mon[32679]: pgmap v6174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:25 smithi092 ceph-mon[29156]: pgmap v6174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:25 smithi189 ceph-mon[32756]: pgmap v6174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:27 smithi156 ceph-mon[32679]: pgmap v6175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:27 smithi092 ceph-mon[29156]: pgmap v6175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:27 smithi189 ceph-mon[32756]: pgmap v6175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:29 smithi156 ceph-mon[32679]: pgmap v6176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10504.433817 secs 2024-04-26T21:13:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9807.409345 secs 2024-04-26T21:13:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:29 smithi092 ceph-mon[29156]: pgmap v6176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10504.433817 secs 2024-04-26T21:13:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9807.409345 secs 2024-04-26T21:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:29 smithi189 ceph-mon[32756]: pgmap v6176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10504.433817 secs 2024-04-26T21:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9807.409345 secs 2024-04-26T21:13:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:31 smithi156 ceph-mon[32679]: pgmap v6177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:31 smithi092 ceph-mon[29156]: pgmap v6177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:31 smithi189 ceph-mon[32756]: pgmap v6177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:33 smithi156 ceph-mon[32679]: pgmap v6178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:33 smithi092 ceph-mon[29156]: pgmap v6178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:33 smithi189 ceph-mon[32756]: pgmap v6178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10509.433936 secs 2024-04-26T21:13:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9812.409400 secs 2024-04-26T21:13:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10509.433936 secs 2024-04-26T21:13:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9812.409400 secs 2024-04-26T21:13:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10509.433936 secs 2024-04-26T21:13:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9812.409400 secs 2024-04-26T21:13:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:35 smithi156 ceph-mon[32679]: pgmap v6179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:35 smithi092 ceph-mon[29156]: pgmap v6179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:35 smithi189 ceph-mon[32756]: pgmap v6179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:36 smithi092 ceph-mon[29156]: pgmap v6180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:36 smithi189 ceph-mon[32756]: pgmap v6180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:36 smithi156 ceph-mon[32679]: pgmap v6180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:39 smithi156 ceph-mon[32679]: pgmap v6181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10514.433998 secs 2024-04-26T21:13:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9817.409478 secs 2024-04-26T21:13:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:39 smithi092 ceph-mon[29156]: pgmap v6181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10514.433998 secs 2024-04-26T21:13:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9817.409478 secs 2024-04-26T21:13:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:39 smithi189 ceph-mon[32756]: pgmap v6181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10514.433998 secs 2024-04-26T21:13:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9817.409478 secs 2024-04-26T21:13:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:41 smithi156 ceph-mon[32679]: pgmap v6182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:41 smithi092 ceph-mon[29156]: pgmap v6182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:41 smithi189 ceph-mon[32756]: pgmap v6182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:43 smithi156 ceph-mon[32679]: pgmap v6183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:43 smithi092 ceph-mon[29156]: pgmap v6183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:43 smithi189 ceph-mon[32756]: pgmap v6183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:13:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10519.434113 secs 2024-04-26T21:13:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9822.409577 secs 2024-04-26T21:13:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10519.434113 secs 2024-04-26T21:13:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9822.409577 secs 2024-04-26T21:13:44.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10519.434113 secs 2024-04-26T21:13:44.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9822.409577 secs 2024-04-26T21:13:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:45 smithi156 ceph-mon[32679]: pgmap v6184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:45 smithi092 ceph-mon[29156]: pgmap v6184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:45 smithi189 ceph-mon[32756]: pgmap v6184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:13:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:47 smithi156 ceph-mon[32679]: pgmap v6185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:47 smithi092 ceph-mon[29156]: pgmap v6185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:47 smithi189 ceph-mon[32756]: pgmap v6185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:49 smithi156 ceph-mon[32679]: pgmap v6186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10524.434225 secs 2024-04-26T21:13:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9827.409640 secs 2024-04-26T21:13:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:49 smithi092 ceph-mon[29156]: pgmap v6186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10524.434225 secs 2024-04-26T21:13:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9827.409640 secs 2024-04-26T21:13:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:49 smithi189 ceph-mon[32756]: pgmap v6186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10524.434225 secs 2024-04-26T21:13:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9827.409640 secs 2024-04-26T21:13:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:51 smithi156 ceph-mon[32679]: pgmap v6187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:51 smithi092 ceph-mon[29156]: pgmap v6187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:51 smithi189 ceph-mon[32756]: pgmap v6187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: pgmap v6188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: pgmap v6188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.510 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: pgmap v6188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:53.511 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10529.434342 secs 2024-04-26T21:13:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9832.409745 secs 2024-04-26T21:13:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10529.434342 secs 2024-04-26T21:13:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9832.409745 secs 2024-04-26T21:13:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10529.434342 secs 2024-04-26T21:13:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9832.409745 secs 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: pgmap v6189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: pgmap v6189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: pgmap v6189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:13:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:13:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: pgmap v6190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: pgmap v6191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:13:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: pgmap v6190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: pgmap v6191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:13:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:13:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: pgmap v6190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: pgmap v6191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:13:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:13:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:58 smithi189 ceph-mon[32756]: pgmap v6192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:13:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:58 smithi156 ceph-mon[32679]: pgmap v6192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:13:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:58 smithi092 ceph-mon[29156]: pgmap v6192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10534.434456 secs 2024-04-26T21:14:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:13:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9837.409816 secs 2024-04-26T21:14:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10534.434456 secs 2024-04-26T21:14:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:13:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9837.409816 secs 2024-04-26T21:14:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10534.434456 secs 2024-04-26T21:14:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:13:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9837.409816 secs 2024-04-26T21:14:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:00 smithi189 ceph-mon[32756]: pgmap v6193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:00 smithi156 ceph-mon[32679]: pgmap v6193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:00 smithi092 ceph-mon[29156]: pgmap v6193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:02 smithi189 ceph-mon[32756]: pgmap v6194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:02 smithi156 ceph-mon[32679]: pgmap v6194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:02 smithi092 ceph-mon[29156]: pgmap v6194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10539.434534 secs 2024-04-26T21:14:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9842.409934 secs 2024-04-26T21:14:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:04 smithi189 ceph-mon[32756]: pgmap v6195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10539.434534 secs 2024-04-26T21:14:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9842.409934 secs 2024-04-26T21:14:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:04 smithi156 ceph-mon[32679]: pgmap v6195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10539.434534 secs 2024-04-26T21:14:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9842.409934 secs 2024-04-26T21:14:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:04 smithi092 ceph-mon[29156]: pgmap v6195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:14:07.076 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:06 smithi092 ceph-mon[29156]: pgmap v6196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:14:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:06 smithi189 ceph-mon[32756]: pgmap v6196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:14:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:06 smithi156 ceph-mon[32679]: pgmap v6196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:14:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:08 smithi189 ceph-mon[32756]: pgmap v6197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:08 smithi156 ceph-mon[32679]: pgmap v6197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:08 smithi092 ceph-mon[29156]: pgmap v6197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10544.434642 secs 2024-04-26T21:14:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9847.410026 secs 2024-04-26T21:14:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10544.434642 secs 2024-04-26T21:14:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9847.410026 secs 2024-04-26T21:14:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10544.434642 secs 2024-04-26T21:14:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9847.410026 secs 2024-04-26T21:14:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:10 smithi189 ceph-mon[32756]: pgmap v6198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:10 smithi156 ceph-mon[32679]: pgmap v6198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:10 smithi092 ceph-mon[29156]: pgmap v6198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:12 smithi189 ceph-mon[32756]: pgmap v6199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:12 smithi156 ceph-mon[32679]: pgmap v6199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:12 smithi092 ceph-mon[29156]: pgmap v6199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10549.434763 secs 2024-04-26T21:14:14.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10549.434763 secs 2024-04-26T21:14:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10549.434763 secs 2024-04-26T21:14:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9852.410149 secs 2024-04-26T21:14:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:14 smithi189 ceph-mon[32756]: pgmap v6200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9852.410149 secs 2024-04-26T21:14:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:14 smithi156 ceph-mon[32679]: pgmap v6200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9852.410149 secs 2024-04-26T21:14:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:14 smithi092 ceph-mon[29156]: pgmap v6200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:16 smithi189 ceph-mon[32756]: pgmap v6201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:16 smithi156 ceph-mon[32679]: pgmap v6201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:16 smithi092 ceph-mon[29156]: pgmap v6201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:18 smithi189 ceph-mon[32756]: pgmap v6202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10554.434829 secs 2024-04-26T21:14:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:18 smithi156 ceph-mon[32679]: pgmap v6202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10554.434829 secs 2024-04-26T21:14:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:18 smithi092 ceph-mon[29156]: pgmap v6202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10554.434829 secs 2024-04-26T21:14:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9857.410271 secs 2024-04-26T21:14:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9857.410271 secs 2024-04-26T21:14:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9857.410271 secs 2024-04-26T21:14:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:20 smithi189 ceph-mon[32756]: pgmap v6203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:20 smithi156 ceph-mon[32679]: pgmap v6203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:20 smithi092 ceph-mon[29156]: pgmap v6203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:22 smithi189 ceph-mon[32756]: pgmap v6204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:22 smithi156 ceph-mon[32679]: pgmap v6204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:22 smithi092 ceph-mon[29156]: pgmap v6204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10559.434941 secs 2024-04-26T21:14:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10559.434941 secs 2024-04-26T21:14:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10559.434941 secs 2024-04-26T21:14:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9862.410385 secs 2024-04-26T21:14:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:24 smithi189 ceph-mon[32756]: pgmap v6205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9862.410385 secs 2024-04-26T21:14:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:24 smithi156 ceph-mon[32679]: pgmap v6205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9862.410385 secs 2024-04-26T21:14:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:24 smithi092 ceph-mon[29156]: pgmap v6205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:26 smithi189 ceph-mon[32756]: pgmap v6206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:26 smithi156 ceph-mon[32679]: pgmap v6206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:26 smithi092 ceph-mon[29156]: pgmap v6206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:28 smithi189 ceph-mon[32756]: pgmap v6207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10564.435034 secs 2024-04-26T21:14:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:28 smithi156 ceph-mon[32679]: pgmap v6207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10564.435034 secs 2024-04-26T21:14:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:28 smithi092 ceph-mon[29156]: pgmap v6207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10564.435034 secs 2024-04-26T21:14:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9867.410508 secs 2024-04-26T21:14:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9867.410508 secs 2024-04-26T21:14:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9867.410508 secs 2024-04-26T21:14:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:30 smithi189 ceph-mon[32756]: pgmap v6208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:30 smithi156 ceph-mon[32679]: pgmap v6208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:30 smithi092 ceph-mon[29156]: pgmap v6208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:32 smithi189 ceph-mon[32756]: pgmap v6209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:32 smithi156 ceph-mon[32679]: pgmap v6209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:32 smithi092 ceph-mon[29156]: pgmap v6209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10569.435153 secs 2024-04-26T21:14:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10569.435153 secs 2024-04-26T21:14:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10569.435153 secs 2024-04-26T21:14:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9872.410573 secs 2024-04-26T21:14:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:34 smithi189 ceph-mon[32756]: pgmap v6210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9872.410573 secs 2024-04-26T21:14:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:34 smithi156 ceph-mon[32679]: pgmap v6210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9872.410573 secs 2024-04-26T21:14:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:34 smithi092 ceph-mon[29156]: pgmap v6210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:36 smithi156 ceph-mon[32679]: pgmap v6211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:36 smithi092 ceph-mon[29156]: pgmap v6211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:36 smithi189 ceph-mon[32756]: pgmap v6211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:38 smithi156 ceph-mon[32679]: pgmap v6212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10574.435215 secs 2024-04-26T21:14:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:38 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9877.410690 secs 2024-04-26T21:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:38 smithi092 ceph-mon[29156]: pgmap v6212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10574.435215 secs 2024-04-26T21:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:38 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9877.410690 secs 2024-04-26T21:14:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:38 smithi189 ceph-mon[32756]: pgmap v6212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10574.435215 secs 2024-04-26T21:14:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:38 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9877.410690 secs 2024-04-26T21:14:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:40 smithi156 ceph-mon[32679]: pgmap v6213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:40 smithi092 ceph-mon[29156]: pgmap v6213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:40 smithi189 ceph-mon[32756]: pgmap v6213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:42 smithi156 ceph-mon[32679]: pgmap v6214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:42 smithi092 ceph-mon[29156]: pgmap v6214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:42 smithi189 ceph-mon[32756]: pgmap v6214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10579.435333 secs 2024-04-26T21:14:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:43 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9882.410815 secs 2024-04-26T21:14:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10579.435333 secs 2024-04-26T21:14:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:43 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9882.410815 secs 2024-04-26T21:14:44.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10579.435333 secs 2024-04-26T21:14:44.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:43 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9882.410815 secs 2024-04-26T21:14:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:44 smithi156 ceph-mon[32679]: pgmap v6215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:44 smithi092 ceph-mon[29156]: pgmap v6215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:44 smithi189 ceph-mon[32756]: pgmap v6215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:46 smithi156 ceph-mon[32679]: pgmap v6216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:46 smithi092 ceph-mon[29156]: pgmap v6216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:46 smithi189 ceph-mon[32756]: pgmap v6216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:48 smithi156 ceph-mon[32679]: pgmap v6217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10584.435472 secs 2024-04-26T21:14:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:48 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9887.410966 secs 2024-04-26T21:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:48 smithi092 ceph-mon[29156]: pgmap v6217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10584.435472 secs 2024-04-26T21:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:48 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9887.410966 secs 2024-04-26T21:14:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:48 smithi189 ceph-mon[32756]: pgmap v6217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10584.435472 secs 2024-04-26T21:14:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:48 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9887.410966 secs 2024-04-26T21:14:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:50 smithi156 ceph-mon[32679]: pgmap v6218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:50 smithi092 ceph-mon[29156]: pgmap v6218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:50 smithi189 ceph-mon[32756]: pgmap v6218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:52 smithi156 ceph-mon[32679]: pgmap v6219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:52 smithi092 ceph-mon[29156]: pgmap v6219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:52 smithi189 ceph-mon[32756]: pgmap v6219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10589.435555 secs 2024-04-26T21:14:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:53 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9892.411045 secs 2024-04-26T21:14:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10589.435555 secs 2024-04-26T21:14:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:53 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9892.411045 secs 2024-04-26T21:14:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10589.435555 secs 2024-04-26T21:14:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:53 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9892.411045 secs 2024-04-26T21:14:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:54 smithi156 ceph-mon[32679]: pgmap v6220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:54 smithi092 ceph-mon[29156]: pgmap v6220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:54 smithi189 ceph-mon[32756]: pgmap v6220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:14:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:14:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:56 smithi092 ceph-mon[29156]: pgmap v6221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:14:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:56 smithi189 ceph-mon[32756]: pgmap v6221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:14:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:56 smithi156 ceph-mon[32679]: pgmap v6221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:14:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:14:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:14:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:14:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:57 smithi092 ceph-mon[29156]: pgmap v6222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:14:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:57 smithi092 ceph-mon[29156]: pgmap v6223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:14:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:57 smithi189 ceph-mon[32756]: pgmap v6222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:14:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:57 smithi189 ceph-mon[32756]: pgmap v6223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:14:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:57 smithi156 ceph-mon[32679]: pgmap v6222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:14:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:57 smithi156 ceph-mon[32679]: pgmap v6223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:14:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10594.435690 secs 2024-04-26T21:14:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:58 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9897.411147 secs 2024-04-26T21:14:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10594.435690 secs 2024-04-26T21:14:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:58 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9897.411147 secs 2024-04-26T21:14:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10594.435690 secs 2024-04-26T21:14:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:58 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9897.411147 secs 2024-04-26T21:15:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:14:59 smithi092 ceph-mon[29156]: pgmap v6224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:14:59 smithi189 ceph-mon[32756]: pgmap v6224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:14:59 smithi156 ceph-mon[32679]: pgmap v6224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:01 smithi092 ceph-mon[29156]: pgmap v6225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:01 smithi189 ceph-mon[32756]: pgmap v6225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:01 smithi156 ceph-mon[32679]: pgmap v6225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:03 smithi092 ceph-mon[29156]: pgmap v6226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10599.435811 secs 2024-04-26T21:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:03 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 9902.411313 secs 2024-04-26T21:15:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:03 smithi092 ceph-mon[29156]: slow request 2880.623978 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:15:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:03 smithi189 ceph-mon[32756]: pgmap v6226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10599.435811 secs 2024-04-26T21:15:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:03 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 9902.411313 secs 2024-04-26T21:15:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:03 smithi189 ceph-mon[32756]: slow request 2880.623978 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:15:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:03 smithi156 ceph-mon[32679]: pgmap v6226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10599.435811 secs 2024-04-26T21:15:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:03 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 9902.411313 secs 2024-04-26T21:15:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:03 smithi156 ceph-mon[32679]: slow request 2880.623978 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:15:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:05 smithi092 ceph-mon[29156]: pgmap v6227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:05 smithi189 ceph-mon[32756]: pgmap v6227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:05 smithi156 ceph-mon[32679]: pgmap v6227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:15:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:07 smithi092 ceph-mon[29156]: pgmap v6228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:15:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:07 smithi189 ceph-mon[32756]: pgmap v6228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:15:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:07 smithi156 ceph-mon[32679]: pgmap v6228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:15:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10604.435843 secs 2024-04-26T21:15:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:08 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9907.411351 secs 2024-04-26T21:15:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10604.435843 secs 2024-04-26T21:15:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:08 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9907.411351 secs 2024-04-26T21:15:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10604.435843 secs 2024-04-26T21:15:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:08 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9907.411351 secs 2024-04-26T21:15:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:09 smithi092 ceph-mon[29156]: pgmap v6229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:09 smithi189 ceph-mon[32756]: pgmap v6229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:09 smithi156 ceph-mon[32679]: pgmap v6229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:11 smithi092 ceph-mon[29156]: pgmap v6230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:11 smithi189 ceph-mon[32756]: pgmap v6230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:11 smithi156 ceph-mon[32679]: pgmap v6230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:13 smithi092 ceph-mon[29156]: pgmap v6231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10609.435938 secs 2024-04-26T21:15:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:13 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9912.411470 secs 2024-04-26T21:15:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:13 smithi189 ceph-mon[32756]: pgmap v6231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10609.435938 secs 2024-04-26T21:15:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:13 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9912.411470 secs 2024-04-26T21:15:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:13 smithi156 ceph-mon[32679]: pgmap v6231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10609.435938 secs 2024-04-26T21:15:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:13 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9912.411470 secs 2024-04-26T21:15:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:15 smithi092 ceph-mon[29156]: pgmap v6232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:15 smithi189 ceph-mon[32756]: pgmap v6232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:15 smithi156 ceph-mon[32679]: pgmap v6232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:17 smithi092 ceph-mon[29156]: pgmap v6233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:17 smithi189 ceph-mon[32756]: pgmap v6233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:17 smithi156 ceph-mon[32679]: pgmap v6233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10614.436061 secs 2024-04-26T21:15:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:18 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9917.411585 secs 2024-04-26T21:15:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10614.436061 secs 2024-04-26T21:15:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:18 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9917.411585 secs 2024-04-26T21:15:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10614.436061 secs 2024-04-26T21:15:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:18 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9917.411585 secs 2024-04-26T21:15:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:19 smithi092 ceph-mon[29156]: pgmap v6234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:20.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:19 smithi156 ceph-mon[32679]: pgmap v6234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:19 smithi189 ceph-mon[32756]: pgmap v6234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:21 smithi092 ceph-mon[29156]: pgmap v6235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:21 smithi189 ceph-mon[32756]: pgmap v6235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:21 smithi156 ceph-mon[32679]: pgmap v6235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:23 smithi092 ceph-mon[29156]: pgmap v6236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10619.436202 secs 2024-04-26T21:15:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:23 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9922.411688 secs 2024-04-26T21:15:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:23 smithi189 ceph-mon[32756]: pgmap v6236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10619.436202 secs 2024-04-26T21:15:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:23 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9922.411688 secs 2024-04-26T21:15:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:23 smithi156 ceph-mon[32679]: pgmap v6236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10619.436202 secs 2024-04-26T21:15:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:23 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9922.411688 secs 2024-04-26T21:15:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:25 smithi189 ceph-mon[32756]: pgmap v6237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:25 smithi156 ceph-mon[32679]: pgmap v6237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:25 smithi092 ceph-mon[29156]: pgmap v6237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:27 smithi189 ceph-mon[32756]: pgmap v6238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:27 smithi156 ceph-mon[32679]: pgmap v6238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:27 smithi092 ceph-mon[29156]: pgmap v6238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10624.436318 secs 2024-04-26T21:15:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9927.411813 secs 2024-04-26T21:15:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10624.436318 secs 2024-04-26T21:15:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9927.411813 secs 2024-04-26T21:15:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10624.436318 secs 2024-04-26T21:15:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9927.411813 secs 2024-04-26T21:15:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:30 smithi189 ceph-mon[32756]: pgmap v6239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:30 smithi156 ceph-mon[32679]: pgmap v6239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:30 smithi092 ceph-mon[29156]: pgmap v6239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:32 smithi189 ceph-mon[32756]: pgmap v6240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:32 smithi156 ceph-mon[32679]: pgmap v6240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:32 smithi092 ceph-mon[29156]: pgmap v6240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:33.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:15:33.663+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:15:33.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:15:33.663+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:15:33.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:15:33.663+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:15:33.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:15:33.663+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:15:33.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:15:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:15:33.663+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:15:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:34 smithi189 ceph-mon[32756]: pgmap v6241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10629.436440 secs 2024-04-26T21:15:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9932.411875 secs 2024-04-26T21:15:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:34 smithi156 ceph-mon[32679]: pgmap v6241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10629.436440 secs 2024-04-26T21:15:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9932.411875 secs 2024-04-26T21:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:34 smithi092 ceph-mon[29156]: pgmap v6241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10629.436440 secs 2024-04-26T21:15:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9932.411875 secs 2024-04-26T21:15:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:36 smithi189 ceph-mon[32756]: pgmap v6242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:36 smithi156 ceph-mon[32679]: pgmap v6242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:36 smithi092 ceph-mon[29156]: pgmap v6242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:15:37.434+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:15:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:15:37.434+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:15:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:15:37.434+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:15:37.435 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:15:37.434+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 85 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:15:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:38 smithi189 ceph-mon[32756]: pgmap v6243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:38 smithi156 ceph-mon[32679]: pgmap v6243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:38 smithi092 ceph-mon[29156]: pgmap v6243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10634.436534 secs 2024-04-26T21:15:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9937.412016 secs 2024-04-26T21:15:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10634.436534 secs 2024-04-26T21:15:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9937.412016 secs 2024-04-26T21:15:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10634.436534 secs 2024-04-26T21:15:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9937.412016 secs 2024-04-26T21:15:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:40 smithi189 ceph-mon[32756]: pgmap v6244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:40 smithi156 ceph-mon[32679]: pgmap v6244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:40 smithi092 ceph-mon[29156]: pgmap v6244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:42 smithi189 ceph-mon[32756]: pgmap v6245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:42 smithi156 ceph-mon[32679]: pgmap v6245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:42 smithi092 ceph-mon[29156]: pgmap v6245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:44.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:44 smithi092 ceph-mon[29156]: pgmap v6246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:44.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10639.436668 secs 2024-04-26T21:15:44.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9942.412157 secs 2024-04-26T21:15:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:44 smithi189 ceph-mon[32756]: pgmap v6246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10639.436668 secs 2024-04-26T21:15:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9942.412157 secs 2024-04-26T21:15:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:44 smithi156 ceph-mon[32679]: pgmap v6246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10639.436668 secs 2024-04-26T21:15:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9942.412157 secs 2024-04-26T21:15:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:46 smithi189 ceph-mon[32756]: pgmap v6247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:46 smithi156 ceph-mon[32679]: pgmap v6247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:46 smithi092 ceph-mon[29156]: pgmap v6247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:48 smithi189 ceph-mon[32756]: pgmap v6248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:48 smithi156 ceph-mon[32679]: pgmap v6248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:48 smithi092 ceph-mon[29156]: pgmap v6248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T21:15:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10644.436739 secs 2024-04-26T21:15:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9947.412261 secs 2024-04-26T21:15:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10644.436739 secs 2024-04-26T21:15:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9947.412261 secs 2024-04-26T21:15:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10644.436739 secs 2024-04-26T21:15:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9947.412261 secs 2024-04-26T21:15:50.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:50 smithi156 ceph-mon[32679]: pgmap v6249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:50 smithi189 ceph-mon[32756]: pgmap v6249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:50 smithi092 ceph-mon[29156]: pgmap v6249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:15:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:52 smithi189 ceph-mon[32756]: pgmap v6250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:52 smithi156 ceph-mon[32679]: pgmap v6250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:52 smithi092 ceph-mon[29156]: pgmap v6250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:54 smithi189 ceph-mon[32756]: pgmap v6251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10649.436871 secs 2024-04-26T21:15:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9952.412380 secs 2024-04-26T21:15:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:54 smithi156 ceph-mon[32679]: pgmap v6251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10649.436871 secs 2024-04-26T21:15:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9952.412380 secs 2024-04-26T21:15:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:54 smithi092 ceph-mon[29156]: pgmap v6251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10649.436871 secs 2024-04-26T21:15:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9952.412380 secs 2024-04-26T21:15:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:56 smithi189 ceph-mon[32756]: pgmap v6252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:56 smithi156 ceph-mon[32679]: pgmap v6252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:56 smithi092 ceph-mon[29156]: pgmap v6252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:15:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:15:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:58 smithi156 ceph-mon[32679]: pgmap v6253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:58.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:15:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:58 smithi092 ceph-mon[29156]: pgmap v6253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:58 smithi189 ceph-mon[32756]: pgmap v6253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:15:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:15:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:15:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:59 smithi156 ceph-mon[32679]: pgmap v6254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:15:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:59 smithi156 ceph-mon[32679]: pgmap v6255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10654.437014 secs 2024-04-26T21:15:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:15:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9957.412441 secs 2024-04-26T21:15:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:59 smithi092 ceph-mon[29156]: pgmap v6254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:15:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:59 smithi092 ceph-mon[29156]: pgmap v6255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10654.437014 secs 2024-04-26T21:15:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:15:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9957.412441 secs 2024-04-26T21:15:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:59 smithi189 ceph-mon[32756]: pgmap v6254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:15:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:59 smithi189 ceph-mon[32756]: pgmap v6255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:15:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10654.437014 secs 2024-04-26T21:15:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:15:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9957.412441 secs 2024-04-26T21:16:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:01 smithi156 ceph-mon[32679]: pgmap v6256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:01 smithi092 ceph-mon[29156]: pgmap v6256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:01 smithi189 ceph-mon[32756]: pgmap v6256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:03 smithi156 ceph-mon[32679]: pgmap v6257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:03 smithi092 ceph-mon[29156]: pgmap v6257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:03 smithi189 ceph-mon[32756]: pgmap v6257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:16:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10659.437156 secs 2024-04-26T21:16:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9962.412558 secs 2024-04-26T21:16:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10659.437156 secs 2024-04-26T21:16:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9962.412558 secs 2024-04-26T21:16:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10659.437156 secs 2024-04-26T21:16:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9962.412558 secs 2024-04-26T21:16:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:05 smithi156 ceph-mon[32679]: pgmap v6258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:05 smithi092 ceph-mon[29156]: pgmap v6258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:05 smithi189 ceph-mon[32756]: pgmap v6258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T21:16:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:07 smithi156 ceph-mon[32679]: pgmap v6259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:07 smithi092 ceph-mon[29156]: pgmap v6259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:07 smithi189 ceph-mon[32756]: pgmap v6259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:09 smithi156 ceph-mon[32679]: pgmap v6260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T21:16:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10664.437281 secs 2024-04-26T21:16:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9967.412676 secs 2024-04-26T21:16:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:09 smithi092 ceph-mon[29156]: pgmap v6260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T21:16:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10664.437281 secs 2024-04-26T21:16:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9967.412676 secs 2024-04-26T21:16:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:09 smithi189 ceph-mon[32756]: pgmap v6260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T21:16:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10664.437281 secs 2024-04-26T21:16:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9967.412676 secs 2024-04-26T21:16:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:11 smithi156 ceph-mon[32679]: pgmap v6261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:11 smithi092 ceph-mon[29156]: pgmap v6261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:11 smithi189 ceph-mon[32756]: pgmap v6261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:13 smithi156 ceph-mon[32679]: pgmap v6262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:13 smithi092 ceph-mon[29156]: pgmap v6262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:13 smithi189 ceph-mon[32756]: pgmap v6262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10669.437397 secs 2024-04-26T21:16:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9972.412795 secs 2024-04-26T21:16:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10669.437397 secs 2024-04-26T21:16:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9972.412795 secs 2024-04-26T21:16:14.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10669.437397 secs 2024-04-26T21:16:14.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9972.412795 secs 2024-04-26T21:16:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:15 smithi156 ceph-mon[32679]: pgmap v6263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:15 smithi092 ceph-mon[29156]: pgmap v6263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:15 smithi189 ceph-mon[32756]: pgmap v6263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:16:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:17 smithi156 ceph-mon[32679]: pgmap v6264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:17 smithi092 ceph-mon[29156]: pgmap v6264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:17 smithi189 ceph-mon[32756]: pgmap v6264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:16:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:19 smithi156 ceph-mon[32679]: pgmap v6265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10674.437493 secs 2024-04-26T21:16:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9977.412872 secs 2024-04-26T21:16:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:19 smithi092 ceph-mon[29156]: pgmap v6265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10674.437493 secs 2024-04-26T21:16:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9977.412872 secs 2024-04-26T21:16:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:19 smithi189 ceph-mon[32756]: pgmap v6265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10674.437493 secs 2024-04-26T21:16:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9977.412872 secs 2024-04-26T21:16:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:21 smithi092 ceph-mon[29156]: pgmap v6266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:21 smithi189 ceph-mon[32756]: pgmap v6266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:21 smithi156 ceph-mon[32679]: pgmap v6266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:23 smithi092 ceph-mon[29156]: pgmap v6267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:23 smithi189 ceph-mon[32756]: pgmap v6267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:23 smithi156 ceph-mon[32679]: pgmap v6267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10679.437633 secs 2024-04-26T21:16:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9982.412961 secs 2024-04-26T21:16:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10679.437633 secs 2024-04-26T21:16:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9982.412961 secs 2024-04-26T21:16:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10679.437633 secs 2024-04-26T21:16:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9982.412961 secs 2024-04-26T21:16:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:25 smithi092 ceph-mon[29156]: pgmap v6268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:25 smithi189 ceph-mon[32756]: pgmap v6268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:25 smithi156 ceph-mon[32679]: pgmap v6268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:27 smithi092 ceph-mon[29156]: pgmap v6269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:27 smithi189 ceph-mon[32756]: pgmap v6269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:27 smithi156 ceph-mon[32679]: pgmap v6269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:28 smithi092 ceph-mon[29156]: pgmap v6270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:28 smithi189 ceph-mon[32756]: pgmap v6270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:28 smithi156 ceph-mon[32679]: pgmap v6270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10684.437748 secs 2024-04-26T21:16:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9987.413023 secs 2024-04-26T21:16:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10684.437748 secs 2024-04-26T21:16:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9987.413023 secs 2024-04-26T21:16:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10684.437748 secs 2024-04-26T21:16:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9987.413023 secs 2024-04-26T21:16:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:30 smithi092 ceph-mon[29156]: pgmap v6271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:30 smithi189 ceph-mon[32756]: pgmap v6271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:30 smithi156 ceph-mon[32679]: pgmap v6271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:32 smithi156 ceph-mon[32679]: pgmap v6272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:32 smithi092 ceph-mon[29156]: pgmap v6272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:32 smithi189 ceph-mon[32756]: pgmap v6272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:34 smithi156 ceph-mon[32679]: pgmap v6273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10689.437904 secs 2024-04-26T21:16:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9992.413209 secs 2024-04-26T21:16:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:34 smithi092 ceph-mon[29156]: pgmap v6273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10689.437904 secs 2024-04-26T21:16:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9992.413209 secs 2024-04-26T21:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:34 smithi189 ceph-mon[32756]: pgmap v6273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10689.437904 secs 2024-04-26T21:16:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9992.413209 secs 2024-04-26T21:16:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:36 smithi156 ceph-mon[32679]: pgmap v6274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:36 smithi092 ceph-mon[29156]: pgmap v6274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:36 smithi189 ceph-mon[32756]: pgmap v6274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:38 smithi156 ceph-mon[32679]: pgmap v6275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:38 smithi092 ceph-mon[29156]: pgmap v6275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:38 smithi189 ceph-mon[32756]: pgmap v6275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10694.438018 secs 2024-04-26T21:16:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 9997.413329 secs 2024-04-26T21:16:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10694.438018 secs 2024-04-26T21:16:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 9997.413329 secs 2024-04-26T21:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10694.438018 secs 2024-04-26T21:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 9997.413329 secs 2024-04-26T21:16:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:40 smithi156 ceph-mon[32679]: pgmap v6276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:40 smithi092 ceph-mon[29156]: pgmap v6276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:40 smithi189 ceph-mon[32756]: pgmap v6276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:42 smithi156 ceph-mon[32679]: pgmap v6277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:42 smithi092 ceph-mon[29156]: pgmap v6277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:42 smithi189 ceph-mon[32756]: pgmap v6277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:44 smithi156 ceph-mon[32679]: pgmap v6278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10699.438142 secs 2024-04-26T21:16:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10002.413400 secs 2024-04-26T21:16:44.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:44 smithi189 ceph-mon[32756]: pgmap v6278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:44.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10699.438142 secs 2024-04-26T21:16:44.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10002.413400 secs 2024-04-26T21:16:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:44 smithi092 ceph-mon[29156]: pgmap v6278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10699.438142 secs 2024-04-26T21:16:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10002.413400 secs 2024-04-26T21:16:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:46 smithi156 ceph-mon[32679]: pgmap v6279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:46 smithi092 ceph-mon[29156]: pgmap v6279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:46 smithi189 ceph-mon[32756]: pgmap v6279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:48 smithi156 ceph-mon[32679]: pgmap v6280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:48 smithi092 ceph-mon[29156]: pgmap v6280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:48 smithi189 ceph-mon[32756]: pgmap v6280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10704.438259 secs 2024-04-26T21:16:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10007.413513 secs 2024-04-26T21:16:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10704.438259 secs 2024-04-26T21:16:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10007.413513 secs 2024-04-26T21:16:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10704.438259 secs 2024-04-26T21:16:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10007.413513 secs 2024-04-26T21:16:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:50 smithi156 ceph-mon[32679]: pgmap v6281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:50 smithi092 ceph-mon[29156]: pgmap v6281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:50 smithi189 ceph-mon[32756]: pgmap v6281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:52 smithi092 ceph-mon[29156]: pgmap v6282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:52 smithi189 ceph-mon[32756]: pgmap v6282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:52 smithi156 ceph-mon[32679]: pgmap v6282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:54 smithi092 ceph-mon[29156]: pgmap v6283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10709.438377 secs 2024-04-26T21:16:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10012.413580 secs 2024-04-26T21:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:54 smithi189 ceph-mon[32756]: pgmap v6283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10709.438377 secs 2024-04-26T21:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10012.413580 secs 2024-04-26T21:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:54 smithi156 ceph-mon[32679]: pgmap v6283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10709.438377 secs 2024-04-26T21:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10012.413580 secs 2024-04-26T21:16:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:56 smithi092 ceph-mon[29156]: pgmap v6284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:56 smithi189 ceph-mon[32756]: pgmap v6284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:56 smithi156 ceph-mon[32679]: pgmap v6284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:16:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: pgmap v6285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: pgmap v6286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: pgmap v6287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:16:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: pgmap v6285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: pgmap v6286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: pgmap v6287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:16:58.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: pgmap v6285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: pgmap v6286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: pgmap v6287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:16:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:16:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10714.438528 secs 2024-04-26T21:16:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:16:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10017.413642 secs 2024-04-26T21:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10714.438528 secs 2024-04-26T21:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:16:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10017.413642 secs 2024-04-26T21:16:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10714.438528 secs 2024-04-26T21:16:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:16:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10017.413642 secs 2024-04-26T21:17:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:00 smithi092 ceph-mon[29156]: pgmap v6288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:00 smithi189 ceph-mon[32756]: pgmap v6288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:00 smithi156 ceph-mon[32679]: pgmap v6288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:03 smithi156 ceph-mon[32679]: pgmap v6289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:03 smithi092 ceph-mon[29156]: pgmap v6289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:03 smithi189 ceph-mon[32756]: pgmap v6289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10719.438642 secs 2024-04-26T21:17:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:04 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 10022.413752 secs 2024-04-26T21:17:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:04 smithi156 ceph-mon[32679]: slow request 720.049832 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10719.438642 secs 2024-04-26T21:17:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:04 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 10022.413752 secs 2024-04-26T21:17:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:04 smithi092 ceph-mon[29156]: slow request 720.049832 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10719.438642 secs 2024-04-26T21:17:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:04 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 10022.413752 secs 2024-04-26T21:17:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:04 smithi189 ceph-mon[32756]: slow request 720.049832 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:17:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:05 smithi156 ceph-mon[32679]: pgmap v6290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:05 smithi092 ceph-mon[29156]: pgmap v6290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:05 smithi189 ceph-mon[32756]: pgmap v6290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:07 smithi156 ceph-mon[32679]: pgmap v6291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:07 smithi092 ceph-mon[29156]: pgmap v6291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:07 smithi189 ceph-mon[32756]: pgmap v6291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:09 smithi156 ceph-mon[32679]: pgmap v6292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10724.438775 secs 2024-04-26T21:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10027.413875 secs 2024-04-26T21:17:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:09 smithi092 ceph-mon[29156]: pgmap v6292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:17:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10724.438775 secs 2024-04-26T21:17:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10027.413875 secs 2024-04-26T21:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:09 smithi189 ceph-mon[32756]: pgmap v6292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10724.438775 secs 2024-04-26T21:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10027.413875 secs 2024-04-26T21:17:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:11 smithi156 ceph-mon[32679]: pgmap v6293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:11 smithi092 ceph-mon[29156]: pgmap v6293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:11 smithi189 ceph-mon[32756]: pgmap v6293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:13 smithi092 ceph-mon[29156]: pgmap v6294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:13 smithi189 ceph-mon[32756]: pgmap v6294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:13 smithi156 ceph-mon[32679]: pgmap v6294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10729.438899 secs 2024-04-26T21:17:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10032.414004 secs 2024-04-26T21:17:14.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10729.438899 secs 2024-04-26T21:17:14.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10032.414004 secs 2024-04-26T21:17:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10729.438899 secs 2024-04-26T21:17:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10032.414004 secs 2024-04-26T21:17:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:15 smithi092 ceph-mon[29156]: pgmap v6295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:15 smithi189 ceph-mon[32756]: pgmap v6295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:15 smithi156 ceph-mon[32679]: pgmap v6295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:17 smithi092 ceph-mon[29156]: pgmap v6296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:17 smithi189 ceph-mon[32756]: pgmap v6296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:17 smithi156 ceph-mon[32679]: pgmap v6296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:19 smithi092 ceph-mon[29156]: pgmap v6297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10734.439013 secs 2024-04-26T21:17:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10037.414127 secs 2024-04-26T21:17:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:19 smithi189 ceph-mon[32756]: pgmap v6297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10734.439013 secs 2024-04-26T21:17:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10037.414127 secs 2024-04-26T21:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:19 smithi156 ceph-mon[32679]: pgmap v6297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10734.439013 secs 2024-04-26T21:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10037.414127 secs 2024-04-26T21:17:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:21 smithi092 ceph-mon[29156]: pgmap v6298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:21 smithi189 ceph-mon[32756]: pgmap v6298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:21 smithi156 ceph-mon[32679]: pgmap v6298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:23.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:23 smithi156 ceph-mon[32679]: pgmap v6299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:23 smithi092 ceph-mon[29156]: pgmap v6299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:23 smithi189 ceph-mon[32756]: pgmap v6299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10739.439132 secs 2024-04-26T21:17:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10042.414262 secs 2024-04-26T21:17:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10739.439132 secs 2024-04-26T21:17:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10042.414262 secs 2024-04-26T21:17:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10739.439132 secs 2024-04-26T21:17:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10042.414262 secs 2024-04-26T21:17:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:25 smithi092 ceph-mon[29156]: pgmap v6300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:25 smithi189 ceph-mon[32756]: pgmap v6300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:25 smithi156 ceph-mon[32679]: pgmap v6300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:26 smithi092 ceph-mon[29156]: pgmap v6301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:26 smithi189 ceph-mon[32756]: pgmap v6301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:26 smithi156 ceph-mon[32679]: pgmap v6301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:29 smithi156 ceph-mon[32679]: pgmap v6302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10744.439250 secs 2024-04-26T21:17:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10047.414380 secs 2024-04-26T21:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:29 smithi092 ceph-mon[29156]: pgmap v6302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10744.439250 secs 2024-04-26T21:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10047.414380 secs 2024-04-26T21:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:29 smithi189 ceph-mon[32756]: pgmap v6302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10744.439250 secs 2024-04-26T21:17:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10047.414380 secs 2024-04-26T21:17:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:31 smithi156 ceph-mon[32679]: pgmap v6303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:31 smithi092 ceph-mon[29156]: pgmap v6303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:31 smithi189 ceph-mon[32756]: pgmap v6303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:33 smithi156 ceph-mon[32679]: pgmap v6304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:33 smithi092 ceph-mon[29156]: pgmap v6304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:33 smithi189 ceph-mon[32756]: pgmap v6304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10749.439363 secs 2024-04-26T21:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10052.414519 secs 2024-04-26T21:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10749.439363 secs 2024-04-26T21:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10052.414519 secs 2024-04-26T21:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10749.439363 secs 2024-04-26T21:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10052.414519 secs 2024-04-26T21:17:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:35 smithi092 ceph-mon[29156]: pgmap v6305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:35 smithi189 ceph-mon[32756]: pgmap v6305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:35 smithi156 ceph-mon[32679]: pgmap v6305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:37 smithi092 ceph-mon[29156]: pgmap v6306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:37 smithi189 ceph-mon[32756]: pgmap v6306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:37 smithi156 ceph-mon[32679]: pgmap v6306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:39 smithi092 ceph-mon[29156]: pgmap v6307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10754.439475 secs 2024-04-26T21:17:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10057.414598 secs 2024-04-26T21:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:39 smithi189 ceph-mon[32756]: pgmap v6307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10754.439475 secs 2024-04-26T21:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10057.414598 secs 2024-04-26T21:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:39 smithi156 ceph-mon[32679]: pgmap v6307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10754.439475 secs 2024-04-26T21:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10057.414598 secs 2024-04-26T21:17:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:41 smithi092 ceph-mon[29156]: pgmap v6308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:41 smithi189 ceph-mon[32756]: pgmap v6308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:41 smithi156 ceph-mon[32679]: pgmap v6308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:43 smithi092 ceph-mon[29156]: pgmap v6309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:43 smithi189 ceph-mon[32756]: pgmap v6309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:43 smithi156 ceph-mon[32679]: pgmap v6309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10759.439621 secs 2024-04-26T21:17:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10062.414735 secs 2024-04-26T21:17:44.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10759.439621 secs 2024-04-26T21:17:44.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10062.414735 secs 2024-04-26T21:17:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10759.439621 secs 2024-04-26T21:17:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10062.414735 secs 2024-04-26T21:17:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:45 smithi092 ceph-mon[29156]: pgmap v6310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:45 smithi189 ceph-mon[32756]: pgmap v6310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:45 smithi156 ceph-mon[32679]: pgmap v6310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:47 smithi092 ceph-mon[29156]: pgmap v6311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:47 smithi189 ceph-mon[32756]: pgmap v6311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:47 smithi156 ceph-mon[32679]: pgmap v6311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:48 smithi189 ceph-mon[32756]: pgmap v6312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:48 smithi156 ceph-mon[32679]: pgmap v6312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:48 smithi092 ceph-mon[29156]: pgmap v6312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10764.439758 secs 2024-04-26T21:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10067.414851 secs 2024-04-26T21:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10764.439758 secs 2024-04-26T21:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10067.414851 secs 2024-04-26T21:17:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10764.439758 secs 2024-04-26T21:17:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10067.414851 secs 2024-04-26T21:17:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:50 smithi189 ceph-mon[32756]: pgmap v6313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:50 smithi156 ceph-mon[32679]: pgmap v6313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:50 smithi092 ceph-mon[29156]: pgmap v6313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:53 smithi092 ceph-mon[29156]: pgmap v6314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:53 smithi189 ceph-mon[32756]: pgmap v6314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:53 smithi156 ceph-mon[32679]: pgmap v6314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10769.439914 secs 2024-04-26T21:17:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10072.414952 secs 2024-04-26T21:17:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10769.439914 secs 2024-04-26T21:17:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10072.414952 secs 2024-04-26T21:17:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10769.439914 secs 2024-04-26T21:17:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10072.414952 secs 2024-04-26T21:17:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:55 smithi092 ceph-mon[29156]: pgmap v6315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:55 smithi189 ceph-mon[32756]: pgmap v6315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:55 smithi156 ceph-mon[32679]: pgmap v6315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:17:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:57 smithi092 ceph-mon[29156]: pgmap v6316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:57 smithi189 ceph-mon[32756]: pgmap v6316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:57 smithi156 ceph-mon[32679]: pgmap v6316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: pgmap v6317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10774.439978 secs 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10077.415040 secs 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:17:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:17:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: pgmap v6317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10774.439978 secs 2024-04-26T21:17:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10077.415040 secs 2024-04-26T21:17:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:17:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: pgmap v6317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10774.439978 secs 2024-04-26T21:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10077.415040 secs 2024-04-26T21:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:17:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:17:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:17:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:18:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:00 smithi092 ceph-mon[29156]: pgmap v6318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:18:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:00 smithi092 ceph-mon[29156]: pgmap v6319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:00 smithi189 ceph-mon[32756]: pgmap v6318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:18:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:00 smithi189 ceph-mon[32756]: pgmap v6319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:00 smithi156 ceph-mon[32679]: pgmap v6318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:18:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:00 smithi156 ceph-mon[32679]: pgmap v6319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:02 smithi092 ceph-mon[29156]: pgmap v6320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:02 smithi189 ceph-mon[32756]: pgmap v6320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:02 smithi156 ceph-mon[32679]: pgmap v6320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:04 smithi092 ceph-mon[29156]: pgmap v6321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:18:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10779.440112 secs 2024-04-26T21:18:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10082.415160 secs 2024-04-26T21:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:04 smithi189 ceph-mon[32756]: pgmap v6321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10779.440112 secs 2024-04-26T21:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10082.415160 secs 2024-04-26T21:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:04 smithi156 ceph-mon[32679]: pgmap v6321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10779.440112 secs 2024-04-26T21:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10082.415160 secs 2024-04-26T21:18:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:06 smithi092 ceph-mon[29156]: pgmap v6322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:06 smithi189 ceph-mon[32756]: pgmap v6322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:06 smithi156 ceph-mon[32679]: pgmap v6322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:08 smithi092 ceph-mon[29156]: pgmap v6323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:08 smithi189 ceph-mon[32756]: pgmap v6323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:08 smithi156 ceph-mon[32679]: pgmap v6323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:18:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10784.440183 secs 2024-04-26T21:18:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10087.415274 secs 2024-04-26T21:18:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10784.440183 secs 2024-04-26T21:18:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10087.415274 secs 2024-04-26T21:18:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10784.440183 secs 2024-04-26T21:18:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10087.415274 secs 2024-04-26T21:18:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:10 smithi092 ceph-mon[29156]: pgmap v6324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:18:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:10 smithi189 ceph-mon[32756]: pgmap v6324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:18:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:10 smithi156 ceph-mon[32679]: pgmap v6324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:18:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:11 smithi092 ceph-mon[29156]: pgmap v6325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:11 smithi189 ceph-mon[32756]: pgmap v6325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:11 smithi156 ceph-mon[32679]: pgmap v6325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:14.197 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:13 smithi092 ceph-mon[29156]: pgmap v6326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:14.197 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10789.440297 secs 2024-04-26T21:18:14.197 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:13 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10092.415359 secs 2024-04-26T21:18:14.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:13 smithi189 ceph-mon[32756]: pgmap v6326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:14.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10789.440297 secs 2024-04-26T21:18:14.342 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:13 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10092.415359 secs 2024-04-26T21:18:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:13 smithi156 ceph-mon[32679]: pgmap v6326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10789.440297 secs 2024-04-26T21:18:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:13 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10092.415359 secs 2024-04-26T21:18:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:15 smithi092 ceph-mon[29156]: pgmap v6327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:15 smithi189 ceph-mon[32756]: pgmap v6327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:15 smithi156 ceph-mon[32679]: pgmap v6327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:17 smithi092 ceph-mon[29156]: pgmap v6328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:17 smithi189 ceph-mon[32756]: pgmap v6328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:17 smithi156 ceph-mon[32679]: pgmap v6328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10794.440409 secs 2024-04-26T21:18:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:18 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10097.415424 secs 2024-04-26T21:18:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10794.440409 secs 2024-04-26T21:18:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:18 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10097.415424 secs 2024-04-26T21:18:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10794.440409 secs 2024-04-26T21:18:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:18 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10097.415424 secs 2024-04-26T21:18:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:19 smithi092 ceph-mon[29156]: pgmap v6329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:19 smithi189 ceph-mon[32756]: pgmap v6329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:19 smithi156 ceph-mon[32679]: pgmap v6329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:21 smithi092 ceph-mon[29156]: pgmap v6330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:21 smithi189 ceph-mon[32756]: pgmap v6330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:21 smithi156 ceph-mon[32679]: pgmap v6330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:24.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:23 smithi156 ceph-mon[32679]: pgmap v6331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:24.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10799.440506 secs 2024-04-26T21:18:24.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:23 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10102.415488 secs 2024-04-26T21:18:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:23 smithi092 ceph-mon[29156]: pgmap v6331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10799.440506 secs 2024-04-26T21:18:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:23 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10102.415488 secs 2024-04-26T21:18:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:23 smithi189 ceph-mon[32756]: pgmap v6331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10799.440506 secs 2024-04-26T21:18:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:23 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10102.415488 secs 2024-04-26T21:18:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:25 smithi092 ceph-mon[29156]: pgmap v6332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:25 smithi189 ceph-mon[32756]: pgmap v6332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:25 smithi156 ceph-mon[32679]: pgmap v6332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:27 smithi092 ceph-mon[29156]: pgmap v6333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:27 smithi189 ceph-mon[32756]: pgmap v6333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:27 smithi156 ceph-mon[32679]: pgmap v6333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10804.440622 secs 2024-04-26T21:18:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:28 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10107.415574 secs 2024-04-26T21:18:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10804.440622 secs 2024-04-26T21:18:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:28 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10107.415574 secs 2024-04-26T21:18:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10804.440622 secs 2024-04-26T21:18:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:28 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10107.415574 secs 2024-04-26T21:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:29 smithi092 ceph-mon[29156]: pgmap v6334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:29 smithi189 ceph-mon[32756]: pgmap v6334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:29 smithi156 ceph-mon[32679]: pgmap v6334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:31 smithi092 ceph-mon[29156]: pgmap v6335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:31 smithi189 ceph-mon[32756]: pgmap v6335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:31 smithi156 ceph-mon[32679]: pgmap v6335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:33 smithi092 ceph-mon[29156]: pgmap v6336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10809.440685 secs 2024-04-26T21:18:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:33 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10112.415653 secs 2024-04-26T21:18:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:33 smithi189 ceph-mon[32756]: pgmap v6336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10809.440685 secs 2024-04-26T21:18:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:33 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10112.415653 secs 2024-04-26T21:18:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:33 smithi156 ceph-mon[32679]: pgmap v6336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10809.440685 secs 2024-04-26T21:18:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:33 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10112.415653 secs 2024-04-26T21:18:36.006 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000862) for more than 900000000 us, fault. 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003e40 tx=0x7f1ca80b0070 comp rx=0 tx=0).stop 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:36.007 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.005+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca80af000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:18:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.031+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:18:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.031+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:18:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.031+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:18:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.031+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=10 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:18:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.031+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:18:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.032+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T21:18:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:36.032+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T21:18:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:35 smithi092 ceph-mon[29156]: pgmap v6337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:35 smithi189 ceph-mon[32756]: pgmap v6337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:35 smithi156 ceph-mon[32679]: pgmap v6337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:37.458+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:18:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:37.458+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:18:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:37.459+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:18:37.460 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:18:37.459+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 86 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:18:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:37 smithi092 ceph-mon[29156]: pgmap v6338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:37 smithi189 ceph-mon[32756]: pgmap v6338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:37 smithi156 ceph-mon[32679]: pgmap v6338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10814.440800 secs 2024-04-26T21:18:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10117.415771 secs 2024-04-26T21:18:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10814.440800 secs 2024-04-26T21:18:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:38 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10117.415771 secs 2024-04-26T21:18:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10814.440800 secs 2024-04-26T21:18:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:38 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10117.415771 secs 2024-04-26T21:18:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:40 smithi189 ceph-mon[32756]: pgmap v6339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:40 smithi156 ceph-mon[32679]: pgmap v6339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:40 smithi092 ceph-mon[29156]: pgmap v6339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:42 smithi189 ceph-mon[32756]: pgmap v6340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:42 smithi156 ceph-mon[32679]: pgmap v6340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:42 smithi092 ceph-mon[29156]: pgmap v6340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:44.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:44 smithi092 ceph-mon[29156]: pgmap v6341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:44.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10819.440913 secs 2024-04-26T21:18:44.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10122.415915 secs 2024-04-26T21:18:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:44 smithi189 ceph-mon[32756]: pgmap v6341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10819.440913 secs 2024-04-26T21:18:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10122.415915 secs 2024-04-26T21:18:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:44 smithi156 ceph-mon[32679]: pgmap v6341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10819.440913 secs 2024-04-26T21:18:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10122.415915 secs 2024-04-26T21:18:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:46 smithi189 ceph-mon[32756]: pgmap v6342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:46 smithi156 ceph-mon[32679]: pgmap v6342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:46 smithi092 ceph-mon[29156]: pgmap v6342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:48 smithi189 ceph-mon[32756]: pgmap v6343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:48 smithi156 ceph-mon[32679]: pgmap v6343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:48 smithi092 ceph-mon[29156]: pgmap v6343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10824.440973 secs 2024-04-26T21:18:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10127.415997 secs 2024-04-26T21:18:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10824.440973 secs 2024-04-26T21:18:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10127.415997 secs 2024-04-26T21:18:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10824.440973 secs 2024-04-26T21:18:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10127.415997 secs 2024-04-26T21:18:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:50 smithi189 ceph-mon[32756]: pgmap v6344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:50 smithi156 ceph-mon[32679]: pgmap v6344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:50 smithi092 ceph-mon[29156]: pgmap v6344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:52 smithi189 ceph-mon[32756]: pgmap v6345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:52 smithi156 ceph-mon[32679]: pgmap v6345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:52 smithi092 ceph-mon[29156]: pgmap v6345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:54 smithi189 ceph-mon[32756]: pgmap v6346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10829.441093 secs 2024-04-26T21:18:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10132.416106 secs 2024-04-26T21:18:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:54 smithi156 ceph-mon[32679]: pgmap v6346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10829.441093 secs 2024-04-26T21:18:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10132.416106 secs 2024-04-26T21:18:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:54 smithi092 ceph-mon[29156]: pgmap v6346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10829.441093 secs 2024-04-26T21:18:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10132.416106 secs 2024-04-26T21:18:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:56 smithi189 ceph-mon[32756]: pgmap v6347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:56 smithi156 ceph-mon[32679]: pgmap v6347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:56 smithi092 ceph-mon[29156]: pgmap v6347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:18:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:58 smithi189 ceph-mon[32756]: pgmap v6348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:58 smithi156 ceph-mon[32679]: pgmap v6348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:58 smithi092 ceph-mon[29156]: pgmap v6348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10834.441211 secs 2024-04-26T21:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10137.416215 secs 2024-04-26T21:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:18:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10834.441211 secs 2024-04-26T21:18:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10137.416215 secs 2024-04-26T21:18:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:18:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:18:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10834.441211 secs 2024-04-26T21:18:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10137.416215 secs 2024-04-26T21:18:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:18:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:19:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:00 smithi189 ceph-mon[32756]: pgmap v6349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:19:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:00 smithi156 ceph-mon[32679]: pgmap v6349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:19:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:00 smithi092 ceph-mon[29156]: pgmap v6349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:19:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:19:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:19:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:01 smithi189 ceph-mon[32756]: pgmap v6350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:19:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:01 smithi189 ceph-mon[32756]: pgmap v6351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:01 smithi156 ceph-mon[32679]: pgmap v6350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:19:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:01 smithi156 ceph-mon[32679]: pgmap v6351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:01 smithi092 ceph-mon[29156]: pgmap v6350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:19:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:01 smithi092 ceph-mon[29156]: pgmap v6351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:03 smithi092 ceph-mon[29156]: pgmap v6352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:03 smithi189 ceph-mon[32756]: pgmap v6352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:03 smithi156 ceph-mon[32679]: pgmap v6352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10839.441333 secs 2024-04-26T21:19:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10142.416285 secs 2024-04-26T21:19:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10839.441333 secs 2024-04-26T21:19:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10142.416285 secs 2024-04-26T21:19:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10839.441333 secs 2024-04-26T21:19:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10142.416285 secs 2024-04-26T21:19:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:05 smithi189 ceph-mon[32756]: pgmap v6353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:05 smithi156 ceph-mon[32679]: pgmap v6353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:05 smithi092 ceph-mon[29156]: pgmap v6353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:07 smithi189 ceph-mon[32756]: pgmap v6354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:07 smithi156 ceph-mon[32679]: pgmap v6354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:07 smithi092 ceph-mon[29156]: pgmap v6354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:19:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:09 smithi189 ceph-mon[32756]: pgmap v6355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:19:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10844.441446 secs 2024-04-26T21:19:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10147.416380 secs 2024-04-26T21:19:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:09 smithi156 ceph-mon[32679]: pgmap v6355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:19:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10844.441446 secs 2024-04-26T21:19:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10147.416380 secs 2024-04-26T21:19:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:09 smithi092 ceph-mon[29156]: pgmap v6355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:19:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10844.441446 secs 2024-04-26T21:19:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10147.416380 secs 2024-04-26T21:19:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:11 smithi189 ceph-mon[32756]: pgmap v6356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:19:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:11 smithi156 ceph-mon[32679]: pgmap v6356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:19:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:11 smithi092 ceph-mon[29156]: pgmap v6356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:19:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:13 smithi189 ceph-mon[32756]: pgmap v6357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:13 smithi156 ceph-mon[32679]: pgmap v6357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:13 smithi092 ceph-mon[29156]: pgmap v6357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10849.441560 secs 2024-04-26T21:19:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10152.416459 secs 2024-04-26T21:19:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10849.441560 secs 2024-04-26T21:19:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10152.416459 secs 2024-04-26T21:19:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10849.441560 secs 2024-04-26T21:19:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10152.416459 secs 2024-04-26T21:19:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:15 smithi189 ceph-mon[32756]: pgmap v6358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:15 smithi156 ceph-mon[32679]: pgmap v6358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:15 smithi092 ceph-mon[29156]: pgmap v6358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:17 smithi189 ceph-mon[32756]: pgmap v6359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:17.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:17 smithi156 ceph-mon[32679]: pgmap v6359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:17 smithi092 ceph-mon[29156]: pgmap v6359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:19 smithi092 ceph-mon[29156]: pgmap v6360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10854.441688 secs 2024-04-26T21:19:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10157.416526 secs 2024-04-26T21:19:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:19 smithi189 ceph-mon[32756]: pgmap v6360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10854.441688 secs 2024-04-26T21:19:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10157.416526 secs 2024-04-26T21:19:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:19 smithi156 ceph-mon[32679]: pgmap v6360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10854.441688 secs 2024-04-26T21:19:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10157.416526 secs 2024-04-26T21:19:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:21 smithi189 ceph-mon[32756]: pgmap v6361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:21 smithi156 ceph-mon[32679]: pgmap v6361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:21 smithi092 ceph-mon[29156]: pgmap v6361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:23 smithi189 ceph-mon[32756]: pgmap v6362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:23 smithi156 ceph-mon[32679]: pgmap v6362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:23 smithi092 ceph-mon[29156]: pgmap v6362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10859.441843 secs 2024-04-26T21:19:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10162.416638 secs 2024-04-26T21:19:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10859.441843 secs 2024-04-26T21:19:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10162.416638 secs 2024-04-26T21:19:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10859.441843 secs 2024-04-26T21:19:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10162.416638 secs 2024-04-26T21:19:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:25 smithi189 ceph-mon[32756]: pgmap v6363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:25 smithi156 ceph-mon[32679]: pgmap v6363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:25 smithi092 ceph-mon[29156]: pgmap v6363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:27 smithi189 ceph-mon[32756]: pgmap v6364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:27 smithi156 ceph-mon[32679]: pgmap v6364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:27 smithi092 ceph-mon[29156]: pgmap v6364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:29 smithi189 ceph-mon[32756]: pgmap v6365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10864.441961 secs 2024-04-26T21:19:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10167.416731 secs 2024-04-26T21:19:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:29 smithi156 ceph-mon[32679]: pgmap v6365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10864.441961 secs 2024-04-26T21:19:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10167.416731 secs 2024-04-26T21:19:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:29 smithi092 ceph-mon[29156]: pgmap v6365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10864.441961 secs 2024-04-26T21:19:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10167.416731 secs 2024-04-26T21:19:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:31 smithi189 ceph-mon[32756]: pgmap v6366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:31 smithi156 ceph-mon[32679]: pgmap v6366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:31 smithi092 ceph-mon[29156]: pgmap v6366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:33 smithi189 ceph-mon[32756]: pgmap v6367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:33 smithi156 ceph-mon[32679]: pgmap v6367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:33 smithi092 ceph-mon[29156]: pgmap v6367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10869.442063 secs 2024-04-26T21:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10172.416857 secs 2024-04-26T21:19:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10869.442063 secs 2024-04-26T21:19:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10172.416857 secs 2024-04-26T21:19:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10869.442063 secs 2024-04-26T21:19:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10172.416857 secs 2024-04-26T21:19:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:35 smithi189 ceph-mon[32756]: pgmap v6368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:35 smithi156 ceph-mon[32679]: pgmap v6368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:35 smithi092 ceph-mon[29156]: pgmap v6368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:37 smithi189 ceph-mon[32756]: pgmap v6369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:37 smithi156 ceph-mon[32679]: pgmap v6369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:37 smithi092 ceph-mon[29156]: pgmap v6369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:39 smithi189 ceph-mon[32756]: pgmap v6370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10874.442172 secs 2024-04-26T21:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10177.416935 secs 2024-04-26T21:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:39 smithi156 ceph-mon[32679]: pgmap v6370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10874.442172 secs 2024-04-26T21:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10177.416935 secs 2024-04-26T21:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:39 smithi092 ceph-mon[29156]: pgmap v6370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10874.442172 secs 2024-04-26T21:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10177.416935 secs 2024-04-26T21:19:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:41 smithi189 ceph-mon[32756]: pgmap v6371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:41 smithi156 ceph-mon[32679]: pgmap v6371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:41 smithi092 ceph-mon[29156]: pgmap v6371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:43 smithi189 ceph-mon[32756]: pgmap v6372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:43 smithi156 ceph-mon[32679]: pgmap v6372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:43 smithi092 ceph-mon[29156]: pgmap v6372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10879.442285 secs 2024-04-26T21:19:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10182.417054 secs 2024-04-26T21:19:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10879.442285 secs 2024-04-26T21:19:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10182.417054 secs 2024-04-26T21:19:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10879.442285 secs 2024-04-26T21:19:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10182.417054 secs 2024-04-26T21:19:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:45 smithi189 ceph-mon[32756]: pgmap v6373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:45 smithi156 ceph-mon[32679]: pgmap v6373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:45 smithi092 ceph-mon[29156]: pgmap v6373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:47 smithi189 ceph-mon[32756]: pgmap v6374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:47 smithi156 ceph-mon[32679]: pgmap v6374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:47 smithi092 ceph-mon[29156]: pgmap v6374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:49 smithi189 ceph-mon[32756]: pgmap v6375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10884.442395 secs 2024-04-26T21:19:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10187.417171 secs 2024-04-26T21:19:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:49 smithi156 ceph-mon[32679]: pgmap v6375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10884.442395 secs 2024-04-26T21:19:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10187.417171 secs 2024-04-26T21:19:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:49 smithi092 ceph-mon[29156]: pgmap v6375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10884.442395 secs 2024-04-26T21:19:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10187.417171 secs 2024-04-26T21:19:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:51 smithi156 ceph-mon[32679]: pgmap v6376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:51 smithi092 ceph-mon[29156]: pgmap v6376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:51 smithi189 ceph-mon[32756]: pgmap v6376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:53 smithi156 ceph-mon[32679]: pgmap v6377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:53 smithi092 ceph-mon[29156]: pgmap v6377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:53 smithi189 ceph-mon[32756]: pgmap v6377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10889.442517 secs 2024-04-26T21:19:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10192.417275 secs 2024-04-26T21:19:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10889.442517 secs 2024-04-26T21:19:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10192.417275 secs 2024-04-26T21:19:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10889.442517 secs 2024-04-26T21:19:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10192.417275 secs 2024-04-26T21:19:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:55 smithi156 ceph-mon[32679]: pgmap v6378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:55 smithi092 ceph-mon[29156]: pgmap v6378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:55 smithi189 ceph-mon[32756]: pgmap v6378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:19:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:57 smithi156 ceph-mon[32679]: pgmap v6379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:57 smithi092 ceph-mon[29156]: pgmap v6379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:57 smithi189 ceph-mon[32756]: pgmap v6379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:59 smithi156 ceph-mon[32679]: pgmap v6380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10894.442651 secs 2024-04-26T21:19:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:19:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10197.417394 secs 2024-04-26T21:19:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:59 smithi092 ceph-mon[29156]: pgmap v6380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10894.442651 secs 2024-04-26T21:19:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:19:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10197.417394 secs 2024-04-26T21:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:59 smithi189 ceph-mon[32756]: pgmap v6380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10894.442651 secs 2024-04-26T21:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:19:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10197.417394 secs 2024-04-26T21:20:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:20:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:20:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:20:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:20:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:01 smithi156 ceph-mon[32679]: pgmap v6381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:20:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:01 smithi092 ceph-mon[29156]: pgmap v6381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:20:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:01 smithi189 ceph-mon[32756]: pgmap v6381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:20:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:20:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:20:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:02 smithi156 ceph-mon[32679]: pgmap v6382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:20:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:02 smithi156 ceph-mon[32679]: pgmap v6383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:02 smithi092 ceph-mon[29156]: pgmap v6382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:20:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:02 smithi092 ceph-mon[29156]: pgmap v6383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:02 smithi189 ceph-mon[32756]: pgmap v6382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:20:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:02 smithi189 ceph-mon[32756]: pgmap v6383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:04 smithi156 ceph-mon[32679]: pgmap v6384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10899.442768 secs 2024-04-26T21:20:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10202.417512 secs 2024-04-26T21:20:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:04 smithi092 ceph-mon[29156]: pgmap v6384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10899.442768 secs 2024-04-26T21:20:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10202.417512 secs 2024-04-26T21:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:04 smithi189 ceph-mon[32756]: pgmap v6384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10899.442768 secs 2024-04-26T21:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10202.417512 secs 2024-04-26T21:20:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:06 smithi156 ceph-mon[32679]: pgmap v6385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:06 smithi092 ceph-mon[29156]: pgmap v6385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:06 smithi189 ceph-mon[32756]: pgmap v6385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:20:07.471+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:20:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:20:07.471+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:20:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:20:07.472+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:20:07.472 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:20:07.472+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 87 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:20:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:08 smithi156 ceph-mon[32679]: pgmap v6386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:08 smithi092 ceph-mon[29156]: pgmap v6386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:08 smithi189 ceph-mon[32756]: pgmap v6386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:20:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10904.442874 secs 2024-04-26T21:20:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10207.417589 secs 2024-04-26T21:20:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10904.442874 secs 2024-04-26T21:20:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10207.417589 secs 2024-04-26T21:20:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10904.442874 secs 2024-04-26T21:20:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10207.417589 secs 2024-04-26T21:20:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:10 smithi092 ceph-mon[29156]: pgmap v6387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:10 smithi189 ceph-mon[32756]: pgmap v6387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:10 smithi156 ceph-mon[32679]: pgmap v6387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:20:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:12 smithi092 ceph-mon[29156]: pgmap v6388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:20:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:12 smithi189 ceph-mon[32756]: pgmap v6388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:20:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:12 smithi156 ceph-mon[32679]: pgmap v6388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:20:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:14 smithi092 ceph-mon[29156]: pgmap v6389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10909.442987 secs 2024-04-26T21:20:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10212.417711 secs 2024-04-26T21:20:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:14 smithi189 ceph-mon[32756]: pgmap v6389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10909.442987 secs 2024-04-26T21:20:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10212.417711 secs 2024-04-26T21:20:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:14 smithi156 ceph-mon[32679]: pgmap v6389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10909.442987 secs 2024-04-26T21:20:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10212.417711 secs 2024-04-26T21:20:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:16 smithi092 ceph-mon[29156]: pgmap v6390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:16 smithi189 ceph-mon[32756]: pgmap v6390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:16 smithi156 ceph-mon[32679]: pgmap v6390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:18 smithi092 ceph-mon[29156]: pgmap v6391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:18 smithi189 ceph-mon[32756]: pgmap v6391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:18 smithi156 ceph-mon[32679]: pgmap v6391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10914.443109 secs 2024-04-26T21:20:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10217.417813 secs 2024-04-26T21:20:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10914.443109 secs 2024-04-26T21:20:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10217.417813 secs 2024-04-26T21:20:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10914.443109 secs 2024-04-26T21:20:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10217.417813 secs 2024-04-26T21:20:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:20 smithi092 ceph-mon[29156]: pgmap v6392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:20 smithi189 ceph-mon[32756]: pgmap v6392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:20 smithi156 ceph-mon[32679]: pgmap v6392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:22.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:22 smithi092 ceph-mon[29156]: pgmap v6393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:22 smithi189 ceph-mon[32756]: pgmap v6393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:22 smithi156 ceph-mon[32679]: pgmap v6393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:24.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:24 smithi156 ceph-mon[32679]: pgmap v6394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:24.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10919.443222 secs 2024-04-26T21:20:24.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10222.417925 secs 2024-04-26T21:20:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:24 smithi092 ceph-mon[29156]: pgmap v6394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10919.443222 secs 2024-04-26T21:20:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10222.417925 secs 2024-04-26T21:20:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:24 smithi189 ceph-mon[32756]: pgmap v6394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10919.443222 secs 2024-04-26T21:20:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10222.417925 secs 2024-04-26T21:20:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:26 smithi092 ceph-mon[29156]: pgmap v6395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:26 smithi189 ceph-mon[32756]: pgmap v6395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:26 smithi156 ceph-mon[32679]: pgmap v6395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:28 smithi092 ceph-mon[29156]: pgmap v6396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:28 smithi189 ceph-mon[32756]: pgmap v6396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:28 smithi156 ceph-mon[32679]: pgmap v6396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10924.443337 secs 2024-04-26T21:20:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10227.418026 secs 2024-04-26T21:20:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10924.443337 secs 2024-04-26T21:20:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10227.418026 secs 2024-04-26T21:20:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10924.443337 secs 2024-04-26T21:20:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10227.418026 secs 2024-04-26T21:20:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:30 smithi092 ceph-mon[29156]: pgmap v6397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:30 smithi189 ceph-mon[32756]: pgmap v6397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:30 smithi156 ceph-mon[32679]: pgmap v6397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:32 smithi092 ceph-mon[29156]: pgmap v6398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:32 smithi189 ceph-mon[32756]: pgmap v6398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:32 smithi156 ceph-mon[32679]: pgmap v6398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:34 smithi092 ceph-mon[29156]: pgmap v6399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10929.443436 secs 2024-04-26T21:20:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10232.418147 secs 2024-04-26T21:20:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:34 smithi189 ceph-mon[32756]: pgmap v6399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10929.443436 secs 2024-04-26T21:20:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10232.418147 secs 2024-04-26T21:20:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:34 smithi156 ceph-mon[32679]: pgmap v6399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10929.443436 secs 2024-04-26T21:20:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10232.418147 secs 2024-04-26T21:20:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:36 smithi092 ceph-mon[29156]: pgmap v6400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:36 smithi189 ceph-mon[32756]: pgmap v6400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:36 smithi156 ceph-mon[32679]: pgmap v6400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:38 smithi092 ceph-mon[29156]: pgmap v6401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:38 smithi189 ceph-mon[32756]: pgmap v6401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:38 smithi156 ceph-mon[32679]: pgmap v6401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10934.443552 secs 2024-04-26T21:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10237.418266 secs 2024-04-26T21:20:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10934.443552 secs 2024-04-26T21:20:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10237.418266 secs 2024-04-26T21:20:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10934.443552 secs 2024-04-26T21:20:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10237.418266 secs 2024-04-26T21:20:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:40 smithi189 ceph-mon[32756]: pgmap v6402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:40 smithi156 ceph-mon[32679]: pgmap v6402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:40 smithi092 ceph-mon[29156]: pgmap v6402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:41 smithi189 ceph-mon[32756]: pgmap v6403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:41 smithi156 ceph-mon[32679]: pgmap v6403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:41 smithi092 ceph-mon[29156]: pgmap v6403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:43 smithi189 ceph-mon[32756]: pgmap v6404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:43 smithi156 ceph-mon[32679]: pgmap v6404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:43 smithi092 ceph-mon[29156]: pgmap v6404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:44.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10939.443664 secs 2024-04-26T21:20:44.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10242.418407 secs 2024-04-26T21:20:44.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10939.443664 secs 2024-04-26T21:20:44.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10242.418407 secs 2024-04-26T21:20:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10939.443664 secs 2024-04-26T21:20:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10242.418407 secs 2024-04-26T21:20:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:45 smithi189 ceph-mon[32756]: pgmap v6405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:45 smithi156 ceph-mon[32679]: pgmap v6405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:45 smithi092 ceph-mon[29156]: pgmap v6405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:47 smithi189 ceph-mon[32756]: pgmap v6406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:47 smithi156 ceph-mon[32679]: pgmap v6406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:47 smithi092 ceph-mon[29156]: pgmap v6406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10944.443779 secs 2024-04-26T21:20:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:49 smithi189 ceph-mon[32756]: pgmap v6407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10247.418520 secs 2024-04-26T21:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10944.443779 secs 2024-04-26T21:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:49 smithi156 ceph-mon[32679]: pgmap v6407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10247.418520 secs 2024-04-26T21:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10944.443779 secs 2024-04-26T21:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:49 smithi092 ceph-mon[29156]: pgmap v6407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10247.418520 secs 2024-04-26T21:20:51.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:51 smithi092 ceph-mon[29156]: pgmap v6408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:51 smithi189 ceph-mon[32756]: pgmap v6408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:51 smithi156 ceph-mon[32679]: pgmap v6408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:20:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:53 smithi189 ceph-mon[32756]: pgmap v6409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:53 smithi156 ceph-mon[32679]: pgmap v6409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:53 smithi092 ceph-mon[29156]: pgmap v6409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:54.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10949.443891 secs 2024-04-26T21:20:54.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10252.418590 secs 2024-04-26T21:20:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10949.443891 secs 2024-04-26T21:20:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10252.418590 secs 2024-04-26T21:20:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10949.443891 secs 2024-04-26T21:20:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10252.418590 secs 2024-04-26T21:20:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:55 smithi189 ceph-mon[32756]: pgmap v6410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:55 smithi156 ceph-mon[32679]: pgmap v6410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:55 smithi092 ceph-mon[29156]: pgmap v6410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:20:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:57 smithi189 ceph-mon[32756]: pgmap v6411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:57 smithi156 ceph-mon[32679]: pgmap v6411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:57 smithi092 ceph-mon[29156]: pgmap v6411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10954.443956 secs 2024-04-26T21:20:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:59 smithi189 ceph-mon[32756]: pgmap v6412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:20:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10257.418671 secs 2024-04-26T21:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10954.443956 secs 2024-04-26T21:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:59 smithi156 ceph-mon[32679]: pgmap v6412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:20:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10257.418671 secs 2024-04-26T21:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10954.443956 secs 2024-04-26T21:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:59 smithi092 ceph-mon[29156]: pgmap v6412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:20:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10257.418671 secs 2024-04-26T21:21:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: pgmap v6413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: pgmap v6414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:21:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: pgmap v6415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: pgmap v6413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: pgmap v6414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:21:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: pgmap v6415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:21:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: pgmap v6413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:21:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:21:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:21:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: pgmap v6414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:21:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: pgmap v6415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:21:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:03 smithi189 ceph-mon[32756]: pgmap v6416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:21:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:03 smithi156 ceph-mon[32679]: pgmap v6416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:21:03.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-mon[29156]: pgmap v6416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:21:03.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:21:03.727+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:21:03.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:21:03.727+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:21:03.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:21:03.727+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:21:03.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:21:03.727+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:21:03.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:21:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:21:03.727+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:21:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10959.444074 secs 2024-04-26T21:21:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10262.418756 secs 2024-04-26T21:21:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10959.444074 secs 2024-04-26T21:21:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10262.418756 secs 2024-04-26T21:21:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10959.444074 secs 2024-04-26T21:21:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10262.418756 secs 2024-04-26T21:21:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:05 smithi189 ceph-mon[32756]: pgmap v6417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:05 smithi156 ceph-mon[32679]: pgmap v6417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:05 smithi092 ceph-mon[29156]: pgmap v6417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:07 smithi189 ceph-mon[32756]: pgmap v6418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:07 smithi156 ceph-mon[32679]: pgmap v6418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:07 smithi092 ceph-mon[29156]: pgmap v6418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:21:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10964.444184 secs 2024-04-26T21:21:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10964.444184 secs 2024-04-26T21:21:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10964.444184 secs 2024-04-26T21:21:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10267.418895 secs 2024-04-26T21:21:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:09 smithi092 ceph-mon[29156]: pgmap v6419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T21:21:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10267.418895 secs 2024-04-26T21:21:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:09 smithi189 ceph-mon[32756]: pgmap v6419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T21:21:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10267.418895 secs 2024-04-26T21:21:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:09 smithi156 ceph-mon[32679]: pgmap v6419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T21:21:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:11 smithi189 ceph-mon[32756]: pgmap v6420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T21:21:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:11 smithi156 ceph-mon[32679]: pgmap v6420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T21:21:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:11 smithi092 ceph-mon[29156]: pgmap v6420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T21:21:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:13 smithi189 ceph-mon[32756]: pgmap v6421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:13 smithi156 ceph-mon[32679]: pgmap v6421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:13 smithi092 ceph-mon[29156]: pgmap v6421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10969.444307 secs 2024-04-26T21:21:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10272.419019 secs 2024-04-26T21:21:14.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10969.444307 secs 2024-04-26T21:21:14.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10272.419019 secs 2024-04-26T21:21:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10969.444307 secs 2024-04-26T21:21:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10272.419019 secs 2024-04-26T21:21:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:15 smithi189 ceph-mon[32756]: pgmap v6422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:15 smithi156 ceph-mon[32679]: pgmap v6422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:15 smithi092 ceph-mon[29156]: pgmap v6422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:17 smithi189 ceph-mon[32756]: pgmap v6423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:17 smithi156 ceph-mon[32679]: pgmap v6423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:17 smithi092 ceph-mon[29156]: pgmap v6423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:21:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10974.444384 secs 2024-04-26T21:21:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10974.444384 secs 2024-04-26T21:21:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10974.444384 secs 2024-04-26T21:21:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10277.419122 secs 2024-04-26T21:21:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:19 smithi092 ceph-mon[29156]: pgmap v6424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10277.419122 secs 2024-04-26T21:21:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:19 smithi189 ceph-mon[32756]: pgmap v6424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10277.419122 secs 2024-04-26T21:21:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:19 smithi156 ceph-mon[32679]: pgmap v6424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:21:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:21 smithi189 ceph-mon[32756]: pgmap v6425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:21 smithi156 ceph-mon[32679]: pgmap v6425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:21 smithi092 ceph-mon[29156]: pgmap v6425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:23 smithi189 ceph-mon[32756]: pgmap v6426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:23 smithi156 ceph-mon[32679]: pgmap v6426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:23 smithi092 ceph-mon[29156]: pgmap v6426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:24.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10979.444517 secs 2024-04-26T21:21:24.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10282.419239 secs 2024-04-26T21:21:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10979.444517 secs 2024-04-26T21:21:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10282.419239 secs 2024-04-26T21:21:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10979.444517 secs 2024-04-26T21:21:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10282.419239 secs 2024-04-26T21:21:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:25 smithi189 ceph-mon[32756]: pgmap v6427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:25 smithi156 ceph-mon[32679]: pgmap v6427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:25 smithi092 ceph-mon[29156]: pgmap v6427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:27 smithi189 ceph-mon[32756]: pgmap v6428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:27 smithi156 ceph-mon[32679]: pgmap v6428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:27 smithi092 ceph-mon[29156]: pgmap v6428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10984.444656 secs 2024-04-26T21:21:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10984.444656 secs 2024-04-26T21:21:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10984.444656 secs 2024-04-26T21:21:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10287.419364 secs 2024-04-26T21:21:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:29 smithi092 ceph-mon[29156]: pgmap v6429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10287.419364 secs 2024-04-26T21:21:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:29 smithi189 ceph-mon[32756]: pgmap v6429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10287.419364 secs 2024-04-26T21:21:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:29 smithi156 ceph-mon[32679]: pgmap v6429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:31 smithi189 ceph-mon[32756]: pgmap v6430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:31 smithi156 ceph-mon[32679]: pgmap v6430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:31 smithi092 ceph-mon[29156]: pgmap v6430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:33 smithi189 ceph-mon[32756]: pgmap v6431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:33 smithi156 ceph-mon[32679]: pgmap v6431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:33 smithi092 ceph-mon[29156]: pgmap v6431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10989.444792 secs 2024-04-26T21:21:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10292.419490 secs 2024-04-26T21:21:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10989.444792 secs 2024-04-26T21:21:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10292.419490 secs 2024-04-26T21:21:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10989.444792 secs 2024-04-26T21:21:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10292.419490 secs 2024-04-26T21:21:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:35 smithi189 ceph-mon[32756]: pgmap v6432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:35 smithi156 ceph-mon[32679]: pgmap v6432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:35 smithi092 ceph-mon[29156]: pgmap v6432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:21:37.483+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:21:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:21:37.483+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:21:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:21:37.484+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:21:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:21:37.484+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 88 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:21:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:37 smithi189 ceph-mon[32756]: pgmap v6433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:37 smithi156 ceph-mon[32679]: pgmap v6433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:37 smithi092 ceph-mon[29156]: pgmap v6433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10994.444900 secs 2024-04-26T21:21:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10994.444900 secs 2024-04-26T21:21:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10994.444900 secs 2024-04-26T21:21:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10297.419608 secs 2024-04-26T21:21:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:39 smithi092 ceph-mon[29156]: pgmap v6434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10297.419608 secs 2024-04-26T21:21:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:39 smithi189 ceph-mon[32756]: pgmap v6434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10297.419608 secs 2024-04-26T21:21:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:39 smithi156 ceph-mon[32679]: pgmap v6434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:41 smithi189 ceph-mon[32756]: pgmap v6435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:41 smithi156 ceph-mon[32679]: pgmap v6435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:41 smithi092 ceph-mon[29156]: pgmap v6435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:43 smithi189 ceph-mon[32756]: pgmap v6436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:43 smithi156 ceph-mon[32679]: pgmap v6436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:43 smithi092 ceph-mon[29156]: pgmap v6436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 10999.445002 secs 2024-04-26T21:21:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10302.419710 secs 2024-04-26T21:21:44.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 10999.445002 secs 2024-04-26T21:21:44.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10302.419710 secs 2024-04-26T21:21:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 10999.445002 secs 2024-04-26T21:21:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10302.419710 secs 2024-04-26T21:21:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:45 smithi189 ceph-mon[32756]: pgmap v6437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:45 smithi156 ceph-mon[32679]: pgmap v6437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:45 smithi092 ceph-mon[29156]: pgmap v6437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:47 smithi189 ceph-mon[32756]: pgmap v6438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:47 smithi156 ceph-mon[32679]: pgmap v6438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:47 smithi092 ceph-mon[29156]: pgmap v6438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11004.445122 secs 2024-04-26T21:21:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11004.445122 secs 2024-04-26T21:21:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11004.445122 secs 2024-04-26T21:21:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10307.419831 secs 2024-04-26T21:21:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:49 smithi092 ceph-mon[29156]: pgmap v6439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10307.419831 secs 2024-04-26T21:21:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:49 smithi189 ceph-mon[32756]: pgmap v6439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10307.419831 secs 2024-04-26T21:21:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:49 smithi156 ceph-mon[32679]: pgmap v6439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:51 smithi189 ceph-mon[32756]: pgmap v6440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:51 smithi156 ceph-mon[32679]: pgmap v6440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:51 smithi092 ceph-mon[29156]: pgmap v6440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:53 smithi189 ceph-mon[32756]: pgmap v6441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:53 smithi156 ceph-mon[32679]: pgmap v6441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:53 smithi092 ceph-mon[29156]: pgmap v6441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:54.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11009.445242 secs 2024-04-26T21:21:54.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10312.419952 secs 2024-04-26T21:21:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11009.445242 secs 2024-04-26T21:21:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10312.419952 secs 2024-04-26T21:21:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11009.445242 secs 2024-04-26T21:21:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10312.419952 secs 2024-04-26T21:21:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:55 smithi189 ceph-mon[32756]: pgmap v6442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:55 smithi156 ceph-mon[32679]: pgmap v6442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:55 smithi092 ceph-mon[29156]: pgmap v6442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:21:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:57 smithi189 ceph-mon[32756]: pgmap v6443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:57 smithi156 ceph-mon[32679]: pgmap v6443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:57 smithi092 ceph-mon[29156]: pgmap v6443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:21:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11014.445359 secs 2024-04-26T21:21:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11014.445359 secs 2024-04-26T21:21:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11014.445359 secs 2024-04-26T21:22:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10317.420025 secs 2024-04-26T21:22:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:21:59 smithi092 ceph-mon[29156]: pgmap v6444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10317.420025 secs 2024-04-26T21:22:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:21:59 smithi189 ceph-mon[32756]: pgmap v6444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10317.420025 secs 2024-04-26T21:22:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:21:59 smithi156 ceph-mon[32679]: pgmap v6444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:01 smithi189 ceph-mon[32756]: pgmap v6445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:01 smithi156 ceph-mon[32679]: pgmap v6445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:01 smithi092 ceph-mon[29156]: pgmap v6445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: pgmap v6446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:22:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: pgmap v6447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:22:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: pgmap v6446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: pgmap v6447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:02.826 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:22:02.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:22:02.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:22:02.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:22:02.827 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: pgmap v6446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:22:02.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: pgmap v6447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:02.828 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:22:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11019.445492 secs 2024-04-26T21:22:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11019.445492 secs 2024-04-26T21:22:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11019.445492 secs 2024-04-26T21:22:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10322.420144 secs 2024-04-26T21:22:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:04 smithi092 ceph-mon[29156]: pgmap v6448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10322.420144 secs 2024-04-26T21:22:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:04 smithi189 ceph-mon[32756]: pgmap v6448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10322.420144 secs 2024-04-26T21:22:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:04 smithi156 ceph-mon[32679]: pgmap v6448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:07 smithi189 ceph-mon[32756]: pgmap v6449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:07 smithi156 ceph-mon[32679]: pgmap v6449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:07 smithi092 ceph-mon[29156]: pgmap v6449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:09 smithi189 ceph-mon[32756]: pgmap v6450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:22:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11024.445613 secs 2024-04-26T21:22:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10327.420262 secs 2024-04-26T21:22:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:09 smithi156 ceph-mon[32679]: pgmap v6450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:22:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11024.445613 secs 2024-04-26T21:22:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10327.420262 secs 2024-04-26T21:22:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:09 smithi092 ceph-mon[29156]: pgmap v6450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:22:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11024.445613 secs 2024-04-26T21:22:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10327.420262 secs 2024-04-26T21:22:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:11 smithi189 ceph-mon[32756]: pgmap v6451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:11 smithi156 ceph-mon[32679]: pgmap v6451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:11 smithi092 ceph-mon[29156]: pgmap v6451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:22:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:13 smithi189 ceph-mon[32756]: pgmap v6452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:22:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:13 smithi156 ceph-mon[32679]: pgmap v6452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:22:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:13 smithi092 ceph-mon[29156]: pgmap v6452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:22:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11029.445724 secs 2024-04-26T21:22:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10332.420379 secs 2024-04-26T21:22:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11029.445724 secs 2024-04-26T21:22:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10332.420379 secs 2024-04-26T21:22:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11029.445724 secs 2024-04-26T21:22:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10332.420379 secs 2024-04-26T21:22:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:15 smithi189 ceph-mon[32756]: pgmap v6453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:15 smithi156 ceph-mon[32679]: pgmap v6453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:15 smithi092 ceph-mon[29156]: pgmap v6453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:17 smithi189 ceph-mon[32756]: pgmap v6454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:17 smithi156 ceph-mon[32679]: pgmap v6454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:17 smithi092 ceph-mon[29156]: pgmap v6454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:19 smithi189 ceph-mon[32756]: pgmap v6455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11034.445855 secs 2024-04-26T21:22:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10337.420499 secs 2024-04-26T21:22:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:19 smithi156 ceph-mon[32679]: pgmap v6455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11034.445855 secs 2024-04-26T21:22:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10337.420499 secs 2024-04-26T21:22:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:19 smithi092 ceph-mon[29156]: pgmap v6455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11034.445855 secs 2024-04-26T21:22:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10337.420499 secs 2024-04-26T21:22:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:21 smithi189 ceph-mon[32756]: pgmap v6456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:21 smithi156 ceph-mon[32679]: pgmap v6456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:21 smithi092 ceph-mon[29156]: pgmap v6456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:23 smithi189 ceph-mon[32756]: pgmap v6457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:23 smithi156 ceph-mon[32679]: pgmap v6457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:23 smithi092 ceph-mon[29156]: pgmap v6457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11039.445897 secs 2024-04-26T21:22:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10342.420605 secs 2024-04-26T21:22:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11039.445897 secs 2024-04-26T21:22:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10342.420605 secs 2024-04-26T21:22:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11039.445897 secs 2024-04-26T21:22:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10342.420605 secs 2024-04-26T21:22:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:25 smithi189 ceph-mon[32756]: pgmap v6458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:25 smithi156 ceph-mon[32679]: pgmap v6458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:25 smithi092 ceph-mon[29156]: pgmap v6458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:27 smithi189 ceph-mon[32756]: pgmap v6459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:27 smithi156 ceph-mon[32679]: pgmap v6459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:27 smithi092 ceph-mon[29156]: pgmap v6459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:29 smithi189 ceph-mon[32756]: pgmap v6460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11044.445988 secs 2024-04-26T21:22:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10347.420671 secs 2024-04-26T21:22:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:29 smithi156 ceph-mon[32679]: pgmap v6460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11044.445988 secs 2024-04-26T21:22:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10347.420671 secs 2024-04-26T21:22:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:29 smithi092 ceph-mon[29156]: pgmap v6460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11044.445988 secs 2024-04-26T21:22:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10347.420671 secs 2024-04-26T21:22:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:31 smithi189 ceph-mon[32756]: pgmap v6461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:31 smithi156 ceph-mon[32679]: pgmap v6461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:31 smithi092 ceph-mon[29156]: pgmap v6461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:33 smithi189 ceph-mon[32756]: pgmap v6462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:33.471 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:33 smithi156 ceph-mon[32679]: pgmap v6462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:33 smithi092 ceph-mon[29156]: pgmap v6462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11049.446142 secs 2024-04-26T21:22:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10352.420779 secs 2024-04-26T21:22:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11049.446142 secs 2024-04-26T21:22:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10352.420779 secs 2024-04-26T21:22:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11049.446142 secs 2024-04-26T21:22:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10352.420779 secs 2024-04-26T21:22:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:35 smithi189 ceph-mon[32756]: pgmap v6463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:35 smithi156 ceph-mon[32679]: pgmap v6463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:35 smithi092 ceph-mon[29156]: pgmap v6463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:37 smithi189 ceph-mon[32756]: pgmap v6464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:37 smithi156 ceph-mon[32679]: pgmap v6464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:37 smithi092 ceph-mon[29156]: pgmap v6464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:39 smithi189 ceph-mon[32756]: pgmap v6465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11054.446234 secs 2024-04-26T21:22:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10357.420874 secs 2024-04-26T21:22:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:39 smithi156 ceph-mon[32679]: pgmap v6465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11054.446234 secs 2024-04-26T21:22:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10357.420874 secs 2024-04-26T21:22:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:39 smithi092 ceph-mon[29156]: pgmap v6465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11054.446234 secs 2024-04-26T21:22:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10357.420874 secs 2024-04-26T21:22:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:41 smithi189 ceph-mon[32756]: pgmap v6466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:41 smithi156 ceph-mon[32679]: pgmap v6466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:41 smithi092 ceph-mon[29156]: pgmap v6466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:43 smithi189 ceph-mon[32756]: pgmap v6467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:43 smithi156 ceph-mon[32679]: pgmap v6467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:43 smithi092 ceph-mon[29156]: pgmap v6467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11059.446355 secs 2024-04-26T21:22:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10362.421009 secs 2024-04-26T21:22:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11059.446355 secs 2024-04-26T21:22:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10362.421009 secs 2024-04-26T21:22:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11059.446355 secs 2024-04-26T21:22:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10362.421009 secs 2024-04-26T21:22:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:45 smithi156 ceph-mon[32679]: pgmap v6468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:45 smithi092 ceph-mon[29156]: pgmap v6468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:45 smithi189 ceph-mon[32756]: pgmap v6468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:47 smithi156 ceph-mon[32679]: pgmap v6469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:47 smithi092 ceph-mon[29156]: pgmap v6469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:47 smithi189 ceph-mon[32756]: pgmap v6469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:49 smithi156 ceph-mon[32679]: pgmap v6470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11064.446475 secs 2024-04-26T21:22:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10367.421125 secs 2024-04-26T21:22:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:49 smithi092 ceph-mon[29156]: pgmap v6470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11064.446475 secs 2024-04-26T21:22:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10367.421125 secs 2024-04-26T21:22:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:49 smithi189 ceph-mon[32756]: pgmap v6470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11064.446475 secs 2024-04-26T21:22:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10367.421125 secs 2024-04-26T21:22:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:51 smithi156 ceph-mon[32679]: pgmap v6471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:51 smithi092 ceph-mon[29156]: pgmap v6471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:51 smithi189 ceph-mon[32756]: pgmap v6471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:53 smithi156 ceph-mon[32679]: pgmap v6472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:53 smithi092 ceph-mon[29156]: pgmap v6472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:53 smithi189 ceph-mon[32756]: pgmap v6472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11069.446608 secs 2024-04-26T21:22:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10372.421260 secs 2024-04-26T21:22:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11069.446608 secs 2024-04-26T21:22:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10372.421260 secs 2024-04-26T21:22:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11069.446608 secs 2024-04-26T21:22:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10372.421260 secs 2024-04-26T21:22:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:55 smithi156 ceph-mon[32679]: pgmap v6473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:55 smithi092 ceph-mon[29156]: pgmap v6473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:55 smithi189 ceph-mon[32756]: pgmap v6473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:22:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:57 smithi156 ceph-mon[32679]: pgmap v6474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:57 smithi092 ceph-mon[29156]: pgmap v6474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:57 smithi189 ceph-mon[32756]: pgmap v6474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:59 smithi156 ceph-mon[32679]: pgmap v6475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11074.446744 secs 2024-04-26T21:22:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:22:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10377.421315 secs 2024-04-26T21:22:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:59 smithi092 ceph-mon[29156]: pgmap v6475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11074.446744 secs 2024-04-26T21:22:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:22:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10377.421315 secs 2024-04-26T21:22:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:59 smithi189 ceph-mon[32756]: pgmap v6475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:22:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11074.446744 secs 2024-04-26T21:22:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:22:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10377.421315 secs 2024-04-26T21:23:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:01 smithi156 ceph-mon[32679]: pgmap v6476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:01 smithi092 ceph-mon[29156]: pgmap v6476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:01 smithi189 ceph-mon[32756]: pgmap v6476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:23:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:03 smithi092 ceph-mon[29156]: pgmap v6477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:23:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:03 smithi189 ceph-mon[32756]: pgmap v6477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:23:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:03 smithi156 ceph-mon[32679]: pgmap v6477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:23:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:23:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:23:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:04 smithi092 ceph-mon[29156]: pgmap v6478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:23:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:04 smithi092 ceph-mon[29156]: pgmap v6479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11079.446889 secs 2024-04-26T21:23:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10382.421391 secs 2024-04-26T21:23:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:04 smithi189 ceph-mon[32756]: pgmap v6478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:04 smithi189 ceph-mon[32756]: pgmap v6479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11079.446889 secs 2024-04-26T21:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10382.421391 secs 2024-04-26T21:23:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:04 smithi156 ceph-mon[32679]: pgmap v6478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:23:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:04 smithi156 ceph-mon[32679]: pgmap v6479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:23:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11079.446889 secs 2024-04-26T21:23:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10382.421391 secs 2024-04-26T21:23:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:06 smithi092 ceph-mon[29156]: pgmap v6480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:06 smithi189 ceph-mon[32756]: pgmap v6480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:06 smithi156 ceph-mon[32679]: pgmap v6480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:08 smithi092 ceph-mon[29156]: pgmap v6481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:08 smithi189 ceph-mon[32756]: pgmap v6481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:08 smithi156 ceph-mon[32679]: pgmap v6481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11084.446983 secs 2024-04-26T21:23:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10387.421466 secs 2024-04-26T21:23:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11084.446983 secs 2024-04-26T21:23:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10387.421466 secs 2024-04-26T21:23:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11084.446983 secs 2024-04-26T21:23:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10387.421466 secs 2024-04-26T21:23:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:10 smithi092 ceph-mon[29156]: pgmap v6482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:10 smithi189 ceph-mon[32756]: pgmap v6482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:10 smithi156 ceph-mon[32679]: pgmap v6482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:12 smithi092 ceph-mon[29156]: pgmap v6483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:12 smithi189 ceph-mon[32756]: pgmap v6483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:12 smithi156 ceph-mon[32679]: pgmap v6483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:23:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:14 smithi092 ceph-mon[29156]: pgmap v6484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:23:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11089.447091 secs 2024-04-26T21:23:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10392.421599 secs 2024-04-26T21:23:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:14 smithi189 ceph-mon[32756]: pgmap v6484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:23:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11089.447091 secs 2024-04-26T21:23:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10392.421599 secs 2024-04-26T21:23:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:14 smithi156 ceph-mon[32679]: pgmap v6484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:23:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11089.447091 secs 2024-04-26T21:23:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10392.421599 secs 2024-04-26T21:23:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:16 smithi092 ceph-mon[29156]: pgmap v6485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:16 smithi189 ceph-mon[32756]: pgmap v6485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:16 smithi156 ceph-mon[32679]: pgmap v6485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:18 smithi092 ceph-mon[29156]: pgmap v6486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:18 smithi189 ceph-mon[32756]: pgmap v6486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:18 smithi156 ceph-mon[32679]: pgmap v6486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11094.447205 secs 2024-04-26T21:23:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10397.421720 secs 2024-04-26T21:23:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11094.447205 secs 2024-04-26T21:23:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10397.421720 secs 2024-04-26T21:23:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11094.447205 secs 2024-04-26T21:23:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10397.421720 secs 2024-04-26T21:23:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:20 smithi092 ceph-mon[29156]: pgmap v6487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:20 smithi189 ceph-mon[32756]: pgmap v6487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:20 smithi156 ceph-mon[32679]: pgmap v6487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:22 smithi092 ceph-mon[29156]: pgmap v6488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:22 smithi189 ceph-mon[32756]: pgmap v6488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:22 smithi156 ceph-mon[32679]: pgmap v6488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:24.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:24 smithi156 ceph-mon[32679]: pgmap v6489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:24.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11099.447318 secs 2024-04-26T21:23:24.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10402.421839 secs 2024-04-26T21:23:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:24 smithi092 ceph-mon[29156]: pgmap v6489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11099.447318 secs 2024-04-26T21:23:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10402.421839 secs 2024-04-26T21:23:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:24 smithi189 ceph-mon[32756]: pgmap v6489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11099.447318 secs 2024-04-26T21:23:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10402.421839 secs 2024-04-26T21:23:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:26 smithi092 ceph-mon[29156]: pgmap v6490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:26 smithi189 ceph-mon[32756]: pgmap v6490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:26 smithi156 ceph-mon[32679]: pgmap v6490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:28 smithi092 ceph-mon[29156]: pgmap v6491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:28 smithi189 ceph-mon[32756]: pgmap v6491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:28 smithi156 ceph-mon[32679]: pgmap v6491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11104.447371 secs 2024-04-26T21:23:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10407.421975 secs 2024-04-26T21:23:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11104.447371 secs 2024-04-26T21:23:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10407.421975 secs 2024-04-26T21:23:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11104.447371 secs 2024-04-26T21:23:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10407.421975 secs 2024-04-26T21:23:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:30 smithi189 ceph-mon[32756]: pgmap v6492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:30 smithi156 ceph-mon[32679]: pgmap v6492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:30 smithi092 ceph-mon[29156]: pgmap v6492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:32 smithi189 ceph-mon[32756]: pgmap v6493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:32 smithi156 ceph-mon[32679]: pgmap v6493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:32 smithi092 ceph-mon[29156]: pgmap v6493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:34 smithi189 ceph-mon[32756]: pgmap v6494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11109.447515 secs 2024-04-26T21:23:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10412.422100 secs 2024-04-26T21:23:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:34 smithi156 ceph-mon[32679]: pgmap v6494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11109.447515 secs 2024-04-26T21:23:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10412.422100 secs 2024-04-26T21:23:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:34 smithi092 ceph-mon[29156]: pgmap v6494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11109.447515 secs 2024-04-26T21:23:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10412.422100 secs 2024-04-26T21:23:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:36 smithi189 ceph-mon[32756]: pgmap v6495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:36 smithi156 ceph-mon[32679]: pgmap v6495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:36 smithi092 ceph-mon[29156]: pgmap v6495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:38 smithi189 ceph-mon[32756]: pgmap v6496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:38 smithi156 ceph-mon[32679]: pgmap v6496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:38 smithi092 ceph-mon[29156]: pgmap v6496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11114.447589 secs 2024-04-26T21:23:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10417.422239 secs 2024-04-26T21:23:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11114.447589 secs 2024-04-26T21:23:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10417.422239 secs 2024-04-26T21:23:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11114.447589 secs 2024-04-26T21:23:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10417.422239 secs 2024-04-26T21:23:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:40 smithi189 ceph-mon[32756]: pgmap v6497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:40 smithi156 ceph-mon[32679]: pgmap v6497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:40 smithi092 ceph-mon[29156]: pgmap v6497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:42.526 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:42 smithi092 ceph-mon[29156]: pgmap v6498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:42 smithi189 ceph-mon[32756]: pgmap v6498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:42 smithi156 ceph-mon[32679]: pgmap v6498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:44 smithi189 ceph-mon[32756]: pgmap v6499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11119.447702 secs 2024-04-26T21:23:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10422.422375 secs 2024-04-26T21:23:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:44 smithi156 ceph-mon[32679]: pgmap v6499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11119.447702 secs 2024-04-26T21:23:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10422.422375 secs 2024-04-26T21:23:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:44 smithi092 ceph-mon[29156]: pgmap v6499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11119.447702 secs 2024-04-26T21:23:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10422.422375 secs 2024-04-26T21:23:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:45 smithi189 ceph-mon[32756]: pgmap v6500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:45 smithi156 ceph-mon[32679]: pgmap v6500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:45 smithi092 ceph-mon[29156]: pgmap v6500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:47 smithi189 ceph-mon[32756]: pgmap v6501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:47 smithi156 ceph-mon[32679]: pgmap v6501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:47 smithi092 ceph-mon[29156]: pgmap v6501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11124.447835 secs 2024-04-26T21:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10427.422435 secs 2024-04-26T21:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:49 smithi189 ceph-mon[32756]: pgmap v6502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11124.447835 secs 2024-04-26T21:23:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10427.422435 secs 2024-04-26T21:23:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:49 smithi156 ceph-mon[32679]: pgmap v6502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11124.447835 secs 2024-04-26T21:23:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10427.422435 secs 2024-04-26T21:23:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:49 smithi092 ceph-mon[29156]: pgmap v6502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:51 smithi189 ceph-mon[32756]: pgmap v6503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:51 smithi156 ceph-mon[32679]: pgmap v6503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:51 smithi092 ceph-mon[29156]: pgmap v6503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:53 smithi189 ceph-mon[32756]: pgmap v6504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:53 smithi156 ceph-mon[32679]: pgmap v6504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:53 smithi092 ceph-mon[29156]: pgmap v6504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11129.447954 secs 2024-04-26T21:23:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10432.422546 secs 2024-04-26T21:23:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11129.447954 secs 2024-04-26T21:23:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10432.422546 secs 2024-04-26T21:23:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11129.447954 secs 2024-04-26T21:23:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10432.422546 secs 2024-04-26T21:23:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:55 smithi189 ceph-mon[32756]: pgmap v6505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:55 smithi156 ceph-mon[32679]: pgmap v6505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:55 smithi092 ceph-mon[29156]: pgmap v6505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:23:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:57 smithi189 ceph-mon[32756]: pgmap v6506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:57 smithi156 ceph-mon[32679]: pgmap v6506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:23:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:57 smithi092 ceph-mon[29156]: pgmap v6506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11134.448068 secs 2024-04-26T21:24:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10437.422674 secs 2024-04-26T21:24:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:23:59 smithi189 ceph-mon[32756]: pgmap v6507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11134.448068 secs 2024-04-26T21:24:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10437.422674 secs 2024-04-26T21:24:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:23:59 smithi156 ceph-mon[32679]: pgmap v6507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11134.448068 secs 2024-04-26T21:24:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10437.422674 secs 2024-04-26T21:24:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:23:59 smithi092 ceph-mon[29156]: pgmap v6507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:01 smithi189 ceph-mon[32756]: pgmap v6508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:01 smithi156 ceph-mon[32679]: pgmap v6508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:01 smithi092 ceph-mon[29156]: pgmap v6508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: pgmap v6509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11139.448141 secs 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 10442.422740 secs 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: pgmap v6509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11139.448141 secs 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.502 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.503 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 10442.422740 secs 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: pgmap v6509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11139.448141 secs 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 10442.422740 secs 2024-04-26T21:24:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: pgmap v6510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: pgmap v6510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: pgmap v6510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:24:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:24:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:24:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:24:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:24:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:08 smithi092 ceph-mon[29156]: pgmap v6511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:08.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:08 smithi092 ceph-mon[29156]: pgmap v6512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:24:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:08 smithi189 ceph-mon[32756]: pgmap v6511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:08 smithi189 ceph-mon[32756]: pgmap v6512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:24:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:24:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:08 smithi156 ceph-mon[32679]: pgmap v6511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:08 smithi156 ceph-mon[32679]: pgmap v6512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11144.448264 secs 2024-04-26T21:24:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:09 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 10447.422855 secs 2024-04-26T21:24:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:09 smithi189 ceph-mon[32756]: slow request 184.834010 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:24:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11144.448264 secs 2024-04-26T21:24:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:09 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 10447.422855 secs 2024-04-26T21:24:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:09 smithi156 ceph-mon[32679]: slow request 184.834010 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:24:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11144.448264 secs 2024-04-26T21:24:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:09 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 10447.422855 secs 2024-04-26T21:24:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:09 smithi092 ceph-mon[29156]: slow request 184.834010 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:24:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:10 smithi189 ceph-mon[32756]: pgmap v6513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:10 smithi156 ceph-mon[32679]: pgmap v6513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:10 smithi092 ceph-mon[29156]: pgmap v6513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:12 smithi189 ceph-mon[32756]: pgmap v6514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:12 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:24:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:12 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:24:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:12 smithi156 ceph-mon[32679]: pgmap v6514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:12 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:24:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:12 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:24:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:12 smithi092 ceph-mon[29156]: pgmap v6514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:12 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:24:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:12 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:24:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:14 smithi189 ceph-mon[32756]: pgmap v6515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11149.448329 secs 2024-04-26T21:24:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10452.422926 secs 2024-04-26T21:24:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:14 smithi156 ceph-mon[32679]: pgmap v6515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11149.448329 secs 2024-04-26T21:24:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10452.422926 secs 2024-04-26T21:24:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:14 smithi092 ceph-mon[29156]: pgmap v6515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T21:24:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11149.448329 secs 2024-04-26T21:24:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10452.422926 secs 2024-04-26T21:24:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:16 smithi189 ceph-mon[32756]: pgmap v6516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:16 smithi156 ceph-mon[32679]: pgmap v6516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:16 smithi092 ceph-mon[29156]: pgmap v6516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:18 smithi189 ceph-mon[32756]: pgmap v6517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:18 smithi156 ceph-mon[32679]: pgmap v6517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:18 smithi092 ceph-mon[29156]: pgmap v6517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:24:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11154.448387 secs 2024-04-26T21:24:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10457.423059 secs 2024-04-26T21:24:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11154.448387 secs 2024-04-26T21:24:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10457.423059 secs 2024-04-26T21:24:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11154.448387 secs 2024-04-26T21:24:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10457.423059 secs 2024-04-26T21:24:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:20 smithi189 ceph-mon[32756]: pgmap v6518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:20 smithi156 ceph-mon[32679]: pgmap v6518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:20 smithi092 ceph-mon[29156]: pgmap v6518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:22 smithi189 ceph-mon[32756]: pgmap v6519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:22 smithi156 ceph-mon[32679]: pgmap v6519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:22 smithi092 ceph-mon[29156]: pgmap v6519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:24 smithi189 ceph-mon[32756]: pgmap v6520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11159.448500 secs 2024-04-26T21:24:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10462.423146 secs 2024-04-26T21:24:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:24 smithi156 ceph-mon[32679]: pgmap v6520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11159.448500 secs 2024-04-26T21:24:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10462.423146 secs 2024-04-26T21:24:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:24 smithi092 ceph-mon[29156]: pgmap v6520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11159.448500 secs 2024-04-26T21:24:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10462.423146 secs 2024-04-26T21:24:25.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:25 smithi156 ceph-mon[32679]: pgmap v6521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:25 smithi189 ceph-mon[32756]: pgmap v6521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:25 smithi092 ceph-mon[29156]: pgmap v6521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:27 smithi189 ceph-mon[32756]: pgmap v6522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:27 smithi156 ceph-mon[32679]: pgmap v6522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:27 smithi092 ceph-mon[29156]: pgmap v6522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11164.448638 secs 2024-04-26T21:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10467.423287 secs 2024-04-26T21:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:29 smithi092 ceph-mon[29156]: pgmap v6523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11164.448638 secs 2024-04-26T21:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10467.423287 secs 2024-04-26T21:24:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:29 smithi189 ceph-mon[32756]: pgmap v6523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11164.448638 secs 2024-04-26T21:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10467.423287 secs 2024-04-26T21:24:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:29 smithi156 ceph-mon[32679]: pgmap v6523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:31 smithi189 ceph-mon[32756]: pgmap v6524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:31 smithi156 ceph-mon[32679]: pgmap v6524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:31 smithi092 ceph-mon[29156]: pgmap v6524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:34 smithi092 ceph-mon[29156]: pgmap v6525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11169.448757 secs 2024-04-26T21:24:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10472.423402 secs 2024-04-26T21:24:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:34 smithi189 ceph-mon[32756]: pgmap v6525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11169.448757 secs 2024-04-26T21:24:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10472.423402 secs 2024-04-26T21:24:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:34 smithi156 ceph-mon[32679]: pgmap v6525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11169.448757 secs 2024-04-26T21:24:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10472.423402 secs 2024-04-26T21:24:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:36 smithi092 ceph-mon[29156]: pgmap v6526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:36 smithi189 ceph-mon[32756]: pgmap v6526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:36 smithi156 ceph-mon[32679]: pgmap v6526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:24:37.507+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:24:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:24:37.507+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:24:37.508 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:24:37.507+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:24:37.509 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:24:37.507+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 89 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:24:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:38 smithi092 ceph-mon[29156]: pgmap v6527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:38 smithi189 ceph-mon[32756]: pgmap v6527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:38 smithi156 ceph-mon[32679]: pgmap v6527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11174.448899 secs 2024-04-26T21:24:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10477.423480 secs 2024-04-26T21:24:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11174.448899 secs 2024-04-26T21:24:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10477.423480 secs 2024-04-26T21:24:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11174.448899 secs 2024-04-26T21:24:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10477.423480 secs 2024-04-26T21:24:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:40 smithi189 ceph-mon[32756]: pgmap v6528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:40 smithi156 ceph-mon[32679]: pgmap v6528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:40 smithi092 ceph-mon[29156]: pgmap v6528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:42 smithi189 ceph-mon[32756]: pgmap v6529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:42 smithi156 ceph-mon[32679]: pgmap v6529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:42 smithi092 ceph-mon[29156]: pgmap v6529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:44.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:44 smithi092 ceph-mon[29156]: pgmap v6530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:44.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11179.449015 secs 2024-04-26T21:24:44.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10482.423544 secs 2024-04-26T21:24:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:44 smithi189 ceph-mon[32756]: pgmap v6530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11179.449015 secs 2024-04-26T21:24:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10482.423544 secs 2024-04-26T21:24:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:44 smithi156 ceph-mon[32679]: pgmap v6530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11179.449015 secs 2024-04-26T21:24:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10482.423544 secs 2024-04-26T21:24:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:46 smithi189 ceph-mon[32756]: pgmap v6531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:46 smithi156 ceph-mon[32679]: pgmap v6531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:46 smithi092 ceph-mon[29156]: pgmap v6531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:48 smithi189 ceph-mon[32756]: pgmap v6532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:48 smithi156 ceph-mon[32679]: pgmap v6532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:48 smithi092 ceph-mon[29156]: pgmap v6532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11184.449111 secs 2024-04-26T21:24:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10487.423888 secs 2024-04-26T21:24:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11184.449111 secs 2024-04-26T21:24:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10487.423888 secs 2024-04-26T21:24:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11184.449111 secs 2024-04-26T21:24:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10487.423888 secs 2024-04-26T21:24:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:50 smithi189 ceph-mon[32756]: pgmap v6533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:50 smithi156 ceph-mon[32679]: pgmap v6533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:50 smithi092 ceph-mon[29156]: pgmap v6533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:51 smithi189 ceph-mon[32756]: pgmap v6534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:51 smithi156 ceph-mon[32679]: pgmap v6534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:51 smithi092 ceph-mon[29156]: pgmap v6534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:53 smithi189 ceph-mon[32756]: pgmap v6535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:53 smithi156 ceph-mon[32679]: pgmap v6535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:53 smithi092 ceph-mon[29156]: pgmap v6535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:55.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11189.449225 secs 2024-04-26T21:24:55.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10492.423993 secs 2024-04-26T21:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11189.449225 secs 2024-04-26T21:24:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10492.423993 secs 2024-04-26T21:24:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11189.449225 secs 2024-04-26T21:24:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10492.423993 secs 2024-04-26T21:24:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:55 smithi189 ceph-mon[32756]: pgmap v6536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:55 smithi156 ceph-mon[32679]: pgmap v6536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:55 smithi092 ceph-mon[29156]: pgmap v6536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:24:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:57 smithi189 ceph-mon[32756]: pgmap v6537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:57 smithi156 ceph-mon[32679]: pgmap v6537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:24:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:57 smithi092 ceph-mon[29156]: pgmap v6537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11194.449369 secs 2024-04-26T21:25:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10497.424098 secs 2024-04-26T21:25:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:24:59 smithi189 ceph-mon[32756]: pgmap v6538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11194.449369 secs 2024-04-26T21:25:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10497.424098 secs 2024-04-26T21:25:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:24:59 smithi156 ceph-mon[32679]: pgmap v6538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11194.449369 secs 2024-04-26T21:25:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10497.424098 secs 2024-04-26T21:25:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:24:59 smithi092 ceph-mon[29156]: pgmap v6538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:01 smithi189 ceph-mon[32756]: pgmap v6539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:01 smithi156 ceph-mon[32679]: pgmap v6539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:01 smithi092 ceph-mon[29156]: pgmap v6539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:03 smithi189 ceph-mon[32756]: pgmap v6540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:03 smithi156 ceph-mon[32679]: pgmap v6540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:03 smithi092 ceph-mon[29156]: pgmap v6540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11199.449505 secs 2024-04-26T21:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:04 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 10502.424231 secs 2024-04-26T21:25:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:04 smithi189 ceph-mon[32756]: slow request 5761.167590 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11199.449505 secs 2024-04-26T21:25:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:04 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 10502.424231 secs 2024-04-26T21:25:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:04 smithi156 ceph-mon[32679]: slow request 5761.167590 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11199.449505 secs 2024-04-26T21:25:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:04 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 10502.424231 secs 2024-04-26T21:25:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:04 smithi092 ceph-mon[29156]: slow request 5761.167590 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:25:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:05 smithi189 ceph-mon[32756]: pgmap v6541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:05 smithi156 ceph-mon[32679]: pgmap v6541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:05 smithi092 ceph-mon[29156]: pgmap v6541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:25:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:07 smithi189 ceph-mon[32756]: pgmap v6542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:25:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:07 smithi156 ceph-mon[32679]: pgmap v6542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:25:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:07 smithi092 ceph-mon[29156]: pgmap v6542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:25:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:25:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:25:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:25:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:25:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:08 smithi189 ceph-mon[32756]: pgmap v6543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:25:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:08 smithi189 ceph-mon[32756]: pgmap v6544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:08 smithi156 ceph-mon[32679]: pgmap v6543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:25:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:08 smithi156 ceph-mon[32679]: pgmap v6544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:08 smithi092 ceph-mon[29156]: pgmap v6543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:25:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:08 smithi092 ceph-mon[29156]: pgmap v6544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11204.449592 secs 2024-04-26T21:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10507.424353 secs 2024-04-26T21:25:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11204.449592 secs 2024-04-26T21:25:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10507.424353 secs 2024-04-26T21:25:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11204.449592 secs 2024-04-26T21:25:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10507.424353 secs 2024-04-26T21:25:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:10 smithi189 ceph-mon[32756]: pgmap v6545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:10 smithi156 ceph-mon[32679]: pgmap v6545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:10 smithi092 ceph-mon[29156]: pgmap v6545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:12 smithi189 ceph-mon[32756]: pgmap v6546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:12 smithi156 ceph-mon[32679]: pgmap v6546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:12 smithi092 ceph-mon[29156]: pgmap v6546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11209.449724 secs 2024-04-26T21:25:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:14 smithi189 ceph-mon[32756]: pgmap v6547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10512.424487 secs 2024-04-26T21:25:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11209.449724 secs 2024-04-26T21:25:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:14 smithi156 ceph-mon[32679]: pgmap v6547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10512.424487 secs 2024-04-26T21:25:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11209.449724 secs 2024-04-26T21:25:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:14 smithi092 ceph-mon[29156]: pgmap v6547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:25:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10512.424487 secs 2024-04-26T21:25:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:16 smithi092 ceph-mon[29156]: pgmap v6548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:16 smithi189 ceph-mon[32756]: pgmap v6548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:16 smithi156 ceph-mon[32679]: pgmap v6548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:25:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:18 smithi189 ceph-mon[32756]: pgmap v6549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:25:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:18 smithi156 ceph-mon[32679]: pgmap v6549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:25:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:18 smithi092 ceph-mon[29156]: pgmap v6549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:25:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11214.449845 secs 2024-04-26T21:25:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10517.424631 secs 2024-04-26T21:25:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11214.449845 secs 2024-04-26T21:25:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10517.424631 secs 2024-04-26T21:25:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11214.449845 secs 2024-04-26T21:25:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10517.424631 secs 2024-04-26T21:25:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:20 smithi189 ceph-mon[32756]: pgmap v6550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:20 smithi156 ceph-mon[32679]: pgmap v6550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:20 smithi092 ceph-mon[29156]: pgmap v6550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:22 smithi189 ceph-mon[32756]: pgmap v6551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:22 smithi156 ceph-mon[32679]: pgmap v6551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:22 smithi092 ceph-mon[29156]: pgmap v6551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11219.449937 secs 2024-04-26T21:25:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:24 smithi189 ceph-mon[32756]: pgmap v6552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10522.424752 secs 2024-04-26T21:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11219.449937 secs 2024-04-26T21:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:24 smithi156 ceph-mon[32679]: pgmap v6552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10522.424752 secs 2024-04-26T21:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11219.449937 secs 2024-04-26T21:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:24 smithi092 ceph-mon[29156]: pgmap v6552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10522.424752 secs 2024-04-26T21:25:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:26 smithi189 ceph-mon[32756]: pgmap v6553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:26 smithi156 ceph-mon[32679]: pgmap v6553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:26 smithi092 ceph-mon[29156]: pgmap v6553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:28 smithi189 ceph-mon[32756]: pgmap v6554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:28 smithi156 ceph-mon[32679]: pgmap v6554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:28 smithi092 ceph-mon[29156]: pgmap v6554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11224.450050 secs 2024-04-26T21:25:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10527.424832 secs 2024-04-26T21:25:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11224.450050 secs 2024-04-26T21:25:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10527.424832 secs 2024-04-26T21:25:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11224.450050 secs 2024-04-26T21:25:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10527.424832 secs 2024-04-26T21:25:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:30 smithi189 ceph-mon[32756]: pgmap v6555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:30 smithi156 ceph-mon[32679]: pgmap v6555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:30 smithi092 ceph-mon[29156]: pgmap v6555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:32 smithi092 ceph-mon[29156]: pgmap v6556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:32 smithi189 ceph-mon[32756]: pgmap v6556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:32 smithi156 ceph-mon[32679]: pgmap v6556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11229.450170 secs 2024-04-26T21:25:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:34 smithi189 ceph-mon[32756]: pgmap v6557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10532.424961 secs 2024-04-26T21:25:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11229.450170 secs 2024-04-26T21:25:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:34 smithi156 ceph-mon[32679]: pgmap v6557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10532.424961 secs 2024-04-26T21:25:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11229.450170 secs 2024-04-26T21:25:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:34 smithi092 ceph-mon[29156]: pgmap v6557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10532.424961 secs 2024-04-26T21:25:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:36 smithi189 ceph-mon[32756]: pgmap v6558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:36 smithi156 ceph-mon[32679]: pgmap v6558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:36 smithi092 ceph-mon[29156]: pgmap v6558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:38 smithi189 ceph-mon[32756]: pgmap v6559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:38 smithi156 ceph-mon[32679]: pgmap v6559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:38 smithi092 ceph-mon[29156]: pgmap v6559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11234.450248 secs 2024-04-26T21:25:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10537.425069 secs 2024-04-26T21:25:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11234.450248 secs 2024-04-26T21:25:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10537.425069 secs 2024-04-26T21:25:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11234.450248 secs 2024-04-26T21:25:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10537.425069 secs 2024-04-26T21:25:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:40 smithi189 ceph-mon[32756]: pgmap v6560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:40 smithi156 ceph-mon[32679]: pgmap v6560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:40 smithi092 ceph-mon[29156]: pgmap v6560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:42 smithi189 ceph-mon[32756]: pgmap v6561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:42 smithi156 ceph-mon[32679]: pgmap v6561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:42 smithi092 ceph-mon[29156]: pgmap v6561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11239.450320 secs 2024-04-26T21:25:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:44 smithi189 ceph-mon[32756]: pgmap v6562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10542.425188 secs 2024-04-26T21:25:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11239.450320 secs 2024-04-26T21:25:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:44 smithi156 ceph-mon[32679]: pgmap v6562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10542.425188 secs 2024-04-26T21:25:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11239.450320 secs 2024-04-26T21:25:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:44 smithi092 ceph-mon[29156]: pgmap v6562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10542.425188 secs 2024-04-26T21:25:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:46 smithi189 ceph-mon[32756]: pgmap v6563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:46 smithi156 ceph-mon[32679]: pgmap v6563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:46 smithi092 ceph-mon[29156]: pgmap v6563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:49.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:48 smithi189 ceph-mon[32756]: pgmap v6564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:48 smithi156 ceph-mon[32679]: pgmap v6564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:48 smithi092 ceph-mon[29156]: pgmap v6564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11244.450435 secs 2024-04-26T21:25:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10547.425324 secs 2024-04-26T21:25:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11244.450435 secs 2024-04-26T21:25:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10547.425324 secs 2024-04-26T21:25:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11244.450435 secs 2024-04-26T21:25:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10547.425324 secs 2024-04-26T21:25:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:50 smithi189 ceph-mon[32756]: pgmap v6565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:50 smithi156 ceph-mon[32679]: pgmap v6565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:50 smithi092 ceph-mon[29156]: pgmap v6565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:52 smithi189 ceph-mon[32756]: pgmap v6566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:52 smithi156 ceph-mon[32679]: pgmap v6566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:52 smithi092 ceph-mon[29156]: pgmap v6566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11249.450557 secs 2024-04-26T21:25:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:54 smithi156 ceph-mon[32679]: pgmap v6567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10552.425440 secs 2024-04-26T21:25:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11249.450557 secs 2024-04-26T21:25:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:54 smithi092 ceph-mon[29156]: pgmap v6567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10552.425440 secs 2024-04-26T21:25:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11249.450557 secs 2024-04-26T21:25:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:54 smithi189 ceph-mon[32756]: pgmap v6567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10552.425440 secs 2024-04-26T21:25:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:56 smithi156 ceph-mon[32679]: pgmap v6568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:56 smithi092 ceph-mon[29156]: pgmap v6568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:56 smithi189 ceph-mon[32756]: pgmap v6568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:25:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:58 smithi156 ceph-mon[32679]: pgmap v6569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:58 smithi092 ceph-mon[29156]: pgmap v6569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:25:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:58 smithi189 ceph-mon[32756]: pgmap v6569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11254.450666 secs 2024-04-26T21:26:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:25:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10557.425550 secs 2024-04-26T21:26:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11254.450666 secs 2024-04-26T21:26:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:25:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10557.425550 secs 2024-04-26T21:26:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11254.450666 secs 2024-04-26T21:26:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:25:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10557.425550 secs 2024-04-26T21:26:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:00 smithi156 ceph-mon[32679]: pgmap v6570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:00 smithi092 ceph-mon[29156]: pgmap v6570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:00 smithi189 ceph-mon[32756]: pgmap v6570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:02 smithi156 ceph-mon[32679]: pgmap v6571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:02 smithi092 ceph-mon[29156]: pgmap v6571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:02 smithi189 ceph-mon[32756]: pgmap v6571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:04.146 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:26:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:26:03.832+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:26:04.146 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:26:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:26:03.832+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:26:04.146 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:26:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:26:03.832+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:26:04.146 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:26:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:26:03.832+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:26:04.146 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:26:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:26:03.832+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:26:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11259.450780 secs 2024-04-26T21:26:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:04 smithi156 ceph-mon[32679]: pgmap v6572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10562.425673 secs 2024-04-26T21:26:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11259.450780 secs 2024-04-26T21:26:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:04 smithi092 ceph-mon[29156]: pgmap v6572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10562.425673 secs 2024-04-26T21:26:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11259.450780 secs 2024-04-26T21:26:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:04 smithi189 ceph-mon[32756]: pgmap v6572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10562.425673 secs 2024-04-26T21:26:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:06 smithi156 ceph-mon[32679]: pgmap v6573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:06 smithi092 ceph-mon[29156]: pgmap v6573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:06 smithi189 ceph-mon[32756]: pgmap v6573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:26:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:26:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:08 smithi156 ceph-mon[32679]: pgmap v6574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:26:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:08 smithi092 ceph-mon[29156]: pgmap v6574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:26:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:08 smithi189 ceph-mon[32756]: pgmap v6574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:26:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:26:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:26:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:26:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:09 smithi156 ceph-mon[32679]: pgmap v6575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:26:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:09 smithi156 ceph-mon[32679]: pgmap v6576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11264.450882 secs 2024-04-26T21:26:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10567.425789 secs 2024-04-26T21:26:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:09 smithi092 ceph-mon[29156]: pgmap v6575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:26:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:09 smithi092 ceph-mon[29156]: pgmap v6576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11264.450882 secs 2024-04-26T21:26:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10567.425789 secs 2024-04-26T21:26:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:09 smithi189 ceph-mon[32756]: pgmap v6575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:26:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:09 smithi189 ceph-mon[32756]: pgmap v6576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:26:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11264.450882 secs 2024-04-26T21:26:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10567.425789 secs 2024-04-26T21:26:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:11 smithi156 ceph-mon[32679]: pgmap v6577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:11 smithi092 ceph-mon[29156]: pgmap v6577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:11 smithi189 ceph-mon[32756]: pgmap v6577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:13 smithi156 ceph-mon[32679]: pgmap v6578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:14.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:13 smithi189 ceph-mon[32756]: pgmap v6578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:13 smithi092 ceph-mon[29156]: pgmap v6578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11269.451027 secs 2024-04-26T21:26:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10572.425869 secs 2024-04-26T21:26:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11269.451027 secs 2024-04-26T21:26:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10572.425869 secs 2024-04-26T21:26:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11269.451027 secs 2024-04-26T21:26:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10572.425869 secs 2024-04-26T21:26:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:15 smithi092 ceph-mon[29156]: pgmap v6579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:15 smithi189 ceph-mon[32756]: pgmap v6579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:15 smithi156 ceph-mon[32679]: pgmap v6579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:17 smithi092 ceph-mon[29156]: pgmap v6580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:18.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:17 smithi189 ceph-mon[32756]: pgmap v6580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:17 smithi156 ceph-mon[32679]: pgmap v6580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T21:26:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11274.451136 secs 2024-04-26T21:26:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11274.451136 secs 2024-04-26T21:26:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11274.451136 secs 2024-04-26T21:26:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:19 smithi092 ceph-mon[29156]: pgmap v6581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T21:26:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10577.425977 secs 2024-04-26T21:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:19 smithi189 ceph-mon[32756]: pgmap v6581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T21:26:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10577.425977 secs 2024-04-26T21:26:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:19 smithi156 ceph-mon[32679]: pgmap v6581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-26T21:26:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10577.425977 secs 2024-04-26T21:26:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:21 smithi092 ceph-mon[29156]: pgmap v6582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:26:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:21 smithi189 ceph-mon[32756]: pgmap v6582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:26:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:21 smithi156 ceph-mon[32679]: pgmap v6582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T21:26:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:23 smithi092 ceph-mon[29156]: pgmap v6583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11279.451258 secs 2024-04-26T21:26:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:23 smithi189 ceph-mon[32756]: pgmap v6583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11279.451258 secs 2024-04-26T21:26:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:23 smithi156 ceph-mon[32679]: pgmap v6583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11279.451258 secs 2024-04-26T21:26:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10582.426051 secs 2024-04-26T21:26:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10582.426051 secs 2024-04-26T21:26:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10582.426051 secs 2024-04-26T21:26:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:25 smithi092 ceph-mon[29156]: pgmap v6584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:26.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:25 smithi156 ceph-mon[32679]: pgmap v6584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:25 smithi189 ceph-mon[32756]: pgmap v6584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:27 smithi092 ceph-mon[29156]: pgmap v6585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:27 smithi189 ceph-mon[32756]: pgmap v6585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:27 smithi156 ceph-mon[32679]: pgmap v6585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11284.451372 secs 2024-04-26T21:26:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11284.451372 secs 2024-04-26T21:26:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11284.451372 secs 2024-04-26T21:26:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:29 smithi092 ceph-mon[29156]: pgmap v6586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10587.426190 secs 2024-04-26T21:26:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:29 smithi189 ceph-mon[32756]: pgmap v6586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10587.426190 secs 2024-04-26T21:26:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:29 smithi156 ceph-mon[32679]: pgmap v6586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10587.426190 secs 2024-04-26T21:26:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:31 smithi092 ceph-mon[29156]: pgmap v6587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:31 smithi189 ceph-mon[32756]: pgmap v6587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:31 smithi156 ceph-mon[32679]: pgmap v6587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:33 smithi092 ceph-mon[29156]: pgmap v6588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11289.451481 secs 2024-04-26T21:26:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:33 smithi189 ceph-mon[32756]: pgmap v6588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11289.451481 secs 2024-04-26T21:26:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:33 smithi156 ceph-mon[32679]: pgmap v6588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11289.451481 secs 2024-04-26T21:26:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10592.426336 secs 2024-04-26T21:26:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10592.426336 secs 2024-04-26T21:26:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10592.426336 secs 2024-04-26T21:26:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:35 smithi092 ceph-mon[29156]: pgmap v6589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:35 smithi189 ceph-mon[32756]: pgmap v6589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:35 smithi156 ceph-mon[32679]: pgmap v6589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:37 smithi092 ceph-mon[29156]: pgmap v6590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:37 smithi189 ceph-mon[32756]: pgmap v6590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:37 smithi156 ceph-mon[32679]: pgmap v6590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11294.451567 secs 2024-04-26T21:26:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11294.451567 secs 2024-04-26T21:26:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11294.451567 secs 2024-04-26T21:26:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:40 smithi189 ceph-mon[32756]: pgmap v6591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:40 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10597.426427 secs 2024-04-26T21:26:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:40 smithi156 ceph-mon[32679]: pgmap v6591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:40 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10597.426427 secs 2024-04-26T21:26:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:39 smithi092 ceph-mon[29156]: pgmap v6591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10597.426427 secs 2024-04-26T21:26:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:42 smithi189 ceph-mon[32756]: pgmap v6592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:42 smithi156 ceph-mon[32679]: pgmap v6592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:42 smithi092 ceph-mon[29156]: pgmap v6592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:44 smithi189 ceph-mon[32756]: pgmap v6593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11299.451702 secs 2024-04-26T21:26:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10602.426567 secs 2024-04-26T21:26:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:44 smithi156 ceph-mon[32679]: pgmap v6593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11299.451702 secs 2024-04-26T21:26:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10602.426567 secs 2024-04-26T21:26:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:44 smithi092 ceph-mon[29156]: pgmap v6593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11299.451702 secs 2024-04-26T21:26:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10602.426567 secs 2024-04-26T21:26:46.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:46 smithi092 ceph-mon[29156]: pgmap v6594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:46 smithi189 ceph-mon[32756]: pgmap v6594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:46 smithi156 ceph-mon[32679]: pgmap v6594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:48 smithi189 ceph-mon[32756]: pgmap v6595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:48 smithi156 ceph-mon[32679]: pgmap v6595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:48 smithi092 ceph-mon[29156]: pgmap v6595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11304.451848 secs 2024-04-26T21:26:49.451 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10607.426670 secs 2024-04-26T21:26:49.452 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11304.451848 secs 2024-04-26T21:26:49.452 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10607.426670 secs 2024-04-26T21:26:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11304.451848 secs 2024-04-26T21:26:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10607.426670 secs 2024-04-26T21:26:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:50 smithi092 ceph-mon[29156]: pgmap v6596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:50 smithi189 ceph-mon[32756]: pgmap v6596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:50 smithi156 ceph-mon[32679]: pgmap v6596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:52 smithi189 ceph-mon[32756]: pgmap v6597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:52 smithi156 ceph-mon[32679]: pgmap v6597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:52 smithi092 ceph-mon[29156]: pgmap v6597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:54 smithi189 ceph-mon[32756]: pgmap v6598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11309.451967 secs 2024-04-26T21:26:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10612.426747 secs 2024-04-26T21:26:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:54 smithi156 ceph-mon[32679]: pgmap v6598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11309.451967 secs 2024-04-26T21:26:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10612.426747 secs 2024-04-26T21:26:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:54 smithi092 ceph-mon[29156]: pgmap v6598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11309.451967 secs 2024-04-26T21:26:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10612.426747 secs 2024-04-26T21:26:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:56 smithi189 ceph-mon[32756]: pgmap v6599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:56 smithi156 ceph-mon[32679]: pgmap v6599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:56 smithi092 ceph-mon[29156]: pgmap v6599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:26:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:58 smithi189 ceph-mon[32756]: pgmap v6600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:58 smithi156 ceph-mon[32679]: pgmap v6600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:58 smithi092 ceph-mon[29156]: pgmap v6600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:26:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11314.452030 secs 2024-04-26T21:26:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:26:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10617.426881 secs 2024-04-26T21:26:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11314.452030 secs 2024-04-26T21:26:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:26:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10617.426881 secs 2024-04-26T21:26:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11314.452030 secs 2024-04-26T21:26:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:26:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10617.426881 secs 2024-04-26T21:27:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:00 smithi189 ceph-mon[32756]: pgmap v6601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:00 smithi156 ceph-mon[32679]: pgmap v6601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:00 smithi092 ceph-mon[29156]: pgmap v6601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:02 smithi189 ceph-mon[32756]: pgmap v6602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:02 smithi156 ceph-mon[32679]: pgmap v6602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:02 smithi092 ceph-mon[29156]: pgmap v6602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:04 smithi189 ceph-mon[32756]: pgmap v6603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11319.452173 secs 2024-04-26T21:27:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10622.427019 secs 2024-04-26T21:27:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:04 smithi156 ceph-mon[32679]: pgmap v6603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11319.452173 secs 2024-04-26T21:27:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10622.427019 secs 2024-04-26T21:27:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:04 smithi092 ceph-mon[29156]: pgmap v6603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11319.452173 secs 2024-04-26T21:27:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10622.427019 secs 2024-04-26T21:27:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:06 smithi189 ceph-mon[32756]: pgmap v6604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:06 smithi156 ceph-mon[32679]: pgmap v6604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:06 smithi092 ceph-mon[29156]: pgmap v6604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:08 smithi189 ceph-mon[32756]: pgmap v6605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:08 smithi156 ceph-mon[32679]: pgmap v6605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:08 smithi092 ceph-mon[29156]: pgmap v6605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11324.452229 secs 2024-04-26T21:27:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:09 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 10627.427106 secs 2024-04-26T21:27:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:09 smithi189 ceph-mon[32756]: slow request 364.838261 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:27:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11324.452229 secs 2024-04-26T21:27:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:09 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 10627.427106 secs 2024-04-26T21:27:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:09 smithi156 ceph-mon[32679]: slow request 364.838261 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:27:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11324.452229 secs 2024-04-26T21:27:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:27:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:09 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 10627.427106 secs 2024-04-26T21:27:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:09 smithi092 ceph-mon[29156]: slow request 364.838261 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:27:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: pgmap v6606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: pgmap v6607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: pgmap v6608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: pgmap v6606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: pgmap v6607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: pgmap v6608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: pgmap v6606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: pgmap v6607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: pgmap v6608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:27:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:12 smithi189 ceph-mon[32756]: pgmap v6609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:12 smithi156 ceph-mon[32679]: pgmap v6609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:12 smithi092 ceph-mon[29156]: pgmap v6609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:27:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:14 smithi189 ceph-mon[32756]: pgmap v6610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:27:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11329.452328 secs 2024-04-26T21:27:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10632.427229 secs 2024-04-26T21:27:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:14 smithi156 ceph-mon[32679]: pgmap v6610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:27:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11329.452328 secs 2024-04-26T21:27:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10632.427229 secs 2024-04-26T21:27:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:14 smithi092 ceph-mon[29156]: pgmap v6610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:27:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11329.452328 secs 2024-04-26T21:27:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10632.427229 secs 2024-04-26T21:27:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:16 smithi189 ceph-mon[32756]: pgmap v6611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:16 smithi156 ceph-mon[32679]: pgmap v6611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:16 smithi092 ceph-mon[29156]: pgmap v6611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:18 smithi189 ceph-mon[32756]: pgmap v6612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:18 smithi156 ceph-mon[32679]: pgmap v6612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:18 smithi092 ceph-mon[29156]: pgmap v6612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:27:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11334.452463 secs 2024-04-26T21:27:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10637.427355 secs 2024-04-26T21:27:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11334.452463 secs 2024-04-26T21:27:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10637.427355 secs 2024-04-26T21:27:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11334.452463 secs 2024-04-26T21:27:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10637.427355 secs 2024-04-26T21:27:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:20 smithi156 ceph-mon[32679]: pgmap v6613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:27:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:20 smithi092 ceph-mon[29156]: pgmap v6613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:27:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:20 smithi189 ceph-mon[32756]: pgmap v6613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:27:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:22 smithi156 ceph-mon[32679]: pgmap v6614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:22 smithi092 ceph-mon[29156]: pgmap v6614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:22 smithi189 ceph-mon[32756]: pgmap v6614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:24 smithi156 ceph-mon[32679]: pgmap v6615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11339.452591 secs 2024-04-26T21:27:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10642.427434 secs 2024-04-26T21:27:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:24 smithi092 ceph-mon[29156]: pgmap v6615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11339.452591 secs 2024-04-26T21:27:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10642.427434 secs 2024-04-26T21:27:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:24 smithi189 ceph-mon[32756]: pgmap v6615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11339.452591 secs 2024-04-26T21:27:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10642.427434 secs 2024-04-26T21:27:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:26 smithi156 ceph-mon[32679]: pgmap v6616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:26 smithi092 ceph-mon[29156]: pgmap v6616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:26 smithi189 ceph-mon[32756]: pgmap v6616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:28 smithi156 ceph-mon[32679]: pgmap v6617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:28 smithi092 ceph-mon[29156]: pgmap v6617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:28 smithi189 ceph-mon[32756]: pgmap v6617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11344.452705 secs 2024-04-26T21:27:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10647.427506 secs 2024-04-26T21:27:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11344.452705 secs 2024-04-26T21:27:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10647.427506 secs 2024-04-26T21:27:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11344.452705 secs 2024-04-26T21:27:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10647.427506 secs 2024-04-26T21:27:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:30 smithi156 ceph-mon[32679]: pgmap v6618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:30 smithi092 ceph-mon[29156]: pgmap v6618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:30 smithi189 ceph-mon[32756]: pgmap v6618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:32 smithi156 ceph-mon[32679]: pgmap v6619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:32 smithi092 ceph-mon[29156]: pgmap v6619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:32 smithi189 ceph-mon[32756]: pgmap v6619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:34 smithi156 ceph-mon[32679]: pgmap v6620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11349.452849 secs 2024-04-26T21:27:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10652.427574 secs 2024-04-26T21:27:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:34 smithi092 ceph-mon[29156]: pgmap v6620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11349.452849 secs 2024-04-26T21:27:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10652.427574 secs 2024-04-26T21:27:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:34 smithi189 ceph-mon[32756]: pgmap v6620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11349.452849 secs 2024-04-26T21:27:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10652.427574 secs 2024-04-26T21:27:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:36 smithi156 ceph-mon[32679]: pgmap v6621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:36 smithi092 ceph-mon[29156]: pgmap v6621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:36 smithi189 ceph-mon[32756]: pgmap v6621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:27:37.531+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:27:37.531 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:27:37.531+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:27:37.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:27:37.531+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:27:37.532 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:27:37.531+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 90 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:27:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:38 smithi156 ceph-mon[32679]: pgmap v6622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:38 smithi092 ceph-mon[29156]: pgmap v6622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:38 smithi189 ceph-mon[32756]: pgmap v6622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11354.452964 secs 2024-04-26T21:27:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10657.427686 secs 2024-04-26T21:27:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11354.452964 secs 2024-04-26T21:27:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10657.427686 secs 2024-04-26T21:27:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11354.452964 secs 2024-04-26T21:27:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10657.427686 secs 2024-04-26T21:27:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:40 smithi092 ceph-mon[29156]: pgmap v6623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:40 smithi189 ceph-mon[32756]: pgmap v6623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:40 smithi156 ceph-mon[32679]: pgmap v6623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:42 smithi092 ceph-mon[29156]: pgmap v6624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:42 smithi189 ceph-mon[32756]: pgmap v6624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:42 smithi156 ceph-mon[32679]: pgmap v6624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:44 smithi092 ceph-mon[29156]: pgmap v6625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11359.453091 secs 2024-04-26T21:27:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10662.427796 secs 2024-04-26T21:27:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:44 smithi189 ceph-mon[32756]: pgmap v6625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11359.453091 secs 2024-04-26T21:27:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10662.427796 secs 2024-04-26T21:27:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:44 smithi156 ceph-mon[32679]: pgmap v6625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11359.453091 secs 2024-04-26T21:27:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10662.427796 secs 2024-04-26T21:27:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:46 smithi092 ceph-mon[29156]: pgmap v6626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:46 smithi189 ceph-mon[32756]: pgmap v6626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:46 smithi156 ceph-mon[32679]: pgmap v6626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:48 smithi092 ceph-mon[29156]: pgmap v6627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:48 smithi189 ceph-mon[32756]: pgmap v6627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:48 smithi156 ceph-mon[32679]: pgmap v6627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11364.453201 secs 2024-04-26T21:27:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10667.427858 secs 2024-04-26T21:27:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11364.453201 secs 2024-04-26T21:27:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10667.427858 secs 2024-04-26T21:27:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11364.453201 secs 2024-04-26T21:27:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10667.427858 secs 2024-04-26T21:27:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:50 smithi092 ceph-mon[29156]: pgmap v6628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:50 smithi189 ceph-mon[32756]: pgmap v6628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:50 smithi156 ceph-mon[32679]: pgmap v6628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:52 smithi092 ceph-mon[29156]: pgmap v6629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:52 smithi189 ceph-mon[32756]: pgmap v6629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:52 smithi156 ceph-mon[32679]: pgmap v6629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:54 smithi092 ceph-mon[29156]: pgmap v6630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11369.453319 secs 2024-04-26T21:27:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10672.428002 secs 2024-04-26T21:27:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:54 smithi189 ceph-mon[32756]: pgmap v6630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11369.453319 secs 2024-04-26T21:27:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10672.428002 secs 2024-04-26T21:27:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:54 smithi156 ceph-mon[32679]: pgmap v6630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11369.453319 secs 2024-04-26T21:27:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10672.428002 secs 2024-04-26T21:27:56.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:56 smithi156 ceph-mon[32679]: pgmap v6631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:56 smithi092 ceph-mon[29156]: pgmap v6631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:56 smithi189 ceph-mon[32756]: pgmap v6631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:27:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:58 smithi092 ceph-mon[29156]: pgmap v6632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:58 smithi189 ceph-mon[32756]: pgmap v6632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:58 smithi156 ceph-mon[32679]: pgmap v6632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:27:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11374.453456 secs 2024-04-26T21:27:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:27:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10677.428115 secs 2024-04-26T21:27:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11374.453456 secs 2024-04-26T21:27:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:27:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10677.428115 secs 2024-04-26T21:27:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11374.453456 secs 2024-04-26T21:27:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:27:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10677.428115 secs 2024-04-26T21:28:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:00 smithi092 ceph-mon[29156]: pgmap v6633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:00 smithi189 ceph-mon[32756]: pgmap v6633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:00 smithi156 ceph-mon[32679]: pgmap v6633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:02 smithi092 ceph-mon[29156]: pgmap v6634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:02 smithi189 ceph-mon[32756]: pgmap v6634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:02 smithi156 ceph-mon[32679]: pgmap v6634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:04 smithi092 ceph-mon[29156]: pgmap v6635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11379.453591 secs 2024-04-26T21:28:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10682.428250 secs 2024-04-26T21:28:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:04 smithi189 ceph-mon[32756]: pgmap v6635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11379.453591 secs 2024-04-26T21:28:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10682.428250 secs 2024-04-26T21:28:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:04 smithi156 ceph-mon[32679]: pgmap v6635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11379.453591 secs 2024-04-26T21:28:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10682.428250 secs 2024-04-26T21:28:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:06 smithi092 ceph-mon[29156]: pgmap v6636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:06 smithi189 ceph-mon[32756]: pgmap v6636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:06 smithi156 ceph-mon[32679]: pgmap v6636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:08 smithi189 ceph-mon[32756]: pgmap v6637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:08 smithi156 ceph-mon[32679]: pgmap v6637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:08 smithi092 ceph-mon[29156]: pgmap v6637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11384.453715 secs 2024-04-26T21:28:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10687.428370 secs 2024-04-26T21:28:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11384.453715 secs 2024-04-26T21:28:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10687.428370 secs 2024-04-26T21:28:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11384.453715 secs 2024-04-26T21:28:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10687.428370 secs 2024-04-26T21:28:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:28:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:10 smithi189 ceph-mon[32756]: pgmap v6638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:28:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:10 smithi156 ceph-mon[32679]: pgmap v6638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:28:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:10 smithi092 ceph-mon[29156]: pgmap v6638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:28:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:28:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:28:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:11 smithi189 ceph-mon[32756]: pgmap v6639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:28:11.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:11 smithi189 ceph-mon[32756]: pgmap v6640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:11 smithi156 ceph-mon[32679]: pgmap v6639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:28:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:11 smithi156 ceph-mon[32679]: pgmap v6640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:11 smithi092 ceph-mon[29156]: pgmap v6639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:28:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:11 smithi092 ceph-mon[29156]: pgmap v6640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:13 smithi189 ceph-mon[32756]: pgmap v6641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:13 smithi156 ceph-mon[32679]: pgmap v6641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:13 smithi092 ceph-mon[29156]: pgmap v6641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11389.453852 secs 2024-04-26T21:28:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10692.428479 secs 2024-04-26T21:28:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11389.453852 secs 2024-04-26T21:28:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10692.428479 secs 2024-04-26T21:28:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11389.453852 secs 2024-04-26T21:28:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10692.428479 secs 2024-04-26T21:28:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:15 smithi189 ceph-mon[32756]: pgmap v6642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:15 smithi156 ceph-mon[32679]: pgmap v6642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:15 smithi092 ceph-mon[29156]: pgmap v6642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:17 smithi189 ceph-mon[32756]: pgmap v6643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:17 smithi156 ceph-mon[32679]: pgmap v6643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:17 smithi092 ceph-mon[29156]: pgmap v6643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:28:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:19 smithi189 ceph-mon[32756]: pgmap v6644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:28:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11394.453908 secs 2024-04-26T21:28:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10697.428587 secs 2024-04-26T21:28:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:19 smithi156 ceph-mon[32679]: pgmap v6644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:28:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11394.453908 secs 2024-04-26T21:28:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10697.428587 secs 2024-04-26T21:28:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:19 smithi092 ceph-mon[29156]: pgmap v6644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:28:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11394.453908 secs 2024-04-26T21:28:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10697.428587 secs 2024-04-26T21:28:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:20 smithi189 ceph-mon[32756]: pgmap v6645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:28:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:20 smithi156 ceph-mon[32679]: pgmap v6645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:28:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:20 smithi092 ceph-mon[29156]: pgmap v6645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:28:22.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:28:22.536+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:28:22.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:28:22.536+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:28:22.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:28:22.536+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:28:22.539 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:28:22.536+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 91 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:28:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:22 smithi156 ceph-mon[32679]: pgmap v6646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:22 smithi092 ceph-mon[29156]: pgmap v6646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:22 smithi189 ceph-mon[32756]: pgmap v6646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11399.454037 secs 2024-04-26T21:28:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10702.428705 secs 2024-04-26T21:28:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:24 smithi156 ceph-mon[32679]: pgmap v6647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11399.454037 secs 2024-04-26T21:28:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10702.428705 secs 2024-04-26T21:28:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:24 smithi092 ceph-mon[29156]: pgmap v6647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11399.454037 secs 2024-04-26T21:28:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10702.428705 secs 2024-04-26T21:28:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:24 smithi189 ceph-mon[32756]: pgmap v6647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:26 smithi156 ceph-mon[32679]: pgmap v6648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:27.280 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:26 smithi092 ceph-mon[29156]: pgmap v6648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:26 smithi189 ceph-mon[32756]: pgmap v6648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:28 smithi156 ceph-mon[32679]: pgmap v6649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:28 smithi092 ceph-mon[29156]: pgmap v6649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:28 smithi189 ceph-mon[32756]: pgmap v6649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11404.454154 secs 2024-04-26T21:28:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10707.428812 secs 2024-04-26T21:28:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11404.454154 secs 2024-04-26T21:28:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10707.428812 secs 2024-04-26T21:28:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11404.454154 secs 2024-04-26T21:28:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10707.428812 secs 2024-04-26T21:28:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:30 smithi156 ceph-mon[32679]: pgmap v6650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:30 smithi092 ceph-mon[29156]: pgmap v6650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:30 smithi189 ceph-mon[32756]: pgmap v6650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:32 smithi156 ceph-mon[32679]: pgmap v6651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:32 smithi092 ceph-mon[29156]: pgmap v6651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:32 smithi189 ceph-mon[32756]: pgmap v6651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11409.454271 secs 2024-04-26T21:28:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10712.428944 secs 2024-04-26T21:28:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:34 smithi092 ceph-mon[29156]: pgmap v6652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11409.454271 secs 2024-04-26T21:28:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10712.428944 secs 2024-04-26T21:28:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:34 smithi189 ceph-mon[32756]: pgmap v6652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11409.454271 secs 2024-04-26T21:28:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10712.428944 secs 2024-04-26T21:28:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:34 smithi156 ceph-mon[32679]: pgmap v6652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:36 smithi092 ceph-mon[29156]: pgmap v6653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:36 smithi189 ceph-mon[32756]: pgmap v6653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:36 smithi156 ceph-mon[32679]: pgmap v6653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:38 smithi092 ceph-mon[29156]: pgmap v6654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:38 smithi189 ceph-mon[32756]: pgmap v6654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:38 smithi156 ceph-mon[32679]: pgmap v6654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11414.454387 secs 2024-04-26T21:28:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10717.429050 secs 2024-04-26T21:28:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11414.454387 secs 2024-04-26T21:28:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10717.429050 secs 2024-04-26T21:28:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11414.454387 secs 2024-04-26T21:28:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10717.429050 secs 2024-04-26T21:28:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:40 smithi092 ceph-mon[29156]: pgmap v6655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:40 smithi189 ceph-mon[32756]: pgmap v6655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:40 smithi156 ceph-mon[32679]: pgmap v6655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:42 smithi092 ceph-mon[29156]: pgmap v6656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:42 smithi189 ceph-mon[32756]: pgmap v6656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:42 smithi156 ceph-mon[32679]: pgmap v6656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11419.454501 secs 2024-04-26T21:28:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10722.429198 secs 2024-04-26T21:28:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:44 smithi092 ceph-mon[29156]: pgmap v6657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11419.454501 secs 2024-04-26T21:28:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10722.429198 secs 2024-04-26T21:28:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:44 smithi189 ceph-mon[32756]: pgmap v6657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11419.454501 secs 2024-04-26T21:28:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10722.429198 secs 2024-04-26T21:28:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:44 smithi156 ceph-mon[32679]: pgmap v6657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:46 smithi092 ceph-mon[29156]: pgmap v6658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:46 smithi189 ceph-mon[32756]: pgmap v6658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:46 smithi156 ceph-mon[32679]: pgmap v6658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:48 smithi092 ceph-mon[29156]: pgmap v6659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11424.454616 secs 2024-04-26T21:28:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:48 smithi189 ceph-mon[32756]: pgmap v6659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11424.454616 secs 2024-04-26T21:28:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:48 smithi156 ceph-mon[32679]: pgmap v6659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11424.454616 secs 2024-04-26T21:28:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10727.429357 secs 2024-04-26T21:28:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10727.429357 secs 2024-04-26T21:28:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10727.429357 secs 2024-04-26T21:28:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:50 smithi092 ceph-mon[29156]: pgmap v6660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:50 smithi189 ceph-mon[32756]: pgmap v6660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:50 smithi156 ceph-mon[32679]: pgmap v6660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:52 smithi092 ceph-mon[29156]: pgmap v6661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:52 smithi189 ceph-mon[32756]: pgmap v6661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:52 smithi156 ceph-mon[32679]: pgmap v6661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11429.454734 secs 2024-04-26T21:28:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11429.454734 secs 2024-04-26T21:28:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11429.454734 secs 2024-04-26T21:28:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10732.429473 secs 2024-04-26T21:28:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:54 smithi092 ceph-mon[29156]: pgmap v6662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10732.429473 secs 2024-04-26T21:28:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:54 smithi189 ceph-mon[32756]: pgmap v6662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10732.429473 secs 2024-04-26T21:28:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:54 smithi156 ceph-mon[32679]: pgmap v6662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:28:57.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:56 smithi156 ceph-mon[32679]: pgmap v6663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:56 smithi092 ceph-mon[29156]: pgmap v6663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:56 smithi189 ceph-mon[32756]: pgmap v6663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:58 smithi092 ceph-mon[29156]: pgmap v6664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11434.454927 secs 2024-04-26T21:28:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:58 smithi189 ceph-mon[32756]: pgmap v6664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11434.454927 secs 2024-04-26T21:28:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:58 smithi156 ceph-mon[32679]: pgmap v6664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:28:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11434.454927 secs 2024-04-26T21:29:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:28:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10737.429551 secs 2024-04-26T21:29:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:28:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10737.429551 secs 2024-04-26T21:29:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:28:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10737.429551 secs 2024-04-26T21:29:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:00 smithi189 ceph-mon[32756]: pgmap v6665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:00 smithi156 ceph-mon[32679]: pgmap v6665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:00 smithi092 ceph-mon[29156]: pgmap v6665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:02 smithi189 ceph-mon[32756]: pgmap v6666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:02 smithi156 ceph-mon[32679]: pgmap v6666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:02 smithi092 ceph-mon[29156]: pgmap v6666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11439.455045 secs 2024-04-26T21:29:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11439.455045 secs 2024-04-26T21:29:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11439.455045 secs 2024-04-26T21:29:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:05 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 10742.429616 secs 2024-04-26T21:29:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:05 smithi189 ceph-mon[32756]: slow request 1440.065696 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:29:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:05 smithi189 ceph-mon[32756]: pgmap v6667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:05 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 10742.429616 secs 2024-04-26T21:29:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:05 smithi156 ceph-mon[32679]: slow request 1440.065696 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:29:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:05 smithi156 ceph-mon[32679]: pgmap v6667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:05 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 10742.429616 secs 2024-04-26T21:29:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:05 smithi092 ceph-mon[29156]: slow request 1440.065696 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:29:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:05 smithi092 ceph-mon[29156]: pgmap v6667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:07 smithi189 ceph-mon[32756]: pgmap v6668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:07 smithi156 ceph-mon[32679]: pgmap v6668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:07 smithi092 ceph-mon[29156]: pgmap v6668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:09 smithi189 ceph-mon[32756]: pgmap v6669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11444.455122 secs 2024-04-26T21:29:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:09 smithi156 ceph-mon[32679]: pgmap v6669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11444.455122 secs 2024-04-26T21:29:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:09 smithi092 ceph-mon[29156]: pgmap v6669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11444.455122 secs 2024-04-26T21:29:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:10 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10747.429696 secs 2024-04-26T21:29:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:10 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10747.429696 secs 2024-04-26T21:29:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:10 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10747.429696 secs 2024-04-26T21:29:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:29:11.292 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:11 smithi092 ceph-mon[29156]: pgmap v6670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:11.365 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:11 smithi156 ceph-mon[32679]: pgmap v6670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:11 smithi189 ceph-mon[32756]: pgmap v6670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:13 smithi092 ceph-mon[29156]: pgmap v6671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:13.362 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:13 smithi156 ceph-mon[32679]: pgmap v6671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:13 smithi189 ceph-mon[32756]: pgmap v6671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:14.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11449.455193 secs 2024-04-26T21:29:14.360 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10752.429759 secs 2024-04-26T21:29:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11449.455193 secs 2024-04-26T21:29:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10752.429759 secs 2024-04-26T21:29:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11449.455193 secs 2024-04-26T21:29:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10752.429759 secs 2024-04-26T21:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: pgmap v6672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: pgmap v6672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: pgmap v6672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:29:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:29:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:29:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:16 smithi189 ceph-mon[32756]: pgmap v6673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:29:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:16 smithi189 ceph-mon[32756]: pgmap v6674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:16 smithi156 ceph-mon[32679]: pgmap v6673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:29:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:16 smithi156 ceph-mon[32679]: pgmap v6674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:16 smithi092 ceph-mon[29156]: pgmap v6673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:29:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:16 smithi092 ceph-mon[29156]: pgmap v6674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:18 smithi189 ceph-mon[32756]: pgmap v6675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:18 smithi156 ceph-mon[32679]: pgmap v6675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:18 smithi092 ceph-mon[29156]: pgmap v6675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11454.455333 secs 2024-04-26T21:29:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10757.429826 secs 2024-04-26T21:29:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11454.455333 secs 2024-04-26T21:29:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10757.429826 secs 2024-04-26T21:29:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11454.455333 secs 2024-04-26T21:29:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10757.429826 secs 2024-04-26T21:29:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:20 smithi189 ceph-mon[32756]: pgmap v6676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:20 smithi156 ceph-mon[32679]: pgmap v6676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:20 smithi092 ceph-mon[29156]: pgmap v6676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:22 smithi189 ceph-mon[32756]: pgmap v6677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:22 smithi156 ceph-mon[32679]: pgmap v6677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:22 smithi092 ceph-mon[29156]: pgmap v6677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:29:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:24 smithi189 ceph-mon[32756]: pgmap v6678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11459.455446 secs 2024-04-26T21:29:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10762.429945 secs 2024-04-26T21:29:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:24 smithi156 ceph-mon[32679]: pgmap v6678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11459.455446 secs 2024-04-26T21:29:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10762.429945 secs 2024-04-26T21:29:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:24 smithi092 ceph-mon[29156]: pgmap v6678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:29:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11459.455446 secs 2024-04-26T21:29:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10762.429945 secs 2024-04-26T21:29:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:26 smithi189 ceph-mon[32756]: pgmap v6679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:29:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:26 smithi156 ceph-mon[32679]: pgmap v6679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:29:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:26 smithi092 ceph-mon[29156]: pgmap v6679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:29:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:28 smithi189 ceph-mon[32756]: pgmap v6680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:28 smithi156 ceph-mon[32679]: pgmap v6680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:28 smithi092 ceph-mon[29156]: pgmap v6680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11464.455529 secs 2024-04-26T21:29:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10767.430067 secs 2024-04-26T21:29:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11464.455529 secs 2024-04-26T21:29:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10767.430067 secs 2024-04-26T21:29:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11464.455529 secs 2024-04-26T21:29:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10767.430067 secs 2024-04-26T21:29:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:30 smithi189 ceph-mon[32756]: pgmap v6681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:30 smithi156 ceph-mon[32679]: pgmap v6681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:30 smithi092 ceph-mon[29156]: pgmap v6681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:32 smithi189 ceph-mon[32756]: pgmap v6682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:32 smithi156 ceph-mon[32679]: pgmap v6682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:32 smithi092 ceph-mon[29156]: pgmap v6682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:34 smithi189 ceph-mon[32756]: pgmap v6683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11469.455649 secs 2024-04-26T21:29:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10772.430161 secs 2024-04-26T21:29:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:34 smithi156 ceph-mon[32679]: pgmap v6683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11469.455649 secs 2024-04-26T21:29:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10772.430161 secs 2024-04-26T21:29:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:34 smithi092 ceph-mon[29156]: pgmap v6683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11469.455649 secs 2024-04-26T21:29:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10772.430161 secs 2024-04-26T21:29:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:36 smithi189 ceph-mon[32756]: pgmap v6684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:36 smithi156 ceph-mon[32679]: pgmap v6684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:36 smithi092 ceph-mon[29156]: pgmap v6684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:38 smithi189 ceph-mon[32756]: pgmap v6685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:38 smithi156 ceph-mon[32679]: pgmap v6685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:38 smithi092 ceph-mon[29156]: pgmap v6685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11474.455774 secs 2024-04-26T21:29:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10777.430336 secs 2024-04-26T21:29:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11474.455774 secs 2024-04-26T21:29:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10777.430336 secs 2024-04-26T21:29:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11474.455774 secs 2024-04-26T21:29:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10777.430336 secs 2024-04-26T21:29:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:40 smithi189 ceph-mon[32756]: pgmap v6686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:40 smithi156 ceph-mon[32679]: pgmap v6686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:40 smithi092 ceph-mon[29156]: pgmap v6686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:42 smithi189 ceph-mon[32756]: pgmap v6687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:42 smithi156 ceph-mon[32679]: pgmap v6687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:42.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:42 smithi092 ceph-mon[29156]: pgmap v6687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:44 smithi189 ceph-mon[32756]: pgmap v6688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11479.455864 secs 2024-04-26T21:29:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10782.430455 secs 2024-04-26T21:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:44 smithi156 ceph-mon[32679]: pgmap v6688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11479.455864 secs 2024-04-26T21:29:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10782.430455 secs 2024-04-26T21:29:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:44 smithi092 ceph-mon[29156]: pgmap v6688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11479.455864 secs 2024-04-26T21:29:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10782.430455 secs 2024-04-26T21:29:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:46 smithi189 ceph-mon[32756]: pgmap v6689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:46 smithi156 ceph-mon[32679]: pgmap v6689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:46 smithi092 ceph-mon[29156]: pgmap v6689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:48 smithi189 ceph-mon[32756]: pgmap v6690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:48 smithi156 ceph-mon[32679]: pgmap v6690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:48 smithi092 ceph-mon[29156]: pgmap v6690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11484.456006 secs 2024-04-26T21:29:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10787.430587 secs 2024-04-26T21:29:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11484.456006 secs 2024-04-26T21:29:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10787.430587 secs 2024-04-26T21:29:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11484.456006 secs 2024-04-26T21:29:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10787.430587 secs 2024-04-26T21:29:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:50 smithi189 ceph-mon[32756]: pgmap v6691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:50 smithi156 ceph-mon[32679]: pgmap v6691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:50 smithi092 ceph-mon[29156]: pgmap v6691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:52 smithi092 ceph-mon[29156]: pgmap v6692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:52 smithi189 ceph-mon[32756]: pgmap v6692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:52 smithi156 ceph-mon[32679]: pgmap v6692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:54 smithi156 ceph-mon[32679]: pgmap v6693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11489.456120 secs 2024-04-26T21:29:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10792.430720 secs 2024-04-26T21:29:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:54 smithi092 ceph-mon[29156]: pgmap v6693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11489.456120 secs 2024-04-26T21:29:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10792.430720 secs 2024-04-26T21:29:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:54 smithi189 ceph-mon[32756]: pgmap v6693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11489.456120 secs 2024-04-26T21:29:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10792.430720 secs 2024-04-26T21:29:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:56 smithi156 ceph-mon[32679]: pgmap v6694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:56 smithi092 ceph-mon[29156]: pgmap v6694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:56 smithi189 ceph-mon[32756]: pgmap v6694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:29:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:58 smithi156 ceph-mon[32679]: pgmap v6695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:58 smithi092 ceph-mon[29156]: pgmap v6695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:58 smithi189 ceph-mon[32756]: pgmap v6695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:29:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11494.456236 secs 2024-04-26T21:29:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:29:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10797.430839 secs 2024-04-26T21:29:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11494.456236 secs 2024-04-26T21:29:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:29:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10797.430839 secs 2024-04-26T21:29:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11494.456236 secs 2024-04-26T21:29:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:29:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10797.430839 secs 2024-04-26T21:30:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:00 smithi156 ceph-mon[32679]: pgmap v6696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:30:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:00 smithi092 ceph-mon[29156]: pgmap v6696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:00 smithi189 ceph-mon[32756]: pgmap v6696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:30:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:02 smithi156 ceph-mon[32679]: pgmap v6697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:02 smithi092 ceph-mon[29156]: pgmap v6697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:02 smithi189 ceph-mon[32756]: pgmap v6697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:04 smithi156 ceph-mon[32679]: pgmap v6698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11499.456335 secs 2024-04-26T21:30:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10802.430964 secs 2024-04-26T21:30:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:04 smithi092 ceph-mon[29156]: pgmap v6698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11499.456335 secs 2024-04-26T21:30:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10802.430964 secs 2024-04-26T21:30:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:04 smithi189 ceph-mon[32756]: pgmap v6698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11499.456335 secs 2024-04-26T21:30:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10802.430964 secs 2024-04-26T21:30:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:06 smithi156 ceph-mon[32679]: pgmap v6699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:06 smithi092 ceph-mon[29156]: pgmap v6699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:06 smithi189 ceph-mon[32756]: pgmap v6699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:08 smithi156 ceph-mon[32679]: pgmap v6700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:08 smithi092 ceph-mon[29156]: pgmap v6700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:08 smithi189 ceph-mon[32756]: pgmap v6700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11504.456450 secs 2024-04-26T21:30:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10807.431088 secs 2024-04-26T21:30:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11504.456450 secs 2024-04-26T21:30:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10807.431088 secs 2024-04-26T21:30:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11504.456450 secs 2024-04-26T21:30:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10807.431088 secs 2024-04-26T21:30:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:10 smithi156 ceph-mon[32679]: pgmap v6701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:10 smithi092 ceph-mon[29156]: pgmap v6701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:10 smithi189 ceph-mon[32756]: pgmap v6701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:12 smithi156 ceph-mon[32679]: pgmap v6702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:12 smithi092 ceph-mon[29156]: pgmap v6702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:12 smithi189 ceph-mon[32756]: pgmap v6702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:14 smithi156 ceph-mon[32679]: pgmap v6703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11509.456584 secs 2024-04-26T21:30:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10812.431192 secs 2024-04-26T21:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:14 smithi092 ceph-mon[29156]: pgmap v6703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11509.456584 secs 2024-04-26T21:30:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10812.431192 secs 2024-04-26T21:30:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:14 smithi189 ceph-mon[32756]: pgmap v6703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11509.456584 secs 2024-04-26T21:30:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10812.431192 secs 2024-04-26T21:30:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:30:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:16 smithi092 ceph-mon[29156]: pgmap v6704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:16 smithi189 ceph-mon[32756]: pgmap v6704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:16 smithi156 ceph-mon[32679]: pgmap v6704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:18.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:18 smithi189 ceph-mon[32756]: pgmap v6705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:18 smithi092 ceph-mon[29156]: pgmap v6705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:18 smithi156 ceph-mon[32679]: pgmap v6705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11514.456733 secs 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: pgmap v6706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10817.431326 secs 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: pgmap v6707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: pgmap v6708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11514.456733 secs 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: pgmap v6706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10817.431326 secs 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: pgmap v6707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T21:30:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: pgmap v6708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11514.456733 secs 2024-04-26T21:30:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: pgmap v6706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10817.431326 secs 2024-04-26T21:30:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: pgmap v6707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T21:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: pgmap v6708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:30:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:21 smithi092 ceph-mon[29156]: pgmap v6709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:21 smithi189 ceph-mon[32756]: pgmap v6709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:21 smithi156 ceph-mon[32679]: pgmap v6709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:23 smithi092 ceph-mon[29156]: pgmap v6710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:23 smithi189 ceph-mon[32756]: pgmap v6710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:23 smithi156 ceph-mon[32679]: pgmap v6710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:30:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11519.456862 secs 2024-04-26T21:30:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10822.431409 secs 2024-04-26T21:30:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11519.456862 secs 2024-04-26T21:30:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10822.431409 secs 2024-04-26T21:30:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11519.456862 secs 2024-04-26T21:30:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10822.431409 secs 2024-04-26T21:30:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:25 smithi092 ceph-mon[29156]: pgmap v6711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:25 smithi189 ceph-mon[32756]: pgmap v6711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:25 smithi156 ceph-mon[32679]: pgmap v6711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:28.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:27 smithi156 ceph-mon[32679]: pgmap v6712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:27 smithi092 ceph-mon[29156]: pgmap v6712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:27 smithi189 ceph-mon[32756]: pgmap v6712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:30:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:29 smithi092 ceph-mon[29156]: 4 slow requests, 2 included below; oldest blocked for > 11524.456979 secs 2024-04-26T21:30:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:29 smithi092 ceph-mon[29156]: slow request 11524.388749 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T21:30:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:29 smithi092 ceph-mon[29156]: slow request 11524.456978 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T21:30:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10827.431532 secs 2024-04-26T21:30:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:29 smithi092 ceph-mon[29156]: pgmap v6713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:30:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:29 smithi189 ceph-mon[32756]: 4 slow requests, 2 included below; oldest blocked for > 11524.456979 secs 2024-04-26T21:30:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:29 smithi189 ceph-mon[32756]: slow request 11524.388749 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T21:30:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:29 smithi189 ceph-mon[32756]: slow request 11524.456978 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T21:30:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10827.431532 secs 2024-04-26T21:30:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:29 smithi189 ceph-mon[32756]: pgmap v6713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:30:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:29 smithi156 ceph-mon[32679]: 4 slow requests, 2 included below; oldest blocked for > 11524.456979 secs 2024-04-26T21:30:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:29 smithi156 ceph-mon[32679]: slow request 11524.388749 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-26T21:30:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:29 smithi156 ceph-mon[32679]: slow request 11524.456978 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-26T21:30:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10827.431532 secs 2024-04-26T21:30:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:29 smithi156 ceph-mon[32679]: pgmap v6713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:30:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:31 smithi092 ceph-mon[29156]: pgmap v6714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:31 smithi189 ceph-mon[32756]: pgmap v6714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:31 smithi156 ceph-mon[32679]: pgmap v6714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:33 smithi092 ceph-mon[29156]: pgmap v6715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:33 smithi189 ceph-mon[32756]: pgmap v6715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:33 smithi156 ceph-mon[32679]: pgmap v6715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11529.457117 secs 2024-04-26T21:30:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10832.431596 secs 2024-04-26T21:30:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11529.457117 secs 2024-04-26T21:30:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10832.431596 secs 2024-04-26T21:30:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11529.457117 secs 2024-04-26T21:30:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10832.431596 secs 2024-04-26T21:30:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:35 smithi092 ceph-mon[29156]: pgmap v6716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:35 smithi189 ceph-mon[32756]: pgmap v6716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:35 smithi156 ceph-mon[32679]: pgmap v6716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:37.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:30:37.555+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:30:37.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:30:37.555+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:30:37.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:30:37.555+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:30:37.556 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:30:37.556+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 92 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:30:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:37 smithi092 ceph-mon[29156]: pgmap v6717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:37 smithi189 ceph-mon[32756]: pgmap v6717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:37 smithi156 ceph-mon[32679]: pgmap v6717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11534.457195 secs 2024-04-26T21:30:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10837.431723 secs 2024-04-26T21:30:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:39 smithi092 ceph-mon[29156]: pgmap v6718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11534.457195 secs 2024-04-26T21:30:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10837.431723 secs 2024-04-26T21:30:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:39 smithi189 ceph-mon[32756]: pgmap v6718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11534.457195 secs 2024-04-26T21:30:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10837.431723 secs 2024-04-26T21:30:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:39 smithi156 ceph-mon[32679]: pgmap v6718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:41 smithi092 ceph-mon[29156]: pgmap v6719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:41 smithi189 ceph-mon[32756]: pgmap v6719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:41 smithi156 ceph-mon[32679]: pgmap v6719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:43 smithi092 ceph-mon[29156]: pgmap v6720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:43 smithi189 ceph-mon[32756]: pgmap v6720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:43 smithi156 ceph-mon[32679]: pgmap v6720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11539.457308 secs 2024-04-26T21:30:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10842.431801 secs 2024-04-26T21:30:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11539.457308 secs 2024-04-26T21:30:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10842.431801 secs 2024-04-26T21:30:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11539.457308 secs 2024-04-26T21:30:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10842.431801 secs 2024-04-26T21:30:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:45 smithi092 ceph-mon[29156]: pgmap v6721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:46.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:45 smithi189 ceph-mon[32756]: pgmap v6721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:45 smithi156 ceph-mon[32679]: pgmap v6721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:47 smithi092 ceph-mon[29156]: pgmap v6722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:47 smithi189 ceph-mon[32756]: pgmap v6722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:47 smithi156 ceph-mon[32679]: pgmap v6722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11544.457422 secs 2024-04-26T21:30:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11544.457422 secs 2024-04-26T21:30:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11544.457422 secs 2024-04-26T21:30:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10847.431908 secs 2024-04-26T21:30:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:49 smithi092 ceph-mon[29156]: pgmap v6723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10847.431908 secs 2024-04-26T21:30:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:49 smithi189 ceph-mon[32756]: pgmap v6723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10847.431908 secs 2024-04-26T21:30:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:49 smithi156 ceph-mon[32679]: pgmap v6723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:51 smithi189 ceph-mon[32756]: pgmap v6724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:51 smithi156 ceph-mon[32679]: pgmap v6724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:51 smithi092 ceph-mon[29156]: pgmap v6724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:53 smithi189 ceph-mon[32756]: pgmap v6725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11549.457557 secs 2024-04-26T21:30:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:53 smithi156 ceph-mon[32679]: pgmap v6725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11549.457557 secs 2024-04-26T21:30:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:53 smithi092 ceph-mon[29156]: pgmap v6725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11549.457557 secs 2024-04-26T21:30:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:55 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10852.431987 secs 2024-04-26T21:30:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:55 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10852.431987 secs 2024-04-26T21:30:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:55 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10852.431987 secs 2024-04-26T21:30:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:56 smithi189 ceph-mon[32756]: pgmap v6726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:56 smithi156 ceph-mon[32679]: pgmap v6726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:56 smithi092 ceph-mon[29156]: pgmap v6726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:30:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:58 smithi189 ceph-mon[32756]: pgmap v6727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:58 smithi156 ceph-mon[32679]: pgmap v6727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:58 smithi092 ceph-mon[29156]: pgmap v6727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:30:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:30:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11554.457691 secs 2024-04-26T21:30:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:30:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11554.457691 secs 2024-04-26T21:30:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:30:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11554.457691 secs 2024-04-26T21:31:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10857.432106 secs 2024-04-26T21:31:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:00 smithi189 ceph-mon[32756]: pgmap v6728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10857.432106 secs 2024-04-26T21:31:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:00 smithi156 ceph-mon[32679]: pgmap v6728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10857.432106 secs 2024-04-26T21:31:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:00 smithi092 ceph-mon[29156]: pgmap v6728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:02 smithi189 ceph-mon[32756]: pgmap v6729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:02 smithi156 ceph-mon[32679]: pgmap v6729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:02 smithi092 ceph-mon[29156]: pgmap v6729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:04 smithi189 ceph-mon[32756]: pgmap v6730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:04 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 11559.457813 secs 2024-04-26T21:31:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:04 smithi189 ceph-mon[32756]: slow request 11523.394123 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T21:31:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:04 smithi156 ceph-mon[32679]: pgmap v6730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:04 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 11559.457813 secs 2024-04-26T21:31:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:04 smithi156 ceph-mon[32679]: slow request 11523.394123 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T21:31:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:04 smithi092 ceph-mon[29156]: pgmap v6730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:04 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 11559.457813 secs 2024-04-26T21:31:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:04 smithi092 ceph-mon[29156]: slow request 11523.394123 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-26T21:31:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:05 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10862.432220 secs 2024-04-26T21:31:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:05 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10862.432220 secs 2024-04-26T21:31:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:05 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10862.432220 secs 2024-04-26T21:31:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:06 smithi189 ceph-mon[32756]: pgmap v6731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:06 smithi156 ceph-mon[32679]: pgmap v6731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:06 smithi092 ceph-mon[29156]: pgmap v6731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:08 smithi189 ceph-mon[32756]: pgmap v6732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:08 smithi156 ceph-mon[32679]: pgmap v6732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:08 smithi092 ceph-mon[29156]: pgmap v6732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11564.457926 secs 2024-04-26T21:31:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10867.432349 secs 2024-04-26T21:31:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11564.457926 secs 2024-04-26T21:31:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10867.432349 secs 2024-04-26T21:31:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11564.457926 secs 2024-04-26T21:31:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10867.432349 secs 2024-04-26T21:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:10 smithi189 ceph-mon[32756]: pgmap v6733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:10 smithi156 ceph-mon[32679]: pgmap v6733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:10 smithi092 ceph-mon[29156]: pgmap v6733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:12 smithi189 ceph-mon[32756]: pgmap v6734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:12 smithi156 ceph-mon[32679]: pgmap v6734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:12 smithi092 ceph-mon[29156]: pgmap v6734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:14 smithi092 ceph-mon[29156]: pgmap v6735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:14.621 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11569.458041 secs 2024-04-26T21:31:14.622 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10872.432473 secs 2024-04-26T21:31:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:14 smithi189 ceph-mon[32756]: pgmap v6735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11569.458041 secs 2024-04-26T21:31:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10872.432473 secs 2024-04-26T21:31:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:14 smithi156 ceph-mon[32679]: pgmap v6735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11569.458041 secs 2024-04-26T21:31:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10872.432473 secs 2024-04-26T21:31:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:16 smithi189 ceph-mon[32756]: pgmap v6736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:16 smithi156 ceph-mon[32679]: pgmap v6736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:16 smithi092 ceph-mon[29156]: pgmap v6736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:18 smithi189 ceph-mon[32756]: pgmap v6737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:18 smithi156 ceph-mon[32679]: pgmap v6737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:18 smithi092 ceph-mon[29156]: pgmap v6737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11574.458149 secs 2024-04-26T21:31:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10877.432554 secs 2024-04-26T21:31:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11574.458149 secs 2024-04-26T21:31:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10877.432554 secs 2024-04-26T21:31:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11574.458149 secs 2024-04-26T21:31:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10877.432554 secs 2024-04-26T21:31:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:31:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:20 smithi189 ceph-mon[32756]: pgmap v6738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:31:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:20 smithi156 ceph-mon[32679]: pgmap v6738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:31:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:20 smithi092 ceph-mon[29156]: pgmap v6738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:31:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:31:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:31:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:21 smithi189 ceph-mon[32756]: pgmap v6739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:31:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:21 smithi189 ceph-mon[32756]: pgmap v6740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:21 smithi156 ceph-mon[32679]: pgmap v6739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:31:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:21 smithi156 ceph-mon[32679]: pgmap v6740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:21 smithi092 ceph-mon[29156]: pgmap v6739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:31:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:21 smithi092 ceph-mon[29156]: pgmap v6740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:23 smithi189 ceph-mon[32756]: pgmap v6741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:23 smithi156 ceph-mon[32679]: pgmap v6741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:23 smithi092 ceph-mon[29156]: pgmap v6741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11579.458269 secs 2024-04-26T21:31:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10882.432670 secs 2024-04-26T21:31:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:24 smithi189 ceph-mon[32756]: pgmap v6742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11579.458269 secs 2024-04-26T21:31:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10882.432670 secs 2024-04-26T21:31:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:24 smithi156 ceph-mon[32679]: pgmap v6742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11579.458269 secs 2024-04-26T21:31:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10882.432670 secs 2024-04-26T21:31:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:24 smithi092 ceph-mon[29156]: pgmap v6742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:26 smithi189 ceph-mon[32756]: pgmap v6743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:26 smithi156 ceph-mon[32679]: pgmap v6743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:26 smithi092 ceph-mon[29156]: pgmap v6743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:31:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:28 smithi189 ceph-mon[32756]: pgmap v6744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:28 smithi156 ceph-mon[32679]: pgmap v6744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:28 smithi092 ceph-mon[29156]: pgmap v6744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:31:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11584.458383 secs 2024-04-26T21:31:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10887.432748 secs 2024-04-26T21:31:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11584.458383 secs 2024-04-26T21:31:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10887.432748 secs 2024-04-26T21:31:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11584.458383 secs 2024-04-26T21:31:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10887.432748 secs 2024-04-26T21:31:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:30 smithi189 ceph-mon[32756]: pgmap v6745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:31:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:30 smithi156 ceph-mon[32679]: pgmap v6745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:31:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:30 smithi092 ceph-mon[29156]: pgmap v6745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:31:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:32 smithi189 ceph-mon[32756]: pgmap v6746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:32 smithi156 ceph-mon[32679]: pgmap v6746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:32 smithi092 ceph-mon[29156]: pgmap v6746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:34.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:31:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:31:33.882+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:31:34.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:31:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:31:33.882+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:31:34.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:31:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:31:33.882+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:31:34.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:31:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:31:33.882+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:31:34.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:31:33 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:31:33.882+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:31:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11589.458521 secs 2024-04-26T21:31:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10892.432830 secs 2024-04-26T21:31:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:34 smithi189 ceph-mon[32756]: pgmap v6747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11589.458521 secs 2024-04-26T21:31:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10892.432830 secs 2024-04-26T21:31:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:34 smithi156 ceph-mon[32679]: pgmap v6747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11589.458521 secs 2024-04-26T21:31:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10892.432830 secs 2024-04-26T21:31:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:34 smithi092 ceph-mon[29156]: pgmap v6747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:36 smithi189 ceph-mon[32756]: pgmap v6748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:36 smithi156 ceph-mon[32679]: pgmap v6748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:36 smithi092 ceph-mon[29156]: pgmap v6748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:38 smithi189 ceph-mon[32756]: pgmap v6749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:38 smithi156 ceph-mon[32679]: pgmap v6749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:38 smithi092 ceph-mon[29156]: pgmap v6749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11594.458634 secs 2024-04-26T21:31:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10897.432929 secs 2024-04-26T21:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11594.458634 secs 2024-04-26T21:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10897.432929 secs 2024-04-26T21:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11594.458634 secs 2024-04-26T21:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10897.432929 secs 2024-04-26T21:31:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:40 smithi189 ceph-mon[32756]: pgmap v6750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:40 smithi156 ceph-mon[32679]: pgmap v6750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:40 smithi092 ceph-mon[29156]: pgmap v6750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:42 smithi189 ceph-mon[32756]: pgmap v6751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:42 smithi156 ceph-mon[32679]: pgmap v6751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:42 smithi092 ceph-mon[29156]: pgmap v6751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11599.458751 secs 2024-04-26T21:31:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10902.433083 secs 2024-04-26T21:31:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:44 smithi189 ceph-mon[32756]: pgmap v6752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11599.458751 secs 2024-04-26T21:31:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10902.433083 secs 2024-04-26T21:31:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:44 smithi156 ceph-mon[32679]: pgmap v6752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11599.458751 secs 2024-04-26T21:31:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10902.433083 secs 2024-04-26T21:31:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:44 smithi092 ceph-mon[29156]: pgmap v6752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:46 smithi189 ceph-mon[32756]: pgmap v6753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:46 smithi156 ceph-mon[32679]: pgmap v6753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:46 smithi092 ceph-mon[29156]: pgmap v6753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:48 smithi189 ceph-mon[32756]: pgmap v6754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:48 smithi156 ceph-mon[32679]: pgmap v6754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:48 smithi092 ceph-mon[29156]: pgmap v6754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:31:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11604.458869 secs 2024-04-26T21:31:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10907.433125 secs 2024-04-26T21:31:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11604.458869 secs 2024-04-26T21:31:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10907.433125 secs 2024-04-26T21:31:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11604.458869 secs 2024-04-26T21:31:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10907.433125 secs 2024-04-26T21:31:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:50 smithi189 ceph-mon[32756]: pgmap v6755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:50 smithi156 ceph-mon[32679]: pgmap v6755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:50 smithi092 ceph-mon[29156]: pgmap v6755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:31:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:52 smithi189 ceph-mon[32756]: pgmap v6756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:52 smithi156 ceph-mon[32679]: pgmap v6756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:52 smithi092 ceph-mon[29156]: pgmap v6756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11609.458982 secs 2024-04-26T21:31:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10912.433243 secs 2024-04-26T21:31:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:54 smithi189 ceph-mon[32756]: pgmap v6757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11609.458982 secs 2024-04-26T21:31:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10912.433243 secs 2024-04-26T21:31:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:54 smithi156 ceph-mon[32679]: pgmap v6757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11609.458982 secs 2024-04-26T21:31:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10912.433243 secs 2024-04-26T21:31:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:54 smithi092 ceph-mon[29156]: pgmap v6757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:31:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:56 smithi189 ceph-mon[32756]: pgmap v6758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:56 smithi156 ceph-mon[32679]: pgmap v6758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:56 smithi092 ceph-mon[29156]: pgmap v6758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:58 smithi189 ceph-mon[32756]: pgmap v6759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:58 smithi156 ceph-mon[32679]: pgmap v6759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:31:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:58 smithi092 ceph-mon[29156]: pgmap v6759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11614.459103 secs 2024-04-26T21:32:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:31:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10917.433385 secs 2024-04-26T21:32:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11614.459103 secs 2024-04-26T21:32:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:31:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10917.433385 secs 2024-04-26T21:32:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11614.459103 secs 2024-04-26T21:32:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:31:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10917.433385 secs 2024-04-26T21:32:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:00 smithi156 ceph-mon[32679]: pgmap v6760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:00 smithi092 ceph-mon[29156]: pgmap v6760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:00 smithi189 ceph-mon[32756]: pgmap v6760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:02 smithi156 ceph-mon[32679]: pgmap v6761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:02 smithi092 ceph-mon[29156]: pgmap v6761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:02 smithi189 ceph-mon[32756]: pgmap v6761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11619.459175 secs 2024-04-26T21:32:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10922.433524 secs 2024-04-26T21:32:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:04 smithi156 ceph-mon[32679]: pgmap v6762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11619.459175 secs 2024-04-26T21:32:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10922.433524 secs 2024-04-26T21:32:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:04 smithi092 ceph-mon[29156]: pgmap v6762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11619.459175 secs 2024-04-26T21:32:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10922.433524 secs 2024-04-26T21:32:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:04 smithi189 ceph-mon[32756]: pgmap v6762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:06 smithi156 ceph-mon[32679]: pgmap v6763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:06 smithi092 ceph-mon[29156]: pgmap v6763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:06 smithi189 ceph-mon[32756]: pgmap v6763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:08 smithi156 ceph-mon[32679]: pgmap v6764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:08 smithi092 ceph-mon[29156]: pgmap v6764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:08 smithi189 ceph-mon[32756]: pgmap v6764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11624.459294 secs 2024-04-26T21:32:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10927.433656 secs 2024-04-26T21:32:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11624.459294 secs 2024-04-26T21:32:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10927.433656 secs 2024-04-26T21:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11624.459294 secs 2024-04-26T21:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10927.433656 secs 2024-04-26T21:32:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:10 smithi156 ceph-mon[32679]: pgmap v6765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:10 smithi092 ceph-mon[29156]: pgmap v6765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:10 smithi189 ceph-mon[32756]: pgmap v6765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:13 smithi189 ceph-mon[32756]: pgmap v6766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:13 smithi156 ceph-mon[32679]: pgmap v6766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:13 smithi092 ceph-mon[29156]: pgmap v6766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11629.459417 secs 2024-04-26T21:32:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10932.433776 secs 2024-04-26T21:32:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11629.459417 secs 2024-04-26T21:32:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10932.433776 secs 2024-04-26T21:32:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11629.459417 secs 2024-04-26T21:32:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10932.433776 secs 2024-04-26T21:32:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:15 smithi189 ceph-mon[32756]: pgmap v6767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:15 smithi156 ceph-mon[32679]: pgmap v6767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:15 smithi092 ceph-mon[29156]: pgmap v6767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:17 smithi189 ceph-mon[32756]: pgmap v6768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:17 smithi156 ceph-mon[32679]: pgmap v6768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:17 smithi092 ceph-mon[29156]: pgmap v6768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:19 smithi189 ceph-mon[32756]: pgmap v6769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11634.459535 secs 2024-04-26T21:32:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10937.433879 secs 2024-04-26T21:32:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:19 smithi156 ceph-mon[32679]: pgmap v6769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11634.459535 secs 2024-04-26T21:32:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10937.433879 secs 2024-04-26T21:32:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:19 smithi092 ceph-mon[29156]: pgmap v6769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11634.459535 secs 2024-04-26T21:32:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10937.433879 secs 2024-04-26T21:32:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:32:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:21 smithi189 ceph-mon[32756]: pgmap v6770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:32:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:21 smithi156 ceph-mon[32679]: pgmap v6770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:32:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:21 smithi092 ceph-mon[29156]: pgmap v6770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:32:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:32:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:32:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:22 smithi189 ceph-mon[32756]: pgmap v6771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:22 smithi189 ceph-mon[32756]: pgmap v6772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:32:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:22 smithi156 ceph-mon[32679]: pgmap v6771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:22 smithi156 ceph-mon[32679]: pgmap v6772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:32:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:22 smithi092 ceph-mon[29156]: pgmap v6771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:22 smithi092 ceph-mon[29156]: pgmap v6772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:32:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:23 smithi189 ceph-mon[32756]: pgmap v6773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:32:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:23 smithi156 ceph-mon[32679]: pgmap v6773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:32:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:23 smithi092 ceph-mon[29156]: pgmap v6773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:32:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11639.459658 secs 2024-04-26T21:32:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10942.434025 secs 2024-04-26T21:32:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11639.459658 secs 2024-04-26T21:32:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10942.434025 secs 2024-04-26T21:32:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11639.459658 secs 2024-04-26T21:32:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10942.434025 secs 2024-04-26T21:32:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:25 smithi189 ceph-mon[32756]: pgmap v6774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:25 smithi156 ceph-mon[32679]: pgmap v6774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:25 smithi092 ceph-mon[29156]: pgmap v6774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:27 smithi189 ceph-mon[32756]: pgmap v6775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:27 smithi156 ceph-mon[32679]: pgmap v6775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:27 smithi092 ceph-mon[29156]: pgmap v6775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:32:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11644.459720 secs 2024-04-26T21:32:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:29 smithi189 ceph-mon[32756]: pgmap v6776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-04-26T21:32:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10947.434107 secs 2024-04-26T21:32:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11644.459720 secs 2024-04-26T21:32:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:29 smithi156 ceph-mon[32679]: pgmap v6776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-04-26T21:32:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10947.434107 secs 2024-04-26T21:32:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11644.459720 secs 2024-04-26T21:32:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:29 smithi092 ceph-mon[29156]: pgmap v6776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 3 op/s 2024-04-26T21:32:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10947.434107 secs 2024-04-26T21:32:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:31 smithi189 ceph-mon[32756]: pgmap v6777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:31.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:31 smithi092 ceph-mon[29156]: pgmap v6777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:31 smithi156 ceph-mon[32679]: pgmap v6777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:32:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:33 smithi189 ceph-mon[32756]: pgmap v6778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:32:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:33 smithi156 ceph-mon[32679]: pgmap v6778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:32:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:33 smithi092 ceph-mon[29156]: pgmap v6778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:32:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11649.459816 secs 2024-04-26T21:32:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10952.434208 secs 2024-04-26T21:32:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11649.459816 secs 2024-04-26T21:32:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10952.434208 secs 2024-04-26T21:32:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11649.459816 secs 2024-04-26T21:32:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10952.434208 secs 2024-04-26T21:32:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:35 smithi189 ceph-mon[32756]: pgmap v6779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:32:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:35 smithi156 ceph-mon[32679]: pgmap v6779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:32:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:35 smithi092 ceph-mon[29156]: pgmap v6779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:32:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:37 smithi189 ceph-mon[32756]: pgmap v6780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:37 smithi156 ceph-mon[32679]: pgmap v6780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:37 smithi092 ceph-mon[29156]: pgmap v6780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11654.459936 secs 2024-04-26T21:32:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:39 smithi189 ceph-mon[32756]: pgmap v6781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10957.434311 secs 2024-04-26T21:32:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11654.459936 secs 2024-04-26T21:32:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:39 smithi156 ceph-mon[32679]: pgmap v6781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10957.434311 secs 2024-04-26T21:32:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11654.459936 secs 2024-04-26T21:32:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:39 smithi092 ceph-mon[29156]: pgmap v6781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10957.434311 secs 2024-04-26T21:32:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:41 smithi189 ceph-mon[32756]: pgmap v6782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:41 smithi156 ceph-mon[32679]: pgmap v6782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:41 smithi092 ceph-mon[29156]: pgmap v6782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:43 smithi189 ceph-mon[32756]: pgmap v6783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:43 smithi156 ceph-mon[32679]: pgmap v6783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:43 smithi092 ceph-mon[29156]: pgmap v6783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11659.460066 secs 2024-04-26T21:32:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10962.434426 secs 2024-04-26T21:32:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11659.460066 secs 2024-04-26T21:32:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10962.434426 secs 2024-04-26T21:32:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11659.460066 secs 2024-04-26T21:32:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10962.434426 secs 2024-04-26T21:32:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:45 smithi189 ceph-mon[32756]: pgmap v6784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:45 smithi156 ceph-mon[32679]: pgmap v6784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:45 smithi092 ceph-mon[29156]: pgmap v6784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:47 smithi156 ceph-mon[32679]: pgmap v6785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:47 smithi092 ceph-mon[29156]: pgmap v6785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:47 smithi189 ceph-mon[32756]: pgmap v6785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11664.460183 secs 2024-04-26T21:32:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:49 smithi156 ceph-mon[32679]: pgmap v6786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10967.434506 secs 2024-04-26T21:32:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11664.460183 secs 2024-04-26T21:32:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:49 smithi092 ceph-mon[29156]: pgmap v6786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10967.434506 secs 2024-04-26T21:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11664.460183 secs 2024-04-26T21:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:49 smithi189 ceph-mon[32756]: pgmap v6786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10967.434506 secs 2024-04-26T21:32:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:51 smithi156 ceph-mon[32679]: pgmap v6787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:51 smithi092 ceph-mon[29156]: pgmap v6787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:51 smithi189 ceph-mon[32756]: pgmap v6787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:53 smithi156 ceph-mon[32679]: pgmap v6788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:53 smithi092 ceph-mon[29156]: pgmap v6788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:53 smithi189 ceph-mon[32756]: pgmap v6788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11669.460308 secs 2024-04-26T21:32:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10972.434594 secs 2024-04-26T21:32:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11669.460308 secs 2024-04-26T21:32:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10972.434594 secs 2024-04-26T21:32:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11669.460308 secs 2024-04-26T21:32:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10972.434594 secs 2024-04-26T21:32:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:55 smithi156 ceph-mon[32679]: pgmap v6789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:55 smithi092 ceph-mon[29156]: pgmap v6789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:55 smithi189 ceph-mon[32756]: pgmap v6789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:57 smithi156 ceph-mon[32679]: pgmap v6790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:57 smithi092 ceph-mon[29156]: pgmap v6790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:57 smithi189 ceph-mon[32756]: pgmap v6790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:32:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11674.460398 secs 2024-04-26T21:32:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:59 smithi156 ceph-mon[32679]: pgmap v6791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:32:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10977.434674 secs 2024-04-26T21:32:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11674.460398 secs 2024-04-26T21:32:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:59 smithi092 ceph-mon[29156]: pgmap v6791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:32:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:32:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10977.434674 secs 2024-04-26T21:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11674.460398 secs 2024-04-26T21:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:59 smithi189 ceph-mon[32756]: pgmap v6791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:32:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10977.434674 secs 2024-04-26T21:33:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:01 smithi156 ceph-mon[32679]: pgmap v6792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:01 smithi092 ceph-mon[29156]: pgmap v6792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:01 smithi189 ceph-mon[32756]: pgmap v6792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:03 smithi156 ceph-mon[32679]: pgmap v6793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:03 smithi092 ceph-mon[29156]: pgmap v6793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:03 smithi189 ceph-mon[32756]: pgmap v6793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11679.460494 secs 2024-04-26T21:33:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10982.434753 secs 2024-04-26T21:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11679.460494 secs 2024-04-26T21:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10982.434753 secs 2024-04-26T21:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11679.460494 secs 2024-04-26T21:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10982.434753 secs 2024-04-26T21:33:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:05 smithi156 ceph-mon[32679]: pgmap v6794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:05 smithi092 ceph-mon[29156]: pgmap v6794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:05 smithi189 ceph-mon[32756]: pgmap v6794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:07 smithi156 ceph-mon[32679]: pgmap v6795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:07 smithi092 ceph-mon[29156]: pgmap v6795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:07 smithi189 ceph-mon[32756]: pgmap v6795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11684.460609 secs 2024-04-26T21:33:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:09 smithi156 ceph-mon[32679]: pgmap v6796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:09 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 10987.434843 secs 2024-04-26T21:33:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:09 smithi156 ceph-mon[32679]: slow request 724.845998 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:33:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11684.460609 secs 2024-04-26T21:33:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:09 smithi092 ceph-mon[29156]: pgmap v6796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:09 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 10987.434843 secs 2024-04-26T21:33:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:09 smithi092 ceph-mon[29156]: slow request 724.845998 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:33:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11684.460609 secs 2024-04-26T21:33:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:09 smithi189 ceph-mon[32756]: pgmap v6796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:09 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 10987.434843 secs 2024-04-26T21:33:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:09 smithi189 ceph-mon[32756]: slow request 724.845998 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:33:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:11 smithi092 ceph-mon[29156]: pgmap v6797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:11 smithi189 ceph-mon[32756]: pgmap v6797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:11 smithi156 ceph-mon[32679]: pgmap v6797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:13 smithi092 ceph-mon[29156]: pgmap v6798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:13 smithi189 ceph-mon[32756]: pgmap v6798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:13 smithi156 ceph-mon[32679]: pgmap v6798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11689.460731 secs 2024-04-26T21:33:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10992.434921 secs 2024-04-26T21:33:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11689.460731 secs 2024-04-26T21:33:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10992.434921 secs 2024-04-26T21:33:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11689.460731 secs 2024-04-26T21:33:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10992.434921 secs 2024-04-26T21:33:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:15 smithi092 ceph-mon[29156]: pgmap v6799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:15 smithi189 ceph-mon[32756]: pgmap v6799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:15 smithi156 ceph-mon[32679]: pgmap v6799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:17 smithi092 ceph-mon[29156]: pgmap v6800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:17 smithi189 ceph-mon[32756]: pgmap v6800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:17 smithi156 ceph-mon[32679]: pgmap v6800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11694.460846 secs 2024-04-26T21:33:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:19 smithi092 ceph-mon[29156]: pgmap v6801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 10997.435010 secs 2024-04-26T21:33:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11694.460846 secs 2024-04-26T21:33:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:19 smithi189 ceph-mon[32756]: pgmap v6801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 10997.435010 secs 2024-04-26T21:33:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11694.460846 secs 2024-04-26T21:33:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:19 smithi156 ceph-mon[32679]: pgmap v6801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 10997.435010 secs 2024-04-26T21:33:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: pgmap v6802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: pgmap v6803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: pgmap v6804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:33:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: pgmap v6802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: pgmap v6803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:33:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: pgmap v6804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: pgmap v6802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: pgmap v6803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: pgmap v6804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:33:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:23 smithi156 ceph-mon[32679]: pgmap v6805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:23 smithi092 ceph-mon[29156]: pgmap v6805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:23 smithi189 ceph-mon[32756]: pgmap v6805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11699.460962 secs 2024-04-26T21:33:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11002.435076 secs 2024-04-26T21:33:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11699.460962 secs 2024-04-26T21:33:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11002.435076 secs 2024-04-26T21:33:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11699.460962 secs 2024-04-26T21:33:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11002.435076 secs 2024-04-26T21:33:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:25 smithi156 ceph-mon[32679]: pgmap v6806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:25 smithi092 ceph-mon[29156]: pgmap v6806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:25 smithi189 ceph-mon[32756]: pgmap v6806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:27 smithi156 ceph-mon[32679]: pgmap v6807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:27 smithi092 ceph-mon[29156]: pgmap v6807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:27 smithi189 ceph-mon[32756]: pgmap v6807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:33:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11704.461076 secs 2024-04-26T21:33:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11704.461076 secs 2024-04-26T21:33:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11704.461076 secs 2024-04-26T21:33:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:30 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11007.435142 secs 2024-04-26T21:33:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:30 smithi189 ceph-mon[32756]: pgmap v6808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:30 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11007.435142 secs 2024-04-26T21:33:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:30 smithi156 ceph-mon[32679]: pgmap v6808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:30 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11007.435142 secs 2024-04-26T21:33:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:30 smithi092 ceph-mon[29156]: pgmap v6808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:33:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:31 smithi156 ceph-mon[32679]: pgmap v6809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:33:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:31 smithi092 ceph-mon[29156]: pgmap v6809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:33:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:31 smithi189 ceph-mon[32756]: pgmap v6809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:33:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:33 smithi156 ceph-mon[32679]: pgmap v6810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:33 smithi092 ceph-mon[29156]: pgmap v6810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:33 smithi189 ceph-mon[32756]: pgmap v6810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11709.461193 secs 2024-04-26T21:33:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11012.435315 secs 2024-04-26T21:33:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11709.461193 secs 2024-04-26T21:33:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11012.435315 secs 2024-04-26T21:33:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11709.461193 secs 2024-04-26T21:33:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11012.435315 secs 2024-04-26T21:33:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:35 smithi156 ceph-mon[32679]: pgmap v6811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:35 smithi092 ceph-mon[29156]: pgmap v6811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:35 smithi189 ceph-mon[32756]: pgmap v6811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T21:33:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:33:36.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca80af000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca80af000 comp rx=0 tx=0).stop 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:36.009 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.007+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca809e000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:33:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:33:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:33:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:33:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=11 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:33:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:33:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T21:33:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:36.034+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T21:33:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:37.579+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:33:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:37.579+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:33:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:37.580+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:33:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:33:37.580+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 93 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:33:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:37 smithi156 ceph-mon[32679]: pgmap v6812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:37 smithi092 ceph-mon[29156]: pgmap v6812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:37 smithi189 ceph-mon[32756]: pgmap v6812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11714.461297 secs 2024-04-26T21:33:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11714.461297 secs 2024-04-26T21:33:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11714.461297 secs 2024-04-26T21:33:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:40 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11017.435367 secs 2024-04-26T21:33:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:40 smithi189 ceph-mon[32756]: pgmap v6813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:40 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11017.435367 secs 2024-04-26T21:33:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:40 smithi156 ceph-mon[32679]: pgmap v6813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:40 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11017.435367 secs 2024-04-26T21:33:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:40 smithi092 ceph-mon[29156]: pgmap v6813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:41 smithi156 ceph-mon[32679]: pgmap v6814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:41 smithi092 ceph-mon[29156]: pgmap v6814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:41 smithi189 ceph-mon[32756]: pgmap v6814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:43 smithi156 ceph-mon[32679]: pgmap v6815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:43 smithi092 ceph-mon[29156]: pgmap v6815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:43 smithi189 ceph-mon[32756]: pgmap v6815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11719.461423 secs 2024-04-26T21:33:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11022.435439 secs 2024-04-26T21:33:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11719.461423 secs 2024-04-26T21:33:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11022.435439 secs 2024-04-26T21:33:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11719.461423 secs 2024-04-26T21:33:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11022.435439 secs 2024-04-26T21:33:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:45 smithi156 ceph-mon[32679]: pgmap v6816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:45 smithi092 ceph-mon[29156]: pgmap v6816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:45 smithi189 ceph-mon[32756]: pgmap v6816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:47 smithi156 ceph-mon[32679]: pgmap v6817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:47.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:47 smithi189 ceph-mon[32756]: pgmap v6817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:47 smithi092 ceph-mon[29156]: pgmap v6817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11724.461565 secs 2024-04-26T21:33:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11724.461565 secs 2024-04-26T21:33:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11724.461565 secs 2024-04-26T21:33:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11027.435510 secs 2024-04-26T21:33:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:50 smithi189 ceph-mon[32756]: pgmap v6818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11027.435510 secs 2024-04-26T21:33:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:50 smithi156 ceph-mon[32679]: pgmap v6818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11027.435510 secs 2024-04-26T21:33:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:50 smithi092 ceph-mon[29156]: pgmap v6818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:51 smithi156 ceph-mon[32679]: pgmap v6819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:51 smithi092 ceph-mon[29156]: pgmap v6819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:51 smithi189 ceph-mon[32756]: pgmap v6819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:53 smithi156 ceph-mon[32679]: pgmap v6820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:53 smithi092 ceph-mon[29156]: pgmap v6820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:53 smithi189 ceph-mon[32756]: pgmap v6820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11729.461703 secs 2024-04-26T21:33:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11032.435574 secs 2024-04-26T21:33:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11729.461703 secs 2024-04-26T21:33:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11032.435574 secs 2024-04-26T21:33:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11729.461703 secs 2024-04-26T21:33:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11032.435574 secs 2024-04-26T21:33:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:55 smithi156 ceph-mon[32679]: pgmap v6821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:55 smithi092 ceph-mon[29156]: pgmap v6821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:55 smithi189 ceph-mon[32756]: pgmap v6821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:33:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:57 smithi156 ceph-mon[32679]: pgmap v6822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:57 smithi092 ceph-mon[29156]: pgmap v6822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:57 smithi189 ceph-mon[32756]: pgmap v6822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:33:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:33:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11734.461851 secs 2024-04-26T21:33:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:33:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11734.461851 secs 2024-04-26T21:33:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:33:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11734.461851 secs 2024-04-26T21:34:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11037.435649 secs 2024-04-26T21:34:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:00 smithi189 ceph-mon[32756]: pgmap v6823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11037.435649 secs 2024-04-26T21:34:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:00 smithi156 ceph-mon[32679]: pgmap v6823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11037.435649 secs 2024-04-26T21:34:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:00 smithi092 ceph-mon[29156]: pgmap v6823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:01 smithi156 ceph-mon[32679]: pgmap v6824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:01 smithi092 ceph-mon[29156]: pgmap v6824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:01 smithi189 ceph-mon[32756]: pgmap v6824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:03 smithi156 ceph-mon[32679]: pgmap v6825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:03 smithi092 ceph-mon[29156]: pgmap v6825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:03 smithi189 ceph-mon[32756]: pgmap v6825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11739.461909 secs 2024-04-26T21:34:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11042.435726 secs 2024-04-26T21:34:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11739.461909 secs 2024-04-26T21:34:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11042.435726 secs 2024-04-26T21:34:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11739.461909 secs 2024-04-26T21:34:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11042.435726 secs 2024-04-26T21:34:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:05 smithi156 ceph-mon[32679]: pgmap v6826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:05 smithi092 ceph-mon[29156]: pgmap v6826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:05 smithi189 ceph-mon[32756]: pgmap v6826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:07 smithi156 ceph-mon[32679]: pgmap v6827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:07 smithi092 ceph-mon[29156]: pgmap v6827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:07 smithi189 ceph-mon[32756]: pgmap v6827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11744.462029 secs 2024-04-26T21:34:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11744.462029 secs 2024-04-26T21:34:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11744.462029 secs 2024-04-26T21:34:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:10 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11047.435790 secs 2024-04-26T21:34:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:10 smithi189 ceph-mon[32756]: pgmap v6828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:10 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11047.435790 secs 2024-04-26T21:34:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:10 smithi156 ceph-mon[32679]: pgmap v6828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:10 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11047.435790 secs 2024-04-26T21:34:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:10 smithi092 ceph-mon[29156]: pgmap v6828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:11 smithi156 ceph-mon[32679]: pgmap v6829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:11 smithi092 ceph-mon[29156]: pgmap v6829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:11 smithi189 ceph-mon[32756]: pgmap v6829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:13 smithi156 ceph-mon[32679]: pgmap v6830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:13 smithi092 ceph-mon[29156]: pgmap v6830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:13 smithi189 ceph-mon[32756]: pgmap v6830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11749.462149 secs 2024-04-26T21:34:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11052.435902 secs 2024-04-26T21:34:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11749.462149 secs 2024-04-26T21:34:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11052.435902 secs 2024-04-26T21:34:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11749.462149 secs 2024-04-26T21:34:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11052.435902 secs 2024-04-26T21:34:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:15 smithi156 ceph-mon[32679]: pgmap v6831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:15 smithi092 ceph-mon[29156]: pgmap v6831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:15 smithi189 ceph-mon[32756]: pgmap v6831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:17 smithi156 ceph-mon[32679]: pgmap v6832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:17.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:17 smithi189 ceph-mon[32756]: pgmap v6832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:17 smithi092 ceph-mon[29156]: pgmap v6832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11754.462291 secs 2024-04-26T21:34:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11754.462291 secs 2024-04-26T21:34:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11754.462291 secs 2024-04-26T21:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:20 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11057.436020 secs 2024-04-26T21:34:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:20 smithi189 ceph-mon[32756]: pgmap v6833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:20 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11057.436020 secs 2024-04-26T21:34:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:20 smithi156 ceph-mon[32679]: pgmap v6833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:20 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11057.436020 secs 2024-04-26T21:34:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:20 smithi092 ceph-mon[29156]: pgmap v6833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:21 smithi156 ceph-mon[32679]: pgmap v6834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:21 smithi092 ceph-mon[29156]: pgmap v6834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:21 smithi189 ceph-mon[32756]: pgmap v6834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:22.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:23 smithi156 ceph-mon[32679]: pgmap v6835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:23 smithi092 ceph-mon[29156]: pgmap v6835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:23 smithi189 ceph-mon[32756]: pgmap v6835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11759.462354 secs 2024-04-26T21:34:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11062.436114 secs 2024-04-26T21:34:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11759.462354 secs 2024-04-26T21:34:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11062.436114 secs 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11759.462354 secs 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11062.436114 secs 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: pgmap v6836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: pgmap v6837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: pgmap v6838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: pgmap v6836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: pgmap v6837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: pgmap v6838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: pgmap v6836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:34:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: pgmap v6837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:26.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: pgmap v6838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:26.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:34:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:27 smithi156 ceph-mon[32679]: pgmap v6839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:27 smithi092 ceph-mon[29156]: pgmap v6839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:27 smithi189 ceph-mon[32756]: pgmap v6839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11764.462462 secs 2024-04-26T21:34:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11764.462462 secs 2024-04-26T21:34:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11764.462462 secs 2024-04-26T21:34:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:30 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11067.436240 secs 2024-04-26T21:34:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:30 smithi189 ceph-mon[32756]: pgmap v6840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:30 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11067.436240 secs 2024-04-26T21:34:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:30 smithi156 ceph-mon[32679]: pgmap v6840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:30 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11067.436240 secs 2024-04-26T21:34:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:30 smithi092 ceph-mon[29156]: pgmap v6840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:31 smithi156 ceph-mon[32679]: pgmap v6841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:31 smithi092 ceph-mon[29156]: pgmap v6841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:31 smithi189 ceph-mon[32756]: pgmap v6841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:33 smithi156 ceph-mon[32679]: pgmap v6842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:33 smithi092 ceph-mon[29156]: pgmap v6842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:33 smithi189 ceph-mon[32756]: pgmap v6842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:34:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11769.462580 secs 2024-04-26T21:34:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11072.436365 secs 2024-04-26T21:34:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11769.462580 secs 2024-04-26T21:34:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11072.436365 secs 2024-04-26T21:34:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11769.462580 secs 2024-04-26T21:34:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11072.436365 secs 2024-04-26T21:34:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:35 smithi156 ceph-mon[32679]: pgmap v6843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:35 smithi092 ceph-mon[29156]: pgmap v6843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:35 smithi189 ceph-mon[32756]: pgmap v6843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:34:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:37 smithi156 ceph-mon[32679]: pgmap v6844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:37 smithi092 ceph-mon[29156]: pgmap v6844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:37 smithi189 ceph-mon[32756]: pgmap v6844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11774.462712 secs 2024-04-26T21:34:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11774.462712 secs 2024-04-26T21:34:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11774.462712 secs 2024-04-26T21:34:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:40 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11077.436480 secs 2024-04-26T21:34:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:40 smithi189 ceph-mon[32756]: pgmap v6845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:40 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11077.436480 secs 2024-04-26T21:34:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:40 smithi156 ceph-mon[32679]: pgmap v6845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:40 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11077.436480 secs 2024-04-26T21:34:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:40 smithi092 ceph-mon[29156]: pgmap v6845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:41 smithi156 ceph-mon[32679]: pgmap v6846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:41 smithi092 ceph-mon[29156]: pgmap v6846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:41 smithi189 ceph-mon[32756]: pgmap v6846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:43 smithi156 ceph-mon[32679]: pgmap v6847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:43 smithi092 ceph-mon[29156]: pgmap v6847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:43 smithi189 ceph-mon[32756]: pgmap v6847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11779.462840 secs 2024-04-26T21:34:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11082.436588 secs 2024-04-26T21:34:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11779.462840 secs 2024-04-26T21:34:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11082.436588 secs 2024-04-26T21:34:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11779.462840 secs 2024-04-26T21:34:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11082.436588 secs 2024-04-26T21:34:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:45 smithi092 ceph-mon[29156]: pgmap v6848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:45 smithi189 ceph-mon[32756]: pgmap v6848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:45 smithi156 ceph-mon[32679]: pgmap v6848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:47 smithi156 ceph-mon[32679]: pgmap v6849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:47.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:47 smithi189 ceph-mon[32756]: pgmap v6849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:47 smithi092 ceph-mon[29156]: pgmap v6849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11784.462956 secs 2024-04-26T21:34:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11784.462956 secs 2024-04-26T21:34:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11784.462956 secs 2024-04-26T21:34:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11087.436678 secs 2024-04-26T21:34:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:50 smithi189 ceph-mon[32756]: pgmap v6850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11087.436678 secs 2024-04-26T21:34:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:50 smithi156 ceph-mon[32679]: pgmap v6850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11087.436678 secs 2024-04-26T21:34:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:50 smithi092 ceph-mon[29156]: pgmap v6850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:51 smithi156 ceph-mon[32679]: pgmap v6851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:51 smithi092 ceph-mon[29156]: pgmap v6851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:51 smithi189 ceph-mon[32756]: pgmap v6851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:53 smithi156 ceph-mon[32679]: pgmap v6852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:53 smithi092 ceph-mon[29156]: pgmap v6852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:53 smithi189 ceph-mon[32756]: pgmap v6852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11789.463072 secs 2024-04-26T21:34:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11092.436746 secs 2024-04-26T21:34:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11789.463072 secs 2024-04-26T21:34:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11092.436746 secs 2024-04-26T21:34:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11789.463072 secs 2024-04-26T21:34:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11092.436746 secs 2024-04-26T21:34:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:55 smithi156 ceph-mon[32679]: pgmap v6853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:55 smithi092 ceph-mon[29156]: pgmap v6853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:55 smithi189 ceph-mon[32756]: pgmap v6853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:34:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:57 smithi156 ceph-mon[32679]: pgmap v6854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:57 smithi092 ceph-mon[29156]: pgmap v6854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:57 smithi189 ceph-mon[32756]: pgmap v6854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:34:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:34:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11794.463147 secs 2024-04-26T21:34:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:34:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11794.463147 secs 2024-04-26T21:34:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:34:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11794.463147 secs 2024-04-26T21:35:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11097.436862 secs 2024-04-26T21:35:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:00 smithi189 ceph-mon[32756]: pgmap v6855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11097.436862 secs 2024-04-26T21:35:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:00 smithi156 ceph-mon[32679]: pgmap v6855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11097.436862 secs 2024-04-26T21:35:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:00 smithi092 ceph-mon[29156]: pgmap v6855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:01 smithi092 ceph-mon[29156]: pgmap v6856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:01 smithi189 ceph-mon[32756]: pgmap v6856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:01 smithi156 ceph-mon[32679]: pgmap v6856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:03 smithi092 ceph-mon[29156]: pgmap v6857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:03 smithi189 ceph-mon[32756]: pgmap v6857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:03 smithi156 ceph-mon[32679]: pgmap v6857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11799.463209 secs 2024-04-26T21:35:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11102.437007 secs 2024-04-26T21:35:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11799.463209 secs 2024-04-26T21:35:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11102.437007 secs 2024-04-26T21:35:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11799.463209 secs 2024-04-26T21:35:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11102.437007 secs 2024-04-26T21:35:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:05 smithi092 ceph-mon[29156]: pgmap v6858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:05 smithi189 ceph-mon[32756]: pgmap v6858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:05 smithi156 ceph-mon[32679]: pgmap v6858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:07 smithi092 ceph-mon[29156]: pgmap v6859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:07 smithi189 ceph-mon[32756]: pgmap v6859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:07 smithi156 ceph-mon[32679]: pgmap v6859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11804.463328 secs 2024-04-26T21:35:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11804.463328 secs 2024-04-26T21:35:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11804.463328 secs 2024-04-26T21:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:10 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11107.437124 secs 2024-04-26T21:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:10 smithi189 ceph-mon[32756]: pgmap v6860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:10 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11107.437124 secs 2024-04-26T21:35:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:10 smithi156 ceph-mon[32679]: pgmap v6860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:10 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11107.437124 secs 2024-04-26T21:35:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:10 smithi092 ceph-mon[29156]: pgmap v6860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:11 smithi092 ceph-mon[29156]: pgmap v6861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:11 smithi189 ceph-mon[32756]: pgmap v6861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:11 smithi156 ceph-mon[32679]: pgmap v6861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:13 smithi156 ceph-mon[32679]: pgmap v6862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:13 smithi092 ceph-mon[29156]: pgmap v6862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:13 smithi189 ceph-mon[32756]: pgmap v6862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11809.463425 secs 2024-04-26T21:35:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11112.437235 secs 2024-04-26T21:35:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11809.463425 secs 2024-04-26T21:35:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11112.437235 secs 2024-04-26T21:35:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11809.463425 secs 2024-04-26T21:35:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11112.437235 secs 2024-04-26T21:35:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:15 smithi092 ceph-mon[29156]: pgmap v6863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:15 smithi189 ceph-mon[32756]: pgmap v6863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:15 smithi156 ceph-mon[32679]: pgmap v6863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:17.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:17 smithi189 ceph-mon[32756]: pgmap v6864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:17 smithi092 ceph-mon[29156]: pgmap v6864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:17 smithi156 ceph-mon[32679]: pgmap v6864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11814.463540 secs 2024-04-26T21:35:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11814.463540 secs 2024-04-26T21:35:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11814.463540 secs 2024-04-26T21:35:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:20 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11117.437388 secs 2024-04-26T21:35:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:20 smithi189 ceph-mon[32756]: pgmap v6865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:20 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11117.437388 secs 2024-04-26T21:35:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:20 smithi156 ceph-mon[32679]: pgmap v6865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:20 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11117.437388 secs 2024-04-26T21:35:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:20 smithi092 ceph-mon[29156]: pgmap v6865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:21 smithi092 ceph-mon[29156]: pgmap v6866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:21 smithi189 ceph-mon[32756]: pgmap v6866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:21 smithi156 ceph-mon[32679]: pgmap v6866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:23 smithi092 ceph-mon[29156]: pgmap v6867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:23 smithi189 ceph-mon[32756]: pgmap v6867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:23 smithi156 ceph-mon[32679]: pgmap v6867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11819.463659 secs 2024-04-26T21:35:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11122.437476 secs 2024-04-26T21:35:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11819.463659 secs 2024-04-26T21:35:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11122.437476 secs 2024-04-26T21:35:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11819.463659 secs 2024-04-26T21:35:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11122.437476 secs 2024-04-26T21:35:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:25 smithi092 ceph-mon[29156]: pgmap v6868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:25 smithi189 ceph-mon[32756]: pgmap v6868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:25 smithi156 ceph-mon[32679]: pgmap v6868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: pgmap v6869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:35:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: pgmap v6870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: pgmap v6869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: pgmap v6870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:35:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:35:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:35:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:35:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: pgmap v6869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:35:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: pgmap v6870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:35:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:29 smithi092 ceph-mon[29156]: pgmap v6871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:35:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11824.463802 secs 2024-04-26T21:35:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11127.437587 secs 2024-04-26T21:35:29.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:29 smithi156 ceph-mon[32679]: pgmap v6871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:35:29.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11824.463802 secs 2024-04-26T21:35:29.637 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11127.437587 secs 2024-04-26T21:35:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:29 smithi189 ceph-mon[32756]: pgmap v6871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:35:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11824.463802 secs 2024-04-26T21:35:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11127.437587 secs 2024-04-26T21:35:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:31 smithi092 ceph-mon[29156]: pgmap v6872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:31 smithi189 ceph-mon[32756]: pgmap v6872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:31 smithi156 ceph-mon[32679]: pgmap v6872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:33 smithi092 ceph-mon[29156]: pgmap v6873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:33 smithi189 ceph-mon[32756]: pgmap v6873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:33 smithi156 ceph-mon[32679]: pgmap v6873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11829.463890 secs 2024-04-26T21:35:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11132.437652 secs 2024-04-26T21:35:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11829.463890 secs 2024-04-26T21:35:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11132.437652 secs 2024-04-26T21:35:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11829.463890 secs 2024-04-26T21:35:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11132.437652 secs 2024-04-26T21:35:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:35 smithi092 ceph-mon[29156]: pgmap v6874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:35 smithi189 ceph-mon[32756]: pgmap v6874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:35 smithi156 ceph-mon[32679]: pgmap v6874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:35:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:37 smithi092 ceph-mon[29156]: pgmap v6875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:35:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:37 smithi189 ceph-mon[32756]: pgmap v6875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:35:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:37 smithi156 ceph-mon[32679]: pgmap v6875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:39 smithi092 ceph-mon[29156]: pgmap v6876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11834.464003 secs 2024-04-26T21:35:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11137.437719 secs 2024-04-26T21:35:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:39 smithi189 ceph-mon[32756]: pgmap v6876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11834.464003 secs 2024-04-26T21:35:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11137.437719 secs 2024-04-26T21:35:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:39 smithi156 ceph-mon[32679]: pgmap v6876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11834.464003 secs 2024-04-26T21:35:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11137.437719 secs 2024-04-26T21:35:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:41 smithi092 ceph-mon[29156]: pgmap v6877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:41 smithi189 ceph-mon[32756]: pgmap v6877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:41 smithi156 ceph-mon[32679]: pgmap v6877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:43 smithi092 ceph-mon[29156]: pgmap v6878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:43 smithi189 ceph-mon[32756]: pgmap v6878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:43 smithi156 ceph-mon[32679]: pgmap v6878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11839.464070 secs 2024-04-26T21:35:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11142.437845 secs 2024-04-26T21:35:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11839.464070 secs 2024-04-26T21:35:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11142.437845 secs 2024-04-26T21:35:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11839.464070 secs 2024-04-26T21:35:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11142.437845 secs 2024-04-26T21:35:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:45 smithi092 ceph-mon[29156]: pgmap v6879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:45 smithi189 ceph-mon[32756]: pgmap v6879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:45 smithi156 ceph-mon[32679]: pgmap v6879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:47 smithi092 ceph-mon[29156]: pgmap v6880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:47 smithi189 ceph-mon[32756]: pgmap v6880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:47 smithi156 ceph-mon[32679]: pgmap v6880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:49 smithi092 ceph-mon[29156]: pgmap v6881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11844.464214 secs 2024-04-26T21:35:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11147.437969 secs 2024-04-26T21:35:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:49 smithi189 ceph-mon[32756]: pgmap v6881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11844.464214 secs 2024-04-26T21:35:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11147.437969 secs 2024-04-26T21:35:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:49 smithi156 ceph-mon[32679]: pgmap v6881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:35:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11844.464214 secs 2024-04-26T21:35:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11147.437969 secs 2024-04-26T21:35:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:51 smithi092 ceph-mon[29156]: pgmap v6882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:51 smithi189 ceph-mon[32756]: pgmap v6882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:51 smithi156 ceph-mon[32679]: pgmap v6882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:35:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:53 smithi092 ceph-mon[29156]: pgmap v6883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:53 smithi189 ceph-mon[32756]: pgmap v6883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:53 smithi156 ceph-mon[32679]: pgmap v6883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11849.464329 secs 2024-04-26T21:35:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11152.438071 secs 2024-04-26T21:35:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11849.464329 secs 2024-04-26T21:35:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11152.438071 secs 2024-04-26T21:35:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11849.464329 secs 2024-04-26T21:35:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11152.438071 secs 2024-04-26T21:35:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:55 smithi189 ceph-mon[32756]: pgmap v6884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:55 smithi156 ceph-mon[32679]: pgmap v6884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:55.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:55 smithi092 ceph-mon[29156]: pgmap v6884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:35:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:57 smithi189 ceph-mon[32756]: pgmap v6885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:57 smithi156 ceph-mon[32679]: pgmap v6885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:57 smithi092 ceph-mon[29156]: pgmap v6885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:59 smithi189 ceph-mon[32756]: pgmap v6886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11854.464451 secs 2024-04-26T21:35:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:35:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11157.438198 secs 2024-04-26T21:35:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:59 smithi156 ceph-mon[32679]: pgmap v6886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11854.464451 secs 2024-04-26T21:35:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:35:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11157.438198 secs 2024-04-26T21:35:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:59 smithi092 ceph-mon[29156]: pgmap v6886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:35:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11854.464451 secs 2024-04-26T21:35:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:35:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11157.438198 secs 2024-04-26T21:36:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:01 smithi189 ceph-mon[32756]: pgmap v6887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:01 smithi156 ceph-mon[32679]: pgmap v6887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:01 smithi092 ceph-mon[29156]: pgmap v6887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:03 smithi189 ceph-mon[32756]: pgmap v6888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:03 smithi156 ceph-mon[32679]: pgmap v6888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:03 smithi092 ceph-mon[29156]: pgmap v6888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11859.464516 secs 2024-04-26T21:36:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11162.438342 secs 2024-04-26T21:36:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11859.464516 secs 2024-04-26T21:36:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11162.438342 secs 2024-04-26T21:36:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11859.464516 secs 2024-04-26T21:36:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11162.438342 secs 2024-04-26T21:36:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:05 smithi189 ceph-mon[32756]: pgmap v6889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:05 smithi156 ceph-mon[32679]: pgmap v6889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:05 smithi092 ceph-mon[29156]: pgmap v6889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:07 smithi189 ceph-mon[32756]: pgmap v6890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:07 smithi156 ceph-mon[32679]: pgmap v6890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:07 smithi092 ceph-mon[29156]: pgmap v6890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:09 smithi189 ceph-mon[32756]: pgmap v6891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11864.464622 secs 2024-04-26T21:36:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11167.438459 secs 2024-04-26T21:36:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:09 smithi156 ceph-mon[32679]: pgmap v6891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11864.464622 secs 2024-04-26T21:36:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11167.438459 secs 2024-04-26T21:36:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:09 smithi092 ceph-mon[29156]: pgmap v6891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11864.464622 secs 2024-04-26T21:36:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11167.438459 secs 2024-04-26T21:36:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:11 smithi189 ceph-mon[32756]: pgmap v6892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:11 smithi156 ceph-mon[32679]: pgmap v6892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:11 smithi092 ceph-mon[29156]: pgmap v6892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:13 smithi189 ceph-mon[32756]: pgmap v6893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:13 smithi156 ceph-mon[32679]: pgmap v6893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:13 smithi092 ceph-mon[29156]: pgmap v6893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11869.464742 secs 2024-04-26T21:36:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11172.438596 secs 2024-04-26T21:36:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11869.464742 secs 2024-04-26T21:36:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11172.438596 secs 2024-04-26T21:36:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11869.464742 secs 2024-04-26T21:36:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11172.438596 secs 2024-04-26T21:36:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:15 smithi156 ceph-mon[32679]: pgmap v6894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:15 smithi092 ceph-mon[29156]: pgmap v6894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:15 smithi189 ceph-mon[32756]: pgmap v6894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:17 smithi156 ceph-mon[32679]: pgmap v6895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:17.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:17 smithi189 ceph-mon[32756]: pgmap v6895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:17 smithi092 ceph-mon[29156]: pgmap v6895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:18 smithi156 ceph-mon[32679]: pgmap v6896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:18 smithi092 ceph-mon[29156]: pgmap v6896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:18 smithi189 ceph-mon[32756]: pgmap v6896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11874.464856 secs 2024-04-26T21:36:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11177.438704 secs 2024-04-26T21:36:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11874.464856 secs 2024-04-26T21:36:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11177.438704 secs 2024-04-26T21:36:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11874.464856 secs 2024-04-26T21:36:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11177.438704 secs 2024-04-26T21:36:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:20 smithi156 ceph-mon[32679]: pgmap v6897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:20 smithi092 ceph-mon[29156]: pgmap v6897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:20 smithi189 ceph-mon[32756]: pgmap v6897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:23 smithi092 ceph-mon[29156]: pgmap v6898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:23 smithi189 ceph-mon[32756]: pgmap v6898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:23 smithi156 ceph-mon[32679]: pgmap v6898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11879.464975 secs 2024-04-26T21:36:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11182.438816 secs 2024-04-26T21:36:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11879.464975 secs 2024-04-26T21:36:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11182.438816 secs 2024-04-26T21:36:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11879.464975 secs 2024-04-26T21:36:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11182.438816 secs 2024-04-26T21:36:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:25 smithi092 ceph-mon[29156]: pgmap v6899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:25 smithi189 ceph-mon[32756]: pgmap v6899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:25 smithi156 ceph-mon[32679]: pgmap v6899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:27 smithi092 ceph-mon[29156]: pgmap v6900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:36:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:27 smithi189 ceph-mon[32756]: pgmap v6900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:36:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:27 smithi156 ceph-mon[32679]: pgmap v6900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:36:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:36:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:36:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:36:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:28 smithi092 ceph-mon[29156]: pgmap v6901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:36:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:28 smithi092 ceph-mon[29156]: pgmap v6902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:28 smithi189 ceph-mon[32756]: pgmap v6901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:36:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:28 smithi189 ceph-mon[32756]: pgmap v6902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:28 smithi156 ceph-mon[32679]: pgmap v6901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:36:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:28 smithi156 ceph-mon[32679]: pgmap v6902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11884.465087 secs 2024-04-26T21:36:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11187.438888 secs 2024-04-26T21:36:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11884.465087 secs 2024-04-26T21:36:29.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11187.438888 secs 2024-04-26T21:36:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11884.465087 secs 2024-04-26T21:36:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11187.438888 secs 2024-04-26T21:36:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:30 smithi092 ceph-mon[29156]: pgmap v6903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:30 smithi189 ceph-mon[32756]: pgmap v6903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:30 smithi156 ceph-mon[32679]: pgmap v6903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:32 smithi092 ceph-mon[29156]: pgmap v6904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:32 smithi189 ceph-mon[32756]: pgmap v6904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:32 smithi156 ceph-mon[32679]: pgmap v6904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:34 smithi092 ceph-mon[29156]: pgmap v6905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:36:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11889.465199 secs 2024-04-26T21:36:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11192.438983 secs 2024-04-26T21:36:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:34 smithi189 ceph-mon[32756]: pgmap v6905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:36:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11889.465199 secs 2024-04-26T21:36:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11192.438983 secs 2024-04-26T21:36:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:34 smithi156 ceph-mon[32679]: pgmap v6905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:36:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11889.465199 secs 2024-04-26T21:36:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11192.438983 secs 2024-04-26T21:36:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:36 smithi189 ceph-mon[32756]: pgmap v6906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:36 smithi156 ceph-mon[32679]: pgmap v6906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:36 smithi092 ceph-mon[29156]: pgmap v6906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 94 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:36:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:36:37.605+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 95 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006660 con 0x5617fb906f00 2024-04-26T21:36:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:38 smithi189 ceph-mon[32756]: pgmap v6907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:36:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:38 smithi156 ceph-mon[32679]: pgmap v6907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:36:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:38 smithi092 ceph-mon[29156]: pgmap v6907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:36:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11894.465291 secs 2024-04-26T21:36:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11197.439101 secs 2024-04-26T21:36:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11894.465291 secs 2024-04-26T21:36:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11197.439101 secs 2024-04-26T21:36:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11894.465291 secs 2024-04-26T21:36:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11197.439101 secs 2024-04-26T21:36:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:40 smithi189 ceph-mon[32756]: pgmap v6908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:40 smithi156 ceph-mon[32679]: pgmap v6908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:40 smithi092 ceph-mon[29156]: pgmap v6908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:42 smithi189 ceph-mon[32756]: pgmap v6909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:42 smithi156 ceph-mon[32679]: pgmap v6909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:42 smithi092 ceph-mon[29156]: pgmap v6909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:44 smithi189 ceph-mon[32756]: pgmap v6910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11899.465358 secs 2024-04-26T21:36:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11202.439212 secs 2024-04-26T21:36:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:44 smithi156 ceph-mon[32679]: pgmap v6910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11899.465358 secs 2024-04-26T21:36:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11202.439212 secs 2024-04-26T21:36:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:44 smithi092 ceph-mon[29156]: pgmap v6910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11899.465358 secs 2024-04-26T21:36:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11202.439212 secs 2024-04-26T21:36:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:46 smithi189 ceph-mon[32756]: pgmap v6911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:46 smithi156 ceph-mon[32679]: pgmap v6911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:46 smithi092 ceph-mon[29156]: pgmap v6911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:48 smithi189 ceph-mon[32756]: pgmap v6912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:48 smithi156 ceph-mon[32679]: pgmap v6912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:48 smithi092 ceph-mon[29156]: pgmap v6912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T21:36:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11904.465420 secs 2024-04-26T21:36:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11207.439325 secs 2024-04-26T21:36:49.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11904.465420 secs 2024-04-26T21:36:49.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11207.439325 secs 2024-04-26T21:36:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11904.465420 secs 2024-04-26T21:36:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11207.439325 secs 2024-04-26T21:36:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:50 smithi189 ceph-mon[32756]: pgmap v6913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:50 smithi156 ceph-mon[32679]: pgmap v6913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:50 smithi092 ceph-mon[29156]: pgmap v6913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T21:36:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:52 smithi189 ceph-mon[32756]: pgmap v6914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:52 smithi156 ceph-mon[32679]: pgmap v6914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:52 smithi092 ceph-mon[29156]: pgmap v6914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:54 smithi189 ceph-mon[32756]: pgmap v6915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11909.465540 secs 2024-04-26T21:36:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11212.439388 secs 2024-04-26T21:36:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:54 smithi156 ceph-mon[32679]: pgmap v6915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11909.465540 secs 2024-04-26T21:36:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11212.439388 secs 2024-04-26T21:36:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:54 smithi092 ceph-mon[29156]: pgmap v6915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11909.465540 secs 2024-04-26T21:36:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11212.439388 secs 2024-04-26T21:36:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:56 smithi189 ceph-mon[32756]: pgmap v6916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:56 smithi156 ceph-mon[32679]: pgmap v6916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:56 smithi092 ceph-mon[29156]: pgmap v6916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:36:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:58 smithi189 ceph-mon[32756]: pgmap v6917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:58 smithi156 ceph-mon[32679]: pgmap v6917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:58 smithi092 ceph-mon[29156]: pgmap v6917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:36:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11914.465672 secs 2024-04-26T21:36:59.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:36:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11217.439472 secs 2024-04-26T21:36:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11914.465672 secs 2024-04-26T21:36:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:36:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11217.439472 secs 2024-04-26T21:36:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11914.465672 secs 2024-04-26T21:36:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:36:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11217.439472 secs 2024-04-26T21:37:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:00 smithi189 ceph-mon[32756]: pgmap v6918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:00 smithi156 ceph-mon[32679]: pgmap v6918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:00 smithi092 ceph-mon[29156]: pgmap v6918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:02 smithi189 ceph-mon[32756]: pgmap v6919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:02 smithi156 ceph-mon[32679]: pgmap v6919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:02 smithi092 ceph-mon[29156]: pgmap v6919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:04.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:37:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:37:03.987+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:37:04.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:37:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:37:03.987+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:37:04.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:37:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:37:03.987+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:37:04.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:37:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:37:03.987+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:37:04.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:37:03 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:37:03.987+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:37:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:04 smithi189 ceph-mon[32756]: pgmap v6920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11919.465775 secs 2024-04-26T21:37:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11222.439586 secs 2024-04-26T21:37:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:04 smithi156 ceph-mon[32679]: pgmap v6920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11919.465775 secs 2024-04-26T21:37:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11222.439586 secs 2024-04-26T21:37:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:04 smithi092 ceph-mon[29156]: pgmap v6920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11919.465775 secs 2024-04-26T21:37:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11222.439586 secs 2024-04-26T21:37:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:06 smithi189 ceph-mon[32756]: pgmap v6921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:06 smithi156 ceph-mon[32679]: pgmap v6921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:06 smithi092 ceph-mon[29156]: pgmap v6921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:08 smithi189 ceph-mon[32756]: pgmap v6922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:08 smithi156 ceph-mon[32679]: pgmap v6922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:08 smithi092 ceph-mon[29156]: pgmap v6922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11924.465891 secs 2024-04-26T21:37:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11227.439699 secs 2024-04-26T21:37:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11924.465891 secs 2024-04-26T21:37:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11227.439699 secs 2024-04-26T21:37:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11924.465891 secs 2024-04-26T21:37:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11227.439699 secs 2024-04-26T21:37:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:10 smithi189 ceph-mon[32756]: pgmap v6923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:10 smithi156 ceph-mon[32679]: pgmap v6923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:10 smithi092 ceph-mon[29156]: pgmap v6923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:12 smithi189 ceph-mon[32756]: pgmap v6924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:12 smithi156 ceph-mon[32679]: pgmap v6924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:12 smithi092 ceph-mon[29156]: pgmap v6924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:14 smithi189 ceph-mon[32756]: pgmap v6925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11929.465983 secs 2024-04-26T21:37:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11232.439838 secs 2024-04-26T21:37:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:14 smithi156 ceph-mon[32679]: pgmap v6925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11929.465983 secs 2024-04-26T21:37:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11232.439838 secs 2024-04-26T21:37:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:14 smithi092 ceph-mon[29156]: pgmap v6925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11929.465983 secs 2024-04-26T21:37:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11232.439838 secs 2024-04-26T21:37:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:16 smithi189 ceph-mon[32756]: pgmap v6926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:16 smithi156 ceph-mon[32679]: pgmap v6926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:16 smithi092 ceph-mon[29156]: pgmap v6926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:18 smithi189 ceph-mon[32756]: pgmap v6927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:18 smithi156 ceph-mon[32679]: pgmap v6927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:18 smithi092 ceph-mon[29156]: pgmap v6927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:37:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11934.466125 secs 2024-04-26T21:37:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11237.439972 secs 2024-04-26T21:37:19.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11934.466125 secs 2024-04-26T21:37:19.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11237.439972 secs 2024-04-26T21:37:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11934.466125 secs 2024-04-26T21:37:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11237.439972 secs 2024-04-26T21:37:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:20 smithi189 ceph-mon[32756]: pgmap v6928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:20 smithi156 ceph-mon[32679]: pgmap v6928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:20 smithi092 ceph-mon[29156]: pgmap v6928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:37:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:22 smithi189 ceph-mon[32756]: pgmap v6929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:22 smithi156 ceph-mon[32679]: pgmap v6929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:22 smithi092 ceph-mon[29156]: pgmap v6929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:24 smithi189 ceph-mon[32756]: pgmap v6930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11939.466241 secs 2024-04-26T21:37:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11242.440047 secs 2024-04-26T21:37:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:24 smithi156 ceph-mon[32679]: pgmap v6930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11939.466241 secs 2024-04-26T21:37:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11242.440047 secs 2024-04-26T21:37:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:24 smithi092 ceph-mon[29156]: pgmap v6930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11939.466241 secs 2024-04-26T21:37:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11242.440047 secs 2024-04-26T21:37:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:26 smithi189 ceph-mon[32756]: pgmap v6931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:26 smithi156 ceph-mon[32679]: pgmap v6931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:26 smithi092 ceph-mon[29156]: pgmap v6931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:37:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:28 smithi189 ceph-mon[32756]: pgmap v6932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:37:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:28 smithi156 ceph-mon[32679]: pgmap v6932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:37:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:28 smithi092 ceph-mon[29156]: pgmap v6932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:37:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:37:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:37:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:29 smithi189 ceph-mon[32756]: pgmap v6933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:37:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:29 smithi189 ceph-mon[32756]: pgmap v6934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:37:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11944.466346 secs 2024-04-26T21:37:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11247.440141 secs 2024-04-26T21:37:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:29 smithi156 ceph-mon[32679]: pgmap v6933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:37:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:29 smithi156 ceph-mon[32679]: pgmap v6934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:37:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11944.466346 secs 2024-04-26T21:37:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11247.440141 secs 2024-04-26T21:37:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:29 smithi092 ceph-mon[29156]: pgmap v6933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:37:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:29 smithi092 ceph-mon[29156]: pgmap v6934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:37:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11944.466346 secs 2024-04-26T21:37:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11247.440141 secs 2024-04-26T21:37:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:31 smithi189 ceph-mon[32756]: pgmap v6935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:31 smithi156 ceph-mon[32679]: pgmap v6935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:31 smithi092 ceph-mon[29156]: pgmap v6935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:33 smithi189 ceph-mon[32756]: pgmap v6936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:33 smithi156 ceph-mon[32679]: pgmap v6936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:33 smithi092 ceph-mon[29156]: pgmap v6936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11949.466487 secs 2024-04-26T21:37:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11252.440285 secs 2024-04-26T21:37:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11949.466487 secs 2024-04-26T21:37:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11252.440285 secs 2024-04-26T21:37:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11949.466487 secs 2024-04-26T21:37:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11252.440285 secs 2024-04-26T21:37:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:35 smithi189 ceph-mon[32756]: pgmap v6937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:35 smithi156 ceph-mon[32679]: pgmap v6937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:35 smithi092 ceph-mon[29156]: pgmap v6937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:37 smithi189 ceph-mon[32756]: pgmap v6938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:37 smithi156 ceph-mon[32679]: pgmap v6938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:37 smithi092 ceph-mon[29156]: pgmap v6938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:37:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:39 smithi156 ceph-mon[32679]: pgmap v6939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:37:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11954.466621 secs 2024-04-26T21:37:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11257.440373 secs 2024-04-26T21:37:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:39 smithi092 ceph-mon[29156]: pgmap v6939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:37:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11954.466621 secs 2024-04-26T21:37:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11257.440373 secs 2024-04-26T21:37:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:39 smithi189 ceph-mon[32756]: pgmap v6939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:37:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11954.466621 secs 2024-04-26T21:37:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11257.440373 secs 2024-04-26T21:37:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:40 smithi156 ceph-mon[32679]: pgmap v6940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:40 smithi092 ceph-mon[29156]: pgmap v6940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:40 smithi189 ceph-mon[32756]: pgmap v6940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:42 smithi189 ceph-mon[32756]: pgmap v6941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:42 smithi156 ceph-mon[32679]: pgmap v6941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:42 smithi092 ceph-mon[29156]: pgmap v6941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11959.466757 secs 2024-04-26T21:37:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11262.440458 secs 2024-04-26T21:37:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:44 smithi189 ceph-mon[32756]: pgmap v6942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11959.466757 secs 2024-04-26T21:37:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11262.440458 secs 2024-04-26T21:37:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:44 smithi156 ceph-mon[32679]: pgmap v6942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11959.466757 secs 2024-04-26T21:37:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11262.440458 secs 2024-04-26T21:37:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:44 smithi092 ceph-mon[29156]: pgmap v6942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:46 smithi189 ceph-mon[32756]: pgmap v6943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:46 smithi156 ceph-mon[32679]: pgmap v6943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:46 smithi092 ceph-mon[29156]: pgmap v6943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:49.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:48 smithi092 ceph-mon[29156]: pgmap v6944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:48 smithi189 ceph-mon[32756]: pgmap v6944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:48 smithi156 ceph-mon[32679]: pgmap v6944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11964.466876 secs 2024-04-26T21:37:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11267.440523 secs 2024-04-26T21:37:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11964.466876 secs 2024-04-26T21:37:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11267.440523 secs 2024-04-26T21:37:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11964.466876 secs 2024-04-26T21:37:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11267.440523 secs 2024-04-26T21:37:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:50 smithi189 ceph-mon[32756]: pgmap v6945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:50 smithi156 ceph-mon[32679]: pgmap v6945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:50 smithi092 ceph-mon[29156]: pgmap v6945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:52 smithi189 ceph-mon[32756]: pgmap v6946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:52 smithi156 ceph-mon[32679]: pgmap v6946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:52 smithi092 ceph-mon[29156]: pgmap v6946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11969.466970 secs 2024-04-26T21:37:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11272.440593 secs 2024-04-26T21:37:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:54 smithi189 ceph-mon[32756]: pgmap v6947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11969.466970 secs 2024-04-26T21:37:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11272.440593 secs 2024-04-26T21:37:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:54 smithi156 ceph-mon[32679]: pgmap v6947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11969.466970 secs 2024-04-26T21:37:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11272.440593 secs 2024-04-26T21:37:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:54 smithi092 ceph-mon[29156]: pgmap v6947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:37:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:56 smithi189 ceph-mon[32756]: pgmap v6948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:56 smithi156 ceph-mon[32679]: pgmap v6948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:57.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:56 smithi092 ceph-mon[29156]: pgmap v6948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:58 smithi189 ceph-mon[32756]: pgmap v6949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:58 smithi156 ceph-mon[32679]: pgmap v6949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:58 smithi092 ceph-mon[29156]: pgmap v6949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:37:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11974.467090 secs 2024-04-26T21:37:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:37:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11277.440682 secs 2024-04-26T21:38:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11974.467090 secs 2024-04-26T21:38:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:37:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11277.440682 secs 2024-04-26T21:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11974.467090 secs 2024-04-26T21:38:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:37:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11277.440682 secs 2024-04-26T21:38:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:00 smithi189 ceph-mon[32756]: pgmap v6950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:00 smithi156 ceph-mon[32679]: pgmap v6950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:00 smithi092 ceph-mon[29156]: pgmap v6950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:02 smithi189 ceph-mon[32756]: pgmap v6951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:02 smithi156 ceph-mon[32679]: pgmap v6951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:02 smithi092 ceph-mon[29156]: pgmap v6951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11979.467201 secs 2024-04-26T21:38:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11282.440762 secs 2024-04-26T21:38:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:04 smithi189 ceph-mon[32756]: pgmap v6952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11979.467201 secs 2024-04-26T21:38:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11282.440762 secs 2024-04-26T21:38:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:04 smithi156 ceph-mon[32679]: pgmap v6952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11979.467201 secs 2024-04-26T21:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11282.440762 secs 2024-04-26T21:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:04 smithi092 ceph-mon[29156]: pgmap v6952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:06 smithi189 ceph-mon[32756]: pgmap v6953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:06 smithi156 ceph-mon[32679]: pgmap v6953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:06 smithi092 ceph-mon[29156]: pgmap v6953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:08 smithi189 ceph-mon[32756]: pgmap v6954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:08 smithi156 ceph-mon[32679]: pgmap v6954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:08 smithi092 ceph-mon[29156]: pgmap v6954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11984.467303 secs 2024-04-26T21:38:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11287.440892 secs 2024-04-26T21:38:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11984.467303 secs 2024-04-26T21:38:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11287.440892 secs 2024-04-26T21:38:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11984.467303 secs 2024-04-26T21:38:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11287.440892 secs 2024-04-26T21:38:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:10 smithi189 ceph-mon[32756]: pgmap v6955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:10 smithi156 ceph-mon[32679]: pgmap v6955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:10 smithi092 ceph-mon[29156]: pgmap v6955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:12 smithi189 ceph-mon[32756]: pgmap v6956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:12 smithi156 ceph-mon[32679]: pgmap v6956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:12 smithi092 ceph-mon[29156]: pgmap v6956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:38:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11989.467397 secs 2024-04-26T21:38:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11292.441016 secs 2024-04-26T21:38:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:14 smithi189 ceph-mon[32756]: pgmap v6957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11989.467397 secs 2024-04-26T21:38:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11292.441016 secs 2024-04-26T21:38:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:14 smithi156 ceph-mon[32679]: pgmap v6957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11989.467397 secs 2024-04-26T21:38:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11292.441016 secs 2024-04-26T21:38:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:14 smithi092 ceph-mon[29156]: pgmap v6957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:38:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:16 smithi189 ceph-mon[32756]: pgmap v6958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:16 smithi156 ceph-mon[32679]: pgmap v6958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:16 smithi092 ceph-mon[29156]: pgmap v6958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:18 smithi189 ceph-mon[32756]: pgmap v6959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:18 smithi156 ceph-mon[32679]: pgmap v6959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:18 smithi092 ceph-mon[29156]: pgmap v6959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11994.467512 secs 2024-04-26T21:38:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11297.441124 secs 2024-04-26T21:38:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11994.467512 secs 2024-04-26T21:38:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11297.441124 secs 2024-04-26T21:38:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11994.467512 secs 2024-04-26T21:38:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11297.441124 secs 2024-04-26T21:38:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:20 smithi189 ceph-mon[32756]: pgmap v6960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:20 smithi156 ceph-mon[32679]: pgmap v6960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:20 smithi092 ceph-mon[29156]: pgmap v6960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:22 smithi189 ceph-mon[32756]: pgmap v6961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:22 smithi156 ceph-mon[32679]: pgmap v6961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:22 smithi092 ceph-mon[29156]: pgmap v6961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 11999.467631 secs 2024-04-26T21:38:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11302.441223 secs 2024-04-26T21:38:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:24 smithi189 ceph-mon[32756]: pgmap v6962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 11999.467631 secs 2024-04-26T21:38:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11302.441223 secs 2024-04-26T21:38:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:24 smithi156 ceph-mon[32679]: pgmap v6962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 11999.467631 secs 2024-04-26T21:38:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11302.441223 secs 2024-04-26T21:38:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:24 smithi092 ceph-mon[29156]: pgmap v6962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:26 smithi189 ceph-mon[32756]: pgmap v6963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:26 smithi156 ceph-mon[32679]: pgmap v6963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:26 smithi092 ceph-mon[29156]: pgmap v6963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:38:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:28 smithi189 ceph-mon[32756]: pgmap v6964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:38:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:28 smithi156 ceph-mon[32679]: pgmap v6964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:28 smithi092 ceph-mon[29156]: pgmap v6964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:38:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12004.467750 secs 2024-04-26T21:38:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:29 smithi189 ceph-mon[32756]: pgmap v6965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:38:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:29 smithi189 ceph-mon[32756]: pgmap v6966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11307.441367 secs 2024-04-26T21:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12004.467750 secs 2024-04-26T21:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:29 smithi156 ceph-mon[32679]: pgmap v6965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:29 smithi156 ceph-mon[32679]: pgmap v6966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11307.441367 secs 2024-04-26T21:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12004.467750 secs 2024-04-26T21:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:29 smithi092 ceph-mon[29156]: pgmap v6965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:29 smithi092 ceph-mon[29156]: pgmap v6966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11307.441367 secs 2024-04-26T21:38:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:31 smithi189 ceph-mon[32756]: pgmap v6967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:31 smithi156 ceph-mon[32679]: pgmap v6967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:31 smithi092 ceph-mon[29156]: pgmap v6967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:33 smithi189 ceph-mon[32756]: pgmap v6968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:33 smithi156 ceph-mon[32679]: pgmap v6968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:33 smithi092 ceph-mon[29156]: pgmap v6968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:38:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12009.467869 secs 2024-04-26T21:38:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11312.441478 secs 2024-04-26T21:38:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12009.467869 secs 2024-04-26T21:38:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11312.441478 secs 2024-04-26T21:38:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12009.467869 secs 2024-04-26T21:38:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11312.441478 secs 2024-04-26T21:38:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:35 smithi189 ceph-mon[32756]: pgmap v6969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:35 smithi156 ceph-mon[32679]: pgmap v6969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:35 smithi092 ceph-mon[29156]: pgmap v6969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:37 smithi189 ceph-mon[32756]: pgmap v6970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:37 smithi156 ceph-mon[32679]: pgmap v6970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:37 smithi092 ceph-mon[29156]: pgmap v6970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:38:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12014.467962 secs 2024-04-26T21:38:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:39 smithi189 ceph-mon[32756]: pgmap v6971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:38:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11317.441579 secs 2024-04-26T21:38:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12014.467962 secs 2024-04-26T21:38:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:39 smithi156 ceph-mon[32679]: pgmap v6971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:38:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11317.441579 secs 2024-04-26T21:38:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12014.467962 secs 2024-04-26T21:38:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:39 smithi092 ceph-mon[29156]: pgmap v6971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:38:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11317.441579 secs 2024-04-26T21:38:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:41 smithi189 ceph-mon[32756]: pgmap v6972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:41 smithi156 ceph-mon[32679]: pgmap v6972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:41 smithi092 ceph-mon[29156]: pgmap v6972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:43 smithi189 ceph-mon[32756]: pgmap v6973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:43 smithi156 ceph-mon[32679]: pgmap v6973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:43 smithi092 ceph-mon[29156]: pgmap v6973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12019.468085 secs 2024-04-26T21:38:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11322.441717 secs 2024-04-26T21:38:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12019.468085 secs 2024-04-26T21:38:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11322.441717 secs 2024-04-26T21:38:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12019.468085 secs 2024-04-26T21:38:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11322.441717 secs 2024-04-26T21:38:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:45 smithi156 ceph-mon[32679]: pgmap v6974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:45 smithi092 ceph-mon[29156]: pgmap v6974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:46.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:45 smithi189 ceph-mon[32756]: pgmap v6974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:47 smithi156 ceph-mon[32679]: pgmap v6975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:48.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:47 smithi189 ceph-mon[32756]: pgmap v6975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:47 smithi092 ceph-mon[29156]: pgmap v6975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12024.468187 secs 2024-04-26T21:38:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:49 smithi156 ceph-mon[32679]: pgmap v6976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11327.441837 secs 2024-04-26T21:38:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12024.468187 secs 2024-04-26T21:38:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:49 smithi092 ceph-mon[29156]: pgmap v6976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11327.441837 secs 2024-04-26T21:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12024.468187 secs 2024-04-26T21:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:49 smithi189 ceph-mon[32756]: pgmap v6976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11327.441837 secs 2024-04-26T21:38:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:51 smithi156 ceph-mon[32679]: pgmap v6977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:51 smithi092 ceph-mon[29156]: pgmap v6977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:51 smithi189 ceph-mon[32756]: pgmap v6977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:53 smithi156 ceph-mon[32679]: pgmap v6978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:53 smithi092 ceph-mon[29156]: pgmap v6978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:53 smithi189 ceph-mon[32756]: pgmap v6978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12029.468306 secs 2024-04-26T21:38:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11332.441968 secs 2024-04-26T21:38:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12029.468306 secs 2024-04-26T21:38:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11332.441968 secs 2024-04-26T21:38:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12029.468306 secs 2024-04-26T21:38:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11332.441968 secs 2024-04-26T21:38:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:55 smithi156 ceph-mon[32679]: pgmap v6979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:55 smithi092 ceph-mon[29156]: pgmap v6979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:55 smithi189 ceph-mon[32756]: pgmap v6979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:38:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:57 smithi156 ceph-mon[32679]: pgmap v6980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:57 smithi092 ceph-mon[29156]: pgmap v6980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:38:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:57 smithi189 ceph-mon[32756]: pgmap v6980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12034.468442 secs 2024-04-26T21:39:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:59 smithi156 ceph-mon[32679]: pgmap v6981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:38:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11337.442107 secs 2024-04-26T21:39:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12034.468442 secs 2024-04-26T21:39:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:59 smithi092 ceph-mon[29156]: pgmap v6981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:38:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11337.442107 secs 2024-04-26T21:39:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12034.468442 secs 2024-04-26T21:39:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:59 smithi189 ceph-mon[32756]: pgmap v6981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:38:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11337.442107 secs 2024-04-26T21:39:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:01 smithi156 ceph-mon[32679]: pgmap v6982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:01 smithi092 ceph-mon[29156]: pgmap v6982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:01 smithi189 ceph-mon[32756]: pgmap v6982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:03 smithi156 ceph-mon[32679]: pgmap v6983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:03 smithi092 ceph-mon[29156]: pgmap v6983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:03 smithi189 ceph-mon[32756]: pgmap v6983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12039.468566 secs 2024-04-26T21:39:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11342.442169 secs 2024-04-26T21:39:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12039.468566 secs 2024-04-26T21:39:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11342.442169 secs 2024-04-26T21:39:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12039.468566 secs 2024-04-26T21:39:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11342.442169 secs 2024-04-26T21:39:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:05 smithi156 ceph-mon[32679]: pgmap v6984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:05 smithi092 ceph-mon[29156]: pgmap v6984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:05 smithi189 ceph-mon[32756]: pgmap v6984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:07 smithi092 ceph-mon[29156]: pgmap v6985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:07 smithi189 ceph-mon[32756]: pgmap v6985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:07 smithi156 ceph-mon[32679]: pgmap v6985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12044.468682 secs 2024-04-26T21:39:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:09 smithi092 ceph-mon[29156]: pgmap v6986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11347.442288 secs 2024-04-26T21:39:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12044.468682 secs 2024-04-26T21:39:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:09 smithi189 ceph-mon[32756]: pgmap v6986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11347.442288 secs 2024-04-26T21:39:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12044.468682 secs 2024-04-26T21:39:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:09 smithi156 ceph-mon[32679]: pgmap v6986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11347.442288 secs 2024-04-26T21:39:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:11 smithi092 ceph-mon[29156]: pgmap v6987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:11 smithi189 ceph-mon[32756]: pgmap v6987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:11 smithi156 ceph-mon[32679]: pgmap v6987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:13 smithi092 ceph-mon[29156]: pgmap v6988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:13 smithi189 ceph-mon[32756]: pgmap v6988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:13 smithi156 ceph-mon[32679]: pgmap v6988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12049.468809 secs 2024-04-26T21:39:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11352.442417 secs 2024-04-26T21:39:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12049.468809 secs 2024-04-26T21:39:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11352.442417 secs 2024-04-26T21:39:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12049.468809 secs 2024-04-26T21:39:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11352.442417 secs 2024-04-26T21:39:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:15 smithi092 ceph-mon[29156]: pgmap v6989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:15 smithi189 ceph-mon[32756]: pgmap v6989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:15 smithi156 ceph-mon[32679]: pgmap v6989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:17 smithi092 ceph-mon[29156]: pgmap v6990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:17 smithi189 ceph-mon[32756]: pgmap v6990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:17 smithi156 ceph-mon[32679]: pgmap v6990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12054.468924 secs 2024-04-26T21:39:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:19 smithi092 ceph-mon[29156]: pgmap v6991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11357.442535 secs 2024-04-26T21:39:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12054.468924 secs 2024-04-26T21:39:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:19 smithi189 ceph-mon[32756]: pgmap v6991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11357.442535 secs 2024-04-26T21:39:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12054.468924 secs 2024-04-26T21:39:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:19 smithi156 ceph-mon[32679]: pgmap v6991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11357.442535 secs 2024-04-26T21:39:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:21 smithi092 ceph-mon[29156]: pgmap v6992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:21 smithi189 ceph-mon[32756]: pgmap v6992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:21 smithi156 ceph-mon[32679]: pgmap v6992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:23 smithi092 ceph-mon[29156]: pgmap v6993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:23 smithi189 ceph-mon[32756]: pgmap v6993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:23 smithi156 ceph-mon[32679]: pgmap v6993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12059.469054 secs 2024-04-26T21:39:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11362.442689 secs 2024-04-26T21:39:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12059.469054 secs 2024-04-26T21:39:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11362.442689 secs 2024-04-26T21:39:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12059.469054 secs 2024-04-26T21:39:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11362.442689 secs 2024-04-26T21:39:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:25 smithi092 ceph-mon[29156]: pgmap v6994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:25 smithi189 ceph-mon[32756]: pgmap v6994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:25 smithi156 ceph-mon[32679]: pgmap v6994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:27 smithi092 ceph-mon[29156]: pgmap v6995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:27 smithi189 ceph-mon[32756]: pgmap v6995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:27 smithi156 ceph-mon[32679]: pgmap v6995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12064.469176 secs 2024-04-26T21:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: pgmap v6996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11367.442779 secs 2024-04-26T21:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: pgmap v6997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:39:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: pgmap v6998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:39:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12064.469176 secs 2024-04-26T21:39:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: pgmap v6996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11367.442779 secs 2024-04-26T21:39:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: pgmap v6997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:39:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: pgmap v6998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12064.469176 secs 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: pgmap v6996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11367.442779 secs 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: pgmap v6997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: pgmap v6998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:39:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:32 smithi189 ceph-mon[32756]: pgmap v6999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:32 smithi156 ceph-mon[32679]: pgmap v6999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:32 smithi092 ceph-mon[29156]: pgmap v6999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:34 smithi189 ceph-mon[32756]: pgmap v7000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12069.469289 secs 2024-04-26T21:39:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11372.442904 secs 2024-04-26T21:39:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:34 smithi156 ceph-mon[32679]: pgmap v7000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12069.469289 secs 2024-04-26T21:39:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11372.442904 secs 2024-04-26T21:39:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:34 smithi092 ceph-mon[29156]: pgmap v7000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:39:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12069.469289 secs 2024-04-26T21:39:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11372.442904 secs 2024-04-26T21:39:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:36 smithi189 ceph-mon[32756]: pgmap v7001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:36 smithi156 ceph-mon[32679]: pgmap v7001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:36 smithi092 ceph-mon[29156]: pgmap v7001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:39:37.631+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:39:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:39:37.631+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:39:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:39:37.631+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:39:37.632 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:39:37.631+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 96 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:39:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:38 smithi189 ceph-mon[32756]: pgmap v7002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:38 smithi156 ceph-mon[32679]: pgmap v7002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:38 smithi092 ceph-mon[29156]: pgmap v7002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:39:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12074.469404 secs 2024-04-26T21:39:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11377.443018 secs 2024-04-26T21:39:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12074.469404 secs 2024-04-26T21:39:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11377.443018 secs 2024-04-26T21:39:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12074.469404 secs 2024-04-26T21:39:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11377.443018 secs 2024-04-26T21:39:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:40 smithi189 ceph-mon[32756]: pgmap v7003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:39:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:40 smithi156 ceph-mon[32679]: pgmap v7003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:39:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:40 smithi092 ceph-mon[29156]: pgmap v7003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:39:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:42 smithi189 ceph-mon[32756]: pgmap v7004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:42 smithi156 ceph-mon[32679]: pgmap v7004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:42 smithi092 ceph-mon[29156]: pgmap v7004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:44 smithi189 ceph-mon[32756]: pgmap v7005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12079.469524 secs 2024-04-26T21:39:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11382.443150 secs 2024-04-26T21:39:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:44 smithi156 ceph-mon[32679]: pgmap v7005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12079.469524 secs 2024-04-26T21:39:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11382.443150 secs 2024-04-26T21:39:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:44 smithi092 ceph-mon[29156]: pgmap v7005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12079.469524 secs 2024-04-26T21:39:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11382.443150 secs 2024-04-26T21:39:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:46 smithi189 ceph-mon[32756]: pgmap v7006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:46 smithi156 ceph-mon[32679]: pgmap v7006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:46 smithi092 ceph-mon[29156]: pgmap v7006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:48 smithi189 ceph-mon[32756]: pgmap v7007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:48.669 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:48 smithi092 ceph-mon[29156]: pgmap v7007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:48 smithi156 ceph-mon[32679]: pgmap v7007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12084.469645 secs 2024-04-26T21:39:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11387.443235 secs 2024-04-26T21:39:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12084.469645 secs 2024-04-26T21:39:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11387.443235 secs 2024-04-26T21:39:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12084.469645 secs 2024-04-26T21:39:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11387.443235 secs 2024-04-26T21:39:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:50 smithi189 ceph-mon[32756]: pgmap v7008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:50.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:50 smithi092 ceph-mon[29156]: pgmap v7008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:50 smithi156 ceph-mon[32679]: pgmap v7008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:52 smithi189 ceph-mon[32756]: pgmap v7009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:52 smithi156 ceph-mon[32679]: pgmap v7009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:52 smithi092 ceph-mon[29156]: pgmap v7009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:54 smithi189 ceph-mon[32756]: pgmap v7010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12089.469757 secs 2024-04-26T21:39:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11392.443304 secs 2024-04-26T21:39:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:54 smithi156 ceph-mon[32679]: pgmap v7010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12089.469757 secs 2024-04-26T21:39:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11392.443304 secs 2024-04-26T21:39:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:54 smithi092 ceph-mon[29156]: pgmap v7010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12089.469757 secs 2024-04-26T21:39:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11392.443304 secs 2024-04-26T21:39:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:56 smithi189 ceph-mon[32756]: pgmap v7011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:56 smithi156 ceph-mon[32679]: pgmap v7011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:56 smithi092 ceph-mon[29156]: pgmap v7011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:39:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:58 smithi189 ceph-mon[32756]: pgmap v7012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:58 smithi156 ceph-mon[32679]: pgmap v7012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:58 smithi092 ceph-mon[29156]: pgmap v7012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:39:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12094.469818 secs 2024-04-26T21:39:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:39:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11397.443424 secs 2024-04-26T21:39:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12094.469818 secs 2024-04-26T21:39:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:39:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11397.443424 secs 2024-04-26T21:39:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12094.469818 secs 2024-04-26T21:39:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:39:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11397.443424 secs 2024-04-26T21:40:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:00 smithi189 ceph-mon[32756]: pgmap v7013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:40:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:00 smithi156 ceph-mon[32679]: pgmap v7013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:40:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:00 smithi092 ceph-mon[29156]: pgmap v7013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:40:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:02 smithi189 ceph-mon[32756]: pgmap v7014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:02 smithi156 ceph-mon[32679]: pgmap v7014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:02 smithi092 ceph-mon[29156]: pgmap v7014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:04 smithi189 ceph-mon[32756]: pgmap v7015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12099.469933 secs 2024-04-26T21:40:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11402.443539 secs 2024-04-26T21:40:04.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:04 smithi092 ceph-mon[29156]: pgmap v7015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:04.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12099.469933 secs 2024-04-26T21:40:04.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11402.443539 secs 2024-04-26T21:40:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:04 smithi156 ceph-mon[32679]: pgmap v7015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12099.469933 secs 2024-04-26T21:40:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11402.443539 secs 2024-04-26T21:40:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:06 smithi189 ceph-mon[32756]: pgmap v7016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:06 smithi156 ceph-mon[32679]: pgmap v7016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:06 smithi092 ceph-mon[29156]: pgmap v7016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:08 smithi189 ceph-mon[32756]: pgmap v7017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:08 smithi156 ceph-mon[32679]: pgmap v7017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:08 smithi092 ceph-mon[29156]: pgmap v7017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12104.469995 secs 2024-04-26T21:40:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11407.443659 secs 2024-04-26T21:40:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12104.469995 secs 2024-04-26T21:40:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11407.443659 secs 2024-04-26T21:40:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12104.469995 secs 2024-04-26T21:40:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11407.443659 secs 2024-04-26T21:40:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:10 smithi189 ceph-mon[32756]: pgmap v7018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:10 smithi156 ceph-mon[32679]: pgmap v7018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:10 smithi092 ceph-mon[29156]: pgmap v7018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:12.649 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:12 smithi189 ceph-mon[32756]: pgmap v7019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:12 smithi156 ceph-mon[32679]: pgmap v7019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:12 smithi092 ceph-mon[29156]: pgmap v7019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:13 smithi092 ceph-mon[29156]: pgmap v7020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:13 smithi189 ceph-mon[32756]: pgmap v7020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:13 smithi156 ceph-mon[32679]: pgmap v7020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12109.470113 secs 2024-04-26T21:40:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11412.443810 secs 2024-04-26T21:40:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12109.470113 secs 2024-04-26T21:40:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11412.443810 secs 2024-04-26T21:40:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12109.470113 secs 2024-04-26T21:40:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11412.443810 secs 2024-04-26T21:40:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:15 smithi092 ceph-mon[29156]: pgmap v7021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:15 smithi189 ceph-mon[32756]: pgmap v7021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:15 smithi156 ceph-mon[32679]: pgmap v7021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:18.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:18 smithi189 ceph-mon[32756]: pgmap v7022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:18 smithi156 ceph-mon[32679]: pgmap v7022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:18 smithi092 ceph-mon[29156]: pgmap v7022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12114.470190 secs 2024-04-26T21:40:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11417.443946 secs 2024-04-26T21:40:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12114.470190 secs 2024-04-26T21:40:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11417.443946 secs 2024-04-26T21:40:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12114.470190 secs 2024-04-26T21:40:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11417.443946 secs 2024-04-26T21:40:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:20 smithi189 ceph-mon[32756]: pgmap v7023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:20.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:20 smithi092 ceph-mon[29156]: pgmap v7023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:20 smithi156 ceph-mon[32679]: pgmap v7023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:22 smithi189 ceph-mon[32756]: pgmap v7024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:22 smithi156 ceph-mon[32679]: pgmap v7024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:22 smithi092 ceph-mon[29156]: pgmap v7024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:24 smithi189 ceph-mon[32756]: pgmap v7025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12119.470340 secs 2024-04-26T21:40:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11422.444083 secs 2024-04-26T21:40:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:24 smithi156 ceph-mon[32679]: pgmap v7025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12119.470340 secs 2024-04-26T21:40:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11422.444083 secs 2024-04-26T21:40:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:24 smithi092 ceph-mon[29156]: pgmap v7025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12119.470340 secs 2024-04-26T21:40:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11422.444083 secs 2024-04-26T21:40:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:26 smithi189 ceph-mon[32756]: pgmap v7026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:26 smithi156 ceph-mon[32679]: pgmap v7026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:26 smithi092 ceph-mon[29156]: pgmap v7026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:28 smithi189 ceph-mon[32756]: pgmap v7027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:28 smithi156 ceph-mon[32679]: pgmap v7027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:28 smithi092 ceph-mon[29156]: pgmap v7027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12124.470453 secs 2024-04-26T21:40:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11427.444209 secs 2024-04-26T21:40:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12124.470453 secs 2024-04-26T21:40:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11427.444209 secs 2024-04-26T21:40:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12124.470453 secs 2024-04-26T21:40:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11427.444209 secs 2024-04-26T21:40:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:30 smithi189 ceph-mon[32756]: pgmap v7028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:40:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:30 smithi156 ceph-mon[32679]: pgmap v7028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:40:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:30 smithi092 ceph-mon[29156]: pgmap v7028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:40:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:40:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:40:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:40:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:31 smithi189 ceph-mon[32756]: pgmap v7029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:40:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:31 smithi189 ceph-mon[32756]: pgmap v7030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:31 smithi156 ceph-mon[32679]: pgmap v7029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:40:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:31 smithi156 ceph-mon[32679]: pgmap v7030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:31 smithi092 ceph-mon[29156]: pgmap v7029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:40:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:31 smithi092 ceph-mon[29156]: pgmap v7030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:33 smithi189 ceph-mon[32756]: pgmap v7031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:33 smithi156 ceph-mon[32679]: pgmap v7031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:33 smithi092 ceph-mon[29156]: pgmap v7031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12129.470571 secs 2024-04-26T21:40:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11432.444275 secs 2024-04-26T21:40:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12129.470571 secs 2024-04-26T21:40:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11432.444275 secs 2024-04-26T21:40:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12129.470571 secs 2024-04-26T21:40:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11432.444275 secs 2024-04-26T21:40:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:35 smithi189 ceph-mon[32756]: pgmap v7032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:35 smithi156 ceph-mon[32679]: pgmap v7032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:35 smithi092 ceph-mon[29156]: pgmap v7032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:37 smithi189 ceph-mon[32756]: pgmap v7033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:37 smithi156 ceph-mon[32679]: pgmap v7033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:37 smithi092 ceph-mon[29156]: pgmap v7033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:40:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:39 smithi189 ceph-mon[32756]: pgmap v7034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:40:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12134.470632 secs 2024-04-26T21:40:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11437.444391 secs 2024-04-26T21:40:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:39 smithi156 ceph-mon[32679]: pgmap v7034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:40:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12134.470632 secs 2024-04-26T21:40:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11437.444391 secs 2024-04-26T21:40:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:39 smithi092 ceph-mon[29156]: pgmap v7034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:40:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12134.470632 secs 2024-04-26T21:40:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11437.444391 secs 2024-04-26T21:40:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:41 smithi189 ceph-mon[32756]: pgmap v7035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:40:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:41 smithi156 ceph-mon[32679]: pgmap v7035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:40:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:41 smithi092 ceph-mon[29156]: pgmap v7035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:40:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:43 smithi189 ceph-mon[32756]: pgmap v7036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:43 smithi156 ceph-mon[32679]: pgmap v7036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:43 smithi092 ceph-mon[29156]: pgmap v7036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12139.470771 secs 2024-04-26T21:40:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11442.444519 secs 2024-04-26T21:40:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12139.470771 secs 2024-04-26T21:40:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11442.444519 secs 2024-04-26T21:40:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12139.470771 secs 2024-04-26T21:40:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11442.444519 secs 2024-04-26T21:40:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:45 smithi189 ceph-mon[32756]: pgmap v7037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:45 smithi156 ceph-mon[32679]: pgmap v7037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:45 smithi092 ceph-mon[29156]: pgmap v7037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:47 smithi189 ceph-mon[32756]: pgmap v7038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:47 smithi156 ceph-mon[32679]: pgmap v7038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:47 smithi092 ceph-mon[29156]: pgmap v7038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:49 smithi156 ceph-mon[32679]: pgmap v7039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12144.470884 secs 2024-04-26T21:40:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11447.444644 secs 2024-04-26T21:40:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:49 smithi092 ceph-mon[29156]: pgmap v7039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12144.470884 secs 2024-04-26T21:40:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11447.444644 secs 2024-04-26T21:40:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:49 smithi189 ceph-mon[32756]: pgmap v7039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12144.470884 secs 2024-04-26T21:40:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11447.444644 secs 2024-04-26T21:40:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:51 smithi156 ceph-mon[32679]: pgmap v7040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:51 smithi092 ceph-mon[29156]: pgmap v7040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:51 smithi189 ceph-mon[32756]: pgmap v7040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:53 smithi156 ceph-mon[32679]: pgmap v7041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:53 smithi092 ceph-mon[29156]: pgmap v7041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:53 smithi189 ceph-mon[32756]: pgmap v7041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12149.470995 secs 2024-04-26T21:40:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11452.444782 secs 2024-04-26T21:40:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12149.470995 secs 2024-04-26T21:40:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11452.444782 secs 2024-04-26T21:40:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12149.470995 secs 2024-04-26T21:40:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11452.444782 secs 2024-04-26T21:40:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:55 smithi156 ceph-mon[32679]: pgmap v7042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:55 smithi092 ceph-mon[29156]: pgmap v7042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:55 smithi189 ceph-mon[32756]: pgmap v7042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:40:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:57 smithi156 ceph-mon[32679]: pgmap v7043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:57 smithi092 ceph-mon[29156]: pgmap v7043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:57 smithi189 ceph-mon[32756]: pgmap v7043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:59 smithi156 ceph-mon[32679]: pgmap v7044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12154.471113 secs 2024-04-26T21:40:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:40:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11457.444863 secs 2024-04-26T21:40:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:59 smithi092 ceph-mon[29156]: pgmap v7044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12154.471113 secs 2024-04-26T21:40:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:40:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11457.444863 secs 2024-04-26T21:40:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:59 smithi189 ceph-mon[32756]: pgmap v7044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:40:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12154.471113 secs 2024-04-26T21:40:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:40:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11457.444863 secs 2024-04-26T21:41:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:01 smithi156 ceph-mon[32679]: pgmap v7045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:01 smithi092 ceph-mon[29156]: pgmap v7045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:01 smithi189 ceph-mon[32756]: pgmap v7045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:03 smithi156 ceph-mon[32679]: pgmap v7046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:03 smithi092 ceph-mon[29156]: pgmap v7046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:03 smithi189 ceph-mon[32756]: pgmap v7046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12159.471214 secs 2024-04-26T21:41:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11462.444981 secs 2024-04-26T21:41:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12159.471214 secs 2024-04-26T21:41:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11462.444981 secs 2024-04-26T21:41:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12159.471214 secs 2024-04-26T21:41:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11462.444981 secs 2024-04-26T21:41:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:05 smithi156 ceph-mon[32679]: pgmap v7047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:05 smithi092 ceph-mon[29156]: pgmap v7047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:05 smithi189 ceph-mon[32756]: pgmap v7047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:07 smithi156 ceph-mon[32679]: pgmap v7048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:07 smithi092 ceph-mon[29156]: pgmap v7048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:07 smithi189 ceph-mon[32756]: pgmap v7048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:09 smithi156 ceph-mon[32679]: pgmap v7049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12164.471330 secs 2024-04-26T21:41:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11467.445055 secs 2024-04-26T21:41:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:09 smithi092 ceph-mon[29156]: pgmap v7049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12164.471330 secs 2024-04-26T21:41:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11467.445055 secs 2024-04-26T21:41:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:09 smithi189 ceph-mon[32756]: pgmap v7049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12164.471330 secs 2024-04-26T21:41:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11467.445055 secs 2024-04-26T21:41:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:11 smithi156 ceph-mon[32679]: pgmap v7050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:11 smithi092 ceph-mon[29156]: pgmap v7050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:11 smithi189 ceph-mon[32756]: pgmap v7050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:13 smithi092 ceph-mon[29156]: pgmap v7051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:13 smithi189 ceph-mon[32756]: pgmap v7051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:13 smithi156 ceph-mon[32679]: pgmap v7051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12169.471468 secs 2024-04-26T21:41:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11472.445186 secs 2024-04-26T21:41:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12169.471468 secs 2024-04-26T21:41:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11472.445186 secs 2024-04-26T21:41:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12169.471468 secs 2024-04-26T21:41:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11472.445186 secs 2024-04-26T21:41:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:15 smithi092 ceph-mon[29156]: pgmap v7052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:15 smithi189 ceph-mon[32756]: pgmap v7052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:15 smithi156 ceph-mon[32679]: pgmap v7052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:16 smithi092 ceph-mon[29156]: pgmap v7053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:16 smithi189 ceph-mon[32756]: pgmap v7053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:16 smithi156 ceph-mon[32679]: pgmap v7053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:19 smithi189 ceph-mon[32756]: pgmap v7054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12174.471575 secs 2024-04-26T21:41:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:19 smithi156 ceph-mon[32679]: pgmap v7054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12174.471575 secs 2024-04-26T21:41:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:19 smithi092 ceph-mon[29156]: pgmap v7054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12174.471575 secs 2024-04-26T21:41:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:20 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11477.445314 secs 2024-04-26T21:41:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:20 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11477.445314 secs 2024-04-26T21:41:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:20 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11477.445314 secs 2024-04-26T21:41:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:21 smithi189 ceph-mon[32756]: pgmap v7055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:21.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:21 smithi092 ceph-mon[29156]: pgmap v7055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:21 smithi156 ceph-mon[32679]: pgmap v7055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:23 smithi189 ceph-mon[32756]: pgmap v7056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:23 smithi156 ceph-mon[32679]: pgmap v7056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:23 smithi092 ceph-mon[29156]: pgmap v7056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12179.471691 secs 2024-04-26T21:41:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12179.471691 secs 2024-04-26T21:41:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12179.471691 secs 2024-04-26T21:41:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:25 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11482.445451 secs 2024-04-26T21:41:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:25 smithi189 ceph-mon[32756]: pgmap v7057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:25 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11482.445451 secs 2024-04-26T21:41:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:25 smithi156 ceph-mon[32679]: pgmap v7057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:25 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11482.445451 secs 2024-04-26T21:41:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:25 smithi092 ceph-mon[29156]: pgmap v7057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:27 smithi189 ceph-mon[32756]: pgmap v7058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:27 smithi156 ceph-mon[32679]: pgmap v7058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:27 smithi092 ceph-mon[29156]: pgmap v7058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:29 smithi189 ceph-mon[32756]: pgmap v7059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12184.471821 secs 2024-04-26T21:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11487.445596 secs 2024-04-26T21:41:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:29 smithi156 ceph-mon[32679]: pgmap v7059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12184.471821 secs 2024-04-26T21:41:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11487.445596 secs 2024-04-26T21:41:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:29 smithi092 ceph-mon[29156]: pgmap v7059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:41:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12184.471821 secs 2024-04-26T21:41:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11487.445596 secs 2024-04-26T21:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:31 smithi189 ceph-mon[32756]: pgmap v7060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:41:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:31 smithi156 ceph-mon[32679]: pgmap v7060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:41:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:31 smithi092 ceph-mon[29156]: pgmap v7060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:41:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:41:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:41:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:41:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:41:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:32 smithi189 ceph-mon[32756]: pgmap v7061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:41:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:32 smithi189 ceph-mon[32756]: pgmap v7062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:41:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:32 smithi156 ceph-mon[32679]: pgmap v7061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:41:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:32 smithi156 ceph-mon[32679]: pgmap v7062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:41:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:32 smithi092 ceph-mon[29156]: pgmap v7061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:41:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:32 smithi092 ceph-mon[29156]: pgmap v7062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T21:41:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:34 smithi156 ceph-mon[32679]: pgmap v7063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12189.471944 secs 2024-04-26T21:41:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11492.445714 secs 2024-04-26T21:41:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:34 smithi092 ceph-mon[29156]: pgmap v7063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12189.471944 secs 2024-04-26T21:41:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11492.445714 secs 2024-04-26T21:41:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:34 smithi189 ceph-mon[32756]: pgmap v7063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:41:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12189.471944 secs 2024-04-26T21:41:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11492.445714 secs 2024-04-26T21:41:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:36 smithi156 ceph-mon[32679]: pgmap v7064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:36 smithi092 ceph-mon[29156]: pgmap v7064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:36 smithi189 ceph-mon[32756]: pgmap v7064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:38 smithi156 ceph-mon[32679]: pgmap v7065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:38 smithi092 ceph-mon[29156]: pgmap v7065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:38 smithi189 ceph-mon[32756]: pgmap v7065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12194.472019 secs 2024-04-26T21:41:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11497.445837 secs 2024-04-26T21:41:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12194.472019 secs 2024-04-26T21:41:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11497.445837 secs 2024-04-26T21:41:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12194.472019 secs 2024-04-26T21:41:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11497.445837 secs 2024-04-26T21:41:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:40 smithi156 ceph-mon[32679]: pgmap v7066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:40 smithi092 ceph-mon[29156]: pgmap v7066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:40 smithi189 ceph-mon[32756]: pgmap v7066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:41:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:42 smithi156 ceph-mon[32679]: pgmap v7067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:41:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:42 smithi092 ceph-mon[29156]: pgmap v7067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:41:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:42 smithi189 ceph-mon[32756]: pgmap v7067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:41:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:44 smithi156 ceph-mon[32679]: pgmap v7068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12199.472131 secs 2024-04-26T21:41:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11502.445903 secs 2024-04-26T21:41:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:44 smithi092 ceph-mon[29156]: pgmap v7068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12199.472131 secs 2024-04-26T21:41:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11502.445903 secs 2024-04-26T21:41:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:44 smithi189 ceph-mon[32756]: pgmap v7068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12199.472131 secs 2024-04-26T21:41:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11502.445903 secs 2024-04-26T21:41:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:46 smithi156 ceph-mon[32679]: pgmap v7069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:46 smithi092 ceph-mon[29156]: pgmap v7069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:46 smithi189 ceph-mon[32756]: pgmap v7069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:48 smithi156 ceph-mon[32679]: pgmap v7070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:48 smithi092 ceph-mon[29156]: pgmap v7070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:48 smithi189 ceph-mon[32756]: pgmap v7070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12204.472185 secs 2024-04-26T21:41:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11507.446022 secs 2024-04-26T21:41:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12204.472185 secs 2024-04-26T21:41:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11507.446022 secs 2024-04-26T21:41:49.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12204.472185 secs 2024-04-26T21:41:49.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11507.446022 secs 2024-04-26T21:41:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:50 smithi156 ceph-mon[32679]: pgmap v7071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:50 smithi092 ceph-mon[29156]: pgmap v7071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:50 smithi189 ceph-mon[32756]: pgmap v7071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:52 smithi156 ceph-mon[32679]: pgmap v7072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:52 smithi092 ceph-mon[29156]: pgmap v7072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:52 smithi189 ceph-mon[32756]: pgmap v7072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:54 smithi156 ceph-mon[32679]: pgmap v7073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12209.472324 secs 2024-04-26T21:41:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11512.446145 secs 2024-04-26T21:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:54 smithi092 ceph-mon[29156]: pgmap v7073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12209.472324 secs 2024-04-26T21:41:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11512.446145 secs 2024-04-26T21:41:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:54 smithi189 ceph-mon[32756]: pgmap v7073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12209.472324 secs 2024-04-26T21:41:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11512.446145 secs 2024-04-26T21:41:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:56 smithi156 ceph-mon[32679]: pgmap v7074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:56 smithi092 ceph-mon[29156]: pgmap v7074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:56 smithi189 ceph-mon[32756]: pgmap v7074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:41:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:58 smithi156 ceph-mon[32679]: pgmap v7075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:58 smithi092 ceph-mon[29156]: pgmap v7075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:58 smithi189 ceph-mon[32756]: pgmap v7075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:41:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12214.472372 secs 2024-04-26T21:41:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:41:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11517.446264 secs 2024-04-26T21:41:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12214.472372 secs 2024-04-26T21:41:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:41:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11517.446264 secs 2024-04-26T21:41:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12214.472372 secs 2024-04-26T21:41:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:41:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11517.446264 secs 2024-04-26T21:42:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:00 smithi092 ceph-mon[29156]: pgmap v7076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:00 smithi189 ceph-mon[32756]: pgmap v7076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:00 smithi156 ceph-mon[32679]: pgmap v7076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:02 smithi092 ceph-mon[29156]: pgmap v7077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:02 smithi189 ceph-mon[32756]: pgmap v7077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:02 smithi156 ceph-mon[32679]: pgmap v7077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:04.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:04 smithi156 ceph-mon[32679]: pgmap v7078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:04.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12219.472491 secs 2024-04-26T21:42:04.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:04 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 11522.446387 secs 2024-04-26T21:42:04.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:04 smithi156 ceph-mon[32679]: slow request 11522.446387 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:42:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:04 smithi092 ceph-mon[29156]: pgmap v7078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12219.472491 secs 2024-04-26T21:42:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:04 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 11522.446387 secs 2024-04-26T21:42:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:04 smithi092 ceph-mon[29156]: slow request 11522.446387 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:42:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:04 smithi189 ceph-mon[32756]: pgmap v7078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12219.472491 secs 2024-04-26T21:42:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:04 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 11522.446387 secs 2024-04-26T21:42:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:04 smithi189 ceph-mon[32756]: slow request 11522.446387 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:42:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:06 smithi092 ceph-mon[29156]: pgmap v7079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:06 smithi189 ceph-mon[32756]: pgmap v7079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:06 smithi156 ceph-mon[32679]: pgmap v7079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:08 smithi092 ceph-mon[29156]: pgmap v7080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:08 smithi189 ceph-mon[32756]: pgmap v7080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:08 smithi156 ceph-mon[32679]: pgmap v7080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12224.472605 secs 2024-04-26T21:42:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11527.446494 secs 2024-04-26T21:42:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12224.472605 secs 2024-04-26T21:42:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11527.446494 secs 2024-04-26T21:42:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12224.472605 secs 2024-04-26T21:42:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11527.446494 secs 2024-04-26T21:42:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:10 smithi092 ceph-mon[29156]: pgmap v7081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:10 smithi189 ceph-mon[32756]: pgmap v7081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:10 smithi156 ceph-mon[32679]: pgmap v7081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:12 smithi092 ceph-mon[29156]: pgmap v7082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:12 smithi189 ceph-mon[32756]: pgmap v7082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:12 smithi156 ceph-mon[32679]: pgmap v7082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:14 smithi092 ceph-mon[29156]: pgmap v7083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12229.472722 secs 2024-04-26T21:42:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11532.446574 secs 2024-04-26T21:42:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:14 smithi189 ceph-mon[32756]: pgmap v7083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12229.472722 secs 2024-04-26T21:42:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11532.446574 secs 2024-04-26T21:42:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:14 smithi156 ceph-mon[32679]: pgmap v7083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12229.472722 secs 2024-04-26T21:42:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11532.446574 secs 2024-04-26T21:42:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:16 smithi092 ceph-mon[29156]: pgmap v7084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:16 smithi189 ceph-mon[32756]: pgmap v7084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:16 smithi156 ceph-mon[32679]: pgmap v7084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:18 smithi092 ceph-mon[29156]: pgmap v7085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:18 smithi189 ceph-mon[32756]: pgmap v7085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:18 smithi156 ceph-mon[32679]: pgmap v7085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12234.472878 secs 2024-04-26T21:42:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11537.446680 secs 2024-04-26T21:42:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12234.472878 secs 2024-04-26T21:42:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11537.446680 secs 2024-04-26T21:42:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12234.472878 secs 2024-04-26T21:42:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11537.446680 secs 2024-04-26T21:42:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:20 smithi092 ceph-mon[29156]: pgmap v7086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:20 smithi189 ceph-mon[32756]: pgmap v7086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:20 smithi156 ceph-mon[32679]: pgmap v7086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:22 smithi092 ceph-mon[29156]: pgmap v7087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:22 smithi189 ceph-mon[32756]: pgmap v7087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:22 smithi156 ceph-mon[32679]: pgmap v7087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:24 smithi092 ceph-mon[29156]: pgmap v7088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12239.472996 secs 2024-04-26T21:42:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11542.446797 secs 2024-04-26T21:42:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:24 smithi189 ceph-mon[32756]: pgmap v7088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12239.472996 secs 2024-04-26T21:42:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11542.446797 secs 2024-04-26T21:42:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:24 smithi156 ceph-mon[32679]: pgmap v7088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12239.472996 secs 2024-04-26T21:42:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11542.446797 secs 2024-04-26T21:42:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:26 smithi092 ceph-mon[29156]: pgmap v7089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:26 smithi189 ceph-mon[32756]: pgmap v7089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:26 smithi156 ceph-mon[32679]: pgmap v7089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:28 smithi189 ceph-mon[32756]: pgmap v7090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:28 smithi156 ceph-mon[32679]: pgmap v7090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:28 smithi092 ceph-mon[29156]: pgmap v7090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12244.473085 secs 2024-04-26T21:42:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11547.446931 secs 2024-04-26T21:42:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12244.473085 secs 2024-04-26T21:42:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11547.446931 secs 2024-04-26T21:42:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12244.473085 secs 2024-04-26T21:42:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11547.446931 secs 2024-04-26T21:42:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:30 smithi189 ceph-mon[32756]: pgmap v7091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:30 smithi156 ceph-mon[32679]: pgmap v7091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:30 smithi092 ceph-mon[29156]: pgmap v7091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:42:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:32 smithi189 ceph-mon[32756]: pgmap v7092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:42:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:32 smithi156 ceph-mon[32679]: pgmap v7092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:42:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:32 smithi092 ceph-mon[29156]: pgmap v7092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:42:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:42:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:42:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:33 smithi189 ceph-mon[32756]: pgmap v7093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:42:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:33 smithi189 ceph-mon[32756]: pgmap v7094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:33 smithi156 ceph-mon[32679]: pgmap v7093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:42:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:33 smithi156 ceph-mon[32679]: pgmap v7094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:33 smithi092 ceph-mon[29156]: pgmap v7093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:42:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:33 smithi092 ceph-mon[29156]: pgmap v7094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12249.473181 secs 2024-04-26T21:42:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11552.447052 secs 2024-04-26T21:42:34.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:42:34.038+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:42:34.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:42:34.038+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:42:34.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:42:34.038+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:42:34.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:42:34.038+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:42:34.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:42:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:42:34.038+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:42:34.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12249.473181 secs 2024-04-26T21:42:34.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11552.447052 secs 2024-04-26T21:42:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12249.473181 secs 2024-04-26T21:42:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11552.447052 secs 2024-04-26T21:42:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:35 smithi189 ceph-mon[32756]: pgmap v7095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:42:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:35 smithi156 ceph-mon[32679]: pgmap v7095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:42:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:35 smithi092 ceph-mon[29156]: pgmap v7095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:42:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:37 smithi189 ceph-mon[32756]: pgmap v7096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:42:37.656+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:42:37.656 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:42:37.656+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:42:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:42:37.657+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:42:37.657 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:42:37.657+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 97 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:42:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:37 smithi156 ceph-mon[32679]: pgmap v7096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:37 smithi092 ceph-mon[29156]: pgmap v7096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:42:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:39 smithi189 ceph-mon[32756]: pgmap v7097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:42:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12254.473316 secs 2024-04-26T21:42:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11557.447153 secs 2024-04-26T21:42:39.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:39 smithi092 ceph-mon[29156]: pgmap v7097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:42:39.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12254.473316 secs 2024-04-26T21:42:39.677 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11557.447153 secs 2024-04-26T21:42:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:39 smithi156 ceph-mon[32679]: pgmap v7097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:42:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12254.473316 secs 2024-04-26T21:42:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11557.447153 secs 2024-04-26T21:42:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:41 smithi189 ceph-mon[32756]: pgmap v7098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:42:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:41 smithi156 ceph-mon[32679]: pgmap v7098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:42:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:41 smithi092 ceph-mon[29156]: pgmap v7098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:42:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:43 smithi189 ceph-mon[32756]: pgmap v7099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:42:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:43 smithi156 ceph-mon[32679]: pgmap v7099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:42:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:43 smithi092 ceph-mon[29156]: pgmap v7099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:42:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12259.473415 secs 2024-04-26T21:42:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11562.447268 secs 2024-04-26T21:42:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12259.473415 secs 2024-04-26T21:42:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11562.447268 secs 2024-04-26T21:42:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12259.473415 secs 2024-04-26T21:42:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11562.447268 secs 2024-04-26T21:42:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:45 smithi189 ceph-mon[32756]: pgmap v7100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:45 smithi156 ceph-mon[32679]: pgmap v7100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:45 smithi092 ceph-mon[29156]: pgmap v7100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:47 smithi189 ceph-mon[32756]: pgmap v7101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-26T21:42:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:47 smithi156 ceph-mon[32679]: pgmap v7101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-26T21:42:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:47 smithi092 ceph-mon[29156]: pgmap v7101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-26T21:42:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:49 smithi189 ceph-mon[32756]: pgmap v7102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:42:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12264.473570 secs 2024-04-26T21:42:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11567.447385 secs 2024-04-26T21:42:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:49 smithi156 ceph-mon[32679]: pgmap v7102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:42:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12264.473570 secs 2024-04-26T21:42:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11567.447385 secs 2024-04-26T21:42:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:49 smithi092 ceph-mon[29156]: pgmap v7102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:42:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12264.473570 secs 2024-04-26T21:42:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11567.447385 secs 2024-04-26T21:42:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:51 smithi189 ceph-mon[32756]: pgmap v7103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:51 smithi156 ceph-mon[32679]: pgmap v7103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:51 smithi092 ceph-mon[29156]: pgmap v7103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:42:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:53 smithi189 ceph-mon[32756]: pgmap v7104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:53 smithi156 ceph-mon[32679]: pgmap v7104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:53 smithi092 ceph-mon[29156]: pgmap v7104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12269.473687 secs 2024-04-26T21:42:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11572.447452 secs 2024-04-26T21:42:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12269.473687 secs 2024-04-26T21:42:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11572.447452 secs 2024-04-26T21:42:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12269.473687 secs 2024-04-26T21:42:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11572.447452 secs 2024-04-26T21:42:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:55 smithi189 ceph-mon[32756]: pgmap v7105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:55 smithi156 ceph-mon[32679]: pgmap v7105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:55 smithi092 ceph-mon[29156]: pgmap v7105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:42:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:57 smithi189 ceph-mon[32756]: pgmap v7106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:57 smithi156 ceph-mon[32679]: pgmap v7106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:57 smithi092 ceph-mon[29156]: pgmap v7106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:59 smithi189 ceph-mon[32756]: pgmap v7107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12274.473784 secs 2024-04-26T21:42:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:42:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11577.447592 secs 2024-04-26T21:42:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:59 smithi156 ceph-mon[32679]: pgmap v7107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12274.473784 secs 2024-04-26T21:42:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:42:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11577.447592 secs 2024-04-26T21:42:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:59 smithi092 ceph-mon[29156]: pgmap v7107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:42:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12274.473784 secs 2024-04-26T21:42:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:42:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11577.447592 secs 2024-04-26T21:43:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:01 smithi189 ceph-mon[32756]: pgmap v7108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:01 smithi156 ceph-mon[32679]: pgmap v7108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:01 smithi092 ceph-mon[29156]: pgmap v7108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:03 smithi189 ceph-mon[32756]: pgmap v7109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:03 smithi156 ceph-mon[32679]: pgmap v7109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:03 smithi092 ceph-mon[29156]: pgmap v7109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:04.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12279.473902 secs 2024-04-26T21:43:04.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11582.447732 secs 2024-04-26T21:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12279.473902 secs 2024-04-26T21:43:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11582.447732 secs 2024-04-26T21:43:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12279.473902 secs 2024-04-26T21:43:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11582.447732 secs 2024-04-26T21:43:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:05 smithi189 ceph-mon[32756]: pgmap v7110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:05 smithi156 ceph-mon[32679]: pgmap v7110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:05 smithi092 ceph-mon[29156]: pgmap v7110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:07 smithi189 ceph-mon[32756]: pgmap v7111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:07 smithi156 ceph-mon[32679]: pgmap v7111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:07 smithi092 ceph-mon[29156]: pgmap v7111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:09.342 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:09 smithi156 ceph-mon[32679]: pgmap v7112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:09.343 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12284.474009 secs 2024-04-26T21:43:09.343 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11587.447811 secs 2024-04-26T21:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:09 smithi189 ceph-mon[32756]: pgmap v7112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12284.474009 secs 2024-04-26T21:43:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11587.447811 secs 2024-04-26T21:43:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:09 smithi092 ceph-mon[29156]: pgmap v7112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12284.474009 secs 2024-04-26T21:43:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11587.447811 secs 2024-04-26T21:43:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:11 smithi189 ceph-mon[32756]: pgmap v7113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:11 smithi156 ceph-mon[32679]: pgmap v7113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:11 smithi092 ceph-mon[29156]: pgmap v7113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:13 smithi189 ceph-mon[32756]: pgmap v7114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:13 smithi156 ceph-mon[32679]: pgmap v7114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:13 smithi092 ceph-mon[29156]: pgmap v7114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12289.474085 secs 2024-04-26T21:43:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11592.447915 secs 2024-04-26T21:43:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12289.474085 secs 2024-04-26T21:43:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11592.447915 secs 2024-04-26T21:43:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12289.474085 secs 2024-04-26T21:43:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11592.447915 secs 2024-04-26T21:43:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:15 smithi189 ceph-mon[32756]: pgmap v7115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:15 smithi156 ceph-mon[32679]: pgmap v7115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:15 smithi092 ceph-mon[29156]: pgmap v7115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:17 smithi189 ceph-mon[32756]: pgmap v7116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:17 smithi156 ceph-mon[32679]: pgmap v7116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:17 smithi092 ceph-mon[29156]: pgmap v7116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:19 smithi189 ceph-mon[32756]: pgmap v7117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12294.474204 secs 2024-04-26T21:43:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11597.448031 secs 2024-04-26T21:43:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:19 smithi156 ceph-mon[32679]: pgmap v7117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12294.474204 secs 2024-04-26T21:43:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11597.448031 secs 2024-04-26T21:43:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:19 smithi092 ceph-mon[29156]: pgmap v7117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12294.474204 secs 2024-04-26T21:43:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11597.448031 secs 2024-04-26T21:43:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:21 smithi189 ceph-mon[32756]: pgmap v7118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:21 smithi156 ceph-mon[32679]: pgmap v7118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:21 smithi092 ceph-mon[29156]: pgmap v7118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:23 smithi189 ceph-mon[32756]: pgmap v7119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:23 smithi156 ceph-mon[32679]: pgmap v7119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:23 smithi092 ceph-mon[29156]: pgmap v7119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12299.474357 secs 2024-04-26T21:43:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11602.448125 secs 2024-04-26T21:43:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12299.474357 secs 2024-04-26T21:43:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11602.448125 secs 2024-04-26T21:43:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12299.474357 secs 2024-04-26T21:43:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11602.448125 secs 2024-04-26T21:43:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:25 smithi189 ceph-mon[32756]: pgmap v7120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:25 smithi156 ceph-mon[32679]: pgmap v7120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:25 smithi092 ceph-mon[29156]: pgmap v7120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:27 smithi189 ceph-mon[32756]: pgmap v7121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:27 smithi156 ceph-mon[32679]: pgmap v7121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:27 smithi092 ceph-mon[29156]: pgmap v7121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:29 smithi189 ceph-mon[32756]: pgmap v7122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12304.474479 secs 2024-04-26T21:43:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11607.448251 secs 2024-04-26T21:43:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:29 smithi156 ceph-mon[32679]: pgmap v7122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12304.474479 secs 2024-04-26T21:43:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11607.448251 secs 2024-04-26T21:43:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:29 smithi092 ceph-mon[29156]: pgmap v7122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12304.474479 secs 2024-04-26T21:43:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11607.448251 secs 2024-04-26T21:43:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:31 smithi189 ceph-mon[32756]: pgmap v7123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:31 smithi156 ceph-mon[32679]: pgmap v7123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:31 smithi092 ceph-mon[29156]: pgmap v7123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:43:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:43:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:43:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:33 smithi156 ceph-mon[32679]: pgmap v7124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:33 smithi156 ceph-mon[32679]: pgmap v7125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:43:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:33 smithi156 ceph-mon[32679]: pgmap v7126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:43:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:33 smithi092 ceph-mon[29156]: pgmap v7124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:33 smithi092 ceph-mon[29156]: pgmap v7125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:43:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:33 smithi092 ceph-mon[29156]: pgmap v7126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:43:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:33 smithi189 ceph-mon[32756]: pgmap v7124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:33 smithi189 ceph-mon[32756]: pgmap v7125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:43:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:33 smithi189 ceph-mon[32756]: pgmap v7126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:43:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12309.474549 secs 2024-04-26T21:43:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11612.448390 secs 2024-04-26T21:43:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12309.474549 secs 2024-04-26T21:43:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11612.448390 secs 2024-04-26T21:43:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12309.474549 secs 2024-04-26T21:43:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11612.448390 secs 2024-04-26T21:43:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:35 smithi156 ceph-mon[32679]: pgmap v7127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:35 smithi092 ceph-mon[29156]: pgmap v7127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:35 smithi189 ceph-mon[32756]: pgmap v7127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:37 smithi156 ceph-mon[32679]: pgmap v7128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:37 smithi092 ceph-mon[29156]: pgmap v7128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:37 smithi189 ceph-mon[32756]: pgmap v7128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:39 smithi156 ceph-mon[32679]: pgmap v7129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12314.474669 secs 2024-04-26T21:43:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11617.448467 secs 2024-04-26T21:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:39 smithi092 ceph-mon[29156]: pgmap v7129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12314.474669 secs 2024-04-26T21:43:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11617.448467 secs 2024-04-26T21:43:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:39 smithi189 ceph-mon[32756]: pgmap v7129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:43:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12314.474669 secs 2024-04-26T21:43:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11617.448467 secs 2024-04-26T21:43:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:41 smithi156 ceph-mon[32679]: pgmap v7130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:41 smithi092 ceph-mon[29156]: pgmap v7130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:41 smithi189 ceph-mon[32756]: pgmap v7130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:43:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:43 smithi156 ceph-mon[32679]: pgmap v7131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:43:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:43 smithi092 ceph-mon[29156]: pgmap v7131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:43:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:43 smithi189 ceph-mon[32756]: pgmap v7131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:43:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12319.474788 secs 2024-04-26T21:43:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11622.448531 secs 2024-04-26T21:43:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12319.474788 secs 2024-04-26T21:43:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11622.448531 secs 2024-04-26T21:43:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12319.474788 secs 2024-04-26T21:43:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11622.448531 secs 2024-04-26T21:43:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:45 smithi156 ceph-mon[32679]: pgmap v7132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:45 smithi092 ceph-mon[29156]: pgmap v7132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:45 smithi189 ceph-mon[32756]: pgmap v7132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:47 smithi156 ceph-mon[32679]: pgmap v7133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:47 smithi092 ceph-mon[29156]: pgmap v7133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:47 smithi189 ceph-mon[32756]: pgmap v7133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:49 smithi156 ceph-mon[32679]: pgmap v7134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12324.474903 secs 2024-04-26T21:43:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11627.448677 secs 2024-04-26T21:43:49.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:49 smithi189 ceph-mon[32756]: pgmap v7134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:49.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12324.474903 secs 2024-04-26T21:43:49.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11627.448677 secs 2024-04-26T21:43:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:49 smithi092 ceph-mon[29156]: pgmap v7134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12324.474903 secs 2024-04-26T21:43:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11627.448677 secs 2024-04-26T21:43:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:51 smithi156 ceph-mon[32679]: pgmap v7135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:51 smithi092 ceph-mon[29156]: pgmap v7135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:51 smithi189 ceph-mon[32756]: pgmap v7135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:53 smithi156 ceph-mon[32679]: pgmap v7136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:53 smithi092 ceph-mon[29156]: pgmap v7136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:53 smithi189 ceph-mon[32756]: pgmap v7136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12329.475043 secs 2024-04-26T21:43:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11632.448759 secs 2024-04-26T21:43:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12329.475043 secs 2024-04-26T21:43:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11632.448759 secs 2024-04-26T21:43:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12329.475043 secs 2024-04-26T21:43:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11632.448759 secs 2024-04-26T21:43:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:55 smithi092 ceph-mon[29156]: pgmap v7137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:55 smithi189 ceph-mon[32756]: pgmap v7137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:55 smithi156 ceph-mon[32679]: pgmap v7137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:43:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:57 smithi092 ceph-mon[29156]: pgmap v7138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:57 smithi189 ceph-mon[32756]: pgmap v7138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:57 smithi156 ceph-mon[32679]: pgmap v7138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:59 smithi092 ceph-mon[29156]: pgmap v7139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12334.475159 secs 2024-04-26T21:43:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:43:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11637.448822 secs 2024-04-26T21:43:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:59 smithi189 ceph-mon[32756]: pgmap v7139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12334.475159 secs 2024-04-26T21:43:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:43:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11637.448822 secs 2024-04-26T21:43:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:59 smithi156 ceph-mon[32679]: pgmap v7139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:43:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12334.475159 secs 2024-04-26T21:43:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:43:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11637.448822 secs 2024-04-26T21:44:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:01 smithi092 ceph-mon[29156]: pgmap v7140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:01 smithi189 ceph-mon[32756]: pgmap v7140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:01 smithi156 ceph-mon[32679]: pgmap v7140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:03 smithi092 ceph-mon[29156]: pgmap v7141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:03 smithi189 ceph-mon[32756]: pgmap v7141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:03 smithi156 ceph-mon[32679]: pgmap v7141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12339.475278 secs 2024-04-26T21:44:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11642.448952 secs 2024-04-26T21:44:04.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12339.475278 secs 2024-04-26T21:44:04.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11642.448952 secs 2024-04-26T21:44:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12339.475278 secs 2024-04-26T21:44:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11642.448952 secs 2024-04-26T21:44:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:05 smithi092 ceph-mon[29156]: pgmap v7142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:05 smithi189 ceph-mon[32756]: pgmap v7142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:05 smithi156 ceph-mon[32679]: pgmap v7142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:07 smithi092 ceph-mon[29156]: pgmap v7143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:07 smithi189 ceph-mon[32756]: pgmap v7143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:07 smithi156 ceph-mon[32679]: pgmap v7143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:09 smithi092 ceph-mon[29156]: pgmap v7144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12344.475398 secs 2024-04-26T21:44:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11647.449056 secs 2024-04-26T21:44:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:09 smithi189 ceph-mon[32756]: pgmap v7144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12344.475398 secs 2024-04-26T21:44:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11647.449056 secs 2024-04-26T21:44:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:09 smithi156 ceph-mon[32679]: pgmap v7144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12344.475398 secs 2024-04-26T21:44:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11647.449056 secs 2024-04-26T21:44:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:11 smithi092 ceph-mon[29156]: pgmap v7145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:11 smithi189 ceph-mon[32756]: pgmap v7145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:11 smithi156 ceph-mon[32679]: pgmap v7145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:13 smithi092 ceph-mon[29156]: pgmap v7146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:13 smithi189 ceph-mon[32756]: pgmap v7146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:13 smithi156 ceph-mon[32679]: pgmap v7146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12349.475523 secs 2024-04-26T21:44:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11652.449203 secs 2024-04-26T21:44:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12349.475523 secs 2024-04-26T21:44:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11652.449203 secs 2024-04-26T21:44:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12349.475523 secs 2024-04-26T21:44:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11652.449203 secs 2024-04-26T21:44:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:15 smithi092 ceph-mon[29156]: pgmap v7147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:15 smithi189 ceph-mon[32756]: pgmap v7147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:15 smithi156 ceph-mon[32679]: pgmap v7147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:16 smithi092 ceph-mon[29156]: pgmap v7148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:16 smithi189 ceph-mon[32756]: pgmap v7148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:16 smithi156 ceph-mon[32679]: pgmap v7148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12354.475642 secs 2024-04-26T21:44:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:19 smithi092 ceph-mon[29156]: pgmap v7149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11657.449352 secs 2024-04-26T21:44:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12354.475642 secs 2024-04-26T21:44:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:19 smithi189 ceph-mon[32756]: pgmap v7149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11657.449352 secs 2024-04-26T21:44:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12354.475642 secs 2024-04-26T21:44:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:19 smithi156 ceph-mon[32679]: pgmap v7149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11657.449352 secs 2024-04-26T21:44:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:21 smithi092 ceph-mon[29156]: pgmap v7150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:21 smithi189 ceph-mon[32756]: pgmap v7150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:21 smithi156 ceph-mon[32679]: pgmap v7150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:23 smithi092 ceph-mon[29156]: pgmap v7151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:23 smithi189 ceph-mon[32756]: pgmap v7151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:23 smithi156 ceph-mon[32679]: pgmap v7151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12359.475757 secs 2024-04-26T21:44:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11662.449426 secs 2024-04-26T21:44:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12359.475757 secs 2024-04-26T21:44:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11662.449426 secs 2024-04-26T21:44:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12359.475757 secs 2024-04-26T21:44:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11662.449426 secs 2024-04-26T21:44:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:25 smithi092 ceph-mon[29156]: pgmap v7152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:25 smithi189 ceph-mon[32756]: pgmap v7152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:25 smithi156 ceph-mon[32679]: pgmap v7152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:27 smithi092 ceph-mon[29156]: pgmap v7153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:27 smithi189 ceph-mon[32756]: pgmap v7153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:27 smithi156 ceph-mon[32679]: pgmap v7153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:28 smithi092 ceph-mon[29156]: pgmap v7154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:28 smithi189 ceph-mon[32756]: pgmap v7154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:28 smithi156 ceph-mon[32679]: pgmap v7154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12364.475856 secs 2024-04-26T21:44:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11667.449539 secs 2024-04-26T21:44:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12364.475856 secs 2024-04-26T21:44:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11667.449539 secs 2024-04-26T21:44:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12364.475856 secs 2024-04-26T21:44:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11667.449539 secs 2024-04-26T21:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:30 smithi189 ceph-mon[32756]: pgmap v7155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:30 smithi156 ceph-mon[32679]: pgmap v7155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:30 smithi092 ceph-mon[29156]: pgmap v7155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: pgmap v7156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: pgmap v7156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.793 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: pgmap v7156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:33.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:44:33.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.805 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:33.806 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12369.475948 secs 2024-04-26T21:44:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11672.449605 secs 2024-04-26T21:44:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12369.475948 secs 2024-04-26T21:44:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11672.449605 secs 2024-04-26T21:44:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12369.475948 secs 2024-04-26T21:44:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11672.449605 secs 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: pgmap v7157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: pgmap v7157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: pgmap v7157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:44:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:44:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:44:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: pgmap v7158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:37 smithi092 ceph-mon[29156]: pgmap v7159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: pgmap v7158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:37 smithi189 ceph-mon[32756]: pgmap v7159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: pgmap v7158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:37 smithi156 ceph-mon[32679]: pgmap v7159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:39 smithi092 ceph-mon[29156]: pgmap v7160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12374.476069 secs 2024-04-26T21:44:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11677.449745 secs 2024-04-26T21:44:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:39 smithi189 ceph-mon[32756]: pgmap v7160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12374.476069 secs 2024-04-26T21:44:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11677.449745 secs 2024-04-26T21:44:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:39 smithi156 ceph-mon[32679]: pgmap v7160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12374.476069 secs 2024-04-26T21:44:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11677.449745 secs 2024-04-26T21:44:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:41 smithi092 ceph-mon[29156]: pgmap v7161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:41 smithi189 ceph-mon[32756]: pgmap v7161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:41 smithi156 ceph-mon[32679]: pgmap v7161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:42 smithi189 ceph-mon[32756]: pgmap v7162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:42 smithi156 ceph-mon[32679]: pgmap v7162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:42 smithi092 ceph-mon[29156]: pgmap v7162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12379.476182 secs 2024-04-26T21:44:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11682.449861 secs 2024-04-26T21:44:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:44 smithi092 ceph-mon[29156]: pgmap v7163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12379.476182 secs 2024-04-26T21:44:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11682.449861 secs 2024-04-26T21:44:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:44 smithi189 ceph-mon[32756]: pgmap v7163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12379.476182 secs 2024-04-26T21:44:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11682.449861 secs 2024-04-26T21:44:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:44 smithi156 ceph-mon[32679]: pgmap v7163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:44:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:46 smithi092 ceph-mon[29156]: pgmap v7164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:44:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:46 smithi189 ceph-mon[32756]: pgmap v7164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:44:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:46 smithi156 ceph-mon[32679]: pgmap v7164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:44:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:48 smithi092 ceph-mon[29156]: pgmap v7165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:48 smithi189 ceph-mon[32756]: pgmap v7165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:48 smithi156 ceph-mon[32679]: pgmap v7165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12384.476307 secs 2024-04-26T21:44:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11687.449959 secs 2024-04-26T21:44:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12384.476307 secs 2024-04-26T21:44:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11687.449959 secs 2024-04-26T21:44:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12384.476307 secs 2024-04-26T21:44:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11687.449959 secs 2024-04-26T21:44:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:50 smithi092 ceph-mon[29156]: pgmap v7166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:50 smithi189 ceph-mon[32756]: pgmap v7166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:50 smithi156 ceph-mon[32679]: pgmap v7166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:44:52.676+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:44:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:44:52.676+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:44:52.676 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:44:52.676+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:44:52.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:44:52.676+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 98 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:44:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:52 smithi189 ceph-mon[32756]: pgmap v7167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:52 smithi156 ceph-mon[32679]: pgmap v7167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:52 smithi092 ceph-mon[29156]: pgmap v7167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12389.476440 secs 2024-04-26T21:44:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11692.450024 secs 2024-04-26T21:44:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:54 smithi189 ceph-mon[32756]: pgmap v7168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12389.476440 secs 2024-04-26T21:44:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11692.450024 secs 2024-04-26T21:44:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:54 smithi156 ceph-mon[32679]: pgmap v7168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12389.476440 secs 2024-04-26T21:44:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11692.450024 secs 2024-04-26T21:44:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:54 smithi092 ceph-mon[29156]: pgmap v7168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:44:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:57 smithi189 ceph-mon[32756]: pgmap v7169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:57 smithi156 ceph-mon[32679]: pgmap v7169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:57 smithi092 ceph-mon[29156]: pgmap v7169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:44:59 smithi189 ceph-mon[32756]: pgmap v7170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:44:59 smithi156 ceph-mon[32679]: pgmap v7170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:44:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:44:59 smithi092 ceph-mon[29156]: pgmap v7170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12394.476575 secs 2024-04-26T21:45:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11697.450137 secs 2024-04-26T21:45:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12394.476575 secs 2024-04-26T21:45:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11697.450137 secs 2024-04-26T21:45:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12394.476575 secs 2024-04-26T21:45:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11697.450137 secs 2024-04-26T21:45:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:01 smithi189 ceph-mon[32756]: pgmap v7171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:01 smithi156 ceph-mon[32679]: pgmap v7171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:01 smithi092 ceph-mon[29156]: pgmap v7171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:03.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:03 smithi189 ceph-mon[32756]: pgmap v7172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:03 smithi156 ceph-mon[32679]: pgmap v7172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:03 smithi092 ceph-mon[29156]: pgmap v7172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12399.476714 secs 2024-04-26T21:45:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:05 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11702.450243 secs 2024-04-26T21:45:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:05 smithi189 ceph-mon[32756]: pgmap v7173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12399.476714 secs 2024-04-26T21:45:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:05 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11702.450243 secs 2024-04-26T21:45:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:05 smithi156 ceph-mon[32679]: pgmap v7173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12399.476714 secs 2024-04-26T21:45:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:05 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11702.450243 secs 2024-04-26T21:45:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:05 smithi092 ceph-mon[29156]: pgmap v7173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:07 smithi189 ceph-mon[32756]: pgmap v7174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:07 smithi156 ceph-mon[32679]: pgmap v7174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:07 smithi092 ceph-mon[29156]: pgmap v7174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:09 smithi189 ceph-mon[32756]: pgmap v7175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:09 smithi156 ceph-mon[32679]: pgmap v7175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:09 smithi092 ceph-mon[29156]: pgmap v7175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12404.476847 secs 2024-04-26T21:45:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:10 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 11707.450335 secs 2024-04-26T21:45:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:10 smithi189 ceph-mon[32756]: slow request 1444.861490 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:45:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12404.476847 secs 2024-04-26T21:45:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:10 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 11707.450335 secs 2024-04-26T21:45:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:10 smithi156 ceph-mon[32679]: slow request 1444.861490 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:45:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12404.476847 secs 2024-04-26T21:45:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:10 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 11707.450335 secs 2024-04-26T21:45:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:10 smithi092 ceph-mon[29156]: slow request 1444.861490 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:45:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:11 smithi189 ceph-mon[32756]: pgmap v7176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:11 smithi156 ceph-mon[32679]: pgmap v7176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:11 smithi092 ceph-mon[29156]: pgmap v7176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:13 smithi189 ceph-mon[32756]: pgmap v7177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:13 smithi156 ceph-mon[32679]: pgmap v7177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:13 smithi092 ceph-mon[29156]: pgmap v7177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12409.476958 secs 2024-04-26T21:45:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:15 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11712.450445 secs 2024-04-26T21:45:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:15 smithi189 ceph-mon[32756]: pgmap v7178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12409.476958 secs 2024-04-26T21:45:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:15 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11712.450445 secs 2024-04-26T21:45:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:15 smithi156 ceph-mon[32679]: pgmap v7178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12409.476958 secs 2024-04-26T21:45:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:15 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11712.450445 secs 2024-04-26T21:45:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:15 smithi092 ceph-mon[29156]: pgmap v7178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:17 smithi189 ceph-mon[32756]: pgmap v7179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:17 smithi156 ceph-mon[32679]: pgmap v7179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:17 smithi092 ceph-mon[29156]: pgmap v7179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:19 smithi189 ceph-mon[32756]: pgmap v7180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:19 smithi156 ceph-mon[32679]: pgmap v7180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:19 smithi092 ceph-mon[29156]: pgmap v7180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12414.477074 secs 2024-04-26T21:45:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:20 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11717.450536 secs 2024-04-26T21:45:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12414.477074 secs 2024-04-26T21:45:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:20 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11717.450536 secs 2024-04-26T21:45:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12414.477074 secs 2024-04-26T21:45:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:20 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11717.450536 secs 2024-04-26T21:45:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:21 smithi189 ceph-mon[32756]: pgmap v7181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:21 smithi156 ceph-mon[32679]: pgmap v7181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:21 smithi092 ceph-mon[29156]: pgmap v7181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:23 smithi189 ceph-mon[32756]: pgmap v7182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:23 smithi156 ceph-mon[32679]: pgmap v7182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:23 smithi092 ceph-mon[29156]: pgmap v7182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12419.477201 secs 2024-04-26T21:45:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:25 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11722.450656 secs 2024-04-26T21:45:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:25 smithi189 ceph-mon[32756]: pgmap v7183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12419.477201 secs 2024-04-26T21:45:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:25 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11722.450656 secs 2024-04-26T21:45:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:25 smithi156 ceph-mon[32679]: pgmap v7183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12419.477201 secs 2024-04-26T21:45:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:25 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11722.450656 secs 2024-04-26T21:45:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:25 smithi092 ceph-mon[29156]: pgmap v7183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:27 smithi189 ceph-mon[32756]: pgmap v7184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:27 smithi156 ceph-mon[32679]: pgmap v7184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:27 smithi092 ceph-mon[29156]: pgmap v7184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:29 smithi189 ceph-mon[32756]: pgmap v7185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:29 smithi156 ceph-mon[32679]: pgmap v7185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:29 smithi092 ceph-mon[29156]: pgmap v7185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12424.477349 secs 2024-04-26T21:45:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:30 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11727.450776 secs 2024-04-26T21:45:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12424.477349 secs 2024-04-26T21:45:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:30 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11727.450776 secs 2024-04-26T21:45:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12424.477349 secs 2024-04-26T21:45:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:30 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11727.450776 secs 2024-04-26T21:45:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:31 smithi189 ceph-mon[32756]: pgmap v7186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:31 smithi156 ceph-mon[32679]: pgmap v7186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:31 smithi092 ceph-mon[29156]: pgmap v7186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:33 smithi189 ceph-mon[32756]: pgmap v7187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:33 smithi156 ceph-mon[32679]: pgmap v7187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:33 smithi092 ceph-mon[29156]: pgmap v7187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12429.477468 secs 2024-04-26T21:45:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:35 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11732.450889 secs 2024-04-26T21:45:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:35 smithi189 ceph-mon[32756]: pgmap v7188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12429.477468 secs 2024-04-26T21:45:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:35 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11732.450889 secs 2024-04-26T21:45:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:35 smithi156 ceph-mon[32679]: pgmap v7188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12429.477468 secs 2024-04-26T21:45:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:35 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11732.450889 secs 2024-04-26T21:45:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:35 smithi092 ceph-mon[29156]: pgmap v7188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:45:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:37 smithi189 ceph-mon[32756]: pgmap v7189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:45:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:37 smithi156 ceph-mon[32679]: pgmap v7189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:45:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:37 smithi092 ceph-mon[29156]: pgmap v7189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:45:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:45:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:45:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:45:37.682+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:45:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:45:37.682+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:45:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:45:37.682+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:45:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:45:37.682+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 99 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:45:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:38 smithi189 ceph-mon[32756]: pgmap v7190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:45:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:38 smithi189 ceph-mon[32756]: pgmap v7191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:38 smithi156 ceph-mon[32679]: pgmap v7190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:45:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:38 smithi156 ceph-mon[32679]: pgmap v7191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:38 smithi092 ceph-mon[29156]: pgmap v7190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:45:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:38 smithi092 ceph-mon[29156]: pgmap v7191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12434.477539 secs 2024-04-26T21:45:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:40 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11737.450995 secs 2024-04-26T21:45:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:40 smithi189 ceph-mon[32756]: pgmap v7192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12434.477539 secs 2024-04-26T21:45:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:40 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11737.450995 secs 2024-04-26T21:45:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:40 smithi156 ceph-mon[32679]: pgmap v7192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12434.477539 secs 2024-04-26T21:45:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:40 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11737.450995 secs 2024-04-26T21:45:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:40 smithi092 ceph-mon[29156]: pgmap v7192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:42 smithi189 ceph-mon[32756]: pgmap v7193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:42 smithi156 ceph-mon[32679]: pgmap v7193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:42 smithi092 ceph-mon[29156]: pgmap v7193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:44 smithi189 ceph-mon[32756]: pgmap v7194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:45:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:44 smithi156 ceph-mon[32679]: pgmap v7194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:45:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:44 smithi092 ceph-mon[29156]: pgmap v7194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:45:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12439.477655 secs 2024-04-26T21:45:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:45 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11742.451105 secs 2024-04-26T21:45:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12439.477655 secs 2024-04-26T21:45:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:45 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11742.451105 secs 2024-04-26T21:45:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12439.477655 secs 2024-04-26T21:45:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:45 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11742.451105 secs 2024-04-26T21:45:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:46 smithi189 ceph-mon[32756]: pgmap v7195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:46 smithi156 ceph-mon[32679]: pgmap v7195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:46 smithi092 ceph-mon[29156]: pgmap v7195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:45:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:48 smithi189 ceph-mon[32756]: pgmap v7196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:45:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:48 smithi156 ceph-mon[32679]: pgmap v7196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:45:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:48 smithi092 ceph-mon[29156]: pgmap v7196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:45:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12444.477770 secs 2024-04-26T21:45:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12444.477770 secs 2024-04-26T21:45:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12444.477770 secs 2024-04-26T21:45:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11747.451243 secs 2024-04-26T21:45:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:50 smithi189 ceph-mon[32756]: pgmap v7197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11747.451243 secs 2024-04-26T21:45:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:50 smithi156 ceph-mon[32679]: pgmap v7197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11747.451243 secs 2024-04-26T21:45:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:50 smithi092 ceph-mon[29156]: pgmap v7197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:52 smithi189 ceph-mon[32756]: pgmap v7198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:52 smithi156 ceph-mon[32679]: pgmap v7198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:52 smithi092 ceph-mon[29156]: pgmap v7198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:54 smithi189 ceph-mon[32756]: pgmap v7199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12449.477915 secs 2024-04-26T21:45:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:54 smithi156 ceph-mon[32679]: pgmap v7199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12449.477915 secs 2024-04-26T21:45:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:54 smithi092 ceph-mon[29156]: pgmap v7199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12449.477915 secs 2024-04-26T21:45:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:55 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11752.451368 secs 2024-04-26T21:45:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:55 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11752.451368 secs 2024-04-26T21:45:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:55 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11752.451368 secs 2024-04-26T21:45:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:56 smithi189 ceph-mon[32756]: pgmap v7200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:56 smithi156 ceph-mon[32679]: pgmap v7200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:56 smithi092 ceph-mon[29156]: pgmap v7200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:45:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:58 smithi189 ceph-mon[32756]: pgmap v7201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:58 smithi156 ceph-mon[32679]: pgmap v7201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:58 smithi092 ceph-mon[29156]: pgmap v7201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:45:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:45:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12454.478035 secs 2024-04-26T21:45:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:45:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12454.478035 secs 2024-04-26T21:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:45:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12454.478035 secs 2024-04-26T21:46:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11757.451485 secs 2024-04-26T21:46:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:00 smithi156 ceph-mon[32679]: pgmap v7202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11757.451485 secs 2024-04-26T21:46:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:00 smithi092 ceph-mon[29156]: pgmap v7202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11757.451485 secs 2024-04-26T21:46:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:00 smithi189 ceph-mon[32756]: pgmap v7202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:02 smithi092 ceph-mon[29156]: pgmap v7203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:02 smithi156 ceph-mon[32679]: pgmap v7203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:02 smithi189 ceph-mon[32756]: pgmap v7203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:04 smithi156 ceph-mon[32679]: pgmap v7204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12459.478153 secs 2024-04-26T21:46:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:04 smithi092 ceph-mon[29156]: pgmap v7204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12459.478153 secs 2024-04-26T21:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:04 smithi189 ceph-mon[32756]: pgmap v7204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12459.478153 secs 2024-04-26T21:46:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:05 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11762.451605 secs 2024-04-26T21:46:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:05 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11762.451605 secs 2024-04-26T21:46:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:05 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11762.451605 secs 2024-04-26T21:46:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:06 smithi156 ceph-mon[32679]: pgmap v7205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:06 smithi092 ceph-mon[29156]: pgmap v7205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:06 smithi189 ceph-mon[32756]: pgmap v7205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:08 smithi156 ceph-mon[32679]: pgmap v7206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:08 smithi092 ceph-mon[29156]: pgmap v7206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:08 smithi189 ceph-mon[32756]: pgmap v7206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12464.478270 secs 2024-04-26T21:46:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11767.451703 secs 2024-04-26T21:46:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12464.478270 secs 2024-04-26T21:46:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11767.451703 secs 2024-04-26T21:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12464.478270 secs 2024-04-26T21:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11767.451703 secs 2024-04-26T21:46:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:10 smithi156 ceph-mon[32679]: pgmap v7207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:10 smithi092 ceph-mon[29156]: pgmap v7207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:10 smithi189 ceph-mon[32756]: pgmap v7207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:12 smithi156 ceph-mon[32679]: pgmap v7208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:12 smithi092 ceph-mon[29156]: pgmap v7208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:12 smithi189 ceph-mon[32756]: pgmap v7208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:14 smithi156 ceph-mon[32679]: pgmap v7209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12469.478334 secs 2024-04-26T21:46:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11772.451839 secs 2024-04-26T21:46:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:14 smithi092 ceph-mon[29156]: pgmap v7209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12469.478334 secs 2024-04-26T21:46:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11772.451839 secs 2024-04-26T21:46:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:14 smithi189 ceph-mon[32756]: pgmap v7209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12469.478334 secs 2024-04-26T21:46:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11772.451839 secs 2024-04-26T21:46:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:16 smithi156 ceph-mon[32679]: pgmap v7210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:16 smithi092 ceph-mon[29156]: pgmap v7210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:16 smithi189 ceph-mon[32756]: pgmap v7210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:18 smithi156 ceph-mon[32679]: pgmap v7211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:18 smithi092 ceph-mon[29156]: pgmap v7211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:18 smithi189 ceph-mon[32756]: pgmap v7211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12474.478454 secs 2024-04-26T21:46:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11777.451960 secs 2024-04-26T21:46:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12474.478454 secs 2024-04-26T21:46:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11777.451960 secs 2024-04-26T21:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12474.478454 secs 2024-04-26T21:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11777.451960 secs 2024-04-26T21:46:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:20 smithi092 ceph-mon[29156]: pgmap v7212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:20 smithi189 ceph-mon[32756]: pgmap v7212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:20 smithi156 ceph-mon[32679]: pgmap v7212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:22 smithi092 ceph-mon[29156]: pgmap v7213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:22 smithi189 ceph-mon[32756]: pgmap v7213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:22 smithi156 ceph-mon[32679]: pgmap v7213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:24 smithi092 ceph-mon[29156]: pgmap v7214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12479.478592 secs 2024-04-26T21:46:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11782.452099 secs 2024-04-26T21:46:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:24 smithi189 ceph-mon[32756]: pgmap v7214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12479.478592 secs 2024-04-26T21:46:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11782.452099 secs 2024-04-26T21:46:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:24 smithi156 ceph-mon[32679]: pgmap v7214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12479.478592 secs 2024-04-26T21:46:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11782.452099 secs 2024-04-26T21:46:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:26 smithi092 ceph-mon[29156]: pgmap v7215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:26 smithi189 ceph-mon[32756]: pgmap v7215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:26 smithi156 ceph-mon[32679]: pgmap v7215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:28 smithi092 ceph-mon[29156]: pgmap v7216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:28 smithi189 ceph-mon[32756]: pgmap v7216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:28 smithi156 ceph-mon[32679]: pgmap v7216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12484.478717 secs 2024-04-26T21:46:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11787.452215 secs 2024-04-26T21:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12484.478717 secs 2024-04-26T21:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11787.452215 secs 2024-04-26T21:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12484.478717 secs 2024-04-26T21:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11787.452215 secs 2024-04-26T21:46:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:30 smithi092 ceph-mon[29156]: pgmap v7217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:30 smithi189 ceph-mon[32756]: pgmap v7217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:30 smithi156 ceph-mon[32679]: pgmap v7217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:32 smithi092 ceph-mon[29156]: pgmap v7218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:32 smithi189 ceph-mon[32756]: pgmap v7218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:32 smithi156 ceph-mon[32679]: pgmap v7218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:34 smithi092 ceph-mon[29156]: pgmap v7219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12489.478869 secs 2024-04-26T21:46:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11792.452336 secs 2024-04-26T21:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:34 smithi189 ceph-mon[32756]: pgmap v7219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12489.478869 secs 2024-04-26T21:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11792.452336 secs 2024-04-26T21:46:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:34 smithi156 ceph-mon[32679]: pgmap v7219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12489.478869 secs 2024-04-26T21:46:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11792.452336 secs 2024-04-26T21:46:36.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:36 smithi156 ceph-mon[32679]: pgmap v7220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:36 smithi092 ceph-mon[29156]: pgmap v7220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:36 smithi189 ceph-mon[32756]: pgmap v7220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:46:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:38 smithi092 ceph-mon[29156]: pgmap v7221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:46:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:38 smithi189 ceph-mon[32756]: pgmap v7221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:46:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:38 smithi156 ceph-mon[32679]: pgmap v7221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:46:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:46:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:46:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:39 smithi092 ceph-mon[29156]: pgmap v7222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:46:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:39 smithi092 ceph-mon[29156]: pgmap v7223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12494.478949 secs 2024-04-26T21:46:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11797.452414 secs 2024-04-26T21:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:39 smithi189 ceph-mon[32756]: pgmap v7222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:39 smithi189 ceph-mon[32756]: pgmap v7223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12494.478949 secs 2024-04-26T21:46:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11797.452414 secs 2024-04-26T21:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:39 smithi156 ceph-mon[32679]: pgmap v7222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:39 smithi156 ceph-mon[32679]: pgmap v7223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12494.478949 secs 2024-04-26T21:46:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11797.452414 secs 2024-04-26T21:46:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:41 smithi092 ceph-mon[29156]: pgmap v7224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:41 smithi189 ceph-mon[32756]: pgmap v7224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:41 smithi156 ceph-mon[32679]: pgmap v7224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:43 smithi092 ceph-mon[29156]: pgmap v7225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:43 smithi189 ceph-mon[32756]: pgmap v7225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:43 smithi156 ceph-mon[32679]: pgmap v7225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12499.479013 secs 2024-04-26T21:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11802.452539 secs 2024-04-26T21:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12499.479013 secs 2024-04-26T21:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11802.452539 secs 2024-04-26T21:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12499.479013 secs 2024-04-26T21:46:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11802.452539 secs 2024-04-26T21:46:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:45 smithi189 ceph-mon[32756]: pgmap v7226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:45 smithi156 ceph-mon[32679]: pgmap v7226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:45 smithi092 ceph-mon[29156]: pgmap v7226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:46:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:47 smithi189 ceph-mon[32756]: pgmap v7227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:47 smithi156 ceph-mon[32679]: pgmap v7227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:47 smithi092 ceph-mon[29156]: pgmap v7227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:49 smithi189 ceph-mon[32756]: pgmap v7228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12504.479104 secs 2024-04-26T21:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11807.452660 secs 2024-04-26T21:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:49 smithi156 ceph-mon[32679]: pgmap v7228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:46:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12504.479104 secs 2024-04-26T21:46:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11807.452660 secs 2024-04-26T21:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:49 smithi092 ceph-mon[29156]: pgmap v7228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12504.479104 secs 2024-04-26T21:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11807.452660 secs 2024-04-26T21:46:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:51 smithi189 ceph-mon[32756]: pgmap v7229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:51 smithi156 ceph-mon[32679]: pgmap v7229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:51 smithi092 ceph-mon[29156]: pgmap v7229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:53 smithi189 ceph-mon[32756]: pgmap v7230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:53 smithi156 ceph-mon[32679]: pgmap v7230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:53 smithi092 ceph-mon[29156]: pgmap v7230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12509.479211 secs 2024-04-26T21:46:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11812.452785 secs 2024-04-26T21:46:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12509.479211 secs 2024-04-26T21:46:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11812.452785 secs 2024-04-26T21:46:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12509.479211 secs 2024-04-26T21:46:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11812.452785 secs 2024-04-26T21:46:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:55 smithi189 ceph-mon[32756]: pgmap v7231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:55 smithi156 ceph-mon[32679]: pgmap v7231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:55 smithi092 ceph-mon[29156]: pgmap v7231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:57 smithi189 ceph-mon[32756]: pgmap v7232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:57 smithi156 ceph-mon[32679]: pgmap v7232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:57 smithi092 ceph-mon[29156]: pgmap v7232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:59 smithi189 ceph-mon[32756]: pgmap v7233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12514.479318 secs 2024-04-26T21:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:46:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11817.452904 secs 2024-04-26T21:46:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:59 smithi156 ceph-mon[32679]: pgmap v7233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12514.479318 secs 2024-04-26T21:46:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:46:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11817.452904 secs 2024-04-26T21:46:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:59 smithi092 ceph-mon[29156]: pgmap v7233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:46:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12514.479318 secs 2024-04-26T21:46:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:46:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11817.452904 secs 2024-04-26T21:47:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:01 smithi189 ceph-mon[32756]: pgmap v7234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:01 smithi156 ceph-mon[32679]: pgmap v7234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:01 smithi092 ceph-mon[29156]: pgmap v7234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:03 smithi189 ceph-mon[32756]: pgmap v7235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:03 smithi156 ceph-mon[32679]: pgmap v7235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:03 smithi092 ceph-mon[29156]: pgmap v7235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12519.479435 secs 2024-04-26T21:47:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11822.452985 secs 2024-04-26T21:47:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12519.479435 secs 2024-04-26T21:47:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11822.452985 secs 2024-04-26T21:47:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12519.479435 secs 2024-04-26T21:47:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11822.452985 secs 2024-04-26T21:47:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:05 smithi189 ceph-mon[32756]: pgmap v7236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:05 smithi156 ceph-mon[32679]: pgmap v7236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:05 smithi092 ceph-mon[29156]: pgmap v7236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:07 smithi189 ceph-mon[32756]: pgmap v7237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:07 smithi156 ceph-mon[32679]: pgmap v7237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:07 smithi092 ceph-mon[29156]: pgmap v7237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:09 smithi189 ceph-mon[32756]: pgmap v7238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12524.479570 secs 2024-04-26T21:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11827.453056 secs 2024-04-26T21:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:09 smithi156 ceph-mon[32679]: pgmap v7238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12524.479570 secs 2024-04-26T21:47:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11827.453056 secs 2024-04-26T21:47:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:09 smithi092 ceph-mon[29156]: pgmap v7238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12524.479570 secs 2024-04-26T21:47:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11827.453056 secs 2024-04-26T21:47:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:11 smithi189 ceph-mon[32756]: pgmap v7239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:11 smithi156 ceph-mon[32679]: pgmap v7239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:11 smithi092 ceph-mon[29156]: pgmap v7239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:13 smithi189 ceph-mon[32756]: pgmap v7240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:13 smithi156 ceph-mon[32679]: pgmap v7240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:13 smithi092 ceph-mon[29156]: pgmap v7240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12529.479698 secs 2024-04-26T21:47:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11832.453175 secs 2024-04-26T21:47:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12529.479698 secs 2024-04-26T21:47:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11832.453175 secs 2024-04-26T21:47:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12529.479698 secs 2024-04-26T21:47:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11832.453175 secs 2024-04-26T21:47:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:15 smithi189 ceph-mon[32756]: pgmap v7241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:15 smithi156 ceph-mon[32679]: pgmap v7241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:15 smithi092 ceph-mon[29156]: pgmap v7241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:17 smithi189 ceph-mon[32756]: pgmap v7242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:17 smithi156 ceph-mon[32679]: pgmap v7242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:17 smithi092 ceph-mon[29156]: pgmap v7242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:19 smithi189 ceph-mon[32756]: pgmap v7243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12534.479798 secs 2024-04-26T21:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11837.453320 secs 2024-04-26T21:47:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:19 smithi156 ceph-mon[32679]: pgmap v7243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12534.479798 secs 2024-04-26T21:47:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11837.453320 secs 2024-04-26T21:47:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:19 smithi092 ceph-mon[29156]: pgmap v7243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12534.479798 secs 2024-04-26T21:47:19.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11837.453320 secs 2024-04-26T21:47:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:21 smithi189 ceph-mon[32756]: pgmap v7244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:21 smithi156 ceph-mon[32679]: pgmap v7244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:21 smithi092 ceph-mon[29156]: pgmap v7244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:23 smithi189 ceph-mon[32756]: pgmap v7245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:23 smithi156 ceph-mon[32679]: pgmap v7245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:23 smithi092 ceph-mon[29156]: pgmap v7245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12539.479868 secs 2024-04-26T21:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11842.453434 secs 2024-04-26T21:47:24.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12539.479868 secs 2024-04-26T21:47:24.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11842.453434 secs 2024-04-26T21:47:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12539.479868 secs 2024-04-26T21:47:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11842.453434 secs 2024-04-26T21:47:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:25 smithi189 ceph-mon[32756]: pgmap v7246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:25 smithi156 ceph-mon[32679]: pgmap v7246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:25 smithi092 ceph-mon[29156]: pgmap v7246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:27 smithi189 ceph-mon[32756]: pgmap v7247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:27 smithi156 ceph-mon[32679]: pgmap v7247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:27 smithi092 ceph-mon[29156]: pgmap v7247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:29 smithi189 ceph-mon[32756]: pgmap v7248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12544.479988 secs 2024-04-26T21:47:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11847.453515 secs 2024-04-26T21:47:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:29 smithi156 ceph-mon[32679]: pgmap v7248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12544.479988 secs 2024-04-26T21:47:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11847.453515 secs 2024-04-26T21:47:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:29 smithi092 ceph-mon[29156]: pgmap v7248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12544.479988 secs 2024-04-26T21:47:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11847.453515 secs 2024-04-26T21:47:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:31 smithi189 ceph-mon[32756]: pgmap v7249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:31 smithi156 ceph-mon[32679]: pgmap v7249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:31 smithi092 ceph-mon[29156]: pgmap v7249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:33 smithi189 ceph-mon[32756]: pgmap v7250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:33 smithi156 ceph-mon[32679]: pgmap v7250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:33 smithi092 ceph-mon[29156]: pgmap v7250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12549.480106 secs 2024-04-26T21:47:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11852.453632 secs 2024-04-26T21:47:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12549.480106 secs 2024-04-26T21:47:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11852.453632 secs 2024-04-26T21:47:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12549.480106 secs 2024-04-26T21:47:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11852.453632 secs 2024-04-26T21:47:35.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:35 smithi092 ceph-mon[29156]: pgmap v7251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:35 smithi189 ceph-mon[32756]: pgmap v7251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:35 smithi156 ceph-mon[32679]: pgmap v7251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:37 smithi189 ceph-mon[32756]: pgmap v7252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:37 smithi156 ceph-mon[32679]: pgmap v7252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:37 smithi092 ceph-mon[29156]: pgmap v7252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:47:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:47:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:47:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:47:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:47:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:47:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:39 smithi189 ceph-mon[32756]: pgmap v7253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:39 smithi189 ceph-mon[32756]: pgmap v7254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:39 smithi189 ceph-mon[32756]: pgmap v7255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12554.480204 secs 2024-04-26T21:47:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11857.453726 secs 2024-04-26T21:47:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:39 smithi156 ceph-mon[32679]: pgmap v7253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:39 smithi156 ceph-mon[32679]: pgmap v7254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:47:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:39 smithi156 ceph-mon[32679]: pgmap v7255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:47:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12554.480204 secs 2024-04-26T21:47:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11857.453726 secs 2024-04-26T21:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:39 smithi092 ceph-mon[29156]: pgmap v7253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:39 smithi092 ceph-mon[29156]: pgmap v7254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:39 smithi092 ceph-mon[29156]: pgmap v7255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12554.480204 secs 2024-04-26T21:47:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11857.453726 secs 2024-04-26T21:47:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:41 smithi189 ceph-mon[32756]: pgmap v7256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:41 smithi156 ceph-mon[32679]: pgmap v7256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:41 smithi092 ceph-mon[29156]: pgmap v7256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:43 smithi189 ceph-mon[32756]: pgmap v7257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 4 op/s 2024-04-26T21:47:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:43 smithi156 ceph-mon[32679]: pgmap v7257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 4 op/s 2024-04-26T21:47:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:43 smithi092 ceph-mon[29156]: pgmap v7257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 4 op/s 2024-04-26T21:47:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12559.480331 secs 2024-04-26T21:47:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11862.453847 secs 2024-04-26T21:47:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12559.480331 secs 2024-04-26T21:47:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11862.453847 secs 2024-04-26T21:47:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12559.480331 secs 2024-04-26T21:47:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11862.453847 secs 2024-04-26T21:47:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:45 smithi189 ceph-mon[32756]: pgmap v7258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:45 smithi156 ceph-mon[32679]: pgmap v7258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:45 smithi092 ceph-mon[29156]: pgmap v7258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:47 smithi189 ceph-mon[32756]: pgmap v7259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:47 smithi156 ceph-mon[32679]: pgmap v7259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:47 smithi092 ceph-mon[29156]: pgmap v7259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T21:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:49 smithi189 ceph-mon[32756]: pgmap v7260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12564.480438 secs 2024-04-26T21:47:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11867.453926 secs 2024-04-26T21:47:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:49 smithi156 ceph-mon[32679]: pgmap v7260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:47:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12564.480438 secs 2024-04-26T21:47:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11867.453926 secs 2024-04-26T21:47:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:49 smithi092 ceph-mon[29156]: pgmap v7260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T21:47:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12564.480438 secs 2024-04-26T21:47:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11867.453926 secs 2024-04-26T21:47:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:51 smithi189 ceph-mon[32756]: pgmap v7261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:47:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:51 smithi156 ceph-mon[32679]: pgmap v7261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:47:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:51 smithi092 ceph-mon[29156]: pgmap v7261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:47:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:53 smithi189 ceph-mon[32756]: pgmap v7262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:47:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:53 smithi156 ceph-mon[32679]: pgmap v7262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:47:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:53 smithi092 ceph-mon[29156]: pgmap v7262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:47:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12569.480580 secs 2024-04-26T21:47:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11872.454064 secs 2024-04-26T21:47:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12569.480580 secs 2024-04-26T21:47:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11872.454064 secs 2024-04-26T21:47:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12569.480580 secs 2024-04-26T21:47:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11872.454064 secs 2024-04-26T21:47:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:55 smithi156 ceph-mon[32679]: pgmap v7263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:47:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:55 smithi092 ceph-mon[29156]: pgmap v7263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:47:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:55 smithi189 ceph-mon[32756]: pgmap v7263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:47:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:57 smithi156 ceph-mon[32679]: pgmap v7264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:57 smithi092 ceph-mon[29156]: pgmap v7264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:57 smithi189 ceph-mon[32756]: pgmap v7264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:59 smithi156 ceph-mon[32679]: pgmap v7265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12574.480725 secs 2024-04-26T21:47:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:47:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11877.454189 secs 2024-04-26T21:47:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:59 smithi092 ceph-mon[29156]: pgmap v7265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12574.480725 secs 2024-04-26T21:47:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:47:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11877.454189 secs 2024-04-26T21:47:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:59 smithi189 ceph-mon[32756]: pgmap v7265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:47:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12574.480725 secs 2024-04-26T21:47:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:47:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11877.454189 secs 2024-04-26T21:48:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:01 smithi156 ceph-mon[32679]: pgmap v7266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:01 smithi092 ceph-mon[29156]: pgmap v7266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:01 smithi189 ceph-mon[32756]: pgmap v7266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:03 smithi156 ceph-mon[32679]: pgmap v7267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:03 smithi092 ceph-mon[29156]: pgmap v7267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:03 smithi189 ceph-mon[32756]: pgmap v7267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12579.480853 secs 2024-04-26T21:48:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11882.454340 secs 2024-04-26T21:48:04.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:48:04.154+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:48:04.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:48:04.154+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:48:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:48:04.154+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:48:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:48:04.154+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:48:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:48:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:48:04.154+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:48:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12579.480853 secs 2024-04-26T21:48:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11882.454340 secs 2024-04-26T21:48:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12579.480853 secs 2024-04-26T21:48:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11882.454340 secs 2024-04-26T21:48:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:05 smithi156 ceph-mon[32679]: pgmap v7268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:05 smithi092 ceph-mon[29156]: pgmap v7268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:05 smithi189 ceph-mon[32756]: pgmap v7268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:07 smithi156 ceph-mon[32679]: pgmap v7269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:07 smithi092 ceph-mon[29156]: pgmap v7269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:07 smithi189 ceph-mon[32756]: pgmap v7269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:09 smithi156 ceph-mon[32679]: pgmap v7270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12584.480976 secs 2024-04-26T21:48:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11887.454429 secs 2024-04-26T21:48:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:09 smithi092 ceph-mon[29156]: pgmap v7270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12584.480976 secs 2024-04-26T21:48:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11887.454429 secs 2024-04-26T21:48:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:09 smithi189 ceph-mon[32756]: pgmap v7270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12584.480976 secs 2024-04-26T21:48:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11887.454429 secs 2024-04-26T21:48:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:11 smithi156 ceph-mon[32679]: pgmap v7271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:11 smithi092 ceph-mon[29156]: pgmap v7271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:11 smithi189 ceph-mon[32756]: pgmap v7271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:13 smithi156 ceph-mon[32679]: pgmap v7272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:13 smithi092 ceph-mon[29156]: pgmap v7272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:13 smithi189 ceph-mon[32756]: pgmap v7272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12589.481094 secs 2024-04-26T21:48:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11892.454497 secs 2024-04-26T21:48:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12589.481094 secs 2024-04-26T21:48:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11892.454497 secs 2024-04-26T21:48:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12589.481094 secs 2024-04-26T21:48:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11892.454497 secs 2024-04-26T21:48:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:15 smithi156 ceph-mon[32679]: pgmap v7273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:15 smithi092 ceph-mon[29156]: pgmap v7273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:15 smithi189 ceph-mon[32756]: pgmap v7273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:17 smithi092 ceph-mon[29156]: pgmap v7274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:17 smithi189 ceph-mon[32756]: pgmap v7274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:17 smithi156 ceph-mon[32679]: pgmap v7274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:19.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:19 smithi189 ceph-mon[32756]: pgmap v7275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:19.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12594.481191 secs 2024-04-26T21:48:19.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11897.454598 secs 2024-04-26T21:48:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:19 smithi092 ceph-mon[29156]: pgmap v7275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12594.481191 secs 2024-04-26T21:48:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11897.454598 secs 2024-04-26T21:48:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:19 smithi156 ceph-mon[32679]: pgmap v7275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T21:48:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12594.481191 secs 2024-04-26T21:48:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11897.454598 secs 2024-04-26T21:48:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:21 smithi092 ceph-mon[29156]: pgmap v7276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:21 smithi189 ceph-mon[32756]: pgmap v7276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:21 smithi156 ceph-mon[32679]: pgmap v7276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T21:48:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:23 smithi092 ceph-mon[29156]: pgmap v7277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:23 smithi189 ceph-mon[32756]: pgmap v7277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:23 smithi156 ceph-mon[32679]: pgmap v7277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12599.481312 secs 2024-04-26T21:48:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11902.454745 secs 2024-04-26T21:48:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12599.481312 secs 2024-04-26T21:48:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11902.454745 secs 2024-04-26T21:48:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12599.481312 secs 2024-04-26T21:48:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11902.454745 secs 2024-04-26T21:48:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:25 smithi092 ceph-mon[29156]: pgmap v7278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:25 smithi189 ceph-mon[32756]: pgmap v7278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:25 smithi156 ceph-mon[32679]: pgmap v7278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:27 smithi092 ceph-mon[29156]: pgmap v7279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:27 smithi189 ceph-mon[32756]: pgmap v7279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:27 smithi156 ceph-mon[32679]: pgmap v7279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:29 smithi092 ceph-mon[29156]: pgmap v7280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12604.481453 secs 2024-04-26T21:48:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11907.454900 secs 2024-04-26T21:48:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:29 smithi189 ceph-mon[32756]: pgmap v7280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12604.481453 secs 2024-04-26T21:48:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11907.454900 secs 2024-04-26T21:48:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:29 smithi156 ceph-mon[32679]: pgmap v7280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12604.481453 secs 2024-04-26T21:48:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11907.454900 secs 2024-04-26T21:48:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:31 smithi092 ceph-mon[29156]: pgmap v7281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:31 smithi189 ceph-mon[32756]: pgmap v7281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:31 smithi156 ceph-mon[32679]: pgmap v7281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:33 smithi092 ceph-mon[29156]: pgmap v7282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:33 smithi189 ceph-mon[32756]: pgmap v7282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:33 smithi156 ceph-mon[32679]: pgmap v7282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12609.481588 secs 2024-04-26T21:48:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11912.454995 secs 2024-04-26T21:48:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12609.481588 secs 2024-04-26T21:48:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11912.454995 secs 2024-04-26T21:48:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12609.481588 secs 2024-04-26T21:48:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11912.454995 secs 2024-04-26T21:48:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:35 smithi092 ceph-mon[29156]: pgmap v7283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:35 smithi189 ceph-mon[32756]: pgmap v7283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:35 smithi156 ceph-mon[32679]: pgmap v7283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca809e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005d90 tx=0x7f1ca809e000 comp rx=0 tx=0).stop 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a58e0 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.008+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:48:36.010 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.009+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005d50 tx=0x7f1ca80ce000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.034+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.034+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=12 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.034+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:48:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.035+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T21:48:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:36.035+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T21:48:37.708 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:37.707+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:48:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:37.707+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:48:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:37.707+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:48:37.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:48:37.707+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 100 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:48:37.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:37 smithi156 ceph-mon[32679]: pgmap v7284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:37 smithi092 ceph-mon[29156]: pgmap v7284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:37 smithi189 ceph-mon[32756]: pgmap v7284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: pgmap v7285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12614.481711 secs 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11917.455086 secs 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: pgmap v7285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12614.481711 secs 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11917.455086 secs 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:48:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: pgmap v7285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12614.481711 secs 2024-04-26T21:48:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11917.455086 secs 2024-04-26T21:48:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:48:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:48:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:48:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:40 smithi092 ceph-mon[29156]: pgmap v7286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:48:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:40 smithi092 ceph-mon[29156]: pgmap v7287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:40 smithi189 ceph-mon[32756]: pgmap v7286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:48:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:40 smithi189 ceph-mon[32756]: pgmap v7287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:40 smithi156 ceph-mon[32679]: pgmap v7286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:48:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:40 smithi156 ceph-mon[32679]: pgmap v7287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:42 smithi092 ceph-mon[29156]: pgmap v7288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:42 smithi189 ceph-mon[32756]: pgmap v7288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:42 smithi156 ceph-mon[32679]: pgmap v7288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:43 smithi189 ceph-mon[32756]: pgmap v7289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:48:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:43 smithi156 ceph-mon[32679]: pgmap v7289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:48:43.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:43 smithi092 ceph-mon[29156]: pgmap v7289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:48:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12619.481843 secs 2024-04-26T21:48:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11922.455184 secs 2024-04-26T21:48:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12619.481843 secs 2024-04-26T21:48:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11922.455184 secs 2024-04-26T21:48:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12619.481843 secs 2024-04-26T21:48:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11922.455184 secs 2024-04-26T21:48:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:45 smithi189 ceph-mon[32756]: pgmap v7290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:45 smithi156 ceph-mon[32679]: pgmap v7290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:45 smithi092 ceph-mon[29156]: pgmap v7290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:48 smithi156 ceph-mon[32679]: pgmap v7291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:48 smithi092 ceph-mon[29156]: pgmap v7291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:48 smithi189 ceph-mon[32756]: pgmap v7291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:48:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12624.481911 secs 2024-04-26T21:48:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12624.481911 secs 2024-04-26T21:48:49.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12624.481911 secs 2024-04-26T21:48:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11927.455286 secs 2024-04-26T21:48:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:50 smithi156 ceph-mon[32679]: pgmap v7292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:48:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11927.455286 secs 2024-04-26T21:48:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:50 smithi092 ceph-mon[29156]: pgmap v7292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:48:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11927.455286 secs 2024-04-26T21:48:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:50 smithi189 ceph-mon[32756]: pgmap v7292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:48:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:52 smithi156 ceph-mon[32679]: pgmap v7293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:52 smithi092 ceph-mon[29156]: pgmap v7293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:52 smithi189 ceph-mon[32756]: pgmap v7293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:54 smithi156 ceph-mon[32679]: pgmap v7294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12629.482033 secs 2024-04-26T21:48:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:54 smithi092 ceph-mon[29156]: pgmap v7294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12629.482033 secs 2024-04-26T21:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:54 smithi189 ceph-mon[32756]: pgmap v7294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12629.482033 secs 2024-04-26T21:48:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:55 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11932.455423 secs 2024-04-26T21:48:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:55 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11932.455423 secs 2024-04-26T21:48:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:55 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11932.455423 secs 2024-04-26T21:48:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:56 smithi156 ceph-mon[32679]: pgmap v7295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:56 smithi092 ceph-mon[29156]: pgmap v7295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:56 smithi189 ceph-mon[32756]: pgmap v7295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:48:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:58 smithi156 ceph-mon[32679]: pgmap v7296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:58 smithi092 ceph-mon[29156]: pgmap v7296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:58 smithi189 ceph-mon[32756]: pgmap v7296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:48:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:48:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12634.482149 secs 2024-04-26T21:48:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:48:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12634.482149 secs 2024-04-26T21:48:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:48:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12634.482149 secs 2024-04-26T21:49:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11937.455558 secs 2024-04-26T21:49:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:00 smithi156 ceph-mon[32679]: pgmap v7297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11937.455558 secs 2024-04-26T21:49:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:00 smithi092 ceph-mon[29156]: pgmap v7297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11937.455558 secs 2024-04-26T21:49:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:00 smithi189 ceph-mon[32756]: pgmap v7297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:02 smithi156 ceph-mon[32679]: pgmap v7298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:02 smithi092 ceph-mon[29156]: pgmap v7298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:02 smithi189 ceph-mon[32756]: pgmap v7298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:04 smithi156 ceph-mon[32679]: pgmap v7299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:04.469 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12639.482302 secs 2024-04-26T21:49:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:04 smithi092 ceph-mon[29156]: pgmap v7299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12639.482302 secs 2024-04-26T21:49:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:04 smithi189 ceph-mon[32756]: pgmap v7299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12639.482302 secs 2024-04-26T21:49:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:05 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11942.455618 secs 2024-04-26T21:49:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:05 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11942.455618 secs 2024-04-26T21:49:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:05 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11942.455618 secs 2024-04-26T21:49:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:06 smithi092 ceph-mon[29156]: pgmap v7300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:06 smithi189 ceph-mon[32756]: pgmap v7300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:06 smithi156 ceph-mon[32679]: pgmap v7300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:08.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:08 smithi156 ceph-mon[32679]: pgmap v7301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:08 smithi092 ceph-mon[29156]: pgmap v7301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:08 smithi189 ceph-mon[32756]: pgmap v7301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12644.482422 secs 2024-04-26T21:49:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11947.455722 secs 2024-04-26T21:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12644.482422 secs 2024-04-26T21:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11947.455722 secs 2024-04-26T21:49:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12644.482422 secs 2024-04-26T21:49:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11947.455722 secs 2024-04-26T21:49:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:10 smithi092 ceph-mon[29156]: pgmap v7302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:10 smithi189 ceph-mon[32756]: pgmap v7302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:10 smithi156 ceph-mon[32679]: pgmap v7302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:12 smithi092 ceph-mon[29156]: pgmap v7303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:12 smithi189 ceph-mon[32756]: pgmap v7303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:12 smithi156 ceph-mon[32679]: pgmap v7303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:14 smithi092 ceph-mon[29156]: pgmap v7304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12649.482549 secs 2024-04-26T21:49:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11952.455845 secs 2024-04-26T21:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:14 smithi189 ceph-mon[32756]: pgmap v7304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12649.482549 secs 2024-04-26T21:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11952.455845 secs 2024-04-26T21:49:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:14 smithi156 ceph-mon[32679]: pgmap v7304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:49:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12649.482549 secs 2024-04-26T21:49:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11952.455845 secs 2024-04-26T21:49:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:16 smithi092 ceph-mon[29156]: pgmap v7305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:16 smithi189 ceph-mon[32756]: pgmap v7305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:16 smithi156 ceph-mon[32679]: pgmap v7305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:49:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:18 smithi092 ceph-mon[29156]: pgmap v7306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:18 smithi189 ceph-mon[32756]: pgmap v7306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:18 smithi156 ceph-mon[32679]: pgmap v7306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12654.482681 secs 2024-04-26T21:49:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11957.455963 secs 2024-04-26T21:49:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12654.482681 secs 2024-04-26T21:49:19.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11957.455963 secs 2024-04-26T21:49:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12654.482681 secs 2024-04-26T21:49:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11957.455963 secs 2024-04-26T21:49:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:20 smithi092 ceph-mon[29156]: pgmap v7307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:20 smithi189 ceph-mon[32756]: pgmap v7307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:20 smithi156 ceph-mon[32679]: pgmap v7307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:22 smithi092 ceph-mon[29156]: pgmap v7308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:22 smithi189 ceph-mon[32756]: pgmap v7308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:22 smithi156 ceph-mon[32679]: pgmap v7308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:24 smithi092 ceph-mon[29156]: pgmap v7309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12659.482809 secs 2024-04-26T21:49:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11962.456084 secs 2024-04-26T21:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:24 smithi189 ceph-mon[32756]: pgmap v7309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12659.482809 secs 2024-04-26T21:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11962.456084 secs 2024-04-26T21:49:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:24 smithi156 ceph-mon[32679]: pgmap v7309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12659.482809 secs 2024-04-26T21:49:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11962.456084 secs 2024-04-26T21:49:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:26 smithi092 ceph-mon[29156]: pgmap v7310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:26 smithi189 ceph-mon[32756]: pgmap v7310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:26 smithi156 ceph-mon[32679]: pgmap v7310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:28 smithi092 ceph-mon[29156]: pgmap v7311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:28 smithi189 ceph-mon[32756]: pgmap v7311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:28 smithi156 ceph-mon[32679]: pgmap v7311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12664.482960 secs 2024-04-26T21:49:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11967.456207 secs 2024-04-26T21:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12664.482960 secs 2024-04-26T21:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11967.456207 secs 2024-04-26T21:49:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12664.482960 secs 2024-04-26T21:49:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11967.456207 secs 2024-04-26T21:49:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:30 smithi092 ceph-mon[29156]: pgmap v7312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:30 smithi189 ceph-mon[32756]: pgmap v7312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:30 smithi156 ceph-mon[32679]: pgmap v7312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:32 smithi189 ceph-mon[32756]: pgmap v7313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:32 smithi156 ceph-mon[32679]: pgmap v7313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:32 smithi092 ceph-mon[29156]: pgmap v7313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:34 smithi189 ceph-mon[32756]: pgmap v7314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12669.483087 secs 2024-04-26T21:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11972.456328 secs 2024-04-26T21:49:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:34 smithi156 ceph-mon[32679]: pgmap v7314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12669.483087 secs 2024-04-26T21:49:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11972.456328 secs 2024-04-26T21:49:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:34 smithi092 ceph-mon[29156]: pgmap v7314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12669.483087 secs 2024-04-26T21:49:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11972.456328 secs 2024-04-26T21:49:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:36 smithi189 ceph-mon[32756]: pgmap v7315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:36 smithi156 ceph-mon[32679]: pgmap v7315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:36 smithi092 ceph-mon[29156]: pgmap v7315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:38 smithi189 ceph-mon[32756]: pgmap v7316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:38 smithi156 ceph-mon[32679]: pgmap v7316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:38 smithi092 ceph-mon[29156]: pgmap v7316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:39.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12674.483152 secs 2024-04-26T21:49:39.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11977.456377 secs 2024-04-26T21:49:39.517 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12674.483152 secs 2024-04-26T21:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11977.456377 secs 2024-04-26T21:49:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12674.483152 secs 2024-04-26T21:49:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11977.456377 secs 2024-04-26T21:49:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:49:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:40 smithi189 ceph-mon[32756]: pgmap v7317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:49:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:40 smithi156 ceph-mon[32679]: pgmap v7317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:49:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:40 smithi092 ceph-mon[29156]: pgmap v7317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:49:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:49:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:49:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:41 smithi189 ceph-mon[32756]: pgmap v7318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:49:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:41 smithi189 ceph-mon[32756]: pgmap v7319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:41 smithi156 ceph-mon[32679]: pgmap v7318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:49:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:41 smithi156 ceph-mon[32679]: pgmap v7319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:41 smithi092 ceph-mon[29156]: pgmap v7318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:49:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:41 smithi092 ceph-mon[29156]: pgmap v7319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:43 smithi189 ceph-mon[32756]: pgmap v7320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:43 smithi156 ceph-mon[32679]: pgmap v7320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:43 smithi092 ceph-mon[29156]: pgmap v7320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12679.483271 secs 2024-04-26T21:49:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11982.456513 secs 2024-04-26T21:49:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12679.483271 secs 2024-04-26T21:49:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11982.456513 secs 2024-04-26T21:49:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12679.483271 secs 2024-04-26T21:49:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11982.456513 secs 2024-04-26T21:49:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:45 smithi189 ceph-mon[32756]: pgmap v7321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:45 smithi156 ceph-mon[32679]: pgmap v7321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:45 smithi092 ceph-mon[29156]: pgmap v7321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:47 smithi189 ceph-mon[32756]: pgmap v7322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:47 smithi156 ceph-mon[32679]: pgmap v7322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:47 smithi092 ceph-mon[29156]: pgmap v7322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:49 smithi189 ceph-mon[32756]: pgmap v7323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12684.483418 secs 2024-04-26T21:49:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11987.456651 secs 2024-04-26T21:49:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:49 smithi156 ceph-mon[32679]: pgmap v7323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12684.483418 secs 2024-04-26T21:49:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11987.456651 secs 2024-04-26T21:49:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:49 smithi092 ceph-mon[29156]: pgmap v7323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:49:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12684.483418 secs 2024-04-26T21:49:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11987.456651 secs 2024-04-26T21:49:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:51 smithi189 ceph-mon[32756]: pgmap v7324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:49:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:51 smithi156 ceph-mon[32679]: pgmap v7324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:49:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:51 smithi092 ceph-mon[29156]: pgmap v7324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:49:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:53 smithi189 ceph-mon[32756]: pgmap v7325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:53 smithi156 ceph-mon[32679]: pgmap v7325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:53 smithi092 ceph-mon[29156]: pgmap v7325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12689.483545 secs 2024-04-26T21:49:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11992.456775 secs 2024-04-26T21:49:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12689.483545 secs 2024-04-26T21:49:54.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11992.456775 secs 2024-04-26T21:49:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12689.483545 secs 2024-04-26T21:49:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11992.456775 secs 2024-04-26T21:49:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:55 smithi189 ceph-mon[32756]: pgmap v7326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:55 smithi156 ceph-mon[32679]: pgmap v7326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:55 smithi092 ceph-mon[29156]: pgmap v7326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:49:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:57 smithi189 ceph-mon[32756]: pgmap v7327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:57 smithi156 ceph-mon[32679]: pgmap v7327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:57 smithi092 ceph-mon[29156]: pgmap v7327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:59 smithi189 ceph-mon[32756]: pgmap v7328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12694.483664 secs 2024-04-26T21:49:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:49:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 11997.456853 secs 2024-04-26T21:49:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:59 smithi156 ceph-mon[32679]: pgmap v7328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12694.483664 secs 2024-04-26T21:49:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:49:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 11997.456853 secs 2024-04-26T21:49:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:59 smithi092 ceph-mon[29156]: pgmap v7328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:49:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12694.483664 secs 2024-04-26T21:49:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:49:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 11997.456853 secs 2024-04-26T21:50:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:50:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:50:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T21:50:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:01 smithi189 ceph-mon[32756]: pgmap v7329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:01 smithi156 ceph-mon[32679]: pgmap v7329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:01 smithi092 ceph-mon[29156]: pgmap v7329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:03 smithi189 ceph-mon[32756]: pgmap v7330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:03 smithi156 ceph-mon[32679]: pgmap v7330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:03 smithi092 ceph-mon[29156]: pgmap v7330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12699.483780 secs 2024-04-26T21:50:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12002.456956 secs 2024-04-26T21:50:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12699.483780 secs 2024-04-26T21:50:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12002.456956 secs 2024-04-26T21:50:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12699.483780 secs 2024-04-26T21:50:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12002.456956 secs 2024-04-26T21:50:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:05 smithi189 ceph-mon[32756]: pgmap v7331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:05 smithi156 ceph-mon[32679]: pgmap v7331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:05 smithi092 ceph-mon[29156]: pgmap v7331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:07 smithi189 ceph-mon[32756]: pgmap v7332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:07 smithi156 ceph-mon[32679]: pgmap v7332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:07 smithi092 ceph-mon[29156]: pgmap v7332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:08 smithi189 ceph-mon[32756]: pgmap v7333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:08 smithi156 ceph-mon[32679]: pgmap v7333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:08 smithi092 ceph-mon[29156]: pgmap v7333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12704.483902 secs 2024-04-26T21:50:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12007.457075 secs 2024-04-26T21:50:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12704.483902 secs 2024-04-26T21:50:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12007.457075 secs 2024-04-26T21:50:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12704.483902 secs 2024-04-26T21:50:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12007.457075 secs 2024-04-26T21:50:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:10 smithi189 ceph-mon[32756]: pgmap v7334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:10 smithi156 ceph-mon[32679]: pgmap v7334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:10 smithi092 ceph-mon[29156]: pgmap v7334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:12 smithi092 ceph-mon[29156]: pgmap v7335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:12 smithi189 ceph-mon[32756]: pgmap v7335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:12 smithi156 ceph-mon[32679]: pgmap v7335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12709.484018 secs 2024-04-26T21:50:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12012.457216 secs 2024-04-26T21:50:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:14 smithi092 ceph-mon[29156]: pgmap v7336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12709.484018 secs 2024-04-26T21:50:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12012.457216 secs 2024-04-26T21:50:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:14 smithi189 ceph-mon[32756]: pgmap v7336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12709.484018 secs 2024-04-26T21:50:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12012.457216 secs 2024-04-26T21:50:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:14 smithi156 ceph-mon[32679]: pgmap v7336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:16 smithi092 ceph-mon[29156]: pgmap v7337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:16 smithi189 ceph-mon[32756]: pgmap v7337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:16 smithi156 ceph-mon[32679]: pgmap v7337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:18 smithi092 ceph-mon[29156]: pgmap v7338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:18 smithi189 ceph-mon[32756]: pgmap v7338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:18 smithi156 ceph-mon[32679]: pgmap v7338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12714.484083 secs 2024-04-26T21:50:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12017.457356 secs 2024-04-26T21:50:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12714.484083 secs 2024-04-26T21:50:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12017.457356 secs 2024-04-26T21:50:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12714.484083 secs 2024-04-26T21:50:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12017.457356 secs 2024-04-26T21:50:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:20 smithi092 ceph-mon[29156]: pgmap v7339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:20 smithi189 ceph-mon[32756]: pgmap v7339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:20 smithi156 ceph-mon[32679]: pgmap v7339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:22 smithi092 ceph-mon[29156]: pgmap v7340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:22 smithi189 ceph-mon[32756]: pgmap v7340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:22 smithi156 ceph-mon[32679]: pgmap v7340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12719.484196 secs 2024-04-26T21:50:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12022.457421 secs 2024-04-26T21:50:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:24 smithi092 ceph-mon[29156]: pgmap v7341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12719.484196 secs 2024-04-26T21:50:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12022.457421 secs 2024-04-26T21:50:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:24 smithi189 ceph-mon[32756]: pgmap v7341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12719.484196 secs 2024-04-26T21:50:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12022.457421 secs 2024-04-26T21:50:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:24 smithi156 ceph-mon[32679]: pgmap v7341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:26 smithi092 ceph-mon[29156]: pgmap v7342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:26 smithi189 ceph-mon[32756]: pgmap v7342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:26 smithi156 ceph-mon[32679]: pgmap v7342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:28 smithi092 ceph-mon[29156]: pgmap v7343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:28 smithi189 ceph-mon[32756]: pgmap v7343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:28 smithi156 ceph-mon[32679]: pgmap v7343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:50:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12724.484277 secs 2024-04-26T21:50:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12027.457505 secs 2024-04-26T21:50:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12724.484277 secs 2024-04-26T21:50:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12027.457505 secs 2024-04-26T21:50:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12724.484277 secs 2024-04-26T21:50:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12027.457505 secs 2024-04-26T21:50:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:30 smithi092 ceph-mon[29156]: pgmap v7344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:30 smithi189 ceph-mon[32756]: pgmap v7344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:30 smithi156 ceph-mon[32679]: pgmap v7344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:50:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:32 smithi092 ceph-mon[29156]: pgmap v7345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:32 smithi189 ceph-mon[32756]: pgmap v7345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:32 smithi156 ceph-mon[32679]: pgmap v7345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12729.484401 secs 2024-04-26T21:50:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12032.457582 secs 2024-04-26T21:50:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:34 smithi092 ceph-mon[29156]: pgmap v7346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12729.484401 secs 2024-04-26T21:50:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12032.457582 secs 2024-04-26T21:50:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:34 smithi189 ceph-mon[32756]: pgmap v7346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12729.484401 secs 2024-04-26T21:50:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12032.457582 secs 2024-04-26T21:50:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:34 smithi156 ceph-mon[32679]: pgmap v7346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:36 smithi092 ceph-mon[29156]: pgmap v7347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:36 smithi189 ceph-mon[32756]: pgmap v7347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:36 smithi156 ceph-mon[32679]: pgmap v7347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:39.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:38 smithi156 ceph-mon[32679]: pgmap v7348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:38 smithi092 ceph-mon[29156]: pgmap v7348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:38 smithi189 ceph-mon[32756]: pgmap v7348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12734.484535 secs 2024-04-26T21:50:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12037.457714 secs 2024-04-26T21:50:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12734.484535 secs 2024-04-26T21:50:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12037.457714 secs 2024-04-26T21:50:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12734.484535 secs 2024-04-26T21:50:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12037.457714 secs 2024-04-26T21:50:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:40 smithi189 ceph-mon[32756]: pgmap v7349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:50:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:40 smithi156 ceph-mon[32679]: pgmap v7349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:50:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:40 smithi092 ceph-mon[29156]: pgmap v7349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:50:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:50:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:50:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:50:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:41 smithi092 ceph-mon[29156]: pgmap v7350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:50:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:41 smithi092 ceph-mon[29156]: pgmap v7351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:41 smithi189 ceph-mon[32756]: pgmap v7350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:50:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:41 smithi189 ceph-mon[32756]: pgmap v7351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:41 smithi156 ceph-mon[32679]: pgmap v7350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T21:50:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:41 smithi156 ceph-mon[32679]: pgmap v7351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:44 smithi189 ceph-mon[32756]: pgmap v7352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:50:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:44 smithi156 ceph-mon[32679]: pgmap v7352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:50:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:43 smithi092 ceph-mon[29156]: pgmap v7352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:50:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12739.484652 secs 2024-04-26T21:50:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:45 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12042.457833 secs 2024-04-26T21:50:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12739.484652 secs 2024-04-26T21:50:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:45 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12042.457833 secs 2024-04-26T21:50:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12739.484652 secs 2024-04-26T21:50:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:45 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12042.457833 secs 2024-04-26T21:50:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:46 smithi189 ceph-mon[32756]: pgmap v7353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:46 smithi156 ceph-mon[32679]: pgmap v7353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:46 smithi092 ceph-mon[29156]: pgmap v7353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:48 smithi189 ceph-mon[32756]: pgmap v7354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:48 smithi156 ceph-mon[32679]: pgmap v7354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:48 smithi092 ceph-mon[29156]: pgmap v7354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12744.484771 secs 2024-04-26T21:50:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12047.457910 secs 2024-04-26T21:50:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:50 smithi189 ceph-mon[32756]: pgmap v7355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12744.484771 secs 2024-04-26T21:50:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12047.457910 secs 2024-04-26T21:50:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:50 smithi156 ceph-mon[32679]: pgmap v7355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12744.484771 secs 2024-04-26T21:50:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12047.457910 secs 2024-04-26T21:50:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:50 smithi092 ceph-mon[29156]: pgmap v7355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:50:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:52 smithi189 ceph-mon[32756]: pgmap v7356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:50:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:52 smithi156 ceph-mon[32679]: pgmap v7356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:50:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:52 smithi092 ceph-mon[29156]: pgmap v7356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:50:54.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:54 smithi189 ceph-mon[32756]: pgmap v7357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:54 smithi156 ceph-mon[32679]: pgmap v7357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:54 smithi092 ceph-mon[29156]: pgmap v7357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12749.484910 secs 2024-04-26T21:50:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:55 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12052.458031 secs 2024-04-26T21:50:55.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12749.484910 secs 2024-04-26T21:50:55.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:55 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12052.458031 secs 2024-04-26T21:50:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12749.484910 secs 2024-04-26T21:50:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:55 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12052.458031 secs 2024-04-26T21:50:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:56 smithi189 ceph-mon[32756]: pgmap v7358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:56 smithi156 ceph-mon[32679]: pgmap v7358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:56 smithi092 ceph-mon[29156]: pgmap v7358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:50:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:50:58 smithi092 ceph-mon[29156]: pgmap v7359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:50:58 smithi189 ceph-mon[32756]: pgmap v7359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:50:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:50:58 smithi156 ceph-mon[32679]: pgmap v7359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12754.485029 secs 2024-04-26T21:51:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:00 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12057.458156 secs 2024-04-26T21:51:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:00 smithi189 ceph-mon[32756]: pgmap v7360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12754.485029 secs 2024-04-26T21:51:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:00 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12057.458156 secs 2024-04-26T21:51:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:00 smithi156 ceph-mon[32679]: pgmap v7360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12754.485029 secs 2024-04-26T21:51:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:00 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12057.458156 secs 2024-04-26T21:51:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:00 smithi092 ceph-mon[29156]: pgmap v7360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:02 smithi189 ceph-mon[32756]: pgmap v7361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:02 smithi156 ceph-mon[32679]: pgmap v7361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:02 smithi092 ceph-mon[29156]: pgmap v7361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:03 smithi189 ceph-mon[32756]: pgmap v7362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:03 smithi156 ceph-mon[32679]: pgmap v7362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:03 smithi092 ceph-mon[29156]: pgmap v7362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12759.485152 secs 2024-04-26T21:51:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 12062.458224 secs 2024-04-26T21:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12759.485152 secs 2024-04-26T21:51:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 12062.458224 secs 2024-04-26T21:51:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12759.485152 secs 2024-04-26T21:51:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 12062.458224 secs 2024-04-26T21:51:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:05 smithi189 ceph-mon[32756]: pgmap v7363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:05 smithi156 ceph-mon[32679]: pgmap v7363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:05 smithi092 ceph-mon[29156]: pgmap v7363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:07 smithi189 ceph-mon[32756]: pgmap v7364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:07 smithi156 ceph-mon[32679]: pgmap v7364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:07 smithi092 ceph-mon[29156]: pgmap v7364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12764.485270 secs 2024-04-26T21:51:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:09 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 12067.458321 secs 2024-04-26T21:51:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:09 smithi189 ceph-mon[32756]: slow request 184.439811 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:51:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:09 smithi189 ceph-mon[32756]: pgmap v7365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12764.485270 secs 2024-04-26T21:51:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:09 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 12067.458321 secs 2024-04-26T21:51:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:09 smithi156 ceph-mon[32679]: slow request 184.439811 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:51:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:09 smithi156 ceph-mon[32679]: pgmap v7365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12764.485270 secs 2024-04-26T21:51:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:09 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 12067.458321 secs 2024-04-26T21:51:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:09 smithi092 ceph-mon[29156]: slow request 184.439811 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T21:51:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:09 smithi092 ceph-mon[29156]: pgmap v7365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:11 smithi189 ceph-mon[32756]: pgmap v7366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:11 smithi156 ceph-mon[32679]: pgmap v7366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:11 smithi092 ceph-mon[29156]: pgmap v7366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:12 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:51:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:12 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:51:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:12 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:51:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:12 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:51:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:12 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T21:51:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:12 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T21:51:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:13 smithi092 ceph-mon[29156]: pgmap v7367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:13 smithi189 ceph-mon[32756]: pgmap v7367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:13 smithi156 ceph-mon[32679]: pgmap v7367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12769.485334 secs 2024-04-26T21:51:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12072.458445 secs 2024-04-26T21:51:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12769.485334 secs 2024-04-26T21:51:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12072.458445 secs 2024-04-26T21:51:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12769.485334 secs 2024-04-26T21:51:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12072.458445 secs 2024-04-26T21:51:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:15 smithi189 ceph-mon[32756]: pgmap v7368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:15 smithi156 ceph-mon[32679]: pgmap v7368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:15 smithi092 ceph-mon[29156]: pgmap v7368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:17 smithi189 ceph-mon[32756]: pgmap v7369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:17 smithi156 ceph-mon[32679]: pgmap v7369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:17 smithi092 ceph-mon[29156]: pgmap v7369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12774.485409 secs 2024-04-26T21:51:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12077.458566 secs 2024-04-26T21:51:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:19 smithi189 ceph-mon[32756]: pgmap v7370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12774.485409 secs 2024-04-26T21:51:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12077.458566 secs 2024-04-26T21:51:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:19 smithi156 ceph-mon[32679]: pgmap v7370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12774.485409 secs 2024-04-26T21:51:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12077.458566 secs 2024-04-26T21:51:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:19 smithi092 ceph-mon[29156]: pgmap v7370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:21 smithi189 ceph-mon[32756]: pgmap v7371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:21 smithi156 ceph-mon[32679]: pgmap v7371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:21 smithi092 ceph-mon[29156]: pgmap v7371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:23 smithi189 ceph-mon[32756]: pgmap v7372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:23 smithi156 ceph-mon[32679]: pgmap v7372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:23 smithi092 ceph-mon[29156]: pgmap v7372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12779.485522 secs 2024-04-26T21:51:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12082.458657 secs 2024-04-26T21:51:25.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12779.485522 secs 2024-04-26T21:51:25.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12082.458657 secs 2024-04-26T21:51:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12779.485522 secs 2024-04-26T21:51:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12082.458657 secs 2024-04-26T21:51:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:25 smithi189 ceph-mon[32756]: pgmap v7373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:25 smithi156 ceph-mon[32679]: pgmap v7373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:25 smithi092 ceph-mon[29156]: pgmap v7373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:27 smithi189 ceph-mon[32756]: pgmap v7374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:27 smithi156 ceph-mon[32679]: pgmap v7374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:27 smithi092 ceph-mon[29156]: pgmap v7374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12784.485638 secs 2024-04-26T21:51:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12087.458780 secs 2024-04-26T21:51:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:29 smithi189 ceph-mon[32756]: pgmap v7375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12784.485638 secs 2024-04-26T21:51:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12087.458780 secs 2024-04-26T21:51:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:29 smithi156 ceph-mon[32679]: pgmap v7375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12784.485638 secs 2024-04-26T21:51:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12087.458780 secs 2024-04-26T21:51:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:29 smithi092 ceph-mon[29156]: pgmap v7375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:31 smithi189 ceph-mon[32756]: pgmap v7376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:31 smithi156 ceph-mon[32679]: pgmap v7376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:31 smithi092 ceph-mon[29156]: pgmap v7376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:33 smithi189 ceph-mon[32756]: pgmap v7377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:33 smithi156 ceph-mon[32679]: pgmap v7377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:33 smithi092 ceph-mon[29156]: pgmap v7377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12789.485750 secs 2024-04-26T21:51:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12092.458923 secs 2024-04-26T21:51:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12789.485750 secs 2024-04-26T21:51:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12092.458923 secs 2024-04-26T21:51:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12789.485750 secs 2024-04-26T21:51:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12092.458923 secs 2024-04-26T21:51:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:35 smithi189 ceph-mon[32756]: pgmap v7378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:35 smithi156 ceph-mon[32679]: pgmap v7378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:35 smithi092 ceph-mon[29156]: pgmap v7378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:37.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:51:37.732+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:51:37.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:51:37.732+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:51:37.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:51:37.733+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:51:37.734 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:51:37.733+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 101 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:51:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:37 smithi189 ceph-mon[32756]: pgmap v7379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:37 smithi156 ceph-mon[32679]: pgmap v7379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:37 smithi092 ceph-mon[29156]: pgmap v7379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12794.485890 secs 2024-04-26T21:51:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12097.459065 secs 2024-04-26T21:51:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:39 smithi189 ceph-mon[32756]: pgmap v7380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12794.485890 secs 2024-04-26T21:51:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12097.459065 secs 2024-04-26T21:51:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:39 smithi156 ceph-mon[32679]: pgmap v7380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12794.485890 secs 2024-04-26T21:51:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12097.459065 secs 2024-04-26T21:51:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:39 smithi092 ceph-mon[29156]: pgmap v7380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: pgmap v7381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: pgmap v7382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: pgmap v7383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: pgmap v7381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: pgmap v7382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: pgmap v7383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: pgmap v7381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: pgmap v7382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: pgmap v7383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:51:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:43 smithi189 ceph-mon[32756]: pgmap v7384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:43.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:43 smithi092 ceph-mon[29156]: pgmap v7384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:43 smithi156 ceph-mon[32679]: pgmap v7384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12799.486008 secs 2024-04-26T21:51:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12102.459200 secs 2024-04-26T21:51:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12799.486008 secs 2024-04-26T21:51:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12102.459200 secs 2024-04-26T21:51:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12799.486008 secs 2024-04-26T21:51:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12102.459200 secs 2024-04-26T21:51:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:45 smithi189 ceph-mon[32756]: pgmap v7385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:45 smithi156 ceph-mon[32679]: pgmap v7385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:45 smithi092 ceph-mon[29156]: pgmap v7385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:47 smithi189 ceph-mon[32756]: pgmap v7386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:47 smithi156 ceph-mon[32679]: pgmap v7386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:47 smithi092 ceph-mon[29156]: pgmap v7386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:51:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12804.486126 secs 2024-04-26T21:51:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12107.459322 secs 2024-04-26T21:51:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12804.486126 secs 2024-04-26T21:51:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12107.459322 secs 2024-04-26T21:51:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12804.486126 secs 2024-04-26T21:51:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12107.459322 secs 2024-04-26T21:51:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:50 smithi092 ceph-mon[29156]: pgmap v7387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:50 smithi189 ceph-mon[32756]: pgmap v7387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:50 smithi156 ceph-mon[32679]: pgmap v7387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:51:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:51 smithi189 ceph-mon[32756]: pgmap v7388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:51:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:51 smithi156 ceph-mon[32679]: pgmap v7388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:51 smithi092 ceph-mon[29156]: pgmap v7388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:51:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:53 smithi189 ceph-mon[32756]: pgmap v7389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:53 smithi156 ceph-mon[32679]: pgmap v7389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:53 smithi092 ceph-mon[29156]: pgmap v7389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12809.486236 secs 2024-04-26T21:51:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12112.459435 secs 2024-04-26T21:51:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12809.486236 secs 2024-04-26T21:51:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12112.459435 secs 2024-04-26T21:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12809.486236 secs 2024-04-26T21:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12112.459435 secs 2024-04-26T21:51:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:55 smithi189 ceph-mon[32756]: pgmap v7390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:55.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:55 smithi092 ceph-mon[29156]: pgmap v7390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:55 smithi156 ceph-mon[32679]: pgmap v7390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:51:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:57 smithi189 ceph-mon[32756]: pgmap v7391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:57 smithi156 ceph-mon[32679]: pgmap v7391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:57 smithi092 ceph-mon[29156]: pgmap v7391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:51:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12814.486374 secs 2024-04-26T21:51:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:51:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12117.459589 secs 2024-04-26T21:51:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12814.486374 secs 2024-04-26T21:51:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:51:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12117.459589 secs 2024-04-26T21:51:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12814.486374 secs 2024-04-26T21:51:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:51:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12117.459589 secs 2024-04-26T21:52:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:00 smithi092 ceph-mon[29156]: pgmap v7392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:00 smithi189 ceph-mon[32756]: pgmap v7392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:00 smithi156 ceph-mon[32679]: pgmap v7392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:01 smithi189 ceph-mon[32756]: pgmap v7393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:01 smithi156 ceph-mon[32679]: pgmap v7393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:01 smithi092 ceph-mon[29156]: pgmap v7393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:03 smithi189 ceph-mon[32756]: pgmap v7394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:03 smithi156 ceph-mon[32679]: pgmap v7394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:03 smithi092 ceph-mon[29156]: pgmap v7394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12819.486488 secs 2024-04-26T21:52:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12122.459697 secs 2024-04-26T21:52:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12819.486488 secs 2024-04-26T21:52:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12122.459697 secs 2024-04-26T21:52:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12819.486488 secs 2024-04-26T21:52:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12122.459697 secs 2024-04-26T21:52:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:05 smithi189 ceph-mon[32756]: pgmap v7395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:05 smithi156 ceph-mon[32679]: pgmap v7395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:05 smithi092 ceph-mon[29156]: pgmap v7395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:07 smithi189 ceph-mon[32756]: pgmap v7396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:07 smithi156 ceph-mon[32679]: pgmap v7396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:07 smithi092 ceph-mon[29156]: pgmap v7396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12824.486601 secs 2024-04-26T21:52:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12127.459816 secs 2024-04-26T21:52:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12824.486601 secs 2024-04-26T21:52:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12127.459816 secs 2024-04-26T21:52:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12824.486601 secs 2024-04-26T21:52:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12127.459816 secs 2024-04-26T21:52:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:10 smithi092 ceph-mon[29156]: pgmap v7397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:10 smithi189 ceph-mon[32756]: pgmap v7397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:10 smithi156 ceph-mon[32679]: pgmap v7397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:11 smithi189 ceph-mon[32756]: pgmap v7398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:11 smithi156 ceph-mon[32679]: pgmap v7398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:11 smithi092 ceph-mon[29156]: pgmap v7398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:13 smithi189 ceph-mon[32756]: pgmap v7399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:13 smithi156 ceph-mon[32679]: pgmap v7399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:13 smithi092 ceph-mon[29156]: pgmap v7399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12829.486713 secs 2024-04-26T21:52:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12132.459936 secs 2024-04-26T21:52:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12829.486713 secs 2024-04-26T21:52:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12132.459936 secs 2024-04-26T21:52:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12829.486713 secs 2024-04-26T21:52:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12132.459936 secs 2024-04-26T21:52:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:15 smithi189 ceph-mon[32756]: pgmap v7400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:15 smithi156 ceph-mon[32679]: pgmap v7400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:15 smithi092 ceph-mon[29156]: pgmap v7400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:17 smithi189 ceph-mon[32756]: pgmap v7401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:17 smithi156 ceph-mon[32679]: pgmap v7401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:17 smithi092 ceph-mon[29156]: pgmap v7401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12834.486842 secs 2024-04-26T21:52:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12137.460007 secs 2024-04-26T21:52:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12834.486842 secs 2024-04-26T21:52:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12137.460007 secs 2024-04-26T21:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12834.486842 secs 2024-04-26T21:52:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12137.460007 secs 2024-04-26T21:52:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:20 smithi092 ceph-mon[29156]: pgmap v7402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:20 smithi189 ceph-mon[32756]: pgmap v7402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:20 smithi156 ceph-mon[32679]: pgmap v7402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:21 smithi189 ceph-mon[32756]: pgmap v7403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:21 smithi156 ceph-mon[32679]: pgmap v7403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:21 smithi092 ceph-mon[29156]: pgmap v7403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:23 smithi189 ceph-mon[32756]: pgmap v7404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:23 smithi156 ceph-mon[32679]: pgmap v7404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:23 smithi092 ceph-mon[29156]: pgmap v7404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12839.486962 secs 2024-04-26T21:52:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12142.460149 secs 2024-04-26T21:52:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12839.486962 secs 2024-04-26T21:52:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12142.460149 secs 2024-04-26T21:52:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12839.486962 secs 2024-04-26T21:52:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12142.460149 secs 2024-04-26T21:52:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:25 smithi189 ceph-mon[32756]: pgmap v7405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:25.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:25 smithi092 ceph-mon[29156]: pgmap v7405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:25 smithi156 ceph-mon[32679]: pgmap v7405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:27 smithi189 ceph-mon[32756]: pgmap v7406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:27 smithi156 ceph-mon[32679]: pgmap v7406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:27 smithi092 ceph-mon[29156]: pgmap v7406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12844.487045 secs 2024-04-26T21:52:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12147.460269 secs 2024-04-26T21:52:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12844.487045 secs 2024-04-26T21:52:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12147.460269 secs 2024-04-26T21:52:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12844.487045 secs 2024-04-26T21:52:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12147.460269 secs 2024-04-26T21:52:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:30 smithi092 ceph-mon[29156]: pgmap v7407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:30 smithi189 ceph-mon[32756]: pgmap v7407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:30 smithi156 ceph-mon[32679]: pgmap v7407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:31 smithi189 ceph-mon[32756]: pgmap v7408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:31 smithi156 ceph-mon[32679]: pgmap v7408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:31 smithi092 ceph-mon[29156]: pgmap v7408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:33 smithi189 ceph-mon[32756]: pgmap v7409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:33 smithi156 ceph-mon[32679]: pgmap v7409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:33 smithi092 ceph-mon[29156]: pgmap v7409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12849.487170 secs 2024-04-26T21:52:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12152.460376 secs 2024-04-26T21:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12849.487170 secs 2024-04-26T21:52:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12152.460376 secs 2024-04-26T21:52:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12849.487170 secs 2024-04-26T21:52:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12152.460376 secs 2024-04-26T21:52:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:35 smithi189 ceph-mon[32756]: pgmap v7410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:35 smithi156 ceph-mon[32679]: pgmap v7410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:35 smithi092 ceph-mon[29156]: pgmap v7410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:37 smithi189 ceph-mon[32756]: pgmap v7411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:37 smithi156 ceph-mon[32679]: pgmap v7411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:37 smithi092 ceph-mon[29156]: pgmap v7411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12854.487234 secs 2024-04-26T21:52:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12157.460515 secs 2024-04-26T21:52:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12854.487234 secs 2024-04-26T21:52:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12157.460515 secs 2024-04-26T21:52:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12854.487234 secs 2024-04-26T21:52:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12157.460515 secs 2024-04-26T21:52:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:40 smithi092 ceph-mon[29156]: pgmap v7412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:40 smithi189 ceph-mon[32756]: pgmap v7412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:40 smithi156 ceph-mon[32679]: pgmap v7412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:41 smithi189 ceph-mon[32756]: pgmap v7413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:41 smithi156 ceph-mon[32679]: pgmap v7413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:41 smithi092 ceph-mon[29156]: pgmap v7413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:52:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:42 smithi189 ceph-mon[32756]: pgmap v7414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:52:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:42 smithi189 ceph-mon[32756]: pgmap v7415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:52:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:52:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:42 smithi156 ceph-mon[32679]: pgmap v7414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:52:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:42 smithi156 ceph-mon[32679]: pgmap v7415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:52:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:52:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:52:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:52:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:42 smithi092 ceph-mon[29156]: pgmap v7414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:52:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:42 smithi092 ceph-mon[29156]: pgmap v7415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T21:52:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12859.487351 secs 2024-04-26T21:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12162.460655 secs 2024-04-26T21:52:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12859.487351 secs 2024-04-26T21:52:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12162.460655 secs 2024-04-26T21:52:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12859.487351 secs 2024-04-26T21:52:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12162.460655 secs 2024-04-26T21:52:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:45 smithi092 ceph-mon[29156]: pgmap v7416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:45 smithi189 ceph-mon[32756]: pgmap v7416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:45 smithi156 ceph-mon[32679]: pgmap v7416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:47 smithi189 ceph-mon[32756]: pgmap v7417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:47 smithi156 ceph-mon[32679]: pgmap v7417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:47 smithi092 ceph-mon[29156]: pgmap v7417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:49 smithi189 ceph-mon[32756]: pgmap v7418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:52:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12864.487484 secs 2024-04-26T21:52:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12167.460706 secs 2024-04-26T21:52:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:49 smithi156 ceph-mon[32679]: pgmap v7418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:52:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12864.487484 secs 2024-04-26T21:52:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12167.460706 secs 2024-04-26T21:52:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:49 smithi092 ceph-mon[29156]: pgmap v7418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:52:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12864.487484 secs 2024-04-26T21:52:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12167.460706 secs 2024-04-26T21:52:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:51 smithi189 ceph-mon[32756]: pgmap v7419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:51 smithi156 ceph-mon[32679]: pgmap v7419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:51 smithi092 ceph-mon[29156]: pgmap v7419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:52:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:53 smithi189 ceph-mon[32756]: pgmap v7420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:52:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:53 smithi156 ceph-mon[32679]: pgmap v7420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:52:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:53 smithi092 ceph-mon[29156]: pgmap v7420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:52:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12869.487619 secs 2024-04-26T21:52:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12172.460826 secs 2024-04-26T21:52:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12869.487619 secs 2024-04-26T21:52:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12172.460826 secs 2024-04-26T21:52:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12869.487619 secs 2024-04-26T21:52:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12172.460826 secs 2024-04-26T21:52:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:55 smithi189 ceph-mon[32756]: pgmap v7421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:55.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:55 smithi092 ceph-mon[29156]: pgmap v7421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:55 smithi156 ceph-mon[32679]: pgmap v7421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:52:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:57 smithi189 ceph-mon[32756]: pgmap v7422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:57 smithi156 ceph-mon[32679]: pgmap v7422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:57 smithi092 ceph-mon[29156]: pgmap v7422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:59 smithi189 ceph-mon[32756]: pgmap v7423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12874.487729 secs 2024-04-26T21:52:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:52:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12177.460946 secs 2024-04-26T21:52:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:59 smithi156 ceph-mon[32679]: pgmap v7423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12874.487729 secs 2024-04-26T21:52:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:52:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12177.460946 secs 2024-04-26T21:52:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:59 smithi092 ceph-mon[29156]: pgmap v7423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:52:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12874.487729 secs 2024-04-26T21:52:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:52:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12177.460946 secs 2024-04-26T21:53:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:01 smithi189 ceph-mon[32756]: pgmap v7424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:01 smithi156 ceph-mon[32679]: pgmap v7424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:01 smithi092 ceph-mon[29156]: pgmap v7424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:03 smithi189 ceph-mon[32756]: pgmap v7425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:03 smithi156 ceph-mon[32679]: pgmap v7425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:03 smithi092 ceph-mon[29156]: pgmap v7425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12879.487855 secs 2024-04-26T21:53:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 12182.461067 secs 2024-04-26T21:53:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-mon[29156]: slow request 2880.097147 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:04.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:53:04.224+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:53:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:53:04.224+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:53:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:53:04.224+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:53:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:53:04.224+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:53:04.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:53:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:53:04.224+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:53:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12879.487855 secs 2024-04-26T21:53:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:04 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 12182.461067 secs 2024-04-26T21:53:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:04 smithi189 ceph-mon[32756]: slow request 2880.097147 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12879.487855 secs 2024-04-26T21:53:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:04 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 12182.461067 secs 2024-04-26T21:53:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:04 smithi156 ceph-mon[32679]: slow request 2880.097147 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:53:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:05 smithi189 ceph-mon[32756]: pgmap v7426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:05 smithi156 ceph-mon[32679]: pgmap v7426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:05 smithi092 ceph-mon[29156]: pgmap v7426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:07 smithi189 ceph-mon[32756]: pgmap v7427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:07 smithi156 ceph-mon[32679]: pgmap v7427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:07 smithi092 ceph-mon[29156]: pgmap v7427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:07.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:53:07.745+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:53:07.745 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:53:07.745+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:53:07.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:53:07.745+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:53:07.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:53:07.745+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 102 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:53:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:09 smithi189 ceph-mon[32756]: pgmap v7428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12884.487966 secs 2024-04-26T21:53:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12187.461206 secs 2024-04-26T21:53:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:09 smithi156 ceph-mon[32679]: pgmap v7428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12884.487966 secs 2024-04-26T21:53:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12187.461206 secs 2024-04-26T21:53:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:09 smithi092 ceph-mon[29156]: pgmap v7428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12884.487966 secs 2024-04-26T21:53:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12187.461206 secs 2024-04-26T21:53:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:11 smithi189 ceph-mon[32756]: pgmap v7429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:11 smithi156 ceph-mon[32679]: pgmap v7429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:11 smithi092 ceph-mon[29156]: pgmap v7429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:13 smithi189 ceph-mon[32756]: pgmap v7430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:13 smithi156 ceph-mon[32679]: pgmap v7430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:13 smithi092 ceph-mon[29156]: pgmap v7430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12889.488050 secs 2024-04-26T21:53:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12192.461359 secs 2024-04-26T21:53:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12889.488050 secs 2024-04-26T21:53:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12192.461359 secs 2024-04-26T21:53:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12889.488050 secs 2024-04-26T21:53:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12192.461359 secs 2024-04-26T21:53:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:15 smithi189 ceph-mon[32756]: pgmap v7431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:15 smithi156 ceph-mon[32679]: pgmap v7431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:15 smithi092 ceph-mon[29156]: pgmap v7431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:17 smithi189 ceph-mon[32756]: pgmap v7432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:17 smithi156 ceph-mon[32679]: pgmap v7432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:17 smithi092 ceph-mon[29156]: pgmap v7432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:19 smithi189 ceph-mon[32756]: pgmap v7433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12894.488132 secs 2024-04-26T21:53:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12197.461425 secs 2024-04-26T21:53:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:19 smithi156 ceph-mon[32679]: pgmap v7433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12894.488132 secs 2024-04-26T21:53:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12197.461425 secs 2024-04-26T21:53:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:19 smithi092 ceph-mon[29156]: pgmap v7433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T21:53:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12894.488132 secs 2024-04-26T21:53:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12197.461425 secs 2024-04-26T21:53:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:21 smithi156 ceph-mon[32679]: pgmap v7434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:21 smithi092 ceph-mon[29156]: pgmap v7434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:21 smithi189 ceph-mon[32756]: pgmap v7434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T21:53:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:23 smithi156 ceph-mon[32679]: pgmap v7435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:23 smithi092 ceph-mon[29156]: pgmap v7435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:23 smithi189 ceph-mon[32756]: pgmap v7435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12899.488214 secs 2024-04-26T21:53:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12202.461491 secs 2024-04-26T21:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12899.488214 secs 2024-04-26T21:53:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12202.461491 secs 2024-04-26T21:53:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12899.488214 secs 2024-04-26T21:53:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12202.461491 secs 2024-04-26T21:53:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:25 smithi156 ceph-mon[32679]: pgmap v7436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:25 smithi092 ceph-mon[29156]: pgmap v7436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:25 smithi189 ceph-mon[32756]: pgmap v7436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:27 smithi156 ceph-mon[32679]: pgmap v7437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:27 smithi092 ceph-mon[29156]: pgmap v7437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:27 smithi189 ceph-mon[32756]: pgmap v7437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:29 smithi156 ceph-mon[32679]: pgmap v7438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12904.488357 secs 2024-04-26T21:53:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12207.461556 secs 2024-04-26T21:53:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:29 smithi092 ceph-mon[29156]: pgmap v7438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12904.488357 secs 2024-04-26T21:53:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12207.461556 secs 2024-04-26T21:53:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:29 smithi189 ceph-mon[32756]: pgmap v7438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12904.488357 secs 2024-04-26T21:53:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12207.461556 secs 2024-04-26T21:53:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:31 smithi156 ceph-mon[32679]: pgmap v7439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:31 smithi092 ceph-mon[29156]: pgmap v7439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:31 smithi189 ceph-mon[32756]: pgmap v7439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:33 smithi156 ceph-mon[32679]: pgmap v7440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:33 smithi092 ceph-mon[29156]: pgmap v7440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:33 smithi189 ceph-mon[32756]: pgmap v7440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12909.488495 secs 2024-04-26T21:53:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12212.461696 secs 2024-04-26T21:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12909.488495 secs 2024-04-26T21:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12212.461696 secs 2024-04-26T21:53:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12909.488495 secs 2024-04-26T21:53:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12212.461696 secs 2024-04-26T21:53:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:35 smithi156 ceph-mon[32679]: pgmap v7441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:35 smithi092 ceph-mon[29156]: pgmap v7441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:35 smithi189 ceph-mon[32756]: pgmap v7441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:37 smithi156 ceph-mon[32679]: pgmap v7442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:37 smithi092 ceph-mon[29156]: pgmap v7442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:37 smithi189 ceph-mon[32756]: pgmap v7442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:39 smithi156 ceph-mon[32679]: pgmap v7443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12914.488614 secs 2024-04-26T21:53:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12217.461783 secs 2024-04-26T21:53:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:39 smithi092 ceph-mon[29156]: pgmap v7443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12914.488614 secs 2024-04-26T21:53:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12217.461783 secs 2024-04-26T21:53:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:39 smithi189 ceph-mon[32756]: pgmap v7443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12914.488614 secs 2024-04-26T21:53:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12217.461783 secs 2024-04-26T21:53:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:41 smithi156 ceph-mon[32679]: pgmap v7444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:41 smithi092 ceph-mon[29156]: pgmap v7444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:41 smithi189 ceph-mon[32756]: pgmap v7444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:53:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:43 smithi092 ceph-mon[29156]: pgmap v7445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:53:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:43 smithi189 ceph-mon[32756]: pgmap v7445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:53:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:43 smithi156 ceph-mon[32679]: pgmap v7445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:53:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:53:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:53:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:44 smithi092 ceph-mon[29156]: pgmap v7446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:53:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:44 smithi092 ceph-mon[29156]: pgmap v7447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:53:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12919.488731 secs 2024-04-26T21:53:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12222.461909 secs 2024-04-26T21:53:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:44 smithi189 ceph-mon[32756]: pgmap v7446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:53:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:44 smithi189 ceph-mon[32756]: pgmap v7447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:53:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12919.488731 secs 2024-04-26T21:53:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12222.461909 secs 2024-04-26T21:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:44 smithi156 ceph-mon[32679]: pgmap v7446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:44 smithi156 ceph-mon[32679]: pgmap v7447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12919.488731 secs 2024-04-26T21:53:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12222.461909 secs 2024-04-26T21:53:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:46 smithi092 ceph-mon[29156]: pgmap v7448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:46 smithi189 ceph-mon[32756]: pgmap v7448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:46 smithi156 ceph-mon[32679]: pgmap v7448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:48 smithi092 ceph-mon[29156]: pgmap v7449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:48 smithi189 ceph-mon[32756]: pgmap v7449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:48 smithi156 ceph-mon[32679]: pgmap v7449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12924.488862 secs 2024-04-26T21:53:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12227.461997 secs 2024-04-26T21:53:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12924.488862 secs 2024-04-26T21:53:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12227.461997 secs 2024-04-26T21:53:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12924.488862 secs 2024-04-26T21:53:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12227.461997 secs 2024-04-26T21:53:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:50 smithi092 ceph-mon[29156]: pgmap v7450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:50 smithi189 ceph-mon[32756]: pgmap v7450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:50 smithi156 ceph-mon[32679]: pgmap v7450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:52 smithi092 ceph-mon[29156]: pgmap v7451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:52 smithi189 ceph-mon[32756]: pgmap v7451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:52 smithi156 ceph-mon[32679]: pgmap v7451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:53:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:54 smithi092 ceph-mon[29156]: pgmap v7452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:53:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12929.488946 secs 2024-04-26T21:53:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12232.462085 secs 2024-04-26T21:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:54 smithi189 ceph-mon[32756]: pgmap v7452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12929.488946 secs 2024-04-26T21:53:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12232.462085 secs 2024-04-26T21:53:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:54 smithi156 ceph-mon[32679]: pgmap v7452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:53:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12929.488946 secs 2024-04-26T21:53:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12232.462085 secs 2024-04-26T21:53:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:56 smithi092 ceph-mon[29156]: pgmap v7453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:56 smithi189 ceph-mon[32756]: pgmap v7453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:56 smithi156 ceph-mon[32679]: pgmap v7453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:53:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:58 smithi092 ceph-mon[29156]: pgmap v7454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:58 smithi189 ceph-mon[32756]: pgmap v7454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:58 smithi156 ceph-mon[32679]: pgmap v7454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:53:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12934.489042 secs 2024-04-26T21:53:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:53:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12237.462156 secs 2024-04-26T21:53:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12934.489042 secs 2024-04-26T21:53:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:53:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12237.462156 secs 2024-04-26T21:53:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12934.489042 secs 2024-04-26T21:53:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:53:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12237.462156 secs 2024-04-26T21:54:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:00 smithi092 ceph-mon[29156]: pgmap v7455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:00 smithi189 ceph-mon[32756]: pgmap v7455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:00 smithi156 ceph-mon[32679]: pgmap v7455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:02 smithi092 ceph-mon[29156]: pgmap v7456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:02 smithi189 ceph-mon[32756]: pgmap v7456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:02 smithi156 ceph-mon[32679]: pgmap v7456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:04 smithi092 ceph-mon[29156]: pgmap v7457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12939.489122 secs 2024-04-26T21:54:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12242.462280 secs 2024-04-26T21:54:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:04 smithi189 ceph-mon[32756]: pgmap v7457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12939.489122 secs 2024-04-26T21:54:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12242.462280 secs 2024-04-26T21:54:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:04 smithi156 ceph-mon[32679]: pgmap v7457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12939.489122 secs 2024-04-26T21:54:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12242.462280 secs 2024-04-26T21:54:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:06 smithi092 ceph-mon[29156]: pgmap v7458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:06 smithi189 ceph-mon[32756]: pgmap v7458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:06 smithi156 ceph-mon[32679]: pgmap v7458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:08 smithi092 ceph-mon[29156]: pgmap v7459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:08 smithi189 ceph-mon[32756]: pgmap v7459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:08 smithi156 ceph-mon[32679]: pgmap v7459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12944.489213 secs 2024-04-26T21:54:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:09 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 12247.462409 secs 2024-04-26T21:54:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:09 smithi092 ceph-mon[29156]: slow request 364.443900 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:54:09.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12944.489213 secs 2024-04-26T21:54:09.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:09 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 12247.462409 secs 2024-04-26T21:54:09.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:09 smithi156 ceph-mon[32679]: slow request 364.443900 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:54:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12944.489213 secs 2024-04-26T21:54:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:09 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 12247.462409 secs 2024-04-26T21:54:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:09 smithi189 ceph-mon[32756]: slow request 364.443900 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:54:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:10 smithi189 ceph-mon[32756]: pgmap v7460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:10 smithi156 ceph-mon[32679]: pgmap v7460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:10 smithi092 ceph-mon[29156]: pgmap v7460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:12 smithi189 ceph-mon[32756]: pgmap v7461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:12 smithi156 ceph-mon[32679]: pgmap v7461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:12 smithi092 ceph-mon[29156]: pgmap v7461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:14 smithi189 ceph-mon[32756]: pgmap v7462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12949.489358 secs 2024-04-26T21:54:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12252.462539 secs 2024-04-26T21:54:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:14 smithi156 ceph-mon[32679]: pgmap v7462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12949.489358 secs 2024-04-26T21:54:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12252.462539 secs 2024-04-26T21:54:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:14 smithi092 ceph-mon[29156]: pgmap v7462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12949.489358 secs 2024-04-26T21:54:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12252.462539 secs 2024-04-26T21:54:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:16 smithi189 ceph-mon[32756]: pgmap v7463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:16 smithi156 ceph-mon[32679]: pgmap v7463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:16 smithi092 ceph-mon[29156]: pgmap v7463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:18 smithi189 ceph-mon[32756]: pgmap v7464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:18 smithi156 ceph-mon[32679]: pgmap v7464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:18 smithi092 ceph-mon[29156]: pgmap v7464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12954.489505 secs 2024-04-26T21:54:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12257.462627 secs 2024-04-26T21:54:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12954.489505 secs 2024-04-26T21:54:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12257.462627 secs 2024-04-26T21:54:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12954.489505 secs 2024-04-26T21:54:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12257.462627 secs 2024-04-26T21:54:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:20 smithi189 ceph-mon[32756]: pgmap v7465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:20 smithi156 ceph-mon[32679]: pgmap v7465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:20 smithi092 ceph-mon[29156]: pgmap v7465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:22 smithi189 ceph-mon[32756]: pgmap v7466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:22 smithi156 ceph-mon[32679]: pgmap v7466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:22 smithi092 ceph-mon[29156]: pgmap v7466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:24 smithi189 ceph-mon[32756]: pgmap v7467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12959.489631 secs 2024-04-26T21:54:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12262.462779 secs 2024-04-26T21:54:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:24 smithi156 ceph-mon[32679]: pgmap v7467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12959.489631 secs 2024-04-26T21:54:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12262.462779 secs 2024-04-26T21:54:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:24 smithi092 ceph-mon[29156]: pgmap v7467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12959.489631 secs 2024-04-26T21:54:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12262.462779 secs 2024-04-26T21:54:26.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:26 smithi092 ceph-mon[29156]: pgmap v7468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:26 smithi189 ceph-mon[32756]: pgmap v7468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:26 smithi156 ceph-mon[32679]: pgmap v7468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:28 smithi189 ceph-mon[32756]: pgmap v7469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:28 smithi156 ceph-mon[32679]: pgmap v7469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:28 smithi092 ceph-mon[29156]: pgmap v7469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12964.489732 secs 2024-04-26T21:54:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12267.462898 secs 2024-04-26T21:54:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12964.489732 secs 2024-04-26T21:54:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12267.462898 secs 2024-04-26T21:54:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12964.489732 secs 2024-04-26T21:54:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12267.462898 secs 2024-04-26T21:54:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:30 smithi189 ceph-mon[32756]: pgmap v7470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:30 smithi156 ceph-mon[32679]: pgmap v7470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:30 smithi092 ceph-mon[29156]: pgmap v7470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:32 smithi189 ceph-mon[32756]: pgmap v7471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:32 smithi156 ceph-mon[32679]: pgmap v7471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:32 smithi092 ceph-mon[29156]: pgmap v7471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:34 smithi189 ceph-mon[32756]: pgmap v7472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12969.489869 secs 2024-04-26T21:54:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12272.462979 secs 2024-04-26T21:54:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:34 smithi156 ceph-mon[32679]: pgmap v7472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12969.489869 secs 2024-04-26T21:54:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12272.462979 secs 2024-04-26T21:54:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:34 smithi092 ceph-mon[29156]: pgmap v7472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12969.489869 secs 2024-04-26T21:54:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12272.462979 secs 2024-04-26T21:54:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:36 smithi189 ceph-mon[32756]: pgmap v7473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:36 smithi156 ceph-mon[32679]: pgmap v7473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:36 smithi092 ceph-mon[29156]: pgmap v7473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:54:37.757+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:54:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:54:37.757+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:54:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:54:37.758+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:54:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:54:37.758+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 103 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:54:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:38 smithi189 ceph-mon[32756]: pgmap v7474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:38 smithi156 ceph-mon[32679]: pgmap v7474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:38 smithi092 ceph-mon[29156]: pgmap v7474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:39.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12974.489990 secs 2024-04-26T21:54:39.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12277.463052 secs 2024-04-26T21:54:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12974.489990 secs 2024-04-26T21:54:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12277.463052 secs 2024-04-26T21:54:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12974.489990 secs 2024-04-26T21:54:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12277.463052 secs 2024-04-26T21:54:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:40 smithi189 ceph-mon[32756]: pgmap v7475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:40 smithi156 ceph-mon[32679]: pgmap v7475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:40 smithi092 ceph-mon[29156]: pgmap v7475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:42 smithi189 ceph-mon[32756]: pgmap v7476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:42 smithi156 ceph-mon[32679]: pgmap v7476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:42 smithi092 ceph-mon[29156]: pgmap v7476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:54:44.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: pgmap v7477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12979.490081 secs 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12282.463123 secs 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: pgmap v7477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12979.490081 secs 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12282.463123 secs 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: pgmap v7477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12979.490081 secs 2024-04-26T21:54:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12282.463123 secs 2024-04-26T21:54:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:45 smithi189 ceph-mon[32756]: pgmap v7478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:45 smithi156 ceph-mon[32679]: pgmap v7478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:45 smithi092 ceph-mon[29156]: pgmap v7478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T21:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:54:48.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:54:48.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:48 smithi189 ceph-mon[32756]: pgmap v7479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:48 smithi189 ceph-mon[32756]: pgmap v7480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:54:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:48 smithi156 ceph-mon[32679]: pgmap v7479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:48 smithi156 ceph-mon[32679]: pgmap v7480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T21:54:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T21:54:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:48 smithi092 ceph-mon[29156]: pgmap v7479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:54:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:48 smithi092 ceph-mon[29156]: pgmap v7480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12984.490213 secs 2024-04-26T21:54:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12287.463232 secs 2024-04-26T21:54:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:50 smithi189 ceph-mon[32756]: pgmap v7481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12984.490213 secs 2024-04-26T21:54:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12287.463232 secs 2024-04-26T21:54:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:50 smithi156 ceph-mon[32679]: pgmap v7481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12984.490213 secs 2024-04-26T21:54:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12287.463232 secs 2024-04-26T21:54:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:50 smithi092 ceph-mon[29156]: pgmap v7481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:52 smithi092 ceph-mon[29156]: pgmap v7482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:52 smithi189 ceph-mon[32756]: pgmap v7482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:52 smithi156 ceph-mon[32679]: pgmap v7482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:54 smithi189 ceph-mon[32756]: pgmap v7483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:54 smithi156 ceph-mon[32679]: pgmap v7483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:54 smithi092 ceph-mon[29156]: pgmap v7483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12989.490342 secs 2024-04-26T21:54:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12292.463354 secs 2024-04-26T21:54:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12989.490342 secs 2024-04-26T21:54:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12292.463354 secs 2024-04-26T21:54:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12989.490342 secs 2024-04-26T21:54:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12292.463354 secs 2024-04-26T21:54:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:56 smithi189 ceph-mon[32756]: pgmap v7484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:56.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:56 smithi092 ceph-mon[29156]: pgmap v7484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:56 smithi156 ceph-mon[32679]: pgmap v7484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T21:54:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:54:58 smithi189 ceph-mon[32756]: pgmap v7485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:54:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:54:58 smithi156 ceph-mon[32679]: pgmap v7485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:54:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:54:58 smithi092 ceph-mon[29156]: pgmap v7485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:55:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12994.490436 secs 2024-04-26T21:55:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12297.463473 secs 2024-04-26T21:55:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:00 smithi189 ceph-mon[32756]: pgmap v7486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12994.490436 secs 2024-04-26T21:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12297.463473 secs 2024-04-26T21:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:00 smithi156 ceph-mon[32679]: pgmap v7486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12994.490436 secs 2024-04-26T21:55:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12297.463473 secs 2024-04-26T21:55:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:00 smithi092 ceph-mon[29156]: pgmap v7486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:02 smithi189 ceph-mon[32756]: pgmap v7487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:02 smithi156 ceph-mon[32679]: pgmap v7487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:02 smithi092 ceph-mon[29156]: pgmap v7487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:04 smithi189 ceph-mon[32756]: pgmap v7488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:04 smithi156 ceph-mon[32679]: pgmap v7488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:04 smithi092 ceph-mon[29156]: pgmap v7488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 12999.490549 secs 2024-04-26T21:55:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:05 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12302.463582 secs 2024-04-26T21:55:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 12999.490549 secs 2024-04-26T21:55:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:05 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12302.463582 secs 2024-04-26T21:55:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 12999.490549 secs 2024-04-26T21:55:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:05 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12302.463582 secs 2024-04-26T21:55:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:06 smithi189 ceph-mon[32756]: pgmap v7489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:06 smithi156 ceph-mon[32679]: pgmap v7489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:06 smithi092 ceph-mon[29156]: pgmap v7489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:08.269 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:08 smithi092 ceph-mon[29156]: pgmap v7490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:08 smithi189 ceph-mon[32756]: pgmap v7490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:08 smithi156 ceph-mon[32679]: pgmap v7490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13004.490661 secs 2024-04-26T21:55:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12307.463670 secs 2024-04-26T21:55:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:10 smithi189 ceph-mon[32756]: pgmap v7491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13004.490661 secs 2024-04-26T21:55:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12307.463670 secs 2024-04-26T21:55:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:10 smithi156 ceph-mon[32679]: pgmap v7491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13004.490661 secs 2024-04-26T21:55:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12307.463670 secs 2024-04-26T21:55:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:10 smithi092 ceph-mon[29156]: pgmap v7491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:12 smithi189 ceph-mon[32756]: pgmap v7492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:12 smithi156 ceph-mon[32679]: pgmap v7492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:12 smithi092 ceph-mon[29156]: pgmap v7492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:14 smithi189 ceph-mon[32756]: pgmap v7493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:14 smithi156 ceph-mon[32679]: pgmap v7493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:14 smithi092 ceph-mon[29156]: pgmap v7493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13009.490781 secs 2024-04-26T21:55:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:15 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12312.463802 secs 2024-04-26T21:55:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13009.490781 secs 2024-04-26T21:55:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:15 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12312.463802 secs 2024-04-26T21:55:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13009.490781 secs 2024-04-26T21:55:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:15 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12312.463802 secs 2024-04-26T21:55:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:16 smithi189 ceph-mon[32756]: pgmap v7494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:16 smithi156 ceph-mon[32679]: pgmap v7494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:16 smithi092 ceph-mon[29156]: pgmap v7494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:18 smithi189 ceph-mon[32756]: pgmap v7495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:18 smithi156 ceph-mon[32679]: pgmap v7495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:18 smithi092 ceph-mon[29156]: pgmap v7495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13014.490898 secs 2024-04-26T21:55:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12317.463972 secs 2024-04-26T21:55:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:20 smithi189 ceph-mon[32756]: pgmap v7496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13014.490898 secs 2024-04-26T21:55:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12317.463972 secs 2024-04-26T21:55:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:20 smithi156 ceph-mon[32679]: pgmap v7496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13014.490898 secs 2024-04-26T21:55:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12317.463972 secs 2024-04-26T21:55:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:20 smithi092 ceph-mon[29156]: pgmap v7496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:22 smithi189 ceph-mon[32756]: pgmap v7497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:22 smithi156 ceph-mon[32679]: pgmap v7497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:22 smithi092 ceph-mon[29156]: pgmap v7497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:24 smithi189 ceph-mon[32756]: pgmap v7498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:24 smithi156 ceph-mon[32679]: pgmap v7498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:24 smithi092 ceph-mon[29156]: pgmap v7498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13019.491015 secs 2024-04-26T21:55:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12322.464098 secs 2024-04-26T21:55:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13019.491015 secs 2024-04-26T21:55:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12322.464098 secs 2024-04-26T21:55:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13019.491015 secs 2024-04-26T21:55:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12322.464098 secs 2024-04-26T21:55:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:26 smithi189 ceph-mon[32756]: pgmap v7499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:26.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:26 smithi092 ceph-mon[29156]: pgmap v7499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:26 smithi156 ceph-mon[32679]: pgmap v7499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:28 smithi189 ceph-mon[32756]: pgmap v7500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:28 smithi156 ceph-mon[32679]: pgmap v7500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:28 smithi092 ceph-mon[29156]: pgmap v7500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13024.491144 secs 2024-04-26T21:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12327.464161 secs 2024-04-26T21:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:30 smithi189 ceph-mon[32756]: pgmap v7501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13024.491144 secs 2024-04-26T21:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12327.464161 secs 2024-04-26T21:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:30 smithi156 ceph-mon[32679]: pgmap v7501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13024.491144 secs 2024-04-26T21:55:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12327.464161 secs 2024-04-26T21:55:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:30 smithi092 ceph-mon[29156]: pgmap v7501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:32 smithi189 ceph-mon[32756]: pgmap v7502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:32 smithi156 ceph-mon[32679]: pgmap v7502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:32 smithi092 ceph-mon[29156]: pgmap v7502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:34 smithi189 ceph-mon[32756]: pgmap v7503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:34 smithi156 ceph-mon[32679]: pgmap v7503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:34 smithi092 ceph-mon[29156]: pgmap v7503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13029.491266 secs 2024-04-26T21:55:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12332.464259 secs 2024-04-26T21:55:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13029.491266 secs 2024-04-26T21:55:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12332.464259 secs 2024-04-26T21:55:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13029.491266 secs 2024-04-26T21:55:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12332.464259 secs 2024-04-26T21:55:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:36 smithi189 ceph-mon[32756]: pgmap v7504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:36 smithi156 ceph-mon[32679]: pgmap v7504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:36 smithi092 ceph-mon[29156]: pgmap v7504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:38 smithi092 ceph-mon[29156]: pgmap v7505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:38 smithi189 ceph-mon[32756]: pgmap v7505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:38 smithi156 ceph-mon[32679]: pgmap v7505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13034.491406 secs 2024-04-26T21:55:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12337.464358 secs 2024-04-26T21:55:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:40 smithi156 ceph-mon[32679]: pgmap v7506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13034.491406 secs 2024-04-26T21:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12337.464358 secs 2024-04-26T21:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:40 smithi092 ceph-mon[29156]: pgmap v7506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13034.491406 secs 2024-04-26T21:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12337.464358 secs 2024-04-26T21:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:40 smithi189 ceph-mon[32756]: pgmap v7506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:42 smithi156 ceph-mon[32679]: pgmap v7507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:42 smithi092 ceph-mon[29156]: pgmap v7507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:42 smithi189 ceph-mon[32756]: pgmap v7507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:44 smithi156 ceph-mon[32679]: pgmap v7508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:44 smithi092 ceph-mon[29156]: pgmap v7508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:44 smithi189 ceph-mon[32756]: pgmap v7508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13039.491547 secs 2024-04-26T21:55:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12342.464480 secs 2024-04-26T21:55:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13039.491547 secs 2024-04-26T21:55:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12342.464480 secs 2024-04-26T21:55:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13039.491547 secs 2024-04-26T21:55:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12342.464480 secs 2024-04-26T21:55:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:46 smithi156 ceph-mon[32679]: pgmap v7509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:46 smithi092 ceph-mon[29156]: pgmap v7509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:46 smithi189 ceph-mon[32756]: pgmap v7509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:55:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: pgmap v7510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: pgmap v7511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: pgmap v7512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: pgmap v7510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: pgmap v7511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: pgmap v7512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: pgmap v7510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: pgmap v7511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: pgmap v7512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:55:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13044.491664 secs 2024-04-26T21:55:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12347.464595 secs 2024-04-26T21:55:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13044.491664 secs 2024-04-26T21:55:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12347.464595 secs 2024-04-26T21:55:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13044.491664 secs 2024-04-26T21:55:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12347.464595 secs 2024-04-26T21:55:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:50 smithi189 ceph-mon[32756]: pgmap v7513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:50 smithi156 ceph-mon[32679]: pgmap v7513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:50 smithi092 ceph-mon[29156]: pgmap v7513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:52 smithi092 ceph-mon[29156]: pgmap v7514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:52 smithi189 ceph-mon[32756]: pgmap v7514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:52 smithi156 ceph-mon[32679]: pgmap v7514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13049.491807 secs 2024-04-26T21:55:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:54 smithi092 ceph-mon[29156]: pgmap v7515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12352.464665 secs 2024-04-26T21:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13049.491807 secs 2024-04-26T21:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:54 smithi189 ceph-mon[32756]: pgmap v7515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12352.464665 secs 2024-04-26T21:55:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13049.491807 secs 2024-04-26T21:55:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:54 smithi156 ceph-mon[32679]: pgmap v7515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:55:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12352.464665 secs 2024-04-26T21:55:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:56 smithi092 ceph-mon[29156]: pgmap v7516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:56 smithi189 ceph-mon[32756]: pgmap v7516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:56 smithi156 ceph-mon[32679]: pgmap v7516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:55:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:58 smithi092 ceph-mon[29156]: pgmap v7517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:55:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:58 smithi189 ceph-mon[32756]: pgmap v7517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:55:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:58 smithi156 ceph-mon[32679]: pgmap v7517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:55:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13054.491921 secs 2024-04-26T21:55:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:55:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12357.464738 secs 2024-04-26T21:55:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13054.491921 secs 2024-04-26T21:55:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:55:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12357.464738 secs 2024-04-26T21:55:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13054.491921 secs 2024-04-26T21:55:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:55:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12357.464738 secs 2024-04-26T21:56:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:00 smithi189 ceph-mon[32756]: pgmap v7518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:00 smithi156 ceph-mon[32679]: pgmap v7518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:00 smithi092 ceph-mon[29156]: pgmap v7518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:02 smithi189 ceph-mon[32756]: pgmap v7519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:02 smithi156 ceph-mon[32679]: pgmap v7519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:02 smithi092 ceph-mon[29156]: pgmap v7519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13059.491997 secs 2024-04-26T21:56:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:04 smithi189 ceph-mon[32756]: pgmap v7520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12362.464803 secs 2024-04-26T21:56:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13059.491997 secs 2024-04-26T21:56:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:04 smithi156 ceph-mon[32679]: pgmap v7520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12362.464803 secs 2024-04-26T21:56:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13059.491997 secs 2024-04-26T21:56:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:04 smithi092 ceph-mon[29156]: pgmap v7520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12362.464803 secs 2024-04-26T21:56:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:06 smithi189 ceph-mon[32756]: pgmap v7521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:06 smithi156 ceph-mon[32679]: pgmap v7521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:06 smithi092 ceph-mon[29156]: pgmap v7521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:08 smithi189 ceph-mon[32756]: pgmap v7522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:08 smithi156 ceph-mon[32679]: pgmap v7522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:08 smithi092 ceph-mon[29156]: pgmap v7522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13064.492115 secs 2024-04-26T21:56:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12367.464950 secs 2024-04-26T21:56:09.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13064.492115 secs 2024-04-26T21:56:09.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12367.464950 secs 2024-04-26T21:56:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13064.492115 secs 2024-04-26T21:56:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12367.464950 secs 2024-04-26T21:56:10.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:10 smithi156 ceph-mon[32679]: pgmap v7523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:10 smithi189 ceph-mon[32756]: pgmap v7523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:10 smithi092 ceph-mon[29156]: pgmap v7523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:12 smithi189 ceph-mon[32756]: pgmap v7524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:12 smithi156 ceph-mon[32679]: pgmap v7524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:12 smithi092 ceph-mon[29156]: pgmap v7524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:13 smithi156 ceph-mon[32679]: pgmap v7525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:13 smithi092 ceph-mon[29156]: pgmap v7525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:13 smithi189 ceph-mon[32756]: pgmap v7525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13069.492185 secs 2024-04-26T21:56:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12372.465085 secs 2024-04-26T21:56:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13069.492185 secs 2024-04-26T21:56:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12372.465085 secs 2024-04-26T21:56:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13069.492185 secs 2024-04-26T21:56:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12372.465085 secs 2024-04-26T21:56:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:15 smithi156 ceph-mon[32679]: pgmap v7526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:15 smithi092 ceph-mon[29156]: pgmap v7526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:15 smithi189 ceph-mon[32756]: pgmap v7526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:18 smithi092 ceph-mon[29156]: pgmap v7527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:18 smithi189 ceph-mon[32756]: pgmap v7527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:18 smithi156 ceph-mon[32679]: pgmap v7527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13074.492303 secs 2024-04-26T21:56:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12377.465166 secs 2024-04-26T21:56:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13074.492303 secs 2024-04-26T21:56:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12377.465166 secs 2024-04-26T21:56:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13074.492303 secs 2024-04-26T21:56:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12377.465166 secs 2024-04-26T21:56:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:20 smithi189 ceph-mon[32756]: pgmap v7528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:20 smithi156 ceph-mon[32679]: pgmap v7528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:20 smithi092 ceph-mon[29156]: pgmap v7528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:22 smithi189 ceph-mon[32756]: pgmap v7529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:22 smithi156 ceph-mon[32679]: pgmap v7529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:22 smithi092 ceph-mon[29156]: pgmap v7529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13079.492453 secs 2024-04-26T21:56:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:24 smithi189 ceph-mon[32756]: pgmap v7530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12382.465290 secs 2024-04-26T21:56:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13079.492453 secs 2024-04-26T21:56:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:24 smithi156 ceph-mon[32679]: pgmap v7530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12382.465290 secs 2024-04-26T21:56:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13079.492453 secs 2024-04-26T21:56:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:24 smithi092 ceph-mon[29156]: pgmap v7530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12382.465290 secs 2024-04-26T21:56:26.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:26 smithi092 ceph-mon[29156]: pgmap v7531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:26 smithi189 ceph-mon[32756]: pgmap v7531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:26 smithi156 ceph-mon[32679]: pgmap v7531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:28 smithi189 ceph-mon[32756]: pgmap v7532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:28 smithi156 ceph-mon[32679]: pgmap v7532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:28 smithi092 ceph-mon[29156]: pgmap v7532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13084.492566 secs 2024-04-26T21:56:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12387.465411 secs 2024-04-26T21:56:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13084.492566 secs 2024-04-26T21:56:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12387.465411 secs 2024-04-26T21:56:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13084.492566 secs 2024-04-26T21:56:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12387.465411 secs 2024-04-26T21:56:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:30 smithi189 ceph-mon[32756]: pgmap v7533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:30 smithi156 ceph-mon[32679]: pgmap v7533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:30 smithi092 ceph-mon[29156]: pgmap v7533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:32 smithi189 ceph-mon[32756]: pgmap v7534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:32 smithi156 ceph-mon[32679]: pgmap v7534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:32 smithi092 ceph-mon[29156]: pgmap v7534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13089.492685 secs 2024-04-26T21:56:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:34 smithi189 ceph-mon[32756]: pgmap v7535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12392.465569 secs 2024-04-26T21:56:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13089.492685 secs 2024-04-26T21:56:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:34 smithi156 ceph-mon[32679]: pgmap v7535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12392.465569 secs 2024-04-26T21:56:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13089.492685 secs 2024-04-26T21:56:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:34 smithi092 ceph-mon[29156]: pgmap v7535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12392.465569 secs 2024-04-26T21:56:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:36 smithi189 ceph-mon[32756]: pgmap v7536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:36 smithi156 ceph-mon[32679]: pgmap v7536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:36 smithi092 ceph-mon[29156]: pgmap v7536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:38 smithi189 ceph-mon[32756]: pgmap v7537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:38 smithi156 ceph-mon[32679]: pgmap v7537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:38 smithi092 ceph-mon[29156]: pgmap v7537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13094.492801 secs 2024-04-26T21:56:39.869 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12397.465708 secs 2024-04-26T21:56:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13094.492801 secs 2024-04-26T21:56:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12397.465708 secs 2024-04-26T21:56:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13094.492801 secs 2024-04-26T21:56:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12397.465708 secs 2024-04-26T21:56:40.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:40 smithi156 ceph-mon[32679]: pgmap v7538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:40 smithi189 ceph-mon[32756]: pgmap v7538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:40 smithi092 ceph-mon[29156]: pgmap v7538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:42 smithi189 ceph-mon[32756]: pgmap v7539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:42 smithi156 ceph-mon[32679]: pgmap v7539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:42 smithi092 ceph-mon[29156]: pgmap v7539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13099.492894 secs 2024-04-26T21:56:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:44 smithi189 ceph-mon[32756]: pgmap v7540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12402.465817 secs 2024-04-26T21:56:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13099.492894 secs 2024-04-26T21:56:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:44 smithi156 ceph-mon[32679]: pgmap v7540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12402.465817 secs 2024-04-26T21:56:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13099.492894 secs 2024-04-26T21:56:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:44 smithi092 ceph-mon[29156]: pgmap v7540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12402.465817 secs 2024-04-26T21:56:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:46 smithi189 ceph-mon[32756]: pgmap v7541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:46 smithi156 ceph-mon[32679]: pgmap v7541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:46 smithi092 ceph-mon[29156]: pgmap v7541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:56:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:56:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:48 smithi189 ceph-mon[32756]: pgmap v7542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:56:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:48 smithi156 ceph-mon[32679]: pgmap v7542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:56:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:48 smithi092 ceph-mon[29156]: pgmap v7542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:56:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:56:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:56:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:49 smithi189 ceph-mon[32756]: pgmap v7543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:49 smithi189 ceph-mon[32756]: pgmap v7544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13104.493009 secs 2024-04-26T21:56:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12407.465889 secs 2024-04-26T21:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:49 smithi156 ceph-mon[32679]: pgmap v7543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:49 smithi156 ceph-mon[32679]: pgmap v7544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13104.493009 secs 2024-04-26T21:56:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12407.465889 secs 2024-04-26T21:56:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:49 smithi092 ceph-mon[29156]: pgmap v7543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:56:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:49 smithi092 ceph-mon[29156]: pgmap v7544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:56:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13104.493009 secs 2024-04-26T21:56:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12407.465889 secs 2024-04-26T21:56:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:51 smithi189 ceph-mon[32756]: pgmap v7545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:51 smithi156 ceph-mon[32679]: pgmap v7545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:51 smithi092 ceph-mon[29156]: pgmap v7545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:53 smithi189 ceph-mon[32756]: pgmap v7546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:53 smithi156 ceph-mon[32679]: pgmap v7546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:53 smithi092 ceph-mon[29156]: pgmap v7546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:54.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13109.493073 secs 2024-04-26T21:56:54.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12412.466019 secs 2024-04-26T21:56:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13109.493073 secs 2024-04-26T21:56:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12412.466019 secs 2024-04-26T21:56:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13109.493073 secs 2024-04-26T21:56:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12412.466019 secs 2024-04-26T21:56:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:55 smithi189 ceph-mon[32756]: pgmap v7547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:55 smithi156 ceph-mon[32679]: pgmap v7547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:55 smithi092 ceph-mon[29156]: pgmap v7547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:57 smithi189 ceph-mon[32756]: pgmap v7548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:57 smithi156 ceph-mon[32679]: pgmap v7548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:57 smithi092 ceph-mon[29156]: pgmap v7548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:56:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:59 smithi189 ceph-mon[32756]: pgmap v7549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:56:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13114.493152 secs 2024-04-26T21:56:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:56:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12417.466138 secs 2024-04-26T21:56:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:59 smithi156 ceph-mon[32679]: pgmap v7549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:56:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13114.493152 secs 2024-04-26T21:56:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:56:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12417.466138 secs 2024-04-26T21:56:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:59 smithi092 ceph-mon[29156]: pgmap v7549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:56:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13114.493152 secs 2024-04-26T21:56:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:56:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12417.466138 secs 2024-04-26T21:57:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:01 smithi189 ceph-mon[32756]: pgmap v7550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:01 smithi156 ceph-mon[32679]: pgmap v7550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:01 smithi092 ceph-mon[29156]: pgmap v7550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:03 smithi189 ceph-mon[32756]: pgmap v7551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:03 smithi156 ceph-mon[32679]: pgmap v7551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:03 smithi092 ceph-mon[29156]: pgmap v7551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13119.493217 secs 2024-04-26T21:57:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12422.466250 secs 2024-04-26T21:57:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13119.493217 secs 2024-04-26T21:57:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12422.466250 secs 2024-04-26T21:57:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13119.493217 secs 2024-04-26T21:57:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12422.466250 secs 2024-04-26T21:57:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:05 smithi189 ceph-mon[32756]: pgmap v7552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:05 smithi156 ceph-mon[32679]: pgmap v7552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:05 smithi092 ceph-mon[29156]: pgmap v7552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:06 smithi189 ceph-mon[32756]: pgmap v7553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:06 smithi156 ceph-mon[32679]: pgmap v7553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:06 smithi092 ceph-mon[29156]: pgmap v7553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:09 smithi189 ceph-mon[32756]: pgmap v7554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13124.493355 secs 2024-04-26T21:57:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12427.466387 secs 2024-04-26T21:57:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:09 smithi156 ceph-mon[32679]: pgmap v7554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13124.493355 secs 2024-04-26T21:57:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12427.466387 secs 2024-04-26T21:57:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:09 smithi092 ceph-mon[29156]: pgmap v7554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13124.493355 secs 2024-04-26T21:57:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12427.466387 secs 2024-04-26T21:57:11.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:11 smithi092 ceph-mon[29156]: pgmap v7555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:11 smithi189 ceph-mon[32756]: pgmap v7555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:11 smithi156 ceph-mon[32679]: pgmap v7555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:13 smithi189 ceph-mon[32756]: pgmap v7556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:13 smithi156 ceph-mon[32679]: pgmap v7556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:13 smithi092 ceph-mon[29156]: pgmap v7556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13129.493474 secs 2024-04-26T21:57:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12432.466504 secs 2024-04-26T21:57:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13129.493474 secs 2024-04-26T21:57:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12432.466504 secs 2024-04-26T21:57:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13129.493474 secs 2024-04-26T21:57:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12432.466504 secs 2024-04-26T21:57:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:15 smithi189 ceph-mon[32756]: pgmap v7557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:15 smithi156 ceph-mon[32679]: pgmap v7557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:15 smithi092 ceph-mon[29156]: pgmap v7557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:17 smithi189 ceph-mon[32756]: pgmap v7558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:17 smithi156 ceph-mon[32679]: pgmap v7558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:17 smithi092 ceph-mon[29156]: pgmap v7558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:19 smithi189 ceph-mon[32756]: pgmap v7559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13134.493595 secs 2024-04-26T21:57:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12437.466620 secs 2024-04-26T21:57:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:19 smithi156 ceph-mon[32679]: pgmap v7559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13134.493595 secs 2024-04-26T21:57:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12437.466620 secs 2024-04-26T21:57:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:19 smithi092 ceph-mon[29156]: pgmap v7559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13134.493595 secs 2024-04-26T21:57:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12437.466620 secs 2024-04-26T21:57:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:21 smithi189 ceph-mon[32756]: pgmap v7560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:21 smithi156 ceph-mon[32679]: pgmap v7560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:21 smithi092 ceph-mon[29156]: pgmap v7560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:23 smithi189 ceph-mon[32756]: pgmap v7561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:23 smithi156 ceph-mon[32679]: pgmap v7561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:23 smithi092 ceph-mon[29156]: pgmap v7561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13139.493719 secs 2024-04-26T21:57:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12442.466699 secs 2024-04-26T21:57:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13139.493719 secs 2024-04-26T21:57:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12442.466699 secs 2024-04-26T21:57:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13139.493719 secs 2024-04-26T21:57:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12442.466699 secs 2024-04-26T21:57:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:25 smithi189 ceph-mon[32756]: pgmap v7562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:25 smithi156 ceph-mon[32679]: pgmap v7562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:25 smithi092 ceph-mon[29156]: pgmap v7562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:27 smithi189 ceph-mon[32756]: pgmap v7563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:27 smithi156 ceph-mon[32679]: pgmap v7563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:27 smithi092 ceph-mon[29156]: pgmap v7563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:29 smithi189 ceph-mon[32756]: pgmap v7564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13144.493809 secs 2024-04-26T21:57:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12447.466838 secs 2024-04-26T21:57:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:29 smithi156 ceph-mon[32679]: pgmap v7564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13144.493809 secs 2024-04-26T21:57:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12447.466838 secs 2024-04-26T21:57:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:29 smithi092 ceph-mon[29156]: pgmap v7564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13144.493809 secs 2024-04-26T21:57:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12447.466838 secs 2024-04-26T21:57:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:31 smithi189 ceph-mon[32756]: pgmap v7565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:31 smithi156 ceph-mon[32679]: pgmap v7565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:31 smithi092 ceph-mon[29156]: pgmap v7565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:33 smithi189 ceph-mon[32756]: pgmap v7566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:33 smithi156 ceph-mon[32679]: pgmap v7566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:33 smithi092 ceph-mon[29156]: pgmap v7566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13149.493930 secs 2024-04-26T21:57:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12452.466965 secs 2024-04-26T21:57:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13149.493930 secs 2024-04-26T21:57:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12452.466965 secs 2024-04-26T21:57:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13149.493930 secs 2024-04-26T21:57:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12452.466965 secs 2024-04-26T21:57:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:35 smithi189 ceph-mon[32756]: pgmap v7567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:35 smithi156 ceph-mon[32679]: pgmap v7567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:35 smithi092 ceph-mon[29156]: pgmap v7567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:37 smithi189 ceph-mon[32756]: pgmap v7568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:37 smithi156 ceph-mon[32679]: pgmap v7568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:37 smithi092 ceph-mon[29156]: pgmap v7568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:57:37.783+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:57:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:57:37.783+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:57:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:57:37.783+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T21:57:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T21:57:37.783+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 104 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T21:57:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:38 smithi156 ceph-mon[32679]: pgmap v7569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:38 smithi092 ceph-mon[29156]: pgmap v7569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:38 smithi189 ceph-mon[32756]: pgmap v7569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13154.494040 secs 2024-04-26T21:57:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12457.467104 secs 2024-04-26T21:57:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13154.494040 secs 2024-04-26T21:57:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12457.467104 secs 2024-04-26T21:57:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13154.494040 secs 2024-04-26T21:57:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12457.467104 secs 2024-04-26T21:57:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:40 smithi156 ceph-mon[32679]: pgmap v7570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:40 smithi092 ceph-mon[29156]: pgmap v7570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:40 smithi189 ceph-mon[32756]: pgmap v7570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:43.636 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:43 smithi156 ceph-mon[32679]: pgmap v7571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:43 smithi189 ceph-mon[32756]: pgmap v7571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:43 smithi092 ceph-mon[29156]: pgmap v7571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13159.494156 secs 2024-04-26T21:57:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12462.467237 secs 2024-04-26T21:57:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13159.494156 secs 2024-04-26T21:57:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12462.467237 secs 2024-04-26T21:57:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13159.494156 secs 2024-04-26T21:57:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12462.467237 secs 2024-04-26T21:57:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:45 smithi189 ceph-mon[32756]: pgmap v7572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:45 smithi156 ceph-mon[32679]: pgmap v7572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:45 smithi092 ceph-mon[29156]: pgmap v7572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:57:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:47 smithi189 ceph-mon[32756]: pgmap v7573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:47 smithi156 ceph-mon[32679]: pgmap v7573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:47 smithi092 ceph-mon[29156]: pgmap v7573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: pgmap v7574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13164.494235 secs 2024-04-26T21:57:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12467.467309 secs 2024-04-26T21:57:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:57:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: pgmap v7574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13164.494235 secs 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12467.467309 secs 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:57:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: pgmap v7574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13164.494235 secs 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12467.467309 secs 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:57:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:57:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:50 smithi189 ceph-mon[32756]: pgmap v7575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:57:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:50 smithi189 ceph-mon[32756]: pgmap v7576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:50 smithi156 ceph-mon[32679]: pgmap v7575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:57:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:50 smithi156 ceph-mon[32679]: pgmap v7576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:50 smithi092 ceph-mon[29156]: pgmap v7575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T21:57:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:50 smithi092 ceph-mon[29156]: pgmap v7576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:52 smithi189 ceph-mon[32756]: pgmap v7577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:52 smithi156 ceph-mon[32679]: pgmap v7577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:52 smithi092 ceph-mon[29156]: pgmap v7577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:54 smithi189 ceph-mon[32756]: pgmap v7578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13169.494374 secs 2024-04-26T21:57:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12472.467432 secs 2024-04-26T21:57:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:54 smithi156 ceph-mon[32679]: pgmap v7578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:57:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13169.494374 secs 2024-04-26T21:57:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12472.467432 secs 2024-04-26T21:57:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:54 smithi092 ceph-mon[29156]: pgmap v7578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:57:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13169.494374 secs 2024-04-26T21:57:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12472.467432 secs 2024-04-26T21:57:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:56 smithi189 ceph-mon[32756]: pgmap v7579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:56 smithi156 ceph-mon[32679]: pgmap v7579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:56 smithi092 ceph-mon[29156]: pgmap v7579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:58 smithi189 ceph-mon[32756]: pgmap v7580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:58 smithi156 ceph-mon[32679]: pgmap v7580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:58.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:58 smithi092 ceph-mon[29156]: pgmap v7580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:57:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13174.494490 secs 2024-04-26T21:57:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:57:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12477.467544 secs 2024-04-26T21:57:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13174.494490 secs 2024-04-26T21:57:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:57:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12477.467544 secs 2024-04-26T21:57:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13174.494490 secs 2024-04-26T21:57:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:57:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12477.467544 secs 2024-04-26T21:58:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:00 smithi189 ceph-mon[32756]: pgmap v7581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:58:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:00 smithi156 ceph-mon[32679]: pgmap v7581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:58:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:00 smithi092 ceph-mon[29156]: pgmap v7581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:58:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:02 smithi189 ceph-mon[32756]: pgmap v7582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:02 smithi156 ceph-mon[32679]: pgmap v7582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:02 smithi092 ceph-mon[29156]: pgmap v7582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:04 smithi189 ceph-mon[32756]: pgmap v7583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13179.494607 secs 2024-04-26T21:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:04 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 12482.467607 secs 2024-04-26T21:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:04 smithi189 ceph-mon[32756]: slow request 11522.172974 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:04 smithi156 ceph-mon[32679]: pgmap v7583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13179.494607 secs 2024-04-26T21:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:04 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 12482.467607 secs 2024-04-26T21:58:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:04 smithi156 ceph-mon[32679]: slow request 11522.172974 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:04 smithi092 ceph-mon[29156]: pgmap v7583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13179.494607 secs 2024-04-26T21:58:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:04 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 12482.467607 secs 2024-04-26T21:58:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:04 smithi092 ceph-mon[29156]: slow request 11522.172974 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T21:58:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:06 smithi189 ceph-mon[32756]: pgmap v7584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:06 smithi156 ceph-mon[32679]: pgmap v7584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:06 smithi092 ceph-mon[29156]: pgmap v7584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:08 smithi189 ceph-mon[32756]: pgmap v7585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:08 smithi156 ceph-mon[32679]: pgmap v7585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:08 smithi092 ceph-mon[29156]: pgmap v7585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13184.494717 secs 2024-04-26T21:58:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12487.467671 secs 2024-04-26T21:58:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13184.494717 secs 2024-04-26T21:58:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12487.467671 secs 2024-04-26T21:58:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13184.494717 secs 2024-04-26T21:58:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12487.467671 secs 2024-04-26T21:58:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:10 smithi189 ceph-mon[32756]: pgmap v7586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:10 smithi156 ceph-mon[32679]: pgmap v7586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:10 smithi092 ceph-mon[29156]: pgmap v7586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:12 smithi189 ceph-mon[32756]: pgmap v7587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:12 smithi156 ceph-mon[32679]: pgmap v7587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:12 smithi092 ceph-mon[29156]: pgmap v7587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:14 smithi189 ceph-mon[32756]: pgmap v7588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13189.494848 secs 2024-04-26T21:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12492.467784 secs 2024-04-26T21:58:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:14 smithi156 ceph-mon[32679]: pgmap v7588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13189.494848 secs 2024-04-26T21:58:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12492.467784 secs 2024-04-26T21:58:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:14 smithi092 ceph-mon[29156]: pgmap v7588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13189.494848 secs 2024-04-26T21:58:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12492.467784 secs 2024-04-26T21:58:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:16 smithi189 ceph-mon[32756]: pgmap v7589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:16 smithi156 ceph-mon[32679]: pgmap v7589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:16 smithi092 ceph-mon[29156]: pgmap v7589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:18 smithi189 ceph-mon[32756]: pgmap v7590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:18 smithi156 ceph-mon[32679]: pgmap v7590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:18 smithi092 ceph-mon[29156]: pgmap v7590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13194.494999 secs 2024-04-26T21:58:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12497.467896 secs 2024-04-26T21:58:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13194.494999 secs 2024-04-26T21:58:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12497.467896 secs 2024-04-26T21:58:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13194.494999 secs 2024-04-26T21:58:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12497.467896 secs 2024-04-26T21:58:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:20 smithi189 ceph-mon[32756]: pgmap v7591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:20 smithi156 ceph-mon[32679]: pgmap v7591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:20 smithi092 ceph-mon[29156]: pgmap v7591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:22 smithi189 ceph-mon[32756]: pgmap v7592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:22 smithi156 ceph-mon[32679]: pgmap v7592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:22 smithi092 ceph-mon[29156]: pgmap v7592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:24 smithi189 ceph-mon[32756]: pgmap v7593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13199.495118 secs 2024-04-26T21:58:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12502.468015 secs 2024-04-26T21:58:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:24 smithi156 ceph-mon[32679]: pgmap v7593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13199.495118 secs 2024-04-26T21:58:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12502.468015 secs 2024-04-26T21:58:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:24 smithi092 ceph-mon[29156]: pgmap v7593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13199.495118 secs 2024-04-26T21:58:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12502.468015 secs 2024-04-26T21:58:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:26 smithi189 ceph-mon[32756]: pgmap v7594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:26 smithi156 ceph-mon[32679]: pgmap v7594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:26 smithi092 ceph-mon[29156]: pgmap v7594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:28 smithi189 ceph-mon[32756]: pgmap v7595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:28 smithi156 ceph-mon[32679]: pgmap v7595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:28 smithi092 ceph-mon[29156]: pgmap v7595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13204.495186 secs 2024-04-26T21:58:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12507.468114 secs 2024-04-26T21:58:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13204.495186 secs 2024-04-26T21:58:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12507.468114 secs 2024-04-26T21:58:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13204.495186 secs 2024-04-26T21:58:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12507.468114 secs 2024-04-26T21:58:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:30 smithi189 ceph-mon[32756]: pgmap v7596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:30 smithi156 ceph-mon[32679]: pgmap v7596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:30 smithi092 ceph-mon[29156]: pgmap v7596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:32 smithi189 ceph-mon[32756]: pgmap v7597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:32 smithi156 ceph-mon[32679]: pgmap v7597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:32 smithi092 ceph-mon[29156]: pgmap v7597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:34 smithi189 ceph-mon[32756]: pgmap v7598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13209.495304 secs 2024-04-26T21:58:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12512.468246 secs 2024-04-26T21:58:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:34 smithi156 ceph-mon[32679]: pgmap v7598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13209.495304 secs 2024-04-26T21:58:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12512.468246 secs 2024-04-26T21:58:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-mon[29156]: pgmap v7598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13209.495304 secs 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12512.468246 secs 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:58:34.327+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:58:34.327+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:58:34.327+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:58:34.327+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:58:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 21:58:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T21:58:34.327+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T21:58:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:36 smithi156 ceph-mon[32679]: pgmap v7599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:36 smithi092 ceph-mon[29156]: pgmap v7599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:36 smithi189 ceph-mon[32756]: pgmap v7599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:58:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:38 smithi156 ceph-mon[32679]: pgmap v7600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:38 smithi092 ceph-mon[29156]: pgmap v7600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:38 smithi189 ceph-mon[32756]: pgmap v7600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:58:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13214.495423 secs 2024-04-26T21:58:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12517.468363 secs 2024-04-26T21:58:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13214.495423 secs 2024-04-26T21:58:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12517.468363 secs 2024-04-26T21:58:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13214.495423 secs 2024-04-26T21:58:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12517.468363 secs 2024-04-26T21:58:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:40 smithi156 ceph-mon[32679]: pgmap v7601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:40 smithi092 ceph-mon[29156]: pgmap v7601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:40 smithi189 ceph-mon[32756]: pgmap v7601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:42 smithi156 ceph-mon[32679]: pgmap v7602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:42 smithi092 ceph-mon[29156]: pgmap v7602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:42 smithi189 ceph-mon[32756]: pgmap v7602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:44 smithi156 ceph-mon[32679]: pgmap v7603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13219.495513 secs 2024-04-26T21:58:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12522.468481 secs 2024-04-26T21:58:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:44 smithi092 ceph-mon[29156]: pgmap v7603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13219.495513 secs 2024-04-26T21:58:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12522.468481 secs 2024-04-26T21:58:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:44 smithi189 ceph-mon[32756]: pgmap v7603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13219.495513 secs 2024-04-26T21:58:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12522.468481 secs 2024-04-26T21:58:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:46 smithi156 ceph-mon[32679]: pgmap v7604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:46 smithi092 ceph-mon[29156]: pgmap v7604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:46 smithi189 ceph-mon[32756]: pgmap v7604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:48 smithi156 ceph-mon[32679]: pgmap v7605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:48 smithi092 ceph-mon[29156]: pgmap v7605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:48 smithi189 ceph-mon[32756]: pgmap v7605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T21:58:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13224.495639 secs 2024-04-26T21:58:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12527.468612 secs 2024-04-26T21:58:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13224.495639 secs 2024-04-26T21:58:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12527.468612 secs 2024-04-26T21:58:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13224.495639 secs 2024-04-26T21:58:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12527.468612 secs 2024-04-26T21:58:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:58:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:50 smithi156 ceph-mon[32679]: pgmap v7606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:58:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:50 smithi092 ceph-mon[29156]: pgmap v7606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:58:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:50 smithi189 ceph-mon[32756]: pgmap v7606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T21:58:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:58:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:58:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:58:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:51 smithi156 ceph-mon[32679]: pgmap v7607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:58:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:51 smithi156 ceph-mon[32679]: pgmap v7608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:51 smithi092 ceph-mon[29156]: pgmap v7607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:58:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:51 smithi092 ceph-mon[29156]: pgmap v7608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:51 smithi189 ceph-mon[32756]: pgmap v7607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:58:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:51 smithi189 ceph-mon[32756]: pgmap v7608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:53 smithi156 ceph-mon[32679]: pgmap v7609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:53 smithi092 ceph-mon[29156]: pgmap v7609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:53 smithi189 ceph-mon[32756]: pgmap v7609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13229.495752 secs 2024-04-26T21:58:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12532.468674 secs 2024-04-26T21:58:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13229.495752 secs 2024-04-26T21:58:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12532.468674 secs 2024-04-26T21:58:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13229.495752 secs 2024-04-26T21:58:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12532.468674 secs 2024-04-26T21:58:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:55 smithi092 ceph-mon[29156]: pgmap v7610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:55 smithi189 ceph-mon[32756]: pgmap v7610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:55 smithi156 ceph-mon[32679]: pgmap v7610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:57 smithi092 ceph-mon[29156]: pgmap v7611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:57 smithi189 ceph-mon[32756]: pgmap v7611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:57 smithi156 ceph-mon[32679]: pgmap v7611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:59 smithi092 ceph-mon[29156]: pgmap v7612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13234.495875 secs 2024-04-26T21:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:58:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12537.468753 secs 2024-04-26T21:58:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:59 smithi189 ceph-mon[32756]: pgmap v7612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:58:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13234.495875 secs 2024-04-26T21:58:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:58:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12537.468753 secs 2024-04-26T21:58:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:59 smithi156 ceph-mon[32679]: pgmap v7612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T21:58:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13234.495875 secs 2024-04-26T21:58:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:58:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12537.468753 secs 2024-04-26T21:59:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:01 smithi092 ceph-mon[29156]: pgmap v7613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:59:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:01 smithi189 ceph-mon[32756]: pgmap v7613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:59:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:01 smithi156 ceph-mon[32679]: pgmap v7613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T21:59:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:03 smithi092 ceph-mon[29156]: pgmap v7614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:03 smithi189 ceph-mon[32756]: pgmap v7614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:03 smithi156 ceph-mon[32679]: pgmap v7614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13239.495990 secs 2024-04-26T21:59:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12542.468826 secs 2024-04-26T21:59:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13239.495990 secs 2024-04-26T21:59:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12542.468826 secs 2024-04-26T21:59:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13239.495990 secs 2024-04-26T21:59:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12542.468826 secs 2024-04-26T21:59:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:05 smithi092 ceph-mon[29156]: pgmap v7615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:05 smithi189 ceph-mon[32756]: pgmap v7615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:05 smithi156 ceph-mon[32679]: pgmap v7615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:07 smithi092 ceph-mon[29156]: pgmap v7616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:07 smithi189 ceph-mon[32756]: pgmap v7616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:07 smithi156 ceph-mon[32679]: pgmap v7616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:09 smithi092 ceph-mon[29156]: pgmap v7617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13244.496113 secs 2024-04-26T21:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12547.468945 secs 2024-04-26T21:59:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:09 smithi189 ceph-mon[32756]: pgmap v7617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13244.496113 secs 2024-04-26T21:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12547.468945 secs 2024-04-26T21:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:09 smithi156 ceph-mon[32679]: pgmap v7617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13244.496113 secs 2024-04-26T21:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12547.468945 secs 2024-04-26T21:59:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:11 smithi092 ceph-mon[29156]: pgmap v7618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:11 smithi189 ceph-mon[32756]: pgmap v7618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:11 smithi156 ceph-mon[32679]: pgmap v7618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:13 smithi092 ceph-mon[29156]: pgmap v7619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:13 smithi189 ceph-mon[32756]: pgmap v7619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:13 smithi156 ceph-mon[32679]: pgmap v7619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T21:59:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13249.496233 secs 2024-04-26T21:59:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12552.469021 secs 2024-04-26T21:59:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13249.496233 secs 2024-04-26T21:59:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12552.469021 secs 2024-04-26T21:59:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13249.496233 secs 2024-04-26T21:59:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12552.469021 secs 2024-04-26T21:59:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:15 smithi092 ceph-mon[29156]: pgmap v7620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:15 smithi189 ceph-mon[32756]: pgmap v7620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:15 smithi156 ceph-mon[32679]: pgmap v7620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T21:59:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:17 smithi092 ceph-mon[29156]: pgmap v7621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:17 smithi189 ceph-mon[32756]: pgmap v7621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:17 smithi156 ceph-mon[32679]: pgmap v7621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:19 smithi092 ceph-mon[29156]: pgmap v7622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13254.496374 secs 2024-04-26T21:59:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12557.469084 secs 2024-04-26T21:59:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:19 smithi189 ceph-mon[32756]: pgmap v7622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13254.496374 secs 2024-04-26T21:59:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12557.469084 secs 2024-04-26T21:59:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:19 smithi156 ceph-mon[32679]: pgmap v7622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13254.496374 secs 2024-04-26T21:59:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12557.469084 secs 2024-04-26T21:59:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:21 smithi092 ceph-mon[29156]: pgmap v7623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:21 smithi189 ceph-mon[32756]: pgmap v7623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:21 smithi156 ceph-mon[32679]: pgmap v7623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:23 smithi092 ceph-mon[29156]: pgmap v7624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:23 smithi189 ceph-mon[32756]: pgmap v7624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:23 smithi156 ceph-mon[32679]: pgmap v7624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13259.496504 secs 2024-04-26T21:59:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12562.469224 secs 2024-04-26T21:59:24.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13259.496504 secs 2024-04-26T21:59:24.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12562.469224 secs 2024-04-26T21:59:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13259.496504 secs 2024-04-26T21:59:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12562.469224 secs 2024-04-26T21:59:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:25 smithi189 ceph-mon[32756]: pgmap v7625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:25 smithi156 ceph-mon[32679]: pgmap v7625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:25 smithi092 ceph-mon[29156]: pgmap v7625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:27 smithi189 ceph-mon[32756]: pgmap v7626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:27 smithi156 ceph-mon[32679]: pgmap v7626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:27 smithi092 ceph-mon[29156]: pgmap v7626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:29 smithi092 ceph-mon[29156]: pgmap v7627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13264.496619 secs 2024-04-26T21:59:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12567.469347 secs 2024-04-26T21:59:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:29 smithi189 ceph-mon[32756]: pgmap v7627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13264.496619 secs 2024-04-26T21:59:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12567.469347 secs 2024-04-26T21:59:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:29 smithi156 ceph-mon[32679]: pgmap v7627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13264.496619 secs 2024-04-26T21:59:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12567.469347 secs 2024-04-26T21:59:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:31 smithi189 ceph-mon[32756]: pgmap v7628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:31 smithi156 ceph-mon[32679]: pgmap v7628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:31 smithi092 ceph-mon[29156]: pgmap v7628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:33 smithi189 ceph-mon[32756]: pgmap v7629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:33 smithi156 ceph-mon[32679]: pgmap v7629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:33 smithi092 ceph-mon[29156]: pgmap v7629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13269.496731 secs 2024-04-26T21:59:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12572.469452 secs 2024-04-26T21:59:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13269.496731 secs 2024-04-26T21:59:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12572.469452 secs 2024-04-26T21:59:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13269.496731 secs 2024-04-26T21:59:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12572.469452 secs 2024-04-26T21:59:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:35 smithi189 ceph-mon[32756]: pgmap v7630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:35 smithi156 ceph-mon[32679]: pgmap v7630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:35 smithi092 ceph-mon[29156]: pgmap v7630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:37 smithi189 ceph-mon[32756]: pgmap v7631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:37 smithi156 ceph-mon[32679]: pgmap v7631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:37 smithi092 ceph-mon[29156]: pgmap v7631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:39 smithi189 ceph-mon[32756]: pgmap v7632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13274.496870 secs 2024-04-26T21:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12577.469525 secs 2024-04-26T21:59:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:39 smithi156 ceph-mon[32679]: pgmap v7632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13274.496870 secs 2024-04-26T21:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12577.469525 secs 2024-04-26T21:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:39 smithi092 ceph-mon[29156]: pgmap v7632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13274.496870 secs 2024-04-26T21:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12577.469525 secs 2024-04-26T21:59:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:41 smithi189 ceph-mon[32756]: pgmap v7633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:41 smithi156 ceph-mon[32679]: pgmap v7633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:41 smithi092 ceph-mon[29156]: pgmap v7633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:43 smithi189 ceph-mon[32756]: pgmap v7634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:43 smithi156 ceph-mon[32679]: pgmap v7634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:43 smithi092 ceph-mon[29156]: pgmap v7634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13279.496949 secs 2024-04-26T21:59:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12582.469638 secs 2024-04-26T21:59:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13279.496949 secs 2024-04-26T21:59:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12582.469638 secs 2024-04-26T21:59:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13279.496949 secs 2024-04-26T21:59:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12582.469638 secs 2024-04-26T21:59:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:45 smithi189 ceph-mon[32756]: pgmap v7635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:45 smithi156 ceph-mon[32679]: pgmap v7635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:45 smithi092 ceph-mon[29156]: pgmap v7635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:47 smithi189 ceph-mon[32756]: pgmap v7636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:47 smithi156 ceph-mon[32679]: pgmap v7636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:47 smithi092 ceph-mon[29156]: pgmap v7636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:49 smithi189 ceph-mon[32756]: pgmap v7637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13284.497066 secs 2024-04-26T21:59:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12587.469720 secs 2024-04-26T21:59:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:49 smithi156 ceph-mon[32679]: pgmap v7637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13284.497066 secs 2024-04-26T21:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12587.469720 secs 2024-04-26T21:59:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:49 smithi092 ceph-mon[29156]: pgmap v7637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T21:59:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13284.497066 secs 2024-04-26T21:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12587.469720 secs 2024-04-26T21:59:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T21:59:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:51 smithi156 ceph-mon[32679]: pgmap v7638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:51 smithi092 ceph-mon[29156]: pgmap v7638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:51 smithi189 ceph-mon[32756]: pgmap v7638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T21:59:53.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:53 smithi156 ceph-mon[32679]: pgmap v7639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:53 smithi189 ceph-mon[32756]: pgmap v7639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:53.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:53 smithi092 ceph-mon[29156]: pgmap v7639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13289.497131 secs 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12592.469785 secs 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: pgmap v7640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: pgmap v7641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: pgmap v7642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13289.497131 secs 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12592.469785 secs 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: pgmap v7640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: pgmap v7641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: pgmap v7642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13289.497131 secs 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12592.469785 secs 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: pgmap v7640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T21:59:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T21:59:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: pgmap v7641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T21:59:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: pgmap v7642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T21:59:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:57 smithi189 ceph-mon[32756]: pgmap v7643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:57 smithi156 ceph-mon[32679]: pgmap v7643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:57 smithi092 ceph-mon[29156]: pgmap v7643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T21:59:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:59 smithi156 ceph-mon[32679]: pgmap v7644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13294.497227 secs 2024-04-26T21:59:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 21:59:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12597.469866 secs 2024-04-26T21:59:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:59 smithi092 ceph-mon[29156]: pgmap v7644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13294.497227 secs 2024-04-26T21:59:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 21:59:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12597.469866 secs 2024-04-26T21:59:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:59 smithi189 ceph-mon[32756]: pgmap v7644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T21:59:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13294.497227 secs 2024-04-26T21:59:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 21:59:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12597.469866 secs 2024-04-26T22:00:00.525 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:00:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:00:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:00:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:01 smithi156 ceph-mon[32679]: pgmap v7645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:00:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:01 smithi092 ceph-mon[29156]: pgmap v7645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:00:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:01 smithi189 ceph-mon[32756]: pgmap v7645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:00:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:03 smithi156 ceph-mon[32679]: pgmap v7646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:03 smithi092 ceph-mon[29156]: pgmap v7646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:03 smithi189 ceph-mon[32756]: pgmap v7646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:00:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13299.497317 secs 2024-04-26T22:00:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12602.470004 secs 2024-04-26T22:00:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13299.497317 secs 2024-04-26T22:00:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12602.470004 secs 2024-04-26T22:00:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13299.497317 secs 2024-04-26T22:00:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12602.470004 secs 2024-04-26T22:00:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:05 smithi156 ceph-mon[32679]: pgmap v7647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:00:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:05 smithi092 ceph-mon[29156]: pgmap v7647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:00:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:05 smithi189 ceph-mon[32756]: pgmap v7647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:00:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:07 smithi156 ceph-mon[32679]: pgmap v7648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:07 smithi092 ceph-mon[29156]: pgmap v7648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:07 smithi189 ceph-mon[32756]: pgmap v7648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:09 smithi156 ceph-mon[32679]: pgmap v7649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13304.497431 secs 2024-04-26T22:00:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:09 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 12607.470103 secs 2024-04-26T22:00:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:09 smithi156 ceph-mon[32679]: slow request 724.451594 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:00:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:09 smithi092 ceph-mon[29156]: pgmap v7649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13304.497431 secs 2024-04-26T22:00:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:09 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 12607.470103 secs 2024-04-26T22:00:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:09 smithi092 ceph-mon[29156]: slow request 724.451594 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:00:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:09 smithi189 ceph-mon[32756]: pgmap v7649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13304.497431 secs 2024-04-26T22:00:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:09 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 12607.470103 secs 2024-04-26T22:00:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:09 smithi189 ceph-mon[32756]: slow request 724.451594 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:00:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:11 smithi156 ceph-mon[32679]: pgmap v7650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:11 smithi092 ceph-mon[29156]: pgmap v7650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:11 smithi189 ceph-mon[32756]: pgmap v7650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:13 smithi156 ceph-mon[32679]: pgmap v7651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:13 smithi092 ceph-mon[29156]: pgmap v7651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:13 smithi189 ceph-mon[32756]: pgmap v7651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13309.497562 secs 2024-04-26T22:00:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12612.470222 secs 2024-04-26T22:00:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13309.497562 secs 2024-04-26T22:00:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12612.470222 secs 2024-04-26T22:00:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13309.497562 secs 2024-04-26T22:00:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12612.470222 secs 2024-04-26T22:00:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:15 smithi156 ceph-mon[32679]: pgmap v7652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:15 smithi092 ceph-mon[29156]: pgmap v7652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:15 smithi189 ceph-mon[32756]: pgmap v7652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:17 smithi156 ceph-mon[32679]: pgmap v7653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:17 smithi092 ceph-mon[29156]: pgmap v7653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:17 smithi189 ceph-mon[32756]: pgmap v7653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:19 smithi092 ceph-mon[29156]: pgmap v7654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13314.497682 secs 2024-04-26T22:00:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12617.470310 secs 2024-04-26T22:00:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:19 smithi189 ceph-mon[32756]: pgmap v7654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13314.497682 secs 2024-04-26T22:00:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12617.470310 secs 2024-04-26T22:00:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:19 smithi156 ceph-mon[32679]: pgmap v7654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13314.497682 secs 2024-04-26T22:00:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12617.470310 secs 2024-04-26T22:00:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:21 smithi092 ceph-mon[29156]: pgmap v7655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:21 smithi189 ceph-mon[32756]: pgmap v7655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:21 smithi156 ceph-mon[32679]: pgmap v7655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:23 smithi092 ceph-mon[29156]: pgmap v7656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:23 smithi189 ceph-mon[32756]: pgmap v7656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:23 smithi156 ceph-mon[32679]: pgmap v7656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13319.497802 secs 2024-04-26T22:00:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12622.470430 secs 2024-04-26T22:00:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13319.497802 secs 2024-04-26T22:00:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12622.470430 secs 2024-04-26T22:00:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13319.497802 secs 2024-04-26T22:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12622.470430 secs 2024-04-26T22:00:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:25 smithi156 ceph-mon[32679]: pgmap v7657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:25 smithi092 ceph-mon[29156]: pgmap v7657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:25 smithi189 ceph-mon[32756]: pgmap v7657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:27 smithi092 ceph-mon[29156]: pgmap v7658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:27 smithi189 ceph-mon[32756]: pgmap v7658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:27 smithi156 ceph-mon[32679]: pgmap v7658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:29 smithi092 ceph-mon[29156]: pgmap v7659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13324.497929 secs 2024-04-26T22:00:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12627.470507 secs 2024-04-26T22:00:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:29 smithi189 ceph-mon[32756]: pgmap v7659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13324.497929 secs 2024-04-26T22:00:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12627.470507 secs 2024-04-26T22:00:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:29 smithi156 ceph-mon[32679]: pgmap v7659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13324.497929 secs 2024-04-26T22:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12627.470507 secs 2024-04-26T22:00:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:31 smithi092 ceph-mon[29156]: pgmap v7660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:31 smithi189 ceph-mon[32756]: pgmap v7660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:31 smithi156 ceph-mon[32679]: pgmap v7660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:33 smithi092 ceph-mon[29156]: pgmap v7661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:33 smithi189 ceph-mon[32756]: pgmap v7661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:33 smithi156 ceph-mon[32679]: pgmap v7661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13329.498045 secs 2024-04-26T22:00:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12632.470629 secs 2024-04-26T22:00:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13329.498045 secs 2024-04-26T22:00:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12632.470629 secs 2024-04-26T22:00:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13329.498045 secs 2024-04-26T22:00:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12632.470629 secs 2024-04-26T22:00:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:35 smithi092 ceph-mon[29156]: pgmap v7662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:35 smithi189 ceph-mon[32756]: pgmap v7662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:35 smithi156 ceph-mon[32679]: pgmap v7662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:37 smithi092 ceph-mon[29156]: pgmap v7663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:00:37.808+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:00:37.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:00:37.808+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:00:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:00:37.808+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:00:37.809 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:00:37.808+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 105 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:00:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:37 smithi189 ceph-mon[32756]: pgmap v7663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:37 smithi156 ceph-mon[32679]: pgmap v7663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:39 smithi092 ceph-mon[29156]: pgmap v7664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13334.498140 secs 2024-04-26T22:00:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12637.470767 secs 2024-04-26T22:00:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:39 smithi189 ceph-mon[32756]: pgmap v7664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13334.498140 secs 2024-04-26T22:00:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12637.470767 secs 2024-04-26T22:00:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:39 smithi156 ceph-mon[32679]: pgmap v7664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13334.498140 secs 2024-04-26T22:00:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12637.470767 secs 2024-04-26T22:00:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:41 smithi092 ceph-mon[29156]: pgmap v7665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:41 smithi189 ceph-mon[32756]: pgmap v7665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:41 smithi156 ceph-mon[32679]: pgmap v7665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:43 smithi092 ceph-mon[29156]: pgmap v7666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:43 smithi189 ceph-mon[32756]: pgmap v7666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:43 smithi156 ceph-mon[32679]: pgmap v7666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13339.498254 secs 2024-04-26T22:00:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12642.470842 secs 2024-04-26T22:00:44.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13339.498254 secs 2024-04-26T22:00:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12642.470842 secs 2024-04-26T22:00:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13339.498254 secs 2024-04-26T22:00:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12642.470842 secs 2024-04-26T22:00:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:45 smithi092 ceph-mon[29156]: pgmap v7667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:45 smithi189 ceph-mon[32756]: pgmap v7667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:45 smithi156 ceph-mon[32679]: pgmap v7667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:47 smithi092 ceph-mon[29156]: pgmap v7668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:47 smithi189 ceph-mon[32756]: pgmap v7668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:47 smithi156 ceph-mon[32679]: pgmap v7668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:49 smithi092 ceph-mon[29156]: pgmap v7669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13344.498390 secs 2024-04-26T22:00:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12647.470959 secs 2024-04-26T22:00:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:49 smithi189 ceph-mon[32756]: pgmap v7669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13344.498390 secs 2024-04-26T22:00:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12647.470959 secs 2024-04-26T22:00:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:49 smithi156 ceph-mon[32679]: pgmap v7669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13344.498390 secs 2024-04-26T22:00:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12647.470959 secs 2024-04-26T22:00:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:51 smithi189 ceph-mon[32756]: pgmap v7670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:51 smithi156 ceph-mon[32679]: pgmap v7670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:51 smithi092 ceph-mon[29156]: pgmap v7670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:53 smithi189 ceph-mon[32756]: pgmap v7671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:53 smithi156 ceph-mon[32679]: pgmap v7671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:53 smithi092 ceph-mon[29156]: pgmap v7671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13349.498503 secs 2024-04-26T22:00:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12652.471054 secs 2024-04-26T22:00:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13349.498503 secs 2024-04-26T22:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12652.471054 secs 2024-04-26T22:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13349.498503 secs 2024-04-26T22:00:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12652.471054 secs 2024-04-26T22:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:00:55.760 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:55 smithi189 ceph-mon[32756]: pgmap v7672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:55 smithi156 ceph-mon[32679]: pgmap v7672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:55 smithi092 ceph-mon[29156]: pgmap v7672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:00:57.665 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:57 smithi189 ceph-mon[32756]: pgmap v7673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:57 smithi156 ceph-mon[32679]: pgmap v7673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:57 smithi092 ceph-mon[29156]: pgmap v7673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:59.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: pgmap v7674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13354.498616 secs 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12657.471191 secs 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:00:59.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:00:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: pgmap v7674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13354.498616 secs 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12657.471191 secs 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:00:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:00:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: pgmap v7674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13354.498616 secs 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12657.471191 secs 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:00:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:00:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:01:00.812 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:00 smithi092 ceph-mon[29156]: pgmap v7675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T22:01:00.812 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:00 smithi092 ceph-mon[29156]: pgmap v7676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:00 smithi189 ceph-mon[32756]: pgmap v7675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T22:01:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:00 smithi189 ceph-mon[32756]: pgmap v7676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:00 smithi156 ceph-mon[32679]: pgmap v7675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T22:01:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:00 smithi156 ceph-mon[32679]: pgmap v7676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:02 smithi189 ceph-mon[32756]: pgmap v7677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:02 smithi156 ceph-mon[32679]: pgmap v7677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:02 smithi092 ceph-mon[29156]: pgmap v7677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:04 smithi189 ceph-mon[32756]: pgmap v7678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13359.498680 secs 2024-04-26T22:01:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12662.471272 secs 2024-04-26T22:01:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:04 smithi156 ceph-mon[32679]: pgmap v7678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13359.498680 secs 2024-04-26T22:01:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12662.471272 secs 2024-04-26T22:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:04 smithi092 ceph-mon[29156]: pgmap v7678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13359.498680 secs 2024-04-26T22:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12662.471272 secs 2024-04-26T22:01:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:06 smithi189 ceph-mon[32756]: pgmap v7679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:06 smithi156 ceph-mon[32679]: pgmap v7679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:06 smithi092 ceph-mon[29156]: pgmap v7679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:08 smithi189 ceph-mon[32756]: pgmap v7680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:08 smithi156 ceph-mon[32679]: pgmap v7680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:08 smithi092 ceph-mon[29156]: pgmap v7680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:01:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13364.498819 secs 2024-04-26T22:01:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12667.471389 secs 2024-04-26T22:01:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13364.498819 secs 2024-04-26T22:01:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12667.471389 secs 2024-04-26T22:01:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13364.498819 secs 2024-04-26T22:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12667.471389 secs 2024-04-26T22:01:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:10 smithi189 ceph-mon[32756]: pgmap v7681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:01:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:10 smithi156 ceph-mon[32679]: pgmap v7681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:01:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:10 smithi092 ceph-mon[29156]: pgmap v7681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:01:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:12 smithi189 ceph-mon[32756]: pgmap v7682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:12 smithi156 ceph-mon[32679]: pgmap v7682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:12 smithi092 ceph-mon[29156]: pgmap v7682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:14 smithi189 ceph-mon[32756]: pgmap v7683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13369.498916 secs 2024-04-26T22:01:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12672.471468 secs 2024-04-26T22:01:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:14 smithi156 ceph-mon[32679]: pgmap v7683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13369.498916 secs 2024-04-26T22:01:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12672.471468 secs 2024-04-26T22:01:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:14 smithi092 ceph-mon[29156]: pgmap v7683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13369.498916 secs 2024-04-26T22:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12672.471468 secs 2024-04-26T22:01:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:16 smithi189 ceph-mon[32756]: pgmap v7684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:16 smithi156 ceph-mon[32679]: pgmap v7684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:16 smithi092 ceph-mon[29156]: pgmap v7684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:18 smithi189 ceph-mon[32756]: pgmap v7685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:18 smithi156 ceph-mon[32679]: pgmap v7685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:18 smithi092 ceph-mon[29156]: pgmap v7685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13374.499037 secs 2024-04-26T22:01:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12677.471586 secs 2024-04-26T22:01:19.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13374.499037 secs 2024-04-26T22:01:19.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12677.471586 secs 2024-04-26T22:01:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13374.499037 secs 2024-04-26T22:01:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12677.471586 secs 2024-04-26T22:01:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:20 smithi189 ceph-mon[32756]: pgmap v7686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:20 smithi156 ceph-mon[32679]: pgmap v7686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:20 smithi092 ceph-mon[29156]: pgmap v7686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:01:22.814+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:01:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:01:22.814+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:01:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:01:22.814+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:01:22.815 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:01:22.814+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 106 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:01:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:22 smithi189 ceph-mon[32756]: pgmap v7687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:22 smithi156 ceph-mon[32679]: pgmap v7687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:22 smithi092 ceph-mon[29156]: pgmap v7687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:24 smithi189 ceph-mon[32756]: pgmap v7688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13379.499128 secs 2024-04-26T22:01:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12682.471711 secs 2024-04-26T22:01:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:24 smithi156 ceph-mon[32679]: pgmap v7688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13379.499128 secs 2024-04-26T22:01:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12682.471711 secs 2024-04-26T22:01:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:24 smithi092 ceph-mon[29156]: pgmap v7688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13379.499128 secs 2024-04-26T22:01:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12682.471711 secs 2024-04-26T22:01:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:26 smithi189 ceph-mon[32756]: pgmap v7689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:26 smithi156 ceph-mon[32679]: pgmap v7689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:26 smithi092 ceph-mon[29156]: pgmap v7689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:28 smithi189 ceph-mon[32756]: pgmap v7690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:28 smithi156 ceph-mon[32679]: pgmap v7690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:28 smithi092 ceph-mon[29156]: pgmap v7690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13384.499246 secs 2024-04-26T22:01:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12687.471839 secs 2024-04-26T22:01:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13384.499246 secs 2024-04-26T22:01:29.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12687.471839 secs 2024-04-26T22:01:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13384.499246 secs 2024-04-26T22:01:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12687.471839 secs 2024-04-26T22:01:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:30 smithi189 ceph-mon[32756]: pgmap v7691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:30 smithi156 ceph-mon[32679]: pgmap v7691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:30 smithi092 ceph-mon[29156]: pgmap v7691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:32 smithi189 ceph-mon[32756]: pgmap v7692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:32 smithi156 ceph-mon[32679]: pgmap v7692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:32 smithi092 ceph-mon[29156]: pgmap v7692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:34 smithi189 ceph-mon[32756]: pgmap v7693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13389.499382 secs 2024-04-26T22:01:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12692.471958 secs 2024-04-26T22:01:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:34 smithi156 ceph-mon[32679]: pgmap v7693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13389.499382 secs 2024-04-26T22:01:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12692.471958 secs 2024-04-26T22:01:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:34 smithi092 ceph-mon[29156]: pgmap v7693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13389.499382 secs 2024-04-26T22:01:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12692.471958 secs 2024-04-26T22:01:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:36 smithi189 ceph-mon[32756]: pgmap v7694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:36 smithi156 ceph-mon[32679]: pgmap v7694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:36 smithi092 ceph-mon[29156]: pgmap v7694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:38 smithi189 ceph-mon[32756]: pgmap v7695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:38 smithi156 ceph-mon[32679]: pgmap v7695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:38 smithi092 ceph-mon[29156]: pgmap v7695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13394.499535 secs 2024-04-26T22:01:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12697.472100 secs 2024-04-26T22:01:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13394.499535 secs 2024-04-26T22:01:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12697.472100 secs 2024-04-26T22:01:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13394.499535 secs 2024-04-26T22:01:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12697.472100 secs 2024-04-26T22:01:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:40 smithi189 ceph-mon[32756]: pgmap v7696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:40 smithi156 ceph-mon[32679]: pgmap v7696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:40 smithi092 ceph-mon[29156]: pgmap v7696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:42 smithi189 ceph-mon[32756]: pgmap v7697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:42 smithi156 ceph-mon[32679]: pgmap v7697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:42 smithi092 ceph-mon[29156]: pgmap v7697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:44 smithi189 ceph-mon[32756]: pgmap v7698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13399.499652 secs 2024-04-26T22:01:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12702.472225 secs 2024-04-26T22:01:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:44 smithi156 ceph-mon[32679]: pgmap v7698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13399.499652 secs 2024-04-26T22:01:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12702.472225 secs 2024-04-26T22:01:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:44 smithi092 ceph-mon[29156]: pgmap v7698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13399.499652 secs 2024-04-26T22:01:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12702.472225 secs 2024-04-26T22:01:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:46 smithi189 ceph-mon[32756]: pgmap v7699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:46 smithi156 ceph-mon[32679]: pgmap v7699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:46 smithi092 ceph-mon[29156]: pgmap v7699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:48 smithi189 ceph-mon[32756]: pgmap v7700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:48 smithi156 ceph-mon[32679]: pgmap v7700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:48 smithi092 ceph-mon[29156]: pgmap v7700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13404.499730 secs 2024-04-26T22:01:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12707.472288 secs 2024-04-26T22:01:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13404.499730 secs 2024-04-26T22:01:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12707.472288 secs 2024-04-26T22:01:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13404.499730 secs 2024-04-26T22:01:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12707.472288 secs 2024-04-26T22:01:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:50 smithi189 ceph-mon[32756]: pgmap v7701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:50 smithi156 ceph-mon[32679]: pgmap v7701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:50 smithi092 ceph-mon[29156]: pgmap v7701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:52 smithi189 ceph-mon[32756]: pgmap v7702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:52 smithi156 ceph-mon[32679]: pgmap v7702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:52 smithi092 ceph-mon[29156]: pgmap v7702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:54 smithi189 ceph-mon[32756]: pgmap v7703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13409.499864 secs 2024-04-26T22:01:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12712.472402 secs 2024-04-26T22:01:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:54 smithi156 ceph-mon[32679]: pgmap v7703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13409.499864 secs 2024-04-26T22:01:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12712.472402 secs 2024-04-26T22:01:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:54 smithi092 ceph-mon[29156]: pgmap v7703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13409.499864 secs 2024-04-26T22:01:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12712.472402 secs 2024-04-26T22:01:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:56 smithi189 ceph-mon[32756]: pgmap v7704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:56 smithi156 ceph-mon[32679]: pgmap v7704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:56 smithi092 ceph-mon[29156]: pgmap v7704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:01:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:58 smithi189 ceph-mon[32756]: pgmap v7705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:58 smithi156 ceph-mon[32679]: pgmap v7705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:58 smithi092 ceph-mon[29156]: pgmap v7705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13414.499979 secs 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12717.472517 secs 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:01:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13414.499979 secs 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12717.472517 secs 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:59.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:01:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:01:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13414.499979 secs 2024-04-26T22:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12717.472517 secs 2024-04-26T22:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:01:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:01:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:02:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:00 smithi189 ceph-mon[32756]: pgmap v7706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:00 smithi189 ceph-mon[32756]: pgmap v7707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:02:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:00 smithi189 ceph-mon[32756]: pgmap v7708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:00 smithi156 ceph-mon[32679]: pgmap v7706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:00 smithi156 ceph-mon[32679]: pgmap v7707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:02:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:00 smithi156 ceph-mon[32679]: pgmap v7708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:00 smithi092 ceph-mon[29156]: pgmap v7706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:00 smithi092 ceph-mon[29156]: pgmap v7707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:02:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:00 smithi092 ceph-mon[29156]: pgmap v7708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:01 smithi092 ceph-mon[29156]: pgmap v7709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:01 smithi189 ceph-mon[32756]: pgmap v7709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:01 smithi156 ceph-mon[32679]: pgmap v7709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:03 smithi092 ceph-mon[29156]: pgmap v7710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:03 smithi189 ceph-mon[32756]: pgmap v7710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:03 smithi156 ceph-mon[32679]: pgmap v7710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13419.500097 secs 2024-04-26T22:02:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12722.472614 secs 2024-04-26T22:02:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13419.500097 secs 2024-04-26T22:02:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12722.472614 secs 2024-04-26T22:02:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13419.500097 secs 2024-04-26T22:02:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12722.472614 secs 2024-04-26T22:02:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:05 smithi092 ceph-mon[29156]: pgmap v7711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:05 smithi189 ceph-mon[32756]: pgmap v7711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:05 smithi156 ceph-mon[32679]: pgmap v7711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:02:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:07 smithi092 ceph-mon[29156]: pgmap v7712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:07 smithi189 ceph-mon[32756]: pgmap v7712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:07 smithi156 ceph-mon[32679]: pgmap v7712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:02:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13424.500196 secs 2024-04-26T22:02:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12727.472756 secs 2024-04-26T22:02:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13424.500196 secs 2024-04-26T22:02:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12727.472756 secs 2024-04-26T22:02:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13424.500196 secs 2024-04-26T22:02:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12727.472756 secs 2024-04-26T22:02:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:10 smithi189 ceph-mon[32756]: pgmap v7713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:02:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:10 smithi156 ceph-mon[32679]: pgmap v7713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:02:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:10 smithi092 ceph-mon[29156]: pgmap v7713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:02:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:11 smithi092 ceph-mon[29156]: pgmap v7714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:11 smithi189 ceph-mon[32756]: pgmap v7714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:11 smithi156 ceph-mon[32679]: pgmap v7714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:13 smithi092 ceph-mon[29156]: pgmap v7715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:13 smithi189 ceph-mon[32756]: pgmap v7715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:13 smithi156 ceph-mon[32679]: pgmap v7715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13429.500269 secs 2024-04-26T22:02:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12732.472917 secs 2024-04-26T22:02:15.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13429.500269 secs 2024-04-26T22:02:15.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12732.472917 secs 2024-04-26T22:02:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13429.500269 secs 2024-04-26T22:02:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12732.472917 secs 2024-04-26T22:02:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:15 smithi092 ceph-mon[29156]: pgmap v7716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:15 smithi189 ceph-mon[32756]: pgmap v7716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:15 smithi156 ceph-mon[32679]: pgmap v7716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:17 smithi092 ceph-mon[29156]: pgmap v7717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:17 smithi189 ceph-mon[32756]: pgmap v7717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:17 smithi156 ceph-mon[32679]: pgmap v7717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13434.500412 secs 2024-04-26T22:02:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12737.473055 secs 2024-04-26T22:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13434.500412 secs 2024-04-26T22:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12737.473055 secs 2024-04-26T22:02:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13434.500412 secs 2024-04-26T22:02:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12737.473055 secs 2024-04-26T22:02:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:20 smithi189 ceph-mon[32756]: pgmap v7718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:20 smithi156 ceph-mon[32679]: pgmap v7718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:20 smithi092 ceph-mon[29156]: pgmap v7718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:21 smithi092 ceph-mon[29156]: pgmap v7719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:21 smithi189 ceph-mon[32756]: pgmap v7719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:21 smithi156 ceph-mon[32679]: pgmap v7719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:23 smithi092 ceph-mon[29156]: pgmap v7720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:23 smithi189 ceph-mon[32756]: pgmap v7720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:23 smithi156 ceph-mon[32679]: pgmap v7720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13439.500549 secs 2024-04-26T22:02:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12742.473156 secs 2024-04-26T22:02:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13439.500549 secs 2024-04-26T22:02:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12742.473156 secs 2024-04-26T22:02:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13439.500549 secs 2024-04-26T22:02:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12742.473156 secs 2024-04-26T22:02:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:25 smithi092 ceph-mon[29156]: pgmap v7721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:26.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:25 smithi189 ceph-mon[32756]: pgmap v7721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:25 smithi156 ceph-mon[32679]: pgmap v7721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:27 smithi092 ceph-mon[29156]: pgmap v7722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:27 smithi189 ceph-mon[32756]: pgmap v7722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:27 smithi156 ceph-mon[32679]: pgmap v7722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13444.500669 secs 2024-04-26T22:02:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12747.473229 secs 2024-04-26T22:02:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13444.500669 secs 2024-04-26T22:02:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12747.473229 secs 2024-04-26T22:02:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13444.500669 secs 2024-04-26T22:02:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12747.473229 secs 2024-04-26T22:02:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:30 smithi189 ceph-mon[32756]: pgmap v7723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:30 smithi156 ceph-mon[32679]: pgmap v7723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:30 smithi092 ceph-mon[29156]: pgmap v7723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:31 smithi092 ceph-mon[29156]: pgmap v7724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:31 smithi189 ceph-mon[32756]: pgmap v7724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:31 smithi156 ceph-mon[32679]: pgmap v7724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:33 smithi092 ceph-mon[29156]: pgmap v7725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:33 smithi189 ceph-mon[32756]: pgmap v7725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:33 smithi156 ceph-mon[32679]: pgmap v7725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13449.500806 secs 2024-04-26T22:02:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12752.473343 secs 2024-04-26T22:02:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13449.500806 secs 2024-04-26T22:02:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12752.473343 secs 2024-04-26T22:02:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13449.500806 secs 2024-04-26T22:02:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12752.473343 secs 2024-04-26T22:02:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:35 smithi092 ceph-mon[29156]: pgmap v7726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:35 smithi189 ceph-mon[32756]: pgmap v7726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:35 smithi156 ceph-mon[32679]: pgmap v7726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:37 smithi092 ceph-mon[29156]: pgmap v7727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:37 smithi189 ceph-mon[32756]: pgmap v7727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:37 smithi156 ceph-mon[32679]: pgmap v7727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13454.500911 secs 2024-04-26T22:02:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12757.473434 secs 2024-04-26T22:02:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13454.500911 secs 2024-04-26T22:02:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12757.473434 secs 2024-04-26T22:02:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13454.500911 secs 2024-04-26T22:02:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12757.473434 secs 2024-04-26T22:02:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:40 smithi189 ceph-mon[32756]: pgmap v7728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:40 smithi156 ceph-mon[32679]: pgmap v7728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:40 smithi092 ceph-mon[29156]: pgmap v7728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:41 smithi092 ceph-mon[29156]: pgmap v7729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:41 smithi189 ceph-mon[32756]: pgmap v7729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:41 smithi156 ceph-mon[32679]: pgmap v7729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:43 smithi092 ceph-mon[29156]: pgmap v7730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:43 smithi189 ceph-mon[32756]: pgmap v7730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:43 smithi156 ceph-mon[32679]: pgmap v7730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13459.501033 secs 2024-04-26T22:02:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12762.473556 secs 2024-04-26T22:02:45.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13459.501033 secs 2024-04-26T22:02:45.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12762.473556 secs 2024-04-26T22:02:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13459.501033 secs 2024-04-26T22:02:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12762.473556 secs 2024-04-26T22:02:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:45 smithi092 ceph-mon[29156]: pgmap v7731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:45 smithi189 ceph-mon[32756]: pgmap v7731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:45 smithi156 ceph-mon[32679]: pgmap v7731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:47 smithi092 ceph-mon[29156]: pgmap v7732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:47 smithi189 ceph-mon[32756]: pgmap v7732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:47 smithi156 ceph-mon[32679]: pgmap v7732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13464.501148 secs 2024-04-26T22:02:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12767.473670 secs 2024-04-26T22:02:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13464.501148 secs 2024-04-26T22:02:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12767.473670 secs 2024-04-26T22:02:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13464.501148 secs 2024-04-26T22:02:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12767.473670 secs 2024-04-26T22:02:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:50 smithi189 ceph-mon[32756]: pgmap v7733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:50 smithi156 ceph-mon[32679]: pgmap v7733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:50 smithi092 ceph-mon[29156]: pgmap v7733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:51 smithi092 ceph-mon[29156]: pgmap v7734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:51 smithi189 ceph-mon[32756]: pgmap v7734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:51 smithi156 ceph-mon[32679]: pgmap v7734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:53 smithi092 ceph-mon[29156]: pgmap v7735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:53 smithi189 ceph-mon[32756]: pgmap v7735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:53 smithi156 ceph-mon[32679]: pgmap v7735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:02:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13469.501286 secs 2024-04-26T22:02:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12772.473789 secs 2024-04-26T22:02:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13469.501286 secs 2024-04-26T22:02:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12772.473789 secs 2024-04-26T22:02:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13469.501286 secs 2024-04-26T22:02:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12772.473789 secs 2024-04-26T22:02:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:55 smithi092 ceph-mon[29156]: pgmap v7736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:56.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:55 smithi189 ceph-mon[32756]: pgmap v7736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:55 smithi156 ceph-mon[32679]: pgmap v7736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:57 smithi092 ceph-mon[29156]: pgmap v7737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:57 smithi189 ceph-mon[32756]: pgmap v7737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:57 smithi156 ceph-mon[32679]: pgmap v7737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:02:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13474.501420 secs 2024-04-26T22:02:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:02:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12777.473900 secs 2024-04-26T22:02:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13474.501420 secs 2024-04-26T22:02:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:02:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12777.473900 secs 2024-04-26T22:02:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13474.501420 secs 2024-04-26T22:02:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:02:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12777.473900 secs 2024-04-26T22:03:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:00 smithi189 ceph-mon[32756]: pgmap v7738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:00 smithi156 ceph-mon[32679]: pgmap v7738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:00 smithi092 ceph-mon[29156]: pgmap v7738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:03:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:01 smithi189 ceph-mon[32756]: pgmap v7739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:03:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:01 smithi189 ceph-mon[32756]: pgmap v7740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:03:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:01 smithi156 ceph-mon[32679]: pgmap v7739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:03:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:01 smithi156 ceph-mon[32679]: pgmap v7740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:03:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:03:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:03:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:01 smithi092 ceph-mon[29156]: pgmap v7739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:03:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:01 smithi092 ceph-mon[29156]: pgmap v7740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:03:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:03 smithi092 ceph-mon[29156]: pgmap v7741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:03 smithi189 ceph-mon[32756]: pgmap v7741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:03 smithi156 ceph-mon[32679]: pgmap v7741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13479.501518 secs 2024-04-26T22:03:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:04 smithi092 ceph-mon[29156]: 11 slow requests, 2 included below; oldest blocked for > 12782.474004 secs 2024-04-26T22:03:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:04 smithi092 ceph-mon[29156]: slow request 11522.127741 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:04 smithi092 ceph-mon[29156]: slow request 5760.686669 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13479.501518 secs 2024-04-26T22:03:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:04 smithi189 ceph-mon[32756]: 11 slow requests, 2 included below; oldest blocked for > 12782.474004 secs 2024-04-26T22:03:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:04 smithi189 ceph-mon[32756]: slow request 11522.127741 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:04 smithi189 ceph-mon[32756]: slow request 5760.686669 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13479.501518 secs 2024-04-26T22:03:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:04 smithi156 ceph-mon[32679]: 11 slow requests, 2 included below; oldest blocked for > 12782.474004 secs 2024-04-26T22:03:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:04 smithi156 ceph-mon[32679]: slow request 11522.127741 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:04 smithi156 ceph-mon[32679]: slow request 5760.686669 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:03:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:05 smithi092 ceph-mon[29156]: pgmap v7742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:05 smithi189 ceph-mon[32756]: pgmap v7742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:05 smithi156 ceph-mon[32679]: pgmap v7742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:07 smithi092 ceph-mon[29156]: pgmap v7743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:07 smithi189 ceph-mon[32756]: pgmap v7743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:07 smithi156 ceph-mon[32679]: pgmap v7743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:03:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:09 smithi092 ceph-mon[29156]: pgmap v7744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13484.501621 secs 2024-04-26T22:03:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12787.474129 secs 2024-04-26T22:03:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:09 smithi189 ceph-mon[32756]: pgmap v7744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13484.501621 secs 2024-04-26T22:03:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12787.474129 secs 2024-04-26T22:03:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:09 smithi156 ceph-mon[32679]: pgmap v7744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:03:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13484.501621 secs 2024-04-26T22:03:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12787.474129 secs 2024-04-26T22:03:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:11 smithi092 ceph-mon[29156]: pgmap v7745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:03:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:11 smithi189 ceph-mon[32756]: pgmap v7745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:03:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:11 smithi156 ceph-mon[32679]: pgmap v7745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:03:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:13 smithi092 ceph-mon[29156]: pgmap v7746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:13 smithi189 ceph-mon[32756]: pgmap v7746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:13 smithi156 ceph-mon[32679]: pgmap v7746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13489.501725 secs 2024-04-26T22:03:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12792.474201 secs 2024-04-26T22:03:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13489.501725 secs 2024-04-26T22:03:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12792.474201 secs 2024-04-26T22:03:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13489.501725 secs 2024-04-26T22:03:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12792.474201 secs 2024-04-26T22:03:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:15 smithi092 ceph-mon[29156]: pgmap v7747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:15.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:15 smithi156 ceph-mon[32679]: pgmap v7747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:15 smithi189 ceph-mon[32756]: pgmap v7747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:17 smithi092 ceph-mon[29156]: pgmap v7748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:17 smithi189 ceph-mon[32756]: pgmap v7748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:17 smithi156 ceph-mon[32679]: pgmap v7748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:19 smithi092 ceph-mon[29156]: pgmap v7749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13494.501840 secs 2024-04-26T22:03:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12797.474337 secs 2024-04-26T22:03:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:19 smithi189 ceph-mon[32756]: pgmap v7749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13494.501840 secs 2024-04-26T22:03:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12797.474337 secs 2024-04-26T22:03:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:19 smithi156 ceph-mon[32679]: pgmap v7749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13494.501840 secs 2024-04-26T22:03:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12797.474337 secs 2024-04-26T22:03:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:21 smithi092 ceph-mon[29156]: pgmap v7750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:21 smithi189 ceph-mon[32756]: pgmap v7750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:21 smithi156 ceph-mon[32679]: pgmap v7750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:23 smithi092 ceph-mon[29156]: pgmap v7751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:23 smithi189 ceph-mon[32756]: pgmap v7751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:23 smithi156 ceph-mon[32679]: pgmap v7751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13499.501958 secs 2024-04-26T22:03:24.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12802.474449 secs 2024-04-26T22:03:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13499.501958 secs 2024-04-26T22:03:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12802.474449 secs 2024-04-26T22:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13499.501958 secs 2024-04-26T22:03:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12802.474449 secs 2024-04-26T22:03:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:25 smithi189 ceph-mon[32756]: pgmap v7752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:25 smithi156 ceph-mon[32679]: pgmap v7752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:25 smithi092 ceph-mon[29156]: pgmap v7752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:27 smithi189 ceph-mon[32756]: pgmap v7753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:27 smithi156 ceph-mon[32679]: pgmap v7753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:27 smithi092 ceph-mon[29156]: pgmap v7753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:29 smithi092 ceph-mon[29156]: pgmap v7754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13504.502075 secs 2024-04-26T22:03:29.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12807.474573 secs 2024-04-26T22:03:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:29 smithi189 ceph-mon[32756]: pgmap v7754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13504.502075 secs 2024-04-26T22:03:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12807.474573 secs 2024-04-26T22:03:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:29 smithi156 ceph-mon[32679]: pgmap v7754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13504.502075 secs 2024-04-26T22:03:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12807.474573 secs 2024-04-26T22:03:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:31 smithi189 ceph-mon[32756]: pgmap v7755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:31 smithi156 ceph-mon[32679]: pgmap v7755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:31 smithi092 ceph-mon[29156]: pgmap v7755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:33 smithi189 ceph-mon[32756]: pgmap v7756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:33 smithi156 ceph-mon[32679]: pgmap v7756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:33 smithi092 ceph-mon[29156]: pgmap v7756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13509.502186 secs 2024-04-26T22:03:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12812.474683 secs 2024-04-26T22:03:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13509.502186 secs 2024-04-26T22:03:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12812.474683 secs 2024-04-26T22:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13509.502186 secs 2024-04-26T22:03:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12812.474683 secs 2024-04-26T22:03:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:35 smithi189 ceph-mon[32756]: pgmap v7757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:35 smithi156 ceph-mon[32679]: pgmap v7757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:35 smithi092 ceph-mon[29156]: pgmap v7757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.010+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000908) for more than 900000000 us, fault. 2024-04-26T22:03:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.010+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005d50 tx=0x7f1ca80ce000 comp rx=0 tx=0).stop 2024-04-26T22:03:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.010+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:03:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.010+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.010+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.011+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.011+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca808a050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=13 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T22:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:36.037+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T22:03:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:37.833+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:37.833+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:37.833+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:03:37.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:03:37.833+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 107 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:03:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:37 smithi189 ceph-mon[32756]: pgmap v7758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:37 smithi156 ceph-mon[32679]: pgmap v7758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:37 smithi092 ceph-mon[29156]: pgmap v7758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:39 smithi189 ceph-mon[32756]: pgmap v7759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13514.502263 secs 2024-04-26T22:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12817.474797 secs 2024-04-26T22:03:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:39 smithi156 ceph-mon[32679]: pgmap v7759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13514.502263 secs 2024-04-26T22:03:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12817.474797 secs 2024-04-26T22:03:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:39 smithi092 ceph-mon[29156]: pgmap v7759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13514.502263 secs 2024-04-26T22:03:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12817.474797 secs 2024-04-26T22:03:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:41 smithi189 ceph-mon[32756]: pgmap v7760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:41 smithi156 ceph-mon[32679]: pgmap v7760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:41 smithi092 ceph-mon[29156]: pgmap v7760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:43 smithi189 ceph-mon[32756]: pgmap v7761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:43 smithi156 ceph-mon[32679]: pgmap v7761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:43 smithi092 ceph-mon[29156]: pgmap v7761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13519.502393 secs 2024-04-26T22:03:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12822.475015 secs 2024-04-26T22:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13519.502393 secs 2024-04-26T22:03:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12822.475015 secs 2024-04-26T22:03:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13519.502393 secs 2024-04-26T22:03:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12822.475015 secs 2024-04-26T22:03:45.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:45 smithi156 ceph-mon[32679]: pgmap v7762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:45 smithi189 ceph-mon[32756]: pgmap v7762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:45 smithi092 ceph-mon[29156]: pgmap v7762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:47 smithi189 ceph-mon[32756]: pgmap v7763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:47 smithi156 ceph-mon[32679]: pgmap v7763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:47 smithi092 ceph-mon[29156]: pgmap v7763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:49 smithi189 ceph-mon[32756]: pgmap v7764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13524.502532 secs 2024-04-26T22:03:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12827.475153 secs 2024-04-26T22:03:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:49 smithi156 ceph-mon[32679]: pgmap v7764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13524.502532 secs 2024-04-26T22:03:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12827.475153 secs 2024-04-26T22:03:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:49 smithi092 ceph-mon[29156]: pgmap v7764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13524.502532 secs 2024-04-26T22:03:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12827.475153 secs 2024-04-26T22:03:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:51 smithi189 ceph-mon[32756]: pgmap v7765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:51 smithi156 ceph-mon[32679]: pgmap v7765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:51 smithi092 ceph-mon[29156]: pgmap v7765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:53 smithi189 ceph-mon[32756]: pgmap v7766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:53 smithi156 ceph-mon[32679]: pgmap v7766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:53 smithi092 ceph-mon[29156]: pgmap v7766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13529.502657 secs 2024-04-26T22:03:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12832.475263 secs 2024-04-26T22:03:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13529.502657 secs 2024-04-26T22:03:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12832.475263 secs 2024-04-26T22:03:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13529.502657 secs 2024-04-26T22:03:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12832.475263 secs 2024-04-26T22:03:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:55 smithi189 ceph-mon[32756]: pgmap v7767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:55 smithi156 ceph-mon[32679]: pgmap v7767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:55 smithi092 ceph-mon[29156]: pgmap v7767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:03:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:57 smithi189 ceph-mon[32756]: pgmap v7768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:57 smithi156 ceph-mon[32679]: pgmap v7768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:57 smithi092 ceph-mon[29156]: pgmap v7768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:59 smithi189 ceph-mon[32756]: pgmap v7769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13534.502767 secs 2024-04-26T22:03:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:03:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12837.475375 secs 2024-04-26T22:03:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:59 smithi156 ceph-mon[32679]: pgmap v7769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13534.502767 secs 2024-04-26T22:03:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:03:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12837.475375 secs 2024-04-26T22:03:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:59 smithi092 ceph-mon[29156]: pgmap v7769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:03:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13534.502767 secs 2024-04-26T22:03:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:03:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12837.475375 secs 2024-04-26T22:04:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:04:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:01 smithi189 ceph-mon[32756]: pgmap v7770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:04:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:01 smithi156 ceph-mon[32679]: pgmap v7770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:04:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:01 smithi092 ceph-mon[29156]: pgmap v7770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:04:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:04:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:04:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:02 smithi189 ceph-mon[32756]: pgmap v7771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:04:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:02 smithi189 ceph-mon[32756]: pgmap v7772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:02 smithi156 ceph-mon[32679]: pgmap v7771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:04:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:02 smithi156 ceph-mon[32679]: pgmap v7772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:02 smithi092 ceph-mon[29156]: pgmap v7771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:04:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:02 smithi092 ceph-mon[29156]: pgmap v7772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-mon[29156]: pgmap v7773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:04:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13539.502883 secs 2024-04-26T22:04:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12842.475497 secs 2024-04-26T22:04:04.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:04:04.378+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:04.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:04:04.378+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:04.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:04:04.378+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:04.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:04:04.378+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:04.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:04:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:04:04.378+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:04:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:04 smithi189 ceph-mon[32756]: pgmap v7773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:04:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13539.502883 secs 2024-04-26T22:04:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12842.475497 secs 2024-04-26T22:04:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:04 smithi156 ceph-mon[32679]: pgmap v7773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:04:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13539.502883 secs 2024-04-26T22:04:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12842.475497 secs 2024-04-26T22:04:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:06 smithi189 ceph-mon[32756]: pgmap v7774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:06 smithi156 ceph-mon[32679]: pgmap v7774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:06 smithi092 ceph-mon[29156]: pgmap v7774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:08 smithi189 ceph-mon[32756]: pgmap v7775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:08 smithi156 ceph-mon[32679]: pgmap v7775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:08 smithi092 ceph-mon[29156]: pgmap v7775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13544.503002 secs 2024-04-26T22:04:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12847.475632 secs 2024-04-26T22:04:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13544.503002 secs 2024-04-26T22:04:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12847.475632 secs 2024-04-26T22:04:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13544.503002 secs 2024-04-26T22:04:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12847.475632 secs 2024-04-26T22:04:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:10 smithi189 ceph-mon[32756]: pgmap v7776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:10 smithi156 ceph-mon[32679]: pgmap v7776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:10 smithi092 ceph-mon[29156]: pgmap v7776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:04:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:12 smithi189 ceph-mon[32756]: pgmap v7777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:04:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:12 smithi156 ceph-mon[32679]: pgmap v7777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:04:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:12 smithi092 ceph-mon[29156]: pgmap v7777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:04:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:13 smithi189 ceph-mon[32756]: pgmap v7778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:13 smithi156 ceph-mon[32679]: pgmap v7778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:13 smithi092 ceph-mon[29156]: pgmap v7778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:15.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13549.503083 secs 2024-04-26T22:04:15.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12852.475704 secs 2024-04-26T22:04:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13549.503083 secs 2024-04-26T22:04:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12852.475704 secs 2024-04-26T22:04:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13549.503083 secs 2024-04-26T22:04:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12852.475704 secs 2024-04-26T22:04:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:15 smithi189 ceph-mon[32756]: pgmap v7779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:15 smithi156 ceph-mon[32679]: pgmap v7779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:15 smithi092 ceph-mon[29156]: pgmap v7779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:18 smithi092 ceph-mon[29156]: pgmap v7780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:18 smithi189 ceph-mon[32756]: pgmap v7780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:18 smithi156 ceph-mon[32679]: pgmap v7780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13554.503208 secs 2024-04-26T22:04:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12857.475769 secs 2024-04-26T22:04:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:20 smithi092 ceph-mon[29156]: pgmap v7781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13554.503208 secs 2024-04-26T22:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12857.475769 secs 2024-04-26T22:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:20 smithi189 ceph-mon[32756]: pgmap v7781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13554.503208 secs 2024-04-26T22:04:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12857.475769 secs 2024-04-26T22:04:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:20 smithi156 ceph-mon[32679]: pgmap v7781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:22 smithi092 ceph-mon[29156]: pgmap v7782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:22 smithi189 ceph-mon[32756]: pgmap v7782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:22 smithi156 ceph-mon[32679]: pgmap v7782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:24 smithi092 ceph-mon[29156]: pgmap v7783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:24 smithi189 ceph-mon[32756]: pgmap v7783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:24 smithi156 ceph-mon[32679]: pgmap v7783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13559.503298 secs 2024-04-26T22:04:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12862.475887 secs 2024-04-26T22:04:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13559.503298 secs 2024-04-26T22:04:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12862.475887 secs 2024-04-26T22:04:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13559.503298 secs 2024-04-26T22:04:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12862.475887 secs 2024-04-26T22:04:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:26 smithi189 ceph-mon[32756]: pgmap v7784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:26 smithi156 ceph-mon[32679]: pgmap v7784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:26 smithi092 ceph-mon[29156]: pgmap v7784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:28 smithi189 ceph-mon[32756]: pgmap v7785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:28 smithi156 ceph-mon[32679]: pgmap v7785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:28 smithi092 ceph-mon[29156]: pgmap v7785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:30.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13564.503417 secs 2024-04-26T22:04:30.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12867.476003 secs 2024-04-26T22:04:30.547 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:30 smithi092 ceph-mon[29156]: pgmap v7786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13564.503417 secs 2024-04-26T22:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12867.476003 secs 2024-04-26T22:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:30 smithi189 ceph-mon[32756]: pgmap v7786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13564.503417 secs 2024-04-26T22:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12867.476003 secs 2024-04-26T22:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:30 smithi156 ceph-mon[32679]: pgmap v7786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:32 smithi189 ceph-mon[32756]: pgmap v7787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:32 smithi156 ceph-mon[32679]: pgmap v7787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:32 smithi092 ceph-mon[29156]: pgmap v7787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:34 smithi189 ceph-mon[32756]: pgmap v7788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:34 smithi156 ceph-mon[32679]: pgmap v7788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:34 smithi092 ceph-mon[29156]: pgmap v7788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13569.503531 secs 2024-04-26T22:04:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12872.476123 secs 2024-04-26T22:04:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13569.503531 secs 2024-04-26T22:04:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12872.476123 secs 2024-04-26T22:04:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13569.503531 secs 2024-04-26T22:04:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12872.476123 secs 2024-04-26T22:04:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:36 smithi189 ceph-mon[32756]: pgmap v7789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:36 smithi156 ceph-mon[32679]: pgmap v7789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:36 smithi092 ceph-mon[29156]: pgmap v7789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:38 smithi189 ceph-mon[32756]: pgmap v7790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:38 smithi156 ceph-mon[32679]: pgmap v7790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:38 smithi092 ceph-mon[29156]: pgmap v7790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13574.503647 secs 2024-04-26T22:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12877.476243 secs 2024-04-26T22:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:40 smithi189 ceph-mon[32756]: pgmap v7791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13574.503647 secs 2024-04-26T22:04:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12877.476243 secs 2024-04-26T22:04:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:40 smithi156 ceph-mon[32679]: pgmap v7791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13574.503647 secs 2024-04-26T22:04:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12877.476243 secs 2024-04-26T22:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:40 smithi092 ceph-mon[29156]: pgmap v7791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:42 smithi189 ceph-mon[32756]: pgmap v7792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:42 smithi156 ceph-mon[32679]: pgmap v7792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:42 smithi092 ceph-mon[29156]: pgmap v7792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:44 smithi189 ceph-mon[32756]: pgmap v7793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:44 smithi156 ceph-mon[32679]: pgmap v7793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:44 smithi092 ceph-mon[29156]: pgmap v7793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:45.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13579.503763 secs 2024-04-26T22:04:45.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12882.476374 secs 2024-04-26T22:04:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13579.503763 secs 2024-04-26T22:04:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12882.476374 secs 2024-04-26T22:04:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13579.503763 secs 2024-04-26T22:04:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12882.476374 secs 2024-04-26T22:04:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:46 smithi189 ceph-mon[32756]: pgmap v7794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:46 smithi156 ceph-mon[32679]: pgmap v7794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:46 smithi092 ceph-mon[29156]: pgmap v7794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:48 smithi189 ceph-mon[32756]: pgmap v7795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:48 smithi156 ceph-mon[32679]: pgmap v7795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:48 smithi092 ceph-mon[29156]: pgmap v7795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13584.503874 secs 2024-04-26T22:04:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13584.503874 secs 2024-04-26T22:04:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13584.503874 secs 2024-04-26T22:04:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12887.476510 secs 2024-04-26T22:04:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:50 smithi189 ceph-mon[32756]: pgmap v7796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12887.476510 secs 2024-04-26T22:04:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:50 smithi156 ceph-mon[32679]: pgmap v7796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12887.476510 secs 2024-04-26T22:04:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:50 smithi092 ceph-mon[29156]: pgmap v7796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:52 smithi189 ceph-mon[32756]: pgmap v7797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:52 smithi156 ceph-mon[32679]: pgmap v7797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:52 smithi092 ceph-mon[29156]: pgmap v7797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:54 smithi189 ceph-mon[32756]: pgmap v7798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13589.503987 secs 2024-04-26T22:04:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:54 smithi156 ceph-mon[32679]: pgmap v7798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13589.503987 secs 2024-04-26T22:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:54 smithi092 ceph-mon[29156]: pgmap v7798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13589.503987 secs 2024-04-26T22:04:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12892.476646 secs 2024-04-26T22:04:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12892.476646 secs 2024-04-26T22:04:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12892.476646 secs 2024-04-26T22:04:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:56 smithi189 ceph-mon[32756]: pgmap v7799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:56 smithi156 ceph-mon[32679]: pgmap v7799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:56 smithi092 ceph-mon[29156]: pgmap v7799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:04:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:58 smithi189 ceph-mon[32756]: pgmap v7800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:58 smithi156 ceph-mon[32679]: pgmap v7800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:58 smithi092 ceph-mon[29156]: pgmap v7800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:04:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:04:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13594.504108 secs 2024-04-26T22:04:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:04:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13594.504108 secs 2024-04-26T22:04:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:04:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13594.504108 secs 2024-04-26T22:05:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12897.476712 secs 2024-04-26T22:05:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:00 smithi189 ceph-mon[32756]: pgmap v7801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12897.476712 secs 2024-04-26T22:05:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:00 smithi092 ceph-mon[29156]: pgmap v7801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12897.476712 secs 2024-04-26T22:05:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:00 smithi156 ceph-mon[32679]: pgmap v7801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:05:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: pgmap v7802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: pgmap v7802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.641 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: pgmap v7802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:02.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: pgmap v7803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13599.504175 secs 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12902.476778 secs 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: pgmap v7803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13599.504175 secs 2024-04-26T22:05:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12902.476778 secs 2024-04-26T22:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: pgmap v7803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13599.504175 secs 2024-04-26T22:05:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12902.476778 secs 2024-04-26T22:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: pgmap v7804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: pgmap v7805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: pgmap v7806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: pgmap v7804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: pgmap v7805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: pgmap v7806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: pgmap v7804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: pgmap v7805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: pgmap v7806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:05:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:08 smithi189 ceph-mon[32756]: pgmap v7807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:08 smithi156 ceph-mon[32679]: pgmap v7807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:08 smithi092 ceph-mon[29156]: pgmap v7807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13604.504287 secs 2024-04-26T22:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12907.476841 secs 2024-04-26T22:05:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13604.504287 secs 2024-04-26T22:05:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12907.476841 secs 2024-04-26T22:05:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13604.504287 secs 2024-04-26T22:05:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12907.476841 secs 2024-04-26T22:05:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:10 smithi189 ceph-mon[32756]: pgmap v7808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:10 smithi156 ceph-mon[32679]: pgmap v7808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:10 smithi092 ceph-mon[29156]: pgmap v7808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:12 smithi189 ceph-mon[32756]: pgmap v7809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:12 smithi156 ceph-mon[32679]: pgmap v7809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:12 smithi092 ceph-mon[29156]: pgmap v7809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13609.504407 secs 2024-04-26T22:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:14 smithi189 ceph-mon[32756]: pgmap v7810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12912.476905 secs 2024-04-26T22:05:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13609.504407 secs 2024-04-26T22:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:14 smithi156 ceph-mon[32679]: pgmap v7810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12912.476905 secs 2024-04-26T22:05:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13609.504407 secs 2024-04-26T22:05:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:14 smithi092 ceph-mon[29156]: pgmap v7810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:05:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12912.476905 secs 2024-04-26T22:05:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:16 smithi189 ceph-mon[32756]: pgmap v7811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:05:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:16 smithi156 ceph-mon[32679]: pgmap v7811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:05:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:16 smithi092 ceph-mon[29156]: pgmap v7811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:05:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:18 smithi156 ceph-mon[32679]: pgmap v7812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:18 smithi092 ceph-mon[29156]: pgmap v7812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:18 smithi189 ceph-mon[32756]: pgmap v7812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13614.504497 secs 2024-04-26T22:05:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12917.477038 secs 2024-04-26T22:05:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13614.504497 secs 2024-04-26T22:05:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12917.477038 secs 2024-04-26T22:05:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13614.504497 secs 2024-04-26T22:05:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12917.477038 secs 2024-04-26T22:05:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:20 smithi156 ceph-mon[32679]: pgmap v7813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:20 smithi092 ceph-mon[29156]: pgmap v7813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:20 smithi189 ceph-mon[32756]: pgmap v7813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:22 smithi156 ceph-mon[32679]: pgmap v7814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:22 smithi092 ceph-mon[29156]: pgmap v7814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:22 smithi189 ceph-mon[32756]: pgmap v7814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13619.504629 secs 2024-04-26T22:05:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:24 smithi156 ceph-mon[32679]: pgmap v7815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12922.477128 secs 2024-04-26T22:05:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13619.504629 secs 2024-04-26T22:05:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:24 smithi092 ceph-mon[29156]: pgmap v7815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12922.477128 secs 2024-04-26T22:05:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13619.504629 secs 2024-04-26T22:05:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:24 smithi189 ceph-mon[32756]: pgmap v7815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12922.477128 secs 2024-04-26T22:05:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:26 smithi156 ceph-mon[32679]: pgmap v7816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:26 smithi092 ceph-mon[29156]: pgmap v7816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:26 smithi189 ceph-mon[32756]: pgmap v7816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:28 smithi156 ceph-mon[32679]: pgmap v7817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:28.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:28 smithi189 ceph-mon[32756]: pgmap v7817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:28 smithi092 ceph-mon[29156]: pgmap v7817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13624.504734 secs 2024-04-26T22:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12927.477262 secs 2024-04-26T22:05:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13624.504734 secs 2024-04-26T22:05:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12927.477262 secs 2024-04-26T22:05:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13624.504734 secs 2024-04-26T22:05:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12927.477262 secs 2024-04-26T22:05:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:30 smithi156 ceph-mon[32679]: pgmap v7818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:30 smithi092 ceph-mon[29156]: pgmap v7818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:30 smithi189 ceph-mon[32756]: pgmap v7818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:32 smithi156 ceph-mon[32679]: pgmap v7819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:32 smithi092 ceph-mon[29156]: pgmap v7819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:32 smithi189 ceph-mon[32756]: pgmap v7819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:33 smithi092 ceph-mon[29156]: pgmap v7820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:33 smithi189 ceph-mon[32756]: pgmap v7820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:33 smithi156 ceph-mon[32679]: pgmap v7820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13629.504866 secs 2024-04-26T22:05:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12932.477351 secs 2024-04-26T22:05:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13629.504866 secs 2024-04-26T22:05:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12932.477351 secs 2024-04-26T22:05:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13629.504866 secs 2024-04-26T22:05:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12932.477351 secs 2024-04-26T22:05:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:35 smithi092 ceph-mon[29156]: pgmap v7821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:35 smithi189 ceph-mon[32756]: pgmap v7821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:35 smithi156 ceph-mon[32679]: pgmap v7821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:38 smithi189 ceph-mon[32756]: pgmap v7822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:38 smithi156 ceph-mon[32679]: pgmap v7822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:38 smithi092 ceph-mon[29156]: pgmap v7822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13634.504916 secs 2024-04-26T22:05:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12937.477414 secs 2024-04-26T22:05:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13634.504916 secs 2024-04-26T22:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12937.477414 secs 2024-04-26T22:05:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13634.504916 secs 2024-04-26T22:05:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12937.477414 secs 2024-04-26T22:05:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:40 smithi189 ceph-mon[32756]: pgmap v7823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:40 smithi156 ceph-mon[32679]: pgmap v7823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:40 smithi092 ceph-mon[29156]: pgmap v7823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:42 smithi189 ceph-mon[32756]: pgmap v7824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:42 smithi156 ceph-mon[32679]: pgmap v7824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:42 smithi092 ceph-mon[29156]: pgmap v7824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13639.505001 secs 2024-04-26T22:05:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:44 smithi156 ceph-mon[32679]: pgmap v7825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12942.477490 secs 2024-04-26T22:05:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13639.505001 secs 2024-04-26T22:05:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:44 smithi092 ceph-mon[29156]: pgmap v7825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12942.477490 secs 2024-04-26T22:05:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13639.505001 secs 2024-04-26T22:05:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:44 smithi189 ceph-mon[32756]: pgmap v7825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12942.477490 secs 2024-04-26T22:05:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:46 smithi156 ceph-mon[32679]: pgmap v7826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:46 smithi092 ceph-mon[29156]: pgmap v7826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:46 smithi189 ceph-mon[32756]: pgmap v7826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:48 smithi156 ceph-mon[32679]: pgmap v7827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:48 smithi092 ceph-mon[29156]: pgmap v7827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:48 smithi189 ceph-mon[32756]: pgmap v7827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13644.505084 secs 2024-04-26T22:05:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12947.477606 secs 2024-04-26T22:05:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13644.505084 secs 2024-04-26T22:05:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12947.477606 secs 2024-04-26T22:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13644.505084 secs 2024-04-26T22:05:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12947.477606 secs 2024-04-26T22:05:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:50 smithi156 ceph-mon[32679]: pgmap v7828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:50 smithi092 ceph-mon[29156]: pgmap v7828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:50 smithi189 ceph-mon[32756]: pgmap v7828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:52 smithi156 ceph-mon[32679]: pgmap v7829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:52 smithi092 ceph-mon[29156]: pgmap v7829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:52 smithi189 ceph-mon[32756]: pgmap v7829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13649.505224 secs 2024-04-26T22:05:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:54 smithi156 ceph-mon[32679]: pgmap v7830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12952.477679 secs 2024-04-26T22:05:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13649.505224 secs 2024-04-26T22:05:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:54 smithi092 ceph-mon[29156]: pgmap v7830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12952.477679 secs 2024-04-26T22:05:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13649.505224 secs 2024-04-26T22:05:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:54 smithi189 ceph-mon[32756]: pgmap v7830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:05:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12952.477679 secs 2024-04-26T22:05:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:56 smithi156 ceph-mon[32679]: pgmap v7831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:56 smithi092 ceph-mon[29156]: pgmap v7831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:56 smithi189 ceph-mon[32756]: pgmap v7831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:58 smithi156 ceph-mon[32679]: pgmap v7832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:58.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:58 smithi189 ceph-mon[32756]: pgmap v7832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:58 smithi092 ceph-mon[29156]: pgmap v7832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:05:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13654.505302 secs 2024-04-26T22:05:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:05:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12957.477756 secs 2024-04-26T22:05:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13654.505302 secs 2024-04-26T22:05:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:05:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12957.477756 secs 2024-04-26T22:06:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13654.505302 secs 2024-04-26T22:06:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:05:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12957.477756 secs 2024-04-26T22:06:00.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:00 smithi092 ceph-mon[29156]: pgmap v7833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:00 smithi156 ceph-mon[32679]: pgmap v7833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:00 smithi189 ceph-mon[32756]: pgmap v7833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:01 smithi092 ceph-mon[29156]: pgmap v7834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:01 smithi189 ceph-mon[32756]: pgmap v7834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:01 smithi156 ceph-mon[32679]: pgmap v7834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13659.505425 secs 2024-04-26T22:06:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:04 smithi189 ceph-mon[32756]: pgmap v7835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12962.477880 secs 2024-04-26T22:06:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13659.505425 secs 2024-04-26T22:06:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:04 smithi156 ceph-mon[32679]: pgmap v7835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12962.477880 secs 2024-04-26T22:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13659.505425 secs 2024-04-26T22:06:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:04 smithi092 ceph-mon[29156]: pgmap v7835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12962.477880 secs 2024-04-26T22:06:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:06 smithi156 ceph-mon[32679]: pgmap v7836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:06:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:06 smithi092 ceph-mon[29156]: pgmap v7836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:06:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:06 smithi189 ceph-mon[32756]: pgmap v7836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:06:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:06:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:06:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:06:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:07 smithi156 ceph-mon[32679]: pgmap v7837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:06:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:07 smithi156 ceph-mon[32679]: pgmap v7838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:07 smithi092 ceph-mon[29156]: pgmap v7837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:06:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:07 smithi092 ceph-mon[29156]: pgmap v7838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:07 smithi189 ceph-mon[32756]: pgmap v7837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:06:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:07 smithi189 ceph-mon[32756]: pgmap v7838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:09 smithi156 ceph-mon[32679]: pgmap v7839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13664.505563 secs 2024-04-26T22:06:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12967.478016 secs 2024-04-26T22:06:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:09 smithi092 ceph-mon[29156]: pgmap v7839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13664.505563 secs 2024-04-26T22:06:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12967.478016 secs 2024-04-26T22:06:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:09 smithi189 ceph-mon[32756]: pgmap v7839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13664.505563 secs 2024-04-26T22:06:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12967.478016 secs 2024-04-26T22:06:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:11 smithi156 ceph-mon[32679]: pgmap v7840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:11 smithi092 ceph-mon[29156]: pgmap v7840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:11 smithi189 ceph-mon[32756]: pgmap v7840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:13 smithi156 ceph-mon[32679]: pgmap v7841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:13 smithi092 ceph-mon[29156]: pgmap v7841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:13 smithi189 ceph-mon[32756]: pgmap v7841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:06:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13669.505702 secs 2024-04-26T22:06:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12972.478138 secs 2024-04-26T22:06:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13669.505702 secs 2024-04-26T22:06:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12972.478138 secs 2024-04-26T22:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13669.505702 secs 2024-04-26T22:06:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12972.478138 secs 2024-04-26T22:06:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:15 smithi156 ceph-mon[32679]: pgmap v7842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:15 smithi092 ceph-mon[29156]: pgmap v7842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:15 smithi189 ceph-mon[32756]: pgmap v7842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:06:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:17 smithi156 ceph-mon[32679]: pgmap v7843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:06:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:17 smithi092 ceph-mon[29156]: pgmap v7843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:06:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:17 smithi189 ceph-mon[32756]: pgmap v7843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:06:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:19 smithi156 ceph-mon[32679]: pgmap v7844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13674.505854 secs 2024-04-26T22:06:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12977.478253 secs 2024-04-26T22:06:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:19 smithi092 ceph-mon[29156]: pgmap v7844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13674.505854 secs 2024-04-26T22:06:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12977.478253 secs 2024-04-26T22:06:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:19 smithi189 ceph-mon[32756]: pgmap v7844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13674.505854 secs 2024-04-26T22:06:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12977.478253 secs 2024-04-26T22:06:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:21 smithi156 ceph-mon[32679]: pgmap v7845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:21 smithi092 ceph-mon[29156]: pgmap v7845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:21 smithi189 ceph-mon[32756]: pgmap v7845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:23 smithi156 ceph-mon[32679]: pgmap v7846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:23 smithi092 ceph-mon[29156]: pgmap v7846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:23 smithi189 ceph-mon[32756]: pgmap v7846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13679.505975 secs 2024-04-26T22:06:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12982.478373 secs 2024-04-26T22:06:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13679.505975 secs 2024-04-26T22:06:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12982.478373 secs 2024-04-26T22:06:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13679.505975 secs 2024-04-26T22:06:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12982.478373 secs 2024-04-26T22:06:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:25 smithi156 ceph-mon[32679]: pgmap v7847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:25 smithi092 ceph-mon[29156]: pgmap v7847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:25 smithi189 ceph-mon[32756]: pgmap v7847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:26 smithi092 ceph-mon[29156]: pgmap v7848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:26 smithi189 ceph-mon[32756]: pgmap v7848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:26 smithi156 ceph-mon[32679]: pgmap v7848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:29 smithi092 ceph-mon[29156]: pgmap v7849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13684.506071 secs 2024-04-26T22:06:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12987.478491 secs 2024-04-26T22:06:29.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:29 smithi189 ceph-mon[32756]: pgmap v7849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:29.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13684.506071 secs 2024-04-26T22:06:29.841 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12987.478491 secs 2024-04-26T22:06:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:29 smithi156 ceph-mon[32679]: pgmap v7849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13684.506071 secs 2024-04-26T22:06:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12987.478491 secs 2024-04-26T22:06:31.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:31 smithi092 ceph-mon[29156]: pgmap v7850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:31 smithi189 ceph-mon[32756]: pgmap v7850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:31 smithi156 ceph-mon[32679]: pgmap v7850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:33 smithi092 ceph-mon[29156]: pgmap v7851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:33 smithi189 ceph-mon[32756]: pgmap v7851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:33 smithi156 ceph-mon[32679]: pgmap v7851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13689.506192 secs 2024-04-26T22:06:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12992.478603 secs 2024-04-26T22:06:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13689.506192 secs 2024-04-26T22:06:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12992.478603 secs 2024-04-26T22:06:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13689.506192 secs 2024-04-26T22:06:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12992.478603 secs 2024-04-26T22:06:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:35 smithi092 ceph-mon[29156]: pgmap v7852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:35 smithi189 ceph-mon[32756]: pgmap v7852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:35 smithi156 ceph-mon[32679]: pgmap v7852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:37 smithi092 ceph-mon[29156]: pgmap v7853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:06:37.858+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:06:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:06:37.858+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:06:37.858 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:06:37.858+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:06:37.859 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:06:37.858+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 108 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:06:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:37 smithi189 ceph-mon[32756]: pgmap v7853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:37 smithi156 ceph-mon[32679]: pgmap v7853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:39 smithi092 ceph-mon[29156]: pgmap v7854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13694.506282 secs 2024-04-26T22:06:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 12997.478730 secs 2024-04-26T22:06:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:39 smithi189 ceph-mon[32756]: pgmap v7854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13694.506282 secs 2024-04-26T22:06:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 12997.478730 secs 2024-04-26T22:06:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:39 smithi156 ceph-mon[32679]: pgmap v7854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13694.506282 secs 2024-04-26T22:06:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 12997.478730 secs 2024-04-26T22:06:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:41 smithi092 ceph-mon[29156]: pgmap v7855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:41 smithi189 ceph-mon[32756]: pgmap v7855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:41 smithi156 ceph-mon[32679]: pgmap v7855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:43 smithi092 ceph-mon[29156]: pgmap v7856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:43 smithi189 ceph-mon[32756]: pgmap v7856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:43 smithi156 ceph-mon[32679]: pgmap v7856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13699.506382 secs 2024-04-26T22:06:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13002.478852 secs 2024-04-26T22:06:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13699.506382 secs 2024-04-26T22:06:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13002.478852 secs 2024-04-26T22:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13699.506382 secs 2024-04-26T22:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13002.478852 secs 2024-04-26T22:06:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:45 smithi189 ceph-mon[32756]: pgmap v7857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:45 smithi156 ceph-mon[32679]: pgmap v7857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:45 smithi092 ceph-mon[29156]: pgmap v7857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:06:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:47 smithi189 ceph-mon[32756]: pgmap v7858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:47 smithi156 ceph-mon[32679]: pgmap v7858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:47 smithi092 ceph-mon[29156]: pgmap v7858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:49 smithi189 ceph-mon[32756]: pgmap v7859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13704.506498 secs 2024-04-26T22:06:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13007.478939 secs 2024-04-26T22:06:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:49 smithi156 ceph-mon[32679]: pgmap v7859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13704.506498 secs 2024-04-26T22:06:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13007.478939 secs 2024-04-26T22:06:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:49 smithi092 ceph-mon[29156]: pgmap v7859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:06:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13704.506498 secs 2024-04-26T22:06:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13007.478939 secs 2024-04-26T22:06:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:51 smithi189 ceph-mon[32756]: pgmap v7860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:51 smithi156 ceph-mon[32679]: pgmap v7860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:51 smithi092 ceph-mon[29156]: pgmap v7860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:53 smithi189 ceph-mon[32756]: pgmap v7861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:53 smithi156 ceph-mon[32679]: pgmap v7861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:53 smithi092 ceph-mon[29156]: pgmap v7861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13709.506634 secs 2024-04-26T22:06:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13012.479062 secs 2024-04-26T22:06:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13709.506634 secs 2024-04-26T22:06:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13012.479062 secs 2024-04-26T22:06:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13709.506634 secs 2024-04-26T22:06:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13012.479062 secs 2024-04-26T22:06:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:55 smithi189 ceph-mon[32756]: pgmap v7862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:55 smithi156 ceph-mon[32679]: pgmap v7862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:55 smithi092 ceph-mon[29156]: pgmap v7862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:06:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:57 smithi189 ceph-mon[32756]: pgmap v7863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:57 smithi156 ceph-mon[32679]: pgmap v7863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:57 smithi092 ceph-mon[29156]: pgmap v7863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:59 smithi189 ceph-mon[32756]: pgmap v7864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13714.506748 secs 2024-04-26T22:06:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:06:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13017.479180 secs 2024-04-26T22:06:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:59 smithi156 ceph-mon[32679]: pgmap v7864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13714.506748 secs 2024-04-26T22:06:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:06:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13017.479180 secs 2024-04-26T22:06:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:59 smithi092 ceph-mon[29156]: pgmap v7864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:06:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13714.506748 secs 2024-04-26T22:06:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:06:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13017.479180 secs 2024-04-26T22:07:01.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:01 smithi092 ceph-mon[29156]: pgmap v7865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:07:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:01 smithi189 ceph-mon[32756]: pgmap v7865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:07:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:01 smithi156 ceph-mon[32679]: pgmap v7865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:07:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:03 smithi189 ceph-mon[32756]: pgmap v7866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:03 smithi156 ceph-mon[32679]: pgmap v7866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:03 smithi092 ceph-mon[29156]: pgmap v7866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13719.506891 secs 2024-04-26T22:07:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13022.479321 secs 2024-04-26T22:07:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13719.506891 secs 2024-04-26T22:07:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13022.479321 secs 2024-04-26T22:07:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13719.506891 secs 2024-04-26T22:07:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13022.479321 secs 2024-04-26T22:07:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:05 smithi189 ceph-mon[32756]: pgmap v7867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:05 smithi156 ceph-mon[32679]: pgmap v7867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:05 smithi092 ceph-mon[29156]: pgmap v7867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:07 smithi189 ceph-mon[32756]: pgmap v7868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:07:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:07 smithi156 ceph-mon[32679]: pgmap v7868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:07:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:07 smithi092 ceph-mon[29156]: pgmap v7868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:07:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:07:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:07:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:07:08.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:08 smithi189 ceph-mon[32756]: pgmap v7869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:07:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:08 smithi189 ceph-mon[32756]: pgmap v7870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:08 smithi156 ceph-mon[32679]: pgmap v7869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:07:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:08 smithi156 ceph-mon[32679]: pgmap v7870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:08 smithi092 ceph-mon[29156]: pgmap v7869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:07:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:08 smithi092 ceph-mon[29156]: pgmap v7870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13724.507017 secs 2024-04-26T22:07:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13027.479375 secs 2024-04-26T22:07:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13724.507017 secs 2024-04-26T22:07:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13027.479375 secs 2024-04-26T22:07:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13724.507017 secs 2024-04-26T22:07:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13027.479375 secs 2024-04-26T22:07:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:10 smithi189 ceph-mon[32756]: pgmap v7871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:10 smithi156 ceph-mon[32679]: pgmap v7871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:10 smithi092 ceph-mon[29156]: pgmap v7871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:12 smithi189 ceph-mon[32756]: pgmap v7872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:12 smithi156 ceph-mon[32679]: pgmap v7872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:12 smithi092 ceph-mon[29156]: pgmap v7872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:14 smithi189 ceph-mon[32756]: pgmap v7873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:07:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13729.507147 secs 2024-04-26T22:07:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13032.479495 secs 2024-04-26T22:07:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:14 smithi156 ceph-mon[32679]: pgmap v7873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:07:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13729.507147 secs 2024-04-26T22:07:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13032.479495 secs 2024-04-26T22:07:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:14 smithi092 ceph-mon[29156]: pgmap v7873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13729.507147 secs 2024-04-26T22:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13032.479495 secs 2024-04-26T22:07:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:16 smithi189 ceph-mon[32756]: pgmap v7874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:16 smithi156 ceph-mon[32679]: pgmap v7874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:16 smithi092 ceph-mon[29156]: pgmap v7874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:07:18.845 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:18 smithi092 ceph-mon[29156]: pgmap v7875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:07:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:18 smithi189 ceph-mon[32756]: pgmap v7875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:07:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:18 smithi156 ceph-mon[32679]: pgmap v7875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:07:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13734.507242 secs 2024-04-26T22:07:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13037.479576 secs 2024-04-26T22:07:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13734.507242 secs 2024-04-26T22:07:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13037.479576 secs 2024-04-26T22:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13734.507242 secs 2024-04-26T22:07:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13037.479576 secs 2024-04-26T22:07:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:20 smithi189 ceph-mon[32756]: pgmap v7876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:20 smithi156 ceph-mon[32679]: pgmap v7876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:20 smithi092 ceph-mon[29156]: pgmap v7876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:22 smithi189 ceph-mon[32756]: pgmap v7877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:22 smithi156 ceph-mon[32679]: pgmap v7877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:22 smithi092 ceph-mon[29156]: pgmap v7877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:24 smithi189 ceph-mon[32756]: pgmap v7878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13739.507306 secs 2024-04-26T22:07:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13042.479690 secs 2024-04-26T22:07:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:24 smithi156 ceph-mon[32679]: pgmap v7878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13739.507306 secs 2024-04-26T22:07:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13042.479690 secs 2024-04-26T22:07:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:24 smithi092 ceph-mon[29156]: pgmap v7878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13739.507306 secs 2024-04-26T22:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13042.479690 secs 2024-04-26T22:07:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:26 smithi189 ceph-mon[32756]: pgmap v7879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:26 smithi156 ceph-mon[32679]: pgmap v7879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:26 smithi092 ceph-mon[29156]: pgmap v7879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:28 smithi189 ceph-mon[32756]: pgmap v7880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:28 smithi156 ceph-mon[32679]: pgmap v7880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:28 smithi092 ceph-mon[29156]: pgmap v7880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13744.507446 secs 2024-04-26T22:07:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13047.479792 secs 2024-04-26T22:07:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13744.507446 secs 2024-04-26T22:07:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13047.479792 secs 2024-04-26T22:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13744.507446 secs 2024-04-26T22:07:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13047.479792 secs 2024-04-26T22:07:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:30 smithi189 ceph-mon[32756]: pgmap v7881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:30 smithi156 ceph-mon[32679]: pgmap v7881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:30 smithi092 ceph-mon[29156]: pgmap v7881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:32 smithi189 ceph-mon[32756]: pgmap v7882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:32 smithi156 ceph-mon[32679]: pgmap v7882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:32 smithi092 ceph-mon[29156]: pgmap v7882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:34 smithi189 ceph-mon[32756]: pgmap v7883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13749.507574 secs 2024-04-26T22:07:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13052.479896 secs 2024-04-26T22:07:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:34 smithi156 ceph-mon[32679]: pgmap v7883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13749.507574 secs 2024-04-26T22:07:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13052.479896 secs 2024-04-26T22:07:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:34 smithi092 ceph-mon[29156]: pgmap v7883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13749.507574 secs 2024-04-26T22:07:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13052.479896 secs 2024-04-26T22:07:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:36 smithi189 ceph-mon[32756]: pgmap v7884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:36 smithi156 ceph-mon[32679]: pgmap v7884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:36 smithi092 ceph-mon[29156]: pgmap v7884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:38 smithi189 ceph-mon[32756]: pgmap v7885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:38 smithi156 ceph-mon[32679]: pgmap v7885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:38 smithi092 ceph-mon[29156]: pgmap v7885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13754.507727 secs 2024-04-26T22:07:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13057.480050 secs 2024-04-26T22:07:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13754.507727 secs 2024-04-26T22:07:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13057.480050 secs 2024-04-26T22:07:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13754.507727 secs 2024-04-26T22:07:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13057.480050 secs 2024-04-26T22:07:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:40 smithi189 ceph-mon[32756]: pgmap v7886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:40 smithi156 ceph-mon[32679]: pgmap v7886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:40 smithi092 ceph-mon[29156]: pgmap v7886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:42 smithi189 ceph-mon[32756]: pgmap v7887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:42 smithi156 ceph-mon[32679]: pgmap v7887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:42 smithi092 ceph-mon[29156]: pgmap v7887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:44 smithi189 ceph-mon[32756]: pgmap v7888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13759.507851 secs 2024-04-26T22:07:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13062.480191 secs 2024-04-26T22:07:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:44 smithi156 ceph-mon[32679]: pgmap v7888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13759.507851 secs 2024-04-26T22:07:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13062.480191 secs 2024-04-26T22:07:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:44 smithi092 ceph-mon[29156]: pgmap v7888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13759.507851 secs 2024-04-26T22:07:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13062.480191 secs 2024-04-26T22:07:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:46 smithi189 ceph-mon[32756]: pgmap v7889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:46 smithi156 ceph-mon[32679]: pgmap v7889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:46 smithi092 ceph-mon[29156]: pgmap v7889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:48 smithi189 ceph-mon[32756]: pgmap v7890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:48 smithi156 ceph-mon[32679]: pgmap v7890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:48 smithi092 ceph-mon[29156]: pgmap v7890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13764.507980 secs 2024-04-26T22:07:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13067.480290 secs 2024-04-26T22:07:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13764.507980 secs 2024-04-26T22:07:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13067.480290 secs 2024-04-26T22:07:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13764.507980 secs 2024-04-26T22:07:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13067.480290 secs 2024-04-26T22:07:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:50 smithi189 ceph-mon[32756]: pgmap v7891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:50 smithi156 ceph-mon[32679]: pgmap v7891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:50 smithi092 ceph-mon[29156]: pgmap v7891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:52 smithi156 ceph-mon[32679]: pgmap v7892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:52 smithi092 ceph-mon[29156]: pgmap v7892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:52 smithi189 ceph-mon[32756]: pgmap v7892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:54 smithi156 ceph-mon[32679]: pgmap v7893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13769.508128 secs 2024-04-26T22:07:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13072.480410 secs 2024-04-26T22:07:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:54 smithi092 ceph-mon[29156]: pgmap v7893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13769.508128 secs 2024-04-26T22:07:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13072.480410 secs 2024-04-26T22:07:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:54 smithi189 ceph-mon[32756]: pgmap v7893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13769.508128 secs 2024-04-26T22:07:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13072.480410 secs 2024-04-26T22:07:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:56 smithi156 ceph-mon[32679]: pgmap v7894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:56 smithi092 ceph-mon[29156]: pgmap v7894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:56 smithi189 ceph-mon[32756]: pgmap v7894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:07:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:58 smithi156 ceph-mon[32679]: pgmap v7895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:58 smithi092 ceph-mon[29156]: pgmap v7895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:58 smithi189 ceph-mon[32756]: pgmap v7895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:07:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13774.508243 secs 2024-04-26T22:07:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:07:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13077.480473 secs 2024-04-26T22:07:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13774.508243 secs 2024-04-26T22:07:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:07:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13077.480473 secs 2024-04-26T22:08:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13774.508243 secs 2024-04-26T22:08:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:07:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13077.480473 secs 2024-04-26T22:08:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:00 smithi156 ceph-mon[32679]: pgmap v7896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:00 smithi092 ceph-mon[29156]: pgmap v7896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:00 smithi189 ceph-mon[32756]: pgmap v7896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:02 smithi156 ceph-mon[32679]: pgmap v7897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:02 smithi092 ceph-mon[29156]: pgmap v7897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:02 smithi189 ceph-mon[32756]: pgmap v7897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:04.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:04 smithi092 ceph-mon[29156]: pgmap v7898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:04.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13779.508358 secs 2024-04-26T22:08:04.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:04 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 13082.480617 secs 2024-04-26T22:08:04.925 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:04 smithi092 ceph-mon[29156]: slow request 11522.027038 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:04 smithi156 ceph-mon[32679]: pgmap v7898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13779.508358 secs 2024-04-26T22:08:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:04 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 13082.480617 secs 2024-04-26T22:08:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:04 smithi156 ceph-mon[32679]: slow request 11522.027038 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:04 smithi189 ceph-mon[32756]: pgmap v7898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13779.508358 secs 2024-04-26T22:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:04 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 13082.480617 secs 2024-04-26T22:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:04 smithi189 ceph-mon[32756]: slow request 11522.027038 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:08:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:06 smithi156 ceph-mon[32679]: pgmap v7899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:06 smithi092 ceph-mon[29156]: pgmap v7899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:06 smithi189 ceph-mon[32756]: pgmap v7899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:08:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:08 smithi156 ceph-mon[32679]: pgmap v7900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:08:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:08 smithi092 ceph-mon[29156]: pgmap v7900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:08 smithi189 ceph-mon[32756]: pgmap v7900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:08:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:09 smithi156 ceph-mon[32679]: pgmap v7901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:08:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:09 smithi156 ceph-mon[32679]: pgmap v7902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:08:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13784.508481 secs 2024-04-26T22:08:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13087.480728 secs 2024-04-26T22:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:09 smithi092 ceph-mon[29156]: pgmap v7901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:09 smithi092 ceph-mon[29156]: pgmap v7902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13784.508481 secs 2024-04-26T22:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13087.480728 secs 2024-04-26T22:08:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:09 smithi189 ceph-mon[32756]: pgmap v7901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:08:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:09 smithi189 ceph-mon[32756]: pgmap v7902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:08:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13784.508481 secs 2024-04-26T22:08:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13087.480728 secs 2024-04-26T22:08:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:11 smithi156 ceph-mon[32679]: pgmap v7903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:11 smithi092 ceph-mon[29156]: pgmap v7903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:11 smithi189 ceph-mon[32756]: pgmap v7903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:13 smithi156 ceph-mon[32679]: pgmap v7904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:13 smithi092 ceph-mon[29156]: pgmap v7904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:13 smithi189 ceph-mon[32756]: pgmap v7904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13789.508559 secs 2024-04-26T22:08:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13092.480826 secs 2024-04-26T22:08:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13789.508559 secs 2024-04-26T22:08:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13092.480826 secs 2024-04-26T22:08:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13789.508559 secs 2024-04-26T22:08:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13092.480826 secs 2024-04-26T22:08:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:15 smithi092 ceph-mon[29156]: pgmap v7905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:15 smithi189 ceph-mon[32756]: pgmap v7905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:15 smithi156 ceph-mon[32679]: pgmap v7905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:17 smithi092 ceph-mon[29156]: pgmap v7906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:17 smithi189 ceph-mon[32756]: pgmap v7906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:17 smithi156 ceph-mon[32679]: pgmap v7906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:08:19.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:19 smithi156 ceph-mon[32679]: pgmap v7907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:08:19.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13794.508673 secs 2024-04-26T22:08:19.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13097.480942 secs 2024-04-26T22:08:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:19 smithi092 ceph-mon[29156]: pgmap v7907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:08:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13794.508673 secs 2024-04-26T22:08:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13097.480942 secs 2024-04-26T22:08:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:19 smithi189 ceph-mon[32756]: pgmap v7907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:08:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13794.508673 secs 2024-04-26T22:08:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13097.480942 secs 2024-04-26T22:08:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:20 smithi189 ceph-mon[32756]: pgmap v7908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:20 smithi156 ceph-mon[32679]: pgmap v7908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:20 smithi092 ceph-mon[29156]: pgmap v7908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:23 smithi189 ceph-mon[32756]: pgmap v7909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:23 smithi156 ceph-mon[32679]: pgmap v7909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:23 smithi092 ceph-mon[29156]: pgmap v7909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13799.508788 secs 2024-04-26T22:08:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13102.481006 secs 2024-04-26T22:08:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:25 smithi189 ceph-mon[32756]: pgmap v7910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13799.508788 secs 2024-04-26T22:08:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13102.481006 secs 2024-04-26T22:08:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:25 smithi156 ceph-mon[32679]: pgmap v7910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13799.508788 secs 2024-04-26T22:08:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13102.481006 secs 2024-04-26T22:08:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:25 smithi092 ceph-mon[29156]: pgmap v7910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:27 smithi189 ceph-mon[32756]: pgmap v7911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:27 smithi156 ceph-mon[32679]: pgmap v7911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:27 smithi092 ceph-mon[29156]: pgmap v7911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:29 smithi189 ceph-mon[32756]: pgmap v7912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:29 smithi156 ceph-mon[32679]: pgmap v7912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:29 smithi092 ceph-mon[29156]: pgmap v7912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13804.508922 secs 2024-04-26T22:08:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13107.481130 secs 2024-04-26T22:08:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13804.508922 secs 2024-04-26T22:08:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13107.481130 secs 2024-04-26T22:08:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13804.508922 secs 2024-04-26T22:08:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13107.481130 secs 2024-04-26T22:08:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:31 smithi189 ceph-mon[32756]: pgmap v7913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:31 smithi156 ceph-mon[32679]: pgmap v7913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:31 smithi092 ceph-mon[29156]: pgmap v7913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:33 smithi189 ceph-mon[32756]: pgmap v7914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:33 smithi156 ceph-mon[32679]: pgmap v7914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:33 smithi092 ceph-mon[29156]: pgmap v7914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13809.509047 secs 2024-04-26T22:08:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13112.481248 secs 2024-04-26T22:08:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:35 smithi189 ceph-mon[32756]: pgmap v7915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13809.509047 secs 2024-04-26T22:08:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13112.481248 secs 2024-04-26T22:08:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:35 smithi156 ceph-mon[32679]: pgmap v7915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13809.509047 secs 2024-04-26T22:08:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13112.481248 secs 2024-04-26T22:08:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:35 smithi092 ceph-mon[29156]: pgmap v7915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:37 smithi189 ceph-mon[32756]: pgmap v7916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:37 smithi156 ceph-mon[32679]: pgmap v7916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:37 smithi092 ceph-mon[29156]: pgmap v7916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:39 smithi189 ceph-mon[32756]: pgmap v7917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:39 smithi156 ceph-mon[32679]: pgmap v7917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:39 smithi092 ceph-mon[29156]: pgmap v7917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13814.509165 secs 2024-04-26T22:08:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13117.481368 secs 2024-04-26T22:08:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13814.509165 secs 2024-04-26T22:08:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13117.481368 secs 2024-04-26T22:08:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13814.509165 secs 2024-04-26T22:08:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13117.481368 secs 2024-04-26T22:08:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:41 smithi189 ceph-mon[32756]: pgmap v7918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:41 smithi156 ceph-mon[32679]: pgmap v7918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:41 smithi092 ceph-mon[29156]: pgmap v7918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:43 smithi189 ceph-mon[32756]: pgmap v7919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:43 smithi156 ceph-mon[32679]: pgmap v7919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:43 smithi092 ceph-mon[29156]: pgmap v7919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13819.509244 secs 2024-04-26T22:08:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13122.481481 secs 2024-04-26T22:08:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:45 smithi189 ceph-mon[32756]: pgmap v7920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13819.509244 secs 2024-04-26T22:08:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13122.481481 secs 2024-04-26T22:08:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:45 smithi156 ceph-mon[32679]: pgmap v7920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13819.509244 secs 2024-04-26T22:08:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13122.481481 secs 2024-04-26T22:08:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:45 smithi092 ceph-mon[29156]: pgmap v7920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:47 smithi189 ceph-mon[32756]: pgmap v7921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:47 smithi156 ceph-mon[32679]: pgmap v7921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:47 smithi092 ceph-mon[29156]: pgmap v7921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:49 smithi189 ceph-mon[32756]: pgmap v7922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:49 smithi156 ceph-mon[32679]: pgmap v7922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:49 smithi092 ceph-mon[29156]: pgmap v7922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13824.509359 secs 2024-04-26T22:08:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13127.481588 secs 2024-04-26T22:08:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13824.509359 secs 2024-04-26T22:08:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13127.481588 secs 2024-04-26T22:08:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13824.509359 secs 2024-04-26T22:08:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13127.481588 secs 2024-04-26T22:08:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:51 smithi189 ceph-mon[32756]: pgmap v7923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:51 smithi156 ceph-mon[32679]: pgmap v7923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:51 smithi092 ceph-mon[29156]: pgmap v7923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:53 smithi189 ceph-mon[32756]: pgmap v7924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:53 smithi156 ceph-mon[32679]: pgmap v7924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:53 smithi092 ceph-mon[29156]: pgmap v7924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13829.509478 secs 2024-04-26T22:08:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13132.481706 secs 2024-04-26T22:08:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:55 smithi189 ceph-mon[32756]: pgmap v7925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13829.509478 secs 2024-04-26T22:08:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13132.481706 secs 2024-04-26T22:08:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:55 smithi156 ceph-mon[32679]: pgmap v7925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13829.509478 secs 2024-04-26T22:08:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13132.481706 secs 2024-04-26T22:08:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:55 smithi092 ceph-mon[29156]: pgmap v7925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:08:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:57 smithi189 ceph-mon[32756]: pgmap v7926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:57 smithi156 ceph-mon[32679]: pgmap v7926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:57 smithi092 ceph-mon[29156]: pgmap v7926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:08:59 smithi189 ceph-mon[32756]: pgmap v7927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:08:59 smithi156 ceph-mon[32679]: pgmap v7927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:08:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:08:59 smithi092 ceph-mon[29156]: pgmap v7927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13834.509625 secs 2024-04-26T22:09:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13137.481846 secs 2024-04-26T22:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13834.509625 secs 2024-04-26T22:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13137.481846 secs 2024-04-26T22:09:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13834.509625 secs 2024-04-26T22:09:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13137.481846 secs 2024-04-26T22:09:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:01 smithi189 ceph-mon[32756]: pgmap v7928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:01 smithi156 ceph-mon[32679]: pgmap v7928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:01 smithi092 ceph-mon[29156]: pgmap v7928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:03 smithi156 ceph-mon[32679]: pgmap v7929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:03 smithi092 ceph-mon[29156]: pgmap v7929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:03 smithi189 ceph-mon[32756]: pgmap v7929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13839.509747 secs 2024-04-26T22:09:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:05 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13142.481964 secs 2024-04-26T22:09:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:05 smithi156 ceph-mon[32679]: pgmap v7930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13839.509747 secs 2024-04-26T22:09:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:05 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13142.481964 secs 2024-04-26T22:09:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:05 smithi092 ceph-mon[29156]: pgmap v7930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13839.509747 secs 2024-04-26T22:09:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:05 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13142.481964 secs 2024-04-26T22:09:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:05 smithi189 ceph-mon[32756]: pgmap v7930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:07 smithi156 ceph-mon[32679]: pgmap v7931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:07 smithi092 ceph-mon[29156]: pgmap v7931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:07 smithi189 ceph-mon[32756]: pgmap v7931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:09:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:09 smithi156 ceph-mon[32679]: pgmap v7932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:09:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:09 smithi092 ceph-mon[29156]: pgmap v7932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:09:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:09 smithi189 ceph-mon[32756]: pgmap v7932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:09:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:09:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:09:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13844.509862 secs 2024-04-26T22:09:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:10 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 13147.482028 secs 2024-04-26T22:09:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:10 smithi156 ceph-mon[32679]: slow request 2884.893183 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:09:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:10 smithi156 ceph-mon[32679]: pgmap v7933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:09:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:10 smithi156 ceph-mon[32679]: pgmap v7934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13844.509862 secs 2024-04-26T22:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:10 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 13147.482028 secs 2024-04-26T22:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:10 smithi092 ceph-mon[29156]: slow request 2884.893183 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:10 smithi092 ceph-mon[29156]: pgmap v7933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:09:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:10 smithi092 ceph-mon[29156]: pgmap v7934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13844.509862 secs 2024-04-26T22:09:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:10 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 13147.482028 secs 2024-04-26T22:09:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:10 smithi189 ceph-mon[32756]: slow request 2884.893183 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:09:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:10 smithi189 ceph-mon[32756]: pgmap v7933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:09:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:10 smithi189 ceph-mon[32756]: pgmap v7934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:12 smithi156 ceph-mon[32679]: pgmap v7935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:12 smithi092 ceph-mon[29156]: pgmap v7935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:12 smithi189 ceph-mon[32756]: pgmap v7935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:14 smithi156 ceph-mon[32679]: pgmap v7936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:09:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:14 smithi092 ceph-mon[29156]: pgmap v7936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:09:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:14 smithi189 ceph-mon[32756]: pgmap v7936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:09:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13849.509980 secs 2024-04-26T22:09:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:15 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13152.482178 secs 2024-04-26T22:09:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13849.509980 secs 2024-04-26T22:09:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:15 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13152.482178 secs 2024-04-26T22:09:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13849.509980 secs 2024-04-26T22:09:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:15 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13152.482178 secs 2024-04-26T22:09:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:16 smithi156 ceph-mon[32679]: pgmap v7937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:16 smithi092 ceph-mon[29156]: pgmap v7937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:16 smithi189 ceph-mon[32756]: pgmap v7937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:18 smithi156 ceph-mon[32679]: pgmap v7938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:18 smithi092 ceph-mon[29156]: pgmap v7938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:18 smithi189 ceph-mon[32756]: pgmap v7938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:09:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13854.510104 secs 2024-04-26T22:09:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13157.482316 secs 2024-04-26T22:09:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:20 smithi156 ceph-mon[32679]: pgmap v7939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:09:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13854.510104 secs 2024-04-26T22:09:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13157.482316 secs 2024-04-26T22:09:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:20 smithi092 ceph-mon[29156]: pgmap v7939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:09:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13854.510104 secs 2024-04-26T22:09:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13157.482316 secs 2024-04-26T22:09:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:20 smithi189 ceph-mon[32756]: pgmap v7939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:09:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:22 smithi156 ceph-mon[32679]: pgmap v7940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:22 smithi092 ceph-mon[29156]: pgmap v7940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:22 smithi189 ceph-mon[32756]: pgmap v7940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:24 smithi092 ceph-mon[29156]: pgmap v7941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:24 smithi189 ceph-mon[32756]: pgmap v7941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:24 smithi156 ceph-mon[32679]: pgmap v7941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13859.510220 secs 2024-04-26T22:09:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13162.482363 secs 2024-04-26T22:09:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13859.510220 secs 2024-04-26T22:09:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13162.482363 secs 2024-04-26T22:09:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13859.510220 secs 2024-04-26T22:09:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13162.482363 secs 2024-04-26T22:09:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:26 smithi092 ceph-mon[29156]: pgmap v7942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:26 smithi189 ceph-mon[32756]: pgmap v7942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:26 smithi156 ceph-mon[32679]: pgmap v7942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:28 smithi092 ceph-mon[29156]: pgmap v7943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:28 smithi189 ceph-mon[32756]: pgmap v7943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:28 smithi156 ceph-mon[32679]: pgmap v7943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13864.510348 secs 2024-04-26T22:09:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13167.482475 secs 2024-04-26T22:09:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:30 smithi092 ceph-mon[29156]: pgmap v7944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13864.510348 secs 2024-04-26T22:09:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13167.482475 secs 2024-04-26T22:09:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:30 smithi189 ceph-mon[32756]: pgmap v7944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13864.510348 secs 2024-04-26T22:09:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13167.482475 secs 2024-04-26T22:09:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:30 smithi156 ceph-mon[32679]: pgmap v7944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:32 smithi092 ceph-mon[29156]: pgmap v7945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:32 smithi189 ceph-mon[32756]: pgmap v7945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:32 smithi156 ceph-mon[32679]: pgmap v7945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:34.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-mon[29156]: pgmap v7946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:34 smithi189 ceph-mon[32756]: pgmap v7946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:34 smithi156 ceph-mon[32679]: pgmap v7946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:09:34.483+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:09:34.483+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:09:34.483+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:09:34.483+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:34.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:09:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:09:34.483+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:09:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13869.510475 secs 2024-04-26T22:09:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13172.482590 secs 2024-04-26T22:09:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13869.510475 secs 2024-04-26T22:09:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13172.482590 secs 2024-04-26T22:09:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13869.510475 secs 2024-04-26T22:09:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13172.482590 secs 2024-04-26T22:09:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:36 smithi092 ceph-mon[29156]: pgmap v7947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:36 smithi189 ceph-mon[32756]: pgmap v7947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:36 smithi156 ceph-mon[32679]: pgmap v7947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.883+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:09:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.884+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:09:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.884+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T22:09:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.884+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T22:09:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.887+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:09:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.887+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 109 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:09:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.887+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:09:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:09:37.888+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 110 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:09:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:38 smithi092 ceph-mon[29156]: pgmap v7948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:38 smithi189 ceph-mon[32756]: pgmap v7948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:38 smithi156 ceph-mon[32679]: pgmap v7948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13874.510620 secs 2024-04-26T22:09:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13177.482670 secs 2024-04-26T22:09:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:40 smithi092 ceph-mon[29156]: pgmap v7949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13874.510620 secs 2024-04-26T22:09:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13177.482670 secs 2024-04-26T22:09:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:40 smithi189 ceph-mon[32756]: pgmap v7949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13874.510620 secs 2024-04-26T22:09:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13177.482670 secs 2024-04-26T22:09:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:40 smithi156 ceph-mon[32679]: pgmap v7949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:42 smithi092 ceph-mon[29156]: pgmap v7950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:42 smithi189 ceph-mon[32756]: pgmap v7950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:42 smithi156 ceph-mon[32679]: pgmap v7950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:44 smithi092 ceph-mon[29156]: pgmap v7951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:44 smithi189 ceph-mon[32756]: pgmap v7951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:44 smithi156 ceph-mon[32679]: pgmap v7951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13879.510742 secs 2024-04-26T22:09:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13182.482807 secs 2024-04-26T22:09:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13879.510742 secs 2024-04-26T22:09:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13182.482807 secs 2024-04-26T22:09:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13879.510742 secs 2024-04-26T22:09:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13182.482807 secs 2024-04-26T22:09:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:46 smithi092 ceph-mon[29156]: pgmap v7952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:46 smithi189 ceph-mon[32756]: pgmap v7952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:46 smithi156 ceph-mon[32679]: pgmap v7952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:48 smithi092 ceph-mon[29156]: pgmap v7953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:48 smithi189 ceph-mon[32756]: pgmap v7953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:48 smithi156 ceph-mon[32679]: pgmap v7953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13884.510814 secs 2024-04-26T22:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13187.482884 secs 2024-04-26T22:09:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:50 smithi092 ceph-mon[29156]: pgmap v7954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13884.510814 secs 2024-04-26T22:09:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13187.482884 secs 2024-04-26T22:09:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:50 smithi189 ceph-mon[32756]: pgmap v7954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13884.510814 secs 2024-04-26T22:09:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13187.482884 secs 2024-04-26T22:09:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:50 smithi156 ceph-mon[32679]: pgmap v7954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:09:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:52 smithi092 ceph-mon[29156]: pgmap v7955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:52 smithi189 ceph-mon[32756]: pgmap v7955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:52 smithi156 ceph-mon[32679]: pgmap v7955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:54 smithi189 ceph-mon[32756]: pgmap v7956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:54 smithi156 ceph-mon[32679]: pgmap v7956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:54 smithi092 ceph-mon[29156]: pgmap v7956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13889.510929 secs 2024-04-26T22:09:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13192.483039 secs 2024-04-26T22:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13889.510929 secs 2024-04-26T22:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13192.483039 secs 2024-04-26T22:09:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13889.510929 secs 2024-04-26T22:09:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13192.483039 secs 2024-04-26T22:09:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:56 smithi189 ceph-mon[32756]: pgmap v7957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:56 smithi156 ceph-mon[32679]: pgmap v7957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:56 smithi092 ceph-mon[29156]: pgmap v7957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:09:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:09:58 smithi189 ceph-mon[32756]: pgmap v7958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:09:58 smithi156 ceph-mon[32679]: pgmap v7958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:09:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:09:58 smithi092 ceph-mon[29156]: pgmap v7958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:00.508 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13894.510987 secs 2024-04-26T22:10:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13197.483174 secs 2024-04-26T22:10:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:00 smithi092 ceph-mon[29156]: pgmap v7959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13894.510987 secs 2024-04-26T22:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13197.483174 secs 2024-04-26T22:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:00 smithi189 ceph-mon[32756]: pgmap v7959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13894.510987 secs 2024-04-26T22:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13197.483174 secs 2024-04-26T22:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:00 smithi156 ceph-mon[32679]: pgmap v7959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:10:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:02 smithi189 ceph-mon[32756]: pgmap v7960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:02 smithi156 ceph-mon[32679]: pgmap v7960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:02 smithi092 ceph-mon[29156]: pgmap v7960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:04.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:04 smithi092 ceph-mon[29156]: pgmap v7961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:04 smithi189 ceph-mon[32756]: pgmap v7961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:04 smithi156 ceph-mon[32679]: pgmap v7961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13899.511072 secs 2024-04-26T22:10:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:05 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13202.483288 secs 2024-04-26T22:10:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13899.511072 secs 2024-04-26T22:10:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:05 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13202.483288 secs 2024-04-26T22:10:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13899.511072 secs 2024-04-26T22:10:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:05 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13202.483288 secs 2024-04-26T22:10:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:06 smithi189 ceph-mon[32756]: pgmap v7962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:06 smithi156 ceph-mon[32679]: pgmap v7962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:06 smithi092 ceph-mon[29156]: pgmap v7962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:08 smithi189 ceph-mon[32756]: pgmap v7963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:10:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:08 smithi156 ceph-mon[32679]: pgmap v7963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:10:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:08 smithi092 ceph-mon[29156]: pgmap v7963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:10:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13904.511194 secs 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13207.483337 secs 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: pgmap v7964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: pgmap v7965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: pgmap v7966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13904.511194 secs 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13207.483337 secs 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: pgmap v7964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: pgmap v7965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: pgmap v7966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13904.511194 secs 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13207.483337 secs 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: pgmap v7964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: pgmap v7965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: pgmap v7966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:10:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:12 smithi156 ceph-mon[32679]: pgmap v7967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:12 smithi092 ceph-mon[29156]: pgmap v7967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:12 smithi189 ceph-mon[32756]: pgmap v7967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:10:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13909.511266 secs 2024-04-26T22:10:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:14 smithi156 ceph-mon[32679]: pgmap v7968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T22:10:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13212.483454 secs 2024-04-26T22:10:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13909.511266 secs 2024-04-26T22:10:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:14 smithi092 ceph-mon[29156]: pgmap v7968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T22:10:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13212.483454 secs 2024-04-26T22:10:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13909.511266 secs 2024-04-26T22:10:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:14 smithi189 ceph-mon[32756]: pgmap v7968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-26T22:10:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13212.483454 secs 2024-04-26T22:10:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:16 smithi156 ceph-mon[32679]: pgmap v7969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:10:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:16 smithi092 ceph-mon[29156]: pgmap v7969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:10:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:16 smithi189 ceph-mon[32756]: pgmap v7969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:10:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:18 smithi156 ceph-mon[32679]: pgmap v7970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:10:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:18 smithi092 ceph-mon[29156]: pgmap v7970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:10:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:18 smithi189 ceph-mon[32756]: pgmap v7970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:10:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13914.511414 secs 2024-04-26T22:10:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13217.483558 secs 2024-04-26T22:10:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13914.511414 secs 2024-04-26T22:10:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13217.483558 secs 2024-04-26T22:10:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13914.511414 secs 2024-04-26T22:10:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13217.483558 secs 2024-04-26T22:10:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:20 smithi156 ceph-mon[32679]: pgmap v7971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:10:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:20 smithi092 ceph-mon[29156]: pgmap v7971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:10:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:20 smithi189 ceph-mon[32756]: pgmap v7971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:10:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:22 smithi156 ceph-mon[32679]: pgmap v7972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:22 smithi092 ceph-mon[29156]: pgmap v7972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:22 smithi189 ceph-mon[32756]: pgmap v7972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13919.511561 secs 2024-04-26T22:10:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:24 smithi156 ceph-mon[32679]: pgmap v7973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13222.483640 secs 2024-04-26T22:10:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13919.511561 secs 2024-04-26T22:10:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:24 smithi092 ceph-mon[29156]: pgmap v7973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13222.483640 secs 2024-04-26T22:10:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13919.511561 secs 2024-04-26T22:10:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:24 smithi189 ceph-mon[32756]: pgmap v7973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13222.483640 secs 2024-04-26T22:10:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:26 smithi156 ceph-mon[32679]: pgmap v7974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:26 smithi092 ceph-mon[29156]: pgmap v7974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:26 smithi189 ceph-mon[32756]: pgmap v7974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:28 smithi156 ceph-mon[32679]: pgmap v7975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:28 smithi092 ceph-mon[29156]: pgmap v7975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:28 smithi189 ceph-mon[32756]: pgmap v7975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13924.511665 secs 2024-04-26T22:10:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13227.483753 secs 2024-04-26T22:10:30.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13924.511665 secs 2024-04-26T22:10:30.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13227.483753 secs 2024-04-26T22:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13924.511665 secs 2024-04-26T22:10:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13227.483753 secs 2024-04-26T22:10:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:30 smithi092 ceph-mon[29156]: pgmap v7976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:30 smithi189 ceph-mon[32756]: pgmap v7976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:30 smithi156 ceph-mon[32679]: pgmap v7976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:32 smithi092 ceph-mon[29156]: pgmap v7977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:32 smithi189 ceph-mon[32756]: pgmap v7977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:32 smithi156 ceph-mon[32679]: pgmap v7977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13929.511768 secs 2024-04-26T22:10:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:34 smithi092 ceph-mon[29156]: pgmap v7978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13232.483884 secs 2024-04-26T22:10:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13929.511768 secs 2024-04-26T22:10:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:34 smithi189 ceph-mon[32756]: pgmap v7978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13232.483884 secs 2024-04-26T22:10:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13929.511768 secs 2024-04-26T22:10:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:34 smithi156 ceph-mon[32679]: pgmap v7978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13232.483884 secs 2024-04-26T22:10:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:36 smithi092 ceph-mon[29156]: pgmap v7979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:36 smithi189 ceph-mon[32756]: pgmap v7979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:36 smithi156 ceph-mon[32679]: pgmap v7979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:38 smithi092 ceph-mon[29156]: pgmap v7980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:38 smithi189 ceph-mon[32756]: pgmap v7980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:38 smithi156 ceph-mon[32679]: pgmap v7980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13934.511897 secs 2024-04-26T22:10:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13237.483965 secs 2024-04-26T22:10:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13934.511897 secs 2024-04-26T22:10:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13237.483965 secs 2024-04-26T22:10:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13934.511897 secs 2024-04-26T22:10:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13237.483965 secs 2024-04-26T22:10:40.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:40 smithi092 ceph-mon[29156]: pgmap v7981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:40 smithi189 ceph-mon[32756]: pgmap v7981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:40 smithi156 ceph-mon[32679]: pgmap v7981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:42 smithi092 ceph-mon[29156]: pgmap v7982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:42 smithi189 ceph-mon[32756]: pgmap v7982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:42 smithi156 ceph-mon[32679]: pgmap v7982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13939.512015 secs 2024-04-26T22:10:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:44 smithi092 ceph-mon[29156]: pgmap v7983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13242.484082 secs 2024-04-26T22:10:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13939.512015 secs 2024-04-26T22:10:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:44 smithi189 ceph-mon[32756]: pgmap v7983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13242.484082 secs 2024-04-26T22:10:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13939.512015 secs 2024-04-26T22:10:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:44 smithi156 ceph-mon[32679]: pgmap v7983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13242.484082 secs 2024-04-26T22:10:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:46 smithi092 ceph-mon[29156]: pgmap v7984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:46 smithi189 ceph-mon[32756]: pgmap v7984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:46 smithi156 ceph-mon[32679]: pgmap v7984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:48 smithi092 ceph-mon[29156]: pgmap v7985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:48 smithi189 ceph-mon[32756]: pgmap v7985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:48 smithi156 ceph-mon[32679]: pgmap v7985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13944.512141 secs 2024-04-26T22:10:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13247.484208 secs 2024-04-26T22:10:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:49 smithi092 ceph-mon[29156]: pgmap v7986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:50.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13944.512141 secs 2024-04-26T22:10:50.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13247.484208 secs 2024-04-26T22:10:50.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:49 smithi156 ceph-mon[32679]: pgmap v7986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13944.512141 secs 2024-04-26T22:10:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13247.484208 secs 2024-04-26T22:10:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:49 smithi189 ceph-mon[32756]: pgmap v7986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:52 smithi156 ceph-mon[32679]: pgmap v7987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:52 smithi092 ceph-mon[29156]: pgmap v7987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:52 smithi189 ceph-mon[32756]: pgmap v7987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13949.512261 secs 2024-04-26T22:10:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:54 smithi156 ceph-mon[32679]: pgmap v7988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13252.484329 secs 2024-04-26T22:10:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13949.512261 secs 2024-04-26T22:10:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:54 smithi092 ceph-mon[29156]: pgmap v7988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13252.484329 secs 2024-04-26T22:10:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13949.512261 secs 2024-04-26T22:10:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:54 smithi189 ceph-mon[32756]: pgmap v7988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:10:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13252.484329 secs 2024-04-26T22:10:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:56 smithi156 ceph-mon[32679]: pgmap v7989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:56 smithi092 ceph-mon[29156]: pgmap v7989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:56 smithi189 ceph-mon[32756]: pgmap v7989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:58 smithi156 ceph-mon[32679]: pgmap v7990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:58 smithi092 ceph-mon[29156]: pgmap v7990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:58 smithi189 ceph-mon[32756]: pgmap v7990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:10:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13954.512384 secs 2024-04-26T22:10:59.972 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:10:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13257.484391 secs 2024-04-26T22:10:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13954.512384 secs 2024-04-26T22:10:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:10:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13257.484391 secs 2024-04-26T22:11:00.058 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13954.512384 secs 2024-04-26T22:11:00.059 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:10:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13257.484391 secs 2024-04-26T22:11:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:00 smithi156 ceph-mon[32679]: pgmap v7991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:00 smithi092 ceph-mon[29156]: pgmap v7991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:00 smithi189 ceph-mon[32756]: pgmap v7991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:02 smithi156 ceph-mon[32679]: pgmap v7992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:02 smithi092 ceph-mon[29156]: pgmap v7992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:02 smithi189 ceph-mon[32756]: pgmap v7992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:03 smithi189 ceph-mon[32756]: pgmap v7993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:03 smithi156 ceph-mon[32679]: pgmap v7993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:03 smithi092 ceph-mon[29156]: pgmap v7993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13959.512469 secs 2024-04-26T22:11:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13262.484537 secs 2024-04-26T22:11:05.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13959.512469 secs 2024-04-26T22:11:05.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13262.484537 secs 2024-04-26T22:11:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13959.512469 secs 2024-04-26T22:11:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13262.484537 secs 2024-04-26T22:11:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:05 smithi189 ceph-mon[32756]: pgmap v7994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:05 smithi156 ceph-mon[32679]: pgmap v7994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:05 smithi092 ceph-mon[29156]: pgmap v7994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:08 smithi156 ceph-mon[32679]: pgmap v7995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:08 smithi092 ceph-mon[29156]: pgmap v7995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:08 smithi189 ceph-mon[32756]: pgmap v7995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13964.512603 secs 2024-04-26T22:11:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13267.484670 secs 2024-04-26T22:11:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13964.512603 secs 2024-04-26T22:11:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13267.484670 secs 2024-04-26T22:11:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13964.512603 secs 2024-04-26T22:11:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13267.484670 secs 2024-04-26T22:11:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:10 smithi156 ceph-mon[32679]: pgmap v7996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:11:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:10 smithi092 ceph-mon[29156]: pgmap v7996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:11:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:10 smithi189 ceph-mon[32756]: pgmap v7996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:11:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:11:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:11:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:11:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:11 smithi156 ceph-mon[32679]: pgmap v7997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:11:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:11 smithi156 ceph-mon[32679]: pgmap v7998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:11 smithi092 ceph-mon[29156]: pgmap v7997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:11:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:11 smithi092 ceph-mon[29156]: pgmap v7998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:11 smithi189 ceph-mon[32756]: pgmap v7997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:11:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:11 smithi189 ceph-mon[32756]: pgmap v7998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:13 smithi156 ceph-mon[32679]: pgmap v7999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:13 smithi092 ceph-mon[29156]: pgmap v7999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:13 smithi189 ceph-mon[32756]: pgmap v7999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13969.512733 secs 2024-04-26T22:11:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13272.484803 secs 2024-04-26T22:11:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13969.512733 secs 2024-04-26T22:11:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13272.484803 secs 2024-04-26T22:11:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13969.512733 secs 2024-04-26T22:11:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13272.484803 secs 2024-04-26T22:11:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:15 smithi092 ceph-mon[29156]: pgmap v8000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:15 smithi189 ceph-mon[32756]: pgmap v8000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:15 smithi156 ceph-mon[32679]: pgmap v8000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:17 smithi092 ceph-mon[29156]: pgmap v8001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:17 smithi189 ceph-mon[32756]: pgmap v8001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:17 smithi156 ceph-mon[32679]: pgmap v8001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:11:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:19 smithi092 ceph-mon[29156]: pgmap v8002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13974.512800 secs 2024-04-26T22:11:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13277.484922 secs 2024-04-26T22:11:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:19 smithi189 ceph-mon[32756]: pgmap v8002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13974.512800 secs 2024-04-26T22:11:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13277.484922 secs 2024-04-26T22:11:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:19 smithi156 ceph-mon[32679]: pgmap v8002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:11:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13974.512800 secs 2024-04-26T22:11:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13277.484922 secs 2024-04-26T22:11:21.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:21 smithi156 ceph-mon[32679]: pgmap v8003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:11:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:21 smithi092 ceph-mon[29156]: pgmap v8003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:11:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:21 smithi189 ceph-mon[32756]: pgmap v8003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:11:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:23 smithi092 ceph-mon[29156]: pgmap v8004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:23 smithi189 ceph-mon[32756]: pgmap v8004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:23 smithi156 ceph-mon[32679]: pgmap v8004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13979.512949 secs 2024-04-26T22:11:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13282.485032 secs 2024-04-26T22:11:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13979.512949 secs 2024-04-26T22:11:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13282.485032 secs 2024-04-26T22:11:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13979.512949 secs 2024-04-26T22:11:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13282.485032 secs 2024-04-26T22:11:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:25 smithi092 ceph-mon[29156]: pgmap v8005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:25 smithi189 ceph-mon[32756]: pgmap v8005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:25 smithi156 ceph-mon[32679]: pgmap v8005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:27 smithi092 ceph-mon[29156]: pgmap v8006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:27 smithi189 ceph-mon[32756]: pgmap v8006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:27 smithi156 ceph-mon[32679]: pgmap v8006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:29 smithi092 ceph-mon[29156]: pgmap v8007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13984.513078 secs 2024-04-26T22:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13287.485152 secs 2024-04-26T22:11:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:29 smithi189 ceph-mon[32756]: pgmap v8007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13984.513078 secs 2024-04-26T22:11:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13287.485152 secs 2024-04-26T22:11:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:29 smithi156 ceph-mon[32679]: pgmap v8007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13984.513078 secs 2024-04-26T22:11:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13287.485152 secs 2024-04-26T22:11:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:31 smithi092 ceph-mon[29156]: pgmap v8008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:31 smithi189 ceph-mon[32756]: pgmap v8008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:31 smithi156 ceph-mon[32679]: pgmap v8008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:33 smithi092 ceph-mon[29156]: pgmap v8009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:33 smithi189 ceph-mon[32756]: pgmap v8009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:33 smithi156 ceph-mon[32679]: pgmap v8009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13989.513144 secs 2024-04-26T22:11:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13292.485212 secs 2024-04-26T22:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13989.513144 secs 2024-04-26T22:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13292.485212 secs 2024-04-26T22:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13989.513144 secs 2024-04-26T22:11:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13292.485212 secs 2024-04-26T22:11:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:35 smithi092 ceph-mon[29156]: pgmap v8010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:35 smithi189 ceph-mon[32756]: pgmap v8010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:35 smithi156 ceph-mon[32679]: pgmap v8010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:37 smithi092 ceph-mon[29156]: pgmap v8011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:37 smithi189 ceph-mon[32756]: pgmap v8011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:37 smithi156 ceph-mon[32679]: pgmap v8011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:38 smithi189 ceph-mon[32756]: pgmap v8012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:38 smithi156 ceph-mon[32679]: pgmap v8012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:38 smithi092 ceph-mon[29156]: pgmap v8012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13994.513224 secs 2024-04-26T22:11:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13297.485352 secs 2024-04-26T22:11:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13994.513224 secs 2024-04-26T22:11:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13297.485352 secs 2024-04-26T22:11:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13994.513224 secs 2024-04-26T22:11:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13297.485352 secs 2024-04-26T22:11:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:40 smithi189 ceph-mon[32756]: pgmap v8013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:40 smithi156 ceph-mon[32679]: pgmap v8013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:40 smithi092 ceph-mon[29156]: pgmap v8013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:43 smithi156 ceph-mon[32679]: pgmap v8014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:43 smithi092 ceph-mon[29156]: pgmap v8014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:43 smithi189 ceph-mon[32756]: pgmap v8014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 13999.513316 secs 2024-04-26T22:11:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13302.485476 secs 2024-04-26T22:11:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 13999.513316 secs 2024-04-26T22:11:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13302.485476 secs 2024-04-26T22:11:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 13999.513316 secs 2024-04-26T22:11:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13302.485476 secs 2024-04-26T22:11:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:45 smithi092 ceph-mon[29156]: pgmap v8015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:45 smithi189 ceph-mon[32756]: pgmap v8015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:45 smithi156 ceph-mon[32679]: pgmap v8015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:47 smithi092 ceph-mon[29156]: pgmap v8016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:47 smithi189 ceph-mon[32756]: pgmap v8016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:47 smithi156 ceph-mon[32679]: pgmap v8016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:49 smithi092 ceph-mon[29156]: pgmap v8017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14004.513437 secs 2024-04-26T22:11:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13307.485608 secs 2024-04-26T22:11:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:49 smithi189 ceph-mon[32756]: pgmap v8017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14004.513437 secs 2024-04-26T22:11:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13307.485608 secs 2024-04-26T22:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:49 smithi156 ceph-mon[32679]: pgmap v8017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14004.513437 secs 2024-04-26T22:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13307.485608 secs 2024-04-26T22:11:51.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:51 smithi156 ceph-mon[32679]: pgmap v8018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:51 smithi092 ceph-mon[29156]: pgmap v8018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:51 smithi189 ceph-mon[32756]: pgmap v8018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:53 smithi092 ceph-mon[29156]: pgmap v8019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:53 smithi189 ceph-mon[32756]: pgmap v8019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:53 smithi156 ceph-mon[32679]: pgmap v8019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14009.513559 secs 2024-04-26T22:11:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13312.485673 secs 2024-04-26T22:11:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14009.513559 secs 2024-04-26T22:11:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13312.485673 secs 2024-04-26T22:11:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14009.513559 secs 2024-04-26T22:11:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13312.485673 secs 2024-04-26T22:11:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:55 smithi092 ceph-mon[29156]: pgmap v8020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:55 smithi189 ceph-mon[32756]: pgmap v8020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:55 smithi156 ceph-mon[32679]: pgmap v8020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:11:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:57 smithi092 ceph-mon[29156]: pgmap v8021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:57 smithi189 ceph-mon[32756]: pgmap v8021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:57 smithi156 ceph-mon[32679]: pgmap v8021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:59 smithi092 ceph-mon[29156]: pgmap v8022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14014.513632 secs 2024-04-26T22:11:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:11:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13317.485755 secs 2024-04-26T22:11:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:59 smithi189 ceph-mon[32756]: pgmap v8022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14014.513632 secs 2024-04-26T22:11:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:11:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13317.485755 secs 2024-04-26T22:11:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:59 smithi156 ceph-mon[32679]: pgmap v8022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:11:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14014.513632 secs 2024-04-26T22:11:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:11:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13317.485755 secs 2024-04-26T22:12:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:01 smithi092 ceph-mon[29156]: pgmap v8023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:01 smithi189 ceph-mon[32756]: pgmap v8023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:01 smithi156 ceph-mon[32679]: pgmap v8023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:03 smithi092 ceph-mon[29156]: pgmap v8024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:03 smithi189 ceph-mon[32756]: pgmap v8024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:03 smithi156 ceph-mon[32679]: pgmap v8024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14019.513769 secs 2024-04-26T22:12:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13322.485833 secs 2024-04-26T22:12:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14019.513769 secs 2024-04-26T22:12:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13322.485833 secs 2024-04-26T22:12:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14019.513769 secs 2024-04-26T22:12:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13322.485833 secs 2024-04-26T22:12:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:05 smithi092 ceph-mon[29156]: pgmap v8025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:05 smithi189 ceph-mon[32756]: pgmap v8025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:05 smithi156 ceph-mon[32679]: pgmap v8025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:07 smithi092 ceph-mon[29156]: pgmap v8026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:07 smithi189 ceph-mon[32756]: pgmap v8026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:07 smithi156 ceph-mon[32679]: pgmap v8026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:08 smithi189 ceph-mon[32756]: pgmap v8027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:08 smithi156 ceph-mon[32679]: pgmap v8027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:08 smithi092 ceph-mon[29156]: pgmap v8027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14024.513892 secs 2024-04-26T22:12:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:09 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 13327.485909 secs 2024-04-26T22:12:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:09 smithi189 ceph-mon[32756]: slow request 1444.467400 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14024.513892 secs 2024-04-26T22:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:09 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 13327.485909 secs 2024-04-26T22:12:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:09 smithi156 ceph-mon[32679]: slow request 1444.467400 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:12:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14024.513892 secs 2024-04-26T22:12:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:09 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 13327.485909 secs 2024-04-26T22:12:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:09 smithi092 ceph-mon[29156]: slow request 1444.467400 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:12:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:10 smithi189 ceph-mon[32756]: pgmap v8028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:10 smithi156 ceph-mon[32679]: pgmap v8028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:11.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:10 smithi092 ceph-mon[29156]: pgmap v8028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:11.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:12:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:11 smithi189 ceph-mon[32756]: pgmap v8029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:12:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:11 smithi189 ceph-mon[32756]: pgmap v8030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:12:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:11 smithi156 ceph-mon[32679]: pgmap v8029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:12:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:11 smithi156 ceph-mon[32679]: pgmap v8030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:12:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:12:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:12:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:11 smithi092 ceph-mon[29156]: pgmap v8029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:12:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:11 smithi092 ceph-mon[29156]: pgmap v8030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:12:14.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:13 smithi092 ceph-mon[29156]: pgmap v8031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:12:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:13 smithi189 ceph-mon[32756]: pgmap v8031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:12:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:13 smithi156 ceph-mon[32679]: pgmap v8031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:12:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14029.514000 secs 2024-04-26T22:12:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13332.485973 secs 2024-04-26T22:12:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14029.514000 secs 2024-04-26T22:12:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13332.485973 secs 2024-04-26T22:12:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14029.514000 secs 2024-04-26T22:12:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13332.485973 secs 2024-04-26T22:12:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:15 smithi189 ceph-mon[32756]: pgmap v8032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:15 smithi156 ceph-mon[32679]: pgmap v8032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:15 smithi092 ceph-mon[29156]: pgmap v8032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:18 smithi092 ceph-mon[29156]: pgmap v8033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:18 smithi189 ceph-mon[32756]: pgmap v8033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:18 smithi156 ceph-mon[32679]: pgmap v8033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14034.514113 secs 2024-04-26T22:12:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13337.486092 secs 2024-04-26T22:12:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:20 smithi092 ceph-mon[29156]: pgmap v8034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14034.514113 secs 2024-04-26T22:12:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13337.486092 secs 2024-04-26T22:12:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:20 smithi189 ceph-mon[32756]: pgmap v8034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14034.514113 secs 2024-04-26T22:12:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13337.486092 secs 2024-04-26T22:12:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:20 smithi156 ceph-mon[32679]: pgmap v8034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:12:22.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:22 smithi156 ceph-mon[32679]: pgmap v8035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:12:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:22 smithi092 ceph-mon[29156]: pgmap v8035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:12:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:22 smithi189 ceph-mon[32756]: pgmap v8035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:12:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:24 smithi092 ceph-mon[29156]: pgmap v8036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:24 smithi189 ceph-mon[32756]: pgmap v8036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:24 smithi156 ceph-mon[32679]: pgmap v8036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14039.514233 secs 2024-04-26T22:12:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13342.486208 secs 2024-04-26T22:12:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14039.514233 secs 2024-04-26T22:12:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13342.486208 secs 2024-04-26T22:12:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14039.514233 secs 2024-04-26T22:12:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13342.486208 secs 2024-04-26T22:12:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:26 smithi092 ceph-mon[29156]: pgmap v8037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:26 smithi189 ceph-mon[32756]: pgmap v8037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:26 smithi156 ceph-mon[32679]: pgmap v8037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:28 smithi092 ceph-mon[29156]: pgmap v8038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:28 smithi189 ceph-mon[32756]: pgmap v8038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:28 smithi156 ceph-mon[32679]: pgmap v8038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14044.514349 secs 2024-04-26T22:12:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13347.486330 secs 2024-04-26T22:12:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:30 smithi092 ceph-mon[29156]: pgmap v8039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14044.514349 secs 2024-04-26T22:12:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13347.486330 secs 2024-04-26T22:12:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:30 smithi189 ceph-mon[32756]: pgmap v8039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14044.514349 secs 2024-04-26T22:12:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13347.486330 secs 2024-04-26T22:12:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:30 smithi156 ceph-mon[32679]: pgmap v8039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:32 smithi092 ceph-mon[29156]: pgmap v8040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:32 smithi189 ceph-mon[32756]: pgmap v8040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:32 smithi156 ceph-mon[32679]: pgmap v8040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:34 smithi092 ceph-mon[29156]: pgmap v8041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:34 smithi189 ceph-mon[32756]: pgmap v8041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:34 smithi156 ceph-mon[32679]: pgmap v8041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14049.514467 secs 2024-04-26T22:12:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 13352.486446 secs 2024-04-26T22:12:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14049.514467 secs 2024-04-26T22:12:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 13352.486446 secs 2024-04-26T22:12:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14049.514467 secs 2024-04-26T22:12:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 13352.486446 secs 2024-04-26T22:12:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:36 smithi092 ceph-mon[29156]: pgmap v8042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:36 smithi189 ceph-mon[32756]: pgmap v8042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:36 smithi156 ceph-mon[32679]: pgmap v8042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:12:37.907+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T22:12:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:12:37.907+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c0049a0 con 0x5617fb906f00 2024-04-26T22:12:37.908 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:12:37.908+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:12:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:12:37.908+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 111 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:12:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:38 smithi092 ceph-mon[29156]: pgmap v8043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:38 smithi189 ceph-mon[32756]: pgmap v8043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:38 smithi156 ceph-mon[32679]: pgmap v8043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14054.514576 secs 2024-04-26T22:12:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:40 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 13357.486524 secs 2024-04-26T22:12:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:40 smithi189 ceph-mon[32756]: slow request 184.143325 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T22:12:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:40 smithi189 ceph-mon[32756]: pgmap v8044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14054.514576 secs 2024-04-26T22:12:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:40 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 13357.486524 secs 2024-04-26T22:12:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:40 smithi156 ceph-mon[32679]: slow request 184.143325 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T22:12:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:40 smithi156 ceph-mon[32679]: pgmap v8044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14054.514576 secs 2024-04-26T22:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:40 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 13357.486524 secs 2024-04-26T22:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:40 smithi092 ceph-mon[29156]: slow request 184.143325 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T22:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:40 smithi092 ceph-mon[29156]: pgmap v8044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T22:12:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:41 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T22:12:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T22:12:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:41 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T22:12:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T22:12:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:41 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T22:12:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:42 smithi189 ceph-mon[32756]: pgmap v8045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:42 smithi156 ceph-mon[32679]: pgmap v8045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:42 smithi092 ceph-mon[29156]: pgmap v8045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:44 smithi189 ceph-mon[32756]: pgmap v8046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:44 smithi156 ceph-mon[32679]: pgmap v8046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:44 smithi092 ceph-mon[29156]: pgmap v8046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14059.514701 secs 2024-04-26T22:12:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13362.486642 secs 2024-04-26T22:12:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14059.514701 secs 2024-04-26T22:12:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13362.486642 secs 2024-04-26T22:12:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14059.514701 secs 2024-04-26T22:12:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13362.486642 secs 2024-04-26T22:12:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:46 smithi189 ceph-mon[32756]: pgmap v8047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:46 smithi156 ceph-mon[32679]: pgmap v8047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:46 smithi092 ceph-mon[29156]: pgmap v8047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:48 smithi189 ceph-mon[32756]: pgmap v8048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:48 smithi156 ceph-mon[32679]: pgmap v8048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:48 smithi092 ceph-mon[29156]: pgmap v8048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14064.514817 secs 2024-04-26T22:12:50.705 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13367.486755 secs 2024-04-26T22:12:50.705 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:50 smithi189 ceph-mon[32756]: pgmap v8049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:50.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14064.514817 secs 2024-04-26T22:12:50.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13367.486755 secs 2024-04-26T22:12:50.706 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:50 smithi156 ceph-mon[32679]: pgmap v8049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14064.514817 secs 2024-04-26T22:12:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13367.486755 secs 2024-04-26T22:12:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:50 smithi092 ceph-mon[29156]: pgmap v8049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:52 smithi189 ceph-mon[32756]: pgmap v8050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:52 smithi156 ceph-mon[32679]: pgmap v8050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:52 smithi092 ceph-mon[29156]: pgmap v8050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:54 smithi189 ceph-mon[32756]: pgmap v8051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:54 smithi156 ceph-mon[32679]: pgmap v8051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:54 smithi092 ceph-mon[29156]: pgmap v8051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14069.514934 secs 2024-04-26T22:12:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13372.486850 secs 2024-04-26T22:12:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14069.514934 secs 2024-04-26T22:12:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13372.486850 secs 2024-04-26T22:12:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14069.514934 secs 2024-04-26T22:12:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13372.486850 secs 2024-04-26T22:12:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:56 smithi189 ceph-mon[32756]: pgmap v8052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:56 smithi156 ceph-mon[32679]: pgmap v8052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:56 smithi092 ceph-mon[29156]: pgmap v8052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:12:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:12:58 smithi189 ceph-mon[32756]: pgmap v8053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:12:58 smithi156 ceph-mon[32679]: pgmap v8053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:12:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:12:58 smithi092 ceph-mon[29156]: pgmap v8053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14074.515051 secs 2024-04-26T22:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13377.486969 secs 2024-04-26T22:13:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:00 smithi189 ceph-mon[32756]: pgmap v8054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14074.515051 secs 2024-04-26T22:13:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13377.486969 secs 2024-04-26T22:13:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:00 smithi156 ceph-mon[32679]: pgmap v8054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14074.515051 secs 2024-04-26T22:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13377.486969 secs 2024-04-26T22:13:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:00 smithi092 ceph-mon[29156]: pgmap v8054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:02 smithi189 ceph-mon[32756]: pgmap v8055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:02 smithi156 ceph-mon[32679]: pgmap v8055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:02 smithi092 ceph-mon[29156]: pgmap v8055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:04 smithi189 ceph-mon[32756]: pgmap v8056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:04 smithi156 ceph-mon[32679]: pgmap v8056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:04 smithi092 ceph-mon[29156]: pgmap v8056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:05 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 14079.515162 secs 2024-04-26T22:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:05 smithi189 ceph-mon[32756]: slow request 11521.771281 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13382.487093 secs 2024-04-26T22:13:05.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:05 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 14079.515162 secs 2024-04-26T22:13:05.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:05 smithi092 ceph-mon[29156]: slow request 11521.771281 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:05.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13382.487093 secs 2024-04-26T22:13:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:05 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 14079.515162 secs 2024-04-26T22:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:05 smithi156 ceph-mon[32679]: slow request 11521.771281 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:13:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13382.487093 secs 2024-04-26T22:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:06 smithi189 ceph-mon[32756]: pgmap v8057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:06 smithi156 ceph-mon[32679]: pgmap v8057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:06 smithi092 ceph-mon[29156]: pgmap v8057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:08 smithi189 ceph-mon[32756]: pgmap v8058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:08 smithi156 ceph-mon[32679]: pgmap v8058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:08 smithi092 ceph-mon[29156]: pgmap v8058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14084.515277 secs 2024-04-26T22:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13387.487233 secs 2024-04-26T22:13:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:10 smithi189 ceph-mon[32756]: pgmap v8059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14084.515277 secs 2024-04-26T22:13:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13387.487233 secs 2024-04-26T22:13:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:10 smithi156 ceph-mon[32679]: pgmap v8059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14084.515277 secs 2024-04-26T22:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13387.487233 secs 2024-04-26T22:13:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:10 smithi092 ceph-mon[29156]: pgmap v8059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:13:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:12 smithi189 ceph-mon[32756]: pgmap v8060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:13:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:12 smithi156 ceph-mon[32679]: pgmap v8060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:13:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:12 smithi092 ceph-mon[29156]: pgmap v8060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:13:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:13:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:13:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:13 smithi189 ceph-mon[32756]: pgmap v8061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:13:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:13 smithi189 ceph-mon[32756]: pgmap v8062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:13 smithi156 ceph-mon[32679]: pgmap v8061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:13:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:13 smithi156 ceph-mon[32679]: pgmap v8062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:13 smithi092 ceph-mon[29156]: pgmap v8061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:13:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:13 smithi092 ceph-mon[29156]: pgmap v8062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14089.515395 secs 2024-04-26T22:13:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13392.487345 secs 2024-04-26T22:13:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:15 smithi189 ceph-mon[32756]: pgmap v8063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14089.515395 secs 2024-04-26T22:13:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13392.487345 secs 2024-04-26T22:13:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:15 smithi156 ceph-mon[32679]: pgmap v8063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14089.515395 secs 2024-04-26T22:13:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13392.487345 secs 2024-04-26T22:13:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:15 smithi092 ceph-mon[29156]: pgmap v8063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:17 smithi189 ceph-mon[32756]: pgmap v8064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:17 smithi156 ceph-mon[32679]: pgmap v8064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:17 smithi092 ceph-mon[29156]: pgmap v8064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:19 smithi189 ceph-mon[32756]: pgmap v8065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:13:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:19 smithi156 ceph-mon[32679]: pgmap v8065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:13:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:19 smithi092 ceph-mon[29156]: pgmap v8065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:13:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14094.515521 secs 2024-04-26T22:13:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13397.487425 secs 2024-04-26T22:13:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14094.515521 secs 2024-04-26T22:13:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13397.487425 secs 2024-04-26T22:13:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14094.515521 secs 2024-04-26T22:13:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13397.487425 secs 2024-04-26T22:13:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:21 smithi189 ceph-mon[32756]: pgmap v8066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:21 smithi156 ceph-mon[32679]: pgmap v8066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:21 smithi092 ceph-mon[29156]: pgmap v8066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:13:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:23 smithi189 ceph-mon[32756]: pgmap v8067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:13:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:23 smithi156 ceph-mon[32679]: pgmap v8067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:13:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:23 smithi092 ceph-mon[29156]: pgmap v8067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14099.515638 secs 2024-04-26T22:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13402.487488 secs 2024-04-26T22:13:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:25 smithi189 ceph-mon[32756]: pgmap v8068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14099.515638 secs 2024-04-26T22:13:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13402.487488 secs 2024-04-26T22:13:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:25 smithi156 ceph-mon[32679]: pgmap v8068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14099.515638 secs 2024-04-26T22:13:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13402.487488 secs 2024-04-26T22:13:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:25 smithi092 ceph-mon[29156]: pgmap v8068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:27 smithi189 ceph-mon[32756]: pgmap v8069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:27 smithi156 ceph-mon[32679]: pgmap v8069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:27 smithi092 ceph-mon[29156]: pgmap v8069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:29 smithi189 ceph-mon[32756]: pgmap v8070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14104.515757 secs 2024-04-26T22:13:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:29 smithi156 ceph-mon[32679]: pgmap v8070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14104.515757 secs 2024-04-26T22:13:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:29 smithi092 ceph-mon[29156]: pgmap v8070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14104.515757 secs 2024-04-26T22:13:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13407.487600 secs 2024-04-26T22:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13407.487600 secs 2024-04-26T22:13:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13407.487600 secs 2024-04-26T22:13:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:31 smithi189 ceph-mon[32756]: pgmap v8071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:31 smithi156 ceph-mon[32679]: pgmap v8071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:31 smithi092 ceph-mon[29156]: pgmap v8071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:33 smithi189 ceph-mon[32756]: pgmap v8072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:33 smithi156 ceph-mon[32679]: pgmap v8072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:33 smithi092 ceph-mon[29156]: pgmap v8072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14109.515897 secs 2024-04-26T22:13:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14109.515897 secs 2024-04-26T22:13:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14109.515897 secs 2024-04-26T22:13:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13412.487700 secs 2024-04-26T22:13:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:35 smithi189 ceph-mon[32756]: pgmap v8073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:35.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13412.487700 secs 2024-04-26T22:13:35.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:35 smithi092 ceph-mon[29156]: pgmap v8073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13412.487700 secs 2024-04-26T22:13:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:35 smithi156 ceph-mon[32679]: pgmap v8073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:37 smithi189 ceph-mon[32756]: pgmap v8074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:37 smithi156 ceph-mon[32679]: pgmap v8074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:37 smithi092 ceph-mon[29156]: pgmap v8074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:39 smithi189 ceph-mon[32756]: pgmap v8075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14114.515995 secs 2024-04-26T22:13:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:39 smithi156 ceph-mon[32679]: pgmap v8075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14114.515995 secs 2024-04-26T22:13:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:39 smithi092 ceph-mon[29156]: pgmap v8075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14114.515995 secs 2024-04-26T22:13:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13417.487791 secs 2024-04-26T22:13:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13417.487791 secs 2024-04-26T22:13:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13417.487791 secs 2024-04-26T22:13:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:41 smithi156 ceph-mon[32679]: pgmap v8076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:41 smithi092 ceph-mon[29156]: pgmap v8076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:41 smithi189 ceph-mon[32756]: pgmap v8076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:43 smithi156 ceph-mon[32679]: pgmap v8077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:43 smithi092 ceph-mon[29156]: pgmap v8077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:43 smithi189 ceph-mon[32756]: pgmap v8077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14119.516112 secs 2024-04-26T22:13:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14119.516112 secs 2024-04-26T22:13:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14119.516112 secs 2024-04-26T22:13:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13422.487925 secs 2024-04-26T22:13:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:45 smithi156 ceph-mon[32679]: pgmap v8078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13422.487925 secs 2024-04-26T22:13:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:45 smithi092 ceph-mon[29156]: pgmap v8078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13422.487925 secs 2024-04-26T22:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:45 smithi189 ceph-mon[32756]: pgmap v8078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:47 smithi156 ceph-mon[32679]: pgmap v8079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:47 smithi092 ceph-mon[29156]: pgmap v8079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:47 smithi189 ceph-mon[32756]: pgmap v8079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:49 smithi156 ceph-mon[32679]: pgmap v8080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14124.516234 secs 2024-04-26T22:13:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13427.488044 secs 2024-04-26T22:13:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:49 smithi092 ceph-mon[29156]: pgmap v8080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14124.516234 secs 2024-04-26T22:13:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13427.488044 secs 2024-04-26T22:13:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:49 smithi189 ceph-mon[32756]: pgmap v8080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14124.516234 secs 2024-04-26T22:13:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13427.488044 secs 2024-04-26T22:13:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:51 smithi156 ceph-mon[32679]: pgmap v8081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:51 smithi092 ceph-mon[29156]: pgmap v8081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:51 smithi189 ceph-mon[32756]: pgmap v8081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:53 smithi156 ceph-mon[32679]: pgmap v8082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:53 smithi092 ceph-mon[29156]: pgmap v8082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:53 smithi189 ceph-mon[32756]: pgmap v8082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14129.516350 secs 2024-04-26T22:13:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13432.488168 secs 2024-04-26T22:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14129.516350 secs 2024-04-26T22:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13432.488168 secs 2024-04-26T22:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14129.516350 secs 2024-04-26T22:13:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13432.488168 secs 2024-04-26T22:13:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:55 smithi156 ceph-mon[32679]: pgmap v8083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:55 smithi092 ceph-mon[29156]: pgmap v8083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:55 smithi189 ceph-mon[32756]: pgmap v8083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:13:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:57 smithi156 ceph-mon[32679]: pgmap v8084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:57 smithi092 ceph-mon[29156]: pgmap v8084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:57 smithi189 ceph-mon[32756]: pgmap v8084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:59 smithi156 ceph-mon[32679]: pgmap v8085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14134.516440 secs 2024-04-26T22:13:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:13:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13437.488312 secs 2024-04-26T22:13:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:59 smithi092 ceph-mon[29156]: pgmap v8085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14134.516440 secs 2024-04-26T22:13:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:13:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13437.488312 secs 2024-04-26T22:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:59 smithi189 ceph-mon[32756]: pgmap v8085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14134.516440 secs 2024-04-26T22:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:13:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13437.488312 secs 2024-04-26T22:14:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:01 smithi156 ceph-mon[32679]: pgmap v8086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:01 smithi092 ceph-mon[29156]: pgmap v8086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:01 smithi189 ceph-mon[32756]: pgmap v8086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:03.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:03 smithi189 ceph-mon[32756]: pgmap v8087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:03 smithi092 ceph-mon[29156]: pgmap v8087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:03 smithi156 ceph-mon[32679]: pgmap v8087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14139.516584 secs 2024-04-26T22:14:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13442.488366 secs 2024-04-26T22:14:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14139.516584 secs 2024-04-26T22:14:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13442.488366 secs 2024-04-26T22:14:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14139.516584 secs 2024-04-26T22:14:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13442.488366 secs 2024-04-26T22:14:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:05 smithi092 ceph-mon[29156]: pgmap v8088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:05 smithi189 ceph-mon[32756]: pgmap v8088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:05 smithi156 ceph-mon[32679]: pgmap v8088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:07 smithi092 ceph-mon[29156]: pgmap v8089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:07 smithi189 ceph-mon[32756]: pgmap v8089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:07 smithi156 ceph-mon[32679]: pgmap v8089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:09 smithi092 ceph-mon[29156]: pgmap v8090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14144.516701 secs 2024-04-26T22:14:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13447.488436 secs 2024-04-26T22:14:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:09 smithi189 ceph-mon[32756]: pgmap v8090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14144.516701 secs 2024-04-26T22:14:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13447.488436 secs 2024-04-26T22:14:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:09 smithi156 ceph-mon[32679]: pgmap v8090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14144.516701 secs 2024-04-26T22:14:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13447.488436 secs 2024-04-26T22:14:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:11 smithi092 ceph-mon[29156]: pgmap v8091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:11 smithi189 ceph-mon[32756]: pgmap v8091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:11 smithi156 ceph-mon[32679]: pgmap v8091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: pgmap v8092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: pgmap v8093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:14:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: pgmap v8094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:14:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: pgmap v8092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: pgmap v8093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: pgmap v8094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:14:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:14:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: pgmap v8092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:14:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:14:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: pgmap v8093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:14:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: pgmap v8094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:14:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:14:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14149.516811 secs 2024-04-26T22:14:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13452.488559 secs 2024-04-26T22:14:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14149.516811 secs 2024-04-26T22:14:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13452.488559 secs 2024-04-26T22:14:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14149.516811 secs 2024-04-26T22:14:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13452.488559 secs 2024-04-26T22:14:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:15 smithi092 ceph-mon[29156]: pgmap v8095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:15 smithi189 ceph-mon[32756]: pgmap v8095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:15 smithi156 ceph-mon[32679]: pgmap v8095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:16 smithi189 ceph-mon[32756]: pgmap v8096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:16 smithi156 ceph-mon[32679]: pgmap v8096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:16 smithi092 ceph-mon[29156]: pgmap v8096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:18 smithi189 ceph-mon[32756]: pgmap v8097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:18 smithi156 ceph-mon[32679]: pgmap v8097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:18 smithi092 ceph-mon[29156]: pgmap v8097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14154.516928 secs 2024-04-26T22:14:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13457.488681 secs 2024-04-26T22:14:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14154.516928 secs 2024-04-26T22:14:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13457.488681 secs 2024-04-26T22:14:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14154.516928 secs 2024-04-26T22:14:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13457.488681 secs 2024-04-26T22:14:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:20 smithi189 ceph-mon[32756]: pgmap v8098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:20 smithi156 ceph-mon[32679]: pgmap v8098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:20 smithi092 ceph-mon[29156]: pgmap v8098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:14:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:22 smithi189 ceph-mon[32756]: pgmap v8099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:14:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:22 smithi156 ceph-mon[32679]: pgmap v8099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:14:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:22 smithi092 ceph-mon[29156]: pgmap v8099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:14:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14159.517064 secs 2024-04-26T22:14:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13462.488803 secs 2024-04-26T22:14:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14159.517064 secs 2024-04-26T22:14:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13462.488803 secs 2024-04-26T22:14:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14159.517064 secs 2024-04-26T22:14:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13462.488803 secs 2024-04-26T22:14:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:25 smithi156 ceph-mon[32679]: pgmap v8100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:25 smithi092 ceph-mon[29156]: pgmap v8100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:25 smithi189 ceph-mon[32756]: pgmap v8100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:26 smithi189 ceph-mon[32756]: pgmap v8101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:26 smithi156 ceph-mon[32679]: pgmap v8101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:26 smithi092 ceph-mon[29156]: pgmap v8101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:28 smithi189 ceph-mon[32756]: pgmap v8102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:28 smithi156 ceph-mon[32679]: pgmap v8102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:28 smithi092 ceph-mon[29156]: pgmap v8102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14164.517175 secs 2024-04-26T22:14:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13467.488885 secs 2024-04-26T22:14:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14164.517175 secs 2024-04-26T22:14:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13467.488885 secs 2024-04-26T22:14:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14164.517175 secs 2024-04-26T22:14:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13467.488885 secs 2024-04-26T22:14:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:30 smithi189 ceph-mon[32756]: pgmap v8103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:30 smithi156 ceph-mon[32679]: pgmap v8103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:30 smithi092 ceph-mon[29156]: pgmap v8103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:32 smithi189 ceph-mon[32756]: pgmap v8104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:32 smithi156 ceph-mon[32679]: pgmap v8104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:32 smithi092 ceph-mon[29156]: pgmap v8104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14169.517296 secs 2024-04-26T22:14:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13472.489000 secs 2024-04-26T22:14:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14169.517296 secs 2024-04-26T22:14:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13472.489000 secs 2024-04-26T22:14:34.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:14:34.537+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:34.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:14:34.537+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:34.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:14:34.537+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:34.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:14:34.537+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:34.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:14:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:14:34.537+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:14:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14169.517296 secs 2024-04-26T22:14:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13472.489000 secs 2024-04-26T22:14:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:35 smithi156 ceph-mon[32679]: pgmap v8105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:35 smithi092 ceph-mon[29156]: pgmap v8105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:35 smithi189 ceph-mon[32756]: pgmap v8105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:14:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:36 smithi189 ceph-mon[32756]: pgmap v8106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:36 smithi156 ceph-mon[32679]: pgmap v8106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:36 smithi092 ceph-mon[29156]: pgmap v8106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:38 smithi189 ceph-mon[32756]: pgmap v8107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:38 smithi156 ceph-mon[32679]: pgmap v8107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:38 smithi092 ceph-mon[29156]: pgmap v8107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14174.517360 secs 2024-04-26T22:14:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13477.489104 secs 2024-04-26T22:14:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14174.517360 secs 2024-04-26T22:14:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13477.489104 secs 2024-04-26T22:14:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14174.517360 secs 2024-04-26T22:14:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13477.489104 secs 2024-04-26T22:14:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:40 smithi189 ceph-mon[32756]: pgmap v8108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:40 smithi156 ceph-mon[32679]: pgmap v8108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:40 smithi092 ceph-mon[29156]: pgmap v8108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:42 smithi189 ceph-mon[32756]: pgmap v8109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:42 smithi156 ceph-mon[32679]: pgmap v8109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:42 smithi092 ceph-mon[29156]: pgmap v8109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14179.517456 secs 2024-04-26T22:14:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13482.489230 secs 2024-04-26T22:14:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14179.517456 secs 2024-04-26T22:14:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13482.489230 secs 2024-04-26T22:14:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14179.517456 secs 2024-04-26T22:14:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13482.489230 secs 2024-04-26T22:14:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:45 smithi156 ceph-mon[32679]: pgmap v8110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:45 smithi092 ceph-mon[29156]: pgmap v8110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:45 smithi189 ceph-mon[32756]: pgmap v8110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:46 smithi189 ceph-mon[32756]: pgmap v8111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:46 smithi156 ceph-mon[32679]: pgmap v8111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:46 smithi092 ceph-mon[29156]: pgmap v8111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:14:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:48 smithi189 ceph-mon[32756]: pgmap v8112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:48 smithi156 ceph-mon[32679]: pgmap v8112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:48 smithi092 ceph-mon[29156]: pgmap v8112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14184.517520 secs 2024-04-26T22:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13487.489345 secs 2024-04-26T22:14:50.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14184.517520 secs 2024-04-26T22:14:50.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13487.489345 secs 2024-04-26T22:14:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14184.517520 secs 2024-04-26T22:14:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13487.489345 secs 2024-04-26T22:14:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:50 smithi189 ceph-mon[32756]: pgmap v8113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:50 smithi156 ceph-mon[32679]: pgmap v8113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:50 smithi092 ceph-mon[29156]: pgmap v8113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:52 smithi189 ceph-mon[32756]: pgmap v8114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:52 smithi156 ceph-mon[32679]: pgmap v8114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:52 smithi092 ceph-mon[29156]: pgmap v8114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:14:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14189.517644 secs 2024-04-26T22:14:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13492.489425 secs 2024-04-26T22:14:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14189.517644 secs 2024-04-26T22:14:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13492.489425 secs 2024-04-26T22:14:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14189.517644 secs 2024-04-26T22:14:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13492.489425 secs 2024-04-26T22:14:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:55 smithi092 ceph-mon[29156]: pgmap v8115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:14:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:55 smithi189 ceph-mon[32756]: pgmap v8115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:14:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:55 smithi156 ceph-mon[32679]: pgmap v8115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:14:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:56 smithi189 ceph-mon[32756]: pgmap v8116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:14:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:56 smithi156 ceph-mon[32679]: pgmap v8116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:14:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:56 smithi092 ceph-mon[29156]: pgmap v8116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:14:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:58 smithi189 ceph-mon[32756]: pgmap v8117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:14:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:58 smithi156 ceph-mon[32679]: pgmap v8117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:14:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:58 smithi092 ceph-mon[29156]: pgmap v8117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:15:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14194.517760 secs 2024-04-26T22:15:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:14:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13497.489550 secs 2024-04-26T22:15:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14194.517760 secs 2024-04-26T22:15:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:14:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13497.489550 secs 2024-04-26T22:15:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14194.517760 secs 2024-04-26T22:15:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:14:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13497.489550 secs 2024-04-26T22:15:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:00 smithi189 ceph-mon[32756]: pgmap v8118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:00 smithi156 ceph-mon[32679]: pgmap v8118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:00 smithi092 ceph-mon[29156]: pgmap v8118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:02 smithi189 ceph-mon[32756]: pgmap v8119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:02 smithi156 ceph-mon[32679]: pgmap v8119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:02 smithi092 ceph-mon[29156]: pgmap v8119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:15:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14199.517878 secs 2024-04-26T22:15:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13502.489676 secs 2024-04-26T22:15:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14199.517878 secs 2024-04-26T22:15:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13502.489676 secs 2024-04-26T22:15:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14199.517878 secs 2024-04-26T22:15:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13502.489676 secs 2024-04-26T22:15:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:05 smithi156 ceph-mon[32679]: pgmap v8120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:15:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:05 smithi092 ceph-mon[29156]: pgmap v8120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:15:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:05 smithi189 ceph-mon[32756]: pgmap v8120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:15:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:06 smithi189 ceph-mon[32756]: pgmap v8121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:06 smithi156 ceph-mon[32679]: pgmap v8121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:06 smithi092 ceph-mon[29156]: pgmap v8121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:08 smithi189 ceph-mon[32756]: pgmap v8122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:08 smithi156 ceph-mon[32679]: pgmap v8122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:08 smithi092 ceph-mon[29156]: pgmap v8122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14204.517975 secs 2024-04-26T22:15:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13507.489767 secs 2024-04-26T22:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14204.517975 secs 2024-04-26T22:15:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13507.489767 secs 2024-04-26T22:15:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14204.517975 secs 2024-04-26T22:15:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13507.489767 secs 2024-04-26T22:15:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:10 smithi189 ceph-mon[32756]: pgmap v8123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:10 smithi156 ceph-mon[32679]: pgmap v8123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:10 smithi092 ceph-mon[29156]: pgmap v8123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:12 smithi189 ceph-mon[32756]: pgmap v8124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:12 smithi156 ceph-mon[32679]: pgmap v8124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:12 smithi092 ceph-mon[29156]: pgmap v8124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14209.518042 secs 2024-04-26T22:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13512.489833 secs 2024-04-26T22:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:14 smithi189 ceph-mon[32756]: pgmap v8125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14209.518042 secs 2024-04-26T22:15:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13512.489833 secs 2024-04-26T22:15:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:14 smithi156 ceph-mon[32679]: pgmap v8125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14209.518042 secs 2024-04-26T22:15:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13512.489833 secs 2024-04-26T22:15:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:14 smithi092 ceph-mon[29156]: pgmap v8125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:15:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:15:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: pgmap v8126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:17 smithi092 ceph-mon[29156]: pgmap v8127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:15:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: pgmap v8126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:17 smithi189 ceph-mon[32756]: pgmap v8127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: pgmap v8126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:17 smithi156 ceph-mon[32679]: pgmap v8127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:19 smithi092 ceph-mon[29156]: pgmap v8128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14214.518162 secs 2024-04-26T22:15:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13517.489952 secs 2024-04-26T22:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:19 smithi189 ceph-mon[32756]: pgmap v8128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14214.518162 secs 2024-04-26T22:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13517.489952 secs 2024-04-26T22:15:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:19 smithi156 ceph-mon[32679]: pgmap v8128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:15:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14214.518162 secs 2024-04-26T22:15:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13517.489952 secs 2024-04-26T22:15:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:21 smithi092 ceph-mon[29156]: pgmap v8129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:21 smithi189 ceph-mon[32756]: pgmap v8129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:21 smithi156 ceph-mon[32679]: pgmap v8129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:23 smithi092 ceph-mon[29156]: pgmap v8130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:23 smithi189 ceph-mon[32756]: pgmap v8130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:23 smithi156 ceph-mon[32679]: pgmap v8130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:25.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14219.518277 secs 2024-04-26T22:15:25.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13522.490088 secs 2024-04-26T22:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14219.518277 secs 2024-04-26T22:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13522.490088 secs 2024-04-26T22:15:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14219.518277 secs 2024-04-26T22:15:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13522.490088 secs 2024-04-26T22:15:26.100 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:25 smithi156 ceph-mon[32679]: pgmap v8131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:25 smithi189 ceph-mon[32756]: pgmap v8131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:25 smithi092 ceph-mon[29156]: pgmap v8131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:15:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:27 smithi189 ceph-mon[32756]: pgmap v8132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:15:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:27 smithi156 ceph-mon[32679]: pgmap v8132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:15:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:27 smithi092 ceph-mon[29156]: pgmap v8132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:29 smithi189 ceph-mon[32756]: pgmap v8133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14224.518395 secs 2024-04-26T22:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13527.490239 secs 2024-04-26T22:15:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:29 smithi156 ceph-mon[32679]: pgmap v8133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14224.518395 secs 2024-04-26T22:15:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13527.490239 secs 2024-04-26T22:15:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:29 smithi092 ceph-mon[29156]: pgmap v8133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14224.518395 secs 2024-04-26T22:15:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13527.490239 secs 2024-04-26T22:15:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:31 smithi189 ceph-mon[32756]: pgmap v8134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:31 smithi156 ceph-mon[32679]: pgmap v8134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:31 smithi092 ceph-mon[29156]: pgmap v8134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:33 smithi189 ceph-mon[32756]: pgmap v8135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:33 smithi156 ceph-mon[32679]: pgmap v8135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:33 smithi092 ceph-mon[29156]: pgmap v8135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:35.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14229.518517 secs 2024-04-26T22:15:35.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13532.490314 secs 2024-04-26T22:15:35.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14229.518517 secs 2024-04-26T22:15:35.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13532.490314 secs 2024-04-26T22:15:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14229.518517 secs 2024-04-26T22:15:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13532.490314 secs 2024-04-26T22:15:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:35 smithi189 ceph-mon[32756]: pgmap v8136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:35 smithi156 ceph-mon[32679]: pgmap v8136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:35 smithi092 ceph-mon[29156]: pgmap v8136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:36 smithi189 ceph-mon[32756]: pgmap v8137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:36 smithi156 ceph-mon[32679]: pgmap v8137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:36 smithi092 ceph-mon[29156]: pgmap v8137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:15:37.932+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:15:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:15:37.932+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:15:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:15:37.932+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:15:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:15:37.932+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 112 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:15:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:39 smithi189 ceph-mon[32756]: pgmap v8138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:39 smithi156 ceph-mon[32679]: pgmap v8138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:39 smithi092 ceph-mon[29156]: pgmap v8138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14234.518644 secs 2024-04-26T22:15:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:40 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 13537.490434 secs 2024-04-26T22:15:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:40 smithi189 ceph-mon[32756]: slow request 364.147235 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:15:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14234.518644 secs 2024-04-26T22:15:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:40 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 13537.490434 secs 2024-04-26T22:15:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:40 smithi156 ceph-mon[32679]: slow request 364.147235 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:15:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14234.518644 secs 2024-04-26T22:15:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:40 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 13537.490434 secs 2024-04-26T22:15:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:40 smithi092 ceph-mon[29156]: slow request 364.147235 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:15:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:41 smithi189 ceph-mon[32756]: pgmap v8139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:41 smithi156 ceph-mon[32679]: pgmap v8139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:41 smithi092 ceph-mon[29156]: pgmap v8139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:43 smithi189 ceph-mon[32756]: pgmap v8140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:43 smithi156 ceph-mon[32679]: pgmap v8140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:43 smithi092 ceph-mon[29156]: pgmap v8140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14239.518760 secs 2024-04-26T22:15:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14239.518760 secs 2024-04-26T22:15:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14239.518760 secs 2024-04-26T22:15:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13542.490514 secs 2024-04-26T22:15:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:45 smithi156 ceph-mon[32679]: pgmap v8141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:45.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13542.490514 secs 2024-04-26T22:15:45.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:45 smithi189 ceph-mon[32756]: pgmap v8141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13542.490514 secs 2024-04-26T22:15:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:45 smithi092 ceph-mon[29156]: pgmap v8141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:47 smithi156 ceph-mon[32679]: pgmap v8142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:47 smithi092 ceph-mon[29156]: pgmap v8142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:47 smithi189 ceph-mon[32756]: pgmap v8142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:49 smithi156 ceph-mon[32679]: pgmap v8143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14244.518873 secs 2024-04-26T22:15:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:49 smithi092 ceph-mon[29156]: pgmap v8143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14244.518873 secs 2024-04-26T22:15:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:49 smithi189 ceph-mon[32756]: pgmap v8143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14244.518873 secs 2024-04-26T22:15:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13547.490607 secs 2024-04-26T22:15:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13547.490607 secs 2024-04-26T22:15:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13547.490607 secs 2024-04-26T22:15:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:51 smithi156 ceph-mon[32679]: pgmap v8144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:51 smithi092 ceph-mon[29156]: pgmap v8144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:51 smithi189 ceph-mon[32756]: pgmap v8144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:53 smithi156 ceph-mon[32679]: pgmap v8145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:53 smithi092 ceph-mon[29156]: pgmap v8145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:53 smithi189 ceph-mon[32756]: pgmap v8145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14249.518916 secs 2024-04-26T22:15:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14249.518916 secs 2024-04-26T22:15:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14249.518916 secs 2024-04-26T22:15:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13552.490712 secs 2024-04-26T22:15:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:55 smithi156 ceph-mon[32679]: pgmap v8146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13552.490712 secs 2024-04-26T22:15:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:55 smithi092 ceph-mon[29156]: pgmap v8146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13552.490712 secs 2024-04-26T22:15:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:55 smithi189 ceph-mon[32756]: pgmap v8146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:15:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:57 smithi156 ceph-mon[32679]: pgmap v8147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:57 smithi092 ceph-mon[29156]: pgmap v8147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:57 smithi189 ceph-mon[32756]: pgmap v8147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:59 smithi156 ceph-mon[32679]: pgmap v8148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:15:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14254.519040 secs 2024-04-26T22:15:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:59 smithi092 ceph-mon[29156]: pgmap v8148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:15:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14254.519040 secs 2024-04-26T22:15:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:59 smithi189 ceph-mon[32756]: pgmap v8148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:15:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:15:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14254.519040 secs 2024-04-26T22:16:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13557.490898 secs 2024-04-26T22:16:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13557.490898 secs 2024-04-26T22:16:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13557.490898 secs 2024-04-26T22:16:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:01 smithi156 ceph-mon[32679]: pgmap v8149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:01 smithi092 ceph-mon[29156]: pgmap v8149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:01 smithi189 ceph-mon[32756]: pgmap v8149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:03 smithi156 ceph-mon[32679]: pgmap v8150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:03 smithi092 ceph-mon[29156]: pgmap v8150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:03 smithi189 ceph-mon[32756]: pgmap v8150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14259.519106 secs 2024-04-26T22:16:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13562.491011 secs 2024-04-26T22:16:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14259.519106 secs 2024-04-26T22:16:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13562.491011 secs 2024-04-26T22:16:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14259.519106 secs 2024-04-26T22:16:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13562.491011 secs 2024-04-26T22:16:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:05 smithi092 ceph-mon[29156]: pgmap v8151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:05.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:05 smithi189 ceph-mon[32756]: pgmap v8151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:05 smithi156 ceph-mon[32679]: pgmap v8151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:07.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:07 smithi092 ceph-mon[29156]: pgmap v8152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:07 smithi189 ceph-mon[32756]: pgmap v8152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:07 smithi156 ceph-mon[32679]: pgmap v8152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:09 smithi092 ceph-mon[29156]: pgmap v8153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14264.519232 secs 2024-04-26T22:16:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13567.491087 secs 2024-04-26T22:16:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:09 smithi189 ceph-mon[32756]: pgmap v8153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14264.519232 secs 2024-04-26T22:16:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13567.491087 secs 2024-04-26T22:16:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:09 smithi156 ceph-mon[32679]: pgmap v8153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14264.519232 secs 2024-04-26T22:16:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13567.491087 secs 2024-04-26T22:16:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:11 smithi092 ceph-mon[29156]: pgmap v8154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:11 smithi189 ceph-mon[32756]: pgmap v8154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:11 smithi156 ceph-mon[32679]: pgmap v8154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:13 smithi092 ceph-mon[29156]: pgmap v8155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:13 smithi189 ceph-mon[32756]: pgmap v8155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:13 smithi156 ceph-mon[32679]: pgmap v8155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14269.519348 secs 2024-04-26T22:16:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13572.491154 secs 2024-04-26T22:16:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14269.519348 secs 2024-04-26T22:16:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13572.491154 secs 2024-04-26T22:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14269.519348 secs 2024-04-26T22:16:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13572.491154 secs 2024-04-26T22:16:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:15 smithi092 ceph-mon[29156]: pgmap v8156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:15 smithi189 ceph-mon[32756]: pgmap v8156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:15 smithi156 ceph-mon[32679]: pgmap v8156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:16:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:17 smithi092 ceph-mon[29156]: pgmap v8157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:16:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:17 smithi189 ceph-mon[32756]: pgmap v8157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:16:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:17 smithi156 ceph-mon[32679]: pgmap v8157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:16:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:16:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:16:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:18 smithi092 ceph-mon[29156]: pgmap v8158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:16:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:18 smithi092 ceph-mon[29156]: pgmap v8159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:18 smithi189 ceph-mon[32756]: pgmap v8158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:16:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:18 smithi189 ceph-mon[32756]: pgmap v8159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:18 smithi156 ceph-mon[32679]: pgmap v8158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:16:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:18 smithi156 ceph-mon[32679]: pgmap v8159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14274.519494 secs 2024-04-26T22:16:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13577.491270 secs 2024-04-26T22:16:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14274.519494 secs 2024-04-26T22:16:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13577.491270 secs 2024-04-26T22:16:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14274.519494 secs 2024-04-26T22:16:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13577.491270 secs 2024-04-26T22:16:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:20 smithi092 ceph-mon[29156]: pgmap v8160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:20 smithi189 ceph-mon[32756]: pgmap v8160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:20 smithi156 ceph-mon[32679]: pgmap v8160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:22 smithi092 ceph-mon[29156]: pgmap v8161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:22 smithi189 ceph-mon[32756]: pgmap v8161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:22 smithi156 ceph-mon[32679]: pgmap v8161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:24 smithi092 ceph-mon[29156]: pgmap v8162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:16:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14279.519630 secs 2024-04-26T22:16:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13582.491385 secs 2024-04-26T22:16:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:24 smithi189 ceph-mon[32756]: pgmap v8162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:16:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14279.519630 secs 2024-04-26T22:16:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13582.491385 secs 2024-04-26T22:16:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:24 smithi156 ceph-mon[32679]: pgmap v8162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:16:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14279.519630 secs 2024-04-26T22:16:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13582.491385 secs 2024-04-26T22:16:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:26 smithi092 ceph-mon[29156]: pgmap v8163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:26 smithi189 ceph-mon[32756]: pgmap v8163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:26 smithi156 ceph-mon[32679]: pgmap v8163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:16:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:28 smithi092 ceph-mon[29156]: pgmap v8164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:16:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:28 smithi189 ceph-mon[32756]: pgmap v8164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:16:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:28 smithi156 ceph-mon[32679]: pgmap v8164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:16:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14284.519742 secs 2024-04-26T22:16:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13587.491510 secs 2024-04-26T22:16:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14284.519742 secs 2024-04-26T22:16:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13587.491510 secs 2024-04-26T22:16:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14284.519742 secs 2024-04-26T22:16:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13587.491510 secs 2024-04-26T22:16:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:30 smithi189 ceph-mon[32756]: pgmap v8165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:30 smithi156 ceph-mon[32679]: pgmap v8165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:30 smithi092 ceph-mon[29156]: pgmap v8165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:32 smithi189 ceph-mon[32756]: pgmap v8166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:32 smithi156 ceph-mon[32679]: pgmap v8166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:32 smithi092 ceph-mon[29156]: pgmap v8166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:34 smithi189 ceph-mon[32756]: pgmap v8167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14289.519863 secs 2024-04-26T22:16:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13592.491634 secs 2024-04-26T22:16:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:34 smithi156 ceph-mon[32679]: pgmap v8167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14289.519863 secs 2024-04-26T22:16:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13592.491634 secs 2024-04-26T22:16:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:34 smithi092 ceph-mon[29156]: pgmap v8167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14289.519863 secs 2024-04-26T22:16:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13592.491634 secs 2024-04-26T22:16:36.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:36 smithi092 ceph-mon[29156]: pgmap v8168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:36 smithi189 ceph-mon[32756]: pgmap v8168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:36 smithi156 ceph-mon[32679]: pgmap v8168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:38 smithi189 ceph-mon[32756]: pgmap v8169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:38 smithi156 ceph-mon[32679]: pgmap v8169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:38.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:38 smithi092 ceph-mon[29156]: pgmap v8169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14294.519987 secs 2024-04-26T22:16:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13597.491754 secs 2024-04-26T22:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14294.519987 secs 2024-04-26T22:16:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13597.491754 secs 2024-04-26T22:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14294.519987 secs 2024-04-26T22:16:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13597.491754 secs 2024-04-26T22:16:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:40 smithi189 ceph-mon[32756]: pgmap v8170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:40 smithi156 ceph-mon[32679]: pgmap v8170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:40 smithi092 ceph-mon[29156]: pgmap v8170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:42 smithi189 ceph-mon[32756]: pgmap v8171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:42 smithi156 ceph-mon[32679]: pgmap v8171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:42 smithi092 ceph-mon[29156]: pgmap v8171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:44 smithi189 ceph-mon[32756]: pgmap v8172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14299.520109 secs 2024-04-26T22:16:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13602.491888 secs 2024-04-26T22:16:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:44 smithi156 ceph-mon[32679]: pgmap v8172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14299.520109 secs 2024-04-26T22:16:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13602.491888 secs 2024-04-26T22:16:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:44 smithi092 ceph-mon[29156]: pgmap v8172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14299.520109 secs 2024-04-26T22:16:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13602.491888 secs 2024-04-26T22:16:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:46 smithi189 ceph-mon[32756]: pgmap v8173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:46 smithi156 ceph-mon[32679]: pgmap v8173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:46 smithi092 ceph-mon[29156]: pgmap v8173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:48 smithi189 ceph-mon[32756]: pgmap v8174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:48 smithi156 ceph-mon[32679]: pgmap v8174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:48 smithi092 ceph-mon[29156]: pgmap v8174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14304.520228 secs 2024-04-26T22:16:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13607.492027 secs 2024-04-26T22:16:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14304.520228 secs 2024-04-26T22:16:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13607.492027 secs 2024-04-26T22:16:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14304.520228 secs 2024-04-26T22:16:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13607.492027 secs 2024-04-26T22:16:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:50 smithi189 ceph-mon[32756]: pgmap v8175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:50 smithi156 ceph-mon[32679]: pgmap v8175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:50 smithi092 ceph-mon[29156]: pgmap v8175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:52 smithi189 ceph-mon[32756]: pgmap v8176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:52 smithi156 ceph-mon[32679]: pgmap v8176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:52 smithi092 ceph-mon[29156]: pgmap v8176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:54.845 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:54 smithi092 ceph-mon[29156]: pgmap v8177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:54.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14309.520352 secs 2024-04-26T22:16:54.846 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13612.492164 secs 2024-04-26T22:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:54 smithi189 ceph-mon[32756]: pgmap v8177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14309.520352 secs 2024-04-26T22:16:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13612.492164 secs 2024-04-26T22:16:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:54 smithi156 ceph-mon[32679]: pgmap v8177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14309.520352 secs 2024-04-26T22:16:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13612.492164 secs 2024-04-26T22:16:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:56 smithi189 ceph-mon[32756]: pgmap v8178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:56 smithi156 ceph-mon[32679]: pgmap v8178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:56 smithi092 ceph-mon[29156]: pgmap v8178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:16:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:58 smithi189 ceph-mon[32756]: pgmap v8179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:58 smithi156 ceph-mon[32679]: pgmap v8179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:58 smithi092 ceph-mon[29156]: pgmap v8179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14314.520476 secs 2024-04-26T22:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:16:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13617.492291 secs 2024-04-26T22:16:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14314.520476 secs 2024-04-26T22:16:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:16:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13617.492291 secs 2024-04-26T22:16:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14314.520476 secs 2024-04-26T22:16:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:16:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13617.492291 secs 2024-04-26T22:17:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:00 smithi189 ceph-mon[32756]: pgmap v8180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:00 smithi156 ceph-mon[32679]: pgmap v8180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:00 smithi092 ceph-mon[29156]: pgmap v8180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:02 smithi189 ceph-mon[32756]: pgmap v8181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:02.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:02 smithi156 ceph-mon[32679]: pgmap v8181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:02 smithi092 ceph-mon[29156]: pgmap v8181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:04 smithi189 ceph-mon[32756]: pgmap v8182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14319.520597 secs 2024-04-26T22:17:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13622.492428 secs 2024-04-26T22:17:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:04 smithi156 ceph-mon[32679]: pgmap v8182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14319.520597 secs 2024-04-26T22:17:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13622.492428 secs 2024-04-26T22:17:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:04 smithi092 ceph-mon[29156]: pgmap v8182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14319.520597 secs 2024-04-26T22:17:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13622.492428 secs 2024-04-26T22:17:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:06 smithi189 ceph-mon[32756]: pgmap v8183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:06 smithi156 ceph-mon[32679]: pgmap v8183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:06 smithi092 ceph-mon[29156]: pgmap v8183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:08 smithi189 ceph-mon[32756]: pgmap v8184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:08 smithi156 ceph-mon[32679]: pgmap v8184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:08 smithi092 ceph-mon[29156]: pgmap v8184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14324.520716 secs 2024-04-26T22:17:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13627.492517 secs 2024-04-26T22:17:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14324.520716 secs 2024-04-26T22:17:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13627.492517 secs 2024-04-26T22:17:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14324.520716 secs 2024-04-26T22:17:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13627.492517 secs 2024-04-26T22:17:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:10 smithi189 ceph-mon[32756]: pgmap v8185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:10 smithi156 ceph-mon[32679]: pgmap v8185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:10 smithi092 ceph-mon[29156]: pgmap v8185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:12 smithi189 ceph-mon[32756]: pgmap v8186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:12 smithi156 ceph-mon[32679]: pgmap v8186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:12 smithi092 ceph-mon[29156]: pgmap v8186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:14 smithi189 ceph-mon[32756]: pgmap v8187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14329.520852 secs 2024-04-26T22:17:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13632.492598 secs 2024-04-26T22:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:14 smithi156 ceph-mon[32679]: pgmap v8187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14329.520852 secs 2024-04-26T22:17:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13632.492598 secs 2024-04-26T22:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:14 smithi092 ceph-mon[29156]: pgmap v8187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14329.520852 secs 2024-04-26T22:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13632.492598 secs 2024-04-26T22:17:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:16 smithi189 ceph-mon[32756]: pgmap v8188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:16 smithi156 ceph-mon[32679]: pgmap v8188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:16 smithi092 ceph-mon[29156]: pgmap v8188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:17:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:18 smithi189 ceph-mon[32756]: pgmap v8189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:17:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:18 smithi156 ceph-mon[32679]: pgmap v8189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:17:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:18 smithi092 ceph-mon[29156]: pgmap v8189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:17:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:17:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:17:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:19 smithi189 ceph-mon[32756]: pgmap v8190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:17:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:19 smithi189 ceph-mon[32756]: pgmap v8191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14334.520960 secs 2024-04-26T22:17:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13637.492720 secs 2024-04-26T22:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:19 smithi156 ceph-mon[32679]: pgmap v8190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:19 smithi156 ceph-mon[32679]: pgmap v8191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14334.520960 secs 2024-04-26T22:17:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13637.492720 secs 2024-04-26T22:17:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:19 smithi092 ceph-mon[29156]: pgmap v8190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:17:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:19 smithi092 ceph-mon[29156]: pgmap v8191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:17:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14334.520960 secs 2024-04-26T22:17:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13637.492720 secs 2024-04-26T22:17:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:21 smithi189 ceph-mon[32756]: pgmap v8192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:21 smithi156 ceph-mon[32679]: pgmap v8192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:21 smithi092 ceph-mon[29156]: pgmap v8192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:23 smithi189 ceph-mon[32756]: pgmap v8193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:23 smithi156 ceph-mon[32679]: pgmap v8193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:23 smithi092 ceph-mon[29156]: pgmap v8193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14339.521023 secs 2024-04-26T22:17:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13642.492847 secs 2024-04-26T22:17:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14339.521023 secs 2024-04-26T22:17:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13642.492847 secs 2024-04-26T22:17:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14339.521023 secs 2024-04-26T22:17:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13642.492847 secs 2024-04-26T22:17:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:25 smithi189 ceph-mon[32756]: pgmap v8194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:25.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:25 smithi092 ceph-mon[29156]: pgmap v8194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:25 smithi156 ceph-mon[32679]: pgmap v8194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:27 smithi189 ceph-mon[32756]: pgmap v8195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:27 smithi156 ceph-mon[32679]: pgmap v8195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:27 smithi092 ceph-mon[29156]: pgmap v8195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:17:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:29 smithi189 ceph-mon[32756]: pgmap v8196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:17:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14344.521136 secs 2024-04-26T22:17:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13647.492970 secs 2024-04-26T22:17:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:29 smithi156 ceph-mon[32679]: pgmap v8196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:17:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14344.521136 secs 2024-04-26T22:17:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13647.492970 secs 2024-04-26T22:17:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:29 smithi092 ceph-mon[29156]: pgmap v8196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:17:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14344.521136 secs 2024-04-26T22:17:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13647.492970 secs 2024-04-26T22:17:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:31 smithi189 ceph-mon[32756]: pgmap v8197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:31 smithi156 ceph-mon[32679]: pgmap v8197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:31 smithi092 ceph-mon[29156]: pgmap v8197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:33 smithi189 ceph-mon[32756]: pgmap v8198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:33 smithi156 ceph-mon[32679]: pgmap v8198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:33 smithi092 ceph-mon[29156]: pgmap v8198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14349.521280 secs 2024-04-26T22:17:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13652.493033 secs 2024-04-26T22:17:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14349.521280 secs 2024-04-26T22:17:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13652.493033 secs 2024-04-26T22:17:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14349.521280 secs 2024-04-26T22:17:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13652.493033 secs 2024-04-26T22:17:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:35 smithi156 ceph-mon[32679]: pgmap v8199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:35 smithi092 ceph-mon[29156]: pgmap v8199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:36.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:35 smithi189 ceph-mon[32756]: pgmap v8199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:37 smithi156 ceph-mon[32679]: pgmap v8200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:37 smithi092 ceph-mon[29156]: pgmap v8200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:37 smithi189 ceph-mon[32756]: pgmap v8200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:39 smithi156 ceph-mon[32679]: pgmap v8201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14354.521416 secs 2024-04-26T22:17:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13657.493159 secs 2024-04-26T22:17:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:39 smithi092 ceph-mon[29156]: pgmap v8201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14354.521416 secs 2024-04-26T22:17:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13657.493159 secs 2024-04-26T22:17:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:39 smithi189 ceph-mon[32756]: pgmap v8201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14354.521416 secs 2024-04-26T22:17:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13657.493159 secs 2024-04-26T22:17:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:41 smithi156 ceph-mon[32679]: pgmap v8202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:41 smithi092 ceph-mon[29156]: pgmap v8202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:41 smithi189 ceph-mon[32756]: pgmap v8202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:43 smithi156 ceph-mon[32679]: pgmap v8203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:43 smithi092 ceph-mon[29156]: pgmap v8203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:43 smithi189 ceph-mon[32756]: pgmap v8203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14359.521582 secs 2024-04-26T22:17:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13662.493286 secs 2024-04-26T22:17:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14359.521582 secs 2024-04-26T22:17:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13662.493286 secs 2024-04-26T22:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14359.521582 secs 2024-04-26T22:17:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13662.493286 secs 2024-04-26T22:17:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:45 smithi156 ceph-mon[32679]: pgmap v8204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:45 smithi092 ceph-mon[29156]: pgmap v8204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:45 smithi189 ceph-mon[32756]: pgmap v8204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:47 smithi156 ceph-mon[32679]: pgmap v8205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:47 smithi092 ceph-mon[29156]: pgmap v8205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:47 smithi189 ceph-mon[32756]: pgmap v8205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:49 smithi156 ceph-mon[32679]: pgmap v8206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14364.521703 secs 2024-04-26T22:17:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13667.493410 secs 2024-04-26T22:17:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:49 smithi092 ceph-mon[29156]: pgmap v8206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14364.521703 secs 2024-04-26T22:17:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13667.493410 secs 2024-04-26T22:17:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:49 smithi189 ceph-mon[32756]: pgmap v8206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14364.521703 secs 2024-04-26T22:17:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13667.493410 secs 2024-04-26T22:17:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:51 smithi156 ceph-mon[32679]: pgmap v8207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:51 smithi092 ceph-mon[29156]: pgmap v8207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:51 smithi189 ceph-mon[32756]: pgmap v8207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:17:52.951+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:17:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:17:52.951+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:17:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:17:52.951+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:17:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:17:52.951+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 113 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:17:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:53 smithi156 ceph-mon[32679]: pgmap v8208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:53 smithi092 ceph-mon[29156]: pgmap v8208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:53 smithi189 ceph-mon[32756]: pgmap v8208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14369.521791 secs 2024-04-26T22:17:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13672.493522 secs 2024-04-26T22:17:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14369.521791 secs 2024-04-26T22:17:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13672.493522 secs 2024-04-26T22:17:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14369.521791 secs 2024-04-26T22:17:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13672.493522 secs 2024-04-26T22:17:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:55 smithi092 ceph-mon[29156]: pgmap v8209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:55 smithi189 ceph-mon[32756]: pgmap v8209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:55 smithi156 ceph-mon[32679]: pgmap v8209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:17:57.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:57 smithi156 ceph-mon[32679]: pgmap v8210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:57 smithi092 ceph-mon[29156]: pgmap v8210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:57 smithi189 ceph-mon[32756]: pgmap v8210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:59 smithi092 ceph-mon[29156]: pgmap v8211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:17:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14374.521859 secs 2024-04-26T22:17:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:17:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13677.493642 secs 2024-04-26T22:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:59 smithi189 ceph-mon[32756]: pgmap v8211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14374.521859 secs 2024-04-26T22:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:17:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13677.493642 secs 2024-04-26T22:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:59 smithi156 ceph-mon[32679]: pgmap v8211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14374.521859 secs 2024-04-26T22:18:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:17:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13677.493642 secs 2024-04-26T22:18:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:01 smithi092 ceph-mon[29156]: pgmap v8212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:01 smithi189 ceph-mon[32756]: pgmap v8212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:01 smithi156 ceph-mon[32679]: pgmap v8212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:03 smithi092 ceph-mon[29156]: pgmap v8213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:03 smithi189 ceph-mon[32756]: pgmap v8213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:03 smithi156 ceph-mon[32679]: pgmap v8213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14379.522010 secs 2024-04-26T22:18:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13682.493759 secs 2024-04-26T22:18:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14379.522010 secs 2024-04-26T22:18:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13682.493759 secs 2024-04-26T22:18:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14379.522010 secs 2024-04-26T22:18:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13682.493759 secs 2024-04-26T22:18:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:05 smithi092 ceph-mon[29156]: pgmap v8214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:06.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:05 smithi189 ceph-mon[32756]: pgmap v8214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:05 smithi156 ceph-mon[32679]: pgmap v8214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:07 smithi092 ceph-mon[29156]: pgmap v8215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:07 smithi189 ceph-mon[32756]: pgmap v8215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:07 smithi156 ceph-mon[32679]: pgmap v8215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:09 smithi092 ceph-mon[29156]: pgmap v8216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14384.522135 secs 2024-04-26T22:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13687.493877 secs 2024-04-26T22:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:09 smithi189 ceph-mon[32756]: pgmap v8216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14384.522135 secs 2024-04-26T22:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13687.493877 secs 2024-04-26T22:18:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:09 smithi156 ceph-mon[32679]: pgmap v8216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14384.522135 secs 2024-04-26T22:18:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13687.493877 secs 2024-04-26T22:18:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:11 smithi092 ceph-mon[29156]: pgmap v8217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:11 smithi189 ceph-mon[32756]: pgmap v8217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:11 smithi156 ceph-mon[32679]: pgmap v8217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:13 smithi092 ceph-mon[29156]: pgmap v8218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:13 smithi189 ceph-mon[32756]: pgmap v8218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:13 smithi156 ceph-mon[32679]: pgmap v8218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14389.522259 secs 2024-04-26T22:18:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13692.494008 secs 2024-04-26T22:18:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14389.522259 secs 2024-04-26T22:18:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13692.494008 secs 2024-04-26T22:18:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14389.522259 secs 2024-04-26T22:18:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13692.494008 secs 2024-04-26T22:18:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:15 smithi092 ceph-mon[29156]: pgmap v8219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:15 smithi189 ceph-mon[32756]: pgmap v8219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:15 smithi156 ceph-mon[32679]: pgmap v8219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:17 smithi092 ceph-mon[29156]: pgmap v8220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:17 smithi189 ceph-mon[32756]: pgmap v8220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:17 smithi156 ceph-mon[32679]: pgmap v8220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:18:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:18:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:18:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:18:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:18:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:18:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:19 smithi092 ceph-mon[29156]: pgmap v8221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14394.522344 secs 2024-04-26T22:18:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13697.494096 secs 2024-04-26T22:18:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:19 smithi092 ceph-mon[29156]: pgmap v8222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:18:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:19 smithi092 ceph-mon[29156]: pgmap v8223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:19 smithi189 ceph-mon[32756]: pgmap v8221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14394.522344 secs 2024-04-26T22:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13697.494096 secs 2024-04-26T22:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:19 smithi189 ceph-mon[32756]: pgmap v8222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:19 smithi189 ceph-mon[32756]: pgmap v8223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:19 smithi156 ceph-mon[32679]: pgmap v8221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14394.522344 secs 2024-04-26T22:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13697.494096 secs 2024-04-26T22:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:19 smithi156 ceph-mon[32679]: pgmap v8222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:19 smithi156 ceph-mon[32679]: pgmap v8223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:21 smithi092 ceph-mon[29156]: pgmap v8224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:21 smithi189 ceph-mon[32756]: pgmap v8224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:21 smithi156 ceph-mon[32679]: pgmap v8224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:23 smithi092 ceph-mon[29156]: pgmap v8225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:23 smithi189 ceph-mon[32756]: pgmap v8225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:23 smithi156 ceph-mon[32679]: pgmap v8225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:18:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14399.522464 secs 2024-04-26T22:18:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13702.494187 secs 2024-04-26T22:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14399.522464 secs 2024-04-26T22:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13702.494187 secs 2024-04-26T22:18:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14399.522464 secs 2024-04-26T22:18:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13702.494187 secs 2024-04-26T22:18:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:25 smithi189 ceph-mon[32756]: pgmap v8226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:25 smithi156 ceph-mon[32679]: pgmap v8226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:25 smithi092 ceph-mon[29156]: pgmap v8226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:27 smithi092 ceph-mon[29156]: pgmap v8227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:27 smithi189 ceph-mon[32756]: pgmap v8227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:27 smithi156 ceph-mon[32679]: pgmap v8227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:18:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14404.522584 secs 2024-04-26T22:18:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13707.494323 secs 2024-04-26T22:18:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:29 smithi189 ceph-mon[32756]: pgmap v8228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:18:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14404.522584 secs 2024-04-26T22:18:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13707.494323 secs 2024-04-26T22:18:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:29 smithi156 ceph-mon[32679]: pgmap v8228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14404.522584 secs 2024-04-26T22:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13707.494323 secs 2024-04-26T22:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:29 smithi092 ceph-mon[29156]: pgmap v8228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:18:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:31 smithi189 ceph-mon[32756]: pgmap v8229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:31 smithi156 ceph-mon[32679]: pgmap v8229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:31 smithi092 ceph-mon[29156]: pgmap v8229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:33 smithi189 ceph-mon[32756]: pgmap v8230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:33 smithi156 ceph-mon[32679]: pgmap v8230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:33 smithi092 ceph-mon[29156]: pgmap v8230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14409.522704 secs 2024-04-26T22:18:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13712.494464 secs 2024-04-26T22:18:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14409.522704 secs 2024-04-26T22:18:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13712.494464 secs 2024-04-26T22:18:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14409.522704 secs 2024-04-26T22:18:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13712.494464 secs 2024-04-26T22:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca808a050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca808a050 comp rx=0 tx=0).stop 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.012+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.013+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:18:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:18:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:18:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:18:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=14 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:18:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:18:36.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:35 smithi189 ceph-mon[32756]: pgmap v8231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T22:18:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:36.038+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T22:18:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:35 smithi156 ceph-mon[32679]: pgmap v8231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:35 smithi092 ceph-mon[29156]: pgmap v8231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:37.958+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:18:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:37.958+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:18:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:37.958+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:18:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:18:37.958+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 114 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:18:38.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:37 smithi092 ceph-mon[29156]: pgmap v8232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:37 smithi189 ceph-mon[32756]: pgmap v8232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:37 smithi156 ceph-mon[32679]: pgmap v8232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14414.522851 secs 2024-04-26T22:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13717.494599 secs 2024-04-26T22:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:39 smithi189 ceph-mon[32756]: pgmap v8233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14414.522851 secs 2024-04-26T22:18:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13717.494599 secs 2024-04-26T22:18:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:39 smithi156 ceph-mon[32679]: pgmap v8233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14414.522851 secs 2024-04-26T22:18:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13717.494599 secs 2024-04-26T22:18:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:39 smithi092 ceph-mon[29156]: pgmap v8233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:41 smithi189 ceph-mon[32756]: pgmap v8234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:41 smithi156 ceph-mon[32679]: pgmap v8234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:41 smithi092 ceph-mon[29156]: pgmap v8234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:43 smithi189 ceph-mon[32756]: pgmap v8235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:43 smithi156 ceph-mon[32679]: pgmap v8235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:43 smithi092 ceph-mon[29156]: pgmap v8235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14419.522913 secs 2024-04-26T22:18:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13722.494686 secs 2024-04-26T22:18:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14419.522913 secs 2024-04-26T22:18:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13722.494686 secs 2024-04-26T22:18:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14419.522913 secs 2024-04-26T22:18:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13722.494686 secs 2024-04-26T22:18:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:45 smithi189 ceph-mon[32756]: pgmap v8236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:45 smithi156 ceph-mon[32679]: pgmap v8236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:45 smithi092 ceph-mon[29156]: pgmap v8236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:47 smithi189 ceph-mon[32756]: pgmap v8237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:47 smithi156 ceph-mon[32679]: pgmap v8237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:47 smithi092 ceph-mon[29156]: pgmap v8237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14424.523023 secs 2024-04-26T22:18:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13727.494790 secs 2024-04-26T22:18:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:49 smithi189 ceph-mon[32756]: pgmap v8238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14424.523023 secs 2024-04-26T22:18:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13727.494790 secs 2024-04-26T22:18:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:49 smithi156 ceph-mon[32679]: pgmap v8238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14424.523023 secs 2024-04-26T22:18:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13727.494790 secs 2024-04-26T22:18:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:49 smithi092 ceph-mon[29156]: pgmap v8238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:51 smithi189 ceph-mon[32756]: pgmap v8239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:51 smithi156 ceph-mon[32679]: pgmap v8239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:51 smithi092 ceph-mon[29156]: pgmap v8239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:52 smithi189 ceph-mon[32756]: pgmap v8240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:52 smithi156 ceph-mon[32679]: pgmap v8240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:52 smithi092 ceph-mon[29156]: pgmap v8240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14429.523113 secs 2024-04-26T22:18:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13732.494930 secs 2024-04-26T22:18:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14429.523113 secs 2024-04-26T22:18:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13732.494930 secs 2024-04-26T22:18:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14429.523113 secs 2024-04-26T22:18:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13732.494930 secs 2024-04-26T22:18:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:55 smithi092 ceph-mon[29156]: pgmap v8241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:55 smithi189 ceph-mon[32756]: pgmap v8241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:55 smithi156 ceph-mon[32679]: pgmap v8241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:18:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:57 smithi189 ceph-mon[32756]: pgmap v8242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:57 smithi156 ceph-mon[32679]: pgmap v8242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:18:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:57 smithi092 ceph-mon[29156]: pgmap v8242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14434.523233 secs 2024-04-26T22:19:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13737.495065 secs 2024-04-26T22:19:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:18:59 smithi189 ceph-mon[32756]: pgmap v8243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14434.523233 secs 2024-04-26T22:19:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13737.495065 secs 2024-04-26T22:19:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:18:59 smithi156 ceph-mon[32679]: pgmap v8243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14434.523233 secs 2024-04-26T22:19:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13737.495065 secs 2024-04-26T22:19:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:18:59 smithi092 ceph-mon[29156]: pgmap v8243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:01 smithi189 ceph-mon[32756]: pgmap v8244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:01 smithi156 ceph-mon[32679]: pgmap v8244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:01 smithi092 ceph-mon[29156]: pgmap v8244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:03 smithi189 ceph-mon[32756]: pgmap v8245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:03 smithi156 ceph-mon[32679]: pgmap v8245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:03 smithi092 ceph-mon[29156]: pgmap v8245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14439.523372 secs 2024-04-26T22:19:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13742.495131 secs 2024-04-26T22:19:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14439.523372 secs 2024-04-26T22:19:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13742.495131 secs 2024-04-26T22:19:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14439.523372 secs 2024-04-26T22:19:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13742.495131 secs 2024-04-26T22:19:06.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:05 smithi189 ceph-mon[32756]: pgmap v8246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:05 smithi156 ceph-mon[32679]: pgmap v8246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:05 smithi092 ceph-mon[29156]: pgmap v8246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:08.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:07 smithi092 ceph-mon[29156]: pgmap v8247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:07 smithi189 ceph-mon[32756]: pgmap v8247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:07 smithi156 ceph-mon[32679]: pgmap v8247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14444.523486 secs 2024-04-26T22:19:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13747.495257 secs 2024-04-26T22:19:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:09 smithi189 ceph-mon[32756]: pgmap v8248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14444.523486 secs 2024-04-26T22:19:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13747.495257 secs 2024-04-26T22:19:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:09 smithi156 ceph-mon[32679]: pgmap v8248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14444.523486 secs 2024-04-26T22:19:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13747.495257 secs 2024-04-26T22:19:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:09 smithi092 ceph-mon[29156]: pgmap v8248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:11 smithi189 ceph-mon[32756]: pgmap v8249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:11 smithi156 ceph-mon[32679]: pgmap v8249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:11 smithi092 ceph-mon[29156]: pgmap v8249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:13 smithi189 ceph-mon[32756]: pgmap v8250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:13 smithi156 ceph-mon[32679]: pgmap v8250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:13 smithi092 ceph-mon[29156]: pgmap v8250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14449.523622 secs 2024-04-26T22:19:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13752.495376 secs 2024-04-26T22:19:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14449.523622 secs 2024-04-26T22:19:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13752.495376 secs 2024-04-26T22:19:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14449.523622 secs 2024-04-26T22:19:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13752.495376 secs 2024-04-26T22:19:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:15 smithi189 ceph-mon[32756]: pgmap v8251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:15 smithi156 ceph-mon[32679]: pgmap v8251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:15 smithi092 ceph-mon[29156]: pgmap v8251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:17 smithi189 ceph-mon[32756]: pgmap v8252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:17 smithi156 ceph-mon[32679]: pgmap v8252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:17 smithi092 ceph-mon[29156]: pgmap v8252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14454.523738 secs 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13757.495495 secs 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: pgmap v8253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14454.523738 secs 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13757.495495 secs 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: pgmap v8253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14454.523738 secs 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13757.495495 secs 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: pgmap v8253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:19:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:20 smithi189 ceph-mon[32756]: pgmap v8254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:19:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:20 smithi189 ceph-mon[32756]: pgmap v8255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:20 smithi156 ceph-mon[32679]: pgmap v8254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:19:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:20 smithi156 ceph-mon[32679]: pgmap v8255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:20 smithi092 ceph-mon[29156]: pgmap v8254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:19:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:20 smithi092 ceph-mon[29156]: pgmap v8255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:22 smithi189 ceph-mon[32756]: pgmap v8256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:22 smithi156 ceph-mon[32679]: pgmap v8256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:22 smithi092 ceph-mon[29156]: pgmap v8256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14459.523886 secs 2024-04-26T22:19:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:24 smithi189 ceph-mon[32756]: pgmap v8257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13762.495618 secs 2024-04-26T22:19:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14459.523886 secs 2024-04-26T22:19:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:24 smithi156 ceph-mon[32679]: pgmap v8257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13762.495618 secs 2024-04-26T22:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14459.523886 secs 2024-04-26T22:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:24 smithi092 ceph-mon[29156]: pgmap v8257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13762.495618 secs 2024-04-26T22:19:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:25 smithi189 ceph-mon[32756]: pgmap v8258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:25 smithi156 ceph-mon[32679]: pgmap v8258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:25 smithi092 ceph-mon[29156]: pgmap v8258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:19:28.887 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:28 smithi156 ceph-mon[32679]: pgmap v8259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:28 smithi189 ceph-mon[32756]: pgmap v8259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:28 smithi092 ceph-mon[29156]: pgmap v8259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:19:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14464.523969 secs 2024-04-26T22:19:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13767.495742 secs 2024-04-26T22:19:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14464.523969 secs 2024-04-26T22:19:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13767.495742 secs 2024-04-26T22:19:29.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14464.523969 secs 2024-04-26T22:19:29.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13767.495742 secs 2024-04-26T22:19:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:30 smithi189 ceph-mon[32756]: pgmap v8260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:19:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:30 smithi156 ceph-mon[32679]: pgmap v8260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:19:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:30 smithi092 ceph-mon[29156]: pgmap v8260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:19:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:32 smithi189 ceph-mon[32756]: pgmap v8261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:32 smithi156 ceph-mon[32679]: pgmap v8261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:32 smithi092 ceph-mon[29156]: pgmap v8261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14469.524047 secs 2024-04-26T22:19:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:34 smithi189 ceph-mon[32756]: pgmap v8262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13772.495870 secs 2024-04-26T22:19:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14469.524047 secs 2024-04-26T22:19:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:34 smithi156 ceph-mon[32679]: pgmap v8262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13772.495870 secs 2024-04-26T22:19:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14469.524047 secs 2024-04-26T22:19:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:34 smithi092 ceph-mon[29156]: pgmap v8262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13772.495870 secs 2024-04-26T22:19:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:36 smithi189 ceph-mon[32756]: pgmap v8263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:36 smithi156 ceph-mon[32679]: pgmap v8263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:36 smithi092 ceph-mon[29156]: pgmap v8263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:38 smithi189 ceph-mon[32756]: pgmap v8264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:38 smithi156 ceph-mon[32679]: pgmap v8264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:38 smithi092 ceph-mon[29156]: pgmap v8264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14474.524163 secs 2024-04-26T22:19:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13777.496011 secs 2024-04-26T22:19:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14474.524163 secs 2024-04-26T22:19:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13777.496011 secs 2024-04-26T22:19:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14474.524163 secs 2024-04-26T22:19:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13777.496011 secs 2024-04-26T22:19:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:40 smithi189 ceph-mon[32756]: pgmap v8265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:40 smithi156 ceph-mon[32679]: pgmap v8265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:40 smithi092 ceph-mon[29156]: pgmap v8265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:42 smithi189 ceph-mon[32756]: pgmap v8266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:42 smithi156 ceph-mon[32679]: pgmap v8266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:42 smithi092 ceph-mon[29156]: pgmap v8266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14479.524281 secs 2024-04-26T22:19:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:44 smithi189 ceph-mon[32756]: pgmap v8267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13782.496101 secs 2024-04-26T22:19:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14479.524281 secs 2024-04-26T22:19:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:44 smithi156 ceph-mon[32679]: pgmap v8267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13782.496101 secs 2024-04-26T22:19:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14479.524281 secs 2024-04-26T22:19:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:44 smithi092 ceph-mon[29156]: pgmap v8267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13782.496101 secs 2024-04-26T22:19:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:46 smithi189 ceph-mon[32756]: pgmap v8268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:46 smithi156 ceph-mon[32679]: pgmap v8268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:46 smithi092 ceph-mon[29156]: pgmap v8268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:48 smithi189 ceph-mon[32756]: pgmap v8269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:48 smithi156 ceph-mon[32679]: pgmap v8269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:48 smithi092 ceph-mon[29156]: pgmap v8269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:19:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14484.524377 secs 2024-04-26T22:19:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13787.496166 secs 2024-04-26T22:19:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14484.524377 secs 2024-04-26T22:19:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13787.496166 secs 2024-04-26T22:19:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14484.524377 secs 2024-04-26T22:19:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13787.496166 secs 2024-04-26T22:19:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:50 smithi189 ceph-mon[32756]: pgmap v8270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:50 smithi156 ceph-mon[32679]: pgmap v8270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:50 smithi092 ceph-mon[29156]: pgmap v8270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:19:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:52 smithi189 ceph-mon[32756]: pgmap v8271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:52 smithi156 ceph-mon[32679]: pgmap v8271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:52 smithi092 ceph-mon[29156]: pgmap v8271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14489.524512 secs 2024-04-26T22:19:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:54 smithi189 ceph-mon[32756]: pgmap v8272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13792.496289 secs 2024-04-26T22:19:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14489.524512 secs 2024-04-26T22:19:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:54 smithi156 ceph-mon[32679]: pgmap v8272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13792.496289 secs 2024-04-26T22:19:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14489.524512 secs 2024-04-26T22:19:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:54 smithi092 ceph-mon[29156]: pgmap v8272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:19:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13792.496289 secs 2024-04-26T22:19:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:56 smithi189 ceph-mon[32756]: pgmap v8273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:56 smithi156 ceph-mon[32679]: pgmap v8273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:56 smithi092 ceph-mon[29156]: pgmap v8273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:58 smithi189 ceph-mon[32756]: pgmap v8274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:58 smithi156 ceph-mon[32679]: pgmap v8274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:58 smithi092 ceph-mon[29156]: pgmap v8274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:19:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14494.524619 secs 2024-04-26T22:19:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:19:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13797.496383 secs 2024-04-26T22:19:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14494.524619 secs 2024-04-26T22:19:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:19:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13797.496383 secs 2024-04-26T22:19:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14494.524619 secs 2024-04-26T22:19:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:19:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13797.496383 secs 2024-04-26T22:20:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:00 smithi189 ceph-mon[32756]: pgmap v8275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:20:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:00 smithi156 ceph-mon[32679]: pgmap v8275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:20:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:00 smithi092 ceph-mon[29156]: pgmap v8275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:20:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:02 smithi189 ceph-mon[32756]: pgmap v8276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:02 smithi156 ceph-mon[32679]: pgmap v8276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:02 smithi092 ceph-mon[29156]: pgmap v8276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14499.524743 secs 2024-04-26T22:20:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:04 smithi189 ceph-mon[32756]: pgmap v8277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13802.496472 secs 2024-04-26T22:20:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14499.524743 secs 2024-04-26T22:20:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:04 smithi156 ceph-mon[32679]: pgmap v8277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13802.496472 secs 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14499.524743 secs 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-mon[29156]: pgmap v8277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13802.496472 secs 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:20:04.656+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:20:04.656+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:20:04.656+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:20:04.656+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:20:04.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:20:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:20:04.656+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:20:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:06 smithi189 ceph-mon[32756]: pgmap v8278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:06 smithi156 ceph-mon[32679]: pgmap v8278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:06 smithi092 ceph-mon[29156]: pgmap v8278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:08 smithi189 ceph-mon[32756]: pgmap v8279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:08 smithi156 ceph-mon[32679]: pgmap v8279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:08 smithi092 ceph-mon[29156]: pgmap v8279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14504.524893 secs 2024-04-26T22:20:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13807.496587 secs 2024-04-26T22:20:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14504.524893 secs 2024-04-26T22:20:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13807.496587 secs 2024-04-26T22:20:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14504.524893 secs 2024-04-26T22:20:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13807.496587 secs 2024-04-26T22:20:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:10 smithi156 ceph-mon[32679]: pgmap v8280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:10 smithi092 ceph-mon[29156]: pgmap v8280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:10 smithi189 ceph-mon[32756]: pgmap v8280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:12 smithi156 ceph-mon[32679]: pgmap v8281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:12 smithi092 ceph-mon[29156]: pgmap v8281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:12 smithi189 ceph-mon[32756]: pgmap v8281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:13 smithi092 ceph-mon[29156]: pgmap v8282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:13 smithi189 ceph-mon[32756]: pgmap v8282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:13 smithi156 ceph-mon[32679]: pgmap v8282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14509.524970 secs 2024-04-26T22:20:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13812.496709 secs 2024-04-26T22:20:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14509.524970 secs 2024-04-26T22:20:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13812.496709 secs 2024-04-26T22:20:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14509.524970 secs 2024-04-26T22:20:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13812.496709 secs 2024-04-26T22:20:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:15 smithi092 ceph-mon[29156]: pgmap v8283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:15 smithi189 ceph-mon[32756]: pgmap v8283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:15 smithi156 ceph-mon[32679]: pgmap v8283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:18 smithi189 ceph-mon[32756]: pgmap v8284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:18 smithi156 ceph-mon[32679]: pgmap v8284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:18 smithi092 ceph-mon[29156]: pgmap v8284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:20:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14514.525034 secs 2024-04-26T22:20:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13817.496835 secs 2024-04-26T22:20:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14514.525034 secs 2024-04-26T22:20:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13817.496835 secs 2024-04-26T22:20:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14514.525034 secs 2024-04-26T22:20:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13817.496835 secs 2024-04-26T22:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:20 smithi189 ceph-mon[32756]: pgmap v8285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:20:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:20 smithi156 ceph-mon[32679]: pgmap v8285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:20:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:20 smithi092 ceph-mon[29156]: pgmap v8285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:20:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:20:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:20:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:20:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:20:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:21 smithi189 ceph-mon[32756]: pgmap v8286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:20:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:21 smithi189 ceph-mon[32756]: pgmap v8287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:21 smithi156 ceph-mon[32679]: pgmap v8286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:20:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:21 smithi156 ceph-mon[32679]: pgmap v8287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:21 smithi092 ceph-mon[29156]: pgmap v8286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:20:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:21 smithi092 ceph-mon[29156]: pgmap v8287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:23 smithi189 ceph-mon[32756]: pgmap v8288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:23 smithi156 ceph-mon[32679]: pgmap v8288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:23 smithi092 ceph-mon[29156]: pgmap v8288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14519.525151 secs 2024-04-26T22:20:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13822.496899 secs 2024-04-26T22:20:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14519.525151 secs 2024-04-26T22:20:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13822.496899 secs 2024-04-26T22:20:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14519.525151 secs 2024-04-26T22:20:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13822.496899 secs 2024-04-26T22:20:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:25 smithi189 ceph-mon[32756]: pgmap v8289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:25 smithi156 ceph-mon[32679]: pgmap v8289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:25 smithi092 ceph-mon[29156]: pgmap v8289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:27 smithi189 ceph-mon[32756]: pgmap v8290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:27 smithi156 ceph-mon[32679]: pgmap v8290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:27 smithi092 ceph-mon[29156]: pgmap v8290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:20:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:29 smithi189 ceph-mon[32756]: pgmap v8291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14524.525277 secs 2024-04-26T22:20:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13827.496977 secs 2024-04-26T22:20:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:29 smithi156 ceph-mon[32679]: pgmap v8291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14524.525277 secs 2024-04-26T22:20:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13827.496977 secs 2024-04-26T22:20:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:29 smithi092 ceph-mon[29156]: pgmap v8291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:20:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14524.525277 secs 2024-04-26T22:20:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13827.496977 secs 2024-04-26T22:20:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:31 smithi189 ceph-mon[32756]: pgmap v8292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:20:31.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:31 smithi092 ceph-mon[29156]: pgmap v8292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:20:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:31 smithi156 ceph-mon[32679]: pgmap v8292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:20:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:33 smithi189 ceph-mon[32756]: pgmap v8293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:33 smithi156 ceph-mon[32679]: pgmap v8293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:33 smithi092 ceph-mon[29156]: pgmap v8293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14529.525387 secs 2024-04-26T22:20:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13832.497130 secs 2024-04-26T22:20:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14529.525387 secs 2024-04-26T22:20:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13832.497130 secs 2024-04-26T22:20:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14529.525387 secs 2024-04-26T22:20:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13832.497130 secs 2024-04-26T22:20:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:35 smithi189 ceph-mon[32756]: pgmap v8294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:35 smithi156 ceph-mon[32679]: pgmap v8294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:35 smithi092 ceph-mon[29156]: pgmap v8294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:37 smithi189 ceph-mon[32756]: pgmap v8295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:37 smithi156 ceph-mon[32679]: pgmap v8295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:37 smithi092 ceph-mon[29156]: pgmap v8295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:39 smithi189 ceph-mon[32756]: pgmap v8296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14534.525519 secs 2024-04-26T22:20:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13837.497249 secs 2024-04-26T22:20:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:39 smithi156 ceph-mon[32679]: pgmap v8296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14534.525519 secs 2024-04-26T22:20:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13837.497249 secs 2024-04-26T22:20:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:39 smithi092 ceph-mon[29156]: pgmap v8296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14534.525519 secs 2024-04-26T22:20:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13837.497249 secs 2024-04-26T22:20:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:41 smithi189 ceph-mon[32756]: pgmap v8297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:41 smithi156 ceph-mon[32679]: pgmap v8297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:41 smithi092 ceph-mon[29156]: pgmap v8297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:43 smithi156 ceph-mon[32679]: pgmap v8298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:43 smithi092 ceph-mon[29156]: pgmap v8298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:43 smithi189 ceph-mon[32756]: pgmap v8298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14539.525610 secs 2024-04-26T22:20:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13842.497347 secs 2024-04-26T22:20:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14539.525610 secs 2024-04-26T22:20:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13842.497347 secs 2024-04-26T22:20:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14539.525610 secs 2024-04-26T22:20:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13842.497347 secs 2024-04-26T22:20:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:45 smithi156 ceph-mon[32679]: pgmap v8299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:45 smithi092 ceph-mon[29156]: pgmap v8299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:45 smithi189 ceph-mon[32756]: pgmap v8299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:20:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:47 smithi156 ceph-mon[32679]: pgmap v8300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:47 smithi092 ceph-mon[29156]: pgmap v8300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:47 smithi189 ceph-mon[32756]: pgmap v8300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:49 smithi156 ceph-mon[32679]: pgmap v8301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14544.525727 secs 2024-04-26T22:20:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13847.497412 secs 2024-04-26T22:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:49 smithi092 ceph-mon[29156]: pgmap v8301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14544.525727 secs 2024-04-26T22:20:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13847.497412 secs 2024-04-26T22:20:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:49 smithi189 ceph-mon[32756]: pgmap v8301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:20:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14544.525727 secs 2024-04-26T22:20:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13847.497412 secs 2024-04-26T22:20:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:51 smithi156 ceph-mon[32679]: pgmap v8302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:51 smithi092 ceph-mon[29156]: pgmap v8302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:51 smithi189 ceph-mon[32756]: pgmap v8302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:53 smithi156 ceph-mon[32679]: pgmap v8303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:53 smithi092 ceph-mon[29156]: pgmap v8303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:53 smithi189 ceph-mon[32756]: pgmap v8303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14549.525849 secs 2024-04-26T22:20:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13852.497478 secs 2024-04-26T22:20:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14549.525849 secs 2024-04-26T22:20:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13852.497478 secs 2024-04-26T22:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14549.525849 secs 2024-04-26T22:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13852.497478 secs 2024-04-26T22:20:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:55 smithi156 ceph-mon[32679]: pgmap v8304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:55 smithi092 ceph-mon[29156]: pgmap v8304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:55 smithi189 ceph-mon[32756]: pgmap v8304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:20:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:57 smithi156 ceph-mon[32679]: pgmap v8305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:57 smithi092 ceph-mon[29156]: pgmap v8305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:57 smithi189 ceph-mon[32756]: pgmap v8305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:59 smithi156 ceph-mon[32679]: pgmap v8306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14554.525972 secs 2024-04-26T22:20:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:20:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13857.497593 secs 2024-04-26T22:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:59 smithi092 ceph-mon[29156]: pgmap v8306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14554.525972 secs 2024-04-26T22:20:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:20:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13857.497593 secs 2024-04-26T22:21:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:59 smithi189 ceph-mon[32756]: pgmap v8306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:21:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14554.525972 secs 2024-04-26T22:21:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:20:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13857.497593 secs 2024-04-26T22:21:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:01 smithi156 ceph-mon[32679]: pgmap v8307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:21:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:01 smithi092 ceph-mon[29156]: pgmap v8307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:21:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:01 smithi189 ceph-mon[32756]: pgmap v8307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:21:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:03 smithi156 ceph-mon[32679]: pgmap v8308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:03 smithi092 ceph-mon[29156]: pgmap v8308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:03 smithi189 ceph-mon[32756]: pgmap v8308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14559.526091 secs 2024-04-26T22:21:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13862.497714 secs 2024-04-26T22:21:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14559.526091 secs 2024-04-26T22:21:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13862.497714 secs 2024-04-26T22:21:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14559.526091 secs 2024-04-26T22:21:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13862.497714 secs 2024-04-26T22:21:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:05 smithi092 ceph-mon[29156]: pgmap v8309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:05 smithi189 ceph-mon[32756]: pgmap v8309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:05 smithi156 ceph-mon[32679]: pgmap v8309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:07.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:07 smithi189 ceph-mon[32756]: pgmap v8310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:07 smithi092 ceph-mon[29156]: pgmap v8310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:07 smithi156 ceph-mon[32679]: pgmap v8310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:09 smithi092 ceph-mon[29156]: pgmap v8311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14564.526229 secs 2024-04-26T22:21:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13867.497855 secs 2024-04-26T22:21:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:09 smithi189 ceph-mon[32756]: pgmap v8311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14564.526229 secs 2024-04-26T22:21:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13867.497855 secs 2024-04-26T22:21:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:09 smithi156 ceph-mon[32679]: pgmap v8311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14564.526229 secs 2024-04-26T22:21:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13867.497855 secs 2024-04-26T22:21:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:11 smithi092 ceph-mon[29156]: pgmap v8312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:11 smithi189 ceph-mon[32756]: pgmap v8312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:11 smithi156 ceph-mon[32679]: pgmap v8312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:13 smithi092 ceph-mon[29156]: pgmap v8313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:13 smithi189 ceph-mon[32756]: pgmap v8313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:13 smithi156 ceph-mon[32679]: pgmap v8313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:21:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14569.526364 secs 2024-04-26T22:21:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13872.497961 secs 2024-04-26T22:21:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14569.526364 secs 2024-04-26T22:21:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13872.497961 secs 2024-04-26T22:21:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14569.526364 secs 2024-04-26T22:21:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13872.497961 secs 2024-04-26T22:21:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:15 smithi092 ceph-mon[29156]: pgmap v8314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:15 smithi189 ceph-mon[32756]: pgmap v8314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:15 smithi156 ceph-mon[32679]: pgmap v8314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:21:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:17 smithi092 ceph-mon[29156]: pgmap v8315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:17 smithi189 ceph-mon[32756]: pgmap v8315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:17 smithi156 ceph-mon[32679]: pgmap v8315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:19 smithi092 ceph-mon[29156]: pgmap v8316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14574.526499 secs 2024-04-26T22:21:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13877.498080 secs 2024-04-26T22:21:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:19 smithi189 ceph-mon[32756]: pgmap v8316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14574.526499 secs 2024-04-26T22:21:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13877.498080 secs 2024-04-26T22:21:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:19 smithi156 ceph-mon[32679]: pgmap v8316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14574.526499 secs 2024-04-26T22:21:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13877.498080 secs 2024-04-26T22:21:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:21:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:21 smithi092 ceph-mon[29156]: pgmap v8317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:21:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:21 smithi189 ceph-mon[32756]: pgmap v8317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:21:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:21 smithi156 ceph-mon[32679]: pgmap v8317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:21:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:21:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:21:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:22 smithi092 ceph-mon[29156]: pgmap v8318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:21:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:22 smithi092 ceph-mon[29156]: pgmap v8319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:22 smithi189 ceph-mon[32756]: pgmap v8318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:21:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:22 smithi189 ceph-mon[32756]: pgmap v8319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:22 smithi156 ceph-mon[32679]: pgmap v8318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:21:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:22 smithi156 ceph-mon[32679]: pgmap v8319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:24 smithi092 ceph-mon[29156]: pgmap v8320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:21:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14579.526613 secs 2024-04-26T22:21:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13882.498213 secs 2024-04-26T22:21:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:24 smithi189 ceph-mon[32756]: pgmap v8320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:21:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14579.526613 secs 2024-04-26T22:21:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13882.498213 secs 2024-04-26T22:21:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:24 smithi156 ceph-mon[32679]: pgmap v8320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:21:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14579.526613 secs 2024-04-26T22:21:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13882.498213 secs 2024-04-26T22:21:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:26 smithi092 ceph-mon[29156]: pgmap v8321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:26 smithi189 ceph-mon[32756]: pgmap v8321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:26 smithi156 ceph-mon[32679]: pgmap v8321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:28 smithi092 ceph-mon[29156]: pgmap v8322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:28 smithi189 ceph-mon[32756]: pgmap v8322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:28 smithi156 ceph-mon[32679]: pgmap v8322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14584.526760 secs 2024-04-26T22:21:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13887.498366 secs 2024-04-26T22:21:30.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14584.526760 secs 2024-04-26T22:21:30.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13887.498366 secs 2024-04-26T22:21:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14584.526760 secs 2024-04-26T22:21:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13887.498366 secs 2024-04-26T22:21:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:30 smithi092 ceph-mon[29156]: pgmap v8323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:30 smithi189 ceph-mon[32756]: pgmap v8323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:30 smithi156 ceph-mon[32679]: pgmap v8323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:21:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:32 smithi189 ceph-mon[32756]: pgmap v8324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:21:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:32 smithi156 ceph-mon[32679]: pgmap v8324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:21:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:32 smithi092 ceph-mon[29156]: pgmap v8324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:21:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:34 smithi189 ceph-mon[32756]: pgmap v8325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:35.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14589.526878 secs 2024-04-26T22:21:35.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13892.498514 secs 2024-04-26T22:21:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:34 smithi156 ceph-mon[32679]: pgmap v8325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14589.526878 secs 2024-04-26T22:21:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13892.498514 secs 2024-04-26T22:21:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:34 smithi092 ceph-mon[29156]: pgmap v8325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14589.526878 secs 2024-04-26T22:21:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13892.498514 secs 2024-04-26T22:21:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:36 smithi189 ceph-mon[32756]: pgmap v8326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:36 smithi156 ceph-mon[32679]: pgmap v8326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:36 smithi092 ceph-mon[29156]: pgmap v8326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:21:37.982+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:21:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:21:37.982+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:21:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:21:37.982+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:21:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:21:37.982+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 115 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:21:39.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:38 smithi092 ceph-mon[29156]: pgmap v8327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:38 smithi189 ceph-mon[32756]: pgmap v8327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:38 smithi156 ceph-mon[32679]: pgmap v8327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14594.526979 secs 2024-04-26T22:21:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:39 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 13897.498634 secs 2024-04-26T22:21:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:39 smithi189 ceph-mon[32756]: slow request 724.155434 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14594.526979 secs 2024-04-26T22:21:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:39 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 13897.498634 secs 2024-04-26T22:21:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:39 smithi156 ceph-mon[32679]: slow request 724.155434 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14594.526979 secs 2024-04-26T22:21:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:39 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 13897.498634 secs 2024-04-26T22:21:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:39 smithi092 ceph-mon[29156]: slow request 724.155434 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:21:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:40 smithi189 ceph-mon[32756]: pgmap v8328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:40 smithi156 ceph-mon[32679]: pgmap v8328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:40 smithi092 ceph-mon[29156]: pgmap v8328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:42 smithi189 ceph-mon[32756]: pgmap v8329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:42 smithi156 ceph-mon[32679]: pgmap v8329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:42 smithi092 ceph-mon[29156]: pgmap v8329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:44 smithi189 ceph-mon[32756]: pgmap v8330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14599.527077 secs 2024-04-26T22:21:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13902.498751 secs 2024-04-26T22:21:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:44 smithi156 ceph-mon[32679]: pgmap v8330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14599.527077 secs 2024-04-26T22:21:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13902.498751 secs 2024-04-26T22:21:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:44 smithi092 ceph-mon[29156]: pgmap v8330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14599.527077 secs 2024-04-26T22:21:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13902.498751 secs 2024-04-26T22:21:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:46 smithi189 ceph-mon[32756]: pgmap v8331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:46 smithi156 ceph-mon[32679]: pgmap v8331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:46 smithi092 ceph-mon[29156]: pgmap v8331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:48 smithi189 ceph-mon[32756]: pgmap v8332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:48 smithi156 ceph-mon[32679]: pgmap v8332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:48 smithi092 ceph-mon[29156]: pgmap v8332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14604.527202 secs 2024-04-26T22:21:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13907.498875 secs 2024-04-26T22:21:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14604.527202 secs 2024-04-26T22:21:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13907.498875 secs 2024-04-26T22:21:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14604.527202 secs 2024-04-26T22:21:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13907.498875 secs 2024-04-26T22:21:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:50 smithi189 ceph-mon[32756]: pgmap v8333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:50 smithi156 ceph-mon[32679]: pgmap v8333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:50 smithi092 ceph-mon[29156]: pgmap v8333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:52 smithi189 ceph-mon[32756]: pgmap v8334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:52 smithi156 ceph-mon[32679]: pgmap v8334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:52 smithi092 ceph-mon[29156]: pgmap v8334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:54 smithi189 ceph-mon[32756]: pgmap v8335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14609.527322 secs 2024-04-26T22:21:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13912.499029 secs 2024-04-26T22:21:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:54 smithi156 ceph-mon[32679]: pgmap v8335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14609.527322 secs 2024-04-26T22:21:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13912.499029 secs 2024-04-26T22:21:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:54 smithi092 ceph-mon[29156]: pgmap v8335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14609.527322 secs 2024-04-26T22:21:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13912.499029 secs 2024-04-26T22:21:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:56 smithi189 ceph-mon[32756]: pgmap v8336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:56 smithi156 ceph-mon[32679]: pgmap v8336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:56 smithi092 ceph-mon[29156]: pgmap v8336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:21:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:58 smithi189 ceph-mon[32756]: pgmap v8337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:58 smithi156 ceph-mon[32679]: pgmap v8337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:21:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:58 smithi092 ceph-mon[29156]: pgmap v8337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:00.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14614.527455 secs 2024-04-26T22:22:00.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:21:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13917.499126 secs 2024-04-26T22:22:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14614.527455 secs 2024-04-26T22:22:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:21:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13917.499126 secs 2024-04-26T22:22:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14614.527455 secs 2024-04-26T22:22:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:21:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13917.499126 secs 2024-04-26T22:22:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:00 smithi189 ceph-mon[32756]: pgmap v8338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:00 smithi156 ceph-mon[32679]: pgmap v8338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:00 smithi092 ceph-mon[29156]: pgmap v8338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:02 smithi189 ceph-mon[32756]: pgmap v8339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:02 smithi156 ceph-mon[32679]: pgmap v8339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:02 smithi092 ceph-mon[29156]: pgmap v8339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:04 smithi189 ceph-mon[32756]: pgmap v8340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14619.527579 secs 2024-04-26T22:22:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13922.499250 secs 2024-04-26T22:22:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:04 smithi156 ceph-mon[32679]: pgmap v8340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14619.527579 secs 2024-04-26T22:22:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13922.499250 secs 2024-04-26T22:22:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:04 smithi092 ceph-mon[29156]: pgmap v8340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14619.527579 secs 2024-04-26T22:22:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13922.499250 secs 2024-04-26T22:22:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:06 smithi189 ceph-mon[32756]: pgmap v8341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:06 smithi156 ceph-mon[32679]: pgmap v8341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:06 smithi092 ceph-mon[29156]: pgmap v8341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:08 smithi189 ceph-mon[32756]: pgmap v8342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:08 smithi156 ceph-mon[32679]: pgmap v8342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:08 smithi092 ceph-mon[29156]: pgmap v8342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14624.527699 secs 2024-04-26T22:22:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13927.499337 secs 2024-04-26T22:22:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14624.527699 secs 2024-04-26T22:22:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13927.499337 secs 2024-04-26T22:22:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14624.527699 secs 2024-04-26T22:22:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13927.499337 secs 2024-04-26T22:22:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:10 smithi189 ceph-mon[32756]: pgmap v8343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:10 smithi156 ceph-mon[32679]: pgmap v8343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:10 smithi092 ceph-mon[29156]: pgmap v8343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:12 smithi189 ceph-mon[32756]: pgmap v8344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:12 smithi156 ceph-mon[32679]: pgmap v8344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:12 smithi092 ceph-mon[29156]: pgmap v8344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:14 smithi189 ceph-mon[32756]: pgmap v8345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14629.527809 secs 2024-04-26T22:22:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13932.499438 secs 2024-04-26T22:22:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:14 smithi156 ceph-mon[32679]: pgmap v8345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14629.527809 secs 2024-04-26T22:22:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13932.499438 secs 2024-04-26T22:22:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:14 smithi092 ceph-mon[29156]: pgmap v8345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14629.527809 secs 2024-04-26T22:22:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13932.499438 secs 2024-04-26T22:22:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:16 smithi189 ceph-mon[32756]: pgmap v8346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:16 smithi156 ceph-mon[32679]: pgmap v8346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:16 smithi092 ceph-mon[29156]: pgmap v8346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:18 smithi189 ceph-mon[32756]: pgmap v8347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:18 smithi156 ceph-mon[32679]: pgmap v8347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:18 smithi092 ceph-mon[29156]: pgmap v8347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14634.527925 secs 2024-04-26T22:22:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13937.499504 secs 2024-04-26T22:22:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:19 smithi189 ceph-mon[32756]: pgmap v8348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14634.527925 secs 2024-04-26T22:22:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13937.499504 secs 2024-04-26T22:22:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:19 smithi156 ceph-mon[32679]: pgmap v8348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14634.527925 secs 2024-04-26T22:22:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13937.499504 secs 2024-04-26T22:22:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:19 smithi092 ceph-mon[29156]: pgmap v8348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:22 smithi156 ceph-mon[32679]: pgmap v8349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:22:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:22 smithi092 ceph-mon[29156]: pgmap v8349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:22:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:22 smithi189 ceph-mon[32756]: pgmap v8349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:22:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:22:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:22:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:22:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:23 smithi156 ceph-mon[32679]: pgmap v8350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:22:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:23 smithi156 ceph-mon[32679]: pgmap v8351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:23 smithi092 ceph-mon[29156]: pgmap v8350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:22:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:23 smithi092 ceph-mon[29156]: pgmap v8351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:23 smithi189 ceph-mon[32756]: pgmap v8350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:22:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:23 smithi189 ceph-mon[32756]: pgmap v8351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14639.528016 secs 2024-04-26T22:22:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13942.499571 secs 2024-04-26T22:22:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:25 smithi156 ceph-mon[32679]: pgmap v8352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14639.528016 secs 2024-04-26T22:22:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13942.499571 secs 2024-04-26T22:22:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:25 smithi092 ceph-mon[29156]: pgmap v8352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14639.528016 secs 2024-04-26T22:22:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13942.499571 secs 2024-04-26T22:22:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:25 smithi189 ceph-mon[32756]: pgmap v8352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:27 smithi156 ceph-mon[32679]: pgmap v8353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:27 smithi092 ceph-mon[29156]: pgmap v8353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:27 smithi189 ceph-mon[32756]: pgmap v8353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:29 smithi156 ceph-mon[32679]: pgmap v8354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:22:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:29 smithi092 ceph-mon[29156]: pgmap v8354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:22:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:29 smithi189 ceph-mon[32756]: pgmap v8354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:22:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14644.528139 secs 2024-04-26T22:22:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13947.499689 secs 2024-04-26T22:22:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14644.528139 secs 2024-04-26T22:22:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13947.499689 secs 2024-04-26T22:22:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14644.528139 secs 2024-04-26T22:22:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13947.499689 secs 2024-04-26T22:22:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:31 smithi156 ceph-mon[32679]: pgmap v8355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:31 smithi092 ceph-mon[29156]: pgmap v8355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:31 smithi189 ceph-mon[32756]: pgmap v8355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:22:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:33 smithi156 ceph-mon[32679]: pgmap v8356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:22:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:33 smithi092 ceph-mon[29156]: pgmap v8356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:22:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:33 smithi189 ceph-mon[32756]: pgmap v8356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:22:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14649.528256 secs 2024-04-26T22:22:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13952.499832 secs 2024-04-26T22:22:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:35 smithi156 ceph-mon[32679]: pgmap v8357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14649.528256 secs 2024-04-26T22:22:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13952.499832 secs 2024-04-26T22:22:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:35 smithi092 ceph-mon[29156]: pgmap v8357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14649.528256 secs 2024-04-26T22:22:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13952.499832 secs 2024-04-26T22:22:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:35 smithi189 ceph-mon[32756]: pgmap v8357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:37 smithi156 ceph-mon[32679]: pgmap v8358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:37 smithi092 ceph-mon[29156]: pgmap v8358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:37 smithi189 ceph-mon[32756]: pgmap v8358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:39 smithi156 ceph-mon[32679]: pgmap v8359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:39.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:39 smithi189 ceph-mon[32756]: pgmap v8359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:39 smithi092 ceph-mon[29156]: pgmap v8359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14654.528378 secs 2024-04-26T22:22:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13957.499898 secs 2024-04-26T22:22:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14654.528378 secs 2024-04-26T22:22:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13957.499898 secs 2024-04-26T22:22:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14654.528378 secs 2024-04-26T22:22:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13957.499898 secs 2024-04-26T22:22:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:41 smithi156 ceph-mon[32679]: pgmap v8360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:41 smithi092 ceph-mon[29156]: pgmap v8360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:41 smithi189 ceph-mon[32756]: pgmap v8360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:43 smithi156 ceph-mon[32679]: pgmap v8361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:43 smithi092 ceph-mon[29156]: pgmap v8361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:43 smithi189 ceph-mon[32756]: pgmap v8361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14659.528511 secs 2024-04-26T22:22:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13962.499973 secs 2024-04-26T22:22:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:45 smithi156 ceph-mon[32679]: pgmap v8362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14659.528511 secs 2024-04-26T22:22:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13962.499973 secs 2024-04-26T22:22:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:45 smithi092 ceph-mon[29156]: pgmap v8362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14659.528511 secs 2024-04-26T22:22:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13962.499973 secs 2024-04-26T22:22:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:45 smithi189 ceph-mon[32756]: pgmap v8362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:47 smithi092 ceph-mon[29156]: pgmap v8363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:47 smithi189 ceph-mon[32756]: pgmap v8363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:47 smithi156 ceph-mon[32679]: pgmap v8363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:49 smithi092 ceph-mon[29156]: pgmap v8364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:49 smithi189 ceph-mon[32756]: pgmap v8364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:49 smithi156 ceph-mon[32679]: pgmap v8364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14664.528648 secs 2024-04-26T22:22:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13967.500101 secs 2024-04-26T22:22:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14664.528648 secs 2024-04-26T22:22:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13967.500101 secs 2024-04-26T22:22:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14664.528648 secs 2024-04-26T22:22:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13967.500101 secs 2024-04-26T22:22:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:51 smithi092 ceph-mon[29156]: pgmap v8365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:51 smithi189 ceph-mon[32756]: pgmap v8365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:51 smithi156 ceph-mon[32679]: pgmap v8365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:53 smithi092 ceph-mon[29156]: pgmap v8366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:53 smithi189 ceph-mon[32756]: pgmap v8366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:53 smithi156 ceph-mon[32679]: pgmap v8366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14669.528728 secs 2024-04-26T22:22:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13972.500238 secs 2024-04-26T22:22:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:55 smithi092 ceph-mon[29156]: pgmap v8367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14669.528728 secs 2024-04-26T22:22:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13972.500238 secs 2024-04-26T22:22:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:55 smithi189 ceph-mon[32756]: pgmap v8367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14669.528728 secs 2024-04-26T22:22:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13972.500238 secs 2024-04-26T22:22:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:55 smithi156 ceph-mon[32679]: pgmap v8367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:22:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:57 smithi092 ceph-mon[29156]: pgmap v8368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:57 smithi189 ceph-mon[32756]: pgmap v8368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:57 smithi156 ceph-mon[32679]: pgmap v8368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:59 smithi092 ceph-mon[29156]: pgmap v8369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:22:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14674.528868 secs 2024-04-26T22:22:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:59 smithi189 ceph-mon[32756]: pgmap v8369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:22:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14674.528868 secs 2024-04-26T22:22:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:59 smithi156 ceph-mon[32679]: pgmap v8369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:22:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:22:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14674.528868 secs 2024-04-26T22:23:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13977.500358 secs 2024-04-26T22:23:00.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13977.500358 secs 2024-04-26T22:23:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13977.500358 secs 2024-04-26T22:23:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:01 smithi092 ceph-mon[29156]: pgmap v8370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:01 smithi189 ceph-mon[32756]: pgmap v8370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:01 smithi156 ceph-mon[32679]: pgmap v8370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:03 smithi092 ceph-mon[29156]: pgmap v8371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:03 smithi189 ceph-mon[32756]: pgmap v8371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:03 smithi156 ceph-mon[32679]: pgmap v8371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14679.528974 secs 2024-04-26T22:23:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14679.528974 secs 2024-04-26T22:23:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14679.528974 secs 2024-04-26T22:23:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13982.500509 secs 2024-04-26T22:23:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:05 smithi092 ceph-mon[29156]: pgmap v8372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13982.500509 secs 2024-04-26T22:23:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:05 smithi189 ceph-mon[32756]: pgmap v8372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13982.500509 secs 2024-04-26T22:23:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:05 smithi156 ceph-mon[32679]: pgmap v8372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:07 smithi092 ceph-mon[29156]: pgmap v8373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:07 smithi189 ceph-mon[32756]: pgmap v8373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:07 smithi156 ceph-mon[32679]: pgmap v8373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:09 smithi092 ceph-mon[29156]: pgmap v8374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14684.529064 secs 2024-04-26T22:23:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:09 smithi189 ceph-mon[32756]: pgmap v8374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14684.529064 secs 2024-04-26T22:23:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:09 smithi156 ceph-mon[32679]: pgmap v8374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14684.529064 secs 2024-04-26T22:23:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13987.500634 secs 2024-04-26T22:23:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13987.500634 secs 2024-04-26T22:23:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13987.500634 secs 2024-04-26T22:23:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:11 smithi092 ceph-mon[29156]: pgmap v8375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:11 smithi189 ceph-mon[32756]: pgmap v8375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:11 smithi156 ceph-mon[32679]: pgmap v8375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:13 smithi189 ceph-mon[32756]: pgmap v8376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:13 smithi156 ceph-mon[32679]: pgmap v8376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:13 smithi092 ceph-mon[29156]: pgmap v8376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14689.529177 secs 2024-04-26T22:23:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14689.529177 secs 2024-04-26T22:23:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14689.529177 secs 2024-04-26T22:23:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13992.500752 secs 2024-04-26T22:23:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:15 smithi189 ceph-mon[32756]: pgmap v8377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13992.500752 secs 2024-04-26T22:23:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:15 smithi156 ceph-mon[32679]: pgmap v8377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13992.500752 secs 2024-04-26T22:23:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:15 smithi092 ceph-mon[29156]: pgmap v8377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:17 smithi189 ceph-mon[32756]: pgmap v8378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:17 smithi156 ceph-mon[32679]: pgmap v8378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:17 smithi092 ceph-mon[29156]: pgmap v8378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:19 smithi189 ceph-mon[32756]: pgmap v8379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14694.529291 secs 2024-04-26T22:23:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:19 smithi156 ceph-mon[32679]: pgmap v8379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14694.529291 secs 2024-04-26T22:23:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:19 smithi092 ceph-mon[29156]: pgmap v8379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14694.529291 secs 2024-04-26T22:23:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 13997.500874 secs 2024-04-26T22:23:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 13997.500874 secs 2024-04-26T22:23:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 13997.500874 secs 2024-04-26T22:23:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:21 smithi189 ceph-mon[32756]: pgmap v8380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:21 smithi156 ceph-mon[32679]: pgmap v8380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:21 smithi092 ceph-mon[29156]: pgmap v8380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:23:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: pgmap v8381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: pgmap v8382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:23:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: pgmap v8383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:23:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:23:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: pgmap v8381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: pgmap v8382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:23:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: pgmap v8383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:23:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: pgmap v8381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: pgmap v8382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: pgmap v8383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:23:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:23:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14699.529405 secs 2024-04-26T22:23:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14699.529405 secs 2024-04-26T22:23:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14699.529405 secs 2024-04-26T22:23:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14002.500986 secs 2024-04-26T22:23:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:25 smithi189 ceph-mon[32756]: pgmap v8384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14002.500986 secs 2024-04-26T22:23:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:25 smithi156 ceph-mon[32679]: pgmap v8384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14002.500986 secs 2024-04-26T22:23:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:25 smithi092 ceph-mon[29156]: pgmap v8384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:27 smithi156 ceph-mon[32679]: pgmap v8385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:27 smithi092 ceph-mon[29156]: pgmap v8385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:27 smithi189 ceph-mon[32756]: pgmap v8385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14704.529547 secs 2024-04-26T22:23:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14704.529547 secs 2024-04-26T22:23:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14704.529547 secs 2024-04-26T22:23:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:29 smithi092 ceph-mon[29156]: pgmap v8386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14007.501108 secs 2024-04-26T22:23:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:29 smithi156 ceph-mon[32679]: pgmap v8386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14007.501108 secs 2024-04-26T22:23:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:29 smithi189 ceph-mon[32756]: pgmap v8386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14007.501108 secs 2024-04-26T22:23:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:31 smithi092 ceph-mon[29156]: pgmap v8387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:31 smithi189 ceph-mon[32756]: pgmap v8387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:31 smithi156 ceph-mon[32679]: pgmap v8387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:23:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:33 smithi092 ceph-mon[29156]: pgmap v8388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:23:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14709.529683 secs 2024-04-26T22:23:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:33 smithi189 ceph-mon[32756]: pgmap v8388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:23:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14709.529683 secs 2024-04-26T22:23:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:33 smithi156 ceph-mon[32679]: pgmap v8388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:23:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14709.529683 secs 2024-04-26T22:23:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14012.501223 secs 2024-04-26T22:23:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14012.501223 secs 2024-04-26T22:23:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14012.501223 secs 2024-04-26T22:23:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:35 smithi092 ceph-mon[29156]: pgmap v8389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:35 smithi189 ceph-mon[32756]: pgmap v8389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:35 smithi156 ceph-mon[32679]: pgmap v8389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:37 smithi092 ceph-mon[29156]: pgmap v8390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:37 smithi189 ceph-mon[32756]: pgmap v8390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:37 smithi156 ceph-mon[32679]: pgmap v8390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14714.529817 secs 2024-04-26T22:23:39.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14714.529817 secs 2024-04-26T22:23:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14714.529817 secs 2024-04-26T22:23:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:39 smithi092 ceph-mon[29156]: pgmap v8391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14017.501317 secs 2024-04-26T22:23:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:39 smithi189 ceph-mon[32756]: pgmap v8391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14017.501317 secs 2024-04-26T22:23:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:39 smithi156 ceph-mon[32679]: pgmap v8391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14017.501317 secs 2024-04-26T22:23:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:41 smithi092 ceph-mon[29156]: pgmap v8392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:41 smithi189 ceph-mon[32756]: pgmap v8392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:41 smithi156 ceph-mon[32679]: pgmap v8392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:43 smithi092 ceph-mon[29156]: pgmap v8393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14719.529934 secs 2024-04-26T22:23:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:43 smithi189 ceph-mon[32756]: pgmap v8393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14719.529934 secs 2024-04-26T22:23:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:43 smithi156 ceph-mon[32679]: pgmap v8393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14719.529934 secs 2024-04-26T22:23:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14022.501410 secs 2024-04-26T22:23:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14022.501410 secs 2024-04-26T22:23:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14022.501410 secs 2024-04-26T22:23:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:45 smithi092 ceph-mon[29156]: pgmap v8394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:45 smithi189 ceph-mon[32756]: pgmap v8394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:45 smithi156 ceph-mon[32679]: pgmap v8394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:23:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:47 smithi092 ceph-mon[29156]: pgmap v8395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:47 smithi189 ceph-mon[32756]: pgmap v8395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:47 smithi156 ceph-mon[32679]: pgmap v8395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:23:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14724.530031 secs 2024-04-26T22:23:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14724.530031 secs 2024-04-26T22:23:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14724.530031 secs 2024-04-26T22:23:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:49 smithi092 ceph-mon[29156]: pgmap v8396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14027.501551 secs 2024-04-26T22:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:49 smithi189 ceph-mon[32756]: pgmap v8396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14027.501551 secs 2024-04-26T22:23:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:49 smithi156 ceph-mon[32679]: pgmap v8396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14027.501551 secs 2024-04-26T22:23:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:51 smithi092 ceph-mon[29156]: pgmap v8397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:51 smithi189 ceph-mon[32756]: pgmap v8397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:51 smithi156 ceph-mon[32679]: pgmap v8397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:53 smithi189 ceph-mon[32756]: pgmap v8398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14729.530149 secs 2024-04-26T22:23:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:53 smithi156 ceph-mon[32679]: pgmap v8398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14729.530149 secs 2024-04-26T22:23:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:53 smithi092 ceph-mon[29156]: pgmap v8398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14729.530149 secs 2024-04-26T22:23:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14032.501611 secs 2024-04-26T22:23:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14032.501611 secs 2024-04-26T22:23:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14032.501611 secs 2024-04-26T22:23:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:55 smithi092 ceph-mon[29156]: pgmap v8399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:55 smithi189 ceph-mon[32756]: pgmap v8399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:55 smithi156 ceph-mon[32679]: pgmap v8399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:23:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:57 smithi189 ceph-mon[32756]: pgmap v8400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:57 smithi156 ceph-mon[32679]: pgmap v8400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:57 smithi092 ceph-mon[29156]: pgmap v8400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:23:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14734.530257 secs 2024-04-26T22:23:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14734.530257 secs 2024-04-26T22:23:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14734.530257 secs 2024-04-26T22:24:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:59 smithi156 ceph-mon[32679]: pgmap v8401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:24:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:23:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14037.501737 secs 2024-04-26T22:24:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:59 smithi189 ceph-mon[32756]: pgmap v8401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:24:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:23:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14037.501737 secs 2024-04-26T22:24:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:59 smithi092 ceph-mon[29156]: pgmap v8401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:24:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:23:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14037.501737 secs 2024-04-26T22:24:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:01 smithi189 ceph-mon[32756]: pgmap v8402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:01 smithi156 ceph-mon[32679]: pgmap v8402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:01 smithi092 ceph-mon[29156]: pgmap v8402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:03 smithi189 ceph-mon[32756]: pgmap v8403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14739.530391 secs 2024-04-26T22:24:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:03 smithi156 ceph-mon[32679]: pgmap v8403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14739.530391 secs 2024-04-26T22:24:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:03 smithi092 ceph-mon[29156]: pgmap v8403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14739.530391 secs 2024-04-26T22:24:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14042.501856 secs 2024-04-26T22:24:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14042.501856 secs 2024-04-26T22:24:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14042.501856 secs 2024-04-26T22:24:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:05 smithi189 ceph-mon[32756]: pgmap v8404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:05 smithi156 ceph-mon[32679]: pgmap v8404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:05 smithi092 ceph-mon[29156]: pgmap v8404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:07 smithi189 ceph-mon[32756]: pgmap v8405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:07 smithi156 ceph-mon[32679]: pgmap v8405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:07 smithi092 ceph-mon[29156]: pgmap v8405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14744.530496 secs 2024-04-26T22:24:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:09 smithi189 ceph-mon[32756]: pgmap v8406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14744.530496 secs 2024-04-26T22:24:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:09 smithi156 ceph-mon[32679]: pgmap v8406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14744.530496 secs 2024-04-26T22:24:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:09 smithi092 ceph-mon[29156]: pgmap v8406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14047.501930 secs 2024-04-26T22:24:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14047.501930 secs 2024-04-26T22:24:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14047.501930 secs 2024-04-26T22:24:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:11 smithi189 ceph-mon[32756]: pgmap v8407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:11 smithi156 ceph-mon[32679]: pgmap v8407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:11 smithi092 ceph-mon[29156]: pgmap v8407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:13 smithi092 ceph-mon[29156]: pgmap v8408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14749.530631 secs 2024-04-26T22:24:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:13 smithi189 ceph-mon[32756]: pgmap v8408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14749.530631 secs 2024-04-26T22:24:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:13 smithi156 ceph-mon[32679]: pgmap v8408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14749.530631 secs 2024-04-26T22:24:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14052.502068 secs 2024-04-26T22:24:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14052.502068 secs 2024-04-26T22:24:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14052.502068 secs 2024-04-26T22:24:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:15 smithi092 ceph-mon[29156]: pgmap v8409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:15 smithi189 ceph-mon[32756]: pgmap v8409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:15 smithi156 ceph-mon[32679]: pgmap v8409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:17 smithi092 ceph-mon[29156]: pgmap v8410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:17 smithi189 ceph-mon[32756]: pgmap v8410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:17 smithi156 ceph-mon[32679]: pgmap v8410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14754.530755 secs 2024-04-26T22:24:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14754.530755 secs 2024-04-26T22:24:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14754.530755 secs 2024-04-26T22:24:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:19 smithi092 ceph-mon[29156]: pgmap v8411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14057.502204 secs 2024-04-26T22:24:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:19 smithi189 ceph-mon[32756]: pgmap v8411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14057.502204 secs 2024-04-26T22:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:19 smithi156 ceph-mon[32679]: pgmap v8411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14057.502204 secs 2024-04-26T22:24:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:21 smithi092 ceph-mon[29156]: pgmap v8412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:21 smithi189 ceph-mon[32756]: pgmap v8412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:21 smithi156 ceph-mon[32679]: pgmap v8412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: pgmap v8413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:24:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14759.530818 secs 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: pgmap v8413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:24:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14759.530818 secs 2024-04-26T22:24:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: pgmap v8413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:24:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:24:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:24:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:24:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14759.530818 secs 2024-04-26T22:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:24 smithi092 ceph-mon[29156]: pgmap v8414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:24 smithi092 ceph-mon[29156]: pgmap v8415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14062.502318 secs 2024-04-26T22:24:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:24 smithi189 ceph-mon[32756]: pgmap v8414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:24:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:24 smithi189 ceph-mon[32756]: pgmap v8415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14062.502318 secs 2024-04-26T22:24:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:24 smithi156 ceph-mon[32679]: pgmap v8414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:24:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:24 smithi156 ceph-mon[32679]: pgmap v8415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14062.502318 secs 2024-04-26T22:24:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:26 smithi092 ceph-mon[29156]: pgmap v8416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:26 smithi189 ceph-mon[32756]: pgmap v8416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:26 smithi156 ceph-mon[32679]: pgmap v8416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:28 smithi092 ceph-mon[29156]: pgmap v8417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14764.530948 secs 2024-04-26T22:24:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:28 smithi189 ceph-mon[32756]: pgmap v8417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14764.530948 secs 2024-04-26T22:24:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:28 smithi156 ceph-mon[32679]: pgmap v8417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:24:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14764.530948 secs 2024-04-26T22:24:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14067.502401 secs 2024-04-26T22:24:30.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14067.502401 secs 2024-04-26T22:24:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14067.502401 secs 2024-04-26T22:24:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:30 smithi092 ceph-mon[29156]: pgmap v8418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:30 smithi189 ceph-mon[32756]: pgmap v8418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:30 smithi156 ceph-mon[32679]: pgmap v8418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:32 smithi092 ceph-mon[29156]: pgmap v8419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:32 smithi189 ceph-mon[32756]: pgmap v8419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:32 smithi156 ceph-mon[32679]: pgmap v8419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:24:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14769.531047 secs 2024-04-26T22:24:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14769.531047 secs 2024-04-26T22:24:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14769.531047 secs 2024-04-26T22:24:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:34 smithi189 ceph-mon[32756]: pgmap v8420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:24:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14072.502465 secs 2024-04-26T22:24:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:34 smithi156 ceph-mon[32679]: pgmap v8420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:24:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14072.502465 secs 2024-04-26T22:24:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:34 smithi092 ceph-mon[29156]: pgmap v8420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:24:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14072.502465 secs 2024-04-26T22:24:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:36 smithi189 ceph-mon[32756]: pgmap v8421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:36 smithi156 ceph-mon[32679]: pgmap v8421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:36 smithi092 ceph-mon[29156]: pgmap v8421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:24:38.007+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:24:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:24:38.007+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:24:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:24:38.007+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:24:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:24:38.008+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 116 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:24:39.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:38 smithi092 ceph-mon[29156]: pgmap v8422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:39.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14774.531167 secs 2024-04-26T22:24:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:38 smithi189 ceph-mon[32756]: pgmap v8422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14774.531167 secs 2024-04-26T22:24:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:38 smithi156 ceph-mon[32679]: pgmap v8422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14774.531167 secs 2024-04-26T22:24:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14077.502572 secs 2024-04-26T22:24:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14077.502572 secs 2024-04-26T22:24:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14077.502572 secs 2024-04-26T22:24:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:40 smithi189 ceph-mon[32756]: pgmap v8423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:40 smithi156 ceph-mon[32679]: pgmap v8423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:40 smithi092 ceph-mon[29156]: pgmap v8423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:42 smithi189 ceph-mon[32756]: pgmap v8424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:42 smithi156 ceph-mon[32679]: pgmap v8424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:42 smithi092 ceph-mon[29156]: pgmap v8424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14779.531296 secs 2024-04-26T22:24:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14779.531296 secs 2024-04-26T22:24:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14779.531296 secs 2024-04-26T22:24:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:44 smithi189 ceph-mon[32756]: pgmap v8425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14082.502684 secs 2024-04-26T22:24:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:44 smithi156 ceph-mon[32679]: pgmap v8425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14082.502684 secs 2024-04-26T22:24:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:44 smithi092 ceph-mon[29156]: pgmap v8425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14082.502684 secs 2024-04-26T22:24:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:46 smithi189 ceph-mon[32756]: pgmap v8426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:46 smithi156 ceph-mon[32679]: pgmap v8426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:46 smithi092 ceph-mon[29156]: pgmap v8426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:48 smithi189 ceph-mon[32756]: pgmap v8427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14784.531383 secs 2024-04-26T22:24:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:48 smithi156 ceph-mon[32679]: pgmap v8427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14784.531383 secs 2024-04-26T22:24:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:48 smithi092 ceph-mon[29156]: pgmap v8427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14784.531383 secs 2024-04-26T22:24:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14087.502759 secs 2024-04-26T22:24:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14087.502759 secs 2024-04-26T22:24:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14087.502759 secs 2024-04-26T22:24:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:50 smithi189 ceph-mon[32756]: pgmap v8428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:50 smithi156 ceph-mon[32679]: pgmap v8428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:50 smithi092 ceph-mon[29156]: pgmap v8428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:52 smithi189 ceph-mon[32756]: pgmap v8429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:52 smithi156 ceph-mon[32679]: pgmap v8429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:52 smithi092 ceph-mon[29156]: pgmap v8429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14789.531521 secs 2024-04-26T22:24:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14789.531521 secs 2024-04-26T22:24:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14789.531521 secs 2024-04-26T22:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:54 smithi189 ceph-mon[32756]: pgmap v8430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14092.502880 secs 2024-04-26T22:24:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:54 smithi156 ceph-mon[32679]: pgmap v8430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14092.502880 secs 2024-04-26T22:24:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:54 smithi092 ceph-mon[29156]: pgmap v8430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14092.502880 secs 2024-04-26T22:24:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:56 smithi189 ceph-mon[32756]: pgmap v8431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:56 smithi156 ceph-mon[32679]: pgmap v8431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:56 smithi092 ceph-mon[29156]: pgmap v8431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:24:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:58 smithi189 ceph-mon[32756]: pgmap v8432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14794.531647 secs 2024-04-26T22:24:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:58 smithi156 ceph-mon[32679]: pgmap v8432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14794.531647 secs 2024-04-26T22:24:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:58 smithi092 ceph-mon[29156]: pgmap v8432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:24:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14794.531647 secs 2024-04-26T22:25:00.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:24:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14097.502997 secs 2024-04-26T22:25:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:24:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14097.502997 secs 2024-04-26T22:25:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:24:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14097.502997 secs 2024-04-26T22:25:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:00 smithi189 ceph-mon[32756]: pgmap v8433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:00 smithi156 ceph-mon[32679]: pgmap v8433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:00 smithi092 ceph-mon[29156]: pgmap v8433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:02 smithi189 ceph-mon[32756]: pgmap v8434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:02 smithi156 ceph-mon[32679]: pgmap v8434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:02 smithi092 ceph-mon[29156]: pgmap v8434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14799.531760 secs 2024-04-26T22:25:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14799.531760 secs 2024-04-26T22:25:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14799.531760 secs 2024-04-26T22:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:04 smithi189 ceph-mon[32756]: pgmap v8435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14102.503096 secs 2024-04-26T22:25:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:04 smithi156 ceph-mon[32679]: pgmap v8435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14102.503096 secs 2024-04-26T22:25:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:04 smithi092 ceph-mon[29156]: pgmap v8435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14102.503096 secs 2024-04-26T22:25:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:06 smithi189 ceph-mon[32756]: pgmap v8436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:06 smithi156 ceph-mon[32679]: pgmap v8436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:06 smithi092 ceph-mon[29156]: pgmap v8436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:08 smithi189 ceph-mon[32756]: pgmap v8437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14804.531901 secs 2024-04-26T22:25:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:08 smithi156 ceph-mon[32679]: pgmap v8437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14804.531901 secs 2024-04-26T22:25:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:08 smithi092 ceph-mon[29156]: pgmap v8437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14804.531901 secs 2024-04-26T22:25:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14107.503231 secs 2024-04-26T22:25:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14107.503231 secs 2024-04-26T22:25:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14107.503231 secs 2024-04-26T22:25:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:10 smithi189 ceph-mon[32756]: pgmap v8438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:10 smithi156 ceph-mon[32679]: pgmap v8438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:10 smithi092 ceph-mon[29156]: pgmap v8438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:12 smithi189 ceph-mon[32756]: pgmap v8439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:12 smithi156 ceph-mon[32679]: pgmap v8439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:12 smithi092 ceph-mon[29156]: pgmap v8439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14809.532016 secs 2024-04-26T22:25:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14809.532016 secs 2024-04-26T22:25:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14809.532016 secs 2024-04-26T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:14 smithi189 ceph-mon[32756]: pgmap v8440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14112.503353 secs 2024-04-26T22:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:14 smithi156 ceph-mon[32679]: pgmap v8440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14112.503353 secs 2024-04-26T22:25:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:14 smithi092 ceph-mon[29156]: pgmap v8440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14112.503353 secs 2024-04-26T22:25:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:16 smithi189 ceph-mon[32756]: pgmap v8441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:16 smithi156 ceph-mon[32679]: pgmap v8441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:16 smithi092 ceph-mon[29156]: pgmap v8441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:18 smithi189 ceph-mon[32756]: pgmap v8442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14814.532130 secs 2024-04-26T22:25:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:18 smithi156 ceph-mon[32679]: pgmap v8442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14814.532130 secs 2024-04-26T22:25:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:18 smithi092 ceph-mon[29156]: pgmap v8442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14814.532130 secs 2024-04-26T22:25:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14117.503435 secs 2024-04-26T22:25:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14117.503435 secs 2024-04-26T22:25:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14117.503435 secs 2024-04-26T22:25:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:20 smithi189 ceph-mon[32756]: pgmap v8443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:20 smithi156 ceph-mon[32679]: pgmap v8443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:20 smithi092 ceph-mon[29156]: pgmap v8443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:22 smithi189 ceph-mon[32756]: pgmap v8444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:22 smithi156 ceph-mon[32679]: pgmap v8444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:22 smithi092 ceph-mon[29156]: pgmap v8444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:24.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14819.532249 secs 2024-04-26T22:25:24.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14819.532249 secs 2024-04-26T22:25:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14819.532249 secs 2024-04-26T22:25:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: pgmap v8445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14122.503503 secs 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: pgmap v8445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14122.503503 secs 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: pgmap v8445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14122.503503 secs 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:25 smithi189 ceph-mon[32756]: pgmap v8446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:25 smithi156 ceph-mon[32679]: pgmap v8446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:25 smithi092 ceph-mon[29156]: pgmap v8446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:25:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:25:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:25:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:25:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:28 smithi189 ceph-mon[32756]: pgmap v8447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:28 smithi189 ceph-mon[32756]: pgmap v8448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:25:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:28 smithi156 ceph-mon[32679]: pgmap v8447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:28 smithi156 ceph-mon[32679]: pgmap v8448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:25:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:25:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:28 smithi092 ceph-mon[29156]: pgmap v8447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:28 smithi092 ceph-mon[29156]: pgmap v8448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14824.532360 secs 2024-04-26T22:25:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14824.532360 secs 2024-04-26T22:25:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14824.532360 secs 2024-04-26T22:25:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14127.503629 secs 2024-04-26T22:25:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:30 smithi189 ceph-mon[32756]: pgmap v8449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14127.503629 secs 2024-04-26T22:25:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:30 smithi156 ceph-mon[32679]: pgmap v8449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14127.503629 secs 2024-04-26T22:25:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:30 smithi092 ceph-mon[29156]: pgmap v8449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:32 smithi189 ceph-mon[32756]: pgmap v8450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:32 smithi156 ceph-mon[32679]: pgmap v8450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:32 smithi092 ceph-mon[29156]: pgmap v8450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:34 smithi189 ceph-mon[32756]: pgmap v8451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14829.532477 secs 2024-04-26T22:25:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:34 smithi156 ceph-mon[32679]: pgmap v8451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14829.532477 secs 2024-04-26T22:25:34.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-mon[29156]: pgmap v8451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:34.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14829.532477 secs 2024-04-26T22:25:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:25:34.706+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:25:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:25:34.706+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:25:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:25:34.706+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:25:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:25:34.706+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:25:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:25:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:25:34.706+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:25:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14132.503796 secs 2024-04-26T22:25:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14132.503796 secs 2024-04-26T22:25:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14132.503796 secs 2024-04-26T22:25:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:36 smithi189 ceph-mon[32756]: pgmap v8452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:36 smithi156 ceph-mon[32679]: pgmap v8452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:36.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:36 smithi092 ceph-mon[29156]: pgmap v8452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:25:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:38 smithi189 ceph-mon[32756]: pgmap v8453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:25:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:38 smithi156 ceph-mon[32679]: pgmap v8453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:25:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:38 smithi092 ceph-mon[29156]: pgmap v8453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:25:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14834.532594 secs 2024-04-26T22:25:39.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14834.532594 secs 2024-04-26T22:25:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14834.532594 secs 2024-04-26T22:25:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14137.503914 secs 2024-04-26T22:25:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:40 smithi189 ceph-mon[32756]: pgmap v8454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:40.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14137.503914 secs 2024-04-26T22:25:40.658 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:40 smithi092 ceph-mon[29156]: pgmap v8454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14137.503914 secs 2024-04-26T22:25:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:40 smithi156 ceph-mon[32679]: pgmap v8454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:42 smithi189 ceph-mon[32756]: pgmap v8455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:42 smithi156 ceph-mon[32679]: pgmap v8455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:42 smithi092 ceph-mon[29156]: pgmap v8455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:44 smithi189 ceph-mon[32756]: pgmap v8456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14839.532708 secs 2024-04-26T22:25:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:44 smithi156 ceph-mon[32679]: pgmap v8456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14839.532708 secs 2024-04-26T22:25:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:44 smithi092 ceph-mon[29156]: pgmap v8456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14839.532708 secs 2024-04-26T22:25:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14142.504035 secs 2024-04-26T22:25:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14142.504035 secs 2024-04-26T22:25:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14142.504035 secs 2024-04-26T22:25:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:46 smithi189 ceph-mon[32756]: pgmap v8457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:46 smithi156 ceph-mon[32679]: pgmap v8457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:46 smithi092 ceph-mon[29156]: pgmap v8457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:48 smithi189 ceph-mon[32756]: pgmap v8458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:48 smithi156 ceph-mon[32679]: pgmap v8458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:48.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:48 smithi092 ceph-mon[29156]: pgmap v8458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:25:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14844.532855 secs 2024-04-26T22:25:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14844.532855 secs 2024-04-26T22:25:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14844.532855 secs 2024-04-26T22:25:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14147.504163 secs 2024-04-26T22:25:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:50 smithi156 ceph-mon[32679]: pgmap v8459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14147.504163 secs 2024-04-26T22:25:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:50 smithi092 ceph-mon[29156]: pgmap v8459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14147.504163 secs 2024-04-26T22:25:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:50 smithi189 ceph-mon[32756]: pgmap v8459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:25:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:52 smithi156 ceph-mon[32679]: pgmap v8460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:52.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:52 smithi092 ceph-mon[29156]: pgmap v8460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:52 smithi189 ceph-mon[32756]: pgmap v8460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:54 smithi156 ceph-mon[32679]: pgmap v8461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14849.532944 secs 2024-04-26T22:25:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:54 smithi092 ceph-mon[29156]: pgmap v8461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14849.532944 secs 2024-04-26T22:25:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:54 smithi189 ceph-mon[32756]: pgmap v8461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14849.532944 secs 2024-04-26T22:25:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14152.504287 secs 2024-04-26T22:25:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14152.504287 secs 2024-04-26T22:25:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14152.504287 secs 2024-04-26T22:25:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:56 smithi156 ceph-mon[32679]: pgmap v8462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:56 smithi092 ceph-mon[29156]: pgmap v8462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:56 smithi189 ceph-mon[32756]: pgmap v8462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:25:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:58 smithi156 ceph-mon[32679]: pgmap v8463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:58 smithi092 ceph-mon[29156]: pgmap v8463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:58 smithi189 ceph-mon[32756]: pgmap v8463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:25:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:25:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14854.533063 secs 2024-04-26T22:25:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:25:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14854.533063 secs 2024-04-26T22:25:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:25:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14854.533063 secs 2024-04-26T22:26:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14157.504365 secs 2024-04-26T22:26:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:00 smithi156 ceph-mon[32679]: pgmap v8464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14157.504365 secs 2024-04-26T22:26:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:00 smithi092 ceph-mon[29156]: pgmap v8464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14157.504365 secs 2024-04-26T22:26:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:00 smithi189 ceph-mon[32756]: pgmap v8464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:02 smithi156 ceph-mon[32679]: pgmap v8465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:02 smithi092 ceph-mon[29156]: pgmap v8465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:02 smithi189 ceph-mon[32756]: pgmap v8465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:04 smithi156 ceph-mon[32679]: pgmap v8466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14859.533136 secs 2024-04-26T22:26:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:04 smithi092 ceph-mon[29156]: pgmap v8466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14859.533136 secs 2024-04-26T22:26:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:04 smithi189 ceph-mon[32756]: pgmap v8466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14859.533136 secs 2024-04-26T22:26:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14162.504480 secs 2024-04-26T22:26:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14162.504480 secs 2024-04-26T22:26:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14162.504480 secs 2024-04-26T22:26:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:06 smithi092 ceph-mon[29156]: pgmap v8467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:06 smithi189 ceph-mon[32756]: pgmap v8467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:06 smithi156 ceph-mon[32679]: pgmap v8467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:26:08.018+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:26:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:26:08.018+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:26:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:26:08.018+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:26:08.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:26:08.018+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 117 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:26:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:08 smithi092 ceph-mon[29156]: pgmap v8468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:08 smithi189 ceph-mon[32756]: pgmap v8468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:08 smithi156 ceph-mon[32679]: pgmap v8468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14864.533256 secs 2024-04-26T22:26:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14864.533256 secs 2024-04-26T22:26:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14864.533256 secs 2024-04-26T22:26:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14167.504587 secs 2024-04-26T22:26:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:10 smithi092 ceph-mon[29156]: pgmap v8469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:10.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14167.504587 secs 2024-04-26T22:26:10.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:10 smithi189 ceph-mon[32756]: pgmap v8469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14167.504587 secs 2024-04-26T22:26:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:10 smithi156 ceph-mon[32679]: pgmap v8469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:12 smithi092 ceph-mon[29156]: pgmap v8470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:12 smithi189 ceph-mon[32756]: pgmap v8470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:12 smithi156 ceph-mon[32679]: pgmap v8470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:14 smithi092 ceph-mon[29156]: pgmap v8471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14869.533369 secs 2024-04-26T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:14 smithi189 ceph-mon[32756]: pgmap v8471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14869.533369 secs 2024-04-26T22:26:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:14 smithi156 ceph-mon[32679]: pgmap v8471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14869.533369 secs 2024-04-26T22:26:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14172.504727 secs 2024-04-26T22:26:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14172.504727 secs 2024-04-26T22:26:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14172.504727 secs 2024-04-26T22:26:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:16 smithi092 ceph-mon[29156]: pgmap v8472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:16 smithi189 ceph-mon[32756]: pgmap v8472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:16 smithi156 ceph-mon[32679]: pgmap v8472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:18 smithi092 ceph-mon[29156]: pgmap v8473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:18 smithi189 ceph-mon[32756]: pgmap v8473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:18 smithi156 ceph-mon[32679]: pgmap v8473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14874.533486 secs 2024-04-26T22:26:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14874.533486 secs 2024-04-26T22:26:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14874.533486 secs 2024-04-26T22:26:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14177.504802 secs 2024-04-26T22:26:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:20 smithi092 ceph-mon[29156]: pgmap v8474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14177.504802 secs 2024-04-26T22:26:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:20 smithi189 ceph-mon[32756]: pgmap v8474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14177.504802 secs 2024-04-26T22:26:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:20 smithi156 ceph-mon[32679]: pgmap v8474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:22 smithi092 ceph-mon[29156]: pgmap v8475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:22 smithi189 ceph-mon[32756]: pgmap v8475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:22 smithi156 ceph-mon[32679]: pgmap v8475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:24 smithi092 ceph-mon[29156]: pgmap v8476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14879.533603 secs 2024-04-26T22:26:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:24 smithi189 ceph-mon[32756]: pgmap v8476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14879.533603 secs 2024-04-26T22:26:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:24 smithi156 ceph-mon[32679]: pgmap v8476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14879.533603 secs 2024-04-26T22:26:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14182.504936 secs 2024-04-26T22:26:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14182.504936 secs 2024-04-26T22:26:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14182.504936 secs 2024-04-26T22:26:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:26 smithi092 ceph-mon[29156]: pgmap v8477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:26 smithi189 ceph-mon[32756]: pgmap v8477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:26 smithi156 ceph-mon[32679]: pgmap v8477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:26:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: pgmap v8478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: pgmap v8479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: pgmap v8480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:26:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14884.533717 secs 2024-04-26T22:26:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: pgmap v8478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: pgmap v8479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: pgmap v8480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:26:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14884.533717 secs 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: pgmap v8478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: pgmap v8479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: pgmap v8480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:26:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14884.533717 secs 2024-04-26T22:26:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14187.505071 secs 2024-04-26T22:26:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14187.505071 secs 2024-04-26T22:26:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14187.505071 secs 2024-04-26T22:26:30.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:30 smithi156 ceph-mon[32679]: pgmap v8481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:30.845 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:30 smithi092 ceph-mon[29156]: pgmap v8481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:30 smithi189 ceph-mon[32756]: pgmap v8481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:32 smithi189 ceph-mon[32756]: pgmap v8482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:32 smithi156 ceph-mon[32679]: pgmap v8482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:32 smithi092 ceph-mon[29156]: pgmap v8482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14889.533848 secs 2024-04-26T22:26:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14889.533848 secs 2024-04-26T22:26:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14889.533848 secs 2024-04-26T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14192.505212 secs 2024-04-26T22:26:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:34 smithi189 ceph-mon[32756]: pgmap v8483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14192.505212 secs 2024-04-26T22:26:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:34 smithi156 ceph-mon[32679]: pgmap v8483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14192.505212 secs 2024-04-26T22:26:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:34 smithi092 ceph-mon[29156]: pgmap v8483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:36 smithi189 ceph-mon[32756]: pgmap v8484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:36 smithi156 ceph-mon[32679]: pgmap v8484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:36 smithi092 ceph-mon[29156]: pgmap v8484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:26:39.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:38 smithi092 ceph-mon[29156]: pgmap v8485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:26:39.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14894.533914 secs 2024-04-26T22:26:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:38 smithi189 ceph-mon[32756]: pgmap v8485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:26:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14894.533914 secs 2024-04-26T22:26:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:38 smithi156 ceph-mon[32679]: pgmap v8485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:26:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14894.533914 secs 2024-04-26T22:26:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14197.505354 secs 2024-04-26T22:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14197.505354 secs 2024-04-26T22:26:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14197.505354 secs 2024-04-26T22:26:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:40 smithi189 ceph-mon[32756]: pgmap v8486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:40 smithi156 ceph-mon[32679]: pgmap v8486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:40 smithi092 ceph-mon[29156]: pgmap v8486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:42 smithi189 ceph-mon[32756]: pgmap v8487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:42 smithi156 ceph-mon[32679]: pgmap v8487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:42 smithi092 ceph-mon[29156]: pgmap v8487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14899.534029 secs 2024-04-26T22:26:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14899.534029 secs 2024-04-26T22:26:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14899.534029 secs 2024-04-26T22:26:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14202.505444 secs 2024-04-26T22:26:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:44 smithi189 ceph-mon[32756]: pgmap v8488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14202.505444 secs 2024-04-26T22:26:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:44 smithi156 ceph-mon[32679]: pgmap v8488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14202.505444 secs 2024-04-26T22:26:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:44 smithi092 ceph-mon[29156]: pgmap v8488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:46 smithi092 ceph-mon[29156]: pgmap v8489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:46 smithi189 ceph-mon[32756]: pgmap v8489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:46 smithi156 ceph-mon[32679]: pgmap v8489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:48 smithi189 ceph-mon[32756]: pgmap v8490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14904.534109 secs 2024-04-26T22:26:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:48 smithi156 ceph-mon[32679]: pgmap v8490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14904.534109 secs 2024-04-26T22:26:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:48 smithi092 ceph-mon[29156]: pgmap v8490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14904.534109 secs 2024-04-26T22:26:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14207.505545 secs 2024-04-26T22:26:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14207.505545 secs 2024-04-26T22:26:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14207.505545 secs 2024-04-26T22:26:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:50 smithi189 ceph-mon[32756]: pgmap v8491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:50 smithi156 ceph-mon[32679]: pgmap v8491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:50 smithi092 ceph-mon[29156]: pgmap v8491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:52 smithi189 ceph-mon[32756]: pgmap v8492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:52 smithi156 ceph-mon[32679]: pgmap v8492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:52 smithi092 ceph-mon[29156]: pgmap v8492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14909.534248 secs 2024-04-26T22:26:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14909.534248 secs 2024-04-26T22:26:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14909.534248 secs 2024-04-26T22:26:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14212.505662 secs 2024-04-26T22:26:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:54 smithi189 ceph-mon[32756]: pgmap v8493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14212.505662 secs 2024-04-26T22:26:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:54 smithi156 ceph-mon[32679]: pgmap v8493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14212.505662 secs 2024-04-26T22:26:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:54 smithi092 ceph-mon[29156]: pgmap v8493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:26:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:56 smithi189 ceph-mon[32756]: pgmap v8494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:56 smithi156 ceph-mon[32679]: pgmap v8494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:56 smithi092 ceph-mon[29156]: pgmap v8494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:58 smithi189 ceph-mon[32756]: pgmap v8495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14914.534365 secs 2024-04-26T22:26:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:58 smithi156 ceph-mon[32679]: pgmap v8495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14914.534365 secs 2024-04-26T22:26:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:58 smithi092 ceph-mon[29156]: pgmap v8495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:26:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14914.534365 secs 2024-04-26T22:27:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:26:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14217.505803 secs 2024-04-26T22:27:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:26:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14217.505803 secs 2024-04-26T22:27:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:26:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14217.505803 secs 2024-04-26T22:27:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:00 smithi189 ceph-mon[32756]: pgmap v8496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:00 smithi156 ceph-mon[32679]: pgmap v8496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:00 smithi092 ceph-mon[29156]: pgmap v8496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:02 smithi189 ceph-mon[32756]: pgmap v8497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:02 smithi156 ceph-mon[32679]: pgmap v8497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:02 smithi092 ceph-mon[29156]: pgmap v8497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14919.534473 secs 2024-04-26T22:27:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14919.534473 secs 2024-04-26T22:27:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14919.534473 secs 2024-04-26T22:27:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14222.505951 secs 2024-04-26T22:27:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:04 smithi189 ceph-mon[32756]: pgmap v8498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14222.505951 secs 2024-04-26T22:27:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:04 smithi156 ceph-mon[32679]: pgmap v8498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14222.505951 secs 2024-04-26T22:27:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:04 smithi092 ceph-mon[29156]: pgmap v8498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:06 smithi189 ceph-mon[32756]: pgmap v8499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:06 smithi156 ceph-mon[32679]: pgmap v8499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:06 smithi092 ceph-mon[29156]: pgmap v8499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:08 smithi189 ceph-mon[32756]: pgmap v8500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14924.534585 secs 2024-04-26T22:27:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:08 smithi156 ceph-mon[32679]: pgmap v8500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14924.534585 secs 2024-04-26T22:27:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:08 smithi092 ceph-mon[29156]: pgmap v8500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14924.534585 secs 2024-04-26T22:27:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14227.506047 secs 2024-04-26T22:27:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14227.506047 secs 2024-04-26T22:27:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14227.506047 secs 2024-04-26T22:27:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:10 smithi189 ceph-mon[32756]: pgmap v8501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:10 smithi156 ceph-mon[32679]: pgmap v8501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:10 smithi092 ceph-mon[29156]: pgmap v8501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:12 smithi189 ceph-mon[32756]: pgmap v8502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:13.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:12 smithi156 ceph-mon[32679]: pgmap v8502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:13.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:12 smithi092 ceph-mon[29156]: pgmap v8502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14929.534719 secs 2024-04-26T22:27:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14929.534719 secs 2024-04-26T22:27:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14929.534719 secs 2024-04-26T22:27:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14232.506198 secs 2024-04-26T22:27:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:14 smithi189 ceph-mon[32756]: pgmap v8503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14232.506198 secs 2024-04-26T22:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:14 smithi156 ceph-mon[32679]: pgmap v8503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14232.506198 secs 2024-04-26T22:27:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:14 smithi092 ceph-mon[29156]: pgmap v8503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:15 smithi189 ceph-mon[32756]: pgmap v8504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:15 smithi156 ceph-mon[32679]: pgmap v8504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:15 smithi092 ceph-mon[29156]: pgmap v8504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:18 smithi189 ceph-mon[32756]: pgmap v8505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14934.534879 secs 2024-04-26T22:27:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:18 smithi156 ceph-mon[32679]: pgmap v8505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14934.534879 secs 2024-04-26T22:27:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:18 smithi092 ceph-mon[29156]: pgmap v8505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14934.534879 secs 2024-04-26T22:27:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14237.506319 secs 2024-04-26T22:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14237.506319 secs 2024-04-26T22:27:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14237.506319 secs 2024-04-26T22:27:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:20 smithi189 ceph-mon[32756]: pgmap v8506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:20 smithi156 ceph-mon[32679]: pgmap v8506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:20 smithi092 ceph-mon[29156]: pgmap v8506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:22 smithi189 ceph-mon[32756]: pgmap v8507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:22 smithi156 ceph-mon[32679]: pgmap v8507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:22 smithi092 ceph-mon[29156]: pgmap v8507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14939.534959 secs 2024-04-26T22:27:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14939.534959 secs 2024-04-26T22:27:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14939.534959 secs 2024-04-26T22:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14242.506411 secs 2024-04-26T22:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:24 smithi189 ceph-mon[32756]: pgmap v8508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14242.506411 secs 2024-04-26T22:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:24 smithi156 ceph-mon[32679]: pgmap v8508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14242.506411 secs 2024-04-26T22:27:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:24 smithi092 ceph-mon[29156]: pgmap v8508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:26 smithi189 ceph-mon[32756]: pgmap v8509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:26 smithi156 ceph-mon[32679]: pgmap v8509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:26 smithi092 ceph-mon[29156]: pgmap v8509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: pgmap v8510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14944.535077 secs 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:27:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: pgmap v8510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14944.535077 secs 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:27:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: pgmap v8510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14944.535077 secs 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:27:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:27:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:29 smithi156 ceph-mon[32679]: pgmap v8511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:27:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:29 smithi156 ceph-mon[32679]: pgmap v8512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14247.506514 secs 2024-04-26T22:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:29 smithi189 ceph-mon[32756]: pgmap v8511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:29 smithi189 ceph-mon[32756]: pgmap v8512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14247.506514 secs 2024-04-26T22:27:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:29 smithi092 ceph-mon[29156]: pgmap v8511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:27:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:29 smithi092 ceph-mon[29156]: pgmap v8512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14247.506514 secs 2024-04-26T22:27:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:31 smithi189 ceph-mon[32756]: pgmap v8513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:31 smithi156 ceph-mon[32679]: pgmap v8513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:31 smithi092 ceph-mon[29156]: pgmap v8513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:33 smithi189 ceph-mon[32756]: pgmap v8514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14949.535156 secs 2024-04-26T22:27:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:33 smithi156 ceph-mon[32679]: pgmap v8514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14949.535156 secs 2024-04-26T22:27:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:33 smithi092 ceph-mon[29156]: pgmap v8514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:27:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14949.535156 secs 2024-04-26T22:27:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14252.506655 secs 2024-04-26T22:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14252.506655 secs 2024-04-26T22:27:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14252.506655 secs 2024-04-26T22:27:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:35 smithi189 ceph-mon[32756]: pgmap v8515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:35 smithi156 ceph-mon[32679]: pgmap v8515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:35 smithi092 ceph-mon[29156]: pgmap v8515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:27:38.031+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:27:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:27:38.031+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:27:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:27:38.032+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:27:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:27:38.032+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 118 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:27:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:37 smithi189 ceph-mon[32756]: pgmap v8516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:37 smithi156 ceph-mon[32679]: pgmap v8516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:37 smithi092 ceph-mon[29156]: pgmap v8516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:27:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14954.535251 secs 2024-04-26T22:27:39.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14954.535251 secs 2024-04-26T22:27:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14954.535251 secs 2024-04-26T22:27:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:39 smithi189 ceph-mon[32756]: pgmap v8517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:27:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14257.506750 secs 2024-04-26T22:27:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:39 smithi156 ceph-mon[32679]: pgmap v8517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:27:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14257.506750 secs 2024-04-26T22:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:39 smithi092 ceph-mon[29156]: pgmap v8517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:27:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14257.506750 secs 2024-04-26T22:27:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:41 smithi189 ceph-mon[32756]: pgmap v8518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:41 smithi156 ceph-mon[32679]: pgmap v8518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:41 smithi092 ceph-mon[29156]: pgmap v8518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:43 smithi189 ceph-mon[32756]: pgmap v8519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14959.535367 secs 2024-04-26T22:27:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:43 smithi156 ceph-mon[32679]: pgmap v8519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14959.535367 secs 2024-04-26T22:27:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:43 smithi092 ceph-mon[29156]: pgmap v8519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14959.535367 secs 2024-04-26T22:27:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14262.506867 secs 2024-04-26T22:27:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14262.506867 secs 2024-04-26T22:27:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14262.506867 secs 2024-04-26T22:27:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:45 smithi189 ceph-mon[32756]: pgmap v8520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:45 smithi156 ceph-mon[32679]: pgmap v8520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:45 smithi092 ceph-mon[29156]: pgmap v8520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:47 smithi189 ceph-mon[32756]: pgmap v8521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:47 smithi156 ceph-mon[32679]: pgmap v8521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:47 smithi092 ceph-mon[29156]: pgmap v8521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14964.535484 secs 2024-04-26T22:27:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14964.535484 secs 2024-04-26T22:27:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14964.535484 secs 2024-04-26T22:27:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:49 smithi189 ceph-mon[32756]: pgmap v8522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14267.506985 secs 2024-04-26T22:27:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:49 smithi156 ceph-mon[32679]: pgmap v8522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14267.506985 secs 2024-04-26T22:27:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:49 smithi092 ceph-mon[29156]: pgmap v8522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14267.506985 secs 2024-04-26T22:27:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:51 smithi189 ceph-mon[32756]: pgmap v8523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:51 smithi156 ceph-mon[32679]: pgmap v8523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:51 smithi092 ceph-mon[29156]: pgmap v8523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:53 smithi189 ceph-mon[32756]: pgmap v8524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14969.535593 secs 2024-04-26T22:27:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:53 smithi156 ceph-mon[32679]: pgmap v8524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14969.535593 secs 2024-04-26T22:27:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:53 smithi092 ceph-mon[29156]: pgmap v8524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14969.535593 secs 2024-04-26T22:27:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14272.507107 secs 2024-04-26T22:27:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14272.507107 secs 2024-04-26T22:27:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14272.507107 secs 2024-04-26T22:27:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:55 smithi189 ceph-mon[32756]: pgmap v8525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:55 smithi156 ceph-mon[32679]: pgmap v8525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:55 smithi092 ceph-mon[29156]: pgmap v8525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:27:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:56 smithi092 ceph-mon[29156]: pgmap v8526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:56 smithi189 ceph-mon[32756]: pgmap v8526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:56 smithi156 ceph-mon[32679]: pgmap v8526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14974.535705 secs 2024-04-26T22:27:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14974.535705 secs 2024-04-26T22:27:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14974.535705 secs 2024-04-26T22:27:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:59 smithi189 ceph-mon[32756]: pgmap v8527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:27:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14277.507200 secs 2024-04-26T22:27:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:59 smithi156 ceph-mon[32679]: pgmap v8527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:27:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14277.507200 secs 2024-04-26T22:27:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:59 smithi092 ceph-mon[29156]: pgmap v8527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:27:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:27:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14277.507200 secs 2024-04-26T22:28:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:01 smithi189 ceph-mon[32756]: pgmap v8528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:01 smithi156 ceph-mon[32679]: pgmap v8528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:01 smithi092 ceph-mon[29156]: pgmap v8528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:03 smithi189 ceph-mon[32756]: pgmap v8529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14979.535859 secs 2024-04-26T22:28:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:03 smithi156 ceph-mon[32679]: pgmap v8529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14979.535859 secs 2024-04-26T22:28:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:03 smithi092 ceph-mon[29156]: pgmap v8529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14979.535859 secs 2024-04-26T22:28:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14282.507321 secs 2024-04-26T22:28:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14282.507321 secs 2024-04-26T22:28:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14282.507321 secs 2024-04-26T22:28:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:05 smithi189 ceph-mon[32756]: pgmap v8530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:05 smithi156 ceph-mon[32679]: pgmap v8530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:05 smithi092 ceph-mon[29156]: pgmap v8530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:07 smithi189 ceph-mon[32756]: pgmap v8531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:07 smithi156 ceph-mon[32679]: pgmap v8531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:07 smithi092 ceph-mon[29156]: pgmap v8531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14984.535978 secs 2024-04-26T22:28:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14984.535978 secs 2024-04-26T22:28:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14984.535978 secs 2024-04-26T22:28:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:09 smithi189 ceph-mon[32756]: pgmap v8532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14287.507443 secs 2024-04-26T22:28:09.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:09 smithi092 ceph-mon[29156]: pgmap v8532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:09.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14287.507443 secs 2024-04-26T22:28:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:09 smithi156 ceph-mon[32679]: pgmap v8532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14287.507443 secs 2024-04-26T22:28:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:11 smithi189 ceph-mon[32756]: pgmap v8533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:11 smithi156 ceph-mon[32679]: pgmap v8533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:11 smithi092 ceph-mon[29156]: pgmap v8533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:13 smithi189 ceph-mon[32756]: pgmap v8534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14989.536102 secs 2024-04-26T22:28:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:13 smithi156 ceph-mon[32679]: pgmap v8534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14989.536102 secs 2024-04-26T22:28:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:13 smithi092 ceph-mon[29156]: pgmap v8534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14989.536102 secs 2024-04-26T22:28:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14292.507522 secs 2024-04-26T22:28:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14292.507522 secs 2024-04-26T22:28:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14292.507522 secs 2024-04-26T22:28:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:15 smithi189 ceph-mon[32756]: pgmap v8535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:15 smithi156 ceph-mon[32679]: pgmap v8535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:15 smithi092 ceph-mon[29156]: pgmap v8535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:17 smithi189 ceph-mon[32756]: pgmap v8536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:17 smithi156 ceph-mon[32679]: pgmap v8536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:17 smithi092 ceph-mon[29156]: pgmap v8536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:18.877 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14994.536218 secs 2024-04-26T22:28:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14994.536218 secs 2024-04-26T22:28:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14994.536218 secs 2024-04-26T22:28:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:19 smithi189 ceph-mon[32756]: pgmap v8537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14297.507674 secs 2024-04-26T22:28:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:19 smithi156 ceph-mon[32679]: pgmap v8537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14297.507674 secs 2024-04-26T22:28:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:19 smithi092 ceph-mon[29156]: pgmap v8537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14297.507674 secs 2024-04-26T22:28:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:21 smithi189 ceph-mon[32756]: pgmap v8538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:21 smithi156 ceph-mon[32679]: pgmap v8538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:21 smithi092 ceph-mon[29156]: pgmap v8538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:23 smithi189 ceph-mon[32756]: pgmap v8539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 14999.536358 secs 2024-04-26T22:28:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:23 smithi156 ceph-mon[32679]: pgmap v8539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 14999.536358 secs 2024-04-26T22:28:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:23 smithi092 ceph-mon[29156]: pgmap v8539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 14999.536358 secs 2024-04-26T22:28:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14302.507743 secs 2024-04-26T22:28:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14302.507743 secs 2024-04-26T22:28:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14302.507743 secs 2024-04-26T22:28:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:25 smithi189 ceph-mon[32756]: pgmap v8540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:25 smithi156 ceph-mon[32679]: pgmap v8540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:25 smithi092 ceph-mon[29156]: pgmap v8540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:27 smithi189 ceph-mon[32756]: pgmap v8541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:27 smithi156 ceph-mon[32679]: pgmap v8541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:27 smithi092 ceph-mon[29156]: pgmap v8541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15004.536474 secs 2024-04-26T22:28:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:28:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15004.536474 secs 2024-04-26T22:28:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:28:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15004.536474 secs 2024-04-26T22:28:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:28:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:29 smithi156 ceph-mon[32679]: pgmap v8542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14307.507817 secs 2024-04-26T22:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:28:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:29 smithi092 ceph-mon[29156]: pgmap v8542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14307.507817 secs 2024-04-26T22:28:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:28:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:29 smithi189 ceph-mon[32756]: pgmap v8542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14307.507817 secs 2024-04-26T22:28:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:28:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:28:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:28:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:30 smithi156 ceph-mon[32679]: pgmap v8543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:28:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:30 smithi156 ceph-mon[32679]: pgmap v8544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:30 smithi092 ceph-mon[29156]: pgmap v8543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:28:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:30 smithi092 ceph-mon[29156]: pgmap v8544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:30 smithi189 ceph-mon[32756]: pgmap v8543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:28:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:30 smithi189 ceph-mon[32756]: pgmap v8544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:32 smithi156 ceph-mon[32679]: pgmap v8545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:32 smithi092 ceph-mon[29156]: pgmap v8545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:32 smithi189 ceph-mon[32756]: pgmap v8545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15009.536586 secs 2024-04-26T22:28:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15009.536586 secs 2024-04-26T22:28:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15009.536586 secs 2024-04-26T22:28:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:34 smithi156 ceph-mon[32679]: pgmap v8546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:28:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14312.507888 secs 2024-04-26T22:28:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:34 smithi092 ceph-mon[29156]: pgmap v8546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:28:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14312.507888 secs 2024-04-26T22:28:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:34 smithi189 ceph-mon[32756]: pgmap v8546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:28:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14312.507888 secs 2024-04-26T22:28:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:36 smithi156 ceph-mon[32679]: pgmap v8547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:36 smithi092 ceph-mon[29156]: pgmap v8547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:36 smithi189 ceph-mon[32756]: pgmap v8547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:38 smithi156 ceph-mon[32679]: pgmap v8548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15014.536703 secs 2024-04-26T22:28:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:38 smithi092 ceph-mon[29156]: pgmap v8548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15014.536703 secs 2024-04-26T22:28:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:38 smithi189 ceph-mon[32756]: pgmap v8548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:28:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15014.536703 secs 2024-04-26T22:28:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14317.507977 secs 2024-04-26T22:28:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14317.507977 secs 2024-04-26T22:28:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14317.507977 secs 2024-04-26T22:28:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:40 smithi156 ceph-mon[32679]: pgmap v8549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:28:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:40 smithi092 ceph-mon[29156]: pgmap v8549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:28:41.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:40 smithi189 ceph-mon[32756]: pgmap v8549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:28:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:42 smithi156 ceph-mon[32679]: pgmap v8550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:42 smithi092 ceph-mon[29156]: pgmap v8550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:42 smithi189 ceph-mon[32756]: pgmap v8550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15019.536840 secs 2024-04-26T22:28:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15019.536840 secs 2024-04-26T22:28:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15019.536840 secs 2024-04-26T22:28:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:44 smithi156 ceph-mon[32679]: pgmap v8551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14322.508113 secs 2024-04-26T22:28:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:44 smithi092 ceph-mon[29156]: pgmap v8551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14322.508113 secs 2024-04-26T22:28:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:44 smithi189 ceph-mon[32756]: pgmap v8551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14322.508113 secs 2024-04-26T22:28:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:46 smithi156 ceph-mon[32679]: pgmap v8552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:46 smithi092 ceph-mon[29156]: pgmap v8552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:46 smithi189 ceph-mon[32756]: pgmap v8552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:48 smithi092 ceph-mon[29156]: pgmap v8553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15024.536933 secs 2024-04-26T22:28:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:48 smithi189 ceph-mon[32756]: pgmap v8553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15024.536933 secs 2024-04-26T22:28:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:48 smithi156 ceph-mon[32679]: pgmap v8553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15024.536933 secs 2024-04-26T22:28:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14327.508233 secs 2024-04-26T22:28:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14327.508233 secs 2024-04-26T22:28:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14327.508233 secs 2024-04-26T22:28:50.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:50 smithi092 ceph-mon[29156]: pgmap v8554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:50 smithi189 ceph-mon[32756]: pgmap v8554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:50 smithi156 ceph-mon[32679]: pgmap v8554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:52 smithi092 ceph-mon[29156]: pgmap v8555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:52 smithi189 ceph-mon[32756]: pgmap v8555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:52 smithi156 ceph-mon[32679]: pgmap v8555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15029.537004 secs 2024-04-26T22:28:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15029.537004 secs 2024-04-26T22:28:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15029.537004 secs 2024-04-26T22:28:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:54 smithi092 ceph-mon[29156]: pgmap v8556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14332.508352 secs 2024-04-26T22:28:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:54 smithi189 ceph-mon[32756]: pgmap v8556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14332.508352 secs 2024-04-26T22:28:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:54 smithi156 ceph-mon[32679]: pgmap v8556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14332.508352 secs 2024-04-26T22:28:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:56 smithi092 ceph-mon[29156]: pgmap v8557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:56 smithi189 ceph-mon[32756]: pgmap v8557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:56 smithi156 ceph-mon[32679]: pgmap v8557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:28:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:58 smithi092 ceph-mon[29156]: pgmap v8558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15034.537084 secs 2024-04-26T22:28:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:58 smithi189 ceph-mon[32756]: pgmap v8558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15034.537084 secs 2024-04-26T22:28:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:58 smithi156 ceph-mon[32679]: pgmap v8558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:28:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15034.537084 secs 2024-04-26T22:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:28:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14337.508485 secs 2024-04-26T22:29:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:28:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14337.508485 secs 2024-04-26T22:29:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:28:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14337.508485 secs 2024-04-26T22:29:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:00 smithi092 ceph-mon[29156]: pgmap v8559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:00 smithi189 ceph-mon[32756]: pgmap v8559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:00 smithi156 ceph-mon[32679]: pgmap v8559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:02.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:02 smithi156 ceph-mon[32679]: pgmap v8560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:02 smithi092 ceph-mon[29156]: pgmap v8560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:02 smithi189 ceph-mon[32756]: pgmap v8560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15039.537214 secs 2024-04-26T22:29:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15039.537214 secs 2024-04-26T22:29:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15039.537214 secs 2024-04-26T22:29:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:04 smithi092 ceph-mon[29156]: pgmap v8561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:04 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 14342.508601 secs 2024-04-26T22:29:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:04 smithi092 ceph-mon[29156]: slow request 11521.719078 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:29:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:04 smithi189 ceph-mon[32756]: pgmap v8561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:04 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 14342.508601 secs 2024-04-26T22:29:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:04 smithi189 ceph-mon[32756]: slow request 11521.719078 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:29:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:04 smithi156 ceph-mon[32679]: pgmap v8561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:04 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 14342.508601 secs 2024-04-26T22:29:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:04 smithi156 ceph-mon[32679]: slow request 11521.719078 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:29:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:06 smithi092 ceph-mon[29156]: pgmap v8562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:06 smithi189 ceph-mon[32756]: pgmap v8562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:06 smithi156 ceph-mon[32679]: pgmap v8562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:08 smithi092 ceph-mon[29156]: pgmap v8563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15044.537334 secs 2024-04-26T22:29:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:08 smithi189 ceph-mon[32756]: pgmap v8563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15044.537334 secs 2024-04-26T22:29:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:08 smithi156 ceph-mon[32679]: pgmap v8563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15044.537334 secs 2024-04-26T22:29:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14347.508693 secs 2024-04-26T22:29:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14347.508693 secs 2024-04-26T22:29:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14347.508693 secs 2024-04-26T22:29:11.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:10 smithi189 ceph-mon[32756]: pgmap v8564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:10 smithi156 ceph-mon[32679]: pgmap v8564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:10 smithi092 ceph-mon[29156]: pgmap v8564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:12 smithi189 ceph-mon[32756]: pgmap v8565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:12 smithi156 ceph-mon[32679]: pgmap v8565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:12 smithi092 ceph-mon[29156]: pgmap v8565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15049.537472 secs 2024-04-26T22:29:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15049.537472 secs 2024-04-26T22:29:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15049.537472 secs 2024-04-26T22:29:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:14 smithi189 ceph-mon[32756]: pgmap v8566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14352.508839 secs 2024-04-26T22:29:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:14 smithi156 ceph-mon[32679]: pgmap v8566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14352.508839 secs 2024-04-26T22:29:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:14 smithi092 ceph-mon[29156]: pgmap v8566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14352.508839 secs 2024-04-26T22:29:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:16 smithi189 ceph-mon[32756]: pgmap v8567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:16 smithi156 ceph-mon[32679]: pgmap v8567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:16 smithi092 ceph-mon[29156]: pgmap v8567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:18 smithi189 ceph-mon[32756]: pgmap v8568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15054.537623 secs 2024-04-26T22:29:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:18 smithi156 ceph-mon[32679]: pgmap v8568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15054.537623 secs 2024-04-26T22:29:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:18 smithi092 ceph-mon[29156]: pgmap v8568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15054.537623 secs 2024-04-26T22:29:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14357.508977 secs 2024-04-26T22:29:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14357.508977 secs 2024-04-26T22:29:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14357.508977 secs 2024-04-26T22:29:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:20 smithi189 ceph-mon[32756]: pgmap v8569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:20 smithi156 ceph-mon[32679]: pgmap v8569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:20 smithi092 ceph-mon[29156]: pgmap v8569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:22 smithi189 ceph-mon[32756]: pgmap v8570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:22 smithi156 ceph-mon[32679]: pgmap v8570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:22 smithi092 ceph-mon[29156]: pgmap v8570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15059.537735 secs 2024-04-26T22:29:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15059.537735 secs 2024-04-26T22:29:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15059.537735 secs 2024-04-26T22:29:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:24 smithi189 ceph-mon[32756]: pgmap v8571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14362.509079 secs 2024-04-26T22:29:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:24 smithi156 ceph-mon[32679]: pgmap v8571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14362.509079 secs 2024-04-26T22:29:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:24 smithi092 ceph-mon[29156]: pgmap v8571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14362.509079 secs 2024-04-26T22:29:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:26 smithi189 ceph-mon[32756]: pgmap v8572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:26 smithi156 ceph-mon[32679]: pgmap v8572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:26 smithi092 ceph-mon[29156]: pgmap v8572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:28 smithi189 ceph-mon[32756]: pgmap v8573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15064.537879 secs 2024-04-26T22:29:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:28 smithi156 ceph-mon[32679]: pgmap v8573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15064.537879 secs 2024-04-26T22:29:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:28 smithi092 ceph-mon[29156]: pgmap v8573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15064.537879 secs 2024-04-26T22:29:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14367.509208 secs 2024-04-26T22:29:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14367.509208 secs 2024-04-26T22:29:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14367.509208 secs 2024-04-26T22:29:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:30 smithi189 ceph-mon[32756]: pgmap v8574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:29:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:30 smithi156 ceph-mon[32679]: pgmap v8574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:29:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:30 smithi092 ceph-mon[29156]: pgmap v8574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:29:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:29:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:29:32.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:31 smithi156 ceph-mon[32679]: pgmap v8575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:29:32.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:31 smithi156 ceph-mon[32679]: pgmap v8576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:31 smithi189 ceph-mon[32756]: pgmap v8575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:29:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:31 smithi189 ceph-mon[32756]: pgmap v8576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:31 smithi092 ceph-mon[29156]: pgmap v8575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:29:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:31 smithi092 ceph-mon[29156]: pgmap v8576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:33 smithi189 ceph-mon[32756]: pgmap v8577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15069.538007 secs 2024-04-26T22:29:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:33 smithi156 ceph-mon[32679]: pgmap v8577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15069.538007 secs 2024-04-26T22:29:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:33 smithi092 ceph-mon[29156]: pgmap v8577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15069.538007 secs 2024-04-26T22:29:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14372.509337 secs 2024-04-26T22:29:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14372.509337 secs 2024-04-26T22:29:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14372.509337 secs 2024-04-26T22:29:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:35 smithi189 ceph-mon[32756]: pgmap v8578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:35 smithi156 ceph-mon[32679]: pgmap v8578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:35 smithi092 ceph-mon[29156]: pgmap v8578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:37 smithi092 ceph-mon[29156]: pgmap v8579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:37 smithi189 ceph-mon[32756]: pgmap v8579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:37 smithi156 ceph-mon[32679]: pgmap v8579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:29:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15074.538091 secs 2024-04-26T22:29:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15074.538091 secs 2024-04-26T22:29:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15074.538091 secs 2024-04-26T22:29:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:39 smithi189 ceph-mon[32756]: pgmap v8580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14377.509459 secs 2024-04-26T22:29:40.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:39 smithi092 ceph-mon[29156]: pgmap v8580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:40.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14377.509459 secs 2024-04-26T22:29:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:39 smithi156 ceph-mon[32679]: pgmap v8580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:29:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14377.509459 secs 2024-04-26T22:29:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:41 smithi189 ceph-mon[32756]: pgmap v8581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:29:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:41 smithi156 ceph-mon[32679]: pgmap v8581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:29:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:41 smithi092 ceph-mon[29156]: pgmap v8581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:29:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:43 smithi189 ceph-mon[32756]: pgmap v8582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15079.538172 secs 2024-04-26T22:29:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:43 smithi156 ceph-mon[32679]: pgmap v8582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15079.538172 secs 2024-04-26T22:29:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:43 smithi092 ceph-mon[29156]: pgmap v8582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15079.538172 secs 2024-04-26T22:29:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14382.509576 secs 2024-04-26T22:29:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14382.509576 secs 2024-04-26T22:29:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14382.509576 secs 2024-04-26T22:29:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:45 smithi189 ceph-mon[32756]: pgmap v8583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:45 smithi156 ceph-mon[32679]: pgmap v8583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:45 smithi092 ceph-mon[29156]: pgmap v8583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:47 smithi189 ceph-mon[32756]: pgmap v8584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:47 smithi156 ceph-mon[32679]: pgmap v8584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:47 smithi092 ceph-mon[29156]: pgmap v8584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15084.538239 secs 2024-04-26T22:29:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15084.538239 secs 2024-04-26T22:29:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15084.538239 secs 2024-04-26T22:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:49 smithi189 ceph-mon[32756]: pgmap v8585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14387.509693 secs 2024-04-26T22:29:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:49 smithi156 ceph-mon[32679]: pgmap v8585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14387.509693 secs 2024-04-26T22:29:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:49 smithi092 ceph-mon[29156]: pgmap v8585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14387.509693 secs 2024-04-26T22:29:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:51 smithi189 ceph-mon[32756]: pgmap v8586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:51 smithi156 ceph-mon[32679]: pgmap v8586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:51 smithi092 ceph-mon[29156]: pgmap v8586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:53 smithi189 ceph-mon[32756]: pgmap v8587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15089.538360 secs 2024-04-26T22:29:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:53 smithi156 ceph-mon[32679]: pgmap v8587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15089.538360 secs 2024-04-26T22:29:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:53 smithi092 ceph-mon[29156]: pgmap v8587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15089.538360 secs 2024-04-26T22:29:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14392.509807 secs 2024-04-26T22:29:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14392.509807 secs 2024-04-26T22:29:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14392.509807 secs 2024-04-26T22:29:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:55 smithi189 ceph-mon[32756]: pgmap v8588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:55 smithi156 ceph-mon[32679]: pgmap v8588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:55 smithi092 ceph-mon[29156]: pgmap v8588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:29:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:57 smithi189 ceph-mon[32756]: pgmap v8589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:57 smithi156 ceph-mon[32679]: pgmap v8589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:57 smithi092 ceph-mon[29156]: pgmap v8589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:29:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15094.538458 secs 2024-04-26T22:29:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15094.538458 secs 2024-04-26T22:29:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15094.538458 secs 2024-04-26T22:30:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:59 smithi189 ceph-mon[32756]: pgmap v8590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:29:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14397.509868 secs 2024-04-26T22:30:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:59 smithi156 ceph-mon[32679]: pgmap v8590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:29:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14397.509868 secs 2024-04-26T22:30:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:59 smithi092 ceph-mon[29156]: pgmap v8590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:29:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14397.509868 secs 2024-04-26T22:30:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:30:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:30:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:30:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:01 smithi189 ceph-mon[32756]: pgmap v8591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:01 smithi156 ceph-mon[32679]: pgmap v8591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:01 smithi092 ceph-mon[29156]: pgmap v8591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:03 smithi189 ceph-mon[32756]: pgmap v8592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15099.538580 secs 2024-04-26T22:30:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:03 smithi156 ceph-mon[32679]: pgmap v8592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15099.538580 secs 2024-04-26T22:30:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:03 smithi092 ceph-mon[29156]: pgmap v8592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15099.538580 secs 2024-04-26T22:30:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14402.509948 secs 2024-04-26T22:30:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14402.509948 secs 2024-04-26T22:30:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14402.509948 secs 2024-04-26T22:30:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:05 smithi156 ceph-mon[32679]: pgmap v8593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:05 smithi092 ceph-mon[29156]: pgmap v8593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:05 smithi189 ceph-mon[32756]: pgmap v8593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:07 smithi156 ceph-mon[32679]: pgmap v8594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:07 smithi092 ceph-mon[29156]: pgmap v8594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:07 smithi189 ceph-mon[32756]: pgmap v8594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15104.538731 secs 2024-04-26T22:30:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15104.538731 secs 2024-04-26T22:30:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15104.538731 secs 2024-04-26T22:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:09 smithi156 ceph-mon[32679]: pgmap v8595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14407.510066 secs 2024-04-26T22:30:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:09 smithi092 ceph-mon[29156]: pgmap v8595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14407.510066 secs 2024-04-26T22:30:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:09 smithi189 ceph-mon[32756]: pgmap v8595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14407.510066 secs 2024-04-26T22:30:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:11 smithi156 ceph-mon[32679]: pgmap v8596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:12.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:11 smithi189 ceph-mon[32756]: pgmap v8596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:11 smithi092 ceph-mon[29156]: pgmap v8596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:13 smithi156 ceph-mon[32679]: pgmap v8597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15109.538794 secs 2024-04-26T22:30:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:13 smithi092 ceph-mon[29156]: pgmap v8597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15109.538794 secs 2024-04-26T22:30:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:13 smithi189 ceph-mon[32756]: pgmap v8597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15109.538794 secs 2024-04-26T22:30:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14412.510169 secs 2024-04-26T22:30:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14412.510169 secs 2024-04-26T22:30:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14412.510169 secs 2024-04-26T22:30:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:15 smithi156 ceph-mon[32679]: pgmap v8598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:15 smithi092 ceph-mon[29156]: pgmap v8598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:15 smithi189 ceph-mon[32756]: pgmap v8598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:16 smithi156 ceph-mon[32679]: pgmap v8599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:16 smithi092 ceph-mon[29156]: pgmap v8599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:16 smithi189 ceph-mon[32756]: pgmap v8599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:19 smithi189 ceph-mon[32756]: pgmap v8600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15114.538934 secs 2024-04-26T22:30:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:19 smithi156 ceph-mon[32679]: pgmap v8600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15114.538934 secs 2024-04-26T22:30:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:19 smithi092 ceph-mon[29156]: pgmap v8600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15114.538934 secs 2024-04-26T22:30:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14417.510257 secs 2024-04-26T22:30:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14417.510257 secs 2024-04-26T22:30:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14417.510257 secs 2024-04-26T22:30:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:21 smithi156 ceph-mon[32679]: pgmap v8601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:21 smithi092 ceph-mon[29156]: pgmap v8601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:21 smithi189 ceph-mon[32756]: pgmap v8601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:23 smithi156 ceph-mon[32679]: pgmap v8602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:23 smithi092 ceph-mon[29156]: pgmap v8602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:23 smithi189 ceph-mon[32756]: pgmap v8602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15119.539020 secs 2024-04-26T22:30:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15119.539020 secs 2024-04-26T22:30:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15119.539020 secs 2024-04-26T22:30:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14422.510375 secs 2024-04-26T22:30:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:25 smithi189 ceph-mon[32756]: pgmap v8603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14422.510375 secs 2024-04-26T22:30:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:25 smithi156 ceph-mon[32679]: pgmap v8603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14422.510375 secs 2024-04-26T22:30:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:25 smithi092 ceph-mon[29156]: pgmap v8603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:27 smithi156 ceph-mon[32679]: pgmap v8604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:27 smithi092 ceph-mon[29156]: pgmap v8604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:27 smithi189 ceph-mon[32756]: pgmap v8604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:29 smithi156 ceph-mon[32679]: pgmap v8605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15124.539171 secs 2024-04-26T22:30:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:29 smithi092 ceph-mon[29156]: pgmap v8605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15124.539171 secs 2024-04-26T22:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:29 smithi189 ceph-mon[32756]: pgmap v8605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15124.539171 secs 2024-04-26T22:30:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14427.510511 secs 2024-04-26T22:30:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14427.510511 secs 2024-04-26T22:30:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14427.510511 secs 2024-04-26T22:30:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:31 smithi156 ceph-mon[32679]: pgmap v8606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:31.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:31 smithi092 ceph-mon[29156]: pgmap v8606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:31.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:31 smithi189 ceph-mon[32756]: pgmap v8606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:30:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:33 smithi156 ceph-mon[32679]: pgmap v8607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:33 smithi092 ceph-mon[29156]: pgmap v8607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:33 smithi189 ceph-mon[32756]: pgmap v8607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15129.539235 secs 2024-04-26T22:30:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15129.539235 secs 2024-04-26T22:30:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15129.539235 secs 2024-04-26T22:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14432.510574 secs 2024-04-26T22:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: pgmap v8608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: pgmap v8609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: pgmap v8610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14432.510574 secs 2024-04-26T22:30:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: pgmap v8608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: pgmap v8609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: pgmap v8610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14432.510574 secs 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: pgmap v8608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:30:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: pgmap v8609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:30:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: pgmap v8610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:30:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:37 smithi092 ceph-mon[29156]: pgmap v8611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:30:38.055+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:30:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:30:38.055+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:30:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:30:38.056+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:30:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:30:38.056+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 119 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:30:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:37 smithi189 ceph-mon[32756]: pgmap v8611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:37 smithi156 ceph-mon[32679]: pgmap v8611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:30:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15134.539357 secs 2024-04-26T22:30:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15134.539357 secs 2024-04-26T22:30:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15134.539357 secs 2024-04-26T22:30:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14437.510710 secs 2024-04-26T22:30:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:39 smithi092 ceph-mon[29156]: pgmap v8612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14437.510710 secs 2024-04-26T22:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:39 smithi189 ceph-mon[32756]: pgmap v8612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14437.510710 secs 2024-04-26T22:30:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:39 smithi156 ceph-mon[32679]: pgmap v8612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:42.058 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:41 smithi092 ceph-mon[29156]: pgmap v8613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:41 smithi189 ceph-mon[32756]: pgmap v8613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:41 smithi156 ceph-mon[32679]: pgmap v8613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 238 B/s wr, 4 op/s 2024-04-26T22:30:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:43 smithi189 ceph-mon[32756]: pgmap v8614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 238 B/s wr, 2 op/s 2024-04-26T22:30:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15139.539436 secs 2024-04-26T22:30:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:43 smithi156 ceph-mon[32679]: pgmap v8614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 238 B/s wr, 2 op/s 2024-04-26T22:30:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15139.539436 secs 2024-04-26T22:30:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:43 smithi092 ceph-mon[29156]: pgmap v8614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 238 B/s wr, 2 op/s 2024-04-26T22:30:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15139.539436 secs 2024-04-26T22:30:45.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14442.510823 secs 2024-04-26T22:30:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14442.510823 secs 2024-04-26T22:30:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14442.510823 secs 2024-04-26T22:30:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:45 smithi189 ceph-mon[32756]: pgmap v8615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T22:30:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:45 smithi156 ceph-mon[32679]: pgmap v8615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T22:30:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:45 smithi092 ceph-mon[29156]: pgmap v8615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-26T22:30:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:47 smithi189 ceph-mon[32756]: pgmap v8616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:30:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:47 smithi156 ceph-mon[32679]: pgmap v8616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:30:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:47 smithi092 ceph-mon[29156]: pgmap v8616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:30:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15144.539512 secs 2024-04-26T22:30:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15144.539512 secs 2024-04-26T22:30:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15144.539512 secs 2024-04-26T22:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14447.510937 secs 2024-04-26T22:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:49 smithi189 ceph-mon[32756]: pgmap v8617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14447.510937 secs 2024-04-26T22:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:49 smithi156 ceph-mon[32679]: pgmap v8617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:30:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14447.510937 secs 2024-04-26T22:30:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:49 smithi092 ceph-mon[29156]: pgmap v8617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:30:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:51 smithi189 ceph-mon[32756]: pgmap v8618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:51 smithi156 ceph-mon[32679]: pgmap v8618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:51 smithi092 ceph-mon[29156]: pgmap v8618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:53 smithi189 ceph-mon[32756]: pgmap v8619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15149.539585 secs 2024-04-26T22:30:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:53 smithi156 ceph-mon[32679]: pgmap v8619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15149.539585 secs 2024-04-26T22:30:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:53 smithi092 ceph-mon[29156]: pgmap v8619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:54.320 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15149.539585 secs 2024-04-26T22:30:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14452.511056 secs 2024-04-26T22:30:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14452.511056 secs 2024-04-26T22:30:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14452.511056 secs 2024-04-26T22:30:56.056 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:55 smithi092 ceph-mon[29156]: pgmap v8620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:55 smithi189 ceph-mon[32756]: pgmap v8620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:55 smithi156 ceph-mon[32679]: pgmap v8620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:30:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:57 smithi189 ceph-mon[32756]: pgmap v8621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:57 smithi156 ceph-mon[32679]: pgmap v8621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:57 smithi092 ceph-mon[29156]: pgmap v8621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:30:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15154.539709 secs 2024-04-26T22:30:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15154.539709 secs 2024-04-26T22:30:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15154.539709 secs 2024-04-26T22:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14457.511131 secs 2024-04-26T22:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:30:59 smithi189 ceph-mon[32756]: pgmap v8622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14457.511131 secs 2024-04-26T22:31:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:30:59 smithi156 ceph-mon[32679]: pgmap v8622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14457.511131 secs 2024-04-26T22:31:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:30:59 smithi092 ceph-mon[29156]: pgmap v8622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:01 smithi189 ceph-mon[32756]: pgmap v8623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:01 smithi156 ceph-mon[32679]: pgmap v8623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:01 smithi092 ceph-mon[29156]: pgmap v8623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:03 smithi189 ceph-mon[32756]: pgmap v8624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15159.539844 secs 2024-04-26T22:31:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:03 smithi156 ceph-mon[32679]: pgmap v8624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15159.539844 secs 2024-04-26T22:31:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:03 smithi092 ceph-mon[29156]: pgmap v8624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15159.539844 secs 2024-04-26T22:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14462.511245 secs 2024-04-26T22:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14462.511245 secs 2024-04-26T22:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14462.511245 secs 2024-04-26T22:31:05.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:31:04.823+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:31:05.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:31:04.823+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:31:05.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:31:04.823+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:31:05.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:31:04.823+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:31:05.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:31:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:31:04.823+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:31:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:05 smithi189 ceph-mon[32756]: pgmap v8625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:05 smithi156 ceph-mon[32679]: pgmap v8625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:05 smithi092 ceph-mon[29156]: pgmap v8625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:07 smithi189 ceph-mon[32756]: pgmap v8626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:07 smithi156 ceph-mon[32679]: pgmap v8626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:07 smithi092 ceph-mon[29156]: pgmap v8626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15164.539965 secs 2024-04-26T22:31:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15164.539965 secs 2024-04-26T22:31:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15164.539965 secs 2024-04-26T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14467.511361 secs 2024-04-26T22:31:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:09 smithi189 ceph-mon[32756]: pgmap v8627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14467.511361 secs 2024-04-26T22:31:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:09 smithi156 ceph-mon[32679]: pgmap v8627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14467.511361 secs 2024-04-26T22:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:09 smithi092 ceph-mon[29156]: pgmap v8627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:11 smithi189 ceph-mon[32756]: pgmap v8628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:11 smithi156 ceph-mon[32679]: pgmap v8628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:11 smithi092 ceph-mon[29156]: pgmap v8628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:13 smithi189 ceph-mon[32756]: pgmap v8629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15169.540061 secs 2024-04-26T22:31:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:13 smithi156 ceph-mon[32679]: pgmap v8629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15169.540061 secs 2024-04-26T22:31:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:13 smithi092 ceph-mon[29156]: pgmap v8629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15169.540061 secs 2024-04-26T22:31:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14472.511428 secs 2024-04-26T22:31:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14472.511428 secs 2024-04-26T22:31:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14472.511428 secs 2024-04-26T22:31:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:15 smithi189 ceph-mon[32756]: pgmap v8630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:15 smithi156 ceph-mon[32679]: pgmap v8630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:15 smithi092 ceph-mon[29156]: pgmap v8630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:17 smithi189 ceph-mon[32756]: pgmap v8631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:17 smithi156 ceph-mon[32679]: pgmap v8631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:17 smithi092 ceph-mon[29156]: pgmap v8631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T22:31:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15174.540185 secs 2024-04-26T22:31:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15174.540185 secs 2024-04-26T22:31:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15174.540185 secs 2024-04-26T22:31:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14477.511530 secs 2024-04-26T22:31:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:19 smithi189 ceph-mon[32756]: pgmap v8632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14477.511530 secs 2024-04-26T22:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:19 smithi156 ceph-mon[32679]: pgmap v8632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14477.511530 secs 2024-04-26T22:31:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:19 smithi092 ceph-mon[29156]: pgmap v8632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T22:31:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:21 smithi189 ceph-mon[32756]: pgmap v8633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:21 smithi156 ceph-mon[32679]: pgmap v8633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:21 smithi092 ceph-mon[29156]: pgmap v8633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:23 smithi189 ceph-mon[32756]: pgmap v8634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15179.540269 secs 2024-04-26T22:31:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:23 smithi156 ceph-mon[32679]: pgmap v8634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15179.540269 secs 2024-04-26T22:31:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:23 smithi092 ceph-mon[29156]: pgmap v8634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15179.540269 secs 2024-04-26T22:31:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14482.511670 secs 2024-04-26T22:31:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14482.511670 secs 2024-04-26T22:31:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14482.511670 secs 2024-04-26T22:31:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:25 smithi189 ceph-mon[32756]: pgmap v8635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:26.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:25 smithi092 ceph-mon[29156]: pgmap v8635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:25 smithi156 ceph-mon[32679]: pgmap v8635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:27 smithi189 ceph-mon[32756]: pgmap v8636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:27 smithi156 ceph-mon[32679]: pgmap v8636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:27 smithi092 ceph-mon[29156]: pgmap v8636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15184.540388 secs 2024-04-26T22:31:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15184.540388 secs 2024-04-26T22:31:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15184.540388 secs 2024-04-26T22:31:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14487.511788 secs 2024-04-26T22:31:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:29 smithi189 ceph-mon[32756]: pgmap v8637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14487.511788 secs 2024-04-26T22:31:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:29 smithi156 ceph-mon[32679]: pgmap v8637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14487.511788 secs 2024-04-26T22:31:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:29 smithi092 ceph-mon[29156]: pgmap v8637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:31 smithi189 ceph-mon[32756]: pgmap v8638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:31 smithi156 ceph-mon[32679]: pgmap v8638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:31 smithi092 ceph-mon[29156]: pgmap v8638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:33 smithi189 ceph-mon[32756]: pgmap v8639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15189.540489 secs 2024-04-26T22:31:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:33 smithi156 ceph-mon[32679]: pgmap v8639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15189.540489 secs 2024-04-26T22:31:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:33 smithi092 ceph-mon[29156]: pgmap v8639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15189.540489 secs 2024-04-26T22:31:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14492.511937 secs 2024-04-26T22:31:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14492.511937 secs 2024-04-26T22:31:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14492.511937 secs 2024-04-26T22:31:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:35 smithi189 ceph-mon[32756]: pgmap v8640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:35 smithi156 ceph-mon[32679]: pgmap v8640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:35 smithi092 ceph-mon[29156]: pgmap v8640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:31:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:37 smithi189 ceph-mon[32756]: pgmap v8641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:37 smithi156 ceph-mon[32679]: pgmap v8641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:37 smithi092 ceph-mon[29156]: pgmap v8641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:39.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15194.540629 secs 2024-04-26T22:31:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15194.540629 secs 2024-04-26T22:31:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15194.540629 secs 2024-04-26T22:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14497.512054 secs 2024-04-26T22:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: pgmap v8642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14497.512054 secs 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: pgmap v8642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14497.512054 secs 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: pgmap v8642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:31:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:40 smithi156 ceph-mon[32679]: pgmap v8643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:31:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:40 smithi156 ceph-mon[32679]: pgmap v8644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:40 smithi092 ceph-mon[29156]: pgmap v8643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:31:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:40 smithi092 ceph-mon[29156]: pgmap v8644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:40 smithi189 ceph-mon[32756]: pgmap v8643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:31:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:40 smithi189 ceph-mon[32756]: pgmap v8644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:42 smithi156 ceph-mon[32679]: pgmap v8645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:43.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:42 smithi189 ceph-mon[32756]: pgmap v8645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:42 smithi092 ceph-mon[29156]: pgmap v8645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15199.540778 secs 2024-04-26T22:31:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15199.540778 secs 2024-04-26T22:31:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15199.540778 secs 2024-04-26T22:31:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:44 smithi156 ceph-mon[32679]: pgmap v8646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14502.512175 secs 2024-04-26T22:31:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:44 smithi092 ceph-mon[29156]: pgmap v8646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14502.512175 secs 2024-04-26T22:31:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:44 smithi189 ceph-mon[32756]: pgmap v8646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14502.512175 secs 2024-04-26T22:31:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:46 smithi156 ceph-mon[32679]: pgmap v8647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:46 smithi092 ceph-mon[29156]: pgmap v8647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:46 smithi189 ceph-mon[32756]: pgmap v8647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:31:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:48 smithi156 ceph-mon[32679]: pgmap v8648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15204.540899 secs 2024-04-26T22:31:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:48 smithi092 ceph-mon[29156]: pgmap v8648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15204.540899 secs 2024-04-26T22:31:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:48 smithi189 ceph-mon[32756]: pgmap v8648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:31:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15204.540899 secs 2024-04-26T22:31:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14507.512312 secs 2024-04-26T22:31:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14507.512312 secs 2024-04-26T22:31:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14507.512312 secs 2024-04-26T22:31:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:50 smithi156 ceph-mon[32679]: pgmap v8649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:31:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:50 smithi092 ceph-mon[29156]: pgmap v8649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:31:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:50 smithi189 ceph-mon[32756]: pgmap v8649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:31:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:51 smithi092 ceph-mon[29156]: pgmap v8650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:51 smithi189 ceph-mon[32756]: pgmap v8650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:51 smithi156 ceph-mon[32679]: pgmap v8650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:54 smithi156 ceph-mon[32679]: pgmap v8651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15209.540980 secs 2024-04-26T22:31:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:54 smithi092 ceph-mon[29156]: pgmap v8651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15209.540980 secs 2024-04-26T22:31:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:54 smithi189 ceph-mon[32756]: pgmap v8651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15209.540980 secs 2024-04-26T22:31:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14512.512395 secs 2024-04-26T22:31:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14512.512395 secs 2024-04-26T22:31:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14512.512395 secs 2024-04-26T22:31:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:56 smithi156 ceph-mon[32679]: pgmap v8652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:56 smithi092 ceph-mon[29156]: pgmap v8652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:56 smithi189 ceph-mon[32756]: pgmap v8652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:31:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:58 smithi156 ceph-mon[32679]: pgmap v8653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:58 smithi092 ceph-mon[29156]: pgmap v8653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:58 smithi189 ceph-mon[32756]: pgmap v8653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:31:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:31:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15214.541097 secs 2024-04-26T22:31:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:31:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15214.541097 secs 2024-04-26T22:31:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:31:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15214.541097 secs 2024-04-26T22:32:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14517.512489 secs 2024-04-26T22:32:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:00 smithi156 ceph-mon[32679]: pgmap v8654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14517.512489 secs 2024-04-26T22:32:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:00 smithi092 ceph-mon[29156]: pgmap v8654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14517.512489 secs 2024-04-26T22:32:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:00 smithi189 ceph-mon[32756]: pgmap v8654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:02 smithi156 ceph-mon[32679]: pgmap v8655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:02 smithi092 ceph-mon[29156]: pgmap v8655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:02 smithi189 ceph-mon[32756]: pgmap v8655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:04 smithi156 ceph-mon[32679]: pgmap v8656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15219.541213 secs 2024-04-26T22:32:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:04 smithi092 ceph-mon[29156]: pgmap v8656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15219.541213 secs 2024-04-26T22:32:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:04 smithi189 ceph-mon[32756]: pgmap v8656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15219.541213 secs 2024-04-26T22:32:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14522.512608 secs 2024-04-26T22:32:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14522.512608 secs 2024-04-26T22:32:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14522.512608 secs 2024-04-26T22:32:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:06 smithi092 ceph-mon[29156]: pgmap v8657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:06 smithi189 ceph-mon[32756]: pgmap v8657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:06 smithi156 ceph-mon[32679]: pgmap v8657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:08 smithi092 ceph-mon[29156]: pgmap v8658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:08 smithi189 ceph-mon[32756]: pgmap v8658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:08 smithi156 ceph-mon[32679]: pgmap v8658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15224.541356 secs 2024-04-26T22:32:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15224.541356 secs 2024-04-26T22:32:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15224.541356 secs 2024-04-26T22:32:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14527.512744 secs 2024-04-26T22:32:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:10 smithi092 ceph-mon[29156]: pgmap v8659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14527.512744 secs 2024-04-26T22:32:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:10 smithi189 ceph-mon[32756]: pgmap v8659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14527.512744 secs 2024-04-26T22:32:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:10 smithi156 ceph-mon[32679]: pgmap v8659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:12 smithi092 ceph-mon[29156]: pgmap v8660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:12 smithi189 ceph-mon[32756]: pgmap v8660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:12 smithi156 ceph-mon[32679]: pgmap v8660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:14 smithi189 ceph-mon[32756]: pgmap v8661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15229.541484 secs 2024-04-26T22:32:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:14 smithi156 ceph-mon[32679]: pgmap v8661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15229.541484 secs 2024-04-26T22:32:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:14 smithi092 ceph-mon[29156]: pgmap v8661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:32:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15229.541484 secs 2024-04-26T22:32:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14532.512825 secs 2024-04-26T22:32:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14532.512825 secs 2024-04-26T22:32:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14532.512825 secs 2024-04-26T22:32:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:16 smithi189 ceph-mon[32756]: pgmap v8662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:16 smithi156 ceph-mon[32679]: pgmap v8662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:16 smithi092 ceph-mon[29156]: pgmap v8662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:32:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:18 smithi189 ceph-mon[32756]: pgmap v8663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:18 smithi156 ceph-mon[32679]: pgmap v8663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:18 smithi092 ceph-mon[29156]: pgmap v8663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15234.541621 secs 2024-04-26T22:32:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15234.541621 secs 2024-04-26T22:32:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15234.541621 secs 2024-04-26T22:32:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14537.512946 secs 2024-04-26T22:32:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:20 smithi189 ceph-mon[32756]: pgmap v8664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14537.512946 secs 2024-04-26T22:32:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:20 smithi156 ceph-mon[32679]: pgmap v8664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14537.512946 secs 2024-04-26T22:32:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:20 smithi092 ceph-mon[29156]: pgmap v8664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:22 smithi189 ceph-mon[32756]: pgmap v8665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:22 smithi156 ceph-mon[32679]: pgmap v8665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:22 smithi092 ceph-mon[29156]: pgmap v8665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:24 smithi189 ceph-mon[32756]: pgmap v8666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15239.541738 secs 2024-04-26T22:32:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:24 smithi156 ceph-mon[32679]: pgmap v8666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15239.541738 secs 2024-04-26T22:32:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:24 smithi092 ceph-mon[29156]: pgmap v8666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15239.541738 secs 2024-04-26T22:32:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14542.513045 secs 2024-04-26T22:32:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14542.513045 secs 2024-04-26T22:32:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14542.513045 secs 2024-04-26T22:32:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:26 smithi156 ceph-mon[32679]: pgmap v8667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:26 smithi092 ceph-mon[29156]: pgmap v8667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:26 smithi189 ceph-mon[32756]: pgmap v8667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:28 smithi156 ceph-mon[32679]: pgmap v8668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:28 smithi092 ceph-mon[29156]: pgmap v8668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:28 smithi189 ceph-mon[32756]: pgmap v8668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15244.541863 secs 2024-04-26T22:32:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15244.541863 secs 2024-04-26T22:32:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15244.541863 secs 2024-04-26T22:32:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14547.513162 secs 2024-04-26T22:32:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:30 smithi156 ceph-mon[32679]: pgmap v8669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14547.513162 secs 2024-04-26T22:32:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:30 smithi092 ceph-mon[29156]: pgmap v8669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14547.513162 secs 2024-04-26T22:32:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:30 smithi189 ceph-mon[32756]: pgmap v8669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:32 smithi156 ceph-mon[32679]: pgmap v8670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:32 smithi092 ceph-mon[29156]: pgmap v8670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:32 smithi189 ceph-mon[32756]: pgmap v8670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:34 smithi156 ceph-mon[32679]: pgmap v8671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15249.541974 secs 2024-04-26T22:32:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:34 smithi092 ceph-mon[29156]: pgmap v8671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15249.541974 secs 2024-04-26T22:32:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:34 smithi189 ceph-mon[32756]: pgmap v8671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15249.541974 secs 2024-04-26T22:32:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14552.513283 secs 2024-04-26T22:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14552.513283 secs 2024-04-26T22:32:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14552.513283 secs 2024-04-26T22:32:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:36 smithi156 ceph-mon[32679]: pgmap v8672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:36 smithi092 ceph-mon[29156]: pgmap v8672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:36 smithi189 ceph-mon[32756]: pgmap v8672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:38 smithi156 ceph-mon[32679]: pgmap v8673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:38 smithi092 ceph-mon[29156]: pgmap v8673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:38 smithi189 ceph-mon[32756]: pgmap v8673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15254.542059 secs 2024-04-26T22:32:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15254.542059 secs 2024-04-26T22:32:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15254.542059 secs 2024-04-26T22:32:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14557.513440 secs 2024-04-26T22:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: pgmap v8674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14557.513440 secs 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: pgmap v8674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14557.513440 secs 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: pgmap v8674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:32:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:41 smithi092 ceph-mon[29156]: pgmap v8675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:32:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:41 smithi092 ceph-mon[29156]: pgmap v8676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:41 smithi189 ceph-mon[32756]: pgmap v8675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:32:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:41 smithi189 ceph-mon[32756]: pgmap v8676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:41 smithi156 ceph-mon[32679]: pgmap v8675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:32:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:41 smithi156 ceph-mon[32679]: pgmap v8676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:43 smithi092 ceph-mon[29156]: pgmap v8677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:43 smithi189 ceph-mon[32756]: pgmap v8677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:43 smithi156 ceph-mon[32679]: pgmap v8677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15259.542142 secs 2024-04-26T22:32:44.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15259.542142 secs 2024-04-26T22:32:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15259.542142 secs 2024-04-26T22:32:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14562.513503 secs 2024-04-26T22:32:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:45 smithi092 ceph-mon[29156]: pgmap v8678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14562.513503 secs 2024-04-26T22:32:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:45 smithi189 ceph-mon[32756]: pgmap v8678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14562.513503 secs 2024-04-26T22:32:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:45 smithi156 ceph-mon[32679]: pgmap v8678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:47 smithi092 ceph-mon[29156]: pgmap v8679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:47 smithi189 ceph-mon[32756]: pgmap v8679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:47 smithi156 ceph-mon[32679]: pgmap v8679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:32:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:49 smithi092 ceph-mon[29156]: pgmap v8680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:32:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15264.542224 secs 2024-04-26T22:32:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:49 smithi189 ceph-mon[32756]: pgmap v8680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:32:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15264.542224 secs 2024-04-26T22:32:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:49 smithi156 ceph-mon[32679]: pgmap v8680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:32:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15264.542224 secs 2024-04-26T22:32:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14567.513648 secs 2024-04-26T22:32:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14567.513648 secs 2024-04-26T22:32:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14567.513648 secs 2024-04-26T22:32:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:51 smithi092 ceph-mon[29156]: pgmap v8681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:32:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:51 smithi189 ceph-mon[32756]: pgmap v8681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:32:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:51 smithi156 ceph-mon[32679]: pgmap v8681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:32:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:53 smithi092 ceph-mon[29156]: pgmap v8682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:53 smithi189 ceph-mon[32756]: pgmap v8682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:53 smithi156 ceph-mon[32679]: pgmap v8682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:32:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15269.542309 secs 2024-04-26T22:32:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15269.542309 secs 2024-04-26T22:32:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15269.542309 secs 2024-04-26T22:32:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14572.513748 secs 2024-04-26T22:32:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:55 smithi092 ceph-mon[29156]: pgmap v8683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:32:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14572.513748 secs 2024-04-26T22:32:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:55 smithi189 ceph-mon[32756]: pgmap v8683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:32:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14572.513748 secs 2024-04-26T22:32:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:55 smithi156 ceph-mon[32679]: pgmap v8683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:32:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:57 smithi092 ceph-mon[29156]: pgmap v8684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:57 smithi189 ceph-mon[32756]: pgmap v8684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:57 smithi156 ceph-mon[32679]: pgmap v8684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:59 smithi092 ceph-mon[29156]: pgmap v8685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:32:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15274.542366 secs 2024-04-26T22:32:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:59 smithi189 ceph-mon[32756]: pgmap v8685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:32:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15274.542366 secs 2024-04-26T22:32:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:59 smithi156 ceph-mon[32679]: pgmap v8685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:32:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:32:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15274.542366 secs 2024-04-26T22:33:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14577.513863 secs 2024-04-26T22:33:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14577.513863 secs 2024-04-26T22:33:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14577.513863 secs 2024-04-26T22:33:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:01 smithi092 ceph-mon[29156]: pgmap v8686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:01 smithi189 ceph-mon[32756]: pgmap v8686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:01 smithi156 ceph-mon[32679]: pgmap v8686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:03 smithi092 ceph-mon[29156]: pgmap v8687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:03 smithi189 ceph-mon[32756]: pgmap v8687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:03 smithi156 ceph-mon[32679]: pgmap v8687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15279.542438 secs 2024-04-26T22:33:04.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15279.542438 secs 2024-04-26T22:33:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15279.542438 secs 2024-04-26T22:33:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14582.514000 secs 2024-04-26T22:33:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:05 smithi092 ceph-mon[29156]: pgmap v8688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14582.514000 secs 2024-04-26T22:33:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:05 smithi189 ceph-mon[32756]: pgmap v8688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14582.514000 secs 2024-04-26T22:33:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:05 smithi156 ceph-mon[32679]: pgmap v8688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:07 smithi189 ceph-mon[32756]: pgmap v8689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:07 smithi156 ceph-mon[32679]: pgmap v8689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:07 smithi092 ceph-mon[29156]: pgmap v8689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:09 smithi189 ceph-mon[32756]: pgmap v8690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15284.542530 secs 2024-04-26T22:33:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:09 smithi156 ceph-mon[32679]: pgmap v8690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15284.542530 secs 2024-04-26T22:33:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:09 smithi092 ceph-mon[29156]: pgmap v8690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15284.542530 secs 2024-04-26T22:33:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14587.514134 secs 2024-04-26T22:33:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14587.514134 secs 2024-04-26T22:33:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14587.514134 secs 2024-04-26T22:33:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:11 smithi189 ceph-mon[32756]: pgmap v8691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:11 smithi156 ceph-mon[32679]: pgmap v8691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:11 smithi092 ceph-mon[29156]: pgmap v8691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:13 smithi189 ceph-mon[32756]: pgmap v8692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:13 smithi156 ceph-mon[32679]: pgmap v8692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:13 smithi092 ceph-mon[29156]: pgmap v8692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:33:14.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15289.542664 secs 2024-04-26T22:33:14.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15289.542664 secs 2024-04-26T22:33:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15289.542664 secs 2024-04-26T22:33:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14592.514257 secs 2024-04-26T22:33:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:15 smithi189 ceph-mon[32756]: pgmap v8693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14592.514257 secs 2024-04-26T22:33:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:15 smithi156 ceph-mon[32679]: pgmap v8693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14592.514257 secs 2024-04-26T22:33:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:15 smithi092 ceph-mon[29156]: pgmap v8693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:33:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:17 smithi189 ceph-mon[32756]: pgmap v8694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:17 smithi156 ceph-mon[32679]: pgmap v8694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:17 smithi092 ceph-mon[29156]: pgmap v8694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:19 smithi189 ceph-mon[32756]: pgmap v8695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15294.542806 secs 2024-04-26T22:33:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:19 smithi156 ceph-mon[32679]: pgmap v8695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15294.542806 secs 2024-04-26T22:33:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:19 smithi092 ceph-mon[29156]: pgmap v8695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15294.542806 secs 2024-04-26T22:33:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14597.514362 secs 2024-04-26T22:33:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14597.514362 secs 2024-04-26T22:33:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14597.514362 secs 2024-04-26T22:33:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:21 smithi189 ceph-mon[32756]: pgmap v8696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:21 smithi156 ceph-mon[32679]: pgmap v8696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:21 smithi092 ceph-mon[29156]: pgmap v8696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:23 smithi189 ceph-mon[32756]: pgmap v8697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:23 smithi156 ceph-mon[32679]: pgmap v8697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:23 smithi092 ceph-mon[29156]: pgmap v8697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15299.542867 secs 2024-04-26T22:33:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15299.542867 secs 2024-04-26T22:33:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15299.542867 secs 2024-04-26T22:33:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14602.514425 secs 2024-04-26T22:33:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:25 smithi189 ceph-mon[32756]: pgmap v8698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14602.514425 secs 2024-04-26T22:33:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:25 smithi156 ceph-mon[32679]: pgmap v8698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14602.514425 secs 2024-04-26T22:33:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:25 smithi092 ceph-mon[29156]: pgmap v8698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:27 smithi189 ceph-mon[32756]: pgmap v8699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:27 smithi156 ceph-mon[32679]: pgmap v8699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:27 smithi092 ceph-mon[29156]: pgmap v8699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:29 smithi189 ceph-mon[32756]: pgmap v8700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15304.542931 secs 2024-04-26T22:33:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:29 smithi156 ceph-mon[32679]: pgmap v8700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15304.542931 secs 2024-04-26T22:33:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:29 smithi092 ceph-mon[29156]: pgmap v8700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15304.542931 secs 2024-04-26T22:33:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14607.514533 secs 2024-04-26T22:33:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14607.514533 secs 2024-04-26T22:33:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14607.514533 secs 2024-04-26T22:33:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:31 smithi189 ceph-mon[32756]: pgmap v8701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:31 smithi156 ceph-mon[32679]: pgmap v8701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:31.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:31 smithi092 ceph-mon[29156]: pgmap v8701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:33 smithi189 ceph-mon[32756]: pgmap v8702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:33 smithi156 ceph-mon[32679]: pgmap v8702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:33 smithi092 ceph-mon[29156]: pgmap v8702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:34.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15309.543000 secs 2024-04-26T22:33:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15309.543000 secs 2024-04-26T22:33:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15309.543000 secs 2024-04-26T22:33:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14612.514620 secs 2024-04-26T22:33:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:35 smithi189 ceph-mon[32756]: pgmap v8703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14612.514620 secs 2024-04-26T22:33:35.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:35 smithi156 ceph-mon[32679]: pgmap v8703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14612.514620 secs 2024-04-26T22:33:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:35 smithi092 ceph-mon[29156]: pgmap v8703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:33:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.014+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:33:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.015+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.041+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.041+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.041+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.041+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=15 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.042+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:33:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.042+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T22:33:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:36.042+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T22:33:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:37 smithi189 ceph-mon[32756]: pgmap v8704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:37 smithi156 ceph-mon[32679]: pgmap v8704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:37 smithi092 ceph-mon[29156]: pgmap v8704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:38.080+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:33:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:38.080+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:33:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:38.081+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:33:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:33:38.081+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 120 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:33:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:39 smithi189 ceph-mon[32756]: pgmap v8705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15314.543116 secs 2024-04-26T22:33:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:39 smithi156 ceph-mon[32679]: pgmap v8705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15314.543116 secs 2024-04-26T22:33:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:39 smithi092 ceph-mon[29156]: pgmap v8705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15314.543116 secs 2024-04-26T22:33:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:40 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 14617.514726 secs 2024-04-26T22:33:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:40 smithi189 ceph-mon[32756]: slow request 1444.171527 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:40 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 14617.514726 secs 2024-04-26T22:33:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:40 smithi156 ceph-mon[32679]: slow request 1444.171527 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:40 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 14617.514726 secs 2024-04-26T22:33:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:40 smithi092 ceph-mon[29156]: slow request 1444.171527 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:33:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: pgmap v8706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: pgmap v8707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: pgmap v8708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:33:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: pgmap v8706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: pgmap v8707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: pgmap v8708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: pgmap v8706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: pgmap v8707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: pgmap v8708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:33:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:43 smithi189 ceph-mon[32756]: pgmap v8709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:33:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15319.543228 secs 2024-04-26T22:33:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:43 smithi156 ceph-mon[32679]: pgmap v8709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:33:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15319.543228 secs 2024-04-26T22:33:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:43 smithi092 ceph-mon[29156]: pgmap v8709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:33:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15319.543228 secs 2024-04-26T22:33:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14622.514805 secs 2024-04-26T22:33:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14622.514805 secs 2024-04-26T22:33:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14622.514805 secs 2024-04-26T22:33:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:45 smithi189 ceph-mon[32756]: pgmap v8710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:45 smithi156 ceph-mon[32679]: pgmap v8710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:45 smithi092 ceph-mon[29156]: pgmap v8710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:47 smithi189 ceph-mon[32756]: pgmap v8711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:47 smithi156 ceph-mon[32679]: pgmap v8711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:47 smithi092 ceph-mon[29156]: pgmap v8711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15324.543330 secs 2024-04-26T22:33:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15324.543330 secs 2024-04-26T22:33:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15324.543330 secs 2024-04-26T22:33:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14627.514929 secs 2024-04-26T22:33:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:49 smithi189 ceph-mon[32756]: pgmap v8712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14627.514929 secs 2024-04-26T22:33:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:49 smithi156 ceph-mon[32679]: pgmap v8712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14627.514929 secs 2024-04-26T22:33:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:49 smithi092 ceph-mon[29156]: pgmap v8712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:33:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:51 smithi189 ceph-mon[32756]: pgmap v8713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:33:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:51 smithi156 ceph-mon[32679]: pgmap v8713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:33:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:51 smithi092 ceph-mon[29156]: pgmap v8713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:33:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:53 smithi189 ceph-mon[32756]: pgmap v8714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15329.543445 secs 2024-04-26T22:33:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:53 smithi156 ceph-mon[32679]: pgmap v8714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15329.543445 secs 2024-04-26T22:33:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:53 smithi092 ceph-mon[29156]: pgmap v8714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15329.543445 secs 2024-04-26T22:33:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14632.515052 secs 2024-04-26T22:33:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14632.515052 secs 2024-04-26T22:33:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14632.515052 secs 2024-04-26T22:33:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:55 smithi189 ceph-mon[32756]: pgmap v8715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:55 smithi156 ceph-mon[32679]: pgmap v8715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:55 smithi092 ceph-mon[29156]: pgmap v8715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:33:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:57 smithi189 ceph-mon[32756]: pgmap v8716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:57 smithi156 ceph-mon[32679]: pgmap v8716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:57 smithi092 ceph-mon[29156]: pgmap v8716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:33:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15334.543562 secs 2024-04-26T22:33:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15334.543562 secs 2024-04-26T22:33:59.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15334.543562 secs 2024-04-26T22:34:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14637.515154 secs 2024-04-26T22:34:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:33:59 smithi189 ceph-mon[32756]: pgmap v8717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14637.515154 secs 2024-04-26T22:34:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:33:59 smithi156 ceph-mon[32679]: pgmap v8717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14637.515154 secs 2024-04-26T22:34:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:33:59 smithi092 ceph-mon[29156]: pgmap v8717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:01 smithi189 ceph-mon[32756]: pgmap v8718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:01 smithi156 ceph-mon[32679]: pgmap v8718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:01 smithi092 ceph-mon[29156]: pgmap v8718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:03 smithi189 ceph-mon[32756]: pgmap v8719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15339.543679 secs 2024-04-26T22:34:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:03 smithi156 ceph-mon[32679]: pgmap v8719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15339.543679 secs 2024-04-26T22:34:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:03 smithi092 ceph-mon[29156]: pgmap v8719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15339.543679 secs 2024-04-26T22:34:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:04 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 14642.515264 secs 2024-04-26T22:34:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:04 smithi189 ceph-mon[32756]: slow request 11521.673168 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:34:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:04 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 14642.515264 secs 2024-04-26T22:34:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:04 smithi156 ceph-mon[32679]: slow request 11521.673168 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:34:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:04 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 14642.515264 secs 2024-04-26T22:34:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:04 smithi092 ceph-mon[29156]: slow request 11521.673168 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:34:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:05 smithi189 ceph-mon[32756]: pgmap v8720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:05 smithi156 ceph-mon[32679]: pgmap v8720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:05 smithi092 ceph-mon[29156]: pgmap v8720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:07 smithi189 ceph-mon[32756]: pgmap v8721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:07 smithi156 ceph-mon[32679]: pgmap v8721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:07 smithi092 ceph-mon[29156]: pgmap v8721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15344.543807 secs 2024-04-26T22:34:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:09 smithi189 ceph-mon[32756]: pgmap v8722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15344.543807 secs 2024-04-26T22:34:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:09 smithi156 ceph-mon[32679]: pgmap v8722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15344.543807 secs 2024-04-26T22:34:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:09 smithi092 ceph-mon[29156]: pgmap v8722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14647.515390 secs 2024-04-26T22:34:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14647.515390 secs 2024-04-26T22:34:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14647.515390 secs 2024-04-26T22:34:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:11 smithi156 ceph-mon[32679]: pgmap v8723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:11 smithi092 ceph-mon[29156]: pgmap v8723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:11 smithi189 ceph-mon[32756]: pgmap v8723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:13 smithi189 ceph-mon[32756]: pgmap v8724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15349.543927 secs 2024-04-26T22:34:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:13 smithi156 ceph-mon[32679]: pgmap v8724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15349.543927 secs 2024-04-26T22:34:14.197 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:13 smithi092 ceph-mon[29156]: pgmap v8724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:14.197 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15349.543927 secs 2024-04-26T22:34:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14652.515477 secs 2024-04-26T22:34:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14652.515477 secs 2024-04-26T22:34:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14652.515477 secs 2024-04-26T22:34:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:15 smithi189 ceph-mon[32756]: pgmap v8725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:15 smithi156 ceph-mon[32679]: pgmap v8725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:15 smithi092 ceph-mon[29156]: pgmap v8725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:17 smithi189 ceph-mon[32756]: pgmap v8726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:17 smithi156 ceph-mon[32679]: pgmap v8726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:17 smithi092 ceph-mon[29156]: pgmap v8726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15354.544066 secs 2024-04-26T22:34:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15354.544066 secs 2024-04-26T22:34:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15354.544066 secs 2024-04-26T22:34:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14657.515583 secs 2024-04-26T22:34:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:19 smithi189 ceph-mon[32756]: pgmap v8727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14657.515583 secs 2024-04-26T22:34:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:19 smithi156 ceph-mon[32679]: pgmap v8727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14657.515583 secs 2024-04-26T22:34:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:19 smithi092 ceph-mon[29156]: pgmap v8727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:21 smithi189 ceph-mon[32756]: pgmap v8728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:21 smithi156 ceph-mon[32679]: pgmap v8728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:21 smithi092 ceph-mon[29156]: pgmap v8728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:34:23.088+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:34:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:34:23.088+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:34:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:34:23.088+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:34:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:34:23.088+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 121 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:34:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:23 smithi189 ceph-mon[32756]: pgmap v8729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15359.544192 secs 2024-04-26T22:34:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:23 smithi156 ceph-mon[32679]: pgmap v8729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15359.544192 secs 2024-04-26T22:34:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:23 smithi092 ceph-mon[29156]: pgmap v8729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15359.544192 secs 2024-04-26T22:34:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14662.515706 secs 2024-04-26T22:34:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14662.515706 secs 2024-04-26T22:34:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14662.515706 secs 2024-04-26T22:34:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:25 smithi189 ceph-mon[32756]: pgmap v8730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:25 smithi156 ceph-mon[32679]: pgmap v8730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:25 smithi092 ceph-mon[29156]: pgmap v8730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:27 smithi189 ceph-mon[32756]: pgmap v8731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:27 smithi156 ceph-mon[32679]: pgmap v8731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:27 smithi092 ceph-mon[29156]: pgmap v8731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15364.544348 secs 2024-04-26T22:34:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15364.544348 secs 2024-04-26T22:34:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15364.544348 secs 2024-04-26T22:34:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14667.515820 secs 2024-04-26T22:34:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:29 smithi189 ceph-mon[32756]: pgmap v8732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14667.515820 secs 2024-04-26T22:34:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:29 smithi156 ceph-mon[32679]: pgmap v8732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14667.515820 secs 2024-04-26T22:34:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:29 smithi092 ceph-mon[29156]: pgmap v8732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:31 smithi189 ceph-mon[32756]: pgmap v8733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:31 smithi156 ceph-mon[32679]: pgmap v8733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:31 smithi092 ceph-mon[29156]: pgmap v8733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:33 smithi092 ceph-mon[29156]: pgmap v8734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15369.544406 secs 2024-04-26T22:34:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:33 smithi189 ceph-mon[32756]: pgmap v8734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15369.544406 secs 2024-04-26T22:34:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:33 smithi156 ceph-mon[32679]: pgmap v8734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15369.544406 secs 2024-04-26T22:34:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14672.515909 secs 2024-04-26T22:34:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14672.515909 secs 2024-04-26T22:34:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14672.515909 secs 2024-04-26T22:34:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:35 smithi189 ceph-mon[32756]: pgmap v8735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:35 smithi156 ceph-mon[32679]: pgmap v8735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:35 smithi092 ceph-mon[29156]: pgmap v8735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:37 smithi189 ceph-mon[32756]: pgmap v8736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:37 smithi156 ceph-mon[32679]: pgmap v8736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:37 smithi092 ceph-mon[29156]: pgmap v8736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15374.544538 secs 2024-04-26T22:34:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15374.544538 secs 2024-04-26T22:34:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15374.544538 secs 2024-04-26T22:34:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14677.516052 secs 2024-04-26T22:34:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:39 smithi189 ceph-mon[32756]: pgmap v8737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14677.516052 secs 2024-04-26T22:34:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:39 smithi156 ceph-mon[32679]: pgmap v8737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14677.516052 secs 2024-04-26T22:34:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:39 smithi092 ceph-mon[29156]: pgmap v8737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:34:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:41 smithi156 ceph-mon[32679]: pgmap v8738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:34:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:41 smithi092 ceph-mon[29156]: pgmap v8738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:34:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:41 smithi189 ceph-mon[32756]: pgmap v8738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:34:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:34:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:34:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:42 smithi156 ceph-mon[32679]: pgmap v8739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:34:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:42 smithi156 ceph-mon[32679]: pgmap v8740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:42 smithi092 ceph-mon[29156]: pgmap v8739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:34:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:42 smithi092 ceph-mon[29156]: pgmap v8740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:42 smithi189 ceph-mon[32756]: pgmap v8739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:34:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:42 smithi189 ceph-mon[32756]: pgmap v8740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15379.544664 secs 2024-04-26T22:34:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15379.544664 secs 2024-04-26T22:34:44.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15379.544664 secs 2024-04-26T22:34:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:44 smithi156 ceph-mon[32679]: pgmap v8741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14682.516178 secs 2024-04-26T22:34:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:44 smithi092 ceph-mon[29156]: pgmap v8741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14682.516178 secs 2024-04-26T22:34:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:44 smithi189 ceph-mon[32756]: pgmap v8741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14682.516178 secs 2024-04-26T22:34:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:46 smithi156 ceph-mon[32679]: pgmap v8742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:46 smithi092 ceph-mon[29156]: pgmap v8742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:46 smithi189 ceph-mon[32756]: pgmap v8742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:48 smithi156 ceph-mon[32679]: pgmap v8743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15384.544738 secs 2024-04-26T22:34:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:48 smithi092 ceph-mon[29156]: pgmap v8743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15384.544738 secs 2024-04-26T22:34:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:48 smithi189 ceph-mon[32756]: pgmap v8743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:34:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15384.544738 secs 2024-04-26T22:34:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14687.516316 secs 2024-04-26T22:34:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14687.516316 secs 2024-04-26T22:34:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14687.516316 secs 2024-04-26T22:34:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:50 smithi156 ceph-mon[32679]: pgmap v8744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:50 smithi092 ceph-mon[29156]: pgmap v8744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:50 smithi189 ceph-mon[32756]: pgmap v8744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:34:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:52 smithi156 ceph-mon[32679]: pgmap v8745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:34:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:52 smithi092 ceph-mon[29156]: pgmap v8745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:34:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:52 smithi189 ceph-mon[32756]: pgmap v8745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:34:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15389.544882 secs 2024-04-26T22:34:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15389.544882 secs 2024-04-26T22:34:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15389.544882 secs 2024-04-26T22:34:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:54 smithi156 ceph-mon[32679]: pgmap v8746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14692.516435 secs 2024-04-26T22:34:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:54 smithi092 ceph-mon[29156]: pgmap v8746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14692.516435 secs 2024-04-26T22:34:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:54 smithi189 ceph-mon[32756]: pgmap v8746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14692.516435 secs 2024-04-26T22:34:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:56 smithi156 ceph-mon[32679]: pgmap v8747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:56 smithi092 ceph-mon[29156]: pgmap v8747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:56 smithi189 ceph-mon[32756]: pgmap v8747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:34:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:58 smithi092 ceph-mon[29156]: pgmap v8748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15394.544949 secs 2024-04-26T22:34:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:58 smithi189 ceph-mon[32756]: pgmap v8748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15394.544949 secs 2024-04-26T22:34:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:58 smithi156 ceph-mon[32679]: pgmap v8748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:34:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15394.544949 secs 2024-04-26T22:35:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:34:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14697.516572 secs 2024-04-26T22:35:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:34:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14697.516572 secs 2024-04-26T22:35:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:34:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14697.516572 secs 2024-04-26T22:35:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:00 smithi092 ceph-mon[29156]: pgmap v8749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:00 smithi189 ceph-mon[32756]: pgmap v8749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:00 smithi156 ceph-mon[32679]: pgmap v8749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:02 smithi092 ceph-mon[29156]: pgmap v8750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:02 smithi189 ceph-mon[32756]: pgmap v8750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:02 smithi156 ceph-mon[32679]: pgmap v8750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:04.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15399.545069 secs 2024-04-26T22:35:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15399.545069 secs 2024-04-26T22:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15399.545069 secs 2024-04-26T22:35:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:04 smithi092 ceph-mon[29156]: pgmap v8751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14702.516662 secs 2024-04-26T22:35:05.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:04 smithi156 ceph-mon[32679]: pgmap v8751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:05.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14702.516662 secs 2024-04-26T22:35:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:04 smithi189 ceph-mon[32756]: pgmap v8751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14702.516662 secs 2024-04-26T22:35:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:06 smithi092 ceph-mon[29156]: pgmap v8752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:06 smithi189 ceph-mon[32756]: pgmap v8752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:06 smithi156 ceph-mon[32679]: pgmap v8752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:07 smithi092 ceph-mon[29156]: pgmap v8753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:07 smithi189 ceph-mon[32756]: pgmap v8753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:07 smithi156 ceph-mon[32679]: pgmap v8753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15404.545194 secs 2024-04-26T22:35:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15404.545194 secs 2024-04-26T22:35:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15404.545194 secs 2024-04-26T22:35:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14707.516780 secs 2024-04-26T22:35:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:09 smithi092 ceph-mon[29156]: pgmap v8754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14707.516780 secs 2024-04-26T22:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:09 smithi189 ceph-mon[32756]: pgmap v8754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14707.516780 secs 2024-04-26T22:35:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:09 smithi156 ceph-mon[32679]: pgmap v8754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:12 smithi189 ceph-mon[32756]: pgmap v8755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:12 smithi156 ceph-mon[32679]: pgmap v8755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:12 smithi092 ceph-mon[29156]: pgmap v8755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15409.545277 secs 2024-04-26T22:35:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15409.545277 secs 2024-04-26T22:35:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15409.545277 secs 2024-04-26T22:35:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:14 smithi189 ceph-mon[32756]: pgmap v8756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14712.516860 secs 2024-04-26T22:35:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:14 smithi092 ceph-mon[29156]: pgmap v8756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14712.516860 secs 2024-04-26T22:35:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:14 smithi156 ceph-mon[32679]: pgmap v8756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14712.516860 secs 2024-04-26T22:35:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:16 smithi189 ceph-mon[32756]: pgmap v8757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:16 smithi156 ceph-mon[32679]: pgmap v8757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:16 smithi092 ceph-mon[29156]: pgmap v8757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:18 smithi189 ceph-mon[32756]: pgmap v8758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15414.545418 secs 2024-04-26T22:35:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:18 smithi156 ceph-mon[32679]: pgmap v8758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15414.545418 secs 2024-04-26T22:35:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:18 smithi092 ceph-mon[29156]: pgmap v8758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15414.545418 secs 2024-04-26T22:35:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14717.516996 secs 2024-04-26T22:35:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14717.516996 secs 2024-04-26T22:35:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14717.516996 secs 2024-04-26T22:35:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:20 smithi189 ceph-mon[32756]: pgmap v8759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:20 smithi156 ceph-mon[32679]: pgmap v8759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:20 smithi092 ceph-mon[29156]: pgmap v8759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:22 smithi189 ceph-mon[32756]: pgmap v8760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:22 smithi156 ceph-mon[32679]: pgmap v8760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:22 smithi092 ceph-mon[29156]: pgmap v8760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15419.545563 secs 2024-04-26T22:35:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15419.545563 secs 2024-04-26T22:35:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15419.545563 secs 2024-04-26T22:35:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:24 smithi189 ceph-mon[32756]: pgmap v8761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14722.517115 secs 2024-04-26T22:35:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:24 smithi156 ceph-mon[32679]: pgmap v8761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14722.517115 secs 2024-04-26T22:35:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:24 smithi092 ceph-mon[29156]: pgmap v8761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14722.517115 secs 2024-04-26T22:35:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:26 smithi189 ceph-mon[32756]: pgmap v8762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:26 smithi156 ceph-mon[32679]: pgmap v8762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:26 smithi092 ceph-mon[29156]: pgmap v8762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:28 smithi189 ceph-mon[32756]: pgmap v8763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15424.545716 secs 2024-04-26T22:35:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:28 smithi156 ceph-mon[32679]: pgmap v8763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15424.545716 secs 2024-04-26T22:35:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:28 smithi092 ceph-mon[29156]: pgmap v8763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15424.545716 secs 2024-04-26T22:35:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14727.517254 secs 2024-04-26T22:35:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14727.517254 secs 2024-04-26T22:35:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14727.517254 secs 2024-04-26T22:35:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:30 smithi156 ceph-mon[32679]: pgmap v8764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:30 smithi092 ceph-mon[29156]: pgmap v8764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:30 smithi189 ceph-mon[32756]: pgmap v8764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:32 smithi156 ceph-mon[32679]: pgmap v8765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:32 smithi092 ceph-mon[29156]: pgmap v8765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:32 smithi189 ceph-mon[32756]: pgmap v8765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15429.545862 secs 2024-04-26T22:35:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15429.545862 secs 2024-04-26T22:35:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15429.545862 secs 2024-04-26T22:35:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:34 smithi156 ceph-mon[32679]: pgmap v8766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14732.517411 secs 2024-04-26T22:35:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:34 smithi092 ceph-mon[29156]: pgmap v8766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14732.517411 secs 2024-04-26T22:35:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:34 smithi189 ceph-mon[32756]: pgmap v8766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14732.517411 secs 2024-04-26T22:35:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:36 smithi156 ceph-mon[32679]: pgmap v8767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:36 smithi092 ceph-mon[29156]: pgmap v8767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:36 smithi189 ceph-mon[32756]: pgmap v8767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:38 smithi156 ceph-mon[32679]: pgmap v8768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15434.545951 secs 2024-04-26T22:35:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:38 smithi092 ceph-mon[29156]: pgmap v8768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15434.545951 secs 2024-04-26T22:35:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:38 smithi189 ceph-mon[32756]: pgmap v8768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15434.545951 secs 2024-04-26T22:35:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14737.517477 secs 2024-04-26T22:35:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14737.517477 secs 2024-04-26T22:35:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14737.517477 secs 2024-04-26T22:35:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:40 smithi156 ceph-mon[32679]: pgmap v8769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:40 smithi092 ceph-mon[29156]: pgmap v8769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:40 smithi189 ceph-mon[32756]: pgmap v8769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: pgmap v8770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: pgmap v8770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: pgmap v8770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:42.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.955 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:42.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15439.546024 secs 2024-04-26T22:35:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15439.546024 secs 2024-04-26T22:35:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15439.546024 secs 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: pgmap v8771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14742.517541 secs 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: pgmap v8771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14742.517541 secs 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: pgmap v8771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14742.517541 secs 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: pgmap v8772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: pgmap v8773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: pgmap v8774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: pgmap v8772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: pgmap v8773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: pgmap v8774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: pgmap v8772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: pgmap v8773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: pgmap v8774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:35:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:48 smithi189 ceph-mon[32756]: pgmap v8775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15444.546170 secs 2024-04-26T22:35:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:48 smithi156 ceph-mon[32679]: pgmap v8775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15444.546170 secs 2024-04-26T22:35:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:48 smithi092 ceph-mon[29156]: pgmap v8775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15444.546170 secs 2024-04-26T22:35:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14747.517657 secs 2024-04-26T22:35:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14747.517657 secs 2024-04-26T22:35:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14747.517657 secs 2024-04-26T22:35:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:50 smithi189 ceph-mon[32756]: pgmap v8776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:50 smithi156 ceph-mon[32679]: pgmap v8776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:50.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:50 smithi092 ceph-mon[29156]: pgmap v8776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:52 smithi189 ceph-mon[32756]: pgmap v8777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:52 smithi156 ceph-mon[32679]: pgmap v8777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:52 smithi092 ceph-mon[29156]: pgmap v8777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:35:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15449.546307 secs 2024-04-26T22:35:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15449.546307 secs 2024-04-26T22:35:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15449.546307 secs 2024-04-26T22:35:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:54 smithi189 ceph-mon[32756]: pgmap v8778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14752.517778 secs 2024-04-26T22:35:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:54 smithi156 ceph-mon[32679]: pgmap v8778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14752.517778 secs 2024-04-26T22:35:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:54 smithi092 ceph-mon[29156]: pgmap v8778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T22:35:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14752.517778 secs 2024-04-26T22:35:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:56 smithi156 ceph-mon[32679]: pgmap v8779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:56 smithi092 ceph-mon[29156]: pgmap v8779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:56 smithi189 ceph-mon[32756]: pgmap v8779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:35:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:58 smithi156 ceph-mon[32679]: pgmap v8780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15454.546425 secs 2024-04-26T22:35:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:58 smithi092 ceph-mon[29156]: pgmap v8780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15454.546425 secs 2024-04-26T22:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:58 smithi189 ceph-mon[32756]: pgmap v8780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:35:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15454.546425 secs 2024-04-26T22:35:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:35:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14757.517898 secs 2024-04-26T22:35:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:35:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14757.517898 secs 2024-04-26T22:36:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:35:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14757.517898 secs 2024-04-26T22:36:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:00 smithi156 ceph-mon[32679]: pgmap v8781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:00 smithi092 ceph-mon[29156]: pgmap v8781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:00 smithi189 ceph-mon[32756]: pgmap v8781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:02 smithi156 ceph-mon[32679]: pgmap v8782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:02 smithi092 ceph-mon[29156]: pgmap v8782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:02 smithi189 ceph-mon[32756]: pgmap v8782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15459.546488 secs 2024-04-26T22:36:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15459.546488 secs 2024-04-26T22:36:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15459.546488 secs 2024-04-26T22:36:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:04 smithi156 ceph-mon[32679]: pgmap v8783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14762.517961 secs 2024-04-26T22:36:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:04 smithi092 ceph-mon[29156]: pgmap v8783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14762.517961 secs 2024-04-26T22:36:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:04 smithi189 ceph-mon[32756]: pgmap v8783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14762.517961 secs 2024-04-26T22:36:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:06 smithi156 ceph-mon[32679]: pgmap v8784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:06 smithi092 ceph-mon[29156]: pgmap v8784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:06 smithi189 ceph-mon[32756]: pgmap v8784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:08 smithi156 ceph-mon[32679]: pgmap v8785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15464.546609 secs 2024-04-26T22:36:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:08 smithi092 ceph-mon[29156]: pgmap v8785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15464.546609 secs 2024-04-26T22:36:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:08 smithi189 ceph-mon[32756]: pgmap v8785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15464.546609 secs 2024-04-26T22:36:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 14767.518033 secs 2024-04-26T22:36:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:09 smithi156 ceph-mon[32679]: slow request 2884.499524 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:36:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 14767.518033 secs 2024-04-26T22:36:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:09 smithi092 ceph-mon[29156]: slow request 2884.499524 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:36:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 14767.518033 secs 2024-04-26T22:36:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:09 smithi189 ceph-mon[32756]: slow request 2884.499524 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:36:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:10 smithi156 ceph-mon[32679]: pgmap v8786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:10 smithi092 ceph-mon[29156]: pgmap v8786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:10 smithi189 ceph-mon[32756]: pgmap v8786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:12 smithi156 ceph-mon[32679]: pgmap v8787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:12 smithi092 ceph-mon[29156]: pgmap v8787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:12 smithi189 ceph-mon[32756]: pgmap v8787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15469.546733 secs 2024-04-26T22:36:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:14 smithi156 ceph-mon[32679]: pgmap v8788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15469.546733 secs 2024-04-26T22:36:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:14 smithi092 ceph-mon[29156]: pgmap v8788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15469.546733 secs 2024-04-26T22:36:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:14 smithi189 ceph-mon[32756]: pgmap v8788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14772.518175 secs 2024-04-26T22:36:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14772.518175 secs 2024-04-26T22:36:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14772.518175 secs 2024-04-26T22:36:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:16 smithi156 ceph-mon[32679]: pgmap v8789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:16 smithi092 ceph-mon[29156]: pgmap v8789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:16 smithi189 ceph-mon[32756]: pgmap v8789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:18 smithi189 ceph-mon[32756]: pgmap v8790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15474.546868 secs 2024-04-26T22:36:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:18 smithi156 ceph-mon[32679]: pgmap v8790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15474.546868 secs 2024-04-26T22:36:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:18 smithi092 ceph-mon[29156]: pgmap v8790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15474.546868 secs 2024-04-26T22:36:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14777.518313 secs 2024-04-26T22:36:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14777.518313 secs 2024-04-26T22:36:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14777.518313 secs 2024-04-26T22:36:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:20 smithi189 ceph-mon[32756]: pgmap v8791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:20 smithi156 ceph-mon[32679]: pgmap v8791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:20 smithi092 ceph-mon[29156]: pgmap v8791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:22 smithi189 ceph-mon[32756]: pgmap v8792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:22 smithi156 ceph-mon[32679]: pgmap v8792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:22 smithi092 ceph-mon[29156]: pgmap v8792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15479.547001 secs 2024-04-26T22:36:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15479.547001 secs 2024-04-26T22:36:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15479.547001 secs 2024-04-26T22:36:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:24 smithi156 ceph-mon[32679]: pgmap v8793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14782.518415 secs 2024-04-26T22:36:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:24 smithi092 ceph-mon[29156]: pgmap v8793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14782.518415 secs 2024-04-26T22:36:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:24 smithi189 ceph-mon[32756]: pgmap v8793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14782.518415 secs 2024-04-26T22:36:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:26 smithi156 ceph-mon[32679]: pgmap v8794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:26 smithi092 ceph-mon[29156]: pgmap v8794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:26 smithi189 ceph-mon[32756]: pgmap v8794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:28 smithi156 ceph-mon[32679]: pgmap v8795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15484.547142 secs 2024-04-26T22:36:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:28 smithi092 ceph-mon[29156]: pgmap v8795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15484.547142 secs 2024-04-26T22:36:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:28 smithi189 ceph-mon[32756]: pgmap v8795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15484.547142 secs 2024-04-26T22:36:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14787.518526 secs 2024-04-26T22:36:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14787.518526 secs 2024-04-26T22:36:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14787.518526 secs 2024-04-26T22:36:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:30 smithi156 ceph-mon[32679]: pgmap v8796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:30 smithi092 ceph-mon[29156]: pgmap v8796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:30 smithi189 ceph-mon[32756]: pgmap v8796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:32 smithi156 ceph-mon[32679]: pgmap v8797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:32 smithi092 ceph-mon[29156]: pgmap v8797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:32 smithi189 ceph-mon[32756]: pgmap v8797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15489.547217 secs 2024-04-26T22:36:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15489.547217 secs 2024-04-26T22:36:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15489.547217 secs 2024-04-26T22:36:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:34 smithi156 ceph-mon[32679]: pgmap v8798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14792.518594 secs 2024-04-26T22:36:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-mon[29156]: pgmap v8798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14792.518594 secs 2024-04-26T22:36:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:36:34.872+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:36:34.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:36:34.872+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:36:34.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:36:34.872+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:36:34.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:36:34.872+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:36:34.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:36:34 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:36:34.872+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:36:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:34 smithi189 ceph-mon[32756]: pgmap v8798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14792.518594 secs 2024-04-26T22:36:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:36 smithi156 ceph-mon[32679]: pgmap v8799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:36 smithi092 ceph-mon[29156]: pgmap v8799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:36 smithi189 ceph-mon[32756]: pgmap v8799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:36:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:36:38.106+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:36:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:36:38.106+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:36:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:36:38.106+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:36:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:36:38.106+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 122 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:36:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:38 smithi156 ceph-mon[32679]: pgmap v8800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15494.547358 secs 2024-04-26T22:36:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:38 smithi092 ceph-mon[29156]: pgmap v8800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:38.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15494.547358 secs 2024-04-26T22:36:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:38 smithi189 ceph-mon[32756]: pgmap v8800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15494.547358 secs 2024-04-26T22:36:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14797.518711 secs 2024-04-26T22:36:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14797.518711 secs 2024-04-26T22:36:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14797.518711 secs 2024-04-26T22:36:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:40 smithi156 ceph-mon[32679]: pgmap v8801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:40 smithi092 ceph-mon[29156]: pgmap v8801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:40 smithi189 ceph-mon[32756]: pgmap v8801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:42 smithi156 ceph-mon[32679]: pgmap v8802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:42 smithi092 ceph-mon[29156]: pgmap v8802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:42 smithi189 ceph-mon[32756]: pgmap v8802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15499.547509 secs 2024-04-26T22:36:44.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15499.547509 secs 2024-04-26T22:36:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15499.547509 secs 2024-04-26T22:36:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:44 smithi092 ceph-mon[29156]: pgmap v8803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14802.518783 secs 2024-04-26T22:36:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:44 smithi189 ceph-mon[32756]: pgmap v8803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14802.518783 secs 2024-04-26T22:36:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:44 smithi156 ceph-mon[32679]: pgmap v8803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:36:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14802.518783 secs 2024-04-26T22:36:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:36:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:46 smithi092 ceph-mon[29156]: pgmap v8804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:36:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:46 smithi189 ceph-mon[32756]: pgmap v8804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:36:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:46 smithi156 ceph-mon[32679]: pgmap v8804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:36:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:36:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:36:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:36:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:47 smithi092 ceph-mon[29156]: pgmap v8805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T22:36:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:47 smithi092 ceph-mon[29156]: pgmap v8806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T22:36:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:47 smithi189 ceph-mon[32756]: pgmap v8805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T22:36:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:47 smithi189 ceph-mon[32756]: pgmap v8806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T22:36:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:47 smithi156 ceph-mon[32679]: pgmap v8805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-26T22:36:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:47 smithi156 ceph-mon[32679]: pgmap v8806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-26T22:36:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15504.547669 secs 2024-04-26T22:36:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15504.547669 secs 2024-04-26T22:36:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15504.547669 secs 2024-04-26T22:36:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:49 smithi092 ceph-mon[29156]: pgmap v8807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:36:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14807.518861 secs 2024-04-26T22:36:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:49 smithi189 ceph-mon[32756]: pgmap v8807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:36:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14807.518861 secs 2024-04-26T22:36:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:49 smithi156 ceph-mon[32679]: pgmap v8807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:36:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14807.518861 secs 2024-04-26T22:36:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:51 smithi092 ceph-mon[29156]: pgmap v8808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:51 smithi189 ceph-mon[32756]: pgmap v8808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:51 smithi156 ceph-mon[32679]: pgmap v8808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:53 smithi092 ceph-mon[29156]: pgmap v8809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15509.547804 secs 2024-04-26T22:36:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:53 smithi189 ceph-mon[32756]: pgmap v8809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15509.547804 secs 2024-04-26T22:36:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:53 smithi156 ceph-mon[32679]: pgmap v8809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15509.547804 secs 2024-04-26T22:36:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14812.518976 secs 2024-04-26T22:36:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14812.518976 secs 2024-04-26T22:36:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14812.518976 secs 2024-04-26T22:36:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:55 smithi092 ceph-mon[29156]: pgmap v8810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:55 smithi189 ceph-mon[32756]: pgmap v8810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:55 smithi156 ceph-mon[32679]: pgmap v8810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:36:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:57 smithi092 ceph-mon[29156]: pgmap v8811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:36:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:57 smithi189 ceph-mon[32756]: pgmap v8811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:36:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:57 smithi156 ceph-mon[32679]: pgmap v8811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:36:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15514.547929 secs 2024-04-26T22:36:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15514.547929 secs 2024-04-26T22:36:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15514.547929 secs 2024-04-26T22:36:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:59 smithi092 ceph-mon[29156]: pgmap v8812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:36:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:36:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14817.519061 secs 2024-04-26T22:37:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:59 smithi189 ceph-mon[32756]: pgmap v8812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:36:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14817.519061 secs 2024-04-26T22:37:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:59 smithi156 ceph-mon[32679]: pgmap v8812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:36:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14817.519061 secs 2024-04-26T22:37:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:01 smithi092 ceph-mon[29156]: pgmap v8813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:01 smithi189 ceph-mon[32756]: pgmap v8813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:01 smithi156 ceph-mon[32679]: pgmap v8813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:03 smithi092 ceph-mon[29156]: pgmap v8814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15519.548084 secs 2024-04-26T22:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:03 smithi189 ceph-mon[32756]: pgmap v8814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15519.548084 secs 2024-04-26T22:37:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:03 smithi156 ceph-mon[32679]: pgmap v8814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15519.548084 secs 2024-04-26T22:37:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14822.519195 secs 2024-04-26T22:37:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14822.519195 secs 2024-04-26T22:37:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14822.519195 secs 2024-04-26T22:37:06.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:05 smithi156 ceph-mon[32679]: pgmap v8815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:05 smithi189 ceph-mon[32756]: pgmap v8815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:05 smithi092 ceph-mon[29156]: pgmap v8815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:07 smithi189 ceph-mon[32756]: pgmap v8816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:07 smithi156 ceph-mon[32679]: pgmap v8816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:07 smithi092 ceph-mon[29156]: pgmap v8816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15524.548148 secs 2024-04-26T22:37:09.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15524.548148 secs 2024-04-26T22:37:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15524.548148 secs 2024-04-26T22:37:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:09 smithi189 ceph-mon[32756]: pgmap v8817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14827.519334 secs 2024-04-26T22:37:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:09 smithi156 ceph-mon[32679]: pgmap v8817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14827.519334 secs 2024-04-26T22:37:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:09 smithi092 ceph-mon[29156]: pgmap v8817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14827.519334 secs 2024-04-26T22:37:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:11 smithi189 ceph-mon[32756]: pgmap v8818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:11 smithi156 ceph-mon[32679]: pgmap v8818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:11 smithi092 ceph-mon[29156]: pgmap v8818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:14.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:13 smithi092 ceph-mon[29156]: pgmap v8819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:14.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15529.548279 secs 2024-04-26T22:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:13 smithi189 ceph-mon[32756]: pgmap v8819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15529.548279 secs 2024-04-26T22:37:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:13 smithi156 ceph-mon[32679]: pgmap v8819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15529.548279 secs 2024-04-26T22:37:15.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14832.519421 secs 2024-04-26T22:37:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14832.519421 secs 2024-04-26T22:37:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14832.519421 secs 2024-04-26T22:37:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:15 smithi189 ceph-mon[32756]: pgmap v8820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:15 smithi156 ceph-mon[32679]: pgmap v8820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:15 smithi092 ceph-mon[29156]: pgmap v8820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:17 smithi189 ceph-mon[32756]: pgmap v8821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:17 smithi156 ceph-mon[32679]: pgmap v8821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:17 smithi092 ceph-mon[29156]: pgmap v8821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15534.548412 secs 2024-04-26T22:37:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15534.548412 secs 2024-04-26T22:37:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15534.548412 secs 2024-04-26T22:37:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:19 smithi189 ceph-mon[32756]: pgmap v8822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14837.519513 secs 2024-04-26T22:37:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:19 smithi156 ceph-mon[32679]: pgmap v8822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14837.519513 secs 2024-04-26T22:37:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:19 smithi092 ceph-mon[29156]: pgmap v8822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14837.519513 secs 2024-04-26T22:37:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:21 smithi189 ceph-mon[32756]: pgmap v8823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:21 smithi156 ceph-mon[32679]: pgmap v8823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:21 smithi092 ceph-mon[29156]: pgmap v8823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:23 smithi189 ceph-mon[32756]: pgmap v8824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15539.548524 secs 2024-04-26T22:37:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:23 smithi156 ceph-mon[32679]: pgmap v8824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15539.548524 secs 2024-04-26T22:37:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:23 smithi092 ceph-mon[29156]: pgmap v8824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15539.548524 secs 2024-04-26T22:37:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14842.519628 secs 2024-04-26T22:37:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14842.519628 secs 2024-04-26T22:37:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14842.519628 secs 2024-04-26T22:37:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:25 smithi189 ceph-mon[32756]: pgmap v8825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:25 smithi156 ceph-mon[32679]: pgmap v8825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:25 smithi092 ceph-mon[29156]: pgmap v8825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:27 smithi189 ceph-mon[32756]: pgmap v8826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:27 smithi156 ceph-mon[32679]: pgmap v8826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:27 smithi092 ceph-mon[29156]: pgmap v8826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15544.548669 secs 2024-04-26T22:37:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15544.548669 secs 2024-04-26T22:37:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15544.548669 secs 2024-04-26T22:37:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:29 smithi189 ceph-mon[32756]: pgmap v8827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14847.519783 secs 2024-04-26T22:37:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:29 smithi156 ceph-mon[32679]: pgmap v8827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14847.519783 secs 2024-04-26T22:37:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:29 smithi092 ceph-mon[29156]: pgmap v8827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14847.519783 secs 2024-04-26T22:37:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:31 smithi189 ceph-mon[32756]: pgmap v8828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:31 smithi156 ceph-mon[32679]: pgmap v8828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:31 smithi092 ceph-mon[29156]: pgmap v8828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:33 smithi189 ceph-mon[32756]: pgmap v8829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15549.548783 secs 2024-04-26T22:37:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:33 smithi156 ceph-mon[32679]: pgmap v8829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15549.548783 secs 2024-04-26T22:37:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:33 smithi092 ceph-mon[29156]: pgmap v8829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15549.548783 secs 2024-04-26T22:37:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14852.519901 secs 2024-04-26T22:37:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14852.519901 secs 2024-04-26T22:37:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14852.519901 secs 2024-04-26T22:37:36.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:35 smithi156 ceph-mon[32679]: pgmap v8830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:35 smithi189 ceph-mon[32756]: pgmap v8830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:35 smithi092 ceph-mon[29156]: pgmap v8830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:37 smithi189 ceph-mon[32756]: pgmap v8831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:37 smithi156 ceph-mon[32679]: pgmap v8831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:37 smithi092 ceph-mon[29156]: pgmap v8831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15554.548906 secs 2024-04-26T22:37:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15554.548906 secs 2024-04-26T22:37:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15554.548906 secs 2024-04-26T22:37:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:39 smithi189 ceph-mon[32756]: pgmap v8832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14857.520019 secs 2024-04-26T22:37:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:39 smithi156 ceph-mon[32679]: pgmap v8832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14857.520019 secs 2024-04-26T22:37:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:39 smithi092 ceph-mon[29156]: pgmap v8832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14857.520019 secs 2024-04-26T22:37:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:41 smithi189 ceph-mon[32756]: pgmap v8833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:41 smithi156 ceph-mon[32679]: pgmap v8833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:41 smithi092 ceph-mon[29156]: pgmap v8833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:43 smithi189 ceph-mon[32756]: pgmap v8834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15559.549017 secs 2024-04-26T22:37:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:43 smithi156 ceph-mon[32679]: pgmap v8834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15559.549017 secs 2024-04-26T22:37:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:43 smithi092 ceph-mon[29156]: pgmap v8834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15559.549017 secs 2024-04-26T22:37:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14862.520138 secs 2024-04-26T22:37:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14862.520138 secs 2024-04-26T22:37:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14862.520138 secs 2024-04-26T22:37:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:45 smithi189 ceph-mon[32756]: pgmap v8835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:45 smithi156 ceph-mon[32679]: pgmap v8835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:45 smithi092 ceph-mon[29156]: pgmap v8835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:37:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:37:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:47 smithi189 ceph-mon[32756]: pgmap v8836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:37:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:47 smithi156 ceph-mon[32679]: pgmap v8836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:37:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:47 smithi092 ceph-mon[29156]: pgmap v8836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:37:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:37:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:37:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:48 smithi189 ceph-mon[32756]: pgmap v8837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:48 smithi189 ceph-mon[32756]: pgmap v8838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15564.549133 secs 2024-04-26T22:37:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:48 smithi156 ceph-mon[32679]: pgmap v8837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:37:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:48 smithi156 ceph-mon[32679]: pgmap v8838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15564.549133 secs 2024-04-26T22:37:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:48 smithi092 ceph-mon[29156]: pgmap v8837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:37:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:48 smithi092 ceph-mon[29156]: pgmap v8838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15564.549133 secs 2024-04-26T22:37:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14867.520244 secs 2024-04-26T22:37:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14867.520244 secs 2024-04-26T22:37:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14867.520244 secs 2024-04-26T22:37:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:50 smithi189 ceph-mon[32756]: pgmap v8839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:50 smithi156 ceph-mon[32679]: pgmap v8839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:50 smithi092 ceph-mon[29156]: pgmap v8839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:52 smithi189 ceph-mon[32756]: pgmap v8840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:52 smithi156 ceph-mon[32679]: pgmap v8840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:52 smithi092 ceph-mon[29156]: pgmap v8840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15569.549256 secs 2024-04-26T22:37:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15569.549256 secs 2024-04-26T22:37:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15569.549256 secs 2024-04-26T22:37:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:54 smithi189 ceph-mon[32756]: pgmap v8841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:37:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14872.520311 secs 2024-04-26T22:37:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:54 smithi156 ceph-mon[32679]: pgmap v8841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:37:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14872.520311 secs 2024-04-26T22:37:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:54 smithi092 ceph-mon[29156]: pgmap v8841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:37:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14872.520311 secs 2024-04-26T22:37:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:56 smithi156 ceph-mon[32679]: pgmap v8842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:56 smithi092 ceph-mon[29156]: pgmap v8842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:56 smithi189 ceph-mon[32756]: pgmap v8842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:37:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:58 smithi156 ceph-mon[32679]: pgmap v8843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:37:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15574.549347 secs 2024-04-26T22:37:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:58 smithi092 ceph-mon[29156]: pgmap v8843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:37:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15574.549347 secs 2024-04-26T22:37:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:58 smithi189 ceph-mon[32756]: pgmap v8843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:37:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15574.549347 secs 2024-04-26T22:38:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:37:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14877.520429 secs 2024-04-26T22:38:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:37:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14877.520429 secs 2024-04-26T22:38:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:37:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14877.520429 secs 2024-04-26T22:38:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:00 smithi156 ceph-mon[32679]: pgmap v8844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:00 smithi092 ceph-mon[29156]: pgmap v8844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:00 smithi189 ceph-mon[32756]: pgmap v8844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:02 smithi156 ceph-mon[32679]: pgmap v8845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:02 smithi092 ceph-mon[29156]: pgmap v8845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:02 smithi189 ceph-mon[32756]: pgmap v8845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15579.549465 secs 2024-04-26T22:38:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15579.549465 secs 2024-04-26T22:38:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15579.549465 secs 2024-04-26T22:38:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:04 smithi156 ceph-mon[32679]: pgmap v8846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14882.520519 secs 2024-04-26T22:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:04 smithi092 ceph-mon[29156]: pgmap v8846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14882.520519 secs 2024-04-26T22:38:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:04 smithi189 ceph-mon[32756]: pgmap v8846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14882.520519 secs 2024-04-26T22:38:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:06 smithi156 ceph-mon[32679]: pgmap v8847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:06 smithi092 ceph-mon[29156]: pgmap v8847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:06 smithi189 ceph-mon[32756]: pgmap v8847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:08 smithi156 ceph-mon[32679]: pgmap v8848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15584.549605 secs 2024-04-26T22:38:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:08 smithi092 ceph-mon[29156]: pgmap v8848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15584.549605 secs 2024-04-26T22:38:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:08 smithi189 ceph-mon[32756]: pgmap v8848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15584.549605 secs 2024-04-26T22:38:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14887.520637 secs 2024-04-26T22:38:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14887.520637 secs 2024-04-26T22:38:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14887.520637 secs 2024-04-26T22:38:11.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:10 smithi092 ceph-mon[29156]: pgmap v8849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:10 smithi156 ceph-mon[32679]: pgmap v8849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:10 smithi189 ceph-mon[32756]: pgmap v8849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:12 smithi156 ceph-mon[32679]: pgmap v8850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:12 smithi092 ceph-mon[29156]: pgmap v8850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:12 smithi189 ceph-mon[32756]: pgmap v8850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15589.549725 secs 2024-04-26T22:38:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15589.549725 secs 2024-04-26T22:38:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15589.549725 secs 2024-04-26T22:38:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:14 smithi092 ceph-mon[29156]: pgmap v8851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14892.520752 secs 2024-04-26T22:38:15.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:14 smithi189 ceph-mon[32756]: pgmap v8851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:15.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14892.520752 secs 2024-04-26T22:38:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:14 smithi156 ceph-mon[32679]: pgmap v8851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14892.520752 secs 2024-04-26T22:38:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:16 smithi092 ceph-mon[29156]: pgmap v8852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:16 smithi189 ceph-mon[32756]: pgmap v8852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:16 smithi156 ceph-mon[32679]: pgmap v8852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:18 smithi092 ceph-mon[29156]: pgmap v8853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15594.549856 secs 2024-04-26T22:38:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:18 smithi189 ceph-mon[32756]: pgmap v8853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15594.549856 secs 2024-04-26T22:38:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:18 smithi156 ceph-mon[32679]: pgmap v8853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15594.549856 secs 2024-04-26T22:38:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14897.520837 secs 2024-04-26T22:38:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14897.520837 secs 2024-04-26T22:38:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14897.520837 secs 2024-04-26T22:38:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:20 smithi092 ceph-mon[29156]: pgmap v8854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:20 smithi189 ceph-mon[32756]: pgmap v8854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:20 smithi156 ceph-mon[32679]: pgmap v8854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:22 smithi092 ceph-mon[29156]: pgmap v8855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:22 smithi189 ceph-mon[32756]: pgmap v8855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:22 smithi156 ceph-mon[32679]: pgmap v8855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15599.549978 secs 2024-04-26T22:38:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15599.549978 secs 2024-04-26T22:38:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15599.549978 secs 2024-04-26T22:38:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:24 smithi092 ceph-mon[29156]: pgmap v8856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14902.520957 secs 2024-04-26T22:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:24 smithi189 ceph-mon[32756]: pgmap v8856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14902.520957 secs 2024-04-26T22:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:24 smithi156 ceph-mon[32679]: pgmap v8856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14902.520957 secs 2024-04-26T22:38:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:26 smithi092 ceph-mon[29156]: pgmap v8857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:26 smithi189 ceph-mon[32756]: pgmap v8857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:26 smithi156 ceph-mon[32679]: pgmap v8857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:28 smithi092 ceph-mon[29156]: pgmap v8858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15604.550058 secs 2024-04-26T22:38:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:28 smithi189 ceph-mon[32756]: pgmap v8858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15604.550058 secs 2024-04-26T22:38:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:28 smithi156 ceph-mon[32679]: pgmap v8858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15604.550058 secs 2024-04-26T22:38:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14907.521081 secs 2024-04-26T22:38:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14907.521081 secs 2024-04-26T22:38:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14907.521081 secs 2024-04-26T22:38:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:30 smithi092 ceph-mon[29156]: pgmap v8859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:30 smithi189 ceph-mon[32756]: pgmap v8859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:30 smithi156 ceph-mon[32679]: pgmap v8859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:32 smithi092 ceph-mon[29156]: pgmap v8860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:32 smithi189 ceph-mon[32756]: pgmap v8860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:32 smithi156 ceph-mon[32679]: pgmap v8860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15609.550154 secs 2024-04-26T22:38:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15609.550154 secs 2024-04-26T22:38:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15609.550154 secs 2024-04-26T22:38:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:34 smithi092 ceph-mon[29156]: pgmap v8861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14912.521193 secs 2024-04-26T22:38:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:34 smithi189 ceph-mon[32756]: pgmap v8861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14912.521193 secs 2024-04-26T22:38:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:34 smithi156 ceph-mon[32679]: pgmap v8861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14912.521193 secs 2024-04-26T22:38:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:36 smithi092 ceph-mon[29156]: pgmap v8862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:36 smithi189 ceph-mon[32756]: pgmap v8862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:36 smithi156 ceph-mon[32679]: pgmap v8862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:38 smithi189 ceph-mon[32756]: pgmap v8863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:38 smithi156 ceph-mon[32679]: pgmap v8863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:38 smithi092 ceph-mon[29156]: pgmap v8863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15614.550273 secs 2024-04-26T22:38:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15614.550273 secs 2024-04-26T22:38:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15614.550273 secs 2024-04-26T22:38:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14917.521323 secs 2024-04-26T22:38:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:40 smithi189 ceph-mon[32756]: pgmap v8864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14917.521323 secs 2024-04-26T22:38:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:40 smithi156 ceph-mon[32679]: pgmap v8864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14917.521323 secs 2024-04-26T22:38:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:40 smithi092 ceph-mon[29156]: pgmap v8864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:42 smithi092 ceph-mon[29156]: pgmap v8865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:42 smithi189 ceph-mon[32756]: pgmap v8865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:42 smithi156 ceph-mon[32679]: pgmap v8865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:44 smithi092 ceph-mon[29156]: pgmap v8866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15619.550391 secs 2024-04-26T22:38:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:44 smithi189 ceph-mon[32756]: pgmap v8866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15619.550391 secs 2024-04-26T22:38:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:44 smithi156 ceph-mon[32679]: pgmap v8866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15619.550391 secs 2024-04-26T22:38:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14922.521372 secs 2024-04-26T22:38:45.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14922.521372 secs 2024-04-26T22:38:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14922.521372 secs 2024-04-26T22:38:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:46 smithi092 ceph-mon[29156]: pgmap v8867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:46 smithi189 ceph-mon[32756]: pgmap v8867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:46 smithi156 ceph-mon[32679]: pgmap v8867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: pgmap v8868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: pgmap v8869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: pgmap v8870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:38:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: pgmap v8868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: pgmap v8869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:38:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: pgmap v8870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:38:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: pgmap v8868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: pgmap v8869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: pgmap v8870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:38:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:38:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15624.550512 secs 2024-04-26T22:38:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15624.550512 secs 2024-04-26T22:38:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15624.550512 secs 2024-04-26T22:38:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14927.521487 secs 2024-04-26T22:38:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:50 smithi092 ceph-mon[29156]: pgmap v8871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14927.521487 secs 2024-04-26T22:38:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:50 smithi189 ceph-mon[32756]: pgmap v8871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14927.521487 secs 2024-04-26T22:38:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:50 smithi156 ceph-mon[32679]: pgmap v8871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:52 smithi092 ceph-mon[29156]: pgmap v8872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:52 smithi189 ceph-mon[32756]: pgmap v8872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:52 smithi156 ceph-mon[32679]: pgmap v8872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15629.550648 secs 2024-04-26T22:38:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15629.550648 secs 2024-04-26T22:38:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15629.550648 secs 2024-04-26T22:38:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14932.521587 secs 2024-04-26T22:38:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:54 smithi092 ceph-mon[29156]: pgmap v8873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14932.521587 secs 2024-04-26T22:38:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:54 smithi189 ceph-mon[32756]: pgmap v8873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14932.521587 secs 2024-04-26T22:38:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:54 smithi156 ceph-mon[32679]: pgmap v8873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:56 smithi092 ceph-mon[29156]: pgmap v8874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:56 smithi189 ceph-mon[32756]: pgmap v8874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:56 smithi156 ceph-mon[32679]: pgmap v8874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:38:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:58 smithi092 ceph-mon[29156]: pgmap v8875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:38:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15634.550713 secs 2024-04-26T22:38:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:58 smithi189 ceph-mon[32756]: pgmap v8875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:38:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15634.550713 secs 2024-04-26T22:38:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:58 smithi156 ceph-mon[32679]: pgmap v8875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:38:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15634.550713 secs 2024-04-26T22:39:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:38:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14937.521704 secs 2024-04-26T22:39:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:38:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14937.521704 secs 2024-04-26T22:39:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:38:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14937.521704 secs 2024-04-26T22:39:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:00 smithi092 ceph-mon[29156]: pgmap v8876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:00 smithi189 ceph-mon[32756]: pgmap v8876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:00 smithi156 ceph-mon[32679]: pgmap v8876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:02 smithi092 ceph-mon[29156]: pgmap v8877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:02 smithi189 ceph-mon[32756]: pgmap v8877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:02 smithi156 ceph-mon[32679]: pgmap v8877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15639.550855 secs 2024-04-26T22:39:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15639.550855 secs 2024-04-26T22:39:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15639.550855 secs 2024-04-26T22:39:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14942.521831 secs 2024-04-26T22:39:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:04 smithi092 ceph-mon[29156]: pgmap v8878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14942.521831 secs 2024-04-26T22:39:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:04 smithi189 ceph-mon[32756]: pgmap v8878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14942.521831 secs 2024-04-26T22:39:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:04 smithi156 ceph-mon[32679]: pgmap v8878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:06 smithi092 ceph-mon[29156]: pgmap v8879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:06 smithi189 ceph-mon[32756]: pgmap v8879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:06 smithi156 ceph-mon[32679]: pgmap v8879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:08 smithi092 ceph-mon[29156]: pgmap v8880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15644.550967 secs 2024-04-26T22:39:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:08 smithi189 ceph-mon[32756]: pgmap v8880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15644.550967 secs 2024-04-26T22:39:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:08 smithi156 ceph-mon[32679]: pgmap v8880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15644.550967 secs 2024-04-26T22:39:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14947.521945 secs 2024-04-26T22:39:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14947.521945 secs 2024-04-26T22:39:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14947.521945 secs 2024-04-26T22:39:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:10 smithi189 ceph-mon[32756]: pgmap v8881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:10 smithi156 ceph-mon[32679]: pgmap v8881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:10 smithi092 ceph-mon[29156]: pgmap v8881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:12 smithi189 ceph-mon[32756]: pgmap v8882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:12 smithi156 ceph-mon[32679]: pgmap v8882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:12 smithi092 ceph-mon[29156]: pgmap v8882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15649.551051 secs 2024-04-26T22:39:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15649.551051 secs 2024-04-26T22:39:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15649.551051 secs 2024-04-26T22:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14952.522082 secs 2024-04-26T22:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:14 smithi156 ceph-mon[32679]: pgmap v8883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14952.522082 secs 2024-04-26T22:39:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:14 smithi092 ceph-mon[29156]: pgmap v8883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:15.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14952.522082 secs 2024-04-26T22:39:15.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:14 smithi189 ceph-mon[32756]: pgmap v8883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:16 smithi092 ceph-mon[29156]: pgmap v8884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:16 smithi189 ceph-mon[32756]: pgmap v8884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:16 smithi156 ceph-mon[32679]: pgmap v8884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:18 smithi092 ceph-mon[29156]: pgmap v8885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15654.551166 secs 2024-04-26T22:39:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:18 smithi189 ceph-mon[32756]: pgmap v8885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15654.551166 secs 2024-04-26T22:39:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:18 smithi156 ceph-mon[32679]: pgmap v8885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15654.551166 secs 2024-04-26T22:39:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14957.522198 secs 2024-04-26T22:39:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14957.522198 secs 2024-04-26T22:39:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14957.522198 secs 2024-04-26T22:39:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:20 smithi092 ceph-mon[29156]: pgmap v8886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:20 smithi189 ceph-mon[32756]: pgmap v8886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:20 smithi156 ceph-mon[32679]: pgmap v8886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:22 smithi092 ceph-mon[29156]: pgmap v8887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:22 smithi189 ceph-mon[32756]: pgmap v8887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:22 smithi156 ceph-mon[32679]: pgmap v8887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15659.551288 secs 2024-04-26T22:39:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15659.551288 secs 2024-04-26T22:39:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15659.551288 secs 2024-04-26T22:39:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14962.522333 secs 2024-04-26T22:39:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:24 smithi092 ceph-mon[29156]: pgmap v8888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14962.522333 secs 2024-04-26T22:39:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:24 smithi189 ceph-mon[32756]: pgmap v8888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14962.522333 secs 2024-04-26T22:39:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:24 smithi156 ceph-mon[32679]: pgmap v8888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:26 smithi092 ceph-mon[29156]: pgmap v8889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:26 smithi189 ceph-mon[32756]: pgmap v8889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:26 smithi156 ceph-mon[32679]: pgmap v8889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:28 smithi092 ceph-mon[29156]: pgmap v8890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15664.551426 secs 2024-04-26T22:39:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:28 smithi189 ceph-mon[32756]: pgmap v8890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15664.551426 secs 2024-04-26T22:39:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:28 smithi156 ceph-mon[32679]: pgmap v8890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15664.551426 secs 2024-04-26T22:39:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14967.522438 secs 2024-04-26T22:39:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14967.522438 secs 2024-04-26T22:39:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14967.522438 secs 2024-04-26T22:39:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:30 smithi189 ceph-mon[32756]: pgmap v8891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:30 smithi156 ceph-mon[32679]: pgmap v8891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:30 smithi092 ceph-mon[29156]: pgmap v8891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:32 smithi189 ceph-mon[32756]: pgmap v8892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:32 smithi156 ceph-mon[32679]: pgmap v8892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:32 smithi092 ceph-mon[29156]: pgmap v8892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15669.551580 secs 2024-04-26T22:39:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15669.551580 secs 2024-04-26T22:39:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15669.551580 secs 2024-04-26T22:39:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14972.522502 secs 2024-04-26T22:39:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:34 smithi156 ceph-mon[32679]: pgmap v8893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14972.522502 secs 2024-04-26T22:39:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:34 smithi092 ceph-mon[29156]: pgmap v8893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14972.522502 secs 2024-04-26T22:39:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:34 smithi189 ceph-mon[32756]: pgmap v8893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:36 smithi092 ceph-mon[29156]: pgmap v8894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:36 smithi189 ceph-mon[32756]: pgmap v8894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:36 smithi156 ceph-mon[32679]: pgmap v8894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:39:38.131+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:39:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:39:38.131+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:39:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:39:38.131+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:39:38.132 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:39:38.131+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 123 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:39:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:38 smithi092 ceph-mon[29156]: pgmap v8895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15674.551707 secs 2024-04-26T22:39:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:38 smithi189 ceph-mon[32756]: pgmap v8895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15674.551707 secs 2024-04-26T22:39:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:38 smithi156 ceph-mon[32679]: pgmap v8895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15674.551707 secs 2024-04-26T22:39:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14977.522583 secs 2024-04-26T22:39:40.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14977.522583 secs 2024-04-26T22:39:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14977.522583 secs 2024-04-26T22:39:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:40 smithi092 ceph-mon[29156]: pgmap v8896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:40 smithi189 ceph-mon[32756]: pgmap v8896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:40 smithi156 ceph-mon[32679]: pgmap v8896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:42 smithi092 ceph-mon[29156]: pgmap v8897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:42 smithi189 ceph-mon[32756]: pgmap v8897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:42 smithi156 ceph-mon[32679]: pgmap v8897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15679.551833 secs 2024-04-26T22:39:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15679.551833 secs 2024-04-26T22:39:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15679.551833 secs 2024-04-26T22:39:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14982.522660 secs 2024-04-26T22:39:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:44 smithi092 ceph-mon[29156]: pgmap v8898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:45.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14982.522660 secs 2024-04-26T22:39:45.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:44 smithi189 ceph-mon[32756]: pgmap v8898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14982.522660 secs 2024-04-26T22:39:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:44 smithi156 ceph-mon[32679]: pgmap v8898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:39:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:46 smithi092 ceph-mon[29156]: pgmap v8899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:46 smithi189 ceph-mon[32756]: pgmap v8899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:46 smithi156 ceph-mon[32679]: pgmap v8899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: pgmap v8900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15684.551874 secs 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:39:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: pgmap v8900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15684.551874 secs 2024-04-26T22:39:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: pgmap v8900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15684.551874 secs 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:39:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:39:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14987.522721 secs 2024-04-26T22:39:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:50 smithi189 ceph-mon[32756]: pgmap v8901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:39:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:50 smithi189 ceph-mon[32756]: pgmap v8902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14987.522721 secs 2024-04-26T22:39:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:50 smithi156 ceph-mon[32679]: pgmap v8901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:39:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:50 smithi156 ceph-mon[32679]: pgmap v8902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14987.522721 secs 2024-04-26T22:39:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:50 smithi092 ceph-mon[29156]: pgmap v8901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:39:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:50 smithi092 ceph-mon[29156]: pgmap v8902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:51 smithi189 ceph-mon[32756]: pgmap v8903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:51 smithi156 ceph-mon[32679]: pgmap v8903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:51 smithi092 ceph-mon[29156]: pgmap v8903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:53 smithi092 ceph-mon[29156]: pgmap v8904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15689.551994 secs 2024-04-26T22:39:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:53 smithi189 ceph-mon[32756]: pgmap v8904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:39:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15689.551994 secs 2024-04-26T22:39:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:53 smithi156 ceph-mon[32679]: pgmap v8904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:39:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15689.551994 secs 2024-04-26T22:39:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14992.522814 secs 2024-04-26T22:39:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14992.522814 secs 2024-04-26T22:39:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14992.522814 secs 2024-04-26T22:39:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:55 smithi092 ceph-mon[29156]: pgmap v8905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:55 smithi189 ceph-mon[32756]: pgmap v8905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:55 smithi156 ceph-mon[32679]: pgmap v8905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:57 smithi189 ceph-mon[32756]: pgmap v8906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:57 smithi156 ceph-mon[32679]: pgmap v8906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:57 smithi092 ceph-mon[29156]: pgmap v8906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:39:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15694.552057 secs 2024-04-26T22:39:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15694.552057 secs 2024-04-26T22:39:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15694.552057 secs 2024-04-26T22:40:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 14997.522927 secs 2024-04-26T22:40:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:39:59 smithi189 ceph-mon[32756]: pgmap v8907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:40:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 14997.522927 secs 2024-04-26T22:40:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:39:59 smithi156 ceph-mon[32679]: pgmap v8907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:40:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 14997.522927 secs 2024-04-26T22:40:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:39:59 smithi092 ceph-mon[29156]: pgmap v8907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:40:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:40:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:40:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:40:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:01 smithi189 ceph-mon[32756]: pgmap v8908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:01 smithi156 ceph-mon[32679]: pgmap v8908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:01 smithi092 ceph-mon[29156]: pgmap v8908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:03 smithi189 ceph-mon[32756]: pgmap v8909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15699.552147 secs 2024-04-26T22:40:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:03 smithi156 ceph-mon[32679]: pgmap v8909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15699.552147 secs 2024-04-26T22:40:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:03 smithi092 ceph-mon[29156]: pgmap v8909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15699.552147 secs 2024-04-26T22:40:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15002.523044 secs 2024-04-26T22:40:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15002.523044 secs 2024-04-26T22:40:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15002.523044 secs 2024-04-26T22:40:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:05 smithi189 ceph-mon[32756]: pgmap v8910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:05 smithi156 ceph-mon[32679]: pgmap v8910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:05 smithi092 ceph-mon[29156]: pgmap v8910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:07 smithi189 ceph-mon[32756]: pgmap v8911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:07 smithi156 ceph-mon[32679]: pgmap v8911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:07 smithi092 ceph-mon[29156]: pgmap v8911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15704.552270 secs 2024-04-26T22:40:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15704.552270 secs 2024-04-26T22:40:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15704.552270 secs 2024-04-26T22:40:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15007.523179 secs 2024-04-26T22:40:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:09 smithi189 ceph-mon[32756]: pgmap v8912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15007.523179 secs 2024-04-26T22:40:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:09 smithi156 ceph-mon[32679]: pgmap v8912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15007.523179 secs 2024-04-26T22:40:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:09 smithi092 ceph-mon[29156]: pgmap v8912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:11 smithi189 ceph-mon[32756]: pgmap v8913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:11 smithi156 ceph-mon[32679]: pgmap v8913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:11 smithi092 ceph-mon[29156]: pgmap v8913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:14.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:13 smithi092 ceph-mon[29156]: pgmap v8914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:14.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15709.552395 secs 2024-04-26T22:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:13 smithi189 ceph-mon[32756]: pgmap v8914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15709.552395 secs 2024-04-26T22:40:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:13 smithi156 ceph-mon[32679]: pgmap v8914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15709.552395 secs 2024-04-26T22:40:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15012.523287 secs 2024-04-26T22:40:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15012.523287 secs 2024-04-26T22:40:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15012.523287 secs 2024-04-26T22:40:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:15 smithi092 ceph-mon[29156]: pgmap v8915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:15 smithi189 ceph-mon[32756]: pgmap v8915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:15 smithi156 ceph-mon[32679]: pgmap v8915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:17 smithi189 ceph-mon[32756]: pgmap v8916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:17 smithi156 ceph-mon[32679]: pgmap v8916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:17 smithi092 ceph-mon[29156]: pgmap v8916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15714.552515 secs 2024-04-26T22:40:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15714.552515 secs 2024-04-26T22:40:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15714.552515 secs 2024-04-26T22:40:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15017.523404 secs 2024-04-26T22:40:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:19 smithi189 ceph-mon[32756]: pgmap v8917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15017.523404 secs 2024-04-26T22:40:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:19 smithi156 ceph-mon[32679]: pgmap v8917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15017.523404 secs 2024-04-26T22:40:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:19 smithi092 ceph-mon[29156]: pgmap v8917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:21 smithi189 ceph-mon[32756]: pgmap v8918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:21 smithi156 ceph-mon[32679]: pgmap v8918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:21 smithi092 ceph-mon[29156]: pgmap v8918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:23 smithi189 ceph-mon[32756]: pgmap v8919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15719.552650 secs 2024-04-26T22:40:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:23 smithi156 ceph-mon[32679]: pgmap v8919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15719.552650 secs 2024-04-26T22:40:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:23 smithi092 ceph-mon[29156]: pgmap v8919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15719.552650 secs 2024-04-26T22:40:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15022.523524 secs 2024-04-26T22:40:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15022.523524 secs 2024-04-26T22:40:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15022.523524 secs 2024-04-26T22:40:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:25 smithi189 ceph-mon[32756]: pgmap v8920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:25 smithi156 ceph-mon[32679]: pgmap v8920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:25 smithi092 ceph-mon[29156]: pgmap v8920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:27 smithi189 ceph-mon[32756]: pgmap v8921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:27 smithi156 ceph-mon[32679]: pgmap v8921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:27 smithi092 ceph-mon[29156]: pgmap v8921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15724.552787 secs 2024-04-26T22:40:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15724.552787 secs 2024-04-26T22:40:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15724.552787 secs 2024-04-26T22:40:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15027.523599 secs 2024-04-26T22:40:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:29 smithi189 ceph-mon[32756]: pgmap v8922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15027.523599 secs 2024-04-26T22:40:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:29 smithi156 ceph-mon[32679]: pgmap v8922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15027.523599 secs 2024-04-26T22:40:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:29 smithi092 ceph-mon[29156]: pgmap v8922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:31 smithi189 ceph-mon[32756]: pgmap v8923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:31 smithi156 ceph-mon[32679]: pgmap v8923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:31 smithi092 ceph-mon[29156]: pgmap v8923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:33 smithi189 ceph-mon[32756]: pgmap v8924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15729.552915 secs 2024-04-26T22:40:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:33 smithi156 ceph-mon[32679]: pgmap v8924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15729.552915 secs 2024-04-26T22:40:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:33 smithi092 ceph-mon[29156]: pgmap v8924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15729.552915 secs 2024-04-26T22:40:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15032.523719 secs 2024-04-26T22:40:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15032.523719 secs 2024-04-26T22:40:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15032.523719 secs 2024-04-26T22:40:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:35 smithi189 ceph-mon[32756]: pgmap v8925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:35 smithi156 ceph-mon[32679]: pgmap v8925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:35 smithi092 ceph-mon[29156]: pgmap v8925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:37 smithi189 ceph-mon[32756]: pgmap v8926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:37 smithi156 ceph-mon[32679]: pgmap v8926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:37 smithi092 ceph-mon[29156]: pgmap v8926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15734.553030 secs 2024-04-26T22:40:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15734.553030 secs 2024-04-26T22:40:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15734.553030 secs 2024-04-26T22:40:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15037.523854 secs 2024-04-26T22:40:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:39 smithi189 ceph-mon[32756]: pgmap v8927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15037.523854 secs 2024-04-26T22:40:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:39 smithi156 ceph-mon[32679]: pgmap v8927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15037.523854 secs 2024-04-26T22:40:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:39 smithi092 ceph-mon[29156]: pgmap v8927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:41 smithi189 ceph-mon[32756]: pgmap v8928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:41 smithi156 ceph-mon[32679]: pgmap v8928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:41 smithi092 ceph-mon[29156]: pgmap v8928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:43 smithi189 ceph-mon[32756]: pgmap v8929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15739.553094 secs 2024-04-26T22:40:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:43 smithi156 ceph-mon[32679]: pgmap v8929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15739.553094 secs 2024-04-26T22:40:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:43 smithi092 ceph-mon[29156]: pgmap v8929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15739.553094 secs 2024-04-26T22:40:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15042.523926 secs 2024-04-26T22:40:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15042.523926 secs 2024-04-26T22:40:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15042.523926 secs 2024-04-26T22:40:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:45 smithi189 ceph-mon[32756]: pgmap v8930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:46.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:45 smithi092 ceph-mon[29156]: pgmap v8930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:45 smithi156 ceph-mon[32679]: pgmap v8930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:47 smithi189 ceph-mon[32756]: pgmap v8931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:47 smithi156 ceph-mon[32679]: pgmap v8931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:47 smithi092 ceph-mon[29156]: pgmap v8931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:40:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15744.553232 secs 2024-04-26T22:40:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15744.553232 secs 2024-04-26T22:40:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15744.553232 secs 2024-04-26T22:40:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:40:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15047.523989 secs 2024-04-26T22:40:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:49 smithi156 ceph-mon[32679]: pgmap v8932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15047.523989 secs 2024-04-26T22:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:49 smithi092 ceph-mon[29156]: pgmap v8932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15047.523989 secs 2024-04-26T22:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:49 smithi189 ceph-mon[32756]: pgmap v8932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:40:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:50 smithi156 ceph-mon[32679]: pgmap v8933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:40:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:50 smithi156 ceph-mon[32679]: pgmap v8934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:50 smithi092 ceph-mon[29156]: pgmap v8933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:40:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:50 smithi092 ceph-mon[29156]: pgmap v8934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:50 smithi189 ceph-mon[32756]: pgmap v8933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:40:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:50 smithi189 ceph-mon[32756]: pgmap v8934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:52 smithi156 ceph-mon[32679]: pgmap v8935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:53.304 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:52 smithi092 ceph-mon[29156]: pgmap v8935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:52 smithi189 ceph-mon[32756]: pgmap v8935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15749.553324 secs 2024-04-26T22:40:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15749.553324 secs 2024-04-26T22:40:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15749.553324 secs 2024-04-26T22:40:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:54 smithi156 ceph-mon[32679]: pgmap v8936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15052.524125 secs 2024-04-26T22:40:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:54 smithi092 ceph-mon[29156]: pgmap v8936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15052.524125 secs 2024-04-26T22:40:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:54 smithi189 ceph-mon[32756]: pgmap v8936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15052.524125 secs 2024-04-26T22:40:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:56 smithi156 ceph-mon[32679]: pgmap v8937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:56 smithi092 ceph-mon[29156]: pgmap v8937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:56 smithi189 ceph-mon[32756]: pgmap v8937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:40:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:58 smithi156 ceph-mon[32679]: pgmap v8938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15754.553393 secs 2024-04-26T22:40:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:58 smithi092 ceph-mon[29156]: pgmap v8938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15754.553393 secs 2024-04-26T22:40:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:58 smithi189 ceph-mon[32756]: pgmap v8938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:40:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15754.553393 secs 2024-04-26T22:41:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:40:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15057.524224 secs 2024-04-26T22:41:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:40:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15057.524224 secs 2024-04-26T22:41:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:40:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15057.524224 secs 2024-04-26T22:41:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:00 smithi156 ceph-mon[32679]: pgmap v8939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:41:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:00 smithi092 ceph-mon[29156]: pgmap v8939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:41:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:00 smithi189 ceph-mon[32756]: pgmap v8939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:41:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:02 smithi156 ceph-mon[32679]: pgmap v8940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:02 smithi092 ceph-mon[29156]: pgmap v8940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:02 smithi189 ceph-mon[32756]: pgmap v8940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15759.553526 secs 2024-04-26T22:41:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15759.553526 secs 2024-04-26T22:41:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15759.553526 secs 2024-04-26T22:41:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:04 smithi156 ceph-mon[32679]: pgmap v8941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:04 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 15062.524285 secs 2024-04-26T22:41:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:04 smithi156 ceph-mon[32679]: slow request 5760.160365 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:41:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:04 smithi092 ceph-mon[29156]: pgmap v8941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:04 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 15062.524285 secs 2024-04-26T22:41:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:04 smithi092 ceph-mon[29156]: slow request 5760.160365 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:41:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:04 smithi189 ceph-mon[32756]: pgmap v8941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:04 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 15062.524285 secs 2024-04-26T22:41:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:04 smithi189 ceph-mon[32756]: slow request 5760.160365 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:41:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:06 smithi092 ceph-mon[29156]: pgmap v8942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:06 smithi189 ceph-mon[32756]: pgmap v8942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:06 smithi156 ceph-mon[32679]: pgmap v8942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:09.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:08 smithi156 ceph-mon[32679]: pgmap v8943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:09.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15764.553659 secs 2024-04-26T22:41:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:08 smithi092 ceph-mon[29156]: pgmap v8943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15764.553659 secs 2024-04-26T22:41:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:08 smithi189 ceph-mon[32756]: pgmap v8943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15764.553659 secs 2024-04-26T22:41:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15067.524375 secs 2024-04-26T22:41:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15067.524375 secs 2024-04-26T22:41:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15067.524375 secs 2024-04-26T22:41:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:10 smithi092 ceph-mon[29156]: pgmap v8944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:10 smithi189 ceph-mon[32756]: pgmap v8944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:10 smithi156 ceph-mon[32679]: pgmap v8944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:12 smithi092 ceph-mon[29156]: pgmap v8945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:12 smithi189 ceph-mon[32756]: pgmap v8945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:12 smithi156 ceph-mon[32679]: pgmap v8945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15769.553718 secs 2024-04-26T22:41:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15769.553718 secs 2024-04-26T22:41:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15769.553718 secs 2024-04-26T22:41:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:14 smithi092 ceph-mon[29156]: pgmap v8946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15072.524437 secs 2024-04-26T22:41:15.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:14 smithi189 ceph-mon[32756]: pgmap v8946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:15.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15072.524437 secs 2024-04-26T22:41:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:14 smithi156 ceph-mon[32679]: pgmap v8946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15072.524437 secs 2024-04-26T22:41:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:16 smithi092 ceph-mon[29156]: pgmap v8947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:16 smithi189 ceph-mon[32756]: pgmap v8947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:16 smithi156 ceph-mon[32679]: pgmap v8947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:18 smithi092 ceph-mon[29156]: pgmap v8948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15774.553856 secs 2024-04-26T22:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:18 smithi189 ceph-mon[32756]: pgmap v8948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15774.553856 secs 2024-04-26T22:41:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:18 smithi156 ceph-mon[32679]: pgmap v8948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15774.553856 secs 2024-04-26T22:41:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15077.524532 secs 2024-04-26T22:41:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15077.524532 secs 2024-04-26T22:41:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15077.524532 secs 2024-04-26T22:41:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:20 smithi092 ceph-mon[29156]: pgmap v8949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:20 smithi189 ceph-mon[32756]: pgmap v8949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:20 smithi156 ceph-mon[32679]: pgmap v8949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:22 smithi092 ceph-mon[29156]: pgmap v8950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:22 smithi189 ceph-mon[32756]: pgmap v8950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:22 smithi156 ceph-mon[32679]: pgmap v8950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15779.553974 secs 2024-04-26T22:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15779.553974 secs 2024-04-26T22:41:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15779.553974 secs 2024-04-26T22:41:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:24 smithi092 ceph-mon[29156]: pgmap v8951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15082.524672 secs 2024-04-26T22:41:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:24 smithi189 ceph-mon[32756]: pgmap v8951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15082.524672 secs 2024-04-26T22:41:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:24 smithi156 ceph-mon[32679]: pgmap v8951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15082.524672 secs 2024-04-26T22:41:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:26 smithi092 ceph-mon[29156]: pgmap v8952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:26 smithi189 ceph-mon[32756]: pgmap v8952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:26 smithi156 ceph-mon[32679]: pgmap v8952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:28 smithi092 ceph-mon[29156]: pgmap v8953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15784.554074 secs 2024-04-26T22:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:28 smithi189 ceph-mon[32756]: pgmap v8953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15784.554074 secs 2024-04-26T22:41:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:28 smithi156 ceph-mon[32679]: pgmap v8953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15784.554074 secs 2024-04-26T22:41:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15087.524763 secs 2024-04-26T22:41:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15087.524763 secs 2024-04-26T22:41:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15087.524763 secs 2024-04-26T22:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:30 smithi189 ceph-mon[32756]: pgmap v8954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:30 smithi156 ceph-mon[32679]: pgmap v8954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:30 smithi092 ceph-mon[29156]: pgmap v8954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:32 smithi092 ceph-mon[29156]: pgmap v8955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:33 smithi189 ceph-mon[32756]: pgmap v8955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:32 smithi156 ceph-mon[32679]: pgmap v8955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15789.554195 secs 2024-04-26T22:41:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15789.554195 secs 2024-04-26T22:41:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15789.554195 secs 2024-04-26T22:41:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:35 smithi189 ceph-mon[32756]: pgmap v8956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15092.524840 secs 2024-04-26T22:41:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:35 smithi156 ceph-mon[32679]: pgmap v8956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15092.524840 secs 2024-04-26T22:41:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:35 smithi092 ceph-mon[29156]: pgmap v8956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15092.524840 secs 2024-04-26T22:41:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:37 smithi189 ceph-mon[32756]: pgmap v8957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:37 smithi156 ceph-mon[32679]: pgmap v8957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:37 smithi092 ceph-mon[29156]: pgmap v8957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:39 smithi189 ceph-mon[32756]: pgmap v8958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15794.554314 secs 2024-04-26T22:41:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:39 smithi156 ceph-mon[32679]: pgmap v8958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15794.554314 secs 2024-04-26T22:41:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:39 smithi092 ceph-mon[29156]: pgmap v8958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:41:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15794.554314 secs 2024-04-26T22:41:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15097.524956 secs 2024-04-26T22:41:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15097.524956 secs 2024-04-26T22:41:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15097.524956 secs 2024-04-26T22:41:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:41 smithi189 ceph-mon[32756]: pgmap v8959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:41 smithi156 ceph-mon[32679]: pgmap v8959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:41 smithi092 ceph-mon[29156]: pgmap v8959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:42 smithi189 ceph-mon[32756]: pgmap v8960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:42 smithi156 ceph-mon[32679]: pgmap v8960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:42 smithi092 ceph-mon[29156]: pgmap v8960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15799.554447 secs 2024-04-26T22:41:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:44 smithi189 ceph-mon[32756]: pgmap v8961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15799.554447 secs 2024-04-26T22:41:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:44 smithi156 ceph-mon[32679]: pgmap v8961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15799.554447 secs 2024-04-26T22:41:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:44 smithi092 ceph-mon[29156]: pgmap v8961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15102.525079 secs 2024-04-26T22:41:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15102.525079 secs 2024-04-26T22:41:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15102.525079 secs 2024-04-26T22:41:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:46 smithi189 ceph-mon[32756]: pgmap v8962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:46 smithi156 ceph-mon[32679]: pgmap v8962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:46 smithi092 ceph-mon[29156]: pgmap v8962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:48.861 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:48 smithi092 ceph-mon[29156]: pgmap v8963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:48 smithi189 ceph-mon[32756]: pgmap v8963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:48 smithi156 ceph-mon[32679]: pgmap v8963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:41:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15804.554570 secs 2024-04-26T22:41:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15804.554570 secs 2024-04-26T22:41:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15804.554570 secs 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15107.525214 secs 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: pgmap v8964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:41:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15107.525214 secs 2024-04-26T22:41:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: pgmap v8964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15107.525214 secs 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: pgmap v8964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:41:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:41:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:51 smithi189 ceph-mon[32756]: pgmap v8965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:41:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:51 smithi189 ceph-mon[32756]: pgmap v8966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:51 smithi156 ceph-mon[32679]: pgmap v8965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:41:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:51 smithi156 ceph-mon[32679]: pgmap v8966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:51 smithi092 ceph-mon[29156]: pgmap v8965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:41:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:51 smithi092 ceph-mon[29156]: pgmap v8966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:53 smithi189 ceph-mon[32756]: pgmap v8967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:53 smithi156 ceph-mon[32679]: pgmap v8967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:53 smithi092 ceph-mon[29156]: pgmap v8967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15809.554688 secs 2024-04-26T22:41:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15809.554688 secs 2024-04-26T22:41:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15809.554688 secs 2024-04-26T22:41:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15112.525337 secs 2024-04-26T22:41:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:55 smithi189 ceph-mon[32756]: pgmap v8968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15112.525337 secs 2024-04-26T22:41:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:55 smithi156 ceph-mon[32679]: pgmap v8968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15112.525337 secs 2024-04-26T22:41:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:55 smithi092 ceph-mon[29156]: pgmap v8968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:57 smithi189 ceph-mon[32756]: pgmap v8969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:57 smithi156 ceph-mon[32679]: pgmap v8969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:57 smithi092 ceph-mon[29156]: pgmap v8969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:41:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:59 smithi189 ceph-mon[32756]: pgmap v8970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:41:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:41:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15814.554800 secs 2024-04-26T22:41:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:59 smithi156 ceph-mon[32679]: pgmap v8970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:41:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:41:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15814.554800 secs 2024-04-26T22:41:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:59 smithi092 ceph-mon[29156]: pgmap v8970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:41:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:41:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15814.554800 secs 2024-04-26T22:42:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15117.525454 secs 2024-04-26T22:42:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15117.525454 secs 2024-04-26T22:42:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15117.525454 secs 2024-04-26T22:42:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:01 smithi189 ceph-mon[32756]: pgmap v8971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:42:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:01 smithi156 ceph-mon[32679]: pgmap v8971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:42:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:01 smithi092 ceph-mon[29156]: pgmap v8971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:42:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:03 smithi189 ceph-mon[32756]: pgmap v8972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:03 smithi156 ceph-mon[32679]: pgmap v8972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:03 smithi092 ceph-mon[29156]: pgmap v8972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15819.554914 secs 2024-04-26T22:42:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15819.554914 secs 2024-04-26T22:42:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15819.554914 secs 2024-04-26T22:42:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:42:04.995+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:42:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:42:04.995+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:42:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:42:04.995+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:42:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:42:04.995+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:42:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:42:04 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:42:04.995+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:42:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15122.525518 secs 2024-04-26T22:42:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:05 smithi189 ceph-mon[32756]: pgmap v8973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:42:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15122.525518 secs 2024-04-26T22:42:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:05 smithi156 ceph-mon[32679]: pgmap v8973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:42:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15122.525518 secs 2024-04-26T22:42:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:05 smithi092 ceph-mon[29156]: pgmap v8973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:42:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:07 smithi189 ceph-mon[32756]: pgmap v8974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:07 smithi156 ceph-mon[32679]: pgmap v8974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:07 smithi092 ceph-mon[29156]: pgmap v8974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:09 smithi189 ceph-mon[32756]: pgmap v8975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15824.554997 secs 2024-04-26T22:42:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:09 smithi156 ceph-mon[32679]: pgmap v8975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15824.554997 secs 2024-04-26T22:42:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:09 smithi092 ceph-mon[29156]: pgmap v8975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:42:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15824.554997 secs 2024-04-26T22:42:10.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15127.525580 secs 2024-04-26T22:42:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15127.525580 secs 2024-04-26T22:42:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15127.525580 secs 2024-04-26T22:42:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:11 smithi189 ceph-mon[32756]: pgmap v8976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:11 smithi156 ceph-mon[32679]: pgmap v8976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:11 smithi092 ceph-mon[29156]: pgmap v8976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:13 smithi189 ceph-mon[32756]: pgmap v8977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:13 smithi156 ceph-mon[32679]: pgmap v8977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:13 smithi092 ceph-mon[29156]: pgmap v8977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15829.555118 secs 2024-04-26T22:42:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15829.555118 secs 2024-04-26T22:42:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15829.555118 secs 2024-04-26T22:42:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15132.525704 secs 2024-04-26T22:42:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:15 smithi189 ceph-mon[32756]: pgmap v8978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15132.525704 secs 2024-04-26T22:42:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:15 smithi156 ceph-mon[32679]: pgmap v8978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15132.525704 secs 2024-04-26T22:42:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:15 smithi092 ceph-mon[29156]: pgmap v8978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:17 smithi189 ceph-mon[32756]: pgmap v8979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:17 smithi156 ceph-mon[32679]: pgmap v8979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:17 smithi092 ceph-mon[29156]: pgmap v8979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15834.555215 secs 2024-04-26T22:42:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15834.555215 secs 2024-04-26T22:42:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15834.555215 secs 2024-04-26T22:42:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:19 smithi189 ceph-mon[32756]: pgmap v8980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:19 smithi156 ceph-mon[32679]: pgmap v8980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:19 smithi092 ceph-mon[29156]: pgmap v8980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T22:42:20.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15137.525841 secs 2024-04-26T22:42:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15137.525841 secs 2024-04-26T22:42:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15137.525841 secs 2024-04-26T22:42:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:21 smithi156 ceph-mon[32679]: pgmap v8981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:21 smithi092 ceph-mon[29156]: pgmap v8981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:21 smithi189 ceph-mon[32756]: pgmap v8981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T22:42:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:23 smithi156 ceph-mon[32679]: pgmap v8982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15839.555295 secs 2024-04-26T22:42:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:23 smithi092 ceph-mon[29156]: pgmap v8982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15839.555295 secs 2024-04-26T22:42:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:23 smithi189 ceph-mon[32756]: pgmap v8982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15839.555295 secs 2024-04-26T22:42:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15142.525901 secs 2024-04-26T22:42:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:25 smithi156 ceph-mon[32679]: pgmap v8983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15142.525901 secs 2024-04-26T22:42:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:25 smithi092 ceph-mon[29156]: pgmap v8983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15142.525901 secs 2024-04-26T22:42:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:25 smithi189 ceph-mon[32756]: pgmap v8983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:27 smithi156 ceph-mon[32679]: pgmap v8984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:27 smithi092 ceph-mon[29156]: pgmap v8984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:27 smithi189 ceph-mon[32756]: pgmap v8984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15844.555415 secs 2024-04-26T22:42:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15844.555415 secs 2024-04-26T22:42:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15844.555415 secs 2024-04-26T22:42:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:29 smithi156 ceph-mon[32679]: pgmap v8985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15147.526051 secs 2024-04-26T22:42:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:29 smithi092 ceph-mon[29156]: pgmap v8985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15147.526051 secs 2024-04-26T22:42:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:29 smithi189 ceph-mon[32756]: pgmap v8985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15147.526051 secs 2024-04-26T22:42:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:31 smithi156 ceph-mon[32679]: pgmap v8986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:31 smithi092 ceph-mon[29156]: pgmap v8986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:31 smithi189 ceph-mon[32756]: pgmap v8986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:33 smithi156 ceph-mon[32679]: pgmap v8987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15849.555541 secs 2024-04-26T22:42:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:33 smithi092 ceph-mon[29156]: pgmap v8987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15849.555541 secs 2024-04-26T22:42:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:33 smithi189 ceph-mon[32756]: pgmap v8987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15849.555541 secs 2024-04-26T22:42:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15152.526163 secs 2024-04-26T22:42:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15152.526163 secs 2024-04-26T22:42:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15152.526163 secs 2024-04-26T22:42:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:35 smithi156 ceph-mon[32679]: pgmap v8988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:35.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:35 smithi092 ceph-mon[29156]: pgmap v8988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:35 smithi189 ceph-mon[32756]: pgmap v8988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:37 smithi156 ceph-mon[32679]: pgmap v8989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:37 smithi092 ceph-mon[29156]: pgmap v8989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:37 smithi189 ceph-mon[32756]: pgmap v8989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.156+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:42:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.156+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:42:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T22:42:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:42:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 124 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T22:42:38.157 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:42:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:42:38.158 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:42:38.157+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 125 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:42:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15854.555685 secs 2024-04-26T22:42:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15854.555685 secs 2024-04-26T22:42:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15854.555685 secs 2024-04-26T22:42:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:39 smithi092 ceph-mon[29156]: pgmap v8990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15157.526280 secs 2024-04-26T22:42:40.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:39 smithi156 ceph-mon[32679]: pgmap v8990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:40.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15157.526280 secs 2024-04-26T22:42:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:39 smithi189 ceph-mon[32756]: pgmap v8990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15157.526280 secs 2024-04-26T22:42:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:41 smithi092 ceph-mon[29156]: pgmap v8991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:41 smithi189 ceph-mon[32756]: pgmap v8991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:41 smithi156 ceph-mon[32679]: pgmap v8991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:43 smithi092 ceph-mon[29156]: pgmap v8992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15859.555802 secs 2024-04-26T22:42:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:43 smithi189 ceph-mon[32756]: pgmap v8992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15859.555802 secs 2024-04-26T22:42:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:43 smithi156 ceph-mon[32679]: pgmap v8992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15859.555802 secs 2024-04-26T22:42:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15162.526395 secs 2024-04-26T22:42:45.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15162.526395 secs 2024-04-26T22:42:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15162.526395 secs 2024-04-26T22:42:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:45 smithi092 ceph-mon[29156]: pgmap v8993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:45 smithi189 ceph-mon[32756]: pgmap v8993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:45 smithi156 ceph-mon[32679]: pgmap v8993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:47 smithi092 ceph-mon[29156]: pgmap v8994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:47 smithi189 ceph-mon[32756]: pgmap v8994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:47 smithi156 ceph-mon[32679]: pgmap v8994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15864.555883 secs 2024-04-26T22:42:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15864.555883 secs 2024-04-26T22:42:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15864.555883 secs 2024-04-26T22:42:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:49 smithi092 ceph-mon[29156]: pgmap v8995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15167.526510 secs 2024-04-26T22:42:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:49 smithi189 ceph-mon[32756]: pgmap v8995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15167.526510 secs 2024-04-26T22:42:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:49 smithi156 ceph-mon[32679]: pgmap v8995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:42:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15167.526510 secs 2024-04-26T22:42:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: pgmap v8996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: pgmap v8997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: pgmap v8998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: pgmap v8996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: pgmap v8997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: pgmap v8998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:42:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: pgmap v8996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:42:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:42:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:42:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: pgmap v8997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:42:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: pgmap v8998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:42:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:53 smithi189 ceph-mon[32756]: pgmap v8999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:42:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:53 smithi156 ceph-mon[32679]: pgmap v8999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:42:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:53 smithi092 ceph-mon[29156]: pgmap v8999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15869.556002 secs 2024-04-26T22:42:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15869.556002 secs 2024-04-26T22:42:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15869.556002 secs 2024-04-26T22:42:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15172.526615 secs 2024-04-26T22:42:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:55 smithi189 ceph-mon[32756]: pgmap v9000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15172.526615 secs 2024-04-26T22:42:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:55 smithi156 ceph-mon[32679]: pgmap v9000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15172.526615 secs 2024-04-26T22:42:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:55 smithi092 ceph-mon[29156]: pgmap v9000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:57 smithi189 ceph-mon[32756]: pgmap v9001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:57 smithi156 ceph-mon[32679]: pgmap v9001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:57 smithi092 ceph-mon[29156]: pgmap v9001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:42:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15874.556095 secs 2024-04-26T22:42:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15874.556095 secs 2024-04-26T22:42:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15874.556095 secs 2024-04-26T22:42:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15177.526724 secs 2024-04-26T22:42:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:42:59 smithi092 ceph-mon[29156]: pgmap v9002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15177.526724 secs 2024-04-26T22:43:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:42:59 smithi189 ceph-mon[32756]: pgmap v9002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15177.526724 secs 2024-04-26T22:43:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:42:59 smithi156 ceph-mon[32679]: pgmap v9002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:01 smithi189 ceph-mon[32756]: pgmap v9003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:43:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:01 smithi156 ceph-mon[32679]: pgmap v9003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:43:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:01 smithi092 ceph-mon[29156]: pgmap v9003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:43:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:03 smithi189 ceph-mon[32756]: pgmap v9004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:03 smithi156 ceph-mon[32679]: pgmap v9004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:03 smithi092 ceph-mon[29156]: pgmap v9004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15879.556208 secs 2024-04-26T22:43:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15879.556208 secs 2024-04-26T22:43:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15879.556208 secs 2024-04-26T22:43:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15182.526796 secs 2024-04-26T22:43:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:05 smithi189 ceph-mon[32756]: pgmap v9005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15182.526796 secs 2024-04-26T22:43:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:05 smithi156 ceph-mon[32679]: pgmap v9005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15182.526796 secs 2024-04-26T22:43:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:05 smithi092 ceph-mon[29156]: pgmap v9005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:07 smithi189 ceph-mon[32756]: pgmap v9006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:07 smithi156 ceph-mon[32679]: pgmap v9006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:07 smithi092 ceph-mon[29156]: pgmap v9006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15884.556272 secs 2024-04-26T22:43:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15884.556272 secs 2024-04-26T22:43:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15884.556272 secs 2024-04-26T22:43:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15187.526912 secs 2024-04-26T22:43:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:09 smithi092 ceph-mon[29156]: pgmap v9007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15187.526912 secs 2024-04-26T22:43:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:09 smithi189 ceph-mon[32756]: pgmap v9007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15187.526912 secs 2024-04-26T22:43:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:09 smithi156 ceph-mon[32679]: pgmap v9007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:11 smithi189 ceph-mon[32756]: pgmap v9008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:11 smithi156 ceph-mon[32679]: pgmap v9008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:11 smithi092 ceph-mon[29156]: pgmap v9008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:13 smithi189 ceph-mon[32756]: pgmap v9009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:13 smithi156 ceph-mon[32679]: pgmap v9009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:13 smithi092 ceph-mon[29156]: pgmap v9009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T22:43:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15889.556412 secs 2024-04-26T22:43:14.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15889.556412 secs 2024-04-26T22:43:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15889.556412 secs 2024-04-26T22:43:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15192.527024 secs 2024-04-26T22:43:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:15 smithi189 ceph-mon[32756]: pgmap v9010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15192.527024 secs 2024-04-26T22:43:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:15 smithi156 ceph-mon[32679]: pgmap v9010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15192.527024 secs 2024-04-26T22:43:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:15 smithi092 ceph-mon[29156]: pgmap v9010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:43:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:17 smithi189 ceph-mon[32756]: pgmap v9011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:17 smithi156 ceph-mon[32679]: pgmap v9011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:17 smithi092 ceph-mon[29156]: pgmap v9011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15894.556533 secs 2024-04-26T22:43:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15894.556533 secs 2024-04-26T22:43:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15894.556533 secs 2024-04-26T22:43:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15197.527143 secs 2024-04-26T22:43:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:19 smithi092 ceph-mon[29156]: pgmap v9012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15197.527143 secs 2024-04-26T22:43:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:19 smithi189 ceph-mon[32756]: pgmap v9012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15197.527143 secs 2024-04-26T22:43:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:19 smithi156 ceph-mon[32679]: pgmap v9012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:21 smithi189 ceph-mon[32756]: pgmap v9013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:21 smithi156 ceph-mon[32679]: pgmap v9013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:21 smithi092 ceph-mon[29156]: pgmap v9013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:23 smithi189 ceph-mon[32756]: pgmap v9014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:23 smithi156 ceph-mon[32679]: pgmap v9014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:23 smithi092 ceph-mon[29156]: pgmap v9014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15899.556613 secs 2024-04-26T22:43:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15899.556613 secs 2024-04-26T22:43:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15899.556613 secs 2024-04-26T22:43:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15202.527252 secs 2024-04-26T22:43:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:25 smithi189 ceph-mon[32756]: pgmap v9015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15202.527252 secs 2024-04-26T22:43:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:25 smithi156 ceph-mon[32679]: pgmap v9015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15202.527252 secs 2024-04-26T22:43:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:25 smithi092 ceph-mon[29156]: pgmap v9015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:27 smithi189 ceph-mon[32756]: pgmap v9016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:27 smithi156 ceph-mon[32679]: pgmap v9016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:27 smithi092 ceph-mon[29156]: pgmap v9016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15904.556725 secs 2024-04-26T22:43:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15904.556725 secs 2024-04-26T22:43:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15904.556725 secs 2024-04-26T22:43:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15207.527366 secs 2024-04-26T22:43:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:29 smithi092 ceph-mon[29156]: pgmap v9017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15207.527366 secs 2024-04-26T22:43:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:29 smithi189 ceph-mon[32756]: pgmap v9017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15207.527366 secs 2024-04-26T22:43:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:29 smithi156 ceph-mon[32679]: pgmap v9017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:31 smithi189 ceph-mon[32756]: pgmap v9018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:31 smithi156 ceph-mon[32679]: pgmap v9018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:31 smithi092 ceph-mon[29156]: pgmap v9018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:33.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:33 smithi189 ceph-mon[32756]: pgmap v9019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:33 smithi156 ceph-mon[32679]: pgmap v9019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:33 smithi092 ceph-mon[29156]: pgmap v9019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15909.556846 secs 2024-04-26T22:43:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15909.556846 secs 2024-04-26T22:43:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15909.556846 secs 2024-04-26T22:43:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15212.527429 secs 2024-04-26T22:43:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:35 smithi189 ceph-mon[32756]: pgmap v9020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15212.527429 secs 2024-04-26T22:43:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:35 smithi156 ceph-mon[32679]: pgmap v9020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15212.527429 secs 2024-04-26T22:43:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:35 smithi092 ceph-mon[29156]: pgmap v9020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:37 smithi189 ceph-mon[32756]: pgmap v9021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:37 smithi156 ceph-mon[32679]: pgmap v9021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:37 smithi092 ceph-mon[29156]: pgmap v9021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15914.556902 secs 2024-04-26T22:43:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15914.556902 secs 2024-04-26T22:43:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15914.556902 secs 2024-04-26T22:43:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15217.527502 secs 2024-04-26T22:43:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:39 smithi092 ceph-mon[29156]: pgmap v9022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15217.527502 secs 2024-04-26T22:43:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:39 smithi189 ceph-mon[32756]: pgmap v9022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15217.527502 secs 2024-04-26T22:43:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:39 smithi156 ceph-mon[32679]: pgmap v9022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:41 smithi189 ceph-mon[32756]: pgmap v9023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:41 smithi156 ceph-mon[32679]: pgmap v9023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:41 smithi092 ceph-mon[29156]: pgmap v9023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:43 smithi189 ceph-mon[32756]: pgmap v9024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:43 smithi156 ceph-mon[32679]: pgmap v9024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:43 smithi092 ceph-mon[29156]: pgmap v9024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15919.556967 secs 2024-04-26T22:43:44.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15919.556967 secs 2024-04-26T22:43:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15919.556967 secs 2024-04-26T22:43:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15222.527582 secs 2024-04-26T22:43:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:45 smithi189 ceph-mon[32756]: pgmap v9025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15222.527582 secs 2024-04-26T22:43:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:45 smithi156 ceph-mon[32679]: pgmap v9025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15222.527582 secs 2024-04-26T22:43:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:45 smithi092 ceph-mon[29156]: pgmap v9025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:47 smithi189 ceph-mon[32756]: pgmap v9026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:47 smithi156 ceph-mon[32679]: pgmap v9026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:47 smithi092 ceph-mon[29156]: pgmap v9026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15924.557052 secs 2024-04-26T22:43:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15924.557052 secs 2024-04-26T22:43:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15924.557052 secs 2024-04-26T22:43:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15227.527722 secs 2024-04-26T22:43:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15227.527722 secs 2024-04-26T22:43:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15227.527722 secs 2024-04-26T22:43:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:50 smithi092 ceph-mon[29156]: pgmap v9027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:50 smithi189 ceph-mon[32756]: pgmap v9027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:50 smithi156 ceph-mon[32679]: pgmap v9027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:43:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: pgmap v9028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: pgmap v9029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: pgmap v9030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: pgmap v9028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: pgmap v9029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: pgmap v9030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:43:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: pgmap v9028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:43:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:43:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:43:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: pgmap v9029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:43:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: pgmap v9030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:43:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15929.557150 secs 2024-04-26T22:43:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15929.557150 secs 2024-04-26T22:43:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15929.557150 secs 2024-04-26T22:43:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15232.527836 secs 2024-04-26T22:43:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:54 smithi092 ceph-mon[29156]: pgmap v9031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15232.527836 secs 2024-04-26T22:43:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:54 smithi189 ceph-mon[32756]: pgmap v9031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15232.527836 secs 2024-04-26T22:43:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:54 smithi156 ceph-mon[32679]: pgmap v9031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:56 smithi189 ceph-mon[32756]: pgmap v9032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:56 smithi156 ceph-mon[32679]: pgmap v9032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:56 smithi092 ceph-mon[29156]: pgmap v9032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:43:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:58 smithi189 ceph-mon[32756]: pgmap v9033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:43:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15934.557276 secs 2024-04-26T22:43:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:58 smithi156 ceph-mon[32679]: pgmap v9033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:43:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15934.557276 secs 2024-04-26T22:43:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:58 smithi092 ceph-mon[29156]: pgmap v9033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:43:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15934.557276 secs 2024-04-26T22:44:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:43:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15237.527952 secs 2024-04-26T22:44:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:43:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15237.527952 secs 2024-04-26T22:44:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:43:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15237.527952 secs 2024-04-26T22:44:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:00 smithi189 ceph-mon[32756]: pgmap v9034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:00 smithi156 ceph-mon[32679]: pgmap v9034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:00 smithi092 ceph-mon[29156]: pgmap v9034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:02 smithi189 ceph-mon[32756]: pgmap v9035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:44:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:02 smithi156 ceph-mon[32679]: pgmap v9035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:44:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:02 smithi092 ceph-mon[29156]: pgmap v9035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:44:04.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15939.557413 secs 2024-04-26T22:44:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15939.557413 secs 2024-04-26T22:44:04.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15939.557413 secs 2024-04-26T22:44:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15242.528087 secs 2024-04-26T22:44:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:04 smithi189 ceph-mon[32756]: pgmap v9036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15242.528087 secs 2024-04-26T22:44:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:04 smithi156 ceph-mon[32679]: pgmap v9036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15242.528087 secs 2024-04-26T22:44:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:04 smithi092 ceph-mon[29156]: pgmap v9036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:06 smithi189 ceph-mon[32756]: pgmap v9037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:06 smithi156 ceph-mon[32679]: pgmap v9037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:06 smithi092 ceph-mon[29156]: pgmap v9037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:08 smithi189 ceph-mon[32756]: pgmap v9038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15944.557538 secs 2024-04-26T22:44:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:08 smithi156 ceph-mon[32679]: pgmap v9038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15944.557538 secs 2024-04-26T22:44:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:08 smithi092 ceph-mon[29156]: pgmap v9038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15944.557538 secs 2024-04-26T22:44:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15247.528209 secs 2024-04-26T22:44:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15247.528209 secs 2024-04-26T22:44:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15247.528209 secs 2024-04-26T22:44:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:10 smithi156 ceph-mon[32679]: pgmap v9039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:10 smithi092 ceph-mon[29156]: pgmap v9039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:10 smithi189 ceph-mon[32756]: pgmap v9039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:12 smithi156 ceph-mon[32679]: pgmap v9040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:12 smithi092 ceph-mon[29156]: pgmap v9040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:12 smithi189 ceph-mon[32756]: pgmap v9040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15949.557665 secs 2024-04-26T22:44:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:14 smithi189 ceph-mon[32756]: pgmap v9041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15949.557665 secs 2024-04-26T22:44:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:14 smithi156 ceph-mon[32679]: pgmap v9041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15949.557665 secs 2024-04-26T22:44:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:14 smithi092 ceph-mon[29156]: pgmap v9041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:15.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15252.528351 secs 2024-04-26T22:44:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15252.528351 secs 2024-04-26T22:44:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15252.528351 secs 2024-04-26T22:44:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:16 smithi189 ceph-mon[32756]: pgmap v9042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:16 smithi156 ceph-mon[32679]: pgmap v9042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:16 smithi092 ceph-mon[29156]: pgmap v9042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:18 smithi189 ceph-mon[32756]: pgmap v9043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15954.557790 secs 2024-04-26T22:44:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:18 smithi156 ceph-mon[32679]: pgmap v9043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15954.557790 secs 2024-04-26T22:44:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:18 smithi092 ceph-mon[29156]: pgmap v9043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15954.557790 secs 2024-04-26T22:44:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15257.528493 secs 2024-04-26T22:44:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15257.528493 secs 2024-04-26T22:44:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15257.528493 secs 2024-04-26T22:44:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:20 smithi189 ceph-mon[32756]: pgmap v9044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:20 smithi156 ceph-mon[32679]: pgmap v9044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:20 smithi092 ceph-mon[29156]: pgmap v9044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:22 smithi189 ceph-mon[32756]: pgmap v9045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:22 smithi156 ceph-mon[32679]: pgmap v9045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:22 smithi092 ceph-mon[29156]: pgmap v9045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15959.557909 secs 2024-04-26T22:44:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15959.557909 secs 2024-04-26T22:44:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15959.557909 secs 2024-04-26T22:44:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15262.528554 secs 2024-04-26T22:44:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:24 smithi189 ceph-mon[32756]: pgmap v9046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15262.528554 secs 2024-04-26T22:44:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:24 smithi156 ceph-mon[32679]: pgmap v9046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15262.528554 secs 2024-04-26T22:44:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:24 smithi092 ceph-mon[29156]: pgmap v9046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:26 smithi189 ceph-mon[32756]: pgmap v9047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:26 smithi156 ceph-mon[32679]: pgmap v9047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:26 smithi092 ceph-mon[29156]: pgmap v9047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:28 smithi189 ceph-mon[32756]: pgmap v9048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15964.558003 secs 2024-04-26T22:44:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:28 smithi156 ceph-mon[32679]: pgmap v9048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15964.558003 secs 2024-04-26T22:44:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:28 smithi092 ceph-mon[29156]: pgmap v9048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15964.558003 secs 2024-04-26T22:44:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15267.528632 secs 2024-04-26T22:44:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15267.528632 secs 2024-04-26T22:44:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15267.528632 secs 2024-04-26T22:44:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:30 smithi156 ceph-mon[32679]: pgmap v9049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:30 smithi092 ceph-mon[29156]: pgmap v9049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:30 smithi189 ceph-mon[32756]: pgmap v9049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:32 smithi156 ceph-mon[32679]: pgmap v9050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:32 smithi092 ceph-mon[29156]: pgmap v9050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:32 smithi189 ceph-mon[32756]: pgmap v9050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15969.558120 secs 2024-04-26T22:44:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15969.558120 secs 2024-04-26T22:44:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15969.558120 secs 2024-04-26T22:44:35.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15272.528738 secs 2024-04-26T22:44:35.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:34 smithi156 ceph-mon[32679]: pgmap v9051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15272.528738 secs 2024-04-26T22:44:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:34 smithi092 ceph-mon[29156]: pgmap v9051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15272.528738 secs 2024-04-26T22:44:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:34 smithi189 ceph-mon[32756]: pgmap v9051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:44:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:36 smithi156 ceph-mon[32679]: pgmap v9052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:36 smithi092 ceph-mon[29156]: pgmap v9052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:36 smithi189 ceph-mon[32756]: pgmap v9052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:38 smithi156 ceph-mon[32679]: pgmap v9053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15974.558235 secs 2024-04-26T22:44:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:38 smithi092 ceph-mon[29156]: pgmap v9053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15974.558235 secs 2024-04-26T22:44:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:38 smithi189 ceph-mon[32756]: pgmap v9053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15974.558235 secs 2024-04-26T22:44:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15277.528867 secs 2024-04-26T22:44:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15277.528867 secs 2024-04-26T22:44:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15277.528867 secs 2024-04-26T22:44:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:40 smithi156 ceph-mon[32679]: pgmap v9054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:40 smithi092 ceph-mon[29156]: pgmap v9054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:40 smithi189 ceph-mon[32756]: pgmap v9054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:42 smithi156 ceph-mon[32679]: pgmap v9055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:43.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:42 smithi092 ceph-mon[29156]: pgmap v9055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:42 smithi189 ceph-mon[32756]: pgmap v9055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15979.558357 secs 2024-04-26T22:44:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15979.558357 secs 2024-04-26T22:44:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15979.558357 secs 2024-04-26T22:44:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15282.528990 secs 2024-04-26T22:44:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:44 smithi156 ceph-mon[32679]: pgmap v9056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15282.528990 secs 2024-04-26T22:44:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:44 smithi092 ceph-mon[29156]: pgmap v9056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:45.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15282.528990 secs 2024-04-26T22:44:45.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:44 smithi189 ceph-mon[32756]: pgmap v9056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:46 smithi156 ceph-mon[32679]: pgmap v9057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:46 smithi092 ceph-mon[29156]: pgmap v9057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:46 smithi189 ceph-mon[32756]: pgmap v9057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:48 smithi092 ceph-mon[29156]: pgmap v9058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15984.558467 secs 2024-04-26T22:44:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:48 smithi189 ceph-mon[32756]: pgmap v9058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15984.558467 secs 2024-04-26T22:44:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:48 smithi156 ceph-mon[32679]: pgmap v9058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:44:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15984.558467 secs 2024-04-26T22:44:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15287.529108 secs 2024-04-26T22:44:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15287.529108 secs 2024-04-26T22:44:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15287.529108 secs 2024-04-26T22:44:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:50 smithi092 ceph-mon[29156]: pgmap v9059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:50 smithi189 ceph-mon[32756]: pgmap v9059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:51.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:50 smithi156 ceph-mon[32679]: pgmap v9059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:44:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:44:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:52 smithi092 ceph-mon[29156]: pgmap v9060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:44:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:52 smithi189 ceph-mon[32756]: pgmap v9060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:52 smithi156 ceph-mon[32679]: pgmap v9060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:44:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:44:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:53 smithi092 ceph-mon[29156]: pgmap v9061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:44:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:53 smithi092 ceph-mon[29156]: pgmap v9062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:44:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15989.558602 secs 2024-04-26T22:44:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:53 smithi189 ceph-mon[32756]: pgmap v9061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:44:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:53 smithi189 ceph-mon[32756]: pgmap v9062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:44:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15989.558602 secs 2024-04-26T22:44:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:53 smithi156 ceph-mon[32679]: pgmap v9061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:44:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:53 smithi156 ceph-mon[32679]: pgmap v9062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:44:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15989.558602 secs 2024-04-26T22:44:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15292.529261 secs 2024-04-26T22:44:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15292.529261 secs 2024-04-26T22:44:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15292.529261 secs 2024-04-26T22:44:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:55 smithi092 ceph-mon[29156]: pgmap v9063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:55 smithi189 ceph-mon[32756]: pgmap v9063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:55 smithi156 ceph-mon[32679]: pgmap v9063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:57 smithi092 ceph-mon[29156]: pgmap v9064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:57 smithi189 ceph-mon[32756]: pgmap v9064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:57 smithi156 ceph-mon[32679]: pgmap v9064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:44:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15994.558725 secs 2024-04-26T22:44:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15994.558725 secs 2024-04-26T22:44:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15994.558725 secs 2024-04-26T22:45:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:59 smithi092 ceph-mon[29156]: pgmap v9065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:44:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15297.529389 secs 2024-04-26T22:45:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:59 smithi189 ceph-mon[32756]: pgmap v9065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:44:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15297.529389 secs 2024-04-26T22:45:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:59 smithi156 ceph-mon[32679]: pgmap v9065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:44:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15297.529389 secs 2024-04-26T22:45:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:01 smithi092 ceph-mon[29156]: pgmap v9066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:01 smithi189 ceph-mon[32756]: pgmap v9066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:01 smithi156 ceph-mon[32679]: pgmap v9066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:45:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:03 smithi092 ceph-mon[29156]: pgmap v9067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:45:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 15999.558861 secs 2024-04-26T22:45:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:03 smithi189 ceph-mon[32756]: pgmap v9067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:45:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 15999.558861 secs 2024-04-26T22:45:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:03 smithi156 ceph-mon[32679]: pgmap v9067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:45:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 15999.558861 secs 2024-04-26T22:45:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15302.529562 secs 2024-04-26T22:45:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15302.529562 secs 2024-04-26T22:45:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15302.529562 secs 2024-04-26T22:45:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:05 smithi092 ceph-mon[29156]: pgmap v9068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:05 smithi189 ceph-mon[32756]: pgmap v9068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:05 smithi156 ceph-mon[32679]: pgmap v9068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:07 smithi092 ceph-mon[29156]: pgmap v9069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:07 smithi189 ceph-mon[32756]: pgmap v9069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:07 smithi156 ceph-mon[32679]: pgmap v9069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16004.558918 secs 2024-04-26T22:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:09 smithi189 ceph-mon[32756]: pgmap v9070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16004.558918 secs 2024-04-26T22:45:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:09 smithi156 ceph-mon[32679]: pgmap v9070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16004.558918 secs 2024-04-26T22:45:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:09 smithi092 ceph-mon[29156]: pgmap v9070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15307.529642 secs 2024-04-26T22:45:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15307.529642 secs 2024-04-26T22:45:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15307.529642 secs 2024-04-26T22:45:11.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:11 smithi156 ceph-mon[32679]: pgmap v9071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:11.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:11 smithi092 ceph-mon[29156]: pgmap v9071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:11 smithi189 ceph-mon[32756]: pgmap v9071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:13 smithi189 ceph-mon[32756]: pgmap v9072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:13 smithi156 ceph-mon[32679]: pgmap v9072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:13 smithi092 ceph-mon[29156]: pgmap v9072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:14.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16009.558980 secs 2024-04-26T22:45:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16009.558980 secs 2024-04-26T22:45:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16009.558980 secs 2024-04-26T22:45:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15312.529699 secs 2024-04-26T22:45:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:15 smithi156 ceph-mon[32679]: pgmap v9073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15312.529699 secs 2024-04-26T22:45:15.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:15 smithi092 ceph-mon[29156]: pgmap v9073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:16.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15312.529699 secs 2024-04-26T22:45:16.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:15 smithi189 ceph-mon[32756]: pgmap v9073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:17 smithi156 ceph-mon[32679]: pgmap v9074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:17 smithi092 ceph-mon[29156]: pgmap v9074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:17 smithi189 ceph-mon[32756]: pgmap v9074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16014.559047 secs 2024-04-26T22:45:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16014.559047 secs 2024-04-26T22:45:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16014.559047 secs 2024-04-26T22:45:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:19 smithi156 ceph-mon[32679]: pgmap v9075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:19 smithi092 ceph-mon[29156]: pgmap v9075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:19 smithi189 ceph-mon[32756]: pgmap v9075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15317.529762 secs 2024-04-26T22:45:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15317.529762 secs 2024-04-26T22:45:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15317.529762 secs 2024-04-26T22:45:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:21 smithi156 ceph-mon[32679]: pgmap v9076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:21 smithi092 ceph-mon[29156]: pgmap v9076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:21 smithi189 ceph-mon[32756]: pgmap v9076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:23 smithi156 ceph-mon[32679]: pgmap v9077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16019.559162 secs 2024-04-26T22:45:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:23 smithi092 ceph-mon[29156]: pgmap v9077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16019.559162 secs 2024-04-26T22:45:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:23 smithi189 ceph-mon[32756]: pgmap v9077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16019.559162 secs 2024-04-26T22:45:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15322.529830 secs 2024-04-26T22:45:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15322.529830 secs 2024-04-26T22:45:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15322.529830 secs 2024-04-26T22:45:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:25 smithi156 ceph-mon[32679]: pgmap v9078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:25 smithi092 ceph-mon[29156]: pgmap v9078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:25 smithi189 ceph-mon[32756]: pgmap v9078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:27 smithi156 ceph-mon[32679]: pgmap v9079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:27 smithi092 ceph-mon[29156]: pgmap v9079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:27 smithi189 ceph-mon[32756]: pgmap v9079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16024.559289 secs 2024-04-26T22:45:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15327.529903 secs 2024-04-26T22:45:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16024.559289 secs 2024-04-26T22:45:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15327.529903 secs 2024-04-26T22:45:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16024.559289 secs 2024-04-26T22:45:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15327.529903 secs 2024-04-26T22:45:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:29 smithi092 ceph-mon[29156]: pgmap v9080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:29 smithi189 ceph-mon[32756]: pgmap v9080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:29 smithi156 ceph-mon[32679]: pgmap v9080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:31.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:31 smithi092 ceph-mon[29156]: pgmap v9081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:31 smithi189 ceph-mon[32756]: pgmap v9081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:31 smithi156 ceph-mon[32679]: pgmap v9081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:33 smithi092 ceph-mon[29156]: pgmap v9082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16029.559427 secs 2024-04-26T22:45:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15332.530024 secs 2024-04-26T22:45:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:33 smithi189 ceph-mon[32756]: pgmap v9082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16029.559427 secs 2024-04-26T22:45:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15332.530024 secs 2024-04-26T22:45:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:33 smithi156 ceph-mon[32679]: pgmap v9082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16029.559427 secs 2024-04-26T22:45:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15332.530024 secs 2024-04-26T22:45:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:35 smithi092 ceph-mon[29156]: pgmap v9083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:35 smithi189 ceph-mon[32756]: pgmap v9083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:35 smithi156 ceph-mon[32679]: pgmap v9083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:37 smithi092 ceph-mon[29156]: pgmap v9084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:37 smithi189 ceph-mon[32756]: pgmap v9084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:45:38.181+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:45:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:45:38.181+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:45:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:45:38.181+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:45:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:45:38.181+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 126 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:45:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:37 smithi156 ceph-mon[32679]: pgmap v9084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16034.559564 secs 2024-04-26T22:45:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15337.530143 secs 2024-04-26T22:45:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16034.559564 secs 2024-04-26T22:45:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15337.530143 secs 2024-04-26T22:45:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16034.559564 secs 2024-04-26T22:45:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15337.530143 secs 2024-04-26T22:45:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:39 smithi092 ceph-mon[29156]: pgmap v9085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:39 smithi189 ceph-mon[32756]: pgmap v9085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:39 smithi156 ceph-mon[32679]: pgmap v9085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:41.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:41 smithi156 ceph-mon[32679]: pgmap v9086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:41 smithi092 ceph-mon[29156]: pgmap v9086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:41 smithi189 ceph-mon[32756]: pgmap v9086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:43 smithi092 ceph-mon[29156]: pgmap v9087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16039.559642 secs 2024-04-26T22:45:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15342.530291 secs 2024-04-26T22:45:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:43 smithi189 ceph-mon[32756]: pgmap v9087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16039.559642 secs 2024-04-26T22:45:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15342.530291 secs 2024-04-26T22:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:43 smithi156 ceph-mon[32679]: pgmap v9087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16039.559642 secs 2024-04-26T22:45:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15342.530291 secs 2024-04-26T22:45:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:45 smithi092 ceph-mon[29156]: pgmap v9088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:45 smithi189 ceph-mon[32756]: pgmap v9088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:45 smithi156 ceph-mon[32679]: pgmap v9088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:47 smithi092 ceph-mon[29156]: pgmap v9089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:47 smithi189 ceph-mon[32756]: pgmap v9089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:47 smithi156 ceph-mon[32679]: pgmap v9089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16044.559782 secs 2024-04-26T22:45:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15347.530430 secs 2024-04-26T22:45:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16044.559782 secs 2024-04-26T22:45:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15347.530430 secs 2024-04-26T22:45:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16044.559782 secs 2024-04-26T22:45:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15347.530430 secs 2024-04-26T22:45:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:49 smithi092 ceph-mon[29156]: pgmap v9090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:49 smithi189 ceph-mon[32756]: pgmap v9090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:49 smithi156 ceph-mon[32679]: pgmap v9090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:51 smithi092 ceph-mon[29156]: pgmap v9091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:51 smithi189 ceph-mon[32756]: pgmap v9091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:51 smithi156 ceph-mon[32679]: pgmap v9091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:45:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: pgmap v9092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16049.559891 secs 2024-04-26T22:45:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15352.530496 secs 2024-04-26T22:45:53.999 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: pgmap v9092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:53.999 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:53.999 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16049.559891 secs 2024-04-26T22:45:54.000 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15352.530496 secs 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: pgmap v9092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16049.559891 secs 2024-04-26T22:45:54.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15352.530496 secs 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: pgmap v9093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: pgmap v9093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: pgmap v9093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:45:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:45:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:45:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:57 smithi189 ceph-mon[32756]: pgmap v9094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:57 smithi189 ceph-mon[32756]: pgmap v9095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:45:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:45:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:57 smithi156 ceph-mon[32679]: pgmap v9094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:57 smithi156 ceph-mon[32679]: pgmap v9095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:45:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:45:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:45:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:57 smithi092 ceph-mon[29156]: pgmap v9094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:45:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:57 smithi092 ceph-mon[29156]: pgmap v9095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:59 smithi189 ceph-mon[32756]: pgmap v9096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16054.559973 secs 2024-04-26T22:45:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:45:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15357.530608 secs 2024-04-26T22:45:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:59 smithi156 ceph-mon[32679]: pgmap v9096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16054.559973 secs 2024-04-26T22:45:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:45:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15357.530608 secs 2024-04-26T22:45:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:59 smithi092 ceph-mon[29156]: pgmap v9096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:45:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16054.559973 secs 2024-04-26T22:45:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:45:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15357.530608 secs 2024-04-26T22:46:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:01 smithi189 ceph-mon[32756]: pgmap v9097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:01 smithi156 ceph-mon[32679]: pgmap v9097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:01 smithi092 ceph-mon[29156]: pgmap v9097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:03 smithi189 ceph-mon[32756]: pgmap v9098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:03 smithi156 ceph-mon[32679]: pgmap v9098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:03 smithi092 ceph-mon[29156]: pgmap v9098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16059.560097 secs 2024-04-26T22:46:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15362.530724 secs 2024-04-26T22:46:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16059.560097 secs 2024-04-26T22:46:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15362.530724 secs 2024-04-26T22:46:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16059.560097 secs 2024-04-26T22:46:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15362.530724 secs 2024-04-26T22:46:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:05 smithi189 ceph-mon[32756]: pgmap v9099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:05 smithi156 ceph-mon[32679]: pgmap v9099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:05 smithi092 ceph-mon[29156]: pgmap v9099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:46:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:07 smithi189 ceph-mon[32756]: pgmap v9100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:46:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:07 smithi156 ceph-mon[32679]: pgmap v9100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:46:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:07 smithi092 ceph-mon[29156]: pgmap v9100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:46:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:09 smithi189 ceph-mon[32756]: pgmap v9101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16064.560220 secs 2024-04-26T22:46:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15367.530866 secs 2024-04-26T22:46:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:09 smithi156 ceph-mon[32679]: pgmap v9101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16064.560220 secs 2024-04-26T22:46:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15367.530866 secs 2024-04-26T22:46:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:09 smithi092 ceph-mon[29156]: pgmap v9101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16064.560220 secs 2024-04-26T22:46:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15367.530866 secs 2024-04-26T22:46:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:11 smithi189 ceph-mon[32756]: pgmap v9102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:11 smithi156 ceph-mon[32679]: pgmap v9102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:11 smithi092 ceph-mon[29156]: pgmap v9102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:13.564 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:13 smithi092 ceph-mon[29156]: pgmap v9103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:13 smithi189 ceph-mon[32756]: pgmap v9103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:13 smithi156 ceph-mon[32679]: pgmap v9103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16069.560344 secs 2024-04-26T22:46:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15372.531020 secs 2024-04-26T22:46:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16069.560344 secs 2024-04-26T22:46:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15372.531020 secs 2024-04-26T22:46:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16069.560344 secs 2024-04-26T22:46:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15372.531020 secs 2024-04-26T22:46:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:15 smithi189 ceph-mon[32756]: pgmap v9104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:15.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:15 smithi092 ceph-mon[29156]: pgmap v9104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:15 smithi156 ceph-mon[32679]: pgmap v9104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:17 smithi189 ceph-mon[32756]: pgmap v9105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:17 smithi156 ceph-mon[32679]: pgmap v9105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:17 smithi092 ceph-mon[29156]: pgmap v9105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:19 smithi189 ceph-mon[32756]: pgmap v9106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16074.560465 secs 2024-04-26T22:46:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15377.531141 secs 2024-04-26T22:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:19 smithi156 ceph-mon[32679]: pgmap v9106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16074.560465 secs 2024-04-26T22:46:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15377.531141 secs 2024-04-26T22:46:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:19 smithi092 ceph-mon[29156]: pgmap v9106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16074.560465 secs 2024-04-26T22:46:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15377.531141 secs 2024-04-26T22:46:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:21 smithi189 ceph-mon[32756]: pgmap v9107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:21 smithi156 ceph-mon[32679]: pgmap v9107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:21 smithi092 ceph-mon[29156]: pgmap v9107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:23 smithi189 ceph-mon[32756]: pgmap v9108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:23 smithi156 ceph-mon[32679]: pgmap v9108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:23 smithi092 ceph-mon[29156]: pgmap v9108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16079.560602 secs 2024-04-26T22:46:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15382.531277 secs 2024-04-26T22:46:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16079.560602 secs 2024-04-26T22:46:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15382.531277 secs 2024-04-26T22:46:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16079.560602 secs 2024-04-26T22:46:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15382.531277 secs 2024-04-26T22:46:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:25 smithi189 ceph-mon[32756]: pgmap v9109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:25 smithi156 ceph-mon[32679]: pgmap v9109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:25 smithi092 ceph-mon[29156]: pgmap v9109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:27 smithi189 ceph-mon[32756]: pgmap v9110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:27 smithi156 ceph-mon[32679]: pgmap v9110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:27 smithi092 ceph-mon[29156]: pgmap v9110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:29 smithi189 ceph-mon[32756]: pgmap v9111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16084.560724 secs 2024-04-26T22:46:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15387.531396 secs 2024-04-26T22:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:29 smithi156 ceph-mon[32679]: pgmap v9111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16084.560724 secs 2024-04-26T22:46:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15387.531396 secs 2024-04-26T22:46:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:29 smithi092 ceph-mon[29156]: pgmap v9111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16084.560724 secs 2024-04-26T22:46:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15387.531396 secs 2024-04-26T22:46:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:31 smithi189 ceph-mon[32756]: pgmap v9112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:31 smithi156 ceph-mon[32679]: pgmap v9112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:31 smithi092 ceph-mon[29156]: pgmap v9112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:33 smithi189 ceph-mon[32756]: pgmap v9113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:33 smithi156 ceph-mon[32679]: pgmap v9113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:33 smithi092 ceph-mon[29156]: pgmap v9113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16089.560854 secs 2024-04-26T22:46:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15392.531537 secs 2024-04-26T22:46:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16089.560854 secs 2024-04-26T22:46:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15392.531537 secs 2024-04-26T22:46:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16089.560854 secs 2024-04-26T22:46:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15392.531537 secs 2024-04-26T22:46:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:35 smithi189 ceph-mon[32756]: pgmap v9114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:35 smithi156 ceph-mon[32679]: pgmap v9114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:35 smithi092 ceph-mon[29156]: pgmap v9114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:37 smithi189 ceph-mon[32756]: pgmap v9115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:37 smithi156 ceph-mon[32679]: pgmap v9115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:37 smithi092 ceph-mon[29156]: pgmap v9115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:39 smithi189 ceph-mon[32756]: pgmap v9116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16094.560947 secs 2024-04-26T22:46:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15397.531617 secs 2024-04-26T22:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:39 smithi156 ceph-mon[32679]: pgmap v9116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16094.560947 secs 2024-04-26T22:46:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15397.531617 secs 2024-04-26T22:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:39 smithi092 ceph-mon[29156]: pgmap v9116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16094.560947 secs 2024-04-26T22:46:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15397.531617 secs 2024-04-26T22:46:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:41 smithi189 ceph-mon[32756]: pgmap v9117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:41 smithi156 ceph-mon[32679]: pgmap v9117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:41 smithi092 ceph-mon[29156]: pgmap v9117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:43 smithi189 ceph-mon[32756]: pgmap v9118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:43 smithi156 ceph-mon[32679]: pgmap v9118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:43 smithi092 ceph-mon[29156]: pgmap v9118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16099.561060 secs 2024-04-26T22:46:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15402.531742 secs 2024-04-26T22:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16099.561060 secs 2024-04-26T22:46:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15402.531742 secs 2024-04-26T22:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16099.561060 secs 2024-04-26T22:46:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15402.531742 secs 2024-04-26T22:46:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:45 smithi189 ceph-mon[32756]: pgmap v9119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:45 smithi156 ceph-mon[32679]: pgmap v9119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:45 smithi092 ceph-mon[29156]: pgmap v9119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:47 smithi189 ceph-mon[32756]: pgmap v9120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:47 smithi156 ceph-mon[32679]: pgmap v9120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:47 smithi092 ceph-mon[29156]: pgmap v9120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:49 smithi189 ceph-mon[32756]: pgmap v9121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16104.561197 secs 2024-04-26T22:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15407.531883 secs 2024-04-26T22:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:49 smithi156 ceph-mon[32679]: pgmap v9121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16104.561197 secs 2024-04-26T22:46:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15407.531883 secs 2024-04-26T22:46:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:49 smithi092 ceph-mon[29156]: pgmap v9121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16104.561197 secs 2024-04-26T22:46:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15407.531883 secs 2024-04-26T22:46:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:51 smithi189 ceph-mon[32756]: pgmap v9122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:51 smithi156 ceph-mon[32679]: pgmap v9122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:51 smithi092 ceph-mon[29156]: pgmap v9122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:53 smithi189 ceph-mon[32756]: pgmap v9123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:53 smithi156 ceph-mon[32679]: pgmap v9123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:53 smithi092 ceph-mon[29156]: pgmap v9123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16109.561281 secs 2024-04-26T22:46:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15412.532004 secs 2024-04-26T22:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16109.561281 secs 2024-04-26T22:46:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15412.532004 secs 2024-04-26T22:46:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16109.561281 secs 2024-04-26T22:46:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15412.532004 secs 2024-04-26T22:46:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:55 smithi156 ceph-mon[32679]: pgmap v9124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:55 smithi092 ceph-mon[29156]: pgmap v9124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:55 smithi189 ceph-mon[32756]: pgmap v9124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:46:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:46:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: pgmap v9125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: pgmap v9126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:46:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: pgmap v9127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:46:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: pgmap v9125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: pgmap v9126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: pgmap v9127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:46:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:46:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: pgmap v9125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: pgmap v9126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: pgmap v9127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:46:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:46:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16114.561419 secs 2024-04-26T22:46:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15417.532065 secs 2024-04-26T22:46:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16114.561419 secs 2024-04-26T22:46:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15417.532065 secs 2024-04-26T22:46:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16114.561419 secs 2024-04-26T22:46:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15417.532065 secs 2024-04-26T22:46:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:46:59 smithi092 ceph-mon[29156]: pgmap v9128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:46:59 smithi189 ceph-mon[32756]: pgmap v9128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:46:59 smithi156 ceph-mon[32679]: pgmap v9128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:02 smithi189 ceph-mon[32756]: pgmap v9129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:02 smithi156 ceph-mon[32679]: pgmap v9129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:02 smithi092 ceph-mon[29156]: pgmap v9129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:04 smithi189 ceph-mon[32756]: pgmap v9130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16119.561510 secs 2024-04-26T22:47:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15422.532176 secs 2024-04-26T22:47:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:04 smithi156 ceph-mon[32679]: pgmap v9130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16119.561510 secs 2024-04-26T22:47:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15422.532176 secs 2024-04-26T22:47:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:04 smithi092 ceph-mon[29156]: pgmap v9130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16119.561510 secs 2024-04-26T22:47:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15422.532176 secs 2024-04-26T22:47:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:06 smithi189 ceph-mon[32756]: pgmap v9131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:06 smithi156 ceph-mon[32679]: pgmap v9131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:06 smithi092 ceph-mon[29156]: pgmap v9131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:47:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:08 smithi189 ceph-mon[32756]: pgmap v9132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:47:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:08 smithi156 ceph-mon[32679]: pgmap v9132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:47:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:08 smithi092 ceph-mon[29156]: pgmap v9132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:47:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16124.561587 secs 2024-04-26T22:47:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15427.532306 secs 2024-04-26T22:47:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:09 smithi189 ceph-mon[32756]: pgmap v9133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16124.561587 secs 2024-04-26T22:47:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15427.532306 secs 2024-04-26T22:47:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:09 smithi156 ceph-mon[32679]: pgmap v9133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16124.561587 secs 2024-04-26T22:47:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15427.532306 secs 2024-04-26T22:47:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:09 smithi092 ceph-mon[29156]: pgmap v9133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:12 smithi189 ceph-mon[32756]: pgmap v9134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:12 smithi156 ceph-mon[32679]: pgmap v9134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:12 smithi092 ceph-mon[29156]: pgmap v9134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:14 smithi189 ceph-mon[32756]: pgmap v9135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16129.561705 secs 2024-04-26T22:47:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15432.532463 secs 2024-04-26T22:47:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:14 smithi156 ceph-mon[32679]: pgmap v9135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16129.561705 secs 2024-04-26T22:47:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15432.532463 secs 2024-04-26T22:47:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:14 smithi092 ceph-mon[29156]: pgmap v9135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16129.561705 secs 2024-04-26T22:47:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15432.532463 secs 2024-04-26T22:47:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:16 smithi189 ceph-mon[32756]: pgmap v9136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:16 smithi156 ceph-mon[32679]: pgmap v9136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:16 smithi092 ceph-mon[29156]: pgmap v9136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:18 smithi189 ceph-mon[32756]: pgmap v9137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:18 smithi156 ceph-mon[32679]: pgmap v9137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:18 smithi092 ceph-mon[29156]: pgmap v9137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T22:47:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16134.561842 secs 2024-04-26T22:47:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15437.532524 secs 2024-04-26T22:47:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16134.561842 secs 2024-04-26T22:47:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15437.532524 secs 2024-04-26T22:47:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16134.561842 secs 2024-04-26T22:47:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15437.532524 secs 2024-04-26T22:47:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:20 smithi189 ceph-mon[32756]: pgmap v9138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:20 smithi156 ceph-mon[32679]: pgmap v9138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:20 smithi092 ceph-mon[29156]: pgmap v9138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T22:47:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:21 smithi189 ceph-mon[32756]: pgmap v9139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:21 smithi156 ceph-mon[32679]: pgmap v9139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:21 smithi092 ceph-mon[29156]: pgmap v9139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:24 smithi189 ceph-mon[32756]: pgmap v9140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16139.561944 secs 2024-04-26T22:47:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15442.532644 secs 2024-04-26T22:47:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:24 smithi156 ceph-mon[32679]: pgmap v9140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16139.561944 secs 2024-04-26T22:47:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15442.532644 secs 2024-04-26T22:47:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:24 smithi092 ceph-mon[29156]: pgmap v9140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16139.561944 secs 2024-04-26T22:47:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15442.532644 secs 2024-04-26T22:47:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:26 smithi189 ceph-mon[32756]: pgmap v9141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:26 smithi156 ceph-mon[32679]: pgmap v9141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:26 smithi092 ceph-mon[29156]: pgmap v9141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:28 smithi189 ceph-mon[32756]: pgmap v9142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:28 smithi156 ceph-mon[32679]: pgmap v9142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:28 smithi092 ceph-mon[29156]: pgmap v9142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16144.562023 secs 2024-04-26T22:47:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15447.532748 secs 2024-04-26T22:47:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16144.562023 secs 2024-04-26T22:47:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15447.532748 secs 2024-04-26T22:47:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16144.562023 secs 2024-04-26T22:47:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15447.532748 secs 2024-04-26T22:47:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:30 smithi189 ceph-mon[32756]: pgmap v9143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:30 smithi156 ceph-mon[32679]: pgmap v9143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:30 smithi092 ceph-mon[29156]: pgmap v9143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:32 smithi189 ceph-mon[32756]: pgmap v9144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:32 smithi156 ceph-mon[32679]: pgmap v9144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:32 smithi092 ceph-mon[29156]: pgmap v9144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:33 smithi189 ceph-mon[32756]: pgmap v9145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:33 smithi156 ceph-mon[32679]: pgmap v9145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:33 smithi092 ceph-mon[29156]: pgmap v9145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16149.562136 secs 2024-04-26T22:47:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15452.532863 secs 2024-04-26T22:47:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16149.562136 secs 2024-04-26T22:47:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15452.532863 secs 2024-04-26T22:47:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16149.562136 secs 2024-04-26T22:47:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15452.532863 secs 2024-04-26T22:47:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:35 smithi189 ceph-mon[32756]: pgmap v9146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:35 smithi156 ceph-mon[32679]: pgmap v9146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-mon[29156]: pgmap v9146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:47:35.045+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:47:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:47:35.045+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:47:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:47:35.045+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:47:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:47:35.045+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:47:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:47:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:47:35.045+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:47:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:38 smithi189 ceph-mon[32756]: pgmap v9147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:38 smithi156 ceph-mon[32679]: pgmap v9147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:38 smithi092 ceph-mon[29156]: pgmap v9147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16154.562259 secs 2024-04-26T22:47:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15457.533008 secs 2024-04-26T22:47:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16154.562259 secs 2024-04-26T22:47:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15457.533008 secs 2024-04-26T22:47:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16154.562259 secs 2024-04-26T22:47:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15457.533008 secs 2024-04-26T22:47:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:40 smithi189 ceph-mon[32756]: pgmap v9148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:40 smithi156 ceph-mon[32679]: pgmap v9148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:40 smithi092 ceph-mon[29156]: pgmap v9148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:42 smithi189 ceph-mon[32756]: pgmap v9149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:42 smithi156 ceph-mon[32679]: pgmap v9149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:42 smithi092 ceph-mon[29156]: pgmap v9149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:43 smithi189 ceph-mon[32756]: pgmap v9150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:43 smithi156 ceph-mon[32679]: pgmap v9150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:43 smithi092 ceph-mon[29156]: pgmap v9150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16159.562395 secs 2024-04-26T22:47:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15462.533115 secs 2024-04-26T22:47:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16159.562395 secs 2024-04-26T22:47:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15462.533115 secs 2024-04-26T22:47:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16159.562395 secs 2024-04-26T22:47:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15462.533115 secs 2024-04-26T22:47:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:45 smithi189 ceph-mon[32756]: pgmap v9151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:45 smithi156 ceph-mon[32679]: pgmap v9151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:45 smithi092 ceph-mon[29156]: pgmap v9151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:48 smithi189 ceph-mon[32756]: pgmap v9152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:48.424 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:48 smithi092 ceph-mon[29156]: pgmap v9152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:48 smithi156 ceph-mon[32679]: pgmap v9152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:47:49.357 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16164.562533 secs 2024-04-26T22:47:49.357 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15467.533203 secs 2024-04-26T22:47:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16164.562533 secs 2024-04-26T22:47:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15467.533203 secs 2024-04-26T22:47:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16164.562533 secs 2024-04-26T22:47:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15467.533203 secs 2024-04-26T22:47:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:50 smithi189 ceph-mon[32756]: pgmap v9153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:50 smithi156 ceph-mon[32679]: pgmap v9153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:50 smithi092 ceph-mon[29156]: pgmap v9153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:47:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:52 smithi189 ceph-mon[32756]: pgmap v9154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:52 smithi156 ceph-mon[32679]: pgmap v9154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:52 smithi092 ceph-mon[29156]: pgmap v9154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:53 smithi189 ceph-mon[32756]: pgmap v9155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:53 smithi156 ceph-mon[32679]: pgmap v9155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:53 smithi092 ceph-mon[29156]: pgmap v9155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16169.562668 secs 2024-04-26T22:47:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15472.533322 secs 2024-04-26T22:47:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16169.562668 secs 2024-04-26T22:47:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15472.533322 secs 2024-04-26T22:47:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16169.562668 secs 2024-04-26T22:47:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15472.533322 secs 2024-04-26T22:47:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:55 smithi189 ceph-mon[32756]: pgmap v9156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:55 smithi156 ceph-mon[32679]: pgmap v9156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:55 smithi092 ceph-mon[29156]: pgmap v9156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:47:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:58 smithi189 ceph-mon[32756]: pgmap v9157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:47:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:58 smithi156 ceph-mon[32679]: pgmap v9157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:47:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:58 smithi092 ceph-mon[29156]: pgmap v9157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:47:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:47:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:47:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:47:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:47:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:59 smithi092 ceph-mon[29156]: pgmap v9158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:59 smithi092 ceph-mon[29156]: pgmap v9159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16174.562786 secs 2024-04-26T22:47:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:47:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15477.533440 secs 2024-04-26T22:47:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:59 smithi189 ceph-mon[32756]: pgmap v9158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:47:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:59 smithi189 ceph-mon[32756]: pgmap v9159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16174.562786 secs 2024-04-26T22:47:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:47:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15477.533440 secs 2024-04-26T22:47:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:59 smithi156 ceph-mon[32679]: pgmap v9158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:47:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:59 smithi156 ceph-mon[32679]: pgmap v9159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:47:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16174.562786 secs 2024-04-26T22:47:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:47:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15477.533440 secs 2024-04-26T22:48:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:01 smithi189 ceph-mon[32756]: pgmap v9160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:01 smithi156 ceph-mon[32679]: pgmap v9160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:01 smithi092 ceph-mon[29156]: pgmap v9160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:02 smithi189 ceph-mon[32756]: pgmap v9161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:02 smithi156 ceph-mon[32679]: pgmap v9161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:02 smithi092 ceph-mon[29156]: pgmap v9161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16179.562920 secs 2024-04-26T22:48:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15482.533583 secs 2024-04-26T22:48:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16179.562920 secs 2024-04-26T22:48:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15482.533583 secs 2024-04-26T22:48:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16179.562920 secs 2024-04-26T22:48:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15482.533583 secs 2024-04-26T22:48:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:04 smithi092 ceph-mon[29156]: pgmap v9162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:04 smithi189 ceph-mon[32756]: pgmap v9162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:04 smithi156 ceph-mon[32679]: pgmap v9162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:06 smithi189 ceph-mon[32756]: pgmap v9163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:06 smithi156 ceph-mon[32679]: pgmap v9163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:06 smithi092 ceph-mon[29156]: pgmap v9163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:48:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:08 smithi189 ceph-mon[32756]: pgmap v9164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:48:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16184.563046 secs 2024-04-26T22:48:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15487.533703 secs 2024-04-26T22:48:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:08 smithi156 ceph-mon[32679]: pgmap v9164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:48:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16184.563046 secs 2024-04-26T22:48:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15487.533703 secs 2024-04-26T22:48:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:08 smithi092 ceph-mon[29156]: pgmap v9164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:48:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16184.563046 secs 2024-04-26T22:48:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15487.533703 secs 2024-04-26T22:48:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:10 smithi189 ceph-mon[32756]: pgmap v9165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:10 smithi156 ceph-mon[32679]: pgmap v9165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:10 smithi092 ceph-mon[29156]: pgmap v9165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:12 smithi189 ceph-mon[32756]: pgmap v9166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:12 smithi156 ceph-mon[32679]: pgmap v9166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:12 smithi092 ceph-mon[29156]: pgmap v9166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16189.563155 secs 2024-04-26T22:48:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15492.533823 secs 2024-04-26T22:48:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:14 smithi189 ceph-mon[32756]: pgmap v9167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16189.563155 secs 2024-04-26T22:48:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15492.533823 secs 2024-04-26T22:48:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:14 smithi156 ceph-mon[32679]: pgmap v9167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16189.563155 secs 2024-04-26T22:48:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15492.533823 secs 2024-04-26T22:48:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:14 smithi092 ceph-mon[29156]: pgmap v9167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:16 smithi189 ceph-mon[32756]: pgmap v9168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:16 smithi156 ceph-mon[32679]: pgmap v9168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:16 smithi092 ceph-mon[29156]: pgmap v9168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:18 smithi189 ceph-mon[32756]: pgmap v9169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16194.563292 secs 2024-04-26T22:48:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15497.533938 secs 2024-04-26T22:48:19.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:18 smithi092 ceph-mon[29156]: pgmap v9169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:19.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16194.563292 secs 2024-04-26T22:48:19.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15497.533938 secs 2024-04-26T22:48:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:18 smithi156 ceph-mon[32679]: pgmap v9169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16194.563292 secs 2024-04-26T22:48:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15497.533938 secs 2024-04-26T22:48:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:20 smithi189 ceph-mon[32756]: pgmap v9170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:20 smithi156 ceph-mon[32679]: pgmap v9170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:20 smithi092 ceph-mon[29156]: pgmap v9170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:22 smithi189 ceph-mon[32756]: pgmap v9171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:22 smithi156 ceph-mon[32679]: pgmap v9171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:22 smithi092 ceph-mon[29156]: pgmap v9171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16199.563414 secs 2024-04-26T22:48:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15502.534065 secs 2024-04-26T22:48:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16199.563414 secs 2024-04-26T22:48:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15502.534065 secs 2024-04-26T22:48:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16199.563414 secs 2024-04-26T22:48:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15502.534065 secs 2024-04-26T22:48:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:24 smithi189 ceph-mon[32756]: pgmap v9172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:24 smithi156 ceph-mon[32679]: pgmap v9172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:24 smithi092 ceph-mon[29156]: pgmap v9172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:26 smithi189 ceph-mon[32756]: pgmap v9173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:26 smithi156 ceph-mon[32679]: pgmap v9173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:26 smithi092 ceph-mon[29156]: pgmap v9173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:28 smithi189 ceph-mon[32756]: pgmap v9174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16204.563552 secs 2024-04-26T22:48:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15507.534203 secs 2024-04-26T22:48:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:28 smithi156 ceph-mon[32679]: pgmap v9174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16204.563552 secs 2024-04-26T22:48:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15507.534203 secs 2024-04-26T22:48:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:28 smithi092 ceph-mon[29156]: pgmap v9174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16204.563552 secs 2024-04-26T22:48:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15507.534203 secs 2024-04-26T22:48:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:30 smithi189 ceph-mon[32756]: pgmap v9175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:30 smithi156 ceph-mon[32679]: pgmap v9175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:30 smithi092 ceph-mon[29156]: pgmap v9175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:32 smithi189 ceph-mon[32756]: pgmap v9176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:32 smithi156 ceph-mon[32679]: pgmap v9176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:32 smithi092 ceph-mon[29156]: pgmap v9176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16209.563675 secs 2024-04-26T22:48:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15512.534319 secs 2024-04-26T22:48:34.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16209.563675 secs 2024-04-26T22:48:34.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15512.534319 secs 2024-04-26T22:48:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16209.563675 secs 2024-04-26T22:48:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15512.534319 secs 2024-04-26T22:48:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:34 smithi189 ceph-mon[32756]: pgmap v9177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:34 smithi156 ceph-mon[32679]: pgmap v9177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:34 smithi092 ceph-mon[29156]: pgmap v9177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T22:48:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T22:48:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0050 comp rx=0 tx=0).stop 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:48:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca809e000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:48:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.042+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T22:48:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.042+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T22:48:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.042+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T22:48:36.042 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.042+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=16 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T22:48:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.042+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:48:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.043+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T22:48:36.043 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:36.043+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T22:48:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:36 smithi189 ceph-mon[32756]: pgmap v9178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:36 smithi156 ceph-mon[32679]: pgmap v9178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:36 smithi092 ceph-mon[29156]: pgmap v9178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:38.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:38.205+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:48:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:38.205+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:48:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:38.206+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:48:38.207 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:48:38.206+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 127 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:48:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:38 smithi189 ceph-mon[32756]: pgmap v9179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16214.563774 secs 2024-04-26T22:48:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15517.534429 secs 2024-04-26T22:48:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:38 smithi156 ceph-mon[32679]: pgmap v9179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16214.563774 secs 2024-04-26T22:48:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15517.534429 secs 2024-04-26T22:48:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:38 smithi092 ceph-mon[29156]: pgmap v9179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16214.563774 secs 2024-04-26T22:48:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15517.534429 secs 2024-04-26T22:48:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:40 smithi189 ceph-mon[32756]: pgmap v9180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:40 smithi156 ceph-mon[32679]: pgmap v9180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:40 smithi092 ceph-mon[29156]: pgmap v9180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:42 smithi189 ceph-mon[32756]: pgmap v9181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:42 smithi156 ceph-mon[32679]: pgmap v9181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:43.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:42 smithi092 ceph-mon[29156]: pgmap v9181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16219.563918 secs 2024-04-26T22:48:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15522.534498 secs 2024-04-26T22:48:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16219.563918 secs 2024-04-26T22:48:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15522.534498 secs 2024-04-26T22:48:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16219.563918 secs 2024-04-26T22:48:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15522.534498 secs 2024-04-26T22:48:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:44 smithi156 ceph-mon[32679]: pgmap v9182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:44 smithi092 ceph-mon[29156]: pgmap v9182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:44 smithi189 ceph-mon[32756]: pgmap v9182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:46 smithi156 ceph-mon[32679]: pgmap v9183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:46 smithi092 ceph-mon[29156]: pgmap v9183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:46 smithi189 ceph-mon[32756]: pgmap v9183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:48 smithi156 ceph-mon[32679]: pgmap v9184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16224.564039 secs 2024-04-26T22:48:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15527.534620 secs 2024-04-26T22:48:49.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:48 smithi189 ceph-mon[32756]: pgmap v9184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:49.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16224.564039 secs 2024-04-26T22:48:49.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15527.534620 secs 2024-04-26T22:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:48 smithi092 ceph-mon[29156]: pgmap v9184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16224.564039 secs 2024-04-26T22:48:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15527.534620 secs 2024-04-26T22:48:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:50 smithi156 ceph-mon[32679]: pgmap v9185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:50 smithi092 ceph-mon[29156]: pgmap v9185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:50 smithi189 ceph-mon[32756]: pgmap v9185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:52 smithi156 ceph-mon[32679]: pgmap v9186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:52 smithi092 ceph-mon[29156]: pgmap v9186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:52 smithi189 ceph-mon[32756]: pgmap v9186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16229.564140 secs 2024-04-26T22:48:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15532.534763 secs 2024-04-26T22:48:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16229.564140 secs 2024-04-26T22:48:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15532.534763 secs 2024-04-26T22:48:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16229.564140 secs 2024-04-26T22:48:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15532.534763 secs 2024-04-26T22:48:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:54 smithi156 ceph-mon[32679]: pgmap v9187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:54 smithi092 ceph-mon[29156]: pgmap v9187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:54 smithi189 ceph-mon[32756]: pgmap v9187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:48:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:56 smithi156 ceph-mon[32679]: pgmap v9188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:56 smithi092 ceph-mon[29156]: pgmap v9188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:56 smithi189 ceph-mon[32756]: pgmap v9188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: pgmap v9189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16234.564243 secs 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:48:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15537.534876 secs 2024-04-26T22:48:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: pgmap v9189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16234.564243 secs 2024-04-26T22:48:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:48:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15537.534876 secs 2024-04-26T22:48:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: pgmap v9189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:48:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16234.564243 secs 2024-04-26T22:48:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:48:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:48:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:48:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15537.534876 secs 2024-04-26T22:49:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:59 smithi156 ceph-mon[32679]: pgmap v9190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:49:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:48:59 smithi156 ceph-mon[32679]: pgmap v9191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:59 smithi092 ceph-mon[29156]: pgmap v9190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:49:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:48:59 smithi092 ceph-mon[29156]: pgmap v9191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:59 smithi189 ceph-mon[32756]: pgmap v9190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:49:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:48:59 smithi189 ceph-mon[32756]: pgmap v9191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:01 smithi156 ceph-mon[32679]: pgmap v9192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:01 smithi092 ceph-mon[29156]: pgmap v9192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:01 smithi189 ceph-mon[32756]: pgmap v9192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:03 smithi092 ceph-mon[29156]: pgmap v9193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:49:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16239.564370 secs 2024-04-26T22:49:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15542.534954 secs 2024-04-26T22:49:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:03 smithi189 ceph-mon[32756]: pgmap v9193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:49:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16239.564370 secs 2024-04-26T22:49:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15542.534954 secs 2024-04-26T22:49:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:03 smithi156 ceph-mon[32679]: pgmap v9193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:49:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16239.564370 secs 2024-04-26T22:49:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15542.534954 secs 2024-04-26T22:49:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:05 smithi092 ceph-mon[29156]: pgmap v9194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:05 smithi189 ceph-mon[32756]: pgmap v9194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:05 smithi156 ceph-mon[32679]: pgmap v9194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:07 smithi092 ceph-mon[29156]: pgmap v9195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:07 smithi189 ceph-mon[32756]: pgmap v9195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:07 smithi156 ceph-mon[32679]: pgmap v9195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:49:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16244.564499 secs 2024-04-26T22:49:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15547.535094 secs 2024-04-26T22:49:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16244.564499 secs 2024-04-26T22:49:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15547.535094 secs 2024-04-26T22:49:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16244.564499 secs 2024-04-26T22:49:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15547.535094 secs 2024-04-26T22:49:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:09 smithi092 ceph-mon[29156]: pgmap v9196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:49:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:09 smithi189 ceph-mon[32756]: pgmap v9196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:49:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:09 smithi156 ceph-mon[32679]: pgmap v9196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:49:12.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:11 smithi156 ceph-mon[32679]: pgmap v9197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:11 smithi092 ceph-mon[29156]: pgmap v9197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:11 smithi189 ceph-mon[32756]: pgmap v9197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:13 smithi092 ceph-mon[29156]: pgmap v9198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16249.564640 secs 2024-04-26T22:49:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15552.535208 secs 2024-04-26T22:49:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:13 smithi189 ceph-mon[32756]: pgmap v9198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16249.564640 secs 2024-04-26T22:49:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15552.535208 secs 2024-04-26T22:49:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:13 smithi156 ceph-mon[32679]: pgmap v9198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16249.564640 secs 2024-04-26T22:49:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15552.535208 secs 2024-04-26T22:49:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:15 smithi092 ceph-mon[29156]: pgmap v9199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:15 smithi189 ceph-mon[32756]: pgmap v9199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:15 smithi156 ceph-mon[32679]: pgmap v9199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:17 smithi092 ceph-mon[29156]: pgmap v9200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:17 smithi189 ceph-mon[32756]: pgmap v9200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:17 smithi156 ceph-mon[32679]: pgmap v9200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16254.564781 secs 2024-04-26T22:49:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15557.535327 secs 2024-04-26T22:49:19.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16254.564781 secs 2024-04-26T22:49:19.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15557.535327 secs 2024-04-26T22:49:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16254.564781 secs 2024-04-26T22:49:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15557.535327 secs 2024-04-26T22:49:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:19 smithi092 ceph-mon[29156]: pgmap v9201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:19 smithi189 ceph-mon[32756]: pgmap v9201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:19 smithi156 ceph-mon[32679]: pgmap v9201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:21 smithi092 ceph-mon[29156]: pgmap v9202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:21 smithi189 ceph-mon[32756]: pgmap v9202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:21 smithi156 ceph-mon[32679]: pgmap v9202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:23 smithi092 ceph-mon[29156]: pgmap v9203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16259.564901 secs 2024-04-26T22:49:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15562.535441 secs 2024-04-26T22:49:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:23 smithi189 ceph-mon[32756]: pgmap v9203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16259.564901 secs 2024-04-26T22:49:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15562.535441 secs 2024-04-26T22:49:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:23 smithi156 ceph-mon[32679]: pgmap v9203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16259.564901 secs 2024-04-26T22:49:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15562.535441 secs 2024-04-26T22:49:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:25 smithi092 ceph-mon[29156]: pgmap v9204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:25 smithi189 ceph-mon[32756]: pgmap v9204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:25 smithi156 ceph-mon[32679]: pgmap v9204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:27 smithi092 ceph-mon[29156]: pgmap v9205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:27 smithi189 ceph-mon[32756]: pgmap v9205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:27 smithi156 ceph-mon[32679]: pgmap v9205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16264.564984 secs 2024-04-26T22:49:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15567.535562 secs 2024-04-26T22:49:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16264.564984 secs 2024-04-26T22:49:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15567.535562 secs 2024-04-26T22:49:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16264.564984 secs 2024-04-26T22:49:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15567.535562 secs 2024-04-26T22:49:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:29 smithi092 ceph-mon[29156]: pgmap v9206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:29 smithi189 ceph-mon[32756]: pgmap v9206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:29 smithi156 ceph-mon[32679]: pgmap v9206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:31 smithi092 ceph-mon[29156]: pgmap v9207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:31 smithi189 ceph-mon[32756]: pgmap v9207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:31 smithi156 ceph-mon[32679]: pgmap v9207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:33 smithi092 ceph-mon[29156]: pgmap v9208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16269.565109 secs 2024-04-26T22:49:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15572.535696 secs 2024-04-26T22:49:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:33 smithi189 ceph-mon[32756]: pgmap v9208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16269.565109 secs 2024-04-26T22:49:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15572.535696 secs 2024-04-26T22:49:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:33 smithi156 ceph-mon[32679]: pgmap v9208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:49:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16269.565109 secs 2024-04-26T22:49:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15572.535696 secs 2024-04-26T22:49:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:35 smithi092 ceph-mon[29156]: pgmap v9209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:35 smithi189 ceph-mon[32756]: pgmap v9209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:35 smithi156 ceph-mon[32679]: pgmap v9209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:49:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:37 smithi189 ceph-mon[32756]: pgmap v9210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:37 smithi156 ceph-mon[32679]: pgmap v9210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:37 smithi092 ceph-mon[29156]: pgmap v9210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16274.565194 secs 2024-04-26T22:49:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15577.535819 secs 2024-04-26T22:49:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16274.565194 secs 2024-04-26T22:49:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15577.535819 secs 2024-04-26T22:49:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16274.565194 secs 2024-04-26T22:49:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15577.535819 secs 2024-04-26T22:49:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:40 smithi189 ceph-mon[32756]: pgmap v9211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:40 smithi156 ceph-mon[32679]: pgmap v9211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:40 smithi092 ceph-mon[29156]: pgmap v9211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:42 smithi189 ceph-mon[32756]: pgmap v9212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:42 smithi156 ceph-mon[32679]: pgmap v9212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:42 smithi092 ceph-mon[29156]: pgmap v9212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:44 smithi189 ceph-mon[32756]: pgmap v9213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16279.565317 secs 2024-04-26T22:49:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15582.535890 secs 2024-04-26T22:49:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:44 smithi156 ceph-mon[32679]: pgmap v9213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16279.565317 secs 2024-04-26T22:49:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15582.535890 secs 2024-04-26T22:49:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:44 smithi092 ceph-mon[29156]: pgmap v9213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16279.565317 secs 2024-04-26T22:49:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15582.535890 secs 2024-04-26T22:49:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:46 smithi189 ceph-mon[32756]: pgmap v9214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:46 smithi156 ceph-mon[32679]: pgmap v9214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:46 smithi092 ceph-mon[29156]: pgmap v9214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:48 smithi189 ceph-mon[32756]: pgmap v9215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:48 smithi156 ceph-mon[32679]: pgmap v9215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:48 smithi092 ceph-mon[29156]: pgmap v9215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:49.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16284.565441 secs 2024-04-26T22:49:49.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15587.536026 secs 2024-04-26T22:49:49.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16284.565441 secs 2024-04-26T22:49:49.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15587.536026 secs 2024-04-26T22:49:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16284.565441 secs 2024-04-26T22:49:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15587.536026 secs 2024-04-26T22:49:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:50 smithi189 ceph-mon[32756]: pgmap v9216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:50 smithi156 ceph-mon[32679]: pgmap v9216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:50 smithi092 ceph-mon[29156]: pgmap v9216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:52 smithi189 ceph-mon[32756]: pgmap v9217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:52 smithi156 ceph-mon[32679]: pgmap v9217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:52 smithi092 ceph-mon[29156]: pgmap v9217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:54 smithi189 ceph-mon[32756]: pgmap v9218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16289.565600 secs 2024-04-26T22:49:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15592.536164 secs 2024-04-26T22:49:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:54 smithi156 ceph-mon[32679]: pgmap v9218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16289.565600 secs 2024-04-26T22:49:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15592.536164 secs 2024-04-26T22:49:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:54 smithi092 ceph-mon[29156]: pgmap v9218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16289.565600 secs 2024-04-26T22:49:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15592.536164 secs 2024-04-26T22:49:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:56 smithi189 ceph-mon[32756]: pgmap v9219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:56 smithi156 ceph-mon[32679]: pgmap v9219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:56 smithi092 ceph-mon[29156]: pgmap v9219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:49:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:58 smithi189 ceph-mon[32756]: pgmap v9220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:58 smithi156 ceph-mon[32679]: pgmap v9220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:58 smithi092 ceph-mon[29156]: pgmap v9220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16294.565649 secs 2024-04-26T22:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:49:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15597.536238 secs 2024-04-26T22:49:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16294.565649 secs 2024-04-26T22:49:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:49:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15597.536238 secs 2024-04-26T22:49:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16294.565649 secs 2024-04-26T22:49:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:49:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:49:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15597.536238 secs 2024-04-26T22:50:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:00 smithi189 ceph-mon[32756]: pgmap v9221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:50:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:00 smithi156 ceph-mon[32679]: pgmap v9221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:50:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:50:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:00 smithi092 ceph-mon[29156]: pgmap v9221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:50:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:50:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:50:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T22:50:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:01 smithi189 ceph-mon[32756]: pgmap v9222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:50:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:01 smithi189 ceph-mon[32756]: pgmap v9223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:01 smithi156 ceph-mon[32679]: pgmap v9222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:50:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:01 smithi156 ceph-mon[32679]: pgmap v9223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:01 smithi092 ceph-mon[29156]: pgmap v9222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:50:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:01 smithi092 ceph-mon[29156]: pgmap v9223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:03 smithi189 ceph-mon[32756]: pgmap v9224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:03 smithi156 ceph-mon[32679]: pgmap v9224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:03 smithi092 ceph-mon[29156]: pgmap v9224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16299.565768 secs 2024-04-26T22:50:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15602.536382 secs 2024-04-26T22:50:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16299.565768 secs 2024-04-26T22:50:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15602.536382 secs 2024-04-26T22:50:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16299.565768 secs 2024-04-26T22:50:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15602.536382 secs 2024-04-26T22:50:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:05 smithi189 ceph-mon[32756]: pgmap v9225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:05 smithi156 ceph-mon[32679]: pgmap v9225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:05 smithi092 ceph-mon[29156]: pgmap v9225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:07 smithi189 ceph-mon[32756]: pgmap v9226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:07 smithi156 ceph-mon[32679]: pgmap v9226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:07 smithi092 ceph-mon[29156]: pgmap v9226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:50:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:09 smithi189 ceph-mon[32756]: pgmap v9227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16304.565852 secs 2024-04-26T22:50:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15607.536509 secs 2024-04-26T22:50:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:09 smithi156 ceph-mon[32679]: pgmap v9227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16304.565852 secs 2024-04-26T22:50:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15607.536509 secs 2024-04-26T22:50:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:09 smithi092 ceph-mon[29156]: pgmap v9227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:50:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16304.565852 secs 2024-04-26T22:50:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15607.536509 secs 2024-04-26T22:50:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:11 smithi189 ceph-mon[32756]: pgmap v9228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:50:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:11 smithi156 ceph-mon[32679]: pgmap v9228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:50:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:11 smithi092 ceph-mon[29156]: pgmap v9228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:50:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:13 smithi189 ceph-mon[32756]: pgmap v9229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:13 smithi156 ceph-mon[32679]: pgmap v9229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:13 smithi092 ceph-mon[29156]: pgmap v9229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16309.565918 secs 2024-04-26T22:50:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15612.536625 secs 2024-04-26T22:50:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16309.565918 secs 2024-04-26T22:50:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15612.536625 secs 2024-04-26T22:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16309.565918 secs 2024-04-26T22:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15612.536625 secs 2024-04-26T22:50:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:15 smithi189 ceph-mon[32756]: pgmap v9230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:15 smithi156 ceph-mon[32679]: pgmap v9230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:15 smithi092 ceph-mon[29156]: pgmap v9230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:17 smithi189 ceph-mon[32756]: pgmap v9231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:17 smithi156 ceph-mon[32679]: pgmap v9231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:17 smithi092 ceph-mon[29156]: pgmap v9231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:19 smithi189 ceph-mon[32756]: pgmap v9232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16314.565984 secs 2024-04-26T22:50:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15617.536692 secs 2024-04-26T22:50:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:19 smithi156 ceph-mon[32679]: pgmap v9232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16314.565984 secs 2024-04-26T22:50:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15617.536692 secs 2024-04-26T22:50:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:19 smithi092 ceph-mon[29156]: pgmap v9232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16314.565984 secs 2024-04-26T22:50:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15617.536692 secs 2024-04-26T22:50:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:21 smithi189 ceph-mon[32756]: pgmap v9233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:21 smithi156 ceph-mon[32679]: pgmap v9233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:21 smithi092 ceph-mon[29156]: pgmap v9233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:23 smithi189 ceph-mon[32756]: pgmap v9234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:23 smithi156 ceph-mon[32679]: pgmap v9234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:23 smithi092 ceph-mon[29156]: pgmap v9234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16319.566121 secs 2024-04-26T22:50:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15622.536813 secs 2024-04-26T22:50:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16319.566121 secs 2024-04-26T22:50:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15622.536813 secs 2024-04-26T22:50:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16319.566121 secs 2024-04-26T22:50:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15622.536813 secs 2024-04-26T22:50:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:25 smithi189 ceph-mon[32756]: pgmap v9235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:25 smithi156 ceph-mon[32679]: pgmap v9235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:25 smithi092 ceph-mon[29156]: pgmap v9235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:26 smithi189 ceph-mon[32756]: pgmap v9236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:26 smithi156 ceph-mon[32679]: pgmap v9236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:26 smithi092 ceph-mon[29156]: pgmap v9236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:28 smithi156 ceph-mon[32679]: pgmap v9237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:28 smithi092 ceph-mon[29156]: pgmap v9237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:28 smithi189 ceph-mon[32756]: pgmap v9237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16324.566184 secs 2024-04-26T22:50:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15627.536928 secs 2024-04-26T22:50:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16324.566184 secs 2024-04-26T22:50:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15627.536928 secs 2024-04-26T22:50:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16324.566184 secs 2024-04-26T22:50:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15627.536928 secs 2024-04-26T22:50:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:30 smithi156 ceph-mon[32679]: pgmap v9238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:30 smithi092 ceph-mon[29156]: pgmap v9238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:30 smithi189 ceph-mon[32756]: pgmap v9238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:32 smithi156 ceph-mon[32679]: pgmap v9239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:32 smithi092 ceph-mon[29156]: pgmap v9239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:32 smithi189 ceph-mon[32756]: pgmap v9239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:34 smithi156 ceph-mon[32679]: pgmap v9240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16329.566317 secs 2024-04-26T22:50:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15632.537048 secs 2024-04-26T22:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:34 smithi092 ceph-mon[29156]: pgmap v9240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16329.566317 secs 2024-04-26T22:50:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15632.537048 secs 2024-04-26T22:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:34 smithi189 ceph-mon[32756]: pgmap v9240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16329.566317 secs 2024-04-26T22:50:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15632.537048 secs 2024-04-26T22:50:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:36 smithi156 ceph-mon[32679]: pgmap v9241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:36 smithi092 ceph-mon[29156]: pgmap v9241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:36 smithi189 ceph-mon[32756]: pgmap v9241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:38 smithi156 ceph-mon[32679]: pgmap v9242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:38 smithi092 ceph-mon[29156]: pgmap v9242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:38 smithi189 ceph-mon[32756]: pgmap v9242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16334.566381 secs 2024-04-26T22:50:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15637.537153 secs 2024-04-26T22:50:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16334.566381 secs 2024-04-26T22:50:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15637.537153 secs 2024-04-26T22:50:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16334.566381 secs 2024-04-26T22:50:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15637.537153 secs 2024-04-26T22:50:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:40 smithi156 ceph-mon[32679]: pgmap v9243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:40 smithi092 ceph-mon[29156]: pgmap v9243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:40 smithi189 ceph-mon[32756]: pgmap v9243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:42 smithi156 ceph-mon[32679]: pgmap v9244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:42 smithi092 ceph-mon[29156]: pgmap v9244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:42 smithi189 ceph-mon[32756]: pgmap v9244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:44 smithi092 ceph-mon[29156]: pgmap v9245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16339.566461 secs 2024-04-26T22:50:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15642.537280 secs 2024-04-26T22:50:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:44 smithi189 ceph-mon[32756]: pgmap v9245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16339.566461 secs 2024-04-26T22:50:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15642.537280 secs 2024-04-26T22:50:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:44 smithi156 ceph-mon[32679]: pgmap v9245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16339.566461 secs 2024-04-26T22:50:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15642.537280 secs 2024-04-26T22:50:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:46 smithi092 ceph-mon[29156]: pgmap v9246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:46 smithi189 ceph-mon[32756]: pgmap v9246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:46 smithi156 ceph-mon[32679]: pgmap v9246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:48 smithi092 ceph-mon[29156]: pgmap v9247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:48 smithi189 ceph-mon[32756]: pgmap v9247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:48 smithi156 ceph-mon[32679]: pgmap v9247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16344.566536 secs 2024-04-26T22:50:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15647.537401 secs 2024-04-26T22:50:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16344.566536 secs 2024-04-26T22:50:49.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15647.537401 secs 2024-04-26T22:50:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16344.566536 secs 2024-04-26T22:50:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15647.537401 secs 2024-04-26T22:50:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:50 smithi092 ceph-mon[29156]: pgmap v9248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:50 smithi189 ceph-mon[32756]: pgmap v9248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:50 smithi156 ceph-mon[32679]: pgmap v9248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:52 smithi092 ceph-mon[29156]: pgmap v9249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:52 smithi189 ceph-mon[32756]: pgmap v9249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:52 smithi156 ceph-mon[32679]: pgmap v9249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:53.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:50:53.225+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:50:53.225+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:50:53.225+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:50:53.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:50:53.225+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 128 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:50:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:54 smithi092 ceph-mon[29156]: pgmap v9250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16349.566653 secs 2024-04-26T22:50:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15652.537480 secs 2024-04-26T22:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:54 smithi189 ceph-mon[32756]: pgmap v9250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16349.566653 secs 2024-04-26T22:50:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15652.537480 secs 2024-04-26T22:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:54 smithi156 ceph-mon[32679]: pgmap v9250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16349.566653 secs 2024-04-26T22:50:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15652.537480 secs 2024-04-26T22:50:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:56 smithi092 ceph-mon[29156]: pgmap v9251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:56 smithi189 ceph-mon[32756]: pgmap v9251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:56 smithi156 ceph-mon[32679]: pgmap v9251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:50:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:58 smithi092 ceph-mon[29156]: pgmap v9252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:58 smithi189 ceph-mon[32756]: pgmap v9252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:58 smithi156 ceph-mon[32679]: pgmap v9252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16354.566734 secs 2024-04-26T22:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15657.537603 secs 2024-04-26T22:50:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:50:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:50:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16354.566734 secs 2024-04-26T22:50:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15657.537603 secs 2024-04-26T22:50:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:50:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:50:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16354.566734 secs 2024-04-26T22:50:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15657.537603 secs 2024-04-26T22:50:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:50:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:51:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:00 smithi092 ceph-mon[29156]: pgmap v9253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:51:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:00 smithi189 ceph-mon[32756]: pgmap v9253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:51:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:00 smithi156 ceph-mon[32679]: pgmap v9253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:51:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:51:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:51:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:01 smithi092 ceph-mon[29156]: pgmap v9254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:51:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:01 smithi092 ceph-mon[29156]: pgmap v9255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:01 smithi189 ceph-mon[32756]: pgmap v9254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:51:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:01 smithi189 ceph-mon[32756]: pgmap v9255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:01 smithi156 ceph-mon[32679]: pgmap v9254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:51:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:01 smithi156 ceph-mon[32679]: pgmap v9255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:03 smithi092 ceph-mon[29156]: pgmap v9256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:03 smithi189 ceph-mon[32756]: pgmap v9256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:03 smithi156 ceph-mon[32679]: pgmap v9256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16359.566794 secs 2024-04-26T22:51:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15662.537677 secs 2024-04-26T22:51:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16359.566794 secs 2024-04-26T22:51:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15662.537677 secs 2024-04-26T22:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16359.566794 secs 2024-04-26T22:51:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15662.537677 secs 2024-04-26T22:51:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:05 smithi092 ceph-mon[29156]: pgmap v9257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:05 smithi189 ceph-mon[32756]: pgmap v9257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:05 smithi156 ceph-mon[32679]: pgmap v9257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:07 smithi189 ceph-mon[32756]: pgmap v9258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:07 smithi156 ceph-mon[32679]: pgmap v9258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:07 smithi092 ceph-mon[29156]: pgmap v9258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:51:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:09 smithi189 ceph-mon[32756]: pgmap v9259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:51:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16364.566861 secs 2024-04-26T22:51:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15667.537823 secs 2024-04-26T22:51:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:09 smithi156 ceph-mon[32679]: pgmap v9259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:51:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16364.566861 secs 2024-04-26T22:51:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15667.537823 secs 2024-04-26T22:51:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:09 smithi092 ceph-mon[29156]: pgmap v9259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:51:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16364.566861 secs 2024-04-26T22:51:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15667.537823 secs 2024-04-26T22:51:11.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:11 smithi189 ceph-mon[32756]: pgmap v9260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:51:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:11 smithi156 ceph-mon[32679]: pgmap v9260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:51:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:11 smithi092 ceph-mon[29156]: pgmap v9260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:51:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:13 smithi189 ceph-mon[32756]: pgmap v9261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:13 smithi156 ceph-mon[32679]: pgmap v9261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:13 smithi092 ceph-mon[29156]: pgmap v9261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:14.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16369.566971 secs 2024-04-26T22:51:14.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15672.537931 secs 2024-04-26T22:51:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16369.566971 secs 2024-04-26T22:51:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15672.537931 secs 2024-04-26T22:51:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16369.566971 secs 2024-04-26T22:51:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15672.537931 secs 2024-04-26T22:51:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:15 smithi189 ceph-mon[32756]: pgmap v9262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:15 smithi156 ceph-mon[32679]: pgmap v9262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:15 smithi092 ceph-mon[29156]: pgmap v9262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:17 smithi189 ceph-mon[32756]: pgmap v9263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:17 smithi156 ceph-mon[32679]: pgmap v9263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:17 smithi092 ceph-mon[29156]: pgmap v9263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:19.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:19 smithi092 ceph-mon[29156]: pgmap v9264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:19.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16374.567034 secs 2024-04-26T22:51:19.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15677.538051 secs 2024-04-26T22:51:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:19 smithi189 ceph-mon[32756]: pgmap v9264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16374.567034 secs 2024-04-26T22:51:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15677.538051 secs 2024-04-26T22:51:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:19 smithi156 ceph-mon[32679]: pgmap v9264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16374.567034 secs 2024-04-26T22:51:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15677.538051 secs 2024-04-26T22:51:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:21 smithi189 ceph-mon[32756]: pgmap v9265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:21 smithi156 ceph-mon[32679]: pgmap v9265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:21 smithi092 ceph-mon[29156]: pgmap v9265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:23 smithi189 ceph-mon[32756]: pgmap v9266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:23 smithi156 ceph-mon[32679]: pgmap v9266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:23 smithi092 ceph-mon[29156]: pgmap v9266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16379.567144 secs 2024-04-26T22:51:24.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15682.538180 secs 2024-04-26T22:51:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16379.567144 secs 2024-04-26T22:51:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15682.538180 secs 2024-04-26T22:51:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16379.567144 secs 2024-04-26T22:51:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15682.538180 secs 2024-04-26T22:51:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:25 smithi189 ceph-mon[32756]: pgmap v9267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:25 smithi156 ceph-mon[32679]: pgmap v9267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:25 smithi092 ceph-mon[29156]: pgmap v9267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:27 smithi189 ceph-mon[32756]: pgmap v9268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:27 smithi156 ceph-mon[32679]: pgmap v9268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:27 smithi092 ceph-mon[29156]: pgmap v9268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:29 smithi189 ceph-mon[32756]: pgmap v9269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16384.567224 secs 2024-04-26T22:51:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15687.538330 secs 2024-04-26T22:51:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:29 smithi156 ceph-mon[32679]: pgmap v9269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16384.567224 secs 2024-04-26T22:51:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15687.538330 secs 2024-04-26T22:51:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:29 smithi092 ceph-mon[29156]: pgmap v9269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16384.567224 secs 2024-04-26T22:51:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15687.538330 secs 2024-04-26T22:51:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:31 smithi189 ceph-mon[32756]: pgmap v9270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:31 smithi156 ceph-mon[32679]: pgmap v9270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:31 smithi092 ceph-mon[29156]: pgmap v9270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:33 smithi189 ceph-mon[32756]: pgmap v9271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:33 smithi156 ceph-mon[32679]: pgmap v9271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:33 smithi092 ceph-mon[29156]: pgmap v9271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16389.567343 secs 2024-04-26T22:51:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15692.538454 secs 2024-04-26T22:51:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16389.567343 secs 2024-04-26T22:51:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15692.538454 secs 2024-04-26T22:51:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16389.567343 secs 2024-04-26T22:51:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15692.538454 secs 2024-04-26T22:51:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:35 smithi189 ceph-mon[32756]: pgmap v9272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:35 smithi156 ceph-mon[32679]: pgmap v9272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:35 smithi092 ceph-mon[29156]: pgmap v9272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:37 smithi189 ceph-mon[32756]: pgmap v9273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:37 smithi156 ceph-mon[32679]: pgmap v9273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:37 smithi092 ceph-mon[29156]: pgmap v9273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:51:38.231+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:51:38.231 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:51:38.231+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:51:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:51:38.231+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:51:38.232 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:51:38.231+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 129 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:51:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:39 smithi189 ceph-mon[32756]: pgmap v9274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16394.567479 secs 2024-04-26T22:51:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15697.538525 secs 2024-04-26T22:51:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:39 smithi156 ceph-mon[32679]: pgmap v9274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16394.567479 secs 2024-04-26T22:51:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15697.538525 secs 2024-04-26T22:51:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:39 smithi092 ceph-mon[29156]: pgmap v9274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16394.567479 secs 2024-04-26T22:51:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15697.538525 secs 2024-04-26T22:51:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:41 smithi189 ceph-mon[32756]: pgmap v9275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:41 smithi156 ceph-mon[32679]: pgmap v9275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:41 smithi092 ceph-mon[29156]: pgmap v9275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:43 smithi189 ceph-mon[32756]: pgmap v9276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:43 smithi156 ceph-mon[32679]: pgmap v9276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:43 smithi092 ceph-mon[29156]: pgmap v9276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:44.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16399.567593 secs 2024-04-26T22:51:44.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15702.538592 secs 2024-04-26T22:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16399.567593 secs 2024-04-26T22:51:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15702.538592 secs 2024-04-26T22:51:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16399.567593 secs 2024-04-26T22:51:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15702.538592 secs 2024-04-26T22:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:45 smithi189 ceph-mon[32756]: pgmap v9277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:45 smithi156 ceph-mon[32679]: pgmap v9277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:45 smithi092 ceph-mon[29156]: pgmap v9277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:47 smithi189 ceph-mon[32756]: pgmap v9278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:47 smithi156 ceph-mon[32679]: pgmap v9278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:47 smithi092 ceph-mon[29156]: pgmap v9278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:49 smithi189 ceph-mon[32756]: pgmap v9279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16404.567729 secs 2024-04-26T22:51:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15707.538706 secs 2024-04-26T22:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:49 smithi156 ceph-mon[32679]: pgmap v9279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16404.567729 secs 2024-04-26T22:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15707.538706 secs 2024-04-26T22:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:49 smithi092 ceph-mon[29156]: pgmap v9279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16404.567729 secs 2024-04-26T22:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15707.538706 secs 2024-04-26T22:51:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:51 smithi189 ceph-mon[32756]: pgmap v9280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:51 smithi156 ceph-mon[32679]: pgmap v9280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:51 smithi092 ceph-mon[29156]: pgmap v9280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:53 smithi189 ceph-mon[32756]: pgmap v9281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:53 smithi156 ceph-mon[32679]: pgmap v9281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:53 smithi092 ceph-mon[29156]: pgmap v9281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16409.567847 secs 2024-04-26T22:51:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15712.538826 secs 2024-04-26T22:51:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16409.567847 secs 2024-04-26T22:51:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15712.538826 secs 2024-04-26T22:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16409.567847 secs 2024-04-26T22:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15712.538826 secs 2024-04-26T22:51:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:55 smithi189 ceph-mon[32756]: pgmap v9282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:55 smithi156 ceph-mon[32679]: pgmap v9282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:55 smithi092 ceph-mon[29156]: pgmap v9282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:51:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:57 smithi189 ceph-mon[32756]: pgmap v9283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:57 smithi156 ceph-mon[32679]: pgmap v9283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:57 smithi092 ceph-mon[29156]: pgmap v9283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:59 smithi189 ceph-mon[32756]: pgmap v9284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16414.568001 secs 2024-04-26T22:51:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:51:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15717.538966 secs 2024-04-26T22:51:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:59 smithi156 ceph-mon[32679]: pgmap v9284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16414.568001 secs 2024-04-26T22:51:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:51:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15717.538966 secs 2024-04-26T22:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:59 smithi092 ceph-mon[29156]: pgmap v9284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16414.568001 secs 2024-04-26T22:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:51:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15717.538966 secs 2024-04-26T22:52:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:52:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: pgmap v9285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: pgmap v9286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: pgmap v9287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: pgmap v9285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: pgmap v9286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: pgmap v9287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: pgmap v9285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:52:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:52:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: pgmap v9286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:52:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: pgmap v9287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:52:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:03 smithi092 ceph-mon[29156]: pgmap v9288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:52:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16419.568064 secs 2024-04-26T22:52:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15722.539077 secs 2024-04-26T22:52:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:03 smithi189 ceph-mon[32756]: pgmap v9288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:52:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16419.568064 secs 2024-04-26T22:52:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15722.539077 secs 2024-04-26T22:52:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:03 smithi156 ceph-mon[32679]: pgmap v9288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:52:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16419.568064 secs 2024-04-26T22:52:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15722.539077 secs 2024-04-26T22:52:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:05 smithi092 ceph-mon[29156]: pgmap v9289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:05 smithi189 ceph-mon[32756]: pgmap v9289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:05 smithi156 ceph-mon[32679]: pgmap v9289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:07 smithi092 ceph-mon[29156]: pgmap v9290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:07 smithi189 ceph-mon[32756]: pgmap v9290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:07 smithi156 ceph-mon[32679]: pgmap v9290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16424.568181 secs 2024-04-26T22:52:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15727.539217 secs 2024-04-26T22:52:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16424.568181 secs 2024-04-26T22:52:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15727.539217 secs 2024-04-26T22:52:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16424.568181 secs 2024-04-26T22:52:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15727.539217 secs 2024-04-26T22:52:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:09 smithi092 ceph-mon[29156]: pgmap v9291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:09 smithi189 ceph-mon[32756]: pgmap v9291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:09 smithi156 ceph-mon[32679]: pgmap v9291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:52:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:11 smithi092 ceph-mon[29156]: pgmap v9292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:52:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:11 smithi189 ceph-mon[32756]: pgmap v9292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:52:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:11 smithi156 ceph-mon[32679]: pgmap v9292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:52:14.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:13 smithi156 ceph-mon[32679]: pgmap v9293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:14.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16429.568302 secs 2024-04-26T22:52:14.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15732.539331 secs 2024-04-26T22:52:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:13 smithi092 ceph-mon[29156]: pgmap v9293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16429.568302 secs 2024-04-26T22:52:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15732.539331 secs 2024-04-26T22:52:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:13 smithi189 ceph-mon[32756]: pgmap v9293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16429.568302 secs 2024-04-26T22:52:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15732.539331 secs 2024-04-26T22:52:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:15 smithi092 ceph-mon[29156]: pgmap v9294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:15 smithi189 ceph-mon[32756]: pgmap v9294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:15 smithi156 ceph-mon[32679]: pgmap v9294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:17 smithi092 ceph-mon[29156]: pgmap v9295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:17 smithi189 ceph-mon[32756]: pgmap v9295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:17 smithi156 ceph-mon[32679]: pgmap v9295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16434.568438 secs 2024-04-26T22:52:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15737.539448 secs 2024-04-26T22:52:19.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16434.568438 secs 2024-04-26T22:52:19.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15737.539448 secs 2024-04-26T22:52:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16434.568438 secs 2024-04-26T22:52:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15737.539448 secs 2024-04-26T22:52:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:19 smithi092 ceph-mon[29156]: pgmap v9296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:19 smithi189 ceph-mon[32756]: pgmap v9296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:19 smithi156 ceph-mon[32679]: pgmap v9296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:21 smithi092 ceph-mon[29156]: pgmap v9297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:21 smithi189 ceph-mon[32756]: pgmap v9297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:21 smithi156 ceph-mon[32679]: pgmap v9297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:23 smithi189 ceph-mon[32756]: pgmap v9298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16439.568596 secs 2024-04-26T22:52:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15742.539562 secs 2024-04-26T22:52:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:23 smithi156 ceph-mon[32679]: pgmap v9298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16439.568596 secs 2024-04-26T22:52:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15742.539562 secs 2024-04-26T22:52:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:23 smithi092 ceph-mon[29156]: pgmap v9298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16439.568596 secs 2024-04-26T22:52:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15742.539562 secs 2024-04-26T22:52:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:26 smithi189 ceph-mon[32756]: pgmap v9299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:26 smithi156 ceph-mon[32679]: pgmap v9299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:25 smithi092 ceph-mon[29156]: pgmap v9299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:28 smithi092 ceph-mon[29156]: pgmap v9300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:28 smithi189 ceph-mon[32756]: pgmap v9300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:28 smithi156 ceph-mon[32679]: pgmap v9300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16444.568719 secs 2024-04-26T22:52:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15747.539638 secs 2024-04-26T22:52:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16444.568719 secs 2024-04-26T22:52:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15747.539638 secs 2024-04-26T22:52:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16444.568719 secs 2024-04-26T22:52:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15747.539638 secs 2024-04-26T22:52:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:30 smithi189 ceph-mon[32756]: pgmap v9301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:30 smithi156 ceph-mon[32679]: pgmap v9301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:30 smithi092 ceph-mon[29156]: pgmap v9301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:32 smithi189 ceph-mon[32756]: pgmap v9302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:32 smithi156 ceph-mon[32679]: pgmap v9302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:32 smithi092 ceph-mon[29156]: pgmap v9302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:34 smithi189 ceph-mon[32756]: pgmap v9303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16449.568889 secs 2024-04-26T22:52:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15752.539751 secs 2024-04-26T22:52:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:34 smithi156 ceph-mon[32679]: pgmap v9303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16449.568889 secs 2024-04-26T22:52:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15752.539751 secs 2024-04-26T22:52:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:34 smithi092 ceph-mon[29156]: pgmap v9303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16449.568889 secs 2024-04-26T22:52:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15752.539751 secs 2024-04-26T22:52:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:36 smithi189 ceph-mon[32756]: pgmap v9304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:36 smithi156 ceph-mon[32679]: pgmap v9304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:36 smithi092 ceph-mon[29156]: pgmap v9304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:38 smithi189 ceph-mon[32756]: pgmap v9305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:38 smithi156 ceph-mon[32679]: pgmap v9305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:38 smithi092 ceph-mon[29156]: pgmap v9305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16454.569007 secs 2024-04-26T22:52:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15757.539832 secs 2024-04-26T22:52:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16454.569007 secs 2024-04-26T22:52:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15757.539832 secs 2024-04-26T22:52:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16454.569007 secs 2024-04-26T22:52:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15757.539832 secs 2024-04-26T22:52:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:40 smithi189 ceph-mon[32756]: pgmap v9306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:40 smithi156 ceph-mon[32679]: pgmap v9306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:40 smithi092 ceph-mon[29156]: pgmap v9306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:42 smithi189 ceph-mon[32756]: pgmap v9307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:42 smithi156 ceph-mon[32679]: pgmap v9307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:42 smithi092 ceph-mon[29156]: pgmap v9307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:44 smithi189 ceph-mon[32756]: pgmap v9308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16459.569122 secs 2024-04-26T22:52:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15762.539950 secs 2024-04-26T22:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:44 smithi156 ceph-mon[32679]: pgmap v9308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16459.569122 secs 2024-04-26T22:52:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15762.539950 secs 2024-04-26T22:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:44 smithi092 ceph-mon[29156]: pgmap v9308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16459.569122 secs 2024-04-26T22:52:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15762.539950 secs 2024-04-26T22:52:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:46 smithi189 ceph-mon[32756]: pgmap v9309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:46 smithi156 ceph-mon[32679]: pgmap v9309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:46 smithi092 ceph-mon[29156]: pgmap v9309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:48 smithi189 ceph-mon[32756]: pgmap v9310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:48 smithi156 ceph-mon[32679]: pgmap v9310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:48 smithi092 ceph-mon[29156]: pgmap v9310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T22:52:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16464.569185 secs 2024-04-26T22:52:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15767.540090 secs 2024-04-26T22:52:49.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16464.569185 secs 2024-04-26T22:52:49.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15767.540090 secs 2024-04-26T22:52:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16464.569185 secs 2024-04-26T22:52:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15767.540090 secs 2024-04-26T22:52:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:50 smithi189 ceph-mon[32756]: pgmap v9311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:50 smithi156 ceph-mon[32679]: pgmap v9311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:50 smithi092 ceph-mon[29156]: pgmap v9311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:52:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:52 smithi189 ceph-mon[32756]: pgmap v9312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:52 smithi156 ceph-mon[32679]: pgmap v9312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:52 smithi092 ceph-mon[29156]: pgmap v9312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:54 smithi189 ceph-mon[32756]: pgmap v9313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16469.569287 secs 2024-04-26T22:52:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15772.540225 secs 2024-04-26T22:52:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:54 smithi156 ceph-mon[32679]: pgmap v9313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16469.569287 secs 2024-04-26T22:52:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15772.540225 secs 2024-04-26T22:52:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:54 smithi092 ceph-mon[29156]: pgmap v9313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16469.569287 secs 2024-04-26T22:52:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15772.540225 secs 2024-04-26T22:52:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:56 smithi189 ceph-mon[32756]: pgmap v9314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:56 smithi156 ceph-mon[32679]: pgmap v9314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:56 smithi092 ceph-mon[29156]: pgmap v9314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:52:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:58 smithi189 ceph-mon[32756]: pgmap v9315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:58 smithi156 ceph-mon[32679]: pgmap v9315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:58 smithi092 ceph-mon[29156]: pgmap v9315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:52:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16474.569367 secs 2024-04-26T22:52:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:52:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15777.540367 secs 2024-04-26T22:52:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16474.569367 secs 2024-04-26T22:52:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:52:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15777.540367 secs 2024-04-26T22:52:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16474.569367 secs 2024-04-26T22:52:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:52:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15777.540367 secs 2024-04-26T22:53:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:00 smithi189 ceph-mon[32756]: pgmap v9316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:00 smithi156 ceph-mon[32679]: pgmap v9316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:00 smithi092 ceph-mon[29156]: pgmap v9316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:53:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:53:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:53:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:02 smithi189 ceph-mon[32756]: pgmap v9317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:53:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:53:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:53:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:02 smithi156 ceph-mon[32679]: pgmap v9317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:53:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:53:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:53:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:02 smithi092 ceph-mon[29156]: pgmap v9317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:53:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:53:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:53:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:03 smithi189 ceph-mon[32756]: pgmap v9318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:53:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:03 smithi189 ceph-mon[32756]: pgmap v9319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:03 smithi156 ceph-mon[32679]: pgmap v9318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:53:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:03 smithi156 ceph-mon[32679]: pgmap v9319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:03 smithi092 ceph-mon[29156]: pgmap v9318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:53:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:03 smithi092 ceph-mon[29156]: pgmap v9319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16479.569425 secs 2024-04-26T22:53:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15782.540482 secs 2024-04-26T22:53:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16479.569425 secs 2024-04-26T22:53:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15782.540482 secs 2024-04-26T22:53:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16479.569425 secs 2024-04-26T22:53:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15782.540482 secs 2024-04-26T22:53:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:05 smithi189 ceph-mon[32756]: pgmap v9320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:05 smithi156 ceph-mon[32679]: pgmap v9320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-mon[29156]: pgmap v9320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:05.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:53:05.166+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:53:05.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:53:05.166+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:53:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:53:05.166+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:53:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:53:05.166+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:53:05.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:53:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:53:05.166+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:53:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:07 smithi189 ceph-mon[32756]: pgmap v9321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:07 smithi156 ceph-mon[32679]: pgmap v9321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:07 smithi092 ceph-mon[29156]: pgmap v9321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:53:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:09 smithi189 ceph-mon[32756]: pgmap v9322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16484.569547 secs 2024-04-26T22:53:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15787.540556 secs 2024-04-26T22:53:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:09 smithi156 ceph-mon[32679]: pgmap v9322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:53:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16484.569547 secs 2024-04-26T22:53:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15787.540556 secs 2024-04-26T22:53:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:09 smithi092 ceph-mon[29156]: pgmap v9322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:53:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16484.569547 secs 2024-04-26T22:53:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15787.540556 secs 2024-04-26T22:53:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:11 smithi189 ceph-mon[32756]: pgmap v9323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T22:53:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:11 smithi156 ceph-mon[32679]: pgmap v9323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T22:53:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:11 smithi092 ceph-mon[29156]: pgmap v9323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T22:53:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:13 smithi189 ceph-mon[32756]: pgmap v9324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T22:53:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:13 smithi156 ceph-mon[32679]: pgmap v9324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T22:53:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:13 smithi092 ceph-mon[29156]: pgmap v9324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T22:53:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16489.569660 secs 2024-04-26T22:53:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15792.540617 secs 2024-04-26T22:53:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16489.569660 secs 2024-04-26T22:53:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15792.540617 secs 2024-04-26T22:53:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16489.569660 secs 2024-04-26T22:53:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15792.540617 secs 2024-04-26T22:53:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:15 smithi189 ceph-mon[32756]: pgmap v9325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:15 smithi156 ceph-mon[32679]: pgmap v9325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:15 smithi092 ceph-mon[29156]: pgmap v9325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:17 smithi189 ceph-mon[32756]: pgmap v9326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:17 smithi156 ceph-mon[32679]: pgmap v9326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:17 smithi092 ceph-mon[29156]: pgmap v9326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:19 smithi189 ceph-mon[32756]: pgmap v9327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16494.569785 secs 2024-04-26T22:53:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15797.540759 secs 2024-04-26T22:53:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:19 smithi156 ceph-mon[32679]: pgmap v9327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16494.569785 secs 2024-04-26T22:53:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15797.540759 secs 2024-04-26T22:53:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:19 smithi092 ceph-mon[29156]: pgmap v9327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T22:53:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16494.569785 secs 2024-04-26T22:53:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15797.540759 secs 2024-04-26T22:53:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:21 smithi189 ceph-mon[32756]: pgmap v9328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:21 smithi156 ceph-mon[32679]: pgmap v9328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:21 smithi092 ceph-mon[29156]: pgmap v9328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T22:53:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:23 smithi189 ceph-mon[32756]: pgmap v9329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:23 smithi156 ceph-mon[32679]: pgmap v9329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:23 smithi092 ceph-mon[29156]: pgmap v9329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16499.569907 secs 2024-04-26T22:53:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15802.540887 secs 2024-04-26T22:53:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16499.569907 secs 2024-04-26T22:53:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15802.540887 secs 2024-04-26T22:53:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16499.569907 secs 2024-04-26T22:53:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15802.540887 secs 2024-04-26T22:53:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:25 smithi189 ceph-mon[32756]: pgmap v9330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:25 smithi156 ceph-mon[32679]: pgmap v9330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:25 smithi092 ceph-mon[29156]: pgmap v9330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:26 smithi156 ceph-mon[32679]: pgmap v9331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:26 smithi092 ceph-mon[29156]: pgmap v9331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:26 smithi189 ceph-mon[32756]: pgmap v9331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:28 smithi092 ceph-mon[29156]: pgmap v9332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:29.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16504.570036 secs 2024-04-26T22:53:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:28 smithi189 ceph-mon[32756]: pgmap v9332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16504.570036 secs 2024-04-26T22:53:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:28 smithi156 ceph-mon[32679]: pgmap v9332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16504.570036 secs 2024-04-26T22:53:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15807.540969 secs 2024-04-26T22:53:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15807.540969 secs 2024-04-26T22:53:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15807.540969 secs 2024-04-26T22:53:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:30 smithi189 ceph-mon[32756]: pgmap v9333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:30 smithi156 ceph-mon[32679]: pgmap v9333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:30 smithi092 ceph-mon[29156]: pgmap v9333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:32 smithi189 ceph-mon[32756]: pgmap v9334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:32 smithi156 ceph-mon[32679]: pgmap v9334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:32 smithi092 ceph-mon[29156]: pgmap v9334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16509.570161 secs 2024-04-26T22:53:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15812.541029 secs 2024-04-26T22:53:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16509.570161 secs 2024-04-26T22:53:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15812.541029 secs 2024-04-26T22:53:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16509.570161 secs 2024-04-26T22:53:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15812.541029 secs 2024-04-26T22:53:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:34 smithi189 ceph-mon[32756]: pgmap v9335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:34 smithi156 ceph-mon[32679]: pgmap v9335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:34 smithi092 ceph-mon[29156]: pgmap v9335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:36 smithi189 ceph-mon[32756]: pgmap v9336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:36 smithi156 ceph-mon[32679]: pgmap v9336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:36 smithi092 ceph-mon[29156]: pgmap v9336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:38 smithi189 ceph-mon[32756]: pgmap v9337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16514.570281 secs 2024-04-26T22:53:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15817.541134 secs 2024-04-26T22:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:38 smithi156 ceph-mon[32679]: pgmap v9337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16514.570281 secs 2024-04-26T22:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15817.541134 secs 2024-04-26T22:53:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:38 smithi092 ceph-mon[29156]: pgmap v9337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16514.570281 secs 2024-04-26T22:53:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15817.541134 secs 2024-04-26T22:53:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:40 smithi189 ceph-mon[32756]: pgmap v9338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:40 smithi156 ceph-mon[32679]: pgmap v9338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:40 smithi092 ceph-mon[29156]: pgmap v9338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:42 smithi189 ceph-mon[32756]: pgmap v9339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:42 smithi156 ceph-mon[32679]: pgmap v9339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:42 smithi092 ceph-mon[29156]: pgmap v9339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:44.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16519.570349 secs 2024-04-26T22:53:44.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15822.541249 secs 2024-04-26T22:53:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16519.570349 secs 2024-04-26T22:53:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15822.541249 secs 2024-04-26T22:53:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16519.570349 secs 2024-04-26T22:53:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15822.541249 secs 2024-04-26T22:53:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:44 smithi189 ceph-mon[32756]: pgmap v9340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:44 smithi156 ceph-mon[32679]: pgmap v9340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:44 smithi092 ceph-mon[29156]: pgmap v9340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:46 smithi189 ceph-mon[32756]: pgmap v9341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:46 smithi156 ceph-mon[32679]: pgmap v9341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:46 smithi092 ceph-mon[29156]: pgmap v9341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:49.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:48 smithi092 ceph-mon[29156]: pgmap v9342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:49.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16524.570425 secs 2024-04-26T22:53:49.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15827.541365 secs 2024-04-26T22:53:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:48 smithi189 ceph-mon[32756]: pgmap v9342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16524.570425 secs 2024-04-26T22:53:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15827.541365 secs 2024-04-26T22:53:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:48 smithi156 ceph-mon[32679]: pgmap v9342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16524.570425 secs 2024-04-26T22:53:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15827.541365 secs 2024-04-26T22:53:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:50 smithi189 ceph-mon[32756]: pgmap v9343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:50 smithi156 ceph-mon[32679]: pgmap v9343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:50 smithi092 ceph-mon[29156]: pgmap v9343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:52 smithi189 ceph-mon[32756]: pgmap v9344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:52 smithi156 ceph-mon[32679]: pgmap v9344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:52 smithi092 ceph-mon[29156]: pgmap v9344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16529.570546 secs 2024-04-26T22:53:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15832.541453 secs 2024-04-26T22:53:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16529.570546 secs 2024-04-26T22:53:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15832.541453 secs 2024-04-26T22:53:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16529.570546 secs 2024-04-26T22:53:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15832.541453 secs 2024-04-26T22:53:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:54 smithi189 ceph-mon[32756]: pgmap v9345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:54 smithi156 ceph-mon[32679]: pgmap v9345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:54 smithi092 ceph-mon[29156]: pgmap v9345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:53:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:56 smithi189 ceph-mon[32756]: pgmap v9346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:56 smithi156 ceph-mon[32679]: pgmap v9346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:56 smithi092 ceph-mon[29156]: pgmap v9346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:58 smithi189 ceph-mon[32756]: pgmap v9347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16534.570671 secs 2024-04-26T22:53:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:53:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15837.541515 secs 2024-04-26T22:53:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:58 smithi156 ceph-mon[32679]: pgmap v9347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16534.570671 secs 2024-04-26T22:53:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:53:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15837.541515 secs 2024-04-26T22:53:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:58 smithi092 ceph-mon[29156]: pgmap v9347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:53:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16534.570671 secs 2024-04-26T22:53:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:53:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15837.541515 secs 2024-04-26T22:54:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:00 smithi189 ceph-mon[32756]: pgmap v9348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:00 smithi156 ceph-mon[32679]: pgmap v9348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:00 smithi092 ceph-mon[29156]: pgmap v9348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:02 smithi189 ceph-mon[32756]: pgmap v9349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:02 smithi156 ceph-mon[32679]: pgmap v9349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:54:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:02 smithi092 ceph-mon[29156]: pgmap v9349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:54:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:54:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:03 smithi189 ceph-mon[32756]: pgmap v9350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:03 smithi189 ceph-mon[32756]: pgmap v9351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16539.570793 secs 2024-04-26T22:54:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15842.541641 secs 2024-04-26T22:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:03 smithi156 ceph-mon[32679]: pgmap v9350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:03 smithi156 ceph-mon[32679]: pgmap v9351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16539.570793 secs 2024-04-26T22:54:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15842.541641 secs 2024-04-26T22:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:03 smithi092 ceph-mon[29156]: pgmap v9350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:03 smithi092 ceph-mon[29156]: pgmap v9351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16539.570793 secs 2024-04-26T22:54:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15842.541641 secs 2024-04-26T22:54:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:05 smithi189 ceph-mon[32756]: pgmap v9352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:05 smithi156 ceph-mon[32679]: pgmap v9352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:05 smithi092 ceph-mon[29156]: pgmap v9352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:07 smithi189 ceph-mon[32756]: pgmap v9353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:07 smithi156 ceph-mon[32679]: pgmap v9353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:07 smithi092 ceph-mon[29156]: pgmap v9353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16544.570936 secs 2024-04-26T22:54:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15847.541756 secs 2024-04-26T22:54:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16544.570936 secs 2024-04-26T22:54:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15847.541756 secs 2024-04-26T22:54:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16544.570936 secs 2024-04-26T22:54:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15847.541756 secs 2024-04-26T22:54:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:09 smithi189 ceph-mon[32756]: pgmap v9354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:54:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:09 smithi156 ceph-mon[32679]: pgmap v9354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:54:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:09 smithi092 ceph-mon[29156]: pgmap v9354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-26T22:54:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:11 smithi189 ceph-mon[32756]: pgmap v9355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:11 smithi156 ceph-mon[32679]: pgmap v9355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:11 smithi092 ceph-mon[29156]: pgmap v9355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:13 smithi189 ceph-mon[32756]: pgmap v9356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:54:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16549.571061 secs 2024-04-26T22:54:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15852.541866 secs 2024-04-26T22:54:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:13 smithi156 ceph-mon[32679]: pgmap v9356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:54:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16549.571061 secs 2024-04-26T22:54:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15852.541866 secs 2024-04-26T22:54:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:13 smithi092 ceph-mon[29156]: pgmap v9356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T22:54:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16549.571061 secs 2024-04-26T22:54:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15852.541866 secs 2024-04-26T22:54:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:15 smithi189 ceph-mon[32756]: pgmap v9357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:15 smithi156 ceph-mon[32679]: pgmap v9357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:15 smithi092 ceph-mon[29156]: pgmap v9357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T22:54:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:17 smithi189 ceph-mon[32756]: pgmap v9358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:17 smithi156 ceph-mon[32679]: pgmap v9358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:17 smithi092 ceph-mon[29156]: pgmap v9358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16554.571140 secs 2024-04-26T22:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15857.541978 secs 2024-04-26T22:54:19.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16554.571140 secs 2024-04-26T22:54:19.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15857.541978 secs 2024-04-26T22:54:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16554.571140 secs 2024-04-26T22:54:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15857.541978 secs 2024-04-26T22:54:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:19 smithi189 ceph-mon[32756]: pgmap v9359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:19 smithi156 ceph-mon[32679]: pgmap v9359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:19 smithi092 ceph-mon[29156]: pgmap v9359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:21 smithi189 ceph-mon[32756]: pgmap v9360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:21 smithi156 ceph-mon[32679]: pgmap v9360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:21 smithi092 ceph-mon[29156]: pgmap v9360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:23 smithi189 ceph-mon[32756]: pgmap v9361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16559.571267 secs 2024-04-26T22:54:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15862.542063 secs 2024-04-26T22:54:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:23 smithi156 ceph-mon[32679]: pgmap v9361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16559.571267 secs 2024-04-26T22:54:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15862.542063 secs 2024-04-26T22:54:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:23 smithi092 ceph-mon[29156]: pgmap v9361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16559.571267 secs 2024-04-26T22:54:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15862.542063 secs 2024-04-26T22:54:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:25 smithi189 ceph-mon[32756]: pgmap v9362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:25 smithi156 ceph-mon[32679]: pgmap v9362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:25 smithi092 ceph-mon[29156]: pgmap v9362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:27 smithi189 ceph-mon[32756]: pgmap v9363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:27 smithi156 ceph-mon[32679]: pgmap v9363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:27 smithi092 ceph-mon[29156]: pgmap v9363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16564.571348 secs 2024-04-26T22:54:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15867.542185 secs 2024-04-26T22:54:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16564.571348 secs 2024-04-26T22:54:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15867.542185 secs 2024-04-26T22:54:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16564.571348 secs 2024-04-26T22:54:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15867.542185 secs 2024-04-26T22:54:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:29 smithi189 ceph-mon[32756]: pgmap v9364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:29 smithi156 ceph-mon[32679]: pgmap v9364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:29 smithi092 ceph-mon[29156]: pgmap v9364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:31 smithi092 ceph-mon[29156]: pgmap v9365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:31 smithi156 ceph-mon[32679]: pgmap v9365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:31 smithi189 ceph-mon[32756]: pgmap v9365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:33 smithi156 ceph-mon[32679]: pgmap v9366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16569.571489 secs 2024-04-26T22:54:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15872.542329 secs 2024-04-26T22:54:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:33 smithi092 ceph-mon[29156]: pgmap v9366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16569.571489 secs 2024-04-26T22:54:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15872.542329 secs 2024-04-26T22:54:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:33 smithi189 ceph-mon[32756]: pgmap v9366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16569.571489 secs 2024-04-26T22:54:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15872.542329 secs 2024-04-26T22:54:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:35 smithi156 ceph-mon[32679]: pgmap v9367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:35 smithi092 ceph-mon[29156]: pgmap v9367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:35 smithi189 ceph-mon[32756]: pgmap v9367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:37 smithi156 ceph-mon[32679]: pgmap v9368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:37 smithi092 ceph-mon[29156]: pgmap v9368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:54:38.256+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:54:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:54:38.256+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:54:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:54:38.257+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:54:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:54:38.257+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 130 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:54:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:37 smithi189 ceph-mon[32756]: pgmap v9368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16574.571631 secs 2024-04-26T22:54:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15877.542441 secs 2024-04-26T22:54:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16574.571631 secs 2024-04-26T22:54:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15877.542441 secs 2024-04-26T22:54:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16574.571631 secs 2024-04-26T22:54:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15877.542441 secs 2024-04-26T22:54:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:39 smithi156 ceph-mon[32679]: pgmap v9369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:39 smithi092 ceph-mon[29156]: pgmap v9369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:39 smithi189 ceph-mon[32756]: pgmap v9369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:41 smithi156 ceph-mon[32679]: pgmap v9370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:41 smithi092 ceph-mon[29156]: pgmap v9370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:41 smithi189 ceph-mon[32756]: pgmap v9370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:43 smithi156 ceph-mon[32679]: pgmap v9371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16579.571779 secs 2024-04-26T22:54:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15882.542531 secs 2024-04-26T22:54:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:43 smithi092 ceph-mon[29156]: pgmap v9371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16579.571779 secs 2024-04-26T22:54:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15882.542531 secs 2024-04-26T22:54:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:43 smithi189 ceph-mon[32756]: pgmap v9371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16579.571779 secs 2024-04-26T22:54:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15882.542531 secs 2024-04-26T22:54:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:45 smithi156 ceph-mon[32679]: pgmap v9372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:45 smithi092 ceph-mon[29156]: pgmap v9372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:45 smithi189 ceph-mon[32756]: pgmap v9372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:47 smithi156 ceph-mon[32679]: pgmap v9373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:47 smithi092 ceph-mon[29156]: pgmap v9373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:47 smithi189 ceph-mon[32756]: pgmap v9373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16584.571903 secs 2024-04-26T22:54:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15887.542617 secs 2024-04-26T22:54:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16584.571903 secs 2024-04-26T22:54:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15887.542617 secs 2024-04-26T22:54:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16584.571903 secs 2024-04-26T22:54:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15887.542617 secs 2024-04-26T22:54:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:49 smithi156 ceph-mon[32679]: pgmap v9374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:49 smithi092 ceph-mon[29156]: pgmap v9374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:50.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:49 smithi189 ceph-mon[32756]: pgmap v9374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:51 smithi156 ceph-mon[32679]: pgmap v9375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:51 smithi092 ceph-mon[29156]: pgmap v9375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:51 smithi189 ceph-mon[32756]: pgmap v9375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:53 smithi092 ceph-mon[29156]: pgmap v9376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16589.572022 secs 2024-04-26T22:54:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15892.542705 secs 2024-04-26T22:54:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:53 smithi189 ceph-mon[32756]: pgmap v9376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16589.572022 secs 2024-04-26T22:54:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15892.542705 secs 2024-04-26T22:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:53 smithi156 ceph-mon[32679]: pgmap v9376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16589.572022 secs 2024-04-26T22:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15892.542705 secs 2024-04-26T22:54:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:55 smithi092 ceph-mon[29156]: pgmap v9377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:55 smithi189 ceph-mon[32756]: pgmap v9377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:55 smithi156 ceph-mon[32679]: pgmap v9377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:54:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:57 smithi092 ceph-mon[29156]: pgmap v9378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:57 smithi189 ceph-mon[32756]: pgmap v9378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:57 smithi156 ceph-mon[32679]: pgmap v9378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:54:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16594.572139 secs 2024-04-26T22:54:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15897.542830 secs 2024-04-26T22:54:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16594.572139 secs 2024-04-26T22:54:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15897.542830 secs 2024-04-26T22:54:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16594.572139 secs 2024-04-26T22:54:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15897.542830 secs 2024-04-26T22:55:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:54:59 smithi092 ceph-mon[29156]: pgmap v9379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:54:59 smithi189 ceph-mon[32756]: pgmap v9379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:54:59 smithi156 ceph-mon[32679]: pgmap v9379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:01 smithi092 ceph-mon[29156]: pgmap v9380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:55:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:01 smithi189 ceph-mon[32756]: pgmap v9380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:55:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:01 smithi156 ceph-mon[32679]: pgmap v9380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:55:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: pgmap v9381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16599.572259 secs 2024-04-26T22:55:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15902.542942 secs 2024-04-26T22:55:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: pgmap v9381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16599.572259 secs 2024-04-26T22:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15902.542942 secs 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: pgmap v9381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16599.572259 secs 2024-04-26T22:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15902.542942 secs 2024-04-26T22:55:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:04 smithi092 ceph-mon[29156]: pgmap v9382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:55:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:04 smithi092 ceph-mon[29156]: pgmap v9383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:55:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:04 smithi189 ceph-mon[32756]: pgmap v9382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:55:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:04 smithi189 ceph-mon[32756]: pgmap v9383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:55:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:04 smithi156 ceph-mon[32679]: pgmap v9382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T22:55:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:04 smithi156 ceph-mon[32679]: pgmap v9383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T22:55:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:06 smithi092 ceph-mon[29156]: pgmap v9384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:06 smithi189 ceph-mon[32756]: pgmap v9384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:06 smithi156 ceph-mon[32679]: pgmap v9384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:08 smithi092 ceph-mon[29156]: pgmap v9385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16604.572360 secs 2024-04-26T22:55:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15907.543034 secs 2024-04-26T22:55:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:08 smithi189 ceph-mon[32756]: pgmap v9385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16604.572360 secs 2024-04-26T22:55:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15907.543034 secs 2024-04-26T22:55:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:08 smithi156 ceph-mon[32679]: pgmap v9385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T22:55:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16604.572360 secs 2024-04-26T22:55:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15907.543034 secs 2024-04-26T22:55:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:10 smithi092 ceph-mon[29156]: pgmap v9386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:10 smithi189 ceph-mon[32756]: pgmap v9386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:10 smithi156 ceph-mon[32679]: pgmap v9386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:12 smithi092 ceph-mon[29156]: pgmap v9387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:12 smithi189 ceph-mon[32756]: pgmap v9387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:12 smithi156 ceph-mon[32679]: pgmap v9387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:55:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16609.572504 secs 2024-04-26T22:55:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15912.543164 secs 2024-04-26T22:55:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16609.572504 secs 2024-04-26T22:55:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15912.543164 secs 2024-04-26T22:55:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16609.572504 secs 2024-04-26T22:55:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15912.543164 secs 2024-04-26T22:55:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:14 smithi092 ceph-mon[29156]: pgmap v9388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:55:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:14 smithi156 ceph-mon[32679]: pgmap v9388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:55:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:14 smithi189 ceph-mon[32756]: pgmap v9388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:55:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:16 smithi092 ceph-mon[29156]: pgmap v9389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:16 smithi189 ceph-mon[32756]: pgmap v9389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:16 smithi156 ceph-mon[32679]: pgmap v9389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:18 smithi092 ceph-mon[29156]: pgmap v9390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16614.572646 secs 2024-04-26T22:55:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15917.543314 secs 2024-04-26T22:55:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:18 smithi189 ceph-mon[32756]: pgmap v9390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16614.572646 secs 2024-04-26T22:55:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15917.543314 secs 2024-04-26T22:55:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:18 smithi156 ceph-mon[32679]: pgmap v9390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16614.572646 secs 2024-04-26T22:55:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15917.543314 secs 2024-04-26T22:55:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:20 smithi092 ceph-mon[29156]: pgmap v9391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:20 smithi189 ceph-mon[32756]: pgmap v9391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:20 smithi156 ceph-mon[32679]: pgmap v9391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:22 smithi189 ceph-mon[32756]: pgmap v9392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:22 smithi156 ceph-mon[32679]: pgmap v9392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:22 smithi092 ceph-mon[29156]: pgmap v9392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16619.572778 secs 2024-04-26T22:55:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15922.543410 secs 2024-04-26T22:55:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16619.572778 secs 2024-04-26T22:55:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15922.543410 secs 2024-04-26T22:55:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16619.572778 secs 2024-04-26T22:55:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15922.543410 secs 2024-04-26T22:55:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:25 smithi189 ceph-mon[32756]: pgmap v9393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:25 smithi156 ceph-mon[32679]: pgmap v9393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:25 smithi092 ceph-mon[29156]: pgmap v9393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:27 smithi189 ceph-mon[32756]: pgmap v9394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:27 smithi156 ceph-mon[32679]: pgmap v9394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:27 smithi092 ceph-mon[29156]: pgmap v9394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:29 smithi189 ceph-mon[32756]: pgmap v9395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16624.572864 secs 2024-04-26T22:55:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15927.543531 secs 2024-04-26T22:55:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:29 smithi156 ceph-mon[32679]: pgmap v9395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16624.572864 secs 2024-04-26T22:55:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15927.543531 secs 2024-04-26T22:55:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:29 smithi092 ceph-mon[29156]: pgmap v9395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16624.572864 secs 2024-04-26T22:55:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15927.543531 secs 2024-04-26T22:55:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:31 smithi189 ceph-mon[32756]: pgmap v9396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:31 smithi156 ceph-mon[32679]: pgmap v9396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:31 smithi092 ceph-mon[29156]: pgmap v9396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:33 smithi189 ceph-mon[32756]: pgmap v9397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:33 smithi156 ceph-mon[32679]: pgmap v9397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:33 smithi092 ceph-mon[29156]: pgmap v9397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16629.572941 secs 2024-04-26T22:55:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15932.543670 secs 2024-04-26T22:55:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16629.572941 secs 2024-04-26T22:55:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15932.543670 secs 2024-04-26T22:55:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16629.572941 secs 2024-04-26T22:55:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15932.543670 secs 2024-04-26T22:55:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:35 smithi189 ceph-mon[32756]: pgmap v9398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:35 smithi156 ceph-mon[32679]: pgmap v9398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:35 smithi092 ceph-mon[29156]: pgmap v9398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:37 smithi189 ceph-mon[32756]: pgmap v9399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:37 smithi156 ceph-mon[32679]: pgmap v9399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:37 smithi092 ceph-mon[29156]: pgmap v9399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:39 smithi189 ceph-mon[32756]: pgmap v9400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16634.573093 secs 2024-04-26T22:55:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15937.543746 secs 2024-04-26T22:55:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:39 smithi156 ceph-mon[32679]: pgmap v9400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16634.573093 secs 2024-04-26T22:55:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15937.543746 secs 2024-04-26T22:55:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:39 smithi092 ceph-mon[29156]: pgmap v9400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16634.573093 secs 2024-04-26T22:55:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15937.543746 secs 2024-04-26T22:55:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:41 smithi189 ceph-mon[32756]: pgmap v9401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:41 smithi156 ceph-mon[32679]: pgmap v9401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:41 smithi092 ceph-mon[29156]: pgmap v9401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:43 smithi189 ceph-mon[32756]: pgmap v9402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:43 smithi156 ceph-mon[32679]: pgmap v9402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:43 smithi092 ceph-mon[29156]: pgmap v9402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16639.573219 secs 2024-04-26T22:55:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15942.543847 secs 2024-04-26T22:55:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16639.573219 secs 2024-04-26T22:55:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15942.543847 secs 2024-04-26T22:55:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16639.573219 secs 2024-04-26T22:55:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15942.543847 secs 2024-04-26T22:55:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:45 smithi156 ceph-mon[32679]: pgmap v9403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:45 smithi189 ceph-mon[32756]: pgmap v9403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:45 smithi092 ceph-mon[29156]: pgmap v9403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:47 smithi189 ceph-mon[32756]: pgmap v9404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:47 smithi156 ceph-mon[32679]: pgmap v9404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:47 smithi092 ceph-mon[29156]: pgmap v9404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:49 smithi189 ceph-mon[32756]: pgmap v9405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16644.573337 secs 2024-04-26T22:55:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15947.543986 secs 2024-04-26T22:55:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:49 smithi156 ceph-mon[32679]: pgmap v9405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16644.573337 secs 2024-04-26T22:55:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15947.543986 secs 2024-04-26T22:55:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:49 smithi092 ceph-mon[29156]: pgmap v9405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16644.573337 secs 2024-04-26T22:55:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15947.543986 secs 2024-04-26T22:55:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:51 smithi189 ceph-mon[32756]: pgmap v9406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:51 smithi156 ceph-mon[32679]: pgmap v9406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:51 smithi092 ceph-mon[29156]: pgmap v9406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:53 smithi189 ceph-mon[32756]: pgmap v9407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:53 smithi156 ceph-mon[32679]: pgmap v9407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:53 smithi092 ceph-mon[29156]: pgmap v9407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16649.573470 secs 2024-04-26T22:55:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15952.544109 secs 2024-04-26T22:55:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16649.573470 secs 2024-04-26T22:55:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15952.544109 secs 2024-04-26T22:55:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16649.573470 secs 2024-04-26T22:55:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15952.544109 secs 2024-04-26T22:55:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:55 smithi189 ceph-mon[32756]: pgmap v9408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:55 smithi156 ceph-mon[32679]: pgmap v9408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:55 smithi092 ceph-mon[29156]: pgmap v9408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:57 smithi189 ceph-mon[32756]: pgmap v9409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:57 smithi156 ceph-mon[32679]: pgmap v9409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:57 smithi092 ceph-mon[29156]: pgmap v9409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:55:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:59 smithi189 ceph-mon[32756]: pgmap v9410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16654.573601 secs 2024-04-26T22:55:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:55:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15957.544223 secs 2024-04-26T22:55:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:59 smithi156 ceph-mon[32679]: pgmap v9410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16654.573601 secs 2024-04-26T22:55:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:55:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15957.544223 secs 2024-04-26T22:55:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:59 smithi092 ceph-mon[29156]: pgmap v9410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:55:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16654.573601 secs 2024-04-26T22:55:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:55:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15957.544223 secs 2024-04-26T22:56:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:01 smithi189 ceph-mon[32756]: pgmap v9411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:01 smithi156 ceph-mon[32679]: pgmap v9411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:01 smithi092 ceph-mon[29156]: pgmap v9411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:03 smithi189 ceph-mon[32756]: pgmap v9412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:03 smithi156 ceph-mon[32679]: pgmap v9412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:03 smithi092 ceph-mon[29156]: pgmap v9412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16659.573691 secs 2024-04-26T22:56:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15962.544309 secs 2024-04-26T22:56:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16659.573691 secs 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15962.544309 secs 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16659.573691 secs 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15962.544309 secs 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:05 smithi189 ceph-mon[32756]: pgmap v9413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:05 smithi156 ceph-mon[32679]: pgmap v9413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:05 smithi092 ceph-mon[29156]: pgmap v9413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: pgmap v9414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: pgmap v9414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: pgmap v9414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:56:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:56:07.905 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:56:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:56:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:56:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:56:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: pgmap v9415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:07 smithi156 ceph-mon[32679]: pgmap v9416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: pgmap v9415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:07 smithi092 ceph-mon[29156]: pgmap v9416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: pgmap v9415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:07 smithi189 ceph-mon[32756]: pgmap v9416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16664.573812 secs 2024-04-26T22:56:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15967.544431 secs 2024-04-26T22:56:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:09 smithi156 ceph-mon[32679]: pgmap v9417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16664.573812 secs 2024-04-26T22:56:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15967.544431 secs 2024-04-26T22:56:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:09 smithi092 ceph-mon[29156]: pgmap v9417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16664.573812 secs 2024-04-26T22:56:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15967.544431 secs 2024-04-26T22:56:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:09 smithi189 ceph-mon[32756]: pgmap v9417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:11 smithi189 ceph-mon[32756]: pgmap v9418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:11 smithi156 ceph-mon[32679]: pgmap v9418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:11 smithi092 ceph-mon[29156]: pgmap v9418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:13 smithi189 ceph-mon[32756]: pgmap v9419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16669.573888 secs 2024-04-26T22:56:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15972.544547 secs 2024-04-26T22:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:13 smithi156 ceph-mon[32679]: pgmap v9419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16669.573888 secs 2024-04-26T22:56:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15972.544547 secs 2024-04-26T22:56:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:13 smithi092 ceph-mon[29156]: pgmap v9419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16669.573888 secs 2024-04-26T22:56:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15972.544547 secs 2024-04-26T22:56:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:15 smithi189 ceph-mon[32756]: pgmap v9420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:15 smithi156 ceph-mon[32679]: pgmap v9420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:15 smithi092 ceph-mon[29156]: pgmap v9420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T22:56:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:17 smithi189 ceph-mon[32756]: pgmap v9421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:56:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:17 smithi156 ceph-mon[32679]: pgmap v9421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:56:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:17 smithi092 ceph-mon[29156]: pgmap v9421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:56:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16674.573964 secs 2024-04-26T22:56:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15977.544628 secs 2024-04-26T22:56:19.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16674.573964 secs 2024-04-26T22:56:19.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15977.544628 secs 2024-04-26T22:56:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16674.573964 secs 2024-04-26T22:56:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15977.544628 secs 2024-04-26T22:56:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:19 smithi189 ceph-mon[32756]: pgmap v9422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:19 smithi156 ceph-mon[32679]: pgmap v9422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:19 smithi092 ceph-mon[29156]: pgmap v9422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:21 smithi189 ceph-mon[32756]: pgmap v9423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:21 smithi156 ceph-mon[32679]: pgmap v9423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:21 smithi092 ceph-mon[29156]: pgmap v9423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:23 smithi189 ceph-mon[32756]: pgmap v9424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16679.574039 secs 2024-04-26T22:56:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15982.544742 secs 2024-04-26T22:56:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:23 smithi156 ceph-mon[32679]: pgmap v9424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16679.574039 secs 2024-04-26T22:56:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15982.544742 secs 2024-04-26T22:56:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:23 smithi092 ceph-mon[29156]: pgmap v9424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16679.574039 secs 2024-04-26T22:56:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15982.544742 secs 2024-04-26T22:56:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:25 smithi189 ceph-mon[32756]: pgmap v9425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:25 smithi156 ceph-mon[32679]: pgmap v9425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:25 smithi092 ceph-mon[29156]: pgmap v9425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:27 smithi189 ceph-mon[32756]: pgmap v9426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:27 smithi156 ceph-mon[32679]: pgmap v9426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:27 smithi092 ceph-mon[29156]: pgmap v9426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16684.574102 secs 2024-04-26T22:56:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15987.544872 secs 2024-04-26T22:56:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16684.574102 secs 2024-04-26T22:56:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15987.544872 secs 2024-04-26T22:56:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16684.574102 secs 2024-04-26T22:56:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15987.544872 secs 2024-04-26T22:56:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:29 smithi189 ceph-mon[32756]: pgmap v9427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:29 smithi156 ceph-mon[32679]: pgmap v9427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:29 smithi092 ceph-mon[29156]: pgmap v9427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:31 smithi156 ceph-mon[32679]: pgmap v9428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:31 smithi092 ceph-mon[29156]: pgmap v9428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:31 smithi189 ceph-mon[32756]: pgmap v9428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:33 smithi156 ceph-mon[32679]: pgmap v9429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16689.574225 secs 2024-04-26T22:56:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15992.545013 secs 2024-04-26T22:56:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:33 smithi092 ceph-mon[29156]: pgmap v9429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16689.574225 secs 2024-04-26T22:56:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15992.545013 secs 2024-04-26T22:56:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:33 smithi189 ceph-mon[32756]: pgmap v9429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16689.574225 secs 2024-04-26T22:56:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15992.545013 secs 2024-04-26T22:56:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:35 smithi156 ceph-mon[32679]: pgmap v9430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:35 smithi092 ceph-mon[29156]: pgmap v9430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:35 smithi189 ceph-mon[32756]: pgmap v9430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:37 smithi156 ceph-mon[32679]: pgmap v9431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:37 smithi092 ceph-mon[29156]: pgmap v9431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:37 smithi189 ceph-mon[32756]: pgmap v9431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16694.574301 secs 2024-04-26T22:56:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 15997.545093 secs 2024-04-26T22:56:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16694.574301 secs 2024-04-26T22:56:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 15997.545093 secs 2024-04-26T22:56:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16694.574301 secs 2024-04-26T22:56:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 15997.545093 secs 2024-04-26T22:56:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:39 smithi156 ceph-mon[32679]: pgmap v9432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:39 smithi092 ceph-mon[29156]: pgmap v9432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:39 smithi189 ceph-mon[32756]: pgmap v9432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:41 smithi156 ceph-mon[32679]: pgmap v9433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:41 smithi092 ceph-mon[29156]: pgmap v9433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:41 smithi189 ceph-mon[32756]: pgmap v9433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:43 smithi156 ceph-mon[32679]: pgmap v9434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16699.574434 secs 2024-04-26T22:56:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16002.545210 secs 2024-04-26T22:56:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:43 smithi092 ceph-mon[29156]: pgmap v9434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16699.574434 secs 2024-04-26T22:56:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16002.545210 secs 2024-04-26T22:56:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:43 smithi189 ceph-mon[32756]: pgmap v9434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16699.574434 secs 2024-04-26T22:56:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16002.545210 secs 2024-04-26T22:56:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:45 smithi156 ceph-mon[32679]: pgmap v9435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:45 smithi092 ceph-mon[29156]: pgmap v9435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:45 smithi189 ceph-mon[32756]: pgmap v9435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:47 smithi156 ceph-mon[32679]: pgmap v9436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:47 smithi092 ceph-mon[29156]: pgmap v9436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:47 smithi189 ceph-mon[32756]: pgmap v9436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16704.574569 secs 2024-04-26T22:56:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16007.545351 secs 2024-04-26T22:56:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16704.574569 secs 2024-04-26T22:56:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16007.545351 secs 2024-04-26T22:56:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16704.574569 secs 2024-04-26T22:56:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16007.545351 secs 2024-04-26T22:56:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:49 smithi156 ceph-mon[32679]: pgmap v9437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:49 smithi092 ceph-mon[29156]: pgmap v9437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:49 smithi189 ceph-mon[32756]: pgmap v9437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:51 smithi156 ceph-mon[32679]: pgmap v9438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:52.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:51 smithi189 ceph-mon[32756]: pgmap v9438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:51 smithi092 ceph-mon[29156]: pgmap v9438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:53 smithi156 ceph-mon[32679]: pgmap v9439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16709.574691 secs 2024-04-26T22:56:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16012.545436 secs 2024-04-26T22:56:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:53 smithi092 ceph-mon[29156]: pgmap v9439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16709.574691 secs 2024-04-26T22:56:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16012.545436 secs 2024-04-26T22:56:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:53 smithi189 ceph-mon[32756]: pgmap v9439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16709.574691 secs 2024-04-26T22:56:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16012.545436 secs 2024-04-26T22:56:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:55 smithi092 ceph-mon[29156]: pgmap v9440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:55 smithi189 ceph-mon[32756]: pgmap v9440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:55 smithi156 ceph-mon[32679]: pgmap v9440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:56:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:57 smithi092 ceph-mon[29156]: pgmap v9441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:57 smithi189 ceph-mon[32756]: pgmap v9441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:57 smithi156 ceph-mon[32679]: pgmap v9441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:56:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16714.574861 secs 2024-04-26T22:56:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16017.545549 secs 2024-04-26T22:56:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16714.574861 secs 2024-04-26T22:56:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16017.545549 secs 2024-04-26T22:56:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16714.574861 secs 2024-04-26T22:56:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16017.545549 secs 2024-04-26T22:57:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:56:59 smithi092 ceph-mon[29156]: pgmap v9442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:56:59 smithi189 ceph-mon[32756]: pgmap v9442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:56:59 smithi156 ceph-mon[32679]: pgmap v9442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:01 smithi092 ceph-mon[29156]: pgmap v9443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:01 smithi189 ceph-mon[32756]: pgmap v9443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:01 smithi156 ceph-mon[32679]: pgmap v9443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:03 smithi092 ceph-mon[29156]: pgmap v9444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16719.574977 secs 2024-04-26T22:57:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16022.545624 secs 2024-04-26T22:57:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:03 smithi189 ceph-mon[32756]: pgmap v9444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16719.574977 secs 2024-04-26T22:57:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16022.545624 secs 2024-04-26T22:57:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:03 smithi156 ceph-mon[32679]: pgmap v9444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16719.574977 secs 2024-04-26T22:57:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16022.545624 secs 2024-04-26T22:57:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:05 smithi092 ceph-mon[29156]: pgmap v9445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:05 smithi189 ceph-mon[32756]: pgmap v9445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:05 smithi156 ceph-mon[32679]: pgmap v9445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:57:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:07 smithi092 ceph-mon[29156]: pgmap v9446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:57:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:07 smithi189 ceph-mon[32756]: pgmap v9446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:57:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:07 smithi156 ceph-mon[32679]: pgmap v9446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:57:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:57:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:57:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:08 smithi092 ceph-mon[29156]: pgmap v9447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:57:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:08 smithi092 ceph-mon[29156]: pgmap v9448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:57:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16724.575096 secs 2024-04-26T22:57:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:08 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 16027.545739 secs 2024-04-26T22:57:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:08 smithi092 ceph-mon[29156]: slow request 5764.956894 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:08 smithi189 ceph-mon[32756]: pgmap v9447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:08 smithi189 ceph-mon[32756]: pgmap v9448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16724.575096 secs 2024-04-26T22:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:08 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 16027.545739 secs 2024-04-26T22:57:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:08 smithi189 ceph-mon[32756]: slow request 5764.956894 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:08 smithi156 ceph-mon[32679]: pgmap v9447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:57:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:08 smithi156 ceph-mon[32679]: pgmap v9448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:57:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16724.575096 secs 2024-04-26T22:57:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:08 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 16027.545739 secs 2024-04-26T22:57:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:08 smithi156 ceph-mon[32679]: slow request 5764.956894 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:10 smithi092 ceph-mon[29156]: pgmap v9449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:10 smithi189 ceph-mon[32756]: pgmap v9449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:10 smithi156 ceph-mon[32679]: pgmap v9449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:12 smithi092 ceph-mon[29156]: pgmap v9450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:12 smithi189 ceph-mon[32756]: pgmap v9450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:12 smithi156 ceph-mon[32679]: pgmap v9450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16729.575211 secs 2024-04-26T22:57:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16032.545861 secs 2024-04-26T22:57:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16729.575211 secs 2024-04-26T22:57:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16032.545861 secs 2024-04-26T22:57:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16729.575211 secs 2024-04-26T22:57:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16032.545861 secs 2024-04-26T22:57:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:14 smithi092 ceph-mon[29156]: pgmap v9451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:14 smithi156 ceph-mon[32679]: pgmap v9451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:14 smithi189 ceph-mon[32756]: pgmap v9451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:16 smithi092 ceph-mon[29156]: pgmap v9452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:16 smithi189 ceph-mon[32756]: pgmap v9452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:16 smithi156 ceph-mon[32679]: pgmap v9452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:57:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:18 smithi092 ceph-mon[29156]: pgmap v9453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:57:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16734.575302 secs 2024-04-26T22:57:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16037.545979 secs 2024-04-26T22:57:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:18 smithi189 ceph-mon[32756]: pgmap v9453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:57:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16734.575302 secs 2024-04-26T22:57:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16037.545979 secs 2024-04-26T22:57:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:18 smithi156 ceph-mon[32679]: pgmap v9453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:57:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16734.575302 secs 2024-04-26T22:57:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16037.545979 secs 2024-04-26T22:57:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:20 smithi092 ceph-mon[29156]: pgmap v9454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:20 smithi189 ceph-mon[32756]: pgmap v9454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:20 smithi156 ceph-mon[32679]: pgmap v9454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:23.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:22 smithi092 ceph-mon[29156]: pgmap v9455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:22 smithi189 ceph-mon[32756]: pgmap v9455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:22 smithi156 ceph-mon[32679]: pgmap v9455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16739.575425 secs 2024-04-26T22:57:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16042.546104 secs 2024-04-26T22:57:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16739.575425 secs 2024-04-26T22:57:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16042.546104 secs 2024-04-26T22:57:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16739.575425 secs 2024-04-26T22:57:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16042.546104 secs 2024-04-26T22:57:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:25 smithi189 ceph-mon[32756]: pgmap v9456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:25 smithi156 ceph-mon[32679]: pgmap v9456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:25 smithi092 ceph-mon[29156]: pgmap v9456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:27 smithi189 ceph-mon[32756]: pgmap v9457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:27 smithi156 ceph-mon[32679]: pgmap v9457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:27 smithi092 ceph-mon[29156]: pgmap v9457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:29 smithi189 ceph-mon[32756]: pgmap v9458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16744.575543 secs 2024-04-26T22:57:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16047.546222 secs 2024-04-26T22:57:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:29 smithi156 ceph-mon[32679]: pgmap v9458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16744.575543 secs 2024-04-26T22:57:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16047.546222 secs 2024-04-26T22:57:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:29 smithi092 ceph-mon[29156]: pgmap v9458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16744.575543 secs 2024-04-26T22:57:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16047.546222 secs 2024-04-26T22:57:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:31 smithi189 ceph-mon[32756]: pgmap v9459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:31 smithi156 ceph-mon[32679]: pgmap v9459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:31 smithi092 ceph-mon[29156]: pgmap v9459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:33 smithi189 ceph-mon[32756]: pgmap v9460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:33 smithi156 ceph-mon[32679]: pgmap v9460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:33 smithi092 ceph-mon[29156]: pgmap v9460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16749.575663 secs 2024-04-26T22:57:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16052.546340 secs 2024-04-26T22:57:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16749.575663 secs 2024-04-26T22:57:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16052.546340 secs 2024-04-26T22:57:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16749.575663 secs 2024-04-26T22:57:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16052.546340 secs 2024-04-26T22:57:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:35 smithi189 ceph-mon[32756]: pgmap v9461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:35 smithi156 ceph-mon[32679]: pgmap v9461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:35 smithi092 ceph-mon[29156]: pgmap v9461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:37 smithi189 ceph-mon[32756]: pgmap v9462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:37 smithi156 ceph-mon[32679]: pgmap v9462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:37 smithi092 ceph-mon[29156]: pgmap v9462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:57:38.282+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:57:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:57:38.282+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:57:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:57:38.282+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:57:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:57:38.282+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 131 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:57:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:39 smithi189 ceph-mon[32756]: pgmap v9463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16754.575807 secs 2024-04-26T22:57:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:39 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 16057.546485 secs 2024-04-26T22:57:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:39 smithi189 ceph-mon[32756]: slow request 2884.203285 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:39 smithi156 ceph-mon[32679]: pgmap v9463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16754.575807 secs 2024-04-26T22:57:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:39 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 16057.546485 secs 2024-04-26T22:57:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:39 smithi156 ceph-mon[32679]: slow request 2884.203285 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:39 smithi092 ceph-mon[29156]: pgmap v9463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16754.575807 secs 2024-04-26T22:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:39 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 16057.546485 secs 2024-04-26T22:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:39 smithi092 ceph-mon[29156]: slow request 2884.203285 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T22:57:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:41 smithi189 ceph-mon[32756]: pgmap v9464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:41 smithi156 ceph-mon[32679]: pgmap v9464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:41 smithi092 ceph-mon[29156]: pgmap v9464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:43 smithi189 ceph-mon[32756]: pgmap v9465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:43 smithi156 ceph-mon[32679]: pgmap v9465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:43 smithi092 ceph-mon[29156]: pgmap v9465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16759.575875 secs 2024-04-26T22:57:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16062.546608 secs 2024-04-26T22:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16759.575875 secs 2024-04-26T22:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16062.546608 secs 2024-04-26T22:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16759.575875 secs 2024-04-26T22:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16062.546608 secs 2024-04-26T22:57:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:45 smithi156 ceph-mon[32679]: pgmap v9466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:45 smithi189 ceph-mon[32756]: pgmap v9466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:45 smithi092 ceph-mon[29156]: pgmap v9466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:47 smithi189 ceph-mon[32756]: pgmap v9467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:47 smithi156 ceph-mon[32679]: pgmap v9467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:47 smithi092 ceph-mon[29156]: pgmap v9467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:49 smithi189 ceph-mon[32756]: pgmap v9468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16764.576017 secs 2024-04-26T22:57:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16067.546713 secs 2024-04-26T22:57:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:49 smithi156 ceph-mon[32679]: pgmap v9468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16764.576017 secs 2024-04-26T22:57:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16067.546713 secs 2024-04-26T22:57:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:49 smithi092 ceph-mon[29156]: pgmap v9468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16764.576017 secs 2024-04-26T22:57:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16067.546713 secs 2024-04-26T22:57:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:51 smithi189 ceph-mon[32756]: pgmap v9469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:51 smithi156 ceph-mon[32679]: pgmap v9469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:51 smithi092 ceph-mon[29156]: pgmap v9469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:53 smithi189 ceph-mon[32756]: pgmap v9470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:53 smithi156 ceph-mon[32679]: pgmap v9470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:53 smithi092 ceph-mon[29156]: pgmap v9470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16769.576094 secs 2024-04-26T22:57:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16072.546859 secs 2024-04-26T22:57:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16769.576094 secs 2024-04-26T22:57:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16072.546859 secs 2024-04-26T22:57:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16769.576094 secs 2024-04-26T22:57:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16072.546859 secs 2024-04-26T22:57:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:55 smithi189 ceph-mon[32756]: pgmap v9471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:55 smithi156 ceph-mon[32679]: pgmap v9471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:55 smithi092 ceph-mon[29156]: pgmap v9471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:57:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:57 smithi189 ceph-mon[32756]: pgmap v9472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:57 smithi156 ceph-mon[32679]: pgmap v9472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:57 smithi092 ceph-mon[29156]: pgmap v9472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:59 smithi189 ceph-mon[32756]: pgmap v9473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16774.576208 secs 2024-04-26T22:57:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:57:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16077.546982 secs 2024-04-26T22:57:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:59 smithi156 ceph-mon[32679]: pgmap v9473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16774.576208 secs 2024-04-26T22:57:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:57:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16077.546982 secs 2024-04-26T22:57:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:59 smithi092 ceph-mon[29156]: pgmap v9473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:57:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16774.576208 secs 2024-04-26T22:57:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:57:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16077.546982 secs 2024-04-26T22:58:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:01 smithi189 ceph-mon[32756]: pgmap v9474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:01 smithi156 ceph-mon[32679]: pgmap v9474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:01 smithi092 ceph-mon[29156]: pgmap v9474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:03 smithi189 ceph-mon[32756]: pgmap v9475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:03 smithi156 ceph-mon[32679]: pgmap v9475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:03 smithi092 ceph-mon[29156]: pgmap v9475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16779.576288 secs 2024-04-26T22:58:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16082.547093 secs 2024-04-26T22:58:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16779.576288 secs 2024-04-26T22:58:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16082.547093 secs 2024-04-26T22:58:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16779.576288 secs 2024-04-26T22:58:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16082.547093 secs 2024-04-26T22:58:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:05 smithi189 ceph-mon[32756]: pgmap v9476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:05 smithi156 ceph-mon[32679]: pgmap v9476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:05 smithi092 ceph-mon[29156]: pgmap v9476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:07 smithi189 ceph-mon[32756]: pgmap v9477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:07 smithi156 ceph-mon[32679]: pgmap v9477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:07 smithi092 ceph-mon[29156]: pgmap v9477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:58:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: pgmap v9478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16784.576433 secs 2024-04-26T22:58:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16087.547245 secs 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: pgmap v9478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16784.576433 secs 2024-04-26T22:58:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16087.547245 secs 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: pgmap v9478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16784.576433 secs 2024-04-26T22:58:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16087.547245 secs 2024-04-26T22:58:10.102 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:10 smithi092 ceph-mon[29156]: pgmap v9479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:58:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:10 smithi189 ceph-mon[32756]: pgmap v9479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:58:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:10 smithi189 ceph-mon[32756]: pgmap v9480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:58:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:10 smithi156 ceph-mon[32679]: pgmap v9479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T22:58:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:10 smithi156 ceph-mon[32679]: pgmap v9480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:58:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:10 smithi092 ceph-mon[29156]: pgmap v9480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:58:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:12 smithi189 ceph-mon[32756]: pgmap v9481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:12 smithi156 ceph-mon[32679]: pgmap v9481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:12 smithi092 ceph-mon[29156]: pgmap v9481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:14 smithi189 ceph-mon[32756]: pgmap v9482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-26T22:58:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16789.576549 secs 2024-04-26T22:58:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16092.547389 secs 2024-04-26T22:58:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:14 smithi156 ceph-mon[32679]: pgmap v9482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-26T22:58:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16789.576549 secs 2024-04-26T22:58:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16092.547389 secs 2024-04-26T22:58:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:14 smithi092 ceph-mon[29156]: pgmap v9482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-26T22:58:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16789.576549 secs 2024-04-26T22:58:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16092.547389 secs 2024-04-26T22:58:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:16 smithi189 ceph-mon[32756]: pgmap v9483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:16 smithi156 ceph-mon[32679]: pgmap v9483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:16 smithi092 ceph-mon[29156]: pgmap v9483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:18 smithi189 ceph-mon[32756]: pgmap v9484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:18 smithi156 ceph-mon[32679]: pgmap v9484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:18 smithi092 ceph-mon[29156]: pgmap v9484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-26T22:58:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16794.576685 secs 2024-04-26T22:58:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16097.547458 secs 2024-04-26T22:58:19.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16794.576685 secs 2024-04-26T22:58:19.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16097.547458 secs 2024-04-26T22:58:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16794.576685 secs 2024-04-26T22:58:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16097.547458 secs 2024-04-26T22:58:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:20 smithi189 ceph-mon[32756]: pgmap v9485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T22:58:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:20 smithi156 ceph-mon[32679]: pgmap v9485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T22:58:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:20 smithi092 ceph-mon[29156]: pgmap v9485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-26T22:58:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:22 smithi189 ceph-mon[32756]: pgmap v9486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:58:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:22 smithi156 ceph-mon[32679]: pgmap v9486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:58:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:22 smithi092 ceph-mon[29156]: pgmap v9486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T22:58:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:24 smithi189 ceph-mon[32756]: pgmap v9487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16799.576804 secs 2024-04-26T22:58:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16102.547549 secs 2024-04-26T22:58:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:24 smithi156 ceph-mon[32679]: pgmap v9487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16799.576804 secs 2024-04-26T22:58:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16102.547549 secs 2024-04-26T22:58:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:24 smithi092 ceph-mon[29156]: pgmap v9487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16799.576804 secs 2024-04-26T22:58:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16102.547549 secs 2024-04-26T22:58:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:26 smithi189 ceph-mon[32756]: pgmap v9488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:26 smithi156 ceph-mon[32679]: pgmap v9488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:26 smithi092 ceph-mon[29156]: pgmap v9488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:28 smithi189 ceph-mon[32756]: pgmap v9489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:28 smithi156 ceph-mon[32679]: pgmap v9489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:28 smithi092 ceph-mon[29156]: pgmap v9489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16804.576916 secs 2024-04-26T22:58:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16107.547630 secs 2024-04-26T22:58:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16804.576916 secs 2024-04-26T22:58:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16107.547630 secs 2024-04-26T22:58:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16804.576916 secs 2024-04-26T22:58:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16107.547630 secs 2024-04-26T22:58:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:30 smithi156 ceph-mon[32679]: pgmap v9490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:30 smithi092 ceph-mon[29156]: pgmap v9490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:30 smithi189 ceph-mon[32756]: pgmap v9490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:32 smithi156 ceph-mon[32679]: pgmap v9491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:32 smithi092 ceph-mon[29156]: pgmap v9491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:32 smithi189 ceph-mon[32756]: pgmap v9491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:34 smithi156 ceph-mon[32679]: pgmap v9492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16809.577052 secs 2024-04-26T22:58:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16112.547739 secs 2024-04-26T22:58:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:34 smithi092 ceph-mon[29156]: pgmap v9492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16809.577052 secs 2024-04-26T22:58:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16112.547739 secs 2024-04-26T22:58:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:34 smithi189 ceph-mon[32756]: pgmap v9492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16809.577052 secs 2024-04-26T22:58:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16112.547739 secs 2024-04-26T22:58:35.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:58:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:58:35.232+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:58:35.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:58:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:58:35.232+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:58:35.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:58:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:58:35.232+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:58:35.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:58:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:58:35.232+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:58:35.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 22:58:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T22:58:35.232+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T22:58:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:36 smithi156 ceph-mon[32679]: pgmap v9493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:36.458 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:36 smithi189 ceph-mon[32756]: pgmap v9493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:36 smithi092 ceph-mon[29156]: pgmap v9493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:38 smithi156 ceph-mon[32679]: pgmap v9494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:38 smithi092 ceph-mon[29156]: pgmap v9494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:38 smithi189 ceph-mon[32756]: pgmap v9494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16814.577170 secs 2024-04-26T22:58:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16117.547880 secs 2024-04-26T22:58:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16814.577170 secs 2024-04-26T22:58:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16117.547880 secs 2024-04-26T22:58:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16814.577170 secs 2024-04-26T22:58:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16117.547880 secs 2024-04-26T22:58:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:40 smithi156 ceph-mon[32679]: pgmap v9495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:40 smithi092 ceph-mon[29156]: pgmap v9495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:40 smithi189 ceph-mon[32756]: pgmap v9495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T22:58:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:42 smithi156 ceph-mon[32679]: pgmap v9496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:42 smithi092 ceph-mon[29156]: pgmap v9496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:42 smithi189 ceph-mon[32756]: pgmap v9496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T22:58:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:44 smithi156 ceph-mon[32679]: pgmap v9497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16819.577312 secs 2024-04-26T22:58:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16122.548023 secs 2024-04-26T22:58:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:44 smithi092 ceph-mon[29156]: pgmap v9497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16819.577312 secs 2024-04-26T22:58:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16122.548023 secs 2024-04-26T22:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:44 smithi189 ceph-mon[32756]: pgmap v9497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16819.577312 secs 2024-04-26T22:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16122.548023 secs 2024-04-26T22:58:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:46 smithi156 ceph-mon[32679]: pgmap v9498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:46 smithi092 ceph-mon[29156]: pgmap v9498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:46 smithi189 ceph-mon[32756]: pgmap v9498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:48 smithi156 ceph-mon[32679]: pgmap v9499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:48 smithi092 ceph-mon[29156]: pgmap v9499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:48 smithi189 ceph-mon[32756]: pgmap v9499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16824.577446 secs 2024-04-26T22:58:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16127.548146 secs 2024-04-26T22:58:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16824.577446 secs 2024-04-26T22:58:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16127.548146 secs 2024-04-26T22:58:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16824.577446 secs 2024-04-26T22:58:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16127.548146 secs 2024-04-26T22:58:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:50 smithi156 ceph-mon[32679]: pgmap v9500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:50 smithi092 ceph-mon[29156]: pgmap v9500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:50 smithi189 ceph-mon[32756]: pgmap v9500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:51 smithi092 ceph-mon[29156]: pgmap v9501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:51 smithi189 ceph-mon[32756]: pgmap v9501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:51 smithi156 ceph-mon[32679]: pgmap v9501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:53 smithi156 ceph-mon[32679]: pgmap v9502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:53 smithi092 ceph-mon[29156]: pgmap v9502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:53 smithi189 ceph-mon[32756]: pgmap v9502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16829.577583 secs 2024-04-26T22:58:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16132.548311 secs 2024-04-26T22:58:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16829.577583 secs 2024-04-26T22:58:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16132.548311 secs 2024-04-26T22:58:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16829.577583 secs 2024-04-26T22:58:54.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16132.548311 secs 2024-04-26T22:58:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:55 smithi156 ceph-mon[32679]: pgmap v9503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:55 smithi092 ceph-mon[29156]: pgmap v9503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:55 smithi189 ceph-mon[32756]: pgmap v9503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:58:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:57 smithi156 ceph-mon[32679]: pgmap v9504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:57 smithi092 ceph-mon[29156]: pgmap v9504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:57 smithi189 ceph-mon[32756]: pgmap v9504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:59 smithi092 ceph-mon[29156]: pgmap v9505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16834.577714 secs 2024-04-26T22:58:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:58:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16137.548418 secs 2024-04-26T22:58:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:59 smithi189 ceph-mon[32756]: pgmap v9505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16834.577714 secs 2024-04-26T22:58:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:58:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16137.548418 secs 2024-04-26T22:58:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:59 smithi156 ceph-mon[32679]: pgmap v9505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:58:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16834.577714 secs 2024-04-26T22:58:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:58:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16137.548418 secs 2024-04-26T22:59:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:01 smithi092 ceph-mon[29156]: pgmap v9506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:01 smithi189 ceph-mon[32756]: pgmap v9506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:01 smithi156 ceph-mon[32679]: pgmap v9506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:03 smithi092 ceph-mon[29156]: pgmap v9507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:03 smithi189 ceph-mon[32756]: pgmap v9507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:03 smithi156 ceph-mon[32679]: pgmap v9507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16839.577867 secs 2024-04-26T22:59:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16142.548532 secs 2024-04-26T22:59:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16839.577867 secs 2024-04-26T22:59:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16142.548532 secs 2024-04-26T22:59:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16839.577867 secs 2024-04-26T22:59:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16142.548532 secs 2024-04-26T22:59:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:05 smithi092 ceph-mon[29156]: pgmap v9508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:05 smithi189 ceph-mon[32756]: pgmap v9508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:05 smithi156 ceph-mon[32679]: pgmap v9508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:07 smithi092 ceph-mon[29156]: pgmap v9509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:07 smithi189 ceph-mon[32756]: pgmap v9509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:07 smithi156 ceph-mon[32679]: pgmap v9509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:08.294 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:59:08.294+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:59:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:59:08.294+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:59:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:59:08.294+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T22:59:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T22:59:08.294+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 132 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T22:59:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: pgmap v9510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16844.577945 secs 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16147.548601 secs 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: pgmap v9511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: pgmap v9512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:59:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: pgmap v9510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16844.577945 secs 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16147.548601 secs 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: pgmap v9511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: pgmap v9512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:59:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: pgmap v9510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16844.577945 secs 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16147.548601 secs 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: pgmap v9511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: pgmap v9512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T22:59:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:11 smithi092 ceph-mon[29156]: pgmap v9513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:11 smithi189 ceph-mon[32756]: pgmap v9513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:11 smithi156 ceph-mon[32679]: pgmap v9513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:13 smithi092 ceph-mon[29156]: pgmap v9514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:13 smithi189 ceph-mon[32756]: pgmap v9514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:13 smithi156 ceph-mon[32679]: pgmap v9514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T22:59:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16849.578006 secs 2024-04-26T22:59:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16152.548742 secs 2024-04-26T22:59:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16849.578006 secs 2024-04-26T22:59:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16152.548742 secs 2024-04-26T22:59:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16849.578006 secs 2024-04-26T22:59:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16152.548742 secs 2024-04-26T22:59:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:15 smithi092 ceph-mon[29156]: pgmap v9515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:15 smithi189 ceph-mon[32756]: pgmap v9515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:15 smithi156 ceph-mon[32679]: pgmap v9515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:17.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:17 smithi156 ceph-mon[32679]: pgmap v9516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:17 smithi092 ceph-mon[29156]: pgmap v9516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:17 smithi189 ceph-mon[32756]: pgmap v9516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T22:59:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16854.578132 secs 2024-04-26T22:59:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16157.548814 secs 2024-04-26T22:59:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16854.578132 secs 2024-04-26T22:59:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16157.548814 secs 2024-04-26T22:59:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16854.578132 secs 2024-04-26T22:59:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16157.548814 secs 2024-04-26T22:59:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:19 smithi189 ceph-mon[32756]: pgmap v9517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:59:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:19 smithi156 ceph-mon[32679]: pgmap v9517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:59:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:19 smithi092 ceph-mon[29156]: pgmap v9517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T22:59:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:21 smithi092 ceph-mon[29156]: pgmap v9518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:21 smithi189 ceph-mon[32756]: pgmap v9518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:21 smithi156 ceph-mon[32679]: pgmap v9518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:23 smithi092 ceph-mon[29156]: pgmap v9519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:23 smithi189 ceph-mon[32756]: pgmap v9519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:23 smithi156 ceph-mon[32679]: pgmap v9519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16859.578249 secs 2024-04-26T22:59:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16162.548925 secs 2024-04-26T22:59:24.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16859.578249 secs 2024-04-26T22:59:24.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16162.548925 secs 2024-04-26T22:59:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16859.578249 secs 2024-04-26T22:59:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16162.548925 secs 2024-04-26T22:59:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:25 smithi092 ceph-mon[29156]: pgmap v9520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:25 smithi189 ceph-mon[32756]: pgmap v9520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:25 smithi156 ceph-mon[32679]: pgmap v9520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:27 smithi092 ceph-mon[29156]: pgmap v9521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:27 smithi189 ceph-mon[32756]: pgmap v9521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:27 smithi156 ceph-mon[32679]: pgmap v9521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16864.578334 secs 2024-04-26T22:59:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16167.549047 secs 2024-04-26T22:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16864.578334 secs 2024-04-26T22:59:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16167.549047 secs 2024-04-26T22:59:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16864.578334 secs 2024-04-26T22:59:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16167.549047 secs 2024-04-26T22:59:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:29 smithi189 ceph-mon[32756]: pgmap v9522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:29 smithi156 ceph-mon[32679]: pgmap v9522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:29 smithi092 ceph-mon[29156]: pgmap v9522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:31 smithi092 ceph-mon[29156]: pgmap v9523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:31 smithi189 ceph-mon[32756]: pgmap v9523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:31 smithi156 ceph-mon[32679]: pgmap v9523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:33 smithi092 ceph-mon[29156]: pgmap v9524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:33 smithi189 ceph-mon[32756]: pgmap v9524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:33 smithi156 ceph-mon[32679]: pgmap v9524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16869.578483 secs 2024-04-26T22:59:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16172.549182 secs 2024-04-26T22:59:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16869.578483 secs 2024-04-26T22:59:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16172.549182 secs 2024-04-26T22:59:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16869.578483 secs 2024-04-26T22:59:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16172.549182 secs 2024-04-26T22:59:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:35 smithi189 ceph-mon[32756]: pgmap v9525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:35 smithi156 ceph-mon[32679]: pgmap v9525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:35 smithi092 ceph-mon[29156]: pgmap v9525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:37 smithi092 ceph-mon[29156]: pgmap v9526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:37 smithi189 ceph-mon[32756]: pgmap v9526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:37 smithi156 ceph-mon[32679]: pgmap v9526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16874.578607 secs 2024-04-26T22:59:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16177.549316 secs 2024-04-26T22:59:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16874.578607 secs 2024-04-26T22:59:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16177.549316 secs 2024-04-26T22:59:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16874.578607 secs 2024-04-26T22:59:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16177.549316 secs 2024-04-26T22:59:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:39 smithi189 ceph-mon[32756]: pgmap v9527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:39 smithi156 ceph-mon[32679]: pgmap v9527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:39 smithi092 ceph-mon[29156]: pgmap v9527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:41 smithi092 ceph-mon[29156]: pgmap v9528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:41 smithi189 ceph-mon[32756]: pgmap v9528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:41 smithi156 ceph-mon[32679]: pgmap v9528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:43 smithi092 ceph-mon[29156]: pgmap v9529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:43 smithi189 ceph-mon[32756]: pgmap v9529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:43 smithi156 ceph-mon[32679]: pgmap v9529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16879.578710 secs 2024-04-26T22:59:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16182.549408 secs 2024-04-26T22:59:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16879.578710 secs 2024-04-26T22:59:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16182.549408 secs 2024-04-26T22:59:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16879.578710 secs 2024-04-26T22:59:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16182.549408 secs 2024-04-26T22:59:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:45 smithi189 ceph-mon[32756]: pgmap v9530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:45 smithi156 ceph-mon[32679]: pgmap v9530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:45 smithi092 ceph-mon[29156]: pgmap v9530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:47 smithi092 ceph-mon[29156]: pgmap v9531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:47 smithi189 ceph-mon[32756]: pgmap v9531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:47 smithi156 ceph-mon[32679]: pgmap v9531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16884.578861 secs 2024-04-26T22:59:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16187.549510 secs 2024-04-26T22:59:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16884.578861 secs 2024-04-26T22:59:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16187.549510 secs 2024-04-26T22:59:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16884.578861 secs 2024-04-26T22:59:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16187.549510 secs 2024-04-26T22:59:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:49 smithi189 ceph-mon[32756]: pgmap v9532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:49 smithi156 ceph-mon[32679]: pgmap v9532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:49 smithi092 ceph-mon[29156]: pgmap v9532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:51 smithi092 ceph-mon[29156]: pgmap v9533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:51 smithi189 ceph-mon[32756]: pgmap v9533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:51 smithi156 ceph-mon[32679]: pgmap v9533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:53 smithi092 ceph-mon[29156]: pgmap v9534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:53 smithi189 ceph-mon[32756]: pgmap v9534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:53 smithi156 ceph-mon[32679]: pgmap v9534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16889.578958 secs 2024-04-26T22:59:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16192.549632 secs 2024-04-26T22:59:54.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16889.578958 secs 2024-04-26T22:59:54.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16192.549632 secs 2024-04-26T22:59:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16889.578958 secs 2024-04-26T22:59:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16192.549632 secs 2024-04-26T22:59:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:55 smithi189 ceph-mon[32756]: pgmap v9535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:55 smithi156 ceph-mon[32679]: pgmap v9535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:55 smithi092 ceph-mon[29156]: pgmap v9535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T22:59:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:57 smithi092 ceph-mon[29156]: pgmap v9536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:57 smithi189 ceph-mon[32756]: pgmap v9536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:57 smithi156 ceph-mon[32679]: pgmap v9536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T22:59:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16894.579077 secs 2024-04-26T22:59:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16197.549755 secs 2024-04-26T22:59:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16894.579077 secs 2024-04-26T22:59:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16197.549755 secs 2024-04-26T22:59:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16894.579077 secs 2024-04-26T22:59:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16197.549755 secs 2024-04-26T23:00:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 22:59:59 smithi189 ceph-mon[32756]: pgmap v9537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 22:59:59 smithi156 ceph-mon[32679]: pgmap v9537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 22:59:59 smithi092 ceph-mon[29156]: pgmap v9537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:00:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:00:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:00:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:01 smithi189 ceph-mon[32756]: pgmap v9538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:01 smithi156 ceph-mon[32679]: pgmap v9538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:01 smithi092 ceph-mon[29156]: pgmap v9538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:03 smithi189 ceph-mon[32756]: pgmap v9539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:03 smithi156 ceph-mon[32679]: pgmap v9539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:03 smithi092 ceph-mon[29156]: pgmap v9539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16899.579216 secs 2024-04-26T23:00:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16202.549871 secs 2024-04-26T23:00:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16899.579216 secs 2024-04-26T23:00:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16202.549871 secs 2024-04-26T23:00:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16899.579216 secs 2024-04-26T23:00:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16202.549871 secs 2024-04-26T23:00:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:05 smithi189 ceph-mon[32756]: pgmap v9540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:05 smithi156 ceph-mon[32679]: pgmap v9540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:05 smithi092 ceph-mon[29156]: pgmap v9540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:07 smithi092 ceph-mon[29156]: pgmap v9541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:07 smithi189 ceph-mon[32756]: pgmap v9541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:07 smithi156 ceph-mon[32679]: pgmap v9541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16904.579334 secs 2024-04-26T23:00:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16207.549987 secs 2024-04-26T23:00:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16904.579334 secs 2024-04-26T23:00:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16207.549987 secs 2024-04-26T23:00:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16904.579334 secs 2024-04-26T23:00:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16207.549987 secs 2024-04-26T23:00:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:09 smithi189 ceph-mon[32756]: pgmap v9542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:09 smithi156 ceph-mon[32679]: pgmap v9542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:09 smithi092 ceph-mon[29156]: pgmap v9542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:00:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:10 smithi189 ceph-mon[32756]: pgmap v9543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:00:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:10 smithi189 ceph-mon[32756]: pgmap v9544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:00:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:10 smithi156 ceph-mon[32679]: pgmap v9543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:00:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:10 smithi156 ceph-mon[32679]: pgmap v9544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:00:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:00:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:00:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:10 smithi092 ceph-mon[29156]: pgmap v9543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:00:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:10 smithi092 ceph-mon[29156]: pgmap v9544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:00:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:12 smithi092 ceph-mon[29156]: pgmap v9545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:12 smithi189 ceph-mon[32756]: pgmap v9545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:12 smithi156 ceph-mon[32679]: pgmap v9545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16909.579435 secs 2024-04-26T23:00:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16212.550092 secs 2024-04-26T23:00:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:14 smithi092 ceph-mon[29156]: pgmap v9546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16909.579435 secs 2024-04-26T23:00:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16212.550092 secs 2024-04-26T23:00:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:14 smithi189 ceph-mon[32756]: pgmap v9546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16909.579435 secs 2024-04-26T23:00:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16212.550092 secs 2024-04-26T23:00:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:14 smithi156 ceph-mon[32679]: pgmap v9546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:16 smithi092 ceph-mon[29156]: pgmap v9547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:16 smithi189 ceph-mon[32756]: pgmap v9547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:16 smithi156 ceph-mon[32679]: pgmap v9547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:00:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:18 smithi092 ceph-mon[29156]: pgmap v9548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:00:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16914.579533 secs 2024-04-26T23:00:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16217.550192 secs 2024-04-26T23:00:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:18 smithi189 ceph-mon[32756]: pgmap v9548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:00:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16914.579533 secs 2024-04-26T23:00:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16217.550192 secs 2024-04-26T23:00:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:18 smithi156 ceph-mon[32679]: pgmap v9548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:00:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16914.579533 secs 2024-04-26T23:00:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16217.550192 secs 2024-04-26T23:00:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:20 smithi092 ceph-mon[29156]: pgmap v9549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:00:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:20 smithi189 ceph-mon[32756]: pgmap v9549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:00:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:20 smithi156 ceph-mon[32679]: pgmap v9549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:00:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:22 smithi092 ceph-mon[29156]: pgmap v9550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:22 smithi189 ceph-mon[32756]: pgmap v9550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:22 smithi156 ceph-mon[32679]: pgmap v9550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16919.579652 secs 2024-04-26T23:00:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16222.550324 secs 2024-04-26T23:00:24.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16919.579652 secs 2024-04-26T23:00:24.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16222.550324 secs 2024-04-26T23:00:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16919.579652 secs 2024-04-26T23:00:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16222.550324 secs 2024-04-26T23:00:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:24 smithi092 ceph-mon[29156]: pgmap v9551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:24 smithi189 ceph-mon[32756]: pgmap v9551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:24 smithi156 ceph-mon[32679]: pgmap v9551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:26 smithi092 ceph-mon[29156]: pgmap v9552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:26 smithi189 ceph-mon[32756]: pgmap v9552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:26 smithi156 ceph-mon[32679]: pgmap v9552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:28 smithi092 ceph-mon[29156]: pgmap v9553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16924.579770 secs 2024-04-26T23:00:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16227.550434 secs 2024-04-26T23:00:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:28 smithi189 ceph-mon[32756]: pgmap v9553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16924.579770 secs 2024-04-26T23:00:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16227.550434 secs 2024-04-26T23:00:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:28 smithi156 ceph-mon[32679]: pgmap v9553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16924.579770 secs 2024-04-26T23:00:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16227.550434 secs 2024-04-26T23:00:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:30 smithi189 ceph-mon[32756]: pgmap v9554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:30 smithi156 ceph-mon[32679]: pgmap v9554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:30 smithi092 ceph-mon[29156]: pgmap v9554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:32 smithi189 ceph-mon[32756]: pgmap v9555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:32 smithi156 ceph-mon[32679]: pgmap v9555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:32 smithi092 ceph-mon[29156]: pgmap v9555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16929.579906 secs 2024-04-26T23:00:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16232.550527 secs 2024-04-26T23:00:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16929.579906 secs 2024-04-26T23:00:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16232.550527 secs 2024-04-26T23:00:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16929.579906 secs 2024-04-26T23:00:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16232.550527 secs 2024-04-26T23:00:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:35 smithi189 ceph-mon[32756]: pgmap v9556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:35 smithi156 ceph-mon[32679]: pgmap v9556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:35 smithi092 ceph-mon[29156]: pgmap v9556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:37 smithi189 ceph-mon[32756]: pgmap v9557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:37 smithi156 ceph-mon[32679]: pgmap v9557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:37 smithi092 ceph-mon[29156]: pgmap v9557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:00:38.307+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:00:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:00:38.307+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:00:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:00:38.308+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:00:38.307 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:00:38.308+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 133 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:00:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:39 smithi189 ceph-mon[32756]: pgmap v9558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16934.579997 secs 2024-04-26T23:00:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16237.550640 secs 2024-04-26T23:00:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:39 smithi156 ceph-mon[32679]: pgmap v9558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16934.579997 secs 2024-04-26T23:00:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16237.550640 secs 2024-04-26T23:00:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:39 smithi092 ceph-mon[29156]: pgmap v9558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16934.579997 secs 2024-04-26T23:00:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16237.550640 secs 2024-04-26T23:00:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:41 smithi189 ceph-mon[32756]: pgmap v9559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:41 smithi156 ceph-mon[32679]: pgmap v9559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:41 smithi092 ceph-mon[29156]: pgmap v9559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:43 smithi189 ceph-mon[32756]: pgmap v9560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:43 smithi156 ceph-mon[32679]: pgmap v9560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:43 smithi092 ceph-mon[29156]: pgmap v9560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16939.580114 secs 2024-04-26T23:00:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16242.550756 secs 2024-04-26T23:00:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16939.580114 secs 2024-04-26T23:00:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16242.550756 secs 2024-04-26T23:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16939.580114 secs 2024-04-26T23:00:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16242.550756 secs 2024-04-26T23:00:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:45 smithi092 ceph-mon[29156]: pgmap v9561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:45 smithi189 ceph-mon[32756]: pgmap v9561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:45 smithi156 ceph-mon[32679]: pgmap v9561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:47 smithi189 ceph-mon[32756]: pgmap v9562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:47 smithi156 ceph-mon[32679]: pgmap v9562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:47 smithi092 ceph-mon[29156]: pgmap v9562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:49.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:49 smithi092 ceph-mon[29156]: pgmap v9563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16944.580231 secs 2024-04-26T23:00:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16247.550862 secs 2024-04-26T23:00:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:49 smithi189 ceph-mon[32756]: pgmap v9563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16944.580231 secs 2024-04-26T23:00:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16247.550862 secs 2024-04-26T23:00:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:49 smithi156 ceph-mon[32679]: pgmap v9563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16944.580231 secs 2024-04-26T23:00:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16247.550862 secs 2024-04-26T23:00:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:51 smithi189 ceph-mon[32756]: pgmap v9564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:51 smithi156 ceph-mon[32679]: pgmap v9564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:51 smithi092 ceph-mon[29156]: pgmap v9564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:53 smithi189 ceph-mon[32756]: pgmap v9565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:53 smithi156 ceph-mon[32679]: pgmap v9565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:53 smithi092 ceph-mon[29156]: pgmap v9565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16949.580362 secs 2024-04-26T23:00:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16252.551001 secs 2024-04-26T23:00:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16949.580362 secs 2024-04-26T23:00:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16252.551001 secs 2024-04-26T23:00:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16949.580362 secs 2024-04-26T23:00:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16252.551001 secs 2024-04-26T23:00:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:55 smithi189 ceph-mon[32756]: pgmap v9566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:55 smithi156 ceph-mon[32679]: pgmap v9566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:55 smithi092 ceph-mon[29156]: pgmap v9566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:00:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:57 smithi189 ceph-mon[32756]: pgmap v9567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:57 smithi156 ceph-mon[32679]: pgmap v9567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:57 smithi092 ceph-mon[29156]: pgmap v9567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:59 smithi189 ceph-mon[32756]: pgmap v9568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16954.580461 secs 2024-04-26T23:00:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:00:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16257.551168 secs 2024-04-26T23:00:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:59 smithi156 ceph-mon[32679]: pgmap v9568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16954.580461 secs 2024-04-26T23:00:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:00:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16257.551168 secs 2024-04-26T23:00:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:59 smithi092 ceph-mon[29156]: pgmap v9568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:00:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16954.580461 secs 2024-04-26T23:00:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:00:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16257.551168 secs 2024-04-26T23:01:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:01 smithi092 ceph-mon[29156]: pgmap v9569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:01.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:01 smithi156 ceph-mon[32679]: pgmap v9569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:01 smithi189 ceph-mon[32756]: pgmap v9569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:03 smithi189 ceph-mon[32756]: pgmap v9570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:03 smithi156 ceph-mon[32679]: pgmap v9570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:03 smithi092 ceph-mon[29156]: pgmap v9570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16959.580579 secs 2024-04-26T23:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:04 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 16262.551315 secs 2024-04-26T23:01:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:04 smithi189 ceph-mon[32756]: slow request 11521.294674 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16959.580579 secs 2024-04-26T23:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:04 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 16262.551315 secs 2024-04-26T23:01:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:04 smithi156 ceph-mon[32679]: slow request 11521.294674 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:01:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16959.580579 secs 2024-04-26T23:01:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:04 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 16262.551315 secs 2024-04-26T23:01:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:04 smithi092 ceph-mon[29156]: slow request 11521.294674 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:01:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:05 smithi189 ceph-mon[32756]: pgmap v9571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:05 smithi156 ceph-mon[32679]: pgmap v9571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:05 smithi092 ceph-mon[29156]: pgmap v9571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:07 smithi189 ceph-mon[32756]: pgmap v9572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:07 smithi156 ceph-mon[32679]: pgmap v9572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:07 smithi092 ceph-mon[29156]: pgmap v9572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:09 smithi189 ceph-mon[32756]: pgmap v9573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16964.580694 secs 2024-04-26T23:01:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16267.551361 secs 2024-04-26T23:01:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:09 smithi156 ceph-mon[32679]: pgmap v9573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16964.580694 secs 2024-04-26T23:01:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16267.551361 secs 2024-04-26T23:01:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:09 smithi092 ceph-mon[29156]: pgmap v9573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16964.580694 secs 2024-04-26T23:01:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16267.551361 secs 2024-04-26T23:01:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:01:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:11 smithi189 ceph-mon[32756]: pgmap v9574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:11.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:11 smithi156 ceph-mon[32679]: pgmap v9574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:11.437 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:11 smithi092 ceph-mon[29156]: pgmap v9574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:13 smithi092 ceph-mon[29156]: pgmap v9575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:13 smithi189 ceph-mon[32756]: pgmap v9575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:13 smithi156 ceph-mon[32679]: pgmap v9575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16969.580784 secs 2024-04-26T23:01:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16272.551450 secs 2024-04-26T23:01:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16969.580784 secs 2024-04-26T23:01:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16272.551450 secs 2024-04-26T23:01:14.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16969.580784 secs 2024-04-26T23:01:14.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16272.551450 secs 2024-04-26T23:01:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: pgmap v9576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: pgmap v9576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: pgmap v9576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:01:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:01:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:16 smithi189 ceph-mon[32756]: pgmap v9577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:01:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:16 smithi189 ceph-mon[32756]: pgmap v9578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:16 smithi156 ceph-mon[32679]: pgmap v9577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:01:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:16 smithi156 ceph-mon[32679]: pgmap v9578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:16 smithi092 ceph-mon[29156]: pgmap v9577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:01:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:16 smithi092 ceph-mon[29156]: pgmap v9578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:18 smithi189 ceph-mon[32756]: pgmap v9579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:18 smithi156 ceph-mon[32679]: pgmap v9579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:18 smithi092 ceph-mon[29156]: pgmap v9579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16974.580868 secs 2024-04-26T23:01:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16277.551567 secs 2024-04-26T23:01:19.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16974.580868 secs 2024-04-26T23:01:19.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16277.551567 secs 2024-04-26T23:01:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16974.580868 secs 2024-04-26T23:01:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16277.551567 secs 2024-04-26T23:01:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:20 smithi189 ceph-mon[32756]: pgmap v9580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:20.406 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:20 smithi092 ceph-mon[29156]: pgmap v9580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:20 smithi156 ceph-mon[32679]: pgmap v9580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:22 smithi189 ceph-mon[32756]: pgmap v9581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:22 smithi156 ceph-mon[32679]: pgmap v9581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:22 smithi092 ceph-mon[29156]: pgmap v9581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:01:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:24 smithi189 ceph-mon[32756]: pgmap v9582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16979.580951 secs 2024-04-26T23:01:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16282.551713 secs 2024-04-26T23:01:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:24 smithi156 ceph-mon[32679]: pgmap v9582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16979.580951 secs 2024-04-26T23:01:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16282.551713 secs 2024-04-26T23:01:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:24 smithi092 ceph-mon[29156]: pgmap v9582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:01:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16979.580951 secs 2024-04-26T23:01:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16282.551713 secs 2024-04-26T23:01:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:26 smithi189 ceph-mon[32756]: pgmap v9583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:01:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:26 smithi156 ceph-mon[32679]: pgmap v9583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:01:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:26 smithi092 ceph-mon[29156]: pgmap v9583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:01:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:28 smithi189 ceph-mon[32756]: pgmap v9584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:28 smithi156 ceph-mon[32679]: pgmap v9584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:28 smithi092 ceph-mon[29156]: pgmap v9584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16984.581063 secs 2024-04-26T23:01:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16287.551793 secs 2024-04-26T23:01:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16984.581063 secs 2024-04-26T23:01:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16287.551793 secs 2024-04-26T23:01:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16984.581063 secs 2024-04-26T23:01:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16287.551793 secs 2024-04-26T23:01:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:30 smithi189 ceph-mon[32756]: pgmap v9585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:30 smithi156 ceph-mon[32679]: pgmap v9585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:30 smithi092 ceph-mon[29156]: pgmap v9585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:32 smithi189 ceph-mon[32756]: pgmap v9586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:32 smithi156 ceph-mon[32679]: pgmap v9586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:32 smithi092 ceph-mon[29156]: pgmap v9586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:34 smithi189 ceph-mon[32756]: pgmap v9587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16989.581159 secs 2024-04-26T23:01:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16292.551881 secs 2024-04-26T23:01:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:34 smithi156 ceph-mon[32679]: pgmap v9587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16989.581159 secs 2024-04-26T23:01:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16292.551881 secs 2024-04-26T23:01:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:34 smithi092 ceph-mon[29156]: pgmap v9587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16989.581159 secs 2024-04-26T23:01:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16292.551881 secs 2024-04-26T23:01:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:36 smithi189 ceph-mon[32756]: pgmap v9588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:36 smithi156 ceph-mon[32679]: pgmap v9588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:36 smithi092 ceph-mon[29156]: pgmap v9588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:38 smithi189 ceph-mon[32756]: pgmap v9589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:38 smithi156 ceph-mon[32679]: pgmap v9589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:38 smithi092 ceph-mon[29156]: pgmap v9589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16994.581277 secs 2024-04-26T23:01:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16297.552004 secs 2024-04-26T23:01:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16994.581277 secs 2024-04-26T23:01:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16297.552004 secs 2024-04-26T23:01:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16994.581277 secs 2024-04-26T23:01:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16297.552004 secs 2024-04-26T23:01:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:40 smithi156 ceph-mon[32679]: pgmap v9590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:40 smithi092 ceph-mon[29156]: pgmap v9590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:40 smithi189 ceph-mon[32756]: pgmap v9590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:42 smithi156 ceph-mon[32679]: pgmap v9591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:42 smithi092 ceph-mon[29156]: pgmap v9591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:42 smithi189 ceph-mon[32756]: pgmap v9591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:44 smithi156 ceph-mon[32679]: pgmap v9592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 16999.581393 secs 2024-04-26T23:01:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16302.552099 secs 2024-04-26T23:01:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:44 smithi092 ceph-mon[29156]: pgmap v9592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 16999.581393 secs 2024-04-26T23:01:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16302.552099 secs 2024-04-26T23:01:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:44 smithi189 ceph-mon[32756]: pgmap v9592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 16999.581393 secs 2024-04-26T23:01:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16302.552099 secs 2024-04-26T23:01:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:46 smithi156 ceph-mon[32679]: pgmap v9593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:46 smithi092 ceph-mon[29156]: pgmap v9593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:46 smithi189 ceph-mon[32756]: pgmap v9593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:48 smithi092 ceph-mon[29156]: pgmap v9594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:48 smithi156 ceph-mon[32679]: pgmap v9594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:48 smithi189 ceph-mon[32756]: pgmap v9594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17004.581510 secs 2024-04-26T23:01:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16307.552204 secs 2024-04-26T23:01:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17004.581510 secs 2024-04-26T23:01:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16307.552204 secs 2024-04-26T23:01:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17004.581510 secs 2024-04-26T23:01:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16307.552204 secs 2024-04-26T23:01:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:50 smithi156 ceph-mon[32679]: pgmap v9595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:50 smithi092 ceph-mon[29156]: pgmap v9595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:50 smithi189 ceph-mon[32756]: pgmap v9595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:52 smithi156 ceph-mon[32679]: pgmap v9596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:52 smithi092 ceph-mon[29156]: pgmap v9596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:52 smithi189 ceph-mon[32756]: pgmap v9596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:54 smithi156 ceph-mon[32679]: pgmap v9597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17009.581626 secs 2024-04-26T23:01:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16312.552343 secs 2024-04-26T23:01:54.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:54 smithi189 ceph-mon[32756]: pgmap v9597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:54.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17009.581626 secs 2024-04-26T23:01:54.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16312.552343 secs 2024-04-26T23:01:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:54 smithi092 ceph-mon[29156]: pgmap v9597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17009.581626 secs 2024-04-26T23:01:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16312.552343 secs 2024-04-26T23:01:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:56 smithi156 ceph-mon[32679]: pgmap v9598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:56 smithi092 ceph-mon[29156]: pgmap v9598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:56 smithi189 ceph-mon[32756]: pgmap v9598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:01:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:58 smithi156 ceph-mon[32679]: pgmap v9599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:58 smithi092 ceph-mon[29156]: pgmap v9599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:58 smithi189 ceph-mon[32756]: pgmap v9599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:01:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17014.581730 secs 2024-04-26T23:01:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:01:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16317.552412 secs 2024-04-26T23:01:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17014.581730 secs 2024-04-26T23:01:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:01:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16317.552412 secs 2024-04-26T23:01:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17014.581730 secs 2024-04-26T23:01:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:01:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16317.552412 secs 2024-04-26T23:02:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:00 smithi156 ceph-mon[32679]: pgmap v9600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:00 smithi092 ceph-mon[29156]: pgmap v9600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:00 smithi189 ceph-mon[32756]: pgmap v9600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:02 smithi156 ceph-mon[32679]: pgmap v9601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:02 smithi092 ceph-mon[29156]: pgmap v9601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:02 smithi189 ceph-mon[32756]: pgmap v9601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:04 smithi156 ceph-mon[32679]: pgmap v9602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17019.581850 secs 2024-04-26T23:02:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16322.552527 secs 2024-04-26T23:02:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:04 smithi092 ceph-mon[29156]: pgmap v9602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17019.581850 secs 2024-04-26T23:02:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16322.552527 secs 2024-04-26T23:02:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:04 smithi189 ceph-mon[32756]: pgmap v9602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17019.581850 secs 2024-04-26T23:02:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16322.552527 secs 2024-04-26T23:02:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:06 smithi092 ceph-mon[29156]: pgmap v9603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:06 smithi189 ceph-mon[32756]: pgmap v9603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:06 smithi156 ceph-mon[32679]: pgmap v9603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:08 smithi092 ceph-mon[29156]: pgmap v9604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:08 smithi189 ceph-mon[32756]: pgmap v9604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:08 smithi156 ceph-mon[32679]: pgmap v9604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17024.581914 secs 2024-04-26T23:02:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16327.552667 secs 2024-04-26T23:02:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17024.581914 secs 2024-04-26T23:02:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16327.552667 secs 2024-04-26T23:02:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17024.581914 secs 2024-04-26T23:02:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16327.552667 secs 2024-04-26T23:02:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:10 smithi092 ceph-mon[29156]: pgmap v9605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:10 smithi189 ceph-mon[32756]: pgmap v9605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:10 smithi156 ceph-mon[32679]: pgmap v9605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:12 smithi092 ceph-mon[29156]: pgmap v9606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:12 smithi189 ceph-mon[32756]: pgmap v9606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:12 smithi156 ceph-mon[32679]: pgmap v9606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:14 smithi092 ceph-mon[29156]: pgmap v9607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17029.582038 secs 2024-04-26T23:02:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16332.552797 secs 2024-04-26T23:02:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:14 smithi189 ceph-mon[32756]: pgmap v9607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17029.582038 secs 2024-04-26T23:02:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16332.552797 secs 2024-04-26T23:02:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:14 smithi156 ceph-mon[32679]: pgmap v9607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17029.582038 secs 2024-04-26T23:02:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16332.552797 secs 2024-04-26T23:02:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:02:16.291 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:16 smithi189 ceph-mon[32756]: pgmap v9608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:16 smithi092 ceph-mon[29156]: pgmap v9608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:16 smithi156 ceph-mon[32679]: pgmap v9608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:18 smithi189 ceph-mon[32756]: pgmap v9609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:18.484 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:18 smithi156 ceph-mon[32679]: pgmap v9609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:18 smithi092 ceph-mon[29156]: pgmap v9609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17034.582121 secs 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16337.552942 secs 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17034.582121 secs 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16337.552942 secs 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17034.582121 secs 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16337.552942 secs 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:02:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:02:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:20 smithi092 ceph-mon[29156]: pgmap v9610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:20 smithi092 ceph-mon[29156]: pgmap v9611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T23:02:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:20 smithi092 ceph-mon[29156]: pgmap v9612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:20 smithi189 ceph-mon[32756]: pgmap v9610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:20 smithi189 ceph-mon[32756]: pgmap v9611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T23:02:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:20 smithi189 ceph-mon[32756]: pgmap v9612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:20 smithi156 ceph-mon[32679]: pgmap v9610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:20 smithi156 ceph-mon[32679]: pgmap v9611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-26T23:02:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:20 smithi156 ceph-mon[32679]: pgmap v9612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:21 smithi092 ceph-mon[29156]: pgmap v9613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:21 smithi189 ceph-mon[32756]: pgmap v9613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:21 smithi156 ceph-mon[32679]: pgmap v9613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:23 smithi156 ceph-mon[32679]: pgmap v9614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17039.582240 secs 2024-04-26T23:02:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16342.553061 secs 2024-04-26T23:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:23 smithi092 ceph-mon[29156]: pgmap v9614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17039.582240 secs 2024-04-26T23:02:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16342.553061 secs 2024-04-26T23:02:24.341 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:23 smithi189 ceph-mon[32756]: pgmap v9614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:02:24.341 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17039.582240 secs 2024-04-26T23:02:24.341 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16342.553061 secs 2024-04-26T23:02:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:25 smithi156 ceph-mon[32679]: pgmap v9615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:25 smithi092 ceph-mon[29156]: pgmap v9615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:25 smithi189 ceph-mon[32756]: pgmap v9615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:27 smithi156 ceph-mon[32679]: pgmap v9616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:27 smithi092 ceph-mon[29156]: pgmap v9616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:27 smithi189 ceph-mon[32756]: pgmap v9616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:02:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17044.582362 secs 2024-04-26T23:02:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16347.553162 secs 2024-04-26T23:02:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17044.582362 secs 2024-04-26T23:02:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16347.553162 secs 2024-04-26T23:02:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17044.582362 secs 2024-04-26T23:02:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16347.553162 secs 2024-04-26T23:02:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:29 smithi156 ceph-mon[32679]: pgmap v9617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:02:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:29 smithi092 ceph-mon[29156]: pgmap v9617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:02:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:29 smithi189 ceph-mon[32756]: pgmap v9617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:02:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:31 smithi156 ceph-mon[32679]: pgmap v9618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:31 smithi092 ceph-mon[29156]: pgmap v9618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:31 smithi189 ceph-mon[32756]: pgmap v9618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:33 smithi156 ceph-mon[32679]: pgmap v9619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17049.582507 secs 2024-04-26T23:02:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16352.553308 secs 2024-04-26T23:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:33 smithi092 ceph-mon[29156]: pgmap v9619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17049.582507 secs 2024-04-26T23:02:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16352.553308 secs 2024-04-26T23:02:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:33 smithi189 ceph-mon[32756]: pgmap v9619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17049.582507 secs 2024-04-26T23:02:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16352.553308 secs 2024-04-26T23:02:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:35 smithi156 ceph-mon[32679]: pgmap v9620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:35 smithi092 ceph-mon[29156]: pgmap v9620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:35 smithi189 ceph-mon[32756]: pgmap v9620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:37 smithi156 ceph-mon[32679]: pgmap v9621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:37 smithi092 ceph-mon[29156]: pgmap v9621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:37 smithi189 ceph-mon[32756]: pgmap v9621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17054.582598 secs 2024-04-26T23:02:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16357.553457 secs 2024-04-26T23:02:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17054.582598 secs 2024-04-26T23:02:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16357.553457 secs 2024-04-26T23:02:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17054.582598 secs 2024-04-26T23:02:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16357.553457 secs 2024-04-26T23:02:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:39 smithi092 ceph-mon[29156]: pgmap v9622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:39 smithi189 ceph-mon[32756]: pgmap v9622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:39 smithi156 ceph-mon[32679]: pgmap v9622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:41 smithi092 ceph-mon[29156]: pgmap v9623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:41 smithi189 ceph-mon[32756]: pgmap v9623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:41 smithi156 ceph-mon[32679]: pgmap v9623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:43 smithi092 ceph-mon[29156]: pgmap v9624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17059.582737 secs 2024-04-26T23:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16362.553517 secs 2024-04-26T23:02:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:43 smithi189 ceph-mon[32756]: pgmap v9624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17059.582737 secs 2024-04-26T23:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16362.553517 secs 2024-04-26T23:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:43 smithi156 ceph-mon[32679]: pgmap v9624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17059.582737 secs 2024-04-26T23:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16362.553517 secs 2024-04-26T23:02:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:45 smithi092 ceph-mon[29156]: pgmap v9625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:45 smithi189 ceph-mon[32756]: pgmap v9625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:45 smithi156 ceph-mon[32679]: pgmap v9625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:48.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:47 smithi156 ceph-mon[32679]: pgmap v9626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:47 smithi092 ceph-mon[29156]: pgmap v9626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:47 smithi189 ceph-mon[32756]: pgmap v9626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17064.582802 secs 2024-04-26T23:02:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16367.553641 secs 2024-04-26T23:02:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:49 smithi189 ceph-mon[32756]: pgmap v9627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:49.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17064.582802 secs 2024-04-26T23:02:49.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16367.553641 secs 2024-04-26T23:02:49.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:49 smithi092 ceph-mon[29156]: pgmap v9627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17064.582802 secs 2024-04-26T23:02:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16367.553641 secs 2024-04-26T23:02:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:49 smithi156 ceph-mon[32679]: pgmap v9627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:51 smithi156 ceph-mon[32679]: pgmap v9628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:51 smithi092 ceph-mon[29156]: pgmap v9628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:51 smithi189 ceph-mon[32756]: pgmap v9628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:53 smithi156 ceph-mon[32679]: pgmap v9629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17069.582869 secs 2024-04-26T23:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16372.553757 secs 2024-04-26T23:02:54.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:53 smithi189 ceph-mon[32756]: pgmap v9629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:54.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17069.582869 secs 2024-04-26T23:02:54.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16372.553757 secs 2024-04-26T23:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:53 smithi092 ceph-mon[29156]: pgmap v9629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17069.582869 secs 2024-04-26T23:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16372.553757 secs 2024-04-26T23:02:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:55 smithi156 ceph-mon[32679]: pgmap v9630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:55 smithi092 ceph-mon[29156]: pgmap v9630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:55 smithi189 ceph-mon[32756]: pgmap v9630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:02:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:57 smithi156 ceph-mon[32679]: pgmap v9631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:57 smithi092 ceph-mon[29156]: pgmap v9631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:57 smithi189 ceph-mon[32756]: pgmap v9631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:02:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17074.582948 secs 2024-04-26T23:02:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16377.553896 secs 2024-04-26T23:02:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17074.582948 secs 2024-04-26T23:02:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16377.553896 secs 2024-04-26T23:02:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17074.582948 secs 2024-04-26T23:02:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16377.553896 secs 2024-04-26T23:03:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:02:59 smithi156 ceph-mon[32679]: pgmap v9632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:02:59 smithi092 ceph-mon[29156]: pgmap v9632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:02:59 smithi189 ceph-mon[32756]: pgmap v9632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:01 smithi156 ceph-mon[32679]: pgmap v9633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:01 smithi092 ceph-mon[29156]: pgmap v9633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:01 smithi189 ceph-mon[32756]: pgmap v9633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:03 smithi156 ceph-mon[32679]: pgmap v9634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17079.583065 secs 2024-04-26T23:03:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16382.554010 secs 2024-04-26T23:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:03 smithi092 ceph-mon[29156]: pgmap v9634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17079.583065 secs 2024-04-26T23:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16382.554010 secs 2024-04-26T23:03:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:03 smithi189 ceph-mon[32756]: pgmap v9634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17079.583065 secs 2024-04-26T23:03:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16382.554010 secs 2024-04-26T23:03:06.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:05 smithi092 ceph-mon[29156]: pgmap v9635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:05 smithi189 ceph-mon[32756]: pgmap v9635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:05 smithi156 ceph-mon[32679]: pgmap v9635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:07 smithi092 ceph-mon[29156]: pgmap v9636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:07 smithi189 ceph-mon[32756]: pgmap v9636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:07 smithi156 ceph-mon[32679]: pgmap v9636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17084.583176 secs 2024-04-26T23:03:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16387.554127 secs 2024-04-26T23:03:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17084.583176 secs 2024-04-26T23:03:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16387.554127 secs 2024-04-26T23:03:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17084.583176 secs 2024-04-26T23:03:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16387.554127 secs 2024-04-26T23:03:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:09 smithi092 ceph-mon[29156]: pgmap v9637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:09 smithi189 ceph-mon[32756]: pgmap v9637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:09 smithi156 ceph-mon[32679]: pgmap v9637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:11 smithi092 ceph-mon[29156]: pgmap v9638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:11 smithi189 ceph-mon[32756]: pgmap v9638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:11 smithi156 ceph-mon[32679]: pgmap v9638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:13 smithi092 ceph-mon[29156]: pgmap v9639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17089.583319 secs 2024-04-26T23:03:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16392.554209 secs 2024-04-26T23:03:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:13 smithi189 ceph-mon[32756]: pgmap v9639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17089.583319 secs 2024-04-26T23:03:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16392.554209 secs 2024-04-26T23:03:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:13 smithi156 ceph-mon[32679]: pgmap v9639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17089.583319 secs 2024-04-26T23:03:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16392.554209 secs 2024-04-26T23:03:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:15 smithi092 ceph-mon[29156]: pgmap v9640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:15 smithi189 ceph-mon[32756]: pgmap v9640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:15 smithi156 ceph-mon[32679]: pgmap v9640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:18.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:17 smithi156 ceph-mon[32679]: pgmap v9641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:17 smithi092 ceph-mon[29156]: pgmap v9641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:17 smithi189 ceph-mon[32756]: pgmap v9641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17094.583391 secs 2024-04-26T23:03:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16397.554327 secs 2024-04-26T23:03:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17094.583391 secs 2024-04-26T23:03:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16397.554327 secs 2024-04-26T23:03:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17094.583391 secs 2024-04-26T23:03:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16397.554327 secs 2024-04-26T23:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:19 smithi092 ceph-mon[29156]: pgmap v9642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:03:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:19 smithi189 ceph-mon[32756]: pgmap v9642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:03:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:19 smithi156 ceph-mon[32679]: pgmap v9642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:03:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:03:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:03:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:03:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:20 smithi092 ceph-mon[29156]: pgmap v9643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:03:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:20 smithi092 ceph-mon[29156]: pgmap v9644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:20 smithi189 ceph-mon[32756]: pgmap v9643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:03:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:20 smithi189 ceph-mon[32756]: pgmap v9644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:20 smithi156 ceph-mon[32679]: pgmap v9643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:03:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:20 smithi156 ceph-mon[32679]: pgmap v9644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:22 smithi092 ceph-mon[29156]: pgmap v9645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:22 smithi189 ceph-mon[32756]: pgmap v9645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:22 smithi156 ceph-mon[32679]: pgmap v9645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17099.583456 secs 2024-04-26T23:03:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16402.554373 secs 2024-04-26T23:03:24.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17099.583456 secs 2024-04-26T23:03:24.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16402.554373 secs 2024-04-26T23:03:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17099.583456 secs 2024-04-26T23:03:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16402.554373 secs 2024-04-26T23:03:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:24 smithi092 ceph-mon[29156]: pgmap v9646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:24 smithi189 ceph-mon[32756]: pgmap v9646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:24 smithi156 ceph-mon[32679]: pgmap v9646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:26 smithi092 ceph-mon[29156]: pgmap v9647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:26 smithi189 ceph-mon[32756]: pgmap v9647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:26 smithi156 ceph-mon[32679]: pgmap v9647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:03:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:28 smithi092 ceph-mon[29156]: pgmap v9648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:03:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17104.583548 secs 2024-04-26T23:03:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16407.554492 secs 2024-04-26T23:03:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:28 smithi189 ceph-mon[32756]: pgmap v9648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:03:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17104.583548 secs 2024-04-26T23:03:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16407.554492 secs 2024-04-26T23:03:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:28 smithi156 ceph-mon[32679]: pgmap v9648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:03:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17104.583548 secs 2024-04-26T23:03:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16407.554492 secs 2024-04-26T23:03:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:30 smithi092 ceph-mon[29156]: pgmap v9649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:03:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:30 smithi189 ceph-mon[32756]: pgmap v9649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:03:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:30 smithi156 ceph-mon[32679]: pgmap v9649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:03:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:32 smithi189 ceph-mon[32756]: pgmap v9650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:32 smithi156 ceph-mon[32679]: pgmap v9650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:32 smithi092 ceph-mon[29156]: pgmap v9650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17109.583651 secs 2024-04-26T23:03:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16412.554579 secs 2024-04-26T23:03:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17109.583651 secs 2024-04-26T23:03:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16412.554579 secs 2024-04-26T23:03:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17109.583651 secs 2024-04-26T23:03:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16412.554579 secs 2024-04-26T23:03:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:35 smithi189 ceph-mon[32756]: pgmap v9651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:35 smithi156 ceph-mon[32679]: pgmap v9651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:35 smithi092 ceph-mon[29156]: pgmap v9651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T23:03:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:03:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca809e000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca809e000 comp rx=0 tx=0).stop 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.016+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.017+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:03:36.018 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.017+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:03:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.044+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.044+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.044+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.044+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=17 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.044+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.045+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T23:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:36.045+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T23:03:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:37 smithi189 ceph-mon[32756]: pgmap v9652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:37 smithi156 ceph-mon[32679]: pgmap v9652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:37 smithi092 ceph-mon[29156]: pgmap v9652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:38.331+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:03:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:38.331+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:03:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:38.331+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:03:38.332 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:03:38.331+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 134 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:03:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:39 smithi189 ceph-mon[32756]: pgmap v9653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17114.583751 secs 2024-04-26T23:03:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16417.554691 secs 2024-04-26T23:03:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:39 smithi156 ceph-mon[32679]: pgmap v9653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17114.583751 secs 2024-04-26T23:03:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16417.554691 secs 2024-04-26T23:03:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:39 smithi092 ceph-mon[29156]: pgmap v9653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17114.583751 secs 2024-04-26T23:03:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16417.554691 secs 2024-04-26T23:03:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:41 smithi189 ceph-mon[32756]: pgmap v9654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:41 smithi156 ceph-mon[32679]: pgmap v9654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:41 smithi092 ceph-mon[29156]: pgmap v9654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:43 smithi189 ceph-mon[32756]: pgmap v9655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:43 smithi156 ceph-mon[32679]: pgmap v9655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:43 smithi092 ceph-mon[29156]: pgmap v9655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17119.583878 secs 2024-04-26T23:03:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16422.554751 secs 2024-04-26T23:03:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17119.583878 secs 2024-04-26T23:03:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16422.554751 secs 2024-04-26T23:03:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17119.583878 secs 2024-04-26T23:03:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16422.554751 secs 2024-04-26T23:03:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:45 smithi189 ceph-mon[32756]: pgmap v9656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:45 smithi156 ceph-mon[32679]: pgmap v9656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:45 smithi092 ceph-mon[29156]: pgmap v9656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:47 smithi189 ceph-mon[32756]: pgmap v9657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:47 smithi156 ceph-mon[32679]: pgmap v9657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:47 smithi092 ceph-mon[29156]: pgmap v9657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:49 smithi092 ceph-mon[29156]: pgmap v9658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17124.584001 secs 2024-04-26T23:03:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16427.554831 secs 2024-04-26T23:03:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:49 smithi189 ceph-mon[32756]: pgmap v9658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17124.584001 secs 2024-04-26T23:03:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16427.554831 secs 2024-04-26T23:03:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:49 smithi156 ceph-mon[32679]: pgmap v9658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17124.584001 secs 2024-04-26T23:03:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16427.554831 secs 2024-04-26T23:03:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:51 smithi189 ceph-mon[32756]: pgmap v9659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:51 smithi156 ceph-mon[32679]: pgmap v9659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:51 smithi092 ceph-mon[29156]: pgmap v9659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:53 smithi189 ceph-mon[32756]: pgmap v9660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:53 smithi156 ceph-mon[32679]: pgmap v9660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:53 smithi092 ceph-mon[29156]: pgmap v9660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17129.584125 secs 2024-04-26T23:03:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16432.554903 secs 2024-04-26T23:03:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17129.584125 secs 2024-04-26T23:03:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16432.554903 secs 2024-04-26T23:03:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17129.584125 secs 2024-04-26T23:03:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16432.554903 secs 2024-04-26T23:03:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:55 smithi189 ceph-mon[32756]: pgmap v9661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:55 smithi156 ceph-mon[32679]: pgmap v9661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:55 smithi092 ceph-mon[29156]: pgmap v9661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:03:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:57 smithi189 ceph-mon[32756]: pgmap v9662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:57 smithi156 ceph-mon[32679]: pgmap v9662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:57 smithi092 ceph-mon[29156]: pgmap v9662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:59 smithi189 ceph-mon[32756]: pgmap v9663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17134.584242 secs 2024-04-26T23:03:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:03:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16437.555022 secs 2024-04-26T23:03:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:59 smithi156 ceph-mon[32679]: pgmap v9663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17134.584242 secs 2024-04-26T23:03:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:03:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16437.555022 secs 2024-04-26T23:03:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:59 smithi092 ceph-mon[29156]: pgmap v9663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:03:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17134.584242 secs 2024-04-26T23:03:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:03:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16437.555022 secs 2024-04-26T23:04:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:01 smithi189 ceph-mon[32756]: pgmap v9664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:01 smithi156 ceph-mon[32679]: pgmap v9664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:01 smithi092 ceph-mon[29156]: pgmap v9664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:03 smithi189 ceph-mon[32756]: pgmap v9665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:03 smithi156 ceph-mon[32679]: pgmap v9665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:03 smithi092 ceph-mon[29156]: pgmap v9665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17139.584359 secs 2024-04-26T23:04:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16442.555159 secs 2024-04-26T23:04:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17139.584359 secs 2024-04-26T23:04:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16442.555159 secs 2024-04-26T23:04:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17139.584359 secs 2024-04-26T23:04:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16442.555159 secs 2024-04-26T23:04:05.340 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-mon[29156]: pgmap v9666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:05 smithi189 ceph-mon[32756]: pgmap v9666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:05 smithi156 ceph-mon[32679]: pgmap v9666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:05.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:04:05.339+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:05.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:04:05.339+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:05.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:04:05.339+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:05.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:04:05.339+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:05.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:04:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:04:05.339+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:04:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:07 smithi189 ceph-mon[32756]: pgmap v9667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:07 smithi156 ceph-mon[32679]: pgmap v9667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:07 smithi092 ceph-mon[29156]: pgmap v9667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:09 smithi189 ceph-mon[32756]: pgmap v9668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17144.584477 secs 2024-04-26T23:04:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16447.555280 secs 2024-04-26T23:04:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:09 smithi156 ceph-mon[32679]: pgmap v9668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17144.584477 secs 2024-04-26T23:04:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16447.555280 secs 2024-04-26T23:04:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:09 smithi092 ceph-mon[29156]: pgmap v9668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17144.584477 secs 2024-04-26T23:04:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16447.555280 secs 2024-04-26T23:04:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:11 smithi189 ceph-mon[32756]: pgmap v9669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:11 smithi156 ceph-mon[32679]: pgmap v9669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:11 smithi092 ceph-mon[29156]: pgmap v9669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:13 smithi189 ceph-mon[32756]: pgmap v9670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:13 smithi156 ceph-mon[32679]: pgmap v9670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:13 smithi092 ceph-mon[29156]: pgmap v9670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17149.584599 secs 2024-04-26T23:04:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16452.555361 secs 2024-04-26T23:04:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:14 smithi189 ceph-mon[32756]: pgmap v9671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17149.584599 secs 2024-04-26T23:04:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16452.555361 secs 2024-04-26T23:04:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:14 smithi156 ceph-mon[32679]: pgmap v9671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17149.584599 secs 2024-04-26T23:04:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16452.555361 secs 2024-04-26T23:04:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:14 smithi092 ceph-mon[29156]: pgmap v9671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:16 smithi189 ceph-mon[32756]: pgmap v9672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:16 smithi156 ceph-mon[32679]: pgmap v9672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:16 smithi092 ceph-mon[29156]: pgmap v9672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:18 smithi189 ceph-mon[32756]: pgmap v9673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:18 smithi156 ceph-mon[32679]: pgmap v9673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:18 smithi092 ceph-mon[29156]: pgmap v9673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-26T23:04:20.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17154.584717 secs 2024-04-26T23:04:20.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16457.555494 secs 2024-04-26T23:04:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17154.584717 secs 2024-04-26T23:04:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16457.555494 secs 2024-04-26T23:04:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17154.584717 secs 2024-04-26T23:04:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16457.555494 secs 2024-04-26T23:04:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:20 smithi189 ceph-mon[32756]: pgmap v9674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:04:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:20 smithi156 ceph-mon[32679]: pgmap v9674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:04:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:20 smithi092 ceph-mon[29156]: pgmap v9674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-26T23:04:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:04:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:04:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:04:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:04:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:21 smithi189 ceph-mon[32756]: pgmap v9675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:04:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:21 smithi189 ceph-mon[32756]: pgmap v9676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:21 smithi156 ceph-mon[32679]: pgmap v9675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:04:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:21 smithi156 ceph-mon[32679]: pgmap v9676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:21 smithi092 ceph-mon[29156]: pgmap v9675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:04:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:21 smithi092 ceph-mon[29156]: pgmap v9676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:23 smithi092 ceph-mon[29156]: pgmap v9677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:23 smithi189 ceph-mon[32756]: pgmap v9677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:23 smithi156 ceph-mon[32679]: pgmap v9677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17159.584868 secs 2024-04-26T23:04:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16462.555636 secs 2024-04-26T23:04:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17159.584868 secs 2024-04-26T23:04:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16462.555636 secs 2024-04-26T23:04:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17159.584868 secs 2024-04-26T23:04:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16462.555636 secs 2024-04-26T23:04:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:25 smithi189 ceph-mon[32756]: pgmap v9678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:25 smithi156 ceph-mon[32679]: pgmap v9678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:25 smithi092 ceph-mon[29156]: pgmap v9678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:27 smithi189 ceph-mon[32756]: pgmap v9679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:27 smithi156 ceph-mon[32679]: pgmap v9679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:27 smithi092 ceph-mon[29156]: pgmap v9679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:04:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17164.584949 secs 2024-04-26T23:04:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17164.584949 secs 2024-04-26T23:04:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17164.584949 secs 2024-04-26T23:04:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:29 smithi189 ceph-mon[32756]: pgmap v9680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16467.555739 secs 2024-04-26T23:04:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:29 smithi156 ceph-mon[32679]: pgmap v9680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16467.555739 secs 2024-04-26T23:04:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:29 smithi092 ceph-mon[29156]: pgmap v9680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:04:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16467.555739 secs 2024-04-26T23:04:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:31 smithi189 ceph-mon[32756]: pgmap v9681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:04:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:31 smithi156 ceph-mon[32679]: pgmap v9681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:04:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:31 smithi092 ceph-mon[29156]: pgmap v9681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:04:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:33 smithi189 ceph-mon[32756]: pgmap v9682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17169.585039 secs 2024-04-26T23:04:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:33 smithi156 ceph-mon[32679]: pgmap v9682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17169.585039 secs 2024-04-26T23:04:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:33 smithi092 ceph-mon[29156]: pgmap v9682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17169.585039 secs 2024-04-26T23:04:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16472.555882 secs 2024-04-26T23:04:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16472.555882 secs 2024-04-26T23:04:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16472.555882 secs 2024-04-26T23:04:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:35 smithi189 ceph-mon[32756]: pgmap v9683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:35 smithi156 ceph-mon[32679]: pgmap v9683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:35 smithi092 ceph-mon[29156]: pgmap v9683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:37 smithi189 ceph-mon[32756]: pgmap v9684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:37 smithi156 ceph-mon[32679]: pgmap v9684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:37 smithi092 ceph-mon[29156]: pgmap v9684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:38 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17174.585142 secs 2024-04-26T23:04:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16477.556004 secs 2024-04-26T23:04:39.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:38 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17174.585142 secs 2024-04-26T23:04:39.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16477.556004 secs 2024-04-26T23:04:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:38 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17174.585142 secs 2024-04-26T23:04:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16477.556004 secs 2024-04-26T23:04:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:39 smithi189 ceph-mon[32756]: pgmap v9685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:39 smithi156 ceph-mon[32679]: pgmap v9685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:39 smithi092 ceph-mon[29156]: pgmap v9685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:41 smithi189 ceph-mon[32756]: pgmap v9686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:41 smithi156 ceph-mon[32679]: pgmap v9686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:41 smithi092 ceph-mon[29156]: pgmap v9686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:43 smithi189 ceph-mon[32756]: pgmap v9687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:43 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17179.585276 secs 2024-04-26T23:04:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:43 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16482.556124 secs 2024-04-26T23:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:43 smithi156 ceph-mon[32679]: pgmap v9687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:43 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17179.585276 secs 2024-04-26T23:04:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:43 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16482.556124 secs 2024-04-26T23:04:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:43 smithi092 ceph-mon[29156]: pgmap v9687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:43 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17179.585276 secs 2024-04-26T23:04:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:43 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16482.556124 secs 2024-04-26T23:04:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:45 smithi189 ceph-mon[32756]: pgmap v9688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:45 smithi156 ceph-mon[32679]: pgmap v9688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:45 smithi092 ceph-mon[29156]: pgmap v9688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:47 smithi189 ceph-mon[32756]: pgmap v9689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:47 smithi156 ceph-mon[32679]: pgmap v9689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:47 smithi092 ceph-mon[29156]: pgmap v9689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:49.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:48 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17184.585395 secs 2024-04-26T23:04:49.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16487.556268 secs 2024-04-26T23:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:48 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17184.585395 secs 2024-04-26T23:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16487.556268 secs 2024-04-26T23:04:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:48 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17184.585395 secs 2024-04-26T23:04:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16487.556268 secs 2024-04-26T23:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:49 smithi156 ceph-mon[32679]: pgmap v9690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:49 smithi092 ceph-mon[29156]: pgmap v9690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:49 smithi189 ceph-mon[32756]: pgmap v9690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:51 smithi156 ceph-mon[32679]: pgmap v9691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:51 smithi092 ceph-mon[29156]: pgmap v9691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:51 smithi189 ceph-mon[32756]: pgmap v9691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:53 smithi156 ceph-mon[32679]: pgmap v9692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17189.585487 secs 2024-04-26T23:04:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16492.556393 secs 2024-04-26T23:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:53 smithi092 ceph-mon[29156]: pgmap v9692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17189.585487 secs 2024-04-26T23:04:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16492.556393 secs 2024-04-26T23:04:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:53 smithi189 ceph-mon[32756]: pgmap v9692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17189.585487 secs 2024-04-26T23:04:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16492.556393 secs 2024-04-26T23:04:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:55 smithi156 ceph-mon[32679]: pgmap v9693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:56.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:55 smithi189 ceph-mon[32756]: pgmap v9693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:55 smithi092 ceph-mon[29156]: pgmap v9693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:04:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:57 smithi156 ceph-mon[32679]: pgmap v9694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:57 smithi092 ceph-mon[29156]: pgmap v9694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:57 smithi189 ceph-mon[32756]: pgmap v9694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:04:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17194.585634 secs 2024-04-26T23:04:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16497.556512 secs 2024-04-26T23:04:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17194.585634 secs 2024-04-26T23:04:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16497.556512 secs 2024-04-26T23:04:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17194.585634 secs 2024-04-26T23:04:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16497.556512 secs 2024-04-26T23:05:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:04:59 smithi156 ceph-mon[32679]: pgmap v9695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:04:59 smithi092 ceph-mon[29156]: pgmap v9695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:04:59 smithi189 ceph-mon[32756]: pgmap v9695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:01 smithi156 ceph-mon[32679]: pgmap v9696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:01 smithi092 ceph-mon[29156]: pgmap v9696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:01 smithi189 ceph-mon[32756]: pgmap v9696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:03 smithi156 ceph-mon[32679]: pgmap v9697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:03 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17199.585745 secs 2024-04-26T23:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:03 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16502.556633 secs 2024-04-26T23:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:03 smithi092 ceph-mon[29156]: pgmap v9697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:03 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17199.585745 secs 2024-04-26T23:05:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:03 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16502.556633 secs 2024-04-26T23:05:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:03 smithi189 ceph-mon[32756]: pgmap v9697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:03 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17199.585745 secs 2024-04-26T23:05:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:03 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16502.556633 secs 2024-04-26T23:05:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:05 smithi156 ceph-mon[32679]: pgmap v9698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:05 smithi092 ceph-mon[29156]: pgmap v9698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:05 smithi189 ceph-mon[32756]: pgmap v9698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:07 smithi156 ceph-mon[32679]: pgmap v9699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:07 smithi092 ceph-mon[29156]: pgmap v9699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:07 smithi189 ceph-mon[32756]: pgmap v9699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:08 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17204.585914 secs 2024-04-26T23:05:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16507.556710 secs 2024-04-26T23:05:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:08 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17204.585914 secs 2024-04-26T23:05:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16507.556710 secs 2024-04-26T23:05:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:08 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17204.585914 secs 2024-04-26T23:05:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16507.556710 secs 2024-04-26T23:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:09 smithi156 ceph-mon[32679]: pgmap v9700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:09 smithi092 ceph-mon[29156]: pgmap v9700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:09 smithi189 ceph-mon[32756]: pgmap v9700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:11 smithi092 ceph-mon[29156]: pgmap v9701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:11 smithi189 ceph-mon[32756]: pgmap v9701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:11 smithi156 ceph-mon[32679]: pgmap v9701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:13 smithi092 ceph-mon[29156]: pgmap v9702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:13 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17209.586015 secs 2024-04-26T23:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:13 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16512.556863 secs 2024-04-26T23:05:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:13 smithi189 ceph-mon[32756]: pgmap v9702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:13 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17209.586015 secs 2024-04-26T23:05:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:13 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16512.556863 secs 2024-04-26T23:05:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:13 smithi156 ceph-mon[32679]: pgmap v9702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:05:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:13 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17209.586015 secs 2024-04-26T23:05:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:13 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16512.556863 secs 2024-04-26T23:05:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:15 smithi092 ceph-mon[29156]: pgmap v9703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:15 smithi189 ceph-mon[32756]: pgmap v9703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:15 smithi156 ceph-mon[32679]: pgmap v9703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:05:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:17 smithi092 ceph-mon[29156]: pgmap v9704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:17 smithi189 ceph-mon[32756]: pgmap v9704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:17 smithi156 ceph-mon[32679]: pgmap v9704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:18 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17214.586094 secs 2024-04-26T23:05:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16517.556993 secs 2024-04-26T23:05:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:18 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17214.586094 secs 2024-04-26T23:05:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16517.556993 secs 2024-04-26T23:05:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:18 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17214.586094 secs 2024-04-26T23:05:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16517.556993 secs 2024-04-26T23:05:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:19 smithi092 ceph-mon[29156]: pgmap v9705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:20.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:19 smithi156 ceph-mon[32679]: pgmap v9705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:19 smithi189 ceph-mon[32756]: pgmap v9705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:05:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:05:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:05:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:21 smithi092 ceph-mon[29156]: pgmap v9706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:05:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:05:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:05:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:21 smithi189 ceph-mon[32756]: pgmap v9706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:05:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:05:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:05:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:21 smithi156 ceph-mon[32679]: pgmap v9706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:05:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:05:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:05:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:22 smithi092 ceph-mon[29156]: pgmap v9707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:05:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:22 smithi092 ceph-mon[29156]: pgmap v9708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:22 smithi189 ceph-mon[32756]: pgmap v9707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:05:23.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:22 smithi189 ceph-mon[32756]: pgmap v9708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:22 smithi156 ceph-mon[32679]: pgmap v9707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:05:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:22 smithi156 ceph-mon[32679]: pgmap v9708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:23 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17219.586178 secs 2024-04-26T23:05:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:23 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16522.557109 secs 2024-04-26T23:05:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:23 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17219.586178 secs 2024-04-26T23:05:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:23 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16522.557109 secs 2024-04-26T23:05:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:23 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17219.586178 secs 2024-04-26T23:05:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:23 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16522.557109 secs 2024-04-26T23:05:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:24 smithi092 ceph-mon[29156]: pgmap v9709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:05:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:24 smithi189 ceph-mon[32756]: pgmap v9709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:05:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:24 smithi156 ceph-mon[32679]: pgmap v9709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:05:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:26 smithi092 ceph-mon[29156]: pgmap v9710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:26 smithi189 ceph-mon[32756]: pgmap v9710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:26 smithi156 ceph-mon[32679]: pgmap v9710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:28 smithi092 ceph-mon[29156]: pgmap v9711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:28 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17224.586300 secs 2024-04-26T23:05:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16527.557172 secs 2024-04-26T23:05:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:28 smithi189 ceph-mon[32756]: pgmap v9711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:28 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17224.586300 secs 2024-04-26T23:05:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16527.557172 secs 2024-04-26T23:05:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:28 smithi156 ceph-mon[32679]: pgmap v9711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:28 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17224.586300 secs 2024-04-26T23:05:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16527.557172 secs 2024-04-26T23:05:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:30 smithi092 ceph-mon[29156]: pgmap v9712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:30 smithi189 ceph-mon[32756]: pgmap v9712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:30 smithi156 ceph-mon[32679]: pgmap v9712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:05:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:32 smithi092 ceph-mon[29156]: pgmap v9713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:05:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:32 smithi189 ceph-mon[32756]: pgmap v9713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:05:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:32 smithi156 ceph-mon[32679]: pgmap v9713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:05:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:33 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17229.586385 secs 2024-04-26T23:05:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16532.557290 secs 2024-04-26T23:05:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:33 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17229.586385 secs 2024-04-26T23:05:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16532.557290 secs 2024-04-26T23:05:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:33 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17229.586385 secs 2024-04-26T23:05:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16532.557290 secs 2024-04-26T23:05:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:34 smithi189 ceph-mon[32756]: pgmap v9714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:34 smithi156 ceph-mon[32679]: pgmap v9714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:34 smithi092 ceph-mon[29156]: pgmap v9714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:37 smithi189 ceph-mon[32756]: pgmap v9715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:37 smithi156 ceph-mon[32679]: pgmap v9715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:37 smithi092 ceph-mon[29156]: pgmap v9715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:39 smithi189 ceph-mon[32756]: pgmap v9716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17234.586513 secs 2024-04-26T23:05:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16537.557413 secs 2024-04-26T23:05:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:39 smithi156 ceph-mon[32679]: pgmap v9716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17234.586513 secs 2024-04-26T23:05:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16537.557413 secs 2024-04-26T23:05:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:39 smithi092 ceph-mon[29156]: pgmap v9716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17234.586513 secs 2024-04-26T23:05:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16537.557413 secs 2024-04-26T23:05:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:41 smithi092 ceph-mon[29156]: pgmap v9717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:41 smithi189 ceph-mon[32756]: pgmap v9717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:41 smithi156 ceph-mon[32679]: pgmap v9717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:43 smithi189 ceph-mon[32756]: pgmap v9718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:43 smithi156 ceph-mon[32679]: pgmap v9718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:43 smithi092 ceph-mon[29156]: pgmap v9718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17239.586638 secs 2024-04-26T23:05:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16542.557486 secs 2024-04-26T23:05:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17239.586638 secs 2024-04-26T23:05:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16542.557486 secs 2024-04-26T23:05:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17239.586638 secs 2024-04-26T23:05:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16542.557486 secs 2024-04-26T23:05:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:45 smithi189 ceph-mon[32756]: pgmap v9719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:45 smithi156 ceph-mon[32679]: pgmap v9719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:45 smithi092 ceph-mon[29156]: pgmap v9719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:47 smithi189 ceph-mon[32756]: pgmap v9720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:47 smithi156 ceph-mon[32679]: pgmap v9720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:47 smithi092 ceph-mon[29156]: pgmap v9720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:49 smithi092 ceph-mon[29156]: pgmap v9721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:49.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17244.586770 secs 2024-04-26T23:05:49.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16547.557547 secs 2024-04-26T23:05:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:49 smithi189 ceph-mon[32756]: pgmap v9721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17244.586770 secs 2024-04-26T23:05:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16547.557547 secs 2024-04-26T23:05:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:49 smithi156 ceph-mon[32679]: pgmap v9721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17244.586770 secs 2024-04-26T23:05:49.849 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16547.557547 secs 2024-04-26T23:05:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:51 smithi189 ceph-mon[32756]: pgmap v9722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:51 smithi156 ceph-mon[32679]: pgmap v9722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:51 smithi092 ceph-mon[29156]: pgmap v9722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:53 smithi189 ceph-mon[32756]: pgmap v9723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:53 smithi156 ceph-mon[32679]: pgmap v9723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:53 smithi092 ceph-mon[29156]: pgmap v9723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17249.586892 secs 2024-04-26T23:05:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16552.557662 secs 2024-04-26T23:05:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17249.586892 secs 2024-04-26T23:05:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16552.557662 secs 2024-04-26T23:05:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17249.586892 secs 2024-04-26T23:05:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16552.557662 secs 2024-04-26T23:05:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:55 smithi189 ceph-mon[32756]: pgmap v9724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:55.452 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:55 smithi156 ceph-mon[32679]: pgmap v9724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:55 smithi092 ceph-mon[29156]: pgmap v9724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:57 smithi092 ceph-mon[29156]: pgmap v9725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:57 smithi189 ceph-mon[32756]: pgmap v9725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:57 smithi156 ceph-mon[32679]: pgmap v9725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:05:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:59 smithi189 ceph-mon[32756]: pgmap v9726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17254.587024 secs 2024-04-26T23:05:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:05:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16557.557788 secs 2024-04-26T23:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:59 smithi156 ceph-mon[32679]: pgmap v9726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17254.587024 secs 2024-04-26T23:05:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:05:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16557.557788 secs 2024-04-26T23:05:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:59 smithi092 ceph-mon[29156]: pgmap v9726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:05:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17254.587024 secs 2024-04-26T23:05:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:05:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16557.557788 secs 2024-04-26T23:06:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:01 smithi189 ceph-mon[32756]: pgmap v9727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:01 smithi156 ceph-mon[32679]: pgmap v9727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:01 smithi092 ceph-mon[29156]: pgmap v9727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:03 smithi189 ceph-mon[32756]: pgmap v9728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:03 smithi156 ceph-mon[32679]: pgmap v9728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:03 smithi092 ceph-mon[29156]: pgmap v9728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17259.587109 secs 2024-04-26T23:06:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16562.557886 secs 2024-04-26T23:06:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17259.587109 secs 2024-04-26T23:06:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16562.557886 secs 2024-04-26T23:06:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17259.587109 secs 2024-04-26T23:06:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16562.557886 secs 2024-04-26T23:06:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:05 smithi189 ceph-mon[32756]: pgmap v9729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:05 smithi156 ceph-mon[32679]: pgmap v9729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:05 smithi092 ceph-mon[29156]: pgmap v9729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:07 smithi189 ceph-mon[32756]: pgmap v9730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:07 smithi156 ceph-mon[32679]: pgmap v9730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:07 smithi092 ceph-mon[29156]: pgmap v9730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:09 smithi189 ceph-mon[32756]: pgmap v9731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17264.587208 secs 2024-04-26T23:06:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16567.558026 secs 2024-04-26T23:06:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:09 smithi156 ceph-mon[32679]: pgmap v9731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17264.587208 secs 2024-04-26T23:06:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16567.558026 secs 2024-04-26T23:06:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:09 smithi092 ceph-mon[29156]: pgmap v9731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17264.587208 secs 2024-04-26T23:06:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16567.558026 secs 2024-04-26T23:06:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:11 smithi189 ceph-mon[32756]: pgmap v9732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:11 smithi156 ceph-mon[32679]: pgmap v9732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:11 smithi092 ceph-mon[29156]: pgmap v9732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:13 smithi189 ceph-mon[32756]: pgmap v9733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:13 smithi156 ceph-mon[32679]: pgmap v9733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:13 smithi092 ceph-mon[29156]: pgmap v9733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17269.587291 secs 2024-04-26T23:06:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16572.558144 secs 2024-04-26T23:06:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17269.587291 secs 2024-04-26T23:06:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16572.558144 secs 2024-04-26T23:06:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17269.587291 secs 2024-04-26T23:06:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16572.558144 secs 2024-04-26T23:06:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:15 smithi189 ceph-mon[32756]: pgmap v9734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:15 smithi156 ceph-mon[32679]: pgmap v9734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:15 smithi092 ceph-mon[29156]: pgmap v9734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:17 smithi189 ceph-mon[32756]: pgmap v9735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:17 smithi156 ceph-mon[32679]: pgmap v9735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:17 smithi092 ceph-mon[29156]: pgmap v9735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:19 smithi189 ceph-mon[32756]: pgmap v9736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17274.587386 secs 2024-04-26T23:06:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16577.558259 secs 2024-04-26T23:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:19 smithi156 ceph-mon[32679]: pgmap v9736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17274.587386 secs 2024-04-26T23:06:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16577.558259 secs 2024-04-26T23:06:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:19 smithi092 ceph-mon[29156]: pgmap v9736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17274.587386 secs 2024-04-26T23:06:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16577.558259 secs 2024-04-26T23:06:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:21 smithi189 ceph-mon[32756]: pgmap v9737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:21 smithi156 ceph-mon[32679]: pgmap v9737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:21 smithi092 ceph-mon[29156]: pgmap v9737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:06:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:23 smithi189 ceph-mon[32756]: pgmap v9738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:23 smithi156 ceph-mon[32679]: pgmap v9738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:23 smithi092 ceph-mon[29156]: pgmap v9738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17279.587449 secs 2024-04-26T23:06:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16582.558354 secs 2024-04-26T23:06:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17279.587449 secs 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16582.558354 secs 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17279.587449 secs 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16582.558354 secs 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: pgmap v9739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: pgmap v9739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: pgmap v9739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:06:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:06:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:06:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:06:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:06:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:06:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:06:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:27 smithi189 ceph-mon[32756]: pgmap v9740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:06:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:27 smithi189 ceph-mon[32756]: pgmap v9741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:27 smithi189 ceph-mon[32756]: pgmap v9742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:27 smithi156 ceph-mon[32679]: pgmap v9740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:06:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:27 smithi156 ceph-mon[32679]: pgmap v9741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:27 smithi156 ceph-mon[32679]: pgmap v9742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:27 smithi092 ceph-mon[29156]: pgmap v9740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:06:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:06:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:27 smithi092 ceph-mon[29156]: pgmap v9741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:27 smithi092 ceph-mon[29156]: pgmap v9742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:29 smithi189 ceph-mon[32756]: pgmap v9743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17284.587571 secs 2024-04-26T23:06:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16587.558469 secs 2024-04-26T23:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:29 smithi156 ceph-mon[32679]: pgmap v9743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17284.587571 secs 2024-04-26T23:06:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16587.558469 secs 2024-04-26T23:06:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:29 smithi092 ceph-mon[29156]: pgmap v9743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17284.587571 secs 2024-04-26T23:06:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16587.558469 secs 2024-04-26T23:06:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:31 smithi189 ceph-mon[32756]: pgmap v9744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:31 smithi156 ceph-mon[32679]: pgmap v9744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:31 smithi092 ceph-mon[29156]: pgmap v9744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:33 smithi189 ceph-mon[32756]: pgmap v9745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:33 smithi156 ceph-mon[32679]: pgmap v9745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:33 smithi092 ceph-mon[29156]: pgmap v9745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17289.587694 secs 2024-04-26T23:06:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16592.558540 secs 2024-04-26T23:06:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17289.587694 secs 2024-04-26T23:06:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16592.558540 secs 2024-04-26T23:06:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17289.587694 secs 2024-04-26T23:06:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16592.558540 secs 2024-04-26T23:06:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:35 smithi189 ceph-mon[32756]: pgmap v9746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:35 smithi156 ceph-mon[32679]: pgmap v9746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:35 smithi092 ceph-mon[29156]: pgmap v9746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:06:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:37 smithi189 ceph-mon[32756]: pgmap v9747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:37 smithi156 ceph-mon[32679]: pgmap v9747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:37 smithi092 ceph-mon[29156]: pgmap v9747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:06:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:06:38.355+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:06:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:06:38.355+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:06:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:06:38.355+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:06:38.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:06:38.355+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 135 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:06:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:39 smithi189 ceph-mon[32756]: pgmap v9748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17294.587789 secs 2024-04-26T23:06:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16597.558691 secs 2024-04-26T23:06:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:39 smithi156 ceph-mon[32679]: pgmap v9748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17294.587789 secs 2024-04-26T23:06:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16597.558691 secs 2024-04-26T23:06:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:39 smithi092 ceph-mon[29156]: pgmap v9748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17294.587789 secs 2024-04-26T23:06:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16597.558691 secs 2024-04-26T23:06:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:41 smithi189 ceph-mon[32756]: pgmap v9749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:41 smithi156 ceph-mon[32679]: pgmap v9749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:41 smithi092 ceph-mon[29156]: pgmap v9749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:43 smithi156 ceph-mon[32679]: pgmap v9750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:43 smithi092 ceph-mon[29156]: pgmap v9750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:43 smithi189 ceph-mon[32756]: pgmap v9750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17299.587906 secs 2024-04-26T23:06:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16602.558776 secs 2024-04-26T23:06:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17299.587906 secs 2024-04-26T23:06:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16602.558776 secs 2024-04-26T23:06:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17299.587906 secs 2024-04-26T23:06:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16602.558776 secs 2024-04-26T23:06:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:45 smithi156 ceph-mon[32679]: pgmap v9751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:45 smithi092 ceph-mon[29156]: pgmap v9751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:45 smithi189 ceph-mon[32756]: pgmap v9751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:47 smithi156 ceph-mon[32679]: pgmap v9752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:47 smithi092 ceph-mon[29156]: pgmap v9752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:47 smithi189 ceph-mon[32756]: pgmap v9752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:49 smithi156 ceph-mon[32679]: pgmap v9753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17304.588061 secs 2024-04-26T23:06:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16607.558869 secs 2024-04-26T23:06:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:49 smithi092 ceph-mon[29156]: pgmap v9753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17304.588061 secs 2024-04-26T23:06:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16607.558869 secs 2024-04-26T23:06:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:49 smithi189 ceph-mon[32756]: pgmap v9753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17304.588061 secs 2024-04-26T23:06:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16607.558869 secs 2024-04-26T23:06:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:51 smithi156 ceph-mon[32679]: pgmap v9754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:51 smithi092 ceph-mon[29156]: pgmap v9754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:51 smithi189 ceph-mon[32756]: pgmap v9754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:53 smithi156 ceph-mon[32679]: pgmap v9755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:53 smithi092 ceph-mon[29156]: pgmap v9755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:53 smithi189 ceph-mon[32756]: pgmap v9755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17309.588162 secs 2024-04-26T23:06:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16612.558949 secs 2024-04-26T23:06:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17309.588162 secs 2024-04-26T23:06:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16612.558949 secs 2024-04-26T23:06:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17309.588162 secs 2024-04-26T23:06:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16612.558949 secs 2024-04-26T23:06:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:55 smithi156 ceph-mon[32679]: pgmap v9756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:55 smithi092 ceph-mon[29156]: pgmap v9756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:55 smithi189 ceph-mon[32756]: pgmap v9756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:57 smithi156 ceph-mon[32679]: pgmap v9757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:57.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:57 smithi189 ceph-mon[32756]: pgmap v9757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:57 smithi092 ceph-mon[29156]: pgmap v9757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:59 smithi156 ceph-mon[32679]: pgmap v9758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17314.588314 secs 2024-04-26T23:06:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:06:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16617.559091 secs 2024-04-26T23:06:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:59 smithi092 ceph-mon[29156]: pgmap v9758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17314.588314 secs 2024-04-26T23:06:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:06:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16617.559091 secs 2024-04-26T23:06:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:59 smithi189 ceph-mon[32756]: pgmap v9758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:06:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17314.588314 secs 2024-04-26T23:06:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:06:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16617.559091 secs 2024-04-26T23:07:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:01 smithi156 ceph-mon[32679]: pgmap v9759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:01 smithi092 ceph-mon[29156]: pgmap v9759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:01 smithi189 ceph-mon[32756]: pgmap v9759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:03 smithi156 ceph-mon[32679]: pgmap v9760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:03 smithi092 ceph-mon[29156]: pgmap v9760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:03 smithi189 ceph-mon[32756]: pgmap v9760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17319.588444 secs 2024-04-26T23:07:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16622.559198 secs 2024-04-26T23:07:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17319.588444 secs 2024-04-26T23:07:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16622.559198 secs 2024-04-26T23:07:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17319.588444 secs 2024-04-26T23:07:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16622.559198 secs 2024-04-26T23:07:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:05 smithi092 ceph-mon[29156]: pgmap v9761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:05 smithi189 ceph-mon[32756]: pgmap v9761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:05 smithi156 ceph-mon[32679]: pgmap v9761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:07 smithi092 ceph-mon[29156]: pgmap v9762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:07 smithi189 ceph-mon[32756]: pgmap v9762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:07 smithi156 ceph-mon[32679]: pgmap v9762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:09 smithi092 ceph-mon[29156]: pgmap v9763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17324.588565 secs 2024-04-26T23:07:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16627.559258 secs 2024-04-26T23:07:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:09 smithi189 ceph-mon[32756]: pgmap v9763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17324.588565 secs 2024-04-26T23:07:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16627.559258 secs 2024-04-26T23:07:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:09 smithi156 ceph-mon[32679]: pgmap v9763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17324.588565 secs 2024-04-26T23:07:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16627.559258 secs 2024-04-26T23:07:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:11 smithi092 ceph-mon[29156]: pgmap v9764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:11 smithi189 ceph-mon[32756]: pgmap v9764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:11 smithi156 ceph-mon[32679]: pgmap v9764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:13 smithi092 ceph-mon[29156]: pgmap v9765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:13 smithi189 ceph-mon[32756]: pgmap v9765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:13 smithi156 ceph-mon[32679]: pgmap v9765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17329.588683 secs 2024-04-26T23:07:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16632.559322 secs 2024-04-26T23:07:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17329.588683 secs 2024-04-26T23:07:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16632.559322 secs 2024-04-26T23:07:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17329.588683 secs 2024-04-26T23:07:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16632.559322 secs 2024-04-26T23:07:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:15 smithi092 ceph-mon[29156]: pgmap v9766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:15 smithi189 ceph-mon[32756]: pgmap v9766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:15 smithi156 ceph-mon[32679]: pgmap v9766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:17 smithi092 ceph-mon[29156]: pgmap v9767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:17 smithi189 ceph-mon[32756]: pgmap v9767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:17 smithi156 ceph-mon[32679]: pgmap v9767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:19 smithi092 ceph-mon[29156]: pgmap v9768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17334.588835 secs 2024-04-26T23:07:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16637.559391 secs 2024-04-26T23:07:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:19 smithi189 ceph-mon[32756]: pgmap v9768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17334.588835 secs 2024-04-26T23:07:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16637.559391 secs 2024-04-26T23:07:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:19 smithi156 ceph-mon[32679]: pgmap v9768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17334.588835 secs 2024-04-26T23:07:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16637.559391 secs 2024-04-26T23:07:21.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:21 smithi156 ceph-mon[32679]: pgmap v9769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:21 smithi092 ceph-mon[29156]: pgmap v9769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:21 smithi189 ceph-mon[32756]: pgmap v9769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:07:23.362+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:07:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:07:23.362+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:07:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:07:23.362+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:07:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:07:23.362+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 136 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:07:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:23 smithi092 ceph-mon[29156]: pgmap v9770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:23 smithi189 ceph-mon[32756]: pgmap v9770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:23 smithi156 ceph-mon[32679]: pgmap v9770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17339.588915 secs 2024-04-26T23:07:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16642.559501 secs 2024-04-26T23:07:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17339.588915 secs 2024-04-26T23:07:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16642.559501 secs 2024-04-26T23:07:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17339.588915 secs 2024-04-26T23:07:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16642.559501 secs 2024-04-26T23:07:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:25 smithi092 ceph-mon[29156]: pgmap v9771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:25 smithi189 ceph-mon[32756]: pgmap v9771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:25 smithi156 ceph-mon[32679]: pgmap v9771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:07:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:07:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:07:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:07:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:07:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:07:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:07:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:07:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:07:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:07:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:07:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:27 smithi092 ceph-mon[29156]: pgmap v9772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:27 smithi092 ceph-mon[29156]: pgmap v9773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:07:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:27 smithi092 ceph-mon[29156]: pgmap v9774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:27.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:27 smithi189 ceph-mon[32756]: pgmap v9772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:27.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:27 smithi189 ceph-mon[32756]: pgmap v9773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:07:27.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:27 smithi189 ceph-mon[32756]: pgmap v9774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:27 smithi156 ceph-mon[32679]: pgmap v9772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:27 smithi156 ceph-mon[32679]: pgmap v9773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:07:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:27 smithi156 ceph-mon[32679]: pgmap v9774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:29 smithi092 ceph-mon[29156]: pgmap v9775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:07:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17344.589040 secs 2024-04-26T23:07:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16647.559583 secs 2024-04-26T23:07:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:29 smithi189 ceph-mon[32756]: pgmap v9775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:07:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17344.589040 secs 2024-04-26T23:07:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16647.559583 secs 2024-04-26T23:07:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:29 smithi156 ceph-mon[32679]: pgmap v9775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:07:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17344.589040 secs 2024-04-26T23:07:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16647.559583 secs 2024-04-26T23:07:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:31 smithi092 ceph-mon[29156]: pgmap v9776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:31 smithi189 ceph-mon[32756]: pgmap v9776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:31 smithi156 ceph-mon[32679]: pgmap v9776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:33 smithi189 ceph-mon[32756]: pgmap v9777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:33 smithi156 ceph-mon[32679]: pgmap v9777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:33 smithi092 ceph-mon[29156]: pgmap v9777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17349.589128 secs 2024-04-26T23:07:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16652.559669 secs 2024-04-26T23:07:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17349.589128 secs 2024-04-26T23:07:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16652.559669 secs 2024-04-26T23:07:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17349.589128 secs 2024-04-26T23:07:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16652.559669 secs 2024-04-26T23:07:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:35 smithi189 ceph-mon[32756]: pgmap v9778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:35 smithi156 ceph-mon[32679]: pgmap v9778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:35 smithi092 ceph-mon[29156]: pgmap v9778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:37 smithi189 ceph-mon[32756]: pgmap v9779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:07:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:37 smithi156 ceph-mon[32679]: pgmap v9779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:07:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:37 smithi092 ceph-mon[29156]: pgmap v9779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:07:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:39 smithi189 ceph-mon[32756]: pgmap v9780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17354.589217 secs 2024-04-26T23:07:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16657.559790 secs 2024-04-26T23:07:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:39 smithi156 ceph-mon[32679]: pgmap v9780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17354.589217 secs 2024-04-26T23:07:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16657.559790 secs 2024-04-26T23:07:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:39 smithi092 ceph-mon[29156]: pgmap v9780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17354.589217 secs 2024-04-26T23:07:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16657.559790 secs 2024-04-26T23:07:41.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:41 smithi189 ceph-mon[32756]: pgmap v9781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:41 smithi156 ceph-mon[32679]: pgmap v9781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:41 smithi092 ceph-mon[29156]: pgmap v9781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:43 smithi189 ceph-mon[32756]: pgmap v9782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:43 smithi156 ceph-mon[32679]: pgmap v9782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:43 smithi092 ceph-mon[29156]: pgmap v9782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17359.589338 secs 2024-04-26T23:07:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16662.559930 secs 2024-04-26T23:07:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17359.589338 secs 2024-04-26T23:07:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16662.559930 secs 2024-04-26T23:07:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17359.589338 secs 2024-04-26T23:07:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16662.559930 secs 2024-04-26T23:07:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:45 smithi189 ceph-mon[32756]: pgmap v9783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:45 smithi156 ceph-mon[32679]: pgmap v9783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:45 smithi092 ceph-mon[29156]: pgmap v9783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:46 smithi189 ceph-mon[32756]: pgmap v9784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:46 smithi156 ceph-mon[32679]: pgmap v9784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:46 smithi092 ceph-mon[29156]: pgmap v9784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:49 smithi092 ceph-mon[29156]: pgmap v9785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17364.589461 secs 2024-04-26T23:07:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16667.560025 secs 2024-04-26T23:07:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:49 smithi189 ceph-mon[32756]: pgmap v9785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17364.589461 secs 2024-04-26T23:07:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16667.560025 secs 2024-04-26T23:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:49 smithi156 ceph-mon[32679]: pgmap v9785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-26T23:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17364.589461 secs 2024-04-26T23:07:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16667.560025 secs 2024-04-26T23:07:51.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:51 smithi156 ceph-mon[32679]: pgmap v9786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:51 smithi092 ceph-mon[29156]: pgmap v9786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:51 smithi189 ceph-mon[32756]: pgmap v9786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:07:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:53 smithi092 ceph-mon[29156]: pgmap v9787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:53 smithi189 ceph-mon[32756]: pgmap v9787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:53 smithi156 ceph-mon[32679]: pgmap v9787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17369.589576 secs 2024-04-26T23:07:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16672.560161 secs 2024-04-26T23:07:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17369.589576 secs 2024-04-26T23:07:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16672.560161 secs 2024-04-26T23:07:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17369.589576 secs 2024-04-26T23:07:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16672.560161 secs 2024-04-26T23:07:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:55 smithi092 ceph-mon[29156]: pgmap v9788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:55 smithi189 ceph-mon[32756]: pgmap v9788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:55 smithi156 ceph-mon[32679]: pgmap v9788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:07:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:57 smithi092 ceph-mon[29156]: pgmap v9789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:57 smithi189 ceph-mon[32756]: pgmap v9789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:57 smithi156 ceph-mon[32679]: pgmap v9789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:59 smithi092 ceph-mon[29156]: pgmap v9790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17374.589697 secs 2024-04-26T23:07:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:07:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16677.560282 secs 2024-04-26T23:07:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:59 smithi189 ceph-mon[32756]: pgmap v9790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17374.589697 secs 2024-04-26T23:07:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:07:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16677.560282 secs 2024-04-26T23:07:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:59 smithi156 ceph-mon[32679]: pgmap v9790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:07:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17374.589697 secs 2024-04-26T23:07:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:07:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16677.560282 secs 2024-04-26T23:08:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:01 smithi092 ceph-mon[29156]: pgmap v9791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:01 smithi189 ceph-mon[32756]: pgmap v9791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:01 smithi156 ceph-mon[32679]: pgmap v9791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:03 smithi092 ceph-mon[29156]: pgmap v9792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:03 smithi189 ceph-mon[32756]: pgmap v9792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:03 smithi156 ceph-mon[32679]: pgmap v9792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17379.589762 secs 2024-04-26T23:08:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16682.560384 secs 2024-04-26T23:08:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17379.589762 secs 2024-04-26T23:08:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16682.560384 secs 2024-04-26T23:08:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17379.589762 secs 2024-04-26T23:08:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16682.560384 secs 2024-04-26T23:08:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:05 smithi092 ceph-mon[29156]: pgmap v9793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:05 smithi189 ceph-mon[32756]: pgmap v9793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:05 smithi156 ceph-mon[32679]: pgmap v9793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:07 smithi092 ceph-mon[29156]: pgmap v9794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:07 smithi189 ceph-mon[32756]: pgmap v9794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:07 smithi156 ceph-mon[32679]: pgmap v9794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:09 smithi189 ceph-mon[32756]: pgmap v9795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17384.589908 secs 2024-04-26T23:08:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16687.560481 secs 2024-04-26T23:08:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:09 smithi156 ceph-mon[32679]: pgmap v9795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17384.589908 secs 2024-04-26T23:08:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16687.560481 secs 2024-04-26T23:08:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:09 smithi092 ceph-mon[29156]: pgmap v9795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17384.589908 secs 2024-04-26T23:08:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16687.560481 secs 2024-04-26T23:08:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:11 smithi189 ceph-mon[32756]: pgmap v9796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:11 smithi156 ceph-mon[32679]: pgmap v9796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:11 smithi092 ceph-mon[29156]: pgmap v9796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:13 smithi189 ceph-mon[32756]: pgmap v9797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:13 smithi156 ceph-mon[32679]: pgmap v9797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:13 smithi092 ceph-mon[29156]: pgmap v9797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17389.589971 secs 2024-04-26T23:08:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16692.560627 secs 2024-04-26T23:08:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:14 smithi189 ceph-mon[32756]: pgmap v9798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17389.589971 secs 2024-04-26T23:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16692.560627 secs 2024-04-26T23:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:14 smithi156 ceph-mon[32679]: pgmap v9798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17389.589971 secs 2024-04-26T23:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16692.560627 secs 2024-04-26T23:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:14 smithi092 ceph-mon[29156]: pgmap v9798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:17 smithi092 ceph-mon[29156]: pgmap v9799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:17 smithi189 ceph-mon[32756]: pgmap v9799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:17 smithi156 ceph-mon[32679]: pgmap v9799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:19 smithi092 ceph-mon[29156]: pgmap v9800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17394.590074 secs 2024-04-26T23:08:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16697.560747 secs 2024-04-26T23:08:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:19 smithi189 ceph-mon[32756]: pgmap v9800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17394.590074 secs 2024-04-26T23:08:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16697.560747 secs 2024-04-26T23:08:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:19 smithi156 ceph-mon[32679]: pgmap v9800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17394.590074 secs 2024-04-26T23:08:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16697.560747 secs 2024-04-26T23:08:21.485 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:21 smithi156 ceph-mon[32679]: pgmap v9801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:21 smithi092 ceph-mon[29156]: pgmap v9801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:21 smithi189 ceph-mon[32756]: pgmap v9801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:23 smithi092 ceph-mon[29156]: pgmap v9802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:23 smithi189 ceph-mon[32756]: pgmap v9802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:23 smithi156 ceph-mon[32679]: pgmap v9802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17399.590200 secs 2024-04-26T23:08:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16702.560816 secs 2024-04-26T23:08:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17399.590200 secs 2024-04-26T23:08:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16702.560816 secs 2024-04-26T23:08:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17399.590200 secs 2024-04-26T23:08:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16702.560816 secs 2024-04-26T23:08:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:25 smithi092 ceph-mon[29156]: pgmap v9803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:25 smithi189 ceph-mon[32756]: pgmap v9803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:25 smithi156 ceph-mon[32679]: pgmap v9803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:27 smithi092 ceph-mon[29156]: pgmap v9804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:08:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:08:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:08:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:08:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:27 smithi189 ceph-mon[32756]: pgmap v9804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:08:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:08:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:08:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:08:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:27 smithi156 ceph-mon[32679]: pgmap v9804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:08:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:08:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:08:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:08:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:28 smithi092 ceph-mon[29156]: pgmap v9805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:08:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:28 smithi092 ceph-mon[29156]: pgmap v9806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:28 smithi189 ceph-mon[32756]: pgmap v9805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:08:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:28 smithi189 ceph-mon[32756]: pgmap v9806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:28 smithi156 ceph-mon[32679]: pgmap v9805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:08:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:28 smithi156 ceph-mon[32679]: pgmap v9806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17404.590322 secs 2024-04-26T23:08:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16707.560954 secs 2024-04-26T23:08:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17404.590322 secs 2024-04-26T23:08:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16707.560954 secs 2024-04-26T23:08:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17404.590322 secs 2024-04-26T23:08:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16707.560954 secs 2024-04-26T23:08:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:30 smithi092 ceph-mon[29156]: pgmap v9807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:30 smithi189 ceph-mon[32756]: pgmap v9807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:30 smithi156 ceph-mon[32679]: pgmap v9807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:32 smithi189 ceph-mon[32756]: pgmap v9808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:32 smithi156 ceph-mon[32679]: pgmap v9808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:32 smithi092 ceph-mon[29156]: pgmap v9808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:34 smithi189 ceph-mon[32756]: pgmap v9809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:08:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17409.590447 secs 2024-04-26T23:08:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16712.561090 secs 2024-04-26T23:08:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:34 smithi156 ceph-mon[32679]: pgmap v9809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:08:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17409.590447 secs 2024-04-26T23:08:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16712.561090 secs 2024-04-26T23:08:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:34 smithi092 ceph-mon[29156]: pgmap v9809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:08:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17409.590447 secs 2024-04-26T23:08:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16712.561090 secs 2024-04-26T23:08:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:36 smithi189 ceph-mon[32756]: pgmap v9810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:36 smithi156 ceph-mon[32679]: pgmap v9810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:36 smithi092 ceph-mon[29156]: pgmap v9810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:08:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:38 smithi189 ceph-mon[32756]: pgmap v9811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:08:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:38 smithi156 ceph-mon[32679]: pgmap v9811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:08:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:38 smithi092 ceph-mon[29156]: pgmap v9811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:08:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17414.590596 secs 2024-04-26T23:08:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16717.561205 secs 2024-04-26T23:08:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17414.590596 secs 2024-04-26T23:08:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16717.561205 secs 2024-04-26T23:08:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17414.590596 secs 2024-04-26T23:08:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16717.561205 secs 2024-04-26T23:08:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:40 smithi189 ceph-mon[32756]: pgmap v9812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:40 smithi156 ceph-mon[32679]: pgmap v9812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:40 smithi092 ceph-mon[29156]: pgmap v9812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:42 smithi189 ceph-mon[32756]: pgmap v9813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:42 smithi156 ceph-mon[32679]: pgmap v9813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:42 smithi092 ceph-mon[29156]: pgmap v9813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:44 smithi189 ceph-mon[32756]: pgmap v9814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17419.590663 secs 2024-04-26T23:08:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16722.561321 secs 2024-04-26T23:08:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:44 smithi156 ceph-mon[32679]: pgmap v9814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17419.590663 secs 2024-04-26T23:08:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16722.561321 secs 2024-04-26T23:08:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:44 smithi092 ceph-mon[29156]: pgmap v9814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17419.590663 secs 2024-04-26T23:08:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16722.561321 secs 2024-04-26T23:08:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:46 smithi189 ceph-mon[32756]: pgmap v9815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:46 smithi156 ceph-mon[32679]: pgmap v9815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:46 smithi092 ceph-mon[29156]: pgmap v9815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:48 smithi189 ceph-mon[32756]: pgmap v9816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:48 smithi156 ceph-mon[32679]: pgmap v9816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:48 smithi092 ceph-mon[29156]: pgmap v9816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17424.590802 secs 2024-04-26T23:08:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16727.561435 secs 2024-04-26T23:08:49.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17424.590802 secs 2024-04-26T23:08:49.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16727.561435 secs 2024-04-26T23:08:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17424.590802 secs 2024-04-26T23:08:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16727.561435 secs 2024-04-26T23:08:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:50 smithi189 ceph-mon[32756]: pgmap v9817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:50 smithi156 ceph-mon[32679]: pgmap v9817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:50 smithi092 ceph-mon[29156]: pgmap v9817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:51.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:51 smithi156 ceph-mon[32679]: pgmap v9818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:51.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:51 smithi189 ceph-mon[32756]: pgmap v9818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:51.755 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:51 smithi092 ceph-mon[29156]: pgmap v9818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:53 smithi092 ceph-mon[29156]: pgmap v9819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:53 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17429.590937 secs 2024-04-26T23:08:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:53 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16732.561498 secs 2024-04-26T23:08:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:53 smithi189 ceph-mon[32756]: pgmap v9819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:53 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17429.590937 secs 2024-04-26T23:08:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:53 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16732.561498 secs 2024-04-26T23:08:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:53 smithi156 ceph-mon[32679]: pgmap v9819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:53 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17429.590937 secs 2024-04-26T23:08:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:53 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16732.561498 secs 2024-04-26T23:08:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:55 smithi092 ceph-mon[29156]: pgmap v9820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:55 smithi189 ceph-mon[32756]: pgmap v9820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:55 smithi156 ceph-mon[32679]: pgmap v9820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:08:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:57 smithi092 ceph-mon[29156]: pgmap v9821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:57 smithi189 ceph-mon[32756]: pgmap v9821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:57 smithi156 ceph-mon[32679]: pgmap v9821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:08:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:58 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17434.591055 secs 2024-04-26T23:08:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:08:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16737.561603 secs 2024-04-26T23:08:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:58 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17434.591055 secs 2024-04-26T23:08:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:08:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16737.561603 secs 2024-04-26T23:08:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:58 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17434.591055 secs 2024-04-26T23:08:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:08:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16737.561603 secs 2024-04-26T23:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:00 smithi189 ceph-mon[32756]: pgmap v9822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:00 smithi156 ceph-mon[32679]: pgmap v9822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:00 smithi092 ceph-mon[29156]: pgmap v9822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:02 smithi189 ceph-mon[32756]: pgmap v9823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:02 smithi156 ceph-mon[32679]: pgmap v9823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:02 smithi092 ceph-mon[29156]: pgmap v9823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:04 smithi189 ceph-mon[32756]: pgmap v9824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17439.591141 secs 2024-04-26T23:09:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16742.561723 secs 2024-04-26T23:09:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:04 smithi156 ceph-mon[32679]: pgmap v9824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17439.591141 secs 2024-04-26T23:09:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16742.561723 secs 2024-04-26T23:09:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:04 smithi092 ceph-mon[29156]: pgmap v9824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17439.591141 secs 2024-04-26T23:09:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16742.561723 secs 2024-04-26T23:09:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:06 smithi189 ceph-mon[32756]: pgmap v9825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:06 smithi156 ceph-mon[32679]: pgmap v9825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:06 smithi092 ceph-mon[29156]: pgmap v9825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:08 smithi189 ceph-mon[32756]: pgmap v9826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:08 smithi156 ceph-mon[32679]: pgmap v9826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:08 smithi092 ceph-mon[29156]: pgmap v9826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17444.591263 secs 2024-04-26T23:09:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16747.561860 secs 2024-04-26T23:09:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17444.591263 secs 2024-04-26T23:09:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16747.561860 secs 2024-04-26T23:09:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17444.591263 secs 2024-04-26T23:09:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16747.561860 secs 2024-04-26T23:09:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:10 smithi189 ceph-mon[32756]: pgmap v9827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:10 smithi156 ceph-mon[32679]: pgmap v9827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:10 smithi092 ceph-mon[29156]: pgmap v9827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:12 smithi189 ceph-mon[32756]: pgmap v9828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:12 smithi156 ceph-mon[32679]: pgmap v9828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:12 smithi092 ceph-mon[29156]: pgmap v9828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:14 smithi189 ceph-mon[32756]: pgmap v9829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17449.591380 secs 2024-04-26T23:09:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16752.561986 secs 2024-04-26T23:09:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:14 smithi156 ceph-mon[32679]: pgmap v9829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17449.591380 secs 2024-04-26T23:09:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16752.561986 secs 2024-04-26T23:09:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:14 smithi092 ceph-mon[29156]: pgmap v9829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17449.591380 secs 2024-04-26T23:09:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16752.561986 secs 2024-04-26T23:09:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:16 smithi189 ceph-mon[32756]: pgmap v9830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:16 smithi156 ceph-mon[32679]: pgmap v9830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:16 smithi092 ceph-mon[29156]: pgmap v9830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:18 smithi189 ceph-mon[32756]: pgmap v9831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:18 smithi156 ceph-mon[32679]: pgmap v9831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:18 smithi092 ceph-mon[29156]: pgmap v9831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17454.591510 secs 2024-04-26T23:09:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16757.562097 secs 2024-04-26T23:09:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17454.591510 secs 2024-04-26T23:09:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16757.562097 secs 2024-04-26T23:09:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17454.591510 secs 2024-04-26T23:09:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16757.562097 secs 2024-04-26T23:09:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:20 smithi189 ceph-mon[32756]: pgmap v9832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:20 smithi156 ceph-mon[32679]: pgmap v9832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:20 smithi092 ceph-mon[29156]: pgmap v9832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:22 smithi189 ceph-mon[32756]: pgmap v9833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:22 smithi156 ceph-mon[32679]: pgmap v9833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:22 smithi092 ceph-mon[29156]: pgmap v9833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:24 smithi189 ceph-mon[32756]: pgmap v9834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17459.591663 secs 2024-04-26T23:09:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16762.562231 secs 2024-04-26T23:09:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:24 smithi156 ceph-mon[32679]: pgmap v9834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17459.591663 secs 2024-04-26T23:09:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16762.562231 secs 2024-04-26T23:09:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:24 smithi092 ceph-mon[29156]: pgmap v9834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17459.591663 secs 2024-04-26T23:09:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16762.562231 secs 2024-04-26T23:09:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:26 smithi189 ceph-mon[32756]: pgmap v9835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:26 smithi156 ceph-mon[32679]: pgmap v9835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:26 smithi092 ceph-mon[29156]: pgmap v9835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:09:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:09:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:09:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:28 smithi189 ceph-mon[32756]: pgmap v9836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:09:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:09:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:09:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:28 smithi156 ceph-mon[32679]: pgmap v9836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:09:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:09:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:09:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:28 smithi092 ceph-mon[29156]: pgmap v9836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:09:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:09:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:09:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:29 smithi189 ceph-mon[32756]: pgmap v9837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:09:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:29 smithi189 ceph-mon[32756]: pgmap v9838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:09:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17464.591801 secs 2024-04-26T23:09:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16767.562324 secs 2024-04-26T23:09:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:29 smithi156 ceph-mon[32679]: pgmap v9837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:09:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:29 smithi156 ceph-mon[32679]: pgmap v9838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:09:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17464.591801 secs 2024-04-26T23:09:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16767.562324 secs 2024-04-26T23:09:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:29 smithi092 ceph-mon[29156]: pgmap v9837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:09:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:29 smithi092 ceph-mon[29156]: pgmap v9838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:09:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17464.591801 secs 2024-04-26T23:09:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16767.562324 secs 2024-04-26T23:09:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:31 smithi189 ceph-mon[32756]: pgmap v9839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:31 smithi156 ceph-mon[32679]: pgmap v9839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:31 smithi092 ceph-mon[29156]: pgmap v9839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:33 smithi189 ceph-mon[32756]: pgmap v9840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:33 smithi156 ceph-mon[32679]: pgmap v9840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:33 smithi092 ceph-mon[29156]: pgmap v9840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 17469.591896 secs 2024-04-26T23:09:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16772.562390 secs 2024-04-26T23:09:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 17469.591896 secs 2024-04-26T23:09:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16772.562390 secs 2024-04-26T23:09:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 17469.591896 secs 2024-04-26T23:09:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16772.562390 secs 2024-04-26T23:09:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:35 smithi189 ceph-mon[32756]: pgmap v9841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:35.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-mon[29156]: pgmap v9841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:35 smithi156 ceph-mon[32679]: pgmap v9841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:35.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:09:35.388+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:09:35.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:09:35.388+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:09:35.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:09:35.388+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:09:35.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:09:35.388+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:09:35.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:09:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:09:35.388+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:09:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:37 smithi189 ceph-mon[32756]: pgmap v9842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:37 smithi156 ceph-mon[32679]: pgmap v9842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:37 smithi092 ceph-mon[29156]: pgmap v9842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:09:38.380 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:09:38.381+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:09:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:09:38.381+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:09:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:09:38.381+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:09:38.381 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:09:38.381+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 137 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:09:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:39 smithi189 ceph-mon[32756]: pgmap v9843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:09:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17474.592011 secs 2024-04-26T23:09:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16777.562493 secs 2024-04-26T23:09:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:39 smithi156 ceph-mon[32679]: pgmap v9843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:09:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17474.592011 secs 2024-04-26T23:09:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16777.562493 secs 2024-04-26T23:09:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:39 smithi092 ceph-mon[29156]: pgmap v9843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:09:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17474.592011 secs 2024-04-26T23:09:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16777.562493 secs 2024-04-26T23:09:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:41 smithi189 ceph-mon[32756]: pgmap v9844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:41 smithi156 ceph-mon[32679]: pgmap v9844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:41 smithi092 ceph-mon[29156]: pgmap v9844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:43 smithi189 ceph-mon[32756]: pgmap v9845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:09:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:09:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:43 smithi156 ceph-mon[32679]: pgmap v9845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:09:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:09:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:43 smithi092 ceph-mon[29156]: pgmap v9845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:09:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:09:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17479.592131 secs 2024-04-26T23:09:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16782.562602 secs 2024-04-26T23:09:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17479.592131 secs 2024-04-26T23:09:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16782.562602 secs 2024-04-26T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17479.592131 secs 2024-04-26T23:09:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16782.562602 secs 2024-04-26T23:09:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:45 smithi189 ceph-mon[32756]: pgmap v9846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:45.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:45 smithi092 ceph-mon[29156]: pgmap v9846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:45.562 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:45 smithi156 ceph-mon[32679]: pgmap v9846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:47 smithi189 ceph-mon[32756]: pgmap v9847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:47 smithi156 ceph-mon[32679]: pgmap v9847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:47 smithi092 ceph-mon[29156]: pgmap v9847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:49 smithi189 ceph-mon[32756]: pgmap v9848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17484.592248 secs 2024-04-26T23:09:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16787.562666 secs 2024-04-26T23:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:49 smithi156 ceph-mon[32679]: pgmap v9848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17484.592248 secs 2024-04-26T23:09:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16787.562666 secs 2024-04-26T23:09:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:49 smithi092 ceph-mon[29156]: pgmap v9848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-26T23:09:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17484.592248 secs 2024-04-26T23:09:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16787.562666 secs 2024-04-26T23:09:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:51 smithi189 ceph-mon[32756]: pgmap v9849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:51 smithi156 ceph-mon[32679]: pgmap v9849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:51 smithi092 ceph-mon[29156]: pgmap v9849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-26T23:09:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:53 smithi189 ceph-mon[32756]: pgmap v9850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:53 smithi156 ceph-mon[32679]: pgmap v9850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:53 smithi092 ceph-mon[29156]: pgmap v9850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17489.592328 secs 2024-04-26T23:09:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16792.562783 secs 2024-04-26T23:09:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17489.592328 secs 2024-04-26T23:09:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16792.562783 secs 2024-04-26T23:09:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17489.592328 secs 2024-04-26T23:09:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16792.562783 secs 2024-04-26T23:09:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:55 smithi189 ceph-mon[32756]: pgmap v9851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:55 smithi156 ceph-mon[32679]: pgmap v9851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:55 smithi092 ceph-mon[29156]: pgmap v9851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:09:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:57 smithi189 ceph-mon[32756]: pgmap v9852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:57 smithi156 ceph-mon[32679]: pgmap v9852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:57 smithi092 ceph-mon[29156]: pgmap v9852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:59 smithi189 ceph-mon[32756]: pgmap v9853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17494.592459 secs 2024-04-26T23:09:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:09:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16797.562889 secs 2024-04-26T23:09:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:59 smithi156 ceph-mon[32679]: pgmap v9853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17494.592459 secs 2024-04-26T23:09:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:09:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16797.562889 secs 2024-04-26T23:09:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:59 smithi092 ceph-mon[29156]: pgmap v9853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:09:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17494.592459 secs 2024-04-26T23:09:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:09:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16797.562889 secs 2024-04-26T23:10:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:10:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:01 smithi156 ceph-mon[32679]: pgmap v9854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:01 smithi092 ceph-mon[29156]: pgmap v9854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:01 smithi189 ceph-mon[32756]: pgmap v9854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:03 smithi156 ceph-mon[32679]: pgmap v9855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:03 smithi092 ceph-mon[29156]: pgmap v9855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:03 smithi189 ceph-mon[32756]: pgmap v9855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17499.592593 secs 2024-04-26T23:10:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16802.562999 secs 2024-04-26T23:10:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17499.592593 secs 2024-04-26T23:10:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16802.562999 secs 2024-04-26T23:10:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17499.592593 secs 2024-04-26T23:10:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16802.562999 secs 2024-04-26T23:10:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:05 smithi156 ceph-mon[32679]: pgmap v9856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:05 smithi092 ceph-mon[29156]: pgmap v9856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:05 smithi189 ceph-mon[32756]: pgmap v9856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:07 smithi156 ceph-mon[32679]: pgmap v9857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:07 smithi092 ceph-mon[29156]: pgmap v9857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:07 smithi189 ceph-mon[32756]: pgmap v9857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:09 smithi156 ceph-mon[32679]: pgmap v9858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17504.592687 secs 2024-04-26T23:10:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16807.563125 secs 2024-04-26T23:10:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:09 smithi092 ceph-mon[29156]: pgmap v9858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17504.592687 secs 2024-04-26T23:10:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16807.563125 secs 2024-04-26T23:10:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:09 smithi189 ceph-mon[32756]: pgmap v9858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17504.592687 secs 2024-04-26T23:10:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16807.563125 secs 2024-04-26T23:10:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:11 smithi156 ceph-mon[32679]: pgmap v9859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:11 smithi092 ceph-mon[29156]: pgmap v9859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:11 smithi189 ceph-mon[32756]: pgmap v9859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:13 smithi156 ceph-mon[32679]: pgmap v9860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:13 smithi092 ceph-mon[29156]: pgmap v9860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:13 smithi189 ceph-mon[32756]: pgmap v9860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17509.592797 secs 2024-04-26T23:10:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16812.563272 secs 2024-04-26T23:10:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17509.592797 secs 2024-04-26T23:10:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16812.563272 secs 2024-04-26T23:10:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17509.592797 secs 2024-04-26T23:10:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16812.563272 secs 2024-04-26T23:10:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:15 smithi156 ceph-mon[32679]: pgmap v9861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:15 smithi092 ceph-mon[29156]: pgmap v9861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:15 smithi189 ceph-mon[32756]: pgmap v9861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:17 smithi156 ceph-mon[32679]: pgmap v9862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:17 smithi092 ceph-mon[29156]: pgmap v9862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:17 smithi189 ceph-mon[32756]: pgmap v9862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:19 smithi156 ceph-mon[32679]: pgmap v9863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17514.592862 secs 2024-04-26T23:10:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16817.563409 secs 2024-04-26T23:10:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:19 smithi092 ceph-mon[29156]: pgmap v9863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17514.592862 secs 2024-04-26T23:10:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16817.563409 secs 2024-04-26T23:10:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:19 smithi189 ceph-mon[32756]: pgmap v9863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17514.592862 secs 2024-04-26T23:10:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16817.563409 secs 2024-04-26T23:10:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:21 smithi092 ceph-mon[29156]: pgmap v9864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:21 smithi156 ceph-mon[32679]: pgmap v9864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:21 smithi189 ceph-mon[32756]: pgmap v9864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:23 smithi092 ceph-mon[29156]: pgmap v9865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:23.510 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:23 smithi156 ceph-mon[32679]: pgmap v9865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:23 smithi189 ceph-mon[32756]: pgmap v9865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:24.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17519.592925 secs 2024-04-26T23:10:24.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16822.563523 secs 2024-04-26T23:10:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17519.592925 secs 2024-04-26T23:10:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16822.563523 secs 2024-04-26T23:10:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17519.592925 secs 2024-04-26T23:10:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16822.563523 secs 2024-04-26T23:10:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:25 smithi092 ceph-mon[29156]: pgmap v9866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:25 smithi189 ceph-mon[32756]: pgmap v9866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:25 smithi156 ceph-mon[32679]: pgmap v9866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:27 smithi092 ceph-mon[29156]: pgmap v9867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:27 smithi189 ceph-mon[32756]: pgmap v9867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:27.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:27 smithi156 ceph-mon[32679]: pgmap v9867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:10:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:10:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:10:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: pgmap v9868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:10:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:10:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:10:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17524.593014 secs 2024-04-26T23:10:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16827.563622 secs 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: pgmap v9868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17524.593014 secs 2024-04-26T23:10:29.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16827.563622 secs 2024-04-26T23:10:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: pgmap v9868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:10:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:10:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:10:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17524.593014 secs 2024-04-26T23:10:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16827.563622 secs 2024-04-26T23:10:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:30 smithi092 ceph-mon[29156]: pgmap v9869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:10:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:30 smithi092 ceph-mon[29156]: pgmap v9870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:30.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:30 smithi189 ceph-mon[32756]: pgmap v9869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:10:30.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:30 smithi189 ceph-mon[32756]: pgmap v9870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:30 smithi156 ceph-mon[32679]: pgmap v9869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:10:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:30 smithi156 ceph-mon[32679]: pgmap v9870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:32 smithi092 ceph-mon[29156]: pgmap v9871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:32 smithi189 ceph-mon[32756]: pgmap v9871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:32 smithi156 ceph-mon[32679]: pgmap v9871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:34 smithi092 ceph-mon[29156]: pgmap v9872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17529.593135 secs 2024-04-26T23:10:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16832.563724 secs 2024-04-26T23:10:34.499 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:34 smithi156 ceph-mon[32679]: pgmap v9872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:34.499 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17529.593135 secs 2024-04-26T23:10:34.499 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16832.563724 secs 2024-04-26T23:10:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:34 smithi189 ceph-mon[32756]: pgmap v9872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:10:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17529.593135 secs 2024-04-26T23:10:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16832.563724 secs 2024-04-26T23:10:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:36 smithi092 ceph-mon[29156]: pgmap v9873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:36 smithi189 ceph-mon[32756]: pgmap v9873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:36 smithi156 ceph-mon[32679]: pgmap v9873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:38 smithi092 ceph-mon[29156]: pgmap v9874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:38 smithi189 ceph-mon[32756]: pgmap v9874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:38 smithi156 ceph-mon[32679]: pgmap v9874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:10:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:39 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17534.593247 secs 2024-04-26T23:10:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16837.563847 secs 2024-04-26T23:10:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:39 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17534.593247 secs 2024-04-26T23:10:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16837.563847 secs 2024-04-26T23:10:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:39 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17534.593247 secs 2024-04-26T23:10:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16837.563847 secs 2024-04-26T23:10:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:40 smithi092 ceph-mon[29156]: pgmap v9875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:10:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:40 smithi189 ceph-mon[32756]: pgmap v9875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:10:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:40 smithi156 ceph-mon[32679]: pgmap v9875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:10:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:42 smithi092 ceph-mon[29156]: pgmap v9876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:42 smithi189 ceph-mon[32756]: pgmap v9876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:42 smithi156 ceph-mon[32679]: pgmap v9876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:44 smithi092 ceph-mon[29156]: pgmap v9877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17539.593395 secs 2024-04-26T23:10:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16842.563951 secs 2024-04-26T23:10:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:44 smithi189 ceph-mon[32756]: pgmap v9877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17539.593395 secs 2024-04-26T23:10:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16842.563951 secs 2024-04-26T23:10:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:44 smithi156 ceph-mon[32679]: pgmap v9877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17539.593395 secs 2024-04-26T23:10:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16842.563951 secs 2024-04-26T23:10:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:46 smithi092 ceph-mon[29156]: pgmap v9878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:46 smithi189 ceph-mon[32756]: pgmap v9878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:46 smithi156 ceph-mon[32679]: pgmap v9878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:48 smithi092 ceph-mon[29156]: pgmap v9879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:48 smithi189 ceph-mon[32756]: pgmap v9879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:48 smithi156 ceph-mon[32679]: pgmap v9879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:49 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17544.593503 secs 2024-04-26T23:10:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16847.564108 secs 2024-04-26T23:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:49 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17544.593503 secs 2024-04-26T23:10:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16847.564108 secs 2024-04-26T23:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:49 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17544.593503 secs 2024-04-26T23:10:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16847.564108 secs 2024-04-26T23:10:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:50 smithi189 ceph-mon[32756]: pgmap v9880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:50 smithi156 ceph-mon[32679]: pgmap v9880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:50 smithi092 ceph-mon[29156]: pgmap v9880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:52 smithi189 ceph-mon[32756]: pgmap v9881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:52 smithi156 ceph-mon[32679]: pgmap v9881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:52.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:52 smithi092 ceph-mon[29156]: pgmap v9881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:54 smithi189 ceph-mon[32756]: pgmap v9882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17549.593636 secs 2024-04-26T23:10:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16852.564208 secs 2024-04-26T23:10:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:54 smithi156 ceph-mon[32679]: pgmap v9882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17549.593636 secs 2024-04-26T23:10:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16852.564208 secs 2024-04-26T23:10:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:54 smithi092 ceph-mon[29156]: pgmap v9882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17549.593636 secs 2024-04-26T23:10:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16852.564208 secs 2024-04-26T23:10:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:56 smithi189 ceph-mon[32756]: pgmap v9883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:56 smithi156 ceph-mon[32679]: pgmap v9883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:56 smithi092 ceph-mon[29156]: pgmap v9883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:10:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:58 smithi189 ceph-mon[32756]: pgmap v9884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:58 smithi156 ceph-mon[32679]: pgmap v9884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:58 smithi092 ceph-mon[29156]: pgmap v9884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:10:59.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:59 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17554.593780 secs 2024-04-26T23:10:59.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:10:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16857.564328 secs 2024-04-26T23:10:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:59 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17554.593780 secs 2024-04-26T23:10:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:10:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16857.564328 secs 2024-04-26T23:10:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:59 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17554.593780 secs 2024-04-26T23:10:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:10:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16857.564328 secs 2024-04-26T23:11:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:00 smithi189 ceph-mon[32756]: pgmap v9885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:00 smithi156 ceph-mon[32679]: pgmap v9885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:00 smithi092 ceph-mon[29156]: pgmap v9885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:02 smithi189 ceph-mon[32756]: pgmap v9886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:02 smithi156 ceph-mon[32679]: pgmap v9886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:02 smithi092 ceph-mon[29156]: pgmap v9886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:04 smithi189 ceph-mon[32756]: pgmap v9887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17559.593874 secs 2024-04-26T23:11:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16862.564444 secs 2024-04-26T23:11:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:04 smithi156 ceph-mon[32679]: pgmap v9887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17559.593874 secs 2024-04-26T23:11:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16862.564444 secs 2024-04-26T23:11:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:04 smithi092 ceph-mon[29156]: pgmap v9887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17559.593874 secs 2024-04-26T23:11:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16862.564444 secs 2024-04-26T23:11:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:06 smithi189 ceph-mon[32756]: pgmap v9888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:06 smithi156 ceph-mon[32679]: pgmap v9888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:06 smithi092 ceph-mon[29156]: pgmap v9888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:08.604 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:08 smithi092 ceph-mon[29156]: pgmap v9889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:08 smithi189 ceph-mon[32756]: pgmap v9889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:08 smithi156 ceph-mon[32679]: pgmap v9889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:09 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17564.593974 secs 2024-04-26T23:11:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16867.564567 secs 2024-04-26T23:11:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:09 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17564.593974 secs 2024-04-26T23:11:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16867.564567 secs 2024-04-26T23:11:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:09 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17564.593974 secs 2024-04-26T23:11:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16867.564567 secs 2024-04-26T23:11:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:10 smithi189 ceph-mon[32756]: pgmap v9890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:10 smithi156 ceph-mon[32679]: pgmap v9890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:10 smithi092 ceph-mon[29156]: pgmap v9890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:12 smithi189 ceph-mon[32756]: pgmap v9891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:12 smithi156 ceph-mon[32679]: pgmap v9891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:12 smithi092 ceph-mon[29156]: pgmap v9891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:14 smithi189 ceph-mon[32756]: pgmap v9892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17569.594073 secs 2024-04-26T23:11:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16872.564731 secs 2024-04-26T23:11:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:14 smithi156 ceph-mon[32679]: pgmap v9892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17569.594073 secs 2024-04-26T23:11:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16872.564731 secs 2024-04-26T23:11:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:14 smithi092 ceph-mon[29156]: pgmap v9892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17569.594073 secs 2024-04-26T23:11:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16872.564731 secs 2024-04-26T23:11:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:16 smithi189 ceph-mon[32756]: pgmap v9893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:16 smithi156 ceph-mon[32679]: pgmap v9893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:16 smithi092 ceph-mon[29156]: pgmap v9893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:18 smithi189 ceph-mon[32756]: pgmap v9894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:18 smithi156 ceph-mon[32679]: pgmap v9894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:18 smithi092 ceph-mon[29156]: pgmap v9894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:19 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17574.594199 secs 2024-04-26T23:11:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16877.564849 secs 2024-04-26T23:11:19.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:19 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17574.594199 secs 2024-04-26T23:11:19.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16877.564849 secs 2024-04-26T23:11:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:19 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17574.594199 secs 2024-04-26T23:11:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16877.564849 secs 2024-04-26T23:11:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:20 smithi189 ceph-mon[32756]: pgmap v9895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:20 smithi156 ceph-mon[32679]: pgmap v9895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:20 smithi092 ceph-mon[29156]: pgmap v9895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:21 smithi189 ceph-mon[32756]: pgmap v9896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:21 smithi156 ceph-mon[32679]: pgmap v9896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:21 smithi092 ceph-mon[29156]: pgmap v9896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:23 smithi189 ceph-mon[32756]: pgmap v9897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:23 smithi156 ceph-mon[32679]: pgmap v9897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:23.964 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:23 smithi092 ceph-mon[29156]: pgmap v9897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:24.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17579.594259 secs 2024-04-26T23:11:24.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16882.564985 secs 2024-04-26T23:11:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17579.594259 secs 2024-04-26T23:11:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16882.564985 secs 2024-04-26T23:11:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17579.594259 secs 2024-04-26T23:11:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16882.564985 secs 2024-04-26T23:11:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:25 smithi189 ceph-mon[32756]: pgmap v9898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:25 smithi156 ceph-mon[32679]: pgmap v9898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:25 smithi092 ceph-mon[29156]: pgmap v9898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:27 smithi189 ceph-mon[32756]: pgmap v9899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:27 smithi156 ceph-mon[32679]: pgmap v9899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:27 smithi092 ceph-mon[29156]: pgmap v9899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: pgmap v9900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17584.594342 secs 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16887.565078 secs 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: pgmap v9901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: pgmap v9902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: pgmap v9900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17584.594342 secs 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16887.565078 secs 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: pgmap v9901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:11:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: pgmap v9902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: pgmap v9900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17584.594342 secs 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16887.565078 secs 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: pgmap v9901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: pgmap v9902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:11:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:31 smithi189 ceph-mon[32756]: pgmap v9903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:31 smithi156 ceph-mon[32679]: pgmap v9903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:31 smithi092 ceph-mon[29156]: pgmap v9903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:33 smithi189 ceph-mon[32756]: pgmap v9904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:11:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:33 smithi156 ceph-mon[32679]: pgmap v9904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:11:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:33 smithi092 ceph-mon[29156]: pgmap v9904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:11:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17589.594458 secs 2024-04-26T23:11:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16892.565204 secs 2024-04-26T23:11:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17589.594458 secs 2024-04-26T23:11:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16892.565204 secs 2024-04-26T23:11:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17589.594458 secs 2024-04-26T23:11:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16892.565204 secs 2024-04-26T23:11:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:35 smithi189 ceph-mon[32756]: pgmap v9905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:35 smithi156 ceph-mon[32679]: pgmap v9905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:35 smithi092 ceph-mon[29156]: pgmap v9905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:37 smithi189 ceph-mon[32756]: pgmap v9906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:37 smithi156 ceph-mon[32679]: pgmap v9906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:37 smithi092 ceph-mon[29156]: pgmap v9906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:11:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:38 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17594.594579 secs 2024-04-26T23:11:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16897.565328 secs 2024-04-26T23:11:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:38 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17594.594579 secs 2024-04-26T23:11:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16897.565328 secs 2024-04-26T23:11:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:38 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17594.594579 secs 2024-04-26T23:11:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16897.565328 secs 2024-04-26T23:11:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:39 smithi092 ceph-mon[29156]: pgmap v9907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:11:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:39 smithi189 ceph-mon[32756]: pgmap v9907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:11:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:39 smithi156 ceph-mon[32679]: pgmap v9907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:11:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:41 smithi189 ceph-mon[32756]: pgmap v9908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:41 smithi156 ceph-mon[32679]: pgmap v9908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:41 smithi092 ceph-mon[29156]: pgmap v9908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:43 smithi189 ceph-mon[32756]: pgmap v9909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:43 smithi156 ceph-mon[32679]: pgmap v9909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:43 smithi092 ceph-mon[29156]: pgmap v9909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:44 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17599.594712 secs 2024-04-26T23:11:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16902.565436 secs 2024-04-26T23:11:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:44 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17599.594712 secs 2024-04-26T23:11:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16902.565436 secs 2024-04-26T23:11:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:44 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17599.594712 secs 2024-04-26T23:11:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16902.565436 secs 2024-04-26T23:11:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:45 smithi189 ceph-mon[32756]: pgmap v9910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:45 smithi156 ceph-mon[32679]: pgmap v9910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:45 smithi092 ceph-mon[29156]: pgmap v9910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:47 smithi189 ceph-mon[32756]: pgmap v9911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:47 smithi156 ceph-mon[32679]: pgmap v9911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:47 smithi092 ceph-mon[29156]: pgmap v9911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:48 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17604.594866 secs 2024-04-26T23:11:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:48 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16907.565556 secs 2024-04-26T23:11:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:48 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17604.594866 secs 2024-04-26T23:11:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:48 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16907.565556 secs 2024-04-26T23:11:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:48 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17604.594866 secs 2024-04-26T23:11:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:48 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16907.565556 secs 2024-04-26T23:11:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:49 smithi092 ceph-mon[29156]: pgmap v9912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:49 smithi189 ceph-mon[32756]: pgmap v9912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:49 smithi156 ceph-mon[32679]: pgmap v9912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:51 smithi189 ceph-mon[32756]: pgmap v9913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:51 smithi156 ceph-mon[32679]: pgmap v9913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:51 smithi092 ceph-mon[29156]: pgmap v9913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:53 smithi189 ceph-mon[32756]: pgmap v9914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:53 smithi156 ceph-mon[32679]: pgmap v9914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:53 smithi092 ceph-mon[29156]: pgmap v9914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:54 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17609.594934 secs 2024-04-26T23:11:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16912.565676 secs 2024-04-26T23:11:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:54 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17609.594934 secs 2024-04-26T23:11:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16912.565676 secs 2024-04-26T23:11:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:54 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17609.594934 secs 2024-04-26T23:11:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16912.565676 secs 2024-04-26T23:11:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:55 smithi189 ceph-mon[32756]: pgmap v9915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:55 smithi156 ceph-mon[32679]: pgmap v9915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:55.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:55 smithi092 ceph-mon[29156]: pgmap v9915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:11:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:57 smithi189 ceph-mon[32756]: pgmap v9916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:57 smithi156 ceph-mon[32679]: pgmap v9916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:57 smithi092 ceph-mon[29156]: pgmap v9916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:11:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:58 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17614.595049 secs 2024-04-26T23:11:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:58 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16917.565798 secs 2024-04-26T23:11:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:58 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17614.595049 secs 2024-04-26T23:11:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:58 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16917.565798 secs 2024-04-26T23:11:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:58 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17614.595049 secs 2024-04-26T23:11:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:58 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16917.565798 secs 2024-04-26T23:12:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:11:59 smithi092 ceph-mon[29156]: pgmap v9917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:11:59 smithi189 ceph-mon[32756]: pgmap v9917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:11:59 smithi156 ceph-mon[32679]: pgmap v9917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:01 smithi189 ceph-mon[32756]: pgmap v9918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:01 smithi156 ceph-mon[32679]: pgmap v9918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:01 smithi092 ceph-mon[29156]: pgmap v9918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:03 smithi189 ceph-mon[32756]: pgmap v9919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:03 smithi156 ceph-mon[32679]: pgmap v9919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:03 smithi092 ceph-mon[29156]: pgmap v9919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:04 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17619.595159 secs 2024-04-26T23:12:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16922.565886 secs 2024-04-26T23:12:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:04 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17619.595159 secs 2024-04-26T23:12:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16922.565886 secs 2024-04-26T23:12:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:04 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17619.595159 secs 2024-04-26T23:12:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16922.565886 secs 2024-04-26T23:12:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:05 smithi189 ceph-mon[32756]: pgmap v9920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:05 smithi156 ceph-mon[32679]: pgmap v9920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:05 smithi092 ceph-mon[29156]: pgmap v9920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:07 smithi189 ceph-mon[32756]: pgmap v9921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:07 smithi156 ceph-mon[32679]: pgmap v9921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:07 smithi092 ceph-mon[29156]: pgmap v9921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:08 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17624.595255 secs 2024-04-26T23:12:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:08 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16927.565980 secs 2024-04-26T23:12:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:08 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17624.595255 secs 2024-04-26T23:12:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:08 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16927.565980 secs 2024-04-26T23:12:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:08 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17624.595255 secs 2024-04-26T23:12:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:08 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16927.565980 secs 2024-04-26T23:12:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:09 smithi092 ceph-mon[29156]: pgmap v9922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:09 smithi189 ceph-mon[32756]: pgmap v9922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:09 smithi156 ceph-mon[32679]: pgmap v9922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:11 smithi189 ceph-mon[32756]: pgmap v9923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:11 smithi156 ceph-mon[32679]: pgmap v9923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:11 smithi092 ceph-mon[29156]: pgmap v9923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:13 smithi189 ceph-mon[32756]: pgmap v9924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:13 smithi156 ceph-mon[32679]: pgmap v9924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:13 smithi092 ceph-mon[29156]: pgmap v9924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:14 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17629.595405 secs 2024-04-26T23:12:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16932.566055 secs 2024-04-26T23:12:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:14 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17629.595405 secs 2024-04-26T23:12:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16932.566055 secs 2024-04-26T23:12:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:14 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17629.595405 secs 2024-04-26T23:12:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16932.566055 secs 2024-04-26T23:12:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:15 smithi189 ceph-mon[32756]: pgmap v9925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:15 smithi156 ceph-mon[32679]: pgmap v9925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:15 smithi092 ceph-mon[29156]: pgmap v9925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:17 smithi189 ceph-mon[32756]: pgmap v9926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:17 smithi156 ceph-mon[32679]: pgmap v9926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:17 smithi092 ceph-mon[29156]: pgmap v9926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:18 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17634.595547 secs 2024-04-26T23:12:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:18 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16937.566171 secs 2024-04-26T23:12:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:18 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17634.595547 secs 2024-04-26T23:12:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:18 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16937.566171 secs 2024-04-26T23:12:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:18 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17634.595547 secs 2024-04-26T23:12:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:18 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16937.566171 secs 2024-04-26T23:12:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:19 smithi092 ceph-mon[29156]: pgmap v9927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:19 smithi189 ceph-mon[32756]: pgmap v9927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:19 smithi156 ceph-mon[32679]: pgmap v9927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:21 smithi189 ceph-mon[32756]: pgmap v9928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:21 smithi156 ceph-mon[32679]: pgmap v9928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:21 smithi092 ceph-mon[29156]: pgmap v9928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:23 smithi189 ceph-mon[32756]: pgmap v9929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:23 smithi156 ceph-mon[32679]: pgmap v9929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:23 smithi092 ceph-mon[29156]: pgmap v9929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:24 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17639.595685 secs 2024-04-26T23:12:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16942.566286 secs 2024-04-26T23:12:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:24 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17639.595685 secs 2024-04-26T23:12:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16942.566286 secs 2024-04-26T23:12:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:24 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17639.595685 secs 2024-04-26T23:12:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16942.566286 secs 2024-04-26T23:12:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:25 smithi189 ceph-mon[32756]: pgmap v9930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:25 smithi156 ceph-mon[32679]: pgmap v9930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:25 smithi092 ceph-mon[29156]: pgmap v9930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:27 smithi189 ceph-mon[32756]: pgmap v9931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:27 smithi156 ceph-mon[32679]: pgmap v9931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:27 smithi092 ceph-mon[29156]: pgmap v9931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:28 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17644.595840 secs 2024-04-26T23:12:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:28 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16947.566422 secs 2024-04-26T23:12:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:28 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17644.595840 secs 2024-04-26T23:12:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:28 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16947.566422 secs 2024-04-26T23:12:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:28 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17644.595840 secs 2024-04-26T23:12:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:28 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16947.566422 secs 2024-04-26T23:12:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:29 smithi092 ceph-mon[29156]: pgmap v9932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:12:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:29 smithi189 ceph-mon[32756]: pgmap v9932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:12:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:29 smithi156 ceph-mon[32679]: pgmap v9932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:12:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:12:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:12:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:30 smithi092 ceph-mon[29156]: pgmap v9933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:12:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:30 smithi092 ceph-mon[29156]: pgmap v9934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:12:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:12:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:12:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:30 smithi189 ceph-mon[32756]: pgmap v9933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:12:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:30 smithi189 ceph-mon[32756]: pgmap v9934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:12:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:12:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:12:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:30 smithi156 ceph-mon[32679]: pgmap v9933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:12:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:30 smithi156 ceph-mon[32679]: pgmap v9934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:12:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:33 smithi189 ceph-mon[32756]: pgmap v9935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:33 smithi156 ceph-mon[32679]: pgmap v9935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:33 smithi092 ceph-mon[29156]: pgmap v9935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:34 smithi189 ceph-mon[32756]: 3 slow requests, 0 included below; oldest blocked for > 17649.595904 secs 2024-04-26T23:12:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16952.566540 secs 2024-04-26T23:12:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:34 smithi156 ceph-mon[32679]: 3 slow requests, 0 included below; oldest blocked for > 17649.595904 secs 2024-04-26T23:12:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16952.566540 secs 2024-04-26T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:34 smithi092 ceph-mon[29156]: 3 slow requests, 0 included below; oldest blocked for > 17649.595904 secs 2024-04-26T23:12:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16952.566540 secs 2024-04-26T23:12:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:35 smithi189 ceph-mon[32756]: pgmap v9936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:35 smithi156 ceph-mon[32679]: pgmap v9936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:35 smithi092 ceph-mon[29156]: pgmap v9936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:37 smithi189 ceph-mon[32756]: pgmap v9937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:37 smithi156 ceph-mon[32679]: pgmap v9937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:37 smithi092 ceph-mon[29156]: pgmap v9937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:12:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:12:38.405+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:12:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:12:38.405+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:12:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:12:38.405+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:12:38.405 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:12:38.405+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 138 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:12:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:39 smithi189 ceph-mon[32756]: pgmap v9938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:39 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 17654.595999 secs 2024-04-26T23:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:39 smithi189 ceph-mon[32756]: slow request 183.112994 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:12:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16957.566700 secs 2024-04-26T23:12:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:39 smithi156 ceph-mon[32679]: pgmap v9938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:12:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:39 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 17654.595999 secs 2024-04-26T23:12:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:39 smithi156 ceph-mon[32679]: slow request 183.112994 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:12:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16957.566700 secs 2024-04-26T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:39 smithi092 ceph-mon[29156]: pgmap v9938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:39 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 17654.595999 secs 2024-04-26T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:39 smithi092 ceph-mon[29156]: slow request 183.112994 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:12:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16957.566700 secs 2024-04-26T23:12:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:41 smithi189 ceph-mon[32756]: pgmap v9939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:12:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:41 smithi156 ceph-mon[32679]: pgmap v9939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:12:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:41 smithi092 ceph-mon[29156]: pgmap v9939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:12:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:43 smithi189 ceph-mon[32756]: pgmap v9940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:12:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:12:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:43 smithi156 ceph-mon[32679]: pgmap v9940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:12:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:12:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:43 smithi092 ceph-mon[29156]: pgmap v9940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-26T23:12:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:12:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17659.596060 secs 2024-04-26T23:12:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16962.566833 secs 2024-04-26T23:12:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17659.596060 secs 2024-04-26T23:12:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16962.566833 secs 2024-04-26T23:12:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17659.596060 secs 2024-04-26T23:12:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16962.566833 secs 2024-04-26T23:12:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:45 smithi156 ceph-mon[32679]: pgmap v9941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:45 smithi092 ceph-mon[29156]: pgmap v9941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:45 smithi189 ceph-mon[32756]: pgmap v9941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:47 smithi156 ceph-mon[32679]: pgmap v9942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:47 smithi092 ceph-mon[29156]: pgmap v9942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:47 smithi189 ceph-mon[32756]: pgmap v9942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:49 smithi156 ceph-mon[32679]: pgmap v9943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17664.596180 secs 2024-04-26T23:12:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16967.566952 secs 2024-04-26T23:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:49 smithi092 ceph-mon[29156]: pgmap v9943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17664.596180 secs 2024-04-26T23:12:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16967.566952 secs 2024-04-26T23:12:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:49 smithi189 ceph-mon[32756]: pgmap v9943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17664.596180 secs 2024-04-26T23:12:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16967.566952 secs 2024-04-26T23:12:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:51 smithi156 ceph-mon[32679]: pgmap v9944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:51 smithi092 ceph-mon[29156]: pgmap v9944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:51 smithi189 ceph-mon[32756]: pgmap v9944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:53 smithi156 ceph-mon[32679]: pgmap v9945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:53 smithi092 ceph-mon[29156]: pgmap v9945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:53 smithi189 ceph-mon[32756]: pgmap v9945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17669.596260 secs 2024-04-26T23:12:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16972.567110 secs 2024-04-26T23:12:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17669.596260 secs 2024-04-26T23:12:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16972.567110 secs 2024-04-26T23:12:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17669.596260 secs 2024-04-26T23:12:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16972.567110 secs 2024-04-26T23:12:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:55 smithi156 ceph-mon[32679]: pgmap v9946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:55 smithi092 ceph-mon[29156]: pgmap v9946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:55 smithi189 ceph-mon[32756]: pgmap v9946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:12:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:57 smithi156 ceph-mon[32679]: pgmap v9947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:57 smithi092 ceph-mon[29156]: pgmap v9947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:57 smithi189 ceph-mon[32756]: pgmap v9947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:59 smithi156 ceph-mon[32679]: pgmap v9948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17674.596378 secs 2024-04-26T23:12:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:12:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16977.567230 secs 2024-04-26T23:12:59.439 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:59 smithi189 ceph-mon[32756]: pgmap v9948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:59.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17674.596378 secs 2024-04-26T23:12:59.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:12:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16977.567230 secs 2024-04-26T23:12:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:59 smithi092 ceph-mon[29156]: pgmap v9948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:12:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17674.596378 secs 2024-04-26T23:12:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:12:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16977.567230 secs 2024-04-26T23:13:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:01 smithi156 ceph-mon[32679]: pgmap v9949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:01 smithi092 ceph-mon[29156]: pgmap v9949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:01 smithi189 ceph-mon[32756]: pgmap v9949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:03 smithi156 ceph-mon[32679]: pgmap v9950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:03 smithi092 ceph-mon[29156]: pgmap v9950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:03 smithi189 ceph-mon[32756]: pgmap v9950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17679.596525 secs 2024-04-26T23:13:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16982.567348 secs 2024-04-26T23:13:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17679.596525 secs 2024-04-26T23:13:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16982.567348 secs 2024-04-26T23:13:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17679.596525 secs 2024-04-26T23:13:04.652 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16982.567348 secs 2024-04-26T23:13:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:05 smithi156 ceph-mon[32679]: pgmap v9951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:05 smithi092 ceph-mon[29156]: pgmap v9951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:05 smithi189 ceph-mon[32756]: pgmap v9951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:07 smithi092 ceph-mon[29156]: pgmap v9952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:07 smithi189 ceph-mon[32756]: pgmap v9952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:07 smithi156 ceph-mon[32679]: pgmap v9952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:09 smithi092 ceph-mon[29156]: pgmap v9953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17684.596636 secs 2024-04-26T23:13:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16987.567472 secs 2024-04-26T23:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:09 smithi189 ceph-mon[32756]: pgmap v9953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17684.596636 secs 2024-04-26T23:13:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16987.567472 secs 2024-04-26T23:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:09 smithi156 ceph-mon[32679]: pgmap v9953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17684.596636 secs 2024-04-26T23:13:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16987.567472 secs 2024-04-26T23:13:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:11 smithi092 ceph-mon[29156]: pgmap v9954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:11 smithi189 ceph-mon[32756]: pgmap v9954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:11 smithi156 ceph-mon[32679]: pgmap v9954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:13 smithi092 ceph-mon[29156]: pgmap v9955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:13 smithi189 ceph-mon[32756]: pgmap v9955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:13 smithi156 ceph-mon[32679]: pgmap v9955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17689.596753 secs 2024-04-26T23:13:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16992.567591 secs 2024-04-26T23:13:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17689.596753 secs 2024-04-26T23:13:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16992.567591 secs 2024-04-26T23:13:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17689.596753 secs 2024-04-26T23:13:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16992.567591 secs 2024-04-26T23:13:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:15 smithi092 ceph-mon[29156]: pgmap v9956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:15 smithi189 ceph-mon[32756]: pgmap v9956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:15 smithi156 ceph-mon[32679]: pgmap v9956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:17 smithi092 ceph-mon[29156]: pgmap v9957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:17 smithi189 ceph-mon[32756]: pgmap v9957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:17 smithi156 ceph-mon[32679]: pgmap v9957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:19 smithi092 ceph-mon[29156]: pgmap v9958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17694.596870 secs 2024-04-26T23:13:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 16997.567692 secs 2024-04-26T23:13:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:19 smithi189 ceph-mon[32756]: pgmap v9958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17694.596870 secs 2024-04-26T23:13:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 16997.567692 secs 2024-04-26T23:13:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:19 smithi156 ceph-mon[32679]: pgmap v9958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17694.596870 secs 2024-04-26T23:13:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 16997.567692 secs 2024-04-26T23:13:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:21 smithi092 ceph-mon[29156]: pgmap v9959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:21 smithi189 ceph-mon[32756]: pgmap v9959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:21 smithi156 ceph-mon[32679]: pgmap v9959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:23 smithi092 ceph-mon[29156]: pgmap v9960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:23 smithi189 ceph-mon[32756]: pgmap v9960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:23 smithi156 ceph-mon[32679]: pgmap v9960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17699.596966 secs 2024-04-26T23:13:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17002.567807 secs 2024-04-26T23:13:24.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17699.596966 secs 2024-04-26T23:13:24.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17002.567807 secs 2024-04-26T23:13:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17699.596966 secs 2024-04-26T23:13:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17002.567807 secs 2024-04-26T23:13:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:25 smithi092 ceph-mon[29156]: pgmap v9961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:25 smithi189 ceph-mon[32756]: pgmap v9961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:25 smithi156 ceph-mon[32679]: pgmap v9961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:27 smithi092 ceph-mon[29156]: pgmap v9962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:27 smithi189 ceph-mon[32756]: pgmap v9962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:27 smithi156 ceph-mon[32679]: pgmap v9962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:29 smithi092 ceph-mon[29156]: pgmap v9963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17704.597083 secs 2024-04-26T23:13:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17007.567902 secs 2024-04-26T23:13:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:29 smithi189 ceph-mon[32756]: pgmap v9963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17704.597083 secs 2024-04-26T23:13:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17007.567902 secs 2024-04-26T23:13:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:29 smithi156 ceph-mon[32679]: pgmap v9963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17704.597083 secs 2024-04-26T23:13:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17007.567902 secs 2024-04-26T23:13:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:13:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:13:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:31 smithi092 ceph-mon[29156]: pgmap v9964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:13:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:13:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:31 smithi189 ceph-mon[32756]: pgmap v9964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:13:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:13:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:13:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:31 smithi156 ceph-mon[32679]: pgmap v9964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:13:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:13:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:13:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:32 smithi092 ceph-mon[29156]: pgmap v9965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:13:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:32 smithi092 ceph-mon[29156]: pgmap v9966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:32 smithi189 ceph-mon[32756]: pgmap v9965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:13:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:32 smithi189 ceph-mon[32756]: pgmap v9966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:32 smithi156 ceph-mon[32679]: pgmap v9965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:13:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:32 smithi156 ceph-mon[32679]: pgmap v9966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:34 smithi092 ceph-mon[29156]: pgmap v9967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:13:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17709.597207 secs 2024-04-26T23:13:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17012.568040 secs 2024-04-26T23:13:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:34 smithi189 ceph-mon[32756]: pgmap v9967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:13:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17709.597207 secs 2024-04-26T23:13:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17012.568040 secs 2024-04-26T23:13:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:34 smithi156 ceph-mon[32679]: pgmap v9967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:13:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17709.597207 secs 2024-04-26T23:13:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17012.568040 secs 2024-04-26T23:13:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:36 smithi189 ceph-mon[32756]: pgmap v9968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:36 smithi156 ceph-mon[32679]: pgmap v9968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:36 smithi092 ceph-mon[29156]: pgmap v9968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:38 smithi189 ceph-mon[32756]: pgmap v9969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:38 smithi156 ceph-mon[32679]: pgmap v9969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:38 smithi092 ceph-mon[29156]: pgmap v9969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17714.597332 secs 2024-04-26T23:13:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17017.568158 secs 2024-04-26T23:13:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17714.597332 secs 2024-04-26T23:13:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17017.568158 secs 2024-04-26T23:13:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17714.597332 secs 2024-04-26T23:13:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17017.568158 secs 2024-04-26T23:13:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:40 smithi189 ceph-mon[32756]: pgmap v9970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:40 smithi156 ceph-mon[32679]: pgmap v9970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:40 smithi092 ceph-mon[29156]: pgmap v9970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:13:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:42 smithi189 ceph-mon[32756]: pgmap v9971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:13:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:42 smithi156 ceph-mon[32679]: pgmap v9971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:13:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:42 smithi092 ceph-mon[29156]: pgmap v9971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:13:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:44 smithi189 ceph-mon[32756]: pgmap v9972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17719.597405 secs 2024-04-26T23:13:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17022.568247 secs 2024-04-26T23:13:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:44 smithi156 ceph-mon[32679]: pgmap v9972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17719.597405 secs 2024-04-26T23:13:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17022.568247 secs 2024-04-26T23:13:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:44 smithi092 ceph-mon[29156]: pgmap v9972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17719.597405 secs 2024-04-26T23:13:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17022.568247 secs 2024-04-26T23:13:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:46 smithi189 ceph-mon[32756]: pgmap v9973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:46 smithi156 ceph-mon[32679]: pgmap v9973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:46 smithi092 ceph-mon[29156]: pgmap v9973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:48 smithi189 ceph-mon[32756]: pgmap v9974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:48 smithi156 ceph-mon[32679]: pgmap v9974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:48 smithi092 ceph-mon[29156]: pgmap v9974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17724.597520 secs 2024-04-26T23:13:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17027.568376 secs 2024-04-26T23:13:49.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17724.597520 secs 2024-04-26T23:13:49.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17027.568376 secs 2024-04-26T23:13:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17724.597520 secs 2024-04-26T23:13:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17027.568376 secs 2024-04-26T23:13:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:50 smithi189 ceph-mon[32756]: pgmap v9975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:50 smithi156 ceph-mon[32679]: pgmap v9975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:50 smithi092 ceph-mon[29156]: pgmap v9975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:52 smithi189 ceph-mon[32756]: pgmap v9976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:52 smithi156 ceph-mon[32679]: pgmap v9976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:52 smithi092 ceph-mon[29156]: pgmap v9976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:54 smithi189 ceph-mon[32756]: pgmap v9977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17729.597634 secs 2024-04-26T23:13:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17032.568497 secs 2024-04-26T23:13:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:54 smithi156 ceph-mon[32679]: pgmap v9977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17729.597634 secs 2024-04-26T23:13:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17032.568497 secs 2024-04-26T23:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:54 smithi092 ceph-mon[29156]: pgmap v9977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17729.597634 secs 2024-04-26T23:13:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17032.568497 secs 2024-04-26T23:13:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:56 smithi189 ceph-mon[32756]: pgmap v9978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:56 smithi156 ceph-mon[32679]: pgmap v9978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:56 smithi092 ceph-mon[29156]: pgmap v9978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:13:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:58 smithi189 ceph-mon[32756]: pgmap v9979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:58 smithi156 ceph-mon[32679]: pgmap v9979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:58 smithi092 ceph-mon[29156]: pgmap v9979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:13:59.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17734.597735 secs 2024-04-26T23:13:59.612 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:13:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17037.568622 secs 2024-04-26T23:13:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17734.597735 secs 2024-04-26T23:13:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:13:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17037.568622 secs 2024-04-26T23:13:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17734.597735 secs 2024-04-26T23:13:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:13:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17037.568622 secs 2024-04-26T23:14:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:00 smithi189 ceph-mon[32756]: pgmap v9980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:00 smithi156 ceph-mon[32679]: pgmap v9980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:00 smithi092 ceph-mon[29156]: pgmap v9980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:02 smithi189 ceph-mon[32756]: pgmap v9981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:02 smithi156 ceph-mon[32679]: pgmap v9981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:02 smithi092 ceph-mon[29156]: pgmap v9981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:04 smithi189 ceph-mon[32756]: pgmap v9982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17739.597873 secs 2024-04-26T23:14:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17042.568756 secs 2024-04-26T23:14:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:04 smithi156 ceph-mon[32679]: pgmap v9982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17739.597873 secs 2024-04-26T23:14:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17042.568756 secs 2024-04-26T23:14:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:04 smithi092 ceph-mon[29156]: pgmap v9982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17739.597873 secs 2024-04-26T23:14:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17042.568756 secs 2024-04-26T23:14:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:06 smithi189 ceph-mon[32756]: pgmap v9983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:06 smithi156 ceph-mon[32679]: pgmap v9983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:06 smithi092 ceph-mon[29156]: pgmap v9983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:08 smithi189 ceph-mon[32756]: pgmap v9984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:08 smithi156 ceph-mon[32679]: pgmap v9984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:08 smithi092 ceph-mon[29156]: pgmap v9984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17744.597973 secs 2024-04-26T23:14:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17047.568877 secs 2024-04-26T23:14:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17744.597973 secs 2024-04-26T23:14:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17047.568877 secs 2024-04-26T23:14:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17744.597973 secs 2024-04-26T23:14:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17047.568877 secs 2024-04-26T23:14:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:10 smithi189 ceph-mon[32756]: pgmap v9985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:10 smithi156 ceph-mon[32679]: pgmap v9985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:10 smithi092 ceph-mon[29156]: pgmap v9985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:12.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:12 smithi189 ceph-mon[32756]: pgmap v9986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:12 smithi156 ceph-mon[32679]: pgmap v9986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:12 smithi092 ceph-mon[29156]: pgmap v9986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:14 smithi189 ceph-mon[32756]: pgmap v9987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17749.598091 secs 2024-04-26T23:14:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17052.568993 secs 2024-04-26T23:14:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:14 smithi156 ceph-mon[32679]: pgmap v9987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17749.598091 secs 2024-04-26T23:14:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17052.568993 secs 2024-04-26T23:14:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:14 smithi092 ceph-mon[29156]: pgmap v9987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17749.598091 secs 2024-04-26T23:14:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17052.568993 secs 2024-04-26T23:14:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:16 smithi189 ceph-mon[32756]: pgmap v9988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:16 smithi156 ceph-mon[32679]: pgmap v9988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:16 smithi092 ceph-mon[29156]: pgmap v9988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:18 smithi189 ceph-mon[32756]: pgmap v9989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:18 smithi156 ceph-mon[32679]: pgmap v9989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:18 smithi092 ceph-mon[29156]: pgmap v9989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17754.598208 secs 2024-04-26T23:14:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17057.569149 secs 2024-04-26T23:14:19.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17754.598208 secs 2024-04-26T23:14:19.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17057.569149 secs 2024-04-26T23:14:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17754.598208 secs 2024-04-26T23:14:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17057.569149 secs 2024-04-26T23:14:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:20 smithi189 ceph-mon[32756]: pgmap v9990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:20 smithi156 ceph-mon[32679]: pgmap v9990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:20 smithi092 ceph-mon[29156]: pgmap v9990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:21 smithi189 ceph-mon[32756]: pgmap v9991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:21 smithi156 ceph-mon[32679]: pgmap v9991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:21 smithi092 ceph-mon[29156]: pgmap v9991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:23 smithi156 ceph-mon[32679]: pgmap v9992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:23 smithi092 ceph-mon[29156]: pgmap v9992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:23 smithi189 ceph-mon[32756]: pgmap v9992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17759.598346 secs 2024-04-26T23:14:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17062.569273 secs 2024-04-26T23:14:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17759.598346 secs 2024-04-26T23:14:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17062.569273 secs 2024-04-26T23:14:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17759.598346 secs 2024-04-26T23:14:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17062.569273 secs 2024-04-26T23:14:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:25 smithi156 ceph-mon[32679]: pgmap v9993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:25 smithi092 ceph-mon[29156]: pgmap v9993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:25 smithi189 ceph-mon[32756]: pgmap v9993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:27 smithi156 ceph-mon[32679]: pgmap v9994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:27 smithi092 ceph-mon[29156]: pgmap v9994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:27 smithi189 ceph-mon[32756]: pgmap v9994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:28 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17764.598463 secs 2024-04-26T23:14:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:28 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17764.598463 secs 2024-04-26T23:14:29.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:28 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17764.598463 secs 2024-04-26T23:14:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17067.569412 secs 2024-04-26T23:14:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:29 smithi156 ceph-mon[32679]: pgmap v9995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17067.569412 secs 2024-04-26T23:14:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:29 smithi092 ceph-mon[29156]: pgmap v9995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17067.569412 secs 2024-04-26T23:14:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:29 smithi189 ceph-mon[32756]: pgmap v9995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:14:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:31 smithi156 ceph-mon[32679]: pgmap v9996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:14:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:14:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:14:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:14:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:31 smithi092 ceph-mon[29156]: pgmap v9996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:14:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:14:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:14:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:14:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:31 smithi189 ceph-mon[32756]: pgmap v9996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:14:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:14:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:14:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:14:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:32 smithi156 ceph-mon[32679]: pgmap v9997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:14:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:32 smithi156 ceph-mon[32679]: pgmap v9998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:32 smithi092 ceph-mon[29156]: pgmap v9997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:14:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:32 smithi092 ceph-mon[29156]: pgmap v9998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:32 smithi189 ceph-mon[32756]: pgmap v9997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:14:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:32 smithi189 ceph-mon[32756]: pgmap v9998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:33 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17769.598571 secs 2024-04-26T23:14:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17072.569530 secs 2024-04-26T23:14:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:33 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17769.598571 secs 2024-04-26T23:14:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17072.569530 secs 2024-04-26T23:14:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:33 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17769.598571 secs 2024-04-26T23:14:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17072.569530 secs 2024-04-26T23:14:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:34 smithi092 ceph-mon[29156]: pgmap v9999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:34 smithi189 ceph-mon[32756]: pgmap v9999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:34 smithi156 ceph-mon[32679]: pgmap v9999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:35.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:14:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:14:35.511+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:14:35.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:14:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:14:35.511+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:14:35.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:14:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:14:35.511+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:14:35.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:14:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:14:35.511+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:14:35.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:14:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:14:35.511+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:14:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:36 smithi092 ceph-mon[29156]: pgmap v10000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:36 smithi189 ceph-mon[32756]: pgmap v10000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:36 smithi156 ceph-mon[32679]: pgmap v10000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:14:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:38 smithi092 ceph-mon[29156]: pgmap v10001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:38 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17774.598687 secs 2024-04-26T23:14:39.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17077.569626 secs 2024-04-26T23:14:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:38 smithi189 ceph-mon[32756]: pgmap v10001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:38 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17774.598687 secs 2024-04-26T23:14:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17077.569626 secs 2024-04-26T23:14:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:38 smithi156 ceph-mon[32679]: pgmap v10001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:14:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:38 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17774.598687 secs 2024-04-26T23:14:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17077.569626 secs 2024-04-26T23:14:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:40 smithi092 ceph-mon[29156]: pgmap v10002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T23:14:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:40 smithi189 ceph-mon[32756]: pgmap v10002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T23:14:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:40 smithi156 ceph-mon[32679]: pgmap v10002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-26T23:14:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:42 smithi092 ceph-mon[29156]: pgmap v10003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T23:14:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:42 smithi189 ceph-mon[32756]: pgmap v10003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T23:14:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:42 smithi156 ceph-mon[32679]: pgmap v10003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-26T23:14:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17779.598809 secs 2024-04-26T23:14:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:44 smithi156 ceph-mon[32679]: pgmap v10004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17082.569747 secs 2024-04-26T23:14:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17779.598809 secs 2024-04-26T23:14:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:44 smithi092 ceph-mon[29156]: pgmap v10004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17082.569747 secs 2024-04-26T23:14:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17779.598809 secs 2024-04-26T23:14:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:44 smithi189 ceph-mon[32756]: pgmap v10004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17082.569747 secs 2024-04-26T23:14:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:46 smithi156 ceph-mon[32679]: pgmap v10005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:46 smithi092 ceph-mon[29156]: pgmap v10005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:46 smithi189 ceph-mon[32756]: pgmap v10005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:48 smithi156 ceph-mon[32679]: pgmap v10006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 341 B/s wr, 14 op/s 2024-04-26T23:14:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:48 smithi092 ceph-mon[29156]: pgmap v10006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 341 B/s wr, 14 op/s 2024-04-26T23:14:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:48 smithi189 ceph-mon[32756]: pgmap v10006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 341 B/s wr, 14 op/s 2024-04-26T23:14:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17784.598937 secs 2024-04-26T23:14:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17087.569828 secs 2024-04-26T23:14:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17784.598937 secs 2024-04-26T23:14:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17087.569828 secs 2024-04-26T23:14:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17784.598937 secs 2024-04-26T23:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17087.569828 secs 2024-04-26T23:14:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:50 smithi156 ceph-mon[32679]: pgmap v10007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:50 smithi092 ceph-mon[29156]: pgmap v10007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:50 smithi189 ceph-mon[32756]: pgmap v10007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:14:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:52 smithi156 ceph-mon[32679]: pgmap v10008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:14:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:52 smithi092 ceph-mon[29156]: pgmap v10008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:14:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:52 smithi189 ceph-mon[32756]: pgmap v10008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:14:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17789.599060 secs 2024-04-26T23:14:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:54 smithi156 ceph-mon[32679]: pgmap v10009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:14:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17092.569967 secs 2024-04-26T23:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17789.599060 secs 2024-04-26T23:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:54 smithi092 ceph-mon[29156]: pgmap v10009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17092.569967 secs 2024-04-26T23:14:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17789.599060 secs 2024-04-26T23:14:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:54 smithi189 ceph-mon[32756]: pgmap v10009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:14:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17092.569967 secs 2024-04-26T23:14:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:56 smithi156 ceph-mon[32679]: pgmap v10010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:56 smithi092 ceph-mon[29156]: pgmap v10010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:56 smithi189 ceph-mon[32756]: pgmap v10010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:58 smithi156 ceph-mon[32679]: pgmap v10011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:58 smithi092 ceph-mon[29156]: pgmap v10011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:58 smithi189 ceph-mon[32756]: pgmap v10011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:14:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17794.599165 secs 2024-04-26T23:14:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:14:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17097.570086 secs 2024-04-26T23:15:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17794.599165 secs 2024-04-26T23:15:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:14:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17097.570086 secs 2024-04-26T23:15:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17794.599165 secs 2024-04-26T23:15:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:14:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17097.570086 secs 2024-04-26T23:15:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:00 smithi092 ceph-mon[29156]: pgmap v10012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:00 smithi189 ceph-mon[32756]: pgmap v10012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:00 smithi156 ceph-mon[32679]: pgmap v10012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:02 smithi092 ceph-mon[29156]: pgmap v10013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:02 smithi189 ceph-mon[32756]: pgmap v10013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:02 smithi156 ceph-mon[32679]: pgmap v10013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17799.599221 secs 2024-04-26T23:15:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:04 smithi092 ceph-mon[29156]: pgmap v10014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17102.570201 secs 2024-04-26T23:15:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17799.599221 secs 2024-04-26T23:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:04 smithi189 ceph-mon[32756]: pgmap v10014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17102.570201 secs 2024-04-26T23:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17799.599221 secs 2024-04-26T23:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:04 smithi156 ceph-mon[32679]: pgmap v10014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17102.570201 secs 2024-04-26T23:15:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:06 smithi092 ceph-mon[29156]: pgmap v10015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:06 smithi189 ceph-mon[32756]: pgmap v10015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:06 smithi156 ceph-mon[32679]: pgmap v10015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:08 smithi092 ceph-mon[29156]: pgmap v10016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:08 smithi189 ceph-mon[32756]: pgmap v10016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:08 smithi156 ceph-mon[32679]: pgmap v10016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17804.599350 secs 2024-04-26T23:15:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17107.570334 secs 2024-04-26T23:15:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17804.599350 secs 2024-04-26T23:15:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17107.570334 secs 2024-04-26T23:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17804.599350 secs 2024-04-26T23:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17107.570334 secs 2024-04-26T23:15:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:10 smithi092 ceph-mon[29156]: pgmap v10017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:10 smithi189 ceph-mon[32756]: pgmap v10017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:10 smithi156 ceph-mon[32679]: pgmap v10017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:12 smithi092 ceph-mon[29156]: pgmap v10018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:12 smithi189 ceph-mon[32756]: pgmap v10018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:12 smithi156 ceph-mon[32679]: pgmap v10018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:15:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17809.599490 secs 2024-04-26T23:15:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:14 smithi092 ceph-mon[29156]: pgmap v10019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17112.570417 secs 2024-04-26T23:15:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17809.599490 secs 2024-04-26T23:15:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:14 smithi189 ceph-mon[32756]: pgmap v10019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17112.570417 secs 2024-04-26T23:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17809.599490 secs 2024-04-26T23:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:14 smithi156 ceph-mon[32679]: pgmap v10019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17112.570417 secs 2024-04-26T23:15:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:16 smithi092 ceph-mon[29156]: pgmap v10020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:16 smithi189 ceph-mon[32756]: pgmap v10020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:16 smithi156 ceph-mon[32679]: pgmap v10020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:18 smithi092 ceph-mon[29156]: pgmap v10021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:18 smithi189 ceph-mon[32756]: pgmap v10021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:18 smithi156 ceph-mon[32679]: pgmap v10021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17814.599559 secs 2024-04-26T23:15:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17117.570496 secs 2024-04-26T23:15:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17814.599559 secs 2024-04-26T23:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17117.570496 secs 2024-04-26T23:15:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17814.599559 secs 2024-04-26T23:15:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17117.570496 secs 2024-04-26T23:15:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:20 smithi092 ceph-mon[29156]: pgmap v10022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:20 smithi189 ceph-mon[32756]: pgmap v10022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:20 smithi156 ceph-mon[32679]: pgmap v10022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:22 smithi092 ceph-mon[29156]: pgmap v10023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:22 smithi189 ceph-mon[32756]: pgmap v10023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:22 smithi156 ceph-mon[32679]: pgmap v10023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17819.599689 secs 2024-04-26T23:15:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:24 smithi092 ceph-mon[29156]: pgmap v10024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17122.570630 secs 2024-04-26T23:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17819.599689 secs 2024-04-26T23:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:24 smithi189 ceph-mon[32756]: pgmap v10024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17122.570630 secs 2024-04-26T23:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17819.599689 secs 2024-04-26T23:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:24 smithi156 ceph-mon[32679]: pgmap v10024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17122.570630 secs 2024-04-26T23:15:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:26 smithi189 ceph-mon[32756]: pgmap v10025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:26 smithi156 ceph-mon[32679]: pgmap v10025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:26 smithi092 ceph-mon[29156]: pgmap v10025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:28 smithi189 ceph-mon[32756]: pgmap v10026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:28 smithi156 ceph-mon[32679]: pgmap v10026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:28 smithi092 ceph-mon[29156]: pgmap v10026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:30.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17824.599808 secs 2024-04-26T23:15:30.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17127.570729 secs 2024-04-26T23:15:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17824.599808 secs 2024-04-26T23:15:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17127.570729 secs 2024-04-26T23:15:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17824.599808 secs 2024-04-26T23:15:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17127.570729 secs 2024-04-26T23:15:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:30 smithi189 ceph-mon[32756]: pgmap v10027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:30 smithi156 ceph-mon[32679]: pgmap v10027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:30 smithi092 ceph-mon[29156]: pgmap v10027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:15:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:15:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:15:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:32 smithi189 ceph-mon[32756]: pgmap v10028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:15:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:15:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:15:33.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:32 smithi092 ceph-mon[29156]: pgmap v10028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:33.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:15:33.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:15:33.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:15:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:32 smithi156 ceph-mon[32679]: pgmap v10028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:15:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:15:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:15:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:33 smithi189 ceph-mon[32756]: pgmap v10029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:15:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:33 smithi189 ceph-mon[32756]: pgmap v10030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:33 smithi156 ceph-mon[32679]: pgmap v10029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:15:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:33 smithi156 ceph-mon[32679]: pgmap v10030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:33 smithi092 ceph-mon[29156]: pgmap v10029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:15:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:33 smithi092 ceph-mon[29156]: pgmap v10030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17829.599907 secs 2024-04-26T23:15:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17132.570851 secs 2024-04-26T23:15:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17829.599907 secs 2024-04-26T23:15:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17132.570851 secs 2024-04-26T23:15:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17829.599907 secs 2024-04-26T23:15:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17132.570851 secs 2024-04-26T23:15:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:35 smithi189 ceph-mon[32756]: pgmap v10031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:35 smithi156 ceph-mon[32679]: pgmap v10031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:35 smithi092 ceph-mon[29156]: pgmap v10031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:37 smithi189 ceph-mon[32756]: pgmap v10032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:37 smithi156 ceph-mon[32679]: pgmap v10032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:37 smithi092 ceph-mon[29156]: pgmap v10032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 139 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.427+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:15:38.429 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:15:38.428+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 140 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:15:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:39 smithi189 ceph-mon[32756]: pgmap v10033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:39 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 17834.600006 secs 2024-04-26T23:15:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:39 smithi189 ceph-mon[32756]: slow request 363.117001 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:15:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17137.570994 secs 2024-04-26T23:15:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:39 smithi156 ceph-mon[32679]: pgmap v10033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:39 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 17834.600006 secs 2024-04-26T23:15:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:39 smithi156 ceph-mon[32679]: slow request 363.117001 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:15:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17137.570994 secs 2024-04-26T23:15:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:39 smithi092 ceph-mon[29156]: pgmap v10033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:15:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:39 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 17834.600006 secs 2024-04-26T23:15:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:39 smithi092 ceph-mon[29156]: slow request 363.117001 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:15:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17137.570994 secs 2024-04-26T23:15:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:41 smithi189 ceph-mon[32756]: pgmap v10034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:41 smithi156 ceph-mon[32679]: pgmap v10034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:41 smithi092 ceph-mon[29156]: pgmap v10034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:15:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:43 smithi189 ceph-mon[32756]: pgmap v10035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:15:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:43 smithi156 ceph-mon[32679]: pgmap v10035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:15:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:43 smithi092 ceph-mon[29156]: pgmap v10035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:15:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17839.600126 secs 2024-04-26T23:15:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17142.571110 secs 2024-04-26T23:15:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17839.600126 secs 2024-04-26T23:15:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17142.571110 secs 2024-04-26T23:15:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17839.600126 secs 2024-04-26T23:15:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17142.571110 secs 2024-04-26T23:15:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:45 smithi189 ceph-mon[32756]: pgmap v10036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:45 smithi156 ceph-mon[32679]: pgmap v10036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:45 smithi092 ceph-mon[29156]: pgmap v10036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:47 smithi189 ceph-mon[32756]: pgmap v10037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:47 smithi156 ceph-mon[32679]: pgmap v10037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:47 smithi092 ceph-mon[29156]: pgmap v10037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:49 smithi189 ceph-mon[32756]: pgmap v10038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17844.600247 secs 2024-04-26T23:15:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17147.571221 secs 2024-04-26T23:15:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:49 smithi156 ceph-mon[32679]: pgmap v10038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17844.600247 secs 2024-04-26T23:15:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17147.571221 secs 2024-04-26T23:15:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:49 smithi092 ceph-mon[29156]: pgmap v10038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17844.600247 secs 2024-04-26T23:15:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17147.571221 secs 2024-04-26T23:15:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:51 smithi189 ceph-mon[32756]: pgmap v10039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:51 smithi156 ceph-mon[32679]: pgmap v10039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:51 smithi092 ceph-mon[29156]: pgmap v10039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:53 smithi189 ceph-mon[32756]: pgmap v10040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:53 smithi156 ceph-mon[32679]: pgmap v10040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:53 smithi092 ceph-mon[29156]: pgmap v10040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:55.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17849.600389 secs 2024-04-26T23:15:55.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17152.571353 secs 2024-04-26T23:15:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17849.600389 secs 2024-04-26T23:15:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17152.571353 secs 2024-04-26T23:15:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17849.600389 secs 2024-04-26T23:15:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17152.571353 secs 2024-04-26T23:15:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:55 smithi189 ceph-mon[32756]: pgmap v10041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:55 smithi156 ceph-mon[32679]: pgmap v10041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:55 smithi092 ceph-mon[29156]: pgmap v10041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:15:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:57 smithi189 ceph-mon[32756]: pgmap v10042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:57 smithi156 ceph-mon[32679]: pgmap v10042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:15:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:57 smithi092 ceph-mon[29156]: pgmap v10042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:59 smithi189 ceph-mon[32756]: pgmap v10043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17854.600526 secs 2024-04-26T23:16:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:15:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17157.571441 secs 2024-04-26T23:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:59 smithi156 ceph-mon[32679]: pgmap v10043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17854.600526 secs 2024-04-26T23:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:15:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17157.571441 secs 2024-04-26T23:16:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:59 smithi092 ceph-mon[29156]: pgmap v10043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17854.600526 secs 2024-04-26T23:16:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:15:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17157.571441 secs 2024-04-26T23:16:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:01 smithi189 ceph-mon[32756]: pgmap v10044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:01 smithi156 ceph-mon[32679]: pgmap v10044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:01 smithi092 ceph-mon[29156]: pgmap v10044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:03 smithi189 ceph-mon[32756]: pgmap v10045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:03 smithi156 ceph-mon[32679]: pgmap v10045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:03 smithi092 ceph-mon[29156]: pgmap v10045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17859.600668 secs 2024-04-26T23:16:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17162.571532 secs 2024-04-26T23:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17859.600668 secs 2024-04-26T23:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17162.571532 secs 2024-04-26T23:16:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17859.600668 secs 2024-04-26T23:16:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17162.571532 secs 2024-04-26T23:16:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:05 smithi189 ceph-mon[32756]: pgmap v10046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:05 smithi156 ceph-mon[32679]: pgmap v10046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:05 smithi092 ceph-mon[29156]: pgmap v10046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:07 smithi189 ceph-mon[32756]: pgmap v10047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:07 smithi156 ceph-mon[32679]: pgmap v10047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:07 smithi092 ceph-mon[29156]: pgmap v10047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:09 smithi189 ceph-mon[32756]: pgmap v10048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17864.600820 secs 2024-04-26T23:16:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17167.571622 secs 2024-04-26T23:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:09 smithi156 ceph-mon[32679]: pgmap v10048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17864.600820 secs 2024-04-26T23:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17167.571622 secs 2024-04-26T23:16:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:09 smithi092 ceph-mon[29156]: pgmap v10048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17864.600820 secs 2024-04-26T23:16:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17167.571622 secs 2024-04-26T23:16:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:11 smithi189 ceph-mon[32756]: pgmap v10049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:11 smithi156 ceph-mon[32679]: pgmap v10049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:11 smithi092 ceph-mon[29156]: pgmap v10049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:13 smithi189 ceph-mon[32756]: pgmap v10050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:13 smithi156 ceph-mon[32679]: pgmap v10050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:13 smithi092 ceph-mon[29156]: pgmap v10050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17869.600933 secs 2024-04-26T23:16:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17172.571701 secs 2024-04-26T23:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17869.600933 secs 2024-04-26T23:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17172.571701 secs 2024-04-26T23:16:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17869.600933 secs 2024-04-26T23:16:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17172.571701 secs 2024-04-26T23:16:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:15 smithi189 ceph-mon[32756]: pgmap v10051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:15 smithi156 ceph-mon[32679]: pgmap v10051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:15 smithi092 ceph-mon[29156]: pgmap v10051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:17 smithi189 ceph-mon[32756]: pgmap v10052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:17 smithi156 ceph-mon[32679]: pgmap v10052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:17 smithi092 ceph-mon[29156]: pgmap v10052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:19 smithi189 ceph-mon[32756]: pgmap v10053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17874.601010 secs 2024-04-26T23:16:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17177.571771 secs 2024-04-26T23:16:20.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:19 smithi092 ceph-mon[29156]: pgmap v10053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:20.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17874.601010 secs 2024-04-26T23:16:20.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17177.571771 secs 2024-04-26T23:16:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:19 smithi156 ceph-mon[32679]: pgmap v10053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17874.601010 secs 2024-04-26T23:16:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17177.571771 secs 2024-04-26T23:16:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:21 smithi189 ceph-mon[32756]: pgmap v10054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:21 smithi156 ceph-mon[32679]: pgmap v10054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:21 smithi092 ceph-mon[29156]: pgmap v10054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:23 smithi189 ceph-mon[32756]: pgmap v10055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:23 smithi156 ceph-mon[32679]: pgmap v10055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:23 smithi092 ceph-mon[29156]: pgmap v10055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17879.601137 secs 2024-04-26T23:16:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17182.571856 secs 2024-04-26T23:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17879.601137 secs 2024-04-26T23:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17182.571856 secs 2024-04-26T23:16:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17879.601137 secs 2024-04-26T23:16:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17182.571856 secs 2024-04-26T23:16:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:25 smithi189 ceph-mon[32756]: pgmap v10056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:25 smithi156 ceph-mon[32679]: pgmap v10056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:25 smithi092 ceph-mon[29156]: pgmap v10056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:27 smithi189 ceph-mon[32756]: pgmap v10057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:27 smithi156 ceph-mon[32679]: pgmap v10057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:27 smithi092 ceph-mon[29156]: pgmap v10057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:29 smithi189 ceph-mon[32756]: pgmap v10058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17884.601199 secs 2024-04-26T23:16:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17187.571987 secs 2024-04-26T23:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:29 smithi156 ceph-mon[32679]: pgmap v10058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17884.601199 secs 2024-04-26T23:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17187.571987 secs 2024-04-26T23:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:29 smithi092 ceph-mon[29156]: pgmap v10058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17884.601199 secs 2024-04-26T23:16:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17187.571987 secs 2024-04-26T23:16:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:31 smithi156 ceph-mon[32679]: pgmap v10059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:31 smithi092 ceph-mon[29156]: pgmap v10059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:31 smithi189 ceph-mon[32756]: pgmap v10059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:16:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:16:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: pgmap v10060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17889.601271 secs 2024-04-26T23:16:34.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17192.572047 secs 2024-04-26T23:16:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: pgmap v10060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17889.601271 secs 2024-04-26T23:16:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17192.572047 secs 2024-04-26T23:16:34.169 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: pgmap v10060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:34.169 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17889.601271 secs 2024-04-26T23:16:34.170 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17192.572047 secs 2024-04-26T23:16:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: pgmap v10061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:16:36.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:16:36.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: pgmap v10061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:16:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: pgmap v10061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:16:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:16:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: pgmap v10062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:37 smithi189 ceph-mon[32756]: pgmap v10063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:16:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: pgmap v10062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:37 smithi156 ceph-mon[32679]: pgmap v10063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: pgmap v10062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:37 smithi092 ceph-mon[29156]: pgmap v10063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:39 smithi189 ceph-mon[32756]: pgmap v10064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17894.601386 secs 2024-04-26T23:16:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17197.572168 secs 2024-04-26T23:16:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:39 smithi156 ceph-mon[32679]: pgmap v10064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17894.601386 secs 2024-04-26T23:16:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17197.572168 secs 2024-04-26T23:16:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:39 smithi092 ceph-mon[29156]: pgmap v10064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17894.601386 secs 2024-04-26T23:16:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17197.572168 secs 2024-04-26T23:16:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:41 smithi189 ceph-mon[32756]: pgmap v10065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:41 smithi156 ceph-mon[32679]: pgmap v10065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:41 smithi092 ceph-mon[29156]: pgmap v10065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:43 smithi189 ceph-mon[32756]: pgmap v10066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:43 smithi156 ceph-mon[32679]: pgmap v10066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:43 smithi092 ceph-mon[29156]: pgmap v10066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17899.601506 secs 2024-04-26T23:16:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17202.572232 secs 2024-04-26T23:16:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17899.601506 secs 2024-04-26T23:16:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17202.572232 secs 2024-04-26T23:16:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17899.601506 secs 2024-04-26T23:16:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17202.572232 secs 2024-04-26T23:16:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:45 smithi189 ceph-mon[32756]: pgmap v10067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:45 smithi156 ceph-mon[32679]: pgmap v10067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:45 smithi092 ceph-mon[29156]: pgmap v10067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:16:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:47 smithi189 ceph-mon[32756]: pgmap v10068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:16:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:47 smithi156 ceph-mon[32679]: pgmap v10068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:16:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:47 smithi092 ceph-mon[29156]: pgmap v10068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:16:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:49 smithi189 ceph-mon[32756]: pgmap v10069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17904.601586 secs 2024-04-26T23:16:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17207.572349 secs 2024-04-26T23:16:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:49 smithi156 ceph-mon[32679]: pgmap v10069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17904.601586 secs 2024-04-26T23:16:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17207.572349 secs 2024-04-26T23:16:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:49 smithi092 ceph-mon[29156]: pgmap v10069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17904.601586 secs 2024-04-26T23:16:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17207.572349 secs 2024-04-26T23:16:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:51 smithi189 ceph-mon[32756]: pgmap v10070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:51 smithi156 ceph-mon[32679]: pgmap v10070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:51 smithi092 ceph-mon[29156]: pgmap v10070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:53 smithi189 ceph-mon[32756]: pgmap v10071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:53 smithi156 ceph-mon[32679]: pgmap v10071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:53 smithi092 ceph-mon[29156]: pgmap v10071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17909.601719 secs 2024-04-26T23:16:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17212.572488 secs 2024-04-26T23:16:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17909.601719 secs 2024-04-26T23:16:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17212.572488 secs 2024-04-26T23:16:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17909.601719 secs 2024-04-26T23:16:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17212.572488 secs 2024-04-26T23:16:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:55 smithi156 ceph-mon[32679]: pgmap v10072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:55 smithi092 ceph-mon[29156]: pgmap v10072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:55 smithi189 ceph-mon[32756]: pgmap v10072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:16:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:57 smithi156 ceph-mon[32679]: pgmap v10073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:57 smithi092 ceph-mon[29156]: pgmap v10073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:57 smithi189 ceph-mon[32756]: pgmap v10073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:59 smithi156 ceph-mon[32679]: pgmap v10074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17914.601853 secs 2024-04-26T23:16:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:16:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17217.572606 secs 2024-04-26T23:16:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:59 smithi092 ceph-mon[29156]: pgmap v10074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17914.601853 secs 2024-04-26T23:16:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:16:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17217.572606 secs 2024-04-26T23:16:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:59 smithi189 ceph-mon[32756]: pgmap v10074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:16:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17914.601853 secs 2024-04-26T23:16:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:16:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17217.572606 secs 2024-04-26T23:17:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:01 smithi156 ceph-mon[32679]: pgmap v10075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:01.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:01 smithi189 ceph-mon[32756]: pgmap v10075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:01 smithi092 ceph-mon[29156]: pgmap v10075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:03 smithi156 ceph-mon[32679]: pgmap v10076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:03 smithi092 ceph-mon[29156]: pgmap v10076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:03 smithi189 ceph-mon[32756]: pgmap v10076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17919.601942 secs 2024-04-26T23:17:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17222.572681 secs 2024-04-26T23:17:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17919.601942 secs 2024-04-26T23:17:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17222.572681 secs 2024-04-26T23:17:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17919.601942 secs 2024-04-26T23:17:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17222.572681 secs 2024-04-26T23:17:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:05 smithi156 ceph-mon[32679]: pgmap v10077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:05 smithi092 ceph-mon[29156]: pgmap v10077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:05 smithi189 ceph-mon[32756]: pgmap v10077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:07 smithi156 ceph-mon[32679]: pgmap v10078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:07 smithi092 ceph-mon[29156]: pgmap v10078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:07 smithi189 ceph-mon[32756]: pgmap v10078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:09 smithi156 ceph-mon[32679]: pgmap v10079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17924.602056 secs 2024-04-26T23:17:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17227.572796 secs 2024-04-26T23:17:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:09 smithi092 ceph-mon[29156]: pgmap v10079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17924.602056 secs 2024-04-26T23:17:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17227.572796 secs 2024-04-26T23:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:09 smithi189 ceph-mon[32756]: pgmap v10079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17924.602056 secs 2024-04-26T23:17:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17227.572796 secs 2024-04-26T23:17:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:11 smithi156 ceph-mon[32679]: pgmap v10080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:11 smithi092 ceph-mon[29156]: pgmap v10080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:11 smithi189 ceph-mon[32756]: pgmap v10080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:13 smithi156 ceph-mon[32679]: pgmap v10081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:13 smithi092 ceph-mon[29156]: pgmap v10081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:13 smithi189 ceph-mon[32756]: pgmap v10081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:17:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17929.602155 secs 2024-04-26T23:17:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17232.572873 secs 2024-04-26T23:17:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17929.602155 secs 2024-04-26T23:17:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17232.572873 secs 2024-04-26T23:17:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17929.602155 secs 2024-04-26T23:17:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17232.572873 secs 2024-04-26T23:17:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:15 smithi092 ceph-mon[29156]: pgmap v10082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:15 smithi189 ceph-mon[32756]: pgmap v10082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:15 smithi156 ceph-mon[32679]: pgmap v10082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:17:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:17 smithi092 ceph-mon[29156]: pgmap v10083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:17 smithi189 ceph-mon[32756]: pgmap v10083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:17 smithi156 ceph-mon[32679]: pgmap v10083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:19 smithi092 ceph-mon[29156]: pgmap v10084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17934.602268 secs 2024-04-26T23:17:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17237.573004 secs 2024-04-26T23:17:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:19 smithi189 ceph-mon[32756]: pgmap v10084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17934.602268 secs 2024-04-26T23:17:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17237.573004 secs 2024-04-26T23:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:19 smithi156 ceph-mon[32679]: pgmap v10084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17934.602268 secs 2024-04-26T23:17:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17237.573004 secs 2024-04-26T23:17:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:21 smithi092 ceph-mon[29156]: pgmap v10085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:21 smithi189 ceph-mon[32756]: pgmap v10085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:21 smithi156 ceph-mon[32679]: pgmap v10085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:23 smithi092 ceph-mon[29156]: pgmap v10086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:23 smithi189 ceph-mon[32756]: pgmap v10086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:23 smithi156 ceph-mon[32679]: pgmap v10086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17939.602347 secs 2024-04-26T23:17:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17242.573074 secs 2024-04-26T23:17:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17939.602347 secs 2024-04-26T23:17:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17242.573074 secs 2024-04-26T23:17:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17939.602347 secs 2024-04-26T23:17:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17242.573074 secs 2024-04-26T23:17:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:25 smithi092 ceph-mon[29156]: pgmap v10087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:25.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:25 smithi156 ceph-mon[32679]: pgmap v10087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:25 smithi189 ceph-mon[32756]: pgmap v10087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:27 smithi092 ceph-mon[29156]: pgmap v10088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:27 smithi189 ceph-mon[32756]: pgmap v10088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:27 smithi156 ceph-mon[32679]: pgmap v10088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:29 smithi092 ceph-mon[29156]: pgmap v10089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17944.602478 secs 2024-04-26T23:17:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17247.573145 secs 2024-04-26T23:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:29 smithi189 ceph-mon[32756]: pgmap v10089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17944.602478 secs 2024-04-26T23:17:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17247.573145 secs 2024-04-26T23:17:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:29 smithi156 ceph-mon[32679]: pgmap v10089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17944.602478 secs 2024-04-26T23:17:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17247.573145 secs 2024-04-26T23:17:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:31 smithi092 ceph-mon[29156]: pgmap v10090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:31 smithi189 ceph-mon[32756]: pgmap v10090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:31 smithi156 ceph-mon[32679]: pgmap v10090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:33 smithi092 ceph-mon[29156]: pgmap v10091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:33 smithi189 ceph-mon[32756]: pgmap v10091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:33 smithi156 ceph-mon[32679]: pgmap v10091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17949.602586 secs 2024-04-26T23:17:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17252.573279 secs 2024-04-26T23:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17949.602586 secs 2024-04-26T23:17:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17252.573279 secs 2024-04-26T23:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17949.602586 secs 2024-04-26T23:17:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17252.573279 secs 2024-04-26T23:17:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:35 smithi092 ceph-mon[29156]: pgmap v10092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:35 smithi189 ceph-mon[32756]: pgmap v10092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:35 smithi156 ceph-mon[32679]: pgmap v10092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:17:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:17:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:17:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:37 smithi092 ceph-mon[29156]: pgmap v10093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:17:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:17:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:17:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:37 smithi189 ceph-mon[32756]: pgmap v10093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:17:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:17:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:17:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:37 smithi156 ceph-mon[32679]: pgmap v10093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:17:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:17:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:17:38.265 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:38 smithi092 ceph-mon[29156]: pgmap v10094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:17:38.265 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:38 smithi092 ceph-mon[29156]: pgmap v10095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:38 smithi189 ceph-mon[32756]: pgmap v10094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:17:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:38 smithi189 ceph-mon[32756]: pgmap v10095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:38 smithi156 ceph-mon[32679]: pgmap v10094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:17:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:38 smithi156 ceph-mon[32679]: pgmap v10095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17954.602701 secs 2024-04-26T23:17:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17257.573371 secs 2024-04-26T23:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17954.602701 secs 2024-04-26T23:17:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17257.573371 secs 2024-04-26T23:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17954.602701 secs 2024-04-26T23:17:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17257.573371 secs 2024-04-26T23:17:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:40 smithi189 ceph-mon[32756]: pgmap v10096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:40 smithi156 ceph-mon[32679]: pgmap v10096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:40 smithi092 ceph-mon[29156]: pgmap v10096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:42 smithi189 ceph-mon[32756]: pgmap v10097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:42 smithi156 ceph-mon[32679]: pgmap v10097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:42 smithi092 ceph-mon[29156]: pgmap v10097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:44 smithi189 ceph-mon[32756]: pgmap v10098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:17:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17959.602766 secs 2024-04-26T23:17:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17262.573480 secs 2024-04-26T23:17:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:44 smithi156 ceph-mon[32679]: pgmap v10098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:17:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17959.602766 secs 2024-04-26T23:17:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17262.573480 secs 2024-04-26T23:17:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:44 smithi092 ceph-mon[29156]: pgmap v10098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:17:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17959.602766 secs 2024-04-26T23:17:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17262.573480 secs 2024-04-26T23:17:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:46 smithi189 ceph-mon[32756]: pgmap v10099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:46 smithi156 ceph-mon[32679]: pgmap v10099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:46 smithi092 ceph-mon[29156]: pgmap v10099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:17:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:48 smithi189 ceph-mon[32756]: pgmap v10100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:17:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:48 smithi156 ceph-mon[32679]: pgmap v10100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:17:48.702 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:48 smithi092 ceph-mon[29156]: pgmap v10100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17964.602884 secs 2024-04-26T23:17:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17267.573617 secs 2024-04-26T23:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17964.602884 secs 2024-04-26T23:17:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17267.573617 secs 2024-04-26T23:17:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17964.602884 secs 2024-04-26T23:17:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17267.573617 secs 2024-04-26T23:17:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:50 smithi189 ceph-mon[32756]: pgmap v10101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:50 smithi156 ceph-mon[32679]: pgmap v10101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:50 smithi092 ceph-mon[29156]: pgmap v10101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:52.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:52 smithi092 ceph-mon[29156]: pgmap v10102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:52 smithi189 ceph-mon[32756]: pgmap v10102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:52 smithi156 ceph-mon[32679]: pgmap v10102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:54 smithi189 ceph-mon[32756]: pgmap v10103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17969.602997 secs 2024-04-26T23:17:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17272.573732 secs 2024-04-26T23:17:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:54 smithi156 ceph-mon[32679]: pgmap v10103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17969.602997 secs 2024-04-26T23:17:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17272.573732 secs 2024-04-26T23:17:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:54 smithi092 ceph-mon[29156]: pgmap v10103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17969.602997 secs 2024-04-26T23:17:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17272.573732 secs 2024-04-26T23:17:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:56 smithi189 ceph-mon[32756]: pgmap v10104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:56 smithi156 ceph-mon[32679]: pgmap v10104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:56 smithi092 ceph-mon[29156]: pgmap v10104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:17:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:58 smithi189 ceph-mon[32756]: pgmap v10105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:58 smithi156 ceph-mon[32679]: pgmap v10105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:58.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:58 smithi092 ceph-mon[29156]: pgmap v10105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:17:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17974.603093 secs 2024-04-26T23:17:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:17:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17277.573825 secs 2024-04-26T23:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17974.603093 secs 2024-04-26T23:17:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:17:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17277.573825 secs 2024-04-26T23:17:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17974.603093 secs 2024-04-26T23:17:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:17:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17277.573825 secs 2024-04-26T23:18:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:00 smithi189 ceph-mon[32756]: pgmap v10106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:00 smithi156 ceph-mon[32679]: pgmap v10106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:00 smithi092 ceph-mon[29156]: pgmap v10106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:02 smithi189 ceph-mon[32756]: pgmap v10107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:02 smithi156 ceph-mon[32679]: pgmap v10107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:02 smithi092 ceph-mon[29156]: pgmap v10107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:04 smithi189 ceph-mon[32756]: pgmap v10108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17979.603209 secs 2024-04-26T23:18:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17282.573970 secs 2024-04-26T23:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:04 smithi156 ceph-mon[32679]: pgmap v10108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17979.603209 secs 2024-04-26T23:18:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17282.573970 secs 2024-04-26T23:18:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:04 smithi092 ceph-mon[29156]: pgmap v10108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17979.603209 secs 2024-04-26T23:18:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17282.573970 secs 2024-04-26T23:18:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:06 smithi189 ceph-mon[32756]: pgmap v10109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:06 smithi156 ceph-mon[32679]: pgmap v10109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:06 smithi092 ceph-mon[29156]: pgmap v10109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:08 smithi189 ceph-mon[32756]: pgmap v10110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:08 smithi156 ceph-mon[32679]: pgmap v10110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:08 smithi092 ceph-mon[29156]: pgmap v10110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17984.603299 secs 2024-04-26T23:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17287.574088 secs 2024-04-26T23:18:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:09 smithi092 ceph-mon[29156]: pgmap v10111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17984.603299 secs 2024-04-26T23:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17287.574088 secs 2024-04-26T23:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:09 smithi189 ceph-mon[32756]: pgmap v10111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17984.603299 secs 2024-04-26T23:18:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17287.574088 secs 2024-04-26T23:18:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:09 smithi156 ceph-mon[32679]: pgmap v10111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:11 smithi189 ceph-mon[32756]: pgmap v10112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:11 smithi156 ceph-mon[32679]: pgmap v10112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:11 smithi092 ceph-mon[29156]: pgmap v10112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:13 smithi189 ceph-mon[32756]: pgmap v10113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:13 smithi156 ceph-mon[32679]: pgmap v10113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:13 smithi092 ceph-mon[29156]: pgmap v10113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17989.603365 secs 2024-04-26T23:18:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17292.574206 secs 2024-04-26T23:18:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17989.603365 secs 2024-04-26T23:18:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17292.574206 secs 2024-04-26T23:18:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17989.603365 secs 2024-04-26T23:18:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17292.574206 secs 2024-04-26T23:18:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:15 smithi189 ceph-mon[32756]: pgmap v10114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:15 smithi156 ceph-mon[32679]: pgmap v10114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:15 smithi092 ceph-mon[29156]: pgmap v10114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:17 smithi189 ceph-mon[32756]: pgmap v10115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:17 smithi156 ceph-mon[32679]: pgmap v10115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:17 smithi092 ceph-mon[29156]: pgmap v10115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17994.603520 secs 2024-04-26T23:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17297.574325 secs 2024-04-26T23:18:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:19 smithi189 ceph-mon[32756]: pgmap v10116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17994.603520 secs 2024-04-26T23:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17297.574325 secs 2024-04-26T23:18:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:19 smithi156 ceph-mon[32679]: pgmap v10116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17994.603520 secs 2024-04-26T23:18:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17297.574325 secs 2024-04-26T23:18:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:19 smithi092 ceph-mon[29156]: pgmap v10116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:21 smithi189 ceph-mon[32756]: pgmap v10117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:21 smithi156 ceph-mon[32679]: pgmap v10117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:21 smithi092 ceph-mon[29156]: pgmap v10117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:23 smithi189 ceph-mon[32756]: pgmap v10118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:23 smithi156 ceph-mon[32679]: pgmap v10118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:23 smithi092 ceph-mon[29156]: pgmap v10118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 17999.603655 secs 2024-04-26T23:18:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17302.574403 secs 2024-04-26T23:18:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 17999.603655 secs 2024-04-26T23:18:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17302.574403 secs 2024-04-26T23:18:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 17999.603655 secs 2024-04-26T23:18:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17302.574403 secs 2024-04-26T23:18:26.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:25 smithi156 ceph-mon[32679]: pgmap v10119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:25 smithi189 ceph-mon[32756]: pgmap v10119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:25 smithi092 ceph-mon[29156]: pgmap v10119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:27 smithi189 ceph-mon[32756]: pgmap v10120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:27 smithi156 ceph-mon[32679]: pgmap v10120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:27 smithi092 ceph-mon[29156]: pgmap v10120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18004.603774 secs 2024-04-26T23:18:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17307.574519 secs 2024-04-26T23:18:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:29 smithi189 ceph-mon[32756]: pgmap v10121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18004.603774 secs 2024-04-26T23:18:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17307.574519 secs 2024-04-26T23:18:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:29 smithi156 ceph-mon[32679]: pgmap v10121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18004.603774 secs 2024-04-26T23:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17307.574519 secs 2024-04-26T23:18:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:29 smithi092 ceph-mon[29156]: pgmap v10121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:31 smithi189 ceph-mon[32756]: pgmap v10122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:31 smithi156 ceph-mon[32679]: pgmap v10122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:31 smithi092 ceph-mon[29156]: pgmap v10122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:33 smithi189 ceph-mon[32756]: pgmap v10123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:33 smithi156 ceph-mon[32679]: pgmap v10123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:33 smithi092 ceph-mon[29156]: pgmap v10123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18009.603850 secs 2024-04-26T23:18:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17312.574617 secs 2024-04-26T23:18:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18009.603850 secs 2024-04-26T23:18:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17312.574617 secs 2024-04-26T23:18:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18009.603850 secs 2024-04-26T23:18:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17312.574617 secs 2024-04-26T23:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T23:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-26T23:18:36.019 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T23:18:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:18:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:18:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:18:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:18:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.018+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca808a050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:18:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.045+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:18:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.045+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:18:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.045+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:18:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.045+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=18 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.045+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.046+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T23:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:36.046+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T23:18:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:35 smithi189 ceph-mon[32756]: pgmap v10124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:35 smithi156 ceph-mon[32679]: pgmap v10124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:35 smithi092 ceph-mon[29156]: pgmap v10124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:18:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:18:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:18:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:37 smithi189 ceph-mon[32756]: pgmap v10125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:18:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:18:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:18:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:37 smithi156 ceph-mon[32679]: pgmap v10125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:18:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:18:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:18:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:37 smithi092 ceph-mon[29156]: pgmap v10125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:18:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:18:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:18:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:38.452+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:18:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:38.452+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:18:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:38.452+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:18:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:18:38.452+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 141 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:18:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:38 smithi189 ceph-mon[32756]: pgmap v10126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:18:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:38 smithi189 ceph-mon[32756]: pgmap v10127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:18:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:38 smithi156 ceph-mon[32679]: pgmap v10126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:18:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:38 smithi156 ceph-mon[32679]: pgmap v10127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:18:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:38 smithi092 ceph-mon[29156]: pgmap v10126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:18:39.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:38 smithi092 ceph-mon[29156]: pgmap v10127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:18:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18014.603966 secs 2024-04-26T23:18:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17317.574719 secs 2024-04-26T23:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18014.603966 secs 2024-04-26T23:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17317.574719 secs 2024-04-26T23:18:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18014.603966 secs 2024-04-26T23:18:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17317.574719 secs 2024-04-26T23:18:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:40 smithi189 ceph-mon[32756]: pgmap v10128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:40 smithi156 ceph-mon[32679]: pgmap v10128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:40 smithi092 ceph-mon[29156]: pgmap v10128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:42 smithi189 ceph-mon[32756]: pgmap v10129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:42 smithi156 ceph-mon[32679]: pgmap v10129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:42 smithi092 ceph-mon[29156]: pgmap v10129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:44 smithi189 ceph-mon[32756]: pgmap v10130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18019.604102 secs 2024-04-26T23:18:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17322.574840 secs 2024-04-26T23:18:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:44 smithi156 ceph-mon[32679]: pgmap v10130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18019.604102 secs 2024-04-26T23:18:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17322.574840 secs 2024-04-26T23:18:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:44 smithi092 ceph-mon[29156]: pgmap v10130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18019.604102 secs 2024-04-26T23:18:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17322.574840 secs 2024-04-26T23:18:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:46 smithi189 ceph-mon[32756]: pgmap v10131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:46 smithi156 ceph-mon[32679]: pgmap v10131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:46 smithi092 ceph-mon[29156]: pgmap v10131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:18:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:48 smithi189 ceph-mon[32756]: pgmap v10132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:18:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:48 smithi156 ceph-mon[32679]: pgmap v10132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:18:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:48 smithi092 ceph-mon[29156]: pgmap v10132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:18:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18024.604220 secs 2024-04-26T23:18:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17327.574917 secs 2024-04-26T23:18:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18024.604220 secs 2024-04-26T23:18:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17327.574917 secs 2024-04-26T23:18:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18024.604220 secs 2024-04-26T23:18:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17327.574917 secs 2024-04-26T23:18:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:50 smithi156 ceph-mon[32679]: pgmap v10133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:50 smithi092 ceph-mon[29156]: pgmap v10133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:50 smithi189 ceph-mon[32756]: pgmap v10133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:52 smithi156 ceph-mon[32679]: pgmap v10134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:52 smithi092 ceph-mon[29156]: pgmap v10134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:53.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:52 smithi189 ceph-mon[32756]: pgmap v10134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18029.604317 secs 2024-04-26T23:18:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:54 smithi156 ceph-mon[32679]: pgmap v10135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17332.575035 secs 2024-04-26T23:18:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18029.604317 secs 2024-04-26T23:18:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:54 smithi092 ceph-mon[29156]: pgmap v10135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17332.575035 secs 2024-04-26T23:18:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18029.604317 secs 2024-04-26T23:18:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:54 smithi189 ceph-mon[32756]: pgmap v10135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:18:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17332.575035 secs 2024-04-26T23:18:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:56 smithi156 ceph-mon[32679]: pgmap v10136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:56 smithi092 ceph-mon[29156]: pgmap v10136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:56 smithi189 ceph-mon[32756]: pgmap v10136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:58 smithi156 ceph-mon[32679]: pgmap v10137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:58 smithi092 ceph-mon[29156]: pgmap v10137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:18:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:58 smithi189 ceph-mon[32756]: pgmap v10137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18034.604437 secs 2024-04-26T23:19:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:18:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17337.575151 secs 2024-04-26T23:19:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18034.604437 secs 2024-04-26T23:19:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:18:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17337.575151 secs 2024-04-26T23:19:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18034.604437 secs 2024-04-26T23:19:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:18:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17337.575151 secs 2024-04-26T23:19:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:00 smithi156 ceph-mon[32679]: pgmap v10138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:00 smithi092 ceph-mon[29156]: pgmap v10138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:00 smithi189 ceph-mon[32756]: pgmap v10138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:02 smithi156 ceph-mon[32679]: pgmap v10139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:03.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:02 smithi189 ceph-mon[32756]: pgmap v10139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:02 smithi092 ceph-mon[29156]: pgmap v10139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18039.604533 secs 2024-04-26T23:19:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:04 smithi156 ceph-mon[32679]: pgmap v10140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17342.575268 secs 2024-04-26T23:19:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18039.604533 secs 2024-04-26T23:19:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:04 smithi092 ceph-mon[29156]: pgmap v10140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17342.575268 secs 2024-04-26T23:19:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18039.604533 secs 2024-04-26T23:19:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:04 smithi189 ceph-mon[32756]: pgmap v10140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17342.575268 secs 2024-04-26T23:19:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:06 smithi156 ceph-mon[32679]: pgmap v10141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:06 smithi092 ceph-mon[29156]: pgmap v10141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:06 smithi189 ceph-mon[32756]: pgmap v10141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:08 smithi156 ceph-mon[32679]: pgmap v10142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:08 smithi092 ceph-mon[29156]: pgmap v10142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:08 smithi189 ceph-mon[32756]: pgmap v10142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:10.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18044.604643 secs 2024-04-26T23:19:10.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17347.575370 secs 2024-04-26T23:19:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18044.604643 secs 2024-04-26T23:19:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17347.575370 secs 2024-04-26T23:19:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18044.604643 secs 2024-04-26T23:19:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17347.575370 secs 2024-04-26T23:19:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:10 smithi156 ceph-mon[32679]: pgmap v10143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:10 smithi092 ceph-mon[29156]: pgmap v10143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:10 smithi189 ceph-mon[32756]: pgmap v10143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:12 smithi092 ceph-mon[29156]: pgmap v10144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:12 smithi189 ceph-mon[32756]: pgmap v10144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:12 smithi156 ceph-mon[32679]: pgmap v10144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18049.604756 secs 2024-04-26T23:19:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:14 smithi092 ceph-mon[29156]: pgmap v10145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17352.575437 secs 2024-04-26T23:19:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18049.604756 secs 2024-04-26T23:19:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:14 smithi189 ceph-mon[32756]: pgmap v10145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17352.575437 secs 2024-04-26T23:19:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18049.604756 secs 2024-04-26T23:19:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:14 smithi156 ceph-mon[32679]: pgmap v10145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17352.575437 secs 2024-04-26T23:19:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:16 smithi092 ceph-mon[29156]: pgmap v10146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:16 smithi189 ceph-mon[32756]: pgmap v10146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:16 smithi156 ceph-mon[32679]: pgmap v10146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:18 smithi092 ceph-mon[29156]: pgmap v10147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:18 smithi189 ceph-mon[32756]: pgmap v10147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:18 smithi156 ceph-mon[32679]: pgmap v10147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18054.604888 secs 2024-04-26T23:19:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17357.575541 secs 2024-04-26T23:19:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18054.604888 secs 2024-04-26T23:19:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17357.575541 secs 2024-04-26T23:19:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18054.604888 secs 2024-04-26T23:19:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17357.575541 secs 2024-04-26T23:19:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:20 smithi092 ceph-mon[29156]: pgmap v10148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:20 smithi189 ceph-mon[32756]: pgmap v10148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:20 smithi156 ceph-mon[32679]: pgmap v10148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:22 smithi092 ceph-mon[29156]: pgmap v10149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:22 smithi189 ceph-mon[32756]: pgmap v10149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:22 smithi156 ceph-mon[32679]: pgmap v10149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18059.604983 secs 2024-04-26T23:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:24 smithi092 ceph-mon[29156]: pgmap v10150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17362.575663 secs 2024-04-26T23:19:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18059.604983 secs 2024-04-26T23:19:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:24 smithi189 ceph-mon[32756]: pgmap v10150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17362.575663 secs 2024-04-26T23:19:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18059.604983 secs 2024-04-26T23:19:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:24 smithi156 ceph-mon[32679]: pgmap v10150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:25.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17362.575663 secs 2024-04-26T23:19:27.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:26 smithi156 ceph-mon[32679]: pgmap v10151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:26 smithi092 ceph-mon[29156]: pgmap v10151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:26 smithi189 ceph-mon[32756]: pgmap v10151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:28 smithi092 ceph-mon[29156]: pgmap v10152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:28 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18064.605129 secs 2024-04-26T23:19:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:28 smithi189 ceph-mon[32756]: pgmap v10152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:28 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18064.605129 secs 2024-04-26T23:19:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:28 smithi156 ceph-mon[32679]: pgmap v10152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:28 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18064.605129 secs 2024-04-26T23:19:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17367.575779 secs 2024-04-26T23:19:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17367.575779 secs 2024-04-26T23:19:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17367.575779 secs 2024-04-26T23:19:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:30 smithi092 ceph-mon[29156]: pgmap v10153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:30 smithi189 ceph-mon[32756]: pgmap v10153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:30 smithi156 ceph-mon[32679]: pgmap v10153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:33.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:32 smithi092 ceph-mon[29156]: pgmap v10154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:32 smithi189 ceph-mon[32756]: pgmap v10154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:32 smithi156 ceph-mon[32679]: pgmap v10154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:33 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18069.605249 secs 2024-04-26T23:19:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:33 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17372.575851 secs 2024-04-26T23:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:33 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18069.605249 secs 2024-04-26T23:19:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:33 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17372.575851 secs 2024-04-26T23:19:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:33 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18069.605249 secs 2024-04-26T23:19:34.450 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:33 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17372.575851 secs 2024-04-26T23:19:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:34 smithi092 ceph-mon[29156]: pgmap v10155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:34 smithi189 ceph-mon[32756]: pgmap v10155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:34 smithi156 ceph-mon[32679]: pgmap v10155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:37.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:36 smithi092 ceph-mon[29156]: pgmap v10156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:36 smithi189 ceph-mon[32756]: pgmap v10156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:36 smithi156 ceph-mon[32679]: pgmap v10156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:19:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:19:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:19:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: pgmap v10157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: pgmap v10158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: pgmap v10159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18074.605399 secs 2024-04-26T23:19:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:38 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17377.575992 secs 2024-04-26T23:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: pgmap v10157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:19:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: pgmap v10158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:19:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: pgmap v10159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:19:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18074.605399 secs 2024-04-26T23:19:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:38 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17377.575992 secs 2024-04-26T23:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: pgmap v10157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:19:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: pgmap v10158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:19:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: pgmap v10159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:19:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18074.605399 secs 2024-04-26T23:19:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:38 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17377.575992 secs 2024-04-26T23:19:41.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:41 smithi092 ceph-mon[29156]: pgmap v10160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:41 smithi189 ceph-mon[32756]: pgmap v10160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:41 smithi156 ceph-mon[32679]: pgmap v10160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:43 smithi189 ceph-mon[32756]: pgmap v10161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:43 smithi156 ceph-mon[32679]: pgmap v10161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:43 smithi092 ceph-mon[29156]: pgmap v10161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:19:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18079.605517 secs 2024-04-26T23:19:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17382.576129 secs 2024-04-26T23:19:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18079.605517 secs 2024-04-26T23:19:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17382.576129 secs 2024-04-26T23:19:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18079.605517 secs 2024-04-26T23:19:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17382.576129 secs 2024-04-26T23:19:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:45 smithi189 ceph-mon[32756]: pgmap v10162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:45 smithi156 ceph-mon[32679]: pgmap v10162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:45 smithi092 ceph-mon[29156]: pgmap v10162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:47 smithi189 ceph-mon[32756]: pgmap v10163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:47 smithi156 ceph-mon[32679]: pgmap v10163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:47 smithi092 ceph-mon[29156]: pgmap v10163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:19:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:49 smithi189 ceph-mon[32756]: pgmap v10164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:19:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18084.605640 secs 2024-04-26T23:19:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17387.576263 secs 2024-04-26T23:19:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:49 smithi156 ceph-mon[32679]: pgmap v10164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:19:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18084.605640 secs 2024-04-26T23:19:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17387.576263 secs 2024-04-26T23:19:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:49 smithi092 ceph-mon[29156]: pgmap v10164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:19:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18084.605640 secs 2024-04-26T23:19:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17387.576263 secs 2024-04-26T23:19:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:51 smithi189 ceph-mon[32756]: pgmap v10165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:51 smithi156 ceph-mon[32679]: pgmap v10165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:51 smithi092 ceph-mon[29156]: pgmap v10165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:53 smithi189 ceph-mon[32756]: pgmap v10166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:53 smithi156 ceph-mon[32679]: pgmap v10166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:53 smithi092 ceph-mon[29156]: pgmap v10166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18089.605731 secs 2024-04-26T23:19:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17392.576327 secs 2024-04-26T23:19:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18089.605731 secs 2024-04-26T23:19:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17392.576327 secs 2024-04-26T23:19:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18089.605731 secs 2024-04-26T23:19:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17392.576327 secs 2024-04-26T23:19:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:55 smithi189 ceph-mon[32756]: pgmap v10167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:55 smithi156 ceph-mon[32679]: pgmap v10167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:55 smithi092 ceph-mon[29156]: pgmap v10167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:19:56.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:56 smithi092 ceph-mon[29156]: pgmap v10168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:56 smithi189 ceph-mon[32756]: pgmap v10168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:56 smithi156 ceph-mon[32679]: pgmap v10168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:59 smithi156 ceph-mon[32679]: pgmap v10169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18094.605893 secs 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:19:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17397.576372 secs 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:59 smithi189 ceph-mon[32756]: pgmap v10169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18094.605893 secs 2024-04-26T23:19:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:19:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17397.576372 secs 2024-04-26T23:19:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:59 smithi092 ceph-mon[29156]: pgmap v10169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:19:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18094.605893 secs 2024-04-26T23:19:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:19:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17397.576372 secs 2024-04-26T23:20:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:20:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:20:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:20:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:01 smithi189 ceph-mon[32756]: pgmap v10170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:01 smithi156 ceph-mon[32679]: pgmap v10170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:01 smithi092 ceph-mon[29156]: pgmap v10170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:03 smithi189 ceph-mon[32756]: pgmap v10171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:03 smithi156 ceph-mon[32679]: pgmap v10171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:03 smithi092 ceph-mon[29156]: pgmap v10171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18099.606008 secs 2024-04-26T23:20:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17402.576445 secs 2024-04-26T23:20:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18099.606008 secs 2024-04-26T23:20:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17402.576445 secs 2024-04-26T23:20:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18099.606008 secs 2024-04-26T23:20:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17402.576445 secs 2024-04-26T23:20:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:05 smithi189 ceph-mon[32756]: pgmap v10172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:05 smithi156 ceph-mon[32679]: pgmap v10172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-mon[29156]: pgmap v10172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:05.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:20:05.563+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:20:05.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:20:05.563+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:20:05.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:20:05.563+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:20:05.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:20:05.563+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:20:05.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:20:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:20:05.563+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:20:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:07 smithi189 ceph-mon[32756]: pgmap v10173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:07 smithi156 ceph-mon[32679]: pgmap v10173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:07 smithi092 ceph-mon[29156]: pgmap v10173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:09 smithi189 ceph-mon[32756]: pgmap v10174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18104.606133 secs 2024-04-26T23:20:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17407.576509 secs 2024-04-26T23:20:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:09 smithi156 ceph-mon[32679]: pgmap v10174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18104.606133 secs 2024-04-26T23:20:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17407.576509 secs 2024-04-26T23:20:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:09 smithi092 ceph-mon[29156]: pgmap v10174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18104.606133 secs 2024-04-26T23:20:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17407.576509 secs 2024-04-26T23:20:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:11 smithi189 ceph-mon[32756]: pgmap v10175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:11 smithi156 ceph-mon[32679]: pgmap v10175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:11 smithi092 ceph-mon[29156]: pgmap v10175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:12 smithi092 ceph-mon[29156]: pgmap v10176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:12 smithi189 ceph-mon[32756]: pgmap v10176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:12 smithi156 ceph-mon[32679]: pgmap v10176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18109.606249 secs 2024-04-26T23:20:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17412.576604 secs 2024-04-26T23:20:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:14 smithi092 ceph-mon[29156]: pgmap v10177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18109.606249 secs 2024-04-26T23:20:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17412.576604 secs 2024-04-26T23:20:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:14 smithi189 ceph-mon[32756]: pgmap v10177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18109.606249 secs 2024-04-26T23:20:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17412.576604 secs 2024-04-26T23:20:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:14 smithi156 ceph-mon[32679]: pgmap v10177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:17 smithi189 ceph-mon[32756]: pgmap v10178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:17 smithi156 ceph-mon[32679]: pgmap v10178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:17 smithi092 ceph-mon[29156]: pgmap v10178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:19 smithi189 ceph-mon[32756]: pgmap v10179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18114.606366 secs 2024-04-26T23:20:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17417.576729 secs 2024-04-26T23:20:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:19 smithi156 ceph-mon[32679]: pgmap v10179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18114.606366 secs 2024-04-26T23:20:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17417.576729 secs 2024-04-26T23:20:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:19 smithi092 ceph-mon[29156]: pgmap v10179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18114.606366 secs 2024-04-26T23:20:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17417.576729 secs 2024-04-26T23:20:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:21 smithi189 ceph-mon[32756]: pgmap v10180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:21 smithi156 ceph-mon[32679]: pgmap v10180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:21 smithi092 ceph-mon[29156]: pgmap v10180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:23 smithi189 ceph-mon[32756]: pgmap v10181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:23 smithi156 ceph-mon[32679]: pgmap v10181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:23 smithi092 ceph-mon[29156]: pgmap v10181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18119.606478 secs 2024-04-26T23:20:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17422.576832 secs 2024-04-26T23:20:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18119.606478 secs 2024-04-26T23:20:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17422.576832 secs 2024-04-26T23:20:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18119.606478 secs 2024-04-26T23:20:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17422.576832 secs 2024-04-26T23:20:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:25 smithi189 ceph-mon[32756]: pgmap v10182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:25 smithi156 ceph-mon[32679]: pgmap v10182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:25 smithi092 ceph-mon[29156]: pgmap v10182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:27 smithi189 ceph-mon[32756]: pgmap v10183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:27 smithi156 ceph-mon[32679]: pgmap v10183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:27 smithi092 ceph-mon[29156]: pgmap v10183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:29 smithi189 ceph-mon[32756]: pgmap v10184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18124.606596 secs 2024-04-26T23:20:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17427.576952 secs 2024-04-26T23:20:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:29 smithi156 ceph-mon[32679]: pgmap v10184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18124.606596 secs 2024-04-26T23:20:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17427.576952 secs 2024-04-26T23:20:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:29 smithi092 ceph-mon[29156]: pgmap v10184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18124.606596 secs 2024-04-26T23:20:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17427.576952 secs 2024-04-26T23:20:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:31 smithi156 ceph-mon[32679]: pgmap v10185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:31 smithi092 ceph-mon[29156]: pgmap v10185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:31.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:31 smithi189 ceph-mon[32756]: pgmap v10185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:32 smithi092 ceph-mon[29156]: pgmap v10186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:32 smithi189 ceph-mon[32756]: pgmap v10186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:32 smithi156 ceph-mon[32679]: pgmap v10186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18129.606719 secs 2024-04-26T23:20:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17432.577088 secs 2024-04-26T23:20:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18129.606719 secs 2024-04-26T23:20:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17432.577088 secs 2024-04-26T23:20:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18129.606719 secs 2024-04-26T23:20:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17432.577088 secs 2024-04-26T23:20:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:35 smithi189 ceph-mon[32756]: pgmap v10187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:35 smithi156 ceph-mon[32679]: pgmap v10187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:35 smithi092 ceph-mon[29156]: pgmap v10187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:37.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:37 smithi189 ceph-mon[32756]: pgmap v10188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:37 smithi156 ceph-mon[32679]: pgmap v10188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:37 smithi092 ceph-mon[29156]: pgmap v10188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: pgmap v10189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18134.606815 secs 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17437.577171 secs 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:20:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:20:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: pgmap v10189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:20:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18134.606815 secs 2024-04-26T23:20:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17437.577171 secs 2024-04-26T23:20:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:20:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:20:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:20:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: pgmap v10189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:20:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18134.606815 secs 2024-04-26T23:20:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17437.577171 secs 2024-04-26T23:20:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:20:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:20:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:20:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:40 smithi156 ceph-mon[32679]: pgmap v10190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:20:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:40 smithi156 ceph-mon[32679]: pgmap v10191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:40 smithi189 ceph-mon[32756]: pgmap v10190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:20:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:40 smithi189 ceph-mon[32756]: pgmap v10191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:40 smithi092 ceph-mon[29156]: pgmap v10190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:20:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:40 smithi092 ceph-mon[29156]: pgmap v10191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:42 smithi189 ceph-mon[32756]: pgmap v10192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:42 smithi156 ceph-mon[32679]: pgmap v10192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:42.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:42 smithi092 ceph-mon[29156]: pgmap v10192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:44 smithi156 ceph-mon[32679]: pgmap v10193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:20:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18139.606968 secs 2024-04-26T23:20:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17442.577248 secs 2024-04-26T23:20:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:44 smithi092 ceph-mon[29156]: pgmap v10193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:20:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18139.606968 secs 2024-04-26T23:20:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17442.577248 secs 2024-04-26T23:20:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:44 smithi189 ceph-mon[32756]: pgmap v10193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:20:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18139.606968 secs 2024-04-26T23:20:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17442.577248 secs 2024-04-26T23:20:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:46 smithi156 ceph-mon[32679]: pgmap v10194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:46 smithi092 ceph-mon[29156]: pgmap v10194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:46 smithi189 ceph-mon[32756]: pgmap v10194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:47 smithi092 ceph-mon[29156]: pgmap v10195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:47 smithi189 ceph-mon[32756]: pgmap v10195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:47 smithi156 ceph-mon[32679]: pgmap v10195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:20:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18144.607050 secs 2024-04-26T23:20:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17447.577399 secs 2024-04-26T23:20:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18144.607050 secs 2024-04-26T23:20:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17447.577399 secs 2024-04-26T23:20:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18144.607050 secs 2024-04-26T23:20:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17447.577399 secs 2024-04-26T23:20:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:50 smithi189 ceph-mon[32756]: pgmap v10196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:20:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:50 smithi156 ceph-mon[32679]: pgmap v10196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:20:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:50 smithi092 ceph-mon[29156]: pgmap v10196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:20:52.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:52 smithi189 ceph-mon[32756]: pgmap v10197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:52 smithi156 ceph-mon[32679]: pgmap v10197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:52 smithi092 ceph-mon[29156]: pgmap v10197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:54 smithi156 ceph-mon[32679]: pgmap v10198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:54.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18149.607148 secs 2024-04-26T23:20:54.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17452.577492 secs 2024-04-26T23:20:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:54 smithi092 ceph-mon[29156]: pgmap v10198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18149.607148 secs 2024-04-26T23:20:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17452.577492 secs 2024-04-26T23:20:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:54 smithi189 ceph-mon[32756]: pgmap v10198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18149.607148 secs 2024-04-26T23:20:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17452.577492 secs 2024-04-26T23:20:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:56 smithi156 ceph-mon[32679]: pgmap v10199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:56 smithi092 ceph-mon[29156]: pgmap v10199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:56 smithi189 ceph-mon[32756]: pgmap v10199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:20:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:58 smithi156 ceph-mon[32679]: pgmap v10200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:58 smithi092 ceph-mon[29156]: pgmap v10200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:58 smithi189 ceph-mon[32756]: pgmap v10200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:20:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18154.607237 secs 2024-04-26T23:20:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:20:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17457.577596 secs 2024-04-26T23:20:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18154.607237 secs 2024-04-26T23:20:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:20:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17457.577596 secs 2024-04-26T23:20:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18154.607237 secs 2024-04-26T23:20:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:20:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17457.577596 secs 2024-04-26T23:21:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:00 smithi092 ceph-mon[29156]: pgmap v10201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:00 smithi156 ceph-mon[32679]: pgmap v10201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:00 smithi189 ceph-mon[32756]: pgmap v10201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:02 smithi156 ceph-mon[32679]: pgmap v10202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:02 smithi092 ceph-mon[29156]: pgmap v10202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:02 smithi189 ceph-mon[32756]: pgmap v10202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:04 smithi156 ceph-mon[32679]: pgmap v10203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18159.607353 secs 2024-04-26T23:21:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17462.577733 secs 2024-04-26T23:21:04.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:04 smithi189 ceph-mon[32756]: pgmap v10203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:04.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18159.607353 secs 2024-04-26T23:21:04.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17462.577733 secs 2024-04-26T23:21:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:04 smithi092 ceph-mon[29156]: pgmap v10203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18159.607353 secs 2024-04-26T23:21:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17462.577733 secs 2024-04-26T23:21:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:06 smithi156 ceph-mon[32679]: pgmap v10204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:06 smithi092 ceph-mon[29156]: pgmap v10204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:06 smithi189 ceph-mon[32756]: pgmap v10204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:08 smithi156 ceph-mon[32679]: pgmap v10205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:08 smithi092 ceph-mon[29156]: pgmap v10205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:08 smithi189 ceph-mon[32756]: pgmap v10205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18164.607472 secs 2024-04-26T23:21:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17467.577819 secs 2024-04-26T23:21:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18164.607472 secs 2024-04-26T23:21:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17467.577819 secs 2024-04-26T23:21:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18164.607472 secs 2024-04-26T23:21:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17467.577819 secs 2024-04-26T23:21:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:10 smithi156 ceph-mon[32679]: pgmap v10206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:10 smithi092 ceph-mon[29156]: pgmap v10206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:10 smithi189 ceph-mon[32756]: pgmap v10206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:12 smithi156 ceph-mon[32679]: pgmap v10207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:12 smithi092 ceph-mon[29156]: pgmap v10207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:12 smithi189 ceph-mon[32756]: pgmap v10207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:14 smithi156 ceph-mon[32679]: pgmap v10208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18169.607559 secs 2024-04-26T23:21:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17472.577895 secs 2024-04-26T23:21:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:14 smithi092 ceph-mon[29156]: pgmap v10208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18169.607559 secs 2024-04-26T23:21:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17472.577895 secs 2024-04-26T23:21:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:14 smithi189 ceph-mon[32756]: pgmap v10208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18169.607559 secs 2024-04-26T23:21:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17472.577895 secs 2024-04-26T23:21:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:16 smithi156 ceph-mon[32679]: pgmap v10209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:16 smithi092 ceph-mon[29156]: pgmap v10209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:16 smithi189 ceph-mon[32756]: pgmap v10209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:18.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:18 smithi092 ceph-mon[29156]: pgmap v10210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:18 smithi189 ceph-mon[32756]: pgmap v10210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:18 smithi156 ceph-mon[32679]: pgmap v10210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18174.607678 secs 2024-04-26T23:21:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17477.578032 secs 2024-04-26T23:21:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18174.607678 secs 2024-04-26T23:21:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17477.578032 secs 2024-04-26T23:21:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18174.607678 secs 2024-04-26T23:21:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17477.578032 secs 2024-04-26T23:21:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:20 smithi092 ceph-mon[29156]: pgmap v10211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:20 smithi189 ceph-mon[32756]: pgmap v10211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:20 smithi156 ceph-mon[32679]: pgmap v10211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:22 smithi092 ceph-mon[29156]: pgmap v10212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:22 smithi189 ceph-mon[32756]: pgmap v10212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:22 smithi156 ceph-mon[32679]: pgmap v10212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:24 smithi092 ceph-mon[29156]: pgmap v10213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18179.607816 secs 2024-04-26T23:21:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17482.578142 secs 2024-04-26T23:21:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:24 smithi189 ceph-mon[32756]: pgmap v10213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18179.607816 secs 2024-04-26T23:21:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17482.578142 secs 2024-04-26T23:21:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:24 smithi156 ceph-mon[32679]: pgmap v10213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18179.607816 secs 2024-04-26T23:21:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17482.578142 secs 2024-04-26T23:21:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:26 smithi092 ceph-mon[29156]: pgmap v10214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:26 smithi189 ceph-mon[32756]: pgmap v10214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:26 smithi156 ceph-mon[32679]: pgmap v10214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:28 smithi092 ceph-mon[29156]: pgmap v10215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:28 smithi189 ceph-mon[32756]: pgmap v10215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:28 smithi156 ceph-mon[32679]: pgmap v10215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18184.607933 secs 2024-04-26T23:21:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17487.578207 secs 2024-04-26T23:21:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:29 smithi189 ceph-mon[32756]: pgmap v10216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18184.607933 secs 2024-04-26T23:21:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17487.578207 secs 2024-04-26T23:21:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:29 smithi156 ceph-mon[32679]: pgmap v10216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18184.607933 secs 2024-04-26T23:21:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17487.578207 secs 2024-04-26T23:21:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:29 smithi092 ceph-mon[29156]: pgmap v10216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:32 smithi156 ceph-mon[32679]: pgmap v10217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:32 smithi092 ceph-mon[29156]: pgmap v10217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:32 smithi189 ceph-mon[32756]: pgmap v10217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:34 smithi156 ceph-mon[32679]: pgmap v10218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18189.608006 secs 2024-04-26T23:21:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17492.578321 secs 2024-04-26T23:21:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:34 smithi189 ceph-mon[32756]: pgmap v10218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18189.608006 secs 2024-04-26T23:21:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17492.578321 secs 2024-04-26T23:21:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:34 smithi092 ceph-mon[29156]: pgmap v10218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18189.608006 secs 2024-04-26T23:21:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17492.578321 secs 2024-04-26T23:21:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:36 smithi156 ceph-mon[32679]: pgmap v10219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:36 smithi092 ceph-mon[29156]: pgmap v10219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:36 smithi189 ceph-mon[32756]: pgmap v10219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:38 smithi156 ceph-mon[32679]: pgmap v10220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:21:38.477+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:21:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:21:38.477+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:21:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:21:38.478+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:21:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:21:38.478+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 142 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:21:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:38 smithi092 ceph-mon[29156]: pgmap v10220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:38 smithi189 ceph-mon[32756]: pgmap v10220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:39.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:39 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 18194.608124 secs 2024-04-26T23:21:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:39 smithi156 ceph-mon[32679]: slow request 723.125119 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:21:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17497.578354 secs 2024-04-26T23:21:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:39 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 18194.608124 secs 2024-04-26T23:21:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:39 smithi092 ceph-mon[29156]: slow request 723.125119 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:21:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17497.578354 secs 2024-04-26T23:21:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:39 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 18194.608124 secs 2024-04-26T23:21:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:39 smithi189 ceph-mon[32756]: slow request 723.125119 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:21:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17497.578354 secs 2024-04-26T23:21:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:40 smithi156 ceph-mon[32679]: pgmap v10221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:21:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:21:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:21:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:21:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:40 smithi092 ceph-mon[29156]: pgmap v10221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:21:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:21:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:21:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:21:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:40 smithi189 ceph-mon[32756]: pgmap v10221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:21:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:21:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:21:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:21:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:41 smithi156 ceph-mon[32679]: pgmap v10222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:21:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:41 smithi156 ceph-mon[32679]: pgmap v10223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:41 smithi092 ceph-mon[29156]: pgmap v10222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:21:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:41 smithi092 ceph-mon[29156]: pgmap v10223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:41 smithi189 ceph-mon[32756]: pgmap v10222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:21:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:41 smithi189 ceph-mon[32756]: pgmap v10223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:43 smithi156 ceph-mon[32679]: pgmap v10224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:43 smithi092 ceph-mon[29156]: pgmap v10224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:43.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:43 smithi189 ceph-mon[32756]: pgmap v10224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18199.608203 secs 2024-04-26T23:21:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17502.578463 secs 2024-04-26T23:21:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18199.608203 secs 2024-04-26T23:21:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17502.578463 secs 2024-04-26T23:21:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18199.608203 secs 2024-04-26T23:21:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17502.578463 secs 2024-04-26T23:21:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:45 smithi156 ceph-mon[32679]: pgmap v10225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:45 smithi092 ceph-mon[29156]: pgmap v10225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:45 smithi189 ceph-mon[32756]: pgmap v10225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:47 smithi156 ceph-mon[32679]: pgmap v10226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:47 smithi092 ceph-mon[29156]: pgmap v10226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:47.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:47 smithi189 ceph-mon[32756]: pgmap v10226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:49 smithi092 ceph-mon[29156]: pgmap v10227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18204.608323 secs 2024-04-26T23:21:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17507.578580 secs 2024-04-26T23:21:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:49 smithi189 ceph-mon[32756]: pgmap v10227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:21:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18204.608323 secs 2024-04-26T23:21:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17507.578580 secs 2024-04-26T23:21:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:49 smithi156 ceph-mon[32679]: pgmap v10227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:21:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18204.608323 secs 2024-04-26T23:21:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17507.578580 secs 2024-04-26T23:21:51.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:51 smithi092 ceph-mon[29156]: pgmap v10228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:21:51.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:51 smithi189 ceph-mon[32756]: pgmap v10228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:21:51.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:51 smithi156 ceph-mon[32679]: pgmap v10228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:21:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:53 smithi092 ceph-mon[29156]: pgmap v10229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:53 smithi189 ceph-mon[32756]: pgmap v10229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:53.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:53 smithi156 ceph-mon[32679]: pgmap v10229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18209.608394 secs 2024-04-26T23:21:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17512.578654 secs 2024-04-26T23:21:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18209.608394 secs 2024-04-26T23:21:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17512.578654 secs 2024-04-26T23:21:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18209.608394 secs 2024-04-26T23:21:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17512.578654 secs 2024-04-26T23:21:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:55 smithi092 ceph-mon[29156]: pgmap v10230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:55 smithi189 ceph-mon[32756]: pgmap v10230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:55 smithi156 ceph-mon[32679]: pgmap v10230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:21:57.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:57 smithi092 ceph-mon[29156]: pgmap v10231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:57 smithi189 ceph-mon[32756]: pgmap v10231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:57 smithi156 ceph-mon[32679]: pgmap v10231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:59 smithi092 ceph-mon[29156]: pgmap v10232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18214.608511 secs 2024-04-26T23:21:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:21:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17517.578797 secs 2024-04-26T23:21:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:59 smithi189 ceph-mon[32756]: pgmap v10232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18214.608511 secs 2024-04-26T23:21:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:21:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17517.578797 secs 2024-04-26T23:21:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:59 smithi156 ceph-mon[32679]: pgmap v10232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:21:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18214.608511 secs 2024-04-26T23:21:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:21:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17517.578797 secs 2024-04-26T23:22:01.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:01 smithi156 ceph-mon[32679]: pgmap v10233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:01 smithi092 ceph-mon[29156]: pgmap v10233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:01 smithi189 ceph-mon[32756]: pgmap v10233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:03 smithi092 ceph-mon[29156]: pgmap v10234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:03 smithi189 ceph-mon[32756]: pgmap v10234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:03 smithi156 ceph-mon[32679]: pgmap v10234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18219.608664 secs 2024-04-26T23:22:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17522.578908 secs 2024-04-26T23:22:04.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18219.608664 secs 2024-04-26T23:22:04.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17522.578908 secs 2024-04-26T23:22:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18219.608664 secs 2024-04-26T23:22:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17522.578908 secs 2024-04-26T23:22:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:05 smithi092 ceph-mon[29156]: pgmap v10235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:05 smithi189 ceph-mon[32756]: pgmap v10235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:05 smithi156 ceph-mon[32679]: pgmap v10235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:07 smithi092 ceph-mon[29156]: pgmap v10236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:07 smithi189 ceph-mon[32756]: pgmap v10236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:07 smithi156 ceph-mon[32679]: pgmap v10236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:09 smithi092 ceph-mon[29156]: pgmap v10237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18224.608817 secs 2024-04-26T23:22:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17527.579021 secs 2024-04-26T23:22:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:09 smithi189 ceph-mon[32756]: pgmap v10237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18224.608817 secs 2024-04-26T23:22:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17527.579021 secs 2024-04-26T23:22:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:09 smithi156 ceph-mon[32679]: pgmap v10237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18224.608817 secs 2024-04-26T23:22:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17527.579021 secs 2024-04-26T23:22:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:11 smithi092 ceph-mon[29156]: pgmap v10238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:11.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:11 smithi189 ceph-mon[32756]: pgmap v10238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:11 smithi156 ceph-mon[32679]: pgmap v10238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:13.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:13 smithi092 ceph-mon[29156]: pgmap v10239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:13 smithi189 ceph-mon[32756]: pgmap v10239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:13.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:13 smithi156 ceph-mon[32679]: pgmap v10239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18229.608906 secs 2024-04-26T23:22:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17532.579153 secs 2024-04-26T23:22:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18229.608906 secs 2024-04-26T23:22:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17532.579153 secs 2024-04-26T23:22:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18229.608906 secs 2024-04-26T23:22:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17532.579153 secs 2024-04-26T23:22:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:15 smithi092 ceph-mon[29156]: pgmap v10240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:15 smithi189 ceph-mon[32756]: pgmap v10240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:15 smithi156 ceph-mon[32679]: pgmap v10240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:17 smithi092 ceph-mon[29156]: pgmap v10241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:17 smithi189 ceph-mon[32756]: pgmap v10241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:17 smithi156 ceph-mon[32679]: pgmap v10241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:19 smithi092 ceph-mon[29156]: pgmap v10242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18234.608971 secs 2024-04-26T23:22:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17537.579261 secs 2024-04-26T23:22:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:19 smithi189 ceph-mon[32756]: pgmap v10242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18234.608971 secs 2024-04-26T23:22:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17537.579261 secs 2024-04-26T23:22:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:19 smithi156 ceph-mon[32679]: pgmap v10242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18234.608971 secs 2024-04-26T23:22:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17537.579261 secs 2024-04-26T23:22:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:21 smithi189 ceph-mon[32756]: pgmap v10243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:21 smithi156 ceph-mon[32679]: pgmap v10243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:21 smithi092 ceph-mon[29156]: pgmap v10243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:23 smithi189 ceph-mon[32756]: pgmap v10244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:23 smithi156 ceph-mon[32679]: pgmap v10244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:23 smithi092 ceph-mon[29156]: pgmap v10244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18239.609050 secs 2024-04-26T23:22:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17542.579355 secs 2024-04-26T23:22:24.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18239.609050 secs 2024-04-26T23:22:24.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17542.579355 secs 2024-04-26T23:22:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18239.609050 secs 2024-04-26T23:22:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17542.579355 secs 2024-04-26T23:22:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:25 smithi189 ceph-mon[32756]: pgmap v10245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:25 smithi156 ceph-mon[32679]: pgmap v10245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:25 smithi092 ceph-mon[29156]: pgmap v10245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:27 smithi189 ceph-mon[32756]: pgmap v10246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:27 smithi156 ceph-mon[32679]: pgmap v10246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:27 smithi092 ceph-mon[29156]: pgmap v10246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:29 smithi189 ceph-mon[32756]: pgmap v10247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18244.609174 secs 2024-04-26T23:22:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17547.579430 secs 2024-04-26T23:22:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:29 smithi156 ceph-mon[32679]: pgmap v10247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18244.609174 secs 2024-04-26T23:22:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17547.579430 secs 2024-04-26T23:22:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:29 smithi092 ceph-mon[29156]: pgmap v10247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18244.609174 secs 2024-04-26T23:22:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17547.579430 secs 2024-04-26T23:22:31.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:31 smithi189 ceph-mon[32756]: pgmap v10248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:31 smithi156 ceph-mon[32679]: pgmap v10248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:31 smithi092 ceph-mon[29156]: pgmap v10248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:33 smithi189 ceph-mon[32756]: pgmap v10249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:33.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:33 smithi092 ceph-mon[29156]: pgmap v10249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:33.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:33 smithi156 ceph-mon[32679]: pgmap v10249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:34.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18249.609300 secs 2024-04-26T23:22:34.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17552.579562 secs 2024-04-26T23:22:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18249.609300 secs 2024-04-26T23:22:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17552.579562 secs 2024-04-26T23:22:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18249.609300 secs 2024-04-26T23:22:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17552.579562 secs 2024-04-26T23:22:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:35 smithi189 ceph-mon[32756]: pgmap v10250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:35 smithi156 ceph-mon[32679]: pgmap v10250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:35 smithi092 ceph-mon[29156]: pgmap v10250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:37.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:37 smithi189 ceph-mon[32756]: pgmap v10251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:37 smithi156 ceph-mon[32679]: pgmap v10251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:37 smithi092 ceph-mon[29156]: pgmap v10251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:39 smithi189 ceph-mon[32756]: pgmap v10252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18254.609363 secs 2024-04-26T23:22:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17557.579644 secs 2024-04-26T23:22:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:39 smithi156 ceph-mon[32679]: pgmap v10252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18254.609363 secs 2024-04-26T23:22:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17557.579644 secs 2024-04-26T23:22:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:39 smithi092 ceph-mon[29156]: pgmap v10252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18254.609363 secs 2024-04-26T23:22:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17557.579644 secs 2024-04-26T23:22:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:22:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:22:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:22:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:41 smithi189 ceph-mon[32756]: pgmap v10253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:22:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:22:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:22:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:41 smithi156 ceph-mon[32679]: pgmap v10253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:22:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:22:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:41 smithi092 ceph-mon[29156]: pgmap v10253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:22:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:22:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:42 smithi189 ceph-mon[32756]: pgmap v10254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:42 smithi156 ceph-mon[32679]: pgmap v10254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:42 smithi092 ceph-mon[29156]: pgmap v10254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:44 smithi189 ceph-mon[32756]: pgmap v10255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18259.609508 secs 2024-04-26T23:22:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17562.579706 secs 2024-04-26T23:22:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:44 smithi156 ceph-mon[32679]: pgmap v10255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18259.609508 secs 2024-04-26T23:22:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17562.579706 secs 2024-04-26T23:22:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:44 smithi092 ceph-mon[29156]: pgmap v10255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18259.609508 secs 2024-04-26T23:22:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17562.579706 secs 2024-04-26T23:22:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:46 smithi189 ceph-mon[32756]: pgmap v10256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:46 smithi156 ceph-mon[32679]: pgmap v10256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:46 smithi092 ceph-mon[29156]: pgmap v10256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:48 smithi189 ceph-mon[32756]: pgmap v10257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:48 smithi156 ceph-mon[32679]: pgmap v10257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:48 smithi092 ceph-mon[29156]: pgmap v10257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18264.609630 secs 2024-04-26T23:22:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17567.579845 secs 2024-04-26T23:22:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18264.609630 secs 2024-04-26T23:22:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17567.579845 secs 2024-04-26T23:22:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18264.609630 secs 2024-04-26T23:22:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17567.579845 secs 2024-04-26T23:22:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:50 smithi189 ceph-mon[32756]: pgmap v10258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T23:22:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:50 smithi156 ceph-mon[32679]: pgmap v10258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T23:22:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:50 smithi092 ceph-mon[29156]: pgmap v10258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-26T23:22:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:52 smithi189 ceph-mon[32756]: pgmap v10259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:52 smithi156 ceph-mon[32679]: pgmap v10259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:52 smithi092 ceph-mon[29156]: pgmap v10259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:22:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:54 smithi189 ceph-mon[32756]: pgmap v10260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18269.609758 secs 2024-04-26T23:22:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17572.579981 secs 2024-04-26T23:22:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:54 smithi156 ceph-mon[32679]: pgmap v10260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18269.609758 secs 2024-04-26T23:22:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17572.579981 secs 2024-04-26T23:22:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:54 smithi092 ceph-mon[29156]: pgmap v10260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18269.609758 secs 2024-04-26T23:22:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17572.579981 secs 2024-04-26T23:22:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:56 smithi189 ceph-mon[32756]: pgmap v10261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:56 smithi156 ceph-mon[32679]: pgmap v10261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:56 smithi092 ceph-mon[29156]: pgmap v10261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:22:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:58 smithi189 ceph-mon[32756]: pgmap v10262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:58 smithi156 ceph-mon[32679]: pgmap v10262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:58 smithi092 ceph-mon[29156]: pgmap v10262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:22:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18274.609885 secs 2024-04-26T23:22:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:22:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17577.580115 secs 2024-04-26T23:22:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18274.609885 secs 2024-04-26T23:22:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:22:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17577.580115 secs 2024-04-26T23:22:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18274.609885 secs 2024-04-26T23:22:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:22:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17577.580115 secs 2024-04-26T23:23:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:00 smithi189 ceph-mon[32756]: pgmap v10263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:00 smithi156 ceph-mon[32679]: pgmap v10263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:00 smithi092 ceph-mon[29156]: pgmap v10263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:02 smithi189 ceph-mon[32756]: pgmap v10264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:02 smithi156 ceph-mon[32679]: pgmap v10264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:02 smithi092 ceph-mon[29156]: pgmap v10264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:04 smithi189 ceph-mon[32756]: pgmap v10265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18279.610002 secs 2024-04-26T23:23:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17582.580186 secs 2024-04-26T23:23:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:04 smithi156 ceph-mon[32679]: pgmap v10265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18279.610002 secs 2024-04-26T23:23:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17582.580186 secs 2024-04-26T23:23:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:04 smithi092 ceph-mon[29156]: pgmap v10265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18279.610002 secs 2024-04-26T23:23:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17582.580186 secs 2024-04-26T23:23:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:06 smithi189 ceph-mon[32756]: pgmap v10266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:06 smithi156 ceph-mon[32679]: pgmap v10266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:06 smithi092 ceph-mon[29156]: pgmap v10266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:08 smithi189 ceph-mon[32756]: pgmap v10267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:08 smithi156 ceph-mon[32679]: pgmap v10267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:08 smithi092 ceph-mon[29156]: pgmap v10267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18284.610146 secs 2024-04-26T23:23:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17587.580318 secs 2024-04-26T23:23:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18284.610146 secs 2024-04-26T23:23:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17587.580318 secs 2024-04-26T23:23:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18284.610146 secs 2024-04-26T23:23:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17587.580318 secs 2024-04-26T23:23:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:10 smithi189 ceph-mon[32756]: pgmap v10268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:10 smithi156 ceph-mon[32679]: pgmap v10268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:10 smithi092 ceph-mon[29156]: pgmap v10268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:12 smithi189 ceph-mon[32756]: pgmap v10269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:12 smithi156 ceph-mon[32679]: pgmap v10269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:12 smithi092 ceph-mon[29156]: pgmap v10269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:14 smithi189 ceph-mon[32756]: pgmap v10270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18289.610233 secs 2024-04-26T23:23:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17592.580382 secs 2024-04-26T23:23:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:14 smithi156 ceph-mon[32679]: pgmap v10270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18289.610233 secs 2024-04-26T23:23:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17592.580382 secs 2024-04-26T23:23:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:14 smithi092 ceph-mon[29156]: pgmap v10270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18289.610233 secs 2024-04-26T23:23:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17592.580382 secs 2024-04-26T23:23:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:16 smithi189 ceph-mon[32756]: pgmap v10271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:16 smithi156 ceph-mon[32679]: pgmap v10271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:16 smithi092 ceph-mon[29156]: pgmap v10271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:18 smithi189 ceph-mon[32756]: pgmap v10272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:18 smithi156 ceph-mon[32679]: pgmap v10272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:18 smithi092 ceph-mon[29156]: pgmap v10272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18294.610311 secs 2024-04-26T23:23:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17597.580449 secs 2024-04-26T23:23:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18294.610311 secs 2024-04-26T23:23:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17597.580449 secs 2024-04-26T23:23:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18294.610311 secs 2024-04-26T23:23:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17597.580449 secs 2024-04-26T23:23:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:20 smithi189 ceph-mon[32756]: pgmap v10273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:20 smithi156 ceph-mon[32679]: pgmap v10273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:20 smithi092 ceph-mon[29156]: pgmap v10273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:22 smithi189 ceph-mon[32756]: pgmap v10274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:22 smithi156 ceph-mon[32679]: pgmap v10274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:22 smithi092 ceph-mon[29156]: pgmap v10274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:24 smithi189 ceph-mon[32756]: pgmap v10275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18299.610383 secs 2024-04-26T23:23:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17602.580519 secs 2024-04-26T23:23:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:24 smithi156 ceph-mon[32679]: pgmap v10275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18299.610383 secs 2024-04-26T23:23:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17602.580519 secs 2024-04-26T23:23:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:24 smithi092 ceph-mon[29156]: pgmap v10275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18299.610383 secs 2024-04-26T23:23:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17602.580519 secs 2024-04-26T23:23:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:26 smithi156 ceph-mon[32679]: pgmap v10276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:26 smithi092 ceph-mon[29156]: pgmap v10276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:26 smithi189 ceph-mon[32756]: pgmap v10276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:28 smithi156 ceph-mon[32679]: pgmap v10277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:28 smithi092 ceph-mon[29156]: pgmap v10277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:28 smithi189 ceph-mon[32756]: pgmap v10277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18304.610476 secs 2024-04-26T23:23:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17607.580649 secs 2024-04-26T23:23:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18304.610476 secs 2024-04-26T23:23:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17607.580649 secs 2024-04-26T23:23:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18304.610476 secs 2024-04-26T23:23:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17607.580649 secs 2024-04-26T23:23:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:30 smithi156 ceph-mon[32679]: pgmap v10278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:30 smithi092 ceph-mon[29156]: pgmap v10278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:30 smithi189 ceph-mon[32756]: pgmap v10278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:32 smithi156 ceph-mon[32679]: pgmap v10279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:32 smithi092 ceph-mon[29156]: pgmap v10279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:32 smithi189 ceph-mon[32756]: pgmap v10279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:34 smithi156 ceph-mon[32679]: pgmap v10280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18309.610621 secs 2024-04-26T23:23:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17612.580738 secs 2024-04-26T23:23:34.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:34 smithi189 ceph-mon[32756]: pgmap v10280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18309.610621 secs 2024-04-26T23:23:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17612.580738 secs 2024-04-26T23:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:34 smithi092 ceph-mon[29156]: pgmap v10280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18309.610621 secs 2024-04-26T23:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17612.580738 secs 2024-04-26T23:23:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:36 smithi156 ceph-mon[32679]: pgmap v10281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:36 smithi092 ceph-mon[29156]: pgmap v10281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:36 smithi189 ceph-mon[32756]: pgmap v10281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:38 smithi156 ceph-mon[32679]: pgmap v10282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:38 smithi092 ceph-mon[29156]: pgmap v10282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:38 smithi189 ceph-mon[32756]: pgmap v10282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18314.610696 secs 2024-04-26T23:23:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17617.580803 secs 2024-04-26T23:23:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18314.610696 secs 2024-04-26T23:23:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17617.580803 secs 2024-04-26T23:23:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18314.610696 secs 2024-04-26T23:23:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17617.580803 secs 2024-04-26T23:23:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:40 smithi156 ceph-mon[32679]: pgmap v10283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:40 smithi092 ceph-mon[29156]: pgmap v10283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:40 smithi189 ceph-mon[32756]: pgmap v10283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:23:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:41 smithi156 ceph-mon[32679]: pgmap v10284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:23:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:41 smithi092 ceph-mon[29156]: pgmap v10284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:23:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:41 smithi189 ceph-mon[32756]: pgmap v10284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:23:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:23:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:23:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:23:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:42 smithi156 ceph-mon[32679]: pgmap v10285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:42 smithi156 ceph-mon[32679]: pgmap v10286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:23:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:23:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:23:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:42 smithi092 ceph-mon[29156]: pgmap v10285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:42 smithi092 ceph-mon[29156]: pgmap v10286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:23:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:23:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:23:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:42 smithi189 ceph-mon[32756]: pgmap v10285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:42 smithi189 ceph-mon[32756]: pgmap v10286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:23:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18319.610785 secs 2024-04-26T23:23:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:44 smithi189 ceph-mon[32756]: pgmap v10287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17622.580881 secs 2024-04-26T23:23:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18319.610785 secs 2024-04-26T23:23:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:44 smithi156 ceph-mon[32679]: pgmap v10287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17622.580881 secs 2024-04-26T23:23:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18319.610785 secs 2024-04-26T23:23:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:44 smithi092 ceph-mon[29156]: pgmap v10287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17622.580881 secs 2024-04-26T23:23:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:46 smithi189 ceph-mon[32756]: pgmap v10288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:46 smithi156 ceph-mon[32679]: pgmap v10288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:46 smithi092 ceph-mon[29156]: pgmap v10288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:23:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:48 smithi189 ceph-mon[32756]: pgmap v10289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:23:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:48 smithi156 ceph-mon[32679]: pgmap v10289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:23:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:48 smithi092 ceph-mon[29156]: pgmap v10289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:23:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18324.610902 secs 2024-04-26T23:23:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17627.580993 secs 2024-04-26T23:23:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18324.610902 secs 2024-04-26T23:23:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17627.580993 secs 2024-04-26T23:23:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18324.610902 secs 2024-04-26T23:23:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17627.580993 secs 2024-04-26T23:23:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:50 smithi189 ceph-mon[32756]: pgmap v10290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:23:51.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:50 smithi092 ceph-mon[29156]: pgmap v10290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:23:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:50 smithi156 ceph-mon[32679]: pgmap v10290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:23:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:52 smithi189 ceph-mon[32756]: pgmap v10291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:52 smithi156 ceph-mon[32679]: pgmap v10291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:53.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:52 smithi092 ceph-mon[29156]: pgmap v10291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:23:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:23:53.495+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:23:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:23:53.495+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:23:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:23:53.495+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:23:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:23:53.495+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 143 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:23:55.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18329.610992 secs 2024-04-26T23:23:55.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:54 smithi092 ceph-mon[29156]: pgmap v10292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:23:55.048 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17632.581065 secs 2024-04-26T23:23:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18329.610992 secs 2024-04-26T23:23:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:54 smithi189 ceph-mon[32756]: pgmap v10292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:23:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17632.581065 secs 2024-04-26T23:23:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18329.610992 secs 2024-04-26T23:23:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:54 smithi156 ceph-mon[32679]: pgmap v10292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:23:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17632.581065 secs 2024-04-26T23:23:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:56 smithi189 ceph-mon[32756]: pgmap v10293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:23:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:56 smithi156 ceph-mon[32679]: pgmap v10293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:23:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:56 smithi092 ceph-mon[29156]: pgmap v10293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:23:59.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:58 smithi189 ceph-mon[32756]: pgmap v10294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:23:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:58 smithi156 ceph-mon[32679]: pgmap v10294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:23:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:58 smithi092 ceph-mon[29156]: pgmap v10294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:24:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18334.611055 secs 2024-04-26T23:24:00.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:23:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17637.581165 secs 2024-04-26T23:24:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18334.611055 secs 2024-04-26T23:24:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:23:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17637.581165 secs 2024-04-26T23:24:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18334.611055 secs 2024-04-26T23:24:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:23:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17637.581165 secs 2024-04-26T23:24:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:00 smithi189 ceph-mon[32756]: pgmap v10295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:24:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:00 smithi156 ceph-mon[32679]: pgmap v10295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:24:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:00 smithi092 ceph-mon[29156]: pgmap v10295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:24:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:02 smithi189 ceph-mon[32756]: pgmap v10296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:02 smithi156 ceph-mon[32679]: pgmap v10296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:03.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:02 smithi092 ceph-mon[29156]: pgmap v10296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18339.611121 secs 2024-04-26T23:24:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:04 smithi189 ceph-mon[32756]: pgmap v10297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17642.581280 secs 2024-04-26T23:24:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18339.611121 secs 2024-04-26T23:24:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:04 smithi156 ceph-mon[32679]: pgmap v10297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17642.581280 secs 2024-04-26T23:24:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18339.611121 secs 2024-04-26T23:24:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:04 smithi092 ceph-mon[29156]: pgmap v10297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17642.581280 secs 2024-04-26T23:24:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:06 smithi189 ceph-mon[32756]: pgmap v10298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:06 smithi156 ceph-mon[32679]: pgmap v10298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:06 smithi092 ceph-mon[29156]: pgmap v10298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:08 smithi189 ceph-mon[32756]: pgmap v10299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:08 smithi156 ceph-mon[32679]: pgmap v10299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:09.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:08 smithi092 ceph-mon[29156]: pgmap v10299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18344.611213 secs 2024-04-26T23:24:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 17647.581393 secs 2024-04-26T23:24:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:09 smithi189 ceph-mon[32756]: slow request 5764.562884 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:24:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18344.611213 secs 2024-04-26T23:24:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 17647.581393 secs 2024-04-26T23:24:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:09 smithi156 ceph-mon[32679]: slow request 5764.562884 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:24:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18344.611213 secs 2024-04-26T23:24:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 17647.581393 secs 2024-04-26T23:24:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:09 smithi092 ceph-mon[29156]: slow request 5764.562884 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:24:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:10 smithi189 ceph-mon[32756]: pgmap v10300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:10 smithi156 ceph-mon[32679]: pgmap v10300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:10 smithi092 ceph-mon[29156]: pgmap v10300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:12 smithi189 ceph-mon[32756]: pgmap v10301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:12 smithi156 ceph-mon[32679]: pgmap v10301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:13.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:12 smithi092 ceph-mon[29156]: pgmap v10301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:15.150 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18349.611333 secs 2024-04-26T23:24:15.150 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:14 smithi189 ceph-mon[32756]: pgmap v10302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:15.150 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17652.581511 secs 2024-04-26T23:24:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18349.611333 secs 2024-04-26T23:24:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:14 smithi156 ceph-mon[32679]: pgmap v10302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17652.581511 secs 2024-04-26T23:24:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18349.611333 secs 2024-04-26T23:24:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:14 smithi092 ceph-mon[29156]: pgmap v10302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17652.581511 secs 2024-04-26T23:24:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:16 smithi189 ceph-mon[32756]: pgmap v10303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:16 smithi156 ceph-mon[32679]: pgmap v10303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:16 smithi092 ceph-mon[29156]: pgmap v10303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:18 smithi189 ceph-mon[32756]: pgmap v10304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:18 smithi156 ceph-mon[32679]: pgmap v10304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:18 smithi092 ceph-mon[29156]: pgmap v10304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18354.611431 secs 2024-04-26T23:24:20.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17657.581580 secs 2024-04-26T23:24:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18354.611431 secs 2024-04-26T23:24:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17657.581580 secs 2024-04-26T23:24:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18354.611431 secs 2024-04-26T23:24:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17657.581580 secs 2024-04-26T23:24:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:20 smithi189 ceph-mon[32756]: pgmap v10305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:20 smithi156 ceph-mon[32679]: pgmap v10305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:20 smithi092 ceph-mon[29156]: pgmap v10305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:22 smithi092 ceph-mon[29156]: pgmap v10306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:22 smithi189 ceph-mon[32756]: pgmap v10306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:22 smithi156 ceph-mon[32679]: pgmap v10306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18359.611573 secs 2024-04-26T23:24:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:24 smithi189 ceph-mon[32756]: pgmap v10307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17662.581656 secs 2024-04-26T23:24:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18359.611573 secs 2024-04-26T23:24:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:24 smithi156 ceph-mon[32679]: pgmap v10307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17662.581656 secs 2024-04-26T23:24:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18359.611573 secs 2024-04-26T23:24:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:24 smithi092 ceph-mon[29156]: pgmap v10307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17662.581656 secs 2024-04-26T23:24:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:26 smithi189 ceph-mon[32756]: pgmap v10308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:26 smithi156 ceph-mon[32679]: pgmap v10308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:26 smithi092 ceph-mon[29156]: pgmap v10308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:28 smithi189 ceph-mon[32756]: pgmap v10309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:28 smithi156 ceph-mon[32679]: pgmap v10309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:28 smithi092 ceph-mon[29156]: pgmap v10309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18364.611694 secs 2024-04-26T23:24:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17667.581772 secs 2024-04-26T23:24:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18364.611694 secs 2024-04-26T23:24:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17667.581772 secs 2024-04-26T23:24:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18364.611694 secs 2024-04-26T23:24:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17667.581772 secs 2024-04-26T23:24:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:30 smithi189 ceph-mon[32756]: pgmap v10310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:30 smithi156 ceph-mon[32679]: pgmap v10310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:30 smithi092 ceph-mon[29156]: pgmap v10310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:32 smithi189 ceph-mon[32756]: pgmap v10311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:32 smithi156 ceph-mon[32679]: pgmap v10311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:32 smithi092 ceph-mon[29156]: pgmap v10311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18369.611818 secs 2024-04-26T23:24:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:34 smithi189 ceph-mon[32756]: pgmap v10312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17672.581887 secs 2024-04-26T23:24:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18369.611818 secs 2024-04-26T23:24:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:34 smithi156 ceph-mon[32679]: pgmap v10312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17672.581887 secs 2024-04-26T23:24:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18369.611818 secs 2024-04-26T23:24:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:34 smithi092 ceph-mon[29156]: pgmap v10312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17672.581887 secs 2024-04-26T23:24:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:36 smithi189 ceph-mon[32756]: pgmap v10313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:36 smithi156 ceph-mon[32679]: pgmap v10313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:36 smithi092 ceph-mon[29156]: pgmap v10313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:38.503 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:24:38.502+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:24:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:24:38.502+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:24:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:24:38.502+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:24:38.504 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:24:38.502+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 144 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:24:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:38 smithi189 ceph-mon[32756]: pgmap v10314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:38 smithi156 ceph-mon[32679]: pgmap v10314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:38 smithi092 ceph-mon[29156]: pgmap v10314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18374.611942 secs 2024-04-26T23:24:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17677.582009 secs 2024-04-26T23:24:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18374.611942 secs 2024-04-26T23:24:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17677.582009 secs 2024-04-26T23:24:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18374.611942 secs 2024-04-26T23:24:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17677.582009 secs 2024-04-26T23:24:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:40 smithi189 ceph-mon[32756]: pgmap v10315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:40 smithi156 ceph-mon[32679]: pgmap v10315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:40 smithi092 ceph-mon[29156]: pgmap v10315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:24:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:24:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:24:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:42 smithi156 ceph-mon[32679]: pgmap v10316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:43.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:24:43.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:24:43.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:24:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:42 smithi092 ceph-mon[29156]: pgmap v10316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:24:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:24:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:24:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:42 smithi189 ceph-mon[32756]: pgmap v10316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:24:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:24:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:24:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:43 smithi156 ceph-mon[32679]: pgmap v10317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:24:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:43 smithi156 ceph-mon[32679]: pgmap v10318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:43 smithi092 ceph-mon[29156]: pgmap v10317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:24:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:43 smithi092 ceph-mon[29156]: pgmap v10318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:43 smithi189 ceph-mon[32756]: pgmap v10317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:24:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:43 smithi189 ceph-mon[32756]: pgmap v10318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18379.612006 secs 2024-04-26T23:24:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17682.582137 secs 2024-04-26T23:24:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18379.612006 secs 2024-04-26T23:24:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17682.582137 secs 2024-04-26T23:24:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18379.612006 secs 2024-04-26T23:24:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17682.582137 secs 2024-04-26T23:24:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:45 smithi156 ceph-mon[32679]: pgmap v10319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:45 smithi092 ceph-mon[29156]: pgmap v10319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:45 smithi189 ceph-mon[32756]: pgmap v10319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:47 smithi156 ceph-mon[32679]: pgmap v10320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:47 smithi092 ceph-mon[29156]: pgmap v10320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:48.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:47 smithi189 ceph-mon[32756]: pgmap v10320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:49 smithi156 ceph-mon[32679]: pgmap v10321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18384.612141 secs 2024-04-26T23:24:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17687.582257 secs 2024-04-26T23:24:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:49 smithi092 ceph-mon[29156]: pgmap v10321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18384.612141 secs 2024-04-26T23:24:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17687.582257 secs 2024-04-26T23:24:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:49 smithi189 ceph-mon[32756]: pgmap v10321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:24:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18384.612141 secs 2024-04-26T23:24:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17687.582257 secs 2024-04-26T23:24:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:51 smithi156 ceph-mon[32679]: pgmap v10322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:51 smithi092 ceph-mon[29156]: pgmap v10322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:52.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:51 smithi189 ceph-mon[32756]: pgmap v10322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:24:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:53 smithi156 ceph-mon[32679]: pgmap v10323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:24:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:53 smithi092 ceph-mon[29156]: pgmap v10323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:24:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:53 smithi189 ceph-mon[32756]: pgmap v10323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:24:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18389.612230 secs 2024-04-26T23:24:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17692.582372 secs 2024-04-26T23:24:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18389.612230 secs 2024-04-26T23:24:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17692.582372 secs 2024-04-26T23:24:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18389.612230 secs 2024-04-26T23:24:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17692.582372 secs 2024-04-26T23:24:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:55 smithi156 ceph-mon[32679]: pgmap v10324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:55 smithi092 ceph-mon[29156]: pgmap v10324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:55 smithi189 ceph-mon[32756]: pgmap v10324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:24:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:57 smithi156 ceph-mon[32679]: pgmap v10325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:57 smithi092 ceph-mon[29156]: pgmap v10325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:24:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:57 smithi189 ceph-mon[32756]: pgmap v10325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:59 smithi156 ceph-mon[32679]: pgmap v10326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18394.612332 secs 2024-04-26T23:25:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:24:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17697.582490 secs 2024-04-26T23:25:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:59 smithi092 ceph-mon[29156]: pgmap v10326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18394.612332 secs 2024-04-26T23:25:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:24:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17697.582490 secs 2024-04-26T23:25:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:59 smithi189 ceph-mon[32756]: pgmap v10326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18394.612332 secs 2024-04-26T23:25:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:24:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17697.582490 secs 2024-04-26T23:25:02.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:01 smithi092 ceph-mon[29156]: pgmap v10327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:01 smithi189 ceph-mon[32756]: pgmap v10327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:02.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:01 smithi156 ceph-mon[32679]: pgmap v10327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:04.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:03 smithi189 ceph-mon[32756]: pgmap v10328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:04.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:03 smithi156 ceph-mon[32679]: pgmap v10328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:03 smithi092 ceph-mon[29156]: pgmap v10328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18399.612455 secs 2024-04-26T23:25:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17702.582604 secs 2024-04-26T23:25:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18399.612455 secs 2024-04-26T23:25:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17702.582604 secs 2024-04-26T23:25:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18399.612455 secs 2024-04-26T23:25:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17702.582604 secs 2024-04-26T23:25:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:05 smithi092 ceph-mon[29156]: pgmap v10329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:06.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:05 smithi189 ceph-mon[32756]: pgmap v10329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:06.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:05 smithi156 ceph-mon[32679]: pgmap v10329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:07 smithi092 ceph-mon[29156]: pgmap v10330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:08.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:07 smithi189 ceph-mon[32756]: pgmap v10330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:08.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:07 smithi156 ceph-mon[32679]: pgmap v10330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:09 smithi092 ceph-mon[29156]: pgmap v10331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18404.612579 secs 2024-04-26T23:25:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17707.582724 secs 2024-04-26T23:25:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:09 smithi189 ceph-mon[32756]: pgmap v10331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18404.612579 secs 2024-04-26T23:25:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17707.582724 secs 2024-04-26T23:25:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:09 smithi156 ceph-mon[32679]: pgmap v10331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18404.612579 secs 2024-04-26T23:25:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17707.582724 secs 2024-04-26T23:25:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:11 smithi092 ceph-mon[29156]: pgmap v10332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:12.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:11 smithi189 ceph-mon[32756]: pgmap v10332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:12.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:11 smithi156 ceph-mon[32679]: pgmap v10332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:13 smithi092 ceph-mon[29156]: pgmap v10333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:13 smithi189 ceph-mon[32756]: pgmap v10333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:13 smithi156 ceph-mon[32679]: pgmap v10333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18409.612695 secs 2024-04-26T23:25:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17712.582844 secs 2024-04-26T23:25:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18409.612695 secs 2024-04-26T23:25:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17712.582844 secs 2024-04-26T23:25:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18409.612695 secs 2024-04-26T23:25:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17712.582844 secs 2024-04-26T23:25:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:15 smithi092 ceph-mon[29156]: pgmap v10334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:15 smithi189 ceph-mon[32756]: pgmap v10334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:15 smithi156 ceph-mon[32679]: pgmap v10334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:17 smithi092 ceph-mon[29156]: pgmap v10335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:17 smithi189 ceph-mon[32756]: pgmap v10335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:18.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:17 smithi156 ceph-mon[32679]: pgmap v10335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:19 smithi092 ceph-mon[29156]: pgmap v10336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18414.612797 secs 2024-04-26T23:25:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17717.582962 secs 2024-04-26T23:25:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:19 smithi189 ceph-mon[32756]: pgmap v10336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18414.612797 secs 2024-04-26T23:25:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17717.582962 secs 2024-04-26T23:25:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:19 smithi156 ceph-mon[32679]: pgmap v10336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18414.612797 secs 2024-04-26T23:25:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17717.582962 secs 2024-04-26T23:25:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:21 smithi092 ceph-mon[29156]: pgmap v10337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:22.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:21 smithi189 ceph-mon[32756]: pgmap v10337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:21 smithi156 ceph-mon[32679]: pgmap v10337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:23 smithi092 ceph-mon[29156]: pgmap v10338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:23 smithi189 ceph-mon[32756]: pgmap v10338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:23 smithi156 ceph-mon[32679]: pgmap v10338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18419.612898 secs 2024-04-26T23:25:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17722.583075 secs 2024-04-26T23:25:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18419.612898 secs 2024-04-26T23:25:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17722.583075 secs 2024-04-26T23:25:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18419.612898 secs 2024-04-26T23:25:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17722.583075 secs 2024-04-26T23:25:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:25 smithi092 ceph-mon[29156]: pgmap v10339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:25 smithi189 ceph-mon[32756]: pgmap v10339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:25 smithi156 ceph-mon[32679]: pgmap v10339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:27 smithi189 ceph-mon[32756]: pgmap v10340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:28.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:27 smithi156 ceph-mon[32679]: pgmap v10340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:28.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:27 smithi092 ceph-mon[29156]: pgmap v10340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:29 smithi189 ceph-mon[32756]: pgmap v10341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18424.613043 secs 2024-04-26T23:25:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17727.583165 secs 2024-04-26T23:25:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:29 smithi156 ceph-mon[32679]: pgmap v10341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18424.613043 secs 2024-04-26T23:25:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17727.583165 secs 2024-04-26T23:25:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:29 smithi092 ceph-mon[29156]: pgmap v10341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18424.613043 secs 2024-04-26T23:25:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17727.583165 secs 2024-04-26T23:25:32.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:32 smithi189 ceph-mon[32756]: pgmap v10342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:32 smithi156 ceph-mon[32679]: pgmap v10342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:32.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:32 smithi092 ceph-mon[29156]: pgmap v10342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:34 smithi189 ceph-mon[32756]: pgmap v10343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:34.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:34 smithi156 ceph-mon[32679]: pgmap v10343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:34 smithi092 ceph-mon[29156]: pgmap v10343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18429.613160 secs 2024-04-26T23:25:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17732.583229 secs 2024-04-26T23:25:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18429.613160 secs 2024-04-26T23:25:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17732.583229 secs 2024-04-26T23:25:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18429.613160 secs 2024-04-26T23:25:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17732.583229 secs 2024-04-26T23:25:35.995 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:25:35.670+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:25:35.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:25:35.670+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:25:35.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:25:35.670+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:25:35.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:25:35.670+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:25:35.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:25:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:25:35.670+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:25:36.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:36 smithi189 ceph-mon[32756]: pgmap v10344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:36 smithi156 ceph-mon[32679]: pgmap v10344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:36 smithi092 ceph-mon[29156]: pgmap v10344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:38 smithi189 ceph-mon[32756]: pgmap v10345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:38 smithi156 ceph-mon[32679]: pgmap v10345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:38.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:38 smithi092 ceph-mon[29156]: pgmap v10345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:40 smithi189 ceph-mon[32756]: pgmap v10346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T23:25:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18434.613285 secs 2024-04-26T23:25:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17737.583389 secs 2024-04-26T23:25:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:40 smithi156 ceph-mon[32679]: pgmap v10346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T23:25:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18434.613285 secs 2024-04-26T23:25:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17737.583389 secs 2024-04-26T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:40 smithi092 ceph-mon[29156]: pgmap v10346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 0 B/s wr, 13 op/s 2024-04-26T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18434.613285 secs 2024-04-26T23:25:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17737.583389 secs 2024-04-26T23:25:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:42 smithi189 ceph-mon[32756]: pgmap v10347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T23:25:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:42 smithi156 ceph-mon[32679]: pgmap v10347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T23:25:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:42 smithi092 ceph-mon[29156]: pgmap v10347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-26T23:25:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:25:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:25:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:25:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: pgmap v10348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: pgmap v10349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: pgmap v10350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18439.613407 secs 2024-04-26T23:25:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17742.583429 secs 2024-04-26T23:25:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: pgmap v10348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T23:25:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: pgmap v10349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: pgmap v10350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18439.613407 secs 2024-04-26T23:25:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17742.583429 secs 2024-04-26T23:25:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: pgmap v10348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-26T23:25:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:25:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:25:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: pgmap v10349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-26T23:25:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: pgmap v10350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 233 B/s wr, 18 op/s 2024-04-26T23:25:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:25:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18439.613407 secs 2024-04-26T23:25:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17742.583429 secs 2024-04-26T23:25:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:46 smithi189 ceph-mon[32756]: pgmap v10351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T23:25:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:46 smithi156 ceph-mon[32679]: pgmap v10351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T23:25:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:46 smithi092 ceph-mon[29156]: pgmap v10351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-26T23:25:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:48 smithi189 ceph-mon[32756]: pgmap v10352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 233 B/s wr, 5 op/s 2024-04-26T23:25:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:48 smithi156 ceph-mon[32679]: pgmap v10352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 233 B/s wr, 5 op/s 2024-04-26T23:25:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:48 smithi092 ceph-mon[29156]: pgmap v10352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 233 B/s wr, 5 op/s 2024-04-26T23:25:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18444.613534 secs 2024-04-26T23:25:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17747.583555 secs 2024-04-26T23:25:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18444.613534 secs 2024-04-26T23:25:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17747.583555 secs 2024-04-26T23:25:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18444.613534 secs 2024-04-26T23:25:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17747.583555 secs 2024-04-26T23:25:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:50 smithi189 ceph-mon[32756]: pgmap v10353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:50 smithi156 ceph-mon[32679]: pgmap v10353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:50 smithi092 ceph-mon[29156]: pgmap v10353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:52 smithi189 ceph-mon[32756]: pgmap v10354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:52 smithi156 ceph-mon[32679]: pgmap v10354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:52 smithi092 ceph-mon[29156]: pgmap v10354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:25:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:54 smithi189 ceph-mon[32756]: pgmap v10355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:25:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18449.613659 secs 2024-04-26T23:25:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17752.583665 secs 2024-04-26T23:25:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:54 smithi156 ceph-mon[32679]: pgmap v10355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:25:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18449.613659 secs 2024-04-26T23:25:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17752.583665 secs 2024-04-26T23:25:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:54 smithi092 ceph-mon[29156]: pgmap v10355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:25:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18449.613659 secs 2024-04-26T23:25:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17752.583665 secs 2024-04-26T23:25:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:56 smithi189 ceph-mon[32756]: pgmap v10356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:56 smithi156 ceph-mon[32679]: pgmap v10356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:56 smithi092 ceph-mon[29156]: pgmap v10356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:25:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:58 smithi189 ceph-mon[32756]: pgmap v10357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:58 smithi156 ceph-mon[32679]: pgmap v10357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:58 smithi092 ceph-mon[29156]: pgmap v10357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:25:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18454.613783 secs 2024-04-26T23:25:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:25:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17757.583789 secs 2024-04-26T23:25:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18454.613783 secs 2024-04-26T23:25:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:25:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17757.583789 secs 2024-04-26T23:25:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18454.613783 secs 2024-04-26T23:25:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:25:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17757.583789 secs 2024-04-26T23:26:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:00 smithi189 ceph-mon[32756]: pgmap v10358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:00 smithi156 ceph-mon[32679]: pgmap v10358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:00 smithi092 ceph-mon[29156]: pgmap v10358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:02 smithi189 ceph-mon[32756]: pgmap v10359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:02 smithi156 ceph-mon[32679]: pgmap v10359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:02 smithi092 ceph-mon[29156]: pgmap v10359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:04 smithi189 ceph-mon[32756]: pgmap v10360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18459.613906 secs 2024-04-26T23:26:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17762.583908 secs 2024-04-26T23:26:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:04 smithi156 ceph-mon[32679]: pgmap v10360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18459.613906 secs 2024-04-26T23:26:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17762.583908 secs 2024-04-26T23:26:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:04 smithi092 ceph-mon[29156]: pgmap v10360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18459.613906 secs 2024-04-26T23:26:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17762.583908 secs 2024-04-26T23:26:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:06 smithi189 ceph-mon[32756]: pgmap v10361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:06 smithi156 ceph-mon[32679]: pgmap v10361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:06 smithi092 ceph-mon[29156]: pgmap v10361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:08 smithi189 ceph-mon[32756]: pgmap v10362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:08 smithi156 ceph-mon[32679]: pgmap v10362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:08 smithi092 ceph-mon[29156]: pgmap v10362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18464.614001 secs 2024-04-26T23:26:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17767.583981 secs 2024-04-26T23:26:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18464.614001 secs 2024-04-26T23:26:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17767.583981 secs 2024-04-26T23:26:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18464.614001 secs 2024-04-26T23:26:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17767.583981 secs 2024-04-26T23:26:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:10 smithi189 ceph-mon[32756]: pgmap v10363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:10 smithi156 ceph-mon[32679]: pgmap v10363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:10 smithi092 ceph-mon[29156]: pgmap v10363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:12 smithi189 ceph-mon[32756]: pgmap v10364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:12 smithi156 ceph-mon[32679]: pgmap v10364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:12 smithi092 ceph-mon[29156]: pgmap v10364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:14 smithi156 ceph-mon[32679]: pgmap v10365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18469.614144 secs 2024-04-26T23:26:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17772.584081 secs 2024-04-26T23:26:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:14 smithi092 ceph-mon[29156]: pgmap v10365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18469.614144 secs 2024-04-26T23:26:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17772.584081 secs 2024-04-26T23:26:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:14 smithi189 ceph-mon[32756]: pgmap v10365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:26:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18469.614144 secs 2024-04-26T23:26:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17772.584081 secs 2024-04-26T23:26:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:16 smithi156 ceph-mon[32679]: pgmap v10366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:16 smithi092 ceph-mon[29156]: pgmap v10366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:16 smithi189 ceph-mon[32756]: pgmap v10366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:26:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:18 smithi156 ceph-mon[32679]: pgmap v10367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:18 smithi092 ceph-mon[29156]: pgmap v10367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:18 smithi189 ceph-mon[32756]: pgmap v10367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18474.614292 secs 2024-04-26T23:26:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17777.584205 secs 2024-04-26T23:26:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18474.614292 secs 2024-04-26T23:26:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17777.584205 secs 2024-04-26T23:26:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18474.614292 secs 2024-04-26T23:26:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17777.584205 secs 2024-04-26T23:26:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:20 smithi156 ceph-mon[32679]: pgmap v10368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:20 smithi092 ceph-mon[29156]: pgmap v10368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:20 smithi189 ceph-mon[32756]: pgmap v10368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:22 smithi156 ceph-mon[32679]: pgmap v10369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:22 smithi092 ceph-mon[29156]: pgmap v10369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:22 smithi189 ceph-mon[32756]: pgmap v10369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:24 smithi156 ceph-mon[32679]: pgmap v10370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18479.614364 secs 2024-04-26T23:26:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17782.584361 secs 2024-04-26T23:26:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:24 smithi092 ceph-mon[29156]: pgmap v10370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18479.614364 secs 2024-04-26T23:26:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17782.584361 secs 2024-04-26T23:26:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:24 smithi189 ceph-mon[32756]: pgmap v10370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18479.614364 secs 2024-04-26T23:26:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17782.584361 secs 2024-04-26T23:26:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:26 smithi156 ceph-mon[32679]: pgmap v10371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:26 smithi092 ceph-mon[29156]: pgmap v10371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:26 smithi189 ceph-mon[32756]: pgmap v10371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:28 smithi156 ceph-mon[32679]: pgmap v10372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:28 smithi092 ceph-mon[29156]: pgmap v10372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:28 smithi189 ceph-mon[32756]: pgmap v10372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18484.614495 secs 2024-04-26T23:26:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17787.584510 secs 2024-04-26T23:26:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18484.614495 secs 2024-04-26T23:26:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17787.584510 secs 2024-04-26T23:26:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18484.614495 secs 2024-04-26T23:26:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17787.584510 secs 2024-04-26T23:26:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:30 smithi156 ceph-mon[32679]: pgmap v10373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:30 smithi092 ceph-mon[29156]: pgmap v10373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:30 smithi189 ceph-mon[32756]: pgmap v10373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:32 smithi156 ceph-mon[32679]: pgmap v10374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:32 smithi092 ceph-mon[29156]: pgmap v10374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:32 smithi189 ceph-mon[32756]: pgmap v10374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:34 smithi156 ceph-mon[32679]: pgmap v10375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18489.614622 secs 2024-04-26T23:26:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17792.584598 secs 2024-04-26T23:26:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:34 smithi189 ceph-mon[32756]: pgmap v10375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18489.614622 secs 2024-04-26T23:26:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17792.584598 secs 2024-04-26T23:26:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:34 smithi092 ceph-mon[29156]: pgmap v10375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18489.614622 secs 2024-04-26T23:26:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17792.584598 secs 2024-04-26T23:26:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:36 smithi156 ceph-mon[32679]: pgmap v10376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:36 smithi092 ceph-mon[29156]: pgmap v10376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:36 smithi189 ceph-mon[32756]: pgmap v10376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:38 smithi156 ceph-mon[32679]: pgmap v10377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:38 smithi092 ceph-mon[29156]: pgmap v10377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:38 smithi189 ceph-mon[32756]: pgmap v10377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18494.614723 secs 2024-04-26T23:26:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17797.584759 secs 2024-04-26T23:26:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18494.614723 secs 2024-04-26T23:26:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17797.584759 secs 2024-04-26T23:26:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18494.614723 secs 2024-04-26T23:26:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17797.584759 secs 2024-04-26T23:26:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:40 smithi092 ceph-mon[29156]: pgmap v10378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:40 smithi189 ceph-mon[32756]: pgmap v10378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:40 smithi156 ceph-mon[32679]: pgmap v10378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:42 smithi092 ceph-mon[29156]: pgmap v10379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:42 smithi189 ceph-mon[32756]: pgmap v10379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:42 smithi156 ceph-mon[32679]: pgmap v10379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:26:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:26:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: pgmap v10380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18499.614849 secs 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17802.584842 secs 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.704 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.705 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: pgmap v10380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18499.614849 secs 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17802.584842 secs 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.716 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.717 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.717 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.717 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: pgmap v10380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18499.614849 secs 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17802.584842 secs 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:45 smithi092 ceph-mon[29156]: pgmap v10381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:45 smithi189 ceph-mon[32756]: pgmap v10381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:45 smithi156 ceph-mon[32679]: pgmap v10381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:26:47.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:26:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:26:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: pgmap v10382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:48 smithi189 ceph-mon[32756]: pgmap v10383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: pgmap v10382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:48 smithi156 ceph-mon[32679]: pgmap v10383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:26:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: pgmap v10382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:26:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:48 smithi092 ceph-mon[29156]: pgmap v10383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18504.614954 secs 2024-04-26T23:26:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17807.584973 secs 2024-04-26T23:26:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18504.614954 secs 2024-04-26T23:26:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17807.584973 secs 2024-04-26T23:26:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18504.614954 secs 2024-04-26T23:26:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17807.584973 secs 2024-04-26T23:26:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:50 smithi189 ceph-mon[32756]: pgmap v10384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:50 smithi156 ceph-mon[32679]: pgmap v10384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:50 smithi092 ceph-mon[29156]: pgmap v10384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:52 smithi189 ceph-mon[32756]: pgmap v10385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:52 smithi156 ceph-mon[32679]: pgmap v10385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:52 smithi092 ceph-mon[29156]: pgmap v10385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:54 smithi189 ceph-mon[32756]: pgmap v10386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18509.615035 secs 2024-04-26T23:26:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17812.585078 secs 2024-04-26T23:26:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:54 smithi156 ceph-mon[32679]: pgmap v10386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18509.615035 secs 2024-04-26T23:26:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17812.585078 secs 2024-04-26T23:26:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:54 smithi092 ceph-mon[29156]: pgmap v10386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18509.615035 secs 2024-04-26T23:26:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17812.585078 secs 2024-04-26T23:26:56.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:56 smithi189 ceph-mon[32756]: pgmap v10387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:56 smithi156 ceph-mon[32679]: pgmap v10387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:56 smithi092 ceph-mon[29156]: pgmap v10387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:26:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:58 smithi092 ceph-mon[29156]: pgmap v10388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:26:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:58 smithi189 ceph-mon[32756]: pgmap v10388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:26:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:58 smithi156 ceph-mon[32679]: pgmap v10388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:26:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18514.615175 secs 2024-04-26T23:26:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:26:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17817.585213 secs 2024-04-26T23:26:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18514.615175 secs 2024-04-26T23:26:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:26:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17817.585213 secs 2024-04-26T23:26:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18514.615175 secs 2024-04-26T23:26:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:26:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17817.585213 secs 2024-04-26T23:27:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:00 smithi189 ceph-mon[32756]: pgmap v10389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:00 smithi156 ceph-mon[32679]: pgmap v10389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:00 smithi092 ceph-mon[29156]: pgmap v10389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:02 smithi189 ceph-mon[32756]: pgmap v10390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:02 smithi156 ceph-mon[32679]: pgmap v10390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:02 smithi092 ceph-mon[29156]: pgmap v10390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:04 smithi189 ceph-mon[32756]: pgmap v10391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18519.615319 secs 2024-04-26T23:27:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17822.585328 secs 2024-04-26T23:27:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:04 smithi156 ceph-mon[32679]: pgmap v10391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18519.615319 secs 2024-04-26T23:27:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17822.585328 secs 2024-04-26T23:27:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:04 smithi092 ceph-mon[29156]: pgmap v10391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18519.615319 secs 2024-04-26T23:27:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17822.585328 secs 2024-04-26T23:27:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:06 smithi189 ceph-mon[32756]: pgmap v10392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:06 smithi156 ceph-mon[32679]: pgmap v10392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:06 smithi092 ceph-mon[29156]: pgmap v10392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:08 smithi189 ceph-mon[32756]: pgmap v10393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:08 smithi156 ceph-mon[32679]: pgmap v10393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:08 smithi092 ceph-mon[29156]: pgmap v10393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18524.615433 secs 2024-04-26T23:27:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17827.585446 secs 2024-04-26T23:27:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18524.615433 secs 2024-04-26T23:27:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17827.585446 secs 2024-04-26T23:27:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18524.615433 secs 2024-04-26T23:27:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17827.585446 secs 2024-04-26T23:27:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:10 smithi189 ceph-mon[32756]: pgmap v10394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:10 smithi156 ceph-mon[32679]: pgmap v10394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:10 smithi092 ceph-mon[29156]: pgmap v10394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:12 smithi189 ceph-mon[32756]: pgmap v10395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:12 smithi156 ceph-mon[32679]: pgmap v10395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:12 smithi092 ceph-mon[29156]: pgmap v10395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:14 smithi189 ceph-mon[32756]: pgmap v10396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18529.615550 secs 2024-04-26T23:27:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17832.585512 secs 2024-04-26T23:27:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:14 smithi156 ceph-mon[32679]: pgmap v10396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18529.615550 secs 2024-04-26T23:27:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17832.585512 secs 2024-04-26T23:27:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:14 smithi092 ceph-mon[29156]: pgmap v10396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18529.615550 secs 2024-04-26T23:27:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17832.585512 secs 2024-04-26T23:27:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:16 smithi189 ceph-mon[32756]: pgmap v10397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:16 smithi156 ceph-mon[32679]: pgmap v10397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:16 smithi092 ceph-mon[29156]: pgmap v10397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:18 smithi189 ceph-mon[32756]: pgmap v10398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:18 smithi156 ceph-mon[32679]: pgmap v10398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:18 smithi092 ceph-mon[29156]: pgmap v10398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18534.615652 secs 2024-04-26T23:27:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17837.585634 secs 2024-04-26T23:27:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18534.615652 secs 2024-04-26T23:27:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17837.585634 secs 2024-04-26T23:27:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18534.615652 secs 2024-04-26T23:27:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17837.585634 secs 2024-04-26T23:27:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:20 smithi189 ceph-mon[32756]: pgmap v10399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:20 smithi156 ceph-mon[32679]: pgmap v10399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:20 smithi092 ceph-mon[29156]: pgmap v10399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:22 smithi189 ceph-mon[32756]: pgmap v10400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:22 smithi156 ceph-mon[32679]: pgmap v10400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:22 smithi092 ceph-mon[29156]: pgmap v10400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:24 smithi189 ceph-mon[32756]: pgmap v10401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18539.615799 secs 2024-04-26T23:27:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17842.585713 secs 2024-04-26T23:27:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:24 smithi156 ceph-mon[32679]: pgmap v10401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18539.615799 secs 2024-04-26T23:27:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17842.585713 secs 2024-04-26T23:27:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:24 smithi092 ceph-mon[29156]: pgmap v10401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18539.615799 secs 2024-04-26T23:27:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17842.585713 secs 2024-04-26T23:27:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:26 smithi189 ceph-mon[32756]: pgmap v10402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:26 smithi156 ceph-mon[32679]: pgmap v10402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:26 smithi092 ceph-mon[29156]: pgmap v10402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:28 smithi189 ceph-mon[32756]: pgmap v10403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:28 smithi156 ceph-mon[32679]: pgmap v10403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:28 smithi092 ceph-mon[29156]: pgmap v10403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18544.615959 secs 2024-04-26T23:27:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17847.585834 secs 2024-04-26T23:27:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18544.615959 secs 2024-04-26T23:27:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17847.585834 secs 2024-04-26T23:27:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18544.615959 secs 2024-04-26T23:27:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17847.585834 secs 2024-04-26T23:27:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:30 smithi156 ceph-mon[32679]: pgmap v10404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:30 smithi092 ceph-mon[29156]: pgmap v10404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:30 smithi189 ceph-mon[32756]: pgmap v10404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:32 smithi156 ceph-mon[32679]: pgmap v10405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:32 smithi092 ceph-mon[29156]: pgmap v10405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:32 smithi189 ceph-mon[32756]: pgmap v10405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:34 smithi156 ceph-mon[32679]: pgmap v10406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18549.616084 secs 2024-04-26T23:27:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17852.585953 secs 2024-04-26T23:27:34.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:34 smithi189 ceph-mon[32756]: pgmap v10406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:34.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18549.616084 secs 2024-04-26T23:27:34.691 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17852.585953 secs 2024-04-26T23:27:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:34 smithi092 ceph-mon[29156]: pgmap v10406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18549.616084 secs 2024-04-26T23:27:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17852.585953 secs 2024-04-26T23:27:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:36 smithi156 ceph-mon[32679]: pgmap v10407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:36 smithi092 ceph-mon[29156]: pgmap v10407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:36 smithi189 ceph-mon[32756]: pgmap v10407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:27:38.525+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:27:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:27:38.525+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:27:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:27:38.526+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:27:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:27:38.526+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 145 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:27:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:38 smithi156 ceph-mon[32679]: pgmap v10408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:38 smithi092 ceph-mon[29156]: pgmap v10408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:38 smithi189 ceph-mon[32756]: pgmap v10408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18554.616202 secs 2024-04-26T23:27:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17857.586083 secs 2024-04-26T23:27:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18554.616202 secs 2024-04-26T23:27:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17857.586083 secs 2024-04-26T23:27:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18554.616202 secs 2024-04-26T23:27:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17857.586083 secs 2024-04-26T23:27:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:40 smithi156 ceph-mon[32679]: pgmap v10409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:40 smithi092 ceph-mon[29156]: pgmap v10409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:40 smithi189 ceph-mon[32756]: pgmap v10409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:42 smithi156 ceph-mon[32679]: pgmap v10410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:42 smithi092 ceph-mon[29156]: pgmap v10410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:42 smithi189 ceph-mon[32756]: pgmap v10410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:44 smithi156 ceph-mon[32679]: pgmap v10411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18559.616299 secs 2024-04-26T23:27:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17862.586209 secs 2024-04-26T23:27:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:44 smithi092 ceph-mon[29156]: pgmap v10411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18559.616299 secs 2024-04-26T23:27:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17862.586209 secs 2024-04-26T23:27:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:44 smithi189 ceph-mon[32756]: pgmap v10411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18559.616299 secs 2024-04-26T23:27:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17862.586209 secs 2024-04-26T23:27:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:46 smithi156 ceph-mon[32679]: pgmap v10412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:46 smithi092 ceph-mon[29156]: pgmap v10412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:46 smithi189 ceph-mon[32756]: pgmap v10412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:27:47.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:27:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:27:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:27:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:48 smithi092 ceph-mon[29156]: pgmap v10413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:27:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:27:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:27:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:48 smithi189 ceph-mon[32756]: pgmap v10413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:27:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:27:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:27:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:48 smithi156 ceph-mon[32679]: pgmap v10413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:27:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:27:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:27:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:27:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:49 smithi092 ceph-mon[29156]: pgmap v10414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:27:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:49 smithi092 ceph-mon[29156]: pgmap v10415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:27:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18564.616420 secs 2024-04-26T23:27:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17867.586365 secs 2024-04-26T23:27:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:49 smithi189 ceph-mon[32756]: pgmap v10414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:27:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:49 smithi189 ceph-mon[32756]: pgmap v10415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:27:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18564.616420 secs 2024-04-26T23:27:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17867.586365 secs 2024-04-26T23:27:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:49 smithi156 ceph-mon[32679]: pgmap v10414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:27:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:49 smithi156 ceph-mon[32679]: pgmap v10415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:27:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18564.616420 secs 2024-04-26T23:27:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17867.586365 secs 2024-04-26T23:27:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:51 smithi092 ceph-mon[29156]: pgmap v10416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:51 smithi189 ceph-mon[32756]: pgmap v10416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:51 smithi156 ceph-mon[32679]: pgmap v10416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:53 smithi092 ceph-mon[29156]: pgmap v10417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:53 smithi189 ceph-mon[32756]: pgmap v10417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:53 smithi156 ceph-mon[32679]: pgmap v10417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18569.616548 secs 2024-04-26T23:27:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17872.586429 secs 2024-04-26T23:27:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18569.616548 secs 2024-04-26T23:27:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17872.586429 secs 2024-04-26T23:27:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18569.616548 secs 2024-04-26T23:27:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17872.586429 secs 2024-04-26T23:27:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:55 smithi092 ceph-mon[29156]: pgmap v10418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:55 smithi189 ceph-mon[32756]: pgmap v10418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:55 smithi156 ceph-mon[32679]: pgmap v10418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:57 smithi092 ceph-mon[29156]: pgmap v10419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:57 smithi189 ceph-mon[32756]: pgmap v10419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:57 smithi156 ceph-mon[32679]: pgmap v10419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:27:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:59 smithi092 ceph-mon[29156]: pgmap v10420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:27:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18574.616674 secs 2024-04-26T23:27:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:27:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17877.586496 secs 2024-04-26T23:27:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:59 smithi189 ceph-mon[32756]: pgmap v10420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:27:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18574.616674 secs 2024-04-26T23:27:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:27:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17877.586496 secs 2024-04-26T23:27:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:59 smithi156 ceph-mon[32679]: pgmap v10420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:27:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18574.616674 secs 2024-04-26T23:27:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:27:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17877.586496 secs 2024-04-26T23:28:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:00 smithi189 ceph-mon[32756]: pgmap v10421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:00 smithi156 ceph-mon[32679]: pgmap v10421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:00 smithi092 ceph-mon[29156]: pgmap v10421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:02.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:02 smithi092 ceph-mon[29156]: pgmap v10422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:03.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:02 smithi189 ceph-mon[32756]: pgmap v10422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:02 smithi156 ceph-mon[32679]: pgmap v10422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:04.988 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18579.616817 secs 2024-04-26T23:28:04.988 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:04 smithi156 ceph-mon[32679]: pgmap v10423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:04.988 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17882.586569 secs 2024-04-26T23:28:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18579.616817 secs 2024-04-26T23:28:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:04 smithi092 ceph-mon[29156]: pgmap v10423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17882.586569 secs 2024-04-26T23:28:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18579.616817 secs 2024-04-26T23:28:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:04 smithi189 ceph-mon[32756]: pgmap v10423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17882.586569 secs 2024-04-26T23:28:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:06 smithi092 ceph-mon[29156]: pgmap v10424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:06 smithi189 ceph-mon[32756]: pgmap v10424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:07.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:06 smithi156 ceph-mon[32679]: pgmap v10424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:08 smithi092 ceph-mon[29156]: pgmap v10425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:09.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:08 smithi189 ceph-mon[32756]: pgmap v10425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:08 smithi156 ceph-mon[32679]: pgmap v10425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18584.616944 secs 2024-04-26T23:28:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17887.586684 secs 2024-04-26T23:28:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18584.616944 secs 2024-04-26T23:28:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17887.586684 secs 2024-04-26T23:28:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18584.616944 secs 2024-04-26T23:28:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17887.586684 secs 2024-04-26T23:28:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:10 smithi092 ceph-mon[29156]: pgmap v10426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:10 smithi189 ceph-mon[32756]: pgmap v10426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:10 smithi156 ceph-mon[32679]: pgmap v10426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:12 smithi092 ceph-mon[29156]: pgmap v10427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:13.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:12 smithi189 ceph-mon[32756]: pgmap v10427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:12 smithi156 ceph-mon[32679]: pgmap v10427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18589.617007 secs 2024-04-26T23:28:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:14 smithi189 ceph-mon[32756]: pgmap v10428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17892.586822 secs 2024-04-26T23:28:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18589.617007 secs 2024-04-26T23:28:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:14 smithi156 ceph-mon[32679]: pgmap v10428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17892.586822 secs 2024-04-26T23:28:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18589.617007 secs 2024-04-26T23:28:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:14 smithi092 ceph-mon[29156]: pgmap v10428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17892.586822 secs 2024-04-26T23:28:17.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:16 smithi189 ceph-mon[32756]: pgmap v10429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:17.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:16 smithi156 ceph-mon[32679]: pgmap v10429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:16 smithi092 ceph-mon[29156]: pgmap v10429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:19.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:18 smithi189 ceph-mon[32756]: pgmap v10430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:18 smithi156 ceph-mon[32679]: pgmap v10430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:18 smithi092 ceph-mon[29156]: pgmap v10430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18594.617088 secs 2024-04-26T23:28:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17897.586958 secs 2024-04-26T23:28:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18594.617088 secs 2024-04-26T23:28:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17897.586958 secs 2024-04-26T23:28:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18594.617088 secs 2024-04-26T23:28:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17897.586958 secs 2024-04-26T23:28:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:20 smithi189 ceph-mon[32756]: pgmap v10431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:20 smithi156 ceph-mon[32679]: pgmap v10431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:21.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:20 smithi092 ceph-mon[29156]: pgmap v10431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:22 smithi189 ceph-mon[32756]: pgmap v10432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:22 smithi156 ceph-mon[32679]: pgmap v10432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:23.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:22 smithi092 ceph-mon[29156]: pgmap v10432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18599.617164 secs 2024-04-26T23:28:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:24 smithi189 ceph-mon[32756]: pgmap v10433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17902.587028 secs 2024-04-26T23:28:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18599.617164 secs 2024-04-26T23:28:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:24 smithi156 ceph-mon[32679]: pgmap v10433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17902.587028 secs 2024-04-26T23:28:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18599.617164 secs 2024-04-26T23:28:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:24 smithi092 ceph-mon[29156]: pgmap v10433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17902.587028 secs 2024-04-26T23:28:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:26 smithi189 ceph-mon[32756]: pgmap v10434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:26 smithi156 ceph-mon[32679]: pgmap v10434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:27.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:26 smithi092 ceph-mon[29156]: pgmap v10434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:28 smithi189 ceph-mon[32756]: pgmap v10435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:28 smithi156 ceph-mon[32679]: pgmap v10435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:28 smithi092 ceph-mon[29156]: pgmap v10435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18604.617228 secs 2024-04-26T23:28:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17907.587167 secs 2024-04-26T23:28:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18604.617228 secs 2024-04-26T23:28:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17907.587167 secs 2024-04-26T23:28:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18604.617228 secs 2024-04-26T23:28:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17907.587167 secs 2024-04-26T23:28:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:30 smithi189 ceph-mon[32756]: pgmap v10436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:30 smithi156 ceph-mon[32679]: pgmap v10436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:31.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:30 smithi092 ceph-mon[29156]: pgmap v10436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:33.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:32 smithi189 ceph-mon[32756]: pgmap v10437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:32 smithi156 ceph-mon[32679]: pgmap v10437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:32 smithi092 ceph-mon[29156]: pgmap v10437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18609.617292 secs 2024-04-26T23:28:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:34 smithi189 ceph-mon[32756]: pgmap v10438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17912.587255 secs 2024-04-26T23:28:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18609.617292 secs 2024-04-26T23:28:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:34 smithi156 ceph-mon[32679]: pgmap v10438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17912.587255 secs 2024-04-26T23:28:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18609.617292 secs 2024-04-26T23:28:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:34 smithi092 ceph-mon[29156]: pgmap v10438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17912.587255 secs 2024-04-26T23:28:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:36 smithi189 ceph-mon[32756]: pgmap v10439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:36 smithi156 ceph-mon[32679]: pgmap v10439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:36 smithi092 ceph-mon[29156]: pgmap v10439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:38 smithi189 ceph-mon[32756]: pgmap v10440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:39.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:38 smithi156 ceph-mon[32679]: pgmap v10440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:39.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:38 smithi092 ceph-mon[29156]: pgmap v10440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18614.617375 secs 2024-04-26T23:28:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17917.587372 secs 2024-04-26T23:28:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18614.617375 secs 2024-04-26T23:28:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17917.587372 secs 2024-04-26T23:28:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18614.617375 secs 2024-04-26T23:28:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17917.587372 secs 2024-04-26T23:28:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:40 smithi156 ceph-mon[32679]: pgmap v10441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:40 smithi092 ceph-mon[29156]: pgmap v10441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:41.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:40 smithi189 ceph-mon[32756]: pgmap v10441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:42 smithi156 ceph-mon[32679]: pgmap v10442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:43.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:42 smithi092 ceph-mon[29156]: pgmap v10442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:42 smithi189 ceph-mon[32756]: pgmap v10442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18619.617446 secs 2024-04-26T23:28:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:44 smithi156 ceph-mon[32679]: pgmap v10443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17922.587487 secs 2024-04-26T23:28:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18619.617446 secs 2024-04-26T23:28:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:44 smithi092 ceph-mon[29156]: pgmap v10443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17922.587487 secs 2024-04-26T23:28:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18619.617446 secs 2024-04-26T23:28:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:44 smithi189 ceph-mon[32756]: pgmap v10443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:28:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17922.587487 secs 2024-04-26T23:28:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:46 smithi156 ceph-mon[32679]: pgmap v10444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:46 smithi092 ceph-mon[29156]: pgmap v10444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:46 smithi189 ceph-mon[32756]: pgmap v10444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:28:48.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:28:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: pgmap v10445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: pgmap v10446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: pgmap v10447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:28:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: pgmap v10445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:28:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:28:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: pgmap v10446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:28:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: pgmap v10447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: pgmap v10445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: pgmap v10446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: pgmap v10447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:28:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18624.617590 secs 2024-04-26T23:28:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17927.587645 secs 2024-04-26T23:28:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18624.617590 secs 2024-04-26T23:28:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17927.587645 secs 2024-04-26T23:28:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18624.617590 secs 2024-04-26T23:28:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17927.587645 secs 2024-04-26T23:28:51.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:50 smithi156 ceph-mon[32679]: pgmap v10448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:51.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:50 smithi092 ceph-mon[29156]: pgmap v10448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:51.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:50 smithi189 ceph-mon[32756]: pgmap v10448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:52 smithi189 ceph-mon[32756]: pgmap v10449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:52 smithi156 ceph-mon[32679]: pgmap v10449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:52 smithi092 ceph-mon[29156]: pgmap v10449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:28:54.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18629.617710 secs 2024-04-26T23:28:54.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17932.587721 secs 2024-04-26T23:28:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18629.617710 secs 2024-04-26T23:28:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17932.587721 secs 2024-04-26T23:28:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18629.617710 secs 2024-04-26T23:28:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17932.587721 secs 2024-04-26T23:28:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:55 smithi189 ceph-mon[32756]: pgmap v10450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:55 smithi156 ceph-mon[32679]: pgmap v10450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:55 smithi092 ceph-mon[29156]: pgmap v10450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:56 smithi189 ceph-mon[32756]: pgmap v10451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:56 smithi156 ceph-mon[32679]: pgmap v10451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:56 smithi092 ceph-mon[29156]: pgmap v10451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:28:58.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:58 smithi092 ceph-mon[29156]: pgmap v10452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:28:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:58 smithi189 ceph-mon[32756]: pgmap v10452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:28:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:58 smithi156 ceph-mon[32679]: pgmap v10452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:28:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18634.617867 secs 2024-04-26T23:28:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:28:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17937.587842 secs 2024-04-26T23:28:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18634.617867 secs 2024-04-26T23:28:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:28:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17937.587842 secs 2024-04-26T23:28:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18634.617867 secs 2024-04-26T23:28:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:28:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17937.587842 secs 2024-04-26T23:29:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:00 smithi189 ceph-mon[32756]: pgmap v10453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:00 smithi156 ceph-mon[32679]: pgmap v10453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:00 smithi092 ceph-mon[29156]: pgmap v10453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:02 smithi189 ceph-mon[32756]: pgmap v10454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:02 smithi156 ceph-mon[32679]: pgmap v10454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:02 smithi092 ceph-mon[29156]: pgmap v10454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:04.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18639.617988 secs 2024-04-26T23:29:04.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17942.587974 secs 2024-04-26T23:29:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18639.617988 secs 2024-04-26T23:29:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17942.587974 secs 2024-04-26T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18639.617988 secs 2024-04-26T23:29:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17942.587974 secs 2024-04-26T23:29:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:05 smithi189 ceph-mon[32756]: pgmap v10455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:05 smithi156 ceph-mon[32679]: pgmap v10455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:05 smithi092 ceph-mon[29156]: pgmap v10455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:06 smithi189 ceph-mon[32756]: pgmap v10456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:06 smithi156 ceph-mon[32679]: pgmap v10456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:06 smithi092 ceph-mon[29156]: pgmap v10456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:08 smithi189 ceph-mon[32756]: pgmap v10457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:08 smithi156 ceph-mon[32679]: pgmap v10457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:08 smithi092 ceph-mon[29156]: pgmap v10457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18644.618111 secs 2024-04-26T23:29:10.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17947.588118 secs 2024-04-26T23:29:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18644.618111 secs 2024-04-26T23:29:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17947.588118 secs 2024-04-26T23:29:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18644.618111 secs 2024-04-26T23:29:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17947.588118 secs 2024-04-26T23:29:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:10 smithi189 ceph-mon[32756]: pgmap v10458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:11.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:10 smithi156 ceph-mon[32679]: pgmap v10458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:10 smithi092 ceph-mon[29156]: pgmap v10458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:12 smithi189 ceph-mon[32756]: pgmap v10459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:12 smithi156 ceph-mon[32679]: pgmap v10459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:12 smithi092 ceph-mon[29156]: pgmap v10459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18649.618187 secs 2024-04-26T23:29:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17952.588255 secs 2024-04-26T23:29:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18649.618187 secs 2024-04-26T23:29:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17952.588255 secs 2024-04-26T23:29:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18649.618187 secs 2024-04-26T23:29:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17952.588255 secs 2024-04-26T23:29:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:15 smithi189 ceph-mon[32756]: pgmap v10460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:15 smithi156 ceph-mon[32679]: pgmap v10460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:15 smithi092 ceph-mon[29156]: pgmap v10460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:16.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:16 smithi189 ceph-mon[32756]: pgmap v10461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:16 smithi156 ceph-mon[32679]: pgmap v10461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:16 smithi092 ceph-mon[29156]: pgmap v10461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:18 smithi189 ceph-mon[32756]: pgmap v10462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:18 smithi156 ceph-mon[32679]: pgmap v10462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:18 smithi092 ceph-mon[29156]: pgmap v10462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18654.618266 secs 2024-04-26T23:29:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17957.588396 secs 2024-04-26T23:29:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18654.618266 secs 2024-04-26T23:29:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17957.588396 secs 2024-04-26T23:29:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18654.618266 secs 2024-04-26T23:29:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17957.588396 secs 2024-04-26T23:29:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:20 smithi189 ceph-mon[32756]: pgmap v10463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:20 smithi156 ceph-mon[32679]: pgmap v10463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:20 smithi092 ceph-mon[29156]: pgmap v10463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:22 smithi189 ceph-mon[32756]: pgmap v10464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:22 smithi156 ceph-mon[32679]: pgmap v10464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:22 smithi092 ceph-mon[29156]: pgmap v10464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18659.618401 secs 2024-04-26T23:29:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17962.588470 secs 2024-04-26T23:29:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18659.618401 secs 2024-04-26T23:29:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17962.588470 secs 2024-04-26T23:29:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18659.618401 secs 2024-04-26T23:29:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17962.588470 secs 2024-04-26T23:29:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:25 smithi189 ceph-mon[32756]: pgmap v10465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:25 smithi156 ceph-mon[32679]: pgmap v10465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:25 smithi092 ceph-mon[29156]: pgmap v10465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:26 smithi189 ceph-mon[32756]: pgmap v10466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:26.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:26 smithi156 ceph-mon[32679]: pgmap v10466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:26 smithi092 ceph-mon[29156]: pgmap v10466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:28.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:28 smithi092 ceph-mon[29156]: pgmap v10467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:28 smithi189 ceph-mon[32756]: pgmap v10467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:28.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:28 smithi156 ceph-mon[32679]: pgmap v10467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18664.618504 secs 2024-04-26T23:29:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17967.588553 secs 2024-04-26T23:29:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18664.618504 secs 2024-04-26T23:29:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17967.588553 secs 2024-04-26T23:29:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18664.618504 secs 2024-04-26T23:29:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17967.588553 secs 2024-04-26T23:29:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:30 smithi189 ceph-mon[32756]: pgmap v10468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:30 smithi156 ceph-mon[32679]: pgmap v10468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:30 smithi092 ceph-mon[29156]: pgmap v10468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:32 smithi189 ceph-mon[32756]: pgmap v10469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:32.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:32 smithi156 ceph-mon[32679]: pgmap v10469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:32.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:32 smithi092 ceph-mon[29156]: pgmap v10469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:29:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18669.618576 secs 2024-04-26T23:29:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17972.588672 secs 2024-04-26T23:29:34.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18669.618576 secs 2024-04-26T23:29:34.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17972.588672 secs 2024-04-26T23:29:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18669.618576 secs 2024-04-26T23:29:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17972.588672 secs 2024-04-26T23:29:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:35 smithi189 ceph-mon[32756]: pgmap v10470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:35 smithi156 ceph-mon[32679]: pgmap v10470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:35 smithi092 ceph-mon[29156]: pgmap v10470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:29:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:36 smithi189 ceph-mon[32756]: pgmap v10471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:36.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:36 smithi156 ceph-mon[32679]: pgmap v10471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:36.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:36 smithi092 ceph-mon[29156]: pgmap v10471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:38 smithi189 ceph-mon[32756]: pgmap v10472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:38.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:38 smithi156 ceph-mon[32679]: pgmap v10472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:38.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:38 smithi092 ceph-mon[29156]: pgmap v10472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18674.618717 secs 2024-04-26T23:29:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17977.588827 secs 2024-04-26T23:29:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18674.618717 secs 2024-04-26T23:29:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17977.588827 secs 2024-04-26T23:29:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18674.618717 secs 2024-04-26T23:29:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17977.588827 secs 2024-04-26T23:29:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:40 smithi189 ceph-mon[32756]: pgmap v10473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:40 smithi156 ceph-mon[32679]: pgmap v10473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:40 smithi092 ceph-mon[29156]: pgmap v10473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:42 smithi189 ceph-mon[32756]: pgmap v10474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:42 smithi156 ceph-mon[32679]: pgmap v10474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:42.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:42 smithi092 ceph-mon[29156]: pgmap v10474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18679.618851 secs 2024-04-26T23:29:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17982.588917 secs 2024-04-26T23:29:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18679.618851 secs 2024-04-26T23:29:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17982.588917 secs 2024-04-26T23:29:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18679.618851 secs 2024-04-26T23:29:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17982.588917 secs 2024-04-26T23:29:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:45 smithi189 ceph-mon[32756]: pgmap v10475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:45 smithi156 ceph-mon[32679]: pgmap v10475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:45 smithi092 ceph-mon[29156]: pgmap v10475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:29:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:46 smithi189 ceph-mon[32756]: pgmap v10476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:46 smithi156 ceph-mon[32679]: pgmap v10476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:46 smithi092 ceph-mon[29156]: pgmap v10476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:48.863 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:48 smithi092 ceph-mon[29156]: pgmap v10477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:48 smithi189 ceph-mon[32756]: pgmap v10477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:48 smithi156 ceph-mon[32679]: pgmap v10477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18684.618918 secs 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17987.589017 secs 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:29:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: pgmap v10478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:29:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: pgmap v10479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18684.618918 secs 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17987.589017 secs 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: pgmap v10478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: pgmap v10479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:29:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18684.618918 secs 2024-04-26T23:29:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:29:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17987.589017 secs 2024-04-26T23:29:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:29:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:29:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: pgmap v10478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:29:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: pgmap v10479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:29:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:52 smithi189 ceph-mon[32756]: pgmap v10480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:52 smithi156 ceph-mon[32679]: pgmap v10480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:52 smithi092 ceph-mon[29156]: pgmap v10480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:54 smithi189 ceph-mon[32756]: pgmap v10481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:29:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18689.619046 secs 2024-04-26T23:29:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17992.589137 secs 2024-04-26T23:29:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:54 smithi156 ceph-mon[32679]: pgmap v10481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:29:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18689.619046 secs 2024-04-26T23:29:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17992.589137 secs 2024-04-26T23:29:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:54 smithi092 ceph-mon[29156]: pgmap v10481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:29:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18689.619046 secs 2024-04-26T23:29:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17992.589137 secs 2024-04-26T23:29:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:56 smithi189 ceph-mon[32756]: pgmap v10482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:56 smithi156 ceph-mon[32679]: pgmap v10482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:56 smithi092 ceph-mon[29156]: pgmap v10482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:58 smithi189 ceph-mon[32756]: pgmap v10483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:58 smithi156 ceph-mon[32679]: pgmap v10483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:58.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:58 smithi092 ceph-mon[29156]: pgmap v10483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:29:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18694.619166 secs 2024-04-26T23:29:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:29:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 17997.589260 secs 2024-04-26T23:29:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18694.619166 secs 2024-04-26T23:29:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:29:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 17997.589260 secs 2024-04-26T23:29:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18694.619166 secs 2024-04-26T23:29:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:29:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 17997.589260 secs 2024-04-26T23:30:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:00 smithi189 ceph-mon[32756]: pgmap v10484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:30:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:30:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:00 smithi156 ceph-mon[32679]: pgmap v10484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:30:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:30:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:00 smithi092 ceph-mon[29156]: pgmap v10484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:30:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:30:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:02 smithi189 ceph-mon[32756]: pgmap v10485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:02.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:02 smithi156 ceph-mon[32679]: pgmap v10485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:02 smithi092 ceph-mon[29156]: pgmap v10485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:04 smithi189 ceph-mon[32756]: pgmap v10486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18699.619283 secs 2024-04-26T23:30:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18002.589333 secs 2024-04-26T23:30:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:04 smithi156 ceph-mon[32679]: pgmap v10486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18699.619283 secs 2024-04-26T23:30:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18002.589333 secs 2024-04-26T23:30:04.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:04 smithi092 ceph-mon[29156]: pgmap v10486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:04.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18699.619283 secs 2024-04-26T23:30:04.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18002.589333 secs 2024-04-26T23:30:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:06 smithi189 ceph-mon[32756]: pgmap v10487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:06.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:06 smithi156 ceph-mon[32679]: pgmap v10487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:06 smithi092 ceph-mon[29156]: pgmap v10487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:08 smithi189 ceph-mon[32756]: pgmap v10488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:08 smithi156 ceph-mon[32679]: pgmap v10488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:08 smithi092 ceph-mon[29156]: pgmap v10488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18704.619431 secs 2024-04-26T23:30:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18007.589457 secs 2024-04-26T23:30:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18704.619431 secs 2024-04-26T23:30:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18007.589457 secs 2024-04-26T23:30:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18704.619431 secs 2024-04-26T23:30:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18007.589457 secs 2024-04-26T23:30:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:10 smithi189 ceph-mon[32756]: pgmap v10489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:10 smithi156 ceph-mon[32679]: pgmap v10489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:10 smithi092 ceph-mon[29156]: pgmap v10489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:12 smithi189 ceph-mon[32756]: pgmap v10490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:12 smithi156 ceph-mon[32679]: pgmap v10490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:12 smithi092 ceph-mon[29156]: pgmap v10490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:14 smithi189 ceph-mon[32756]: pgmap v10491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18709.619543 secs 2024-04-26T23:30:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18012.589573 secs 2024-04-26T23:30:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:14 smithi156 ceph-mon[32679]: pgmap v10491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18709.619543 secs 2024-04-26T23:30:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18012.589573 secs 2024-04-26T23:30:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:14 smithi092 ceph-mon[29156]: pgmap v10491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18709.619543 secs 2024-04-26T23:30:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18012.589573 secs 2024-04-26T23:30:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:16 smithi189 ceph-mon[32756]: pgmap v10492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:16 smithi156 ceph-mon[32679]: pgmap v10492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:16 smithi092 ceph-mon[29156]: pgmap v10492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:18 smithi189 ceph-mon[32756]: pgmap v10493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:18 smithi156 ceph-mon[32679]: pgmap v10493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:18 smithi092 ceph-mon[29156]: pgmap v10493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18714.619669 secs 2024-04-26T23:30:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18017.589643 secs 2024-04-26T23:30:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18714.619669 secs 2024-04-26T23:30:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18017.589643 secs 2024-04-26T23:30:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18714.619669 secs 2024-04-26T23:30:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18017.589643 secs 2024-04-26T23:30:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:20 smithi189 ceph-mon[32756]: pgmap v10494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:20 smithi156 ceph-mon[32679]: pgmap v10494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:20 smithi092 ceph-mon[29156]: pgmap v10494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:22 smithi189 ceph-mon[32756]: pgmap v10495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:22 smithi156 ceph-mon[32679]: pgmap v10495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:22 smithi092 ceph-mon[29156]: pgmap v10495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:24 smithi189 ceph-mon[32756]: pgmap v10496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18719.619799 secs 2024-04-26T23:30:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18022.589751 secs 2024-04-26T23:30:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:24 smithi156 ceph-mon[32679]: pgmap v10496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18719.619799 secs 2024-04-26T23:30:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18022.589751 secs 2024-04-26T23:30:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:24 smithi092 ceph-mon[29156]: pgmap v10496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18719.619799 secs 2024-04-26T23:30:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18022.589751 secs 2024-04-26T23:30:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:26 smithi189 ceph-mon[32756]: pgmap v10497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:26 smithi156 ceph-mon[32679]: pgmap v10497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:26 smithi092 ceph-mon[29156]: pgmap v10497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:28 smithi189 ceph-mon[32756]: pgmap v10498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:28 smithi156 ceph-mon[32679]: pgmap v10498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:28 smithi092 ceph-mon[29156]: pgmap v10498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18724.619943 secs 2024-04-26T23:30:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18027.589869 secs 2024-04-26T23:30:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18724.619943 secs 2024-04-26T23:30:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18027.589869 secs 2024-04-26T23:30:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18724.619943 secs 2024-04-26T23:30:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18027.589869 secs 2024-04-26T23:30:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:30 smithi189 ceph-mon[32756]: pgmap v10499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:30 smithi156 ceph-mon[32679]: pgmap v10499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:30 smithi092 ceph-mon[29156]: pgmap v10499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:32 smithi156 ceph-mon[32679]: pgmap v10500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:32 smithi092 ceph-mon[29156]: pgmap v10500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:32 smithi189 ceph-mon[32756]: pgmap v10500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:34 smithi156 ceph-mon[32679]: pgmap v10501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18729.620086 secs 2024-04-26T23:30:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18032.589990 secs 2024-04-26T23:30:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:34 smithi189 ceph-mon[32756]: pgmap v10501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18729.620086 secs 2024-04-26T23:30:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18032.589990 secs 2024-04-26T23:30:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:34 smithi092 ceph-mon[29156]: pgmap v10501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18729.620086 secs 2024-04-26T23:30:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18032.589990 secs 2024-04-26T23:30:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:36 smithi156 ceph-mon[32679]: pgmap v10502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:36 smithi092 ceph-mon[29156]: pgmap v10502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:36.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:36 smithi189 ceph-mon[32756]: pgmap v10502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:30:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:30:38.550+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:30:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:30:38.550+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:30:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:30:38.550+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:30:38.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:30:38.550+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 146 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:30:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:38 smithi156 ceph-mon[32679]: pgmap v10503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:38 smithi092 ceph-mon[29156]: pgmap v10503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:38 smithi189 ceph-mon[32756]: pgmap v10503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:30:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18734.620219 secs 2024-04-26T23:30:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18037.590084 secs 2024-04-26T23:30:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18734.620219 secs 2024-04-26T23:30:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18037.590084 secs 2024-04-26T23:30:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18734.620219 secs 2024-04-26T23:30:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18037.590084 secs 2024-04-26T23:30:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:40 smithi156 ceph-mon[32679]: pgmap v10504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:40 smithi092 ceph-mon[29156]: pgmap v10504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:40 smithi189 ceph-mon[32756]: pgmap v10504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:42 smithi156 ceph-mon[32679]: pgmap v10505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:42 smithi092 ceph-mon[29156]: pgmap v10505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:42 smithi189 ceph-mon[32756]: pgmap v10505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:44 smithi156 ceph-mon[32679]: pgmap v10506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:44.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18739.620332 secs 2024-04-26T23:30:44.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18042.590174 secs 2024-04-26T23:30:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:44 smithi092 ceph-mon[29156]: pgmap v10506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18739.620332 secs 2024-04-26T23:30:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18042.590174 secs 2024-04-26T23:30:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:44 smithi189 ceph-mon[32756]: pgmap v10506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18739.620332 secs 2024-04-26T23:30:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18042.590174 secs 2024-04-26T23:30:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:46 smithi156 ceph-mon[32679]: pgmap v10507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:46 smithi092 ceph-mon[29156]: pgmap v10507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:46 smithi189 ceph-mon[32756]: pgmap v10507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:48 smithi156 ceph-mon[32679]: pgmap v10508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:48 smithi092 ceph-mon[29156]: pgmap v10508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:48 smithi189 ceph-mon[32756]: pgmap v10508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:30:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18744.620429 secs 2024-04-26T23:30:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18047.590327 secs 2024-04-26T23:30:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:30:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18744.620429 secs 2024-04-26T23:30:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18047.590327 secs 2024-04-26T23:30:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:30:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18744.620429 secs 2024-04-26T23:30:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18047.590327 secs 2024-04-26T23:30:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:30:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:50 smithi156 ceph-mon[32679]: pgmap v10509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:30:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:30:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:50 smithi092 ceph-mon[29156]: pgmap v10509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:30:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:50 smithi189 ceph-mon[32756]: pgmap v10509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:30:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:30:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:30:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:30:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:51 smithi156 ceph-mon[32679]: pgmap v10510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:30:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:51 smithi156 ceph-mon[32679]: pgmap v10511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:51 smithi092 ceph-mon[29156]: pgmap v10510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:30:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:51 smithi092 ceph-mon[29156]: pgmap v10511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:51 smithi189 ceph-mon[32756]: pgmap v10510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:30:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:51 smithi189 ceph-mon[32756]: pgmap v10511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:53 smithi156 ceph-mon[32679]: pgmap v10512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:53 smithi092 ceph-mon[29156]: pgmap v10512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:53 smithi189 ceph-mon[32756]: pgmap v10512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18749.620511 secs 2024-04-26T23:30:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18052.590451 secs 2024-04-26T23:30:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18749.620511 secs 2024-04-26T23:30:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18052.590451 secs 2024-04-26T23:30:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18749.620511 secs 2024-04-26T23:30:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18052.590451 secs 2024-04-26T23:30:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:55 smithi092 ceph-mon[29156]: pgmap v10513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:55 smithi189 ceph-mon[32756]: pgmap v10513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:55 smithi156 ceph-mon[32679]: pgmap v10513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:57 smithi092 ceph-mon[29156]: pgmap v10514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:57 smithi189 ceph-mon[32756]: pgmap v10514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:57 smithi156 ceph-mon[32679]: pgmap v10514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:30:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:59 smithi092 ceph-mon[29156]: pgmap v10515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:30:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18754.620611 secs 2024-04-26T23:30:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:30:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18057.590573 secs 2024-04-26T23:30:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:59 smithi189 ceph-mon[32756]: pgmap v10515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:30:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18754.620611 secs 2024-04-26T23:30:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:30:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18057.590573 secs 2024-04-26T23:30:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:59 smithi156 ceph-mon[32679]: pgmap v10515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:30:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18754.620611 secs 2024-04-26T23:30:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:30:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18057.590573 secs 2024-04-26T23:31:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:01 smithi092 ceph-mon[29156]: pgmap v10516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:31:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:01 smithi189 ceph-mon[32756]: pgmap v10516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:31:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:01 smithi156 ceph-mon[32679]: pgmap v10516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:31:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:03 smithi092 ceph-mon[29156]: pgmap v10517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:03 smithi189 ceph-mon[32756]: pgmap v10517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:03 smithi156 ceph-mon[32679]: pgmap v10517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18759.620747 secs 2024-04-26T23:31:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18062.590688 secs 2024-04-26T23:31:04.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18759.620747 secs 2024-04-26T23:31:04.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18062.590688 secs 2024-04-26T23:31:04.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18759.620747 secs 2024-04-26T23:31:04.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18062.590688 secs 2024-04-26T23:31:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-mon[29156]: pgmap v10518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:05 smithi189 ceph-mon[32756]: pgmap v10518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:05 smithi156 ceph-mon[32679]: pgmap v10518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:05.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:31:05.719+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:31:05.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:31:05.719+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:31:05.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:31:05.719+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:31:05.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:31:05.719+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:31:05.996 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:31:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:31:05.719+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:31:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:07 smithi092 ceph-mon[29156]: pgmap v10519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:07 smithi189 ceph-mon[32756]: pgmap v10519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:07 smithi156 ceph-mon[32679]: pgmap v10519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:09 smithi092 ceph-mon[29156]: pgmap v10520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18764.620863 secs 2024-04-26T23:31:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18067.590769 secs 2024-04-26T23:31:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:09 smithi189 ceph-mon[32756]: pgmap v10520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18764.620863 secs 2024-04-26T23:31:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18067.590769 secs 2024-04-26T23:31:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:09 smithi156 ceph-mon[32679]: pgmap v10520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18764.620863 secs 2024-04-26T23:31:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18067.590769 secs 2024-04-26T23:31:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:11 smithi092 ceph-mon[29156]: pgmap v10521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:11 smithi189 ceph-mon[32756]: pgmap v10521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:11 smithi156 ceph-mon[32679]: pgmap v10521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:13 smithi092 ceph-mon[29156]: pgmap v10522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:13 smithi189 ceph-mon[32756]: pgmap v10522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:13 smithi156 ceph-mon[32679]: pgmap v10522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18769.620974 secs 2024-04-26T23:31:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18072.590885 secs 2024-04-26T23:31:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18769.620974 secs 2024-04-26T23:31:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18072.590885 secs 2024-04-26T23:31:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18769.620974 secs 2024-04-26T23:31:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18072.590885 secs 2024-04-26T23:31:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:15 smithi092 ceph-mon[29156]: pgmap v10523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:15 smithi189 ceph-mon[32756]: pgmap v10523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:15 smithi156 ceph-mon[32679]: pgmap v10523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:17 smithi092 ceph-mon[29156]: pgmap v10524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:17 smithi189 ceph-mon[32756]: pgmap v10524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:17 smithi156 ceph-mon[32679]: pgmap v10524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:19 smithi092 ceph-mon[29156]: pgmap v10525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18774.621051 secs 2024-04-26T23:31:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18077.590959 secs 2024-04-26T23:31:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:19 smithi189 ceph-mon[32756]: pgmap v10525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18774.621051 secs 2024-04-26T23:31:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18077.590959 secs 2024-04-26T23:31:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:19 smithi156 ceph-mon[32679]: pgmap v10525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:31:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18774.621051 secs 2024-04-26T23:31:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18077.590959 secs 2024-04-26T23:31:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:21 smithi092 ceph-mon[29156]: pgmap v10526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:21 smithi189 ceph-mon[32756]: pgmap v10526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:21 smithi156 ceph-mon[32679]: pgmap v10526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:31:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:22 smithi189 ceph-mon[32756]: pgmap v10527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:22 smithi156 ceph-mon[32679]: pgmap v10527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:22 smithi092 ceph-mon[29156]: pgmap v10527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18779.621127 secs 2024-04-26T23:31:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18082.591035 secs 2024-04-26T23:31:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18779.621127 secs 2024-04-26T23:31:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18082.591035 secs 2024-04-26T23:31:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18779.621127 secs 2024-04-26T23:31:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18082.591035 secs 2024-04-26T23:31:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:25 smithi189 ceph-mon[32756]: pgmap v10528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:25.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:25 smithi156 ceph-mon[32679]: pgmap v10528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:25 smithi092 ceph-mon[29156]: pgmap v10528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:27 smithi189 ceph-mon[32756]: pgmap v10529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:27 smithi156 ceph-mon[32679]: pgmap v10529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:27 smithi092 ceph-mon[29156]: pgmap v10529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:29 smithi189 ceph-mon[32756]: pgmap v10530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18784.621206 secs 2024-04-26T23:31:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18087.591184 secs 2024-04-26T23:31:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:29 smithi156 ceph-mon[32679]: pgmap v10530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18784.621206 secs 2024-04-26T23:31:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18087.591184 secs 2024-04-26T23:31:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:29 smithi092 ceph-mon[29156]: pgmap v10530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18784.621206 secs 2024-04-26T23:31:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18087.591184 secs 2024-04-26T23:31:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:31 smithi189 ceph-mon[32756]: pgmap v10531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:31.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:31 smithi156 ceph-mon[32679]: pgmap v10531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:31.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:31 smithi092 ceph-mon[29156]: pgmap v10531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:33.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:33 smithi189 ceph-mon[32756]: pgmap v10532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:33.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:33 smithi156 ceph-mon[32679]: pgmap v10532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:33 smithi092 ceph-mon[29156]: pgmap v10532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:34.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18789.621284 secs 2024-04-26T23:31:34.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18092.591245 secs 2024-04-26T23:31:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18789.621284 secs 2024-04-26T23:31:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18092.591245 secs 2024-04-26T23:31:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18789.621284 secs 2024-04-26T23:31:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18092.591245 secs 2024-04-26T23:31:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:35 smithi156 ceph-mon[32679]: pgmap v10533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:35 smithi092 ceph-mon[29156]: pgmap v10533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:35 smithi189 ceph-mon[32756]: pgmap v10533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:37.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:37 smithi156 ceph-mon[32679]: pgmap v10534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:37.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:37 smithi092 ceph-mon[29156]: pgmap v10534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:37 smithi189 ceph-mon[32756]: pgmap v10534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:39 smithi156 ceph-mon[32679]: pgmap v10535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18794.621361 secs 2024-04-26T23:31:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18097.591365 secs 2024-04-26T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:39 smithi092 ceph-mon[29156]: pgmap v10535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18794.621361 secs 2024-04-26T23:31:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18097.591365 secs 2024-04-26T23:31:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:39 smithi189 ceph-mon[32756]: pgmap v10535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18794.621361 secs 2024-04-26T23:31:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18097.591365 secs 2024-04-26T23:31:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:41 smithi156 ceph-mon[32679]: pgmap v10536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:41.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:41 smithi092 ceph-mon[29156]: pgmap v10536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:41 smithi189 ceph-mon[32756]: pgmap v10536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:43.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:43 smithi156 ceph-mon[32679]: pgmap v10537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:43 smithi092 ceph-mon[29156]: pgmap v10537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:43 smithi189 ceph-mon[32756]: pgmap v10537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18799.621435 secs 2024-04-26T23:31:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18102.591465 secs 2024-04-26T23:31:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18799.621435 secs 2024-04-26T23:31:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18102.591465 secs 2024-04-26T23:31:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18799.621435 secs 2024-04-26T23:31:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18102.591465 secs 2024-04-26T23:31:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:45 smithi156 ceph-mon[32679]: pgmap v10538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:45 smithi092 ceph-mon[29156]: pgmap v10538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:45 smithi189 ceph-mon[32756]: pgmap v10538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:47 smithi156 ceph-mon[32679]: pgmap v10539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:47.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:47 smithi092 ceph-mon[29156]: pgmap v10539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:47 smithi189 ceph-mon[32756]: pgmap v10539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:49 smithi156 ceph-mon[32679]: pgmap v10540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18804.621497 secs 2024-04-26T23:31:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18107.591604 secs 2024-04-26T23:31:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:49 smithi092 ceph-mon[29156]: pgmap v10540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18804.621497 secs 2024-04-26T23:31:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18107.591604 secs 2024-04-26T23:31:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:49 smithi189 ceph-mon[32756]: pgmap v10540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18804.621497 secs 2024-04-26T23:31:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18107.591604 secs 2024-04-26T23:31:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:31:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:31:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:31:51.428 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:51 smithi092 ceph-mon[29156]: pgmap v10541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:51.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:51 smithi156 ceph-mon[32679]: pgmap v10541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:51 smithi189 ceph-mon[32756]: pgmap v10541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:53.316 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:53 smithi156 ceph-mon[32679]: pgmap v10542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:53.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:53 smithi092 ceph-mon[29156]: pgmap v10542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:53 smithi189 ceph-mon[32756]: pgmap v10542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:31:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18809.621582 secs 2024-04-26T23:31:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18112.591671 secs 2024-04-26T23:31:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18809.621582 secs 2024-04-26T23:31:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18112.591671 secs 2024-04-26T23:31:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18809.621582 secs 2024-04-26T23:31:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18112.591671 secs 2024-04-26T23:31:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: pgmap v10543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:31:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:31:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: pgmap v10543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:31:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:31:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: pgmap v10543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:31:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:31:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:56 smithi092 ceph-mon[29156]: pgmap v10544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:31:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:56 smithi092 ceph-mon[29156]: pgmap v10545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:56 smithi189 ceph-mon[32756]: pgmap v10544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:31:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:56 smithi189 ceph-mon[32756]: pgmap v10545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:56 smithi156 ceph-mon[32679]: pgmap v10544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:31:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:56 smithi156 ceph-mon[32679]: pgmap v10545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:58 smithi092 ceph-mon[29156]: pgmap v10546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:58 smithi189 ceph-mon[32756]: pgmap v10546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:58 smithi156 ceph-mon[32679]: pgmap v10546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:31:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18814.621692 secs 2024-04-26T23:31:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:31:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18117.591810 secs 2024-04-26T23:31:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18814.621692 secs 2024-04-26T23:31:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:31:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18117.591810 secs 2024-04-26T23:31:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18814.621692 secs 2024-04-26T23:31:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:31:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18117.591810 secs 2024-04-26T23:32:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:00 smithi092 ceph-mon[29156]: pgmap v10547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:00 smithi189 ceph-mon[32756]: pgmap v10547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:00 smithi156 ceph-mon[32679]: pgmap v10547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:02 smithi092 ceph-mon[29156]: pgmap v10548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:02 smithi189 ceph-mon[32756]: pgmap v10548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:02.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:02 smithi156 ceph-mon[32679]: pgmap v10548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:32:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:04 smithi092 ceph-mon[29156]: pgmap v10549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:32:04.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18819.621771 secs 2024-04-26T23:32:04.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18122.591944 secs 2024-04-26T23:32:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:04 smithi189 ceph-mon[32756]: pgmap v10549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:32:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18819.621771 secs 2024-04-26T23:32:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18122.591944 secs 2024-04-26T23:32:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:04 smithi156 ceph-mon[32679]: pgmap v10549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:32:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18819.621771 secs 2024-04-26T23:32:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18122.591944 secs 2024-04-26T23:32:06.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:06 smithi092 ceph-mon[29156]: pgmap v10550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:32:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:06 smithi189 ceph-mon[32756]: pgmap v10550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:32:06.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:06 smithi156 ceph-mon[32679]: pgmap v10550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:32:08.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:08 smithi092 ceph-mon[29156]: pgmap v10551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:32:08.563+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:32:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:32:08.564+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:32:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:32:08.568+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:32:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:32:08.569+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 147 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:32:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:08 smithi189 ceph-mon[32756]: pgmap v10551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:08 smithi156 ceph-mon[32679]: pgmap v10551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18824.621851 secs 2024-04-26T23:32:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18127.592063 secs 2024-04-26T23:32:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18824.621851 secs 2024-04-26T23:32:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18127.592063 secs 2024-04-26T23:32:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18824.621851 secs 2024-04-26T23:32:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18127.592063 secs 2024-04-26T23:32:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:10 smithi092 ceph-mon[29156]: pgmap v10552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:10 smithi189 ceph-mon[32756]: pgmap v10552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:10 smithi156 ceph-mon[32679]: pgmap v10552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:12.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:12 smithi092 ceph-mon[29156]: pgmap v10553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:12 smithi189 ceph-mon[32756]: pgmap v10553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:12 smithi156 ceph-mon[32679]: pgmap v10553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:14.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:14 smithi156 ceph-mon[32679]: pgmap v10554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:14.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18829.621943 secs 2024-04-26T23:32:14.487 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18132.592148 secs 2024-04-26T23:32:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:14 smithi092 ceph-mon[29156]: pgmap v10554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18829.621943 secs 2024-04-26T23:32:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18132.592148 secs 2024-04-26T23:32:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:14 smithi189 ceph-mon[32756]: pgmap v10554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18829.621943 secs 2024-04-26T23:32:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18132.592148 secs 2024-04-26T23:32:16.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:16 smithi092 ceph-mon[29156]: pgmap v10555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:16 smithi189 ceph-mon[32756]: pgmap v10555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:16 smithi156 ceph-mon[32679]: pgmap v10555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:18.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:18 smithi092 ceph-mon[29156]: pgmap v10556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:18 smithi189 ceph-mon[32756]: pgmap v10556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:18 smithi156 ceph-mon[32679]: pgmap v10556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18834.622037 secs 2024-04-26T23:32:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18137.592267 secs 2024-04-26T23:32:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18834.622037 secs 2024-04-26T23:32:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18137.592267 secs 2024-04-26T23:32:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18834.622037 secs 2024-04-26T23:32:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18137.592267 secs 2024-04-26T23:32:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:20 smithi092 ceph-mon[29156]: pgmap v10557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:20 smithi189 ceph-mon[32756]: pgmap v10557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:20 smithi156 ceph-mon[32679]: pgmap v10557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:22 smithi189 ceph-mon[32756]: pgmap v10558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:22 smithi156 ceph-mon[32679]: pgmap v10558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:22 smithi092 ceph-mon[29156]: pgmap v10558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:24.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:24 smithi092 ceph-mon[29156]: pgmap v10559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:24.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18839.622148 secs 2024-04-26T23:32:24.511 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18142.592386 secs 2024-04-26T23:32:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:24 smithi189 ceph-mon[32756]: pgmap v10559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18839.622148 secs 2024-04-26T23:32:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18142.592386 secs 2024-04-26T23:32:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:24 smithi156 ceph-mon[32679]: pgmap v10559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18839.622148 secs 2024-04-26T23:32:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18142.592386 secs 2024-04-26T23:32:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:26 smithi189 ceph-mon[32756]: pgmap v10560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:26 smithi156 ceph-mon[32679]: pgmap v10560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:26 smithi092 ceph-mon[29156]: pgmap v10560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:28 smithi189 ceph-mon[32756]: pgmap v10561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:28 smithi156 ceph-mon[32679]: pgmap v10561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:28 smithi092 ceph-mon[29156]: pgmap v10561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18844.622256 secs 2024-04-26T23:32:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18147.592494 secs 2024-04-26T23:32:29.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18844.622256 secs 2024-04-26T23:32:29.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18147.592494 secs 2024-04-26T23:32:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18844.622256 secs 2024-04-26T23:32:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18147.592494 secs 2024-04-26T23:32:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:30 smithi189 ceph-mon[32756]: pgmap v10562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:30 smithi156 ceph-mon[32679]: pgmap v10562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:30 smithi092 ceph-mon[29156]: pgmap v10562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:32 smithi189 ceph-mon[32756]: pgmap v10563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:32 smithi156 ceph-mon[32679]: pgmap v10563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:32 smithi092 ceph-mon[29156]: pgmap v10563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:34 smithi189 ceph-mon[32756]: pgmap v10564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18849.622320 secs 2024-04-26T23:32:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18152.592593 secs 2024-04-26T23:32:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:34 smithi156 ceph-mon[32679]: pgmap v10564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18849.622320 secs 2024-04-26T23:32:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18152.592593 secs 2024-04-26T23:32:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:34 smithi092 ceph-mon[29156]: pgmap v10564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18849.622320 secs 2024-04-26T23:32:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18152.592593 secs 2024-04-26T23:32:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:36 smithi189 ceph-mon[32756]: pgmap v10565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:36 smithi156 ceph-mon[32679]: pgmap v10565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:36 smithi092 ceph-mon[29156]: pgmap v10565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:38.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:38 smithi189 ceph-mon[32756]: pgmap v10566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:38 smithi156 ceph-mon[32679]: pgmap v10566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:38 smithi092 ceph-mon[29156]: pgmap v10566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18854.622456 secs 2024-04-26T23:32:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18157.592660 secs 2024-04-26T23:32:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18854.622456 secs 2024-04-26T23:32:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18157.592660 secs 2024-04-26T23:32:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18854.622456 secs 2024-04-26T23:32:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18157.592660 secs 2024-04-26T23:32:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:40 smithi189 ceph-mon[32756]: pgmap v10567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:40 smithi156 ceph-mon[32679]: pgmap v10567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:40 smithi092 ceph-mon[29156]: pgmap v10567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:42 smithi189 ceph-mon[32756]: pgmap v10568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:42 smithi156 ceph-mon[32679]: pgmap v10568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:42 smithi092 ceph-mon[29156]: pgmap v10568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:44 smithi189 ceph-mon[32756]: pgmap v10569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18859.622542 secs 2024-04-26T23:32:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18162.592773 secs 2024-04-26T23:32:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:44 smithi156 ceph-mon[32679]: pgmap v10569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18859.622542 secs 2024-04-26T23:32:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18162.592773 secs 2024-04-26T23:32:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:44 smithi092 ceph-mon[29156]: pgmap v10569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18859.622542 secs 2024-04-26T23:32:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18162.592773 secs 2024-04-26T23:32:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:46 smithi189 ceph-mon[32756]: pgmap v10570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:46 smithi156 ceph-mon[32679]: pgmap v10570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:46 smithi092 ceph-mon[29156]: pgmap v10570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:32:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:48 smithi189 ceph-mon[32756]: pgmap v10571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:48 smithi156 ceph-mon[32679]: pgmap v10571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:48 smithi092 ceph-mon[29156]: pgmap v10571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:32:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18864.622660 secs 2024-04-26T23:32:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18167.592895 secs 2024-04-26T23:32:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18864.622660 secs 2024-04-26T23:32:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18167.592895 secs 2024-04-26T23:32:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18864.622660 secs 2024-04-26T23:32:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18167.592895 secs 2024-04-26T23:32:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:50 smithi189 ceph-mon[32756]: pgmap v10572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:50 smithi156 ceph-mon[32679]: pgmap v10572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:50 smithi092 ceph-mon[29156]: pgmap v10572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:52 smithi189 ceph-mon[32756]: pgmap v10573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:52 smithi156 ceph-mon[32679]: pgmap v10573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:52 smithi092 ceph-mon[29156]: pgmap v10573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:54 smithi189 ceph-mon[32756]: pgmap v10574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18869.622758 secs 2024-04-26T23:32:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18172.593001 secs 2024-04-26T23:32:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:54 smithi156 ceph-mon[32679]: pgmap v10574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18869.622758 secs 2024-04-26T23:32:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18172.593001 secs 2024-04-26T23:32:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:54 smithi092 ceph-mon[29156]: pgmap v10574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18869.622758 secs 2024-04-26T23:32:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18172.593001 secs 2024-04-26T23:32:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:32:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:32:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:32:56.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:56 smithi189 ceph-mon[32756]: pgmap v10575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:56 smithi156 ceph-mon[32679]: pgmap v10575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:56 smithi092 ceph-mon[29156]: pgmap v10575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:32:58.506 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:58 smithi189 ceph-mon[32756]: pgmap v10576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:58 smithi156 ceph-mon[32679]: pgmap v10576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:58.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:58 smithi092 ceph-mon[29156]: pgmap v10576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18874.622914 secs 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18177.593117 secs 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:32:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:32:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18874.622914 secs 2024-04-26T23:32:59.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18177.593117 secs 2024-04-26T23:32:59.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:32:59.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:32:59.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:32:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18874.622914 secs 2024-04-26T23:32:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18177.593117 secs 2024-04-26T23:32:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:32:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:32:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:32:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:32:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:33:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:00 smithi189 ceph-mon[32756]: pgmap v10577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:33:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:00 smithi189 ceph-mon[32756]: pgmap v10578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:33:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:00 smithi189 ceph-mon[32756]: pgmap v10579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:00.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:00 smithi092 ceph-mon[29156]: pgmap v10577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:33:00.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:00 smithi092 ceph-mon[29156]: pgmap v10578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:33:00.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:00 smithi092 ceph-mon[29156]: pgmap v10579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:00 smithi156 ceph-mon[32679]: pgmap v10577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:33:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:00 smithi156 ceph-mon[32679]: pgmap v10578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:33:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:00 smithi156 ceph-mon[32679]: pgmap v10579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:02 smithi189 ceph-mon[32756]: pgmap v10580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:02.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:02 smithi156 ceph-mon[32679]: pgmap v10580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:02 smithi092 ceph-mon[29156]: pgmap v10580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:04.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:04 smithi189 ceph-mon[32756]: pgmap v10581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:04.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18879.623023 secs 2024-04-26T23:33:04.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18182.593252 secs 2024-04-26T23:33:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:04 smithi156 ceph-mon[32679]: pgmap v10581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18879.623023 secs 2024-04-26T23:33:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18182.593252 secs 2024-04-26T23:33:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:04 smithi092 ceph-mon[29156]: pgmap v10581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18879.623023 secs 2024-04-26T23:33:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18182.593252 secs 2024-04-26T23:33:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:06 smithi189 ceph-mon[32756]: pgmap v10582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:06.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:06 smithi156 ceph-mon[32679]: pgmap v10582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:06 smithi092 ceph-mon[29156]: pgmap v10582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:33:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:08 smithi189 ceph-mon[32756]: pgmap v10583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:08 smithi156 ceph-mon[32679]: pgmap v10583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:08 smithi092 ceph-mon[29156]: pgmap v10583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:33:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18884.623146 secs 2024-04-26T23:33:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18187.593310 secs 2024-04-26T23:33:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18884.623146 secs 2024-04-26T23:33:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18187.593310 secs 2024-04-26T23:33:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18884.623146 secs 2024-04-26T23:33:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18187.593310 secs 2024-04-26T23:33:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:10 smithi189 ceph-mon[32756]: pgmap v10584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:33:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:10 smithi156 ceph-mon[32679]: pgmap v10584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:33:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:10 smithi092 ceph-mon[29156]: pgmap v10584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:33:12.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:12 smithi189 ceph-mon[32756]: pgmap v10585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:12 smithi156 ceph-mon[32679]: pgmap v10585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:12 smithi092 ceph-mon[29156]: pgmap v10585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:14 smithi189 ceph-mon[32756]: pgmap v10586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18889.623261 secs 2024-04-26T23:33:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18192.593446 secs 2024-04-26T23:33:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:14 smithi156 ceph-mon[32679]: pgmap v10586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18889.623261 secs 2024-04-26T23:33:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18192.593446 secs 2024-04-26T23:33:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:14 smithi092 ceph-mon[29156]: pgmap v10586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18889.623261 secs 2024-04-26T23:33:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18192.593446 secs 2024-04-26T23:33:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:16 smithi189 ceph-mon[32756]: pgmap v10587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:16 smithi156 ceph-mon[32679]: pgmap v10587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:16 smithi092 ceph-mon[29156]: pgmap v10587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:18 smithi189 ceph-mon[32756]: pgmap v10588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:18 smithi156 ceph-mon[32679]: pgmap v10588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:18 smithi092 ceph-mon[29156]: pgmap v10588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18894.623401 secs 2024-04-26T23:33:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18197.593525 secs 2024-04-26T23:33:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18894.623401 secs 2024-04-26T23:33:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18197.593525 secs 2024-04-26T23:33:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18894.623401 secs 2024-04-26T23:33:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18197.593525 secs 2024-04-26T23:33:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:20 smithi189 ceph-mon[32756]: pgmap v10589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:20 smithi156 ceph-mon[32679]: pgmap v10589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:20 smithi092 ceph-mon[29156]: pgmap v10589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:22 smithi189 ceph-mon[32756]: pgmap v10590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:22 smithi156 ceph-mon[32679]: pgmap v10590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:22 smithi092 ceph-mon[29156]: pgmap v10590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:24 smithi189 ceph-mon[32756]: pgmap v10591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18899.623515 secs 2024-04-26T23:33:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18202.593616 secs 2024-04-26T23:33:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:24 smithi156 ceph-mon[32679]: pgmap v10591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18899.623515 secs 2024-04-26T23:33:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18202.593616 secs 2024-04-26T23:33:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:24 smithi092 ceph-mon[29156]: pgmap v10591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18899.623515 secs 2024-04-26T23:33:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18202.593616 secs 2024-04-26T23:33:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:26 smithi189 ceph-mon[32756]: pgmap v10592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:26 smithi156 ceph-mon[32679]: pgmap v10592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:26 smithi092 ceph-mon[29156]: pgmap v10592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:28 smithi156 ceph-mon[32679]: pgmap v10593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:28 smithi092 ceph-mon[29156]: pgmap v10593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:28 smithi189 ceph-mon[32756]: pgmap v10593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:29.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18904.623637 secs 2024-04-26T23:33:29.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18207.593692 secs 2024-04-26T23:33:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18904.623637 secs 2024-04-26T23:33:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18207.593692 secs 2024-04-26T23:33:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18904.623637 secs 2024-04-26T23:33:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18207.593692 secs 2024-04-26T23:33:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:30 smithi156 ceph-mon[32679]: pgmap v10594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:30 smithi092 ceph-mon[29156]: pgmap v10594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:30 smithi189 ceph-mon[32756]: pgmap v10594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:32 smithi156 ceph-mon[32679]: pgmap v10595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:32 smithi092 ceph-mon[29156]: pgmap v10595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:32 smithi189 ceph-mon[32756]: pgmap v10595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:34 smithi156 ceph-mon[32679]: pgmap v10596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18909.623772 secs 2024-04-26T23:33:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18212.593765 secs 2024-04-26T23:33:34.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:34 smithi189 ceph-mon[32756]: pgmap v10596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:34.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18909.623772 secs 2024-04-26T23:33:34.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18212.593765 secs 2024-04-26T23:33:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:34 smithi092 ceph-mon[29156]: pgmap v10596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18909.623772 secs 2024-04-26T23:33:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18212.593765 secs 2024-04-26T23:33:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000822) for more than 900000000 us, fault. 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca808a050 comp rx=0 tx=0).stop 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.019+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0070 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:33:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:33:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:33:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:33:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=19 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T23:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:36.050+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T23:33:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:36 smithi156 ceph-mon[32679]: pgmap v10597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:36 smithi092 ceph-mon[29156]: pgmap v10597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:36 smithi189 ceph-mon[32756]: pgmap v10597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:38.575+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:33:38.578 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:38.575+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:33:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:38.579+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:33:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:33:38.579+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 148 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:33:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:38 smithi156 ceph-mon[32679]: pgmap v10598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:38 smithi092 ceph-mon[29156]: pgmap v10598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:38 smithi189 ceph-mon[32756]: pgmap v10598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:39 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 18914.623896 secs 2024-04-26T23:33:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:39 smithi156 ceph-mon[32679]: slow request 1443.140891 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:33:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18217.593883 secs 2024-04-26T23:33:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:39 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 18914.623896 secs 2024-04-26T23:33:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:39 smithi092 ceph-mon[29156]: slow request 1443.140891 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:33:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18217.593883 secs 2024-04-26T23:33:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:39 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 18914.623896 secs 2024-04-26T23:33:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:39 smithi189 ceph-mon[32756]: slow request 1443.140891 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:33:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18217.593883 secs 2024-04-26T23:33:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:40 smithi156 ceph-mon[32679]: pgmap v10599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:40 smithi092 ceph-mon[29156]: pgmap v10599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:40 smithi189 ceph-mon[32756]: pgmap v10599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:42 smithi156 ceph-mon[32679]: pgmap v10600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:42 smithi092 ceph-mon[29156]: pgmap v10600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:42 smithi189 ceph-mon[32756]: pgmap v10600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:44 smithi156 ceph-mon[32679]: pgmap v10601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18919.623961 secs 2024-04-26T23:33:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18222.594000 secs 2024-04-26T23:33:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:44 smithi092 ceph-mon[29156]: pgmap v10601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18919.623961 secs 2024-04-26T23:33:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18222.594000 secs 2024-04-26T23:33:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:44 smithi189 ceph-mon[32756]: pgmap v10601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18919.623961 secs 2024-04-26T23:33:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18222.594000 secs 2024-04-26T23:33:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:46 smithi156 ceph-mon[32679]: pgmap v10602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:46 smithi092 ceph-mon[29156]: pgmap v10602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:46 smithi189 ceph-mon[32756]: pgmap v10602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:48 smithi156 ceph-mon[32679]: pgmap v10603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:48 smithi092 ceph-mon[29156]: pgmap v10603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:48 smithi189 ceph-mon[32756]: pgmap v10603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18924.624036 secs 2024-04-26T23:33:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18227.594131 secs 2024-04-26T23:33:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18924.624036 secs 2024-04-26T23:33:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18227.594131 secs 2024-04-26T23:33:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18924.624036 secs 2024-04-26T23:33:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18227.594131 secs 2024-04-26T23:33:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:50 smithi092 ceph-mon[29156]: pgmap v10604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:50 smithi189 ceph-mon[32756]: pgmap v10604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:50 smithi156 ceph-mon[32679]: pgmap v10604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:52 smithi092 ceph-mon[29156]: pgmap v10605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:52 smithi189 ceph-mon[32756]: pgmap v10605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:52 smithi156 ceph-mon[32679]: pgmap v10605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:54 smithi092 ceph-mon[29156]: pgmap v10606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18929.624156 secs 2024-04-26T23:33:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18232.594233 secs 2024-04-26T23:33:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:54 smithi189 ceph-mon[32756]: pgmap v10606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18929.624156 secs 2024-04-26T23:33:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18232.594233 secs 2024-04-26T23:33:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:54 smithi156 ceph-mon[32679]: pgmap v10606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18929.624156 secs 2024-04-26T23:33:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18232.594233 secs 2024-04-26T23:33:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:56 smithi092 ceph-mon[29156]: pgmap v10607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:56 smithi189 ceph-mon[32756]: pgmap v10607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:56 smithi156 ceph-mon[32679]: pgmap v10607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:33:58.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:58 smithi092 ceph-mon[29156]: pgmap v10608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:58 smithi189 ceph-mon[32756]: pgmap v10608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:58 smithi156 ceph-mon[32679]: pgmap v10608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:33:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18934.624271 secs 2024-04-26T23:33:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18237.594356 secs 2024-04-26T23:33:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:33:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:33:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18934.624271 secs 2024-04-26T23:33:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18237.594356 secs 2024-04-26T23:33:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:33:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:33:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18934.624271 secs 2024-04-26T23:33:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18237.594356 secs 2024-04-26T23:33:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:33:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:34:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:00 smithi092 ceph-mon[29156]: pgmap v10609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:34:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:34:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:34:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:00 smithi189 ceph-mon[32756]: pgmap v10609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:34:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:34:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:34:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:00 smithi156 ceph-mon[32679]: pgmap v10609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:34:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:34:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:34:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:01 smithi092 ceph-mon[29156]: pgmap v10610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:34:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:01 smithi092 ceph-mon[29156]: pgmap v10611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:01 smithi189 ceph-mon[32756]: pgmap v10610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:34:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:01 smithi189 ceph-mon[32756]: pgmap v10611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:01 smithi156 ceph-mon[32679]: pgmap v10610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:34:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:01 smithi156 ceph-mon[32679]: pgmap v10611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:03 smithi092 ceph-mon[29156]: pgmap v10612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:03 smithi189 ceph-mon[32756]: pgmap v10612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:03 smithi156 ceph-mon[32679]: pgmap v10612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18939.624345 secs 2024-04-26T23:34:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 18242.594470 secs 2024-04-26T23:34:04.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18939.624345 secs 2024-04-26T23:34:04.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 18242.594470 secs 2024-04-26T23:34:04.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18939.624345 secs 2024-04-26T23:34:04.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 18242.594470 secs 2024-04-26T23:34:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:05 smithi092 ceph-mon[29156]: pgmap v10613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:05 smithi189 ceph-mon[32756]: pgmap v10613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:05 smithi156 ceph-mon[32679]: pgmap v10613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:07 smithi092 ceph-mon[29156]: pgmap v10614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:07 smithi189 ceph-mon[32756]: pgmap v10614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:07 smithi156 ceph-mon[32679]: pgmap v10614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:34:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:09 smithi092 ceph-mon[29156]: pgmap v10615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:34:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18944.624461 secs 2024-04-26T23:34:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:09 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 18247.594522 secs 2024-04-26T23:34:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:09 smithi092 ceph-mon[29156]: slow request 183.014070 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:34:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:09 smithi189 ceph-mon[32756]: pgmap v10615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:34:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18944.624461 secs 2024-04-26T23:34:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:09 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 18247.594522 secs 2024-04-26T23:34:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:09 smithi189 ceph-mon[32756]: slow request 183.014070 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:34:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:09 smithi156 ceph-mon[32679]: pgmap v10615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:34:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18944.624461 secs 2024-04-26T23:34:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:09 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 18247.594522 secs 2024-04-26T23:34:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:09 smithi156 ceph-mon[32679]: slow request 183.014070 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:34:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:11 smithi092 ceph-mon[29156]: pgmap v10616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:34:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:11 smithi189 ceph-mon[32756]: pgmap v10616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:34:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:11 smithi156 ceph-mon[32679]: pgmap v10616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:34:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:13 smithi092 ceph-mon[29156]: pgmap v10617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:34:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:34:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:13 smithi189 ceph-mon[32756]: pgmap v10617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:34:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:34:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:13 smithi156 ceph-mon[32679]: pgmap v10617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:34:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:34:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18949.624579 secs 2024-04-26T23:34:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18252.594646 secs 2024-04-26T23:34:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18949.624579 secs 2024-04-26T23:34:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18252.594646 secs 2024-04-26T23:34:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18949.624579 secs 2024-04-26T23:34:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18252.594646 secs 2024-04-26T23:34:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:15 smithi189 ceph-mon[32756]: pgmap v10618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:15 smithi156 ceph-mon[32679]: pgmap v10618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:15 smithi092 ceph-mon[29156]: pgmap v10618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:17 smithi189 ceph-mon[32756]: pgmap v10619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:17 smithi156 ceph-mon[32679]: pgmap v10619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:17.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:17 smithi092 ceph-mon[29156]: pgmap v10619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:19 smithi189 ceph-mon[32756]: pgmap v10620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18954.624719 secs 2024-04-26T23:34:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18257.594772 secs 2024-04-26T23:34:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:19 smithi156 ceph-mon[32679]: pgmap v10620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18954.624719 secs 2024-04-26T23:34:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18257.594772 secs 2024-04-26T23:34:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:19 smithi092 ceph-mon[29156]: pgmap v10620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18954.624719 secs 2024-04-26T23:34:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18257.594772 secs 2024-04-26T23:34:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:21 smithi189 ceph-mon[32756]: pgmap v10621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:21 smithi156 ceph-mon[32679]: pgmap v10621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:21 smithi092 ceph-mon[29156]: pgmap v10621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:23 smithi189 ceph-mon[32756]: pgmap v10622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:23 smithi156 ceph-mon[32679]: pgmap v10622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:23.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:23 smithi092 ceph-mon[29156]: pgmap v10622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18959.624853 secs 2024-04-26T23:34:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18262.594864 secs 2024-04-26T23:34:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18959.624853 secs 2024-04-26T23:34:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18262.594864 secs 2024-04-26T23:34:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18959.624853 secs 2024-04-26T23:34:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18262.594864 secs 2024-04-26T23:34:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:25 smithi189 ceph-mon[32756]: pgmap v10623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:25 smithi156 ceph-mon[32679]: pgmap v10623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:25 smithi092 ceph-mon[29156]: pgmap v10623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:27.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:27 smithi189 ceph-mon[32756]: pgmap v10624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:27 smithi156 ceph-mon[32679]: pgmap v10624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:27.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:27 smithi092 ceph-mon[29156]: pgmap v10624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:29 smithi189 ceph-mon[32756]: pgmap v10625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18964.624968 secs 2024-04-26T23:34:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18267.594975 secs 2024-04-26T23:34:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:29 smithi156 ceph-mon[32679]: pgmap v10625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18964.624968 secs 2024-04-26T23:34:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18267.594975 secs 2024-04-26T23:34:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:29 smithi092 ceph-mon[29156]: pgmap v10625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18964.624968 secs 2024-04-26T23:34:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18267.594975 secs 2024-04-26T23:34:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:30 smithi189 ceph-mon[32756]: pgmap v10626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:30 smithi156 ceph-mon[32679]: pgmap v10626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:30 smithi092 ceph-mon[29156]: pgmap v10626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:33.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:33 smithi156 ceph-mon[32679]: pgmap v10627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:33 smithi092 ceph-mon[29156]: pgmap v10627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:33 smithi189 ceph-mon[32756]: pgmap v10627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:34.340 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18969.625088 secs 2024-04-26T23:34:34.340 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18272.595116 secs 2024-04-26T23:34:34.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18969.625088 secs 2024-04-26T23:34:34.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18272.595116 secs 2024-04-26T23:34:34.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18969.625088 secs 2024-04-26T23:34:34.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18272.595116 secs 2024-04-26T23:34:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:35 smithi156 ceph-mon[32679]: pgmap v10628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:35 smithi092 ceph-mon[29156]: pgmap v10628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:35 smithi189 ceph-mon[32756]: pgmap v10628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:37.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:37 smithi156 ceph-mon[32679]: pgmap v10629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:37.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:37 smithi092 ceph-mon[29156]: pgmap v10629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:37 smithi189 ceph-mon[32756]: pgmap v10629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:39 smithi156 ceph-mon[32679]: pgmap v10630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18974.625220 secs 2024-04-26T23:34:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18277.595238 secs 2024-04-26T23:34:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:39 smithi092 ceph-mon[29156]: pgmap v10630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18974.625220 secs 2024-04-26T23:34:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18277.595238 secs 2024-04-26T23:34:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:39 smithi189 ceph-mon[32756]: pgmap v10630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18974.625220 secs 2024-04-26T23:34:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18277.595238 secs 2024-04-26T23:34:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:41 smithi156 ceph-mon[32679]: pgmap v10631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:41.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:41 smithi092 ceph-mon[29156]: pgmap v10631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:41.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:41 smithi189 ceph-mon[32756]: pgmap v10631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:43.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:43 smithi156 ceph-mon[32679]: pgmap v10632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:43 smithi092 ceph-mon[29156]: pgmap v10632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:43 smithi189 ceph-mon[32756]: pgmap v10632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18979.625348 secs 2024-04-26T23:34:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18282.595355 secs 2024-04-26T23:34:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18979.625348 secs 2024-04-26T23:34:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18282.595355 secs 2024-04-26T23:34:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18979.625348 secs 2024-04-26T23:34:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18282.595355 secs 2024-04-26T23:34:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:45 smithi156 ceph-mon[32679]: pgmap v10633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:45 smithi092 ceph-mon[29156]: pgmap v10633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:45 smithi189 ceph-mon[32756]: pgmap v10633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:47 smithi156 ceph-mon[32679]: pgmap v10634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:47.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:47 smithi092 ceph-mon[29156]: pgmap v10634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:47 smithi189 ceph-mon[32756]: pgmap v10634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:49 smithi092 ceph-mon[29156]: pgmap v10635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18984.625482 secs 2024-04-26T23:34:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18287.595469 secs 2024-04-26T23:34:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:49 smithi189 ceph-mon[32756]: pgmap v10635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18984.625482 secs 2024-04-26T23:34:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18287.595469 secs 2024-04-26T23:34:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:49 smithi156 ceph-mon[32679]: pgmap v10635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18984.625482 secs 2024-04-26T23:34:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18287.595469 secs 2024-04-26T23:34:51.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:51 smithi092 ceph-mon[29156]: pgmap v10636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:51 smithi189 ceph-mon[32756]: pgmap v10636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:51 smithi156 ceph-mon[32679]: pgmap v10636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:53.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:53 smithi092 ceph-mon[29156]: pgmap v10637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:53 smithi189 ceph-mon[32756]: pgmap v10637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:53 smithi156 ceph-mon[32679]: pgmap v10637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18989.625555 secs 2024-04-26T23:34:55.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18292.595598 secs 2024-04-26T23:34:55.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:54 smithi156 ceph-mon[32679]: pgmap v10638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18989.625555 secs 2024-04-26T23:34:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18292.595598 secs 2024-04-26T23:34:55.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:54 smithi092 ceph-mon[29156]: pgmap v10638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18989.625555 secs 2024-04-26T23:34:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18292.595598 secs 2024-04-26T23:34:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:54 smithi189 ceph-mon[32756]: pgmap v10638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:34:57.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:57 smithi156 ceph-mon[32679]: pgmap v10639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:57.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:57 smithi092 ceph-mon[29156]: pgmap v10639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:57.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:57 smithi189 ceph-mon[32756]: pgmap v10639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:59 smithi156 ceph-mon[32679]: pgmap v10640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18994.625695 secs 2024-04-26T23:34:59.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:34:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18297.595719 secs 2024-04-26T23:34:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:59 smithi092 ceph-mon[29156]: pgmap v10640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18994.625695 secs 2024-04-26T23:34:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:34:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18297.595719 secs 2024-04-26T23:34:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:59 smithi189 ceph-mon[32756]: pgmap v10640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:34:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18994.625695 secs 2024-04-26T23:34:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:34:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18297.595719 secs 2024-04-26T23:35:01.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:01 smithi156 ceph-mon[32679]: pgmap v10641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:35:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:35:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:35:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:35:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:01 smithi092 ceph-mon[29156]: pgmap v10641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:35:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:35:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:35:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:35:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:01 smithi189 ceph-mon[32756]: pgmap v10641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:35:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:35:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:35:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:35:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:02 smithi156 ceph-mon[32679]: pgmap v10642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:35:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:02 smithi156 ceph-mon[32679]: pgmap v10643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:02 smithi092 ceph-mon[29156]: pgmap v10642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:35:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:02 smithi092 ceph-mon[29156]: pgmap v10643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:02 smithi189 ceph-mon[32756]: pgmap v10642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:35:02.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:02 smithi189 ceph-mon[32756]: pgmap v10643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:04 smithi156 ceph-mon[32679]: pgmap v10644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:35:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 18999.625806 secs 2024-04-26T23:35:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18302.595796 secs 2024-04-26T23:35:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:04 smithi189 ceph-mon[32756]: pgmap v10644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:35:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 18999.625806 secs 2024-04-26T23:35:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18302.595796 secs 2024-04-26T23:35:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:04 smithi092 ceph-mon[29156]: pgmap v10644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:35:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 18999.625806 secs 2024-04-26T23:35:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18302.595796 secs 2024-04-26T23:35:06.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:06 smithi156 ceph-mon[32679]: pgmap v10645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:06.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:06 smithi092 ceph-mon[29156]: pgmap v10645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:06 smithi189 ceph-mon[32756]: pgmap v10645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:08.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:08 smithi156 ceph-mon[32679]: pgmap v10646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:08.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:08 smithi092 ceph-mon[29156]: pgmap v10646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:08 smithi189 ceph-mon[32756]: pgmap v10646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19004.625923 secs 2024-04-26T23:35:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18307.595906 secs 2024-04-26T23:35:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19004.625923 secs 2024-04-26T23:35:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18307.595906 secs 2024-04-26T23:35:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19004.625923 secs 2024-04-26T23:35:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18307.595906 secs 2024-04-26T23:35:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:10 smithi156 ceph-mon[32679]: pgmap v10647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:10 smithi092 ceph-mon[29156]: pgmap v10647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:10 smithi189 ceph-mon[32756]: pgmap v10647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:35:12.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:12 smithi156 ceph-mon[32679]: pgmap v10648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:35:12.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:12 smithi092 ceph-mon[29156]: pgmap v10648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:35:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:12 smithi189 ceph-mon[32756]: pgmap v10648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:35:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:14 smithi092 ceph-mon[29156]: pgmap v10649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19009.626007 secs 2024-04-26T23:35:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18312.596048 secs 2024-04-26T23:35:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:14 smithi189 ceph-mon[32756]: pgmap v10649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19009.626007 secs 2024-04-26T23:35:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18312.596048 secs 2024-04-26T23:35:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:14 smithi156 ceph-mon[32679]: pgmap v10649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19009.626007 secs 2024-04-26T23:35:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18312.596048 secs 2024-04-26T23:35:16.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:16 smithi092 ceph-mon[29156]: pgmap v10650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:16 smithi189 ceph-mon[32756]: pgmap v10650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:16 smithi156 ceph-mon[32679]: pgmap v10650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:18.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:18 smithi092 ceph-mon[29156]: pgmap v10651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:18 smithi189 ceph-mon[32756]: pgmap v10651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:18 smithi156 ceph-mon[32679]: pgmap v10651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19014.626127 secs 2024-04-26T23:35:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18317.596169 secs 2024-04-26T23:35:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19014.626127 secs 2024-04-26T23:35:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18317.596169 secs 2024-04-26T23:35:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19014.626127 secs 2024-04-26T23:35:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18317.596169 secs 2024-04-26T23:35:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:20 smithi092 ceph-mon[29156]: pgmap v10652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:20 smithi189 ceph-mon[32756]: pgmap v10652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:20 smithi156 ceph-mon[32679]: pgmap v10652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:22.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:22 smithi092 ceph-mon[29156]: pgmap v10653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:22.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:22 smithi189 ceph-mon[32756]: pgmap v10653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:22 smithi156 ceph-mon[32679]: pgmap v10653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:24.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:24 smithi092 ceph-mon[29156]: pgmap v10654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:24.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19019.626251 secs 2024-04-26T23:35:24.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18322.596288 secs 2024-04-26T23:35:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:24 smithi189 ceph-mon[32756]: pgmap v10654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19019.626251 secs 2024-04-26T23:35:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18322.596288 secs 2024-04-26T23:35:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:24 smithi156 ceph-mon[32679]: pgmap v10654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19019.626251 secs 2024-04-26T23:35:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18322.596288 secs 2024-04-26T23:35:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:26 smithi092 ceph-mon[29156]: pgmap v10655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:26 smithi189 ceph-mon[32756]: pgmap v10655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:26 smithi156 ceph-mon[32679]: pgmap v10655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:28.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:28 smithi092 ceph-mon[29156]: pgmap v10656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:28 smithi189 ceph-mon[32756]: pgmap v10656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:28 smithi156 ceph-mon[32679]: pgmap v10656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19024.626331 secs 2024-04-26T23:35:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18327.596313 secs 2024-04-26T23:35:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19024.626331 secs 2024-04-26T23:35:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18327.596313 secs 2024-04-26T23:35:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19024.626331 secs 2024-04-26T23:35:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18327.596313 secs 2024-04-26T23:35:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:30 smithi092 ceph-mon[29156]: pgmap v10657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:30 smithi189 ceph-mon[32756]: pgmap v10657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:30 smithi156 ceph-mon[32679]: pgmap v10657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:32.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:32 smithi092 ceph-mon[29156]: pgmap v10658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:32 smithi189 ceph-mon[32756]: pgmap v10658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:32 smithi156 ceph-mon[32679]: pgmap v10658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:34.488 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:34 smithi156 ceph-mon[32679]: pgmap v10659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:34.488 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19029.626392 secs 2024-04-26T23:35:34.488 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18332.596431 secs 2024-04-26T23:35:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:34 smithi092 ceph-mon[29156]: pgmap v10659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19029.626392 secs 2024-04-26T23:35:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18332.596431 secs 2024-04-26T23:35:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:34 smithi189 ceph-mon[32756]: pgmap v10659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19029.626392 secs 2024-04-26T23:35:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18332.596431 secs 2024-04-26T23:35:36.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:36 smithi092 ceph-mon[29156]: pgmap v10660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:36.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:36 smithi189 ceph-mon[32756]: pgmap v10660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:36 smithi156 ceph-mon[32679]: pgmap v10660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:38 smithi092 ceph-mon[29156]: pgmap v10661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:38.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:38 smithi189 ceph-mon[32756]: pgmap v10661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:38 smithi156 ceph-mon[32679]: pgmap v10661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19034.626537 secs 2024-04-26T23:35:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18337.596542 secs 2024-04-26T23:35:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19034.626537 secs 2024-04-26T23:35:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18337.596542 secs 2024-04-26T23:35:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19034.626537 secs 2024-04-26T23:35:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18337.596542 secs 2024-04-26T23:35:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:40 smithi189 ceph-mon[32756]: pgmap v10662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:40 smithi156 ceph-mon[32679]: pgmap v10662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:40 smithi092 ceph-mon[29156]: pgmap v10662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:42.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:42 smithi189 ceph-mon[32756]: pgmap v10663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:42 smithi156 ceph-mon[32679]: pgmap v10663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:42 smithi092 ceph-mon[29156]: pgmap v10663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:44 smithi189 ceph-mon[32756]: pgmap v10664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19039.626692 secs 2024-04-26T23:35:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18342.596649 secs 2024-04-26T23:35:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:44 smithi156 ceph-mon[32679]: pgmap v10664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19039.626692 secs 2024-04-26T23:35:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18342.596649 secs 2024-04-26T23:35:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:44 smithi092 ceph-mon[29156]: pgmap v10664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19039.626692 secs 2024-04-26T23:35:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18342.596649 secs 2024-04-26T23:35:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:46 smithi189 ceph-mon[32756]: pgmap v10665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:46 smithi156 ceph-mon[32679]: pgmap v10665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:46 smithi092 ceph-mon[29156]: pgmap v10665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:48.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:48 smithi189 ceph-mon[32756]: pgmap v10666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:48 smithi156 ceph-mon[32679]: pgmap v10666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:48 smithi092 ceph-mon[29156]: pgmap v10666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19044.626841 secs 2024-04-26T23:35:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18347.596721 secs 2024-04-26T23:35:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:49 smithi156 ceph-mon[32679]: pgmap v10667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19044.626841 secs 2024-04-26T23:35:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18347.596721 secs 2024-04-26T23:35:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:49 smithi092 ceph-mon[29156]: pgmap v10667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19044.626841 secs 2024-04-26T23:35:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18347.596721 secs 2024-04-26T23:35:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:49 smithi189 ceph-mon[32756]: pgmap v10667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:52.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:51 smithi092 ceph-mon[29156]: pgmap v10668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:52.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:51 smithi189 ceph-mon[32756]: pgmap v10668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:52.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:51 smithi156 ceph-mon[32679]: pgmap v10668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:53 smithi092 ceph-mon[29156]: pgmap v10669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:54.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:53 smithi189 ceph-mon[32756]: pgmap v10669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:53 smithi156 ceph-mon[32679]: pgmap v10669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19049.626944 secs 2024-04-26T23:35:55.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18352.596804 secs 2024-04-26T23:35:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19049.626944 secs 2024-04-26T23:35:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18352.596804 secs 2024-04-26T23:35:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19049.626944 secs 2024-04-26T23:35:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18352.596804 secs 2024-04-26T23:35:56.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:55 smithi092 ceph-mon[29156]: pgmap v10670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:56.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:55 smithi189 ceph-mon[32756]: pgmap v10670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:56.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:55 smithi156 ceph-mon[32679]: pgmap v10670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:35:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:57 smithi092 ceph-mon[29156]: pgmap v10671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:58.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:57 smithi189 ceph-mon[32756]: pgmap v10671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:35:58.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:57 smithi156 ceph-mon[32679]: pgmap v10671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19054.627067 secs 2024-04-26T23:36:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18357.596924 secs 2024-04-26T23:36:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:35:59 smithi092 ceph-mon[29156]: pgmap v10672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19054.627067 secs 2024-04-26T23:36:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18357.596924 secs 2024-04-26T23:36:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:35:59 smithi189 ceph-mon[32756]: pgmap v10672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19054.627067 secs 2024-04-26T23:36:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18357.596924 secs 2024-04-26T23:36:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:35:59 smithi156 ceph-mon[32679]: pgmap v10672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:02.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:01 smithi092 ceph-mon[29156]: pgmap v10673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:02.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:36:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:36:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:36:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:36:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:01 smithi189 ceph-mon[32756]: pgmap v10673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:36:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:36:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:36:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:36:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:01 smithi156 ceph-mon[32679]: pgmap v10673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:36:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:36:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:36:02.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:36:03.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:02 smithi092 ceph-mon[29156]: pgmap v10674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:36:03.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:02 smithi092 ceph-mon[29156]: pgmap v10675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:03.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:02 smithi189 ceph-mon[32756]: pgmap v10674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:36:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:02 smithi189 ceph-mon[32756]: pgmap v10675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:03.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:02 smithi156 ceph-mon[32679]: pgmap v10674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:36:03.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:02 smithi156 ceph-mon[32679]: pgmap v10675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:05.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19059.627186 secs 2024-04-26T23:36:05.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:04 smithi156 ceph-mon[32679]: pgmap v10676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:05.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18362.597058 secs 2024-04-26T23:36:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19059.627186 secs 2024-04-26T23:36:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:04 smithi092 ceph-mon[29156]: pgmap v10676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18362.597058 secs 2024-04-26T23:36:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19059.627186 secs 2024-04-26T23:36:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:04 smithi189 ceph-mon[32756]: pgmap v10676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18362.597058 secs 2024-04-26T23:36:06.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:36:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:36:05.824+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:36:06.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:36:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:36:05.824+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:36:06.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:36:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:36:05.824+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:36:06.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:36:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:36:05.824+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:36:06.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:36:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:36:05.824+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:36:07.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:06 smithi092 ceph-mon[29156]: pgmap v10677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:07.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:06 smithi189 ceph-mon[32756]: pgmap v10677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:07.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:06 smithi156 ceph-mon[32679]: pgmap v10677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:36:09.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:08 smithi092 ceph-mon[29156]: pgmap v10678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:36:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:08 smithi189 ceph-mon[32756]: pgmap v10678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:36:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:08 smithi156 ceph-mon[32679]: pgmap v10678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:36:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19064.627266 secs 2024-04-26T23:36:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18367.597229 secs 2024-04-26T23:36:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19064.627266 secs 2024-04-26T23:36:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18367.597229 secs 2024-04-26T23:36:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19064.627266 secs 2024-04-26T23:36:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18367.597229 secs 2024-04-26T23:36:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:10 smithi092 ceph-mon[29156]: pgmap v10679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 584 B/s wr, 20 op/s 2024-04-26T23:36:11.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:10 smithi189 ceph-mon[32756]: pgmap v10679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 584 B/s wr, 20 op/s 2024-04-26T23:36:11.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:10 smithi156 ceph-mon[32679]: pgmap v10679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 584 B/s wr, 20 op/s 2024-04-26T23:36:13.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:12 smithi092 ceph-mon[29156]: pgmap v10680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T23:36:13.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:12 smithi189 ceph-mon[32756]: pgmap v10680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T23:36:13.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:12 smithi156 ceph-mon[32679]: pgmap v10680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 511 B/s wr, 18 op/s 2024-04-26T23:36:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19069.627407 secs 2024-04-26T23:36:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:14 smithi092 ceph-mon[29156]: pgmap v10681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:15.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18372.597348 secs 2024-04-26T23:36:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19069.627407 secs 2024-04-26T23:36:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:14 smithi189 ceph-mon[32756]: pgmap v10681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18372.597348 secs 2024-04-26T23:36:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19069.627407 secs 2024-04-26T23:36:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:14 smithi156 ceph-mon[32679]: pgmap v10681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18372.597348 secs 2024-04-26T23:36:17.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:16 smithi092 ceph-mon[29156]: pgmap v10682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:17.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:16 smithi189 ceph-mon[32756]: pgmap v10682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:17.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:16 smithi156 ceph-mon[32679]: pgmap v10682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:19.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:18 smithi189 ceph-mon[32756]: pgmap v10683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:18 smithi156 ceph-mon[32679]: pgmap v10683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:18 smithi092 ceph-mon[29156]: pgmap v10683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-26T23:36:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:20 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19074.627524 secs 2024-04-26T23:36:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18377.597464 secs 2024-04-26T23:36:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:20 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19074.627524 secs 2024-04-26T23:36:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18377.597464 secs 2024-04-26T23:36:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:20 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19074.627524 secs 2024-04-26T23:36:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18377.597464 secs 2024-04-26T23:36:21.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:21 smithi189 ceph-mon[32756]: pgmap v10684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:21.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:21 smithi156 ceph-mon[32679]: pgmap v10684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:21.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:21 smithi092 ceph-mon[29156]: pgmap v10684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-26T23:36:23.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:23 smithi189 ceph-mon[32756]: pgmap v10685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:23.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:23 smithi156 ceph-mon[32679]: pgmap v10685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:23.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:23 smithi092 ceph-mon[29156]: pgmap v10685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19079.627653 secs 2024-04-26T23:36:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:25 smithi189 ceph-mon[32756]: pgmap v10686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18382.597606 secs 2024-04-26T23:36:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19079.627653 secs 2024-04-26T23:36:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:25 smithi156 ceph-mon[32679]: pgmap v10686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18382.597606 secs 2024-04-26T23:36:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19079.627653 secs 2024-04-26T23:36:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:25 smithi092 ceph-mon[29156]: pgmap v10686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18382.597606 secs 2024-04-26T23:36:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:27 smithi189 ceph-mon[32756]: pgmap v10687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:27 smithi156 ceph-mon[32679]: pgmap v10687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:27 smithi092 ceph-mon[29156]: pgmap v10687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:29.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:29 smithi189 ceph-mon[32756]: pgmap v10688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:29 smithi156 ceph-mon[32679]: pgmap v10688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:29 smithi092 ceph-mon[29156]: pgmap v10688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19084.627771 secs 2024-04-26T23:36:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18387.597729 secs 2024-04-26T23:36:30.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19084.627771 secs 2024-04-26T23:36:30.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18387.597729 secs 2024-04-26T23:36:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19084.627771 secs 2024-04-26T23:36:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18387.597729 secs 2024-04-26T23:36:31.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:31 smithi189 ceph-mon[32756]: pgmap v10689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:31.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:31 smithi156 ceph-mon[32679]: pgmap v10689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:31.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:31 smithi092 ceph-mon[29156]: pgmap v10689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:33.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:33 smithi189 ceph-mon[32756]: pgmap v10690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:33.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:33 smithi156 ceph-mon[32679]: pgmap v10690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:33 smithi092 ceph-mon[29156]: pgmap v10690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19089.627893 secs 2024-04-26T23:36:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:35 smithi189 ceph-mon[32756]: pgmap v10691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18392.597843 secs 2024-04-26T23:36:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19089.627893 secs 2024-04-26T23:36:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:35 smithi156 ceph-mon[32679]: pgmap v10691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18392.597843 secs 2024-04-26T23:36:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19089.627893 secs 2024-04-26T23:36:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:35 smithi092 ceph-mon[29156]: pgmap v10691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18392.597843 secs 2024-04-26T23:36:37.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:37 smithi189 ceph-mon[32756]: pgmap v10692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:37.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:37 smithi156 ceph-mon[32679]: pgmap v10692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:37.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:37 smithi092 ceph-mon[29156]: pgmap v10692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:36:38.599+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:36:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:36:38.600+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:36:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:36:38.602+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:36:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:36:38.602+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 149 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:36:39.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:39 smithi189 ceph-mon[32756]: pgmap v10693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:39 smithi156 ceph-mon[32679]: pgmap v10693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:39 smithi092 ceph-mon[29156]: pgmap v10693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19094.627968 secs 2024-04-26T23:36:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18397.597954 secs 2024-04-26T23:36:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19094.627968 secs 2024-04-26T23:36:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18397.597954 secs 2024-04-26T23:36:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19094.627968 secs 2024-04-26T23:36:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18397.597954 secs 2024-04-26T23:36:41.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:41 smithi189 ceph-mon[32756]: pgmap v10694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:41 smithi156 ceph-mon[32679]: pgmap v10694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:41.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:41 smithi092 ceph-mon[29156]: pgmap v10694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:43 smithi189 ceph-mon[32756]: pgmap v10695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:43.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:43 smithi156 ceph-mon[32679]: pgmap v10695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:43 smithi092 ceph-mon[29156]: pgmap v10695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19099.628109 secs 2024-04-26T23:36:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:45 smithi189 ceph-mon[32756]: pgmap v10696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18402.598041 secs 2024-04-26T23:36:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19099.628109 secs 2024-04-26T23:36:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:45 smithi156 ceph-mon[32679]: pgmap v10696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18402.598041 secs 2024-04-26T23:36:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19099.628109 secs 2024-04-26T23:36:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:45 smithi092 ceph-mon[29156]: pgmap v10696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18402.598041 secs 2024-04-26T23:36:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:47 smithi189 ceph-mon[32756]: pgmap v10697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:47 smithi156 ceph-mon[32679]: pgmap v10697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:47.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:47 smithi092 ceph-mon[29156]: pgmap v10697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:49.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:49 smithi189 ceph-mon[32756]: pgmap v10698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:49 smithi156 ceph-mon[32679]: pgmap v10698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:49 smithi092 ceph-mon[29156]: pgmap v10698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19104.628232 secs 2024-04-26T23:36:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18407.598167 secs 2024-04-26T23:36:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19104.628232 secs 2024-04-26T23:36:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18407.598167 secs 2024-04-26T23:36:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19104.628232 secs 2024-04-26T23:36:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18407.598167 secs 2024-04-26T23:36:51.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:51 smithi189 ceph-mon[32756]: pgmap v10699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:51.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:51 smithi156 ceph-mon[32679]: pgmap v10699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:51.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:51 smithi092 ceph-mon[29156]: pgmap v10699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:53.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:53 smithi189 ceph-mon[32756]: pgmap v10700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:53.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:53 smithi156 ceph-mon[32679]: pgmap v10700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:53.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:53 smithi092 ceph-mon[29156]: pgmap v10700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19109.628354 secs 2024-04-26T23:36:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:55 smithi189 ceph-mon[32756]: pgmap v10701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18412.598228 secs 2024-04-26T23:36:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19109.628354 secs 2024-04-26T23:36:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:55 smithi156 ceph-mon[32679]: pgmap v10701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18412.598228 secs 2024-04-26T23:36:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19109.628354 secs 2024-04-26T23:36:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:55 smithi092 ceph-mon[29156]: pgmap v10701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:36:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18412.598228 secs 2024-04-26T23:36:57.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:57 smithi189 ceph-mon[32756]: pgmap v10702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:57.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:57 smithi156 ceph-mon[32679]: pgmap v10702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:57.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:57 smithi092 ceph-mon[29156]: pgmap v10702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:36:59 smithi189 ceph-mon[32756]: pgmap v10703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:36:59 smithi156 ceph-mon[32679]: pgmap v10703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:36:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:36:59 smithi092 ceph-mon[29156]: pgmap v10703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:00 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19114.628482 secs 2024-04-26T23:37:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18417.598316 secs 2024-04-26T23:37:00.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:00 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19114.628482 secs 2024-04-26T23:37:00.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18417.598316 secs 2024-04-26T23:37:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:00 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19114.628482 secs 2024-04-26T23:37:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18417.598316 secs 2024-04-26T23:37:01.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:01 smithi189 ceph-mon[32756]: pgmap v10704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:01.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:01 smithi156 ceph-mon[32679]: pgmap v10704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:01.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:01 smithi092 ceph-mon[29156]: pgmap v10704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:02.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:37:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:37:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: pgmap v10705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: pgmap v10705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: pgmap v10705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:03.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:04.575 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19119.628577 secs 2024-04-26T23:37:04.576 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18422.598385 secs 2024-04-26T23:37:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19119.628577 secs 2024-04-26T23:37:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18422.598385 secs 2024-04-26T23:37:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19119.628577 secs 2024-04-26T23:37:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18422.598385 secs 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: pgmap v10706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: pgmap v10706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: pgmap v10706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:37:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:37:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:06.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:37:06.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:37:06.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:37:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:37:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:07 smithi092 ceph-mon[29156]: pgmap v10707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:37:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:07 smithi092 ceph-mon[29156]: pgmap v10708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T23:37:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:07 smithi092 ceph-mon[29156]: pgmap v10709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:07 smithi189 ceph-mon[32756]: pgmap v10707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:37:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:07 smithi189 ceph-mon[32756]: pgmap v10708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T23:37:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:07 smithi189 ceph-mon[32756]: pgmap v10709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:07 smithi156 ceph-mon[32679]: pgmap v10707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:37:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:37:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:07 smithi156 ceph-mon[32679]: pgmap v10708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-26T23:37:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:07 smithi156 ceph-mon[32679]: pgmap v10709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:09 smithi092 ceph-mon[29156]: pgmap v10710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19124.628709 secs 2024-04-26T23:37:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:09 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 18427.598514 secs 2024-04-26T23:37:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:09 smithi092 ceph-mon[29156]: slow request 363.018061 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:37:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:09 smithi189 ceph-mon[32756]: pgmap v10710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19124.628709 secs 2024-04-26T23:37:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:09 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 18427.598514 secs 2024-04-26T23:37:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:09 smithi189 ceph-mon[32756]: slow request 363.018061 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:37:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:09 smithi156 ceph-mon[32679]: pgmap v10710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:37:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19124.628709 secs 2024-04-26T23:37:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:09 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 18427.598514 secs 2024-04-26T23:37:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:09 smithi156 ceph-mon[32679]: slow request 363.018061 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:37:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:11 smithi092 ceph-mon[29156]: pgmap v10711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:11 smithi189 ceph-mon[32756]: pgmap v10711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:11 smithi156 ceph-mon[32679]: pgmap v10711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:37:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:13 smithi092 ceph-mon[29156]: pgmap v10712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:37:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:13 smithi189 ceph-mon[32756]: pgmap v10712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:37:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:13 smithi156 ceph-mon[32679]: pgmap v10712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-26T23:37:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19129.628853 secs 2024-04-26T23:37:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18432.598580 secs 2024-04-26T23:37:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19129.628853 secs 2024-04-26T23:37:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18432.598580 secs 2024-04-26T23:37:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19129.628853 secs 2024-04-26T23:37:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18432.598580 secs 2024-04-26T23:37:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:15 smithi092 ceph-mon[29156]: pgmap v10713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:15 smithi189 ceph-mon[32756]: pgmap v10713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:15 smithi156 ceph-mon[32679]: pgmap v10713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:17 smithi092 ceph-mon[29156]: pgmap v10714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:37:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:17 smithi189 ceph-mon[32756]: pgmap v10714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:37:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:17 smithi156 ceph-mon[32679]: pgmap v10714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:37:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:19 smithi092 ceph-mon[29156]: pgmap v10715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19134.628967 secs 2024-04-26T23:37:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18437.598722 secs 2024-04-26T23:37:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:19 smithi189 ceph-mon[32756]: pgmap v10715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19134.628967 secs 2024-04-26T23:37:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18437.598722 secs 2024-04-26T23:37:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:19 smithi156 ceph-mon[32679]: pgmap v10715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19134.628967 secs 2024-04-26T23:37:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18437.598722 secs 2024-04-26T23:37:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:21 smithi092 ceph-mon[29156]: pgmap v10716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:21 smithi189 ceph-mon[32756]: pgmap v10716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:21 smithi156 ceph-mon[32679]: pgmap v10716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:23.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:23 smithi092 ceph-mon[29156]: pgmap v10717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:23 smithi189 ceph-mon[32756]: pgmap v10717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:23 smithi156 ceph-mon[32679]: pgmap v10717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19139.629117 secs 2024-04-26T23:37:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18442.598800 secs 2024-04-26T23:37:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19139.629117 secs 2024-04-26T23:37:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18442.598800 secs 2024-04-26T23:37:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19139.629117 secs 2024-04-26T23:37:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18442.598800 secs 2024-04-26T23:37:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:25 smithi092 ceph-mon[29156]: pgmap v10718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:25 smithi189 ceph-mon[32756]: pgmap v10718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:25.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:25 smithi156 ceph-mon[32679]: pgmap v10718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:27 smithi092 ceph-mon[29156]: pgmap v10719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:27.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:27 smithi189 ceph-mon[32756]: pgmap v10719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:27 smithi156 ceph-mon[32679]: pgmap v10719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:29 smithi092 ceph-mon[29156]: pgmap v10720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19144.629217 secs 2024-04-26T23:37:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18447.598920 secs 2024-04-26T23:37:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:29 smithi189 ceph-mon[32756]: pgmap v10720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19144.629217 secs 2024-04-26T23:37:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18447.598920 secs 2024-04-26T23:37:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:29 smithi156 ceph-mon[32679]: pgmap v10720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19144.629217 secs 2024-04-26T23:37:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18447.598920 secs 2024-04-26T23:37:31.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:31 smithi092 ceph-mon[29156]: pgmap v10721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:31.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:31 smithi189 ceph-mon[32756]: pgmap v10721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:31 smithi156 ceph-mon[32679]: pgmap v10721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:33.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:33 smithi092 ceph-mon[29156]: pgmap v10722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:33.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:33 smithi189 ceph-mon[32756]: pgmap v10722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:33 smithi156 ceph-mon[32679]: pgmap v10722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19149.629348 secs 2024-04-26T23:37:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18452.598994 secs 2024-04-26T23:37:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19149.629348 secs 2024-04-26T23:37:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18452.598994 secs 2024-04-26T23:37:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19149.629348 secs 2024-04-26T23:37:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18452.598994 secs 2024-04-26T23:37:35.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:35 smithi189 ceph-mon[32756]: pgmap v10723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:35.808 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:35 smithi092 ceph-mon[29156]: pgmap v10723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:35.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:35 smithi156 ceph-mon[32679]: pgmap v10723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:37.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:37 smithi189 ceph-mon[32756]: pgmap v10724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:37 smithi156 ceph-mon[32679]: pgmap v10724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:37.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:37 smithi092 ceph-mon[29156]: pgmap v10724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:39 smithi189 ceph-mon[32756]: pgmap v10725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19154.629474 secs 2024-04-26T23:37:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18457.599109 secs 2024-04-26T23:37:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:39 smithi156 ceph-mon[32679]: pgmap v10725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19154.629474 secs 2024-04-26T23:37:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18457.599109 secs 2024-04-26T23:37:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:39 smithi092 ceph-mon[29156]: pgmap v10725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19154.629474 secs 2024-04-26T23:37:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18457.599109 secs 2024-04-26T23:37:41.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:41 smithi189 ceph-mon[32756]: pgmap v10726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:41 smithi156 ceph-mon[32679]: pgmap v10726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:41.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:41 smithi092 ceph-mon[29156]: pgmap v10726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:43.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:43 smithi189 ceph-mon[32756]: pgmap v10727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:43 smithi156 ceph-mon[32679]: pgmap v10727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:43 smithi092 ceph-mon[29156]: pgmap v10727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19159.629572 secs 2024-04-26T23:37:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18462.599204 secs 2024-04-26T23:37:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19159.629572 secs 2024-04-26T23:37:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18462.599204 secs 2024-04-26T23:37:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19159.629572 secs 2024-04-26T23:37:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18462.599204 secs 2024-04-26T23:37:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:45 smithi189 ceph-mon[32756]: pgmap v10728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:45 smithi156 ceph-mon[32679]: pgmap v10728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:45 smithi092 ceph-mon[29156]: pgmap v10728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:47.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:47 smithi189 ceph-mon[32756]: pgmap v10729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:47 smithi156 ceph-mon[32679]: pgmap v10729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:47 smithi092 ceph-mon[29156]: pgmap v10729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:49 smithi189 ceph-mon[32756]: pgmap v10730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19164.629693 secs 2024-04-26T23:37:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18467.599335 secs 2024-04-26T23:37:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:49 smithi156 ceph-mon[32679]: pgmap v10730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19164.629693 secs 2024-04-26T23:37:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18467.599335 secs 2024-04-26T23:37:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:49 smithi092 ceph-mon[29156]: pgmap v10730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19164.629693 secs 2024-04-26T23:37:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18467.599335 secs 2024-04-26T23:37:51.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:51 smithi092 ceph-mon[29156]: pgmap v10731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:51 smithi189 ceph-mon[32756]: pgmap v10731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:51 smithi156 ceph-mon[32679]: pgmap v10731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:53.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:53 smithi189 ceph-mon[32756]: pgmap v10732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:53 smithi156 ceph-mon[32679]: pgmap v10732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:53 smithi092 ceph-mon[29156]: pgmap v10732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19169.629842 secs 2024-04-26T23:37:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18472.599453 secs 2024-04-26T23:37:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19169.629842 secs 2024-04-26T23:37:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18472.599453 secs 2024-04-26T23:37:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19169.629842 secs 2024-04-26T23:37:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18472.599453 secs 2024-04-26T23:37:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:55 smithi189 ceph-mon[32756]: pgmap v10733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:55 smithi156 ceph-mon[32679]: pgmap v10733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:55 smithi092 ceph-mon[29156]: pgmap v10733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:37:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:57 smithi189 ceph-mon[32756]: pgmap v10734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:57 smithi156 ceph-mon[32679]: pgmap v10734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:57 smithi092 ceph-mon[29156]: pgmap v10734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:59 smithi189 ceph-mon[32756]: pgmap v10735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19174.629987 secs 2024-04-26T23:37:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:37:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18477.599573 secs 2024-04-26T23:37:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:59 smithi156 ceph-mon[32679]: pgmap v10735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19174.629987 secs 2024-04-26T23:37:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:37:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18477.599573 secs 2024-04-26T23:37:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:59 smithi092 ceph-mon[29156]: pgmap v10735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:37:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19174.629987 secs 2024-04-26T23:37:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:37:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18477.599573 secs 2024-04-26T23:38:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:01 smithi189 ceph-mon[32756]: pgmap v10736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:01.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:01 smithi156 ceph-mon[32679]: pgmap v10736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:01 smithi092 ceph-mon[29156]: pgmap v10736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:03.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:03 smithi189 ceph-mon[32756]: pgmap v10737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:03.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:03 smithi156 ceph-mon[32679]: pgmap v10737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:03 smithi092 ceph-mon[29156]: pgmap v10737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19179.630087 secs 2024-04-26T23:38:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18482.599690 secs 2024-04-26T23:38:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19179.630087 secs 2024-04-26T23:38:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18482.599690 secs 2024-04-26T23:38:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19179.630087 secs 2024-04-26T23:38:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18482.599690 secs 2024-04-26T23:38:05.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:05 smithi156 ceph-mon[32679]: pgmap v10738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:05.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:05 smithi189 ceph-mon[32756]: pgmap v10738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:05 smithi092 ceph-mon[29156]: pgmap v10738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: pgmap v10739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: pgmap v10740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: pgmap v10741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:38:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: pgmap v10739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:38:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:38:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:38:06.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: pgmap v10740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:38:06.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: pgmap v10741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:06.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: pgmap v10739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: pgmap v10740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: pgmap v10741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:38:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:09 smithi189 ceph-mon[32756]: pgmap v10742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19184.630209 secs 2024-04-26T23:38:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18487.599809 secs 2024-04-26T23:38:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:09 smithi156 ceph-mon[32679]: pgmap v10742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19184.630209 secs 2024-04-26T23:38:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18487.599809 secs 2024-04-26T23:38:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:09 smithi092 ceph-mon[29156]: pgmap v10742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19184.630209 secs 2024-04-26T23:38:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18487.599809 secs 2024-04-26T23:38:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:11 smithi189 ceph-mon[32756]: pgmap v10743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:11 smithi156 ceph-mon[32679]: pgmap v10743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:11 smithi092 ceph-mon[29156]: pgmap v10743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:13 smithi189 ceph-mon[32756]: pgmap v10744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:13 smithi156 ceph-mon[32679]: pgmap v10744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:13.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:13 smithi092 ceph-mon[29156]: pgmap v10744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:38:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19189.630308 secs 2024-04-26T23:38:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18492.599924 secs 2024-04-26T23:38:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19189.630308 secs 2024-04-26T23:38:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18492.599924 secs 2024-04-26T23:38:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19189.630308 secs 2024-04-26T23:38:14.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18492.599924 secs 2024-04-26T23:38:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:15 smithi189 ceph-mon[32756]: pgmap v10745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:15 smithi156 ceph-mon[32679]: pgmap v10745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:15 smithi092 ceph-mon[29156]: pgmap v10745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:38:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:17 smithi189 ceph-mon[32756]: pgmap v10746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:38:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:17 smithi156 ceph-mon[32679]: pgmap v10746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:38:17.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:17 smithi092 ceph-mon[29156]: pgmap v10746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:38:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:19 smithi189 ceph-mon[32756]: pgmap v10747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19194.630430 secs 2024-04-26T23:38:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18497.599989 secs 2024-04-26T23:38:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:19 smithi156 ceph-mon[32679]: pgmap v10747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19194.630430 secs 2024-04-26T23:38:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18497.599989 secs 2024-04-26T23:38:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:19 smithi092 ceph-mon[29156]: pgmap v10747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19194.630430 secs 2024-04-26T23:38:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18497.599989 secs 2024-04-26T23:38:21.888 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:21 smithi092 ceph-mon[29156]: pgmap v10748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:21 smithi189 ceph-mon[32756]: pgmap v10748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:21 smithi156 ceph-mon[32679]: pgmap v10748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:23 smithi189 ceph-mon[32756]: pgmap v10749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:23 smithi156 ceph-mon[32679]: pgmap v10749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:23 smithi092 ceph-mon[29156]: pgmap v10749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19199.630570 secs 2024-04-26T23:38:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18502.600108 secs 2024-04-26T23:38:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:24 smithi189 ceph-mon[32756]: pgmap v10750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19199.630570 secs 2024-04-26T23:38:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18502.600108 secs 2024-04-26T23:38:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:24 smithi156 ceph-mon[32679]: pgmap v10750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19199.630570 secs 2024-04-26T23:38:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18502.600108 secs 2024-04-26T23:38:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:24 smithi092 ceph-mon[29156]: pgmap v10750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:27.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:27 smithi189 ceph-mon[32756]: pgmap v10751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:27 smithi156 ceph-mon[32679]: pgmap v10751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:27.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:27 smithi092 ceph-mon[29156]: pgmap v10751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:29 smithi189 ceph-mon[32756]: pgmap v10752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19204.630638 secs 2024-04-26T23:38:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18507.600225 secs 2024-04-26T23:38:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:29 smithi156 ceph-mon[32679]: pgmap v10752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19204.630638 secs 2024-04-26T23:38:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18507.600225 secs 2024-04-26T23:38:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:29 smithi092 ceph-mon[29156]: pgmap v10752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19204.630638 secs 2024-04-26T23:38:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18507.600225 secs 2024-04-26T23:38:31.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:31 smithi189 ceph-mon[32756]: pgmap v10753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:31 smithi156 ceph-mon[32679]: pgmap v10753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:31.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:31 smithi092 ceph-mon[29156]: pgmap v10753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:33.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:33 smithi189 ceph-mon[32756]: pgmap v10754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:33 smithi156 ceph-mon[32679]: pgmap v10754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:33 smithi092 ceph-mon[29156]: pgmap v10754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19209.630761 secs 2024-04-26T23:38:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18512.600346 secs 2024-04-26T23:38:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19209.630761 secs 2024-04-26T23:38:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18512.600346 secs 2024-04-26T23:38:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19209.630761 secs 2024-04-26T23:38:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18512.600346 secs 2024-04-26T23:38:35.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:35 smithi156 ceph-mon[32679]: pgmap v10755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:35 smithi189 ceph-mon[32756]: pgmap v10755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:35 smithi092 ceph-mon[29156]: pgmap v10755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:37.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:37 smithi189 ceph-mon[32756]: pgmap v10756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:37 smithi156 ceph-mon[32679]: pgmap v10756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:37.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:37 smithi092 ceph-mon[29156]: pgmap v10756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:39 smithi189 ceph-mon[32756]: pgmap v10757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19214.630913 secs 2024-04-26T23:38:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18517.600393 secs 2024-04-26T23:38:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:39 smithi156 ceph-mon[32679]: pgmap v10757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19214.630913 secs 2024-04-26T23:38:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18517.600393 secs 2024-04-26T23:38:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:39 smithi092 ceph-mon[29156]: pgmap v10757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19214.630913 secs 2024-04-26T23:38:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18517.600393 secs 2024-04-26T23:38:40.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:40 smithi189 ceph-mon[32756]: pgmap v10758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:40 smithi156 ceph-mon[32679]: pgmap v10758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:40 smithi092 ceph-mon[29156]: pgmap v10758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:43.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:43 smithi189 ceph-mon[32756]: pgmap v10759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:43 smithi156 ceph-mon[32679]: pgmap v10759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:43.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:43 smithi092 ceph-mon[29156]: pgmap v10759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19219.630982 secs 2024-04-26T23:38:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18522.600508 secs 2024-04-26T23:38:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19219.630982 secs 2024-04-26T23:38:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18522.600508 secs 2024-04-26T23:38:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19219.630982 secs 2024-04-26T23:38:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18522.600508 secs 2024-04-26T23:38:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:45 smithi189 ceph-mon[32756]: pgmap v10760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:45 smithi156 ceph-mon[32679]: pgmap v10760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:45 smithi092 ceph-mon[29156]: pgmap v10760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:47.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:47 smithi189 ceph-mon[32756]: pgmap v10761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:47 smithi156 ceph-mon[32679]: pgmap v10761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:47 smithi092 ceph-mon[29156]: pgmap v10761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:49 smithi189 ceph-mon[32756]: pgmap v10762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19224.631048 secs 2024-04-26T23:38:49.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18527.600629 secs 2024-04-26T23:38:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:49 smithi156 ceph-mon[32679]: pgmap v10762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19224.631048 secs 2024-04-26T23:38:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18527.600629 secs 2024-04-26T23:38:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:49 smithi092 ceph-mon[29156]: pgmap v10762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19224.631048 secs 2024-04-26T23:38:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18527.600629 secs 2024-04-26T23:38:51.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:51 smithi189 ceph-mon[32756]: pgmap v10763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:51.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:51 smithi156 ceph-mon[32679]: pgmap v10763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:51 smithi092 ceph-mon[29156]: pgmap v10763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:53.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:53 smithi189 ceph-mon[32756]: pgmap v10764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:53 smithi156 ceph-mon[32679]: pgmap v10764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:53 smithi092 ceph-mon[29156]: pgmap v10764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19229.631120 secs 2024-04-26T23:38:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18532.600751 secs 2024-04-26T23:38:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:54 smithi189 ceph-mon[32756]: pgmap v10765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19229.631120 secs 2024-04-26T23:38:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18532.600751 secs 2024-04-26T23:38:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:54 smithi156 ceph-mon[32679]: pgmap v10765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19229.631120 secs 2024-04-26T23:38:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18532.600751 secs 2024-04-26T23:38:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:54 smithi092 ceph-mon[29156]: pgmap v10765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:38:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:57 smithi189 ceph-mon[32756]: pgmap v10766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:57 smithi156 ceph-mon[32679]: pgmap v10766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:57 smithi092 ceph-mon[29156]: pgmap v10766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:59 smithi189 ceph-mon[32756]: pgmap v10767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19234.631201 secs 2024-04-26T23:38:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:38:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18537.600895 secs 2024-04-26T23:38:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:59 smithi156 ceph-mon[32679]: pgmap v10767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19234.631201 secs 2024-04-26T23:38:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:38:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18537.600895 secs 2024-04-26T23:38:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:59 smithi092 ceph-mon[29156]: pgmap v10767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:38:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19234.631201 secs 2024-04-26T23:38:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:38:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18537.600895 secs 2024-04-26T23:39:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:01 smithi189 ceph-mon[32756]: pgmap v10768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:01 smithi156 ceph-mon[32679]: pgmap v10768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:01.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:01 smithi092 ceph-mon[29156]: pgmap v10768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:03.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:03 smithi189 ceph-mon[32756]: pgmap v10769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:03 smithi156 ceph-mon[32679]: pgmap v10769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:03.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:03 smithi092 ceph-mon[29156]: pgmap v10769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19239.631316 secs 2024-04-26T23:39:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:04 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 18542.601017 secs 2024-04-26T23:39:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:04 smithi189 ceph-mon[32756]: slow request 11520.813682 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:39:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19239.631316 secs 2024-04-26T23:39:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:04 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 18542.601017 secs 2024-04-26T23:39:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:04 smithi156 ceph-mon[32679]: slow request 11520.813682 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:39:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19239.631316 secs 2024-04-26T23:39:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:04 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 18542.601017 secs 2024-04-26T23:39:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:04 smithi092 ceph-mon[29156]: slow request 11520.813682 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:39:05.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:05 smithi156 ceph-mon[32679]: pgmap v10770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:05.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:05 smithi189 ceph-mon[32756]: pgmap v10770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:05.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:05 smithi092 ceph-mon[29156]: pgmap v10770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:06 smithi189 ceph-mon[32756]: pgmap v10771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:06 smithi156 ceph-mon[32679]: pgmap v10771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:06 smithi092 ceph-mon[29156]: pgmap v10771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:39:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:39:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:39:07.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: pgmap v10772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:39:07.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: pgmap v10773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:07.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: pgmap v10772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: pgmap v10773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: pgmap v10772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: pgmap v10773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:39:09.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19244.631436 secs 2024-04-26T23:39:09.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18547.601131 secs 2024-04-26T23:39:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19244.631436 secs 2024-04-26T23:39:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18547.601131 secs 2024-04-26T23:39:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19244.631436 secs 2024-04-26T23:39:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18547.601131 secs 2024-04-26T23:39:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:10 smithi092 ceph-mon[29156]: pgmap v10774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:10 smithi189 ceph-mon[32756]: pgmap v10774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:10 smithi156 ceph-mon[32679]: pgmap v10774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:12.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:12 smithi189 ceph-mon[32756]: pgmap v10775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:12 smithi156 ceph-mon[32679]: pgmap v10775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:12 smithi092 ceph-mon[29156]: pgmap v10775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:14 smithi189 ceph-mon[32756]: pgmap v10776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:39:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19249.631516 secs 2024-04-26T23:39:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18552.601265 secs 2024-04-26T23:39:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:14 smithi156 ceph-mon[32679]: pgmap v10776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:39:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19249.631516 secs 2024-04-26T23:39:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18552.601265 secs 2024-04-26T23:39:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:14 smithi092 ceph-mon[29156]: pgmap v10776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:39:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19249.631516 secs 2024-04-26T23:39:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18552.601265 secs 2024-04-26T23:39:16.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:16 smithi189 ceph-mon[32756]: pgmap v10777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:16 smithi156 ceph-mon[32679]: pgmap v10777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:16 smithi092 ceph-mon[29156]: pgmap v10777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:39:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:18 smithi189 ceph-mon[32756]: pgmap v10778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:39:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:18 smithi156 ceph-mon[32679]: pgmap v10778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:39:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:18 smithi092 ceph-mon[29156]: pgmap v10778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:39:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19254.631641 secs 2024-04-26T23:39:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18557.601368 secs 2024-04-26T23:39:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19254.631641 secs 2024-04-26T23:39:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18557.601368 secs 2024-04-26T23:39:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19254.631641 secs 2024-04-26T23:39:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18557.601368 secs 2024-04-26T23:39:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:20 smithi189 ceph-mon[32756]: pgmap v10779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:20 smithi156 ceph-mon[32679]: pgmap v10779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:20 smithi092 ceph-mon[29156]: pgmap v10779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:22.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:22 smithi189 ceph-mon[32756]: pgmap v10780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:22 smithi156 ceph-mon[32679]: pgmap v10780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:22 smithi092 ceph-mon[29156]: pgmap v10780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:24 smithi189 ceph-mon[32756]: pgmap v10781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19259.631771 secs 2024-04-26T23:39:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18562.601477 secs 2024-04-26T23:39:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:24 smithi156 ceph-mon[32679]: pgmap v10781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19259.631771 secs 2024-04-26T23:39:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18562.601477 secs 2024-04-26T23:39:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:24 smithi092 ceph-mon[29156]: pgmap v10781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19259.631771 secs 2024-04-26T23:39:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18562.601477 secs 2024-04-26T23:39:26.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:26 smithi189 ceph-mon[32756]: pgmap v10782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:26 smithi156 ceph-mon[32679]: pgmap v10782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:26 smithi092 ceph-mon[29156]: pgmap v10782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:28.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:28 smithi189 ceph-mon[32756]: pgmap v10783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:28 smithi156 ceph-mon[32679]: pgmap v10783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:28 smithi092 ceph-mon[29156]: pgmap v10783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19264.631897 secs 2024-04-26T23:39:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18567.601559 secs 2024-04-26T23:39:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19264.631897 secs 2024-04-26T23:39:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18567.601559 secs 2024-04-26T23:39:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19264.631897 secs 2024-04-26T23:39:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18567.601559 secs 2024-04-26T23:39:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:30 smithi189 ceph-mon[32756]: pgmap v10784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:30 smithi156 ceph-mon[32679]: pgmap v10784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:30 smithi092 ceph-mon[29156]: pgmap v10784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:32.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:32 smithi189 ceph-mon[32756]: pgmap v10785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:32 smithi156 ceph-mon[32679]: pgmap v10785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:32 smithi092 ceph-mon[29156]: pgmap v10785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:34 smithi189 ceph-mon[32756]: pgmap v10786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19269.632018 secs 2024-04-26T23:39:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18572.601673 secs 2024-04-26T23:39:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:34 smithi156 ceph-mon[32679]: pgmap v10786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19269.632018 secs 2024-04-26T23:39:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18572.601673 secs 2024-04-26T23:39:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:34 smithi092 ceph-mon[29156]: pgmap v10786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19269.632018 secs 2024-04-26T23:39:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18572.601673 secs 2024-04-26T23:39:36.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:36 smithi189 ceph-mon[32756]: pgmap v10787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:36 smithi156 ceph-mon[32679]: pgmap v10787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:36 smithi092 ceph-mon[29156]: pgmap v10787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:39:38.623+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:39:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:39:38.623+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:39:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:39:38.623+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:39:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:39:38.623+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 150 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:39:38.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:38 smithi189 ceph-mon[32756]: pgmap v10788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:38 smithi156 ceph-mon[32679]: pgmap v10788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:38 smithi092 ceph-mon[29156]: pgmap v10788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19274.632097 secs 2024-04-26T23:39:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18577.601752 secs 2024-04-26T23:39:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19274.632097 secs 2024-04-26T23:39:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18577.601752 secs 2024-04-26T23:39:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19274.632097 secs 2024-04-26T23:39:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18577.601752 secs 2024-04-26T23:39:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:40 smithi189 ceph-mon[32756]: pgmap v10789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:40 smithi156 ceph-mon[32679]: pgmap v10789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:40.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:40 smithi092 ceph-mon[29156]: pgmap v10789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:42 smithi156 ceph-mon[32679]: pgmap v10790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:42 smithi092 ceph-mon[29156]: pgmap v10790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:42.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:42 smithi189 ceph-mon[32756]: pgmap v10790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:44 smithi189 ceph-mon[32756]: pgmap v10791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19279.632168 secs 2024-04-26T23:39:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18582.601887 secs 2024-04-26T23:39:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:44 smithi156 ceph-mon[32679]: pgmap v10791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19279.632168 secs 2024-04-26T23:39:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18582.601887 secs 2024-04-26T23:39:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:44 smithi092 ceph-mon[29156]: pgmap v10791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19279.632168 secs 2024-04-26T23:39:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18582.601887 secs 2024-04-26T23:39:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:46 smithi156 ceph-mon[32679]: pgmap v10792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:46 smithi092 ceph-mon[29156]: pgmap v10792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:46.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:46 smithi189 ceph-mon[32756]: pgmap v10792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:48.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:48 smithi156 ceph-mon[32679]: pgmap v10793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:48 smithi092 ceph-mon[29156]: pgmap v10793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:48.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:48 smithi189 ceph-mon[32756]: pgmap v10793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19284.632247 secs 2024-04-26T23:39:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18587.601999 secs 2024-04-26T23:39:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19284.632247 secs 2024-04-26T23:39:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18587.601999 secs 2024-04-26T23:39:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19284.632247 secs 2024-04-26T23:39:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18587.601999 secs 2024-04-26T23:39:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:50 smithi156 ceph-mon[32679]: pgmap v10794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:50 smithi092 ceph-mon[29156]: pgmap v10794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:50 smithi189 ceph-mon[32756]: pgmap v10794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:52.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:52 smithi156 ceph-mon[32679]: pgmap v10795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:52 smithi092 ceph-mon[29156]: pgmap v10795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:52.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:52 smithi189 ceph-mon[32756]: pgmap v10795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:54 smithi156 ceph-mon[32679]: pgmap v10796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19289.632364 secs 2024-04-26T23:39:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18592.602115 secs 2024-04-26T23:39:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:54 smithi092 ceph-mon[29156]: pgmap v10796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19289.632364 secs 2024-04-26T23:39:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18592.602115 secs 2024-04-26T23:39:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:54 smithi189 ceph-mon[32756]: pgmap v10796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19289.632364 secs 2024-04-26T23:39:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18592.602115 secs 2024-04-26T23:39:56.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:56 smithi156 ceph-mon[32679]: pgmap v10797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:56.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:56 smithi092 ceph-mon[29156]: pgmap v10797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:56 smithi189 ceph-mon[32756]: pgmap v10797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:39:58.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:58 smithi156 ceph-mon[32679]: pgmap v10798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:58.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:58 smithi092 ceph-mon[29156]: pgmap v10798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:58.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:58 smithi189 ceph-mon[32756]: pgmap v10798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:39:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19294.632508 secs 2024-04-26T23:39:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:39:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18597.602267 secs 2024-04-26T23:39:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19294.632508 secs 2024-04-26T23:39:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:39:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18597.602267 secs 2024-04-26T23:39:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19294.632508 secs 2024-04-26T23:39:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:39:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18597.602267 secs 2024-04-26T23:40:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:00 smithi156 ceph-mon[32679]: pgmap v10799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:00.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:40:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:00 smithi092 ceph-mon[29156]: pgmap v10799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:40:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:00 smithi189 ceph-mon[32756]: pgmap v10799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:40:02.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:02 smithi156 ceph-mon[32679]: pgmap v10800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:02 smithi092 ceph-mon[29156]: pgmap v10800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:02.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:02 smithi189 ceph-mon[32756]: pgmap v10800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:04 smithi092 ceph-mon[29156]: pgmap v10801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19299.632600 secs 2024-04-26T23:40:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18602.602359 secs 2024-04-26T23:40:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:04 smithi189 ceph-mon[32756]: pgmap v10801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19299.632600 secs 2024-04-26T23:40:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18602.602359 secs 2024-04-26T23:40:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:04 smithi156 ceph-mon[32679]: pgmap v10801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19299.632600 secs 2024-04-26T23:40:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18602.602359 secs 2024-04-26T23:40:06.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:06 smithi189 ceph-mon[32756]: pgmap v10802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:06.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:06 smithi156 ceph-mon[32679]: pgmap v10802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:06 smithi092 ceph-mon[29156]: pgmap v10802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:40:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:40:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:40:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:08 smithi092 ceph-mon[29156]: pgmap v10803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:40:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:40:08.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:40:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:08 smithi189 ceph-mon[32756]: pgmap v10803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:40:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:40:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:40:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:08 smithi156 ceph-mon[32679]: pgmap v10803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:08.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:40:08.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:40:08.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:40:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:09 smithi092 ceph-mon[29156]: pgmap v10804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:40:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:09 smithi092 ceph-mon[29156]: pgmap v10805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:40:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19304.632721 secs 2024-04-26T23:40:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18607.602438 secs 2024-04-26T23:40:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:09 smithi189 ceph-mon[32756]: pgmap v10804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:40:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:09 smithi189 ceph-mon[32756]: pgmap v10805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:40:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19304.632721 secs 2024-04-26T23:40:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18607.602438 secs 2024-04-26T23:40:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:09 smithi156 ceph-mon[32679]: pgmap v10804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:40:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:09 smithi156 ceph-mon[32679]: pgmap v10805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:40:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19304.632721 secs 2024-04-26T23:40:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18607.602438 secs 2024-04-26T23:40:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:11 smithi092 ceph-mon[29156]: pgmap v10806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:11 smithi189 ceph-mon[32756]: pgmap v10806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:11 smithi156 ceph-mon[32679]: pgmap v10806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:13 smithi092 ceph-mon[29156]: pgmap v10807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:13 smithi189 ceph-mon[32756]: pgmap v10807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:13 smithi156 ceph-mon[32679]: pgmap v10807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19309.632863 secs 2024-04-26T23:40:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18612.602521 secs 2024-04-26T23:40:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:14 smithi189 ceph-mon[32756]: pgmap v10808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19309.632863 secs 2024-04-26T23:40:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18612.602521 secs 2024-04-26T23:40:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:14 smithi156 ceph-mon[32679]: pgmap v10808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19309.632863 secs 2024-04-26T23:40:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18612.602521 secs 2024-04-26T23:40:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:14 smithi092 ceph-mon[29156]: pgmap v10808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:17.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:17 smithi189 ceph-mon[32756]: pgmap v10809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:17.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:17 smithi156 ceph-mon[32679]: pgmap v10809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:17.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:17 smithi092 ceph-mon[29156]: pgmap v10809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:40:19.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:19 smithi189 ceph-mon[32756]: pgmap v10810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:40:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:19 smithi156 ceph-mon[32679]: pgmap v10810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:40:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:19 smithi092 ceph-mon[29156]: pgmap v10810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:40:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:20 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19314.632950 secs 2024-04-26T23:40:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18617.602642 secs 2024-04-26T23:40:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:20 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19314.632950 secs 2024-04-26T23:40:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18617.602642 secs 2024-04-26T23:40:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:20 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19314.632950 secs 2024-04-26T23:40:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18617.602642 secs 2024-04-26T23:40:21.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:21 smithi156 ceph-mon[32679]: pgmap v10811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:21.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:21 smithi189 ceph-mon[32756]: pgmap v10811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:21.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:21 smithi092 ceph-mon[29156]: pgmap v10811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:23.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:23 smithi189 ceph-mon[32756]: pgmap v10812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:23.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:23 smithi156 ceph-mon[32679]: pgmap v10812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:23.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:23 smithi092 ceph-mon[29156]: pgmap v10812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:40:23.630+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:40:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:40:23.630+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:40:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:40:23.630+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:40:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:40:23.630+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 151 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:40:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19319.633017 secs 2024-04-26T23:40:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18622.602740 secs 2024-04-26T23:40:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:25 smithi189 ceph-mon[32756]: pgmap v10813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19319.633017 secs 2024-04-26T23:40:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18622.602740 secs 2024-04-26T23:40:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:25 smithi156 ceph-mon[32679]: pgmap v10813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19319.633017 secs 2024-04-26T23:40:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18622.602740 secs 2024-04-26T23:40:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:25 smithi092 ceph-mon[29156]: pgmap v10813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:27 smithi189 ceph-mon[32756]: pgmap v10814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:27 smithi156 ceph-mon[32679]: pgmap v10814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:27.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:27 smithi092 ceph-mon[29156]: pgmap v10814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:29.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:29 smithi189 ceph-mon[32756]: pgmap v10815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:29 smithi156 ceph-mon[32679]: pgmap v10815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:29 smithi092 ceph-mon[29156]: pgmap v10815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19324.633082 secs 2024-04-26T23:40:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18627.602817 secs 2024-04-26T23:40:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19324.633082 secs 2024-04-26T23:40:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18627.602817 secs 2024-04-26T23:40:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19324.633082 secs 2024-04-26T23:40:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18627.602817 secs 2024-04-26T23:40:31.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:31 smithi189 ceph-mon[32756]: pgmap v10816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:31.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:31 smithi156 ceph-mon[32679]: pgmap v10816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:31.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:31 smithi092 ceph-mon[29156]: pgmap v10816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:33.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:33 smithi189 ceph-mon[32756]: pgmap v10817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:33.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:33 smithi156 ceph-mon[32679]: pgmap v10817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:33 smithi092 ceph-mon[29156]: pgmap v10817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19329.633147 secs 2024-04-26T23:40:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18632.602964 secs 2024-04-26T23:40:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:35 smithi189 ceph-mon[32756]: pgmap v10818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19329.633147 secs 2024-04-26T23:40:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18632.602964 secs 2024-04-26T23:40:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:35 smithi156 ceph-mon[32679]: pgmap v10818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19329.633147 secs 2024-04-26T23:40:35.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18632.602964 secs 2024-04-26T23:40:35.662 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:35 smithi092 ceph-mon[29156]: pgmap v10818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:37.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:37 smithi156 ceph-mon[32679]: pgmap v10819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:37.476 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:37 smithi189 ceph-mon[32756]: pgmap v10819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:37.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:37 smithi092 ceph-mon[29156]: pgmap v10819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:39.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:39 smithi156 ceph-mon[32679]: pgmap v10820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:39 smithi092 ceph-mon[29156]: pgmap v10820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:39 smithi189 ceph-mon[32756]: pgmap v10820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19334.633236 secs 2024-04-26T23:40:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18637.603118 secs 2024-04-26T23:40:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19334.633236 secs 2024-04-26T23:40:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18637.603118 secs 2024-04-26T23:40:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19334.633236 secs 2024-04-26T23:40:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18637.603118 secs 2024-04-26T23:40:41.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:41 smithi156 ceph-mon[32679]: pgmap v10821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:41 smithi092 ceph-mon[29156]: pgmap v10821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:41.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:41 smithi189 ceph-mon[32756]: pgmap v10821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:43.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:43 smithi156 ceph-mon[32679]: pgmap v10822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:43.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:43 smithi092 ceph-mon[29156]: pgmap v10822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:43.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:43 smithi189 ceph-mon[32756]: pgmap v10822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:44.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18642.603226 secs 2024-04-26T23:40:44.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18642.603226 secs 2024-04-26T23:40:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18642.603226 secs 2024-04-26T23:40:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19339.633335 secs 2024-04-26T23:40:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:45 smithi156 ceph-mon[32679]: pgmap v10823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19339.633335 secs 2024-04-26T23:40:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:45 smithi092 ceph-mon[29156]: pgmap v10823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19339.633335 secs 2024-04-26T23:40:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:45 smithi189 ceph-mon[32756]: pgmap v10823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:47 smithi156 ceph-mon[32679]: pgmap v10824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:47 smithi092 ceph-mon[29156]: pgmap v10824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:47.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:47 smithi189 ceph-mon[32756]: pgmap v10824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:49.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:49 smithi156 ceph-mon[32679]: pgmap v10825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:49.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19344.633483 secs 2024-04-26T23:40:49.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18647.603367 secs 2024-04-26T23:40:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:49 smithi092 ceph-mon[29156]: pgmap v10825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19344.633483 secs 2024-04-26T23:40:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18647.603367 secs 2024-04-26T23:40:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:49 smithi189 ceph-mon[32756]: pgmap v10825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19344.633483 secs 2024-04-26T23:40:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18647.603367 secs 2024-04-26T23:40:51.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:51 smithi156 ceph-mon[32679]: pgmap v10826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:51.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:51 smithi092 ceph-mon[29156]: pgmap v10826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:51.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:51 smithi189 ceph-mon[32756]: pgmap v10826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:53.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:53 smithi156 ceph-mon[32679]: pgmap v10827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:53.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:53 smithi092 ceph-mon[29156]: pgmap v10827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:53.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:53 smithi189 ceph-mon[32756]: pgmap v10827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19349.633626 secs 2024-04-26T23:40:54.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18652.603441 secs 2024-04-26T23:40:54.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19349.633626 secs 2024-04-26T23:40:54.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18652.603441 secs 2024-04-26T23:40:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19349.633626 secs 2024-04-26T23:40:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18652.603441 secs 2024-04-26T23:40:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:55 smithi156 ceph-mon[32679]: pgmap v10828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:55 smithi092 ceph-mon[29156]: pgmap v10828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:55 smithi189 ceph-mon[32756]: pgmap v10828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:40:57.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:57 smithi092 ceph-mon[29156]: pgmap v10829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:57.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:57 smithi189 ceph-mon[32756]: pgmap v10829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:57.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:57 smithi156 ceph-mon[32679]: pgmap v10829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:59 smithi092 ceph-mon[29156]: pgmap v10830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19354.633768 secs 2024-04-26T23:40:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:40:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18657.603526 secs 2024-04-26T23:40:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:59 smithi189 ceph-mon[32756]: pgmap v10830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19354.633768 secs 2024-04-26T23:40:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:40:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18657.603526 secs 2024-04-26T23:40:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:59 smithi156 ceph-mon[32679]: pgmap v10830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:40:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19354.633768 secs 2024-04-26T23:40:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:40:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18657.603526 secs 2024-04-26T23:41:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:01 smithi092 ceph-mon[29156]: pgmap v10831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:01 smithi189 ceph-mon[32756]: pgmap v10831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:01.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:01 smithi156 ceph-mon[32679]: pgmap v10831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:03 smithi092 ceph-mon[29156]: pgmap v10832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:03.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:03 smithi189 ceph-mon[32756]: pgmap v10832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:03.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:03 smithi156 ceph-mon[32679]: pgmap v10832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19359.633892 secs 2024-04-26T23:41:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18662.603643 secs 2024-04-26T23:41:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19359.633892 secs 2024-04-26T23:41:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18662.603643 secs 2024-04-26T23:41:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19359.633892 secs 2024-04-26T23:41:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18662.603643 secs 2024-04-26T23:41:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:05 smithi092 ceph-mon[29156]: pgmap v10833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:05 smithi189 ceph-mon[32756]: pgmap v10833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:05 smithi156 ceph-mon[32679]: pgmap v10833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:07.488 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:07 smithi156 ceph-mon[32679]: pgmap v10834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:07.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:07 smithi092 ceph-mon[29156]: pgmap v10834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:07.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:07 smithi189 ceph-mon[32756]: pgmap v10834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:08.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:41:08.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:41:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: pgmap v10835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19364.633961 secs 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18667.603714 secs 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:41:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:41:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: pgmap v10835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19364.633961 secs 2024-04-26T23:41:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18667.603714 secs 2024-04-26T23:41:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:41:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:41:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: pgmap v10835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19364.633961 secs 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18667.603714 secs 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:41:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:41:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:10 smithi092 ceph-mon[29156]: pgmap v10836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 380 B/s wr, 6 op/s 2024-04-26T23:41:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:10 smithi092 ceph-mon[29156]: pgmap v10837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:10 smithi189 ceph-mon[32756]: pgmap v10836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 380 B/s wr, 6 op/s 2024-04-26T23:41:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:10 smithi189 ceph-mon[32756]: pgmap v10837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:10 smithi156 ceph-mon[32679]: pgmap v10836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 380 B/s wr, 6 op/s 2024-04-26T23:41:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:10 smithi156 ceph-mon[32679]: pgmap v10837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:12.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:12 smithi092 ceph-mon[29156]: pgmap v10838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:12.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:12 smithi189 ceph-mon[32756]: pgmap v10838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:12.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:12 smithi156 ceph-mon[32679]: pgmap v10838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:14 smithi092 ceph-mon[29156]: pgmap v10839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 466 B/s wr, 2 op/s 2024-04-26T23:41:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19369.634044 secs 2024-04-26T23:41:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18672.603827 secs 2024-04-26T23:41:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:14 smithi189 ceph-mon[32756]: pgmap v10839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 466 B/s wr, 2 op/s 2024-04-26T23:41:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19369.634044 secs 2024-04-26T23:41:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18672.603827 secs 2024-04-26T23:41:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:14 smithi156 ceph-mon[32679]: pgmap v10839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 466 B/s wr, 2 op/s 2024-04-26T23:41:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19369.634044 secs 2024-04-26T23:41:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18672.603827 secs 2024-04-26T23:41:16.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:16 smithi092 ceph-mon[29156]: pgmap v10840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:16.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:16 smithi189 ceph-mon[32756]: pgmap v10840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:16 smithi156 ceph-mon[32679]: pgmap v10840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:18.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:18 smithi092 ceph-mon[29156]: pgmap v10841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:18 smithi189 ceph-mon[32756]: pgmap v10841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:18 smithi156 ceph-mon[32679]: pgmap v10841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 466 B/s wr, 5 op/s 2024-04-26T23:41:19.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19374.634191 secs 2024-04-26T23:41:19.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18677.603953 secs 2024-04-26T23:41:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19374.634191 secs 2024-04-26T23:41:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18677.603953 secs 2024-04-26T23:41:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19374.634191 secs 2024-04-26T23:41:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18677.603953 secs 2024-04-26T23:41:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:20 smithi092 ceph-mon[29156]: pgmap v10842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:41:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:20 smithi189 ceph-mon[32756]: pgmap v10842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:41:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:20 smithi156 ceph-mon[32679]: pgmap v10842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:41:22.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:22 smithi189 ceph-mon[32756]: pgmap v10843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:22 smithi156 ceph-mon[32679]: pgmap v10843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:22 smithi092 ceph-mon[29156]: pgmap v10843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:24 smithi189 ceph-mon[32756]: pgmap v10844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19379.634273 secs 2024-04-26T23:41:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18682.604085 secs 2024-04-26T23:41:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:24 smithi156 ceph-mon[32679]: pgmap v10844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19379.634273 secs 2024-04-26T23:41:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18682.604085 secs 2024-04-26T23:41:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:24 smithi092 ceph-mon[29156]: pgmap v10844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19379.634273 secs 2024-04-26T23:41:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18682.604085 secs 2024-04-26T23:41:26.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:26 smithi189 ceph-mon[32756]: pgmap v10845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:26.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:26 smithi156 ceph-mon[32679]: pgmap v10845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:26 smithi092 ceph-mon[29156]: pgmap v10845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:28.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:28 smithi189 ceph-mon[32756]: pgmap v10846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:28.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:28 smithi156 ceph-mon[32679]: pgmap v10846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:28.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:28 smithi092 ceph-mon[29156]: pgmap v10846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19384.634397 secs 2024-04-26T23:41:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18687.604164 secs 2024-04-26T23:41:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19384.634397 secs 2024-04-26T23:41:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18687.604164 secs 2024-04-26T23:41:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19384.634397 secs 2024-04-26T23:41:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18687.604164 secs 2024-04-26T23:41:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:30 smithi189 ceph-mon[32756]: pgmap v10847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:30 smithi156 ceph-mon[32679]: pgmap v10847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:30 smithi092 ceph-mon[29156]: pgmap v10847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:32.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:32 smithi189 ceph-mon[32756]: pgmap v10848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:32.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:32 smithi156 ceph-mon[32679]: pgmap v10848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:32 smithi092 ceph-mon[29156]: pgmap v10848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:34.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:34 smithi092 ceph-mon[29156]: pgmap v10849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:34.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19389.634537 secs 2024-04-26T23:41:34.549 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18692.604315 secs 2024-04-26T23:41:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:34 smithi189 ceph-mon[32756]: pgmap v10849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19389.634537 secs 2024-04-26T23:41:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18692.604315 secs 2024-04-26T23:41:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:34 smithi156 ceph-mon[32679]: pgmap v10849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19389.634537 secs 2024-04-26T23:41:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18692.604315 secs 2024-04-26T23:41:36.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:41:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:41:35.891+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:41:36.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:41:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:41:35.891+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:41:36.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:41:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:41:35.891+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:41:36.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:41:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:41:35.891+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:41:36.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:41:35 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:41:35.891+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:41:36.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:36 smithi189 ceph-mon[32756]: pgmap v10850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:36.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:36 smithi156 ceph-mon[32679]: pgmap v10850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:36 smithi092 ceph-mon[29156]: pgmap v10850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:38.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:38 smithi189 ceph-mon[32756]: pgmap v10851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:38.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:38 smithi156 ceph-mon[32679]: pgmap v10851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:38 smithi092 ceph-mon[29156]: pgmap v10851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19394.634647 secs 2024-04-26T23:41:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18697.604356 secs 2024-04-26T23:41:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19394.634647 secs 2024-04-26T23:41:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18697.604356 secs 2024-04-26T23:41:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19394.634647 secs 2024-04-26T23:41:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18697.604356 secs 2024-04-26T23:41:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:40 smithi189 ceph-mon[32756]: pgmap v10852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:40.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:40 smithi156 ceph-mon[32679]: pgmap v10852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:40 smithi092 ceph-mon[29156]: pgmap v10852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:42.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:42 smithi189 ceph-mon[32756]: pgmap v10853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:42.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:42 smithi156 ceph-mon[32679]: pgmap v10853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:42 smithi092 ceph-mon[29156]: pgmap v10853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:44 smithi189 ceph-mon[32756]: pgmap v10854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19399.634788 secs 2024-04-26T23:41:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18702.604472 secs 2024-04-26T23:41:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:44 smithi156 ceph-mon[32679]: pgmap v10854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19399.634788 secs 2024-04-26T23:41:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18702.604472 secs 2024-04-26T23:41:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:44 smithi092 ceph-mon[29156]: pgmap v10854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19399.634788 secs 2024-04-26T23:41:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18702.604472 secs 2024-04-26T23:41:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:46 smithi189 ceph-mon[32756]: pgmap v10855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:46 smithi156 ceph-mon[32679]: pgmap v10855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:46 smithi092 ceph-mon[29156]: pgmap v10855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:41:48.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:48 smithi189 ceph-mon[32756]: pgmap v10856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:48.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:48 smithi156 ceph-mon[32679]: pgmap v10856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:48 smithi092 ceph-mon[29156]: pgmap v10856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:41:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19404.634893 secs 2024-04-26T23:41:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18707.604541 secs 2024-04-26T23:41:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:50 smithi189 ceph-mon[32756]: pgmap v10857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:41:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19404.634893 secs 2024-04-26T23:41:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18707.604541 secs 2024-04-26T23:41:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:50 smithi156 ceph-mon[32679]: pgmap v10857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:41:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19404.634893 secs 2024-04-26T23:41:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18707.604541 secs 2024-04-26T23:41:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:50 smithi092 ceph-mon[29156]: pgmap v10857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:41:52.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:52 smithi189 ceph-mon[32756]: pgmap v10858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:52.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:52 smithi156 ceph-mon[32679]: pgmap v10858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:52.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:52 smithi092 ceph-mon[29156]: pgmap v10858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:54.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:54 smithi189 ceph-mon[32756]: pgmap v10859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:54.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:54 smithi156 ceph-mon[32679]: pgmap v10859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:54.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:54 smithi092 ceph-mon[29156]: pgmap v10859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:41:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19409.634978 secs 2024-04-26T23:41:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18712.604629 secs 2024-04-26T23:41:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19409.634978 secs 2024-04-26T23:41:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18712.604629 secs 2024-04-26T23:41:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19409.634978 secs 2024-04-26T23:41:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18712.604629 secs 2024-04-26T23:41:56.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:56 smithi189 ceph-mon[32756]: pgmap v10860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:41:56.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:56 smithi156 ceph-mon[32679]: pgmap v10860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:41:56.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:56 smithi092 ceph-mon[29156]: pgmap v10860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:41:58.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:41:58 smithi189 ceph-mon[32756]: pgmap v10861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T23:41:58.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:41:58 smithi156 ceph-mon[32679]: pgmap v10861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T23:41:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:41:58 smithi092 ceph-mon[29156]: pgmap v10861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-26T23:42:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:00 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19414.635089 secs 2024-04-26T23:42:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18717.604744 secs 2024-04-26T23:42:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:00 smithi189 ceph-mon[32756]: pgmap v10862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:00 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19414.635089 secs 2024-04-26T23:42:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18717.604744 secs 2024-04-26T23:42:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:00 smithi156 ceph-mon[32679]: pgmap v10862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:00 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19414.635089 secs 2024-04-26T23:42:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18717.604744 secs 2024-04-26T23:42:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:00 smithi092 ceph-mon[29156]: pgmap v10862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:02.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:02 smithi189 ceph-mon[32756]: pgmap v10863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:02 smithi156 ceph-mon[32679]: pgmap v10863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:02 smithi092 ceph-mon[29156]: pgmap v10863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:04.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:04 smithi092 ceph-mon[29156]: pgmap v10864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:04.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:04 smithi189 ceph-mon[32756]: pgmap v10864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:04.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:04 smithi156 ceph-mon[32679]: pgmap v10864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:42:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:05 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19419.635211 secs 2024-04-26T23:42:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18722.604860 secs 2024-04-26T23:42:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:05 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19419.635211 secs 2024-04-26T23:42:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18722.604860 secs 2024-04-26T23:42:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:05 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19419.635211 secs 2024-04-26T23:42:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18722.604860 secs 2024-04-26T23:42:06.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:06 smithi189 ceph-mon[32756]: pgmap v10865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:42:06.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:06 smithi156 ceph-mon[32679]: pgmap v10865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:42:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:06 smithi092 ceph-mon[29156]: pgmap v10865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:42:08.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:08 smithi189 ceph-mon[32756]: pgmap v10866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:08.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:08 smithi156 ceph-mon[32679]: pgmap v10866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:08 smithi092 ceph-mon[29156]: pgmap v10866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:09.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:42:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:42:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19424.635335 secs 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18727.604957 secs 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: pgmap v10867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:42:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19424.635335 secs 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18727.604957 secs 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: pgmap v10867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:42:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19424.635335 secs 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18727.604957 secs 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: pgmap v10867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:42:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:42:11.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:11 smithi189 ceph-mon[32756]: pgmap v10868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:42:11.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:11 smithi189 ceph-mon[32756]: pgmap v10869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:11.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:11 smithi156 ceph-mon[32679]: pgmap v10868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:42:11.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:11 smithi156 ceph-mon[32679]: pgmap v10869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:11 smithi092 ceph-mon[29156]: pgmap v10868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:42:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:11 smithi092 ceph-mon[29156]: pgmap v10869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:13.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:13 smithi189 ceph-mon[32756]: pgmap v10870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:13.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:13 smithi156 ceph-mon[32679]: pgmap v10870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:13 smithi092 ceph-mon[29156]: pgmap v10870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:15 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19429.635489 secs 2024-04-26T23:42:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:15 smithi189 ceph-mon[32756]: pgmap v10871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:15.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18732.605073 secs 2024-04-26T23:42:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:15 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19429.635489 secs 2024-04-26T23:42:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:15 smithi156 ceph-mon[32679]: pgmap v10871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18732.605073 secs 2024-04-26T23:42:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:15 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19429.635489 secs 2024-04-26T23:42:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:15 smithi092 ceph-mon[29156]: pgmap v10871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18732.605073 secs 2024-04-26T23:42:17.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:17 smithi189 ceph-mon[32756]: pgmap v10872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:17.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:17 smithi156 ceph-mon[32679]: pgmap v10872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:17.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:17 smithi092 ceph-mon[29156]: pgmap v10872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:42:19.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:19 smithi189 ceph-mon[32756]: pgmap v10873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:19 smithi156 ceph-mon[32679]: pgmap v10873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:19.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:19 smithi092 ceph-mon[29156]: pgmap v10873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:42:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:20 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19434.635586 secs 2024-04-26T23:42:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18737.605197 secs 2024-04-26T23:42:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:20 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19434.635586 secs 2024-04-26T23:42:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18737.605197 secs 2024-04-26T23:42:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:20 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19434.635586 secs 2024-04-26T23:42:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18737.605197 secs 2024-04-26T23:42:21.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:21 smithi189 ceph-mon[32756]: pgmap v10874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:42:21.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:21 smithi156 ceph-mon[32679]: pgmap v10874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:42:21.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:21 smithi092 ceph-mon[29156]: pgmap v10874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:42:23.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:23 smithi189 ceph-mon[32756]: pgmap v10875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:23.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:23 smithi156 ceph-mon[32679]: pgmap v10875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:23.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:23 smithi092 ceph-mon[29156]: pgmap v10875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19439.635722 secs 2024-04-26T23:42:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:25 smithi189 ceph-mon[32756]: pgmap v10876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18742.605348 secs 2024-04-26T23:42:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19439.635722 secs 2024-04-26T23:42:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:25 smithi156 ceph-mon[32679]: pgmap v10876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18742.605348 secs 2024-04-26T23:42:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19439.635722 secs 2024-04-26T23:42:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:25 smithi092 ceph-mon[29156]: pgmap v10876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18742.605348 secs 2024-04-26T23:42:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:27 smithi189 ceph-mon[32756]: pgmap v10877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:27 smithi156 ceph-mon[32679]: pgmap v10877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:27.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:27 smithi092 ceph-mon[29156]: pgmap v10877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:29.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:29 smithi189 ceph-mon[32756]: pgmap v10878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:29.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:29 smithi156 ceph-mon[32679]: pgmap v10878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:29 smithi092 ceph-mon[29156]: pgmap v10878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19444.635861 secs 2024-04-26T23:42:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18747.605470 secs 2024-04-26T23:42:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19444.635861 secs 2024-04-26T23:42:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18747.605470 secs 2024-04-26T23:42:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19444.635861 secs 2024-04-26T23:42:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18747.605470 secs 2024-04-26T23:42:31.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:31 smithi189 ceph-mon[32756]: pgmap v10879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:31.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:31 smithi156 ceph-mon[32679]: pgmap v10879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:31.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:31 smithi092 ceph-mon[29156]: pgmap v10879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:33.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:33 smithi189 ceph-mon[32756]: pgmap v10880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:33.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:33 smithi156 ceph-mon[32679]: pgmap v10880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:33.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:33 smithi092 ceph-mon[29156]: pgmap v10880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19449.635979 secs 2024-04-26T23:42:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:35 smithi189 ceph-mon[32756]: pgmap v10881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18752.605539 secs 2024-04-26T23:42:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19449.635979 secs 2024-04-26T23:42:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:35 smithi156 ceph-mon[32679]: pgmap v10881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18752.605539 secs 2024-04-26T23:42:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19449.635979 secs 2024-04-26T23:42:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:35 smithi092 ceph-mon[29156]: pgmap v10881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18752.605539 secs 2024-04-26T23:42:37.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:37 smithi189 ceph-mon[32756]: pgmap v10882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:37.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:37 smithi156 ceph-mon[32679]: pgmap v10882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:37.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:37 smithi092 ceph-mon[29156]: pgmap v10882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:42:38.648+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:42:38.652 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:42:38.648+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:42:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:42:38.648+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:42:38.653 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:42:38.648+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 152 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:42:39.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:39 smithi189 ceph-mon[32756]: pgmap v10883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:39.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:39 smithi156 ceph-mon[32679]: pgmap v10883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:39 smithi092 ceph-mon[29156]: pgmap v10883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19454.636104 secs 2024-04-26T23:42:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18757.605659 secs 2024-04-26T23:42:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19454.636104 secs 2024-04-26T23:42:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18757.605659 secs 2024-04-26T23:42:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19454.636104 secs 2024-04-26T23:42:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18757.605659 secs 2024-04-26T23:42:41.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:41 smithi189 ceph-mon[32756]: pgmap v10884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:41.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:41 smithi156 ceph-mon[32679]: pgmap v10884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:41 smithi092 ceph-mon[29156]: pgmap v10884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:43.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:43 smithi189 ceph-mon[32756]: pgmap v10885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:43.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:43 smithi156 ceph-mon[32679]: pgmap v10885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:43.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:43 smithi092 ceph-mon[29156]: pgmap v10885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19459.636229 secs 2024-04-26T23:42:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:45 smithi189 ceph-mon[32756]: pgmap v10886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18762.605768 secs 2024-04-26T23:42:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19459.636229 secs 2024-04-26T23:42:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:45 smithi156 ceph-mon[32679]: pgmap v10886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18762.605768 secs 2024-04-26T23:42:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19459.636229 secs 2024-04-26T23:42:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:45 smithi092 ceph-mon[29156]: pgmap v10886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18762.605768 secs 2024-04-26T23:42:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:47 smithi189 ceph-mon[32756]: pgmap v10887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:47 smithi156 ceph-mon[32679]: pgmap v10887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:47 smithi092 ceph-mon[29156]: pgmap v10887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:49.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:49 smithi156 ceph-mon[32679]: pgmap v10888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:49 smithi092 ceph-mon[29156]: pgmap v10888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:49 smithi189 ceph-mon[32756]: pgmap v10888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19464.636355 secs 2024-04-26T23:42:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18767.605886 secs 2024-04-26T23:42:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19464.636355 secs 2024-04-26T23:42:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18767.605886 secs 2024-04-26T23:42:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19464.636355 secs 2024-04-26T23:42:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18767.605886 secs 2024-04-26T23:42:51.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:51 smithi156 ceph-mon[32679]: pgmap v10889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:51.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:51 smithi092 ceph-mon[29156]: pgmap v10889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:51.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:51 smithi189 ceph-mon[32756]: pgmap v10889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:53.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:53 smithi156 ceph-mon[32679]: pgmap v10890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:53.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:53 smithi092 ceph-mon[29156]: pgmap v10890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:53.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:53 smithi189 ceph-mon[32756]: pgmap v10890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19469.636478 secs 2024-04-26T23:42:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:55 smithi156 ceph-mon[32679]: pgmap v10891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18772.606001 secs 2024-04-26T23:42:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19469.636478 secs 2024-04-26T23:42:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:55 smithi092 ceph-mon[29156]: pgmap v10891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18772.606001 secs 2024-04-26T23:42:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19469.636478 secs 2024-04-26T23:42:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:55 smithi189 ceph-mon[32756]: pgmap v10891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18772.606001 secs 2024-04-26T23:42:57.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:57 smithi156 ceph-mon[32679]: pgmap v10892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:57.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:57 smithi092 ceph-mon[29156]: pgmap v10892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:57.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:57 smithi189 ceph-mon[32756]: pgmap v10892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:42:59.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:42:59 smithi156 ceph-mon[32679]: pgmap v10893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:42:59 smithi092 ceph-mon[29156]: pgmap v10893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:42:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:42:59 smithi189 ceph-mon[32756]: pgmap v10893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:00 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19474.636599 secs 2024-04-26T23:43:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18777.606123 secs 2024-04-26T23:43:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:00 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19474.636599 secs 2024-04-26T23:43:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18777.606123 secs 2024-04-26T23:43:00.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:00 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19474.636599 secs 2024-04-26T23:43:00.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18777.606123 secs 2024-04-26T23:43:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:01 smithi156 ceph-mon[32679]: pgmap v10894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:01 smithi092 ceph-mon[29156]: pgmap v10894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:01 smithi189 ceph-mon[32756]: pgmap v10894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:03.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:03 smithi092 ceph-mon[29156]: pgmap v10895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:03 smithi156 ceph-mon[32679]: pgmap v10895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:03.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:03 smithi189 ceph-mon[32756]: pgmap v10895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:05 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19479.636758 secs 2024-04-26T23:43:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:05 smithi156 ceph-mon[32679]: pgmap v10896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18782.606254 secs 2024-04-26T23:43:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:05 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19479.636758 secs 2024-04-26T23:43:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:05 smithi092 ceph-mon[29156]: pgmap v10896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18782.606254 secs 2024-04-26T23:43:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:05 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19479.636758 secs 2024-04-26T23:43:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:05 smithi189 ceph-mon[32756]: pgmap v10896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18782.606254 secs 2024-04-26T23:43:07.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:07 smithi156 ceph-mon[32679]: pgmap v10897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:07.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:07 smithi092 ceph-mon[29156]: pgmap v10897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:07.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:07 smithi189 ceph-mon[32756]: pgmap v10897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:09.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:09 smithi156 ceph-mon[32679]: pgmap v10898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:09.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:09 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 18787.606348 secs 2024-04-26T23:43:09.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:09 smithi156 ceph-mon[32679]: slow request 723.025896 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:43:09.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:09 smithi189 ceph-mon[32756]: pgmap v10898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:09.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:09 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 18787.606348 secs 2024-04-26T23:43:09.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:09 smithi189 ceph-mon[32756]: slow request 723.025896 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:43:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:09 smithi092 ceph-mon[29156]: pgmap v10898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:09.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:09 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 18787.606348 secs 2024-04-26T23:43:09.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:09 smithi092 ceph-mon[29156]: slow request 723.025896 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:43:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19484.636910 secs 2024-04-26T23:43:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:43:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19484.636910 secs 2024-04-26T23:43:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:43:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19484.636910 secs 2024-04-26T23:43:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: pgmap v10899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: pgmap v10900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: pgmap v10901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: pgmap v10899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: pgmap v10900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: pgmap v10901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: pgmap v10899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: pgmap v10900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: pgmap v10901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:43:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:13 smithi092 ceph-mon[29156]: pgmap v10902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:13 smithi189 ceph-mon[32756]: pgmap v10902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:13.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:13 smithi156 ceph-mon[32679]: pgmap v10902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19489.637036 secs 2024-04-26T23:43:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18792.606414 secs 2024-04-26T23:43:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19489.637036 secs 2024-04-26T23:43:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18792.606414 secs 2024-04-26T23:43:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19489.637036 secs 2024-04-26T23:43:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18792.606414 secs 2024-04-26T23:43:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:15 smithi092 ceph-mon[29156]: pgmap v10903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:15 smithi189 ceph-mon[32756]: pgmap v10903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:15.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:15 smithi156 ceph-mon[32679]: pgmap v10903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:17 smithi092 ceph-mon[29156]: pgmap v10904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:17 smithi189 ceph-mon[32756]: pgmap v10904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:17.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:17 smithi156 ceph-mon[32679]: pgmap v10904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:43:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:19 smithi092 ceph-mon[29156]: pgmap v10905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:43:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19494.637100 secs 2024-04-26T23:43:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18797.606536 secs 2024-04-26T23:43:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:19 smithi189 ceph-mon[32756]: pgmap v10905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:43:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19494.637100 secs 2024-04-26T23:43:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18797.606536 secs 2024-04-26T23:43:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:19 smithi156 ceph-mon[32679]: pgmap v10905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:43:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19494.637100 secs 2024-04-26T23:43:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18797.606536 secs 2024-04-26T23:43:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:21 smithi092 ceph-mon[29156]: pgmap v10906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:43:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:21 smithi189 ceph-mon[32756]: pgmap v10906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:43:21.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:21 smithi156 ceph-mon[32679]: pgmap v10906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:43:23.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:23 smithi092 ceph-mon[29156]: pgmap v10907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:23 smithi189 ceph-mon[32756]: pgmap v10907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:23.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:23 smithi156 ceph-mon[32679]: pgmap v10907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19499.637218 secs 2024-04-26T23:43:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18802.606622 secs 2024-04-26T23:43:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19499.637218 secs 2024-04-26T23:43:24.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18802.606622 secs 2024-04-26T23:43:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19499.637218 secs 2024-04-26T23:43:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18802.606622 secs 2024-04-26T23:43:25.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:25 smithi092 ceph-mon[29156]: pgmap v10908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:25 smithi189 ceph-mon[32756]: pgmap v10908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:25.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:25 smithi156 ceph-mon[32679]: pgmap v10908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:27 smithi092 ceph-mon[29156]: pgmap v10909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:27.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:27 smithi189 ceph-mon[32756]: pgmap v10909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:27.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:27 smithi156 ceph-mon[32679]: pgmap v10909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:29 smithi092 ceph-mon[29156]: pgmap v10910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19504.637316 secs 2024-04-26T23:43:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18807.606730 secs 2024-04-26T23:43:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:29 smithi189 ceph-mon[32756]: pgmap v10910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19504.637316 secs 2024-04-26T23:43:29.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18807.606730 secs 2024-04-26T23:43:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:29 smithi156 ceph-mon[32679]: pgmap v10910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19504.637316 secs 2024-04-26T23:43:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18807.606730 secs 2024-04-26T23:43:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:31 smithi092 ceph-mon[29156]: pgmap v10911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:31.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:31 smithi189 ceph-mon[32756]: pgmap v10911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:31.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:31 smithi156 ceph-mon[32679]: pgmap v10911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:33.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:33 smithi189 ceph-mon[32756]: pgmap v10912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:33.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:33 smithi156 ceph-mon[32679]: pgmap v10912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:33 smithi092 ceph-mon[29156]: pgmap v10912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19509.637434 secs 2024-04-26T23:43:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18812.606835 secs 2024-04-26T23:43:34.898 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19509.637434 secs 2024-04-26T23:43:34.899 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18812.606835 secs 2024-04-26T23:43:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19509.637434 secs 2024-04-26T23:43:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18812.606835 secs 2024-04-26T23:43:35.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:35 smithi189 ceph-mon[32756]: pgmap v10913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:35.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:35 smithi156 ceph-mon[32679]: pgmap v10913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:35 smithi092 ceph-mon[29156]: pgmap v10913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:37.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:37 smithi189 ceph-mon[32756]: pgmap v10914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:37.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:37 smithi156 ceph-mon[32679]: pgmap v10914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:37.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:37 smithi092 ceph-mon[29156]: pgmap v10914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:39 smithi189 ceph-mon[32756]: pgmap v10915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19514.637547 secs 2024-04-26T23:43:39.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18817.606963 secs 2024-04-26T23:43:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:39 smithi156 ceph-mon[32679]: pgmap v10915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19514.637547 secs 2024-04-26T23:43:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18817.606963 secs 2024-04-26T23:43:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:39 smithi092 ceph-mon[29156]: pgmap v10915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19514.637547 secs 2024-04-26T23:43:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18817.606963 secs 2024-04-26T23:43:41.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:41 smithi189 ceph-mon[32756]: pgmap v10916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:41.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:41 smithi156 ceph-mon[32679]: pgmap v10916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:41.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:41 smithi092 ceph-mon[29156]: pgmap v10916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:43.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:43 smithi189 ceph-mon[32756]: pgmap v10917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:43.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:43 smithi156 ceph-mon[32679]: pgmap v10917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:43.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:43 smithi092 ceph-mon[29156]: pgmap v10917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19519.637616 secs 2024-04-26T23:43:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18822.607079 secs 2024-04-26T23:43:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19519.637616 secs 2024-04-26T23:43:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18822.607079 secs 2024-04-26T23:43:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19519.637616 secs 2024-04-26T23:43:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18822.607079 secs 2024-04-26T23:43:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:45 smithi189 ceph-mon[32756]: pgmap v10918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:45 smithi156 ceph-mon[32679]: pgmap v10918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:45.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:45 smithi092 ceph-mon[29156]: pgmap v10918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:47.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:47 smithi189 ceph-mon[32756]: pgmap v10919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:47.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:47 smithi156 ceph-mon[32679]: pgmap v10919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:47.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:47 smithi092 ceph-mon[29156]: pgmap v10919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:49 smithi189 ceph-mon[32756]: pgmap v10920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19524.637734 secs 2024-04-26T23:43:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18827.607180 secs 2024-04-26T23:43:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:49 smithi156 ceph-mon[32679]: pgmap v10920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19524.637734 secs 2024-04-26T23:43:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18827.607180 secs 2024-04-26T23:43:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:49 smithi092 ceph-mon[29156]: pgmap v10920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19524.637734 secs 2024-04-26T23:43:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18827.607180 secs 2024-04-26T23:43:51.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:51 smithi189 ceph-mon[32756]: pgmap v10921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:51.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:51 smithi156 ceph-mon[32679]: pgmap v10921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:51.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:51 smithi092 ceph-mon[29156]: pgmap v10921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:53.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:53 smithi189 ceph-mon[32756]: pgmap v10922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:53.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:53 smithi156 ceph-mon[32679]: pgmap v10922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:53 smithi092 ceph-mon[29156]: pgmap v10922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19529.637839 secs 2024-04-26T23:43:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18832.607323 secs 2024-04-26T23:43:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19529.637839 secs 2024-04-26T23:43:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18832.607323 secs 2024-04-26T23:43:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19529.637839 secs 2024-04-26T23:43:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18832.607323 secs 2024-04-26T23:43:55.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:55 smithi189 ceph-mon[32756]: pgmap v10923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:55.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:55 smithi156 ceph-mon[32679]: pgmap v10923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:55.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:55 smithi092 ceph-mon[29156]: pgmap v10923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:43:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:57 smithi189 ceph-mon[32756]: pgmap v10924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:57.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:57 smithi156 ceph-mon[32679]: pgmap v10924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:57 smithi092 ceph-mon[29156]: pgmap v10924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:59 smithi189 ceph-mon[32756]: pgmap v10925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19534.637933 secs 2024-04-26T23:43:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:43:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18837.607440 secs 2024-04-26T23:43:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:59 smithi156 ceph-mon[32679]: pgmap v10925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19534.637933 secs 2024-04-26T23:43:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:43:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18837.607440 secs 2024-04-26T23:43:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:59 smithi092 ceph-mon[29156]: pgmap v10925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:43:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19534.637933 secs 2024-04-26T23:43:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:43:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18837.607440 secs 2024-04-26T23:44:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:01 smithi189 ceph-mon[32756]: pgmap v10926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:01.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:01 smithi156 ceph-mon[32679]: pgmap v10926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:01.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:01 smithi092 ceph-mon[29156]: pgmap v10926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:03.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:03 smithi189 ceph-mon[32756]: pgmap v10927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:03.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:03 smithi156 ceph-mon[32679]: pgmap v10927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:03.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:03 smithi092 ceph-mon[29156]: pgmap v10927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:05.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:05 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19539.638066 secs 2024-04-26T23:44:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18842.607557 secs 2024-04-26T23:44:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:05 smithi092 ceph-mon[29156]: pgmap v10928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:05 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19539.638066 secs 2024-04-26T23:44:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18842.607557 secs 2024-04-26T23:44:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:05 smithi189 ceph-mon[32756]: pgmap v10928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:05 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19539.638066 secs 2024-04-26T23:44:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18842.607557 secs 2024-04-26T23:44:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:05 smithi156 ceph-mon[32679]: pgmap v10928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:07 smithi092 ceph-mon[29156]: pgmap v10929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:07 smithi189 ceph-mon[32756]: pgmap v10929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:07 smithi156 ceph-mon[32679]: pgmap v10929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:09.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:09 smithi156 ceph-mon[32679]: pgmap v10930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:09.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19544.638181 secs 2024-04-26T23:44:09.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18847.607624 secs 2024-04-26T23:44:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:09 smithi092 ceph-mon[29156]: pgmap v10930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19544.638181 secs 2024-04-26T23:44:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18847.607624 secs 2024-04-26T23:44:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:09 smithi189 ceph-mon[32756]: pgmap v10930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19544.638181 secs 2024-04-26T23:44:09.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18847.607624 secs 2024-04-26T23:44:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:11 smithi092 ceph-mon[29156]: pgmap v10931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:44:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:44:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:44:11.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:44:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:11 smithi189 ceph-mon[32756]: pgmap v10931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:44:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:44:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:44:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:44:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:11 smithi156 ceph-mon[32679]: pgmap v10931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:44:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:44:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:44:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:44:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:12 smithi092 ceph-mon[29156]: pgmap v10932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:44:12.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:12 smithi092 ceph-mon[29156]: pgmap v10933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:12 smithi189 ceph-mon[32756]: pgmap v10932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:44:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:12 smithi189 ceph-mon[32756]: pgmap v10933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:12 smithi156 ceph-mon[32679]: pgmap v10932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:44:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:12 smithi156 ceph-mon[32679]: pgmap v10933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:14 smithi092 ceph-mon[29156]: pgmap v10934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:44:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19549.638293 secs 2024-04-26T23:44:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18852.607764 secs 2024-04-26T23:44:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:14 smithi189 ceph-mon[32756]: pgmap v10934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:44:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19549.638293 secs 2024-04-26T23:44:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18852.607764 secs 2024-04-26T23:44:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:14 smithi156 ceph-mon[32679]: pgmap v10934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:44:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19549.638293 secs 2024-04-26T23:44:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18852.607764 secs 2024-04-26T23:44:16.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:16 smithi092 ceph-mon[29156]: pgmap v10935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:16.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:16 smithi189 ceph-mon[32756]: pgmap v10935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:16.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:16 smithi156 ceph-mon[32679]: pgmap v10935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:18 smithi092 ceph-mon[29156]: pgmap v10936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:18.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:18 smithi189 ceph-mon[32756]: pgmap v10936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:18.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:18 smithi156 ceph-mon[32679]: pgmap v10936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19554.638437 secs 2024-04-26T23:44:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18857.607907 secs 2024-04-26T23:44:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19554.638437 secs 2024-04-26T23:44:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18857.607907 secs 2024-04-26T23:44:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19554.638437 secs 2024-04-26T23:44:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18857.607907 secs 2024-04-26T23:44:20.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:20 smithi092 ceph-mon[29156]: pgmap v10937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:20 smithi189 ceph-mon[32756]: pgmap v10937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:20.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:20 smithi156 ceph-mon[32679]: pgmap v10937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:44:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:22 smithi189 ceph-mon[32756]: pgmap v10938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:44:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:22 smithi156 ceph-mon[32679]: pgmap v10938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:44:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:22 smithi092 ceph-mon[29156]: pgmap v10938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:44:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:24 smithi189 ceph-mon[32756]: pgmap v10939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:24.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19559.638569 secs 2024-04-26T23:44:24.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18862.608039 secs 2024-04-26T23:44:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:24 smithi156 ceph-mon[32679]: pgmap v10939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19559.638569 secs 2024-04-26T23:44:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18862.608039 secs 2024-04-26T23:44:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:24 smithi092 ceph-mon[29156]: pgmap v10939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19559.638569 secs 2024-04-26T23:44:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18862.608039 secs 2024-04-26T23:44:26.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:26 smithi189 ceph-mon[32756]: pgmap v10940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:26.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:26 smithi156 ceph-mon[32679]: pgmap v10940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:26 smithi092 ceph-mon[29156]: pgmap v10940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:28.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:28 smithi189 ceph-mon[32756]: pgmap v10941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:28.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:28 smithi156 ceph-mon[32679]: pgmap v10941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:28 smithi092 ceph-mon[29156]: pgmap v10941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19564.638687 secs 2024-04-26T23:44:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18867.608160 secs 2024-04-26T23:44:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19564.638687 secs 2024-04-26T23:44:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18867.608160 secs 2024-04-26T23:44:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19564.638687 secs 2024-04-26T23:44:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18867.608160 secs 2024-04-26T23:44:30.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:30 smithi189 ceph-mon[32756]: pgmap v10942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:30.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:30 smithi156 ceph-mon[32679]: pgmap v10942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:30 smithi092 ceph-mon[29156]: pgmap v10942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:32.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:32 smithi189 ceph-mon[32756]: pgmap v10943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:32.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:32 smithi156 ceph-mon[32679]: pgmap v10943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:32 smithi092 ceph-mon[29156]: pgmap v10943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:34 smithi189 ceph-mon[32756]: pgmap v10944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19569.638749 secs 2024-04-26T23:44:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18872.608273 secs 2024-04-26T23:44:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:34 smithi156 ceph-mon[32679]: pgmap v10944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19569.638749 secs 2024-04-26T23:44:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18872.608273 secs 2024-04-26T23:44:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:34 smithi092 ceph-mon[29156]: pgmap v10944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19569.638749 secs 2024-04-26T23:44:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18872.608273 secs 2024-04-26T23:44:36.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:36 smithi092 ceph-mon[29156]: pgmap v10945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:36.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:36 smithi189 ceph-mon[32756]: pgmap v10945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:36.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:36 smithi156 ceph-mon[32679]: pgmap v10945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:38.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:38 smithi189 ceph-mon[32756]: pgmap v10946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:38.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:38 smithi156 ceph-mon[32679]: pgmap v10946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:38.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:38 smithi092 ceph-mon[29156]: pgmap v10946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:39.793 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19574.638896 secs 2024-04-26T23:44:39.793 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18877.608394 secs 2024-04-26T23:44:39.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19574.638896 secs 2024-04-26T23:44:39.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18877.608394 secs 2024-04-26T23:44:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19574.638896 secs 2024-04-26T23:44:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18877.608394 secs 2024-04-26T23:44:40.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:40 smithi189 ceph-mon[32756]: pgmap v10947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:40.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:40 smithi156 ceph-mon[32679]: pgmap v10947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:40.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:40 smithi092 ceph-mon[29156]: pgmap v10947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:42.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:42 smithi189 ceph-mon[32756]: pgmap v10948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:42.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:42 smithi156 ceph-mon[32679]: pgmap v10948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:42.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:42 smithi092 ceph-mon[29156]: pgmap v10948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:44 smithi189 ceph-mon[32756]: pgmap v10949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19579.639019 secs 2024-04-26T23:44:44.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18882.608452 secs 2024-04-26T23:44:44.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:44 smithi156 ceph-mon[32679]: pgmap v10949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:44.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19579.639019 secs 2024-04-26T23:44:44.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18882.608452 secs 2024-04-26T23:44:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:44 smithi092 ceph-mon[29156]: pgmap v10949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19579.639019 secs 2024-04-26T23:44:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18882.608452 secs 2024-04-26T23:44:46.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:46 smithi189 ceph-mon[32756]: pgmap v10950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:46.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:46 smithi156 ceph-mon[32679]: pgmap v10950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:46.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:46 smithi092 ceph-mon[29156]: pgmap v10950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:48.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:48 smithi189 ceph-mon[32756]: pgmap v10951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:48.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:48 smithi156 ceph-mon[32679]: pgmap v10951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:48.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:48 smithi092 ceph-mon[29156]: pgmap v10951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19584.639084 secs 2024-04-26T23:44:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18887.608574 secs 2024-04-26T23:44:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19584.639084 secs 2024-04-26T23:44:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18887.608574 secs 2024-04-26T23:44:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19584.639084 secs 2024-04-26T23:44:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18887.608574 secs 2024-04-26T23:44:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:50 smithi189 ceph-mon[32756]: pgmap v10952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:50.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:50 smithi156 ceph-mon[32679]: pgmap v10952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:50 smithi092 ceph-mon[29156]: pgmap v10952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:52.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:52 smithi189 ceph-mon[32756]: pgmap v10953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:52.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:52 smithi156 ceph-mon[32679]: pgmap v10953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:52.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:52 smithi092 ceph-mon[29156]: pgmap v10953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:54 smithi189 ceph-mon[32756]: pgmap v10954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19589.639199 secs 2024-04-26T23:44:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18892.608693 secs 2024-04-26T23:44:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:54 smithi156 ceph-mon[32679]: pgmap v10954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19589.639199 secs 2024-04-26T23:44:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18892.608693 secs 2024-04-26T23:44:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:54 smithi092 ceph-mon[29156]: pgmap v10954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19589.639199 secs 2024-04-26T23:44:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18892.608693 secs 2024-04-26T23:44:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:56 smithi189 ceph-mon[32756]: pgmap v10955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:56.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:56 smithi156 ceph-mon[32679]: pgmap v10955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:56 smithi092 ceph-mon[29156]: pgmap v10955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:44:58.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:58 smithi189 ceph-mon[32756]: pgmap v10956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:58.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:58 smithi156 ceph-mon[32679]: pgmap v10956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:58.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:58 smithi092 ceph-mon[29156]: pgmap v10956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:44:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19594.639311 secs 2024-04-26T23:44:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:44:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18897.608810 secs 2024-04-26T23:44:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19594.639311 secs 2024-04-26T23:44:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:44:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18897.608810 secs 2024-04-26T23:44:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19594.639311 secs 2024-04-26T23:44:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:44:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18897.608810 secs 2024-04-26T23:45:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:00 smithi189 ceph-mon[32756]: pgmap v10957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:00.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:00 smithi156 ceph-mon[32679]: pgmap v10957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:00.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:00 smithi092 ceph-mon[29156]: pgmap v10957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:02.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:02 smithi189 ceph-mon[32756]: pgmap v10958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:02.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:02 smithi156 ceph-mon[32679]: pgmap v10958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:02.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:02 smithi092 ceph-mon[29156]: pgmap v10958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:04 smithi189 ceph-mon[32756]: pgmap v10959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:04.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19599.639372 secs 2024-04-26T23:45:04.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18902.608961 secs 2024-04-26T23:45:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:04 smithi156 ceph-mon[32679]: pgmap v10959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19599.639372 secs 2024-04-26T23:45:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18902.608961 secs 2024-04-26T23:45:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:04 smithi092 ceph-mon[29156]: pgmap v10959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19599.639372 secs 2024-04-26T23:45:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18902.608961 secs 2024-04-26T23:45:06.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:06 smithi092 ceph-mon[29156]: pgmap v10960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:06 smithi189 ceph-mon[32756]: pgmap v10960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:06.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:06 smithi156 ceph-mon[32679]: pgmap v10960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:08 smithi189 ceph-mon[32756]: pgmap v10961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:08.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:08 smithi156 ceph-mon[32679]: pgmap v10961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:08.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:08 smithi092 ceph-mon[29156]: pgmap v10961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19604.639464 secs 2024-04-26T23:45:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18907.609073 secs 2024-04-26T23:45:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19604.639464 secs 2024-04-26T23:45:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18907.609073 secs 2024-04-26T23:45:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19604.639464 secs 2024-04-26T23:45:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18907.609073 secs 2024-04-26T23:45:10.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:10 smithi189 ceph-mon[32756]: pgmap v10962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:10.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:10 smithi156 ceph-mon[32679]: pgmap v10962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:10.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:10 smithi092 ceph-mon[29156]: pgmap v10962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:45:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:45:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:45:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:12 smithi189 ceph-mon[32756]: pgmap v10963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:45:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:45:12.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:45:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:12 smithi156 ceph-mon[32679]: pgmap v10963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:45:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:45:12.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:45:12.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:12 smithi092 ceph-mon[29156]: pgmap v10963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:12.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:45:12.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:45:12.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:45:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:13 smithi189 ceph-mon[32756]: pgmap v10964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:45:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:13 smithi189 ceph-mon[32756]: pgmap v10965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:13.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:13 smithi156 ceph-mon[32679]: pgmap v10964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:45:13.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:13 smithi156 ceph-mon[32679]: pgmap v10965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:13.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:13 smithi092 ceph-mon[29156]: pgmap v10964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:45:13.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:13 smithi092 ceph-mon[29156]: pgmap v10965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19609.639602 secs 2024-04-26T23:45:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18912.609179 secs 2024-04-26T23:45:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19609.639602 secs 2024-04-26T23:45:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18912.609179 secs 2024-04-26T23:45:14.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19609.639602 secs 2024-04-26T23:45:14.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18912.609179 secs 2024-04-26T23:45:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:15 smithi189 ceph-mon[32756]: pgmap v10966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:15.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:15 smithi156 ceph-mon[32679]: pgmap v10966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:15.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:15 smithi092 ceph-mon[29156]: pgmap v10966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:17 smithi189 ceph-mon[32756]: pgmap v10967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:17.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:17 smithi156 ceph-mon[32679]: pgmap v10967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:17 smithi092 ceph-mon[29156]: pgmap v10967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:18.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:18 smithi156 ceph-mon[32679]: pgmap v10968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:45:18.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:18 smithi092 ceph-mon[29156]: pgmap v10968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:45:19.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:18 smithi189 ceph-mon[32756]: pgmap v10968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:45:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19614.639725 secs 2024-04-26T23:45:19.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18917.609321 secs 2024-04-26T23:45:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19614.639725 secs 2024-04-26T23:45:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18917.609321 secs 2024-04-26T23:45:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19614.639725 secs 2024-04-26T23:45:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18917.609321 secs 2024-04-26T23:45:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:20 smithi092 ceph-mon[29156]: pgmap v10969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:21.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:20 smithi189 ceph-mon[32756]: pgmap v10969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:21.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:20 smithi156 ceph-mon[32679]: pgmap v10969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:45:23.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:23 smithi189 ceph-mon[32756]: pgmap v10970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:45:23.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:23 smithi156 ceph-mon[32679]: pgmap v10970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:45:23.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:23 smithi092 ceph-mon[29156]: pgmap v10970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:45:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19619.639852 secs 2024-04-26T23:45:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18922.609471 secs 2024-04-26T23:45:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:25 smithi189 ceph-mon[32756]: pgmap v10971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19619.639852 secs 2024-04-26T23:45:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18922.609471 secs 2024-04-26T23:45:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:25 smithi156 ceph-mon[32679]: pgmap v10971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19619.639852 secs 2024-04-26T23:45:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18922.609471 secs 2024-04-26T23:45:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:25 smithi092 ceph-mon[29156]: pgmap v10971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:27 smithi189 ceph-mon[32756]: pgmap v10972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:27 smithi156 ceph-mon[32679]: pgmap v10972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:27.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:27 smithi092 ceph-mon[29156]: pgmap v10972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:29.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:29 smithi189 ceph-mon[32756]: pgmap v10973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:29.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:29 smithi156 ceph-mon[32679]: pgmap v10973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:29.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:29 smithi092 ceph-mon[29156]: pgmap v10973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19624.639895 secs 2024-04-26T23:45:30.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18927.609594 secs 2024-04-26T23:45:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19624.639895 secs 2024-04-26T23:45:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18927.609594 secs 2024-04-26T23:45:30.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19624.639895 secs 2024-04-26T23:45:30.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18927.609594 secs 2024-04-26T23:45:31.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:31 smithi189 ceph-mon[32756]: pgmap v10974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:31.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:31 smithi156 ceph-mon[32679]: pgmap v10974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:31.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:31 smithi092 ceph-mon[29156]: pgmap v10974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:33.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:33 smithi189 ceph-mon[32756]: pgmap v10975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:33.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:33 smithi156 ceph-mon[32679]: pgmap v10975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:33.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:33 smithi092 ceph-mon[29156]: pgmap v10975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19629.640017 secs 2024-04-26T23:45:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18932.609728 secs 2024-04-26T23:45:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:35 smithi189 ceph-mon[32756]: pgmap v10976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19629.640017 secs 2024-04-26T23:45:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18932.609728 secs 2024-04-26T23:45:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:35 smithi156 ceph-mon[32679]: pgmap v10976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19629.640017 secs 2024-04-26T23:45:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18932.609728 secs 2024-04-26T23:45:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:35 smithi092 ceph-mon[29156]: pgmap v10976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:37.299 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:37 smithi092 ceph-mon[29156]: pgmap v10977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:37.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:37 smithi189 ceph-mon[32756]: pgmap v10977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:37.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:37 smithi156 ceph-mon[32679]: pgmap v10977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:45:38.673+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:45:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:45:38.673+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:45:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:45:38.673+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:45:38.677 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:45:38.673+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 153 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:45:39.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:39 smithi189 ceph-mon[32756]: pgmap v10978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:39.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:39 smithi156 ceph-mon[32679]: pgmap v10978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:39.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:39 smithi092 ceph-mon[29156]: pgmap v10978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19634.640134 secs 2024-04-26T23:45:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:40 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 18937.609849 secs 2024-04-26T23:45:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:40 smithi189 ceph-mon[32756]: slow request 5764.266649 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:45:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19634.640134 secs 2024-04-26T23:45:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:40 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 18937.609849 secs 2024-04-26T23:45:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:40 smithi156 ceph-mon[32679]: slow request 5764.266649 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:45:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19634.640134 secs 2024-04-26T23:45:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:40 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 18937.609849 secs 2024-04-26T23:45:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:40 smithi092 ceph-mon[29156]: slow request 5764.266649 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:45:41.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:41 smithi189 ceph-mon[32756]: pgmap v10979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:41.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:41 smithi156 ceph-mon[32679]: pgmap v10979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:41.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:41 smithi092 ceph-mon[29156]: pgmap v10979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:43.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:43 smithi189 ceph-mon[32756]: pgmap v10980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:43.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:43 smithi156 ceph-mon[32679]: pgmap v10980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:43.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:43 smithi092 ceph-mon[29156]: pgmap v10980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19639.640250 secs 2024-04-26T23:45:45.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18942.609990 secs 2024-04-26T23:45:45.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:45 smithi189 ceph-mon[32756]: pgmap v10981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19639.640250 secs 2024-04-26T23:45:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18942.609990 secs 2024-04-26T23:45:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:45 smithi156 ceph-mon[32679]: pgmap v10981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19639.640250 secs 2024-04-26T23:45:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18942.609990 secs 2024-04-26T23:45:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:45 smithi092 ceph-mon[29156]: pgmap v10981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:47.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:47 smithi189 ceph-mon[32756]: pgmap v10982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:47.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:47 smithi156 ceph-mon[32679]: pgmap v10982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:47.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:47 smithi092 ceph-mon[29156]: pgmap v10982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:49.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:49 smithi189 ceph-mon[32756]: pgmap v10983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:49.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:49 smithi156 ceph-mon[32679]: pgmap v10983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:49.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:49 smithi092 ceph-mon[29156]: pgmap v10983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19644.640388 secs 2024-04-26T23:45:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18947.610123 secs 2024-04-26T23:45:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19644.640388 secs 2024-04-26T23:45:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18947.610123 secs 2024-04-26T23:45:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19644.640388 secs 2024-04-26T23:45:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18947.610123 secs 2024-04-26T23:45:51.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:51 smithi189 ceph-mon[32756]: pgmap v10984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:51.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:51 smithi156 ceph-mon[32679]: pgmap v10984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:51.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:51 smithi092 ceph-mon[29156]: pgmap v10984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:53.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:53 smithi189 ceph-mon[32756]: pgmap v10985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:53.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:53 smithi156 ceph-mon[32679]: pgmap v10985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:53.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:53 smithi092 ceph-mon[29156]: pgmap v10985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19649.640509 secs 2024-04-26T23:45:55.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18952.610235 secs 2024-04-26T23:45:55.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:55 smithi189 ceph-mon[32756]: pgmap v10986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19649.640509 secs 2024-04-26T23:45:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18952.610235 secs 2024-04-26T23:45:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:55 smithi156 ceph-mon[32679]: pgmap v10986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19649.640509 secs 2024-04-26T23:45:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18952.610235 secs 2024-04-26T23:45:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:55 smithi092 ceph-mon[29156]: pgmap v10986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:45:57.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:57 smithi189 ceph-mon[32756]: pgmap v10987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:57.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:57 smithi156 ceph-mon[32679]: pgmap v10987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:57.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:57 smithi092 ceph-mon[29156]: pgmap v10987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:45:59 smithi189 ceph-mon[32756]: pgmap v10988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:59.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:45:59 smithi156 ceph-mon[32679]: pgmap v10988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:45:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:45:59 smithi092 ceph-mon[29156]: pgmap v10988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:00 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19654.640626 secs 2024-04-26T23:46:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18957.610362 secs 2024-04-26T23:46:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:00 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19654.640626 secs 2024-04-26T23:46:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18957.610362 secs 2024-04-26T23:46:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:00 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19654.640626 secs 2024-04-26T23:46:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18957.610362 secs 2024-04-26T23:46:01.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:01 smithi189 ceph-mon[32756]: pgmap v10989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:01.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:01 smithi156 ceph-mon[32679]: pgmap v10989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:01.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:01 smithi092 ceph-mon[29156]: pgmap v10989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:03.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:03 smithi189 ceph-mon[32756]: pgmap v10990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:03.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:03 smithi156 ceph-mon[32679]: pgmap v10990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:03.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:03 smithi092 ceph-mon[29156]: pgmap v10990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:05 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19659.640758 secs 2024-04-26T23:46:05.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18962.610468 secs 2024-04-26T23:46:05.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:05 smithi189 ceph-mon[32756]: pgmap v10991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:05 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19659.640758 secs 2024-04-26T23:46:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18962.610468 secs 2024-04-26T23:46:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:05 smithi156 ceph-mon[32679]: pgmap v10991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:05 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19659.640758 secs 2024-04-26T23:46:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18962.610468 secs 2024-04-26T23:46:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:05 smithi092 ceph-mon[29156]: pgmap v10991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:07.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:07 smithi189 ceph-mon[32756]: pgmap v10992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:07.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:07 smithi156 ceph-mon[32679]: pgmap v10992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:07.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:07 smithi092 ceph-mon[29156]: pgmap v10992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:09.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:09 smithi189 ceph-mon[32756]: pgmap v10993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:09.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:09 smithi156 ceph-mon[32679]: pgmap v10993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:09 smithi092 ceph-mon[29156]: pgmap v10993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19664.640875 secs 2024-04-26T23:46:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18967.610530 secs 2024-04-26T23:46:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19664.640875 secs 2024-04-26T23:46:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18967.610530 secs 2024-04-26T23:46:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19664.640875 secs 2024-04-26T23:46:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18967.610530 secs 2024-04-26T23:46:11.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:11 smithi189 ceph-mon[32756]: pgmap v10994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:11.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:11 smithi156 ceph-mon[32679]: pgmap v10994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:11 smithi092 ceph-mon[29156]: pgmap v10994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:12.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:46:12.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:46:12.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:46:13.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:13 smithi189 ceph-mon[32756]: pgmap v10995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:13.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:46:13.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:46:13.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:46:13.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:13 smithi156 ceph-mon[32679]: pgmap v10995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:13.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:46:13.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:46:13.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:46:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:13 smithi092 ceph-mon[29156]: pgmap v10995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:46:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:46:13.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:46:14.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:14 smithi189 ceph-mon[32756]: pgmap v10996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:46:14.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:14 smithi189 ceph-mon[32756]: pgmap v10997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:46:14.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:14 smithi156 ceph-mon[32679]: pgmap v10996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:46:14.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:14 smithi156 ceph-mon[32679]: pgmap v10997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:46:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:14 smithi092 ceph-mon[29156]: pgmap v10996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:46:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:14 smithi092 ceph-mon[29156]: pgmap v10997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:46:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:15 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19669.640916 secs 2024-04-26T23:46:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18972.610614 secs 2024-04-26T23:46:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:15 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19669.640916 secs 2024-04-26T23:46:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18972.610614 secs 2024-04-26T23:46:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:15 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19669.640916 secs 2024-04-26T23:46:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18972.610614 secs 2024-04-26T23:46:16.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:16 smithi189 ceph-mon[32756]: pgmap v10998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:16.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:16 smithi156 ceph-mon[32679]: pgmap v10998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:16.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:16 smithi092 ceph-mon[29156]: pgmap v10998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:18.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:18 smithi156 ceph-mon[32679]: pgmap v10999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:18.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:18 smithi092 ceph-mon[29156]: pgmap v10999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:18 smithi189 ceph-mon[32756]: pgmap v10999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:20 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19674.641027 secs 2024-04-26T23:46:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:20 smithi156 ceph-mon[32679]: pgmap v11000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18977.610692 secs 2024-04-26T23:46:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:20 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19674.641027 secs 2024-04-26T23:46:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:20 smithi092 ceph-mon[29156]: pgmap v11000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:20.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18977.610692 secs 2024-04-26T23:46:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:20 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19674.641027 secs 2024-04-26T23:46:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:20 smithi189 ceph-mon[32756]: pgmap v11000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18977.610692 secs 2024-04-26T23:46:22.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:22 smithi156 ceph-mon[32679]: pgmap v11001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:22.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:22 smithi092 ceph-mon[29156]: pgmap v11001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:22.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:22 smithi189 ceph-mon[32756]: pgmap v11001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:46:24.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:24 smithi156 ceph-mon[32679]: pgmap v11002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:46:24.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:24 smithi092 ceph-mon[29156]: pgmap v11002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:46:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:24 smithi189 ceph-mon[32756]: pgmap v11002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:46:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19679.641118 secs 2024-04-26T23:46:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18982.610778 secs 2024-04-26T23:46:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19679.641118 secs 2024-04-26T23:46:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18982.610778 secs 2024-04-26T23:46:25.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19679.641118 secs 2024-04-26T23:46:25.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18982.610778 secs 2024-04-26T23:46:26.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:26 smithi156 ceph-mon[32679]: pgmap v11003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:26.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:26 smithi092 ceph-mon[29156]: pgmap v11003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:26.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:26 smithi189 ceph-mon[32756]: pgmap v11003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:28.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:28 smithi156 ceph-mon[32679]: pgmap v11004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:28.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:28 smithi092 ceph-mon[29156]: pgmap v11004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:28.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:28 smithi189 ceph-mon[32756]: pgmap v11004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19684.641242 secs 2024-04-26T23:46:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:30 smithi156 ceph-mon[32679]: pgmap v11005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18987.610917 secs 2024-04-26T23:46:30.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19684.641242 secs 2024-04-26T23:46:30.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:30 smithi092 ceph-mon[29156]: pgmap v11005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:30.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18987.610917 secs 2024-04-26T23:46:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19684.641242 secs 2024-04-26T23:46:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:30 smithi189 ceph-mon[32756]: pgmap v11005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18987.610917 secs 2024-04-26T23:46:32.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:32 smithi156 ceph-mon[32679]: pgmap v11006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:32.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:32 smithi092 ceph-mon[29156]: pgmap v11006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:32.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:32 smithi189 ceph-mon[32756]: pgmap v11006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:34.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:34 smithi156 ceph-mon[32679]: pgmap v11007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:34.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:34 smithi092 ceph-mon[29156]: pgmap v11007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:34 smithi189 ceph-mon[32756]: pgmap v11007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19689.641366 secs 2024-04-26T23:46:35.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18992.611049 secs 2024-04-26T23:46:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19689.641366 secs 2024-04-26T23:46:35.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18992.611049 secs 2024-04-26T23:46:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19689.641366 secs 2024-04-26T23:46:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18992.611049 secs 2024-04-26T23:46:36.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:36 smithi156 ceph-mon[32679]: pgmap v11008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:36.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:36 smithi092 ceph-mon[29156]: pgmap v11008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:36.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:36 smithi189 ceph-mon[32756]: pgmap v11008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:38 smithi156 ceph-mon[32679]: pgmap v11009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:38 smithi092 ceph-mon[29156]: pgmap v11009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:38.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:38 smithi189 ceph-mon[32756]: pgmap v11009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19694.641510 secs 2024-04-26T23:46:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:40 smithi156 ceph-mon[32679]: pgmap v11010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 18997.611158 secs 2024-04-26T23:46:40.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19694.641510 secs 2024-04-26T23:46:40.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:40 smithi189 ceph-mon[32756]: pgmap v11010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:40.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 18997.611158 secs 2024-04-26T23:46:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19694.641510 secs 2024-04-26T23:46:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:40 smithi092 ceph-mon[29156]: pgmap v11010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:40.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 18997.611158 secs 2024-04-26T23:46:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:42 smithi092 ceph-mon[29156]: pgmap v11011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:42.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:42 smithi189 ceph-mon[32756]: pgmap v11011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:42.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:42 smithi156 ceph-mon[32679]: pgmap v11011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:44.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:44 smithi092 ceph-mon[29156]: pgmap v11012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:44 smithi189 ceph-mon[32756]: pgmap v11012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:44 smithi156 ceph-mon[32679]: pgmap v11012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19699.641644 secs 2024-04-26T23:46:45.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19002.611292 secs 2024-04-26T23:46:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19699.641644 secs 2024-04-26T23:46:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19002.611292 secs 2024-04-26T23:46:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19699.641644 secs 2024-04-26T23:46:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19002.611292 secs 2024-04-26T23:46:46.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:46 smithi092 ceph-mon[29156]: pgmap v11013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:46 smithi189 ceph-mon[32756]: pgmap v11013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:46 smithi156 ceph-mon[32679]: pgmap v11013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:48 smithi092 ceph-mon[29156]: pgmap v11014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:48.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:48 smithi189 ceph-mon[32756]: pgmap v11014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:48.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:48 smithi156 ceph-mon[32679]: pgmap v11014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19704.641765 secs 2024-04-26T23:46:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:50 smithi092 ceph-mon[29156]: pgmap v11015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19007.611409 secs 2024-04-26T23:46:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19704.641765 secs 2024-04-26T23:46:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:50 smithi189 ceph-mon[32756]: pgmap v11015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19007.611409 secs 2024-04-26T23:46:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19704.641765 secs 2024-04-26T23:46:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:50 smithi156 ceph-mon[32679]: pgmap v11015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19007.611409 secs 2024-04-26T23:46:52.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:52 smithi092 ceph-mon[29156]: pgmap v11016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:52.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:52 smithi189 ceph-mon[32756]: pgmap v11016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:52.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:52 smithi156 ceph-mon[32679]: pgmap v11016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:54.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:54 smithi092 ceph-mon[29156]: pgmap v11017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:54 smithi189 ceph-mon[32756]: pgmap v11017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:54.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:54 smithi156 ceph-mon[32679]: pgmap v11017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19709.641861 secs 2024-04-26T23:46:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19012.611523 secs 2024-04-26T23:46:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19709.641861 secs 2024-04-26T23:46:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19012.611523 secs 2024-04-26T23:46:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19709.641861 secs 2024-04-26T23:46:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19012.611523 secs 2024-04-26T23:46:56.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:56 smithi092 ceph-mon[29156]: pgmap v11018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:56.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:56 smithi189 ceph-mon[32756]: pgmap v11018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:56.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:56 smithi156 ceph-mon[32679]: pgmap v11018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:46:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:58 smithi092 ceph-mon[29156]: pgmap v11019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:58.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:58 smithi189 ceph-mon[32756]: pgmap v11019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:58.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:58 smithi156 ceph-mon[32679]: pgmap v11019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:46:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19714.641954 secs 2024-04-26T23:46:59.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:46:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19017.611631 secs 2024-04-26T23:46:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19714.641954 secs 2024-04-26T23:46:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:46:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19017.611631 secs 2024-04-26T23:46:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19714.641954 secs 2024-04-26T23:46:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:46:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19017.611631 secs 2024-04-26T23:47:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:00 smithi092 ceph-mon[29156]: pgmap v11020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:00.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:00 smithi189 ceph-mon[32756]: pgmap v11020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:00.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:00 smithi156 ceph-mon[32679]: pgmap v11020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:02 smithi092 ceph-mon[29156]: pgmap v11021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:02.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:02 smithi189 ceph-mon[32756]: pgmap v11021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:02.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:02 smithi156 ceph-mon[32679]: pgmap v11021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:04 smithi092 ceph-mon[29156]: pgmap v11022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19719.642074 secs 2024-04-26T23:47:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19022.611772 secs 2024-04-26T23:47:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:04 smithi189 ceph-mon[32756]: pgmap v11022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19719.642074 secs 2024-04-26T23:47:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19022.611772 secs 2024-04-26T23:47:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:04 smithi156 ceph-mon[32679]: pgmap v11022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19719.642074 secs 2024-04-26T23:47:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19022.611772 secs 2024-04-26T23:47:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:06 smithi092 ceph-mon[29156]: pgmap v11023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:06.498 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:47:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:47:05.995+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:06.498 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:47:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:47:05.995+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:06.498 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:47:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:47:05.995+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:06.498 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:47:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:47:05.995+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:06.498 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:47:05 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:47:05.995+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:06.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:06 smithi189 ceph-mon[32756]: pgmap v11023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:06 smithi156 ceph-mon[32679]: pgmap v11023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:08 smithi092 ceph-mon[29156]: pgmap v11024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:08.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:08 smithi189 ceph-mon[32756]: pgmap v11024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:08.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:08 smithi156 ceph-mon[32679]: pgmap v11024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19724.642188 secs 2024-04-26T23:47:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19027.611895 secs 2024-04-26T23:47:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19724.642188 secs 2024-04-26T23:47:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19027.611895 secs 2024-04-26T23:47:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19724.642188 secs 2024-04-26T23:47:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19027.611895 secs 2024-04-26T23:47:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:10 smithi092 ceph-mon[29156]: pgmap v11025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:10 smithi189 ceph-mon[32756]: pgmap v11025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:10.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:10 smithi156 ceph-mon[32679]: pgmap v11025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:12.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:12 smithi092 ceph-mon[29156]: pgmap v11026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:12.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:12 smithi189 ceph-mon[32756]: pgmap v11026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:12.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:12 smithi156 ceph-mon[32679]: pgmap v11026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:13.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:47:13.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:47:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:47:14.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: pgmap v11027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:14.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19729.642272 secs 2024-04-26T23:47:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19032.611979 secs 2024-04-26T23:47:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: pgmap v11027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19729.642272 secs 2024-04-26T23:47:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19032.611979 secs 2024-04-26T23:47:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: pgmap v11027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:47:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19729.642272 secs 2024-04-26T23:47:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19032.611979 secs 2024-04-26T23:47:16.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: pgmap v11028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:16.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:47:16.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:47:16.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: pgmap v11028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:47:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: pgmap v11028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:47:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:47:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:47:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:47:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:47:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:47:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: pgmap v11029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 353 B/s wr, 15 op/s 2024-04-26T23:47:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:17 smithi156 ceph-mon[32679]: pgmap v11030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 427 B/s wr, 18 op/s 2024-04-26T23:47:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:47:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:47:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:47:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:47:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: pgmap v11029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 353 B/s wr, 15 op/s 2024-04-26T23:47:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:17 smithi092 ceph-mon[29156]: pgmap v11030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 427 B/s wr, 18 op/s 2024-04-26T23:47:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:47:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:47:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:47:17.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:47:17.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:47:17.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: pgmap v11029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 353 B/s wr, 15 op/s 2024-04-26T23:47:17.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:17 smithi189 ceph-mon[32756]: pgmap v11030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 427 B/s wr, 18 op/s 2024-04-26T23:47:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:19 smithi156 ceph-mon[32679]: pgmap v11031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:47:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19734.642340 secs 2024-04-26T23:47:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19037.612098 secs 2024-04-26T23:47:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:19 smithi092 ceph-mon[29156]: pgmap v11031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:47:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19734.642340 secs 2024-04-26T23:47:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19037.612098 secs 2024-04-26T23:47:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:19 smithi189 ceph-mon[32756]: pgmap v11031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:47:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19734.642340 secs 2024-04-26T23:47:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19037.612098 secs 2024-04-26T23:47:21.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:21 smithi156 ceph-mon[32679]: pgmap v11032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:21 smithi092 ceph-mon[29156]: pgmap v11032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:21 smithi189 ceph-mon[32756]: pgmap v11032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:23.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:23 smithi156 ceph-mon[32679]: pgmap v11033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:23.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:23 smithi092 ceph-mon[29156]: pgmap v11033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:23 smithi189 ceph-mon[32756]: pgmap v11033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19739.642420 secs 2024-04-26T23:47:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19042.612216 secs 2024-04-26T23:47:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19739.642420 secs 2024-04-26T23:47:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19042.612216 secs 2024-04-26T23:47:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19739.642420 secs 2024-04-26T23:47:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19042.612216 secs 2024-04-26T23:47:25.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:25 smithi156 ceph-mon[32679]: pgmap v11034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:25.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:25 smithi092 ceph-mon[29156]: pgmap v11034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:25 smithi189 ceph-mon[32756]: pgmap v11034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:47:27.681 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:27 smithi092 ceph-mon[29156]: pgmap v11035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:47:27.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:27 smithi156 ceph-mon[32679]: pgmap v11035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:47:27.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:27 smithi189 ceph-mon[32756]: pgmap v11035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:47:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:29 smithi156 ceph-mon[32679]: pgmap v11036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19744.642565 secs 2024-04-26T23:47:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19047.612335 secs 2024-04-26T23:47:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:29 smithi092 ceph-mon[29156]: pgmap v11036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19744.642565 secs 2024-04-26T23:47:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19047.612335 secs 2024-04-26T23:47:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:29 smithi189 ceph-mon[32756]: pgmap v11036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19744.642565 secs 2024-04-26T23:47:29.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19047.612335 secs 2024-04-26T23:47:31.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:31 smithi156 ceph-mon[32679]: pgmap v11037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:31 smithi092 ceph-mon[29156]: pgmap v11037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:31.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:31 smithi189 ceph-mon[32756]: pgmap v11037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:33.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:33 smithi156 ceph-mon[32679]: pgmap v11038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:33 smithi092 ceph-mon[29156]: pgmap v11038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:33.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:33 smithi189 ceph-mon[32756]: pgmap v11038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19749.642706 secs 2024-04-26T23:47:34.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19052.612453 secs 2024-04-26T23:47:34.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19749.642706 secs 2024-04-26T23:47:34.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19052.612453 secs 2024-04-26T23:47:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19749.642706 secs 2024-04-26T23:47:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19052.612453 secs 2024-04-26T23:47:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:35 smithi092 ceph-mon[29156]: pgmap v11039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:35.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:35 smithi189 ceph-mon[32756]: pgmap v11039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:35.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:35 smithi156 ceph-mon[32679]: pgmap v11039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:37 smithi092 ceph-mon[29156]: pgmap v11040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:37.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:37 smithi189 ceph-mon[32756]: pgmap v11040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:37.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:37 smithi156 ceph-mon[32679]: pgmap v11040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:39 smithi092 ceph-mon[29156]: pgmap v11041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19754.642840 secs 2024-04-26T23:47:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19057.612575 secs 2024-04-26T23:47:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:39 smithi189 ceph-mon[32756]: pgmap v11041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19754.642840 secs 2024-04-26T23:47:39.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19057.612575 secs 2024-04-26T23:47:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:39 smithi156 ceph-mon[32679]: pgmap v11041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19754.642840 secs 2024-04-26T23:47:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19057.612575 secs 2024-04-26T23:47:41.739 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:41 smithi156 ceph-mon[32679]: pgmap v11042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:41 smithi092 ceph-mon[29156]: pgmap v11042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:41.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:41 smithi189 ceph-mon[32756]: pgmap v11042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:43.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:43 smithi092 ceph-mon[29156]: pgmap v11043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:43.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:43 smithi189 ceph-mon[32756]: pgmap v11043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:43.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:43 smithi156 ceph-mon[32679]: pgmap v11043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19759.642925 secs 2024-04-26T23:47:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19062.612645 secs 2024-04-26T23:47:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19759.642925 secs 2024-04-26T23:47:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19062.612645 secs 2024-04-26T23:47:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19759.642925 secs 2024-04-26T23:47:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19062.612645 secs 2024-04-26T23:47:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:45 smithi092 ceph-mon[29156]: pgmap v11044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:45.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:45 smithi189 ceph-mon[32756]: pgmap v11044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:45 smithi156 ceph-mon[32679]: pgmap v11044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:47 smithi092 ceph-mon[29156]: pgmap v11045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:47.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:47 smithi189 ceph-mon[32756]: pgmap v11045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:47.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:47 smithi156 ceph-mon[32679]: pgmap v11045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:49 smithi092 ceph-mon[29156]: pgmap v11046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19764.643040 secs 2024-04-26T23:47:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19067.612780 secs 2024-04-26T23:47:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:49 smithi189 ceph-mon[32756]: pgmap v11046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:49.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19764.643040 secs 2024-04-26T23:47:49.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19067.612780 secs 2024-04-26T23:47:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:49 smithi156 ceph-mon[32679]: pgmap v11046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19764.643040 secs 2024-04-26T23:47:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19067.612780 secs 2024-04-26T23:47:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:51 smithi092 ceph-mon[29156]: pgmap v11047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:51.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:51 smithi189 ceph-mon[32756]: pgmap v11047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:51.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:51 smithi156 ceph-mon[32679]: pgmap v11047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:53 smithi092 ceph-mon[29156]: pgmap v11048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:53.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:53 smithi189 ceph-mon[32756]: pgmap v11048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:53.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:53 smithi156 ceph-mon[32679]: pgmap v11048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19769.643162 secs 2024-04-26T23:47:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19072.612871 secs 2024-04-26T23:47:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19769.643162 secs 2024-04-26T23:47:54.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19072.612871 secs 2024-04-26T23:47:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19769.643162 secs 2024-04-26T23:47:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19072.612871 secs 2024-04-26T23:47:55.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:55 smithi092 ceph-mon[29156]: pgmap v11049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:55 smithi189 ceph-mon[32756]: pgmap v11049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:55.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:55 smithi156 ceph-mon[32679]: pgmap v11049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:47:57.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:57 smithi092 ceph-mon[29156]: pgmap v11050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:57 smithi189 ceph-mon[32756]: pgmap v11050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:57.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:57 smithi156 ceph-mon[32679]: pgmap v11050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:59 smithi092 ceph-mon[29156]: pgmap v11051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19774.643276 secs 2024-04-26T23:47:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:47:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19077.612964 secs 2024-04-26T23:47:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:59 smithi189 ceph-mon[32756]: pgmap v11051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:59.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19774.643276 secs 2024-04-26T23:47:59.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:47:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19077.612964 secs 2024-04-26T23:47:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:59 smithi156 ceph-mon[32679]: pgmap v11051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:47:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19774.643276 secs 2024-04-26T23:47:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:47:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19077.612964 secs 2024-04-26T23:48:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:01 smithi092 ceph-mon[29156]: pgmap v11052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:01 smithi189 ceph-mon[32756]: pgmap v11052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:01.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:01 smithi156 ceph-mon[32679]: pgmap v11052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:03.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:03 smithi189 ceph-mon[32756]: pgmap v11053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:03.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:03 smithi156 ceph-mon[32679]: pgmap v11053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:03.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:03 smithi092 ceph-mon[29156]: pgmap v11053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19779.643392 secs 2024-04-26T23:48:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19082.613031 secs 2024-04-26T23:48:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19779.643392 secs 2024-04-26T23:48:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19082.613031 secs 2024-04-26T23:48:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19779.643392 secs 2024-04-26T23:48:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19082.613031 secs 2024-04-26T23:48:05.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:05 smithi189 ceph-mon[32756]: pgmap v11054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:05.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:05 smithi156 ceph-mon[32679]: pgmap v11054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:05.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:05 smithi092 ceph-mon[29156]: pgmap v11054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:07 smithi189 ceph-mon[32756]: pgmap v11055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:07 smithi156 ceph-mon[32679]: pgmap v11055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:07.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:07 smithi092 ceph-mon[29156]: pgmap v11055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:09.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:09 smithi092 ceph-mon[29156]: pgmap v11056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:09.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19784.643517 secs 2024-04-26T23:48:09.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19087.613154 secs 2024-04-26T23:48:09.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:09 smithi189 ceph-mon[32756]: pgmap v11056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:09.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19784.643517 secs 2024-04-26T23:48:09.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19087.613154 secs 2024-04-26T23:48:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:09 smithi156 ceph-mon[32679]: pgmap v11056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19784.643517 secs 2024-04-26T23:48:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19087.613154 secs 2024-04-26T23:48:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:11 smithi189 ceph-mon[32756]: pgmap v11057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:11 smithi156 ceph-mon[32679]: pgmap v11057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:11 smithi092 ceph-mon[29156]: pgmap v11057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:13.800 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:13 smithi092 ceph-mon[29156]: pgmap v11058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:13 smithi189 ceph-mon[32756]: pgmap v11058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:13.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:13 smithi156 ceph-mon[32679]: pgmap v11058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:48:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:15 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19789.643597 secs 2024-04-26T23:48:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19092.613243 secs 2024-04-26T23:48:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:15 smithi189 ceph-mon[32756]: pgmap v11059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:15 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19789.643597 secs 2024-04-26T23:48:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19092.613243 secs 2024-04-26T23:48:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:15 smithi156 ceph-mon[32679]: pgmap v11059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:15 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19789.643597 secs 2024-04-26T23:48:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19092.613243 secs 2024-04-26T23:48:15.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:15 smithi092 ceph-mon[29156]: pgmap v11059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:48:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:17 smithi156 ceph-mon[32679]: pgmap v11060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:48:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:48:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:48:17.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:48:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:17 smithi092 ceph-mon[29156]: pgmap v11060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:48:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:48:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:48:17.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:48:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:17 smithi189 ceph-mon[32756]: pgmap v11060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:48:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:48:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:48:17.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:48:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:18 smithi156 ceph-mon[32679]: pgmap v11061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:18 smithi092 ceph-mon[29156]: pgmap v11061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:18.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:18 smithi189 ceph-mon[32756]: pgmap v11061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19794.643710 secs 2024-04-26T23:48:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19097.613370 secs 2024-04-26T23:48:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19794.643710 secs 2024-04-26T23:48:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19097.613370 secs 2024-04-26T23:48:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19794.643710 secs 2024-04-26T23:48:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19097.613370 secs 2024-04-26T23:48:20.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:20 smithi156 ceph-mon[32679]: pgmap v11062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:48:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:20 smithi092 ceph-mon[29156]: pgmap v11062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:48:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:20 smithi189 ceph-mon[32756]: pgmap v11062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:48:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:22 smithi156 ceph-mon[32679]: pgmap v11063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:22 smithi092 ceph-mon[29156]: pgmap v11063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:22 smithi189 ceph-mon[32756]: pgmap v11063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:24 smithi156 ceph-mon[32679]: pgmap v11064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19799.643839 secs 2024-04-26T23:48:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19102.613458 secs 2024-04-26T23:48:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:24 smithi092 ceph-mon[29156]: pgmap v11064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19799.643839 secs 2024-04-26T23:48:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19102.613458 secs 2024-04-26T23:48:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:24 smithi189 ceph-mon[32756]: pgmap v11064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19799.643839 secs 2024-04-26T23:48:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19102.613458 secs 2024-04-26T23:48:26.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:26 smithi156 ceph-mon[32679]: pgmap v11065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:26 smithi092 ceph-mon[29156]: pgmap v11065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:26.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:26 smithi189 ceph-mon[32756]: pgmap v11065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:28.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:28 smithi156 ceph-mon[32679]: pgmap v11066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:28.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:28 smithi092 ceph-mon[29156]: pgmap v11066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:28.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:28 smithi189 ceph-mon[32756]: pgmap v11066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:48:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19804.643931 secs 2024-04-26T23:48:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19107.613574 secs 2024-04-26T23:48:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19804.643931 secs 2024-04-26T23:48:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19107.613574 secs 2024-04-26T23:48:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19804.643931 secs 2024-04-26T23:48:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19107.613574 secs 2024-04-26T23:48:30.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:30 smithi156 ceph-mon[32679]: pgmap v11067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:30 smithi092 ceph-mon[29156]: pgmap v11067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:30.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:30 smithi189 ceph-mon[32756]: pgmap v11067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:32 smithi092 ceph-mon[29156]: pgmap v11068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:32.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:32 smithi189 ceph-mon[32756]: pgmap v11068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:32.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:32 smithi156 ceph-mon[32679]: pgmap v11068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:34 smithi092 ceph-mon[29156]: pgmap v11069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19809.643980 secs 2024-04-26T23:48:34.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19112.613692 secs 2024-04-26T23:48:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:34 smithi189 ceph-mon[32756]: pgmap v11069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19809.643980 secs 2024-04-26T23:48:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19112.613692 secs 2024-04-26T23:48:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:34 smithi156 ceph-mon[32679]: pgmap v11069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19809.643980 secs 2024-04-26T23:48:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19112.613692 secs 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0070 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80b0070 comp rx=0 tx=0).stop 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.020+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.021+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca80d1000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.051+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.051+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.051+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.051+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=20 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.051+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.052+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-26T23:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:36.052+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-26T23:48:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:36 smithi092 ceph-mon[29156]: pgmap v11070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:36.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:36 smithi189 ceph-mon[32756]: pgmap v11070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:36.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:36 smithi156 ceph-mon[32679]: pgmap v11070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.698+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.698+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 154 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:48:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:48:38.699+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 155 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:48:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:38 smithi092 ceph-mon[29156]: pgmap v11071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:38.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:38 smithi189 ceph-mon[32756]: pgmap v11071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:38.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:38 smithi156 ceph-mon[32679]: pgmap v11071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19814.644060 secs 2024-04-26T23:48:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19117.613863 secs 2024-04-26T23:48:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:40 smithi189 ceph-mon[32756]: pgmap v11072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19814.644060 secs 2024-04-26T23:48:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19117.613863 secs 2024-04-26T23:48:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:40 smithi156 ceph-mon[32679]: pgmap v11072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19814.644060 secs 2024-04-26T23:48:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19117.613863 secs 2024-04-26T23:48:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:40 smithi092 ceph-mon[29156]: pgmap v11072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:42.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:42 smithi156 ceph-mon[32679]: pgmap v11073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:42.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:42 smithi092 ceph-mon[29156]: pgmap v11073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:42.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:42 smithi189 ceph-mon[32756]: pgmap v11073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:44.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:44 smithi156 ceph-mon[32679]: pgmap v11074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:44.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:44 smithi092 ceph-mon[29156]: pgmap v11074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:44 smithi189 ceph-mon[32756]: pgmap v11074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:45 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19819.644158 secs 2024-04-26T23:48:45.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19122.613984 secs 2024-04-26T23:48:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:45 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19819.644158 secs 2024-04-26T23:48:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19122.613984 secs 2024-04-26T23:48:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:45 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19819.644158 secs 2024-04-26T23:48:45.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19122.613984 secs 2024-04-26T23:48:46.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:46 smithi156 ceph-mon[32679]: pgmap v11075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:46.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:46 smithi092 ceph-mon[29156]: pgmap v11075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:46 smithi189 ceph-mon[32756]: pgmap v11075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:48.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:48 smithi092 ceph-mon[29156]: pgmap v11076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:48.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:48 smithi189 ceph-mon[32756]: pgmap v11076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:48.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:48 smithi156 ceph-mon[32679]: pgmap v11076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:50 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19824.644222 secs 2024-04-26T23:48:50.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19127.614105 secs 2024-04-26T23:48:50.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:50 smithi092 ceph-mon[29156]: pgmap v11077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:50 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19824.644222 secs 2024-04-26T23:48:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19127.614105 secs 2024-04-26T23:48:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:50 smithi189 ceph-mon[32756]: pgmap v11077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:50 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19824.644222 secs 2024-04-26T23:48:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19127.614105 secs 2024-04-26T23:48:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:50 smithi156 ceph-mon[32679]: pgmap v11077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:52.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:52 smithi092 ceph-mon[29156]: pgmap v11078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:52.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:52 smithi189 ceph-mon[32756]: pgmap v11078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:52.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:52 smithi156 ceph-mon[32679]: pgmap v11078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:54.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:54 smithi092 ceph-mon[29156]: pgmap v11079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:54 smithi189 ceph-mon[32756]: pgmap v11079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:54 smithi156 ceph-mon[32679]: pgmap v11079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:55 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19829.644285 secs 2024-04-26T23:48:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19132.614183 secs 2024-04-26T23:48:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:55 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19829.644285 secs 2024-04-26T23:48:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19132.614183 secs 2024-04-26T23:48:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:55 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19829.644285 secs 2024-04-26T23:48:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19132.614183 secs 2024-04-26T23:48:56.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:56 smithi092 ceph-mon[29156]: pgmap v11080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:56.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:56 smithi189 ceph-mon[32756]: pgmap v11080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:56.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:56 smithi156 ceph-mon[32679]: pgmap v11080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:48:58.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:48:58 smithi092 ceph-mon[29156]: pgmap v11081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:58.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:48:58 smithi189 ceph-mon[32756]: pgmap v11081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:48:58.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:48:58 smithi156 ceph-mon[32679]: pgmap v11081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:00 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19834.644390 secs 2024-04-26T23:49:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19137.614311 secs 2024-04-26T23:49:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:00 smithi092 ceph-mon[29156]: pgmap v11082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:00.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:00 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19834.644390 secs 2024-04-26T23:49:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19137.614311 secs 2024-04-26T23:49:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:00 smithi189 ceph-mon[32756]: pgmap v11082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:00.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:00 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19834.644390 secs 2024-04-26T23:49:00.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19137.614311 secs 2024-04-26T23:49:00.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:00 smithi156 ceph-mon[32679]: pgmap v11082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:02.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:02 smithi092 ceph-mon[29156]: pgmap v11083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:02.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:02 smithi189 ceph-mon[32756]: pgmap v11083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:02.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:02 smithi156 ceph-mon[32679]: pgmap v11083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:04.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:04 smithi092 ceph-mon[29156]: pgmap v11084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:04 smithi189 ceph-mon[32756]: pgmap v11084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:04 smithi156 ceph-mon[32679]: pgmap v11084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:05 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19839.644501 secs 2024-04-26T23:49:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19142.614411 secs 2024-04-26T23:49:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:05 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19839.644501 secs 2024-04-26T23:49:05.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19142.614411 secs 2024-04-26T23:49:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:05 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19839.644501 secs 2024-04-26T23:49:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19142.614411 secs 2024-04-26T23:49:06.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:06 smithi092 ceph-mon[29156]: pgmap v11085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:06.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:06 smithi189 ceph-mon[32756]: pgmap v11085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:06.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:06 smithi156 ceph-mon[32679]: pgmap v11085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:08.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:08 smithi092 ceph-mon[29156]: pgmap v11086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:08.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:08 smithi189 ceph-mon[32756]: pgmap v11086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:08.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:08 smithi156 ceph-mon[32679]: pgmap v11086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19147.614538 secs 2024-04-26T23:49:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19147.614538 secs 2024-04-26T23:49:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19147.614538 secs 2024-04-26T23:49:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19844.644616 secs 2024-04-26T23:49:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:10 smithi092 ceph-mon[29156]: pgmap v11087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19844.644616 secs 2024-04-26T23:49:10.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:10 smithi189 ceph-mon[32756]: pgmap v11087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19844.644616 secs 2024-04-26T23:49:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:10 smithi156 ceph-mon[32679]: pgmap v11087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:12.489 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:12 smithi156 ceph-mon[32679]: pgmap v11088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:12.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:12 smithi092 ceph-mon[29156]: pgmap v11088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:12.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:12 smithi189 ceph-mon[32756]: pgmap v11088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:14 smithi092 ceph-mon[29156]: pgmap v11089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19849.644734 secs 2024-04-26T23:49:14.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19152.614639 secs 2024-04-26T23:49:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:14 smithi189 ceph-mon[32756]: pgmap v11089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19849.644734 secs 2024-04-26T23:49:14.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19152.614639 secs 2024-04-26T23:49:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:14 smithi156 ceph-mon[32679]: pgmap v11089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19849.644734 secs 2024-04-26T23:49:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19152.614639 secs 2024-04-26T23:49:16.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:16 smithi092 ceph-mon[29156]: pgmap v11090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:49:16.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:16 smithi189 ceph-mon[32756]: pgmap v11090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:49:16.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:16 smithi156 ceph-mon[32679]: pgmap v11090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:49:17.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:49:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:49:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:49:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:18 smithi189 ceph-mon[32756]: pgmap v11091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:49:18.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:49:18.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:49:18.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:49:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:18 smithi156 ceph-mon[32679]: pgmap v11091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:49:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:49:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:49:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:49:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:18 smithi092 ceph-mon[29156]: pgmap v11091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:49:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:49:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:49:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:49:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:19 smithi189 ceph-mon[32756]: pgmap v11092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:49:19.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:19 smithi189 ceph-mon[32756]: pgmap v11093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:49:19.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19854.644887 secs 2024-04-26T23:49:19.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19157.614700 secs 2024-04-26T23:49:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:19 smithi156 ceph-mon[32679]: pgmap v11092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:49:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:19 smithi156 ceph-mon[32679]: pgmap v11093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:49:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19854.644887 secs 2024-04-26T23:49:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19157.614700 secs 2024-04-26T23:49:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:19 smithi092 ceph-mon[29156]: pgmap v11092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:49:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:19 smithi092 ceph-mon[29156]: pgmap v11093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:49:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19854.644887 secs 2024-04-26T23:49:19.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19157.614700 secs 2024-04-26T23:49:21.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:21 smithi189 ceph-mon[32756]: pgmap v11094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:21.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:21 smithi156 ceph-mon[32679]: pgmap v11094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:21 smithi092 ceph-mon[29156]: pgmap v11094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:23.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:23 smithi189 ceph-mon[32756]: pgmap v11095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:23.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:23 smithi156 ceph-mon[32679]: pgmap v11095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:23.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:23 smithi092 ceph-mon[29156]: pgmap v11095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:49:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19859.645032 secs 2024-04-26T23:49:24.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19162.614844 secs 2024-04-26T23:49:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19859.645032 secs 2024-04-26T23:49:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19162.614844 secs 2024-04-26T23:49:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19859.645032 secs 2024-04-26T23:49:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19162.614844 secs 2024-04-26T23:49:25.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:25 smithi189 ceph-mon[32756]: pgmap v11096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:25.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:25 smithi156 ceph-mon[32679]: pgmap v11096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:25.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:25 smithi092 ceph-mon[29156]: pgmap v11096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:27.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:27 smithi189 ceph-mon[32756]: pgmap v11097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:27.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:27 smithi156 ceph-mon[32679]: pgmap v11097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:27 smithi092 ceph-mon[29156]: pgmap v11097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:49:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:29 smithi189 ceph-mon[32756]: pgmap v11098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:49:29.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19864.645176 secs 2024-04-26T23:49:29.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19167.614987 secs 2024-04-26T23:49:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:29 smithi156 ceph-mon[32679]: pgmap v11098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:49:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19864.645176 secs 2024-04-26T23:49:29.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19167.614987 secs 2024-04-26T23:49:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:29 smithi092 ceph-mon[29156]: pgmap v11098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:49:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19864.645176 secs 2024-04-26T23:49:29.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19167.614987 secs 2024-04-26T23:49:31.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:31 smithi189 ceph-mon[32756]: pgmap v11099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:31.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:31 smithi156 ceph-mon[32679]: pgmap v11099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:31 smithi092 ceph-mon[29156]: pgmap v11099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:33.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:33 smithi189 ceph-mon[32756]: pgmap v11100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:33.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:33 smithi156 ceph-mon[32679]: pgmap v11100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:33 smithi092 ceph-mon[29156]: pgmap v11100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19869.645281 secs 2024-04-26T23:49:34.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19172.615079 secs 2024-04-26T23:49:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19869.645281 secs 2024-04-26T23:49:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19172.615079 secs 2024-04-26T23:49:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19869.645281 secs 2024-04-26T23:49:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19172.615079 secs 2024-04-26T23:49:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:35 smithi189 ceph-mon[32756]: pgmap v11101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:35.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:35 smithi156 ceph-mon[32679]: pgmap v11101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:35 smithi092 ceph-mon[29156]: pgmap v11101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:37.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:37 smithi189 ceph-mon[32756]: pgmap v11102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:37.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:37 smithi156 ceph-mon[32679]: pgmap v11102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:37 smithi092 ceph-mon[29156]: pgmap v11102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:39 smithi189 ceph-mon[32756]: pgmap v11103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19874.645349 secs 2024-04-26T23:49:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19177.615199 secs 2024-04-26T23:49:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:39 smithi156 ceph-mon[32679]: pgmap v11103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19874.645349 secs 2024-04-26T23:49:39.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19177.615199 secs 2024-04-26T23:49:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:39 smithi092 ceph-mon[29156]: pgmap v11103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19874.645349 secs 2024-04-26T23:49:39.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19177.615199 secs 2024-04-26T23:49:41.550 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:41 smithi092 ceph-mon[29156]: pgmap v11104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:41.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:41 smithi189 ceph-mon[32756]: pgmap v11104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:41.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:41 smithi156 ceph-mon[32679]: pgmap v11104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:43.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:43 smithi189 ceph-mon[32756]: pgmap v11105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:43.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:43 smithi156 ceph-mon[32679]: pgmap v11105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:43.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:43 smithi092 ceph-mon[29156]: pgmap v11105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19879.645493 secs 2024-04-26T23:49:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19182.615341 secs 2024-04-26T23:49:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19879.645493 secs 2024-04-26T23:49:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19182.615341 secs 2024-04-26T23:49:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19879.645493 secs 2024-04-26T23:49:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19182.615341 secs 2024-04-26T23:49:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:45 smithi189 ceph-mon[32756]: pgmap v11106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:45 smithi156 ceph-mon[32679]: pgmap v11106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:45 smithi092 ceph-mon[29156]: pgmap v11106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:47.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:47 smithi189 ceph-mon[32756]: pgmap v11107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:47.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:47 smithi156 ceph-mon[32679]: pgmap v11107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:47 smithi092 ceph-mon[29156]: pgmap v11107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:49 smithi189 ceph-mon[32756]: pgmap v11108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:49.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19884.645575 secs 2024-04-26T23:49:49.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19187.615406 secs 2024-04-26T23:49:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:49 smithi156 ceph-mon[32679]: pgmap v11108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19884.645575 secs 2024-04-26T23:49:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19187.615406 secs 2024-04-26T23:49:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:49 smithi092 ceph-mon[29156]: pgmap v11108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:49.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19884.645575 secs 2024-04-26T23:49:49.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19187.615406 secs 2024-04-26T23:49:51.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:51 smithi189 ceph-mon[32756]: pgmap v11109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:51.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:51 smithi156 ceph-mon[32679]: pgmap v11109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:51 smithi092 ceph-mon[29156]: pgmap v11109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:53.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:53 smithi189 ceph-mon[32756]: pgmap v11110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:53.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:53 smithi156 ceph-mon[32679]: pgmap v11110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:53 smithi092 ceph-mon[29156]: pgmap v11110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:54.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19889.645637 secs 2024-04-26T23:49:54.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19192.615525 secs 2024-04-26T23:49:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19889.645637 secs 2024-04-26T23:49:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19192.615525 secs 2024-04-26T23:49:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19889.645637 secs 2024-04-26T23:49:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19192.615525 secs 2024-04-26T23:49:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:55 smithi189 ceph-mon[32756]: pgmap v11111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:55 smithi156 ceph-mon[32679]: pgmap v11111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:55.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:55 smithi092 ceph-mon[29156]: pgmap v11111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:49:57.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:57 smithi189 ceph-mon[32756]: pgmap v11112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:57.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:57 smithi156 ceph-mon[32679]: pgmap v11112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:57.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:57 smithi092 ceph-mon[29156]: pgmap v11112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:59 smithi189 ceph-mon[32756]: pgmap v11113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19894.645758 secs 2024-04-26T23:49:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:49:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19197.615584 secs 2024-04-26T23:49:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:59 smithi156 ceph-mon[32679]: pgmap v11113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19894.645758 secs 2024-04-26T23:49:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:49:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19197.615584 secs 2024-04-26T23:49:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:59 smithi092 ceph-mon[29156]: pgmap v11113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:49:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19894.645758 secs 2024-04-26T23:49:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:49:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19197.615584 secs 2024-04-26T23:50:00.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:50:00.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:50:00.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-26T23:50:01.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:01 smithi189 ceph-mon[32756]: pgmap v11114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:01.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:01 smithi156 ceph-mon[32679]: pgmap v11114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:01 smithi092 ceph-mon[29156]: pgmap v11114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:03.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:03 smithi189 ceph-mon[32756]: pgmap v11115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:03.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:03 smithi156 ceph-mon[32679]: pgmap v11115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:03.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:03 smithi092 ceph-mon[29156]: pgmap v11115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19899.645856 secs 2024-04-26T23:50:04.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 19202.615661 secs 2024-04-26T23:50:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19899.645856 secs 2024-04-26T23:50:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 19202.615661 secs 2024-04-26T23:50:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19899.645856 secs 2024-04-26T23:50:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 19202.615661 secs 2024-04-26T23:50:05.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:05 smithi189 ceph-mon[32756]: pgmap v11116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:05 smithi156 ceph-mon[32679]: pgmap v11116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:05 smithi092 ceph-mon[29156]: pgmap v11116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:07.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:07 smithi189 ceph-mon[32756]: pgmap v11117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:07.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:07 smithi156 ceph-mon[32679]: pgmap v11117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:07 smithi092 ceph-mon[29156]: pgmap v11117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:09 smithi189 ceph-mon[32756]: pgmap v11118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19904.645981 secs 2024-04-26T23:50:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 19207.615720 secs 2024-04-26T23:50:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:09 smithi189 ceph-mon[32756]: slow request 182.756235 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:50:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:09 smithi156 ceph-mon[32679]: pgmap v11118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19904.645981 secs 2024-04-26T23:50:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 19207.615720 secs 2024-04-26T23:50:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:09 smithi156 ceph-mon[32679]: slow request 182.756235 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:50:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:09 smithi092 ceph-mon[29156]: pgmap v11118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19904.645981 secs 2024-04-26T23:50:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 19207.615720 secs 2024-04-26T23:50:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:09 smithi092 ceph-mon[29156]: slow request 182.756235 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-26T23:50:11.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:11 smithi189 ceph-mon[32756]: pgmap v11119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:11 smithi156 ceph-mon[32679]: pgmap v11119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:11 smithi092 ceph-mon[29156]: pgmap v11119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:13.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:13 smithi189 ceph-mon[32756]: pgmap v11120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:13.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:50:13.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:50:13.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:13 smithi156 ceph-mon[32679]: pgmap v11120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:13.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:50:13.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:50:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:13 smithi092 ceph-mon[29156]: pgmap v11120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-26T23:50:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-26T23:50:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19909.646065 secs 2024-04-26T23:50:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19212.615816 secs 2024-04-26T23:50:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19909.646065 secs 2024-04-26T23:50:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19212.615816 secs 2024-04-26T23:50:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19909.646065 secs 2024-04-26T23:50:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19212.615816 secs 2024-04-26T23:50:15.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:15 smithi189 ceph-mon[32756]: pgmap v11121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:15.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:15 smithi156 ceph-mon[32679]: pgmap v11121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:15 smithi092 ceph-mon[29156]: pgmap v11121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:17.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:17 smithi189 ceph-mon[32756]: pgmap v11122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:17 smithi156 ceph-mon[32679]: pgmap v11122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:17 smithi092 ceph-mon[29156]: pgmap v11122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:18.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:50:18.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:50:18.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:50:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: pgmap v11123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19914.646163 secs 2024-04-26T23:50:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:50:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:50:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: pgmap v11124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:50:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: pgmap v11125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:50:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19217.615900 secs 2024-04-26T23:50:19.712 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: pgmap v11123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19914.646163 secs 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: pgmap v11124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: pgmap v11125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:50:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19217.615900 secs 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: pgmap v11123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19914.646163 secs 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: pgmap v11124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: pgmap v11125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:50:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19217.615900 secs 2024-04-26T23:50:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:20 smithi092 ceph-mon[29156]: pgmap v11126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:21.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:20 smithi189 ceph-mon[32756]: pgmap v11126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:21.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:20 smithi156 ceph-mon[32679]: pgmap v11126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:22 smithi092 ceph-mon[29156]: pgmap v11127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:50:23.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:22 smithi189 ceph-mon[32756]: pgmap v11127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:50:23.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:22 smithi156 ceph-mon[32679]: pgmap v11127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:50:24.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19919.646254 secs 2024-04-26T23:50:24.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19222.616034 secs 2024-04-26T23:50:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19919.646254 secs 2024-04-26T23:50:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19222.616034 secs 2024-04-26T23:50:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19919.646254 secs 2024-04-26T23:50:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19222.616034 secs 2024-04-26T23:50:25.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:25 smithi189 ceph-mon[32756]: pgmap v11128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:25.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:25 smithi156 ceph-mon[32679]: pgmap v11128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:25.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:25 smithi092 ceph-mon[29156]: pgmap v11128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:26 smithi092 ceph-mon[29156]: pgmap v11129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:26 smithi189 ceph-mon[32756]: pgmap v11129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:26 smithi156 ceph-mon[32679]: pgmap v11129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:50:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:28 smithi092 ceph-mon[29156]: pgmap v11130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:50:29.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:28 smithi189 ceph-mon[32756]: pgmap v11130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:50:29.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:28 smithi156 ceph-mon[32679]: pgmap v11130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:50:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19924.646418 secs 2024-04-26T23:50:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19227.616154 secs 2024-04-26T23:50:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19924.646418 secs 2024-04-26T23:50:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19227.616154 secs 2024-04-26T23:50:30.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19924.646418 secs 2024-04-26T23:50:30.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19227.616154 secs 2024-04-26T23:50:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:30 smithi092 ceph-mon[29156]: pgmap v11131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:31.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:30 smithi189 ceph-mon[32756]: pgmap v11131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:31.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:30 smithi156 ceph-mon[32679]: pgmap v11131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:32 smithi092 ceph-mon[29156]: pgmap v11132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:33.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:32 smithi189 ceph-mon[32756]: pgmap v11132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:33.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:32 smithi156 ceph-mon[32679]: pgmap v11132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:34.560 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19929.646480 secs 2024-04-26T23:50:34.560 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19232.616243 secs 2024-04-26T23:50:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19929.646480 secs 2024-04-26T23:50:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19232.616243 secs 2024-04-26T23:50:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19929.646480 secs 2024-04-26T23:50:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19232.616243 secs 2024-04-26T23:50:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:35 smithi189 ceph-mon[32756]: pgmap v11133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:35.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:35 smithi156 ceph-mon[32679]: pgmap v11133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:35 smithi092 ceph-mon[29156]: pgmap v11133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:36 smithi092 ceph-mon[29156]: pgmap v11134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:36 smithi189 ceph-mon[32756]: pgmap v11134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:37.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:36 smithi156 ceph-mon[32679]: pgmap v11134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:38.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:38 smithi092 ceph-mon[29156]: pgmap v11135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:39.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:38 smithi189 ceph-mon[32756]: pgmap v11135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:39.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:38 smithi156 ceph-mon[32679]: pgmap v11135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19934.646599 secs 2024-04-26T23:50:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19237.616386 secs 2024-04-26T23:50:40.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19934.646599 secs 2024-04-26T23:50:40.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19237.616386 secs 2024-04-26T23:50:40.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19934.646599 secs 2024-04-26T23:50:40.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19237.616386 secs 2024-04-26T23:50:40.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:40 smithi092 ceph-mon[29156]: pgmap v11136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:41.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:40 smithi189 ceph-mon[32756]: pgmap v11136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:41.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:40 smithi156 ceph-mon[32679]: pgmap v11136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:42.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:42 smithi092 ceph-mon[29156]: pgmap v11137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:43.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:42 smithi189 ceph-mon[32756]: pgmap v11137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:43.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:42 smithi156 ceph-mon[32679]: pgmap v11137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19939.646726 secs 2024-04-26T23:50:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19242.616492 secs 2024-04-26T23:50:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19939.646726 secs 2024-04-26T23:50:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19242.616492 secs 2024-04-26T23:50:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19939.646726 secs 2024-04-26T23:50:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19242.616492 secs 2024-04-26T23:50:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:45 smithi189 ceph-mon[32756]: pgmap v11138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:45 smithi156 ceph-mon[32679]: pgmap v11138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:45 smithi092 ceph-mon[29156]: pgmap v11138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:46.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:46 smithi092 ceph-mon[29156]: pgmap v11139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:47.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:46 smithi189 ceph-mon[32756]: pgmap v11139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:47.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:46 smithi156 ceph-mon[32679]: pgmap v11139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:48.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:48 smithi092 ceph-mon[29156]: pgmap v11140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:49.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:48 smithi189 ceph-mon[32756]: pgmap v11140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:49.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:48 smithi156 ceph-mon[32679]: pgmap v11140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19944.646871 secs 2024-04-26T23:50:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19247.616560 secs 2024-04-26T23:50:50.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19944.646871 secs 2024-04-26T23:50:50.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19247.616560 secs 2024-04-26T23:50:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19944.646871 secs 2024-04-26T23:50:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19247.616560 secs 2024-04-26T23:50:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:50 smithi092 ceph-mon[29156]: pgmap v11141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:51.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:50 smithi189 ceph-mon[32756]: pgmap v11141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:51.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:50 smithi156 ceph-mon[32679]: pgmap v11141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:52.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:52 smithi092 ceph-mon[29156]: pgmap v11142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:53.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:52 smithi189 ceph-mon[32756]: pgmap v11142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:53.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:52 smithi156 ceph-mon[32679]: pgmap v11142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19949.646957 secs 2024-04-26T23:50:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19252.616706 secs 2024-04-26T23:50:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19949.646957 secs 2024-04-26T23:50:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19252.616706 secs 2024-04-26T23:50:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19949.646957 secs 2024-04-26T23:50:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19252.616706 secs 2024-04-26T23:50:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:55 smithi189 ceph-mon[32756]: pgmap v11143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:55 smithi156 ceph-mon[32679]: pgmap v11143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:55.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:55 smithi092 ceph-mon[29156]: pgmap v11143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:56 smithi092 ceph-mon[29156]: pgmap v11144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:57.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:56 smithi189 ceph-mon[32756]: pgmap v11144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:57.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:56 smithi156 ceph-mon[32679]: pgmap v11144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:50:58.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:58 smithi092 ceph-mon[29156]: pgmap v11145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:59.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:58 smithi189 ceph-mon[32756]: pgmap v11145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:59.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:58 smithi156 ceph-mon[32679]: pgmap v11145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:50:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19954.647086 secs 2024-04-26T23:50:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:50:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19257.616834 secs 2024-04-26T23:51:00.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19954.647086 secs 2024-04-26T23:51:00.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:50:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19257.616834 secs 2024-04-26T23:51:00.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19954.647086 secs 2024-04-26T23:51:00.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:50:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19257.616834 secs 2024-04-26T23:51:01.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:00 smithi189 ceph-mon[32756]: pgmap v11146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:01.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:00 smithi156 ceph-mon[32679]: pgmap v11146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:01.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:00 smithi092 ceph-mon[29156]: pgmap v11146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:02.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:02 smithi092 ceph-mon[29156]: pgmap v11147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:03.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:02 smithi189 ceph-mon[32756]: pgmap v11147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:03.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:02 smithi156 ceph-mon[32679]: pgmap v11147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19959.647196 secs 2024-04-26T23:51:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19262.616947 secs 2024-04-26T23:51:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19959.647196 secs 2024-04-26T23:51:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19262.616947 secs 2024-04-26T23:51:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19959.647196 secs 2024-04-26T23:51:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19262.616947 secs 2024-04-26T23:51:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:05 smithi189 ceph-mon[32756]: pgmap v11148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:05 smithi156 ceph-mon[32679]: pgmap v11148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:05 smithi092 ceph-mon[29156]: pgmap v11148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:06.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:06 smithi092 ceph-mon[29156]: pgmap v11149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:07.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:06 smithi189 ceph-mon[32756]: pgmap v11149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:07.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:06 smithi156 ceph-mon[32679]: pgmap v11149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:08.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:08 smithi092 ceph-mon[29156]: pgmap v11150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:09.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:08 smithi189 ceph-mon[32756]: pgmap v11150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:09.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:08 smithi156 ceph-mon[32679]: pgmap v11150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19964.647314 secs 2024-04-26T23:51:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19267.617095 secs 2024-04-26T23:51:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19964.647314 secs 2024-04-26T23:51:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19267.617095 secs 2024-04-26T23:51:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19964.647314 secs 2024-04-26T23:51:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19267.617095 secs 2024-04-26T23:51:11.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:11 smithi156 ceph-mon[32679]: pgmap v11151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:11.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:11 smithi092 ceph-mon[29156]: pgmap v11151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:11 smithi189 ceph-mon[32756]: pgmap v11151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:12.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:12 smithi092 ceph-mon[29156]: pgmap v11152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:13.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:12 smithi189 ceph-mon[32756]: pgmap v11152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:13.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:12 smithi156 ceph-mon[32679]: pgmap v11152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19969.647433 secs 2024-04-26T23:51:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19272.617228 secs 2024-04-26T23:51:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19969.647433 secs 2024-04-26T23:51:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19272.617228 secs 2024-04-26T23:51:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19969.647433 secs 2024-04-26T23:51:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19272.617228 secs 2024-04-26T23:51:15.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:15 smithi189 ceph-mon[32756]: pgmap v11153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:15.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:15 smithi156 ceph-mon[32679]: pgmap v11153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:15 smithi092 ceph-mon[29156]: pgmap v11153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:16.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:16 smithi092 ceph-mon[29156]: pgmap v11154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:17.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:16 smithi189 ceph-mon[32756]: pgmap v11154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:17.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:16 smithi156 ceph-mon[32679]: pgmap v11154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19974.647505 secs 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: pgmap v11155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19277.617348 secs 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:51:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:51:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: pgmap v11156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:51:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: pgmap v11157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:51:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19974.647505 secs 2024-04-26T23:51:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: pgmap v11155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:51:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19277.617348 secs 2024-04-26T23:51:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:51:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:51:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:51:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: pgmap v11156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:51:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: pgmap v11157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19974.647505 secs 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: pgmap v11155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19277.617348 secs 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: pgmap v11156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: pgmap v11157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:51:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:22 smithi189 ceph-mon[32756]: pgmap v11158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:22 smithi156 ceph-mon[32679]: pgmap v11158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:22 smithi092 ceph-mon[29156]: pgmap v11158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:24 smithi189 ceph-mon[32756]: pgmap v11159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:51:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19979.647635 secs 2024-04-26T23:51:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19282.617468 secs 2024-04-26T23:51:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:24 smithi156 ceph-mon[32679]: pgmap v11159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:51:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19979.647635 secs 2024-04-26T23:51:24.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19282.617468 secs 2024-04-26T23:51:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:24 smithi092 ceph-mon[29156]: pgmap v11159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-26T23:51:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19979.647635 secs 2024-04-26T23:51:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19282.617468 secs 2024-04-26T23:51:26.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:26 smithi189 ceph-mon[32756]: pgmap v11160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:26.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:26 smithi156 ceph-mon[32679]: pgmap v11160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:26 smithi092 ceph-mon[29156]: pgmap v11160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-26T23:51:28.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:28 smithi189 ceph-mon[32756]: pgmap v11161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:51:28.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:28 smithi156 ceph-mon[32679]: pgmap v11161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:51:28.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:28 smithi092 ceph-mon[29156]: pgmap v11161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:51:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19984.647774 secs 2024-04-26T23:51:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19287.617603 secs 2024-04-26T23:51:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19984.647774 secs 2024-04-26T23:51:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19287.617603 secs 2024-04-26T23:51:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19984.647774 secs 2024-04-26T23:51:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19287.617603 secs 2024-04-26T23:51:30.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:30 smithi189 ceph-mon[32756]: pgmap v11162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:51:30.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:30 smithi156 ceph-mon[32679]: pgmap v11162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:51:30.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:30 smithi092 ceph-mon[29156]: pgmap v11162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:51:32.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:32 smithi189 ceph-mon[32756]: pgmap v11163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:32.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:32 smithi156 ceph-mon[32679]: pgmap v11163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:32 smithi092 ceph-mon[29156]: pgmap v11163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:34 smithi189 ceph-mon[32756]: pgmap v11164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19989.647895 secs 2024-04-26T23:51:34.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19292.617667 secs 2024-04-26T23:51:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:34 smithi156 ceph-mon[32679]: pgmap v11164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19989.647895 secs 2024-04-26T23:51:34.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19292.617667 secs 2024-04-26T23:51:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:34 smithi092 ceph-mon[29156]: pgmap v11164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19989.647895 secs 2024-04-26T23:51:34.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19292.617667 secs 2024-04-26T23:51:36.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:36 smithi189 ceph-mon[32756]: pgmap v11165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:36.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:36 smithi156 ceph-mon[32679]: pgmap v11165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:36.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:36 smithi092 ceph-mon[29156]: pgmap v11165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:51:38.722+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:51:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:51:38.722+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:51:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:51:38.722+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:51:38.726 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:51:38.722+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 156 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:51:38.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:38 smithi189 ceph-mon[32756]: pgmap v11166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:38.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:38 smithi156 ceph-mon[32679]: pgmap v11166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:38.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:38 smithi092 ceph-mon[29156]: pgmap v11166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19994.648005 secs 2024-04-26T23:51:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19297.617798 secs 2024-04-26T23:51:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19994.648005 secs 2024-04-26T23:51:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19297.617798 secs 2024-04-26T23:51:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19994.648005 secs 2024-04-26T23:51:39.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19297.617798 secs 2024-04-26T23:51:40.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:40 smithi189 ceph-mon[32756]: pgmap v11167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:40.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:40 smithi156 ceph-mon[32679]: pgmap v11167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:40 smithi092 ceph-mon[29156]: pgmap v11167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:42.799 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:42 smithi092 ceph-mon[29156]: pgmap v11168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:42.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:42 smithi189 ceph-mon[32756]: pgmap v11168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:42 smithi156 ceph-mon[32679]: pgmap v11168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:44 smithi189 ceph-mon[32756]: pgmap v11169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 19999.648121 secs 2024-04-26T23:51:44.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19302.617919 secs 2024-04-26T23:51:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:44 smithi156 ceph-mon[32679]: pgmap v11169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 19999.648121 secs 2024-04-26T23:51:44.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19302.617919 secs 2024-04-26T23:51:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:44 smithi092 ceph-mon[29156]: pgmap v11169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 19999.648121 secs 2024-04-26T23:51:44.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19302.617919 secs 2024-04-26T23:51:46.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:46 smithi189 ceph-mon[32756]: pgmap v11170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:46 smithi156 ceph-mon[32679]: pgmap v11170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:46 smithi092 ceph-mon[29156]: pgmap v11170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:48.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:48 smithi189 ceph-mon[32756]: pgmap v11171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:48 smithi156 ceph-mon[32679]: pgmap v11171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:48.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:48 smithi092 ceph-mon[29156]: pgmap v11171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20004.648223 secs 2024-04-26T23:51:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19307.618043 secs 2024-04-26T23:51:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20004.648223 secs 2024-04-26T23:51:49.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19307.618043 secs 2024-04-26T23:51:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20004.648223 secs 2024-04-26T23:51:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19307.618043 secs 2024-04-26T23:51:50.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:50 smithi189 ceph-mon[32756]: pgmap v11172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:50 smithi156 ceph-mon[32679]: pgmap v11172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:50 smithi092 ceph-mon[29156]: pgmap v11172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:52.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:52 smithi189 ceph-mon[32756]: pgmap v11173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:52 smithi156 ceph-mon[32679]: pgmap v11173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:52.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:52 smithi092 ceph-mon[29156]: pgmap v11173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:54 smithi189 ceph-mon[32756]: pgmap v11174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20009.648287 secs 2024-04-26T23:51:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19312.618164 secs 2024-04-26T23:51:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:54 smithi156 ceph-mon[32679]: pgmap v11174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20009.648287 secs 2024-04-26T23:51:54.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19312.618164 secs 2024-04-26T23:51:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:54 smithi092 ceph-mon[29156]: pgmap v11174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20009.648287 secs 2024-04-26T23:51:54.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19312.618164 secs 2024-04-26T23:51:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:56 smithi189 ceph-mon[32756]: pgmap v11175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:56 smithi156 ceph-mon[32679]: pgmap v11175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:56 smithi092 ceph-mon[29156]: pgmap v11175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:51:58.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:58 smithi189 ceph-mon[32756]: pgmap v11176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:58 smithi156 ceph-mon[32679]: pgmap v11176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:58 smithi092 ceph-mon[29156]: pgmap v11176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:51:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20014.648384 secs 2024-04-26T23:51:59.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:51:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19317.618284 secs 2024-04-26T23:51:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20014.648384 secs 2024-04-26T23:51:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:51:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19317.618284 secs 2024-04-26T23:51:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20014.648384 secs 2024-04-26T23:51:59.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:51:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19317.618284 secs 2024-04-26T23:52:00.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:00 smithi189 ceph-mon[32756]: pgmap v11177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:00 smithi156 ceph-mon[32679]: pgmap v11177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:00 smithi092 ceph-mon[29156]: pgmap v11177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:02.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:02 smithi189 ceph-mon[32756]: pgmap v11178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:02 smithi156 ceph-mon[32679]: pgmap v11178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:02 smithi092 ceph-mon[29156]: pgmap v11178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:04 smithi189 ceph-mon[32756]: pgmap v11179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20019.648503 secs 2024-04-26T23:52:04.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19322.618397 secs 2024-04-26T23:52:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:04 smithi156 ceph-mon[32679]: pgmap v11179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20019.648503 secs 2024-04-26T23:52:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19322.618397 secs 2024-04-26T23:52:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:04 smithi092 ceph-mon[29156]: pgmap v11179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20019.648503 secs 2024-04-26T23:52:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19322.618397 secs 2024-04-26T23:52:06.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:52:06.061+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:52:06.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:52:06.061+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:52:06.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:52:06.061+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:52:06.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:52:06.061+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:52:06.497 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:52:06.061+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:52:06.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:06 smithi189 ceph-mon[32756]: pgmap v11180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:06.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:06 smithi156 ceph-mon[32679]: pgmap v11180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:06 smithi092 ceph-mon[29156]: pgmap v11180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:08.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:08 smithi189 ceph-mon[32756]: pgmap v11181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:08 smithi156 ceph-mon[32679]: pgmap v11181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:08 smithi092 ceph-mon[29156]: pgmap v11181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20024.648625 secs 2024-04-26T23:52:09.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19327.618478 secs 2024-04-26T23:52:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20024.648625 secs 2024-04-26T23:52:09.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19327.618478 secs 2024-04-26T23:52:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20024.648625 secs 2024-04-26T23:52:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19327.618478 secs 2024-04-26T23:52:10.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:10 smithi189 ceph-mon[32756]: pgmap v11182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:10 smithi156 ceph-mon[32679]: pgmap v11182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:10 smithi092 ceph-mon[29156]: pgmap v11182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:12.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:12 smithi189 ceph-mon[32756]: pgmap v11183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:12 smithi156 ceph-mon[32679]: pgmap v11183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:12 smithi092 ceph-mon[29156]: pgmap v11183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:14 smithi189 ceph-mon[32756]: pgmap v11184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20029.648758 secs 2024-04-26T23:52:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19332.618563 secs 2024-04-26T23:52:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:14 smithi156 ceph-mon[32679]: pgmap v11184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20029.648758 secs 2024-04-26T23:52:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19332.618563 secs 2024-04-26T23:52:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:14 smithi092 ceph-mon[29156]: pgmap v11184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20029.648758 secs 2024-04-26T23:52:14.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19332.618563 secs 2024-04-26T23:52:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:16 smithi189 ceph-mon[32756]: pgmap v11185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:16 smithi156 ceph-mon[32679]: pgmap v11185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:16.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:16 smithi092 ceph-mon[29156]: pgmap v11185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:18 smithi189 ceph-mon[32756]: pgmap v11186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:18 smithi156 ceph-mon[32679]: pgmap v11186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:18 smithi092 ceph-mon[29156]: pgmap v11186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-26T23:52:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20034.648874 secs 2024-04-26T23:52:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19337.618676 secs 2024-04-26T23:52:19.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:52:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20034.648874 secs 2024-04-26T23:52:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19337.618676 secs 2024-04-26T23:52:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:52:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20034.648874 secs 2024-04-26T23:52:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19337.618676 secs 2024-04-26T23:52:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:52:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:20 smithi189 ceph-mon[32756]: pgmap v11187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:52:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:52:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:52:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:20 smithi156 ceph-mon[32679]: pgmap v11187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:52:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:52:20.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:52:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:20 smithi092 ceph-mon[29156]: pgmap v11187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-26T23:52:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:52:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:52:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:52:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:21 smithi189 ceph-mon[32756]: pgmap v11188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:52:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:21 smithi189 ceph-mon[32756]: pgmap v11189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:21 smithi156 ceph-mon[32679]: pgmap v11188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:52:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:21 smithi156 ceph-mon[32679]: pgmap v11189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:21 smithi092 ceph-mon[29156]: pgmap v11188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:52:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:21 smithi092 ceph-mon[29156]: pgmap v11189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:23.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:23 smithi092 ceph-mon[29156]: pgmap v11190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:23 smithi189 ceph-mon[32756]: pgmap v11190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:23 smithi156 ceph-mon[32679]: pgmap v11190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20039.648986 secs 2024-04-26T23:52:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19342.618766 secs 2024-04-26T23:52:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20039.648986 secs 2024-04-26T23:52:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19342.618766 secs 2024-04-26T23:52:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20039.648986 secs 2024-04-26T23:52:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19342.618766 secs 2024-04-26T23:52:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:25 smithi189 ceph-mon[32756]: pgmap v11191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:25 smithi156 ceph-mon[32679]: pgmap v11191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:25 smithi092 ceph-mon[29156]: pgmap v11191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:27 smithi156 ceph-mon[32679]: pgmap v11192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:27.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:27 smithi092 ceph-mon[29156]: pgmap v11192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:27 smithi189 ceph-mon[32756]: pgmap v11192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:52:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:29 smithi156 ceph-mon[32679]: pgmap v11193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:52:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20044.649099 secs 2024-04-26T23:52:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19347.618886 secs 2024-04-26T23:52:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:29 smithi092 ceph-mon[29156]: pgmap v11193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:52:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20044.649099 secs 2024-04-26T23:52:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19347.618886 secs 2024-04-26T23:52:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:29 smithi189 ceph-mon[32756]: pgmap v11193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:52:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20044.649099 secs 2024-04-26T23:52:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19347.618886 secs 2024-04-26T23:52:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:31 smithi156 ceph-mon[32679]: pgmap v11194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:52:31.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:31 smithi092 ceph-mon[29156]: pgmap v11194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:52:32.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:31 smithi189 ceph-mon[32756]: pgmap v11194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:52:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:33 smithi156 ceph-mon[32679]: pgmap v11195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:33 smithi092 ceph-mon[29156]: pgmap v11195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:34.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:33 smithi189 ceph-mon[32756]: pgmap v11195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20049.649237 secs 2024-04-26T23:52:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19352.618957 secs 2024-04-26T23:52:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20049.649237 secs 2024-04-26T23:52:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19352.618957 secs 2024-04-26T23:52:35.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20049.649237 secs 2024-04-26T23:52:35.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19352.618957 secs 2024-04-26T23:52:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:35 smithi156 ceph-mon[32679]: pgmap v11196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:35 smithi092 ceph-mon[29156]: pgmap v11196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:35 smithi189 ceph-mon[32756]: pgmap v11196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:37 smithi156 ceph-mon[32679]: pgmap v11197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:37.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:37 smithi092 ceph-mon[29156]: pgmap v11197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:37 smithi189 ceph-mon[32756]: pgmap v11197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:39 smithi156 ceph-mon[32679]: pgmap v11198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20054.649376 secs 2024-04-26T23:52:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19357.619065 secs 2024-04-26T23:52:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:39 smithi092 ceph-mon[29156]: pgmap v11198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20054.649376 secs 2024-04-26T23:52:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19357.619065 secs 2024-04-26T23:52:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:39 smithi189 ceph-mon[32756]: pgmap v11198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20054.649376 secs 2024-04-26T23:52:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19357.619065 secs 2024-04-26T23:52:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:41 smithi156 ceph-mon[32679]: pgmap v11199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:41.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:41 smithi092 ceph-mon[29156]: pgmap v11199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:41 smithi189 ceph-mon[32756]: pgmap v11199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:43 smithi156 ceph-mon[32679]: pgmap v11200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:43 smithi092 ceph-mon[29156]: pgmap v11200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:43 smithi189 ceph-mon[32756]: pgmap v11200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20059.649451 secs 2024-04-26T23:52:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19362.619192 secs 2024-04-26T23:52:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20059.649451 secs 2024-04-26T23:52:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19362.619192 secs 2024-04-26T23:52:45.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20059.649451 secs 2024-04-26T23:52:45.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19362.619192 secs 2024-04-26T23:52:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:45 smithi156 ceph-mon[32679]: pgmap v11201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:45 smithi092 ceph-mon[29156]: pgmap v11201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:45 smithi189 ceph-mon[32756]: pgmap v11201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:47 smithi092 ceph-mon[29156]: pgmap v11202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:47 smithi189 ceph-mon[32756]: pgmap v11202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:48.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:47 smithi156 ceph-mon[32679]: pgmap v11202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:49 smithi092 ceph-mon[29156]: pgmap v11203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20064.649576 secs 2024-04-26T23:52:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19367.619324 secs 2024-04-26T23:52:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:49 smithi189 ceph-mon[32756]: pgmap v11203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20064.649576 secs 2024-04-26T23:52:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19367.619324 secs 2024-04-26T23:52:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:49 smithi156 ceph-mon[32679]: pgmap v11203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20064.649576 secs 2024-04-26T23:52:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19367.619324 secs 2024-04-26T23:52:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:51 smithi092 ceph-mon[29156]: pgmap v11204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:52.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:51 smithi189 ceph-mon[32756]: pgmap v11204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:52.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:51 smithi156 ceph-mon[32679]: pgmap v11204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:53 smithi092 ceph-mon[29156]: pgmap v11205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:54.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:53 smithi189 ceph-mon[32756]: pgmap v11205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:54.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:53 smithi156 ceph-mon[32679]: pgmap v11205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20069.649707 secs 2024-04-26T23:52:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19372.619461 secs 2024-04-26T23:52:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20069.649707 secs 2024-04-26T23:52:55.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19372.619461 secs 2024-04-26T23:52:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20069.649707 secs 2024-04-26T23:52:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19372.619461 secs 2024-04-26T23:52:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:55 smithi092 ceph-mon[29156]: pgmap v11206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:56.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:55 smithi189 ceph-mon[32756]: pgmap v11206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:56.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:55 smithi156 ceph-mon[32679]: pgmap v11206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:52:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:56 smithi092 ceph-mon[29156]: pgmap v11207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:57.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:56 smithi189 ceph-mon[32756]: pgmap v11207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:56 smithi156 ceph-mon[32679]: pgmap v11207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:59 smithi189 ceph-mon[32756]: pgmap v11208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20074.649870 secs 2024-04-26T23:52:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:52:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19377.619525 secs 2024-04-26T23:52:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:59 smithi156 ceph-mon[32679]: pgmap v11208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20074.649870 secs 2024-04-26T23:52:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:52:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19377.619525 secs 2024-04-26T23:52:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:59 smithi092 ceph-mon[29156]: pgmap v11208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:52:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20074.649870 secs 2024-04-26T23:52:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:52:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19377.619525 secs 2024-04-26T23:53:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:01 smithi189 ceph-mon[32756]: pgmap v11209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:01 smithi156 ceph-mon[32679]: pgmap v11209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:01 smithi092 ceph-mon[29156]: pgmap v11209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:03 smithi189 ceph-mon[32756]: pgmap v11210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:03 smithi156 ceph-mon[32679]: pgmap v11210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:03 smithi092 ceph-mon[29156]: pgmap v11210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20079.649992 secs 2024-04-26T23:53:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19382.619643 secs 2024-04-26T23:53:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20079.649992 secs 2024-04-26T23:53:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19382.619643 secs 2024-04-26T23:53:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20079.649992 secs 2024-04-26T23:53:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19382.619643 secs 2024-04-26T23:53:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:05 smithi189 ceph-mon[32756]: pgmap v11211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:05 smithi156 ceph-mon[32679]: pgmap v11211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:05 smithi092 ceph-mon[29156]: pgmap v11211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:07.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:07 smithi189 ceph-mon[32756]: pgmap v11212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:07 smithi156 ceph-mon[32679]: pgmap v11212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:07 smithi092 ceph-mon[29156]: pgmap v11212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:09 smithi189 ceph-mon[32756]: pgmap v11213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20084.650136 secs 2024-04-26T23:53:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 19387.619756 secs 2024-04-26T23:53:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:09 smithi189 ceph-mon[32756]: slow request 362.760270 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:53:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:09 smithi156 ceph-mon[32679]: pgmap v11213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20084.650136 secs 2024-04-26T23:53:09.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 19387.619756 secs 2024-04-26T23:53:09.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:09 smithi156 ceph-mon[32679]: slow request 362.760270 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:53:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:09 smithi092 ceph-mon[29156]: pgmap v11213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20084.650136 secs 2024-04-26T23:53:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 19387.619756 secs 2024-04-26T23:53:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:09 smithi092 ceph-mon[29156]: slow request 362.760270 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:53:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:11 smithi189 ceph-mon[32756]: pgmap v11214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:11.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:11 smithi156 ceph-mon[32679]: pgmap v11214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:11 smithi092 ceph-mon[29156]: pgmap v11214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:13.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:13 smithi189 ceph-mon[32756]: pgmap v11215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:13 smithi156 ceph-mon[32679]: pgmap v11215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:13 smithi092 ceph-mon[29156]: pgmap v11215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:14.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20089.650259 secs 2024-04-26T23:53:14.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19392.619869 secs 2024-04-26T23:53:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20089.650259 secs 2024-04-26T23:53:14.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19392.619869 secs 2024-04-26T23:53:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20089.650259 secs 2024-04-26T23:53:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19392.619869 secs 2024-04-26T23:53:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:15 smithi189 ceph-mon[32756]: pgmap v11216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:15 smithi156 ceph-mon[32679]: pgmap v11216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:15 smithi092 ceph-mon[29156]: pgmap v11216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:17.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:17 smithi189 ceph-mon[32756]: pgmap v11217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:17.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:17 smithi156 ceph-mon[32679]: pgmap v11217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:17 smithi092 ceph-mon[29156]: pgmap v11217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:19 smithi189 ceph-mon[32756]: pgmap v11218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20094.650409 secs 2024-04-26T23:53:19.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19397.619986 secs 2024-04-26T23:53:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:19 smithi156 ceph-mon[32679]: pgmap v11218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20094.650409 secs 2024-04-26T23:53:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19397.619986 secs 2024-04-26T23:53:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:19 smithi092 ceph-mon[29156]: pgmap v11218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20094.650409 secs 2024-04-26T23:53:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19397.619986 secs 2024-04-26T23:53:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:53:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:53:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:53:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:21 smithi156 ceph-mon[32679]: pgmap v11219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:53:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:53:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:53:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:21 smithi092 ceph-mon[29156]: pgmap v11219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:53:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:53:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:53:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:21 smithi189 ceph-mon[32756]: pgmap v11219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:53:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:53:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:53:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:22 smithi156 ceph-mon[32679]: pgmap v11220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:53:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:22 smithi156 ceph-mon[32679]: pgmap v11221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:22 smithi092 ceph-mon[29156]: pgmap v11220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:53:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:22 smithi092 ceph-mon[29156]: pgmap v11221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:22 smithi189 ceph-mon[32756]: pgmap v11220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:53:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:22 smithi189 ceph-mon[32756]: pgmap v11221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:24 smithi156 ceph-mon[32679]: pgmap v11222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:53:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20099.650531 secs 2024-04-26T23:53:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19402.620065 secs 2024-04-26T23:53:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:24 smithi092 ceph-mon[29156]: pgmap v11222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:53:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20099.650531 secs 2024-04-26T23:53:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19402.620065 secs 2024-04-26T23:53:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:24 smithi189 ceph-mon[32756]: pgmap v11222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:53:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20099.650531 secs 2024-04-26T23:53:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19402.620065 secs 2024-04-26T23:53:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:26 smithi156 ceph-mon[32679]: pgmap v11223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:26 smithi092 ceph-mon[29156]: pgmap v11223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:26 smithi189 ceph-mon[32756]: pgmap v11223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:28 smithi156 ceph-mon[32679]: pgmap v11224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:28 smithi092 ceph-mon[29156]: pgmap v11224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:28 smithi189 ceph-mon[32756]: pgmap v11224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20104.650628 secs 2024-04-26T23:53:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19407.620182 secs 2024-04-26T23:53:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20104.650628 secs 2024-04-26T23:53:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19407.620182 secs 2024-04-26T23:53:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20104.650628 secs 2024-04-26T23:53:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19407.620182 secs 2024-04-26T23:53:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:30 smithi156 ceph-mon[32679]: pgmap v11225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:30 smithi092 ceph-mon[29156]: pgmap v11225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:30 smithi189 ceph-mon[32756]: pgmap v11225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:53:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:32 smithi156 ceph-mon[32679]: pgmap v11226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:53:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:32 smithi092 ceph-mon[29156]: pgmap v11226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:53:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:32 smithi189 ceph-mon[32756]: pgmap v11226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:53:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:34 smithi156 ceph-mon[32679]: pgmap v11227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20109.650703 secs 2024-04-26T23:53:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19412.620313 secs 2024-04-26T23:53:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:34 smithi092 ceph-mon[29156]: pgmap v11227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20109.650703 secs 2024-04-26T23:53:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19412.620313 secs 2024-04-26T23:53:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:34 smithi189 ceph-mon[32756]: pgmap v11227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20109.650703 secs 2024-04-26T23:53:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19412.620313 secs 2024-04-26T23:53:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:36 smithi156 ceph-mon[32679]: pgmap v11228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:36 smithi092 ceph-mon[29156]: pgmap v11228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:36 smithi189 ceph-mon[32756]: pgmap v11228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:38 smithi156 ceph-mon[32679]: pgmap v11229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:38 smithi092 ceph-mon[29156]: pgmap v11229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:38 smithi189 ceph-mon[32756]: pgmap v11229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20114.650886 secs 2024-04-26T23:53:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19417.620403 secs 2024-04-26T23:53:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20114.650886 secs 2024-04-26T23:53:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19417.620403 secs 2024-04-26T23:53:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20114.650886 secs 2024-04-26T23:53:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19417.620403 secs 2024-04-26T23:53:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:40 smithi156 ceph-mon[32679]: pgmap v11230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:40 smithi092 ceph-mon[29156]: pgmap v11230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:40 smithi189 ceph-mon[32756]: pgmap v11230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:42 smithi156 ceph-mon[32679]: pgmap v11231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:42 smithi092 ceph-mon[29156]: pgmap v11231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:42 smithi189 ceph-mon[32756]: pgmap v11231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:44 smithi092 ceph-mon[29156]: pgmap v11232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20119.650988 secs 2024-04-26T23:53:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19422.620520 secs 2024-04-26T23:53:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:44 smithi189 ceph-mon[32756]: pgmap v11232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20119.650988 secs 2024-04-26T23:53:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19422.620520 secs 2024-04-26T23:53:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:44 smithi156 ceph-mon[32679]: pgmap v11232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20119.650988 secs 2024-04-26T23:53:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19422.620520 secs 2024-04-26T23:53:46.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:46 smithi189 ceph-mon[32756]: pgmap v11233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:46 smithi092 ceph-mon[29156]: pgmap v11233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:46 smithi156 ceph-mon[32679]: pgmap v11233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:48 smithi092 ceph-mon[29156]: pgmap v11234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:48 smithi189 ceph-mon[32756]: pgmap v11234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:48 smithi156 ceph-mon[32679]: pgmap v11234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20124.651115 secs 2024-04-26T23:53:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19427.620646 secs 2024-04-26T23:53:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20124.651115 secs 2024-04-26T23:53:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19427.620646 secs 2024-04-26T23:53:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20124.651115 secs 2024-04-26T23:53:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19427.620646 secs 2024-04-26T23:53:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:50 smithi092 ceph-mon[29156]: pgmap v11235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:50 smithi189 ceph-mon[32756]: pgmap v11235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:50 smithi156 ceph-mon[32679]: pgmap v11235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:52 smithi092 ceph-mon[29156]: pgmap v11236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:52 smithi189 ceph-mon[32756]: pgmap v11236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:52 smithi156 ceph-mon[32679]: pgmap v11236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:54 smithi092 ceph-mon[29156]: pgmap v11237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20129.651180 secs 2024-04-26T23:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19432.620766 secs 2024-04-26T23:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:54 smithi189 ceph-mon[32756]: pgmap v11237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20129.651180 secs 2024-04-26T23:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19432.620766 secs 2024-04-26T23:53:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:54 smithi156 ceph-mon[32679]: pgmap v11237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20129.651180 secs 2024-04-26T23:53:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19432.620766 secs 2024-04-26T23:53:56.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:56 smithi092 ceph-mon[29156]: pgmap v11238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:56 smithi189 ceph-mon[32756]: pgmap v11238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:56 smithi156 ceph-mon[32679]: pgmap v11238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:53:58.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:58 smithi092 ceph-mon[29156]: pgmap v11239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:58 smithi189 ceph-mon[32756]: pgmap v11239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:58 smithi156 ceph-mon[32679]: pgmap v11239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:53:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20134.651307 secs 2024-04-26T23:53:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:53:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19437.620894 secs 2024-04-26T23:53:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20134.651307 secs 2024-04-26T23:53:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:53:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19437.620894 secs 2024-04-26T23:53:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20134.651307 secs 2024-04-26T23:53:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:53:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19437.620894 secs 2024-04-26T23:54:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:00 smithi092 ceph-mon[29156]: pgmap v11240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:00 smithi189 ceph-mon[32756]: pgmap v11240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:00 smithi156 ceph-mon[32679]: pgmap v11240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:02 smithi092 ceph-mon[29156]: pgmap v11241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:02 smithi189 ceph-mon[32756]: pgmap v11241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:02 smithi156 ceph-mon[32679]: pgmap v11241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:04 smithi092 ceph-mon[29156]: pgmap v11242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20139.651429 secs 2024-04-26T23:54:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19442.620971 secs 2024-04-26T23:54:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:04 smithi189 ceph-mon[32756]: pgmap v11242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20139.651429 secs 2024-04-26T23:54:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19442.620971 secs 2024-04-26T23:54:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:04 smithi156 ceph-mon[32679]: pgmap v11242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20139.651429 secs 2024-04-26T23:54:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19442.620971 secs 2024-04-26T23:54:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:06 smithi092 ceph-mon[29156]: pgmap v11243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:06 smithi189 ceph-mon[32756]: pgmap v11243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:06 smithi156 ceph-mon[32679]: pgmap v11243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:08 smithi092 ceph-mon[29156]: pgmap v11244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:08 smithi189 ceph-mon[32756]: pgmap v11244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:08 smithi156 ceph-mon[32679]: pgmap v11244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20144.651553 secs 2024-04-26T23:54:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19447.621103 secs 2024-04-26T23:54:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20144.651553 secs 2024-04-26T23:54:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19447.621103 secs 2024-04-26T23:54:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20144.651553 secs 2024-04-26T23:54:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19447.621103 secs 2024-04-26T23:54:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:10 smithi092 ceph-mon[29156]: pgmap v11245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:10 smithi189 ceph-mon[32756]: pgmap v11245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:10 smithi156 ceph-mon[32679]: pgmap v11245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:12 smithi189 ceph-mon[32756]: pgmap v11246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:12 smithi156 ceph-mon[32679]: pgmap v11246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:12 smithi092 ceph-mon[29156]: pgmap v11246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:14.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:14 smithi092 ceph-mon[29156]: pgmap v11247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:14.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20149.651695 secs 2024-04-26T23:54:14.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19452.621212 secs 2024-04-26T23:54:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:14 smithi189 ceph-mon[32756]: pgmap v11247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20149.651695 secs 2024-04-26T23:54:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19452.621212 secs 2024-04-26T23:54:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:14 smithi156 ceph-mon[32679]: pgmap v11247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20149.651695 secs 2024-04-26T23:54:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19452.621212 secs 2024-04-26T23:54:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:16 smithi189 ceph-mon[32756]: pgmap v11248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:16 smithi156 ceph-mon[32679]: pgmap v11248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:16 smithi092 ceph-mon[29156]: pgmap v11248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:18 smithi189 ceph-mon[32756]: pgmap v11249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:18 smithi156 ceph-mon[32679]: pgmap v11249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:18 smithi092 ceph-mon[29156]: pgmap v11249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20154.651847 secs 2024-04-26T23:54:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19457.621333 secs 2024-04-26T23:54:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20154.651847 secs 2024-04-26T23:54:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19457.621333 secs 2024-04-26T23:54:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20154.651847 secs 2024-04-26T23:54:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19457.621333 secs 2024-04-26T23:54:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:20 smithi189 ceph-mon[32756]: pgmap v11250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:20 smithi156 ceph-mon[32679]: pgmap v11250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:20 smithi092 ceph-mon[29156]: pgmap v11250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:54:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:54:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:54:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:22 smithi189 ceph-mon[32756]: pgmap v11251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:54:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:54:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:54:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:22 smithi156 ceph-mon[32679]: pgmap v11251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:54:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:54:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:54:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:22 smithi092 ceph-mon[29156]: pgmap v11251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:54:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:54:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:54:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:23 smithi189 ceph-mon[32756]: pgmap v11252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:54:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:23 smithi189 ceph-mon[32756]: pgmap v11253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:23.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:23 smithi156 ceph-mon[32679]: pgmap v11252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:54:23.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:23 smithi156 ceph-mon[32679]: pgmap v11253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:23 smithi092 ceph-mon[29156]: pgmap v11252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:54:23.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:23 smithi092 ceph-mon[29156]: pgmap v11253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20159.652007 secs 2024-04-26T23:54:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19462.621471 secs 2024-04-26T23:54:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20159.652007 secs 2024-04-26T23:54:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19462.621471 secs 2024-04-26T23:54:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20159.652007 secs 2024-04-26T23:54:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19462.621471 secs 2024-04-26T23:54:25.899 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:25 smithi189 ceph-mon[32756]: pgmap v11254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:25.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:25 smithi156 ceph-mon[32679]: pgmap v11254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:25 smithi092 ceph-mon[29156]: pgmap v11254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:27.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:27 smithi092 ceph-mon[29156]: pgmap v11255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:27 smithi189 ceph-mon[32756]: pgmap v11255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:27 smithi156 ceph-mon[32679]: pgmap v11255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:29 smithi189 ceph-mon[32756]: pgmap v11256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:54:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20164.652056 secs 2024-04-26T23:54:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19467.621533 secs 2024-04-26T23:54:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:29 smithi156 ceph-mon[32679]: pgmap v11256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:54:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20164.652056 secs 2024-04-26T23:54:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19467.621533 secs 2024-04-26T23:54:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:29 smithi092 ceph-mon[29156]: pgmap v11256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:54:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20164.652056 secs 2024-04-26T23:54:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19467.621533 secs 2024-04-26T23:54:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:31 smithi189 ceph-mon[32756]: pgmap v11257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:31 smithi156 ceph-mon[32679]: pgmap v11257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:31 smithi092 ceph-mon[29156]: pgmap v11257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:54:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:33 smithi189 ceph-mon[32756]: pgmap v11258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:54:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:33 smithi156 ceph-mon[32679]: pgmap v11258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:54:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:33 smithi092 ceph-mon[29156]: pgmap v11258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:54:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20169.652161 secs 2024-04-26T23:54:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19472.621641 secs 2024-04-26T23:54:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20169.652161 secs 2024-04-26T23:54:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19472.621641 secs 2024-04-26T23:54:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20169.652161 secs 2024-04-26T23:54:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19472.621641 secs 2024-04-26T23:54:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:35 smithi189 ceph-mon[32756]: pgmap v11259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:35 smithi156 ceph-mon[32679]: pgmap v11259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:35 smithi092 ceph-mon[29156]: pgmap v11259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:37 smithi189 ceph-mon[32756]: pgmap v11260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:37 smithi156 ceph-mon[32679]: pgmap v11260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:37 smithi092 ceph-mon[29156]: pgmap v11260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:54:38.747+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:54:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:54:38.747+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:54:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:54:38.747+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:54:38.750 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:54:38.747+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 157 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:54:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:39 smithi189 ceph-mon[32756]: pgmap v11261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20174.652292 secs 2024-04-26T23:54:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19477.621703 secs 2024-04-26T23:54:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:39 smithi156 ceph-mon[32679]: pgmap v11261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20174.652292 secs 2024-04-26T23:54:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19477.621703 secs 2024-04-26T23:54:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:39 smithi092 ceph-mon[29156]: pgmap v11261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20174.652292 secs 2024-04-26T23:54:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19477.621703 secs 2024-04-26T23:54:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:41 smithi189 ceph-mon[32756]: pgmap v11262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:41 smithi156 ceph-mon[32679]: pgmap v11262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:41 smithi092 ceph-mon[29156]: pgmap v11262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:43 smithi189 ceph-mon[32756]: pgmap v11263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:43 smithi156 ceph-mon[32679]: pgmap v11263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:43 smithi092 ceph-mon[29156]: pgmap v11263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:44.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20179.652359 secs 2024-04-26T23:54:44.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19482.621775 secs 2024-04-26T23:54:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20179.652359 secs 2024-04-26T23:54:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19482.621775 secs 2024-04-26T23:54:44.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20179.652359 secs 2024-04-26T23:54:44.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19482.621775 secs 2024-04-26T23:54:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:45 smithi189 ceph-mon[32756]: pgmap v11264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:45 smithi156 ceph-mon[32679]: pgmap v11264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:45 smithi092 ceph-mon[29156]: pgmap v11264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:47 smithi189 ceph-mon[32756]: pgmap v11265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:47 smithi156 ceph-mon[32679]: pgmap v11265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:47 smithi092 ceph-mon[29156]: pgmap v11265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:49 smithi189 ceph-mon[32756]: pgmap v11266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20184.652490 secs 2024-04-26T23:54:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19487.621885 secs 2024-04-26T23:54:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:49 smithi156 ceph-mon[32679]: pgmap v11266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20184.652490 secs 2024-04-26T23:54:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19487.621885 secs 2024-04-26T23:54:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:49 smithi092 ceph-mon[29156]: pgmap v11266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20184.652490 secs 2024-04-26T23:54:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19487.621885 secs 2024-04-26T23:54:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:51 smithi189 ceph-mon[32756]: pgmap v11267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:51.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:51 smithi156 ceph-mon[32679]: pgmap v11267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:51 smithi092 ceph-mon[29156]: pgmap v11267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:53 smithi189 ceph-mon[32756]: pgmap v11268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:53 smithi156 ceph-mon[32679]: pgmap v11268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:53 smithi092 ceph-mon[29156]: pgmap v11268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20189.652629 secs 2024-04-26T23:54:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19492.622033 secs 2024-04-26T23:54:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20189.652629 secs 2024-04-26T23:54:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19492.622033 secs 2024-04-26T23:54:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20189.652629 secs 2024-04-26T23:54:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19492.622033 secs 2024-04-26T23:54:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:55 smithi189 ceph-mon[32756]: pgmap v11269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:55 smithi156 ceph-mon[32679]: pgmap v11269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:55 smithi092 ceph-mon[29156]: pgmap v11269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:54:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:57 smithi189 ceph-mon[32756]: pgmap v11270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:57 smithi156 ceph-mon[32679]: pgmap v11270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:57 smithi092 ceph-mon[29156]: pgmap v11270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:59 smithi189 ceph-mon[32756]: pgmap v11271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20194.652767 secs 2024-04-26T23:54:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:54:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19497.622150 secs 2024-04-26T23:54:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:59 smithi156 ceph-mon[32679]: pgmap v11271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20194.652767 secs 2024-04-26T23:54:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:54:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19497.622150 secs 2024-04-26T23:54:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:59 smithi092 ceph-mon[29156]: pgmap v11271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:54:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20194.652767 secs 2024-04-26T23:54:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:54:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19497.622150 secs 2024-04-26T23:55:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:01 smithi189 ceph-mon[32756]: pgmap v11272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:01 smithi156 ceph-mon[32679]: pgmap v11272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:01 smithi092 ceph-mon[29156]: pgmap v11272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:03 smithi189 ceph-mon[32756]: pgmap v11273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:03 smithi156 ceph-mon[32679]: pgmap v11273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:03 smithi092 ceph-mon[29156]: pgmap v11273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20199.652897 secs 2024-04-26T23:55:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19502.622271 secs 2024-04-26T23:55:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20199.652897 secs 2024-04-26T23:55:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19502.622271 secs 2024-04-26T23:55:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20199.652897 secs 2024-04-26T23:55:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19502.622271 secs 2024-04-26T23:55:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:05 smithi189 ceph-mon[32756]: pgmap v11274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:05 smithi156 ceph-mon[32679]: pgmap v11274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:05 smithi092 ceph-mon[29156]: pgmap v11274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:07 smithi189 ceph-mon[32756]: pgmap v11275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:07 smithi156 ceph-mon[32679]: pgmap v11275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:07 smithi092 ceph-mon[29156]: pgmap v11275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:09 smithi189 ceph-mon[32756]: pgmap v11276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20204.653011 secs 2024-04-26T23:55:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 19507.622358 secs 2024-04-26T23:55:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:09 smithi189 ceph-mon[32756]: slow request 1443.041906 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:55:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:09 smithi156 ceph-mon[32679]: pgmap v11276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20204.653011 secs 2024-04-26T23:55:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 19507.622358 secs 2024-04-26T23:55:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:09 smithi156 ceph-mon[32679]: slow request 1443.041906 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:55:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:09 smithi092 ceph-mon[29156]: pgmap v11276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20204.653011 secs 2024-04-26T23:55:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 19507.622358 secs 2024-04-26T23:55:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:09 smithi092 ceph-mon[29156]: slow request 1443.041906 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:55:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:11 smithi189 ceph-mon[32756]: pgmap v11277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:11 smithi156 ceph-mon[32679]: pgmap v11277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:11 smithi092 ceph-mon[29156]: pgmap v11277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:13 smithi189 ceph-mon[32756]: pgmap v11278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:13 smithi156 ceph-mon[32679]: pgmap v11278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:13 smithi092 ceph-mon[29156]: pgmap v11278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20209.653163 secs 2024-04-26T23:55:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19512.622420 secs 2024-04-26T23:55:14.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20209.653163 secs 2024-04-26T23:55:14.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19512.622420 secs 2024-04-26T23:55:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20209.653163 secs 2024-04-26T23:55:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19512.622420 secs 2024-04-26T23:55:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:15 smithi189 ceph-mon[32756]: pgmap v11279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:15 smithi156 ceph-mon[32679]: pgmap v11279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:15 smithi092 ceph-mon[29156]: pgmap v11279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:17 smithi189 ceph-mon[32756]: pgmap v11280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:17 smithi156 ceph-mon[32679]: pgmap v11280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:17 smithi092 ceph-mon[29156]: pgmap v11280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:19 smithi156 ceph-mon[32679]: pgmap v11281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20214.653297 secs 2024-04-26T23:55:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19517.622499 secs 2024-04-26T23:55:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:19 smithi092 ceph-mon[29156]: pgmap v11281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20214.653297 secs 2024-04-26T23:55:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19517.622499 secs 2024-04-26T23:55:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:19 smithi189 ceph-mon[32756]: pgmap v11281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20214.653297 secs 2024-04-26T23:55:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19517.622499 secs 2024-04-26T23:55:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:21 smithi156 ceph-mon[32679]: pgmap v11282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:21 smithi092 ceph-mon[29156]: pgmap v11282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:21 smithi189 ceph-mon[32756]: pgmap v11282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:55:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:55:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:55:22.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:55:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:55:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:55:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:55:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:55:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:55:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:55:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:55:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:55:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:23 smithi156 ceph-mon[32679]: pgmap v11283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:23 smithi156 ceph-mon[32679]: pgmap v11284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:55:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:23 smithi156 ceph-mon[32679]: pgmap v11285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:55:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:23 smithi092 ceph-mon[29156]: pgmap v11283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:23 smithi092 ceph-mon[29156]: pgmap v11284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:55:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:23 smithi092 ceph-mon[29156]: pgmap v11285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:55:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:23 smithi189 ceph-mon[32756]: pgmap v11283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:24.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:23 smithi189 ceph-mon[32756]: pgmap v11284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:55:24.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:23 smithi189 ceph-mon[32756]: pgmap v11285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:55:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20219.653420 secs 2024-04-26T23:55:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19522.622567 secs 2024-04-26T23:55:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20219.653420 secs 2024-04-26T23:55:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19522.622567 secs 2024-04-26T23:55:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20219.653420 secs 2024-04-26T23:55:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19522.622567 secs 2024-04-26T23:55:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:25 smithi156 ceph-mon[32679]: pgmap v11286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:25 smithi092 ceph-mon[29156]: pgmap v11286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:25 smithi189 ceph-mon[32756]: pgmap v11286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:27 smithi156 ceph-mon[32679]: pgmap v11287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:27 smithi092 ceph-mon[29156]: pgmap v11287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:27 smithi189 ceph-mon[32756]: pgmap v11287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20224.653550 secs 2024-04-26T23:55:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:29 smithi156 ceph-mon[32679]: pgmap v11288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19527.622682 secs 2024-04-26T23:55:29.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20224.653550 secs 2024-04-26T23:55:29.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:29 smithi092 ceph-mon[29156]: pgmap v11288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:29.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19527.622682 secs 2024-04-26T23:55:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20224.653550 secs 2024-04-26T23:55:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:29 smithi189 ceph-mon[32756]: pgmap v11288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19527.622682 secs 2024-04-26T23:55:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:31 smithi156 ceph-mon[32679]: pgmap v11289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:31 smithi092 ceph-mon[29156]: pgmap v11289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:31 smithi189 ceph-mon[32756]: pgmap v11289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:55:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:33 smithi156 ceph-mon[32679]: pgmap v11290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:55:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:33 smithi092 ceph-mon[29156]: pgmap v11290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:55:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:33 smithi189 ceph-mon[32756]: pgmap v11290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:55:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20229.653679 secs 2024-04-26T23:55:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19532.622803 secs 2024-04-26T23:55:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20229.653679 secs 2024-04-26T23:55:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19532.622803 secs 2024-04-26T23:55:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20229.653679 secs 2024-04-26T23:55:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19532.622803 secs 2024-04-26T23:55:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:35 smithi156 ceph-mon[32679]: pgmap v11291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:35 smithi092 ceph-mon[29156]: pgmap v11291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:35 smithi189 ceph-mon[32756]: pgmap v11291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:37 smithi092 ceph-mon[29156]: pgmap v11292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:37 smithi189 ceph-mon[32756]: pgmap v11292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:37 smithi156 ceph-mon[32679]: pgmap v11292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20234.653804 secs 2024-04-26T23:55:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:39 smithi092 ceph-mon[29156]: pgmap v11293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19537.622946 secs 2024-04-26T23:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20234.653804 secs 2024-04-26T23:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:39 smithi189 ceph-mon[32756]: pgmap v11293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19537.622946 secs 2024-04-26T23:55:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20234.653804 secs 2024-04-26T23:55:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:39 smithi156 ceph-mon[32679]: pgmap v11293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19537.622946 secs 2024-04-26T23:55:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:41 smithi092 ceph-mon[29156]: pgmap v11294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:41 smithi189 ceph-mon[32756]: pgmap v11294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:41 smithi156 ceph-mon[32679]: pgmap v11294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:43 smithi092 ceph-mon[29156]: pgmap v11295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:43 smithi189 ceph-mon[32756]: pgmap v11295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:43 smithi156 ceph-mon[32679]: pgmap v11295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20239.653921 secs 2024-04-26T23:55:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19542.623051 secs 2024-04-26T23:55:45.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20239.653921 secs 2024-04-26T23:55:45.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19542.623051 secs 2024-04-26T23:55:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20239.653921 secs 2024-04-26T23:55:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19542.623051 secs 2024-04-26T23:55:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:45 smithi092 ceph-mon[29156]: pgmap v11296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:45 smithi189 ceph-mon[32756]: pgmap v11296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:45 smithi156 ceph-mon[32679]: pgmap v11296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:47 smithi092 ceph-mon[29156]: pgmap v11297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:47 smithi189 ceph-mon[32756]: pgmap v11297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:47 smithi156 ceph-mon[32679]: pgmap v11297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20244.654039 secs 2024-04-26T23:55:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:49 smithi092 ceph-mon[29156]: pgmap v11298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19547.623171 secs 2024-04-26T23:55:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20244.654039 secs 2024-04-26T23:55:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:49 smithi189 ceph-mon[32756]: pgmap v11298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19547.623171 secs 2024-04-26T23:55:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20244.654039 secs 2024-04-26T23:55:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:49 smithi156 ceph-mon[32679]: pgmap v11298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19547.623171 secs 2024-04-26T23:55:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:51 smithi092 ceph-mon[29156]: pgmap v11299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:51 smithi189 ceph-mon[32756]: pgmap v11299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:51 smithi156 ceph-mon[32679]: pgmap v11299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:53 smithi092 ceph-mon[29156]: pgmap v11300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:53 smithi189 ceph-mon[32756]: pgmap v11300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:53 smithi156 ceph-mon[32679]: pgmap v11300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20249.654105 secs 2024-04-26T23:55:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19552.623257 secs 2024-04-26T23:55:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20249.654105 secs 2024-04-26T23:55:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19552.623257 secs 2024-04-26T23:55:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20249.654105 secs 2024-04-26T23:55:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19552.623257 secs 2024-04-26T23:55:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:55 smithi092 ceph-mon[29156]: pgmap v11301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:55 smithi189 ceph-mon[32756]: pgmap v11301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:55 smithi156 ceph-mon[32679]: pgmap v11301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:57 smithi092 ceph-mon[29156]: pgmap v11302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:57 smithi189 ceph-mon[32756]: pgmap v11302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:57 smithi156 ceph-mon[32679]: pgmap v11302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:55:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20254.654230 secs 2024-04-26T23:55:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:59 smithi092 ceph-mon[29156]: pgmap v11303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:55:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:55:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19557.623396 secs 2024-04-26T23:56:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20254.654230 secs 2024-04-26T23:56:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:59 smithi189 ceph-mon[32756]: pgmap v11303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:00.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:55:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19557.623396 secs 2024-04-26T23:56:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20254.654230 secs 2024-04-26T23:56:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:59 smithi156 ceph-mon[32679]: pgmap v11303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:55:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19557.623396 secs 2024-04-26T23:56:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:01 smithi092 ceph-mon[29156]: pgmap v11304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:01 smithi189 ceph-mon[32756]: pgmap v11304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:02.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:01 smithi156 ceph-mon[32679]: pgmap v11304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:03 smithi092 ceph-mon[29156]: pgmap v11305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:03 smithi189 ceph-mon[32756]: pgmap v11305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:03 smithi156 ceph-mon[32679]: pgmap v11305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20259.654367 secs 2024-04-26T23:56:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19562.623512 secs 2024-04-26T23:56:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:04 smithi092 ceph-mon[29156]: pgmap v11306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20259.654367 secs 2024-04-26T23:56:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19562.623512 secs 2024-04-26T23:56:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:04 smithi189 ceph-mon[32756]: pgmap v11306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20259.654367 secs 2024-04-26T23:56:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19562.623512 secs 2024-04-26T23:56:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:04 smithi156 ceph-mon[32679]: pgmap v11306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:07 smithi189 ceph-mon[32756]: pgmap v11307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:07 smithi156 ceph-mon[32679]: pgmap v11307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:07 smithi092 ceph-mon[29156]: pgmap v11307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20264.654517 secs 2024-04-26T23:56:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:09 smithi156 ceph-mon[32679]: pgmap v11308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19567.623609 secs 2024-04-26T23:56:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20264.654517 secs 2024-04-26T23:56:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:09 smithi092 ceph-mon[29156]: pgmap v11308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19567.623609 secs 2024-04-26T23:56:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20264.654517 secs 2024-04-26T23:56:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:09 smithi189 ceph-mon[32756]: pgmap v11308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19567.623609 secs 2024-04-26T23:56:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:11 smithi156 ceph-mon[32679]: pgmap v11309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:11 smithi092 ceph-mon[29156]: pgmap v11309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:11 smithi189 ceph-mon[32756]: pgmap v11309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:13 smithi156 ceph-mon[32679]: pgmap v11310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:13 smithi092 ceph-mon[29156]: pgmap v11310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:13 smithi189 ceph-mon[32756]: pgmap v11310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:15 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20269.654613 secs 2024-04-26T23:56:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19572.623722 secs 2024-04-26T23:56:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:15 smithi092 ceph-mon[29156]: pgmap v11311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:15 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20269.654613 secs 2024-04-26T23:56:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19572.623722 secs 2024-04-26T23:56:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:15 smithi189 ceph-mon[32756]: pgmap v11311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:15 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20269.654613 secs 2024-04-26T23:56:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19572.623722 secs 2024-04-26T23:56:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:15 smithi156 ceph-mon[32679]: pgmap v11311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:17.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:17 smithi156 ceph-mon[32679]: pgmap v11312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:17 smithi092 ceph-mon[29156]: pgmap v11312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:17 smithi189 ceph-mon[32756]: pgmap v11312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20274.654746 secs 2024-04-26T23:56:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:19 smithi156 ceph-mon[32679]: pgmap v11313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19577.623860 secs 2024-04-26T23:56:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20274.654746 secs 2024-04-26T23:56:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:19 smithi092 ceph-mon[29156]: pgmap v11313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19577.623860 secs 2024-04-26T23:56:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20274.654746 secs 2024-04-26T23:56:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:19 smithi189 ceph-mon[32756]: pgmap v11313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19577.623860 secs 2024-04-26T23:56:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:21 smithi156 ceph-mon[32679]: pgmap v11314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:21 smithi092 ceph-mon[29156]: pgmap v11314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:21 smithi189 ceph-mon[32756]: pgmap v11314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:23 smithi156 ceph-mon[32679]: pgmap v11315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:56:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:56:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:56:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:56:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:23 smithi092 ceph-mon[29156]: pgmap v11315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:56:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:56:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:56:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:56:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:23 smithi189 ceph-mon[32756]: pgmap v11315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:56:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:56:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:56:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:56:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:24 smithi156 ceph-mon[32679]: pgmap v11316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:56:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:24 smithi156 ceph-mon[32679]: pgmap v11317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20279.654858 secs 2024-04-26T23:56:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19582.623940 secs 2024-04-26T23:56:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:24 smithi092 ceph-mon[29156]: pgmap v11316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:56:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:24 smithi092 ceph-mon[29156]: pgmap v11317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20279.654858 secs 2024-04-26T23:56:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19582.623940 secs 2024-04-26T23:56:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:24 smithi189 ceph-mon[32756]: pgmap v11316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:56:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:24 smithi189 ceph-mon[32756]: pgmap v11317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20279.654858 secs 2024-04-26T23:56:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19582.623940 secs 2024-04-26T23:56:26.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:26 smithi156 ceph-mon[32679]: pgmap v11318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:26 smithi092 ceph-mon[29156]: pgmap v11318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:27.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:26 smithi189 ceph-mon[32756]: pgmap v11318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:28 smithi156 ceph-mon[32679]: pgmap v11319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:28 smithi092 ceph-mon[29156]: pgmap v11319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:28 smithi189 ceph-mon[32756]: pgmap v11319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:56:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20284.654988 secs 2024-04-26T23:56:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19587.624081 secs 2024-04-26T23:56:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20284.654988 secs 2024-04-26T23:56:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19587.624081 secs 2024-04-26T23:56:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20284.654988 secs 2024-04-26T23:56:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19587.624081 secs 2024-04-26T23:56:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:30 smithi156 ceph-mon[32679]: pgmap v11320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:30 smithi092 ceph-mon[29156]: pgmap v11320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:30 smithi189 ceph-mon[32756]: pgmap v11320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:32 smithi156 ceph-mon[32679]: pgmap v11321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:32 smithi092 ceph-mon[29156]: pgmap v11321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:32 smithi189 ceph-mon[32756]: pgmap v11321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:56:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:34 smithi156 ceph-mon[32679]: pgmap v11322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:56:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20289.655126 secs 2024-04-26T23:56:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19592.624215 secs 2024-04-26T23:56:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:34 smithi092 ceph-mon[29156]: pgmap v11322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:56:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20289.655126 secs 2024-04-26T23:56:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19592.624215 secs 2024-04-26T23:56:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:34 smithi189 ceph-mon[32756]: pgmap v11322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:56:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20289.655126 secs 2024-04-26T23:56:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19592.624215 secs 2024-04-26T23:56:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:36 smithi156 ceph-mon[32679]: pgmap v11323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:36 smithi092 ceph-mon[29156]: pgmap v11323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:36 smithi189 ceph-mon[32756]: pgmap v11323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:38 smithi156 ceph-mon[32679]: pgmap v11324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:38 smithi092 ceph-mon[29156]: pgmap v11324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:38 smithi189 ceph-mon[32756]: pgmap v11324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20294.655244 secs 2024-04-26T23:56:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19597.624288 secs 2024-04-26T23:56:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20294.655244 secs 2024-04-26T23:56:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19597.624288 secs 2024-04-26T23:56:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20294.655244 secs 2024-04-26T23:56:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19597.624288 secs 2024-04-26T23:56:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:40 smithi092 ceph-mon[29156]: pgmap v11325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:40 smithi189 ceph-mon[32756]: pgmap v11325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:40 smithi156 ceph-mon[32679]: pgmap v11325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:42 smithi092 ceph-mon[29156]: pgmap v11326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:42 smithi189 ceph-mon[32756]: pgmap v11326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:42 smithi156 ceph-mon[32679]: pgmap v11326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:44 smithi092 ceph-mon[29156]: pgmap v11327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20299.655356 secs 2024-04-26T23:56:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19602.624402 secs 2024-04-26T23:56:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:44 smithi189 ceph-mon[32756]: pgmap v11327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20299.655356 secs 2024-04-26T23:56:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19602.624402 secs 2024-04-26T23:56:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:44 smithi156 ceph-mon[32679]: pgmap v11327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20299.655356 secs 2024-04-26T23:56:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19602.624402 secs 2024-04-26T23:56:46.987 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:46 smithi156 ceph-mon[32679]: pgmap v11328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:46 smithi092 ceph-mon[29156]: pgmap v11328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:46 smithi189 ceph-mon[32756]: pgmap v11328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:48 smithi092 ceph-mon[29156]: pgmap v11329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:48 smithi189 ceph-mon[32756]: pgmap v11329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:48 smithi156 ceph-mon[32679]: pgmap v11329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20304.655467 secs 2024-04-26T23:56:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19607.624503 secs 2024-04-26T23:56:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20304.655467 secs 2024-04-26T23:56:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19607.624503 secs 2024-04-26T23:56:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20304.655467 secs 2024-04-26T23:56:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19607.624503 secs 2024-04-26T23:56:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:50 smithi092 ceph-mon[29156]: pgmap v11330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:50 smithi189 ceph-mon[32756]: pgmap v11330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:50 smithi156 ceph-mon[32679]: pgmap v11330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:52 smithi092 ceph-mon[29156]: pgmap v11331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:52 smithi189 ceph-mon[32756]: pgmap v11331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:52 smithi156 ceph-mon[32679]: pgmap v11331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:56:53.765+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:56:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:56:53.765+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:56:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:56:53.766+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:56:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:56:53.766+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 158 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:56:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:54 smithi092 ceph-mon[29156]: pgmap v11332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20309.655530 secs 2024-04-26T23:56:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19612.624606 secs 2024-04-26T23:56:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:54 smithi189 ceph-mon[32756]: pgmap v11332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20309.655530 secs 2024-04-26T23:56:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19612.624606 secs 2024-04-26T23:56:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:54 smithi156 ceph-mon[32679]: pgmap v11332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20309.655530 secs 2024-04-26T23:56:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19612.624606 secs 2024-04-26T23:56:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:56 smithi092 ceph-mon[29156]: pgmap v11333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:56 smithi189 ceph-mon[32756]: pgmap v11333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:56 smithi156 ceph-mon[32679]: pgmap v11333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:56:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:58 smithi092 ceph-mon[29156]: pgmap v11334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:58 smithi189 ceph-mon[32756]: pgmap v11334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:58 smithi156 ceph-mon[32679]: pgmap v11334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:56:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20314.655657 secs 2024-04-26T23:56:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:56:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19617.624722 secs 2024-04-26T23:57:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20314.655657 secs 2024-04-26T23:57:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:56:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19617.624722 secs 2024-04-26T23:57:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20314.655657 secs 2024-04-26T23:57:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:56:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19617.624722 secs 2024-04-26T23:57:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:00 smithi092 ceph-mon[29156]: pgmap v11335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:00 smithi189 ceph-mon[32756]: pgmap v11335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:00 smithi156 ceph-mon[32679]: pgmap v11335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:02 smithi092 ceph-mon[29156]: pgmap v11336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:02 smithi189 ceph-mon[32756]: pgmap v11336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:02 smithi156 ceph-mon[32679]: pgmap v11336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:04 smithi092 ceph-mon[29156]: pgmap v11337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20319.655772 secs 2024-04-26T23:57:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19622.624869 secs 2024-04-26T23:57:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:04 smithi189 ceph-mon[32756]: pgmap v11337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20319.655772 secs 2024-04-26T23:57:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19622.624869 secs 2024-04-26T23:57:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:04 smithi156 ceph-mon[32679]: pgmap v11337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20319.655772 secs 2024-04-26T23:57:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19622.624869 secs 2024-04-26T23:57:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:06 smithi092 ceph-mon[29156]: pgmap v11338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:06 smithi189 ceph-mon[32756]: pgmap v11338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:06 smithi156 ceph-mon[32679]: pgmap v11338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:08 smithi092 ceph-mon[29156]: pgmap v11339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:08 smithi189 ceph-mon[32756]: pgmap v11339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:08 smithi156 ceph-mon[32679]: pgmap v11339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20324.655890 secs 2024-04-26T23:57:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19627.624987 secs 2024-04-26T23:57:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:09 smithi189 ceph-mon[32756]: pgmap v11340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20324.655890 secs 2024-04-26T23:57:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19627.624987 secs 2024-04-26T23:57:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:09 smithi156 ceph-mon[32679]: pgmap v11340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20324.655890 secs 2024-04-26T23:57:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19627.624987 secs 2024-04-26T23:57:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:09 smithi092 ceph-mon[29156]: pgmap v11340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:12 smithi156 ceph-mon[32679]: pgmap v11341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:12 smithi092 ceph-mon[29156]: pgmap v11341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:12 smithi189 ceph-mon[32756]: pgmap v11341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:14 smithi156 ceph-mon[32679]: pgmap v11342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20329.656005 secs 2024-04-26T23:57:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19632.625109 secs 2024-04-26T23:57:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:14 smithi092 ceph-mon[29156]: pgmap v11342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20329.656005 secs 2024-04-26T23:57:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19632.625109 secs 2024-04-26T23:57:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:14 smithi189 ceph-mon[32756]: pgmap v11342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20329.656005 secs 2024-04-26T23:57:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19632.625109 secs 2024-04-26T23:57:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:16 smithi156 ceph-mon[32679]: pgmap v11343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:16 smithi092 ceph-mon[29156]: pgmap v11343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:16 smithi189 ceph-mon[32756]: pgmap v11343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:18 smithi156 ceph-mon[32679]: pgmap v11344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:18.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:18 smithi189 ceph-mon[32756]: pgmap v11344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:18 smithi092 ceph-mon[29156]: pgmap v11344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-26T23:57:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20334.656125 secs 2024-04-26T23:57:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19637.625223 secs 2024-04-26T23:57:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20334.656125 secs 2024-04-26T23:57:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19637.625223 secs 2024-04-26T23:57:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20334.656125 secs 2024-04-26T23:57:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19637.625223 secs 2024-04-26T23:57:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:20 smithi092 ceph-mon[29156]: pgmap v11345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:20 smithi189 ceph-mon[32756]: pgmap v11345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:20 smithi156 ceph-mon[32679]: pgmap v11345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-26T23:57:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:22 smithi092 ceph-mon[29156]: pgmap v11346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:22 smithi189 ceph-mon[32756]: pgmap v11346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:22 smithi156 ceph-mon[32679]: pgmap v11346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: pgmap v11347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20339.656211 secs 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19642.625326 secs 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.751 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: pgmap v11347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:24.751 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:57:24.751 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20339.656211 secs 2024-04-26T23:57:24.751 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19642.625326 secs 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.752 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: pgmap v11347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:24.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:57:24.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20339.656211 secs 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19642.625326 secs 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:24.787 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: pgmap v11348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: pgmap v11348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: pgmap v11348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:57:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:57:27.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:57:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:57:27.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:57:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:57:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:57:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:28 smithi092 ceph-mon[29156]: pgmap v11349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:28 smithi092 ceph-mon[29156]: pgmap v11350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:57:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:28 smithi189 ceph-mon[32756]: pgmap v11349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:28 smithi189 ceph-mon[32756]: pgmap v11350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-26T23:57:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-26T23:57:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:28 smithi156 ceph-mon[32679]: pgmap v11349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:28 smithi156 ceph-mon[32679]: pgmap v11350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20344.656331 secs 2024-04-26T23:57:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19647.625464 secs 2024-04-26T23:57:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20344.656331 secs 2024-04-26T23:57:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19647.625464 secs 2024-04-26T23:57:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20344.656331 secs 2024-04-26T23:57:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19647.625464 secs 2024-04-26T23:57:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:30 smithi092 ceph-mon[29156]: pgmap v11351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:30 smithi189 ceph-mon[32756]: pgmap v11351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:30 smithi156 ceph-mon[32679]: pgmap v11351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:32 smithi092 ceph-mon[29156]: pgmap v11352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:32 smithi189 ceph-mon[32756]: pgmap v11352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:32 smithi156 ceph-mon[32679]: pgmap v11352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:34 smithi092 ceph-mon[29156]: pgmap v11353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20349.656450 secs 2024-04-26T23:57:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19652.625598 secs 2024-04-26T23:57:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:34 smithi189 ceph-mon[32756]: pgmap v11353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20349.656450 secs 2024-04-26T23:57:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19652.625598 secs 2024-04-26T23:57:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:34 smithi156 ceph-mon[32679]: pgmap v11353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20349.656450 secs 2024-04-26T23:57:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19652.625598 secs 2024-04-26T23:57:36.484 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:57:36.159+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:57:36.484 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:57:36.159+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:57:36.484 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:57:36.159+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:57:36.484 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:57:36.159+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:57:36.484 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-26T23:57:36.159+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:57:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:36 smithi092 ceph-mon[29156]: pgmap v11354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:36 smithi189 ceph-mon[32756]: pgmap v11354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:36 smithi156 ceph-mon[32679]: pgmap v11354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-26T23:57:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:38 smithi092 ceph-mon[29156]: pgmap v11355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:57:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:57:38.772+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:57:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:57:38.772+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:57:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:57:38.772+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-26T23:57:38.774 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-26T23:57:38.772+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 159 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-26T23:57:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:38 smithi189 ceph-mon[32756]: pgmap v11355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:57:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:38 smithi156 ceph-mon[32679]: pgmap v11355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:57:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:39 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 20354.656568 secs 2024-04-26T23:57:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:39 smithi092 ceph-mon[29156]: slow request 2883.173563 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:57:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19657.625720 secs 2024-04-26T23:57:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:39 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 20354.656568 secs 2024-04-26T23:57:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:39 smithi189 ceph-mon[32756]: slow request 2883.173563 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:57:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19657.625720 secs 2024-04-26T23:57:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:39 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 20354.656568 secs 2024-04-26T23:57:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:39 smithi156 ceph-mon[32679]: slow request 2883.173563 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:57:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19657.625720 secs 2024-04-26T23:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:40 smithi189 ceph-mon[32756]: pgmap v11356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:40 smithi156 ceph-mon[32679]: pgmap v11356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:40 smithi092 ceph-mon[29156]: pgmap v11356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:42 smithi189 ceph-mon[32756]: pgmap v11357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:42 smithi156 ceph-mon[32679]: pgmap v11357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:42 smithi092 ceph-mon[29156]: pgmap v11357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:44 smithi189 ceph-mon[32756]: pgmap v11358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20359.656675 secs 2024-04-26T23:57:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19662.625856 secs 2024-04-26T23:57:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:44 smithi156 ceph-mon[32679]: pgmap v11358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20359.656675 secs 2024-04-26T23:57:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19662.625856 secs 2024-04-26T23:57:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:44 smithi092 ceph-mon[29156]: pgmap v11358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20359.656675 secs 2024-04-26T23:57:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19662.625856 secs 2024-04-26T23:57:46.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:46 smithi092 ceph-mon[29156]: pgmap v11359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:46 smithi189 ceph-mon[32756]: pgmap v11359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:46 smithi156 ceph-mon[32679]: pgmap v11359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:48 smithi189 ceph-mon[32756]: pgmap v11360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:48 smithi156 ceph-mon[32679]: pgmap v11360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:48 smithi092 ceph-mon[29156]: pgmap v11360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-26T23:57:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20364.656831 secs 2024-04-26T23:57:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19667.625947 secs 2024-04-26T23:57:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20364.656831 secs 2024-04-26T23:57:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19667.625947 secs 2024-04-26T23:57:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20364.656831 secs 2024-04-26T23:57:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19667.625947 secs 2024-04-26T23:57:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:50 smithi189 ceph-mon[32756]: pgmap v11361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:50 smithi156 ceph-mon[32679]: pgmap v11361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:50 smithi092 ceph-mon[29156]: pgmap v11361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-26T23:57:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:52 smithi189 ceph-mon[32756]: pgmap v11362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:52 smithi156 ceph-mon[32679]: pgmap v11362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:52 smithi092 ceph-mon[29156]: pgmap v11362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:54 smithi189 ceph-mon[32756]: pgmap v11363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20369.656939 secs 2024-04-26T23:57:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19672.626080 secs 2024-04-26T23:57:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:54 smithi156 ceph-mon[32679]: pgmap v11363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20369.656939 secs 2024-04-26T23:57:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19672.626080 secs 2024-04-26T23:57:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:54 smithi092 ceph-mon[29156]: pgmap v11363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20369.656939 secs 2024-04-26T23:57:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19672.626080 secs 2024-04-26T23:57:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:56 smithi189 ceph-mon[32756]: pgmap v11364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:56 smithi156 ceph-mon[32679]: pgmap v11364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:56 smithi092 ceph-mon[29156]: pgmap v11364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:57:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:58 smithi189 ceph-mon[32756]: pgmap v11365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:58 smithi156 ceph-mon[32679]: pgmap v11365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:58 smithi092 ceph-mon[29156]: pgmap v11365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:57:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20374.657051 secs 2024-04-26T23:57:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:57:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19677.626141 secs 2024-04-26T23:57:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20374.657051 secs 2024-04-26T23:57:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:57:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19677.626141 secs 2024-04-26T23:57:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20374.657051 secs 2024-04-26T23:57:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:57:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19677.626141 secs 2024-04-26T23:58:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:00 smithi189 ceph-mon[32756]: pgmap v11366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:00 smithi156 ceph-mon[32679]: pgmap v11366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:00 smithi092 ceph-mon[29156]: pgmap v11366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:02 smithi189 ceph-mon[32756]: pgmap v11367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:02 smithi156 ceph-mon[32679]: pgmap v11367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:02 smithi092 ceph-mon[29156]: pgmap v11367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:04 smithi189 ceph-mon[32756]: pgmap v11368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20379.657138 secs 2024-04-26T23:58:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19682.626257 secs 2024-04-26T23:58:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:04 smithi156 ceph-mon[32679]: pgmap v11368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20379.657138 secs 2024-04-26T23:58:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19682.626257 secs 2024-04-26T23:58:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:04 smithi092 ceph-mon[29156]: pgmap v11368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20379.657138 secs 2024-04-26T23:58:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19682.626257 secs 2024-04-26T23:58:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:06 smithi189 ceph-mon[32756]: pgmap v11369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:06 smithi156 ceph-mon[32679]: pgmap v11369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:06 smithi092 ceph-mon[29156]: pgmap v11369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:08 smithi189 ceph-mon[32756]: pgmap v11370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:08 smithi156 ceph-mon[32679]: pgmap v11370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:08 smithi092 ceph-mon[29156]: pgmap v11370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20384.657258 secs 2024-04-26T23:58:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19687.626335 secs 2024-04-26T23:58:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20384.657258 secs 2024-04-26T23:58:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19687.626335 secs 2024-04-26T23:58:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20384.657258 secs 2024-04-26T23:58:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19687.626335 secs 2024-04-26T23:58:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:10 smithi189 ceph-mon[32756]: pgmap v11371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:10 smithi156 ceph-mon[32679]: pgmap v11371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:10 smithi092 ceph-mon[29156]: pgmap v11371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:12 smithi189 ceph-mon[32756]: pgmap v11372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:12 smithi156 ceph-mon[32679]: pgmap v11372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:12 smithi092 ceph-mon[29156]: pgmap v11372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:14 smithi189 ceph-mon[32756]: pgmap v11373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20389.657370 secs 2024-04-26T23:58:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19692.626416 secs 2024-04-26T23:58:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:14 smithi156 ceph-mon[32679]: pgmap v11373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20389.657370 secs 2024-04-26T23:58:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19692.626416 secs 2024-04-26T23:58:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:14 smithi092 ceph-mon[29156]: pgmap v11373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-26T23:58:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20389.657370 secs 2024-04-26T23:58:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19692.626416 secs 2024-04-26T23:58:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:16 smithi189 ceph-mon[32756]: pgmap v11374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:16 smithi156 ceph-mon[32679]: pgmap v11374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:16 smithi092 ceph-mon[29156]: pgmap v11374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-26T23:58:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:18 smithi189 ceph-mon[32756]: pgmap v11375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:18.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:18 smithi156 ceph-mon[32679]: pgmap v11375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:18 smithi092 ceph-mon[29156]: pgmap v11375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20394.657438 secs 2024-04-26T23:58:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19697.626479 secs 2024-04-26T23:58:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20394.657438 secs 2024-04-26T23:58:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19697.626479 secs 2024-04-26T23:58:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20394.657438 secs 2024-04-26T23:58:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19697.626479 secs 2024-04-26T23:58:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:20 smithi189 ceph-mon[32756]: pgmap v11376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:20 smithi156 ceph-mon[32679]: pgmap v11376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:20.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:20 smithi092 ceph-mon[29156]: pgmap v11376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:22 smithi189 ceph-mon[32756]: pgmap v11377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:22 smithi156 ceph-mon[32679]: pgmap v11377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:22 smithi092 ceph-mon[29156]: pgmap v11377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:24 smithi189 ceph-mon[32756]: pgmap v11378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20399.657574 secs 2024-04-26T23:58:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19702.626597 secs 2024-04-26T23:58:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:24 smithi156 ceph-mon[32679]: pgmap v11378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20399.657574 secs 2024-04-26T23:58:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19702.626597 secs 2024-04-26T23:58:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:24 smithi092 ceph-mon[29156]: pgmap v11378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-26T23:58:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20399.657574 secs 2024-04-26T23:58:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19702.626597 secs 2024-04-26T23:58:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:26 smithi189 ceph-mon[32756]: pgmap v11379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:26 smithi156 ceph-mon[32679]: pgmap v11379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:26 smithi092 ceph-mon[29156]: pgmap v11379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-26T23:58:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:58:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:58:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: pgmap v11380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: pgmap v11381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: pgmap v11382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:58:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: pgmap v11380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: pgmap v11381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: pgmap v11382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:58:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: pgmap v11380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: pgmap v11381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: pgmap v11382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:58:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:58:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20404.657695 secs 2024-04-26T23:58:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19707.626733 secs 2024-04-26T23:58:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20404.657695 secs 2024-04-26T23:58:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19707.626733 secs 2024-04-26T23:58:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20404.657695 secs 2024-04-26T23:58:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19707.626733 secs 2024-04-26T23:58:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:30 smithi189 ceph-mon[32756]: pgmap v11383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:30 smithi156 ceph-mon[32679]: pgmap v11383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:30 smithi092 ceph-mon[29156]: pgmap v11383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:31 smithi189 ceph-mon[32756]: pgmap v11384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:31 smithi156 ceph-mon[32679]: pgmap v11384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:31 smithi092 ceph-mon[29156]: pgmap v11384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:33 smithi189 ceph-mon[32756]: pgmap v11385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:33 smithi156 ceph-mon[32679]: pgmap v11385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:33 smithi092 ceph-mon[29156]: pgmap v11385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20409.657820 secs 2024-04-26T23:58:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19712.626867 secs 2024-04-26T23:58:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20409.657820 secs 2024-04-26T23:58:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19712.626867 secs 2024-04-26T23:58:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20409.657820 secs 2024-04-26T23:58:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19712.626867 secs 2024-04-26T23:58:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:35 smithi189 ceph-mon[32756]: pgmap v11386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:35 smithi156 ceph-mon[32679]: pgmap v11386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:35 smithi092 ceph-mon[29156]: pgmap v11386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:58:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:37 smithi189 ceph-mon[32756]: pgmap v11387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:58:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:37 smithi156 ceph-mon[32679]: pgmap v11387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:58:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:37 smithi092 ceph-mon[29156]: pgmap v11387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-26T23:58:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20414.657932 secs 2024-04-26T23:58:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19717.626949 secs 2024-04-26T23:58:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20414.657932 secs 2024-04-26T23:58:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19717.626949 secs 2024-04-26T23:58:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20414.657932 secs 2024-04-26T23:58:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19717.626949 secs 2024-04-26T23:58:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:40 smithi189 ceph-mon[32756]: pgmap v11388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:40 smithi156 ceph-mon[32679]: pgmap v11388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:40 smithi092 ceph-mon[29156]: pgmap v11388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:41 smithi189 ceph-mon[32756]: pgmap v11389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:42.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:41 smithi156 ceph-mon[32679]: pgmap v11389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:41 smithi092 ceph-mon[29156]: pgmap v11389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:43 smithi189 ceph-mon[32756]: pgmap v11390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:43 smithi156 ceph-mon[32679]: pgmap v11390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:43 smithi092 ceph-mon[29156]: pgmap v11390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20419.658027 secs 2024-04-26T23:58:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19722.627090 secs 2024-04-26T23:58:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20419.658027 secs 2024-04-26T23:58:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19722.627090 secs 2024-04-26T23:58:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20419.658027 secs 2024-04-26T23:58:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19722.627090 secs 2024-04-26T23:58:46.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:45 smithi156 ceph-mon[32679]: pgmap v11391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:45 smithi189 ceph-mon[32756]: pgmap v11391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:46.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:45 smithi092 ceph-mon[29156]: pgmap v11391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:47 smithi189 ceph-mon[32756]: pgmap v11392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:47 smithi156 ceph-mon[32679]: pgmap v11392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:47 smithi092 ceph-mon[29156]: pgmap v11392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20424.658141 secs 2024-04-26T23:58:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19727.627198 secs 2024-04-26T23:58:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20424.658141 secs 2024-04-26T23:58:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19727.627198 secs 2024-04-26T23:58:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20424.658141 secs 2024-04-26T23:58:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19727.627198 secs 2024-04-26T23:58:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:50 smithi189 ceph-mon[32756]: pgmap v11393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:50 smithi156 ceph-mon[32679]: pgmap v11393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:50 smithi092 ceph-mon[29156]: pgmap v11393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:51 smithi189 ceph-mon[32756]: pgmap v11394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:51 smithi156 ceph-mon[32679]: pgmap v11394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:51 smithi092 ceph-mon[29156]: pgmap v11394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:53 smithi189 ceph-mon[32756]: pgmap v11395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:53 smithi156 ceph-mon[32679]: pgmap v11395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:53 smithi092 ceph-mon[29156]: pgmap v11395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:58:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20429.658221 secs 2024-04-26T23:58:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19732.627328 secs 2024-04-26T23:58:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20429.658221 secs 2024-04-26T23:58:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19732.627328 secs 2024-04-26T23:58:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20429.658221 secs 2024-04-26T23:58:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19732.627328 secs 2024-04-26T23:58:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:55 smithi189 ceph-mon[32756]: pgmap v11396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:55 smithi156 ceph-mon[32679]: pgmap v11396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:55 smithi092 ceph-mon[29156]: pgmap v11396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:57 smithi189 ceph-mon[32756]: pgmap v11397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:57 smithi156 ceph-mon[32679]: pgmap v11397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:57 smithi092 ceph-mon[29156]: pgmap v11397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:58:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20434.658294 secs 2024-04-26T23:58:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:58:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19737.627451 secs 2024-04-26T23:58:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20434.658294 secs 2024-04-26T23:58:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:58:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19737.627451 secs 2024-04-26T23:58:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20434.658294 secs 2024-04-26T23:58:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:58:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19737.627451 secs 2024-04-26T23:59:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:00 smithi189 ceph-mon[32756]: pgmap v11398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:00 smithi156 ceph-mon[32679]: pgmap v11398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:00 smithi092 ceph-mon[29156]: pgmap v11398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:01 smithi189 ceph-mon[32756]: pgmap v11399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:01 smithi156 ceph-mon[32679]: pgmap v11399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:01 smithi092 ceph-mon[29156]: pgmap v11399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:03 smithi189 ceph-mon[32756]: pgmap v11400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:03 smithi156 ceph-mon[32679]: pgmap v11400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:03 smithi092 ceph-mon[29156]: pgmap v11400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20439.658372 secs 2024-04-26T23:59:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19742.627586 secs 2024-04-26T23:59:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20439.658372 secs 2024-04-26T23:59:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19742.627586 secs 2024-04-26T23:59:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20439.658372 secs 2024-04-26T23:59:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19742.627586 secs 2024-04-26T23:59:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:05 smithi189 ceph-mon[32756]: pgmap v11401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:05 smithi156 ceph-mon[32679]: pgmap v11401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:05 smithi092 ceph-mon[29156]: pgmap v11401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:07 smithi189 ceph-mon[32756]: pgmap v11402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:07 smithi156 ceph-mon[32679]: pgmap v11402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:07 smithi092 ceph-mon[29156]: pgmap v11402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20444.658490 secs 2024-04-26T23:59:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 19747.627688 secs 2024-04-26T23:59:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:09 smithi189 ceph-mon[32756]: slow request 722.768202 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:59:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20444.658490 secs 2024-04-26T23:59:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 19747.627688 secs 2024-04-26T23:59:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:09 smithi156 ceph-mon[32679]: slow request 722.768202 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:59:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20444.658490 secs 2024-04-26T23:59:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 19747.627688 secs 2024-04-26T23:59:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:09 smithi092 ceph-mon[29156]: slow request 722.768202 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-26T23:59:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:10 smithi189 ceph-mon[32756]: pgmap v11403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:10 smithi156 ceph-mon[32679]: pgmap v11403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:10 smithi092 ceph-mon[29156]: pgmap v11403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:11 smithi189 ceph-mon[32756]: pgmap v11404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:11 smithi156 ceph-mon[32679]: pgmap v11404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:11 smithi092 ceph-mon[29156]: pgmap v11404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:13 smithi189 ceph-mon[32756]: pgmap v11405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:13 smithi156 ceph-mon[32679]: pgmap v11405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:13 smithi092 ceph-mon[29156]: pgmap v11405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20449.658610 secs 2024-04-26T23:59:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19752.627758 secs 2024-04-26T23:59:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20449.658610 secs 2024-04-26T23:59:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19752.627758 secs 2024-04-26T23:59:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20449.658610 secs 2024-04-26T23:59:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19752.627758 secs 2024-04-26T23:59:16.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:15 smithi156 ceph-mon[32679]: pgmap v11406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:15 smithi189 ceph-mon[32756]: pgmap v11406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:16.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:15 smithi092 ceph-mon[29156]: pgmap v11406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:17 smithi189 ceph-mon[32756]: pgmap v11407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:17 smithi156 ceph-mon[32679]: pgmap v11407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:17 smithi092 ceph-mon[29156]: pgmap v11407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20454.658747 secs 2024-04-26T23:59:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19757.627895 secs 2024-04-26T23:59:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20454.658747 secs 2024-04-26T23:59:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19757.627895 secs 2024-04-26T23:59:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20454.658747 secs 2024-04-26T23:59:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19757.627895 secs 2024-04-26T23:59:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:20 smithi189 ceph-mon[32756]: pgmap v11408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:20 smithi156 ceph-mon[32679]: pgmap v11408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:20 smithi092 ceph-mon[29156]: pgmap v11408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:21 smithi189 ceph-mon[32756]: pgmap v11409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:21 smithi156 ceph-mon[32679]: pgmap v11409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:21 smithi092 ceph-mon[29156]: pgmap v11409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:23 smithi189 ceph-mon[32756]: pgmap v11410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:23 smithi156 ceph-mon[32679]: pgmap v11410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:23 smithi092 ceph-mon[29156]: pgmap v11410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20459.658844 secs 2024-04-26T23:59:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19762.628026 secs 2024-04-26T23:59:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20459.658844 secs 2024-04-26T23:59:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19762.628026 secs 2024-04-26T23:59:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20459.658844 secs 2024-04-26T23:59:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19762.628026 secs 2024-04-26T23:59:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:25 smithi189 ceph-mon[32756]: pgmap v11411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:25 smithi156 ceph-mon[32679]: pgmap v11411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:25 smithi092 ceph-mon[29156]: pgmap v11411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:27 smithi189 ceph-mon[32756]: pgmap v11412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:27 smithi156 ceph-mon[32679]: pgmap v11412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:27 smithi092 ceph-mon[29156]: pgmap v11412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: pgmap v11413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: pgmap v11414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:59:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:59:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:59:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:59:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: pgmap v11413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:59:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: pgmap v11414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: pgmap v11413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: pgmap v11414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-26T23:59:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20464.658909 secs 2024-04-26T23:59:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19767.628167 secs 2024-04-26T23:59:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20464.658909 secs 2024-04-26T23:59:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19767.628167 secs 2024-04-26T23:59:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20464.658909 secs 2024-04-26T23:59:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19767.628167 secs 2024-04-26T23:59:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:30 smithi189 ceph-mon[32756]: pgmap v11415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:30 smithi156 ceph-mon[32679]: pgmap v11415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:30 smithi092 ceph-mon[29156]: pgmap v11415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:33 smithi189 ceph-mon[32756]: pgmap v11416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:33.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:33 smithi156 ceph-mon[32679]: pgmap v11416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:33.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:33 smithi092 ceph-mon[29156]: pgmap v11416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-26T23:59:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20469.658975 secs 2024-04-26T23:59:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19772.628225 secs 2024-04-26T23:59:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20469.658975 secs 2024-04-26T23:59:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19772.628225 secs 2024-04-26T23:59:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20469.658975 secs 2024-04-26T23:59:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19772.628225 secs 2024-04-26T23:59:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:35 smithi189 ceph-mon[32756]: pgmap v11417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:35 smithi156 ceph-mon[32679]: pgmap v11417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:35.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:35 smithi092 ceph-mon[29156]: pgmap v11417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:37 smithi189 ceph-mon[32756]: pgmap v11418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:37.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:37 smithi156 ceph-mon[32679]: pgmap v11418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:37 smithi092 ceph-mon[29156]: pgmap v11418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-26T23:59:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:39 smithi189 ceph-mon[32756]: pgmap v11419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T23:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20474.659088 secs 2024-04-26T23:59:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19777.628375 secs 2024-04-26T23:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:39 smithi156 ceph-mon[32679]: pgmap v11419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T23:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20474.659088 secs 2024-04-26T23:59:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19777.628375 secs 2024-04-26T23:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:39 smithi092 ceph-mon[29156]: pgmap v11419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-26T23:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20474.659088 secs 2024-04-26T23:59:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19777.628375 secs 2024-04-26T23:59:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:41 smithi189 ceph-mon[32756]: pgmap v11420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:41 smithi156 ceph-mon[32679]: pgmap v11420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:41 smithi092 ceph-mon[29156]: pgmap v11420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:43 smithi189 ceph-mon[32756]: pgmap v11421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:43 smithi156 ceph-mon[32679]: pgmap v11421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:43 smithi092 ceph-mon[29156]: pgmap v11421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20479.659175 secs 2024-04-26T23:59:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19782.628479 secs 2024-04-26T23:59:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20479.659175 secs 2024-04-26T23:59:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19782.628479 secs 2024-04-26T23:59:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20479.659175 secs 2024-04-26T23:59:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19782.628479 secs 2024-04-26T23:59:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:45 smithi189 ceph-mon[32756]: pgmap v11422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:45 smithi156 ceph-mon[32679]: pgmap v11422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:45 smithi092 ceph-mon[29156]: pgmap v11422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:47 smithi189 ceph-mon[32756]: pgmap v11423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:47 smithi156 ceph-mon[32679]: pgmap v11423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:47 smithi092 ceph-mon[29156]: pgmap v11423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:49 smithi189 ceph-mon[32756]: pgmap v11424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20484.659312 secs 2024-04-26T23:59:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19787.628598 secs 2024-04-26T23:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:49 smithi156 ceph-mon[32679]: pgmap v11424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20484.659312 secs 2024-04-26T23:59:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19787.628598 secs 2024-04-26T23:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:49 smithi092 ceph-mon[29156]: pgmap v11424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20484.659312 secs 2024-04-26T23:59:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19787.628598 secs 2024-04-26T23:59:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:51 smithi189 ceph-mon[32756]: pgmap v11425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:51 smithi156 ceph-mon[32679]: pgmap v11425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:51 smithi092 ceph-mon[29156]: pgmap v11425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:53.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:53 smithi189 ceph-mon[32756]: pgmap v11426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:53 smithi156 ceph-mon[32679]: pgmap v11426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:53 smithi092 ceph-mon[29156]: pgmap v11426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20489.659450 secs 2024-04-26T23:59:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19792.628735 secs 2024-04-26T23:59:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20489.659450 secs 2024-04-26T23:59:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19792.628735 secs 2024-04-26T23:59:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20489.659450 secs 2024-04-26T23:59:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19792.628735 secs 2024-04-26T23:59:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:55 smithi189 ceph-mon[32756]: pgmap v11427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:55 smithi156 ceph-mon[32679]: pgmap v11427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:55 smithi092 ceph-mon[29156]: pgmap v11427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-26T23:59:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:57 smithi189 ceph-mon[32756]: pgmap v11428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:57 smithi156 ceph-mon[32679]: pgmap v11428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:57 smithi092 ceph-mon[29156]: pgmap v11428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:59 smithi189 ceph-mon[32756]: pgmap v11429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20494.659551 secs 2024-04-26T23:59:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 26 23:59:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19797.628859 secs 2024-04-26T23:59:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:59 smithi156 ceph-mon[32679]: pgmap v11429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20494.659551 secs 2024-04-26T23:59:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 26 23:59:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19797.628859 secs 2024-04-26T23:59:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:59 smithi092 ceph-mon[29156]: pgmap v11429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-26T23:59:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20494.659551 secs 2024-04-26T23:59:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 26 23:59:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19797.628859 secs 2024-04-27T00:00:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:00:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:00:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:00:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:01 smithi156 ceph-mon[32679]: pgmap v11430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:01 smithi092 ceph-mon[29156]: pgmap v11430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:01 smithi189 ceph-mon[32756]: pgmap v11430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:03 smithi156 ceph-mon[32679]: pgmap v11431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:03 smithi092 ceph-mon[29156]: pgmap v11431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:03 smithi189 ceph-mon[32756]: pgmap v11431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20499.659688 secs 2024-04-27T00:00:04.952 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19802.628974 secs 2024-04-27T00:00:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20499.659688 secs 2024-04-27T00:00:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19802.628974 secs 2024-04-27T00:00:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20499.659688 secs 2024-04-27T00:00:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19802.628974 secs 2024-04-27T00:00:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:05 smithi156 ceph-mon[32679]: pgmap v11432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:05 smithi092 ceph-mon[29156]: pgmap v11432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:05 smithi189 ceph-mon[32756]: pgmap v11432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:06 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:00:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:06 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:00:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:06 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:00:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:06 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:00:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:06 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:00:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:06 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:00:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:07 smithi156 ceph-mon[32679]: pgmap v11433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:07 smithi092 ceph-mon[29156]: pgmap v11433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:07 smithi189 ceph-mon[32756]: pgmap v11433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:09 smithi156 ceph-mon[32679]: pgmap v11434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20504.659811 secs 2024-04-27T00:00:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19807.629101 secs 2024-04-27T00:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:09 smithi092 ceph-mon[29156]: pgmap v11434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20504.659811 secs 2024-04-27T00:00:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19807.629101 secs 2024-04-27T00:00:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:09 smithi189 ceph-mon[32756]: pgmap v11434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20504.659811 secs 2024-04-27T00:00:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19807.629101 secs 2024-04-27T00:00:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:11 smithi156 ceph-mon[32679]: pgmap v11435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:11 smithi092 ceph-mon[29156]: pgmap v11435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:11 smithi189 ceph-mon[32756]: pgmap v11435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:13 smithi156 ceph-mon[32679]: pgmap v11436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:13 smithi092 ceph-mon[29156]: pgmap v11436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:13 smithi189 ceph-mon[32756]: pgmap v11436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20509.659876 secs 2024-04-27T00:00:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19812.629217 secs 2024-04-27T00:00:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:15 smithi189 ceph-mon[32756]: pgmap v11437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20509.659876 secs 2024-04-27T00:00:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19812.629217 secs 2024-04-27T00:00:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:15 smithi156 ceph-mon[32679]: pgmap v11437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20509.659876 secs 2024-04-27T00:00:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19812.629217 secs 2024-04-27T00:00:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:15 smithi092 ceph-mon[29156]: pgmap v11437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:17 smithi189 ceph-mon[32756]: pgmap v11438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:17 smithi156 ceph-mon[32679]: pgmap v11438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:17 smithi092 ceph-mon[29156]: pgmap v11438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:19 smithi189 ceph-mon[32756]: pgmap v11439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20514.660000 secs 2024-04-27T00:00:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19817.629363 secs 2024-04-27T00:00:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:19 smithi156 ceph-mon[32679]: pgmap v11439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20514.660000 secs 2024-04-27T00:00:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19817.629363 secs 2024-04-27T00:00:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:19 smithi092 ceph-mon[29156]: pgmap v11439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20514.660000 secs 2024-04-27T00:00:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19817.629363 secs 2024-04-27T00:00:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:21 smithi189 ceph-mon[32756]: pgmap v11440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:21 smithi156 ceph-mon[32679]: pgmap v11440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:21 smithi092 ceph-mon[29156]: pgmap v11440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:23 smithi189 ceph-mon[32756]: pgmap v11441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:23.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:23 smithi156 ceph-mon[32679]: pgmap v11441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:23 smithi092 ceph-mon[29156]: pgmap v11441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20519.660143 secs 2024-04-27T00:00:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19822.629438 secs 2024-04-27T00:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20519.660143 secs 2024-04-27T00:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19822.629438 secs 2024-04-27T00:00:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20519.660143 secs 2024-04-27T00:00:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19822.629438 secs 2024-04-27T00:00:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:25 smithi189 ceph-mon[32756]: pgmap v11442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:25.917 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:25 smithi092 ceph-mon[29156]: pgmap v11442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:25 smithi156 ceph-mon[32679]: pgmap v11442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:27 smithi189 ceph-mon[32756]: pgmap v11443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:27 smithi156 ceph-mon[32679]: pgmap v11443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:27 smithi092 ceph-mon[29156]: pgmap v11443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: pgmap v11444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20524.660217 secs 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19827.629503 secs 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:00:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: pgmap v11444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20524.660217 secs 2024-04-27T00:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:00:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19827.629503 secs 2024-04-27T00:00:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:00:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:00:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:00:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: pgmap v11444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20524.660217 secs 2024-04-27T00:00:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:00:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19827.629503 secs 2024-04-27T00:00:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:00:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:00:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:00:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:30 smithi189 ceph-mon[32756]: pgmap v11445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:00:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:30 smithi189 ceph-mon[32756]: pgmap v11446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:30 smithi156 ceph-mon[32679]: pgmap v11445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:00:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:30 smithi156 ceph-mon[32679]: pgmap v11446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:30 smithi092 ceph-mon[29156]: pgmap v11445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:00:30.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:30 smithi092 ceph-mon[29156]: pgmap v11446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:32 smithi189 ceph-mon[32756]: pgmap v11447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:32.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:32 smithi156 ceph-mon[32679]: pgmap v11447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:32 smithi092 ceph-mon[29156]: pgmap v11447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:34 smithi189 ceph-mon[32756]: pgmap v11448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:00:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20529.660334 secs 2024-04-27T00:00:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19832.629581 secs 2024-04-27T00:00:34.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:34 smithi156 ceph-mon[32679]: pgmap v11448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:00:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20529.660334 secs 2024-04-27T00:00:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19832.629581 secs 2024-04-27T00:00:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:34 smithi092 ceph-mon[29156]: pgmap v11448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:00:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20529.660334 secs 2024-04-27T00:00:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19832.629581 secs 2024-04-27T00:00:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:36 smithi189 ceph-mon[32756]: pgmap v11449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:36.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:36 smithi156 ceph-mon[32679]: pgmap v11449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:36 smithi092 ceph-mon[29156]: pgmap v11449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:00:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:00:38.797+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:00:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:00:38.797+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:00:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:00:38.797+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:00:38.798 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:00:38.797+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 160 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:00:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:38 smithi189 ceph-mon[32756]: pgmap v11450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:00:38.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:38 smithi156 ceph-mon[32679]: pgmap v11450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:00:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:38 smithi092 ceph-mon[29156]: pgmap v11450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:00:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20534.660478 secs 2024-04-27T00:00:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19837.629725 secs 2024-04-27T00:00:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20534.660478 secs 2024-04-27T00:00:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19837.629725 secs 2024-04-27T00:00:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20534.660478 secs 2024-04-27T00:00:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19837.629725 secs 2024-04-27T00:00:40.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:40 smithi156 ceph-mon[32679]: pgmap v11451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:00:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:40 smithi092 ceph-mon[29156]: pgmap v11451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:00:41.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:40 smithi189 ceph-mon[32756]: pgmap v11451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:00:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:42 smithi156 ceph-mon[32679]: pgmap v11452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:42 smithi092 ceph-mon[29156]: pgmap v11452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:42 smithi189 ceph-mon[32756]: pgmap v11452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:44 smithi156 ceph-mon[32679]: pgmap v11453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20539.660571 secs 2024-04-27T00:00:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19842.629803 secs 2024-04-27T00:00:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:44 smithi092 ceph-mon[29156]: pgmap v11453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20539.660571 secs 2024-04-27T00:00:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19842.629803 secs 2024-04-27T00:00:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:44 smithi189 ceph-mon[32756]: pgmap v11453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20539.660571 secs 2024-04-27T00:00:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19842.629803 secs 2024-04-27T00:00:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:46 smithi156 ceph-mon[32679]: pgmap v11454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:46 smithi092 ceph-mon[29156]: pgmap v11454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:46 smithi189 ceph-mon[32756]: pgmap v11454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:48 smithi156 ceph-mon[32679]: pgmap v11455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:48 smithi092 ceph-mon[29156]: pgmap v11455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:48 smithi189 ceph-mon[32756]: pgmap v11455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20544.660697 secs 2024-04-27T00:00:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19847.629921 secs 2024-04-27T00:00:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20544.660697 secs 2024-04-27T00:00:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19847.629921 secs 2024-04-27T00:00:50.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20544.660697 secs 2024-04-27T00:00:50.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19847.629921 secs 2024-04-27T00:00:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:50 smithi156 ceph-mon[32679]: pgmap v11456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:50 smithi092 ceph-mon[29156]: pgmap v11456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:51.057 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:50 smithi189 ceph-mon[32756]: pgmap v11456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:52 smithi156 ceph-mon[32679]: pgmap v11457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:52.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:52 smithi092 ceph-mon[29156]: pgmap v11457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:52 smithi189 ceph-mon[32756]: pgmap v11457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:54 smithi156 ceph-mon[32679]: pgmap v11458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20549.660844 secs 2024-04-27T00:00:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19852.630041 secs 2024-04-27T00:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:54 smithi092 ceph-mon[29156]: pgmap v11458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20549.660844 secs 2024-04-27T00:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19852.630041 secs 2024-04-27T00:00:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:54 smithi189 ceph-mon[32756]: pgmap v11458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20549.660844 secs 2024-04-27T00:00:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19852.630041 secs 2024-04-27T00:00:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:56 smithi156 ceph-mon[32679]: pgmap v11459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:56.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:56 smithi092 ceph-mon[29156]: pgmap v11459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:56 smithi189 ceph-mon[32756]: pgmap v11459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:00:58.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:58 smithi156 ceph-mon[32679]: pgmap v11460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:58.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:58 smithi092 ceph-mon[29156]: pgmap v11460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:58 smithi189 ceph-mon[32756]: pgmap v11460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20554.660945 secs 2024-04-27T00:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:00:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19857.630106 secs 2024-04-27T00:01:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20554.660945 secs 2024-04-27T00:01:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:00:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19857.630106 secs 2024-04-27T00:01:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20554.660945 secs 2024-04-27T00:01:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:00:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19857.630106 secs 2024-04-27T00:01:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:00 smithi092 ceph-mon[29156]: pgmap v11461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:00 smithi189 ceph-mon[32756]: pgmap v11461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:00 smithi156 ceph-mon[32679]: pgmap v11461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:02 smithi092 ceph-mon[29156]: pgmap v11462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:02 smithi189 ceph-mon[32756]: pgmap v11462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:02 smithi156 ceph-mon[32679]: pgmap v11462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:04 smithi092 ceph-mon[29156]: pgmap v11463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:04 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20559.661066 secs 2024-04-27T00:01:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19862.630212 secs 2024-04-27T00:01:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:04 smithi189 ceph-mon[32756]: pgmap v11463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:04 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20559.661066 secs 2024-04-27T00:01:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19862.630212 secs 2024-04-27T00:01:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:04 smithi156 ceph-mon[32679]: pgmap v11463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:04 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20559.661066 secs 2024-04-27T00:01:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19862.630212 secs 2024-04-27T00:01:06.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:06 smithi092 ceph-mon[29156]: pgmap v11464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:06 smithi189 ceph-mon[32756]: pgmap v11464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:06 smithi156 ceph-mon[32679]: pgmap v11464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:08.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:08 smithi092 ceph-mon[29156]: pgmap v11465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:08 smithi189 ceph-mon[32756]: pgmap v11465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:08 smithi156 ceph-mon[32679]: pgmap v11465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:09 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20564.661186 secs 2024-04-27T00:01:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19867.630332 secs 2024-04-27T00:01:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:09 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20564.661186 secs 2024-04-27T00:01:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19867.630332 secs 2024-04-27T00:01:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:09 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20564.661186 secs 2024-04-27T00:01:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19867.630332 secs 2024-04-27T00:01:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:10 smithi092 ceph-mon[29156]: pgmap v11466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:10 smithi189 ceph-mon[32756]: pgmap v11466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:10 smithi156 ceph-mon[32679]: pgmap v11466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:12.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:12 smithi092 ceph-mon[29156]: pgmap v11467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:12 smithi189 ceph-mon[32756]: pgmap v11467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:12 smithi156 ceph-mon[32679]: pgmap v11467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:14 smithi092 ceph-mon[29156]: pgmap v11468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:14 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20569.661310 secs 2024-04-27T00:01:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19872.630418 secs 2024-04-27T00:01:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:14 smithi189 ceph-mon[32756]: pgmap v11468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:14 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20569.661310 secs 2024-04-27T00:01:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19872.630418 secs 2024-04-27T00:01:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:14 smithi156 ceph-mon[32679]: pgmap v11468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:14 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20569.661310 secs 2024-04-27T00:01:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19872.630418 secs 2024-04-27T00:01:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:16 smithi092 ceph-mon[29156]: pgmap v11469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:16 smithi189 ceph-mon[32756]: pgmap v11469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:16 smithi156 ceph-mon[32679]: pgmap v11469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:18.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:18 smithi156 ceph-mon[32679]: pgmap v11470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:18.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:18 smithi092 ceph-mon[29156]: pgmap v11470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:18 smithi189 ceph-mon[32756]: pgmap v11470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:19 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20574.661427 secs 2024-04-27T00:01:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19877.630537 secs 2024-04-27T00:01:20.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:19 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20574.661427 secs 2024-04-27T00:01:20.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19877.630537 secs 2024-04-27T00:01:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:19 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20574.661427 secs 2024-04-27T00:01:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19877.630537 secs 2024-04-27T00:01:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:20 smithi092 ceph-mon[29156]: pgmap v11471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:20 smithi189 ceph-mon[32756]: pgmap v11471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:20 smithi156 ceph-mon[32679]: pgmap v11471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:22 smithi092 ceph-mon[29156]: pgmap v11472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:22 smithi189 ceph-mon[32756]: pgmap v11472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:22 smithi156 ceph-mon[32679]: pgmap v11472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:24 smithi189 ceph-mon[32756]: pgmap v11473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:24 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20579.661578 secs 2024-04-27T00:01:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19882.630653 secs 2024-04-27T00:01:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:24 smithi156 ceph-mon[32679]: pgmap v11473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:24 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20579.661578 secs 2024-04-27T00:01:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19882.630653 secs 2024-04-27T00:01:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:24 smithi092 ceph-mon[29156]: pgmap v11473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:24 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20579.661578 secs 2024-04-27T00:01:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19882.630653 secs 2024-04-27T00:01:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:26 smithi189 ceph-mon[32756]: pgmap v11474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:27.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:26 smithi156 ceph-mon[32679]: pgmap v11474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:27.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:26 smithi092 ceph-mon[29156]: pgmap v11474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:28 smithi189 ceph-mon[32756]: pgmap v11475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:28 smithi156 ceph-mon[32679]: pgmap v11475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:28 smithi092 ceph-mon[29156]: pgmap v11475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:29 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20584.661698 secs 2024-04-27T00:01:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19887.630775 secs 2024-04-27T00:01:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:29 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20584.661698 secs 2024-04-27T00:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19887.630775 secs 2024-04-27T00:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:29 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20584.661698 secs 2024-04-27T00:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19887.630775 secs 2024-04-27T00:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:01:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:30 smithi189 ceph-mon[32756]: pgmap v11476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:01:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:01:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:01:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:30 smithi156 ceph-mon[32679]: pgmap v11476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:01:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:01:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:01:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:30 smithi092 ceph-mon[29156]: pgmap v11476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:31.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:01:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:01:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:01:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:31 smithi189 ceph-mon[32756]: pgmap v11477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:01:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:31 smithi189 ceph-mon[32756]: pgmap v11478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:31 smithi156 ceph-mon[32679]: pgmap v11477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:01:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:31 smithi156 ceph-mon[32679]: pgmap v11478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:31 smithi092 ceph-mon[29156]: pgmap v11477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:01:32.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:31 smithi092 ceph-mon[29156]: pgmap v11478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:33 smithi189 ceph-mon[32756]: pgmap v11479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:33 smithi156 ceph-mon[32679]: pgmap v11479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:33 smithi092 ceph-mon[29156]: pgmap v11479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:34 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20589.661821 secs 2024-04-27T00:01:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19892.630890 secs 2024-04-27T00:01:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:34 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20589.661821 secs 2024-04-27T00:01:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19892.630890 secs 2024-04-27T00:01:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:34 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20589.661821 secs 2024-04-27T00:01:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19892.630890 secs 2024-04-27T00:01:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:35 smithi189 ceph-mon[32756]: pgmap v11480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:35 smithi156 ceph-mon[32679]: pgmap v11480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:35 smithi092 ceph-mon[29156]: pgmap v11480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:37 smithi189 ceph-mon[32756]: pgmap v11481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:37 smithi156 ceph-mon[32679]: pgmap v11481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:37 smithi092 ceph-mon[29156]: pgmap v11481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:01:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:39 smithi189 ceph-mon[32756]: pgmap v11482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:01:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20594.661944 secs 2024-04-27T00:01:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19897.630955 secs 2024-04-27T00:01:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:39 smithi156 ceph-mon[32679]: pgmap v11482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:01:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20594.661944 secs 2024-04-27T00:01:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19897.630955 secs 2024-04-27T00:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:39 smithi092 ceph-mon[29156]: pgmap v11482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20594.661944 secs 2024-04-27T00:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19897.630955 secs 2024-04-27T00:01:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:41 smithi189 ceph-mon[32756]: pgmap v11483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:01:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:41 smithi156 ceph-mon[32679]: pgmap v11483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:01:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:41 smithi092 ceph-mon[29156]: pgmap v11483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:01:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:43 smithi092 ceph-mon[29156]: pgmap v11484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:43 smithi189 ceph-mon[32756]: pgmap v11484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:43 smithi156 ceph-mon[32679]: pgmap v11484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20599.662063 secs 2024-04-27T00:01:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19902.631045 secs 2024-04-27T00:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20599.662063 secs 2024-04-27T00:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19902.631045 secs 2024-04-27T00:01:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20599.662063 secs 2024-04-27T00:01:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19902.631045 secs 2024-04-27T00:01:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:45 smithi189 ceph-mon[32756]: pgmap v11485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:45 smithi156 ceph-mon[32679]: pgmap v11485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:45 smithi092 ceph-mon[29156]: pgmap v11485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:46 smithi189 ceph-mon[32756]: pgmap v11486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:46 smithi156 ceph-mon[32679]: pgmap v11486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:46 smithi092 ceph-mon[29156]: pgmap v11486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:49 smithi092 ceph-mon[29156]: pgmap v11487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:49 smithi189 ceph-mon[32756]: pgmap v11487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:49 smithi156 ceph-mon[32679]: pgmap v11487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20604.662185 secs 2024-04-27T00:01:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:50 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19907.631184 secs 2024-04-27T00:01:50.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20604.662185 secs 2024-04-27T00:01:50.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:50 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19907.631184 secs 2024-04-27T00:01:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20604.662185 secs 2024-04-27T00:01:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:50 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19907.631184 secs 2024-04-27T00:01:51.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:51 smithi092 ceph-mon[29156]: pgmap v11488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:51 smithi189 ceph-mon[32756]: pgmap v11488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:51 smithi156 ceph-mon[32679]: pgmap v11488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:53 smithi092 ceph-mon[29156]: pgmap v11489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:53 smithi189 ceph-mon[32756]: pgmap v11489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:53 smithi156 ceph-mon[32679]: pgmap v11489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20609.662252 secs 2024-04-27T00:01:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:55 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19912.631327 secs 2024-04-27T00:01:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:55 smithi092 ceph-mon[29156]: pgmap v11490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20609.662252 secs 2024-04-27T00:01:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:55 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19912.631327 secs 2024-04-27T00:01:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:55 smithi189 ceph-mon[32756]: pgmap v11490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20609.662252 secs 2024-04-27T00:01:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:55 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19912.631327 secs 2024-04-27T00:01:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:55 smithi156 ceph-mon[32679]: pgmap v11490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:01:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:57 smithi092 ceph-mon[29156]: pgmap v11491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:57 smithi189 ceph-mon[32756]: pgmap v11491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:57 smithi156 ceph-mon[32679]: pgmap v11491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:01:59 smithi092 ceph-mon[29156]: pgmap v11492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:01:59 smithi189 ceph-mon[32756]: pgmap v11492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:01:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:01:59 smithi156 ceph-mon[32679]: pgmap v11492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20614.662384 secs 2024-04-27T00:02:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:00 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19917.631349 secs 2024-04-27T00:02:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20614.662384 secs 2024-04-27T00:02:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:00 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19917.631349 secs 2024-04-27T00:02:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20614.662384 secs 2024-04-27T00:02:00.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:00 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19917.631349 secs 2024-04-27T00:02:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:01 smithi189 ceph-mon[32756]: pgmap v11493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:01 smithi156 ceph-mon[32679]: pgmap v11493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:01 smithi092 ceph-mon[29156]: pgmap v11493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:03 smithi189 ceph-mon[32756]: pgmap v11494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:03 smithi156 ceph-mon[32679]: pgmap v11494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:03 smithi092 ceph-mon[29156]: pgmap v11494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20619.662526 secs 2024-04-27T00:02:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:05 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19922.631459 secs 2024-04-27T00:02:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:05 smithi189 ceph-mon[32756]: pgmap v11495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20619.662526 secs 2024-04-27T00:02:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:05 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19922.631459 secs 2024-04-27T00:02:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:05 smithi156 ceph-mon[32679]: pgmap v11495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20619.662526 secs 2024-04-27T00:02:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:05 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19922.631459 secs 2024-04-27T00:02:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:05 smithi092 ceph-mon[29156]: pgmap v11495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:07 smithi189 ceph-mon[32756]: pgmap v11496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:07 smithi156 ceph-mon[32679]: pgmap v11496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:07 smithi092 ceph-mon[29156]: pgmap v11496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:09 smithi189 ceph-mon[32756]: pgmap v11497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:09 smithi156 ceph-mon[32679]: pgmap v11497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:09 smithi092 ceph-mon[29156]: pgmap v11497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20624.662649 secs 2024-04-27T00:02:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19927.631539 secs 2024-04-27T00:02:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20624.662649 secs 2024-04-27T00:02:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19927.631539 secs 2024-04-27T00:02:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20624.662649 secs 2024-04-27T00:02:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19927.631539 secs 2024-04-27T00:02:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:11 smithi189 ceph-mon[32756]: pgmap v11498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:11 smithi156 ceph-mon[32679]: pgmap v11498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:11.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:11 smithi092 ceph-mon[29156]: pgmap v11498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:13 smithi189 ceph-mon[32756]: pgmap v11499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:13 smithi156 ceph-mon[32679]: pgmap v11499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:13 smithi092 ceph-mon[29156]: pgmap v11499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20629.662768 secs 2024-04-27T00:02:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19932.631599 secs 2024-04-27T00:02:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:15 smithi189 ceph-mon[32756]: pgmap v11500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20629.662768 secs 2024-04-27T00:02:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19932.631599 secs 2024-04-27T00:02:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:15 smithi156 ceph-mon[32679]: pgmap v11500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20629.662768 secs 2024-04-27T00:02:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19932.631599 secs 2024-04-27T00:02:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:15 smithi092 ceph-mon[29156]: pgmap v11500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:17 smithi189 ceph-mon[32756]: pgmap v11501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:17 smithi156 ceph-mon[32679]: pgmap v11501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:17 smithi092 ceph-mon[29156]: pgmap v11501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:19 smithi189 ceph-mon[32756]: pgmap v11502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:19 smithi156 ceph-mon[32679]: pgmap v11502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:19 smithi092 ceph-mon[29156]: pgmap v11502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20634.662904 secs 2024-04-27T00:02:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:20 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19937.631665 secs 2024-04-27T00:02:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20634.662904 secs 2024-04-27T00:02:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:20 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19937.631665 secs 2024-04-27T00:02:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20634.662904 secs 2024-04-27T00:02:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:20 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19937.631665 secs 2024-04-27T00:02:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:21 smithi189 ceph-mon[32756]: pgmap v11503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:21 smithi156 ceph-mon[32679]: pgmap v11503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:21 smithi092 ceph-mon[29156]: pgmap v11503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:23 smithi189 ceph-mon[32756]: pgmap v11504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:23 smithi156 ceph-mon[32679]: pgmap v11504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:23 smithi092 ceph-mon[29156]: pgmap v11504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20639.663042 secs 2024-04-27T00:02:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:25 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19942.631811 secs 2024-04-27T00:02:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:25 smithi189 ceph-mon[32756]: pgmap v11505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20639.663042 secs 2024-04-27T00:02:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:25 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19942.631811 secs 2024-04-27T00:02:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:25 smithi156 ceph-mon[32679]: pgmap v11505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20639.663042 secs 2024-04-27T00:02:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:25 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19942.631811 secs 2024-04-27T00:02:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:25 smithi092 ceph-mon[29156]: pgmap v11505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:27 smithi189 ceph-mon[32756]: pgmap v11506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:27 smithi156 ceph-mon[32679]: pgmap v11506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:27 smithi092 ceph-mon[29156]: pgmap v11506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:29 smithi189 ceph-mon[32756]: pgmap v11507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:29 smithi156 ceph-mon[32679]: pgmap v11507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:29 smithi092 ceph-mon[29156]: pgmap v11507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20644.663166 secs 2024-04-27T00:02:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:30 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19947.631919 secs 2024-04-27T00:02:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:02:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20644.663166 secs 2024-04-27T00:02:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:30 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19947.631919 secs 2024-04-27T00:02:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:02:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20644.663166 secs 2024-04-27T00:02:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:30 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19947.631919 secs 2024-04-27T00:02:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:02:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:31 smithi189 ceph-mon[32756]: pgmap v11508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:31.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:31 smithi092 ceph-mon[29156]: pgmap v11508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:31 smithi156 ceph-mon[32679]: pgmap v11508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:33.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:33 smithi156 ceph-mon[32679]: pgmap v11509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:33 smithi092 ceph-mon[29156]: pgmap v11509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:33 smithi189 ceph-mon[32756]: pgmap v11509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:34.601 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19952.632002 secs 2024-04-27T00:02:34.608 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19952.632002 secs 2024-04-27T00:02:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19952.632002 secs 2024-04-27T00:02:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20649.663231 secs 2024-04-27T00:02:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: pgmap v11510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: pgmap v11511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: pgmap v11512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20649.663231 secs 2024-04-27T00:02:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: pgmap v11510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: pgmap v11511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: pgmap v11512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20649.663231 secs 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: pgmap v11510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: pgmap v11511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: pgmap v11512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:02:37.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:37 smithi092 ceph-mon[29156]: pgmap v11513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:37 smithi189 ceph-mon[32756]: pgmap v11513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:37 smithi156 ceph-mon[32679]: pgmap v11513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:39 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20654.663359 secs 2024-04-27T00:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:39 smithi092 ceph-mon[29156]: pgmap v11514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19957.632088 secs 2024-04-27T00:02:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:39 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20654.663359 secs 2024-04-27T00:02:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:39 smithi189 ceph-mon[32756]: pgmap v11514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19957.632088 secs 2024-04-27T00:02:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:39 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20654.663359 secs 2024-04-27T00:02:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:39 smithi156 ceph-mon[32679]: pgmap v11514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19957.632088 secs 2024-04-27T00:02:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:41 smithi092 ceph-mon[29156]: pgmap v11515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:41 smithi189 ceph-mon[32756]: pgmap v11515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:41 smithi156 ceph-mon[32679]: pgmap v11515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 481 B/s wr, 5 op/s 2024-04-27T00:02:43.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:43 smithi092 ceph-mon[29156]: pgmap v11516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 481 B/s wr, 3 op/s 2024-04-27T00:02:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:43 smithi189 ceph-mon[32756]: pgmap v11516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 481 B/s wr, 3 op/s 2024-04-27T00:02:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:43 smithi156 ceph-mon[32679]: pgmap v11516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 481 B/s wr, 3 op/s 2024-04-27T00:02:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:44 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20659.663497 secs 2024-04-27T00:02:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19962.632206 secs 2024-04-27T00:02:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:44 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20659.663497 secs 2024-04-27T00:02:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19962.632206 secs 2024-04-27T00:02:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:44 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20659.663497 secs 2024-04-27T00:02:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19962.632206 secs 2024-04-27T00:02:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:45 smithi092 ceph-mon[29156]: pgmap v11517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T00:02:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:45 smithi189 ceph-mon[32756]: pgmap v11517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T00:02:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:45 smithi156 ceph-mon[32679]: pgmap v11517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T00:02:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:47 smithi092 ceph-mon[29156]: pgmap v11518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:47 smithi189 ceph-mon[32756]: pgmap v11518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:47 smithi156 ceph-mon[32679]: pgmap v11518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:02:49.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:49 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20664.663640 secs 2024-04-27T00:02:49.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:49 smithi156 ceph-mon[32679]: pgmap v11519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:02:49.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19967.632275 secs 2024-04-27T00:02:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:49 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20664.663640 secs 2024-04-27T00:02:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:49 smithi092 ceph-mon[29156]: pgmap v11519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:02:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19967.632275 secs 2024-04-27T00:02:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:49 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20664.663640 secs 2024-04-27T00:02:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:49 smithi189 ceph-mon[32756]: pgmap v11519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:02:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19967.632275 secs 2024-04-27T00:02:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:51 smithi092 ceph-mon[29156]: pgmap v11520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:51 smithi189 ceph-mon[32756]: pgmap v11520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:51 smithi156 ceph-mon[32679]: pgmap v11520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:53 smithi092 ceph-mon[29156]: pgmap v11521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:53 smithi189 ceph-mon[32756]: pgmap v11521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:53 smithi156 ceph-mon[32679]: pgmap v11521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:54 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20669.663769 secs 2024-04-27T00:02:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19972.632392 secs 2024-04-27T00:02:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:54 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20669.663769 secs 2024-04-27T00:02:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19972.632392 secs 2024-04-27T00:02:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:54 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20669.663769 secs 2024-04-27T00:02:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19972.632392 secs 2024-04-27T00:02:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:55 smithi189 ceph-mon[32756]: pgmap v11522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:55 smithi156 ceph-mon[32679]: pgmap v11522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:56.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:55 smithi092 ceph-mon[29156]: pgmap v11522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:02:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:57 smithi189 ceph-mon[32756]: pgmap v11523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:57 smithi156 ceph-mon[32679]: pgmap v11523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:02:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:57 smithi092 ceph-mon[29156]: pgmap v11523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:59 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 20674.663892 secs 2024-04-27T00:03:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:59 smithi189 ceph-mon[32756]: pgmap v11524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:02:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19977.632514 secs 2024-04-27T00:03:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:59 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 20674.663892 secs 2024-04-27T00:03:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:59 smithi156 ceph-mon[32679]: pgmap v11524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:02:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19977.632514 secs 2024-04-27T00:03:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:59 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 20674.663892 secs 2024-04-27T00:03:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:59 smithi092 ceph-mon[29156]: pgmap v11524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:02:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19977.632514 secs 2024-04-27T00:03:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:01 smithi092 ceph-mon[29156]: pgmap v11525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:01 smithi189 ceph-mon[32756]: pgmap v11525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:01 smithi156 ceph-mon[32679]: pgmap v11525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:03 smithi189 ceph-mon[32756]: pgmap v11526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:03 smithi156 ceph-mon[32679]: pgmap v11526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:03 smithi092 ceph-mon[29156]: pgmap v11526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:04 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 20679.663969 secs 2024-04-27T00:03:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:04 smithi189 ceph-mon[32756]: slow request 182.686046 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:03:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19982.632617 secs 2024-04-27T00:03:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:04 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 20679.663969 secs 2024-04-27T00:03:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:04 smithi156 ceph-mon[32679]: slow request 182.686046 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:03:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19982.632617 secs 2024-04-27T00:03:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:04 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 20679.663969 secs 2024-04-27T00:03:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:04 smithi092 ceph-mon[29156]: slow request 182.686046 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:03:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19982.632617 secs 2024-04-27T00:03:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:05 smithi189 ceph-mon[32756]: pgmap v11527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:05 smithi156 ceph-mon[32679]: pgmap v11527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:06.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:05 smithi092 ceph-mon[29156]: pgmap v11527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:06.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:03:06.223+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:03:06.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:03:06.223+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:03:06.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:03:06.223+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:03:06.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:03:06.223+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:03:06.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:03:06.223+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:03:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:06 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:06 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:06 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:06 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:06 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:07 smithi189 ceph-mon[32756]: pgmap v11528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:07 smithi156 ceph-mon[32679]: pgmap v11528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:07 smithi092 ceph-mon[29156]: pgmap v11528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20684.664047 secs 2024-04-27T00:03:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:09 smithi189 ceph-mon[32756]: pgmap v11529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19987.632690 secs 2024-04-27T00:03:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20684.664047 secs 2024-04-27T00:03:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:09 smithi156 ceph-mon[32679]: pgmap v11529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19987.632690 secs 2024-04-27T00:03:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20684.664047 secs 2024-04-27T00:03:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:09 smithi092 ceph-mon[29156]: pgmap v11529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19987.632690 secs 2024-04-27T00:03:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:10 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:10 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:03:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:10 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:03:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:11 smithi189 ceph-mon[32756]: pgmap v11530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:11 smithi156 ceph-mon[32679]: pgmap v11530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:11 smithi092 ceph-mon[29156]: pgmap v11530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:13 smithi189 ceph-mon[32756]: pgmap v11531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:13 smithi156 ceph-mon[32679]: pgmap v11531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:13 smithi092 ceph-mon[29156]: pgmap v11531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20689.664119 secs 2024-04-27T00:03:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19992.632801 secs 2024-04-27T00:03:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20689.664119 secs 2024-04-27T00:03:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19992.632801 secs 2024-04-27T00:03:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20689.664119 secs 2024-04-27T00:03:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19992.632801 secs 2024-04-27T00:03:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:15 smithi189 ceph-mon[32756]: pgmap v11532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:15 smithi156 ceph-mon[32679]: pgmap v11532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:15 smithi092 ceph-mon[29156]: pgmap v11532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:16 smithi189 ceph-mon[32756]: pgmap v11533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:17.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:16 smithi092 ceph-mon[29156]: pgmap v11533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:16 smithi156 ceph-mon[32679]: pgmap v11533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:03:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20694.664251 secs 2024-04-27T00:03:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:19 smithi092 ceph-mon[29156]: pgmap v11534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 19997.632922 secs 2024-04-27T00:03:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20694.664251 secs 2024-04-27T00:03:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:19 smithi189 ceph-mon[32756]: pgmap v11534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 19997.632922 secs 2024-04-27T00:03:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20694.664251 secs 2024-04-27T00:03:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:19 smithi156 ceph-mon[32679]: pgmap v11534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:03:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 19997.632922 secs 2024-04-27T00:03:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:21 smithi092 ceph-mon[29156]: pgmap v11535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:21 smithi189 ceph-mon[32756]: pgmap v11535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:21 smithi156 ceph-mon[32679]: pgmap v11535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:23 smithi092 ceph-mon[29156]: pgmap v11536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:23 smithi189 ceph-mon[32756]: pgmap v11536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:24.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:23 smithi156 ceph-mon[32679]: pgmap v11536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20699.664387 secs 2024-04-27T00:03:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20002.633039 secs 2024-04-27T00:03:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20699.664387 secs 2024-04-27T00:03:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20002.633039 secs 2024-04-27T00:03:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20699.664387 secs 2024-04-27T00:03:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20002.633039 secs 2024-04-27T00:03:25.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:25 smithi092 ceph-mon[29156]: pgmap v11537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:25 smithi189 ceph-mon[32756]: pgmap v11537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:25 smithi156 ceph-mon[32679]: pgmap v11537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:27 smithi092 ceph-mon[29156]: pgmap v11538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:27 smithi189 ceph-mon[32756]: pgmap v11538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:27 smithi156 ceph-mon[32679]: pgmap v11538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20704.664526 secs 2024-04-27T00:03:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:29 smithi189 ceph-mon[32756]: pgmap v11539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20007.633193 secs 2024-04-27T00:03:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20704.664526 secs 2024-04-27T00:03:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:29 smithi156 ceph-mon[32679]: pgmap v11539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20007.633193 secs 2024-04-27T00:03:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20704.664526 secs 2024-04-27T00:03:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:29 smithi092 ceph-mon[29156]: pgmap v11539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20007.633193 secs 2024-04-27T00:03:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:31 smithi189 ceph-mon[32756]: pgmap v11540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:32.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:31 smithi156 ceph-mon[32679]: pgmap v11540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:31 smithi092 ceph-mon[29156]: pgmap v11540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:33 smithi189 ceph-mon[32756]: pgmap v11541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:33 smithi156 ceph-mon[32679]: pgmap v11541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:33 smithi092 ceph-mon[29156]: pgmap v11541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:03:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20709.664626 secs 2024-04-27T00:03:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20012.633334 secs 2024-04-27T00:03:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20709.664626 secs 2024-04-27T00:03:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20012.633334 secs 2024-04-27T00:03:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20709.664626 secs 2024-04-27T00:03:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20012.633334 secs 2024-04-27T00:03:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca80d1000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1ca804b040 tx=0x7f1ca80d1000 comp rx=0 tx=0).stop 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca808a050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T00:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.054+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T00:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.054+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T00:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.054+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.054+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=21 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T00:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.054+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.055+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T00:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:36.055+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T00:03:36.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:35 smithi189 ceph-mon[32756]: pgmap v11542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:36.106 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:03:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:35 smithi156 ceph-mon[32679]: pgmap v11542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:36.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:03:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:35 smithi092 ceph-mon[29156]: pgmap v11542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:03:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:37 smithi189 ceph-mon[32756]: pgmap v11543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:37 smithi156 ceph-mon[32679]: pgmap v11543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:37 smithi092 ceph-mon[29156]: pgmap v11543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:38.822 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:38.822+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:03:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:38.822+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:03:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:38.822+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:03:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:03:38.822+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 161 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20714.664746 secs 2024-04-27T00:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: pgmap v11544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20017.633457 secs 2024-04-27T00:03:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:03:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:03:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20714.664746 secs 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: pgmap v11544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20017.633457 secs 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:03:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:03:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20714.664746 secs 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: pgmap v11544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20017.633457 secs 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:03:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:03:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:40 smithi189 ceph-mon[32756]: pgmap v11545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:03:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:40 smithi189 ceph-mon[32756]: pgmap v11546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:40 smithi156 ceph-mon[32679]: pgmap v11545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:03:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:40 smithi156 ceph-mon[32679]: pgmap v11546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:40 smithi092 ceph-mon[29156]: pgmap v11545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:03:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:40 smithi092 ceph-mon[29156]: pgmap v11546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:42 smithi189 ceph-mon[32756]: pgmap v11547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:42 smithi156 ceph-mon[32679]: pgmap v11547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:42 smithi092 ceph-mon[29156]: pgmap v11547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:44 smithi189 ceph-mon[32756]: pgmap v11548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20719.664881 secs 2024-04-27T00:03:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20022.633546 secs 2024-04-27T00:03:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:44 smithi156 ceph-mon[32679]: pgmap v11548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20719.664881 secs 2024-04-27T00:03:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20022.633546 secs 2024-04-27T00:03:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:44 smithi092 ceph-mon[29156]: pgmap v11548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20719.664881 secs 2024-04-27T00:03:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20022.633546 secs 2024-04-27T00:03:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:46 smithi189 ceph-mon[32756]: pgmap v11549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:46 smithi156 ceph-mon[32679]: pgmap v11549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:47.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:46 smithi092 ceph-mon[29156]: pgmap v11549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:03:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:48 smithi092 ceph-mon[29156]: pgmap v11550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:49.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:48 smithi189 ceph-mon[32756]: pgmap v11550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:48 smithi156 ceph-mon[32679]: pgmap v11550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:03:50.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20724.664946 secs 2024-04-27T00:03:50.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20027.633626 secs 2024-04-27T00:03:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20724.664946 secs 2024-04-27T00:03:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20027.633626 secs 2024-04-27T00:03:50.209 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20724.664946 secs 2024-04-27T00:03:50.209 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20027.633626 secs 2024-04-27T00:03:51.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:50 smithi189 ceph-mon[32756]: pgmap v11551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:03:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:50 smithi156 ceph-mon[32679]: pgmap v11551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:03:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:50 smithi092 ceph-mon[29156]: pgmap v11551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:03:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:52 smithi189 ceph-mon[32756]: pgmap v11552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:53.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:52 smithi156 ceph-mon[32679]: pgmap v11552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:53.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:52 smithi092 ceph-mon[29156]: pgmap v11552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:54 smithi189 ceph-mon[32756]: pgmap v11553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20729.665015 secs 2024-04-27T00:03:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20032.633742 secs 2024-04-27T00:03:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:54 smithi156 ceph-mon[32679]: pgmap v11553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20729.665015 secs 2024-04-27T00:03:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20032.633742 secs 2024-04-27T00:03:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:54 smithi092 ceph-mon[29156]: pgmap v11553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20729.665015 secs 2024-04-27T00:03:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20032.633742 secs 2024-04-27T00:03:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:56 smithi189 ceph-mon[32756]: pgmap v11554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:56 smithi156 ceph-mon[32679]: pgmap v11554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:56 smithi092 ceph-mon[29156]: pgmap v11554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:03:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:58 smithi189 ceph-mon[32756]: pgmap v11555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:58 smithi156 ceph-mon[32679]: pgmap v11555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:58 smithi092 ceph-mon[29156]: pgmap v11555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:03:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20734.665078 secs 2024-04-27T00:03:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:03:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20037.633830 secs 2024-04-27T00:04:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20734.665078 secs 2024-04-27T00:04:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:03:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20037.633830 secs 2024-04-27T00:04:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20734.665078 secs 2024-04-27T00:04:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:03:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20037.633830 secs 2024-04-27T00:04:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:00 smithi189 ceph-mon[32756]: pgmap v11556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:00 smithi156 ceph-mon[32679]: pgmap v11556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:01.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:00 smithi092 ceph-mon[29156]: pgmap v11556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:02 smithi189 ceph-mon[32756]: pgmap v11557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:02 smithi156 ceph-mon[32679]: pgmap v11557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:03.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:02 smithi092 ceph-mon[29156]: pgmap v11557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:03 smithi189 ceph-mon[32756]: pgmap v11558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:03 smithi156 ceph-mon[32679]: pgmap v11558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:03 smithi092 ceph-mon[29156]: pgmap v11558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20739.665157 secs 2024-04-27T00:04:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20042.633964 secs 2024-04-27T00:04:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20739.665157 secs 2024-04-27T00:04:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20042.633964 secs 2024-04-27T00:04:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20739.665157 secs 2024-04-27T00:04:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20042.633964 secs 2024-04-27T00:04:06.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:05 smithi189 ceph-mon[32756]: pgmap v11559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:05 smithi156 ceph-mon[32679]: pgmap v11559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:05 smithi092 ceph-mon[29156]: pgmap v11559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:08 smithi156 ceph-mon[32679]: pgmap v11560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:08 smithi092 ceph-mon[29156]: pgmap v11560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:08 smithi189 ceph-mon[32756]: pgmap v11560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:10 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20744.665253 secs 2024-04-27T00:04:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20047.634052 secs 2024-04-27T00:04:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:10 smithi156 ceph-mon[32679]: pgmap v11561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:10 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20744.665253 secs 2024-04-27T00:04:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20047.634052 secs 2024-04-27T00:04:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:10 smithi092 ceph-mon[29156]: pgmap v11561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:10 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20744.665253 secs 2024-04-27T00:04:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20047.634052 secs 2024-04-27T00:04:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:10 smithi189 ceph-mon[32756]: pgmap v11561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:12 smithi156 ceph-mon[32679]: pgmap v11562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:12 smithi092 ceph-mon[29156]: pgmap v11562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:12 smithi189 ceph-mon[32756]: pgmap v11562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:14 smithi156 ceph-mon[32679]: pgmap v11563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:14 smithi092 ceph-mon[29156]: pgmap v11563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:14 smithi189 ceph-mon[32756]: pgmap v11563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:15 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20749.665322 secs 2024-04-27T00:04:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20052.634168 secs 2024-04-27T00:04:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:15 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20749.665322 secs 2024-04-27T00:04:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20052.634168 secs 2024-04-27T00:04:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:15 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20749.665322 secs 2024-04-27T00:04:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20052.634168 secs 2024-04-27T00:04:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:16 smithi189 ceph-mon[32756]: pgmap v11564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:16 smithi156 ceph-mon[32679]: pgmap v11564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:16 smithi092 ceph-mon[29156]: pgmap v11564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:18 smithi189 ceph-mon[32756]: pgmap v11565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:18 smithi156 ceph-mon[32679]: pgmap v11565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:18 smithi092 ceph-mon[29156]: pgmap v11565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:20 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20754.665465 secs 2024-04-27T00:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:20 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20057.634289 secs 2024-04-27T00:04:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:20 smithi189 ceph-mon[32756]: pgmap v11566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:20 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20754.665465 secs 2024-04-27T00:04:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:20 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20057.634289 secs 2024-04-27T00:04:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:20 smithi156 ceph-mon[32679]: pgmap v11566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:20 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20754.665465 secs 2024-04-27T00:04:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:20 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20057.634289 secs 2024-04-27T00:04:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:20 smithi092 ceph-mon[29156]: pgmap v11566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:22 smithi189 ceph-mon[32756]: pgmap v11567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:22 smithi156 ceph-mon[32679]: pgmap v11567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:22 smithi092 ceph-mon[29156]: pgmap v11567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:24 smithi189 ceph-mon[32756]: pgmap v11568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:24 smithi156 ceph-mon[32679]: pgmap v11568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:24 smithi092 ceph-mon[29156]: pgmap v11568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:25 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20759.665579 secs 2024-04-27T00:04:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:25 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20062.634408 secs 2024-04-27T00:04:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:25 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20759.665579 secs 2024-04-27T00:04:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:25 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20062.634408 secs 2024-04-27T00:04:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:25 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20759.665579 secs 2024-04-27T00:04:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:25 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20062.634408 secs 2024-04-27T00:04:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:26 smithi189 ceph-mon[32756]: pgmap v11569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:26 smithi156 ceph-mon[32679]: pgmap v11569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:26 smithi092 ceph-mon[29156]: pgmap v11569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:28 smithi189 ceph-mon[32756]: pgmap v11570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:28.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:28 smithi156 ceph-mon[32679]: pgmap v11570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:28.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:28 smithi092 ceph-mon[29156]: pgmap v11570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:30 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20764.665676 secs 2024-04-27T00:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:30 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20067.634535 secs 2024-04-27T00:04:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:30 smithi189 ceph-mon[32756]: pgmap v11571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:30 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20764.665676 secs 2024-04-27T00:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:30 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20067.634535 secs 2024-04-27T00:04:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:30 smithi156 ceph-mon[32679]: pgmap v11571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:30 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20764.665676 secs 2024-04-27T00:04:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:30 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20067.634535 secs 2024-04-27T00:04:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:30 smithi092 ceph-mon[29156]: pgmap v11571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:32 smithi189 ceph-mon[32756]: pgmap v11572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:32.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:32 smithi156 ceph-mon[32679]: pgmap v11572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:32.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:32 smithi092 ceph-mon[29156]: pgmap v11572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:34 smithi189 ceph-mon[32756]: pgmap v11573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:34 smithi156 ceph-mon[32679]: pgmap v11573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:34 smithi092 ceph-mon[29156]: pgmap v11573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:35 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20769.665795 secs 2024-04-27T00:04:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:35 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20072.634630 secs 2024-04-27T00:04:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:35 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20769.665795 secs 2024-04-27T00:04:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:35 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20072.634630 secs 2024-04-27T00:04:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:35 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20769.665795 secs 2024-04-27T00:04:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:35 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20072.634630 secs 2024-04-27T00:04:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:36 smithi189 ceph-mon[32756]: pgmap v11574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:36 smithi156 ceph-mon[32679]: pgmap v11574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:36 smithi092 ceph-mon[29156]: pgmap v11574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:38 smithi189 ceph-mon[32756]: pgmap v11575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:38 smithi156 ceph-mon[32679]: pgmap v11575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:38.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:38 smithi092 ceph-mon[29156]: pgmap v11575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20077.634679 secs 2024-04-27T00:04:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:04:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20077.634679 secs 2024-04-27T00:04:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:04:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20077.634679 secs 2024-04-27T00:04:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:40 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20774.665911 secs 2024-04-27T00:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:40 smithi189 ceph-mon[32756]: pgmap v11576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:04:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:04:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:40 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20774.665911 secs 2024-04-27T00:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:40 smithi156 ceph-mon[32679]: pgmap v11576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:04:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:40 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20774.665911 secs 2024-04-27T00:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:40 smithi092 ceph-mon[29156]: pgmap v11576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:04:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:04:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:41 smithi189 ceph-mon[32756]: pgmap v11577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:04:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:41 smithi189 ceph-mon[32756]: pgmap v11578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:41 smithi156 ceph-mon[32679]: pgmap v11577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:04:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:41 smithi156 ceph-mon[32679]: pgmap v11578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:41 smithi092 ceph-mon[29156]: pgmap v11577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:04:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:41 smithi092 ceph-mon[29156]: pgmap v11578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:43 smithi189 ceph-mon[32756]: pgmap v11579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:43 smithi156 ceph-mon[32679]: pgmap v11579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:43 smithi092 ceph-mon[29156]: pgmap v11579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20779.666030 secs 2024-04-27T00:04:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20082.634771 secs 2024-04-27T00:04:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20779.666030 secs 2024-04-27T00:04:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20082.634771 secs 2024-04-27T00:04:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20779.666030 secs 2024-04-27T00:04:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20082.634771 secs 2024-04-27T00:04:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:45 smithi189 ceph-mon[32756]: pgmap v11580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:45 smithi156 ceph-mon[32679]: pgmap v11580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:45 smithi092 ceph-mon[29156]: pgmap v11580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:47 smithi189 ceph-mon[32756]: pgmap v11581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:47 smithi156 ceph-mon[32679]: pgmap v11581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:47 smithi092 ceph-mon[29156]: pgmap v11581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:04:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:49 smithi156 ceph-mon[32679]: pgmap v11582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:04:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20784.666128 secs 2024-04-27T00:04:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20087.634913 secs 2024-04-27T00:04:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:49 smithi092 ceph-mon[29156]: pgmap v11582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:04:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20784.666128 secs 2024-04-27T00:04:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20087.634913 secs 2024-04-27T00:04:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:49 smithi189 ceph-mon[32756]: pgmap v11582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:04:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20784.666128 secs 2024-04-27T00:04:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20087.634913 secs 2024-04-27T00:04:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:51 smithi156 ceph-mon[32679]: pgmap v11583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:04:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:51 smithi092 ceph-mon[29156]: pgmap v11583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:04:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:51 smithi189 ceph-mon[32756]: pgmap v11583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:04:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:53 smithi156 ceph-mon[32679]: pgmap v11584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:53.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:53 smithi189 ceph-mon[32756]: pgmap v11584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:53 smithi092 ceph-mon[29156]: pgmap v11584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20789.666253 secs 2024-04-27T00:04:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20092.635051 secs 2024-04-27T00:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20789.666253 secs 2024-04-27T00:04:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20092.635051 secs 2024-04-27T00:04:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20789.666253 secs 2024-04-27T00:04:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20092.635051 secs 2024-04-27T00:04:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:55 smithi156 ceph-mon[32679]: pgmap v11585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:55 smithi092 ceph-mon[29156]: pgmap v11585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:55 smithi189 ceph-mon[32756]: pgmap v11585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:04:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:57 smithi156 ceph-mon[32679]: pgmap v11586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:57 smithi092 ceph-mon[29156]: pgmap v11586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:57 smithi189 ceph-mon[32756]: pgmap v11586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:59 smithi156 ceph-mon[32679]: pgmap v11587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20794.666370 secs 2024-04-27T00:04:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:04:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20097.635205 secs 2024-04-27T00:04:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:59 smithi092 ceph-mon[29156]: pgmap v11587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20794.666370 secs 2024-04-27T00:04:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:04:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20097.635205 secs 2024-04-27T00:04:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:59 smithi189 ceph-mon[32756]: pgmap v11587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:04:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20794.666370 secs 2024-04-27T00:04:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:04:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20097.635205 secs 2024-04-27T00:05:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:01 smithi156 ceph-mon[32679]: pgmap v11588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:01 smithi092 ceph-mon[29156]: pgmap v11588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:01 smithi189 ceph-mon[32756]: pgmap v11588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:03 smithi156 ceph-mon[32679]: pgmap v11589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:03.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:03 smithi092 ceph-mon[29156]: pgmap v11589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:03 smithi189 ceph-mon[32756]: pgmap v11589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:04 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20799.666506 secs 2024-04-27T00:05:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20102.635378 secs 2024-04-27T00:05:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:04 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20799.666506 secs 2024-04-27T00:05:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20102.635378 secs 2024-04-27T00:05:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:04 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20799.666506 secs 2024-04-27T00:05:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20102.635378 secs 2024-04-27T00:05:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:05 smithi156 ceph-mon[32679]: pgmap v11590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:05 smithi092 ceph-mon[29156]: pgmap v11590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:05 smithi189 ceph-mon[32756]: pgmap v11590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:07 smithi156 ceph-mon[32679]: pgmap v11591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:07.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:07 smithi092 ceph-mon[29156]: pgmap v11591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:07 smithi189 ceph-mon[32756]: pgmap v11591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:05:08.833+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:05:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:05:08.833+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:05:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:05:08.833+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:05:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:05:08.833+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 162 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:05:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:09 smithi156 ceph-mon[32679]: pgmap v11592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:09 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20804.666619 secs 2024-04-27T00:05:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20107.635500 secs 2024-04-27T00:05:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:09 smithi092 ceph-mon[29156]: pgmap v11592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:09 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20804.666619 secs 2024-04-27T00:05:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20107.635500 secs 2024-04-27T00:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:09 smithi189 ceph-mon[32756]: pgmap v11592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:09 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20804.666619 secs 2024-04-27T00:05:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20107.635500 secs 2024-04-27T00:05:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:11 smithi092 ceph-mon[29156]: pgmap v11593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:11 smithi189 ceph-mon[32756]: pgmap v11593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:11 smithi156 ceph-mon[32679]: pgmap v11593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:13 smithi092 ceph-mon[29156]: pgmap v11594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:13 smithi189 ceph-mon[32756]: pgmap v11594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:13 smithi156 ceph-mon[32679]: pgmap v11594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:14 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20809.666721 secs 2024-04-27T00:05:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20112.635607 secs 2024-04-27T00:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:14 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20809.666721 secs 2024-04-27T00:05:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20112.635607 secs 2024-04-27T00:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:14 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20809.666721 secs 2024-04-27T00:05:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20112.635607 secs 2024-04-27T00:05:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:15 smithi092 ceph-mon[29156]: pgmap v11595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:15 smithi189 ceph-mon[32756]: pgmap v11595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:15 smithi156 ceph-mon[32679]: pgmap v11595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:17 smithi092 ceph-mon[29156]: pgmap v11596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:17 smithi189 ceph-mon[32756]: pgmap v11596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:17 smithi156 ceph-mon[32679]: pgmap v11596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:19 smithi092 ceph-mon[29156]: pgmap v11597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:19 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20814.666861 secs 2024-04-27T00:05:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20117.635730 secs 2024-04-27T00:05:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:19 smithi189 ceph-mon[32756]: pgmap v11597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:19 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20814.666861 secs 2024-04-27T00:05:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20117.635730 secs 2024-04-27T00:05:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:19 smithi156 ceph-mon[32679]: pgmap v11597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:19 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20814.666861 secs 2024-04-27T00:05:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20117.635730 secs 2024-04-27T00:05:21.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:21 smithi156 ceph-mon[32679]: pgmap v11598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:21 smithi092 ceph-mon[29156]: pgmap v11598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:21 smithi189 ceph-mon[32756]: pgmap v11598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:23 smithi092 ceph-mon[29156]: pgmap v11599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:23 smithi189 ceph-mon[32756]: pgmap v11599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:23 smithi156 ceph-mon[32679]: pgmap v11599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:24 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20819.666940 secs 2024-04-27T00:05:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20122.635828 secs 2024-04-27T00:05:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:24 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20819.666940 secs 2024-04-27T00:05:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20122.635828 secs 2024-04-27T00:05:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:24 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20819.666940 secs 2024-04-27T00:05:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20122.635828 secs 2024-04-27T00:05:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:25 smithi092 ceph-mon[29156]: pgmap v11600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:25 smithi189 ceph-mon[32756]: pgmap v11600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:25 smithi156 ceph-mon[32679]: pgmap v11600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:27 smithi092 ceph-mon[29156]: pgmap v11601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:27 smithi189 ceph-mon[32756]: pgmap v11601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:27 smithi156 ceph-mon[32679]: pgmap v11601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:29 smithi092 ceph-mon[29156]: pgmap v11602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:29 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20824.667021 secs 2024-04-27T00:05:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20127.635960 secs 2024-04-27T00:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:29 smithi189 ceph-mon[32756]: pgmap v11602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:29 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20824.667021 secs 2024-04-27T00:05:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20127.635960 secs 2024-04-27T00:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:29 smithi156 ceph-mon[32679]: pgmap v11602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:29 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20824.667021 secs 2024-04-27T00:05:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20127.635960 secs 2024-04-27T00:05:31.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:31 smithi092 ceph-mon[29156]: pgmap v11603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:31.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:31 smithi189 ceph-mon[32756]: pgmap v11603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:31.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:31 smithi156 ceph-mon[32679]: pgmap v11603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:33 smithi092 ceph-mon[29156]: pgmap v11604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:33.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:33 smithi189 ceph-mon[32756]: pgmap v11604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:33 smithi156 ceph-mon[32679]: pgmap v11604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:34 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20829.667136 secs 2024-04-27T00:05:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20132.636075 secs 2024-04-27T00:05:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:34 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20829.667136 secs 2024-04-27T00:05:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20132.636075 secs 2024-04-27T00:05:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:34 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20829.667136 secs 2024-04-27T00:05:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20132.636075 secs 2024-04-27T00:05:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:35 smithi092 ceph-mon[29156]: pgmap v11605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:35 smithi189 ceph-mon[32756]: pgmap v11605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:35.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:35 smithi156 ceph-mon[32679]: pgmap v11605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:37 smithi092 ceph-mon[29156]: pgmap v11606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:37.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:37 smithi189 ceph-mon[32756]: pgmap v11606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:37 smithi156 ceph-mon[32679]: pgmap v11606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:39 smithi092 ceph-mon[29156]: pgmap v11607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:39 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20834.667254 secs 2024-04-27T00:05:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20137.636216 secs 2024-04-27T00:05:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:39 smithi189 ceph-mon[32756]: pgmap v11607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:39 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20834.667254 secs 2024-04-27T00:05:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20137.636216 secs 2024-04-27T00:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:39 smithi156 ceph-mon[32679]: pgmap v11607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:39 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20834.667254 secs 2024-04-27T00:05:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20137.636216 secs 2024-04-27T00:05:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:05:40.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:05:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:05:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: pgmap v11608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:05:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:05:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: pgmap v11609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:05:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: pgmap v11610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: pgmap v11608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: pgmap v11609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: pgmap v11610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: pgmap v11608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: pgmap v11609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: pgmap v11610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:41.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:05:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:42 smithi189 ceph-mon[32756]: pgmap v11611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:05:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:42 smithi156 ceph-mon[32679]: pgmap v11611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:05:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:42 smithi092 ceph-mon[29156]: pgmap v11611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:05:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:44 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20839.667321 secs 2024-04-27T00:05:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20142.636365 secs 2024-04-27T00:05:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:44 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20839.667321 secs 2024-04-27T00:05:44.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20142.636365 secs 2024-04-27T00:05:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:44 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20839.667321 secs 2024-04-27T00:05:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20142.636365 secs 2024-04-27T00:05:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:45 smithi156 ceph-mon[32679]: pgmap v11612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:45 smithi092 ceph-mon[29156]: pgmap v11612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:45 smithi189 ceph-mon[32756]: pgmap v11612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:46 smithi189 ceph-mon[32756]: pgmap v11613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:46 smithi156 ceph-mon[32679]: pgmap v11613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:46 smithi092 ceph-mon[29156]: pgmap v11613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:48 smithi189 ceph-mon[32756]: pgmap v11614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:48 smithi156 ceph-mon[32679]: pgmap v11614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:48 smithi092 ceph-mon[29156]: pgmap v11614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:05:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:49 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20844.667413 secs 2024-04-27T00:05:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20147.636496 secs 2024-04-27T00:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:49 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20844.667413 secs 2024-04-27T00:05:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20147.636496 secs 2024-04-27T00:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:49 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20844.667413 secs 2024-04-27T00:05:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20147.636496 secs 2024-04-27T00:05:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:50 smithi156 ceph-mon[32679]: pgmap v11615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:05:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:50 smithi092 ceph-mon[29156]: pgmap v11615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:05:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:50 smithi189 ceph-mon[32756]: pgmap v11615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:05:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:52 smithi189 ceph-mon[32756]: pgmap v11616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:52 smithi156 ceph-mon[32679]: pgmap v11616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:52 smithi092 ceph-mon[29156]: pgmap v11616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:54 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20849.667492 secs 2024-04-27T00:05:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20152.636603 secs 2024-04-27T00:05:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:54 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20849.667492 secs 2024-04-27T00:05:54.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20152.636603 secs 2024-04-27T00:05:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:54 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20849.667492 secs 2024-04-27T00:05:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20152.636603 secs 2024-04-27T00:05:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:55 smithi156 ceph-mon[32679]: pgmap v11617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:55 smithi092 ceph-mon[29156]: pgmap v11617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:55 smithi189 ceph-mon[32756]: pgmap v11617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:56 smithi189 ceph-mon[32756]: pgmap v11618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:56 smithi156 ceph-mon[32679]: pgmap v11618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:56 smithi092 ceph-mon[29156]: pgmap v11618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:05:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:58 smithi189 ceph-mon[32756]: pgmap v11619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:58 smithi156 ceph-mon[32679]: pgmap v11619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:05:59.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:58 smithi092 ceph-mon[29156]: pgmap v11619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:59 smithi189 ceph-mon[32756]: 5 slow requests, 0 included below; oldest blocked for > 20854.667610 secs 2024-04-27T00:06:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:05:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20157.636671 secs 2024-04-27T00:06:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:59 smithi156 ceph-mon[32679]: 5 slow requests, 0 included below; oldest blocked for > 20854.667610 secs 2024-04-27T00:06:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:05:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20157.636671 secs 2024-04-27T00:06:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:59 smithi092 ceph-mon[29156]: 5 slow requests, 0 included below; oldest blocked for > 20854.667610 secs 2024-04-27T00:06:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:05:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20157.636671 secs 2024-04-27T00:06:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:00 smithi189 ceph-mon[32756]: pgmap v11620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:00 smithi156 ceph-mon[32679]: pgmap v11620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:00 smithi092 ceph-mon[29156]: pgmap v11620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:02 smithi189 ceph-mon[32756]: pgmap v11621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:02 smithi156 ceph-mon[32679]: pgmap v11621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:02 smithi092 ceph-mon[29156]: pgmap v11621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:04 smithi156 ceph-mon[32679]: 5 slow requests, 1 included below; oldest blocked for > 20859.667751 secs 2024-04-27T00:06:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:04 smithi156 ceph-mon[32679]: slow request 362.689828 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:06:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20162.636745 secs 2024-04-27T00:06:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:04 smithi092 ceph-mon[29156]: 5 slow requests, 1 included below; oldest blocked for > 20859.667751 secs 2024-04-27T00:06:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:04 smithi092 ceph-mon[29156]: slow request 362.689828 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:06:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20162.636745 secs 2024-04-27T00:06:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:04 smithi189 ceph-mon[32756]: 5 slow requests, 1 included below; oldest blocked for > 20859.667751 secs 2024-04-27T00:06:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:04 smithi189 ceph-mon[32756]: slow request 362.689828 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:06:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20162.636745 secs 2024-04-27T00:06:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:05 smithi156 ceph-mon[32679]: pgmap v11622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:05 smithi092 ceph-mon[29156]: pgmap v11622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:05 smithi189 ceph-mon[32756]: pgmap v11622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:06 smithi189 ceph-mon[32756]: pgmap v11623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:06 smithi156 ceph-mon[32679]: pgmap v11623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:06 smithi092 ceph-mon[29156]: pgmap v11623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:08 smithi189 ceph-mon[32756]: pgmap v11624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:08 smithi156 ceph-mon[32679]: pgmap v11624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:08 smithi092 ceph-mon[29156]: pgmap v11624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:09 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 20864.667868 secs 2024-04-27T00:06:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:09 smithi156 ceph-mon[32679]: slow request 182.354578 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:06:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20167.636887 secs 2024-04-27T00:06:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:09 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 20864.667868 secs 2024-04-27T00:06:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:09 smithi092 ceph-mon[29156]: slow request 182.354578 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:06:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20167.636887 secs 2024-04-27T00:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:09 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 20864.667868 secs 2024-04-27T00:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:09 smithi189 ceph-mon[32756]: slow request 182.354578 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:06:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20167.636887 secs 2024-04-27T00:06:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:10 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:06:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:10 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:06:11.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:10 smithi156 ceph-mon[32679]: pgmap v11625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:10 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:06:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:10 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:06:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:10 smithi092 ceph-mon[29156]: pgmap v11625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:10 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:06:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:10 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:06:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:10 smithi189 ceph-mon[32756]: pgmap v11625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:12 smithi189 ceph-mon[32756]: pgmap v11626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:12 smithi156 ceph-mon[32679]: pgmap v11626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:12 smithi092 ceph-mon[29156]: pgmap v11626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20869.667947 secs 2024-04-27T00:06:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20172.637001 secs 2024-04-27T00:06:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20869.667947 secs 2024-04-27T00:06:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20172.637001 secs 2024-04-27T00:06:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20869.667947 secs 2024-04-27T00:06:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20172.637001 secs 2024-04-27T00:06:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:15 smithi156 ceph-mon[32679]: pgmap v11627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:15 smithi092 ceph-mon[29156]: pgmap v11627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:15 smithi189 ceph-mon[32756]: pgmap v11627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:16 smithi189 ceph-mon[32756]: pgmap v11628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:16 smithi156 ceph-mon[32679]: pgmap v11628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:16 smithi092 ceph-mon[29156]: pgmap v11628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:18 smithi189 ceph-mon[32756]: pgmap v11629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:18 smithi156 ceph-mon[32679]: pgmap v11629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:18 smithi092 ceph-mon[29156]: pgmap v11629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20874.668100 secs 2024-04-27T00:06:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20177.637122 secs 2024-04-27T00:06:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20874.668100 secs 2024-04-27T00:06:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20177.637122 secs 2024-04-27T00:06:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20874.668100 secs 2024-04-27T00:06:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20177.637122 secs 2024-04-27T00:06:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:20 smithi156 ceph-mon[32679]: pgmap v11630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:20 smithi092 ceph-mon[29156]: pgmap v11630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:20 smithi189 ceph-mon[32756]: pgmap v11630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:22 smithi189 ceph-mon[32756]: pgmap v11631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:22 smithi156 ceph-mon[32679]: pgmap v11631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:22 smithi092 ceph-mon[29156]: pgmap v11631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20879.668178 secs 2024-04-27T00:06:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20182.637239 secs 2024-04-27T00:06:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20879.668178 secs 2024-04-27T00:06:24.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20182.637239 secs 2024-04-27T00:06:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20879.668178 secs 2024-04-27T00:06:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20182.637239 secs 2024-04-27T00:06:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:25 smithi156 ceph-mon[32679]: pgmap v11632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:25 smithi092 ceph-mon[29156]: pgmap v11632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:25 smithi189 ceph-mon[32756]: pgmap v11632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:26 smithi189 ceph-mon[32756]: pgmap v11633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:26 smithi156 ceph-mon[32679]: pgmap v11633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:26 smithi092 ceph-mon[29156]: pgmap v11633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:28 smithi189 ceph-mon[32756]: pgmap v11634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:29.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:28 smithi156 ceph-mon[32679]: pgmap v11634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:28 smithi092 ceph-mon[29156]: pgmap v11634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20884.668295 secs 2024-04-27T00:06:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20187.637366 secs 2024-04-27T00:06:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20884.668295 secs 2024-04-27T00:06:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20187.637366 secs 2024-04-27T00:06:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20884.668295 secs 2024-04-27T00:06:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20187.637366 secs 2024-04-27T00:06:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:30 smithi156 ceph-mon[32679]: pgmap v11635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:30 smithi092 ceph-mon[29156]: pgmap v11635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:30 smithi189 ceph-mon[32756]: pgmap v11635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:32 smithi189 ceph-mon[32756]: pgmap v11636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:32 smithi156 ceph-mon[32679]: pgmap v11636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:32 smithi092 ceph-mon[29156]: pgmap v11636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20889.668409 secs 2024-04-27T00:06:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20192.637479 secs 2024-04-27T00:06:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20889.668409 secs 2024-04-27T00:06:34.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20192.637479 secs 2024-04-27T00:06:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20889.668409 secs 2024-04-27T00:06:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20192.637479 secs 2024-04-27T00:06:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:35 smithi156 ceph-mon[32679]: pgmap v11637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:35 smithi092 ceph-mon[29156]: pgmap v11637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:35 smithi189 ceph-mon[32756]: pgmap v11637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:36 smithi189 ceph-mon[32756]: pgmap v11638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:37.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:36 smithi156 ceph-mon[32679]: pgmap v11638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:36 smithi092 ceph-mon[29156]: pgmap v11638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:06:38.845+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:06:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:06:38.845+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:06:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:06:38.846+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:06:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:06:38.846+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 163 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:06:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:38 smithi189 ceph-mon[32756]: pgmap v11639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:38 smithi156 ceph-mon[32679]: pgmap v11639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:38 smithi092 ceph-mon[29156]: pgmap v11639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20894.668504 secs 2024-04-27T00:06:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20197.637623 secs 2024-04-27T00:06:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20894.668504 secs 2024-04-27T00:06:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20197.637623 secs 2024-04-27T00:06:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20894.668504 secs 2024-04-27T00:06:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20197.637623 secs 2024-04-27T00:06:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:40 smithi156 ceph-mon[32679]: pgmap v11640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:40 smithi092 ceph-mon[29156]: pgmap v11640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:40 smithi189 ceph-mon[32756]: pgmap v11640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: pgmap v11641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: pgmap v11642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:06:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:06:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:06:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:06:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: pgmap v11641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:06:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: pgmap v11642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: pgmap v11641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: pgmap v11642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:06:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:44 smithi189 ceph-mon[32756]: pgmap v11643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20899.668620 secs 2024-04-27T00:06:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20202.637702 secs 2024-04-27T00:06:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:44 smithi156 ceph-mon[32679]: pgmap v11643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20899.668620 secs 2024-04-27T00:06:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20202.637702 secs 2024-04-27T00:06:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:44 smithi092 ceph-mon[29156]: pgmap v11643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20899.668620 secs 2024-04-27T00:06:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20202.637702 secs 2024-04-27T00:06:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:46 smithi189 ceph-mon[32756]: pgmap v11644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:46 smithi156 ceph-mon[32679]: pgmap v11644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:46 smithi092 ceph-mon[29156]: pgmap v11644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:48 smithi156 ceph-mon[32679]: pgmap v11645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:48 smithi092 ceph-mon[29156]: pgmap v11645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:48 smithi189 ceph-mon[32756]: pgmap v11645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:06:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20904.668739 secs 2024-04-27T00:06:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20207.637786 secs 2024-04-27T00:06:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20904.668739 secs 2024-04-27T00:06:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20207.637786 secs 2024-04-27T00:06:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20904.668739 secs 2024-04-27T00:06:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20207.637786 secs 2024-04-27T00:06:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:50 smithi156 ceph-mon[32679]: pgmap v11646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:50 smithi092 ceph-mon[29156]: pgmap v11646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:50 smithi189 ceph-mon[32756]: pgmap v11646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:06:52.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:52 smithi156 ceph-mon[32679]: pgmap v11647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:06:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:52 smithi092 ceph-mon[29156]: pgmap v11647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:06:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:52 smithi189 ceph-mon[32756]: pgmap v11647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:06:54.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:54 smithi092 ceph-mon[29156]: pgmap v11648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:54.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20909.668866 secs 2024-04-27T00:06:54.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20212.637902 secs 2024-04-27T00:06:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:54 smithi156 ceph-mon[32679]: pgmap v11648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20909.668866 secs 2024-04-27T00:06:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20212.637902 secs 2024-04-27T00:06:54.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:54 smithi189 ceph-mon[32756]: pgmap v11648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:54.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20909.668866 secs 2024-04-27T00:06:54.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20212.637902 secs 2024-04-27T00:06:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:56 smithi156 ceph-mon[32679]: pgmap v11649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:56 smithi092 ceph-mon[29156]: pgmap v11649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:56 smithi189 ceph-mon[32756]: pgmap v11649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:06:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:58 smithi156 ceph-mon[32679]: pgmap v11650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:58 smithi092 ceph-mon[29156]: pgmap v11650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:58 smithi189 ceph-mon[32756]: pgmap v11650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:06:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20914.668930 secs 2024-04-27T00:06:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:06:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20217.637975 secs 2024-04-27T00:06:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20914.668930 secs 2024-04-27T00:06:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:06:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20217.637975 secs 2024-04-27T00:07:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20914.668930 secs 2024-04-27T00:07:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:06:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20217.637975 secs 2024-04-27T00:07:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:00 smithi156 ceph-mon[32679]: pgmap v11651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:00 smithi092 ceph-mon[29156]: pgmap v11651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:00 smithi189 ceph-mon[32756]: pgmap v11651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:02 smithi156 ceph-mon[32679]: pgmap v11652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:02.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:02 smithi092 ceph-mon[29156]: pgmap v11652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:02 smithi189 ceph-mon[32756]: pgmap v11652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:04 smithi156 ceph-mon[32679]: pgmap v11653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20919.669066 secs 2024-04-27T00:07:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20222.638079 secs 2024-04-27T00:07:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:04 smithi092 ceph-mon[29156]: pgmap v11653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20919.669066 secs 2024-04-27T00:07:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20222.638079 secs 2024-04-27T00:07:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:04 smithi189 ceph-mon[32756]: pgmap v11653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20919.669066 secs 2024-04-27T00:07:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20222.638079 secs 2024-04-27T00:07:06.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:06 smithi156 ceph-mon[32679]: pgmap v11654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:06 smithi092 ceph-mon[29156]: pgmap v11654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:06 smithi189 ceph-mon[32756]: pgmap v11654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:08.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:08 smithi156 ceph-mon[32679]: pgmap v11655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:08 smithi092 ceph-mon[29156]: pgmap v11655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:08 smithi189 ceph-mon[32756]: pgmap v11655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20924.669146 secs 2024-04-27T00:07:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20227.638149 secs 2024-04-27T00:07:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20924.669146 secs 2024-04-27T00:07:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20227.638149 secs 2024-04-27T00:07:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20924.669146 secs 2024-04-27T00:07:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20227.638149 secs 2024-04-27T00:07:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:10 smithi092 ceph-mon[29156]: pgmap v11656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:10 smithi189 ceph-mon[32756]: pgmap v11656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:10 smithi156 ceph-mon[32679]: pgmap v11656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:12 smithi092 ceph-mon[29156]: pgmap v11657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:12 smithi189 ceph-mon[32756]: pgmap v11657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:12 smithi156 ceph-mon[32679]: pgmap v11657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20929.669265 secs 2024-04-27T00:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:14 smithi092 ceph-mon[29156]: pgmap v11658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20232.638220 secs 2024-04-27T00:07:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20929.669265 secs 2024-04-27T00:07:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:14 smithi189 ceph-mon[32756]: pgmap v11658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20232.638220 secs 2024-04-27T00:07:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20929.669265 secs 2024-04-27T00:07:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:14 smithi156 ceph-mon[32679]: pgmap v11658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20232.638220 secs 2024-04-27T00:07:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:16 smithi092 ceph-mon[29156]: pgmap v11659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:16 smithi189 ceph-mon[32756]: pgmap v11659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:16 smithi156 ceph-mon[32679]: pgmap v11659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:18 smithi092 ceph-mon[29156]: pgmap v11660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:18 smithi189 ceph-mon[32756]: pgmap v11660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:18 smithi156 ceph-mon[32679]: pgmap v11660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20934.669383 secs 2024-04-27T00:07:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20237.638337 secs 2024-04-27T00:07:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20934.669383 secs 2024-04-27T00:07:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20237.638337 secs 2024-04-27T00:07:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20934.669383 secs 2024-04-27T00:07:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20237.638337 secs 2024-04-27T00:07:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:20 smithi092 ceph-mon[29156]: pgmap v11661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:20 smithi189 ceph-mon[32756]: pgmap v11661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:20 smithi156 ceph-mon[32679]: pgmap v11661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:22.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:22 smithi156 ceph-mon[32679]: pgmap v11662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:22 smithi092 ceph-mon[29156]: pgmap v11662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:22 smithi189 ceph-mon[32756]: pgmap v11662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20939.669517 secs 2024-04-27T00:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:24 smithi092 ceph-mon[29156]: pgmap v11663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20242.638454 secs 2024-04-27T00:07:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20939.669517 secs 2024-04-27T00:07:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:24 smithi189 ceph-mon[32756]: pgmap v11663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20242.638454 secs 2024-04-27T00:07:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20939.669517 secs 2024-04-27T00:07:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:24 smithi156 ceph-mon[32679]: pgmap v11663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20242.638454 secs 2024-04-27T00:07:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:26 smithi092 ceph-mon[29156]: pgmap v11664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:26 smithi189 ceph-mon[32756]: pgmap v11664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:26 smithi156 ceph-mon[32679]: pgmap v11664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:07:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:28 smithi092 ceph-mon[29156]: pgmap v11665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:28 smithi189 ceph-mon[32756]: pgmap v11665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:28 smithi156 ceph-mon[32679]: pgmap v11665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20944.669655 secs 2024-04-27T00:07:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20247.638574 secs 2024-04-27T00:07:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20944.669655 secs 2024-04-27T00:07:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20247.638574 secs 2024-04-27T00:07:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20944.669655 secs 2024-04-27T00:07:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20247.638574 secs 2024-04-27T00:07:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:30 smithi092 ceph-mon[29156]: pgmap v11666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:30 smithi189 ceph-mon[32756]: pgmap v11666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:30 smithi156 ceph-mon[32679]: pgmap v11666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:32 smithi092 ceph-mon[29156]: pgmap v11667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:32 smithi189 ceph-mon[32756]: pgmap v11667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:32 smithi156 ceph-mon[32679]: pgmap v11667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20949.669746 secs 2024-04-27T00:07:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:34 smithi092 ceph-mon[29156]: pgmap v11668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20252.638692 secs 2024-04-27T00:07:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20949.669746 secs 2024-04-27T00:07:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:34 smithi189 ceph-mon[32756]: pgmap v11668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20252.638692 secs 2024-04-27T00:07:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20949.669746 secs 2024-04-27T00:07:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:34 smithi156 ceph-mon[32679]: pgmap v11668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20252.638692 secs 2024-04-27T00:07:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:36 smithi092 ceph-mon[29156]: pgmap v11669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:36 smithi189 ceph-mon[32756]: pgmap v11669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:36 smithi156 ceph-mon[32679]: pgmap v11669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:38 smithi189 ceph-mon[32756]: pgmap v11670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:38 smithi156 ceph-mon[32679]: pgmap v11670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:38 smithi092 ceph-mon[29156]: pgmap v11670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20954.669872 secs 2024-04-27T00:07:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20257.638813 secs 2024-04-27T00:07:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20954.669872 secs 2024-04-27T00:07:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20257.638813 secs 2024-04-27T00:07:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20954.669872 secs 2024-04-27T00:07:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20257.638813 secs 2024-04-27T00:07:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:40 smithi189 ceph-mon[32756]: pgmap v11671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:40 smithi156 ceph-mon[32679]: pgmap v11671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:40 smithi092 ceph-mon[29156]: pgmap v11671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:07:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:07:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:07:43.013 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: pgmap v11672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:43.013 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.014 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.014 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.014 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.014 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.014 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.060 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: pgmap v11672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:43.060 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.060 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.061 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: pgmap v11672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.066 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:43.067 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20959.669916 secs 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: pgmap v11673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20262.638879 secs 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20959.669916 secs 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: pgmap v11673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20262.638879 secs 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20959.669916 secs 2024-04-27T00:07:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: pgmap v11673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20262.638879 secs 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:07:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:07:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: pgmap v11674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: pgmap v11675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: pgmap v11674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: pgmap v11675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: pgmap v11674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: pgmap v11675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:07:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:48 smithi189 ceph-mon[32756]: pgmap v11676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:48 smithi156 ceph-mon[32679]: pgmap v11676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:48 smithi092 ceph-mon[29156]: pgmap v11676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20964.670029 secs 2024-04-27T00:07:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20267.639017 secs 2024-04-27T00:07:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20964.670029 secs 2024-04-27T00:07:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20267.639017 secs 2024-04-27T00:07:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20964.670029 secs 2024-04-27T00:07:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20267.639017 secs 2024-04-27T00:07:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:50 smithi189 ceph-mon[32756]: pgmap v11677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:50 smithi156 ceph-mon[32679]: pgmap v11677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:50 smithi092 ceph-mon[29156]: pgmap v11677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:52 smithi189 ceph-mon[32756]: pgmap v11678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:52 smithi156 ceph-mon[32679]: pgmap v11678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:52 smithi092 ceph-mon[29156]: pgmap v11678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:07:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:54 smithi189 ceph-mon[32756]: pgmap v11679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:07:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20969.670170 secs 2024-04-27T00:07:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20272.639147 secs 2024-04-27T00:07:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:54 smithi156 ceph-mon[32679]: pgmap v11679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:07:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20969.670170 secs 2024-04-27T00:07:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20272.639147 secs 2024-04-27T00:07:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:54 smithi092 ceph-mon[29156]: pgmap v11679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:07:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20969.670170 secs 2024-04-27T00:07:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20272.639147 secs 2024-04-27T00:07:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:56 smithi189 ceph-mon[32756]: pgmap v11680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:07:56.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:56 smithi156 ceph-mon[32679]: pgmap v11680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:07:56.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:56 smithi092 ceph-mon[29156]: pgmap v11680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:07:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:58 smithi189 ceph-mon[32756]: pgmap v11681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:58 smithi156 ceph-mon[32679]: pgmap v11681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:58 smithi092 ceph-mon[29156]: pgmap v11681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:07:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20974.670247 secs 2024-04-27T00:07:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:07:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20277.639278 secs 2024-04-27T00:07:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20974.670247 secs 2024-04-27T00:07:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:07:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20277.639278 secs 2024-04-27T00:08:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20974.670247 secs 2024-04-27T00:08:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:07:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20277.639278 secs 2024-04-27T00:08:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:00 smithi156 ceph-mon[32679]: pgmap v11682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:00 smithi092 ceph-mon[29156]: pgmap v11682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:00 smithi189 ceph-mon[32756]: pgmap v11682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:02 smithi156 ceph-mon[32679]: pgmap v11683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:02 smithi092 ceph-mon[29156]: pgmap v11683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:02 smithi189 ceph-mon[32756]: pgmap v11683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:04 smithi156 ceph-mon[32679]: pgmap v11684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20979.670314 secs 2024-04-27T00:08:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20282.639393 secs 2024-04-27T00:08:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:04 smithi092 ceph-mon[29156]: pgmap v11684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20979.670314 secs 2024-04-27T00:08:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20282.639393 secs 2024-04-27T00:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:04 smithi189 ceph-mon[32756]: pgmap v11684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20979.670314 secs 2024-04-27T00:08:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20282.639393 secs 2024-04-27T00:08:06.650 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:08:06.340+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:08:06.650 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:08:06.340+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:08:06.650 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:08:06.340+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:08:06.650 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:08:06.340+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:08:06.650 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:08:06.340+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:08:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:06 smithi156 ceph-mon[32679]: pgmap v11685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:06 smithi092 ceph-mon[29156]: pgmap v11685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:06 smithi189 ceph-mon[32756]: pgmap v11685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:08 smithi156 ceph-mon[32679]: pgmap v11686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:08 smithi092 ceph-mon[29156]: pgmap v11686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:08 smithi189 ceph-mon[32756]: pgmap v11686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20984.670382 secs 2024-04-27T00:08:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20287.639513 secs 2024-04-27T00:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20984.670382 secs 2024-04-27T00:08:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20287.639513 secs 2024-04-27T00:08:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20984.670382 secs 2024-04-27T00:08:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20287.639513 secs 2024-04-27T00:08:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:10 smithi156 ceph-mon[32679]: pgmap v11687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:10 smithi092 ceph-mon[29156]: pgmap v11687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:10 smithi189 ceph-mon[32756]: pgmap v11687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:12 smithi156 ceph-mon[32679]: pgmap v11688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:12 smithi092 ceph-mon[29156]: pgmap v11688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:12 smithi189 ceph-mon[32756]: pgmap v11688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:14 smithi156 ceph-mon[32679]: pgmap v11689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-27T00:08:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20989.670475 secs 2024-04-27T00:08:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20292.639630 secs 2024-04-27T00:08:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:14 smithi092 ceph-mon[29156]: pgmap v11689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-27T00:08:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20989.670475 secs 2024-04-27T00:08:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20292.639630 secs 2024-04-27T00:08:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:14 smithi189 ceph-mon[32756]: pgmap v11689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 15 op/s 2024-04-27T00:08:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20989.670475 secs 2024-04-27T00:08:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20292.639630 secs 2024-04-27T00:08:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:16 smithi156 ceph-mon[32679]: pgmap v11690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:16 smithi092 ceph-mon[29156]: pgmap v11690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:16 smithi189 ceph-mon[32756]: pgmap v11690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:18 smithi156 ceph-mon[32679]: pgmap v11691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:18 smithi092 ceph-mon[29156]: pgmap v11691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:18 smithi189 ceph-mon[32756]: pgmap v11691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T00:08:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20994.670599 secs 2024-04-27T00:08:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20297.639752 secs 2024-04-27T00:08:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20994.670599 secs 2024-04-27T00:08:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20297.639752 secs 2024-04-27T00:08:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20994.670599 secs 2024-04-27T00:08:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20297.639752 secs 2024-04-27T00:08:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:20 smithi092 ceph-mon[29156]: pgmap v11692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:20 smithi189 ceph-mon[32756]: pgmap v11692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:20 smithi156 ceph-mon[32679]: pgmap v11692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T00:08:22.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:22 smithi156 ceph-mon[32679]: pgmap v11693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:22 smithi092 ceph-mon[29156]: pgmap v11693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:22 smithi189 ceph-mon[32756]: pgmap v11693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:24.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:24 smithi189 ceph-mon[32756]: pgmap v11694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:24.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 20999.670738 secs 2024-04-27T00:08:24.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20302.639857 secs 2024-04-27T00:08:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:24 smithi092 ceph-mon[29156]: pgmap v11694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 20999.670738 secs 2024-04-27T00:08:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20302.639857 secs 2024-04-27T00:08:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:24 smithi156 ceph-mon[32679]: pgmap v11694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 20999.670738 secs 2024-04-27T00:08:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20302.639857 secs 2024-04-27T00:08:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:26 smithi092 ceph-mon[29156]: pgmap v11695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:26 smithi189 ceph-mon[32756]: pgmap v11695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:26 smithi156 ceph-mon[32679]: pgmap v11695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:28 smithi092 ceph-mon[29156]: pgmap v11696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:28 smithi189 ceph-mon[32756]: pgmap v11696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:28 smithi156 ceph-mon[32679]: pgmap v11696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21004.670865 secs 2024-04-27T00:08:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20307.639980 secs 2024-04-27T00:08:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21004.670865 secs 2024-04-27T00:08:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20307.639980 secs 2024-04-27T00:08:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21004.670865 secs 2024-04-27T00:08:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20307.639980 secs 2024-04-27T00:08:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:30 smithi092 ceph-mon[29156]: pgmap v11697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:30 smithi189 ceph-mon[32756]: pgmap v11697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:30 smithi156 ceph-mon[32679]: pgmap v11697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:32 smithi092 ceph-mon[29156]: pgmap v11698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:32 smithi189 ceph-mon[32756]: pgmap v11698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:32 smithi156 ceph-mon[32679]: pgmap v11698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:34 smithi092 ceph-mon[29156]: pgmap v11699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21009.670940 secs 2024-04-27T00:08:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20312.640038 secs 2024-04-27T00:08:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:34 smithi189 ceph-mon[32756]: pgmap v11699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21009.670940 secs 2024-04-27T00:08:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20312.640038 secs 2024-04-27T00:08:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:34 smithi156 ceph-mon[32679]: pgmap v11699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21009.670940 secs 2024-04-27T00:08:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20312.640038 secs 2024-04-27T00:08:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:36 smithi092 ceph-mon[29156]: pgmap v11700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:36 smithi189 ceph-mon[32756]: pgmap v11700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:36 smithi156 ceph-mon[32679]: pgmap v11700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:38 smithi092 ceph-mon[29156]: pgmap v11701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:38 smithi189 ceph-mon[32756]: pgmap v11701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:38 smithi156 ceph-mon[32679]: pgmap v11701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21014.671000 secs 2024-04-27T00:08:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:40 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20317.640167 secs 2024-04-27T00:08:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:40 smithi189 ceph-mon[32756]: pgmap v11702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21014.671000 secs 2024-04-27T00:08:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:40 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20317.640167 secs 2024-04-27T00:08:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:40 smithi156 ceph-mon[32679]: pgmap v11702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21014.671000 secs 2024-04-27T00:08:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:40 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20317.640167 secs 2024-04-27T00:08:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:40 smithi092 ceph-mon[29156]: pgmap v11702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:42 smithi189 ceph-mon[32756]: pgmap v11703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:42 smithi156 ceph-mon[32679]: pgmap v11703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:42 smithi092 ceph-mon[29156]: pgmap v11703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:44 smithi189 ceph-mon[32756]: pgmap v11704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21019.671067 secs 2024-04-27T00:08:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20322.640242 secs 2024-04-27T00:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:44 smithi156 ceph-mon[32679]: pgmap v11704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21019.671067 secs 2024-04-27T00:08:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20322.640242 secs 2024-04-27T00:08:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:44 smithi092 ceph-mon[29156]: pgmap v11704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21019.671067 secs 2024-04-27T00:08:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20322.640242 secs 2024-04-27T00:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:46 smithi189 ceph-mon[32756]: pgmap v11705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:08:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:08:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:46 smithi156 ceph-mon[32679]: pgmap v11705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:08:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:08:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:08:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:08:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:46 smithi092 ceph-mon[29156]: pgmap v11705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:08:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:08:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:08:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:08:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:08:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:47 smithi189 ceph-mon[32756]: pgmap v11706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:08:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:47 smithi189 ceph-mon[32756]: pgmap v11707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:47 smithi156 ceph-mon[32679]: pgmap v11706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:08:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:47 smithi156 ceph-mon[32679]: pgmap v11707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:47 smithi092 ceph-mon[29156]: pgmap v11706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:08:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:47 smithi092 ceph-mon[29156]: pgmap v11707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:49 smithi189 ceph-mon[32756]: pgmap v11708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:08:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21024.671187 secs 2024-04-27T00:08:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20327.640372 secs 2024-04-27T00:08:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:49 smithi156 ceph-mon[32679]: pgmap v11708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:08:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21024.671187 secs 2024-04-27T00:08:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20327.640372 secs 2024-04-27T00:08:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:49 smithi092 ceph-mon[29156]: pgmap v11708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:08:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21024.671187 secs 2024-04-27T00:08:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20327.640372 secs 2024-04-27T00:08:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:51 smithi156 ceph-mon[32679]: pgmap v11709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:51 smithi092 ceph-mon[29156]: pgmap v11709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:51 smithi189 ceph-mon[32756]: pgmap v11709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:53 smithi156 ceph-mon[32679]: pgmap v11710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:08:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:53 smithi092 ceph-mon[29156]: pgmap v11710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:08:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:53 smithi189 ceph-mon[32756]: pgmap v11710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21029.671296 secs 2024-04-27T00:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20332.640476 secs 2024-04-27T00:08:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21029.671296 secs 2024-04-27T00:08:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20332.640476 secs 2024-04-27T00:08:55.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21029.671296 secs 2024-04-27T00:08:55.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20332.640476 secs 2024-04-27T00:08:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:55 smithi156 ceph-mon[32679]: pgmap v11711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:55 smithi092 ceph-mon[29156]: pgmap v11711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:55 smithi189 ceph-mon[32756]: pgmap v11711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:08:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:57 smithi156 ceph-mon[32679]: pgmap v11712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:08:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:57 smithi092 ceph-mon[29156]: pgmap v11712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:08:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:57 smithi189 ceph-mon[32756]: pgmap v11712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:08:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:59 smithi156 ceph-mon[32679]: pgmap v11713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21034.671404 secs 2024-04-27T00:08:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:08:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20337.640601 secs 2024-04-27T00:08:59.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:59 smithi092 ceph-mon[29156]: pgmap v11713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:08:59.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21034.671404 secs 2024-04-27T00:08:59.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:08:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20337.640601 secs 2024-04-27T00:09:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:59 smithi189 ceph-mon[32756]: pgmap v11713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21034.671404 secs 2024-04-27T00:09:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:08:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20337.640601 secs 2024-04-27T00:09:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:01 smithi156 ceph-mon[32679]: pgmap v11714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:01 smithi092 ceph-mon[29156]: pgmap v11714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:01 smithi189 ceph-mon[32756]: pgmap v11714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:03 smithi156 ceph-mon[32679]: pgmap v11715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:03 smithi092 ceph-mon[29156]: pgmap v11715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:03 smithi189 ceph-mon[32756]: pgmap v11715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21039.671527 secs 2024-04-27T00:09:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20342.640727 secs 2024-04-27T00:09:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21039.671527 secs 2024-04-27T00:09:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20342.640727 secs 2024-04-27T00:09:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21039.671527 secs 2024-04-27T00:09:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20342.640727 secs 2024-04-27T00:09:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:05 smithi156 ceph-mon[32679]: pgmap v11716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:05 smithi092 ceph-mon[29156]: pgmap v11716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:05 smithi189 ceph-mon[32756]: pgmap v11716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:07.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:07 smithi156 ceph-mon[32679]: pgmap v11717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:07 smithi092 ceph-mon[29156]: pgmap v11717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:07 smithi189 ceph-mon[32756]: pgmap v11717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:09 smithi156 ceph-mon[32679]: pgmap v11718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:09 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 21044.671645 secs 2024-04-27T00:09:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:09 smithi156 ceph-mon[32679]: slow request 362.358355 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:09:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20347.640854 secs 2024-04-27T00:09:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:09 smithi092 ceph-mon[29156]: pgmap v11718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:09 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 21044.671645 secs 2024-04-27T00:09:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:09 smithi092 ceph-mon[29156]: slow request 362.358355 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:09:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20347.640854 secs 2024-04-27T00:09:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:09 smithi189 ceph-mon[32756]: pgmap v11718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:09 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 21044.671645 secs 2024-04-27T00:09:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:09 smithi189 ceph-mon[32756]: slow request 362.358355 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:09:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20347.640854 secs 2024-04-27T00:09:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:11 smithi156 ceph-mon[32679]: pgmap v11719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:11 smithi092 ceph-mon[29156]: pgmap v11719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:11 smithi189 ceph-mon[32756]: pgmap v11719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:13 smithi156 ceph-mon[32679]: pgmap v11720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:13 smithi092 ceph-mon[29156]: pgmap v11720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:13 smithi189 ceph-mon[32756]: pgmap v11720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:09:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21049.671758 secs 2024-04-27T00:09:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20352.640971 secs 2024-04-27T00:09:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21049.671758 secs 2024-04-27T00:09:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20352.640971 secs 2024-04-27T00:09:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21049.671758 secs 2024-04-27T00:09:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20352.640971 secs 2024-04-27T00:09:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:15 smithi092 ceph-mon[29156]: pgmap v11721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:15 smithi189 ceph-mon[32756]: pgmap v11721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:15 smithi156 ceph-mon[32679]: pgmap v11721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:09:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:17 smithi092 ceph-mon[29156]: pgmap v11722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:17 smithi189 ceph-mon[32756]: pgmap v11722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:17 smithi156 ceph-mon[32679]: pgmap v11722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:19 smithi092 ceph-mon[29156]: pgmap v11723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21054.671869 secs 2024-04-27T00:09:19.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20357.641093 secs 2024-04-27T00:09:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:19 smithi189 ceph-mon[32756]: pgmap v11723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21054.671869 secs 2024-04-27T00:09:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20357.641093 secs 2024-04-27T00:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:19 smithi156 ceph-mon[32679]: pgmap v11723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21054.671869 secs 2024-04-27T00:09:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20357.641093 secs 2024-04-27T00:09:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:21 smithi092 ceph-mon[29156]: pgmap v11724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:21 smithi189 ceph-mon[32756]: pgmap v11724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:21 smithi156 ceph-mon[32679]: pgmap v11724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:23.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:23 smithi156 ceph-mon[32679]: pgmap v11725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:23 smithi092 ceph-mon[29156]: pgmap v11725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:23 smithi189 ceph-mon[32756]: pgmap v11725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21059.671932 secs 2024-04-27T00:09:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20362.641209 secs 2024-04-27T00:09:25.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21059.671932 secs 2024-04-27T00:09:25.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20362.641209 secs 2024-04-27T00:09:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21059.671932 secs 2024-04-27T00:09:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20362.641209 secs 2024-04-27T00:09:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:25 smithi092 ceph-mon[29156]: pgmap v11726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:25 smithi189 ceph-mon[32756]: pgmap v11726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:25 smithi156 ceph-mon[32679]: pgmap v11726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:27 smithi092 ceph-mon[29156]: pgmap v11727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:27 smithi189 ceph-mon[32756]: pgmap v11727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:27 smithi156 ceph-mon[32679]: pgmap v11727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:29 smithi092 ceph-mon[29156]: pgmap v11728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21064.672006 secs 2024-04-27T00:09:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20367.641392 secs 2024-04-27T00:09:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:29 smithi189 ceph-mon[32756]: pgmap v11728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21064.672006 secs 2024-04-27T00:09:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20367.641392 secs 2024-04-27T00:09:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:29 smithi156 ceph-mon[32679]: pgmap v11728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21064.672006 secs 2024-04-27T00:09:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20367.641392 secs 2024-04-27T00:09:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:31 smithi092 ceph-mon[29156]: pgmap v11729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:31 smithi189 ceph-mon[32756]: pgmap v11729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:31 smithi156 ceph-mon[32679]: pgmap v11729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:33 smithi092 ceph-mon[29156]: pgmap v11730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:33 smithi189 ceph-mon[32756]: pgmap v11730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:33 smithi156 ceph-mon[32679]: pgmap v11730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21069.672071 secs 2024-04-27T00:09:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20372.641522 secs 2024-04-27T00:09:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21069.672071 secs 2024-04-27T00:09:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20372.641522 secs 2024-04-27T00:09:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21069.672071 secs 2024-04-27T00:09:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20372.641522 secs 2024-04-27T00:09:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:35 smithi092 ceph-mon[29156]: pgmap v11731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:35 smithi189 ceph-mon[32756]: pgmap v11731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:35 smithi156 ceph-mon[32679]: pgmap v11731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:37 smithi092 ceph-mon[29156]: pgmap v11732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:37 smithi189 ceph-mon[32756]: pgmap v11732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:37 smithi156 ceph-mon[32679]: pgmap v11732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:09:38.871+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:09:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:09:38.871+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:09:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:09:38.871+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:09:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:09:38.871+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 164 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:09:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:39 smithi092 ceph-mon[29156]: pgmap v11733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21074.672192 secs 2024-04-27T00:09:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20377.641618 secs 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198045]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198045]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198048]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198048]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:39.994 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198048]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:39.995 INFO:journalctl@ceph.osd.0.smithi092.stdout:Apr 27 00:09:39 smithi092 sudo[198048]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:39 smithi189 ceph-mon[32756]: pgmap v11733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:40.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21074.672192 secs 2024-04-27T00:09:40.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20377.641618 secs 2024-04-27T00:09:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:39 smithi156 ceph-mon[32679]: pgmap v11733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21074.672192 secs 2024-04-27T00:09:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20377.641618 secs 2024-04-27T00:09:40.184 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165671]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.184 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165671]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165671]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165671]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165674]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165674]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165674]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.185 INFO:journalctl@ceph.osd.1.smithi156.stdout:Apr 27 00:09:39 smithi156 sudo[165674]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165838]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165838]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165838]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165838]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165841]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.379 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165841]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.380 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165841]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.380 INFO:journalctl@ceph.osd.2.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165841]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198051]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198051]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198051]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198051]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198054]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198054]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198054]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.472 INFO:journalctl@ceph.osd.3.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198054]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.568 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165677]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165677]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165680]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165680]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165680]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.569 INFO:journalctl@ceph.osd.4.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165680]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.638 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165844]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.638 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165844]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.638 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165844]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.638 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165844]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.639 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.639 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.639 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165847]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.639 INFO:journalctl@ceph.osd.5.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165847]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.743 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198057]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198057]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198060]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198060]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198060]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.744 INFO:journalctl@ceph.osd.6.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198060]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.866 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165683]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165683]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165683]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165683]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165686]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165686]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165686]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.867 INFO:journalctl@ceph.osd.7.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165686]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:40.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:40.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:40.959 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:40 smithi189 ceph-mon[32756]: pgmap v11734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:40.959 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165850]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:40.959 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165850]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.959 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165850]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.959 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165850]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:40.960 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165853]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:40.960 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165853]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:40.960 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165853]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:40.960 INFO:journalctl@ceph.osd.8.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165853]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.031 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:40 smithi092 ceph-mon[29156]: pgmap v11734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198063]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198063]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198063]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198063]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198066]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.032 INFO:journalctl@ceph.osd.9.smithi092.stdout:Apr 27 00:09:40 smithi092 sudo[198066]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.146 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.146 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.146 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:41.147 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:40 smithi156 ceph-mon[32679]: pgmap v11734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165689]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165689]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165689]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165689]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165692]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165692]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165692]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Apr 27 00:09:40 smithi156 sudo[165692]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165862]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165862]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165862]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165862]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165865]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165865]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165865]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165865]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165856]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165856]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165856]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:40 smithi189 sudo[165856]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165859]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165859]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165859]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.389 INFO:journalctl@ceph.osd.11.smithi189.stdout:Apr 27 00:09:41 smithi189 sudo[165859]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165695]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165695]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165695]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165695]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165698]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 sudo[165698]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-27T00:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198069]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198069]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-27T00:09:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-27T00:09:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198072]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-27T00:09:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 sudo[198072]: pam_unix(sudo:session): session closed for user root 2024-04-27T00:09:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:41 smithi189 ceph-mon[32756]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:41 smithi156 ceph-mon[32679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-27T00:09:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:41 smithi092 ceph-mon[29156]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-27T00:09:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:42 smithi156 ceph-mon[32679]: pgmap v11735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:42 smithi092 ceph-mon[29156]: pgmap v11735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:42 smithi189 ceph-mon[32756]: pgmap v11735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:09:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21079.672309 secs 2024-04-27T00:09:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:45 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20382.641734 secs 2024-04-27T00:09:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:45 smithi156 ceph-mon[32679]: pgmap v11736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 120 KiB/s wr, 15 op/s 2024-04-27T00:09:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21079.672309 secs 2024-04-27T00:09:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:45 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20382.641734 secs 2024-04-27T00:09:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:45 smithi092 ceph-mon[29156]: pgmap v11736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 120 KiB/s wr, 15 op/s 2024-04-27T00:09:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21079.672309 secs 2024-04-27T00:09:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:45 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20382.641734 secs 2024-04-27T00:09:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:45 smithi189 ceph-mon[32756]: pgmap v11736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 120 KiB/s wr, 15 op/s 2024-04-27T00:09:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:47 smithi156 ceph-mon[32679]: pgmap v11737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-04-27T00:09:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:09:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:09:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:09:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:47 smithi092 ceph-mon[29156]: pgmap v11737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-04-27T00:09:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:09:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:09:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:09:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:47 smithi189 ceph-mon[32756]: pgmap v11737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-04-27T00:09:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:09:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:09:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:09:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:09:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:48 smithi156 ceph-mon[32679]: pgmap v11738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-04-27T00:09:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:48 smithi156 ceph-mon[32679]: pgmap v11739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:48 smithi092 ceph-mon[29156]: pgmap v11738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-04-27T00:09:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:48 smithi092 ceph-mon[29156]: pgmap v11739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:48 smithi189 ceph-mon[32756]: pgmap v11738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-04-27T00:09:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:48 smithi189 ceph-mon[32756]: pgmap v11739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20387.641836 secs 2024-04-27T00:09:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20387.641836 secs 2024-04-27T00:09:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20387.641836 secs 2024-04-27T00:09:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21084.672426 secs 2024-04-27T00:09:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:50 smithi156 ceph-mon[32679]: pgmap v11740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21084.672426 secs 2024-04-27T00:09:50.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:50 smithi092 ceph-mon[29156]: pgmap v11740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21084.672426 secs 2024-04-27T00:09:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:50 smithi189 ceph-mon[32756]: pgmap v11740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:52 smithi156 ceph-mon[32679]: pgmap v11741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:52 smithi092 ceph-mon[29156]: pgmap v11741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:52 smithi189 ceph-mon[32756]: pgmap v11741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 164 KiB/s wr, 19 op/s 2024-04-27T00:09:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:54 smithi156 ceph-mon[32679]: pgmap v11742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:09:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20392.641969 secs 2024-04-27T00:09:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:54 smithi092 ceph-mon[29156]: pgmap v11742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:09:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20392.641969 secs 2024-04-27T00:09:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:54 smithi189 ceph-mon[32756]: pgmap v11742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:09:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20392.641969 secs 2024-04-27T00:09:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21089.672542 secs 2024-04-27T00:09:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21089.672542 secs 2024-04-27T00:09:55.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21089.672542 secs 2024-04-27T00:09:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:56 smithi156 ceph-mon[32679]: pgmap v11743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:09:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:56 smithi092 ceph-mon[29156]: pgmap v11743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:09:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:56 smithi189 ceph-mon[32756]: pgmap v11743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:09:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:58 smithi156 ceph-mon[32679]: pgmap v11744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:09:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:58 smithi092 ceph-mon[29156]: pgmap v11744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:09:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:58 smithi189 ceph-mon[32756]: pgmap v11744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:09:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21094.672654 secs 2024-04-27T00:09:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:09:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20397.642133 secs 2024-04-27T00:09:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21094.672654 secs 2024-04-27T00:09:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:09:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20397.642133 secs 2024-04-27T00:09:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21094.672654 secs 2024-04-27T00:09:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:09:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20397.642133 secs 2024-04-27T00:10:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:00 smithi092 ceph-mon[29156]: pgmap v11745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:10:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:00 smithi189 ceph-mon[32756]: pgmap v11745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:10:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:00 smithi156 ceph-mon[32679]: pgmap v11745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:10:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:02 smithi092 ceph-mon[29156]: pgmap v11746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:02 smithi189 ceph-mon[32756]: pgmap v11746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:02 smithi156 ceph-mon[32679]: pgmap v11746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:04 smithi092 ceph-mon[29156]: pgmap v11747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21099.672809 secs 2024-04-27T00:10:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20402.642241 secs 2024-04-27T00:10:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:04 smithi189 ceph-mon[32756]: pgmap v11747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21099.672809 secs 2024-04-27T00:10:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20402.642241 secs 2024-04-27T00:10:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:04 smithi156 ceph-mon[32679]: pgmap v11747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21099.672809 secs 2024-04-27T00:10:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20402.642241 secs 2024-04-27T00:10:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:06 smithi092 ceph-mon[29156]: pgmap v11748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:06 smithi189 ceph-mon[32756]: pgmap v11748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:06 smithi156 ceph-mon[32679]: pgmap v11748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:08 smithi092 ceph-mon[29156]: pgmap v11749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:08 smithi189 ceph-mon[32756]: pgmap v11749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:08 smithi156 ceph-mon[32679]: pgmap v11749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21104.672906 secs 2024-04-27T00:10:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20407.642357 secs 2024-04-27T00:10:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21104.672906 secs 2024-04-27T00:10:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20407.642357 secs 2024-04-27T00:10:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21104.672906 secs 2024-04-27T00:10:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20407.642357 secs 2024-04-27T00:10:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:10 smithi092 ceph-mon[29156]: pgmap v11750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:10 smithi189 ceph-mon[32756]: pgmap v11750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:10 smithi156 ceph-mon[32679]: pgmap v11750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:12 smithi092 ceph-mon[29156]: pgmap v11751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:12 smithi189 ceph-mon[32756]: pgmap v11751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:12 smithi156 ceph-mon[32679]: pgmap v11751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:14 smithi092 ceph-mon[29156]: pgmap v11752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21109.672994 secs 2024-04-27T00:10:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20412.642420 secs 2024-04-27T00:10:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:14 smithi189 ceph-mon[32756]: pgmap v11752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21109.672994 secs 2024-04-27T00:10:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20412.642420 secs 2024-04-27T00:10:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:14 smithi156 ceph-mon[32679]: pgmap v11752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21109.672994 secs 2024-04-27T00:10:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20412.642420 secs 2024-04-27T00:10:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:16 smithi092 ceph-mon[29156]: pgmap v11753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:16 smithi189 ceph-mon[32756]: pgmap v11753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:16 smithi156 ceph-mon[32679]: pgmap v11753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:18 smithi092 ceph-mon[29156]: pgmap v11754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:18 smithi189 ceph-mon[32756]: pgmap v11754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:18 smithi156 ceph-mon[32679]: pgmap v11754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21114.673076 secs 2024-04-27T00:10:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20417.642542 secs 2024-04-27T00:10:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21114.673076 secs 2024-04-27T00:10:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20417.642542 secs 2024-04-27T00:10:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21114.673076 secs 2024-04-27T00:10:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20417.642542 secs 2024-04-27T00:10:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:20 smithi092 ceph-mon[29156]: pgmap v11755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:20 smithi189 ceph-mon[32756]: pgmap v11755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:20 smithi156 ceph-mon[32679]: pgmap v11755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:22 smithi092 ceph-mon[29156]: pgmap v11756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:22 smithi189 ceph-mon[32756]: pgmap v11756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:22 smithi156 ceph-mon[32679]: pgmap v11756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:24.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:24 smithi156 ceph-mon[32679]: pgmap v11757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:24.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21119.673142 secs 2024-04-27T00:10:24.735 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20422.642650 secs 2024-04-27T00:10:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:24 smithi092 ceph-mon[29156]: pgmap v11757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21119.673142 secs 2024-04-27T00:10:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20422.642650 secs 2024-04-27T00:10:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:24 smithi189 ceph-mon[32756]: pgmap v11757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21119.673142 secs 2024-04-27T00:10:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20422.642650 secs 2024-04-27T00:10:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:26 smithi092 ceph-mon[29156]: pgmap v11758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:26 smithi189 ceph-mon[32756]: pgmap v11758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:26 smithi156 ceph-mon[32679]: pgmap v11758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:28 smithi092 ceph-mon[29156]: pgmap v11759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:28 smithi189 ceph-mon[32756]: pgmap v11759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:28 smithi156 ceph-mon[32679]: pgmap v11759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21124.673261 secs 2024-04-27T00:10:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20427.642731 secs 2024-04-27T00:10:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21124.673261 secs 2024-04-27T00:10:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20427.642731 secs 2024-04-27T00:10:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21124.673261 secs 2024-04-27T00:10:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20427.642731 secs 2024-04-27T00:10:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:30 smithi189 ceph-mon[32756]: pgmap v11760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:30 smithi156 ceph-mon[32679]: pgmap v11760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:30 smithi092 ceph-mon[29156]: pgmap v11760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:32 smithi189 ceph-mon[32756]: pgmap v11761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:32 smithi156 ceph-mon[32679]: pgmap v11761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:32 smithi092 ceph-mon[29156]: pgmap v11761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:34 smithi189 ceph-mon[32756]: pgmap v11762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21129.673377 secs 2024-04-27T00:10:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20432.642808 secs 2024-04-27T00:10:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:34 smithi156 ceph-mon[32679]: pgmap v11762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21129.673377 secs 2024-04-27T00:10:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20432.642808 secs 2024-04-27T00:10:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:34 smithi092 ceph-mon[29156]: pgmap v11762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21129.673377 secs 2024-04-27T00:10:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20432.642808 secs 2024-04-27T00:10:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:36 smithi189 ceph-mon[32756]: pgmap v11763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:36 smithi156 ceph-mon[32679]: pgmap v11763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:36 smithi092 ceph-mon[29156]: pgmap v11763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:38 smithi189 ceph-mon[32756]: pgmap v11764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:38 smithi156 ceph-mon[32679]: pgmap v11764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:38 smithi092 ceph-mon[29156]: pgmap v11764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21134.673502 secs 2024-04-27T00:10:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20437.642923 secs 2024-04-27T00:10:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21134.673502 secs 2024-04-27T00:10:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20437.642923 secs 2024-04-27T00:10:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21134.673502 secs 2024-04-27T00:10:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20437.642923 secs 2024-04-27T00:10:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:40 smithi189 ceph-mon[32756]: pgmap v11765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:40 smithi156 ceph-mon[32679]: pgmap v11765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:40 smithi092 ceph-mon[29156]: pgmap v11765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:42 smithi189 ceph-mon[32756]: pgmap v11766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:42 smithi156 ceph-mon[32679]: pgmap v11766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:42 smithi092 ceph-mon[29156]: pgmap v11766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:44 smithi189 ceph-mon[32756]: pgmap v11767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21139.673630 secs 2024-04-27T00:10:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20442.643027 secs 2024-04-27T00:10:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:44 smithi156 ceph-mon[32679]: pgmap v11767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21139.673630 secs 2024-04-27T00:10:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20442.643027 secs 2024-04-27T00:10:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:44 smithi092 ceph-mon[29156]: pgmap v11767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21139.673630 secs 2024-04-27T00:10:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20442.643027 secs 2024-04-27T00:10:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:46 smithi189 ceph-mon[32756]: pgmap v11768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:46 smithi156 ceph-mon[32679]: pgmap v11768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:46 smithi092 ceph-mon[29156]: pgmap v11768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:10:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:10:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:10:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:10:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:48 smithi189 ceph-mon[32756]: pgmap v11769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:10:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:10:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:10:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:48 smithi156 ceph-mon[32679]: pgmap v11769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:10:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:10:48.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:10:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:48 smithi092 ceph-mon[29156]: pgmap v11769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:10:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:10:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:10:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:10:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:49 smithi189 ceph-mon[32756]: pgmap v11770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:10:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:49 smithi189 ceph-mon[32756]: pgmap v11771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:10:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21144.673747 secs 2024-04-27T00:10:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20447.643143 secs 2024-04-27T00:10:49.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:49 smithi092 ceph-mon[29156]: pgmap v11770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:10:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:49 smithi092 ceph-mon[29156]: pgmap v11771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:10:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21144.673747 secs 2024-04-27T00:10:49.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20447.643143 secs 2024-04-27T00:10:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:49 smithi156 ceph-mon[32679]: pgmap v11770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:10:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:49 smithi156 ceph-mon[32679]: pgmap v11771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:10:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21144.673747 secs 2024-04-27T00:10:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20447.643143 secs 2024-04-27T00:10:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:51 smithi189 ceph-mon[32756]: pgmap v11772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:51 smithi156 ceph-mon[32679]: pgmap v11772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:51 smithi092 ceph-mon[29156]: pgmap v11772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:53 smithi189 ceph-mon[32756]: pgmap v11773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:53 smithi156 ceph-mon[32679]: pgmap v11773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:53 smithi092 ceph-mon[29156]: pgmap v11773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:54.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21149.673899 secs 2024-04-27T00:10:54.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20452.643211 secs 2024-04-27T00:10:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21149.673899 secs 2024-04-27T00:10:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20452.643211 secs 2024-04-27T00:10:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21149.673899 secs 2024-04-27T00:10:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20452.643211 secs 2024-04-27T00:10:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:55 smithi189 ceph-mon[32756]: pgmap v11774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:55 smithi156 ceph-mon[32679]: pgmap v11774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:55 smithi092 ceph-mon[29156]: pgmap v11774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:57 smithi189 ceph-mon[32756]: pgmap v11775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:57 smithi156 ceph-mon[32679]: pgmap v11775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:57 smithi092 ceph-mon[29156]: pgmap v11775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:10:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:59 smithi189 ceph-mon[32756]: pgmap v11776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:10:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21154.674043 secs 2024-04-27T00:10:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:10:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20457.643334 secs 2024-04-27T00:10:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:59 smithi156 ceph-mon[32679]: pgmap v11776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:10:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21154.674043 secs 2024-04-27T00:10:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:10:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20457.643334 secs 2024-04-27T00:10:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:59 smithi092 ceph-mon[29156]: pgmap v11776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:10:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21154.674043 secs 2024-04-27T00:10:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:10:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20457.643334 secs 2024-04-27T00:11:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:01 smithi189 ceph-mon[32756]: pgmap v11777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:01 smithi156 ceph-mon[32679]: pgmap v11777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:01 smithi092 ceph-mon[29156]: pgmap v11777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:03.868 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:03 smithi092 ceph-mon[29156]: pgmap v11778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:03 smithi189 ceph-mon[32756]: pgmap v11778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:03 smithi156 ceph-mon[32679]: pgmap v11778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21159.674161 secs 2024-04-27T00:11:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20462.643466 secs 2024-04-27T00:11:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21159.674161 secs 2024-04-27T00:11:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20462.643466 secs 2024-04-27T00:11:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21159.674161 secs 2024-04-27T00:11:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20462.643466 secs 2024-04-27T00:11:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:05 smithi189 ceph-mon[32756]: pgmap v11779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:05 smithi156 ceph-mon[32679]: pgmap v11779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:05 smithi092 ceph-mon[29156]: pgmap v11779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:07 smithi189 ceph-mon[32756]: pgmap v11780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:07 smithi156 ceph-mon[32679]: pgmap v11780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:07 smithi092 ceph-mon[29156]: pgmap v11780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:09 smithi189 ceph-mon[32756]: pgmap v11781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21164.674226 secs 2024-04-27T00:11:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 20467.643586 secs 2024-04-27T00:11:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:09 smithi189 ceph-mon[32756]: slow request 1442.784100 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:11:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:09 smithi156 ceph-mon[32679]: pgmap v11781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21164.674226 secs 2024-04-27T00:11:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 20467.643586 secs 2024-04-27T00:11:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:09 smithi156 ceph-mon[32679]: slow request 1442.784100 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:11:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:09 smithi092 ceph-mon[29156]: pgmap v11781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21164.674226 secs 2024-04-27T00:11:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 20467.643586 secs 2024-04-27T00:11:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:09 smithi092 ceph-mon[29156]: slow request 1442.784100 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:11:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:11 smithi189 ceph-mon[32756]: pgmap v11782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:11 smithi156 ceph-mon[32679]: pgmap v11782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:11 smithi092 ceph-mon[29156]: pgmap v11782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:13.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:13 smithi189 ceph-mon[32756]: pgmap v11783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:13.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:13 smithi156 ceph-mon[32679]: pgmap v11783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:13 smithi092 ceph-mon[29156]: pgmap v11783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21169.674308 secs 2024-04-27T00:11:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20472.643645 secs 2024-04-27T00:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21169.674308 secs 2024-04-27T00:11:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20472.643645 secs 2024-04-27T00:11:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21169.674308 secs 2024-04-27T00:11:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20472.643645 secs 2024-04-27T00:11:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:15 smithi189 ceph-mon[32756]: pgmap v11784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:15.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:15 smithi156 ceph-mon[32679]: pgmap v11784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:15 smithi092 ceph-mon[29156]: pgmap v11784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:17 smithi189 ceph-mon[32756]: pgmap v11785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:17 smithi156 ceph-mon[32679]: pgmap v11785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:17 smithi092 ceph-mon[29156]: pgmap v11785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:19 smithi189 ceph-mon[32756]: pgmap v11786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21174.674440 secs 2024-04-27T00:11:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20477.643771 secs 2024-04-27T00:11:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:19 smithi156 ceph-mon[32679]: pgmap v11786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21174.674440 secs 2024-04-27T00:11:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20477.643771 secs 2024-04-27T00:11:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:19 smithi092 ceph-mon[29156]: pgmap v11786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21174.674440 secs 2024-04-27T00:11:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20477.643771 secs 2024-04-27T00:11:21.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:21 smithi189 ceph-mon[32756]: pgmap v11787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:21 smithi156 ceph-mon[32679]: pgmap v11787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:21 smithi092 ceph-mon[29156]: pgmap v11787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:23 smithi189 ceph-mon[32756]: pgmap v11788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:23 smithi156 ceph-mon[32679]: pgmap v11788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:23 smithi092 ceph-mon[29156]: pgmap v11788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21179.674578 secs 2024-04-27T00:11:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20482.643891 secs 2024-04-27T00:11:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21179.674578 secs 2024-04-27T00:11:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20482.643891 secs 2024-04-27T00:11:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21179.674578 secs 2024-04-27T00:11:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20482.643891 secs 2024-04-27T00:11:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:25 smithi189 ceph-mon[32756]: pgmap v11789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:25 smithi156 ceph-mon[32679]: pgmap v11789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:25 smithi092 ceph-mon[29156]: pgmap v11789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:27 smithi189 ceph-mon[32756]: pgmap v11790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:27.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:27 smithi156 ceph-mon[32679]: pgmap v11790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:27 smithi092 ceph-mon[29156]: pgmap v11790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:29 smithi189 ceph-mon[32756]: pgmap v11791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21184.674701 secs 2024-04-27T00:11:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20487.644021 secs 2024-04-27T00:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:29 smithi156 ceph-mon[32679]: pgmap v11791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21184.674701 secs 2024-04-27T00:11:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20487.644021 secs 2024-04-27T00:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:29 smithi092 ceph-mon[29156]: pgmap v11791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21184.674701 secs 2024-04-27T00:11:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20487.644021 secs 2024-04-27T00:11:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:31 smithi189 ceph-mon[32756]: pgmap v11792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:31 smithi156 ceph-mon[32679]: pgmap v11792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:31 smithi092 ceph-mon[29156]: pgmap v11792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:33 smithi156 ceph-mon[32679]: pgmap v11793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:33 smithi092 ceph-mon[29156]: pgmap v11793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:33 smithi189 ceph-mon[32756]: pgmap v11793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21189.674862 secs 2024-04-27T00:11:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20492.644155 secs 2024-04-27T00:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21189.674862 secs 2024-04-27T00:11:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20492.644155 secs 2024-04-27T00:11:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21189.674862 secs 2024-04-27T00:11:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20492.644155 secs 2024-04-27T00:11:35.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:35 smithi092 ceph-mon[29156]: pgmap v11794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:35 smithi156 ceph-mon[32679]: pgmap v11794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:35 smithi189 ceph-mon[32756]: pgmap v11794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:37 smithi156 ceph-mon[32679]: pgmap v11795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:37 smithi092 ceph-mon[29156]: pgmap v11795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:37 smithi189 ceph-mon[32756]: pgmap v11795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:39 smithi156 ceph-mon[32679]: pgmap v11796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21194.674987 secs 2024-04-27T00:11:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20497.644290 secs 2024-04-27T00:11:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:39 smithi092 ceph-mon[29156]: pgmap v11796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21194.674987 secs 2024-04-27T00:11:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20497.644290 secs 2024-04-27T00:11:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:39 smithi189 ceph-mon[32756]: pgmap v11796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21194.674987 secs 2024-04-27T00:11:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20497.644290 secs 2024-04-27T00:11:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:41 smithi156 ceph-mon[32679]: pgmap v11797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:41 smithi092 ceph-mon[29156]: pgmap v11797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:41 smithi189 ceph-mon[32756]: pgmap v11797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:43 smithi156 ceph-mon[32679]: pgmap v11798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:43 smithi092 ceph-mon[29156]: pgmap v11798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:43 smithi189 ceph-mon[32756]: pgmap v11798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21199.675127 secs 2024-04-27T00:11:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20502.644426 secs 2024-04-27T00:11:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21199.675127 secs 2024-04-27T00:11:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20502.644426 secs 2024-04-27T00:11:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21199.675127 secs 2024-04-27T00:11:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20502.644426 secs 2024-04-27T00:11:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:45 smithi156 ceph-mon[32679]: pgmap v11799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:45 smithi092 ceph-mon[29156]: pgmap v11799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:45 smithi189 ceph-mon[32756]: pgmap v11799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:11:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:47 smithi156 ceph-mon[32679]: pgmap v11800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:47 smithi092 ceph-mon[29156]: pgmap v11800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:47 smithi189 ceph-mon[32756]: pgmap v11800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:11:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:11:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: pgmap v11801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21204.675210 secs 2024-04-27T00:11:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: pgmap v11802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: pgmap v11803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:11:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20507.644533 secs 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: pgmap v11801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21204.675210 secs 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: pgmap v11802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:11:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: pgmap v11803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:11:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20507.644533 secs 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: pgmap v11801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21204.675210 secs 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: pgmap v11802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: pgmap v11803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:11:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20507.644533 secs 2024-04-27T00:11:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:51 smithi092 ceph-mon[29156]: pgmap v11804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:51 smithi189 ceph-mon[32756]: pgmap v11804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:51 smithi156 ceph-mon[32679]: pgmap v11804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:53 smithi092 ceph-mon[29156]: pgmap v11805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:11:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:53 smithi189 ceph-mon[32756]: pgmap v11805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:11:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:53 smithi156 ceph-mon[32679]: pgmap v11805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21209.675272 secs 2024-04-27T00:11:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20512.644605 secs 2024-04-27T00:11:55.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21209.675272 secs 2024-04-27T00:11:55.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20512.644605 secs 2024-04-27T00:11:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21209.675272 secs 2024-04-27T00:11:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20512.644605 secs 2024-04-27T00:11:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:55 smithi092 ceph-mon[29156]: pgmap v11806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:55 smithi189 ceph-mon[32756]: pgmap v11806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:55 smithi156 ceph-mon[32679]: pgmap v11806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:57 smithi092 ceph-mon[29156]: pgmap v11807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:57 smithi189 ceph-mon[32756]: pgmap v11807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:57 smithi156 ceph-mon[32679]: pgmap v11807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:11:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21214.675405 secs 2024-04-27T00:11:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:59 smithi092 ceph-mon[29156]: pgmap v11808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:11:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:11:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20517.644685 secs 2024-04-27T00:12:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21214.675405 secs 2024-04-27T00:12:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:59 smithi189 ceph-mon[32756]: pgmap v11808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:12:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:11:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20517.644685 secs 2024-04-27T00:12:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21214.675405 secs 2024-04-27T00:12:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:59 smithi156 ceph-mon[32679]: pgmap v11808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:12:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:11:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20517.644685 secs 2024-04-27T00:12:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:01 smithi092 ceph-mon[29156]: pgmap v11809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:01 smithi189 ceph-mon[32756]: pgmap v11809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:01 smithi156 ceph-mon[32679]: pgmap v11809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:03 smithi092 ceph-mon[29156]: pgmap v11810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:03 smithi189 ceph-mon[32756]: pgmap v11810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:03 smithi156 ceph-mon[32679]: pgmap v11810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 21219.675525 secs 2024-04-27T00:12:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:04 smithi092 ceph-mon[29156]: slow request 722.697602 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:12:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20522.644794 secs 2024-04-27T00:12:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 21219.675525 secs 2024-04-27T00:12:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:04 smithi189 ceph-mon[32756]: slow request 722.697602 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:12:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20522.644794 secs 2024-04-27T00:12:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 21219.675525 secs 2024-04-27T00:12:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:04 smithi156 ceph-mon[32679]: slow request 722.697602 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:12:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20522.644794 secs 2024-04-27T00:12:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:05 smithi092 ceph-mon[29156]: pgmap v11811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:05 smithi189 ceph-mon[32756]: pgmap v11811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:05 smithi156 ceph-mon[32679]: pgmap v11811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:07 smithi092 ceph-mon[29156]: pgmap v11812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:07 smithi189 ceph-mon[32756]: pgmap v11812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:07 smithi156 ceph-mon[32679]: pgmap v11812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21224.675656 secs 2024-04-27T00:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:09 smithi092 ceph-mon[29156]: pgmap v11813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20527.644880 secs 2024-04-27T00:12:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21224.675656 secs 2024-04-27T00:12:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:09 smithi189 ceph-mon[32756]: pgmap v11813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20527.644880 secs 2024-04-27T00:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21224.675656 secs 2024-04-27T00:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:09 smithi156 ceph-mon[32679]: pgmap v11813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20527.644880 secs 2024-04-27T00:12:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:11 smithi092 ceph-mon[29156]: pgmap v11814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:11 smithi189 ceph-mon[32756]: pgmap v11814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:11 smithi156 ceph-mon[32679]: pgmap v11814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:13 smithi092 ceph-mon[29156]: pgmap v11815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:13 smithi189 ceph-mon[32756]: pgmap v11815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:13 smithi156 ceph-mon[32679]: pgmap v11815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21229.675795 secs 2024-04-27T00:12:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20532.645001 secs 2024-04-27T00:12:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:15 smithi156 ceph-mon[32679]: pgmap v11816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21229.675795 secs 2024-04-27T00:12:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20532.645001 secs 2024-04-27T00:12:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:15 smithi092 ceph-mon[29156]: pgmap v11816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21229.675795 secs 2024-04-27T00:12:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20532.645001 secs 2024-04-27T00:12:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:15 smithi189 ceph-mon[32756]: pgmap v11816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:17 smithi092 ceph-mon[29156]: pgmap v11817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:17 smithi189 ceph-mon[32756]: pgmap v11817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:17 smithi156 ceph-mon[32679]: pgmap v11817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21234.675917 secs 2024-04-27T00:12:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:19 smithi092 ceph-mon[29156]: pgmap v11818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20537.645103 secs 2024-04-27T00:12:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21234.675917 secs 2024-04-27T00:12:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:19 smithi189 ceph-mon[32756]: pgmap v11818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20537.645103 secs 2024-04-27T00:12:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21234.675917 secs 2024-04-27T00:12:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:19 smithi156 ceph-mon[32679]: pgmap v11818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20537.645103 secs 2024-04-27T00:12:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:21 smithi189 ceph-mon[32756]: pgmap v11819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:21 smithi156 ceph-mon[32679]: pgmap v11819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:21 smithi092 ceph-mon[29156]: pgmap v11819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:23 smithi189 ceph-mon[32756]: pgmap v11820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:23 smithi156 ceph-mon[32679]: pgmap v11820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:23 smithi092 ceph-mon[29156]: pgmap v11820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:25.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21239.676050 secs 2024-04-27T00:12:25.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20542.645213 secs 2024-04-27T00:12:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21239.676050 secs 2024-04-27T00:12:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20542.645213 secs 2024-04-27T00:12:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21239.676050 secs 2024-04-27T00:12:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20542.645213 secs 2024-04-27T00:12:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:25 smithi189 ceph-mon[32756]: pgmap v11821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:25 smithi156 ceph-mon[32679]: pgmap v11821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:25 smithi092 ceph-mon[29156]: pgmap v11821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:27 smithi189 ceph-mon[32756]: pgmap v11822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:27 smithi156 ceph-mon[32679]: pgmap v11822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:27 smithi092 ceph-mon[29156]: pgmap v11822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21244.676172 secs 2024-04-27T00:12:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:29 smithi189 ceph-mon[32756]: pgmap v11823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20547.645310 secs 2024-04-27T00:12:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21244.676172 secs 2024-04-27T00:12:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:29 smithi156 ceph-mon[32679]: pgmap v11823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20547.645310 secs 2024-04-27T00:12:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21244.676172 secs 2024-04-27T00:12:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:29 smithi092 ceph-mon[29156]: pgmap v11823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20547.645310 secs 2024-04-27T00:12:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:31 smithi189 ceph-mon[32756]: pgmap v11824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:31 smithi156 ceph-mon[32679]: pgmap v11824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:31 smithi092 ceph-mon[29156]: pgmap v11824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:33 smithi189 ceph-mon[32756]: pgmap v11825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:33 smithi156 ceph-mon[32679]: pgmap v11825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:33 smithi092 ceph-mon[29156]: pgmap v11825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21249.676290 secs 2024-04-27T00:12:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20552.645426 secs 2024-04-27T00:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21249.676290 secs 2024-04-27T00:12:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20552.645426 secs 2024-04-27T00:12:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21249.676290 secs 2024-04-27T00:12:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20552.645426 secs 2024-04-27T00:12:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:35 smithi189 ceph-mon[32756]: pgmap v11826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:35 smithi156 ceph-mon[32679]: pgmap v11826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:35 smithi092 ceph-mon[29156]: pgmap v11826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:37 smithi092 ceph-mon[29156]: pgmap v11827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:37 smithi189 ceph-mon[32756]: pgmap v11827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:37 smithi156 ceph-mon[32679]: pgmap v11827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:38.895 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:12:38.895+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:12:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:12:38.895+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:12:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:12:38.895+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:12:38.896 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:12:38.895+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 165 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:12:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21254.676409 secs 2024-04-27T00:12:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:39 smithi189 ceph-mon[32756]: pgmap v11828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20557.645504 secs 2024-04-27T00:12:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21254.676409 secs 2024-04-27T00:12:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:39 smithi156 ceph-mon[32679]: pgmap v11828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20557.645504 secs 2024-04-27T00:12:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21254.676409 secs 2024-04-27T00:12:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:39 smithi092 ceph-mon[29156]: pgmap v11828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20557.645504 secs 2024-04-27T00:12:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:41 smithi189 ceph-mon[32756]: pgmap v11829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:41 smithi156 ceph-mon[32679]: pgmap v11829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:41 smithi092 ceph-mon[29156]: pgmap v11829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:43 smithi189 ceph-mon[32756]: pgmap v11830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:43 smithi156 ceph-mon[32679]: pgmap v11830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:43 smithi092 ceph-mon[29156]: pgmap v11830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21259.676530 secs 2024-04-27T00:12:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20562.645639 secs 2024-04-27T00:12:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21259.676530 secs 2024-04-27T00:12:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20562.645639 secs 2024-04-27T00:12:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21259.676530 secs 2024-04-27T00:12:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20562.645639 secs 2024-04-27T00:12:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:45 smithi189 ceph-mon[32756]: pgmap v11831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:45 smithi156 ceph-mon[32679]: pgmap v11831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:45 smithi092 ceph-mon[29156]: pgmap v11831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:47 smithi189 ceph-mon[32756]: pgmap v11832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:47 smithi156 ceph-mon[32679]: pgmap v11832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:47 smithi092 ceph-mon[29156]: pgmap v11832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:12:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:12:49.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:12:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21264.676630 secs 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: pgmap v11833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20567.645711 secs 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:12:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:12:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21264.676630 secs 2024-04-27T00:12:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: pgmap v11833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20567.645711 secs 2024-04-27T00:12:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:12:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:12:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21264.676630 secs 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: pgmap v11833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20567.645711 secs 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:12:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:12:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:50 smithi189 ceph-mon[32756]: pgmap v11834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:12:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:50 smithi189 ceph-mon[32756]: pgmap v11835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:50 smithi156 ceph-mon[32679]: pgmap v11834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:12:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:50 smithi156 ceph-mon[32679]: pgmap v11835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:50 smithi092 ceph-mon[29156]: pgmap v11834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:12:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:50 smithi092 ceph-mon[29156]: pgmap v11835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:52 smithi189 ceph-mon[32756]: pgmap v11836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:52 smithi156 ceph-mon[32679]: pgmap v11836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:52 smithi092 ceph-mon[29156]: pgmap v11836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:54 smithi189 ceph-mon[32756]: pgmap v11837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:12:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21269.676756 secs 2024-04-27T00:12:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20572.645812 secs 2024-04-27T00:12:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:54 smithi156 ceph-mon[32679]: pgmap v11837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:12:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21269.676756 secs 2024-04-27T00:12:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20572.645812 secs 2024-04-27T00:12:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:54 smithi092 ceph-mon[29156]: pgmap v11837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:12:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21269.676756 secs 2024-04-27T00:12:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20572.645812 secs 2024-04-27T00:12:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:56 smithi189 ceph-mon[32756]: pgmap v11838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:56 smithi156 ceph-mon[32679]: pgmap v11838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:56 smithi092 ceph-mon[29156]: pgmap v11838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:12:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:58 smithi189 ceph-mon[32756]: pgmap v11839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:12:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:58 smithi156 ceph-mon[32679]: pgmap v11839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:12:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:58 smithi092 ceph-mon[29156]: pgmap v11839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:13:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21274.676889 secs 2024-04-27T00:13:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:12:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20577.645945 secs 2024-04-27T00:13:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21274.676889 secs 2024-04-27T00:13:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:12:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20577.645945 secs 2024-04-27T00:13:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21274.676889 secs 2024-04-27T00:13:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:12:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20577.645945 secs 2024-04-27T00:13:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:00 smithi189 ceph-mon[32756]: pgmap v11840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:13:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:00 smithi156 ceph-mon[32679]: pgmap v11840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:13:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:00 smithi092 ceph-mon[29156]: pgmap v11840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:13:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:02 smithi189 ceph-mon[32756]: pgmap v11841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:02 smithi156 ceph-mon[32679]: pgmap v11841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:02 smithi092 ceph-mon[29156]: pgmap v11841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:04 smithi189 ceph-mon[32756]: pgmap v11842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21279.676990 secs 2024-04-27T00:13:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20582.646045 secs 2024-04-27T00:13:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:04 smithi156 ceph-mon[32679]: pgmap v11842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21279.676990 secs 2024-04-27T00:13:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20582.646045 secs 2024-04-27T00:13:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:04 smithi092 ceph-mon[29156]: pgmap v11842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21279.676990 secs 2024-04-27T00:13:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20582.646045 secs 2024-04-27T00:13:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:06 smithi189 ceph-mon[32756]: pgmap v11843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:06 smithi156 ceph-mon[32679]: pgmap v11843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:06 smithi092 ceph-mon[29156]: pgmap v11843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:09.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:08 smithi092 ceph-mon[29156]: pgmap v11844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:08 smithi189 ceph-mon[32756]: pgmap v11844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:08 smithi156 ceph-mon[32679]: pgmap v11844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21284.677074 secs 2024-04-27T00:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20587.646159 secs 2024-04-27T00:13:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:10 smithi156 ceph-mon[32679]: pgmap v11845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21284.677074 secs 2024-04-27T00:13:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20587.646159 secs 2024-04-27T00:13:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:10 smithi092 ceph-mon[29156]: pgmap v11845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21284.677074 secs 2024-04-27T00:13:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20587.646159 secs 2024-04-27T00:13:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:10 smithi189 ceph-mon[32756]: pgmap v11845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:12 smithi189 ceph-mon[32756]: pgmap v11846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:12 smithi156 ceph-mon[32679]: pgmap v11846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:12 smithi092 ceph-mon[29156]: pgmap v11846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:14 smithi189 ceph-mon[32756]: pgmap v11847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21289.677205 secs 2024-04-27T00:13:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20592.646288 secs 2024-04-27T00:13:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:14 smithi156 ceph-mon[32679]: pgmap v11847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21289.677205 secs 2024-04-27T00:13:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20592.646288 secs 2024-04-27T00:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:14 smithi092 ceph-mon[29156]: pgmap v11847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21289.677205 secs 2024-04-27T00:13:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20592.646288 secs 2024-04-27T00:13:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:16 smithi189 ceph-mon[32756]: pgmap v11848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:16 smithi156 ceph-mon[32679]: pgmap v11848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:16 smithi092 ceph-mon[29156]: pgmap v11848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:18 smithi189 ceph-mon[32756]: pgmap v11849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:18 smithi156 ceph-mon[32679]: pgmap v11849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:18 smithi092 ceph-mon[29156]: pgmap v11849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:13:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21294.677280 secs 2024-04-27T00:13:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20597.646428 secs 2024-04-27T00:13:19.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21294.677280 secs 2024-04-27T00:13:19.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20597.646428 secs 2024-04-27T00:13:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21294.677280 secs 2024-04-27T00:13:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20597.646428 secs 2024-04-27T00:13:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:20 smithi189 ceph-mon[32756]: pgmap v11850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:20 smithi156 ceph-mon[32679]: pgmap v11850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:20 smithi092 ceph-mon[29156]: pgmap v11850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:13:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:22 smithi189 ceph-mon[32756]: pgmap v11851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:22 smithi156 ceph-mon[32679]: pgmap v11851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:22 smithi092 ceph-mon[29156]: pgmap v11851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:13:23.902+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:13:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:13:23.902+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:13:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:13:23.903+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:13:23.902 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:13:23.903+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 166 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:13:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:24 smithi189 ceph-mon[32756]: pgmap v11852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21299.677403 secs 2024-04-27T00:13:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20602.646547 secs 2024-04-27T00:13:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:24 smithi156 ceph-mon[32679]: pgmap v11852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21299.677403 secs 2024-04-27T00:13:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20602.646547 secs 2024-04-27T00:13:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:24 smithi092 ceph-mon[29156]: pgmap v11852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21299.677403 secs 2024-04-27T00:13:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20602.646547 secs 2024-04-27T00:13:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:26 smithi189 ceph-mon[32756]: pgmap v11853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:26 smithi156 ceph-mon[32679]: pgmap v11853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:26 smithi092 ceph-mon[29156]: pgmap v11853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:28 smithi189 ceph-mon[32756]: pgmap v11854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:28 smithi156 ceph-mon[32679]: pgmap v11854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:28 smithi092 ceph-mon[29156]: pgmap v11854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21304.677546 secs 2024-04-27T00:13:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20607.646677 secs 2024-04-27T00:13:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21304.677546 secs 2024-04-27T00:13:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20607.646677 secs 2024-04-27T00:13:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21304.677546 secs 2024-04-27T00:13:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20607.646677 secs 2024-04-27T00:13:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:30 smithi189 ceph-mon[32756]: pgmap v11855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:30 smithi156 ceph-mon[32679]: pgmap v11855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:30 smithi092 ceph-mon[29156]: pgmap v11855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:32.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:32 smithi189 ceph-mon[32756]: pgmap v11856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:32 smithi156 ceph-mon[32679]: pgmap v11856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:32 smithi092 ceph-mon[29156]: pgmap v11856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:34 smithi189 ceph-mon[32756]: pgmap v11857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21309.677676 secs 2024-04-27T00:13:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20612.646792 secs 2024-04-27T00:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:34 smithi156 ceph-mon[32679]: pgmap v11857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21309.677676 secs 2024-04-27T00:13:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20612.646792 secs 2024-04-27T00:13:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:34 smithi092 ceph-mon[29156]: pgmap v11857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21309.677676 secs 2024-04-27T00:13:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20612.646792 secs 2024-04-27T00:13:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-mon[29156]: pgmap v11858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:36.743 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:13:36.405+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:13:36.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:13:36.405+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:13:36.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:13:36.405+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:13:36.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:13:36.405+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:13:36.744 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:13:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:13:36.405+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:13:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:36 smithi189 ceph-mon[32756]: pgmap v11858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:36 smithi156 ceph-mon[32679]: pgmap v11858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:13:38.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:38 smithi189 ceph-mon[32756]: pgmap v11859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:38 smithi156 ceph-mon[32679]: pgmap v11859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:38 smithi092 ceph-mon[29156]: pgmap v11859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:13:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21314.677803 secs 2024-04-27T00:13:39.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20617.646885 secs 2024-04-27T00:13:39.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21314.677803 secs 2024-04-27T00:13:39.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20617.646885 secs 2024-04-27T00:13:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21314.677803 secs 2024-04-27T00:13:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20617.646885 secs 2024-04-27T00:13:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:40 smithi189 ceph-mon[32756]: pgmap v11860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:40 smithi156 ceph-mon[32679]: pgmap v11860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:40 smithi092 ceph-mon[29156]: pgmap v11860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:42.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:42 smithi189 ceph-mon[32756]: pgmap v11861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:42 smithi156 ceph-mon[32679]: pgmap v11861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:42 smithi092 ceph-mon[29156]: pgmap v11861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:44 smithi189 ceph-mon[32756]: pgmap v11862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21319.677931 secs 2024-04-27T00:13:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20622.647017 secs 2024-04-27T00:13:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:44 smithi156 ceph-mon[32679]: pgmap v11862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21319.677931 secs 2024-04-27T00:13:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20622.647017 secs 2024-04-27T00:13:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:44 smithi092 ceph-mon[29156]: pgmap v11862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21319.677931 secs 2024-04-27T00:13:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20622.647017 secs 2024-04-27T00:13:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:46 smithi189 ceph-mon[32756]: pgmap v11863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:46 smithi156 ceph-mon[32679]: pgmap v11863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:46 smithi092 ceph-mon[29156]: pgmap v11863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:48 smithi189 ceph-mon[32756]: pgmap v11864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:48 smithi156 ceph-mon[32679]: pgmap v11864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:48 smithi092 ceph-mon[29156]: pgmap v11864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:13:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21324.677997 secs 2024-04-27T00:13:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20627.647108 secs 2024-04-27T00:13:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:13:49.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21324.677997 secs 2024-04-27T00:13:49.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20627.647108 secs 2024-04-27T00:13:49.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:13:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21324.677997 secs 2024-04-27T00:13:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20627.647108 secs 2024-04-27T00:13:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:13:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:50 smithi189 ceph-mon[32756]: pgmap v11865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:13:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:13:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:13:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:50 smithi156 ceph-mon[32679]: pgmap v11865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:13:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:13:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:13:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:50 smithi092 ceph-mon[29156]: pgmap v11865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:13:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:13:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:13:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:13:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:51 smithi189 ceph-mon[32756]: pgmap v11866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:13:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:51 smithi189 ceph-mon[32756]: pgmap v11867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:51 smithi156 ceph-mon[32679]: pgmap v11866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:13:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:51 smithi156 ceph-mon[32679]: pgmap v11867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:51 smithi092 ceph-mon[29156]: pgmap v11866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:13:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:51 smithi092 ceph-mon[29156]: pgmap v11867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:53 smithi189 ceph-mon[32756]: pgmap v11868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:53 smithi156 ceph-mon[32679]: pgmap v11868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:53 smithi092 ceph-mon[29156]: pgmap v11868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:54.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21329.678079 secs 2024-04-27T00:13:54.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20632.647228 secs 2024-04-27T00:13:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21329.678079 secs 2024-04-27T00:13:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20632.647228 secs 2024-04-27T00:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21329.678079 secs 2024-04-27T00:13:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20632.647228 secs 2024-04-27T00:13:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:55 smithi189 ceph-mon[32756]: pgmap v11869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:55 smithi156 ceph-mon[32679]: pgmap v11869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:55 smithi092 ceph-mon[29156]: pgmap v11869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:57 smithi189 ceph-mon[32756]: pgmap v11870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:57 smithi156 ceph-mon[32679]: pgmap v11870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:57 smithi092 ceph-mon[29156]: pgmap v11870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:13:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:59 smithi189 ceph-mon[32756]: pgmap v11871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21334.678196 secs 2024-04-27T00:13:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:13:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20637.647370 secs 2024-04-27T00:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:59 smithi156 ceph-mon[32679]: pgmap v11871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21334.678196 secs 2024-04-27T00:13:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:13:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20637.647370 secs 2024-04-27T00:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:59 smithi092 ceph-mon[29156]: pgmap v11871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21334.678196 secs 2024-04-27T00:13:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:13:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20637.647370 secs 2024-04-27T00:14:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:01 smithi189 ceph-mon[32756]: pgmap v11872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:14:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:01 smithi156 ceph-mon[32679]: pgmap v11872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:14:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:01 smithi092 ceph-mon[29156]: pgmap v11872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:14:03.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:03 smithi189 ceph-mon[32756]: pgmap v11873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:03 smithi156 ceph-mon[32679]: pgmap v11873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:03 smithi092 ceph-mon[29156]: pgmap v11873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21339.678306 secs 2024-04-27T00:14:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20642.647489 secs 2024-04-27T00:14:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21339.678306 secs 2024-04-27T00:14:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20642.647489 secs 2024-04-27T00:14:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21339.678306 secs 2024-04-27T00:14:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20642.647489 secs 2024-04-27T00:14:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:05 smithi189 ceph-mon[32756]: pgmap v11874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:05 smithi156 ceph-mon[32679]: pgmap v11874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:05 smithi092 ceph-mon[29156]: pgmap v11874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:07 smithi156 ceph-mon[32679]: pgmap v11875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:07 smithi092 ceph-mon[29156]: pgmap v11875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:07 smithi189 ceph-mon[32756]: pgmap v11875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:09 smithi156 ceph-mon[32679]: pgmap v11876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21344.678441 secs 2024-04-27T00:14:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20647.647627 secs 2024-04-27T00:14:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:09 smithi092 ceph-mon[29156]: pgmap v11876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21344.678441 secs 2024-04-27T00:14:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20647.647627 secs 2024-04-27T00:14:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:09 smithi189 ceph-mon[32756]: pgmap v11876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21344.678441 secs 2024-04-27T00:14:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20647.647627 secs 2024-04-27T00:14:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:11 smithi156 ceph-mon[32679]: pgmap v11877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:11 smithi092 ceph-mon[29156]: pgmap v11877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:11 smithi189 ceph-mon[32756]: pgmap v11877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:13 smithi156 ceph-mon[32679]: pgmap v11878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:13 smithi092 ceph-mon[29156]: pgmap v11878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:13 smithi189 ceph-mon[32756]: pgmap v11878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21349.678564 secs 2024-04-27T00:14:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20652.647701 secs 2024-04-27T00:14:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21349.678564 secs 2024-04-27T00:14:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20652.647701 secs 2024-04-27T00:14:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21349.678564 secs 2024-04-27T00:14:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20652.647701 secs 2024-04-27T00:14:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:15 smithi156 ceph-mon[32679]: pgmap v11879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:15 smithi092 ceph-mon[29156]: pgmap v11879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:15 smithi189 ceph-mon[32756]: pgmap v11879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:17 smithi156 ceph-mon[32679]: pgmap v11880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:17 smithi092 ceph-mon[29156]: pgmap v11880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:17 smithi189 ceph-mon[32756]: pgmap v11880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:19 smithi156 ceph-mon[32679]: pgmap v11881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21354.678681 secs 2024-04-27T00:14:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20657.647776 secs 2024-04-27T00:14:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:19 smithi092 ceph-mon[29156]: pgmap v11881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21354.678681 secs 2024-04-27T00:14:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20657.647776 secs 2024-04-27T00:14:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:19 smithi189 ceph-mon[32756]: pgmap v11881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21354.678681 secs 2024-04-27T00:14:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20657.647776 secs 2024-04-27T00:14:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:21 smithi156 ceph-mon[32679]: pgmap v11882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:21 smithi092 ceph-mon[29156]: pgmap v11882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:21 smithi189 ceph-mon[32756]: pgmap v11882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:23 smithi156 ceph-mon[32679]: pgmap v11883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:23.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:23 smithi092 ceph-mon[29156]: pgmap v11883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:23 smithi189 ceph-mon[32756]: pgmap v11883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21359.678818 secs 2024-04-27T00:14:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20662.647937 secs 2024-04-27T00:14:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21359.678818 secs 2024-04-27T00:14:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20662.647937 secs 2024-04-27T00:14:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21359.678818 secs 2024-04-27T00:14:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20662.647937 secs 2024-04-27T00:14:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:25 smithi156 ceph-mon[32679]: pgmap v11884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:25 smithi092 ceph-mon[29156]: pgmap v11884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:25 smithi189 ceph-mon[32756]: pgmap v11884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:27 smithi156 ceph-mon[32679]: pgmap v11885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:27 smithi092 ceph-mon[29156]: pgmap v11885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:27 smithi189 ceph-mon[32756]: pgmap v11885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:29 smithi156 ceph-mon[32679]: pgmap v11886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21364.678927 secs 2024-04-27T00:14:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20667.648011 secs 2024-04-27T00:14:29.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:29 smithi189 ceph-mon[32756]: pgmap v11886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:29.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21364.678927 secs 2024-04-27T00:14:29.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20667.648011 secs 2024-04-27T00:14:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:29 smithi092 ceph-mon[29156]: pgmap v11886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21364.678927 secs 2024-04-27T00:14:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20667.648011 secs 2024-04-27T00:14:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:31 smithi156 ceph-mon[32679]: pgmap v11887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:31 smithi092 ceph-mon[29156]: pgmap v11887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:31 smithi189 ceph-mon[32756]: pgmap v11887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:33 smithi092 ceph-mon[29156]: pgmap v11888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:33 smithi189 ceph-mon[32756]: pgmap v11888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:33 smithi156 ceph-mon[32679]: pgmap v11888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21369.679007 secs 2024-04-27T00:14:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20672.648164 secs 2024-04-27T00:14:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21369.679007 secs 2024-04-27T00:14:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20672.648164 secs 2024-04-27T00:14:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21369.679007 secs 2024-04-27T00:14:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20672.648164 secs 2024-04-27T00:14:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:35 smithi092 ceph-mon[29156]: pgmap v11889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:35 smithi189 ceph-mon[32756]: pgmap v11889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:35 smithi156 ceph-mon[32679]: pgmap v11889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:14:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:37 smithi092 ceph-mon[29156]: pgmap v11890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:37 smithi189 ceph-mon[32756]: pgmap v11890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:37 smithi156 ceph-mon[32679]: pgmap v11890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:39 smithi092 ceph-mon[29156]: pgmap v11891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21374.679070 secs 2024-04-27T00:14:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20677.648271 secs 2024-04-27T00:14:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:39 smithi189 ceph-mon[32756]: pgmap v11891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21374.679070 secs 2024-04-27T00:14:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20677.648271 secs 2024-04-27T00:14:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:39 smithi156 ceph-mon[32679]: pgmap v11891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:14:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21374.679070 secs 2024-04-27T00:14:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20677.648271 secs 2024-04-27T00:14:41.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:41 smithi092 ceph-mon[29156]: pgmap v11892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:41 smithi189 ceph-mon[32756]: pgmap v11892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:42.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:41 smithi156 ceph-mon[32679]: pgmap v11892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:43 smithi092 ceph-mon[29156]: pgmap v11893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:43 smithi189 ceph-mon[32756]: pgmap v11893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:43 smithi156 ceph-mon[32679]: pgmap v11893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21379.679673 secs 2024-04-27T00:14:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20682.648408 secs 2024-04-27T00:14:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21379.679673 secs 2024-04-27T00:14:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20682.648408 secs 2024-04-27T00:14:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21379.679673 secs 2024-04-27T00:14:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20682.648408 secs 2024-04-27T00:14:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:45 smithi092 ceph-mon[29156]: pgmap v11894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:45 smithi189 ceph-mon[32756]: pgmap v11894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:45 smithi156 ceph-mon[32679]: pgmap v11894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:47 smithi092 ceph-mon[29156]: pgmap v11895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:47 smithi189 ceph-mon[32756]: pgmap v11895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:47 smithi156 ceph-mon[32679]: pgmap v11895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:49 smithi092 ceph-mon[29156]: pgmap v11896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21384.679819 secs 2024-04-27T00:14:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20687.648499 secs 2024-04-27T00:14:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:49 smithi189 ceph-mon[32756]: pgmap v11896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21384.679819 secs 2024-04-27T00:14:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20687.648499 secs 2024-04-27T00:14:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:49 smithi156 ceph-mon[32679]: pgmap v11896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T00:14:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21384.679819 secs 2024-04-27T00:14:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20687.648499 secs 2024-04-27T00:14:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:14:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:14:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:14:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:51 smithi092 ceph-mon[29156]: pgmap v11897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:14:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:14:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:14:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:51 smithi189 ceph-mon[32756]: pgmap v11897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:14:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:14:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:14:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:51 smithi156 ceph-mon[32679]: pgmap v11897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:14:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:14:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:14:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:52 smithi092 ceph-mon[29156]: pgmap v11898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:14:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:52 smithi092 ceph-mon[29156]: pgmap v11899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:52 smithi189 ceph-mon[32756]: pgmap v11898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:14:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:52 smithi189 ceph-mon[32756]: pgmap v11899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:52 smithi156 ceph-mon[32679]: pgmap v11898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:14:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:52 smithi156 ceph-mon[32679]: pgmap v11899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:54 smithi092 ceph-mon[29156]: pgmap v11900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21389.679972 secs 2024-04-27T00:14:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20692.648632 secs 2024-04-27T00:14:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:54 smithi189 ceph-mon[32756]: pgmap v11900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:14:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21389.679972 secs 2024-04-27T00:14:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20692.648632 secs 2024-04-27T00:14:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:54 smithi156 ceph-mon[32679]: pgmap v11900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:14:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21389.679972 secs 2024-04-27T00:14:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20692.648632 secs 2024-04-27T00:14:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:56 smithi092 ceph-mon[29156]: pgmap v11901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:56 smithi189 ceph-mon[32756]: pgmap v11901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:56 smithi156 ceph-mon[32679]: pgmap v11901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:58 smithi092 ceph-mon[29156]: pgmap v11902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:58 smithi189 ceph-mon[32756]: pgmap v11902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:14:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:58 smithi156 ceph-mon[32679]: pgmap v11902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21394.680110 secs 2024-04-27T00:15:00.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:14:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20697.648768 secs 2024-04-27T00:15:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21394.680110 secs 2024-04-27T00:15:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:14:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20697.648768 secs 2024-04-27T00:15:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21394.680110 secs 2024-04-27T00:15:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:14:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20697.648768 secs 2024-04-27T00:15:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:00 smithi189 ceph-mon[32756]: pgmap v11903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:00 smithi156 ceph-mon[32679]: pgmap v11903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:00 smithi092 ceph-mon[29156]: pgmap v11903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:02 smithi189 ceph-mon[32756]: pgmap v11904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:15:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:02 smithi156 ceph-mon[32679]: pgmap v11904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:15:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:02 smithi092 ceph-mon[29156]: pgmap v11904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:15:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:04 smithi189 ceph-mon[32756]: pgmap v11905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21399.680251 secs 2024-04-27T00:15:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20702.648875 secs 2024-04-27T00:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:04 smithi156 ceph-mon[32679]: pgmap v11905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21399.680251 secs 2024-04-27T00:15:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20702.648875 secs 2024-04-27T00:15:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:04 smithi092 ceph-mon[29156]: pgmap v11905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21399.680251 secs 2024-04-27T00:15:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20702.648875 secs 2024-04-27T00:15:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:06 smithi189 ceph-mon[32756]: pgmap v11906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:06 smithi156 ceph-mon[32679]: pgmap v11906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:06 smithi092 ceph-mon[29156]: pgmap v11906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:08 smithi189 ceph-mon[32756]: pgmap v11907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:08 smithi156 ceph-mon[32679]: pgmap v11907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:08 smithi092 ceph-mon[29156]: pgmap v11907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:09 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 21404.680388 secs 2024-04-27T00:15:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:09 smithi189 ceph-mon[32756]: slow request 722.367098 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:15:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20707.649002 secs 2024-04-27T00:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:09 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 21404.680388 secs 2024-04-27T00:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:09 smithi156 ceph-mon[32679]: slow request 722.367098 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:15:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20707.649002 secs 2024-04-27T00:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:09 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 21404.680388 secs 2024-04-27T00:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:09 smithi092 ceph-mon[29156]: slow request 722.367098 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20707.649002 secs 2024-04-27T00:15:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:10 smithi189 ceph-mon[32756]: pgmap v11908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:10 smithi156 ceph-mon[32679]: pgmap v11908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:10 smithi092 ceph-mon[29156]: pgmap v11908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:12 smithi189 ceph-mon[32756]: pgmap v11909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:12 smithi156 ceph-mon[32679]: pgmap v11909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:12 smithi092 ceph-mon[29156]: pgmap v11909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:14 smithi189 ceph-mon[32756]: pgmap v11910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21409.680505 secs 2024-04-27T00:15:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20712.649126 secs 2024-04-27T00:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:14 smithi156 ceph-mon[32679]: pgmap v11910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21409.680505 secs 2024-04-27T00:15:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20712.649126 secs 2024-04-27T00:15:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:14 smithi092 ceph-mon[29156]: pgmap v11910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21409.680505 secs 2024-04-27T00:15:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20712.649126 secs 2024-04-27T00:15:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:16 smithi189 ceph-mon[32756]: pgmap v11911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:16 smithi156 ceph-mon[32679]: pgmap v11911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:16 smithi092 ceph-mon[29156]: pgmap v11911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:19.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:18 smithi092 ceph-mon[29156]: pgmap v11912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:18 smithi189 ceph-mon[32756]: pgmap v11912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:18 smithi156 ceph-mon[32679]: pgmap v11912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21414.680640 secs 2024-04-27T00:15:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20717.649186 secs 2024-04-27T00:15:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21414.680640 secs 2024-04-27T00:15:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20717.649186 secs 2024-04-27T00:15:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21414.680640 secs 2024-04-27T00:15:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20717.649186 secs 2024-04-27T00:15:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:20 smithi189 ceph-mon[32756]: pgmap v11913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:20 smithi156 ceph-mon[32679]: pgmap v11913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:20 smithi092 ceph-mon[29156]: pgmap v11913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:22 smithi189 ceph-mon[32756]: pgmap v11914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:22 smithi156 ceph-mon[32679]: pgmap v11914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:22 smithi092 ceph-mon[29156]: pgmap v11914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:24 smithi189 ceph-mon[32756]: pgmap v11915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21419.680771 secs 2024-04-27T00:15:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20722.649304 secs 2024-04-27T00:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:24 smithi156 ceph-mon[32679]: pgmap v11915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21419.680771 secs 2024-04-27T00:15:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20722.649304 secs 2024-04-27T00:15:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:24 smithi092 ceph-mon[29156]: pgmap v11915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21419.680771 secs 2024-04-27T00:15:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20722.649304 secs 2024-04-27T00:15:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:26 smithi189 ceph-mon[32756]: pgmap v11916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:26 smithi156 ceph-mon[32679]: pgmap v11916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:26 smithi092 ceph-mon[29156]: pgmap v11916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:28 smithi092 ceph-mon[29156]: pgmap v11917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:28 smithi189 ceph-mon[32756]: pgmap v11917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:28 smithi156 ceph-mon[32679]: pgmap v11917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21424.680907 secs 2024-04-27T00:15:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20727.649424 secs 2024-04-27T00:15:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21424.680907 secs 2024-04-27T00:15:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20727.649424 secs 2024-04-27T00:15:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21424.680907 secs 2024-04-27T00:15:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20727.649424 secs 2024-04-27T00:15:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:30 smithi189 ceph-mon[32756]: pgmap v11918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:30 smithi156 ceph-mon[32679]: pgmap v11918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:30 smithi092 ceph-mon[29156]: pgmap v11918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:32 smithi189 ceph-mon[32756]: pgmap v11919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:32 smithi156 ceph-mon[32679]: pgmap v11919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:32 smithi092 ceph-mon[29156]: pgmap v11919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:34 smithi189 ceph-mon[32756]: pgmap v11920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21429.681045 secs 2024-04-27T00:15:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20732.649539 secs 2024-04-27T00:15:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:34 smithi156 ceph-mon[32679]: pgmap v11920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21429.681045 secs 2024-04-27T00:15:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20732.649539 secs 2024-04-27T00:15:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:34 smithi092 ceph-mon[29156]: pgmap v11920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21429.681045 secs 2024-04-27T00:15:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20732.649539 secs 2024-04-27T00:15:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:36 smithi189 ceph-mon[32756]: pgmap v11921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:36 smithi156 ceph-mon[32679]: pgmap v11921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:36 smithi092 ceph-mon[29156]: pgmap v11921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:15:38.920+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:15:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:15:38.920+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:15:38.920 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:15:38.920+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:15:38.921 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:15:38.920+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 167 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:15:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:38 smithi189 ceph-mon[32756]: pgmap v11922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:38 smithi156 ceph-mon[32679]: pgmap v11922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:38 smithi092 ceph-mon[29156]: pgmap v11922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21434.681161 secs 2024-04-27T00:15:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20737.649656 secs 2024-04-27T00:15:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21434.681161 secs 2024-04-27T00:15:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20737.649656 secs 2024-04-27T00:15:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21434.681161 secs 2024-04-27T00:15:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20737.649656 secs 2024-04-27T00:15:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:40 smithi189 ceph-mon[32756]: pgmap v11923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:40 smithi156 ceph-mon[32679]: pgmap v11923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:40 smithi092 ceph-mon[29156]: pgmap v11923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:42 smithi189 ceph-mon[32756]: pgmap v11924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:42 smithi156 ceph-mon[32679]: pgmap v11924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:42 smithi092 ceph-mon[29156]: pgmap v11924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:44 smithi189 ceph-mon[32756]: pgmap v11925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21439.681234 secs 2024-04-27T00:15:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20742.649773 secs 2024-04-27T00:15:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:44 smithi156 ceph-mon[32679]: pgmap v11925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21439.681234 secs 2024-04-27T00:15:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20742.649773 secs 2024-04-27T00:15:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:44 smithi092 ceph-mon[29156]: pgmap v11925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21439.681234 secs 2024-04-27T00:15:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20742.649773 secs 2024-04-27T00:15:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:46 smithi189 ceph-mon[32756]: pgmap v11926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:46 smithi156 ceph-mon[32679]: pgmap v11926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:46 smithi092 ceph-mon[29156]: pgmap v11926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:48 smithi189 ceph-mon[32756]: pgmap v11927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:48 smithi156 ceph-mon[32679]: pgmap v11927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:48 smithi092 ceph-mon[29156]: pgmap v11927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21444.681369 secs 2024-04-27T00:15:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20747.649899 secs 2024-04-27T00:15:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21444.681369 secs 2024-04-27T00:15:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20747.649899 secs 2024-04-27T00:15:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21444.681369 secs 2024-04-27T00:15:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20747.649899 secs 2024-04-27T00:15:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:50 smithi189 ceph-mon[32756]: pgmap v11928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:50 smithi156 ceph-mon[32679]: pgmap v11928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:50 smithi092 ceph-mon[29156]: pgmap v11928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:15:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:15:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:15:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:15:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:15:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:15:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:15:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:15:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:15:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:15:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:15:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:15:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:15:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:52 smithi189 ceph-mon[32756]: pgmap v11929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:52 smithi189 ceph-mon[32756]: pgmap v11930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:15:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:52 smithi189 ceph-mon[32756]: pgmap v11931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:52 smithi156 ceph-mon[32679]: pgmap v11929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:52 smithi156 ceph-mon[32679]: pgmap v11930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:15:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:52 smithi156 ceph-mon[32679]: pgmap v11931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:52 smithi092 ceph-mon[29156]: pgmap v11929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:15:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:52 smithi092 ceph-mon[29156]: pgmap v11930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:15:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:52 smithi092 ceph-mon[29156]: pgmap v11931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21449.681508 secs 2024-04-27T00:15:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20752.650018 secs 2024-04-27T00:15:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:54 smithi189 ceph-mon[32756]: pgmap v11932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21449.681508 secs 2024-04-27T00:15:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20752.650018 secs 2024-04-27T00:15:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:54 smithi156 ceph-mon[32679]: pgmap v11932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21449.681508 secs 2024-04-27T00:15:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20752.650018 secs 2024-04-27T00:15:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:54 smithi092 ceph-mon[29156]: pgmap v11932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:56 smithi189 ceph-mon[32756]: pgmap v11933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:56 smithi156 ceph-mon[32679]: pgmap v11933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:56 smithi092 ceph-mon[29156]: pgmap v11933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:15:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:58 smithi189 ceph-mon[32756]: pgmap v11934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:15:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:58 smithi156 ceph-mon[32679]: pgmap v11934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:15:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:58 smithi092 ceph-mon[29156]: pgmap v11934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:16:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21454.681643 secs 2024-04-27T00:16:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:15:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20757.650084 secs 2024-04-27T00:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21454.681643 secs 2024-04-27T00:16:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:15:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20757.650084 secs 2024-04-27T00:16:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21454.681643 secs 2024-04-27T00:16:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:15:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20757.650084 secs 2024-04-27T00:16:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:00 smithi156 ceph-mon[32679]: pgmap v11935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:00 smithi092 ceph-mon[29156]: pgmap v11935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:00 smithi189 ceph-mon[32756]: pgmap v11935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:02 smithi156 ceph-mon[32679]: pgmap v11936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:16:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:02 smithi092 ceph-mon[29156]: pgmap v11936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:16:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:02 smithi189 ceph-mon[32756]: pgmap v11936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21459.681704 secs 2024-04-27T00:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20762.650178 secs 2024-04-27T00:16:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:04 smithi156 ceph-mon[32679]: pgmap v11937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21459.681704 secs 2024-04-27T00:16:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20762.650178 secs 2024-04-27T00:16:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:04 smithi092 ceph-mon[29156]: pgmap v11937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21459.681704 secs 2024-04-27T00:16:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20762.650178 secs 2024-04-27T00:16:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:04 smithi189 ceph-mon[32756]: pgmap v11937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:06 smithi156 ceph-mon[32679]: pgmap v11938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:06 smithi092 ceph-mon[29156]: pgmap v11938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:06 smithi189 ceph-mon[32756]: pgmap v11938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:08 smithi156 ceph-mon[32679]: pgmap v11939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:08 smithi092 ceph-mon[29156]: pgmap v11939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:08 smithi189 ceph-mon[32756]: pgmap v11939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21464.681850 secs 2024-04-27T00:16:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20767.650316 secs 2024-04-27T00:16:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21464.681850 secs 2024-04-27T00:16:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20767.650316 secs 2024-04-27T00:16:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21464.681850 secs 2024-04-27T00:16:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20767.650316 secs 2024-04-27T00:16:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:10 smithi156 ceph-mon[32679]: pgmap v11940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:10 smithi092 ceph-mon[29156]: pgmap v11940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:10 smithi189 ceph-mon[32756]: pgmap v11940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:12 smithi156 ceph-mon[32679]: pgmap v11941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:12 smithi092 ceph-mon[29156]: pgmap v11941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:12 smithi189 ceph-mon[32756]: pgmap v11941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21469.681969 secs 2024-04-27T00:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20772.650437 secs 2024-04-27T00:16:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:14 smithi156 ceph-mon[32679]: pgmap v11942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21469.681969 secs 2024-04-27T00:16:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20772.650437 secs 2024-04-27T00:16:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:14 smithi092 ceph-mon[29156]: pgmap v11942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21469.681969 secs 2024-04-27T00:16:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20772.650437 secs 2024-04-27T00:16:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:14 smithi189 ceph-mon[32756]: pgmap v11942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:16 smithi156 ceph-mon[32679]: pgmap v11943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:16 smithi092 ceph-mon[29156]: pgmap v11943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:16 smithi189 ceph-mon[32756]: pgmap v11943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:18 smithi156 ceph-mon[32679]: pgmap v11944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:18 smithi092 ceph-mon[29156]: pgmap v11944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:18 smithi189 ceph-mon[32756]: pgmap v11944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21474.682048 secs 2024-04-27T00:16:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20777.650556 secs 2024-04-27T00:16:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21474.682048 secs 2024-04-27T00:16:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20777.650556 secs 2024-04-27T00:16:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21474.682048 secs 2024-04-27T00:16:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20777.650556 secs 2024-04-27T00:16:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:20 smithi156 ceph-mon[32679]: pgmap v11945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:20 smithi092 ceph-mon[29156]: pgmap v11945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:20 smithi189 ceph-mon[32756]: pgmap v11945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:21 smithi092 ceph-mon[29156]: pgmap v11946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:21 smithi189 ceph-mon[32756]: pgmap v11946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:21 smithi156 ceph-mon[32679]: pgmap v11946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21479.682183 secs 2024-04-27T00:16:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20782.650674 secs 2024-04-27T00:16:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:24 smithi189 ceph-mon[32756]: pgmap v11947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21479.682183 secs 2024-04-27T00:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20782.650674 secs 2024-04-27T00:16:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:24 smithi156 ceph-mon[32679]: pgmap v11947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21479.682183 secs 2024-04-27T00:16:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20782.650674 secs 2024-04-27T00:16:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:24 smithi092 ceph-mon[29156]: pgmap v11947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:26 smithi189 ceph-mon[32756]: pgmap v11948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:26 smithi156 ceph-mon[32679]: pgmap v11948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:26 smithi092 ceph-mon[29156]: pgmap v11948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:28 smithi189 ceph-mon[32756]: pgmap v11949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:28 smithi156 ceph-mon[32679]: pgmap v11949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:28 smithi092 ceph-mon[29156]: pgmap v11949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21484.682300 secs 2024-04-27T00:16:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20787.650804 secs 2024-04-27T00:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21484.682300 secs 2024-04-27T00:16:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20787.650804 secs 2024-04-27T00:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21484.682300 secs 2024-04-27T00:16:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20787.650804 secs 2024-04-27T00:16:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:30 smithi189 ceph-mon[32756]: pgmap v11950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:30 smithi156 ceph-mon[32679]: pgmap v11950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:30 smithi092 ceph-mon[29156]: pgmap v11950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:32 smithi189 ceph-mon[32756]: pgmap v11951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:32 smithi156 ceph-mon[32679]: pgmap v11951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:32 smithi092 ceph-mon[29156]: pgmap v11951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21489.682438 secs 2024-04-27T00:16:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 20792.650916 secs 2024-04-27T00:16:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:34 smithi189 ceph-mon[32756]: pgmap v11952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21489.682438 secs 2024-04-27T00:16:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 20792.650916 secs 2024-04-27T00:16:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:34 smithi156 ceph-mon[32679]: pgmap v11952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21489.682438 secs 2024-04-27T00:16:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 20792.650916 secs 2024-04-27T00:16:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:34 smithi092 ceph-mon[29156]: pgmap v11952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:36 smithi189 ceph-mon[32756]: pgmap v11953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:36 smithi156 ceph-mon[32679]: pgmap v11953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:36 smithi092 ceph-mon[29156]: pgmap v11953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:38 smithi189 ceph-mon[32756]: pgmap v11954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:38 smithi156 ceph-mon[32679]: pgmap v11954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:38 smithi092 ceph-mon[29156]: pgmap v11954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21494.682571 secs 2024-04-27T00:16:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:39 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 20797.651055 secs 2024-04-27T00:16:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:39 smithi156 ceph-mon[32679]: slow request 182.381669 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:16:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21494.682571 secs 2024-04-27T00:16:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:39 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 20797.651055 secs 2024-04-27T00:16:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:39 smithi092 ceph-mon[29156]: slow request 182.381669 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:16:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21494.682571 secs 2024-04-27T00:16:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:39 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 20797.651055 secs 2024-04-27T00:16:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:39 smithi189 ceph-mon[32756]: slow request 182.381669 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:16:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:40 smithi156 ceph-mon[32679]: pgmap v11955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:40 smithi092 ceph-mon[29156]: pgmap v11955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:40 smithi189 ceph-mon[32756]: pgmap v11955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:16:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:41 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:16:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:16:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:41 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:16:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:16:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:41 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:16:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:42 smithi156 ceph-mon[32679]: pgmap v11956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:42 smithi092 ceph-mon[29156]: pgmap v11956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:42 smithi189 ceph-mon[32756]: pgmap v11956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21499.682705 secs 2024-04-27T00:16:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20802.651168 secs 2024-04-27T00:16:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:44 smithi156 ceph-mon[32679]: pgmap v11957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21499.682705 secs 2024-04-27T00:16:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20802.651168 secs 2024-04-27T00:16:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:44 smithi092 ceph-mon[29156]: pgmap v11957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21499.682705 secs 2024-04-27T00:16:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20802.651168 secs 2024-04-27T00:16:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:44 smithi189 ceph-mon[32756]: pgmap v11957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:46 smithi156 ceph-mon[32679]: pgmap v11958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:46 smithi092 ceph-mon[29156]: pgmap v11958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:46 smithi189 ceph-mon[32756]: pgmap v11958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:48 smithi156 ceph-mon[32679]: pgmap v11959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:48 smithi092 ceph-mon[29156]: pgmap v11959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:48 smithi189 ceph-mon[32756]: pgmap v11959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21504.682864 secs 2024-04-27T00:16:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20807.651328 secs 2024-04-27T00:16:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21504.682864 secs 2024-04-27T00:16:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20807.651328 secs 2024-04-27T00:16:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21504.682864 secs 2024-04-27T00:16:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20807.651328 secs 2024-04-27T00:16:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:50 smithi156 ceph-mon[32679]: pgmap v11960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:50 smithi092 ceph-mon[29156]: pgmap v11960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:50 smithi189 ceph-mon[32756]: pgmap v11960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:16:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:16:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:16:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:16:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:52 smithi156 ceph-mon[32679]: pgmap v11961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:16:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:16:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:16:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:52 smithi092 ceph-mon[29156]: pgmap v11961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:16:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:16:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:16:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:52 smithi189 ceph-mon[32756]: pgmap v11961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:16:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:16:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:16:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:16:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:53 smithi092 ceph-mon[29156]: pgmap v11962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:16:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:53 smithi092 ceph-mon[29156]: pgmap v11963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:16:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:53 smithi189 ceph-mon[32756]: pgmap v11962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:16:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:53 smithi189 ceph-mon[32756]: pgmap v11963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:16:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:53 smithi156 ceph-mon[32679]: pgmap v11962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:16:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:53 smithi156 ceph-mon[32679]: pgmap v11963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:16:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21509.682915 secs 2024-04-27T00:16:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20812.651477 secs 2024-04-27T00:16:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:54 smithi092 ceph-mon[29156]: pgmap v11964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21509.682915 secs 2024-04-27T00:16:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20812.651477 secs 2024-04-27T00:16:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:54 smithi189 ceph-mon[32756]: pgmap v11964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21509.682915 secs 2024-04-27T00:16:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20812.651477 secs 2024-04-27T00:16:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:54 smithi156 ceph-mon[32679]: pgmap v11964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:57 smithi189 ceph-mon[32756]: pgmap v11965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:57 smithi156 ceph-mon[32679]: pgmap v11965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:57 smithi092 ceph-mon[29156]: pgmap v11965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:59 smithi189 ceph-mon[32756]: pgmap v11966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21514.682977 secs 2024-04-27T00:16:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:16:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20817.651598 secs 2024-04-27T00:16:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:59 smithi156 ceph-mon[32679]: pgmap v11966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21514.682977 secs 2024-04-27T00:16:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:16:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20817.651598 secs 2024-04-27T00:16:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:59 smithi092 ceph-mon[29156]: pgmap v11966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:16:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21514.682977 secs 2024-04-27T00:16:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:16:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20817.651598 secs 2024-04-27T00:17:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:01 smithi156 ceph-mon[32679]: pgmap v11967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:17:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:01 smithi092 ceph-mon[29156]: pgmap v11967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:17:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:01 smithi189 ceph-mon[32756]: pgmap v11967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:17:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:03 smithi156 ceph-mon[32679]: pgmap v11968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:17:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:03 smithi092 ceph-mon[29156]: pgmap v11968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:17:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:03 smithi189 ceph-mon[32756]: pgmap v11968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:17:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21519.683107 secs 2024-04-27T00:17:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:04 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 20822.651683 secs 2024-04-27T00:17:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:04 smithi156 ceph-mon[32679]: slow request 11520.287763 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:17:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21519.683107 secs 2024-04-27T00:17:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:04 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 20822.651683 secs 2024-04-27T00:17:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:04 smithi092 ceph-mon[29156]: slow request 11520.287763 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:17:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21519.683107 secs 2024-04-27T00:17:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:04 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 20822.651683 secs 2024-04-27T00:17:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:04 smithi189 ceph-mon[32756]: slow request 11520.287763 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:17:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:05 smithi156 ceph-mon[32679]: pgmap v11969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:05 smithi092 ceph-mon[29156]: pgmap v11969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:05 smithi189 ceph-mon[32756]: pgmap v11969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:07 smithi156 ceph-mon[32679]: pgmap v11970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:07 smithi092 ceph-mon[29156]: pgmap v11970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:07 smithi189 ceph-mon[32756]: pgmap v11970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:09 smithi156 ceph-mon[32679]: pgmap v11971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21524.683249 secs 2024-04-27T00:17:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20827.651788 secs 2024-04-27T00:17:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:09 smithi092 ceph-mon[29156]: pgmap v11971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21524.683249 secs 2024-04-27T00:17:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20827.651788 secs 2024-04-27T00:17:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:09 smithi189 ceph-mon[32756]: pgmap v11971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21524.683249 secs 2024-04-27T00:17:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20827.651788 secs 2024-04-27T00:17:11.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:11 smithi156 ceph-mon[32679]: pgmap v11972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:11 smithi092 ceph-mon[29156]: pgmap v11972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:11 smithi189 ceph-mon[32756]: pgmap v11972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:13 smithi156 ceph-mon[32679]: pgmap v11973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:13 smithi092 ceph-mon[29156]: pgmap v11973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:13 smithi189 ceph-mon[32756]: pgmap v11973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21529.683321 secs 2024-04-27T00:17:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20832.651907 secs 2024-04-27T00:17:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21529.683321 secs 2024-04-27T00:17:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20832.651907 secs 2024-04-27T00:17:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21529.683321 secs 2024-04-27T00:17:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20832.651907 secs 2024-04-27T00:17:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:15 smithi156 ceph-mon[32679]: pgmap v11974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:15 smithi092 ceph-mon[29156]: pgmap v11974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:15 smithi189 ceph-mon[32756]: pgmap v11974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:17 smithi156 ceph-mon[32679]: pgmap v11975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:17 smithi092 ceph-mon[29156]: pgmap v11975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:17 smithi189 ceph-mon[32756]: pgmap v11975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:19 smithi156 ceph-mon[32679]: pgmap v11976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21534.683454 secs 2024-04-27T00:17:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20837.651999 secs 2024-04-27T00:17:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:19 smithi092 ceph-mon[29156]: pgmap v11976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21534.683454 secs 2024-04-27T00:17:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20837.651999 secs 2024-04-27T00:17:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:19 smithi189 ceph-mon[32756]: pgmap v11976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21534.683454 secs 2024-04-27T00:17:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20837.651999 secs 2024-04-27T00:17:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:21 smithi156 ceph-mon[32679]: pgmap v11977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:21 smithi092 ceph-mon[29156]: pgmap v11977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:21 smithi189 ceph-mon[32756]: pgmap v11977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:23 smithi092 ceph-mon[29156]: pgmap v11978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:23 smithi189 ceph-mon[32756]: pgmap v11978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:23 smithi156 ceph-mon[32679]: pgmap v11978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21539.683588 secs 2024-04-27T00:17:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20842.652119 secs 2024-04-27T00:17:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21539.683588 secs 2024-04-27T00:17:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20842.652119 secs 2024-04-27T00:17:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21539.683588 secs 2024-04-27T00:17:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20842.652119 secs 2024-04-27T00:17:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:25 smithi092 ceph-mon[29156]: pgmap v11979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:25 smithi189 ceph-mon[32756]: pgmap v11979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:25 smithi156 ceph-mon[32679]: pgmap v11979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:27 smithi092 ceph-mon[29156]: pgmap v11980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:27 smithi189 ceph-mon[32756]: pgmap v11980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:27 smithi156 ceph-mon[32679]: pgmap v11980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:29.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:29 smithi156 ceph-mon[32679]: pgmap v11981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:29.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21544.683703 secs 2024-04-27T00:17:29.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20847.652221 secs 2024-04-27T00:17:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:29 smithi092 ceph-mon[29156]: pgmap v11981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21544.683703 secs 2024-04-27T00:17:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20847.652221 secs 2024-04-27T00:17:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:29 smithi189 ceph-mon[32756]: pgmap v11981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21544.683703 secs 2024-04-27T00:17:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20847.652221 secs 2024-04-27T00:17:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:31 smithi092 ceph-mon[29156]: pgmap v11982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:31 smithi189 ceph-mon[32756]: pgmap v11982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:31 smithi156 ceph-mon[32679]: pgmap v11982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:33 smithi092 ceph-mon[29156]: pgmap v11983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:33 smithi189 ceph-mon[32756]: pgmap v11983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:33 smithi156 ceph-mon[32679]: pgmap v11983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21549.683841 secs 2024-04-27T00:17:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20852.652363 secs 2024-04-27T00:17:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21549.683841 secs 2024-04-27T00:17:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20852.652363 secs 2024-04-27T00:17:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21549.683841 secs 2024-04-27T00:17:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20852.652363 secs 2024-04-27T00:17:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:35 smithi092 ceph-mon[29156]: pgmap v11984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:35 smithi189 ceph-mon[32756]: pgmap v11984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:35 smithi156 ceph-mon[32679]: pgmap v11984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:37 smithi092 ceph-mon[29156]: pgmap v11985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:37 smithi189 ceph-mon[32756]: pgmap v11985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:37 smithi156 ceph-mon[32679]: pgmap v11985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:39 smithi092 ceph-mon[29156]: pgmap v11986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21554.683932 secs 2024-04-27T00:17:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20857.652486 secs 2024-04-27T00:17:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:39 smithi189 ceph-mon[32756]: pgmap v11986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21554.683932 secs 2024-04-27T00:17:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20857.652486 secs 2024-04-27T00:17:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:39 smithi156 ceph-mon[32679]: pgmap v11986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21554.683932 secs 2024-04-27T00:17:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20857.652486 secs 2024-04-27T00:17:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:41 smithi092 ceph-mon[29156]: pgmap v11987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:41 smithi189 ceph-mon[32756]: pgmap v11987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:41 smithi156 ceph-mon[32679]: pgmap v11987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:43 smithi092 ceph-mon[29156]: pgmap v11988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:43 smithi189 ceph-mon[32756]: pgmap v11988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:43 smithi156 ceph-mon[32679]: pgmap v11988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21559.684036 secs 2024-04-27T00:17:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20862.652599 secs 2024-04-27T00:17:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21559.684036 secs 2024-04-27T00:17:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20862.652599 secs 2024-04-27T00:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21559.684036 secs 2024-04-27T00:17:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20862.652599 secs 2024-04-27T00:17:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:45 smithi092 ceph-mon[29156]: pgmap v11989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:45 smithi189 ceph-mon[32756]: pgmap v11989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:45 smithi156 ceph-mon[32679]: pgmap v11989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:47 smithi092 ceph-mon[29156]: pgmap v11990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:47 smithi189 ceph-mon[32756]: pgmap v11990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:47 smithi156 ceph-mon[32679]: pgmap v11990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:49 smithi092 ceph-mon[29156]: pgmap v11991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21564.684100 secs 2024-04-27T00:17:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20867.652718 secs 2024-04-27T00:17:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:49 smithi189 ceph-mon[32756]: pgmap v11991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21564.684100 secs 2024-04-27T00:17:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20867.652718 secs 2024-04-27T00:17:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:49 smithi156 ceph-mon[32679]: pgmap v11991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21564.684100 secs 2024-04-27T00:17:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20867.652718 secs 2024-04-27T00:17:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:51 smithi189 ceph-mon[32756]: pgmap v11992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:51 smithi156 ceph-mon[32679]: pgmap v11992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:51 smithi092 ceph-mon[29156]: pgmap v11992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:17:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:17:53.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: pgmap v11993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.041 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: pgmap v11993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:54.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: pgmap v11993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.098 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:54.099 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21569.684161 secs 2024-04-27T00:17:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20872.652784 secs 2024-04-27T00:17:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21569.684161 secs 2024-04-27T00:17:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20872.652784 secs 2024-04-27T00:17:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21569.684161 secs 2024-04-27T00:17:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20872.652784 secs 2024-04-27T00:17:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: pgmap v11994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: pgmap v11994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: pgmap v11994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:17:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:17:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:17:57.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:17:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:17:57.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:57 smithi189 ceph-mon[32756]: pgmap v11995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:57 smithi189 ceph-mon[32756]: pgmap v11996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:57 smithi156 ceph-mon[32679]: pgmap v11995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:57 smithi156 ceph-mon[32679]: pgmap v11996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:57 smithi092 ceph-mon[29156]: pgmap v11995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:17:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:57 smithi092 ceph-mon[29156]: pgmap v11996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:59 smithi189 ceph-mon[32756]: pgmap v11997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21574.684234 secs 2024-04-27T00:18:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:17:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20877.652892 secs 2024-04-27T00:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:59 smithi156 ceph-mon[32679]: pgmap v11997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21574.684234 secs 2024-04-27T00:18:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:17:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20877.652892 secs 2024-04-27T00:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:59 smithi092 ceph-mon[29156]: pgmap v11997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T00:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21574.684234 secs 2024-04-27T00:18:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:17:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20877.652892 secs 2024-04-27T00:18:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:01 smithi189 ceph-mon[32756]: pgmap v11998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:01 smithi156 ceph-mon[32679]: pgmap v11998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:01 smithi092 ceph-mon[29156]: pgmap v11998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:03 smithi189 ceph-mon[32756]: pgmap v11999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:03 smithi156 ceph-mon[32679]: pgmap v11999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:03 smithi092 ceph-mon[29156]: pgmap v11999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21579.684365 secs 2024-04-27T00:18:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20882.652999 secs 2024-04-27T00:18:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21579.684365 secs 2024-04-27T00:18:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20882.652999 secs 2024-04-27T00:18:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21579.684365 secs 2024-04-27T00:18:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20882.652999 secs 2024-04-27T00:18:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:05 smithi189 ceph-mon[32756]: pgmap v12000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:05 smithi156 ceph-mon[32679]: pgmap v12000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:06.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:05 smithi092 ceph-mon[29156]: pgmap v12000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:18:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:07 smithi189 ceph-mon[32756]: pgmap v12001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:18:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:07 smithi156 ceph-mon[32679]: pgmap v12001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:18:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:07 smithi092 ceph-mon[29156]: pgmap v12001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:18:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:09 smithi189 ceph-mon[32756]: pgmap v12002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21584.684426 secs 2024-04-27T00:18:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20887.653140 secs 2024-04-27T00:18:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:09 smithi156 ceph-mon[32679]: pgmap v12002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21584.684426 secs 2024-04-27T00:18:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20887.653140 secs 2024-04-27T00:18:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:09 smithi092 ceph-mon[29156]: pgmap v12002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21584.684426 secs 2024-04-27T00:18:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20887.653140 secs 2024-04-27T00:18:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:11 smithi189 ceph-mon[32756]: pgmap v12003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:11 smithi156 ceph-mon[32679]: pgmap v12003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:11 smithi092 ceph-mon[29156]: pgmap v12003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:13 smithi189 ceph-mon[32756]: pgmap v12004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:13 smithi156 ceph-mon[32679]: pgmap v12004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:13 smithi092 ceph-mon[29156]: pgmap v12004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21589.684516 secs 2024-04-27T00:18:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20892.653290 secs 2024-04-27T00:18:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21589.684516 secs 2024-04-27T00:18:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20892.653290 secs 2024-04-27T00:18:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21589.684516 secs 2024-04-27T00:18:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20892.653290 secs 2024-04-27T00:18:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:15 smithi189 ceph-mon[32756]: pgmap v12005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:15 smithi156 ceph-mon[32679]: pgmap v12005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:15 smithi092 ceph-mon[29156]: pgmap v12005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:17 smithi189 ceph-mon[32756]: pgmap v12006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:17 smithi156 ceph-mon[32679]: pgmap v12006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:17 smithi092 ceph-mon[29156]: pgmap v12006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:20.069 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:19 smithi092 ceph-mon[29156]: pgmap v12007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:20.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21594.684563 secs 2024-04-27T00:18:20.070 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20897.653428 secs 2024-04-27T00:18:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:19 smithi189 ceph-mon[32756]: pgmap v12007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21594.684563 secs 2024-04-27T00:18:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20897.653428 secs 2024-04-27T00:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:19 smithi156 ceph-mon[32679]: pgmap v12007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21594.684563 secs 2024-04-27T00:18:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20897.653428 secs 2024-04-27T00:18:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:21 smithi189 ceph-mon[32756]: pgmap v12008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:21 smithi156 ceph-mon[32679]: pgmap v12008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:21 smithi092 ceph-mon[29156]: pgmap v12008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:23 smithi189 ceph-mon[32756]: pgmap v12009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:23 smithi156 ceph-mon[32679]: pgmap v12009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:23 smithi092 ceph-mon[29156]: pgmap v12009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21599.684633 secs 2024-04-27T00:18:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20902.653565 secs 2024-04-27T00:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21599.684633 secs 2024-04-27T00:18:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20902.653565 secs 2024-04-27T00:18:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21599.684633 secs 2024-04-27T00:18:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20902.653565 secs 2024-04-27T00:18:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:25 smithi189 ceph-mon[32756]: pgmap v12010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:25 smithi156 ceph-mon[32679]: pgmap v12010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:25 smithi092 ceph-mon[29156]: pgmap v12010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:27 smithi189 ceph-mon[32756]: pgmap v12011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:27 smithi156 ceph-mon[32679]: pgmap v12011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:27 smithi092 ceph-mon[29156]: pgmap v12011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:29 smithi189 ceph-mon[32756]: pgmap v12012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21604.684695 secs 2024-04-27T00:18:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20907.653647 secs 2024-04-27T00:18:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:29 smithi156 ceph-mon[32679]: pgmap v12012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21604.684695 secs 2024-04-27T00:18:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20907.653647 secs 2024-04-27T00:18:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:29 smithi092 ceph-mon[29156]: pgmap v12012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21604.684695 secs 2024-04-27T00:18:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20907.653647 secs 2024-04-27T00:18:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:31 smithi189 ceph-mon[32756]: pgmap v12013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:31 smithi156 ceph-mon[32679]: pgmap v12013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:31 smithi092 ceph-mon[29156]: pgmap v12013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:33 smithi189 ceph-mon[32756]: pgmap v12014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:33 smithi156 ceph-mon[32679]: pgmap v12014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:33 smithi092 ceph-mon[29156]: pgmap v12014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21609.684755 secs 2024-04-27T00:18:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20912.653759 secs 2024-04-27T00:18:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21609.684755 secs 2024-04-27T00:18:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20912.653759 secs 2024-04-27T00:18:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21609.684755 secs 2024-04-27T00:18:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20912.653759 secs 2024-04-27T00:18:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T00:18:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca808a050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca808a050 comp rx=0 tx=0).stop 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:18:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.022+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80b0050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.057+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.057+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.057+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.057+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=22 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.058+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.058+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T00:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:36.058+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T00:18:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:35 smithi189 ceph-mon[32756]: pgmap v12015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:35 smithi156 ceph-mon[32679]: pgmap v12015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:35 smithi092 ceph-mon[29156]: pgmap v12015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:36.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:18:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:18:36.526+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:18:36.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:18:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:18:36.526+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:18:36.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:18:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:18:36.526+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:18:36.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:18:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:18:36.526+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:18:36.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:18:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:18:36.526+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:18:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:37 smithi189 ceph-mon[32756]: pgmap v12016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:37 smithi156 ceph-mon[32679]: pgmap v12016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:37 smithi092 ceph-mon[29156]: pgmap v12016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:38.945+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:18:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:38.945+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:18:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:38.946+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:18:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:18:38.946+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 168 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:18:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:39 smithi189 ceph-mon[32756]: pgmap v12017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21614.684821 secs 2024-04-27T00:18:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20917.653838 secs 2024-04-27T00:18:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:39 smithi156 ceph-mon[32679]: pgmap v12017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21614.684821 secs 2024-04-27T00:18:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20917.653838 secs 2024-04-27T00:18:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:39 smithi092 ceph-mon[29156]: pgmap v12017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21614.684821 secs 2024-04-27T00:18:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20917.653838 secs 2024-04-27T00:18:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:41 smithi189 ceph-mon[32756]: pgmap v12018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:41 smithi156 ceph-mon[32679]: pgmap v12018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:41 smithi092 ceph-mon[29156]: pgmap v12018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:43 smithi189 ceph-mon[32756]: pgmap v12019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:43 smithi156 ceph-mon[32679]: pgmap v12019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:43 smithi092 ceph-mon[29156]: pgmap v12019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21619.684936 secs 2024-04-27T00:18:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20922.653949 secs 2024-04-27T00:18:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21619.684936 secs 2024-04-27T00:18:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20922.653949 secs 2024-04-27T00:18:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21619.684936 secs 2024-04-27T00:18:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20922.653949 secs 2024-04-27T00:18:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:45 smithi189 ceph-mon[32756]: pgmap v12020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:45 smithi156 ceph-mon[32679]: pgmap v12020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:45 smithi092 ceph-mon[29156]: pgmap v12020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:47 smithi189 ceph-mon[32756]: pgmap v12021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:47 smithi156 ceph-mon[32679]: pgmap v12021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:47 smithi092 ceph-mon[29156]: pgmap v12021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:49 smithi189 ceph-mon[32756]: pgmap v12022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21624.684999 secs 2024-04-27T00:18:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20927.654072 secs 2024-04-27T00:18:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:49 smithi156 ceph-mon[32679]: pgmap v12022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21624.684999 secs 2024-04-27T00:18:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20927.654072 secs 2024-04-27T00:18:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:49 smithi092 ceph-mon[29156]: pgmap v12022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T00:18:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21624.684999 secs 2024-04-27T00:18:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20927.654072 secs 2024-04-27T00:18:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:51 smithi189 ceph-mon[32756]: pgmap v12023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:51 smithi156 ceph-mon[32679]: pgmap v12023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:51 smithi092 ceph-mon[29156]: pgmap v12023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T00:18:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:53 smithi156 ceph-mon[32679]: pgmap v12024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:53 smithi092 ceph-mon[29156]: pgmap v12024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:53 smithi189 ceph-mon[32756]: pgmap v12024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21629.685119 secs 2024-04-27T00:18:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20932.654141 secs 2024-04-27T00:18:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21629.685119 secs 2024-04-27T00:18:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20932.654141 secs 2024-04-27T00:18:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21629.685119 secs 2024-04-27T00:18:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20932.654141 secs 2024-04-27T00:18:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:55 smithi156 ceph-mon[32679]: pgmap v12025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:55 smithi092 ceph-mon[29156]: pgmap v12025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:55 smithi189 ceph-mon[32756]: pgmap v12025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:18:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:18:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:18:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: pgmap v12026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: pgmap v12027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:18:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: pgmap v12028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:18:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: pgmap v12026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: pgmap v12027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: pgmap v12028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:18:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: pgmap v12026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: pgmap v12027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: pgmap v12028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:18:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:18:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:18:59 smithi189 ceph-mon[32756]: pgmap v12029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:18:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:18:59 smithi156 ceph-mon[32679]: pgmap v12029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:18:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:18:59 smithi092 ceph-mon[29156]: pgmap v12029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:19:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21634.685239 secs 2024-04-27T00:19:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:00 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20937.654251 secs 2024-04-27T00:19:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21634.685239 secs 2024-04-27T00:19:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:00 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20937.654251 secs 2024-04-27T00:19:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21634.685239 secs 2024-04-27T00:19:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:00 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20937.654251 secs 2024-04-27T00:19:01.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:01 smithi189 ceph-mon[32756]: pgmap v12030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:19:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:01 smithi156 ceph-mon[32679]: pgmap v12030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:19:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:01 smithi092 ceph-mon[29156]: pgmap v12030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:19:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:03 smithi189 ceph-mon[32756]: pgmap v12031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:03 smithi156 ceph-mon[32679]: pgmap v12031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:03 smithi092 ceph-mon[29156]: pgmap v12031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21639.685361 secs 2024-04-27T00:19:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20942.654385 secs 2024-04-27T00:19:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21639.685361 secs 2024-04-27T00:19:04.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20942.654385 secs 2024-04-27T00:19:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21639.685361 secs 2024-04-27T00:19:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20942.654385 secs 2024-04-27T00:19:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:05 smithi189 ceph-mon[32756]: pgmap v12032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:05 smithi156 ceph-mon[32679]: pgmap v12032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:05 smithi092 ceph-mon[29156]: pgmap v12032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:07 smithi189 ceph-mon[32756]: pgmap v12033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:19:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:07 smithi156 ceph-mon[32679]: pgmap v12033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:19:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:07 smithi092 ceph-mon[29156]: pgmap v12033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:19:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:09 smithi189 ceph-mon[32756]: pgmap v12034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:09 smithi156 ceph-mon[32679]: pgmap v12034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:09 smithi092 ceph-mon[29156]: pgmap v12034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21644.685484 secs 2024-04-27T00:19:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:10 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 20947.654499 secs 2024-04-27T00:19:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:10 smithi189 ceph-mon[32756]: slow request 2883.074046 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21644.685484 secs 2024-04-27T00:19:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:10 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 20947.654499 secs 2024-04-27T00:19:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:10 smithi156 ceph-mon[32679]: slow request 2883.074046 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21644.685484 secs 2024-04-27T00:19:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:10 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 20947.654499 secs 2024-04-27T00:19:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:10 smithi092 ceph-mon[29156]: slow request 2883.074046 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:11 smithi189 ceph-mon[32756]: pgmap v12035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:11 smithi156 ceph-mon[32679]: pgmap v12035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:11 smithi092 ceph-mon[29156]: pgmap v12035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:13 smithi189 ceph-mon[32756]: pgmap v12036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:13 smithi156 ceph-mon[32679]: pgmap v12036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:13 smithi092 ceph-mon[29156]: pgmap v12036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:19:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21649.685625 secs 2024-04-27T00:19:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20952.654618 secs 2024-04-27T00:19:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21649.685625 secs 2024-04-27T00:19:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20952.654618 secs 2024-04-27T00:19:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21649.685625 secs 2024-04-27T00:19:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20952.654618 secs 2024-04-27T00:19:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:15 smithi189 ceph-mon[32756]: pgmap v12037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:15 smithi156 ceph-mon[32679]: pgmap v12037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:15 smithi092 ceph-mon[29156]: pgmap v12037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:19:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:17 smithi189 ceph-mon[32756]: pgmap v12038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:17 smithi156 ceph-mon[32679]: pgmap v12038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:17 smithi092 ceph-mon[29156]: pgmap v12038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:19 smithi189 ceph-mon[32756]: pgmap v12039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:19 smithi156 ceph-mon[32679]: pgmap v12039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:19 smithi092 ceph-mon[29156]: pgmap v12039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21654.685746 secs 2024-04-27T00:19:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:20 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20957.654757 secs 2024-04-27T00:19:20.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21654.685746 secs 2024-04-27T00:19:20.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:20 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20957.654757 secs 2024-04-27T00:19:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21654.685746 secs 2024-04-27T00:19:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:20 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20957.654757 secs 2024-04-27T00:19:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:21 smithi189 ceph-mon[32756]: pgmap v12040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:21 smithi156 ceph-mon[32679]: pgmap v12040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:21 smithi092 ceph-mon[29156]: pgmap v12040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:23 smithi189 ceph-mon[32756]: pgmap v12041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:23 smithi156 ceph-mon[32679]: pgmap v12041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:23 smithi092 ceph-mon[29156]: pgmap v12041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21659.685868 secs 2024-04-27T00:19:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20962.654853 secs 2024-04-27T00:19:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21659.685868 secs 2024-04-27T00:19:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20962.654853 secs 2024-04-27T00:19:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21659.685868 secs 2024-04-27T00:19:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20962.654853 secs 2024-04-27T00:19:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:25 smithi189 ceph-mon[32756]: pgmap v12042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:25 smithi156 ceph-mon[32679]: pgmap v12042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:25 smithi092 ceph-mon[29156]: pgmap v12042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:27 smithi189 ceph-mon[32756]: pgmap v12043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:27 smithi156 ceph-mon[32679]: pgmap v12043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:27 smithi092 ceph-mon[29156]: pgmap v12043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:29 smithi189 ceph-mon[32756]: pgmap v12044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:29 smithi156 ceph-mon[32679]: pgmap v12044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:29 smithi092 ceph-mon[29156]: pgmap v12044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21664.686007 secs 2024-04-27T00:19:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:30 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20967.654940 secs 2024-04-27T00:19:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21664.686007 secs 2024-04-27T00:19:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:30 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20967.654940 secs 2024-04-27T00:19:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21664.686007 secs 2024-04-27T00:19:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:30 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20967.654940 secs 2024-04-27T00:19:31.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:31 smithi189 ceph-mon[32756]: pgmap v12045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:31 smithi156 ceph-mon[32679]: pgmap v12045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:31 smithi092 ceph-mon[29156]: pgmap v12045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:33 smithi189 ceph-mon[32756]: pgmap v12046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:33 smithi156 ceph-mon[32679]: pgmap v12046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:33 smithi092 ceph-mon[29156]: pgmap v12046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21669.686095 secs 2024-04-27T00:19:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20972.655062 secs 2024-04-27T00:19:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21669.686095 secs 2024-04-27T00:19:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20972.655062 secs 2024-04-27T00:19:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21669.686095 secs 2024-04-27T00:19:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20972.655062 secs 2024-04-27T00:19:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:35 smithi189 ceph-mon[32756]: pgmap v12047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:35 smithi156 ceph-mon[32679]: pgmap v12047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:35 smithi092 ceph-mon[29156]: pgmap v12047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:37 smithi189 ceph-mon[32756]: pgmap v12048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:37 smithi156 ceph-mon[32679]: pgmap v12048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:37.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:37 smithi092 ceph-mon[29156]: pgmap v12048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:39 smithi189 ceph-mon[32756]: pgmap v12049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:39 smithi156 ceph-mon[32679]: pgmap v12049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:39 smithi092 ceph-mon[29156]: pgmap v12049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21674.686229 secs 2024-04-27T00:19:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:40 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 20977.655180 secs 2024-04-27T00:19:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:40 smithi189 ceph-mon[32756]: slow request 362.385794 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21674.686229 secs 2024-04-27T00:19:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:40 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 20977.655180 secs 2024-04-27T00:19:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:40 smithi156 ceph-mon[32679]: slow request 362.385794 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21674.686229 secs 2024-04-27T00:19:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:40 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 20977.655180 secs 2024-04-27T00:19:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:40 smithi092 ceph-mon[29156]: slow request 362.385794 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:19:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:41 smithi189 ceph-mon[32756]: pgmap v12050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:41 smithi156 ceph-mon[32679]: pgmap v12050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:41 smithi092 ceph-mon[29156]: pgmap v12050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:43 smithi189 ceph-mon[32756]: pgmap v12051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:43 smithi156 ceph-mon[32679]: pgmap v12051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:43 smithi092 ceph-mon[29156]: pgmap v12051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21679.686359 secs 2024-04-27T00:19:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20982.655251 secs 2024-04-27T00:19:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21679.686359 secs 2024-04-27T00:19:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20982.655251 secs 2024-04-27T00:19:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21679.686359 secs 2024-04-27T00:19:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20982.655251 secs 2024-04-27T00:19:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:45 smithi189 ceph-mon[32756]: pgmap v12052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:45 smithi156 ceph-mon[32679]: pgmap v12052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:45 smithi092 ceph-mon[29156]: pgmap v12052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:47 smithi189 ceph-mon[32756]: pgmap v12053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:47 smithi156 ceph-mon[32679]: pgmap v12053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:47 smithi092 ceph-mon[29156]: pgmap v12053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:49 smithi189 ceph-mon[32756]: pgmap v12054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:49 smithi156 ceph-mon[32679]: pgmap v12054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:49 smithi092 ceph-mon[29156]: pgmap v12054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21684.686502 secs 2024-04-27T00:19:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:50 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20987.655320 secs 2024-04-27T00:19:50.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21684.686502 secs 2024-04-27T00:19:50.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:50 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20987.655320 secs 2024-04-27T00:19:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21684.686502 secs 2024-04-27T00:19:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:50 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20987.655320 secs 2024-04-27T00:19:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:51 smithi189 ceph-mon[32756]: pgmap v12055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:51 smithi156 ceph-mon[32679]: pgmap v12055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:51 smithi092 ceph-mon[29156]: pgmap v12055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:53 smithi189 ceph-mon[32756]: pgmap v12056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:53 smithi156 ceph-mon[32679]: pgmap v12056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:53 smithi092 ceph-mon[29156]: pgmap v12056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21689.686621 secs 2024-04-27T00:19:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20992.655377 secs 2024-04-27T00:19:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21689.686621 secs 2024-04-27T00:19:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20992.655377 secs 2024-04-27T00:19:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21689.686621 secs 2024-04-27T00:19:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20992.655377 secs 2024-04-27T00:19:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:55 smithi189 ceph-mon[32756]: pgmap v12057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:55 smithi156 ceph-mon[32679]: pgmap v12057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:55 smithi092 ceph-mon[29156]: pgmap v12057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:19:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:57 smithi189 ceph-mon[32756]: pgmap v12058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:57 smithi156 ceph-mon[32679]: pgmap v12058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:57 smithi092 ceph-mon[29156]: pgmap v12058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:19:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:19:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:19:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:19:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: pgmap v12059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:19:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: pgmap v12060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: pgmap v12059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: pgmap v12060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: pgmap v12059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: pgmap v12060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:19:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:19:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21694.686743 secs 2024-04-27T00:19:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:19:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 20997.655477 secs 2024-04-27T00:19:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21694.686743 secs 2024-04-27T00:19:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:19:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 20997.655477 secs 2024-04-27T00:19:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21694.686743 secs 2024-04-27T00:19:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:19:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 20997.655477 secs 2024-04-27T00:20:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:00 smithi189 ceph-mon[32756]: pgmap v12061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:20:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:00 smithi156 ceph-mon[32679]: pgmap v12061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:20:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:00 smithi092 ceph-mon[29156]: pgmap v12061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:20:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:02 smithi189 ceph-mon[32756]: pgmap v12062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:02 smithi156 ceph-mon[32679]: pgmap v12062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:02 smithi092 ceph-mon[29156]: pgmap v12062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21699.686866 secs 2024-04-27T00:20:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:04 smithi189 ceph-mon[32756]: pgmap v12063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21002.655552 secs 2024-04-27T00:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21699.686866 secs 2024-04-27T00:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:04 smithi156 ceph-mon[32679]: pgmap v12063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21002.655552 secs 2024-04-27T00:20:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21699.686866 secs 2024-04-27T00:20:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:04 smithi092 ceph-mon[29156]: pgmap v12063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21002.655552 secs 2024-04-27T00:20:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:06 smithi189 ceph-mon[32756]: pgmap v12064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:06 smithi156 ceph-mon[32679]: pgmap v12064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:06 smithi092 ceph-mon[29156]: pgmap v12064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:20:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:08 smithi189 ceph-mon[32756]: pgmap v12065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:20:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:08 smithi156 ceph-mon[32679]: pgmap v12065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:20:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:08 smithi092 ceph-mon[29156]: pgmap v12065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:20:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21704.687007 secs 2024-04-27T00:20:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21007.655678 secs 2024-04-27T00:20:10.150 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21704.687007 secs 2024-04-27T00:20:10.150 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21007.655678 secs 2024-04-27T00:20:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21704.687007 secs 2024-04-27T00:20:10.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21007.655678 secs 2024-04-27T00:20:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:10 smithi189 ceph-mon[32756]: pgmap v12066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:10 smithi156 ceph-mon[32679]: pgmap v12066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:11.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:10 smithi092 ceph-mon[29156]: pgmap v12066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:12 smithi189 ceph-mon[32756]: pgmap v12067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:12 smithi156 ceph-mon[32679]: pgmap v12067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:12 smithi092 ceph-mon[29156]: pgmap v12067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21709.687084 secs 2024-04-27T00:20:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:14 smithi189 ceph-mon[32756]: pgmap v12068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21012.655769 secs 2024-04-27T00:20:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21709.687084 secs 2024-04-27T00:20:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:14 smithi156 ceph-mon[32679]: pgmap v12068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21012.655769 secs 2024-04-27T00:20:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21709.687084 secs 2024-04-27T00:20:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:14 smithi092 ceph-mon[29156]: pgmap v12068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21012.655769 secs 2024-04-27T00:20:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:16 smithi189 ceph-mon[32756]: pgmap v12069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:16 smithi156 ceph-mon[32679]: pgmap v12069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:16 smithi092 ceph-mon[29156]: pgmap v12069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:18 smithi189 ceph-mon[32756]: pgmap v12070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:18 smithi156 ceph-mon[32679]: pgmap v12070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:18 smithi092 ceph-mon[29156]: pgmap v12070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21714.687181 secs 2024-04-27T00:20:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21017.655884 secs 2024-04-27T00:20:20.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21714.687181 secs 2024-04-27T00:20:20.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21017.655884 secs 2024-04-27T00:20:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21714.687181 secs 2024-04-27T00:20:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21017.655884 secs 2024-04-27T00:20:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:20 smithi189 ceph-mon[32756]: pgmap v12071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:20 smithi156 ceph-mon[32679]: pgmap v12071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:20 smithi092 ceph-mon[29156]: pgmap v12071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:22 smithi189 ceph-mon[32756]: pgmap v12072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:22 smithi156 ceph-mon[32679]: pgmap v12072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:22 smithi092 ceph-mon[29156]: pgmap v12072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21719.687260 secs 2024-04-27T00:20:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:24 smithi189 ceph-mon[32756]: pgmap v12073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21022.655992 secs 2024-04-27T00:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21719.687260 secs 2024-04-27T00:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:24 smithi156 ceph-mon[32679]: pgmap v12073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21022.655992 secs 2024-04-27T00:20:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21719.687260 secs 2024-04-27T00:20:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:24 smithi092 ceph-mon[29156]: pgmap v12073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21022.655992 secs 2024-04-27T00:20:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:26 smithi189 ceph-mon[32756]: pgmap v12074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:26 smithi156 ceph-mon[32679]: pgmap v12074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:26 smithi092 ceph-mon[29156]: pgmap v12074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:28 smithi189 ceph-mon[32756]: pgmap v12075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:28 smithi156 ceph-mon[32679]: pgmap v12075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:28 smithi092 ceph-mon[29156]: pgmap v12075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21724.687385 secs 2024-04-27T00:20:30.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21027.656114 secs 2024-04-27T00:20:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21724.687385 secs 2024-04-27T00:20:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21027.656114 secs 2024-04-27T00:20:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21724.687385 secs 2024-04-27T00:20:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21027.656114 secs 2024-04-27T00:20:31.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:30 smithi156 ceph-mon[32679]: pgmap v12076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:30 smithi189 ceph-mon[32756]: pgmap v12076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:30 smithi092 ceph-mon[29156]: pgmap v12076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:32 smithi189 ceph-mon[32756]: pgmap v12077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:32 smithi156 ceph-mon[32679]: pgmap v12077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:32 smithi092 ceph-mon[29156]: pgmap v12077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21729.687446 secs 2024-04-27T00:20:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:34 smithi189 ceph-mon[32756]: pgmap v12078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21032.656231 secs 2024-04-27T00:20:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21729.687446 secs 2024-04-27T00:20:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:34 smithi156 ceph-mon[32679]: pgmap v12078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21032.656231 secs 2024-04-27T00:20:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21729.687446 secs 2024-04-27T00:20:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:34 smithi092 ceph-mon[29156]: pgmap v12078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21032.656231 secs 2024-04-27T00:20:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:36 smithi189 ceph-mon[32756]: pgmap v12079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:36 smithi156 ceph-mon[32679]: pgmap v12079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:36 smithi092 ceph-mon[29156]: pgmap v12079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:38 smithi189 ceph-mon[32756]: pgmap v12080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:38 smithi156 ceph-mon[32679]: pgmap v12080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:38 smithi092 ceph-mon[29156]: pgmap v12080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21734.687571 secs 2024-04-27T00:20:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21037.656350 secs 2024-04-27T00:20:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21734.687571 secs 2024-04-27T00:20:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21037.656350 secs 2024-04-27T00:20:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21734.687571 secs 2024-04-27T00:20:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21037.656350 secs 2024-04-27T00:20:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:40 smithi189 ceph-mon[32756]: pgmap v12081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:40 smithi156 ceph-mon[32679]: pgmap v12081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:40 smithi092 ceph-mon[29156]: pgmap v12081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:42 smithi189 ceph-mon[32756]: pgmap v12082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:42 smithi156 ceph-mon[32679]: pgmap v12082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:42 smithi092 ceph-mon[29156]: pgmap v12082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21739.687665 secs 2024-04-27T00:20:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:44 smithi189 ceph-mon[32756]: pgmap v12083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21042.656419 secs 2024-04-27T00:20:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21739.687665 secs 2024-04-27T00:20:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:44 smithi156 ceph-mon[32679]: pgmap v12083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21042.656419 secs 2024-04-27T00:20:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21739.687665 secs 2024-04-27T00:20:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:44 smithi092 ceph-mon[29156]: pgmap v12083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21042.656419 secs 2024-04-27T00:20:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:46 smithi189 ceph-mon[32756]: pgmap v12084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:46 smithi156 ceph-mon[32679]: pgmap v12084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:46 smithi092 ceph-mon[29156]: pgmap v12084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:48 smithi189 ceph-mon[32756]: pgmap v12085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:48 smithi156 ceph-mon[32679]: pgmap v12085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:48 smithi092 ceph-mon[29156]: pgmap v12085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21744.687788 secs 2024-04-27T00:20:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21047.656554 secs 2024-04-27T00:20:50.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21744.687788 secs 2024-04-27T00:20:50.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21047.656554 secs 2024-04-27T00:20:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21744.687788 secs 2024-04-27T00:20:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21047.656554 secs 2024-04-27T00:20:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:50 smithi189 ceph-mon[32756]: pgmap v12086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:50 smithi156 ceph-mon[32679]: pgmap v12086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:50 smithi092 ceph-mon[29156]: pgmap v12086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:52 smithi189 ceph-mon[32756]: pgmap v12087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:52 smithi156 ceph-mon[32679]: pgmap v12087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:52 smithi092 ceph-mon[29156]: pgmap v12087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21749.687942 secs 2024-04-27T00:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:54 smithi189 ceph-mon[32756]: pgmap v12088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21052.656680 secs 2024-04-27T00:20:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21749.687942 secs 2024-04-27T00:20:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:54 smithi156 ceph-mon[32679]: pgmap v12088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21052.656680 secs 2024-04-27T00:20:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21749.687942 secs 2024-04-27T00:20:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:54 smithi092 ceph-mon[29156]: pgmap v12088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:20:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21052.656680 secs 2024-04-27T00:20:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:56 smithi189 ceph-mon[32756]: pgmap v12089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:56 smithi156 ceph-mon[32679]: pgmap v12089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:56 smithi092 ceph-mon[29156]: pgmap v12089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:20:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:20:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:58 smithi156 ceph-mon[32679]: pgmap v12090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:20:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:58 smithi092 ceph-mon[29156]: pgmap v12090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:20:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:58 smithi189 ceph-mon[32756]: pgmap v12090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:20:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:21:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:59 smithi156 ceph-mon[32679]: pgmap v12091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:21:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:59 smithi156 ceph-mon[32679]: pgmap v12092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21754.688004 secs 2024-04-27T00:21:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:20:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21057.656778 secs 2024-04-27T00:21:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:59 smithi092 ceph-mon[29156]: pgmap v12091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:21:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:59 smithi092 ceph-mon[29156]: pgmap v12092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21754.688004 secs 2024-04-27T00:21:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:20:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21057.656778 secs 2024-04-27T00:21:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:59 smithi189 ceph-mon[32756]: pgmap v12091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:21:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:59 smithi189 ceph-mon[32756]: pgmap v12092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21754.688004 secs 2024-04-27T00:21:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:20:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21057.656778 secs 2024-04-27T00:21:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:01 smithi156 ceph-mon[32679]: pgmap v12093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:01 smithi092 ceph-mon[29156]: pgmap v12093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:01 smithi189 ceph-mon[32756]: pgmap v12093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:03 smithi156 ceph-mon[32679]: pgmap v12094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:21:04.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:03 smithi189 ceph-mon[32756]: pgmap v12094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:21:04.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:03 smithi092 ceph-mon[29156]: pgmap v12094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:21:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21759.688114 secs 2024-04-27T00:21:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21062.656892 secs 2024-04-27T00:21:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21759.688114 secs 2024-04-27T00:21:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21062.656892 secs 2024-04-27T00:21:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21759.688114 secs 2024-04-27T00:21:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21062.656892 secs 2024-04-27T00:21:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:05 smithi156 ceph-mon[32679]: pgmap v12095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:05 smithi092 ceph-mon[29156]: pgmap v12095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:05 smithi189 ceph-mon[32756]: pgmap v12095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:07 smithi156 ceph-mon[32679]: pgmap v12096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:07 smithi092 ceph-mon[29156]: pgmap v12096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:07 smithi189 ceph-mon[32756]: pgmap v12096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:21:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:09 smithi156 ceph-mon[32679]: pgmap v12097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:21:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21764.688186 secs 2024-04-27T00:21:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21067.657009 secs 2024-04-27T00:21:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:09 smithi092 ceph-mon[29156]: pgmap v12097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:21:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21764.688186 secs 2024-04-27T00:21:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21067.657009 secs 2024-04-27T00:21:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:09 smithi189 ceph-mon[32756]: pgmap v12097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:21:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21764.688186 secs 2024-04-27T00:21:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21067.657009 secs 2024-04-27T00:21:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:11 smithi156 ceph-mon[32679]: pgmap v12098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:11 smithi092 ceph-mon[29156]: pgmap v12098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:11 smithi189 ceph-mon[32756]: pgmap v12098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:13 smithi156 ceph-mon[32679]: pgmap v12099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:13 smithi092 ceph-mon[29156]: pgmap v12099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:13 smithi189 ceph-mon[32756]: pgmap v12099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21769.688308 secs 2024-04-27T00:21:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21072.657121 secs 2024-04-27T00:21:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21769.688308 secs 2024-04-27T00:21:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21072.657121 secs 2024-04-27T00:21:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21769.688308 secs 2024-04-27T00:21:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21072.657121 secs 2024-04-27T00:21:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:15 smithi156 ceph-mon[32679]: pgmap v12100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:15 smithi092 ceph-mon[29156]: pgmap v12100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:15 smithi189 ceph-mon[32756]: pgmap v12100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:17 smithi156 ceph-mon[32679]: pgmap v12101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:17 smithi092 ceph-mon[29156]: pgmap v12101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:17 smithi189 ceph-mon[32756]: pgmap v12101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:19 smithi092 ceph-mon[29156]: pgmap v12102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21774.688435 secs 2024-04-27T00:21:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21077.657195 secs 2024-04-27T00:21:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:19 smithi189 ceph-mon[32756]: pgmap v12102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21774.688435 secs 2024-04-27T00:21:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21077.657195 secs 2024-04-27T00:21:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:19 smithi156 ceph-mon[32679]: pgmap v12102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21774.688435 secs 2024-04-27T00:21:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21077.657195 secs 2024-04-27T00:21:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:21 smithi092 ceph-mon[29156]: pgmap v12103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:21 smithi189 ceph-mon[32756]: pgmap v12103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:22.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:21 smithi156 ceph-mon[32679]: pgmap v12103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:23 smithi092 ceph-mon[29156]: pgmap v12104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:23 smithi189 ceph-mon[32756]: pgmap v12104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:23 smithi156 ceph-mon[32679]: pgmap v12104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21779.688542 secs 2024-04-27T00:21:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21082.657263 secs 2024-04-27T00:21:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21779.688542 secs 2024-04-27T00:21:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21082.657263 secs 2024-04-27T00:21:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21779.688542 secs 2024-04-27T00:21:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21082.657263 secs 2024-04-27T00:21:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:25 smithi092 ceph-mon[29156]: pgmap v12105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:25 smithi189 ceph-mon[32756]: pgmap v12105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:25 smithi156 ceph-mon[32679]: pgmap v12105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:27 smithi092 ceph-mon[29156]: pgmap v12106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:27 smithi189 ceph-mon[32756]: pgmap v12106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:27 smithi156 ceph-mon[32679]: pgmap v12106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:30.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:29 smithi156 ceph-mon[32679]: pgmap v12107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:30.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21784.688651 secs 2024-04-27T00:21:30.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21087.657379 secs 2024-04-27T00:21:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:29 smithi092 ceph-mon[29156]: pgmap v12107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21784.688651 secs 2024-04-27T00:21:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21087.657379 secs 2024-04-27T00:21:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:29 smithi189 ceph-mon[32756]: pgmap v12107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21784.688651 secs 2024-04-27T00:21:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21087.657379 secs 2024-04-27T00:21:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:31 smithi092 ceph-mon[29156]: pgmap v12108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:31 smithi189 ceph-mon[32756]: pgmap v12108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:31 smithi156 ceph-mon[32679]: pgmap v12108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:33 smithi092 ceph-mon[29156]: pgmap v12109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:33 smithi189 ceph-mon[32756]: pgmap v12109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:33 smithi156 ceph-mon[32679]: pgmap v12109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21789.688759 secs 2024-04-27T00:21:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21092.657499 secs 2024-04-27T00:21:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21789.688759 secs 2024-04-27T00:21:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21092.657499 secs 2024-04-27T00:21:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21789.688759 secs 2024-04-27T00:21:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21092.657499 secs 2024-04-27T00:21:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:35 smithi092 ceph-mon[29156]: pgmap v12110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:35 smithi189 ceph-mon[32756]: pgmap v12110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:35 smithi156 ceph-mon[32679]: pgmap v12110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:37 smithi092 ceph-mon[29156]: pgmap v12111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:37 smithi189 ceph-mon[32756]: pgmap v12111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:37 smithi156 ceph-mon[32679]: pgmap v12111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 169 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:21:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:21:38.970+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 170 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:21:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:39 smithi092 ceph-mon[29156]: pgmap v12112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21794.688901 secs 2024-04-27T00:21:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21097.657614 secs 2024-04-27T00:21:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:39 smithi189 ceph-mon[32756]: pgmap v12112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21794.688901 secs 2024-04-27T00:21:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21097.657614 secs 2024-04-27T00:21:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:39 smithi156 ceph-mon[32679]: pgmap v12112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21794.688901 secs 2024-04-27T00:21:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21097.657614 secs 2024-04-27T00:21:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:41 smithi092 ceph-mon[29156]: pgmap v12113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:41 smithi189 ceph-mon[32756]: pgmap v12113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:41 smithi156 ceph-mon[32679]: pgmap v12113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:43 smithi092 ceph-mon[29156]: pgmap v12114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:43 smithi189 ceph-mon[32756]: pgmap v12114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:43 smithi156 ceph-mon[32679]: pgmap v12114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21799.688981 secs 2024-04-27T00:21:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21102.657729 secs 2024-04-27T00:21:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21799.688981 secs 2024-04-27T00:21:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21102.657729 secs 2024-04-27T00:21:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21799.688981 secs 2024-04-27T00:21:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21102.657729 secs 2024-04-27T00:21:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:45 smithi092 ceph-mon[29156]: pgmap v12115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:45 smithi189 ceph-mon[32756]: pgmap v12115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:45 smithi156 ceph-mon[32679]: pgmap v12115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:46 smithi189 ceph-mon[32756]: pgmap v12116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:46 smithi156 ceph-mon[32679]: pgmap v12116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:46 smithi092 ceph-mon[29156]: pgmap v12116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:49 smithi189 ceph-mon[32756]: pgmap v12117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21804.689076 secs 2024-04-27T00:21:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21107.657869 secs 2024-04-27T00:21:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:49 smithi156 ceph-mon[32679]: pgmap v12117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21804.689076 secs 2024-04-27T00:21:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21107.657869 secs 2024-04-27T00:21:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:49 smithi092 ceph-mon[29156]: pgmap v12117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21804.689076 secs 2024-04-27T00:21:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21107.657869 secs 2024-04-27T00:21:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:51 smithi189 ceph-mon[32756]: pgmap v12118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:51 smithi156 ceph-mon[32679]: pgmap v12118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:51 smithi092 ceph-mon[29156]: pgmap v12118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:53 smithi189 ceph-mon[32756]: pgmap v12119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:53 smithi156 ceph-mon[32679]: pgmap v12119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:53 smithi092 ceph-mon[29156]: pgmap v12119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21809.689145 secs 2024-04-27T00:21:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21112.657982 secs 2024-04-27T00:21:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21809.689145 secs 2024-04-27T00:21:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21112.657982 secs 2024-04-27T00:21:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21809.689145 secs 2024-04-27T00:21:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21112.657982 secs 2024-04-27T00:21:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:55 smithi189 ceph-mon[32756]: pgmap v12120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:55 smithi156 ceph-mon[32679]: pgmap v12120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:55 smithi092 ceph-mon[29156]: pgmap v12120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:57 smithi189 ceph-mon[32756]: pgmap v12121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:57 smithi156 ceph-mon[32679]: pgmap v12121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:57 smithi092 ceph-mon[29156]: pgmap v12121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:21:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: pgmap v12122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21814.689257 secs 2024-04-27T00:21:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:21:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21117.658051 secs 2024-04-27T00:21:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:21:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:21:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:21:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: pgmap v12122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21814.689257 secs 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21117.658051 secs 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:21:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:21:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: pgmap v12122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21814.689257 secs 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21117.658051 secs 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:21:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:21:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:22:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:00 smithi189 ceph-mon[32756]: pgmap v12123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:22:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:00 smithi189 ceph-mon[32756]: pgmap v12124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:00 smithi156 ceph-mon[32679]: pgmap v12123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:22:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:00 smithi156 ceph-mon[32679]: pgmap v12124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:00 smithi092 ceph-mon[29156]: pgmap v12123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:22:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:00 smithi092 ceph-mon[29156]: pgmap v12124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:02.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:02 smithi189 ceph-mon[32756]: pgmap v12125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:02 smithi156 ceph-mon[32679]: pgmap v12125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:02 smithi092 ceph-mon[29156]: pgmap v12125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:04 smithi189 ceph-mon[32756]: pgmap v12126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21819.689367 secs 2024-04-27T00:22:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21122.658186 secs 2024-04-27T00:22:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:04 smithi156 ceph-mon[32679]: pgmap v12126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21819.689367 secs 2024-04-27T00:22:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21122.658186 secs 2024-04-27T00:22:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:04 smithi092 ceph-mon[29156]: pgmap v12126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21819.689367 secs 2024-04-27T00:22:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21122.658186 secs 2024-04-27T00:22:06.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:06 smithi189 ceph-mon[32756]: pgmap v12127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:06 smithi156 ceph-mon[32679]: pgmap v12127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:06 smithi092 ceph-mon[29156]: pgmap v12127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:22:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:08 smithi156 ceph-mon[32679]: pgmap v12128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:08 smithi092 ceph-mon[29156]: pgmap v12128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:08 smithi189 ceph-mon[32756]: pgmap v12128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:22:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21824.689476 secs 2024-04-27T00:22:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21127.658316 secs 2024-04-27T00:22:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21824.689476 secs 2024-04-27T00:22:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21127.658316 secs 2024-04-27T00:22:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21824.689476 secs 2024-04-27T00:22:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21127.658316 secs 2024-04-27T00:22:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:10 smithi156 ceph-mon[32679]: pgmap v12129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:22:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:10 smithi092 ceph-mon[29156]: pgmap v12129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:22:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:10 smithi189 ceph-mon[32756]: pgmap v12129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:22:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:12 smithi156 ceph-mon[32679]: pgmap v12130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:12 smithi092 ceph-mon[29156]: pgmap v12130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:12 smithi189 ceph-mon[32756]: pgmap v12130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:14 smithi156 ceph-mon[32679]: pgmap v12131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21829.689593 secs 2024-04-27T00:22:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21132.658375 secs 2024-04-27T00:22:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:14 smithi092 ceph-mon[29156]: pgmap v12131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21829.689593 secs 2024-04-27T00:22:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21132.658375 secs 2024-04-27T00:22:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:14 smithi189 ceph-mon[32756]: pgmap v12131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21829.689593 secs 2024-04-27T00:22:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21132.658375 secs 2024-04-27T00:22:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:16 smithi156 ceph-mon[32679]: pgmap v12132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:16 smithi092 ceph-mon[29156]: pgmap v12132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:16 smithi189 ceph-mon[32756]: pgmap v12132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:18 smithi156 ceph-mon[32679]: pgmap v12133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:18 smithi092 ceph-mon[29156]: pgmap v12133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:18 smithi189 ceph-mon[32756]: pgmap v12133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21834.689656 secs 2024-04-27T00:22:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21137.658468 secs 2024-04-27T00:22:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21834.689656 secs 2024-04-27T00:22:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21137.658468 secs 2024-04-27T00:22:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21834.689656 secs 2024-04-27T00:22:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21137.658468 secs 2024-04-27T00:22:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:20 smithi156 ceph-mon[32679]: pgmap v12134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:20 smithi092 ceph-mon[29156]: pgmap v12134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:20 smithi189 ceph-mon[32756]: pgmap v12134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:22 smithi156 ceph-mon[32679]: pgmap v12135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:22 smithi092 ceph-mon[29156]: pgmap v12135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:22 smithi189 ceph-mon[32756]: pgmap v12135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:24 smithi156 ceph-mon[32679]: pgmap v12136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21839.689766 secs 2024-04-27T00:22:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21142.658532 secs 2024-04-27T00:22:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:24 smithi092 ceph-mon[29156]: pgmap v12136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21839.689766 secs 2024-04-27T00:22:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21142.658532 secs 2024-04-27T00:22:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:24 smithi189 ceph-mon[32756]: pgmap v12136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21839.689766 secs 2024-04-27T00:22:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21142.658532 secs 2024-04-27T00:22:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:26 smithi156 ceph-mon[32679]: pgmap v12137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:26 smithi092 ceph-mon[29156]: pgmap v12137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:26 smithi189 ceph-mon[32756]: pgmap v12137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:28 smithi156 ceph-mon[32679]: pgmap v12138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:28 smithi092 ceph-mon[29156]: pgmap v12138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:28 smithi189 ceph-mon[32756]: pgmap v12138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21844.689881 secs 2024-04-27T00:22:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21147.658644 secs 2024-04-27T00:22:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21844.689881 secs 2024-04-27T00:22:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21147.658644 secs 2024-04-27T00:22:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21844.689881 secs 2024-04-27T00:22:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21147.658644 secs 2024-04-27T00:22:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:30 smithi092 ceph-mon[29156]: pgmap v12139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:31.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:30 smithi156 ceph-mon[32679]: pgmap v12139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:30 smithi189 ceph-mon[32756]: pgmap v12139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:32 smithi092 ceph-mon[29156]: pgmap v12140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:32 smithi189 ceph-mon[32756]: pgmap v12140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:32 smithi156 ceph-mon[32679]: pgmap v12140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:34 smithi092 ceph-mon[29156]: pgmap v12141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21849.689946 secs 2024-04-27T00:22:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21152.658732 secs 2024-04-27T00:22:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:34 smithi189 ceph-mon[32756]: pgmap v12141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21849.689946 secs 2024-04-27T00:22:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21152.658732 secs 2024-04-27T00:22:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:34 smithi156 ceph-mon[32679]: pgmap v12141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21849.689946 secs 2024-04-27T00:22:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21152.658732 secs 2024-04-27T00:22:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:36 smithi092 ceph-mon[29156]: pgmap v12142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:36 smithi189 ceph-mon[32756]: pgmap v12142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:36 smithi156 ceph-mon[32679]: pgmap v12142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:38 smithi092 ceph-mon[29156]: pgmap v12143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:38 smithi189 ceph-mon[32756]: pgmap v12143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:38 smithi156 ceph-mon[32679]: pgmap v12143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21854.690009 secs 2024-04-27T00:22:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21157.658883 secs 2024-04-27T00:22:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21854.690009 secs 2024-04-27T00:22:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21157.658883 secs 2024-04-27T00:22:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21854.690009 secs 2024-04-27T00:22:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21157.658883 secs 2024-04-27T00:22:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:40 smithi092 ceph-mon[29156]: pgmap v12144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:40 smithi189 ceph-mon[32756]: pgmap v12144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:40 smithi156 ceph-mon[32679]: pgmap v12144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:42 smithi092 ceph-mon[29156]: pgmap v12145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:42 smithi189 ceph-mon[32756]: pgmap v12145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:42 smithi156 ceph-mon[32679]: pgmap v12145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:44 smithi092 ceph-mon[29156]: pgmap v12146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21859.690083 secs 2024-04-27T00:22:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21162.659015 secs 2024-04-27T00:22:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:44 smithi189 ceph-mon[32756]: pgmap v12146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21859.690083 secs 2024-04-27T00:22:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21162.659015 secs 2024-04-27T00:22:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:44 smithi156 ceph-mon[32679]: pgmap v12146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21859.690083 secs 2024-04-27T00:22:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21162.659015 secs 2024-04-27T00:22:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:46 smithi092 ceph-mon[29156]: pgmap v12147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:46 smithi189 ceph-mon[32756]: pgmap v12147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:46 smithi156 ceph-mon[32679]: pgmap v12147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:48 smithi092 ceph-mon[29156]: pgmap v12148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:48 smithi189 ceph-mon[32756]: pgmap v12148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:48 smithi156 ceph-mon[32679]: pgmap v12148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21864.690204 secs 2024-04-27T00:22:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21167.659166 secs 2024-04-27T00:22:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21864.690204 secs 2024-04-27T00:22:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21167.659166 secs 2024-04-27T00:22:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21864.690204 secs 2024-04-27T00:22:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21167.659166 secs 2024-04-27T00:22:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:50 smithi092 ceph-mon[29156]: pgmap v12149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:50 smithi189 ceph-mon[32756]: pgmap v12149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:50 smithi156 ceph-mon[32679]: pgmap v12149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:52 smithi092 ceph-mon[29156]: pgmap v12150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:52 smithi189 ceph-mon[32756]: pgmap v12150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:52 smithi156 ceph-mon[32679]: pgmap v12150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:54 smithi092 ceph-mon[29156]: pgmap v12151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21869.690298 secs 2024-04-27T00:22:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21172.659220 secs 2024-04-27T00:22:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:54 smithi189 ceph-mon[32756]: pgmap v12151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21869.690298 secs 2024-04-27T00:22:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21172.659220 secs 2024-04-27T00:22:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:54 smithi156 ceph-mon[32679]: pgmap v12151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21869.690298 secs 2024-04-27T00:22:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21172.659220 secs 2024-04-27T00:22:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:56 smithi092 ceph-mon[29156]: pgmap v12152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:56 smithi189 ceph-mon[32756]: pgmap v12152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:56 smithi156 ceph-mon[32679]: pgmap v12152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:22:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:58 smithi189 ceph-mon[32756]: pgmap v12153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:58 smithi156 ceph-mon[32679]: pgmap v12153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:22:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:58 smithi092 ceph-mon[29156]: pgmap v12153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21874.690421 secs 2024-04-27T00:23:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21177.659357 secs 2024-04-27T00:23:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:22:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:23:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21874.690421 secs 2024-04-27T00:23:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21177.659357 secs 2024-04-27T00:23:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:22:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:23:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21874.690421 secs 2024-04-27T00:23:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21177.659357 secs 2024-04-27T00:23:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:22:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:23:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:00 smithi092 ceph-mon[29156]: pgmap v12154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:23:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:23:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:23:01.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:00 smithi156 ceph-mon[32679]: pgmap v12154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:01.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:23:01.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:23:01.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:23:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:00 smithi189 ceph-mon[32756]: pgmap v12154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:23:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:23:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:23:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:01 smithi189 ceph-mon[32756]: pgmap v12155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:23:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:01 smithi189 ceph-mon[32756]: pgmap v12156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:01 smithi156 ceph-mon[32679]: pgmap v12155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:23:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:01 smithi156 ceph-mon[32679]: pgmap v12156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:01 smithi092 ceph-mon[29156]: pgmap v12155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:23:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:01 smithi092 ceph-mon[29156]: pgmap v12156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:03 smithi189 ceph-mon[32756]: pgmap v12157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:03 smithi156 ceph-mon[32679]: pgmap v12157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:03 smithi092 ceph-mon[29156]: pgmap v12157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:05.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21879.690544 secs 2024-04-27T00:23:05.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21182.659420 secs 2024-04-27T00:23:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21879.690544 secs 2024-04-27T00:23:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21182.659420 secs 2024-04-27T00:23:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21879.690544 secs 2024-04-27T00:23:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21182.659420 secs 2024-04-27T00:23:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:05 smithi189 ceph-mon[32756]: pgmap v12158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:05 smithi156 ceph-mon[32679]: pgmap v12158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:05 smithi092 ceph-mon[29156]: pgmap v12158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:07 smithi189 ceph-mon[32756]: pgmap v12159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:07 smithi156 ceph-mon[32679]: pgmap v12159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:07 smithi092 ceph-mon[29156]: pgmap v12159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:23:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:09 smithi189 ceph-mon[32756]: pgmap v12160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:23:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21884.690684 secs 2024-04-27T00:23:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21187.659546 secs 2024-04-27T00:23:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:09 smithi156 ceph-mon[32679]: pgmap v12160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:23:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21884.690684 secs 2024-04-27T00:23:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21187.659546 secs 2024-04-27T00:23:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:09 smithi092 ceph-mon[29156]: pgmap v12160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:23:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21884.690684 secs 2024-04-27T00:23:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21187.659546 secs 2024-04-27T00:23:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:11 smithi189 ceph-mon[32756]: pgmap v12161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:23:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:11 smithi156 ceph-mon[32679]: pgmap v12161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:23:12.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:11 smithi092 ceph-mon[29156]: pgmap v12161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:23:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:13 smithi189 ceph-mon[32756]: pgmap v12162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:13 smithi156 ceph-mon[32679]: pgmap v12162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:13 smithi092 ceph-mon[29156]: pgmap v12162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21889.690844 secs 2024-04-27T00:23:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21192.659608 secs 2024-04-27T00:23:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21889.690844 secs 2024-04-27T00:23:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21192.659608 secs 2024-04-27T00:23:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21889.690844 secs 2024-04-27T00:23:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21192.659608 secs 2024-04-27T00:23:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:15 smithi189 ceph-mon[32756]: pgmap v12163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:15 smithi156 ceph-mon[32679]: pgmap v12163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:15 smithi092 ceph-mon[29156]: pgmap v12163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:17 smithi189 ceph-mon[32756]: pgmap v12164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:17 smithi156 ceph-mon[32679]: pgmap v12164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:17 smithi092 ceph-mon[29156]: pgmap v12164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:19 smithi189 ceph-mon[32756]: pgmap v12165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21894.690941 secs 2024-04-27T00:23:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21197.659727 secs 2024-04-27T00:23:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:19 smithi156 ceph-mon[32679]: pgmap v12165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21894.690941 secs 2024-04-27T00:23:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21197.659727 secs 2024-04-27T00:23:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:19 smithi092 ceph-mon[29156]: pgmap v12165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21894.690941 secs 2024-04-27T00:23:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21197.659727 secs 2024-04-27T00:23:22.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:21 smithi092 ceph-mon[29156]: pgmap v12166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:21 smithi189 ceph-mon[32756]: pgmap v12166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:21 smithi156 ceph-mon[32679]: pgmap v12166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:23 smithi189 ceph-mon[32756]: pgmap v12167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:23 smithi156 ceph-mon[32679]: pgmap v12167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:23 smithi092 ceph-mon[29156]: pgmap v12167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21899.691036 secs 2024-04-27T00:23:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21202.659782 secs 2024-04-27T00:23:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21899.691036 secs 2024-04-27T00:23:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21202.659782 secs 2024-04-27T00:23:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21899.691036 secs 2024-04-27T00:23:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21202.659782 secs 2024-04-27T00:23:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:25 smithi189 ceph-mon[32756]: pgmap v12168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:25 smithi156 ceph-mon[32679]: pgmap v12168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:25 smithi092 ceph-mon[29156]: pgmap v12168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:27 smithi189 ceph-mon[32756]: pgmap v12169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:27 smithi156 ceph-mon[32679]: pgmap v12169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:28.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:27 smithi092 ceph-mon[29156]: pgmap v12169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:29 smithi189 ceph-mon[32756]: pgmap v12170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21904.691115 secs 2024-04-27T00:23:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21207.659924 secs 2024-04-27T00:23:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:29 smithi156 ceph-mon[32679]: pgmap v12170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21904.691115 secs 2024-04-27T00:23:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21207.659924 secs 2024-04-27T00:23:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:29 smithi092 ceph-mon[29156]: pgmap v12170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21904.691115 secs 2024-04-27T00:23:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21207.659924 secs 2024-04-27T00:23:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:31 smithi189 ceph-mon[32756]: pgmap v12171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:31 smithi156 ceph-mon[32679]: pgmap v12171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:31 smithi092 ceph-mon[29156]: pgmap v12171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:33 smithi189 ceph-mon[32756]: pgmap v12172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:34.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:33 smithi156 ceph-mon[32679]: pgmap v12172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:34.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:33 smithi092 ceph-mon[29156]: pgmap v12172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21909.691242 secs 2024-04-27T00:23:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21212.660060 secs 2024-04-27T00:23:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21909.691242 secs 2024-04-27T00:23:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21212.660060 secs 2024-04-27T00:23:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21909.691242 secs 2024-04-27T00:23:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21212.660060 secs 2024-04-27T00:23:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:35 smithi189 ceph-mon[32756]: pgmap v12173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:35 smithi156 ceph-mon[32679]: pgmap v12173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:35 smithi092 ceph-mon[29156]: pgmap v12173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:37 smithi189 ceph-mon[32756]: pgmap v12174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:37 smithi156 ceph-mon[32679]: pgmap v12174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:37 smithi092 ceph-mon[29156]: pgmap v12174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:39 smithi189 ceph-mon[32756]: pgmap v12175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21914.691359 secs 2024-04-27T00:23:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21217.660197 secs 2024-04-27T00:23:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:39 smithi156 ceph-mon[32679]: pgmap v12175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21914.691359 secs 2024-04-27T00:23:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21217.660197 secs 2024-04-27T00:23:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:39 smithi092 ceph-mon[29156]: pgmap v12175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21914.691359 secs 2024-04-27T00:23:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21217.660197 secs 2024-04-27T00:23:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:41 smithi189 ceph-mon[32756]: pgmap v12176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:41 smithi156 ceph-mon[32679]: pgmap v12176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:42.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:41 smithi092 ceph-mon[29156]: pgmap v12176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:43 smithi189 ceph-mon[32756]: pgmap v12177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:43 smithi156 ceph-mon[32679]: pgmap v12177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:43 smithi092 ceph-mon[29156]: pgmap v12177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21919.691482 secs 2024-04-27T00:23:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21222.660330 secs 2024-04-27T00:23:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21919.691482 secs 2024-04-27T00:23:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21222.660330 secs 2024-04-27T00:23:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21919.691482 secs 2024-04-27T00:23:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21222.660330 secs 2024-04-27T00:23:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:45 smithi189 ceph-mon[32756]: pgmap v12178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:45 smithi156 ceph-mon[32679]: pgmap v12178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:45 smithi092 ceph-mon[29156]: pgmap v12178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:47 smithi189 ceph-mon[32756]: pgmap v12179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:47 smithi156 ceph-mon[32679]: pgmap v12179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:47 smithi092 ceph-mon[29156]: pgmap v12179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:49 smithi189 ceph-mon[32756]: pgmap v12180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21924.691632 secs 2024-04-27T00:23:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21227.660455 secs 2024-04-27T00:23:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:49 smithi156 ceph-mon[32679]: pgmap v12180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21924.691632 secs 2024-04-27T00:23:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21227.660455 secs 2024-04-27T00:23:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:49 smithi092 ceph-mon[29156]: pgmap v12180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T00:23:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21924.691632 secs 2024-04-27T00:23:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21227.660455 secs 2024-04-27T00:23:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:51 smithi189 ceph-mon[32756]: pgmap v12181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:52.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:51 smithi156 ceph-mon[32679]: pgmap v12181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:52.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:51 smithi092 ceph-mon[29156]: pgmap v12181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T00:23:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:53 smithi189 ceph-mon[32756]: pgmap v12182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:53 smithi156 ceph-mon[32679]: pgmap v12182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:53 smithi092 ceph-mon[29156]: pgmap v12182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21929.691755 secs 2024-04-27T00:23:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21232.660570 secs 2024-04-27T00:23:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21929.691755 secs 2024-04-27T00:23:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21232.660570 secs 2024-04-27T00:23:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21929.691755 secs 2024-04-27T00:23:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21232.660570 secs 2024-04-27T00:23:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:55 smithi189 ceph-mon[32756]: pgmap v12183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:55 smithi156 ceph-mon[32679]: pgmap v12183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:55 smithi092 ceph-mon[29156]: pgmap v12183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:23:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:57 smithi189 ceph-mon[32756]: pgmap v12184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:57 smithi156 ceph-mon[32679]: pgmap v12184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:23:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:57 smithi092 ceph-mon[29156]: pgmap v12184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:59 smithi189 ceph-mon[32756]: pgmap v12185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21934.691857 secs 2024-04-27T00:24:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:23:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21237.660670 secs 2024-04-27T00:24:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:59 smithi156 ceph-mon[32679]: pgmap v12185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21934.691857 secs 2024-04-27T00:24:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:23:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21237.660670 secs 2024-04-27T00:24:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:59 smithi092 ceph-mon[29156]: pgmap v12185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21934.691857 secs 2024-04-27T00:24:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:23:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21237.660670 secs 2024-04-27T00:24:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:24:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:24:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:24:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: pgmap v12186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:24:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:24:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: pgmap v12187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:24:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: pgmap v12188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: pgmap v12186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: pgmap v12187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: pgmap v12188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: pgmap v12186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: pgmap v12187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: pgmap v12188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:24:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:03 smithi189 ceph-mon[32756]: pgmap v12189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:24:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:03 smithi156 ceph-mon[32679]: pgmap v12189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:24:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:03 smithi092 ceph-mon[29156]: pgmap v12189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:24:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 21939.691975 secs 2024-04-27T00:24:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:04 smithi156 ceph-mon[32679]: slow request 1442.714052 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:24:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21242.660748 secs 2024-04-27T00:24:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 21939.691975 secs 2024-04-27T00:24:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:04 smithi092 ceph-mon[29156]: slow request 1442.714052 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:24:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21242.660748 secs 2024-04-27T00:24:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 21939.691975 secs 2024-04-27T00:24:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:04 smithi189 ceph-mon[32756]: slow request 1442.714052 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:24:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21242.660748 secs 2024-04-27T00:24:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:05 smithi156 ceph-mon[32679]: pgmap v12190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:05 smithi092 ceph-mon[29156]: pgmap v12190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:05 smithi189 ceph-mon[32756]: pgmap v12190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:24:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:24:06.589+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:24:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:24:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:24:06.589+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:24:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:24:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:24:06.589+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:24:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:24:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:24:06.589+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:24:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:24:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:24:06.589+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:24:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:07 smithi156 ceph-mon[32679]: pgmap v12191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:07 smithi092 ceph-mon[29156]: pgmap v12191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:07 smithi189 ceph-mon[32756]: pgmap v12191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:24:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21944.692095 secs 2024-04-27T00:24:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21247.660868 secs 2024-04-27T00:24:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:09 smithi156 ceph-mon[32679]: pgmap v12192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T00:24:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21944.692095 secs 2024-04-27T00:24:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21247.660868 secs 2024-04-27T00:24:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:09 smithi092 ceph-mon[29156]: pgmap v12192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T00:24:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21944.692095 secs 2024-04-27T00:24:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21247.660868 secs 2024-04-27T00:24:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:09 smithi189 ceph-mon[32756]: pgmap v12192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T00:24:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:11 smithi156 ceph-mon[32679]: pgmap v12193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T00:24:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:11 smithi092 ceph-mon[29156]: pgmap v12193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T00:24:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:11 smithi189 ceph-mon[32756]: pgmap v12193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T00:24:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:13 smithi156 ceph-mon[32679]: pgmap v12194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:13 smithi092 ceph-mon[29156]: pgmap v12194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:13 smithi189 ceph-mon[32756]: pgmap v12194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21949.692174 secs 2024-04-27T00:24:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21252.661006 secs 2024-04-27T00:24:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21949.692174 secs 2024-04-27T00:24:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21252.661006 secs 2024-04-27T00:24:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21949.692174 secs 2024-04-27T00:24:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21252.661006 secs 2024-04-27T00:24:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:15 smithi156 ceph-mon[32679]: pgmap v12195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:15 smithi092 ceph-mon[29156]: pgmap v12195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:15 smithi189 ceph-mon[32756]: pgmap v12195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:17 smithi156 ceph-mon[32679]: pgmap v12196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:17 smithi092 ceph-mon[29156]: pgmap v12196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:17 smithi189 ceph-mon[32756]: pgmap v12196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21954.692302 secs 2024-04-27T00:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21257.661122 secs 2024-04-27T00:24:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:19 smithi156 ceph-mon[32679]: pgmap v12197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21954.692302 secs 2024-04-27T00:24:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21257.661122 secs 2024-04-27T00:24:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:19 smithi092 ceph-mon[29156]: pgmap v12197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21954.692302 secs 2024-04-27T00:24:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21257.661122 secs 2024-04-27T00:24:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:19 smithi189 ceph-mon[32756]: pgmap v12197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:24:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:21 smithi156 ceph-mon[32679]: pgmap v12198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:21 smithi092 ceph-mon[29156]: pgmap v12198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:21 smithi189 ceph-mon[32756]: pgmap v12198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:23 smithi156 ceph-mon[32679]: pgmap v12199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:23 smithi092 ceph-mon[29156]: pgmap v12199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:23 smithi189 ceph-mon[32756]: pgmap v12199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21959.692365 secs 2024-04-27T00:24:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21262.661184 secs 2024-04-27T00:24:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21959.692365 secs 2024-04-27T00:24:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21262.661184 secs 2024-04-27T00:24:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21959.692365 secs 2024-04-27T00:24:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21262.661184 secs 2024-04-27T00:24:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:25 smithi156 ceph-mon[32679]: pgmap v12200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:26.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:25 smithi092 ceph-mon[29156]: pgmap v12200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:25 smithi189 ceph-mon[32756]: pgmap v12200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:27 smithi092 ceph-mon[29156]: pgmap v12201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:27 smithi189 ceph-mon[32756]: pgmap v12201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:27 smithi156 ceph-mon[32679]: pgmap v12201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21964.692485 secs 2024-04-27T00:24:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21267.661345 secs 2024-04-27T00:24:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:29 smithi092 ceph-mon[29156]: pgmap v12202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21964.692485 secs 2024-04-27T00:24:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21267.661345 secs 2024-04-27T00:24:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:29 smithi189 ceph-mon[32756]: pgmap v12202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21964.692485 secs 2024-04-27T00:24:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21267.661345 secs 2024-04-27T00:24:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:29 smithi156 ceph-mon[32679]: pgmap v12202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:32.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:31 smithi156 ceph-mon[32679]: pgmap v12203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:31 smithi092 ceph-mon[29156]: pgmap v12203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:31 smithi189 ceph-mon[32756]: pgmap v12203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:33 smithi092 ceph-mon[29156]: pgmap v12204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:33 smithi189 ceph-mon[32756]: pgmap v12204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:33 smithi156 ceph-mon[32679]: pgmap v12204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21969.692633 secs 2024-04-27T00:24:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21272.661472 secs 2024-04-27T00:24:35.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21969.692633 secs 2024-04-27T00:24:35.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21272.661472 secs 2024-04-27T00:24:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21969.692633 secs 2024-04-27T00:24:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21272.661472 secs 2024-04-27T00:24:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:35 smithi092 ceph-mon[29156]: pgmap v12205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:35 smithi189 ceph-mon[32756]: pgmap v12205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:35 smithi156 ceph-mon[32679]: pgmap v12205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:37 smithi092 ceph-mon[29156]: pgmap v12206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:37 smithi189 ceph-mon[32756]: pgmap v12206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:37 smithi156 ceph-mon[32679]: pgmap v12206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:24:38.995+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:24:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:24:38.995+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:24:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:24:38.995+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:24:38.995 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:24:38.995+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 171 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:24:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21974.692770 secs 2024-04-27T00:24:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21277.661589 secs 2024-04-27T00:24:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:39 smithi092 ceph-mon[29156]: pgmap v12207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21974.692770 secs 2024-04-27T00:24:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21277.661589 secs 2024-04-27T00:24:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:39 smithi189 ceph-mon[32756]: pgmap v12207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21974.692770 secs 2024-04-27T00:24:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21277.661589 secs 2024-04-27T00:24:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:39 smithi156 ceph-mon[32679]: pgmap v12207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:41 smithi092 ceph-mon[29156]: pgmap v12208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:41 smithi189 ceph-mon[32756]: pgmap v12208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:41 smithi156 ceph-mon[32679]: pgmap v12208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:43 smithi092 ceph-mon[29156]: pgmap v12209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:43 smithi189 ceph-mon[32756]: pgmap v12209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:43 smithi156 ceph-mon[32679]: pgmap v12209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21979.692882 secs 2024-04-27T00:24:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21282.661708 secs 2024-04-27T00:24:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21979.692882 secs 2024-04-27T00:24:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21282.661708 secs 2024-04-27T00:24:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21979.692882 secs 2024-04-27T00:24:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21282.661708 secs 2024-04-27T00:24:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:45 smithi092 ceph-mon[29156]: pgmap v12210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:45 smithi189 ceph-mon[32756]: pgmap v12210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:45 smithi156 ceph-mon[32679]: pgmap v12210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:47 smithi092 ceph-mon[29156]: pgmap v12211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:47 smithi189 ceph-mon[32756]: pgmap v12211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:47 smithi156 ceph-mon[32679]: pgmap v12211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21984.692985 secs 2024-04-27T00:24:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21287.661832 secs 2024-04-27T00:24:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:49 smithi092 ceph-mon[29156]: pgmap v12212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21984.692985 secs 2024-04-27T00:24:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21287.661832 secs 2024-04-27T00:24:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:49 smithi189 ceph-mon[32756]: pgmap v12212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21984.692985 secs 2024-04-27T00:24:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21287.661832 secs 2024-04-27T00:24:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:49 smithi156 ceph-mon[32679]: pgmap v12212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:51 smithi092 ceph-mon[29156]: pgmap v12213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:51 smithi189 ceph-mon[32756]: pgmap v12213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:51 smithi156 ceph-mon[32679]: pgmap v12213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:53 smithi092 ceph-mon[29156]: pgmap v12214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:53 smithi189 ceph-mon[32756]: pgmap v12214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:53 smithi156 ceph-mon[32679]: pgmap v12214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21989.693070 secs 2024-04-27T00:24:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21292.661907 secs 2024-04-27T00:24:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21989.693070 secs 2024-04-27T00:24:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21292.661907 secs 2024-04-27T00:24:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21989.693070 secs 2024-04-27T00:24:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21292.661907 secs 2024-04-27T00:24:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:55 smithi092 ceph-mon[29156]: pgmap v12215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:55 smithi189 ceph-mon[32756]: pgmap v12215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:55 smithi156 ceph-mon[32679]: pgmap v12215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:24:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:57 smithi092 ceph-mon[29156]: pgmap v12216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:57 smithi189 ceph-mon[32756]: pgmap v12216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:24:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:57 smithi156 ceph-mon[32679]: pgmap v12216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21994.693193 secs 2024-04-27T00:25:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21297.662024 secs 2024-04-27T00:25:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:24:59 smithi189 ceph-mon[32756]: pgmap v12217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21994.693193 secs 2024-04-27T00:25:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21297.662024 secs 2024-04-27T00:25:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:24:59 smithi156 ceph-mon[32679]: pgmap v12217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21994.693193 secs 2024-04-27T00:25:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21297.662024 secs 2024-04-27T00:25:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:24:59 smithi092 ceph-mon[29156]: pgmap v12217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:25:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:25:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:25:02.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:02 smithi156 ceph-mon[32679]: pgmap v12218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:02.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:25:02.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:25:02.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:25:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:02 smithi189 ceph-mon[32756]: pgmap v12218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:25:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:25:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:25:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:02 smithi092 ceph-mon[29156]: pgmap v12218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:25:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:25:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:25:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:03 smithi189 ceph-mon[32756]: pgmap v12219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:25:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:03 smithi189 ceph-mon[32756]: pgmap v12220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:03 smithi156 ceph-mon[32679]: pgmap v12219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:25:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:03 smithi156 ceph-mon[32679]: pgmap v12220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:03 smithi092 ceph-mon[29156]: pgmap v12219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:25:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:03 smithi092 ceph-mon[29156]: pgmap v12220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 21999.693256 secs 2024-04-27T00:25:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:05 smithi189 ceph-mon[32756]: pgmap v12221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:05 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21302.662177 secs 2024-04-27T00:25:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 21999.693256 secs 2024-04-27T00:25:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:05 smithi156 ceph-mon[32679]: pgmap v12221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:05 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21302.662177 secs 2024-04-27T00:25:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 21999.693256 secs 2024-04-27T00:25:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:05 smithi092 ceph-mon[29156]: pgmap v12221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:05 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21302.662177 secs 2024-04-27T00:25:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:07 smithi189 ceph-mon[32756]: pgmap v12222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:07 smithi156 ceph-mon[32679]: pgmap v12222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:07 smithi092 ceph-mon[29156]: pgmap v12222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:08 smithi189 ceph-mon[32756]: pgmap v12223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:25:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:08 smithi156 ceph-mon[32679]: pgmap v12223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:25:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:08 smithi092 ceph-mon[29156]: pgmap v12223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:25:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22004.693361 secs 2024-04-27T00:25:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21307.662312 secs 2024-04-27T00:25:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22004.693361 secs 2024-04-27T00:25:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21307.662312 secs 2024-04-27T00:25:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22004.693361 secs 2024-04-27T00:25:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21307.662312 secs 2024-04-27T00:25:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:10 smithi189 ceph-mon[32756]: pgmap v12224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:10 smithi156 ceph-mon[32679]: pgmap v12224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:10 smithi092 ceph-mon[29156]: pgmap v12224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:25:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:12 smithi092 ceph-mon[29156]: pgmap v12225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:25:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:12 smithi189 ceph-mon[32756]: pgmap v12225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:25:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:12 smithi156 ceph-mon[32679]: pgmap v12225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:25:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22009.693423 secs 2024-04-27T00:25:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:14 smithi092 ceph-mon[29156]: pgmap v12226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21312.662395 secs 2024-04-27T00:25:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22009.693423 secs 2024-04-27T00:25:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:14 smithi189 ceph-mon[32756]: pgmap v12226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21312.662395 secs 2024-04-27T00:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22009.693423 secs 2024-04-27T00:25:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:14 smithi156 ceph-mon[32679]: pgmap v12226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21312.662395 secs 2024-04-27T00:25:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:16 smithi092 ceph-mon[29156]: pgmap v12227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:16 smithi189 ceph-mon[32756]: pgmap v12227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:16 smithi156 ceph-mon[32679]: pgmap v12227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:18 smithi092 ceph-mon[29156]: pgmap v12228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:18 smithi189 ceph-mon[32756]: pgmap v12228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:18 smithi156 ceph-mon[32679]: pgmap v12228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22014.693488 secs 2024-04-27T00:25:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21317.662479 secs 2024-04-27T00:25:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22014.693488 secs 2024-04-27T00:25:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21317.662479 secs 2024-04-27T00:25:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22014.693488 secs 2024-04-27T00:25:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21317.662479 secs 2024-04-27T00:25:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:20 smithi092 ceph-mon[29156]: pgmap v12229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:20 smithi189 ceph-mon[32756]: pgmap v12229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:20 smithi156 ceph-mon[32679]: pgmap v12229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:22 smithi092 ceph-mon[29156]: pgmap v12230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:22 smithi189 ceph-mon[32756]: pgmap v12230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:22 smithi156 ceph-mon[32679]: pgmap v12230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22019.693554 secs 2024-04-27T00:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:24 smithi189 ceph-mon[32756]: pgmap v12231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21322.662599 secs 2024-04-27T00:25:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22019.693554 secs 2024-04-27T00:25:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:24 smithi156 ceph-mon[32679]: pgmap v12231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21322.662599 secs 2024-04-27T00:25:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22019.693554 secs 2024-04-27T00:25:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:24 smithi092 ceph-mon[29156]: pgmap v12231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21322.662599 secs 2024-04-27T00:25:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:26 smithi189 ceph-mon[32756]: pgmap v12232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:26 smithi156 ceph-mon[32679]: pgmap v12232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:26 smithi092 ceph-mon[29156]: pgmap v12232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:28 smithi189 ceph-mon[32756]: pgmap v12233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:28 smithi156 ceph-mon[32679]: pgmap v12233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:28 smithi092 ceph-mon[29156]: pgmap v12233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22024.693700 secs 2024-04-27T00:25:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21327.662731 secs 2024-04-27T00:25:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22024.693700 secs 2024-04-27T00:25:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21327.662731 secs 2024-04-27T00:25:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22024.693700 secs 2024-04-27T00:25:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21327.662731 secs 2024-04-27T00:25:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:30 smithi189 ceph-mon[32756]: pgmap v12234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:30 smithi156 ceph-mon[32679]: pgmap v12234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:30 smithi092 ceph-mon[29156]: pgmap v12234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:32 smithi189 ceph-mon[32756]: pgmap v12235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:32 smithi156 ceph-mon[32679]: pgmap v12235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:32 smithi092 ceph-mon[29156]: pgmap v12235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:25:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22029.693856 secs 2024-04-27T00:25:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:34 smithi189 ceph-mon[32756]: pgmap v12236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21332.662844 secs 2024-04-27T00:25:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22029.693856 secs 2024-04-27T00:25:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:34 smithi156 ceph-mon[32679]: pgmap v12236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21332.662844 secs 2024-04-27T00:25:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22029.693856 secs 2024-04-27T00:25:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:34 smithi092 ceph-mon[29156]: pgmap v12236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:25:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21332.662844 secs 2024-04-27T00:25:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:36 smithi189 ceph-mon[32756]: pgmap v12237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:36 smithi156 ceph-mon[32679]: pgmap v12237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:36 smithi092 ceph-mon[29156]: pgmap v12237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:38 smithi189 ceph-mon[32756]: pgmap v12238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:38 smithi156 ceph-mon[32679]: pgmap v12238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:38 smithi092 ceph-mon[29156]: pgmap v12238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22034.693903 secs 2024-04-27T00:25:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:39 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 21337.662971 secs 2024-04-27T00:25:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:39 smithi189 ceph-mon[32756]: slow request 722.393584 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:25:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22034.693903 secs 2024-04-27T00:25:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:39 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 21337.662971 secs 2024-04-27T00:25:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:39 smithi156 ceph-mon[32679]: slow request 722.393584 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:25:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22034.693903 secs 2024-04-27T00:25:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:39 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 21337.662971 secs 2024-04-27T00:25:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:39 smithi092 ceph-mon[29156]: slow request 722.393584 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:25:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:40 smithi189 ceph-mon[32756]: pgmap v12239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:40 smithi156 ceph-mon[32679]: pgmap v12239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:40 smithi092 ceph-mon[29156]: pgmap v12239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:42 smithi189 ceph-mon[32756]: pgmap v12240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:42 smithi156 ceph-mon[32679]: pgmap v12240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:43.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:42 smithi092 ceph-mon[29156]: pgmap v12240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22039.693981 secs 2024-04-27T00:25:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:44 smithi189 ceph-mon[32756]: pgmap v12241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21342.663039 secs 2024-04-27T00:25:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22039.693981 secs 2024-04-27T00:25:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:44 smithi156 ceph-mon[32679]: pgmap v12241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21342.663039 secs 2024-04-27T00:25:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22039.693981 secs 2024-04-27T00:25:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:44 smithi092 ceph-mon[29156]: pgmap v12241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21342.663039 secs 2024-04-27T00:25:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:46 smithi189 ceph-mon[32756]: pgmap v12242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:46 smithi156 ceph-mon[32679]: pgmap v12242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:46 smithi092 ceph-mon[29156]: pgmap v12242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:48 smithi189 ceph-mon[32756]: pgmap v12243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:48 smithi156 ceph-mon[32679]: pgmap v12243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:48 smithi092 ceph-mon[29156]: pgmap v12243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22044.694050 secs 2024-04-27T00:25:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21347.663179 secs 2024-04-27T00:25:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22044.694050 secs 2024-04-27T00:25:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21347.663179 secs 2024-04-27T00:25:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22044.694050 secs 2024-04-27T00:25:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21347.663179 secs 2024-04-27T00:25:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:50 smithi189 ceph-mon[32756]: pgmap v12244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:50 smithi156 ceph-mon[32679]: pgmap v12244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:50 smithi092 ceph-mon[29156]: pgmap v12244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:52 smithi189 ceph-mon[32756]: pgmap v12245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:52 smithi156 ceph-mon[32679]: pgmap v12245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:52 smithi092 ceph-mon[29156]: pgmap v12245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22049.694109 secs 2024-04-27T00:25:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:54 smithi189 ceph-mon[32756]: pgmap v12246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21352.663256 secs 2024-04-27T00:25:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22049.694109 secs 2024-04-27T00:25:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:54 smithi156 ceph-mon[32679]: pgmap v12246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21352.663256 secs 2024-04-27T00:25:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22049.694109 secs 2024-04-27T00:25:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:54 smithi092 ceph-mon[29156]: pgmap v12246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:25:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21352.663256 secs 2024-04-27T00:25:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:56 smithi189 ceph-mon[32756]: pgmap v12247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:56 smithi156 ceph-mon[32679]: pgmap v12247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:56 smithi092 ceph-mon[29156]: pgmap v12247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:58 smithi189 ceph-mon[32756]: pgmap v12248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:58 smithi156 ceph-mon[32679]: pgmap v12248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:25:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:58 smithi092 ceph-mon[29156]: pgmap v12248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22054.694204 secs 2024-04-27T00:26:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:25:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21357.663368 secs 2024-04-27T00:26:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22054.694204 secs 2024-04-27T00:26:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:25:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21357.663368 secs 2024-04-27T00:26:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22054.694204 secs 2024-04-27T00:26:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:25:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21357.663368 secs 2024-04-27T00:26:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:00 smithi189 ceph-mon[32756]: pgmap v12249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:00 smithi156 ceph-mon[32679]: pgmap v12249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:00 smithi092 ceph-mon[29156]: pgmap v12249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:02.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:26:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:26:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:26:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:02 smithi189 ceph-mon[32756]: pgmap v12250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:26:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:26:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:26:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:02 smithi156 ceph-mon[32679]: pgmap v12250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:26:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:26:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:26:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:02 smithi092 ceph-mon[29156]: pgmap v12250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:26:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:26:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:26:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:03 smithi189 ceph-mon[32756]: pgmap v12251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:26:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:03 smithi189 ceph-mon[32756]: pgmap v12252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:03 smithi156 ceph-mon[32679]: pgmap v12251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:26:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:03 smithi156 ceph-mon[32679]: pgmap v12252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:03 smithi092 ceph-mon[29156]: pgmap v12251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:26:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:03 smithi092 ceph-mon[29156]: pgmap v12252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22059.694321 secs 2024-04-27T00:26:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21362.663490 secs 2024-04-27T00:26:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22059.694321 secs 2024-04-27T00:26:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21362.663490 secs 2024-04-27T00:26:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22059.694321 secs 2024-04-27T00:26:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21362.663490 secs 2024-04-27T00:26:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:05 smithi189 ceph-mon[32756]: pgmap v12253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:05 smithi156 ceph-mon[32679]: pgmap v12253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:05 smithi092 ceph-mon[29156]: pgmap v12253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:07 smithi189 ceph-mon[32756]: pgmap v12254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:07 smithi156 ceph-mon[32679]: pgmap v12254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:07 smithi092 ceph-mon[29156]: pgmap v12254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:09 smithi189 ceph-mon[32756]: pgmap v12255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:10.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22064.694431 secs 2024-04-27T00:26:10.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21367.663573 secs 2024-04-27T00:26:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:09 smithi156 ceph-mon[32679]: pgmap v12255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22064.694431 secs 2024-04-27T00:26:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21367.663573 secs 2024-04-27T00:26:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:09 smithi092 ceph-mon[29156]: pgmap v12255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:26:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22064.694431 secs 2024-04-27T00:26:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21367.663573 secs 2024-04-27T00:26:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:11 smithi189 ceph-mon[32756]: pgmap v12256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:11 smithi156 ceph-mon[32679]: pgmap v12256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:11 smithi092 ceph-mon[29156]: pgmap v12256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:26:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:13 smithi189 ceph-mon[32756]: pgmap v12257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:26:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:13 smithi156 ceph-mon[32679]: pgmap v12257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:26:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:13 smithi092 ceph-mon[29156]: pgmap v12257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:26:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22069.694511 secs 2024-04-27T00:26:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21372.663713 secs 2024-04-27T00:26:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22069.694511 secs 2024-04-27T00:26:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21372.663713 secs 2024-04-27T00:26:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22069.694511 secs 2024-04-27T00:26:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21372.663713 secs 2024-04-27T00:26:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:15 smithi189 ceph-mon[32756]: pgmap v12258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:15 smithi156 ceph-mon[32679]: pgmap v12258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:15 smithi092 ceph-mon[29156]: pgmap v12258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:17 smithi189 ceph-mon[32756]: pgmap v12259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:17 smithi156 ceph-mon[32679]: pgmap v12259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:17 smithi092 ceph-mon[29156]: pgmap v12259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:19 smithi189 ceph-mon[32756]: pgmap v12260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22074.694644 secs 2024-04-27T00:26:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21377.663794 secs 2024-04-27T00:26:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:19 smithi156 ceph-mon[32679]: pgmap v12260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22074.694644 secs 2024-04-27T00:26:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21377.663794 secs 2024-04-27T00:26:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:19 smithi092 ceph-mon[29156]: pgmap v12260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22074.694644 secs 2024-04-27T00:26:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21377.663794 secs 2024-04-27T00:26:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:21 smithi189 ceph-mon[32756]: pgmap v12261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:21 smithi156 ceph-mon[32679]: pgmap v12261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:21 smithi092 ceph-mon[29156]: pgmap v12261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:23 smithi189 ceph-mon[32756]: pgmap v12262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:23 smithi156 ceph-mon[32679]: pgmap v12262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:23 smithi092 ceph-mon[29156]: pgmap v12262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22079.694777 secs 2024-04-27T00:26:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21382.663930 secs 2024-04-27T00:26:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22079.694777 secs 2024-04-27T00:26:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21382.663930 secs 2024-04-27T00:26:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22079.694777 secs 2024-04-27T00:26:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21382.663930 secs 2024-04-27T00:26:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:25 smithi189 ceph-mon[32756]: pgmap v12263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:25 smithi156 ceph-mon[32679]: pgmap v12263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:25 smithi092 ceph-mon[29156]: pgmap v12263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:27 smithi189 ceph-mon[32756]: pgmap v12264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:27 smithi156 ceph-mon[32679]: pgmap v12264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:27 smithi092 ceph-mon[29156]: pgmap v12264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:29 smithi156 ceph-mon[32679]: pgmap v12265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22084.694931 secs 2024-04-27T00:26:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21387.664057 secs 2024-04-27T00:26:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:29 smithi092 ceph-mon[29156]: pgmap v12265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22084.694931 secs 2024-04-27T00:26:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21387.664057 secs 2024-04-27T00:26:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:29 smithi189 ceph-mon[32756]: pgmap v12265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22084.694931 secs 2024-04-27T00:26:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21387.664057 secs 2024-04-27T00:26:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:31 smithi156 ceph-mon[32679]: pgmap v12266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:31 smithi092 ceph-mon[29156]: pgmap v12266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:31 smithi189 ceph-mon[32756]: pgmap v12266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:33 smithi156 ceph-mon[32679]: pgmap v12267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:33 smithi092 ceph-mon[29156]: pgmap v12267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:33 smithi189 ceph-mon[32756]: pgmap v12267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22089.695031 secs 2024-04-27T00:26:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21392.664201 secs 2024-04-27T00:26:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22089.695031 secs 2024-04-27T00:26:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21392.664201 secs 2024-04-27T00:26:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22089.695031 secs 2024-04-27T00:26:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21392.664201 secs 2024-04-27T00:26:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:35 smithi156 ceph-mon[32679]: pgmap v12268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:35 smithi092 ceph-mon[29156]: pgmap v12268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:36.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:35 smithi189 ceph-mon[32756]: pgmap v12268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:38.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:37 smithi092 ceph-mon[29156]: pgmap v12269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:37 smithi156 ceph-mon[32679]: pgmap v12269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:37 smithi189 ceph-mon[32756]: pgmap v12269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:39 smithi156 ceph-mon[32679]: pgmap v12270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22094.695113 secs 2024-04-27T00:26:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21397.664337 secs 2024-04-27T00:26:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:39 smithi092 ceph-mon[29156]: pgmap v12270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22094.695113 secs 2024-04-27T00:26:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21397.664337 secs 2024-04-27T00:26:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:39 smithi189 ceph-mon[32756]: pgmap v12270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22094.695113 secs 2024-04-27T00:26:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21397.664337 secs 2024-04-27T00:26:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:41 smithi156 ceph-mon[32679]: pgmap v12271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:41 smithi092 ceph-mon[29156]: pgmap v12271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:41 smithi189 ceph-mon[32756]: pgmap v12271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:43 smithi156 ceph-mon[32679]: pgmap v12272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:43 smithi092 ceph-mon[29156]: pgmap v12272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:43 smithi189 ceph-mon[32756]: pgmap v12272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22099.695187 secs 2024-04-27T00:26:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21402.664457 secs 2024-04-27T00:26:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22099.695187 secs 2024-04-27T00:26:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21402.664457 secs 2024-04-27T00:26:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22099.695187 secs 2024-04-27T00:26:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21402.664457 secs 2024-04-27T00:26:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:45 smithi156 ceph-mon[32679]: pgmap v12273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:45 smithi092 ceph-mon[29156]: pgmap v12273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:45 smithi189 ceph-mon[32756]: pgmap v12273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:47 smithi156 ceph-mon[32679]: pgmap v12274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:47 smithi092 ceph-mon[29156]: pgmap v12274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:47 smithi189 ceph-mon[32756]: pgmap v12274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:49 smithi092 ceph-mon[29156]: pgmap v12275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22104.695304 secs 2024-04-27T00:26:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21407.664575 secs 2024-04-27T00:26:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:49 smithi189 ceph-mon[32756]: pgmap v12275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22104.695304 secs 2024-04-27T00:26:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21407.664575 secs 2024-04-27T00:26:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:49 smithi156 ceph-mon[32679]: pgmap v12275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22104.695304 secs 2024-04-27T00:26:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21407.664575 secs 2024-04-27T00:26:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:51 smithi092 ceph-mon[29156]: pgmap v12276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:51 smithi189 ceph-mon[32756]: pgmap v12276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:51 smithi156 ceph-mon[32679]: pgmap v12276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:53 smithi092 ceph-mon[29156]: pgmap v12277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:53 smithi189 ceph-mon[32756]: pgmap v12277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:53 smithi156 ceph-mon[32679]: pgmap v12277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22109.695383 secs 2024-04-27T00:26:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21412.664639 secs 2024-04-27T00:26:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22109.695383 secs 2024-04-27T00:26:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21412.664639 secs 2024-04-27T00:26:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22109.695383 secs 2024-04-27T00:26:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21412.664639 secs 2024-04-27T00:26:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:55 smithi092 ceph-mon[29156]: pgmap v12278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:55 smithi189 ceph-mon[32756]: pgmap v12278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:55 smithi156 ceph-mon[32679]: pgmap v12278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:26:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:57 smithi092 ceph-mon[29156]: pgmap v12279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:57 smithi189 ceph-mon[32756]: pgmap v12279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:26:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:57 smithi156 ceph-mon[32679]: pgmap v12279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:59 smithi092 ceph-mon[29156]: pgmap v12280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22114.695478 secs 2024-04-27T00:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:26:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21417.664761 secs 2024-04-27T00:27:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:59 smithi189 ceph-mon[32756]: pgmap v12280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22114.695478 secs 2024-04-27T00:27:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:26:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21417.664761 secs 2024-04-27T00:27:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:59 smithi156 ceph-mon[32679]: pgmap v12280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22114.695478 secs 2024-04-27T00:27:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:26:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21417.664761 secs 2024-04-27T00:27:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:01 smithi092 ceph-mon[29156]: pgmap v12281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:01 smithi189 ceph-mon[32756]: pgmap v12281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:01 smithi156 ceph-mon[32679]: pgmap v12281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:27:03.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:27:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:03 smithi092 ceph-mon[29156]: pgmap v12282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:27:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:03 smithi189 ceph-mon[32756]: pgmap v12282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:27:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:27:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:27:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:03 smithi156 ceph-mon[32679]: pgmap v12282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:27:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:27:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:04 smithi092 ceph-mon[29156]: pgmap v12283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:04 smithi092 ceph-mon[29156]: pgmap v12284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22119.695573 secs 2024-04-27T00:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 21422.664872 secs 2024-04-27T00:27:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:04 smithi189 ceph-mon[32756]: pgmap v12283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:27:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:04 smithi189 ceph-mon[32756]: pgmap v12284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:27:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22119.695573 secs 2024-04-27T00:27:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 21422.664872 secs 2024-04-27T00:27:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:04 smithi156 ceph-mon[32679]: pgmap v12283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:27:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:04 smithi156 ceph-mon[32679]: pgmap v12284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:27:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22119.695573 secs 2024-04-27T00:27:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 21422.664872 secs 2024-04-27T00:27:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:06 smithi092 ceph-mon[29156]: pgmap v12285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:06 smithi189 ceph-mon[32756]: pgmap v12285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:06 smithi156 ceph-mon[32679]: pgmap v12285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:08 smithi092 ceph-mon[29156]: pgmap v12286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:08 smithi189 ceph-mon[32756]: pgmap v12286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:08 smithi156 ceph-mon[32679]: pgmap v12286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:09 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 22124.695695 secs 2024-04-27T00:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:09 smithi092 ceph-mon[29156]: slow request 1442.382405 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:09 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 21427.665010 secs 2024-04-27T00:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:09 smithi092 ceph-mon[29156]: slow request 182.214771 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:27:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:09 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 22124.695695 secs 2024-04-27T00:27:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:09 smithi189 ceph-mon[32756]: slow request 1442.382405 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:27:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:09 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 21427.665010 secs 2024-04-27T00:27:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:09 smithi189 ceph-mon[32756]: slow request 182.214771 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:27:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:09 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 22124.695695 secs 2024-04-27T00:27:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:09 smithi156 ceph-mon[32679]: slow request 1442.382405 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:27:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:09 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 21427.665010 secs 2024-04-27T00:27:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:09 smithi156 ceph-mon[32679]: slow request 182.214771 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:27:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:10 smithi092 ceph-mon[29156]: pgmap v12287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:10 smithi189 ceph-mon[32756]: pgmap v12287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:10 smithi156 ceph-mon[32679]: pgmap v12287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:12 smithi189 ceph-mon[32756]: pgmap v12288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:12 smithi156 ceph-mon[32679]: pgmap v12288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:12 smithi092 ceph-mon[29156]: pgmap v12288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:27:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:27:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:27:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:27:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:27:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:27:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:27:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:15 smithi189 ceph-mon[32756]: pgmap v12289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:27:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22129.695816 secs 2024-04-27T00:27:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21432.665127 secs 2024-04-27T00:27:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:15 smithi156 ceph-mon[32679]: pgmap v12289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:27:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22129.695816 secs 2024-04-27T00:27:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21432.665127 secs 2024-04-27T00:27:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:15 smithi092 ceph-mon[29156]: pgmap v12289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:27:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22129.695816 secs 2024-04-27T00:27:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21432.665127 secs 2024-04-27T00:27:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:17 smithi189 ceph-mon[32756]: pgmap v12290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:17 smithi156 ceph-mon[32679]: pgmap v12290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:17 smithi092 ceph-mon[29156]: pgmap v12290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:19.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:19 smithi189 ceph-mon[32756]: pgmap v12291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:19 smithi156 ceph-mon[32679]: pgmap v12291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:19 smithi092 ceph-mon[29156]: pgmap v12291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22134.695953 secs 2024-04-27T00:27:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21437.665265 secs 2024-04-27T00:27:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22134.695953 secs 2024-04-27T00:27:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21437.665265 secs 2024-04-27T00:27:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22134.695953 secs 2024-04-27T00:27:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21437.665265 secs 2024-04-27T00:27:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:21 smithi189 ceph-mon[32756]: pgmap v12292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:21 smithi156 ceph-mon[32679]: pgmap v12292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:21 smithi092 ceph-mon[29156]: pgmap v12292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:23.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:23 smithi092 ceph-mon[29156]: pgmap v12293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:23 smithi189 ceph-mon[32756]: pgmap v12293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:23 smithi156 ceph-mon[32679]: pgmap v12293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:25 smithi092 ceph-mon[29156]: pgmap v12294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:25 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22139.696069 secs 2024-04-27T00:27:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21442.665383 secs 2024-04-27T00:27:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:25 smithi189 ceph-mon[32756]: pgmap v12294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:25 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22139.696069 secs 2024-04-27T00:27:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21442.665383 secs 2024-04-27T00:27:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:25 smithi156 ceph-mon[32679]: pgmap v12294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:25 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22139.696069 secs 2024-04-27T00:27:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21442.665383 secs 2024-04-27T00:27:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:27 smithi189 ceph-mon[32756]: pgmap v12295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:27 smithi156 ceph-mon[32679]: pgmap v12295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:27 smithi092 ceph-mon[29156]: pgmap v12295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:29 smithi189 ceph-mon[32756]: pgmap v12296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:29 smithi156 ceph-mon[32679]: pgmap v12296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:29 smithi092 ceph-mon[29156]: pgmap v12296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:30 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22144.696168 secs 2024-04-27T00:27:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21447.665499 secs 2024-04-27T00:27:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:30 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22144.696168 secs 2024-04-27T00:27:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21447.665499 secs 2024-04-27T00:27:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:30 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22144.696168 secs 2024-04-27T00:27:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21447.665499 secs 2024-04-27T00:27:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:31 smithi189 ceph-mon[32756]: pgmap v12297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:31 smithi156 ceph-mon[32679]: pgmap v12297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:31 smithi092 ceph-mon[29156]: pgmap v12297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:32 smithi189 ceph-mon[32756]: pgmap v12298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:32 smithi156 ceph-mon[32679]: pgmap v12298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:32 smithi092 ceph-mon[29156]: pgmap v12298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:34 smithi189 ceph-mon[32756]: pgmap v12299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:34 smithi156 ceph-mon[32679]: pgmap v12299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:34 smithi092 ceph-mon[29156]: pgmap v12299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:35 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22149.696243 secs 2024-04-27T00:27:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21452.665605 secs 2024-04-27T00:27:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:35 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22149.696243 secs 2024-04-27T00:27:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21452.665605 secs 2024-04-27T00:27:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:35 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22149.696243 secs 2024-04-27T00:27:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21452.665605 secs 2024-04-27T00:27:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:36 smithi189 ceph-mon[32756]: pgmap v12300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:36 smithi156 ceph-mon[32679]: pgmap v12300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:36 smithi092 ceph-mon[29156]: pgmap v12300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:38 smithi189 ceph-mon[32756]: pgmap v12301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:38 smithi156 ceph-mon[32679]: pgmap v12301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:38 smithi092 ceph-mon[29156]: pgmap v12301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:27:39.019+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:27:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:27:39.019+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:27:39.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:27:39.020+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:27:39.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:27:39.020+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 172 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:27:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:40 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22154.696318 secs 2024-04-27T00:27:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21457.665726 secs 2024-04-27T00:27:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:40 smithi189 ceph-mon[32756]: pgmap v12302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:40 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22154.696318 secs 2024-04-27T00:27:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21457.665726 secs 2024-04-27T00:27:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:40 smithi156 ceph-mon[32679]: pgmap v12302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:40 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22154.696318 secs 2024-04-27T00:27:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21457.665726 secs 2024-04-27T00:27:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:40 smithi092 ceph-mon[29156]: pgmap v12302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:42 smithi189 ceph-mon[32756]: pgmap v12303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:42 smithi156 ceph-mon[32679]: pgmap v12303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:42 smithi092 ceph-mon[29156]: pgmap v12303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:44 smithi189 ceph-mon[32756]: pgmap v12304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:44 smithi156 ceph-mon[32679]: pgmap v12304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:44 smithi092 ceph-mon[29156]: pgmap v12304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:45 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22159.696383 secs 2024-04-27T00:27:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21462.665846 secs 2024-04-27T00:27:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:45 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22159.696383 secs 2024-04-27T00:27:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21462.665846 secs 2024-04-27T00:27:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:45 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22159.696383 secs 2024-04-27T00:27:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21462.665846 secs 2024-04-27T00:27:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:46 smithi189 ceph-mon[32756]: pgmap v12305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:46 smithi156 ceph-mon[32679]: pgmap v12305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:46 smithi092 ceph-mon[29156]: pgmap v12305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:48 smithi189 ceph-mon[32756]: pgmap v12306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:48 smithi156 ceph-mon[32679]: pgmap v12306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:48 smithi092 ceph-mon[29156]: pgmap v12306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:50 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22164.696500 secs 2024-04-27T00:27:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21467.665994 secs 2024-04-27T00:27:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:50 smithi189 ceph-mon[32756]: pgmap v12307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:50 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22164.696500 secs 2024-04-27T00:27:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21467.665994 secs 2024-04-27T00:27:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:50 smithi156 ceph-mon[32679]: pgmap v12307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:50 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22164.696500 secs 2024-04-27T00:27:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21467.665994 secs 2024-04-27T00:27:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:50 smithi092 ceph-mon[29156]: pgmap v12307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:52 smithi189 ceph-mon[32756]: pgmap v12308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:52 smithi156 ceph-mon[32679]: pgmap v12308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:52 smithi092 ceph-mon[29156]: pgmap v12308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:54 smithi189 ceph-mon[32756]: pgmap v12309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:54 smithi156 ceph-mon[32679]: pgmap v12309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:54 smithi092 ceph-mon[29156]: pgmap v12309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:55 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22169.696633 secs 2024-04-27T00:27:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21472.666108 secs 2024-04-27T00:27:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:55 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22169.696633 secs 2024-04-27T00:27:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21472.666108 secs 2024-04-27T00:27:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:55 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22169.696633 secs 2024-04-27T00:27:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21472.666108 secs 2024-04-27T00:27:56.604 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:56 smithi092 ceph-mon[29156]: pgmap v12310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:56 smithi189 ceph-mon[32756]: pgmap v12310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:56 smithi156 ceph-mon[32679]: pgmap v12310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:27:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:27:58 smithi189 ceph-mon[32756]: pgmap v12311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:27:58 smithi156 ceph-mon[32679]: pgmap v12311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:27:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:27:58 smithi092 ceph-mon[29156]: pgmap v12311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:00 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22174.696779 secs 2024-04-27T00:28:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21477.666223 secs 2024-04-27T00:28:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:00 smithi189 ceph-mon[32756]: pgmap v12312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22174.696779 secs 2024-04-27T00:28:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21477.666223 secs 2024-04-27T00:28:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:00 smithi156 ceph-mon[32679]: pgmap v12312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:00 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22174.696779 secs 2024-04-27T00:28:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21477.666223 secs 2024-04-27T00:28:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:00 smithi092 ceph-mon[29156]: pgmap v12312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:02 smithi189 ceph-mon[32756]: pgmap v12313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:02 smithi156 ceph-mon[32679]: pgmap v12313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:02 smithi092 ceph-mon[29156]: pgmap v12313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:28:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:28:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:28:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: pgmap v12314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22179.696848 secs 2024-04-27T00:28:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21482.666287 secs 2024-04-27T00:28:04.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: pgmap v12314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22179.696848 secs 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21482.666287 secs 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: pgmap v12314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22179.696848 secs 2024-04-27T00:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21482.666287 secs 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: pgmap v12315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:28:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:28:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: pgmap v12315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:28:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:28:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: pgmap v12315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: pgmap v12316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:07 smithi156 ceph-mon[32679]: pgmap v12317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:28:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: pgmap v12316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:08.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:07 smithi092 ceph-mon[29156]: pgmap v12317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:08.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:28:08.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:28:08.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:28:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:28:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:28:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: pgmap v12316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:07 smithi189 ceph-mon[32756]: pgmap v12317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22184.696926 secs 2024-04-27T00:28:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21487.666407 secs 2024-04-27T00:28:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:09 smithi156 ceph-mon[32679]: pgmap v12318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22184.696926 secs 2024-04-27T00:28:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21487.666407 secs 2024-04-27T00:28:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:09 smithi092 ceph-mon[29156]: pgmap v12318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22184.696926 secs 2024-04-27T00:28:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21487.666407 secs 2024-04-27T00:28:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:09 smithi189 ceph-mon[32756]: pgmap v12318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:11 smithi156 ceph-mon[32679]: pgmap v12319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:11 smithi092 ceph-mon[29156]: pgmap v12319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:11 smithi189 ceph-mon[32756]: pgmap v12319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:13 smithi156 ceph-mon[32679]: pgmap v12320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:13 smithi092 ceph-mon[29156]: pgmap v12320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:13 smithi189 ceph-mon[32756]: pgmap v12320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22189.697057 secs 2024-04-27T00:28:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21492.666470 secs 2024-04-27T00:28:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22189.697057 secs 2024-04-27T00:28:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21492.666470 secs 2024-04-27T00:28:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22189.697057 secs 2024-04-27T00:28:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21492.666470 secs 2024-04-27T00:28:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:15 smithi156 ceph-mon[32679]: pgmap v12321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:15 smithi092 ceph-mon[29156]: pgmap v12321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:15 smithi189 ceph-mon[32756]: pgmap v12321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:28:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:17 smithi156 ceph-mon[32679]: pgmap v12322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:28:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:17 smithi092 ceph-mon[29156]: pgmap v12322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:28:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:17 smithi189 ceph-mon[32756]: pgmap v12322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:28:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22194.697188 secs 2024-04-27T00:28:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21497.666598 secs 2024-04-27T00:28:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:19 smithi156 ceph-mon[32679]: pgmap v12323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22194.697188 secs 2024-04-27T00:28:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21497.666598 secs 2024-04-27T00:28:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:19 smithi092 ceph-mon[29156]: pgmap v12323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22194.697188 secs 2024-04-27T00:28:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21497.666598 secs 2024-04-27T00:28:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:19 smithi189 ceph-mon[32756]: pgmap v12323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:22.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:21 smithi156 ceph-mon[32679]: pgmap v12324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:21 smithi092 ceph-mon[29156]: pgmap v12324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:21 smithi189 ceph-mon[32756]: pgmap v12324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:24.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:23 smithi092 ceph-mon[29156]: pgmap v12325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:23 smithi156 ceph-mon[32679]: pgmap v12325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:23 smithi189 ceph-mon[32756]: pgmap v12325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22199.697319 secs 2024-04-27T00:28:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21502.666720 secs 2024-04-27T00:28:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22199.697319 secs 2024-04-27T00:28:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21502.666720 secs 2024-04-27T00:28:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22199.697319 secs 2024-04-27T00:28:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21502.666720 secs 2024-04-27T00:28:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:25 smithi156 ceph-mon[32679]: pgmap v12326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:25 smithi092 ceph-mon[29156]: pgmap v12326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:25 smithi189 ceph-mon[32756]: pgmap v12326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:27 smithi156 ceph-mon[32679]: pgmap v12327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:27 smithi092 ceph-mon[29156]: pgmap v12327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:27 smithi189 ceph-mon[32756]: pgmap v12327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22204.697446 secs 2024-04-27T00:28:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21507.666852 secs 2024-04-27T00:28:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:29 smithi092 ceph-mon[29156]: pgmap v12328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22204.697446 secs 2024-04-27T00:28:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21507.666852 secs 2024-04-27T00:28:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:29 smithi189 ceph-mon[32756]: pgmap v12328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22204.697446 secs 2024-04-27T00:28:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21507.666852 secs 2024-04-27T00:28:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:29 smithi156 ceph-mon[32679]: pgmap v12328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:31 smithi092 ceph-mon[29156]: pgmap v12329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:31 smithi189 ceph-mon[32756]: pgmap v12329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:31 smithi156 ceph-mon[32679]: pgmap v12329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:34.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:33 smithi156 ceph-mon[32679]: pgmap v12330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:33 smithi092 ceph-mon[29156]: pgmap v12330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:33 smithi189 ceph-mon[32756]: pgmap v12330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22209.697586 secs 2024-04-27T00:28:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21512.667002 secs 2024-04-27T00:28:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22209.697586 secs 2024-04-27T00:28:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21512.667002 secs 2024-04-27T00:28:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22209.697586 secs 2024-04-27T00:28:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21512.667002 secs 2024-04-27T00:28:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:35 smithi092 ceph-mon[29156]: pgmap v12331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:35 smithi189 ceph-mon[32756]: pgmap v12331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:35 smithi156 ceph-mon[32679]: pgmap v12331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:37 smithi092 ceph-mon[29156]: pgmap v12332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:37 smithi189 ceph-mon[32756]: pgmap v12332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:37 smithi156 ceph-mon[32679]: pgmap v12332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22214.697728 secs 2024-04-27T00:28:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21517.667117 secs 2024-04-27T00:28:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:39 smithi092 ceph-mon[29156]: pgmap v12333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22214.697728 secs 2024-04-27T00:28:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21517.667117 secs 2024-04-27T00:28:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:39 smithi189 ceph-mon[32756]: pgmap v12333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22214.697728 secs 2024-04-27T00:28:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21517.667117 secs 2024-04-27T00:28:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:39 smithi156 ceph-mon[32679]: pgmap v12333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:41 smithi092 ceph-mon[29156]: pgmap v12334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:41 smithi189 ceph-mon[32756]: pgmap v12334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:41 smithi156 ceph-mon[32679]: pgmap v12334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:43 smithi092 ceph-mon[29156]: pgmap v12335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:43 smithi189 ceph-mon[32756]: pgmap v12335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:43 smithi156 ceph-mon[32679]: pgmap v12335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22219.697852 secs 2024-04-27T00:28:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21522.667181 secs 2024-04-27T00:28:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22219.697852 secs 2024-04-27T00:28:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21522.667181 secs 2024-04-27T00:28:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22219.697852 secs 2024-04-27T00:28:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21522.667181 secs 2024-04-27T00:28:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:45 smithi092 ceph-mon[29156]: pgmap v12336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:45 smithi189 ceph-mon[32756]: pgmap v12336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:45 smithi156 ceph-mon[32679]: pgmap v12336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:47 smithi092 ceph-mon[29156]: pgmap v12337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:47 smithi189 ceph-mon[32756]: pgmap v12337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:47 smithi156 ceph-mon[32679]: pgmap v12337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22224.697979 secs 2024-04-27T00:28:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21527.667323 secs 2024-04-27T00:28:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:49 smithi092 ceph-mon[29156]: pgmap v12338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22224.697979 secs 2024-04-27T00:28:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21527.667323 secs 2024-04-27T00:28:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:49 smithi189 ceph-mon[32756]: pgmap v12338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22224.697979 secs 2024-04-27T00:28:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21527.667323 secs 2024-04-27T00:28:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:49 smithi156 ceph-mon[32679]: pgmap v12338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:51 smithi092 ceph-mon[29156]: pgmap v12339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:51 smithi189 ceph-mon[32756]: pgmap v12339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:51 smithi156 ceph-mon[32679]: pgmap v12339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:53 smithi092 ceph-mon[29156]: pgmap v12340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:53 smithi189 ceph-mon[32756]: pgmap v12340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:53 smithi156 ceph-mon[32679]: pgmap v12340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22229.698103 secs 2024-04-27T00:28:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21532.667370 secs 2024-04-27T00:28:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22229.698103 secs 2024-04-27T00:28:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21532.667370 secs 2024-04-27T00:28:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22229.698103 secs 2024-04-27T00:28:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21532.667370 secs 2024-04-27T00:28:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:55 smithi092 ceph-mon[29156]: pgmap v12341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:55 smithi189 ceph-mon[32756]: pgmap v12341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:55 smithi156 ceph-mon[32679]: pgmap v12341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:28:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:57 smithi189 ceph-mon[32756]: pgmap v12342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:28:57 smithi156 ceph-mon[32679]: pgmap v12342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:28:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:57 smithi092 ceph-mon[29156]: pgmap v12342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22234.698180 secs 2024-04-27T00:29:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21537.667458 secs 2024-04-27T00:29:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:28:59 smithi189 ceph-mon[32756]: pgmap v12343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:00 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22234.698180 secs 2024-04-27T00:29:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21537.667458 secs 2024-04-27T00:29:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:00 smithi156 ceph-mon[32679]: pgmap v12343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22234.698180 secs 2024-04-27T00:29:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21537.667458 secs 2024-04-27T00:29:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:28:59 smithi092 ceph-mon[29156]: pgmap v12343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:02 smithi189 ceph-mon[32756]: pgmap v12344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:02 smithi156 ceph-mon[32679]: pgmap v12344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:02 smithi092 ceph-mon[29156]: pgmap v12344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:04 smithi189 ceph-mon[32756]: pgmap v12345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:04 smithi156 ceph-mon[32679]: pgmap v12345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:04 smithi092 ceph-mon[29156]: pgmap v12345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:05 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22239.698300 secs 2024-04-27T00:29:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21542.667580 secs 2024-04-27T00:29:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:05 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22239.698300 secs 2024-04-27T00:29:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21542.667580 secs 2024-04-27T00:29:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:05 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22239.698300 secs 2024-04-27T00:29:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21542.667580 secs 2024-04-27T00:29:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:06 smithi189 ceph-mon[32756]: pgmap v12346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:06 smithi156 ceph-mon[32679]: pgmap v12346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-mon[29156]: pgmap v12346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:29:06.696+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:29:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:29:06.696+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:29:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:29:06.696+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:29:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:29:06.696+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:29:06.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:29:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:29:06.696+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:29:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:29:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:29:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:29:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:08 smithi189 ceph-mon[32756]: pgmap v12347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:29:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:29:08.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:29:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:08 smithi156 ceph-mon[32679]: pgmap v12347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:29:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:29:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:29:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:08 smithi092 ceph-mon[29156]: pgmap v12347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:29:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:29:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:29:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:09 smithi189 ceph-mon[32756]: pgmap v12348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:29:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:09 smithi189 ceph-mon[32756]: pgmap v12349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:29:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:09 smithi156 ceph-mon[32679]: pgmap v12348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:29:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:09 smithi156 ceph-mon[32679]: pgmap v12349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:29:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:09 smithi092 ceph-mon[29156]: pgmap v12348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:29:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:09 smithi092 ceph-mon[29156]: pgmap v12349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:29:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:10 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22244.698418 secs 2024-04-27T00:29:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21547.667670 secs 2024-04-27T00:29:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:10 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22244.698418 secs 2024-04-27T00:29:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21547.667670 secs 2024-04-27T00:29:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:10 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22244.698418 secs 2024-04-27T00:29:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21547.667670 secs 2024-04-27T00:29:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:11 smithi189 ceph-mon[32756]: pgmap v12350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:11 smithi156 ceph-mon[32679]: pgmap v12350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:11 smithi092 ceph-mon[29156]: pgmap v12350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:13 smithi189 ceph-mon[32756]: pgmap v12351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:13 smithi156 ceph-mon[32679]: pgmap v12351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:13 smithi092 ceph-mon[29156]: pgmap v12351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:15 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22249.698557 secs 2024-04-27T00:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:15 smithi189 ceph-mon[32756]: pgmap v12352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21552.667750 secs 2024-04-27T00:29:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:15 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22249.698557 secs 2024-04-27T00:29:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:15 smithi156 ceph-mon[32679]: pgmap v12352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21552.667750 secs 2024-04-27T00:29:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:15 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22249.698557 secs 2024-04-27T00:29:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:15 smithi092 ceph-mon[29156]: pgmap v12352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21552.667750 secs 2024-04-27T00:29:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:17 smithi189 ceph-mon[32756]: pgmap v12353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:17 smithi156 ceph-mon[32679]: pgmap v12353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:17 smithi092 ceph-mon[29156]: pgmap v12353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T00:29:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:19 smithi189 ceph-mon[32756]: pgmap v12354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T00:29:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:19 smithi156 ceph-mon[32679]: pgmap v12354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T00:29:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:19 smithi092 ceph-mon[29156]: pgmap v12354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T00:29:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:20 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22254.698698 secs 2024-04-27T00:29:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21557.667833 secs 2024-04-27T00:29:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:20 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22254.698698 secs 2024-04-27T00:29:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21557.667833 secs 2024-04-27T00:29:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:20 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22254.698698 secs 2024-04-27T00:29:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21557.667833 secs 2024-04-27T00:29:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:21 smithi189 ceph-mon[32756]: pgmap v12355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:29:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:21 smithi156 ceph-mon[32679]: pgmap v12355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:29:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:21 smithi092 ceph-mon[29156]: pgmap v12355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:29:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:22 smithi189 ceph-mon[32756]: pgmap v12356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:22 smithi156 ceph-mon[32679]: pgmap v12356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:22 smithi092 ceph-mon[29156]: pgmap v12356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22259.698844 secs 2024-04-27T00:29:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:24 smithi156 ceph-mon[32679]: pgmap v12357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21562.667951 secs 2024-04-27T00:29:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22259.698844 secs 2024-04-27T00:29:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:24 smithi092 ceph-mon[29156]: pgmap v12357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21562.667951 secs 2024-04-27T00:29:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22259.698844 secs 2024-04-27T00:29:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:24 smithi189 ceph-mon[32756]: pgmap v12357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21562.667951 secs 2024-04-27T00:29:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:26 smithi156 ceph-mon[32679]: pgmap v12358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:26 smithi092 ceph-mon[29156]: pgmap v12358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:26 smithi189 ceph-mon[32756]: pgmap v12358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:28 smithi156 ceph-mon[32679]: pgmap v12359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:28 smithi092 ceph-mon[29156]: pgmap v12359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:28 smithi189 ceph-mon[32756]: pgmap v12359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22264.698938 secs 2024-04-27T00:29:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21567.668024 secs 2024-04-27T00:29:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22264.698938 secs 2024-04-27T00:29:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21567.668024 secs 2024-04-27T00:29:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22264.698938 secs 2024-04-27T00:29:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21567.668024 secs 2024-04-27T00:29:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:30 smithi092 ceph-mon[29156]: pgmap v12360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:30 smithi189 ceph-mon[32756]: pgmap v12360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:30 smithi156 ceph-mon[32679]: pgmap v12360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:32 smithi092 ceph-mon[29156]: pgmap v12361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:32 smithi189 ceph-mon[32756]: pgmap v12361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:32 smithi156 ceph-mon[32679]: pgmap v12361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:34.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22269.699022 secs 2024-04-27T00:29:34.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:34 smithi156 ceph-mon[32679]: pgmap v12362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:34.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21572.668097 secs 2024-04-27T00:29:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22269.699022 secs 2024-04-27T00:29:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:34 smithi092 ceph-mon[29156]: pgmap v12362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21572.668097 secs 2024-04-27T00:29:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22269.699022 secs 2024-04-27T00:29:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:34 smithi189 ceph-mon[32756]: pgmap v12362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21572.668097 secs 2024-04-27T00:29:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:36 smithi092 ceph-mon[29156]: pgmap v12363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:37.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:36 smithi189 ceph-mon[32756]: pgmap v12363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:36 smithi156 ceph-mon[32679]: pgmap v12363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:38 smithi092 ceph-mon[29156]: pgmap v12364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:38 smithi189 ceph-mon[32756]: pgmap v12364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:38 smithi156 ceph-mon[32679]: pgmap v12364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22274.699133 secs 2024-04-27T00:29:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21577.668218 secs 2024-04-27T00:29:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22274.699133 secs 2024-04-27T00:29:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21577.668218 secs 2024-04-27T00:29:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22274.699133 secs 2024-04-27T00:29:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21577.668218 secs 2024-04-27T00:29:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:40 smithi092 ceph-mon[29156]: pgmap v12365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:40 smithi189 ceph-mon[32756]: pgmap v12365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:40 smithi156 ceph-mon[32679]: pgmap v12365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:42 smithi092 ceph-mon[29156]: pgmap v12366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:42 smithi189 ceph-mon[32756]: pgmap v12366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:42 smithi156 ceph-mon[32679]: pgmap v12366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22279.699252 secs 2024-04-27T00:29:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:44 smithi092 ceph-mon[29156]: pgmap v12367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21582.668340 secs 2024-04-27T00:29:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22279.699252 secs 2024-04-27T00:29:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:44 smithi189 ceph-mon[32756]: pgmap v12367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21582.668340 secs 2024-04-27T00:29:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22279.699252 secs 2024-04-27T00:29:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:44 smithi156 ceph-mon[32679]: pgmap v12367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21582.668340 secs 2024-04-27T00:29:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:46 smithi092 ceph-mon[29156]: pgmap v12368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:46 smithi189 ceph-mon[32756]: pgmap v12368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:46 smithi156 ceph-mon[32679]: pgmap v12368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:48 smithi092 ceph-mon[29156]: pgmap v12369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:48 smithi189 ceph-mon[32756]: pgmap v12369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:48 smithi156 ceph-mon[32679]: pgmap v12369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22284.699317 secs 2024-04-27T00:29:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21587.668482 secs 2024-04-27T00:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22284.699317 secs 2024-04-27T00:29:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21587.668482 secs 2024-04-27T00:29:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22284.699317 secs 2024-04-27T00:29:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21587.668482 secs 2024-04-27T00:29:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:50 smithi092 ceph-mon[29156]: pgmap v12370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:50 smithi189 ceph-mon[32756]: pgmap v12370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:50 smithi156 ceph-mon[32679]: pgmap v12370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:52 smithi092 ceph-mon[29156]: pgmap v12371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:52 smithi189 ceph-mon[32756]: pgmap v12371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:52 smithi156 ceph-mon[32679]: pgmap v12371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:54.038 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:29:54.039+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:29:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:29:54.039+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:29:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:29:54.039+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:29:54.039 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:29:54.039+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 173 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:29:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22289.699433 secs 2024-04-27T00:29:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:54 smithi092 ceph-mon[29156]: pgmap v12372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21592.668587 secs 2024-04-27T00:29:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22289.699433 secs 2024-04-27T00:29:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:54 smithi189 ceph-mon[32756]: pgmap v12372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21592.668587 secs 2024-04-27T00:29:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22289.699433 secs 2024-04-27T00:29:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:54 smithi156 ceph-mon[32679]: pgmap v12372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:29:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21592.668587 secs 2024-04-27T00:29:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:56 smithi092 ceph-mon[29156]: pgmap v12373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:56 smithi189 ceph-mon[32756]: pgmap v12373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:56 smithi156 ceph-mon[32679]: pgmap v12373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:58 smithi092 ceph-mon[29156]: pgmap v12374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:58 smithi189 ceph-mon[32756]: pgmap v12374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:58 smithi156 ceph-mon[32679]: pgmap v12374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:29:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22294.699559 secs 2024-04-27T00:30:00.124 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:29:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21597.668655 secs 2024-04-27T00:30:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22294.699559 secs 2024-04-27T00:30:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:29:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21597.668655 secs 2024-04-27T00:30:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22294.699559 secs 2024-04-27T00:30:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:29:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21597.668655 secs 2024-04-27T00:30:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:00 smithi092 ceph-mon[29156]: pgmap v12375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:30:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:00 smithi189 ceph-mon[32756]: pgmap v12375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:30:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:00 smithi156 ceph-mon[32679]: pgmap v12375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:30:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:02 smithi189 ceph-mon[32756]: pgmap v12376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:02 smithi156 ceph-mon[32679]: pgmap v12376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:02 smithi092 ceph-mon[29156]: pgmap v12376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22299.699644 secs 2024-04-27T00:30:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:04 smithi189 ceph-mon[32756]: pgmap v12377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21602.668776 secs 2024-04-27T00:30:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22299.699644 secs 2024-04-27T00:30:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:04 smithi156 ceph-mon[32679]: pgmap v12377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21602.668776 secs 2024-04-27T00:30:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22299.699644 secs 2024-04-27T00:30:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:04 smithi092 ceph-mon[29156]: pgmap v12377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21602.668776 secs 2024-04-27T00:30:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:06 smithi189 ceph-mon[32756]: pgmap v12378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:06 smithi156 ceph-mon[32679]: pgmap v12378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:06 smithi092 ceph-mon[29156]: pgmap v12378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:08.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:30:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:30:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:30:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:08 smithi189 ceph-mon[32756]: pgmap v12379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:30:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:30:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:08 smithi156 ceph-mon[32679]: pgmap v12379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:30:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:30:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:08 smithi092 ceph-mon[29156]: pgmap v12379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:30:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:30:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:30:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:30:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:09 smithi189 ceph-mon[32756]: pgmap v12380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:30:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:09 smithi189 ceph-mon[32756]: pgmap v12381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T00:30:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22304.699733 secs 2024-04-27T00:30:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:09 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 21607.668899 secs 2024-04-27T00:30:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:09 smithi189 ceph-mon[32756]: slow request 362.218660 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:09 smithi156 ceph-mon[32679]: pgmap v12380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:09 smithi156 ceph-mon[32679]: pgmap v12381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T00:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22304.699733 secs 2024-04-27T00:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:09 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 21607.668899 secs 2024-04-27T00:30:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:09 smithi156 ceph-mon[32679]: slow request 362.218660 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:30:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:09 smithi092 ceph-mon[29156]: pgmap v12380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T00:30:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:09 smithi092 ceph-mon[29156]: pgmap v12381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T00:30:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22304.699733 secs 2024-04-27T00:30:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:09 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 21607.668899 secs 2024-04-27T00:30:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:09 smithi092 ceph-mon[29156]: slow request 362.218660 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:30:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:11 smithi189 ceph-mon[32756]: pgmap v12382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:11 smithi156 ceph-mon[32679]: pgmap v12382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:11 smithi092 ceph-mon[29156]: pgmap v12382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:30:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:13 smithi189 ceph-mon[32756]: pgmap v12383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:30:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:13 smithi156 ceph-mon[32679]: pgmap v12383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:30:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:13 smithi092 ceph-mon[29156]: pgmap v12383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:30:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22309.699849 secs 2024-04-27T00:30:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21612.669021 secs 2024-04-27T00:30:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22309.699849 secs 2024-04-27T00:30:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21612.669021 secs 2024-04-27T00:30:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22309.699849 secs 2024-04-27T00:30:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21612.669021 secs 2024-04-27T00:30:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:15 smithi189 ceph-mon[32756]: pgmap v12384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:16.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:15 smithi092 ceph-mon[29156]: pgmap v12384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:15 smithi156 ceph-mon[32679]: pgmap v12384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:17 smithi189 ceph-mon[32756]: pgmap v12385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:17 smithi156 ceph-mon[32679]: pgmap v12385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:17 smithi092 ceph-mon[29156]: pgmap v12385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:30:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:19 smithi189 ceph-mon[32756]: pgmap v12386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:30:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22314.699991 secs 2024-04-27T00:30:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21617.669145 secs 2024-04-27T00:30:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:19 smithi156 ceph-mon[32679]: pgmap v12386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:30:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22314.699991 secs 2024-04-27T00:30:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21617.669145 secs 2024-04-27T00:30:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:19 smithi092 ceph-mon[29156]: pgmap v12386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:30:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22314.699991 secs 2024-04-27T00:30:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21617.669145 secs 2024-04-27T00:30:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:21 smithi189 ceph-mon[32756]: pgmap v12387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:21 smithi156 ceph-mon[32679]: pgmap v12387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:21 smithi092 ceph-mon[29156]: pgmap v12387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:24.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:23 smithi092 ceph-mon[29156]: pgmap v12388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:23 smithi189 ceph-mon[32756]: pgmap v12388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:23 smithi156 ceph-mon[32679]: pgmap v12388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22319.700099 secs 2024-04-27T00:30:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21622.669314 secs 2024-04-27T00:30:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22319.700099 secs 2024-04-27T00:30:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21622.669314 secs 2024-04-27T00:30:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22319.700099 secs 2024-04-27T00:30:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21622.669314 secs 2024-04-27T00:30:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:25 smithi189 ceph-mon[32756]: pgmap v12389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:25 smithi156 ceph-mon[32679]: pgmap v12389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:25 smithi092 ceph-mon[29156]: pgmap v12389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:27 smithi189 ceph-mon[32756]: pgmap v12390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:27 smithi156 ceph-mon[32679]: pgmap v12390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:27 smithi092 ceph-mon[29156]: pgmap v12390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:29 smithi189 ceph-mon[32756]: pgmap v12391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22324.700203 secs 2024-04-27T00:30:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21627.669342 secs 2024-04-27T00:30:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:29 smithi156 ceph-mon[32679]: pgmap v12391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22324.700203 secs 2024-04-27T00:30:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21627.669342 secs 2024-04-27T00:30:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:29 smithi092 ceph-mon[29156]: pgmap v12391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22324.700203 secs 2024-04-27T00:30:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21627.669342 secs 2024-04-27T00:30:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:31 smithi092 ceph-mon[29156]: pgmap v12392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:31 smithi189 ceph-mon[32756]: pgmap v12392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:31 smithi156 ceph-mon[32679]: pgmap v12392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:33 smithi189 ceph-mon[32756]: pgmap v12393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:33 smithi156 ceph-mon[32679]: pgmap v12393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:33 smithi092 ceph-mon[29156]: pgmap v12393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:35.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22329.700321 secs 2024-04-27T00:30:35.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21632.669471 secs 2024-04-27T00:30:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22329.700321 secs 2024-04-27T00:30:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21632.669471 secs 2024-04-27T00:30:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22329.700321 secs 2024-04-27T00:30:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21632.669471 secs 2024-04-27T00:30:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:35 smithi189 ceph-mon[32756]: pgmap v12394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:35 smithi156 ceph-mon[32679]: pgmap v12394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:35 smithi092 ceph-mon[29156]: pgmap v12394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:37 smithi189 ceph-mon[32756]: pgmap v12395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:37 smithi156 ceph-mon[32679]: pgmap v12395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:37 smithi092 ceph-mon[29156]: pgmap v12395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:30:39.045+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:30:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:30:39.045+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:30:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:30:39.046+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:30:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:30:39.046+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 174 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:30:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:39 smithi189 ceph-mon[32756]: pgmap v12396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22334.700404 secs 2024-04-27T00:30:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21637.669589 secs 2024-04-27T00:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:39 smithi156 ceph-mon[32679]: pgmap v12396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22334.700404 secs 2024-04-27T00:30:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21637.669589 secs 2024-04-27T00:30:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:39 smithi092 ceph-mon[29156]: pgmap v12396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22334.700404 secs 2024-04-27T00:30:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21637.669589 secs 2024-04-27T00:30:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:41 smithi189 ceph-mon[32756]: pgmap v12397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:41 smithi156 ceph-mon[32679]: pgmap v12397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:41 smithi092 ceph-mon[29156]: pgmap v12397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:43 smithi189 ceph-mon[32756]: pgmap v12398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:44.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:43 smithi156 ceph-mon[32679]: pgmap v12398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:43 smithi092 ceph-mon[29156]: pgmap v12398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22339.700522 secs 2024-04-27T00:30:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21642.669697 secs 2024-04-27T00:30:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22339.700522 secs 2024-04-27T00:30:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21642.669697 secs 2024-04-27T00:30:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22339.700522 secs 2024-04-27T00:30:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21642.669697 secs 2024-04-27T00:30:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:45 smithi189 ceph-mon[32756]: pgmap v12399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:45 smithi156 ceph-mon[32679]: pgmap v12399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:45 smithi092 ceph-mon[29156]: pgmap v12399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:47 smithi092 ceph-mon[29156]: pgmap v12400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:47 smithi189 ceph-mon[32756]: pgmap v12400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:47 smithi156 ceph-mon[32679]: pgmap v12400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:49 smithi189 ceph-mon[32756]: pgmap v12401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22344.700642 secs 2024-04-27T00:30:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21647.669821 secs 2024-04-27T00:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:49 smithi156 ceph-mon[32679]: pgmap v12401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22344.700642 secs 2024-04-27T00:30:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21647.669821 secs 2024-04-27T00:30:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:49 smithi092 ceph-mon[29156]: pgmap v12401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22344.700642 secs 2024-04-27T00:30:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21647.669821 secs 2024-04-27T00:30:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:51 smithi189 ceph-mon[32756]: pgmap v12402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:51 smithi156 ceph-mon[32679]: pgmap v12402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:51 smithi092 ceph-mon[29156]: pgmap v12402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:53 smithi189 ceph-mon[32756]: pgmap v12403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:53 smithi156 ceph-mon[32679]: pgmap v12403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:53 smithi092 ceph-mon[29156]: pgmap v12403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22349.700766 secs 2024-04-27T00:30:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21652.669956 secs 2024-04-27T00:30:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22349.700766 secs 2024-04-27T00:30:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21652.669956 secs 2024-04-27T00:30:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22349.700766 secs 2024-04-27T00:30:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21652.669956 secs 2024-04-27T00:30:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:55 smithi189 ceph-mon[32756]: pgmap v12404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:55 smithi156 ceph-mon[32679]: pgmap v12404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:55 smithi092 ceph-mon[29156]: pgmap v12404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:30:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:57 smithi189 ceph-mon[32756]: pgmap v12405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:57 smithi156 ceph-mon[32679]: pgmap v12405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:30:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:57 smithi092 ceph-mon[29156]: pgmap v12405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:59 smithi189 ceph-mon[32756]: pgmap v12406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22354.700877 secs 2024-04-27T00:31:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:30:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21657.670078 secs 2024-04-27T00:31:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:59 smithi156 ceph-mon[32679]: pgmap v12406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22354.700877 secs 2024-04-27T00:31:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:30:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21657.670078 secs 2024-04-27T00:31:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:59 smithi092 ceph-mon[29156]: pgmap v12406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22354.700877 secs 2024-04-27T00:31:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:30:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21657.670078 secs 2024-04-27T00:31:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:01 smithi189 ceph-mon[32756]: pgmap v12407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:01 smithi156 ceph-mon[32679]: pgmap v12407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:01 smithi092 ceph-mon[29156]: pgmap v12407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:03 smithi189 ceph-mon[32756]: pgmap v12408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:03 smithi156 ceph-mon[32679]: pgmap v12408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:03 smithi092 ceph-mon[29156]: pgmap v12408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22359.700994 secs 2024-04-27T00:31:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21662.670202 secs 2024-04-27T00:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22359.700994 secs 2024-04-27T00:31:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21662.670202 secs 2024-04-27T00:31:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22359.700994 secs 2024-04-27T00:31:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21662.670202 secs 2024-04-27T00:31:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:05 smithi156 ceph-mon[32679]: pgmap v12409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:05 smithi092 ceph-mon[29156]: pgmap v12409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:05 smithi189 ceph-mon[32756]: pgmap v12409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:07 smithi156 ceph-mon[32679]: pgmap v12410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:07 smithi092 ceph-mon[29156]: pgmap v12410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:07 smithi189 ceph-mon[32756]: pgmap v12410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:31:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:31:09.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: pgmap v12411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22364.701083 secs 2024-04-27T00:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21667.670301 secs 2024-04-27T00:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:31:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:31:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: pgmap v12411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22364.701083 secs 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21667.670301 secs 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:31:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: pgmap v12411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22364.701083 secs 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21667.670301 secs 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:31:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:10 smithi156 ceph-mon[32679]: pgmap v12412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:31:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:10 smithi156 ceph-mon[32679]: pgmap v12413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:10 smithi092 ceph-mon[29156]: pgmap v12412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:31:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:10 smithi092 ceph-mon[29156]: pgmap v12413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:10 smithi189 ceph-mon[32756]: pgmap v12412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:31:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:10 smithi189 ceph-mon[32756]: pgmap v12413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:12 smithi156 ceph-mon[32679]: pgmap v12414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:12 smithi092 ceph-mon[29156]: pgmap v12414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:12 smithi189 ceph-mon[32756]: pgmap v12414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:14 smithi156 ceph-mon[32679]: pgmap v12415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:31:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22369.701200 secs 2024-04-27T00:31:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21672.670416 secs 2024-04-27T00:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:14 smithi092 ceph-mon[29156]: pgmap v12415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22369.701200 secs 2024-04-27T00:31:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21672.670416 secs 2024-04-27T00:31:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:14 smithi189 ceph-mon[32756]: pgmap v12415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:31:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22369.701200 secs 2024-04-27T00:31:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21672.670416 secs 2024-04-27T00:31:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:16 smithi156 ceph-mon[32679]: pgmap v12416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:16 smithi092 ceph-mon[29156]: pgmap v12416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:16 smithi189 ceph-mon[32756]: pgmap v12416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:18 smithi156 ceph-mon[32679]: pgmap v12417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:18 smithi092 ceph-mon[29156]: pgmap v12417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:18 smithi189 ceph-mon[32756]: pgmap v12417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22374.701319 secs 2024-04-27T00:31:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21677.670550 secs 2024-04-27T00:31:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22374.701319 secs 2024-04-27T00:31:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21677.670550 secs 2024-04-27T00:31:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22374.701319 secs 2024-04-27T00:31:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21677.670550 secs 2024-04-27T00:31:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:20 smithi156 ceph-mon[32679]: pgmap v12418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:31:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:20 smithi092 ceph-mon[29156]: pgmap v12418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:31:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:20 smithi189 ceph-mon[32756]: pgmap v12418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:31:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:22 smithi156 ceph-mon[32679]: pgmap v12419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:22 smithi092 ceph-mon[29156]: pgmap v12419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:22 smithi189 ceph-mon[32756]: pgmap v12419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:24 smithi156 ceph-mon[32679]: pgmap v12420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22379.701435 secs 2024-04-27T00:31:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21682.670665 secs 2024-04-27T00:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:24 smithi092 ceph-mon[29156]: pgmap v12420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22379.701435 secs 2024-04-27T00:31:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21682.670665 secs 2024-04-27T00:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:24 smithi189 ceph-mon[32756]: pgmap v12420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22379.701435 secs 2024-04-27T00:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21682.670665 secs 2024-04-27T00:31:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:26 smithi156 ceph-mon[32679]: pgmap v12421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:26 smithi092 ceph-mon[29156]: pgmap v12421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:26 smithi189 ceph-mon[32756]: pgmap v12421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:28 smithi092 ceph-mon[29156]: pgmap v12422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:28 smithi189 ceph-mon[32756]: pgmap v12422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:28 smithi156 ceph-mon[32679]: pgmap v12422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22384.701563 secs 2024-04-27T00:31:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21687.670738 secs 2024-04-27T00:31:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22384.701563 secs 2024-04-27T00:31:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21687.670738 secs 2024-04-27T00:31:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22384.701563 secs 2024-04-27T00:31:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21687.670738 secs 2024-04-27T00:31:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:30 smithi092 ceph-mon[29156]: pgmap v12423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:30 smithi189 ceph-mon[32756]: pgmap v12423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:30 smithi156 ceph-mon[32679]: pgmap v12423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:32 smithi092 ceph-mon[29156]: pgmap v12424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:32 smithi189 ceph-mon[32756]: pgmap v12424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:32 smithi156 ceph-mon[32679]: pgmap v12424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22389.701682 secs 2024-04-27T00:31:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22389.701682 secs 2024-04-27T00:31:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:33 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22389.701682 secs 2024-04-27T00:31:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:34 smithi092 ceph-mon[29156]: pgmap v12425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21692.670810 secs 2024-04-27T00:31:35.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:34 smithi156 ceph-mon[32679]: pgmap v12425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:35.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21692.670810 secs 2024-04-27T00:31:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:34 smithi189 ceph-mon[32756]: pgmap v12425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21692.670810 secs 2024-04-27T00:31:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:36 smithi092 ceph-mon[29156]: pgmap v12426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:36 smithi189 ceph-mon[32756]: pgmap v12426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:36 smithi156 ceph-mon[32679]: pgmap v12426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:38 smithi092 ceph-mon[29156]: pgmap v12427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22394.701801 secs 2024-04-27T00:31:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:38 smithi189 ceph-mon[32756]: pgmap v12427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22394.701801 secs 2024-04-27T00:31:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:38 smithi156 ceph-mon[32679]: pgmap v12427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22394.701801 secs 2024-04-27T00:31:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21697.670961 secs 2024-04-27T00:31:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21697.670961 secs 2024-04-27T00:31:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21697.670961 secs 2024-04-27T00:31:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:40 smithi092 ceph-mon[29156]: pgmap v12428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:40 smithi189 ceph-mon[32756]: pgmap v12428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:40 smithi156 ceph-mon[32679]: pgmap v12428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:31:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:42 smithi092 ceph-mon[29156]: pgmap v12429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:42 smithi189 ceph-mon[32756]: pgmap v12429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:42 smithi156 ceph-mon[32679]: pgmap v12429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22399.701922 secs 2024-04-27T00:31:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22399.701922 secs 2024-04-27T00:31:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22399.701922 secs 2024-04-27T00:31:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:44 smithi092 ceph-mon[29156]: pgmap v12430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21702.671078 secs 2024-04-27T00:31:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:44 smithi189 ceph-mon[32756]: pgmap v12430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21702.671078 secs 2024-04-27T00:31:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:44 smithi156 ceph-mon[32679]: pgmap v12430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21702.671078 secs 2024-04-27T00:31:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:46 smithi092 ceph-mon[29156]: pgmap v12431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:46 smithi189 ceph-mon[32756]: pgmap v12431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:46 smithi156 ceph-mon[32679]: pgmap v12431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:49.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:48 smithi092 ceph-mon[29156]: pgmap v12432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22404.702002 secs 2024-04-27T00:31:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:48 smithi189 ceph-mon[32756]: pgmap v12432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22404.702002 secs 2024-04-27T00:31:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:48 smithi156 ceph-mon[32679]: pgmap v12432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22404.702002 secs 2024-04-27T00:31:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21707.671138 secs 2024-04-27T00:31:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21707.671138 secs 2024-04-27T00:31:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21707.671138 secs 2024-04-27T00:31:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:51 smithi189 ceph-mon[32756]: pgmap v12433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:51 smithi156 ceph-mon[32679]: pgmap v12433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:51 smithi092 ceph-mon[29156]: pgmap v12433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:53.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:53 smithi189 ceph-mon[32756]: pgmap v12434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:53 smithi156 ceph-mon[32679]: pgmap v12434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:53 smithi092 ceph-mon[29156]: pgmap v12434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22409.702120 secs 2024-04-27T00:31:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22409.702120 secs 2024-04-27T00:31:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22409.702120 secs 2024-04-27T00:31:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:55 smithi189 ceph-mon[32756]: pgmap v12435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21712.671261 secs 2024-04-27T00:31:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:55 smithi092 ceph-mon[29156]: pgmap v12435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21712.671261 secs 2024-04-27T00:31:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:55 smithi156 ceph-mon[32679]: pgmap v12435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:31:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21712.671261 secs 2024-04-27T00:31:57.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:57 smithi189 ceph-mon[32756]: pgmap v12436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:57 smithi156 ceph-mon[32679]: pgmap v12436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:57 smithi092 ceph-mon[29156]: pgmap v12436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:31:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:59 smithi189 ceph-mon[32756]: pgmap v12437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:31:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22414.702199 secs 2024-04-27T00:31:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:59 smithi156 ceph-mon[32679]: pgmap v12437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:31:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22414.702199 secs 2024-04-27T00:31:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:59 smithi092 ceph-mon[29156]: pgmap v12437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:31:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:31:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22414.702199 secs 2024-04-27T00:32:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21717.671358 secs 2024-04-27T00:32:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21717.671358 secs 2024-04-27T00:32:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21717.671358 secs 2024-04-27T00:32:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:01 smithi189 ceph-mon[32756]: pgmap v12438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:01 smithi156 ceph-mon[32679]: pgmap v12438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:01 smithi092 ceph-mon[29156]: pgmap v12438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:03 smithi189 ceph-mon[32756]: pgmap v12439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:03 smithi156 ceph-mon[32679]: pgmap v12439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:03 smithi092 ceph-mon[29156]: pgmap v12439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22419.702320 secs 2024-04-27T00:32:04.457 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22419.702320 secs 2024-04-27T00:32:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22419.702320 secs 2024-04-27T00:32:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:05 smithi092 ceph-mon[29156]: pgmap v12440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21722.671437 secs 2024-04-27T00:32:05.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:05 smithi156 ceph-mon[32679]: pgmap v12440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:05.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21722.671437 secs 2024-04-27T00:32:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:05 smithi189 ceph-mon[32756]: pgmap v12440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21722.671437 secs 2024-04-27T00:32:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:07 smithi189 ceph-mon[32756]: pgmap v12441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:07 smithi156 ceph-mon[32679]: pgmap v12441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:07 smithi092 ceph-mon[29156]: pgmap v12441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:09 smithi189 ceph-mon[32756]: pgmap v12442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22424.702473 secs 2024-04-27T00:32:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:09 smithi156 ceph-mon[32679]: pgmap v12442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22424.702473 secs 2024-04-27T00:32:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:09 smithi092 ceph-mon[29156]: pgmap v12442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22424.702473 secs 2024-04-27T00:32:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21727.671525 secs 2024-04-27T00:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:32:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21727.671525 secs 2024-04-27T00:32:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:32:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:32:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:32:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:32:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21727.671525 secs 2024-04-27T00:32:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:32:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:32:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:32:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:32:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:11 smithi189 ceph-mon[32756]: pgmap v12443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:11 smithi189 ceph-mon[32756]: pgmap v12444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:32:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:11 smithi189 ceph-mon[32756]: pgmap v12445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:11 smithi156 ceph-mon[32679]: pgmap v12443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:11 smithi156 ceph-mon[32679]: pgmap v12444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:32:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:11 smithi156 ceph-mon[32679]: pgmap v12445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:11 smithi092 ceph-mon[29156]: pgmap v12443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:11 smithi092 ceph-mon[29156]: pgmap v12444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:32:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:11 smithi092 ceph-mon[29156]: pgmap v12445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:13 smithi189 ceph-mon[32756]: pgmap v12446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:13 smithi156 ceph-mon[32679]: pgmap v12446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:13 smithi092 ceph-mon[29156]: pgmap v12446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22429.702608 secs 2024-04-27T00:32:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22429.702608 secs 2024-04-27T00:32:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22429.702608 secs 2024-04-27T00:32:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21732.671602 secs 2024-04-27T00:32:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:15 smithi189 ceph-mon[32756]: pgmap v12447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21732.671602 secs 2024-04-27T00:32:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:15 smithi156 ceph-mon[32679]: pgmap v12447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21732.671602 secs 2024-04-27T00:32:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:15 smithi092 ceph-mon[29156]: pgmap v12447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:17 smithi189 ceph-mon[32756]: pgmap v12448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:17 smithi156 ceph-mon[32679]: pgmap v12448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:17 smithi092 ceph-mon[29156]: pgmap v12448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:32:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:19 smithi189 ceph-mon[32756]: pgmap v12449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:32:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22434.702681 secs 2024-04-27T00:32:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:19 smithi156 ceph-mon[32679]: pgmap v12449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:32:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22434.702681 secs 2024-04-27T00:32:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:19 smithi092 ceph-mon[29156]: pgmap v12449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:32:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22434.702681 secs 2024-04-27T00:32:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21737.671707 secs 2024-04-27T00:32:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21737.671707 secs 2024-04-27T00:32:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21737.671707 secs 2024-04-27T00:32:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:21 smithi189 ceph-mon[32756]: pgmap v12450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:32:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:21 smithi156 ceph-mon[32679]: pgmap v12450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:32:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:21 smithi092 ceph-mon[29156]: pgmap v12450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:32:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:23 smithi189 ceph-mon[32756]: pgmap v12451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:23 smithi156 ceph-mon[32679]: pgmap v12451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:23 smithi092 ceph-mon[29156]: pgmap v12451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22439.702788 secs 2024-04-27T00:32:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22439.702788 secs 2024-04-27T00:32:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22439.702788 secs 2024-04-27T00:32:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21742.671828 secs 2024-04-27T00:32:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:25 smithi189 ceph-mon[32756]: pgmap v12452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21742.671828 secs 2024-04-27T00:32:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:25 smithi092 ceph-mon[29156]: pgmap v12452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21742.671828 secs 2024-04-27T00:32:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:25 smithi156 ceph-mon[32679]: pgmap v12452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:26 smithi189 ceph-mon[32756]: pgmap v12453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:26 smithi156 ceph-mon[32679]: pgmap v12453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:26 smithi092 ceph-mon[29156]: pgmap v12453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:29 smithi189 ceph-mon[32756]: pgmap v12454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22444.702921 secs 2024-04-27T00:32:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:29 smithi156 ceph-mon[32679]: pgmap v12454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22444.702921 secs 2024-04-27T00:32:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:29 smithi092 ceph-mon[29156]: pgmap v12454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22444.702921 secs 2024-04-27T00:32:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21747.671980 secs 2024-04-27T00:32:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21747.671980 secs 2024-04-27T00:32:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21747.671980 secs 2024-04-27T00:32:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:31 smithi189 ceph-mon[32756]: pgmap v12455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:31 smithi156 ceph-mon[32679]: pgmap v12455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:31 smithi092 ceph-mon[29156]: pgmap v12455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:33 smithi189 ceph-mon[32756]: pgmap v12456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:33 smithi156 ceph-mon[32679]: pgmap v12456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:33 smithi092 ceph-mon[29156]: pgmap v12456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22449.703011 secs 2024-04-27T00:32:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22449.703011 secs 2024-04-27T00:32:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22449.703011 secs 2024-04-27T00:32:35.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21752.672103 secs 2024-04-27T00:32:35.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:35 smithi156 ceph-mon[32679]: pgmap v12457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21752.672103 secs 2024-04-27T00:32:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:35 smithi189 ceph-mon[32756]: pgmap v12457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21752.672103 secs 2024-04-27T00:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:35 smithi092 ceph-mon[29156]: pgmap v12457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:37 smithi189 ceph-mon[32756]: pgmap v12458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:37 smithi156 ceph-mon[32679]: pgmap v12458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:37 smithi092 ceph-mon[29156]: pgmap v12458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:39 smithi189 ceph-mon[32756]: pgmap v12459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22454.703088 secs 2024-04-27T00:32:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:39 smithi156 ceph-mon[32679]: pgmap v12459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22454.703088 secs 2024-04-27T00:32:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:39 smithi092 ceph-mon[29156]: pgmap v12459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22454.703088 secs 2024-04-27T00:32:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21757.672220 secs 2024-04-27T00:32:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21757.672220 secs 2024-04-27T00:32:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21757.672220 secs 2024-04-27T00:32:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:41 smithi189 ceph-mon[32756]: pgmap v12460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:41 smithi156 ceph-mon[32679]: pgmap v12460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:41 smithi092 ceph-mon[29156]: pgmap v12460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:43 smithi189 ceph-mon[32756]: pgmap v12461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:43 smithi156 ceph-mon[32679]: pgmap v12461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:43 smithi092 ceph-mon[29156]: pgmap v12461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22459.703223 secs 2024-04-27T00:32:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22459.703223 secs 2024-04-27T00:32:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22459.703223 secs 2024-04-27T00:32:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21762.672344 secs 2024-04-27T00:32:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:45 smithi189 ceph-mon[32756]: pgmap v12462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21762.672344 secs 2024-04-27T00:32:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:45 smithi156 ceph-mon[32679]: pgmap v12462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21762.672344 secs 2024-04-27T00:32:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:45 smithi092 ceph-mon[29156]: pgmap v12462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:47 smithi189 ceph-mon[32756]: pgmap v12463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:47 smithi156 ceph-mon[32679]: pgmap v12463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:47 smithi092 ceph-mon[29156]: pgmap v12463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:49 smithi189 ceph-mon[32756]: pgmap v12464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22464.703359 secs 2024-04-27T00:32:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:49 smithi156 ceph-mon[32679]: pgmap v12464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22464.703359 secs 2024-04-27T00:32:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:49 smithi092 ceph-mon[29156]: pgmap v12464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22464.703359 secs 2024-04-27T00:32:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21767.672467 secs 2024-04-27T00:32:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21767.672467 secs 2024-04-27T00:32:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21767.672467 secs 2024-04-27T00:32:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:51 smithi189 ceph-mon[32756]: pgmap v12465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:51 smithi156 ceph-mon[32679]: pgmap v12465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:51 smithi092 ceph-mon[29156]: pgmap v12465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:53 smithi189 ceph-mon[32756]: pgmap v12466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:53 smithi156 ceph-mon[32679]: pgmap v12466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:53 smithi092 ceph-mon[29156]: pgmap v12466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22469.703500 secs 2024-04-27T00:32:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22469.703500 secs 2024-04-27T00:32:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22469.703500 secs 2024-04-27T00:32:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21772.672587 secs 2024-04-27T00:32:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:55 smithi189 ceph-mon[32756]: pgmap v12467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21772.672587 secs 2024-04-27T00:32:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:55 smithi092 ceph-mon[29156]: pgmap v12467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21772.672587 secs 2024-04-27T00:32:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:55 smithi156 ceph-mon[32679]: pgmap v12467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:32:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:57 smithi189 ceph-mon[32756]: pgmap v12468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:57 smithi156 ceph-mon[32679]: pgmap v12468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:57 smithi092 ceph-mon[29156]: pgmap v12468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:59 smithi189 ceph-mon[32756]: pgmap v12469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:32:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22474.703635 secs 2024-04-27T00:32:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:59 smithi156 ceph-mon[32679]: pgmap v12469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:32:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22474.703635 secs 2024-04-27T00:32:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:59 smithi092 ceph-mon[29156]: pgmap v12469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:32:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:32:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22474.703635 secs 2024-04-27T00:33:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21777.672703 secs 2024-04-27T00:33:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21777.672703 secs 2024-04-27T00:33:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21777.672703 secs 2024-04-27T00:33:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:01 smithi189 ceph-mon[32756]: pgmap v12470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:01 smithi156 ceph-mon[32679]: pgmap v12470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:01 smithi092 ceph-mon[29156]: pgmap v12470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:02 smithi189 ceph-mon[32756]: pgmap v12471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:02 smithi156 ceph-mon[32679]: pgmap v12471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:02 smithi092 ceph-mon[29156]: pgmap v12471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:03 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22479.703753 secs 2024-04-27T00:33:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:03 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22479.703753 secs 2024-04-27T00:33:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:03 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22479.703753 secs 2024-04-27T00:33:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:04 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 21782.672828 secs 2024-04-27T00:33:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:04 smithi092 ceph-mon[29156]: slow request 11520.083983 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:33:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:04 smithi092 ceph-mon[29156]: pgmap v12472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:04 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 21782.672828 secs 2024-04-27T00:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:04 smithi189 ceph-mon[32756]: slow request 11520.083983 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:33:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:04 smithi189 ceph-mon[32756]: pgmap v12472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:04 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 21782.672828 secs 2024-04-27T00:33:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:04 smithi156 ceph-mon[32679]: slow request 11520.083983 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:33:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:04 smithi156 ceph-mon[32679]: pgmap v12472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:07 smithi092 ceph-mon[29156]: pgmap v12473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:07 smithi189 ceph-mon[32756]: pgmap v12473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:07 smithi156 ceph-mon[32679]: pgmap v12473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:09 smithi189 ceph-mon[32756]: pgmap v12474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22484.703858 secs 2024-04-27T00:33:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:09 smithi156 ceph-mon[32679]: pgmap v12474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22484.703858 secs 2024-04-27T00:33:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:09 smithi092 ceph-mon[29156]: pgmap v12474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22484.703858 secs 2024-04-27T00:33:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21787.672948 secs 2024-04-27T00:33:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21787.672948 secs 2024-04-27T00:33:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21787.672948 secs 2024-04-27T00:33:11.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:11 smithi092 ceph-mon[29156]: pgmap v12475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:11.343 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:33:11.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:11 smithi156 ceph-mon[32679]: pgmap v12475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:11.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:33:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:11 smithi189 ceph-mon[32756]: pgmap v12475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:33:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:13 smithi156 ceph-mon[32679]: pgmap v12476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:13 smithi189 ceph-mon[32756]: pgmap v12476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:13 smithi092 ceph-mon[29156]: pgmap v12476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:14.360 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22489.703928 secs 2024-04-27T00:33:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22489.703928 secs 2024-04-27T00:33:14.422 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22489.703928 secs 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21792.673081 secs 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: pgmap v12477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:33:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21792.673081 secs 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: pgmap v12477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:33:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:33:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21792.673081 secs 2024-04-27T00:33:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: pgmap v12477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:33:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:33:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:33:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:16 smithi189 ceph-mon[32756]: pgmap v12478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:33:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:16 smithi189 ceph-mon[32756]: pgmap v12479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:16 smithi156 ceph-mon[32679]: pgmap v12478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:33:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:16 smithi156 ceph-mon[32679]: pgmap v12479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:16 smithi092 ceph-mon[29156]: pgmap v12478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:33:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:16 smithi092 ceph-mon[29156]: pgmap v12479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:18 smithi189 ceph-mon[32756]: pgmap v12480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:18 smithi156 ceph-mon[32679]: pgmap v12480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:18 smithi092 ceph-mon[29156]: pgmap v12480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22494.704023 secs 2024-04-27T00:33:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22494.704023 secs 2024-04-27T00:33:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22494.704023 secs 2024-04-27T00:33:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:20 smithi189 ceph-mon[32756]: pgmap v12481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21797.673175 secs 2024-04-27T00:33:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:20 smithi156 ceph-mon[32679]: pgmap v12481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21797.673175 secs 2024-04-27T00:33:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:20 smithi092 ceph-mon[29156]: pgmap v12481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21797.673175 secs 2024-04-27T00:33:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:22 smithi189 ceph-mon[32756]: pgmap v12482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:22 smithi156 ceph-mon[32679]: pgmap v12482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:22 smithi092 ceph-mon[29156]: pgmap v12482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:33:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:24 smithi189 ceph-mon[32756]: pgmap v12483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:33:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22499.704134 secs 2024-04-27T00:33:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:24 smithi156 ceph-mon[32679]: pgmap v12483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:33:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22499.704134 secs 2024-04-27T00:33:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:24 smithi092 ceph-mon[29156]: pgmap v12483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:33:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22499.704134 secs 2024-04-27T00:33:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21802.673330 secs 2024-04-27T00:33:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21802.673330 secs 2024-04-27T00:33:25.441 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21802.673330 secs 2024-04-27T00:33:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:26 smithi189 ceph-mon[32756]: pgmap v12484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:33:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:26 smithi156 ceph-mon[32679]: pgmap v12484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:33:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:26 smithi092 ceph-mon[29156]: pgmap v12484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:33:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:28 smithi189 ceph-mon[32756]: pgmap v12485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:28 smithi156 ceph-mon[32679]: pgmap v12485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:28 smithi092 ceph-mon[29156]: pgmap v12485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22504.704231 secs 2024-04-27T00:33:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22504.704231 secs 2024-04-27T00:33:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22504.704231 secs 2024-04-27T00:33:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:30 smithi189 ceph-mon[32756]: pgmap v12486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21807.673427 secs 2024-04-27T00:33:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:30 smithi156 ceph-mon[32679]: pgmap v12486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21807.673427 secs 2024-04-27T00:33:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:30 smithi092 ceph-mon[29156]: pgmap v12486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21807.673427 secs 2024-04-27T00:33:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:32 smithi189 ceph-mon[32756]: pgmap v12487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:32 smithi156 ceph-mon[32679]: pgmap v12487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:32 smithi092 ceph-mon[29156]: pgmap v12487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:34 smithi189 ceph-mon[32756]: pgmap v12488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22509.704370 secs 2024-04-27T00:33:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:34 smithi156 ceph-mon[32679]: pgmap v12488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22509.704370 secs 2024-04-27T00:33:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:34 smithi092 ceph-mon[29156]: pgmap v12488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22509.704370 secs 2024-04-27T00:33:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21812.673577 secs 2024-04-27T00:33:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21812.673577 secs 2024-04-27T00:33:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21812.673577 secs 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000814) for more than 900000000 us, fault. 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80b0050 comp rx=0 tx=0).stop 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T00:33:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:33:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.023+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80d5000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T00:33:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.061+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.061+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.061+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.061+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=23 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.061+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.062+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T00:33:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:36.062+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T00:33:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:36 smithi189 ceph-mon[32756]: pgmap v12489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:36 smithi156 ceph-mon[32679]: pgmap v12489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:36 smithi092 ceph-mon[29156]: pgmap v12489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:38 smithi189 ceph-mon[32756]: pgmap v12490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:38 smithi156 ceph-mon[32679]: pgmap v12490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:38 smithi092 ceph-mon[29156]: pgmap v12490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:39.068+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:33:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:39.068+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:33:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:39.068+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:33:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:33:39.068+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 175 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:33:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22514.704483 secs 2024-04-27T00:33:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22514.704483 secs 2024-04-27T00:33:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22514.704483 secs 2024-04-27T00:33:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:40 smithi189 ceph-mon[32756]: pgmap v12491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21817.673696 secs 2024-04-27T00:33:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:40 smithi156 ceph-mon[32679]: pgmap v12491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21817.673696 secs 2024-04-27T00:33:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:40 smithi092 ceph-mon[29156]: pgmap v12491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21817.673696 secs 2024-04-27T00:33:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:41 smithi189 ceph-mon[32756]: pgmap v12492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:41 smithi156 ceph-mon[32679]: pgmap v12492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:41 smithi092 ceph-mon[29156]: pgmap v12492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:43 smithi189 ceph-mon[32756]: pgmap v12493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:43 smithi156 ceph-mon[32679]: pgmap v12493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:43 smithi092 ceph-mon[29156]: pgmap v12493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22519.704601 secs 2024-04-27T00:33:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22519.704601 secs 2024-04-27T00:33:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22519.704601 secs 2024-04-27T00:33:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21822.673814 secs 2024-04-27T00:33:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:45 smithi189 ceph-mon[32756]: pgmap v12494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21822.673814 secs 2024-04-27T00:33:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:45 smithi156 ceph-mon[32679]: pgmap v12494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21822.673814 secs 2024-04-27T00:33:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:45 smithi092 ceph-mon[29156]: pgmap v12494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:47 smithi189 ceph-mon[32756]: pgmap v12495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:47 smithi156 ceph-mon[32679]: pgmap v12495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:47 smithi092 ceph-mon[29156]: pgmap v12495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:49 smithi189 ceph-mon[32756]: pgmap v12496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22524.704717 secs 2024-04-27T00:33:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:49 smithi156 ceph-mon[32679]: pgmap v12496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22524.704717 secs 2024-04-27T00:33:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:49 smithi092 ceph-mon[29156]: pgmap v12496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22524.704717 secs 2024-04-27T00:33:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21827.673932 secs 2024-04-27T00:33:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21827.673932 secs 2024-04-27T00:33:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21827.673932 secs 2024-04-27T00:33:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:51 smithi189 ceph-mon[32756]: pgmap v12497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:51 smithi156 ceph-mon[32679]: pgmap v12497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:51 smithi092 ceph-mon[29156]: pgmap v12497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:53 smithi189 ceph-mon[32756]: pgmap v12498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:53 smithi156 ceph-mon[32679]: pgmap v12498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:53.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:53 smithi092 ceph-mon[29156]: pgmap v12498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22529.704808 secs 2024-04-27T00:33:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21832.674048 secs 2024-04-27T00:33:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22529.704808 secs 2024-04-27T00:33:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21832.674048 secs 2024-04-27T00:33:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22529.704808 secs 2024-04-27T00:33:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21832.674048 secs 2024-04-27T00:33:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:55 smithi189 ceph-mon[32756]: pgmap v12499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:55.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:55 smithi092 ceph-mon[29156]: pgmap v12499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:55 smithi156 ceph-mon[32679]: pgmap v12499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:57.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:57 smithi189 ceph-mon[32756]: pgmap v12500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:57 smithi156 ceph-mon[32679]: pgmap v12500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:57 smithi092 ceph-mon[29156]: pgmap v12500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:33:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:59 smithi189 ceph-mon[32756]: pgmap v12501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22534.704927 secs 2024-04-27T00:33:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:33:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21837.674169 secs 2024-04-27T00:33:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:59 smithi156 ceph-mon[32679]: pgmap v12501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22534.704927 secs 2024-04-27T00:33:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:33:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21837.674169 secs 2024-04-27T00:33:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:59 smithi092 ceph-mon[29156]: pgmap v12501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:33:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22534.704927 secs 2024-04-27T00:33:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:33:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21837.674169 secs 2024-04-27T00:34:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:01 smithi189 ceph-mon[32756]: pgmap v12502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:01 smithi156 ceph-mon[32679]: pgmap v12502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:01 smithi092 ceph-mon[29156]: pgmap v12502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:03 smithi189 ceph-mon[32756]: pgmap v12503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:03 smithi156 ceph-mon[32679]: pgmap v12503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:03 smithi092 ceph-mon[29156]: pgmap v12503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22539.704991 secs 2024-04-27T00:34:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21842.674287 secs 2024-04-27T00:34:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22539.704991 secs 2024-04-27T00:34:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21842.674287 secs 2024-04-27T00:34:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22539.704991 secs 2024-04-27T00:34:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21842.674287 secs 2024-04-27T00:34:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:05 smithi189 ceph-mon[32756]: pgmap v12504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:05 smithi156 ceph-mon[32679]: pgmap v12504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:05 smithi092 ceph-mon[29156]: pgmap v12504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:07.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:07 smithi189 ceph-mon[32756]: pgmap v12505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:07 smithi156 ceph-mon[32679]: pgmap v12505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:07 smithi092 ceph-mon[29156]: pgmap v12505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:09 smithi189 ceph-mon[32756]: pgmap v12506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22544.705102 secs 2024-04-27T00:34:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21847.674393 secs 2024-04-27T00:34:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:09 smithi156 ceph-mon[32679]: pgmap v12506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22544.705102 secs 2024-04-27T00:34:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21847.674393 secs 2024-04-27T00:34:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:09 smithi092 ceph-mon[29156]: pgmap v12506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22544.705102 secs 2024-04-27T00:34:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21847.674393 secs 2024-04-27T00:34:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:11 smithi189 ceph-mon[32756]: pgmap v12507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:11 smithi156 ceph-mon[32679]: pgmap v12507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:11 smithi092 ceph-mon[29156]: pgmap v12507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:13 smithi156 ceph-mon[32679]: pgmap v12508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:13 smithi092 ceph-mon[29156]: pgmap v12508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:13 smithi189 ceph-mon[32756]: pgmap v12508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22549.705224 secs 2024-04-27T00:34:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21852.674466 secs 2024-04-27T00:34:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22549.705224 secs 2024-04-27T00:34:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21852.674466 secs 2024-04-27T00:34:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22549.705224 secs 2024-04-27T00:34:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21852.674466 secs 2024-04-27T00:34:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:15 smithi156 ceph-mon[32679]: pgmap v12509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:34:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:15 smithi092 ceph-mon[29156]: pgmap v12509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:34:15.993 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:15 smithi189 ceph-mon[32756]: pgmap v12509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:15.994 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:34:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:17 smithi189 ceph-mon[32756]: pgmap v12510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:17 smithi156 ceph-mon[32679]: pgmap v12510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:17 smithi092 ceph-mon[29156]: pgmap v12510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22554.705298 secs 2024-04-27T00:34:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22554.705298 secs 2024-04-27T00:34:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22554.705298 secs 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: pgmap v12511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21857.674620 secs 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:34:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:34:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: pgmap v12512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:34:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: pgmap v12513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: pgmap v12511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21857.674620 secs 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: pgmap v12512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: pgmap v12513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: pgmap v12511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21857.674620 secs 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: pgmap v12512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:34:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: pgmap v12513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:34:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:22 smithi189 ceph-mon[32756]: pgmap v12514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:22 smithi156 ceph-mon[32679]: pgmap v12514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:22 smithi092 ceph-mon[29156]: pgmap v12514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:24 smithi189 ceph-mon[32756]: pgmap v12515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22559.705394 secs 2024-04-27T00:34:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:24 smithi156 ceph-mon[32679]: pgmap v12515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22559.705394 secs 2024-04-27T00:34:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:24 smithi092 ceph-mon[29156]: pgmap v12515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22559.705394 secs 2024-04-27T00:34:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21862.674732 secs 2024-04-27T00:34:25.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21862.674732 secs 2024-04-27T00:34:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21862.674732 secs 2024-04-27T00:34:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:26 smithi189 ceph-mon[32756]: pgmap v12516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:26 smithi156 ceph-mon[32679]: pgmap v12516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:26 smithi092 ceph-mon[29156]: pgmap v12516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:34:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:28 smithi189 ceph-mon[32756]: pgmap v12517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:28 smithi156 ceph-mon[32679]: pgmap v12517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:28 smithi092 ceph-mon[29156]: pgmap v12517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T00:34:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22564.705519 secs 2024-04-27T00:34:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22564.705519 secs 2024-04-27T00:34:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22564.705519 secs 2024-04-27T00:34:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21867.674844 secs 2024-04-27T00:34:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:30 smithi189 ceph-mon[32756]: pgmap v12518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:34:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21867.674844 secs 2024-04-27T00:34:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:30 smithi156 ceph-mon[32679]: pgmap v12518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:34:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21867.674844 secs 2024-04-27T00:34:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:30 smithi092 ceph-mon[29156]: pgmap v12518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:34:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:31 smithi189 ceph-mon[32756]: pgmap v12519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:31 smithi156 ceph-mon[32679]: pgmap v12519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:31 smithi092 ceph-mon[29156]: pgmap v12519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:34 smithi189 ceph-mon[32756]: pgmap v12520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22569.705591 secs 2024-04-27T00:34:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:34 smithi156 ceph-mon[32679]: pgmap v12520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22569.705591 secs 2024-04-27T00:34:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:34 smithi092 ceph-mon[29156]: pgmap v12520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22569.705591 secs 2024-04-27T00:34:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21872.674944 secs 2024-04-27T00:34:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21872.674944 secs 2024-04-27T00:34:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21872.674944 secs 2024-04-27T00:34:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:36 smithi189 ceph-mon[32756]: pgmap v12521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:36 smithi156 ceph-mon[32679]: pgmap v12521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-mon[29156]: pgmap v12521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:37.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:34:36.747+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:34:37.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:34:36.747+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:34:37.243 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:34:36.747+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:34:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:34:36.747+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:34:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:34:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:34:36.747+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:34:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:38 smithi189 ceph-mon[32756]: pgmap v12522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:38 smithi156 ceph-mon[32679]: pgmap v12522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:38 smithi092 ceph-mon[29156]: pgmap v12522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22574.705711 secs 2024-04-27T00:34:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22574.705711 secs 2024-04-27T00:34:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22574.705711 secs 2024-04-27T00:34:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21877.675060 secs 2024-04-27T00:34:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:40 smithi189 ceph-mon[32756]: pgmap v12523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21877.675060 secs 2024-04-27T00:34:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:40 smithi156 ceph-mon[32679]: pgmap v12523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21877.675060 secs 2024-04-27T00:34:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:40 smithi092 ceph-mon[29156]: pgmap v12523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:41 smithi189 ceph-mon[32756]: pgmap v12524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:41 smithi156 ceph-mon[32679]: pgmap v12524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:41 smithi092 ceph-mon[29156]: pgmap v12524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:44 smithi189 ceph-mon[32756]: pgmap v12525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22579.705772 secs 2024-04-27T00:34:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:44 smithi156 ceph-mon[32679]: pgmap v12525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22579.705772 secs 2024-04-27T00:34:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:44 smithi092 ceph-mon[29156]: pgmap v12525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22579.705772 secs 2024-04-27T00:34:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21882.675181 secs 2024-04-27T00:34:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21882.675181 secs 2024-04-27T00:34:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21882.675181 secs 2024-04-27T00:34:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:46 smithi189 ceph-mon[32756]: pgmap v12526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:46 smithi156 ceph-mon[32679]: pgmap v12526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:46 smithi092 ceph-mon[29156]: pgmap v12526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:48 smithi189 ceph-mon[32756]: pgmap v12527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:48 smithi156 ceph-mon[32679]: pgmap v12527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:48 smithi092 ceph-mon[29156]: pgmap v12527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:34:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22584.705896 secs 2024-04-27T00:34:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22584.705896 secs 2024-04-27T00:34:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22584.705896 secs 2024-04-27T00:34:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21887.675291 secs 2024-04-27T00:34:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:50 smithi189 ceph-mon[32756]: pgmap v12528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21887.675291 secs 2024-04-27T00:34:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:50 smithi156 ceph-mon[32679]: pgmap v12528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21887.675291 secs 2024-04-27T00:34:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:50 smithi092 ceph-mon[29156]: pgmap v12528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:34:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:51 smithi189 ceph-mon[32756]: pgmap v12529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:51 smithi156 ceph-mon[32679]: pgmap v12529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:51 smithi092 ceph-mon[29156]: pgmap v12529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:54 smithi189 ceph-mon[32756]: pgmap v12530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22589.705961 secs 2024-04-27T00:34:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:54 smithi156 ceph-mon[32679]: pgmap v12530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22589.705961 secs 2024-04-27T00:34:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:54 smithi092 ceph-mon[29156]: pgmap v12530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22589.705961 secs 2024-04-27T00:34:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21892.675421 secs 2024-04-27T00:34:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21892.675421 secs 2024-04-27T00:34:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21892.675421 secs 2024-04-27T00:34:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:56 smithi092 ceph-mon[29156]: pgmap v12531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:56 smithi189 ceph-mon[32756]: pgmap v12531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:56 smithi156 ceph-mon[32679]: pgmap v12531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:34:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:58 smithi189 ceph-mon[32756]: pgmap v12532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:58 smithi156 ceph-mon[32679]: pgmap v12532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:58 smithi092 ceph-mon[29156]: pgmap v12532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:34:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:34:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22594.706070 secs 2024-04-27T00:34:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:34:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22594.706070 secs 2024-04-27T00:34:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:34:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22594.706070 secs 2024-04-27T00:35:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21897.675534 secs 2024-04-27T00:35:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:00 smithi189 ceph-mon[32756]: pgmap v12533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21897.675534 secs 2024-04-27T00:35:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:00 smithi156 ceph-mon[32679]: pgmap v12533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21897.675534 secs 2024-04-27T00:35:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:00 smithi092 ceph-mon[29156]: pgmap v12533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:01 smithi189 ceph-mon[32756]: pgmap v12534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:01 smithi156 ceph-mon[32679]: pgmap v12534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:01 smithi092 ceph-mon[29156]: pgmap v12534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:04 smithi189 ceph-mon[32756]: pgmap v12535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22599.706187 secs 2024-04-27T00:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:04 smithi156 ceph-mon[32679]: pgmap v12535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22599.706187 secs 2024-04-27T00:35:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:04 smithi092 ceph-mon[29156]: pgmap v12535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22599.706187 secs 2024-04-27T00:35:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21902.675635 secs 2024-04-27T00:35:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21902.675635 secs 2024-04-27T00:35:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21902.675635 secs 2024-04-27T00:35:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:06 smithi189 ceph-mon[32756]: pgmap v12536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:06 smithi156 ceph-mon[32679]: pgmap v12536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:06 smithi092 ceph-mon[29156]: pgmap v12536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:08 smithi189 ceph-mon[32756]: pgmap v12537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:08 smithi156 ceph-mon[32679]: pgmap v12537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:08 smithi092 ceph-mon[29156]: pgmap v12537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22604.706281 secs 2024-04-27T00:35:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22604.706281 secs 2024-04-27T00:35:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22604.706281 secs 2024-04-27T00:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:10 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 21907.675754 secs 2024-04-27T00:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:10 smithi189 ceph-mon[32756]: slow request 2882.816268 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:35:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:10 smithi189 ceph-mon[32756]: pgmap v12538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:10 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 21907.675754 secs 2024-04-27T00:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:10 smithi156 ceph-mon[32679]: slow request 2882.816268 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:35:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:10 smithi156 ceph-mon[32679]: pgmap v12538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:10 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 21907.675754 secs 2024-04-27T00:35:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:10 smithi092 ceph-mon[29156]: slow request 2882.816268 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:35:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:10 smithi092 ceph-mon[29156]: pgmap v12538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:11 smithi189 ceph-mon[32756]: pgmap v12539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:11 smithi156 ceph-mon[32679]: pgmap v12539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:11 smithi092 ceph-mon[29156]: pgmap v12539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:14 smithi189 ceph-mon[32756]: pgmap v12540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22609.706397 secs 2024-04-27T00:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:14 smithi156 ceph-mon[32679]: pgmap v12540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22609.706397 secs 2024-04-27T00:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:14 smithi092 ceph-mon[29156]: pgmap v12540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22609.706397 secs 2024-04-27T00:35:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21912.675910 secs 2024-04-27T00:35:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21912.675910 secs 2024-04-27T00:35:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21912.675910 secs 2024-04-27T00:35:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:16 smithi189 ceph-mon[32756]: pgmap v12541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:16 smithi156 ceph-mon[32679]: pgmap v12541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:16 smithi092 ceph-mon[29156]: pgmap v12541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:17 smithi156 ceph-mon[32679]: pgmap v12542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:17 smithi092 ceph-mon[29156]: pgmap v12542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:17 smithi189 ceph-mon[32756]: pgmap v12542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22614.706462 secs 2024-04-27T00:35:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22614.706462 secs 2024-04-27T00:35:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22614.706462 secs 2024-04-27T00:35:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21917.676046 secs 2024-04-27T00:35:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:19 smithi092 ceph-mon[29156]: pgmap v12543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:35:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21917.676046 secs 2024-04-27T00:35:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:19 smithi189 ceph-mon[32756]: pgmap v12543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:35:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21917.676046 secs 2024-04-27T00:35:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:19 smithi156 ceph-mon[32679]: pgmap v12543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:35:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:35:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:35:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:20 smithi092 ceph-mon[29156]: pgmap v12544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:35:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:20 smithi092 ceph-mon[29156]: pgmap v12545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:35:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:35:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:35:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:20 smithi189 ceph-mon[32756]: pgmap v12544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:35:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:20 smithi189 ceph-mon[32756]: pgmap v12545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:35:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:35:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:35:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:20 smithi156 ceph-mon[32679]: pgmap v12544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:35:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:20 smithi156 ceph-mon[32679]: pgmap v12545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:35:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:22 smithi092 ceph-mon[29156]: pgmap v12546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:22 smithi189 ceph-mon[32756]: pgmap v12546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:22 smithi156 ceph-mon[32679]: pgmap v12546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:23 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22619.706601 secs 2024-04-27T00:35:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:23 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22619.706601 secs 2024-04-27T00:35:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:23 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22619.706601 secs 2024-04-27T00:35:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21922.676148 secs 2024-04-27T00:35:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:24 smithi092 ceph-mon[29156]: pgmap v12547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21922.676148 secs 2024-04-27T00:35:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:24 smithi189 ceph-mon[32756]: pgmap v12547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21922.676148 secs 2024-04-27T00:35:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:24 smithi156 ceph-mon[32679]: pgmap v12547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:26 smithi092 ceph-mon[29156]: pgmap v12548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:26 smithi189 ceph-mon[32756]: pgmap v12548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:27.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:26 smithi156 ceph-mon[32679]: pgmap v12548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:35:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:28 smithi092 ceph-mon[29156]: pgmap v12549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:35:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22624.706746 secs 2024-04-27T00:35:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:28 smithi189 ceph-mon[32756]: pgmap v12549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:35:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22624.706746 secs 2024-04-27T00:35:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:28 smithi156 ceph-mon[32679]: pgmap v12549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:35:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22624.706746 secs 2024-04-27T00:35:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21927.676226 secs 2024-04-27T00:35:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21927.676226 secs 2024-04-27T00:35:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21927.676226 secs 2024-04-27T00:35:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:30 smithi092 ceph-mon[29156]: pgmap v12550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:35:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:30 smithi189 ceph-mon[32756]: pgmap v12550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:35:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:30 smithi156 ceph-mon[32679]: pgmap v12550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:35:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:32 smithi092 ceph-mon[29156]: pgmap v12551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:32 smithi189 ceph-mon[32756]: pgmap v12551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:32 smithi156 ceph-mon[32679]: pgmap v12551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22629.706863 secs 2024-04-27T00:35:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22629.706863 secs 2024-04-27T00:35:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22629.706863 secs 2024-04-27T00:35:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21932.676356 secs 2024-04-27T00:35:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:35 smithi189 ceph-mon[32756]: pgmap v12552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21932.676356 secs 2024-04-27T00:35:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:35 smithi156 ceph-mon[32679]: pgmap v12552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21932.676356 secs 2024-04-27T00:35:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:35 smithi092 ceph-mon[29156]: pgmap v12552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:37 smithi189 ceph-mon[32756]: pgmap v12553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:37 smithi156 ceph-mon[32679]: pgmap v12553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:37 smithi092 ceph-mon[29156]: pgmap v12553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:39 smithi189 ceph-mon[32756]: pgmap v12554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22634.706979 secs 2024-04-27T00:35:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:39 smithi156 ceph-mon[32679]: pgmap v12554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22634.706979 secs 2024-04-27T00:35:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:39 smithi092 ceph-mon[29156]: pgmap v12554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22634.706979 secs 2024-04-27T00:35:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21937.676471 secs 2024-04-27T00:35:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21937.676471 secs 2024-04-27T00:35:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21937.676471 secs 2024-04-27T00:35:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:41 smithi189 ceph-mon[32756]: pgmap v12555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:41 smithi156 ceph-mon[32679]: pgmap v12555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:41 smithi092 ceph-mon[29156]: pgmap v12555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:43 smithi189 ceph-mon[32756]: pgmap v12556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:43 smithi156 ceph-mon[32679]: pgmap v12556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:43 smithi092 ceph-mon[29156]: pgmap v12556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22639.707098 secs 2024-04-27T00:35:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22639.707098 secs 2024-04-27T00:35:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22639.707098 secs 2024-04-27T00:35:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21942.676542 secs 2024-04-27T00:35:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:45 smithi189 ceph-mon[32756]: pgmap v12557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21942.676542 secs 2024-04-27T00:35:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:45 smithi156 ceph-mon[32679]: pgmap v12557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21942.676542 secs 2024-04-27T00:35:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:45 smithi092 ceph-mon[29156]: pgmap v12557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:47 smithi189 ceph-mon[32756]: pgmap v12558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:47 smithi156 ceph-mon[32679]: pgmap v12558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:47 smithi092 ceph-mon[29156]: pgmap v12558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:49 smithi189 ceph-mon[32756]: pgmap v12559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22644.707213 secs 2024-04-27T00:35:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:49 smithi156 ceph-mon[32679]: pgmap v12559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22644.707213 secs 2024-04-27T00:35:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:49 smithi092 ceph-mon[29156]: pgmap v12559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22644.707213 secs 2024-04-27T00:35:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21947.676660 secs 2024-04-27T00:35:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21947.676660 secs 2024-04-27T00:35:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21947.676660 secs 2024-04-27T00:35:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:51 smithi189 ceph-mon[32756]: pgmap v12560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:51 smithi156 ceph-mon[32679]: pgmap v12560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:51 smithi092 ceph-mon[29156]: pgmap v12560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:53 smithi189 ceph-mon[32756]: pgmap v12561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:53 smithi156 ceph-mon[32679]: pgmap v12561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:53 smithi092 ceph-mon[29156]: pgmap v12561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22649.707346 secs 2024-04-27T00:35:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22649.707346 secs 2024-04-27T00:35:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22649.707346 secs 2024-04-27T00:35:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21952.676736 secs 2024-04-27T00:35:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:55 smithi189 ceph-mon[32756]: pgmap v12562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:55.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21952.676736 secs 2024-04-27T00:35:55.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:55 smithi092 ceph-mon[29156]: pgmap v12562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21952.676736 secs 2024-04-27T00:35:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:55 smithi156 ceph-mon[32679]: pgmap v12562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:35:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:57 smithi189 ceph-mon[32756]: pgmap v12563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:57 smithi156 ceph-mon[32679]: pgmap v12563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:57 smithi092 ceph-mon[29156]: pgmap v12563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:59 smithi189 ceph-mon[32756]: pgmap v12564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:35:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22654.707456 secs 2024-04-27T00:35:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:59 smithi156 ceph-mon[32679]: pgmap v12564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:35:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22654.707456 secs 2024-04-27T00:35:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:59 smithi092 ceph-mon[29156]: pgmap v12564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:35:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:35:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22654.707456 secs 2024-04-27T00:36:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21957.676899 secs 2024-04-27T00:36:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21957.676899 secs 2024-04-27T00:36:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21957.676899 secs 2024-04-27T00:36:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:01 smithi189 ceph-mon[32756]: pgmap v12565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:01 smithi156 ceph-mon[32679]: pgmap v12565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:01 smithi092 ceph-mon[29156]: pgmap v12565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:03 smithi189 ceph-mon[32756]: pgmap v12566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:03 smithi156 ceph-mon[32679]: pgmap v12566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:03 smithi092 ceph-mon[29156]: pgmap v12566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22659.707585 secs 2024-04-27T00:36:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22659.707585 secs 2024-04-27T00:36:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22659.707585 secs 2024-04-27T00:36:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21962.677019 secs 2024-04-27T00:36:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:05 smithi189 ceph-mon[32756]: pgmap v12567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21962.677019 secs 2024-04-27T00:36:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:05 smithi156 ceph-mon[32679]: pgmap v12567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21962.677019 secs 2024-04-27T00:36:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:05 smithi092 ceph-mon[29156]: pgmap v12567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:07 smithi189 ceph-mon[32756]: pgmap v12568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:07 smithi156 ceph-mon[32679]: pgmap v12568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:07 smithi092 ceph-mon[29156]: pgmap v12568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:09 smithi189 ceph-mon[32756]: pgmap v12569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22664.707700 secs 2024-04-27T00:36:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:09 smithi156 ceph-mon[32679]: pgmap v12569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22664.707700 secs 2024-04-27T00:36:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:09 smithi092 ceph-mon[29156]: pgmap v12569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22664.707700 secs 2024-04-27T00:36:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:10 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 21967.677156 secs 2024-04-27T00:36:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:10 smithi189 ceph-mon[32756]: slow request 722.226916 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:36:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:10 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 21967.677156 secs 2024-04-27T00:36:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:10 smithi156 ceph-mon[32679]: slow request 722.226916 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:36:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:10 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 21967.677156 secs 2024-04-27T00:36:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:10 smithi092 ceph-mon[29156]: slow request 722.226916 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:36:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:11 smithi189 ceph-mon[32756]: pgmap v12570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:11 smithi156 ceph-mon[32679]: pgmap v12570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:11 smithi092 ceph-mon[29156]: pgmap v12570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:13 smithi189 ceph-mon[32756]: pgmap v12571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:13 smithi156 ceph-mon[32679]: pgmap v12571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:13 smithi092 ceph-mon[29156]: pgmap v12571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22669.707818 secs 2024-04-27T00:36:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22669.707818 secs 2024-04-27T00:36:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22669.707818 secs 2024-04-27T00:36:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21972.677316 secs 2024-04-27T00:36:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:15 smithi189 ceph-mon[32756]: pgmap v12572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21972.677316 secs 2024-04-27T00:36:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:15 smithi156 ceph-mon[32679]: pgmap v12572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21972.677316 secs 2024-04-27T00:36:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:15 smithi092 ceph-mon[29156]: pgmap v12572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:17 smithi189 ceph-mon[32756]: pgmap v12573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:17 smithi156 ceph-mon[32679]: pgmap v12573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:17 smithi092 ceph-mon[29156]: pgmap v12573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:19 smithi189 ceph-mon[32756]: pgmap v12574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22674.707907 secs 2024-04-27T00:36:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:19 smithi156 ceph-mon[32679]: pgmap v12574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22674.707907 secs 2024-04-27T00:36:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:19 smithi092 ceph-mon[29156]: pgmap v12574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:36:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22674.707907 secs 2024-04-27T00:36:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21977.677370 secs 2024-04-27T00:36:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:36:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21977.677370 secs 2024-04-27T00:36:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:36:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21977.677370 secs 2024-04-27T00:36:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:36:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:21 smithi189 ceph-mon[32756]: pgmap v12575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:36:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:36:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:36:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:21 smithi156 ceph-mon[32679]: pgmap v12575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:36:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:36:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:36:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:21 smithi092 ceph-mon[29156]: pgmap v12575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:36:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:36:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:36:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:36:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:22 smithi189 ceph-mon[32756]: pgmap v12576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:36:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:22 smithi189 ceph-mon[32756]: pgmap v12577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:36:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:22 smithi156 ceph-mon[32679]: pgmap v12576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:36:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:22 smithi156 ceph-mon[32679]: pgmap v12577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:36:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:22 smithi092 ceph-mon[29156]: pgmap v12576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:36:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:22 smithi092 ceph-mon[29156]: pgmap v12577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:36:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:23 smithi189 ceph-mon[32756]: pgmap v12578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:36:23.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:23 smithi156 ceph-mon[32679]: pgmap v12578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:36:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:23 smithi092 ceph-mon[29156]: pgmap v12578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:36:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22679.708005 secs 2024-04-27T00:36:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22679.708005 secs 2024-04-27T00:36:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22679.708005 secs 2024-04-27T00:36:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21982.677493 secs 2024-04-27T00:36:25.395 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:25 smithi092 ceph-mon[29156]: pgmap v12579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21982.677493 secs 2024-04-27T00:36:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:25 smithi156 ceph-mon[32679]: pgmap v12579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21982.677493 secs 2024-04-27T00:36:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:25 smithi189 ceph-mon[32756]: pgmap v12579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:27 smithi189 ceph-mon[32756]: pgmap v12580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:27 smithi156 ceph-mon[32679]: pgmap v12580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:27 smithi092 ceph-mon[29156]: pgmap v12580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22684.708147 secs 2024-04-27T00:36:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22684.708147 secs 2024-04-27T00:36:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22684.708147 secs 2024-04-27T00:36:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:29 smithi092 ceph-mon[29156]: pgmap v12581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21987.677614 secs 2024-04-27T00:36:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:29 smithi189 ceph-mon[32756]: pgmap v12581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21987.677614 secs 2024-04-27T00:36:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:29 smithi156 ceph-mon[32679]: pgmap v12581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:36:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21987.677614 secs 2024-04-27T00:36:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:31 smithi189 ceph-mon[32756]: pgmap v12582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:36:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:31 smithi156 ceph-mon[32679]: pgmap v12582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:36:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:31 smithi092 ceph-mon[29156]: pgmap v12582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:36:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:33 smithi189 ceph-mon[32756]: pgmap v12583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22689.708293 secs 2024-04-27T00:36:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:33 smithi156 ceph-mon[32679]: pgmap v12583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:33 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22689.708293 secs 2024-04-27T00:36:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:33 smithi092 ceph-mon[29156]: pgmap v12583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22689.708293 secs 2024-04-27T00:36:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21992.677682 secs 2024-04-27T00:36:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21992.677682 secs 2024-04-27T00:36:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21992.677682 secs 2024-04-27T00:36:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:35 smithi189 ceph-mon[32756]: pgmap v12584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:35 smithi156 ceph-mon[32679]: pgmap v12584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:35 smithi092 ceph-mon[29156]: pgmap v12584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:37 smithi189 ceph-mon[32756]: pgmap v12585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:37 smithi156 ceph-mon[32679]: pgmap v12585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:37 smithi092 ceph-mon[29156]: pgmap v12585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:39.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22694.708403 secs 2024-04-27T00:36:39.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22694.708403 secs 2024-04-27T00:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:36:39.093+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:36:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:36:39.093+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:36:39.093+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:36:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:36:39.093+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 176 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d9100 con 0x5617fb906f00 2024-04-27T00:36:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22694.708403 secs 2024-04-27T00:36:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:39 smithi189 ceph-mon[32756]: pgmap v12586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 21997.677808 secs 2024-04-27T00:36:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:39 smithi156 ceph-mon[32679]: pgmap v12586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 21997.677808 secs 2024-04-27T00:36:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:39 smithi092 ceph-mon[29156]: pgmap v12586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 21997.677808 secs 2024-04-27T00:36:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:41 smithi189 ceph-mon[32756]: pgmap v12587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:41 smithi156 ceph-mon[32679]: pgmap v12587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:41 smithi092 ceph-mon[29156]: pgmap v12587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:43 smithi189 ceph-mon[32756]: pgmap v12588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22699.708524 secs 2024-04-27T00:36:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:43 smithi156 ceph-mon[32679]: pgmap v12588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22699.708524 secs 2024-04-27T00:36:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:43 smithi092 ceph-mon[29156]: pgmap v12588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22699.708524 secs 2024-04-27T00:36:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22002.677901 secs 2024-04-27T00:36:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22002.677901 secs 2024-04-27T00:36:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22002.677901 secs 2024-04-27T00:36:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:45 smithi189 ceph-mon[32756]: pgmap v12589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:45 smithi156 ceph-mon[32679]: pgmap v12589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:45 smithi092 ceph-mon[29156]: pgmap v12589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:47 smithi189 ceph-mon[32756]: pgmap v12590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:47 smithi156 ceph-mon[32679]: pgmap v12590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:47 smithi092 ceph-mon[29156]: pgmap v12590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22704.708662 secs 2024-04-27T00:36:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22704.708662 secs 2024-04-27T00:36:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22704.708662 secs 2024-04-27T00:36:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:49 smithi189 ceph-mon[32756]: pgmap v12591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22007.678025 secs 2024-04-27T00:36:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:49 smithi156 ceph-mon[32679]: pgmap v12591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22007.678025 secs 2024-04-27T00:36:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:49 smithi092 ceph-mon[29156]: pgmap v12591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22007.678025 secs 2024-04-27T00:36:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:51 smithi189 ceph-mon[32756]: pgmap v12592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:51 smithi156 ceph-mon[32679]: pgmap v12592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:51 smithi092 ceph-mon[29156]: pgmap v12592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:53 smithi189 ceph-mon[32756]: pgmap v12593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22709.708723 secs 2024-04-27T00:36:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:53 smithi156 ceph-mon[32679]: pgmap v12593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22709.708723 secs 2024-04-27T00:36:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:53 smithi092 ceph-mon[29156]: pgmap v12593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22709.708723 secs 2024-04-27T00:36:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22012.678165 secs 2024-04-27T00:36:55.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22012.678165 secs 2024-04-27T00:36:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22012.678165 secs 2024-04-27T00:36:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:55 smithi189 ceph-mon[32756]: pgmap v12594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:55 smithi156 ceph-mon[32679]: pgmap v12594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:55 smithi092 ceph-mon[29156]: pgmap v12594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:36:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:57 smithi189 ceph-mon[32756]: pgmap v12595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:57 smithi156 ceph-mon[32679]: pgmap v12595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:57 smithi092 ceph-mon[29156]: pgmap v12595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:36:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:58 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22714.708859 secs 2024-04-27T00:36:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:58 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22714.708859 secs 2024-04-27T00:36:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:58 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22714.708859 secs 2024-04-27T00:37:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:59 smithi189 ceph-mon[32756]: pgmap v12596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:36:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22017.678228 secs 2024-04-27T00:37:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:59 smithi156 ceph-mon[32679]: pgmap v12596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:36:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22017.678228 secs 2024-04-27T00:37:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:59 smithi092 ceph-mon[29156]: pgmap v12596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:36:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22017.678228 secs 2024-04-27T00:37:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:01 smithi189 ceph-mon[32756]: pgmap v12597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:01 smithi156 ceph-mon[32679]: pgmap v12597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:01 smithi092 ceph-mon[29156]: pgmap v12597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:03 smithi189 ceph-mon[32756]: pgmap v12598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:03 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22719.708963 secs 2024-04-27T00:37:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:03 smithi156 ceph-mon[32679]: pgmap v12598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:03 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22719.708963 secs 2024-04-27T00:37:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:03 smithi092 ceph-mon[29156]: pgmap v12598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:03 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22719.708963 secs 2024-04-27T00:37:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22022.678353 secs 2024-04-27T00:37:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22022.678353 secs 2024-04-27T00:37:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22022.678353 secs 2024-04-27T00:37:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:05 smithi189 ceph-mon[32756]: pgmap v12599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:05 smithi156 ceph-mon[32679]: pgmap v12599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:05 smithi092 ceph-mon[29156]: pgmap v12599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:07 smithi189 ceph-mon[32756]: pgmap v12600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:07 smithi156 ceph-mon[32679]: pgmap v12600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:07 smithi092 ceph-mon[29156]: pgmap v12600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:08 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22724.709081 secs 2024-04-27T00:37:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:08 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22724.709081 secs 2024-04-27T00:37:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:08 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22724.709081 secs 2024-04-27T00:37:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:09 smithi189 ceph-mon[32756]: pgmap v12601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:10.257 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22027.678471 secs 2024-04-27T00:37:10.258 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:09 smithi092 ceph-mon[29156]: pgmap v12601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:10.258 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22027.678471 secs 2024-04-27T00:37:10.258 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:09 smithi156 ceph-mon[32679]: pgmap v12601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:10.258 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22027.678471 secs 2024-04-27T00:37:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:11 smithi189 ceph-mon[32756]: pgmap v12602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:11 smithi156 ceph-mon[32679]: pgmap v12602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:11 smithi092 ceph-mon[29156]: pgmap v12602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:13 smithi189 ceph-mon[32756]: pgmap v12603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:13 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22729.709182 secs 2024-04-27T00:37:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:13 smithi156 ceph-mon[32679]: pgmap v12603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:13 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22729.709182 secs 2024-04-27T00:37:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:13 smithi092 ceph-mon[29156]: pgmap v12603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:13 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22729.709182 secs 2024-04-27T00:37:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22032.678600 secs 2024-04-27T00:37:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22032.678600 secs 2024-04-27T00:37:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22032.678600 secs 2024-04-27T00:37:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:15 smithi189 ceph-mon[32756]: pgmap v12604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:15 smithi156 ceph-mon[32679]: pgmap v12604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:15 smithi092 ceph-mon[29156]: pgmap v12604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:17 smithi189 ceph-mon[32756]: pgmap v12605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:17 smithi156 ceph-mon[32679]: pgmap v12605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:17 smithi092 ceph-mon[29156]: pgmap v12605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22734.709307 secs 2024-04-27T00:37:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22734.709307 secs 2024-04-27T00:37:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22734.709307 secs 2024-04-27T00:37:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:19 smithi189 ceph-mon[32756]: pgmap v12606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22037.678712 secs 2024-04-27T00:37:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:19 smithi156 ceph-mon[32679]: pgmap v12606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22037.678712 secs 2024-04-27T00:37:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:19 smithi092 ceph-mon[29156]: pgmap v12606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22037.678712 secs 2024-04-27T00:37:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:37:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:37:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:37:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:21 smithi189 ceph-mon[32756]: pgmap v12607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:37:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:37:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:37:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:21 smithi156 ceph-mon[32679]: pgmap v12607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:37:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:37:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:37:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:21 smithi092 ceph-mon[29156]: pgmap v12607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:37:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:37:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:37:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:22 smithi189 ceph-mon[32756]: pgmap v12608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:37:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:22 smithi189 ceph-mon[32756]: pgmap v12609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:22 smithi156 ceph-mon[32679]: pgmap v12608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:37:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:22 smithi156 ceph-mon[32679]: pgmap v12609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:22 smithi092 ceph-mon[29156]: pgmap v12608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:37:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:22 smithi092 ceph-mon[29156]: pgmap v12609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:23 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22739.709458 secs 2024-04-27T00:37:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:23 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22739.709458 secs 2024-04-27T00:37:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:23 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22739.709458 secs 2024-04-27T00:37:25.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:24 smithi092 ceph-mon[29156]: pgmap v12610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:25.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22042.678819 secs 2024-04-27T00:37:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:24 smithi156 ceph-mon[32679]: pgmap v12610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22042.678819 secs 2024-04-27T00:37:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:24 smithi189 ceph-mon[32756]: pgmap v12610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22042.678819 secs 2024-04-27T00:37:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:26 smithi156 ceph-mon[32679]: pgmap v12611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:26 smithi092 ceph-mon[29156]: pgmap v12611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:26 smithi189 ceph-mon[32756]: pgmap v12611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:28 smithi156 ceph-mon[32679]: pgmap v12612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22744.709555 secs 2024-04-27T00:37:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:28 smithi092 ceph-mon[29156]: pgmap v12612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22744.709555 secs 2024-04-27T00:37:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:28 smithi189 ceph-mon[32756]: pgmap v12612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:37:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22744.709555 secs 2024-04-27T00:37:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22047.678898 secs 2024-04-27T00:37:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22047.678898 secs 2024-04-27T00:37:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22047.678898 secs 2024-04-27T00:37:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:30 smithi156 ceph-mon[32679]: pgmap v12613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:30 smithi092 ceph-mon[29156]: pgmap v12613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:30 smithi189 ceph-mon[32756]: pgmap v12613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:37:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:32 smithi156 ceph-mon[32679]: pgmap v12614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:37:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:32 smithi092 ceph-mon[29156]: pgmap v12614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:37:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:32 smithi189 ceph-mon[32756]: pgmap v12614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:37:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:33 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22749.709674 secs 2024-04-27T00:37:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22749.709674 secs 2024-04-27T00:37:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22749.709674 secs 2024-04-27T00:37:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:34 smithi156 ceph-mon[32679]: pgmap v12615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 22052.678979 secs 2024-04-27T00:37:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:34 smithi092 ceph-mon[29156]: pgmap v12615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 22052.678979 secs 2024-04-27T00:37:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:34 smithi189 ceph-mon[32756]: pgmap v12615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 22052.678979 secs 2024-04-27T00:37:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:36 smithi156 ceph-mon[32679]: pgmap v12616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:36 smithi092 ceph-mon[29156]: pgmap v12616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:36 smithi189 ceph-mon[32756]: pgmap v12616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:38 smithi156 ceph-mon[32679]: pgmap v12617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22754.709792 secs 2024-04-27T00:37:39.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:38 smithi189 ceph-mon[32756]: pgmap v12617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:39.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22754.709792 secs 2024-04-27T00:37:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:38 smithi092 ceph-mon[29156]: pgmap v12617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22754.709792 secs 2024-04-27T00:37:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:39 smithi156 ceph-mon[32679]: 17 slow requests, 2 included below; oldest blocked for > 22057.679111 secs 2024-04-27T00:37:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:39 smithi156 ceph-mon[32679]: slow request 1442.409725 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:37:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:39 smithi156 ceph-mon[32679]: slow request 182.071272 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:37:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:39 smithi092 ceph-mon[29156]: 17 slow requests, 2 included below; oldest blocked for > 22057.679111 secs 2024-04-27T00:37:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:39 smithi092 ceph-mon[29156]: slow request 1442.409725 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:37:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:39 smithi092 ceph-mon[29156]: slow request 182.071272 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:37:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:39 smithi189 ceph-mon[32756]: 17 slow requests, 2 included below; oldest blocked for > 22057.679111 secs 2024-04-27T00:37:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:39 smithi189 ceph-mon[32756]: slow request 1442.409725 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:37:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:39 smithi189 ceph-mon[32756]: slow request 182.071272 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:37:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:40 smithi092 ceph-mon[29156]: pgmap v12618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:40 smithi189 ceph-mon[32756]: pgmap v12618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:40 smithi156 ceph-mon[32679]: pgmap v12618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:41 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:37:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:41 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:37:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:41 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:37:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:41 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:37:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:41 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:37:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:41 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:37:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:42 smithi092 ceph-mon[29156]: pgmap v12619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:42 smithi189 ceph-mon[32756]: pgmap v12619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:42 smithi156 ceph-mon[32679]: pgmap v12619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22759.709909 secs 2024-04-27T00:37:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22759.709909 secs 2024-04-27T00:37:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22759.709909 secs 2024-04-27T00:37:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:44 smithi092 ceph-mon[29156]: pgmap v12620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22062.679249 secs 2024-04-27T00:37:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:44 smithi189 ceph-mon[32756]: pgmap v12620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22062.679249 secs 2024-04-27T00:37:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:44 smithi156 ceph-mon[32679]: pgmap v12620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22062.679249 secs 2024-04-27T00:37:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:46 smithi092 ceph-mon[29156]: pgmap v12621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:46 smithi189 ceph-mon[32756]: pgmap v12621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:46 smithi156 ceph-mon[32679]: pgmap v12621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:48 smithi092 ceph-mon[29156]: pgmap v12622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22764.710039 secs 2024-04-27T00:37:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:48 smithi189 ceph-mon[32756]: pgmap v12622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22764.710039 secs 2024-04-27T00:37:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:48 smithi156 ceph-mon[32679]: pgmap v12622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22764.710039 secs 2024-04-27T00:37:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22067.679388 secs 2024-04-27T00:37:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22067.679388 secs 2024-04-27T00:37:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22067.679388 secs 2024-04-27T00:37:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:50 smithi092 ceph-mon[29156]: pgmap v12623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:50 smithi189 ceph-mon[32756]: pgmap v12623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:50 smithi156 ceph-mon[32679]: pgmap v12623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:52 smithi092 ceph-mon[29156]: pgmap v12624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:52 smithi189 ceph-mon[32756]: pgmap v12624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:52 smithi156 ceph-mon[32679]: pgmap v12624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22769.710151 secs 2024-04-27T00:37:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22769.710151 secs 2024-04-27T00:37:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22769.710151 secs 2024-04-27T00:37:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:54 smithi092 ceph-mon[29156]: pgmap v12625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22072.679479 secs 2024-04-27T00:37:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:54 smithi189 ceph-mon[32756]: pgmap v12625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22072.679479 secs 2024-04-27T00:37:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:54 smithi156 ceph-mon[32679]: pgmap v12625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22072.679479 secs 2024-04-27T00:37:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:56 smithi092 ceph-mon[29156]: pgmap v12626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:56 smithi189 ceph-mon[32756]: pgmap v12626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:56 smithi156 ceph-mon[32679]: pgmap v12626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:37:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:58 smithi092 ceph-mon[29156]: pgmap v12627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:58 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22774.710247 secs 2024-04-27T00:37:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:58 smithi189 ceph-mon[32756]: pgmap v12627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:58 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22774.710247 secs 2024-04-27T00:37:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:58 smithi156 ceph-mon[32679]: pgmap v12627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:37:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:58 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22774.710247 secs 2024-04-27T00:38:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:37:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22077.679618 secs 2024-04-27T00:38:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:37:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22077.679618 secs 2024-04-27T00:38:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:37:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22077.679618 secs 2024-04-27T00:38:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:00 smithi092 ceph-mon[29156]: pgmap v12628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:00 smithi189 ceph-mon[32756]: pgmap v12628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:00 smithi156 ceph-mon[32679]: pgmap v12628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:02 smithi189 ceph-mon[32756]: pgmap v12629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:02 smithi156 ceph-mon[32679]: pgmap v12629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:02 smithi092 ceph-mon[29156]: pgmap v12629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22779.710361 secs 2024-04-27T00:38:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22779.710361 secs 2024-04-27T00:38:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22779.710361 secs 2024-04-27T00:38:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:05 smithi189 ceph-mon[32756]: pgmap v12630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22082.679735 secs 2024-04-27T00:38:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:05 smithi156 ceph-mon[32679]: pgmap v12630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22082.679735 secs 2024-04-27T00:38:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:05 smithi092 ceph-mon[29156]: pgmap v12630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22082.679735 secs 2024-04-27T00:38:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:07 smithi189 ceph-mon[32756]: pgmap v12631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:07 smithi156 ceph-mon[32679]: pgmap v12631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:07 smithi092 ceph-mon[29156]: pgmap v12631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:38:09.107+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:38:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:38:09.107+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:38:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:38:09.107+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:38:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:38:09.107+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 177 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:38:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:09 smithi189 ceph-mon[32756]: pgmap v12632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22784.710478 secs 2024-04-27T00:38:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:09 smithi156 ceph-mon[32679]: pgmap v12632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22784.710478 secs 2024-04-27T00:38:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:09 smithi092 ceph-mon[29156]: pgmap v12632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22784.710478 secs 2024-04-27T00:38:10.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22087.679841 secs 2024-04-27T00:38:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22087.679841 secs 2024-04-27T00:38:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22087.679841 secs 2024-04-27T00:38:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:11 smithi189 ceph-mon[32756]: pgmap v12633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:11 smithi156 ceph-mon[32679]: pgmap v12633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:11 smithi092 ceph-mon[29156]: pgmap v12633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:13 smithi189 ceph-mon[32756]: pgmap v12634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:13 smithi156 ceph-mon[32679]: pgmap v12634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:13 smithi092 ceph-mon[29156]: pgmap v12634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22789.710597 secs 2024-04-27T00:38:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22789.710597 secs 2024-04-27T00:38:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22789.710597 secs 2024-04-27T00:38:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:15 smithi189 ceph-mon[32756]: pgmap v12635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22092.679946 secs 2024-04-27T00:38:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:15 smithi156 ceph-mon[32679]: pgmap v12635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22092.679946 secs 2024-04-27T00:38:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:15 smithi092 ceph-mon[29156]: pgmap v12635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22092.679946 secs 2024-04-27T00:38:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:17 smithi189 ceph-mon[32756]: pgmap v12636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:17 smithi156 ceph-mon[32679]: pgmap v12636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:17 smithi092 ceph-mon[29156]: pgmap v12636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:19 smithi189 ceph-mon[32756]: pgmap v12637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22794.710731 secs 2024-04-27T00:38:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:19 smithi156 ceph-mon[32679]: pgmap v12637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22794.710731 secs 2024-04-27T00:38:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:19 smithi092 ceph-mon[29156]: pgmap v12637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22794.710731 secs 2024-04-27T00:38:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22097.680065 secs 2024-04-27T00:38:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22097.680065 secs 2024-04-27T00:38:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22097.680065 secs 2024-04-27T00:38:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:21 smithi189 ceph-mon[32756]: pgmap v12638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:21 smithi156 ceph-mon[32679]: pgmap v12638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:21 smithi092 ceph-mon[29156]: pgmap v12638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:38:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:38:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:38:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: pgmap v12639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: pgmap v12639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: pgmap v12639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22799.710816 secs 2024-04-27T00:38:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22799.710816 secs 2024-04-27T00:38:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22799.710816 secs 2024-04-27T00:38:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: pgmap v12640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22102.680154 secs 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: pgmap v12640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:25.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22102.680154 secs 2024-04-27T00:38:25.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: pgmap v12640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22102.680154 secs 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: pgmap v12641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: pgmap v12642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:38:26.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: pgmap v12641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: pgmap v12642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: pgmap v12641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-27T00:38:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: pgmap v12642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:38:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:28 smithi189 ceph-mon[32756]: pgmap v12643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:28 smithi156 ceph-mon[32679]: pgmap v12643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:28 smithi092 ceph-mon[29156]: pgmap v12643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22804.710878 secs 2024-04-27T00:38:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22804.710878 secs 2024-04-27T00:38:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22804.710878 secs 2024-04-27T00:38:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22107.680254 secs 2024-04-27T00:38:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:30 smithi189 ceph-mon[32756]: pgmap v12644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22107.680254 secs 2024-04-27T00:38:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:30 smithi156 ceph-mon[32679]: pgmap v12644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22107.680254 secs 2024-04-27T00:38:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:30 smithi092 ceph-mon[29156]: pgmap v12644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:32 smithi189 ceph-mon[32756]: pgmap v12645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:32 smithi156 ceph-mon[32679]: pgmap v12645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:32 smithi092 ceph-mon[29156]: pgmap v12645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:34 smithi092 ceph-mon[29156]: pgmap v12646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:34.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22809.710944 secs 2024-04-27T00:38:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:34 smithi189 ceph-mon[32756]: pgmap v12646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:34.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22809.710944 secs 2024-04-27T00:38:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:34 smithi156 ceph-mon[32679]: pgmap v12646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:38:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22809.710944 secs 2024-04-27T00:38:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22112.680349 secs 2024-04-27T00:38:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22112.680349 secs 2024-04-27T00:38:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22112.680349 secs 2024-04-27T00:38:36.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:36 smithi189 ceph-mon[32756]: pgmap v12647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:38:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:36 smithi156 ceph-mon[32679]: pgmap v12647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:38:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:36 smithi092 ceph-mon[29156]: pgmap v12647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:38:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:38 smithi189 ceph-mon[32756]: pgmap v12648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:38 smithi156 ceph-mon[32679]: pgmap v12648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:38 smithi092 ceph-mon[29156]: pgmap v12648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:39.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22814.711032 secs 2024-04-27T00:38:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22814.711032 secs 2024-04-27T00:38:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22814.711032 secs 2024-04-27T00:38:40.833 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22117.680467 secs 2024-04-27T00:38:40.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:40 smithi156 ceph-mon[32679]: pgmap v12649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22117.680467 secs 2024-04-27T00:38:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:40 smithi189 ceph-mon[32756]: pgmap v12649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22117.680467 secs 2024-04-27T00:38:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:40 smithi092 ceph-mon[29156]: pgmap v12649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:42 smithi189 ceph-mon[32756]: pgmap v12650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:42 smithi156 ceph-mon[32679]: pgmap v12650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:42 smithi092 ceph-mon[29156]: pgmap v12650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:44 smithi189 ceph-mon[32756]: pgmap v12651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22819.711149 secs 2024-04-27T00:38:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:44 smithi156 ceph-mon[32679]: pgmap v12651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22819.711149 secs 2024-04-27T00:38:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:44 smithi092 ceph-mon[29156]: pgmap v12651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22819.711149 secs 2024-04-27T00:38:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22122.680577 secs 2024-04-27T00:38:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22122.680577 secs 2024-04-27T00:38:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22122.680577 secs 2024-04-27T00:38:46.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:46 smithi189 ceph-mon[32756]: pgmap v12652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:46 smithi156 ceph-mon[32679]: pgmap v12652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:46 smithi092 ceph-mon[29156]: pgmap v12652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:48.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:48 smithi189 ceph-mon[32756]: pgmap v12653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:48 smithi156 ceph-mon[32679]: pgmap v12653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:48 smithi092 ceph-mon[29156]: pgmap v12653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22824.711288 secs 2024-04-27T00:38:49.916 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22824.711288 secs 2024-04-27T00:38:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22824.711288 secs 2024-04-27T00:38:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22127.680692 secs 2024-04-27T00:38:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:50 smithi189 ceph-mon[32756]: pgmap v12654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22127.680692 secs 2024-04-27T00:38:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:50 smithi156 ceph-mon[32679]: pgmap v12654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22127.680692 secs 2024-04-27T00:38:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:50 smithi092 ceph-mon[29156]: pgmap v12654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:52 smithi189 ceph-mon[32756]: pgmap v12655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:52 smithi156 ceph-mon[32679]: pgmap v12655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:52 smithi092 ceph-mon[29156]: pgmap v12655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:54 smithi189 ceph-mon[32756]: pgmap v12656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22829.711407 secs 2024-04-27T00:38:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:54 smithi156 ceph-mon[32679]: pgmap v12656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22829.711407 secs 2024-04-27T00:38:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:54 smithi092 ceph-mon[29156]: pgmap v12656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22829.711407 secs 2024-04-27T00:38:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22132.680837 secs 2024-04-27T00:38:55.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22132.680837 secs 2024-04-27T00:38:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22132.680837 secs 2024-04-27T00:38:56.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:56 smithi189 ceph-mon[32756]: pgmap v12657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:56.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:56 smithi156 ceph-mon[32679]: pgmap v12657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:56.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:56 smithi092 ceph-mon[29156]: pgmap v12657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:38:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:58 smithi189 ceph-mon[32756]: pgmap v12658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:58 smithi156 ceph-mon[32679]: pgmap v12658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:58 smithi092 ceph-mon[29156]: pgmap v12658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:38:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:38:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22834.711511 secs 2024-04-27T00:38:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:38:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22834.711511 secs 2024-04-27T00:38:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:38:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22834.711511 secs 2024-04-27T00:39:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22137.680896 secs 2024-04-27T00:39:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:00 smithi189 ceph-mon[32756]: pgmap v12659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22137.680896 secs 2024-04-27T00:39:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:00 smithi156 ceph-mon[32679]: pgmap v12659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22137.680896 secs 2024-04-27T00:39:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:00 smithi092 ceph-mon[29156]: pgmap v12659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:02 smithi189 ceph-mon[32756]: pgmap v12660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:02.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:02 smithi156 ceph-mon[32679]: pgmap v12660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:02.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:02 smithi092 ceph-mon[29156]: pgmap v12660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:04 smithi189 ceph-mon[32756]: pgmap v12661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22839.711633 secs 2024-04-27T00:39:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:04 smithi156 ceph-mon[32679]: pgmap v12661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22839.711633 secs 2024-04-27T00:39:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:04 smithi092 ceph-mon[29156]: pgmap v12661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22839.711633 secs 2024-04-27T00:39:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22142.681009 secs 2024-04-27T00:39:05.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22142.681009 secs 2024-04-27T00:39:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22142.681009 secs 2024-04-27T00:39:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:06 smithi189 ceph-mon[32756]: pgmap v12662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:06.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:06 smithi156 ceph-mon[32679]: pgmap v12662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:06.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:06 smithi092 ceph-mon[29156]: pgmap v12662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:08 smithi189 ceph-mon[32756]: pgmap v12663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:08.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:08 smithi156 ceph-mon[32679]: pgmap v12663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:08.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:08 smithi092 ceph-mon[29156]: pgmap v12663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22844.711725 secs 2024-04-27T00:39:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22844.711725 secs 2024-04-27T00:39:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22844.711725 secs 2024-04-27T00:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22147.681122 secs 2024-04-27T00:39:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:10 smithi189 ceph-mon[32756]: pgmap v12664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22147.681122 secs 2024-04-27T00:39:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:10 smithi156 ceph-mon[32679]: pgmap v12664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22147.681122 secs 2024-04-27T00:39:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:10 smithi092 ceph-mon[29156]: pgmap v12664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:12.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:12 smithi189 ceph-mon[32756]: pgmap v12665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:12 smithi156 ceph-mon[32679]: pgmap v12665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:12 smithi092 ceph-mon[29156]: pgmap v12665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:14 smithi189 ceph-mon[32756]: pgmap v12666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22849.711876 secs 2024-04-27T00:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:14 smithi156 ceph-mon[32679]: pgmap v12666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22849.711876 secs 2024-04-27T00:39:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:14 smithi092 ceph-mon[29156]: pgmap v12666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22849.711876 secs 2024-04-27T00:39:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22152.681234 secs 2024-04-27T00:39:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22152.681234 secs 2024-04-27T00:39:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22152.681234 secs 2024-04-27T00:39:16.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:16 smithi189 ceph-mon[32756]: pgmap v12667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:16 smithi156 ceph-mon[32679]: pgmap v12667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:16 smithi092 ceph-mon[29156]: pgmap v12667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:18 smithi189 ceph-mon[32756]: pgmap v12668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:18 smithi156 ceph-mon[32679]: pgmap v12668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:18 smithi092 ceph-mon[29156]: pgmap v12668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22854.711942 secs 2024-04-27T00:39:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22854.711942 secs 2024-04-27T00:39:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22854.711942 secs 2024-04-27T00:39:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22157.681332 secs 2024-04-27T00:39:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:20 smithi189 ceph-mon[32756]: pgmap v12669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22157.681332 secs 2024-04-27T00:39:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:20 smithi156 ceph-mon[32679]: pgmap v12669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22157.681332 secs 2024-04-27T00:39:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:20 smithi092 ceph-mon[29156]: pgmap v12669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:22 smithi189 ceph-mon[32756]: pgmap v12670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:22 smithi156 ceph-mon[32679]: pgmap v12670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:22 smithi092 ceph-mon[29156]: pgmap v12670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:24 smithi156 ceph-mon[32679]: pgmap v12671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22859.712061 secs 2024-04-27T00:39:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:24 smithi092 ceph-mon[29156]: pgmap v12671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22859.712061 secs 2024-04-27T00:39:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:24 smithi189 ceph-mon[32756]: pgmap v12671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22859.712061 secs 2024-04-27T00:39:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22162.681396 secs 2024-04-27T00:39:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:39:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22162.681396 secs 2024-04-27T00:39:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:39:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22162.681396 secs 2024-04-27T00:39:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:39:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:26 smithi156 ceph-mon[32679]: pgmap v12672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:39:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:39:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:39:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:26 smithi092 ceph-mon[29156]: pgmap v12672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:39:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:39:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:39:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:26 smithi189 ceph-mon[32756]: pgmap v12672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:39:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:39:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:39:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:27 smithi156 ceph-mon[32679]: pgmap v12673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:39:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:27 smithi156 ceph-mon[32679]: pgmap v12674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:27 smithi092 ceph-mon[29156]: pgmap v12673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:39:27.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:27 smithi092 ceph-mon[29156]: pgmap v12674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:27 smithi189 ceph-mon[32756]: pgmap v12673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:39:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:27 smithi189 ceph-mon[32756]: pgmap v12674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:29 smithi156 ceph-mon[32679]: pgmap v12675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:39:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22864.712180 secs 2024-04-27T00:39:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22167.681521 secs 2024-04-27T00:39:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:29 smithi092 ceph-mon[29156]: pgmap v12675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:39:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22864.712180 secs 2024-04-27T00:39:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22167.681521 secs 2024-04-27T00:39:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:29 smithi189 ceph-mon[32756]: pgmap v12675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:39:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22864.712180 secs 2024-04-27T00:39:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22167.681521 secs 2024-04-27T00:39:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:31 smithi156 ceph-mon[32679]: pgmap v12676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:31 smithi092 ceph-mon[29156]: pgmap v12676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:31 smithi189 ceph-mon[32756]: pgmap v12676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:33 smithi156 ceph-mon[32679]: pgmap v12677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:33 smithi092 ceph-mon[29156]: pgmap v12677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:33 smithi189 ceph-mon[32756]: pgmap v12677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22869.712299 secs 2024-04-27T00:39:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22172.681664 secs 2024-04-27T00:39:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22869.712299 secs 2024-04-27T00:39:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22172.681664 secs 2024-04-27T00:39:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22869.712299 secs 2024-04-27T00:39:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22172.681664 secs 2024-04-27T00:39:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:35 smithi156 ceph-mon[32679]: pgmap v12678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:35 smithi092 ceph-mon[29156]: pgmap v12678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:35 smithi189 ceph-mon[32756]: pgmap v12678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:39:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:39:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:39:36.854+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:39:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:39:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:39:36.854+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:39:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:39:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:39:36.854+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:39:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:39:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:39:36.854+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:39:37.244 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:39:36 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:39:36.854+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:39:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:37 smithi156 ceph-mon[32679]: pgmap v12679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:39:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:37 smithi092 ceph-mon[29156]: pgmap v12679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:39:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:37 smithi189 ceph-mon[32756]: pgmap v12679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:39:39.119 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:39:39.119+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:39:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:39:39.119+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:39:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:39:39.119+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:39:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:39:39.119+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 178 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d9100 con 0x5617fb906f00 2024-04-27T00:39:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:39 smithi156 ceph-mon[32679]: pgmap v12680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22874.712416 secs 2024-04-27T00:39:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22177.681781 secs 2024-04-27T00:39:39.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:39 smithi189 ceph-mon[32756]: pgmap v12680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:39.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22874.712416 secs 2024-04-27T00:39:39.940 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22177.681781 secs 2024-04-27T00:39:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:39 smithi092 ceph-mon[29156]: pgmap v12680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22874.712416 secs 2024-04-27T00:39:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22177.681781 secs 2024-04-27T00:39:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:41 smithi156 ceph-mon[32679]: pgmap v12681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:41 smithi092 ceph-mon[29156]: pgmap v12681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:41 smithi189 ceph-mon[32756]: pgmap v12681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:43 smithi092 ceph-mon[29156]: pgmap v12682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:43 smithi189 ceph-mon[32756]: pgmap v12682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:43 smithi156 ceph-mon[32679]: pgmap v12682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22879.712529 secs 2024-04-27T00:39:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22182.681857 secs 2024-04-27T00:39:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22879.712529 secs 2024-04-27T00:39:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22182.681857 secs 2024-04-27T00:39:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22879.712529 secs 2024-04-27T00:39:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22182.681857 secs 2024-04-27T00:39:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:45 smithi092 ceph-mon[29156]: pgmap v12683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:45 smithi189 ceph-mon[32756]: pgmap v12683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:45 smithi156 ceph-mon[32679]: pgmap v12683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:47 smithi092 ceph-mon[29156]: pgmap v12684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:47 smithi189 ceph-mon[32756]: pgmap v12684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:47 smithi156 ceph-mon[32679]: pgmap v12684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22884.712647 secs 2024-04-27T00:39:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22884.712647 secs 2024-04-27T00:39:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22884.712647 secs 2024-04-27T00:39:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:49 smithi092 ceph-mon[29156]: pgmap v12685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22187.681932 secs 2024-04-27T00:39:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:49 smithi189 ceph-mon[32756]: pgmap v12685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22187.681932 secs 2024-04-27T00:39:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:49 smithi156 ceph-mon[32679]: pgmap v12685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T00:39:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22187.681932 secs 2024-04-27T00:39:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:51 smithi092 ceph-mon[29156]: pgmap v12686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:51 smithi189 ceph-mon[32756]: pgmap v12686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:51 smithi156 ceph-mon[32679]: pgmap v12686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T00:39:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:53 smithi092 ceph-mon[29156]: pgmap v12687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22889.712762 secs 2024-04-27T00:39:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:53 smithi189 ceph-mon[32756]: pgmap v12687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22889.712762 secs 2024-04-27T00:39:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:53 smithi156 ceph-mon[32679]: pgmap v12687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22889.712762 secs 2024-04-27T00:39:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22192.682004 secs 2024-04-27T00:39:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22192.682004 secs 2024-04-27T00:39:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22192.682004 secs 2024-04-27T00:39:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:55 smithi092 ceph-mon[29156]: pgmap v12688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:55 smithi189 ceph-mon[32756]: pgmap v12688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:55 smithi156 ceph-mon[32679]: pgmap v12688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:39:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:57 smithi092 ceph-mon[29156]: pgmap v12689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:57 smithi189 ceph-mon[32756]: pgmap v12689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:57 smithi156 ceph-mon[32679]: pgmap v12689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:58 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22894.712893 secs 2024-04-27T00:39:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:58 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22894.712893 secs 2024-04-27T00:39:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:58 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22894.712893 secs 2024-04-27T00:39:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:59 smithi092 ceph-mon[29156]: pgmap v12690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:39:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:39:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22197.682150 secs 2024-04-27T00:40:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:59 smithi189 ceph-mon[32756]: pgmap v12690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:39:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22197.682150 secs 2024-04-27T00:40:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:59 smithi156 ceph-mon[32679]: pgmap v12690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:39:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22197.682150 secs 2024-04-27T00:40:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:40:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:40:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:40:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:01 smithi092 ceph-mon[29156]: pgmap v12691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:01 smithi189 ceph-mon[32756]: pgmap v12691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:01 smithi156 ceph-mon[32679]: pgmap v12691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:03 smithi092 ceph-mon[29156]: pgmap v12692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:03 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22899.713010 secs 2024-04-27T00:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:03 smithi189 ceph-mon[32756]: pgmap v12692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:03 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22899.713010 secs 2024-04-27T00:40:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:03 smithi156 ceph-mon[32679]: pgmap v12692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:03 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22899.713010 secs 2024-04-27T00:40:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22202.682275 secs 2024-04-27T00:40:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22202.682275 secs 2024-04-27T00:40:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22202.682275 secs 2024-04-27T00:40:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:05 smithi092 ceph-mon[29156]: pgmap v12693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:05 smithi189 ceph-mon[32756]: pgmap v12693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:05 smithi156 ceph-mon[32679]: pgmap v12693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:07 smithi092 ceph-mon[29156]: pgmap v12694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:07 smithi189 ceph-mon[32756]: pgmap v12694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:07 smithi156 ceph-mon[32679]: pgmap v12694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:08.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:08 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22904.713151 secs 2024-04-27T00:40:09.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:08 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22904.713151 secs 2024-04-27T00:40:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:08 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22904.713151 secs 2024-04-27T00:40:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:09 smithi189 ceph-mon[32756]: pgmap v12695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22207.682338 secs 2024-04-27T00:40:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:09 smithi156 ceph-mon[32679]: pgmap v12695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22207.682338 secs 2024-04-27T00:40:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:09 smithi092 ceph-mon[29156]: pgmap v12695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22207.682338 secs 2024-04-27T00:40:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:11 smithi189 ceph-mon[32756]: pgmap v12696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:11 smithi156 ceph-mon[32679]: pgmap v12696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:11 smithi092 ceph-mon[29156]: pgmap v12696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:13 smithi189 ceph-mon[32756]: pgmap v12697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:13 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22909.713291 secs 2024-04-27T00:40:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:13 smithi156 ceph-mon[32679]: pgmap v12697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:13 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22909.713291 secs 2024-04-27T00:40:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:13 smithi092 ceph-mon[29156]: pgmap v12697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:40:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:13 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22909.713291 secs 2024-04-27T00:40:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22212.682460 secs 2024-04-27T00:40:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22212.682460 secs 2024-04-27T00:40:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22212.682460 secs 2024-04-27T00:40:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:15 smithi189 ceph-mon[32756]: pgmap v12698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:15 smithi156 ceph-mon[32679]: pgmap v12698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:15 smithi092 ceph-mon[29156]: pgmap v12698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:40:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:17 smithi189 ceph-mon[32756]: pgmap v12699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:17 smithi156 ceph-mon[32679]: pgmap v12699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:17 smithi092 ceph-mon[29156]: pgmap v12699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:19.065 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22914.713370 secs 2024-04-27T00:40:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22914.713370 secs 2024-04-27T00:40:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22914.713370 secs 2024-04-27T00:40:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:19 smithi189 ceph-mon[32756]: pgmap v12700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22217.682531 secs 2024-04-27T00:40:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:19 smithi156 ceph-mon[32679]: pgmap v12700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22217.682531 secs 2024-04-27T00:40:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:19 smithi092 ceph-mon[29156]: pgmap v12700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22217.682531 secs 2024-04-27T00:40:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:21 smithi189 ceph-mon[32756]: pgmap v12701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:21 smithi156 ceph-mon[32679]: pgmap v12701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:21 smithi092 ceph-mon[29156]: pgmap v12701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:23 smithi092 ceph-mon[29156]: pgmap v12702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:23 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22919.713488 secs 2024-04-27T00:40:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:23 smithi189 ceph-mon[32756]: pgmap v12702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:23 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22919.713488 secs 2024-04-27T00:40:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:23 smithi156 ceph-mon[32679]: pgmap v12702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:23 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22919.713488 secs 2024-04-27T00:40:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22222.682613 secs 2024-04-27T00:40:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22222.682613 secs 2024-04-27T00:40:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22222.682613 secs 2024-04-27T00:40:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:25 smithi189 ceph-mon[32756]: pgmap v12703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:26.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:25 smithi092 ceph-mon[29156]: pgmap v12703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:25 smithi156 ceph-mon[32679]: pgmap v12703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:40:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:40:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: pgmap v12704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: pgmap v12705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: pgmap v12706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:40:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: pgmap v12704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:40:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:40:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: pgmap v12705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:40:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: pgmap v12706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: pgmap v12704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: pgmap v12705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: pgmap v12706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:40:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22924.713603 secs 2024-04-27T00:40:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22924.713603 secs 2024-04-27T00:40:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22924.713603 secs 2024-04-27T00:40:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22227.682732 secs 2024-04-27T00:40:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:29 smithi189 ceph-mon[32756]: pgmap v12707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22227.682732 secs 2024-04-27T00:40:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:29 smithi156 ceph-mon[32679]: pgmap v12707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22227.682732 secs 2024-04-27T00:40:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:29 smithi092 ceph-mon[29156]: pgmap v12707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:32 smithi189 ceph-mon[32756]: pgmap v12708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:32 smithi156 ceph-mon[32679]: pgmap v12708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:32 smithi092 ceph-mon[29156]: pgmap v12708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:34 smithi189 ceph-mon[32756]: pgmap v12709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:40:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22929.713718 secs 2024-04-27T00:40:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:34 smithi156 ceph-mon[32679]: pgmap v12709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:40:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22929.713718 secs 2024-04-27T00:40:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:34 smithi092 ceph-mon[29156]: pgmap v12709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:40:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22929.713718 secs 2024-04-27T00:40:35.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22232.682864 secs 2024-04-27T00:40:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22232.682864 secs 2024-04-27T00:40:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22232.682864 secs 2024-04-27T00:40:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:36 smithi189 ceph-mon[32756]: pgmap v12710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:36 smithi156 ceph-mon[32679]: pgmap v12710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:36 smithi092 ceph-mon[29156]: pgmap v12710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:40:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:38 smithi189 ceph-mon[32756]: pgmap v12711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:40:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:38 smithi156 ceph-mon[32679]: pgmap v12711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:40:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:38 smithi092 ceph-mon[29156]: pgmap v12711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:40:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22934.713815 secs 2024-04-27T00:40:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22934.713815 secs 2024-04-27T00:40:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22934.713815 secs 2024-04-27T00:40:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:40 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 22237.682977 secs 2024-04-27T00:40:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:40 smithi189 ceph-mon[32756]: slow request 362.075138 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:40:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:40 smithi189 ceph-mon[32756]: pgmap v12712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:40 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 22237.682977 secs 2024-04-27T00:40:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:40 smithi156 ceph-mon[32679]: slow request 362.075138 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:40:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:40 smithi156 ceph-mon[32679]: pgmap v12712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:40 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 22237.682977 secs 2024-04-27T00:40:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:40 smithi092 ceph-mon[29156]: slow request 362.075138 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:40:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:40 smithi092 ceph-mon[29156]: pgmap v12712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:42 smithi189 ceph-mon[32756]: pgmap v12713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:42 smithi156 ceph-mon[32679]: pgmap v12713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:42 smithi092 ceph-mon[29156]: pgmap v12713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:44 smithi189 ceph-mon[32756]: pgmap v12714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22939.713953 secs 2024-04-27T00:40:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:44 smithi156 ceph-mon[32679]: pgmap v12714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22939.713953 secs 2024-04-27T00:40:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:44 smithi092 ceph-mon[29156]: pgmap v12714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22939.713953 secs 2024-04-27T00:40:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22242.683094 secs 2024-04-27T00:40:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22242.683094 secs 2024-04-27T00:40:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22242.683094 secs 2024-04-27T00:40:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:46 smithi189 ceph-mon[32756]: pgmap v12715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:46 smithi156 ceph-mon[32679]: pgmap v12715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:46 smithi092 ceph-mon[29156]: pgmap v12715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:40:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:48 smithi189 ceph-mon[32756]: pgmap v12716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:48 smithi156 ceph-mon[32679]: pgmap v12716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:48 smithi092 ceph-mon[29156]: pgmap v12716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:40:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22944.714074 secs 2024-04-27T00:40:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22944.714074 secs 2024-04-27T00:40:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22944.714074 secs 2024-04-27T00:40:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22247.683228 secs 2024-04-27T00:40:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:50 smithi189 ceph-mon[32756]: pgmap v12717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22247.683228 secs 2024-04-27T00:40:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:50 smithi156 ceph-mon[32679]: pgmap v12717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22247.683228 secs 2024-04-27T00:40:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:50 smithi092 ceph-mon[29156]: pgmap v12717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:52 smithi189 ceph-mon[32756]: pgmap v12718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:52 smithi156 ceph-mon[32679]: pgmap v12718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:52 smithi092 ceph-mon[29156]: pgmap v12718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:54 smithi189 ceph-mon[32756]: pgmap v12719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22949.714168 secs 2024-04-27T00:40:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:54 smithi156 ceph-mon[32679]: pgmap v12719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22949.714168 secs 2024-04-27T00:40:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:54 smithi092 ceph-mon[29156]: pgmap v12719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22949.714168 secs 2024-04-27T00:40:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22252.683365 secs 2024-04-27T00:40:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22252.683365 secs 2024-04-27T00:40:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22252.683365 secs 2024-04-27T00:40:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:56 smithi189 ceph-mon[32756]: pgmap v12720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:56.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:56 smithi092 ceph-mon[29156]: pgmap v12720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:56 smithi156 ceph-mon[32679]: pgmap v12720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:40:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:58 smithi189 ceph-mon[32756]: pgmap v12721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:58 smithi156 ceph-mon[32679]: pgmap v12721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:58 smithi092 ceph-mon[29156]: pgmap v12721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:40:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:40:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22954.714320 secs 2024-04-27T00:40:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:40:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22954.714320 secs 2024-04-27T00:40:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:40:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22954.714320 secs 2024-04-27T00:41:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22257.683491 secs 2024-04-27T00:41:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:00 smithi189 ceph-mon[32756]: pgmap v12722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:41:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22257.683491 secs 2024-04-27T00:41:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:00 smithi156 ceph-mon[32679]: pgmap v12722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:41:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22257.683491 secs 2024-04-27T00:41:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:00 smithi092 ceph-mon[29156]: pgmap v12722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:41:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:02 smithi156 ceph-mon[32679]: pgmap v12723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:02 smithi092 ceph-mon[29156]: pgmap v12723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:02 smithi189 ceph-mon[32756]: pgmap v12723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:04 smithi156 ceph-mon[32679]: pgmap v12724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22959.714435 secs 2024-04-27T00:41:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:04 smithi092 ceph-mon[29156]: pgmap v12724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22959.714435 secs 2024-04-27T00:41:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:04 smithi189 ceph-mon[32756]: pgmap v12724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22959.714435 secs 2024-04-27T00:41:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22262.683600 secs 2024-04-27T00:41:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22262.683600 secs 2024-04-27T00:41:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22262.683600 secs 2024-04-27T00:41:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:06 smithi156 ceph-mon[32679]: pgmap v12725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:06 smithi092 ceph-mon[29156]: pgmap v12725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:06 smithi189 ceph-mon[32756]: pgmap v12725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:08 smithi156 ceph-mon[32679]: pgmap v12726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:08 smithi092 ceph-mon[29156]: pgmap v12726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:08 smithi189 ceph-mon[32756]: pgmap v12726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22964.714508 secs 2024-04-27T00:41:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22964.714508 secs 2024-04-27T00:41:09.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22964.714508 secs 2024-04-27T00:41:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22267.683705 secs 2024-04-27T00:41:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:10 smithi156 ceph-mon[32679]: pgmap v12727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22267.683705 secs 2024-04-27T00:41:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:10 smithi092 ceph-mon[29156]: pgmap v12727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22267.683705 secs 2024-04-27T00:41:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:10 smithi189 ceph-mon[32756]: pgmap v12727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:12 smithi156 ceph-mon[32679]: pgmap v12728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:12 smithi092 ceph-mon[29156]: pgmap v12728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:12 smithi189 ceph-mon[32756]: pgmap v12728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:14 smithi156 ceph-mon[32679]: pgmap v12729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22969.714619 secs 2024-04-27T00:41:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:14 smithi092 ceph-mon[29156]: pgmap v12729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22969.714619 secs 2024-04-27T00:41:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:14 smithi189 ceph-mon[32756]: pgmap v12729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22969.714619 secs 2024-04-27T00:41:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22272.683765 secs 2024-04-27T00:41:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:15 smithi156 ceph-mon[32679]: pgmap v12730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22272.683765 secs 2024-04-27T00:41:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:15 smithi092 ceph-mon[29156]: pgmap v12730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22272.683765 secs 2024-04-27T00:41:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:15 smithi189 ceph-mon[32756]: pgmap v12730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:18 smithi189 ceph-mon[32756]: pgmap v12731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:18 smithi156 ceph-mon[32679]: pgmap v12731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:18 smithi092 ceph-mon[29156]: pgmap v12731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22974.714741 secs 2024-04-27T00:41:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22974.714741 secs 2024-04-27T00:41:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22974.714741 secs 2024-04-27T00:41:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22277.683842 secs 2024-04-27T00:41:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:20 smithi189 ceph-mon[32756]: pgmap v12732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22277.683842 secs 2024-04-27T00:41:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:20 smithi156 ceph-mon[32679]: pgmap v12732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22277.683842 secs 2024-04-27T00:41:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:20 smithi092 ceph-mon[29156]: pgmap v12732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:22 smithi189 ceph-mon[32756]: pgmap v12733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:22 smithi156 ceph-mon[32679]: pgmap v12733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:22 smithi092 ceph-mon[29156]: pgmap v12733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:24 smithi189 ceph-mon[32756]: pgmap v12734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22979.714852 secs 2024-04-27T00:41:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:24 smithi156 ceph-mon[32679]: pgmap v12734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22979.714852 secs 2024-04-27T00:41:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:24 smithi092 ceph-mon[29156]: pgmap v12734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22979.714852 secs 2024-04-27T00:41:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22282.683959 secs 2024-04-27T00:41:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22282.683959 secs 2024-04-27T00:41:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22282.683959 secs 2024-04-27T00:41:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:26 smithi189 ceph-mon[32756]: pgmap v12735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:26 smithi156 ceph-mon[32679]: pgmap v12735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:26 smithi092 ceph-mon[29156]: pgmap v12735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:28 smithi189 ceph-mon[32756]: pgmap v12736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:41:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:41:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:41:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:28 smithi156 ceph-mon[32679]: pgmap v12736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:41:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:41:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:28 smithi092 ceph-mon[29156]: pgmap v12736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:41:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:41:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:41:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:29 smithi189 ceph-mon[32756]: pgmap v12737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:29 smithi189 ceph-mon[32756]: pgmap v12738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:41:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22984.714891 secs 2024-04-27T00:41:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:29 smithi156 ceph-mon[32679]: pgmap v12737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:41:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:29 smithi156 ceph-mon[32679]: pgmap v12738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:41:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22984.714891 secs 2024-04-27T00:41:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:29 smithi092 ceph-mon[29156]: pgmap v12737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:41:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:29 smithi092 ceph-mon[29156]: pgmap v12738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:41:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22984.714891 secs 2024-04-27T00:41:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22287.684067 secs 2024-04-27T00:41:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22287.684067 secs 2024-04-27T00:41:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22287.684067 secs 2024-04-27T00:41:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:31 smithi189 ceph-mon[32756]: pgmap v12739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:31 smithi156 ceph-mon[32679]: pgmap v12739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:31 smithi092 ceph-mon[29156]: pgmap v12739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:33 smithi189 ceph-mon[32756]: pgmap v12740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:33 smithi156 ceph-mon[32679]: pgmap v12740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:33 smithi092 ceph-mon[29156]: pgmap v12740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22989.715004 secs 2024-04-27T00:41:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22989.715004 secs 2024-04-27T00:41:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22989.715004 secs 2024-04-27T00:41:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:35 smithi189 ceph-mon[32756]: pgmap v12741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22292.684209 secs 2024-04-27T00:41:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:35 smithi156 ceph-mon[32679]: pgmap v12741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22292.684209 secs 2024-04-27T00:41:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:35 smithi092 ceph-mon[29156]: pgmap v12741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22292.684209 secs 2024-04-27T00:41:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:37 smithi189 ceph-mon[32756]: pgmap v12742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:37 smithi156 ceph-mon[32679]: pgmap v12742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:37 smithi092 ceph-mon[29156]: pgmap v12742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:39 smithi189 ceph-mon[32756]: pgmap v12743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:41:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22994.715123 secs 2024-04-27T00:41:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:39 smithi156 ceph-mon[32679]: pgmap v12743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:41:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22994.715123 secs 2024-04-27T00:41:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:39 smithi092 ceph-mon[29156]: pgmap v12743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:41:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22994.715123 secs 2024-04-27T00:41:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22297.684279 secs 2024-04-27T00:41:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22297.684279 secs 2024-04-27T00:41:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22297.684279 secs 2024-04-27T00:41:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:41 smithi092 ceph-mon[29156]: pgmap v12744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:41 smithi156 ceph-mon[32679]: pgmap v12744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:41 smithi189 ceph-mon[32756]: pgmap v12744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:43 smithi156 ceph-mon[32679]: pgmap v12745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:43 smithi092 ceph-mon[29156]: pgmap v12745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:43 smithi189 ceph-mon[32756]: pgmap v12745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 22999.715246 secs 2024-04-27T00:41:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 22999.715246 secs 2024-04-27T00:41:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 22999.715246 secs 2024-04-27T00:41:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:45 smithi156 ceph-mon[32679]: pgmap v12746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22302.684386 secs 2024-04-27T00:41:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:45 smithi092 ceph-mon[29156]: pgmap v12746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22302.684386 secs 2024-04-27T00:41:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:45 smithi189 ceph-mon[32756]: pgmap v12746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22302.684386 secs 2024-04-27T00:41:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:47 smithi156 ceph-mon[32679]: pgmap v12747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:47 smithi092 ceph-mon[29156]: pgmap v12747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:47 smithi189 ceph-mon[32756]: pgmap v12747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:49 smithi156 ceph-mon[32679]: pgmap v12748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23004.715363 secs 2024-04-27T00:41:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:49 smithi092 ceph-mon[29156]: pgmap v12748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23004.715363 secs 2024-04-27T00:41:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:49 smithi189 ceph-mon[32756]: pgmap v12748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23004.715363 secs 2024-04-27T00:41:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22307.684511 secs 2024-04-27T00:41:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22307.684511 secs 2024-04-27T00:41:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22307.684511 secs 2024-04-27T00:41:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:51 smithi156 ceph-mon[32679]: pgmap v12749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:51 smithi092 ceph-mon[29156]: pgmap v12749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:51 smithi189 ceph-mon[32756]: pgmap v12749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:53 smithi156 ceph-mon[32679]: pgmap v12750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:53 smithi092 ceph-mon[29156]: pgmap v12750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:53 smithi189 ceph-mon[32756]: pgmap v12750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23009.715479 secs 2024-04-27T00:41:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23009.715479 secs 2024-04-27T00:41:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23009.715479 secs 2024-04-27T00:41:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:55 smithi156 ceph-mon[32679]: pgmap v12751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22312.684627 secs 2024-04-27T00:41:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:55 smithi092 ceph-mon[29156]: pgmap v12751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22312.684627 secs 2024-04-27T00:41:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:55 smithi189 ceph-mon[32756]: pgmap v12751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:41:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22312.684627 secs 2024-04-27T00:41:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:56 smithi092 ceph-mon[29156]: pgmap v12752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:56 smithi189 ceph-mon[32756]: pgmap v12752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:56 smithi156 ceph-mon[32679]: pgmap v12752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:58 smithi189 ceph-mon[32756]: pgmap v12753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:58 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23014.715596 secs 2024-04-27T00:41:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:58 smithi156 ceph-mon[32679]: pgmap v12753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:58 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23014.715596 secs 2024-04-27T00:41:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:58 smithi092 ceph-mon[29156]: pgmap v12753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:41:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:58 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23014.715596 secs 2024-04-27T00:42:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:41:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22317.684716 secs 2024-04-27T00:42:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:41:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22317.684716 secs 2024-04-27T00:42:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:41:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22317.684716 secs 2024-04-27T00:42:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:00 smithi189 ceph-mon[32756]: pgmap v12754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:00 smithi156 ceph-mon[32679]: pgmap v12754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:00 smithi092 ceph-mon[29156]: pgmap v12754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:02 smithi189 ceph-mon[32756]: pgmap v12755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:02 smithi156 ceph-mon[32679]: pgmap v12755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:02 smithi092 ceph-mon[29156]: pgmap v12755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:03 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23019.715731 secs 2024-04-27T00:42:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:03 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23019.715731 secs 2024-04-27T00:42:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:03 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23019.715731 secs 2024-04-27T00:42:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:04 smithi189 ceph-mon[32756]: pgmap v12756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22322.684869 secs 2024-04-27T00:42:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:04 smithi156 ceph-mon[32679]: pgmap v12756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22322.684869 secs 2024-04-27T00:42:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:04 smithi092 ceph-mon[29156]: pgmap v12756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22322.684869 secs 2024-04-27T00:42:07.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:06 smithi189 ceph-mon[32756]: pgmap v12757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:06 smithi156 ceph-mon[32679]: pgmap v12757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:06 smithi092 ceph-mon[29156]: pgmap v12757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:08 smithi189 ceph-mon[32756]: pgmap v12758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:08 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23024.715876 secs 2024-04-27T00:42:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:08 smithi156 ceph-mon[32679]: pgmap v12758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:08 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23024.715876 secs 2024-04-27T00:42:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:08 smithi092 ceph-mon[29156]: pgmap v12758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:08 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23024.715876 secs 2024-04-27T00:42:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22327.684945 secs 2024-04-27T00:42:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22327.684945 secs 2024-04-27T00:42:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22327.684945 secs 2024-04-27T00:42:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:10 smithi189 ceph-mon[32756]: pgmap v12759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:10 smithi156 ceph-mon[32679]: pgmap v12759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:10 smithi092 ceph-mon[29156]: pgmap v12759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:12.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:12 smithi092 ceph-mon[29156]: pgmap v12760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:12 smithi189 ceph-mon[32756]: pgmap v12760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:13.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:12 smithi156 ceph-mon[32679]: pgmap v12760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:13 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23029.715944 secs 2024-04-27T00:42:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:13 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23029.715944 secs 2024-04-27T00:42:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:13 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23029.715944 secs 2024-04-27T00:42:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:14 smithi156 ceph-mon[32679]: pgmap v12761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22332.685063 secs 2024-04-27T00:42:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:14 smithi092 ceph-mon[29156]: pgmap v12761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22332.685063 secs 2024-04-27T00:42:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:14 smithi189 ceph-mon[32756]: pgmap v12761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22332.685063 secs 2024-04-27T00:42:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:16 smithi156 ceph-mon[32679]: pgmap v12762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:16 smithi092 ceph-mon[29156]: pgmap v12762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:16 smithi189 ceph-mon[32756]: pgmap v12762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:18 smithi156 ceph-mon[32679]: pgmap v12763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23034.716048 secs 2024-04-27T00:42:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:18 smithi092 ceph-mon[29156]: pgmap v12763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23034.716048 secs 2024-04-27T00:42:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:18 smithi189 ceph-mon[32756]: pgmap v12763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23034.716048 secs 2024-04-27T00:42:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22337.685177 secs 2024-04-27T00:42:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22337.685177 secs 2024-04-27T00:42:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22337.685177 secs 2024-04-27T00:42:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:20 smithi156 ceph-mon[32679]: pgmap v12764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:20 smithi092 ceph-mon[29156]: pgmap v12764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:20 smithi189 ceph-mon[32756]: pgmap v12764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:22 smithi156 ceph-mon[32679]: pgmap v12765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:22 smithi092 ceph-mon[29156]: pgmap v12765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:22 smithi189 ceph-mon[32756]: pgmap v12765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:23 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23039.716118 secs 2024-04-27T00:42:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:23 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23039.716118 secs 2024-04-27T00:42:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:23 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23039.716118 secs 2024-04-27T00:42:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:24 smithi156 ceph-mon[32679]: pgmap v12766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22342.685333 secs 2024-04-27T00:42:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:24 smithi092 ceph-mon[29156]: pgmap v12766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22342.685333 secs 2024-04-27T00:42:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:24 smithi189 ceph-mon[32756]: pgmap v12766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22342.685333 secs 2024-04-27T00:42:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:26 smithi156 ceph-mon[32679]: pgmap v12767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:26 smithi092 ceph-mon[29156]: pgmap v12767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:26 smithi189 ceph-mon[32756]: pgmap v12767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:42:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:42:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:42:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: pgmap v12768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:42:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:42:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:42:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: 7 slow requests, 2 included below; oldest blocked for > 23044.716178 secs 2024-04-27T00:42:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: slow request 23044.647948 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-27T00:42:29.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:28 smithi092 ceph-mon[29156]: slow request 23044.716177 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: pgmap v12768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: 7 slow requests, 2 included below; oldest blocked for > 23044.716178 secs 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: slow request 23044.647948 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-27T00:42:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:28 smithi189 ceph-mon[32756]: slow request 23044.716177 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-27T00:42:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: pgmap v12768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:42:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:42:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:42:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: 7 slow requests, 2 included below; oldest blocked for > 23044.716178 secs 2024-04-27T00:42:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: slow request 23044.647948 seconds old, received at 2024-04-26T18:18:23.983971+0000: client_request(client.15261:234 rmsnap #0x1//scheduled-2024-04-26-18_12_00_UTC 2024-04-26T18:18:23.983892+0000 caller_uid=0, caller_gid=0{}) currently failed to xlock, waiting 2024-04-27T00:42:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:28 smithi156 ceph-mon[32679]: slow request 23044.716177 seconds old, received at 2024-04-26T18:18:23.915742+0000: peer_request:mds.2:1 currently dispatched 2024-04-27T00:42:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:29 smithi092 ceph-mon[29156]: pgmap v12769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:42:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:29 smithi092 ceph-mon[29156]: pgmap v12770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:42:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22347.685417 secs 2024-04-27T00:42:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:29 smithi189 ceph-mon[32756]: pgmap v12769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:42:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:29 smithi189 ceph-mon[32756]: pgmap v12770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:42:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22347.685417 secs 2024-04-27T00:42:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:29 smithi156 ceph-mon[32679]: pgmap v12769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:42:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:29 smithi156 ceph-mon[32679]: pgmap v12770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T00:42:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22347.685417 secs 2024-04-27T00:42:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:31 smithi092 ceph-mon[29156]: pgmap v12771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:31 smithi189 ceph-mon[32756]: pgmap v12771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:31 smithi156 ceph-mon[32679]: pgmap v12771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:33 smithi092 ceph-mon[29156]: pgmap v12772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:42:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23049.716293 secs 2024-04-27T00:42:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:33 smithi189 ceph-mon[32756]: pgmap v12772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:42:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23049.716293 secs 2024-04-27T00:42:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:33 smithi156 ceph-mon[32679]: pgmap v12772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:42:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:33 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23049.716293 secs 2024-04-27T00:42:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22352.685521 secs 2024-04-27T00:42:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22352.685521 secs 2024-04-27T00:42:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22352.685521 secs 2024-04-27T00:42:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:35 smithi092 ceph-mon[29156]: pgmap v12773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:35 smithi189 ceph-mon[32756]: pgmap v12773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:35 smithi156 ceph-mon[32679]: pgmap v12773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:37 smithi092 ceph-mon[29156]: pgmap v12774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:37 smithi189 ceph-mon[32756]: pgmap v12774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:37 smithi156 ceph-mon[32679]: pgmap v12774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:42:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:42:39.145+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:42:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:42:39.145+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:42:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:42:39.145+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80d9100 con 0x5617fb906f00 2024-04-27T00:42:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:42:39.145+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 179 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:42:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23054.716408 secs 2024-04-27T00:42:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23054.716408 secs 2024-04-27T00:42:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23054.716408 secs 2024-04-27T00:42:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:39 smithi092 ceph-mon[29156]: pgmap v12775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:42:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22357.685646 secs 2024-04-27T00:42:40.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:39 smithi189 ceph-mon[32756]: pgmap v12775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:42:40.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22357.685646 secs 2024-04-27T00:42:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:39 smithi156 ceph-mon[32679]: pgmap v12775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:42:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22357.685646 secs 2024-04-27T00:42:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:41 smithi092 ceph-mon[29156]: pgmap v12776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:41 smithi189 ceph-mon[32756]: pgmap v12776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:41 smithi156 ceph-mon[32679]: pgmap v12776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:44.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:43 smithi156 ceph-mon[32679]: pgmap v12777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:44.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23059.716525 secs 2024-04-27T00:42:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:43 smithi092 ceph-mon[29156]: pgmap v12777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23059.716525 secs 2024-04-27T00:42:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:43 smithi189 ceph-mon[32756]: pgmap v12777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23059.716525 secs 2024-04-27T00:42:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22362.685764 secs 2024-04-27T00:42:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22362.685764 secs 2024-04-27T00:42:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22362.685764 secs 2024-04-27T00:42:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:45 smithi092 ceph-mon[29156]: pgmap v12778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:45 smithi189 ceph-mon[32756]: pgmap v12778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:45 smithi156 ceph-mon[32679]: pgmap v12778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:47 smithi092 ceph-mon[29156]: pgmap v12779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:47 smithi189 ceph-mon[32756]: pgmap v12779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:47 smithi156 ceph-mon[32679]: pgmap v12779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23064.716646 secs 2024-04-27T00:42:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23064.716646 secs 2024-04-27T00:42:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23064.716646 secs 2024-04-27T00:42:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:49 smithi092 ceph-mon[29156]: pgmap v12780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22367.685825 secs 2024-04-27T00:42:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:49 smithi189 ceph-mon[32756]: pgmap v12780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22367.685825 secs 2024-04-27T00:42:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:49 smithi156 ceph-mon[32679]: pgmap v12780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22367.685825 secs 2024-04-27T00:42:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:51 smithi092 ceph-mon[29156]: pgmap v12781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:51 smithi189 ceph-mon[32756]: pgmap v12781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:51 smithi156 ceph-mon[32679]: pgmap v12781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:53 smithi189 ceph-mon[32756]: pgmap v12782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23069.716712 secs 2024-04-27T00:42:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:53 smithi156 ceph-mon[32679]: pgmap v12782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23069.716712 secs 2024-04-27T00:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:53 smithi092 ceph-mon[29156]: pgmap v12782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23069.716712 secs 2024-04-27T00:42:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22372.685963 secs 2024-04-27T00:42:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22372.685963 secs 2024-04-27T00:42:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22372.685963 secs 2024-04-27T00:42:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:56 smithi189 ceph-mon[32756]: pgmap v12783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:56 smithi156 ceph-mon[32679]: pgmap v12783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:56 smithi092 ceph-mon[29156]: pgmap v12783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:42:58.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:58 smithi092 ceph-mon[29156]: pgmap v12784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:58 smithi189 ceph-mon[32756]: pgmap v12784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:58 smithi156 ceph-mon[32679]: pgmap v12784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:42:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:42:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23074.716846 secs 2024-04-27T00:42:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:42:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23074.716846 secs 2024-04-27T00:42:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:42:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23074.716846 secs 2024-04-27T00:43:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:00 smithi189 ceph-mon[32756]: pgmap v12785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22377.686081 secs 2024-04-27T00:43:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:00 smithi156 ceph-mon[32679]: pgmap v12785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22377.686081 secs 2024-04-27T00:43:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:00 smithi092 ceph-mon[29156]: pgmap v12785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22377.686081 secs 2024-04-27T00:43:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:02 smithi189 ceph-mon[32756]: pgmap v12786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:02 smithi156 ceph-mon[32679]: pgmap v12786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:02 smithi092 ceph-mon[29156]: pgmap v12786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:04 smithi189 ceph-mon[32756]: pgmap v12787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:04 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 23079.716947 secs 2024-04-27T00:43:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:04 smithi189 ceph-mon[32756]: slow request 23043.653257 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:43:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:04 smithi156 ceph-mon[32679]: pgmap v12787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:04 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 23079.716947 secs 2024-04-27T00:43:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:04 smithi156 ceph-mon[32679]: slow request 23043.653257 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:43:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:04 smithi092 ceph-mon[29156]: pgmap v12787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:04 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 23079.716947 secs 2024-04-27T00:43:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:04 smithi092 ceph-mon[29156]: slow request 23043.653257 seconds old, received at 2024-04-26T18:18:59.979431+0000: client_request(client.24770:4276 open #0x10000000006/postmaster.pid 2024-04-26T18:18:59.978165+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:43:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22382.686188 secs 2024-04-27T00:43:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22382.686188 secs 2024-04-27T00:43:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22382.686188 secs 2024-04-27T00:43:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:06 smithi189 ceph-mon[32756]: pgmap v12788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:06 smithi156 ceph-mon[32679]: pgmap v12788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:06 smithi092 ceph-mon[29156]: pgmap v12788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:08 smithi189 ceph-mon[32756]: pgmap v12789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:08 smithi156 ceph-mon[32679]: pgmap v12789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:08 smithi092 ceph-mon[29156]: pgmap v12789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23084.717081 secs 2024-04-27T00:43:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23084.717081 secs 2024-04-27T00:43:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23084.717081 secs 2024-04-27T00:43:10.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:10 smithi189 ceph-mon[32756]: pgmap v12790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:10.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22387.686344 secs 2024-04-27T00:43:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:10 smithi156 ceph-mon[32679]: pgmap v12790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22387.686344 secs 2024-04-27T00:43:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:10 smithi092 ceph-mon[29156]: pgmap v12790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22387.686344 secs 2024-04-27T00:43:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:12 smithi189 ceph-mon[32756]: pgmap v12791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:12 smithi156 ceph-mon[32679]: pgmap v12791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:12 smithi092 ceph-mon[29156]: pgmap v12791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:14 smithi189 ceph-mon[32756]: pgmap v12792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23089.717178 secs 2024-04-27T00:43:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:14 smithi156 ceph-mon[32679]: pgmap v12792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23089.717178 secs 2024-04-27T00:43:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:14 smithi092 ceph-mon[29156]: pgmap v12792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23089.717178 secs 2024-04-27T00:43:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22392.686434 secs 2024-04-27T00:43:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22392.686434 secs 2024-04-27T00:43:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22392.686434 secs 2024-04-27T00:43:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:16 smithi189 ceph-mon[32756]: pgmap v12793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:16 smithi156 ceph-mon[32679]: pgmap v12793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:16 smithi092 ceph-mon[29156]: pgmap v12793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:18 smithi189 ceph-mon[32756]: pgmap v12794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:18 smithi156 ceph-mon[32679]: pgmap v12794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:18 smithi092 ceph-mon[29156]: pgmap v12794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23094.717269 secs 2024-04-27T00:43:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23094.717269 secs 2024-04-27T00:43:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23094.717269 secs 2024-04-27T00:43:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:20 smithi189 ceph-mon[32756]: pgmap v12795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22397.686507 secs 2024-04-27T00:43:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:20 smithi156 ceph-mon[32679]: pgmap v12795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22397.686507 secs 2024-04-27T00:43:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:20 smithi092 ceph-mon[29156]: pgmap v12795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22397.686507 secs 2024-04-27T00:43:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:22 smithi189 ceph-mon[32756]: pgmap v12796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:22 smithi156 ceph-mon[32679]: pgmap v12796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:22 smithi092 ceph-mon[29156]: pgmap v12796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:24 smithi189 ceph-mon[32756]: pgmap v12797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23099.717364 secs 2024-04-27T00:43:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:24 smithi156 ceph-mon[32679]: pgmap v12797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23099.717364 secs 2024-04-27T00:43:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:24 smithi092 ceph-mon[29156]: pgmap v12797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23099.717364 secs 2024-04-27T00:43:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22402.686627 secs 2024-04-27T00:43:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22402.686627 secs 2024-04-27T00:43:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22402.686627 secs 2024-04-27T00:43:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:26 smithi189 ceph-mon[32756]: pgmap v12798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:26 smithi156 ceph-mon[32679]: pgmap v12798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:26 smithi092 ceph-mon[29156]: pgmap v12798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:28 smithi189 ceph-mon[32756]: pgmap v12799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:28 smithi156 ceph-mon[32679]: pgmap v12799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:28 smithi092 ceph-mon[29156]: pgmap v12799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23104.717487 secs 2024-04-27T00:43:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:43:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23104.717487 secs 2024-04-27T00:43:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:43:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23104.717487 secs 2024-04-27T00:43:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:43:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:30 smithi092 ceph-mon[29156]: pgmap v12800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22407.686719 secs 2024-04-27T00:43:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:43:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:43:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:43:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:30 smithi189 ceph-mon[32756]: pgmap v12800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22407.686719 secs 2024-04-27T00:43:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:43:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:43:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:43:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:30 smithi156 ceph-mon[32679]: pgmap v12800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22407.686719 secs 2024-04-27T00:43:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:43:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:43:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:43:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:31 smithi189 ceph-mon[32756]: pgmap v12801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:43:31.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:31 smithi189 ceph-mon[32756]: pgmap v12802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:31 smithi156 ceph-mon[32679]: pgmap v12801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:43:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:31 smithi156 ceph-mon[32679]: pgmap v12802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:31 smithi092 ceph-mon[29156]: pgmap v12801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T00:43:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:31 smithi092 ceph-mon[29156]: pgmap v12802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:33 smithi189 ceph-mon[32756]: pgmap v12803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:33 smithi156 ceph-mon[32679]: pgmap v12803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:33 smithi092 ceph-mon[29156]: pgmap v12803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23109.717555 secs 2024-04-27T00:43:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23109.717555 secs 2024-04-27T00:43:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23109.717555 secs 2024-04-27T00:43:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:35 smithi189 ceph-mon[32756]: pgmap v12804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22412.686797 secs 2024-04-27T00:43:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:35 smithi156 ceph-mon[32679]: pgmap v12804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22412.686797 secs 2024-04-27T00:43:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:35 smithi092 ceph-mon[29156]: pgmap v12804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22412.686797 secs 2024-04-27T00:43:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:37 smithi189 ceph-mon[32756]: pgmap v12805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:37 smithi156 ceph-mon[32679]: pgmap v12805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:37 smithi092 ceph-mon[29156]: pgmap v12805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:43:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:39 smithi189 ceph-mon[32756]: pgmap v12806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23114.717672 secs 2024-04-27T00:43:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:39 smithi156 ceph-mon[32679]: pgmap v12806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23114.717672 secs 2024-04-27T00:43:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:39 smithi092 ceph-mon[29156]: pgmap v12806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:43:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23114.717672 secs 2024-04-27T00:43:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22417.686870 secs 2024-04-27T00:43:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22417.686870 secs 2024-04-27T00:43:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22417.686870 secs 2024-04-27T00:43:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:41 smithi189 ceph-mon[32756]: pgmap v12807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:43:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:41 smithi156 ceph-mon[32679]: pgmap v12807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:43:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:41 smithi092 ceph-mon[29156]: pgmap v12807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:43:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:43 smithi189 ceph-mon[32756]: pgmap v12808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:43 smithi156 ceph-mon[32679]: pgmap v12808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:43 smithi092 ceph-mon[29156]: pgmap v12808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23119.717785 secs 2024-04-27T00:43:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23119.717785 secs 2024-04-27T00:43:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23119.717785 secs 2024-04-27T00:43:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:45 smithi189 ceph-mon[32756]: pgmap v12809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22422.687003 secs 2024-04-27T00:43:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:45 smithi156 ceph-mon[32679]: pgmap v12809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22422.687003 secs 2024-04-27T00:43:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:45 smithi092 ceph-mon[29156]: pgmap v12809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22422.687003 secs 2024-04-27T00:43:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:47 smithi189 ceph-mon[32756]: pgmap v12810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:47 smithi156 ceph-mon[32679]: pgmap v12810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:47 smithi092 ceph-mon[29156]: pgmap v12810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:49 smithi189 ceph-mon[32756]: pgmap v12811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23124.717900 secs 2024-04-27T00:43:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:49 smithi156 ceph-mon[32679]: pgmap v12811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23124.717900 secs 2024-04-27T00:43:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:49 smithi092 ceph-mon[29156]: pgmap v12811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23124.717900 secs 2024-04-27T00:43:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22427.687111 secs 2024-04-27T00:43:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22427.687111 secs 2024-04-27T00:43:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22427.687111 secs 2024-04-27T00:43:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:51 smithi156 ceph-mon[32679]: pgmap v12812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:51 smithi092 ceph-mon[29156]: pgmap v12812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:51 smithi189 ceph-mon[32756]: pgmap v12812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:53 smithi156 ceph-mon[32679]: pgmap v12813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:53 smithi092 ceph-mon[29156]: pgmap v12813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:53 smithi189 ceph-mon[32756]: pgmap v12813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23129.718013 secs 2024-04-27T00:43:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23129.718013 secs 2024-04-27T00:43:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23129.718013 secs 2024-04-27T00:43:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:55 smithi156 ceph-mon[32679]: pgmap v12814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22432.687217 secs 2024-04-27T00:43:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:55 smithi092 ceph-mon[29156]: pgmap v12814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22432.687217 secs 2024-04-27T00:43:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:55 smithi189 ceph-mon[32756]: pgmap v12814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22432.687217 secs 2024-04-27T00:43:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:57 smithi156 ceph-mon[32679]: pgmap v12815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:57 smithi092 ceph-mon[29156]: pgmap v12815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:57 smithi189 ceph-mon[32756]: pgmap v12815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:43:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:59 smithi156 ceph-mon[32679]: pgmap v12816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:43:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23134.718077 secs 2024-04-27T00:43:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:59 smithi092 ceph-mon[29156]: pgmap v12816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:43:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23134.718077 secs 2024-04-27T00:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:59 smithi189 ceph-mon[32756]: pgmap v12816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:43:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:43:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23134.718077 secs 2024-04-27T00:44:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22437.687339 secs 2024-04-27T00:44:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22437.687339 secs 2024-04-27T00:44:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22437.687339 secs 2024-04-27T00:44:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:01 smithi156 ceph-mon[32679]: pgmap v12817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:01 smithi092 ceph-mon[29156]: pgmap v12817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:01 smithi189 ceph-mon[32756]: pgmap v12817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:03 smithi156 ceph-mon[32679]: pgmap v12818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:03 smithi092 ceph-mon[29156]: pgmap v12818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:03 smithi189 ceph-mon[32756]: pgmap v12818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23139.718163 secs 2024-04-27T00:44:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23139.718163 secs 2024-04-27T00:44:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23139.718163 secs 2024-04-27T00:44:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:05 smithi092 ceph-mon[29156]: pgmap v12819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22442.687474 secs 2024-04-27T00:44:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:05 smithi189 ceph-mon[32756]: pgmap v12819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22442.687474 secs 2024-04-27T00:44:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:05 smithi156 ceph-mon[32679]: pgmap v12819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22442.687474 secs 2024-04-27T00:44:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:07 smithi092 ceph-mon[29156]: pgmap v12820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:07 smithi189 ceph-mon[32756]: pgmap v12820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:07 smithi156 ceph-mon[32679]: pgmap v12820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:09 smithi092 ceph-mon[29156]: pgmap v12821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23144.718285 secs 2024-04-27T00:44:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:09 smithi189 ceph-mon[32756]: pgmap v12821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23144.718285 secs 2024-04-27T00:44:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:09 smithi156 ceph-mon[32679]: pgmap v12821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23144.718285 secs 2024-04-27T00:44:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22447.687546 secs 2024-04-27T00:44:10.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22447.687546 secs 2024-04-27T00:44:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22447.687546 secs 2024-04-27T00:44:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:11 smithi092 ceph-mon[29156]: pgmap v12822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:11 smithi189 ceph-mon[32756]: pgmap v12822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:11 smithi156 ceph-mon[32679]: pgmap v12822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:13 smithi092 ceph-mon[29156]: pgmap v12823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:13 smithi189 ceph-mon[32756]: pgmap v12823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:13 smithi156 ceph-mon[32679]: pgmap v12823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:14 smithi092 ceph-mon[29156]: pgmap v12824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23149.718401 secs 2024-04-27T00:44:14.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:14 smithi156 ceph-mon[32679]: pgmap v12824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:14.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23149.718401 secs 2024-04-27T00:44:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:14 smithi189 ceph-mon[32756]: pgmap v12824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23149.718401 secs 2024-04-27T00:44:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22452.687667 secs 2024-04-27T00:44:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22452.687667 secs 2024-04-27T00:44:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22452.687667 secs 2024-04-27T00:44:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:16 smithi092 ceph-mon[29156]: pgmap v12825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:16 smithi189 ceph-mon[32756]: pgmap v12825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:16 smithi156 ceph-mon[32679]: pgmap v12825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:18 smithi156 ceph-mon[32679]: pgmap v12826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:18 smithi092 ceph-mon[29156]: pgmap v12826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:18 smithi189 ceph-mon[32756]: pgmap v12826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23154.718519 secs 2024-04-27T00:44:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23154.718519 secs 2024-04-27T00:44:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23154.718519 secs 2024-04-27T00:44:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22457.687804 secs 2024-04-27T00:44:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:20 smithi156 ceph-mon[32679]: pgmap v12827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22457.687804 secs 2024-04-27T00:44:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:20 smithi092 ceph-mon[29156]: pgmap v12827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22457.687804 secs 2024-04-27T00:44:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:20 smithi189 ceph-mon[32756]: pgmap v12827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:22 smithi156 ceph-mon[32679]: pgmap v12828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:22 smithi092 ceph-mon[29156]: pgmap v12828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:22.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:22 smithi189 ceph-mon[32756]: pgmap v12828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:24 smithi156 ceph-mon[32679]: pgmap v12829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23159.718652 secs 2024-04-27T00:44:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:24 smithi092 ceph-mon[29156]: pgmap v12829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23159.718652 secs 2024-04-27T00:44:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:24 smithi189 ceph-mon[32756]: pgmap v12829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23159.718652 secs 2024-04-27T00:44:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22462.687932 secs 2024-04-27T00:44:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22462.687932 secs 2024-04-27T00:44:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22462.687932 secs 2024-04-27T00:44:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:26 smithi156 ceph-mon[32679]: pgmap v12830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:26 smithi092 ceph-mon[29156]: pgmap v12830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:26.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:26 smithi189 ceph-mon[32756]: pgmap v12830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:28 smithi092 ceph-mon[29156]: pgmap v12831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:28.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:28 smithi189 ceph-mon[32756]: pgmap v12831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:28 smithi156 ceph-mon[32679]: pgmap v12831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23164.718782 secs 2024-04-27T00:44:29.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23164.718782 secs 2024-04-27T00:44:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23164.718782 secs 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22467.688050 secs 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: pgmap v12832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: pgmap v12833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: pgmap v12834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:44:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22467.688050 secs 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: pgmap v12832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: pgmap v12833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: pgmap v12834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:30.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22467.688050 secs 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: pgmap v12832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:44:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: pgmap v12833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:44:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: pgmap v12834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:44:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:33 smithi156 ceph-mon[32679]: pgmap v12835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:33 smithi092 ceph-mon[29156]: pgmap v12835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:33 smithi189 ceph-mon[32756]: pgmap v12835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23169.718900 secs 2024-04-27T00:44:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23169.718900 secs 2024-04-27T00:44:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23169.718900 secs 2024-04-27T00:44:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22472.688171 secs 2024-04-27T00:44:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:35 smithi092 ceph-mon[29156]: pgmap v12836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22472.688171 secs 2024-04-27T00:44:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:35 smithi189 ceph-mon[32756]: pgmap v12836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22472.688171 secs 2024-04-27T00:44:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:35 smithi156 ceph-mon[32679]: pgmap v12836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:37 smithi092 ceph-mon[29156]: pgmap v12837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:37 smithi189 ceph-mon[32756]: pgmap v12837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:37 smithi156 ceph-mon[32679]: pgmap v12837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:44:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:39 smithi092 ceph-mon[29156]: pgmap v12838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:44:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23174.719023 secs 2024-04-27T00:44:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:39 smithi189 ceph-mon[32756]: pgmap v12838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:44:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23174.719023 secs 2024-04-27T00:44:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:39 smithi156 ceph-mon[32679]: pgmap v12838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:44:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23174.719023 secs 2024-04-27T00:44:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22477.688280 secs 2024-04-27T00:44:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22477.688280 secs 2024-04-27T00:44:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22477.688280 secs 2024-04-27T00:44:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:41 smithi092 ceph-mon[29156]: pgmap v12839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:44:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:41 smithi189 ceph-mon[32756]: pgmap v12839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:44:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:41 smithi156 ceph-mon[32679]: pgmap v12839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:44:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:43 smithi092 ceph-mon[29156]: pgmap v12840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:43 smithi189 ceph-mon[32756]: pgmap v12840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:43 smithi156 ceph-mon[32679]: pgmap v12840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23179.719147 secs 2024-04-27T00:44:44.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23179.719147 secs 2024-04-27T00:44:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23179.719147 secs 2024-04-27T00:44:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22482.688380 secs 2024-04-27T00:44:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:45 smithi092 ceph-mon[29156]: pgmap v12841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22482.688380 secs 2024-04-27T00:44:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:45 smithi189 ceph-mon[32756]: pgmap v12841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22482.688380 secs 2024-04-27T00:44:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:45 smithi156 ceph-mon[32679]: pgmap v12841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:46 smithi092 ceph-mon[29156]: pgmap v12842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:46 smithi189 ceph-mon[32756]: pgmap v12842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:46 smithi156 ceph-mon[32679]: pgmap v12842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:49 smithi092 ceph-mon[29156]: pgmap v12843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23184.719261 secs 2024-04-27T00:44:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:49 smithi189 ceph-mon[32756]: pgmap v12843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23184.719261 secs 2024-04-27T00:44:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:49 smithi156 ceph-mon[32679]: pgmap v12843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23184.719261 secs 2024-04-27T00:44:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22487.688502 secs 2024-04-27T00:44:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22487.688502 secs 2024-04-27T00:44:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22487.688502 secs 2024-04-27T00:44:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:51 smithi092 ceph-mon[29156]: pgmap v12844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:51 smithi189 ceph-mon[32756]: pgmap v12844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:51 smithi156 ceph-mon[32679]: pgmap v12844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:53 smithi092 ceph-mon[29156]: pgmap v12845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:53 smithi189 ceph-mon[32756]: pgmap v12845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:53 smithi156 ceph-mon[32679]: pgmap v12845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23189.719381 secs 2024-04-27T00:44:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23189.719381 secs 2024-04-27T00:44:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23189.719381 secs 2024-04-27T00:44:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22492.688636 secs 2024-04-27T00:44:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:55 smithi092 ceph-mon[29156]: pgmap v12846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22492.688636 secs 2024-04-27T00:44:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:55 smithi189 ceph-mon[32756]: pgmap v12846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22492.688636 secs 2024-04-27T00:44:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:55 smithi156 ceph-mon[32679]: pgmap v12846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:44:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:57 smithi092 ceph-mon[29156]: pgmap v12847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:57 smithi189 ceph-mon[32756]: pgmap v12847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:57 smithi156 ceph-mon[32679]: pgmap v12847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:58 smithi189 ceph-mon[32756]: pgmap v12848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:58 smithi156 ceph-mon[32679]: pgmap v12848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:58 smithi092 ceph-mon[29156]: pgmap v12848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:44:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:44:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23194.719502 secs 2024-04-27T00:44:59.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:44:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23194.719502 secs 2024-04-27T00:44:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:44:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23194.719502 secs 2024-04-27T00:45:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22497.688730 secs 2024-04-27T00:45:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:00 smithi189 ceph-mon[32756]: pgmap v12849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22497.688730 secs 2024-04-27T00:45:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:00 smithi156 ceph-mon[32679]: pgmap v12849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22497.688730 secs 2024-04-27T00:45:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:00 smithi092 ceph-mon[29156]: pgmap v12849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:03 smithi092 ceph-mon[29156]: pgmap v12850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:03 smithi189 ceph-mon[32756]: pgmap v12850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:03 smithi156 ceph-mon[32679]: pgmap v12850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23199.719620 secs 2024-04-27T00:45:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23199.719620 secs 2024-04-27T00:45:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23199.719620 secs 2024-04-27T00:45:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22502.688817 secs 2024-04-27T00:45:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:05 smithi092 ceph-mon[29156]: pgmap v12851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22502.688817 secs 2024-04-27T00:45:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:05 smithi189 ceph-mon[32756]: pgmap v12851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22502.688817 secs 2024-04-27T00:45:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:05 smithi156 ceph-mon[32679]: pgmap v12851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:07.200 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:45:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:45:06.905+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:45:07.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:45:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:45:06.905+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:45:07.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:45:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:45:06.905+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:45:07.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:45:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:45:06.905+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:45:07.201 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:45:06 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:45:06.905+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:45:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:07 smithi092 ceph-mon[29156]: pgmap v12852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:07 smithi189 ceph-mon[32756]: pgmap v12852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:07 smithi156 ceph-mon[32679]: pgmap v12852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:09 smithi092 ceph-mon[29156]: pgmap v12853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23204.719739 secs 2024-04-27T00:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:09 smithi189 ceph-mon[32756]: pgmap v12853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23204.719739 secs 2024-04-27T00:45:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:09 smithi156 ceph-mon[32679]: pgmap v12853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23204.719739 secs 2024-04-27T00:45:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22507.688948 secs 2024-04-27T00:45:10.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22507.688948 secs 2024-04-27T00:45:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22507.688948 secs 2024-04-27T00:45:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:11 smithi092 ceph-mon[29156]: pgmap v12854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:11 smithi189 ceph-mon[32756]: pgmap v12854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:11 smithi156 ceph-mon[32679]: pgmap v12854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:12 smithi092 ceph-mon[29156]: pgmap v12855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:12 smithi189 ceph-mon[32756]: pgmap v12855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:12 smithi156 ceph-mon[32679]: pgmap v12855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:13 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23209.719858 secs 2024-04-27T00:45:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:13 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23209.719858 secs 2024-04-27T00:45:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:13 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23209.719858 secs 2024-04-27T00:45:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22512.689088 secs 2024-04-27T00:45:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:14 smithi189 ceph-mon[32756]: pgmap v12856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22512.689088 secs 2024-04-27T00:45:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:14 smithi156 ceph-mon[32679]: pgmap v12856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22512.689088 secs 2024-04-27T00:45:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:14 smithi092 ceph-mon[29156]: pgmap v12856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:17 smithi092 ceph-mon[29156]: pgmap v12857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:17 smithi189 ceph-mon[32756]: pgmap v12857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:17 smithi156 ceph-mon[32679]: pgmap v12857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:19 smithi092 ceph-mon[29156]: pgmap v12858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:19.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23214.719985 secs 2024-04-27T00:45:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:19 smithi189 ceph-mon[32756]: pgmap v12858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23214.719985 secs 2024-04-27T00:45:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:19 smithi156 ceph-mon[32679]: pgmap v12858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:45:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23214.719985 secs 2024-04-27T00:45:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22517.689170 secs 2024-04-27T00:45:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22517.689170 secs 2024-04-27T00:45:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22517.689170 secs 2024-04-27T00:45:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:21 smithi092 ceph-mon[29156]: pgmap v12859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:21 smithi189 ceph-mon[32756]: pgmap v12859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:21 smithi156 ceph-mon[32679]: pgmap v12859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:45:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:23 smithi092 ceph-mon[29156]: pgmap v12860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:23 smithi189 ceph-mon[32756]: pgmap v12860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:23 smithi156 ceph-mon[32679]: pgmap v12860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23219.720123 secs 2024-04-27T00:45:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23219.720123 secs 2024-04-27T00:45:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23219.720123 secs 2024-04-27T00:45:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22522.689286 secs 2024-04-27T00:45:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:25 smithi092 ceph-mon[29156]: pgmap v12861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22522.689286 secs 2024-04-27T00:45:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:25 smithi189 ceph-mon[32756]: pgmap v12861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22522.689286 secs 2024-04-27T00:45:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:25 smithi156 ceph-mon[32679]: pgmap v12861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:26 smithi092 ceph-mon[29156]: pgmap v12862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:26 smithi189 ceph-mon[32756]: pgmap v12862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:26 smithi156 ceph-mon[32679]: pgmap v12862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:29 smithi092 ceph-mon[29156]: pgmap v12863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23224.720215 secs 2024-04-27T00:45:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:29 smithi189 ceph-mon[32756]: pgmap v12863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23224.720215 secs 2024-04-27T00:45:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:29 smithi156 ceph-mon[32679]: pgmap v12863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23224.720215 secs 2024-04-27T00:45:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22527.689421 secs 2024-04-27T00:45:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22527.689421 secs 2024-04-27T00:45:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22527.689421 secs 2024-04-27T00:45:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:31 smithi092 ceph-mon[29156]: pgmap v12864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:45:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:45:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:45:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:45:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:31 smithi189 ceph-mon[32756]: pgmap v12864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:45:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:45:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:45:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:45:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:31 smithi156 ceph-mon[32679]: pgmap v12864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:45:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:45:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:45:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:45:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:32 smithi092 ceph-mon[29156]: pgmap v12865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:45:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:32 smithi092 ceph-mon[29156]: pgmap v12866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:32 smithi189 ceph-mon[32756]: pgmap v12865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:45:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:32 smithi189 ceph-mon[32756]: pgmap v12866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:32 smithi156 ceph-mon[32679]: pgmap v12865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:45:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:32 smithi156 ceph-mon[32679]: pgmap v12866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:34 smithi092 ceph-mon[29156]: pgmap v12867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:45:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23229.720341 secs 2024-04-27T00:45:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:34 smithi189 ceph-mon[32756]: pgmap v12867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:45:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23229.720341 secs 2024-04-27T00:45:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:34 smithi156 ceph-mon[32679]: pgmap v12867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:45:34.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23229.720341 secs 2024-04-27T00:45:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22532.689538 secs 2024-04-27T00:45:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22532.689538 secs 2024-04-27T00:45:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22532.689538 secs 2024-04-27T00:45:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:36 smithi092 ceph-mon[29156]: pgmap v12868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:36 smithi189 ceph-mon[32756]: pgmap v12868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:36 smithi156 ceph-mon[32679]: pgmap v12868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:37 smithi092 ceph-mon[29156]: pgmap v12869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:37 smithi189 ceph-mon[32756]: pgmap v12869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:37 smithi156 ceph-mon[32679]: pgmap v12869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:38 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 23234.720475 secs 2024-04-27T00:45:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:38 smithi189 ceph-mon[32756]: slow request 5763.237470 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:45:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:45:39.170+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:45:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:45:39.170+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:45:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:45:39.170+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:45:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:45:39.170+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 180 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:45:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:38 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 23234.720475 secs 2024-04-27T00:45:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:38 smithi156 ceph-mon[32679]: slow request 5763.237470 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:45:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:38 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 23234.720475 secs 2024-04-27T00:45:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:38 smithi092 ceph-mon[29156]: slow request 5763.237470 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:45:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22537.689654 secs 2024-04-27T00:45:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:39 smithi189 ceph-mon[32756]: pgmap v12870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22537.689654 secs 2024-04-27T00:45:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:39 smithi156 ceph-mon[32679]: pgmap v12870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22537.689654 secs 2024-04-27T00:45:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:39 smithi092 ceph-mon[29156]: pgmap v12870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:45:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:41 smithi092 ceph-mon[29156]: pgmap v12871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:45:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:41 smithi189 ceph-mon[32756]: pgmap v12871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:45:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:41 smithi156 ceph-mon[32679]: pgmap v12871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:45:44.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:43 smithi156 ceph-mon[32679]: pgmap v12872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:44.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23239.720570 secs 2024-04-27T00:45:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:43 smithi092 ceph-mon[29156]: pgmap v12872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23239.720570 secs 2024-04-27T00:45:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:43 smithi189 ceph-mon[32756]: pgmap v12872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23239.720570 secs 2024-04-27T00:45:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22542.689726 secs 2024-04-27T00:45:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22542.689726 secs 2024-04-27T00:45:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22542.689726 secs 2024-04-27T00:45:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:45 smithi092 ceph-mon[29156]: pgmap v12873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:45 smithi189 ceph-mon[32756]: pgmap v12873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:45 smithi156 ceph-mon[32679]: pgmap v12873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:47 smithi092 ceph-mon[29156]: pgmap v12874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:47 smithi189 ceph-mon[32756]: pgmap v12874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:47 smithi156 ceph-mon[32679]: pgmap v12874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23244.720709 secs 2024-04-27T00:45:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23244.720709 secs 2024-04-27T00:45:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23244.720709 secs 2024-04-27T00:45:50.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22547.689859 secs 2024-04-27T00:45:50.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:49 smithi092 ceph-mon[29156]: pgmap v12875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22547.689859 secs 2024-04-27T00:45:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:49 smithi189 ceph-mon[32756]: pgmap v12875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22547.689859 secs 2024-04-27T00:45:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:49 smithi156 ceph-mon[32679]: pgmap v12875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:51 smithi189 ceph-mon[32756]: pgmap v12876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:51 smithi156 ceph-mon[32679]: pgmap v12876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:51 smithi092 ceph-mon[29156]: pgmap v12876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:53 smithi189 ceph-mon[32756]: pgmap v12877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23249.720834 secs 2024-04-27T00:45:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:53 smithi156 ceph-mon[32679]: pgmap v12877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23249.720834 secs 2024-04-27T00:45:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:53 smithi092 ceph-mon[29156]: pgmap v12877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23249.720834 secs 2024-04-27T00:45:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22552.689975 secs 2024-04-27T00:45:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22552.689975 secs 2024-04-27T00:45:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22552.689975 secs 2024-04-27T00:45:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:56 smithi189 ceph-mon[32756]: pgmap v12878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:56 smithi156 ceph-mon[32679]: pgmap v12878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:56 smithi092 ceph-mon[29156]: pgmap v12878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:45:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:58 smithi189 ceph-mon[32756]: pgmap v12879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:58 smithi156 ceph-mon[32679]: pgmap v12879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:58 smithi092 ceph-mon[29156]: pgmap v12879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:45:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:45:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23254.720926 secs 2024-04-27T00:45:59.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:45:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23254.720926 secs 2024-04-27T00:45:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:45:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23254.720926 secs 2024-04-27T00:46:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22557.690090 secs 2024-04-27T00:46:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:00 smithi189 ceph-mon[32756]: pgmap v12880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22557.690090 secs 2024-04-27T00:46:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:00 smithi156 ceph-mon[32679]: pgmap v12880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22557.690090 secs 2024-04-27T00:46:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:00 smithi092 ceph-mon[29156]: pgmap v12880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:02 smithi189 ceph-mon[32756]: pgmap v12881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:02 smithi156 ceph-mon[32679]: pgmap v12881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:02 smithi092 ceph-mon[29156]: pgmap v12881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:04 smithi189 ceph-mon[32756]: pgmap v12882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23259.721038 secs 2024-04-27T00:46:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:04 smithi156 ceph-mon[32679]: pgmap v12882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23259.721038 secs 2024-04-27T00:46:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:04 smithi092 ceph-mon[29156]: pgmap v12882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23259.721038 secs 2024-04-27T00:46:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22562.690223 secs 2024-04-27T00:46:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22562.690223 secs 2024-04-27T00:46:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22562.690223 secs 2024-04-27T00:46:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:06 smithi189 ceph-mon[32756]: pgmap v12883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:06 smithi156 ceph-mon[32679]: pgmap v12883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:06 smithi092 ceph-mon[29156]: pgmap v12883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:08 smithi189 ceph-mon[32756]: pgmap v12884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:08 smithi156 ceph-mon[32679]: pgmap v12884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:08 smithi092 ceph-mon[29156]: pgmap v12884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23264.721156 secs 2024-04-27T00:46:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23264.721156 secs 2024-04-27T00:46:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23264.721156 secs 2024-04-27T00:46:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22567.690335 secs 2024-04-27T00:46:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:10 smithi189 ceph-mon[32756]: pgmap v12885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22567.690335 secs 2024-04-27T00:46:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:10 smithi156 ceph-mon[32679]: pgmap v12885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22567.690335 secs 2024-04-27T00:46:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:10 smithi092 ceph-mon[29156]: pgmap v12885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:12 smithi189 ceph-mon[32756]: pgmap v12886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:12 smithi156 ceph-mon[32679]: pgmap v12886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:12 smithi092 ceph-mon[29156]: pgmap v12886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:14 smithi189 ceph-mon[32756]: pgmap v12887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23269.721236 secs 2024-04-27T00:46:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:14 smithi156 ceph-mon[32679]: pgmap v12887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23269.721236 secs 2024-04-27T00:46:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:14 smithi092 ceph-mon[29156]: pgmap v12887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23269.721236 secs 2024-04-27T00:46:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22572.690460 secs 2024-04-27T00:46:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22572.690460 secs 2024-04-27T00:46:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22572.690460 secs 2024-04-27T00:46:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:16 smithi189 ceph-mon[32756]: pgmap v12888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:16 smithi156 ceph-mon[32679]: pgmap v12888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:16 smithi092 ceph-mon[29156]: pgmap v12888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:18 smithi189 ceph-mon[32756]: pgmap v12889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:18 smithi156 ceph-mon[32679]: pgmap v12889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:18 smithi092 ceph-mon[29156]: pgmap v12889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23274.721306 secs 2024-04-27T00:46:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23274.721306 secs 2024-04-27T00:46:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23274.721306 secs 2024-04-27T00:46:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22577.690538 secs 2024-04-27T00:46:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:20 smithi189 ceph-mon[32756]: pgmap v12890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22577.690538 secs 2024-04-27T00:46:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:20 smithi156 ceph-mon[32679]: pgmap v12890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22577.690538 secs 2024-04-27T00:46:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:20 smithi092 ceph-mon[29156]: pgmap v12890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:22 smithi189 ceph-mon[32756]: pgmap v12891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:22 smithi156 ceph-mon[32679]: pgmap v12891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:22 smithi092 ceph-mon[29156]: pgmap v12891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:24.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:46:24.175+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:46:24.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:46:24.175+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:46:24.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:46:24.176+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:46:24.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:46:24.176+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 181 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:46:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:24 smithi189 ceph-mon[32756]: pgmap v12892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23279.721504 secs 2024-04-27T00:46:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:24 smithi156 ceph-mon[32679]: pgmap v12892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23279.721504 secs 2024-04-27T00:46:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:24 smithi092 ceph-mon[29156]: pgmap v12892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23279.721504 secs 2024-04-27T00:46:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22582.690659 secs 2024-04-27T00:46:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22582.690659 secs 2024-04-27T00:46:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22582.690659 secs 2024-04-27T00:46:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:26 smithi189 ceph-mon[32756]: pgmap v12893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:26 smithi156 ceph-mon[32679]: pgmap v12893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:26 smithi092 ceph-mon[29156]: pgmap v12893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:28 smithi189 ceph-mon[32756]: pgmap v12894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:28 smithi156 ceph-mon[32679]: pgmap v12894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:28 smithi092 ceph-mon[29156]: pgmap v12894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23284.721640 secs 2024-04-27T00:46:29.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23284.721640 secs 2024-04-27T00:46:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23284.721640 secs 2024-04-27T00:46:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22587.690734 secs 2024-04-27T00:46:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:30 smithi189 ceph-mon[32756]: pgmap v12895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22587.690734 secs 2024-04-27T00:46:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:30 smithi156 ceph-mon[32679]: pgmap v12895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22587.690734 secs 2024-04-27T00:46:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:30 smithi092 ceph-mon[29156]: pgmap v12895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:46:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:46:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:46:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:32 smithi189 ceph-mon[32756]: pgmap v12896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:46:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:46:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:46:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:32 smithi156 ceph-mon[32679]: pgmap v12896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:46:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:46:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:46:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:32 smithi092 ceph-mon[29156]: pgmap v12896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:46:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:46:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:46:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:33 smithi189 ceph-mon[32756]: pgmap v12897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:46:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:33 smithi189 ceph-mon[32756]: pgmap v12898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:33 smithi156 ceph-mon[32679]: pgmap v12897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:46:33.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:33 smithi156 ceph-mon[32679]: pgmap v12898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:33 smithi092 ceph-mon[29156]: pgmap v12897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:46:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:33 smithi092 ceph-mon[29156]: pgmap v12898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23289.721755 secs 2024-04-27T00:46:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23289.721755 secs 2024-04-27T00:46:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23289.721755 secs 2024-04-27T00:46:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:35 smithi189 ceph-mon[32756]: pgmap v12899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22592.690797 secs 2024-04-27T00:46:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:35 smithi156 ceph-mon[32679]: pgmap v12899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22592.690797 secs 2024-04-27T00:46:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:35 smithi092 ceph-mon[29156]: pgmap v12899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22592.690797 secs 2024-04-27T00:46:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:37 smithi092 ceph-mon[29156]: pgmap v12900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:37 smithi189 ceph-mon[32756]: pgmap v12900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:37 smithi156 ceph-mon[32679]: pgmap v12900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:39 smithi189 ceph-mon[32756]: pgmap v12901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:46:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23294.721880 secs 2024-04-27T00:46:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:39 smithi156 ceph-mon[32679]: pgmap v12901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:46:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23294.721880 secs 2024-04-27T00:46:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:39 smithi092 ceph-mon[29156]: pgmap v12901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:46:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23294.721880 secs 2024-04-27T00:46:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:40 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 22597.690912 secs 2024-04-27T00:46:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:40 smithi189 ceph-mon[32756]: slow request 722.083073 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:46:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:40 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 22597.690912 secs 2024-04-27T00:46:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:40 smithi156 ceph-mon[32679]: slow request 722.083073 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:46:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:40 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 22597.690912 secs 2024-04-27T00:46:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:40 smithi092 ceph-mon[29156]: slow request 722.083073 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:46:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:41 smithi189 ceph-mon[32756]: pgmap v12902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:41 smithi156 ceph-mon[32679]: pgmap v12902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:41 smithi092 ceph-mon[29156]: pgmap v12902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:46:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:43 smithi189 ceph-mon[32756]: pgmap v12903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:46:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:43 smithi156 ceph-mon[32679]: pgmap v12903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:46:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:43 smithi092 ceph-mon[29156]: pgmap v12903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:46:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23299.722013 secs 2024-04-27T00:46:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23299.722013 secs 2024-04-27T00:46:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23299.722013 secs 2024-04-27T00:46:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:45 smithi189 ceph-mon[32756]: pgmap v12904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22602.691035 secs 2024-04-27T00:46:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:45 smithi156 ceph-mon[32679]: pgmap v12904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22602.691035 secs 2024-04-27T00:46:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:45 smithi092 ceph-mon[29156]: pgmap v12904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22602.691035 secs 2024-04-27T00:46:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:47 smithi189 ceph-mon[32756]: pgmap v12905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:47 smithi156 ceph-mon[32679]: pgmap v12905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:47 smithi092 ceph-mon[29156]: pgmap v12905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:49 smithi156 ceph-mon[32679]: pgmap v12906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23304.722134 secs 2024-04-27T00:46:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:49 smithi092 ceph-mon[29156]: pgmap v12906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23304.722134 secs 2024-04-27T00:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:49 smithi189 ceph-mon[32756]: pgmap v12906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23304.722134 secs 2024-04-27T00:46:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22607.691174 secs 2024-04-27T00:46:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22607.691174 secs 2024-04-27T00:46:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22607.691174 secs 2024-04-27T00:46:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:51 smithi156 ceph-mon[32679]: pgmap v12907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:51 smithi092 ceph-mon[29156]: pgmap v12907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:51.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:51 smithi189 ceph-mon[32756]: pgmap v12907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:53 smithi156 ceph-mon[32679]: pgmap v12908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:53 smithi092 ceph-mon[29156]: pgmap v12908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:53 smithi189 ceph-mon[32756]: pgmap v12908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23309.722259 secs 2024-04-27T00:46:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23309.722259 secs 2024-04-27T00:46:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23309.722259 secs 2024-04-27T00:46:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:55 smithi156 ceph-mon[32679]: pgmap v12909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22612.691315 secs 2024-04-27T00:46:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:55 smithi092 ceph-mon[29156]: pgmap v12909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22612.691315 secs 2024-04-27T00:46:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:55 smithi189 ceph-mon[32756]: pgmap v12909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:46:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22612.691315 secs 2024-04-27T00:46:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:57 smithi156 ceph-mon[32679]: pgmap v12910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:57 smithi092 ceph-mon[29156]: pgmap v12910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:57 smithi189 ceph-mon[32756]: pgmap v12910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:59 smithi156 ceph-mon[32679]: pgmap v12911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:46:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23314.722398 secs 2024-04-27T00:46:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:59 smithi092 ceph-mon[29156]: pgmap v12911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:46:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23314.722398 secs 2024-04-27T00:46:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:59 smithi189 ceph-mon[32756]: pgmap v12911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:46:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:46:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23314.722398 secs 2024-04-27T00:47:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22617.691435 secs 2024-04-27T00:47:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22617.691435 secs 2024-04-27T00:47:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22617.691435 secs 2024-04-27T00:47:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:01 smithi156 ceph-mon[32679]: pgmap v12912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:01 smithi092 ceph-mon[29156]: pgmap v12912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:01 smithi189 ceph-mon[32756]: pgmap v12912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:03 smithi156 ceph-mon[32679]: pgmap v12913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:03 smithi092 ceph-mon[29156]: pgmap v12913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:03 smithi189 ceph-mon[32756]: pgmap v12913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23319.722544 secs 2024-04-27T00:47:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23319.722544 secs 2024-04-27T00:47:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23319.722544 secs 2024-04-27T00:47:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:05 smithi092 ceph-mon[29156]: pgmap v12914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22622.691506 secs 2024-04-27T00:47:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:05 smithi189 ceph-mon[32756]: pgmap v12914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22622.691506 secs 2024-04-27T00:47:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:05 smithi156 ceph-mon[32679]: pgmap v12914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22622.691506 secs 2024-04-27T00:47:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:07 smithi092 ceph-mon[29156]: pgmap v12915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:07 smithi189 ceph-mon[32756]: pgmap v12915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:07 smithi156 ceph-mon[32679]: pgmap v12915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:09 smithi092 ceph-mon[29156]: pgmap v12916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23324.722664 secs 2024-04-27T00:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:09 smithi189 ceph-mon[32756]: pgmap v12916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23324.722664 secs 2024-04-27T00:47:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:09 smithi156 ceph-mon[32679]: pgmap v12916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23324.722664 secs 2024-04-27T00:47:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22627.691621 secs 2024-04-27T00:47:10.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22627.691621 secs 2024-04-27T00:47:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22627.691621 secs 2024-04-27T00:47:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:11 smithi092 ceph-mon[29156]: pgmap v12917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:11 smithi189 ceph-mon[32756]: pgmap v12917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:11 smithi156 ceph-mon[32679]: pgmap v12917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:13 smithi092 ceph-mon[29156]: pgmap v12918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:13 smithi189 ceph-mon[32756]: pgmap v12918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:13 smithi156 ceph-mon[32679]: pgmap v12918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23329.722788 secs 2024-04-27T00:47:14.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23329.722788 secs 2024-04-27T00:47:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23329.722788 secs 2024-04-27T00:47:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:15 smithi092 ceph-mon[29156]: pgmap v12919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22632.691697 secs 2024-04-27T00:47:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:15 smithi189 ceph-mon[32756]: pgmap v12919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22632.691697 secs 2024-04-27T00:47:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:15 smithi156 ceph-mon[32679]: pgmap v12919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22632.691697 secs 2024-04-27T00:47:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:17 smithi092 ceph-mon[29156]: pgmap v12920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:17 smithi189 ceph-mon[32756]: pgmap v12920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:17 smithi156 ceph-mon[32679]: pgmap v12920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:19 smithi092 ceph-mon[29156]: pgmap v12921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23334.722939 secs 2024-04-27T00:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:19 smithi189 ceph-mon[32756]: pgmap v12921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23334.722939 secs 2024-04-27T00:47:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:19 smithi156 ceph-mon[32679]: pgmap v12921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:19.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23334.722939 secs 2024-04-27T00:47:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22637.691814 secs 2024-04-27T00:47:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22637.691814 secs 2024-04-27T00:47:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22637.691814 secs 2024-04-27T00:47:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:21 smithi092 ceph-mon[29156]: pgmap v12922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:21 smithi189 ceph-mon[32756]: pgmap v12922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:21 smithi156 ceph-mon[32679]: pgmap v12922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:23 smithi092 ceph-mon[29156]: pgmap v12923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:23 smithi189 ceph-mon[32756]: pgmap v12923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:23 smithi156 ceph-mon[32679]: pgmap v12923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23339.723073 secs 2024-04-27T00:47:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:24 smithi092 ceph-mon[29156]: pgmap v12924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23339.723073 secs 2024-04-27T00:47:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:24 smithi189 ceph-mon[32756]: pgmap v12924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23339.723073 secs 2024-04-27T00:47:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:24 smithi156 ceph-mon[32679]: pgmap v12924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22642.691934 secs 2024-04-27T00:47:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22642.691934 secs 2024-04-27T00:47:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22642.691934 secs 2024-04-27T00:47:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:26 smithi189 ceph-mon[32756]: pgmap v12925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:26 smithi156 ceph-mon[32679]: pgmap v12925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:26 smithi092 ceph-mon[29156]: pgmap v12925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:28 smithi189 ceph-mon[32756]: pgmap v12926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23344.723185 secs 2024-04-27T00:47:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:28 smithi156 ceph-mon[32679]: pgmap v12926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23344.723185 secs 2024-04-27T00:47:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:28 smithi092 ceph-mon[29156]: pgmap v12926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23344.723185 secs 2024-04-27T00:47:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22647.692051 secs 2024-04-27T00:47:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22647.692051 secs 2024-04-27T00:47:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22647.692051 secs 2024-04-27T00:47:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:30 smithi189 ceph-mon[32756]: pgmap v12927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:30 smithi156 ceph-mon[32679]: pgmap v12927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:30 smithi092 ceph-mon[29156]: pgmap v12927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:32 smithi189 ceph-mon[32756]: pgmap v12928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:47:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:47:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:47:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:47:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:32 smithi156 ceph-mon[32679]: pgmap v12928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:47:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:47:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:47:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:47:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:32 smithi092 ceph-mon[29156]: pgmap v12928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:47:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:47:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:47:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:47:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:33 smithi189 ceph-mon[32756]: pgmap v12929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:47:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:33 smithi189 ceph-mon[32756]: pgmap v12930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:33 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23349.723312 secs 2024-04-27T00:47:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:33 smithi156 ceph-mon[32679]: pgmap v12929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:47:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:33 smithi156 ceph-mon[32679]: pgmap v12930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:33 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23349.723312 secs 2024-04-27T00:47:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:33 smithi092 ceph-mon[29156]: pgmap v12929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:47:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:33 smithi092 ceph-mon[29156]: pgmap v12930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:33 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23349.723312 secs 2024-04-27T00:47:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22652.692203 secs 2024-04-27T00:47:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22652.692203 secs 2024-04-27T00:47:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22652.692203 secs 2024-04-27T00:47:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:35 smithi189 ceph-mon[32756]: pgmap v12931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:35 smithi156 ceph-mon[32679]: pgmap v12931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:35 smithi092 ceph-mon[29156]: pgmap v12931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:37 smithi189 ceph-mon[32756]: pgmap v12932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:37 smithi156 ceph-mon[32679]: pgmap v12932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:37 smithi092 ceph-mon[29156]: pgmap v12932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23354.723440 secs 2024-04-27T00:47:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23354.723440 secs 2024-04-27T00:47:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23354.723440 secs 2024-04-27T00:47:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:39 smithi189 ceph-mon[32756]: pgmap v12933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22657.692327 secs 2024-04-27T00:47:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:39 smithi156 ceph-mon[32679]: pgmap v12933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22657.692327 secs 2024-04-27T00:47:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:39 smithi092 ceph-mon[29156]: pgmap v12933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:47:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22657.692327 secs 2024-04-27T00:47:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:41 smithi189 ceph-mon[32756]: pgmap v12934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:41 smithi156 ceph-mon[32679]: pgmap v12934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:41 smithi092 ceph-mon[29156]: pgmap v12934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:47:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:43 smithi189 ceph-mon[32756]: pgmap v12935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:47:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23359.723559 secs 2024-04-27T00:47:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:43 smithi156 ceph-mon[32679]: pgmap v12935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:47:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23359.723559 secs 2024-04-27T00:47:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:43 smithi092 ceph-mon[29156]: pgmap v12935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:47:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23359.723559 secs 2024-04-27T00:47:45.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22662.692446 secs 2024-04-27T00:47:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22662.692446 secs 2024-04-27T00:47:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22662.692446 secs 2024-04-27T00:47:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:45 smithi189 ceph-mon[32756]: pgmap v12936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:45 smithi156 ceph-mon[32679]: pgmap v12936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:45 smithi092 ceph-mon[29156]: pgmap v12936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:47 smithi189 ceph-mon[32756]: pgmap v12937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:47 smithi156 ceph-mon[32679]: pgmap v12937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:47 smithi092 ceph-mon[29156]: pgmap v12937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23364.723670 secs 2024-04-27T00:47:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23364.723670 secs 2024-04-27T00:47:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23364.723670 secs 2024-04-27T00:47:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:49 smithi189 ceph-mon[32756]: pgmap v12938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22667.692570 secs 2024-04-27T00:47:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:49 smithi156 ceph-mon[32679]: pgmap v12938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22667.692570 secs 2024-04-27T00:47:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:49 smithi092 ceph-mon[29156]: pgmap v12938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22667.692570 secs 2024-04-27T00:47:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:51 smithi189 ceph-mon[32756]: pgmap v12939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:51 smithi156 ceph-mon[32679]: pgmap v12939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:51 smithi092 ceph-mon[29156]: pgmap v12939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:53 smithi189 ceph-mon[32756]: pgmap v12940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23369.723788 secs 2024-04-27T00:47:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:53 smithi156 ceph-mon[32679]: pgmap v12940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23369.723788 secs 2024-04-27T00:47:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:53 smithi092 ceph-mon[29156]: pgmap v12940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23369.723788 secs 2024-04-27T00:47:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22672.692636 secs 2024-04-27T00:47:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22672.692636 secs 2024-04-27T00:47:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22672.692636 secs 2024-04-27T00:47:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:55 smithi092 ceph-mon[29156]: pgmap v12941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:55 smithi189 ceph-mon[32756]: pgmap v12941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:55 smithi156 ceph-mon[32679]: pgmap v12941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:47:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:57 smithi189 ceph-mon[32756]: pgmap v12942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:57 smithi156 ceph-mon[32679]: pgmap v12942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:57 smithi092 ceph-mon[29156]: pgmap v12942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:47:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:58 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23374.723915 secs 2024-04-27T00:47:59.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:58 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23374.723915 secs 2024-04-27T00:47:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:58 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23374.723915 secs 2024-04-27T00:48:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:59 smithi189 ceph-mon[32756]: pgmap v12943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:47:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22677.692762 secs 2024-04-27T00:48:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:59 smithi156 ceph-mon[32679]: pgmap v12943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:47:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22677.692762 secs 2024-04-27T00:48:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:59 smithi092 ceph-mon[29156]: pgmap v12943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:47:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22677.692762 secs 2024-04-27T00:48:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:01 smithi189 ceph-mon[32756]: pgmap v12944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:01 smithi156 ceph-mon[32679]: pgmap v12944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:01 smithi092 ceph-mon[29156]: pgmap v12944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:03 smithi189 ceph-mon[32756]: pgmap v12945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:03 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 23379.724069 secs 2024-04-27T00:48:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:03 smithi189 ceph-mon[32756]: slow request 2882.746146 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:48:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:03 smithi156 ceph-mon[32679]: pgmap v12945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:03 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 23379.724069 secs 2024-04-27T00:48:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:03 smithi156 ceph-mon[32679]: slow request 2882.746146 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:48:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:03 smithi092 ceph-mon[29156]: pgmap v12945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:03 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 23379.724069 secs 2024-04-27T00:48:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:03 smithi092 ceph-mon[29156]: slow request 2882.746146 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T00:48:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22682.692886 secs 2024-04-27T00:48:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22682.692886 secs 2024-04-27T00:48:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22682.692886 secs 2024-04-27T00:48:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:05 smithi189 ceph-mon[32756]: pgmap v12946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:05 smithi156 ceph-mon[32679]: pgmap v12946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:05 smithi092 ceph-mon[29156]: pgmap v12946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:07 smithi189 ceph-mon[32756]: pgmap v12947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:07 smithi156 ceph-mon[32679]: pgmap v12947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:07 smithi092 ceph-mon[29156]: pgmap v12947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:08 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23384.724161 secs 2024-04-27T00:48:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:08 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23384.724161 secs 2024-04-27T00:48:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:08 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23384.724161 secs 2024-04-27T00:48:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:09 smithi189 ceph-mon[32756]: pgmap v12948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 22687.693026 secs 2024-04-27T00:48:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:09 smithi189 ceph-mon[32756]: slow request 1442.242787 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:48:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:09 smithi156 ceph-mon[32679]: pgmap v12948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 22687.693026 secs 2024-04-27T00:48:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:09 smithi156 ceph-mon[32679]: slow request 1442.242787 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:48:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:09 smithi092 ceph-mon[29156]: pgmap v12948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 22687.693026 secs 2024-04-27T00:48:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:09 smithi092 ceph-mon[29156]: slow request 1442.242787 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:48:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:11 smithi189 ceph-mon[32756]: pgmap v12949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:11 smithi156 ceph-mon[32679]: pgmap v12949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:11 smithi092 ceph-mon[29156]: pgmap v12949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:13 smithi189 ceph-mon[32756]: pgmap v12950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:13 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23389.724243 secs 2024-04-27T00:48:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:13 smithi156 ceph-mon[32679]: pgmap v12950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:13 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23389.724243 secs 2024-04-27T00:48:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:13 smithi092 ceph-mon[29156]: pgmap v12950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:13 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23389.724243 secs 2024-04-27T00:48:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22692.693151 secs 2024-04-27T00:48:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22692.693151 secs 2024-04-27T00:48:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22692.693151 secs 2024-04-27T00:48:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:15 smithi189 ceph-mon[32756]: pgmap v12951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:15 smithi156 ceph-mon[32679]: pgmap v12951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:15 smithi092 ceph-mon[29156]: pgmap v12951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:17 smithi156 ceph-mon[32679]: pgmap v12952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:17 smithi092 ceph-mon[29156]: pgmap v12952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:17 smithi189 ceph-mon[32756]: pgmap v12952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:18 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23394.724355 secs 2024-04-27T00:48:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:18 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23394.724355 secs 2024-04-27T00:48:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:18 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23394.724355 secs 2024-04-27T00:48:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:19 smithi156 ceph-mon[32679]: pgmap v12953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22697.693222 secs 2024-04-27T00:48:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:19 smithi092 ceph-mon[29156]: pgmap v12953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22697.693222 secs 2024-04-27T00:48:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:19 smithi189 ceph-mon[32756]: pgmap v12953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22697.693222 secs 2024-04-27T00:48:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:21 smithi156 ceph-mon[32679]: pgmap v12954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:21 smithi092 ceph-mon[29156]: pgmap v12954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:21 smithi189 ceph-mon[32756]: pgmap v12954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:23 smithi156 ceph-mon[32679]: pgmap v12955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:23 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23399.724513 secs 2024-04-27T00:48:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:23 smithi092 ceph-mon[29156]: pgmap v12955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:23 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23399.724513 secs 2024-04-27T00:48:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:23 smithi189 ceph-mon[32756]: pgmap v12955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:23 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23399.724513 secs 2024-04-27T00:48:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22702.693340 secs 2024-04-27T00:48:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22702.693340 secs 2024-04-27T00:48:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22702.693340 secs 2024-04-27T00:48:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:25 smithi156 ceph-mon[32679]: pgmap v12956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:25 smithi092 ceph-mon[29156]: pgmap v12956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:25 smithi189 ceph-mon[32756]: pgmap v12956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:27 smithi156 ceph-mon[32679]: pgmap v12957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:27 smithi092 ceph-mon[29156]: pgmap v12957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:27 smithi189 ceph-mon[32756]: pgmap v12957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:28 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23404.724645 secs 2024-04-27T00:48:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:28 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23404.724645 secs 2024-04-27T00:48:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:28 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23404.724645 secs 2024-04-27T00:48:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:29 smithi156 ceph-mon[32679]: pgmap v12958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22707.693458 secs 2024-04-27T00:48:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:29 smithi092 ceph-mon[29156]: pgmap v12958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22707.693458 secs 2024-04-27T00:48:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:29 smithi189 ceph-mon[32756]: pgmap v12958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:48:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22707.693458 secs 2024-04-27T00:48:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:31 smithi156 ceph-mon[32679]: pgmap v12959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:31 smithi092 ceph-mon[29156]: pgmap v12959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:32.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:31 smithi189 ceph-mon[32756]: pgmap v12959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:48:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:48:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:48:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: pgmap v12960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23409.724714 secs 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: pgmap v12960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.389 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23409.724714 secs 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: pgmap v12960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:34.444 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23409.724714 secs 2024-04-27T00:48:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22712.693567 secs 2024-04-27T00:48:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22712.693567 secs 2024-04-27T00:48:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22712.693567 secs 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80d5000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80d5000 comp rx=0 tx=0).stop 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T00:48:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.024+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:48:36.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.025+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80d80d0 tx=0x7f1ca8082000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T00:48:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.062+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.062+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.062+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.062+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=24 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.062+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.063+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T00:48:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:36.063+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: pgmap v12961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: pgmap v12961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: pgmap v12961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:48:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: pgmap v12962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: pgmap v12963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:48:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: pgmap v12962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: pgmap v12963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:48:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:48:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: pgmap v12962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: pgmap v12963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:48:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:39.193+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:48:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:39.193+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:48:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:39.194+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:48:39.194 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:48:39.194+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 182 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:48:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:39 smithi156 ceph-mon[32679]: pgmap v12964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T00:48:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23414.724848 secs 2024-04-27T00:48:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:39 smithi092 ceph-mon[29156]: pgmap v12964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T00:48:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23414.724848 secs 2024-04-27T00:48:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:39 smithi189 ceph-mon[32756]: pgmap v12964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T00:48:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23414.724848 secs 2024-04-27T00:48:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22717.693643 secs 2024-04-27T00:48:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22717.693643 secs 2024-04-27T00:48:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22717.693643 secs 2024-04-27T00:48:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:41 smithi156 ceph-mon[32679]: pgmap v12965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:41 smithi092 ceph-mon[29156]: pgmap v12965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:41 smithi189 ceph-mon[32756]: pgmap v12965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:43 smithi156 ceph-mon[32679]: pgmap v12966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:43 smithi092 ceph-mon[29156]: pgmap v12966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:43 smithi189 ceph-mon[32756]: pgmap v12966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23419.724959 secs 2024-04-27T00:48:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23419.724959 secs 2024-04-27T00:48:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23419.724959 secs 2024-04-27T00:48:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22722.693758 secs 2024-04-27T00:48:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:45 smithi092 ceph-mon[29156]: pgmap v12967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22722.693758 secs 2024-04-27T00:48:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:45 smithi156 ceph-mon[32679]: pgmap v12967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22722.693758 secs 2024-04-27T00:48:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:45 smithi189 ceph-mon[32756]: pgmap v12967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:48:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:47 smithi092 ceph-mon[29156]: pgmap v12968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:48:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:47 smithi189 ceph-mon[32756]: pgmap v12968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:48:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:47 smithi156 ceph-mon[32679]: pgmap v12968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:48:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:49 smithi092 ceph-mon[29156]: pgmap v12969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23424.725021 secs 2024-04-27T00:48:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:49 smithi189 ceph-mon[32756]: pgmap v12969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23424.725021 secs 2024-04-27T00:48:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:49 smithi156 ceph-mon[32679]: pgmap v12969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23424.725021 secs 2024-04-27T00:48:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22727.693837 secs 2024-04-27T00:48:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22727.693837 secs 2024-04-27T00:48:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22727.693837 secs 2024-04-27T00:48:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:51 smithi092 ceph-mon[29156]: pgmap v12970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:51 smithi189 ceph-mon[32756]: pgmap v12970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:51 smithi156 ceph-mon[32679]: pgmap v12970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:53 smithi092 ceph-mon[29156]: pgmap v12971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:53 smithi189 ceph-mon[32756]: pgmap v12971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:53 smithi156 ceph-mon[32679]: pgmap v12971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23429.725138 secs 2024-04-27T00:48:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23429.725138 secs 2024-04-27T00:48:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23429.725138 secs 2024-04-27T00:48:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22732.693951 secs 2024-04-27T00:48:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:55 smithi092 ceph-mon[29156]: pgmap v12972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22732.693951 secs 2024-04-27T00:48:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:55 smithi189 ceph-mon[32756]: pgmap v12972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22732.693951 secs 2024-04-27T00:48:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:55 smithi156 ceph-mon[32679]: pgmap v12972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:48:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:57 smithi092 ceph-mon[29156]: pgmap v12973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:57 smithi189 ceph-mon[32756]: pgmap v12973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:57 smithi156 ceph-mon[32679]: pgmap v12973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:59 smithi092 ceph-mon[29156]: pgmap v12974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:48:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23434.725246 secs 2024-04-27T00:48:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:59 smithi189 ceph-mon[32756]: pgmap v12974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:48:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23434.725246 secs 2024-04-27T00:48:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:59 smithi156 ceph-mon[32679]: pgmap v12974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:48:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:48:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23434.725246 secs 2024-04-27T00:49:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22737.694090 secs 2024-04-27T00:49:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22737.694090 secs 2024-04-27T00:49:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22737.694090 secs 2024-04-27T00:49:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:01 smithi092 ceph-mon[29156]: pgmap v12975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:01 smithi189 ceph-mon[32756]: pgmap v12975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:01 smithi156 ceph-mon[32679]: pgmap v12975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:02 smithi189 ceph-mon[32756]: pgmap v12976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:02 smithi156 ceph-mon[32679]: pgmap v12976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:02 smithi092 ceph-mon[29156]: pgmap v12976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:03 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23439.725329 secs 2024-04-27T00:49:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:03 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23439.725329 secs 2024-04-27T00:49:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:03 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23439.725329 secs 2024-04-27T00:49:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22742.694229 secs 2024-04-27T00:49:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:04 smithi189 ceph-mon[32756]: pgmap v12977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22742.694229 secs 2024-04-27T00:49:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:04 smithi156 ceph-mon[32679]: pgmap v12977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22742.694229 secs 2024-04-27T00:49:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:04 smithi092 ceph-mon[29156]: pgmap v12977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:07 smithi156 ceph-mon[32679]: pgmap v12978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:07 smithi092 ceph-mon[29156]: pgmap v12978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:07 smithi189 ceph-mon[32756]: pgmap v12978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:09 smithi156 ceph-mon[32679]: pgmap v12979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23444.725445 secs 2024-04-27T00:49:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:09 smithi092 ceph-mon[29156]: pgmap v12979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23444.725445 secs 2024-04-27T00:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:09 smithi189 ceph-mon[32756]: pgmap v12979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23444.725445 secs 2024-04-27T00:49:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22747.694354 secs 2024-04-27T00:49:10.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22747.694354 secs 2024-04-27T00:49:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22747.694354 secs 2024-04-27T00:49:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:11 smithi092 ceph-mon[29156]: pgmap v12980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:11 smithi189 ceph-mon[32756]: pgmap v12980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:11 smithi156 ceph-mon[32679]: pgmap v12980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:13 smithi092 ceph-mon[29156]: pgmap v12981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:13 smithi189 ceph-mon[32756]: pgmap v12981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:13 smithi156 ceph-mon[32679]: pgmap v12981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23449.725565 secs 2024-04-27T00:49:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23449.725565 secs 2024-04-27T00:49:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23449.725565 secs 2024-04-27T00:49:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22752.694416 secs 2024-04-27T00:49:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:15 smithi092 ceph-mon[29156]: pgmap v12982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22752.694416 secs 2024-04-27T00:49:15.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:15 smithi156 ceph-mon[32679]: pgmap v12982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22752.694416 secs 2024-04-27T00:49:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:15 smithi189 ceph-mon[32756]: pgmap v12982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:17 smithi092 ceph-mon[29156]: pgmap v12983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:17 smithi189 ceph-mon[32756]: pgmap v12983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:17 smithi156 ceph-mon[32679]: pgmap v12983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:19 smithi092 ceph-mon[29156]: pgmap v12984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23454.725706 secs 2024-04-27T00:49:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:19 smithi189 ceph-mon[32756]: pgmap v12984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23454.725706 secs 2024-04-27T00:49:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:19 smithi156 ceph-mon[32679]: pgmap v12984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23454.725706 secs 2024-04-27T00:49:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22757.694517 secs 2024-04-27T00:49:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22757.694517 secs 2024-04-27T00:49:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22757.694517 secs 2024-04-27T00:49:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:21 smithi092 ceph-mon[29156]: pgmap v12985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:21 smithi189 ceph-mon[32756]: pgmap v12985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:21 smithi156 ceph-mon[32679]: pgmap v12985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:23 smithi092 ceph-mon[29156]: pgmap v12986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:23 smithi189 ceph-mon[32756]: pgmap v12986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:23 smithi156 ceph-mon[32679]: pgmap v12986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23459.725834 secs 2024-04-27T00:49:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23459.725834 secs 2024-04-27T00:49:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23459.725834 secs 2024-04-27T00:49:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22762.694654 secs 2024-04-27T00:49:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:25 smithi092 ceph-mon[29156]: pgmap v12987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22762.694654 secs 2024-04-27T00:49:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:25 smithi189 ceph-mon[32756]: pgmap v12987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22762.694654 secs 2024-04-27T00:49:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:25 smithi156 ceph-mon[32679]: pgmap v12987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:27 smithi092 ceph-mon[29156]: pgmap v12988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:27 smithi189 ceph-mon[32756]: pgmap v12988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:27 smithi156 ceph-mon[32679]: pgmap v12988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:29 smithi092 ceph-mon[29156]: pgmap v12989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23464.725953 secs 2024-04-27T00:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:29 smithi189 ceph-mon[32756]: pgmap v12989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23464.725953 secs 2024-04-27T00:49:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:29 smithi156 ceph-mon[32679]: pgmap v12989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23464.725953 secs 2024-04-27T00:49:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22767.694715 secs 2024-04-27T00:49:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22767.694715 secs 2024-04-27T00:49:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22767.694715 secs 2024-04-27T00:49:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:31 smithi092 ceph-mon[29156]: pgmap v12990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:31 smithi189 ceph-mon[32756]: pgmap v12990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:31 smithi156 ceph-mon[32679]: pgmap v12990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:33 smithi092 ceph-mon[29156]: pgmap v12991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:33 smithi189 ceph-mon[32756]: pgmap v12991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:33 smithi156 ceph-mon[32679]: pgmap v12991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23469.726077 secs 2024-04-27T00:49:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23469.726077 secs 2024-04-27T00:49:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23469.726077 secs 2024-04-27T00:49:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22772.694817 secs 2024-04-27T00:49:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:35 smithi189 ceph-mon[32756]: pgmap v12992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22772.694817 secs 2024-04-27T00:49:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:35 smithi156 ceph-mon[32679]: pgmap v12992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22772.694817 secs 2024-04-27T00:49:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:35 smithi092 ceph-mon[29156]: pgmap v12992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:49:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:36 smithi189 ceph-mon[32756]: pgmap v12993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:49:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:36 smithi156 ceph-mon[32679]: pgmap v12993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:36 smithi092 ceph-mon[29156]: pgmap v12993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:37 smithi189 ceph-mon[32756]: pgmap v12994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:37 smithi189 ceph-mon[32756]: pgmap v12995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:37 smithi156 ceph-mon[32679]: pgmap v12994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:37 smithi156 ceph-mon[32679]: pgmap v12995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:37 smithi092 ceph-mon[29156]: pgmap v12994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:37 smithi092 ceph-mon[29156]: pgmap v12995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:49:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:38 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23474.726155 secs 2024-04-27T00:49:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:38 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23474.726155 secs 2024-04-27T00:49:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:38 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23474.726155 secs 2024-04-27T00:49:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22777.694962 secs 2024-04-27T00:49:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:39 smithi189 ceph-mon[32756]: pgmap v12996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22777.694962 secs 2024-04-27T00:49:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:39 smithi156 ceph-mon[32679]: pgmap v12996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22777.694962 secs 2024-04-27T00:49:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:39 smithi092 ceph-mon[29156]: pgmap v12996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:41 smithi092 ceph-mon[29156]: pgmap v12997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:41 smithi189 ceph-mon[32756]: pgmap v12997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:41 smithi156 ceph-mon[32679]: pgmap v12997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:49:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:43 smithi092 ceph-mon[29156]: pgmap v12998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:49:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:43 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23479.726270 secs 2024-04-27T00:49:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:43 smithi189 ceph-mon[32756]: pgmap v12998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:49:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:43 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23479.726270 secs 2024-04-27T00:49:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:43 smithi156 ceph-mon[32679]: pgmap v12998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:49:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:43 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23479.726270 secs 2024-04-27T00:49:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22782.695076 secs 2024-04-27T00:49:45.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22782.695076 secs 2024-04-27T00:49:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22782.695076 secs 2024-04-27T00:49:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:45 smithi092 ceph-mon[29156]: pgmap v12999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:49:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:45 smithi189 ceph-mon[32756]: pgmap v12999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:49:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:45 smithi156 ceph-mon[32679]: pgmap v12999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T00:49:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:47 smithi092 ceph-mon[29156]: pgmap v13000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:47 smithi189 ceph-mon[32756]: pgmap v13000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:47 smithi156 ceph-mon[32679]: pgmap v13000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:49:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:48 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23484.726382 secs 2024-04-27T00:49:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:48 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23484.726382 secs 2024-04-27T00:49:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:48 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23484.726382 secs 2024-04-27T00:49:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22787.695188 secs 2024-04-27T00:49:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:49 smithi092 ceph-mon[29156]: pgmap v13001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22787.695188 secs 2024-04-27T00:49:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:49 smithi189 ceph-mon[32756]: pgmap v13001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22787.695188 secs 2024-04-27T00:49:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:49 smithi156 ceph-mon[32679]: pgmap v13001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:51 smithi092 ceph-mon[29156]: pgmap v13002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:51 smithi189 ceph-mon[32756]: pgmap v13002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:51 smithi156 ceph-mon[32679]: pgmap v13002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:53 smithi092 ceph-mon[29156]: pgmap v13003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:53 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23489.726517 secs 2024-04-27T00:49:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:53 smithi189 ceph-mon[32756]: pgmap v13003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:53 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23489.726517 secs 2024-04-27T00:49:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:53 smithi156 ceph-mon[32679]: pgmap v13003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:49:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:53 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23489.726517 secs 2024-04-27T00:49:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22792.695330 secs 2024-04-27T00:49:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22792.695330 secs 2024-04-27T00:49:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22792.695330 secs 2024-04-27T00:49:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:55 smithi189 ceph-mon[32756]: pgmap v13004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:55 smithi156 ceph-mon[32679]: pgmap v13004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:55 smithi092 ceph-mon[29156]: pgmap v13004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:49:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:57 smithi189 ceph-mon[32756]: pgmap v13005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:57 smithi156 ceph-mon[32679]: pgmap v13005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:58.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:57 smithi092 ceph-mon[29156]: pgmap v13005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:49:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:49:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23494.726579 secs 2024-04-27T00:49:59.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:49:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23494.726579 secs 2024-04-27T00:49:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:49:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23494.726579 secs 2024-04-27T00:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22797.695439 secs 2024-04-27T00:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:00 smithi189 ceph-mon[32756]: pgmap v13006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:50:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22797.695439 secs 2024-04-27T00:50:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:00 smithi156 ceph-mon[32679]: pgmap v13006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:50:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22797.695439 secs 2024-04-27T00:50:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:00 smithi092 ceph-mon[29156]: pgmap v13006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T00:50:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:02 smithi189 ceph-mon[32756]: pgmap v13007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:02 smithi156 ceph-mon[32679]: pgmap v13007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:02 smithi092 ceph-mon[29156]: pgmap v13007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:04 smithi189 ceph-mon[32756]: pgmap v13008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23499.726707 secs 2024-04-27T00:50:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:04 smithi156 ceph-mon[32679]: pgmap v13008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23499.726707 secs 2024-04-27T00:50:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:04 smithi092 ceph-mon[29156]: pgmap v13008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23499.726707 secs 2024-04-27T00:50:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22802.695572 secs 2024-04-27T00:50:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22802.695572 secs 2024-04-27T00:50:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22802.695572 secs 2024-04-27T00:50:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:06 smithi189 ceph-mon[32756]: pgmap v13009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:06 smithi156 ceph-mon[32679]: pgmap v13009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:06 smithi092 ceph-mon[29156]: pgmap v13009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:08 smithi189 ceph-mon[32756]: pgmap v13010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:08 smithi156 ceph-mon[32679]: pgmap v13010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:08 smithi092 ceph-mon[29156]: pgmap v13010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23504.726864 secs 2024-04-27T00:50:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23504.726864 secs 2024-04-27T00:50:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23504.726864 secs 2024-04-27T00:50:10.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22807.695645 secs 2024-04-27T00:50:10.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:10 smithi189 ceph-mon[32756]: pgmap v13011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22807.695645 secs 2024-04-27T00:50:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:10 smithi156 ceph-mon[32679]: pgmap v13011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22807.695645 secs 2024-04-27T00:50:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:10 smithi092 ceph-mon[29156]: pgmap v13011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:12 smithi189 ceph-mon[32756]: pgmap v13012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:12 smithi156 ceph-mon[32679]: pgmap v13012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:12 smithi092 ceph-mon[29156]: pgmap v13012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:14 smithi189 ceph-mon[32756]: pgmap v13013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23509.726929 secs 2024-04-27T00:50:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:14 smithi156 ceph-mon[32679]: pgmap v13013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23509.726929 secs 2024-04-27T00:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:14 smithi092 ceph-mon[29156]: pgmap v13013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23509.726929 secs 2024-04-27T00:50:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22812.695760 secs 2024-04-27T00:50:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22812.695760 secs 2024-04-27T00:50:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22812.695760 secs 2024-04-27T00:50:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:16 smithi189 ceph-mon[32756]: pgmap v13014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:16 smithi156 ceph-mon[32679]: pgmap v13014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:16 smithi092 ceph-mon[29156]: pgmap v13014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:18 smithi189 ceph-mon[32756]: pgmap v13015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:18 smithi156 ceph-mon[32679]: pgmap v13015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:18 smithi092 ceph-mon[29156]: pgmap v13015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T00:50:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23514.727042 secs 2024-04-27T00:50:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23514.727042 secs 2024-04-27T00:50:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23514.727042 secs 2024-04-27T00:50:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22817.695851 secs 2024-04-27T00:50:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:20 smithi189 ceph-mon[32756]: pgmap v13016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22817.695851 secs 2024-04-27T00:50:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:20 smithi156 ceph-mon[32679]: pgmap v13016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22817.695851 secs 2024-04-27T00:50:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:20 smithi092 ceph-mon[29156]: pgmap v13016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T00:50:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:22 smithi189 ceph-mon[32756]: pgmap v13017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:22 smithi156 ceph-mon[32679]: pgmap v13017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:22 smithi092 ceph-mon[29156]: pgmap v13017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:24 smithi189 ceph-mon[32756]: pgmap v13018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23519.727155 secs 2024-04-27T00:50:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:24 smithi156 ceph-mon[32679]: pgmap v13018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23519.727155 secs 2024-04-27T00:50:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:24 smithi092 ceph-mon[29156]: pgmap v13018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23519.727155 secs 2024-04-27T00:50:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22822.695967 secs 2024-04-27T00:50:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22822.695967 secs 2024-04-27T00:50:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22822.695967 secs 2024-04-27T00:50:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:26 smithi189 ceph-mon[32756]: pgmap v13019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:26 smithi156 ceph-mon[32679]: pgmap v13019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:26 smithi092 ceph-mon[29156]: pgmap v13019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:28 smithi189 ceph-mon[32756]: pgmap v13020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:28 smithi156 ceph-mon[32679]: pgmap v13020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:28 smithi092 ceph-mon[29156]: pgmap v13020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23524.727236 secs 2024-04-27T00:50:29.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23524.727236 secs 2024-04-27T00:50:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23524.727236 secs 2024-04-27T00:50:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22827.696104 secs 2024-04-27T00:50:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:30 smithi189 ceph-mon[32756]: pgmap v13021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22827.696104 secs 2024-04-27T00:50:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:30 smithi156 ceph-mon[32679]: pgmap v13021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22827.696104 secs 2024-04-27T00:50:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:30 smithi092 ceph-mon[29156]: pgmap v13021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:32 smithi189 ceph-mon[32756]: pgmap v13022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:32 smithi156 ceph-mon[32679]: pgmap v13022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:32 smithi092 ceph-mon[29156]: pgmap v13022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:34 smithi189 ceph-mon[32756]: pgmap v13023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 23529.727372 secs 2024-04-27T00:50:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:34 smithi156 ceph-mon[32679]: pgmap v13023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 23529.727372 secs 2024-04-27T00:50:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:34 smithi092 ceph-mon[29156]: pgmap v13023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 23529.727372 secs 2024-04-27T00:50:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22832.696218 secs 2024-04-27T00:50:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22832.696218 secs 2024-04-27T00:50:35.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22832.696218 secs 2024-04-27T00:50:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:36 smithi189 ceph-mon[32756]: pgmap v13024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:36 smithi156 ceph-mon[32679]: pgmap v13024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:36 smithi092 ceph-mon[29156]: pgmap v13024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:50:37.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:50:37.022+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:50:37.022+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:50:37.022+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:50:37.022+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:50:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:50:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:50:37.022+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:50:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:38 smithi189 ceph-mon[32756]: pgmap v13025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:50:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:50:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:50:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:38 smithi156 ceph-mon[32679]: pgmap v13025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:50:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:50:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:50:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:38 smithi092 ceph-mon[29156]: pgmap v13025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:50:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:50:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:50:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:39 smithi189 ceph-mon[32756]: pgmap v13026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:50:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:39 smithi189 ceph-mon[32756]: pgmap v13027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:50:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23534.727527 secs 2024-04-27T00:50:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:39 smithi156 ceph-mon[32679]: pgmap v13026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:50:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:39 smithi156 ceph-mon[32679]: pgmap v13027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:50:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23534.727527 secs 2024-04-27T00:50:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:39 smithi092 ceph-mon[29156]: pgmap v13026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:50:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:39 smithi092 ceph-mon[29156]: pgmap v13027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:50:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23534.727527 secs 2024-04-27T00:50:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22837.696315 secs 2024-04-27T00:50:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22837.696315 secs 2024-04-27T00:50:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22837.696315 secs 2024-04-27T00:50:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:41 smithi189 ceph-mon[32756]: pgmap v13028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:41 smithi156 ceph-mon[32679]: pgmap v13028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:41 smithi092 ceph-mon[29156]: pgmap v13028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:43 smithi189 ceph-mon[32756]: pgmap v13029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:50:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:50:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:43 smithi156 ceph-mon[32679]: pgmap v13029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:50:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:50:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:43 smithi092 ceph-mon[29156]: pgmap v13029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:50:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:50:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23539.727645 secs 2024-04-27T00:50:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23539.727645 secs 2024-04-27T00:50:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23539.727645 secs 2024-04-27T00:50:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:45 smithi189 ceph-mon[32756]: pgmap v13030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22842.696375 secs 2024-04-27T00:50:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:45 smithi156 ceph-mon[32679]: pgmap v13030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22842.696375 secs 2024-04-27T00:50:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:45 smithi092 ceph-mon[29156]: pgmap v13030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22842.696375 secs 2024-04-27T00:50:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:47 smithi189 ceph-mon[32756]: pgmap v13031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:47 smithi156 ceph-mon[32679]: pgmap v13031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:47 smithi092 ceph-mon[29156]: pgmap v13031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T00:50:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:49 smithi156 ceph-mon[32679]: pgmap v13032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-27T00:50:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23544.727761 secs 2024-04-27T00:50:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:49 smithi092 ceph-mon[29156]: pgmap v13032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-27T00:50:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23544.727761 secs 2024-04-27T00:50:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:49 smithi189 ceph-mon[32756]: pgmap v13032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 409 B/s wr, 18 op/s 2024-04-27T00:50:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23544.727761 secs 2024-04-27T00:50:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22847.696455 secs 2024-04-27T00:50:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22847.696455 secs 2024-04-27T00:50:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22847.696455 secs 2024-04-27T00:50:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:51 smithi189 ceph-mon[32756]: pgmap v13033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T00:50:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:51 smithi156 ceph-mon[32679]: pgmap v13033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T00:50:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:51 smithi092 ceph-mon[29156]: pgmap v13033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T00:50:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:53 smithi156 ceph-mon[32679]: pgmap v13034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:53 smithi092 ceph-mon[29156]: pgmap v13034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:53 smithi189 ceph-mon[32756]: pgmap v13034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23549.727845 secs 2024-04-27T00:50:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23549.727845 secs 2024-04-27T00:50:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23549.727845 secs 2024-04-27T00:50:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:55 smithi156 ceph-mon[32679]: pgmap v13035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22852.696578 secs 2024-04-27T00:50:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:55 smithi092 ceph-mon[29156]: pgmap v13035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22852.696578 secs 2024-04-27T00:50:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:55 smithi189 ceph-mon[32756]: pgmap v13035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:50:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22852.696578 secs 2024-04-27T00:50:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:57 smithi156 ceph-mon[32679]: pgmap v13036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:57 smithi092 ceph-mon[29156]: pgmap v13036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:57 smithi189 ceph-mon[32756]: pgmap v13036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:59 smithi156 ceph-mon[32679]: pgmap v13037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:50:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23554.727899 secs 2024-04-27T00:50:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:59 smithi092 ceph-mon[29156]: pgmap v13037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:50:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23554.727899 secs 2024-04-27T00:50:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:59 smithi189 ceph-mon[32756]: pgmap v13037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:50:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:50:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23554.727899 secs 2024-04-27T00:51:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22857.696696 secs 2024-04-27T00:51:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22857.696696 secs 2024-04-27T00:51:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22857.696696 secs 2024-04-27T00:51:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:01 smithi156 ceph-mon[32679]: pgmap v13038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:01 smithi092 ceph-mon[29156]: pgmap v13038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:01 smithi189 ceph-mon[32756]: pgmap v13038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:03 smithi156 ceph-mon[32679]: pgmap v13039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:03 smithi092 ceph-mon[29156]: pgmap v13039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:03 smithi189 ceph-mon[32756]: pgmap v13039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23559.727973 secs 2024-04-27T00:51:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23559.727973 secs 2024-04-27T00:51:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23559.727973 secs 2024-04-27T00:51:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:05 smithi156 ceph-mon[32679]: pgmap v13040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22862.696845 secs 2024-04-27T00:51:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:05 smithi092 ceph-mon[29156]: pgmap v13040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22862.696845 secs 2024-04-27T00:51:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:05 smithi189 ceph-mon[32756]: pgmap v13040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22862.696845 secs 2024-04-27T00:51:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:07 smithi092 ceph-mon[29156]: pgmap v13041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:07 smithi189 ceph-mon[32756]: pgmap v13041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:07 smithi156 ceph-mon[32679]: pgmap v13041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:09 smithi092 ceph-mon[29156]: pgmap v13042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:09 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 23564.728054 secs 2024-04-27T00:51:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:09 smithi092 ceph-mon[29156]: slow request 2882.414765 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:51:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:09 smithi189 ceph-mon[32756]: pgmap v13042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:09 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 23564.728054 secs 2024-04-27T00:51:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:09 smithi189 ceph-mon[32756]: slow request 2882.414765 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:51:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:09 smithi156 ceph-mon[32679]: pgmap v13042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:09 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 23564.728054 secs 2024-04-27T00:51:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:09 smithi156 ceph-mon[32679]: slow request 2882.414765 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:51:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22867.696960 secs 2024-04-27T00:51:10.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22867.696960 secs 2024-04-27T00:51:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22867.696960 secs 2024-04-27T00:51:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:11 smithi092 ceph-mon[29156]: pgmap v13043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:11 smithi189 ceph-mon[32756]: pgmap v13043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:11 smithi156 ceph-mon[32679]: pgmap v13043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:13 smithi092 ceph-mon[29156]: pgmap v13044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:13 smithi189 ceph-mon[32756]: pgmap v13044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:13 smithi156 ceph-mon[32679]: pgmap v13044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T00:51:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23569.728146 secs 2024-04-27T00:51:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23569.728146 secs 2024-04-27T00:51:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23569.728146 secs 2024-04-27T00:51:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:15 smithi092 ceph-mon[29156]: pgmap v13045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22872.697063 secs 2024-04-27T00:51:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:15 smithi156 ceph-mon[32679]: pgmap v13045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22872.697063 secs 2024-04-27T00:51:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:15 smithi189 ceph-mon[32756]: pgmap v13045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T00:51:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22872.697063 secs 2024-04-27T00:51:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:17 smithi092 ceph-mon[29156]: pgmap v13046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:17 smithi189 ceph-mon[32756]: pgmap v13046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:17 smithi156 ceph-mon[32679]: pgmap v13046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:19 smithi092 ceph-mon[29156]: pgmap v13047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23574.728267 secs 2024-04-27T00:51:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:19 smithi189 ceph-mon[32756]: pgmap v13047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23574.728267 secs 2024-04-27T00:51:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:19 smithi156 ceph-mon[32679]: pgmap v13047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23574.728267 secs 2024-04-27T00:51:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22877.697164 secs 2024-04-27T00:51:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22877.697164 secs 2024-04-27T00:51:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22877.697164 secs 2024-04-27T00:51:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:21 smithi092 ceph-mon[29156]: pgmap v13048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:21 smithi189 ceph-mon[32756]: pgmap v13048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:21 smithi156 ceph-mon[32679]: pgmap v13048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:23 smithi092 ceph-mon[29156]: pgmap v13049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:23 smithi189 ceph-mon[32756]: pgmap v13049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:23 smithi156 ceph-mon[32679]: pgmap v13049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23579.728386 secs 2024-04-27T00:51:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23579.728386 secs 2024-04-27T00:51:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23579.728386 secs 2024-04-27T00:51:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:25 smithi092 ceph-mon[29156]: pgmap v13050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22882.697325 secs 2024-04-27T00:51:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:25 smithi189 ceph-mon[32756]: pgmap v13050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22882.697325 secs 2024-04-27T00:51:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:25 smithi156 ceph-mon[32679]: pgmap v13050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22882.697325 secs 2024-04-27T00:51:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:27 smithi092 ceph-mon[29156]: pgmap v13051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:27 smithi189 ceph-mon[32756]: pgmap v13051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:27 smithi156 ceph-mon[32679]: pgmap v13051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:29 smithi092 ceph-mon[29156]: pgmap v13052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23584.728527 secs 2024-04-27T00:51:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:29 smithi189 ceph-mon[32756]: pgmap v13052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23584.728527 secs 2024-04-27T00:51:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:29 smithi156 ceph-mon[32679]: pgmap v13052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23584.728527 secs 2024-04-27T00:51:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22887.697465 secs 2024-04-27T00:51:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22887.697465 secs 2024-04-27T00:51:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22887.697465 secs 2024-04-27T00:51:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:31 smithi189 ceph-mon[32756]: pgmap v13053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:31 smithi156 ceph-mon[32679]: pgmap v13053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:31 smithi092 ceph-mon[29156]: pgmap v13053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:33 smithi189 ceph-mon[32756]: pgmap v13054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:33 smithi156 ceph-mon[32679]: pgmap v13054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:33 smithi092 ceph-mon[29156]: pgmap v13054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23589.728661 secs 2024-04-27T00:51:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23589.728661 secs 2024-04-27T00:51:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23589.728661 secs 2024-04-27T00:51:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:35 smithi189 ceph-mon[32756]: pgmap v13055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22892.697541 secs 2024-04-27T00:51:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:35 smithi156 ceph-mon[32679]: pgmap v13055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22892.697541 secs 2024-04-27T00:51:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:35 smithi092 ceph-mon[29156]: pgmap v13055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22892.697541 secs 2024-04-27T00:51:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:37 smithi189 ceph-mon[32756]: pgmap v13056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:37 smithi156 ceph-mon[32679]: pgmap v13056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:37 smithi092 ceph-mon[29156]: pgmap v13056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:51:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:51:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:51:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:51:39.219+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:51:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:51:39.219+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:51:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:51:39.219+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:51:39.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:51:39.219+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 183 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:39 smithi189 ceph-mon[32756]: pgmap v13057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:51:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23594.728772 secs 2024-04-27T00:51:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:39 smithi156 ceph-mon[32679]: pgmap v13057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:51:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:51:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:51:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23594.728772 secs 2024-04-27T00:51:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:39 smithi092 ceph-mon[29156]: pgmap v13057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:51:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:51:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:51:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23594.728772 secs 2024-04-27T00:51:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:40 smithi189 ceph-mon[32756]: pgmap v13058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:51:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:40 smithi189 ceph-mon[32756]: pgmap v13059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22897.697680 secs 2024-04-27T00:51:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:40 smithi156 ceph-mon[32679]: pgmap v13058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:51:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:40 smithi156 ceph-mon[32679]: pgmap v13059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22897.697680 secs 2024-04-27T00:51:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:40 smithi092 ceph-mon[29156]: pgmap v13058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:51:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:40 smithi092 ceph-mon[29156]: pgmap v13059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22897.697680 secs 2024-04-27T00:51:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:41 smithi189 ceph-mon[32756]: pgmap v13060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:41 smithi156 ceph-mon[32679]: pgmap v13060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:41 smithi092 ceph-mon[29156]: pgmap v13060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:43.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:43 smithi189 ceph-mon[32756]: pgmap v13061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:43 smithi156 ceph-mon[32679]: pgmap v13061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:43 smithi092 ceph-mon[29156]: pgmap v13061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:51:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23599.728890 secs 2024-04-27T00:51:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23599.728890 secs 2024-04-27T00:51:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23599.728890 secs 2024-04-27T00:51:45.834 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22902.697784 secs 2024-04-27T00:51:45.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:45 smithi156 ceph-mon[32679]: pgmap v13062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22902.697784 secs 2024-04-27T00:51:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:45 smithi189 ceph-mon[32756]: pgmap v13062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22902.697784 secs 2024-04-27T00:51:45.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:45 smithi092 ceph-mon[29156]: pgmap v13062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:47 smithi189 ceph-mon[32756]: pgmap v13063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:47 smithi156 ceph-mon[32679]: pgmap v13063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:47 smithi092 ceph-mon[29156]: pgmap v13063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:51:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:49 smithi189 ceph-mon[32756]: pgmap v13064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:51:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:49 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23604.728951 secs 2024-04-27T00:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:49 smithi156 ceph-mon[32679]: pgmap v13064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:51:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:49 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23604.728951 secs 2024-04-27T00:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:49 smithi092 ceph-mon[29156]: pgmap v13064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:51:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:49 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23604.728951 secs 2024-04-27T00:51:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22907.697920 secs 2024-04-27T00:51:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22907.697920 secs 2024-04-27T00:51:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22907.697920 secs 2024-04-27T00:51:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:51 smithi189 ceph-mon[32756]: pgmap v13065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:51 smithi156 ceph-mon[32679]: pgmap v13065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:51 smithi092 ceph-mon[29156]: pgmap v13065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:53 smithi189 ceph-mon[32756]: pgmap v13066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:53.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:53 smithi156 ceph-mon[32679]: pgmap v13066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:53 smithi092 ceph-mon[29156]: pgmap v13066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23609.729017 secs 2024-04-27T00:51:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23609.729017 secs 2024-04-27T00:51:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23609.729017 secs 2024-04-27T00:51:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22912.698058 secs 2024-04-27T00:51:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:55 smithi189 ceph-mon[32756]: pgmap v13067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22912.698058 secs 2024-04-27T00:51:55.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:55 smithi156 ceph-mon[32679]: pgmap v13067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22912.698058 secs 2024-04-27T00:51:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:55 smithi092 ceph-mon[29156]: pgmap v13067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:51:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:57 smithi189 ceph-mon[32756]: pgmap v13068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:57.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:57 smithi156 ceph-mon[32679]: pgmap v13068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:57 smithi092 ceph-mon[29156]: pgmap v13068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:59 smithi189 ceph-mon[32756]: pgmap v13069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:51:59 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23614.729128 secs 2024-04-27T00:51:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:59 smithi156 ceph-mon[32679]: pgmap v13069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:59.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:51:59 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23614.729128 secs 2024-04-27T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:59 smithi092 ceph-mon[29156]: pgmap v13069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:51:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:51:59 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23614.729128 secs 2024-04-27T00:52:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22917.698180 secs 2024-04-27T00:52:00.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22917.698180 secs 2024-04-27T00:52:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22917.698180 secs 2024-04-27T00:52:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:01 smithi189 ceph-mon[32756]: pgmap v13070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:01.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:01 smithi156 ceph-mon[32679]: pgmap v13070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:01 smithi092 ceph-mon[29156]: pgmap v13070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:03.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:03 smithi092 ceph-mon[29156]: pgmap v13071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:03 smithi189 ceph-mon[32756]: pgmap v13071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:03.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:03 smithi156 ceph-mon[32679]: pgmap v13071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23619.729247 secs 2024-04-27T00:52:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23619.729247 secs 2024-04-27T00:52:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23619.729247 secs 2024-04-27T00:52:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22922.698286 secs 2024-04-27T00:52:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:05 smithi189 ceph-mon[32756]: pgmap v13072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22922.698286 secs 2024-04-27T00:52:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:05 smithi156 ceph-mon[32679]: pgmap v13072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22922.698286 secs 2024-04-27T00:52:05.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:05 smithi092 ceph-mon[29156]: pgmap v13072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:07 smithi189 ceph-mon[32756]: pgmap v13073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:07.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:07 smithi156 ceph-mon[32679]: pgmap v13073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:07 smithi092 ceph-mon[29156]: pgmap v13073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:09 smithi189 ceph-mon[32756]: pgmap v13074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:09 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23624.729396 secs 2024-04-27T00:52:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:09 smithi156 ceph-mon[32679]: pgmap v13074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:09 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23624.729396 secs 2024-04-27T00:52:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:09 smithi092 ceph-mon[29156]: pgmap v13074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:09 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23624.729396 secs 2024-04-27T00:52:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22927.698399 secs 2024-04-27T00:52:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22927.698399 secs 2024-04-27T00:52:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22927.698399 secs 2024-04-27T00:52:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:11 smithi189 ceph-mon[32756]: pgmap v13075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:11 smithi156 ceph-mon[32679]: pgmap v13075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:11 smithi092 ceph-mon[29156]: pgmap v13075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:13 smithi189 ceph-mon[32756]: pgmap v13076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:13 smithi156 ceph-mon[32679]: pgmap v13076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:13.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:13 smithi092 ceph-mon[29156]: pgmap v13076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23629.729467 secs 2024-04-27T00:52:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23629.729467 secs 2024-04-27T00:52:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23629.729467 secs 2024-04-27T00:52:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22932.698525 secs 2024-04-27T00:52:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:15 smithi189 ceph-mon[32756]: pgmap v13077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22932.698525 secs 2024-04-27T00:52:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:15 smithi156 ceph-mon[32679]: pgmap v13077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22932.698525 secs 2024-04-27T00:52:15.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:15 smithi092 ceph-mon[29156]: pgmap v13077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:17.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:17 smithi189 ceph-mon[32756]: pgmap v13078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:17 smithi156 ceph-mon[32679]: pgmap v13078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:17 smithi092 ceph-mon[29156]: pgmap v13078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:19 smithi189 ceph-mon[32756]: pgmap v13079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:19 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23634.729593 secs 2024-04-27T00:52:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:19 smithi156 ceph-mon[32679]: pgmap v13079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:19 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23634.729593 secs 2024-04-27T00:52:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:19 smithi092 ceph-mon[29156]: pgmap v13079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:19 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23634.729593 secs 2024-04-27T00:52:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22937.698592 secs 2024-04-27T00:52:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22937.698592 secs 2024-04-27T00:52:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22937.698592 secs 2024-04-27T00:52:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:21 smithi189 ceph-mon[32756]: pgmap v13080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:21 smithi156 ceph-mon[32679]: pgmap v13080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:21 smithi092 ceph-mon[29156]: pgmap v13080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:23.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:23 smithi189 ceph-mon[32756]: pgmap v13081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:23 smithi156 ceph-mon[32679]: pgmap v13081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:23 smithi092 ceph-mon[29156]: pgmap v13081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23639.729712 secs 2024-04-27T00:52:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23639.729712 secs 2024-04-27T00:52:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23639.729712 secs 2024-04-27T00:52:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22942.698674 secs 2024-04-27T00:52:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:25 smithi189 ceph-mon[32756]: pgmap v13082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22942.698674 secs 2024-04-27T00:52:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:25 smithi156 ceph-mon[32679]: pgmap v13082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22942.698674 secs 2024-04-27T00:52:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:25 smithi092 ceph-mon[29156]: pgmap v13082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:27 smithi156 ceph-mon[32679]: pgmap v13083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:27 smithi092 ceph-mon[29156]: pgmap v13083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:27 smithi189 ceph-mon[32756]: pgmap v13083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:29 smithi156 ceph-mon[32679]: pgmap v13084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:29 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23644.729779 secs 2024-04-27T00:52:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:29 smithi092 ceph-mon[29156]: pgmap v13084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:29 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23644.729779 secs 2024-04-27T00:52:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:29 smithi189 ceph-mon[32756]: pgmap v13084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:29 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23644.729779 secs 2024-04-27T00:52:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22947.698807 secs 2024-04-27T00:52:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22947.698807 secs 2024-04-27T00:52:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22947.698807 secs 2024-04-27T00:52:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:31 smithi156 ceph-mon[32679]: pgmap v13085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:31.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:31 smithi092 ceph-mon[29156]: pgmap v13085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:31 smithi189 ceph-mon[32756]: pgmap v13085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:33 smithi156 ceph-mon[32679]: pgmap v13086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:33 smithi092 ceph-mon[29156]: pgmap v13086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:33 smithi189 ceph-mon[32756]: pgmap v13086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23649.729915 secs 2024-04-27T00:52:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23649.729915 secs 2024-04-27T00:52:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23649.729915 secs 2024-04-27T00:52:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22952.698930 secs 2024-04-27T00:52:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:35 smithi156 ceph-mon[32679]: pgmap v13087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22952.698930 secs 2024-04-27T00:52:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:35 smithi092 ceph-mon[29156]: pgmap v13087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22952.698930 secs 2024-04-27T00:52:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:35 smithi189 ceph-mon[32756]: pgmap v13087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:37 smithi156 ceph-mon[32679]: pgmap v13088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:37 smithi092 ceph-mon[29156]: pgmap v13088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:37 smithi189 ceph-mon[32756]: pgmap v13088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:52:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:52:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:52:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: pgmap v13089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23654.729982 secs 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: pgmap v13090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: pgmap v13091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:52:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: pgmap v13089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23654.729982 secs 2024-04-27T00:52:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:52:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:52:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: pgmap v13090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:52:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: pgmap v13091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: pgmap v13089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23654.729982 secs 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: pgmap v13090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T00:52:40.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: pgmap v13091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:40.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:52:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22957.699018 secs 2024-04-27T00:52:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22957.699018 secs 2024-04-27T00:52:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22957.699018 secs 2024-04-27T00:52:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:41 smithi156 ceph-mon[32679]: pgmap v13092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:41 smithi092 ceph-mon[29156]: pgmap v13092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:41 smithi189 ceph-mon[32756]: pgmap v13092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:43 smithi189 ceph-mon[32756]: pgmap v13093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:52:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:43 smithi156 ceph-mon[32679]: pgmap v13093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:52:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:43 smithi092 ceph-mon[29156]: pgmap v13093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:52:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:44 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23659.730085 secs 2024-04-27T00:52:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:44 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23659.730085 secs 2024-04-27T00:52:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:44 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23659.730085 secs 2024-04-27T00:52:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22962.699154 secs 2024-04-27T00:52:45.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:45 smithi156 ceph-mon[32679]: pgmap v13094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22962.699154 secs 2024-04-27T00:52:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:45 smithi189 ceph-mon[32756]: pgmap v13094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22962.699154 secs 2024-04-27T00:52:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:45 smithi092 ceph-mon[29156]: pgmap v13094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:47 smithi189 ceph-mon[32756]: pgmap v13095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:47 smithi156 ceph-mon[32679]: pgmap v13095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:47 smithi092 ceph-mon[29156]: pgmap v13095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:52:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:48 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23664.730170 secs 2024-04-27T00:52:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:48 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23664.730170 secs 2024-04-27T00:52:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:48 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23664.730170 secs 2024-04-27T00:52:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22967.699268 secs 2024-04-27T00:52:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:49 smithi189 ceph-mon[32756]: pgmap v13096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:52:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22967.699268 secs 2024-04-27T00:52:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:49 smithi156 ceph-mon[32679]: pgmap v13096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:52:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22967.699268 secs 2024-04-27T00:52:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:49 smithi092 ceph-mon[29156]: pgmap v13096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:52:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:51 smithi189 ceph-mon[32756]: pgmap v13097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:51.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:51 smithi156 ceph-mon[32679]: pgmap v13097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:51 smithi092 ceph-mon[29156]: pgmap v13097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:53 smithi189 ceph-mon[32756]: pgmap v13098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:53.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:53 smithi156 ceph-mon[32679]: pgmap v13098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:53.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:53 smithi092 ceph-mon[29156]: pgmap v13098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:54 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23669.730264 secs 2024-04-27T00:52:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:54 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23669.730264 secs 2024-04-27T00:52:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:54 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23669.730264 secs 2024-04-27T00:52:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22972.699383 secs 2024-04-27T00:52:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:55 smithi189 ceph-mon[32756]: pgmap v13099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22972.699383 secs 2024-04-27T00:52:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:55 smithi156 ceph-mon[32679]: pgmap v13099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22972.699383 secs 2024-04-27T00:52:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:55 smithi092 ceph-mon[29156]: pgmap v13099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:52:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:57 smithi189 ceph-mon[32756]: pgmap v13100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:57 smithi156 ceph-mon[32679]: pgmap v13100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:57 smithi092 ceph-mon[29156]: pgmap v13100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:52:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:58 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23674.730381 secs 2024-04-27T00:52:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:58 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23674.730381 secs 2024-04-27T00:52:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:58 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23674.730381 secs 2024-04-27T00:53:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22977.699442 secs 2024-04-27T00:53:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:52:59 smithi189 ceph-mon[32756]: pgmap v13101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22977.699442 secs 2024-04-27T00:53:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:52:59 smithi156 ceph-mon[32679]: pgmap v13101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22977.699442 secs 2024-04-27T00:53:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:52:59 smithi092 ceph-mon[29156]: pgmap v13101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:01 smithi189 ceph-mon[32756]: pgmap v13102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:01 smithi156 ceph-mon[32679]: pgmap v13102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:01 smithi092 ceph-mon[29156]: pgmap v13102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:03 smithi189 ceph-mon[32756]: pgmap v13103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:03 smithi156 ceph-mon[32679]: pgmap v13103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:03 smithi092 ceph-mon[29156]: pgmap v13103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:04 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23679.730523 secs 2024-04-27T00:53:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:04 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23679.730523 secs 2024-04-27T00:53:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:04 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23679.730523 secs 2024-04-27T00:53:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22982.699559 secs 2024-04-27T00:53:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:05 smithi189 ceph-mon[32756]: pgmap v13104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22982.699559 secs 2024-04-27T00:53:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:05 smithi156 ceph-mon[32679]: pgmap v13104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22982.699559 secs 2024-04-27T00:53:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:05 smithi092 ceph-mon[29156]: pgmap v13104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:07 smithi189 ceph-mon[32756]: pgmap v13105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:07 smithi156 ceph-mon[32679]: pgmap v13105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:07 smithi092 ceph-mon[29156]: pgmap v13105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:09.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:08 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23684.730658 secs 2024-04-27T00:53:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:08 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23684.730658 secs 2024-04-27T00:53:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:08 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23684.730658 secs 2024-04-27T00:53:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22987.699672 secs 2024-04-27T00:53:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:09 smithi189 ceph-mon[32756]: pgmap v13106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22987.699672 secs 2024-04-27T00:53:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:09 smithi156 ceph-mon[32679]: pgmap v13106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22987.699672 secs 2024-04-27T00:53:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:09 smithi092 ceph-mon[29156]: pgmap v13106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:11 smithi189 ceph-mon[32756]: pgmap v13107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:11.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:11 smithi156 ceph-mon[32679]: pgmap v13107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:11 smithi092 ceph-mon[29156]: pgmap v13107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:13 smithi189 ceph-mon[32756]: pgmap v13108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:13 smithi156 ceph-mon[32679]: pgmap v13108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:13.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:13 smithi092 ceph-mon[29156]: pgmap v13108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:14 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23689.730778 secs 2024-04-27T00:53:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:14 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23689.730778 secs 2024-04-27T00:53:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:14 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23689.730778 secs 2024-04-27T00:53:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22992.699782 secs 2024-04-27T00:53:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:15 smithi189 ceph-mon[32756]: pgmap v13109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22992.699782 secs 2024-04-27T00:53:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:15 smithi156 ceph-mon[32679]: pgmap v13109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22992.699782 secs 2024-04-27T00:53:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:15 smithi092 ceph-mon[29156]: pgmap v13109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:17 smithi189 ceph-mon[32756]: pgmap v13110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:17 smithi156 ceph-mon[32679]: pgmap v13110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:17.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:17 smithi092 ceph-mon[29156]: pgmap v13110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:19.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:18 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23694.730899 secs 2024-04-27T00:53:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:18 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23694.730899 secs 2024-04-27T00:53:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:18 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23694.730899 secs 2024-04-27T00:53:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 22997.699902 secs 2024-04-27T00:53:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:19 smithi189 ceph-mon[32756]: pgmap v13111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 22997.699902 secs 2024-04-27T00:53:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:19 smithi156 ceph-mon[32679]: pgmap v13111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 22997.699902 secs 2024-04-27T00:53:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:19 smithi092 ceph-mon[29156]: pgmap v13111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:21 smithi189 ceph-mon[32756]: pgmap v13112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:21 smithi156 ceph-mon[32679]: pgmap v13112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:21 smithi092 ceph-mon[29156]: pgmap v13112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:23 smithi189 ceph-mon[32756]: pgmap v13113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:23 smithi156 ceph-mon[32679]: pgmap v13113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:23 smithi092 ceph-mon[29156]: pgmap v13113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:24 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23699.730987 secs 2024-04-27T00:53:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:24 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23699.730987 secs 2024-04-27T00:53:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:24 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23699.730987 secs 2024-04-27T00:53:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23002.700008 secs 2024-04-27T00:53:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:25 smithi189 ceph-mon[32756]: pgmap v13114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23002.700008 secs 2024-04-27T00:53:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:25 smithi156 ceph-mon[32679]: pgmap v13114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23002.700008 secs 2024-04-27T00:53:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:25 smithi092 ceph-mon[29156]: pgmap v13114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:27 smithi189 ceph-mon[32756]: pgmap v13115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:27 smithi156 ceph-mon[32679]: pgmap v13115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:27 smithi092 ceph-mon[29156]: pgmap v13115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:28 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23704.731063 secs 2024-04-27T00:53:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:28 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23704.731063 secs 2024-04-27T00:53:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:28 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23704.731063 secs 2024-04-27T00:53:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23007.700126 secs 2024-04-27T00:53:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:29 smithi189 ceph-mon[32756]: pgmap v13116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23007.700126 secs 2024-04-27T00:53:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:29 smithi156 ceph-mon[32679]: pgmap v13116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23007.700126 secs 2024-04-27T00:53:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:29 smithi092 ceph-mon[29156]: pgmap v13116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:31 smithi189 ceph-mon[32756]: pgmap v13117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:31 smithi156 ceph-mon[32679]: pgmap v13117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:31 smithi092 ceph-mon[29156]: pgmap v13117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:33 smithi189 ceph-mon[32756]: pgmap v13118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:33 smithi156 ceph-mon[32679]: pgmap v13118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:33 smithi092 ceph-mon[29156]: pgmap v13118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:34 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 23709.731198 secs 2024-04-27T00:53:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:34 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 23709.731198 secs 2024-04-27T00:53:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:34 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 23709.731198 secs 2024-04-27T00:53:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23012.700264 secs 2024-04-27T00:53:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:35 smithi189 ceph-mon[32756]: pgmap v13119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23012.700264 secs 2024-04-27T00:53:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:35 smithi156 ceph-mon[32679]: pgmap v13119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23012.700264 secs 2024-04-27T00:53:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:35 smithi092 ceph-mon[29156]: pgmap v13119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:37 smithi189 ceph-mon[32756]: pgmap v13120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:37 smithi156 ceph-mon[32679]: pgmap v13120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:37.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:37 smithi092 ceph-mon[29156]: pgmap v13120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:38 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 23714.731315 secs 2024-04-27T00:53:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:38 smithi189 ceph-mon[32756]: slow request 181.614181 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:38 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 23714.731315 secs 2024-04-27T00:53:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:38 smithi156 ceph-mon[32679]: slow request 181.614181 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:53:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:38 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 23714.731315 secs 2024-04-27T00:53:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:38 smithi092 ceph-mon[29156]: slow request 181.614181 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:53:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23017.700386 secs 2024-04-27T00:53:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:39 smithi189 ceph-mon[32756]: pgmap v13121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:53:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23017.700386 secs 2024-04-27T00:53:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:39 smithi156 ceph-mon[32679]: pgmap v13121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:53:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23017.700386 secs 2024-04-27T00:53:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:39 smithi092 ceph-mon[29156]: pgmap v13121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:53:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:53:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:53:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:40 smithi189 ceph-mon[32756]: pgmap v13122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:53:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:40 smithi189 ceph-mon[32756]: pgmap v13123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:53:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:53:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:53:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:40 smithi156 ceph-mon[32679]: pgmap v13122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:53:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:40 smithi156 ceph-mon[32679]: pgmap v13123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:40 smithi092 ceph-mon[29156]: pgmap v13122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:40 smithi092 ceph-mon[29156]: pgmap v13123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:53:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:53:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:53:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:42 smithi189 ceph-mon[32756]: pgmap v13124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:53:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:53:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:42 smithi156 ceph-mon[32679]: pgmap v13124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T00:53:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:53:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:42 smithi092 ceph-mon[29156]: pgmap v13124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23719.731375 secs 2024-04-27T00:53:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23719.731375 secs 2024-04-27T00:53:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23719.731375 secs 2024-04-27T00:53:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23022.700455 secs 2024-04-27T00:53:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:45 smithi156 ceph-mon[32679]: pgmap v13125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23022.700455 secs 2024-04-27T00:53:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:45 smithi189 ceph-mon[32756]: pgmap v13125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23022.700455 secs 2024-04-27T00:53:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:45 smithi092 ceph-mon[29156]: pgmap v13125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:47 smithi156 ceph-mon[32679]: pgmap v13126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:47 smithi092 ceph-mon[29156]: pgmap v13126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:47 smithi189 ceph-mon[32756]: pgmap v13126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:53:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:49 smithi156 ceph-mon[32679]: pgmap v13127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:53:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23724.731482 secs 2024-04-27T00:53:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:49 smithi092 ceph-mon[29156]: pgmap v13127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:53:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23724.731482 secs 2024-04-27T00:53:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:49 smithi189 ceph-mon[32756]: pgmap v13127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:53:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23724.731482 secs 2024-04-27T00:53:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23027.700556 secs 2024-04-27T00:53:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23027.700556 secs 2024-04-27T00:53:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23027.700556 secs 2024-04-27T00:53:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:51 smithi156 ceph-mon[32679]: pgmap v13128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:53:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:51 smithi092 ceph-mon[29156]: pgmap v13128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:53:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:51 smithi189 ceph-mon[32756]: pgmap v13128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:53:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:53 smithi156 ceph-mon[32679]: pgmap v13129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:53 smithi092 ceph-mon[29156]: pgmap v13129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:53 smithi189 ceph-mon[32756]: pgmap v13129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23729.731621 secs 2024-04-27T00:53:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23729.731621 secs 2024-04-27T00:53:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23729.731621 secs 2024-04-27T00:53:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23032.700712 secs 2024-04-27T00:53:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:55 smithi092 ceph-mon[29156]: pgmap v13130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23032.700712 secs 2024-04-27T00:53:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:55 smithi189 ceph-mon[32756]: pgmap v13130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23032.700712 secs 2024-04-27T00:53:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:55 smithi156 ceph-mon[32679]: pgmap v13130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:53:57.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:57 smithi092 ceph-mon[29156]: pgmap v13131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:57 smithi189 ceph-mon[32756]: pgmap v13131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:57 smithi156 ceph-mon[32679]: pgmap v13131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:59 smithi092 ceph-mon[29156]: pgmap v13132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:53:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23734.731738 secs 2024-04-27T00:53:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:59 smithi189 ceph-mon[32756]: pgmap v13132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:53:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23734.731738 secs 2024-04-27T00:53:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:59 smithi156 ceph-mon[32679]: pgmap v13132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:53:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:53:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23734.731738 secs 2024-04-27T00:54:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23037.700829 secs 2024-04-27T00:54:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23037.700829 secs 2024-04-27T00:54:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23037.700829 secs 2024-04-27T00:54:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:01 smithi092 ceph-mon[29156]: pgmap v13133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:01 smithi189 ceph-mon[32756]: pgmap v13133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:01 smithi156 ceph-mon[32679]: pgmap v13133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:03 smithi092 ceph-mon[29156]: pgmap v13134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:03.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:03 smithi189 ceph-mon[32756]: pgmap v13134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:03 smithi156 ceph-mon[32679]: pgmap v13134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23739.731852 secs 2024-04-27T00:54:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23739.731852 secs 2024-04-27T00:54:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23739.731852 secs 2024-04-27T00:54:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:05 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 23042.700943 secs 2024-04-27T00:54:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:05 smithi092 ceph-mon[29156]: slow request 23042.700943 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:54:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:05 smithi092 ceph-mon[29156]: pgmap v13135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:05 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 23042.700943 secs 2024-04-27T00:54:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:05 smithi189 ceph-mon[32756]: slow request 23042.700943 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:54:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:05 smithi189 ceph-mon[32756]: pgmap v13135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:05 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 23042.700943 secs 2024-04-27T00:54:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:05 smithi156 ceph-mon[32679]: slow request 23042.700943 seconds old, received at 2024-04-26T18:30:01.146034+0000: client_request(client.16854:1 getattr pAsLsXsFs #0x1 2024-04-26T18:30:01.141634+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:54:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:05 smithi156 ceph-mon[32679]: pgmap v13135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:07 smithi092 ceph-mon[29156]: pgmap v13136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:07.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:07 smithi189 ceph-mon[32756]: pgmap v13136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:07 smithi156 ceph-mon[32679]: pgmap v13136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:09 smithi092 ceph-mon[29156]: pgmap v13137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23744.731966 secs 2024-04-27T00:54:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:09 smithi189 ceph-mon[32756]: pgmap v13137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23744.731966 secs 2024-04-27T00:54:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:09 smithi156 ceph-mon[32679]: pgmap v13137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23744.731966 secs 2024-04-27T00:54:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23047.701077 secs 2024-04-27T00:54:10.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23047.701077 secs 2024-04-27T00:54:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23047.701077 secs 2024-04-27T00:54:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:11 smithi092 ceph-mon[29156]: pgmap v13138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:11 smithi189 ceph-mon[32756]: pgmap v13138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:11 smithi156 ceph-mon[32679]: pgmap v13138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:13 smithi092 ceph-mon[29156]: pgmap v13139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:13.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:13 smithi189 ceph-mon[32756]: pgmap v13139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:13 smithi156 ceph-mon[32679]: pgmap v13139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23749.732097 secs 2024-04-27T00:54:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23749.732097 secs 2024-04-27T00:54:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23749.732097 secs 2024-04-27T00:54:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23052.701210 secs 2024-04-27T00:54:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:15 smithi092 ceph-mon[29156]: pgmap v13140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23052.701210 secs 2024-04-27T00:54:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:15 smithi156 ceph-mon[32679]: pgmap v13140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23052.701210 secs 2024-04-27T00:54:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:15 smithi189 ceph-mon[32756]: pgmap v13140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:17 smithi092 ceph-mon[29156]: pgmap v13141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:17.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:17 smithi189 ceph-mon[32756]: pgmap v13141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:17 smithi156 ceph-mon[32679]: pgmap v13141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:19 smithi092 ceph-mon[29156]: pgmap v13142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23754.732214 secs 2024-04-27T00:54:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:19 smithi189 ceph-mon[32756]: pgmap v13142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23754.732214 secs 2024-04-27T00:54:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:19 smithi156 ceph-mon[32679]: pgmap v13142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23754.732214 secs 2024-04-27T00:54:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23057.701331 secs 2024-04-27T00:54:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23057.701331 secs 2024-04-27T00:54:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23057.701331 secs 2024-04-27T00:54:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:21 smithi189 ceph-mon[32756]: pgmap v13143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:21 smithi156 ceph-mon[32679]: pgmap v13143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:21 smithi092 ceph-mon[29156]: pgmap v13143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:23 smithi189 ceph-mon[32756]: pgmap v13144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:23 smithi156 ceph-mon[32679]: pgmap v13144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:23 smithi092 ceph-mon[29156]: pgmap v13144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23759.732330 secs 2024-04-27T00:54:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23759.732330 secs 2024-04-27T00:54:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23759.732330 secs 2024-04-27T00:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23062.701454 secs 2024-04-27T00:54:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:25 smithi189 ceph-mon[32756]: pgmap v13145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23062.701454 secs 2024-04-27T00:54:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:25 smithi156 ceph-mon[32679]: pgmap v13145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23062.701454 secs 2024-04-27T00:54:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:25 smithi092 ceph-mon[29156]: pgmap v13145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:27 smithi189 ceph-mon[32756]: pgmap v13146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:27 smithi156 ceph-mon[32679]: pgmap v13146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:27 smithi092 ceph-mon[29156]: pgmap v13146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:29.545 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:29 smithi092 ceph-mon[29156]: pgmap v13147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:29.546 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23764.732451 secs 2024-04-27T00:54:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:29 smithi189 ceph-mon[32756]: pgmap v13147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23764.732451 secs 2024-04-27T00:54:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:29 smithi156 ceph-mon[32679]: pgmap v13147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23764.732451 secs 2024-04-27T00:54:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23067.701532 secs 2024-04-27T00:54:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23067.701532 secs 2024-04-27T00:54:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23067.701532 secs 2024-04-27T00:54:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:31 smithi189 ceph-mon[32756]: pgmap v13148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:31 smithi156 ceph-mon[32679]: pgmap v13148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:31.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:31 smithi092 ceph-mon[29156]: pgmap v13148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:33 smithi189 ceph-mon[32756]: pgmap v13149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:33 smithi156 ceph-mon[32679]: pgmap v13149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:33 smithi092 ceph-mon[29156]: pgmap v13149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23769.732541 secs 2024-04-27T00:54:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23769.732541 secs 2024-04-27T00:54:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23769.732541 secs 2024-04-27T00:54:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23072.701644 secs 2024-04-27T00:54:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:35 smithi189 ceph-mon[32756]: pgmap v13150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23072.701644 secs 2024-04-27T00:54:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:35 smithi156 ceph-mon[32679]: pgmap v13150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23072.701644 secs 2024-04-27T00:54:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:35 smithi092 ceph-mon[29156]: pgmap v13150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:37.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:37 smithi189 ceph-mon[32756]: pgmap v13151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:37 smithi156 ceph-mon[32679]: pgmap v13151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:37 smithi092 ceph-mon[29156]: pgmap v13151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 184 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T00:54:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.244+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:54:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.245+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:54:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:54:39.245+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 185 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:54:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:39 smithi189 ceph-mon[32756]: pgmap v13152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23774.732661 secs 2024-04-27T00:54:39.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:39 smithi092 ceph-mon[29156]: pgmap v13152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:39.676 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23774.732661 secs 2024-04-27T00:54:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:39 smithi156 ceph-mon[32679]: pgmap v13152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23774.732661 secs 2024-04-27T00:54:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23077.701728 secs 2024-04-27T00:54:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:54:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23077.701728 secs 2024-04-27T00:54:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:54:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23077.701728 secs 2024-04-27T00:54:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: pgmap v13153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: pgmap v13154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: pgmap v13155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:54:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: pgmap v13153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:54:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:54:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: pgmap v13154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:54:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: pgmap v13155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: pgmap v13153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: pgmap v13154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: pgmap v13155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:54:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:43 smithi092 ceph-mon[29156]: pgmap v13156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:54:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:43 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23779.732770 secs 2024-04-27T00:54:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:43 smithi189 ceph-mon[32756]: pgmap v13156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:54:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:43 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23779.732770 secs 2024-04-27T00:54:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:43 smithi156 ceph-mon[32679]: pgmap v13156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:54:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:43 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23779.732770 secs 2024-04-27T00:54:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23082.701807 secs 2024-04-27T00:54:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23082.701807 secs 2024-04-27T00:54:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23082.701807 secs 2024-04-27T00:54:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:45 smithi092 ceph-mon[29156]: pgmap v13157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:45 smithi189 ceph-mon[32756]: pgmap v13157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:45 smithi156 ceph-mon[32679]: pgmap v13157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:47 smithi092 ceph-mon[29156]: pgmap v13158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:47 smithi189 ceph-mon[32756]: pgmap v13158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:47 smithi156 ceph-mon[32679]: pgmap v13158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:48 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23784.732908 secs 2024-04-27T00:54:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:48 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23784.732908 secs 2024-04-27T00:54:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:48 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23784.732908 secs 2024-04-27T00:54:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23087.701896 secs 2024-04-27T00:54:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:49 smithi092 ceph-mon[29156]: pgmap v13159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23087.701896 secs 2024-04-27T00:54:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:49 smithi189 ceph-mon[32756]: pgmap v13159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23087.701896 secs 2024-04-27T00:54:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:49 smithi156 ceph-mon[32679]: pgmap v13159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:54:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:51 smithi092 ceph-mon[29156]: pgmap v13160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:54:52.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:51 smithi189 ceph-mon[32756]: pgmap v13160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:54:52.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:51 smithi156 ceph-mon[32679]: pgmap v13160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:54:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:53 smithi092 ceph-mon[29156]: pgmap v13161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:53 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23789.732987 secs 2024-04-27T00:54:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:53 smithi189 ceph-mon[32756]: pgmap v13161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:53 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23789.732987 secs 2024-04-27T00:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:53 smithi156 ceph-mon[32679]: pgmap v13161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:53 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23789.732987 secs 2024-04-27T00:54:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23092.702008 secs 2024-04-27T00:54:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23092.702008 secs 2024-04-27T00:54:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23092.702008 secs 2024-04-27T00:54:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:55 smithi092 ceph-mon[29156]: pgmap v13162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:55 smithi189 ceph-mon[32756]: pgmap v13162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:55 smithi156 ceph-mon[32679]: pgmap v13162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:54:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:57 smithi092 ceph-mon[29156]: pgmap v13163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:57 smithi189 ceph-mon[32756]: pgmap v13163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:58.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:57 smithi156 ceph-mon[32679]: pgmap v13163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:54:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23794.733050 secs 2024-04-27T00:54:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23794.733050 secs 2024-04-27T00:54:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23794.733050 secs 2024-04-27T00:55:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23097.702146 secs 2024-04-27T00:55:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:54:59 smithi092 ceph-mon[29156]: pgmap v13164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23097.702146 secs 2024-04-27T00:55:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:54:59 smithi189 ceph-mon[32756]: pgmap v13164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23097.702146 secs 2024-04-27T00:55:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:54:59 smithi156 ceph-mon[32679]: pgmap v13164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:01 smithi092 ceph-mon[29156]: pgmap v13165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:02.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:01 smithi189 ceph-mon[32756]: pgmap v13165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:02.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:01 smithi156 ceph-mon[32679]: pgmap v13165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:03 smithi189 ceph-mon[32756]: pgmap v13166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23799.733124 secs 2024-04-27T00:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:03 smithi156 ceph-mon[32679]: pgmap v13166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23799.733124 secs 2024-04-27T00:55:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:03 smithi092 ceph-mon[29156]: pgmap v13166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23799.733124 secs 2024-04-27T00:55:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23102.702284 secs 2024-04-27T00:55:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23102.702284 secs 2024-04-27T00:55:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23102.702284 secs 2024-04-27T00:55:06.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:06 smithi189 ceph-mon[32756]: pgmap v13167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:06.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:06 smithi156 ceph-mon[32679]: pgmap v13167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:06.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:06 smithi092 ceph-mon[29156]: pgmap v13167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:08.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:08 smithi189 ceph-mon[32756]: pgmap v13168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:08.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:08 smithi156 ceph-mon[32679]: pgmap v13168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:08.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:08 smithi092 ceph-mon[29156]: pgmap v13168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23804.733248 secs 2024-04-27T00:55:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23804.733248 secs 2024-04-27T00:55:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23804.733248 secs 2024-04-27T00:55:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23107.702401 secs 2024-04-27T00:55:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:10 smithi092 ceph-mon[29156]: pgmap v13169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:10.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23107.702401 secs 2024-04-27T00:55:10.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:10 smithi189 ceph-mon[32756]: pgmap v13169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23107.702401 secs 2024-04-27T00:55:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:10 smithi156 ceph-mon[32679]: pgmap v13169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:12 smithi189 ceph-mon[32756]: pgmap v13170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:12 smithi156 ceph-mon[32679]: pgmap v13170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:12.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:12 smithi092 ceph-mon[29156]: pgmap v13170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:14 smithi189 ceph-mon[32756]: pgmap v13171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23809.733342 secs 2024-04-27T00:55:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:14 smithi156 ceph-mon[32679]: pgmap v13171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23809.733342 secs 2024-04-27T00:55:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:14 smithi092 ceph-mon[29156]: pgmap v13171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23809.733342 secs 2024-04-27T00:55:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23112.702518 secs 2024-04-27T00:55:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23112.702518 secs 2024-04-27T00:55:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23112.702518 secs 2024-04-27T00:55:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:16 smithi189 ceph-mon[32756]: pgmap v13172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:16 smithi156 ceph-mon[32679]: pgmap v13172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:16.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:16 smithi092 ceph-mon[29156]: pgmap v13172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:18 smithi189 ceph-mon[32756]: pgmap v13173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:18 smithi156 ceph-mon[32679]: pgmap v13173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:18 smithi092 ceph-mon[29156]: pgmap v13173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23814.733460 secs 2024-04-27T00:55:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23814.733460 secs 2024-04-27T00:55:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23814.733460 secs 2024-04-27T00:55:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23117.702644 secs 2024-04-27T00:55:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:20 smithi189 ceph-mon[32756]: pgmap v13174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23117.702644 secs 2024-04-27T00:55:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:20 smithi156 ceph-mon[32679]: pgmap v13174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23117.702644 secs 2024-04-27T00:55:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:20 smithi092 ceph-mon[29156]: pgmap v13174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:22 smithi189 ceph-mon[32756]: pgmap v13175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:22 smithi156 ceph-mon[32679]: pgmap v13175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:22.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:22 smithi092 ceph-mon[29156]: pgmap v13175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:24 smithi189 ceph-mon[32756]: pgmap v13176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23819.733592 secs 2024-04-27T00:55:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:24 smithi156 ceph-mon[32679]: pgmap v13176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23819.733592 secs 2024-04-27T00:55:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:24 smithi092 ceph-mon[29156]: pgmap v13176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23819.733592 secs 2024-04-27T00:55:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23122.702767 secs 2024-04-27T00:55:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23122.702767 secs 2024-04-27T00:55:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23122.702767 secs 2024-04-27T00:55:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:26 smithi189 ceph-mon[32756]: pgmap v13177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:26 smithi156 ceph-mon[32679]: pgmap v13177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:26 smithi092 ceph-mon[29156]: pgmap v13177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:28 smithi189 ceph-mon[32756]: pgmap v13178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:28 smithi156 ceph-mon[32679]: pgmap v13178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:28 smithi092 ceph-mon[29156]: pgmap v13178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:29.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23824.733711 secs 2024-04-27T00:55:29.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23824.733711 secs 2024-04-27T00:55:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23824.733711 secs 2024-04-27T00:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23127.702887 secs 2024-04-27T00:55:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:30 smithi189 ceph-mon[32756]: pgmap v13179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23127.702887 secs 2024-04-27T00:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:30 smithi156 ceph-mon[32679]: pgmap v13179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23127.702887 secs 2024-04-27T00:55:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:30 smithi092 ceph-mon[29156]: pgmap v13179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:32 smithi189 ceph-mon[32756]: pgmap v13180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:32.456 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:32 smithi156 ceph-mon[32679]: pgmap v13180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:32 smithi092 ceph-mon[29156]: pgmap v13180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:34 smithi189 ceph-mon[32756]: pgmap v13181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23829.733778 secs 2024-04-27T00:55:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:34 smithi156 ceph-mon[32679]: pgmap v13181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23829.733778 secs 2024-04-27T00:55:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:34 smithi092 ceph-mon[29156]: pgmap v13181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23829.733778 secs 2024-04-27T00:55:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23132.703043 secs 2024-04-27T00:55:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23132.703043 secs 2024-04-27T00:55:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23132.703043 secs 2024-04-27T00:55:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:36 smithi189 ceph-mon[32756]: pgmap v13182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:36 smithi156 ceph-mon[32679]: pgmap v13182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:36 smithi092 ceph-mon[29156]: pgmap v13182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:55:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:55:37.092+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:55:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:55:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:55:37.092+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:55:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:55:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:55:37.092+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:55:37.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:55:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:55:37.092+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:55:37.494 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 00:55:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T00:55:37.092+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T00:55:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:38 smithi189 ceph-mon[32756]: pgmap v13183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:38 smithi156 ceph-mon[32679]: pgmap v13183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:38 smithi092 ceph-mon[29156]: pgmap v13183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23834.733897 secs 2024-04-27T00:55:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23834.733897 secs 2024-04-27T00:55:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23834.733897 secs 2024-04-27T00:55:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23137.703096 secs 2024-04-27T00:55:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:40 smithi189 ceph-mon[32756]: pgmap v13184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-27T00:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23137.703096 secs 2024-04-27T00:55:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:40 smithi156 ceph-mon[32679]: pgmap v13184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-27T00:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23137.703096 secs 2024-04-27T00:55:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:40 smithi092 ceph-mon[29156]: pgmap v13184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-04-27T00:55:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:55:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:55:41.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:55:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:42 smithi189 ceph-mon[32756]: pgmap v13185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-27T00:55:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:55:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:55:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:55:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:42 smithi156 ceph-mon[32679]: pgmap v13185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-27T00:55:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:55:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:55:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:55:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:42 smithi092 ceph-mon[29156]: pgmap v13185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-04-27T00:55:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:55:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:55:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:55:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:43 smithi189 ceph-mon[32756]: pgmap v13186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 571 B/s wr, 4 op/s 2024-04-27T00:55:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:43 smithi189 ceph-mon[32756]: pgmap v13187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:43 smithi156 ceph-mon[32679]: pgmap v13186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 571 B/s wr, 4 op/s 2024-04-27T00:55:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:43 smithi156 ceph-mon[32679]: pgmap v13187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:43 smithi092 ceph-mon[29156]: pgmap v13186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 571 B/s wr, 4 op/s 2024-04-27T00:55:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:43 smithi092 ceph-mon[29156]: pgmap v13187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23839.734007 secs 2024-04-27T00:55:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23839.734007 secs 2024-04-27T00:55:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23839.734007 secs 2024-04-27T00:55:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:45 smithi189 ceph-mon[32756]: pgmap v13188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23142.703169 secs 2024-04-27T00:55:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:45 smithi156 ceph-mon[32679]: pgmap v13188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23142.703169 secs 2024-04-27T00:55:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:45 smithi092 ceph-mon[29156]: pgmap v13188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23142.703169 secs 2024-04-27T00:55:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:47 smithi189 ceph-mon[32756]: pgmap v13189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:47 smithi156 ceph-mon[32679]: pgmap v13189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:47.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:47 smithi092 ceph-mon[29156]: pgmap v13189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 701 B/s wr, 5 op/s 2024-04-27T00:55:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:49 smithi189 ceph-mon[32756]: pgmap v13190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:55:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23844.734098 secs 2024-04-27T00:55:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:49 smithi156 ceph-mon[32679]: pgmap v13190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:55:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23844.734098 secs 2024-04-27T00:55:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:49 smithi092 ceph-mon[29156]: pgmap v13190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:55:49.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23844.734098 secs 2024-04-27T00:55:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23147.703287 secs 2024-04-27T00:55:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23147.703287 secs 2024-04-27T00:55:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23147.703287 secs 2024-04-27T00:55:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:51 smithi189 ceph-mon[32756]: pgmap v13191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:55:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:51 smithi156 ceph-mon[32679]: pgmap v13191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:55:51.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:51 smithi092 ceph-mon[29156]: pgmap v13191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:55:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:53 smithi189 ceph-mon[32756]: pgmap v13192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:55:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:53 smithi156 ceph-mon[32679]: pgmap v13192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:55:53.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:53 smithi092 ceph-mon[29156]: pgmap v13192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:55:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23849.734220 secs 2024-04-27T00:55:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23849.734220 secs 2024-04-27T00:55:54.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23849.734220 secs 2024-04-27T00:55:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:55 smithi189 ceph-mon[32756]: pgmap v13193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23152.703431 secs 2024-04-27T00:55:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:55 smithi156 ceph-mon[32679]: pgmap v13193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23152.703431 secs 2024-04-27T00:55:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:55 smithi092 ceph-mon[29156]: pgmap v13193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:55:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23152.703431 secs 2024-04-27T00:55:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:57 smithi092 ceph-mon[29156]: pgmap v13194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:57 smithi156 ceph-mon[32679]: pgmap v13194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:57 smithi189 ceph-mon[32756]: pgmap v13194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:59 smithi156 ceph-mon[32679]: pgmap v13195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:55:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23854.734340 secs 2024-04-27T00:55:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:59 smithi092 ceph-mon[29156]: pgmap v13195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:59.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:55:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23854.734340 secs 2024-04-27T00:55:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:59 smithi189 ceph-mon[32756]: pgmap v13195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:55:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:55:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23854.734340 secs 2024-04-27T00:56:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23157.703505 secs 2024-04-27T00:56:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23157.703505 secs 2024-04-27T00:56:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23157.703505 secs 2024-04-27T00:56:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:01 smithi156 ceph-mon[32679]: pgmap v13196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:01.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:01 smithi092 ceph-mon[29156]: pgmap v13196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:01.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:01 smithi189 ceph-mon[32756]: pgmap v13196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:03 smithi156 ceph-mon[32679]: pgmap v13197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:03.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:03 smithi092 ceph-mon[29156]: pgmap v13197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:03.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:03 smithi189 ceph-mon[32756]: pgmap v13197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23859.734463 secs 2024-04-27T00:56:04.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23859.734463 secs 2024-04-27T00:56:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23859.734463 secs 2024-04-27T00:56:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:05 smithi156 ceph-mon[32679]: pgmap v13198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23162.703629 secs 2024-04-27T00:56:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:05 smithi092 ceph-mon[29156]: pgmap v13198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23162.703629 secs 2024-04-27T00:56:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:05 smithi189 ceph-mon[32756]: pgmap v13198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23162.703629 secs 2024-04-27T00:56:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:07 smithi156 ceph-mon[32679]: pgmap v13199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:07 smithi092 ceph-mon[29156]: pgmap v13199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:07 smithi189 ceph-mon[32756]: pgmap v13199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:09 smithi156 ceph-mon[32679]: pgmap v13200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23864.734580 secs 2024-04-27T00:56:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:09 smithi092 ceph-mon[29156]: pgmap v13200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23864.734580 secs 2024-04-27T00:56:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:09 smithi189 ceph-mon[32756]: pgmap v13200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23864.734580 secs 2024-04-27T00:56:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23167.703765 secs 2024-04-27T00:56:10.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23167.703765 secs 2024-04-27T00:56:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23167.703765 secs 2024-04-27T00:56:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:11 smithi092 ceph-mon[29156]: pgmap v13201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:11.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:11 smithi189 ceph-mon[32756]: pgmap v13201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:11 smithi156 ceph-mon[32679]: pgmap v13201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:13 smithi092 ceph-mon[29156]: pgmap v13202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:13.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:13 smithi189 ceph-mon[32756]: pgmap v13202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:13.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:13 smithi156 ceph-mon[32679]: pgmap v13202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23869.734690 secs 2024-04-27T00:56:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23869.734690 secs 2024-04-27T00:56:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23869.734690 secs 2024-04-27T00:56:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:15 smithi092 ceph-mon[29156]: pgmap v13203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23172.703888 secs 2024-04-27T00:56:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:15 smithi156 ceph-mon[32679]: pgmap v13203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:15.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23172.703888 secs 2024-04-27T00:56:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:15 smithi189 ceph-mon[32756]: pgmap v13203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23172.703888 secs 2024-04-27T00:56:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:17 smithi092 ceph-mon[29156]: pgmap v13204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:17 smithi189 ceph-mon[32756]: pgmap v13204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:17 smithi156 ceph-mon[32679]: pgmap v13204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:19 smithi092 ceph-mon[29156]: pgmap v13205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23874.734852 secs 2024-04-27T00:56:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:19 smithi189 ceph-mon[32756]: pgmap v13205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:19.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23874.734852 secs 2024-04-27T00:56:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:19 smithi156 ceph-mon[32679]: pgmap v13205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23874.734852 secs 2024-04-27T00:56:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23177.703997 secs 2024-04-27T00:56:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23177.703997 secs 2024-04-27T00:56:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23177.703997 secs 2024-04-27T00:56:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:21 smithi092 ceph-mon[29156]: pgmap v13206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:21.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:21 smithi189 ceph-mon[32756]: pgmap v13206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:21.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:21 smithi156 ceph-mon[32679]: pgmap v13206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:23.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:23 smithi092 ceph-mon[29156]: pgmap v13207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:23 smithi189 ceph-mon[32756]: pgmap v13207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:23 smithi156 ceph-mon[32679]: pgmap v13207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23879.734949 secs 2024-04-27T00:56:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23879.734949 secs 2024-04-27T00:56:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23879.734949 secs 2024-04-27T00:56:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:25 smithi092 ceph-mon[29156]: pgmap v13208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23182.704122 secs 2024-04-27T00:56:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:25 smithi189 ceph-mon[32756]: pgmap v13208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23182.704122 secs 2024-04-27T00:56:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:25 smithi156 ceph-mon[32679]: pgmap v13208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23182.704122 secs 2024-04-27T00:56:27.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:27 smithi092 ceph-mon[29156]: pgmap v13209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:27.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:27 smithi189 ceph-mon[32756]: pgmap v13209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:27 smithi156 ceph-mon[32679]: pgmap v13209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:29 smithi092 ceph-mon[29156]: pgmap v13210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:29.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23884.735014 secs 2024-04-27T00:56:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:29 smithi189 ceph-mon[32756]: pgmap v13210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23884.735014 secs 2024-04-27T00:56:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:29 smithi156 ceph-mon[32679]: pgmap v13210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23884.735014 secs 2024-04-27T00:56:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23187.704234 secs 2024-04-27T00:56:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23187.704234 secs 2024-04-27T00:56:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23187.704234 secs 2024-04-27T00:56:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:31 smithi092 ceph-mon[29156]: pgmap v13211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:31.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:31 smithi189 ceph-mon[32756]: pgmap v13211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:31 smithi156 ceph-mon[32679]: pgmap v13211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:33.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:33 smithi092 ceph-mon[29156]: pgmap v13212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:33.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:33 smithi189 ceph-mon[32756]: pgmap v13212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:33 smithi156 ceph-mon[32679]: pgmap v13212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23889.735153 secs 2024-04-27T00:56:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23889.735153 secs 2024-04-27T00:56:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23889.735153 secs 2024-04-27T00:56:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:35 smithi092 ceph-mon[29156]: pgmap v13213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23192.704363 secs 2024-04-27T00:56:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:35 smithi189 ceph-mon[32756]: pgmap v13213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23192.704363 secs 2024-04-27T00:56:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:35 smithi156 ceph-mon[32679]: pgmap v13213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23192.704363 secs 2024-04-27T00:56:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:37 smithi189 ceph-mon[32756]: pgmap v13214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:37 smithi156 ceph-mon[32679]: pgmap v13214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:37 smithi092 ceph-mon[29156]: pgmap v13214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:39 smithi189 ceph-mon[32756]: pgmap v13215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:39 smithi189 ceph-mon[32756]: 8 slow requests, 1 included below; oldest blocked for > 23894.735265 secs 2024-04-27T00:56:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:39 smithi189 ceph-mon[32756]: slow request 361.618131 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:56:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:39 smithi156 ceph-mon[32679]: pgmap v13215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:39 smithi156 ceph-mon[32679]: 8 slow requests, 1 included below; oldest blocked for > 23894.735265 secs 2024-04-27T00:56:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:39 smithi156 ceph-mon[32679]: slow request 361.618131 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:39 smithi092 ceph-mon[29156]: pgmap v13215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:39 smithi092 ceph-mon[29156]: 8 slow requests, 1 included below; oldest blocked for > 23894.735265 secs 2024-04-27T00:56:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:39 smithi092 ceph-mon[29156]: slow request 361.618131 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:56:40.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23197.704426 secs 2024-04-27T00:56:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23197.704426 secs 2024-04-27T00:56:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23197.704426 secs 2024-04-27T00:56:41.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:41 smithi189 ceph-mon[32756]: pgmap v13216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:41 smithi156 ceph-mon[32679]: pgmap v13216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:41 smithi092 ceph-mon[29156]: pgmap v13216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:56:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:56:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:56:43.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:43 smithi189 ceph-mon[32756]: pgmap v13217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:56:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:56:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:56:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:43 smithi156 ceph-mon[32679]: pgmap v13217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:56:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:56:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:56:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:43 smithi092 ceph-mon[29156]: pgmap v13217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:56:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:56:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:56:44.604 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:44 smithi092 ceph-mon[29156]: pgmap v13218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:44.604 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23899.735357 secs 2024-04-27T00:56:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:44 smithi189 ceph-mon[32756]: pgmap v13218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23899.735357 secs 2024-04-27T00:56:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:44 smithi156 ceph-mon[32679]: pgmap v13218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23899.735357 secs 2024-04-27T00:56:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23202.704521 secs 2024-04-27T00:56:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23202.704521 secs 2024-04-27T00:56:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23202.704521 secs 2024-04-27T00:56:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:46 smithi189 ceph-mon[32756]: pgmap v13219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:46 smithi156 ceph-mon[32679]: pgmap v13219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:46 smithi092 ceph-mon[29156]: pgmap v13219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:48 smithi189 ceph-mon[32756]: pgmap v13220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:48 smithi156 ceph-mon[32679]: pgmap v13220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:48 smithi092 ceph-mon[29156]: pgmap v13220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23904.735469 secs 2024-04-27T00:56:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23904.735469 secs 2024-04-27T00:56:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23904.735469 secs 2024-04-27T00:56:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:50 smithi189 ceph-mon[32756]: pgmap v13221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23207.704622 secs 2024-04-27T00:56:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:50 smithi156 ceph-mon[32679]: pgmap v13221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23207.704622 secs 2024-04-27T00:56:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:50 smithi092 ceph-mon[29156]: pgmap v13221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23207.704622 secs 2024-04-27T00:56:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:52 smithi189 ceph-mon[32756]: pgmap v13222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:52 smithi156 ceph-mon[32679]: pgmap v13222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:52 smithi092 ceph-mon[29156]: pgmap v13222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:54 smithi189 ceph-mon[32756]: pgmap v13223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23909.735603 secs 2024-04-27T00:56:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:54 smithi156 ceph-mon[32679]: pgmap v13223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23909.735603 secs 2024-04-27T00:56:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:54 smithi092 ceph-mon[29156]: pgmap v13223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:56:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23909.735603 secs 2024-04-27T00:56:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23212.704767 secs 2024-04-27T00:56:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23212.704767 secs 2024-04-27T00:56:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23212.704767 secs 2024-04-27T00:56:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:56 smithi189 ceph-mon[32756]: pgmap v13224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:56 smithi156 ceph-mon[32679]: pgmap v13224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:56 smithi092 ceph-mon[29156]: pgmap v13224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:56:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:58 smithi189 ceph-mon[32756]: pgmap v13225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:58 smithi156 ceph-mon[32679]: pgmap v13225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:58 smithi092 ceph-mon[29156]: pgmap v13225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:56:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:56:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23914.735716 secs 2024-04-27T00:56:59.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:56:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23914.735716 secs 2024-04-27T00:56:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:56:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23914.735716 secs 2024-04-27T00:57:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:00 smithi189 ceph-mon[32756]: pgmap v13226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23217.704831 secs 2024-04-27T00:57:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:00 smithi156 ceph-mon[32679]: pgmap v13226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23217.704831 secs 2024-04-27T00:57:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:00 smithi092 ceph-mon[29156]: pgmap v13226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23217.704831 secs 2024-04-27T00:57:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:02 smithi189 ceph-mon[32756]: pgmap v13227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:02 smithi156 ceph-mon[32679]: pgmap v13227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:02 smithi092 ceph-mon[29156]: pgmap v13227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:04 smithi189 ceph-mon[32756]: pgmap v13228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23919.735849 secs 2024-04-27T00:57:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:04 smithi156 ceph-mon[32679]: pgmap v13228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23919.735849 secs 2024-04-27T00:57:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:04 smithi092 ceph-mon[29156]: pgmap v13228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23919.735849 secs 2024-04-27T00:57:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23222.704936 secs 2024-04-27T00:57:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23222.704936 secs 2024-04-27T00:57:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23222.704936 secs 2024-04-27T00:57:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:06 smithi189 ceph-mon[32756]: pgmap v13229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:06 smithi156 ceph-mon[32679]: pgmap v13229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:06 smithi092 ceph-mon[29156]: pgmap v13229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:07.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:07 smithi189 ceph-mon[32756]: pgmap v13230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:07 smithi156 ceph-mon[32679]: pgmap v13230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:07 smithi092 ceph-mon[29156]: pgmap v13230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:09.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:09 smithi189 ceph-mon[32756]: pgmap v13231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23924.735965 secs 2024-04-27T00:57:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:09 smithi156 ceph-mon[32679]: pgmap v13231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23924.735965 secs 2024-04-27T00:57:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:09 smithi092 ceph-mon[29156]: pgmap v13231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23924.735965 secs 2024-04-27T00:57:10.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23227.705030 secs 2024-04-27T00:57:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23227.705030 secs 2024-04-27T00:57:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23227.705030 secs 2024-04-27T00:57:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:11 smithi092 ceph-mon[29156]: pgmap v13232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:11 smithi189 ceph-mon[32756]: pgmap v13232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:12.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:11 smithi156 ceph-mon[32679]: pgmap v13232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:13 smithi189 ceph-mon[32756]: pgmap v13233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23929.736095 secs 2024-04-27T00:57:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:13 smithi156 ceph-mon[32679]: pgmap v13233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:14.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23929.736095 secs 2024-04-27T00:57:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:13 smithi092 ceph-mon[29156]: pgmap v13233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:14.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23929.736095 secs 2024-04-27T00:57:15.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23232.705163 secs 2024-04-27T00:57:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23232.705163 secs 2024-04-27T00:57:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23232.705163 secs 2024-04-27T00:57:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:16 smithi092 ceph-mon[29156]: pgmap v13234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:16 smithi189 ceph-mon[32756]: pgmap v13234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:16 smithi156 ceph-mon[32679]: pgmap v13234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:18.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:18 smithi189 ceph-mon[32756]: pgmap v13235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:18.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:18 smithi156 ceph-mon[32679]: pgmap v13235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:18.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:18 smithi092 ceph-mon[29156]: pgmap v13235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23934.736212 secs 2024-04-27T00:57:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23934.736212 secs 2024-04-27T00:57:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23934.736212 secs 2024-04-27T00:57:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:20 smithi189 ceph-mon[32756]: pgmap v13236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23237.705310 secs 2024-04-27T00:57:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:20 smithi156 ceph-mon[32679]: pgmap v13236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23237.705310 secs 2024-04-27T00:57:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:20 smithi092 ceph-mon[29156]: pgmap v13236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23237.705310 secs 2024-04-27T00:57:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:22 smithi189 ceph-mon[32756]: pgmap v13237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:22.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:22 smithi156 ceph-mon[32679]: pgmap v13237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:22 smithi092 ceph-mon[29156]: pgmap v13237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:24 smithi189 ceph-mon[32756]: pgmap v13238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23939.736334 secs 2024-04-27T00:57:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:24 smithi156 ceph-mon[32679]: pgmap v13238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:24.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23939.736334 secs 2024-04-27T00:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:24 smithi092 ceph-mon[29156]: pgmap v13238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23939.736334 secs 2024-04-27T00:57:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23242.705416 secs 2024-04-27T00:57:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23242.705416 secs 2024-04-27T00:57:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23242.705416 secs 2024-04-27T00:57:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:26 smithi189 ceph-mon[32756]: pgmap v13239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:26 smithi156 ceph-mon[32679]: pgmap v13239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:26 smithi092 ceph-mon[29156]: pgmap v13239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:28 smithi189 ceph-mon[32756]: pgmap v13240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:28 smithi156 ceph-mon[32679]: pgmap v13240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:28 smithi092 ceph-mon[29156]: pgmap v13240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23944.736430 secs 2024-04-27T00:57:29.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23944.736430 secs 2024-04-27T00:57:29.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23944.736430 secs 2024-04-27T00:57:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:30 smithi189 ceph-mon[32756]: pgmap v13241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23247.705541 secs 2024-04-27T00:57:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:30 smithi156 ceph-mon[32679]: pgmap v13241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23247.705541 secs 2024-04-27T00:57:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:30 smithi092 ceph-mon[29156]: pgmap v13241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23247.705541 secs 2024-04-27T00:57:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:32 smithi189 ceph-mon[32756]: pgmap v13242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:32.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:32 smithi156 ceph-mon[32679]: pgmap v13242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:32 smithi092 ceph-mon[29156]: pgmap v13242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:34 smithi189 ceph-mon[32756]: pgmap v13243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23949.736544 secs 2024-04-27T00:57:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:34 smithi156 ceph-mon[32679]: pgmap v13243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:34.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23949.736544 secs 2024-04-27T00:57:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:34 smithi092 ceph-mon[29156]: pgmap v13243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23949.736544 secs 2024-04-27T00:57:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23252.705665 secs 2024-04-27T00:57:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23252.705665 secs 2024-04-27T00:57:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23252.705665 secs 2024-04-27T00:57:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:36 smithi189 ceph-mon[32756]: pgmap v13244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:36.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:36 smithi156 ceph-mon[32679]: pgmap v13244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:36 smithi092 ceph-mon[29156]: pgmap v13244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:38 smithi189 ceph-mon[32756]: pgmap v13245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:38.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:38 smithi156 ceph-mon[32679]: pgmap v13245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:38 smithi092 ceph-mon[29156]: pgmap v13245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:57:39.269+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:57:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:57:39.269+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:57:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:57:39.269+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T00:57:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T00:57:39.269+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 186 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T00:57:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23954.736679 secs 2024-04-27T00:57:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23954.736679 secs 2024-04-27T00:57:39.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23954.736679 secs 2024-04-27T00:57:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:40 smithi189 ceph-mon[32756]: pgmap v13246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23257.705818 secs 2024-04-27T00:57:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:40 smithi156 ceph-mon[32679]: pgmap v13246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23257.705818 secs 2024-04-27T00:57:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:40 smithi092 ceph-mon[29156]: pgmap v13246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23257.705818 secs 2024-04-27T00:57:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:42 smithi189 ceph-mon[32756]: pgmap v13247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:42 smithi156 ceph-mon[32679]: pgmap v13247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:42 smithi092 ceph-mon[29156]: pgmap v13247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:57:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:57:43.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: pgmap v13248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: pgmap v13249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: pgmap v13250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:57:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23959.736792 secs 2024-04-27T00:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: pgmap v13248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:57:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: pgmap v13249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:57:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: pgmap v13250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:57:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:57:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23959.736792 secs 2024-04-27T00:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: pgmap v13248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: pgmap v13249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:57:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: pgmap v13250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:57:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:57:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23959.736792 secs 2024-04-27T00:57:45.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23262.705914 secs 2024-04-27T00:57:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23262.705914 secs 2024-04-27T00:57:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23262.705914 secs 2024-04-27T00:57:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:46 smithi189 ceph-mon[32756]: pgmap v13251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:46 smithi156 ceph-mon[32679]: pgmap v13251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:46 smithi092 ceph-mon[29156]: pgmap v13251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:48 smithi189 ceph-mon[32756]: pgmap v13252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:48 smithi156 ceph-mon[32679]: pgmap v13252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:48 smithi092 ceph-mon[29156]: pgmap v13252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23964.736912 secs 2024-04-27T00:57:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23964.736912 secs 2024-04-27T00:57:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23964.736912 secs 2024-04-27T00:57:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23267.706047 secs 2024-04-27T00:57:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:50 smithi189 ceph-mon[32756]: pgmap v13253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23267.706047 secs 2024-04-27T00:57:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:50 smithi156 ceph-mon[32679]: pgmap v13253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23267.706047 secs 2024-04-27T00:57:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:50 smithi092 ceph-mon[29156]: pgmap v13253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:52 smithi189 ceph-mon[32756]: pgmap v13254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:52 smithi156 ceph-mon[32679]: pgmap v13254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:52 smithi092 ceph-mon[29156]: pgmap v13254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:57:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:54 smithi189 ceph-mon[32756]: pgmap v13255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:57:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23969.737024 secs 2024-04-27T00:57:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:54 smithi156 ceph-mon[32679]: pgmap v13255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:57:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23969.737024 secs 2024-04-27T00:57:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:54 smithi092 ceph-mon[29156]: pgmap v13255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:57:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23969.737024 secs 2024-04-27T00:57:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23272.706180 secs 2024-04-27T00:57:55.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23272.706180 secs 2024-04-27T00:57:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23272.706180 secs 2024-04-27T00:57:56.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:56 smithi189 ceph-mon[32756]: pgmap v13256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:56 smithi156 ceph-mon[32679]: pgmap v13256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:56 smithi092 ceph-mon[29156]: pgmap v13256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:57:58.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:58 smithi189 ceph-mon[32756]: pgmap v13257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:58 smithi156 ceph-mon[32679]: pgmap v13257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:58 smithi092 ceph-mon[29156]: pgmap v13257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:57:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:57:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23974.737104 secs 2024-04-27T00:57:59.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:57:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23974.737104 secs 2024-04-27T00:57:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:57:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23974.737104 secs 2024-04-27T00:58:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23277.706323 secs 2024-04-27T00:58:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:00 smithi189 ceph-mon[32756]: pgmap v13258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23277.706323 secs 2024-04-27T00:58:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:00 smithi156 ceph-mon[32679]: pgmap v13258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23277.706323 secs 2024-04-27T00:58:00.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:00 smithi092 ceph-mon[29156]: pgmap v13258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:02 smithi189 ceph-mon[32756]: pgmap v13259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:02.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:02 smithi156 ceph-mon[32679]: pgmap v13259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:02 smithi092 ceph-mon[29156]: pgmap v13259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:04.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:04 smithi189 ceph-mon[32756]: pgmap v13260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23979.737167 secs 2024-04-27T00:58:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:04 smithi156 ceph-mon[32679]: pgmap v13260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23979.737167 secs 2024-04-27T00:58:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:04 smithi092 ceph-mon[29156]: pgmap v13260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23979.737167 secs 2024-04-27T00:58:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23282.706392 secs 2024-04-27T00:58:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:05 smithi189 ceph-mon[32756]: pgmap v13261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23282.706392 secs 2024-04-27T00:58:05.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:05 smithi156 ceph-mon[32679]: pgmap v13261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23282.706392 secs 2024-04-27T00:58:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:05 smithi092 ceph-mon[29156]: pgmap v13261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:08 smithi189 ceph-mon[32756]: pgmap v13262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:08 smithi156 ceph-mon[32679]: pgmap v13262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:08 smithi092 ceph-mon[29156]: pgmap v13262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:09.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23984.737263 secs 2024-04-27T00:58:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23984.737263 secs 2024-04-27T00:58:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23984.737263 secs 2024-04-27T00:58:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23287.706479 secs 2024-04-27T00:58:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:10 smithi189 ceph-mon[32756]: pgmap v13263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23287.706479 secs 2024-04-27T00:58:10.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:10 smithi156 ceph-mon[32679]: pgmap v13263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23287.706479 secs 2024-04-27T00:58:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:10 smithi092 ceph-mon[29156]: pgmap v13263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:12 smithi189 ceph-mon[32756]: pgmap v13264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:12 smithi156 ceph-mon[32679]: pgmap v13264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:12 smithi092 ceph-mon[29156]: pgmap v13264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:14 smithi189 ceph-mon[32756]: pgmap v13265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23989.737380 secs 2024-04-27T00:58:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:14 smithi156 ceph-mon[32679]: pgmap v13265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23989.737380 secs 2024-04-27T00:58:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:14 smithi092 ceph-mon[29156]: pgmap v13265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23989.737380 secs 2024-04-27T00:58:15.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23292.706555 secs 2024-04-27T00:58:15.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23292.706555 secs 2024-04-27T00:58:15.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23292.706555 secs 2024-04-27T00:58:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:16 smithi189 ceph-mon[32756]: pgmap v13266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:16 smithi156 ceph-mon[32679]: pgmap v13266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:16 smithi092 ceph-mon[29156]: pgmap v13266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:18 smithi189 ceph-mon[32756]: pgmap v13267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:18 smithi156 ceph-mon[32679]: pgmap v13267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:18 smithi092 ceph-mon[29156]: pgmap v13267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23994.737499 secs 2024-04-27T00:58:19.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23994.737499 secs 2024-04-27T00:58:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23994.737499 secs 2024-04-27T00:58:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23297.706662 secs 2024-04-27T00:58:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:20 smithi189 ceph-mon[32756]: pgmap v13268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23297.706662 secs 2024-04-27T00:58:20.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:20 smithi156 ceph-mon[32679]: pgmap v13268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23297.706662 secs 2024-04-27T00:58:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:20 smithi092 ceph-mon[29156]: pgmap v13268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:22 smithi189 ceph-mon[32756]: pgmap v13269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:22 smithi156 ceph-mon[32679]: pgmap v13269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:22 smithi092 ceph-mon[29156]: pgmap v13269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:24 smithi189 ceph-mon[32756]: pgmap v13270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 23999.737616 secs 2024-04-27T00:58:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:24 smithi156 ceph-mon[32679]: pgmap v13270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 23999.737616 secs 2024-04-27T00:58:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:24 smithi092 ceph-mon[29156]: pgmap v13270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 23999.737616 secs 2024-04-27T00:58:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23302.706825 secs 2024-04-27T00:58:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23302.706825 secs 2024-04-27T00:58:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23302.706825 secs 2024-04-27T00:58:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:26 smithi189 ceph-mon[32756]: pgmap v13271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:26 smithi156 ceph-mon[32679]: pgmap v13271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:26 smithi092 ceph-mon[29156]: pgmap v13271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:27 smithi189 ceph-mon[32756]: pgmap v13272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:27 smithi156 ceph-mon[32679]: pgmap v13272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:27 smithi092 ceph-mon[29156]: pgmap v13272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:28 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24004.737754 secs 2024-04-27T00:58:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:28 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24004.737754 secs 2024-04-27T00:58:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:28 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24004.737754 secs 2024-04-27T00:58:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23307.706948 secs 2024-04-27T00:58:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:29 smithi156 ceph-mon[32679]: pgmap v13273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23307.706948 secs 2024-04-27T00:58:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:29 smithi092 ceph-mon[29156]: pgmap v13273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23307.706948 secs 2024-04-27T00:58:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:29 smithi189 ceph-mon[32756]: pgmap v13273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:32 smithi189 ceph-mon[32756]: pgmap v13274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:32 smithi156 ceph-mon[32679]: pgmap v13274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:32 smithi092 ceph-mon[29156]: pgmap v13274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:34 smithi189 ceph-mon[32756]: pgmap v13275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24009.737894 secs 2024-04-27T00:58:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:34 smithi156 ceph-mon[32679]: pgmap v13275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24009.737894 secs 2024-04-27T00:58:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:34 smithi092 ceph-mon[29156]: pgmap v13275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24009.737894 secs 2024-04-27T00:58:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 23312.707062 secs 2024-04-27T00:58:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 23312.707062 secs 2024-04-27T00:58:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 23312.707062 secs 2024-04-27T00:58:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:36 smithi189 ceph-mon[32756]: pgmap v13276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:36 smithi156 ceph-mon[32679]: pgmap v13276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:36 smithi092 ceph-mon[29156]: pgmap v13276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:38 smithi189 ceph-mon[32756]: pgmap v13277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:38 smithi156 ceph-mon[32679]: pgmap v13277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:38 smithi092 ceph-mon[29156]: pgmap v13277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:39.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24014.737990 secs 2024-04-27T00:58:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24014.737990 secs 2024-04-27T00:58:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24014.737990 secs 2024-04-27T00:58:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:40 smithi189 ceph-mon[32756]: 18 slow requests, 2 included below; oldest blocked for > 23317.707219 secs 2024-04-27T00:58:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:40 smithi189 ceph-mon[32756]: slow request 1442.099380 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:58:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:40 smithi189 ceph-mon[32756]: slow request 181.751538 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:58:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:40 smithi189 ceph-mon[32756]: pgmap v13278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:40 smithi156 ceph-mon[32679]: 18 slow requests, 2 included below; oldest blocked for > 23317.707219 secs 2024-04-27T00:58:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:40 smithi156 ceph-mon[32679]: slow request 1442.099380 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:58:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:40 smithi156 ceph-mon[32679]: slow request 181.751538 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:58:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:40 smithi156 ceph-mon[32679]: pgmap v13278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:40 smithi092 ceph-mon[29156]: 18 slow requests, 2 included below; oldest blocked for > 23317.707219 secs 2024-04-27T00:58:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:40 smithi092 ceph-mon[29156]: slow request 1442.099380 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T00:58:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:40 smithi092 ceph-mon[29156]: slow request 181.751538 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T00:58:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:40 smithi092 ceph-mon[29156]: pgmap v13278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:42 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:58:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:42 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:58:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:42 smithi189 ceph-mon[32756]: pgmap v13279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:42.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:42 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:58:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:42 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:58:42.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:42 smithi156 ceph-mon[32679]: pgmap v13279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:42 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T00:58:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:42 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T00:58:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:42 smithi092 ceph-mon[29156]: pgmap v13279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: pgmap v13280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24019.738079 secs 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: pgmap v13280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24019.738079 secs 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: pgmap v13280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24019.738079 secs 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.691 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:44.692 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:45.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23322.707284 secs 2024-04-27T00:58:45.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23322.707284 secs 2024-04-27T00:58:45.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23322.707284 secs 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: pgmap v13281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: pgmap v13281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: pgmap v13281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:58:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:58:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:58:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:58:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T00:58:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:58:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:58:47.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:58:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:58:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: pgmap v13282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:48 smithi189 ceph-mon[32756]: pgmap v13283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:58:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:58:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:58:48.644 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:58:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:58:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: pgmap v13282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:48.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:48 smithi092 ceph-mon[29156]: pgmap v13283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: pgmap v13282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:58:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:48 smithi156 ceph-mon[32679]: pgmap v13283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T00:58:49.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24024.738191 secs 2024-04-27T00:58:49.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24024.738191 secs 2024-04-27T00:58:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24024.738191 secs 2024-04-27T00:58:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23327.707401 secs 2024-04-27T00:58:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:50 smithi189 ceph-mon[32756]: pgmap v13284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23327.707401 secs 2024-04-27T00:58:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:50 smithi156 ceph-mon[32679]: pgmap v13284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:50.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23327.707401 secs 2024-04-27T00:58:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:50 smithi092 ceph-mon[29156]: pgmap v13284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:52 smithi189 ceph-mon[32756]: pgmap v13285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:52.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:52 smithi156 ceph-mon[32679]: pgmap v13285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:52.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:52 smithi092 ceph-mon[29156]: pgmap v13285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:53.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:53 smithi189 ceph-mon[32756]: pgmap v13286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:53.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:53 smithi156 ceph-mon[32679]: pgmap v13286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:53.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:53 smithi092 ceph-mon[29156]: pgmap v13286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:54.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24029.738256 secs 2024-04-27T00:58:54.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24029.738256 secs 2024-04-27T00:58:54.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24029.738256 secs 2024-04-27T00:58:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23332.707480 secs 2024-04-27T00:58:55.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:55 smithi189 ceph-mon[32756]: pgmap v13287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:55.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23332.707480 secs 2024-04-27T00:58:55.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:55 smithi156 ceph-mon[32679]: pgmap v13287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23332.707480 secs 2024-04-27T00:58:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:55 smithi092 ceph-mon[29156]: pgmap v13287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T00:58:58.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:57 smithi092 ceph-mon[29156]: pgmap v13288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:58:58.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:57 smithi189 ceph-mon[32756]: pgmap v13288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:58:58.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:57 smithi156 ceph-mon[32679]: pgmap v13288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T00:58:59.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:58 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24034.738374 secs 2024-04-27T00:58:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:58 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24034.738374 secs 2024-04-27T00:58:59.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:58 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24034.738374 secs 2024-04-27T00:59:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23337.707550 secs 2024-04-27T00:59:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:58:59 smithi092 ceph-mon[29156]: pgmap v13289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23337.707550 secs 2024-04-27T00:59:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:58:59 smithi189 ceph-mon[32756]: pgmap v13289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23337.707550 secs 2024-04-27T00:59:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:58:59 smithi156 ceph-mon[32679]: pgmap v13289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:01 smithi092 ceph-mon[29156]: pgmap v13290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:01 smithi189 ceph-mon[32756]: pgmap v13290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:01 smithi156 ceph-mon[32679]: pgmap v13290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:04.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:03 smithi092 ceph-mon[29156]: pgmap v13291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:04.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:03 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24039.738488 secs 2024-04-27T00:59:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:03 smithi189 ceph-mon[32756]: pgmap v13291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:04.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:03 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24039.738488 secs 2024-04-27T00:59:04.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:03 smithi156 ceph-mon[32679]: pgmap v13291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:04.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:03 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24039.738488 secs 2024-04-27T00:59:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23342.707613 secs 2024-04-27T00:59:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23342.707613 secs 2024-04-27T00:59:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23342.707613 secs 2024-04-27T00:59:06.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:05 smithi092 ceph-mon[29156]: pgmap v13292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:06.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:05 smithi189 ceph-mon[32756]: pgmap v13292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:06.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:05 smithi156 ceph-mon[32679]: pgmap v13292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:08.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:07 smithi092 ceph-mon[29156]: pgmap v13293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:07 smithi189 ceph-mon[32756]: pgmap v13293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:08.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:07 smithi156 ceph-mon[32679]: pgmap v13293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:09.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:08 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24044.738584 secs 2024-04-27T00:59:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:08 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24044.738584 secs 2024-04-27T00:59:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:08 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24044.738584 secs 2024-04-27T00:59:10.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23347.707687 secs 2024-04-27T00:59:10.255 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:09 smithi092 ceph-mon[29156]: pgmap v13294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:10.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23347.707687 secs 2024-04-27T00:59:10.288 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:09 smithi189 ceph-mon[32756]: pgmap v13294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23347.707687 secs 2024-04-27T00:59:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:09 smithi156 ceph-mon[32679]: pgmap v13294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:12.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:11 smithi092 ceph-mon[29156]: pgmap v13295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:12.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:11 smithi189 ceph-mon[32756]: pgmap v13295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:12.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:11 smithi156 ceph-mon[32679]: pgmap v13295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:14.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:13 smithi092 ceph-mon[29156]: pgmap v13296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:14.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:13 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24049.738653 secs 2024-04-27T00:59:14.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:13 smithi189 ceph-mon[32756]: pgmap v13296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:13 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24049.738653 secs 2024-04-27T00:59:14.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:13 smithi156 ceph-mon[32679]: pgmap v13296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:14.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:13 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24049.738653 secs 2024-04-27T00:59:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23352.707745 secs 2024-04-27T00:59:15.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23352.707745 secs 2024-04-27T00:59:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23352.707745 secs 2024-04-27T00:59:16.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:15 smithi092 ceph-mon[29156]: pgmap v13297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:15 smithi189 ceph-mon[32756]: pgmap v13297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:16.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:15 smithi156 ceph-mon[32679]: pgmap v13297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:18.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:17 smithi092 ceph-mon[29156]: pgmap v13298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:18.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:17 smithi189 ceph-mon[32756]: pgmap v13298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:18.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:17 smithi156 ceph-mon[32679]: pgmap v13298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:19.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:18 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24054.738751 secs 2024-04-27T00:59:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:18 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24054.738751 secs 2024-04-27T00:59:19.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:18 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24054.738751 secs 2024-04-27T00:59:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23357.707816 secs 2024-04-27T00:59:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:19 smithi092 ceph-mon[29156]: pgmap v13299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23357.707816 secs 2024-04-27T00:59:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:19 smithi189 ceph-mon[32756]: pgmap v13299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23357.707816 secs 2024-04-27T00:59:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:19 smithi156 ceph-mon[32679]: pgmap v13299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:22.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:21 smithi092 ceph-mon[29156]: pgmap v13300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:22.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:21 smithi189 ceph-mon[32756]: pgmap v13300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:22.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:21 smithi156 ceph-mon[32679]: pgmap v13300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:24.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:23 smithi189 ceph-mon[32756]: pgmap v13301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:24.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:23 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24059.738864 secs 2024-04-27T00:59:24.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:23 smithi156 ceph-mon[32679]: pgmap v13301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:24.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:23 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24059.738864 secs 2024-04-27T00:59:24.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:23 smithi092 ceph-mon[29156]: pgmap v13301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:24.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:23 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24059.738864 secs 2024-04-27T00:59:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23362.707930 secs 2024-04-27T00:59:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23362.707930 secs 2024-04-27T00:59:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23362.707930 secs 2024-04-27T00:59:26.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:26 smithi189 ceph-mon[32756]: pgmap v13302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:26.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:26 smithi156 ceph-mon[32679]: pgmap v13302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:26 smithi092 ceph-mon[29156]: pgmap v13302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:28.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:28 smithi189 ceph-mon[32756]: pgmap v13303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:28.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:28 smithi156 ceph-mon[32679]: pgmap v13303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:28.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:28 smithi092 ceph-mon[29156]: pgmap v13303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24064.738960 secs 2024-04-27T00:59:29.393 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24064.738960 secs 2024-04-27T00:59:29.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24064.738960 secs 2024-04-27T00:59:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23367.708003 secs 2024-04-27T00:59:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:30 smithi189 ceph-mon[32756]: pgmap v13304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23367.708003 secs 2024-04-27T00:59:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:30 smithi156 ceph-mon[32679]: pgmap v13304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23367.708003 secs 2024-04-27T00:59:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:30 smithi092 ceph-mon[29156]: pgmap v13304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:32.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:32 smithi189 ceph-mon[32756]: pgmap v13305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:32.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:32 smithi156 ceph-mon[32679]: pgmap v13305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:32 smithi092 ceph-mon[29156]: pgmap v13305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:34.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:34 smithi189 ceph-mon[32756]: pgmap v13306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:34.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24069.739079 secs 2024-04-27T00:59:34.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:34 smithi156 ceph-mon[32679]: pgmap v13306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:34.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24069.739079 secs 2024-04-27T00:59:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:34 smithi092 ceph-mon[29156]: pgmap v13306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:34.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24069.739079 secs 2024-04-27T00:59:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23372.708078 secs 2024-04-27T00:59:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23372.708078 secs 2024-04-27T00:59:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23372.708078 secs 2024-04-27T00:59:36.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:36 smithi189 ceph-mon[32756]: pgmap v13307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:36.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:36 smithi156 ceph-mon[32679]: pgmap v13307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:36.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:36 smithi092 ceph-mon[29156]: pgmap v13307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T00:59:38.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:38 smithi189 ceph-mon[32756]: pgmap v13308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:38.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:38 smithi156 ceph-mon[32679]: pgmap v13308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:38.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:38 smithi092 ceph-mon[29156]: pgmap v13308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T00:59:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24074.739215 secs 2024-04-27T00:59:39.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24074.739215 secs 2024-04-27T00:59:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24074.739215 secs 2024-04-27T00:59:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23377.708186 secs 2024-04-27T00:59:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:40 smithi189 ceph-mon[32756]: pgmap v13309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23377.708186 secs 2024-04-27T00:59:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:40 smithi156 ceph-mon[32679]: pgmap v13309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23377.708186 secs 2024-04-27T00:59:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:40 smithi092 ceph-mon[29156]: pgmap v13309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:42.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:42 smithi189 ceph-mon[32756]: pgmap v13310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:42.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:42 smithi156 ceph-mon[32679]: pgmap v13310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:42.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:42 smithi092 ceph-mon[29156]: pgmap v13310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:44.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:44 smithi189 ceph-mon[32756]: pgmap v13311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:44.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24079.739309 secs 2024-04-27T00:59:44.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:44 smithi156 ceph-mon[32679]: pgmap v13311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:44.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24079.739309 secs 2024-04-27T00:59:44.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:44 smithi092 ceph-mon[29156]: pgmap v13311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:44.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24079.739309 secs 2024-04-27T00:59:45.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23382.708326 secs 2024-04-27T00:59:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23382.708326 secs 2024-04-27T00:59:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23382.708326 secs 2024-04-27T00:59:46.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:46 smithi189 ceph-mon[32756]: pgmap v13312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:46.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:46 smithi156 ceph-mon[32679]: pgmap v13312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:46.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:46 smithi092 ceph-mon[29156]: pgmap v13312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T00:59:47.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:59:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:59:47.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T00:59:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:48 smithi189 ceph-mon[32756]: pgmap v13313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:59:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:59:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:59:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:48 smithi156 ceph-mon[32679]: pgmap v13313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:59:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:59:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:59:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:48 smithi092 ceph-mon[29156]: pgmap v13313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T00:59:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T00:59:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T00:59:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T00:59:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:49 smithi189 ceph-mon[32756]: pgmap v13314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:59:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:49 smithi189 ceph-mon[32756]: pgmap v13315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:59:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24084.739382 secs 2024-04-27T00:59:49.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:49 smithi156 ceph-mon[32679]: pgmap v13314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:59:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:49 smithi156 ceph-mon[32679]: pgmap v13315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:59:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24084.739382 secs 2024-04-27T00:59:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:49 smithi092 ceph-mon[29156]: pgmap v13314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T00:59:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:49 smithi092 ceph-mon[29156]: pgmap v13315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T00:59:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24084.739382 secs 2024-04-27T00:59:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23387.708437 secs 2024-04-27T00:59:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23387.708437 secs 2024-04-27T00:59:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23387.708437 secs 2024-04-27T00:59:51.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:51 smithi092 ceph-mon[29156]: pgmap v13316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:51.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:51 smithi189 ceph-mon[32756]: pgmap v13316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:51.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:51 smithi156 ceph-mon[32679]: pgmap v13316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:53 smithi189 ceph-mon[32756]: pgmap v13317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:53.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:53 smithi156 ceph-mon[32679]: pgmap v13317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:53.456 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:53 smithi092 ceph-mon[29156]: pgmap v13317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:54.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24089.739517 secs 2024-04-27T00:59:54.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24089.739517 secs 2024-04-27T00:59:54.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24089.739517 secs 2024-04-27T00:59:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:55 smithi189 ceph-mon[32756]: pgmap v13318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23392.708585 secs 2024-04-27T00:59:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:55 smithi156 ceph-mon[32679]: pgmap v13318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23392.708585 secs 2024-04-27T00:59:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:55 smithi092 ceph-mon[29156]: pgmap v13318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23392.708585 secs 2024-04-27T00:59:57.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:57 smithi189 ceph-mon[32756]: pgmap v13319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:57.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:57 smithi156 ceph-mon[32679]: pgmap v13319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:57.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:57 smithi092 ceph-mon[29156]: pgmap v13319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T00:59:59.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:59 smithi189 ceph-mon[32756]: pgmap v13320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:59:59.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 00:59:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24094.739651 secs 2024-04-27T00:59:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:59 smithi156 ceph-mon[32679]: pgmap v13320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:59:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 00:59:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24094.739651 secs 2024-04-27T00:59:59.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:59 smithi092 ceph-mon[29156]: pgmap v13320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T00:59:59.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 00:59:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24094.739651 secs 2024-04-27T01:00:00.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23397.708645 secs 2024-04-27T01:00:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:00:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23397.708645 secs 2024-04-27T01:00:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:00:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23397.708645 secs 2024-04-27T01:00:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:00:01.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:01 smithi189 ceph-mon[32756]: pgmap v13321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:01.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:01 smithi156 ceph-mon[32679]: pgmap v13321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:01.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:01 smithi092 ceph-mon[29156]: pgmap v13321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:03.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:03 smithi092 ceph-mon[29156]: pgmap v13322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:03.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:03 smithi189 ceph-mon[32756]: pgmap v13322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:03 smithi156 ceph-mon[32679]: pgmap v13322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:04.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24099.739770 secs 2024-04-27T01:00:04.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24099.739770 secs 2024-04-27T01:00:04.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24099.739770 secs 2024-04-27T01:00:05.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:05 smithi189 ceph-mon[32756]: pgmap v13323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:05.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23402.708723 secs 2024-04-27T01:00:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:05 smithi156 ceph-mon[32679]: pgmap v13323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23402.708723 secs 2024-04-27T01:00:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:05 smithi092 ceph-mon[29156]: pgmap v13323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23402.708723 secs 2024-04-27T01:00:07.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:07 smithi189 ceph-mon[32756]: pgmap v13324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:07.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:07 smithi156 ceph-mon[32679]: pgmap v13324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:07.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:07 smithi092 ceph-mon[29156]: pgmap v13324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:09 smithi189 ceph-mon[32756]: pgmap v13325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24104.739891 secs 2024-04-27T01:00:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:09 smithi156 ceph-mon[32679]: pgmap v13325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24104.739891 secs 2024-04-27T01:00:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:09 smithi092 ceph-mon[29156]: pgmap v13325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24104.739891 secs 2024-04-27T01:00:10.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:10 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 23407.708877 secs 2024-04-27T01:00:10.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:10 smithi189 ceph-mon[32756]: slow request 11524.690368 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:00:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:10 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 23407.708877 secs 2024-04-27T01:00:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:10 smithi156 ceph-mon[32679]: slow request 11524.690368 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:00:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:10 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 23407.708877 secs 2024-04-27T01:00:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:10 smithi092 ceph-mon[29156]: slow request 11524.690368 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:00:11.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:11 smithi189 ceph-mon[32756]: pgmap v13326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:11 smithi156 ceph-mon[32679]: pgmap v13326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:11 smithi092 ceph-mon[29156]: pgmap v13326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:13.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:13 smithi189 ceph-mon[32756]: pgmap v13327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:13 smithi156 ceph-mon[32679]: pgmap v13327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:13 smithi092 ceph-mon[29156]: pgmap v13327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:14.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24109.740002 secs 2024-04-27T01:00:14.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24109.740002 secs 2024-04-27T01:00:14.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24109.740002 secs 2024-04-27T01:00:15.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:15 smithi189 ceph-mon[32756]: pgmap v13328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:15.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23412.708967 secs 2024-04-27T01:00:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:15 smithi156 ceph-mon[32679]: pgmap v13328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23412.708967 secs 2024-04-27T01:00:15.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:15 smithi092 ceph-mon[29156]: pgmap v13328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23412.708967 secs 2024-04-27T01:00:17.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:17 smithi189 ceph-mon[32756]: pgmap v13329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:17.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:17 smithi156 ceph-mon[32679]: pgmap v13329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:17.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:17 smithi092 ceph-mon[29156]: pgmap v13329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:19 smithi156 ceph-mon[32679]: pgmap v13330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24114.740068 secs 2024-04-27T01:00:19.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:19 smithi092 ceph-mon[29156]: pgmap v13330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:19.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24114.740068 secs 2024-04-27T01:00:19.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:19 smithi189 ceph-mon[32756]: pgmap v13330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:19.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24114.740068 secs 2024-04-27T01:00:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23417.709084 secs 2024-04-27T01:00:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23417.709084 secs 2024-04-27T01:00:20.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23417.709084 secs 2024-04-27T01:00:21.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:21 smithi156 ceph-mon[32679]: pgmap v13331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:21.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:21 smithi092 ceph-mon[29156]: pgmap v13331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:21.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:21 smithi189 ceph-mon[32756]: pgmap v13331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:23.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:23 smithi156 ceph-mon[32679]: pgmap v13332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:23.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:23 smithi092 ceph-mon[29156]: pgmap v13332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:23.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:23 smithi189 ceph-mon[32756]: pgmap v13332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:24.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24119.740152 secs 2024-04-27T01:00:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24119.740152 secs 2024-04-27T01:00:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24119.740152 secs 2024-04-27T01:00:25.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:25 smithi189 ceph-mon[32756]: pgmap v13333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:25.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23422.709220 secs 2024-04-27T01:00:25.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:25 smithi156 ceph-mon[32679]: pgmap v13333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:25.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23422.709220 secs 2024-04-27T01:00:25.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:25 smithi092 ceph-mon[29156]: pgmap v13333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23422.709220 secs 2024-04-27T01:00:27.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:27 smithi156 ceph-mon[32679]: pgmap v13334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:27.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:27 smithi092 ceph-mon[29156]: pgmap v13334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:27.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:27 smithi189 ceph-mon[32756]: pgmap v13334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:29.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:29 smithi156 ceph-mon[32679]: pgmap v13335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:29.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24124.740224 secs 2024-04-27T01:00:29.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:29 smithi092 ceph-mon[29156]: pgmap v13335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:29.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24124.740224 secs 2024-04-27T01:00:29.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:29 smithi189 ceph-mon[32756]: pgmap v13335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:29.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24124.740224 secs 2024-04-27T01:00:30.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23427.709335 secs 2024-04-27T01:00:30.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23427.709335 secs 2024-04-27T01:00:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23427.709335 secs 2024-04-27T01:00:31.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:31 smithi156 ceph-mon[32679]: pgmap v13336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:31.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:31 smithi092 ceph-mon[29156]: pgmap v13336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:31.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:31 smithi189 ceph-mon[32756]: pgmap v13336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:33.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:33 smithi156 ceph-mon[32679]: pgmap v13337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:33.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:33 smithi092 ceph-mon[29156]: pgmap v13337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:33.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:33 smithi189 ceph-mon[32756]: pgmap v13337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:34.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 24129.740325 secs 2024-04-27T01:00:34.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 24129.740325 secs 2024-04-27T01:00:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 24129.740325 secs 2024-04-27T01:00:35.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:35 smithi156 ceph-mon[32679]: pgmap v13338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23432.709426 secs 2024-04-27T01:00:35.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:35 smithi092 ceph-mon[29156]: pgmap v13338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:35.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23432.709426 secs 2024-04-27T01:00:35.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:35 smithi189 ceph-mon[32756]: pgmap v13338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:00:35.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23432.709426 secs 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-mon[29156]: pgmap v13339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:00:37.214+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:00:37.214+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:00:37.214+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:00:37.214+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:00:37.491 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:00:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:00:37.214+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:00:37.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:37 smithi189 ceph-mon[32756]: pgmap v13339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:37.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:37 smithi156 ceph-mon[32679]: pgmap v13339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:00:39.295+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:00:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:00:39.295+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:00:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:00:39.296+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:00:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:00:39.296+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 187 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:00:39.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:39 smithi092 ceph-mon[29156]: pgmap v13340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:39.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24134.740404 secs 2024-04-27T01:00:39.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:39 smithi189 ceph-mon[32756]: pgmap v13340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:39.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24134.740404 secs 2024-04-27T01:00:39.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:39 smithi156 ceph-mon[32679]: pgmap v13340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:00:39.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24134.740404 secs 2024-04-27T01:00:40.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23437.709499 secs 2024-04-27T01:00:40.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23437.709499 secs 2024-04-27T01:00:40.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23437.709499 secs 2024-04-27T01:00:41.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:41 smithi092 ceph-mon[29156]: pgmap v13341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:41.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:41 smithi189 ceph-mon[32756]: pgmap v13341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:41.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:41 smithi156 ceph-mon[32679]: pgmap v13341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:43.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:43 smithi092 ceph-mon[29156]: pgmap v13342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:43.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:00:43.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:00:43.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:43 smithi189 ceph-mon[32756]: pgmap v13342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:43.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:00:43.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:00:43.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:43 smithi156 ceph-mon[32679]: pgmap v13342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:43.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:00:43.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:00:44.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24139.740514 secs 2024-04-27T01:00:44.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24139.740514 secs 2024-04-27T01:00:44.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24139.740514 secs 2024-04-27T01:00:45.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:45 smithi092 ceph-mon[29156]: pgmap v13343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:45.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23442.709586 secs 2024-04-27T01:00:45.581 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:45 smithi156 ceph-mon[32679]: pgmap v13343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:45.582 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23442.709586 secs 2024-04-27T01:00:45.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:45 smithi189 ceph-mon[32756]: pgmap v13343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:00:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23442.709586 secs 2024-04-27T01:00:47.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:47 smithi092 ceph-mon[29156]: pgmap v13344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:47.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:47 smithi189 ceph-mon[32756]: pgmap v13344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:47.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:47 smithi156 ceph-mon[32679]: pgmap v13344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:48.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:00:48.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:00:48.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:00:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:49 smithi092 ceph-mon[29156]: pgmap v13345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:00:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:00:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:00:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24144.740626 secs 2024-04-27T01:00:49.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:49 smithi189 ceph-mon[32756]: pgmap v13345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:49.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:00:49.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:00:49.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:00:49.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24144.740626 secs 2024-04-27T01:00:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:49 smithi156 ceph-mon[32679]: pgmap v13345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:00:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:00:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:00:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:00:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24144.740626 secs 2024-04-27T01:00:50.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:50 smithi092 ceph-mon[29156]: pgmap v13346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 475 B/s wr, 18 op/s 2024-04-27T01:00:50.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:50 smithi092 ceph-mon[29156]: pgmap v13347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:00:50.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23447.709675 secs 2024-04-27T01:00:50.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:50 smithi189 ceph-mon[32756]: pgmap v13346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 475 B/s wr, 18 op/s 2024-04-27T01:00:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:50 smithi189 ceph-mon[32756]: pgmap v13347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:00:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23447.709675 secs 2024-04-27T01:00:50.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:50 smithi156 ceph-mon[32679]: pgmap v13346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 475 B/s wr, 18 op/s 2024-04-27T01:00:50.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:50 smithi156 ceph-mon[32679]: pgmap v13347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:00:50.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23447.709675 secs 2024-04-27T01:00:52.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:52 smithi092 ceph-mon[29156]: pgmap v13348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:52.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:52 smithi189 ceph-mon[32756]: pgmap v13348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:52.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:52 smithi156 ceph-mon[32679]: pgmap v13348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:54.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:54 smithi092 ceph-mon[29156]: pgmap v13349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:00:54.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24149.740745 secs 2024-04-27T01:00:54.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:54 smithi189 ceph-mon[32756]: pgmap v13349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:00:54.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24149.740745 secs 2024-04-27T01:00:54.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:54 smithi156 ceph-mon[32679]: pgmap v13349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:00:54.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24149.740745 secs 2024-04-27T01:00:55.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23452.709801 secs 2024-04-27T01:00:55.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23452.709801 secs 2024-04-27T01:00:55.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23452.709801 secs 2024-04-27T01:00:56.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:56 smithi092 ceph-mon[29156]: pgmap v13350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:56.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:56 smithi189 ceph-mon[32756]: pgmap v13350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:56.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:56 smithi156 ceph-mon[32679]: pgmap v13350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:58.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:58 smithi092 ceph-mon[29156]: pgmap v13351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:58.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:58 smithi189 ceph-mon[32756]: pgmap v13351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:58.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:58 smithi156 ceph-mon[32679]: pgmap v13351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:00:59.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:00:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24154.740855 secs 2024-04-27T01:00:59.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:00:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24154.740855 secs 2024-04-27T01:00:59.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:00:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24154.740855 secs 2024-04-27T01:01:00.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:00 smithi189 ceph-mon[32756]: pgmap v13352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:01:00.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23457.709932 secs 2024-04-27T01:01:00.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:00 smithi156 ceph-mon[32679]: pgmap v13352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:01:00.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23457.709932 secs 2024-04-27T01:01:00.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:00 smithi092 ceph-mon[29156]: pgmap v13352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:01:00.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23457.709932 secs 2024-04-27T01:01:02.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:02 smithi189 ceph-mon[32756]: pgmap v13353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:02.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:02 smithi156 ceph-mon[32679]: pgmap v13353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:02.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:02 smithi092 ceph-mon[29156]: pgmap v13353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:04.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:04 smithi189 ceph-mon[32756]: pgmap v13354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:04.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24159.740928 secs 2024-04-27T01:01:04.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:04 smithi156 ceph-mon[32679]: pgmap v13354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:04.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24159.740928 secs 2024-04-27T01:01:04.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:04 smithi092 ceph-mon[29156]: pgmap v13354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:04.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24159.740928 secs 2024-04-27T01:01:05.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23462.710049 secs 2024-04-27T01:01:05.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23462.710049 secs 2024-04-27T01:01:05.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23462.710049 secs 2024-04-27T01:01:06.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:06 smithi189 ceph-mon[32756]: pgmap v13355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:06.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:06 smithi156 ceph-mon[32679]: pgmap v13355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:06.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:06 smithi092 ceph-mon[29156]: pgmap v13355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:08.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:08 smithi189 ceph-mon[32756]: pgmap v13356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:08.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:08 smithi156 ceph-mon[32679]: pgmap v13356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:08.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:08 smithi092 ceph-mon[29156]: pgmap v13356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:09.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24164.741046 secs 2024-04-27T01:01:09.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24164.741046 secs 2024-04-27T01:01:09.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24164.741046 secs 2024-04-27T01:01:10.535 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:10 smithi189 ceph-mon[32756]: pgmap v13357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:01:10.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23467.710170 secs 2024-04-27T01:01:10.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:10 smithi156 ceph-mon[32679]: pgmap v13357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:01:10.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23467.710170 secs 2024-04-27T01:01:10.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:10 smithi092 ceph-mon[29156]: pgmap v13357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:01:10.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23467.710170 secs 2024-04-27T01:01:12.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:12 smithi189 ceph-mon[32756]: pgmap v13358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:12.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:12 smithi156 ceph-mon[32679]: pgmap v13358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:12.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:12 smithi092 ceph-mon[29156]: pgmap v13358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:14.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:14 smithi189 ceph-mon[32756]: pgmap v13359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:14.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24169.741128 secs 2024-04-27T01:01:14.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:14 smithi156 ceph-mon[32679]: pgmap v13359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:14.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24169.741128 secs 2024-04-27T01:01:14.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:14 smithi092 ceph-mon[29156]: pgmap v13359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:01:14.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24169.741128 secs 2024-04-27T01:01:15.581 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23472.710324 secs 2024-04-27T01:01:15.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23472.710324 secs 2024-04-27T01:01:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23472.710324 secs 2024-04-27T01:01:16.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:16 smithi189 ceph-mon[32756]: pgmap v13360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:16.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:16 smithi156 ceph-mon[32679]: pgmap v13360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:16.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:16 smithi092 ceph-mon[29156]: pgmap v13360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:01:18.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:18 smithi189 ceph-mon[32756]: pgmap v13361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:18.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:18 smithi156 ceph-mon[32679]: pgmap v13361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:18.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:18 smithi092 ceph-mon[29156]: pgmap v13361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:19.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24174.741261 secs 2024-04-27T01:01:19.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24174.741261 secs 2024-04-27T01:01:19.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24174.741261 secs 2024-04-27T01:01:20.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:20 smithi189 ceph-mon[32756]: pgmap v13362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:20.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23477.710363 secs 2024-04-27T01:01:20.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:20 smithi156 ceph-mon[32679]: pgmap v13362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:20.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23477.710363 secs 2024-04-27T01:01:20.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:20 smithi092 ceph-mon[29156]: pgmap v13362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:20.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23477.710363 secs 2024-04-27T01:01:22.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:22 smithi189 ceph-mon[32756]: pgmap v13363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:22.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:22 smithi156 ceph-mon[32679]: pgmap v13363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:22.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:22 smithi092 ceph-mon[29156]: pgmap v13363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:24.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:24 smithi189 ceph-mon[32756]: pgmap v13364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:24.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24179.741379 secs 2024-04-27T01:01:24.664 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:24 smithi092 ceph-mon[29156]: pgmap v13364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:24.665 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24179.741379 secs 2024-04-27T01:01:24.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:24 smithi156 ceph-mon[32679]: pgmap v13364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:24.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24179.741379 secs 2024-04-27T01:01:25.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23482.710474 secs 2024-04-27T01:01:25.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23482.710474 secs 2024-04-27T01:01:25.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23482.710474 secs 2024-04-27T01:01:26.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:26 smithi189 ceph-mon[32756]: pgmap v13365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:26.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:26 smithi156 ceph-mon[32679]: pgmap v13365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:26.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:26 smithi092 ceph-mon[29156]: pgmap v13365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:28.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:28 smithi189 ceph-mon[32756]: pgmap v13366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:28.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:28 smithi156 ceph-mon[32679]: pgmap v13366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:28.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:28 smithi092 ceph-mon[29156]: pgmap v13366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:29.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24184.741475 secs 2024-04-27T01:01:29.640 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24184.741475 secs 2024-04-27T01:01:29.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24184.741475 secs 2024-04-27T01:01:30.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:30 smithi189 ceph-mon[32756]: pgmap v13367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:30.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23487.710610 secs 2024-04-27T01:01:30.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:30 smithi156 ceph-mon[32679]: pgmap v13367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:30.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23487.710610 secs 2024-04-27T01:01:30.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:30 smithi092 ceph-mon[29156]: pgmap v13367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:30.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23487.710610 secs 2024-04-27T01:01:32.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:32 smithi189 ceph-mon[32756]: pgmap v13368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:32.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:32 smithi156 ceph-mon[32679]: pgmap v13368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:32.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:32 smithi092 ceph-mon[29156]: pgmap v13368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:34.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:34 smithi189 ceph-mon[32756]: pgmap v13369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:34.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24189.741570 secs 2024-04-27T01:01:34.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:34 smithi156 ceph-mon[32679]: pgmap v13369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:34.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24189.741570 secs 2024-04-27T01:01:34.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:34 smithi092 ceph-mon[29156]: pgmap v13369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:34.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24189.741570 secs 2024-04-27T01:01:35.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23492.710706 secs 2024-04-27T01:01:35.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23492.710706 secs 2024-04-27T01:01:35.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23492.710706 secs 2024-04-27T01:01:36.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:36 smithi189 ceph-mon[32756]: pgmap v13370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:36.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:36 smithi156 ceph-mon[32679]: pgmap v13370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:36.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:36 smithi092 ceph-mon[29156]: pgmap v13370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:38.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:38 smithi189 ceph-mon[32756]: pgmap v13371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:38.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:38 smithi156 ceph-mon[32679]: pgmap v13371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:38.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:38 smithi092 ceph-mon[29156]: pgmap v13371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:39.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:39 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24194.741688 secs 2024-04-27T01:01:39.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:39 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24194.741688 secs 2024-04-27T01:01:39.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:39 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24194.741688 secs 2024-04-27T01:01:40.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:40 smithi189 ceph-mon[32756]: pgmap v13372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:40.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:40 smithi189 ceph-mon[32756]: 18 slow requests, 2 included below; oldest blocked for > 23497.710822 secs 2024-04-27T01:01:40.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:40 smithi189 ceph-mon[32756]: slow request 2882.441436 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:40.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:40 smithi189 ceph-mon[32756]: slow request 361.755142 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:40.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:40 smithi156 ceph-mon[32679]: pgmap v13372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:40.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:40 smithi156 ceph-mon[32679]: 18 slow requests, 2 included below; oldest blocked for > 23497.710822 secs 2024-04-27T01:01:40.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:40 smithi156 ceph-mon[32679]: slow request 2882.441436 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:40.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:40 smithi156 ceph-mon[32679]: slow request 361.755142 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:40.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:40 smithi092 ceph-mon[29156]: pgmap v13372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:40.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:40 smithi092 ceph-mon[29156]: 18 slow requests, 2 included below; oldest blocked for > 23497.710822 secs 2024-04-27T01:01:40.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:40 smithi092 ceph-mon[29156]: slow request 2882.441436 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:40.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:40 smithi092 ceph-mon[29156]: slow request 361.755142 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:01:42.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:42 smithi189 ceph-mon[32756]: pgmap v13373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:42.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:42 smithi156 ceph-mon[32679]: pgmap v13373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:42.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:42 smithi092 ceph-mon[29156]: pgmap v13373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:44.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:44 smithi189 ceph-mon[32756]: pgmap v13374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:44.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24199.741845 secs 2024-04-27T01:01:44.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:44 smithi156 ceph-mon[32679]: pgmap v13374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:44.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24199.741845 secs 2024-04-27T01:01:44.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:44 smithi092 ceph-mon[29156]: pgmap v13374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:44.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24199.741845 secs 2024-04-27T01:01:45.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23502.710940 secs 2024-04-27T01:01:45.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23502.710940 secs 2024-04-27T01:01:45.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23502.710940 secs 2024-04-27T01:01:46.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:46 smithi189 ceph-mon[32756]: pgmap v13375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:46.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:46 smithi156 ceph-mon[32679]: pgmap v13375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:46.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:46 smithi092 ceph-mon[29156]: pgmap v13375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:47.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:47 smithi189 ceph-mon[32756]: pgmap v13376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:47.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:47 smithi156 ceph-mon[32679]: pgmap v13376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:47.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:47 smithi092 ceph-mon[29156]: pgmap v13376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:01:49.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: pgmap v13377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24204.741885 secs 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: pgmap v13378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: pgmap v13379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: pgmap v13377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24204.741885 secs 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: pgmap v13378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:01:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: pgmap v13379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:49.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: pgmap v13377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24204.741885 secs 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:01:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: pgmap v13378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:01:49.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: pgmap v13379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:49.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:01:50.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23507.711026 secs 2024-04-27T01:01:50.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23507.711026 secs 2024-04-27T01:01:50.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23507.711026 secs 2024-04-27T01:01:51.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:51 smithi189 ceph-mon[32756]: pgmap v13380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:51.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:51 smithi156 ceph-mon[32679]: pgmap v13380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:51.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:51 smithi092 ceph-mon[29156]: pgmap v13380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:54.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:54 smithi189 ceph-mon[32756]: pgmap v13381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:54.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24209.741984 secs 2024-04-27T01:01:54.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:54 smithi156 ceph-mon[32679]: pgmap v13381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:54.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24209.741984 secs 2024-04-27T01:01:54.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:54 smithi092 ceph-mon[29156]: pgmap v13381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:54.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24209.741984 secs 2024-04-27T01:01:55.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23512.711144 secs 2024-04-27T01:01:55.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23512.711144 secs 2024-04-27T01:01:55.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23512.711144 secs 2024-04-27T01:01:56.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:56 smithi189 ceph-mon[32756]: pgmap v13382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:56.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:56 smithi156 ceph-mon[32679]: pgmap v13382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:56.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:56 smithi092 ceph-mon[29156]: pgmap v13382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:01:58.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:58 smithi189 ceph-mon[32756]: pgmap v13383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:58.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:58 smithi156 ceph-mon[32679]: pgmap v13383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:58.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:58 smithi092 ceph-mon[29156]: pgmap v13383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:01:59.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:01:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24214.742104 secs 2024-04-27T01:01:59.640 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:01:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24214.742104 secs 2024-04-27T01:01:59.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:01:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24214.742104 secs 2024-04-27T01:02:00.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23517.711267 secs 2024-04-27T01:02:00.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:00 smithi189 ceph-mon[32756]: pgmap v13384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:02:00.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23517.711267 secs 2024-04-27T01:02:00.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:00 smithi156 ceph-mon[32679]: pgmap v13384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:02:00.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23517.711267 secs 2024-04-27T01:02:00.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:00 smithi092 ceph-mon[29156]: pgmap v13384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:02:02.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:02 smithi189 ceph-mon[32756]: pgmap v13385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:02.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:02 smithi156 ceph-mon[32679]: pgmap v13385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:02.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:02 smithi092 ceph-mon[29156]: pgmap v13385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:04.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:04 smithi189 ceph-mon[32756]: pgmap v13386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:04.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24219.742268 secs 2024-04-27T01:02:04.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:04 smithi156 ceph-mon[32679]: pgmap v13386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:04.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24219.742268 secs 2024-04-27T01:02:04.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:04 smithi092 ceph-mon[29156]: pgmap v13386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:04.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24219.742268 secs 2024-04-27T01:02:05.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23522.711366 secs 2024-04-27T01:02:05.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23522.711366 secs 2024-04-27T01:02:05.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23522.711366 secs 2024-04-27T01:02:06.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:06 smithi189 ceph-mon[32756]: pgmap v13387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:06.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:06 smithi156 ceph-mon[32679]: pgmap v13387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:06.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:06 smithi092 ceph-mon[29156]: pgmap v13387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:08.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:08 smithi189 ceph-mon[32756]: pgmap v13388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:08.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:08 smithi156 ceph-mon[32679]: pgmap v13388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:08.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:08 smithi092 ceph-mon[29156]: pgmap v13388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:09.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24224.742372 secs 2024-04-27T01:02:09.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24224.742372 secs 2024-04-27T01:02:09.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24224.742372 secs 2024-04-27T01:02:10.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23527.711450 secs 2024-04-27T01:02:10.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:10 smithi189 ceph-mon[32756]: pgmap v13389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:10.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23527.711450 secs 2024-04-27T01:02:10.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:10 smithi156 ceph-mon[32679]: pgmap v13389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:10.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23527.711450 secs 2024-04-27T01:02:10.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:10 smithi092 ceph-mon[29156]: pgmap v13389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:12.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:12 smithi189 ceph-mon[32756]: pgmap v13390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:12.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:12 smithi156 ceph-mon[32679]: pgmap v13390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:12.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:12 smithi092 ceph-mon[29156]: pgmap v13390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:14.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:14 smithi189 ceph-mon[32756]: pgmap v13391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:14.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24229.742470 secs 2024-04-27T01:02:14.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:14 smithi156 ceph-mon[32679]: pgmap v13391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:14.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24229.742470 secs 2024-04-27T01:02:14.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:14 smithi092 ceph-mon[29156]: pgmap v13391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:14.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24229.742470 secs 2024-04-27T01:02:15.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23532.711589 secs 2024-04-27T01:02:15.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:15 smithi189 ceph-mon[32756]: pgmap v13392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:15.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23532.711589 secs 2024-04-27T01:02:15.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:15 smithi156 ceph-mon[32679]: pgmap v13392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:15.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23532.711589 secs 2024-04-27T01:02:15.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:15 smithi092 ceph-mon[29156]: pgmap v13392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:18.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:18 smithi189 ceph-mon[32756]: pgmap v13393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:18.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:18 smithi156 ceph-mon[32679]: pgmap v13393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:18.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:18 smithi092 ceph-mon[29156]: pgmap v13393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:19.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24234.742607 secs 2024-04-27T01:02:19.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24234.742607 secs 2024-04-27T01:02:19.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24234.742607 secs 2024-04-27T01:02:20.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23537.711733 secs 2024-04-27T01:02:20.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:20 smithi189 ceph-mon[32756]: pgmap v13394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:20.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23537.711733 secs 2024-04-27T01:02:20.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:20 smithi156 ceph-mon[32679]: pgmap v13394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:20.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23537.711733 secs 2024-04-27T01:02:20.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:20 smithi092 ceph-mon[29156]: pgmap v13394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:22.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:22 smithi189 ceph-mon[32756]: pgmap v13395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:22.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:22 smithi156 ceph-mon[32679]: pgmap v13395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:22.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:22 smithi092 ceph-mon[29156]: pgmap v13395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:24.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:24 smithi189 ceph-mon[32756]: pgmap v13396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:24.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24239.742723 secs 2024-04-27T01:02:24.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:24 smithi156 ceph-mon[32679]: pgmap v13396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:24.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24239.742723 secs 2024-04-27T01:02:24.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:24 smithi092 ceph-mon[29156]: pgmap v13396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:24.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24239.742723 secs 2024-04-27T01:02:25.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23542.711867 secs 2024-04-27T01:02:25.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23542.711867 secs 2024-04-27T01:02:25.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23542.711867 secs 2024-04-27T01:02:26.615 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:26 smithi092 ceph-mon[29156]: pgmap v13397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:26.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:26 smithi189 ceph-mon[32756]: pgmap v13397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:26.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:26 smithi156 ceph-mon[32679]: pgmap v13397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:28.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:28 smithi189 ceph-mon[32756]: pgmap v13398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:28.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:28 smithi156 ceph-mon[32679]: pgmap v13398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:28.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:28 smithi092 ceph-mon[29156]: pgmap v13398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:29.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24244.742789 secs 2024-04-27T01:02:29.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24244.742789 secs 2024-04-27T01:02:29.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24244.742789 secs 2024-04-27T01:02:30.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23547.711990 secs 2024-04-27T01:02:30.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:30 smithi189 ceph-mon[32756]: pgmap v13399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:30.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23547.711990 secs 2024-04-27T01:02:30.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:30 smithi156 ceph-mon[32679]: pgmap v13399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:30.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23547.711990 secs 2024-04-27T01:02:30.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:30 smithi092 ceph-mon[29156]: pgmap v13399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:32.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:32 smithi189 ceph-mon[32756]: pgmap v13400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:32.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:32 smithi156 ceph-mon[32679]: pgmap v13400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:32.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:32 smithi092 ceph-mon[29156]: pgmap v13400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:34.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:34 smithi189 ceph-mon[32756]: pgmap v13401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:34.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24249.742886 secs 2024-04-27T01:02:34.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:34 smithi156 ceph-mon[32679]: pgmap v13401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:34.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24249.742886 secs 2024-04-27T01:02:34.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:34 smithi092 ceph-mon[29156]: pgmap v13401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:34.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24249.742886 secs 2024-04-27T01:02:35.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23552.712107 secs 2024-04-27T01:02:35.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23552.712107 secs 2024-04-27T01:02:35.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23552.712107 secs 2024-04-27T01:02:36.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:36 smithi189 ceph-mon[32756]: pgmap v13402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:36.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:36 smithi156 ceph-mon[32679]: pgmap v13402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:36.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:36 smithi092 ceph-mon[29156]: pgmap v13402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:37.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:37 smithi156 ceph-mon[32679]: pgmap v13403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:37.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:37 smithi092 ceph-mon[29156]: pgmap v13403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:37.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:37 smithi189 ceph-mon[32756]: pgmap v13403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:39.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:38 smithi092 ceph-mon[29156]: 7 slow requests, 1 included below; oldest blocked for > 24254.743009 secs 2024-04-27T01:02:39.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:38 smithi092 ceph-mon[29156]: slow request 721.625876 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:02:39.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:38 smithi189 ceph-mon[32756]: 7 slow requests, 1 included below; oldest blocked for > 24254.743009 secs 2024-04-27T01:02:39.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:38 smithi189 ceph-mon[32756]: slow request 721.625876 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:02:39.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:38 smithi156 ceph-mon[32679]: 7 slow requests, 1 included below; oldest blocked for > 24254.743009 secs 2024-04-27T01:02:39.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:38 smithi156 ceph-mon[32679]: slow request 721.625876 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:02:40.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23557.712216 secs 2024-04-27T01:02:40.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:39 smithi092 ceph-mon[29156]: pgmap v13404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:40.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23557.712216 secs 2024-04-27T01:02:40.285 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:39 smithi189 ceph-mon[32756]: pgmap v13404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:40.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23557.712216 secs 2024-04-27T01:02:40.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:39 smithi156 ceph-mon[32679]: pgmap v13404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:42.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:42 smithi189 ceph-mon[32756]: pgmap v13405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:42.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:42 smithi156 ceph-mon[32679]: pgmap v13405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:42.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:42 smithi092 ceph-mon[29156]: pgmap v13405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:44.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:44 smithi189 ceph-mon[32756]: pgmap v13406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:44.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:44 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24259.743086 secs 2024-04-27T01:02:44.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:44 smithi156 ceph-mon[32679]: pgmap v13406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:44.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:44 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24259.743086 secs 2024-04-27T01:02:44.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:44 smithi092 ceph-mon[29156]: pgmap v13406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:44.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:44 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24259.743086 secs 2024-04-27T01:02:45.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23562.712337 secs 2024-04-27T01:02:45.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23562.712337 secs 2024-04-27T01:02:45.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23562.712337 secs 2024-04-27T01:02:46.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:46 smithi189 ceph-mon[32756]: pgmap v13407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:46.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:46 smithi156 ceph-mon[32679]: pgmap v13407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:46.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:46 smithi092 ceph-mon[29156]: pgmap v13407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:48.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:48 smithi189 ceph-mon[32756]: pgmap v13408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:48.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:48 smithi156 ceph-mon[32679]: pgmap v13408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:48.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:48 smithi092 ceph-mon[29156]: pgmap v13408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:02:49.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:49 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24264.743198 secs 2024-04-27T01:02:49.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:49 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24264.743198 secs 2024-04-27T01:02:49.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:49 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24264.743198 secs 2024-04-27T01:02:50.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23567.712431 secs 2024-04-27T01:02:50.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: pgmap v13409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:50.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:02:50.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:02:50.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:02:50.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:02:50.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23567.712431 secs 2024-04-27T01:02:50.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: pgmap v13409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:50.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:02:50.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:02:50.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:02:50.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23567.712431 secs 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: pgmap v13409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:02:50.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:02:51.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:51 smithi189 ceph-mon[32756]: pgmap v13410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:02:51.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:51 smithi189 ceph-mon[32756]: pgmap v13411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:51.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:51 smithi156 ceph-mon[32679]: pgmap v13410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:02:51.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:51 smithi156 ceph-mon[32679]: pgmap v13411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:51.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:51 smithi092 ceph-mon[29156]: pgmap v13410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:02:51.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:51 smithi092 ceph-mon[29156]: pgmap v13411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:53.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:53 smithi189 ceph-mon[32756]: pgmap v13412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:53.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:53 smithi156 ceph-mon[32679]: pgmap v13412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:53.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:53 smithi092 ceph-mon[29156]: pgmap v13412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:02:54.314+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:02:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:02:54.314+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:02:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:02:54.314+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:02:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:02:54.314+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 188 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:02:54.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:54 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24269.743315 secs 2024-04-27T01:02:54.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:54 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24269.743315 secs 2024-04-27T01:02:54.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:54 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24269.743315 secs 2024-04-27T01:02:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23572.712509 secs 2024-04-27T01:02:55.633 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:55 smithi189 ceph-mon[32756]: pgmap v13413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23572.712509 secs 2024-04-27T01:02:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:55 smithi156 ceph-mon[32679]: pgmap v13413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23572.712509 secs 2024-04-27T01:02:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:55 smithi092 ceph-mon[29156]: pgmap v13413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:56.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:56 smithi156 ceph-mon[32679]: pgmap v13414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:56.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:56 smithi092 ceph-mon[29156]: pgmap v13414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:56.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:56 smithi189 ceph-mon[32756]: pgmap v13414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:02:59.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:59 smithi189 ceph-mon[32756]: pgmap v13415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:02:59.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:02:59 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24274.743433 secs 2024-04-27T01:02:59.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:59 smithi156 ceph-mon[32679]: pgmap v13415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:02:59.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:02:59 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24274.743433 secs 2024-04-27T01:02:59.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:59 smithi092 ceph-mon[29156]: pgmap v13415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:02:59.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:02:59 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24274.743433 secs 2024-04-27T01:03:00.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23577.712580 secs 2024-04-27T01:03:00.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23577.712580 secs 2024-04-27T01:03:00.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23577.712580 secs 2024-04-27T01:03:01.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:01 smithi189 ceph-mon[32756]: pgmap v13416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:03:01.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:01 smithi156 ceph-mon[32679]: pgmap v13416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:03:01.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:01 smithi092 ceph-mon[29156]: pgmap v13416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:03:03.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:03 smithi189 ceph-mon[32756]: pgmap v13417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:03.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:03 smithi156 ceph-mon[32679]: pgmap v13417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:03.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:03 smithi092 ceph-mon[29156]: pgmap v13417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:04.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:04 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24279.743549 secs 2024-04-27T01:03:04.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:04 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24279.743549 secs 2024-04-27T01:03:04.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:04 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24279.743549 secs 2024-04-27T01:03:05.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23582.712701 secs 2024-04-27T01:03:05.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:05 smithi189 ceph-mon[32756]: pgmap v13418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:05.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23582.712701 secs 2024-04-27T01:03:05.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:05 smithi156 ceph-mon[32679]: pgmap v13418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:05.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23582.712701 secs 2024-04-27T01:03:05.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:05 smithi092 ceph-mon[29156]: pgmap v13418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:07.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:07 smithi189 ceph-mon[32756]: pgmap v13419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:07.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:07 smithi156 ceph-mon[32679]: pgmap v13419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:07.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:07 smithi092 ceph-mon[29156]: pgmap v13419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:09.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:09 smithi189 ceph-mon[32756]: pgmap v13420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:09.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:09 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24284.743685 secs 2024-04-27T01:03:09.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:09 smithi156 ceph-mon[32679]: pgmap v13420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:09.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:09 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24284.743685 secs 2024-04-27T01:03:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:09 smithi092 ceph-mon[29156]: pgmap v13420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:09 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24284.743685 secs 2024-04-27T01:03:10.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23587.712760 secs 2024-04-27T01:03:10.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23587.712760 secs 2024-04-27T01:03:10.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23587.712760 secs 2024-04-27T01:03:11.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:11 smithi189 ceph-mon[32756]: pgmap v13421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:11.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:11 smithi156 ceph-mon[32679]: pgmap v13421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:11.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:11 smithi092 ceph-mon[29156]: pgmap v13421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:13.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:13 smithi189 ceph-mon[32756]: pgmap v13422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:13.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:13 smithi156 ceph-mon[32679]: pgmap v13422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:13.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:13 smithi092 ceph-mon[29156]: pgmap v13422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:14.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:14 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24289.743802 secs 2024-04-27T01:03:14.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:14 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24289.743802 secs 2024-04-27T01:03:14.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:14 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24289.743802 secs 2024-04-27T01:03:15.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23592.712821 secs 2024-04-27T01:03:15.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:15 smithi156 ceph-mon[32679]: pgmap v13423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:15.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23592.712821 secs 2024-04-27T01:03:15.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:15 smithi092 ceph-mon[29156]: pgmap v13423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:15.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23592.712821 secs 2024-04-27T01:03:15.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:15 smithi189 ceph-mon[32756]: pgmap v13423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:17.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:17 smithi156 ceph-mon[32679]: pgmap v13424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:17.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:17 smithi092 ceph-mon[29156]: pgmap v13424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:17.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:17 smithi189 ceph-mon[32756]: pgmap v13424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:19.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:19 smithi156 ceph-mon[32679]: pgmap v13425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:19.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:19 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24294.743864 secs 2024-04-27T01:03:19.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:19 smithi092 ceph-mon[29156]: pgmap v13425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:19.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:19 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24294.743864 secs 2024-04-27T01:03:19.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:19 smithi189 ceph-mon[32756]: pgmap v13425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:19.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:19 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24294.743864 secs 2024-04-27T01:03:20.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23597.712896 secs 2024-04-27T01:03:20.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23597.712896 secs 2024-04-27T01:03:20.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23597.712896 secs 2024-04-27T01:03:21.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:21 smithi156 ceph-mon[32679]: pgmap v13426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:21.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:21 smithi092 ceph-mon[29156]: pgmap v13426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:21.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:21 smithi189 ceph-mon[32756]: pgmap v13426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:23.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:23 smithi156 ceph-mon[32679]: pgmap v13427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:23.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:23 smithi092 ceph-mon[29156]: pgmap v13427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:23.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:23 smithi189 ceph-mon[32756]: pgmap v13427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:24.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:24 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24299.743980 secs 2024-04-27T01:03:24.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:24 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24299.743980 secs 2024-04-27T01:03:24.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:24 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24299.743980 secs 2024-04-27T01:03:25.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23602.713008 secs 2024-04-27T01:03:25.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:25 smithi156 ceph-mon[32679]: pgmap v13428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:25.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23602.713008 secs 2024-04-27T01:03:25.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:25 smithi092 ceph-mon[29156]: pgmap v13428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:25.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23602.713008 secs 2024-04-27T01:03:25.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:25 smithi189 ceph-mon[32756]: pgmap v13428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:27.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:27 smithi156 ceph-mon[32679]: pgmap v13429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:27.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:27 smithi092 ceph-mon[29156]: pgmap v13429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:27.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:27 smithi189 ceph-mon[32756]: pgmap v13429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:29.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:29 smithi156 ceph-mon[32679]: pgmap v13430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:29.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:29 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24304.744102 secs 2024-04-27T01:03:29.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:29 smithi092 ceph-mon[29156]: pgmap v13430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:29.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:29 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24304.744102 secs 2024-04-27T01:03:29.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:29 smithi189 ceph-mon[32756]: pgmap v13430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:29.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:29 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24304.744102 secs 2024-04-27T01:03:30.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23607.713104 secs 2024-04-27T01:03:30.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23607.713104 secs 2024-04-27T01:03:30.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23607.713104 secs 2024-04-27T01:03:31.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:31 smithi156 ceph-mon[32679]: pgmap v13431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:31.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:31 smithi092 ceph-mon[29156]: pgmap v13431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:31.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:31 smithi189 ceph-mon[32756]: pgmap v13431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:33.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:33 smithi092 ceph-mon[29156]: pgmap v13432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:33.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:33 smithi189 ceph-mon[32756]: pgmap v13432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:33.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:33 smithi156 ceph-mon[32679]: pgmap v13432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:34.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:34 smithi092 ceph-mon[29156]: 7 slow requests, 0 included below; oldest blocked for > 24309.744218 secs 2024-04-27T01:03:34.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:34 smithi189 ceph-mon[32756]: 7 slow requests, 0 included below; oldest blocked for > 24309.744218 secs 2024-04-27T01:03:34.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:34 smithi156 ceph-mon[32679]: 7 slow requests, 0 included below; oldest blocked for > 24309.744218 secs 2024-04-27T01:03:35.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23612.713169 secs 2024-04-27T01:03:35.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:35 smithi092 ceph-mon[29156]: pgmap v13433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:35.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23612.713169 secs 2024-04-27T01:03:35.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:35 smithi189 ceph-mon[32756]: pgmap v13433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:35.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23612.713169 secs 2024-04-27T01:03:35.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:35 smithi156 ceph-mon[32679]: pgmap v13433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T01:03:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T01:03:36.020 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80d80d0 tx=0x7f1ca8082000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80d80d0 tx=0x7f1ca8082000 comp rx=0 tx=0).stop 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.026+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.027+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:03:36.021 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.027+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80b0050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T01:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.064+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T01:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.064+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T01:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.064+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.064+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=25 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T01:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.065+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:03:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.065+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T01:03:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:36.065+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T01:03:37.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:37 smithi092 ceph-mon[29156]: pgmap v13434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:37.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:37 smithi189 ceph-mon[32756]: pgmap v13434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:37.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:37 smithi156 ceph-mon[32679]: pgmap v13434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:39.320+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:39.320+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:39.320+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:03:39.320+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 189 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:03:39.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:39 smithi092 ceph-mon[29156]: pgmap v13435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:39.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:39 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 24314.744340 secs 2024-04-27T01:03:39.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:39 smithi092 ceph-mon[29156]: slow request 181.440486 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:03:39.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:39 smithi189 ceph-mon[32756]: pgmap v13435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:39.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:39 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 24314.744340 secs 2024-04-27T01:03:39.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:39 smithi189 ceph-mon[32756]: slow request 181.440486 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:03:39.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:39 smithi156 ceph-mon[32679]: pgmap v13435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:39.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:39 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 24314.744340 secs 2024-04-27T01:03:39.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:39 smithi156 ceph-mon[32679]: slow request 181.440486 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:03:40.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23617.713326 secs 2024-04-27T01:03:40.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23617.713326 secs 2024-04-27T01:03:40.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23617.713326 secs 2024-04-27T01:03:41.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:41 smithi092 ceph-mon[29156]: pgmap v13436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:41.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:41 smithi189 ceph-mon[32756]: pgmap v13436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:41.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:41 smithi156 ceph-mon[32679]: pgmap v13436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:43.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:43 smithi092 ceph-mon[29156]: pgmap v13437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:43.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:03:43.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:03:43.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:43 smithi189 ceph-mon[32756]: pgmap v13437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:43.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:03:43.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:03:43.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:43 smithi156 ceph-mon[32679]: pgmap v13437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:43.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:03:43.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:03:44.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24319.744425 secs 2024-04-27T01:03:44.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24319.744425 secs 2024-04-27T01:03:44.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24319.744425 secs 2024-04-27T01:03:45.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23622.713446 secs 2024-04-27T01:03:45.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:45 smithi092 ceph-mon[29156]: pgmap v13438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:45.579 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23622.713446 secs 2024-04-27T01:03:45.579 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:45 smithi156 ceph-mon[32679]: pgmap v13438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:45.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23622.713446 secs 2024-04-27T01:03:45.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:45 smithi189 ceph-mon[32756]: pgmap v13438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:47.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:47 smithi092 ceph-mon[29156]: pgmap v13439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:47.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:47 smithi189 ceph-mon[32756]: pgmap v13439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:47.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:47 smithi156 ceph-mon[32679]: pgmap v13439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:49.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:49 smithi092 ceph-mon[29156]: pgmap v13440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:49.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24324.744564 secs 2024-04-27T01:03:49.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:49 smithi189 ceph-mon[32756]: pgmap v13440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:49.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24324.744564 secs 2024-04-27T01:03:49.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:49 smithi156 ceph-mon[32679]: pgmap v13440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:49.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24324.744564 secs 2024-04-27T01:03:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23627.713511 secs 2024-04-27T01:03:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:03:50.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23627.713511 secs 2024-04-27T01:03:50.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:03:50.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23627.713511 secs 2024-04-27T01:03:50.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:03:51.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:51 smithi092 ceph-mon[29156]: pgmap v13441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:51.577 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:51 smithi156 ceph-mon[32679]: pgmap v13441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:51.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:51 smithi189 ceph-mon[32756]: pgmap v13441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:53.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:53 smithi156 ceph-mon[32679]: pgmap v13442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:53.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:53 smithi092 ceph-mon[29156]: pgmap v13442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:53.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:53 smithi189 ceph-mon[32756]: pgmap v13442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:03:54.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24329.744628 secs 2024-04-27T01:03:54.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24329.744628 secs 2024-04-27T01:03:54.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24329.744628 secs 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23632.713568 secs 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: pgmap v13443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:03:55.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23632.713568 secs 2024-04-27T01:03:55.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: pgmap v13443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:55.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:03:55.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23632.713568 secs 2024-04-27T01:03:55.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: pgmap v13443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:03:55.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:03:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:03:56.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:56 smithi189 ceph-mon[32756]: pgmap v13444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:03:56.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:56 smithi189 ceph-mon[32756]: pgmap v13445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:56.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:56 smithi156 ceph-mon[32679]: pgmap v13444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:03:56.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:56 smithi156 ceph-mon[32679]: pgmap v13445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:56.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:56 smithi092 ceph-mon[29156]: pgmap v13444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:03:56.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:56 smithi092 ceph-mon[29156]: pgmap v13445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:58.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:58 smithi189 ceph-mon[32756]: pgmap v13446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:58.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:58 smithi156 ceph-mon[32679]: pgmap v13446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:58.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:58 smithi092 ceph-mon[29156]: pgmap v13446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:03:59.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:03:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24334.744741 secs 2024-04-27T01:03:59.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:03:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24334.744741 secs 2024-04-27T01:03:59.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:03:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24334.744741 secs 2024-04-27T01:04:00.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:00 smithi189 ceph-mon[32756]: pgmap v13447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:00.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23637.713715 secs 2024-04-27T01:04:00.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:00 smithi156 ceph-mon[32679]: pgmap v13447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:00.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23637.713715 secs 2024-04-27T01:04:00.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:00 smithi092 ceph-mon[29156]: pgmap v13447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:00.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23637.713715 secs 2024-04-27T01:04:02.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:02 smithi189 ceph-mon[32756]: pgmap v13448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:02.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:02 smithi156 ceph-mon[32679]: pgmap v13448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:02.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:02 smithi092 ceph-mon[29156]: pgmap v13448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:04:04.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:04 smithi189 ceph-mon[32756]: pgmap v13449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:04:04.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24339.744889 secs 2024-04-27T01:04:04.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23642.713843 secs 2024-04-27T01:04:04.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:04 smithi156 ceph-mon[32679]: pgmap v13449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:04:04.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24339.744889 secs 2024-04-27T01:04:04.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23642.713843 secs 2024-04-27T01:04:04.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:04 smithi092 ceph-mon[29156]: pgmap v13449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:04:04.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24339.744889 secs 2024-04-27T01:04:04.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23642.713843 secs 2024-04-27T01:04:06.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:06 smithi189 ceph-mon[32756]: pgmap v13450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:04:06.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:06 smithi156 ceph-mon[32679]: pgmap v13450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:04:06.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:06 smithi092 ceph-mon[29156]: pgmap v13450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:04:08.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:08 smithi189 ceph-mon[32756]: pgmap v13451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:08.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:08 smithi156 ceph-mon[32679]: pgmap v13451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:08.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:08 smithi092 ceph-mon[29156]: pgmap v13451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:09.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24344.745004 secs 2024-04-27T01:04:09.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23647.713958 secs 2024-04-27T01:04:09.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24344.745004 secs 2024-04-27T01:04:09.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23647.713958 secs 2024-04-27T01:04:09.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24344.745004 secs 2024-04-27T01:04:09.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23647.713958 secs 2024-04-27T01:04:10.533 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:10 smithi189 ceph-mon[32756]: pgmap v13452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:10.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:10 smithi156 ceph-mon[32679]: pgmap v13452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:10.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:10 smithi092 ceph-mon[29156]: pgmap v13452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:12.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:12 smithi189 ceph-mon[32756]: pgmap v13453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:12.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:12 smithi156 ceph-mon[32679]: pgmap v13453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:12.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:12 smithi092 ceph-mon[29156]: pgmap v13453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:14.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:14 smithi189 ceph-mon[32756]: pgmap v13454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:14.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24349.745114 secs 2024-04-27T01:04:14.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23652.714095 secs 2024-04-27T01:04:14.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:14 smithi156 ceph-mon[32679]: pgmap v13454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:14.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24349.745114 secs 2024-04-27T01:04:14.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23652.714095 secs 2024-04-27T01:04:14.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:14 smithi092 ceph-mon[29156]: pgmap v13454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:14.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24349.745114 secs 2024-04-27T01:04:14.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23652.714095 secs 2024-04-27T01:04:16.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:16 smithi189 ceph-mon[32756]: pgmap v13455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:16.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:16 smithi156 ceph-mon[32679]: pgmap v13455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:16.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:16 smithi092 ceph-mon[29156]: pgmap v13455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:18.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:18 smithi189 ceph-mon[32756]: pgmap v13456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:18.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:18 smithi156 ceph-mon[32679]: pgmap v13456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:18.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:18 smithi092 ceph-mon[29156]: pgmap v13456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:19.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24354.745173 secs 2024-04-27T01:04:19.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23657.714242 secs 2024-04-27T01:04:19.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24354.745173 secs 2024-04-27T01:04:19.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23657.714242 secs 2024-04-27T01:04:19.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24354.745173 secs 2024-04-27T01:04:19.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23657.714242 secs 2024-04-27T01:04:20.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:20 smithi189 ceph-mon[32756]: pgmap v13457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:20.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:20 smithi156 ceph-mon[32679]: pgmap v13457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:20.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:20 smithi092 ceph-mon[29156]: pgmap v13457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:22.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:22 smithi189 ceph-mon[32756]: pgmap v13458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:22.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:22 smithi156 ceph-mon[32679]: pgmap v13458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:22.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:22 smithi092 ceph-mon[29156]: pgmap v13458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:24.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:24 smithi189 ceph-mon[32756]: pgmap v13459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:24.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24359.745290 secs 2024-04-27T01:04:24.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23662.714368 secs 2024-04-27T01:04:24.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:24 smithi156 ceph-mon[32679]: pgmap v13459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:24.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24359.745290 secs 2024-04-27T01:04:24.678 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23662.714368 secs 2024-04-27T01:04:24.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:24 smithi092 ceph-mon[29156]: pgmap v13459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:24.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24359.745290 secs 2024-04-27T01:04:24.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23662.714368 secs 2024-04-27T01:04:26.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:26 smithi189 ceph-mon[32756]: pgmap v13460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:26.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:26 smithi156 ceph-mon[32679]: pgmap v13460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:26.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:26 smithi092 ceph-mon[29156]: pgmap v13460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:28.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:28 smithi189 ceph-mon[32756]: pgmap v13461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:28.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:28 smithi156 ceph-mon[32679]: pgmap v13461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:28.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:28 smithi092 ceph-mon[29156]: pgmap v13461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:29.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24364.745407 secs 2024-04-27T01:04:29.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23667.714481 secs 2024-04-27T01:04:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24364.745407 secs 2024-04-27T01:04:29.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23667.714481 secs 2024-04-27T01:04:29.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24364.745407 secs 2024-04-27T01:04:29.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23667.714481 secs 2024-04-27T01:04:30.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:30 smithi189 ceph-mon[32756]: pgmap v13462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:30.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:30 smithi092 ceph-mon[29156]: pgmap v13462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:30.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:30 smithi156 ceph-mon[32679]: pgmap v13462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:32.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:32 smithi189 ceph-mon[32756]: pgmap v13463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:32.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:32 smithi156 ceph-mon[32679]: pgmap v13463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:32.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:32 smithi092 ceph-mon[29156]: pgmap v13463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:34.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:34 smithi189 ceph-mon[32756]: pgmap v13464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:34.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24369.745521 secs 2024-04-27T01:04:34.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23672.714561 secs 2024-04-27T01:04:34.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:34 smithi156 ceph-mon[32679]: pgmap v13464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:34.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24369.745521 secs 2024-04-27T01:04:34.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23672.714561 secs 2024-04-27T01:04:34.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:34 smithi092 ceph-mon[29156]: pgmap v13464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:34.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24369.745521 secs 2024-04-27T01:04:34.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23672.714561 secs 2024-04-27T01:04:36.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:36 smithi189 ceph-mon[32756]: pgmap v13465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:36.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:36 smithi156 ceph-mon[32679]: pgmap v13465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:36.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:36 smithi092 ceph-mon[29156]: pgmap v13465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:38.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:38 smithi189 ceph-mon[32756]: pgmap v13466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:38.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:38 smithi156 ceph-mon[32679]: pgmap v13466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:38.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:38 smithi092 ceph-mon[29156]: pgmap v13466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:39.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24374.745618 secs 2024-04-27T01:04:39.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23677.714677 secs 2024-04-27T01:04:39.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24374.745618 secs 2024-04-27T01:04:39.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23677.714677 secs 2024-04-27T01:04:39.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24374.745618 secs 2024-04-27T01:04:39.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23677.714677 secs 2024-04-27T01:04:40.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:40 smithi189 ceph-mon[32756]: pgmap v13467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:40.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:40 smithi156 ceph-mon[32679]: pgmap v13467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:40.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:40 smithi092 ceph-mon[29156]: pgmap v13467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:42.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:42 smithi189 ceph-mon[32756]: pgmap v13468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:42.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:42 smithi156 ceph-mon[32679]: pgmap v13468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:42.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:42 smithi092 ceph-mon[29156]: pgmap v13468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:44.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:44 smithi189 ceph-mon[32756]: pgmap v13469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:44.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24379.745730 secs 2024-04-27T01:04:44.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23682.714753 secs 2024-04-27T01:04:44.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:44 smithi156 ceph-mon[32679]: pgmap v13469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:44.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24379.745730 secs 2024-04-27T01:04:44.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23682.714753 secs 2024-04-27T01:04:44.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:44 smithi092 ceph-mon[29156]: pgmap v13469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:44.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24379.745730 secs 2024-04-27T01:04:44.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23682.714753 secs 2024-04-27T01:04:46.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:46 smithi189 ceph-mon[32756]: pgmap v13470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:46.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:46 smithi156 ceph-mon[32679]: pgmap v13470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:46.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:46 smithi092 ceph-mon[29156]: pgmap v13470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:48.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:48 smithi189 ceph-mon[32756]: pgmap v13471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:48.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:48 smithi156 ceph-mon[32679]: pgmap v13471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:48.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:48 smithi092 ceph-mon[29156]: pgmap v13471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:49.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24384.745849 secs 2024-04-27T01:04:49.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23687.714892 secs 2024-04-27T01:04:49.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24384.745849 secs 2024-04-27T01:04:49.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23687.714892 secs 2024-04-27T01:04:49.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24384.745849 secs 2024-04-27T01:04:49.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23687.714892 secs 2024-04-27T01:04:50.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:50 smithi189 ceph-mon[32756]: pgmap v13472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:50.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:50 smithi156 ceph-mon[32679]: pgmap v13472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:50.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:50 smithi092 ceph-mon[29156]: pgmap v13472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:52.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:52 smithi189 ceph-mon[32756]: pgmap v13473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:52.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:52 smithi156 ceph-mon[32679]: pgmap v13473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:52.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:52 smithi092 ceph-mon[29156]: pgmap v13473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:54.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:54 smithi189 ceph-mon[32756]: pgmap v13474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:54.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24389.745966 secs 2024-04-27T01:04:54.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23692.715031 secs 2024-04-27T01:04:54.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:54 smithi156 ceph-mon[32679]: pgmap v13474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:54.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24389.745966 secs 2024-04-27T01:04:54.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23692.715031 secs 2024-04-27T01:04:54.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:54 smithi092 ceph-mon[29156]: pgmap v13474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:54.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24389.745966 secs 2024-04-27T01:04:54.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23692.715031 secs 2024-04-27T01:04:55.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:04:55.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:04:55.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:04:56.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:56 smithi189 ceph-mon[32756]: pgmap v13475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:56.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:56 smithi156 ceph-mon[32679]: pgmap v13475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:56.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:56 smithi092 ceph-mon[29156]: pgmap v13475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:04:58.451 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:58 smithi189 ceph-mon[32756]: pgmap v13476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:58.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:58 smithi156 ceph-mon[32679]: pgmap v13476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:04:58.736 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:58 smithi092 ceph-mon[29156]: pgmap v13476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:00.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: pgmap v13477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24394.746080 secs 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: pgmap v13478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: pgmap v13479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:04:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23697.715103 secs 2024-04-27T01:05:00.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: pgmap v13477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24394.746080 secs 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: pgmap v13478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: pgmap v13479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:04:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23697.715103 secs 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: pgmap v13477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24394.746080 secs 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: pgmap v13478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: pgmap v13479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:05:00.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:04:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23697.715103 secs 2024-04-27T01:05:02.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:01 smithi156 ceph-mon[32679]: pgmap v13480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:02.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:01 smithi092 ceph-mon[29156]: pgmap v13480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:02.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:01 smithi189 ceph-mon[32756]: pgmap v13480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:04.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:03 smithi156 ceph-mon[32679]: pgmap v13481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:05:04.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:03 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23702.715228 secs 2024-04-27T01:05:04.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:03 smithi092 ceph-mon[29156]: pgmap v13481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:05:04.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:03 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23702.715228 secs 2024-04-27T01:05:04.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:03 smithi189 ceph-mon[32756]: pgmap v13481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:05:04.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:03 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23702.715228 secs 2024-04-27T01:05:05.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24399.746156 secs 2024-04-27T01:05:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24399.746156 secs 2024-04-27T01:05:05.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24399.746156 secs 2024-04-27T01:05:06.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:05 smithi156 ceph-mon[32679]: pgmap v13482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:05 smithi092 ceph-mon[29156]: pgmap v13482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:05 smithi189 ceph-mon[32756]: pgmap v13482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:05:08.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:07 smithi156 ceph-mon[32679]: pgmap v13483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T01:05:08.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:07 smithi092 ceph-mon[29156]: pgmap v13483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T01:05:08.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:07 smithi189 ceph-mon[32756]: pgmap v13483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T01:05:09.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:08 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23707.715386 secs 2024-04-27T01:05:09.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:08 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23707.715386 secs 2024-04-27T01:05:09.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:08 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23707.715386 secs 2024-04-27T01:05:10.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24404.746271 secs 2024-04-27T01:05:10.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:09 smithi156 ceph-mon[32679]: pgmap v13484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:05:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24404.746271 secs 2024-04-27T01:05:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:09 smithi092 ceph-mon[29156]: pgmap v13484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:05:10.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24404.746271 secs 2024-04-27T01:05:10.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:09 smithi189 ceph-mon[32756]: pgmap v13484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:05:12.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:11 smithi156 ceph-mon[32679]: pgmap v13485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:12.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:11 smithi092 ceph-mon[29156]: pgmap v13485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:12.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:11 smithi189 ceph-mon[32756]: pgmap v13485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:14.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:13 smithi156 ceph-mon[32679]: pgmap v13486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:14.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:13 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24409.746395 secs 2024-04-27T01:05:14.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:13 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23712.715468 secs 2024-04-27T01:05:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:13 smithi092 ceph-mon[29156]: pgmap v13486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:13 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24409.746395 secs 2024-04-27T01:05:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:13 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23712.715468 secs 2024-04-27T01:05:14.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:13 smithi189 ceph-mon[32756]: pgmap v13486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:14.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:13 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24409.746395 secs 2024-04-27T01:05:14.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:13 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23712.715468 secs 2024-04-27T01:05:16.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:15 smithi156 ceph-mon[32679]: pgmap v13487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:16.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:15 smithi092 ceph-mon[29156]: pgmap v13487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:16.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:15 smithi189 ceph-mon[32756]: pgmap v13487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:18.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:17 smithi156 ceph-mon[32679]: pgmap v13488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:18.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:17 smithi092 ceph-mon[29156]: pgmap v13488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:18.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:17 smithi189 ceph-mon[32756]: pgmap v13488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:19.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:18 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24414.746511 secs 2024-04-27T01:05:19.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:18 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23717.715579 secs 2024-04-27T01:05:19.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:18 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24414.746511 secs 2024-04-27T01:05:19.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:18 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23717.715579 secs 2024-04-27T01:05:19.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:18 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24414.746511 secs 2024-04-27T01:05:19.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:18 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23717.715579 secs 2024-04-27T01:05:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:19 smithi092 ceph-mon[29156]: pgmap v13489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:20.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:19 smithi189 ceph-mon[32756]: pgmap v13489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:20.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:19 smithi156 ceph-mon[32679]: pgmap v13489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:22.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:21 smithi092 ceph-mon[29156]: pgmap v13490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:22.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:21 smithi189 ceph-mon[32756]: pgmap v13490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:22.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:21 smithi156 ceph-mon[32679]: pgmap v13490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:24.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:23 smithi092 ceph-mon[29156]: pgmap v13491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:24.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:23 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24419.746623 secs 2024-04-27T01:05:24.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:23 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23722.715689 secs 2024-04-27T01:05:24.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:23 smithi189 ceph-mon[32756]: pgmap v13491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:24.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:23 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24419.746623 secs 2024-04-27T01:05:24.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:23 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23722.715689 secs 2024-04-27T01:05:24.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:23 smithi156 ceph-mon[32679]: pgmap v13491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:24.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:23 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24419.746623 secs 2024-04-27T01:05:24.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:23 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23722.715689 secs 2024-04-27T01:05:26.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:25 smithi092 ceph-mon[29156]: pgmap v13492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:26.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:25 smithi189 ceph-mon[32756]: pgmap v13492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:26.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:25 smithi156 ceph-mon[32679]: pgmap v13492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:28.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:27 smithi092 ceph-mon[29156]: pgmap v13493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:28.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:27 smithi189 ceph-mon[32756]: pgmap v13493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:28.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:27 smithi156 ceph-mon[32679]: pgmap v13493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:29.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:28 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24424.746737 secs 2024-04-27T01:05:29.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:28 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23727.715824 secs 2024-04-27T01:05:29.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:28 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24424.746737 secs 2024-04-27T01:05:29.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:28 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23727.715824 secs 2024-04-27T01:05:29.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:28 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24424.746737 secs 2024-04-27T01:05:29.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:28 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23727.715824 secs 2024-04-27T01:05:30.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:29 smithi092 ceph-mon[29156]: pgmap v13494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:30.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:29 smithi189 ceph-mon[32756]: pgmap v13494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:30.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:29 smithi156 ceph-mon[32679]: pgmap v13494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:32.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:31 smithi092 ceph-mon[29156]: pgmap v13495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:32.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:31 smithi189 ceph-mon[32756]: pgmap v13495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:32.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:31 smithi156 ceph-mon[32679]: pgmap v13495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:34.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:33 smithi092 ceph-mon[29156]: pgmap v13496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:34.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:33 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24429.746813 secs 2024-04-27T01:05:34.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:33 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23732.715905 secs 2024-04-27T01:05:34.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:33 smithi189 ceph-mon[32756]: pgmap v13496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:34.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:33 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24429.746813 secs 2024-04-27T01:05:34.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:33 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23732.715905 secs 2024-04-27T01:05:34.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:33 smithi156 ceph-mon[32679]: pgmap v13496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:34.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:33 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24429.746813 secs 2024-04-27T01:05:34.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:33 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23732.715905 secs 2024-04-27T01:05:36.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:35 smithi092 ceph-mon[29156]: pgmap v13497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:36.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:35 smithi189 ceph-mon[32756]: pgmap v13497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:36.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:35 smithi156 ceph-mon[32679]: pgmap v13497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:37.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:05:37.282+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:05:37.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:05:37.282+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:05:37.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:05:37.282+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:05:37.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:05:37.282+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:05:37.736 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:05:37.282+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:05:38.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:37 smithi092 ceph-mon[29156]: pgmap v13498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:38.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:37 smithi189 ceph-mon[32756]: pgmap v13498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:38.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:37 smithi156 ceph-mon[32679]: pgmap v13498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:39.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:38 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24434.746924 secs 2024-04-27T01:05:39.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:38 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23737.715969 secs 2024-04-27T01:05:39.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:38 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24434.746924 secs 2024-04-27T01:05:39.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:38 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23737.715969 secs 2024-04-27T01:05:39.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:38 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24434.746924 secs 2024-04-27T01:05:39.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:38 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23737.715969 secs 2024-04-27T01:05:40.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:39 smithi092 ceph-mon[29156]: pgmap v13499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:40.281 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:39 smithi189 ceph-mon[32756]: pgmap v13499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:40.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:39 smithi156 ceph-mon[32679]: pgmap v13499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:42.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:41 smithi092 ceph-mon[29156]: pgmap v13500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:42.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:41 smithi189 ceph-mon[32756]: pgmap v13500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:42.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:41 smithi156 ceph-mon[32679]: pgmap v13500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:44.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:43 smithi092 ceph-mon[29156]: pgmap v13501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:44.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:43 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24439.746982 secs 2024-04-27T01:05:44.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:43 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23742.716065 secs 2024-04-27T01:05:44.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:43 smithi189 ceph-mon[32756]: pgmap v13501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:44.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:43 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24439.746982 secs 2024-04-27T01:05:44.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:43 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23742.716065 secs 2024-04-27T01:05:44.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:43 smithi156 ceph-mon[32679]: pgmap v13501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:44.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:43 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24439.746982 secs 2024-04-27T01:05:44.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:43 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23742.716065 secs 2024-04-27T01:05:46.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:45 smithi092 ceph-mon[29156]: pgmap v13502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:46.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:45 smithi189 ceph-mon[32756]: pgmap v13502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:46.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:45 smithi156 ceph-mon[32679]: pgmap v13502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:48.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:47 smithi189 ceph-mon[32756]: pgmap v13503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:48.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:47 smithi156 ceph-mon[32679]: pgmap v13503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:48.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:47 smithi092 ceph-mon[29156]: pgmap v13503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:05:49.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24444.747110 secs 2024-04-27T01:05:49.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23747.716132 secs 2024-04-27T01:05:49.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24444.747110 secs 2024-04-27T01:05:49.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23747.716132 secs 2024-04-27T01:05:49.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24444.747110 secs 2024-04-27T01:05:49.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23747.716132 secs 2024-04-27T01:05:50.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:50 smithi189 ceph-mon[32756]: pgmap v13504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:50.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:50 smithi156 ceph-mon[32679]: pgmap v13504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:50.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:50 smithi092 ceph-mon[29156]: pgmap v13504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:05:52.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:52 smithi189 ceph-mon[32756]: pgmap v13505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:52.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:52 smithi156 ceph-mon[32679]: pgmap v13505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:52.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:52 smithi092 ceph-mon[29156]: pgmap v13505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:54.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:54 smithi189 ceph-mon[32756]: pgmap v13506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:54.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24449.747242 secs 2024-04-27T01:05:54.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23752.716233 secs 2024-04-27T01:05:54.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:54 smithi156 ceph-mon[32679]: pgmap v13506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:54.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24449.747242 secs 2024-04-27T01:05:54.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23752.716233 secs 2024-04-27T01:05:54.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:54 smithi092 ceph-mon[29156]: pgmap v13506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:54.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24449.747242 secs 2024-04-27T01:05:54.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23752.716233 secs 2024-04-27T01:05:56.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:56 smithi189 ceph-mon[32756]: pgmap v13507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:56.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:56 smithi156 ceph-mon[32679]: pgmap v13507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:56.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:56 smithi092 ceph-mon[29156]: pgmap v13507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:05:58.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:58 smithi189 ceph-mon[32756]: pgmap v13508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:58.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:58 smithi156 ceph-mon[32679]: pgmap v13508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:58.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:58 smithi092 ceph-mon[29156]: pgmap v13508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:05:59.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24454.747385 secs 2024-04-27T01:05:59.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:05:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23757.716327 secs 2024-04-27T01:05:59.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24454.747385 secs 2024-04-27T01:05:59.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:05:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23757.716327 secs 2024-04-27T01:05:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24454.747385 secs 2024-04-27T01:05:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:05:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23757.716327 secs 2024-04-27T01:06:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:00 smithi189 ceph-mon[32756]: pgmap v13509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:06:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:06:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:06:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:06:00.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:00 smithi092 ceph-mon[29156]: pgmap v13509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:00.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:06:00.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:06:00.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:06:00.387 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:06:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:00 smithi156 ceph-mon[32679]: pgmap v13509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:06:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:06:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:06:00.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:06:01.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:01 smithi189 ceph-mon[32756]: pgmap v13510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:06:01.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:01 smithi189 ceph-mon[32756]: pgmap v13511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:01.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:01 smithi156 ceph-mon[32679]: pgmap v13510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:06:01.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:01 smithi156 ceph-mon[32679]: pgmap v13511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:01 smithi092 ceph-mon[29156]: pgmap v13510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:06:01.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:01 smithi092 ceph-mon[29156]: pgmap v13511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:03.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:03 smithi189 ceph-mon[32756]: pgmap v13512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:03.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:03 smithi156 ceph-mon[32679]: pgmap v13512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:03.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:03 smithi092 ceph-mon[29156]: pgmap v13512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:04.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24459.747522 secs 2024-04-27T01:06:04.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23762.716449 secs 2024-04-27T01:06:04.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24459.747522 secs 2024-04-27T01:06:04.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23762.716449 secs 2024-04-27T01:06:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24459.747522 secs 2024-04-27T01:06:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23762.716449 secs 2024-04-27T01:06:05.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:05 smithi189 ceph-mon[32756]: pgmap v13513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:05 smithi156 ceph-mon[32679]: pgmap v13513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:05.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:05 smithi092 ceph-mon[29156]: pgmap v13513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:07.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:07 smithi189 ceph-mon[32756]: pgmap v13514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:07.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:07 smithi156 ceph-mon[32679]: pgmap v13514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:07.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:07 smithi092 ceph-mon[29156]: pgmap v13514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:06:09.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:09 smithi189 ceph-mon[32756]: pgmap v13515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:06:09.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24464.747595 secs 2024-04-27T01:06:09.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23767.716577 secs 2024-04-27T01:06:09.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:09 smithi156 ceph-mon[32679]: pgmap v13515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:06:09.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24464.747595 secs 2024-04-27T01:06:09.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23767.716577 secs 2024-04-27T01:06:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:09 smithi092 ceph-mon[29156]: pgmap v13515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:06:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24464.747595 secs 2024-04-27T01:06:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23767.716577 secs 2024-04-27T01:06:11.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:11 smithi189 ceph-mon[32756]: pgmap v13516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:06:11.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:11 smithi156 ceph-mon[32679]: pgmap v13516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:06:11.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:11 smithi092 ceph-mon[29156]: pgmap v13516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:06:13.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:13 smithi189 ceph-mon[32756]: pgmap v13517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:13.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:13 smithi156 ceph-mon[32679]: pgmap v13517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:13.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:13 smithi092 ceph-mon[29156]: pgmap v13517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:14.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24469.747717 secs 2024-04-27T01:06:14.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23772.716659 secs 2024-04-27T01:06:14.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24469.747717 secs 2024-04-27T01:06:14.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23772.716659 secs 2024-04-27T01:06:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24469.747717 secs 2024-04-27T01:06:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23772.716659 secs 2024-04-27T01:06:15.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:15 smithi189 ceph-mon[32756]: pgmap v13518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:15.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:15 smithi156 ceph-mon[32679]: pgmap v13518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:15.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:15 smithi092 ceph-mon[29156]: pgmap v13518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:17.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:17 smithi189 ceph-mon[32756]: pgmap v13519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:17.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:17 smithi156 ceph-mon[32679]: pgmap v13519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:17.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:17 smithi092 ceph-mon[29156]: pgmap v13519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:19.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:19 smithi189 ceph-mon[32756]: pgmap v13520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:19.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24474.747853 secs 2024-04-27T01:06:19.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23777.716797 secs 2024-04-27T01:06:19.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:19 smithi156 ceph-mon[32679]: pgmap v13520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:19.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24474.747853 secs 2024-04-27T01:06:19.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23777.716797 secs 2024-04-27T01:06:19.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:19 smithi092 ceph-mon[29156]: pgmap v13520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:06:19.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24474.747853 secs 2024-04-27T01:06:19.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23777.716797 secs 2024-04-27T01:06:21.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:21 smithi189 ceph-mon[32756]: pgmap v13521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:21.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:21 smithi156 ceph-mon[32679]: pgmap v13521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:21.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:21 smithi092 ceph-mon[29156]: pgmap v13521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:06:23.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:23 smithi189 ceph-mon[32756]: pgmap v13522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:23.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:23 smithi156 ceph-mon[32679]: pgmap v13522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:23.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:23 smithi092 ceph-mon[29156]: pgmap v13522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:24.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24479.747967 secs 2024-04-27T01:06:24.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23782.716869 secs 2024-04-27T01:06:24.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24479.747967 secs 2024-04-27T01:06:24.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23782.716869 secs 2024-04-27T01:06:24.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24479.747967 secs 2024-04-27T01:06:24.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23782.716869 secs 2024-04-27T01:06:25.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:25 smithi189 ceph-mon[32756]: pgmap v13523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:25.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:25 smithi156 ceph-mon[32679]: pgmap v13523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:25.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:25 smithi092 ceph-mon[29156]: pgmap v13523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:27.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:27 smithi189 ceph-mon[32756]: pgmap v13524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:27.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:27 smithi156 ceph-mon[32679]: pgmap v13524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:27.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:27 smithi092 ceph-mon[29156]: pgmap v13524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:29.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:29 smithi189 ceph-mon[32756]: pgmap v13525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:29.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24484.748085 secs 2024-04-27T01:06:29.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23787.716983 secs 2024-04-27T01:06:29.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:29 smithi156 ceph-mon[32679]: pgmap v13525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:29.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24484.748085 secs 2024-04-27T01:06:29.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23787.716983 secs 2024-04-27T01:06:29.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:29 smithi092 ceph-mon[29156]: pgmap v13525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:29.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24484.748085 secs 2024-04-27T01:06:29.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23787.716983 secs 2024-04-27T01:06:31.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:31 smithi189 ceph-mon[32756]: pgmap v13526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:31.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:31 smithi156 ceph-mon[32679]: pgmap v13526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:31.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:31 smithi092 ceph-mon[29156]: pgmap v13526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:33.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:33 smithi189 ceph-mon[32756]: pgmap v13527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:33.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:33 smithi156 ceph-mon[32679]: pgmap v13527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:33.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:33 smithi092 ceph-mon[29156]: pgmap v13527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:34.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24489.748207 secs 2024-04-27T01:06:34.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23792.717101 secs 2024-04-27T01:06:34.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24489.748207 secs 2024-04-27T01:06:34.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23792.717101 secs 2024-04-27T01:06:34.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24489.748207 secs 2024-04-27T01:06:34.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23792.717101 secs 2024-04-27T01:06:35.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:35 smithi189 ceph-mon[32756]: pgmap v13528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:35.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:35 smithi156 ceph-mon[32679]: pgmap v13528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:35.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:35 smithi092 ceph-mon[29156]: pgmap v13528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:37.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:37 smithi189 ceph-mon[32756]: pgmap v13529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:37.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:37 smithi156 ceph-mon[32679]: pgmap v13529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:37.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:37 smithi092 ceph-mon[29156]: pgmap v13529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:06:39.344+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:06:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:06:39.344+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:06:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:06:39.344+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:06:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:06:39.344+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 190 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:06:39.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:39 smithi189 ceph-mon[32756]: pgmap v13530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:39.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:39 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 24494.748319 secs 2024-04-27T01:06:39.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:39 smithi189 ceph-mon[32756]: slow request 361.444465 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:06:39.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23797.717218 secs 2024-04-27T01:06:39.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:39 smithi156 ceph-mon[32679]: pgmap v13530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:39.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:39 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 24494.748319 secs 2024-04-27T01:06:39.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:39 smithi156 ceph-mon[32679]: slow request 361.444465 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:06:39.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23797.717218 secs 2024-04-27T01:06:39.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:39 smithi092 ceph-mon[29156]: pgmap v13530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:39.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:39 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 24494.748319 secs 2024-04-27T01:06:39.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:39 smithi092 ceph-mon[29156]: slow request 361.444465 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:06:39.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23797.717218 secs 2024-04-27T01:06:41.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:41 smithi189 ceph-mon[32756]: pgmap v13531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:41.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:41 smithi156 ceph-mon[32679]: pgmap v13531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:41.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:41 smithi092 ceph-mon[29156]: pgmap v13531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:43.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:43 smithi156 ceph-mon[32679]: pgmap v13532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:43.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:43 smithi092 ceph-mon[29156]: pgmap v13532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:43.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:43 smithi189 ceph-mon[32756]: pgmap v13532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:44.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24499.748421 secs 2024-04-27T01:06:44.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23802.717333 secs 2024-04-27T01:06:44.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24499.748421 secs 2024-04-27T01:06:44.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23802.717333 secs 2024-04-27T01:06:44.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24499.748421 secs 2024-04-27T01:06:44.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23802.717333 secs 2024-04-27T01:06:45.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:45 smithi156 ceph-mon[32679]: pgmap v13533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:45.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:45 smithi092 ceph-mon[29156]: pgmap v13533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:45.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:45 smithi189 ceph-mon[32756]: pgmap v13533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:47.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:47 smithi156 ceph-mon[32679]: pgmap v13534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:47.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:47 smithi092 ceph-mon[29156]: pgmap v13534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:47.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:47 smithi189 ceph-mon[32756]: pgmap v13534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:49.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:49 smithi156 ceph-mon[32679]: pgmap v13535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:49.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24504.748539 secs 2024-04-27T01:06:49.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23807.717449 secs 2024-04-27T01:06:49.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:49 smithi092 ceph-mon[29156]: pgmap v13535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:49.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24504.748539 secs 2024-04-27T01:06:49.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23807.717449 secs 2024-04-27T01:06:49.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:49 smithi189 ceph-mon[32756]: pgmap v13535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:49.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24504.748539 secs 2024-04-27T01:06:49.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23807.717449 secs 2024-04-27T01:06:51.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:51 smithi156 ceph-mon[32679]: pgmap v13536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:51.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:51 smithi092 ceph-mon[29156]: pgmap v13536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:51.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:51 smithi189 ceph-mon[32756]: pgmap v13536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:53.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:53 smithi156 ceph-mon[32679]: pgmap v13537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:53.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:53 smithi092 ceph-mon[29156]: pgmap v13537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:53.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:53 smithi189 ceph-mon[32756]: pgmap v13537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:54.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24509.748652 secs 2024-04-27T01:06:54.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23812.717570 secs 2024-04-27T01:06:54.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24509.748652 secs 2024-04-27T01:06:54.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23812.717570 secs 2024-04-27T01:06:54.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24509.748652 secs 2024-04-27T01:06:54.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23812.717570 secs 2024-04-27T01:06:55.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:55 smithi156 ceph-mon[32679]: pgmap v13538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:55.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:55 smithi092 ceph-mon[29156]: pgmap v13538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:55.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:55 smithi189 ceph-mon[32756]: pgmap v13538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:06:57.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:57 smithi156 ceph-mon[32679]: pgmap v13539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:57.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:57 smithi092 ceph-mon[29156]: pgmap v13539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:57.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:57 smithi189 ceph-mon[32756]: pgmap v13539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:59.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:59 smithi156 ceph-mon[32679]: pgmap v13540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:59.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24514.748765 secs 2024-04-27T01:06:59.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:06:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23817.717652 secs 2024-04-27T01:06:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:59 smithi092 ceph-mon[29156]: pgmap v13540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24514.748765 secs 2024-04-27T01:06:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:06:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23817.717652 secs 2024-04-27T01:06:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:59 smithi189 ceph-mon[32756]: pgmap v13540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:06:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24514.748765 secs 2024-04-27T01:06:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:06:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23817.717652 secs 2024-04-27T01:07:00.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:07:00.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:07:00.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:07:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:01 smithi092 ceph-mon[29156]: pgmap v13541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:07:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:07:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:07:01.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:01 smithi189 ceph-mon[32756]: pgmap v13541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:01.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:07:01.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:07:01.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:07:01.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:01 smithi156 ceph-mon[32679]: pgmap v13541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:01.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:07:01.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:07:01.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:07:02.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:02 smithi092 ceph-mon[29156]: pgmap v13542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:07:02.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:02 smithi092 ceph-mon[29156]: pgmap v13543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:02 smithi189 ceph-mon[32756]: pgmap v13542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:07:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:02 smithi189 ceph-mon[32756]: pgmap v13543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:02.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:02 smithi156 ceph-mon[32679]: pgmap v13542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:07:02.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:02 smithi156 ceph-mon[32679]: pgmap v13543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:04 smithi092 ceph-mon[29156]: pgmap v13544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:07:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24519.748881 secs 2024-04-27T01:07:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23822.717808 secs 2024-04-27T01:07:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:04 smithi189 ceph-mon[32756]: pgmap v13544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:07:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24519.748881 secs 2024-04-27T01:07:04.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23822.717808 secs 2024-04-27T01:07:04.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:04 smithi156 ceph-mon[32679]: pgmap v13544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:07:04.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24519.748881 secs 2024-04-27T01:07:04.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23822.717808 secs 2024-04-27T01:07:06.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:06 smithi092 ceph-mon[29156]: pgmap v13545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:06.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:06 smithi189 ceph-mon[32756]: pgmap v13545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:06.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:06 smithi156 ceph-mon[32679]: pgmap v13545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:08.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:08 smithi092 ceph-mon[29156]: pgmap v13546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:08.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:08 smithi189 ceph-mon[32756]: pgmap v13546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:08.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:08 smithi156 ceph-mon[32679]: pgmap v13546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:07:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24524.749002 secs 2024-04-27T01:07:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:09 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 23827.717897 secs 2024-04-27T01:07:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:09 smithi092 ceph-mon[29156]: slow request 5763.137445 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:09.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24524.749002 secs 2024-04-27T01:07:09.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:09 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 23827.717897 secs 2024-04-27T01:07:09.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:09 smithi189 ceph-mon[32756]: slow request 5763.137445 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:09.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24524.749002 secs 2024-04-27T01:07:09.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:09 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 23827.717897 secs 2024-04-27T01:07:09.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:09 smithi156 ceph-mon[32679]: slow request 5763.137445 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:10.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:10 smithi092 ceph-mon[29156]: pgmap v13547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:07:10.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:10 smithi189 ceph-mon[32756]: pgmap v13547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:07:10.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:10 smithi156 ceph-mon[32679]: pgmap v13547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:07:12.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:12 smithi092 ceph-mon[29156]: pgmap v13548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:07:12.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:12 smithi189 ceph-mon[32756]: pgmap v13548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:07:12.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:12 smithi156 ceph-mon[32679]: pgmap v13548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:07:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:14 smithi092 ceph-mon[29156]: pgmap v13549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24529.749085 secs 2024-04-27T01:07:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23832.718015 secs 2024-04-27T01:07:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:14 smithi189 ceph-mon[32756]: pgmap v13549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24529.749085 secs 2024-04-27T01:07:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23832.718015 secs 2024-04-27T01:07:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:14 smithi156 ceph-mon[32679]: pgmap v13549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24529.749085 secs 2024-04-27T01:07:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23832.718015 secs 2024-04-27T01:07:16.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:16 smithi092 ceph-mon[29156]: pgmap v13550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:16.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:16 smithi189 ceph-mon[32756]: pgmap v13550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:16.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:16 smithi156 ceph-mon[32679]: pgmap v13550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:18.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:18 smithi092 ceph-mon[29156]: pgmap v13551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:18.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:18 smithi189 ceph-mon[32756]: pgmap v13551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:18.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:18 smithi156 ceph-mon[32679]: pgmap v13551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:19.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24534.749167 secs 2024-04-27T01:07:19.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23837.718132 secs 2024-04-27T01:07:19.575 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24534.749167 secs 2024-04-27T01:07:19.575 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23837.718132 secs 2024-04-27T01:07:19.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24534.749167 secs 2024-04-27T01:07:19.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23837.718132 secs 2024-04-27T01:07:20.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:20 smithi092 ceph-mon[29156]: pgmap v13552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:20.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:20 smithi189 ceph-mon[32756]: pgmap v13552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:20.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:20 smithi156 ceph-mon[32679]: pgmap v13552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:22.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:22 smithi092 ceph-mon[29156]: pgmap v13553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:22.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:22 smithi189 ceph-mon[32756]: pgmap v13553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:22.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:22 smithi156 ceph-mon[32679]: pgmap v13553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:24.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:24 smithi092 ceph-mon[29156]: pgmap v13554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:24.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24539.749224 secs 2024-04-27T01:07:24.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23842.718250 secs 2024-04-27T01:07:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:24 smithi189 ceph-mon[32756]: pgmap v13554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24539.749224 secs 2024-04-27T01:07:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23842.718250 secs 2024-04-27T01:07:24.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:24 smithi156 ceph-mon[32679]: pgmap v13554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:24.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24539.749224 secs 2024-04-27T01:07:24.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23842.718250 secs 2024-04-27T01:07:26.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:26 smithi092 ceph-mon[29156]: pgmap v13555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:26.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:26 smithi189 ceph-mon[32756]: pgmap v13555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:26.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:26 smithi156 ceph-mon[32679]: pgmap v13555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:28.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:28 smithi092 ceph-mon[29156]: pgmap v13556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:28.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:28 smithi189 ceph-mon[32756]: pgmap v13556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:28.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:28 smithi156 ceph-mon[32679]: pgmap v13556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:29.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24544.749342 secs 2024-04-27T01:07:29.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23847.718356 secs 2024-04-27T01:07:29.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24544.749342 secs 2024-04-27T01:07:29.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23847.718356 secs 2024-04-27T01:07:29.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24544.749342 secs 2024-04-27T01:07:29.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23847.718356 secs 2024-04-27T01:07:30.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:30 smithi189 ceph-mon[32756]: pgmap v13557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:30.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:30 smithi156 ceph-mon[32679]: pgmap v13557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:30.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:30 smithi092 ceph-mon[29156]: pgmap v13557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:32.537 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:32 smithi092 ceph-mon[29156]: pgmap v13558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:32.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:32 smithi189 ceph-mon[32756]: pgmap v13558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:32.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:32 smithi156 ceph-mon[32679]: pgmap v13558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:34.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:34 smithi189 ceph-mon[32756]: pgmap v13559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:34.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24549.749481 secs 2024-04-27T01:07:34.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23852.718499 secs 2024-04-27T01:07:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:34 smithi156 ceph-mon[32679]: pgmap v13559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:34.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24549.749481 secs 2024-04-27T01:07:34.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23852.718499 secs 2024-04-27T01:07:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:34 smithi092 ceph-mon[29156]: pgmap v13559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24549.749481 secs 2024-04-27T01:07:34.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23852.718499 secs 2024-04-27T01:07:36.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:36 smithi189 ceph-mon[32756]: pgmap v13560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:36.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:36 smithi156 ceph-mon[32679]: pgmap v13560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:36.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:36 smithi092 ceph-mon[29156]: pgmap v13560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:38.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:38 smithi189 ceph-mon[32756]: pgmap v13561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:38.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:38 smithi156 ceph-mon[32679]: pgmap v13561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:38.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:38 smithi092 ceph-mon[29156]: pgmap v13561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:39.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24554.749619 secs 2024-04-27T01:07:39.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:39 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 23857.718623 secs 2024-04-27T01:07:39.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:39 smithi189 ceph-mon[32756]: slow request 721.762942 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:39.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24554.749619 secs 2024-04-27T01:07:39.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:39 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 23857.718623 secs 2024-04-27T01:07:39.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:39 smithi156 ceph-mon[32679]: slow request 721.762942 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24554.749619 secs 2024-04-27T01:07:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:39 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 23857.718623 secs 2024-04-27T01:07:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:39 smithi092 ceph-mon[29156]: slow request 721.762942 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:07:40.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:40 smithi189 ceph-mon[32756]: pgmap v13562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:40.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:40 smithi156 ceph-mon[32679]: pgmap v13562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:40.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:40 smithi092 ceph-mon[29156]: pgmap v13562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:42.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:42 smithi189 ceph-mon[32756]: pgmap v13563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:42.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:42 smithi156 ceph-mon[32679]: pgmap v13563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:42.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:42 smithi092 ceph-mon[29156]: pgmap v13563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:44.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:44 smithi189 ceph-mon[32756]: pgmap v13564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:44.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24559.749737 secs 2024-04-27T01:07:44.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23862.718742 secs 2024-04-27T01:07:44.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:44 smithi156 ceph-mon[32679]: pgmap v13564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:44.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24559.749737 secs 2024-04-27T01:07:44.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23862.718742 secs 2024-04-27T01:07:44.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:44 smithi092 ceph-mon[29156]: pgmap v13564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:44.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24559.749737 secs 2024-04-27T01:07:44.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23862.718742 secs 2024-04-27T01:07:46.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:46 smithi189 ceph-mon[32756]: pgmap v13565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:46.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:46 smithi156 ceph-mon[32679]: pgmap v13565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:46.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:46 smithi092 ceph-mon[29156]: pgmap v13565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:48.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:48 smithi189 ceph-mon[32756]: pgmap v13566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:48.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:48 smithi156 ceph-mon[32679]: pgmap v13566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:48.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:48 smithi092 ceph-mon[29156]: pgmap v13566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:49.575 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24564.749854 secs 2024-04-27T01:07:49.575 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23867.718859 secs 2024-04-27T01:07:49.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24564.749854 secs 2024-04-27T01:07:49.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23867.718859 secs 2024-04-27T01:07:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24564.749854 secs 2024-04-27T01:07:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23867.718859 secs 2024-04-27T01:07:50.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:50 smithi189 ceph-mon[32756]: pgmap v13567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:50.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:50 smithi156 ceph-mon[32679]: pgmap v13567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:50.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:50 smithi092 ceph-mon[29156]: pgmap v13567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:52.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:52 smithi189 ceph-mon[32756]: pgmap v13568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:52.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:52 smithi156 ceph-mon[32679]: pgmap v13568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:52.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:52 smithi092 ceph-mon[29156]: pgmap v13568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:54.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:54 smithi189 ceph-mon[32756]: pgmap v13569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:54.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24569.749992 secs 2024-04-27T01:07:54.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23872.718998 secs 2024-04-27T01:07:54.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:54 smithi156 ceph-mon[32679]: pgmap v13569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:54.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24569.749992 secs 2024-04-27T01:07:54.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23872.718998 secs 2024-04-27T01:07:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:54 smithi092 ceph-mon[29156]: pgmap v13569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24569.749992 secs 2024-04-27T01:07:54.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23872.718998 secs 2024-04-27T01:07:56.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:56 smithi189 ceph-mon[32756]: pgmap v13570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:56.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:56 smithi156 ceph-mon[32679]: pgmap v13570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:56.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:56 smithi092 ceph-mon[29156]: pgmap v13570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:07:58.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:58 smithi189 ceph-mon[32756]: pgmap v13571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:58.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:58 smithi156 ceph-mon[32679]: pgmap v13571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:58.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:58 smithi092 ceph-mon[29156]: pgmap v13571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:07:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24574.750092 secs 2024-04-27T01:07:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:07:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23877.719116 secs 2024-04-27T01:07:59.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24574.750092 secs 2024-04-27T01:07:59.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:07:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23877.719116 secs 2024-04-27T01:07:59.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24574.750092 secs 2024-04-27T01:07:59.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:07:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23877.719116 secs 2024-04-27T01:08:00.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:00 smithi189 ceph-mon[32756]: pgmap v13572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:00.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:00 smithi156 ceph-mon[32679]: pgmap v13572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:00.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:00 smithi092 ceph-mon[29156]: pgmap v13572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:01.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:08:01.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:08:01.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:08:01.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:08:01.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:08:01.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:08:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:02 smithi189 ceph-mon[32756]: pgmap v13573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:08:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:02 smithi189 ceph-mon[32756]: pgmap v13574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:08:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:02 smithi189 ceph-mon[32756]: pgmap v13575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:02.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:08:02.635 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:02 smithi092 ceph-mon[29156]: pgmap v13573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:02.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:08:02.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:02 smithi092 ceph-mon[29156]: pgmap v13574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:08:02.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:02 smithi092 ceph-mon[29156]: pgmap v13575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:02.636 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:08:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:02 smithi156 ceph-mon[32679]: pgmap v13573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:08:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:02 smithi156 ceph-mon[32679]: pgmap v13574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:08:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:02 smithi156 ceph-mon[32679]: pgmap v13575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:08:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:04 smithi189 ceph-mon[32756]: pgmap v13576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24579.750225 secs 2024-04-27T01:08:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23882.719229 secs 2024-04-27T01:08:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:04 smithi156 ceph-mon[32679]: pgmap v13576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:04.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24579.750225 secs 2024-04-27T01:08:04.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23882.719229 secs 2024-04-27T01:08:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:04 smithi092 ceph-mon[29156]: pgmap v13576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24579.750225 secs 2024-04-27T01:08:04.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23882.719229 secs 2024-04-27T01:08:06.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:06 smithi189 ceph-mon[32756]: pgmap v13577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:06.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:06 smithi156 ceph-mon[32679]: pgmap v13577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:06.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:06 smithi092 ceph-mon[29156]: pgmap v13577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:08.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:08 smithi189 ceph-mon[32756]: pgmap v13578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:08.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:08 smithi156 ceph-mon[32679]: pgmap v13578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:08.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:08 smithi092 ceph-mon[29156]: pgmap v13578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:08:09.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24584.750325 secs 2024-04-27T01:08:09.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23887.719380 secs 2024-04-27T01:08:09.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24584.750325 secs 2024-04-27T01:08:09.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23887.719380 secs 2024-04-27T01:08:09.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24584.750325 secs 2024-04-27T01:08:09.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23887.719380 secs 2024-04-27T01:08:10.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:10 smithi189 ceph-mon[32756]: pgmap v13579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:10.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:10 smithi156 ceph-mon[32679]: pgmap v13579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:10.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:10 smithi092 ceph-mon[29156]: pgmap v13579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:08:12.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:12 smithi189 ceph-mon[32756]: pgmap v13580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:08:12.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:12 smithi156 ceph-mon[32679]: pgmap v13580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:08:12.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:12 smithi092 ceph-mon[29156]: pgmap v13580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:08:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:14 smithi189 ceph-mon[32756]: pgmap v13581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24589.750462 secs 2024-04-27T01:08:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23892.719531 secs 2024-04-27T01:08:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:14 smithi156 ceph-mon[32679]: pgmap v13581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24589.750462 secs 2024-04-27T01:08:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23892.719531 secs 2024-04-27T01:08:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:14 smithi092 ceph-mon[29156]: pgmap v13581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24589.750462 secs 2024-04-27T01:08:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23892.719531 secs 2024-04-27T01:08:16.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:16 smithi156 ceph-mon[32679]: pgmap v13582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:16.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:16 smithi092 ceph-mon[29156]: pgmap v13582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:16.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:16 smithi189 ceph-mon[32756]: pgmap v13582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:18.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:18 smithi189 ceph-mon[32756]: pgmap v13583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:18.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:18 smithi156 ceph-mon[32679]: pgmap v13583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:18.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:18 smithi092 ceph-mon[29156]: pgmap v13583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:19.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24594.750541 secs 2024-04-27T01:08:19.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23897.719649 secs 2024-04-27T01:08:19.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24594.750541 secs 2024-04-27T01:08:19.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23897.719649 secs 2024-04-27T01:08:19.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24594.750541 secs 2024-04-27T01:08:19.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23897.719649 secs 2024-04-27T01:08:20.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:20 smithi189 ceph-mon[32756]: pgmap v13584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:20.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:20 smithi156 ceph-mon[32679]: pgmap v13584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:20.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:20 smithi092 ceph-mon[29156]: pgmap v13584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:22.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:22 smithi189 ceph-mon[32756]: pgmap v13585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:22.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:22 smithi156 ceph-mon[32679]: pgmap v13585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:22.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:22 smithi092 ceph-mon[29156]: pgmap v13585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:24 smithi189 ceph-mon[32756]: pgmap v13586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24599.750653 secs 2024-04-27T01:08:24.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23902.719720 secs 2024-04-27T01:08:24.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:24 smithi156 ceph-mon[32679]: pgmap v13586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:24.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24599.750653 secs 2024-04-27T01:08:24.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23902.719720 secs 2024-04-27T01:08:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:24 smithi092 ceph-mon[29156]: pgmap v13586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24599.750653 secs 2024-04-27T01:08:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23902.719720 secs 2024-04-27T01:08:26.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:26 smithi189 ceph-mon[32756]: pgmap v13587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:26.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:26 smithi156 ceph-mon[32679]: pgmap v13587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:26.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:26 smithi092 ceph-mon[29156]: pgmap v13587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:28.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:28 smithi156 ceph-mon[32679]: pgmap v13588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:28.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:28 smithi092 ceph-mon[29156]: pgmap v13588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:28.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:28 smithi189 ceph-mon[32756]: pgmap v13588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:29.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24604.750750 secs 2024-04-27T01:08:29.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23907.719839 secs 2024-04-27T01:08:29.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24604.750750 secs 2024-04-27T01:08:29.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23907.719839 secs 2024-04-27T01:08:29.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24604.750750 secs 2024-04-27T01:08:29.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23907.719839 secs 2024-04-27T01:08:30.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:30 smithi156 ceph-mon[32679]: pgmap v13589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:30.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:30 smithi092 ceph-mon[29156]: pgmap v13589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:30.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:30 smithi189 ceph-mon[32756]: pgmap v13589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:32.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:32 smithi156 ceph-mon[32679]: pgmap v13590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:32.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:32 smithi092 ceph-mon[29156]: pgmap v13590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:32.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:32 smithi189 ceph-mon[32756]: pgmap v13590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:34 smithi156 ceph-mon[32679]: pgmap v13591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24609.750871 secs 2024-04-27T01:08:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23912.719960 secs 2024-04-27T01:08:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:34 smithi092 ceph-mon[29156]: pgmap v13591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24609.750871 secs 2024-04-27T01:08:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23912.719960 secs 2024-04-27T01:08:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:34 smithi189 ceph-mon[32756]: pgmap v13591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24609.750871 secs 2024-04-27T01:08:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23912.719960 secs 2024-04-27T01:08:36.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:36 smithi156 ceph-mon[32679]: pgmap v13592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:36.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:36 smithi092 ceph-mon[29156]: pgmap v13592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:36.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:36 smithi189 ceph-mon[32756]: pgmap v13592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:38.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:38 smithi156 ceph-mon[32679]: pgmap v13593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:38.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:38 smithi092 ceph-mon[29156]: pgmap v13593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:38.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:38 smithi189 ceph-mon[32756]: pgmap v13593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:39.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24614.750990 secs 2024-04-27T01:08:39.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23917.720099 secs 2024-04-27T01:08:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24614.750990 secs 2024-04-27T01:08:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23917.720099 secs 2024-04-27T01:08:39.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24614.750990 secs 2024-04-27T01:08:39.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23917.720099 secs 2024-04-27T01:08:40.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:40 smithi156 ceph-mon[32679]: pgmap v13594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:40.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:40 smithi092 ceph-mon[29156]: pgmap v13594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:40.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:40 smithi189 ceph-mon[32756]: pgmap v13594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:42.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:42 smithi156 ceph-mon[32679]: pgmap v13595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:42.680 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:42 smithi189 ceph-mon[32756]: pgmap v13595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:42.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:42 smithi092 ceph-mon[29156]: pgmap v13595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:44.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:44 smithi156 ceph-mon[32679]: pgmap v13596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:44.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24619.751087 secs 2024-04-27T01:08:44.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23922.720213 secs 2024-04-27T01:08:44.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:44 smithi092 ceph-mon[29156]: pgmap v13596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:44.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24619.751087 secs 2024-04-27T01:08:44.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23922.720213 secs 2024-04-27T01:08:44.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:44 smithi189 ceph-mon[32756]: pgmap v13596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:44.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24619.751087 secs 2024-04-27T01:08:44.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23922.720213 secs 2024-04-27T01:08:46.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:46 smithi156 ceph-mon[32679]: pgmap v13597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:46.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:46 smithi092 ceph-mon[29156]: pgmap v13597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:46.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:46 smithi189 ceph-mon[32756]: pgmap v13597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:48.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:48 smithi156 ceph-mon[32679]: pgmap v13598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:48.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:48 smithi092 ceph-mon[29156]: pgmap v13598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:48.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:48 smithi189 ceph-mon[32756]: pgmap v13598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24624.751168 secs 2024-04-27T01:08:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23927.720349 secs 2024-04-27T01:08:49.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24624.751168 secs 2024-04-27T01:08:49.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23927.720349 secs 2024-04-27T01:08:49.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24624.751168 secs 2024-04-27T01:08:49.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23927.720349 secs 2024-04-27T01:08:50.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:50 smithi092 ceph-mon[29156]: pgmap v13599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:50.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:50 smithi189 ceph-mon[32756]: pgmap v13599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:50.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:50 smithi156 ceph-mon[32679]: pgmap v13599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:51.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:51 smithi092 ceph-mon[29156]: pgmap v13600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:51.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:51 smithi189 ceph-mon[32756]: pgmap v13600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:51.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:51 smithi156 ceph-mon[32679]: pgmap v13600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:54.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:54 smithi189 ceph-mon[32756]: pgmap v13601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:54.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24629.751299 secs 2024-04-27T01:08:54.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23932.720469 secs 2024-04-27T01:08:54.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:54 smithi156 ceph-mon[32679]: pgmap v13601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:54.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24629.751299 secs 2024-04-27T01:08:54.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23932.720469 secs 2024-04-27T01:08:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:54 smithi092 ceph-mon[29156]: pgmap v13601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24629.751299 secs 2024-04-27T01:08:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23932.720469 secs 2024-04-27T01:08:56.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:56 smithi189 ceph-mon[32756]: pgmap v13602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:56.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:56 smithi156 ceph-mon[32679]: pgmap v13602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:56.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:56 smithi092 ceph-mon[29156]: pgmap v13602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:08:58.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:58 smithi156 ceph-mon[32679]: pgmap v13603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:58.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:58 smithi092 ceph-mon[29156]: pgmap v13603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:58.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:58 smithi189 ceph-mon[32756]: pgmap v13603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:08:59.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24634.751440 secs 2024-04-27T01:08:59.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:08:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23937.720610 secs 2024-04-27T01:08:59.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24634.751440 secs 2024-04-27T01:08:59.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:08:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23937.720610 secs 2024-04-27T01:08:59.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24634.751440 secs 2024-04-27T01:08:59.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:08:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23937.720610 secs 2024-04-27T01:09:00.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:00 smithi156 ceph-mon[32679]: pgmap v13604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:00.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:00 smithi092 ceph-mon[29156]: pgmap v13604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:00.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:00 smithi189 ceph-mon[32756]: pgmap v13604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: pgmap v13605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: pgmap v13605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: pgmap v13605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:02.747 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: pgmap v13606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24639.751510 secs 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23942.720675 secs 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: pgmap v13606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24639.751510 secs 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23942.720675 secs 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: pgmap v13606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:04.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24639.751510 secs 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23942.720675 secs 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:04.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:09:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: pgmap v13607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: pgmap v13608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: pgmap v13609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: pgmap v13607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: pgmap v13608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: pgmap v13609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: pgmap v13607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: pgmap v13608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: pgmap v13609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:06.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:09:08.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:08 smithi156 ceph-mon[32679]: pgmap v13610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:08.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:08 smithi092 ceph-mon[29156]: pgmap v13610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:08.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:08 smithi189 ceph-mon[32756]: pgmap v13610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:09.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24644.751622 secs 2024-04-27T01:09:09.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23947.720793 secs 2024-04-27T01:09:09.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24644.751622 secs 2024-04-27T01:09:09.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23947.720793 secs 2024-04-27T01:09:09.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24644.751622 secs 2024-04-27T01:09:09.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23947.720793 secs 2024-04-27T01:09:10.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:10 smithi156 ceph-mon[32679]: pgmap v13611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:10.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:10 smithi092 ceph-mon[29156]: pgmap v13611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:10.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:10 smithi189 ceph-mon[32756]: pgmap v13611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:12.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:12 smithi156 ceph-mon[32679]: pgmap v13612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:12.680 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:12 smithi189 ceph-mon[32756]: pgmap v13612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:12.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:12 smithi092 ceph-mon[29156]: pgmap v13612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:14 smithi156 ceph-mon[32679]: pgmap v13613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24649.751736 secs 2024-04-27T01:09:14.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23952.720927 secs 2024-04-27T01:09:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:14 smithi092 ceph-mon[29156]: pgmap v13613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24649.751736 secs 2024-04-27T01:09:14.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23952.720927 secs 2024-04-27T01:09:14.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:14 smithi189 ceph-mon[32756]: pgmap v13613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:09:14.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24649.751736 secs 2024-04-27T01:09:14.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23952.720927 secs 2024-04-27T01:09:16.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:16 smithi156 ceph-mon[32679]: pgmap v13614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:16.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:16 smithi092 ceph-mon[29156]: pgmap v13614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:16.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:16 smithi189 ceph-mon[32756]: pgmap v13614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:09:18.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:18 smithi156 ceph-mon[32679]: pgmap v13615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:18.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:18 smithi092 ceph-mon[29156]: pgmap v13615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:18.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:18 smithi189 ceph-mon[32756]: pgmap v13615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:19.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24654.751890 secs 2024-04-27T01:09:19.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23957.721043 secs 2024-04-27T01:09:19.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24654.751890 secs 2024-04-27T01:09:19.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23957.721043 secs 2024-04-27T01:09:19.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24654.751890 secs 2024-04-27T01:09:19.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23957.721043 secs 2024-04-27T01:09:20.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:20 smithi156 ceph-mon[32679]: pgmap v13616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:20.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:20 smithi092 ceph-mon[29156]: pgmap v13616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:20.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:20 smithi189 ceph-mon[32756]: pgmap v13616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:22.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:22 smithi092 ceph-mon[29156]: pgmap v13617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:22.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:22 smithi189 ceph-mon[32756]: pgmap v13617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:22.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:22 smithi156 ceph-mon[32679]: pgmap v13617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:24 smithi092 ceph-mon[29156]: pgmap v13618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24659.752000 secs 2024-04-27T01:09:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23962.721170 secs 2024-04-27T01:09:24.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:24 smithi189 ceph-mon[32756]: pgmap v13618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:24.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24659.752000 secs 2024-04-27T01:09:24.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23962.721170 secs 2024-04-27T01:09:24.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:24 smithi156 ceph-mon[32679]: pgmap v13618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:24.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24659.752000 secs 2024-04-27T01:09:24.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23962.721170 secs 2024-04-27T01:09:25.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:25 smithi092 ceph-mon[29156]: pgmap v13619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:25.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:25 smithi189 ceph-mon[32756]: pgmap v13619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:25.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:25 smithi156 ceph-mon[32679]: pgmap v13619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:28.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:28 smithi156 ceph-mon[32679]: pgmap v13620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:28.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:28 smithi092 ceph-mon[29156]: pgmap v13620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:28.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:28 smithi189 ceph-mon[32756]: pgmap v13620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:29.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24664.752113 secs 2024-04-27T01:09:29.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23967.721285 secs 2024-04-27T01:09:29.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24664.752113 secs 2024-04-27T01:09:29.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23967.721285 secs 2024-04-27T01:09:29.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24664.752113 secs 2024-04-27T01:09:29.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23967.721285 secs 2024-04-27T01:09:30.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:30 smithi156 ceph-mon[32679]: pgmap v13621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:30.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:30 smithi092 ceph-mon[29156]: pgmap v13621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:30.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:30 smithi189 ceph-mon[32756]: pgmap v13621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:32.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:32 smithi156 ceph-mon[32679]: pgmap v13622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:32.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:32 smithi092 ceph-mon[29156]: pgmap v13622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:32.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:32 smithi189 ceph-mon[32756]: pgmap v13622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:34 smithi156 ceph-mon[32679]: pgmap v13623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24669.752225 secs 2024-04-27T01:09:34.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23972.721435 secs 2024-04-27T01:09:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:34 smithi092 ceph-mon[29156]: pgmap v13623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24669.752225 secs 2024-04-27T01:09:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23972.721435 secs 2024-04-27T01:09:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:34 smithi189 ceph-mon[32756]: pgmap v13623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24669.752225 secs 2024-04-27T01:09:34.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23972.721435 secs 2024-04-27T01:09:36.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:36 smithi156 ceph-mon[32679]: pgmap v13624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:36.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:36 smithi092 ceph-mon[29156]: pgmap v13624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:36.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:36 smithi189 ceph-mon[32756]: pgmap v13624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:38.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:38 smithi156 ceph-mon[32679]: pgmap v13625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:38.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:38 smithi092 ceph-mon[29156]: pgmap v13625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:38.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:38 smithi189 ceph-mon[32756]: pgmap v13625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:09:39.369+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:09:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:09:39.369+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:09:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:09:39.370+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:09:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:09:39.370+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 191 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:09:39.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24674.752341 secs 2024-04-27T01:09:39.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23977.721529 secs 2024-04-27T01:09:39.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24674.752341 secs 2024-04-27T01:09:39.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23977.721529 secs 2024-04-27T01:09:39.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24674.752341 secs 2024-04-27T01:09:39.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23977.721529 secs 2024-04-27T01:09:40.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:40 smithi092 ceph-mon[29156]: pgmap v13626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:40.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:40 smithi189 ceph-mon[32756]: pgmap v13626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:40.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:40 smithi156 ceph-mon[32679]: pgmap v13626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:42.680 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:42 smithi189 ceph-mon[32756]: pgmap v13627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:42.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:42 smithi092 ceph-mon[29156]: pgmap v13627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:42.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:42 smithi156 ceph-mon[32679]: pgmap v13627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:43.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:43 smithi092 ceph-mon[29156]: pgmap v13628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:43.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:43 smithi189 ceph-mon[32756]: pgmap v13628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:43.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:43 smithi156 ceph-mon[32679]: pgmap v13628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24679.752488 secs 2024-04-27T01:09:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23982.721675 secs 2024-04-27T01:09:44.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24679.752488 secs 2024-04-27T01:09:44.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23982.721675 secs 2024-04-27T01:09:44.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24679.752488 secs 2024-04-27T01:09:44.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23982.721675 secs 2024-04-27T01:09:45.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:45 smithi189 ceph-mon[32756]: pgmap v13629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:45.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:45 smithi156 ceph-mon[32679]: pgmap v13629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:45.983 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:45 smithi092 ceph-mon[29156]: pgmap v13629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:48.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:48 smithi156 ceph-mon[32679]: pgmap v13630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:48.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:48 smithi092 ceph-mon[29156]: pgmap v13630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:48.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:48 smithi189 ceph-mon[32756]: pgmap v13630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:49.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24684.752624 secs 2024-04-27T01:09:49.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23987.721794 secs 2024-04-27T01:09:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24684.752624 secs 2024-04-27T01:09:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23987.721794 secs 2024-04-27T01:09:49.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24684.752624 secs 2024-04-27T01:09:49.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23987.721794 secs 2024-04-27T01:09:50.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:50 smithi156 ceph-mon[32679]: pgmap v13631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:50.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:50 smithi092 ceph-mon[29156]: pgmap v13631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:50.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:50 smithi189 ceph-mon[32756]: pgmap v13631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:52.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:52 smithi156 ceph-mon[32679]: pgmap v13632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:52.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:52 smithi092 ceph-mon[29156]: pgmap v13632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:52.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:52 smithi189 ceph-mon[32756]: pgmap v13632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:54 smithi156 ceph-mon[32679]: pgmap v13633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24689.752742 secs 2024-04-27T01:09:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23992.721910 secs 2024-04-27T01:09:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:54 smithi092 ceph-mon[29156]: pgmap v13633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24689.752742 secs 2024-04-27T01:09:54.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23992.721910 secs 2024-04-27T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:54 smithi189 ceph-mon[32756]: pgmap v13633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24689.752742 secs 2024-04-27T01:09:54.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23992.721910 secs 2024-04-27T01:09:56.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:56 smithi156 ceph-mon[32679]: pgmap v13634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:56.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:56 smithi092 ceph-mon[29156]: pgmap v13634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:56.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:56 smithi189 ceph-mon[32756]: pgmap v13634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:09:58.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:58 smithi156 ceph-mon[32679]: pgmap v13635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:58.706 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:58 smithi092 ceph-mon[29156]: pgmap v13635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:58.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:58 smithi189 ceph-mon[32756]: pgmap v13635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:09:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24694.752856 secs 2024-04-27T01:09:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:09:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 23997.722027 secs 2024-04-27T01:09:59.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24694.752856 secs 2024-04-27T01:09:59.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:09:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 23997.722027 secs 2024-04-27T01:09:59.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24694.752856 secs 2024-04-27T01:09:59.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:09:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 23997.722027 secs 2024-04-27T01:10:00.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:00 smithi092 ceph-mon[29156]: pgmap v13636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:00.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:10:00.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:00 smithi189 ceph-mon[32756]: pgmap v13636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:00.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:10:00.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:00 smithi156 ceph-mon[32679]: pgmap v13636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:00.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:10:02.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:02 smithi092 ceph-mon[29156]: pgmap v13637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:02.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:02 smithi189 ceph-mon[32756]: pgmap v13637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:02.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:02 smithi156 ceph-mon[32679]: pgmap v13637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:03.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:03 smithi092 ceph-mon[29156]: pgmap v13638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:03.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:03 smithi189 ceph-mon[32756]: pgmap v13638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:03.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:03 smithi156 ceph-mon[32679]: pgmap v13638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24699.752973 secs 2024-04-27T01:10:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:04 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24002.722111 secs 2024-04-27T01:10:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:04 smithi092 ceph-mon[29156]: slow request 23042.427478 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:10:04.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24699.752973 secs 2024-04-27T01:10:04.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:04 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24002.722111 secs 2024-04-27T01:10:04.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:04 smithi189 ceph-mon[32756]: slow request 23042.427478 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:10:04.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24699.752973 secs 2024-04-27T01:10:04.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:04 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24002.722111 secs 2024-04-27T01:10:04.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:04 smithi156 ceph-mon[32679]: slow request 23042.427478 seconds old, received at 2024-04-26T18:46:01.440667+0000: client_request(client.16872:1 getattr pAsLsXsFs #0x1 2024-04-26T18:46:01.436500+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:10:05.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:05 smithi092 ceph-mon[29156]: pgmap v13639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:05.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:05 smithi189 ceph-mon[32756]: pgmap v13639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:05.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:05 smithi156 ceph-mon[32679]: pgmap v13639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:10:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:10:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:10:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: pgmap v13640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:10:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: pgmap v13641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:06.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: pgmap v13640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: pgmap v13641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:06.878 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:10:06.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:10:06.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:10:06.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:10:06.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: pgmap v13640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:10:06.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: pgmap v13641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:06.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:10:09.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:09 smithi092 ceph-mon[29156]: pgmap v13642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:10:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24704.753092 secs 2024-04-27T01:10:09.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24007.722184 secs 2024-04-27T01:10:09.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:09 smithi189 ceph-mon[32756]: pgmap v13642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:10:09.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24704.753092 secs 2024-04-27T01:10:09.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24007.722184 secs 2024-04-27T01:10:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:09 smithi156 ceph-mon[32679]: pgmap v13642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:10:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24704.753092 secs 2024-04-27T01:10:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24007.722184 secs 2024-04-27T01:10:11.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:11 smithi092 ceph-mon[29156]: pgmap v13643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:11.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:11 smithi189 ceph-mon[32756]: pgmap v13643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:11.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:11 smithi156 ceph-mon[32679]: pgmap v13643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:13.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:13 smithi189 ceph-mon[32756]: pgmap v13644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:13.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:13 smithi092 ceph-mon[29156]: pgmap v13644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:13.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:13 smithi156 ceph-mon[32679]: pgmap v13644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:14.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24709.753204 secs 2024-04-27T01:10:14.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24012.722322 secs 2024-04-27T01:10:14.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24709.753204 secs 2024-04-27T01:10:14.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24012.722322 secs 2024-04-27T01:10:14.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24709.753204 secs 2024-04-27T01:10:14.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24012.722322 secs 2024-04-27T01:10:15.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:15 smithi092 ceph-mon[29156]: pgmap v13645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:15.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:15 smithi189 ceph-mon[32756]: pgmap v13645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:15.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:15 smithi156 ceph-mon[32679]: pgmap v13645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:10:17.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:17 smithi092 ceph-mon[29156]: pgmap v13646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:10:17.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:17 smithi189 ceph-mon[32756]: pgmap v13646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:10:17.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:17 smithi156 ceph-mon[32679]: pgmap v13646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:10:19.476 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:19 smithi156 ceph-mon[32679]: pgmap v13647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:19.476 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24714.753326 secs 2024-04-27T01:10:19.476 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24017.722404 secs 2024-04-27T01:10:19.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:19 smithi092 ceph-mon[29156]: pgmap v13647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:19.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24714.753326 secs 2024-04-27T01:10:19.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24017.722404 secs 2024-04-27T01:10:19.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:19 smithi189 ceph-mon[32756]: pgmap v13647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:19.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24714.753326 secs 2024-04-27T01:10:19.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24017.722404 secs 2024-04-27T01:10:21.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:21 smithi092 ceph-mon[29156]: pgmap v13648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:21.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:21 smithi189 ceph-mon[32756]: pgmap v13648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:21.674 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:21 smithi156 ceph-mon[32679]: pgmap v13648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:23.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:23 smithi092 ceph-mon[29156]: pgmap v13649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:23.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:23 smithi189 ceph-mon[32756]: pgmap v13649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:23.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:23 smithi156 ceph-mon[32679]: pgmap v13649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:24.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24719.753445 secs 2024-04-27T01:10:24.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24022.722469 secs 2024-04-27T01:10:24.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24719.753445 secs 2024-04-27T01:10:24.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24022.722469 secs 2024-04-27T01:10:24.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24719.753445 secs 2024-04-27T01:10:24.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24022.722469 secs 2024-04-27T01:10:25.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:25 smithi092 ceph-mon[29156]: pgmap v13650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:25.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:25 smithi189 ceph-mon[32756]: pgmap v13650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:25.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:25 smithi156 ceph-mon[32679]: pgmap v13650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:27.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:27 smithi092 ceph-mon[29156]: pgmap v13651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:27.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:27 smithi189 ceph-mon[32756]: pgmap v13651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:27.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:27 smithi156 ceph-mon[32679]: pgmap v13651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:29.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:29 smithi092 ceph-mon[29156]: pgmap v13652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:29.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24724.753582 secs 2024-04-27T01:10:29.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24027.722552 secs 2024-04-27T01:10:29.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:29 smithi189 ceph-mon[32756]: pgmap v13652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:29.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24724.753582 secs 2024-04-27T01:10:29.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24027.722552 secs 2024-04-27T01:10:29.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:29 smithi156 ceph-mon[32679]: pgmap v13652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:29.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24724.753582 secs 2024-04-27T01:10:29.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24027.722552 secs 2024-04-27T01:10:31.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:31 smithi092 ceph-mon[29156]: pgmap v13653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:31.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:31 smithi189 ceph-mon[32756]: pgmap v13653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:31.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:31 smithi156 ceph-mon[32679]: pgmap v13653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:33.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:33 smithi092 ceph-mon[29156]: pgmap v13654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:33.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:33 smithi189 ceph-mon[32756]: pgmap v13654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:33.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:33 smithi156 ceph-mon[32679]: pgmap v13654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24729.753720 secs 2024-04-27T01:10:34.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24032.722677 secs 2024-04-27T01:10:34.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24729.753720 secs 2024-04-27T01:10:34.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24032.722677 secs 2024-04-27T01:10:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24729.753720 secs 2024-04-27T01:10:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24032.722677 secs 2024-04-27T01:10:35.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:35 smithi189 ceph-mon[32756]: pgmap v13655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:35.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:35 smithi156 ceph-mon[32679]: pgmap v13655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:35.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:35 smithi092 ceph-mon[29156]: pgmap v13655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:10:37.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:37 smithi189 ceph-mon[32756]: pgmap v13656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:37.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:37 smithi156 ceph-mon[32679]: pgmap v13656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:37.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:37 smithi092 ceph-mon[29156]: pgmap v13656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:39 smithi189 ceph-mon[32756]: pgmap v13657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:39.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24734.753858 secs 2024-04-27T01:10:39.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24037.722807 secs 2024-04-27T01:10:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:39 smithi156 ceph-mon[32679]: pgmap v13657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24734.753858 secs 2024-04-27T01:10:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24037.722807 secs 2024-04-27T01:10:39.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:39 smithi092 ceph-mon[29156]: pgmap v13657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:39.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24734.753858 secs 2024-04-27T01:10:39.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24037.722807 secs 2024-04-27T01:10:41.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:41 smithi189 ceph-mon[32756]: pgmap v13658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:41.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:41 smithi156 ceph-mon[32679]: pgmap v13658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:41.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:41 smithi092 ceph-mon[29156]: pgmap v13658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:43.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:43 smithi189 ceph-mon[32756]: pgmap v13659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:43.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:43 smithi156 ceph-mon[32679]: pgmap v13659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:43.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:43 smithi092 ceph-mon[29156]: pgmap v13659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:44.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24739.753973 secs 2024-04-27T01:10:44.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24042.722940 secs 2024-04-27T01:10:44.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24739.753973 secs 2024-04-27T01:10:44.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24042.722940 secs 2024-04-27T01:10:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24739.753973 secs 2024-04-27T01:10:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24042.722940 secs 2024-04-27T01:10:45.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:45 smithi189 ceph-mon[32756]: pgmap v13660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:45.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:45 smithi156 ceph-mon[32679]: pgmap v13660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:45.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:45 smithi092 ceph-mon[29156]: pgmap v13660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:47.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:47 smithi189 ceph-mon[32756]: pgmap v13661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:47.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:47 smithi156 ceph-mon[32679]: pgmap v13661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:47.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:47 smithi092 ceph-mon[29156]: pgmap v13661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:49.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:49 smithi189 ceph-mon[32756]: pgmap v13662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:49.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24744.754091 secs 2024-04-27T01:10:49.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24047.723063 secs 2024-04-27T01:10:49.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:49 smithi156 ceph-mon[32679]: pgmap v13662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:49.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24744.754091 secs 2024-04-27T01:10:49.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24047.723063 secs 2024-04-27T01:10:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:49 smithi092 ceph-mon[29156]: pgmap v13662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:10:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24744.754091 secs 2024-04-27T01:10:49.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24047.723063 secs 2024-04-27T01:10:51.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:51 smithi189 ceph-mon[32756]: pgmap v13663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:51.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:51 smithi156 ceph-mon[32679]: pgmap v13663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:51.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:51 smithi092 ceph-mon[29156]: pgmap v13663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:10:53.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:53 smithi189 ceph-mon[32756]: pgmap v13664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:53.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:53 smithi156 ceph-mon[32679]: pgmap v13664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:53.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:53 smithi092 ceph-mon[29156]: pgmap v13664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24749.754171 secs 2024-04-27T01:10:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24052.723180 secs 2024-04-27T01:10:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24749.754171 secs 2024-04-27T01:10:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24052.723180 secs 2024-04-27T01:10:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24749.754171 secs 2024-04-27T01:10:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24052.723180 secs 2024-04-27T01:10:55.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:55 smithi189 ceph-mon[32756]: pgmap v13665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:55.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:55 smithi156 ceph-mon[32679]: pgmap v13665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:55.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:55 smithi092 ceph-mon[29156]: pgmap v13665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:10:57.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:57 smithi189 ceph-mon[32756]: pgmap v13666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:57.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:57 smithi156 ceph-mon[32679]: pgmap v13666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:57.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:57 smithi092 ceph-mon[29156]: pgmap v13666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:59.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:59 smithi189 ceph-mon[32756]: pgmap v13667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:59.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24754.754289 secs 2024-04-27T01:10:59.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:10:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24057.723312 secs 2024-04-27T01:10:59.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:59 smithi156 ceph-mon[32679]: pgmap v13667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:59.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24754.754289 secs 2024-04-27T01:10:59.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:10:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24057.723312 secs 2024-04-27T01:10:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:59 smithi092 ceph-mon[29156]: pgmap v13667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:10:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24754.754289 secs 2024-04-27T01:10:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:10:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24057.723312 secs 2024-04-27T01:11:01.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:01 smithi189 ceph-mon[32756]: pgmap v13668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:01.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:01 smithi156 ceph-mon[32679]: pgmap v13668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:01.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:01 smithi092 ceph-mon[29156]: pgmap v13668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:03.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:03 smithi189 ceph-mon[32756]: pgmap v13669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:03.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:03 smithi156 ceph-mon[32679]: pgmap v13669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:03.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:03 smithi092 ceph-mon[29156]: pgmap v13669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:04.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24759.754404 secs 2024-04-27T01:11:04.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24062.723415 secs 2024-04-27T01:11:04.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24759.754404 secs 2024-04-27T01:11:04.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24062.723415 secs 2024-04-27T01:11:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24759.754404 secs 2024-04-27T01:11:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24062.723415 secs 2024-04-27T01:11:05.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:05 smithi189 ceph-mon[32756]: pgmap v13670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:05.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:05 smithi156 ceph-mon[32679]: pgmap v13670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:05.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:05 smithi092 ceph-mon[29156]: pgmap v13670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:06.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:11:06.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:11:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:11:07.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:07 smithi189 ceph-mon[32756]: pgmap v13671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:07.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:11:07.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:11:07.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:11:07.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:07 smithi156 ceph-mon[32679]: pgmap v13671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:07.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:11:07.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:11:07.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-mon[29156]: pgmap v13671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:11:07.393+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:11:07.733 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:11:07.393+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:11:07.734 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:11:07.393+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:11:07.734 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:11:07.393+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:11:07.734 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:11:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:11:07.393+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:11:08.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:08 smithi189 ceph-mon[32756]: pgmap v13672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:11:08.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:08 smithi189 ceph-mon[32756]: pgmap v13673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:11:08.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:08 smithi156 ceph-mon[32679]: pgmap v13672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:11:08.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:08 smithi156 ceph-mon[32679]: pgmap v13673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:11:08.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:08 smithi092 ceph-mon[29156]: pgmap v13672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:11:08.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:08 smithi092 ceph-mon[29156]: pgmap v13673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:11:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:11:09.384+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:11:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:11:09.384+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:11:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:11:09.384+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:11:09.373 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:11:09.384+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 192 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:11:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24764.754518 secs 2024-04-27T01:11:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24067.723542 secs 2024-04-27T01:11:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24764.754518 secs 2024-04-27T01:11:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24067.723542 secs 2024-04-27T01:11:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24764.754518 secs 2024-04-27T01:11:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24067.723542 secs 2024-04-27T01:11:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:10 smithi189 ceph-mon[32756]: pgmap v13674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:10 smithi156 ceph-mon[32679]: pgmap v13674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:10.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:10 smithi092 ceph-mon[29156]: pgmap v13674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:12.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:12 smithi189 ceph-mon[32756]: pgmap v13675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:12.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:12 smithi156 ceph-mon[32679]: pgmap v13675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:12.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:12 smithi092 ceph-mon[29156]: pgmap v13675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:14.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:14 smithi189 ceph-mon[32756]: pgmap v13676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:14.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24769.754656 secs 2024-04-27T01:11:14.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24072.723660 secs 2024-04-27T01:11:14.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:14 smithi156 ceph-mon[32679]: pgmap v13676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:14.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24769.754656 secs 2024-04-27T01:11:14.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24072.723660 secs 2024-04-27T01:11:14.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:14 smithi092 ceph-mon[29156]: pgmap v13676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:14.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24769.754656 secs 2024-04-27T01:11:14.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24072.723660 secs 2024-04-27T01:11:16.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:16 smithi189 ceph-mon[32756]: pgmap v13677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:16.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:16 smithi156 ceph-mon[32679]: pgmap v13677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:16.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:16 smithi092 ceph-mon[29156]: pgmap v13677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 0 B/s wr, 19 op/s 2024-04-27T01:11:18.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:18 smithi189 ceph-mon[32756]: pgmap v13678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:18.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:18 smithi156 ceph-mon[32679]: pgmap v13678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:18.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:18 smithi092 ceph-mon[29156]: pgmap v13678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 0 B/s wr, 17 op/s 2024-04-27T01:11:19.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24774.754771 secs 2024-04-27T01:11:19.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24077.723777 secs 2024-04-27T01:11:19.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24774.754771 secs 2024-04-27T01:11:19.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24077.723777 secs 2024-04-27T01:11:19.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24774.754771 secs 2024-04-27T01:11:19.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24077.723777 secs 2024-04-27T01:11:20.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:20 smithi189 ceph-mon[32756]: pgmap v13679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T01:11:20.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:20 smithi156 ceph-mon[32679]: pgmap v13679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T01:11:20.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:20 smithi092 ceph-mon[29156]: pgmap v13679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T01:11:22.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:22 smithi189 ceph-mon[32756]: pgmap v13680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:22.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:22 smithi156 ceph-mon[32679]: pgmap v13680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:22.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:22 smithi092 ceph-mon[29156]: pgmap v13680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:24.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:24 smithi189 ceph-mon[32756]: pgmap v13681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:24.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24779.754885 secs 2024-04-27T01:11:24.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24082.723892 secs 2024-04-27T01:11:24.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:24 smithi156 ceph-mon[32679]: pgmap v13681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:24.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24779.754885 secs 2024-04-27T01:11:24.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24082.723892 secs 2024-04-27T01:11:24.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:24 smithi092 ceph-mon[29156]: pgmap v13681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24779.754885 secs 2024-04-27T01:11:24.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24082.723892 secs 2024-04-27T01:11:26.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:26 smithi189 ceph-mon[32756]: pgmap v13682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:26.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:26 smithi156 ceph-mon[32679]: pgmap v13682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:26.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:26 smithi092 ceph-mon[29156]: pgmap v13682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:28.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:28 smithi189 ceph-mon[32756]: pgmap v13683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:28.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:28 smithi156 ceph-mon[32679]: pgmap v13683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:28.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:28 smithi092 ceph-mon[29156]: pgmap v13683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:29.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24784.755001 secs 2024-04-27T01:11:29.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24087.724032 secs 2024-04-27T01:11:29.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24784.755001 secs 2024-04-27T01:11:29.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24087.724032 secs 2024-04-27T01:11:29.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24784.755001 secs 2024-04-27T01:11:29.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24087.724032 secs 2024-04-27T01:11:30.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:30 smithi189 ceph-mon[32756]: pgmap v13684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:30.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:30 smithi156 ceph-mon[32679]: pgmap v13684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:30.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:30 smithi092 ceph-mon[29156]: pgmap v13684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:32.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:32 smithi189 ceph-mon[32756]: pgmap v13685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:32.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:32 smithi156 ceph-mon[32679]: pgmap v13685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:32.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:32 smithi092 ceph-mon[29156]: pgmap v13685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:34 smithi189 ceph-mon[32756]: pgmap v13686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24789.755082 secs 2024-04-27T01:11:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24092.724104 secs 2024-04-27T01:11:34.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:34 smithi156 ceph-mon[32679]: pgmap v13686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:34.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24789.755082 secs 2024-04-27T01:11:34.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24092.724104 secs 2024-04-27T01:11:34.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:34 smithi092 ceph-mon[29156]: pgmap v13686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24789.755082 secs 2024-04-27T01:11:34.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24092.724104 secs 2024-04-27T01:11:36.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:36 smithi189 ceph-mon[32756]: pgmap v13687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:36.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:36 smithi156 ceph-mon[32679]: pgmap v13687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:36.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:36 smithi092 ceph-mon[29156]: pgmap v13687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:38.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:38 smithi189 ceph-mon[32756]: pgmap v13688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:38.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:38 smithi156 ceph-mon[32679]: pgmap v13688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:38.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:38 smithi092 ceph-mon[29156]: pgmap v13688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24794.755161 secs 2024-04-27T01:11:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24097.724219 secs 2024-04-27T01:11:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24794.755161 secs 2024-04-27T01:11:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24097.724219 secs 2024-04-27T01:11:39.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24794.755161 secs 2024-04-27T01:11:39.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24097.724219 secs 2024-04-27T01:11:40.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:40 smithi156 ceph-mon[32679]: pgmap v13689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:40 smithi092 ceph-mon[29156]: pgmap v13689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:40.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:40 smithi189 ceph-mon[32756]: pgmap v13689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:42.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:42 smithi156 ceph-mon[32679]: pgmap v13690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:42.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:42 smithi092 ceph-mon[29156]: pgmap v13690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:42.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:42 smithi189 ceph-mon[32756]: pgmap v13690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:44.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:44 smithi156 ceph-mon[32679]: pgmap v13691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:44.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24799.755225 secs 2024-04-27T01:11:44.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24102.724348 secs 2024-04-27T01:11:44.679 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:44 smithi189 ceph-mon[32756]: pgmap v13691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:44.679 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24799.755225 secs 2024-04-27T01:11:44.679 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24102.724348 secs 2024-04-27T01:11:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:44 smithi092 ceph-mon[29156]: pgmap v13691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24799.755225 secs 2024-04-27T01:11:44.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24102.724348 secs 2024-04-27T01:11:46.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:46 smithi156 ceph-mon[32679]: pgmap v13692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:46.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:46 smithi092 ceph-mon[29156]: pgmap v13692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:46.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:46 smithi189 ceph-mon[32756]: pgmap v13692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:48.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:48 smithi156 ceph-mon[32679]: pgmap v13693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:48.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:48 smithi092 ceph-mon[29156]: pgmap v13693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:48.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:48 smithi189 ceph-mon[32756]: pgmap v13693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:49.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24804.755347 secs 2024-04-27T01:11:49.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24107.724468 secs 2024-04-27T01:11:49.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24804.755347 secs 2024-04-27T01:11:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24107.724468 secs 2024-04-27T01:11:49.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24804.755347 secs 2024-04-27T01:11:49.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24107.724468 secs 2024-04-27T01:11:50.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:50 smithi156 ceph-mon[32679]: pgmap v13694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:50.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:50 smithi092 ceph-mon[29156]: pgmap v13694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:50.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:50 smithi189 ceph-mon[32756]: pgmap v13694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:52.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:52 smithi156 ceph-mon[32679]: pgmap v13695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:52.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:52 smithi092 ceph-mon[29156]: pgmap v13695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:52.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:52 smithi189 ceph-mon[32756]: pgmap v13695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:54 smithi156 ceph-mon[32679]: pgmap v13696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24809.755484 secs 2024-04-27T01:11:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24112.724590 secs 2024-04-27T01:11:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:54 smithi092 ceph-mon[29156]: pgmap v13696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24809.755484 secs 2024-04-27T01:11:54.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24112.724590 secs 2024-04-27T01:11:54.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:54 smithi189 ceph-mon[32756]: pgmap v13696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:54.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24809.755484 secs 2024-04-27T01:11:54.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24112.724590 secs 2024-04-27T01:11:56.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:56 smithi156 ceph-mon[32679]: pgmap v13697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:56.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:56 smithi092 ceph-mon[29156]: pgmap v13697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:56.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:56 smithi189 ceph-mon[32756]: pgmap v13697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:11:58.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:58 smithi156 ceph-mon[32679]: pgmap v13698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:58.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:58 smithi092 ceph-mon[29156]: pgmap v13698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:58.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:58 smithi189 ceph-mon[32756]: pgmap v13698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:11:59.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24814.755605 secs 2024-04-27T01:11:59.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:11:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24117.724705 secs 2024-04-27T01:11:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24814.755605 secs 2024-04-27T01:11:59.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:11:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24117.724705 secs 2024-04-27T01:11:59.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24814.755605 secs 2024-04-27T01:11:59.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:11:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24117.724705 secs 2024-04-27T01:12:00.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:00 smithi092 ceph-mon[29156]: pgmap v13699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:00.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:00 smithi189 ceph-mon[32756]: pgmap v13699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:00.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:00 smithi156 ceph-mon[32679]: pgmap v13699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:02.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:02 smithi092 ceph-mon[29156]: pgmap v13700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:02.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:02 smithi189 ceph-mon[32756]: pgmap v13700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:02.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:02 smithi156 ceph-mon[32679]: pgmap v13700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:04.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:04 smithi092 ceph-mon[29156]: pgmap v13701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:04.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24819.755668 secs 2024-04-27T01:12:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24122.724809 secs 2024-04-27T01:12:04.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:04 smithi189 ceph-mon[32756]: pgmap v13701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:04.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24819.755668 secs 2024-04-27T01:12:04.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24122.724809 secs 2024-04-27T01:12:04.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:04 smithi156 ceph-mon[32679]: pgmap v13701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:04.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24819.755668 secs 2024-04-27T01:12:04.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24122.724809 secs 2024-04-27T01:12:06.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:06 smithi092 ceph-mon[29156]: pgmap v13702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:06.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:06 smithi189 ceph-mon[32756]: pgmap v13702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:06.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:06 smithi156 ceph-mon[32679]: pgmap v13702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:07.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:12:07.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:12:07.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:12:08.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:08 smithi092 ceph-mon[29156]: pgmap v13703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:12:08.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:12:08.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:12:08.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:12:08.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:08 smithi189 ceph-mon[32756]: pgmap v13703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:12:08.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:12:08.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:12:08.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:12:08.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:08 smithi156 ceph-mon[32679]: pgmap v13703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:12:08.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:12:08.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:12:08.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:12:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:09 smithi092 ceph-mon[29156]: pgmap v13704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:12:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:09 smithi092 ceph-mon[29156]: pgmap v13705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T01:12:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24824.755783 secs 2024-04-27T01:12:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:09 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24127.724928 secs 2024-04-27T01:12:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:09 smithi092 ceph-mon[29156]: slow request 2882.274689 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:09 smithi189 ceph-mon[32756]: pgmap v13704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:12:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:09 smithi189 ceph-mon[32756]: pgmap v13705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T01:12:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24824.755783 secs 2024-04-27T01:12:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:09 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24127.724928 secs 2024-04-27T01:12:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:09 smithi189 ceph-mon[32756]: slow request 2882.274689 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:09 smithi156 ceph-mon[32679]: pgmap v13704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:12:09.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:09 smithi156 ceph-mon[32679]: pgmap v13705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T01:12:09.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24824.755783 secs 2024-04-27T01:12:09.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:09 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24127.724928 secs 2024-04-27T01:12:09.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:09 smithi156 ceph-mon[32679]: slow request 2882.274689 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:11.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:11 smithi092 ceph-mon[29156]: pgmap v13706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:11.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:11 smithi189 ceph-mon[32756]: pgmap v13706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:11.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:11 smithi156 ceph-mon[32679]: pgmap v13706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:13.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:13 smithi092 ceph-mon[29156]: pgmap v13707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:13.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:13 smithi189 ceph-mon[32756]: pgmap v13707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:13.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:13 smithi156 ceph-mon[32679]: pgmap v13707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:12:14.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24829.755904 secs 2024-04-27T01:12:14.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:14 smithi092 ceph-mon[29156]: pgmap v13708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:14.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24132.725077 secs 2024-04-27T01:12:14.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24829.755904 secs 2024-04-27T01:12:14.778 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:14 smithi189 ceph-mon[32756]: pgmap v13708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:14.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24132.725077 secs 2024-04-27T01:12:14.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24829.755904 secs 2024-04-27T01:12:14.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:14 smithi156 ceph-mon[32679]: pgmap v13708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:14.923 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24132.725077 secs 2024-04-27T01:12:17.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:17 smithi092 ceph-mon[29156]: pgmap v13709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:17.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:17 smithi189 ceph-mon[32756]: pgmap v13709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:17.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:17 smithi156 ceph-mon[32679]: pgmap v13709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:12:19.475 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:19 smithi156 ceph-mon[32679]: pgmap v13710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:12:19.475 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24834.755999 secs 2024-04-27T01:12:19.475 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24137.725219 secs 2024-04-27T01:12:19.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:19 smithi092 ceph-mon[29156]: pgmap v13710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:12:19.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24834.755999 secs 2024-04-27T01:12:19.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24137.725219 secs 2024-04-27T01:12:19.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:19 smithi189 ceph-mon[32756]: pgmap v13710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:12:19.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24834.755999 secs 2024-04-27T01:12:19.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24137.725219 secs 2024-04-27T01:12:21.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:21 smithi092 ceph-mon[29156]: pgmap v13711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:21.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:21 smithi189 ceph-mon[32756]: pgmap v13711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:21.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:21 smithi156 ceph-mon[32679]: pgmap v13711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:23.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:23 smithi092 ceph-mon[29156]: pgmap v13712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:23.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:23 smithi189 ceph-mon[32756]: pgmap v13712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:23.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:23 smithi156 ceph-mon[32679]: pgmap v13712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:24.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24839.756119 secs 2024-04-27T01:12:24.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24142.725344 secs 2024-04-27T01:12:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24839.756119 secs 2024-04-27T01:12:24.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24142.725344 secs 2024-04-27T01:12:24.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24839.756119 secs 2024-04-27T01:12:24.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24142.725344 secs 2024-04-27T01:12:25.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:25 smithi092 ceph-mon[29156]: pgmap v13713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:25.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:25 smithi189 ceph-mon[32756]: pgmap v13713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:25.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:25 smithi156 ceph-mon[32679]: pgmap v13713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:27.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:27 smithi092 ceph-mon[29156]: pgmap v13714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:27.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:27 smithi189 ceph-mon[32756]: pgmap v13714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:27.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:27 smithi156 ceph-mon[32679]: pgmap v13714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:29.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:29 smithi092 ceph-mon[29156]: pgmap v13715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:29.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24844.756216 secs 2024-04-27T01:12:29.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24147.725462 secs 2024-04-27T01:12:29.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:29 smithi189 ceph-mon[32756]: pgmap v13715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:29.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24844.756216 secs 2024-04-27T01:12:29.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24147.725462 secs 2024-04-27T01:12:29.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:29 smithi156 ceph-mon[32679]: pgmap v13715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:29.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24844.756216 secs 2024-04-27T01:12:29.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24147.725462 secs 2024-04-27T01:12:31.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:31 smithi092 ceph-mon[29156]: pgmap v13716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:31.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:31 smithi189 ceph-mon[32756]: pgmap v13716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:31.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:31 smithi156 ceph-mon[32679]: pgmap v13716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:33.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:33 smithi092 ceph-mon[29156]: pgmap v13717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:33.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:33 smithi189 ceph-mon[32756]: pgmap v13717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:33.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:33 smithi156 ceph-mon[32679]: pgmap v13717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:34.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24849.756329 secs 2024-04-27T01:12:34.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24152.725582 secs 2024-04-27T01:12:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24849.756329 secs 2024-04-27T01:12:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24152.725582 secs 2024-04-27T01:12:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24849.756329 secs 2024-04-27T01:12:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24152.725582 secs 2024-04-27T01:12:35.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:35 smithi092 ceph-mon[29156]: pgmap v13718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:35.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:35 smithi189 ceph-mon[32756]: pgmap v13718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:35.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:35 smithi156 ceph-mon[32679]: pgmap v13718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:37.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:37 smithi092 ceph-mon[29156]: pgmap v13719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:37.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:37 smithi189 ceph-mon[32756]: pgmap v13719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:37.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:37 smithi156 ceph-mon[32679]: pgmap v13719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:12:39.395+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:12:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:12:39.395+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:12:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:12:39.395+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:12:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:12:39.395+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 193 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:12:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:39 smithi092 ceph-mon[29156]: pgmap v13720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:39 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 24854.756444 secs 2024-04-27T01:12:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:39 smithi092 ceph-mon[29156]: slow request 721.452589 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24157.725706 secs 2024-04-27T01:12:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:39 smithi189 ceph-mon[32756]: pgmap v13720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:39 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 24854.756444 secs 2024-04-27T01:12:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:39 smithi189 ceph-mon[32756]: slow request 721.452589 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:39.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24157.725706 secs 2024-04-27T01:12:39.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:39 smithi156 ceph-mon[32679]: pgmap v13720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:39.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:39 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 24854.756444 secs 2024-04-27T01:12:39.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:39 smithi156 ceph-mon[32679]: slow request 721.452589 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:12:39.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24157.725706 secs 2024-04-27T01:12:41.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:41 smithi092 ceph-mon[29156]: pgmap v13721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:41.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:41 smithi189 ceph-mon[32756]: pgmap v13721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:41.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:41 smithi156 ceph-mon[32679]: pgmap v13721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:43.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:43 smithi092 ceph-mon[29156]: pgmap v13722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:43.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:43 smithi189 ceph-mon[32756]: pgmap v13722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:43.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:43 smithi156 ceph-mon[32679]: pgmap v13722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:44.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24859.756580 secs 2024-04-27T01:12:44.528 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24162.725821 secs 2024-04-27T01:12:44.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24859.756580 secs 2024-04-27T01:12:44.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24162.725821 secs 2024-04-27T01:12:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24859.756580 secs 2024-04-27T01:12:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24162.725821 secs 2024-04-27T01:12:45.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:45 smithi189 ceph-mon[32756]: pgmap v13723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:45.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:45 smithi156 ceph-mon[32679]: pgmap v13723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:45.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:45 smithi092 ceph-mon[29156]: pgmap v13723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:47.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:47 smithi189 ceph-mon[32756]: pgmap v13724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:47.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:47 smithi156 ceph-mon[32679]: pgmap v13724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:47.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:47 smithi092 ceph-mon[29156]: pgmap v13724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:49.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:49 smithi189 ceph-mon[32756]: pgmap v13725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:49.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24864.756686 secs 2024-04-27T01:12:49.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24167.725935 secs 2024-04-27T01:12:49.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:49 smithi156 ceph-mon[32679]: pgmap v13725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:49.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24864.756686 secs 2024-04-27T01:12:49.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24167.725935 secs 2024-04-27T01:12:49.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:49 smithi092 ceph-mon[29156]: pgmap v13725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:49.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24864.756686 secs 2024-04-27T01:12:49.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24167.725935 secs 2024-04-27T01:12:51.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:51 smithi189 ceph-mon[32756]: pgmap v13726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:51.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:51 smithi156 ceph-mon[32679]: pgmap v13726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:51.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:51 smithi092 ceph-mon[29156]: pgmap v13726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:53.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:53 smithi189 ceph-mon[32756]: pgmap v13727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:53.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:53 smithi156 ceph-mon[32679]: pgmap v13727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:53.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:53 smithi092 ceph-mon[29156]: pgmap v13727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24869.756808 secs 2024-04-27T01:12:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24172.726060 secs 2024-04-27T01:12:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24869.756808 secs 2024-04-27T01:12:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24172.726060 secs 2024-04-27T01:12:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24869.756808 secs 2024-04-27T01:12:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24172.726060 secs 2024-04-27T01:12:55.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:55 smithi189 ceph-mon[32756]: pgmap v13728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:55.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:55 smithi156 ceph-mon[32679]: pgmap v13728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:55.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:55 smithi092 ceph-mon[29156]: pgmap v13728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:12:57.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:57 smithi189 ceph-mon[32756]: pgmap v13729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:57.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:57 smithi156 ceph-mon[32679]: pgmap v13729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:57.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:57 smithi092 ceph-mon[29156]: pgmap v13729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:59.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:59 smithi189 ceph-mon[32756]: pgmap v13730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:59.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24874.756922 secs 2024-04-27T01:12:59.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:12:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24177.726208 secs 2024-04-27T01:12:59.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:59 smithi156 ceph-mon[32679]: pgmap v13730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:59.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24874.756922 secs 2024-04-27T01:12:59.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:12:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24177.726208 secs 2024-04-27T01:12:59.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:59 smithi092 ceph-mon[29156]: pgmap v13730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:12:59.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24874.756922 secs 2024-04-27T01:12:59.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:12:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24177.726208 secs 2024-04-27T01:13:01.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:01 smithi189 ceph-mon[32756]: pgmap v13731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:01.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:01 smithi156 ceph-mon[32679]: pgmap v13731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:01.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:01 smithi092 ceph-mon[29156]: pgmap v13731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:03.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:03 smithi189 ceph-mon[32756]: pgmap v13732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:03.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:03 smithi156 ceph-mon[32679]: pgmap v13732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:03.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:03 smithi092 ceph-mon[29156]: pgmap v13732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:04.561 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24879.757016 secs 2024-04-27T01:13:04.562 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24182.726330 secs 2024-04-27T01:13:04.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24879.757016 secs 2024-04-27T01:13:04.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24182.726330 secs 2024-04-27T01:13:04.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24879.757016 secs 2024-04-27T01:13:04.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24182.726330 secs 2024-04-27T01:13:05.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:05 smithi189 ceph-mon[32756]: pgmap v13733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:05.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:05 smithi156 ceph-mon[32679]: pgmap v13733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:05.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:05 smithi092 ceph-mon[29156]: pgmap v13733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:07.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:07 smithi189 ceph-mon[32756]: pgmap v13734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:07.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:07 smithi156 ceph-mon[32679]: pgmap v13734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:07.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:07 smithi092 ceph-mon[29156]: pgmap v13734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:08.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:13:08.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:13:08.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:13:09.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: pgmap v13735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: pgmap v13736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: pgmap v13737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24884.757104 secs 2024-04-27T01:13:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24187.726411 secs 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: pgmap v13735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: pgmap v13736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: pgmap v13737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24884.757104 secs 2024-04-27T01:13:09.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24187.726411 secs 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: pgmap v13735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: pgmap v13736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: pgmap v13737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:09.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:13:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24884.757104 secs 2024-04-27T01:13:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24187.726411 secs 2024-04-27T01:13:10.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:10 smithi189 ceph-mon[32756]: pgmap v13738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:10.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:10 smithi156 ceph-mon[32679]: pgmap v13738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:10.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:10 smithi092 ceph-mon[29156]: pgmap v13738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:12.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:12 smithi189 ceph-mon[32756]: pgmap v13739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:12.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:12 smithi156 ceph-mon[32679]: pgmap v13739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:12.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:12 smithi092 ceph-mon[29156]: pgmap v13739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:13:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:13 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24889.757223 secs 2024-04-27T01:13:14.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:13 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24192.726546 secs 2024-04-27T01:13:14.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:13 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24889.757223 secs 2024-04-27T01:13:14.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:13 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24192.726546 secs 2024-04-27T01:13:14.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:13 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24889.757223 secs 2024-04-27T01:13:14.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:13 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24192.726546 secs 2024-04-27T01:13:15.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:14 smithi092 ceph-mon[29156]: pgmap v13740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:15.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:14 smithi189 ceph-mon[32756]: pgmap v13740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:15.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:14 smithi156 ceph-mon[32679]: pgmap v13740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:16.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:16 smithi189 ceph-mon[32756]: pgmap v13741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:16.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:16 smithi156 ceph-mon[32679]: pgmap v13741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:16.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:16 smithi092 ceph-mon[29156]: pgmap v13741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:13:18.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:18 smithi189 ceph-mon[32756]: pgmap v13742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:13:18.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:18 smithi156 ceph-mon[32679]: pgmap v13742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:13:18.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:18 smithi092 ceph-mon[29156]: pgmap v13742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:13:19.823 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24894.757361 secs 2024-04-27T01:13:19.823 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24197.726660 secs 2024-04-27T01:13:19.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24894.757361 secs 2024-04-27T01:13:19.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24197.726660 secs 2024-04-27T01:13:19.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24894.757361 secs 2024-04-27T01:13:19.921 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24197.726660 secs 2024-04-27T01:13:20.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:20 smithi189 ceph-mon[32756]: pgmap v13743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:20.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:20 smithi156 ceph-mon[32679]: pgmap v13743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:20.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:20 smithi092 ceph-mon[29156]: pgmap v13743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:22.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:22 smithi189 ceph-mon[32756]: pgmap v13744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:22.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:22 smithi156 ceph-mon[32679]: pgmap v13744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:22.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:22 smithi092 ceph-mon[29156]: pgmap v13744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:24.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:23 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24899.757422 secs 2024-04-27T01:13:24.232 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:23 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24202.726777 secs 2024-04-27T01:13:24.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:23 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24899.757422 secs 2024-04-27T01:13:24.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:23 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24202.726777 secs 2024-04-27T01:13:24.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:23 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24899.757422 secs 2024-04-27T01:13:24.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:23 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24202.726777 secs 2024-04-27T01:13:25.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:24 smithi189 ceph-mon[32756]: pgmap v13745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:25.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:24 smithi156 ceph-mon[32679]: pgmap v13745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:25.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:24 smithi092 ceph-mon[29156]: pgmap v13745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:26.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:26 smithi189 ceph-mon[32756]: pgmap v13746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:26.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:26 smithi156 ceph-mon[32679]: pgmap v13746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:26.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:26 smithi092 ceph-mon[29156]: pgmap v13746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:28.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:28 smithi189 ceph-mon[32756]: pgmap v13747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:28.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:28 smithi156 ceph-mon[32679]: pgmap v13747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:28.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:28 smithi092 ceph-mon[29156]: pgmap v13747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:29.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24904.757538 secs 2024-04-27T01:13:29.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24207.726881 secs 2024-04-27T01:13:29.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24904.757538 secs 2024-04-27T01:13:29.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24207.726881 secs 2024-04-27T01:13:29.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24904.757538 secs 2024-04-27T01:13:29.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24207.726881 secs 2024-04-27T01:13:31.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:31 smithi189 ceph-mon[32756]: pgmap v13748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:31.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:31 smithi156 ceph-mon[32679]: pgmap v13748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:31.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:31 smithi092 ceph-mon[29156]: pgmap v13748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:33.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:33 smithi189 ceph-mon[32756]: pgmap v13749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:33.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:33 smithi156 ceph-mon[32679]: pgmap v13749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:33.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:33 smithi092 ceph-mon[29156]: pgmap v13749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:34.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24909.757672 secs 2024-04-27T01:13:34.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24212.726997 secs 2024-04-27T01:13:34.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24909.757672 secs 2024-04-27T01:13:34.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24212.726997 secs 2024-04-27T01:13:34.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24909.757672 secs 2024-04-27T01:13:34.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24212.726997 secs 2024-04-27T01:13:35.793 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:35 smithi092 ceph-mon[29156]: pgmap v13750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:35.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:35 smithi189 ceph-mon[32756]: pgmap v13750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:35.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:35 smithi156 ceph-mon[32679]: pgmap v13750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:37.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:37 smithi189 ceph-mon[32756]: pgmap v13751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:37.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:37 smithi156 ceph-mon[32679]: pgmap v13751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:37.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:37 smithi092 ceph-mon[29156]: pgmap v13751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:39 smithi189 ceph-mon[32756]: pgmap v13752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24914.757790 secs 2024-04-27T01:13:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24217.727098 secs 2024-04-27T01:13:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:39 smithi156 ceph-mon[32679]: pgmap v13752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:39.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24914.757790 secs 2024-04-27T01:13:39.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24217.727098 secs 2024-04-27T01:13:39.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:39 smithi092 ceph-mon[29156]: pgmap v13752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:39.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24914.757790 secs 2024-04-27T01:13:39.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24217.727098 secs 2024-04-27T01:13:41.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:41 smithi189 ceph-mon[32756]: pgmap v13753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:41.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:41 smithi156 ceph-mon[32679]: pgmap v13753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:41.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:41 smithi092 ceph-mon[29156]: pgmap v13753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:43.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:43 smithi189 ceph-mon[32756]: pgmap v13754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:43.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:43 smithi156 ceph-mon[32679]: pgmap v13754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:43.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:43 smithi092 ceph-mon[29156]: pgmap v13754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:44.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24919.757909 secs 2024-04-27T01:13:44.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24222.727217 secs 2024-04-27T01:13:44.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24919.757909 secs 2024-04-27T01:13:44.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24222.727217 secs 2024-04-27T01:13:44.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24919.757909 secs 2024-04-27T01:13:44.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24222.727217 secs 2024-04-27T01:13:45.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:45 smithi189 ceph-mon[32756]: pgmap v13755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:45.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:45 smithi156 ceph-mon[32679]: pgmap v13755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:45.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:45 smithi092 ceph-mon[29156]: pgmap v13755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:47.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:47 smithi189 ceph-mon[32756]: pgmap v13756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:47.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:47 smithi156 ceph-mon[32679]: pgmap v13756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:47.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:47 smithi092 ceph-mon[29156]: pgmap v13756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:49.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:49 smithi189 ceph-mon[32756]: pgmap v13757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:49.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24924.757973 secs 2024-04-27T01:13:49.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24227.727334 secs 2024-04-27T01:13:49.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:49 smithi156 ceph-mon[32679]: pgmap v13757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:49.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24924.757973 secs 2024-04-27T01:13:49.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24227.727334 secs 2024-04-27T01:13:49.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:49 smithi092 ceph-mon[29156]: pgmap v13757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:49.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24924.757973 secs 2024-04-27T01:13:49.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24227.727334 secs 2024-04-27T01:13:51.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:51 smithi189 ceph-mon[32756]: pgmap v13758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:51.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:51 smithi156 ceph-mon[32679]: pgmap v13758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:51.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:51 smithi092 ceph-mon[29156]: pgmap v13758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:53.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:53 smithi189 ceph-mon[32756]: pgmap v13759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:53.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:53 smithi156 ceph-mon[32679]: pgmap v13759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:53.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:53 smithi092 ceph-mon[29156]: pgmap v13759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:54.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24929.758096 secs 2024-04-27T01:13:54.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24232.727451 secs 2024-04-27T01:13:54.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24929.758096 secs 2024-04-27T01:13:54.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24232.727451 secs 2024-04-27T01:13:54.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24929.758096 secs 2024-04-27T01:13:54.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24232.727451 secs 2024-04-27T01:13:55.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:55 smithi189 ceph-mon[32756]: pgmap v13760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:55.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:55 smithi156 ceph-mon[32679]: pgmap v13760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:55.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:55 smithi092 ceph-mon[29156]: pgmap v13760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:13:57.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:57 smithi189 ceph-mon[32756]: pgmap v13761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:57.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:57 smithi156 ceph-mon[32679]: pgmap v13761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:57.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:57 smithi092 ceph-mon[29156]: pgmap v13761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:59 smithi189 ceph-mon[32756]: pgmap v13762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24934.758187 secs 2024-04-27T01:13:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:13:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24237.727515 secs 2024-04-27T01:13:59.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:59 smithi156 ceph-mon[32679]: pgmap v13762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:59.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24934.758187 secs 2024-04-27T01:13:59.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:13:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24237.727515 secs 2024-04-27T01:13:59.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:59 smithi092 ceph-mon[29156]: pgmap v13762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:13:59.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24934.758187 secs 2024-04-27T01:13:59.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:13:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24237.727515 secs 2024-04-27T01:14:01.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:01 smithi189 ceph-mon[32756]: pgmap v13763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:01.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:01 smithi156 ceph-mon[32679]: pgmap v13763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:01.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:01 smithi092 ceph-mon[29156]: pgmap v13763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:03.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:03 smithi189 ceph-mon[32756]: pgmap v13764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:03.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:03 smithi156 ceph-mon[32679]: pgmap v13764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:03.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:03 smithi092 ceph-mon[29156]: pgmap v13764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:04.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24939.758311 secs 2024-04-27T01:14:04.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24242.727655 secs 2024-04-27T01:14:04.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24939.758311 secs 2024-04-27T01:14:04.883 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24242.727655 secs 2024-04-27T01:14:04.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24939.758311 secs 2024-04-27T01:14:04.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24242.727655 secs 2024-04-27T01:14:05.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:05 smithi189 ceph-mon[32756]: pgmap v13765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:05.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:05 smithi156 ceph-mon[32679]: pgmap v13765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:05.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:05 smithi092 ceph-mon[29156]: pgmap v13765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:07.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:07 smithi189 ceph-mon[32756]: pgmap v13766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:07.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:07 smithi156 ceph-mon[32679]: pgmap v13766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:07.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:07 smithi092 ceph-mon[29156]: pgmap v13766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:08.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:14:08.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:14:08.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: pgmap v13767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24944.758377 secs 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24247.727724 secs 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:14:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: pgmap v13768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:14:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: pgmap v13769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:09.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:14:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: pgmap v13767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24944.758377 secs 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24247.727724 secs 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: pgmap v13768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: pgmap v13769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:09.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:14:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: pgmap v13767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24944.758377 secs 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24247.727724 secs 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: pgmap v13768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: pgmap v13769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:09.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:14:12.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:12 smithi189 ceph-mon[32756]: pgmap v13770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:12.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:12 smithi156 ceph-mon[32679]: pgmap v13770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:12.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:12 smithi092 ceph-mon[29156]: pgmap v13770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:14.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:14 smithi189 ceph-mon[32756]: pgmap v13771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:14:14.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24949.758507 secs 2024-04-27T01:14:14.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24252.727844 secs 2024-04-27T01:14:14.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:14 smithi156 ceph-mon[32679]: pgmap v13771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:14:14.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24949.758507 secs 2024-04-27T01:14:14.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24252.727844 secs 2024-04-27T01:14:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:14 smithi092 ceph-mon[29156]: pgmap v13771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:14:14.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24949.758507 secs 2024-04-27T01:14:14.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24252.727844 secs 2024-04-27T01:14:16.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:16 smithi189 ceph-mon[32756]: pgmap v13772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:16.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:16 smithi156 ceph-mon[32679]: pgmap v13772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:16 smithi092 ceph-mon[29156]: pgmap v13772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:18.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:18 smithi189 ceph-mon[32756]: pgmap v13773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:18.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:18 smithi156 ceph-mon[32679]: pgmap v13773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:18.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:18 smithi092 ceph-mon[29156]: pgmap v13773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:14:19.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24954.758609 secs 2024-04-27T01:14:19.573 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24257.727917 secs 2024-04-27T01:14:19.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24954.758609 secs 2024-04-27T01:14:19.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24257.727917 secs 2024-04-27T01:14:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24954.758609 secs 2024-04-27T01:14:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24257.727917 secs 2024-04-27T01:14:20.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:20 smithi189 ceph-mon[32756]: pgmap v13774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:14:20.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:20 smithi156 ceph-mon[32679]: pgmap v13774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:14:20.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:20 smithi092 ceph-mon[29156]: pgmap v13774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:14:22.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:22 smithi189 ceph-mon[32756]: pgmap v13775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:22.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:22 smithi156 ceph-mon[32679]: pgmap v13775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:22.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:22 smithi092 ceph-mon[29156]: pgmap v13775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:24 smithi189 ceph-mon[32756]: pgmap v13776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24959.758702 secs 2024-04-27T01:14:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24262.728063 secs 2024-04-27T01:14:24.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:24 smithi156 ceph-mon[32679]: pgmap v13776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:24.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24959.758702 secs 2024-04-27T01:14:24.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24262.728063 secs 2024-04-27T01:14:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:24 smithi092 ceph-mon[29156]: pgmap v13776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24959.758702 secs 2024-04-27T01:14:24.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24262.728063 secs 2024-04-27T01:14:26.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:26 smithi189 ceph-mon[32756]: pgmap v13777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:26.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:26 smithi156 ceph-mon[32679]: pgmap v13777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:26.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:26 smithi092 ceph-mon[29156]: pgmap v13777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:28.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:28 smithi189 ceph-mon[32756]: pgmap v13778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:28.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:28 smithi156 ceph-mon[32679]: pgmap v13778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:28.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:28 smithi092 ceph-mon[29156]: pgmap v13778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:29.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24964.758815 secs 2024-04-27T01:14:29.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24267.728199 secs 2024-04-27T01:14:29.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24964.758815 secs 2024-04-27T01:14:29.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24267.728199 secs 2024-04-27T01:14:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24964.758815 secs 2024-04-27T01:14:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24267.728199 secs 2024-04-27T01:14:30.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:30 smithi189 ceph-mon[32756]: pgmap v13779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:30.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:30 smithi156 ceph-mon[32679]: pgmap v13779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:30.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:30 smithi092 ceph-mon[29156]: pgmap v13779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:32.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:32 smithi189 ceph-mon[32756]: pgmap v13780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:32.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:32 smithi156 ceph-mon[32679]: pgmap v13780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:32.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:32 smithi092 ceph-mon[29156]: pgmap v13780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:34 smithi189 ceph-mon[32756]: pgmap v13781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24969.758933 secs 2024-04-27T01:14:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24272.728337 secs 2024-04-27T01:14:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:34 smithi156 ceph-mon[32679]: pgmap v13781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24969.758933 secs 2024-04-27T01:14:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24272.728337 secs 2024-04-27T01:14:34.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:34 smithi092 ceph-mon[29156]: pgmap v13781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:34.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24969.758933 secs 2024-04-27T01:14:34.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24272.728337 secs 2024-04-27T01:14:36.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:36 smithi189 ceph-mon[32756]: pgmap v13782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:36.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:36 smithi156 ceph-mon[32679]: pgmap v13782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:36.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:36 smithi092 ceph-mon[29156]: pgmap v13782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:38.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:38 smithi189 ceph-mon[32756]: pgmap v13783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:38.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:38 smithi156 ceph-mon[32679]: pgmap v13783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:38.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:38 smithi092 ceph-mon[29156]: pgmap v13783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:39.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:39 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 24974.759053 secs 2024-04-27T01:14:39.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:39 smithi189 ceph-mon[32756]: slow request 1441.641919 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:14:39.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24277.728432 secs 2024-04-27T01:14:39.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:39 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 24974.759053 secs 2024-04-27T01:14:39.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:39 smithi156 ceph-mon[32679]: slow request 1441.641919 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:14:39.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24277.728432 secs 2024-04-27T01:14:39.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:39 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 24974.759053 secs 2024-04-27T01:14:39.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:39 smithi092 ceph-mon[29156]: slow request 1441.641919 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:14:39.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24277.728432 secs 2024-04-27T01:14:40.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:40 smithi189 ceph-mon[32756]: pgmap v13784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:40.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:40 smithi156 ceph-mon[32679]: pgmap v13784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:40.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:40 smithi092 ceph-mon[29156]: pgmap v13784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:42 smithi189 ceph-mon[32756]: pgmap v13785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:42.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:42 smithi156 ceph-mon[32679]: pgmap v13785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:42.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:42 smithi092 ceph-mon[29156]: pgmap v13785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:44.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:44 smithi189 ceph-mon[32756]: pgmap v13786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:44.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24979.759156 secs 2024-04-27T01:14:44.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24282.728497 secs 2024-04-27T01:14:44.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:44 smithi156 ceph-mon[32679]: pgmap v13786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:44.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24979.759156 secs 2024-04-27T01:14:44.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24282.728497 secs 2024-04-27T01:14:44.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:44 smithi092 ceph-mon[29156]: pgmap v13786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24979.759156 secs 2024-04-27T01:14:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24282.728497 secs 2024-04-27T01:14:46.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:46 smithi189 ceph-mon[32756]: pgmap v13787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:46.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:46 smithi156 ceph-mon[32679]: pgmap v13787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:46.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:46 smithi092 ceph-mon[29156]: pgmap v13787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:48.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:48 smithi189 ceph-mon[32756]: pgmap v13788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:48.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:48 smithi156 ceph-mon[32679]: pgmap v13788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:48.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:48 smithi092 ceph-mon[29156]: pgmap v13788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:14:49.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24984.759278 secs 2024-04-27T01:14:49.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24287.728615 secs 2024-04-27T01:14:49.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24984.759278 secs 2024-04-27T01:14:49.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24287.728615 secs 2024-04-27T01:14:49.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24984.759278 secs 2024-04-27T01:14:49.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24287.728615 secs 2024-04-27T01:14:50.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:50 smithi156 ceph-mon[32679]: pgmap v13789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:50.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:50 smithi092 ceph-mon[29156]: pgmap v13789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:50.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:50 smithi189 ceph-mon[32756]: pgmap v13789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:14:52.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:52 smithi156 ceph-mon[32679]: pgmap v13790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:52.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:52 smithi092 ceph-mon[29156]: pgmap v13790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:52.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:52 smithi189 ceph-mon[32756]: pgmap v13790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:54.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:54 smithi156 ceph-mon[32679]: pgmap v13791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24989.759391 secs 2024-04-27T01:14:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24292.728731 secs 2024-04-27T01:14:54.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:54 smithi092 ceph-mon[29156]: pgmap v13791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:54.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24989.759391 secs 2024-04-27T01:14:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24292.728731 secs 2024-04-27T01:14:54.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:54 smithi189 ceph-mon[32756]: pgmap v13791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:54.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24989.759391 secs 2024-04-27T01:14:54.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24292.728731 secs 2024-04-27T01:14:56.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:56 smithi156 ceph-mon[32679]: pgmap v13792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:56.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:56 smithi092 ceph-mon[29156]: pgmap v13792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:56.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:56 smithi189 ceph-mon[32756]: pgmap v13792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:14:58.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:58 smithi156 ceph-mon[32679]: pgmap v13793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:58.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:58 smithi092 ceph-mon[29156]: pgmap v13793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:58.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:58 smithi189 ceph-mon[32756]: pgmap v13793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:14:59.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24994.759507 secs 2024-04-27T01:14:59.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:14:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24297.728811 secs 2024-04-27T01:14:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24994.759507 secs 2024-04-27T01:14:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:14:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24297.728811 secs 2024-04-27T01:14:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24994.759507 secs 2024-04-27T01:14:59.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:14:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24297.728811 secs 2024-04-27T01:15:00.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:00 smithi156 ceph-mon[32679]: pgmap v13794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:00.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:00 smithi092 ceph-mon[29156]: pgmap v13794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:00.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:00 smithi189 ceph-mon[32756]: pgmap v13794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:02.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:02 smithi156 ceph-mon[32679]: pgmap v13795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:02.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:02 smithi092 ceph-mon[29156]: pgmap v13795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:02.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:02 smithi189 ceph-mon[32756]: pgmap v13795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:04.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:04 smithi156 ceph-mon[32679]: pgmap v13796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:04.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 24999.759607 secs 2024-04-27T01:15:04.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:04 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24302.728943 secs 2024-04-27T01:15:04.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:04 smithi156 ceph-mon[32679]: slow request 23042.382680 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:15:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:04 smithi092 ceph-mon[29156]: pgmap v13796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 24999.759607 secs 2024-04-27T01:15:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:04 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24302.728943 secs 2024-04-27T01:15:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:04 smithi092 ceph-mon[29156]: slow request 23042.382680 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:15:04.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:04 smithi189 ceph-mon[32756]: pgmap v13796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:04.880 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 24999.759607 secs 2024-04-27T01:15:04.880 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:04 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24302.728943 secs 2024-04-27T01:15:04.880 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:04 smithi189 ceph-mon[32756]: slow request 23042.382680 seconds old, received at 2024-04-26T18:51:01.492297+0000: client_request(client.16878:1 getattr pAsLsXsFs #0x1 2024-04-26T18:51:01.488085+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:15:06.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:06 smithi156 ceph-mon[32679]: pgmap v13797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:06.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:06 smithi092 ceph-mon[29156]: pgmap v13797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:06.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:06 smithi189 ceph-mon[32756]: pgmap v13797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:08.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:08 smithi156 ceph-mon[32679]: pgmap v13798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:08.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:08 smithi092 ceph-mon[29156]: pgmap v13798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:08.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:08 smithi189 ceph-mon[32756]: pgmap v13798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:09.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25004.759740 secs 2024-04-27T01:15:09.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24307.729013 secs 2024-04-27T01:15:09.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:15:09.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25004.759740 secs 2024-04-27T01:15:09.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24307.729013 secs 2024-04-27T01:15:09.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:15:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25004.759740 secs 2024-04-27T01:15:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24307.729013 secs 2024-04-27T01:15:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:15:10.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:10 smithi092 ceph-mon[29156]: pgmap v13799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:10.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:15:10.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:15:10.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:15:10.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:10 smithi189 ceph-mon[32756]: pgmap v13799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:10.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:15:10.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:15:10.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:15:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:10 smithi156 ceph-mon[32679]: pgmap v13799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:15:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:15:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:15:11.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:11 smithi092 ceph-mon[29156]: pgmap v13800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:15:11.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:11 smithi092 ceph-mon[29156]: pgmap v13801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:11.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:11 smithi189 ceph-mon[32756]: pgmap v13800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:15:11.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:11 smithi189 ceph-mon[32756]: pgmap v13801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:11.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:11 smithi156 ceph-mon[32679]: pgmap v13800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:15:11.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:11 smithi156 ceph-mon[32679]: pgmap v13801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:13.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:13 smithi092 ceph-mon[29156]: pgmap v13802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:13.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:13 smithi189 ceph-mon[32756]: pgmap v13802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:13.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:13 smithi156 ceph-mon[32679]: pgmap v13802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25009.759852 secs 2024-04-27T01:15:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24312.729130 secs 2024-04-27T01:15:14.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25009.759852 secs 2024-04-27T01:15:14.777 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24312.729130 secs 2024-04-27T01:15:14.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25009.759852 secs 2024-04-27T01:15:14.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24312.729130 secs 2024-04-27T01:15:15.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:15 smithi092 ceph-mon[29156]: pgmap v13803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:15 smithi189 ceph-mon[32756]: pgmap v13803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:15.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:15 smithi156 ceph-mon[32679]: pgmap v13803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:17.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:17 smithi092 ceph-mon[29156]: pgmap v13804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:17.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:17 smithi189 ceph-mon[32756]: pgmap v13804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:17.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:17 smithi156 ceph-mon[32679]: pgmap v13804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:15:19.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:19 smithi156 ceph-mon[32679]: pgmap v13805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:15:19.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25014.759920 secs 2024-04-27T01:15:19.724 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24317.729245 secs 2024-04-27T01:15:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:19 smithi092 ceph-mon[29156]: pgmap v13805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:15:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25014.759920 secs 2024-04-27T01:15:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24317.729245 secs 2024-04-27T01:15:19.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:19 smithi189 ceph-mon[32756]: pgmap v13805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:15:19.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25014.759920 secs 2024-04-27T01:15:19.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24317.729245 secs 2024-04-27T01:15:21.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:21 smithi092 ceph-mon[29156]: pgmap v13806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:15:21.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:21 smithi189 ceph-mon[32756]: pgmap v13806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:15:21.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:21 smithi156 ceph-mon[32679]: pgmap v13806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:15:23.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:23 smithi092 ceph-mon[29156]: pgmap v13807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:23.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:23 smithi189 ceph-mon[32756]: pgmap v13807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:23.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:23 smithi156 ceph-mon[32679]: pgmap v13807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25019.760043 secs 2024-04-27T01:15:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24322.729371 secs 2024-04-27T01:15:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25019.760043 secs 2024-04-27T01:15:24.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24322.729371 secs 2024-04-27T01:15:24.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25019.760043 secs 2024-04-27T01:15:24.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24322.729371 secs 2024-04-27T01:15:25.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:25 smithi092 ceph-mon[29156]: pgmap v13808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:25.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:25 smithi189 ceph-mon[32756]: pgmap v13808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:25.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:25 smithi156 ceph-mon[32679]: pgmap v13808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:27.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:27 smithi092 ceph-mon[29156]: pgmap v13809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:27.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:27 smithi189 ceph-mon[32756]: pgmap v13809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:27.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:27 smithi156 ceph-mon[32679]: pgmap v13809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:29 smithi092 ceph-mon[29156]: pgmap v13810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25024.760107 secs 2024-04-27T01:15:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24327.729483 secs 2024-04-27T01:15:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:29 smithi189 ceph-mon[32756]: pgmap v13810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:29.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25024.760107 secs 2024-04-27T01:15:29.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24327.729483 secs 2024-04-27T01:15:29.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:29 smithi156 ceph-mon[32679]: pgmap v13810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:29.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25024.760107 secs 2024-04-27T01:15:29.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24327.729483 secs 2024-04-27T01:15:31.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:31 smithi092 ceph-mon[29156]: pgmap v13811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:31.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:31 smithi189 ceph-mon[32756]: pgmap v13811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:31.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:31 smithi156 ceph-mon[32679]: pgmap v13811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:33.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:33 smithi092 ceph-mon[29156]: pgmap v13812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:33.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:33 smithi189 ceph-mon[32756]: pgmap v13812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:33.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:33 smithi156 ceph-mon[32679]: pgmap v13812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:34.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25029.760242 secs 2024-04-27T01:15:34.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24332.729606 secs 2024-04-27T01:15:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25029.760242 secs 2024-04-27T01:15:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24332.729606 secs 2024-04-27T01:15:34.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25029.760242 secs 2024-04-27T01:15:34.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24332.729606 secs 2024-04-27T01:15:35.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:35 smithi092 ceph-mon[29156]: pgmap v13813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:35.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:35 smithi189 ceph-mon[32756]: pgmap v13813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:35.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:35 smithi156 ceph-mon[32679]: pgmap v13813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:37.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:37 smithi092 ceph-mon[29156]: pgmap v13814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:37.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:37 smithi189 ceph-mon[32756]: pgmap v13814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:37.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:37 smithi156 ceph-mon[32679]: pgmap v13814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:15:39.421+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:15:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:15:39.421+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:15:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:15:39.421+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:15:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:15:39.421+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 194 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:15:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:39 smithi189 ceph-mon[32756]: pgmap v13815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25034.760360 secs 2024-04-27T01:15:39.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24337.729729 secs 2024-04-27T01:15:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:39 smithi156 ceph-mon[32679]: pgmap v13815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25034.760360 secs 2024-04-27T01:15:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24337.729729 secs 2024-04-27T01:15:39.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:39 smithi092 ceph-mon[29156]: pgmap v13815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:39.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25034.760360 secs 2024-04-27T01:15:39.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24337.729729 secs 2024-04-27T01:15:40.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:40 smithi189 ceph-mon[32756]: pgmap v13816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:40.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:40 smithi156 ceph-mon[32679]: pgmap v13816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:40.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:40 smithi092 ceph-mon[29156]: pgmap v13816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:43.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:43 smithi189 ceph-mon[32756]: pgmap v13817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:43.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:43 smithi156 ceph-mon[32679]: pgmap v13817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:43.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:43 smithi092 ceph-mon[29156]: pgmap v13817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:44.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25039.760455 secs 2024-04-27T01:15:44.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24342.729847 secs 2024-04-27T01:15:44.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25039.760455 secs 2024-04-27T01:15:44.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24342.729847 secs 2024-04-27T01:15:44.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25039.760455 secs 2024-04-27T01:15:44.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24342.729847 secs 2024-04-27T01:15:45.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:45 smithi189 ceph-mon[32756]: pgmap v13818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:45.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:45 smithi156 ceph-mon[32679]: pgmap v13818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:45.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:45 smithi092 ceph-mon[29156]: pgmap v13818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:47.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:47 smithi189 ceph-mon[32756]: pgmap v13819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:47.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:47 smithi156 ceph-mon[32679]: pgmap v13819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:47.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:47 smithi092 ceph-mon[29156]: pgmap v13819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:49.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:49 smithi189 ceph-mon[32756]: pgmap v13820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:49.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25044.760547 secs 2024-04-27T01:15:49.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24347.729945 secs 2024-04-27T01:15:49.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:49 smithi156 ceph-mon[32679]: pgmap v13820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:49.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25044.760547 secs 2024-04-27T01:15:49.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24347.729945 secs 2024-04-27T01:15:49.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:49 smithi092 ceph-mon[29156]: pgmap v13820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:49.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25044.760547 secs 2024-04-27T01:15:49.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24347.729945 secs 2024-04-27T01:15:51.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:51 smithi189 ceph-mon[32756]: pgmap v13821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:51.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:51 smithi156 ceph-mon[32679]: pgmap v13821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:51.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:51 smithi092 ceph-mon[29156]: pgmap v13821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:53.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:53 smithi189 ceph-mon[32756]: pgmap v13822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:53.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:53 smithi156 ceph-mon[32679]: pgmap v13822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:53.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:53 smithi092 ceph-mon[29156]: pgmap v13822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:54.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25049.760665 secs 2024-04-27T01:15:54.376 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24352.730088 secs 2024-04-27T01:15:54.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25049.760665 secs 2024-04-27T01:15:54.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24352.730088 secs 2024-04-27T01:15:54.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25049.760665 secs 2024-04-27T01:15:54.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24352.730088 secs 2024-04-27T01:15:55.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:55 smithi189 ceph-mon[32756]: pgmap v13823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:55.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:55 smithi156 ceph-mon[32679]: pgmap v13823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:55.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:55 smithi092 ceph-mon[29156]: pgmap v13823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:15:57.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:57 smithi189 ceph-mon[32756]: pgmap v13824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:57.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:57 smithi156 ceph-mon[32679]: pgmap v13824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:57.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:57 smithi092 ceph-mon[29156]: pgmap v13824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:59.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:59 smithi189 ceph-mon[32756]: pgmap v13825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:59.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25054.760739 secs 2024-04-27T01:15:59.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:15:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24357.730200 secs 2024-04-27T01:15:59.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:59 smithi156 ceph-mon[32679]: pgmap v13825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:59.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25054.760739 secs 2024-04-27T01:15:59.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:15:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24357.730200 secs 2024-04-27T01:15:59.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:59 smithi092 ceph-mon[29156]: pgmap v13825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:15:59.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25054.760739 secs 2024-04-27T01:15:59.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:15:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24357.730200 secs 2024-04-27T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:01 smithi189 ceph-mon[32756]: pgmap v13826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:01.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:01 smithi156 ceph-mon[32679]: pgmap v13826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:01.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:01 smithi092 ceph-mon[29156]: pgmap v13826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:03.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:03 smithi189 ceph-mon[32756]: pgmap v13827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:03.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:03 smithi156 ceph-mon[32679]: pgmap v13827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:03.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:03 smithi092 ceph-mon[29156]: pgmap v13827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:04.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25059.760858 secs 2024-04-27T01:16:04.382 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24362.730291 secs 2024-04-27T01:16:04.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25059.760858 secs 2024-04-27T01:16:04.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24362.730291 secs 2024-04-27T01:16:04.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25059.760858 secs 2024-04-27T01:16:04.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24362.730291 secs 2024-04-27T01:16:05.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:05 smithi156 ceph-mon[32679]: pgmap v13828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:05.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:05 smithi092 ceph-mon[29156]: pgmap v13828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:05.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:05 smithi189 ceph-mon[32756]: pgmap v13828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:07.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:07 smithi156 ceph-mon[32679]: pgmap v13829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:07.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:07 smithi092 ceph-mon[29156]: pgmap v13829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:07.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:07 smithi189 ceph-mon[32756]: pgmap v13829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:09.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:09 smithi156 ceph-mon[32679]: pgmap v13830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:09.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25064.760973 secs 2024-04-27T01:16:09.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24367.730406 secs 2024-04-27T01:16:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:09 smithi092 ceph-mon[29156]: pgmap v13830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25064.760973 secs 2024-04-27T01:16:09.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24367.730406 secs 2024-04-27T01:16:09.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:09 smithi189 ceph-mon[32756]: pgmap v13830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:09.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25064.760973 secs 2024-04-27T01:16:09.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24367.730406 secs 2024-04-27T01:16:10.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:16:10.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:16:10.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:16:11.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:11 smithi156 ceph-mon[32679]: pgmap v13831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:11.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:16:11.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:16:11.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:16:11.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:11 smithi092 ceph-mon[29156]: pgmap v13831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:11.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:16:11.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:16:11.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:16:11.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:11 smithi189 ceph-mon[32756]: pgmap v13831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:11.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:16:11.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:16:11.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:16:12.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:12 smithi092 ceph-mon[29156]: pgmap v13832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:16:12.231 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:12 smithi092 ceph-mon[29156]: pgmap v13833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:12.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:12 smithi156 ceph-mon[32679]: pgmap v13832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:16:12.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:12 smithi156 ceph-mon[32679]: pgmap v13833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:12 smithi189 ceph-mon[32756]: pgmap v13832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:16:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:12 smithi189 ceph-mon[32756]: pgmap v13833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:14 smithi156 ceph-mon[32679]: pgmap v13834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:16:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25069.761092 secs 2024-04-27T01:16:14.421 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24372.730515 secs 2024-04-27T01:16:14.428 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:14 smithi189 ceph-mon[32756]: pgmap v13834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:16:14.428 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25069.761092 secs 2024-04-27T01:16:14.428 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24372.730515 secs 2024-04-27T01:16:14.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:14 smithi092 ceph-mon[29156]: pgmap v13834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:16:14.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25069.761092 secs 2024-04-27T01:16:14.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24372.730515 secs 2024-04-27T01:16:16.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:16 smithi092 ceph-mon[29156]: pgmap v13835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:16.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:16 smithi189 ceph-mon[32756]: pgmap v13835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:16.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:16 smithi156 ceph-mon[32679]: pgmap v13835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:18.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:18 smithi092 ceph-mon[29156]: pgmap v13836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:18 smithi189 ceph-mon[32756]: pgmap v13836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:18.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:18 smithi156 ceph-mon[32679]: pgmap v13836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:19.572 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25074.761212 secs 2024-04-27T01:16:19.572 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24377.730636 secs 2024-04-27T01:16:19.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25074.761212 secs 2024-04-27T01:16:19.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24377.730636 secs 2024-04-27T01:16:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25074.761212 secs 2024-04-27T01:16:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24377.730636 secs 2024-04-27T01:16:20.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:20 smithi189 ceph-mon[32756]: pgmap v13837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:20.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:20 smithi156 ceph-mon[32679]: pgmap v13837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:20.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:20 smithi092 ceph-mon[29156]: pgmap v13837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:16:22.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:22 smithi189 ceph-mon[32756]: pgmap v13838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:16:22.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:22 smithi156 ceph-mon[32679]: pgmap v13838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:16:22.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:22 smithi092 ceph-mon[29156]: pgmap v13838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:16:24.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:24 smithi189 ceph-mon[32756]: pgmap v13839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:24.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25079.761327 secs 2024-04-27T01:16:24.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24382.730711 secs 2024-04-27T01:16:24.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:24 smithi156 ceph-mon[32679]: pgmap v13839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:24.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25079.761327 secs 2024-04-27T01:16:24.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24382.730711 secs 2024-04-27T01:16:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:24 smithi092 ceph-mon[29156]: pgmap v13839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25079.761327 secs 2024-04-27T01:16:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24382.730711 secs 2024-04-27T01:16:26.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:26 smithi189 ceph-mon[32756]: pgmap v13840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:26.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:26 smithi156 ceph-mon[32679]: pgmap v13840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:26.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:26 smithi092 ceph-mon[29156]: pgmap v13840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:28.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:28 smithi189 ceph-mon[32756]: pgmap v13841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:28.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:28 smithi156 ceph-mon[32679]: pgmap v13841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:28.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:28 smithi092 ceph-mon[29156]: pgmap v13841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:29.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25084.761404 secs 2024-04-27T01:16:29.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24387.730831 secs 2024-04-27T01:16:29.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25084.761404 secs 2024-04-27T01:16:29.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24387.730831 secs 2024-04-27T01:16:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25084.761404 secs 2024-04-27T01:16:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24387.730831 secs 2024-04-27T01:16:30.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:30 smithi189 ceph-mon[32756]: pgmap v13842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:30.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:30 smithi156 ceph-mon[32679]: pgmap v13842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:30.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:30 smithi092 ceph-mon[29156]: pgmap v13842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:32.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:32 smithi189 ceph-mon[32756]: pgmap v13843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:32.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:32 smithi156 ceph-mon[32679]: pgmap v13843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:32.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:32 smithi092 ceph-mon[29156]: pgmap v13843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:34.533 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:34 smithi092 ceph-mon[29156]: pgmap v13844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:34.533 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25089.761537 secs 2024-04-27T01:16:34.533 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24392.730949 secs 2024-04-27T01:16:34.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:34 smithi189 ceph-mon[32756]: pgmap v13844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:34.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25089.761537 secs 2024-04-27T01:16:34.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24392.730949 secs 2024-04-27T01:16:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:34 smithi156 ceph-mon[32679]: pgmap v13844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25089.761537 secs 2024-04-27T01:16:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24392.730949 secs 2024-04-27T01:16:36.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:36 smithi189 ceph-mon[32756]: pgmap v13845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:36.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:36 smithi156 ceph-mon[32679]: pgmap v13845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:36.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:36 smithi092 ceph-mon[29156]: pgmap v13845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:37.731 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:16:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:16:37.444+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:16:37.731 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:16:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:16:37.444+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:16:37.731 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:16:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:16:37.444+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:16:37.731 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:16:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:16:37.444+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:16:37.731 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:16:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:16:37.444+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:16:38.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:38 smithi189 ceph-mon[32756]: pgmap v13846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:38.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:38 smithi156 ceph-mon[32679]: pgmap v13846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:38.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:38 smithi092 ceph-mon[29156]: pgmap v13846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:39.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25094.761686 secs 2024-04-27T01:16:39.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24397.731049 secs 2024-04-27T01:16:39.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25094.761686 secs 2024-04-27T01:16:39.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24397.731049 secs 2024-04-27T01:16:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25094.761686 secs 2024-04-27T01:16:39.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24397.731049 secs 2024-04-27T01:16:40.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:40 smithi189 ceph-mon[32756]: pgmap v13847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:40.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:40 smithi156 ceph-mon[32679]: pgmap v13847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:40.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:40 smithi092 ceph-mon[29156]: pgmap v13847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:42.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:42 smithi189 ceph-mon[32756]: pgmap v13848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:42.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:42 smithi156 ceph-mon[32679]: pgmap v13848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:42.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:42 smithi092 ceph-mon[29156]: pgmap v13848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:43.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:16:43.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:16:43.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:16:43.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:16:43.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:16:43.696 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:16:44.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:44 smithi189 ceph-mon[32756]: pgmap v13849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:44.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25099.761802 secs 2024-04-27T01:16:44.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24402.731190 secs 2024-04-27T01:16:44.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:44 smithi156 ceph-mon[32679]: pgmap v13849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:44.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25099.761802 secs 2024-04-27T01:16:44.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24402.731190 secs 2024-04-27T01:16:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:44 smithi092 ceph-mon[29156]: pgmap v13849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:44.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25099.761802 secs 2024-04-27T01:16:44.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24402.731190 secs 2024-04-27T01:16:46.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:46 smithi189 ceph-mon[32756]: pgmap v13850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:46.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:46 smithi156 ceph-mon[32679]: pgmap v13850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:46.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:46 smithi092 ceph-mon[29156]: pgmap v13850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:48.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:48 smithi189 ceph-mon[32756]: pgmap v13851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:48.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:48 smithi156 ceph-mon[32679]: pgmap v13851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:48.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:48 smithi092 ceph-mon[29156]: pgmap v13851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:16:49.572 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25104.761894 secs 2024-04-27T01:16:49.572 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24407.731326 secs 2024-04-27T01:16:49.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25104.761894 secs 2024-04-27T01:16:49.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24407.731326 secs 2024-04-27T01:16:49.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25104.761894 secs 2024-04-27T01:16:49.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24407.731326 secs 2024-04-27T01:16:50.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:50 smithi189 ceph-mon[32756]: pgmap v13852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:50.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:50 smithi156 ceph-mon[32679]: pgmap v13852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:50.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:50 smithi092 ceph-mon[29156]: pgmap v13852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:16:52.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:52 smithi189 ceph-mon[32756]: pgmap v13853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:52.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:52 smithi156 ceph-mon[32679]: pgmap v13853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:52.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:52 smithi092 ceph-mon[29156]: pgmap v13853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:54.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:54 smithi189 ceph-mon[32756]: pgmap v13854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:54.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25109.762006 secs 2024-04-27T01:16:54.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24412.731401 secs 2024-04-27T01:16:54.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:54 smithi156 ceph-mon[32679]: pgmap v13854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:54.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25109.762006 secs 2024-04-27T01:16:54.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24412.731401 secs 2024-04-27T01:16:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:54 smithi092 ceph-mon[29156]: pgmap v13854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:54.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25109.762006 secs 2024-04-27T01:16:54.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24412.731401 secs 2024-04-27T01:16:56.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:56 smithi189 ceph-mon[32756]: pgmap v13855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:56.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:56 smithi156 ceph-mon[32679]: pgmap v13855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:56.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:56 smithi092 ceph-mon[29156]: pgmap v13855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:16:58.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:58 smithi189 ceph-mon[32756]: pgmap v13856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:58.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:58 smithi156 ceph-mon[32679]: pgmap v13856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:58.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:58 smithi092 ceph-mon[29156]: pgmap v13856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:16:59.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25114.762115 secs 2024-04-27T01:16:59.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:16:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24417.731505 secs 2024-04-27T01:16:59.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25114.762115 secs 2024-04-27T01:16:59.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:16:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24417.731505 secs 2024-04-27T01:16:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25114.762115 secs 2024-04-27T01:16:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:16:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24417.731505 secs 2024-04-27T01:17:00.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:00 smithi189 ceph-mon[32756]: pgmap v13857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:00.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:00 smithi156 ceph-mon[32679]: pgmap v13857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:00.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:00 smithi092 ceph-mon[29156]: pgmap v13857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:02.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:02 smithi189 ceph-mon[32756]: pgmap v13858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:02.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:02 smithi156 ceph-mon[32679]: pgmap v13858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:02.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:02 smithi092 ceph-mon[29156]: pgmap v13858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:04.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:04 smithi189 ceph-mon[32756]: pgmap v13859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:04.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25119.762191 secs 2024-04-27T01:17:04.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24422.731620 secs 2024-04-27T01:17:04.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:04 smithi156 ceph-mon[32679]: pgmap v13859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:04.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25119.762191 secs 2024-04-27T01:17:04.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24422.731620 secs 2024-04-27T01:17:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:04 smithi092 ceph-mon[29156]: pgmap v13859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25119.762191 secs 2024-04-27T01:17:04.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24422.731620 secs 2024-04-27T01:17:06.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:06 smithi189 ceph-mon[32756]: pgmap v13860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:06.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:06 smithi156 ceph-mon[32679]: pgmap v13860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:06.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:06 smithi092 ceph-mon[29156]: pgmap v13860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:08.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:08 smithi189 ceph-mon[32756]: pgmap v13861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:08.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:08 smithi156 ceph-mon[32679]: pgmap v13861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:08.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:08 smithi092 ceph-mon[29156]: pgmap v13861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:09.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25124.762325 secs 2024-04-27T01:17:09.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24427.731746 secs 2024-04-27T01:17:09.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25124.762325 secs 2024-04-27T01:17:09.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24427.731746 secs 2024-04-27T01:17:09.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25124.762325 secs 2024-04-27T01:17:09.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24427.731746 secs 2024-04-27T01:17:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:10 smithi189 ceph-mon[32756]: pgmap v13862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:10.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:10 smithi156 ceph-mon[32679]: pgmap v13862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:10.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:10 smithi092 ceph-mon[29156]: pgmap v13862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:11.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:17:11.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:17:11.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:17:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:12 smithi189 ceph-mon[32756]: pgmap v13863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:17:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:17:12.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:17:12.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:12 smithi156 ceph-mon[32679]: pgmap v13863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:12.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:17:12.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:17:12.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:17:12.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:12 smithi092 ceph-mon[29156]: pgmap v13863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:12.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:17:12.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:17:12.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:17:13.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:13 smithi189 ceph-mon[32756]: pgmap v13864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:17:13.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:13 smithi189 ceph-mon[32756]: pgmap v13865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:13.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:13 smithi156 ceph-mon[32679]: pgmap v13864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:17:13.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:13 smithi156 ceph-mon[32679]: pgmap v13865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:13 smithi092 ceph-mon[29156]: pgmap v13864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:17:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:13 smithi092 ceph-mon[29156]: pgmap v13865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:14.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25129.762462 secs 2024-04-27T01:17:14.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24432.731813 secs 2024-04-27T01:17:14.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25129.762462 secs 2024-04-27T01:17:14.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24432.731813 secs 2024-04-27T01:17:14.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25129.762462 secs 2024-04-27T01:17:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24432.731813 secs 2024-04-27T01:17:15.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:15 smithi189 ceph-mon[32756]: pgmap v13866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:15.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:15 smithi156 ceph-mon[32679]: pgmap v13866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:15 smithi092 ceph-mon[29156]: pgmap v13866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:17.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:17 smithi189 ceph-mon[32756]: pgmap v13867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:17.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:17 smithi156 ceph-mon[32679]: pgmap v13867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:17 smithi092 ceph-mon[29156]: pgmap v13867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:19.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:19 smithi189 ceph-mon[32756]: pgmap v13868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:17:19.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25134.762579 secs 2024-04-27T01:17:19.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24437.731938 secs 2024-04-27T01:17:19.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:19 smithi156 ceph-mon[32679]: pgmap v13868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:17:19.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25134.762579 secs 2024-04-27T01:17:19.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24437.731938 secs 2024-04-27T01:17:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:19 smithi092 ceph-mon[29156]: pgmap v13868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:17:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25134.762579 secs 2024-04-27T01:17:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24437.731938 secs 2024-04-27T01:17:21.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:21 smithi156 ceph-mon[32679]: pgmap v13869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:21.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:21 smithi092 ceph-mon[29156]: pgmap v13869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:21.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:21 smithi189 ceph-mon[32756]: pgmap v13869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:17:23.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:23 smithi156 ceph-mon[32679]: pgmap v13870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:17:23.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:23 smithi092 ceph-mon[29156]: pgmap v13870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:17:23.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:23 smithi189 ceph-mon[32756]: pgmap v13870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:17:24.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25139.762714 secs 2024-04-27T01:17:24.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24442.732060 secs 2024-04-27T01:17:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25139.762714 secs 2024-04-27T01:17:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24442.732060 secs 2024-04-27T01:17:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25139.762714 secs 2024-04-27T01:17:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24442.732060 secs 2024-04-27T01:17:25.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:25 smithi156 ceph-mon[32679]: pgmap v13871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:25.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:25 smithi092 ceph-mon[29156]: pgmap v13871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:25.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:25 smithi189 ceph-mon[32756]: pgmap v13871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:27.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:27 smithi156 ceph-mon[32679]: pgmap v13872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:27.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:27 smithi092 ceph-mon[29156]: pgmap v13872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:27.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:27 smithi189 ceph-mon[32756]: pgmap v13872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:29.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:29 smithi156 ceph-mon[32679]: pgmap v13873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:29.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25144.762848 secs 2024-04-27T01:17:29.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24447.732176 secs 2024-04-27T01:17:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:29 smithi092 ceph-mon[29156]: pgmap v13873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25144.762848 secs 2024-04-27T01:17:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24447.732176 secs 2024-04-27T01:17:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:29 smithi189 ceph-mon[32756]: pgmap v13873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25144.762848 secs 2024-04-27T01:17:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24447.732176 secs 2024-04-27T01:17:31.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:31 smithi156 ceph-mon[32679]: pgmap v13874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:31.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:31 smithi092 ceph-mon[29156]: pgmap v13874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:31.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:31 smithi189 ceph-mon[32756]: pgmap v13874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:33.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:33 smithi156 ceph-mon[32679]: pgmap v13875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:33.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:33 smithi092 ceph-mon[29156]: pgmap v13875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:33.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:33 smithi189 ceph-mon[32756]: pgmap v13875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25149.762894 secs 2024-04-27T01:17:34.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24452.732315 secs 2024-04-27T01:17:34.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25149.762894 secs 2024-04-27T01:17:34.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24452.732315 secs 2024-04-27T01:17:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25149.762894 secs 2024-04-27T01:17:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24452.732315 secs 2024-04-27T01:17:35.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:35 smithi156 ceph-mon[32679]: pgmap v13876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:35.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:35 smithi092 ceph-mon[29156]: pgmap v13876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:35.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:35 smithi189 ceph-mon[32756]: pgmap v13876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:37.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:37 smithi156 ceph-mon[32679]: pgmap v13877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:37.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:37 smithi092 ceph-mon[29156]: pgmap v13877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:37.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:37 smithi189 ceph-mon[32756]: pgmap v13877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:39.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:39 smithi156 ceph-mon[32679]: pgmap v13878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:39.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25154.763045 secs 2024-04-27T01:17:39.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24457.732492 secs 2024-04-27T01:17:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:39 smithi092 ceph-mon[29156]: pgmap v13878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25154.763045 secs 2024-04-27T01:17:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24457.732492 secs 2024-04-27T01:17:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:39 smithi189 ceph-mon[32756]: pgmap v13878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25154.763045 secs 2024-04-27T01:17:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24457.732492 secs 2024-04-27T01:17:41.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:41 smithi156 ceph-mon[32679]: pgmap v13879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:41 smithi092 ceph-mon[29156]: pgmap v13879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:41.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:41 smithi189 ceph-mon[32756]: pgmap v13879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:43.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:43 smithi092 ceph-mon[29156]: pgmap v13880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:43.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:43 smithi189 ceph-mon[32756]: pgmap v13880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:43 smithi156 ceph-mon[32679]: pgmap v13880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25159.763139 secs 2024-04-27T01:17:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24462.732612 secs 2024-04-27T01:17:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25159.763139 secs 2024-04-27T01:17:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24462.732612 secs 2024-04-27T01:17:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25159.763139 secs 2024-04-27T01:17:44.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24462.732612 secs 2024-04-27T01:17:45.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:45 smithi092 ceph-mon[29156]: pgmap v13881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:45.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:45 smithi189 ceph-mon[32756]: pgmap v13881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:45.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:45 smithi156 ceph-mon[32679]: pgmap v13881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:47.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:47 smithi092 ceph-mon[29156]: pgmap v13882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:47.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:47 smithi189 ceph-mon[32756]: pgmap v13882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:47.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:47 smithi156 ceph-mon[32679]: pgmap v13882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:49.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:49 smithi156 ceph-mon[32679]: pgmap v13883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:49.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25164.763264 secs 2024-04-27T01:17:49.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24467.732726 secs 2024-04-27T01:17:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:49 smithi092 ceph-mon[29156]: pgmap v13883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25164.763264 secs 2024-04-27T01:17:49.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24467.732726 secs 2024-04-27T01:17:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:49 smithi189 ceph-mon[32756]: pgmap v13883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25164.763264 secs 2024-04-27T01:17:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24467.732726 secs 2024-04-27T01:17:51.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:51 smithi092 ceph-mon[29156]: pgmap v13884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:51.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:51 smithi189 ceph-mon[32756]: pgmap v13884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:51.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:51 smithi156 ceph-mon[32679]: pgmap v13884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:53.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:53 smithi092 ceph-mon[29156]: pgmap v13885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:53.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:53 smithi189 ceph-mon[32756]: pgmap v13885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:53.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:53 smithi156 ceph-mon[32679]: pgmap v13885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25169.763339 secs 2024-04-27T01:17:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24472.732845 secs 2024-04-27T01:17:54.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25169.763339 secs 2024-04-27T01:17:54.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24472.732845 secs 2024-04-27T01:17:54.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25169.763339 secs 2024-04-27T01:17:54.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24472.732845 secs 2024-04-27T01:17:55.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:55 smithi092 ceph-mon[29156]: pgmap v13886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:55.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:55 smithi189 ceph-mon[32756]: pgmap v13886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:55.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:55 smithi156 ceph-mon[32679]: pgmap v13886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:17:57.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:57 smithi092 ceph-mon[29156]: pgmap v13887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:57.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:57 smithi189 ceph-mon[32756]: pgmap v13887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:57.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:57 smithi156 ceph-mon[32679]: pgmap v13887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:59.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:59 smithi092 ceph-mon[29156]: pgmap v13888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25174.763454 secs 2024-04-27T01:17:59.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:17:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24477.732910 secs 2024-04-27T01:17:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:59 smithi189 ceph-mon[32756]: pgmap v13888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25174.763454 secs 2024-04-27T01:17:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:17:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24477.732910 secs 2024-04-27T01:17:59.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:59 smithi156 ceph-mon[32679]: pgmap v13888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:17:59.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25174.763454 secs 2024-04-27T01:17:59.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:17:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24477.732910 secs 2024-04-27T01:18:01.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:01 smithi092 ceph-mon[29156]: pgmap v13889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:01.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:01 smithi189 ceph-mon[32756]: pgmap v13889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:01.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:01 smithi156 ceph-mon[32679]: pgmap v13889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:03.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:03 smithi092 ceph-mon[29156]: pgmap v13890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:03.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:03 smithi189 ceph-mon[32756]: pgmap v13890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:03.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:03 smithi156 ceph-mon[32679]: pgmap v13890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:04.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25179.763572 secs 2024-04-27T01:18:04.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24482.733039 secs 2024-04-27T01:18:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25179.763572 secs 2024-04-27T01:18:04.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24482.733039 secs 2024-04-27T01:18:04.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25179.763572 secs 2024-04-27T01:18:04.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24482.733039 secs 2024-04-27T01:18:05.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:05 smithi092 ceph-mon[29156]: pgmap v13891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:05.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:05 smithi189 ceph-mon[32756]: pgmap v13891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:05.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:05 smithi156 ceph-mon[32679]: pgmap v13891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:07.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:07 smithi092 ceph-mon[29156]: pgmap v13892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:07.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:07 smithi189 ceph-mon[32756]: pgmap v13892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:07.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:07 smithi156 ceph-mon[32679]: pgmap v13892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:09.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:09 smithi092 ceph-mon[29156]: pgmap v13893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:09.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25184.763690 secs 2024-04-27T01:18:09.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24487.733104 secs 2024-04-27T01:18:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:09 smithi189 ceph-mon[32756]: pgmap v13893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25184.763690 secs 2024-04-27T01:18:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24487.733104 secs 2024-04-27T01:18:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:09 smithi156 ceph-mon[32679]: pgmap v13893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25184.763690 secs 2024-04-27T01:18:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24487.733104 secs 2024-04-27T01:18:11.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:11 smithi092 ceph-mon[29156]: pgmap v13894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:11.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:11 smithi189 ceph-mon[32756]: pgmap v13894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:11.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:11 smithi156 ceph-mon[32679]: pgmap v13894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:12.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:18:12.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:18:12.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:18:12.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:18:12.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:18:12.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:18:12.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:18:12.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:18:12.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:18:12.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:18:12.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:18:12.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:18:13.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:13 smithi189 ceph-mon[32756]: pgmap v13895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:13.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:13 smithi189 ceph-mon[32756]: pgmap v13896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:18:13.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:13 smithi189 ceph-mon[32756]: pgmap v13897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:13.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:13 smithi156 ceph-mon[32679]: pgmap v13895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:13.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:13 smithi156 ceph-mon[32679]: pgmap v13896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:18:13.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:13 smithi156 ceph-mon[32679]: pgmap v13897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:13.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:13 smithi092 ceph-mon[29156]: pgmap v13895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:13.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:13 smithi092 ceph-mon[29156]: pgmap v13896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:18:13.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:13 smithi092 ceph-mon[29156]: pgmap v13897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:14.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25189.763756 secs 2024-04-27T01:18:14.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24492.733218 secs 2024-04-27T01:18:14.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25189.763756 secs 2024-04-27T01:18:14.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24492.733218 secs 2024-04-27T01:18:14.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25189.763756 secs 2024-04-27T01:18:14.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24492.733218 secs 2024-04-27T01:18:15.855 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:15 smithi092 ceph-mon[29156]: pgmap v13898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:15.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:15 smithi189 ceph-mon[32756]: pgmap v13898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:15 smithi156 ceph-mon[32679]: pgmap v13898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:17 smithi189 ceph-mon[32756]: pgmap v13899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:17 smithi156 ceph-mon[32679]: pgmap v13899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:17.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:17 smithi092 ceph-mon[29156]: pgmap v13899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:19.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:19 smithi189 ceph-mon[32756]: pgmap v13900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:19.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25194.763902 secs 2024-04-27T01:18:19.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24497.733350 secs 2024-04-27T01:18:19.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:19 smithi156 ceph-mon[32679]: pgmap v13900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:19.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25194.763902 secs 2024-04-27T01:18:19.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24497.733350 secs 2024-04-27T01:18:19.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:19 smithi092 ceph-mon[29156]: pgmap v13900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:18:19.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25194.763902 secs 2024-04-27T01:18:19.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24497.733350 secs 2024-04-27T01:18:21.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:21 smithi189 ceph-mon[32756]: pgmap v13901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:21.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:21 smithi156 ceph-mon[32679]: pgmap v13901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:21.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:21 smithi092 ceph-mon[29156]: pgmap v13901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:18:23.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:23 smithi189 ceph-mon[32756]: pgmap v13902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:18:23.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:23 smithi156 ceph-mon[32679]: pgmap v13902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:18:23.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:23 smithi092 ceph-mon[29156]: pgmap v13902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:18:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25199.763984 secs 2024-04-27T01:18:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24502.733425 secs 2024-04-27T01:18:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25199.763984 secs 2024-04-27T01:18:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24502.733425 secs 2024-04-27T01:18:24.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25199.763984 secs 2024-04-27T01:18:24.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24502.733425 secs 2024-04-27T01:18:25.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:25 smithi189 ceph-mon[32756]: pgmap v13903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:25.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:25 smithi156 ceph-mon[32679]: pgmap v13903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:25.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:25 smithi092 ceph-mon[29156]: pgmap v13903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:26.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:26 smithi189 ceph-mon[32756]: pgmap v13904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:26.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:26 smithi156 ceph-mon[32679]: pgmap v13904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:26.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:26 smithi092 ceph-mon[29156]: pgmap v13904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:29 smithi092 ceph-mon[29156]: pgmap v13905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25204.764049 secs 2024-04-27T01:18:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24507.733501 secs 2024-04-27T01:18:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:29 smithi189 ceph-mon[32756]: pgmap v13905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25204.764049 secs 2024-04-27T01:18:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24507.733501 secs 2024-04-27T01:18:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:29 smithi156 ceph-mon[32679]: pgmap v13905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25204.764049 secs 2024-04-27T01:18:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24507.733501 secs 2024-04-27T01:18:31.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:31 smithi092 ceph-mon[29156]: pgmap v13906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:31.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:31 smithi189 ceph-mon[32756]: pgmap v13906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:31.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:31 smithi156 ceph-mon[32679]: pgmap v13906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:33.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:33 smithi092 ceph-mon[29156]: pgmap v13907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:33.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:33 smithi189 ceph-mon[32756]: pgmap v13907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:33.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:33 smithi156 ceph-mon[32679]: pgmap v13907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:34.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25209.764132 secs 2024-04-27T01:18:34.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24512.733618 secs 2024-04-27T01:18:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25209.764132 secs 2024-04-27T01:18:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24512.733618 secs 2024-04-27T01:18:34.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25209.764132 secs 2024-04-27T01:18:34.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24512.733618 secs 2024-04-27T01:18:35.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:35 smithi092 ceph-mon[29156]: pgmap v13908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:35.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:35 smithi189 ceph-mon[32756]: pgmap v13908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:35.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:35 smithi156 ceph-mon[32679]: pgmap v13908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80b0050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80b0050 comp rx=0 tx=0).stop 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T01:18:36.016 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.029+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:18:36.017 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.030+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80d7000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T01:18:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T01:18:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T01:18:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=26 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T01:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T01:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:36.068+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T01:18:37.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:37 smithi092 ceph-mon[29156]: pgmap v13909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:37.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:37 smithi189 ceph-mon[32756]: pgmap v13909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:37.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:37 smithi156 ceph-mon[32679]: pgmap v13909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:39.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:39.446+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:18:39.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:39.446+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:18:39.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:39.446+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:18:39.433 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:18:39.447+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 195 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:18:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:39 smithi092 ceph-mon[29156]: pgmap v13910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:39 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25214.764254 secs 2024-04-27T01:18:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24517.733725 secs 2024-04-27T01:18:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:39 smithi189 ceph-mon[32756]: pgmap v13910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:39 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25214.764254 secs 2024-04-27T01:18:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24517.733725 secs 2024-04-27T01:18:39.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:39 smithi156 ceph-mon[32679]: pgmap v13910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:39.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:39 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25214.764254 secs 2024-04-27T01:18:39.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24517.733725 secs 2024-04-27T01:18:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:41 smithi092 ceph-mon[29156]: pgmap v13911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:41.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:41 smithi189 ceph-mon[32756]: pgmap v13911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:41.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:41 smithi156 ceph-mon[32679]: pgmap v13911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:43.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:43 smithi092 ceph-mon[29156]: pgmap v13912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:43.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:43 smithi189 ceph-mon[32756]: pgmap v13912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:43 smithi156 ceph-mon[32679]: pgmap v13912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:44 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25219.764371 secs 2024-04-27T01:18:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24522.733842 secs 2024-04-27T01:18:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:44 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25219.764371 secs 2024-04-27T01:18:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24522.733842 secs 2024-04-27T01:18:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:44 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25219.764371 secs 2024-04-27T01:18:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24522.733842 secs 2024-04-27T01:18:45.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:45 smithi092 ceph-mon[29156]: pgmap v13913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:45.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:45 smithi189 ceph-mon[32756]: pgmap v13913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:45.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:45 smithi156 ceph-mon[32679]: pgmap v13913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:47.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:47 smithi092 ceph-mon[29156]: pgmap v13914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:47.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:47 smithi189 ceph-mon[32756]: pgmap v13914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:47.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:47 smithi156 ceph-mon[32679]: pgmap v13914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:49.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:49 smithi156 ceph-mon[32679]: pgmap v13915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:49.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:49 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25224.764479 secs 2024-04-27T01:18:49.723 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24527.733963 secs 2024-04-27T01:18:49.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:49 smithi092 ceph-mon[29156]: pgmap v13915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:49.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:49 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25224.764479 secs 2024-04-27T01:18:49.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24527.733963 secs 2024-04-27T01:18:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:49 smithi189 ceph-mon[32756]: pgmap v13915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:49 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25224.764479 secs 2024-04-27T01:18:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24527.733963 secs 2024-04-27T01:18:51.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:51 smithi092 ceph-mon[29156]: pgmap v13916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:51.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:51 smithi189 ceph-mon[32756]: pgmap v13916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:51.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:51 smithi156 ceph-mon[32679]: pgmap v13916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:53.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:53 smithi092 ceph-mon[29156]: pgmap v13917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:53.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:53 smithi189 ceph-mon[32756]: pgmap v13917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:53.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:53 smithi156 ceph-mon[32679]: pgmap v13917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:54 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25229.764555 secs 2024-04-27T01:18:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24532.734038 secs 2024-04-27T01:18:54.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:54 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25229.764555 secs 2024-04-27T01:18:54.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24532.734038 secs 2024-04-27T01:18:54.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:54 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25229.764555 secs 2024-04-27T01:18:54.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24532.734038 secs 2024-04-27T01:18:55.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:55 smithi092 ceph-mon[29156]: pgmap v13918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:55.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:55 smithi189 ceph-mon[32756]: pgmap v13918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:55.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:55 smithi156 ceph-mon[32679]: pgmap v13918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:18:57.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:57 smithi189 ceph-mon[32756]: pgmap v13919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:57.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:57 smithi156 ceph-mon[32679]: pgmap v13919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:57.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:57 smithi092 ceph-mon[29156]: pgmap v13919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:59 smithi189 ceph-mon[32756]: pgmap v13920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:59 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25234.764693 secs 2024-04-27T01:18:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:18:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24537.734154 secs 2024-04-27T01:18:59.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:59 smithi156 ceph-mon[32679]: pgmap v13920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:59.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:59 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25234.764693 secs 2024-04-27T01:18:59.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:18:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24537.734154 secs 2024-04-27T01:18:59.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:59 smithi092 ceph-mon[29156]: pgmap v13920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:18:59.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:59 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25234.764693 secs 2024-04-27T01:18:59.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:18:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24537.734154 secs 2024-04-27T01:19:01.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:01 smithi189 ceph-mon[32756]: pgmap v13921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:01.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:01 smithi156 ceph-mon[32679]: pgmap v13921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:01.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:01 smithi092 ceph-mon[29156]: pgmap v13921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:03.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:03 smithi189 ceph-mon[32756]: pgmap v13922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:03.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:03 smithi156 ceph-mon[32679]: pgmap v13922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:03.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:03 smithi092 ceph-mon[29156]: pgmap v13922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:04.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:04 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25239.764818 secs 2024-04-27T01:19:04.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24542.734269 secs 2024-04-27T01:19:04.881 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:04 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25239.764818 secs 2024-04-27T01:19:04.881 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24542.734269 secs 2024-04-27T01:19:04.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:04 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25239.764818 secs 2024-04-27T01:19:04.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24542.734269 secs 2024-04-27T01:19:05.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:05 smithi189 ceph-mon[32756]: pgmap v13923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:05.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:05 smithi156 ceph-mon[32679]: pgmap v13923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:05.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:05 smithi092 ceph-mon[29156]: pgmap v13923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:07.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:07 smithi189 ceph-mon[32756]: pgmap v13924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:07.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:07 smithi156 ceph-mon[32679]: pgmap v13924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:07.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:07 smithi092 ceph-mon[29156]: pgmap v13924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:09 smithi189 ceph-mon[32756]: pgmap v13925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:09 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25244.764919 secs 2024-04-27T01:19:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24547.734369 secs 2024-04-27T01:19:09.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:09 smithi156 ceph-mon[32679]: pgmap v13925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:09.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:09 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25244.764919 secs 2024-04-27T01:19:09.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24547.734369 secs 2024-04-27T01:19:09.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:09 smithi092 ceph-mon[29156]: pgmap v13925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:09.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:09 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25244.764919 secs 2024-04-27T01:19:09.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24547.734369 secs 2024-04-27T01:19:11.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:11 smithi189 ceph-mon[32756]: pgmap v13926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:11.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:11 smithi156 ceph-mon[32679]: pgmap v13926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:11.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:11 smithi092 ceph-mon[29156]: pgmap v13926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: pgmap v13927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:19:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: pgmap v13927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: pgmap v13927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:13.815 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:14.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:14 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25249.764981 secs 2024-04-27T01:19:14.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24552.734437 secs 2024-04-27T01:19:14.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:14 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25249.764981 secs 2024-04-27T01:19:14.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24552.734437 secs 2024-04-27T01:19:14.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:14 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25249.764981 secs 2024-04-27T01:19:14.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24552.734437 secs 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: pgmap v13928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: pgmap v13928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: pgmap v13928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:15.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:19:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:16.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:19:16.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:19:16.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:19:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:19:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:19:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:19:17.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:19:17.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: pgmap v13929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:17.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:17 smithi092 ceph-mon[29156]: pgmap v13930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:17.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:19:17.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: pgmap v13929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:17.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:17 smithi189 ceph-mon[32756]: pgmap v13930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:19:17.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: pgmap v13929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:17.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:17 smithi156 ceph-mon[32679]: pgmap v13930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:19.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:19 smithi156 ceph-mon[32679]: pgmap v13931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:19.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:19 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25254.765096 secs 2024-04-27T01:19:19.722 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24557.734565 secs 2024-04-27T01:19:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:19 smithi092 ceph-mon[29156]: pgmap v13931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:19 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25254.765096 secs 2024-04-27T01:19:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24557.734565 secs 2024-04-27T01:19:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:19 smithi189 ceph-mon[32756]: pgmap v13931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:19.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:19 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25254.765096 secs 2024-04-27T01:19:19.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24557.734565 secs 2024-04-27T01:19:21.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:21 smithi092 ceph-mon[29156]: pgmap v13932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:21.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:21 smithi189 ceph-mon[32756]: pgmap v13932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:21.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:21 smithi156 ceph-mon[32679]: pgmap v13932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:23.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:23 smithi092 ceph-mon[29156]: pgmap v13933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:23.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:23 smithi189 ceph-mon[32756]: pgmap v13933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:23.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:23 smithi156 ceph-mon[32679]: pgmap v13933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:19:24.451+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:19:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:19:24.451+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:19:24.438 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:19:24.451+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:19:24.439 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:19:24.451+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 196 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:19:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:24 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25259.765174 secs 2024-04-27T01:19:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24562.734676 secs 2024-04-27T01:19:24.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:24 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25259.765174 secs 2024-04-27T01:19:24.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24562.734676 secs 2024-04-27T01:19:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:24 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25259.765174 secs 2024-04-27T01:19:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24562.734676 secs 2024-04-27T01:19:25.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:25 smithi092 ceph-mon[29156]: pgmap v13934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:25.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:25 smithi189 ceph-mon[32756]: pgmap v13934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:25.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:25 smithi156 ceph-mon[32679]: pgmap v13934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:19:27.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:27 smithi092 ceph-mon[29156]: pgmap v13935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:19:27.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:27 smithi189 ceph-mon[32756]: pgmap v13935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:19:27.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:27 smithi156 ceph-mon[32679]: pgmap v13935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:19:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:29 smithi189 ceph-mon[32756]: pgmap v13936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:29 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25264.765271 secs 2024-04-27T01:19:29.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24567.734798 secs 2024-04-27T01:19:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:29 smithi156 ceph-mon[32679]: pgmap v13936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:29 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25264.765271 secs 2024-04-27T01:19:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24567.734798 secs 2024-04-27T01:19:29.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:29 smithi092 ceph-mon[29156]: pgmap v13936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:29.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:29 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25264.765271 secs 2024-04-27T01:19:29.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24567.734798 secs 2024-04-27T01:19:31.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:31 smithi189 ceph-mon[32756]: pgmap v13937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:31.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:31 smithi156 ceph-mon[32679]: pgmap v13937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:31.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:31 smithi092 ceph-mon[29156]: pgmap v13937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:33.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:33 smithi189 ceph-mon[32756]: pgmap v13938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:33.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:33 smithi156 ceph-mon[32679]: pgmap v13938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:33.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:33 smithi092 ceph-mon[29156]: pgmap v13938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:34.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:34 smithi189 ceph-mon[32756]: 8 slow requests, 0 included below; oldest blocked for > 25269.765363 secs 2024-04-27T01:19:34.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24572.734888 secs 2024-04-27T01:19:34.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:34 smithi092 ceph-mon[29156]: 8 slow requests, 0 included below; oldest blocked for > 25269.765363 secs 2024-04-27T01:19:34.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24572.734888 secs 2024-04-27T01:19:34.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:34 smithi156 ceph-mon[32679]: 8 slow requests, 0 included below; oldest blocked for > 25269.765363 secs 2024-04-27T01:19:34.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24572.734888 secs 2024-04-27T01:19:35.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:35 smithi189 ceph-mon[32756]: pgmap v13939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:35.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:35 smithi156 ceph-mon[32679]: pgmap v13939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:35.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:35 smithi092 ceph-mon[29156]: pgmap v13939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:37.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:37 smithi189 ceph-mon[32756]: pgmap v13940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:37.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:37 smithi156 ceph-mon[32679]: pgmap v13940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:37.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:37 smithi092 ceph-mon[29156]: pgmap v13940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:39 smithi189 ceph-mon[32756]: pgmap v13941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:39 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 25274.765460 secs 2024-04-27T01:19:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:39 smithi189 ceph-mon[32756]: slow request 181.229616 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:19:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:39 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24577.735011 secs 2024-04-27T01:19:39.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:39 smithi189 ceph-mon[32756]: slow request 1441.779330 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:19:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:39 smithi156 ceph-mon[32679]: pgmap v13941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:39 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 25274.765460 secs 2024-04-27T01:19:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:39 smithi156 ceph-mon[32679]: slow request 181.229616 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:19:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:39 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24577.735011 secs 2024-04-27T01:19:39.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:39 smithi156 ceph-mon[32679]: slow request 1441.779330 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:19:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:39 smithi092 ceph-mon[29156]: pgmap v13941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:39 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 25274.765460 secs 2024-04-27T01:19:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:39 smithi092 ceph-mon[29156]: slow request 181.229616 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:19:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:39 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24577.735011 secs 2024-04-27T01:19:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:39 smithi092 ceph-mon[29156]: slow request 1441.779330 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:19:41.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:41 smithi189 ceph-mon[32756]: pgmap v13942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:41.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:41 smithi156 ceph-mon[32679]: pgmap v13942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:41.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:41 smithi092 ceph-mon[29156]: pgmap v13942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:43.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:43 smithi189 ceph-mon[32756]: pgmap v13943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:43.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:19:43.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:19:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:43 smithi156 ceph-mon[32679]: pgmap v13943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:19:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:19:43.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:43 smithi092 ceph-mon[29156]: pgmap v13943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:43.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:19:43.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:19:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25279.765579 secs 2024-04-27T01:19:44.776 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24582.735107 secs 2024-04-27T01:19:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25279.765579 secs 2024-04-27T01:19:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24582.735107 secs 2024-04-27T01:19:44.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25279.765579 secs 2024-04-27T01:19:44.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24582.735107 secs 2024-04-27T01:19:45.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:45 smithi189 ceph-mon[32756]: pgmap v13944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:45.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:45 smithi156 ceph-mon[32679]: pgmap v13944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:45.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:45 smithi092 ceph-mon[29156]: pgmap v13944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:46.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:46 smithi189 ceph-mon[32756]: pgmap v13945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:46.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:46 smithi156 ceph-mon[32679]: pgmap v13945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:46.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:46 smithi092 ceph-mon[29156]: pgmap v13945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:49.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:49 smithi189 ceph-mon[32756]: pgmap v13946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:49.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25284.765696 secs 2024-04-27T01:19:49.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24587.735170 secs 2024-04-27T01:19:49.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:49 smithi156 ceph-mon[32679]: pgmap v13946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:49.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25284.765696 secs 2024-04-27T01:19:49.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24587.735170 secs 2024-04-27T01:19:49.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:49 smithi092 ceph-mon[29156]: pgmap v13946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:49.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25284.765696 secs 2024-04-27T01:19:49.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24587.735170 secs 2024-04-27T01:19:51.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:51 smithi189 ceph-mon[32756]: pgmap v13947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:51.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:51 smithi156 ceph-mon[32679]: pgmap v13947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:51.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:51 smithi092 ceph-mon[29156]: pgmap v13947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:53.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:53 smithi189 ceph-mon[32756]: pgmap v13948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:53.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:53 smithi156 ceph-mon[32679]: pgmap v13948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:53.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:53 smithi092 ceph-mon[29156]: pgmap v13948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:54.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25289.765872 secs 2024-04-27T01:19:54.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24592.735306 secs 2024-04-27T01:19:54.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25289.765872 secs 2024-04-27T01:19:54.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24592.735306 secs 2024-04-27T01:19:54.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25289.765872 secs 2024-04-27T01:19:54.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24592.735306 secs 2024-04-27T01:19:55.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:55 smithi189 ceph-mon[32756]: pgmap v13949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:55.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:55 smithi156 ceph-mon[32679]: pgmap v13949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:55.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:55 smithi092 ceph-mon[29156]: pgmap v13949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:19:57.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:57 smithi189 ceph-mon[32756]: pgmap v13950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:57.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:57 smithi156 ceph-mon[32679]: pgmap v13950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:57.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:57 smithi092 ceph-mon[29156]: pgmap v13950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:59.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:59 smithi189 ceph-mon[32756]: pgmap v13951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:59.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25294.765965 secs 2024-04-27T01:19:59.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:19:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24597.735425 secs 2024-04-27T01:19:59.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:59 smithi156 ceph-mon[32679]: pgmap v13951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:59.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25294.765965 secs 2024-04-27T01:19:59.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:19:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24597.735425 secs 2024-04-27T01:19:59.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:59 smithi092 ceph-mon[29156]: pgmap v13951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:19:59.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25294.765965 secs 2024-04-27T01:19:59.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:19:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24597.735425 secs 2024-04-27T01:20:00.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:20:00.422 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:20:00.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:20:01.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:01 smithi189 ceph-mon[32756]: pgmap v13952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:01.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:01 smithi156 ceph-mon[32679]: pgmap v13952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:01.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:01 smithi092 ceph-mon[29156]: pgmap v13952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:03.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:03 smithi189 ceph-mon[32756]: pgmap v13953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:03.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:03 smithi156 ceph-mon[32679]: pgmap v13953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:03.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:03 smithi092 ceph-mon[29156]: pgmap v13953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:04.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25299.766040 secs 2024-04-27T01:20:04.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:04 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24602.735528 secs 2024-04-27T01:20:04.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:04 smithi189 ceph-mon[32756]: slow request 23042.281949 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:20:04.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25299.766040 secs 2024-04-27T01:20:04.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:04 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24602.735528 secs 2024-04-27T01:20:04.381 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:04 smithi092 ceph-mon[29156]: slow request 23042.281949 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:20:04.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25299.766040 secs 2024-04-27T01:20:04.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:04 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24602.735528 secs 2024-04-27T01:20:04.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:04 smithi156 ceph-mon[32679]: slow request 23042.281949 seconds old, received at 2024-04-26T18:56:01.599612+0000: client_request(client.16884:1 getattr pAsLsXsFs #0x1 2024-04-26T18:56:01.592602+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:20:05.230 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:05 smithi092 ceph-mon[29156]: pgmap v13954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:05.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:05 smithi189 ceph-mon[32756]: pgmap v13954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:05.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:05 smithi156 ceph-mon[32679]: pgmap v13954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:07.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:07 smithi189 ceph-mon[32756]: pgmap v13955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:07.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:07 smithi156 ceph-mon[32679]: pgmap v13955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:07.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:07 smithi092 ceph-mon[29156]: pgmap v13955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:09.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:09 smithi189 ceph-mon[32756]: pgmap v13956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:09.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25304.766157 secs 2024-04-27T01:20:09.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24607.735600 secs 2024-04-27T01:20:09.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:09 smithi156 ceph-mon[32679]: pgmap v13956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:09.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25304.766157 secs 2024-04-27T01:20:09.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24607.735600 secs 2024-04-27T01:20:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:09 smithi092 ceph-mon[29156]: pgmap v13956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25304.766157 secs 2024-04-27T01:20:09.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24607.735600 secs 2024-04-27T01:20:11.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:11 smithi189 ceph-mon[32756]: pgmap v13957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:11.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:11 smithi156 ceph-mon[32679]: pgmap v13957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:11.481 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:11 smithi092 ceph-mon[29156]: pgmap v13957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:13.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:13 smithi156 ceph-mon[32679]: pgmap v13958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:13.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:13 smithi092 ceph-mon[29156]: pgmap v13958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:13.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:13 smithi189 ceph-mon[32756]: pgmap v13958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:14.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25309.766223 secs 2024-04-27T01:20:14.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24612.735725 secs 2024-04-27T01:20:14.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25309.766223 secs 2024-04-27T01:20:14.480 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24612.735725 secs 2024-04-27T01:20:14.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25309.766223 secs 2024-04-27T01:20:14.526 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24612.735725 secs 2024-04-27T01:20:15.420 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:15 smithi156 ceph-mon[32679]: pgmap v13959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:15.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:15 smithi092 ceph-mon[29156]: pgmap v13959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:15.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:15 smithi189 ceph-mon[32756]: pgmap v13959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:16.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:20:16.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:20:16.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:20:17.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:17 smithi189 ceph-mon[32756]: pgmap v13960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:17.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:20:17.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:20:17.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:20:17.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:17 smithi156 ceph-mon[32679]: pgmap v13960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:17.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:20:17.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:20:17.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:20:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:17 smithi092 ceph-mon[29156]: pgmap v13960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:20:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:20:17.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:20:18.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:18 smithi189 ceph-mon[32756]: pgmap v13961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:20:18.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:18 smithi189 ceph-mon[32756]: pgmap v13962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:18.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:18 smithi156 ceph-mon[32679]: pgmap v13961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:20:18.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:18 smithi156 ceph-mon[32679]: pgmap v13962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:18.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:18 smithi092 ceph-mon[29156]: pgmap v13961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:20:18.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:18 smithi092 ceph-mon[29156]: pgmap v13962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:19.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25314.766347 secs 2024-04-27T01:20:19.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24617.735828 secs 2024-04-27T01:20:19.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25314.766347 secs 2024-04-27T01:20:19.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24617.735828 secs 2024-04-27T01:20:19.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25314.766347 secs 2024-04-27T01:20:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24617.735828 secs 2024-04-27T01:20:20.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:20 smithi156 ceph-mon[32679]: pgmap v13963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:20.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:20 smithi189 ceph-mon[32756]: pgmap v13963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:20.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:20 smithi092 ceph-mon[29156]: pgmap v13963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:22.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:22 smithi189 ceph-mon[32756]: pgmap v13964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:22.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:22 smithi156 ceph-mon[32679]: pgmap v13964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:22.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:22 smithi092 ceph-mon[29156]: pgmap v13964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:24.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:24 smithi189 ceph-mon[32756]: pgmap v13965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:20:24.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25319.766468 secs 2024-04-27T01:20:24.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24622.735890 secs 2024-04-27T01:20:24.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:24 smithi156 ceph-mon[32679]: pgmap v13965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:20:24.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25319.766468 secs 2024-04-27T01:20:24.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24622.735890 secs 2024-04-27T01:20:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:24 smithi092 ceph-mon[29156]: pgmap v13965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:20:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25319.766468 secs 2024-04-27T01:20:24.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24622.735890 secs 2024-04-27T01:20:26.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:26 smithi189 ceph-mon[32756]: pgmap v13966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:26.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:26 smithi156 ceph-mon[32679]: pgmap v13966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:26.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:26 smithi092 ceph-mon[29156]: pgmap v13966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:20:28.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:28 smithi189 ceph-mon[32756]: pgmap v13967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:20:28.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:28 smithi156 ceph-mon[32679]: pgmap v13967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:20:28.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:28 smithi092 ceph-mon[29156]: pgmap v13967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:20:29.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25324.766547 secs 2024-04-27T01:20:29.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24627.736028 secs 2024-04-27T01:20:29.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25324.766547 secs 2024-04-27T01:20:29.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24627.736028 secs 2024-04-27T01:20:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25324.766547 secs 2024-04-27T01:20:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24627.736028 secs 2024-04-27T01:20:30.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:30 smithi189 ceph-mon[32756]: pgmap v13968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:30.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:30 smithi156 ceph-mon[32679]: pgmap v13968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:30.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:30 smithi092 ceph-mon[29156]: pgmap v13968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:32.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:32 smithi189 ceph-mon[32756]: pgmap v13969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:32.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:32 smithi156 ceph-mon[32679]: pgmap v13969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:32.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:32 smithi092 ceph-mon[29156]: pgmap v13969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:34 smithi189 ceph-mon[32756]: pgmap v13970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25329.766663 secs 2024-04-27T01:20:34.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24632.736167 secs 2024-04-27T01:20:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:34 smithi156 ceph-mon[32679]: pgmap v13970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:34.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25329.766663 secs 2024-04-27T01:20:34.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24632.736167 secs 2024-04-27T01:20:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:34 smithi092 ceph-mon[29156]: pgmap v13970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:34.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25329.766663 secs 2024-04-27T01:20:34.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24632.736167 secs 2024-04-27T01:20:36.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:36 smithi189 ceph-mon[32756]: pgmap v13971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:36.655 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:36 smithi092 ceph-mon[29156]: pgmap v13971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:36.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:36 smithi156 ceph-mon[32679]: pgmap v13971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:38.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:38 smithi189 ceph-mon[32756]: pgmap v13972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:38.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:38 smithi156 ceph-mon[32679]: pgmap v13972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:38.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:38 smithi092 ceph-mon[29156]: pgmap v13972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:39.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25334.766780 secs 2024-04-27T01:20:39.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24637.736324 secs 2024-04-27T01:20:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25334.766780 secs 2024-04-27T01:20:39.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24637.736324 secs 2024-04-27T01:20:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25334.766780 secs 2024-04-27T01:20:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24637.736324 secs 2024-04-27T01:20:40.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:40 smithi189 ceph-mon[32756]: pgmap v13973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:40.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:40 smithi156 ceph-mon[32679]: pgmap v13973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:40.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:40 smithi092 ceph-mon[29156]: pgmap v13973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:42.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:42 smithi189 ceph-mon[32756]: pgmap v13974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:42.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:42 smithi156 ceph-mon[32679]: pgmap v13974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:42.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:42 smithi092 ceph-mon[29156]: pgmap v13974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:44 smithi189 ceph-mon[32756]: pgmap v13975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25339.766882 secs 2024-04-27T01:20:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24642.736376 secs 2024-04-27T01:20:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:44 smithi156 ceph-mon[32679]: pgmap v13975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:44.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25339.766882 secs 2024-04-27T01:20:44.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24642.736376 secs 2024-04-27T01:20:44.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:44 smithi092 ceph-mon[29156]: pgmap v13975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:44.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25339.766882 secs 2024-04-27T01:20:44.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24642.736376 secs 2024-04-27T01:20:46.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:46 smithi189 ceph-mon[32756]: pgmap v13976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:46.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:46 smithi156 ceph-mon[32679]: pgmap v13976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:46.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:46 smithi092 ceph-mon[29156]: pgmap v13976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:48.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:48 smithi189 ceph-mon[32756]: pgmap v13977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:48.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:48 smithi156 ceph-mon[32679]: pgmap v13977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:48.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:48 smithi092 ceph-mon[29156]: pgmap v13977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:49.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25344.767019 secs 2024-04-27T01:20:49.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24647.736485 secs 2024-04-27T01:20:49.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25344.767019 secs 2024-04-27T01:20:49.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24647.736485 secs 2024-04-27T01:20:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25344.767019 secs 2024-04-27T01:20:49.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24647.736485 secs 2024-04-27T01:20:50.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:50 smithi189 ceph-mon[32756]: pgmap v13978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:50.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:50 smithi156 ceph-mon[32679]: pgmap v13978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:50.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:50 smithi092 ceph-mon[29156]: pgmap v13978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:52.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:52 smithi189 ceph-mon[32756]: pgmap v13979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:52.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:52 smithi156 ceph-mon[32679]: pgmap v13979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:52.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:52 smithi092 ceph-mon[29156]: pgmap v13979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:54.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:54 smithi189 ceph-mon[32756]: pgmap v13980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:54.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25349.767094 secs 2024-04-27T01:20:54.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24652.736594 secs 2024-04-27T01:20:54.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:54 smithi156 ceph-mon[32679]: pgmap v13980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:54.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25349.767094 secs 2024-04-27T01:20:54.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24652.736594 secs 2024-04-27T01:20:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:54 smithi092 ceph-mon[29156]: pgmap v13980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25349.767094 secs 2024-04-27T01:20:54.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24652.736594 secs 2024-04-27T01:20:56.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:56 smithi189 ceph-mon[32756]: pgmap v13981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:56.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:56 smithi156 ceph-mon[32679]: pgmap v13981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:56.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:56 smithi092 ceph-mon[29156]: pgmap v13981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:20:58.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:58 smithi189 ceph-mon[32756]: pgmap v13982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:58.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:58 smithi156 ceph-mon[32679]: pgmap v13982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:58.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:58 smithi092 ceph-mon[29156]: pgmap v13982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:20:59.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25354.767210 secs 2024-04-27T01:20:59.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:20:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24657.736686 secs 2024-04-27T01:20:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25354.767210 secs 2024-04-27T01:20:59.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:20:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24657.736686 secs 2024-04-27T01:20:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25354.767210 secs 2024-04-27T01:20:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:20:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24657.736686 secs 2024-04-27T01:21:00.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:00 smithi156 ceph-mon[32679]: pgmap v13983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:00.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:00 smithi092 ceph-mon[29156]: pgmap v13983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:00.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:00 smithi189 ceph-mon[32756]: pgmap v13983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:02.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:02 smithi156 ceph-mon[32679]: pgmap v13984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:02.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:02 smithi092 ceph-mon[29156]: pgmap v13984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:02.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:02 smithi189 ceph-mon[32756]: pgmap v13984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:04.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:04 smithi156 ceph-mon[32679]: pgmap v13985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:04.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25359.767329 secs 2024-04-27T01:21:04.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24662.736749 secs 2024-04-27T01:21:04.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:04 smithi092 ceph-mon[29156]: pgmap v13985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:04.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25359.767329 secs 2024-04-27T01:21:04.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24662.736749 secs 2024-04-27T01:21:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:04 smithi189 ceph-mon[32756]: pgmap v13985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25359.767329 secs 2024-04-27T01:21:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24662.736749 secs 2024-04-27T01:21:06.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:06 smithi156 ceph-mon[32679]: pgmap v13986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:06.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:06 smithi092 ceph-mon[29156]: pgmap v13986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:06.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:06 smithi189 ceph-mon[32756]: pgmap v13986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:08.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:08 smithi156 ceph-mon[32679]: pgmap v13987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:08.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:08 smithi092 ceph-mon[29156]: pgmap v13987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:08.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:08 smithi189 ceph-mon[32756]: pgmap v13987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:09.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25364.767452 secs 2024-04-27T01:21:09.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24667.736882 secs 2024-04-27T01:21:09.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25364.767452 secs 2024-04-27T01:21:09.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24667.736882 secs 2024-04-27T01:21:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25364.767452 secs 2024-04-27T01:21:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24667.736882 secs 2024-04-27T01:21:10.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:10 smithi156 ceph-mon[32679]: pgmap v13988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:10.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:10 smithi092 ceph-mon[29156]: pgmap v13988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:10.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:10 smithi189 ceph-mon[32756]: pgmap v13988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:12.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:12 smithi156 ceph-mon[32679]: pgmap v13989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:12.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:12 smithi092 ceph-mon[29156]: pgmap v13989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:12.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:12 smithi189 ceph-mon[32756]: pgmap v13989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:14.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:14 smithi156 ceph-mon[32679]: pgmap v13990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:14.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25369.767570 secs 2024-04-27T01:21:14.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24672.737015 secs 2024-04-27T01:21:14.676 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:14 smithi189 ceph-mon[32756]: pgmap v13990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:14.676 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25369.767570 secs 2024-04-27T01:21:14.676 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24672.737015 secs 2024-04-27T01:21:14.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:14 smithi092 ceph-mon[29156]: pgmap v13990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:14.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25369.767570 secs 2024-04-27T01:21:14.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24672.737015 secs 2024-04-27T01:21:16.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:16 smithi156 ceph-mon[32679]: pgmap v13991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:16.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:16 smithi092 ceph-mon[29156]: pgmap v13991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:16.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:16 smithi189 ceph-mon[32756]: pgmap v13991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:21:17.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:21:17.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:21:17.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:21:18.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:18 smithi092 ceph-mon[29156]: pgmap v13992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:18.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:21:18.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:21:18.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:21:18.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:18 smithi189 ceph-mon[32756]: pgmap v13992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:18.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:21:18.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:21:18.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:21:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:18 smithi156 ceph-mon[32679]: pgmap v13992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:21:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:21:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:21:19.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:19 smithi092 ceph-mon[29156]: pgmap v13993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:21:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:19 smithi092 ceph-mon[29156]: pgmap v13994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:21:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25374.767667 secs 2024-04-27T01:21:19.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24677.737131 secs 2024-04-27T01:21:19.821 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:19 smithi156 ceph-mon[32679]: pgmap v13993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:21:19.821 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:19 smithi156 ceph-mon[32679]: pgmap v13994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:21:19.821 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25374.767667 secs 2024-04-27T01:21:19.821 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24677.737131 secs 2024-04-27T01:21:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:19 smithi189 ceph-mon[32756]: pgmap v13993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:21:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:19 smithi189 ceph-mon[32756]: pgmap v13994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:21:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25374.767667 secs 2024-04-27T01:21:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24677.737131 secs 2024-04-27T01:21:21.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:21 smithi092 ceph-mon[29156]: pgmap v13995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:21.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:21 smithi189 ceph-mon[32756]: pgmap v13995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:21.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:21 smithi156 ceph-mon[32679]: pgmap v13995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:23.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:23 smithi092 ceph-mon[29156]: pgmap v13996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:23.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:23 smithi189 ceph-mon[32756]: pgmap v13996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:23.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:23 smithi156 ceph-mon[32679]: pgmap v13996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25379.767798 secs 2024-04-27T01:21:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24682.737264 secs 2024-04-27T01:21:24.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25379.767798 secs 2024-04-27T01:21:24.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24682.737264 secs 2024-04-27T01:21:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25379.767798 secs 2024-04-27T01:21:24.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24682.737264 secs 2024-04-27T01:21:25.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:25 smithi092 ceph-mon[29156]: pgmap v13997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:25.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:25 smithi189 ceph-mon[32756]: pgmap v13997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:25.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:25 smithi156 ceph-mon[32679]: pgmap v13997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:27.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:27 smithi092 ceph-mon[29156]: pgmap v13998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:27.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:27 smithi189 ceph-mon[32756]: pgmap v13998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:27 smithi156 ceph-mon[32679]: pgmap v13998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:21:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:29 smithi092 ceph-mon[29156]: pgmap v13999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:21:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25384.767918 secs 2024-04-27T01:21:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24687.737406 secs 2024-04-27T01:21:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:29 smithi189 ceph-mon[32756]: pgmap v13999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:21:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25384.767918 secs 2024-04-27T01:21:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24687.737406 secs 2024-04-27T01:21:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:29 smithi156 ceph-mon[32679]: pgmap v13999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:21:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25384.767918 secs 2024-04-27T01:21:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24687.737406 secs 2024-04-27T01:21:31.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:31 smithi092 ceph-mon[29156]: pgmap v14000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:31.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:31 smithi189 ceph-mon[32756]: pgmap v14000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:31.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:31 smithi156 ceph-mon[32679]: pgmap v14000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:33.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:33 smithi092 ceph-mon[29156]: pgmap v14001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:33.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:33 smithi189 ceph-mon[32756]: pgmap v14001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:33.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:33 smithi156 ceph-mon[32679]: pgmap v14001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 25389.767999 secs 2024-04-27T01:21:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24692.737503 secs 2024-04-27T01:21:34.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 25389.767999 secs 2024-04-27T01:21:34.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24692.737503 secs 2024-04-27T01:21:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 25389.767999 secs 2024-04-27T01:21:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24692.737503 secs 2024-04-27T01:21:35.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:35 smithi092 ceph-mon[29156]: pgmap v14002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:35.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:35 smithi189 ceph-mon[32756]: pgmap v14002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:35.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:35 smithi156 ceph-mon[32679]: pgmap v14002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:21:37.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-mon[29156]: pgmap v14003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:37.730 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:21:37.564+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:21:37.730 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:21:37.564+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:21:37.730 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:21:37.564+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:21:37.730 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:21:37.564+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:21:37.730 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:21:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:21:37.564+0000 7f254757c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:21:37.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:37 smithi189 ceph-mon[32756]: pgmap v14003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:37.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:37 smithi156 ceph-mon[32679]: pgmap v14003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:21:39.470+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:21:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:21:39.470+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:21:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:21:39.470+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:21:39.457 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:21:39.471+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 197 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:21:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:39 smithi092 ceph-mon[29156]: pgmap v14004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25394.768116 secs 2024-04-27T01:21:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:39 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24697.737627 secs 2024-04-27T01:21:39.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:39 smithi092 ceph-mon[29156]: slow request 11524.394427 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:21:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:39 smithi189 ceph-mon[32756]: pgmap v14004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25394.768116 secs 2024-04-27T01:21:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:39 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24697.737627 secs 2024-04-27T01:21:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:39 smithi189 ceph-mon[32756]: slow request 11524.394427 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:21:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:39 smithi156 ceph-mon[32679]: pgmap v14004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:21:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25394.768116 secs 2024-04-27T01:21:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:39 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24697.737627 secs 2024-04-27T01:21:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:39 smithi156 ceph-mon[32679]: slow request 11524.394427 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:21:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:41 smithi092 ceph-mon[29156]: pgmap v14005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:41.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:41 smithi189 ceph-mon[32756]: pgmap v14005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:41.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:41 smithi156 ceph-mon[32679]: pgmap v14005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:43.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:43 smithi092 ceph-mon[29156]: pgmap v14006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:43.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:21:43.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:21:43.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:43 smithi189 ceph-mon[32756]: pgmap v14006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:43.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:21:43.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:21:43.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:43 smithi156 ceph-mon[32679]: pgmap v14006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:43.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:21:43.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:21:44.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25399.768195 secs 2024-04-27T01:21:44.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24702.737723 secs 2024-04-27T01:21:44.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25399.768195 secs 2024-04-27T01:21:44.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24702.737723 secs 2024-04-27T01:21:44.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25399.768195 secs 2024-04-27T01:21:44.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24702.737723 secs 2024-04-27T01:21:45.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:45 smithi189 ceph-mon[32756]: pgmap v14007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:45.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:45 smithi156 ceph-mon[32679]: pgmap v14007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:45.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:45 smithi092 ceph-mon[29156]: pgmap v14007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:47.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:47 smithi189 ceph-mon[32756]: pgmap v14008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:47.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:47 smithi156 ceph-mon[32679]: pgmap v14008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:47.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:47 smithi092 ceph-mon[29156]: pgmap v14008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:49 smithi189 ceph-mon[32756]: pgmap v14009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25404.768315 secs 2024-04-27T01:21:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24707.737806 secs 2024-04-27T01:21:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:49 smithi156 ceph-mon[32679]: pgmap v14009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25404.768315 secs 2024-04-27T01:21:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24707.737806 secs 2024-04-27T01:21:49.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:49 smithi092 ceph-mon[29156]: pgmap v14009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T01:21:49.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25404.768315 secs 2024-04-27T01:21:49.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24707.737806 secs 2024-04-27T01:21:51.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:51 smithi189 ceph-mon[32756]: pgmap v14010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:51.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:51 smithi156 ceph-mon[32679]: pgmap v14010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:51.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:51 smithi092 ceph-mon[29156]: pgmap v14010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T01:21:53.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:53 smithi189 ceph-mon[32756]: pgmap v14011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:53.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:53 smithi156 ceph-mon[32679]: pgmap v14011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:53.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:53 smithi092 ceph-mon[29156]: pgmap v14011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:54.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25409.768441 secs 2024-04-27T01:21:54.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24712.737932 secs 2024-04-27T01:21:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25409.768441 secs 2024-04-27T01:21:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24712.737932 secs 2024-04-27T01:21:54.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25409.768441 secs 2024-04-27T01:21:54.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24712.737932 secs 2024-04-27T01:21:55.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:55 smithi189 ceph-mon[32756]: pgmap v14012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:21:55.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:55 smithi156 ceph-mon[32679]: pgmap v14012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:21:55.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:55 smithi092 ceph-mon[29156]: pgmap v14012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:21:57.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:57 smithi189 ceph-mon[32756]: pgmap v14013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:57.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:57 smithi156 ceph-mon[32679]: pgmap v14013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:57.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:57 smithi092 ceph-mon[29156]: pgmap v14013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:59 smithi189 ceph-mon[32756]: pgmap v14014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25414.768577 secs 2024-04-27T01:21:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:21:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24717.738047 secs 2024-04-27T01:21:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:59 smithi156 ceph-mon[32679]: pgmap v14014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25414.768577 secs 2024-04-27T01:21:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:21:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24717.738047 secs 2024-04-27T01:21:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:59 smithi092 ceph-mon[29156]: pgmap v14014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:21:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25414.768577 secs 2024-04-27T01:21:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:21:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24717.738047 secs 2024-04-27T01:22:01.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:01 smithi189 ceph-mon[32756]: pgmap v14015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:01.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:01 smithi156 ceph-mon[32679]: pgmap v14015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:01.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:01 smithi092 ceph-mon[29156]: pgmap v14015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:03.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:03 smithi189 ceph-mon[32756]: pgmap v14016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:03.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:03 smithi156 ceph-mon[32679]: pgmap v14016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:03.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:03 smithi092 ceph-mon[29156]: pgmap v14016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25419.768635 secs 2024-04-27T01:22:04.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24722.738165 secs 2024-04-27T01:22:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25419.768635 secs 2024-04-27T01:22:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24722.738165 secs 2024-04-27T01:22:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25419.768635 secs 2024-04-27T01:22:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24722.738165 secs 2024-04-27T01:22:05.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:05 smithi189 ceph-mon[32756]: pgmap v14017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:05.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:05 smithi156 ceph-mon[32679]: pgmap v14017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:05.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:05 smithi092 ceph-mon[29156]: pgmap v14017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:07.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:07 smithi189 ceph-mon[32756]: pgmap v14018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:07.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:07 smithi156 ceph-mon[32679]: pgmap v14018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:07.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:07 smithi092 ceph-mon[29156]: pgmap v14018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:09.838 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:09 smithi092 ceph-mon[29156]: pgmap v14019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:09.838 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25424.768726 secs 2024-04-27T01:22:09.839 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24727.738314 secs 2024-04-27T01:22:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:09 smithi189 ceph-mon[32756]: pgmap v14019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25424.768726 secs 2024-04-27T01:22:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24727.738314 secs 2024-04-27T01:22:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:09 smithi156 ceph-mon[32679]: pgmap v14019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25424.768726 secs 2024-04-27T01:22:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24727.738314 secs 2024-04-27T01:22:11.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:11 smithi189 ceph-mon[32756]: pgmap v14020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:11.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:11 smithi156 ceph-mon[32679]: pgmap v14020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:11.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:11 smithi092 ceph-mon[29156]: pgmap v14020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:13.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:13 smithi189 ceph-mon[32756]: pgmap v14021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:13.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:13 smithi156 ceph-mon[32679]: pgmap v14021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:13.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:13 smithi092 ceph-mon[29156]: pgmap v14021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:22:14.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25429.768788 secs 2024-04-27T01:22:14.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24732.738380 secs 2024-04-27T01:22:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25429.768788 secs 2024-04-27T01:22:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24732.738380 secs 2024-04-27T01:22:14.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25429.768788 secs 2024-04-27T01:22:14.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24732.738380 secs 2024-04-27T01:22:15.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:15 smithi189 ceph-mon[32756]: pgmap v14022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:15.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:15 smithi156 ceph-mon[32679]: pgmap v14022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:15.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:15 smithi092 ceph-mon[29156]: pgmap v14022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:22:16.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:16 smithi189 ceph-mon[32756]: pgmap v14023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:16.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:16 smithi156 ceph-mon[32679]: pgmap v14023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:16.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:16 smithi092 ceph-mon[29156]: pgmap v14023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: pgmap v14024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:22:18.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:22:18.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:22:18.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: pgmap v14025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:22:18.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: pgmap v14026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:18.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: pgmap v14024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: pgmap v14025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: pgmap v14026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: pgmap v14024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: pgmap v14025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: pgmap v14026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:19.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:22:19.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25434.768841 secs 2024-04-27T01:22:19.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24737.738458 secs 2024-04-27T01:22:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25434.768841 secs 2024-04-27T01:22:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24737.738458 secs 2024-04-27T01:22:20.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25434.768841 secs 2024-04-27T01:22:20.124 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24737.738458 secs 2024-04-27T01:22:20.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:20 smithi156 ceph-mon[32679]: pgmap v14027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:20.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:20 smithi092 ceph-mon[29156]: pgmap v14027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:21.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:20 smithi189 ceph-mon[32756]: pgmap v14027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:23.670 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:23 smithi156 ceph-mon[32679]: pgmap v14028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:23.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:23 smithi092 ceph-mon[29156]: pgmap v14028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:23 smithi189 ceph-mon[32756]: pgmap v14028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:22:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25439.768932 secs 2024-04-27T01:22:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24742.738570 secs 2024-04-27T01:22:24.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25439.768932 secs 2024-04-27T01:22:24.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24742.738570 secs 2024-04-27T01:22:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25439.768932 secs 2024-04-27T01:22:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24742.738570 secs 2024-04-27T01:22:25.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:25 smithi092 ceph-mon[29156]: pgmap v14029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:25.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:25 smithi189 ceph-mon[32756]: pgmap v14029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:25.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:25 smithi156 ceph-mon[32679]: pgmap v14029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:27.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:27 smithi092 ceph-mon[29156]: pgmap v14030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:27.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:27 smithi189 ceph-mon[32756]: pgmap v14030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:27 smithi156 ceph-mon[32679]: pgmap v14030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:22:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:29 smithi092 ceph-mon[29156]: pgmap v14031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:22:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25444.768978 secs 2024-04-27T01:22:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24747.738695 secs 2024-04-27T01:22:29.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:29 smithi189 ceph-mon[32756]: pgmap v14031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:22:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25444.768978 secs 2024-04-27T01:22:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24747.738695 secs 2024-04-27T01:22:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:29 smithi156 ceph-mon[32679]: pgmap v14031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:22:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25444.768978 secs 2024-04-27T01:22:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24747.738695 secs 2024-04-27T01:22:31.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:31 smithi092 ceph-mon[29156]: pgmap v14032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:31.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:31 smithi189 ceph-mon[32756]: pgmap v14032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:31.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:31 smithi156 ceph-mon[32679]: pgmap v14032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:33.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:33 smithi092 ceph-mon[29156]: pgmap v14033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:33.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:33 smithi189 ceph-mon[32756]: pgmap v14033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:33.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:33 smithi156 ceph-mon[32679]: pgmap v14033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25449.769029 secs 2024-04-27T01:22:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24752.738817 secs 2024-04-27T01:22:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25449.769029 secs 2024-04-27T01:22:34.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24752.738817 secs 2024-04-27T01:22:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25449.769029 secs 2024-04-27T01:22:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24752.738817 secs 2024-04-27T01:22:35.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:35 smithi092 ceph-mon[29156]: pgmap v14034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:35.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:35 smithi189 ceph-mon[32756]: pgmap v14034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:35.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:35 smithi156 ceph-mon[32679]: pgmap v14034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:37.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:37 smithi092 ceph-mon[29156]: pgmap v14035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:37.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:37 smithi189 ceph-mon[32756]: pgmap v14035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:37.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:37 smithi156 ceph-mon[32679]: pgmap v14035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:39 smithi092 ceph-mon[29156]: pgmap v14036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:39 smithi092 ceph-mon[29156]: 9 slow requests, 1 included below; oldest blocked for > 25454.769140 secs 2024-04-27T01:22:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:39 smithi092 ceph-mon[29156]: slow request 361.233296 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:39 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24757.738937 secs 2024-04-27T01:22:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:39 smithi092 ceph-mon[29156]: slow request 2882.131099 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:39 smithi189 ceph-mon[32756]: pgmap v14036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:39 smithi189 ceph-mon[32756]: 9 slow requests, 1 included below; oldest blocked for > 25454.769140 secs 2024-04-27T01:22:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:39 smithi189 ceph-mon[32756]: slow request 361.233296 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:39 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24757.738937 secs 2024-04-27T01:22:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:39 smithi189 ceph-mon[32756]: slow request 2882.131099 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:39 smithi156 ceph-mon[32679]: pgmap v14036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:39 smithi156 ceph-mon[32679]: 9 slow requests, 1 included below; oldest blocked for > 25454.769140 secs 2024-04-27T01:22:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:39 smithi156 ceph-mon[32679]: slow request 361.233296 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:39 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24757.738937 secs 2024-04-27T01:22:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:39 smithi156 ceph-mon[32679]: slow request 2882.131099 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:22:41.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:41 smithi092 ceph-mon[29156]: pgmap v14037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:41.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:41 smithi189 ceph-mon[32756]: pgmap v14037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:41.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:41 smithi156 ceph-mon[32679]: pgmap v14037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:43.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:43 smithi092 ceph-mon[29156]: pgmap v14038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:43.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:43 smithi189 ceph-mon[32756]: pgmap v14038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:43.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:43 smithi156 ceph-mon[32679]: pgmap v14038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:44.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25459.769260 secs 2024-04-27T01:22:44.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24762.739075 secs 2024-04-27T01:22:44.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25459.769260 secs 2024-04-27T01:22:44.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24762.739075 secs 2024-04-27T01:22:44.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25459.769260 secs 2024-04-27T01:22:44.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24762.739075 secs 2024-04-27T01:22:45.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:45 smithi092 ceph-mon[29156]: pgmap v14039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:45.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:45 smithi189 ceph-mon[32756]: pgmap v14039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:45.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:45 smithi156 ceph-mon[32679]: pgmap v14039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:47.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:47 smithi092 ceph-mon[29156]: pgmap v14040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:47.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:47 smithi189 ceph-mon[32756]: pgmap v14040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:47.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:47 smithi156 ceph-mon[32679]: pgmap v14040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:49 smithi092 ceph-mon[29156]: pgmap v14041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25464.769366 secs 2024-04-27T01:22:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24767.739191 secs 2024-04-27T01:22:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:49 smithi189 ceph-mon[32756]: pgmap v14041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25464.769366 secs 2024-04-27T01:22:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24767.739191 secs 2024-04-27T01:22:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:49 smithi156 ceph-mon[32679]: pgmap v14041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25464.769366 secs 2024-04-27T01:22:49.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24767.739191 secs 2024-04-27T01:22:51.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:51 smithi092 ceph-mon[29156]: pgmap v14042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:51.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:51 smithi189 ceph-mon[32756]: pgmap v14042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:51.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:51 smithi156 ceph-mon[32679]: pgmap v14042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:53.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:53 smithi092 ceph-mon[29156]: pgmap v14043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:53.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:53 smithi189 ceph-mon[32756]: pgmap v14043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:53.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:53 smithi156 ceph-mon[32679]: pgmap v14043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25469.769431 secs 2024-04-27T01:22:54.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24772.739266 secs 2024-04-27T01:22:54.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25469.769431 secs 2024-04-27T01:22:54.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24772.739266 secs 2024-04-27T01:22:54.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25469.769431 secs 2024-04-27T01:22:54.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24772.739266 secs 2024-04-27T01:22:55.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:55 smithi189 ceph-mon[32756]: pgmap v14044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:55.918 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:55 smithi092 ceph-mon[29156]: pgmap v14044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:55.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:55 smithi156 ceph-mon[32679]: pgmap v14044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:22:57.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:57 smithi189 ceph-mon[32756]: pgmap v14045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:57.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:57 smithi156 ceph-mon[32679]: pgmap v14045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:57.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:57 smithi092 ceph-mon[29156]: pgmap v14045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:59 smithi189 ceph-mon[32756]: pgmap v14046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25474.769558 secs 2024-04-27T01:22:59.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:22:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24777.739367 secs 2024-04-27T01:22:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:59 smithi156 ceph-mon[32679]: pgmap v14046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25474.769558 secs 2024-04-27T01:22:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:22:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24777.739367 secs 2024-04-27T01:22:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:59 smithi092 ceph-mon[29156]: pgmap v14046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:22:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25474.769558 secs 2024-04-27T01:22:59.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:22:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24777.739367 secs 2024-04-27T01:23:01.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:01 smithi189 ceph-mon[32756]: pgmap v14047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:01.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:01 smithi156 ceph-mon[32679]: pgmap v14047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:01.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:01 smithi092 ceph-mon[29156]: pgmap v14047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:03.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:03 smithi189 ceph-mon[32756]: pgmap v14048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:03.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:03 smithi156 ceph-mon[32679]: pgmap v14048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:03.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:03 smithi092 ceph-mon[29156]: pgmap v14048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25479.769696 secs 2024-04-27T01:23:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24782.739486 secs 2024-04-27T01:23:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25479.769696 secs 2024-04-27T01:23:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24782.739486 secs 2024-04-27T01:23:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25479.769696 secs 2024-04-27T01:23:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24782.739486 secs 2024-04-27T01:23:05.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:05 smithi189 ceph-mon[32756]: pgmap v14049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:05.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:05 smithi156 ceph-mon[32679]: pgmap v14049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:05.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:05 smithi092 ceph-mon[29156]: pgmap v14049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:07.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:07 smithi189 ceph-mon[32756]: pgmap v14050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:07.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:07 smithi156 ceph-mon[32679]: pgmap v14050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:07.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:07 smithi092 ceph-mon[29156]: pgmap v14050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:09 smithi189 ceph-mon[32756]: pgmap v14051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25484.769847 secs 2024-04-27T01:23:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:09 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 24787.739626 secs 2024-04-27T01:23:09.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:09 smithi189 ceph-mon[32756]: slow request 5762.880140 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:23:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:09 smithi156 ceph-mon[32679]: pgmap v14051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25484.769847 secs 2024-04-27T01:23:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:09 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 24787.739626 secs 2024-04-27T01:23:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:09 smithi156 ceph-mon[32679]: slow request 5762.880140 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:23:09.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:09 smithi092 ceph-mon[29156]: pgmap v14051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:09.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25484.769847 secs 2024-04-27T01:23:09.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:09 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 24787.739626 secs 2024-04-27T01:23:09.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:09 smithi092 ceph-mon[29156]: slow request 5762.880140 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:23:11.790 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:11 smithi092 ceph-mon[29156]: pgmap v14052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:11.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:11 smithi189 ceph-mon[32756]: pgmap v14052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:11.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:11 smithi156 ceph-mon[32679]: pgmap v14052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:13.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:13 smithi189 ceph-mon[32756]: pgmap v14053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:13.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:13 smithi156 ceph-mon[32679]: pgmap v14053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:13.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:13 smithi092 ceph-mon[29156]: pgmap v14053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:14.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25489.769964 secs 2024-04-27T01:23:14.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24792.739760 secs 2024-04-27T01:23:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25489.769964 secs 2024-04-27T01:23:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24792.739760 secs 2024-04-27T01:23:14.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25489.769964 secs 2024-04-27T01:23:14.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24792.739760 secs 2024-04-27T01:23:15.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:15 smithi189 ceph-mon[32756]: pgmap v14054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:15.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:15 smithi156 ceph-mon[32679]: pgmap v14054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:15.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:15 smithi092 ceph-mon[29156]: pgmap v14054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:17.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:17 smithi189 ceph-mon[32756]: pgmap v14055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:17.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:17 smithi156 ceph-mon[32679]: pgmap v14055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:17 smithi092 ceph-mon[29156]: pgmap v14055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:18.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:23:18.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:23:18.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: pgmap v14056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25494.770051 secs 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24797.739847 secs 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:23:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:23:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: pgmap v14056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25494.770051 secs 2024-04-27T01:23:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24797.739847 secs 2024-04-27T01:23:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:23:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:23:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: pgmap v14056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25494.770051 secs 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24797.739847 secs 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:23:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:23:20.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:20 smithi189 ceph-mon[32756]: pgmap v14057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:23:20.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:20 smithi189 ceph-mon[32756]: pgmap v14058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:20.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:20 smithi156 ceph-mon[32679]: pgmap v14057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:23:20.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:20 smithi156 ceph-mon[32679]: pgmap v14058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:20.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:20 smithi092 ceph-mon[29156]: pgmap v14057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:23:20.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:20 smithi092 ceph-mon[29156]: pgmap v14058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:22 smithi189 ceph-mon[32756]: pgmap v14059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:22.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:22 smithi156 ceph-mon[32679]: pgmap v14059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:22.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:22 smithi092 ceph-mon[29156]: pgmap v14059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:24 smithi189 ceph-mon[32756]: pgmap v14060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T01:23:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25499.770162 secs 2024-04-27T01:23:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24802.739937 secs 2024-04-27T01:23:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:24 smithi156 ceph-mon[32679]: pgmap v14060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T01:23:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25499.770162 secs 2024-04-27T01:23:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24802.739937 secs 2024-04-27T01:23:24.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:24 smithi092 ceph-mon[29156]: pgmap v14060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T01:23:24.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25499.770162 secs 2024-04-27T01:23:24.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24802.739937 secs 2024-04-27T01:23:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:26 smithi189 ceph-mon[32756]: pgmap v14061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:26.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:26 smithi156 ceph-mon[32679]: pgmap v14061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:26.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:26 smithi092 ceph-mon[29156]: pgmap v14061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:27 smithi189 ceph-mon[32756]: pgmap v14062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:27 smithi156 ceph-mon[32679]: pgmap v14062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:27.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:27 smithi092 ceph-mon[29156]: pgmap v14062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:23:29.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24807.740043 secs 2024-04-27T01:23:29.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24807.740043 secs 2024-04-27T01:23:29.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24807.740043 secs 2024-04-27T01:23:30.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:30 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25504.770279 secs 2024-04-27T01:23:30.374 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:30 smithi189 ceph-mon[32756]: pgmap v14063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:23:30.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:30 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25504.770279 secs 2024-04-27T01:23:30.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:30 smithi156 ceph-mon[32679]: pgmap v14063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:23:30.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:30 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25504.770279 secs 2024-04-27T01:23:30.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:30 smithi092 ceph-mon[29156]: pgmap v14063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:23:32.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:32 smithi092 ceph-mon[29156]: pgmap v14064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:32.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:32 smithi189 ceph-mon[32756]: pgmap v14064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:32.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:32 smithi156 ceph-mon[32679]: pgmap v14064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:34.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:34 smithi092 ceph-mon[29156]: pgmap v14065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:34.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25509.770385 secs 2024-04-27T01:23:34.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24812.740176 secs 2024-04-27T01:23:34.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:34 smithi189 ceph-mon[32756]: pgmap v14065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:34.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25509.770385 secs 2024-04-27T01:23:34.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24812.740176 secs 2024-04-27T01:23:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:34 smithi156 ceph-mon[32679]: pgmap v14065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25509.770385 secs 2024-04-27T01:23:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24812.740176 secs 2024-04-27T01:23:36.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:36 smithi092 ceph-mon[29156]: pgmap v14066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:36.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:36 smithi189 ceph-mon[32756]: pgmap v14066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:36.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:36 smithi156 ceph-mon[32679]: pgmap v14066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:38.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:38 smithi092 ceph-mon[29156]: pgmap v14067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:38.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:38 smithi189 ceph-mon[32756]: pgmap v14067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:38.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:38 smithi156 ceph-mon[32679]: pgmap v14067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:39 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25514.770448 secs 2024-04-27T01:23:39.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24817.740311 secs 2024-04-27T01:23:39.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:39 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25514.770448 secs 2024-04-27T01:23:39.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24817.740311 secs 2024-04-27T01:23:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:39 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25514.770448 secs 2024-04-27T01:23:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24817.740311 secs 2024-04-27T01:23:40.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:40 smithi092 ceph-mon[29156]: pgmap v14068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:40.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:40 smithi189 ceph-mon[32756]: pgmap v14068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:40.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:40 smithi156 ceph-mon[32679]: pgmap v14068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:42.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:42 smithi092 ceph-mon[29156]: pgmap v14069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:42.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:42 smithi189 ceph-mon[32756]: pgmap v14069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:42.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:42 smithi156 ceph-mon[32679]: pgmap v14069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:44.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:44 smithi092 ceph-mon[29156]: pgmap v14070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:44.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:44 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25519.770538 secs 2024-04-27T01:23:44.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24822.740417 secs 2024-04-27T01:23:44.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:44 smithi189 ceph-mon[32756]: pgmap v14070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:44.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:44 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25519.770538 secs 2024-04-27T01:23:44.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24822.740417 secs 2024-04-27T01:23:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:44 smithi156 ceph-mon[32679]: pgmap v14070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:44 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25519.770538 secs 2024-04-27T01:23:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24822.740417 secs 2024-04-27T01:23:46.479 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:46 smithi092 ceph-mon[29156]: pgmap v14071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:46.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:46 smithi189 ceph-mon[32756]: pgmap v14071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:46.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:46 smithi156 ceph-mon[32679]: pgmap v14071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:48.482 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:48 smithi092 ceph-mon[29156]: pgmap v14072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:48.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:48 smithi189 ceph-mon[32756]: pgmap v14072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:48.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:48 smithi156 ceph-mon[32679]: pgmap v14072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:49.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:49 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25524.770673 secs 2024-04-27T01:23:49.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24827.740530 secs 2024-04-27T01:23:49.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:49 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25524.770673 secs 2024-04-27T01:23:49.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24827.740530 secs 2024-04-27T01:23:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:49 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25524.770673 secs 2024-04-27T01:23:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24827.740530 secs 2024-04-27T01:23:50.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:50 smithi189 ceph-mon[32756]: pgmap v14073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:50.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:50 smithi156 ceph-mon[32679]: pgmap v14073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:50.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:50 smithi092 ceph-mon[29156]: pgmap v14073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:52.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:52 smithi189 ceph-mon[32756]: pgmap v14074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:52.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:52 smithi156 ceph-mon[32679]: pgmap v14074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:52.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:52 smithi092 ceph-mon[29156]: pgmap v14074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:54.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:54 smithi189 ceph-mon[32756]: pgmap v14075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:54.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:54 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25529.770791 secs 2024-04-27T01:23:54.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24832.740652 secs 2024-04-27T01:23:54.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:54 smithi156 ceph-mon[32679]: pgmap v14075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:54.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:54 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25529.770791 secs 2024-04-27T01:23:54.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24832.740652 secs 2024-04-27T01:23:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:54 smithi092 ceph-mon[29156]: pgmap v14075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:54 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25529.770791 secs 2024-04-27T01:23:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24832.740652 secs 2024-04-27T01:23:56.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:56 smithi189 ceph-mon[32756]: pgmap v14076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:56.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:56 smithi156 ceph-mon[32679]: pgmap v14076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:56.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:56 smithi092 ceph-mon[29156]: pgmap v14076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:23:58.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:58 smithi189 ceph-mon[32756]: pgmap v14077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:58.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:58 smithi156 ceph-mon[32679]: pgmap v14077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:58.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:58 smithi092 ceph-mon[29156]: pgmap v14077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:23:59.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:59 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25534.770908 secs 2024-04-27T01:23:59.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:23:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24837.740775 secs 2024-04-27T01:23:59.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:59 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25534.770908 secs 2024-04-27T01:23:59.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:23:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24837.740775 secs 2024-04-27T01:23:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:59 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25534.770908 secs 2024-04-27T01:23:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:23:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24837.740775 secs 2024-04-27T01:24:00.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:00 smithi189 ceph-mon[32756]: pgmap v14078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:00.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:00 smithi156 ceph-mon[32679]: pgmap v14078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:00.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:00 smithi092 ceph-mon[29156]: pgmap v14078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:02.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:02 smithi189 ceph-mon[32756]: pgmap v14079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:02.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:02 smithi156 ceph-mon[32679]: pgmap v14079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:02.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:02 smithi092 ceph-mon[29156]: pgmap v14079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:04.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:04 smithi092 ceph-mon[29156]: pgmap v14080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:04.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:04 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25539.771017 secs 2024-04-27T01:24:04.531 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24842.740884 secs 2024-04-27T01:24:04.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:04 smithi189 ceph-mon[32756]: pgmap v14080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:04.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:04 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25539.771017 secs 2024-04-27T01:24:04.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24842.740884 secs 2024-04-27T01:24:04.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:04 smithi156 ceph-mon[32679]: pgmap v14080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:04.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:04 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25539.771017 secs 2024-04-27T01:24:04.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24842.740884 secs 2024-04-27T01:24:06.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:06 smithi189 ceph-mon[32756]: pgmap v14081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:06.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:06 smithi156 ceph-mon[32679]: pgmap v14081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:06.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:06 smithi092 ceph-mon[29156]: pgmap v14081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:08.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:08 smithi189 ceph-mon[32756]: pgmap v14082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:08.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:08 smithi156 ceph-mon[32679]: pgmap v14082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:08.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:08 smithi092 ceph-mon[29156]: pgmap v14082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:09.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:09 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25544.771092 secs 2024-04-27T01:24:09.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24847.741004 secs 2024-04-27T01:24:09.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:09 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25544.771092 secs 2024-04-27T01:24:09.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24847.741004 secs 2024-04-27T01:24:09.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:09 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25544.771092 secs 2024-04-27T01:24:09.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24847.741004 secs 2024-04-27T01:24:10.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:10 smithi189 ceph-mon[32756]: pgmap v14083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:10.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:10 smithi156 ceph-mon[32679]: pgmap v14083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:10.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:10 smithi092 ceph-mon[29156]: pgmap v14083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:12.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:12 smithi189 ceph-mon[32756]: pgmap v14084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:12.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:12 smithi156 ceph-mon[32679]: pgmap v14084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:12.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:12 smithi092 ceph-mon[29156]: pgmap v14084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:14.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:14 smithi189 ceph-mon[32756]: pgmap v14085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:14.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:14 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25549.771567 secs 2024-04-27T01:24:14.624 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24852.741101 secs 2024-04-27T01:24:14.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:14 smithi156 ceph-mon[32679]: pgmap v14085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:14.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:14 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25549.771567 secs 2024-04-27T01:24:14.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24852.741101 secs 2024-04-27T01:24:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:14 smithi092 ceph-mon[29156]: pgmap v14085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:14.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:14 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25549.771567 secs 2024-04-27T01:24:14.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24852.741101 secs 2024-04-27T01:24:16.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:16 smithi189 ceph-mon[32756]: pgmap v14086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:16.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:16 smithi156 ceph-mon[32679]: pgmap v14086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:16.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:16 smithi092 ceph-mon[29156]: pgmap v14086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:18.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:18 smithi189 ceph-mon[32756]: pgmap v14087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:18.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:18 smithi156 ceph-mon[32679]: pgmap v14087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:18.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:18 smithi092 ceph-mon[29156]: pgmap v14087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:19.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:19 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25554.771678 secs 2024-04-27T01:24:19.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24857.741222 secs 2024-04-27T01:24:19.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:24:19.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:19 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25554.771678 secs 2024-04-27T01:24:19.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24857.741222 secs 2024-04-27T01:24:19.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:24:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:19 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25554.771678 secs 2024-04-27T01:24:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24857.741222 secs 2024-04-27T01:24:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:24:20.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:20 smithi189 ceph-mon[32756]: pgmap v14088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:20.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:24:20.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:24:20.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:24:20.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:20 smithi156 ceph-mon[32679]: pgmap v14088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:20.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:24:20.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:24:20.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:24:20.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:20 smithi092 ceph-mon[29156]: pgmap v14088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:20.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:24:20.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:24:20.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:24:21.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:21 smithi189 ceph-mon[32756]: pgmap v14089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:24:21.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:21 smithi189 ceph-mon[32756]: pgmap v14090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:21.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:21 smithi156 ceph-mon[32679]: pgmap v14089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:24:21.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:21 smithi156 ceph-mon[32679]: pgmap v14090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:21.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:21 smithi092 ceph-mon[29156]: pgmap v14089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:24:21.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:21 smithi092 ceph-mon[29156]: pgmap v14090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:23.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:23 smithi189 ceph-mon[32756]: pgmap v14091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:23.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:23 smithi156 ceph-mon[32679]: pgmap v14091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:23.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:23 smithi092 ceph-mon[29156]: pgmap v14091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:24.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:24 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25559.771788 secs 2024-04-27T01:24:24.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24862.741359 secs 2024-04-27T01:24:24.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:24 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25559.771788 secs 2024-04-27T01:24:24.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24862.741359 secs 2024-04-27T01:24:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:24 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25559.771788 secs 2024-04-27T01:24:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24862.741359 secs 2024-04-27T01:24:25.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:25 smithi189 ceph-mon[32756]: pgmap v14092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:25.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:25 smithi156 ceph-mon[32679]: pgmap v14092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:25.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:25 smithi092 ceph-mon[29156]: pgmap v14092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:27.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:27 smithi189 ceph-mon[32756]: pgmap v14093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:27.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:27 smithi156 ceph-mon[32679]: pgmap v14093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:27.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:27 smithi092 ceph-mon[29156]: pgmap v14093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:24:29.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:29 smithi189 ceph-mon[32756]: pgmap v14094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:24:29.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:29 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25564.771873 secs 2024-04-27T01:24:29.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24867.741498 secs 2024-04-27T01:24:29.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:29 smithi156 ceph-mon[32679]: pgmap v14094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:24:29.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:29 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25564.771873 secs 2024-04-27T01:24:29.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24867.741498 secs 2024-04-27T01:24:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:29 smithi092 ceph-mon[29156]: pgmap v14094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:24:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:29 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25564.771873 secs 2024-04-27T01:24:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24867.741498 secs 2024-04-27T01:24:31.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:31 smithi156 ceph-mon[32679]: pgmap v14095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:24:31.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:31 smithi092 ceph-mon[29156]: pgmap v14095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:24:31.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:31 smithi189 ceph-mon[32756]: pgmap v14095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:24:33.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:33 smithi156 ceph-mon[32679]: pgmap v14096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:33.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:33 smithi092 ceph-mon[29156]: pgmap v14096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:33.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:33 smithi189 ceph-mon[32756]: pgmap v14096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:34 smithi156 ceph-mon[32679]: 9 slow requests, 0 included below; oldest blocked for > 25569.771941 secs 2024-04-27T01:24:34.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24872.741623 secs 2024-04-27T01:24:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:34 smithi092 ceph-mon[29156]: 9 slow requests, 0 included below; oldest blocked for > 25569.771941 secs 2024-04-27T01:24:34.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24872.741623 secs 2024-04-27T01:24:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:34 smithi189 ceph-mon[32756]: 9 slow requests, 0 included below; oldest blocked for > 25569.771941 secs 2024-04-27T01:24:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24872.741623 secs 2024-04-27T01:24:35.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:35 smithi156 ceph-mon[32679]: pgmap v14097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:35.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:35 smithi092 ceph-mon[29156]: pgmap v14097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:35.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:35 smithi189 ceph-mon[32756]: pgmap v14097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:37.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:37 smithi156 ceph-mon[32679]: pgmap v14098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:37.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:37 smithi092 ceph-mon[29156]: pgmap v14098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:37.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:37 smithi189 ceph-mon[32756]: pgmap v14098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:39.480 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:24:39.494+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:24:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:24:39.494+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:24:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:24:39.495+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:24:39.481 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:24:39.495+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 198 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:24:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:39 smithi156 ceph-mon[32679]: pgmap v14099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:39 smithi156 ceph-mon[32679]: 11 slow requests, 2 included below; oldest blocked for > 25574.772014 secs 2024-04-27T01:24:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:39 smithi156 ceph-mon[32679]: slow request 1441.468159 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:24:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:39 smithi156 ceph-mon[32679]: slow request 181.114784 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:24:39.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24877.741717 secs 2024-04-27T01:24:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:39 smithi092 ceph-mon[29156]: pgmap v14099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:39 smithi092 ceph-mon[29156]: 11 slow requests, 2 included below; oldest blocked for > 25574.772014 secs 2024-04-27T01:24:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:39 smithi092 ceph-mon[29156]: slow request 1441.468159 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:24:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:39 smithi092 ceph-mon[29156]: slow request 181.114784 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:24:39.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24877.741717 secs 2024-04-27T01:24:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:39 smithi189 ceph-mon[32756]: pgmap v14099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:39 smithi189 ceph-mon[32756]: 11 slow requests, 2 included below; oldest blocked for > 25574.772014 secs 2024-04-27T01:24:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:39 smithi189 ceph-mon[32756]: slow request 1441.468159 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:24:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:39 smithi189 ceph-mon[32756]: slow request 181.114784 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:24:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24877.741717 secs 2024-04-27T01:24:41.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:41 smithi156 ceph-mon[32679]: pgmap v14100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:41.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:41 smithi092 ceph-mon[29156]: pgmap v14100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:41.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:41 smithi189 ceph-mon[32756]: pgmap v14100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:43.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:43 smithi156 ceph-mon[32679]: pgmap v14101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:43.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:43 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:24:43.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:43 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:24:43.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:43 smithi092 ceph-mon[29156]: pgmap v14101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:43.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:43 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:24:43.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:43 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:24:43.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:43 smithi189 ceph-mon[32756]: pgmap v14101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:43.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:43 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:24:43.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:43 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:24:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25579.772093 secs 2024-04-27T01:24:44.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24882.741781 secs 2024-04-27T01:24:44.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25579.772093 secs 2024-04-27T01:24:44.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24882.741781 secs 2024-04-27T01:24:44.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25579.772093 secs 2024-04-27T01:24:44.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24882.741781 secs 2024-04-27T01:24:45.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:45 smithi156 ceph-mon[32679]: pgmap v14102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:45.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:45 smithi092 ceph-mon[29156]: pgmap v14102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:45.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:45 smithi189 ceph-mon[32756]: pgmap v14102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:47.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:47 smithi156 ceph-mon[32679]: pgmap v14103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:47.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:47 smithi092 ceph-mon[29156]: pgmap v14103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:47.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:47 smithi189 ceph-mon[32756]: pgmap v14103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:49.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:49 smithi156 ceph-mon[32679]: pgmap v14104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:49.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25584.772175 secs 2024-04-27T01:24:49.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24887.741866 secs 2024-04-27T01:24:49.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:49 smithi092 ceph-mon[29156]: pgmap v14104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25584.772175 secs 2024-04-27T01:24:49.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24887.741866 secs 2024-04-27T01:24:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:49 smithi189 ceph-mon[32756]: pgmap v14104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25584.772175 secs 2024-04-27T01:24:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24887.741866 secs 2024-04-27T01:24:51.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:51 smithi156 ceph-mon[32679]: pgmap v14105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:51.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:51 smithi092 ceph-mon[29156]: pgmap v14105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:51.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:51 smithi189 ceph-mon[32756]: pgmap v14105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:53.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:53 smithi092 ceph-mon[29156]: pgmap v14106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:53.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:53 smithi189 ceph-mon[32756]: pgmap v14106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:53.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:53 smithi156 ceph-mon[32679]: pgmap v14106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:54.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25589.772526 secs 2024-04-27T01:24:54.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24892.741990 secs 2024-04-27T01:24:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25589.772526 secs 2024-04-27T01:24:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24892.741990 secs 2024-04-27T01:24:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25589.772526 secs 2024-04-27T01:24:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24892.741990 secs 2024-04-27T01:24:55.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:55 smithi092 ceph-mon[29156]: pgmap v14107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:55.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:55 smithi189 ceph-mon[32756]: pgmap v14107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:55.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:55 smithi156 ceph-mon[32679]: pgmap v14107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:24:57.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:57 smithi092 ceph-mon[29156]: pgmap v14108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:57.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:57 smithi189 ceph-mon[32756]: pgmap v14108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:57.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:57 smithi156 ceph-mon[32679]: pgmap v14108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:59 smithi092 ceph-mon[29156]: pgmap v14109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25594.772639 secs 2024-04-27T01:24:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:24:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24897.742110 secs 2024-04-27T01:24:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:59 smithi189 ceph-mon[32756]: pgmap v14109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25594.772639 secs 2024-04-27T01:24:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:24:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24897.742110 secs 2024-04-27T01:24:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:59 smithi156 ceph-mon[32679]: pgmap v14109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:24:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25594.772639 secs 2024-04-27T01:24:59.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:24:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24897.742110 secs 2024-04-27T01:25:01.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:01 smithi092 ceph-mon[29156]: pgmap v14110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:01.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:01 smithi189 ceph-mon[32756]: pgmap v14110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:01.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:01 smithi156 ceph-mon[32679]: pgmap v14110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:03.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:03 smithi092 ceph-mon[29156]: pgmap v14111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:03.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:03 smithi189 ceph-mon[32756]: pgmap v14111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:03.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:03 smithi156 ceph-mon[32679]: pgmap v14111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:04.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:04 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 25599.772677 secs 2024-04-27T01:25:04.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:04 smithi092 ceph-mon[29156]: slow request 23042.028796 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:25:04.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24902.742227 secs 2024-04-27T01:25:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:04 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 25599.772677 secs 2024-04-27T01:25:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:04 smithi189 ceph-mon[32756]: slow request 23042.028796 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:25:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24902.742227 secs 2024-04-27T01:25:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:04 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 25599.772677 secs 2024-04-27T01:25:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:04 smithi156 ceph-mon[32679]: slow request 23042.028796 seconds old, received at 2024-04-26T19:01:01.659622+0000: client_request(client.16890:1 getattr pAsLsXsFs #0x1 2024-04-26T19:01:01.656226+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:25:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24902.742227 secs 2024-04-27T01:25:05.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:05 smithi092 ceph-mon[29156]: pgmap v14112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:05.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:05 smithi189 ceph-mon[32756]: pgmap v14112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:05.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:05 smithi156 ceph-mon[32679]: pgmap v14112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:07.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:07 smithi092 ceph-mon[29156]: pgmap v14113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:07.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:07 smithi189 ceph-mon[32756]: pgmap v14113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:07.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:07 smithi156 ceph-mon[32679]: pgmap v14113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:09.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:09 smithi092 ceph-mon[29156]: pgmap v14114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:09.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25604.772756 secs 2024-04-27T01:25:09.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24907.742347 secs 2024-04-27T01:25:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:09 smithi189 ceph-mon[32756]: pgmap v14114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25604.772756 secs 2024-04-27T01:25:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24907.742347 secs 2024-04-27T01:25:09.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:09 smithi156 ceph-mon[32679]: pgmap v14114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25604.772756 secs 2024-04-27T01:25:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24907.742347 secs 2024-04-27T01:25:11.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:11 smithi092 ceph-mon[29156]: pgmap v14115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:11.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:11 smithi189 ceph-mon[32756]: pgmap v14115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:11.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:11 smithi156 ceph-mon[32679]: pgmap v14115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:13.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:13 smithi092 ceph-mon[29156]: pgmap v14116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:13.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:13 smithi189 ceph-mon[32756]: pgmap v14116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:13.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:13 smithi156 ceph-mon[32679]: pgmap v14116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25609.772849 secs 2024-04-27T01:25:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24912.742490 secs 2024-04-27T01:25:14.774 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25609.772849 secs 2024-04-27T01:25:14.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24912.742490 secs 2024-04-27T01:25:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25609.772849 secs 2024-04-27T01:25:14.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24912.742490 secs 2024-04-27T01:25:15.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:15 smithi092 ceph-mon[29156]: pgmap v14117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:15.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:15 smithi189 ceph-mon[32756]: pgmap v14117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:15.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:15 smithi156 ceph-mon[32679]: pgmap v14117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:17.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:17 smithi092 ceph-mon[29156]: pgmap v14118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:17.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:17 smithi189 ceph-mon[32756]: pgmap v14118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:17.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:17 smithi156 ceph-mon[32679]: pgmap v14118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:19.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:19 smithi156 ceph-mon[32679]: pgmap v14119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:19.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25614.772961 secs 2024-04-27T01:25:19.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24917.742605 secs 2024-04-27T01:25:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:19 smithi092 ceph-mon[29156]: pgmap v14119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25614.772961 secs 2024-04-27T01:25:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24917.742605 secs 2024-04-27T01:25:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:19 smithi189 ceph-mon[32756]: pgmap v14119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25614.772961 secs 2024-04-27T01:25:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24917.742605 secs 2024-04-27T01:25:20.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:25:20.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:25:20.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:25:21.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:21 smithi189 ceph-mon[32756]: pgmap v14120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:21.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:25:21.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:25:21.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:25:21.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:21 smithi156 ceph-mon[32679]: pgmap v14120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:21.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:25:21.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:25:21.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:25:21.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:21 smithi092 ceph-mon[29156]: pgmap v14120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:21.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:25:21.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:25:21.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:25:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:22 smithi189 ceph-mon[32756]: pgmap v14121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:25:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:22 smithi189 ceph-mon[32756]: pgmap v14122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:22 smithi156 ceph-mon[32679]: pgmap v14121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:25:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:22 smithi156 ceph-mon[32679]: pgmap v14122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:22 smithi092 ceph-mon[29156]: pgmap v14121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:25:22.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:22 smithi092 ceph-mon[29156]: pgmap v14122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:24 smithi189 ceph-mon[32756]: pgmap v14123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:25:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25619.773069 secs 2024-04-27T01:25:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24922.742761 secs 2024-04-27T01:25:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:24 smithi156 ceph-mon[32679]: pgmap v14123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:25:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25619.773069 secs 2024-04-27T01:25:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24922.742761 secs 2024-04-27T01:25:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:24 smithi092 ceph-mon[29156]: pgmap v14123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:25:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25619.773069 secs 2024-04-27T01:25:24.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24922.742761 secs 2024-04-27T01:25:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:26 smithi189 ceph-mon[32756]: pgmap v14124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:26 smithi156 ceph-mon[32679]: pgmap v14124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:26 smithi092 ceph-mon[29156]: pgmap v14124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:28 smithi189 ceph-mon[32756]: pgmap v14125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:28 smithi156 ceph-mon[32679]: pgmap v14125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:28 smithi092 ceph-mon[29156]: pgmap v14125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:29.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25624.773186 secs 2024-04-27T01:25:29.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24927.742842 secs 2024-04-27T01:25:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25624.773186 secs 2024-04-27T01:25:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24927.742842 secs 2024-04-27T01:25:29.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25624.773186 secs 2024-04-27T01:25:29.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24927.742842 secs 2024-04-27T01:25:30.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:30 smithi189 ceph-mon[32756]: pgmap v14126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:30.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:30 smithi156 ceph-mon[32679]: pgmap v14126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:30.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:30 smithi092 ceph-mon[29156]: pgmap v14126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:25:32.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:32 smithi189 ceph-mon[32756]: pgmap v14127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:25:32.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:32 smithi156 ceph-mon[32679]: pgmap v14127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:25:32.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:32 smithi092 ceph-mon[29156]: pgmap v14127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:25:34.781 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:34 smithi092 ceph-mon[29156]: pgmap v14128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:34.781 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25629.773281 secs 2024-04-27T01:25:34.781 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24932.742961 secs 2024-04-27T01:25:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:34 smithi189 ceph-mon[32756]: pgmap v14128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25629.773281 secs 2024-04-27T01:25:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24932.742961 secs 2024-04-27T01:25:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:34 smithi156 ceph-mon[32679]: pgmap v14128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25629.773281 secs 2024-04-27T01:25:34.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24932.742961 secs 2024-04-27T01:25:36.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:36 smithi189 ceph-mon[32756]: pgmap v14129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:36.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:36 smithi156 ceph-mon[32679]: pgmap v14129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:36.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:36 smithi092 ceph-mon[29156]: pgmap v14129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:38.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:38 smithi189 ceph-mon[32756]: pgmap v14130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:38.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:38 smithi156 ceph-mon[32679]: pgmap v14130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:38.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:38 smithi092 ceph-mon[29156]: pgmap v14130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25634.773399 secs 2024-04-27T01:25:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24937.743086 secs 2024-04-27T01:25:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25634.773399 secs 2024-04-27T01:25:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24937.743086 secs 2024-04-27T01:25:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25634.773399 secs 2024-04-27T01:25:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24937.743086 secs 2024-04-27T01:25:40.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:40 smithi189 ceph-mon[32756]: pgmap v14131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:40.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:40 smithi156 ceph-mon[32679]: pgmap v14131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:40.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:40 smithi092 ceph-mon[29156]: pgmap v14131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:42.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:42 smithi189 ceph-mon[32756]: pgmap v14132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:42 smithi156 ceph-mon[32679]: pgmap v14132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:42.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:42 smithi092 ceph-mon[29156]: pgmap v14132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:44 smithi189 ceph-mon[32756]: pgmap v14133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25639.773543 secs 2024-04-27T01:25:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24942.743206 secs 2024-04-27T01:25:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:44 smithi156 ceph-mon[32679]: pgmap v14133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25639.773543 secs 2024-04-27T01:25:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24942.743206 secs 2024-04-27T01:25:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:44 smithi092 ceph-mon[29156]: pgmap v14133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25639.773543 secs 2024-04-27T01:25:44.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24942.743206 secs 2024-04-27T01:25:46.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:46 smithi189 ceph-mon[32756]: pgmap v14134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:46.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:46 smithi156 ceph-mon[32679]: pgmap v14134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:46.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:46 smithi092 ceph-mon[29156]: pgmap v14134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:48.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:48 smithi189 ceph-mon[32756]: pgmap v14135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:48.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:48 smithi156 ceph-mon[32679]: pgmap v14135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:48.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:48 smithi092 ceph-mon[29156]: pgmap v14135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:49.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25644.773677 secs 2024-04-27T01:25:49.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24947.743331 secs 2024-04-27T01:25:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25644.773677 secs 2024-04-27T01:25:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24947.743331 secs 2024-04-27T01:25:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25644.773677 secs 2024-04-27T01:25:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24947.743331 secs 2024-04-27T01:25:50.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:50 smithi189 ceph-mon[32756]: pgmap v14136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:50.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:50 smithi156 ceph-mon[32679]: pgmap v14136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:50.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:50 smithi092 ceph-mon[29156]: pgmap v14136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:52 smithi189 ceph-mon[32756]: pgmap v14137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:52.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:52 smithi156 ceph-mon[32679]: pgmap v14137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:52.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:52 smithi092 ceph-mon[29156]: pgmap v14137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:54 smithi189 ceph-mon[32756]: pgmap v14138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25649.773855 secs 2024-04-27T01:25:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24952.743466 secs 2024-04-27T01:25:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:54 smithi156 ceph-mon[32679]: pgmap v14138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25649.773855 secs 2024-04-27T01:25:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24952.743466 secs 2024-04-27T01:25:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:54 smithi092 ceph-mon[29156]: pgmap v14138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25649.773855 secs 2024-04-27T01:25:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24952.743466 secs 2024-04-27T01:25:56.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:56 smithi189 ceph-mon[32756]: pgmap v14139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:56 smithi156 ceph-mon[32679]: pgmap v14139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:56.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:56 smithi092 ceph-mon[29156]: pgmap v14139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:25:58.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:58 smithi189 ceph-mon[32756]: pgmap v14140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:58.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:58 smithi156 ceph-mon[32679]: pgmap v14140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:58.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:58 smithi092 ceph-mon[29156]: pgmap v14140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:25:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25654.773967 secs 2024-04-27T01:25:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:25:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24957.743551 secs 2024-04-27T01:25:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25654.773967 secs 2024-04-27T01:25:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:25:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24957.743551 secs 2024-04-27T01:25:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25654.773967 secs 2024-04-27T01:25:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:25:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24957.743551 secs 2024-04-27T01:26:00.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:00 smithi189 ceph-mon[32756]: pgmap v14141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:00.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:00 smithi156 ceph-mon[32679]: pgmap v14141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:00.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:00 smithi092 ceph-mon[29156]: pgmap v14141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:02.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:02 smithi189 ceph-mon[32756]: pgmap v14142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:02.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:02 smithi156 ceph-mon[32679]: pgmap v14142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:02.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:02 smithi092 ceph-mon[29156]: pgmap v14142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:04 smithi189 ceph-mon[32756]: pgmap v14143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25659.774072 secs 2024-04-27T01:26:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24962.743671 secs 2024-04-27T01:26:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:04 smithi156 ceph-mon[32679]: pgmap v14143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25659.774072 secs 2024-04-27T01:26:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24962.743671 secs 2024-04-27T01:26:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:04 smithi092 ceph-mon[29156]: pgmap v14143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:04.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25659.774072 secs 2024-04-27T01:26:04.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24962.743671 secs 2024-04-27T01:26:06.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:06 smithi189 ceph-mon[32756]: pgmap v14144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:06.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:06 smithi156 ceph-mon[32679]: pgmap v14144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:06.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:06 smithi092 ceph-mon[29156]: pgmap v14144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:08.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:08 smithi189 ceph-mon[32756]: pgmap v14145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:08.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:08 smithi156 ceph-mon[32679]: pgmap v14145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:08.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:08 smithi092 ceph-mon[29156]: pgmap v14145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25664.774180 secs 2024-04-27T01:26:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24967.743780 secs 2024-04-27T01:26:09.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25664.774180 secs 2024-04-27T01:26:09.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24967.743780 secs 2024-04-27T01:26:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25664.774180 secs 2024-04-27T01:26:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24967.743780 secs 2024-04-27T01:26:10.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:10 smithi189 ceph-mon[32756]: pgmap v14146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:10.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:10 smithi156 ceph-mon[32679]: pgmap v14146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:10.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:10 smithi092 ceph-mon[29156]: pgmap v14146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:11.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:11 smithi156 ceph-mon[32679]: pgmap v14147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:11.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:11 smithi092 ceph-mon[29156]: pgmap v14147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:12.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:11 smithi189 ceph-mon[32756]: pgmap v14147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:14.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:13 smithi189 ceph-mon[32756]: pgmap v14148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:14.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:13 smithi156 ceph-mon[32679]: pgmap v14148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:14.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:13 smithi092 ceph-mon[29156]: pgmap v14148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:15.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25669.774315 secs 2024-04-27T01:26:15.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24972.743907 secs 2024-04-27T01:26:15.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25669.774315 secs 2024-04-27T01:26:15.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24972.743907 secs 2024-04-27T01:26:15.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25669.774315 secs 2024-04-27T01:26:15.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24972.743907 secs 2024-04-27T01:26:16.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:15 smithi189 ceph-mon[32756]: pgmap v14149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:16.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:15 smithi156 ceph-mon[32679]: pgmap v14149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:16.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:15 smithi092 ceph-mon[29156]: pgmap v14149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:18.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:17 smithi189 ceph-mon[32756]: pgmap v14150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:18.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:17 smithi156 ceph-mon[32679]: pgmap v14150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:18.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:17 smithi092 ceph-mon[29156]: pgmap v14150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25674.774428 secs 2024-04-27T01:26:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:19 smithi092 ceph-mon[29156]: pgmap v14151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:19.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24977.744041 secs 2024-04-27T01:26:20.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25674.774428 secs 2024-04-27T01:26:20.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:19 smithi189 ceph-mon[32756]: pgmap v14151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:20.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24977.744041 secs 2024-04-27T01:26:20.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25674.774428 secs 2024-04-27T01:26:20.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:19 smithi156 ceph-mon[32679]: pgmap v14151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:20.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24977.744041 secs 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: pgmap v14152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: pgmap v14153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: pgmap v14154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:22.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:26:22.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: pgmap v14152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:22.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:26:22.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:26:22.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:26:22.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: pgmap v14153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:26:22.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: pgmap v14154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:22.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:26:22.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: pgmap v14152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:22.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:26:22.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:26:22.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:26:22.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: pgmap v14153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:26:22.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: pgmap v14154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:22.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:26:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:24 smithi189 ceph-mon[32756]: pgmap v14155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25679.774527 secs 2024-04-27T01:26:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24982.744149 secs 2024-04-27T01:26:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:24 smithi156 ceph-mon[32679]: pgmap v14155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25679.774527 secs 2024-04-27T01:26:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24982.744149 secs 2024-04-27T01:26:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:24 smithi092 ceph-mon[29156]: pgmap v14155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25679.774527 secs 2024-04-27T01:26:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24982.744149 secs 2024-04-27T01:26:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:26 smithi189 ceph-mon[32756]: pgmap v14156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:26 smithi156 ceph-mon[32679]: pgmap v14156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:26 smithi092 ceph-mon[29156]: pgmap v14156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:28 smithi189 ceph-mon[32756]: pgmap v14157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:28 smithi156 ceph-mon[32679]: pgmap v14157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:28 smithi092 ceph-mon[29156]: pgmap v14157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:26:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25684.774650 secs 2024-04-27T01:26:29.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24987.744269 secs 2024-04-27T01:26:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25684.774650 secs 2024-04-27T01:26:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24987.744269 secs 2024-04-27T01:26:29.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25684.774650 secs 2024-04-27T01:26:29.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24987.744269 secs 2024-04-27T01:26:30.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:30 smithi189 ceph-mon[32756]: pgmap v14158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:30.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:30 smithi156 ceph-mon[32679]: pgmap v14158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:30.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:30 smithi092 ceph-mon[29156]: pgmap v14158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:26:32.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:32 smithi189 ceph-mon[32756]: pgmap v14159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:26:32.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:32 smithi156 ceph-mon[32679]: pgmap v14159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:26:32.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:32 smithi092 ceph-mon[29156]: pgmap v14159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:26:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:34 smithi189 ceph-mon[32756]: pgmap v14160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25689.774708 secs 2024-04-27T01:26:34.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24992.744386 secs 2024-04-27T01:26:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:34 smithi156 ceph-mon[32679]: pgmap v14160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25689.774708 secs 2024-04-27T01:26:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24992.744386 secs 2024-04-27T01:26:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:34 smithi092 ceph-mon[29156]: pgmap v14160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25689.774708 secs 2024-04-27T01:26:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24992.744386 secs 2024-04-27T01:26:36.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:36 smithi189 ceph-mon[32756]: pgmap v14161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:36.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:36 smithi156 ceph-mon[32679]: pgmap v14161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:36.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:36 smithi092 ceph-mon[29156]: pgmap v14161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:37.978 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:26:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:26:37.634+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:26:37.979 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:26:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:26:37.634+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:26:37.979 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:26:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:26:37.634+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:26:37.979 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:26:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:26:37.634+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:26:37.979 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:26:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:26:37.634+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:26:38.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:38 smithi189 ceph-mon[32756]: pgmap v14162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:38.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:38 smithi156 ceph-mon[32679]: pgmap v14162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:38.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:38 smithi092 ceph-mon[29156]: pgmap v14162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25694.774836 secs 2024-04-27T01:26:39.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 24997.744504 secs 2024-04-27T01:26:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25694.774836 secs 2024-04-27T01:26:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 24997.744504 secs 2024-04-27T01:26:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25694.774836 secs 2024-04-27T01:26:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 24997.744504 secs 2024-04-27T01:26:40.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:40 smithi189 ceph-mon[32756]: pgmap v14163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:40.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:40 smithi156 ceph-mon[32679]: pgmap v14163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:40.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:40 smithi092 ceph-mon[29156]: pgmap v14163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:42.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:42 smithi189 ceph-mon[32756]: pgmap v14164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:42 smithi156 ceph-mon[32679]: pgmap v14164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:42.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:42 smithi092 ceph-mon[29156]: pgmap v14164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:43.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:43 smithi156 ceph-mon[32679]: pgmap v14165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:43.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:43 smithi092 ceph-mon[29156]: pgmap v14165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:44.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:43 smithi189 ceph-mon[32756]: pgmap v14165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25699.774929 secs 2024-04-27T01:26:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25002.744623 secs 2024-04-27T01:26:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25699.774929 secs 2024-04-27T01:26:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25002.744623 secs 2024-04-27T01:26:45.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25699.774929 secs 2024-04-27T01:26:45.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25002.744623 secs 2024-04-27T01:26:45.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:45 smithi156 ceph-mon[32679]: pgmap v14166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:45.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:45 smithi092 ceph-mon[29156]: pgmap v14166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:46.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:45 smithi189 ceph-mon[32756]: pgmap v14166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:48.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:48 smithi189 ceph-mon[32756]: pgmap v14167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:48.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:48 smithi156 ceph-mon[32679]: pgmap v14167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:48.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:48 smithi092 ceph-mon[29156]: pgmap v14167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T01:26:49.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25704.775016 secs 2024-04-27T01:26:49.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25007.744778 secs 2024-04-27T01:26:49.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25704.775016 secs 2024-04-27T01:26:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25007.744778 secs 2024-04-27T01:26:49.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25704.775016 secs 2024-04-27T01:26:49.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25007.744778 secs 2024-04-27T01:26:50.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:50 smithi189 ceph-mon[32756]: pgmap v14168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:50.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:50 smithi156 ceph-mon[32679]: pgmap v14168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:50.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:50 smithi092 ceph-mon[29156]: pgmap v14168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T01:26:52.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:52 smithi189 ceph-mon[32756]: pgmap v14169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:52.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:52 smithi156 ceph-mon[32679]: pgmap v14169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:52.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:52 smithi092 ceph-mon[29156]: pgmap v14169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:54 smithi189 ceph-mon[32756]: pgmap v14170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25709.775121 secs 2024-04-27T01:26:54.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25012.744914 secs 2024-04-27T01:26:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:54 smithi156 ceph-mon[32679]: pgmap v14170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25709.775121 secs 2024-04-27T01:26:54.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25012.744914 secs 2024-04-27T01:26:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:54 smithi092 ceph-mon[29156]: pgmap v14170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25709.775121 secs 2024-04-27T01:26:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25012.744914 secs 2024-04-27T01:26:56.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:56 smithi189 ceph-mon[32756]: pgmap v14171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:56 smithi156 ceph-mon[32679]: pgmap v14171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:56.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:56 smithi092 ceph-mon[29156]: pgmap v14171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:26:58.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:58 smithi189 ceph-mon[32756]: pgmap v14172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:58.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:58 smithi156 ceph-mon[32679]: pgmap v14172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:58.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:58 smithi092 ceph-mon[29156]: pgmap v14172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:26:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25714.775233 secs 2024-04-27T01:26:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:26:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25017.745040 secs 2024-04-27T01:26:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25714.775233 secs 2024-04-27T01:26:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:26:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25017.745040 secs 2024-04-27T01:26:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25714.775233 secs 2024-04-27T01:26:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:26:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25017.745040 secs 2024-04-27T01:27:00.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:00 smithi189 ceph-mon[32756]: pgmap v14173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:00.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:00 smithi156 ceph-mon[32679]: pgmap v14173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:00.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:00 smithi092 ceph-mon[29156]: pgmap v14173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:02.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:02 smithi189 ceph-mon[32756]: pgmap v14174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:02.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:02 smithi156 ceph-mon[32679]: pgmap v14174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:02.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:02 smithi092 ceph-mon[29156]: pgmap v14174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:04 smithi189 ceph-mon[32756]: pgmap v14175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25719.775312 secs 2024-04-27T01:27:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25022.745145 secs 2024-04-27T01:27:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:04 smithi156 ceph-mon[32679]: pgmap v14175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25719.775312 secs 2024-04-27T01:27:04.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25022.745145 secs 2024-04-27T01:27:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:04 smithi092 ceph-mon[29156]: pgmap v14175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25719.775312 secs 2024-04-27T01:27:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25022.745145 secs 2024-04-27T01:27:06.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:06 smithi189 ceph-mon[32756]: pgmap v14176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:06.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:06 smithi156 ceph-mon[32679]: pgmap v14176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:06.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:06 smithi092 ceph-mon[29156]: pgmap v14176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:07.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:07 smithi156 ceph-mon[32679]: pgmap v14177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:07.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:07 smithi092 ceph-mon[29156]: pgmap v14177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:08.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:07 smithi189 ceph-mon[32756]: pgmap v14177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:09.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25027.745292 secs 2024-04-27T01:27:09.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25027.745292 secs 2024-04-27T01:27:09.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25027.745292 secs 2024-04-27T01:27:10.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25724.775457 secs 2024-04-27T01:27:10.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:10 smithi189 ceph-mon[32756]: pgmap v14178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:10.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25724.775457 secs 2024-04-27T01:27:10.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:10 smithi156 ceph-mon[32679]: pgmap v14178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:10.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25724.775457 secs 2024-04-27T01:27:10.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:10 smithi092 ceph-mon[29156]: pgmap v14178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:12.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:12 smithi189 ceph-mon[32756]: pgmap v14179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:12.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:12 smithi156 ceph-mon[32679]: pgmap v14179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:12.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:12 smithi092 ceph-mon[29156]: pgmap v14179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:14.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:14 smithi189 ceph-mon[32756]: pgmap v14180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:14.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25729.775578 secs 2024-04-27T01:27:14.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25032.745418 secs 2024-04-27T01:27:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:14 smithi156 ceph-mon[32679]: pgmap v14180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25729.775578 secs 2024-04-27T01:27:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25032.745418 secs 2024-04-27T01:27:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:14 smithi092 ceph-mon[29156]: pgmap v14180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25729.775578 secs 2024-04-27T01:27:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25032.745418 secs 2024-04-27T01:27:16.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:16 smithi189 ceph-mon[32756]: pgmap v14181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:16.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:16 smithi156 ceph-mon[32679]: pgmap v14181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:16.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:16 smithi092 ceph-mon[29156]: pgmap v14181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:18.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:18 smithi189 ceph-mon[32756]: pgmap v14182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:18.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:18 smithi156 ceph-mon[32679]: pgmap v14182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:18.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:18 smithi092 ceph-mon[29156]: pgmap v14182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25734.775698 secs 2024-04-27T01:27:19.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25037.745506 secs 2024-04-27T01:27:19.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25734.775698 secs 2024-04-27T01:27:19.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25037.745506 secs 2024-04-27T01:27:19.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25734.775698 secs 2024-04-27T01:27:19.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25037.745506 secs 2024-04-27T01:27:20.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:20 smithi189 ceph-mon[32756]: pgmap v14183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:20.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:20 smithi156 ceph-mon[32679]: pgmap v14183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:20.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:20 smithi092 ceph-mon[29156]: pgmap v14183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:22 smithi189 ceph-mon[32756]: pgmap v14184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:27:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:27:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:27:22.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:27:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:22 smithi156 ceph-mon[32679]: pgmap v14184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:27:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:27:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:27:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:27:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:22 smithi092 ceph-mon[29156]: pgmap v14184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:27:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:27:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:27:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:27:23.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:23 smithi189 ceph-mon[32756]: pgmap v14185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:27:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:23 smithi189 ceph-mon[32756]: pgmap v14186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:23 smithi156 ceph-mon[32679]: pgmap v14185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:27:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:23 smithi156 ceph-mon[32679]: pgmap v14186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:23.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:23 smithi092 ceph-mon[29156]: pgmap v14185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:27:23.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:23 smithi092 ceph-mon[29156]: pgmap v14186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25739.775815 secs 2024-04-27T01:27:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25042.745625 secs 2024-04-27T01:27:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25739.775815 secs 2024-04-27T01:27:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25042.745625 secs 2024-04-27T01:27:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25739.775815 secs 2024-04-27T01:27:24.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25042.745625 secs 2024-04-27T01:27:25.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:25 smithi189 ceph-mon[32756]: pgmap v14187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:25.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:25 smithi156 ceph-mon[32679]: pgmap v14187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:25.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:25 smithi092 ceph-mon[29156]: pgmap v14187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:26 smithi189 ceph-mon[32756]: pgmap v14188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:26 smithi156 ceph-mon[32679]: pgmap v14188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:26 smithi092 ceph-mon[29156]: pgmap v14188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:29.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:29 smithi189 ceph-mon[32756]: pgmap v14189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:27:29.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25744.775940 secs 2024-04-27T01:27:29.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25047.745730 secs 2024-04-27T01:27:29.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:29 smithi156 ceph-mon[32679]: pgmap v14189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:27:29.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25744.775940 secs 2024-04-27T01:27:29.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25047.745730 secs 2024-04-27T01:27:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:29 smithi092 ceph-mon[29156]: pgmap v14189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:27:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25744.775940 secs 2024-04-27T01:27:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25047.745730 secs 2024-04-27T01:27:31.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:31 smithi189 ceph-mon[32756]: pgmap v14190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:31.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:31 smithi156 ceph-mon[32679]: pgmap v14190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:31.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:31 smithi092 ceph-mon[29156]: pgmap v14190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:27:33.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:33 smithi189 ceph-mon[32756]: pgmap v14191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:27:33.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:33 smithi156 ceph-mon[32679]: pgmap v14191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:27:33.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:33 smithi092 ceph-mon[29156]: pgmap v14191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:27:34.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25749.776050 secs 2024-04-27T01:27:34.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25052.745824 secs 2024-04-27T01:27:34.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25749.776050 secs 2024-04-27T01:27:34.629 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25052.745824 secs 2024-04-27T01:27:34.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25749.776050 secs 2024-04-27T01:27:34.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25052.745824 secs 2024-04-27T01:27:35.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:35 smithi189 ceph-mon[32756]: pgmap v14192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:35.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:35 smithi156 ceph-mon[32679]: pgmap v14192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:35.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:35 smithi092 ceph-mon[29156]: pgmap v14192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:37.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:37 smithi189 ceph-mon[32756]: pgmap v14193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:37.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:37 smithi156 ceph-mon[32679]: pgmap v14193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:37.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:37 smithi092 ceph-mon[29156]: pgmap v14193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:27:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:27:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T01:27:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:27:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 199 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T01:27:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:27:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:27:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:27:39.520+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 200 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:27:39.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:39 smithi189 ceph-mon[32756]: pgmap v14194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:39.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 25754.776174 secs 2024-04-27T01:27:39.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:39 smithi189 ceph-mon[32756]: slow request 361.118944 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:27:39.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25057.745898 secs 2024-04-27T01:27:39.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:39 smithi156 ceph-mon[32679]: pgmap v14194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:39.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 25754.776174 secs 2024-04-27T01:27:39.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:39 smithi156 ceph-mon[32679]: slow request 361.118944 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:27:39.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25057.745898 secs 2024-04-27T01:27:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:39 smithi092 ceph-mon[29156]: pgmap v14194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 25754.776174 secs 2024-04-27T01:27:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:39 smithi092 ceph-mon[29156]: slow request 361.118944 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:27:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25057.745898 secs 2024-04-27T01:27:41.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:41 smithi189 ceph-mon[32756]: pgmap v14195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:41.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:41 smithi156 ceph-mon[32679]: pgmap v14195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:41.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:41 smithi092 ceph-mon[29156]: pgmap v14195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:43.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:43 smithi189 ceph-mon[32756]: pgmap v14196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:43.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:43 smithi156 ceph-mon[32679]: pgmap v14196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:43.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:43 smithi092 ceph-mon[29156]: pgmap v14196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:44.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25759.776311 secs 2024-04-27T01:27:44.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25062.746036 secs 2024-04-27T01:27:44.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25759.776311 secs 2024-04-27T01:27:44.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25062.746036 secs 2024-04-27T01:27:44.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25759.776311 secs 2024-04-27T01:27:44.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25062.746036 secs 2024-04-27T01:27:45.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:45 smithi189 ceph-mon[32756]: pgmap v14197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:45.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:45 smithi156 ceph-mon[32679]: pgmap v14197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:45.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:45 smithi092 ceph-mon[29156]: pgmap v14197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:47.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:47 smithi189 ceph-mon[32756]: pgmap v14198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:47.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:47 smithi156 ceph-mon[32679]: pgmap v14198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:47.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:47 smithi092 ceph-mon[29156]: pgmap v14198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:49.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:49 smithi189 ceph-mon[32756]: pgmap v14199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:49.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25764.776427 secs 2024-04-27T01:27:49.623 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25067.746149 secs 2024-04-27T01:27:49.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:49 smithi156 ceph-mon[32679]: pgmap v14199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:49.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25764.776427 secs 2024-04-27T01:27:49.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25067.746149 secs 2024-04-27T01:27:49.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:49 smithi092 ceph-mon[29156]: pgmap v14199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:49.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25764.776427 secs 2024-04-27T01:27:49.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25067.746149 secs 2024-04-27T01:27:51.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:51 smithi189 ceph-mon[32756]: pgmap v14200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:51.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:51 smithi156 ceph-mon[32679]: pgmap v14200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:51.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:51 smithi092 ceph-mon[29156]: pgmap v14200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:53.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:53 smithi189 ceph-mon[32756]: pgmap v14201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:53.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:53 smithi156 ceph-mon[32679]: pgmap v14201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:53.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:53 smithi092 ceph-mon[29156]: pgmap v14201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:54.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25769.776546 secs 2024-04-27T01:27:54.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25072.746231 secs 2024-04-27T01:27:54.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25769.776546 secs 2024-04-27T01:27:54.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25072.746231 secs 2024-04-27T01:27:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25769.776546 secs 2024-04-27T01:27:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25072.746231 secs 2024-04-27T01:27:55.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:55 smithi156 ceph-mon[32679]: pgmap v14202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:55.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:55 smithi092 ceph-mon[29156]: pgmap v14202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:55.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:55 smithi189 ceph-mon[32756]: pgmap v14202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:27:57.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:57 smithi156 ceph-mon[32679]: pgmap v14203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:57.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:57 smithi092 ceph-mon[29156]: pgmap v14203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:57.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:57 smithi189 ceph-mon[32756]: pgmap v14203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:59.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:59 smithi156 ceph-mon[32679]: pgmap v14204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:59.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25774.776664 secs 2024-04-27T01:27:59.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:27:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25077.746348 secs 2024-04-27T01:27:59.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:59 smithi092 ceph-mon[29156]: pgmap v14204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:59.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25774.776664 secs 2024-04-27T01:27:59.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:27:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25077.746348 secs 2024-04-27T01:27:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:59 smithi189 ceph-mon[32756]: pgmap v14204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:27:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25774.776664 secs 2024-04-27T01:27:59.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:27:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25077.746348 secs 2024-04-27T01:28:01.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:01 smithi156 ceph-mon[32679]: pgmap v14205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:01.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:01 smithi092 ceph-mon[29156]: pgmap v14205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:01.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:01 smithi189 ceph-mon[32756]: pgmap v14205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:03.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:03 smithi156 ceph-mon[32679]: pgmap v14206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:03.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:03 smithi092 ceph-mon[29156]: pgmap v14206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:03.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:03 smithi189 ceph-mon[32756]: pgmap v14206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:04.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25779.776801 secs 2024-04-27T01:28:04.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25082.746488 secs 2024-04-27T01:28:04.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25779.776801 secs 2024-04-27T01:28:04.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25082.746488 secs 2024-04-27T01:28:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25779.776801 secs 2024-04-27T01:28:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25082.746488 secs 2024-04-27T01:28:05.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:05 smithi156 ceph-mon[32679]: pgmap v14207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:05.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:05 smithi092 ceph-mon[29156]: pgmap v14207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:05.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:05 smithi189 ceph-mon[32756]: pgmap v14207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:07.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:07 smithi156 ceph-mon[32679]: pgmap v14208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:07.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:07 smithi092 ceph-mon[29156]: pgmap v14208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:07.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:07 smithi189 ceph-mon[32756]: pgmap v14208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:09.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:09 smithi156 ceph-mon[32679]: pgmap v14209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:09.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25784.776920 secs 2024-04-27T01:28:09.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25087.746574 secs 2024-04-27T01:28:09.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:09 smithi092 ceph-mon[29156]: pgmap v14209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:09.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25784.776920 secs 2024-04-27T01:28:09.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25087.746574 secs 2024-04-27T01:28:09.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:09 smithi189 ceph-mon[32756]: pgmap v14209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:09.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25784.776920 secs 2024-04-27T01:28:09.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25087.746574 secs 2024-04-27T01:28:11.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:11 smithi156 ceph-mon[32679]: pgmap v14210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:11.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:11 smithi092 ceph-mon[29156]: pgmap v14210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:11.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:11 smithi189 ceph-mon[32756]: pgmap v14210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:13.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:13 smithi156 ceph-mon[32679]: pgmap v14211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:13.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:13 smithi092 ceph-mon[29156]: pgmap v14211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:13.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:13 smithi189 ceph-mon[32756]: pgmap v14211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:14.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25789.776986 secs 2024-04-27T01:28:14.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25092.746683 secs 2024-04-27T01:28:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25789.776986 secs 2024-04-27T01:28:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25092.746683 secs 2024-04-27T01:28:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25789.776986 secs 2024-04-27T01:28:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25092.746683 secs 2024-04-27T01:28:15.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:15 smithi156 ceph-mon[32679]: pgmap v14212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:15.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:15 smithi092 ceph-mon[29156]: pgmap v14212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:15.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:15 smithi189 ceph-mon[32756]: pgmap v14212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:17.675 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:17 smithi189 ceph-mon[32756]: pgmap v14213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:17.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:17 smithi092 ceph-mon[29156]: pgmap v14213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:17.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:17 smithi156 ceph-mon[32679]: pgmap v14213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:19.720 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:19 smithi156 ceph-mon[32679]: pgmap v14214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:19.720 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25794.777070 secs 2024-04-27T01:28:19.721 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25097.746760 secs 2024-04-27T01:28:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:19 smithi092 ceph-mon[29156]: pgmap v14214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25794.777070 secs 2024-04-27T01:28:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25097.746760 secs 2024-04-27T01:28:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:19 smithi189 ceph-mon[32756]: pgmap v14214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25794.777070 secs 2024-04-27T01:28:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25097.746760 secs 2024-04-27T01:28:21.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:21 smithi092 ceph-mon[29156]: pgmap v14215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:21.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:21 smithi189 ceph-mon[32756]: pgmap v14215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:21.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:21 smithi156 ceph-mon[32679]: pgmap v14215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:22.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:28:22.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:28:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:28:23.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:23 smithi092 ceph-mon[29156]: pgmap v14216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:23.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:28:23.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:28:23.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:28:23.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:23 smithi189 ceph-mon[32756]: pgmap v14216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:28:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:28:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:28:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:23 smithi156 ceph-mon[32679]: pgmap v14216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:28:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:28:23.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:28:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:24 smithi092 ceph-mon[29156]: pgmap v14217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:28:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:24 smithi092 ceph-mon[29156]: pgmap v14218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:28:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25799.777140 secs 2024-04-27T01:28:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25102.746871 secs 2024-04-27T01:28:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:24 smithi189 ceph-mon[32756]: pgmap v14217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:28:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:24 smithi189 ceph-mon[32756]: pgmap v14218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:28:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25799.777140 secs 2024-04-27T01:28:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25102.746871 secs 2024-04-27T01:28:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:24 smithi156 ceph-mon[32679]: pgmap v14217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:28:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:24 smithi156 ceph-mon[32679]: pgmap v14218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:28:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25799.777140 secs 2024-04-27T01:28:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25102.746871 secs 2024-04-27T01:28:26.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:26 smithi092 ceph-mon[29156]: pgmap v14219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:26 smithi189 ceph-mon[32756]: pgmap v14219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:26 smithi156 ceph-mon[32679]: pgmap v14219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:28 smithi092 ceph-mon[29156]: pgmap v14220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:28 smithi189 ceph-mon[32756]: pgmap v14220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:28 smithi156 ceph-mon[32679]: pgmap v14220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25804.777260 secs 2024-04-27T01:28:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25107.746937 secs 2024-04-27T01:28:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25804.777260 secs 2024-04-27T01:28:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25107.746937 secs 2024-04-27T01:28:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25804.777260 secs 2024-04-27T01:28:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25107.746937 secs 2024-04-27T01:28:30.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:30 smithi092 ceph-mon[29156]: pgmap v14221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:30 smithi189 ceph-mon[32756]: pgmap v14221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:30.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:30 smithi156 ceph-mon[32679]: pgmap v14221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:32.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:32 smithi092 ceph-mon[29156]: pgmap v14222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:32.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:32 smithi189 ceph-mon[32756]: pgmap v14222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:32.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:32 smithi156 ceph-mon[32679]: pgmap v14222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:28:34.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:34 smithi092 ceph-mon[29156]: pgmap v14223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:28:34.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25809.777358 secs 2024-04-27T01:28:34.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25112.747075 secs 2024-04-27T01:28:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:34 smithi189 ceph-mon[32756]: pgmap v14223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:28:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25809.777358 secs 2024-04-27T01:28:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25112.747075 secs 2024-04-27T01:28:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:34 smithi156 ceph-mon[32679]: pgmap v14223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:28:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25809.777358 secs 2024-04-27T01:28:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25112.747075 secs 2024-04-27T01:28:36.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:36 smithi092 ceph-mon[29156]: pgmap v14224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:36.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:36 smithi189 ceph-mon[32756]: pgmap v14224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:36.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:36 smithi156 ceph-mon[32679]: pgmap v14224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:38.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:38 smithi092 ceph-mon[29156]: pgmap v14225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:38.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:38 smithi189 ceph-mon[32756]: pgmap v14225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:38.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:38 smithi156 ceph-mon[32679]: pgmap v14225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 25814.777477 secs 2024-04-27T01:28:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:39 smithi092 ceph-mon[29156]: slow request 721.241633 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:28:39.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25117.747209 secs 2024-04-27T01:28:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 25814.777477 secs 2024-04-27T01:28:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:39 smithi189 ceph-mon[32756]: slow request 721.241633 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:28:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25117.747209 secs 2024-04-27T01:28:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 25814.777477 secs 2024-04-27T01:28:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:39 smithi156 ceph-mon[32679]: slow request 721.241633 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:28:39.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25117.747209 secs 2024-04-27T01:28:40.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:40 smithi092 ceph-mon[29156]: pgmap v14226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:40.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:40 smithi189 ceph-mon[32756]: pgmap v14226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:40.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:40 smithi156 ceph-mon[32679]: pgmap v14226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:42.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:42 smithi189 ceph-mon[32756]: pgmap v14227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:42 smithi156 ceph-mon[32679]: pgmap v14227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:42.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:42 smithi092 ceph-mon[29156]: pgmap v14227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:44 smithi189 ceph-mon[32756]: pgmap v14228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25819.777625 secs 2024-04-27T01:28:44.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25122.747371 secs 2024-04-27T01:28:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:44 smithi156 ceph-mon[32679]: pgmap v14228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25819.777625 secs 2024-04-27T01:28:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25122.747371 secs 2024-04-27T01:28:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:44 smithi092 ceph-mon[29156]: pgmap v14228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25819.777625 secs 2024-04-27T01:28:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25122.747371 secs 2024-04-27T01:28:46.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:46 smithi189 ceph-mon[32756]: pgmap v14229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:46.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:46 smithi156 ceph-mon[32679]: pgmap v14229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:46.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:46 smithi092 ceph-mon[29156]: pgmap v14229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:48.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:48 smithi189 ceph-mon[32756]: pgmap v14230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:48.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:48 smithi156 ceph-mon[32679]: pgmap v14230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:48.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:48 smithi092 ceph-mon[29156]: pgmap v14230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:49.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25824.777758 secs 2024-04-27T01:28:49.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25127.747435 secs 2024-04-27T01:28:49.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25824.777758 secs 2024-04-27T01:28:49.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25127.747435 secs 2024-04-27T01:28:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25824.777758 secs 2024-04-27T01:28:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25127.747435 secs 2024-04-27T01:28:50.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:50 smithi189 ceph-mon[32756]: pgmap v14231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:50.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:50 smithi156 ceph-mon[32679]: pgmap v14231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:50.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:50 smithi092 ceph-mon[29156]: pgmap v14231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:52 smithi189 ceph-mon[32756]: pgmap v14232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:52.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:52 smithi156 ceph-mon[32679]: pgmap v14232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:52.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:52 smithi092 ceph-mon[29156]: pgmap v14232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:54.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:54 smithi092 ceph-mon[29156]: pgmap v14233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:54.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25829.777879 secs 2024-04-27T01:28:54.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25132.747509 secs 2024-04-27T01:28:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:54 smithi189 ceph-mon[32756]: pgmap v14233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25829.777879 secs 2024-04-27T01:28:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25132.747509 secs 2024-04-27T01:28:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:54 smithi156 ceph-mon[32679]: pgmap v14233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25829.777879 secs 2024-04-27T01:28:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25132.747509 secs 2024-04-27T01:28:56.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:56 smithi189 ceph-mon[32756]: pgmap v14234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:56 smithi156 ceph-mon[32679]: pgmap v14234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:56.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:56 smithi092 ceph-mon[29156]: pgmap v14234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:28:58.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:58 smithi189 ceph-mon[32756]: pgmap v14235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:58.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:58 smithi156 ceph-mon[32679]: pgmap v14235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:58.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:58 smithi092 ceph-mon[29156]: pgmap v14235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:28:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25834.777945 secs 2024-04-27T01:28:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:28:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25137.747646 secs 2024-04-27T01:28:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25834.777945 secs 2024-04-27T01:28:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:28:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25137.747646 secs 2024-04-27T01:28:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25834.777945 secs 2024-04-27T01:28:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:28:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25137.747646 secs 2024-04-27T01:29:00.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:00 smithi189 ceph-mon[32756]: pgmap v14236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:00.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:00 smithi156 ceph-mon[32679]: pgmap v14236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:00.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:00 smithi092 ceph-mon[29156]: pgmap v14236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:02.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:02 smithi189 ceph-mon[32756]: pgmap v14237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:02.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:02 smithi156 ceph-mon[32679]: pgmap v14237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:02.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:02 smithi092 ceph-mon[29156]: pgmap v14237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:04.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:04 smithi092 ceph-mon[29156]: pgmap v14238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:04.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25839.778073 secs 2024-04-27T01:29:04.780 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25142.747727 secs 2024-04-27T01:29:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:04 smithi189 ceph-mon[32756]: pgmap v14238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25839.778073 secs 2024-04-27T01:29:04.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25142.747727 secs 2024-04-27T01:29:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:04 smithi156 ceph-mon[32679]: pgmap v14238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25839.778073 secs 2024-04-27T01:29:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25142.747727 secs 2024-04-27T01:29:06.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:06 smithi189 ceph-mon[32756]: pgmap v14239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:06.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:06 smithi156 ceph-mon[32679]: pgmap v14239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:06.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:06 smithi092 ceph-mon[29156]: pgmap v14239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:08.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:08 smithi189 ceph-mon[32756]: pgmap v14240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:08.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:08 smithi156 ceph-mon[32679]: pgmap v14240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:08.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:08 smithi092 ceph-mon[29156]: pgmap v14240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:09.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25844.778205 secs 2024-04-27T01:29:09.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25147.747870 secs 2024-04-27T01:29:09.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25844.778205 secs 2024-04-27T01:29:09.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25147.747870 secs 2024-04-27T01:29:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25844.778205 secs 2024-04-27T01:29:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25147.747870 secs 2024-04-27T01:29:10.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:10 smithi189 ceph-mon[32756]: pgmap v14241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:10.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:10 smithi156 ceph-mon[32679]: pgmap v14241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:10.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:10 smithi092 ceph-mon[29156]: pgmap v14241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:12.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:12 smithi189 ceph-mon[32756]: pgmap v14242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:12.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:12 smithi156 ceph-mon[32679]: pgmap v14242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:12.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:12 smithi092 ceph-mon[29156]: pgmap v14242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:14 smithi189 ceph-mon[32756]: pgmap v14243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25849.778343 secs 2024-04-27T01:29:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25152.747955 secs 2024-04-27T01:29:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:14 smithi156 ceph-mon[32679]: pgmap v14243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25849.778343 secs 2024-04-27T01:29:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25152.747955 secs 2024-04-27T01:29:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:14 smithi092 ceph-mon[29156]: pgmap v14243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25849.778343 secs 2024-04-27T01:29:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25152.747955 secs 2024-04-27T01:29:16.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:16 smithi189 ceph-mon[32756]: pgmap v14244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:16.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:16 smithi156 ceph-mon[32679]: pgmap v14244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:16.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:16 smithi092 ceph-mon[29156]: pgmap v14244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:18.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:18 smithi189 ceph-mon[32756]: pgmap v14245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:18.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:18 smithi156 ceph-mon[32679]: pgmap v14245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:18.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:18 smithi092 ceph-mon[29156]: pgmap v14245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:19.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25854.778467 secs 2024-04-27T01:29:19.820 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25157.748024 secs 2024-04-27T01:29:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25854.778467 secs 2024-04-27T01:29:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25157.748024 secs 2024-04-27T01:29:19.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25854.778467 secs 2024-04-27T01:29:19.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25157.748024 secs 2024-04-27T01:29:20.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:20 smithi189 ceph-mon[32756]: pgmap v14246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:20.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:20 smithi156 ceph-mon[32679]: pgmap v14246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:20.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:20 smithi092 ceph-mon[29156]: pgmap v14246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:22.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:22 smithi189 ceph-mon[32756]: pgmap v14247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:22 smithi156 ceph-mon[32679]: pgmap v14247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:22.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:22 smithi092 ceph-mon[29156]: pgmap v14247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:23.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:29:23.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:29:23.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: pgmap v14248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25859.778527 secs 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.765 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25162.748113 secs 2024-04-27T01:29:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: pgmap v14248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25859.778527 secs 2024-04-27T01:29:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25162.748113 secs 2024-04-27T01:29:24.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: pgmap v14248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25859.778527 secs 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:24.933 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25162.748113 secs 2024-04-27T01:29:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: pgmap v14249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: pgmap v14249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: pgmap v14249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:26.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:29:27.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:29:27.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:29:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:29:27.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:29:27.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:29:27.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:29:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:29:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:29:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:29:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: pgmap v14250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:28.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:28 smithi189 ceph-mon[32756]: pgmap v14251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: pgmap v14250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:28 smithi156 ceph-mon[32679]: pgmap v14251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: pgmap v14250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:28 smithi092 ceph-mon[29156]: pgmap v14251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25864.778601 secs 2024-04-27T01:29:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25167.748177 secs 2024-04-27T01:29:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25864.778601 secs 2024-04-27T01:29:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25167.748177 secs 2024-04-27T01:29:29.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25864.778601 secs 2024-04-27T01:29:29.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25167.748177 secs 2024-04-27T01:29:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:30 smithi189 ceph-mon[32756]: pgmap v14252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:30.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:30 smithi156 ceph-mon[32679]: pgmap v14252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:30.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:30 smithi092 ceph-mon[29156]: pgmap v14252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:32.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:32 smithi189 ceph-mon[32756]: pgmap v14253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:32.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:32 smithi156 ceph-mon[32679]: pgmap v14253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:32.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:32 smithi092 ceph-mon[29156]: pgmap v14253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:34 smithi189 ceph-mon[32756]: pgmap v14254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25869.778724 secs 2024-04-27T01:29:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25172.748326 secs 2024-04-27T01:29:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:34 smithi156 ceph-mon[32679]: pgmap v14254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25869.778724 secs 2024-04-27T01:29:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25172.748326 secs 2024-04-27T01:29:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:34 smithi092 ceph-mon[29156]: pgmap v14254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25869.778724 secs 2024-04-27T01:29:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25172.748326 secs 2024-04-27T01:29:36.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:36 smithi189 ceph-mon[32756]: pgmap v14255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:36.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:36 smithi156 ceph-mon[32679]: pgmap v14255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:36.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:36 smithi092 ceph-mon[29156]: pgmap v14255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:29:38.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:38 smithi189 ceph-mon[32756]: pgmap v14256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:29:38.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:38 smithi156 ceph-mon[32679]: pgmap v14256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:29:38.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:38 smithi092 ceph-mon[29156]: pgmap v14256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:29:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25874.778884 secs 2024-04-27T01:29:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25177.748446 secs 2024-04-27T01:29:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25874.778884 secs 2024-04-27T01:29:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25177.748446 secs 2024-04-27T01:29:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25874.778884 secs 2024-04-27T01:29:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25177.748446 secs 2024-04-27T01:29:40.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:40 smithi189 ceph-mon[32756]: pgmap v14257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:40.909 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:40 smithi092 ceph-mon[29156]: pgmap v14257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:40.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:40 smithi156 ceph-mon[32679]: pgmap v14257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:42.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:42 smithi189 ceph-mon[32756]: pgmap v14258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:42 smithi156 ceph-mon[32679]: pgmap v14258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:42.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:42 smithi092 ceph-mon[29156]: pgmap v14258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:44 smithi189 ceph-mon[32756]: pgmap v14259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25879.778997 secs 2024-04-27T01:29:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25182.748557 secs 2024-04-27T01:29:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:44 smithi156 ceph-mon[32679]: pgmap v14259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25879.778997 secs 2024-04-27T01:29:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25182.748557 secs 2024-04-27T01:29:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:44 smithi092 ceph-mon[29156]: pgmap v14259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25879.778997 secs 2024-04-27T01:29:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25182.748557 secs 2024-04-27T01:29:46.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:46 smithi189 ceph-mon[32756]: pgmap v14260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:46.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:46 smithi156 ceph-mon[32679]: pgmap v14260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:46.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:46 smithi092 ceph-mon[29156]: pgmap v14260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:48.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:48 smithi189 ceph-mon[32756]: pgmap v14261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:48.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:48 smithi156 ceph-mon[32679]: pgmap v14261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:48.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:48 smithi092 ceph-mon[29156]: pgmap v14261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25884.779123 secs 2024-04-27T01:29:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:49 smithi156 ceph-mon[32679]: pgmap v14262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25187.748675 secs 2024-04-27T01:29:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25884.779123 secs 2024-04-27T01:29:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:49 smithi092 ceph-mon[29156]: pgmap v14262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25187.748675 secs 2024-04-27T01:29:50.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25884.779123 secs 2024-04-27T01:29:50.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:49 smithi189 ceph-mon[32756]: pgmap v14262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:50.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25187.748675 secs 2024-04-27T01:29:52.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:51 smithi189 ceph-mon[32756]: pgmap v14263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:52.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:51 smithi156 ceph-mon[32679]: pgmap v14263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:52.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:51 smithi092 ceph-mon[29156]: pgmap v14263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:54.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:53 smithi189 ceph-mon[32756]: pgmap v14264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:54.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:53 smithi156 ceph-mon[32679]: pgmap v14264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:54.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:53 smithi092 ceph-mon[29156]: pgmap v14264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:55.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25889.779245 secs 2024-04-27T01:29:55.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25192.748791 secs 2024-04-27T01:29:55.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25889.779245 secs 2024-04-27T01:29:55.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25192.748791 secs 2024-04-27T01:29:55.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25889.779245 secs 2024-04-27T01:29:55.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25192.748791 secs 2024-04-27T01:29:56.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:55 smithi189 ceph-mon[32756]: pgmap v14265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:56.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:55 smithi156 ceph-mon[32679]: pgmap v14265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:56.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:55 smithi092 ceph-mon[29156]: pgmap v14265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:29:58.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:57 smithi189 ceph-mon[32756]: pgmap v14266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:58.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:57 smithi156 ceph-mon[32679]: pgmap v14266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:29:58.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:57 smithi092 ceph-mon[29156]: pgmap v14266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:00.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25894.779346 secs 2024-04-27T01:30:00.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:59 smithi189 ceph-mon[32756]: pgmap v14267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:00.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:29:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25197.748903 secs 2024-04-27T01:30:00.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25894.779346 secs 2024-04-27T01:30:00.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:59 smithi156 ceph-mon[32679]: pgmap v14267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:00.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:29:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25197.748903 secs 2024-04-27T01:30:00.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25894.779346 secs 2024-04-27T01:30:00.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:59 smithi092 ceph-mon[29156]: pgmap v14267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:00.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:29:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25197.748903 secs 2024-04-27T01:30:01.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:30:01.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:30:01.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:30:02.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:01 smithi189 ceph-mon[32756]: pgmap v14268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:02.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:01 smithi156 ceph-mon[32679]: pgmap v14268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:02.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:01 smithi092 ceph-mon[29156]: pgmap v14268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:04.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:03 smithi189 ceph-mon[32756]: pgmap v14269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:04.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:03 smithi156 ceph-mon[32679]: pgmap v14269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:04.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:03 smithi092 ceph-mon[29156]: pgmap v14269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:05.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25899.779409 secs 2024-04-27T01:30:05.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25202.749037 secs 2024-04-27T01:30:05.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25899.779409 secs 2024-04-27T01:30:05.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25202.749037 secs 2024-04-27T01:30:05.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25899.779409 secs 2024-04-27T01:30:05.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25202.749037 secs 2024-04-27T01:30:06.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:05 smithi189 ceph-mon[32756]: pgmap v14270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:06.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:05 smithi156 ceph-mon[32679]: pgmap v14270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:06.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:05 smithi092 ceph-mon[29156]: pgmap v14270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:08.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:07 smithi189 ceph-mon[32756]: pgmap v14271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:08.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:07 smithi156 ceph-mon[32679]: pgmap v14271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:08.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:07 smithi092 ceph-mon[29156]: pgmap v14271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:10.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25904.779537 secs 2024-04-27T01:30:10.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:09 smithi189 ceph-mon[32756]: pgmap v14272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:10.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25207.749158 secs 2024-04-27T01:30:10.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25904.779537 secs 2024-04-27T01:30:10.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:09 smithi156 ceph-mon[32679]: pgmap v14272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:10.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25207.749158 secs 2024-04-27T01:30:10.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25904.779537 secs 2024-04-27T01:30:10.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:09 smithi092 ceph-mon[29156]: pgmap v14272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:10.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25207.749158 secs 2024-04-27T01:30:12.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:12 smithi156 ceph-mon[32679]: pgmap v14273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:12.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:12 smithi092 ceph-mon[29156]: pgmap v14273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:12.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:12 smithi189 ceph-mon[32756]: pgmap v14273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:14.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:14 smithi156 ceph-mon[32679]: pgmap v14274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:14.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25909.779674 secs 2024-04-27T01:30:14.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25212.749216 secs 2024-04-27T01:30:14.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:14 smithi092 ceph-mon[29156]: pgmap v14274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25909.779674 secs 2024-04-27T01:30:14.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25212.749216 secs 2024-04-27T01:30:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:14 smithi189 ceph-mon[32756]: pgmap v14274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25909.779674 secs 2024-04-27T01:30:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25212.749216 secs 2024-04-27T01:30:16.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:16 smithi156 ceph-mon[32679]: pgmap v14275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:16.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:16 smithi092 ceph-mon[29156]: pgmap v14275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:16.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:16 smithi189 ceph-mon[32756]: pgmap v14275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:18.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:18 smithi156 ceph-mon[32679]: pgmap v14276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:18.674 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:18 smithi189 ceph-mon[32756]: pgmap v14276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:18.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:18 smithi092 ceph-mon[29156]: pgmap v14276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:19.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25914.779800 secs 2024-04-27T01:30:19.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25217.749328 secs 2024-04-27T01:30:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25914.779800 secs 2024-04-27T01:30:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25217.749328 secs 2024-04-27T01:30:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25914.779800 secs 2024-04-27T01:30:19.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25217.749328 secs 2024-04-27T01:30:20.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:20 smithi092 ceph-mon[29156]: pgmap v14277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:20.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:20 smithi189 ceph-mon[32756]: pgmap v14277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:20.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:20 smithi156 ceph-mon[32679]: pgmap v14277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:22.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:22 smithi092 ceph-mon[29156]: pgmap v14278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:22.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:22 smithi189 ceph-mon[32756]: pgmap v14278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:22.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:22 smithi156 ceph-mon[32679]: pgmap v14278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:24 smithi092 ceph-mon[29156]: pgmap v14279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25919.779911 secs 2024-04-27T01:30:24.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25222.749444 secs 2024-04-27T01:30:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:24 smithi189 ceph-mon[32756]: pgmap v14279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25919.779911 secs 2024-04-27T01:30:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25222.749444 secs 2024-04-27T01:30:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:24 smithi156 ceph-mon[32679]: pgmap v14279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25919.779911 secs 2024-04-27T01:30:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25222.749444 secs 2024-04-27T01:30:26.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:26 smithi092 ceph-mon[29156]: pgmap v14280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:26 smithi189 ceph-mon[32756]: pgmap v14280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:26.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:26 smithi156 ceph-mon[32679]: pgmap v14280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:27.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:30:27.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:30:27.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:30:28.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: pgmap v14281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:30:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:30:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: pgmap v14282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:30:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: pgmap v14283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:30:28.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: pgmap v14281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: pgmap v14282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: pgmap v14283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:30:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: pgmap v14281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: pgmap v14282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: pgmap v14283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:30:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:30:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25924.780037 secs 2024-04-27T01:30:29.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25227.749553 secs 2024-04-27T01:30:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25924.780037 secs 2024-04-27T01:30:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25227.749553 secs 2024-04-27T01:30:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25924.780037 secs 2024-04-27T01:30:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25227.749553 secs 2024-04-27T01:30:30.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:30 smithi092 ceph-mon[29156]: pgmap v14284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:30 smithi189 ceph-mon[32756]: pgmap v14284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:30 smithi156 ceph-mon[32679]: pgmap v14284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:32.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:32 smithi189 ceph-mon[32756]: pgmap v14285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:32.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:32 smithi156 ceph-mon[32679]: pgmap v14285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:32.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:32 smithi092 ceph-mon[29156]: pgmap v14285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:34 smithi189 ceph-mon[32756]: pgmap v14286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:30:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25929.780162 secs 2024-04-27T01:30:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25232.749617 secs 2024-04-27T01:30:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:34 smithi156 ceph-mon[32679]: pgmap v14286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:30:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25929.780162 secs 2024-04-27T01:30:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25232.749617 secs 2024-04-27T01:30:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:34 smithi092 ceph-mon[29156]: pgmap v14286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T01:30:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25929.780162 secs 2024-04-27T01:30:34.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25232.749617 secs 2024-04-27T01:30:36.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:36 smithi189 ceph-mon[32756]: pgmap v14287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:36.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:36 smithi156 ceph-mon[32679]: pgmap v14287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:36.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:36 smithi092 ceph-mon[29156]: pgmap v14287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:30:38.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:38 smithi189 ceph-mon[32756]: pgmap v14288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:30:38.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:38 smithi156 ceph-mon[32679]: pgmap v14288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:30:38.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:38 smithi092 ceph-mon[29156]: pgmap v14288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:30:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:30:39.544+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:30:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:30:39.544+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:30:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:30:39.545+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:30:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:30:39.545+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 201 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:30:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25934.780307 secs 2024-04-27T01:30:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25237.749761 secs 2024-04-27T01:30:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25934.780307 secs 2024-04-27T01:30:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25237.749761 secs 2024-04-27T01:30:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25934.780307 secs 2024-04-27T01:30:39.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25237.749761 secs 2024-04-27T01:30:40.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:40 smithi189 ceph-mon[32756]: pgmap v14289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:40.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:40 smithi156 ceph-mon[32679]: pgmap v14289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:40 smithi092 ceph-mon[29156]: pgmap v14289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:42.860 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:42 smithi092 ceph-mon[29156]: pgmap v14290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:42.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:42 smithi189 ceph-mon[32756]: pgmap v14290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:42 smithi156 ceph-mon[32679]: pgmap v14290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:44 smithi189 ceph-mon[32756]: pgmap v14291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25939.780395 secs 2024-04-27T01:30:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25242.749880 secs 2024-04-27T01:30:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:44 smithi156 ceph-mon[32679]: pgmap v14291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25939.780395 secs 2024-04-27T01:30:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25242.749880 secs 2024-04-27T01:30:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:44 smithi092 ceph-mon[29156]: pgmap v14291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25939.780395 secs 2024-04-27T01:30:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25242.749880 secs 2024-04-27T01:30:46.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:46 smithi189 ceph-mon[32756]: pgmap v14292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:46.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:46 smithi156 ceph-mon[32679]: pgmap v14292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:46.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:46 smithi092 ceph-mon[29156]: pgmap v14292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:48.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:48 smithi189 ceph-mon[32756]: pgmap v14293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:48.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:48 smithi156 ceph-mon[32679]: pgmap v14293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:48.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:48 smithi092 ceph-mon[29156]: pgmap v14293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:49.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25944.780529 secs 2024-04-27T01:30:49.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25247.750000 secs 2024-04-27T01:30:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25944.780529 secs 2024-04-27T01:30:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25247.750000 secs 2024-04-27T01:30:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25944.780529 secs 2024-04-27T01:30:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25247.750000 secs 2024-04-27T01:30:50.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:50 smithi189 ceph-mon[32756]: pgmap v14294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:50.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:50 smithi156 ceph-mon[32679]: pgmap v14294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:50.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:50 smithi092 ceph-mon[29156]: pgmap v14294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:52.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:52 smithi189 ceph-mon[32756]: pgmap v14295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:52.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:52 smithi156 ceph-mon[32679]: pgmap v14295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:52.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:52 smithi092 ceph-mon[29156]: pgmap v14295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:54 smithi189 ceph-mon[32756]: pgmap v14296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25949.780668 secs 2024-04-27T01:30:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25252.750121 secs 2024-04-27T01:30:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:54 smithi156 ceph-mon[32679]: pgmap v14296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25949.780668 secs 2024-04-27T01:30:54.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25252.750121 secs 2024-04-27T01:30:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:54 smithi092 ceph-mon[29156]: pgmap v14296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:30:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25949.780668 secs 2024-04-27T01:30:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25252.750121 secs 2024-04-27T01:30:56.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:56 smithi189 ceph-mon[32756]: pgmap v14297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:56 smithi156 ceph-mon[32679]: pgmap v14297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:56.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:56 smithi092 ceph-mon[29156]: pgmap v14297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:58.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:58 smithi189 ceph-mon[32756]: pgmap v14298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:58.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:58 smithi156 ceph-mon[32679]: pgmap v14298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:58.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:58 smithi092 ceph-mon[29156]: pgmap v14298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:30:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25954.780819 secs 2024-04-27T01:30:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:30:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25257.750221 secs 2024-04-27T01:30:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25954.780819 secs 2024-04-27T01:30:59.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:30:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25257.750221 secs 2024-04-27T01:30:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25954.780819 secs 2024-04-27T01:30:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:30:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25257.750221 secs 2024-04-27T01:31:00.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:00 smithi189 ceph-mon[32756]: pgmap v14299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:00.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:00 smithi156 ceph-mon[32679]: pgmap v14299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:00.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:00 smithi092 ceph-mon[29156]: pgmap v14299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:02.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:02 smithi189 ceph-mon[32756]: pgmap v14300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:02.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:02 smithi156 ceph-mon[32679]: pgmap v14300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:02.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:02 smithi092 ceph-mon[29156]: pgmap v14300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:04 smithi189 ceph-mon[32756]: pgmap v14301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25959.780939 secs 2024-04-27T01:31:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25262.750360 secs 2024-04-27T01:31:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:04 smithi156 ceph-mon[32679]: pgmap v14301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25959.780939 secs 2024-04-27T01:31:04.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25262.750360 secs 2024-04-27T01:31:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:04 smithi092 ceph-mon[29156]: pgmap v14301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25959.780939 secs 2024-04-27T01:31:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25262.750360 secs 2024-04-27T01:31:06.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:06 smithi189 ceph-mon[32756]: pgmap v14302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:06.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:06 smithi156 ceph-mon[32679]: pgmap v14302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:06.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:06 smithi092 ceph-mon[29156]: pgmap v14302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:08.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:08 smithi156 ceph-mon[32679]: pgmap v14303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:08.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:08 smithi092 ceph-mon[29156]: pgmap v14303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:09.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:08 smithi189 ceph-mon[32756]: pgmap v14303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25964.781018 secs 2024-04-27T01:31:09.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25267.750401 secs 2024-04-27T01:31:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25964.781018 secs 2024-04-27T01:31:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25267.750401 secs 2024-04-27T01:31:10.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25964.781018 secs 2024-04-27T01:31:10.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25267.750401 secs 2024-04-27T01:31:10.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:10 smithi156 ceph-mon[32679]: pgmap v14304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:10.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:10 smithi092 ceph-mon[29156]: pgmap v14304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:11.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:10 smithi189 ceph-mon[32756]: pgmap v14304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:11.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:11 smithi156 ceph-mon[32679]: pgmap v14305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:11.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:11 smithi092 ceph-mon[29156]: pgmap v14305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:12.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:11 smithi189 ceph-mon[32756]: pgmap v14305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:14 smithi189 ceph-mon[32756]: pgmap v14306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25969.781095 secs 2024-04-27T01:31:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25272.750467 secs 2024-04-27T01:31:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:14 smithi156 ceph-mon[32679]: pgmap v14306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25969.781095 secs 2024-04-27T01:31:14.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25272.750467 secs 2024-04-27T01:31:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:14 smithi092 ceph-mon[29156]: pgmap v14306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25969.781095 secs 2024-04-27T01:31:14.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25272.750467 secs 2024-04-27T01:31:16.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:16 smithi189 ceph-mon[32756]: pgmap v14307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:16.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:16 smithi156 ceph-mon[32679]: pgmap v14307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:16.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:16 smithi092 ceph-mon[29156]: pgmap v14307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:18.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:18 smithi189 ceph-mon[32756]: pgmap v14308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:18.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:18 smithi156 ceph-mon[32679]: pgmap v14308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:18.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:18 smithi092 ceph-mon[29156]: pgmap v14308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:19.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25974.781212 secs 2024-04-27T01:31:19.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25277.750560 secs 2024-04-27T01:31:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25974.781212 secs 2024-04-27T01:31:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25277.750560 secs 2024-04-27T01:31:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25974.781212 secs 2024-04-27T01:31:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25277.750560 secs 2024-04-27T01:31:20.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:20 smithi189 ceph-mon[32756]: pgmap v14309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:20.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:20 smithi156 ceph-mon[32679]: pgmap v14309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:20.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:20 smithi092 ceph-mon[29156]: pgmap v14309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:22.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:22 smithi189 ceph-mon[32756]: pgmap v14310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:22.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:22 smithi156 ceph-mon[32679]: pgmap v14310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:22.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:22 smithi092 ceph-mon[29156]: pgmap v14310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:24 smithi189 ceph-mon[32756]: pgmap v14311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25979.781305 secs 2024-04-27T01:31:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25282.750638 secs 2024-04-27T01:31:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:24 smithi156 ceph-mon[32679]: pgmap v14311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25979.781305 secs 2024-04-27T01:31:24.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25282.750638 secs 2024-04-27T01:31:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:24 smithi092 ceph-mon[29156]: pgmap v14311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25979.781305 secs 2024-04-27T01:31:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25282.750638 secs 2024-04-27T01:31:26.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:26 smithi189 ceph-mon[32756]: pgmap v14312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:26.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:26 smithi156 ceph-mon[32679]: pgmap v14312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:26.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:26 smithi092 ceph-mon[29156]: pgmap v14312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:28 smithi189 ceph-mon[32756]: pgmap v14313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:31:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:31:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:31:28.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:31:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:28 smithi156 ceph-mon[32679]: pgmap v14313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:31:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:31:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:31:28.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:28 smithi092 ceph-mon[29156]: pgmap v14313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:31:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:29 smithi189 ceph-mon[32756]: pgmap v14314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:29 smithi189 ceph-mon[32756]: pgmap v14315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25984.781401 secs 2024-04-27T01:31:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25287.750759 secs 2024-04-27T01:31:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:29 smithi156 ceph-mon[32679]: pgmap v14314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:29 smithi156 ceph-mon[32679]: pgmap v14315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25984.781401 secs 2024-04-27T01:31:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25287.750759 secs 2024-04-27T01:31:29.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:29 smithi092 ceph-mon[29156]: pgmap v14314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:29.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:29 smithi092 ceph-mon[29156]: pgmap v14315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:29.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25984.781401 secs 2024-04-27T01:31:29.965 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25287.750759 secs 2024-04-27T01:31:31.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:31 smithi189 ceph-mon[32756]: pgmap v14316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:31:31.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:31 smithi156 ceph-mon[32679]: pgmap v14316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:31:31.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:31 smithi092 ceph-mon[29156]: pgmap v14316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:31:33.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:33 smithi189 ceph-mon[32756]: pgmap v14317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:33.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:33 smithi156 ceph-mon[32679]: pgmap v14317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:33.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:33 smithi092 ceph-mon[29156]: pgmap v14317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:31:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25989.781513 secs 2024-04-27T01:31:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25292.750880 secs 2024-04-27T01:31:34.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25989.781513 secs 2024-04-27T01:31:34.879 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25292.750880 secs 2024-04-27T01:31:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25989.781513 secs 2024-04-27T01:31:34.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25292.750880 secs 2024-04-27T01:31:35.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:35 smithi189 ceph-mon[32756]: pgmap v14318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:35.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:35 smithi156 ceph-mon[32679]: pgmap v14318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:35.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:35 smithi092 ceph-mon[29156]: pgmap v14318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:37.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:37 smithi189 ceph-mon[32756]: pgmap v14319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:37.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:37 smithi156 ceph-mon[32679]: pgmap v14319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:37.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:37 smithi092 ceph-mon[29156]: pgmap v14319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:31:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:39 smithi189 ceph-mon[32756]: pgmap v14320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25994.781655 secs 2024-04-27T01:31:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25297.751001 secs 2024-04-27T01:31:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:39 smithi156 ceph-mon[32679]: pgmap v14320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25994.781655 secs 2024-04-27T01:31:39.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25297.751001 secs 2024-04-27T01:31:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:39 smithi092 ceph-mon[29156]: pgmap v14320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:31:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25994.781655 secs 2024-04-27T01:31:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25297.751001 secs 2024-04-27T01:31:41.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:41 smithi189 ceph-mon[32756]: pgmap v14321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:41 smithi156 ceph-mon[32679]: pgmap v14321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:41.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:41 smithi092 ceph-mon[29156]: pgmap v14321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:43.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:43 smithi189 ceph-mon[32756]: pgmap v14322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:31:43.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:43 smithi156 ceph-mon[32679]: pgmap v14322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:31:43.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:43 smithi092 ceph-mon[29156]: pgmap v14322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:31:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 25999.781726 secs 2024-04-27T01:31:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25302.751138 secs 2024-04-27T01:31:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 25999.781726 secs 2024-04-27T01:31:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25302.751138 secs 2024-04-27T01:31:45.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 25999.781726 secs 2024-04-27T01:31:45.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25302.751138 secs 2024-04-27T01:31:45.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:45 smithi156 ceph-mon[32679]: pgmap v14323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:45.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:45 smithi092 ceph-mon[29156]: pgmap v14323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:46.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:45 smithi189 ceph-mon[32756]: pgmap v14323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:31:47.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:47 smithi156 ceph-mon[32679]: pgmap v14324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:47.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:47 smithi092 ceph-mon[29156]: pgmap v14324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:48.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:47 smithi189 ceph-mon[32756]: pgmap v14324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:49 smithi156 ceph-mon[32679]: pgmap v14325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26004.781797 secs 2024-04-27T01:31:49.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25307.751228 secs 2024-04-27T01:31:49.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:49 smithi189 ceph-mon[32756]: pgmap v14325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:49.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26004.781797 secs 2024-04-27T01:31:49.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25307.751228 secs 2024-04-27T01:31:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:49 smithi092 ceph-mon[29156]: pgmap v14325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26004.781797 secs 2024-04-27T01:31:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25307.751228 secs 2024-04-27T01:31:51.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:51 smithi156 ceph-mon[32679]: pgmap v14326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:51.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:51 smithi092 ceph-mon[29156]: pgmap v14326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:52.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:51 smithi189 ceph-mon[32756]: pgmap v14326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:52.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:52 smithi092 ceph-mon[29156]: pgmap v14327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:53.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:52 smithi189 ceph-mon[32756]: pgmap v14327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:53.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:52 smithi156 ceph-mon[32679]: pgmap v14327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:54.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25312.751342 secs 2024-04-27T01:31:54.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25312.751342 secs 2024-04-27T01:31:54.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25312.751342 secs 2024-04-27T01:31:55.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26009.781908 secs 2024-04-27T01:31:55.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:55 smithi156 ceph-mon[32679]: pgmap v14328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:55.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26009.781908 secs 2024-04-27T01:31:55.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:55 smithi092 ceph-mon[29156]: pgmap v14328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:55.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26009.781908 secs 2024-04-27T01:31:55.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:55 smithi189 ceph-mon[32756]: pgmap v14328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:31:57.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:57 smithi189 ceph-mon[32756]: pgmap v14329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:57.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:57 smithi156 ceph-mon[32679]: pgmap v14329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:57.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:57 smithi092 ceph-mon[29156]: pgmap v14329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:59.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:59 smithi189 ceph-mon[32756]: pgmap v14330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:59.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26014.782061 secs 2024-04-27T01:31:59.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:31:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25317.751475 secs 2024-04-27T01:31:59.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:59 smithi156 ceph-mon[32679]: pgmap v14330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:59.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26014.782061 secs 2024-04-27T01:31:59.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:31:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25317.751475 secs 2024-04-27T01:31:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:59 smithi092 ceph-mon[29156]: pgmap v14330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:31:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26014.782061 secs 2024-04-27T01:31:59.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:31:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25317.751475 secs 2024-04-27T01:32:01.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:01 smithi189 ceph-mon[32756]: pgmap v14331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:01.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:01 smithi156 ceph-mon[32679]: pgmap v14331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:01.708 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:01 smithi092 ceph-mon[29156]: pgmap v14331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:03.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:03 smithi189 ceph-mon[32756]: pgmap v14332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:03.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:03 smithi156 ceph-mon[32679]: pgmap v14332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:03.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:03 smithi092 ceph-mon[29156]: pgmap v14332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:04.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26019.782185 secs 2024-04-27T01:32:04.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25322.751594 secs 2024-04-27T01:32:04.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26019.782185 secs 2024-04-27T01:32:04.628 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25322.751594 secs 2024-04-27T01:32:04.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26019.782185 secs 2024-04-27T01:32:04.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25322.751594 secs 2024-04-27T01:32:05.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:05 smithi189 ceph-mon[32756]: pgmap v14333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:05.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:05 smithi156 ceph-mon[32679]: pgmap v14333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:05.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:05 smithi092 ceph-mon[29156]: pgmap v14333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:07.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:07 smithi189 ceph-mon[32756]: pgmap v14334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:07.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:07 smithi156 ceph-mon[32679]: pgmap v14334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:07.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-mon[29156]: pgmap v14334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:07.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:32:07.738+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:32:07.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:32:07.738+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:32:07.977 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:32:07.738+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:32:07.978 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:32:07.738+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:32:07.978 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:32:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:32:07.738+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:32:09.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:09 smithi189 ceph-mon[32756]: pgmap v14335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:09.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26024.782299 secs 2024-04-27T01:32:09.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25327.751679 secs 2024-04-27T01:32:09.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:09 smithi156 ceph-mon[32679]: pgmap v14335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:09.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26024.782299 secs 2024-04-27T01:32:09.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25327.751679 secs 2024-04-27T01:32:09.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:09 smithi092 ceph-mon[29156]: pgmap v14335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:09.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26024.782299 secs 2024-04-27T01:32:09.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25327.751679 secs 2024-04-27T01:32:11.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:11 smithi189 ceph-mon[32756]: pgmap v14336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:11.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:11 smithi156 ceph-mon[32679]: pgmap v14336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:11.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:11 smithi092 ceph-mon[29156]: pgmap v14336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:13.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:13 smithi189 ceph-mon[32756]: pgmap v14337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:13.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:13 smithi156 ceph-mon[32679]: pgmap v14337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:13.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:13 smithi092 ceph-mon[29156]: pgmap v14337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:14.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26029.782434 secs 2024-04-27T01:32:14.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25332.751803 secs 2024-04-27T01:32:14.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26029.782434 secs 2024-04-27T01:32:14.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25332.751803 secs 2024-04-27T01:32:14.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26029.782434 secs 2024-04-27T01:32:14.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25332.751803 secs 2024-04-27T01:32:15.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:15 smithi189 ceph-mon[32756]: pgmap v14338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:15.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:15 smithi156 ceph-mon[32679]: pgmap v14338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:15.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:15 smithi092 ceph-mon[29156]: pgmap v14338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:17.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:17 smithi092 ceph-mon[29156]: pgmap v14339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:17.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:17 smithi189 ceph-mon[32756]: pgmap v14339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:17.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:17 smithi156 ceph-mon[32679]: pgmap v14339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:19.719 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:19 smithi156 ceph-mon[32679]: pgmap v14340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:19.719 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26034.782549 secs 2024-04-27T01:32:19.719 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25337.751924 secs 2024-04-27T01:32:19.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:19 smithi092 ceph-mon[29156]: pgmap v14340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:19.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26034.782549 secs 2024-04-27T01:32:19.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25337.751924 secs 2024-04-27T01:32:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:19 smithi189 ceph-mon[32756]: pgmap v14340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:32:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26034.782549 secs 2024-04-27T01:32:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25337.751924 secs 2024-04-27T01:32:21.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:21 smithi092 ceph-mon[29156]: pgmap v14341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:21.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:21 smithi189 ceph-mon[32756]: pgmap v14341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:21.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:21 smithi156 ceph-mon[32679]: pgmap v14341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:32:23.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:23 smithi092 ceph-mon[29156]: pgmap v14342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:23.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:23 smithi189 ceph-mon[32756]: pgmap v14342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:23.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:23 smithi156 ceph-mon[32679]: pgmap v14342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:24.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26039.782671 secs 2024-04-27T01:32:24.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25342.752051 secs 2024-04-27T01:32:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26039.782671 secs 2024-04-27T01:32:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25342.752051 secs 2024-04-27T01:32:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26039.782671 secs 2024-04-27T01:32:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25342.752051 secs 2024-04-27T01:32:25.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:25 smithi092 ceph-mon[29156]: pgmap v14343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:25.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:25 smithi189 ceph-mon[32756]: pgmap v14343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:25.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:25 smithi156 ceph-mon[32679]: pgmap v14343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:27.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:27 smithi092 ceph-mon[29156]: pgmap v14344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:27.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:27 smithi189 ceph-mon[32756]: pgmap v14344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:27.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:27 smithi156 ceph-mon[32679]: pgmap v14344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:28.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:32:28.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:32:28.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: pgmap v14345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26044.782762 secs 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25347.752119 secs 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:32:29.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: pgmap v14345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26044.782762 secs 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25347.752119 secs 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:32:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:32:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: pgmap v14345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26044.782762 secs 2024-04-27T01:32:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25347.752119 secs 2024-04-27T01:32:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:32:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:32:29.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:32:30.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:30 smithi092 ceph-mon[29156]: pgmap v14346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:32:30.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:30 smithi092 ceph-mon[29156]: pgmap v14347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:30.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:30 smithi189 ceph-mon[32756]: pgmap v14346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:32:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:30 smithi189 ceph-mon[32756]: pgmap v14347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:30 smithi156 ceph-mon[32679]: pgmap v14346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:32:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:30 smithi156 ceph-mon[32679]: pgmap v14347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:32.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:32 smithi092 ceph-mon[29156]: pgmap v14348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:32.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:32 smithi189 ceph-mon[32756]: pgmap v14348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:32.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:32 smithi156 ceph-mon[32679]: pgmap v14348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:32:34.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:34 smithi092 ceph-mon[29156]: pgmap v14349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:32:34.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26049.782871 secs 2024-04-27T01:32:34.728 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25352.752248 secs 2024-04-27T01:32:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:34 smithi189 ceph-mon[32756]: pgmap v14349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:32:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26049.782871 secs 2024-04-27T01:32:34.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25352.752248 secs 2024-04-27T01:32:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:34 smithi156 ceph-mon[32679]: pgmap v14349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:32:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26049.782871 secs 2024-04-27T01:32:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25352.752248 secs 2024-04-27T01:32:36.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:36 smithi092 ceph-mon[29156]: pgmap v14350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:36.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:36 smithi189 ceph-mon[32756]: pgmap v14350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:36.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:36 smithi156 ceph-mon[32679]: pgmap v14350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:38.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:38 smithi092 ceph-mon[29156]: pgmap v14351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:38.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:38 smithi189 ceph-mon[32756]: pgmap v14351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:38.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:38 smithi156 ceph-mon[32679]: pgmap v14351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:32:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26054.782980 secs 2024-04-27T01:32:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25357.752377 secs 2024-04-27T01:32:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26054.782980 secs 2024-04-27T01:32:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25357.752377 secs 2024-04-27T01:32:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26054.782980 secs 2024-04-27T01:32:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25357.752377 secs 2024-04-27T01:32:40.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:40 smithi189 ceph-mon[32756]: pgmap v14352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:32:40.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:40 smithi156 ceph-mon[32679]: pgmap v14352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:32:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:40 smithi092 ceph-mon[29156]: pgmap v14352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:32:42.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:42 smithi189 ceph-mon[32756]: pgmap v14353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:42 smithi156 ceph-mon[32679]: pgmap v14353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:42 smithi092 ceph-mon[29156]: pgmap v14353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:44 smithi189 ceph-mon[32756]: pgmap v14354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26059.783109 secs 2024-04-27T01:32:44.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25362.752489 secs 2024-04-27T01:32:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:44 smithi156 ceph-mon[32679]: pgmap v14354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26059.783109 secs 2024-04-27T01:32:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25362.752489 secs 2024-04-27T01:32:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:44 smithi092 ceph-mon[29156]: pgmap v14354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:32:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26059.783109 secs 2024-04-27T01:32:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25362.752489 secs 2024-04-27T01:32:46.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:46 smithi189 ceph-mon[32756]: pgmap v14355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:32:46.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:46 smithi156 ceph-mon[32679]: pgmap v14355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:32:46.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:46 smithi092 ceph-mon[29156]: pgmap v14355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:32:48.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:48 smithi189 ceph-mon[32756]: pgmap v14356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:48.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:48 smithi156 ceph-mon[32679]: pgmap v14356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:48.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:48 smithi092 ceph-mon[29156]: pgmap v14356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:49.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26064.783226 secs 2024-04-27T01:32:49.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25367.752627 secs 2024-04-27T01:32:49.818 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26064.783226 secs 2024-04-27T01:32:49.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25367.752627 secs 2024-04-27T01:32:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26064.783226 secs 2024-04-27T01:32:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25367.752627 secs 2024-04-27T01:32:50.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:50 smithi189 ceph-mon[32756]: pgmap v14357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:50.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:50 smithi156 ceph-mon[32679]: pgmap v14357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:50.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:50 smithi092 ceph-mon[29156]: pgmap v14357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:52.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:52 smithi189 ceph-mon[32756]: pgmap v14358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:52.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:52 smithi156 ceph-mon[32679]: pgmap v14358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:52.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:52 smithi092 ceph-mon[29156]: pgmap v14358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:54 smithi189 ceph-mon[32756]: pgmap v14359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26069.783297 secs 2024-04-27T01:32:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25372.752736 secs 2024-04-27T01:32:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:54 smithi156 ceph-mon[32679]: pgmap v14359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26069.783297 secs 2024-04-27T01:32:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25372.752736 secs 2024-04-27T01:32:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:54 smithi092 ceph-mon[29156]: pgmap v14359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26069.783297 secs 2024-04-27T01:32:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25372.752736 secs 2024-04-27T01:32:56.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:56 smithi189 ceph-mon[32756]: pgmap v14360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:56 smithi156 ceph-mon[32679]: pgmap v14360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:56.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:56 smithi092 ceph-mon[29156]: pgmap v14360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:32:58.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:58 smithi189 ceph-mon[32756]: pgmap v14361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:58.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:58 smithi156 ceph-mon[32679]: pgmap v14361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:58.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:58 smithi092 ceph-mon[29156]: pgmap v14361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:32:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26074.783420 secs 2024-04-27T01:32:59.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:32:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25377.752900 secs 2024-04-27T01:32:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26074.783420 secs 2024-04-27T01:32:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:32:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25377.752900 secs 2024-04-27T01:32:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26074.783420 secs 2024-04-27T01:32:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:32:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25377.752900 secs 2024-04-27T01:33:00.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:00 smithi189 ceph-mon[32756]: pgmap v14362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:00.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:00 smithi156 ceph-mon[32679]: pgmap v14362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:00.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:00 smithi092 ceph-mon[29156]: pgmap v14362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:02.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:02 smithi189 ceph-mon[32756]: pgmap v14363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:02.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:02 smithi156 ceph-mon[32679]: pgmap v14363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:02.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:02 smithi092 ceph-mon[29156]: pgmap v14363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:04 smithi189 ceph-mon[32756]: pgmap v14364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26079.783536 secs 2024-04-27T01:33:04.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25382.753037 secs 2024-04-27T01:33:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:04 smithi092 ceph-mon[29156]: pgmap v14364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26079.783536 secs 2024-04-27T01:33:04.880 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25382.753037 secs 2024-04-27T01:33:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:04 smithi156 ceph-mon[32679]: pgmap v14364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26079.783536 secs 2024-04-27T01:33:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25382.753037 secs 2024-04-27T01:33:06.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:06 smithi189 ceph-mon[32756]: pgmap v14365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:06.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:06 smithi156 ceph-mon[32679]: pgmap v14365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:06.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:06 smithi092 ceph-mon[29156]: pgmap v14365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:08.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:08 smithi189 ceph-mon[32756]: pgmap v14366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:08.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:08 smithi156 ceph-mon[32679]: pgmap v14366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:08.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:08 smithi092 ceph-mon[29156]: pgmap v14366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26084.783637 secs 2024-04-27T01:33:09.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25387.753170 secs 2024-04-27T01:33:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26084.783637 secs 2024-04-27T01:33:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25387.753170 secs 2024-04-27T01:33:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26084.783637 secs 2024-04-27T01:33:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25387.753170 secs 2024-04-27T01:33:10.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:10 smithi189 ceph-mon[32756]: pgmap v14367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:10.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:10 smithi156 ceph-mon[32679]: pgmap v14367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:10.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:10 smithi092 ceph-mon[29156]: pgmap v14367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:12.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:12 smithi189 ceph-mon[32756]: pgmap v14368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:12.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:12 smithi156 ceph-mon[32679]: pgmap v14368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:12.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:12 smithi092 ceph-mon[29156]: pgmap v14368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:14 smithi189 ceph-mon[32756]: pgmap v14369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26089.783773 secs 2024-04-27T01:33:14.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25392.753284 secs 2024-04-27T01:33:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:14 smithi156 ceph-mon[32679]: pgmap v14369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26089.783773 secs 2024-04-27T01:33:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25392.753284 secs 2024-04-27T01:33:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:14 smithi092 ceph-mon[29156]: pgmap v14369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:33:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26089.783773 secs 2024-04-27T01:33:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25392.753284 secs 2024-04-27T01:33:16.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:16 smithi189 ceph-mon[32756]: pgmap v14370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:16.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:16 smithi156 ceph-mon[32679]: pgmap v14370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:16.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:16 smithi092 ceph-mon[29156]: pgmap v14370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:33:18.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:18 smithi189 ceph-mon[32756]: pgmap v14371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:18.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:18 smithi156 ceph-mon[32679]: pgmap v14371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:18.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:18 smithi092 ceph-mon[29156]: pgmap v14371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:19.818 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26094.783909 secs 2024-04-27T01:33:19.819 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25397.753402 secs 2024-04-27T01:33:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26094.783909 secs 2024-04-27T01:33:19.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25397.753402 secs 2024-04-27T01:33:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26094.783909 secs 2024-04-27T01:33:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25397.753402 secs 2024-04-27T01:33:20.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:20 smithi189 ceph-mon[32756]: pgmap v14372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:20.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:20 smithi156 ceph-mon[32679]: pgmap v14372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:20.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:20 smithi092 ceph-mon[29156]: pgmap v14372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:22.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:22 smithi189 ceph-mon[32756]: pgmap v14373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:22.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:22 smithi156 ceph-mon[32679]: pgmap v14373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:22.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:22 smithi092 ceph-mon[29156]: pgmap v14373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:24 smithi189 ceph-mon[32756]: pgmap v14374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26099.784042 secs 2024-04-27T01:33:24.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25402.753536 secs 2024-04-27T01:33:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:24 smithi156 ceph-mon[32679]: pgmap v14374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26099.784042 secs 2024-04-27T01:33:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25402.753536 secs 2024-04-27T01:33:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:24 smithi092 ceph-mon[29156]: pgmap v14374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26099.784042 secs 2024-04-27T01:33:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25402.753536 secs 2024-04-27T01:33:26.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:26 smithi189 ceph-mon[32756]: pgmap v14375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:26.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:26 smithi156 ceph-mon[32679]: pgmap v14375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:26.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:26 smithi092 ceph-mon[29156]: pgmap v14375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:28.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:28 smithi189 ceph-mon[32756]: pgmap v14376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:28.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:28 smithi156 ceph-mon[32679]: pgmap v14376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:28.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:28 smithi092 ceph-mon[29156]: pgmap v14376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26104.784172 secs 2024-04-27T01:33:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25407.753679 secs 2024-04-27T01:33:29.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:33:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26104.784172 secs 2024-04-27T01:33:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25407.753679 secs 2024-04-27T01:33:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:33:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26104.784172 secs 2024-04-27T01:33:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25407.753679 secs 2024-04-27T01:33:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:33:30.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:30 smithi189 ceph-mon[32756]: pgmap v14377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:33:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:33:30.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:33:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:30 smithi156 ceph-mon[32679]: pgmap v14377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:33:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:33:30.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:33:30.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:30 smithi092 ceph-mon[29156]: pgmap v14377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:30.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:33:30.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:33:30.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:33:31.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:31 smithi189 ceph-mon[32756]: pgmap v14378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:33:31.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:31 smithi189 ceph-mon[32756]: pgmap v14379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:31.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:31 smithi156 ceph-mon[32679]: pgmap v14378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:33:31.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:31 smithi156 ceph-mon[32679]: pgmap v14379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:31.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:31 smithi092 ceph-mon[29156]: pgmap v14378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:33:31.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:31 smithi092 ceph-mon[29156]: pgmap v14379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:33.868 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:33 smithi092 ceph-mon[29156]: pgmap v14380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:33.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:33 smithi189 ceph-mon[32756]: pgmap v14380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:33.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:33 smithi156 ceph-mon[32679]: pgmap v14380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26109.784292 secs 2024-04-27T01:33:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25412.753758 secs 2024-04-27T01:33:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26109.784292 secs 2024-04-27T01:33:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25412.753758 secs 2024-04-27T01:33:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26109.784292 secs 2024-04-27T01:33:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25412.753758 secs 2024-04-27T01:33:35.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:35 smithi189 ceph-mon[32756]: pgmap v14381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:35.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:35 smithi156 ceph-mon[32679]: pgmap v14381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:35.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:35 smithi092 ceph-mon[29156]: pgmap v14381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80d7000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049590 tx=0x7f1ca80d7000 comp rx=0 tx=0).stop 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.030+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:33:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.031+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803de10 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T01:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.069+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T01:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.069+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T01:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.069+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.069+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=27 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T01:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.069+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.070+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T01:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:36.070+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T01:33:37.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:37 smithi189 ceph-mon[32756]: pgmap v14382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:37.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:37 smithi156 ceph-mon[32679]: pgmap v14382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:37.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:37 smithi092 ceph-mon[29156]: pgmap v14382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:33:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:39.568+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:33:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:39.568+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:33:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:39.568+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:33:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:33:39.568+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 202 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:33:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:39 smithi189 ceph-mon[32756]: pgmap v14383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:33:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26114.784430 secs 2024-04-27T01:33:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:39 smithi189 ceph-mon[32756]: slow request 721.127200 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:33:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25417.753885 secs 2024-04-27T01:33:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:39 smithi156 ceph-mon[32679]: pgmap v14383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:33:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26114.784430 secs 2024-04-27T01:33:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:39 smithi156 ceph-mon[32679]: slow request 721.127200 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:33:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25417.753885 secs 2024-04-27T01:33:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:39 smithi092 ceph-mon[29156]: pgmap v14383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:33:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26114.784430 secs 2024-04-27T01:33:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:39 smithi092 ceph-mon[29156]: slow request 721.127200 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:33:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25417.753885 secs 2024-04-27T01:33:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:41 smithi189 ceph-mon[32756]: pgmap v14384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:33:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:41 smithi156 ceph-mon[32679]: pgmap v14384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:33:41.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:41 smithi092 ceph-mon[29156]: pgmap v14384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:33:43.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:43 smithi156 ceph-mon[32679]: pgmap v14385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:43.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:43 smithi092 ceph-mon[29156]: pgmap v14385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:44.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:43 smithi189 ceph-mon[32756]: pgmap v14385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26119.784550 secs 2024-04-27T01:33:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25422.754014 secs 2024-04-27T01:33:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26119.784550 secs 2024-04-27T01:33:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25422.754014 secs 2024-04-27T01:33:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26119.784550 secs 2024-04-27T01:33:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25422.754014 secs 2024-04-27T01:33:45.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:45 smithi156 ceph-mon[32679]: pgmap v14386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:45.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:45 smithi092 ceph-mon[29156]: pgmap v14386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:46.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:45 smithi189 ceph-mon[32756]: pgmap v14386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:47.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:47 smithi156 ceph-mon[32679]: pgmap v14387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:47.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:47 smithi092 ceph-mon[29156]: pgmap v14387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:48.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:47 smithi189 ceph-mon[32756]: pgmap v14387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:49 smithi156 ceph-mon[32679]: pgmap v14388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26124.784669 secs 2024-04-27T01:33:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25427.754147 secs 2024-04-27T01:33:49.923 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:49 smithi189 ceph-mon[32756]: pgmap v14388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:49.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26124.784669 secs 2024-04-27T01:33:49.924 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25427.754147 secs 2024-04-27T01:33:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:49 smithi092 ceph-mon[29156]: pgmap v14388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26124.784669 secs 2024-04-27T01:33:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25427.754147 secs 2024-04-27T01:33:51.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:51 smithi156 ceph-mon[32679]: pgmap v14389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:51.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:51 smithi092 ceph-mon[29156]: pgmap v14389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:52.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:51 smithi189 ceph-mon[32756]: pgmap v14389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:53.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:53 smithi156 ceph-mon[32679]: pgmap v14390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:53.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:53 smithi092 ceph-mon[29156]: pgmap v14390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:54.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:53 smithi189 ceph-mon[32756]: pgmap v14390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26129.784786 secs 2024-04-27T01:33:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25432.754290 secs 2024-04-27T01:33:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26129.784786 secs 2024-04-27T01:33:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25432.754290 secs 2024-04-27T01:33:55.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26129.784786 secs 2024-04-27T01:33:55.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25432.754290 secs 2024-04-27T01:33:55.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:55 smithi156 ceph-mon[32679]: pgmap v14391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:55.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:55 smithi092 ceph-mon[29156]: pgmap v14391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:56.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:55 smithi189 ceph-mon[32756]: pgmap v14391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:33:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:56 smithi156 ceph-mon[32679]: pgmap v14392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:56.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:56 smithi092 ceph-mon[29156]: pgmap v14392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:57.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:56 smithi189 ceph-mon[32756]: pgmap v14392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:59.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:58 smithi156 ceph-mon[32679]: pgmap v14393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:59.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:58 smithi092 ceph-mon[29156]: pgmap v14393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:33:59.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:58 smithi189 ceph-mon[32756]: pgmap v14393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:00.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26134.784910 secs 2024-04-27T01:34:00.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:33:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25437.754378 secs 2024-04-27T01:34:00.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26134.784910 secs 2024-04-27T01:34:00.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:33:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25437.754378 secs 2024-04-27T01:34:00.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26134.784910 secs 2024-04-27T01:34:00.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:33:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25437.754378 secs 2024-04-27T01:34:01.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:00 smithi156 ceph-mon[32679]: pgmap v14394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:01.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:00 smithi092 ceph-mon[29156]: pgmap v14394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:01.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:00 smithi189 ceph-mon[32756]: pgmap v14394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:03.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:02 smithi156 ceph-mon[32679]: pgmap v14395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:03.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:02 smithi092 ceph-mon[29156]: pgmap v14395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:03.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:02 smithi189 ceph-mon[32756]: pgmap v14395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:05.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26139.784996 secs 2024-04-27T01:34:05.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:04 smithi156 ceph-mon[32679]: pgmap v14396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:05.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25442.754501 secs 2024-04-27T01:34:05.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26139.784996 secs 2024-04-27T01:34:05.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:04 smithi092 ceph-mon[29156]: pgmap v14396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:05.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25442.754501 secs 2024-04-27T01:34:05.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26139.784996 secs 2024-04-27T01:34:05.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:04 smithi189 ceph-mon[32756]: pgmap v14396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:05.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25442.754501 secs 2024-04-27T01:34:07.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:06 smithi156 ceph-mon[32679]: pgmap v14397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:07.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:06 smithi092 ceph-mon[29156]: pgmap v14397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:07.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:06 smithi189 ceph-mon[32756]: pgmap v14397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:09.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:08 smithi156 ceph-mon[32679]: pgmap v14398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:09.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:08 smithi092 ceph-mon[29156]: pgmap v14398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:09.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:08 smithi189 ceph-mon[32756]: pgmap v14398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:10.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26144.785089 secs 2024-04-27T01:34:10.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25447.754581 secs 2024-04-27T01:34:10.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26144.785089 secs 2024-04-27T01:34:10.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25447.754581 secs 2024-04-27T01:34:10.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26144.785089 secs 2024-04-27T01:34:10.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25447.754581 secs 2024-04-27T01:34:11.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:10 smithi092 ceph-mon[29156]: pgmap v14399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:11.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:10 smithi189 ceph-mon[32756]: pgmap v14399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:11.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:10 smithi156 ceph-mon[32679]: pgmap v14399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:13.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:12 smithi092 ceph-mon[29156]: pgmap v14400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:13.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:12 smithi189 ceph-mon[32756]: pgmap v14400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:13.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:12 smithi156 ceph-mon[32679]: pgmap v14400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:15.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26149.785234 secs 2024-04-27T01:34:15.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:14 smithi092 ceph-mon[29156]: pgmap v14401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:15.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25452.754681 secs 2024-04-27T01:34:15.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26149.785234 secs 2024-04-27T01:34:15.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:14 smithi189 ceph-mon[32756]: pgmap v14401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:15.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25452.754681 secs 2024-04-27T01:34:15.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26149.785234 secs 2024-04-27T01:34:15.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:14 smithi156 ceph-mon[32679]: pgmap v14401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:15.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25452.754681 secs 2024-04-27T01:34:17.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:16 smithi092 ceph-mon[29156]: pgmap v14402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:17.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:16 smithi189 ceph-mon[32756]: pgmap v14402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:17.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:16 smithi156 ceph-mon[32679]: pgmap v14402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:19.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:18 smithi156 ceph-mon[32679]: pgmap v14403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:19.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:18 smithi092 ceph-mon[29156]: pgmap v14403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:19.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:18 smithi189 ceph-mon[32756]: pgmap v14403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:20.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26154.785374 secs 2024-04-27T01:34:20.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25457.754834 secs 2024-04-27T01:34:20.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26154.785374 secs 2024-04-27T01:34:20.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25457.754834 secs 2024-04-27T01:34:20.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26154.785374 secs 2024-04-27T01:34:20.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25457.754834 secs 2024-04-27T01:34:21.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:20 smithi092 ceph-mon[29156]: pgmap v14404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:21.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:20 smithi189 ceph-mon[32756]: pgmap v14404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:21.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:20 smithi156 ceph-mon[32679]: pgmap v14404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:23.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:22 smithi092 ceph-mon[29156]: pgmap v14405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:23.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:22 smithi189 ceph-mon[32756]: pgmap v14405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:23.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:22 smithi156 ceph-mon[32679]: pgmap v14405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:25.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26159.785509 secs 2024-04-27T01:34:25.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:24 smithi092 ceph-mon[29156]: pgmap v14406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:25.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25462.754938 secs 2024-04-27T01:34:25.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26159.785509 secs 2024-04-27T01:34:25.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:24 smithi189 ceph-mon[32756]: pgmap v14406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:25.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25462.754938 secs 2024-04-27T01:34:25.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26159.785509 secs 2024-04-27T01:34:25.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:24 smithi156 ceph-mon[32679]: pgmap v14406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:25.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25462.754938 secs 2024-04-27T01:34:27.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:26 smithi092 ceph-mon[29156]: pgmap v14407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:27.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:26 smithi189 ceph-mon[32756]: pgmap v14407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:27.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:26 smithi156 ceph-mon[32679]: pgmap v14407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:29.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:28 smithi092 ceph-mon[29156]: pgmap v14408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:29.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:28 smithi189 ceph-mon[32756]: pgmap v14408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:29.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:28 smithi156 ceph-mon[32679]: pgmap v14408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26164.785644 secs 2024-04-27T01:34:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25467.755070 secs 2024-04-27T01:34:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:34:30.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26164.785644 secs 2024-04-27T01:34:30.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25467.755070 secs 2024-04-27T01:34:30.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:34:30.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26164.785644 secs 2024-04-27T01:34:30.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25467.755070 secs 2024-04-27T01:34:30.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:34:31.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:30 smithi092 ceph-mon[29156]: pgmap v14409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:30 smithi156 ceph-mon[32679]: pgmap v14409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:31.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:30 smithi189 ceph-mon[32756]: pgmap v14409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:33.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:32 smithi156 ceph-mon[32679]: pgmap v14410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:33.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:32 smithi092 ceph-mon[29156]: pgmap v14410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:33.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:32 smithi189 ceph-mon[32756]: pgmap v14410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26169.785730 secs 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: pgmap v14411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25472.755217 secs 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: pgmap v14412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: pgmap v14413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:35.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26169.785730 secs 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: pgmap v14411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25472.755217 secs 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: pgmap v14412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: pgmap v14413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:35.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26169.785730 secs 2024-04-27T01:34:35.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: pgmap v14411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25472.755217 secs 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: pgmap v14412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: pgmap v14413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:34:37.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:37 smithi092 ceph-mon[29156]: pgmap v14414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:37.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:37 smithi189 ceph-mon[32756]: pgmap v14414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:37.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:37 smithi156 ceph-mon[32679]: pgmap v14414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:39.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:39 smithi092 ceph-mon[29156]: pgmap v14415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:39.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26174.785854 secs 2024-04-27T01:34:39.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25477.755335 secs 2024-04-27T01:34:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:39 smithi189 ceph-mon[32756]: pgmap v14415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26174.785854 secs 2024-04-27T01:34:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25477.755335 secs 2024-04-27T01:34:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:39 smithi156 ceph-mon[32679]: pgmap v14415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26174.785854 secs 2024-04-27T01:34:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25477.755335 secs 2024-04-27T01:34:41.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:41 smithi092 ceph-mon[29156]: pgmap v14416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:41 smithi189 ceph-mon[32756]: pgmap v14416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:41 smithi156 ceph-mon[32679]: pgmap v14416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:34:43.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:43 smithi092 ceph-mon[29156]: pgmap v14417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:43.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:43 smithi189 ceph-mon[32756]: pgmap v14417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:43.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:43 smithi156 ceph-mon[32679]: pgmap v14417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:34:44.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26179.785944 secs 2024-04-27T01:34:44.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25482.755454 secs 2024-04-27T01:34:44.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26179.785944 secs 2024-04-27T01:34:44.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25482.755454 secs 2024-04-27T01:34:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26179.785944 secs 2024-04-27T01:34:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25482.755454 secs 2024-04-27T01:34:45.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:45 smithi092 ceph-mon[29156]: pgmap v14418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:34:45.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:45 smithi189 ceph-mon[32756]: pgmap v14418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:34:45.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:45 smithi156 ceph-mon[32679]: pgmap v14418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:34:47.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:47 smithi092 ceph-mon[29156]: pgmap v14419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:47.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:47 smithi189 ceph-mon[32756]: pgmap v14419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:47.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:47 smithi156 ceph-mon[32679]: pgmap v14419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:49.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:49 smithi092 ceph-mon[29156]: pgmap v14420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:49.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26184.786062 secs 2024-04-27T01:34:49.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25487.755576 secs 2024-04-27T01:34:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:49 smithi189 ceph-mon[32756]: pgmap v14420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26184.786062 secs 2024-04-27T01:34:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25487.755576 secs 2024-04-27T01:34:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:49 smithi156 ceph-mon[32679]: pgmap v14420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26184.786062 secs 2024-04-27T01:34:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25487.755576 secs 2024-04-27T01:34:51.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:51 smithi189 ceph-mon[32756]: pgmap v14421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:51.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:51 smithi156 ceph-mon[32679]: pgmap v14421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:51.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:51 smithi092 ceph-mon[29156]: pgmap v14421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:53.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:53 smithi189 ceph-mon[32756]: pgmap v14422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:53.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:53 smithi156 ceph-mon[32679]: pgmap v14422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:53.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:53 smithi092 ceph-mon[29156]: pgmap v14422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26189.786138 secs 2024-04-27T01:34:54.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25492.755698 secs 2024-04-27T01:34:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26189.786138 secs 2024-04-27T01:34:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25492.755698 secs 2024-04-27T01:34:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26189.786138 secs 2024-04-27T01:34:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25492.755698 secs 2024-04-27T01:34:55.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:55 smithi189 ceph-mon[32756]: pgmap v14423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:55.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:55 smithi156 ceph-mon[32679]: pgmap v14423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:55.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:55 smithi092 ceph-mon[29156]: pgmap v14423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:34:57.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:57 smithi189 ceph-mon[32756]: pgmap v14424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:57.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:57 smithi156 ceph-mon[32679]: pgmap v14424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:57.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:57 smithi092 ceph-mon[29156]: pgmap v14424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:59 smithi189 ceph-mon[32756]: pgmap v14425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26194.786249 secs 2024-04-27T01:34:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:34:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25497.755802 secs 2024-04-27T01:34:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:59 smithi156 ceph-mon[32679]: pgmap v14425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26194.786249 secs 2024-04-27T01:34:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:34:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25497.755802 secs 2024-04-27T01:34:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:59 smithi092 ceph-mon[29156]: pgmap v14425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:34:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26194.786249 secs 2024-04-27T01:34:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:34:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25497.755802 secs 2024-04-27T01:35:01.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:01 smithi189 ceph-mon[32756]: pgmap v14426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:01.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:01 smithi156 ceph-mon[32679]: pgmap v14426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:01.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:01 smithi092 ceph-mon[29156]: pgmap v14426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:03.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:03 smithi189 ceph-mon[32756]: pgmap v14427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:03.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:03 smithi156 ceph-mon[32679]: pgmap v14427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:03.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:03 smithi092 ceph-mon[29156]: pgmap v14427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26199.786366 secs 2024-04-27T01:35:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25502.755895 secs 2024-04-27T01:35:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26199.786366 secs 2024-04-27T01:35:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25502.755895 secs 2024-04-27T01:35:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26199.786366 secs 2024-04-27T01:35:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25502.755895 secs 2024-04-27T01:35:05.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:05 smithi189 ceph-mon[32756]: pgmap v14428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:05.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:05 smithi092 ceph-mon[29156]: pgmap v14428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:05.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:05 smithi156 ceph-mon[32679]: pgmap v14428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:07.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:07 smithi189 ceph-mon[32756]: pgmap v14429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:07.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:07 smithi156 ceph-mon[32679]: pgmap v14429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:07.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:07 smithi092 ceph-mon[29156]: pgmap v14429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:09 smithi189 ceph-mon[32756]: pgmap v14430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26204.786507 secs 2024-04-27T01:35:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25507.756013 secs 2024-04-27T01:35:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:09 smithi156 ceph-mon[32679]: pgmap v14430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26204.786507 secs 2024-04-27T01:35:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25507.756013 secs 2024-04-27T01:35:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:09 smithi092 ceph-mon[29156]: pgmap v14430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26204.786507 secs 2024-04-27T01:35:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25507.756013 secs 2024-04-27T01:35:11.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:11 smithi189 ceph-mon[32756]: pgmap v14431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:11.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:11 smithi156 ceph-mon[32679]: pgmap v14431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:11.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:11 smithi092 ceph-mon[29156]: pgmap v14431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:13.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:13 smithi189 ceph-mon[32756]: pgmap v14432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:13.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:13 smithi156 ceph-mon[32679]: pgmap v14432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:13.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:13 smithi092 ceph-mon[29156]: pgmap v14432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26209.786597 secs 2024-04-27T01:35:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25512.756147 secs 2024-04-27T01:35:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26209.786597 secs 2024-04-27T01:35:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25512.756147 secs 2024-04-27T01:35:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26209.786597 secs 2024-04-27T01:35:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25512.756147 secs 2024-04-27T01:35:15.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:15 smithi189 ceph-mon[32756]: pgmap v14433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:15.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:15 smithi156 ceph-mon[32679]: pgmap v14433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:15.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:15 smithi092 ceph-mon[29156]: pgmap v14433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:17.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:17 smithi189 ceph-mon[32756]: pgmap v14434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:17.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:17 smithi156 ceph-mon[32679]: pgmap v14434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:17.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:17 smithi092 ceph-mon[29156]: pgmap v14434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:19 smithi189 ceph-mon[32756]: pgmap v14435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26214.786733 secs 2024-04-27T01:35:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25517.756286 secs 2024-04-27T01:35:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:19 smithi156 ceph-mon[32679]: pgmap v14435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26214.786733 secs 2024-04-27T01:35:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25517.756286 secs 2024-04-27T01:35:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:19 smithi092 ceph-mon[29156]: pgmap v14435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26214.786733 secs 2024-04-27T01:35:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25517.756286 secs 2024-04-27T01:35:21.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:21 smithi189 ceph-mon[32756]: pgmap v14436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:21.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:21 smithi156 ceph-mon[32679]: pgmap v14436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:21.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:21 smithi092 ceph-mon[29156]: pgmap v14436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:23.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:23 smithi189 ceph-mon[32756]: pgmap v14437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:23.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:23 smithi156 ceph-mon[32679]: pgmap v14437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:23.948 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:23 smithi092 ceph-mon[29156]: pgmap v14437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26219.786848 secs 2024-04-27T01:35:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25522.756405 secs 2024-04-27T01:35:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26219.786848 secs 2024-04-27T01:35:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25522.756405 secs 2024-04-27T01:35:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26219.786848 secs 2024-04-27T01:35:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25522.756405 secs 2024-04-27T01:35:25.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:25 smithi189 ceph-mon[32756]: pgmap v14438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:25.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:25 smithi156 ceph-mon[32679]: pgmap v14438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:25.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:25 smithi092 ceph-mon[29156]: pgmap v14438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:27.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:27 smithi189 ceph-mon[32756]: pgmap v14439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:27.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:27 smithi156 ceph-mon[32679]: pgmap v14439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:27.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:27 smithi092 ceph-mon[29156]: pgmap v14439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:29 smithi189 ceph-mon[32756]: pgmap v14440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26224.786938 secs 2024-04-27T01:35:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25527.756473 secs 2024-04-27T01:35:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:29 smithi156 ceph-mon[32679]: pgmap v14440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26224.786938 secs 2024-04-27T01:35:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25527.756473 secs 2024-04-27T01:35:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:29 smithi092 ceph-mon[29156]: pgmap v14440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26224.786938 secs 2024-04-27T01:35:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25527.756473 secs 2024-04-27T01:35:31.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:31 smithi189 ceph-mon[32756]: pgmap v14441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:31.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:31 smithi156 ceph-mon[32679]: pgmap v14441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:31.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:31 smithi092 ceph-mon[29156]: pgmap v14441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:33.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:33 smithi189 ceph-mon[32756]: pgmap v14442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:33.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:33 smithi156 ceph-mon[32679]: pgmap v14442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:33.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:33 smithi092 ceph-mon[29156]: pgmap v14442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26229.787065 secs 2024-04-27T01:35:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25532.756543 secs 2024-04-27T01:35:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:35:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26229.787065 secs 2024-04-27T01:35:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25532.756543 secs 2024-04-27T01:35:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:35:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26229.787065 secs 2024-04-27T01:35:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25532.756543 secs 2024-04-27T01:35:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:35:35.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:35 smithi189 ceph-mon[32756]: pgmap v14443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:35.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:35 smithi092 ceph-mon[29156]: pgmap v14443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:35.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:35 smithi156 ceph-mon[32679]: pgmap v14443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:37.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:37 smithi189 ceph-mon[32756]: pgmap v14444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:37.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:37 smithi156 ceph-mon[32679]: pgmap v14444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:37.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:37 smithi092 ceph-mon[29156]: pgmap v14444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: pgmap v14445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26234.787191 secs 2024-04-27T01:35:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:35:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:35:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25537.756672 secs 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: pgmap v14445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26234.787191 secs 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25537.756672 secs 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: pgmap v14445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26234.787191 secs 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:35:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25537.756672 secs 2024-04-27T01:35:40.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:40 smithi189 ceph-mon[32756]: pgmap v14446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T01:35:40.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:40 smithi189 ceph-mon[32756]: pgmap v14447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:40.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:40 smithi156 ceph-mon[32679]: pgmap v14446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T01:35:40.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:40 smithi156 ceph-mon[32679]: pgmap v14447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:40.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:40 smithi092 ceph-mon[29156]: pgmap v14446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T01:35:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:40 smithi092 ceph-mon[29156]: pgmap v14447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:42 smithi189 ceph-mon[32756]: pgmap v14448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:42 smithi156 ceph-mon[32679]: pgmap v14448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:42 smithi092 ceph-mon[29156]: pgmap v14448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:44 smithi189 ceph-mon[32756]: pgmap v14449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:35:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26239.787330 secs 2024-04-27T01:35:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25542.756754 secs 2024-04-27T01:35:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:44 smithi156 ceph-mon[32679]: pgmap v14449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:35:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26239.787330 secs 2024-04-27T01:35:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25542.756754 secs 2024-04-27T01:35:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:44 smithi092 ceph-mon[29156]: pgmap v14449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:35:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26239.787330 secs 2024-04-27T01:35:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25542.756754 secs 2024-04-27T01:35:46.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:46 smithi189 ceph-mon[32756]: pgmap v14450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:46.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:46 smithi156 ceph-mon[32679]: pgmap v14450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:46 smithi092 ceph-mon[29156]: pgmap v14450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:48.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:48 smithi189 ceph-mon[32756]: pgmap v14451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:48.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:48 smithi156 ceph-mon[32679]: pgmap v14451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:48.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:48 smithi092 ceph-mon[29156]: pgmap v14451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:35:49.772 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26244.787453 secs 2024-04-27T01:35:49.773 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25547.756874 secs 2024-04-27T01:35:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26244.787453 secs 2024-04-27T01:35:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25547.756874 secs 2024-04-27T01:35:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26244.787453 secs 2024-04-27T01:35:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25547.756874 secs 2024-04-27T01:35:50.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:50 smithi189 ceph-mon[32756]: pgmap v14452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:35:50.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:50 smithi156 ceph-mon[32679]: pgmap v14452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:35:50.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:50 smithi092 ceph-mon[29156]: pgmap v14452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:35:52.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:52 smithi189 ceph-mon[32756]: pgmap v14453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:52.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:52 smithi156 ceph-mon[32679]: pgmap v14453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:52.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:52 smithi092 ceph-mon[29156]: pgmap v14453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:35:54.586+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:35:54.570 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:35:54.586+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:35:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:35:54.586+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:35:54.571 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:35:54.586+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 203 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:35:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:54 smithi189 ceph-mon[32756]: pgmap v14454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26249.787567 secs 2024-04-27T01:35:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25552.756991 secs 2024-04-27T01:35:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:54 smithi156 ceph-mon[32679]: pgmap v14454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26249.787567 secs 2024-04-27T01:35:54.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25552.756991 secs 2024-04-27T01:35:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:54 smithi092 ceph-mon[29156]: pgmap v14454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26249.787567 secs 2024-04-27T01:35:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25552.756991 secs 2024-04-27T01:35:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:56 smithi189 ceph-mon[32756]: pgmap v14455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:56 smithi156 ceph-mon[32679]: pgmap v14455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:56.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:56 smithi092 ceph-mon[29156]: pgmap v14455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:35:58.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:58 smithi189 ceph-mon[32756]: pgmap v14456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:58.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:58 smithi156 ceph-mon[32679]: pgmap v14456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:58.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:58 smithi092 ceph-mon[29156]: pgmap v14456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:35:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26254.787689 secs 2024-04-27T01:35:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:35:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25557.757116 secs 2024-04-27T01:35:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26254.787689 secs 2024-04-27T01:35:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:35:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25557.757116 secs 2024-04-27T01:36:00.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26254.787689 secs 2024-04-27T01:36:00.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:35:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25557.757116 secs 2024-04-27T01:36:00.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:00 smithi156 ceph-mon[32679]: pgmap v14457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:00.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:00 smithi092 ceph-mon[29156]: pgmap v14457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:01.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:00 smithi189 ceph-mon[32756]: pgmap v14457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:02.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:02 smithi156 ceph-mon[32679]: pgmap v14458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:02.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:02 smithi092 ceph-mon[29156]: pgmap v14458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:03.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:02 smithi189 ceph-mon[32756]: pgmap v14458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:04 smithi156 ceph-mon[32679]: pgmap v14459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:04.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:04 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26259.787811 secs 2024-04-27T01:36:04.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:04 smithi156 ceph-mon[32679]: slow request 5762.809889 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T01:36:04.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25562.757257 secs 2024-04-27T01:36:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:04 smithi092 ceph-mon[29156]: pgmap v14459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:04 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26259.787811 secs 2024-04-27T01:36:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:04 smithi092 ceph-mon[29156]: slow request 5762.809889 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T01:36:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25562.757257 secs 2024-04-27T01:36:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:04 smithi189 ceph-mon[32756]: pgmap v14459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:04 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26259.787811 secs 2024-04-27T01:36:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:04 smithi189 ceph-mon[32756]: slow request 5762.809889 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T01:36:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25562.757257 secs 2024-04-27T01:36:06.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:06 smithi156 ceph-mon[32679]: pgmap v14460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:06.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:06 smithi092 ceph-mon[29156]: pgmap v14460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:07.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:06 smithi189 ceph-mon[32756]: pgmap v14460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:08.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:08 smithi156 ceph-mon[32679]: pgmap v14461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:08.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:08 smithi092 ceph-mon[29156]: pgmap v14461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:09.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:08 smithi189 ceph-mon[32756]: pgmap v14461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26264.787914 secs 2024-04-27T01:36:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25567.757380 secs 2024-04-27T01:36:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26264.787914 secs 2024-04-27T01:36:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25567.757380 secs 2024-04-27T01:36:10.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26264.787914 secs 2024-04-27T01:36:10.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25567.757380 secs 2024-04-27T01:36:10.878 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:10 smithi092 ceph-mon[29156]: pgmap v14462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:10.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:10 smithi156 ceph-mon[32679]: pgmap v14462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:11.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:10 smithi189 ceph-mon[32756]: pgmap v14462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:12.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:12 smithi156 ceph-mon[32679]: pgmap v14463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:12.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:12 smithi092 ceph-mon[29156]: pgmap v14463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:13.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:12 smithi189 ceph-mon[32756]: pgmap v14463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:14 smithi156 ceph-mon[32679]: pgmap v14464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26269.787981 secs 2024-04-27T01:36:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25572.757500 secs 2024-04-27T01:36:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:14 smithi092 ceph-mon[29156]: pgmap v14464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26269.787981 secs 2024-04-27T01:36:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25572.757500 secs 2024-04-27T01:36:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:14 smithi189 ceph-mon[32756]: pgmap v14464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26269.787981 secs 2024-04-27T01:36:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25572.757500 secs 2024-04-27T01:36:16.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:16 smithi156 ceph-mon[32679]: pgmap v14465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:16.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:16 smithi092 ceph-mon[29156]: pgmap v14465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:17.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:16 smithi189 ceph-mon[32756]: pgmap v14465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:18.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:18 smithi156 ceph-mon[32679]: pgmap v14466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:18.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:18 smithi092 ceph-mon[29156]: pgmap v14466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:19.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:18 smithi189 ceph-mon[32756]: pgmap v14466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26274.788108 secs 2024-04-27T01:36:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25577.757574 secs 2024-04-27T01:36:20.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26274.788108 secs 2024-04-27T01:36:20.023 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25577.757574 secs 2024-04-27T01:36:20.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26274.788108 secs 2024-04-27T01:36:20.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25577.757574 secs 2024-04-27T01:36:20.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:20 smithi092 ceph-mon[29156]: pgmap v14467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:21.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:20 smithi189 ceph-mon[32756]: pgmap v14467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:21.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:20 smithi156 ceph-mon[32679]: pgmap v14467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:22.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:22 smithi092 ceph-mon[29156]: pgmap v14468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:23.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:22 smithi189 ceph-mon[32756]: pgmap v14468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:23.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:22 smithi156 ceph-mon[32679]: pgmap v14468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:24 smithi092 ceph-mon[29156]: pgmap v14469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26279.788179 secs 2024-04-27T01:36:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25582.757651 secs 2024-04-27T01:36:25.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:24 smithi189 ceph-mon[32756]: pgmap v14469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:25.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26279.788179 secs 2024-04-27T01:36:25.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25582.757651 secs 2024-04-27T01:36:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:24 smithi156 ceph-mon[32679]: pgmap v14469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26279.788179 secs 2024-04-27T01:36:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25582.757651 secs 2024-04-27T01:36:26.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:26 smithi092 ceph-mon[29156]: pgmap v14470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:27.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:26 smithi189 ceph-mon[32756]: pgmap v14470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:27.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:26 smithi156 ceph-mon[32679]: pgmap v14470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:28.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:27 smithi189 ceph-mon[32756]: pgmap v14471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:28.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:27 smithi156 ceph-mon[32679]: pgmap v14471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:28.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:27 smithi092 ceph-mon[29156]: pgmap v14471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26284.788292 secs 2024-04-27T01:36:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:29 smithi189 ceph-mon[32756]: pgmap v14472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25587.757777 secs 2024-04-27T01:36:30.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26284.788292 secs 2024-04-27T01:36:30.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:29 smithi156 ceph-mon[32679]: pgmap v14472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:30.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25587.757777 secs 2024-04-27T01:36:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26284.788292 secs 2024-04-27T01:36:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:29 smithi092 ceph-mon[29156]: pgmap v14472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25587.757777 secs 2024-04-27T01:36:32.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:31 smithi189 ceph-mon[32756]: pgmap v14473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:32.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:31 smithi156 ceph-mon[32679]: pgmap v14473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:32.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:31 smithi092 ceph-mon[29156]: pgmap v14473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:34.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:33 smithi189 ceph-mon[32756]: pgmap v14474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:34.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:33 smithi156 ceph-mon[32679]: pgmap v14474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:34.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:33 smithi092 ceph-mon[29156]: pgmap v14474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26289.788410 secs 2024-04-27T01:36:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25592.757849 secs 2024-04-27T01:36:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26289.788410 secs 2024-04-27T01:36:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25592.757849 secs 2024-04-27T01:36:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26289.788410 secs 2024-04-27T01:36:35.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25592.757849 secs 2024-04-27T01:36:36.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:35 smithi189 ceph-mon[32756]: pgmap v14475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:36.128 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:35 smithi092 ceph-mon[29156]: pgmap v14475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:36.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:35 smithi156 ceph-mon[32679]: pgmap v14475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:38.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:37 smithi189 ceph-mon[32756]: pgmap v14476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:38.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:37 smithi156 ceph-mon[32679]: pgmap v14476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:38.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:37 smithi092 ceph-mon[29156]: pgmap v14476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:39.576 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:36:39.592+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:36:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:36:39.593+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:36:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:36:39.593+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:36:39.577 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:36:39.593+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 204 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26294.788522 secs 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: pgmap v14477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25597.757927 secs 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:36:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: pgmap v14478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:36:40.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: pgmap v14479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:40.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26294.788522 secs 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: pgmap v14477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25597.757927 secs 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: pgmap v14478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: pgmap v14479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26294.788522 secs 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: pgmap v14477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25597.757927 secs 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: pgmap v14478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: pgmap v14479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:40.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:36:42.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:42 smithi156 ceph-mon[32679]: pgmap v14480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:42 smithi092 ceph-mon[29156]: pgmap v14480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:43.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:42 smithi189 ceph-mon[32756]: pgmap v14480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:44 smithi156 ceph-mon[32679]: pgmap v14481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26299.788635 secs 2024-04-27T01:36:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25602.758042 secs 2024-04-27T01:36:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:44 smithi092 ceph-mon[29156]: pgmap v14481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26299.788635 secs 2024-04-27T01:36:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25602.758042 secs 2024-04-27T01:36:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:44 smithi189 ceph-mon[32756]: pgmap v14481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26299.788635 secs 2024-04-27T01:36:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25602.758042 secs 2024-04-27T01:36:46.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:46 smithi156 ceph-mon[32679]: pgmap v14482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:46.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:46 smithi092 ceph-mon[29156]: pgmap v14482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:47.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:46 smithi189 ceph-mon[32756]: pgmap v14482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:36:48.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:48 smithi156 ceph-mon[32679]: pgmap v14483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:36:48.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:48 smithi092 ceph-mon[29156]: pgmap v14483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:36:49.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:48 smithi189 ceph-mon[32756]: pgmap v14483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:36:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26304.788750 secs 2024-04-27T01:36:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25607.758143 secs 2024-04-27T01:36:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26304.788750 secs 2024-04-27T01:36:49.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25607.758143 secs 2024-04-27T01:36:50.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26304.788750 secs 2024-04-27T01:36:50.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25607.758143 secs 2024-04-27T01:36:50.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:50 smithi156 ceph-mon[32679]: pgmap v14484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:36:50.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:50 smithi092 ceph-mon[29156]: pgmap v14484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:36:51.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:50 smithi189 ceph-mon[32756]: pgmap v14484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:36:52.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:52 smithi156 ceph-mon[32679]: pgmap v14485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:52.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:52 smithi092 ceph-mon[29156]: pgmap v14485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:53.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:52 smithi189 ceph-mon[32756]: pgmap v14485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:54 smithi092 ceph-mon[29156]: pgmap v14486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26309.788865 secs 2024-04-27T01:36:54.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25612.758307 secs 2024-04-27T01:36:55.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:54 smithi189 ceph-mon[32756]: pgmap v14486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:55.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26309.788865 secs 2024-04-27T01:36:55.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25612.758307 secs 2024-04-27T01:36:55.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:54 smithi156 ceph-mon[32679]: pgmap v14486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:36:55.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26309.788865 secs 2024-04-27T01:36:55.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25612.758307 secs 2024-04-27T01:36:56.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:56 smithi092 ceph-mon[29156]: pgmap v14487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:57.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:56 smithi189 ceph-mon[32756]: pgmap v14487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:57.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:56 smithi156 ceph-mon[32679]: pgmap v14487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:58.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:58 smithi092 ceph-mon[29156]: pgmap v14488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:59.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:58 smithi189 ceph-mon[32756]: pgmap v14488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:59.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:58 smithi156 ceph-mon[32679]: pgmap v14488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:36:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26314.788989 secs 2024-04-27T01:36:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:36:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25617.758374 secs 2024-04-27T01:37:00.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26314.788989 secs 2024-04-27T01:37:00.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:36:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25617.758374 secs 2024-04-27T01:37:00.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26314.788989 secs 2024-04-27T01:37:00.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:36:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25617.758374 secs 2024-04-27T01:37:00.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:00 smithi092 ceph-mon[29156]: pgmap v14489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:01.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:00 smithi189 ceph-mon[32756]: pgmap v14489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:01.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:00 smithi156 ceph-mon[32679]: pgmap v14489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:02.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:01 smithi189 ceph-mon[32756]: pgmap v14490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:02.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:01 smithi156 ceph-mon[32679]: pgmap v14490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:02.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:01 smithi092 ceph-mon[29156]: pgmap v14490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:04 smithi156 ceph-mon[32679]: pgmap v14491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26319.789103 secs 2024-04-27T01:37:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25622.758487 secs 2024-04-27T01:37:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:04 smithi092 ceph-mon[29156]: pgmap v14491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26319.789103 secs 2024-04-27T01:37:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25622.758487 secs 2024-04-27T01:37:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:04 smithi189 ceph-mon[32756]: pgmap v14491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26319.789103 secs 2024-04-27T01:37:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25622.758487 secs 2024-04-27T01:37:06.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:06 smithi156 ceph-mon[32679]: pgmap v14492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:06.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:06 smithi092 ceph-mon[29156]: pgmap v14492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:07.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:06 smithi189 ceph-mon[32756]: pgmap v14492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:08.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:08 smithi156 ceph-mon[32679]: pgmap v14493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:08.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:08 smithi092 ceph-mon[29156]: pgmap v14493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:09.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:08 smithi189 ceph-mon[32756]: pgmap v14493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26324.789223 secs 2024-04-27T01:37:09.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25627.758599 secs 2024-04-27T01:37:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26324.789223 secs 2024-04-27T01:37:09.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25627.758599 secs 2024-04-27T01:37:10.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26324.789223 secs 2024-04-27T01:37:10.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25627.758599 secs 2024-04-27T01:37:10.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:10 smithi156 ceph-mon[32679]: pgmap v14494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:10.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:10 smithi092 ceph-mon[29156]: pgmap v14494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:11.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:10 smithi189 ceph-mon[32756]: pgmap v14494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:12.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:12 smithi092 ceph-mon[29156]: pgmap v14495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:13.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:12 smithi189 ceph-mon[32756]: pgmap v14495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:13.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:12 smithi156 ceph-mon[32679]: pgmap v14495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:14 smithi092 ceph-mon[29156]: pgmap v14496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26329.789343 secs 2024-04-27T01:37:14.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25632.758735 secs 2024-04-27T01:37:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:14 smithi189 ceph-mon[32756]: pgmap v14496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26329.789343 secs 2024-04-27T01:37:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25632.758735 secs 2024-04-27T01:37:15.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:14 smithi156 ceph-mon[32679]: pgmap v14496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:15.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26329.789343 secs 2024-04-27T01:37:15.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25632.758735 secs 2024-04-27T01:37:16.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:16 smithi092 ceph-mon[29156]: pgmap v14497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:17.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:16 smithi189 ceph-mon[32756]: pgmap v14497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:17.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:16 smithi156 ceph-mon[32679]: pgmap v14497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:18.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:18 smithi092 ceph-mon[29156]: pgmap v14498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:19.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:18 smithi189 ceph-mon[32756]: pgmap v14498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:19.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:18 smithi156 ceph-mon[32679]: pgmap v14498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:37:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26334.789450 secs 2024-04-27T01:37:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25637.758853 secs 2024-04-27T01:37:20.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26334.789450 secs 2024-04-27T01:37:20.022 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25637.758853 secs 2024-04-27T01:37:20.068 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26334.789450 secs 2024-04-27T01:37:20.068 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25637.758853 secs 2024-04-27T01:37:20.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:20 smithi092 ceph-mon[29156]: pgmap v14499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:21.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:20 smithi189 ceph-mon[32756]: pgmap v14499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:21.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:20 smithi156 ceph-mon[32679]: pgmap v14499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:21.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:21 smithi092 ceph-mon[29156]: pgmap v14500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:22.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:21 smithi189 ceph-mon[32756]: pgmap v14500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:22.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:21 smithi156 ceph-mon[32679]: pgmap v14500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:24 smithi156 ceph-mon[32679]: pgmap v14501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26339.789597 secs 2024-04-27T01:37:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25642.758980 secs 2024-04-27T01:37:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:24 smithi092 ceph-mon[29156]: pgmap v14501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26339.789597 secs 2024-04-27T01:37:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25642.758980 secs 2024-04-27T01:37:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:24 smithi189 ceph-mon[32756]: pgmap v14501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26339.789597 secs 2024-04-27T01:37:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25642.758980 secs 2024-04-27T01:37:26.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:26 smithi156 ceph-mon[32679]: pgmap v14502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:26.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:26 smithi092 ceph-mon[29156]: pgmap v14502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:27.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:26 smithi189 ceph-mon[32756]: pgmap v14502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:28.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:28 smithi156 ceph-mon[32679]: pgmap v14503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:28.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:28 smithi092 ceph-mon[29156]: pgmap v14503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:29.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:28 smithi189 ceph-mon[32756]: pgmap v14503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26344.789749 secs 2024-04-27T01:37:29.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25647.759151 secs 2024-04-27T01:37:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26344.789749 secs 2024-04-27T01:37:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25647.759151 secs 2024-04-27T01:37:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26344.789749 secs 2024-04-27T01:37:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25647.759151 secs 2024-04-27T01:37:30.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:30 smithi092 ceph-mon[29156]: pgmap v14504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:31.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:30 smithi189 ceph-mon[32756]: pgmap v14504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:31.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:30 smithi156 ceph-mon[32679]: pgmap v14504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:32.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:32 smithi092 ceph-mon[29156]: pgmap v14505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:33.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:32 smithi189 ceph-mon[32756]: pgmap v14505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:33.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:32 smithi156 ceph-mon[32679]: pgmap v14505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:34 smithi092 ceph-mon[29156]: pgmap v14506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26349.789841 secs 2024-04-27T01:37:34.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25652.759247 secs 2024-04-27T01:37:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:34 smithi189 ceph-mon[32756]: pgmap v14506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26349.789841 secs 2024-04-27T01:37:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25652.759247 secs 2024-04-27T01:37:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:34 smithi156 ceph-mon[32679]: pgmap v14506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26349.789841 secs 2024-04-27T01:37:35.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25652.759247 secs 2024-04-27T01:37:36.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:36 smithi092 ceph-mon[29156]: pgmap v14507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:37.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:36 smithi189 ceph-mon[32756]: pgmap v14507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:37.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:36 smithi156 ceph-mon[32679]: pgmap v14507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:38.227 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:37:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:37:37.804+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:37:38.227 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:37:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:37:37.804+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:37:38.227 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:37:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:37:37.804+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:37:38.227 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:37:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:37:37.804+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:37:38.227 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:37:37 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:37:37.804+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:37:38.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:38 smithi092 ceph-mon[29156]: pgmap v14508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:39.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:38 smithi189 ceph-mon[32756]: pgmap v14508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:39.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:38 smithi156 ceph-mon[32679]: pgmap v14508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26354.789953 secs 2024-04-27T01:37:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25657.759365 secs 2024-04-27T01:37:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26354.789953 secs 2024-04-27T01:37:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25657.759365 secs 2024-04-27T01:37:40.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26354.789953 secs 2024-04-27T01:37:40.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25657.759365 secs 2024-04-27T01:37:40.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:40 smithi092 ceph-mon[29156]: pgmap v14509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:37:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:37:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:37:40.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:37:41.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:40 smithi189 ceph-mon[32756]: pgmap v14509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:41.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:37:41.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:37:41.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:37:41.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:37:41.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:40 smithi156 ceph-mon[32679]: pgmap v14509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:37:41.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:37:41.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:37:41.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:37:41.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:37:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:41 smithi092 ceph-mon[29156]: pgmap v14510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:37:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:41 smithi092 ceph-mon[29156]: pgmap v14511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:42.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:41 smithi189 ceph-mon[32756]: pgmap v14510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:37:42.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:41 smithi189 ceph-mon[32756]: pgmap v14511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:42.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:41 smithi156 ceph-mon[32679]: pgmap v14510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:37:42.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:41 smithi156 ceph-mon[32679]: pgmap v14511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:42 smithi092 ceph-mon[29156]: pgmap v14512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T01:37:43.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:42 smithi189 ceph-mon[32756]: pgmap v14512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T01:37:43.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:42 smithi156 ceph-mon[32679]: pgmap v14512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T01:37:44.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25662.759481 secs 2024-04-27T01:37:44.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25662.759481 secs 2024-04-27T01:37:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25662.759481 secs 2024-04-27T01:37:45.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26359.790067 secs 2024-04-27T01:37:45.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:45 smithi092 ceph-mon[29156]: pgmap v14513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:45.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26359.790067 secs 2024-04-27T01:37:45.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:45 smithi189 ceph-mon[32756]: pgmap v14513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:45.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26359.790067 secs 2024-04-27T01:37:45.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:45 smithi156 ceph-mon[32679]: pgmap v14513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:47.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:47 smithi092 ceph-mon[29156]: pgmap v14514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:47.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:47 smithi189 ceph-mon[32756]: pgmap v14514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:47.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:47 smithi156 ceph-mon[32679]: pgmap v14514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T01:37:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:49 smithi092 ceph-mon[29156]: pgmap v14515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:37:49.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26364.790180 secs 2024-04-27T01:37:49.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25667.759548 secs 2024-04-27T01:37:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:49 smithi189 ceph-mon[32756]: pgmap v14515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:37:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26364.790180 secs 2024-04-27T01:37:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25667.759548 secs 2024-04-27T01:37:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:49 smithi156 ceph-mon[32679]: pgmap v14515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:37:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26364.790180 secs 2024-04-27T01:37:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25667.759548 secs 2024-04-27T01:37:51.719 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:51 smithi156 ceph-mon[32679]: pgmap v14516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:37:51.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:51 smithi092 ceph-mon[29156]: pgmap v14516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:37:51.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:51 smithi189 ceph-mon[32756]: pgmap v14516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:37:53.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:53 smithi092 ceph-mon[29156]: pgmap v14517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:53.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:53 smithi189 ceph-mon[32756]: pgmap v14517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:53.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:53 smithi156 ceph-mon[32679]: pgmap v14517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26369.790292 secs 2024-04-27T01:37:54.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25672.759699 secs 2024-04-27T01:37:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26369.790292 secs 2024-04-27T01:37:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25672.759699 secs 2024-04-27T01:37:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26369.790292 secs 2024-04-27T01:37:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25672.759699 secs 2024-04-27T01:37:55.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:55 smithi092 ceph-mon[29156]: pgmap v14518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:55.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:55 smithi189 ceph-mon[32756]: pgmap v14518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:55.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:55 smithi156 ceph-mon[32679]: pgmap v14518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:37:57.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:57 smithi092 ceph-mon[29156]: pgmap v14519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:57.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:57 smithi189 ceph-mon[32756]: pgmap v14519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:57.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:57 smithi156 ceph-mon[32679]: pgmap v14519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:59 smithi092 ceph-mon[29156]: pgmap v14520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:59.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26374.790427 secs 2024-04-27T01:37:59.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:37:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25677.759825 secs 2024-04-27T01:37:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:59 smithi189 ceph-mon[32756]: pgmap v14520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26374.790427 secs 2024-04-27T01:37:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:37:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25677.759825 secs 2024-04-27T01:37:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:59 smithi156 ceph-mon[32679]: pgmap v14520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:37:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26374.790427 secs 2024-04-27T01:37:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:37:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25677.759825 secs 2024-04-27T01:38:01.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:01 smithi092 ceph-mon[29156]: pgmap v14521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:01.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:01 smithi189 ceph-mon[32756]: pgmap v14521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:01.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:01 smithi156 ceph-mon[32679]: pgmap v14521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:03.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:03 smithi092 ceph-mon[29156]: pgmap v14522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:03.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:03 smithi189 ceph-mon[32756]: pgmap v14522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:03.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:03 smithi156 ceph-mon[32679]: pgmap v14522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26379.790544 secs 2024-04-27T01:38:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25682.759944 secs 2024-04-27T01:38:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26379.790544 secs 2024-04-27T01:38:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25682.759944 secs 2024-04-27T01:38:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26379.790544 secs 2024-04-27T01:38:04.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25682.759944 secs 2024-04-27T01:38:05.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:05 smithi092 ceph-mon[29156]: pgmap v14523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:05.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:05 smithi189 ceph-mon[32756]: pgmap v14523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:05.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:05 smithi156 ceph-mon[32679]: pgmap v14523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:07.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:07 smithi092 ceph-mon[29156]: pgmap v14524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:07.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:07 smithi189 ceph-mon[32756]: pgmap v14524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:07.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:07 smithi156 ceph-mon[32679]: pgmap v14524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:09.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:09 smithi092 ceph-mon[29156]: pgmap v14525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:09.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26384.790607 secs 2024-04-27T01:38:09.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25687.760047 secs 2024-04-27T01:38:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:09 smithi189 ceph-mon[32756]: pgmap v14525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26384.790607 secs 2024-04-27T01:38:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25687.760047 secs 2024-04-27T01:38:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:09 smithi156 ceph-mon[32679]: pgmap v14525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26384.790607 secs 2024-04-27T01:38:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25687.760047 secs 2024-04-27T01:38:11.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:11 smithi092 ceph-mon[29156]: pgmap v14526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:11.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:11 smithi189 ceph-mon[32756]: pgmap v14526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:11.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:11 smithi156 ceph-mon[32679]: pgmap v14526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:13.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:13 smithi189 ceph-mon[32756]: pgmap v14527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:13.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:13 smithi156 ceph-mon[32679]: pgmap v14527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:13.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:13 smithi092 ceph-mon[29156]: pgmap v14527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26389.790723 secs 2024-04-27T01:38:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25692.760108 secs 2024-04-27T01:38:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26389.790723 secs 2024-04-27T01:38:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25692.760108 secs 2024-04-27T01:38:14.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26389.790723 secs 2024-04-27T01:38:14.956 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25692.760108 secs 2024-04-27T01:38:15.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:15 smithi189 ceph-mon[32756]: pgmap v14528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:15.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:15 smithi156 ceph-mon[32679]: pgmap v14528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:15.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:15 smithi092 ceph-mon[29156]: pgmap v14528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:17.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:17 smithi189 ceph-mon[32756]: pgmap v14529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:17.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:17 smithi156 ceph-mon[32679]: pgmap v14529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:17.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:17 smithi092 ceph-mon[29156]: pgmap v14529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:19 smithi189 ceph-mon[32756]: pgmap v14530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26394.790848 secs 2024-04-27T01:38:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25697.760229 secs 2024-04-27T01:38:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:19 smithi156 ceph-mon[32679]: pgmap v14530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26394.790848 secs 2024-04-27T01:38:19.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25697.760229 secs 2024-04-27T01:38:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:19 smithi092 ceph-mon[29156]: pgmap v14530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26394.790848 secs 2024-04-27T01:38:19.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25697.760229 secs 2024-04-27T01:38:21.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:21 smithi189 ceph-mon[32756]: pgmap v14531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:21.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:21 smithi156 ceph-mon[32679]: pgmap v14531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:21.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:21 smithi092 ceph-mon[29156]: pgmap v14531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:23.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:23 smithi189 ceph-mon[32756]: pgmap v14532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:23.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:23 smithi156 ceph-mon[32679]: pgmap v14532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:23.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:23 smithi092 ceph-mon[29156]: pgmap v14532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26399.790972 secs 2024-04-27T01:38:24.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25702.760370 secs 2024-04-27T01:38:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26399.790972 secs 2024-04-27T01:38:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25702.760370 secs 2024-04-27T01:38:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26399.790972 secs 2024-04-27T01:38:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25702.760370 secs 2024-04-27T01:38:25.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:25 smithi189 ceph-mon[32756]: pgmap v14533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:25.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:25 smithi156 ceph-mon[32679]: pgmap v14533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:25 smithi092 ceph-mon[29156]: pgmap v14533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:27.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:27 smithi189 ceph-mon[32756]: pgmap v14534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:27.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:27 smithi156 ceph-mon[32679]: pgmap v14534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:27.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:27 smithi092 ceph-mon[29156]: pgmap v14534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:29 smithi189 ceph-mon[32756]: pgmap v14535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26404.791062 secs 2024-04-27T01:38:29.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25707.760492 secs 2024-04-27T01:38:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:29 smithi156 ceph-mon[32679]: pgmap v14535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26404.791062 secs 2024-04-27T01:38:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25707.760492 secs 2024-04-27T01:38:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:29 smithi092 ceph-mon[29156]: pgmap v14535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26404.791062 secs 2024-04-27T01:38:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25707.760492 secs 2024-04-27T01:38:31.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:31 smithi189 ceph-mon[32756]: pgmap v14536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:31.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:31 smithi156 ceph-mon[32679]: pgmap v14536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:31.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:31 smithi092 ceph-mon[29156]: pgmap v14536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:33.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:33 smithi189 ceph-mon[32756]: pgmap v14537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:33.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:33 smithi156 ceph-mon[32679]: pgmap v14537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:33.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:33 smithi092 ceph-mon[29156]: pgmap v14537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26409.791180 secs 2024-04-27T01:38:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25712.760609 secs 2024-04-27T01:38:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26409.791180 secs 2024-04-27T01:38:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25712.760609 secs 2024-04-27T01:38:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26409.791180 secs 2024-04-27T01:38:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25712.760609 secs 2024-04-27T01:38:35.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:35 smithi189 ceph-mon[32756]: pgmap v14538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:35.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:35 smithi156 ceph-mon[32679]: pgmap v14538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:35.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:35 smithi092 ceph-mon[29156]: pgmap v14538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:37.779 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:37 smithi092 ceph-mon[29156]: pgmap v14539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:37.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:37 smithi189 ceph-mon[32756]: pgmap v14539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:37.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:37 smithi156 ceph-mon[32679]: pgmap v14539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:39 smithi189 ceph-mon[32756]: pgmap v14540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26414.791296 secs 2024-04-27T01:38:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:39 smithi189 ceph-mon[32756]: slow request 2881.674162 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:38:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25717.760726 secs 2024-04-27T01:38:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:39 smithi156 ceph-mon[32679]: pgmap v14540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26414.791296 secs 2024-04-27T01:38:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:39 smithi156 ceph-mon[32679]: slow request 2881.674162 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:38:39.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25717.760726 secs 2024-04-27T01:38:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:39 smithi092 ceph-mon[29156]: pgmap v14540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26414.791296 secs 2024-04-27T01:38:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:39 smithi092 ceph-mon[29156]: slow request 2881.674162 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:38:39.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25717.760726 secs 2024-04-27T01:38:40.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:38:40.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:38:40.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:38:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:41 smithi189 ceph-mon[32756]: pgmap v14541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:38:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:38:41.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:38:41.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:41 smithi156 ceph-mon[32679]: pgmap v14541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:38:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:38:41.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:38:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:41 smithi092 ceph-mon[29156]: pgmap v14541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:38:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:38:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:38:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:42 smithi189 ceph-mon[32756]: pgmap v14542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:38:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:42 smithi189 ceph-mon[32756]: pgmap v14543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:42.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:42 smithi156 ceph-mon[32679]: pgmap v14542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:38:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:42 smithi156 ceph-mon[32679]: pgmap v14543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:42 smithi092 ceph-mon[29156]: pgmap v14542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:38:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:42 smithi092 ceph-mon[29156]: pgmap v14543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:44 smithi189 ceph-mon[32756]: pgmap v14544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:38:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26419.791429 secs 2024-04-27T01:38:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25722.760805 secs 2024-04-27T01:38:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:44 smithi156 ceph-mon[32679]: pgmap v14544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:38:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26419.791429 secs 2024-04-27T01:38:44.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25722.760805 secs 2024-04-27T01:38:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:44 smithi092 ceph-mon[29156]: pgmap v14544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:38:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26419.791429 secs 2024-04-27T01:38:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25722.760805 secs 2024-04-27T01:38:46.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:46 smithi189 ceph-mon[32756]: pgmap v14545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:46 smithi156 ceph-mon[32679]: pgmap v14545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:46 smithi092 ceph-mon[29156]: pgmap v14545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:48.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:48 smithi189 ceph-mon[32756]: pgmap v14546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:48.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:48 smithi156 ceph-mon[32679]: pgmap v14546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:48.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:48 smithi092 ceph-mon[29156]: pgmap v14546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26424.791567 secs 2024-04-27T01:38:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25727.760918 secs 2024-04-27T01:38:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26424.791567 secs 2024-04-27T01:38:49.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25727.760918 secs 2024-04-27T01:38:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26424.791567 secs 2024-04-27T01:38:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25727.760918 secs 2024-04-27T01:38:50.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:50 smithi189 ceph-mon[32756]: pgmap v14547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:50.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:50 smithi156 ceph-mon[32679]: pgmap v14547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:50.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:50 smithi092 ceph-mon[29156]: pgmap v14547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:38:52.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:52 smithi189 ceph-mon[32756]: pgmap v14548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:38:52.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:52 smithi156 ceph-mon[32679]: pgmap v14548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:38:52.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:52 smithi092 ceph-mon[29156]: pgmap v14548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:38:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:54 smithi189 ceph-mon[32756]: pgmap v14549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26429.791692 secs 2024-04-27T01:38:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25732.761039 secs 2024-04-27T01:38:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:54 smithi156 ceph-mon[32679]: pgmap v14549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26429.791692 secs 2024-04-27T01:38:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25732.761039 secs 2024-04-27T01:38:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:54 smithi092 ceph-mon[29156]: pgmap v14549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26429.791692 secs 2024-04-27T01:38:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25732.761039 secs 2024-04-27T01:38:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:56 smithi189 ceph-mon[32756]: pgmap v14550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:56 smithi156 ceph-mon[32679]: pgmap v14550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:56.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:56 smithi092 ceph-mon[29156]: pgmap v14550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:38:58.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:58 smithi189 ceph-mon[32756]: pgmap v14551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:58.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:58 smithi156 ceph-mon[32679]: pgmap v14551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:58.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:58 smithi092 ceph-mon[29156]: pgmap v14551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:38:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26434.791814 secs 2024-04-27T01:38:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:38:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25737.761161 secs 2024-04-27T01:38:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26434.791814 secs 2024-04-27T01:38:59.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:38:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25737.761161 secs 2024-04-27T01:38:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26434.791814 secs 2024-04-27T01:38:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:38:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25737.761161 secs 2024-04-27T01:39:00.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:00 smithi189 ceph-mon[32756]: pgmap v14552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:00.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:00 smithi156 ceph-mon[32679]: pgmap v14552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:00.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:00 smithi092 ceph-mon[29156]: pgmap v14552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:02.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:02 smithi189 ceph-mon[32756]: pgmap v14553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:02.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:02 smithi156 ceph-mon[32679]: pgmap v14553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:02.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:02 smithi092 ceph-mon[29156]: pgmap v14553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:04 smithi189 ceph-mon[32756]: pgmap v14554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26439.791961 secs 2024-04-27T01:39:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25742.761279 secs 2024-04-27T01:39:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:04 smithi156 ceph-mon[32679]: pgmap v14554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26439.791961 secs 2024-04-27T01:39:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25742.761279 secs 2024-04-27T01:39:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:04 smithi092 ceph-mon[29156]: pgmap v14554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26439.791961 secs 2024-04-27T01:39:04.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25742.761279 secs 2024-04-27T01:39:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:06 smithi189 ceph-mon[32756]: pgmap v14555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:06.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:06 smithi156 ceph-mon[32679]: pgmap v14555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:06.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:06 smithi092 ceph-mon[29156]: pgmap v14555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:08.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:08 smithi189 ceph-mon[32756]: pgmap v14556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:08.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:08 smithi156 ceph-mon[32679]: pgmap v14556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:08.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:08 smithi092 ceph-mon[29156]: pgmap v14556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:09 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26444.792079 secs 2024-04-27T01:39:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:09 smithi189 ceph-mon[32756]: slow request 5762.478790 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:39:09.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25747.761428 secs 2024-04-27T01:39:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:09 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26444.792079 secs 2024-04-27T01:39:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:09 smithi156 ceph-mon[32679]: slow request 5762.478790 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:39:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25747.761428 secs 2024-04-27T01:39:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:09 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26444.792079 secs 2024-04-27T01:39:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:09 smithi092 ceph-mon[29156]: slow request 5762.478790 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:39:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25747.761428 secs 2024-04-27T01:39:10.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:10 smithi189 ceph-mon[32756]: pgmap v14557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:10.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:10 smithi156 ceph-mon[32679]: pgmap v14557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:10.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:10 smithi092 ceph-mon[29156]: pgmap v14557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:12.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:12 smithi189 ceph-mon[32756]: pgmap v14558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:12.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:12 smithi156 ceph-mon[32679]: pgmap v14558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:12.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:12 smithi092 ceph-mon[29156]: pgmap v14558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:14 smithi189 ceph-mon[32756]: pgmap v14559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26449.792196 secs 2024-04-27T01:39:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25752.761575 secs 2024-04-27T01:39:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:14 smithi156 ceph-mon[32679]: pgmap v14559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26449.792196 secs 2024-04-27T01:39:14.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25752.761575 secs 2024-04-27T01:39:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:14 smithi092 ceph-mon[29156]: pgmap v14559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26449.792196 secs 2024-04-27T01:39:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25752.761575 secs 2024-04-27T01:39:16.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:16 smithi189 ceph-mon[32756]: pgmap v14560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:16.907 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:16 smithi092 ceph-mon[29156]: pgmap v14560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:16.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:16 smithi156 ceph-mon[32679]: pgmap v14560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:18.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:18 smithi189 ceph-mon[32756]: pgmap v14561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:18.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:18 smithi156 ceph-mon[32679]: pgmap v14561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:18.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:18 smithi092 ceph-mon[29156]: pgmap v14561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26454.792314 secs 2024-04-27T01:39:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25757.761701 secs 2024-04-27T01:39:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26454.792314 secs 2024-04-27T01:39:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25757.761701 secs 2024-04-27T01:39:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26454.792314 secs 2024-04-27T01:39:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25757.761701 secs 2024-04-27T01:39:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:20 smithi189 ceph-mon[32756]: pgmap v14562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:20.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:20 smithi156 ceph-mon[32679]: pgmap v14562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:20.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:20 smithi092 ceph-mon[29156]: pgmap v14562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:22.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:22 smithi156 ceph-mon[32679]: pgmap v14563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:22.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:22 smithi092 ceph-mon[29156]: pgmap v14563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:23.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:22 smithi189 ceph-mon[32756]: pgmap v14563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:24 smithi156 ceph-mon[32679]: pgmap v14564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26459.792423 secs 2024-04-27T01:39:24.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25762.761798 secs 2024-04-27T01:39:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:24 smithi092 ceph-mon[29156]: pgmap v14564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26459.792423 secs 2024-04-27T01:39:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25762.761798 secs 2024-04-27T01:39:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:24 smithi189 ceph-mon[32756]: pgmap v14564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26459.792423 secs 2024-04-27T01:39:25.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25762.761798 secs 2024-04-27T01:39:26.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:26 smithi156 ceph-mon[32679]: pgmap v14565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:26.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:26 smithi092 ceph-mon[29156]: pgmap v14565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:27.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:26 smithi189 ceph-mon[32756]: pgmap v14565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:28.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:28 smithi156 ceph-mon[32679]: pgmap v14566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:28.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:28 smithi092 ceph-mon[29156]: pgmap v14566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:29.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:28 smithi189 ceph-mon[32756]: pgmap v14566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26464.792557 secs 2024-04-27T01:39:29.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25767.761913 secs 2024-04-27T01:39:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26464.792557 secs 2024-04-27T01:39:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25767.761913 secs 2024-04-27T01:39:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26464.792557 secs 2024-04-27T01:39:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25767.761913 secs 2024-04-27T01:39:30.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:30 smithi156 ceph-mon[32679]: pgmap v14567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:30.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:30 smithi092 ceph-mon[29156]: pgmap v14567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:31.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:30 smithi189 ceph-mon[32756]: pgmap v14567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:32.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:32 smithi156 ceph-mon[32679]: pgmap v14568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:32.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:32 smithi092 ceph-mon[29156]: pgmap v14568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:33.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:32 smithi189 ceph-mon[32756]: pgmap v14568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:34 smithi156 ceph-mon[32679]: pgmap v14569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26469.792703 secs 2024-04-27T01:39:34.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25772.761986 secs 2024-04-27T01:39:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:34 smithi092 ceph-mon[29156]: pgmap v14569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26469.792703 secs 2024-04-27T01:39:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25772.761986 secs 2024-04-27T01:39:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:34 smithi189 ceph-mon[32756]: pgmap v14569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26469.792703 secs 2024-04-27T01:39:35.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25772.761986 secs 2024-04-27T01:39:36.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:36 smithi156 ceph-mon[32679]: pgmap v14570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:36.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:36 smithi092 ceph-mon[29156]: pgmap v14570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:37.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:36 smithi189 ceph-mon[32756]: pgmap v14570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:38.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:38 smithi156 ceph-mon[32679]: pgmap v14571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:38.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:38 smithi092 ceph-mon[29156]: pgmap v14571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:39.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:38 smithi189 ceph-mon[32756]: pgmap v14571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:39:39.618+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:39:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:39:39.618+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:39:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:39:39.619+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:39:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:39:39.619+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 205 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:39:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26474.792769 secs 2024-04-27T01:39:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25777.762095 secs 2024-04-27T01:39:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26474.792769 secs 2024-04-27T01:39:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25777.762095 secs 2024-04-27T01:39:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26474.792769 secs 2024-04-27T01:39:40.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25777.762095 secs 2024-04-27T01:39:40.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:40 smithi156 ceph-mon[32679]: pgmap v14572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:40.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:40 smithi092 ceph-mon[29156]: pgmap v14572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:41.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:40 smithi189 ceph-mon[32756]: pgmap v14572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:41.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:39:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:39:42.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:39:42.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: pgmap v14573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: pgmap v14573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: pgmap v14573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:42.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: pgmap v14574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26479.792876 secs 2024-04-27T01:39:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25782.762166 secs 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: pgmap v14574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26479.792876 secs 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25782.762166 secs 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: pgmap v14574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26479.792876 secs 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25782.762166 secs 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:45.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: pgmap v14575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:39:46.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:39:46.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:39:46.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: pgmap v14576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:46.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: pgmap v14577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:46.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: pgmap v14575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: pgmap v14576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: pgmap v14577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:46.373 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: pgmap v14575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: pgmap v14576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: pgmap v14577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:46.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:39:48.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:48 smithi092 ceph-mon[29156]: pgmap v14578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:48 smithi156 ceph-mon[32679]: pgmap v14578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:48.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:48 smithi189 ceph-mon[32756]: pgmap v14578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26484.792955 secs 2024-04-27T01:39:49.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25787.762285 secs 2024-04-27T01:39:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26484.792955 secs 2024-04-27T01:39:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25787.762285 secs 2024-04-27T01:39:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26484.792955 secs 2024-04-27T01:39:49.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25787.762285 secs 2024-04-27T01:39:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:50 smithi156 ceph-mon[32679]: pgmap v14579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:50 smithi092 ceph-mon[29156]: pgmap v14579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:50.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:50 smithi189 ceph-mon[32756]: pgmap v14579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:52.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:52 smithi156 ceph-mon[32679]: pgmap v14580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:52.672 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:52 smithi189 ceph-mon[32756]: pgmap v14580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:52.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:52 smithi092 ceph-mon[29156]: pgmap v14580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:39:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:54 smithi156 ceph-mon[32679]: pgmap v14581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26489.793073 secs 2024-04-27T01:39:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25792.762401 secs 2024-04-27T01:39:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:54 smithi092 ceph-mon[29156]: pgmap v14581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26489.793073 secs 2024-04-27T01:39:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25792.762401 secs 2024-04-27T01:39:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:54 smithi189 ceph-mon[32756]: pgmap v14581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T01:39:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26489.793073 secs 2024-04-27T01:39:54.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25792.762401 secs 2024-04-27T01:39:56.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:56 smithi156 ceph-mon[32679]: pgmap v14582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:56 smithi092 ceph-mon[29156]: pgmap v14582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:56 smithi189 ceph-mon[32756]: pgmap v14582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:39:58.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:58 smithi156 ceph-mon[32679]: pgmap v14583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:58.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:58 smithi092 ceph-mon[29156]: pgmap v14583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:58.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:58 smithi189 ceph-mon[32756]: pgmap v14583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:39:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26494.793195 secs 2024-04-27T01:39:59.667 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:39:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25797.762479 secs 2024-04-27T01:39:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26494.793195 secs 2024-04-27T01:39:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:39:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25797.762479 secs 2024-04-27T01:39:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26494.793195 secs 2024-04-27T01:39:59.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:39:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25797.762479 secs 2024-04-27T01:40:00.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:00 smithi092 ceph-mon[29156]: pgmap v14584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:00.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:40:00.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:00 smithi189 ceph-mon[32756]: pgmap v14584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:00.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:40:00.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:00 smithi156 ceph-mon[32679]: pgmap v14584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:00.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:40:02.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:02 smithi092 ceph-mon[29156]: pgmap v14585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:02.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:02 smithi189 ceph-mon[32756]: pgmap v14585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:02.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:02 smithi156 ceph-mon[32679]: pgmap v14585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:04 smithi092 ceph-mon[29156]: pgmap v14586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26499.793345 secs 2024-04-27T01:40:04.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25802.762592 secs 2024-04-27T01:40:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:04 smithi189 ceph-mon[32756]: pgmap v14586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26499.793345 secs 2024-04-27T01:40:04.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25802.762592 secs 2024-04-27T01:40:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:04 smithi156 ceph-mon[32679]: pgmap v14586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26499.793345 secs 2024-04-27T01:40:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25802.762592 secs 2024-04-27T01:40:06.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:06 smithi092 ceph-mon[29156]: pgmap v14587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:06 smithi189 ceph-mon[32756]: pgmap v14587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:06.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:06 smithi156 ceph-mon[32679]: pgmap v14587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:08.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:08 smithi092 ceph-mon[29156]: pgmap v14588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:08.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:08 smithi189 ceph-mon[32756]: pgmap v14588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:08.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:08 smithi156 ceph-mon[32679]: pgmap v14588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:09.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26504.793464 secs 2024-04-27T01:40:09.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25807.762662 secs 2024-04-27T01:40:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26504.793464 secs 2024-04-27T01:40:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25807.762662 secs 2024-04-27T01:40:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26504.793464 secs 2024-04-27T01:40:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25807.762662 secs 2024-04-27T01:40:10.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:10 smithi092 ceph-mon[29156]: pgmap v14589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:10.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:10 smithi189 ceph-mon[32756]: pgmap v14589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:10.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:10 smithi156 ceph-mon[32679]: pgmap v14589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:12.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:12 smithi092 ceph-mon[29156]: pgmap v14590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:12.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:12 smithi189 ceph-mon[32756]: pgmap v14590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:12.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:12 smithi156 ceph-mon[32679]: pgmap v14590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:14 smithi092 ceph-mon[29156]: pgmap v14591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26509.793585 secs 2024-04-27T01:40:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25812.762809 secs 2024-04-27T01:40:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:14 smithi189 ceph-mon[32756]: pgmap v14591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26509.793585 secs 2024-04-27T01:40:14.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25812.762809 secs 2024-04-27T01:40:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:14 smithi156 ceph-mon[32679]: pgmap v14591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26509.793585 secs 2024-04-27T01:40:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25812.762809 secs 2024-04-27T01:40:16.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:16 smithi189 ceph-mon[32756]: pgmap v14592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:16.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:16 smithi156 ceph-mon[32679]: pgmap v14592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:16.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:16 smithi092 ceph-mon[29156]: pgmap v14592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:18.859 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:18 smithi092 ceph-mon[29156]: pgmap v14593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:18.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:18 smithi189 ceph-mon[32756]: pgmap v14593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:18.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:18 smithi156 ceph-mon[32679]: pgmap v14593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:19.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26514.793724 secs 2024-04-27T01:40:19.803 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25817.762963 secs 2024-04-27T01:40:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26514.793724 secs 2024-04-27T01:40:19.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25817.762963 secs 2024-04-27T01:40:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26514.793724 secs 2024-04-27T01:40:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25817.762963 secs 2024-04-27T01:40:20.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:20 smithi189 ceph-mon[32756]: pgmap v14594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:20.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:20 smithi156 ceph-mon[32679]: pgmap v14594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:20.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:20 smithi092 ceph-mon[29156]: pgmap v14594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:22.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:22 smithi189 ceph-mon[32756]: pgmap v14595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:22.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:22 smithi156 ceph-mon[32679]: pgmap v14595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:22.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:22 smithi092 ceph-mon[29156]: pgmap v14595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:24 smithi189 ceph-mon[32756]: pgmap v14596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26519.793861 secs 2024-04-27T01:40:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25822.763079 secs 2024-04-27T01:40:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:24 smithi156 ceph-mon[32679]: pgmap v14596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26519.793861 secs 2024-04-27T01:40:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25822.763079 secs 2024-04-27T01:40:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:24 smithi092 ceph-mon[29156]: pgmap v14596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26519.793861 secs 2024-04-27T01:40:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25822.763079 secs 2024-04-27T01:40:26.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:26 smithi189 ceph-mon[32756]: pgmap v14597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:26.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:26 smithi156 ceph-mon[32679]: pgmap v14597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:26.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:26 smithi092 ceph-mon[29156]: pgmap v14597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:28.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:28 smithi189 ceph-mon[32756]: pgmap v14598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:28.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:28 smithi156 ceph-mon[32679]: pgmap v14598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:28.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:28 smithi092 ceph-mon[29156]: pgmap v14598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:29.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26524.793973 secs 2024-04-27T01:40:29.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25827.763204 secs 2024-04-27T01:40:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26524.793973 secs 2024-04-27T01:40:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25827.763204 secs 2024-04-27T01:40:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26524.793973 secs 2024-04-27T01:40:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25827.763204 secs 2024-04-27T01:40:30.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:30 smithi189 ceph-mon[32756]: pgmap v14599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:30.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:30 smithi156 ceph-mon[32679]: pgmap v14599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:30.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:30 smithi092 ceph-mon[29156]: pgmap v14599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:32.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:32 smithi189 ceph-mon[32756]: pgmap v14600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:32.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:32 smithi156 ceph-mon[32679]: pgmap v14600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:32.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:32 smithi092 ceph-mon[29156]: pgmap v14600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:34.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:34 smithi189 ceph-mon[32756]: pgmap v14601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:34.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26529.794081 secs 2024-04-27T01:40:34.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25832.763264 secs 2024-04-27T01:40:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:34 smithi156 ceph-mon[32679]: pgmap v14601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26529.794081 secs 2024-04-27T01:40:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25832.763264 secs 2024-04-27T01:40:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:34 smithi092 ceph-mon[29156]: pgmap v14601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26529.794081 secs 2024-04-27T01:40:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25832.763264 secs 2024-04-27T01:40:36.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:36 smithi189 ceph-mon[32756]: pgmap v14602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:36.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:36 smithi156 ceph-mon[32679]: pgmap v14602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:36.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:36 smithi092 ceph-mon[29156]: pgmap v14602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:40:38.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:38 smithi189 ceph-mon[32756]: pgmap v14603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:38.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:38 smithi156 ceph-mon[32679]: pgmap v14603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:38.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:38 smithi092 ceph-mon[29156]: pgmap v14603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:39.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26534.794196 secs 2024-04-27T01:40:39.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:39 smithi189 ceph-mon[32756]: slow request 1441.258351 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:40:39.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25837.763391 secs 2024-04-27T01:40:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26534.794196 secs 2024-04-27T01:40:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:39 smithi156 ceph-mon[32679]: slow request 1441.258351 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:40:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25837.763391 secs 2024-04-27T01:40:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26534.794196 secs 2024-04-27T01:40:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:39 smithi092 ceph-mon[29156]: slow request 1441.258351 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:40:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25837.763391 secs 2024-04-27T01:40:40.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:40 smithi189 ceph-mon[32756]: pgmap v14604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:40.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:40 smithi156 ceph-mon[32679]: pgmap v14604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:40.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:40 smithi092 ceph-mon[29156]: pgmap v14604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:42.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:42 smithi189 ceph-mon[32756]: pgmap v14605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:42.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:42 smithi156 ceph-mon[32679]: pgmap v14605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:42.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:42 smithi092 ceph-mon[29156]: pgmap v14605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:44 smithi189 ceph-mon[32756]: pgmap v14606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26539.794292 secs 2024-04-27T01:40:44.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25842.763457 secs 2024-04-27T01:40:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:44 smithi156 ceph-mon[32679]: pgmap v14606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26539.794292 secs 2024-04-27T01:40:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25842.763457 secs 2024-04-27T01:40:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:44 smithi092 ceph-mon[29156]: pgmap v14606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:40:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26539.794292 secs 2024-04-27T01:40:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25842.763457 secs 2024-04-27T01:40:45.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:40:45.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:40:45.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:40:46.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:46 smithi189 ceph-mon[32756]: pgmap v14607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:46.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:40:46.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:40:46.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:40:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:46 smithi156 ceph-mon[32679]: pgmap v14607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:40:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:40:46.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:40:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:46 smithi092 ceph-mon[29156]: pgmap v14607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:40:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:40:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:40:46.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:40:47.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:47 smithi189 ceph-mon[32756]: pgmap v14608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:40:47.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:47 smithi189 ceph-mon[32756]: pgmap v14609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:40:47.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:47 smithi156 ceph-mon[32679]: pgmap v14608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:40:47.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:47 smithi156 ceph-mon[32679]: pgmap v14609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:40:47.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:47 smithi092 ceph-mon[29156]: pgmap v14608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:40:47.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:47 smithi092 ceph-mon[29156]: pgmap v14609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T01:40:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:49 smithi189 ceph-mon[32756]: pgmap v14610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:40:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26544.794403 secs 2024-04-27T01:40:49.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25847.763573 secs 2024-04-27T01:40:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:49 smithi156 ceph-mon[32679]: pgmap v14610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:40:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26544.794403 secs 2024-04-27T01:40:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25847.763573 secs 2024-04-27T01:40:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:49 smithi092 ceph-mon[29156]: pgmap v14610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:40:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26544.794403 secs 2024-04-27T01:40:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25847.763573 secs 2024-04-27T01:40:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:51 smithi189 ceph-mon[32756]: pgmap v14611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:51.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:51 smithi156 ceph-mon[32679]: pgmap v14611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:51.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:51 smithi092 ceph-mon[29156]: pgmap v14611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:53.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:53 smithi156 ceph-mon[32679]: pgmap v14612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:53.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:53 smithi092 ceph-mon[29156]: pgmap v14612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:54.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:53 smithi189 ceph-mon[32756]: pgmap v14612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26549.794515 secs 2024-04-27T01:40:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25852.763679 secs 2024-04-27T01:40:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26549.794515 secs 2024-04-27T01:40:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25852.763679 secs 2024-04-27T01:40:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26549.794515 secs 2024-04-27T01:40:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25852.763679 secs 2024-04-27T01:40:55.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:55 smithi156 ceph-mon[32679]: pgmap v14613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:55.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:55 smithi092 ceph-mon[29156]: pgmap v14613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:56.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:55 smithi189 ceph-mon[32756]: pgmap v14613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:40:57.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:57 smithi156 ceph-mon[32679]: pgmap v14614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:40:57.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:57 smithi092 ceph-mon[29156]: pgmap v14614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:40:58.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:57 smithi189 ceph-mon[32756]: pgmap v14614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:40:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:59 smithi156 ceph-mon[32679]: pgmap v14615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26554.794640 secs 2024-04-27T01:40:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:40:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25857.763740 secs 2024-04-27T01:40:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:59 smithi092 ceph-mon[29156]: pgmap v14615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:40:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26554.794640 secs 2024-04-27T01:40:59.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:40:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25857.763740 secs 2024-04-27T01:41:00.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:59 smithi189 ceph-mon[32756]: pgmap v14615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:00.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26554.794640 secs 2024-04-27T01:41:00.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:40:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25857.763740 secs 2024-04-27T01:41:01.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:01 smithi156 ceph-mon[32679]: pgmap v14616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:01.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:01 smithi092 ceph-mon[29156]: pgmap v14616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:02.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:01 smithi189 ceph-mon[32756]: pgmap v14616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:03.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:03 smithi156 ceph-mon[32679]: pgmap v14617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:03.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:03 smithi092 ceph-mon[29156]: pgmap v14617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:04.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:03 smithi189 ceph-mon[32756]: pgmap v14617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26559.794771 secs 2024-04-27T01:41:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:04 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 25862.763805 secs 2024-04-27T01:41:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:04 smithi156 ceph-mon[32679]: slow request 23041.974282 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:41:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26559.794771 secs 2024-04-27T01:41:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:04 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 25862.763805 secs 2024-04-27T01:41:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:04 smithi092 ceph-mon[29156]: slow request 23041.974282 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:41:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26559.794771 secs 2024-04-27T01:41:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:04 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 25862.763805 secs 2024-04-27T01:41:05.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:04 smithi189 ceph-mon[32756]: slow request 23041.974282 seconds old, received at 2024-04-26T19:17:01.935557+0000: client_request(client.16908:1 getattr pAsLsXsFs #0x1 2024-04-26T19:17:01.931639+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:41:05.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:05 smithi156 ceph-mon[32679]: pgmap v14618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:05.963 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:05 smithi092 ceph-mon[29156]: pgmap v14618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:06.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:05 smithi189 ceph-mon[32756]: pgmap v14618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:07.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:07 smithi156 ceph-mon[32679]: pgmap v14619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:07.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:07 smithi092 ceph-mon[29156]: pgmap v14619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:08.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:07 smithi189 ceph-mon[32756]: pgmap v14619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:09 smithi156 ceph-mon[32679]: pgmap v14620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26564.794889 secs 2024-04-27T01:41:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25867.763917 secs 2024-04-27T01:41:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:09 smithi092 ceph-mon[29156]: pgmap v14620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26564.794889 secs 2024-04-27T01:41:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25867.763917 secs 2024-04-27T01:41:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:09 smithi189 ceph-mon[32756]: pgmap v14620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26564.794889 secs 2024-04-27T01:41:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25867.763917 secs 2024-04-27T01:41:11.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:11 smithi156 ceph-mon[32679]: pgmap v14621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:11.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:11 smithi092 ceph-mon[29156]: pgmap v14621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:12.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:11 smithi189 ceph-mon[32756]: pgmap v14621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:13.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:13 smithi156 ceph-mon[32679]: pgmap v14622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:13.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:13 smithi092 ceph-mon[29156]: pgmap v14622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:14.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:13 smithi189 ceph-mon[32756]: pgmap v14622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26569.795016 secs 2024-04-27T01:41:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25872.764086 secs 2024-04-27T01:41:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26569.795016 secs 2024-04-27T01:41:15.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25872.764086 secs 2024-04-27T01:41:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26569.795016 secs 2024-04-27T01:41:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25872.764086 secs 2024-04-27T01:41:15.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:15 smithi092 ceph-mon[29156]: pgmap v14623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:16.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:15 smithi189 ceph-mon[32756]: pgmap v14623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:16.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:15 smithi156 ceph-mon[32679]: pgmap v14623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:17.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:17 smithi092 ceph-mon[29156]: pgmap v14624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:18.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:17 smithi189 ceph-mon[32756]: pgmap v14624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:18.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:17 smithi156 ceph-mon[32679]: pgmap v14624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:19 smithi092 ceph-mon[29156]: pgmap v14625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26574.795141 secs 2024-04-27T01:41:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25877.764193 secs 2024-04-27T01:41:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:19 smithi189 ceph-mon[32756]: pgmap v14625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26574.795141 secs 2024-04-27T01:41:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25877.764193 secs 2024-04-27T01:41:20.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:19 smithi156 ceph-mon[32679]: pgmap v14625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:20.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26574.795141 secs 2024-04-27T01:41:20.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25877.764193 secs 2024-04-27T01:41:21.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:21 smithi092 ceph-mon[29156]: pgmap v14626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:22.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:21 smithi189 ceph-mon[32756]: pgmap v14626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:22.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:21 smithi156 ceph-mon[32679]: pgmap v14626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:23.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:23 smithi156 ceph-mon[32679]: pgmap v14627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:23.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:23 smithi092 ceph-mon[29156]: pgmap v14627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:24.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:23 smithi189 ceph-mon[32756]: pgmap v14627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26579.795217 secs 2024-04-27T01:41:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25882.764318 secs 2024-04-27T01:41:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26579.795217 secs 2024-04-27T01:41:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25882.764318 secs 2024-04-27T01:41:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26579.795217 secs 2024-04-27T01:41:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25882.764318 secs 2024-04-27T01:41:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:25 smithi092 ceph-mon[29156]: pgmap v14628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:26.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:25 smithi189 ceph-mon[32756]: pgmap v14628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:26.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:25 smithi156 ceph-mon[32679]: pgmap v14628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:27.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:27 smithi092 ceph-mon[29156]: pgmap v14629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:28.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:27 smithi189 ceph-mon[32756]: pgmap v14629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:28.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:27 smithi156 ceph-mon[32679]: pgmap v14629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:29 smithi092 ceph-mon[29156]: pgmap v14630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26584.795333 secs 2024-04-27T01:41:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25887.764439 secs 2024-04-27T01:41:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:29 smithi189 ceph-mon[32756]: pgmap v14630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26584.795333 secs 2024-04-27T01:41:30.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25887.764439 secs 2024-04-27T01:41:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:29 smithi156 ceph-mon[32679]: pgmap v14630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26584.795333 secs 2024-04-27T01:41:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25887.764439 secs 2024-04-27T01:41:31.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:31 smithi092 ceph-mon[29156]: pgmap v14631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:32.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:31 smithi189 ceph-mon[32756]: pgmap v14631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:32.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:31 smithi156 ceph-mon[32679]: pgmap v14631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:33.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:33 smithi092 ceph-mon[29156]: pgmap v14632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:34.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:33 smithi189 ceph-mon[32756]: pgmap v14632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:34.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:33 smithi156 ceph-mon[32679]: pgmap v14632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26589.795468 secs 2024-04-27T01:41:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25892.764530 secs 2024-04-27T01:41:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26589.795468 secs 2024-04-27T01:41:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25892.764530 secs 2024-04-27T01:41:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26589.795468 secs 2024-04-27T01:41:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25892.764530 secs 2024-04-27T01:41:35.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:35 smithi092 ceph-mon[29156]: pgmap v14633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:36.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:35 smithi189 ceph-mon[32756]: pgmap v14633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:36.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:35 smithi156 ceph-mon[32679]: pgmap v14633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:37.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:37 smithi092 ceph-mon[29156]: pgmap v14634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:38.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:37 smithi189 ceph-mon[32756]: pgmap v14634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:38.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:37 smithi156 ceph-mon[32679]: pgmap v14634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:39 smithi092 ceph-mon[29156]: pgmap v14635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26594.795604 secs 2024-04-27T01:41:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25897.764650 secs 2024-04-27T01:41:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:39 smithi189 ceph-mon[32756]: pgmap v14635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26594.795604 secs 2024-04-27T01:41:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25897.764650 secs 2024-04-27T01:41:40.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:39 smithi156 ceph-mon[32679]: pgmap v14635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:40.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26594.795604 secs 2024-04-27T01:41:40.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25897.764650 secs 2024-04-27T01:41:42.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:41 smithi189 ceph-mon[32756]: pgmap v14636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:42.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:41 smithi156 ceph-mon[32679]: pgmap v14636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:42.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:41 smithi092 ceph-mon[29156]: pgmap v14636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:43.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:42 smithi189 ceph-mon[32756]: pgmap v14637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:43.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:42 smithi156 ceph-mon[32679]: pgmap v14637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:43.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:42 smithi092 ceph-mon[29156]: pgmap v14637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:44.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25902.764767 secs 2024-04-27T01:41:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25902.764767 secs 2024-04-27T01:41:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25902.764767 secs 2024-04-27T01:41:45.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26599.795736 secs 2024-04-27T01:41:45.476 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:45 smithi092 ceph-mon[29156]: pgmap v14638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:45.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26599.795736 secs 2024-04-27T01:41:45.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:45 smithi189 ceph-mon[32756]: pgmap v14638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:45.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26599.795736 secs 2024-04-27T01:41:45.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:45 smithi156 ceph-mon[32679]: pgmap v14638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:41:47.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:47 smithi189 ceph-mon[32756]: pgmap v14639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:47.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:41:47.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:41:47.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:41:47.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:41:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:47 smithi156 ceph-mon[32679]: pgmap v14639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:41:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:41:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:41:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:41:47.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:47 smithi092 ceph-mon[29156]: pgmap v14639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:41:47.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:41:47.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:41:47.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:41:47.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:41:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:48 smithi189 ceph-mon[32756]: pgmap v14640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:41:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:48 smithi189 ceph-mon[32756]: pgmap v14641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:48 smithi156 ceph-mon[32679]: pgmap v14640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:41:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:48 smithi156 ceph-mon[32679]: pgmap v14641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:48 smithi092 ceph-mon[29156]: pgmap v14640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:41:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:48 smithi092 ceph-mon[29156]: pgmap v14641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:49.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26604.795859 secs 2024-04-27T01:41:49.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25907.764908 secs 2024-04-27T01:41:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26604.795859 secs 2024-04-27T01:41:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25907.764908 secs 2024-04-27T01:41:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26604.795859 secs 2024-04-27T01:41:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25907.764908 secs 2024-04-27T01:41:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:50 smithi189 ceph-mon[32756]: pgmap v14642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:50 smithi156 ceph-mon[32679]: pgmap v14642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:50 smithi092 ceph-mon[29156]: pgmap v14642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:52.555 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:52 smithi092 ceph-mon[29156]: pgmap v14643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:52.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:52 smithi189 ceph-mon[32756]: pgmap v14643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:52.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:52 smithi156 ceph-mon[32679]: pgmap v14643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:54.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:54 smithi189 ceph-mon[32756]: pgmap v14644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:41:54.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26609.795978 secs 2024-04-27T01:41:54.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25912.765024 secs 2024-04-27T01:41:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:54 smithi156 ceph-mon[32679]: pgmap v14644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:41:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26609.795978 secs 2024-04-27T01:41:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25912.765024 secs 2024-04-27T01:41:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:54 smithi092 ceph-mon[29156]: pgmap v14644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:41:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26609.795978 secs 2024-04-27T01:41:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25912.765024 secs 2024-04-27T01:41:56.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:56 smithi189 ceph-mon[32756]: pgmap v14645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:56.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:56 smithi156 ceph-mon[32679]: pgmap v14645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:56 smithi092 ceph-mon[29156]: pgmap v14645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:41:58.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:58 smithi189 ceph-mon[32756]: pgmap v14646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:41:58.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:58 smithi156 ceph-mon[32679]: pgmap v14646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:41:58.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:58 smithi092 ceph-mon[29156]: pgmap v14646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:41:59.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26614.796096 secs 2024-04-27T01:41:59.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:41:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25917.765143 secs 2024-04-27T01:41:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26614.796096 secs 2024-04-27T01:41:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:41:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25917.765143 secs 2024-04-27T01:41:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26614.796096 secs 2024-04-27T01:41:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:41:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25917.765143 secs 2024-04-27T01:42:00.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:00 smithi189 ceph-mon[32756]: pgmap v14647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:00.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:00 smithi156 ceph-mon[32679]: pgmap v14647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:00.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:00 smithi092 ceph-mon[29156]: pgmap v14647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:02.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:02 smithi189 ceph-mon[32756]: pgmap v14648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:02.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:02 smithi156 ceph-mon[32679]: pgmap v14648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:02.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:02 smithi092 ceph-mon[29156]: pgmap v14648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:04.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:04 smithi189 ceph-mon[32756]: pgmap v14649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:04.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26619.796218 secs 2024-04-27T01:42:04.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25922.765234 secs 2024-04-27T01:42:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:04 smithi156 ceph-mon[32679]: pgmap v14649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26619.796218 secs 2024-04-27T01:42:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25922.765234 secs 2024-04-27T01:42:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:04 smithi092 ceph-mon[29156]: pgmap v14649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26619.796218 secs 2024-04-27T01:42:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25922.765234 secs 2024-04-27T01:42:06.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:06 smithi189 ceph-mon[32756]: pgmap v14650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:06.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:06 smithi156 ceph-mon[32679]: pgmap v14650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:06.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:06 smithi092 ceph-mon[29156]: pgmap v14650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:08.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:08 smithi189 ceph-mon[32756]: pgmap v14651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:08.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:08 smithi156 ceph-mon[32679]: pgmap v14651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:08.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:08 smithi092 ceph-mon[29156]: pgmap v14651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:09.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26624.796318 secs 2024-04-27T01:42:09.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25927.765362 secs 2024-04-27T01:42:09.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26624.796318 secs 2024-04-27T01:42:09.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25927.765362 secs 2024-04-27T01:42:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26624.796318 secs 2024-04-27T01:42:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25927.765362 secs 2024-04-27T01:42:10.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:10 smithi189 ceph-mon[32756]: pgmap v14652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:10.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:10 smithi156 ceph-mon[32679]: pgmap v14652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:10.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:10 smithi092 ceph-mon[29156]: pgmap v14652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:12.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:12 smithi189 ceph-mon[32756]: pgmap v14653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:12.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:12 smithi156 ceph-mon[32679]: pgmap v14653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:12.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:12 smithi092 ceph-mon[29156]: pgmap v14653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:14.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:14 smithi189 ceph-mon[32756]: pgmap v14654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:14.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26629.796431 secs 2024-04-27T01:42:14.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25932.765432 secs 2024-04-27T01:42:14.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:14 smithi156 ceph-mon[32679]: pgmap v14654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:14.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26629.796431 secs 2024-04-27T01:42:14.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25932.765432 secs 2024-04-27T01:42:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:14 smithi092 ceph-mon[29156]: pgmap v14654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26629.796431 secs 2024-04-27T01:42:14.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25932.765432 secs 2024-04-27T01:42:16.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:16 smithi189 ceph-mon[32756]: pgmap v14655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:16.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:16 smithi156 ceph-mon[32679]: pgmap v14655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:16.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:16 smithi092 ceph-mon[29156]: pgmap v14655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:18.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:18 smithi189 ceph-mon[32756]: pgmap v14656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:18.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:18 smithi156 ceph-mon[32679]: pgmap v14656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:18.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:18 smithi092 ceph-mon[29156]: pgmap v14656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:19.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26634.796569 secs 2024-04-27T01:42:19.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25937.765544 secs 2024-04-27T01:42:19.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26634.796569 secs 2024-04-27T01:42:19.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25937.765544 secs 2024-04-27T01:42:19.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26634.796569 secs 2024-04-27T01:42:19.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25937.765544 secs 2024-04-27T01:42:20.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:20 smithi189 ceph-mon[32756]: pgmap v14657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:20.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:20 smithi156 ceph-mon[32679]: pgmap v14657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:20.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:20 smithi092 ceph-mon[29156]: pgmap v14657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:22.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:22 smithi189 ceph-mon[32756]: pgmap v14658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:22.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:22 smithi156 ceph-mon[32679]: pgmap v14658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:22.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:22 smithi092 ceph-mon[29156]: pgmap v14658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:24.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:24 smithi189 ceph-mon[32756]: pgmap v14659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:24.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26639.796681 secs 2024-04-27T01:42:24.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25942.765654 secs 2024-04-27T01:42:24.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:24 smithi156 ceph-mon[32679]: pgmap v14659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:24.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26639.796681 secs 2024-04-27T01:42:24.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25942.765654 secs 2024-04-27T01:42:24.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:24 smithi092 ceph-mon[29156]: pgmap v14659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:24.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26639.796681 secs 2024-04-27T01:42:24.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25942.765654 secs 2024-04-27T01:42:26.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:26 smithi189 ceph-mon[32756]: pgmap v14660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:26.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:26 smithi156 ceph-mon[32679]: pgmap v14660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:26.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:26 smithi092 ceph-mon[29156]: pgmap v14660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:28.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:28 smithi189 ceph-mon[32756]: pgmap v14661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:28.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:28 smithi156 ceph-mon[32679]: pgmap v14661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:28.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:28 smithi092 ceph-mon[29156]: pgmap v14661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:29.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26644.796800 secs 2024-04-27T01:42:29.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25947.765716 secs 2024-04-27T01:42:29.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26644.796800 secs 2024-04-27T01:42:29.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25947.765716 secs 2024-04-27T01:42:29.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26644.796800 secs 2024-04-27T01:42:29.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25947.765716 secs 2024-04-27T01:42:30.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:30 smithi189 ceph-mon[32756]: pgmap v14662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:30.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:30 smithi156 ceph-mon[32679]: pgmap v14662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:30.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:30 smithi092 ceph-mon[29156]: pgmap v14662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:32.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:32 smithi189 ceph-mon[32756]: pgmap v14663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:32.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:32 smithi156 ceph-mon[32679]: pgmap v14663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:32.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:32 smithi092 ceph-mon[29156]: pgmap v14663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:34.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:34 smithi189 ceph-mon[32756]: pgmap v14664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:34.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26649.796918 secs 2024-04-27T01:42:34.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25952.765794 secs 2024-04-27T01:42:34.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:34 smithi156 ceph-mon[32679]: pgmap v14664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:34.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26649.796918 secs 2024-04-27T01:42:34.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25952.765794 secs 2024-04-27T01:42:34.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:34 smithi092 ceph-mon[29156]: pgmap v14664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:34.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26649.796918 secs 2024-04-27T01:42:34.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25952.765794 secs 2024-04-27T01:42:36.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:36 smithi189 ceph-mon[32756]: pgmap v14665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:36.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:36 smithi156 ceph-mon[32679]: pgmap v14665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:36.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:36 smithi092 ceph-mon[29156]: pgmap v14665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:42:38.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:38 smithi189 ceph-mon[32756]: pgmap v14666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:38.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:38 smithi156 ceph-mon[32679]: pgmap v14666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:38.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:38 smithi092 ceph-mon[29156]: pgmap v14666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:42:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26654.796984 secs 2024-04-27T01:42:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25957.765918 secs 2024-04-27T01:42:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:42:39.642+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:42:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:42:39.642+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:42:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:42:39.642+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:42:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:42:39.642+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 206 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:42:39.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26654.796984 secs 2024-04-27T01:42:39.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25957.765918 secs 2024-04-27T01:42:39.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26654.796984 secs 2024-04-27T01:42:39.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25957.765918 secs 2024-04-27T01:42:40.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:40 smithi189 ceph-mon[32756]: pgmap v14667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:40.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:40 smithi156 ceph-mon[32679]: pgmap v14667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:40.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:40 smithi092 ceph-mon[29156]: pgmap v14667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:42 smithi189 ceph-mon[32756]: pgmap v14668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:42.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:42 smithi156 ceph-mon[32679]: pgmap v14668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:42.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:42 smithi092 ceph-mon[29156]: pgmap v14668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:44 smithi189 ceph-mon[32756]: pgmap v14669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26659.797049 secs 2024-04-27T01:42:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25962.765997 secs 2024-04-27T01:42:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:44 smithi156 ceph-mon[32679]: pgmap v14669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26659.797049 secs 2024-04-27T01:42:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25962.765997 secs 2024-04-27T01:42:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:44 smithi092 ceph-mon[29156]: pgmap v14669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26659.797049 secs 2024-04-27T01:42:44.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25962.765997 secs 2024-04-27T01:42:46.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:46 smithi189 ceph-mon[32756]: pgmap v14670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:46.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:46 smithi156 ceph-mon[32679]: pgmap v14670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:46.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:46 smithi092 ceph-mon[29156]: pgmap v14670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T01:42:47.622 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:42:47.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:42:47.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:42:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: pgmap v14671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:42:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:42:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: pgmap v14672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:42:48.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: pgmap v14673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:42:48.621 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: pgmap v14671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: pgmap v14672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: pgmap v14673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:42:48.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: pgmap v14671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: pgmap v14672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 190 B/s wr, 3 op/s 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: pgmap v14673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:42:48.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:42:49.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26664.797145 secs 2024-04-27T01:42:49.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25967.766109 secs 2024-04-27T01:42:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26664.797145 secs 2024-04-27T01:42:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25967.766109 secs 2024-04-27T01:42:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26664.797145 secs 2024-04-27T01:42:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25967.766109 secs 2024-04-27T01:42:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:50 smithi189 ceph-mon[32756]: pgmap v14674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:50 smithi156 ceph-mon[32679]: pgmap v14674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:50 smithi092 ceph-mon[29156]: pgmap v14674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:52.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:51 smithi189 ceph-mon[32756]: pgmap v14675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:52.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:51 smithi156 ceph-mon[32679]: pgmap v14675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:52.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:51 smithi092 ceph-mon[29156]: pgmap v14675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:54.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:53 smithi189 ceph-mon[32756]: pgmap v14676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:54.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:53 smithi156 ceph-mon[32679]: pgmap v14676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:54.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:53 smithi092 ceph-mon[29156]: pgmap v14676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:55.067 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26669.797257 secs 2024-04-27T01:42:55.067 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25972.766230 secs 2024-04-27T01:42:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26669.797257 secs 2024-04-27T01:42:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25972.766230 secs 2024-04-27T01:42:55.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26669.797257 secs 2024-04-27T01:42:55.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25972.766230 secs 2024-04-27T01:42:56.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:55 smithi189 ceph-mon[32756]: pgmap v14677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:56.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:55 smithi156 ceph-mon[32679]: pgmap v14677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:56.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:55 smithi092 ceph-mon[29156]: pgmap v14677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:42:58.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:57 smithi189 ceph-mon[32756]: pgmap v14678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:42:58.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:57 smithi156 ceph-mon[32679]: pgmap v14678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:42:58.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:57 smithi092 ceph-mon[29156]: pgmap v14678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:42:59.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:42:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25977.766407 secs 2024-04-27T01:42:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:42:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25977.766407 secs 2024-04-27T01:42:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:42:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25977.766407 secs 2024-04-27T01:43:00.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26674.797386 secs 2024-04-27T01:43:00.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:00 smithi189 ceph-mon[32756]: pgmap v14679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:00.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26674.797386 secs 2024-04-27T01:43:00.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:00 smithi156 ceph-mon[32679]: pgmap v14679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:00.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26674.797386 secs 2024-04-27T01:43:00.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:00 smithi092 ceph-mon[29156]: pgmap v14679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:02.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:01 smithi189 ceph-mon[32756]: pgmap v14680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:02.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:01 smithi156 ceph-mon[32679]: pgmap v14680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:02.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:01 smithi092 ceph-mon[29156]: pgmap v14680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:04.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:03 smithi189 ceph-mon[32756]: pgmap v14681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:04.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:03 smithi156 ceph-mon[32679]: pgmap v14681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:04.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:03 smithi092 ceph-mon[29156]: pgmap v14681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26679.797487 secs 2024-04-27T01:43:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25982.766499 secs 2024-04-27T01:43:05.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26679.797487 secs 2024-04-27T01:43:05.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25982.766499 secs 2024-04-27T01:43:05.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26679.797487 secs 2024-04-27T01:43:05.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25982.766499 secs 2024-04-27T01:43:06.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:05 smithi189 ceph-mon[32756]: pgmap v14682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:06.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:05 smithi156 ceph-mon[32679]: pgmap v14682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:06.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:05 smithi092 ceph-mon[29156]: pgmap v14682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:08.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:07 smithi189 ceph-mon[32756]: pgmap v14683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:08.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:07 smithi156 ceph-mon[32679]: pgmap v14683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-mon[29156]: pgmap v14683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:43:07.926+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:43:07.926+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:43:07.926+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:43:07.926+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:43:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:43:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:43:07.926+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:43:09.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25987.766615 secs 2024-04-27T01:43:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25987.766615 secs 2024-04-27T01:43:09.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25987.766615 secs 2024-04-27T01:43:10.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26684.797622 secs 2024-04-27T01:43:10.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:10 smithi189 ceph-mon[32756]: pgmap v14684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:10.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26684.797622 secs 2024-04-27T01:43:10.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:10 smithi156 ceph-mon[32679]: pgmap v14684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:10.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26684.797622 secs 2024-04-27T01:43:10.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:10 smithi092 ceph-mon[29156]: pgmap v14684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:12.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:11 smithi189 ceph-mon[32756]: pgmap v14685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:12.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:11 smithi156 ceph-mon[32679]: pgmap v14685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:12.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:11 smithi092 ceph-mon[29156]: pgmap v14685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:14.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:13 smithi189 ceph-mon[32756]: pgmap v14686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:14.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:13 smithi156 ceph-mon[32679]: pgmap v14686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:13 smithi092 ceph-mon[29156]: pgmap v14686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26689.797738 secs 2024-04-27T01:43:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25992.766760 secs 2024-04-27T01:43:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26689.797738 secs 2024-04-27T01:43:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25992.766760 secs 2024-04-27T01:43:15.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26689.797738 secs 2024-04-27T01:43:15.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25992.766760 secs 2024-04-27T01:43:16.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:15 smithi189 ceph-mon[32756]: pgmap v14687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:16.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:15 smithi156 ceph-mon[32679]: pgmap v14687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:16.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:15 smithi092 ceph-mon[29156]: pgmap v14687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:18.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:17 smithi189 ceph-mon[32756]: pgmap v14688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:18.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:17 smithi156 ceph-mon[32679]: pgmap v14688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:18.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:17 smithi092 ceph-mon[29156]: pgmap v14688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T01:43:19.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 25997.766881 secs 2024-04-27T01:43:19.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 25997.766881 secs 2024-04-27T01:43:19.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 25997.766881 secs 2024-04-27T01:43:20.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26694.797896 secs 2024-04-27T01:43:20.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:20 smithi189 ceph-mon[32756]: pgmap v14689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:20.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26694.797896 secs 2024-04-27T01:43:20.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:20 smithi156 ceph-mon[32679]: pgmap v14689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:20.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26694.797896 secs 2024-04-27T01:43:20.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:20 smithi092 ceph-mon[29156]: pgmap v14689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T01:43:22.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:21 smithi189 ceph-mon[32756]: pgmap v14690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:22.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:21 smithi156 ceph-mon[32679]: pgmap v14690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:22.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:21 smithi092 ceph-mon[29156]: pgmap v14690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:24.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:23 smithi189 ceph-mon[32756]: pgmap v14691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:43:24.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:23 smithi156 ceph-mon[32679]: pgmap v14691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:43:24.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:23 smithi092 ceph-mon[29156]: pgmap v14691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:43:25.068 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26699.798001 secs 2024-04-27T01:43:25.068 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26002.766962 secs 2024-04-27T01:43:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26699.798001 secs 2024-04-27T01:43:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26002.766962 secs 2024-04-27T01:43:25.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26699.798001 secs 2024-04-27T01:43:25.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26002.766962 secs 2024-04-27T01:43:26.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:25 smithi189 ceph-mon[32756]: pgmap v14692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:26.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:25 smithi092 ceph-mon[29156]: pgmap v14692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:26.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:25 smithi156 ceph-mon[32679]: pgmap v14692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:28.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:27 smithi189 ceph-mon[32756]: pgmap v14693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:28.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:27 smithi156 ceph-mon[32679]: pgmap v14693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:28.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:27 smithi092 ceph-mon[29156]: pgmap v14693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:29.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26007.767119 secs 2024-04-27T01:43:29.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26007.767119 secs 2024-04-27T01:43:29.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26007.767119 secs 2024-04-27T01:43:30.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26704.798124 secs 2024-04-27T01:43:30.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:30 smithi189 ceph-mon[32756]: pgmap v14694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:30.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26704.798124 secs 2024-04-27T01:43:30.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:30 smithi156 ceph-mon[32679]: pgmap v14694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:30.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26704.798124 secs 2024-04-27T01:43:30.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:30 smithi092 ceph-mon[29156]: pgmap v14694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:32.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:31 smithi189 ceph-mon[32756]: pgmap v14695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:32.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:31 smithi156 ceph-mon[32679]: pgmap v14695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:32.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:31 smithi092 ceph-mon[29156]: pgmap v14695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:34.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:33 smithi189 ceph-mon[32756]: pgmap v14696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:34.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:33 smithi156 ceph-mon[32679]: pgmap v14696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:34.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:33 smithi092 ceph-mon[29156]: pgmap v14696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26709.798197 secs 2024-04-27T01:43:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26012.767233 secs 2024-04-27T01:43:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26709.798197 secs 2024-04-27T01:43:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26012.767233 secs 2024-04-27T01:43:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26709.798197 secs 2024-04-27T01:43:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26012.767233 secs 2024-04-27T01:43:36.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:35 smithi189 ceph-mon[32756]: pgmap v14697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:36.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:35 smithi156 ceph-mon[32679]: pgmap v14697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:36.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:35 smithi092 ceph-mon[29156]: pgmap v14697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:38.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:37 smithi189 ceph-mon[32756]: pgmap v14698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:38.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:37 smithi156 ceph-mon[32679]: pgmap v14698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:38.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:37 smithi092 ceph-mon[29156]: pgmap v14698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:39 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 26017.767349 secs 2024-04-27T01:43:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:39 smithi189 ceph-mon[32756]: slow request 2881.811668 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:43:39.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:39 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 26017.767349 secs 2024-04-27T01:43:39.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:39 smithi156 ceph-mon[32679]: slow request 2881.811668 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:43:39.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:39 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 26017.767349 secs 2024-04-27T01:43:39.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:39 smithi092 ceph-mon[29156]: slow request 2881.811668 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:43:40.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26714.798276 secs 2024-04-27T01:43:40.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:40 smithi189 ceph-mon[32756]: pgmap v14699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:40.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26714.798276 secs 2024-04-27T01:43:40.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:40 smithi156 ceph-mon[32679]: pgmap v14699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:40.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26714.798276 secs 2024-04-27T01:43:40.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:40 smithi092 ceph-mon[29156]: pgmap v14699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:41.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:41 smithi092 ceph-mon[29156]: pgmap v14700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:42.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:41 smithi189 ceph-mon[32756]: pgmap v14700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:42.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:41 smithi156 ceph-mon[32679]: pgmap v14700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:44.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:43 smithi189 ceph-mon[32756]: pgmap v14701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:44.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:43 smithi156 ceph-mon[32679]: pgmap v14701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:44.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:43 smithi092 ceph-mon[29156]: pgmap v14701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:43:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26719.798399 secs 2024-04-27T01:43:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26022.767453 secs 2024-04-27T01:43:45.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26719.798399 secs 2024-04-27T01:43:45.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26022.767453 secs 2024-04-27T01:43:45.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26719.798399 secs 2024-04-27T01:43:45.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26022.767453 secs 2024-04-27T01:43:46.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:45 smithi189 ceph-mon[32756]: pgmap v14702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:46.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:45 smithi156 ceph-mon[32679]: pgmap v14702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:46.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:45 smithi092 ceph-mon[29156]: pgmap v14702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:48.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:47 smithi189 ceph-mon[32756]: pgmap v14703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:48.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:47 smithi156 ceph-mon[32679]: pgmap v14703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:48.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:47 smithi092 ceph-mon[29156]: pgmap v14703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:43:49.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:43:49.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:43:49.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:43:49.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:48 smithi189 ceph-mon[32756]: pgmap v14704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:49.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:43:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:43:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:43:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:43:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:48 smithi156 ceph-mon[32679]: pgmap v14704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:43:49.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:43:49.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:43:49.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:43:49.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:48 smithi092 ceph-mon[29156]: pgmap v14704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:49.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:43:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26724.798513 secs 2024-04-27T01:43:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26027.767562 secs 2024-04-27T01:43:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26724.798513 secs 2024-04-27T01:43:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26027.767562 secs 2024-04-27T01:43:50.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26724.798513 secs 2024-04-27T01:43:50.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26027.767562 secs 2024-04-27T01:43:51.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:50 smithi189 ceph-mon[32756]: pgmap v14705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:51.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:50 smithi156 ceph-mon[32679]: pgmap v14705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:51.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:50 smithi092 ceph-mon[29156]: pgmap v14705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:53.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:53 smithi189 ceph-mon[32756]: pgmap v14706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:53.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:53 smithi156 ceph-mon[32679]: pgmap v14706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:53.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:53 smithi092 ceph-mon[29156]: pgmap v14706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26729.798631 secs 2024-04-27T01:43:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26032.767686 secs 2024-04-27T01:43:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26729.798631 secs 2024-04-27T01:43:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26032.767686 secs 2024-04-27T01:43:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26729.798631 secs 2024-04-27T01:43:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26032.767686 secs 2024-04-27T01:43:55.816 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:55 smithi156 ceph-mon[32679]: pgmap v14707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:55.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:55 smithi189 ceph-mon[32756]: pgmap v14707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:55.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:55 smithi092 ceph-mon[29156]: pgmap v14707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:57.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:57 smithi189 ceph-mon[32756]: pgmap v14708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:57.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:57 smithi156 ceph-mon[32679]: pgmap v14708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:57.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:57 smithi092 ceph-mon[29156]: pgmap v14708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:59 smithi189 ceph-mon[32756]: pgmap v14709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26734.798750 secs 2024-04-27T01:43:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:43:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26037.767805 secs 2024-04-27T01:43:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:59 smithi156 ceph-mon[32679]: pgmap v14709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26734.798750 secs 2024-04-27T01:43:59.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:43:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26037.767805 secs 2024-04-27T01:43:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:59 smithi092 ceph-mon[29156]: pgmap v14709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:43:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26734.798750 secs 2024-04-27T01:43:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:43:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26037.767805 secs 2024-04-27T01:44:01.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:01 smithi189 ceph-mon[32756]: pgmap v14710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:01.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:01 smithi156 ceph-mon[32679]: pgmap v14710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:01.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:01 smithi092 ceph-mon[29156]: pgmap v14710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:03.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:03 smithi189 ceph-mon[32756]: pgmap v14711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:03.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:03 smithi156 ceph-mon[32679]: pgmap v14711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:03.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:03 smithi092 ceph-mon[29156]: pgmap v14711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26739.798866 secs 2024-04-27T01:44:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26042.767924 secs 2024-04-27T01:44:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26739.798866 secs 2024-04-27T01:44:04.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26042.767924 secs 2024-04-27T01:44:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26739.798866 secs 2024-04-27T01:44:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26042.767924 secs 2024-04-27T01:44:05.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:05 smithi189 ceph-mon[32756]: pgmap v14712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:05.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:05 smithi156 ceph-mon[32679]: pgmap v14712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:05.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:05 smithi092 ceph-mon[29156]: pgmap v14712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:07.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:07 smithi189 ceph-mon[32756]: pgmap v14713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:07.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:07 smithi156 ceph-mon[32679]: pgmap v14713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:07.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:07 smithi092 ceph-mon[29156]: pgmap v14713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:44:09.655+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:44:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:44:09.655+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:44:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:44:09.655+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:44:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:44:09.655+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 207 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:44:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:09 smithi189 ceph-mon[32756]: pgmap v14714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26744.798983 secs 2024-04-27T01:44:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26047.768042 secs 2024-04-27T01:44:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:09 smithi156 ceph-mon[32679]: pgmap v14714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26744.798983 secs 2024-04-27T01:44:09.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26047.768042 secs 2024-04-27T01:44:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:09 smithi092 ceph-mon[29156]: pgmap v14714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26744.798983 secs 2024-04-27T01:44:09.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26047.768042 secs 2024-04-27T01:44:11.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:11 smithi189 ceph-mon[32756]: pgmap v14715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:11.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:11 smithi156 ceph-mon[32679]: pgmap v14715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:11.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:11 smithi092 ceph-mon[29156]: pgmap v14715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:13.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:13 smithi189 ceph-mon[32756]: pgmap v14716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:13.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:13 smithi156 ceph-mon[32679]: pgmap v14716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:13.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:13 smithi092 ceph-mon[29156]: pgmap v14716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:44:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26749.799062 secs 2024-04-27T01:44:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26052.768155 secs 2024-04-27T01:44:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26749.799062 secs 2024-04-27T01:44:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26052.768155 secs 2024-04-27T01:44:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26749.799062 secs 2024-04-27T01:44:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26052.768155 secs 2024-04-27T01:44:15.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:15 smithi189 ceph-mon[32756]: pgmap v14717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:15.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:15 smithi156 ceph-mon[32679]: pgmap v14717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:15.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:15 smithi092 ceph-mon[29156]: pgmap v14717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:44:17.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:17 smithi189 ceph-mon[32756]: pgmap v14718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:17.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:17 smithi156 ceph-mon[32679]: pgmap v14718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:17.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:17 smithi092 ceph-mon[29156]: pgmap v14718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:19 smithi189 ceph-mon[32756]: pgmap v14719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26754.799177 secs 2024-04-27T01:44:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26057.768262 secs 2024-04-27T01:44:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:19 smithi156 ceph-mon[32679]: pgmap v14719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26754.799177 secs 2024-04-27T01:44:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26057.768262 secs 2024-04-27T01:44:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:19 smithi092 ceph-mon[29156]: pgmap v14719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26754.799177 secs 2024-04-27T01:44:19.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26057.768262 secs 2024-04-27T01:44:21.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:21 smithi189 ceph-mon[32756]: pgmap v14720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:21.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:21 smithi156 ceph-mon[32679]: pgmap v14720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:21.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:21 smithi092 ceph-mon[29156]: pgmap v14720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:23.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:23 smithi189 ceph-mon[32756]: pgmap v14721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:23.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:23 smithi156 ceph-mon[32679]: pgmap v14721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:23.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:23 smithi092 ceph-mon[29156]: pgmap v14721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26759.799291 secs 2024-04-27T01:44:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26062.768373 secs 2024-04-27T01:44:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26759.799291 secs 2024-04-27T01:44:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26062.768373 secs 2024-04-27T01:44:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26759.799291 secs 2024-04-27T01:44:24.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26062.768373 secs 2024-04-27T01:44:25.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:25 smithi189 ceph-mon[32756]: pgmap v14722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:25.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:25 smithi156 ceph-mon[32679]: pgmap v14722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:25 smithi092 ceph-mon[29156]: pgmap v14722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:27.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:27 smithi189 ceph-mon[32756]: pgmap v14723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:27.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:27 smithi156 ceph-mon[32679]: pgmap v14723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:27.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:27 smithi092 ceph-mon[29156]: pgmap v14723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:29 smithi156 ceph-mon[32679]: pgmap v14724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26764.799395 secs 2024-04-27T01:44:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26067.768492 secs 2024-04-27T01:44:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:29 smithi092 ceph-mon[29156]: pgmap v14724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26764.799395 secs 2024-04-27T01:44:29.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26067.768492 secs 2024-04-27T01:44:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:29 smithi189 ceph-mon[32756]: pgmap v14724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26764.799395 secs 2024-04-27T01:44:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26067.768492 secs 2024-04-27T01:44:31.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:31 smithi156 ceph-mon[32679]: pgmap v14725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:31.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:31 smithi092 ceph-mon[29156]: pgmap v14725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:32.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:31 smithi189 ceph-mon[32756]: pgmap v14725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:33.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:33 smithi156 ceph-mon[32679]: pgmap v14726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:33.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:33 smithi092 ceph-mon[29156]: pgmap v14726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:34.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:33 smithi189 ceph-mon[32756]: pgmap v14726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26769.799507 secs 2024-04-27T01:44:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26072.768634 secs 2024-04-27T01:44:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26769.799507 secs 2024-04-27T01:44:34.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26072.768634 secs 2024-04-27T01:44:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26769.799507 secs 2024-04-27T01:44:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26072.768634 secs 2024-04-27T01:44:35.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:35 smithi156 ceph-mon[32679]: pgmap v14727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:35.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:35 smithi092 ceph-mon[29156]: pgmap v14727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:36.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:35 smithi189 ceph-mon[32756]: pgmap v14727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:44:37.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:37 smithi156 ceph-mon[32679]: pgmap v14728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:37.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:37 smithi092 ceph-mon[29156]: pgmap v14728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:38.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:37 smithi189 ceph-mon[32756]: pgmap v14728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:44:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:39 smithi156 ceph-mon[32679]: pgmap v14729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26774.799608 secs 2024-04-27T01:44:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26077.768713 secs 2024-04-27T01:44:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:39 smithi092 ceph-mon[29156]: pgmap v14729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26774.799608 secs 2024-04-27T01:44:39.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26077.768713 secs 2024-04-27T01:44:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:39 smithi189 ceph-mon[32756]: pgmap v14729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26774.799608 secs 2024-04-27T01:44:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26077.768713 secs 2024-04-27T01:44:41.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:41 smithi156 ceph-mon[32679]: pgmap v14730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:41.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:41 smithi092 ceph-mon[29156]: pgmap v14730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:42.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:41 smithi189 ceph-mon[32756]: pgmap v14730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:43.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:43 smithi156 ceph-mon[32679]: pgmap v14731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:43.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:43 smithi092 ceph-mon[29156]: pgmap v14731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:44.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:43 smithi189 ceph-mon[32756]: pgmap v14731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26779.799690 secs 2024-04-27T01:44:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26082.768879 secs 2024-04-27T01:44:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26779.799690 secs 2024-04-27T01:44:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26082.768879 secs 2024-04-27T01:44:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26779.799690 secs 2024-04-27T01:44:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26082.768879 secs 2024-04-27T01:44:45.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:45 smithi156 ceph-mon[32679]: pgmap v14732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:45.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:45 smithi092 ceph-mon[29156]: pgmap v14732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:46.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:45 smithi189 ceph-mon[32756]: pgmap v14732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:47.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:47 smithi156 ceph-mon[32679]: pgmap v14733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:47.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:47 smithi092 ceph-mon[29156]: pgmap v14733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:48.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:47 smithi189 ceph-mon[32756]: pgmap v14733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:44:48.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:44:49.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:44:49.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:44:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: pgmap v14734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26784.799781 secs 2024-04-27T01:44:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26087.768950 secs 2024-04-27T01:44:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:44:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:44:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: pgmap v14734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26784.799781 secs 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26087.768950 secs 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:44:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: pgmap v14734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26784.799781 secs 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26087.768950 secs 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:44:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:44:50.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:50 smithi092 ceph-mon[29156]: pgmap v14735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:44:50.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:50 smithi092 ceph-mon[29156]: pgmap v14736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:51.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:50 smithi189 ceph-mon[32756]: pgmap v14735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:44:51.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:50 smithi189 ceph-mon[32756]: pgmap v14736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:51.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:50 smithi156 ceph-mon[32679]: pgmap v14735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:44:51.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:50 smithi156 ceph-mon[32679]: pgmap v14736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:52 smithi092 ceph-mon[29156]: pgmap v14737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:52 smithi189 ceph-mon[32756]: pgmap v14737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:52 smithi156 ceph-mon[32679]: pgmap v14737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:54 smithi092 ceph-mon[29156]: pgmap v14738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26789.799899 secs 2024-04-27T01:44:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26092.769084 secs 2024-04-27T01:44:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:54 smithi189 ceph-mon[32756]: pgmap v14738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26789.799899 secs 2024-04-27T01:44:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26092.769084 secs 2024-04-27T01:44:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:54 smithi156 ceph-mon[32679]: pgmap v14738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:55.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26789.799899 secs 2024-04-27T01:44:55.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26092.769084 secs 2024-04-27T01:44:56.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:56 smithi156 ceph-mon[32679]: pgmap v14739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:56.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:56 smithi092 ceph-mon[29156]: pgmap v14739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:57.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:56 smithi189 ceph-mon[32756]: pgmap v14739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:44:58.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:58 smithi092 ceph-mon[29156]: pgmap v14740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:59.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:58 smithi189 ceph-mon[32756]: pgmap v14740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:59.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:58 smithi156 ceph-mon[32679]: pgmap v14740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:44:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26794.799962 secs 2024-04-27T01:44:59.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:44:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26097.769212 secs 2024-04-27T01:45:00.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26794.799962 secs 2024-04-27T01:45:00.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:44:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26097.769212 secs 2024-04-27T01:45:00.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26794.799962 secs 2024-04-27T01:45:00.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:44:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26097.769212 secs 2024-04-27T01:45:00.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:00 smithi092 ceph-mon[29156]: pgmap v14741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:45:01.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:00 smithi189 ceph-mon[32756]: pgmap v14741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:45:01.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:00 smithi156 ceph-mon[32679]: pgmap v14741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:45:02.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:02 smithi092 ceph-mon[29156]: pgmap v14742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:03.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:02 smithi189 ceph-mon[32756]: pgmap v14742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:03.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:02 smithi156 ceph-mon[32679]: pgmap v14742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:04 smithi092 ceph-mon[29156]: pgmap v14743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26799.800084 secs 2024-04-27T01:45:04.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26102.769346 secs 2024-04-27T01:45:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:04 smithi189 ceph-mon[32756]: pgmap v14743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26799.800084 secs 2024-04-27T01:45:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26102.769346 secs 2024-04-27T01:45:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:04 smithi156 ceph-mon[32679]: pgmap v14743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:05.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26799.800084 secs 2024-04-27T01:45:05.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26102.769346 secs 2024-04-27T01:45:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:06 smithi092 ceph-mon[29156]: pgmap v14744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:07.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:06 smithi189 ceph-mon[32756]: pgmap v14744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:07.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:06 smithi156 ceph-mon[32679]: pgmap v14744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:08.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:08 smithi092 ceph-mon[29156]: pgmap v14745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:09.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:08 smithi189 ceph-mon[32756]: pgmap v14745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:08 smithi156 ceph-mon[32679]: pgmap v14745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26804.800200 secs 2024-04-27T01:45:09.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26107.769468 secs 2024-04-27T01:45:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26804.800200 secs 2024-04-27T01:45:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26107.769468 secs 2024-04-27T01:45:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26804.800200 secs 2024-04-27T01:45:10.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26107.769468 secs 2024-04-27T01:45:10.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:10 smithi092 ceph-mon[29156]: pgmap v14746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:11.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:10 smithi189 ceph-mon[32756]: pgmap v14746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:11.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:10 smithi156 ceph-mon[32679]: pgmap v14746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:12.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:12 smithi092 ceph-mon[29156]: pgmap v14747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:13.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:12 smithi189 ceph-mon[32756]: pgmap v14747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:13.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:12 smithi156 ceph-mon[32679]: pgmap v14747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:14 smithi092 ceph-mon[29156]: pgmap v14748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26809.800330 secs 2024-04-27T01:45:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26112.769587 secs 2024-04-27T01:45:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:14 smithi189 ceph-mon[32756]: pgmap v14748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26809.800330 secs 2024-04-27T01:45:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26112.769587 secs 2024-04-27T01:45:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:14 smithi156 ceph-mon[32679]: pgmap v14748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26809.800330 secs 2024-04-27T01:45:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26112.769587 secs 2024-04-27T01:45:17.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:16 smithi189 ceph-mon[32756]: pgmap v14749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:17.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:16 smithi156 ceph-mon[32679]: pgmap v14749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:17.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:16 smithi092 ceph-mon[29156]: pgmap v14749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:19.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:18 smithi189 ceph-mon[32756]: pgmap v14750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:19.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:18 smithi156 ceph-mon[32679]: pgmap v14750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:19.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:18 smithi092 ceph-mon[29156]: pgmap v14750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26814.800445 secs 2024-04-27T01:45:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26117.769678 secs 2024-04-27T01:45:20.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26814.800445 secs 2024-04-27T01:45:20.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26117.769678 secs 2024-04-27T01:45:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26814.800445 secs 2024-04-27T01:45:20.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26117.769678 secs 2024-04-27T01:45:21.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:20 smithi189 ceph-mon[32756]: pgmap v14751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:21.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:20 smithi156 ceph-mon[32679]: pgmap v14751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:21.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:20 smithi092 ceph-mon[29156]: pgmap v14751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:23.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:22 smithi189 ceph-mon[32756]: pgmap v14752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:23.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:22 smithi156 ceph-mon[32679]: pgmap v14752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:23.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:22 smithi092 ceph-mon[29156]: pgmap v14752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:24 smithi189 ceph-mon[32756]: pgmap v14753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26819.800559 secs 2024-04-27T01:45:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26122.769744 secs 2024-04-27T01:45:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:24 smithi156 ceph-mon[32679]: pgmap v14753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26819.800559 secs 2024-04-27T01:45:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26122.769744 secs 2024-04-27T01:45:25.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:24 smithi092 ceph-mon[29156]: pgmap v14753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:25.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26819.800559 secs 2024-04-27T01:45:25.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26122.769744 secs 2024-04-27T01:45:27.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:26 smithi189 ceph-mon[32756]: pgmap v14754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:27.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:26 smithi156 ceph-mon[32679]: pgmap v14754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:27.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:26 smithi092 ceph-mon[29156]: pgmap v14754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:29.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:28 smithi189 ceph-mon[32756]: pgmap v14755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:29.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:28 smithi156 ceph-mon[32679]: pgmap v14755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:28 smithi092 ceph-mon[29156]: pgmap v14755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26824.800624 secs 2024-04-27T01:45:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26127.769871 secs 2024-04-27T01:45:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26824.800624 secs 2024-04-27T01:45:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26127.769871 secs 2024-04-27T01:45:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26824.800624 secs 2024-04-27T01:45:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26127.769871 secs 2024-04-27T01:45:31.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:30 smithi189 ceph-mon[32756]: pgmap v14756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:31.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:30 smithi156 ceph-mon[32679]: pgmap v14756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:31.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:30 smithi092 ceph-mon[29156]: pgmap v14756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:33.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:32 smithi189 ceph-mon[32756]: pgmap v14757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:33.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:32 smithi156 ceph-mon[32679]: pgmap v14757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:33.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:32 smithi092 ceph-mon[29156]: pgmap v14757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:34 smithi189 ceph-mon[32756]: pgmap v14758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26829.800739 secs 2024-04-27T01:45:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26132.769976 secs 2024-04-27T01:45:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:34 smithi156 ceph-mon[32679]: pgmap v14758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26829.800739 secs 2024-04-27T01:45:35.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26132.769976 secs 2024-04-27T01:45:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:34 smithi092 ceph-mon[29156]: pgmap v14758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26829.800739 secs 2024-04-27T01:45:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26132.769976 secs 2024-04-27T01:45:36.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:35 smithi189 ceph-mon[32756]: pgmap v14759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:36.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:35 smithi156 ceph-mon[32679]: pgmap v14759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:36.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:35 smithi092 ceph-mon[29156]: pgmap v14759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:38.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:38 smithi189 ceph-mon[32756]: pgmap v14760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:38.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:38 smithi156 ceph-mon[32679]: pgmap v14760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:38.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:38 smithi092 ceph-mon[29156]: pgmap v14760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:39 smithi189 ceph-mon[32756]: 11 slow requests, 1 included below; oldest blocked for > 26834.800855 secs 2024-04-27T01:45:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:39 smithi189 ceph-mon[32756]: slow request 1441.143624 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:45:39.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26137.770103 secs 2024-04-27T01:45:39.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:39 smithi092 ceph-mon[29156]: 11 slow requests, 1 included below; oldest blocked for > 26834.800855 secs 2024-04-27T01:45:39.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:39 smithi092 ceph-mon[29156]: slow request 1441.143624 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:45:39.627 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26137.770103 secs 2024-04-27T01:45:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:45:39.667+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:45:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:45:39.667+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:45:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:45:39.667+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:45:39.649 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:45:39.667+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 208 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:45:39.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:39 smithi156 ceph-mon[32679]: 11 slow requests, 1 included below; oldest blocked for > 26834.800855 secs 2024-04-27T01:45:39.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:39 smithi156 ceph-mon[32679]: slow request 1441.143624 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:45:39.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26137.770103 secs 2024-04-27T01:45:40.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:40 smithi189 ceph-mon[32756]: pgmap v14761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:40.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:40 smithi156 ceph-mon[32679]: pgmap v14761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:40.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:40 smithi092 ceph-mon[29156]: pgmap v14761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:42.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:42 smithi189 ceph-mon[32756]: pgmap v14762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:42.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:42 smithi156 ceph-mon[32679]: pgmap v14762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:42.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:42 smithi092 ceph-mon[29156]: pgmap v14762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:44 smithi189 ceph-mon[32756]: pgmap v14763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26839.800967 secs 2024-04-27T01:45:44.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26142.770255 secs 2024-04-27T01:45:44.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:44 smithi156 ceph-mon[32679]: pgmap v14763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26839.800967 secs 2024-04-27T01:45:44.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26142.770255 secs 2024-04-27T01:45:44.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:44 smithi092 ceph-mon[29156]: pgmap v14763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:44.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26839.800967 secs 2024-04-27T01:45:44.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26142.770255 secs 2024-04-27T01:45:46.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:46 smithi189 ceph-mon[32756]: pgmap v14764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:46.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:46 smithi156 ceph-mon[32679]: pgmap v14764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:46.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:46 smithi092 ceph-mon[29156]: pgmap v14764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:48.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:48 smithi189 ceph-mon[32756]: pgmap v14765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:48.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:48 smithi156 ceph-mon[32679]: pgmap v14765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:48.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:48 smithi092 ceph-mon[29156]: pgmap v14765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:45:49.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26844.801081 secs 2024-04-27T01:45:49.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26147.770369 secs 2024-04-27T01:45:49.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26844.801081 secs 2024-04-27T01:45:49.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26147.770369 secs 2024-04-27T01:45:49.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26844.801081 secs 2024-04-27T01:45:49.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26147.770369 secs 2024-04-27T01:45:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:50 smithi189 ceph-mon[32756]: pgmap v14766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:45:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:45:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:45:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:45:50.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:50 smithi156 ceph-mon[32679]: pgmap v14766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:50.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:45:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:45:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:45:50.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:45:50.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:50 smithi092 ceph-mon[29156]: pgmap v14766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:45:50.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:45:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:45:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:45:50.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:45:51.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:51 smithi156 ceph-mon[32679]: pgmap v14767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:45:51.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:51 smithi156 ceph-mon[32679]: pgmap v14768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:51.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:51 smithi092 ceph-mon[29156]: pgmap v14767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:45:51.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:51 smithi092 ceph-mon[29156]: pgmap v14768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:51 smithi189 ceph-mon[32756]: pgmap v14767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:45:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:51 smithi189 ceph-mon[32756]: pgmap v14768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:53.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:53 smithi156 ceph-mon[32679]: pgmap v14769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:53 smithi092 ceph-mon[29156]: pgmap v14769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:53.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:53 smithi189 ceph-mon[32756]: pgmap v14769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26849.801146 secs 2024-04-27T01:45:54.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26152.770494 secs 2024-04-27T01:45:54.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26849.801146 secs 2024-04-27T01:45:54.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26152.770494 secs 2024-04-27T01:45:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26849.801146 secs 2024-04-27T01:45:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26152.770494 secs 2024-04-27T01:45:55.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:55 smithi156 ceph-mon[32679]: pgmap v14770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:55 smithi092 ceph-mon[29156]: pgmap v14770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:55.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:55 smithi189 ceph-mon[32756]: pgmap v14770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:57.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:57 smithi156 ceph-mon[32679]: pgmap v14771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:57.672 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:57 smithi189 ceph-mon[32756]: pgmap v14771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:57.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:57 smithi092 ceph-mon[29156]: pgmap v14771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:45:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:59 smithi156 ceph-mon[32679]: pgmap v14772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:45:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26854.801264 secs 2024-04-27T01:45:59.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:45:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 26157.770601 secs 2024-04-27T01:45:59.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:59 smithi092 ceph-mon[29156]: pgmap v14772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:45:59.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26854.801264 secs 2024-04-27T01:45:59.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:45:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 26157.770601 secs 2024-04-27T01:45:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:59 smithi189 ceph-mon[32756]: pgmap v14772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:45:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26854.801264 secs 2024-04-27T01:45:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:45:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 26157.770601 secs 2024-04-27T01:46:01.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:01 smithi156 ceph-mon[32679]: pgmap v14773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:46:01.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:01 smithi092 ceph-mon[29156]: pgmap v14773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:46:01.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:01 smithi189 ceph-mon[32756]: pgmap v14773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:46:03.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:03 smithi156 ceph-mon[32679]: pgmap v14774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:03.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:03 smithi092 ceph-mon[29156]: pgmap v14774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:03.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:03 smithi189 ceph-mon[32756]: pgmap v14774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26859.801373 secs 2024-04-27T01:46:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:04 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 26162.770656 secs 2024-04-27T01:46:04.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:04 smithi156 ceph-mon[32679]: slow request 23041.928560 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:46:04.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26859.801373 secs 2024-04-27T01:46:04.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:04 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 26162.770656 secs 2024-04-27T01:46:04.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:04 smithi092 ceph-mon[29156]: slow request 23041.928560 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:46:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26859.801373 secs 2024-04-27T01:46:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:04 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 26162.770656 secs 2024-04-27T01:46:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:04 smithi189 ceph-mon[32756]: slow request 23041.928560 seconds old, received at 2024-04-26T19:22:01.988129+0000: client_request(client.16914:1 getattr pAsLsXsFs #0x1 2024-04-26T19:22:01.984272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:46:05.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:05 smithi156 ceph-mon[32679]: pgmap v14775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:05.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:05 smithi092 ceph-mon[29156]: pgmap v14775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:05.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:05 smithi189 ceph-mon[32756]: pgmap v14775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:07.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:07 smithi156 ceph-mon[32679]: pgmap v14776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:07.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:07 smithi092 ceph-mon[29156]: pgmap v14776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:07.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:07 smithi189 ceph-mon[32756]: pgmap v14776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:09 smithi156 ceph-mon[32679]: pgmap v14777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26864.801488 secs 2024-04-27T01:46:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:09 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 26167.770769 secs 2024-04-27T01:46:09.666 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:09 smithi156 ceph-mon[32679]: slow request 180.984180 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:46:09.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:09 smithi092 ceph-mon[29156]: pgmap v14777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:09.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26864.801488 secs 2024-04-27T01:46:09.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:09 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 26167.770769 secs 2024-04-27T01:46:09.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:09 smithi092 ceph-mon[29156]: slow request 180.984180 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:46:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:09 smithi189 ceph-mon[32756]: pgmap v14777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26864.801488 secs 2024-04-27T01:46:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:09 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 26167.770769 secs 2024-04-27T01:46:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:09 smithi189 ceph-mon[32756]: slow request 180.984180 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:46:11.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:11 smithi156 ceph-mon[32679]: pgmap v14778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:11.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:11 smithi092 ceph-mon[29156]: pgmap v14778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:11.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:11 smithi189 ceph-mon[32756]: pgmap v14778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:13.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:13 smithi092 ceph-mon[29156]: pgmap v14779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:13.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:46:13.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:46:13.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:13 smithi189 ceph-mon[32756]: pgmap v14779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:13.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:46:13.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:46:13.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:13 smithi156 ceph-mon[32679]: pgmap v14779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:13.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:46:13.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:46:14.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26869.801606 secs 2024-04-27T01:46:14.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26172.770844 secs 2024-04-27T01:46:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26869.801606 secs 2024-04-27T01:46:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26172.770844 secs 2024-04-27T01:46:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26869.801606 secs 2024-04-27T01:46:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26172.770844 secs 2024-04-27T01:46:15.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:15 smithi092 ceph-mon[29156]: pgmap v14780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:15.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:15 smithi189 ceph-mon[32756]: pgmap v14780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:15.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:15 smithi156 ceph-mon[32679]: pgmap v14780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:17.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:17 smithi092 ceph-mon[29156]: pgmap v14781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:17.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:17 smithi189 ceph-mon[32756]: pgmap v14781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:17.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:17 smithi156 ceph-mon[32679]: pgmap v14781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:19.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:19 smithi092 ceph-mon[29156]: pgmap v14782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:19.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26874.801668 secs 2024-04-27T01:46:19.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26177.770923 secs 2024-04-27T01:46:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:19 smithi189 ceph-mon[32756]: pgmap v14782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26874.801668 secs 2024-04-27T01:46:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26177.770923 secs 2024-04-27T01:46:19.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:19 smithi156 ceph-mon[32679]: pgmap v14782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26874.801668 secs 2024-04-27T01:46:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26177.770923 secs 2024-04-27T01:46:21.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:21 smithi092 ceph-mon[29156]: pgmap v14783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:21.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:21 smithi189 ceph-mon[32756]: pgmap v14783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:21.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:21 smithi156 ceph-mon[32679]: pgmap v14783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:23.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:23 smithi092 ceph-mon[29156]: pgmap v14784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:23.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:23 smithi189 ceph-mon[32756]: pgmap v14784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:23.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:23 smithi156 ceph-mon[32679]: pgmap v14784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:24.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26879.801803 secs 2024-04-27T01:46:24.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26182.771072 secs 2024-04-27T01:46:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26879.801803 secs 2024-04-27T01:46:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26182.771072 secs 2024-04-27T01:46:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26879.801803 secs 2024-04-27T01:46:24.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26182.771072 secs 2024-04-27T01:46:25.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:25 smithi092 ceph-mon[29156]: pgmap v14785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:25.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:25 smithi189 ceph-mon[32756]: pgmap v14785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:25.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:25 smithi156 ceph-mon[32679]: pgmap v14785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:27.718 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:27 smithi156 ceph-mon[32679]: pgmap v14786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:27.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:27 smithi092 ceph-mon[29156]: pgmap v14786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:27.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:27 smithi189 ceph-mon[32756]: pgmap v14786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:29.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:29 smithi092 ceph-mon[29156]: pgmap v14787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:29.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26884.801861 secs 2024-04-27T01:46:29.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26187.771178 secs 2024-04-27T01:46:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:29 smithi189 ceph-mon[32756]: pgmap v14787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:29.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26884.801861 secs 2024-04-27T01:46:29.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26187.771178 secs 2024-04-27T01:46:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:29 smithi156 ceph-mon[32679]: pgmap v14787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26884.801861 secs 2024-04-27T01:46:29.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26187.771178 secs 2024-04-27T01:46:31.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:31 smithi092 ceph-mon[29156]: pgmap v14788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:31.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:31 smithi189 ceph-mon[32756]: pgmap v14788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:31.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:31 smithi156 ceph-mon[32679]: pgmap v14788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:33.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:33 smithi092 ceph-mon[29156]: pgmap v14789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:33.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:33 smithi189 ceph-mon[32756]: pgmap v14789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:33.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:33 smithi156 ceph-mon[32679]: pgmap v14789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:34.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26889.801984 secs 2024-04-27T01:46:34.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26192.771359 secs 2024-04-27T01:46:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26889.801984 secs 2024-04-27T01:46:34.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26192.771359 secs 2024-04-27T01:46:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26889.801984 secs 2024-04-27T01:46:34.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26192.771359 secs 2024-04-27T01:46:35.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:35 smithi092 ceph-mon[29156]: pgmap v14790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:35.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:35 smithi189 ceph-mon[32756]: pgmap v14790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:35.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:35 smithi156 ceph-mon[32679]: pgmap v14790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:37.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:37 smithi092 ceph-mon[29156]: pgmap v14791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:37.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:37 smithi189 ceph-mon[32756]: pgmap v14791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:37.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:37 smithi156 ceph-mon[32679]: pgmap v14791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:39.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:39 smithi092 ceph-mon[29156]: pgmap v14792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:39.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26894.802101 secs 2024-04-27T01:46:39.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26197.771512 secs 2024-04-27T01:46:39.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:39 smithi189 ceph-mon[32756]: pgmap v14792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:39.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26894.802101 secs 2024-04-27T01:46:39.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26197.771512 secs 2024-04-27T01:46:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:39 smithi156 ceph-mon[32679]: pgmap v14792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26894.802101 secs 2024-04-27T01:46:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26197.771512 secs 2024-04-27T01:46:41.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:41 smithi092 ceph-mon[29156]: pgmap v14793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:41.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:41 smithi189 ceph-mon[32756]: pgmap v14793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:41.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:41 smithi156 ceph-mon[32679]: pgmap v14793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:43.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:43 smithi189 ceph-mon[32756]: pgmap v14794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:43.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:43 smithi156 ceph-mon[32679]: pgmap v14794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:43.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:43 smithi092 ceph-mon[29156]: pgmap v14794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26899.802217 secs 2024-04-27T01:46:44.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26202.771625 secs 2024-04-27T01:46:44.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26899.802217 secs 2024-04-27T01:46:44.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26202.771625 secs 2024-04-27T01:46:44.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26899.802217 secs 2024-04-27T01:46:44.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26202.771625 secs 2024-04-27T01:46:45.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:45 smithi189 ceph-mon[32756]: pgmap v14795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:45.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:45 smithi156 ceph-mon[32679]: pgmap v14795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:45.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:45 smithi092 ceph-mon[29156]: pgmap v14795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:47.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:47 smithi189 ceph-mon[32756]: pgmap v14796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:47.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:47 smithi156 ceph-mon[32679]: pgmap v14796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:47.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:47 smithi092 ceph-mon[29156]: pgmap v14796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:49 smithi189 ceph-mon[32756]: pgmap v14797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26904.802279 secs 2024-04-27T01:46:49.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26207.771750 secs 2024-04-27T01:46:49.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:49 smithi156 ceph-mon[32679]: pgmap v14797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26904.802279 secs 2024-04-27T01:46:49.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26207.771750 secs 2024-04-27T01:46:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:49 smithi092 ceph-mon[29156]: pgmap v14797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:46:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26904.802279 secs 2024-04-27T01:46:49.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26207.771750 secs 2024-04-27T01:46:50.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:46:50.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:46:50.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:46:51.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:51 smithi189 ceph-mon[32756]: pgmap v14798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:46:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:46:51.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:46:51.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:51 smithi156 ceph-mon[32679]: pgmap v14798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:51.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:46:51.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:46:51.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:46:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:51 smithi092 ceph-mon[29156]: pgmap v14798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:46:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:46:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:46:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:46:52.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:52 smithi189 ceph-mon[32756]: pgmap v14799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:46:52.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:52 smithi189 ceph-mon[32756]: pgmap v14800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:52.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:52 smithi156 ceph-mon[32679]: pgmap v14799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:46:52.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:52 smithi156 ceph-mon[32679]: pgmap v14800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:52 smithi092 ceph-mon[29156]: pgmap v14799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:46:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:52 smithi092 ceph-mon[29156]: pgmap v14800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:54 smithi189 ceph-mon[32756]: pgmap v14801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:46:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26909.802353 secs 2024-04-27T01:46:54.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26212.771832 secs 2024-04-27T01:46:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:54 smithi156 ceph-mon[32679]: pgmap v14801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:46:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26909.802353 secs 2024-04-27T01:46:54.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26212.771832 secs 2024-04-27T01:46:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:54 smithi092 ceph-mon[29156]: pgmap v14801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:46:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26909.802353 secs 2024-04-27T01:46:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26212.771832 secs 2024-04-27T01:46:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:56 smithi189 ceph-mon[32756]: pgmap v14802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:56 smithi156 ceph-mon[32679]: pgmap v14802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:56.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:56 smithi092 ceph-mon[29156]: pgmap v14802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:58.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:58 smithi189 ceph-mon[32756]: pgmap v14803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:58.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:58 smithi156 ceph-mon[32679]: pgmap v14803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:58.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:58 smithi092 ceph-mon[29156]: pgmap v14803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:46:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26914.802468 secs 2024-04-27T01:46:59.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:46:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26217.771928 secs 2024-04-27T01:46:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26914.802468 secs 2024-04-27T01:46:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:46:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26217.771928 secs 2024-04-27T01:46:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26914.802468 secs 2024-04-27T01:46:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:46:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26217.771928 secs 2024-04-27T01:47:00.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:00 smithi189 ceph-mon[32756]: pgmap v14804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:00 smithi156 ceph-mon[32679]: pgmap v14804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:00.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:00 smithi092 ceph-mon[29156]: pgmap v14804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:02.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:02 smithi189 ceph-mon[32756]: pgmap v14805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:47:02.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:02 smithi156 ceph-mon[32679]: pgmap v14805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:47:02.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:02 smithi092 ceph-mon[29156]: pgmap v14805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:47:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:04 smithi189 ceph-mon[32756]: pgmap v14806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26919.802579 secs 2024-04-27T01:47:04.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26222.772053 secs 2024-04-27T01:47:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:04 smithi156 ceph-mon[32679]: pgmap v14806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26919.802579 secs 2024-04-27T01:47:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26222.772053 secs 2024-04-27T01:47:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:04 smithi092 ceph-mon[29156]: pgmap v14806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26919.802579 secs 2024-04-27T01:47:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26222.772053 secs 2024-04-27T01:47:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:06 smithi189 ceph-mon[32756]: pgmap v14807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:06 smithi156 ceph-mon[32679]: pgmap v14807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:06 smithi092 ceph-mon[29156]: pgmap v14807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:08.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:08 smithi189 ceph-mon[32756]: pgmap v14808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:08.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:08 smithi156 ceph-mon[32679]: pgmap v14808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:08.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:08 smithi092 ceph-mon[29156]: pgmap v14808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26924.802710 secs 2024-04-27T01:47:09.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26227.772145 secs 2024-04-27T01:47:09.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26924.802710 secs 2024-04-27T01:47:09.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26227.772145 secs 2024-04-27T01:47:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26924.802710 secs 2024-04-27T01:47:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26227.772145 secs 2024-04-27T01:47:10.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:10 smithi189 ceph-mon[32756]: pgmap v14809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:10.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:10 smithi156 ceph-mon[32679]: pgmap v14809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:10.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:10 smithi092 ceph-mon[29156]: pgmap v14809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:12.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:12 smithi189 ceph-mon[32756]: pgmap v14810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:12.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:12 smithi156 ceph-mon[32679]: pgmap v14810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:12.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:12 smithi092 ceph-mon[29156]: pgmap v14810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:14 smithi189 ceph-mon[32756]: pgmap v14811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26929.802805 secs 2024-04-27T01:47:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26232.772285 secs 2024-04-27T01:47:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:14 smithi156 ceph-mon[32679]: pgmap v14811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26929.802805 secs 2024-04-27T01:47:14.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26232.772285 secs 2024-04-27T01:47:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:14 smithi092 ceph-mon[29156]: pgmap v14811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26929.802805 secs 2024-04-27T01:47:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26232.772285 secs 2024-04-27T01:47:16.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:16 smithi189 ceph-mon[32756]: pgmap v14812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:16.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:16 smithi156 ceph-mon[32679]: pgmap v14812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:16.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:16 smithi092 ceph-mon[29156]: pgmap v14812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:18.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:18 smithi189 ceph-mon[32756]: pgmap v14813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:18.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:18 smithi156 ceph-mon[32679]: pgmap v14813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:18.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:18 smithi092 ceph-mon[29156]: pgmap v14813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:19 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26934.802911 secs 2024-04-27T01:47:19.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26237.772375 secs 2024-04-27T01:47:19.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:19 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26934.802911 secs 2024-04-27T01:47:19.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26237.772375 secs 2024-04-27T01:47:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:19 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26934.802911 secs 2024-04-27T01:47:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26237.772375 secs 2024-04-27T01:47:20.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:20 smithi189 ceph-mon[32756]: pgmap v14814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:20.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:20 smithi156 ceph-mon[32679]: pgmap v14814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:20.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:20 smithi092 ceph-mon[29156]: pgmap v14814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:22.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:22 smithi189 ceph-mon[32756]: pgmap v14815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:22.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:22 smithi156 ceph-mon[32679]: pgmap v14815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:22.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:22 smithi092 ceph-mon[29156]: pgmap v14815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:24 smithi189 ceph-mon[32756]: pgmap v14816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:24 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26939.802988 secs 2024-04-27T01:47:24.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26242.772498 secs 2024-04-27T01:47:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:24 smithi156 ceph-mon[32679]: pgmap v14816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:24 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26939.802988 secs 2024-04-27T01:47:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26242.772498 secs 2024-04-27T01:47:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:24 smithi092 ceph-mon[29156]: pgmap v14816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:24 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26939.802988 secs 2024-04-27T01:47:24.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26242.772498 secs 2024-04-27T01:47:26.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:26 smithi189 ceph-mon[32756]: pgmap v14817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:26.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:26 smithi156 ceph-mon[32679]: pgmap v14817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:26.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:26 smithi092 ceph-mon[29156]: pgmap v14817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:28.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:28 smithi189 ceph-mon[32756]: pgmap v14818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:28.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:28 smithi156 ceph-mon[32679]: pgmap v14818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:28.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:28 smithi092 ceph-mon[29156]: pgmap v14818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:29 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26944.803055 secs 2024-04-27T01:47:29.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26247.772579 secs 2024-04-27T01:47:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:29 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26944.803055 secs 2024-04-27T01:47:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26247.772579 secs 2024-04-27T01:47:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:29 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26944.803055 secs 2024-04-27T01:47:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26247.772579 secs 2024-04-27T01:47:30.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:30 smithi189 ceph-mon[32756]: pgmap v14819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:30.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:30 smithi156 ceph-mon[32679]: pgmap v14819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:30.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:30 smithi092 ceph-mon[29156]: pgmap v14819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:32.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:32 smithi189 ceph-mon[32756]: pgmap v14820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:32.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:32 smithi156 ceph-mon[32679]: pgmap v14820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:32.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:32 smithi092 ceph-mon[29156]: pgmap v14820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:34 smithi189 ceph-mon[32756]: pgmap v14821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:34 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26949.803169 secs 2024-04-27T01:47:34.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26252.772707 secs 2024-04-27T01:47:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:34 smithi156 ceph-mon[32679]: pgmap v14821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:34 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26949.803169 secs 2024-04-27T01:47:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26252.772707 secs 2024-04-27T01:47:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:34 smithi092 ceph-mon[29156]: pgmap v14821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:34 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26949.803169 secs 2024-04-27T01:47:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26252.772707 secs 2024-04-27T01:47:36.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:36 smithi156 ceph-mon[32679]: pgmap v14822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:36.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:36 smithi092 ceph-mon[29156]: pgmap v14822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:37.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:36 smithi189 ceph-mon[32756]: pgmap v14822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:38.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:38 smithi156 ceph-mon[32679]: pgmap v14823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:38.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:38 smithi092 ceph-mon[29156]: pgmap v14823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:39.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:38 smithi189 ceph-mon[32756]: pgmap v14823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:39 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26954.803287 secs 2024-04-27T01:47:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26257.772859 secs 2024-04-27T01:47:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:39 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26954.803287 secs 2024-04-27T01:47:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26257.772859 secs 2024-04-27T01:47:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:39 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26954.803287 secs 2024-04-27T01:47:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26257.772859 secs 2024-04-27T01:47:40.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:40 smithi156 ceph-mon[32679]: pgmap v14824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:40.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:40 smithi092 ceph-mon[29156]: pgmap v14824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:41.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:40 smithi189 ceph-mon[32756]: pgmap v14824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:42.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:42 smithi156 ceph-mon[32679]: pgmap v14825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:42.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:42 smithi092 ceph-mon[29156]: pgmap v14825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:43.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:42 smithi189 ceph-mon[32756]: pgmap v14825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:44.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:44 smithi156 ceph-mon[32679]: pgmap v14826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:44 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26959.803399 secs 2024-04-27T01:47:44.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26262.772993 secs 2024-04-27T01:47:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:44 smithi092 ceph-mon[29156]: pgmap v14826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:44 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26959.803399 secs 2024-04-27T01:47:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26262.772993 secs 2024-04-27T01:47:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:44 smithi189 ceph-mon[32756]: pgmap v14826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:44 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26959.803399 secs 2024-04-27T01:47:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26262.772993 secs 2024-04-27T01:47:46.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:46 smithi156 ceph-mon[32679]: pgmap v14827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:46.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:46 smithi092 ceph-mon[29156]: pgmap v14827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:47.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:46 smithi189 ceph-mon[32756]: pgmap v14827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:48.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:48 smithi156 ceph-mon[32679]: pgmap v14828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:48.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:48 smithi092 ceph-mon[29156]: pgmap v14828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:49.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:48 smithi189 ceph-mon[32756]: pgmap v14828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:49 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26964.803488 secs 2024-04-27T01:47:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26267.773103 secs 2024-04-27T01:47:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:49 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26964.803488 secs 2024-04-27T01:47:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26267.773103 secs 2024-04-27T01:47:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:49 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26964.803488 secs 2024-04-27T01:47:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26267.773103 secs 2024-04-27T01:47:50.954 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:50 smithi092 ceph-mon[29156]: pgmap v14829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:51.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:50 smithi189 ceph-mon[32756]: pgmap v14829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:51.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:50 smithi156 ceph-mon[32679]: pgmap v14829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:47:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:47:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:47:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:47:51.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:47:52.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:47:52.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:47:52.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:47:52.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:47:52.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:47:52.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:47:52.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:47:52.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:47:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:52 smithi092 ceph-mon[29156]: pgmap v14830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:52 smithi092 ceph-mon[29156]: pgmap v14831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:47:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:52 smithi092 ceph-mon[29156]: pgmap v14832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:53.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:52 smithi189 ceph-mon[32756]: pgmap v14830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:52 smithi189 ceph-mon[32756]: pgmap v14831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:47:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:52 smithi189 ceph-mon[32756]: pgmap v14832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:53.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:52 smithi156 ceph-mon[32679]: pgmap v14830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:47:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:52 smithi156 ceph-mon[32679]: pgmap v14831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:47:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:52 smithi156 ceph-mon[32679]: pgmap v14832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:54 smithi092 ceph-mon[29156]: pgmap v14833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26969.803574 secs 2024-04-27T01:47:54.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26272.773211 secs 2024-04-27T01:47:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:54 smithi189 ceph-mon[32756]: pgmap v14833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26969.803574 secs 2024-04-27T01:47:55.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26272.773211 secs 2024-04-27T01:47:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:54 smithi156 ceph-mon[32679]: pgmap v14833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26969.803574 secs 2024-04-27T01:47:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26272.773211 secs 2024-04-27T01:47:56.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:56 smithi092 ceph-mon[29156]: pgmap v14834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:57.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:56 smithi189 ceph-mon[32756]: pgmap v14834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:57.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:56 smithi156 ceph-mon[32679]: pgmap v14834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:47:58.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:58 smithi156 ceph-mon[32679]: pgmap v14835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:47:58.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:58 smithi092 ceph-mon[29156]: pgmap v14835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:47:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:58 smithi189 ceph-mon[32756]: pgmap v14835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:47:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26974.803726 secs 2024-04-27T01:47:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:47:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26277.773329 secs 2024-04-27T01:48:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26974.803726 secs 2024-04-27T01:48:00.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:47:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26277.773329 secs 2024-04-27T01:48:00.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26974.803726 secs 2024-04-27T01:48:00.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:47:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26277.773329 secs 2024-04-27T01:48:00.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:00 smithi092 ceph-mon[29156]: pgmap v14836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:01.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:00 smithi189 ceph-mon[32756]: pgmap v14836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:01.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:00 smithi156 ceph-mon[32679]: pgmap v14836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:02.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:02 smithi092 ceph-mon[29156]: pgmap v14837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:48:03.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:02 smithi189 ceph-mon[32756]: pgmap v14837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:48:03.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:02 smithi156 ceph-mon[32679]: pgmap v14837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:48:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:04 smithi092 ceph-mon[29156]: pgmap v14838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 26979.803790 secs 2024-04-27T01:48:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26282.773430 secs 2024-04-27T01:48:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:04 smithi189 ceph-mon[32756]: pgmap v14838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 26979.803790 secs 2024-04-27T01:48:05.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26282.773430 secs 2024-04-27T01:48:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:04 smithi156 ceph-mon[32679]: pgmap v14838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 26979.803790 secs 2024-04-27T01:48:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26282.773430 secs 2024-04-27T01:48:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:06 smithi092 ceph-mon[29156]: pgmap v14839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:07.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:06 smithi189 ceph-mon[32756]: pgmap v14839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:07.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:06 smithi156 ceph-mon[32679]: pgmap v14839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:08.225 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:48:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:48:07.981+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:48:08.225 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:48:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:48:07.981+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:48:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:48:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:48:07.981+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:48:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:48:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:48:07.981+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:48:08.226 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:48:07 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:48:07.981+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:48:08.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:08 smithi092 ceph-mon[29156]: pgmap v14840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:09.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:08 smithi189 ceph-mon[32756]: pgmap v14840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:08 smithi156 ceph-mon[32679]: pgmap v14840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 26984.803909 secs 2024-04-27T01:48:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26287.773567 secs 2024-04-27T01:48:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 26984.803909 secs 2024-04-27T01:48:10.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26287.773567 secs 2024-04-27T01:48:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 26984.803909 secs 2024-04-27T01:48:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26287.773567 secs 2024-04-27T01:48:10.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:10 smithi092 ceph-mon[29156]: pgmap v14841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:11.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:10 smithi189 ceph-mon[32756]: pgmap v14841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:11.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:10 smithi156 ceph-mon[32679]: pgmap v14841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:11.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:48:11.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:48:12.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:48:12.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:48:12.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:48:12.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:48:12.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:12 smithi092 ceph-mon[29156]: pgmap v14842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:13.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:12 smithi189 ceph-mon[32756]: pgmap v14842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:13.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:12 smithi156 ceph-mon[32679]: pgmap v14842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:14 smithi189 ceph-mon[32756]: pgmap v14843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 26989.804016 secs 2024-04-27T01:48:15.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26292.773672 secs 2024-04-27T01:48:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:14 smithi156 ceph-mon[32679]: pgmap v14843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 26989.804016 secs 2024-04-27T01:48:15.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26292.773672 secs 2024-04-27T01:48:15.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:14 smithi092 ceph-mon[29156]: pgmap v14843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:15.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 26989.804016 secs 2024-04-27T01:48:15.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26292.773672 secs 2024-04-27T01:48:17.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:16 smithi189 ceph-mon[32756]: pgmap v14844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:17.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:16 smithi156 ceph-mon[32679]: pgmap v14844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:17.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:16 smithi092 ceph-mon[29156]: pgmap v14844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:19.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:18 smithi189 ceph-mon[32756]: pgmap v14845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:19.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:18 smithi156 ceph-mon[32679]: pgmap v14845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:19.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:18 smithi092 ceph-mon[29156]: pgmap v14845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:48:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 26994.804134 secs 2024-04-27T01:48:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26297.773779 secs 2024-04-27T01:48:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 26994.804134 secs 2024-04-27T01:48:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26297.773779 secs 2024-04-27T01:48:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 26994.804134 secs 2024-04-27T01:48:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26297.773779 secs 2024-04-27T01:48:21.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:20 smithi189 ceph-mon[32756]: pgmap v14846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:21.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:20 smithi156 ceph-mon[32679]: pgmap v14846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:21.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:20 smithi092 ceph-mon[29156]: pgmap v14846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:48:22.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:22 smithi092 ceph-mon[29156]: pgmap v14847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:23.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:22 smithi189 ceph-mon[32756]: pgmap v14847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:23.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:22 smithi156 ceph-mon[32679]: pgmap v14847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:24 smithi189 ceph-mon[32756]: pgmap v14848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:48:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 26999.804216 secs 2024-04-27T01:48:25.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26302.773857 secs 2024-04-27T01:48:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:24 smithi156 ceph-mon[32679]: pgmap v14848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:48:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 26999.804216 secs 2024-04-27T01:48:25.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26302.773857 secs 2024-04-27T01:48:25.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:24 smithi092 ceph-mon[29156]: pgmap v14848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:48:25.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 26999.804216 secs 2024-04-27T01:48:25.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26302.773857 secs 2024-04-27T01:48:27.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:26 smithi189 ceph-mon[32756]: pgmap v14849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:27.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:26 smithi156 ceph-mon[32679]: pgmap v14849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:27.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:26 smithi092 ceph-mon[29156]: pgmap v14849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:29.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:28 smithi189 ceph-mon[32756]: pgmap v14850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:29.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:28 smithi156 ceph-mon[32679]: pgmap v14850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:28 smithi092 ceph-mon[29156]: pgmap v14850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27004.804376 secs 2024-04-27T01:48:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26307.773979 secs 2024-04-27T01:48:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27004.804376 secs 2024-04-27T01:48:30.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26307.773979 secs 2024-04-27T01:48:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27004.804376 secs 2024-04-27T01:48:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26307.773979 secs 2024-04-27T01:48:31.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:30 smithi189 ceph-mon[32756]: pgmap v14851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:31.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:30 smithi156 ceph-mon[32679]: pgmap v14851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:31.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:30 smithi092 ceph-mon[29156]: pgmap v14851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:33.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:32 smithi189 ceph-mon[32756]: pgmap v14852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:33.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:32 smithi156 ceph-mon[32679]: pgmap v14852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:33.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:32 smithi092 ceph-mon[29156]: pgmap v14852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:34 smithi189 ceph-mon[32756]: pgmap v14853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27009.804510 secs 2024-04-27T01:48:35.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26312.774119 secs 2024-04-27T01:48:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:34 smithi156 ceph-mon[32679]: pgmap v14853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27009.804510 secs 2024-04-27T01:48:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26312.774119 secs 2024-04-27T01:48:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:34 smithi092 ceph-mon[29156]: pgmap v14853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27009.804510 secs 2024-04-27T01:48:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26312.774119 secs 2024-04-27T01:48:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803de10 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803de10 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T01:48:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.032+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:48:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.033+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca80b0050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T01:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T01:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T01:48:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T01:48:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=28 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T01:48:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T01:48:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T01:48:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:36.074+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T01:48:37.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:36 smithi189 ceph-mon[32756]: pgmap v14854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:37.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:36 smithi156 ceph-mon[32679]: pgmap v14854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:37.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:36 smithi092 ceph-mon[29156]: pgmap v14854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:39.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:38 smithi189 ceph-mon[32756]: pgmap v14855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:39.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:38 smithi156 ceph-mon[32679]: pgmap v14855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:39.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:38 smithi092 ceph-mon[29156]: pgmap v14855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:39.692+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:48:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:39.692+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:48:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:39.692+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:48:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:48:39.692+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 209 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:48:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:39 smithi189 ceph-mon[32756]: 10 slow requests, 1 included below; oldest blocked for > 27014.804642 secs 2024-04-27T01:48:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:39 smithi189 ceph-mon[32756]: slow request 2881.500787 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:48:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26317.774234 secs 2024-04-27T01:48:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:39 smithi156 ceph-mon[32679]: 10 slow requests, 1 included below; oldest blocked for > 27014.804642 secs 2024-04-27T01:48:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:39 smithi156 ceph-mon[32679]: slow request 2881.500787 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:48:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26317.774234 secs 2024-04-27T01:48:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:39 smithi092 ceph-mon[29156]: 10 slow requests, 1 included below; oldest blocked for > 27014.804642 secs 2024-04-27T01:48:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:39 smithi092 ceph-mon[29156]: slow request 2881.500787 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:48:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26317.774234 secs 2024-04-27T01:48:41.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:40 smithi189 ceph-mon[32756]: pgmap v14856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:41.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:40 smithi156 ceph-mon[32679]: pgmap v14856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:41.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:40 smithi092 ceph-mon[29156]: pgmap v14856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:48:43.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:42 smithi189 ceph-mon[32756]: pgmap v14857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:43.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:42 smithi156 ceph-mon[32679]: pgmap v14857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:43.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:42 smithi092 ceph-mon[29156]: pgmap v14857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:48:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:44 smithi189 ceph-mon[32756]: pgmap v14858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27019.804755 secs 2024-04-27T01:48:45.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26322.774383 secs 2024-04-27T01:48:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:44 smithi156 ceph-mon[32679]: pgmap v14858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27019.804755 secs 2024-04-27T01:48:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26322.774383 secs 2024-04-27T01:48:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:44 smithi092 ceph-mon[29156]: pgmap v14858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27019.804755 secs 2024-04-27T01:48:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26322.774383 secs 2024-04-27T01:48:47.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:46 smithi189 ceph-mon[32756]: pgmap v14859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:47.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:46 smithi156 ceph-mon[32679]: pgmap v14859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:47.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:46 smithi092 ceph-mon[29156]: pgmap v14859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:48.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:47 smithi189 ceph-mon[32756]: pgmap v14860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:48.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:47 smithi156 ceph-mon[32679]: pgmap v14860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:48.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:47 smithi092 ceph-mon[29156]: pgmap v14860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:49.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26327.774520 secs 2024-04-27T01:48:49.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26327.774520 secs 2024-04-27T01:48:49.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26327.774520 secs 2024-04-27T01:48:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:50 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27024.804891 secs 2024-04-27T01:48:50.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:50 smithi189 ceph-mon[32756]: pgmap v14861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:50.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:50 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27024.804891 secs 2024-04-27T01:48:50.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:50 smithi156 ceph-mon[32679]: pgmap v14861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:50.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:50 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27024.804891 secs 2024-04-27T01:48:50.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:50 smithi092 ceph-mon[29156]: pgmap v14861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:48:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:52 smithi092 ceph-mon[29156]: pgmap v14862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:48:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:48:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:48:52.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:48:53.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:52 smithi189 ceph-mon[32756]: pgmap v14862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:53.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:48:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:48:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:48:53.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:48:53.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:52 smithi156 ceph-mon[32679]: pgmap v14862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:48:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:48:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:48:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:48:53.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:48:53.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:53 smithi092 ceph-mon[29156]: pgmap v14863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:48:53.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:53 smithi092 ceph-mon[29156]: pgmap v14864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:48:54.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:53 smithi189 ceph-mon[32756]: pgmap v14863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:48:54.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:53 smithi189 ceph-mon[32756]: pgmap v14864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:48:54.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:53 smithi156 ceph-mon[32679]: pgmap v14863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:48:54.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:53 smithi156 ceph-mon[32679]: pgmap v14864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:48:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27029.804971 secs 2024-04-27T01:48:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26332.774617 secs 2024-04-27T01:48:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27029.804971 secs 2024-04-27T01:48:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26332.774617 secs 2024-04-27T01:48:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27029.804971 secs 2024-04-27T01:48:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26332.774617 secs 2024-04-27T01:48:55.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:55 smithi092 ceph-mon[29156]: pgmap v14865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:56.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:55 smithi189 ceph-mon[32756]: pgmap v14865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:56.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:55 smithi156 ceph-mon[32679]: pgmap v14865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:57 smithi092 ceph-mon[29156]: pgmap v14866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:58.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:57 smithi189 ceph-mon[32756]: pgmap v14866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:57 smithi156 ceph-mon[32679]: pgmap v14866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:48:59.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:59 smithi156 ceph-mon[32679]: pgmap v14867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:48:59.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27034.805038 secs 2024-04-27T01:48:59.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:48:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26337.774742 secs 2024-04-27T01:48:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:59 smithi092 ceph-mon[29156]: pgmap v14867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:48:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27034.805038 secs 2024-04-27T01:48:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:48:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26337.774742 secs 2024-04-27T01:49:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:59 smithi189 ceph-mon[32756]: pgmap v14867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:49:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27034.805038 secs 2024-04-27T01:49:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:48:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26337.774742 secs 2024-04-27T01:49:01.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:01 smithi092 ceph-mon[29156]: pgmap v14868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:49:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:01 smithi189 ceph-mon[32756]: pgmap v14868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:49:02.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:01 smithi156 ceph-mon[32679]: pgmap v14868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:49:03.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:03 smithi092 ceph-mon[29156]: pgmap v14869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:49:04.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:03 smithi189 ceph-mon[32756]: pgmap v14869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:49:04.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:03 smithi156 ceph-mon[32679]: pgmap v14869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:49:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27039.805127 secs 2024-04-27T01:49:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26342.774862 secs 2024-04-27T01:49:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27039.805127 secs 2024-04-27T01:49:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26342.774862 secs 2024-04-27T01:49:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27039.805127 secs 2024-04-27T01:49:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26342.774862 secs 2024-04-27T01:49:05.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:05 smithi092 ceph-mon[29156]: pgmap v14870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:06.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:05 smithi189 ceph-mon[32756]: pgmap v14870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:06.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:05 smithi156 ceph-mon[32679]: pgmap v14870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:07.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:07 smithi092 ceph-mon[29156]: pgmap v14871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:08.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:07 smithi189 ceph-mon[32756]: pgmap v14871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:08.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:07 smithi156 ceph-mon[32679]: pgmap v14871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:09 smithi092 ceph-mon[29156]: pgmap v14872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27044.805251 secs 2024-04-27T01:49:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:09 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 26347.774988 secs 2024-04-27T01:49:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:09 smithi092 ceph-mon[29156]: slow request 360.988399 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:09 smithi189 ceph-mon[32756]: pgmap v14872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27044.805251 secs 2024-04-27T01:49:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:09 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 26347.774988 secs 2024-04-27T01:49:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:09 smithi189 ceph-mon[32756]: slow request 360.988399 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:09 smithi156 ceph-mon[32679]: pgmap v14872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27044.805251 secs 2024-04-27T01:49:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:09 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 26347.774988 secs 2024-04-27T01:49:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:09 smithi156 ceph-mon[32679]: slow request 360.988399 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:11.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:11 smithi092 ceph-mon[29156]: pgmap v14873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:12.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:11 smithi189 ceph-mon[32756]: pgmap v14873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:12.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:11 smithi156 ceph-mon[32679]: pgmap v14873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:14.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:13 smithi189 ceph-mon[32756]: pgmap v14874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:14.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:13 smithi156 ceph-mon[32679]: pgmap v14874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:14.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:13 smithi092 ceph-mon[29156]: pgmap v14874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27049.805370 secs 2024-04-27T01:49:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26352.775098 secs 2024-04-27T01:49:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27049.805370 secs 2024-04-27T01:49:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26352.775098 secs 2024-04-27T01:49:15.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27049.805370 secs 2024-04-27T01:49:15.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26352.775098 secs 2024-04-27T01:49:16.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:15 smithi189 ceph-mon[32756]: pgmap v14875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:16.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:15 smithi156 ceph-mon[32679]: pgmap v14875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:16.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:15 smithi092 ceph-mon[29156]: pgmap v14875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:18.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:17 smithi189 ceph-mon[32756]: pgmap v14876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:18.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:17 smithi156 ceph-mon[32679]: pgmap v14876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:18.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:17 smithi092 ceph-mon[29156]: pgmap v14876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:19 smithi189 ceph-mon[32756]: pgmap v14877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27054.805488 secs 2024-04-27T01:49:20.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26357.775215 secs 2024-04-27T01:49:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:19 smithi156 ceph-mon[32679]: pgmap v14877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27054.805488 secs 2024-04-27T01:49:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26357.775215 secs 2024-04-27T01:49:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:19 smithi092 ceph-mon[29156]: pgmap v14877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27054.805488 secs 2024-04-27T01:49:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26357.775215 secs 2024-04-27T01:49:22.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:21 smithi189 ceph-mon[32756]: pgmap v14878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:22.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:21 smithi156 ceph-mon[32679]: pgmap v14878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:22.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:21 smithi092 ceph-mon[29156]: pgmap v14878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:24.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:23 smithi189 ceph-mon[32756]: pgmap v14879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:24.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:23 smithi156 ceph-mon[32679]: pgmap v14879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:24.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:23 smithi092 ceph-mon[29156]: pgmap v14879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27059.805597 secs 2024-04-27T01:49:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26362.775338 secs 2024-04-27T01:49:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27059.805597 secs 2024-04-27T01:49:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26362.775338 secs 2024-04-27T01:49:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27059.805597 secs 2024-04-27T01:49:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26362.775338 secs 2024-04-27T01:49:26.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:25 smithi189 ceph-mon[32756]: pgmap v14880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:26.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:25 smithi156 ceph-mon[32679]: pgmap v14880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:26.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:25 smithi092 ceph-mon[29156]: pgmap v14880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:28.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:27 smithi189 ceph-mon[32756]: pgmap v14881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:28.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:27 smithi156 ceph-mon[32679]: pgmap v14881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:28.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:27 smithi092 ceph-mon[29156]: pgmap v14881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:29 smithi189 ceph-mon[32756]: pgmap v14882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27064.805730 secs 2024-04-27T01:49:30.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26367.775460 secs 2024-04-27T01:49:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:29 smithi156 ceph-mon[32679]: pgmap v14882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27064.805730 secs 2024-04-27T01:49:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26367.775460 secs 2024-04-27T01:49:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:29 smithi092 ceph-mon[29156]: pgmap v14882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27064.805730 secs 2024-04-27T01:49:30.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26367.775460 secs 2024-04-27T01:49:32.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:31 smithi189 ceph-mon[32756]: pgmap v14883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:32.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:31 smithi156 ceph-mon[32679]: pgmap v14883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:32.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:31 smithi092 ceph-mon[29156]: pgmap v14883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:34.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:33 smithi189 ceph-mon[32756]: pgmap v14884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:34.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:33 smithi156 ceph-mon[32679]: pgmap v14884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:34.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:33 smithi092 ceph-mon[29156]: pgmap v14884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27069.805873 secs 2024-04-27T01:49:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26372.775583 secs 2024-04-27T01:49:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27069.805873 secs 2024-04-27T01:49:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26372.775583 secs 2024-04-27T01:49:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27069.805873 secs 2024-04-27T01:49:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26372.775583 secs 2024-04-27T01:49:36.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:35 smithi189 ceph-mon[32756]: pgmap v14885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:36.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:35 smithi156 ceph-mon[32679]: pgmap v14885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:36.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:35 smithi092 ceph-mon[29156]: pgmap v14885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:38.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:37 smithi189 ceph-mon[32756]: pgmap v14886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:38.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:37 smithi156 ceph-mon[32679]: pgmap v14886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:38.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:37 smithi092 ceph-mon[29156]: pgmap v14886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:39 smithi189 ceph-mon[32756]: pgmap v14887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27074.806044 secs 2024-04-27T01:49:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:39 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 26377.775693 secs 2024-04-27T01:49:40.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:39 smithi189 ceph-mon[32756]: slow request 5762.506307 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:39 smithi156 ceph-mon[32679]: pgmap v14887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27074.806044 secs 2024-04-27T01:49:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:39 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 26377.775693 secs 2024-04-27T01:49:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:39 smithi156 ceph-mon[32679]: slow request 5762.506307 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:39 smithi092 ceph-mon[29156]: pgmap v14887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27074.806044 secs 2024-04-27T01:49:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:39 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 26377.775693 secs 2024-04-27T01:49:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:39 smithi092 ceph-mon[29156]: slow request 5762.506307 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:49:42.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:41 smithi189 ceph-mon[32756]: pgmap v14888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:42.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:41 smithi156 ceph-mon[32679]: pgmap v14888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:42.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:41 smithi092 ceph-mon[29156]: pgmap v14888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:44.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:43 smithi189 ceph-mon[32756]: pgmap v14889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:44.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:43 smithi156 ceph-mon[32679]: pgmap v14889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:44.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:43 smithi092 ceph-mon[29156]: pgmap v14889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27079.806139 secs 2024-04-27T01:49:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26382.775817 secs 2024-04-27T01:49:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27079.806139 secs 2024-04-27T01:49:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26382.775817 secs 2024-04-27T01:49:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27079.806139 secs 2024-04-27T01:49:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26382.775817 secs 2024-04-27T01:49:46.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:45 smithi189 ceph-mon[32756]: pgmap v14890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:46.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:45 smithi156 ceph-mon[32679]: pgmap v14890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:46.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:45 smithi092 ceph-mon[29156]: pgmap v14890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:48.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:47 smithi189 ceph-mon[32756]: pgmap v14891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:48.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:47 smithi156 ceph-mon[32679]: pgmap v14891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:48.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:47 smithi092 ceph-mon[29156]: pgmap v14891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:49 smithi189 ceph-mon[32756]: pgmap v14892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27084.806265 secs 2024-04-27T01:49:50.120 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26387.775895 secs 2024-04-27T01:49:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:49 smithi156 ceph-mon[32679]: pgmap v14892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27084.806265 secs 2024-04-27T01:49:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26387.775895 secs 2024-04-27T01:49:50.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:49 smithi092 ceph-mon[29156]: pgmap v14892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:50.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27084.806265 secs 2024-04-27T01:49:50.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26387.775895 secs 2024-04-27T01:49:51.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:50 smithi189 ceph-mon[32756]: pgmap v14893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:51.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:50 smithi156 ceph-mon[32679]: pgmap v14893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:51.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:50 smithi092 ceph-mon[29156]: pgmap v14893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: pgmap v14894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: pgmap v14894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.818 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.819 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: pgmap v14894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:53.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:54.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27089.806337 secs 2024-04-27T01:49:54.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26392.775964 secs 2024-04-27T01:49:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27089.806337 secs 2024-04-27T01:49:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26392.775964 secs 2024-04-27T01:49:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27089.806337 secs 2024-04-27T01:49:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26392.775964 secs 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: pgmap v14895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: pgmap v14895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: pgmap v14895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:56.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:49:56.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:56.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:49:56.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:49:56.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:56.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T01:49:56.917 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:49:56.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:49:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:49:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:57 smithi189 ceph-mon[32756]: pgmap v14896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:57 smithi189 ceph-mon[32756]: pgmap v14897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:49:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:57 smithi156 ceph-mon[32679]: pgmap v14896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:57 smithi156 ceph-mon[32679]: pgmap v14897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T01:49:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T01:49:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:57 smithi092 ceph-mon[29156]: pgmap v14896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:49:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:57 smithi092 ceph-mon[29156]: pgmap v14897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:59 smithi189 ceph-mon[32756]: pgmap v14898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27094.806462 secs 2024-04-27T01:49:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:49:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26397.776053 secs 2024-04-27T01:49:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:59 smithi156 ceph-mon[32679]: pgmap v14898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27094.806462 secs 2024-04-27T01:49:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:49:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26397.776053 secs 2024-04-27T01:49:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:59 smithi092 ceph-mon[29156]: pgmap v14898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:49:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27094.806462 secs 2024-04-27T01:49:59.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:49:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26397.776053 secs 2024-04-27T01:50:00.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:50:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:50:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T01:50:01.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:01 smithi189 ceph-mon[32756]: pgmap v14899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:01.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:01 smithi156 ceph-mon[32679]: pgmap v14899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:01.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:01 smithi092 ceph-mon[29156]: pgmap v14899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:03.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:03 smithi189 ceph-mon[32756]: pgmap v14900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:03.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:03 smithi156 ceph-mon[32679]: pgmap v14900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:03.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:03 smithi092 ceph-mon[29156]: pgmap v14900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:04 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27099.806585 secs 2024-04-27T01:50:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26402.776176 secs 2024-04-27T01:50:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:04 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27099.806585 secs 2024-04-27T01:50:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26402.776176 secs 2024-04-27T01:50:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:04 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27099.806585 secs 2024-04-27T01:50:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26402.776176 secs 2024-04-27T01:50:05.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:05 smithi189 ceph-mon[32756]: pgmap v14901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:05.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:05 smithi156 ceph-mon[32679]: pgmap v14901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:05.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:05 smithi092 ceph-mon[29156]: pgmap v14901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T01:50:07.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:07 smithi189 ceph-mon[32756]: pgmap v14902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:50:07.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:07 smithi156 ceph-mon[32679]: pgmap v14902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:50:07.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:07 smithi092 ceph-mon[29156]: pgmap v14902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:50:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:09 smithi189 ceph-mon[32756]: pgmap v14903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:09 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27104.806747 secs 2024-04-27T01:50:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26407.776311 secs 2024-04-27T01:50:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:09 smithi156 ceph-mon[32679]: pgmap v14903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:09 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27104.806747 secs 2024-04-27T01:50:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26407.776311 secs 2024-04-27T01:50:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:09 smithi092 ceph-mon[29156]: pgmap v14903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:09 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27104.806747 secs 2024-04-27T01:50:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26407.776311 secs 2024-04-27T01:50:11.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:11 smithi189 ceph-mon[32756]: pgmap v14904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:11.893 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:11 smithi092 ceph-mon[29156]: pgmap v14904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:11.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:11 smithi156 ceph-mon[32679]: pgmap v14904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:13.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:13 smithi189 ceph-mon[32756]: pgmap v14905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:13.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:13 smithi156 ceph-mon[32679]: pgmap v14905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:13.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:13 smithi092 ceph-mon[29156]: pgmap v14905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:14 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27109.806875 secs 2024-04-27T01:50:14.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26412.776408 secs 2024-04-27T01:50:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:14 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27109.806875 secs 2024-04-27T01:50:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26412.776408 secs 2024-04-27T01:50:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:14 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27109.806875 secs 2024-04-27T01:50:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26412.776408 secs 2024-04-27T01:50:15.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:15 smithi189 ceph-mon[32756]: pgmap v14906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:15.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:15 smithi156 ceph-mon[32679]: pgmap v14906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:15.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:15 smithi092 ceph-mon[29156]: pgmap v14906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:17.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:17 smithi189 ceph-mon[32756]: pgmap v14907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:17.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:17 smithi156 ceph-mon[32679]: pgmap v14907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:17.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:17 smithi092 ceph-mon[29156]: pgmap v14907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:19 smithi189 ceph-mon[32756]: pgmap v14908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:19 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27114.807003 secs 2024-04-27T01:50:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26417.776528 secs 2024-04-27T01:50:19.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:19 smithi156 ceph-mon[32679]: pgmap v14908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:19.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:19 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27114.807003 secs 2024-04-27T01:50:19.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26417.776528 secs 2024-04-27T01:50:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:19 smithi092 ceph-mon[29156]: pgmap v14908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:19 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27114.807003 secs 2024-04-27T01:50:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26417.776528 secs 2024-04-27T01:50:21.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:21 smithi189 ceph-mon[32756]: pgmap v14909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:21.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:21 smithi156 ceph-mon[32679]: pgmap v14909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:21.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:21 smithi092 ceph-mon[29156]: pgmap v14909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:23.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:23 smithi189 ceph-mon[32756]: pgmap v14910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:23.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:23 smithi156 ceph-mon[32679]: pgmap v14910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:23.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:23 smithi092 ceph-mon[29156]: pgmap v14910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:24 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27119.807097 secs 2024-04-27T01:50:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26422.776640 secs 2024-04-27T01:50:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:24 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27119.807097 secs 2024-04-27T01:50:24.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26422.776640 secs 2024-04-27T01:50:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:24 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27119.807097 secs 2024-04-27T01:50:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26422.776640 secs 2024-04-27T01:50:25.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:25 smithi189 ceph-mon[32756]: pgmap v14911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:25.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:25 smithi156 ceph-mon[32679]: pgmap v14911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:25 smithi092 ceph-mon[29156]: pgmap v14911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:27.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:27 smithi189 ceph-mon[32756]: pgmap v14912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:27.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:27 smithi156 ceph-mon[32679]: pgmap v14912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:27.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:27 smithi092 ceph-mon[29156]: pgmap v14912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:29 smithi189 ceph-mon[32756]: pgmap v14913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:29 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27124.807194 secs 2024-04-27T01:50:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26427.776758 secs 2024-04-27T01:50:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:29 smithi156 ceph-mon[32679]: pgmap v14913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:29 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27124.807194 secs 2024-04-27T01:50:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26427.776758 secs 2024-04-27T01:50:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:29 smithi092 ceph-mon[29156]: pgmap v14913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:29 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27124.807194 secs 2024-04-27T01:50:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26427.776758 secs 2024-04-27T01:50:31.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:31 smithi189 ceph-mon[32756]: pgmap v14914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:31.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:31 smithi156 ceph-mon[32679]: pgmap v14914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:31.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:31 smithi092 ceph-mon[29156]: pgmap v14914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:33.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:33 smithi189 ceph-mon[32756]: pgmap v14915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:33.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:33 smithi156 ceph-mon[32679]: pgmap v14915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:33.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:33 smithi092 ceph-mon[29156]: pgmap v14915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:34 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27129.807273 secs 2024-04-27T01:50:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26432.776833 secs 2024-04-27T01:50:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:34 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27129.807273 secs 2024-04-27T01:50:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26432.776833 secs 2024-04-27T01:50:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:34 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27129.807273 secs 2024-04-27T01:50:34.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26432.776833 secs 2024-04-27T01:50:35.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:35 smithi189 ceph-mon[32756]: pgmap v14916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:35.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:35 smithi156 ceph-mon[32679]: pgmap v14916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:35.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:35 smithi092 ceph-mon[29156]: pgmap v14916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:37.562 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:37 smithi092 ceph-mon[29156]: pgmap v14917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:37.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:37 smithi189 ceph-mon[32756]: pgmap v14917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:37.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:37 smithi156 ceph-mon[32679]: pgmap v14917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:39 smithi189 ceph-mon[32756]: pgmap v14918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:39 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27134.807389 secs 2024-04-27T01:50:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26437.776957 secs 2024-04-27T01:50:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:39 smithi156 ceph-mon[32679]: pgmap v14918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:39 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27134.807389 secs 2024-04-27T01:50:39.916 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26437.776957 secs 2024-04-27T01:50:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:39 smithi092 ceph-mon[29156]: pgmap v14918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:39 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27134.807389 secs 2024-04-27T01:50:39.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26437.776957 secs 2024-04-27T01:50:41.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:41 smithi189 ceph-mon[32756]: pgmap v14919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:41.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:41 smithi156 ceph-mon[32679]: pgmap v14919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:41.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:41 smithi092 ceph-mon[29156]: pgmap v14919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:43.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:43 smithi189 ceph-mon[32756]: pgmap v14920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:43.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:43 smithi156 ceph-mon[32679]: pgmap v14920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:43.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:43 smithi092 ceph-mon[29156]: pgmap v14920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:44 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27139.807506 secs 2024-04-27T01:50:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26442.777071 secs 2024-04-27T01:50:44.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:44 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27139.807506 secs 2024-04-27T01:50:44.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26442.777071 secs 2024-04-27T01:50:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:44 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27139.807506 secs 2024-04-27T01:50:44.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26442.777071 secs 2024-04-27T01:50:45.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:45 smithi189 ceph-mon[32756]: pgmap v14921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:45.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:45 smithi156 ceph-mon[32679]: pgmap v14921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:45.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:45 smithi092 ceph-mon[29156]: pgmap v14921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:47.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:47 smithi189 ceph-mon[32756]: pgmap v14922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:47.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:47 smithi156 ceph-mon[32679]: pgmap v14922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:47.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:47 smithi092 ceph-mon[29156]: pgmap v14922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:49 smithi189 ceph-mon[32756]: pgmap v14923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:49 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27144.807595 secs 2024-04-27T01:50:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26447.777189 secs 2024-04-27T01:50:49.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:49 smithi156 ceph-mon[32679]: pgmap v14923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:49.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:49 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27144.807595 secs 2024-04-27T01:50:49.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26447.777189 secs 2024-04-27T01:50:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:49 smithi092 ceph-mon[29156]: pgmap v14923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:49 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27144.807595 secs 2024-04-27T01:50:49.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26447.777189 secs 2024-04-27T01:50:51.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:51 smithi189 ceph-mon[32756]: pgmap v14924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:51.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:51 smithi156 ceph-mon[32679]: pgmap v14924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:51.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:51 smithi092 ceph-mon[29156]: pgmap v14924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:53.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:53 smithi189 ceph-mon[32756]: pgmap v14925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:53.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:53 smithi156 ceph-mon[32679]: pgmap v14925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:53.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:53 smithi092 ceph-mon[29156]: pgmap v14925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:54 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27149.807690 secs 2024-04-27T01:50:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26452.777330 secs 2024-04-27T01:50:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:54 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27149.807690 secs 2024-04-27T01:50:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26452.777330 secs 2024-04-27T01:50:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:54 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27149.807690 secs 2024-04-27T01:50:54.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26452.777330 secs 2024-04-27T01:50:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:55 smithi189 ceph-mon[32756]: pgmap v14926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:55.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:55 smithi156 ceph-mon[32679]: pgmap v14926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:55.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:55 smithi092 ceph-mon[29156]: pgmap v14926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:50:56.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:50:56.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:50:56.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:50:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: pgmap v14927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:50:57.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:50:57.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: pgmap v14928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:50:57.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: pgmap v14929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:50:57.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: pgmap v14927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: pgmap v14928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: pgmap v14929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:50:57.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: pgmap v14927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: pgmap v14928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: pgmap v14929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:50:57.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:50:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:58 smithi189 ceph-mon[32756]: pgmap v14930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:50:59.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:58 smithi156 ceph-mon[32679]: pgmap v14930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:50:59.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:58 smithi092 ceph-mon[29156]: pgmap v14930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:59 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27154.807832 secs 2024-04-27T01:51:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:50:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26457.777460 secs 2024-04-27T01:51:00.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:59 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27154.807832 secs 2024-04-27T01:51:00.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:50:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26457.777460 secs 2024-04-27T01:51:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:59 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27154.807832 secs 2024-04-27T01:51:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:50:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26457.777460 secs 2024-04-27T01:51:01.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:00 smithi156 ceph-mon[32679]: pgmap v14931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:01.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:00 smithi092 ceph-mon[29156]: pgmap v14931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:01.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:00 smithi189 ceph-mon[32756]: pgmap v14931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:03.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:02 smithi189 ceph-mon[32756]: pgmap v14932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:03.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:02 smithi156 ceph-mon[32679]: pgmap v14932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:02 smithi092 ceph-mon[29156]: pgmap v14932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:04.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26462.777579 secs 2024-04-27T01:51:04.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26462.777579 secs 2024-04-27T01:51:04.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26462.777579 secs 2024-04-27T01:51:05.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:05 smithi189 ceph-mon[32756]: 10 slow requests, 0 included below; oldest blocked for > 27159.807937 secs 2024-04-27T01:51:05.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:05 smithi189 ceph-mon[32756]: pgmap v14933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:05.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:05 smithi156 ceph-mon[32679]: 10 slow requests, 0 included below; oldest blocked for > 27159.807937 secs 2024-04-27T01:51:05.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:05 smithi156 ceph-mon[32679]: pgmap v14933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:05 smithi092 ceph-mon[29156]: 10 slow requests, 0 included below; oldest blocked for > 27159.807937 secs 2024-04-27T01:51:05.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:05 smithi092 ceph-mon[29156]: pgmap v14933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:51:07.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:06 smithi189 ceph-mon[32756]: pgmap v14934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:51:07.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:06 smithi156 ceph-mon[32679]: pgmap v14934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:51:07.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:06 smithi092 ceph-mon[29156]: pgmap v14934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:51:09.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:08 smithi189 ceph-mon[32756]: pgmap v14935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:08 smithi156 ceph-mon[32679]: pgmap v14935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:09.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:08 smithi092 ceph-mon[29156]: pgmap v14935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 27164.808033 secs 2024-04-27T01:51:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:09 smithi189 ceph-mon[32756]: slow request 180.732898 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:51:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26467.777701 secs 2024-04-27T01:51:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 27164.808033 secs 2024-04-27T01:51:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:09 smithi156 ceph-mon[32679]: slow request 180.732898 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:51:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26467.777701 secs 2024-04-27T01:51:10.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 27164.808033 secs 2024-04-27T01:51:10.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:09 smithi092 ceph-mon[29156]: slow request 180.732898 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:51:10.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26467.777701 secs 2024-04-27T01:51:11.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:10 smithi092 ceph-mon[29156]: pgmap v14936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:11.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:10 smithi156 ceph-mon[32679]: pgmap v14936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:11.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:10 smithi189 ceph-mon[32756]: pgmap v14936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:12.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:51:12.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:51:12.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:51:12.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:51:12.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T01:51:12.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:51:13.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:12 smithi156 ceph-mon[32679]: pgmap v14937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:13.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:12 smithi092 ceph-mon[29156]: pgmap v14937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:13.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:12 smithi189 ceph-mon[32756]: pgmap v14937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:14.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26472.777815 secs 2024-04-27T01:51:14.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26472.777815 secs 2024-04-27T01:51:14.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26472.777815 secs 2024-04-27T01:51:15.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27169.808144 secs 2024-04-27T01:51:15.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:15 smithi189 ceph-mon[32756]: pgmap v14938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:15.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27169.808144 secs 2024-04-27T01:51:15.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:15 smithi156 ceph-mon[32679]: pgmap v14938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:15.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27169.808144 secs 2024-04-27T01:51:15.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:15 smithi092 ceph-mon[29156]: pgmap v14938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:17.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:16 smithi189 ceph-mon[32756]: pgmap v14939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:17.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:16 smithi156 ceph-mon[32679]: pgmap v14939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:17.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:16 smithi092 ceph-mon[29156]: pgmap v14939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:19.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:18 smithi156 ceph-mon[32679]: pgmap v14940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:19.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:18 smithi092 ceph-mon[29156]: pgmap v14940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:19.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:18 smithi189 ceph-mon[32756]: pgmap v14940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27174.808257 secs 2024-04-27T01:51:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26477.777933 secs 2024-04-27T01:51:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27174.808257 secs 2024-04-27T01:51:20.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26477.777933 secs 2024-04-27T01:51:20.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27174.808257 secs 2024-04-27T01:51:20.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26477.777933 secs 2024-04-27T01:51:21.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:20 smithi156 ceph-mon[32679]: pgmap v14941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:21.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:20 smithi092 ceph-mon[29156]: pgmap v14941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:21.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:20 smithi189 ceph-mon[32756]: pgmap v14941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:23.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:22 smithi189 ceph-mon[32756]: pgmap v14942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:23.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:22 smithi156 ceph-mon[32679]: pgmap v14942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:23.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:22 smithi092 ceph-mon[29156]: pgmap v14942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:24.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26482.778051 secs 2024-04-27T01:51:24.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26482.778051 secs 2024-04-27T01:51:24.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26482.778051 secs 2024-04-27T01:51:25.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27179.808386 secs 2024-04-27T01:51:25.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:25 smithi189 ceph-mon[32756]: pgmap v14943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:25.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27179.808386 secs 2024-04-27T01:51:25.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:25 smithi156 ceph-mon[32679]: pgmap v14943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:25.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27179.808386 secs 2024-04-27T01:51:25.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:25 smithi092 ceph-mon[29156]: pgmap v14943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:27.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:26 smithi156 ceph-mon[32679]: pgmap v14944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:27.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:26 smithi092 ceph-mon[29156]: pgmap v14944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:27.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:26 smithi189 ceph-mon[32756]: pgmap v14944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:29.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:28 smithi156 ceph-mon[32679]: pgmap v14945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:29.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:28 smithi189 ceph-mon[32756]: pgmap v14945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:29.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:28 smithi092 ceph-mon[29156]: pgmap v14945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27184.808529 secs 2024-04-27T01:51:30.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26487.778164 secs 2024-04-27T01:51:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27184.808529 secs 2024-04-27T01:51:30.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26487.778164 secs 2024-04-27T01:51:30.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27184.808529 secs 2024-04-27T01:51:30.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26487.778164 secs 2024-04-27T01:51:31.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:30 smithi156 ceph-mon[32679]: pgmap v14946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:31.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:30 smithi092 ceph-mon[29156]: pgmap v14946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:31.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:30 smithi189 ceph-mon[32756]: pgmap v14946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:33.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:32 smithi156 ceph-mon[32679]: pgmap v14947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:33.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:32 smithi092 ceph-mon[29156]: pgmap v14947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:33.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:32 smithi189 ceph-mon[32756]: pgmap v14947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:34.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26492.778253 secs 2024-04-27T01:51:34.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26492.778253 secs 2024-04-27T01:51:34.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26492.778253 secs 2024-04-27T01:51:35.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27189.808635 secs 2024-04-27T01:51:35.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:35 smithi189 ceph-mon[32756]: pgmap v14948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:35.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27189.808635 secs 2024-04-27T01:51:35.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:35 smithi156 ceph-mon[32679]: pgmap v14948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:35.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27189.808635 secs 2024-04-27T01:51:35.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:35 smithi092 ceph-mon[29156]: pgmap v14948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:37.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:36 smithi156 ceph-mon[32679]: pgmap v14949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:37.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:36 smithi092 ceph-mon[29156]: pgmap v14949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:37.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:36 smithi189 ceph-mon[32756]: pgmap v14949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:39.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:38 smithi156 ceph-mon[32679]: pgmap v14950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:39.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:38 smithi092 ceph-mon[29156]: pgmap v14950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:39.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:38 smithi189 ceph-mon[32756]: pgmap v14950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:51:39.716+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:51:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:51:39.716+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:51:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:51:39.716+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:51:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:51:39.716+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 210 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:51:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27194.808756 secs 2024-04-27T01:51:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26497.778375 secs 2024-04-27T01:51:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27194.808756 secs 2024-04-27T01:51:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26497.778375 secs 2024-04-27T01:51:40.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27194.808756 secs 2024-04-27T01:51:40.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26497.778375 secs 2024-04-27T01:51:41.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:40 smithi156 ceph-mon[32679]: pgmap v14951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:41.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:40 smithi092 ceph-mon[29156]: pgmap v14951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:41.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:40 smithi189 ceph-mon[32756]: pgmap v14951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:43.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:42 smithi156 ceph-mon[32679]: pgmap v14952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:43.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:42 smithi092 ceph-mon[29156]: pgmap v14952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:43.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:42 smithi189 ceph-mon[32756]: pgmap v14952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:44.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26502.778496 secs 2024-04-27T01:51:44.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26502.778496 secs 2024-04-27T01:51:44.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26502.778496 secs 2024-04-27T01:51:45.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27199.808871 secs 2024-04-27T01:51:45.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:45 smithi189 ceph-mon[32756]: pgmap v14953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:45.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27199.808871 secs 2024-04-27T01:51:45.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:45 smithi156 ceph-mon[32679]: pgmap v14953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:45.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27199.808871 secs 2024-04-27T01:51:45.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:45 smithi092 ceph-mon[29156]: pgmap v14953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:47.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:46 smithi156 ceph-mon[32679]: pgmap v14954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:47.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:46 smithi092 ceph-mon[29156]: pgmap v14954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:47.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:46 smithi189 ceph-mon[32756]: pgmap v14954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:49.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:48 smithi156 ceph-mon[32679]: pgmap v14955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:49.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:48 smithi092 ceph-mon[29156]: pgmap v14955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:49.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:48 smithi189 ceph-mon[32756]: pgmap v14955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27204.808982 secs 2024-04-27T01:51:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26507.778562 secs 2024-04-27T01:51:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27204.808982 secs 2024-04-27T01:51:50.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26507.778562 secs 2024-04-27T01:51:50.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27204.808982 secs 2024-04-27T01:51:50.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26507.778562 secs 2024-04-27T01:51:51.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:50 smithi156 ceph-mon[32679]: pgmap v14956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:51.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:50 smithi092 ceph-mon[29156]: pgmap v14956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:51.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:50 smithi189 ceph-mon[32756]: pgmap v14956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:53.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:52 smithi156 ceph-mon[32679]: pgmap v14957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:53.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:52 smithi092 ceph-mon[29156]: pgmap v14957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:53.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:52 smithi189 ceph-mon[32756]: pgmap v14957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:54.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26512.778696 secs 2024-04-27T01:51:54.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26512.778696 secs 2024-04-27T01:51:54.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26512.778696 secs 2024-04-27T01:51:55.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27209.809058 secs 2024-04-27T01:51:55.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:55 smithi189 ceph-mon[32756]: pgmap v14958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:55.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27209.809058 secs 2024-04-27T01:51:55.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:55 smithi156 ceph-mon[32679]: pgmap v14958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:55.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27209.809058 secs 2024-04-27T01:51:55.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:55 smithi092 ceph-mon[29156]: pgmap v14958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:51:57.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:56 smithi156 ceph-mon[32679]: pgmap v14959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:57.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:51:57.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:56 smithi092 ceph-mon[29156]: pgmap v14959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:57.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:51:57.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:56 smithi189 ceph-mon[32756]: pgmap v14959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:51:57.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:51:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:51:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:51:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:57 smithi156 ceph-mon[32679]: pgmap v14960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:51:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:57 smithi156 ceph-mon[32679]: pgmap v14961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:58.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:51:58.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:51:58.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:51:58.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:57 smithi092 ceph-mon[29156]: pgmap v14960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:51:58.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:57 smithi092 ceph-mon[29156]: pgmap v14961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:58.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:51:58.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:51:58.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:51:58.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:57 smithi189 ceph-mon[32756]: pgmap v14960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:51:58.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:57 smithi189 ceph-mon[32756]: pgmap v14961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:51:58.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:51:59.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:51:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26517.778758 secs 2024-04-27T01:51:59.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:51:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26517.778758 secs 2024-04-27T01:51:59.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:51:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26517.778758 secs 2024-04-27T01:52:00.566 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27214.809167 secs 2024-04-27T01:52:00.566 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:00 smithi156 ceph-mon[32679]: pgmap v14962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:00.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27214.809167 secs 2024-04-27T01:52:00.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:00 smithi189 ceph-mon[32756]: pgmap v14962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:00.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27214.809167 secs 2024-04-27T01:52:00.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:00 smithi092 ceph-mon[29156]: pgmap v14962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:02.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:02 smithi189 ceph-mon[32756]: pgmap v14963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:02.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:02 smithi156 ceph-mon[32679]: pgmap v14963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:02.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:02 smithi092 ceph-mon[29156]: pgmap v14963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:04 smithi189 ceph-mon[32756]: pgmap v14964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27219.809231 secs 2024-04-27T01:52:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26522.778877 secs 2024-04-27T01:52:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:04 smithi156 ceph-mon[32679]: pgmap v14964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27219.809231 secs 2024-04-27T01:52:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26522.778877 secs 2024-04-27T01:52:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:04 smithi092 ceph-mon[29156]: pgmap v14964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27219.809231 secs 2024-04-27T01:52:04.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26522.778877 secs 2024-04-27T01:52:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:06 smithi189 ceph-mon[32756]: pgmap v14965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:06 smithi156 ceph-mon[32679]: pgmap v14965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:06 smithi092 ceph-mon[29156]: pgmap v14965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:52:08.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:08 smithi189 ceph-mon[32756]: pgmap v14966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:52:08.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:08 smithi156 ceph-mon[32679]: pgmap v14966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:52:08.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:08 smithi092 ceph-mon[29156]: pgmap v14966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:52:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27224.809352 secs 2024-04-27T01:52:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26527.778986 secs 2024-04-27T01:52:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27224.809352 secs 2024-04-27T01:52:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26527.778986 secs 2024-04-27T01:52:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27224.809352 secs 2024-04-27T01:52:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26527.778986 secs 2024-04-27T01:52:10.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:10 smithi189 ceph-mon[32756]: pgmap v14967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:10.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:10 smithi156 ceph-mon[32679]: pgmap v14967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:10.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:10 smithi092 ceph-mon[29156]: pgmap v14967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:12.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:12 smithi092 ceph-mon[29156]: pgmap v14968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:13.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:12 smithi189 ceph-mon[32756]: pgmap v14968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:13.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:12 smithi156 ceph-mon[32679]: pgmap v14968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:14 smithi092 ceph-mon[29156]: pgmap v14969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27229.809487 secs 2024-04-27T01:52:14.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26532.779104 secs 2024-04-27T01:52:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:14 smithi189 ceph-mon[32756]: pgmap v14969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27229.809487 secs 2024-04-27T01:52:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26532.779104 secs 2024-04-27T01:52:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:14 smithi156 ceph-mon[32679]: pgmap v14969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27229.809487 secs 2024-04-27T01:52:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26532.779104 secs 2024-04-27T01:52:16.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:16 smithi092 ceph-mon[29156]: pgmap v14970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:17.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:16 smithi189 ceph-mon[32756]: pgmap v14970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:17.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:16 smithi156 ceph-mon[32679]: pgmap v14970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:18.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:18 smithi092 ceph-mon[29156]: pgmap v14971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:19.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:18 smithi189 ceph-mon[32756]: pgmap v14971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:19.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:18 smithi156 ceph-mon[32679]: pgmap v14971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27234.809604 secs 2024-04-27T01:52:19.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26537.779214 secs 2024-04-27T01:52:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27234.809604 secs 2024-04-27T01:52:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26537.779214 secs 2024-04-27T01:52:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27234.809604 secs 2024-04-27T01:52:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26537.779214 secs 2024-04-27T01:52:20.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:20 smithi092 ceph-mon[29156]: pgmap v14972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:21.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:20 smithi189 ceph-mon[32756]: pgmap v14972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:21.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:20 smithi156 ceph-mon[32679]: pgmap v14972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:22.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:22 smithi092 ceph-mon[29156]: pgmap v14973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:23.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:22 smithi189 ceph-mon[32756]: pgmap v14973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:23.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:22 smithi156 ceph-mon[32679]: pgmap v14973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:52:24.722+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:52:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:52:24.722+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:52:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:52:24.722+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:52:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:52:24.722+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 211 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:52:24.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:24 smithi092 ceph-mon[29156]: pgmap v14974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27239.809718 secs 2024-04-27T01:52:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26542.779340 secs 2024-04-27T01:52:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:24 smithi189 ceph-mon[32756]: pgmap v14974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27239.809718 secs 2024-04-27T01:52:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26542.779340 secs 2024-04-27T01:52:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:24 smithi156 ceph-mon[32679]: pgmap v14974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27239.809718 secs 2024-04-27T01:52:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26542.779340 secs 2024-04-27T01:52:26.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:26 smithi092 ceph-mon[29156]: pgmap v14975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:27.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:26 smithi189 ceph-mon[32756]: pgmap v14975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:27.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:26 smithi156 ceph-mon[32679]: pgmap v14975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:28.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:28 smithi092 ceph-mon[29156]: pgmap v14976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:29.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:28 smithi189 ceph-mon[32756]: pgmap v14976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:29.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:28 smithi156 ceph-mon[32679]: pgmap v14976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:29.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27244.809851 secs 2024-04-27T01:52:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26547.779480 secs 2024-04-27T01:52:30.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27244.809851 secs 2024-04-27T01:52:30.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26547.779480 secs 2024-04-27T01:52:30.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27244.809851 secs 2024-04-27T01:52:30.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26547.779480 secs 2024-04-27T01:52:30.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:30 smithi092 ceph-mon[29156]: pgmap v14977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:31.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:30 smithi189 ceph-mon[32756]: pgmap v14977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:31.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:30 smithi156 ceph-mon[32679]: pgmap v14977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:33.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:32 smithi189 ceph-mon[32756]: pgmap v14978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:33.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:32 smithi156 ceph-mon[32679]: pgmap v14978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:33.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:32 smithi092 ceph-mon[29156]: pgmap v14978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:34 smithi189 ceph-mon[32756]: pgmap v14979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27249.809996 secs 2024-04-27T01:52:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26552.779559 secs 2024-04-27T01:52:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:34 smithi156 ceph-mon[32679]: pgmap v14979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27249.809996 secs 2024-04-27T01:52:35.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26552.779559 secs 2024-04-27T01:52:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:34 smithi092 ceph-mon[29156]: pgmap v14979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27249.809996 secs 2024-04-27T01:52:35.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26552.779559 secs 2024-04-27T01:52:37.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:36 smithi189 ceph-mon[32756]: pgmap v14980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:37.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:36 smithi156 ceph-mon[32679]: pgmap v14980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:37.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:36 smithi092 ceph-mon[29156]: pgmap v14980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:39.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:38 smithi189 ceph-mon[32756]: pgmap v14981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:39.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:38 smithi156 ceph-mon[32679]: pgmap v14981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:39.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:38 smithi092 ceph-mon[29156]: pgmap v14981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27254.810060 secs 2024-04-27T01:52:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26557.779678 secs 2024-04-27T01:52:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27254.810060 secs 2024-04-27T01:52:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26557.779678 secs 2024-04-27T01:52:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27254.810060 secs 2024-04-27T01:52:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26557.779678 secs 2024-04-27T01:52:41.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:40 smithi189 ceph-mon[32756]: pgmap v14982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:41.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:40 smithi156 ceph-mon[32679]: pgmap v14982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:41.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:40 smithi092 ceph-mon[29156]: pgmap v14982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:43.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:42 smithi092 ceph-mon[29156]: pgmap v14983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:43.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:42 smithi189 ceph-mon[32756]: pgmap v14983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:43.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:42 smithi156 ceph-mon[32679]: pgmap v14983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:44 smithi189 ceph-mon[32756]: pgmap v14984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27259.810177 secs 2024-04-27T01:52:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26562.779781 secs 2024-04-27T01:52:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:44 smithi156 ceph-mon[32679]: pgmap v14984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27259.810177 secs 2024-04-27T01:52:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26562.779781 secs 2024-04-27T01:52:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:44 smithi092 ceph-mon[29156]: pgmap v14984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27259.810177 secs 2024-04-27T01:52:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26562.779781 secs 2024-04-27T01:52:47.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:46 smithi189 ceph-mon[32756]: pgmap v14985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:47.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:46 smithi156 ceph-mon[32679]: pgmap v14985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:47.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:46 smithi092 ceph-mon[29156]: pgmap v14985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:49.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:48 smithi189 ceph-mon[32756]: pgmap v14986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:49.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:48 smithi156 ceph-mon[32679]: pgmap v14986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:49.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:48 smithi092 ceph-mon[29156]: pgmap v14986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27264.810242 secs 2024-04-27T01:52:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26567.779853 secs 2024-04-27T01:52:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27264.810242 secs 2024-04-27T01:52:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26567.779853 secs 2024-04-27T01:52:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27264.810242 secs 2024-04-27T01:52:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26567.779853 secs 2024-04-27T01:52:51.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:50 smithi189 ceph-mon[32756]: pgmap v14987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:51.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:50 smithi156 ceph-mon[32679]: pgmap v14987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:51.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:50 smithi092 ceph-mon[29156]: pgmap v14987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:53.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:52 smithi189 ceph-mon[32756]: pgmap v14988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:53.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:52 smithi156 ceph-mon[32679]: pgmap v14988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:53.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:52 smithi092 ceph-mon[29156]: pgmap v14988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:54 smithi189 ceph-mon[32756]: pgmap v14989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27269.810320 secs 2024-04-27T01:52:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26572.779965 secs 2024-04-27T01:52:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:54 smithi156 ceph-mon[32679]: pgmap v14989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27269.810320 secs 2024-04-27T01:52:55.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26572.779965 secs 2024-04-27T01:52:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:54 smithi092 ceph-mon[29156]: pgmap v14989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:52:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27269.810320 secs 2024-04-27T01:52:55.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26572.779965 secs 2024-04-27T01:52:57.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:56 smithi189 ceph-mon[32756]: pgmap v14990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:57.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:56 smithi156 ceph-mon[32679]: pgmap v14990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:57.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:56 smithi092 ceph-mon[29156]: pgmap v14990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:58.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:52:58.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:52:58.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:52:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:58 smithi189 ceph-mon[32756]: pgmap v14991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:52:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:52:59.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:52:59.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:58 smithi156 ceph-mon[32679]: pgmap v14991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:59.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:52:59.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:52:59.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:52:59.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:58 smithi092 ceph-mon[29156]: pgmap v14991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:52:59.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:52:59.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:52:59.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:53:00.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:59 smithi156 ceph-mon[32679]: pgmap v14992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:53:00.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:59 smithi156 ceph-mon[32679]: pgmap v14993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:00.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27274.810436 secs 2024-04-27T01:53:00.066 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:52:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26577.780076 secs 2024-04-27T01:53:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:59 smithi189 ceph-mon[32756]: pgmap v14992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:53:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:59 smithi189 ceph-mon[32756]: pgmap v14993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27274.810436 secs 2024-04-27T01:53:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:52:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26577.780076 secs 2024-04-27T01:53:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:59 smithi092 ceph-mon[29156]: pgmap v14992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:53:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:59 smithi092 ceph-mon[29156]: pgmap v14993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27274.810436 secs 2024-04-27T01:53:00.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:52:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26577.780076 secs 2024-04-27T01:53:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:01 smithi189 ceph-mon[32756]: pgmap v14994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:02.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:01 smithi156 ceph-mon[32679]: pgmap v14994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:01 smithi092 ceph-mon[29156]: pgmap v14994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:04.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:03 smithi189 ceph-mon[32756]: pgmap v14995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:03 smithi156 ceph-mon[32679]: pgmap v14995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:03 smithi092 ceph-mon[29156]: pgmap v14995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:53:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27279.810548 secs 2024-04-27T01:53:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26582.780192 secs 2024-04-27T01:53:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27279.810548 secs 2024-04-27T01:53:05.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26582.780192 secs 2024-04-27T01:53:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27279.810548 secs 2024-04-27T01:53:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26582.780192 secs 2024-04-27T01:53:06.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:05 smithi189 ceph-mon[32756]: pgmap v14996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:06.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:05 smithi156 ceph-mon[32679]: pgmap v14996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:06.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:05 smithi092 ceph-mon[29156]: pgmap v14996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:08.086 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:07 smithi092 ceph-mon[29156]: pgmap v14997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:07 smithi189 ceph-mon[32756]: pgmap v14997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:08.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:07 smithi156 ceph-mon[32679]: pgmap v14997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:53:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:53:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:53:08.104+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:53:08.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:53:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:53:08.104+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:53:08.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:53:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:53:08.104+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:53:08.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:53:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:53:08.104+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:53:08.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:53:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:53:08.104+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:53:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:09 smithi189 ceph-mon[32756]: pgmap v14998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:53:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27284.810658 secs 2024-04-27T01:53:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26587.780331 secs 2024-04-27T01:53:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:09 smithi156 ceph-mon[32679]: pgmap v14998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:53:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27284.810658 secs 2024-04-27T01:53:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26587.780331 secs 2024-04-27T01:53:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:09 smithi092 ceph-mon[29156]: pgmap v14998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:53:10.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27284.810658 secs 2024-04-27T01:53:10.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26587.780331 secs 2024-04-27T01:53:12.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:11 smithi189 ceph-mon[32756]: pgmap v14999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:12.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:11 smithi156 ceph-mon[32679]: pgmap v14999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:12.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:11 smithi092 ceph-mon[29156]: pgmap v14999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:14.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:13 smithi189 ceph-mon[32756]: pgmap v15000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:14.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:13 smithi156 ceph-mon[32679]: pgmap v15000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:13 smithi092 ceph-mon[29156]: pgmap v15000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27289.810777 secs 2024-04-27T01:53:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26592.780428 secs 2024-04-27T01:53:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27289.810777 secs 2024-04-27T01:53:15.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26592.780428 secs 2024-04-27T01:53:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27289.810777 secs 2024-04-27T01:53:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26592.780428 secs 2024-04-27T01:53:16.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:15 smithi189 ceph-mon[32756]: pgmap v15001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:16.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:15 smithi156 ceph-mon[32679]: pgmap v15001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:16.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:15 smithi092 ceph-mon[29156]: pgmap v15001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:17.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:17 smithi092 ceph-mon[29156]: pgmap v15002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:18.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:17 smithi189 ceph-mon[32756]: pgmap v15002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:18.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:17 smithi156 ceph-mon[32679]: pgmap v15002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:19 smithi189 ceph-mon[32756]: pgmap v15003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27294.810915 secs 2024-04-27T01:53:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26597.780557 secs 2024-04-27T01:53:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:19 smithi156 ceph-mon[32679]: pgmap v15003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27294.810915 secs 2024-04-27T01:53:20.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26597.780557 secs 2024-04-27T01:53:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:19 smithi092 ceph-mon[29156]: pgmap v15003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T01:53:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27294.810915 secs 2024-04-27T01:53:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26597.780557 secs 2024-04-27T01:53:22.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:21 smithi189 ceph-mon[32756]: pgmap v15004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:22.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:21 smithi156 ceph-mon[32679]: pgmap v15004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:22.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:21 smithi092 ceph-mon[29156]: pgmap v15004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T01:53:24.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:23 smithi189 ceph-mon[32756]: pgmap v15005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:24.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:23 smithi156 ceph-mon[32679]: pgmap v15005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:24.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:23 smithi092 ceph-mon[29156]: pgmap v15005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27299.811026 secs 2024-04-27T01:53:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26602.780678 secs 2024-04-27T01:53:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27299.811026 secs 2024-04-27T01:53:25.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26602.780678 secs 2024-04-27T01:53:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27299.811026 secs 2024-04-27T01:53:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26602.780678 secs 2024-04-27T01:53:26.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:25 smithi189 ceph-mon[32756]: pgmap v15006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:53:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:25 smithi156 ceph-mon[32679]: pgmap v15006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:53:26.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:25 smithi092 ceph-mon[29156]: pgmap v15006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T01:53:27.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:26 smithi189 ceph-mon[32756]: pgmap v15007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:27.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:26 smithi156 ceph-mon[32679]: pgmap v15007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:27.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:26 smithi092 ceph-mon[29156]: pgmap v15007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:29.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:29 smithi156 ceph-mon[32679]: pgmap v15008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:29.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27304.811128 secs 2024-04-27T01:53:29.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26607.780756 secs 2024-04-27T01:53:29.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:29 smithi092 ceph-mon[29156]: pgmap v15008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:29.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27304.811128 secs 2024-04-27T01:53:29.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26607.780756 secs 2024-04-27T01:53:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:29 smithi189 ceph-mon[32756]: pgmap v15008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27304.811128 secs 2024-04-27T01:53:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26607.780756 secs 2024-04-27T01:53:31.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:31 smithi156 ceph-mon[32679]: pgmap v15009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:31.671 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:31 smithi189 ceph-mon[32756]: pgmap v15009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:31.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:31 smithi092 ceph-mon[29156]: pgmap v15009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:33.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:33 smithi156 ceph-mon[32679]: pgmap v15010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:33.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:33 smithi092 ceph-mon[29156]: pgmap v15010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:33.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:33 smithi189 ceph-mon[32756]: pgmap v15010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:34.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27309.811221 secs 2024-04-27T01:53:34.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26612.780876 secs 2024-04-27T01:53:34.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27309.811221 secs 2024-04-27T01:53:34.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26612.780876 secs 2024-04-27T01:53:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27309.811221 secs 2024-04-27T01:53:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26612.780876 secs 2024-04-27T01:53:35.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:35 smithi156 ceph-mon[32679]: pgmap v15011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:35.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:35 smithi092 ceph-mon[29156]: pgmap v15011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:35.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:35 smithi189 ceph-mon[32756]: pgmap v15011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:37.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:37 smithi156 ceph-mon[32679]: pgmap v15012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:37.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:37 smithi092 ceph-mon[29156]: pgmap v15012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:37.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:37 smithi189 ceph-mon[32756]: pgmap v15012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:39.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:39 smithi156 ceph-mon[32679]: pgmap v15013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:39.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27314.811296 secs 2024-04-27T01:53:39.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26617.780984 secs 2024-04-27T01:53:39.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:39 smithi092 ceph-mon[29156]: pgmap v15013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:39.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27314.811296 secs 2024-04-27T01:53:39.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26617.780984 secs 2024-04-27T01:53:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:39 smithi189 ceph-mon[32756]: pgmap v15013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27314.811296 secs 2024-04-27T01:53:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26617.780984 secs 2024-04-27T01:53:41.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:41 smithi156 ceph-mon[32679]: pgmap v15014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:41.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:41 smithi092 ceph-mon[29156]: pgmap v15014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:41.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:41 smithi189 ceph-mon[32756]: pgmap v15014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:43.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:43 smithi156 ceph-mon[32679]: pgmap v15015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:43.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:43 smithi092 ceph-mon[29156]: pgmap v15015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:43.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:43 smithi189 ceph-mon[32756]: pgmap v15015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:44.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27319.811430 secs 2024-04-27T01:53:44.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26622.781116 secs 2024-04-27T01:53:44.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27319.811430 secs 2024-04-27T01:53:44.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26622.781116 secs 2024-04-27T01:53:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27319.811430 secs 2024-04-27T01:53:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26622.781116 secs 2024-04-27T01:53:45.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:45 smithi092 ceph-mon[29156]: pgmap v15016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:45.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:45 smithi189 ceph-mon[32756]: pgmap v15016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:45.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:45 smithi156 ceph-mon[32679]: pgmap v15016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:47.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:47 smithi092 ceph-mon[29156]: pgmap v15017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:47.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:47 smithi189 ceph-mon[32756]: pgmap v15017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:47.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:47 smithi156 ceph-mon[32679]: pgmap v15017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:49.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:49 smithi092 ceph-mon[29156]: pgmap v15018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:49.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27324.811548 secs 2024-04-27T01:53:49.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26627.781233 secs 2024-04-27T01:53:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:49 smithi189 ceph-mon[32756]: pgmap v15018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27324.811548 secs 2024-04-27T01:53:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26627.781233 secs 2024-04-27T01:53:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:49 smithi156 ceph-mon[32679]: pgmap v15018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27324.811548 secs 2024-04-27T01:53:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26627.781233 secs 2024-04-27T01:53:51.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:51 smithi092 ceph-mon[29156]: pgmap v15019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:51.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:51 smithi189 ceph-mon[32756]: pgmap v15019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:51.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:51 smithi156 ceph-mon[32679]: pgmap v15019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:53.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:53 smithi092 ceph-mon[29156]: pgmap v15020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:53.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:53 smithi189 ceph-mon[32756]: pgmap v15020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:53.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:53 smithi156 ceph-mon[32679]: pgmap v15020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:54.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27329.811655 secs 2024-04-27T01:53:54.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26632.781324 secs 2024-04-27T01:53:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27329.811655 secs 2024-04-27T01:53:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26632.781324 secs 2024-04-27T01:53:54.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27329.811655 secs 2024-04-27T01:53:54.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26632.781324 secs 2024-04-27T01:53:55.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:55 smithi092 ceph-mon[29156]: pgmap v15021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:55.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:55 smithi189 ceph-mon[32756]: pgmap v15021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:55.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:55 smithi156 ceph-mon[32679]: pgmap v15021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:53:57.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:57 smithi092 ceph-mon[29156]: pgmap v15022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:57.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:57 smithi189 ceph-mon[32756]: pgmap v15022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:57.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:57 smithi156 ceph-mon[32679]: pgmap v15022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:58.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:53:58.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:53:58.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:53:59.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: pgmap v15023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:59.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27334.811718 secs 2024-04-27T01:53:59.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26637.781417 secs 2024-04-27T01:53:59.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:53:59.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:53:59.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:53:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: pgmap v15023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27334.811718 secs 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26637.781417 secs 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:53:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:53:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:53:59.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: pgmap v15023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:53:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27334.811718 secs 2024-04-27T01:53:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26637.781417 secs 2024-04-27T01:53:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:53:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:53:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:53:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:54:00.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:00 smithi092 ceph-mon[29156]: pgmap v15024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:54:00.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:00 smithi092 ceph-mon[29156]: pgmap v15025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:00 smithi189 ceph-mon[32756]: pgmap v15024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:54:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:00 smithi189 ceph-mon[32756]: pgmap v15025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:00.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:00 smithi156 ceph-mon[32679]: pgmap v15024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T01:54:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:00 smithi156 ceph-mon[32679]: pgmap v15025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:02.717 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:02 smithi156 ceph-mon[32679]: pgmap v15026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:02.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:02 smithi092 ceph-mon[29156]: pgmap v15026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:02.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:02 smithi189 ceph-mon[32756]: pgmap v15026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:54:04.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:04 smithi092 ceph-mon[29156]: pgmap v15027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:54:04.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27339.811855 secs 2024-04-27T01:54:04.714 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26642.781552 secs 2024-04-27T01:54:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:04 smithi189 ceph-mon[32756]: pgmap v15027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:54:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27339.811855 secs 2024-04-27T01:54:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26642.781552 secs 2024-04-27T01:54:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:04 smithi156 ceph-mon[32679]: pgmap v15027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:54:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27339.811855 secs 2024-04-27T01:54:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26642.781552 secs 2024-04-27T01:54:06.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:06 smithi092 ceph-mon[29156]: pgmap v15028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:06 smithi189 ceph-mon[32756]: pgmap v15028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:06 smithi156 ceph-mon[32679]: pgmap v15028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:08.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:08 smithi092 ceph-mon[29156]: pgmap v15029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:08.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:08 smithi189 ceph-mon[32756]: pgmap v15029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:08.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:08 smithi156 ceph-mon[32679]: pgmap v15029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:09.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 27344.811975 secs 2024-04-27T01:54:09.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:09 smithi092 ceph-mon[29156]: slow request 360.736839 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:54:09.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26647.781667 secs 2024-04-27T01:54:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 27344.811975 secs 2024-04-27T01:54:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:09 smithi189 ceph-mon[32756]: slow request 360.736839 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:54:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26647.781667 secs 2024-04-27T01:54:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 27344.811975 secs 2024-04-27T01:54:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:09 smithi156 ceph-mon[32679]: slow request 360.736839 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:54:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26647.781667 secs 2024-04-27T01:54:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:10 smithi092 ceph-mon[29156]: pgmap v15030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:54:10.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:10 smithi189 ceph-mon[32756]: pgmap v15030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:54:10.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:10 smithi156 ceph-mon[32679]: pgmap v15030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T01:54:12.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:12 smithi092 ceph-mon[29156]: pgmap v15031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:12.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:12 smithi189 ceph-mon[32756]: pgmap v15031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:12.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:12 smithi156 ceph-mon[32679]: pgmap v15031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:14 smithi189 ceph-mon[32756]: pgmap v15032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27349.812087 secs 2024-04-27T01:54:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26652.781793 secs 2024-04-27T01:54:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:14 smithi156 ceph-mon[32679]: pgmap v15032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27349.812087 secs 2024-04-27T01:54:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26652.781793 secs 2024-04-27T01:54:14.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:14 smithi092 ceph-mon[29156]: pgmap v15032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T01:54:14.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27349.812087 secs 2024-04-27T01:54:14.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26652.781793 secs 2024-04-27T01:54:16.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:16 smithi189 ceph-mon[32756]: pgmap v15033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:16.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:16 smithi156 ceph-mon[32679]: pgmap v15033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:16.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:16 smithi092 ceph-mon[29156]: pgmap v15033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T01:54:18.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:18 smithi189 ceph-mon[32756]: pgmap v15034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:18.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:18 smithi156 ceph-mon[32679]: pgmap v15034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:18.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:18 smithi092 ceph-mon[29156]: pgmap v15034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27354.812208 secs 2024-04-27T01:54:19.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26657.781895 secs 2024-04-27T01:54:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27354.812208 secs 2024-04-27T01:54:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26657.781895 secs 2024-04-27T01:54:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27354.812208 secs 2024-04-27T01:54:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26657.781895 secs 2024-04-27T01:54:20.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:20 smithi189 ceph-mon[32756]: pgmap v15035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:20.876 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:20 smithi092 ceph-mon[29156]: pgmap v15035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:20.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:20 smithi156 ceph-mon[32679]: pgmap v15035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:22.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:22 smithi189 ceph-mon[32756]: pgmap v15036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:22.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:22 smithi156 ceph-mon[32679]: pgmap v15036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:22.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:22 smithi092 ceph-mon[29156]: pgmap v15036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:24 smithi189 ceph-mon[32756]: pgmap v15037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27359.812302 secs 2024-04-27T01:54:24.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26662.782013 secs 2024-04-27T01:54:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:24 smithi156 ceph-mon[32679]: pgmap v15037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27359.812302 secs 2024-04-27T01:54:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26662.782013 secs 2024-04-27T01:54:24.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:24 smithi092 ceph-mon[29156]: pgmap v15037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27359.812302 secs 2024-04-27T01:54:24.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26662.782013 secs 2024-04-27T01:54:26.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:26 smithi189 ceph-mon[32756]: pgmap v15038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:26.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:26 smithi156 ceph-mon[32679]: pgmap v15038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:26.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:26 smithi092 ceph-mon[29156]: pgmap v15038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:28.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:28 smithi189 ceph-mon[32756]: pgmap v15039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:28.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:28 smithi156 ceph-mon[32679]: pgmap v15039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:28.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:28 smithi092 ceph-mon[29156]: pgmap v15039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27364.812419 secs 2024-04-27T01:54:29.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26667.782124 secs 2024-04-27T01:54:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27364.812419 secs 2024-04-27T01:54:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26667.782124 secs 2024-04-27T01:54:29.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27364.812419 secs 2024-04-27T01:54:29.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26667.782124 secs 2024-04-27T01:54:30.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:30 smithi189 ceph-mon[32756]: pgmap v15040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:30.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:30 smithi156 ceph-mon[32679]: pgmap v15040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:30.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:30 smithi092 ceph-mon[29156]: pgmap v15040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:32.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:32 smithi189 ceph-mon[32756]: pgmap v15041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:32.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:32 smithi156 ceph-mon[32679]: pgmap v15041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:32.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:32 smithi092 ceph-mon[29156]: pgmap v15041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:34 smithi189 ceph-mon[32756]: pgmap v15042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27369.812541 secs 2024-04-27T01:54:34.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26672.782225 secs 2024-04-27T01:54:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:34 smithi156 ceph-mon[32679]: pgmap v15042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27369.812541 secs 2024-04-27T01:54:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26672.782225 secs 2024-04-27T01:54:34.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:34 smithi092 ceph-mon[29156]: pgmap v15042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:34.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27369.812541 secs 2024-04-27T01:54:34.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26672.782225 secs 2024-04-27T01:54:36.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:36 smithi189 ceph-mon[32756]: pgmap v15043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:36.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:36 smithi156 ceph-mon[32679]: pgmap v15043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:36.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:36 smithi092 ceph-mon[29156]: pgmap v15043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:38.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:38 smithi189 ceph-mon[32756]: pgmap v15044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:38.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:38 smithi156 ceph-mon[32679]: pgmap v15044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:38.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:38 smithi092 ceph-mon[29156]: pgmap v15044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:54:39.741+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:54:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:54:39.741+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:54:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:54:39.741+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:54:39.722 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:54:39.741+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 212 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:54:39.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27374.812675 secs 2024-04-27T01:54:39.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26677.782367 secs 2024-04-27T01:54:39.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27374.812675 secs 2024-04-27T01:54:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26677.782367 secs 2024-04-27T01:54:39.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27374.812675 secs 2024-04-27T01:54:39.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26677.782367 secs 2024-04-27T01:54:40.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:40 smithi189 ceph-mon[32756]: pgmap v15045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:40.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:40 smithi156 ceph-mon[32679]: pgmap v15045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:40.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:40 smithi092 ceph-mon[29156]: pgmap v15045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:42.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:42 smithi189 ceph-mon[32756]: pgmap v15046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:42.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:42 smithi156 ceph-mon[32679]: pgmap v15046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:42.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:42 smithi092 ceph-mon[29156]: pgmap v15046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:44 smithi189 ceph-mon[32756]: pgmap v15047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27379.812796 secs 2024-04-27T01:54:44.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26682.782475 secs 2024-04-27T01:54:44.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:44 smithi156 ceph-mon[32679]: pgmap v15047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:44.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27379.812796 secs 2024-04-27T01:54:44.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26682.782475 secs 2024-04-27T01:54:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:44 smithi092 ceph-mon[29156]: pgmap v15047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27379.812796 secs 2024-04-27T01:54:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26682.782475 secs 2024-04-27T01:54:46.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:46 smithi189 ceph-mon[32756]: pgmap v15048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:46.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:46 smithi156 ceph-mon[32679]: pgmap v15048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:46.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:46 smithi092 ceph-mon[29156]: pgmap v15048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:48.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:48 smithi189 ceph-mon[32756]: pgmap v15049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:48.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:48 smithi156 ceph-mon[32679]: pgmap v15049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:48.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:48 smithi092 ceph-mon[29156]: pgmap v15049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:49.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27384.812896 secs 2024-04-27T01:54:49.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26687.782537 secs 2024-04-27T01:54:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27384.812896 secs 2024-04-27T01:54:49.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26687.782537 secs 2024-04-27T01:54:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27384.812896 secs 2024-04-27T01:54:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26687.782537 secs 2024-04-27T01:54:50.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:50 smithi189 ceph-mon[32756]: pgmap v15050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:50.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:50 smithi156 ceph-mon[32679]: pgmap v15050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:50.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:50 smithi092 ceph-mon[29156]: pgmap v15050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:52.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:52 smithi189 ceph-mon[32756]: pgmap v15051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:52.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:52 smithi156 ceph-mon[32679]: pgmap v15051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:52.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:52 smithi092 ceph-mon[29156]: pgmap v15051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:54 smithi189 ceph-mon[32756]: pgmap v15052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27389.813013 secs 2024-04-27T01:54:54.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26692.782655 secs 2024-04-27T01:54:54.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:54 smithi156 ceph-mon[32679]: pgmap v15052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27389.813013 secs 2024-04-27T01:54:54.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26692.782655 secs 2024-04-27T01:54:54.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:54 smithi092 ceph-mon[29156]: pgmap v15052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:54.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27389.813013 secs 2024-04-27T01:54:54.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26692.782655 secs 2024-04-27T01:54:56.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:56 smithi189 ceph-mon[32756]: pgmap v15053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:56.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:56 smithi156 ceph-mon[32679]: pgmap v15053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:56.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:56 smithi092 ceph-mon[29156]: pgmap v15053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:54:58.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:58 smithi189 ceph-mon[32756]: pgmap v15054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:58.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:58 smithi156 ceph-mon[32679]: pgmap v15054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:58.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:58 smithi092 ceph-mon[29156]: pgmap v15054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:54:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27394.813094 secs 2024-04-27T01:54:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26697.782776 secs 2024-04-27T01:54:59.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:54:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:54:59.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27394.813094 secs 2024-04-27T01:54:59.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26697.782776 secs 2024-04-27T01:54:59.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:54:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:54:59.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27394.813094 secs 2024-04-27T01:54:59.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26697.782776 secs 2024-04-27T01:54:59.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:54:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:55:00.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:00 smithi189 ceph-mon[32756]: pgmap v15055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:55:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:55:00.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:55:00.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:00 smithi156 ceph-mon[32679]: pgmap v15055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:55:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:55:00.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:55:00.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:00 smithi092 ceph-mon[29156]: pgmap v15055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:00.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:55:00.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:55:00.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:55:01.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:01 smithi189 ceph-mon[32756]: pgmap v15056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:55:01.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:01 smithi189 ceph-mon[32756]: pgmap v15057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:01.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:01 smithi156 ceph-mon[32679]: pgmap v15056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:55:01.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:01 smithi156 ceph-mon[32679]: pgmap v15057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:01.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:01 smithi092 ceph-mon[29156]: pgmap v15056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:55:01.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:01 smithi092 ceph-mon[29156]: pgmap v15057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:03.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:03 smithi189 ceph-mon[32756]: pgmap v15058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:03.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:03 smithi156 ceph-mon[32679]: pgmap v15058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:03.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:03 smithi092 ceph-mon[29156]: pgmap v15058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27399.813189 secs 2024-04-27T01:55:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26702.782921 secs 2024-04-27T01:55:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27399.813189 secs 2024-04-27T01:55:04.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26702.782921 secs 2024-04-27T01:55:04.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27399.813189 secs 2024-04-27T01:55:04.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26702.782921 secs 2024-04-27T01:55:05.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:05 smithi189 ceph-mon[32756]: pgmap v15059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:05.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:05 smithi156 ceph-mon[32679]: pgmap v15059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:05.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:05 smithi092 ceph-mon[29156]: pgmap v15059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:07.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:07 smithi189 ceph-mon[32756]: pgmap v15060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:07 smithi156 ceph-mon[32679]: pgmap v15060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:07 smithi092 ceph-mon[29156]: pgmap v15060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:55:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:09 smithi189 ceph-mon[32756]: pgmap v15061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:55:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27404.813300 secs 2024-04-27T01:55:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:09 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 26707.783069 secs 2024-04-27T01:55:09.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:09 smithi189 ceph-mon[32756]: slow request 720.996481 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:55:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:09 smithi156 ceph-mon[32679]: pgmap v15061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:55:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27404.813300 secs 2024-04-27T01:55:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:09 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 26707.783069 secs 2024-04-27T01:55:09.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:09 smithi156 ceph-mon[32679]: slow request 720.996481 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:55:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:09 smithi092 ceph-mon[29156]: pgmap v15061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:55:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27404.813300 secs 2024-04-27T01:55:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:09 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 26707.783069 secs 2024-04-27T01:55:09.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:09 smithi092 ceph-mon[29156]: slow request 720.996481 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:55:11.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:11 smithi189 ceph-mon[32756]: pgmap v15062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:55:11.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:11 smithi156 ceph-mon[32679]: pgmap v15062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:55:11.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:11 smithi092 ceph-mon[29156]: pgmap v15062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:55:13.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:13 smithi189 ceph-mon[32756]: pgmap v15063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:13.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:13 smithi156 ceph-mon[32679]: pgmap v15063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:13.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:13 smithi092 ceph-mon[29156]: pgmap v15063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27409.813432 secs 2024-04-27T01:55:14.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26712.783148 secs 2024-04-27T01:55:14.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27409.813432 secs 2024-04-27T01:55:14.875 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26712.783148 secs 2024-04-27T01:55:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27409.813432 secs 2024-04-27T01:55:14.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26712.783148 secs 2024-04-27T01:55:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:15 smithi189 ceph-mon[32756]: pgmap v15064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:15.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:15 smithi156 ceph-mon[32679]: pgmap v15064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:15.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:15 smithi092 ceph-mon[29156]: pgmap v15064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:17.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:17 smithi189 ceph-mon[32756]: pgmap v15065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:17.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:17 smithi156 ceph-mon[32679]: pgmap v15065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:17.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:17 smithi092 ceph-mon[29156]: pgmap v15065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:19 smithi156 ceph-mon[32679]: pgmap v15066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27414.813551 secs 2024-04-27T01:55:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26717.783238 secs 2024-04-27T01:55:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:19 smithi092 ceph-mon[29156]: pgmap v15066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27414.813551 secs 2024-04-27T01:55:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26717.783238 secs 2024-04-27T01:55:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:19 smithi189 ceph-mon[32756]: pgmap v15066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27414.813551 secs 2024-04-27T01:55:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26717.783238 secs 2024-04-27T01:55:21.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:21 smithi156 ceph-mon[32679]: pgmap v15067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:21.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:21 smithi092 ceph-mon[29156]: pgmap v15067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:22.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:21 smithi189 ceph-mon[32756]: pgmap v15067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:23.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:23 smithi156 ceph-mon[32679]: pgmap v15068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:23.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:23 smithi092 ceph-mon[29156]: pgmap v15068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:24.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:23 smithi189 ceph-mon[32756]: pgmap v15068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27419.813670 secs 2024-04-27T01:55:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26722.783369 secs 2024-04-27T01:55:24.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27419.813670 secs 2024-04-27T01:55:24.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26722.783369 secs 2024-04-27T01:55:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27419.813670 secs 2024-04-27T01:55:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26722.783369 secs 2024-04-27T01:55:25.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:25 smithi156 ceph-mon[32679]: pgmap v15069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:25 smithi092 ceph-mon[29156]: pgmap v15069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:25 smithi189 ceph-mon[32756]: pgmap v15069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:27.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:27 smithi156 ceph-mon[32679]: pgmap v15070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:27.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:27 smithi092 ceph-mon[29156]: pgmap v15070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:28.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:27 smithi189 ceph-mon[32756]: pgmap v15070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:29.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:29 smithi156 ceph-mon[32679]: pgmap v15071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27424.813794 secs 2024-04-27T01:55:29.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26727.783526 secs 2024-04-27T01:55:29.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:29 smithi092 ceph-mon[29156]: pgmap v15071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:29.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27424.813794 secs 2024-04-27T01:55:29.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26727.783526 secs 2024-04-27T01:55:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:29 smithi189 ceph-mon[32756]: pgmap v15071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27424.813794 secs 2024-04-27T01:55:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26727.783526 secs 2024-04-27T01:55:31.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:31 smithi156 ceph-mon[32679]: pgmap v15072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:31.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:31 smithi092 ceph-mon[29156]: pgmap v15072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:32.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:31 smithi189 ceph-mon[32756]: pgmap v15072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:33.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:33 smithi156 ceph-mon[32679]: pgmap v15073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:33.921 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:33 smithi189 ceph-mon[32756]: pgmap v15073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:33.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:33 smithi092 ceph-mon[29156]: pgmap v15073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:34.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27429.813935 secs 2024-04-27T01:55:34.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26732.783650 secs 2024-04-27T01:55:34.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27429.813935 secs 2024-04-27T01:55:34.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26732.783650 secs 2024-04-27T01:55:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27429.813935 secs 2024-04-27T01:55:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26732.783650 secs 2024-04-27T01:55:35.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:35 smithi156 ceph-mon[32679]: pgmap v15074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:35.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:35 smithi092 ceph-mon[29156]: pgmap v15074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:36.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:35 smithi189 ceph-mon[32756]: pgmap v15074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:37.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:37 smithi156 ceph-mon[32679]: pgmap v15075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:37.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:37 smithi092 ceph-mon[29156]: pgmap v15075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:38.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:37 smithi189 ceph-mon[32756]: pgmap v15075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:39.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:39 smithi156 ceph-mon[32679]: pgmap v15076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27434.814005 secs 2024-04-27T01:55:39.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26737.783746 secs 2024-04-27T01:55:39.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:39 smithi092 ceph-mon[29156]: pgmap v15076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:39.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27434.814005 secs 2024-04-27T01:55:39.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26737.783746 secs 2024-04-27T01:55:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:39 smithi189 ceph-mon[32756]: pgmap v15076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27434.814005 secs 2024-04-27T01:55:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26737.783746 secs 2024-04-27T01:55:41.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:41 smithi156 ceph-mon[32679]: pgmap v15077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:41.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:41 smithi092 ceph-mon[29156]: pgmap v15077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:42.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:41 smithi189 ceph-mon[32756]: pgmap v15077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:55:43.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:43 smithi156 ceph-mon[32679]: pgmap v15078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:43.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:43 smithi092 ceph-mon[29156]: pgmap v15078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:44.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:43 smithi189 ceph-mon[32756]: pgmap v15078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27439.814079 secs 2024-04-27T01:55:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26742.783818 secs 2024-04-27T01:55:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27439.814079 secs 2024-04-27T01:55:45.121 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26742.783818 secs 2024-04-27T01:55:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27439.814079 secs 2024-04-27T01:55:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26742.783818 secs 2024-04-27T01:55:45.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:45 smithi092 ceph-mon[29156]: pgmap v15079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:46.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:45 smithi189 ceph-mon[32756]: pgmap v15079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:46.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:45 smithi156 ceph-mon[32679]: pgmap v15079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:47.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:47 smithi092 ceph-mon[29156]: pgmap v15080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:48.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:47 smithi189 ceph-mon[32756]: pgmap v15080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:48.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:47 smithi156 ceph-mon[32679]: pgmap v15080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:49 smithi092 ceph-mon[29156]: pgmap v15081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27444.814201 secs 2024-04-27T01:55:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26747.783915 secs 2024-04-27T01:55:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:49 smithi189 ceph-mon[32756]: pgmap v15081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27444.814201 secs 2024-04-27T01:55:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26747.783915 secs 2024-04-27T01:55:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:49 smithi156 ceph-mon[32679]: pgmap v15081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27444.814201 secs 2024-04-27T01:55:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26747.783915 secs 2024-04-27T01:55:52.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:51 smithi189 ceph-mon[32756]: pgmap v15082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:52.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:51 smithi156 ceph-mon[32679]: pgmap v15082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:52.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:51 smithi092 ceph-mon[29156]: pgmap v15082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:54.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:53 smithi092 ceph-mon[29156]: pgmap v15083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:54.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:53 smithi189 ceph-mon[32756]: pgmap v15083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:54.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:53 smithi156 ceph-mon[32679]: pgmap v15083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:55:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27449.814327 secs 2024-04-27T01:55:55.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26752.784040 secs 2024-04-27T01:55:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27449.814327 secs 2024-04-27T01:55:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26752.784040 secs 2024-04-27T01:55:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27449.814327 secs 2024-04-27T01:55:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26752.784040 secs 2024-04-27T01:55:56.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:55 smithi189 ceph-mon[32756]: pgmap v15084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:56.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:55 smithi156 ceph-mon[32679]: pgmap v15084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:56.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:55 smithi092 ceph-mon[29156]: pgmap v15084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:55:58.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:57 smithi189 ceph-mon[32756]: pgmap v15085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:58.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:57 smithi156 ceph-mon[32679]: pgmap v15085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:55:58.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:57 smithi092 ceph-mon[29156]: pgmap v15085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:59 smithi189 ceph-mon[32756]: pgmap v15086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27454.814445 secs 2024-04-27T01:56:00.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:55:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26757.784164 secs 2024-04-27T01:56:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:59 smithi156 ceph-mon[32679]: pgmap v15086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27454.814445 secs 2024-04-27T01:56:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:55:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26757.784164 secs 2024-04-27T01:56:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:59 smithi092 ceph-mon[29156]: pgmap v15086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27454.814445 secs 2024-04-27T01:56:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:55:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26757.784164 secs 2024-04-27T01:56:01.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:56:01.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:56:01.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:56:01.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:56:01.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:56:01.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:56:01.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:56:01.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:56:01.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:56:01.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:56:01.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:56:01.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:56:02.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:01 smithi189 ceph-mon[32756]: pgmap v15087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:01 smithi189 ceph-mon[32756]: pgmap v15088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:56:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:01 smithi189 ceph-mon[32756]: pgmap v15089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:01 smithi156 ceph-mon[32679]: pgmap v15087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:01 smithi156 ceph-mon[32679]: pgmap v15088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:56:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:01 smithi156 ceph-mon[32679]: pgmap v15089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:01 smithi092 ceph-mon[29156]: pgmap v15087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:01 smithi092 ceph-mon[29156]: pgmap v15088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:56:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:01 smithi092 ceph-mon[29156]: pgmap v15089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:04.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:03 smithi189 ceph-mon[32756]: pgmap v15090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:56:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:03 smithi156 ceph-mon[32679]: pgmap v15090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:56:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:03 smithi092 ceph-mon[29156]: pgmap v15090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:56:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27459.814562 secs 2024-04-27T01:56:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 26762.784326 secs 2024-04-27T01:56:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27459.814562 secs 2024-04-27T01:56:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 26762.784326 secs 2024-04-27T01:56:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27459.814562 secs 2024-04-27T01:56:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 26762.784326 secs 2024-04-27T01:56:06.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:05 smithi189 ceph-mon[32756]: pgmap v15091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:06.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:05 smithi156 ceph-mon[32679]: pgmap v15091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:06.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:05 smithi092 ceph-mon[29156]: pgmap v15091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:07 smithi189 ceph-mon[32756]: pgmap v15092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:08.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:07 smithi156 ceph-mon[32679]: pgmap v15092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:08.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:07 smithi092 ceph-mon[29156]: pgmap v15092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:09 smithi092 ceph-mon[29156]: pgmap v15093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27464.814642 secs 2024-04-27T01:56:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:09 smithi092 ceph-mon[29156]: 20 slow requests, 1 included below; oldest blocked for > 26767.784412 secs 2024-04-27T01:56:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:09 smithi092 ceph-mon[29156]: slow request 180.817246 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:56:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:09 smithi189 ceph-mon[32756]: pgmap v15093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27464.814642 secs 2024-04-27T01:56:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:09 smithi189 ceph-mon[32756]: 20 slow requests, 1 included below; oldest blocked for > 26767.784412 secs 2024-04-27T01:56:10.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:09 smithi189 ceph-mon[32756]: slow request 180.817246 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:56:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:09 smithi156 ceph-mon[32679]: pgmap v15093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:56:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27464.814642 secs 2024-04-27T01:56:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:09 smithi156 ceph-mon[32679]: 20 slow requests, 1 included below; oldest blocked for > 26767.784412 secs 2024-04-27T01:56:10.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:09 smithi156 ceph-mon[32679]: slow request 180.817246 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T01:56:12.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:11 smithi189 ceph-mon[32756]: pgmap v15094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:56:12.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:11 smithi156 ceph-mon[32679]: pgmap v15094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:56:12.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:11 smithi092 ceph-mon[29156]: pgmap v15094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:56:14.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:13 smithi189 ceph-mon[32756]: pgmap v15095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:14.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:56:14.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:56:14.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:13 smithi156 ceph-mon[32679]: pgmap v15095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:14.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:56:14.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:56:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:13 smithi092 ceph-mon[29156]: pgmap v15095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T01:56:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T01:56:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27469.814760 secs 2024-04-27T01:56:15.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:14 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26772.784530 secs 2024-04-27T01:56:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27469.814760 secs 2024-04-27T01:56:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:14 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26772.784530 secs 2024-04-27T01:56:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27469.814760 secs 2024-04-27T01:56:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:14 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26772.784530 secs 2024-04-27T01:56:16.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:15 smithi189 ceph-mon[32756]: pgmap v15096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:16.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:15 smithi156 ceph-mon[32679]: pgmap v15096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:16.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:15 smithi092 ceph-mon[29156]: pgmap v15096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:18.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:17 smithi189 ceph-mon[32756]: pgmap v15097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:18.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:17 smithi156 ceph-mon[32679]: pgmap v15097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:18.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:17 smithi092 ceph-mon[29156]: pgmap v15097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:19 smithi189 ceph-mon[32756]: pgmap v15098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27474.814890 secs 2024-04-27T01:56:20.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:19 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26777.784648 secs 2024-04-27T01:56:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:19 smithi156 ceph-mon[32679]: pgmap v15098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27474.814890 secs 2024-04-27T01:56:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:19 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26777.784648 secs 2024-04-27T01:56:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:19 smithi092 ceph-mon[29156]: pgmap v15098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27474.814890 secs 2024-04-27T01:56:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:19 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26777.784648 secs 2024-04-27T01:56:22.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:21 smithi189 ceph-mon[32756]: pgmap v15099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:22.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:21 smithi156 ceph-mon[32679]: pgmap v15099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:22.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:21 smithi092 ceph-mon[29156]: pgmap v15099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:24.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:23 smithi189 ceph-mon[32756]: pgmap v15100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:24.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:23 smithi156 ceph-mon[32679]: pgmap v15100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:24.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:23 smithi092 ceph-mon[29156]: pgmap v15100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27479.814955 secs 2024-04-27T01:56:25.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:24 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26782.784759 secs 2024-04-27T01:56:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27479.814955 secs 2024-04-27T01:56:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:24 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26782.784759 secs 2024-04-27T01:56:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27479.814955 secs 2024-04-27T01:56:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:24 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26782.784759 secs 2024-04-27T01:56:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:25 smithi189 ceph-mon[32756]: pgmap v15101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:25 smithi156 ceph-mon[32679]: pgmap v15101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:26.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:25 smithi092 ceph-mon[29156]: pgmap v15101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:28.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:27 smithi189 ceph-mon[32756]: pgmap v15102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:28.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:27 smithi156 ceph-mon[32679]: pgmap v15102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:28.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:27 smithi092 ceph-mon[29156]: pgmap v15102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:29 smithi189 ceph-mon[32756]: pgmap v15103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27484.815043 secs 2024-04-27T01:56:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:29 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26787.784901 secs 2024-04-27T01:56:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:29 smithi156 ceph-mon[32679]: pgmap v15103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27484.815043 secs 2024-04-27T01:56:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:29 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26787.784901 secs 2024-04-27T01:56:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:29 smithi092 ceph-mon[29156]: pgmap v15103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27484.815043 secs 2024-04-27T01:56:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:29 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26787.784901 secs 2024-04-27T01:56:32.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:31 smithi189 ceph-mon[32756]: pgmap v15104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:32.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:31 smithi156 ceph-mon[32679]: pgmap v15104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:32.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:31 smithi092 ceph-mon[29156]: pgmap v15104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:34.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:33 smithi189 ceph-mon[32756]: pgmap v15105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:34.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:33 smithi156 ceph-mon[32679]: pgmap v15105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:34.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:33 smithi092 ceph-mon[29156]: pgmap v15105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27489.815158 secs 2024-04-27T01:56:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:34 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26792.785025 secs 2024-04-27T01:56:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27489.815158 secs 2024-04-27T01:56:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:34 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26792.785025 secs 2024-04-27T01:56:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27489.815158 secs 2024-04-27T01:56:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:34 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26792.785025 secs 2024-04-27T01:56:36.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:35 smithi189 ceph-mon[32756]: pgmap v15106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:36.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:35 smithi156 ceph-mon[32679]: pgmap v15106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:36.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:35 smithi092 ceph-mon[29156]: pgmap v15106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:38.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:37 smithi189 ceph-mon[32756]: pgmap v15107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:38.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:37 smithi156 ceph-mon[32679]: pgmap v15107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:38.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:37 smithi092 ceph-mon[29156]: pgmap v15107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:39 smithi189 ceph-mon[32756]: pgmap v15108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27494.815265 secs 2024-04-27T01:56:40.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:39 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26797.785158 secs 2024-04-27T01:56:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:39 smithi156 ceph-mon[32679]: pgmap v15108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27494.815265 secs 2024-04-27T01:56:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:39 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26797.785158 secs 2024-04-27T01:56:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:39 smithi092 ceph-mon[29156]: pgmap v15108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27494.815265 secs 2024-04-27T01:56:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:39 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26797.785158 secs 2024-04-27T01:56:42.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:41 smithi189 ceph-mon[32756]: pgmap v15109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:42.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:41 smithi156 ceph-mon[32679]: pgmap v15109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:42.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:41 smithi092 ceph-mon[29156]: pgmap v15109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:44.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:43 smithi189 ceph-mon[32756]: pgmap v15110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:44.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:43 smithi156 ceph-mon[32679]: pgmap v15110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:44.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:43 smithi092 ceph-mon[29156]: pgmap v15110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27499.815376 secs 2024-04-27T01:56:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:44 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26802.785271 secs 2024-04-27T01:56:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27499.815376 secs 2024-04-27T01:56:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:44 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26802.785271 secs 2024-04-27T01:56:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27499.815376 secs 2024-04-27T01:56:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:44 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26802.785271 secs 2024-04-27T01:56:46.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:45 smithi189 ceph-mon[32756]: pgmap v15111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:46.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:45 smithi156 ceph-mon[32679]: pgmap v15111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:46.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:45 smithi092 ceph-mon[29156]: pgmap v15111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:48.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:47 smithi189 ceph-mon[32756]: pgmap v15112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:48.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:47 smithi156 ceph-mon[32679]: pgmap v15112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:48.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:47 smithi092 ceph-mon[29156]: pgmap v15112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:49 smithi189 ceph-mon[32756]: pgmap v15113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27504.815515 secs 2024-04-27T01:56:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:49 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26807.785367 secs 2024-04-27T01:56:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:49 smithi156 ceph-mon[32679]: pgmap v15113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27504.815515 secs 2024-04-27T01:56:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:49 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26807.785367 secs 2024-04-27T01:56:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:49 smithi092 ceph-mon[29156]: pgmap v15113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27504.815515 secs 2024-04-27T01:56:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:49 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26807.785367 secs 2024-04-27T01:56:52.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:51 smithi156 ceph-mon[32679]: pgmap v15114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:52.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:51 smithi092 ceph-mon[29156]: pgmap v15114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:52.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:51 smithi189 ceph-mon[32756]: pgmap v15114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:53.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:52 smithi092 ceph-mon[29156]: pgmap v15115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:53.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:52 smithi189 ceph-mon[32756]: pgmap v15115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:53.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:52 smithi156 ceph-mon[32679]: pgmap v15115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:54.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:54 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26812.785430 secs 2024-04-27T01:56:54.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:54 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26812.785430 secs 2024-04-27T01:56:54.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:54 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26812.785430 secs 2024-04-27T01:56:55.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27509.815655 secs 2024-04-27T01:56:55.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:55 smithi189 ceph-mon[32756]: pgmap v15116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:55.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27509.815655 secs 2024-04-27T01:56:55.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:55 smithi156 ceph-mon[32679]: pgmap v15116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:55.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27509.815655 secs 2024-04-27T01:56:55.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:55 smithi092 ceph-mon[29156]: pgmap v15116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:56:58.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:57 smithi189 ceph-mon[32756]: pgmap v15117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:58.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:57 smithi156 ceph-mon[32679]: pgmap v15117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:56:58.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:57 smithi092 ceph-mon[29156]: pgmap v15117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:59 smithi189 ceph-mon[32756]: pgmap v15118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27514.815716 secs 2024-04-27T01:57:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:56:59 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26817.785526 secs 2024-04-27T01:57:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:59 smithi156 ceph-mon[32679]: pgmap v15118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27514.815716 secs 2024-04-27T01:57:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:56:59 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26817.785526 secs 2024-04-27T01:57:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:59 smithi092 ceph-mon[29156]: pgmap v15118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27514.815716 secs 2024-04-27T01:57:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:56:59 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26817.785526 secs 2024-04-27T01:57:02.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:01 smithi189 ceph-mon[32756]: pgmap v15119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:57:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:57:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:57:02.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:57:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:01 smithi156 ceph-mon[32679]: pgmap v15119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:57:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:57:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:57:02.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:57:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:01 smithi092 ceph-mon[29156]: pgmap v15119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:57:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:57:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:57:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:57:03.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:02 smithi189 ceph-mon[32756]: pgmap v15120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:57:03.020 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:02 smithi189 ceph-mon[32756]: pgmap v15121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:03.065 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:02 smithi156 ceph-mon[32679]: pgmap v15120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:57:03.065 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:02 smithi156 ceph-mon[32679]: pgmap v15121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:02 smithi092 ceph-mon[29156]: pgmap v15120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:57:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:02 smithi092 ceph-mon[29156]: pgmap v15121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:04 smithi189 ceph-mon[32756]: pgmap v15122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27519.815815 secs 2024-04-27T01:57:05.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:04 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26822.785650 secs 2024-04-27T01:57:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:04 smithi156 ceph-mon[32679]: pgmap v15122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27519.815815 secs 2024-04-27T01:57:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:04 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26822.785650 secs 2024-04-27T01:57:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:04 smithi092 ceph-mon[29156]: pgmap v15122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27519.815815 secs 2024-04-27T01:57:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:04 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26822.785650 secs 2024-04-27T01:57:07.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:06 smithi189 ceph-mon[32756]: pgmap v15123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:07.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:06 smithi156 ceph-mon[32679]: pgmap v15123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:07.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:06 smithi092 ceph-mon[29156]: pgmap v15123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:09.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:08 smithi189 ceph-mon[32756]: pgmap v15124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:09.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:08 smithi156 ceph-mon[32679]: pgmap v15124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:09.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:08 smithi092 ceph-mon[29156]: pgmap v15124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:57:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27524.815947 secs 2024-04-27T01:57:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:09 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26827.785784 secs 2024-04-27T01:57:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27524.815947 secs 2024-04-27T01:57:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:09 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26827.785784 secs 2024-04-27T01:57:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27524.815947 secs 2024-04-27T01:57:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:09 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26827.785784 secs 2024-04-27T01:57:11.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:10 smithi189 ceph-mon[32756]: pgmap v15125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:11.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:10 smithi156 ceph-mon[32679]: pgmap v15125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:11.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:10 smithi092 ceph-mon[29156]: pgmap v15125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:57:13.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:12 smithi189 ceph-mon[32756]: pgmap v15126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:57:13.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:12 smithi156 ceph-mon[32679]: pgmap v15126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:57:13.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:12 smithi092 ceph-mon[29156]: pgmap v15126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:57:15.026 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:14 smithi092 ceph-mon[29156]: pgmap v15127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:15.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27529.816021 secs 2024-04-27T01:57:15.027 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:14 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26832.785942 secs 2024-04-27T01:57:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:14 smithi189 ceph-mon[32756]: pgmap v15127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27529.816021 secs 2024-04-27T01:57:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:14 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26832.785942 secs 2024-04-27T01:57:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:14 smithi156 ceph-mon[32679]: pgmap v15127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27529.816021 secs 2024-04-27T01:57:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:14 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26832.785942 secs 2024-04-27T01:57:17.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:16 smithi189 ceph-mon[32756]: pgmap v15128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:17.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:16 smithi156 ceph-mon[32679]: pgmap v15128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:17.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:16 smithi092 ceph-mon[29156]: pgmap v15128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:19.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:18 smithi189 ceph-mon[32756]: pgmap v15129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:19.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:18 smithi156 ceph-mon[32679]: pgmap v15129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:19.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:18 smithi092 ceph-mon[29156]: pgmap v15129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27534.816142 secs 2024-04-27T01:57:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:19 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26837.786081 secs 2024-04-27T01:57:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27534.816142 secs 2024-04-27T01:57:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:19 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26837.786081 secs 2024-04-27T01:57:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27534.816142 secs 2024-04-27T01:57:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:19 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26837.786081 secs 2024-04-27T01:57:21.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:20 smithi189 ceph-mon[32756]: pgmap v15130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:21.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:20 smithi156 ceph-mon[32679]: pgmap v15130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:21.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:20 smithi092 ceph-mon[29156]: pgmap v15130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:23.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:22 smithi189 ceph-mon[32756]: pgmap v15131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:23.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:22 smithi156 ceph-mon[32679]: pgmap v15131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:23.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:22 smithi092 ceph-mon[29156]: pgmap v15131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:24 smithi189 ceph-mon[32756]: pgmap v15132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27539.816279 secs 2024-04-27T01:57:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:24 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26842.786186 secs 2024-04-27T01:57:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:24 smithi156 ceph-mon[32679]: pgmap v15132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27539.816279 secs 2024-04-27T01:57:25.167 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:24 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26842.786186 secs 2024-04-27T01:57:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:24 smithi092 ceph-mon[29156]: pgmap v15132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27539.816279 secs 2024-04-27T01:57:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:24 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26842.786186 secs 2024-04-27T01:57:27.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:26 smithi189 ceph-mon[32756]: pgmap v15133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:27.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:26 smithi156 ceph-mon[32679]: pgmap v15133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:27.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:26 smithi092 ceph-mon[29156]: pgmap v15133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:29.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:28 smithi189 ceph-mon[32756]: pgmap v15134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:29.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:28 smithi156 ceph-mon[32679]: pgmap v15134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:29.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:28 smithi092 ceph-mon[29156]: pgmap v15134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27544.816414 secs 2024-04-27T01:57:30.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:29 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26847.786313 secs 2024-04-27T01:57:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27544.816414 secs 2024-04-27T01:57:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:29 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26847.786313 secs 2024-04-27T01:57:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27544.816414 secs 2024-04-27T01:57:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:29 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26847.786313 secs 2024-04-27T01:57:31.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:30 smithi189 ceph-mon[32756]: pgmap v15135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:31.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:30 smithi156 ceph-mon[32679]: pgmap v15135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:31.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:30 smithi092 ceph-mon[29156]: pgmap v15135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:33.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:32 smithi189 ceph-mon[32756]: pgmap v15136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:33.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:32 smithi156 ceph-mon[32679]: pgmap v15136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:33.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:32 smithi092 ceph-mon[29156]: pgmap v15136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:34 smithi189 ceph-mon[32756]: pgmap v15137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27549.816494 secs 2024-04-27T01:57:35.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:34 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26852.786441 secs 2024-04-27T01:57:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:34 smithi156 ceph-mon[32679]: pgmap v15137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27549.816494 secs 2024-04-27T01:57:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:34 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26852.786441 secs 2024-04-27T01:57:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:34 smithi092 ceph-mon[29156]: pgmap v15137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27549.816494 secs 2024-04-27T01:57:35.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:34 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26852.786441 secs 2024-04-27T01:57:37.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:36 smithi189 ceph-mon[32756]: pgmap v15138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:37.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:36 smithi156 ceph-mon[32679]: pgmap v15138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:37.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:36 smithi092 ceph-mon[29156]: pgmap v15138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:39.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:38 smithi189 ceph-mon[32756]: pgmap v15139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:39.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:38 smithi156 ceph-mon[32679]: pgmap v15139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:39.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:38 smithi092 ceph-mon[29156]: pgmap v15139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:57:39.765+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:57:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:57:39.765+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:57:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:57:39.766+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T01:57:39.746 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T01:57:39.766+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 213 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T01:57:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27554.816557 secs 2024-04-27T01:57:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:39 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26857.786520 secs 2024-04-27T01:57:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27554.816557 secs 2024-04-27T01:57:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:39 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26857.786520 secs 2024-04-27T01:57:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27554.816557 secs 2024-04-27T01:57:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:39 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26857.786520 secs 2024-04-27T01:57:41.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:40 smithi189 ceph-mon[32756]: pgmap v15140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:41.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:40 smithi156 ceph-mon[32679]: pgmap v15140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:41.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:40 smithi092 ceph-mon[29156]: pgmap v15140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:43.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:42 smithi189 ceph-mon[32756]: pgmap v15141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:43.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:42 smithi156 ceph-mon[32679]: pgmap v15141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:43.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:42 smithi092 ceph-mon[29156]: pgmap v15141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:44 smithi189 ceph-mon[32756]: pgmap v15142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27559.816620 secs 2024-04-27T01:57:45.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:44 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26862.786599 secs 2024-04-27T01:57:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:44 smithi156 ceph-mon[32679]: pgmap v15142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27559.816620 secs 2024-04-27T01:57:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:44 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26862.786599 secs 2024-04-27T01:57:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:44 smithi092 ceph-mon[29156]: pgmap v15142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27559.816620 secs 2024-04-27T01:57:45.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:44 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26862.786599 secs 2024-04-27T01:57:47.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:46 smithi189 ceph-mon[32756]: pgmap v15143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:47.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:46 smithi156 ceph-mon[32679]: pgmap v15143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:47.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:46 smithi092 ceph-mon[29156]: pgmap v15143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:49.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:48 smithi189 ceph-mon[32756]: pgmap v15144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:49.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:48 smithi156 ceph-mon[32679]: pgmap v15144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:49.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:48 smithi092 ceph-mon[29156]: pgmap v15144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T01:57:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27564.816750 secs 2024-04-27T01:57:50.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:49 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26867.786724 secs 2024-04-27T01:57:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27564.816750 secs 2024-04-27T01:57:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:49 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26867.786724 secs 2024-04-27T01:57:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27564.816750 secs 2024-04-27T01:57:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:49 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26867.786724 secs 2024-04-27T01:57:51.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:50 smithi189 ceph-mon[32756]: pgmap v15145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:51.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:50 smithi156 ceph-mon[32679]: pgmap v15145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:51.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:50 smithi092 ceph-mon[29156]: pgmap v15145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T01:57:53.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:52 smithi189 ceph-mon[32756]: pgmap v15146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:53.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:52 smithi156 ceph-mon[32679]: pgmap v15146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:53.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:52 smithi092 ceph-mon[29156]: pgmap v15146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:54 smithi189 ceph-mon[32756]: pgmap v15147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27569.816844 secs 2024-04-27T01:57:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:54 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26872.786839 secs 2024-04-27T01:57:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:54 smithi156 ceph-mon[32679]: pgmap v15147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27569.816844 secs 2024-04-27T01:57:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:54 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26872.786839 secs 2024-04-27T01:57:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:54 smithi092 ceph-mon[29156]: pgmap v15147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27569.816844 secs 2024-04-27T01:57:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:54 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26872.786839 secs 2024-04-27T01:57:57.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:56 smithi189 ceph-mon[32756]: pgmap v15148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:57.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:56 smithi156 ceph-mon[32679]: pgmap v15148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:57.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:56 smithi092 ceph-mon[29156]: pgmap v15148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:57:58.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:58 smithi092 ceph-mon[29156]: pgmap v15149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:59.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:58 smithi189 ceph-mon[32756]: pgmap v15149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:57:59.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:58 smithi156 ceph-mon[32679]: pgmap v15149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27574.816960 secs 2024-04-27T01:58:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:57:59 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26877.786953 secs 2024-04-27T01:58:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27574.816960 secs 2024-04-27T01:58:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:57:59 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26877.786953 secs 2024-04-27T01:58:00.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27574.816960 secs 2024-04-27T01:58:00.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:57:59 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26877.786953 secs 2024-04-27T01:58:01.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:00 smithi156 ceph-mon[32679]: pgmap v15150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:01.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:00 smithi092 ceph-mon[29156]: pgmap v15150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:01.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:00 smithi189 ceph-mon[32756]: pgmap v15150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:02.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:58:02.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:58:02.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: pgmap v15151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: pgmap v15152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: pgmap v15153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:03.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: pgmap v15151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: pgmap v15152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: pgmap v15153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:03.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:58:03.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: pgmap v15151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:03.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:58:03.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:58:03.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: pgmap v15152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:58:03.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: pgmap v15153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:03.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:58:05.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27579.817046 secs 2024-04-27T01:58:05.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:05 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26882.787086 secs 2024-04-27T01:58:05.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:05 smithi189 ceph-mon[32756]: pgmap v15154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:05.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27579.817046 secs 2024-04-27T01:58:05.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:05 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26882.787086 secs 2024-04-27T01:58:05.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:05 smithi156 ceph-mon[32679]: pgmap v15154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27579.817046 secs 2024-04-27T01:58:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:05 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26882.787086 secs 2024-04-27T01:58:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:05 smithi092 ceph-mon[29156]: pgmap v15154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:07.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:07 smithi189 ceph-mon[32756]: pgmap v15155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:07.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:07 smithi156 ceph-mon[32679]: pgmap v15155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:07.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:07 smithi092 ceph-mon[29156]: pgmap v15155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:58:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:58:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:58:08.174+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:58:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:58:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:58:08.174+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:58:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:58:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:58:08.174+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:58:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:58:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:58:08.174+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:58:08.474 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 01:58:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T01:58:08.174+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T01:58:09.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:09 smithi189 ceph-mon[32756]: pgmap v15156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:58:09.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:09 smithi156 ceph-mon[32679]: pgmap v15156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:58:09.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:09 smithi092 ceph-mon[29156]: pgmap v15156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:58:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27584.817113 secs 2024-04-27T01:58:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:10 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26887.787222 secs 2024-04-27T01:58:10.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27584.817113 secs 2024-04-27T01:58:10.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:10 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26887.787222 secs 2024-04-27T01:58:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27584.817113 secs 2024-04-27T01:58:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:10 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26887.787222 secs 2024-04-27T01:58:11.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:11 smithi189 ceph-mon[32756]: pgmap v15157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 583 B/s wr, 5 op/s 2024-04-27T01:58:11.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:11 smithi156 ceph-mon[32679]: pgmap v15157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 583 B/s wr, 5 op/s 2024-04-27T01:58:11.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:11 smithi092 ceph-mon[29156]: pgmap v15157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 583 B/s wr, 5 op/s 2024-04-27T01:58:13.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:13 smithi189 ceph-mon[32756]: pgmap v15158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T01:58:13.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:13 smithi156 ceph-mon[32679]: pgmap v15158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T01:58:13.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:13 smithi092 ceph-mon[29156]: pgmap v15158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-04-27T01:58:14.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:14 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26892.787338 secs 2024-04-27T01:58:14.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:14 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26892.787338 secs 2024-04-27T01:58:14.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:14 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26892.787338 secs 2024-04-27T01:58:15.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27589.817226 secs 2024-04-27T01:58:15.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:15 smithi189 ceph-mon[32756]: pgmap v15159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:15.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27589.817226 secs 2024-04-27T01:58:15.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:15 smithi092 ceph-mon[29156]: pgmap v15159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:15.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27589.817226 secs 2024-04-27T01:58:15.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:15 smithi156 ceph-mon[32679]: pgmap v15159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:17.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:17 smithi189 ceph-mon[32756]: pgmap v15160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:17.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:17 smithi156 ceph-mon[32679]: pgmap v15160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:17.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:17 smithi092 ceph-mon[29156]: pgmap v15160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:19.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:19 smithi189 ceph-mon[32756]: pgmap v15161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:19.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:19 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26897.787479 secs 2024-04-27T01:58:19.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:19 smithi156 ceph-mon[32679]: pgmap v15161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:19.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:19 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26897.787479 secs 2024-04-27T01:58:19.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:19 smithi092 ceph-mon[29156]: pgmap v15161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T01:58:19.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:19 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26897.787479 secs 2024-04-27T01:58:20.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27594.817454 secs 2024-04-27T01:58:20.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27594.817454 secs 2024-04-27T01:58:20.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27594.817454 secs 2024-04-27T01:58:21.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:21 smithi189 ceph-mon[32756]: pgmap v15162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:21.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:21 smithi156 ceph-mon[32679]: pgmap v15162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:21.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:21 smithi092 ceph-mon[29156]: pgmap v15162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T01:58:23.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:23 smithi189 ceph-mon[32756]: pgmap v15163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:58:23.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:23 smithi156 ceph-mon[32679]: pgmap v15163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:58:23.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:23 smithi092 ceph-mon[29156]: pgmap v15163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T01:58:24.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:24 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26902.787558 secs 2024-04-27T01:58:24.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:24 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26902.787558 secs 2024-04-27T01:58:24.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:24 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26902.787558 secs 2024-04-27T01:58:25.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27599.817536 secs 2024-04-27T01:58:25.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:25 smithi189 ceph-mon[32756]: pgmap v15164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:58:25.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27599.817536 secs 2024-04-27T01:58:25.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:25 smithi156 ceph-mon[32679]: pgmap v15164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:58:25.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27599.817536 secs 2024-04-27T01:58:25.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:25 smithi092 ceph-mon[29156]: pgmap v15164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T01:58:27.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:27 smithi189 ceph-mon[32756]: pgmap v15165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:27.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:27 smithi156 ceph-mon[32679]: pgmap v15165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:27.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:27 smithi092 ceph-mon[29156]: pgmap v15165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:29.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:29 smithi189 ceph-mon[32756]: pgmap v15166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:29.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:29 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26907.787620 secs 2024-04-27T01:58:29.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:29 smithi156 ceph-mon[32679]: pgmap v15166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:29.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:29 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26907.787620 secs 2024-04-27T01:58:29.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:29 smithi092 ceph-mon[29156]: pgmap v15166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:29.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:29 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26907.787620 secs 2024-04-27T01:58:30.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27604.817621 secs 2024-04-27T01:58:30.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27604.817621 secs 2024-04-27T01:58:30.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27604.817621 secs 2024-04-27T01:58:32.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:31 smithi189 ceph-mon[32756]: pgmap v15167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:32.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:31 smithi156 ceph-mon[32679]: pgmap v15167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:32.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:31 smithi092 ceph-mon[29156]: pgmap v15167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:34.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:33 smithi189 ceph-mon[32756]: pgmap v15168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:34.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:33 smithi156 ceph-mon[32679]: pgmap v15168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:34.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:33 smithi092 ceph-mon[29156]: pgmap v15168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:35.065 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27609.817742 secs 2024-04-27T01:58:35.065 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:34 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26912.787760 secs 2024-04-27T01:58:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27609.817742 secs 2024-04-27T01:58:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:34 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26912.787760 secs 2024-04-27T01:58:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27609.817742 secs 2024-04-27T01:58:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:34 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26912.787760 secs 2024-04-27T01:58:36.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:35 smithi189 ceph-mon[32756]: pgmap v15169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:36.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:35 smithi156 ceph-mon[32679]: pgmap v15169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:36.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:35 smithi092 ceph-mon[29156]: pgmap v15169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:38.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:37 smithi189 ceph-mon[32756]: pgmap v15170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:38.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:37 smithi156 ceph-mon[32679]: pgmap v15170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:38.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:37 smithi092 ceph-mon[29156]: pgmap v15170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:39 smithi189 ceph-mon[32756]: pgmap v15171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27614.817885 secs 2024-04-27T01:58:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:39 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26917.787880 secs 2024-04-27T01:58:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:39 smithi156 ceph-mon[32679]: pgmap v15171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27614.817885 secs 2024-04-27T01:58:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:39 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26917.787880 secs 2024-04-27T01:58:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:39 smithi092 ceph-mon[29156]: pgmap v15171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27614.817885 secs 2024-04-27T01:58:40.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:39 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26917.787880 secs 2024-04-27T01:58:42.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:41 smithi189 ceph-mon[32756]: pgmap v15172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:42.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:41 smithi156 ceph-mon[32679]: pgmap v15172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:42.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:41 smithi092 ceph-mon[29156]: pgmap v15172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:44.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:43 smithi189 ceph-mon[32756]: pgmap v15173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:44.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:43 smithi156 ceph-mon[32679]: pgmap v15173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:44.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:43 smithi092 ceph-mon[29156]: pgmap v15173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27619.817950 secs 2024-04-27T01:58:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:44 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26922.787979 secs 2024-04-27T01:58:45.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27619.817950 secs 2024-04-27T01:58:45.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:44 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26922.787979 secs 2024-04-27T01:58:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27619.817950 secs 2024-04-27T01:58:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:44 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26922.787979 secs 2024-04-27T01:58:46.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:45 smithi189 ceph-mon[32756]: pgmap v15174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:46.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:45 smithi156 ceph-mon[32679]: pgmap v15174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:46.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:45 smithi092 ceph-mon[29156]: pgmap v15174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:48.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:47 smithi189 ceph-mon[32756]: pgmap v15175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:48.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:47 smithi156 ceph-mon[32679]: pgmap v15175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:48.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:47 smithi092 ceph-mon[29156]: pgmap v15175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:49 smithi189 ceph-mon[32756]: pgmap v15176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27624.818035 secs 2024-04-27T01:58:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:49 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26927.788105 secs 2024-04-27T01:58:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:49 smithi156 ceph-mon[32679]: pgmap v15176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27624.818035 secs 2024-04-27T01:58:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:49 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26927.788105 secs 2024-04-27T01:58:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:49 smithi092 ceph-mon[29156]: pgmap v15176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27624.818035 secs 2024-04-27T01:58:50.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:49 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26927.788105 secs 2024-04-27T01:58:52.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:51 smithi189 ceph-mon[32756]: pgmap v15177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:52.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:51 smithi156 ceph-mon[32679]: pgmap v15177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:52.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:51 smithi092 ceph-mon[29156]: pgmap v15177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:54.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:53 smithi189 ceph-mon[32756]: pgmap v15178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:54.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:53 smithi156 ceph-mon[32679]: pgmap v15178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:54.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:53 smithi092 ceph-mon[29156]: pgmap v15178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27629.818167 secs 2024-04-27T01:58:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:54 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26932.788223 secs 2024-04-27T01:58:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27629.818167 secs 2024-04-27T01:58:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:54 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26932.788223 secs 2024-04-27T01:58:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27629.818167 secs 2024-04-27T01:58:55.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:54 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26932.788223 secs 2024-04-27T01:58:56.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:55 smithi189 ceph-mon[32756]: pgmap v15179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:56.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:55 smithi156 ceph-mon[32679]: pgmap v15179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:56.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:55 smithi092 ceph-mon[29156]: pgmap v15179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:58:58.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:57 smithi189 ceph-mon[32756]: pgmap v15180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:58.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:57 smithi156 ceph-mon[32679]: pgmap v15180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:58:58.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:57 smithi092 ceph-mon[29156]: pgmap v15180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:59 smithi189 ceph-mon[32756]: pgmap v15181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27634.818232 secs 2024-04-27T01:59:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:58:59 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26937.788342 secs 2024-04-27T01:59:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:59 smithi156 ceph-mon[32679]: pgmap v15181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27634.818232 secs 2024-04-27T01:59:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:58:59 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26937.788342 secs 2024-04-27T01:59:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:59 smithi092 ceph-mon[29156]: pgmap v15181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27634.818232 secs 2024-04-27T01:59:00.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:58:59 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26937.788342 secs 2024-04-27T01:59:02.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:01 smithi189 ceph-mon[32756]: pgmap v15182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:02.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:01 smithi156 ceph-mon[32679]: pgmap v15182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:02.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:01 smithi092 ceph-mon[29156]: pgmap v15182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:03.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:59:03.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:59:03.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T01:59:04.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:03 smithi189 ceph-mon[32756]: pgmap v15183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:04.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:59:04.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:59:04.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:59:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:03 smithi156 ceph-mon[32679]: pgmap v15183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:59:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:59:04.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:59:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:03 smithi092 ceph-mon[29156]: pgmap v15183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T01:59:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T01:59:04.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T01:59:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:04 smithi189 ceph-mon[32756]: pgmap v15184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:59:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:04 smithi189 ceph-mon[32756]: pgmap v15185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:59:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27639.818343 secs 2024-04-27T01:59:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:04 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26942.788485 secs 2024-04-27T01:59:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:04 smithi156 ceph-mon[32679]: pgmap v15184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:59:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:04 smithi156 ceph-mon[32679]: pgmap v15185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:59:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27639.818343 secs 2024-04-27T01:59:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:04 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26942.788485 secs 2024-04-27T01:59:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:04 smithi092 ceph-mon[29156]: pgmap v15184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T01:59:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:04 smithi092 ceph-mon[29156]: pgmap v15185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T01:59:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27639.818343 secs 2024-04-27T01:59:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:04 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26942.788485 secs 2024-04-27T01:59:07.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:06 smithi189 ceph-mon[32756]: pgmap v15186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:07.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:06 smithi156 ceph-mon[32679]: pgmap v15186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:07.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:06 smithi092 ceph-mon[29156]: pgmap v15186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:09.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:08 smithi189 ceph-mon[32756]: pgmap v15187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:09.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:08 smithi156 ceph-mon[32679]: pgmap v15187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:09.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:08 smithi092 ceph-mon[29156]: pgmap v15187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27644.818476 secs 2024-04-27T01:59:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:09 smithi189 ceph-mon[32756]: 20 slow requests, 1 included below; oldest blocked for > 26947.788591 secs 2024-04-27T01:59:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:09 smithi189 ceph-mon[32756]: slow request 360.821426 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:59:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27644.818476 secs 2024-04-27T01:59:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:09 smithi156 ceph-mon[32679]: 20 slow requests, 1 included below; oldest blocked for > 26947.788591 secs 2024-04-27T01:59:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:09 smithi156 ceph-mon[32679]: slow request 360.821426 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:59:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27644.818476 secs 2024-04-27T01:59:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:09 smithi092 ceph-mon[29156]: 20 slow requests, 1 included below; oldest blocked for > 26947.788591 secs 2024-04-27T01:59:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:09 smithi092 ceph-mon[29156]: slow request 360.821426 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T01:59:11.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:10 smithi189 ceph-mon[32756]: pgmap v15188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:11.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:10 smithi156 ceph-mon[32679]: pgmap v15188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:10 smithi092 ceph-mon[29156]: pgmap v15188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:13.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:12 smithi189 ceph-mon[32756]: pgmap v15189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:13.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:12 smithi156 ceph-mon[32679]: pgmap v15189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:13.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:12 smithi092 ceph-mon[29156]: pgmap v15189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T01:59:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:14 smithi189 ceph-mon[32756]: pgmap v15190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:59:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27649.818595 secs 2024-04-27T01:59:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:14 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26952.788726 secs 2024-04-27T01:59:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:14 smithi156 ceph-mon[32679]: pgmap v15190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:59:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27649.818595 secs 2024-04-27T01:59:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:14 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26952.788726 secs 2024-04-27T01:59:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:14 smithi092 ceph-mon[29156]: pgmap v15190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T01:59:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27649.818595 secs 2024-04-27T01:59:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:14 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26952.788726 secs 2024-04-27T01:59:17.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:16 smithi189 ceph-mon[32756]: pgmap v15191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:17.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:16 smithi156 ceph-mon[32679]: pgmap v15191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:17.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:16 smithi092 ceph-mon[29156]: pgmap v15191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:19.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:18 smithi189 ceph-mon[32756]: pgmap v15192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:19.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:18 smithi156 ceph-mon[32679]: pgmap v15192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:19.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:18 smithi092 ceph-mon[29156]: pgmap v15192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27654.818739 secs 2024-04-27T01:59:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:19 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26957.788869 secs 2024-04-27T01:59:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27654.818739 secs 2024-04-27T01:59:20.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:19 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26957.788869 secs 2024-04-27T01:59:20.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27654.818739 secs 2024-04-27T01:59:20.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:19 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26957.788869 secs 2024-04-27T01:59:21.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:20 smithi156 ceph-mon[32679]: pgmap v15193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:21.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:20 smithi092 ceph-mon[29156]: pgmap v15193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:21.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:20 smithi189 ceph-mon[32756]: pgmap v15193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:23.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:22 smithi156 ceph-mon[32679]: pgmap v15194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:23.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:22 smithi092 ceph-mon[29156]: pgmap v15194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:23.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:22 smithi189 ceph-mon[32756]: pgmap v15194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:24 smithi156 ceph-mon[32679]: pgmap v15195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27659.818855 secs 2024-04-27T01:59:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:24 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26962.789007 secs 2024-04-27T01:59:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:24 smithi092 ceph-mon[29156]: pgmap v15195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27659.818855 secs 2024-04-27T01:59:25.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:24 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26962.789007 secs 2024-04-27T01:59:25.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:24 smithi189 ceph-mon[32756]: pgmap v15195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:25.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27659.818855 secs 2024-04-27T01:59:25.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:24 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26962.789007 secs 2024-04-27T01:59:27.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:26 smithi156 ceph-mon[32679]: pgmap v15196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:27.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:26 smithi092 ceph-mon[29156]: pgmap v15196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:27.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:26 smithi189 ceph-mon[32756]: pgmap v15196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:29.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:28 smithi156 ceph-mon[32679]: pgmap v15197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:29.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:28 smithi092 ceph-mon[29156]: pgmap v15197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:29.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:28 smithi189 ceph-mon[32756]: pgmap v15197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27664.818948 secs 2024-04-27T01:59:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:29 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26967.789143 secs 2024-04-27T01:59:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27664.818948 secs 2024-04-27T01:59:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:29 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26967.789143 secs 2024-04-27T01:59:30.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27664.818948 secs 2024-04-27T01:59:30.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:29 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26967.789143 secs 2024-04-27T01:59:31.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:30 smithi092 ceph-mon[29156]: pgmap v15198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:31.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:30 smithi156 ceph-mon[32679]: pgmap v15198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:31.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:30 smithi189 ceph-mon[32756]: pgmap v15198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:32.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:31 smithi156 ceph-mon[32679]: pgmap v15199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:32.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:31 smithi092 ceph-mon[29156]: pgmap v15199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:32.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:31 smithi189 ceph-mon[32756]: pgmap v15199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:34.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:34 smithi189 ceph-mon[32756]: pgmap v15200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:34.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:34 smithi156 ceph-mon[32679]: pgmap v15200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:34.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:34 smithi092 ceph-mon[29156]: pgmap v15200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:35.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27669.819044 secs 2024-04-27T01:59:35.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:35 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26972.789287 secs 2024-04-27T01:59:35.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27669.819044 secs 2024-04-27T01:59:35.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:35 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26972.789287 secs 2024-04-27T01:59:35.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27669.819044 secs 2024-04-27T01:59:35.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:35 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26972.789287 secs 2024-04-27T01:59:36.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:36 smithi189 ceph-mon[32756]: pgmap v15201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:36.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:36 smithi156 ceph-mon[32679]: pgmap v15201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:36.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:36 smithi092 ceph-mon[29156]: pgmap v15201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:38.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:38 smithi189 ceph-mon[32756]: pgmap v15202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:38.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:38 smithi156 ceph-mon[32679]: pgmap v15202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:38.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:38 smithi092 ceph-mon[29156]: pgmap v15202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:40.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27674.819162 secs 2024-04-27T01:59:40.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:40 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26977.789412 secs 2024-04-27T01:59:40.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:40 smithi189 ceph-mon[32756]: pgmap v15203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:40.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27674.819162 secs 2024-04-27T01:59:40.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:40 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26977.789412 secs 2024-04-27T01:59:40.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:40 smithi156 ceph-mon[32679]: pgmap v15203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:40.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27674.819162 secs 2024-04-27T01:59:40.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:40 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26977.789412 secs 2024-04-27T01:59:40.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:40 smithi092 ceph-mon[29156]: pgmap v15203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:42.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:42 smithi189 ceph-mon[32756]: pgmap v15204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:42.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:42 smithi156 ceph-mon[32679]: pgmap v15204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:42.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:42 smithi092 ceph-mon[29156]: pgmap v15204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:44.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:44 smithi189 ceph-mon[32756]: pgmap v15205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:44.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:44 smithi156 ceph-mon[32679]: pgmap v15205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:44.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:44 smithi092 ceph-mon[29156]: pgmap v15205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:45.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27679.819296 secs 2024-04-27T01:59:45.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:45 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26982.789509 secs 2024-04-27T01:59:45.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27679.819296 secs 2024-04-27T01:59:45.375 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:45 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26982.789509 secs 2024-04-27T01:59:45.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27679.819296 secs 2024-04-27T01:59:45.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:45 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26982.789509 secs 2024-04-27T01:59:46.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:46 smithi189 ceph-mon[32756]: pgmap v15206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:46.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:46 smithi156 ceph-mon[32679]: pgmap v15206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:46.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:46 smithi092 ceph-mon[29156]: pgmap v15206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:48.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:48 smithi189 ceph-mon[32756]: pgmap v15207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:48.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:48 smithi156 ceph-mon[32679]: pgmap v15207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:48.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:48 smithi092 ceph-mon[29156]: pgmap v15207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:50.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27684.819412 secs 2024-04-27T01:59:50.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:50 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26987.789583 secs 2024-04-27T01:59:50.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:50 smithi189 ceph-mon[32756]: pgmap v15208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:50.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27684.819412 secs 2024-04-27T01:59:50.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:50 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26987.789583 secs 2024-04-27T01:59:50.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:50 smithi156 ceph-mon[32679]: pgmap v15208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:50.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27684.819412 secs 2024-04-27T01:59:50.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:50 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26987.789583 secs 2024-04-27T01:59:50.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:50 smithi092 ceph-mon[29156]: pgmap v15208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:52.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:52 smithi189 ceph-mon[32756]: pgmap v15209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:52.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:52 smithi156 ceph-mon[32679]: pgmap v15209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:52.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:52 smithi092 ceph-mon[29156]: pgmap v15209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:54.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:54 smithi189 ceph-mon[32756]: pgmap v15210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:54.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:54 smithi156 ceph-mon[32679]: pgmap v15210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:54.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:54 smithi092 ceph-mon[29156]: pgmap v15210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27689.819555 secs 2024-04-27T01:59:55.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:55 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26992.789706 secs 2024-04-27T01:59:55.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27689.819555 secs 2024-04-27T01:59:55.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:55 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26992.789706 secs 2024-04-27T01:59:55.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27689.819555 secs 2024-04-27T01:59:55.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:55 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26992.789706 secs 2024-04-27T01:59:56.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:56 smithi156 ceph-mon[32679]: pgmap v15211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:56.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:56 smithi092 ceph-mon[29156]: pgmap v15211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:56.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:56 smithi189 ceph-mon[32756]: pgmap v15211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T01:59:58.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 01:59:58 smithi156 ceph-mon[32679]: pgmap v15212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:58.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 01:59:58 smithi092 ceph-mon[29156]: pgmap v15212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T01:59:58.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 01:59:58 smithi189 ceph-mon[32756]: pgmap v15212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:00.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27694.819672 secs 2024-04-27T02:00:00.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:00 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 26997.789803 secs 2024-04-27T02:00:00.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:00 smithi156 ceph-mon[32679]: pgmap v15213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:00.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:00:00.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27694.819672 secs 2024-04-27T02:00:00.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:00 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 26997.789803 secs 2024-04-27T02:00:00.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:00 smithi092 ceph-mon[29156]: pgmap v15213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:00.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:00:00.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27694.819672 secs 2024-04-27T02:00:00.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:00 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 26997.789803 secs 2024-04-27T02:00:00.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:00 smithi189 ceph-mon[32756]: pgmap v15213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:00.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:00:02.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:02 smithi156 ceph-mon[32679]: pgmap v15214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:02.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:02 smithi092 ceph-mon[29156]: pgmap v15214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:02.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:02 smithi189 ceph-mon[32756]: pgmap v15214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:03.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:00:03.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:00:03.603 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: pgmap v15215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27699.819740 secs 2024-04-27T02:00:04.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:04 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27002.789895 secs 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: pgmap v15215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27699.819740 secs 2024-04-27T02:00:04.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:04 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27002.789895 secs 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: pgmap v15215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27699.819740 secs 2024-04-27T02:00:04.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:04 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27002.789895 secs 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: pgmap v15216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.869 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:00:06.870 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:00:06.871 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: pgmap v15216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:00:06.915 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: pgmap v15216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:06.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:00:06.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: pgmap v15217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:07.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:07 smithi156 ceph-mon[32679]: pgmap v15218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:07.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:00:07.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: pgmap v15217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:07.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:07 smithi092 ceph-mon[29156]: pgmap v15218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:00:08.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:00:08.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: pgmap v15217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:08.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:07 smithi189 ceph-mon[32756]: pgmap v15218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:09 smithi156 ceph-mon[32679]: pgmap v15219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 27704.819880 secs 2024-04-27T02:00:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:09 smithi156 ceph-mon[32679]: slow request 720.744744 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:09 smithi156 ceph-mon[32679]: 20 slow requests, 1 included below; oldest blocked for > 27007.790011 secs 2024-04-27T02:00:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:09 smithi156 ceph-mon[32679]: slow request 5762.339772 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:09 smithi092 ceph-mon[29156]: pgmap v15219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 27704.819880 secs 2024-04-27T02:00:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:09 smithi092 ceph-mon[29156]: slow request 720.744744 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:09 smithi092 ceph-mon[29156]: 20 slow requests, 1 included below; oldest blocked for > 27007.790011 secs 2024-04-27T02:00:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:09 smithi092 ceph-mon[29156]: slow request 5762.339772 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:09 smithi189 ceph-mon[32756]: pgmap v15219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 27704.819880 secs 2024-04-27T02:00:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:09 smithi189 ceph-mon[32756]: slow request 720.744744 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:09 smithi189 ceph-mon[32756]: 20 slow requests, 1 included below; oldest blocked for > 27007.790011 secs 2024-04-27T02:00:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:09 smithi189 ceph-mon[32756]: slow request 5762.339772 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:00:11.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:11 smithi156 ceph-mon[32679]: pgmap v15220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:11.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:11 smithi092 ceph-mon[29156]: pgmap v15220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:12.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:11 smithi189 ceph-mon[32756]: pgmap v15220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:13.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:13 smithi156 ceph-mon[32679]: pgmap v15221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:13.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:13 smithi092 ceph-mon[29156]: pgmap v15221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:14.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:13 smithi189 ceph-mon[32756]: pgmap v15221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27709.819993 secs 2024-04-27T02:00:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:14 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27012.790145 secs 2024-04-27T02:00:14.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27709.819993 secs 2024-04-27T02:00:14.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:14 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27012.790145 secs 2024-04-27T02:00:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27709.819993 secs 2024-04-27T02:00:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:14 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27012.790145 secs 2024-04-27T02:00:15.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:15 smithi156 ceph-mon[32679]: pgmap v15222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:15.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:15 smithi092 ceph-mon[29156]: pgmap v15222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:16.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:15 smithi189 ceph-mon[32756]: pgmap v15222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:00:18.078 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:17 smithi092 ceph-mon[29156]: pgmap v15223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:00:18.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:17 smithi189 ceph-mon[32756]: pgmap v15223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:00:18.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:17 smithi156 ceph-mon[32679]: pgmap v15223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:00:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:19 smithi189 ceph-mon[32756]: pgmap v15224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27714.820106 secs 2024-04-27T02:00:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:19 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27017.790270 secs 2024-04-27T02:00:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:19 smithi156 ceph-mon[32679]: pgmap v15224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27714.820106 secs 2024-04-27T02:00:20.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:19 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27017.790270 secs 2024-04-27T02:00:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:19 smithi092 ceph-mon[29156]: pgmap v15224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27714.820106 secs 2024-04-27T02:00:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:19 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27017.790270 secs 2024-04-27T02:00:22.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:21 smithi189 ceph-mon[32756]: pgmap v15225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:22.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:21 smithi156 ceph-mon[32679]: pgmap v15225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:22.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:21 smithi092 ceph-mon[29156]: pgmap v15225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:24.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:23 smithi189 ceph-mon[32756]: pgmap v15226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:24.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:23 smithi156 ceph-mon[32679]: pgmap v15226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:24.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:23 smithi092 ceph-mon[29156]: pgmap v15226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27719.820216 secs 2024-04-27T02:00:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:24 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27022.790410 secs 2024-04-27T02:00:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27719.820216 secs 2024-04-27T02:00:25.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:24 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27022.790410 secs 2024-04-27T02:00:25.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27719.820216 secs 2024-04-27T02:00:25.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:24 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27022.790410 secs 2024-04-27T02:00:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:25 smithi189 ceph-mon[32756]: pgmap v15227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:25 smithi156 ceph-mon[32679]: pgmap v15227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:26.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:25 smithi092 ceph-mon[29156]: pgmap v15227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:27.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:27 smithi092 ceph-mon[29156]: pgmap v15228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:28.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:27 smithi189 ceph-mon[32756]: pgmap v15228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:28.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:27 smithi156 ceph-mon[32679]: pgmap v15228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:29 smithi189 ceph-mon[32756]: pgmap v15229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27724.820355 secs 2024-04-27T02:00:30.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:29 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27027.790478 secs 2024-04-27T02:00:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:29 smithi156 ceph-mon[32679]: pgmap v15229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27724.820355 secs 2024-04-27T02:00:30.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:29 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27027.790478 secs 2024-04-27T02:00:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:29 smithi092 ceph-mon[29156]: pgmap v15229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27724.820355 secs 2024-04-27T02:00:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:29 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27027.790478 secs 2024-04-27T02:00:32.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:31 smithi189 ceph-mon[32756]: pgmap v15230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:32.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:31 smithi156 ceph-mon[32679]: pgmap v15230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:32.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:31 smithi092 ceph-mon[29156]: pgmap v15230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:34.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:33 smithi189 ceph-mon[32756]: pgmap v15231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:34.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:33 smithi156 ceph-mon[32679]: pgmap v15231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:34.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:33 smithi092 ceph-mon[29156]: pgmap v15231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27729.820498 secs 2024-04-27T02:00:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:34 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27032.790593 secs 2024-04-27T02:00:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27729.820498 secs 2024-04-27T02:00:35.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:34 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27032.790593 secs 2024-04-27T02:00:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27729.820498 secs 2024-04-27T02:00:35.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:34 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27032.790593 secs 2024-04-27T02:00:36.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:35 smithi189 ceph-mon[32756]: pgmap v15232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:36.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:35 smithi156 ceph-mon[32679]: pgmap v15232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:36.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:35 smithi092 ceph-mon[29156]: pgmap v15232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:38.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:37 smithi189 ceph-mon[32756]: pgmap v15233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:38.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:37 smithi156 ceph-mon[32679]: pgmap v15233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:38.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:37 smithi092 ceph-mon[29156]: pgmap v15233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.789+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.789+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.789+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.790+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 214 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.790+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:00:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:00:39.790+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 215 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:00:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:39 smithi189 ceph-mon[32756]: pgmap v15234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27734.820647 secs 2024-04-27T02:00:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:39 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27037.790709 secs 2024-04-27T02:00:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:39 smithi156 ceph-mon[32679]: pgmap v15234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27734.820647 secs 2024-04-27T02:00:40.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:39 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27037.790709 secs 2024-04-27T02:00:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:39 smithi092 ceph-mon[29156]: pgmap v15234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27734.820647 secs 2024-04-27T02:00:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:39 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27037.790709 secs 2024-04-27T02:00:42.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:41 smithi189 ceph-mon[32756]: pgmap v15235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:42.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:41 smithi156 ceph-mon[32679]: pgmap v15235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:42.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:41 smithi092 ceph-mon[29156]: pgmap v15235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:44.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:43 smithi189 ceph-mon[32756]: pgmap v15236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:44.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:43 smithi156 ceph-mon[32679]: pgmap v15236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:44.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:43 smithi092 ceph-mon[29156]: pgmap v15236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27739.820783 secs 2024-04-27T02:00:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:44 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27042.790853 secs 2024-04-27T02:00:45.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27739.820783 secs 2024-04-27T02:00:45.125 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:44 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27042.790853 secs 2024-04-27T02:00:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27739.820783 secs 2024-04-27T02:00:45.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:44 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27042.790853 secs 2024-04-27T02:00:46.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:45 smithi189 ceph-mon[32756]: pgmap v15237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:46.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:45 smithi156 ceph-mon[32679]: pgmap v15237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:46.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:45 smithi092 ceph-mon[29156]: pgmap v15237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:48.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:47 smithi189 ceph-mon[32756]: pgmap v15238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:48.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:47 smithi156 ceph-mon[32679]: pgmap v15238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:48.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:47 smithi092 ceph-mon[29156]: pgmap v15238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:49 smithi092 ceph-mon[29156]: pgmap v15239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27744.820898 secs 2024-04-27T02:00:49.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:49 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27047.790994 secs 2024-04-27T02:00:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:49 smithi189 ceph-mon[32756]: pgmap v15239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27744.820898 secs 2024-04-27T02:00:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:49 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27047.790994 secs 2024-04-27T02:00:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:49 smithi156 ceph-mon[32679]: pgmap v15239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27744.820898 secs 2024-04-27T02:00:50.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:49 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27047.790994 secs 2024-04-27T02:00:52.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:51 smithi189 ceph-mon[32756]: pgmap v15240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:52.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:51 smithi156 ceph-mon[32679]: pgmap v15240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:52.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:51 smithi092 ceph-mon[29156]: pgmap v15240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:54.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:53 smithi189 ceph-mon[32756]: pgmap v15241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:54.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:53 smithi156 ceph-mon[32679]: pgmap v15241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:54.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:53 smithi092 ceph-mon[29156]: pgmap v15241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27749.821025 secs 2024-04-27T02:00:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:54 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27052.791145 secs 2024-04-27T02:00:55.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27749.821025 secs 2024-04-27T02:00:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:54 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27052.791145 secs 2024-04-27T02:00:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27749.821025 secs 2024-04-27T02:00:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:54 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27052.791145 secs 2024-04-27T02:00:56.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:55 smithi189 ceph-mon[32756]: pgmap v15242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:56.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:55 smithi156 ceph-mon[32679]: pgmap v15242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:56.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:55 smithi092 ceph-mon[29156]: pgmap v15242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:00:58.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:57 smithi189 ceph-mon[32756]: pgmap v15243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:58.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:57 smithi156 ceph-mon[32679]: pgmap v15243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:00:58.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:57 smithi092 ceph-mon[29156]: pgmap v15243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:59 smithi156 ceph-mon[32679]: pgmap v15244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27754.821152 secs 2024-04-27T02:01:00.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:00:59 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27057.791273 secs 2024-04-27T02:01:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:59 smithi092 ceph-mon[29156]: pgmap v15244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27754.821152 secs 2024-04-27T02:01:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:00:59 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27057.791273 secs 2024-04-27T02:01:00.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:59 smithi189 ceph-mon[32756]: pgmap v15244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:00.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27754.821152 secs 2024-04-27T02:01:00.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:00:59 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27057.791273 secs 2024-04-27T02:01:02.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:01 smithi156 ceph-mon[32679]: pgmap v15245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:02.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:01 smithi092 ceph-mon[29156]: pgmap v15245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:02.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:01 smithi189 ceph-mon[32756]: pgmap v15245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:04.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:03 smithi156 ceph-mon[32679]: pgmap v15246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:04.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:03 smithi092 ceph-mon[29156]: pgmap v15246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:04.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:03 smithi189 ceph-mon[32756]: pgmap v15246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:05.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27759.821222 secs 2024-04-27T02:01:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:04 smithi156 ceph-mon[32679]: 20 slow requests, 0 included below; oldest blocked for > 27062.791374 secs 2024-04-27T02:01:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27759.821222 secs 2024-04-27T02:01:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:04 smithi092 ceph-mon[29156]: 20 slow requests, 0 included below; oldest blocked for > 27062.791374 secs 2024-04-27T02:01:05.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27759.821222 secs 2024-04-27T02:01:05.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:04 smithi189 ceph-mon[32756]: 20 slow requests, 0 included below; oldest blocked for > 27062.791374 secs 2024-04-27T02:01:06.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:05 smithi156 ceph-mon[32679]: pgmap v15247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:06.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:05 smithi092 ceph-mon[29156]: pgmap v15247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:06.269 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:05 smithi189 ceph-mon[32756]: pgmap v15247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:07.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:01:07.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:01:07.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:01:08.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:07 smithi156 ceph-mon[32679]: pgmap v15248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:08.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:01:08.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:01:08.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:01:08.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:07 smithi092 ceph-mon[29156]: pgmap v15248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:08.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:01:08.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:01:08.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:01:08.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:07 smithi189 ceph-mon[32756]: pgmap v15248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:08.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:01:08.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:01:08.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:01:09.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:08 smithi156 ceph-mon[32679]: pgmap v15249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:01:09.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:08 smithi156 ceph-mon[32679]: pgmap v15250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:09.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:08 smithi092 ceph-mon[29156]: pgmap v15249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:01:09.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:08 smithi092 ceph-mon[29156]: pgmap v15250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:09.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:08 smithi189 ceph-mon[32756]: pgmap v15249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:01:09.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:08 smithi189 ceph-mon[32756]: pgmap v15250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27764.821335 secs 2024-04-27T02:01:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27067.791515 secs 2024-04-27T02:01:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:09 smithi156 ceph-mon[32679]: slow request 180.756599 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:01:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27764.821335 secs 2024-04-27T02:01:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27067.791515 secs 2024-04-27T02:01:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:09 smithi092 ceph-mon[29156]: slow request 180.756599 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:01:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27764.821335 secs 2024-04-27T02:01:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27067.791515 secs 2024-04-27T02:01:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:09 smithi189 ceph-mon[32756]: slow request 180.756599 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:01:11.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:10 smithi156 ceph-mon[32679]: pgmap v15251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:10 smithi092 ceph-mon[29156]: pgmap v15251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:11.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:10 smithi189 ceph-mon[32756]: pgmap v15251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:13.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:12 smithi156 ceph-mon[32679]: pgmap v15252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:13.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:12 smithi092 ceph-mon[29156]: pgmap v15252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:13.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:12 smithi189 ceph-mon[32756]: pgmap v15252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:14.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:13 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:01:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:13 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:01:14.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:13 smithi092 ceph-mon[29156]: pgmap v15253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:14.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:13 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:01:14.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:13 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:01:14.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:13 smithi189 ceph-mon[32756]: pgmap v15253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:14.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:13 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:01:14.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:13 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:01:14.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:13 smithi156 ceph-mon[32679]: pgmap v15253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:01:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27769.821456 secs 2024-04-27T02:01:15.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27072.791579 secs 2024-04-27T02:01:15.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27769.821456 secs 2024-04-27T02:01:15.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27072.791579 secs 2024-04-27T02:01:15.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27769.821456 secs 2024-04-27T02:01:15.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27072.791579 secs 2024-04-27T02:01:16.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:15 smithi092 ceph-mon[29156]: pgmap v15254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:16.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:15 smithi189 ceph-mon[32756]: pgmap v15254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:16.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:15 smithi156 ceph-mon[32679]: pgmap v15254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:01:18.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:18 smithi092 ceph-mon[29156]: pgmap v15255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:01:18.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:18 smithi189 ceph-mon[32756]: pgmap v15255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:01:18.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:18 smithi156 ceph-mon[32679]: pgmap v15255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:01:19.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27774.821572 secs 2024-04-27T02:01:19.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27077.791661 secs 2024-04-27T02:01:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27774.821572 secs 2024-04-27T02:01:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27077.791661 secs 2024-04-27T02:01:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27774.821572 secs 2024-04-27T02:01:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27077.791661 secs 2024-04-27T02:01:20.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:20 smithi092 ceph-mon[29156]: pgmap v15256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:20.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:20 smithi189 ceph-mon[32756]: pgmap v15256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:20.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:20 smithi156 ceph-mon[32679]: pgmap v15256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:22.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:22 smithi092 ceph-mon[29156]: pgmap v15257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:22.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:22 smithi189 ceph-mon[32756]: pgmap v15257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:22.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:22 smithi156 ceph-mon[32679]: pgmap v15257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:24.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:24 smithi092 ceph-mon[29156]: pgmap v15258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:24.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27779.821687 secs 2024-04-27T02:01:24.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27082.791795 secs 2024-04-27T02:01:24.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:24 smithi189 ceph-mon[32756]: pgmap v15258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:24.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27779.821687 secs 2024-04-27T02:01:24.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27082.791795 secs 2024-04-27T02:01:24.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:24 smithi156 ceph-mon[32679]: pgmap v15258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27779.821687 secs 2024-04-27T02:01:24.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27082.791795 secs 2024-04-27T02:01:26.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:26 smithi092 ceph-mon[29156]: pgmap v15259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:26.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:26 smithi189 ceph-mon[32756]: pgmap v15259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:26.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:26 smithi156 ceph-mon[32679]: pgmap v15259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:28.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:28 smithi092 ceph-mon[29156]: pgmap v15260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:28.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:28 smithi189 ceph-mon[32756]: pgmap v15260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:28.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:28 smithi156 ceph-mon[32679]: pgmap v15260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:29.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27784.821782 secs 2024-04-27T02:01:29.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27087.791909 secs 2024-04-27T02:01:29.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27784.821782 secs 2024-04-27T02:01:29.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27087.791909 secs 2024-04-27T02:01:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27784.821782 secs 2024-04-27T02:01:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27087.791909 secs 2024-04-27T02:01:30.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:30 smithi189 ceph-mon[32756]: pgmap v15261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:30.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:30 smithi156 ceph-mon[32679]: pgmap v15261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:30.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:30 smithi092 ceph-mon[29156]: pgmap v15261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:32.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:32 smithi189 ceph-mon[32756]: pgmap v15262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:32.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:32 smithi156 ceph-mon[32679]: pgmap v15262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:32.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:32 smithi092 ceph-mon[29156]: pgmap v15262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:34.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:34 smithi189 ceph-mon[32756]: pgmap v15263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:34.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27789.821919 secs 2024-04-27T02:01:34.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27092.792015 secs 2024-04-27T02:01:34.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:34 smithi156 ceph-mon[32679]: pgmap v15263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:34.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27789.821919 secs 2024-04-27T02:01:34.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27092.792015 secs 2024-04-27T02:01:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:34 smithi092 ceph-mon[29156]: pgmap v15263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27789.821919 secs 2024-04-27T02:01:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27092.792015 secs 2024-04-27T02:01:36.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:36 smithi189 ceph-mon[32756]: pgmap v15264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:36.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:36 smithi156 ceph-mon[32679]: pgmap v15264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:36.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:36 smithi092 ceph-mon[29156]: pgmap v15264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:38.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:38 smithi189 ceph-mon[32756]: pgmap v15265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:38.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:38 smithi156 ceph-mon[32679]: pgmap v15265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:38.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:38 smithi092 ceph-mon[29156]: pgmap v15265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:39.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27794.822051 secs 2024-04-27T02:01:39.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27097.792138 secs 2024-04-27T02:01:39.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27794.822051 secs 2024-04-27T02:01:39.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27097.792138 secs 2024-04-27T02:01:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27794.822051 secs 2024-04-27T02:01:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27097.792138 secs 2024-04-27T02:01:40.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:40 smithi189 ceph-mon[32756]: pgmap v15266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:40.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:40 smithi156 ceph-mon[32679]: pgmap v15266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:40.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:40 smithi092 ceph-mon[29156]: pgmap v15266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:42.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:42 smithi189 ceph-mon[32756]: pgmap v15267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:42.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:42 smithi156 ceph-mon[32679]: pgmap v15267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:42.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:42 smithi092 ceph-mon[29156]: pgmap v15267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:44.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:44 smithi189 ceph-mon[32756]: pgmap v15268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:44.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27799.822166 secs 2024-04-27T02:01:44.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27102.792246 secs 2024-04-27T02:01:44.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:44 smithi156 ceph-mon[32679]: pgmap v15268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:44.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27799.822166 secs 2024-04-27T02:01:44.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27102.792246 secs 2024-04-27T02:01:44.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:44 smithi092 ceph-mon[29156]: pgmap v15268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27799.822166 secs 2024-04-27T02:01:44.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27102.792246 secs 2024-04-27T02:01:46.775 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:46 smithi092 ceph-mon[29156]: pgmap v15269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:46.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:46 smithi189 ceph-mon[32756]: pgmap v15269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:46.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:46 smithi156 ceph-mon[32679]: pgmap v15269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:48.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:48 smithi189 ceph-mon[32756]: pgmap v15270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:48.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:48 smithi156 ceph-mon[32679]: pgmap v15270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:48.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:48 smithi092 ceph-mon[29156]: pgmap v15270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:49.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27804.822302 secs 2024-04-27T02:01:49.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27107.792391 secs 2024-04-27T02:01:49.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27804.822302 secs 2024-04-27T02:01:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27107.792391 secs 2024-04-27T02:01:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27804.822302 secs 2024-04-27T02:01:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27107.792391 secs 2024-04-27T02:01:50.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:50 smithi189 ceph-mon[32756]: pgmap v15271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:50.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:50 smithi156 ceph-mon[32679]: pgmap v15271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:50.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:50 smithi092 ceph-mon[29156]: pgmap v15271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:52.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:52 smithi189 ceph-mon[32756]: pgmap v15272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:52.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:52 smithi156 ceph-mon[32679]: pgmap v15272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:52.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:52 smithi092 ceph-mon[29156]: pgmap v15272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:54.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:54 smithi189 ceph-mon[32756]: pgmap v15273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:54.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27809.822447 secs 2024-04-27T02:01:54.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27112.792467 secs 2024-04-27T02:01:54.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:54 smithi156 ceph-mon[32679]: pgmap v15273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:54.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27809.822447 secs 2024-04-27T02:01:54.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27112.792467 secs 2024-04-27T02:01:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:54 smithi092 ceph-mon[29156]: pgmap v15273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27809.822447 secs 2024-04-27T02:01:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27112.792467 secs 2024-04-27T02:01:56.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:56 smithi189 ceph-mon[32756]: pgmap v15274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:56.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:56 smithi156 ceph-mon[32679]: pgmap v15274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:56.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:56 smithi092 ceph-mon[29156]: pgmap v15274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:01:58.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:58 smithi189 ceph-mon[32756]: pgmap v15275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:58.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:58 smithi156 ceph-mon[32679]: pgmap v15275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:58.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:58 smithi092 ceph-mon[29156]: pgmap v15275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:01:59.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27814.822590 secs 2024-04-27T02:01:59.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:01:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27117.792542 secs 2024-04-27T02:01:59.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27814.822590 secs 2024-04-27T02:01:59.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:01:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27117.792542 secs 2024-04-27T02:01:59.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27814.822590 secs 2024-04-27T02:01:59.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:01:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27117.792542 secs 2024-04-27T02:02:00.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:00 smithi189 ceph-mon[32756]: pgmap v15276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:00.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:00 smithi156 ceph-mon[32679]: pgmap v15276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:00.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:00 smithi092 ceph-mon[29156]: pgmap v15276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:02.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:02 smithi189 ceph-mon[32756]: pgmap v15277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:02.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:02 smithi156 ceph-mon[32679]: pgmap v15277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:02.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:02 smithi092 ceph-mon[29156]: pgmap v15277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:04 smithi189 ceph-mon[32756]: pgmap v15278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27819.822727 secs 2024-04-27T02:02:04.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27122.792600 secs 2024-04-27T02:02:04.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:04 smithi156 ceph-mon[32679]: pgmap v15278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:04.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27819.822727 secs 2024-04-27T02:02:04.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27122.792600 secs 2024-04-27T02:02:04.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:04 smithi092 ceph-mon[29156]: pgmap v15278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:04.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27819.822727 secs 2024-04-27T02:02:04.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27122.792600 secs 2024-04-27T02:02:06.776 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:06 smithi092 ceph-mon[29156]: pgmap v15279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:06.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:06 smithi189 ceph-mon[32756]: pgmap v15279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:06.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:06 smithi156 ceph-mon[32679]: pgmap v15279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:07.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:02:07.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:02:07.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:02:08.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:08 smithi189 ceph-mon[32756]: pgmap v15280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:08.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:02:08.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:02:08.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:02:08.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:08 smithi156 ceph-mon[32679]: pgmap v15280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:08.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:02:08.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:02:08.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:02:08.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:08 smithi092 ceph-mon[29156]: pgmap v15280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:08.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:02:08.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:02:08.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:02:09.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:09 smithi189 ceph-mon[32756]: pgmap v15281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:02:09.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:09 smithi189 ceph-mon[32756]: pgmap v15282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:02:09.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27824.822799 secs 2024-04-27T02:02:09.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27127.792670 secs 2024-04-27T02:02:09.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:09 smithi156 ceph-mon[32679]: pgmap v15281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:02:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:09 smithi156 ceph-mon[32679]: pgmap v15282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:02:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27824.822799 secs 2024-04-27T02:02:09.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27127.792670 secs 2024-04-27T02:02:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:09 smithi092 ceph-mon[29156]: pgmap v15281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:02:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:09 smithi092 ceph-mon[29156]: pgmap v15282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:02:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27824.822799 secs 2024-04-27T02:02:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27127.792670 secs 2024-04-27T02:02:11.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:11 smithi189 ceph-mon[32756]: pgmap v15283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:11.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:11 smithi156 ceph-mon[32679]: pgmap v15283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:11.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:11 smithi092 ceph-mon[29156]: pgmap v15283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:13.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:13 smithi189 ceph-mon[32756]: pgmap v15284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:13.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:13 smithi156 ceph-mon[32679]: pgmap v15284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:13.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:13 smithi092 ceph-mon[29156]: pgmap v15284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:14.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27829.822883 secs 2024-04-27T02:02:14.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27132.792792 secs 2024-04-27T02:02:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27829.822883 secs 2024-04-27T02:02:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27132.792792 secs 2024-04-27T02:02:14.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27829.822883 secs 2024-04-27T02:02:14.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27132.792792 secs 2024-04-27T02:02:15.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:15 smithi189 ceph-mon[32756]: pgmap v15285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:15.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:15 smithi156 ceph-mon[32679]: pgmap v15285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:15.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:15 smithi092 ceph-mon[29156]: pgmap v15285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:17.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:17 smithi189 ceph-mon[32756]: pgmap v15286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:17.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:17 smithi156 ceph-mon[32679]: pgmap v15286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:17.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:17 smithi092 ceph-mon[29156]: pgmap v15286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:02:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:19 smithi189 ceph-mon[32756]: pgmap v15287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:02:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27834.822960 secs 2024-04-27T02:02:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27137.792908 secs 2024-04-27T02:02:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:19 smithi156 ceph-mon[32679]: pgmap v15287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:02:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27834.822960 secs 2024-04-27T02:02:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27137.792908 secs 2024-04-27T02:02:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:19 smithi092 ceph-mon[29156]: pgmap v15287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:02:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27834.822960 secs 2024-04-27T02:02:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27137.792908 secs 2024-04-27T02:02:21.864 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:21 smithi092 ceph-mon[29156]: pgmap v15288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:21.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:21 smithi189 ceph-mon[32756]: pgmap v15288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:21.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:21 smithi156 ceph-mon[32679]: pgmap v15288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:23.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:23 smithi189 ceph-mon[32756]: pgmap v15289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:23.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:23 smithi156 ceph-mon[32679]: pgmap v15289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:23.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:23 smithi092 ceph-mon[29156]: pgmap v15289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:24.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27839.823079 secs 2024-04-27T02:02:24.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27142.792996 secs 2024-04-27T02:02:24.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27839.823079 secs 2024-04-27T02:02:24.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27142.792996 secs 2024-04-27T02:02:24.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27839.823079 secs 2024-04-27T02:02:24.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27142.792996 secs 2024-04-27T02:02:25.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:25 smithi189 ceph-mon[32756]: pgmap v15290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:25.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:25 smithi156 ceph-mon[32679]: pgmap v15290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:25 smithi092 ceph-mon[29156]: pgmap v15290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:27.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:27 smithi189 ceph-mon[32756]: pgmap v15291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:27.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:27 smithi156 ceph-mon[32679]: pgmap v15291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:27.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:27 smithi092 ceph-mon[29156]: pgmap v15291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:29.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:29 smithi189 ceph-mon[32756]: pgmap v15292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:29.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27844.823196 secs 2024-04-27T02:02:29.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27147.793089 secs 2024-04-27T02:02:29.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:29 smithi156 ceph-mon[32679]: pgmap v15292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:29.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27844.823196 secs 2024-04-27T02:02:29.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27147.793089 secs 2024-04-27T02:02:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:29 smithi092 ceph-mon[29156]: pgmap v15292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27844.823196 secs 2024-04-27T02:02:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27147.793089 secs 2024-04-27T02:02:31.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:31 smithi189 ceph-mon[32756]: pgmap v15293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:31.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:31 smithi156 ceph-mon[32679]: pgmap v15293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:31.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:31 smithi092 ceph-mon[29156]: pgmap v15293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:33.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:33 smithi189 ceph-mon[32756]: pgmap v15294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:33.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:33 smithi156 ceph-mon[32679]: pgmap v15294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:33.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:33 smithi092 ceph-mon[29156]: pgmap v15294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:34.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27849.823312 secs 2024-04-27T02:02:34.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27152.793227 secs 2024-04-27T02:02:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27849.823312 secs 2024-04-27T02:02:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27152.793227 secs 2024-04-27T02:02:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27849.823312 secs 2024-04-27T02:02:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27152.793227 secs 2024-04-27T02:02:35.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:35 smithi156 ceph-mon[32679]: pgmap v15295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:35.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:35 smithi092 ceph-mon[29156]: pgmap v15295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:36.019 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:35 smithi189 ceph-mon[32756]: pgmap v15295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:37.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:37 smithi156 ceph-mon[32679]: pgmap v15296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:37.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:37 smithi092 ceph-mon[29156]: pgmap v15296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:38.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:37 smithi189 ceph-mon[32756]: pgmap v15296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:39.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:39 smithi156 ceph-mon[32679]: pgmap v15297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:39.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27854.823445 secs 2024-04-27T02:02:39.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27157.793322 secs 2024-04-27T02:02:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:39 smithi092 ceph-mon[29156]: pgmap v15297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27854.823445 secs 2024-04-27T02:02:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27157.793322 secs 2024-04-27T02:02:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:39 smithi189 ceph-mon[32756]: pgmap v15297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27854.823445 secs 2024-04-27T02:02:40.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27157.793322 secs 2024-04-27T02:02:41.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:41 smithi156 ceph-mon[32679]: pgmap v15298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:41.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:41 smithi092 ceph-mon[29156]: pgmap v15298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:42.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:41 smithi189 ceph-mon[32756]: pgmap v15298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:43.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:43 smithi156 ceph-mon[32679]: pgmap v15299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:43.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:43 smithi092 ceph-mon[29156]: pgmap v15299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:44.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:43 smithi189 ceph-mon[32756]: pgmap v15299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:44.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27859.823574 secs 2024-04-27T02:02:44.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27162.793457 secs 2024-04-27T02:02:44.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27859.823574 secs 2024-04-27T02:02:44.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27162.793457 secs 2024-04-27T02:02:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27859.823574 secs 2024-04-27T02:02:45.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27162.793457 secs 2024-04-27T02:02:45.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:45 smithi156 ceph-mon[32679]: pgmap v15300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:45.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:45 smithi092 ceph-mon[29156]: pgmap v15300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:46.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:45 smithi189 ceph-mon[32756]: pgmap v15300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:47.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:47 smithi156 ceph-mon[32679]: pgmap v15301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:47.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:47 smithi092 ceph-mon[29156]: pgmap v15301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:48.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:47 smithi189 ceph-mon[32756]: pgmap v15301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:49.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:49 smithi156 ceph-mon[32679]: pgmap v15302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27864.823718 secs 2024-04-27T02:02:49.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27167.793599 secs 2024-04-27T02:02:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:49 smithi092 ceph-mon[29156]: pgmap v15302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27864.823718 secs 2024-04-27T02:02:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27167.793599 secs 2024-04-27T02:02:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:49 smithi189 ceph-mon[32756]: pgmap v15302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27864.823718 secs 2024-04-27T02:02:50.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27167.793599 secs 2024-04-27T02:02:51.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:51 smithi156 ceph-mon[32679]: pgmap v15303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:51.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:51 smithi092 ceph-mon[29156]: pgmap v15303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:52.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:51 smithi189 ceph-mon[32756]: pgmap v15303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:53.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:53 smithi156 ceph-mon[32679]: pgmap v15304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:53.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:53 smithi092 ceph-mon[29156]: pgmap v15304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:54.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:53 smithi189 ceph-mon[32756]: pgmap v15304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:54.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27869.823839 secs 2024-04-27T02:02:54.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27172.793714 secs 2024-04-27T02:02:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27869.823839 secs 2024-04-27T02:02:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27172.793714 secs 2024-04-27T02:02:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27869.823839 secs 2024-04-27T02:02:55.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27172.793714 secs 2024-04-27T02:02:55.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:55 smithi156 ceph-mon[32679]: pgmap v15305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:55.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:55 smithi092 ceph-mon[29156]: pgmap v15305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:56.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:55 smithi189 ceph-mon[32756]: pgmap v15305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:02:57.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:57 smithi156 ceph-mon[32679]: pgmap v15306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:57.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:57 smithi092 ceph-mon[29156]: pgmap v15306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:58.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:57 smithi189 ceph-mon[32756]: pgmap v15306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:59.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:59 smithi092 ceph-mon[29156]: pgmap v15307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:02:59.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27874.823982 secs 2024-04-27T02:02:59.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:02:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27177.793829 secs 2024-04-27T02:03:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:59 smithi189 ceph-mon[32756]: pgmap v15307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27874.823982 secs 2024-04-27T02:03:00.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:02:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27177.793829 secs 2024-04-27T02:03:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:59 smithi156 ceph-mon[32679]: pgmap v15307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27874.823982 secs 2024-04-27T02:03:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:02:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27177.793829 secs 2024-04-27T02:03:01.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:01 smithi092 ceph-mon[29156]: pgmap v15308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:02.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:01 smithi189 ceph-mon[32756]: pgmap v15308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:02.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:01 smithi156 ceph-mon[32679]: pgmap v15308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:03.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:03 smithi092 ceph-mon[29156]: pgmap v15309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:04.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:03 smithi189 ceph-mon[32756]: pgmap v15309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:04.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:03 smithi156 ceph-mon[32679]: pgmap v15309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:04.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27879.824096 secs 2024-04-27T02:03:04.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27182.793986 secs 2024-04-27T02:03:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27879.824096 secs 2024-04-27T02:03:05.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27182.793986 secs 2024-04-27T02:03:05.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27879.824096 secs 2024-04-27T02:03:05.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27182.793986 secs 2024-04-27T02:03:05.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:05 smithi092 ceph-mon[29156]: pgmap v15310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:06.018 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:05 smithi189 ceph-mon[32756]: pgmap v15310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:06.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:05 smithi156 ceph-mon[32679]: pgmap v15310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:07.966 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:07 smithi156 ceph-mon[32679]: pgmap v15311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:07.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:07 smithi092 ceph-mon[29156]: pgmap v15311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:08.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:07 smithi189 ceph-mon[32756]: pgmap v15311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:08.685 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:03:08.282+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:03:08.685 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:03:08.282+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:03:08.686 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:03:08.282+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:03:08.686 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:03:08.282+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:03:08.686 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:03:08.282+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:03:08.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:03:09.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:03:09.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:03:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: pgmap v15312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27884.824163 secs 2024-04-27T02:03:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27187.794062 secs 2024-04-27T02:03:09.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:03:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:03:09.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:03:10.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: pgmap v15312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27884.824163 secs 2024-04-27T02:03:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27187.794062 secs 2024-04-27T02:03:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:03:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:03:10.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:03:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: pgmap v15312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27884.824163 secs 2024-04-27T02:03:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27187.794062 secs 2024-04-27T02:03:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:03:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:03:10.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:03:10.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:10 smithi092 ceph-mon[29156]: pgmap v15313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 380 B/s wr, 18 op/s 2024-04-27T02:03:10.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:10 smithi092 ceph-mon[29156]: pgmap v15314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:11.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:10 smithi189 ceph-mon[32756]: pgmap v15313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 380 B/s wr, 18 op/s 2024-04-27T02:03:11.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:10 smithi189 ceph-mon[32756]: pgmap v15314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:11.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:10 smithi156 ceph-mon[32679]: pgmap v15313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 380 B/s wr, 18 op/s 2024-04-27T02:03:11.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:10 smithi156 ceph-mon[32679]: pgmap v15314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:13.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:12 smithi189 ceph-mon[32756]: pgmap v15315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:13.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:12 smithi156 ceph-mon[32679]: pgmap v15315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:13.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:12 smithi092 ceph-mon[29156]: pgmap v15315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:15.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:14 smithi189 ceph-mon[32756]: pgmap v15316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 467 B/s wr, 18 op/s 2024-04-27T02:03:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27889.824278 secs 2024-04-27T02:03:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27192.794184 secs 2024-04-27T02:03:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:14 smithi156 ceph-mon[32679]: pgmap v15316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 467 B/s wr, 18 op/s 2024-04-27T02:03:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27889.824278 secs 2024-04-27T02:03:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27192.794184 secs 2024-04-27T02:03:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:14 smithi092 ceph-mon[29156]: pgmap v15316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 467 B/s wr, 18 op/s 2024-04-27T02:03:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27889.824278 secs 2024-04-27T02:03:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27192.794184 secs 2024-04-27T02:03:17.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:16 smithi189 ceph-mon[32756]: pgmap v15317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:17.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:16 smithi156 ceph-mon[32679]: pgmap v15317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:17.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:16 smithi092 ceph-mon[29156]: pgmap v15317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:19.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:18 smithi189 ceph-mon[32756]: pgmap v15318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:19.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:18 smithi156 ceph-mon[32679]: pgmap v15318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:19.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:18 smithi092 ceph-mon[29156]: pgmap v15318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 467 B/s wr, 20 op/s 2024-04-27T02:03:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27894.824399 secs 2024-04-27T02:03:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27197.794299 secs 2024-04-27T02:03:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27894.824399 secs 2024-04-27T02:03:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27197.794299 secs 2024-04-27T02:03:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27894.824399 secs 2024-04-27T02:03:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27197.794299 secs 2024-04-27T02:03:21.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:20 smithi189 ceph-mon[32756]: pgmap v15319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:03:21.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:20 smithi156 ceph-mon[32679]: pgmap v15319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:03:21.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:20 smithi092 ceph-mon[29156]: pgmap v15319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:03:23.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:22 smithi189 ceph-mon[32756]: pgmap v15320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:23.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:22 smithi156 ceph-mon[32679]: pgmap v15320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:23.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:22 smithi092 ceph-mon[29156]: pgmap v15320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:24 smithi189 ceph-mon[32756]: pgmap v15321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27899.824503 secs 2024-04-27T02:03:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27202.794436 secs 2024-04-27T02:03:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:24 smithi156 ceph-mon[32679]: pgmap v15321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27899.824503 secs 2024-04-27T02:03:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27202.794436 secs 2024-04-27T02:03:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:24 smithi092 ceph-mon[29156]: pgmap v15321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:03:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27899.824503 secs 2024-04-27T02:03:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27202.794436 secs 2024-04-27T02:03:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:26 smithi189 ceph-mon[32756]: pgmap v15322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T02:03:27.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:26 smithi156 ceph-mon[32679]: pgmap v15322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T02:03:27.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:26 smithi092 ceph-mon[29156]: pgmap v15322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-04-27T02:03:29.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:28 smithi189 ceph-mon[32756]: pgmap v15323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:29.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:28 smithi156 ceph-mon[32679]: pgmap v15323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:29.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:28 smithi092 ceph-mon[29156]: pgmap v15323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27904.824639 secs 2024-04-27T02:03:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27207.794567 secs 2024-04-27T02:03:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27904.824639 secs 2024-04-27T02:03:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27207.794567 secs 2024-04-27T02:03:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27904.824639 secs 2024-04-27T02:03:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27207.794567 secs 2024-04-27T02:03:31.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:30 smithi189 ceph-mon[32756]: pgmap v15324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:31.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:30 smithi156 ceph-mon[32679]: pgmap v15324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:31.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:30 smithi092 ceph-mon[29156]: pgmap v15324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:33.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:32 smithi189 ceph-mon[32756]: pgmap v15325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:33.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:32 smithi156 ceph-mon[32679]: pgmap v15325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:33.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:32 smithi092 ceph-mon[29156]: pgmap v15325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:34 smithi189 ceph-mon[32756]: pgmap v15326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27909.824754 secs 2024-04-27T02:03:35.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27212.794660 secs 2024-04-27T02:03:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:34 smithi156 ceph-mon[32679]: pgmap v15326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27909.824754 secs 2024-04-27T02:03:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27212.794660 secs 2024-04-27T02:03:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:34 smithi092 ceph-mon[29156]: pgmap v15326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27909.824754 secs 2024-04-27T02:03:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27212.794660 secs 2024-04-27T02:03:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T02:03:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca80b0050 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8003a40 tx=0x7f1ca80b0050 comp rx=0 tx=0).stop 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.033+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.034+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:03:36.015 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.034+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80af000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.076+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T02:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.076+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T02:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.076+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.076+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=29 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T02:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.077+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.077+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T02:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:36.077+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T02:03:37.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:36 smithi156 ceph-mon[32679]: pgmap v15327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:37.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:36 smithi092 ceph-mon[29156]: pgmap v15327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:37.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:36 smithi189 ceph-mon[32756]: pgmap v15327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:39.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:38 smithi156 ceph-mon[32679]: pgmap v15328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:39.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:38 smithi092 ceph-mon[29156]: pgmap v15328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:39.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:38 smithi189 ceph-mon[32756]: pgmap v15328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:39.815+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:39.815+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:39.815+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:03:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:03:39.815+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 216 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:03:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27914.824886 secs 2024-04-27T02:03:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27217.794729 secs 2024-04-27T02:03:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27914.824886 secs 2024-04-27T02:03:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27217.794729 secs 2024-04-27T02:03:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27914.824886 secs 2024-04-27T02:03:40.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27217.794729 secs 2024-04-27T02:03:40.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:40 smithi092 ceph-mon[29156]: pgmap v15329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:41.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:40 smithi156 ceph-mon[32679]: pgmap v15329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:41.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:40 smithi189 ceph-mon[32756]: pgmap v15329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:43.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:42 smithi156 ceph-mon[32679]: pgmap v15330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:43.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:42 smithi092 ceph-mon[29156]: pgmap v15330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:43.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:42 smithi189 ceph-mon[32756]: pgmap v15330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:44 smithi156 ceph-mon[32679]: pgmap v15331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27919.825003 secs 2024-04-27T02:03:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27222.794853 secs 2024-04-27T02:03:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:44 smithi092 ceph-mon[29156]: pgmap v15331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27919.825003 secs 2024-04-27T02:03:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27222.794853 secs 2024-04-27T02:03:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:44 smithi189 ceph-mon[32756]: pgmap v15331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27919.825003 secs 2024-04-27T02:03:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27222.794853 secs 2024-04-27T02:03:47.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:46 smithi156 ceph-mon[32679]: pgmap v15332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:47.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:46 smithi092 ceph-mon[29156]: pgmap v15332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:47.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:46 smithi189 ceph-mon[32756]: pgmap v15332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:49.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:48 smithi156 ceph-mon[32679]: pgmap v15333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:49.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:48 smithi092 ceph-mon[29156]: pgmap v15333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:49.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:48 smithi189 ceph-mon[32756]: pgmap v15333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27924.825068 secs 2024-04-27T02:03:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27227.794978 secs 2024-04-27T02:03:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27924.825068 secs 2024-04-27T02:03:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27227.794978 secs 2024-04-27T02:03:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27924.825068 secs 2024-04-27T02:03:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27227.794978 secs 2024-04-27T02:03:51.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:50 smithi156 ceph-mon[32679]: pgmap v15334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:51.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:50 smithi092 ceph-mon[29156]: pgmap v15334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:51.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:50 smithi189 ceph-mon[32756]: pgmap v15334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:53.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:52 smithi156 ceph-mon[32679]: pgmap v15335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:53.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:52 smithi092 ceph-mon[29156]: pgmap v15335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:53.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:52 smithi189 ceph-mon[32756]: pgmap v15335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:55.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:54 smithi156 ceph-mon[32679]: pgmap v15336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:55.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27929.825148 secs 2024-04-27T02:03:55.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27232.795040 secs 2024-04-27T02:03:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:54 smithi092 ceph-mon[29156]: pgmap v15336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27929.825148 secs 2024-04-27T02:03:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27232.795040 secs 2024-04-27T02:03:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:54 smithi189 ceph-mon[32756]: pgmap v15336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27929.825148 secs 2024-04-27T02:03:55.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27232.795040 secs 2024-04-27T02:03:57.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:56 smithi092 ceph-mon[29156]: pgmap v15337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:57.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:56 smithi189 ceph-mon[32756]: pgmap v15337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:57.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:56 smithi156 ceph-mon[32679]: pgmap v15337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:03:59.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:58 smithi092 ceph-mon[29156]: pgmap v15338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:59.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:58 smithi189 ceph-mon[32756]: pgmap v15338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:03:59.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:58 smithi156 ceph-mon[32679]: pgmap v15338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27934.825244 secs 2024-04-27T02:04:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:03:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27237.795130 secs 2024-04-27T02:04:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27934.825244 secs 2024-04-27T02:04:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:03:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27237.795130 secs 2024-04-27T02:04:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27934.825244 secs 2024-04-27T02:04:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:03:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27237.795130 secs 2024-04-27T02:04:01.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:00 smithi092 ceph-mon[29156]: pgmap v15339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:01.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:00 smithi189 ceph-mon[32756]: pgmap v15339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:01.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:00 smithi156 ceph-mon[32679]: pgmap v15339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:03.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:02 smithi092 ceph-mon[29156]: pgmap v15340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:03.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:02 smithi189 ceph-mon[32756]: pgmap v15340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:03.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:02 smithi156 ceph-mon[32679]: pgmap v15340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:04 smithi092 ceph-mon[29156]: pgmap v15341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27939.825374 secs 2024-04-27T02:04:05.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27242.795238 secs 2024-04-27T02:04:05.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:04 smithi189 ceph-mon[32756]: pgmap v15341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:05.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27939.825374 secs 2024-04-27T02:04:05.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27242.795238 secs 2024-04-27T02:04:05.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:04 smithi156 ceph-mon[32679]: pgmap v15341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:05.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27939.825374 secs 2024-04-27T02:04:05.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27242.795238 secs 2024-04-27T02:04:07.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:06 smithi092 ceph-mon[29156]: pgmap v15342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:07.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:06 smithi189 ceph-mon[32756]: pgmap v15342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:07.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:06 smithi156 ceph-mon[32679]: pgmap v15342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:09.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:08 smithi156 ceph-mon[32679]: pgmap v15343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:04:09.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:08 smithi092 ceph-mon[29156]: pgmap v15343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:04:09.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:08 smithi189 ceph-mon[32756]: pgmap v15343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27944.825515 secs 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27247.795394 secs 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: slow request 360.760478 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:04:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:04:10.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:04:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27944.825515 secs 2024-04-27T02:04:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27247.795394 secs 2024-04-27T02:04:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: slow request 360.760478 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:04:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:04:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:04:10.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27944.825515 secs 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27247.795394 secs 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: slow request 360.760478 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:04:10.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:04:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:10 smithi092 ceph-mon[29156]: pgmap v15344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:10 smithi092 ceph-mon[29156]: pgmap v15345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:04:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:10 smithi092 ceph-mon[29156]: pgmap v15346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:11.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:10 smithi189 ceph-mon[32756]: pgmap v15344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:11.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:10 smithi189 ceph-mon[32756]: pgmap v15345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:04:11.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:10 smithi189 ceph-mon[32756]: pgmap v15346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:11.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:10 smithi156 ceph-mon[32679]: pgmap v15344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:11.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:10 smithi156 ceph-mon[32679]: pgmap v15345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:04:11.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:10 smithi156 ceph-mon[32679]: pgmap v15346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:12.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:11 smithi092 ceph-mon[29156]: pgmap v15347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:12.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:11 smithi189 ceph-mon[32756]: pgmap v15347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:12.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:11 smithi156 ceph-mon[32679]: pgmap v15347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:04:15.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27949.825665 secs 2024-04-27T02:04:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:14 smithi189 ceph-mon[32756]: pgmap v15348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27252.795513 secs 2024-04-27T02:04:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27949.825665 secs 2024-04-27T02:04:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:14 smithi156 ceph-mon[32679]: pgmap v15348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27252.795513 secs 2024-04-27T02:04:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27949.825665 secs 2024-04-27T02:04:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:14 smithi092 ceph-mon[29156]: pgmap v15348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27252.795513 secs 2024-04-27T02:04:17.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:16 smithi189 ceph-mon[32756]: pgmap v15349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:17.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:16 smithi156 ceph-mon[32679]: pgmap v15349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:17.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:16 smithi092 ceph-mon[29156]: pgmap v15349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:04:19.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:18 smithi189 ceph-mon[32756]: pgmap v15350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:04:19.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:18 smithi156 ceph-mon[32679]: pgmap v15350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:04:19.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:18 smithi092 ceph-mon[29156]: pgmap v15350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:04:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27954.825806 secs 2024-04-27T02:04:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27257.795646 secs 2024-04-27T02:04:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27954.825806 secs 2024-04-27T02:04:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27257.795646 secs 2024-04-27T02:04:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27954.825806 secs 2024-04-27T02:04:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27257.795646 secs 2024-04-27T02:04:21.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:20 smithi189 ceph-mon[32756]: pgmap v15351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:04:21.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:20 smithi156 ceph-mon[32679]: pgmap v15351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:04:21.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:20 smithi092 ceph-mon[29156]: pgmap v15351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:04:23.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:22 smithi189 ceph-mon[32756]: pgmap v15352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:23.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:22 smithi156 ceph-mon[32679]: pgmap v15352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:23.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:22 smithi092 ceph-mon[29156]: pgmap v15352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27959.825899 secs 2024-04-27T02:04:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:24 smithi189 ceph-mon[32756]: pgmap v15353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27262.795746 secs 2024-04-27T02:04:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27959.825899 secs 2024-04-27T02:04:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:24 smithi156 ceph-mon[32679]: pgmap v15353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27262.795746 secs 2024-04-27T02:04:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27959.825899 secs 2024-04-27T02:04:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:24 smithi092 ceph-mon[29156]: pgmap v15353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27262.795746 secs 2024-04-27T02:04:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:26 smithi189 ceph-mon[32756]: pgmap v15354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:27.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:26 smithi156 ceph-mon[32679]: pgmap v15354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:27.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:26 smithi092 ceph-mon[29156]: pgmap v15354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:29.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:28 smithi189 ceph-mon[32756]: pgmap v15355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:29.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:28 smithi156 ceph-mon[32679]: pgmap v15355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:29.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:28 smithi092 ceph-mon[29156]: pgmap v15355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27964.825998 secs 2024-04-27T02:04:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27267.795866 secs 2024-04-27T02:04:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27964.825998 secs 2024-04-27T02:04:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27267.795866 secs 2024-04-27T02:04:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27964.825998 secs 2024-04-27T02:04:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27267.795866 secs 2024-04-27T02:04:31.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:30 smithi156 ceph-mon[32679]: pgmap v15356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:31.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:30 smithi092 ceph-mon[29156]: pgmap v15356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:31.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:30 smithi189 ceph-mon[32756]: pgmap v15356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:33.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:32 smithi156 ceph-mon[32679]: pgmap v15357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:33.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:32 smithi092 ceph-mon[29156]: pgmap v15357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:33.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:32 smithi189 ceph-mon[32756]: pgmap v15357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27969.826107 secs 2024-04-27T02:04:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:34 smithi156 ceph-mon[32679]: pgmap v15358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27272.796020 secs 2024-04-27T02:04:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27969.826107 secs 2024-04-27T02:04:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:34 smithi092 ceph-mon[29156]: pgmap v15358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27272.796020 secs 2024-04-27T02:04:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27969.826107 secs 2024-04-27T02:04:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:34 smithi189 ceph-mon[32756]: pgmap v15358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27272.796020 secs 2024-04-27T02:04:37.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:36 smithi156 ceph-mon[32679]: pgmap v15359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:37.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:36 smithi189 ceph-mon[32756]: pgmap v15359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:37.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:36 smithi092 ceph-mon[29156]: pgmap v15359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:39.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:38 smithi156 ceph-mon[32679]: pgmap v15360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:39.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:38 smithi092 ceph-mon[29156]: pgmap v15360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:39.368 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:38 smithi189 ceph-mon[32756]: pgmap v15360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:39 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 27974.826236 secs 2024-04-27T02:04:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:39 smithi156 ceph-mon[32679]: slow request 2881.290391 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27277.796164 secs 2024-04-27T02:04:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:39 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 27974.826236 secs 2024-04-27T02:04:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:39 smithi092 ceph-mon[29156]: slow request 2881.290391 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27277.796164 secs 2024-04-27T02:04:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:39 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 27974.826236 secs 2024-04-27T02:04:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:39 smithi189 ceph-mon[32756]: slow request 2881.290391 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:04:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27277.796164 secs 2024-04-27T02:04:41.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:40 smithi156 ceph-mon[32679]: pgmap v15361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:41.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:40 smithi092 ceph-mon[29156]: pgmap v15361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:41.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:40 smithi189 ceph-mon[32756]: pgmap v15361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:43.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:42 smithi156 ceph-mon[32679]: pgmap v15362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:43.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:42 smithi092 ceph-mon[29156]: pgmap v15362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:43.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:42 smithi189 ceph-mon[32756]: pgmap v15362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27979.826351 secs 2024-04-27T02:04:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:44 smithi156 ceph-mon[32679]: pgmap v15363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27282.796257 secs 2024-04-27T02:04:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27979.826351 secs 2024-04-27T02:04:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:44 smithi092 ceph-mon[29156]: pgmap v15363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27282.796257 secs 2024-04-27T02:04:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27979.826351 secs 2024-04-27T02:04:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:44 smithi189 ceph-mon[32756]: pgmap v15363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27282.796257 secs 2024-04-27T02:04:47.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:46 smithi156 ceph-mon[32679]: pgmap v15364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:47.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:46 smithi092 ceph-mon[29156]: pgmap v15364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:47.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:46 smithi189 ceph-mon[32756]: pgmap v15364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:49.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:48 smithi156 ceph-mon[32679]: pgmap v15365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:49.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:48 smithi092 ceph-mon[29156]: pgmap v15365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:49.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:48 smithi189 ceph-mon[32756]: pgmap v15365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27984.826467 secs 2024-04-27T02:04:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27287.796374 secs 2024-04-27T02:04:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27984.826467 secs 2024-04-27T02:04:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27287.796374 secs 2024-04-27T02:04:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27984.826467 secs 2024-04-27T02:04:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27287.796374 secs 2024-04-27T02:04:51.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:50 smithi156 ceph-mon[32679]: pgmap v15366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:51.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:50 smithi092 ceph-mon[29156]: pgmap v15366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:51.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:50 smithi189 ceph-mon[32756]: pgmap v15366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:53.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:52 smithi092 ceph-mon[29156]: pgmap v15367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:53.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:52 smithi189 ceph-mon[32756]: pgmap v15367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:53.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:52 smithi156 ceph-mon[32679]: pgmap v15367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27989.826578 secs 2024-04-27T02:04:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:54 smithi092 ceph-mon[29156]: pgmap v15368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27292.796438 secs 2024-04-27T02:04:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27989.826578 secs 2024-04-27T02:04:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:54 smithi189 ceph-mon[32756]: pgmap v15368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27292.796438 secs 2024-04-27T02:04:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27989.826578 secs 2024-04-27T02:04:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:54 smithi156 ceph-mon[32679]: pgmap v15368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:04:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27292.796438 secs 2024-04-27T02:04:57.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:56 smithi092 ceph-mon[29156]: pgmap v15369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:57.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:56 smithi189 ceph-mon[32756]: pgmap v15369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:57.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:56 smithi156 ceph-mon[32679]: pgmap v15369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:59.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:58 smithi092 ceph-mon[29156]: pgmap v15370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:59.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:58 smithi189 ceph-mon[32756]: pgmap v15370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:04:59.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:58 smithi156 ceph-mon[32679]: pgmap v15370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27994.826717 secs 2024-04-27T02:05:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:04:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27297.796561 secs 2024-04-27T02:05:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27994.826717 secs 2024-04-27T02:05:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:04:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27297.796561 secs 2024-04-27T02:05:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27994.826717 secs 2024-04-27T02:05:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:04:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27297.796561 secs 2024-04-27T02:05:01.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:00 smithi092 ceph-mon[29156]: pgmap v15371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:01.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:00 smithi189 ceph-mon[32756]: pgmap v15371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:01.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:00 smithi156 ceph-mon[32679]: pgmap v15371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:03.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:02 smithi092 ceph-mon[29156]: pgmap v15372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:03.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:02 smithi189 ceph-mon[32756]: pgmap v15372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:03.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:02 smithi156 ceph-mon[32679]: pgmap v15372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 27999.826854 secs 2024-04-27T02:05:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:04 smithi092 ceph-mon[29156]: pgmap v15373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:05.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27302.796676 secs 2024-04-27T02:05:05.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 27999.826854 secs 2024-04-27T02:05:05.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:04 smithi189 ceph-mon[32756]: pgmap v15373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:05.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27302.796676 secs 2024-04-27T02:05:05.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 27999.826854 secs 2024-04-27T02:05:05.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:04 smithi156 ceph-mon[32679]: pgmap v15373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:05.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27302.796676 secs 2024-04-27T02:05:07.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:06 smithi092 ceph-mon[29156]: pgmap v15374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:07.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:06 smithi189 ceph-mon[32756]: pgmap v15374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:07.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:06 smithi156 ceph-mon[32679]: pgmap v15374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:09.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:08 smithi092 ceph-mon[29156]: pgmap v15375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:09.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:08 smithi189 ceph-mon[32756]: pgmap v15375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:09.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:08 smithi156 ceph-mon[32679]: pgmap v15375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28004.826968 secs 2024-04-27T02:05:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27307.796798 secs 2024-04-27T02:05:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:09 smithi092 ceph-mon[29156]: slow request 720.829632 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:05:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:05:10.313 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28004.826968 secs 2024-04-27T02:05:10.313 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27307.796798 secs 2024-04-27T02:05:10.313 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:09 smithi156 ceph-mon[32679]: slow request 720.829632 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:05:10.313 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:05:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28004.826968 secs 2024-04-27T02:05:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27307.796798 secs 2024-04-27T02:05:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:09 smithi189 ceph-mon[32756]: slow request 720.829632 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:05:10.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:05:11.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:10 smithi092 ceph-mon[29156]: pgmap v15376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:11.284 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:10 smithi156 ceph-mon[32679]: pgmap v15376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:11.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:10 smithi189 ceph-mon[32756]: pgmap v15376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:12.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:11 smithi092 ceph-mon[29156]: pgmap v15377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:12.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:11 smithi156 ceph-mon[32679]: pgmap v15377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:12.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:11 smithi189 ceph-mon[32756]: pgmap v15377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:15.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28009.827053 secs 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: pgmap v15378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27312.796912 secs 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:05:15.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28009.827053 secs 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: pgmap v15378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27312.796912 secs 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:05:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:05:15.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28009.827053 secs 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: pgmap v15378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27312.796912 secs 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:05:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:05:16.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:15 smithi189 ceph-mon[32756]: pgmap v15379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:05:16.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:15 smithi189 ceph-mon[32756]: pgmap v15380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:16.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:15 smithi156 ceph-mon[32679]: pgmap v15379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:05:16.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:15 smithi156 ceph-mon[32679]: pgmap v15380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:16.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:15 smithi092 ceph-mon[29156]: pgmap v15379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:05:16.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:15 smithi092 ceph-mon[29156]: pgmap v15380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:18.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:17 smithi189 ceph-mon[32756]: pgmap v15381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:18.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:17 smithi156 ceph-mon[32679]: pgmap v15381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:18.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:17 smithi092 ceph-mon[29156]: pgmap v15381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:19 smithi156 ceph-mon[32679]: pgmap v15382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28014.827136 secs 2024-04-27T02:05:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27317.796978 secs 2024-04-27T02:05:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:19 smithi092 ceph-mon[29156]: pgmap v15382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28014.827136 secs 2024-04-27T02:05:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27317.796978 secs 2024-04-27T02:05:20.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:19 smithi189 ceph-mon[32756]: pgmap v15382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:20.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28014.827136 secs 2024-04-27T02:05:20.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27317.796978 secs 2024-04-27T02:05:22.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:21 smithi156 ceph-mon[32679]: pgmap v15383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:22.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:21 smithi092 ceph-mon[29156]: pgmap v15383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:22.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:21 smithi189 ceph-mon[32756]: pgmap v15383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:05:24.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:23 smithi156 ceph-mon[32679]: pgmap v15384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:24.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:23 smithi092 ceph-mon[29156]: pgmap v15384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:24.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:23 smithi189 ceph-mon[32756]: pgmap v15384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:05:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28019.827255 secs 2024-04-27T02:05:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27322.797101 secs 2024-04-27T02:05:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28019.827255 secs 2024-04-27T02:05:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27322.797101 secs 2024-04-27T02:05:25.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28019.827255 secs 2024-04-27T02:05:25.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27322.797101 secs 2024-04-27T02:05:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:25 smithi156 ceph-mon[32679]: pgmap v15385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:05:26.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:25 smithi092 ceph-mon[29156]: pgmap v15385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:05:26.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:25 smithi189 ceph-mon[32756]: pgmap v15385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:05:28.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:27 smithi156 ceph-mon[32679]: pgmap v15386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:28.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:27 smithi092 ceph-mon[29156]: pgmap v15386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:28.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:27 smithi189 ceph-mon[32756]: pgmap v15386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:29 smithi156 ceph-mon[32679]: pgmap v15387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28024.827334 secs 2024-04-27T02:05:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27327.797222 secs 2024-04-27T02:05:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:29 smithi092 ceph-mon[29156]: pgmap v15387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28024.827334 secs 2024-04-27T02:05:30.224 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27327.797222 secs 2024-04-27T02:05:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:29 smithi189 ceph-mon[32756]: pgmap v15387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28024.827334 secs 2024-04-27T02:05:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27327.797222 secs 2024-04-27T02:05:32.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:31 smithi156 ceph-mon[32679]: pgmap v15388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:32.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:31 smithi092 ceph-mon[29156]: pgmap v15388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:32.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:31 smithi189 ceph-mon[32756]: pgmap v15388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:34.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:33 smithi156 ceph-mon[32679]: pgmap v15389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:34.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:33 smithi092 ceph-mon[29156]: pgmap v15389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:34.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:33 smithi189 ceph-mon[32756]: pgmap v15389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28029.827446 secs 2024-04-27T02:05:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27332.797359 secs 2024-04-27T02:05:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28029.827446 secs 2024-04-27T02:05:35.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27332.797359 secs 2024-04-27T02:05:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28029.827446 secs 2024-04-27T02:05:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27332.797359 secs 2024-04-27T02:05:36.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:35 smithi156 ceph-mon[32679]: pgmap v15390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:36.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:35 smithi092 ceph-mon[29156]: pgmap v15390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:36.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:35 smithi189 ceph-mon[32756]: pgmap v15390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:38.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:37 smithi156 ceph-mon[32679]: pgmap v15391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:38.169 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:37 smithi189 ceph-mon[32756]: pgmap v15391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:38.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:37 smithi092 ceph-mon[29156]: pgmap v15391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:39 smithi092 ceph-mon[29156]: pgmap v15392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28034.827525 secs 2024-04-27T02:05:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27337.797474 secs 2024-04-27T02:05:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:39 smithi189 ceph-mon[32756]: pgmap v15392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28034.827525 secs 2024-04-27T02:05:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27337.797474 secs 2024-04-27T02:05:40.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:39 smithi156 ceph-mon[32679]: pgmap v15392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:40.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28034.827525 secs 2024-04-27T02:05:40.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27337.797474 secs 2024-04-27T02:05:42.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:41 smithi156 ceph-mon[32679]: pgmap v15393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:42.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:41 smithi092 ceph-mon[29156]: pgmap v15393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:42.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:41 smithi189 ceph-mon[32756]: pgmap v15393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:44.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:43 smithi092 ceph-mon[29156]: pgmap v15394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:44.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:43 smithi189 ceph-mon[32756]: pgmap v15394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:44.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:43 smithi156 ceph-mon[32679]: pgmap v15394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28039.827660 secs 2024-04-27T02:05:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27342.797538 secs 2024-04-27T02:05:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28039.827660 secs 2024-04-27T02:05:45.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27342.797538 secs 2024-04-27T02:05:45.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28039.827660 secs 2024-04-27T02:05:45.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27342.797538 secs 2024-04-27T02:05:46.199 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:45 smithi092 ceph-mon[29156]: pgmap v15395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:46.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:45 smithi189 ceph-mon[32756]: pgmap v15395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:46.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:45 smithi156 ceph-mon[32679]: pgmap v15395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:48.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:47 smithi092 ceph-mon[29156]: pgmap v15396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:48.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:47 smithi189 ceph-mon[32756]: pgmap v15396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:48.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:47 smithi156 ceph-mon[32679]: pgmap v15396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:49 smithi092 ceph-mon[29156]: pgmap v15397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28044.827728 secs 2024-04-27T02:05:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27347.797656 secs 2024-04-27T02:05:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:49 smithi189 ceph-mon[32756]: pgmap v15397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28044.827728 secs 2024-04-27T02:05:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27347.797656 secs 2024-04-27T02:05:50.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:49 smithi156 ceph-mon[32679]: pgmap v15397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:50.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28044.827728 secs 2024-04-27T02:05:50.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27347.797656 secs 2024-04-27T02:05:52.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:51 smithi092 ceph-mon[29156]: pgmap v15398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:52.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:51 smithi189 ceph-mon[32756]: pgmap v15398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:52.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:51 smithi156 ceph-mon[32679]: pgmap v15398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:54.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:53 smithi092 ceph-mon[29156]: pgmap v15399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:54.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:53 smithi189 ceph-mon[32756]: pgmap v15399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:54.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:53 smithi156 ceph-mon[32679]: pgmap v15399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28049.827871 secs 2024-04-27T02:05:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27352.797745 secs 2024-04-27T02:05:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28049.827871 secs 2024-04-27T02:05:55.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27352.797745 secs 2024-04-27T02:05:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28049.827871 secs 2024-04-27T02:05:55.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27352.797745 secs 2024-04-27T02:05:56.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:55 smithi092 ceph-mon[29156]: pgmap v15400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:56.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:55 smithi189 ceph-mon[32756]: pgmap v15400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:56.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:55 smithi156 ceph-mon[32679]: pgmap v15400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:05:58.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:57 smithi092 ceph-mon[29156]: pgmap v15401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:58.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:57 smithi189 ceph-mon[32756]: pgmap v15401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:58.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:57 smithi156 ceph-mon[32679]: pgmap v15401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:59.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:05:59 smithi189 ceph-mon[32756]: pgmap v15402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:59.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:05:59 smithi156 ceph-mon[32679]: pgmap v15402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:05:59.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:05:59 smithi092 ceph-mon[29156]: pgmap v15402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28054.827986 secs 2024-04-27T02:06:00.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27357.797846 secs 2024-04-27T02:06:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28054.827986 secs 2024-04-27T02:06:00.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27357.797846 secs 2024-04-27T02:06:00.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28054.827986 secs 2024-04-27T02:06:00.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27357.797846 secs 2024-04-27T02:06:01.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:01 smithi189 ceph-mon[32756]: pgmap v15403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:01.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:01 smithi156 ceph-mon[32679]: pgmap v15403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:01.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:01 smithi092 ceph-mon[29156]: pgmap v15403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:03.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:03 smithi189 ceph-mon[32756]: pgmap v15404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:03.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:03 smithi156 ceph-mon[32679]: pgmap v15404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:03.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:03 smithi092 ceph-mon[29156]: pgmap v15404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28059.828047 secs 2024-04-27T02:06:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27362.797967 secs 2024-04-27T02:06:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:05 smithi189 ceph-mon[32756]: pgmap v15405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:05.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28059.828047 secs 2024-04-27T02:06:05.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27362.797967 secs 2024-04-27T02:06:05.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:05 smithi156 ceph-mon[32679]: pgmap v15405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:05.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28059.828047 secs 2024-04-27T02:06:05.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27362.797967 secs 2024-04-27T02:06:05.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:05 smithi092 ceph-mon[29156]: pgmap v15405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:07.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:07 smithi189 ceph-mon[32756]: pgmap v15406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:07.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:07 smithi156 ceph-mon[32679]: pgmap v15406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:07.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:07 smithi092 ceph-mon[29156]: pgmap v15406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:09.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:09 smithi189 ceph-mon[32756]: pgmap v15407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:09.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:09 smithi156 ceph-mon[32679]: pgmap v15407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:09.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:09 smithi092 ceph-mon[29156]: pgmap v15407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:10.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28064.828152 secs 2024-04-27T02:06:10.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27367.798089 secs 2024-04-27T02:06:10.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28064.828152 secs 2024-04-27T02:06:10.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27367.798089 secs 2024-04-27T02:06:10.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28064.828152 secs 2024-04-27T02:06:10.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27367.798089 secs 2024-04-27T02:06:11.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:11 smithi189 ceph-mon[32756]: pgmap v15408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:11.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:11 smithi156 ceph-mon[32679]: pgmap v15408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:11.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:11 smithi092 ceph-mon[29156]: pgmap v15408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:13.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:13 smithi189 ceph-mon[32756]: pgmap v15409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:13.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:13 smithi156 ceph-mon[32679]: pgmap v15409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:13.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:13 smithi092 ceph-mon[29156]: pgmap v15409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:15.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28069.828275 secs 2024-04-27T02:06:15.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27372.798236 secs 2024-04-27T02:06:15.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:15 smithi189 ceph-mon[32756]: pgmap v15410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:15.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:06:15.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28069.828275 secs 2024-04-27T02:06:15.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27372.798236 secs 2024-04-27T02:06:15.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:15 smithi156 ceph-mon[32679]: pgmap v15410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:15.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:06:15.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28069.828275 secs 2024-04-27T02:06:15.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27372.798236 secs 2024-04-27T02:06:15.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:15 smithi092 ceph-mon[29156]: pgmap v15410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:15.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:06:17.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:17 smithi189 ceph-mon[32756]: pgmap v15411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:17.625 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:17 smithi092 ceph-mon[29156]: pgmap v15411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:17.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:17 smithi156 ceph-mon[32679]: pgmap v15411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:19.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: pgmap v15412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:19.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: pgmap v15413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: pgmap v15414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28074.828356 secs 2024-04-27T02:06:19.868 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27377.798361 secs 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: pgmap v15412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:06:19.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: pgmap v15413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:06:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: pgmap v15414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28074.828356 secs 2024-04-27T02:06:19.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27377.798361 secs 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: pgmap v15412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: pgmap v15413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:06:19.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: pgmap v15414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:06:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28074.828356 secs 2024-04-27T02:06:19.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27377.798361 secs 2024-04-27T02:06:21.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:21 smithi156 ceph-mon[32679]: pgmap v15415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:21.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:21 smithi092 ceph-mon[29156]: pgmap v15415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:22.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:21 smithi189 ceph-mon[32756]: pgmap v15415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:23.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:23 smithi156 ceph-mon[32679]: pgmap v15416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:06:23.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:23 smithi092 ceph-mon[29156]: pgmap v15416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:06:24.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:23 smithi189 ceph-mon[32756]: pgmap v15416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:06:24.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28079.828482 secs 2024-04-27T02:06:24.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27382.798495 secs 2024-04-27T02:06:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28079.828482 secs 2024-04-27T02:06:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27382.798495 secs 2024-04-27T02:06:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28079.828482 secs 2024-04-27T02:06:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27382.798495 secs 2024-04-27T02:06:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:25 smithi092 ceph-mon[29156]: pgmap v15417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:25 smithi189 ceph-mon[32756]: pgmap v15417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:25 smithi156 ceph-mon[32679]: pgmap v15417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:27.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:27 smithi092 ceph-mon[29156]: pgmap v15418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:28.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:27 smithi189 ceph-mon[32756]: pgmap v15418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:28.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:27 smithi156 ceph-mon[32679]: pgmap v15418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:29.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:29 smithi092 ceph-mon[29156]: pgmap v15419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:06:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28084.828602 secs 2024-04-27T02:06:29.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27387.798618 secs 2024-04-27T02:06:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:29 smithi189 ceph-mon[32756]: pgmap v15419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:06:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28084.828602 secs 2024-04-27T02:06:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27387.798618 secs 2024-04-27T02:06:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:29 smithi156 ceph-mon[32679]: pgmap v15419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:06:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28084.828602 secs 2024-04-27T02:06:30.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27387.798618 secs 2024-04-27T02:06:31.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:31 smithi092 ceph-mon[29156]: pgmap v15420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:32.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:31 smithi189 ceph-mon[32756]: pgmap v15420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:32.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:31 smithi156 ceph-mon[32679]: pgmap v15420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:33.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:33 smithi092 ceph-mon[29156]: pgmap v15421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:34.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:33 smithi189 ceph-mon[32756]: pgmap v15421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:34.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:33 smithi156 ceph-mon[32679]: pgmap v15421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:34.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28089.828739 secs 2024-04-27T02:06:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27392.798734 secs 2024-04-27T02:06:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28089.828739 secs 2024-04-27T02:06:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27392.798734 secs 2024-04-27T02:06:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28089.828739 secs 2024-04-27T02:06:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27392.798734 secs 2024-04-27T02:06:35.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:35 smithi092 ceph-mon[29156]: pgmap v15422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:36.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:35 smithi189 ceph-mon[32756]: pgmap v15422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:36.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:35 smithi156 ceph-mon[32679]: pgmap v15422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:37.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:37 smithi092 ceph-mon[29156]: pgmap v15423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:38.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:37 smithi189 ceph-mon[32756]: pgmap v15423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:38.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:37 smithi156 ceph-mon[32679]: pgmap v15423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:06:39.839+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:06:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:06:39.839+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:06:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:06:39.840+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:06:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:06:39.840+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 217 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:06:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:39 smithi092 ceph-mon[29156]: pgmap v15424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28094.828852 secs 2024-04-27T02:06:39.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27397.798806 secs 2024-04-27T02:06:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:39 smithi189 ceph-mon[32756]: pgmap v15424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28094.828852 secs 2024-04-27T02:06:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27397.798806 secs 2024-04-27T02:06:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:39 smithi156 ceph-mon[32679]: pgmap v15424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28094.828852 secs 2024-04-27T02:06:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27397.798806 secs 2024-04-27T02:06:41.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:41 smithi092 ceph-mon[29156]: pgmap v15425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:42.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:41 smithi189 ceph-mon[32756]: pgmap v15425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:42.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:41 smithi156 ceph-mon[32679]: pgmap v15425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:43.965 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:43 smithi156 ceph-mon[32679]: pgmap v15426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:43.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:43 smithi092 ceph-mon[29156]: pgmap v15426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:44.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:43 smithi189 ceph-mon[32756]: pgmap v15426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:44.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28099.828971 secs 2024-04-27T02:06:44.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27402.798926 secs 2024-04-27T02:06:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28099.828971 secs 2024-04-27T02:06:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27402.798926 secs 2024-04-27T02:06:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28099.828971 secs 2024-04-27T02:06:45.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27402.798926 secs 2024-04-27T02:06:45.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:45 smithi092 ceph-mon[29156]: pgmap v15427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:46.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:45 smithi189 ceph-mon[32756]: pgmap v15427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:46.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:45 smithi156 ceph-mon[32679]: pgmap v15427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:47.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:47 smithi092 ceph-mon[29156]: pgmap v15428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:48.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:47 smithi189 ceph-mon[32756]: pgmap v15428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:48.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:47 smithi156 ceph-mon[32679]: pgmap v15428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:49 smithi092 ceph-mon[29156]: pgmap v15429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28104.829045 secs 2024-04-27T02:06:49.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27407.799044 secs 2024-04-27T02:06:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:49 smithi189 ceph-mon[32756]: pgmap v15429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28104.829045 secs 2024-04-27T02:06:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27407.799044 secs 2024-04-27T02:06:50.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:49 smithi156 ceph-mon[32679]: pgmap v15429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:06:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28104.829045 secs 2024-04-27T02:06:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27407.799044 secs 2024-04-27T02:06:51.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:51 smithi092 ceph-mon[29156]: pgmap v15430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:52.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:51 smithi189 ceph-mon[32756]: pgmap v15430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:52.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:51 smithi156 ceph-mon[32679]: pgmap v15430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:53.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:53 smithi092 ceph-mon[29156]: pgmap v15431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:54.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:53 smithi189 ceph-mon[32756]: pgmap v15431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:54.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:53 smithi156 ceph-mon[32679]: pgmap v15431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:06:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28109.829159 secs 2024-04-27T02:06:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27412.799151 secs 2024-04-27T02:06:55.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28109.829159 secs 2024-04-27T02:06:55.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27412.799151 secs 2024-04-27T02:06:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28109.829159 secs 2024-04-27T02:06:55.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27412.799151 secs 2024-04-27T02:06:56.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:55 smithi189 ceph-mon[32756]: pgmap v15432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:56.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:55 smithi156 ceph-mon[32679]: pgmap v15432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:56.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:55 smithi092 ceph-mon[29156]: pgmap v15432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:06:58.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:57 smithi189 ceph-mon[32756]: pgmap v15433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:06:58.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:57 smithi156 ceph-mon[32679]: pgmap v15433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:06:58.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:57 smithi092 ceph-mon[29156]: pgmap v15433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:00.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:59 smithi189 ceph-mon[32756]: pgmap v15434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:00.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28114.829281 secs 2024-04-27T02:07:00.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:06:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27417.799304 secs 2024-04-27T02:07:00.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:59 smithi156 ceph-mon[32679]: pgmap v15434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:00.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28114.829281 secs 2024-04-27T02:07:00.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:06:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27417.799304 secs 2024-04-27T02:07:00.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:59 smithi092 ceph-mon[29156]: pgmap v15434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28114.829281 secs 2024-04-27T02:07:00.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:06:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27417.799304 secs 2024-04-27T02:07:02.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:01 smithi189 ceph-mon[32756]: pgmap v15435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:02.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:01 smithi156 ceph-mon[32679]: pgmap v15435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:02.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:01 smithi092 ceph-mon[29156]: pgmap v15435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:04.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:03 smithi189 ceph-mon[32756]: pgmap v15436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:04.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:03 smithi156 ceph-mon[32679]: pgmap v15436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:04.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:03 smithi092 ceph-mon[29156]: pgmap v15436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:07:05.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28119.829411 secs 2024-04-27T02:07:05.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27422.799393 secs 2024-04-27T02:07:05.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28119.829411 secs 2024-04-27T02:07:05.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27422.799393 secs 2024-04-27T02:07:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28119.829411 secs 2024-04-27T02:07:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27422.799393 secs 2024-04-27T02:07:06.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:05 smithi189 ceph-mon[32756]: pgmap v15437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:06.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:05 smithi156 ceph-mon[32679]: pgmap v15437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:06.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:05 smithi092 ceph-mon[29156]: pgmap v15437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:07:08.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:07 smithi189 ceph-mon[32756]: pgmap v15438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:08.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:07 smithi156 ceph-mon[32679]: pgmap v15438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:08.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:07 smithi092 ceph-mon[29156]: pgmap v15438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:10.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:09 smithi189 ceph-mon[32756]: pgmap v15439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:10.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28124.829533 secs 2024-04-27T02:07:10.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27427.799516 secs 2024-04-27T02:07:10.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:09 smithi189 ceph-mon[32756]: slow request 1441.012927 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:07:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:09 smithi156 ceph-mon[32679]: pgmap v15439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28124.829533 secs 2024-04-27T02:07:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27427.799516 secs 2024-04-27T02:07:10.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:09 smithi156 ceph-mon[32679]: slow request 1441.012927 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:07:10.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:09 smithi092 ceph-mon[29156]: pgmap v15439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28124.829533 secs 2024-04-27T02:07:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27427.799516 secs 2024-04-27T02:07:10.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:09 smithi092 ceph-mon[29156]: slow request 1441.012927 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:07:12.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:11 smithi189 ceph-mon[32756]: pgmap v15440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:12.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:11 smithi156 ceph-mon[32679]: pgmap v15440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:12.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:11 smithi092 ceph-mon[29156]: pgmap v15440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:14.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:13 smithi189 ceph-mon[32756]: pgmap v15441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:14.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:13 smithi156 ceph-mon[32679]: pgmap v15441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:14.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:13 smithi092 ceph-mon[29156]: pgmap v15441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:15.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28129.829642 secs 2024-04-27T02:07:15.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27432.799579 secs 2024-04-27T02:07:15.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28129.829642 secs 2024-04-27T02:07:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27432.799579 secs 2024-04-27T02:07:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28129.829642 secs 2024-04-27T02:07:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27432.799579 secs 2024-04-27T02:07:16.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:15 smithi189 ceph-mon[32756]: pgmap v15442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:16.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:15 smithi156 ceph-mon[32679]: pgmap v15442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:16.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:15 smithi092 ceph-mon[29156]: pgmap v15442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:18.025 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:17 smithi092 ceph-mon[29156]: pgmap v15443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:18.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:17 smithi189 ceph-mon[32756]: pgmap v15443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:18.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:17 smithi156 ceph-mon[32679]: pgmap v15443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: pgmap v15444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28134.829776 secs 2024-04-27T02:07:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:07:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27437.799648 secs 2024-04-27T02:07:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:07:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:07:20.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:07:20.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: pgmap v15444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28134.829776 secs 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27437.799648 secs 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:07:20.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: pgmap v15444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28134.829776 secs 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27437.799648 secs 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:07:20.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:07:21.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:20 smithi189 ceph-mon[32756]: pgmap v15445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:07:21.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:20 smithi189 ceph-mon[32756]: pgmap v15446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:21.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:20 smithi156 ceph-mon[32679]: pgmap v15445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:07:21.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:20 smithi156 ceph-mon[32679]: pgmap v15446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:21.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:20 smithi092 ceph-mon[29156]: pgmap v15445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:07:21.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:20 smithi092 ceph-mon[29156]: pgmap v15446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:23.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:22 smithi189 ceph-mon[32756]: pgmap v15447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:23.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:22 smithi156 ceph-mon[32679]: pgmap v15447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:23.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:22 smithi092 ceph-mon[29156]: pgmap v15447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:24 smithi189 ceph-mon[32756]: pgmap v15448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28139.829906 secs 2024-04-27T02:07:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27442.799727 secs 2024-04-27T02:07:25.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:24 smithi156 ceph-mon[32679]: pgmap v15448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28139.829906 secs 2024-04-27T02:07:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27442.799727 secs 2024-04-27T02:07:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:24 smithi092 ceph-mon[29156]: pgmap v15448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28139.829906 secs 2024-04-27T02:07:25.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27442.799727 secs 2024-04-27T02:07:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:26 smithi189 ceph-mon[32756]: pgmap v15449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:26 smithi156 ceph-mon[32679]: pgmap v15449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:27.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:26 smithi092 ceph-mon[29156]: pgmap v15449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:07:29.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:28 smithi189 ceph-mon[32756]: pgmap v15450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:29.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:28 smithi156 ceph-mon[32679]: pgmap v15450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:29.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:28 smithi092 ceph-mon[29156]: pgmap v15450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:07:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28144.830022 secs 2024-04-27T02:07:30.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27447.799825 secs 2024-04-27T02:07:30.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28144.830022 secs 2024-04-27T02:07:30.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27447.799825 secs 2024-04-27T02:07:30.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28144.830022 secs 2024-04-27T02:07:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27447.799825 secs 2024-04-27T02:07:31.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:30 smithi189 ceph-mon[32756]: pgmap v15451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:07:31.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:30 smithi156 ceph-mon[32679]: pgmap v15451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:07:31.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:30 smithi092 ceph-mon[29156]: pgmap v15451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:07:33.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:32 smithi189 ceph-mon[32756]: pgmap v15452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:33.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:32 smithi156 ceph-mon[32679]: pgmap v15452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:33.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:32 smithi092 ceph-mon[29156]: pgmap v15452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:34.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:34 smithi092 ceph-mon[29156]: pgmap v15453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28149.830137 secs 2024-04-27T02:07:34.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27452.799900 secs 2024-04-27T02:07:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:34 smithi189 ceph-mon[32756]: pgmap v15453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28149.830137 secs 2024-04-27T02:07:35.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27452.799900 secs 2024-04-27T02:07:35.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:34 smithi156 ceph-mon[32679]: pgmap v15453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28149.830137 secs 2024-04-27T02:07:35.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27452.799900 secs 2024-04-27T02:07:37.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:36 smithi189 ceph-mon[32756]: pgmap v15454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:37.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:36 smithi156 ceph-mon[32679]: pgmap v15454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:37.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:36 smithi092 ceph-mon[29156]: pgmap v15454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:39.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:38 smithi189 ceph-mon[32756]: pgmap v15455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:39.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:38 smithi156 ceph-mon[32679]: pgmap v15455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:39.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:38 smithi092 ceph-mon[29156]: pgmap v15455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28154.830274 secs 2024-04-27T02:07:40.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27457.800022 secs 2024-04-27T02:07:40.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28154.830274 secs 2024-04-27T02:07:40.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27457.800022 secs 2024-04-27T02:07:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28154.830274 secs 2024-04-27T02:07:40.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27457.800022 secs 2024-04-27T02:07:41.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:40 smithi189 ceph-mon[32756]: pgmap v15456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:41.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:40 smithi156 ceph-mon[32679]: pgmap v15456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:41.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:40 smithi092 ceph-mon[29156]: pgmap v15456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:43.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:42 smithi189 ceph-mon[32756]: pgmap v15457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:43.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:42 smithi156 ceph-mon[32679]: pgmap v15457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:43.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:42 smithi092 ceph-mon[29156]: pgmap v15457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:44 smithi189 ceph-mon[32756]: pgmap v15458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28159.830343 secs 2024-04-27T02:07:45.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27462.800156 secs 2024-04-27T02:07:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:44 smithi156 ceph-mon[32679]: pgmap v15458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28159.830343 secs 2024-04-27T02:07:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27462.800156 secs 2024-04-27T02:07:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:44 smithi092 ceph-mon[29156]: pgmap v15458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28159.830343 secs 2024-04-27T02:07:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27462.800156 secs 2024-04-27T02:07:47.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:46 smithi189 ceph-mon[32756]: pgmap v15459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:47.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:46 smithi156 ceph-mon[32679]: pgmap v15459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:47.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:46 smithi092 ceph-mon[29156]: pgmap v15459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:49.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:48 smithi189 ceph-mon[32756]: pgmap v15460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:49.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:48 smithi156 ceph-mon[32679]: pgmap v15460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:49.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:48 smithi092 ceph-mon[29156]: pgmap v15460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28164.830480 secs 2024-04-27T02:07:50.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27467.800280 secs 2024-04-27T02:07:50.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28164.830480 secs 2024-04-27T02:07:50.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27467.800280 secs 2024-04-27T02:07:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28164.830480 secs 2024-04-27T02:07:50.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27467.800280 secs 2024-04-27T02:07:51.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:50 smithi189 ceph-mon[32756]: pgmap v15461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:51.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:50 smithi156 ceph-mon[32679]: pgmap v15461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:51.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:50 smithi092 ceph-mon[29156]: pgmap v15461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:53.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:52 smithi189 ceph-mon[32756]: pgmap v15462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:53.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:52 smithi156 ceph-mon[32679]: pgmap v15462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:53.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:52 smithi092 ceph-mon[29156]: pgmap v15462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:54 smithi189 ceph-mon[32756]: pgmap v15463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28169.830618 secs 2024-04-27T02:07:55.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27472.800401 secs 2024-04-27T02:07:55.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:54 smithi156 ceph-mon[32679]: pgmap v15463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:55.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28169.830618 secs 2024-04-27T02:07:55.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27472.800401 secs 2024-04-27T02:07:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:54 smithi092 ceph-mon[29156]: pgmap v15463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28169.830618 secs 2024-04-27T02:07:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27472.800401 secs 2024-04-27T02:07:57.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:56 smithi189 ceph-mon[32756]: pgmap v15464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:57.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:56 smithi156 ceph-mon[32679]: pgmap v15464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:57.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:56 smithi092 ceph-mon[29156]: pgmap v15464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:07:59.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:58 smithi189 ceph-mon[32756]: pgmap v15465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:59.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:58 smithi156 ceph-mon[32679]: pgmap v15465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:07:59.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:58 smithi092 ceph-mon[29156]: pgmap v15465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:00.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28174.830735 secs 2024-04-27T02:08:00.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:07:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27477.800542 secs 2024-04-27T02:08:00.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28174.830735 secs 2024-04-27T02:08:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:07:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27477.800542 secs 2024-04-27T02:08:00.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28174.830735 secs 2024-04-27T02:08:00.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:07:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27477.800542 secs 2024-04-27T02:08:01.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:00 smithi189 ceph-mon[32756]: pgmap v15466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:01.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:00 smithi156 ceph-mon[32679]: pgmap v15466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:01.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:00 smithi092 ceph-mon[29156]: pgmap v15466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:03.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:02 smithi189 ceph-mon[32756]: pgmap v15467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:03.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:02 smithi156 ceph-mon[32679]: pgmap v15467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:03.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:02 smithi092 ceph-mon[29156]: pgmap v15467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:05.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:04 smithi189 ceph-mon[32756]: pgmap v15468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:05.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28179.830852 secs 2024-04-27T02:08:05.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27482.800623 secs 2024-04-27T02:08:05.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:04 smithi156 ceph-mon[32679]: pgmap v15468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:05.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28179.830852 secs 2024-04-27T02:08:05.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27482.800623 secs 2024-04-27T02:08:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:04 smithi092 ceph-mon[29156]: pgmap v15468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28179.830852 secs 2024-04-27T02:08:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27482.800623 secs 2024-04-27T02:08:07.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:06 smithi189 ceph-mon[32756]: pgmap v15469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:07.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:06 smithi156 ceph-mon[32679]: pgmap v15469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:07.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:06 smithi092 ceph-mon[29156]: pgmap v15469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:09.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:08 smithi156 ceph-mon[32679]: pgmap v15470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:09.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:08 smithi092 ceph-mon[29156]: pgmap v15470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:09.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:08 smithi189 ceph-mon[32756]: pgmap v15470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:08:10.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28184.830917 secs 2024-04-27T02:08:10.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27487.800743 secs 2024-04-27T02:08:10.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28184.830917 secs 2024-04-27T02:08:10.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27487.800743 secs 2024-04-27T02:08:10.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28184.830917 secs 2024-04-27T02:08:10.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27487.800743 secs 2024-04-27T02:08:11.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:10 smithi156 ceph-mon[32679]: pgmap v15471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T02:08:11.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:10 smithi092 ceph-mon[29156]: pgmap v15471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T02:08:11.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:10 smithi189 ceph-mon[32756]: pgmap v15471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T02:08:13.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:12 smithi156 ceph-mon[32679]: pgmap v15472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:13.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:12 smithi092 ceph-mon[29156]: pgmap v15472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:13.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:12 smithi189 ceph-mon[32756]: pgmap v15472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:15.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:14 smithi156 ceph-mon[32679]: pgmap v15473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28189.831013 secs 2024-04-27T02:08:15.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27492.800822 secs 2024-04-27T02:08:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:14 smithi092 ceph-mon[29156]: pgmap v15473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28189.831013 secs 2024-04-27T02:08:15.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27492.800822 secs 2024-04-27T02:08:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:14 smithi189 ceph-mon[32756]: pgmap v15473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:15.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28189.831013 secs 2024-04-27T02:08:15.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27492.800822 secs 2024-04-27T02:08:17.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:16 smithi156 ceph-mon[32679]: pgmap v15474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:17.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:16 smithi092 ceph-mon[29156]: pgmap v15474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:17.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:16 smithi189 ceph-mon[32756]: pgmap v15474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:19.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:18 smithi156 ceph-mon[32679]: pgmap v15475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:19.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:18 smithi092 ceph-mon[29156]: pgmap v15475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:19.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:18 smithi189 ceph-mon[32756]: pgmap v15475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:08:20.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28194.831133 secs 2024-04-27T02:08:20.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27497.800945 secs 2024-04-27T02:08:20.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:08:20.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28194.831133 secs 2024-04-27T02:08:20.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27497.800945 secs 2024-04-27T02:08:20.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:08:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28194.831133 secs 2024-04-27T02:08:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27497.800945 secs 2024-04-27T02:08:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:08:21.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:20 smithi092 ceph-mon[29156]: pgmap v15476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:21.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:08:21.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:08:21.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:08:21.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:20 smithi156 ceph-mon[32679]: pgmap v15476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:21.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:08:21.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:08:21.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:08:21.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:20 smithi189 ceph-mon[32756]: pgmap v15476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:08:21.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:08:21.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:08:21.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:08:22.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:21 smithi156 ceph-mon[32679]: pgmap v15477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:22.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:21 smithi156 ceph-mon[32679]: pgmap v15478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:22.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:21 smithi092 ceph-mon[29156]: pgmap v15477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:22.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:21 smithi092 ceph-mon[29156]: pgmap v15478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:22.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:21 smithi189 ceph-mon[32756]: pgmap v15477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:22.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:21 smithi189 ceph-mon[32756]: pgmap v15478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:24.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:23 smithi156 ceph-mon[32679]: pgmap v15479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:24.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:23 smithi092 ceph-mon[29156]: pgmap v15479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:24.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:23 smithi189 ceph-mon[32756]: pgmap v15479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:08:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28199.831247 secs 2024-04-27T02:08:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27502.801090 secs 2024-04-27T02:08:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28199.831247 secs 2024-04-27T02:08:25.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27502.801090 secs 2024-04-27T02:08:25.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28199.831247 secs 2024-04-27T02:08:25.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27502.801090 secs 2024-04-27T02:08:26.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:25 smithi092 ceph-mon[29156]: pgmap v15480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:26.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:25 smithi189 ceph-mon[32756]: pgmap v15480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:26.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:25 smithi156 ceph-mon[32679]: pgmap v15480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:28.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:27 smithi092 ceph-mon[29156]: pgmap v15481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:28.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:27 smithi189 ceph-mon[32756]: pgmap v15481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:28.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:27 smithi156 ceph-mon[32679]: pgmap v15481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:08:30.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:29 smithi092 ceph-mon[29156]: pgmap v15482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:08:30.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28204.831383 secs 2024-04-27T02:08:30.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27507.801205 secs 2024-04-27T02:08:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:29 smithi189 ceph-mon[32756]: pgmap v15482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:08:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28204.831383 secs 2024-04-27T02:08:30.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27507.801205 secs 2024-04-27T02:08:30.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:29 smithi156 ceph-mon[32679]: pgmap v15482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:08:30.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28204.831383 secs 2024-04-27T02:08:30.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27507.801205 secs 2024-04-27T02:08:32.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:31 smithi092 ceph-mon[29156]: pgmap v15483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:32.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:31 smithi189 ceph-mon[32756]: pgmap v15483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:32.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:31 smithi156 ceph-mon[32679]: pgmap v15483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:08:34.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:33 smithi092 ceph-mon[29156]: pgmap v15484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:34.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:33 smithi189 ceph-mon[32756]: pgmap v15484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:34.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:33 smithi156 ceph-mon[32679]: pgmap v15484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:35.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28209.831504 secs 2024-04-27T02:08:35.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27512.801342 secs 2024-04-27T02:08:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28209.831504 secs 2024-04-27T02:08:35.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27512.801342 secs 2024-04-27T02:08:35.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28209.831504 secs 2024-04-27T02:08:35.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27512.801342 secs 2024-04-27T02:08:36.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:35 smithi092 ceph-mon[29156]: pgmap v15485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:36.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:35 smithi189 ceph-mon[32756]: pgmap v15485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:36.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:35 smithi156 ceph-mon[32679]: pgmap v15485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:38.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:37 smithi092 ceph-mon[29156]: pgmap v15486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:38.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:37 smithi189 ceph-mon[32756]: pgmap v15486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:38.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:37 smithi156 ceph-mon[32679]: pgmap v15486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:38.722 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:08:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:08:38.348+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:08:38.723 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:08:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:08:38.348+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:08:38.723 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:08:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:08:38.348+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:08:38.723 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:08:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:08:38.348+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:08:38.723 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:08:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:08:38.348+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:08:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:39 smithi092 ceph-mon[29156]: pgmap v15487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28214.831640 secs 2024-04-27T02:08:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27517.801449 secs 2024-04-27T02:08:40.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:39 smithi189 ceph-mon[32756]: pgmap v15487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28214.831640 secs 2024-04-27T02:08:40.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27517.801449 secs 2024-04-27T02:08:40.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:39 smithi156 ceph-mon[32679]: pgmap v15487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:40.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28214.831640 secs 2024-04-27T02:08:40.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27517.801449 secs 2024-04-27T02:08:42.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:41 smithi092 ceph-mon[29156]: pgmap v15488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:42.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:41 smithi189 ceph-mon[32756]: pgmap v15488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:42.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:41 smithi156 ceph-mon[32679]: pgmap v15488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:44.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:43 smithi156 ceph-mon[32679]: pgmap v15489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:44.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:43 smithi092 ceph-mon[29156]: pgmap v15489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:44.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:43 smithi189 ceph-mon[32756]: pgmap v15489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28219.831767 secs 2024-04-27T02:08:45.223 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27522.801518 secs 2024-04-27T02:08:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28219.831767 secs 2024-04-27T02:08:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27522.801518 secs 2024-04-27T02:08:45.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28219.831767 secs 2024-04-27T02:08:45.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27522.801518 secs 2024-04-27T02:08:46.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:45 smithi092 ceph-mon[29156]: pgmap v15490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:46.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:45 smithi189 ceph-mon[32756]: pgmap v15490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:46.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:45 smithi156 ceph-mon[32679]: pgmap v15490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:48.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:47 smithi092 ceph-mon[29156]: pgmap v15491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:48.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:47 smithi189 ceph-mon[32756]: pgmap v15491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:48.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:47 smithi156 ceph-mon[32679]: pgmap v15491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:49 smithi092 ceph-mon[29156]: pgmap v15492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28224.831881 secs 2024-04-27T02:08:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27527.801628 secs 2024-04-27T02:08:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:49 smithi189 ceph-mon[32756]: pgmap v15492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28224.831881 secs 2024-04-27T02:08:50.367 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27527.801628 secs 2024-04-27T02:08:50.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:49 smithi156 ceph-mon[32679]: pgmap v15492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:50.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28224.831881 secs 2024-04-27T02:08:50.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27527.801628 secs 2024-04-27T02:08:52.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:51 smithi092 ceph-mon[29156]: pgmap v15493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:52.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:51 smithi189 ceph-mon[32756]: pgmap v15493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:52.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:51 smithi156 ceph-mon[32679]: pgmap v15493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:54.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:53 smithi092 ceph-mon[29156]: pgmap v15494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:54.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:53 smithi189 ceph-mon[32756]: pgmap v15494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:54.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:53 smithi156 ceph-mon[32679]: pgmap v15494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:08:54.856+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:08:54.836 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:08:54.857+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:08:54.840 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:08:54.861+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:08:54.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:08:54.862+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 218 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:08:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28229.831985 secs 2024-04-27T02:08:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27532.801746 secs 2024-04-27T02:08:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28229.831985 secs 2024-04-27T02:08:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27532.801746 secs 2024-04-27T02:08:55.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28229.831985 secs 2024-04-27T02:08:55.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27532.801746 secs 2024-04-27T02:08:56.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:55 smithi189 ceph-mon[32756]: pgmap v15495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:56.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:55 smithi156 ceph-mon[32679]: pgmap v15495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:56.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:55 smithi092 ceph-mon[29156]: pgmap v15495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:08:57.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:57 smithi189 ceph-mon[32756]: pgmap v15496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:57.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:57 smithi156 ceph-mon[32679]: pgmap v15496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:57.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:57 smithi092 ceph-mon[29156]: pgmap v15496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:59.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:08:59 smithi189 ceph-mon[32756]: pgmap v15497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:59.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:08:59 smithi156 ceph-mon[32679]: pgmap v15497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:08:59.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:08:59 smithi092 ceph-mon[29156]: pgmap v15497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:00.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28234.832077 secs 2024-04-27T02:09:00.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27537.801864 secs 2024-04-27T02:09:00.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28234.832077 secs 2024-04-27T02:09:00.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27537.801864 secs 2024-04-27T02:09:00.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28234.832077 secs 2024-04-27T02:09:00.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27537.801864 secs 2024-04-27T02:09:01.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:01 smithi189 ceph-mon[32756]: pgmap v15498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:01.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:01 smithi156 ceph-mon[32679]: pgmap v15498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:01.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:01 smithi092 ceph-mon[29156]: pgmap v15498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:03.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:03 smithi189 ceph-mon[32756]: pgmap v15499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:03.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:03 smithi156 ceph-mon[32679]: pgmap v15499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:03.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:03 smithi092 ceph-mon[29156]: pgmap v15499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28239.832186 secs 2024-04-27T02:09:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27542.801937 secs 2024-04-27T02:09:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:05 smithi189 ceph-mon[32756]: pgmap v15500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:05.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28239.832186 secs 2024-04-27T02:09:05.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27542.801937 secs 2024-04-27T02:09:05.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:05 smithi156 ceph-mon[32679]: pgmap v15500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:05.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28239.832186 secs 2024-04-27T02:09:05.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27542.801937 secs 2024-04-27T02:09:05.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:05 smithi092 ceph-mon[29156]: pgmap v15500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:07.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:07 smithi189 ceph-mon[32756]: pgmap v15501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:07.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:07 smithi156 ceph-mon[32679]: pgmap v15501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:07.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:07 smithi092 ceph-mon[29156]: pgmap v15501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:09.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:09 smithi189 ceph-mon[32756]: pgmap v15502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:09.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:09 smithi156 ceph-mon[32679]: pgmap v15502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:09.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:09 smithi092 ceph-mon[29156]: pgmap v15502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:10.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28244.832302 secs 2024-04-27T02:09:10.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27547.802053 secs 2024-04-27T02:09:10.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28244.832302 secs 2024-04-27T02:09:10.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27547.802053 secs 2024-04-27T02:09:10.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28244.832302 secs 2024-04-27T02:09:10.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27547.802053 secs 2024-04-27T02:09:11.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:11 smithi189 ceph-mon[32756]: pgmap v15503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:11.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:11 smithi156 ceph-mon[32679]: pgmap v15503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:11.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:11 smithi092 ceph-mon[29156]: pgmap v15503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:13.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:13 smithi156 ceph-mon[32679]: pgmap v15504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:13.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:13 smithi092 ceph-mon[29156]: pgmap v15504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:13.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:13 smithi189 ceph-mon[32756]: pgmap v15504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:15.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28249.832380 secs 2024-04-27T02:09:15.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27552.802187 secs 2024-04-27T02:09:15.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:15 smithi156 ceph-mon[32679]: pgmap v15505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:15.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28249.832380 secs 2024-04-27T02:09:15.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27552.802187 secs 2024-04-27T02:09:15.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:15 smithi092 ceph-mon[29156]: pgmap v15505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:15.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28249.832380 secs 2024-04-27T02:09:15.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27552.802187 secs 2024-04-27T02:09:15.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:15 smithi189 ceph-mon[32756]: pgmap v15505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:17.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:17 smithi156 ceph-mon[32679]: pgmap v15506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:17.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:17 smithi092 ceph-mon[29156]: pgmap v15506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:17.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:17 smithi189 ceph-mon[32756]: pgmap v15506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:19.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:19 smithi156 ceph-mon[32679]: pgmap v15507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:19.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:19 smithi092 ceph-mon[29156]: pgmap v15507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:19.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:19 smithi189 ceph-mon[32756]: pgmap v15507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:20.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28254.832492 secs 2024-04-27T02:09:20.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27557.802279 secs 2024-04-27T02:09:20.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:09:20.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28254.832492 secs 2024-04-27T02:09:20.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27557.802279 secs 2024-04-27T02:09:20.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:09:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28254.832492 secs 2024-04-27T02:09:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27557.802279 secs 2024-04-27T02:09:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:09:21.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:21 smithi156 ceph-mon[32679]: pgmap v15508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:21.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:09:21.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:09:21.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:09:21.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:21 smithi092 ceph-mon[29156]: pgmap v15508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:21.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:09:21.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:09:21.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:09:21.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:21 smithi189 ceph-mon[32756]: pgmap v15508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:21.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:09:21.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:09:21.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:09:22.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:22 smithi156 ceph-mon[32679]: pgmap v15509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:09:22.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:22 smithi156 ceph-mon[32679]: pgmap v15510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:22.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:22 smithi092 ceph-mon[29156]: pgmap v15509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:09:22.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:22 smithi092 ceph-mon[29156]: pgmap v15510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:22.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:22 smithi189 ceph-mon[32756]: pgmap v15509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:09:22.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:22 smithi189 ceph-mon[32756]: pgmap v15510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:24.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:24 smithi156 ceph-mon[32679]: pgmap v15511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:09:24.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:24 smithi092 ceph-mon[29156]: pgmap v15511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:09:24.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:24 smithi189 ceph-mon[32756]: pgmap v15511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:09:25.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28259.832579 secs 2024-04-27T02:09:25.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27562.802373 secs 2024-04-27T02:09:25.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28259.832579 secs 2024-04-27T02:09:25.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27562.802373 secs 2024-04-27T02:09:25.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28259.832579 secs 2024-04-27T02:09:25.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27562.802373 secs 2024-04-27T02:09:26.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:26 smithi156 ceph-mon[32679]: pgmap v15512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:26.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:26 smithi092 ceph-mon[29156]: pgmap v15512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:26.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:26 smithi189 ceph-mon[32756]: pgmap v15512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:28.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:28 smithi156 ceph-mon[32679]: pgmap v15513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:28.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:28 smithi092 ceph-mon[29156]: pgmap v15513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:28.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:28 smithi189 ceph-mon[32756]: pgmap v15513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:29.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27567.802466 secs 2024-04-27T02:09:29.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27567.802466 secs 2024-04-27T02:09:29.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27567.802466 secs 2024-04-27T02:09:30.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28264.832698 secs 2024-04-27T02:09:30.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:30 smithi092 ceph-mon[29156]: pgmap v15514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:30.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28264.832698 secs 2024-04-27T02:09:30.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:30 smithi189 ceph-mon[32756]: pgmap v15514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:30.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28264.832698 secs 2024-04-27T02:09:30.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:30 smithi156 ceph-mon[32679]: pgmap v15514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:09:32.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:32 smithi092 ceph-mon[29156]: pgmap v15515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:09:32.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:32 smithi189 ceph-mon[32756]: pgmap v15515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:09:32.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:32 smithi156 ceph-mon[32679]: pgmap v15515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:09:34.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:34 smithi092 ceph-mon[29156]: pgmap v15516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:34.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27572.802579 secs 2024-04-27T02:09:34.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:34 smithi189 ceph-mon[32756]: pgmap v15516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:34.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27572.802579 secs 2024-04-27T02:09:34.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:34 smithi156 ceph-mon[32679]: pgmap v15516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:34.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27572.802579 secs 2024-04-27T02:09:35.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28269.832845 secs 2024-04-27T02:09:35.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28269.832845 secs 2024-04-27T02:09:35.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28269.832845 secs 2024-04-27T02:09:36.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:36 smithi092 ceph-mon[29156]: pgmap v15517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:36.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:36 smithi189 ceph-mon[32756]: pgmap v15517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:36.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:36 smithi156 ceph-mon[32679]: pgmap v15517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:38.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:38 smithi092 ceph-mon[29156]: pgmap v15518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:38.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:38 smithi189 ceph-mon[32756]: pgmap v15518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:38.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:38 smithi156 ceph-mon[32679]: pgmap v15518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:39.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27577.802659 secs 2024-04-27T02:09:39.841 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:09:39.863+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:09:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:09:39.864+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:09:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:09:39.868+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:09:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:09:39.868+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 219 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:09:39.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27577.802659 secs 2024-04-27T02:09:39.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27577.802659 secs 2024-04-27T02:09:40.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:40 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 28274.832964 secs 2024-04-27T02:09:40.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:40 smithi092 ceph-mon[29156]: slow request 2881.175734 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:09:40.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:40 smithi092 ceph-mon[29156]: pgmap v15519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:40.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:40 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 28274.832964 secs 2024-04-27T02:09:40.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:40 smithi189 ceph-mon[32756]: slow request 2881.175734 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:09:40.768 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:40 smithi189 ceph-mon[32756]: pgmap v15519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:40.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:40 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 28274.832964 secs 2024-04-27T02:09:40.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:40 smithi156 ceph-mon[32679]: slow request 2881.175734 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:09:40.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:40 smithi156 ceph-mon[32679]: pgmap v15519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:42.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:42 smithi092 ceph-mon[29156]: pgmap v15520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:42.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:42 smithi189 ceph-mon[32756]: pgmap v15520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:42.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:42 smithi156 ceph-mon[32679]: pgmap v15520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:44.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:44 smithi092 ceph-mon[29156]: pgmap v15521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:44.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27582.802722 secs 2024-04-27T02:09:44.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:44 smithi189 ceph-mon[32756]: pgmap v15521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:44.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27582.802722 secs 2024-04-27T02:09:44.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:44 smithi156 ceph-mon[32679]: pgmap v15521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:44.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27582.802722 secs 2024-04-27T02:09:45.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28279.833075 secs 2024-04-27T02:09:45.813 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28279.833075 secs 2024-04-27T02:09:45.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28279.833075 secs 2024-04-27T02:09:46.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:46 smithi092 ceph-mon[29156]: pgmap v15522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:46.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:46 smithi189 ceph-mon[32756]: pgmap v15522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:46.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:46 smithi156 ceph-mon[32679]: pgmap v15522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:48.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:48 smithi092 ceph-mon[29156]: pgmap v15523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:48.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:48 smithi189 ceph-mon[32756]: pgmap v15523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:48.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:48 smithi156 ceph-mon[32679]: pgmap v15523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:49.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27587.802847 secs 2024-04-27T02:09:49.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27587.802847 secs 2024-04-27T02:09:49.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27587.802847 secs 2024-04-27T02:09:50.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28284.833168 secs 2024-04-27T02:09:50.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:50 smithi092 ceph-mon[29156]: pgmap v15524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:50.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28284.833168 secs 2024-04-27T02:09:50.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:50 smithi189 ceph-mon[32756]: pgmap v15524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:50.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28284.833168 secs 2024-04-27T02:09:50.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:50 smithi156 ceph-mon[32679]: pgmap v15524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:52.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:52 smithi092 ceph-mon[29156]: pgmap v15525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:52.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:52 smithi189 ceph-mon[32756]: pgmap v15525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:52.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:52 smithi156 ceph-mon[32679]: pgmap v15525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:54.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:54 smithi092 ceph-mon[29156]: pgmap v15526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:54.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27592.802950 secs 2024-04-27T02:09:54.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:54 smithi189 ceph-mon[32756]: pgmap v15526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:54.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27592.802950 secs 2024-04-27T02:09:54.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:54 smithi156 ceph-mon[32679]: pgmap v15526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:54.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27592.802950 secs 2024-04-27T02:09:55.722 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28289.833281 secs 2024-04-27T02:09:55.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28289.833281 secs 2024-04-27T02:09:55.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28289.833281 secs 2024-04-27T02:09:56.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:56 smithi189 ceph-mon[32756]: pgmap v15527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:56.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:56 smithi156 ceph-mon[32679]: pgmap v15527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:56.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:56 smithi092 ceph-mon[29156]: pgmap v15527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:09:58.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:58 smithi189 ceph-mon[32756]: pgmap v15528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:58.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:58 smithi156 ceph-mon[32679]: pgmap v15528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:58.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:58 smithi092 ceph-mon[29156]: pgmap v15528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:09:59.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:09:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27597.803059 secs 2024-04-27T02:09:59.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:09:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27597.803059 secs 2024-04-27T02:09:59.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:09:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27597.803059 secs 2024-04-27T02:10:00.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28294.833402 secs 2024-04-27T02:10:00.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:00 smithi189 ceph-mon[32756]: pgmap v15529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:00.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:10:00.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28294.833402 secs 2024-04-27T02:10:00.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:00 smithi156 ceph-mon[32679]: pgmap v15529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:00.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:10:00.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28294.833402 secs 2024-04-27T02:10:00.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:00 smithi092 ceph-mon[29156]: pgmap v15529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:00.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:10:02.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:02 smithi189 ceph-mon[32756]: pgmap v15530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:02.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:02 smithi156 ceph-mon[32679]: pgmap v15530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:02.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:02 smithi092 ceph-mon[29156]: pgmap v15530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:04.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:04 smithi189 ceph-mon[32756]: pgmap v15531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:04.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28299.833537 secs 2024-04-27T02:10:04.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27602.803168 secs 2024-04-27T02:10:04.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:04 smithi156 ceph-mon[32679]: pgmap v15531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:04.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28299.833537 secs 2024-04-27T02:10:04.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27602.803168 secs 2024-04-27T02:10:04.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:04 smithi092 ceph-mon[29156]: pgmap v15531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:04.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28299.833537 secs 2024-04-27T02:10:04.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27602.803168 secs 2024-04-27T02:10:06.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:06 smithi189 ceph-mon[32756]: pgmap v15532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:06.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:06 smithi156 ceph-mon[32679]: pgmap v15532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:06.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:06 smithi092 ceph-mon[29156]: pgmap v15532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:08.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:08 smithi189 ceph-mon[32756]: pgmap v15533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:08.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:08 smithi156 ceph-mon[32679]: pgmap v15533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:08.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:08 smithi092 ceph-mon[29156]: pgmap v15533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:09.831 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28304.833676 secs 2024-04-27T02:10:09.831 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27607.803330 secs 2024-04-27T02:10:09.831 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:09 smithi092 ceph-mon[29156]: slow request 720.768414 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:09.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28304.833676 secs 2024-04-27T02:10:09.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27607.803330 secs 2024-04-27T02:10:09.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:09 smithi189 ceph-mon[32756]: slow request 720.768414 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:09.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28304.833676 secs 2024-04-27T02:10:09.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27607.803330 secs 2024-04-27T02:10:09.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:09 smithi156 ceph-mon[32679]: slow request 720.768414 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:10.767 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:10 smithi189 ceph-mon[32756]: pgmap v15534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:10.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:10 smithi156 ceph-mon[32679]: pgmap v15534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:10.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:10 smithi092 ceph-mon[29156]: pgmap v15534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:12.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:12 smithi189 ceph-mon[32756]: pgmap v15535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:12.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:12 smithi156 ceph-mon[32679]: pgmap v15535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:12.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:12 smithi092 ceph-mon[29156]: pgmap v15535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:14.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:14 smithi189 ceph-mon[32756]: pgmap v15536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:14.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28309.833793 secs 2024-04-27T02:10:14.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27612.803391 secs 2024-04-27T02:10:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:14 smithi156 ceph-mon[32679]: pgmap v15536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28309.833793 secs 2024-04-27T02:10:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27612.803391 secs 2024-04-27T02:10:14.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:14 smithi092 ceph-mon[29156]: pgmap v15536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:14.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28309.833793 secs 2024-04-27T02:10:14.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27612.803391 secs 2024-04-27T02:10:16.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:16 smithi189 ceph-mon[32756]: pgmap v15537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:16.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:16 smithi156 ceph-mon[32679]: pgmap v15537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:16.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:16 smithi092 ceph-mon[29156]: pgmap v15537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:18.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:18 smithi189 ceph-mon[32756]: pgmap v15538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:18.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:18 smithi156 ceph-mon[32679]: pgmap v15538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:18.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:18 smithi092 ceph-mon[29156]: pgmap v15538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:19.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28314.833902 secs 2024-04-27T02:10:19.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27617.803533 secs 2024-04-27T02:10:19.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28314.833902 secs 2024-04-27T02:10:19.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27617.803533 secs 2024-04-27T02:10:19.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28314.833902 secs 2024-04-27T02:10:19.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27617.803533 secs 2024-04-27T02:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:20 smithi189 ceph-mon[32756]: pgmap v15539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:20.873 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:20 smithi092 ceph-mon[29156]: pgmap v15539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:20.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:20 smithi156 ceph-mon[32679]: pgmap v15539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:21.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:10:21.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:10:21.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:10:22.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: pgmap v15540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:22.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: pgmap v15540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: pgmap v15540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.978 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:22.979 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: pgmap v15541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28319.833990 secs 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27622.803598 secs 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: pgmap v15541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:25.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28319.833990 secs 2024-04-27T02:10:25.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27622.803598 secs 2024-04-27T02:10:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: pgmap v15541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28319.833990 secs 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27622.803598 secs 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.972 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:10:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:10:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:25.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:10:25.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:10:25.977 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:10:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:10:26.118 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:10:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:10:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:10:26.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:10:27.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:10:27.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: pgmap v15542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:27.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:10:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: pgmap v15543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:27.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:26 smithi189 ceph-mon[32756]: pgmap v15544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: pgmap v15542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: pgmap v15543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:27.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:26 smithi156 ceph-mon[32679]: pgmap v15544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: pgmap v15542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: pgmap v15543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:27.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:26 smithi092 ceph-mon[29156]: pgmap v15544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:29.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:28 smithi189 ceph-mon[32756]: pgmap v15545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:29.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:28 smithi156 ceph-mon[32679]: pgmap v15545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:29.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:28 smithi092 ceph-mon[29156]: pgmap v15545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:30.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28324.834105 secs 2024-04-27T02:10:30.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27627.803708 secs 2024-04-27T02:10:30.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28324.834105 secs 2024-04-27T02:10:30.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27627.803708 secs 2024-04-27T02:10:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28324.834105 secs 2024-04-27T02:10:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27627.803708 secs 2024-04-27T02:10:31.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:30 smithi156 ceph-mon[32679]: pgmap v15546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:31.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:30 smithi092 ceph-mon[29156]: pgmap v15546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:31.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:30 smithi189 ceph-mon[32756]: pgmap v15546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:33.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:32 smithi156 ceph-mon[32679]: pgmap v15547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:33.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:32 smithi092 ceph-mon[29156]: pgmap v15547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:33.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:32 smithi189 ceph-mon[32756]: pgmap v15547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:35.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:34 smithi156 ceph-mon[32679]: pgmap v15548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:35.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28329.834209 secs 2024-04-27T02:10:35.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27632.803825 secs 2024-04-27T02:10:35.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:34 smithi092 ceph-mon[29156]: pgmap v15548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:35.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28329.834209 secs 2024-04-27T02:10:35.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27632.803825 secs 2024-04-27T02:10:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:34 smithi189 ceph-mon[32756]: pgmap v15548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:10:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28329.834209 secs 2024-04-27T02:10:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27632.803825 secs 2024-04-27T02:10:37.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:36 smithi156 ceph-mon[32679]: pgmap v15549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:37.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:36 smithi092 ceph-mon[29156]: pgmap v15549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:37.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:36 smithi189 ceph-mon[32756]: pgmap v15549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:10:39.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:38 smithi156 ceph-mon[32679]: pgmap v15550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:39.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:38 smithi092 ceph-mon[29156]: pgmap v15550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:39.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:38 smithi189 ceph-mon[32756]: pgmap v15550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:40.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28334.834305 secs 2024-04-27T02:10:40.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:39 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27637.803891 secs 2024-04-27T02:10:40.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:39 smithi156 ceph-mon[32679]: slow request 5762.196053 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28334.834305 secs 2024-04-27T02:10:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:39 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27637.803891 secs 2024-04-27T02:10:40.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:39 smithi092 ceph-mon[29156]: slow request 5762.196053 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:40.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28334.834305 secs 2024-04-27T02:10:40.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:39 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27637.803891 secs 2024-04-27T02:10:40.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:39 smithi189 ceph-mon[32756]: slow request 5762.196053 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:10:41.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:40 smithi156 ceph-mon[32679]: pgmap v15551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:41.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:40 smithi092 ceph-mon[29156]: pgmap v15551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:41.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:40 smithi189 ceph-mon[32756]: pgmap v15551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:43.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:42 smithi156 ceph-mon[32679]: pgmap v15552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:43.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:42 smithi092 ceph-mon[29156]: pgmap v15552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:43.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:42 smithi189 ceph-mon[32756]: pgmap v15552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:44 smithi156 ceph-mon[32679]: pgmap v15553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28339.834421 secs 2024-04-27T02:10:45.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27642.804006 secs 2024-04-27T02:10:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:44 smithi092 ceph-mon[29156]: pgmap v15553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28339.834421 secs 2024-04-27T02:10:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27642.804006 secs 2024-04-27T02:10:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:44 smithi189 ceph-mon[32756]: pgmap v15553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28339.834421 secs 2024-04-27T02:10:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27642.804006 secs 2024-04-27T02:10:47.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:46 smithi156 ceph-mon[32679]: pgmap v15554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:47.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:46 smithi092 ceph-mon[29156]: pgmap v15554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:47.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:46 smithi189 ceph-mon[32756]: pgmap v15554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:49.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:48 smithi156 ceph-mon[32679]: pgmap v15555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:49.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:48 smithi092 ceph-mon[29156]: pgmap v15555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:49.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:48 smithi189 ceph-mon[32756]: pgmap v15555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:50.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28344.834571 secs 2024-04-27T02:10:50.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27647.804124 secs 2024-04-27T02:10:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28344.834571 secs 2024-04-27T02:10:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27647.804124 secs 2024-04-27T02:10:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28344.834571 secs 2024-04-27T02:10:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27647.804124 secs 2024-04-27T02:10:51.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:50 smithi156 ceph-mon[32679]: pgmap v15556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:51.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:50 smithi092 ceph-mon[29156]: pgmap v15556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:51.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:50 smithi189 ceph-mon[32756]: pgmap v15556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:53.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:52 smithi156 ceph-mon[32679]: pgmap v15557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:53.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:52 smithi092 ceph-mon[29156]: pgmap v15557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:53.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:52 smithi189 ceph-mon[32756]: pgmap v15557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:54 smithi092 ceph-mon[29156]: pgmap v15558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28349.834703 secs 2024-04-27T02:10:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27652.804245 secs 2024-04-27T02:10:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:54 smithi189 ceph-mon[32756]: pgmap v15558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28349.834703 secs 2024-04-27T02:10:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27652.804245 secs 2024-04-27T02:10:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:54 smithi156 ceph-mon[32679]: pgmap v15558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28349.834703 secs 2024-04-27T02:10:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27652.804245 secs 2024-04-27T02:10:57.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:56 smithi092 ceph-mon[29156]: pgmap v15559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:57.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:56 smithi189 ceph-mon[32756]: pgmap v15559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:57.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:56 smithi156 ceph-mon[32679]: pgmap v15559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:10:59.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:58 smithi092 ceph-mon[29156]: pgmap v15560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:59.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:58 smithi189 ceph-mon[32756]: pgmap v15560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:10:59.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:58 smithi156 ceph-mon[32679]: pgmap v15560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28354.834813 secs 2024-04-27T02:11:00.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:10:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27657.804368 secs 2024-04-27T02:11:00.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28354.834813 secs 2024-04-27T02:11:00.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:10:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27657.804368 secs 2024-04-27T02:11:00.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28354.834813 secs 2024-04-27T02:11:00.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:10:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27657.804368 secs 2024-04-27T02:11:01.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:00 smithi092 ceph-mon[29156]: pgmap v15561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:01.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:00 smithi189 ceph-mon[32756]: pgmap v15561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:01.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:00 smithi156 ceph-mon[32679]: pgmap v15561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:03.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:02 smithi092 ceph-mon[29156]: pgmap v15562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:03.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:02 smithi189 ceph-mon[32756]: pgmap v15562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:03.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:02 smithi156 ceph-mon[32679]: pgmap v15562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:04 smithi092 ceph-mon[29156]: pgmap v15563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28359.834918 secs 2024-04-27T02:11:05.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27662.804486 secs 2024-04-27T02:11:05.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:04 smithi189 ceph-mon[32756]: pgmap v15563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:05.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28359.834918 secs 2024-04-27T02:11:05.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27662.804486 secs 2024-04-27T02:11:05.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:04 smithi156 ceph-mon[32679]: pgmap v15563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:05.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28359.834918 secs 2024-04-27T02:11:05.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27662.804486 secs 2024-04-27T02:11:07.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:06 smithi092 ceph-mon[29156]: pgmap v15564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:07.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:06 smithi189 ceph-mon[32756]: pgmap v15564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:07.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:06 smithi156 ceph-mon[32679]: pgmap v15564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:09.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:08 smithi092 ceph-mon[29156]: pgmap v15565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:09.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:08 smithi189 ceph-mon[32756]: pgmap v15565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:09.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:08 smithi156 ceph-mon[32679]: pgmap v15565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:10.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28364.835029 secs 2024-04-27T02:11:10.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27667.804625 secs 2024-04-27T02:11:10.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28364.835029 secs 2024-04-27T02:11:10.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27667.804625 secs 2024-04-27T02:11:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28364.835029 secs 2024-04-27T02:11:10.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27667.804625 secs 2024-04-27T02:11:11.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:10 smithi092 ceph-mon[29156]: pgmap v15566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:11.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:10 smithi189 ceph-mon[32756]: pgmap v15566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:11.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:10 smithi156 ceph-mon[32679]: pgmap v15566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:13.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:12 smithi092 ceph-mon[29156]: pgmap v15567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:13.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:12 smithi189 ceph-mon[32756]: pgmap v15567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:13.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:12 smithi156 ceph-mon[32679]: pgmap v15567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:14 smithi092 ceph-mon[29156]: pgmap v15568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28369.835111 secs 2024-04-27T02:11:15.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27672.804761 secs 2024-04-27T02:11:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:14 smithi189 ceph-mon[32756]: pgmap v15568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28369.835111 secs 2024-04-27T02:11:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27672.804761 secs 2024-04-27T02:11:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:14 smithi156 ceph-mon[32679]: pgmap v15568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:15.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28369.835111 secs 2024-04-27T02:11:15.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27672.804761 secs 2024-04-27T02:11:17.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:16 smithi156 ceph-mon[32679]: pgmap v15569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:17.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:16 smithi092 ceph-mon[29156]: pgmap v15569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:17.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:16 smithi189 ceph-mon[32756]: pgmap v15569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:19.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:18 smithi092 ceph-mon[29156]: pgmap v15570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:19.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:18 smithi189 ceph-mon[32756]: pgmap v15570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:19.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:18 smithi156 ceph-mon[32679]: pgmap v15570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:20.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28374.835230 secs 2024-04-27T02:11:20.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27677.804898 secs 2024-04-27T02:11:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28374.835230 secs 2024-04-27T02:11:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27677.804898 secs 2024-04-27T02:11:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28374.835230 secs 2024-04-27T02:11:20.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27677.804898 secs 2024-04-27T02:11:21.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:20 smithi092 ceph-mon[29156]: pgmap v15571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:21.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:20 smithi189 ceph-mon[32756]: pgmap v15571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:21.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:20 smithi156 ceph-mon[32679]: pgmap v15571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:23.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:22 smithi092 ceph-mon[29156]: pgmap v15572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:23.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:22 smithi189 ceph-mon[32756]: pgmap v15572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:23.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:22 smithi156 ceph-mon[32679]: pgmap v15572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:24 smithi189 ceph-mon[32756]: pgmap v15573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28379.835375 secs 2024-04-27T02:11:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27682.805006 secs 2024-04-27T02:11:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:24 smithi156 ceph-mon[32679]: pgmap v15573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28379.835375 secs 2024-04-27T02:11:25.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27682.805006 secs 2024-04-27T02:11:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:24 smithi092 ceph-mon[29156]: pgmap v15573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:25.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28379.835375 secs 2024-04-27T02:11:25.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27682.805006 secs 2024-04-27T02:11:26.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:11:26.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:11:26.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:11:26.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:11:26.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:11:26.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:11:26.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:11:26.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:11:26.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:11:26.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:11:26.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:11:26.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:11:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:27 smithi189 ceph-mon[32756]: pgmap v15574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:27 smithi189 ceph-mon[32756]: pgmap v15575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:11:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:27 smithi189 ceph-mon[32756]: pgmap v15576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:27 smithi156 ceph-mon[32679]: pgmap v15574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:27.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:27 smithi156 ceph-mon[32679]: pgmap v15575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:11:27.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:27 smithi156 ceph-mon[32679]: pgmap v15576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:27 smithi092 ceph-mon[29156]: pgmap v15574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:27.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:27 smithi092 ceph-mon[29156]: pgmap v15575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:11:27.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:27 smithi092 ceph-mon[29156]: pgmap v15576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:29.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:29 smithi189 ceph-mon[32756]: pgmap v15577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:11:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:29 smithi156 ceph-mon[32679]: pgmap v15577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:11:29.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:29 smithi092 ceph-mon[29156]: pgmap v15577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:11:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28384.835518 secs 2024-04-27T02:11:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27687.805110 secs 2024-04-27T02:11:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28384.835518 secs 2024-04-27T02:11:30.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27687.805110 secs 2024-04-27T02:11:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28384.835518 secs 2024-04-27T02:11:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27687.805110 secs 2024-04-27T02:11:31.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:31 smithi189 ceph-mon[32756]: pgmap v15578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:31.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:31 smithi156 ceph-mon[32679]: pgmap v15578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:31.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:31 smithi092 ceph-mon[29156]: pgmap v15578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:33.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:33 smithi189 ceph-mon[32756]: pgmap v15579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:33.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:33 smithi156 ceph-mon[32679]: pgmap v15579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:33.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:33 smithi092 ceph-mon[29156]: pgmap v15579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28389.835636 secs 2024-04-27T02:11:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:35 smithi189 ceph-mon[32756]: pgmap v15580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:35.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27692.805242 secs 2024-04-27T02:11:35.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28389.835636 secs 2024-04-27T02:11:35.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:35 smithi156 ceph-mon[32679]: pgmap v15580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:35.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27692.805242 secs 2024-04-27T02:11:35.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28389.835636 secs 2024-04-27T02:11:35.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:35 smithi092 ceph-mon[29156]: pgmap v15580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:11:35.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27692.805242 secs 2024-04-27T02:11:37.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:37 smithi189 ceph-mon[32756]: pgmap v15581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:11:37.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:37 smithi156 ceph-mon[32679]: pgmap v15581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:11:37.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:37 smithi092 ceph-mon[29156]: pgmap v15581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:11:39.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:39 smithi189 ceph-mon[32756]: pgmap v15582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:39.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:39 smithi156 ceph-mon[32679]: pgmap v15582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:39.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:39 smithi092 ceph-mon[29156]: pgmap v15582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:40.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28394.835733 secs 2024-04-27T02:11:40.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27697.805374 secs 2024-04-27T02:11:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28394.835733 secs 2024-04-27T02:11:40.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27697.805374 secs 2024-04-27T02:11:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28394.835733 secs 2024-04-27T02:11:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27697.805374 secs 2024-04-27T02:11:41.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:41 smithi189 ceph-mon[32756]: pgmap v15583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:41.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:41 smithi156 ceph-mon[32679]: pgmap v15583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:41.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:41 smithi092 ceph-mon[29156]: pgmap v15583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:42.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:42 smithi189 ceph-mon[32756]: pgmap v15584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:42.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:42 smithi156 ceph-mon[32679]: pgmap v15584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:42.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:42 smithi092 ceph-mon[29156]: pgmap v15584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28399.835850 secs 2024-04-27T02:11:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:44 smithi092 ceph-mon[29156]: pgmap v15585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:45.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27702.805492 secs 2024-04-27T02:11:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28399.835850 secs 2024-04-27T02:11:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:44 smithi189 ceph-mon[32756]: pgmap v15585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:45.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27702.805492 secs 2024-04-27T02:11:45.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28399.835850 secs 2024-04-27T02:11:45.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:44 smithi156 ceph-mon[32679]: pgmap v15585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:45.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27702.805492 secs 2024-04-27T02:11:47.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:46 smithi156 ceph-mon[32679]: pgmap v15586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:47.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:46 smithi092 ceph-mon[29156]: pgmap v15586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:47.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:46 smithi189 ceph-mon[32756]: pgmap v15586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:49.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:48 smithi092 ceph-mon[29156]: pgmap v15587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:49.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:48 smithi189 ceph-mon[32756]: pgmap v15587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:49.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:48 smithi156 ceph-mon[32679]: pgmap v15587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:50.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28404.835929 secs 2024-04-27T02:11:50.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27707.805558 secs 2024-04-27T02:11:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28404.835929 secs 2024-04-27T02:11:50.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27707.805558 secs 2024-04-27T02:11:50.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28404.835929 secs 2024-04-27T02:11:50.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27707.805558 secs 2024-04-27T02:11:51.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:50 smithi092 ceph-mon[29156]: pgmap v15588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:51.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:50 smithi189 ceph-mon[32756]: pgmap v15588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:51.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:50 smithi156 ceph-mon[32679]: pgmap v15588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:53.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:52 smithi092 ceph-mon[29156]: pgmap v15589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:53.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:52 smithi189 ceph-mon[32756]: pgmap v15589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:53.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:52 smithi156 ceph-mon[32679]: pgmap v15589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28409.836044 secs 2024-04-27T02:11:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:54 smithi092 ceph-mon[29156]: pgmap v15590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:55.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27712.805696 secs 2024-04-27T02:11:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28409.836044 secs 2024-04-27T02:11:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:54 smithi189 ceph-mon[32756]: pgmap v15590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27712.805696 secs 2024-04-27T02:11:55.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28409.836044 secs 2024-04-27T02:11:55.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:54 smithi156 ceph-mon[32679]: pgmap v15590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:11:55.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27712.805696 secs 2024-04-27T02:11:57.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:56 smithi092 ceph-mon[29156]: pgmap v15591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:57.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:56 smithi189 ceph-mon[32756]: pgmap v15591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:57.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:56 smithi156 ceph-mon[32679]: pgmap v15591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:59.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:58 smithi092 ceph-mon[29156]: pgmap v15592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:59.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:58 smithi189 ceph-mon[32756]: pgmap v15592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:11:59.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:58 smithi156 ceph-mon[32679]: pgmap v15592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28414.836125 secs 2024-04-27T02:12:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:11:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27717.805812 secs 2024-04-27T02:12:00.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28414.836125 secs 2024-04-27T02:12:00.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:11:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27717.805812 secs 2024-04-27T02:12:00.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28414.836125 secs 2024-04-27T02:12:00.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:11:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27717.805812 secs 2024-04-27T02:12:01.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:00 smithi092 ceph-mon[29156]: pgmap v15593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:01.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:00 smithi189 ceph-mon[32756]: pgmap v15593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:01.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:00 smithi156 ceph-mon[32679]: pgmap v15593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:03.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:02 smithi092 ceph-mon[29156]: pgmap v15594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:03.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:02 smithi189 ceph-mon[32756]: pgmap v15594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:03.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:02 smithi156 ceph-mon[32679]: pgmap v15594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28419.836190 secs 2024-04-27T02:12:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:04 smithi092 ceph-mon[29156]: pgmap v15595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27722.805929 secs 2024-04-27T02:12:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28419.836190 secs 2024-04-27T02:12:05.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:04 smithi189 ceph-mon[32756]: pgmap v15595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:05.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27722.805929 secs 2024-04-27T02:12:05.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28419.836190 secs 2024-04-27T02:12:05.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:04 smithi156 ceph-mon[32679]: pgmap v15595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:05.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27722.805929 secs 2024-04-27T02:12:07.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:06 smithi092 ceph-mon[29156]: pgmap v15596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:07.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:06 smithi189 ceph-mon[32756]: pgmap v15596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:07.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:06 smithi156 ceph-mon[32679]: pgmap v15596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:09.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:08 smithi092 ceph-mon[29156]: pgmap v15597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:09.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:08 smithi189 ceph-mon[32756]: pgmap v15597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:09.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:08 smithi156 ceph-mon[32679]: pgmap v15597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:10.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:09 smithi189 ceph-mon[32756]: 12 slow requests, 1 included below; oldest blocked for > 28424.836302 secs 2024-04-27T02:12:10.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:09 smithi189 ceph-mon[32756]: slow request 1440.761167 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:12:10.268 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27727.806002 secs 2024-04-27T02:12:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:09 smithi156 ceph-mon[32679]: 12 slow requests, 1 included below; oldest blocked for > 28424.836302 secs 2024-04-27T02:12:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:09 smithi156 ceph-mon[32679]: slow request 1440.761167 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:12:10.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27727.806002 secs 2024-04-27T02:12:10.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:09 smithi092 ceph-mon[29156]: 12 slow requests, 1 included below; oldest blocked for > 28424.836302 secs 2024-04-27T02:12:10.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:09 smithi092 ceph-mon[29156]: slow request 1440.761167 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:12:10.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27727.806002 secs 2024-04-27T02:12:11.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:10 smithi189 ceph-mon[32756]: pgmap v15598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:11.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:10 smithi156 ceph-mon[32679]: pgmap v15598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:11.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:10 smithi092 ceph-mon[29156]: pgmap v15598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:13.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:12 smithi189 ceph-mon[32756]: pgmap v15599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:13.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:12 smithi156 ceph-mon[32679]: pgmap v15599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:13.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:12 smithi092 ceph-mon[29156]: pgmap v15599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28429.836422 secs 2024-04-27T02:12:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:15 smithi189 ceph-mon[32756]: pgmap v15600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:15.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27732.806118 secs 2024-04-27T02:12:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28429.836422 secs 2024-04-27T02:12:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:15 smithi156 ceph-mon[32679]: pgmap v15600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27732.806118 secs 2024-04-27T02:12:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28429.836422 secs 2024-04-27T02:12:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:15 smithi092 ceph-mon[29156]: pgmap v15600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27732.806118 secs 2024-04-27T02:12:17.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:17 smithi189 ceph-mon[32756]: pgmap v15601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:17.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:17 smithi156 ceph-mon[32679]: pgmap v15601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:17.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:17 smithi092 ceph-mon[29156]: pgmap v15601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:19.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:19 smithi189 ceph-mon[32756]: pgmap v15602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:19.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:19 smithi156 ceph-mon[32679]: pgmap v15602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:19.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:19 smithi092 ceph-mon[29156]: pgmap v15602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28434.836557 secs 2024-04-27T02:12:20.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27737.806262 secs 2024-04-27T02:12:20.373 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28434.836557 secs 2024-04-27T02:12:20.373 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27737.806262 secs 2024-04-27T02:12:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28434.836557 secs 2024-04-27T02:12:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27737.806262 secs 2024-04-27T02:12:21.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:21 smithi189 ceph-mon[32756]: pgmap v15603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:21.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:21 smithi156 ceph-mon[32679]: pgmap v15603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:21.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:21 smithi092 ceph-mon[29156]: pgmap v15603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:23.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:23 smithi189 ceph-mon[32756]: pgmap v15604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:23.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:23 smithi156 ceph-mon[32679]: pgmap v15604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:23.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:23 smithi092 ceph-mon[29156]: pgmap v15604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28439.836673 secs 2024-04-27T02:12:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:25 smithi189 ceph-mon[32756]: pgmap v15605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:25.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27742.806400 secs 2024-04-27T02:12:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28439.836673 secs 2024-04-27T02:12:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:25 smithi156 ceph-mon[32679]: pgmap v15605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:25.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27742.806400 secs 2024-04-27T02:12:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28439.836673 secs 2024-04-27T02:12:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:25 smithi092 ceph-mon[29156]: pgmap v15605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27742.806400 secs 2024-04-27T02:12:26.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:12:26.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:12:26.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:12:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:27 smithi189 ceph-mon[32756]: pgmap v15606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:12:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:12:27.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:12:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:27 smithi156 ceph-mon[32679]: pgmap v15606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:12:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:12:27.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:12:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:27 smithi092 ceph-mon[29156]: pgmap v15606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:12:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:12:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:12:28.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:28 smithi189 ceph-mon[32756]: pgmap v15607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:12:28.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:28 smithi189 ceph-mon[32756]: pgmap v15608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:28.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:28 smithi156 ceph-mon[32679]: pgmap v15607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:12:28.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:28 smithi156 ceph-mon[32679]: pgmap v15608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:28.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:28 smithi092 ceph-mon[29156]: pgmap v15607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:12:28.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:28 smithi092 ceph-mon[29156]: pgmap v15608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:29.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:29 smithi189 ceph-mon[32756]: pgmap v15609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:29 smithi156 ceph-mon[32679]: pgmap v15609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:29 smithi092 ceph-mon[29156]: pgmap v15609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28444.836787 secs 2024-04-27T02:12:30.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27747.806516 secs 2024-04-27T02:12:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28444.836787 secs 2024-04-27T02:12:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27747.806516 secs 2024-04-27T02:12:30.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28444.836787 secs 2024-04-27T02:12:30.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27747.806516 secs 2024-04-27T02:12:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:31 smithi189 ceph-mon[32756]: pgmap v15610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:31.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:31 smithi156 ceph-mon[32679]: pgmap v15610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:31.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:31 smithi092 ceph-mon[29156]: pgmap v15610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:33.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:33 smithi092 ceph-mon[29156]: pgmap v15611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:12:34.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:33 smithi189 ceph-mon[32756]: pgmap v15611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:12:34.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:33 smithi156 ceph-mon[32679]: pgmap v15611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:12:34.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28449.836901 secs 2024-04-27T02:12:34.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27752.806633 secs 2024-04-27T02:12:35.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28449.836901 secs 2024-04-27T02:12:35.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27752.806633 secs 2024-04-27T02:12:35.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28449.836901 secs 2024-04-27T02:12:35.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27752.806633 secs 2024-04-27T02:12:35.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:35 smithi092 ceph-mon[29156]: pgmap v15612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:36.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:35 smithi189 ceph-mon[32756]: pgmap v15612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:36.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:35 smithi156 ceph-mon[32679]: pgmap v15612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:12:37.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:37 smithi092 ceph-mon[29156]: pgmap v15613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:12:38.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:37 smithi189 ceph-mon[32756]: pgmap v15613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:12:38.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:37 smithi156 ceph-mon[32679]: pgmap v15613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:12:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:12:39.886+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:12:39.865 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:12:39.887+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:12:39.866 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:12:39.888+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:12:39.867 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:12:39.888+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 220 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:12:39.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:39 smithi092 ceph-mon[29156]: pgmap v15614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:39.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28454.836986 secs 2024-04-27T02:12:39.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27757.806780 secs 2024-04-27T02:12:40.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:39 smithi189 ceph-mon[32756]: pgmap v15614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:40.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28454.836986 secs 2024-04-27T02:12:40.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27757.806780 secs 2024-04-27T02:12:40.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:39 smithi156 ceph-mon[32679]: pgmap v15614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:40.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28454.836986 secs 2024-04-27T02:12:40.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27757.806780 secs 2024-04-27T02:12:41.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:41 smithi092 ceph-mon[29156]: pgmap v15615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:42.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:41 smithi189 ceph-mon[32756]: pgmap v15615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:42.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:41 smithi156 ceph-mon[32679]: pgmap v15615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:44.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:43 smithi189 ceph-mon[32756]: pgmap v15616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:44.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:43 smithi156 ceph-mon[32679]: pgmap v15616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:44.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:43 smithi092 ceph-mon[29156]: pgmap v15616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:45.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28459.837076 secs 2024-04-27T02:12:45.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27762.806857 secs 2024-04-27T02:12:45.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28459.837076 secs 2024-04-27T02:12:45.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27762.806857 secs 2024-04-27T02:12:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28459.837076 secs 2024-04-27T02:12:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27762.806857 secs 2024-04-27T02:12:46.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:45 smithi189 ceph-mon[32756]: pgmap v15617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:46.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:45 smithi156 ceph-mon[32679]: pgmap v15617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:46.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:45 smithi092 ceph-mon[29156]: pgmap v15617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:48.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:47 smithi189 ceph-mon[32756]: pgmap v15618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:48.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:47 smithi156 ceph-mon[32679]: pgmap v15618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:48.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:47 smithi092 ceph-mon[29156]: pgmap v15618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:50.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:49 smithi092 ceph-mon[29156]: pgmap v15619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:50.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28464.837148 secs 2024-04-27T02:12:50.024 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27767.806988 secs 2024-04-27T02:12:50.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:49 smithi189 ceph-mon[32756]: pgmap v15619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:50.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28464.837148 secs 2024-04-27T02:12:50.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27767.806988 secs 2024-04-27T02:12:50.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:49 smithi156 ceph-mon[32679]: pgmap v15619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:50.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28464.837148 secs 2024-04-27T02:12:50.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27767.806988 secs 2024-04-27T02:12:52.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:51 smithi189 ceph-mon[32756]: pgmap v15620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:52.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:51 smithi156 ceph-mon[32679]: pgmap v15620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:52.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:51 smithi092 ceph-mon[29156]: pgmap v15620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:54.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:53 smithi189 ceph-mon[32756]: pgmap v15621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:54.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:53 smithi156 ceph-mon[32679]: pgmap v15621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:54.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:53 smithi092 ceph-mon[29156]: pgmap v15621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:55.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28469.837240 secs 2024-04-27T02:12:55.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27772.807138 secs 2024-04-27T02:12:55.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28469.837240 secs 2024-04-27T02:12:55.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27772.807138 secs 2024-04-27T02:12:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28469.837240 secs 2024-04-27T02:12:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27772.807138 secs 2024-04-27T02:12:56.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:55 smithi189 ceph-mon[32756]: pgmap v15622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:56.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:55 smithi156 ceph-mon[32679]: pgmap v15622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:56.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:55 smithi092 ceph-mon[29156]: pgmap v15622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:12:58.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:57 smithi189 ceph-mon[32756]: pgmap v15623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:58.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:57 smithi156 ceph-mon[32679]: pgmap v15623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:12:58.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:57 smithi092 ceph-mon[29156]: pgmap v15623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:00.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:59 smithi189 ceph-mon[32756]: pgmap v15624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:00.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28474.837343 secs 2024-04-27T02:13:00.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:12:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27777.807238 secs 2024-04-27T02:13:00.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:59 smithi156 ceph-mon[32679]: pgmap v15624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:00.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28474.837343 secs 2024-04-27T02:13:00.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:12:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27777.807238 secs 2024-04-27T02:13:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:59 smithi092 ceph-mon[29156]: pgmap v15624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28474.837343 secs 2024-04-27T02:13:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:12:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27777.807238 secs 2024-04-27T02:13:02.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:01 smithi189 ceph-mon[32756]: pgmap v15625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:02.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:01 smithi156 ceph-mon[32679]: pgmap v15625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:02.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:01 smithi092 ceph-mon[29156]: pgmap v15625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:04.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:03 smithi189 ceph-mon[32756]: pgmap v15626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:04.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:03 smithi156 ceph-mon[32679]: pgmap v15626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:04.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:03 smithi092 ceph-mon[29156]: pgmap v15626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:05.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28479.837472 secs 2024-04-27T02:13:05.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:04 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 27782.807325 secs 2024-04-27T02:13:05.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:04 smithi189 ceph-mon[32756]: slow request 23041.550684 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:13:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28479.837472 secs 2024-04-27T02:13:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:04 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 27782.807325 secs 2024-04-27T02:13:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:04 smithi156 ceph-mon[32679]: slow request 23041.550684 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:13:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28479.837472 secs 2024-04-27T02:13:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:04 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 27782.807325 secs 2024-04-27T02:13:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:04 smithi092 ceph-mon[29156]: slow request 23041.550684 seconds old, received at 2024-04-26T19:49:02.402675+0000: client_request(client.16944:1 getattr pAsLsXsFs #0x1 2024-04-26T19:49:02.399363+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:13:06.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:05 smithi189 ceph-mon[32756]: pgmap v15627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:06.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:05 smithi156 ceph-mon[32679]: pgmap v15627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:06.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:05 smithi092 ceph-mon[29156]: pgmap v15627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:08.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:07 smithi189 ceph-mon[32756]: pgmap v15628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:08.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:07 smithi156 ceph-mon[32679]: pgmap v15628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:08.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:07 smithi092 ceph-mon[29156]: pgmap v15628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:10.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:09 smithi189 ceph-mon[32756]: pgmap v15629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:10.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:09 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28484.837595 secs 2024-04-27T02:13:10.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27787.807466 secs 2024-04-27T02:13:10.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:09 smithi156 ceph-mon[32679]: pgmap v15629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:10.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:09 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28484.837595 secs 2024-04-27T02:13:10.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27787.807466 secs 2024-04-27T02:13:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:09 smithi092 ceph-mon[29156]: pgmap v15629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:09 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28484.837595 secs 2024-04-27T02:13:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27787.807466 secs 2024-04-27T02:13:12.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:11 smithi189 ceph-mon[32756]: pgmap v15630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:12.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:11 smithi156 ceph-mon[32679]: pgmap v15630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:12.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:11 smithi092 ceph-mon[29156]: pgmap v15630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:14.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:13 smithi189 ceph-mon[32756]: pgmap v15631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:14.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:13 smithi156 ceph-mon[32679]: pgmap v15631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:14.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:13 smithi092 ceph-mon[29156]: pgmap v15631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:15.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:14 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28489.837665 secs 2024-04-27T02:13:15.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27792.807597 secs 2024-04-27T02:13:15.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:14 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28489.837665 secs 2024-04-27T02:13:15.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27792.807597 secs 2024-04-27T02:13:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:14 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28489.837665 secs 2024-04-27T02:13:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27792.807597 secs 2024-04-27T02:13:16.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:15 smithi189 ceph-mon[32756]: pgmap v15632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:16.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:15 smithi156 ceph-mon[32679]: pgmap v15632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:16.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:15 smithi092 ceph-mon[29156]: pgmap v15632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:18.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:17 smithi189 ceph-mon[32756]: pgmap v15633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:18.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:17 smithi156 ceph-mon[32679]: pgmap v15633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:18.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:17 smithi092 ceph-mon[29156]: pgmap v15633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:20.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:19 smithi189 ceph-mon[32756]: pgmap v15634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:19 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28494.837746 secs 2024-04-27T02:13:20.117 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27797.807666 secs 2024-04-27T02:13:20.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:19 smithi156 ceph-mon[32679]: pgmap v15634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:20.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:19 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28494.837746 secs 2024-04-27T02:13:20.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27797.807666 secs 2024-04-27T02:13:20.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:19 smithi092 ceph-mon[29156]: pgmap v15634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:20.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:19 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28494.837746 secs 2024-04-27T02:13:20.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27797.807666 secs 2024-04-27T02:13:22.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:21 smithi189 ceph-mon[32756]: pgmap v15635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:22.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:21 smithi156 ceph-mon[32679]: pgmap v15635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:22.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:21 smithi092 ceph-mon[29156]: pgmap v15635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:24.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:23 smithi189 ceph-mon[32756]: pgmap v15636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:24.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:23 smithi156 ceph-mon[32679]: pgmap v15636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:24.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:23 smithi092 ceph-mon[29156]: pgmap v15636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:25.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28499.837868 secs 2024-04-27T02:13:25.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27802.807738 secs 2024-04-27T02:13:25.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28499.837868 secs 2024-04-27T02:13:25.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27802.807738 secs 2024-04-27T02:13:25.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28499.837868 secs 2024-04-27T02:13:25.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27802.807738 secs 2024-04-27T02:13:26.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:25 smithi189 ceph-mon[32756]: pgmap v15637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:26.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:25 smithi156 ceph-mon[32679]: pgmap v15637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:26.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:25 smithi092 ceph-mon[29156]: pgmap v15637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:27.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:13:27.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:13:27.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:13:28.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:27 smithi189 ceph-mon[32756]: pgmap v15638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:28.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:13:28.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:13:28.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:13:28.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:27 smithi156 ceph-mon[32679]: pgmap v15638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:28.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:13:28.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:13:28.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:13:28.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:27 smithi092 ceph-mon[29156]: pgmap v15638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:28.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:13:28.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:13:28.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:13:29.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:28 smithi189 ceph-mon[32756]: pgmap v15639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:13:29.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:28 smithi189 ceph-mon[32756]: pgmap v15640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:29.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:28 smithi156 ceph-mon[32679]: pgmap v15639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:13:29.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:28 smithi156 ceph-mon[32679]: pgmap v15640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:29.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:28 smithi092 ceph-mon[29156]: pgmap v15639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:13:29.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:28 smithi092 ceph-mon[29156]: pgmap v15640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:30.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28504.837984 secs 2024-04-27T02:13:30.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27807.807861 secs 2024-04-27T02:13:30.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28504.837984 secs 2024-04-27T02:13:30.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27807.807861 secs 2024-04-27T02:13:30.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28504.837984 secs 2024-04-27T02:13:30.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27807.807861 secs 2024-04-27T02:13:31.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:30 smithi189 ceph-mon[32756]: pgmap v15641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:31.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:30 smithi156 ceph-mon[32679]: pgmap v15641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:31.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:30 smithi092 ceph-mon[29156]: pgmap v15641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:32.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:32 smithi092 ceph-mon[29156]: pgmap v15642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:33.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:32 smithi189 ceph-mon[32756]: pgmap v15642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:33.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:32 smithi156 ceph-mon[32679]: pgmap v15642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:35.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:34 smithi189 ceph-mon[32756]: pgmap v15643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:35.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28509.838101 secs 2024-04-27T02:13:35.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27812.807978 secs 2024-04-27T02:13:35.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:34 smithi156 ceph-mon[32679]: pgmap v15643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:35.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28509.838101 secs 2024-04-27T02:13:35.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27812.807978 secs 2024-04-27T02:13:35.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:34 smithi092 ceph-mon[29156]: pgmap v15643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:13:35.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28509.838101 secs 2024-04-27T02:13:35.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27812.807978 secs 2024-04-27T02:13:37.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:36 smithi189 ceph-mon[32756]: pgmap v15644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:37.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:36 smithi156 ceph-mon[32679]: pgmap v15644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:37.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:36 smithi092 ceph-mon[29156]: pgmap v15644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:13:39.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:38 smithi189 ceph-mon[32756]: pgmap v15645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:13:39.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:38 smithi156 ceph-mon[32679]: pgmap v15645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:13:39.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:38 smithi092 ceph-mon[29156]: pgmap v15645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:13:40.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28514.838215 secs 2024-04-27T02:13:40.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27817.808100 secs 2024-04-27T02:13:40.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28514.838215 secs 2024-04-27T02:13:40.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27817.808100 secs 2024-04-27T02:13:40.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28514.838215 secs 2024-04-27T02:13:40.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27817.808100 secs 2024-04-27T02:13:41.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:40 smithi189 ceph-mon[32756]: pgmap v15646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:41.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:40 smithi156 ceph-mon[32679]: pgmap v15646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:41.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:40 smithi092 ceph-mon[29156]: pgmap v15646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:43.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:42 smithi189 ceph-mon[32756]: pgmap v15647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:43.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:42 smithi156 ceph-mon[32679]: pgmap v15647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:43.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:42 smithi092 ceph-mon[29156]: pgmap v15647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:45.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:44 smithi189 ceph-mon[32756]: pgmap v15648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:45.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28519.838329 secs 2024-04-27T02:13:45.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27822.808224 secs 2024-04-27T02:13:45.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:44 smithi156 ceph-mon[32679]: pgmap v15648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:45.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28519.838329 secs 2024-04-27T02:13:45.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27822.808224 secs 2024-04-27T02:13:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:44 smithi092 ceph-mon[29156]: pgmap v15648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28519.838329 secs 2024-04-27T02:13:45.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27822.808224 secs 2024-04-27T02:13:47.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:46 smithi189 ceph-mon[32756]: pgmap v15649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:47.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:46 smithi156 ceph-mon[32679]: pgmap v15649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:47.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:46 smithi092 ceph-mon[29156]: pgmap v15649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:49.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:48 smithi189 ceph-mon[32756]: pgmap v15650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:49.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:48 smithi156 ceph-mon[32679]: pgmap v15650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:49.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:48 smithi092 ceph-mon[29156]: pgmap v15650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:50.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28524.838441 secs 2024-04-27T02:13:50.116 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27827.808348 secs 2024-04-27T02:13:50.122 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28524.838441 secs 2024-04-27T02:13:50.122 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27827.808348 secs 2024-04-27T02:13:50.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28524.838441 secs 2024-04-27T02:13:50.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27827.808348 secs 2024-04-27T02:13:51.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:50 smithi189 ceph-mon[32756]: pgmap v15651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:51.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:50 smithi156 ceph-mon[32679]: pgmap v15651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:51.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:50 smithi092 ceph-mon[29156]: pgmap v15651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:53.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:52 smithi156 ceph-mon[32679]: pgmap v15652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:53.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:52 smithi092 ceph-mon[29156]: pgmap v15652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:53.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:52 smithi189 ceph-mon[32756]: pgmap v15652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:55.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:54 smithi156 ceph-mon[32679]: pgmap v15653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:55.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28529.838576 secs 2024-04-27T02:13:55.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27832.808485 secs 2024-04-27T02:13:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:54 smithi092 ceph-mon[29156]: pgmap v15653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28529.838576 secs 2024-04-27T02:13:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27832.808485 secs 2024-04-27T02:13:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:54 smithi189 ceph-mon[32756]: pgmap v15653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28529.838576 secs 2024-04-27T02:13:55.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27832.808485 secs 2024-04-27T02:13:57.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:56 smithi156 ceph-mon[32679]: pgmap v15654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:57.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:56 smithi092 ceph-mon[29156]: pgmap v15654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:57.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:56 smithi189 ceph-mon[32756]: pgmap v15654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:13:59.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:58 smithi156 ceph-mon[32679]: pgmap v15655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:59.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:58 smithi092 ceph-mon[29156]: pgmap v15655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:13:59.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:58 smithi189 ceph-mon[32756]: pgmap v15655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:00.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28534.838694 secs 2024-04-27T02:14:00.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:13:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27837.808605 secs 2024-04-27T02:14:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28534.838694 secs 2024-04-27T02:14:00.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:13:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27837.808605 secs 2024-04-27T02:14:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28534.838694 secs 2024-04-27T02:14:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:13:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27837.808605 secs 2024-04-27T02:14:01.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:00 smithi156 ceph-mon[32679]: pgmap v15656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:01.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:00 smithi092 ceph-mon[29156]: pgmap v15656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:01.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:00 smithi189 ceph-mon[32756]: pgmap v15656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:03.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:02 smithi156 ceph-mon[32679]: pgmap v15657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:03.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:02 smithi092 ceph-mon[29156]: pgmap v15657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:03.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:02 smithi189 ceph-mon[32756]: pgmap v15657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:04 smithi156 ceph-mon[32679]: pgmap v15658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 28539.838850 secs 2024-04-27T02:14:05.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27842.808723 secs 2024-04-27T02:14:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:04 smithi092 ceph-mon[29156]: pgmap v15658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 28539.838850 secs 2024-04-27T02:14:05.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27842.808723 secs 2024-04-27T02:14:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:04 smithi189 ceph-mon[32756]: pgmap v15658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 28539.838850 secs 2024-04-27T02:14:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27842.808723 secs 2024-04-27T02:14:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:06 smithi156 ceph-mon[32679]: pgmap v15659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:07.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:06 smithi092 ceph-mon[29156]: pgmap v15659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:07.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:06 smithi189 ceph-mon[32756]: pgmap v15659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:08.721 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:14:08.453+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:14:08.721 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:14:08.453+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:14:08.721 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:14:08.453+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:14:08.722 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:14:08.453+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:14:08.722 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:14:08.453+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:14:09.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:08 smithi156 ceph-mon[32679]: pgmap v15660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:09.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:08 smithi092 ceph-mon[29156]: pgmap v15660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:09.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:08 smithi189 ceph-mon[32756]: pgmap v15660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:10.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:09 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28544.838969 secs 2024-04-27T02:14:10.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27847.808830 secs 2024-04-27T02:14:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:09 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28544.838969 secs 2024-04-27T02:14:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27847.808830 secs 2024-04-27T02:14:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:09 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28544.838969 secs 2024-04-27T02:14:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27847.808830 secs 2024-04-27T02:14:11.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:10 smithi156 ceph-mon[32679]: pgmap v15661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:11.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:10 smithi092 ceph-mon[29156]: pgmap v15661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:11.267 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:10 smithi189 ceph-mon[32756]: pgmap v15661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:12.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:14:12.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:14:12.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:14:12.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:14:12.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:14:12.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:14:13.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:12 smithi092 ceph-mon[29156]: pgmap v15662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:13.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:12 smithi189 ceph-mon[32756]: pgmap v15662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:13.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:12 smithi156 ceph-mon[32679]: pgmap v15662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:14 smithi092 ceph-mon[29156]: pgmap v15663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:14 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28549.839046 secs 2024-04-27T02:14:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27852.808968 secs 2024-04-27T02:14:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:14 smithi189 ceph-mon[32756]: pgmap v15663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:14 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28549.839046 secs 2024-04-27T02:14:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27852.808968 secs 2024-04-27T02:14:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:14 smithi156 ceph-mon[32679]: pgmap v15663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:14 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28549.839046 secs 2024-04-27T02:14:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27852.808968 secs 2024-04-27T02:14:17.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:16 smithi189 ceph-mon[32756]: pgmap v15664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:17.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:16 smithi156 ceph-mon[32679]: pgmap v15664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:17.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:16 smithi092 ceph-mon[29156]: pgmap v15664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:19.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:19 smithi189 ceph-mon[32756]: pgmap v15665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:19.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:18 smithi156 ceph-mon[32679]: pgmap v15665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:19.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:18 smithi092 ceph-mon[29156]: pgmap v15665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:14:20.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28554.839136 secs 2024-04-27T02:14:20.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27857.809106 secs 2024-04-27T02:14:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28554.839136 secs 2024-04-27T02:14:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27857.809106 secs 2024-04-27T02:14:20.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28554.839136 secs 2024-04-27T02:14:20.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27857.809106 secs 2024-04-27T02:14:21.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:21 smithi189 ceph-mon[32756]: pgmap v15666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:21.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:21 smithi156 ceph-mon[32679]: pgmap v15666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:21.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:21 smithi092 ceph-mon[29156]: pgmap v15666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:14:23.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:23 smithi189 ceph-mon[32756]: pgmap v15667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:23.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:23 smithi156 ceph-mon[32679]: pgmap v15667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:23.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:23 smithi092 ceph-mon[29156]: pgmap v15667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:25 smithi189 ceph-mon[32756]: pgmap v15668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28559.839201 secs 2024-04-27T02:14:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27862.809222 secs 2024-04-27T02:14:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:25 smithi156 ceph-mon[32679]: pgmap v15668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28559.839201 secs 2024-04-27T02:14:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27862.809222 secs 2024-04-27T02:14:25.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:25 smithi092 ceph-mon[29156]: pgmap v15668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:25.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28559.839201 secs 2024-04-27T02:14:25.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27862.809222 secs 2024-04-27T02:14:27.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:27 smithi189 ceph-mon[32756]: pgmap v15669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T02:14:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:27 smithi156 ceph-mon[32679]: pgmap v15669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T02:14:27.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:27 smithi092 ceph-mon[29156]: pgmap v15669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-04-27T02:14:28.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:14:28.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:14:28.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:14:29.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:29 smithi189 ceph-mon[32756]: pgmap v15670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:29.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:14:29.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:14:29.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:14:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:29 smithi156 ceph-mon[32679]: pgmap v15670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:14:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:14:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:14:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:29 smithi092 ceph-mon[29156]: pgmap v15670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:14:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:14:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:14:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:30 smithi189 ceph-mon[32756]: pgmap v15671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:14:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:30 smithi189 ceph-mon[32756]: pgmap v15672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:14:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28564.839315 secs 2024-04-27T02:14:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27867.809328 secs 2024-04-27T02:14:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:30 smithi156 ceph-mon[32679]: pgmap v15671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:14:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:30 smithi156 ceph-mon[32679]: pgmap v15672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:14:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28564.839315 secs 2024-04-27T02:14:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27867.809328 secs 2024-04-27T02:14:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:30 smithi092 ceph-mon[29156]: pgmap v15671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:14:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:30 smithi092 ceph-mon[29156]: pgmap v15672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:14:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28564.839315 secs 2024-04-27T02:14:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27867.809328 secs 2024-04-27T02:14:32.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:32 smithi189 ceph-mon[32756]: pgmap v15673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:32.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:32 smithi156 ceph-mon[32679]: pgmap v15673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:32.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:32 smithi092 ceph-mon[29156]: pgmap v15673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:34.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:34 smithi189 ceph-mon[32756]: pgmap v15674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:34.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:34 smithi156 ceph-mon[32679]: pgmap v15674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:34.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:34 smithi092 ceph-mon[29156]: pgmap v15674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:35.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28569.839454 secs 2024-04-27T02:14:35.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27872.809440 secs 2024-04-27T02:14:35.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28569.839454 secs 2024-04-27T02:14:35.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27872.809440 secs 2024-04-27T02:14:35.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28569.839454 secs 2024-04-27T02:14:35.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27872.809440 secs 2024-04-27T02:14:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:36 smithi189 ceph-mon[32756]: pgmap v15675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:36 smithi156 ceph-mon[32679]: pgmap v15675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:36 smithi092 ceph-mon[29156]: pgmap v15675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:38.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:38 smithi189 ceph-mon[32756]: pgmap v15676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:38.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:38 smithi156 ceph-mon[32679]: pgmap v15676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:38.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:38 smithi092 ceph-mon[29156]: pgmap v15676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:14:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:40 smithi189 ceph-mon[32756]: pgmap v15677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:14:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28574.839573 secs 2024-04-27T02:14:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27877.809547 secs 2024-04-27T02:14:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:40 smithi156 ceph-mon[32679]: pgmap v15677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:14:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28574.839573 secs 2024-04-27T02:14:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27877.809547 secs 2024-04-27T02:14:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:40 smithi092 ceph-mon[29156]: pgmap v15677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:14:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28574.839573 secs 2024-04-27T02:14:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27877.809547 secs 2024-04-27T02:14:42.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:42 smithi189 ceph-mon[32756]: pgmap v15678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:42.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:42 smithi156 ceph-mon[32679]: pgmap v15678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:42.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:42 smithi092 ceph-mon[29156]: pgmap v15678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:44.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:44 smithi189 ceph-mon[32756]: pgmap v15679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:44.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:44 smithi156 ceph-mon[32679]: pgmap v15679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:44.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:44 smithi092 ceph-mon[29156]: pgmap v15679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:45.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28579.839686 secs 2024-04-27T02:14:45.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27882.809668 secs 2024-04-27T02:14:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28579.839686 secs 2024-04-27T02:14:45.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27882.809668 secs 2024-04-27T02:14:45.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28579.839686 secs 2024-04-27T02:14:45.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27882.809668 secs 2024-04-27T02:14:46.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:46 smithi189 ceph-mon[32756]: pgmap v15680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:46.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:46 smithi156 ceph-mon[32679]: pgmap v15680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:46.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:46 smithi092 ceph-mon[29156]: pgmap v15680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:47.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:47 smithi189 ceph-mon[32756]: pgmap v15681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:47.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:47 smithi156 ceph-mon[32679]: pgmap v15681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:47.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:47 smithi092 ceph-mon[29156]: pgmap v15681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:49.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:49 smithi189 ceph-mon[32756]: pgmap v15682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:49.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:49 smithi156 ceph-mon[32679]: pgmap v15682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:49.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:49 smithi092 ceph-mon[29156]: pgmap v15682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:14:50.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28584.839805 secs 2024-04-27T02:14:50.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27887.809744 secs 2024-04-27T02:14:50.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28584.839805 secs 2024-04-27T02:14:50.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27887.809744 secs 2024-04-27T02:14:50.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28584.839805 secs 2024-04-27T02:14:50.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27887.809744 secs 2024-04-27T02:14:51.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:51 smithi189 ceph-mon[32756]: pgmap v15683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:51.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:51 smithi156 ceph-mon[32679]: pgmap v15683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:51.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:51 smithi092 ceph-mon[29156]: pgmap v15683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:14:53.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:53 smithi189 ceph-mon[32756]: pgmap v15684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:53.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:53 smithi156 ceph-mon[32679]: pgmap v15684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:53.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:53 smithi092 ceph-mon[29156]: pgmap v15684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:55.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28589.839873 secs 2024-04-27T02:14:55.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27892.809875 secs 2024-04-27T02:14:55.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:55 smithi189 ceph-mon[32756]: pgmap v15685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:55.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28589.839873 secs 2024-04-27T02:14:55.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27892.809875 secs 2024-04-27T02:14:55.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:55 smithi156 ceph-mon[32679]: pgmap v15685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:55.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28589.839873 secs 2024-04-27T02:14:55.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27892.809875 secs 2024-04-27T02:14:55.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:55 smithi092 ceph-mon[29156]: pgmap v15685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:14:57.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:57 smithi189 ceph-mon[32756]: pgmap v15686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:57.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:57 smithi156 ceph-mon[32679]: pgmap v15686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:57.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:57 smithi092 ceph-mon[29156]: pgmap v15686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:59.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:14:59 smithi189 ceph-mon[32756]: pgmap v15687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:59.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:14:59 smithi156 ceph-mon[32679]: pgmap v15687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:14:59.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:14:59 smithi092 ceph-mon[29156]: pgmap v15687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:00.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28594.839979 secs 2024-04-27T02:15:00.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27897.810000 secs 2024-04-27T02:15:00.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28594.839979 secs 2024-04-27T02:15:00.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27897.810000 secs 2024-04-27T02:15:00.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28594.839979 secs 2024-04-27T02:15:00.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27897.810000 secs 2024-04-27T02:15:01.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:01 smithi189 ceph-mon[32756]: pgmap v15688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:01.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:01 smithi156 ceph-mon[32679]: pgmap v15688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:01.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:01 smithi092 ceph-mon[29156]: pgmap v15688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:03.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:03 smithi189 ceph-mon[32756]: pgmap v15689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:03.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:03 smithi156 ceph-mon[32679]: pgmap v15689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:03.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:03 smithi092 ceph-mon[29156]: pgmap v15689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:05 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28599.840094 secs 2024-04-27T02:15:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27902.810083 secs 2024-04-27T02:15:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:05 smithi189 ceph-mon[32756]: pgmap v15690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:05.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:05 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28599.840094 secs 2024-04-27T02:15:05.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27902.810083 secs 2024-04-27T02:15:05.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:05 smithi156 ceph-mon[32679]: pgmap v15690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:05.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:05 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28599.840094 secs 2024-04-27T02:15:05.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27902.810083 secs 2024-04-27T02:15:05.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:05 smithi092 ceph-mon[29156]: pgmap v15690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:07.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:07 smithi189 ceph-mon[32756]: pgmap v15691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:07.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:07 smithi156 ceph-mon[32679]: pgmap v15691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:07.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:07 smithi092 ceph-mon[29156]: pgmap v15691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:09.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:09 smithi189 ceph-mon[32756]: pgmap v15692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:09.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:09 smithi156 ceph-mon[32679]: pgmap v15692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:09.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:09 smithi092 ceph-mon[29156]: pgmap v15692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:10.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28604.840185 secs 2024-04-27T02:15:10.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27907.810185 secs 2024-04-27T02:15:10.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28604.840185 secs 2024-04-27T02:15:10.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27907.810185 secs 2024-04-27T02:15:10.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28604.840185 secs 2024-04-27T02:15:10.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27907.810185 secs 2024-04-27T02:15:11.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:11 smithi156 ceph-mon[32679]: pgmap v15693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:11.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:11 smithi092 ceph-mon[29156]: pgmap v15693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:11.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:11 smithi189 ceph-mon[32756]: pgmap v15693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:13.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:13 smithi156 ceph-mon[32679]: pgmap v15694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:13.667 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:13 smithi189 ceph-mon[32756]: pgmap v15694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:13.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:13 smithi092 ceph-mon[29156]: pgmap v15694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:15:15.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:15 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28609.840271 secs 2024-04-27T02:15:15.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27912.810321 secs 2024-04-27T02:15:15.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:15 smithi156 ceph-mon[32679]: pgmap v15695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:15.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:15 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28609.840271 secs 2024-04-27T02:15:15.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27912.810321 secs 2024-04-27T02:15:15.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:15 smithi092 ceph-mon[29156]: pgmap v15695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:15.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:15 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28609.840271 secs 2024-04-27T02:15:15.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27912.810321 secs 2024-04-27T02:15:15.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:15 smithi189 ceph-mon[32756]: pgmap v15695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:15:17.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:17 smithi156 ceph-mon[32679]: pgmap v15696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:17.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:17 smithi092 ceph-mon[29156]: pgmap v15696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:17.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:17 smithi189 ceph-mon[32756]: pgmap v15696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:19.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:19 smithi156 ceph-mon[32679]: pgmap v15697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:19.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:19 smithi092 ceph-mon[29156]: pgmap v15697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:19.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:19 smithi189 ceph-mon[32756]: pgmap v15697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:20.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28614.840383 secs 2024-04-27T02:15:20.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27917.810400 secs 2024-04-27T02:15:20.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28614.840383 secs 2024-04-27T02:15:20.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27917.810400 secs 2024-04-27T02:15:20.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28614.840383 secs 2024-04-27T02:15:20.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27917.810400 secs 2024-04-27T02:15:21.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:21 smithi156 ceph-mon[32679]: pgmap v15698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:21.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:21 smithi092 ceph-mon[29156]: pgmap v15698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:21.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:21 smithi189 ceph-mon[32756]: pgmap v15698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:23.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:23 smithi156 ceph-mon[32679]: pgmap v15699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:23.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:23 smithi092 ceph-mon[29156]: pgmap v15699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:23.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:23 smithi189 ceph-mon[32756]: pgmap v15699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:25.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28619.840503 secs 2024-04-27T02:15:25.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27922.810473 secs 2024-04-27T02:15:25.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:25 smithi156 ceph-mon[32679]: pgmap v15700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:25.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28619.840503 secs 2024-04-27T02:15:25.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27922.810473 secs 2024-04-27T02:15:25.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:25 smithi092 ceph-mon[29156]: pgmap v15700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:25.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28619.840503 secs 2024-04-27T02:15:25.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27922.810473 secs 2024-04-27T02:15:25.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:25 smithi189 ceph-mon[32756]: pgmap v15700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:27.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:27 smithi156 ceph-mon[32679]: pgmap v15701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:27.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:27 smithi092 ceph-mon[29156]: pgmap v15701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:27.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:27 smithi189 ceph-mon[32756]: pgmap v15701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:28.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:15:28.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:15:28.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: pgmap v15702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: pgmap v15703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: pgmap v15704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:29.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: pgmap v15702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: pgmap v15703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: pgmap v15704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:29.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:15:29.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: pgmap v15702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:29.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:15:29.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:15:29.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: pgmap v15703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:15:29.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: pgmap v15704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:29.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:15:30.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28624.840593 secs 2024-04-27T02:15:30.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27927.810538 secs 2024-04-27T02:15:30.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28624.840593 secs 2024-04-27T02:15:30.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27927.810538 secs 2024-04-27T02:15:30.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28624.840593 secs 2024-04-27T02:15:30.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27927.810538 secs 2024-04-27T02:15:31.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:31 smithi092 ceph-mon[29156]: pgmap v15705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:31.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:31 smithi189 ceph-mon[32756]: pgmap v15705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:31.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:31 smithi156 ceph-mon[32679]: pgmap v15705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:33.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:33 smithi189 ceph-mon[32756]: pgmap v15706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:15:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:33 smithi156 ceph-mon[32679]: pgmap v15706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:15:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:33 smithi092 ceph-mon[29156]: pgmap v15706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:15:34.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27932.810634 secs 2024-04-27T02:15:34.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27932.810634 secs 2024-04-27T02:15:34.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27932.810634 secs 2024-04-27T02:15:35.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28629.840730 secs 2024-04-27T02:15:35.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:35 smithi189 ceph-mon[32756]: pgmap v15707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:35.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28629.840730 secs 2024-04-27T02:15:35.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:35 smithi156 ceph-mon[32679]: pgmap v15707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:35.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28629.840730 secs 2024-04-27T02:15:35.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:35 smithi092 ceph-mon[29156]: pgmap v15707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:37.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:37 smithi092 ceph-mon[29156]: pgmap v15708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:37.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:37 smithi189 ceph-mon[32756]: pgmap v15708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:37 smithi156 ceph-mon[32679]: pgmap v15708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:15:39.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:39 smithi189 ceph-mon[32756]: pgmap v15709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:15:39.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:39 smithi156 ceph-mon[32679]: pgmap v15709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:15:39.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:39 smithi092 ceph-mon[29156]: pgmap v15709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:15:39.888 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:15:39.911+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:15:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:15:39.911+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:15:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:15:39.911+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:15:39.889 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:15:39.911+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 221 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:15:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28634.840858 secs 2024-04-27T02:15:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27937.810751 secs 2024-04-27T02:15:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28634.840858 secs 2024-04-27T02:15:40.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27937.810751 secs 2024-04-27T02:15:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28634.840858 secs 2024-04-27T02:15:40.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27937.810751 secs 2024-04-27T02:15:41.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:41 smithi189 ceph-mon[32756]: pgmap v15710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:41.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:41 smithi156 ceph-mon[32679]: pgmap v15710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:41.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:41 smithi092 ceph-mon[29156]: pgmap v15710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:43.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:43 smithi189 ceph-mon[32756]: pgmap v15711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:43.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:43 smithi156 ceph-mon[32679]: pgmap v15711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:43.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:43 smithi092 ceph-mon[29156]: pgmap v15711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:44.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27942.810825 secs 2024-04-27T02:15:44.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27942.810825 secs 2024-04-27T02:15:44.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27942.810825 secs 2024-04-27T02:15:45.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28639.840997 secs 2024-04-27T02:15:45.865 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:45 smithi189 ceph-mon[32756]: pgmap v15712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:45.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28639.840997 secs 2024-04-27T02:15:45.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:45 smithi156 ceph-mon[32679]: pgmap v15712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:45.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28639.840997 secs 2024-04-27T02:15:45.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:45 smithi092 ceph-mon[29156]: pgmap v15712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:47.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:47 smithi189 ceph-mon[32756]: pgmap v15713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:47.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:47 smithi156 ceph-mon[32679]: pgmap v15713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:47.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:47 smithi092 ceph-mon[29156]: pgmap v15713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28644.841089 secs 2024-04-27T02:15:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27947.810951 secs 2024-04-27T02:15:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:50 smithi189 ceph-mon[32756]: pgmap v15714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:50.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28644.841089 secs 2024-04-27T02:15:50.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27947.810951 secs 2024-04-27T02:15:50.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:50 smithi156 ceph-mon[32679]: pgmap v15714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:50.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28644.841089 secs 2024-04-27T02:15:50.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27947.810951 secs 2024-04-27T02:15:50.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:50 smithi092 ceph-mon[29156]: pgmap v15714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:52.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:52 smithi189 ceph-mon[32756]: pgmap v15715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:52.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:52 smithi156 ceph-mon[32679]: pgmap v15715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:52.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:52 smithi092 ceph-mon[29156]: pgmap v15715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:54.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:54 smithi189 ceph-mon[32756]: pgmap v15716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:54.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:54 smithi156 ceph-mon[32679]: pgmap v15716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:54.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:54 smithi092 ceph-mon[29156]: pgmap v15716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:55 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28649.841185 secs 2024-04-27T02:15:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27952.811073 secs 2024-04-27T02:15:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:55 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28649.841185 secs 2024-04-27T02:15:55.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27952.811073 secs 2024-04-27T02:15:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:55 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28649.841185 secs 2024-04-27T02:15:55.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27952.811073 secs 2024-04-27T02:15:56.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:56 smithi189 ceph-mon[32756]: pgmap v15717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:56.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:56 smithi156 ceph-mon[32679]: pgmap v15717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:56.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:56 smithi092 ceph-mon[29156]: pgmap v15717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:15:58.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:15:58 smithi156 ceph-mon[32679]: pgmap v15718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:58.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:15:58 smithi092 ceph-mon[29156]: pgmap v15718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:15:58.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:15:58 smithi189 ceph-mon[32756]: pgmap v15718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:00 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28654.841301 secs 2024-04-27T02:16:00.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27957.811197 secs 2024-04-27T02:16:00.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:00 smithi156 ceph-mon[32679]: pgmap v15719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:00 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28654.841301 secs 2024-04-27T02:16:00.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27957.811197 secs 2024-04-27T02:16:00.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:00 smithi092 ceph-mon[29156]: pgmap v15719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:00.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:00 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28654.841301 secs 2024-04-27T02:16:00.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27957.811197 secs 2024-04-27T02:16:00.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:00 smithi189 ceph-mon[32756]: pgmap v15719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:02.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:02 smithi156 ceph-mon[32679]: pgmap v15720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:02.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:02 smithi092 ceph-mon[29156]: pgmap v15720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:02.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:02 smithi189 ceph-mon[32756]: pgmap v15720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:04.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:04 smithi156 ceph-mon[32679]: pgmap v15721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:04.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:04 smithi092 ceph-mon[29156]: pgmap v15721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:04.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:04 smithi189 ceph-mon[32756]: pgmap v15721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:05 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28659.841394 secs 2024-04-27T02:16:05.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27962.811359 secs 2024-04-27T02:16:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:05 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28659.841394 secs 2024-04-27T02:16:05.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27962.811359 secs 2024-04-27T02:16:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:05 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28659.841394 secs 2024-04-27T02:16:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27962.811359 secs 2024-04-27T02:16:06.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:06 smithi156 ceph-mon[32679]: pgmap v15722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:06.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:06 smithi092 ceph-mon[29156]: pgmap v15722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:06 smithi189 ceph-mon[32756]: pgmap v15722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:08.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:08 smithi156 ceph-mon[32679]: pgmap v15723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:08.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:08 smithi092 ceph-mon[29156]: pgmap v15723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:08.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:08 smithi189 ceph-mon[32756]: pgmap v15723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:10 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28664.841511 secs 2024-04-27T02:16:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27967.811467 secs 2024-04-27T02:16:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:10 smithi156 ceph-mon[32679]: pgmap v15724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:10 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28664.841511 secs 2024-04-27T02:16:10.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27967.811467 secs 2024-04-27T02:16:10.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:10 smithi092 ceph-mon[29156]: pgmap v15724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:10.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:10 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28664.841511 secs 2024-04-27T02:16:10.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27967.811467 secs 2024-04-27T02:16:10.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:10 smithi189 ceph-mon[32756]: pgmap v15724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:12 smithi156 ceph-mon[32679]: pgmap v15725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:12.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:12 smithi092 ceph-mon[29156]: pgmap v15725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:12.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:12 smithi189 ceph-mon[32756]: pgmap v15725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:14.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:14 smithi156 ceph-mon[32679]: pgmap v15726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:14.417 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:14 smithi189 ceph-mon[32756]: pgmap v15726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:14.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:14 smithi092 ceph-mon[29156]: pgmap v15726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:15 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28669.841629 secs 2024-04-27T02:16:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27972.811535 secs 2024-04-27T02:16:15.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:15 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28669.841629 secs 2024-04-27T02:16:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27972.811535 secs 2024-04-27T02:16:15.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:15 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28669.841629 secs 2024-04-27T02:16:15.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27972.811535 secs 2024-04-27T02:16:17.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:17 smithi189 ceph-mon[32756]: pgmap v15727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:17.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:17 smithi156 ceph-mon[32679]: pgmap v15727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:17.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:17 smithi092 ceph-mon[29156]: pgmap v15727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:19.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:19 smithi189 ceph-mon[32756]: pgmap v15728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:19.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:19 smithi156 ceph-mon[32679]: pgmap v15728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:19.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:19 smithi092 ceph-mon[29156]: pgmap v15728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:20.312 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:20 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28674.841781 secs 2024-04-27T02:16:20.312 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27977.811639 secs 2024-04-27T02:16:20.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:20 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28674.841781 secs 2024-04-27T02:16:20.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27977.811639 secs 2024-04-27T02:16:20.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:20 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28674.841781 secs 2024-04-27T02:16:20.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27977.811639 secs 2024-04-27T02:16:21.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:21 smithi189 ceph-mon[32756]: pgmap v15729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:21.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:21 smithi156 ceph-mon[32679]: pgmap v15729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:21.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:21 smithi092 ceph-mon[29156]: pgmap v15729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:23.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:23 smithi189 ceph-mon[32756]: pgmap v15730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:23.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:23 smithi156 ceph-mon[32679]: pgmap v15730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:23.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:23 smithi092 ceph-mon[29156]: pgmap v15730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:25 smithi189 ceph-mon[32756]: pgmap v15731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:25 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28679.841899 secs 2024-04-27T02:16:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27982.811756 secs 2024-04-27T02:16:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:25 smithi156 ceph-mon[32679]: pgmap v15731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:25 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28679.841899 secs 2024-04-27T02:16:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27982.811756 secs 2024-04-27T02:16:25.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:25 smithi092 ceph-mon[29156]: pgmap v15731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:25.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:25 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28679.841899 secs 2024-04-27T02:16:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27982.811756 secs 2024-04-27T02:16:27.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:27 smithi189 ceph-mon[32756]: pgmap v15732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:27.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:27 smithi156 ceph-mon[32679]: pgmap v15732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:27.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:27 smithi092 ceph-mon[29156]: pgmap v15732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:29.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:29 smithi189 ceph-mon[32756]: pgmap v15733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:29.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:29 smithi156 ceph-mon[32679]: pgmap v15733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:29.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:29 smithi092 ceph-mon[29156]: pgmap v15733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28684.842016 secs 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27987.811892 secs 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:16:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:16:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28684.842016 secs 2024-04-27T02:16:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27987.811892 secs 2024-04-27T02:16:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:16:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:16:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:16:30.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:16:30.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28684.842016 secs 2024-04-27T02:16:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27987.811892 secs 2024-04-27T02:16:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:16:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:16:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:16:30.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:16:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:31 smithi189 ceph-mon[32756]: pgmap v15734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:31 smithi189 ceph-mon[32756]: pgmap v15735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:16:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:31 smithi189 ceph-mon[32756]: pgmap v15736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:31 smithi156 ceph-mon[32679]: pgmap v15734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:31 smithi156 ceph-mon[32679]: pgmap v15735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:16:31.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:31 smithi156 ceph-mon[32679]: pgmap v15736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:31.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:31 smithi092 ceph-mon[29156]: pgmap v15734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:31.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:31 smithi092 ceph-mon[29156]: pgmap v15735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:16:31.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:31 smithi092 ceph-mon[29156]: pgmap v15736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:33.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:33 smithi189 ceph-mon[32756]: pgmap v15737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:33 smithi156 ceph-mon[32679]: pgmap v15737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:33 smithi092 ceph-mon[29156]: pgmap v15737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:35 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28689.842128 secs 2024-04-27T02:16:35.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:35 smithi189 ceph-mon[32756]: pgmap v15738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:35.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27992.812027 secs 2024-04-27T02:16:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:35 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28689.842128 secs 2024-04-27T02:16:35.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:35 smithi156 ceph-mon[32679]: pgmap v15738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:35.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27992.812027 secs 2024-04-27T02:16:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:35 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28689.842128 secs 2024-04-27T02:16:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:35 smithi092 ceph-mon[29156]: pgmap v15738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:35.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27992.812027 secs 2024-04-27T02:16:37.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:37 smithi189 ceph-mon[32756]: pgmap v15739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:37 smithi156 ceph-mon[32679]: pgmap v15739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:37 smithi092 ceph-mon[29156]: pgmap v15739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:16:39.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:39 smithi092 ceph-mon[29156]: pgmap v15740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:16:39.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:39 smithi189 ceph-mon[32756]: pgmap v15740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:16:39.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:39 smithi156 ceph-mon[32679]: pgmap v15740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:16:40.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:40 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28694.842247 secs 2024-04-27T02:16:40.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 27997.812126 secs 2024-04-27T02:16:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:40 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28694.842247 secs 2024-04-27T02:16:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 27997.812126 secs 2024-04-27T02:16:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:40 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28694.842247 secs 2024-04-27T02:16:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 27997.812126 secs 2024-04-27T02:16:41.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:41 smithi189 ceph-mon[32756]: pgmap v15741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:16:41.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:41 smithi156 ceph-mon[32679]: pgmap v15741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:16:41.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:41 smithi092 ceph-mon[29156]: pgmap v15741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:16:43.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:43 smithi189 ceph-mon[32756]: pgmap v15742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:43.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:43 smithi156 ceph-mon[32679]: pgmap v15742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:43.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:43 smithi092 ceph-mon[29156]: pgmap v15742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:45.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:45 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28699.842336 secs 2024-04-27T02:16:45.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:45 smithi189 ceph-mon[32756]: pgmap v15743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:45.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28002.812215 secs 2024-04-27T02:16:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:45 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28699.842336 secs 2024-04-27T02:16:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:45 smithi156 ceph-mon[32679]: pgmap v15743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28002.812215 secs 2024-04-27T02:16:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:45 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28699.842336 secs 2024-04-27T02:16:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:45 smithi092 ceph-mon[29156]: pgmap v15743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28002.812215 secs 2024-04-27T02:16:47.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:47 smithi189 ceph-mon[32756]: pgmap v15744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:47.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:47 smithi156 ceph-mon[32679]: pgmap v15744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:47.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:47 smithi092 ceph-mon[29156]: pgmap v15744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:49.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:49 smithi189 ceph-mon[32756]: pgmap v15745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:49.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:49 smithi156 ceph-mon[32679]: pgmap v15745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:49.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:49 smithi092 ceph-mon[29156]: pgmap v15745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:50.312 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:50 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28704.842450 secs 2024-04-27T02:16:50.312 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28007.812342 secs 2024-04-27T02:16:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:50 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28704.842450 secs 2024-04-27T02:16:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28007.812342 secs 2024-04-27T02:16:50.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:50 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28704.842450 secs 2024-04-27T02:16:50.372 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28007.812342 secs 2024-04-27T02:16:51.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:51 smithi189 ceph-mon[32756]: pgmap v15746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:51.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:51 smithi156 ceph-mon[32679]: pgmap v15746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:51.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:51 smithi092 ceph-mon[29156]: pgmap v15746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:52.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:52 smithi189 ceph-mon[32756]: pgmap v15747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:52.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:52 smithi156 ceph-mon[32679]: pgmap v15747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:52.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:52 smithi092 ceph-mon[29156]: pgmap v15747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:54 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28709.842571 secs 2024-04-27T02:16:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:54 smithi156 ceph-mon[32679]: pgmap v15748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28012.812422 secs 2024-04-27T02:16:55.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:54 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28709.842571 secs 2024-04-27T02:16:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:54 smithi092 ceph-mon[29156]: pgmap v15748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:55.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28012.812422 secs 2024-04-27T02:16:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:54 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28709.842571 secs 2024-04-27T02:16:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:54 smithi189 ceph-mon[32756]: pgmap v15748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:16:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28012.812422 secs 2024-04-27T02:16:57.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:56 smithi156 ceph-mon[32679]: pgmap v15749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:57.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:56 smithi092 ceph-mon[29156]: pgmap v15749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:57.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:56 smithi189 ceph-mon[32756]: pgmap v15749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:59.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:58 smithi156 ceph-mon[32679]: pgmap v15750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:59.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:58 smithi092 ceph-mon[29156]: pgmap v15750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:16:59.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:58 smithi189 ceph-mon[32756]: pgmap v15750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:00.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:59 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28714.842671 secs 2024-04-27T02:17:00.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:16:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28017.812535 secs 2024-04-27T02:17:00.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:59 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28714.842671 secs 2024-04-27T02:17:00.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:16:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28017.812535 secs 2024-04-27T02:17:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:59 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28714.842671 secs 2024-04-27T02:17:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:16:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28017.812535 secs 2024-04-27T02:17:01.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:00 smithi156 ceph-mon[32679]: pgmap v15751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:01.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:00 smithi092 ceph-mon[29156]: pgmap v15751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:01.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:00 smithi189 ceph-mon[32756]: pgmap v15751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:03.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:02 smithi156 ceph-mon[32679]: pgmap v15752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:03.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:02 smithi092 ceph-mon[29156]: pgmap v15752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:03.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:02 smithi189 ceph-mon[32756]: pgmap v15752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:05.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:04 smithi156 ceph-mon[32679]: 11 slow requests, 0 included below; oldest blocked for > 28719.842788 secs 2024-04-27T02:17:05.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:04 smithi156 ceph-mon[32679]: pgmap v15753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:05.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28022.812656 secs 2024-04-27T02:17:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:04 smithi092 ceph-mon[29156]: 11 slow requests, 0 included below; oldest blocked for > 28719.842788 secs 2024-04-27T02:17:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:04 smithi092 ceph-mon[29156]: pgmap v15753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28022.812656 secs 2024-04-27T02:17:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:04 smithi189 ceph-mon[32756]: 11 slow requests, 0 included below; oldest blocked for > 28719.842788 secs 2024-04-27T02:17:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:04 smithi189 ceph-mon[32756]: pgmap v15753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:05.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28022.812656 secs 2024-04-27T02:17:07.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:06 smithi156 ceph-mon[32679]: pgmap v15754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:07.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:06 smithi092 ceph-mon[29156]: pgmap v15754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:07.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:06 smithi189 ceph-mon[32756]: pgmap v15754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:09.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:08 smithi092 ceph-mon[29156]: pgmap v15755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:09.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:08 smithi189 ceph-mon[32756]: pgmap v15755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:09.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:08 smithi156 ceph-mon[32679]: pgmap v15755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:09.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:17:09.923+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:17:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:17:09.923+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:17:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:17:09.923+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:17:09.901 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:17:09.923+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 222 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:17:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:09 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 28724.842903 secs 2024-04-27T02:17:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:09 smithi092 ceph-mon[29156]: slow request 180.299983 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:17:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:09 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 28027.812802 secs 2024-04-27T02:17:10.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:09 smithi092 ceph-mon[29156]: slow request 1440.845636 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:17:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:09 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 28724.842903 secs 2024-04-27T02:17:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:09 smithi189 ceph-mon[32756]: slow request 180.299983 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:17:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:09 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 28027.812802 secs 2024-04-27T02:17:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:09 smithi189 ceph-mon[32756]: slow request 1440.845636 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:17:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:09 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 28724.842903 secs 2024-04-27T02:17:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:09 smithi156 ceph-mon[32679]: slow request 180.299983 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:17:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:09 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 28027.812802 secs 2024-04-27T02:17:10.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:09 smithi156 ceph-mon[32679]: slow request 1440.845636 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:17:10.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:10 smithi092 ceph-mon[29156]: pgmap v15756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:11.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:10 smithi189 ceph-mon[32756]: pgmap v15756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:11.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:10 smithi156 ceph-mon[32679]: pgmap v15756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:12.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:17:12.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:17:12.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:17:12.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:17:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:17:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:17:13.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:12 smithi092 ceph-mon[29156]: pgmap v15757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:13.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:12 smithi189 ceph-mon[32756]: pgmap v15757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:13.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:12 smithi156 ceph-mon[32679]: pgmap v15757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28729.843018 secs 2024-04-27T02:17:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:14 smithi092 ceph-mon[29156]: pgmap v15758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:15.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28032.812894 secs 2024-04-27T02:17:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28729.843018 secs 2024-04-27T02:17:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:14 smithi189 ceph-mon[32756]: pgmap v15758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28032.812894 secs 2024-04-27T02:17:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28729.843018 secs 2024-04-27T02:17:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:14 smithi156 ceph-mon[32679]: pgmap v15758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28032.812894 secs 2024-04-27T02:17:17.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:16 smithi092 ceph-mon[29156]: pgmap v15759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:17.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:16 smithi189 ceph-mon[32756]: pgmap v15759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:17.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:16 smithi156 ceph-mon[32679]: pgmap v15759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:19.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:18 smithi092 ceph-mon[29156]: pgmap v15760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:19.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:18 smithi189 ceph-mon[32756]: pgmap v15760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:19.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:18 smithi156 ceph-mon[32679]: pgmap v15760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:20.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28734.843136 secs 2024-04-27T02:17:20.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28037.812959 secs 2024-04-27T02:17:20.310 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28734.843136 secs 2024-04-27T02:17:20.311 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28037.812959 secs 2024-04-27T02:17:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28734.843136 secs 2024-04-27T02:17:20.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28037.812959 secs 2024-04-27T02:17:21.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:20 smithi092 ceph-mon[29156]: pgmap v15761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:21.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:20 smithi189 ceph-mon[32756]: pgmap v15761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:21.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:20 smithi156 ceph-mon[32679]: pgmap v15761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:23.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:22 smithi092 ceph-mon[29156]: pgmap v15762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:23.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:22 smithi189 ceph-mon[32756]: pgmap v15762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:23.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:22 smithi156 ceph-mon[32679]: pgmap v15762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:25.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28739.843228 secs 2024-04-27T02:17:25.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:24 smithi092 ceph-mon[29156]: pgmap v15763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:25.221 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28042.813094 secs 2024-04-27T02:17:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28739.843228 secs 2024-04-27T02:17:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:24 smithi189 ceph-mon[32756]: pgmap v15763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:25.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28042.813094 secs 2024-04-27T02:17:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28739.843228 secs 2024-04-27T02:17:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:24 smithi156 ceph-mon[32679]: pgmap v15763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28042.813094 secs 2024-04-27T02:17:27.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:26 smithi092 ceph-mon[29156]: pgmap v15764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:27.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:26 smithi189 ceph-mon[32756]: pgmap v15764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:27.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:26 smithi156 ceph-mon[32679]: pgmap v15764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:29.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:28 smithi092 ceph-mon[29156]: pgmap v15765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:29.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:28 smithi189 ceph-mon[32756]: pgmap v15765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:29.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:28 smithi156 ceph-mon[32679]: pgmap v15765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:30.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28744.843363 secs 2024-04-27T02:17:30.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28047.813224 secs 2024-04-27T02:17:30.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:17:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28744.843363 secs 2024-04-27T02:17:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28047.813224 secs 2024-04-27T02:17:30.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:17:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28744.843363 secs 2024-04-27T02:17:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28047.813224 secs 2024-04-27T02:17:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:17:31.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:30 smithi189 ceph-mon[32756]: pgmap v15766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:17:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:17:31.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:17:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:30 smithi156 ceph-mon[32679]: pgmap v15766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:17:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:17:31.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:17:31.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:30 smithi092 ceph-mon[29156]: pgmap v15766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:31.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:17:31.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:17:31.474 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:17:32.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:32 smithi189 ceph-mon[32756]: pgmap v15767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:32.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:32 smithi189 ceph-mon[32756]: pgmap v15768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:32.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:32 smithi156 ceph-mon[32679]: pgmap v15767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:32.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:32 smithi156 ceph-mon[32679]: pgmap v15768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:32.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:32 smithi092 ceph-mon[29156]: pgmap v15767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:32.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:32 smithi092 ceph-mon[29156]: pgmap v15768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:34.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:34 smithi189 ceph-mon[32756]: pgmap v15769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:17:34.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:34 smithi156 ceph-mon[32679]: pgmap v15769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:17:34.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:34 smithi092 ceph-mon[29156]: pgmap v15769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:17:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28749.843437 secs 2024-04-27T02:17:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28052.813339 secs 2024-04-27T02:17:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28749.843437 secs 2024-04-27T02:17:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28052.813339 secs 2024-04-27T02:17:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28749.843437 secs 2024-04-27T02:17:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28052.813339 secs 2024-04-27T02:17:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:36 smithi189 ceph-mon[32756]: pgmap v15770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:36 smithi156 ceph-mon[32679]: pgmap v15770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:36 smithi092 ceph-mon[29156]: pgmap v15770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:38.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:38 smithi189 ceph-mon[32756]: pgmap v15771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:38.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:38 smithi156 ceph-mon[32679]: pgmap v15771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:38.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:38 smithi092 ceph-mon[29156]: pgmap v15771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:17:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:40 smithi189 ceph-mon[32756]: pgmap v15772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:17:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28754.843513 secs 2024-04-27T02:17:40.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28057.813458 secs 2024-04-27T02:17:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:40 smithi156 ceph-mon[32679]: pgmap v15772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:17:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28754.843513 secs 2024-04-27T02:17:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28057.813458 secs 2024-04-27T02:17:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:40 smithi092 ceph-mon[29156]: pgmap v15772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:17:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28754.843513 secs 2024-04-27T02:17:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28057.813458 secs 2024-04-27T02:17:42.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:42 smithi189 ceph-mon[32756]: pgmap v15773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:42.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:42 smithi156 ceph-mon[32679]: pgmap v15773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:42.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:42 smithi092 ceph-mon[29156]: pgmap v15773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:17:44.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:44 smithi189 ceph-mon[32756]: pgmap v15774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:44.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:44 smithi156 ceph-mon[32679]: pgmap v15774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:44.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:44 smithi092 ceph-mon[29156]: pgmap v15774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:45.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28759.843625 secs 2024-04-27T02:17:45.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28062.813522 secs 2024-04-27T02:17:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28759.843625 secs 2024-04-27T02:17:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28062.813522 secs 2024-04-27T02:17:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28759.843625 secs 2024-04-27T02:17:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28062.813522 secs 2024-04-27T02:17:46.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:46 smithi189 ceph-mon[32756]: pgmap v15775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:46.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:46 smithi156 ceph-mon[32679]: pgmap v15775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:46.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:46 smithi092 ceph-mon[29156]: pgmap v15775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:48.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:48 smithi189 ceph-mon[32756]: pgmap v15776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:48.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:48 smithi156 ceph-mon[32679]: pgmap v15776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:48.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:48 smithi092 ceph-mon[29156]: pgmap v15776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:17:50.272 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:50 smithi092 ceph-mon[29156]: pgmap v15777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:50.273 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28764.843741 secs 2024-04-27T02:17:50.273 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28067.813609 secs 2024-04-27T02:17:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:50 smithi189 ceph-mon[32756]: pgmap v15777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28764.843741 secs 2024-04-27T02:17:50.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28067.813609 secs 2024-04-27T02:17:50.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:50 smithi156 ceph-mon[32679]: pgmap v15777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:17:50.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28764.843741 secs 2024-04-27T02:17:50.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28067.813609 secs 2024-04-27T02:17:52.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:52 smithi189 ceph-mon[32756]: pgmap v15778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:52.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:52 smithi156 ceph-mon[32679]: pgmap v15778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:52.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:52 smithi092 ceph-mon[29156]: pgmap v15778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:54.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:54 smithi189 ceph-mon[32756]: pgmap v15779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:54.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:54 smithi156 ceph-mon[32679]: pgmap v15779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:54.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:54 smithi092 ceph-mon[29156]: pgmap v15779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28769.843891 secs 2024-04-27T02:17:55.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28072.813680 secs 2024-04-27T02:17:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28769.843891 secs 2024-04-27T02:17:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28072.813680 secs 2024-04-27T02:17:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28769.843891 secs 2024-04-27T02:17:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28072.813680 secs 2024-04-27T02:17:56.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:56 smithi189 ceph-mon[32756]: pgmap v15780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:56.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:56 smithi156 ceph-mon[32679]: pgmap v15780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:56.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:56 smithi092 ceph-mon[29156]: pgmap v15780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:17:58.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:17:58 smithi189 ceph-mon[32756]: pgmap v15781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:58.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:17:58 smithi156 ceph-mon[32679]: pgmap v15781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:17:58.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:17:58 smithi092 ceph-mon[29156]: pgmap v15781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:00 smithi189 ceph-mon[32756]: pgmap v15782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28774.844003 secs 2024-04-27T02:18:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28077.813819 secs 2024-04-27T02:18:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:00 smithi156 ceph-mon[32679]: pgmap v15782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28774.844003 secs 2024-04-27T02:18:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28077.813819 secs 2024-04-27T02:18:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:00 smithi092 ceph-mon[29156]: pgmap v15782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28774.844003 secs 2024-04-27T02:18:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28077.813819 secs 2024-04-27T02:18:02.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:02 smithi189 ceph-mon[32756]: pgmap v15783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:02.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:02 smithi156 ceph-mon[32679]: pgmap v15783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:02.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:02 smithi092 ceph-mon[29156]: pgmap v15783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:04.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:04 smithi189 ceph-mon[32756]: pgmap v15784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:04.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:04 smithi156 ceph-mon[32679]: pgmap v15784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:04.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:04 smithi092 ceph-mon[29156]: pgmap v15784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28779.844129 secs 2024-04-27T02:18:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28082.813894 secs 2024-04-27T02:18:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28779.844129 secs 2024-04-27T02:18:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28082.813894 secs 2024-04-27T02:18:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28779.844129 secs 2024-04-27T02:18:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28082.813894 secs 2024-04-27T02:18:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:06 smithi189 ceph-mon[32756]: pgmap v15785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:06.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:06 smithi156 ceph-mon[32679]: pgmap v15785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:06.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:06 smithi092 ceph-mon[29156]: pgmap v15785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:08.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:08 smithi189 ceph-mon[32756]: pgmap v15786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:08.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:08 smithi156 ceph-mon[32679]: pgmap v15786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:08.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:08 smithi092 ceph-mon[29156]: pgmap v15786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:10 smithi189 ceph-mon[32756]: pgmap v15787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28784.844207 secs 2024-04-27T02:18:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28087.813995 secs 2024-04-27T02:18:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:10 smithi156 ceph-mon[32679]: pgmap v15787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28784.844207 secs 2024-04-27T02:18:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28087.813995 secs 2024-04-27T02:18:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:10 smithi092 ceph-mon[29156]: pgmap v15787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28784.844207 secs 2024-04-27T02:18:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28087.813995 secs 2024-04-27T02:18:12.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:12 smithi189 ceph-mon[32756]: pgmap v15788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:12 smithi156 ceph-mon[32679]: pgmap v15788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:12.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:12 smithi092 ceph-mon[29156]: pgmap v15788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:14.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:14 smithi189 ceph-mon[32756]: pgmap v15789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:14.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:14 smithi156 ceph-mon[32679]: pgmap v15789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:14.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:14 smithi092 ceph-mon[29156]: pgmap v15789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28789.844327 secs 2024-04-27T02:18:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28092.814110 secs 2024-04-27T02:18:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28789.844327 secs 2024-04-27T02:18:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28092.814110 secs 2024-04-27T02:18:15.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28789.844327 secs 2024-04-27T02:18:15.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28092.814110 secs 2024-04-27T02:18:16.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:16 smithi189 ceph-mon[32756]: pgmap v15790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:16.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:16 smithi156 ceph-mon[32679]: pgmap v15790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:16.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:16 smithi092 ceph-mon[29156]: pgmap v15790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:18.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:18 smithi189 ceph-mon[32756]: pgmap v15791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:18.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:18 smithi156 ceph-mon[32679]: pgmap v15791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:18.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:18 smithi092 ceph-mon[29156]: pgmap v15791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:19.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:19 smithi156 ceph-mon[32679]: pgmap v15792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:19.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:19 smithi092 ceph-mon[29156]: pgmap v15792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:19.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:19 smithi189 ceph-mon[32756]: pgmap v15792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:20.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28794.844446 secs 2024-04-27T02:18:20.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28097.814248 secs 2024-04-27T02:18:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28794.844446 secs 2024-04-27T02:18:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28097.814248 secs 2024-04-27T02:18:20.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28794.844446 secs 2024-04-27T02:18:20.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28097.814248 secs 2024-04-27T02:18:21.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:21 smithi156 ceph-mon[32679]: pgmap v15793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:21.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:21 smithi092 ceph-mon[29156]: pgmap v15793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:21.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:21 smithi189 ceph-mon[32756]: pgmap v15793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:23.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:23 smithi092 ceph-mon[29156]: pgmap v15794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:24.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:23 smithi189 ceph-mon[32756]: pgmap v15794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:24.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:23 smithi156 ceph-mon[32679]: pgmap v15794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:24.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28799.844564 secs 2024-04-27T02:18:24.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28102.814402 secs 2024-04-27T02:18:25.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28799.844564 secs 2024-04-27T02:18:25.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28102.814402 secs 2024-04-27T02:18:25.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28799.844564 secs 2024-04-27T02:18:25.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28102.814402 secs 2024-04-27T02:18:25.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:25 smithi092 ceph-mon[29156]: pgmap v15795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:26.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:25 smithi189 ceph-mon[32756]: pgmap v15795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:26.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:25 smithi156 ceph-mon[32679]: pgmap v15795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:27.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:27 smithi092 ceph-mon[29156]: pgmap v15796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:28.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:27 smithi189 ceph-mon[32756]: pgmap v15796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:28.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:27 smithi156 ceph-mon[32679]: pgmap v15796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:29.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:29 smithi092 ceph-mon[29156]: pgmap v15797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:29.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28804.844682 secs 2024-04-27T02:18:29.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28107.814508 secs 2024-04-27T02:18:30.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:29 smithi189 ceph-mon[32756]: pgmap v15797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:30.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28804.844682 secs 2024-04-27T02:18:30.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28107.814508 secs 2024-04-27T02:18:30.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:29 smithi156 ceph-mon[32679]: pgmap v15797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:30.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28804.844682 secs 2024-04-27T02:18:30.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28107.814508 secs 2024-04-27T02:18:31.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:31 smithi092 ceph-mon[29156]: pgmap v15798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:31.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:18:31.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:18:31.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:18:31.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:18:32.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:31 smithi189 ceph-mon[32756]: pgmap v15798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:32.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:18:32.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:18:32.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:18:32.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:18:32.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:31 smithi156 ceph-mon[32679]: pgmap v15798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:32.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:18:32.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:18:32.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:18:32.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:18:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:32 smithi092 ceph-mon[29156]: pgmap v15799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:18:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:32 smithi092 ceph-mon[29156]: pgmap v15800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:33.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:32 smithi189 ceph-mon[32756]: pgmap v15799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:18:33.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:32 smithi189 ceph-mon[32756]: pgmap v15800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:33.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:32 smithi156 ceph-mon[32679]: pgmap v15799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:18:33.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:32 smithi156 ceph-mon[32679]: pgmap v15800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:34.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:34 smithi092 ceph-mon[29156]: pgmap v15801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:34.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28809.844802 secs 2024-04-27T02:18:34.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28112.814579 secs 2024-04-27T02:18:35.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:34 smithi189 ceph-mon[32756]: pgmap v15801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:35.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28809.844802 secs 2024-04-27T02:18:35.115 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28112.814579 secs 2024-04-27T02:18:35.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:34 smithi156 ceph-mon[32679]: pgmap v15801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:35.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28809.844802 secs 2024-04-27T02:18:35.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28112.814579 secs 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80af000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca80af000 comp rx=0 tx=0).stop 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T02:18:36.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T02:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.035+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:18:36.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.036+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:18:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T02:18:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T02:18:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:18:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=30 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T02:18:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T02:18:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:36.079+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T02:18:36.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:36 smithi092 ceph-mon[29156]: pgmap v15802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:37.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:36 smithi189 ceph-mon[32756]: pgmap v15802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:37.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:36 smithi156 ceph-mon[32679]: pgmap v15802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:38.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:38 smithi092 ceph-mon[29156]: pgmap v15803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:39.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:38 smithi189 ceph-mon[32756]: pgmap v15803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:39.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:38 smithi156 ceph-mon[32679]: pgmap v15803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:18:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:39.935+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:18:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:39.935+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:18:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:39.936+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:18:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:18:39.936+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 223 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006540 con 0x5617fb906f00 2024-04-27T02:18:39.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28814.844869 secs 2024-04-27T02:18:39.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28117.814697 secs 2024-04-27T02:18:40.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28814.844869 secs 2024-04-27T02:18:40.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28117.814697 secs 2024-04-27T02:18:40.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28814.844869 secs 2024-04-27T02:18:40.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28117.814697 secs 2024-04-27T02:18:40.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:40 smithi092 ceph-mon[29156]: pgmap v15804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:41.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:40 smithi189 ceph-mon[32756]: pgmap v15804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:41.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:40 smithi156 ceph-mon[32679]: pgmap v15804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:18:43.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:43 smithi092 ceph-mon[29156]: pgmap v15805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:18:43.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:43 smithi189 ceph-mon[32756]: pgmap v15805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:18:43.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:43 smithi156 ceph-mon[32679]: pgmap v15805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:18:45.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:45 smithi189 ceph-mon[32756]: pgmap v15806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:45.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28819.844977 secs 2024-04-27T02:18:45.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28122.814789 secs 2024-04-27T02:18:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:45 smithi156 ceph-mon[32679]: pgmap v15806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28819.844977 secs 2024-04-27T02:18:45.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28122.814789 secs 2024-04-27T02:18:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:45 smithi092 ceph-mon[29156]: pgmap v15806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28819.844977 secs 2024-04-27T02:18:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28122.814789 secs 2024-04-27T02:18:47.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:47 smithi189 ceph-mon[32756]: pgmap v15807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:47.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:47 smithi156 ceph-mon[32679]: pgmap v15807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:47.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:47 smithi092 ceph-mon[29156]: pgmap v15807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:49.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:49 smithi189 ceph-mon[32756]: pgmap v15808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:49.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:49 smithi156 ceph-mon[32679]: pgmap v15808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:49.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:49 smithi092 ceph-mon[29156]: pgmap v15808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:50.311 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28824.845039 secs 2024-04-27T02:18:50.311 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28127.814927 secs 2024-04-27T02:18:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28824.845039 secs 2024-04-27T02:18:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28127.814927 secs 2024-04-27T02:18:50.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28824.845039 secs 2024-04-27T02:18:50.371 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28127.814927 secs 2024-04-27T02:18:51.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:51 smithi189 ceph-mon[32756]: pgmap v15809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:51.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:51 smithi156 ceph-mon[32679]: pgmap v15809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:51.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:51 smithi092 ceph-mon[29156]: pgmap v15809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:53.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:53 smithi189 ceph-mon[32756]: pgmap v15810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:53.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:53 smithi156 ceph-mon[32679]: pgmap v15810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:53.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:53 smithi092 ceph-mon[29156]: pgmap v15810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:55 smithi189 ceph-mon[32756]: pgmap v15811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28829.845121 secs 2024-04-27T02:18:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28132.815070 secs 2024-04-27T02:18:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:55 smithi156 ceph-mon[32679]: pgmap v15811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28829.845121 secs 2024-04-27T02:18:55.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28132.815070 secs 2024-04-27T02:18:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:55 smithi092 ceph-mon[29156]: pgmap v15811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28829.845121 secs 2024-04-27T02:18:55.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28132.815070 secs 2024-04-27T02:18:57.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:57 smithi189 ceph-mon[32756]: pgmap v15812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:57.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:57 smithi156 ceph-mon[32679]: pgmap v15812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:57.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:57 smithi092 ceph-mon[29156]: pgmap v15812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:18:59.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:18:59 smithi189 ceph-mon[32756]: pgmap v15813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:59.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:18:59 smithi156 ceph-mon[32679]: pgmap v15813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:18:59.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:18:59 smithi092 ceph-mon[29156]: pgmap v15813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28834.845225 secs 2024-04-27T02:19:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28137.815177 secs 2024-04-27T02:19:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28834.845225 secs 2024-04-27T02:19:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28137.815177 secs 2024-04-27T02:19:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28834.845225 secs 2024-04-27T02:19:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28137.815177 secs 2024-04-27T02:19:01.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:01 smithi189 ceph-mon[32756]: pgmap v15814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:01.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:01 smithi156 ceph-mon[32679]: pgmap v15814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:01.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:01 smithi092 ceph-mon[29156]: pgmap v15814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:03.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:03 smithi189 ceph-mon[32756]: pgmap v15815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:03.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:03 smithi156 ceph-mon[32679]: pgmap v15815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:03.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:03 smithi092 ceph-mon[29156]: pgmap v15815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:05 smithi189 ceph-mon[32756]: pgmap v15816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28839.845337 secs 2024-04-27T02:19:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28142.815316 secs 2024-04-27T02:19:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:05 smithi156 ceph-mon[32679]: pgmap v15816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28839.845337 secs 2024-04-27T02:19:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28142.815316 secs 2024-04-27T02:19:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:05 smithi092 ceph-mon[29156]: pgmap v15816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28839.845337 secs 2024-04-27T02:19:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28142.815316 secs 2024-04-27T02:19:07.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:07 smithi189 ceph-mon[32756]: pgmap v15817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:07.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:07 smithi156 ceph-mon[32679]: pgmap v15817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:07.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:07 smithi092 ceph-mon[29156]: pgmap v15817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:08.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:19:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:19:08.517+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:19:08.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:19:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:19:08.517+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:19:08.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:19:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:19:08.517+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:19:08.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:19:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:19:08.517+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:19:08.970 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:19:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:19:08.517+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:19:09.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:09 smithi189 ceph-mon[32756]: pgmap v15818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:09.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:09 smithi156 ceph-mon[32679]: pgmap v15818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:09 smithi092 ceph-mon[29156]: pgmap v15818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28844.845472 secs 2024-04-27T02:19:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28147.815350 secs 2024-04-27T02:19:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28844.845472 secs 2024-04-27T02:19:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28147.815350 secs 2024-04-27T02:19:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28844.845472 secs 2024-04-27T02:19:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28147.815350 secs 2024-04-27T02:19:11.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:11 smithi189 ceph-mon[32756]: pgmap v15819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:11.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:11 smithi156 ceph-mon[32679]: pgmap v15819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:11.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:11 smithi092 ceph-mon[29156]: pgmap v15819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:12.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:12 smithi189 ceph-mon[32756]: pgmap v15820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:12.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:12 smithi156 ceph-mon[32679]: pgmap v15820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:12.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:12 smithi092 ceph-mon[29156]: pgmap v15820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:14.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:14 smithi092 ceph-mon[29156]: pgmap v15821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:14.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:14 smithi189 ceph-mon[32756]: pgmap v15821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:14 smithi156 ceph-mon[32679]: pgmap v15821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:15.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28849.845597 secs 2024-04-27T02:19:15.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28152.815496 secs 2024-04-27T02:19:15.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28849.845597 secs 2024-04-27T02:19:15.766 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28152.815496 secs 2024-04-27T02:19:15.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28849.845597 secs 2024-04-27T02:19:15.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28152.815496 secs 2024-04-27T02:19:16.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:16 smithi092 ceph-mon[29156]: pgmap v15822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:16.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:16 smithi189 ceph-mon[32756]: pgmap v15822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:16.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:16 smithi156 ceph-mon[32679]: pgmap v15822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:18.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:18 smithi092 ceph-mon[29156]: pgmap v15823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:18.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:18 smithi189 ceph-mon[32756]: pgmap v15823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:18.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:18 smithi156 ceph-mon[32679]: pgmap v15823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:20.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28854.845707 secs 2024-04-27T02:19:20.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28157.815640 secs 2024-04-27T02:19:20.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:20 smithi189 ceph-mon[32756]: pgmap v15824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:20.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28854.845707 secs 2024-04-27T02:19:20.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28157.815640 secs 2024-04-27T02:19:20.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:20 smithi156 ceph-mon[32679]: pgmap v15824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:20.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28854.845707 secs 2024-04-27T02:19:20.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28157.815640 secs 2024-04-27T02:19:20.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:20 smithi092 ceph-mon[29156]: pgmap v15824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:22.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:22 smithi189 ceph-mon[32756]: pgmap v15825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:22.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:22 smithi156 ceph-mon[32679]: pgmap v15825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:22.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:22 smithi092 ceph-mon[29156]: pgmap v15825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:24.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:24 smithi189 ceph-mon[32756]: pgmap v15826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:24.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:24 smithi156 ceph-mon[32679]: pgmap v15826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:24.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:24 smithi092 ceph-mon[29156]: pgmap v15826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:19:25.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28859.845854 secs 2024-04-27T02:19:25.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28162.815760 secs 2024-04-27T02:19:25.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28859.845854 secs 2024-04-27T02:19:25.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28162.815760 secs 2024-04-27T02:19:25.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28859.845854 secs 2024-04-27T02:19:25.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28162.815760 secs 2024-04-27T02:19:26.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:26 smithi189 ceph-mon[32756]: pgmap v15827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:26.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:26 smithi156 ceph-mon[32679]: pgmap v15827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:26.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:26 smithi092 ceph-mon[29156]: pgmap v15827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:19:28.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:28 smithi189 ceph-mon[32756]: pgmap v15828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:28.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:28 smithi156 ceph-mon[32679]: pgmap v15828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:28.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:28 smithi092 ceph-mon[29156]: pgmap v15828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:29.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28167.815831 secs 2024-04-27T02:19:29.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28167.815831 secs 2024-04-27T02:19:29.957 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28167.815831 secs 2024-04-27T02:19:30.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28864.845992 secs 2024-04-27T02:19:30.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:30 smithi189 ceph-mon[32756]: pgmap v15829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:30.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28864.845992 secs 2024-04-27T02:19:30.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:30 smithi156 ceph-mon[32679]: pgmap v15829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:30.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28864.845992 secs 2024-04-27T02:19:30.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:30 smithi092 ceph-mon[29156]: pgmap v15829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:32.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:32 smithi189 ceph-mon[32756]: pgmap v15830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:32.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:19:32.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:19:32.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:19:32.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:19:32.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:32 smithi156 ceph-mon[32679]: pgmap v15830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:32.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:19:32.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:19:32.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:19:32.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:19:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:32 smithi092 ceph-mon[29156]: pgmap v15830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:19:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:19:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:19:32.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:19:33.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:33 smithi189 ceph-mon[32756]: pgmap v15831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:19:33.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:33 smithi189 ceph-mon[32756]: pgmap v15832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:33.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:33 smithi156 ceph-mon[32679]: pgmap v15831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:19:33.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:33 smithi156 ceph-mon[32679]: pgmap v15832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:33.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:33 smithi092 ceph-mon[29156]: pgmap v15831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:19:33.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:33 smithi092 ceph-mon[29156]: pgmap v15832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:34.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28172.815948 secs 2024-04-27T02:19:34.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28172.815948 secs 2024-04-27T02:19:34.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28172.815948 secs 2024-04-27T02:19:35.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28869.846112 secs 2024-04-27T02:19:35.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:35 smithi189 ceph-mon[32756]: pgmap v15833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:35.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28869.846112 secs 2024-04-27T02:19:35.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:35 smithi156 ceph-mon[32679]: pgmap v15833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:35.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28869.846112 secs 2024-04-27T02:19:35.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:35 smithi092 ceph-mon[29156]: pgmap v15833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:37.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:37 smithi189 ceph-mon[32756]: pgmap v15834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:37.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:37 smithi156 ceph-mon[32679]: pgmap v15834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:37.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:37 smithi092 ceph-mon[29156]: pgmap v15834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:39.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:39 smithi189 ceph-mon[32756]: pgmap v15835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:19:39.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28177.816050 secs 2024-04-27T02:19:39.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:39 smithi156 ceph-mon[32679]: pgmap v15835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:19:39.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28177.816050 secs 2024-04-27T02:19:39.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:39 smithi092 ceph-mon[29156]: pgmap v15835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:19:39.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28177.816050 secs 2024-04-27T02:19:40.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28874.846197 secs 2024-04-27T02:19:40.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28874.846197 secs 2024-04-27T02:19:40.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28874.846197 secs 2024-04-27T02:19:41.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:41 smithi189 ceph-mon[32756]: pgmap v15836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:41.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:41 smithi156 ceph-mon[32679]: pgmap v15836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:41.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:41 smithi092 ceph-mon[29156]: pgmap v15836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:19:43.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:43 smithi189 ceph-mon[32756]: pgmap v15837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:19:43.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:43 smithi156 ceph-mon[32679]: pgmap v15837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:19:43.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:43 smithi092 ceph-mon[29156]: pgmap v15837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:19:44.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28182.816167 secs 2024-04-27T02:19:44.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28182.816167 secs 2024-04-27T02:19:44.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28182.816167 secs 2024-04-27T02:19:45.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28879.846326 secs 2024-04-27T02:19:45.829 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:45 smithi092 ceph-mon[29156]: pgmap v15838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:45.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28879.846326 secs 2024-04-27T02:19:45.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:45 smithi189 ceph-mon[32756]: pgmap v15838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:45.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28879.846326 secs 2024-04-27T02:19:45.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:45 smithi156 ceph-mon[32679]: pgmap v15838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:47.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:47 smithi189 ceph-mon[32756]: pgmap v15839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:47.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:47 smithi156 ceph-mon[32679]: pgmap v15839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:47.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:47 smithi092 ceph-mon[29156]: pgmap v15839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:49.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:49 smithi189 ceph-mon[32756]: pgmap v15840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:49.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28187.816273 secs 2024-04-27T02:19:49.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:49 smithi156 ceph-mon[32679]: pgmap v15840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:49.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28187.816273 secs 2024-04-27T02:19:49.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:49 smithi092 ceph-mon[29156]: pgmap v15840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:49.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28187.816273 secs 2024-04-27T02:19:50.811 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28884.846459 secs 2024-04-27T02:19:50.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28884.846459 secs 2024-04-27T02:19:50.871 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28884.846459 secs 2024-04-27T02:19:51.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:51 smithi189 ceph-mon[32756]: pgmap v15841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:51.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:51 smithi156 ceph-mon[32679]: pgmap v15841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:51.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:51 smithi092 ceph-mon[29156]: pgmap v15841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:53.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:53 smithi189 ceph-mon[32756]: pgmap v15842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:53.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:53 smithi156 ceph-mon[32679]: pgmap v15842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:53.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:53 smithi092 ceph-mon[29156]: pgmap v15842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:54.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28192.816396 secs 2024-04-27T02:19:54.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28192.816396 secs 2024-04-27T02:19:54.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28192.816396 secs 2024-04-27T02:19:55.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28889.846576 secs 2024-04-27T02:19:55.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:55 smithi189 ceph-mon[32756]: pgmap v15843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:55.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28889.846576 secs 2024-04-27T02:19:55.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:55 smithi156 ceph-mon[32679]: pgmap v15843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:55.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28889.846576 secs 2024-04-27T02:19:55.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:55 smithi092 ceph-mon[29156]: pgmap v15843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:19:57.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:57 smithi189 ceph-mon[32756]: pgmap v15844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:57.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:57 smithi156 ceph-mon[32679]: pgmap v15844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:57.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:57 smithi092 ceph-mon[29156]: pgmap v15844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:59.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:59 smithi189 ceph-mon[32756]: pgmap v15845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:59.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:19:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28197.816486 secs 2024-04-27T02:19:59.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:59 smithi156 ceph-mon[32679]: pgmap v15845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:59.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:19:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28197.816486 secs 2024-04-27T02:19:59.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:59 smithi092 ceph-mon[29156]: pgmap v15845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:19:59.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:19:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28197.816486 secs 2024-04-27T02:20:00.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28894.846694 secs 2024-04-27T02:20:00.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:20:00.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28894.846694 secs 2024-04-27T02:20:00.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:20:00.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28894.846694 secs 2024-04-27T02:20:00.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:20:01.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:01 smithi189 ceph-mon[32756]: pgmap v15846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:01.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:01 smithi156 ceph-mon[32679]: pgmap v15846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:01.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:01 smithi092 ceph-mon[29156]: pgmap v15846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:03.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:03 smithi189 ceph-mon[32756]: pgmap v15847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:03.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:03 smithi156 ceph-mon[32679]: pgmap v15847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:03.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:03 smithi092 ceph-mon[29156]: pgmap v15847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:04.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28899.846769 secs 2024-04-27T02:20:04.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28202.816605 secs 2024-04-27T02:20:04.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28899.846769 secs 2024-04-27T02:20:04.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28202.816605 secs 2024-04-27T02:20:04.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28899.846769 secs 2024-04-27T02:20:04.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28202.816605 secs 2024-04-27T02:20:05.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:05 smithi189 ceph-mon[32756]: pgmap v15848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:05.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:05 smithi156 ceph-mon[32679]: pgmap v15848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:05.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:05 smithi092 ceph-mon[29156]: pgmap v15848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:07.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:07 smithi189 ceph-mon[32756]: pgmap v15849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:07.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:07 smithi156 ceph-mon[32679]: pgmap v15849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:07.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:07 smithi092 ceph-mon[29156]: pgmap v15849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:09.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:09 smithi189 ceph-mon[32756]: pgmap v15850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:09.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:09 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 28904.846885 secs 2024-04-27T02:20:09.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:09 smithi189 ceph-mon[32756]: slow request 360.303966 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:20:09.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28207.816722 secs 2024-04-27T02:20:09.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:09 smithi156 ceph-mon[32679]: pgmap v15850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:09.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:09 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 28904.846885 secs 2024-04-27T02:20:09.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:09 smithi156 ceph-mon[32679]: slow request 360.303966 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:20:09.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28207.816722 secs 2024-04-27T02:20:09.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:09 smithi092 ceph-mon[29156]: pgmap v15850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:09.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:09 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 28904.846885 secs 2024-04-27T02:20:09.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:09 smithi092 ceph-mon[29156]: slow request 360.303966 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:20:09.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28207.816722 secs 2024-04-27T02:20:11.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:11 smithi189 ceph-mon[32756]: pgmap v15851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:11.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:11 smithi156 ceph-mon[32679]: pgmap v15851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:11.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:11 smithi092 ceph-mon[29156]: pgmap v15851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:13.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:13 smithi189 ceph-mon[32756]: pgmap v15852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:13.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:13 smithi156 ceph-mon[32679]: pgmap v15852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:13.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:13 smithi092 ceph-mon[29156]: pgmap v15852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:14.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28909.846999 secs 2024-04-27T02:20:14.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28212.816881 secs 2024-04-27T02:20:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28909.846999 secs 2024-04-27T02:20:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28212.816881 secs 2024-04-27T02:20:14.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28909.846999 secs 2024-04-27T02:20:14.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28212.816881 secs 2024-04-27T02:20:15.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:15 smithi189 ceph-mon[32756]: pgmap v15853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:15.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:15 smithi156 ceph-mon[32679]: pgmap v15853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:15.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:15 smithi092 ceph-mon[29156]: pgmap v15853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:18.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:18 smithi189 ceph-mon[32756]: pgmap v15854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:18.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:18 smithi156 ceph-mon[32679]: pgmap v15854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:18.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:18 smithi092 ceph-mon[29156]: pgmap v15854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:20 smithi189 ceph-mon[32756]: pgmap v15855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28914.847119 secs 2024-04-27T02:20:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28217.816977 secs 2024-04-27T02:20:20.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:20 smithi156 ceph-mon[32679]: pgmap v15855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:20.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28914.847119 secs 2024-04-27T02:20:20.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28217.816977 secs 2024-04-27T02:20:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:20 smithi092 ceph-mon[29156]: pgmap v15855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28914.847119 secs 2024-04-27T02:20:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28217.816977 secs 2024-04-27T02:20:22.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:22 smithi189 ceph-mon[32756]: pgmap v15856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:22.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:22 smithi156 ceph-mon[32679]: pgmap v15856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:22.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:22 smithi092 ceph-mon[29156]: pgmap v15856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:24.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:24 smithi189 ceph-mon[32756]: pgmap v15857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:24.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:24 smithi156 ceph-mon[32679]: pgmap v15857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:24.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:24 smithi092 ceph-mon[29156]: pgmap v15857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28919.847223 secs 2024-04-27T02:20:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28222.817094 secs 2024-04-27T02:20:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28919.847223 secs 2024-04-27T02:20:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28222.817094 secs 2024-04-27T02:20:25.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28919.847223 secs 2024-04-27T02:20:25.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28222.817094 secs 2024-04-27T02:20:26.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:26 smithi189 ceph-mon[32756]: pgmap v15858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:26.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:26 smithi156 ceph-mon[32679]: pgmap v15858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:26.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:26 smithi092 ceph-mon[29156]: pgmap v15858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:28.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:28 smithi189 ceph-mon[32756]: pgmap v15859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:28.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:28 smithi156 ceph-mon[32679]: pgmap v15859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:28.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:28 smithi092 ceph-mon[29156]: pgmap v15859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:30 smithi189 ceph-mon[32756]: pgmap v15860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28924.847303 secs 2024-04-27T02:20:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28227.817211 secs 2024-04-27T02:20:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:30 smithi156 ceph-mon[32679]: pgmap v15860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28924.847303 secs 2024-04-27T02:20:30.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28227.817211 secs 2024-04-27T02:20:30.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:30 smithi092 ceph-mon[29156]: pgmap v15860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:30.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28924.847303 secs 2024-04-27T02:20:30.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28227.817211 secs 2024-04-27T02:20:32.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:32 smithi092 ceph-mon[29156]: pgmap v15861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:32.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:32 smithi189 ceph-mon[32756]: pgmap v15861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:32.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:32 smithi156 ceph-mon[32679]: pgmap v15861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:33.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:34.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:34 smithi189 ceph-mon[32756]: pgmap v15862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:34.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:34 smithi156 ceph-mon[32679]: pgmap v15862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:34.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:34 smithi092 ceph-mon[29156]: pgmap v15862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28929.847366 secs 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28232.817327 secs 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28929.847366 secs 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28232.817327 secs 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28929.847366 secs 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28232.817327 secs 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:35.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: pgmap v15863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:20:36.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: pgmap v15863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:20:36.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: pgmap v15863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:20:36.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:20:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: pgmap v15864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:37.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:37 smithi189 ceph-mon[32756]: pgmap v15865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: pgmap v15864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:37.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:37 smithi156 ceph-mon[32679]: pgmap v15865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:20:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:20:37.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: pgmap v15864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:37.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:37 smithi092 ceph-mon[29156]: pgmap v15865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:39.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:39 smithi189 ceph-mon[32756]: pgmap v15866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:39.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:39 smithi156 ceph-mon[32679]: pgmap v15866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:39.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:39 smithi092 ceph-mon[29156]: pgmap v15866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28934.847506 secs 2024-04-27T02:20:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28237.817443 secs 2024-04-27T02:20:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:40 smithi189 ceph-mon[32756]: pgmap v15867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28934.847506 secs 2024-04-27T02:20:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28237.817443 secs 2024-04-27T02:20:40.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:40 smithi156 ceph-mon[32679]: pgmap v15867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28934.847506 secs 2024-04-27T02:20:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28237.817443 secs 2024-04-27T02:20:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:40 smithi092 ceph-mon[29156]: pgmap v15867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:43.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:42 smithi156 ceph-mon[32679]: pgmap v15868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:43.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:42 smithi092 ceph-mon[29156]: pgmap v15868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:43.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:42 smithi189 ceph-mon[32756]: pgmap v15868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:45.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28939.847621 secs 2024-04-27T02:20:45.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:44 smithi156 ceph-mon[32679]: pgmap v15869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:45.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28242.817561 secs 2024-04-27T02:20:45.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28939.847621 secs 2024-04-27T02:20:45.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:44 smithi189 ceph-mon[32756]: pgmap v15869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:45.165 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28242.817561 secs 2024-04-27T02:20:45.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28939.847621 secs 2024-04-27T02:20:45.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:44 smithi092 ceph-mon[29156]: pgmap v15869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:20:45.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28242.817561 secs 2024-04-27T02:20:47.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:46 smithi156 ceph-mon[32679]: pgmap v15870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:20:47.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:46 smithi092 ceph-mon[29156]: pgmap v15870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:20:47.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:46 smithi189 ceph-mon[32756]: pgmap v15870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:20:49.141 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:48 smithi092 ceph-mon[29156]: pgmap v15871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:49.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:48 smithi156 ceph-mon[32679]: pgmap v15871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:49.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:48 smithi189 ceph-mon[32756]: pgmap v15871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:50.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28944.847740 secs 2024-04-27T02:20:50.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28247.817679 secs 2024-04-27T02:20:50.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28944.847740 secs 2024-04-27T02:20:50.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28247.817679 secs 2024-04-27T02:20:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28944.847740 secs 2024-04-27T02:20:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28247.817679 secs 2024-04-27T02:20:51.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:50 smithi156 ceph-mon[32679]: pgmap v15872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:51.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:50 smithi092 ceph-mon[29156]: pgmap v15872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:51.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:50 smithi189 ceph-mon[32756]: pgmap v15872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:53.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:52 smithi156 ceph-mon[32679]: pgmap v15873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:53.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:52 smithi092 ceph-mon[29156]: pgmap v15873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:53.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:52 smithi189 ceph-mon[32756]: pgmap v15873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28949.847896 secs 2024-04-27T02:20:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:54 smithi156 ceph-mon[32679]: pgmap v15874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:55.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28252.817820 secs 2024-04-27T02:20:55.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28949.847896 secs 2024-04-27T02:20:55.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:54 smithi092 ceph-mon[29156]: pgmap v15874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:55.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28252.817820 secs 2024-04-27T02:20:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28949.847896 secs 2024-04-27T02:20:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:54 smithi189 ceph-mon[32756]: pgmap v15874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:20:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28252.817820 secs 2024-04-27T02:20:57.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:56 smithi156 ceph-mon[32679]: pgmap v15875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:57.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:56 smithi092 ceph-mon[29156]: pgmap v15875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:57.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:56 smithi189 ceph-mon[32756]: pgmap v15875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:59.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:58 smithi156 ceph-mon[32679]: pgmap v15876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:59.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:58 smithi092 ceph-mon[29156]: pgmap v15876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:20:59.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:58 smithi189 ceph-mon[32756]: pgmap v15876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:00.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28954.847992 secs 2024-04-27T02:21:00.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:20:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28257.817959 secs 2024-04-27T02:21:00.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28954.847992 secs 2024-04-27T02:21:00.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:20:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28257.817959 secs 2024-04-27T02:21:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28954.847992 secs 2024-04-27T02:21:00.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:20:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28257.817959 secs 2024-04-27T02:21:01.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:00 smithi156 ceph-mon[32679]: pgmap v15877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:01.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:00 smithi092 ceph-mon[29156]: pgmap v15877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:01.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:00 smithi189 ceph-mon[32756]: pgmap v15877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:03.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:02 smithi156 ceph-mon[32679]: pgmap v15878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:03.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:02 smithi092 ceph-mon[29156]: pgmap v15878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:03.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:02 smithi189 ceph-mon[32756]: pgmap v15878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:05.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28959.848102 secs 2024-04-27T02:21:05.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:04 smithi156 ceph-mon[32679]: pgmap v15879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:05.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28262.818080 secs 2024-04-27T02:21:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28959.848102 secs 2024-04-27T02:21:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:04 smithi092 ceph-mon[29156]: pgmap v15879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:05.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28262.818080 secs 2024-04-27T02:21:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28959.848102 secs 2024-04-27T02:21:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:04 smithi189 ceph-mon[32756]: pgmap v15879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:05.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28262.818080 secs 2024-04-27T02:21:07.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:06 smithi156 ceph-mon[32679]: pgmap v15880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:07.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:06 smithi092 ceph-mon[29156]: pgmap v15880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:07.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:06 smithi189 ceph-mon[32756]: pgmap v15880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:09.222 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:08 smithi092 ceph-mon[29156]: pgmap v15881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:09.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:08 smithi189 ceph-mon[32756]: pgmap v15881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:09.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:08 smithi156 ceph-mon[32679]: pgmap v15881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:10.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28964.848200 secs 2024-04-27T02:21:10.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28267.818232 secs 2024-04-27T02:21:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28964.848200 secs 2024-04-27T02:21:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28267.818232 secs 2024-04-27T02:21:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28964.848200 secs 2024-04-27T02:21:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28267.818232 secs 2024-04-27T02:21:11.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:10 smithi092 ceph-mon[29156]: pgmap v15882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:11.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:10 smithi189 ceph-mon[32756]: pgmap v15882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:11.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:10 smithi156 ceph-mon[32679]: pgmap v15882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:13.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:12 smithi092 ceph-mon[29156]: pgmap v15883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:13.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:12 smithi189 ceph-mon[32756]: pgmap v15883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:13.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:12 smithi156 ceph-mon[32679]: pgmap v15883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:15.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28969.848319 secs 2024-04-27T02:21:15.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:14 smithi092 ceph-mon[29156]: pgmap v15884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:15.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28272.818371 secs 2024-04-27T02:21:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28969.848319 secs 2024-04-27T02:21:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:14 smithi189 ceph-mon[32756]: pgmap v15884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28272.818371 secs 2024-04-27T02:21:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28969.848319 secs 2024-04-27T02:21:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:14 smithi156 ceph-mon[32679]: pgmap v15884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:15.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28272.818371 secs 2024-04-27T02:21:17.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:16 smithi092 ceph-mon[29156]: pgmap v15885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:17.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:16 smithi189 ceph-mon[32756]: pgmap v15885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:17.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:16 smithi156 ceph-mon[32679]: pgmap v15885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:19.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:18 smithi092 ceph-mon[29156]: pgmap v15886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:19.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:18 smithi189 ceph-mon[32756]: pgmap v15886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:19.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:18 smithi156 ceph-mon[32679]: pgmap v15886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:20.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28974.848437 secs 2024-04-27T02:21:20.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28277.818482 secs 2024-04-27T02:21:20.311 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28974.848437 secs 2024-04-27T02:21:20.311 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28277.818482 secs 2024-04-27T02:21:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28974.848437 secs 2024-04-27T02:21:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28277.818482 secs 2024-04-27T02:21:21.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:20 smithi092 ceph-mon[29156]: pgmap v15887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:21.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:20 smithi189 ceph-mon[32756]: pgmap v15887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:21.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:20 smithi156 ceph-mon[32679]: pgmap v15887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:23.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:22 smithi092 ceph-mon[29156]: pgmap v15888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:23.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:22 smithi189 ceph-mon[32756]: pgmap v15888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:23.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:22 smithi156 ceph-mon[32679]: pgmap v15888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:25.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28979.848563 secs 2024-04-27T02:21:25.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:24 smithi092 ceph-mon[29156]: pgmap v15889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:25.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28282.818591 secs 2024-04-27T02:21:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28979.848563 secs 2024-04-27T02:21:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:24 smithi189 ceph-mon[32756]: pgmap v15889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28282.818591 secs 2024-04-27T02:21:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28979.848563 secs 2024-04-27T02:21:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:24 smithi156 ceph-mon[32679]: pgmap v15889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:25.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28282.818591 secs 2024-04-27T02:21:27.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:26 smithi092 ceph-mon[29156]: pgmap v15890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:27.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:26 smithi189 ceph-mon[32756]: pgmap v15890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:27.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:26 smithi156 ceph-mon[32679]: pgmap v15890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:29.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:28 smithi092 ceph-mon[29156]: pgmap v15891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:29.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:28 smithi189 ceph-mon[32756]: pgmap v15891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:29.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:28 smithi156 ceph-mon[32679]: pgmap v15891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:30.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28984.848683 secs 2024-04-27T02:21:30.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28287.818683 secs 2024-04-27T02:21:30.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28984.848683 secs 2024-04-27T02:21:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28287.818683 secs 2024-04-27T02:21:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28984.848683 secs 2024-04-27T02:21:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28287.818683 secs 2024-04-27T02:21:31.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:30 smithi092 ceph-mon[29156]: pgmap v15892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:31.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:30 smithi189 ceph-mon[32756]: pgmap v15892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:31.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:30 smithi156 ceph-mon[32679]: pgmap v15892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:33.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:32 smithi092 ceph-mon[29156]: pgmap v15893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:33.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:32 smithi189 ceph-mon[32756]: pgmap v15893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:33.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:32 smithi156 ceph-mon[32679]: pgmap v15893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:35.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28989.848814 secs 2024-04-27T02:21:35.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:34 smithi092 ceph-mon[29156]: pgmap v15894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:35.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28292.818798 secs 2024-04-27T02:21:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28989.848814 secs 2024-04-27T02:21:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:34 smithi189 ceph-mon[32756]: pgmap v15894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28292.818798 secs 2024-04-27T02:21:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28989.848814 secs 2024-04-27T02:21:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:34 smithi156 ceph-mon[32679]: pgmap v15894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28292.818798 secs 2024-04-27T02:21:36.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:21:36.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:21:36.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:21:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:37 smithi189 ceph-mon[32756]: pgmap v15895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:21:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:21:37.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:21:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:37 smithi156 ceph-mon[32679]: pgmap v15895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:21:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:21:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:21:37.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:37 smithi092 ceph-mon[29156]: pgmap v15895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:37.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:21:37.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:21:37.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:21:38.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:38 smithi189 ceph-mon[32756]: pgmap v15896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:21:38.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:38 smithi189 ceph-mon[32756]: pgmap v15897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:38 smithi156 ceph-mon[32679]: pgmap v15896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:21:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:38 smithi156 ceph-mon[32679]: pgmap v15897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:38 smithi092 ceph-mon[29156]: pgmap v15896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:21:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:38 smithi092 ceph-mon[29156]: pgmap v15897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:21:39.959+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:21:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:21:39.959+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:21:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:21:39.959+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:21:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:21:39.959+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 224 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:21:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:40 smithi189 ceph-mon[32756]: pgmap v15898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:40 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 28994.848843 secs 2024-04-27T02:21:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:40 smithi189 ceph-mon[32756]: slow request 11523.365839 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:21:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28297.818919 secs 2024-04-27T02:21:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:40 smithi156 ceph-mon[32679]: pgmap v15898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:40 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 28994.848843 secs 2024-04-27T02:21:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:40 smithi156 ceph-mon[32679]: slow request 11523.365839 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:21:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28297.818919 secs 2024-04-27T02:21:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:40 smithi092 ceph-mon[29156]: pgmap v15898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:40 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 28994.848843 secs 2024-04-27T02:21:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:40 smithi092 ceph-mon[29156]: slow request 11523.365839 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:21:40.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28297.818919 secs 2024-04-27T02:21:42.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:42 smithi189 ceph-mon[32756]: pgmap v15899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:42.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:42 smithi156 ceph-mon[32679]: pgmap v15899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:42.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:42 smithi092 ceph-mon[29156]: pgmap v15899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:44.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:44 smithi189 ceph-mon[32756]: pgmap v15900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:21:44.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:44 smithi156 ceph-mon[32679]: pgmap v15900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:21:44.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:44 smithi092 ceph-mon[29156]: pgmap v15900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:21:45.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 28999.848907 secs 2024-04-27T02:21:45.265 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28302.819035 secs 2024-04-27T02:21:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 28999.848907 secs 2024-04-27T02:21:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28302.819035 secs 2024-04-27T02:21:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 28999.848907 secs 2024-04-27T02:21:45.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28302.819035 secs 2024-04-27T02:21:46.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:46 smithi189 ceph-mon[32756]: pgmap v15901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:46.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:46 smithi156 ceph-mon[32679]: pgmap v15901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:46.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:46 smithi092 ceph-mon[29156]: pgmap v15901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:21:48.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:48 smithi189 ceph-mon[32756]: pgmap v15902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:21:48.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:48 smithi156 ceph-mon[32679]: pgmap v15902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:21:48.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:48 smithi092 ceph-mon[29156]: pgmap v15902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:21:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:50 smithi189 ceph-mon[32756]: pgmap v15903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29004.848990 secs 2024-04-27T02:21:50.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28307.819119 secs 2024-04-27T02:21:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:50 smithi156 ceph-mon[32679]: pgmap v15903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29004.848990 secs 2024-04-27T02:21:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28307.819119 secs 2024-04-27T02:21:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:50 smithi092 ceph-mon[29156]: pgmap v15903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29004.848990 secs 2024-04-27T02:21:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28307.819119 secs 2024-04-27T02:21:52.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:52 smithi189 ceph-mon[32756]: pgmap v15904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:52.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:52 smithi156 ceph-mon[32679]: pgmap v15904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:52.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:52 smithi092 ceph-mon[29156]: pgmap v15904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:54.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:54 smithi189 ceph-mon[32756]: pgmap v15905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:54.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:54 smithi156 ceph-mon[32679]: pgmap v15905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:54.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:54 smithi092 ceph-mon[29156]: pgmap v15905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29009.849054 secs 2024-04-27T02:21:55.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28312.819196 secs 2024-04-27T02:21:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29009.849054 secs 2024-04-27T02:21:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28312.819196 secs 2024-04-27T02:21:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29009.849054 secs 2024-04-27T02:21:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28312.819196 secs 2024-04-27T02:21:56.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:56 smithi189 ceph-mon[32756]: pgmap v15906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:56.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:56 smithi156 ceph-mon[32679]: pgmap v15906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:56.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:56 smithi092 ceph-mon[29156]: pgmap v15906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:21:58.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:21:58 smithi189 ceph-mon[32756]: pgmap v15907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:58.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:21:58 smithi156 ceph-mon[32679]: pgmap v15907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:21:58.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:21:58 smithi092 ceph-mon[29156]: pgmap v15907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:00 smithi189 ceph-mon[32756]: pgmap v15908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29014.849121 secs 2024-04-27T02:22:00.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28317.819332 secs 2024-04-27T02:22:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:00 smithi156 ceph-mon[32679]: pgmap v15908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29014.849121 secs 2024-04-27T02:22:00.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28317.819332 secs 2024-04-27T02:22:00.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:00 smithi092 ceph-mon[29156]: pgmap v15908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29014.849121 secs 2024-04-27T02:22:00.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28317.819332 secs 2024-04-27T02:22:02.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:02 smithi189 ceph-mon[32756]: pgmap v15909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:02.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:02 smithi156 ceph-mon[32679]: pgmap v15909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:02.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:02 smithi092 ceph-mon[29156]: pgmap v15909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:04.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:04 smithi189 ceph-mon[32756]: pgmap v15910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:04.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:04 smithi156 ceph-mon[32679]: pgmap v15910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:04.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:04 smithi092 ceph-mon[29156]: pgmap v15910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29019.849229 secs 2024-04-27T02:22:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28322.819377 secs 2024-04-27T02:22:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29019.849229 secs 2024-04-27T02:22:05.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28322.819377 secs 2024-04-27T02:22:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29019.849229 secs 2024-04-27T02:22:05.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28322.819377 secs 2024-04-27T02:22:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:06 smithi189 ceph-mon[32756]: pgmap v15911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:06 smithi156 ceph-mon[32679]: pgmap v15911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:06 smithi092 ceph-mon[29156]: pgmap v15911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:08.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:08 smithi189 ceph-mon[32756]: pgmap v15912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:08.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:08 smithi156 ceph-mon[32679]: pgmap v15912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:08.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:08 smithi092 ceph-mon[29156]: pgmap v15912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:10 smithi189 ceph-mon[32756]: pgmap v15913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29024.849358 secs 2024-04-27T02:22:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:10 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 28327.819484 secs 2024-04-27T02:22:10.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:10 smithi189 ceph-mon[32756]: slow request 1440.784568 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:22:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:10 smithi156 ceph-mon[32679]: pgmap v15913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29024.849358 secs 2024-04-27T02:22:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:10 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 28327.819484 secs 2024-04-27T02:22:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:10 smithi156 ceph-mon[32679]: slow request 1440.784568 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:22:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:10 smithi092 ceph-mon[29156]: pgmap v15913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29024.849358 secs 2024-04-27T02:22:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:10 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 28327.819484 secs 2024-04-27T02:22:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:10 smithi092 ceph-mon[29156]: slow request 1440.784568 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:22:12.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:12 smithi189 ceph-mon[32756]: pgmap v15914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:12.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:12 smithi156 ceph-mon[32679]: pgmap v15914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:12.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:12 smithi092 ceph-mon[29156]: pgmap v15914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:14.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:14 smithi189 ceph-mon[32756]: pgmap v15915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:14.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:14 smithi156 ceph-mon[32679]: pgmap v15915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:14.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:14 smithi092 ceph-mon[29156]: pgmap v15915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29029.849475 secs 2024-04-27T02:22:15.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28332.819622 secs 2024-04-27T02:22:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29029.849475 secs 2024-04-27T02:22:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28332.819622 secs 2024-04-27T02:22:15.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29029.849475 secs 2024-04-27T02:22:15.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28332.819622 secs 2024-04-27T02:22:16.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:16 smithi189 ceph-mon[32756]: pgmap v15916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:16.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:16 smithi156 ceph-mon[32679]: pgmap v15916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:16.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:16 smithi092 ceph-mon[29156]: pgmap v15916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:18.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:18 smithi189 ceph-mon[32756]: pgmap v15917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:18.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:18 smithi156 ceph-mon[32679]: pgmap v15917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:18.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:18 smithi092 ceph-mon[29156]: pgmap v15917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:20 smithi189 ceph-mon[32756]: pgmap v15918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29034.849569 secs 2024-04-27T02:22:20.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28337.819695 secs 2024-04-27T02:22:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:20 smithi156 ceph-mon[32679]: pgmap v15918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29034.849569 secs 2024-04-27T02:22:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28337.819695 secs 2024-04-27T02:22:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:20 smithi092 ceph-mon[29156]: pgmap v15918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29034.849569 secs 2024-04-27T02:22:20.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28337.819695 secs 2024-04-27T02:22:22.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:22 smithi189 ceph-mon[32756]: pgmap v15919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:22.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:22 smithi156 ceph-mon[32679]: pgmap v15919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:22.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:22 smithi092 ceph-mon[29156]: pgmap v15919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:24.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:24 smithi189 ceph-mon[32756]: pgmap v15920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:24.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:24 smithi156 ceph-mon[32679]: pgmap v15920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:24.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:24 smithi092 ceph-mon[29156]: pgmap v15920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29039.849701 secs 2024-04-27T02:22:25.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28342.819759 secs 2024-04-27T02:22:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29039.849701 secs 2024-04-27T02:22:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28342.819759 secs 2024-04-27T02:22:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29039.849701 secs 2024-04-27T02:22:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28342.819759 secs 2024-04-27T02:22:26.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:26 smithi189 ceph-mon[32756]: pgmap v15921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:26.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:26 smithi156 ceph-mon[32679]: pgmap v15921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:26.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:26 smithi092 ceph-mon[29156]: pgmap v15921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:28.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:28 smithi189 ceph-mon[32756]: pgmap v15922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:28.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:28 smithi156 ceph-mon[32679]: pgmap v15922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:28.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:28 smithi092 ceph-mon[29156]: pgmap v15922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:30 smithi189 ceph-mon[32756]: pgmap v15923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29044.849851 secs 2024-04-27T02:22:30.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28347.819821 secs 2024-04-27T02:22:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:30 smithi156 ceph-mon[32679]: pgmap v15923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29044.849851 secs 2024-04-27T02:22:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28347.819821 secs 2024-04-27T02:22:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:30 smithi092 ceph-mon[29156]: pgmap v15923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29044.849851 secs 2024-04-27T02:22:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28347.819821 secs 2024-04-27T02:22:32.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:32 smithi189 ceph-mon[32756]: pgmap v15924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:32.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:32 smithi156 ceph-mon[32679]: pgmap v15924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:32.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:32 smithi092 ceph-mon[29156]: pgmap v15924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:34.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:34 smithi189 ceph-mon[32756]: pgmap v15925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:34.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:34 smithi156 ceph-mon[32679]: pgmap v15925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:34.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:34 smithi092 ceph-mon[29156]: pgmap v15925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29049.849926 secs 2024-04-27T02:22:35.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28352.819944 secs 2024-04-27T02:22:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29049.849926 secs 2024-04-27T02:22:35.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28352.819944 secs 2024-04-27T02:22:35.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29049.849926 secs 2024-04-27T02:22:35.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28352.819944 secs 2024-04-27T02:22:36.366 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:36 smithi189 ceph-mon[32756]: pgmap v15926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:36.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:36 smithi156 ceph-mon[32679]: pgmap v15926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:36.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:36 smithi092 ceph-mon[29156]: pgmap v15926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:37.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:22:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:22:37.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:22:38.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:38 smithi189 ceph-mon[32756]: pgmap v15927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:38.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:22:38.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:22:38.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:22:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:38 smithi156 ceph-mon[32679]: pgmap v15927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:22:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:22:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:22:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:38 smithi092 ceph-mon[29156]: pgmap v15927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:22:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:22:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:22:39.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:39 smithi189 ceph-mon[32756]: pgmap v15928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:22:39.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:39 smithi189 ceph-mon[32756]: pgmap v15929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:39.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:39 smithi156 ceph-mon[32679]: pgmap v15928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:22:39.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:39 smithi156 ceph-mon[32679]: pgmap v15929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:39.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:39 smithi092 ceph-mon[29156]: pgmap v15928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:22:39.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:39 smithi092 ceph-mon[29156]: pgmap v15929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29054.850046 secs 2024-04-27T02:22:40.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28357.820055 secs 2024-04-27T02:22:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29054.850046 secs 2024-04-27T02:22:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28357.820055 secs 2024-04-27T02:22:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29054.850046 secs 2024-04-27T02:22:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28357.820055 secs 2024-04-27T02:22:41.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:41 smithi189 ceph-mon[32756]: pgmap v15930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:41.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:41 smithi156 ceph-mon[32679]: pgmap v15930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:41.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:41 smithi092 ceph-mon[29156]: pgmap v15930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:42.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:42 smithi092 ceph-mon[29156]: pgmap v15931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:42.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:42 smithi189 ceph-mon[32756]: pgmap v15931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:42.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:42 smithi156 ceph-mon[32679]: pgmap v15931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:44.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:44 smithi092 ceph-mon[29156]: pgmap v15932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:44.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:44 smithi189 ceph-mon[32756]: pgmap v15932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:44.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:44 smithi156 ceph-mon[32679]: pgmap v15932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:22:45.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29059.850169 secs 2024-04-27T02:22:45.765 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28362.820189 secs 2024-04-27T02:22:45.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29059.850169 secs 2024-04-27T02:22:45.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28362.820189 secs 2024-04-27T02:22:45.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29059.850169 secs 2024-04-27T02:22:45.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28362.820189 secs 2024-04-27T02:22:46.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:46 smithi189 ceph-mon[32756]: pgmap v15933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:46.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:46 smithi156 ceph-mon[32679]: pgmap v15933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:46.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:46 smithi092 ceph-mon[29156]: pgmap v15933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:22:48.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:48 smithi189 ceph-mon[32756]: pgmap v15934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:22:48.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:48 smithi156 ceph-mon[32679]: pgmap v15934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:22:48.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:48 smithi092 ceph-mon[29156]: pgmap v15934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:22:50.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29064.850231 secs 2024-04-27T02:22:50.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28367.820334 secs 2024-04-27T02:22:50.772 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:50 smithi092 ceph-mon[29156]: pgmap v15935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:50.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29064.850231 secs 2024-04-27T02:22:50.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28367.820334 secs 2024-04-27T02:22:50.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:50 smithi189 ceph-mon[32756]: pgmap v15935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:50.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29064.850231 secs 2024-04-27T02:22:50.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28367.820334 secs 2024-04-27T02:22:50.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:50 smithi156 ceph-mon[32679]: pgmap v15935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:52.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:52 smithi189 ceph-mon[32756]: pgmap v15936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:52.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:52 smithi156 ceph-mon[32679]: pgmap v15936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:52.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:52 smithi092 ceph-mon[29156]: pgmap v15936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:54.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:54 smithi189 ceph-mon[32756]: pgmap v15937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:54.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:54 smithi156 ceph-mon[32679]: pgmap v15937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:54 smithi092 ceph-mon[29156]: pgmap v15937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:55.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29069.850366 secs 2024-04-27T02:22:55.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28372.820371 secs 2024-04-27T02:22:55.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29069.850366 secs 2024-04-27T02:22:55.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28372.820371 secs 2024-04-27T02:22:55.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29069.850366 secs 2024-04-27T02:22:55.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28372.820371 secs 2024-04-27T02:22:56.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:56 smithi189 ceph-mon[32756]: pgmap v15938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:56.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:56 smithi156 ceph-mon[32679]: pgmap v15938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:56.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:56 smithi092 ceph-mon[29156]: pgmap v15938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:22:58.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:22:58 smithi189 ceph-mon[32756]: pgmap v15939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:58.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:22:58 smithi156 ceph-mon[32679]: pgmap v15939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:22:58.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:22:58 smithi092 ceph-mon[29156]: pgmap v15939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:00.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29074.850504 secs 2024-04-27T02:23:00.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28377.820490 secs 2024-04-27T02:23:00.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:00 smithi189 ceph-mon[32756]: pgmap v15940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:00.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29074.850504 secs 2024-04-27T02:23:00.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28377.820490 secs 2024-04-27T02:23:00.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:00 smithi156 ceph-mon[32679]: pgmap v15940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:00.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29074.850504 secs 2024-04-27T02:23:00.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28377.820490 secs 2024-04-27T02:23:00.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:00 smithi092 ceph-mon[29156]: pgmap v15940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:02.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:02 smithi189 ceph-mon[32756]: pgmap v15941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:02.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:02 smithi156 ceph-mon[32679]: pgmap v15941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:02.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:02 smithi092 ceph-mon[29156]: pgmap v15941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:04.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:04 smithi189 ceph-mon[32756]: pgmap v15942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:04.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:04 smithi156 ceph-mon[32679]: pgmap v15942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:04.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:04 smithi092 ceph-mon[29156]: pgmap v15942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:05.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29079.850623 secs 2024-04-27T02:23:05.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28382.820624 secs 2024-04-27T02:23:05.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29079.850623 secs 2024-04-27T02:23:05.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28382.820624 secs 2024-04-27T02:23:05.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29079.850623 secs 2024-04-27T02:23:05.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28382.820624 secs 2024-04-27T02:23:06.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:06 smithi189 ceph-mon[32756]: pgmap v15943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:06.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:06 smithi156 ceph-mon[32679]: pgmap v15943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:06.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:06 smithi092 ceph-mon[29156]: pgmap v15943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:08.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:08 smithi189 ceph-mon[32756]: pgmap v15944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:08.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:08 smithi156 ceph-mon[32679]: pgmap v15944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:08.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:08 smithi092 ceph-mon[29156]: pgmap v15944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:09.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28387.820701 secs 2024-04-27T02:23:09.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28387.820701 secs 2024-04-27T02:23:09.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28387.820701 secs 2024-04-27T02:23:10.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29084.850764 secs 2024-04-27T02:23:10.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:10 smithi189 ceph-mon[32756]: pgmap v15945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:10.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29084.850764 secs 2024-04-27T02:23:10.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:10 smithi156 ceph-mon[32679]: pgmap v15945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:10.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29084.850764 secs 2024-04-27T02:23:10.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:10 smithi092 ceph-mon[29156]: pgmap v15945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:12.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:12 smithi189 ceph-mon[32756]: pgmap v15946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:12.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:12 smithi156 ceph-mon[32679]: pgmap v15946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:12.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:12 smithi092 ceph-mon[29156]: pgmap v15946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:14.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:14 smithi189 ceph-mon[32756]: pgmap v15947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:14.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28392.820818 secs 2024-04-27T02:23:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:14 smithi156 ceph-mon[32679]: pgmap v15947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28392.820818 secs 2024-04-27T02:23:14.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:14 smithi092 ceph-mon[29156]: pgmap v15947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:23:14.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28392.820818 secs 2024-04-27T02:23:15.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29089.850864 secs 2024-04-27T02:23:15.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29089.850864 secs 2024-04-27T02:23:15.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29089.850864 secs 2024-04-27T02:23:16.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:16 smithi189 ceph-mon[32756]: pgmap v15948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:16.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:16 smithi156 ceph-mon[32679]: pgmap v15948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:16.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:16 smithi092 ceph-mon[29156]: pgmap v15948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:23:18.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:18 smithi189 ceph-mon[32756]: pgmap v15949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:18 smithi156 ceph-mon[32679]: pgmap v15949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:18.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:18 smithi092 ceph-mon[29156]: pgmap v15949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:19.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28397.820890 secs 2024-04-27T02:23:19.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28397.820890 secs 2024-04-27T02:23:19.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28397.820890 secs 2024-04-27T02:23:20.810 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29094.850906 secs 2024-04-27T02:23:20.811 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:20 smithi156 ceph-mon[32679]: pgmap v15950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:20.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29094.850906 secs 2024-04-27T02:23:20.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:20 smithi189 ceph-mon[32756]: pgmap v15950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:20.870 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29094.850906 secs 2024-04-27T02:23:20.870 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:20 smithi092 ceph-mon[29156]: pgmap v15950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:22.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:22 smithi189 ceph-mon[32756]: pgmap v15951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:22.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:22 smithi156 ceph-mon[32679]: pgmap v15951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:22.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:22 smithi092 ceph-mon[29156]: pgmap v15951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:24.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:24 smithi189 ceph-mon[32756]: pgmap v15952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:24.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28402.820983 secs 2024-04-27T02:23:24.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:24 smithi156 ceph-mon[32679]: pgmap v15952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:24.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28402.820983 secs 2024-04-27T02:23:24.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:24 smithi092 ceph-mon[29156]: pgmap v15952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:24.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28402.820983 secs 2024-04-27T02:23:25.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29099.851016 secs 2024-04-27T02:23:25.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29099.851016 secs 2024-04-27T02:23:25.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29099.851016 secs 2024-04-27T02:23:26.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:26 smithi189 ceph-mon[32756]: pgmap v15953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:26.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:26 smithi156 ceph-mon[32679]: pgmap v15953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:26.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:26 smithi092 ceph-mon[29156]: pgmap v15953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:28.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:28 smithi189 ceph-mon[32756]: pgmap v15954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:28.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:28 smithi156 ceph-mon[32679]: pgmap v15954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:28.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:28 smithi092 ceph-mon[29156]: pgmap v15954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:29.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28407.821065 secs 2024-04-27T02:23:29.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28407.821065 secs 2024-04-27T02:23:29.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28407.821065 secs 2024-04-27T02:23:30.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29104.851092 secs 2024-04-27T02:23:30.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:30 smithi189 ceph-mon[32756]: pgmap v15955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:30.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29104.851092 secs 2024-04-27T02:23:30.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:30 smithi156 ceph-mon[32679]: pgmap v15955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:30.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29104.851092 secs 2024-04-27T02:23:30.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:30 smithi092 ceph-mon[29156]: pgmap v15955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:32.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:32 smithi189 ceph-mon[32756]: pgmap v15956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:32.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:32 smithi156 ceph-mon[32679]: pgmap v15956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:32.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:32 smithi092 ceph-mon[29156]: pgmap v15956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:34.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:34 smithi189 ceph-mon[32756]: pgmap v15957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:34.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28412.821185 secs 2024-04-27T02:23:34.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:34 smithi156 ceph-mon[32679]: pgmap v15957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:34.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28412.821185 secs 2024-04-27T02:23:34.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:34 smithi092 ceph-mon[29156]: pgmap v15957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:34.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28412.821185 secs 2024-04-27T02:23:35.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29109.851205 secs 2024-04-27T02:23:35.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29109.851205 secs 2024-04-27T02:23:35.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29109.851205 secs 2024-04-27T02:23:36.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:36 smithi189 ceph-mon[32756]: pgmap v15958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:36.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:36 smithi156 ceph-mon[32679]: pgmap v15958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:36.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:36 smithi092 ceph-mon[29156]: pgmap v15958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:37.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:23:37.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:23:37.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:23:38.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:38 smithi189 ceph-mon[32756]: pgmap v15959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:38.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:23:38.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:23:38.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:23:38.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:38 smithi156 ceph-mon[32679]: pgmap v15959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:38.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:23:38.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:23:38.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:23:38.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:38 smithi092 ceph-mon[29156]: pgmap v15959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:38.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:23:38.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:23:38.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:23:39.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:39 smithi189 ceph-mon[32756]: pgmap v15960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:23:39.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:39 smithi189 ceph-mon[32756]: pgmap v15961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:23:39.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28417.821282 secs 2024-04-27T02:23:39.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:39 smithi156 ceph-mon[32679]: pgmap v15960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:23:39.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:39 smithi156 ceph-mon[32679]: pgmap v15961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:23:39.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28417.821282 secs 2024-04-27T02:23:39.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:39 smithi092 ceph-mon[29156]: pgmap v15960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:23:39.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:39 smithi092 ceph-mon[29156]: pgmap v15961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:23:39.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28417.821282 secs 2024-04-27T02:23:40.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29114.851328 secs 2024-04-27T02:23:40.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29114.851328 secs 2024-04-27T02:23:40.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29114.851328 secs 2024-04-27T02:23:41.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:41 smithi189 ceph-mon[32756]: pgmap v15962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:41.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:41 smithi156 ceph-mon[32679]: pgmap v15962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:41.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:41 smithi092 ceph-mon[29156]: pgmap v15962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:43.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:43 smithi189 ceph-mon[32756]: pgmap v15963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:43.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:43 smithi156 ceph-mon[32679]: pgmap v15963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:43.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:43 smithi092 ceph-mon[29156]: pgmap v15963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:44.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29119.851441 secs 2024-04-27T02:23:44.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28422.821404 secs 2024-04-27T02:23:44.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29119.851441 secs 2024-04-27T02:23:44.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28422.821404 secs 2024-04-27T02:23:45.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29119.851441 secs 2024-04-27T02:23:45.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28422.821404 secs 2024-04-27T02:23:45.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:45 smithi156 ceph-mon[32679]: pgmap v15964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:45.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:45 smithi092 ceph-mon[29156]: pgmap v15964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:46.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:45 smithi189 ceph-mon[32756]: pgmap v15964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:47.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:47 smithi156 ceph-mon[32679]: pgmap v15965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:47.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:47 smithi092 ceph-mon[29156]: pgmap v15965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:48.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:47 smithi189 ceph-mon[32756]: pgmap v15965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:23:49.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:49 smithi156 ceph-mon[32679]: pgmap v15966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:23:49.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29124.851554 secs 2024-04-27T02:23:49.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28427.821541 secs 2024-04-27T02:23:49.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:49 smithi092 ceph-mon[29156]: pgmap v15966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:23:49.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29124.851554 secs 2024-04-27T02:23:49.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28427.821541 secs 2024-04-27T02:23:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:49 smithi189 ceph-mon[32756]: pgmap v15966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:23:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29124.851554 secs 2024-04-27T02:23:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28427.821541 secs 2024-04-27T02:23:51.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:51 smithi156 ceph-mon[32679]: pgmap v15967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:51.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:51 smithi092 ceph-mon[29156]: pgmap v15967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:52.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:51 smithi189 ceph-mon[32756]: pgmap v15967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:53.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:53 smithi156 ceph-mon[32679]: pgmap v15968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:53.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:53 smithi092 ceph-mon[29156]: pgmap v15968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:54.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:53 smithi189 ceph-mon[32756]: pgmap v15968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:54.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29129.851665 secs 2024-04-27T02:23:54.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28432.821620 secs 2024-04-27T02:23:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29129.851665 secs 2024-04-27T02:23:54.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28432.821620 secs 2024-04-27T02:23:55.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29129.851665 secs 2024-04-27T02:23:55.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28432.821620 secs 2024-04-27T02:23:55.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:55 smithi156 ceph-mon[32679]: pgmap v15969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:55.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:55 smithi092 ceph-mon[29156]: pgmap v15969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:56.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:55 smithi189 ceph-mon[32756]: pgmap v15969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:23:57.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:57 smithi156 ceph-mon[32679]: pgmap v15970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:57.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:57 smithi092 ceph-mon[29156]: pgmap v15970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:58.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:57 smithi189 ceph-mon[32756]: pgmap v15970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:59.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:59 smithi156 ceph-mon[32679]: pgmap v15971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:59.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29134.851802 secs 2024-04-27T02:23:59.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:23:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28437.821693 secs 2024-04-27T02:23:59.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:59 smithi092 ceph-mon[29156]: pgmap v15971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:23:59.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29134.851802 secs 2024-04-27T02:23:59.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:23:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28437.821693 secs 2024-04-27T02:24:00.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:59 smithi189 ceph-mon[32756]: pgmap v15971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:00.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29134.851802 secs 2024-04-27T02:24:00.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:23:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28437.821693 secs 2024-04-27T02:24:01.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:01 smithi156 ceph-mon[32679]: pgmap v15972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:01.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:01 smithi092 ceph-mon[29156]: pgmap v15972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:02.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:01 smithi189 ceph-mon[32756]: pgmap v15972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:03.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:03 smithi156 ceph-mon[32679]: pgmap v15973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:03.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:03 smithi092 ceph-mon[29156]: pgmap v15973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:04.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:03 smithi189 ceph-mon[32756]: pgmap v15973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:04.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29139.851917 secs 2024-04-27T02:24:04.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28442.821781 secs 2024-04-27T02:24:04.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29139.851917 secs 2024-04-27T02:24:04.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28442.821781 secs 2024-04-27T02:24:05.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29139.851917 secs 2024-04-27T02:24:05.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28442.821781 secs 2024-04-27T02:24:05.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:05 smithi156 ceph-mon[32679]: pgmap v15974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:05.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:05 smithi092 ceph-mon[29156]: pgmap v15974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:06.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:05 smithi189 ceph-mon[32756]: pgmap v15974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:07.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:07 smithi092 ceph-mon[29156]: pgmap v15975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:08.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:07 smithi189 ceph-mon[32756]: pgmap v15975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:08.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:07 smithi156 ceph-mon[32679]: pgmap v15975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:09.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:09 smithi092 ceph-mon[29156]: pgmap v15976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:09.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29144.852027 secs 2024-04-27T02:24:09.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28447.821904 secs 2024-04-27T02:24:10.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:09 smithi189 ceph-mon[32756]: pgmap v15976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:10.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29144.852027 secs 2024-04-27T02:24:10.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28447.821904 secs 2024-04-27T02:24:10.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:09 smithi156 ceph-mon[32679]: pgmap v15976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:10.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29144.852027 secs 2024-04-27T02:24:10.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28447.821904 secs 2024-04-27T02:24:11.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:11 smithi092 ceph-mon[29156]: pgmap v15977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:12.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:11 smithi189 ceph-mon[32756]: pgmap v15977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:12.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:11 smithi156 ceph-mon[32679]: pgmap v15977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:13.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:13 smithi092 ceph-mon[29156]: pgmap v15978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:14.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:13 smithi189 ceph-mon[32756]: pgmap v15978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:14.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:13 smithi156 ceph-mon[32679]: pgmap v15978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:14.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29149.852091 secs 2024-04-27T02:24:14.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28452.822024 secs 2024-04-27T02:24:15.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29149.852091 secs 2024-04-27T02:24:15.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28452.822024 secs 2024-04-27T02:24:15.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29149.852091 secs 2024-04-27T02:24:15.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28452.822024 secs 2024-04-27T02:24:15.969 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:15 smithi092 ceph-mon[29156]: pgmap v15979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:16.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:15 smithi189 ceph-mon[32756]: pgmap v15979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:16.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:15 smithi156 ceph-mon[32679]: pgmap v15979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:18.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:18 smithi189 ceph-mon[32756]: pgmap v15980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:18.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:18 smithi156 ceph-mon[32679]: pgmap v15980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:18.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:18 smithi092 ceph-mon[29156]: pgmap v15980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:20 smithi189 ceph-mon[32756]: pgmap v15981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29154.852206 secs 2024-04-27T02:24:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28457.822149 secs 2024-04-27T02:24:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:20 smithi156 ceph-mon[32679]: pgmap v15981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29154.852206 secs 2024-04-27T02:24:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28457.822149 secs 2024-04-27T02:24:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:20 smithi092 ceph-mon[29156]: pgmap v15981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29154.852206 secs 2024-04-27T02:24:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28457.822149 secs 2024-04-27T02:24:22.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:22 smithi189 ceph-mon[32756]: pgmap v15982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:22.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:22 smithi156 ceph-mon[32679]: pgmap v15982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:22.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:22 smithi092 ceph-mon[29156]: pgmap v15982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:24.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:24 smithi189 ceph-mon[32756]: pgmap v15983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:24.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:24 smithi156 ceph-mon[32679]: pgmap v15983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:24.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:24 smithi092 ceph-mon[29156]: pgmap v15983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:25.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29159.852269 secs 2024-04-27T02:24:25.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28462.822284 secs 2024-04-27T02:24:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29159.852269 secs 2024-04-27T02:24:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28462.822284 secs 2024-04-27T02:24:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29159.852269 secs 2024-04-27T02:24:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28462.822284 secs 2024-04-27T02:24:26.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:26 smithi092 ceph-mon[29156]: pgmap v15984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:26.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:26 smithi189 ceph-mon[32756]: pgmap v15984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:26.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:26 smithi156 ceph-mon[32679]: pgmap v15984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:28.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:28 smithi156 ceph-mon[32679]: pgmap v15985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:28.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:28 smithi092 ceph-mon[29156]: pgmap v15985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:28.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:28 smithi189 ceph-mon[32756]: pgmap v15985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:30 smithi156 ceph-mon[32679]: pgmap v15986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29164.852389 secs 2024-04-27T02:24:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28467.822345 secs 2024-04-27T02:24:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:30 smithi092 ceph-mon[29156]: pgmap v15986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29164.852389 secs 2024-04-27T02:24:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28467.822345 secs 2024-04-27T02:24:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:30 smithi189 ceph-mon[32756]: pgmap v15986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29164.852389 secs 2024-04-27T02:24:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28467.822345 secs 2024-04-27T02:24:32.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:32 smithi156 ceph-mon[32679]: pgmap v15987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:32.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:32 smithi092 ceph-mon[29156]: pgmap v15987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:32.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:32 smithi189 ceph-mon[32756]: pgmap v15987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:34.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:34 smithi156 ceph-mon[32679]: pgmap v15988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:34.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:34 smithi092 ceph-mon[29156]: pgmap v15988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:34.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:34 smithi189 ceph-mon[32756]: pgmap v15988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29169.852500 secs 2024-04-27T02:24:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28472.822447 secs 2024-04-27T02:24:35.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29169.852500 secs 2024-04-27T02:24:35.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28472.822447 secs 2024-04-27T02:24:35.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29169.852500 secs 2024-04-27T02:24:35.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28472.822447 secs 2024-04-27T02:24:36.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:36 smithi156 ceph-mon[32679]: pgmap v15989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:36.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:36 smithi092 ceph-mon[29156]: pgmap v15989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:36.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:36 smithi189 ceph-mon[32756]: pgmap v15989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:24:37.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:37 smithi156 ceph-mon[32679]: pgmap v15990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:37.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:37 smithi092 ceph-mon[29156]: pgmap v15990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:37.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:37 smithi189 ceph-mon[32756]: pgmap v15990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:38.969 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:24:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:24:38.614+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:24:38.969 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:24:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:24:38.614+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:24:38.969 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:24:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:24:38.614+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:24:38.969 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:24:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:24:38.614+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:24:38.969 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:24:38 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:24:38.614+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:24:39.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: pgmap v15991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:39.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:24:39.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:24:39.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:24:39.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: pgmap v15992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:24:39.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: pgmap v15993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:39.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: pgmap v15991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: pgmap v15992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: pgmap v15993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: pgmap v15991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: pgmap v15992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:24:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: pgmap v15993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:39.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:24:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:24:39.983+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:24:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:24:39.983+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:24:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:24:39.983+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:24:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:24:39.983+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 225 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:24:40.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29174.852566 secs 2024-04-27T02:24:40.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28477.822513 secs 2024-04-27T02:24:40.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29174.852566 secs 2024-04-27T02:24:40.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28477.822513 secs 2024-04-27T02:24:40.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29174.852566 secs 2024-04-27T02:24:40.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28477.822513 secs 2024-04-27T02:24:41.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:41 smithi189 ceph-mon[32756]: pgmap v15994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:41.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:41 smithi156 ceph-mon[32679]: pgmap v15994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:41.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:41 smithi092 ceph-mon[29156]: pgmap v15994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:24:44.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:44 smithi189 ceph-mon[32756]: pgmap v15995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:24:44.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:44 smithi156 ceph-mon[32679]: pgmap v15995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:24:44.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:44 smithi092 ceph-mon[29156]: pgmap v15995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:24:45.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29179.852682 secs 2024-04-27T02:24:45.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28482.822593 secs 2024-04-27T02:24:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29179.852682 secs 2024-04-27T02:24:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28482.822593 secs 2024-04-27T02:24:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29179.852682 secs 2024-04-27T02:24:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28482.822593 secs 2024-04-27T02:24:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:46 smithi189 ceph-mon[32756]: pgmap v15996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:46 smithi156 ceph-mon[32679]: pgmap v15996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:46.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:46 smithi092 ceph-mon[29156]: pgmap v15996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:48.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:48 smithi189 ceph-mon[32756]: pgmap v15997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:48.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:48 smithi156 ceph-mon[32679]: pgmap v15997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:48.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:48 smithi092 ceph-mon[29156]: pgmap v15997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T02:24:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29184.852745 secs 2024-04-27T02:24:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28487.822749 secs 2024-04-27T02:24:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:50 smithi189 ceph-mon[32756]: pgmap v15998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T02:24:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29184.852745 secs 2024-04-27T02:24:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28487.822749 secs 2024-04-27T02:24:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:50 smithi156 ceph-mon[32679]: pgmap v15998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T02:24:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29184.852745 secs 2024-04-27T02:24:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28487.822749 secs 2024-04-27T02:24:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:50 smithi092 ceph-mon[29156]: pgmap v15998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T02:24:52.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:52 smithi189 ceph-mon[32756]: pgmap v15999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:52.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:52 smithi156 ceph-mon[32679]: pgmap v15999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:52.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:52 smithi092 ceph-mon[29156]: pgmap v15999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:54.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:54 smithi189 ceph-mon[32756]: pgmap v16000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:54.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:54 smithi156 ceph-mon[32679]: pgmap v16000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:54.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:54 smithi092 ceph-mon[29156]: pgmap v16000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:24:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29189.852860 secs 2024-04-27T02:24:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28492.822852 secs 2024-04-27T02:24:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29189.852860 secs 2024-04-27T02:24:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28492.822852 secs 2024-04-27T02:24:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29189.852860 secs 2024-04-27T02:24:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28492.822852 secs 2024-04-27T02:24:56.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:56 smithi189 ceph-mon[32756]: pgmap v16001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:24:56.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:56 smithi156 ceph-mon[32679]: pgmap v16001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:24:56.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:56 smithi092 ceph-mon[29156]: pgmap v16001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:24:58.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:24:58 smithi189 ceph-mon[32756]: pgmap v16002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:58.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:24:58 smithi156 ceph-mon[32679]: pgmap v16002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:24:58.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:24:58 smithi092 ceph-mon[29156]: pgmap v16002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29194.852982 secs 2024-04-27T02:25:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28497.822968 secs 2024-04-27T02:25:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:00 smithi189 ceph-mon[32756]: pgmap v16003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29194.852982 secs 2024-04-27T02:25:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28497.822968 secs 2024-04-27T02:25:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:00 smithi156 ceph-mon[32679]: pgmap v16003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:00.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29194.852982 secs 2024-04-27T02:25:00.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28497.822968 secs 2024-04-27T02:25:00.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:00 smithi092 ceph-mon[29156]: pgmap v16003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:02.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:02 smithi189 ceph-mon[32756]: pgmap v16004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:02.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:02 smithi156 ceph-mon[32679]: pgmap v16004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:02.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:02 smithi092 ceph-mon[29156]: pgmap v16004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:04.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:04 smithi189 ceph-mon[32756]: pgmap v16005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:04.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:04 smithi156 ceph-mon[32679]: pgmap v16005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:04.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:04 smithi092 ceph-mon[29156]: pgmap v16005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29199.853132 secs 2024-04-27T02:25:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28502.823032 secs 2024-04-27T02:25:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29199.853132 secs 2024-04-27T02:25:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28502.823032 secs 2024-04-27T02:25:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29199.853132 secs 2024-04-27T02:25:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28502.823032 secs 2024-04-27T02:25:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:06 smithi189 ceph-mon[32756]: pgmap v16006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:06 smithi156 ceph-mon[32679]: pgmap v16006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:06 smithi092 ceph-mon[29156]: pgmap v16006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:08.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:08 smithi189 ceph-mon[32756]: pgmap v16007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:08.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:08 smithi156 ceph-mon[32679]: pgmap v16007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:08.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:08 smithi092 ceph-mon[29156]: pgmap v16007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29204.853271 secs 2024-04-27T02:25:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28507.823140 secs 2024-04-27T02:25:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:10 smithi189 ceph-mon[32756]: pgmap v16008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29204.853271 secs 2024-04-27T02:25:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28507.823140 secs 2024-04-27T02:25:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:10 smithi156 ceph-mon[32679]: pgmap v16008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29204.853271 secs 2024-04-27T02:25:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28507.823140 secs 2024-04-27T02:25:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:10 smithi092 ceph-mon[29156]: pgmap v16008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:12.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:12 smithi189 ceph-mon[32756]: pgmap v16009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:12.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:12 smithi156 ceph-mon[32679]: pgmap v16009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:12.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:12 smithi092 ceph-mon[29156]: pgmap v16009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:14.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:14 smithi189 ceph-mon[32756]: pgmap v16010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:14.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:14 smithi156 ceph-mon[32679]: pgmap v16010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:14.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:14 smithi092 ceph-mon[29156]: pgmap v16010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:25:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29209.853385 secs 2024-04-27T02:25:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28512.823255 secs 2024-04-27T02:25:15.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29209.853385 secs 2024-04-27T02:25:15.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28512.823255 secs 2024-04-27T02:25:15.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29209.853385 secs 2024-04-27T02:25:15.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28512.823255 secs 2024-04-27T02:25:16.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:16 smithi156 ceph-mon[32679]: pgmap v16011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:16.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:16 smithi092 ceph-mon[29156]: pgmap v16011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:16.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:16 smithi189 ceph-mon[32756]: pgmap v16011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:25:18.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:18 smithi156 ceph-mon[32679]: pgmap v16012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:18.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:18 smithi092 ceph-mon[29156]: pgmap v16012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:18.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:18 smithi189 ceph-mon[32756]: pgmap v16012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29214.853505 secs 2024-04-27T02:25:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28517.823356 secs 2024-04-27T02:25:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:20 smithi156 ceph-mon[32679]: pgmap v16013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29214.853505 secs 2024-04-27T02:25:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28517.823356 secs 2024-04-27T02:25:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:20 smithi092 ceph-mon[29156]: pgmap v16013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:20.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29214.853505 secs 2024-04-27T02:25:20.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28517.823356 secs 2024-04-27T02:25:20.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:20 smithi189 ceph-mon[32756]: pgmap v16013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:22.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:22 smithi156 ceph-mon[32679]: pgmap v16014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:22.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:22 smithi092 ceph-mon[29156]: pgmap v16014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:22.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:22 smithi189 ceph-mon[32756]: pgmap v16014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:24.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:24 smithi156 ceph-mon[32679]: pgmap v16015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:24.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:24 smithi092 ceph-mon[29156]: pgmap v16015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:24.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:24 smithi189 ceph-mon[32756]: pgmap v16015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:25:24.990+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:25:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:25:24.990+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:25:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:25:24.990+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:25:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:25:24.990+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 226 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:25:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29219.853619 secs 2024-04-27T02:25:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28522.823439 secs 2024-04-27T02:25:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29219.853619 secs 2024-04-27T02:25:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28522.823439 secs 2024-04-27T02:25:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29219.853619 secs 2024-04-27T02:25:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28522.823439 secs 2024-04-27T02:25:26.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:26 smithi156 ceph-mon[32679]: pgmap v16016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:26.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:26 smithi092 ceph-mon[29156]: pgmap v16016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:26.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:26 smithi189 ceph-mon[32756]: pgmap v16016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:28.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:28 smithi156 ceph-mon[32679]: pgmap v16017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:28.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:28 smithi092 ceph-mon[29156]: pgmap v16017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:28.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:28 smithi189 ceph-mon[32756]: pgmap v16017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:29.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:29 smithi092 ceph-mon[29156]: pgmap v16018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:29.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:29 smithi189 ceph-mon[32756]: pgmap v16018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:29.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:29 smithi156 ceph-mon[32679]: pgmap v16018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29224.853736 secs 2024-04-27T02:25:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28527.823516 secs 2024-04-27T02:25:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29224.853736 secs 2024-04-27T02:25:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28527.823516 secs 2024-04-27T02:25:30.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29224.853736 secs 2024-04-27T02:25:30.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28527.823516 secs 2024-04-27T02:25:31.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:31 smithi092 ceph-mon[29156]: pgmap v16019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:31.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:31 smithi189 ceph-mon[32756]: pgmap v16019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:31.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:31 smithi156 ceph-mon[32679]: pgmap v16019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:34.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:34 smithi189 ceph-mon[32756]: pgmap v16020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:34.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:34 smithi156 ceph-mon[32679]: pgmap v16020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:34.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:34 smithi092 ceph-mon[29156]: pgmap v16020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:35.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29229.853854 secs 2024-04-27T02:25:35.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28532.823629 secs 2024-04-27T02:25:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29229.853854 secs 2024-04-27T02:25:35.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28532.823629 secs 2024-04-27T02:25:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29229.853854 secs 2024-04-27T02:25:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28532.823629 secs 2024-04-27T02:25:36.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:36 smithi189 ceph-mon[32756]: pgmap v16021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:36.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:36 smithi156 ceph-mon[32679]: pgmap v16021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:36.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:36 smithi092 ceph-mon[29156]: pgmap v16021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:38.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:38 smithi189 ceph-mon[32756]: pgmap v16022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:38.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:38 smithi156 ceph-mon[32679]: pgmap v16022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:38.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:38 smithi092 ceph-mon[29156]: pgmap v16022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29234.853936 secs 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28537.823748 secs 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: pgmap v16023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:25:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29234.853936 secs 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28537.823748 secs 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: pgmap v16023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:25:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:25:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29234.853936 secs 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28537.823748 secs 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: pgmap v16023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:25:40.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:25:41.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:41 smithi189 ceph-mon[32756]: pgmap v16024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:25:41.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:41 smithi189 ceph-mon[32756]: pgmap v16025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:41.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:41 smithi156 ceph-mon[32679]: pgmap v16024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:25:41.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:41 smithi156 ceph-mon[32679]: pgmap v16025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:41.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:41 smithi092 ceph-mon[29156]: pgmap v16024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:25:41.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:41 smithi092 ceph-mon[29156]: pgmap v16025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:43.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:43 smithi189 ceph-mon[32756]: pgmap v16026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:43.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:43 smithi156 ceph-mon[32679]: pgmap v16026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:43.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:43 smithi092 ceph-mon[29156]: pgmap v16026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:45.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29239.854042 secs 2024-04-27T02:25:45.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:45 smithi189 ceph-mon[32756]: pgmap v16027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:45.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28542.823848 secs 2024-04-27T02:25:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29239.854042 secs 2024-04-27T02:25:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:45 smithi156 ceph-mon[32679]: pgmap v16027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28542.823848 secs 2024-04-27T02:25:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29239.854042 secs 2024-04-27T02:25:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:45 smithi092 ceph-mon[29156]: pgmap v16027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:45.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28542.823848 secs 2024-04-27T02:25:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:47 smithi189 ceph-mon[32756]: pgmap v16028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:47 smithi156 ceph-mon[32679]: pgmap v16028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:47 smithi092 ceph-mon[29156]: pgmap v16028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:25:49.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:49 smithi189 ceph-mon[32756]: pgmap v16029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:25:49.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:49 smithi156 ceph-mon[32679]: pgmap v16029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:25:49.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:49 smithi092 ceph-mon[29156]: pgmap v16029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:25:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29244.854130 secs 2024-04-27T02:25:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28547.823964 secs 2024-04-27T02:25:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29244.854130 secs 2024-04-27T02:25:50.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28547.823964 secs 2024-04-27T02:25:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29244.854130 secs 2024-04-27T02:25:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28547.823964 secs 2024-04-27T02:25:51.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:51 smithi189 ceph-mon[32756]: pgmap v16030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:25:51.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:51 smithi156 ceph-mon[32679]: pgmap v16030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:25:51.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:51 smithi092 ceph-mon[29156]: pgmap v16030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:25:53.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:53 smithi189 ceph-mon[32756]: pgmap v16031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:53.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:53 smithi156 ceph-mon[32679]: pgmap v16031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:53.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:53 smithi092 ceph-mon[29156]: pgmap v16031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29249.854228 secs 2024-04-27T02:25:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:55 smithi189 ceph-mon[32756]: pgmap v16032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28552.824065 secs 2024-04-27T02:25:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29249.854228 secs 2024-04-27T02:25:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:55 smithi156 ceph-mon[32679]: pgmap v16032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28552.824065 secs 2024-04-27T02:25:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29249.854228 secs 2024-04-27T02:25:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:55 smithi092 ceph-mon[29156]: pgmap v16032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:25:55.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28552.824065 secs 2024-04-27T02:25:57.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:57 smithi189 ceph-mon[32756]: pgmap v16033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:57.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:57 smithi156 ceph-mon[32679]: pgmap v16033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:57.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:57 smithi092 ceph-mon[29156]: pgmap v16033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:59.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:25:59 smithi189 ceph-mon[32756]: pgmap v16034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:59.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:25:59 smithi156 ceph-mon[32679]: pgmap v16034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:25:59.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:25:59 smithi092 ceph-mon[29156]: pgmap v16034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29254.854350 secs 2024-04-27T02:26:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28557.824184 secs 2024-04-27T02:26:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29254.854350 secs 2024-04-27T02:26:00.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28557.824184 secs 2024-04-27T02:26:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29254.854350 secs 2024-04-27T02:26:00.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28557.824184 secs 2024-04-27T02:26:01.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:01 smithi189 ceph-mon[32756]: pgmap v16035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:01.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:01 smithi156 ceph-mon[32679]: pgmap v16035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:01 smithi092 ceph-mon[29156]: pgmap v16035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:03.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:03 smithi189 ceph-mon[32756]: pgmap v16036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:03.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:03 smithi156 ceph-mon[32679]: pgmap v16036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:03.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:03 smithi092 ceph-mon[29156]: pgmap v16036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29259.854482 secs 2024-04-27T02:26:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:05 smithi189 ceph-mon[32756]: pgmap v16037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28562.824322 secs 2024-04-27T02:26:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29259.854482 secs 2024-04-27T02:26:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:05 smithi156 ceph-mon[32679]: pgmap v16037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:05.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28562.824322 secs 2024-04-27T02:26:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29259.854482 secs 2024-04-27T02:26:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:05 smithi092 ceph-mon[29156]: pgmap v16037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:05.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28562.824322 secs 2024-04-27T02:26:07.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:07 smithi189 ceph-mon[32756]: pgmap v16038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:07 smithi156 ceph-mon[32679]: pgmap v16038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:07.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:07 smithi092 ceph-mon[29156]: pgmap v16038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:09.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:09 smithi189 ceph-mon[32756]: pgmap v16039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:09.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:09 smithi156 ceph-mon[32679]: pgmap v16039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:09.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:09 smithi092 ceph-mon[29156]: pgmap v16039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:10 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 29264.854554 secs 2024-04-27T02:26:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:10 smithi189 ceph-mon[32756]: slow request 720.311635 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28567.824402 secs 2024-04-27T02:26:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:10 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 29264.854554 secs 2024-04-27T02:26:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:10 smithi156 ceph-mon[32679]: slow request 720.311635 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:10.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28567.824402 secs 2024-04-27T02:26:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:10 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 29264.854554 secs 2024-04-27T02:26:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:10 smithi092 ceph-mon[29156]: slow request 720.311635 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:10.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28567.824402 secs 2024-04-27T02:26:11.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:11 smithi189 ceph-mon[32756]: pgmap v16040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:11.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:11 smithi156 ceph-mon[32679]: pgmap v16040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:11.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:11 smithi092 ceph-mon[29156]: pgmap v16040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:13.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:13 smithi156 ceph-mon[32679]: pgmap v16041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:13.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:13 smithi092 ceph-mon[29156]: pgmap v16041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:13.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:13 smithi189 ceph-mon[32756]: pgmap v16041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:15.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29269.854618 secs 2024-04-27T02:26:15.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:15 smithi092 ceph-mon[29156]: pgmap v16042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:15.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28572.824485 secs 2024-04-27T02:26:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29269.854618 secs 2024-04-27T02:26:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:15 smithi156 ceph-mon[32679]: pgmap v16042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28572.824485 secs 2024-04-27T02:26:15.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29269.854618 secs 2024-04-27T02:26:15.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:15 smithi189 ceph-mon[32756]: pgmap v16042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:15.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28572.824485 secs 2024-04-27T02:26:17.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:17 smithi156 ceph-mon[32679]: pgmap v16043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:17.415 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:17 smithi189 ceph-mon[32756]: pgmap v16043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:17.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:17 smithi092 ceph-mon[29156]: pgmap v16043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:19.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:19 smithi156 ceph-mon[32679]: pgmap v16044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:19.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:19 smithi092 ceph-mon[29156]: pgmap v16044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:19.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:19 smithi189 ceph-mon[32756]: pgmap v16044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29274.854762 secs 2024-04-27T02:26:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28577.824589 secs 2024-04-27T02:26:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29274.854762 secs 2024-04-27T02:26:20.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28577.824589 secs 2024-04-27T02:26:20.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29274.854762 secs 2024-04-27T02:26:20.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28577.824589 secs 2024-04-27T02:26:21.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:21 smithi156 ceph-mon[32679]: pgmap v16045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:21.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:21 smithi092 ceph-mon[29156]: pgmap v16045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:21.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:21 smithi189 ceph-mon[32756]: pgmap v16045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:23.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:23 smithi156 ceph-mon[32679]: pgmap v16046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:23.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:23 smithi092 ceph-mon[29156]: pgmap v16046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:23.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:23 smithi189 ceph-mon[32756]: pgmap v16046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29279.854870 secs 2024-04-27T02:26:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:25 smithi156 ceph-mon[32679]: pgmap v16047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:25.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28582.824700 secs 2024-04-27T02:26:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29279.854870 secs 2024-04-27T02:26:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:25 smithi092 ceph-mon[29156]: pgmap v16047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:25.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28582.824700 secs 2024-04-27T02:26:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29279.854870 secs 2024-04-27T02:26:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:25 smithi189 ceph-mon[32756]: pgmap v16047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28582.824700 secs 2024-04-27T02:26:27.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:27 smithi156 ceph-mon[32679]: pgmap v16048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:27.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:27 smithi092 ceph-mon[29156]: pgmap v16048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:27.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:27 smithi189 ceph-mon[32756]: pgmap v16048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:29.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:29 smithi156 ceph-mon[32679]: pgmap v16049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:29.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:29 smithi092 ceph-mon[29156]: pgmap v16049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:29.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:29 smithi189 ceph-mon[32756]: pgmap v16049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:30.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29284.854987 secs 2024-04-27T02:26:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28587.824809 secs 2024-04-27T02:26:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29284.854987 secs 2024-04-27T02:26:30.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28587.824809 secs 2024-04-27T02:26:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29284.854987 secs 2024-04-27T02:26:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28587.824809 secs 2024-04-27T02:26:31.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:31 smithi156 ceph-mon[32679]: pgmap v16050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:31.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:31 smithi092 ceph-mon[29156]: pgmap v16050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:31.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:31 smithi189 ceph-mon[32756]: pgmap v16050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:32.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:32 smithi156 ceph-mon[32679]: pgmap v16051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:32.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:32 smithi092 ceph-mon[29156]: pgmap v16051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:32.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:32 smithi189 ceph-mon[32756]: pgmap v16051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:35.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29289.855073 secs 2024-04-27T02:26:35.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:34 smithi189 ceph-mon[32756]: pgmap v16052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:35.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28592.824914 secs 2024-04-27T02:26:35.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29289.855073 secs 2024-04-27T02:26:35.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:34 smithi156 ceph-mon[32679]: pgmap v16052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:35.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28592.824914 secs 2024-04-27T02:26:35.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29289.855073 secs 2024-04-27T02:26:35.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:34 smithi092 ceph-mon[29156]: pgmap v16052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:35.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28592.824914 secs 2024-04-27T02:26:37.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:36 smithi189 ceph-mon[32756]: pgmap v16053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:37.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:36 smithi156 ceph-mon[32679]: pgmap v16053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:37.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:36 smithi092 ceph-mon[29156]: pgmap v16053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:39.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:38 smithi189 ceph-mon[32756]: pgmap v16054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:39.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:38 smithi156 ceph-mon[32679]: pgmap v16054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:39.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:38 smithi092 ceph-mon[29156]: pgmap v16054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:40.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:39 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 29294.855163 secs 2024-04-27T02:26:40.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:39 smithi189 ceph-mon[32756]: slow request 5761.738030 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:40.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28597.825048 secs 2024-04-27T02:26:40.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:39 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 29294.855163 secs 2024-04-27T02:26:40.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:39 smithi156 ceph-mon[32679]: slow request 5761.738030 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:40.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28597.825048 secs 2024-04-27T02:26:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:39 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 29294.855163 secs 2024-04-27T02:26:40.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:39 smithi092 ceph-mon[29156]: slow request 5761.738030 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:26:40.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28597.825048 secs 2024-04-27T02:26:41.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:40 smithi189 ceph-mon[32756]: pgmap v16055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:41.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:26:41.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:26:41.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:26:41.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:26:41.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:40 smithi156 ceph-mon[32679]: pgmap v16055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:41.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:26:41.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:26:41.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:26:41.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:26:41.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:40 smithi092 ceph-mon[29156]: pgmap v16055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:41.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:26:41.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:26:41.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:26:41.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:26:42.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:41 smithi189 ceph-mon[32756]: pgmap v16056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:26:42.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:41 smithi189 ceph-mon[32756]: pgmap v16057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:42.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:41 smithi156 ceph-mon[32679]: pgmap v16056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:26:42.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:41 smithi156 ceph-mon[32679]: pgmap v16057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:42.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:41 smithi092 ceph-mon[29156]: pgmap v16056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:26:42.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:41 smithi092 ceph-mon[29156]: pgmap v16057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:44.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:43 smithi189 ceph-mon[32756]: pgmap v16058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:26:44.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:43 smithi156 ceph-mon[32679]: pgmap v16058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:26:44.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:43 smithi092 ceph-mon[29156]: pgmap v16058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:26:45.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29299.855267 secs 2024-04-27T02:26:45.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28602.825160 secs 2024-04-27T02:26:45.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29299.855267 secs 2024-04-27T02:26:45.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28602.825160 secs 2024-04-27T02:26:45.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29299.855267 secs 2024-04-27T02:26:45.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28602.825160 secs 2024-04-27T02:26:46.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:45 smithi189 ceph-mon[32756]: pgmap v16059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:46.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:45 smithi156 ceph-mon[32679]: pgmap v16059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:46.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:45 smithi092 ceph-mon[29156]: pgmap v16059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:48.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:47 smithi189 ceph-mon[32756]: pgmap v16060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:48.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:47 smithi156 ceph-mon[32679]: pgmap v16060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:48.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:47 smithi092 ceph-mon[29156]: pgmap v16060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:49 smithi189 ceph-mon[32756]: pgmap v16061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29304.855346 secs 2024-04-27T02:26:50.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28607.825278 secs 2024-04-27T02:26:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:49 smithi156 ceph-mon[32679]: pgmap v16061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29304.855346 secs 2024-04-27T02:26:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28607.825278 secs 2024-04-27T02:26:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:49 smithi092 ceph-mon[29156]: pgmap v16061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:26:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29304.855346 secs 2024-04-27T02:26:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28607.825278 secs 2024-04-27T02:26:52.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:51 smithi189 ceph-mon[32756]: pgmap v16062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:26:52.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:51 smithi156 ceph-mon[32679]: pgmap v16062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:26:52.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:51 smithi092 ceph-mon[29156]: pgmap v16062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:26:54.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:53 smithi189 ceph-mon[32756]: pgmap v16063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:54.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:53 smithi156 ceph-mon[32679]: pgmap v16063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:54.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:53 smithi092 ceph-mon[29156]: pgmap v16063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:55.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29309.855475 secs 2024-04-27T02:26:55.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28612.825430 secs 2024-04-27T02:26:55.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29309.855475 secs 2024-04-27T02:26:55.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28612.825430 secs 2024-04-27T02:26:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29309.855475 secs 2024-04-27T02:26:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28612.825430 secs 2024-04-27T02:26:56.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:55 smithi156 ceph-mon[32679]: pgmap v16064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:56.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:55 smithi092 ceph-mon[29156]: pgmap v16064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:56.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:55 smithi189 ceph-mon[32756]: pgmap v16064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:26:58.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:57 smithi156 ceph-mon[32679]: pgmap v16065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:58.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:57 smithi092 ceph-mon[29156]: pgmap v16065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:26:58.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:57 smithi189 ceph-mon[32756]: pgmap v16065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:59 smithi156 ceph-mon[32679]: pgmap v16066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:00.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29314.855593 secs 2024-04-27T02:27:00.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:26:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28617.825505 secs 2024-04-27T02:27:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:59 smithi092 ceph-mon[29156]: pgmap v16066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29314.855593 secs 2024-04-27T02:27:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:26:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28617.825505 secs 2024-04-27T02:27:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:59 smithi189 ceph-mon[32756]: pgmap v16066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29314.855593 secs 2024-04-27T02:27:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:26:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28617.825505 secs 2024-04-27T02:27:02.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:01 smithi156 ceph-mon[32679]: pgmap v16067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:02.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:01 smithi092 ceph-mon[29156]: pgmap v16067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:02.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:01 smithi189 ceph-mon[32756]: pgmap v16067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:04.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:03 smithi156 ceph-mon[32679]: pgmap v16068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:04.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:03 smithi092 ceph-mon[29156]: pgmap v16068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:04.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:03 smithi189 ceph-mon[32756]: pgmap v16068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29319.855728 secs 2024-04-27T02:27:05.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28622.825604 secs 2024-04-27T02:27:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29319.855728 secs 2024-04-27T02:27:05.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28622.825604 secs 2024-04-27T02:27:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29319.855728 secs 2024-04-27T02:27:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28622.825604 secs 2024-04-27T02:27:06.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:05 smithi156 ceph-mon[32679]: pgmap v16069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:06.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:05 smithi092 ceph-mon[29156]: pgmap v16069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:05 smithi189 ceph-mon[32756]: pgmap v16069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:08.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:07 smithi156 ceph-mon[32679]: pgmap v16070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:08.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:07 smithi092 ceph-mon[29156]: pgmap v16070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:08.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:07 smithi189 ceph-mon[32756]: pgmap v16070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:10.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:09 smithi156 ceph-mon[32679]: pgmap v16071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:10.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29324.855834 secs 2024-04-27T02:27:10.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28627.825693 secs 2024-04-27T02:27:10.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:09 smithi092 ceph-mon[29156]: pgmap v16071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:10.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29324.855834 secs 2024-04-27T02:27:10.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28627.825693 secs 2024-04-27T02:27:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:09 smithi189 ceph-mon[32756]: pgmap v16071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29324.855834 secs 2024-04-27T02:27:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28627.825693 secs 2024-04-27T02:27:12.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:11 smithi156 ceph-mon[32679]: pgmap v16072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:12.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:11 smithi092 ceph-mon[29156]: pgmap v16072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:12.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:11 smithi189 ceph-mon[32756]: pgmap v16072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:14.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:13 smithi156 ceph-mon[32679]: pgmap v16073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:14.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:13 smithi092 ceph-mon[29156]: pgmap v16073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:14.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:13 smithi189 ceph-mon[32756]: pgmap v16073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:15.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29329.855958 secs 2024-04-27T02:27:15.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28632.825773 secs 2024-04-27T02:27:15.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29329.855958 secs 2024-04-27T02:27:15.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28632.825773 secs 2024-04-27T02:27:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29329.855958 secs 2024-04-27T02:27:15.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28632.825773 secs 2024-04-27T02:27:16.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:15 smithi156 ceph-mon[32679]: pgmap v16074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:16.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:15 smithi092 ceph-mon[29156]: pgmap v16074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:16.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:15 smithi189 ceph-mon[32756]: pgmap v16074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:18.164 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:17 smithi189 ceph-mon[32756]: pgmap v16075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:18.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:17 smithi092 ceph-mon[29156]: pgmap v16075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:18.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:17 smithi156 ceph-mon[32679]: pgmap v16075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:20.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:19 smithi092 ceph-mon[29156]: pgmap v16076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:20.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29334.856048 secs 2024-04-27T02:27:20.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28637.825889 secs 2024-04-27T02:27:20.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:19 smithi189 ceph-mon[32756]: pgmap v16076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29334.856048 secs 2024-04-27T02:27:20.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28637.825889 secs 2024-04-27T02:27:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:19 smithi156 ceph-mon[32679]: pgmap v16076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29334.856048 secs 2024-04-27T02:27:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28637.825889 secs 2024-04-27T02:27:22.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:21 smithi092 ceph-mon[29156]: pgmap v16077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:22.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:21 smithi189 ceph-mon[32756]: pgmap v16077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:22.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:21 smithi156 ceph-mon[32679]: pgmap v16077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:24.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:23 smithi156 ceph-mon[32679]: pgmap v16078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:24.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:23 smithi092 ceph-mon[29156]: pgmap v16078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:24.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:23 smithi189 ceph-mon[32756]: pgmap v16078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:25.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29339.856110 secs 2024-04-27T02:27:25.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28642.826032 secs 2024-04-27T02:27:25.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29339.856110 secs 2024-04-27T02:27:25.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28642.826032 secs 2024-04-27T02:27:25.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29339.856110 secs 2024-04-27T02:27:25.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28642.826032 secs 2024-04-27T02:27:26.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:25 smithi092 ceph-mon[29156]: pgmap v16079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:26.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:25 smithi189 ceph-mon[32756]: pgmap v16079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:26.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:25 smithi156 ceph-mon[32679]: pgmap v16079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:28.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:27 smithi092 ceph-mon[29156]: pgmap v16080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:28.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:27 smithi189 ceph-mon[32756]: pgmap v16080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:28.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:27 smithi156 ceph-mon[32679]: pgmap v16080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:30.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:29 smithi092 ceph-mon[29156]: pgmap v16081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:30.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29344.856227 secs 2024-04-27T02:27:30.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28647.826170 secs 2024-04-27T02:27:30.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:29 smithi189 ceph-mon[32756]: pgmap v16081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:30.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29344.856227 secs 2024-04-27T02:27:30.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28647.826170 secs 2024-04-27T02:27:30.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:29 smithi156 ceph-mon[32679]: pgmap v16081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29344.856227 secs 2024-04-27T02:27:30.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28647.826170 secs 2024-04-27T02:27:32.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:31 smithi092 ceph-mon[29156]: pgmap v16082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:32.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:31 smithi189 ceph-mon[32756]: pgmap v16082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:32.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:31 smithi156 ceph-mon[32679]: pgmap v16082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:34.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:33 smithi092 ceph-mon[29156]: pgmap v16083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:34.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:33 smithi189 ceph-mon[32756]: pgmap v16083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:34.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:33 smithi156 ceph-mon[32679]: pgmap v16083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:35.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29349.856315 secs 2024-04-27T02:27:35.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28652.826320 secs 2024-04-27T02:27:35.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29349.856315 secs 2024-04-27T02:27:35.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28652.826320 secs 2024-04-27T02:27:35.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29349.856315 secs 2024-04-27T02:27:35.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28652.826320 secs 2024-04-27T02:27:36.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:35 smithi092 ceph-mon[29156]: pgmap v16084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:36.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:35 smithi189 ceph-mon[32756]: pgmap v16084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:36.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:35 smithi156 ceph-mon[32679]: pgmap v16084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:38.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:37 smithi092 ceph-mon[29156]: pgmap v16085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:38.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:37 smithi189 ceph-mon[32756]: pgmap v16085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:38.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:37 smithi156 ceph-mon[32679]: pgmap v16085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:27:40.008+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:27:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:27:40.008+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:27:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:27:40.008+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:27:39.984 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:27:40.008+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 227 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:27:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:39 smithi092 ceph-mon[29156]: pgmap v16086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29354.856432 secs 2024-04-27T02:27:40.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28657.826436 secs 2024-04-27T02:27:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:39 smithi189 ceph-mon[32756]: pgmap v16086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29354.856432 secs 2024-04-27T02:27:40.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28657.826436 secs 2024-04-27T02:27:40.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:39 smithi156 ceph-mon[32679]: pgmap v16086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29354.856432 secs 2024-04-27T02:27:40.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28657.826436 secs 2024-04-27T02:27:41.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:27:41.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:27:41.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:27:42.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:41 smithi092 ceph-mon[29156]: pgmap v16087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:42.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:27:42.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:27:42.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:27:42.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:41 smithi189 ceph-mon[32756]: pgmap v16087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:42.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:27:42.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:27:42.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:27:42.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:41 smithi156 ceph-mon[32679]: pgmap v16087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:42.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:27:42.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:27:42.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:27:43.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:42 smithi092 ceph-mon[29156]: pgmap v16088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:27:43.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:42 smithi092 ceph-mon[29156]: pgmap v16089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:43.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:42 smithi189 ceph-mon[32756]: pgmap v16088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:27:43.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:42 smithi189 ceph-mon[32756]: pgmap v16089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:43.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:42 smithi156 ceph-mon[32679]: pgmap v16088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:27:43.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:42 smithi156 ceph-mon[32679]: pgmap v16089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:45.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:44 smithi092 ceph-mon[29156]: pgmap v16090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:45.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29359.856556 secs 2024-04-27T02:27:45.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28662.826513 secs 2024-04-27T02:27:45.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:44 smithi189 ceph-mon[32756]: pgmap v16090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:45.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29359.856556 secs 2024-04-27T02:27:45.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28662.826513 secs 2024-04-27T02:27:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:44 smithi156 ceph-mon[32679]: pgmap v16090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29359.856556 secs 2024-04-27T02:27:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28662.826513 secs 2024-04-27T02:27:47.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:46 smithi189 ceph-mon[32756]: pgmap v16091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:46 smithi156 ceph-mon[32679]: pgmap v16091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:46 smithi092 ceph-mon[29156]: pgmap v16091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:49.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:48 smithi189 ceph-mon[32756]: pgmap v16092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:49.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:48 smithi156 ceph-mon[32679]: pgmap v16092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:49.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:48 smithi092 ceph-mon[29156]: pgmap v16092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:27:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29364.856670 secs 2024-04-27T02:27:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28667.826650 secs 2024-04-27T02:27:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29364.856670 secs 2024-04-27T02:27:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28667.826650 secs 2024-04-27T02:27:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29364.856670 secs 2024-04-27T02:27:50.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28667.826650 secs 2024-04-27T02:27:51.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:51 smithi189 ceph-mon[32756]: pgmap v16093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:51.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:51 smithi156 ceph-mon[32679]: pgmap v16093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:51.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:51 smithi092 ceph-mon[29156]: pgmap v16093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:27:53.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:53 smithi189 ceph-mon[32756]: pgmap v16094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:27:53.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:53 smithi156 ceph-mon[32679]: pgmap v16094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:27:53.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:53 smithi092 ceph-mon[29156]: pgmap v16094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:27:55.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:55 smithi092 ceph-mon[29156]: pgmap v16095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:55.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29369.856790 secs 2024-04-27T02:27:55.271 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28672.826757 secs 2024-04-27T02:27:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:55 smithi189 ceph-mon[32756]: pgmap v16095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29369.856790 secs 2024-04-27T02:27:55.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28672.826757 secs 2024-04-27T02:27:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:55 smithi156 ceph-mon[32679]: pgmap v16095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29369.856790 secs 2024-04-27T02:27:55.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28672.826757 secs 2024-04-27T02:27:57.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:57 smithi189 ceph-mon[32756]: pgmap v16096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:57.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:57 smithi156 ceph-mon[32679]: pgmap v16096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:57.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:57 smithi092 ceph-mon[29156]: pgmap v16096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:27:59.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:27:59 smithi189 ceph-mon[32756]: pgmap v16097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:59.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:27:59 smithi156 ceph-mon[32679]: pgmap v16097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:27:59.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:27:59 smithi092 ceph-mon[29156]: pgmap v16097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29374.856920 secs 2024-04-27T02:28:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28677.826892 secs 2024-04-27T02:28:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29374.856920 secs 2024-04-27T02:28:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28677.826892 secs 2024-04-27T02:28:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29374.856920 secs 2024-04-27T02:28:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28677.826892 secs 2024-04-27T02:28:01.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:01 smithi189 ceph-mon[32756]: pgmap v16098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:01.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:01 smithi156 ceph-mon[32679]: pgmap v16098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:01 smithi092 ceph-mon[29156]: pgmap v16098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:03.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:03 smithi189 ceph-mon[32756]: pgmap v16099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:03.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:03 smithi156 ceph-mon[32679]: pgmap v16099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:03.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:03 smithi092 ceph-mon[29156]: pgmap v16099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:05 smithi189 ceph-mon[32756]: pgmap v16100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29379.857030 secs 2024-04-27T02:28:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28682.826960 secs 2024-04-27T02:28:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:05 smithi156 ceph-mon[32679]: pgmap v16100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29379.857030 secs 2024-04-27T02:28:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28682.826960 secs 2024-04-27T02:28:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:05 smithi092 ceph-mon[29156]: pgmap v16100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29379.857030 secs 2024-04-27T02:28:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28682.826960 secs 2024-04-27T02:28:07.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:07 smithi189 ceph-mon[32756]: pgmap v16101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:07.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:07 smithi156 ceph-mon[32679]: pgmap v16101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:07.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:07 smithi092 ceph-mon[29156]: pgmap v16101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:09.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:09 smithi189 ceph-mon[32756]: pgmap v16102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:09.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:09 smithi156 ceph-mon[32679]: pgmap v16102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:09 smithi092 ceph-mon[29156]: pgmap v16102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:10.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29384.857148 secs 2024-04-27T02:28:10.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28687.827083 secs 2024-04-27T02:28:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29384.857148 secs 2024-04-27T02:28:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28687.827083 secs 2024-04-27T02:28:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29384.857148 secs 2024-04-27T02:28:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28687.827083 secs 2024-04-27T02:28:11.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:11 smithi189 ceph-mon[32756]: pgmap v16103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:11.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:11 smithi156 ceph-mon[32679]: pgmap v16103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:11.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:11 smithi092 ceph-mon[29156]: pgmap v16103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:13.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:13 smithi189 ceph-mon[32756]: pgmap v16104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:13.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:13 smithi156 ceph-mon[32679]: pgmap v16104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:13.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:13 smithi092 ceph-mon[29156]: pgmap v16104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:15.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:15 smithi189 ceph-mon[32756]: pgmap v16105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:15.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29389.857263 secs 2024-04-27T02:28:15.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28692.827219 secs 2024-04-27T02:28:15.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:15 smithi156 ceph-mon[32679]: pgmap v16105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:15.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29389.857263 secs 2024-04-27T02:28:15.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28692.827219 secs 2024-04-27T02:28:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:15 smithi092 ceph-mon[29156]: pgmap v16105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29389.857263 secs 2024-04-27T02:28:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28692.827219 secs 2024-04-27T02:28:17.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:17 smithi156 ceph-mon[32679]: pgmap v16106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:17.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:17 smithi092 ceph-mon[29156]: pgmap v16106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:17.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:17 smithi189 ceph-mon[32756]: pgmap v16106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:19.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:19 smithi156 ceph-mon[32679]: pgmap v16107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:19.414 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:19 smithi189 ceph-mon[32756]: pgmap v16107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:19.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:19 smithi092 ceph-mon[29156]: pgmap v16107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29394.857393 secs 2024-04-27T02:28:20.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28697.827327 secs 2024-04-27T02:28:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29394.857393 secs 2024-04-27T02:28:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28697.827327 secs 2024-04-27T02:28:20.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29394.857393 secs 2024-04-27T02:28:20.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28697.827327 secs 2024-04-27T02:28:21.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:21 smithi156 ceph-mon[32679]: pgmap v16108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:21.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:21 smithi092 ceph-mon[29156]: pgmap v16108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:21.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:21 smithi189 ceph-mon[32756]: pgmap v16108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:23.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:23 smithi092 ceph-mon[29156]: pgmap v16109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:23.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:23 smithi189 ceph-mon[32756]: pgmap v16109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:23.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:23 smithi156 ceph-mon[32679]: pgmap v16109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:25.460 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:25 smithi156 ceph-mon[32679]: pgmap v16110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:25.460 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29399.857522 secs 2024-04-27T02:28:25.460 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28702.827445 secs 2024-04-27T02:28:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:25 smithi092 ceph-mon[29156]: pgmap v16110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29399.857522 secs 2024-04-27T02:28:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28702.827445 secs 2024-04-27T02:28:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:25 smithi189 ceph-mon[32756]: pgmap v16110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29399.857522 secs 2024-04-27T02:28:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28702.827445 secs 2024-04-27T02:28:27.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:27 smithi092 ceph-mon[29156]: pgmap v16111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:27.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:27 smithi189 ceph-mon[32756]: pgmap v16111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:27.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:27 smithi156 ceph-mon[32679]: pgmap v16111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:28.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:28 smithi092 ceph-mon[29156]: pgmap v16112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:28.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:28 smithi189 ceph-mon[32756]: pgmap v16112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:28.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:28 smithi156 ceph-mon[32679]: pgmap v16112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29404.857644 secs 2024-04-27T02:28:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28707.827506 secs 2024-04-27T02:28:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:30 smithi156 ceph-mon[32679]: pgmap v16113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:30.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29404.857644 secs 2024-04-27T02:28:30.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28707.827506 secs 2024-04-27T02:28:30.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:30 smithi092 ceph-mon[29156]: pgmap v16113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:30.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29404.857644 secs 2024-04-27T02:28:30.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28707.827506 secs 2024-04-27T02:28:30.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:30 smithi189 ceph-mon[32756]: pgmap v16113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:32.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:32 smithi156 ceph-mon[32679]: pgmap v16114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:32.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:32 smithi092 ceph-mon[29156]: pgmap v16114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:32.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:32 smithi189 ceph-mon[32756]: pgmap v16114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:34.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:34 smithi156 ceph-mon[32679]: pgmap v16115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:34.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:34 smithi092 ceph-mon[29156]: pgmap v16115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:34.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:34 smithi189 ceph-mon[32756]: pgmap v16115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29409.857759 secs 2024-04-27T02:28:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28712.827605 secs 2024-04-27T02:28:35.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29409.857759 secs 2024-04-27T02:28:35.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28712.827605 secs 2024-04-27T02:28:35.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29409.857759 secs 2024-04-27T02:28:35.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28712.827605 secs 2024-04-27T02:28:36.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:36 smithi156 ceph-mon[32679]: pgmap v16116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:36.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:36 smithi092 ceph-mon[29156]: pgmap v16116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:36.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:36 smithi189 ceph-mon[32756]: pgmap v16116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:38.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:38 smithi156 ceph-mon[32679]: pgmap v16117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:38.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:38 smithi092 ceph-mon[29156]: pgmap v16117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:38.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:38 smithi189 ceph-mon[32756]: pgmap v16117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29414.857883 secs 2024-04-27T02:28:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28717.827725 secs 2024-04-27T02:28:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:40 smithi156 ceph-mon[32679]: pgmap v16118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:40.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29414.857883 secs 2024-04-27T02:28:40.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28717.827725 secs 2024-04-27T02:28:40.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:40 smithi092 ceph-mon[29156]: pgmap v16118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:40.862 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29414.857883 secs 2024-04-27T02:28:40.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28717.827725 secs 2024-04-27T02:28:40.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:40 smithi189 ceph-mon[32756]: pgmap v16118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: pgmap v16119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:28:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:28:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:28:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: pgmap v16120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:28:42.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: pgmap v16121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:42.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:28:42.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: pgmap v16119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:42.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:28:42.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:28:42.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:28:42.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: pgmap v16120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:28:42.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: pgmap v16121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:42.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:28:42.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: pgmap v16119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:42.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:28:42.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:28:42.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:28:42.863 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: pgmap v16120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:28:42.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: pgmap v16121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:42.864 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:28:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29419.857994 secs 2024-04-27T02:28:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28722.827834 secs 2024-04-27T02:28:45.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:45 smithi156 ceph-mon[32679]: pgmap v16122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29419.857994 secs 2024-04-27T02:28:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28722.827834 secs 2024-04-27T02:28:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:45 smithi092 ceph-mon[29156]: pgmap v16122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:45.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29419.857994 secs 2024-04-27T02:28:45.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28722.827834 secs 2024-04-27T02:28:45.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:45 smithi189 ceph-mon[32756]: pgmap v16122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:47 smithi092 ceph-mon[29156]: pgmap v16123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:47.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:47 smithi189 ceph-mon[32756]: pgmap v16123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:47.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:47 smithi156 ceph-mon[32679]: pgmap v16123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:49.414 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:49 smithi189 ceph-mon[32756]: pgmap v16124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:28:49.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:49 smithi092 ceph-mon[29156]: pgmap v16124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:28:49.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:49 smithi156 ceph-mon[32679]: pgmap v16124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:28:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29424.858117 secs 2024-04-27T02:28:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28727.827972 secs 2024-04-27T02:28:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29424.858117 secs 2024-04-27T02:28:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28727.827972 secs 2024-04-27T02:28:50.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29424.858117 secs 2024-04-27T02:28:50.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28727.827972 secs 2024-04-27T02:28:51.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:51 smithi092 ceph-mon[29156]: pgmap v16125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:51.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:51 smithi189 ceph-mon[32756]: pgmap v16125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:51.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:51 smithi156 ceph-mon[32679]: pgmap v16125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:28:52.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:52 smithi189 ceph-mon[32756]: pgmap v16126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:28:52.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:52 smithi156 ceph-mon[32679]: pgmap v16126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:28:52.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:52 smithi092 ceph-mon[29156]: pgmap v16126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:28:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29429.858230 secs 2024-04-27T02:28:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28732.828099 secs 2024-04-27T02:28:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:55 smithi156 ceph-mon[32679]: pgmap v16127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:55.421 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29429.858230 secs 2024-04-27T02:28:55.422 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28732.828099 secs 2024-04-27T02:28:55.422 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:55 smithi092 ceph-mon[29156]: pgmap v16127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29429.858230 secs 2024-04-27T02:28:55.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28732.828099 secs 2024-04-27T02:28:55.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:55 smithi189 ceph-mon[32756]: pgmap v16127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:28:57.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:57 smithi156 ceph-mon[32679]: pgmap v16128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:57.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:57 smithi092 ceph-mon[29156]: pgmap v16128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:57.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:57 smithi189 ceph-mon[32756]: pgmap v16128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:59.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:28:59 smithi156 ceph-mon[32679]: pgmap v16129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:59.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:28:59 smithi092 ceph-mon[29156]: pgmap v16129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:28:59.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:28:59 smithi189 ceph-mon[32756]: pgmap v16129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29434.858369 secs 2024-04-27T02:29:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28737.828170 secs 2024-04-27T02:29:00.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29434.858369 secs 2024-04-27T02:29:00.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28737.828170 secs 2024-04-27T02:29:00.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29434.858369 secs 2024-04-27T02:29:00.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28737.828170 secs 2024-04-27T02:29:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:01 smithi092 ceph-mon[29156]: pgmap v16130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:01.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:01 smithi189 ceph-mon[32756]: pgmap v16130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:01.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:01 smithi156 ceph-mon[32679]: pgmap v16130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:03.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:03 smithi092 ceph-mon[29156]: pgmap v16131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:03.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:03 smithi189 ceph-mon[32756]: pgmap v16131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:03.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:03 smithi156 ceph-mon[32679]: pgmap v16131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:04.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:04 smithi189 ceph-mon[32756]: pgmap v16132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:04.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:04 smithi156 ceph-mon[32679]: pgmap v16132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:04.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:04 smithi092 ceph-mon[29156]: pgmap v16132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:05.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29439.858485 secs 2024-04-27T02:29:05.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28742.828259 secs 2024-04-27T02:29:05.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29439.858485 secs 2024-04-27T02:29:05.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28742.828259 secs 2024-04-27T02:29:05.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29439.858485 secs 2024-04-27T02:29:05.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28742.828259 secs 2024-04-27T02:29:06.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:06 smithi189 ceph-mon[32756]: pgmap v16133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:06.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:06 smithi156 ceph-mon[32679]: pgmap v16133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:06.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:06 smithi092 ceph-mon[29156]: pgmap v16133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:09.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:09 smithi156 ceph-mon[32679]: pgmap v16134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:09.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:09 smithi092 ceph-mon[29156]: pgmap v16134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:09.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:09 smithi189 ceph-mon[32756]: pgmap v16134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:10 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29444.858618 secs 2024-04-27T02:29:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28747.828381 secs 2024-04-27T02:29:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:10 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29444.858618 secs 2024-04-27T02:29:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28747.828381 secs 2024-04-27T02:29:10.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:10 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29444.858618 secs 2024-04-27T02:29:10.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28747.828381 secs 2024-04-27T02:29:11.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:11 smithi092 ceph-mon[29156]: pgmap v16135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:11.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:11 smithi189 ceph-mon[32756]: pgmap v16135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:11.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:11 smithi156 ceph-mon[32679]: pgmap v16135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:13.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:13 smithi092 ceph-mon[29156]: pgmap v16136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:13.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:13 smithi189 ceph-mon[32756]: pgmap v16136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:13.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:13 smithi156 ceph-mon[32679]: pgmap v16136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29449.858734 secs 2024-04-27T02:29:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28752.828486 secs 2024-04-27T02:29:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:15 smithi092 ceph-mon[29156]: pgmap v16137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:15.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29449.858734 secs 2024-04-27T02:29:15.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28752.828486 secs 2024-04-27T02:29:15.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:15 smithi189 ceph-mon[32756]: pgmap v16137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:15.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29449.858734 secs 2024-04-27T02:29:15.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28752.828486 secs 2024-04-27T02:29:15.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:15 smithi156 ceph-mon[32679]: pgmap v16137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:17.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:17 smithi092 ceph-mon[29156]: pgmap v16138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:17.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:17 smithi189 ceph-mon[32756]: pgmap v16138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:17.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:17 smithi156 ceph-mon[32679]: pgmap v16138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:18.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:18 smithi189 ceph-mon[32756]: pgmap v16139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:18.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:18 smithi156 ceph-mon[32679]: pgmap v16139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:18.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:18 smithi092 ceph-mon[29156]: pgmap v16139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:19.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28757.828567 secs 2024-04-27T02:29:19.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28757.828567 secs 2024-04-27T02:29:20.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28757.828567 secs 2024-04-27T02:29:20.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29454.858856 secs 2024-04-27T02:29:20.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:20 smithi156 ceph-mon[32679]: pgmap v16140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:20.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29454.858856 secs 2024-04-27T02:29:20.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:20 smithi092 ceph-mon[29156]: pgmap v16140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:21.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29454.858856 secs 2024-04-27T02:29:21.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:20 smithi189 ceph-mon[32756]: pgmap v16140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:23.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:23 smithi092 ceph-mon[29156]: pgmap v16141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:23.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:23 smithi189 ceph-mon[32756]: pgmap v16141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:23.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:23 smithi156 ceph-mon[32679]: pgmap v16141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:25.460 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29459.858979 secs 2024-04-27T02:29:25.461 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28762.828689 secs 2024-04-27T02:29:25.461 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:25 smithi156 ceph-mon[32679]: pgmap v16142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29459.858979 secs 2024-04-27T02:29:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28762.828689 secs 2024-04-27T02:29:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:25 smithi092 ceph-mon[29156]: pgmap v16142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29459.858979 secs 2024-04-27T02:29:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28762.828689 secs 2024-04-27T02:29:25.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:25 smithi189 ceph-mon[32756]: pgmap v16142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:27.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:27 smithi092 ceph-mon[29156]: pgmap v16143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:27.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:27 smithi189 ceph-mon[32756]: pgmap v16143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:27.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:27 smithi156 ceph-mon[32679]: pgmap v16143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:29.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:29 smithi092 ceph-mon[29156]: pgmap v16144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:29.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:29 smithi189 ceph-mon[32756]: pgmap v16144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:29.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:29 smithi156 ceph-mon[32679]: pgmap v16144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29464.859095 secs 2024-04-27T02:29:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28767.828812 secs 2024-04-27T02:29:30.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29464.859095 secs 2024-04-27T02:29:30.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28767.828812 secs 2024-04-27T02:29:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29464.859095 secs 2024-04-27T02:29:30.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28767.828812 secs 2024-04-27T02:29:31.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:31 smithi092 ceph-mon[29156]: pgmap v16145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:31.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:31 smithi189 ceph-mon[32756]: pgmap v16145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:31.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:31 smithi156 ceph-mon[32679]: pgmap v16145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:32.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:32 smithi189 ceph-mon[32756]: pgmap v16146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:32.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:32 smithi156 ceph-mon[32679]: pgmap v16146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:32.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:32 smithi092 ceph-mon[29156]: pgmap v16146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29469.859208 secs 2024-04-27T02:29:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28772.828929 secs 2024-04-27T02:29:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:35 smithi092 ceph-mon[29156]: pgmap v16147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:35.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29469.859208 secs 2024-04-27T02:29:35.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28772.828929 secs 2024-04-27T02:29:35.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:35 smithi189 ceph-mon[32756]: pgmap v16147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29469.859208 secs 2024-04-27T02:29:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28772.828929 secs 2024-04-27T02:29:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:35 smithi156 ceph-mon[32679]: pgmap v16147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:37.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:37 smithi092 ceph-mon[29156]: pgmap v16148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:37.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:37 smithi189 ceph-mon[32756]: pgmap v16148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:37.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:37 smithi156 ceph-mon[32679]: pgmap v16148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:39.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:39 smithi092 ceph-mon[29156]: pgmap v16149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:39.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:39 smithi189 ceph-mon[32756]: pgmap v16149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:39.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:39 smithi156 ceph-mon[32679]: pgmap v16149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29474.859338 secs 2024-04-27T02:29:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28777.829045 secs 2024-04-27T02:29:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29474.859338 secs 2024-04-27T02:29:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28777.829045 secs 2024-04-27T02:29:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29474.859338 secs 2024-04-27T02:29:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28777.829045 secs 2024-04-27T02:29:41.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:41 smithi092 ceph-mon[29156]: pgmap v16150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:41.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:41 smithi189 ceph-mon[32756]: pgmap v16150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:41.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:41 smithi156 ceph-mon[32679]: pgmap v16150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:29:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:42 smithi189 ceph-mon[32756]: pgmap v16151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:29:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:42 smithi156 ceph-mon[32679]: pgmap v16151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:42.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:29:42.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:42 smithi092 ceph-mon[29156]: pgmap v16151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:29:42.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:29:43.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:29:43.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:29:43.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:43 smithi189 ceph-mon[32756]: pgmap v16152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:29:43.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:43 smithi189 ceph-mon[32756]: pgmap v16153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:29:43.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:29:43.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:29:43.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:29:43.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:43 smithi156 ceph-mon[32679]: pgmap v16152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:29:43.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:43 smithi156 ceph-mon[32679]: pgmap v16153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:29:43.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:29:43.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:29:43.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:29:43.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:43 smithi092 ceph-mon[29156]: pgmap v16152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:29:43.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:43 smithi092 ceph-mon[29156]: pgmap v16153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:29:43.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:29:44.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28782.829178 secs 2024-04-27T02:29:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28782.829178 secs 2024-04-27T02:29:45.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28782.829178 secs 2024-04-27T02:29:45.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29479.859470 secs 2024-04-27T02:29:45.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:45 smithi156 ceph-mon[32679]: pgmap v16154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:45.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29479.859470 secs 2024-04-27T02:29:45.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:45 smithi092 ceph-mon[29156]: pgmap v16154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:46.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29479.859470 secs 2024-04-27T02:29:46.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:45 smithi189 ceph-mon[32756]: pgmap v16154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:48.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:47 smithi092 ceph-mon[29156]: pgmap v16155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:48.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:47 smithi189 ceph-mon[32756]: pgmap v16155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:48.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:47 smithi156 ceph-mon[32679]: pgmap v16155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29484.859586 secs 2024-04-27T02:29:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:49 smithi092 ceph-mon[29156]: pgmap v16156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:50.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28787.829333 secs 2024-04-27T02:29:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29484.859586 secs 2024-04-27T02:29:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:49 smithi189 ceph-mon[32756]: pgmap v16156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:50.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28787.829333 secs 2024-04-27T02:29:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29484.859586 secs 2024-04-27T02:29:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:49 smithi156 ceph-mon[32679]: pgmap v16156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28787.829333 secs 2024-04-27T02:29:52.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:51 smithi092 ceph-mon[29156]: pgmap v16157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:52.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:51 smithi189 ceph-mon[32756]: pgmap v16157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:52.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:51 smithi156 ceph-mon[32679]: pgmap v16157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:29:54.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:53 smithi092 ceph-mon[29156]: pgmap v16158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:29:54.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:53 smithi189 ceph-mon[32756]: pgmap v16158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:29:54.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:53 smithi156 ceph-mon[32679]: pgmap v16158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:29:55.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29489.859677 secs 2024-04-27T02:29:55.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28792.829466 secs 2024-04-27T02:29:55.309 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29489.859677 secs 2024-04-27T02:29:55.309 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28792.829466 secs 2024-04-27T02:29:55.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29489.859677 secs 2024-04-27T02:29:55.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28792.829466 secs 2024-04-27T02:29:56.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:55 smithi092 ceph-mon[29156]: pgmap v16159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:29:56.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:55 smithi189 ceph-mon[32756]: pgmap v16159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:29:56.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:55 smithi156 ceph-mon[32679]: pgmap v16159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:29:58.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:57 smithi092 ceph-mon[29156]: pgmap v16160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:29:58.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:57 smithi189 ceph-mon[32756]: pgmap v16160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:29:58.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:57 smithi156 ceph-mon[32679]: pgmap v16160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29494.859850 secs 2024-04-27T02:30:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:59 smithi092 ceph-mon[29156]: pgmap v16161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:29:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28797.829587 secs 2024-04-27T02:30:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29494.859850 secs 2024-04-27T02:30:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:59 smithi189 ceph-mon[32756]: pgmap v16161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:00.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:29:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28797.829587 secs 2024-04-27T02:30:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29494.859850 secs 2024-04-27T02:30:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:59 smithi156 ceph-mon[32679]: pgmap v16161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:29:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28797.829587 secs 2024-04-27T02:30:01.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:30:01.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:30:01.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:30:02.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:01 smithi189 ceph-mon[32756]: pgmap v16162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:02.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:01 smithi156 ceph-mon[32679]: pgmap v16162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:02.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:01 smithi092 ceph-mon[29156]: pgmap v16162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:04.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:03 smithi189 ceph-mon[32756]: pgmap v16163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:04.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:03 smithi156 ceph-mon[32679]: pgmap v16163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:04.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:03 smithi092 ceph-mon[29156]: pgmap v16163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:30:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29499.859939 secs 2024-04-27T02:30:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28802.829659 secs 2024-04-27T02:30:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29499.859939 secs 2024-04-27T02:30:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28802.829659 secs 2024-04-27T02:30:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29499.859939 secs 2024-04-27T02:30:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28802.829659 secs 2024-04-27T02:30:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:06 smithi189 ceph-mon[32756]: pgmap v16164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:06 smithi156 ceph-mon[32679]: pgmap v16164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:06 smithi092 ceph-mon[29156]: pgmap v16164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:30:08.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-mon[29156]: pgmap v16165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:08.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:08 smithi189 ceph-mon[32756]: pgmap v16165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:08.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:08 smithi156 ceph-mon[32679]: pgmap v16165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:08.968 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:30:08.682+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:30:08.968 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:30:08.682+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:30:08.968 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:30:08.682+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:30:08.968 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:30:08.682+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:30:08.968 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:30:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:30:08.682+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:30:10.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29504.860081 secs 2024-04-27T02:30:10.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:10 smithi189 ceph-mon[32756]: pgmap v16166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:10.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28807.829730 secs 2024-04-27T02:30:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29504.860081 secs 2024-04-27T02:30:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:10 smithi156 ceph-mon[32679]: pgmap v16166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28807.829730 secs 2024-04-27T02:30:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29504.860081 secs 2024-04-27T02:30:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:10 smithi092 ceph-mon[29156]: pgmap v16166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28807.829730 secs 2024-04-27T02:30:12.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:12 smithi189 ceph-mon[32756]: pgmap v16167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:12.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:12 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:30:12.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:12 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:30:12.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:12 smithi156 ceph-mon[32679]: pgmap v16167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:12.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:12 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:30:12.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:12 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:30:12.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:12 smithi092 ceph-mon[29156]: pgmap v16167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:12.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:12 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:30:12.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:12 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:30:14.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:14 smithi189 ceph-mon[32756]: pgmap v16168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:14.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:14 smithi156 ceph-mon[32679]: pgmap v16168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:14.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:14 smithi092 ceph-mon[29156]: pgmap v16168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29509.860217 secs 2024-04-27T02:30:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28812.829871 secs 2024-04-27T02:30:15.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29509.860217 secs 2024-04-27T02:30:15.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28812.829871 secs 2024-04-27T02:30:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29509.860217 secs 2024-04-27T02:30:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28812.829871 secs 2024-04-27T02:30:16.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:16 smithi189 ceph-mon[32756]: pgmap v16169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:16.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:16 smithi156 ceph-mon[32679]: pgmap v16169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:16.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:16 smithi092 ceph-mon[29156]: pgmap v16169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:18.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:18 smithi189 ceph-mon[32756]: pgmap v16170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:18.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:18 smithi156 ceph-mon[32679]: pgmap v16170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:18.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:18 smithi092 ceph-mon[29156]: pgmap v16170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:20.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29514.860368 secs 2024-04-27T02:30:20.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:20 smithi189 ceph-mon[32756]: pgmap v16171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:20.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28817.829981 secs 2024-04-27T02:30:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29514.860368 secs 2024-04-27T02:30:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:20 smithi156 ceph-mon[32679]: pgmap v16171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28817.829981 secs 2024-04-27T02:30:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29514.860368 secs 2024-04-27T02:30:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:20 smithi092 ceph-mon[29156]: pgmap v16171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28817.829981 secs 2024-04-27T02:30:22.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:22 smithi189 ceph-mon[32756]: pgmap v16172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:22.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:22 smithi156 ceph-mon[32679]: pgmap v16172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:22.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:22 smithi092 ceph-mon[29156]: pgmap v16172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:24.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:24 smithi092 ceph-mon[29156]: pgmap v16173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:24.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:24 smithi189 ceph-mon[32756]: pgmap v16173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:24.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:24 smithi156 ceph-mon[32679]: pgmap v16173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T02:30:25.309 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29519.860503 secs 2024-04-27T02:30:25.309 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28822.830098 secs 2024-04-27T02:30:25.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29519.860503 secs 2024-04-27T02:30:25.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28822.830098 secs 2024-04-27T02:30:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29519.860503 secs 2024-04-27T02:30:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28822.830098 secs 2024-04-27T02:30:26.325 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:26 smithi156 ceph-mon[32679]: pgmap v16174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:26.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:26 smithi189 ceph-mon[32756]: pgmap v16174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:26.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:26 smithi092 ceph-mon[29156]: pgmap v16174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:30:28.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:28 smithi189 ceph-mon[32756]: pgmap v16175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:28.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:28 smithi156 ceph-mon[32679]: pgmap v16175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:28.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:28 smithi092 ceph-mon[29156]: pgmap v16175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:30.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29524.860625 secs 2024-04-27T02:30:30.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:30 smithi189 ceph-mon[32756]: pgmap v16176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:30.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28827.830221 secs 2024-04-27T02:30:30.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29524.860625 secs 2024-04-27T02:30:30.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:30 smithi156 ceph-mon[32679]: pgmap v16176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:30.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28827.830221 secs 2024-04-27T02:30:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29524.860625 secs 2024-04-27T02:30:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:30 smithi092 ceph-mon[29156]: pgmap v16176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28827.830221 secs 2024-04-27T02:30:32.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:32 smithi189 ceph-mon[32756]: pgmap v16177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:32.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:32 smithi156 ceph-mon[32679]: pgmap v16177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:32.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:32 smithi092 ceph-mon[29156]: pgmap v16177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:34.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:34 smithi189 ceph-mon[32756]: pgmap v16178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:34.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:34 smithi156 ceph-mon[32679]: pgmap v16178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:34.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:34 smithi092 ceph-mon[29156]: pgmap v16178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:35.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29529.860755 secs 2024-04-27T02:30:35.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28832.830310 secs 2024-04-27T02:30:35.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29529.860755 secs 2024-04-27T02:30:35.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28832.830310 secs 2024-04-27T02:30:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29529.860755 secs 2024-04-27T02:30:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28832.830310 secs 2024-04-27T02:30:36.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:36 smithi189 ceph-mon[32756]: pgmap v16179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:36.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:36 smithi156 ceph-mon[32679]: pgmap v16179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:36.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:36 smithi092 ceph-mon[29156]: pgmap v16179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:38.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:38 smithi189 ceph-mon[32756]: pgmap v16180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:38.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:38 smithi156 ceph-mon[32679]: pgmap v16180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:38.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:38 smithi092 ceph-mon[29156]: pgmap v16180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:30:40.034+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:30:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:30:40.034+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:30:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:30:40.034+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:30:40.008 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:30:40.034+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 228 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:30:40.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29534.860881 secs 2024-04-27T02:30:40.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:40 smithi189 ceph-mon[32756]: pgmap v16181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:40.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28837.830441 secs 2024-04-27T02:30:40.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29534.860881 secs 2024-04-27T02:30:40.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:40 smithi156 ceph-mon[32679]: pgmap v16181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:40.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28837.830441 secs 2024-04-27T02:30:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29534.860881 secs 2024-04-27T02:30:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:40 smithi092 ceph-mon[29156]: pgmap v16181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28837.830441 secs 2024-04-27T02:30:42.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:42 smithi189 ceph-mon[32756]: pgmap v16182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:42.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:42 smithi156 ceph-mon[32679]: pgmap v16182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:42.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:42 smithi092 ceph-mon[29156]: pgmap v16182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:43.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:30:43.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:30:43.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: pgmap v16183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: pgmap v16183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: pgmap v16183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:44.449 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:45.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29539.860948 secs 2024-04-27T02:30:45.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28842.830513 secs 2024-04-27T02:30:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29539.860948 secs 2024-04-27T02:30:45.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28842.830513 secs 2024-04-27T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29539.860948 secs 2024-04-27T02:30:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28842.830513 secs 2024-04-27T02:30:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:46 smithi189 ceph-mon[32756]: pgmap v16184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:46 smithi156 ceph-mon[32679]: pgmap v16184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:46 smithi092 ceph-mon[29156]: pgmap v16184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:30:46.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:46.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:30:47.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:30:47.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:30:47.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:47.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:30:47.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:30:48.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:48 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:30:48.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:48 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:48.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:48 smithi189 ceph-mon[32756]: pgmap v16185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:48.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:48 smithi189 ceph-mon[32756]: pgmap v16186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:48.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:48 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:30:48.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:48 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:48.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:48 smithi156 ceph-mon[32679]: pgmap v16185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:48.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:48 smithi156 ceph-mon[32679]: pgmap v16186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:48 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:30:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:48 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:30:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:48 smithi092 ceph-mon[29156]: pgmap v16185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:30:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:48 smithi092 ceph-mon[29156]: pgmap v16186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29544.861030 secs 2024-04-27T02:30:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:50 smithi189 ceph-mon[32756]: pgmap v16187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28847.830576 secs 2024-04-27T02:30:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29544.861030 secs 2024-04-27T02:30:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:50 smithi156 ceph-mon[32679]: pgmap v16187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:50.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28847.830576 secs 2024-04-27T02:30:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29544.861030 secs 2024-04-27T02:30:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:50 smithi092 ceph-mon[29156]: pgmap v16187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28847.830576 secs 2024-04-27T02:30:52.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:52 smithi189 ceph-mon[32756]: pgmap v16188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:52.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:52 smithi156 ceph-mon[32679]: pgmap v16188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:52.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:52 smithi092 ceph-mon[29156]: pgmap v16188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:54.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:54 smithi189 ceph-mon[32756]: pgmap v16189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:54.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:54 smithi156 ceph-mon[32679]: pgmap v16189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:54.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:54 smithi092 ceph-mon[29156]: pgmap v16189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:55.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:55 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29549.861096 secs 2024-04-27T02:30:55.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28852.830710 secs 2024-04-27T02:30:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:55 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29549.861096 secs 2024-04-27T02:30:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28852.830710 secs 2024-04-27T02:30:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:55 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29549.861096 secs 2024-04-27T02:30:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28852.830710 secs 2024-04-27T02:30:56.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:56 smithi189 ceph-mon[32756]: pgmap v16190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:56.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:56 smithi156 ceph-mon[32679]: pgmap v16190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:56.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:56 smithi092 ceph-mon[29156]: pgmap v16190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T02:30:58.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:30:58 smithi189 ceph-mon[32756]: pgmap v16191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:30:58.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:30:58 smithi156 ceph-mon[32679]: pgmap v16191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:30:58.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:30:58 smithi092 ceph-mon[29156]: pgmap v16191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:31:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:00 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29554.861175 secs 2024-04-27T02:31:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:00 smithi189 ceph-mon[32756]: pgmap v16192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:00.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28857.830833 secs 2024-04-27T02:31:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:00 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29554.861175 secs 2024-04-27T02:31:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:00 smithi156 ceph-mon[32679]: pgmap v16192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:00.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28857.830833 secs 2024-04-27T02:31:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:00 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29554.861175 secs 2024-04-27T02:31:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:00 smithi092 ceph-mon[29156]: pgmap v16192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:00.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28857.830833 secs 2024-04-27T02:31:02.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:02 smithi189 ceph-mon[32756]: pgmap v16193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:02.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:02 smithi156 ceph-mon[32679]: pgmap v16193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:02.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:02 smithi092 ceph-mon[29156]: pgmap v16193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:04.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:04 smithi189 ceph-mon[32756]: pgmap v16194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:04.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:04 smithi156 ceph-mon[32679]: pgmap v16194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:04.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:04 smithi092 ceph-mon[29156]: pgmap v16194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29559.861292 secs 2024-04-27T02:31:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28862.830950 secs 2024-04-27T02:31:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29559.861292 secs 2024-04-27T02:31:05.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28862.830950 secs 2024-04-27T02:31:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29559.861292 secs 2024-04-27T02:31:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28862.830950 secs 2024-04-27T02:31:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:06 smithi189 ceph-mon[32756]: pgmap v16195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:06 smithi156 ceph-mon[32679]: pgmap v16195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:06 smithi092 ceph-mon[29156]: pgmap v16195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:08.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:08 smithi156 ceph-mon[32679]: pgmap v16196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:08.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:08 smithi092 ceph-mon[29156]: pgmap v16196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:08.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:08 smithi189 ceph-mon[32756]: pgmap v16196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29564.861407 secs 2024-04-27T02:31:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:10 smithi156 ceph-mon[32679]: pgmap v16197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:10 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 28867.831068 secs 2024-04-27T02:31:10.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:10 smithi156 ceph-mon[32679]: slow request 2881.044480 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29564.861407 secs 2024-04-27T02:31:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:10 smithi092 ceph-mon[29156]: pgmap v16197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:10 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 28867.831068 secs 2024-04-27T02:31:10.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:10 smithi092 ceph-mon[29156]: slow request 2881.044480 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29564.861407 secs 2024-04-27T02:31:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:10 smithi189 ceph-mon[32756]: pgmap v16197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:10 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 28867.831068 secs 2024-04-27T02:31:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:10 smithi189 ceph-mon[32756]: slow request 2881.044480 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:12.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:12 smithi156 ceph-mon[32679]: pgmap v16198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:12.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:12 smithi092 ceph-mon[29156]: pgmap v16198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:12.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:12 smithi189 ceph-mon[32756]: pgmap v16198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:14.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:14 smithi156 ceph-mon[32679]: pgmap v16199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:14.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:14 smithi092 ceph-mon[29156]: pgmap v16199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:14.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:14 smithi189 ceph-mon[32756]: pgmap v16199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29569.861521 secs 2024-04-27T02:31:15.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28872.831157 secs 2024-04-27T02:31:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29569.861521 secs 2024-04-27T02:31:15.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28872.831157 secs 2024-04-27T02:31:15.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29569.861521 secs 2024-04-27T02:31:15.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28872.831157 secs 2024-04-27T02:31:16.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:16 smithi156 ceph-mon[32679]: pgmap v16200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:16.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:16 smithi092 ceph-mon[29156]: pgmap v16200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:16.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:16 smithi189 ceph-mon[32756]: pgmap v16200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:18.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:18 smithi156 ceph-mon[32679]: pgmap v16201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:18.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:18 smithi092 ceph-mon[29156]: pgmap v16201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:18.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:18 smithi189 ceph-mon[32756]: pgmap v16201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29574.861637 secs 2024-04-27T02:31:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:20 smithi156 ceph-mon[32679]: pgmap v16202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:20.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28877.831311 secs 2024-04-27T02:31:20.414 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29574.861637 secs 2024-04-27T02:31:20.414 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:20 smithi189 ceph-mon[32756]: pgmap v16202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:20.415 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28877.831311 secs 2024-04-27T02:31:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29574.861637 secs 2024-04-27T02:31:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:20 smithi092 ceph-mon[29156]: pgmap v16202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28877.831311 secs 2024-04-27T02:31:22.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:22 smithi156 ceph-mon[32679]: pgmap v16203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:22.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:22 smithi092 ceph-mon[29156]: pgmap v16203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:22.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:22 smithi189 ceph-mon[32756]: pgmap v16203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:24.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:24 smithi156 ceph-mon[32679]: pgmap v16204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:24.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:24 smithi092 ceph-mon[29156]: pgmap v16204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:24.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:24 smithi189 ceph-mon[32756]: pgmap v16204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:25 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29579.861758 secs 2024-04-27T02:31:25.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28882.831436 secs 2024-04-27T02:31:25.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:25 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29579.861758 secs 2024-04-27T02:31:25.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28882.831436 secs 2024-04-27T02:31:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:25 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29579.861758 secs 2024-04-27T02:31:25.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28882.831436 secs 2024-04-27T02:31:26.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:26 smithi156 ceph-mon[32679]: pgmap v16205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:26.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:26 smithi092 ceph-mon[29156]: pgmap v16205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:26.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:26 smithi189 ceph-mon[32756]: pgmap v16205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:28.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:28 smithi156 ceph-mon[32679]: pgmap v16206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:28.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:28 smithi092 ceph-mon[29156]: pgmap v16206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:28.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:28 smithi189 ceph-mon[32756]: pgmap v16206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:30 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29584.861889 secs 2024-04-27T02:31:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:30 smithi092 ceph-mon[29156]: pgmap v16207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:30.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28887.831556 secs 2024-04-27T02:31:30.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:30 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29584.861889 secs 2024-04-27T02:31:30.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:30 smithi189 ceph-mon[32756]: pgmap v16207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:30.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28887.831556 secs 2024-04-27T02:31:30.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:30 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29584.861889 secs 2024-04-27T02:31:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:30 smithi156 ceph-mon[32679]: pgmap v16207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:30.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28887.831556 secs 2024-04-27T02:31:32.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:32 smithi092 ceph-mon[29156]: pgmap v16208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:32.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:32 smithi189 ceph-mon[32756]: pgmap v16208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:32.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:32 smithi156 ceph-mon[32679]: pgmap v16208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:34.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:34 smithi092 ceph-mon[29156]: pgmap v16209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:34.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:34 smithi189 ceph-mon[32756]: pgmap v16209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:34.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:34 smithi156 ceph-mon[32679]: pgmap v16209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:35 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29589.861991 secs 2024-04-27T02:31:35.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28892.831678 secs 2024-04-27T02:31:35.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:35 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29589.861991 secs 2024-04-27T02:31:35.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28892.831678 secs 2024-04-27T02:31:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:35 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29589.861991 secs 2024-04-27T02:31:35.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28892.831678 secs 2024-04-27T02:31:36.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:36 smithi092 ceph-mon[29156]: pgmap v16210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:36.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:36 smithi189 ceph-mon[32756]: pgmap v16210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:36.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:36 smithi156 ceph-mon[32679]: pgmap v16210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:38.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:38 smithi092 ceph-mon[29156]: pgmap v16211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:38.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:38 smithi189 ceph-mon[32756]: pgmap v16211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:38 smithi156 ceph-mon[32679]: pgmap v16211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:40 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29594.862112 secs 2024-04-27T02:31:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:40 smithi092 ceph-mon[29156]: pgmap v16212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:40 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 28897.831828 secs 2024-04-27T02:31:40.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:40 smithi092 ceph-mon[29156]: slow request 5761.876147 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:40 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29594.862112 secs 2024-04-27T02:31:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:40 smithi189 ceph-mon[32756]: pgmap v16212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:40 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 28897.831828 secs 2024-04-27T02:31:40.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:40 smithi189 ceph-mon[32756]: slow request 5761.876147 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:40.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:40 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29594.862112 secs 2024-04-27T02:31:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:40 smithi156 ceph-mon[32679]: pgmap v16212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:40 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 28897.831828 secs 2024-04-27T02:31:40.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:40 smithi156 ceph-mon[32679]: slow request 5761.876147 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:31:42.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:42 smithi092 ceph-mon[29156]: pgmap v16213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:42.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:42 smithi189 ceph-mon[32756]: pgmap v16213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:42.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:42 smithi156 ceph-mon[32679]: pgmap v16213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:44.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:44 smithi092 ceph-mon[29156]: pgmap v16214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:44.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:44 smithi189 ceph-mon[32756]: pgmap v16214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:44.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:44 smithi156 ceph-mon[32679]: pgmap v16214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:45.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:45 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29599.862223 secs 2024-04-27T02:31:45.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28902.831919 secs 2024-04-27T02:31:45.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:45 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29599.862223 secs 2024-04-27T02:31:45.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28902.831919 secs 2024-04-27T02:31:45.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:45 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29599.862223 secs 2024-04-27T02:31:45.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28902.831919 secs 2024-04-27T02:31:46.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:46 smithi092 ceph-mon[29156]: pgmap v16215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:46.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:46 smithi189 ceph-mon[32756]: pgmap v16215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:46.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:46 smithi156 ceph-mon[32679]: pgmap v16215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:31:47.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:31:47.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:31:47.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:31:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:48 smithi092 ceph-mon[29156]: pgmap v16216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:31:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:31:48.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:31:48.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:48 smithi189 ceph-mon[32756]: pgmap v16216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:48.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:31:48.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:31:48.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:31:48.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:48 smithi156 ceph-mon[32679]: pgmap v16216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:31:48.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:31:48.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:31:48.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:31:49.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:49 smithi092 ceph-mon[29156]: pgmap v16217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:31:49.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:49 smithi092 ceph-mon[29156]: pgmap v16218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:31:49.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:49 smithi189 ceph-mon[32756]: pgmap v16217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:31:49.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:49 smithi189 ceph-mon[32756]: pgmap v16218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:31:49.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:49 smithi156 ceph-mon[32679]: pgmap v16217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:31:49.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:49 smithi156 ceph-mon[32679]: pgmap v16218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:31:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:50 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29604.862333 secs 2024-04-27T02:31:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28907.831999 secs 2024-04-27T02:31:50.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:50 smithi092 ceph-mon[29156]: pgmap v16219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:50.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:50 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29604.862333 secs 2024-04-27T02:31:50.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28907.831999 secs 2024-04-27T02:31:50.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:50 smithi189 ceph-mon[32756]: pgmap v16219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:50.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:50 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29604.862333 secs 2024-04-27T02:31:50.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28907.831999 secs 2024-04-27T02:31:50.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:50 smithi156 ceph-mon[32679]: pgmap v16219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:52.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:52 smithi092 ceph-mon[29156]: pgmap v16220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:53.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:52 smithi189 ceph-mon[32756]: pgmap v16220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:53.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:52 smithi156 ceph-mon[32679]: pgmap v16220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:54 smithi092 ceph-mon[29156]: pgmap v16221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29609.862479 secs 2024-04-27T02:31:54.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28912.832071 secs 2024-04-27T02:31:55.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:54 smithi189 ceph-mon[32756]: pgmap v16221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:55.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29609.862479 secs 2024-04-27T02:31:55.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28912.832071 secs 2024-04-27T02:31:55.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:54 smithi156 ceph-mon[32679]: pgmap v16221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:55.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29609.862479 secs 2024-04-27T02:31:55.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28912.832071 secs 2024-04-27T02:31:56.959 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:56 smithi156 ceph-mon[32679]: pgmap v16222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:56.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:56 smithi092 ceph-mon[29156]: pgmap v16222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:57.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:56 smithi189 ceph-mon[32756]: pgmap v16222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:31:58.970 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:58 smithi092 ceph-mon[29156]: pgmap v16223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:31:59.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:58 smithi189 ceph-mon[32756]: pgmap v16223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:31:59.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:58 smithi156 ceph-mon[32679]: pgmap v16223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:31:59.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29614.862598 secs 2024-04-27T02:31:59.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:31:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28917.832171 secs 2024-04-27T02:32:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29614.862598 secs 2024-04-27T02:32:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:31:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28917.832171 secs 2024-04-27T02:32:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29614.862598 secs 2024-04-27T02:32:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:31:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28917.832171 secs 2024-04-27T02:32:00.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:00 smithi092 ceph-mon[29156]: pgmap v16224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:01.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:00 smithi189 ceph-mon[32756]: pgmap v16224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:01.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:00 smithi156 ceph-mon[32679]: pgmap v16224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:03.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:03 smithi092 ceph-mon[29156]: pgmap v16225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:03.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:03 smithi189 ceph-mon[32756]: pgmap v16225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:03.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:03 smithi156 ceph-mon[32679]: pgmap v16225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:05 smithi092 ceph-mon[29156]: pgmap v16226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:05 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29619.862743 secs 2024-04-27T02:32:05.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28922.832329 secs 2024-04-27T02:32:05.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:05 smithi189 ceph-mon[32756]: pgmap v16226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:05.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:05 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29619.862743 secs 2024-04-27T02:32:05.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28922.832329 secs 2024-04-27T02:32:05.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:05 smithi156 ceph-mon[32679]: pgmap v16226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:05.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:05 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29619.862743 secs 2024-04-27T02:32:05.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28922.832329 secs 2024-04-27T02:32:07.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:07 smithi092 ceph-mon[29156]: pgmap v16227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:07.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:07 smithi189 ceph-mon[32756]: pgmap v16227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:07.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:07 smithi156 ceph-mon[32679]: pgmap v16227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:08.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:08 smithi092 ceph-mon[29156]: pgmap v16228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:08.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:08 smithi189 ceph-mon[32756]: pgmap v16228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:08.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:08 smithi156 ceph-mon[32679]: pgmap v16228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:32:09.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28927.832389 secs 2024-04-27T02:32:09.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28927.832389 secs 2024-04-27T02:32:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28927.832389 secs 2024-04-27T02:32:10.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:10 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29624.862887 secs 2024-04-27T02:32:10.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:10 smithi156 ceph-mon[32679]: pgmap v16229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:10.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:10 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29624.862887 secs 2024-04-27T02:32:10.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:10 smithi092 ceph-mon[29156]: pgmap v16229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:11.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:10 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29624.862887 secs 2024-04-27T02:32:11.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:10 smithi189 ceph-mon[32756]: pgmap v16229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:32:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:12 smithi156 ceph-mon[32679]: pgmap v16230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:12.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:12 smithi092 ceph-mon[29156]: pgmap v16230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:13.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:12 smithi189 ceph-mon[32756]: pgmap v16230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:14 smithi156 ceph-mon[32679]: pgmap v16231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:14.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28932.832506 secs 2024-04-27T02:32:14.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:14 smithi092 ceph-mon[29156]: pgmap v16231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:14.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28932.832506 secs 2024-04-27T02:32:15.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:14 smithi189 ceph-mon[32756]: pgmap v16231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:15.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28932.832506 secs 2024-04-27T02:32:15.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:15 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29629.863010 secs 2024-04-27T02:32:15.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:15 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29629.863010 secs 2024-04-27T02:32:16.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:15 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29629.863010 secs 2024-04-27T02:32:17.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:17 smithi092 ceph-mon[29156]: pgmap v16232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:17.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:17 smithi189 ceph-mon[32756]: pgmap v16232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:17.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:17 smithi156 ceph-mon[32679]: pgmap v16232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:19.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:19 smithi092 ceph-mon[29156]: pgmap v16233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:19.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:19 smithi189 ceph-mon[32756]: pgmap v16233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:19.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:19 smithi156 ceph-mon[32679]: pgmap v16233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:20.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:20 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29634.863129 secs 2024-04-27T02:32:20.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28937.832624 secs 2024-04-27T02:32:20.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:20 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29634.863129 secs 2024-04-27T02:32:20.512 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28937.832624 secs 2024-04-27T02:32:20.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:20 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29634.863129 secs 2024-04-27T02:32:20.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28937.832624 secs 2024-04-27T02:32:21.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:21 smithi092 ceph-mon[29156]: pgmap v16234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:21.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:21 smithi189 ceph-mon[32756]: pgmap v16234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:21 smithi156 ceph-mon[32679]: pgmap v16234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:22.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:22 smithi092 ceph-mon[29156]: pgmap v16235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:22.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:22 smithi189 ceph-mon[32756]: pgmap v16235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:22.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:22 smithi156 ceph-mon[32679]: pgmap v16235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:24.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:24 smithi092 ceph-mon[29156]: pgmap v16236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:24.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:24 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29639.863245 secs 2024-04-27T02:32:24.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28942.832701 secs 2024-04-27T02:32:25.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:24 smithi189 ceph-mon[32756]: pgmap v16236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:25.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:24 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29639.863245 secs 2024-04-27T02:32:25.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28942.832701 secs 2024-04-27T02:32:25.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:24 smithi156 ceph-mon[32679]: pgmap v16236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:25.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:24 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29639.863245 secs 2024-04-27T02:32:25.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28942.832701 secs 2024-04-27T02:32:26.960 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:26 smithi156 ceph-mon[32679]: pgmap v16237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:26.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:26 smithi092 ceph-mon[29156]: pgmap v16237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:27.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:26 smithi189 ceph-mon[32756]: pgmap v16237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:28.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:28 smithi092 ceph-mon[29156]: pgmap v16238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:29.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:28 smithi189 ceph-mon[32756]: pgmap v16238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:29.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:28 smithi156 ceph-mon[32679]: pgmap v16238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:29.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:29 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29644.863409 secs 2024-04-27T02:32:29.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28947.832806 secs 2024-04-27T02:32:30.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:29 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29644.863409 secs 2024-04-27T02:32:30.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28947.832806 secs 2024-04-27T02:32:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:29 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29644.863409 secs 2024-04-27T02:32:30.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28947.832806 secs 2024-04-27T02:32:30.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:30 smithi092 ceph-mon[29156]: pgmap v16239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:31.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:30 smithi189 ceph-mon[32756]: pgmap v16239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:31.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:30 smithi156 ceph-mon[32679]: pgmap v16239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:32.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:32 smithi092 ceph-mon[29156]: pgmap v16240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:33.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:32 smithi189 ceph-mon[32756]: pgmap v16240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:33.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:32 smithi156 ceph-mon[32679]: pgmap v16240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:34.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:34 smithi092 ceph-mon[29156]: pgmap v16241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:34.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:34 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29649.863533 secs 2024-04-27T02:32:34.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28952.832885 secs 2024-04-27T02:32:35.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:34 smithi189 ceph-mon[32756]: pgmap v16241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:35.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:34 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29649.863533 secs 2024-04-27T02:32:35.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28952.832885 secs 2024-04-27T02:32:35.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:34 smithi156 ceph-mon[32679]: pgmap v16241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:35.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:34 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29649.863533 secs 2024-04-27T02:32:35.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28952.832885 secs 2024-04-27T02:32:36.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:36 smithi092 ceph-mon[29156]: pgmap v16242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:37.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:36 smithi189 ceph-mon[32756]: pgmap v16242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:37.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:36 smithi156 ceph-mon[32679]: pgmap v16242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:38.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:38 smithi092 ceph-mon[29156]: pgmap v16243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:39.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:38 smithi189 ceph-mon[32756]: pgmap v16243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:39.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:38 smithi156 ceph-mon[32679]: pgmap v16243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:40.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:39 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29654.863674 secs 2024-04-27T02:32:40.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28957.833005 secs 2024-04-27T02:32:40.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:39 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29654.863674 secs 2024-04-27T02:32:40.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28957.833005 secs 2024-04-27T02:32:40.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:39 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29654.863674 secs 2024-04-27T02:32:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28957.833005 secs 2024-04-27T02:32:41.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:40 smithi189 ceph-mon[32756]: pgmap v16244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:41.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:40 smithi156 ceph-mon[32679]: pgmap v16244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:41.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:40 smithi092 ceph-mon[29156]: pgmap v16244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:43.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:42 smithi189 ceph-mon[32756]: pgmap v16245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:42 smithi156 ceph-mon[32679]: pgmap v16245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:43.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:42 smithi092 ceph-mon[29156]: pgmap v16245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:44 smithi092 ceph-mon[29156]: pgmap v16246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:44 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29659.863803 secs 2024-04-27T02:32:44.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28962.833120 secs 2024-04-27T02:32:45.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:44 smithi189 ceph-mon[32756]: pgmap v16246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:45.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:44 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29659.863803 secs 2024-04-27T02:32:45.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28962.833120 secs 2024-04-27T02:32:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:44 smithi156 ceph-mon[32679]: pgmap v16246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:32:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:44 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29659.863803 secs 2024-04-27T02:32:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28962.833120 secs 2024-04-27T02:32:47.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:46 smithi189 ceph-mon[32756]: pgmap v16247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:47.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:46 smithi156 ceph-mon[32679]: pgmap v16247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:47.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:46 smithi092 ceph-mon[29156]: pgmap v16247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:48.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:32:48.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:32:48.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:32:49.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:48 smithi189 ceph-mon[32756]: pgmap v16248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:49.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:32:49.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:32:49.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:32:49.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:48 smithi156 ceph-mon[32679]: pgmap v16248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:49.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:32:49.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:32:49.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:32:49.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:48 smithi092 ceph-mon[29156]: pgmap v16248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:32:49.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:32:49.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:32:49.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:32:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:49 smithi189 ceph-mon[32756]: pgmap v16249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:32:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:49 smithi189 ceph-mon[32756]: pgmap v16250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:49 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29664.863861 secs 2024-04-27T02:32:50.013 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28967.833257 secs 2024-04-27T02:32:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:49 smithi156 ceph-mon[32679]: pgmap v16249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:32:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:49 smithi156 ceph-mon[32679]: pgmap v16250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:49 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29664.863861 secs 2024-04-27T02:32:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28967.833257 secs 2024-04-27T02:32:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:49 smithi092 ceph-mon[29156]: pgmap v16249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:32:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:49 smithi092 ceph-mon[29156]: pgmap v16250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:49 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29664.863861 secs 2024-04-27T02:32:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28967.833257 secs 2024-04-27T02:32:52.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:51 smithi189 ceph-mon[32756]: pgmap v16251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:52.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:51 smithi156 ceph-mon[32679]: pgmap v16251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:52.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:51 smithi092 ceph-mon[29156]: pgmap v16251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:54.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:53 smithi189 ceph-mon[32756]: pgmap v16252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:54.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:53 smithi156 ceph-mon[32679]: pgmap v16252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:54.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:53 smithi092 ceph-mon[29156]: pgmap v16252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:32:55.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:54 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29669.863928 secs 2024-04-27T02:32:55.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28972.833395 secs 2024-04-27T02:32:55.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:54 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29669.863928 secs 2024-04-27T02:32:55.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28972.833395 secs 2024-04-27T02:32:55.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:54 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29669.863928 secs 2024-04-27T02:32:55.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28972.833395 secs 2024-04-27T02:32:56.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:55 smithi156 ceph-mon[32679]: pgmap v16253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:56.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:55 smithi189 ceph-mon[32756]: pgmap v16253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:56.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:55 smithi092 ceph-mon[29156]: pgmap v16253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:58.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:57 smithi189 ceph-mon[32756]: pgmap v16254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:58.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:57 smithi156 ceph-mon[32679]: pgmap v16254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:32:58.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:57 smithi092 ceph-mon[29156]: pgmap v16254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:59 smithi189 ceph-mon[32756]: pgmap v16255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:33:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:59 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29674.864050 secs 2024-04-27T02:33:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:32:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28977.833522 secs 2024-04-27T02:33:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:59 smithi156 ceph-mon[32679]: pgmap v16255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:33:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:59 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29674.864050 secs 2024-04-27T02:33:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:32:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28977.833522 secs 2024-04-27T02:33:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:59 smithi092 ceph-mon[29156]: pgmap v16255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:33:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:59 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29674.864050 secs 2024-04-27T02:33:00.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:32:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28977.833522 secs 2024-04-27T02:33:02.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:01 smithi189 ceph-mon[32756]: pgmap v16256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:02.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:01 smithi156 ceph-mon[32679]: pgmap v16256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:02.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:01 smithi092 ceph-mon[29156]: pgmap v16256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:04.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:03 smithi189 ceph-mon[32756]: pgmap v16257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:03 smithi156 ceph-mon[32679]: pgmap v16257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:04.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:03 smithi092 ceph-mon[29156]: pgmap v16257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:04 smithi189 ceph-mon[32756]: 12 slow requests, 0 included below; oldest blocked for > 29679.864160 secs 2024-04-27T02:33:05.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28982.833601 secs 2024-04-27T02:33:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:04 smithi156 ceph-mon[32679]: 12 slow requests, 0 included below; oldest blocked for > 29679.864160 secs 2024-04-27T02:33:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28982.833601 secs 2024-04-27T02:33:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:04 smithi092 ceph-mon[29156]: 12 slow requests, 0 included below; oldest blocked for > 29679.864160 secs 2024-04-27T02:33:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28982.833601 secs 2024-04-27T02:33:06.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:05 smithi189 ceph-mon[32756]: pgmap v16258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:06.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:05 smithi156 ceph-mon[32679]: pgmap v16258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:06.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:05 smithi092 ceph-mon[29156]: pgmap v16258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:08.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:07 smithi189 ceph-mon[32756]: pgmap v16259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:08.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:07 smithi156 ceph-mon[32679]: pgmap v16259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:08.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:07 smithi092 ceph-mon[29156]: pgmap v16259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:09 smithi189 ceph-mon[32756]: pgmap v16260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:09 smithi189 ceph-mon[32756]: 14 slow requests, 1 included below; oldest blocked for > 29684.864275 secs 2024-04-27T02:33:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:09 smithi189 ceph-mon[32756]: slow request 180.091473 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:33:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28987.833715 secs 2024-04-27T02:33:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:09 smithi156 ceph-mon[32679]: pgmap v16260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:09 smithi156 ceph-mon[32679]: 14 slow requests, 1 included below; oldest blocked for > 29684.864275 secs 2024-04-27T02:33:10.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:09 smithi156 ceph-mon[32679]: slow request 180.091473 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:33:10.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28987.833715 secs 2024-04-27T02:33:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:09 smithi092 ceph-mon[29156]: pgmap v16260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:09 smithi092 ceph-mon[29156]: 14 slow requests, 1 included below; oldest blocked for > 29684.864275 secs 2024-04-27T02:33:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:09 smithi092 ceph-mon[29156]: slow request 180.091473 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:33:10.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28987.833715 secs 2024-04-27T02:33:12.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:11 smithi189 ceph-mon[32756]: pgmap v16261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:12.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:11 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:33:12.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:11 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:33:12.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:11 smithi156 ceph-mon[32679]: pgmap v16261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:12.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:11 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:33:12.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:11 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:33:12.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:11 smithi092 ceph-mon[29156]: pgmap v16261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:12.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:11 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:33:12.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:11 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:33:14.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:13 smithi189 ceph-mon[32756]: pgmap v16262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:14.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:13 smithi156 ceph-mon[32679]: pgmap v16262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:14.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:13 smithi092 ceph-mon[29156]: pgmap v16262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:15.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29689.864350 secs 2024-04-27T02:33:15.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28992.833849 secs 2024-04-27T02:33:15.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29689.864350 secs 2024-04-27T02:33:15.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28992.833849 secs 2024-04-27T02:33:15.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29689.864350 secs 2024-04-27T02:33:15.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28992.833849 secs 2024-04-27T02:33:16.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:15 smithi189 ceph-mon[32756]: pgmap v16263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:16.119 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:15 smithi092 ceph-mon[29156]: pgmap v16263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:16.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:15 smithi156 ceph-mon[32679]: pgmap v16263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:18.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:17 smithi189 ceph-mon[32756]: pgmap v16264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:18.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:17 smithi156 ceph-mon[32679]: pgmap v16264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:18.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:17 smithi092 ceph-mon[29156]: pgmap v16264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:20.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:19 smithi189 ceph-mon[32756]: pgmap v16265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:20.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29694.864485 secs 2024-04-27T02:33:20.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 28997.833933 secs 2024-04-27T02:33:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:19 smithi156 ceph-mon[32679]: pgmap v16265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29694.864485 secs 2024-04-27T02:33:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 28997.833933 secs 2024-04-27T02:33:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:19 smithi092 ceph-mon[29156]: pgmap v16265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29694.864485 secs 2024-04-27T02:33:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 28997.833933 secs 2024-04-27T02:33:22.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:21 smithi189 ceph-mon[32756]: pgmap v16266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:21 smithi156 ceph-mon[32679]: pgmap v16266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:22.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:21 smithi092 ceph-mon[29156]: pgmap v16266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:24.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:23 smithi189 ceph-mon[32756]: pgmap v16267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:24.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:23 smithi156 ceph-mon[32679]: pgmap v16267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:24.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:23 smithi092 ceph-mon[29156]: pgmap v16267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:25.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29699.864586 secs 2024-04-27T02:33:25.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29002.834041 secs 2024-04-27T02:33:25.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29699.864586 secs 2024-04-27T02:33:25.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29002.834041 secs 2024-04-27T02:33:25.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29699.864586 secs 2024-04-27T02:33:25.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29002.834041 secs 2024-04-27T02:33:26.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:25 smithi189 ceph-mon[32756]: pgmap v16268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:26.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:25 smithi092 ceph-mon[29156]: pgmap v16268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:26.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:25 smithi156 ceph-mon[32679]: pgmap v16268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:28.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:27 smithi189 ceph-mon[32756]: pgmap v16269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:28.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:27 smithi156 ceph-mon[32679]: pgmap v16269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:28.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:27 smithi092 ceph-mon[29156]: pgmap v16269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:30.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:29 smithi189 ceph-mon[32756]: pgmap v16270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:30.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29704.864727 secs 2024-04-27T02:33:30.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29007.834100 secs 2024-04-27T02:33:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:29 smithi156 ceph-mon[32679]: pgmap v16270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29704.864727 secs 2024-04-27T02:33:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29007.834100 secs 2024-04-27T02:33:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:29 smithi092 ceph-mon[29156]: pgmap v16270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29704.864727 secs 2024-04-27T02:33:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29007.834100 secs 2024-04-27T02:33:31.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:31 smithi092 ceph-mon[29156]: pgmap v16271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:32.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:31 smithi189 ceph-mon[32756]: pgmap v16271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:32.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:31 smithi156 ceph-mon[32679]: pgmap v16271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:34.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:33 smithi189 ceph-mon[32756]: pgmap v16272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:34.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:33 smithi156 ceph-mon[32679]: pgmap v16272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:34.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:33 smithi092 ceph-mon[29156]: pgmap v16272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:35.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29709.864857 secs 2024-04-27T02:33:35.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29012.834162 secs 2024-04-27T02:33:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29709.864857 secs 2024-04-27T02:33:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29012.834162 secs 2024-04-27T02:33:35.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29709.864857 secs 2024-04-27T02:33:35.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29012.834162 secs 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:33:36.011 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:33:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:33:36.012 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.037+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1ca808a0d0 tx=0x7f1ca80d9000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:33:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.082+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T02:33:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.082+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T02:33:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.082+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:33:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.082+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=31 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T02:33:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.082+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:33:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.083+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T02:33:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:36.083+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T02:33:36.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:35 smithi189 ceph-mon[32756]: pgmap v16273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:36.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:35 smithi156 ceph-mon[32679]: pgmap v16273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:36.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:35 smithi092 ceph-mon[29156]: pgmap v16273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:38.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:37 smithi189 ceph-mon[32756]: pgmap v16274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:38.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:37 smithi156 ceph-mon[32679]: pgmap v16274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:38.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:37 smithi092 ceph-mon[29156]: pgmap v16274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.059+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:33:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.059+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:33:40.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.059+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T02:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.060+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.060+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 229 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T02:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.060+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.060+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:33:40.034 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:33:40.060+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 230 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:33:40.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:39 smithi189 ceph-mon[32756]: pgmap v16275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:40.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29714.864928 secs 2024-04-27T02:33:40.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29017.834246 secs 2024-04-27T02:33:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:39 smithi156 ceph-mon[32679]: pgmap v16275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29714.864928 secs 2024-04-27T02:33:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29017.834246 secs 2024-04-27T02:33:40.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:39 smithi092 ceph-mon[29156]: pgmap v16275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:40.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29714.864928 secs 2024-04-27T02:33:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29017.834246 secs 2024-04-27T02:33:42.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:41 smithi189 ceph-mon[32756]: pgmap v16276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:42.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:41 smithi156 ceph-mon[32679]: pgmap v16276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:42.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:41 smithi092 ceph-mon[29156]: pgmap v16276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:44.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:43 smithi156 ceph-mon[32679]: pgmap v16277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:44.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:43 smithi092 ceph-mon[29156]: pgmap v16277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:44.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:43 smithi189 ceph-mon[32756]: pgmap v16277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29719.865019 secs 2024-04-27T02:33:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29022.834315 secs 2024-04-27T02:33:45.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29719.865019 secs 2024-04-27T02:33:45.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29022.834315 secs 2024-04-27T02:33:45.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29719.865019 secs 2024-04-27T02:33:45.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29022.834315 secs 2024-04-27T02:33:46.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:45 smithi156 ceph-mon[32679]: pgmap v16278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:46.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:45 smithi092 ceph-mon[29156]: pgmap v16278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:46.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:45 smithi189 ceph-mon[32756]: pgmap v16278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:33:48.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:47 smithi156 ceph-mon[32679]: pgmap v16279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:48.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:47 smithi092 ceph-mon[29156]: pgmap v16279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:48.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:47 smithi189 ceph-mon[32756]: pgmap v16279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:49.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:33:49.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:33:49.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:33:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: pgmap v16280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29724.865088 secs 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29027.834378 secs 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: pgmap v16281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: pgmap v16282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:50.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:33:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: pgmap v16280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29724.865088 secs 2024-04-27T02:33:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29027.834378 secs 2024-04-27T02:33:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:33:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:33:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: pgmap v16281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:33:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: pgmap v16282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:50.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: pgmap v16280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29724.865088 secs 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29027.834378 secs 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: pgmap v16281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: pgmap v16282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:50.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:33:51.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:51 smithi189 ceph-mon[32756]: pgmap v16283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:51.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:51 smithi156 ceph-mon[32679]: pgmap v16283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:51.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:51 smithi092 ceph-mon[29156]: pgmap v16283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:53.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:53 smithi189 ceph-mon[32756]: pgmap v16284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:33:53.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:53 smithi156 ceph-mon[32679]: pgmap v16284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:33:53.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:53 smithi092 ceph-mon[29156]: pgmap v16284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:33:54.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29032.834521 secs 2024-04-27T02:33:54.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29032.834521 secs 2024-04-27T02:33:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29032.834521 secs 2024-04-27T02:33:55.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:55 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29729.865204 secs 2024-04-27T02:33:55.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:55 smithi092 ceph-mon[29156]: pgmap v16285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:56.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:55 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29729.865204 secs 2024-04-27T02:33:56.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:55 smithi189 ceph-mon[32756]: pgmap v16285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:56.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:55 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29729.865204 secs 2024-04-27T02:33:56.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:55 smithi156 ceph-mon[32679]: pgmap v16285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:57.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:57 smithi189 ceph-mon[32756]: pgmap v16286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:57.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:57 smithi156 ceph-mon[32679]: pgmap v16286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:57.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:57 smithi092 ceph-mon[29156]: pgmap v16286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:33:59.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:33:59 smithi189 ceph-mon[32756]: pgmap v16287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:33:59.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:33:59 smithi156 ceph-mon[32679]: pgmap v16287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:33:59.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:33:59 smithi092 ceph-mon[29156]: pgmap v16287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:34:00.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:00 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29734.865282 secs 2024-04-27T02:34:00.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29037.834672 secs 2024-04-27T02:34:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:00 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29734.865282 secs 2024-04-27T02:34:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29037.834672 secs 2024-04-27T02:34:00.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:00 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29734.865282 secs 2024-04-27T02:34:00.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29037.834672 secs 2024-04-27T02:34:01.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:01 smithi189 ceph-mon[32756]: pgmap v16288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:01.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:01 smithi156 ceph-mon[32679]: pgmap v16288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:01.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:01 smithi092 ceph-mon[29156]: pgmap v16288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:03.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:03 smithi189 ceph-mon[32756]: pgmap v16289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:03.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:03 smithi156 ceph-mon[32679]: pgmap v16289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:03.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:03 smithi092 ceph-mon[29156]: pgmap v16289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:04.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29042.834789 secs 2024-04-27T02:34:04.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29042.834789 secs 2024-04-27T02:34:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29042.834789 secs 2024-04-27T02:34:05.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:05 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29739.865370 secs 2024-04-27T02:34:05.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:05 smithi092 ceph-mon[29156]: pgmap v16290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:06.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:05 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29739.865370 secs 2024-04-27T02:34:06.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:05 smithi189 ceph-mon[32756]: pgmap v16290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:06.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:05 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29739.865370 secs 2024-04-27T02:34:06.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:05 smithi156 ceph-mon[32679]: pgmap v16290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:07.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:07 smithi189 ceph-mon[32756]: pgmap v16291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:07.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:07 smithi156 ceph-mon[32679]: pgmap v16291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:07.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:07 smithi092 ceph-mon[29156]: pgmap v16291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:09.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:09 smithi189 ceph-mon[32756]: pgmap v16292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:09.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:09 smithi156 ceph-mon[32679]: pgmap v16292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:09.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:09 smithi092 ceph-mon[29156]: pgmap v16292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29744.865502 secs 2024-04-27T02:34:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29047.834928 secs 2024-04-27T02:34:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29744.865502 secs 2024-04-27T02:34:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29047.834928 secs 2024-04-27T02:34:10.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29744.865502 secs 2024-04-27T02:34:10.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29047.834928 secs 2024-04-27T02:34:11.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:11 smithi189 ceph-mon[32756]: pgmap v16293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:11.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:11 smithi156 ceph-mon[32679]: pgmap v16293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:11.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:11 smithi092 ceph-mon[29156]: pgmap v16293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:13.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:13 smithi189 ceph-mon[32756]: pgmap v16294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:13.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:13 smithi156 ceph-mon[32679]: pgmap v16294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:13.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:13 smithi092 ceph-mon[29156]: pgmap v16294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29052.834995 secs 2024-04-27T02:34:14.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29052.834995 secs 2024-04-27T02:34:15.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29052.834995 secs 2024-04-27T02:34:15.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:15 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29749.865594 secs 2024-04-27T02:34:15.968 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:15 smithi092 ceph-mon[29156]: pgmap v16295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:16.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:15 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29749.865594 secs 2024-04-27T02:34:16.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:15 smithi189 ceph-mon[32756]: pgmap v16295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:16.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:15 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29749.865594 secs 2024-04-27T02:34:16.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:15 smithi156 ceph-mon[32679]: pgmap v16295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:17.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:17 smithi189 ceph-mon[32756]: pgmap v16296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:17.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:17 smithi156 ceph-mon[32679]: pgmap v16296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:17.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:17 smithi092 ceph-mon[29156]: pgmap v16296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:19.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:19 smithi189 ceph-mon[32756]: pgmap v16297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:19.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:19 smithi156 ceph-mon[32679]: pgmap v16297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:19.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:19 smithi092 ceph-mon[29156]: pgmap v16297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:20.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:20 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29754.865728 secs 2024-04-27T02:34:20.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29057.835059 secs 2024-04-27T02:34:20.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:20 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29754.865728 secs 2024-04-27T02:34:20.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29057.835059 secs 2024-04-27T02:34:20.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:20 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29754.865728 secs 2024-04-27T02:34:20.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29057.835059 secs 2024-04-27T02:34:21.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:21 smithi189 ceph-mon[32756]: pgmap v16298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:21 smithi156 ceph-mon[32679]: pgmap v16298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:21.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:21 smithi092 ceph-mon[29156]: pgmap v16298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:23.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:23 smithi189 ceph-mon[32756]: pgmap v16299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:23.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:23 smithi156 ceph-mon[32679]: pgmap v16299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:23.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:23 smithi092 ceph-mon[29156]: pgmap v16299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:24.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29062.835181 secs 2024-04-27T02:34:25.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29062.835181 secs 2024-04-27T02:34:25.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29062.835181 secs 2024-04-27T02:34:25.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:25 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29759.865870 secs 2024-04-27T02:34:25.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:25 smithi092 ceph-mon[29156]: pgmap v16300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:26.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:25 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29759.865870 secs 2024-04-27T02:34:26.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:25 smithi189 ceph-mon[32756]: pgmap v16300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:26.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:25 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29759.865870 secs 2024-04-27T02:34:26.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:25 smithi156 ceph-mon[32679]: pgmap v16300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:27.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:27 smithi189 ceph-mon[32756]: pgmap v16301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:27.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:27 smithi156 ceph-mon[32679]: pgmap v16301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:27.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:27 smithi092 ceph-mon[29156]: pgmap v16301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:29.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:29 smithi189 ceph-mon[32756]: pgmap v16302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:29.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:29 smithi156 ceph-mon[32679]: pgmap v16302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:29.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:29 smithi092 ceph-mon[29156]: pgmap v16302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:30.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:30 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29764.865984 secs 2024-04-27T02:34:30.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29067.835317 secs 2024-04-27T02:34:30.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:30 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29764.865984 secs 2024-04-27T02:34:30.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29067.835317 secs 2024-04-27T02:34:30.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:30 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29764.865984 secs 2024-04-27T02:34:30.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29067.835317 secs 2024-04-27T02:34:31.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:31 smithi189 ceph-mon[32756]: pgmap v16303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:31.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:31 smithi156 ceph-mon[32679]: pgmap v16303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:31.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:31 smithi092 ceph-mon[29156]: pgmap v16303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:33.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:33 smithi189 ceph-mon[32756]: pgmap v16304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:33.634 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:33 smithi092 ceph-mon[29156]: pgmap v16304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:33.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:33 smithi156 ceph-mon[32679]: pgmap v16304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:34.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29072.835394 secs 2024-04-27T02:34:35.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29072.835394 secs 2024-04-27T02:34:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29072.835394 secs 2024-04-27T02:34:35.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:35 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29769.866096 secs 2024-04-27T02:34:35.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:35 smithi092 ceph-mon[29156]: pgmap v16305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:36.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:35 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29769.866096 secs 2024-04-27T02:34:36.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:35 smithi189 ceph-mon[32756]: pgmap v16305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:36.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:35 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29769.866096 secs 2024-04-27T02:34:36.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:35 smithi156 ceph-mon[32679]: pgmap v16305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:37.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:37 smithi189 ceph-mon[32756]: pgmap v16306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:37.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:37 smithi156 ceph-mon[32679]: pgmap v16306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:37.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:37 smithi092 ceph-mon[29156]: pgmap v16306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:39.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:39 smithi189 ceph-mon[32756]: pgmap v16307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:39.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:39 smithi156 ceph-mon[32679]: pgmap v16307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:39.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:39 smithi092 ceph-mon[29156]: pgmap v16307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:40.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:40 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29774.866207 secs 2024-04-27T02:34:40.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29077.835517 secs 2024-04-27T02:34:40.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:40 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29774.866207 secs 2024-04-27T02:34:40.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29077.835517 secs 2024-04-27T02:34:40.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:40 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29774.866207 secs 2024-04-27T02:34:40.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29077.835517 secs 2024-04-27T02:34:41.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:41 smithi189 ceph-mon[32756]: pgmap v16308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:41.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:41 smithi156 ceph-mon[32679]: pgmap v16308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:41.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:41 smithi092 ceph-mon[29156]: pgmap v16308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:43.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:43 smithi189 ceph-mon[32756]: pgmap v16309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:43.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:43 smithi156 ceph-mon[32679]: pgmap v16309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:43.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:43 smithi092 ceph-mon[29156]: pgmap v16309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:44.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29082.835644 secs 2024-04-27T02:34:45.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29082.835644 secs 2024-04-27T02:34:45.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29082.835644 secs 2024-04-27T02:34:45.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:45 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29779.866316 secs 2024-04-27T02:34:45.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:45 smithi092 ceph-mon[29156]: pgmap v16310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:46.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:45 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29779.866316 secs 2024-04-27T02:34:46.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:45 smithi189 ceph-mon[32756]: pgmap v16310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:46.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:45 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29779.866316 secs 2024-04-27T02:34:46.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:45 smithi156 ceph-mon[32679]: pgmap v16310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:47.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:47 smithi189 ceph-mon[32756]: pgmap v16311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:47.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:47 smithi156 ceph-mon[32679]: pgmap v16311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:47.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:47 smithi092 ceph-mon[29156]: pgmap v16311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:34:49.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:49 smithi189 ceph-mon[32756]: pgmap v16312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:49.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:49 smithi156 ceph-mon[32679]: pgmap v16312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:49.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:49 smithi092 ceph-mon[29156]: pgmap v16312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:34:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29784.866453 secs 2024-04-27T02:34:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29087.835769 secs 2024-04-27T02:34:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:34:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:34:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:34:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: pgmap v16313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:34:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: pgmap v16314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:50.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29784.866453 secs 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29087.835769 secs 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: pgmap v16313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: pgmap v16314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:50.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29784.866453 secs 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29087.835769 secs 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: pgmap v16313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: pgmap v16314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:50.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:34:53.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:53 smithi189 ceph-mon[32756]: pgmap v16315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:53.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:53 smithi156 ceph-mon[32679]: pgmap v16315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:53.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:53 smithi092 ceph-mon[29156]: pgmap v16315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:55.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:55 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29789.866573 secs 2024-04-27T02:34:55.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29092.835896 secs 2024-04-27T02:34:55.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:55 smithi189 ceph-mon[32756]: pgmap v16316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:55 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29789.866573 secs 2024-04-27T02:34:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29092.835896 secs 2024-04-27T02:34:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:55 smithi156 ceph-mon[32679]: pgmap v16316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:55 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29789.866573 secs 2024-04-27T02:34:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29092.835896 secs 2024-04-27T02:34:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:55 smithi092 ceph-mon[29156]: pgmap v16316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:57.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:57 smithi189 ceph-mon[32756]: pgmap v16317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:57 smithi156 ceph-mon[32679]: pgmap v16317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:57.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:57 smithi092 ceph-mon[29156]: pgmap v16317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:34:59.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:34:59 smithi189 ceph-mon[32756]: pgmap v16318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:34:59.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:34:59 smithi156 ceph-mon[32679]: pgmap v16318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:34:59.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:34:59 smithi092 ceph-mon[29156]: pgmap v16318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:35:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:00 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29794.866709 secs 2024-04-27T02:35:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29097.836018 secs 2024-04-27T02:35:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:00 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29794.866709 secs 2024-04-27T02:35:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29097.836018 secs 2024-04-27T02:35:00.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:00 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29794.866709 secs 2024-04-27T02:35:00.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29097.836018 secs 2024-04-27T02:35:01.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:01 smithi189 ceph-mon[32756]: pgmap v16319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:35:01.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:01 smithi156 ceph-mon[32679]: pgmap v16319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:35:01.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:01 smithi092 ceph-mon[29156]: pgmap v16319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:35:03.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:03 smithi189 ceph-mon[32756]: pgmap v16320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:03.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:03 smithi156 ceph-mon[32679]: pgmap v16320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:03.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:03 smithi092 ceph-mon[29156]: pgmap v16320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:05 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29799.866783 secs 2024-04-27T02:35:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29102.836134 secs 2024-04-27T02:35:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:05 smithi189 ceph-mon[32756]: pgmap v16321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:05 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29799.866783 secs 2024-04-27T02:35:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29102.836134 secs 2024-04-27T02:35:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:05 smithi156 ceph-mon[32679]: pgmap v16321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:05 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29799.866783 secs 2024-04-27T02:35:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29102.836134 secs 2024-04-27T02:35:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:05 smithi092 ceph-mon[29156]: pgmap v16321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:07.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:07 smithi189 ceph-mon[32756]: pgmap v16322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:07 smithi156 ceph-mon[32679]: pgmap v16322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:07.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:07 smithi092 ceph-mon[29156]: pgmap v16322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:09.052 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:35:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:35:08.805+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:35:09.052 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:35:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:35:08.805+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:35:09.052 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:35:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:35:08.805+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:35:09.053 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:35:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:35:08.805+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:35:09.053 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:35:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:35:08.805+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:35:09.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:09 smithi189 ceph-mon[32756]: pgmap v16323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:09.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:09 smithi156 ceph-mon[32679]: pgmap v16323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:09.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:09 smithi092 ceph-mon[29156]: pgmap v16323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:10.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 29804.866897 secs 2024-04-27T02:35:10.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29107.836286 secs 2024-04-27T02:35:10.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 29804.866897 secs 2024-04-27T02:35:10.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29107.836286 secs 2024-04-27T02:35:10.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 29804.866897 secs 2024-04-27T02:35:10.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29107.836286 secs 2024-04-27T02:35:11.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:11 smithi189 ceph-mon[32756]: pgmap v16324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:11.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:11 smithi156 ceph-mon[32679]: pgmap v16324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:11.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:11 smithi092 ceph-mon[29156]: pgmap v16324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:13.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:13 smithi189 ceph-mon[32756]: pgmap v16325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:13.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:13 smithi156 ceph-mon[32679]: pgmap v16325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:13.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:13 smithi092 ceph-mon[29156]: pgmap v16325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29809.867020 secs 2024-04-27T02:35:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29112.836407 secs 2024-04-27T02:35:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:15 smithi189 ceph-mon[32756]: pgmap v16326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29809.867020 secs 2024-04-27T02:35:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29112.836407 secs 2024-04-27T02:35:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:15 smithi156 ceph-mon[32679]: pgmap v16326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29809.867020 secs 2024-04-27T02:35:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29112.836407 secs 2024-04-27T02:35:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:15 smithi092 ceph-mon[29156]: pgmap v16326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:16.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:35:16.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:35:16.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:35:16.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:35:16.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:35:16.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:35:17.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:17 smithi189 ceph-mon[32756]: pgmap v16327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:17.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:17 smithi156 ceph-mon[32679]: pgmap v16327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:17.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:17 smithi092 ceph-mon[29156]: pgmap v16327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:19.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:19 smithi189 ceph-mon[32756]: pgmap v16328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:19.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:19 smithi156 ceph-mon[32679]: pgmap v16328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:19.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:19 smithi092 ceph-mon[29156]: pgmap v16328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29814.867137 secs 2024-04-27T02:35:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29117.836517 secs 2024-04-27T02:35:20.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29814.867137 secs 2024-04-27T02:35:20.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29117.836517 secs 2024-04-27T02:35:20.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29814.867137 secs 2024-04-27T02:35:20.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29117.836517 secs 2024-04-27T02:35:21.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:21 smithi189 ceph-mon[32756]: pgmap v16329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:21.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:21 smithi156 ceph-mon[32679]: pgmap v16329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:21.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:21 smithi092 ceph-mon[29156]: pgmap v16329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:23.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:23 smithi189 ceph-mon[32756]: pgmap v16330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:23.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:23 smithi156 ceph-mon[32679]: pgmap v16330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:23.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:23 smithi092 ceph-mon[29156]: pgmap v16330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T02:35:25.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29819.867249 secs 2024-04-27T02:35:25.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29122.836629 secs 2024-04-27T02:35:25.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:25 smithi189 ceph-mon[32756]: pgmap v16331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29819.867249 secs 2024-04-27T02:35:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29122.836629 secs 2024-04-27T02:35:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:25 smithi156 ceph-mon[32679]: pgmap v16331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:25.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29819.867249 secs 2024-04-27T02:35:25.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29122.836629 secs 2024-04-27T02:35:25.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:25 smithi092 ceph-mon[29156]: pgmap v16331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T02:35:27.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:27 smithi189 ceph-mon[32756]: pgmap v16332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:27.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:27 smithi156 ceph-mon[32679]: pgmap v16332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:27.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:27 smithi092 ceph-mon[29156]: pgmap v16332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:29.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:29 smithi189 ceph-mon[32756]: pgmap v16333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:29.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:29 smithi156 ceph-mon[32679]: pgmap v16333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:29.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:29 smithi092 ceph-mon[29156]: pgmap v16333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29824.867323 secs 2024-04-27T02:35:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29127.836763 secs 2024-04-27T02:35:30.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29824.867323 secs 2024-04-27T02:35:30.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29127.836763 secs 2024-04-27T02:35:30.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29824.867323 secs 2024-04-27T02:35:30.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29127.836763 secs 2024-04-27T02:35:31.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:31 smithi189 ceph-mon[32756]: pgmap v16334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:31.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:31 smithi156 ceph-mon[32679]: pgmap v16334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:31.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:31 smithi092 ceph-mon[29156]: pgmap v16334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:33.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:33 smithi156 ceph-mon[32679]: pgmap v16335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:33.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:33 smithi092 ceph-mon[29156]: pgmap v16335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:33.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:33 smithi189 ceph-mon[32756]: pgmap v16335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:35.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29829.867463 secs 2024-04-27T02:35:35.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29132.836907 secs 2024-04-27T02:35:35.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:35 smithi156 ceph-mon[32679]: pgmap v16336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:35.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29829.867463 secs 2024-04-27T02:35:35.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29132.836907 secs 2024-04-27T02:35:35.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:35 smithi092 ceph-mon[29156]: pgmap v16336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:35.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29829.867463 secs 2024-04-27T02:35:35.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29132.836907 secs 2024-04-27T02:35:35.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:35 smithi189 ceph-mon[32756]: pgmap v16336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:37.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:37 smithi156 ceph-mon[32679]: pgmap v16337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:37.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:37 smithi092 ceph-mon[29156]: pgmap v16337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:37.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:37 smithi189 ceph-mon[32756]: pgmap v16337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:39.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:39 smithi156 ceph-mon[32679]: pgmap v16338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:39.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:39 smithi092 ceph-mon[29156]: pgmap v16338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:39.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:39 smithi189 ceph-mon[32756]: pgmap v16338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:40 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29834.867609 secs 2024-04-27T02:35:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29137.837031 secs 2024-04-27T02:35:40.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:40 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29834.867609 secs 2024-04-27T02:35:40.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29137.837031 secs 2024-04-27T02:35:40.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:40 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29834.867609 secs 2024-04-27T02:35:40.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29137.837031 secs 2024-04-27T02:35:41.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:41 smithi156 ceph-mon[32679]: pgmap v16339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:41.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:41 smithi092 ceph-mon[29156]: pgmap v16339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:41.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:41 smithi189 ceph-mon[32756]: pgmap v16339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:43.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:43 smithi156 ceph-mon[32679]: pgmap v16340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:43.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:43 smithi092 ceph-mon[29156]: pgmap v16340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:43.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:43 smithi189 ceph-mon[32756]: pgmap v16340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:45.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29839.867722 secs 2024-04-27T02:35:45.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29142.837138 secs 2024-04-27T02:35:45.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:45 smithi156 ceph-mon[32679]: pgmap v16341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:45.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29839.867722 secs 2024-04-27T02:35:45.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29142.837138 secs 2024-04-27T02:35:45.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:45 smithi092 ceph-mon[29156]: pgmap v16341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:45.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29839.867722 secs 2024-04-27T02:35:45.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29142.837138 secs 2024-04-27T02:35:45.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:45 smithi189 ceph-mon[32756]: pgmap v16341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:47.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:47 smithi156 ceph-mon[32679]: pgmap v16342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:47.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:47 smithi092 ceph-mon[29156]: pgmap v16342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:47.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:47 smithi189 ceph-mon[32756]: pgmap v16342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:49.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:49 smithi156 ceph-mon[32679]: pgmap v16343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:49.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:49 smithi092 ceph-mon[29156]: pgmap v16343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:49.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:49 smithi189 ceph-mon[32756]: pgmap v16343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:50.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29844.867860 secs 2024-04-27T02:35:50.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29147.837256 secs 2024-04-27T02:35:50.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:35:50.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29844.867860 secs 2024-04-27T02:35:50.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29147.837256 secs 2024-04-27T02:35:50.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:35:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29844.867860 secs 2024-04-27T02:35:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29147.837256 secs 2024-04-27T02:35:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:35:51.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:51 smithi092 ceph-mon[29156]: pgmap v16344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:51.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:51 smithi156 ceph-mon[32679]: pgmap v16344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:51.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:51 smithi189 ceph-mon[32756]: pgmap v16344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:53.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:53 smithi092 ceph-mon[29156]: pgmap v16345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:53.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:53 smithi156 ceph-mon[32679]: pgmap v16345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:53.413 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:53 smithi189 ceph-mon[32756]: pgmap v16345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29849.867945 secs 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29152.837354 secs 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: pgmap v16346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:35:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:35:55.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29849.867945 secs 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29152.837354 secs 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: pgmap v16346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:35:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:35:55.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29849.867945 secs 2024-04-27T02:35:55.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29152.837354 secs 2024-04-27T02:35:55.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: pgmap v16346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:35:55.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:35:56.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:56 smithi156 ceph-mon[32679]: pgmap v16347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:35:56.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:56 smithi156 ceph-mon[32679]: pgmap v16348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:35:56.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:56 smithi092 ceph-mon[29156]: pgmap v16347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:35:56.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:56 smithi092 ceph-mon[29156]: pgmap v16348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:35:56.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:56 smithi189 ceph-mon[32756]: pgmap v16347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:35:56.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:56 smithi189 ceph-mon[32756]: pgmap v16348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:35:58.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:35:58 smithi092 ceph-mon[29156]: pgmap v16349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:35:58.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:35:58 smithi189 ceph-mon[32756]: pgmap v16349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:35:58.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:35:58 smithi156 ceph-mon[32679]: pgmap v16349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:36:00.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:00 smithi092 ceph-mon[29156]: pgmap v16350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:00.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:00 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29854.868067 secs 2024-04-27T02:36:00.465 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29157.837415 secs 2024-04-27T02:36:00.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:00 smithi189 ceph-mon[32756]: pgmap v16350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:00.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:00 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29854.868067 secs 2024-04-27T02:36:00.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29157.837415 secs 2024-04-27T02:36:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:00 smithi156 ceph-mon[32679]: pgmap v16350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:00 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29854.868067 secs 2024-04-27T02:36:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29157.837415 secs 2024-04-27T02:36:02.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:02 smithi092 ceph-mon[29156]: pgmap v16351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:36:02.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:02 smithi189 ceph-mon[32756]: pgmap v16351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:36:02.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:02 smithi156 ceph-mon[32679]: pgmap v16351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:36:04.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:04 smithi092 ceph-mon[29156]: pgmap v16352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:04.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:04 smithi189 ceph-mon[32756]: pgmap v16352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:04.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:04 smithi156 ceph-mon[32679]: pgmap v16352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:36:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:05 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29859.868175 secs 2024-04-27T02:36:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29162.837518 secs 2024-04-27T02:36:05.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:05 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29859.868175 secs 2024-04-27T02:36:05.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29162.837518 secs 2024-04-27T02:36:05.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:05 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29859.868175 secs 2024-04-27T02:36:05.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29162.837518 secs 2024-04-27T02:36:06.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:06 smithi092 ceph-mon[29156]: pgmap v16353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:36:06.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:06 smithi189 ceph-mon[32756]: pgmap v16353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:36:06.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:06 smithi156 ceph-mon[32679]: pgmap v16353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T02:36:08.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:08 smithi092 ceph-mon[29156]: pgmap v16354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:08.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:08 smithi189 ceph-mon[32756]: pgmap v16354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:08.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:08 smithi156 ceph-mon[32679]: pgmap v16354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:10 smithi092 ceph-mon[29156]: pgmap v16355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:10 smithi092 ceph-mon[29156]: 13 slow requests, 2 included below; oldest blocked for > 29864.868295 secs 2024-04-27T02:36:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:10 smithi092 ceph-mon[29156]: slow request 2880.793160 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:10 smithi092 ceph-mon[29156]: slow request 360.095493 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29167.837619 secs 2024-04-27T02:36:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:10 smithi189 ceph-mon[32756]: pgmap v16355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:10 smithi189 ceph-mon[32756]: 13 slow requests, 2 included below; oldest blocked for > 29864.868295 secs 2024-04-27T02:36:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:10 smithi189 ceph-mon[32756]: slow request 2880.793160 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:10 smithi189 ceph-mon[32756]: slow request 360.095493 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29167.837619 secs 2024-04-27T02:36:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:10 smithi156 ceph-mon[32679]: pgmap v16355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:10 smithi156 ceph-mon[32679]: 13 slow requests, 2 included below; oldest blocked for > 29864.868295 secs 2024-04-27T02:36:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:10 smithi156 ceph-mon[32679]: slow request 2880.793160 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:10 smithi156 ceph-mon[32679]: slow request 360.095493 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29167.837619 secs 2024-04-27T02:36:12.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:12 smithi092 ceph-mon[29156]: pgmap v16356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:12.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:12 smithi189 ceph-mon[32756]: pgmap v16356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:12.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:12 smithi156 ceph-mon[32679]: pgmap v16356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:14.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:14 smithi092 ceph-mon[29156]: pgmap v16357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:14.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:14 smithi189 ceph-mon[32756]: pgmap v16357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:14 smithi156 ceph-mon[32679]: pgmap v16357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:36:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:15 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29869.868408 secs 2024-04-27T02:36:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29172.837752 secs 2024-04-27T02:36:15.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:15 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29869.868408 secs 2024-04-27T02:36:15.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29172.837752 secs 2024-04-27T02:36:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:15 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29869.868408 secs 2024-04-27T02:36:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29172.837752 secs 2024-04-27T02:36:16.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:16 smithi092 ceph-mon[29156]: pgmap v16358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:16.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:16 smithi189 ceph-mon[32756]: pgmap v16358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:16.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:16 smithi156 ceph-mon[32679]: pgmap v16358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:36:17.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:17 smithi189 ceph-mon[32756]: pgmap v16359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:17.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:17 smithi156 ceph-mon[32679]: pgmap v16359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:17.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:17 smithi092 ceph-mon[29156]: pgmap v16359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:19.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:19 smithi092 ceph-mon[29156]: pgmap v16360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:19.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:19 smithi189 ceph-mon[32756]: pgmap v16360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:19.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:19 smithi156 ceph-mon[32679]: pgmap v16360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:20.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:20 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29874.868523 secs 2024-04-27T02:36:20.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29177.837870 secs 2024-04-27T02:36:20.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:20 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29874.868523 secs 2024-04-27T02:36:20.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29177.837870 secs 2024-04-27T02:36:20.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:20 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29874.868523 secs 2024-04-27T02:36:20.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29177.837870 secs 2024-04-27T02:36:21.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:21 smithi092 ceph-mon[29156]: pgmap v16361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:21.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:21 smithi189 ceph-mon[32756]: pgmap v16361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:21.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:21 smithi156 ceph-mon[32679]: pgmap v16361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:23.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:23 smithi092 ceph-mon[29156]: pgmap v16362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:23.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:23 smithi189 ceph-mon[32756]: pgmap v16362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:23.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:23 smithi156 ceph-mon[32679]: pgmap v16362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:25.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:25 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29879.868594 secs 2024-04-27T02:36:25.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29182.837995 secs 2024-04-27T02:36:25.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:25 smithi092 ceph-mon[29156]: pgmap v16363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:25.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:25 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29879.868594 secs 2024-04-27T02:36:25.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29182.837995 secs 2024-04-27T02:36:25.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:25 smithi189 ceph-mon[32756]: pgmap v16363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:25.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:25 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29879.868594 secs 2024-04-27T02:36:25.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29182.837995 secs 2024-04-27T02:36:25.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:25 smithi156 ceph-mon[32679]: pgmap v16363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:27.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:27 smithi092 ceph-mon[29156]: pgmap v16364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:27.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:27 smithi189 ceph-mon[32756]: pgmap v16364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:27.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:27 smithi156 ceph-mon[32679]: pgmap v16364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:29.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:29 smithi092 ceph-mon[29156]: pgmap v16365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:29.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:29 smithi189 ceph-mon[32756]: pgmap v16365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:29.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:29 smithi156 ceph-mon[32679]: pgmap v16365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:30.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:30 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29884.868718 secs 2024-04-27T02:36:30.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29187.838112 secs 2024-04-27T02:36:30.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:30 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29884.868718 secs 2024-04-27T02:36:30.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29187.838112 secs 2024-04-27T02:36:30.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:30 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29884.868718 secs 2024-04-27T02:36:30.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29187.838112 secs 2024-04-27T02:36:31.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:31 smithi189 ceph-mon[32756]: pgmap v16366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:31.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:31 smithi156 ceph-mon[32679]: pgmap v16366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:31.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:31 smithi092 ceph-mon[29156]: pgmap v16366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:33.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:33 smithi189 ceph-mon[32756]: pgmap v16367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:33.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:33 smithi156 ceph-mon[32679]: pgmap v16367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:33.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:33 smithi092 ceph-mon[29156]: pgmap v16367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:35.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:35 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29889.868853 secs 2024-04-27T02:36:35.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29192.838229 secs 2024-04-27T02:36:35.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:35 smithi189 ceph-mon[32756]: pgmap v16368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:35.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:35 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29889.868853 secs 2024-04-27T02:36:35.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29192.838229 secs 2024-04-27T02:36:35.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:35 smithi156 ceph-mon[32679]: pgmap v16368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:35.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:35 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29889.868853 secs 2024-04-27T02:36:35.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29192.838229 secs 2024-04-27T02:36:35.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:35 smithi092 ceph-mon[29156]: pgmap v16368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:37.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:37 smithi189 ceph-mon[32756]: pgmap v16369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:37 smithi156 ceph-mon[32679]: pgmap v16369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:37.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:37 smithi092 ceph-mon[29156]: pgmap v16369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:39.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:39 smithi189 ceph-mon[32756]: pgmap v16370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:39.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:39 smithi156 ceph-mon[32679]: pgmap v16370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:39.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:39 smithi092 ceph-mon[29156]: pgmap v16370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:36:40.084+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:36:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:36:40.084+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:36:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:36:40.084+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:36:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:36:40.084+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 231 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:36:40.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:40 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 29894.868948 secs 2024-04-27T02:36:40.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:40 smithi189 ceph-mon[32756]: slow request 5761.565094 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:40.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29197.838324 secs 2024-04-27T02:36:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:40 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 29894.868948 secs 2024-04-27T02:36:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:40 smithi156 ceph-mon[32679]: slow request 5761.565094 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29197.838324 secs 2024-04-27T02:36:40.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:40 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 29894.868948 secs 2024-04-27T02:36:40.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:40 smithi092 ceph-mon[29156]: slow request 5761.565094 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:36:40.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29197.838324 secs 2024-04-27T02:36:41.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:41 smithi189 ceph-mon[32756]: pgmap v16371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:41 smithi156 ceph-mon[32679]: pgmap v16371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:41.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:41 smithi092 ceph-mon[29156]: pgmap v16371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:43.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:43 smithi189 ceph-mon[32756]: pgmap v16372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:43.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:43 smithi156 ceph-mon[32679]: pgmap v16372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:43.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:43 smithi092 ceph-mon[29156]: pgmap v16372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:45.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:45 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29899.869059 secs 2024-04-27T02:36:45.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29202.838465 secs 2024-04-27T02:36:45.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:45 smithi189 ceph-mon[32756]: pgmap v16373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:45.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:45 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29899.869059 secs 2024-04-27T02:36:45.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29202.838465 secs 2024-04-27T02:36:45.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:45 smithi156 ceph-mon[32679]: pgmap v16373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:45.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:45 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29899.869059 secs 2024-04-27T02:36:45.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29202.838465 secs 2024-04-27T02:36:45.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:45 smithi092 ceph-mon[29156]: pgmap v16373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:47.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:47 smithi189 ceph-mon[32756]: pgmap v16374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:47 smithi156 ceph-mon[32679]: pgmap v16374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:47.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:47 smithi092 ceph-mon[29156]: pgmap v16374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:49.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:49 smithi189 ceph-mon[32756]: pgmap v16375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:49.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:49 smithi156 ceph-mon[32679]: pgmap v16375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:49.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:49 smithi092 ceph-mon[29156]: pgmap v16375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:50.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:50 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29904.869209 secs 2024-04-27T02:36:50.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29207.838585 secs 2024-04-27T02:36:50.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:50 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29904.869209 secs 2024-04-27T02:36:50.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29207.838585 secs 2024-04-27T02:36:50.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:50 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29904.869209 secs 2024-04-27T02:36:50.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29207.838585 secs 2024-04-27T02:36:51.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:51 smithi189 ceph-mon[32756]: pgmap v16376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:51.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:51 smithi156 ceph-mon[32679]: pgmap v16376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:51.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:51 smithi092 ceph-mon[29156]: pgmap v16376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:53.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:53 smithi189 ceph-mon[32756]: pgmap v16377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:53.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:53 smithi156 ceph-mon[32679]: pgmap v16377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:53.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:53 smithi092 ceph-mon[29156]: pgmap v16377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:54.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:36:54.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:36:54.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:36:55.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:55 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29909.869351 secs 2024-04-27T02:36:55.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29212.838675 secs 2024-04-27T02:36:55.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:55 smithi189 ceph-mon[32756]: pgmap v16378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:55.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:55 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29909.869351 secs 2024-04-27T02:36:55.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29212.838675 secs 2024-04-27T02:36:55.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:55 smithi156 ceph-mon[32679]: pgmap v16378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:55.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:55 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29909.869351 secs 2024-04-27T02:36:55.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29212.838675 secs 2024-04-27T02:36:55.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:55 smithi092 ceph-mon[29156]: pgmap v16378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:36:57.861 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:57 smithi189 ceph-mon[32756]: pgmap v16379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:57.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:57 smithi156 ceph-mon[32679]: pgmap v16379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:36:57.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:57 smithi092 ceph-mon[29156]: pgmap v16379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: pgmap v16380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29914.869423 secs 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:37:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:37:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: pgmap v16381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:37:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: pgmap v16382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:36:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29217.838780 secs 2024-04-27T02:37:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: pgmap v16380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29914.869423 secs 2024-04-27T02:37:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: pgmap v16381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: pgmap v16382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:36:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29217.838780 secs 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: pgmap v16380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29914.869423 secs 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: pgmap v16381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: pgmap v16382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:37:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:36:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29217.838780 secs 2024-04-27T02:37:02.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:01 smithi189 ceph-mon[32756]: pgmap v16383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:01 smithi156 ceph-mon[32679]: pgmap v16383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:01 smithi092 ceph-mon[29156]: pgmap v16383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:04.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:03 smithi189 ceph-mon[32756]: pgmap v16384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:37:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:03 smithi156 ceph-mon[32679]: pgmap v16384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:37:04.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:03 smithi092 ceph-mon[29156]: pgmap v16384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:37:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29919.869540 secs 2024-04-27T02:37:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29222.838847 secs 2024-04-27T02:37:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29919.869540 secs 2024-04-27T02:37:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29222.838847 secs 2024-04-27T02:37:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29919.869540 secs 2024-04-27T02:37:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29222.838847 secs 2024-04-27T02:37:06.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:05 smithi189 ceph-mon[32756]: pgmap v16385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:05 smithi156 ceph-mon[32679]: pgmap v16385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:06.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:05 smithi092 ceph-mon[29156]: pgmap v16385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:08.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:07 smithi189 ceph-mon[32756]: pgmap v16386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:07 smithi156 ceph-mon[32679]: pgmap v16386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:08.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:07 smithi092 ceph-mon[29156]: pgmap v16386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:37:10.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:09 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29924.869676 secs 2024-04-27T02:37:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:09 smithi189 ceph-mon[32756]: pgmap v16387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:37:10.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29227.838967 secs 2024-04-27T02:37:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:09 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29924.869676 secs 2024-04-27T02:37:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:09 smithi156 ceph-mon[32679]: pgmap v16387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:37:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29227.838967 secs 2024-04-27T02:37:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:09 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29924.869676 secs 2024-04-27T02:37:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:09 smithi092 ceph-mon[29156]: pgmap v16387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:37:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29227.838967 secs 2024-04-27T02:37:12.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:11 smithi189 ceph-mon[32756]: pgmap v16388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:12.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:11 smithi156 ceph-mon[32679]: pgmap v16388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:12.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:11 smithi092 ceph-mon[29156]: pgmap v16388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:14.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:13 smithi189 ceph-mon[32756]: pgmap v16389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:14.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:13 smithi156 ceph-mon[32679]: pgmap v16389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:14.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:13 smithi092 ceph-mon[29156]: pgmap v16389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:15.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:14 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29929.869789 secs 2024-04-27T02:37:15.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29232.839112 secs 2024-04-27T02:37:15.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:14 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29929.869789 secs 2024-04-27T02:37:15.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29232.839112 secs 2024-04-27T02:37:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:14 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29929.869789 secs 2024-04-27T02:37:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29232.839112 secs 2024-04-27T02:37:16.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:15 smithi156 ceph-mon[32679]: pgmap v16390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:16.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:15 smithi092 ceph-mon[29156]: pgmap v16390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:16.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:15 smithi189 ceph-mon[32756]: pgmap v16390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:18.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:17 smithi156 ceph-mon[32679]: pgmap v16391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:18.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:17 smithi092 ceph-mon[29156]: pgmap v16391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:18.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:17 smithi189 ceph-mon[32756]: pgmap v16391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:19 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29934.869914 secs 2024-04-27T02:37:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:19 smithi156 ceph-mon[32679]: pgmap v16392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29237.839249 secs 2024-04-27T02:37:20.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:19 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29934.869914 secs 2024-04-27T02:37:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:19 smithi092 ceph-mon[29156]: pgmap v16392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29237.839249 secs 2024-04-27T02:37:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:19 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29934.869914 secs 2024-04-27T02:37:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:19 smithi189 ceph-mon[32756]: pgmap v16392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29237.839249 secs 2024-04-27T02:37:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:21 smithi156 ceph-mon[32679]: pgmap v16393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:22.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:21 smithi092 ceph-mon[29156]: pgmap v16393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:22.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:21 smithi189 ceph-mon[32756]: pgmap v16393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:23 smithi156 ceph-mon[32679]: pgmap v16394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:24.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:23 smithi189 ceph-mon[32756]: pgmap v16394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:24.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:23 smithi092 ceph-mon[29156]: pgmap v16394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:24.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:24 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29939.869986 secs 2024-04-27T02:37:24.967 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29242.839359 secs 2024-04-27T02:37:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:24 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29939.869986 secs 2024-04-27T02:37:25.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29242.839359 secs 2024-04-27T02:37:25.181 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:24 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29939.869986 secs 2024-04-27T02:37:25.181 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29242.839359 secs 2024-04-27T02:37:26.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:25 smithi156 ceph-mon[32679]: pgmap v16395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:26.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:25 smithi092 ceph-mon[29156]: pgmap v16395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:26.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:25 smithi189 ceph-mon[32756]: pgmap v16395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:28.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:27 smithi156 ceph-mon[32679]: pgmap v16396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:28.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:27 smithi092 ceph-mon[29156]: pgmap v16396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:28.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:27 smithi189 ceph-mon[32756]: pgmap v16396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:29 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29944.870102 secs 2024-04-27T02:37:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:29 smithi156 ceph-mon[32679]: pgmap v16397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29247.839444 secs 2024-04-27T02:37:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:29 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29944.870102 secs 2024-04-27T02:37:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:29 smithi092 ceph-mon[29156]: pgmap v16397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:30.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29247.839444 secs 2024-04-27T02:37:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:29 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29944.870102 secs 2024-04-27T02:37:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:29 smithi189 ceph-mon[32756]: pgmap v16397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29247.839444 secs 2024-04-27T02:37:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:31 smithi156 ceph-mon[32679]: pgmap v16398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:32.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:31 smithi092 ceph-mon[29156]: pgmap v16398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:32.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:31 smithi189 ceph-mon[32756]: pgmap v16398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:34.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:33 smithi156 ceph-mon[32679]: pgmap v16399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:34.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:33 smithi092 ceph-mon[29156]: pgmap v16399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:34.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:33 smithi189 ceph-mon[32756]: pgmap v16399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:34 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29949.870254 secs 2024-04-27T02:37:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29252.839515 secs 2024-04-27T02:37:35.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:34 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29949.870254 secs 2024-04-27T02:37:35.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29252.839515 secs 2024-04-27T02:37:35.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:34 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29949.870254 secs 2024-04-27T02:37:35.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29252.839515 secs 2024-04-27T02:37:36.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:35 smithi092 ceph-mon[29156]: pgmap v16400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:36.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:35 smithi189 ceph-mon[32756]: pgmap v16400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:36.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:35 smithi156 ceph-mon[32679]: pgmap v16400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:38.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:37 smithi092 ceph-mon[29156]: pgmap v16401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:38.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:37 smithi189 ceph-mon[32756]: pgmap v16401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:38.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:37 smithi156 ceph-mon[32679]: pgmap v16401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:39 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29954.870373 secs 2024-04-27T02:37:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:39 smithi092 ceph-mon[29156]: pgmap v16402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:40.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29257.839595 secs 2024-04-27T02:37:40.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:39 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29954.870373 secs 2024-04-27T02:37:40.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:39 smithi189 ceph-mon[32756]: pgmap v16402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:40.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29257.839595 secs 2024-04-27T02:37:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:39 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29954.870373 secs 2024-04-27T02:37:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:39 smithi156 ceph-mon[32679]: pgmap v16402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29257.839595 secs 2024-04-27T02:37:42.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:41 smithi092 ceph-mon[29156]: pgmap v16403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:42.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:41 smithi189 ceph-mon[32756]: pgmap v16403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:42.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:41 smithi156 ceph-mon[32679]: pgmap v16403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:44.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:43 smithi092 ceph-mon[29156]: pgmap v16404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:44.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:43 smithi189 ceph-mon[32756]: pgmap v16404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:44.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:43 smithi156 ceph-mon[32679]: pgmap v16404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:45.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:44 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29959.870507 secs 2024-04-27T02:37:45.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29262.839661 secs 2024-04-27T02:37:45.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:44 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29959.870507 secs 2024-04-27T02:37:45.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29262.839661 secs 2024-04-27T02:37:45.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:44 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29959.870507 secs 2024-04-27T02:37:45.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29262.839661 secs 2024-04-27T02:37:46.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:45 smithi092 ceph-mon[29156]: pgmap v16405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:46.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:45 smithi189 ceph-mon[32756]: pgmap v16405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:45 smithi156 ceph-mon[32679]: pgmap v16405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:48.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:47 smithi092 ceph-mon[29156]: pgmap v16406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:48.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:47 smithi189 ceph-mon[32756]: pgmap v16406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:48.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:47 smithi156 ceph-mon[32679]: pgmap v16406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:49 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29964.870623 secs 2024-04-27T02:37:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:49 smithi092 ceph-mon[29156]: pgmap v16407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:50.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29267.839738 secs 2024-04-27T02:37:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:49 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29964.870623 secs 2024-04-27T02:37:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:49 smithi189 ceph-mon[32756]: pgmap v16407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29267.839738 secs 2024-04-27T02:37:50.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:49 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29964.870623 secs 2024-04-27T02:37:50.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:49 smithi156 ceph-mon[32679]: pgmap v16407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:50.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29267.839738 secs 2024-04-27T02:37:52.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:51 smithi092 ceph-mon[29156]: pgmap v16408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:52.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:51 smithi189 ceph-mon[32756]: pgmap v16408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:52.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:51 smithi156 ceph-mon[32679]: pgmap v16408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:54.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:53 smithi092 ceph-mon[29156]: pgmap v16409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:54.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:53 smithi189 ceph-mon[32756]: pgmap v16409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:54.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:53 smithi156 ceph-mon[32679]: pgmap v16409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:55.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:54 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29969.870695 secs 2024-04-27T02:37:55.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29272.839812 secs 2024-04-27T02:37:55.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:54 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29969.870695 secs 2024-04-27T02:37:55.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29272.839812 secs 2024-04-27T02:37:55.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:54 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29969.870695 secs 2024-04-27T02:37:55.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29272.839812 secs 2024-04-27T02:37:56.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:55 smithi092 ceph-mon[29156]: pgmap v16410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:56.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:55 smithi189 ceph-mon[32756]: pgmap v16410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:56.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:55 smithi156 ceph-mon[32679]: pgmap v16410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:37:58.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:57 smithi092 ceph-mon[29156]: pgmap v16411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:58.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:57 smithi189 ceph-mon[32756]: pgmap v16411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:37:58.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:57 smithi156 ceph-mon[32679]: pgmap v16411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29974.871094 secs 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: pgmap v16412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29277.839947 secs 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:38:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:37:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29974.871094 secs 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: pgmap v16412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29277.839947 secs 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:38:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:37:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29974.871094 secs 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: pgmap v16412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29277.839947 secs 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:38:00.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:37:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:38:01.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:00 smithi092 ceph-mon[29156]: pgmap v16413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:38:01.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:00 smithi092 ceph-mon[29156]: pgmap v16414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:01.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:00 smithi156 ceph-mon[32679]: pgmap v16413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:38:01.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:00 smithi156 ceph-mon[32679]: pgmap v16414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:01.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:00 smithi189 ceph-mon[32756]: pgmap v16413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T02:38:01.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:00 smithi189 ceph-mon[32756]: pgmap v16414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:03.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:02 smithi092 ceph-mon[29156]: pgmap v16415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:03.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:02 smithi189 ceph-mon[32756]: pgmap v16415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:03.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:02 smithi156 ceph-mon[32679]: pgmap v16415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:04 smithi189 ceph-mon[32756]: pgmap v16416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:04 smithi189 ceph-mon[32756]: 13 slow requests, 0 included below; oldest blocked for > 29979.871203 secs 2024-04-27T02:38:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29282.840070 secs 2024-04-27T02:38:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:04 smithi156 ceph-mon[32679]: pgmap v16416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:04 smithi156 ceph-mon[32679]: 13 slow requests, 0 included below; oldest blocked for > 29979.871203 secs 2024-04-27T02:38:05.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29282.840070 secs 2024-04-27T02:38:05.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:04 smithi092 ceph-mon[29156]: pgmap v16416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:04 smithi092 ceph-mon[29156]: 13 slow requests, 0 included below; oldest blocked for > 29979.871203 secs 2024-04-27T02:38:05.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29282.840070 secs 2024-04-27T02:38:07.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:06 smithi189 ceph-mon[32756]: pgmap v16417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:06 smithi156 ceph-mon[32679]: pgmap v16417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:07.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:06 smithi092 ceph-mon[29156]: pgmap v16417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:38:09.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:09 smithi189 ceph-mon[32756]: pgmap v16418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:38:09.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:09 smithi156 ceph-mon[32679]: pgmap v16418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:38:09.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:09 smithi092 ceph-mon[29156]: pgmap v16418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:38:10.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:10 smithi189 ceph-mon[32756]: 13 slow requests, 1 included below; oldest blocked for > 29984.871293 secs 2024-04-27T02:38:10.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:10 smithi189 ceph-mon[32756]: slow request 1440.328375 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:38:10.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29287.840143 secs 2024-04-27T02:38:10.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:10 smithi156 ceph-mon[32679]: 13 slow requests, 1 included below; oldest blocked for > 29984.871293 secs 2024-04-27T02:38:10.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:10 smithi156 ceph-mon[32679]: slow request 1440.328375 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:38:10.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29287.840143 secs 2024-04-27T02:38:10.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:10 smithi092 ceph-mon[29156]: 13 slow requests, 1 included below; oldest blocked for > 29984.871293 secs 2024-04-27T02:38:10.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:10 smithi092 ceph-mon[29156]: slow request 1440.328375 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:38:10.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29287.840143 secs 2024-04-27T02:38:11.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:11 smithi189 ceph-mon[32756]: pgmap v16419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:38:11.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:11 smithi156 ceph-mon[32679]: pgmap v16419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:38:11.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:11 smithi092 ceph-mon[29156]: pgmap v16419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:38:13.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:13 smithi189 ceph-mon[32756]: pgmap v16420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:13.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:13 smithi156 ceph-mon[32679]: pgmap v16420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:13.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:13 smithi092 ceph-mon[29156]: pgmap v16420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:15.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:15 smithi189 ceph-mon[32756]: pgmap v16421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:15 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 29989.871403 secs 2024-04-27T02:38:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:15 smithi189 ceph-mon[32756]: slow request 184.972459 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:38:15.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29292.840219 secs 2024-04-27T02:38:15.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:15 smithi156 ceph-mon[32679]: pgmap v16421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:15 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 29989.871403 secs 2024-04-27T02:38:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:15 smithi156 ceph-mon[32679]: slow request 184.972459 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:38:15.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29292.840219 secs 2024-04-27T02:38:15.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:15 smithi092 ceph-mon[29156]: pgmap v16421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:15 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 29989.871403 secs 2024-04-27T02:38:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:15 smithi092 ceph-mon[29156]: slow request 184.972459 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:38:15.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29292.840219 secs 2024-04-27T02:38:16.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:38:16.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:38:16.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:38:16.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:38:16.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T02:38:16.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:38:17.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:17 smithi189 ceph-mon[32756]: pgmap v16422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:17.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:17 smithi156 ceph-mon[32679]: pgmap v16422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:17.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:17 smithi092 ceph-mon[29156]: pgmap v16422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:19.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:19 smithi189 ceph-mon[32756]: pgmap v16423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:19.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:19 smithi156 ceph-mon[32679]: pgmap v16423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:19.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:19 smithi092 ceph-mon[29156]: pgmap v16423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:20 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 29994.871516 secs 2024-04-27T02:38:20.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29297.840292 secs 2024-04-27T02:38:20.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:20 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 29994.871516 secs 2024-04-27T02:38:20.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29297.840292 secs 2024-04-27T02:38:20.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:20 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 29994.871516 secs 2024-04-27T02:38:20.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29297.840292 secs 2024-04-27T02:38:21.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:21 smithi189 ceph-mon[32756]: pgmap v16424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:21.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:21 smithi156 ceph-mon[32679]: pgmap v16424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:21.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:21 smithi092 ceph-mon[29156]: pgmap v16424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:23.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:23 smithi189 ceph-mon[32756]: pgmap v16425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:23.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:23 smithi156 ceph-mon[32679]: pgmap v16425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:23.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:23 smithi092 ceph-mon[29156]: pgmap v16425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:25.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:25 smithi189 ceph-mon[32756]: pgmap v16426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:25.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:25 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 29999.871627 secs 2024-04-27T02:38:25.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29302.840347 secs 2024-04-27T02:38:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:25 smithi156 ceph-mon[32679]: pgmap v16426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:25 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 29999.871627 secs 2024-04-27T02:38:25.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29302.840347 secs 2024-04-27T02:38:25.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:25 smithi092 ceph-mon[29156]: pgmap v16426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:25.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:25 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 29999.871627 secs 2024-04-27T02:38:25.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29302.840347 secs 2024-04-27T02:38:27.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:27 smithi189 ceph-mon[32756]: pgmap v16427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:27.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:27 smithi156 ceph-mon[32679]: pgmap v16427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:27.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:27 smithi092 ceph-mon[29156]: pgmap v16427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:29.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:29 smithi189 ceph-mon[32756]: pgmap v16428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:29.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:29 smithi156 ceph-mon[32679]: pgmap v16428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:29.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:29 smithi092 ceph-mon[29156]: pgmap v16428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:30 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30004.871767 secs 2024-04-27T02:38:30.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29307.840408 secs 2024-04-27T02:38:30.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:30 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30004.871767 secs 2024-04-27T02:38:30.368 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29307.840408 secs 2024-04-27T02:38:30.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:30 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30004.871767 secs 2024-04-27T02:38:30.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29307.840408 secs 2024-04-27T02:38:31.308 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:31 smithi156 ceph-mon[32679]: pgmap v16429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:31.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:31 smithi189 ceph-mon[32756]: pgmap v16429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:31.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:31 smithi092 ceph-mon[29156]: pgmap v16429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:33.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:33 smithi189 ceph-mon[32756]: pgmap v16430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:33.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:33 smithi156 ceph-mon[32679]: pgmap v16430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:33.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:33 smithi092 ceph-mon[29156]: pgmap v16430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:35.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:35 smithi189 ceph-mon[32756]: pgmap v16431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:35.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:35 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30009.871897 secs 2024-04-27T02:38:35.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29312.840472 secs 2024-04-27T02:38:35.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:35 smithi156 ceph-mon[32679]: pgmap v16431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:35.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:35 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30009.871897 secs 2024-04-27T02:38:35.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29312.840472 secs 2024-04-27T02:38:35.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:35 smithi092 ceph-mon[29156]: pgmap v16431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:35.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:35 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30009.871897 secs 2024-04-27T02:38:35.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29312.840472 secs 2024-04-27T02:38:37.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:37 smithi189 ceph-mon[32756]: pgmap v16432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:37.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:37 smithi156 ceph-mon[32679]: pgmap v16432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:37.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:37 smithi092 ceph-mon[29156]: pgmap v16432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:39.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:39 smithi189 ceph-mon[32756]: pgmap v16433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:39.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:39 smithi156 ceph-mon[32679]: pgmap v16433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:39.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:39 smithi092 ceph-mon[29156]: pgmap v16433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:40.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:40 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30014.872014 secs 2024-04-27T02:38:40.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29317.840555 secs 2024-04-27T02:38:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:40 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30014.872014 secs 2024-04-27T02:38:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29317.840555 secs 2024-04-27T02:38:40.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:40 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30014.872014 secs 2024-04-27T02:38:40.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29317.840555 secs 2024-04-27T02:38:41.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:41 smithi189 ceph-mon[32756]: pgmap v16434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:41.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:41 smithi156 ceph-mon[32679]: pgmap v16434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:41.466 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:41 smithi092 ceph-mon[29156]: pgmap v16434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:42.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:42 smithi189 ceph-mon[32756]: pgmap v16435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:42.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:42 smithi156 ceph-mon[32679]: pgmap v16435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:42.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:42 smithi092 ceph-mon[29156]: pgmap v16435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:45.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:44 smithi189 ceph-mon[32756]: pgmap v16436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:45.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29322.840668 secs 2024-04-27T02:38:45.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:44 smithi156 ceph-mon[32679]: pgmap v16436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:45.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29322.840668 secs 2024-04-27T02:38:45.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:44 smithi092 ceph-mon[29156]: pgmap v16436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:45.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29322.840668 secs 2024-04-27T02:38:46.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:45 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30019.872130 secs 2024-04-27T02:38:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:45 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30019.872130 secs 2024-04-27T02:38:46.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:45 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30019.872130 secs 2024-04-27T02:38:47.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:46 smithi189 ceph-mon[32756]: pgmap v16437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:47.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:46 smithi156 ceph-mon[32679]: pgmap v16437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:47.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:46 smithi092 ceph-mon[29156]: pgmap v16437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:49.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:48 smithi189 ceph-mon[32756]: pgmap v16438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:49.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:48 smithi156 ceph-mon[32679]: pgmap v16438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:49.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:48 smithi092 ceph-mon[29156]: pgmap v16438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:50.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29327.840743 secs 2024-04-27T02:38:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29327.840743 secs 2024-04-27T02:38:50.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29327.840743 secs 2024-04-27T02:38:51.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:50 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30024.872247 secs 2024-04-27T02:38:51.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:50 smithi189 ceph-mon[32756]: pgmap v16439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:50 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30024.872247 secs 2024-04-27T02:38:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:50 smithi156 ceph-mon[32679]: pgmap v16439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:51.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:50 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30024.872247 secs 2024-04-27T02:38:51.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:50 smithi092 ceph-mon[29156]: pgmap v16439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:53.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:52 smithi189 ceph-mon[32756]: pgmap v16440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:52 smithi156 ceph-mon[32679]: pgmap v16440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:53.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:52 smithi092 ceph-mon[29156]: pgmap v16440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:54 smithi189 ceph-mon[32756]: pgmap v16441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30029.872326 secs 2024-04-27T02:38:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29332.840873 secs 2024-04-27T02:38:55.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:54 smithi156 ceph-mon[32679]: pgmap v16441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:55.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30029.872326 secs 2024-04-27T02:38:55.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29332.840873 secs 2024-04-27T02:38:55.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:54 smithi092 ceph-mon[29156]: pgmap v16441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:38:55.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30029.872326 secs 2024-04-27T02:38:55.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29332.840873 secs 2024-04-27T02:38:57.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:56 smithi189 ceph-mon[32756]: pgmap v16442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:56 smithi156 ceph-mon[32679]: pgmap v16442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:57.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:56 smithi092 ceph-mon[29156]: pgmap v16442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:59.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:58 smithi189 ceph-mon[32756]: pgmap v16443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:59.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:58 smithi156 ceph-mon[32679]: pgmap v16443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:38:59.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:58 smithi092 ceph-mon[29156]: pgmap v16443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:00.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30034.872416 secs 2024-04-27T02:39:00.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:38:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29337.840982 secs 2024-04-27T02:39:00.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30034.872416 secs 2024-04-27T02:39:00.118 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:38:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29337.840982 secs 2024-04-27T02:39:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30034.872416 secs 2024-04-27T02:39:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:38:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29337.840982 secs 2024-04-27T02:39:01.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:00 smithi156 ceph-mon[32679]: pgmap v16444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:01.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:39:01.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:39:01.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:39:01.058 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:39:01.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:00 smithi189 ceph-mon[32756]: pgmap v16444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:01.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:39:01.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:39:01.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:39:01.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:39:01.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:00 smithi092 ceph-mon[29156]: pgmap v16444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:01.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:39:01.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:39:01.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:39:01.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:39:02.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:01 smithi189 ceph-mon[32756]: pgmap v16445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:39:02.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:01 smithi189 ceph-mon[32756]: pgmap v16446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:01 smithi156 ceph-mon[32679]: pgmap v16445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:39:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:01 smithi156 ceph-mon[32679]: pgmap v16446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:01 smithi092 ceph-mon[29156]: pgmap v16445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:39:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:01 smithi092 ceph-mon[29156]: pgmap v16446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:04.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:03 smithi189 ceph-mon[32756]: pgmap v16447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:03 smithi156 ceph-mon[32679]: pgmap v16447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:04.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:03 smithi092 ceph-mon[29156]: pgmap v16447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30039.872487 secs 2024-04-27T02:39:05.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29342.841102 secs 2024-04-27T02:39:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30039.872487 secs 2024-04-27T02:39:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29342.841102 secs 2024-04-27T02:39:05.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30039.872487 secs 2024-04-27T02:39:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29342.841102 secs 2024-04-27T02:39:06.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:05 smithi189 ceph-mon[32756]: pgmap v16448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:05 smithi156 ceph-mon[32679]: pgmap v16448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:06.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:05 smithi092 ceph-mon[29156]: pgmap v16448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:08.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:07 smithi189 ceph-mon[32756]: pgmap v16449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:07 smithi156 ceph-mon[32679]: pgmap v16449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:08.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:07 smithi092 ceph-mon[29156]: pgmap v16449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:39:10.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:09 smithi189 ceph-mon[32756]: pgmap v16450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:10.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30044.872599 secs 2024-04-27T02:39:10.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:09 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29347.841239 secs 2024-04-27T02:39:10.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:09 smithi156 ceph-mon[32679]: pgmap v16450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:10.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30044.872599 secs 2024-04-27T02:39:10.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:09 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29347.841239 secs 2024-04-27T02:39:10.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:09 smithi092 ceph-mon[29156]: pgmap v16450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:39:10.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30044.872599 secs 2024-04-27T02:39:10.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:09 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29347.841239 secs 2024-04-27T02:39:12.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:11 smithi189 ceph-mon[32756]: pgmap v16451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:39:12.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:11 smithi156 ceph-mon[32679]: pgmap v16451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:39:12.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:11 smithi092 ceph-mon[29156]: pgmap v16451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:39:13.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:13 smithi092 ceph-mon[29156]: pgmap v16452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:14.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:13 smithi189 ceph-mon[32756]: pgmap v16452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:14.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:13 smithi156 ceph-mon[32679]: pgmap v16452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:15.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30049.872694 secs 2024-04-27T02:39:15.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29352.841341 secs 2024-04-27T02:39:15.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30049.872694 secs 2024-04-27T02:39:15.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29352.841341 secs 2024-04-27T02:39:15.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30049.872694 secs 2024-04-27T02:39:15.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29352.841341 secs 2024-04-27T02:39:16.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:15 smithi189 ceph-mon[32756]: pgmap v16453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:16.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:15 smithi156 ceph-mon[32679]: pgmap v16453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:16.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:15 smithi092 ceph-mon[29156]: pgmap v16453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:18.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:17 smithi189 ceph-mon[32756]: pgmap v16454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:18.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:17 smithi156 ceph-mon[32679]: pgmap v16454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:18.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:17 smithi092 ceph-mon[29156]: pgmap v16454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:20.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:19 smithi189 ceph-mon[32756]: pgmap v16455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:20.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30054.872811 secs 2024-04-27T02:39:20.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:19 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29357.841463 secs 2024-04-27T02:39:20.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:19 smithi156 ceph-mon[32679]: pgmap v16455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30054.872811 secs 2024-04-27T02:39:20.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:19 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29357.841463 secs 2024-04-27T02:39:20.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:19 smithi092 ceph-mon[29156]: pgmap v16455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30054.872811 secs 2024-04-27T02:39:20.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:19 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29357.841463 secs 2024-04-27T02:39:22.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:21 smithi189 ceph-mon[32756]: pgmap v16456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:21 smithi156 ceph-mon[32679]: pgmap v16456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:22.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:21 smithi092 ceph-mon[29156]: pgmap v16456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:24.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:23 smithi189 ceph-mon[32756]: pgmap v16457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:23 smithi156 ceph-mon[32679]: pgmap v16457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:24.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:23 smithi092 ceph-mon[29156]: pgmap v16457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:25.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30059.872944 secs 2024-04-27T02:39:25.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29362.841587 secs 2024-04-27T02:39:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30059.872944 secs 2024-04-27T02:39:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29362.841587 secs 2024-04-27T02:39:25.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30059.872944 secs 2024-04-27T02:39:25.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29362.841587 secs 2024-04-27T02:39:26.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:25 smithi189 ceph-mon[32756]: pgmap v16458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:25 smithi156 ceph-mon[32679]: pgmap v16458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:26.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:25 smithi092 ceph-mon[29156]: pgmap v16458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:28.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:27 smithi189 ceph-mon[32756]: pgmap v16459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:28.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:27 smithi156 ceph-mon[32679]: pgmap v16459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:28.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:27 smithi092 ceph-mon[29156]: pgmap v16459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:30.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:29 smithi189 ceph-mon[32756]: pgmap v16460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:30.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30064.873061 secs 2024-04-27T02:39:30.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:29 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29367.841693 secs 2024-04-27T02:39:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:29 smithi156 ceph-mon[32679]: pgmap v16460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30064.873061 secs 2024-04-27T02:39:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:29 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29367.841693 secs 2024-04-27T02:39:30.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:29 smithi092 ceph-mon[29156]: pgmap v16460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:30.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30064.873061 secs 2024-04-27T02:39:30.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:29 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29367.841693 secs 2024-04-27T02:39:32.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:31 smithi189 ceph-mon[32756]: pgmap v16461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:31 smithi156 ceph-mon[32679]: pgmap v16461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:32.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:31 smithi092 ceph-mon[29156]: pgmap v16461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:34.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:33 smithi189 ceph-mon[32756]: pgmap v16462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:34.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:33 smithi156 ceph-mon[32679]: pgmap v16462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:34.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:33 smithi092 ceph-mon[29156]: pgmap v16462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:35.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30069.873182 secs 2024-04-27T02:39:35.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29372.841763 secs 2024-04-27T02:39:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30069.873182 secs 2024-04-27T02:39:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29372.841763 secs 2024-04-27T02:39:35.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30069.873182 secs 2024-04-27T02:39:35.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29372.841763 secs 2024-04-27T02:39:36.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:35 smithi189 ceph-mon[32756]: pgmap v16463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:36.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:35 smithi156 ceph-mon[32679]: pgmap v16463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:36.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:35 smithi092 ceph-mon[29156]: pgmap v16463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:38.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:37 smithi189 ceph-mon[32756]: pgmap v16464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:38.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:37 smithi156 ceph-mon[32679]: pgmap v16464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:38.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:37 smithi092 ceph-mon[29156]: pgmap v16464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:39:40.109+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:39:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:39:40.109+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:39:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:39:40.109+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:39:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:39:40.109+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 232 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:39:40.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:39 smithi189 ceph-mon[32756]: pgmap v16465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:40.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30074.873296 secs 2024-04-27T02:39:40.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:39 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29377.841876 secs 2024-04-27T02:39:40.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:39 smithi156 ceph-mon[32679]: pgmap v16465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30074.873296 secs 2024-04-27T02:39:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:39 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29377.841876 secs 2024-04-27T02:39:40.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:39 smithi092 ceph-mon[29156]: pgmap v16465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:40.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30074.873296 secs 2024-04-27T02:39:40.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:39 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29377.841876 secs 2024-04-27T02:39:42.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:41 smithi189 ceph-mon[32756]: pgmap v16466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:41 smithi156 ceph-mon[32679]: pgmap v16466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:42.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:41 smithi092 ceph-mon[29156]: pgmap v16466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:44.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:43 smithi189 ceph-mon[32756]: pgmap v16467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:43 smithi156 ceph-mon[32679]: pgmap v16467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:44.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:43 smithi092 ceph-mon[29156]: pgmap v16467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:45.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30079.873445 secs 2024-04-27T02:39:45.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29382.841993 secs 2024-04-27T02:39:45.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30079.873445 secs 2024-04-27T02:39:45.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29382.841993 secs 2024-04-27T02:39:45.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30079.873445 secs 2024-04-27T02:39:45.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29382.841993 secs 2024-04-27T02:39:46.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:45 smithi189 ceph-mon[32756]: pgmap v16468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:45 smithi156 ceph-mon[32679]: pgmap v16468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:46.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:45 smithi092 ceph-mon[29156]: pgmap v16468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:48.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:47 smithi189 ceph-mon[32756]: pgmap v16469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:48.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:47 smithi156 ceph-mon[32679]: pgmap v16469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:48.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:47 smithi092 ceph-mon[29156]: pgmap v16469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:49 smithi156 ceph-mon[32679]: pgmap v16470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30084.873583 secs 2024-04-27T02:39:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29387.842127 secs 2024-04-27T02:39:50.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:49 smithi092 ceph-mon[29156]: pgmap v16470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:50.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30084.873583 secs 2024-04-27T02:39:50.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29387.842127 secs 2024-04-27T02:39:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:49 smithi189 ceph-mon[32756]: pgmap v16470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30084.873583 secs 2024-04-27T02:39:50.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29387.842127 secs 2024-04-27T02:39:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:51 smithi156 ceph-mon[32679]: pgmap v16471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:52.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:51 smithi092 ceph-mon[29156]: pgmap v16471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:52.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:51 smithi189 ceph-mon[32756]: pgmap v16471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:54.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:53 smithi156 ceph-mon[32679]: pgmap v16472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:54.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:53 smithi092 ceph-mon[29156]: pgmap v16472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:54.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:53 smithi189 ceph-mon[32756]: pgmap v16472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:55.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30089.873714 secs 2024-04-27T02:39:55.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29392.842262 secs 2024-04-27T02:39:55.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30089.873714 secs 2024-04-27T02:39:55.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29392.842262 secs 2024-04-27T02:39:55.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30089.873714 secs 2024-04-27T02:39:55.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29392.842262 secs 2024-04-27T02:39:56.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:55 smithi156 ceph-mon[32679]: pgmap v16473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:56.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:55 smithi092 ceph-mon[29156]: pgmap v16473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:56.262 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:55 smithi189 ceph-mon[32756]: pgmap v16473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:39:58.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:57 smithi156 ceph-mon[32679]: pgmap v16474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:58.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:57 smithi092 ceph-mon[29156]: pgmap v16474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:39:58.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:57 smithi189 ceph-mon[32756]: pgmap v16474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:59 smithi156 ceph-mon[32679]: pgmap v16475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30094.873841 secs 2024-04-27T02:40:00.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:39:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29397.842398 secs 2024-04-27T02:40:00.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:59 smithi092 ceph-mon[29156]: pgmap v16475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30094.873841 secs 2024-04-27T02:40:00.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:39:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29397.842398 secs 2024-04-27T02:40:00.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:59 smithi189 ceph-mon[32756]: pgmap v16475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30094.873841 secs 2024-04-27T02:40:00.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:39:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29397.842398 secs 2024-04-27T02:40:01.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:40:01.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:40:01.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:40:01.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:40:01.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:40:01.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:40:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: pgmap v16476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:40:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:40:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: pgmap v16477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:40:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: pgmap v16478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:40:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: pgmap v16476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:40:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:40:02.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: pgmap v16477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:40:02.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: pgmap v16478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:02.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:40:02.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: pgmap v16476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:02.360 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:40:02.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:40:02.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: pgmap v16477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:40:02.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: pgmap v16478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:02.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:40:03.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:03 smithi189 ceph-mon[32756]: pgmap v16479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:40:03.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:03 smithi156 ceph-mon[32679]: pgmap v16479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:40:03.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:03 smithi092 ceph-mon[29156]: pgmap v16479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:40:04.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29402.842490 secs 2024-04-27T02:40:05.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29402.842490 secs 2024-04-27T02:40:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29402.842490 secs 2024-04-27T02:40:05.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:05 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30099.873954 secs 2024-04-27T02:40:05.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:05 smithi092 ceph-mon[29156]: pgmap v16480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:06.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:05 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30099.873954 secs 2024-04-27T02:40:06.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:05 smithi189 ceph-mon[32756]: pgmap v16480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:05 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30099.873954 secs 2024-04-27T02:40:06.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:05 smithi156 ceph-mon[32679]: pgmap v16480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:07.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:07 smithi189 ceph-mon[32756]: pgmap v16481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:07.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:07 smithi156 ceph-mon[32679]: pgmap v16481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:07.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:07 smithi092 ceph-mon[29156]: pgmap v16481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:09.217 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:40:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:40:08.880+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:40:09.217 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:40:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:40:08.880+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:40:09.217 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:40:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:40:08.880+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:40:09.217 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:40:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:40:08.880+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:40:09.217 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:40:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:40:08.880+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:40:09.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:09 smithi189 ceph-mon[32756]: pgmap v16482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:09.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:09 smithi156 ceph-mon[32679]: pgmap v16482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:09.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:09 smithi092 ceph-mon[29156]: pgmap v16482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:40:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:10 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30104.874073 secs 2024-04-27T02:40:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29407.842558 secs 2024-04-27T02:40:10.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:10 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30104.874073 secs 2024-04-27T02:40:10.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29407.842558 secs 2024-04-27T02:40:10.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:10 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30104.874073 secs 2024-04-27T02:40:10.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29407.842558 secs 2024-04-27T02:40:11.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:11 smithi189 ceph-mon[32756]: pgmap v16483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:40:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:11 smithi156 ceph-mon[32679]: pgmap v16483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:40:11.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:11 smithi092 ceph-mon[29156]: pgmap v16483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:40:13.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:13 smithi189 ceph-mon[32756]: pgmap v16484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:13 smithi156 ceph-mon[32679]: pgmap v16484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:13.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:13 smithi092 ceph-mon[29156]: pgmap v16484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:14.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29412.842629 secs 2024-04-27T02:40:15.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29412.842629 secs 2024-04-27T02:40:15.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29412.842629 secs 2024-04-27T02:40:15.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:15 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30109.874190 secs 2024-04-27T02:40:15.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:15 smithi092 ceph-mon[29156]: pgmap v16485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:16.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:15 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30109.874190 secs 2024-04-27T02:40:16.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:15 smithi189 ceph-mon[32756]: pgmap v16485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:16.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:15 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30109.874190 secs 2024-04-27T02:40:16.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:15 smithi156 ceph-mon[32679]: pgmap v16485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:17.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:17 smithi189 ceph-mon[32756]: pgmap v16486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:17.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:17 smithi156 ceph-mon[32679]: pgmap v16486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:17.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:17 smithi092 ceph-mon[29156]: pgmap v16486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:19.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:19 smithi189 ceph-mon[32756]: pgmap v16487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:19.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:19 smithi156 ceph-mon[32679]: pgmap v16487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:19.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:19 smithi092 ceph-mon[29156]: pgmap v16487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:20.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:20 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30114.874325 secs 2024-04-27T02:40:20.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29417.842746 secs 2024-04-27T02:40:20.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:20 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30114.874325 secs 2024-04-27T02:40:20.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29417.842746 secs 2024-04-27T02:40:20.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:20 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30114.874325 secs 2024-04-27T02:40:20.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29417.842746 secs 2024-04-27T02:40:21.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:21 smithi189 ceph-mon[32756]: pgmap v16488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:21 smithi156 ceph-mon[32679]: pgmap v16488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:21.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:21 smithi092 ceph-mon[29156]: pgmap v16488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:23.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:23 smithi189 ceph-mon[32756]: pgmap v16489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:23.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:23 smithi156 ceph-mon[32679]: pgmap v16489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:23.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:23 smithi092 ceph-mon[29156]: pgmap v16489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T02:40:24.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29422.842855 secs 2024-04-27T02:40:25.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29422.842855 secs 2024-04-27T02:40:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29422.842855 secs 2024-04-27T02:40:25.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:25 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30119.874454 secs 2024-04-27T02:40:25.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:25 smithi092 ceph-mon[29156]: pgmap v16490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:26.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:25 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30119.874454 secs 2024-04-27T02:40:26.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:25 smithi189 ceph-mon[32756]: pgmap v16490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:25 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30119.874454 secs 2024-04-27T02:40:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:25 smithi156 ceph-mon[32679]: pgmap v16490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T02:40:27.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:27 smithi189 ceph-mon[32756]: pgmap v16491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:27.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:27 smithi156 ceph-mon[32679]: pgmap v16491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:27.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:27 smithi092 ceph-mon[29156]: pgmap v16491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:29.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:29 smithi189 ceph-mon[32756]: pgmap v16492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:29.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:29 smithi156 ceph-mon[32679]: pgmap v16492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:29.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:29 smithi092 ceph-mon[29156]: pgmap v16492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:30.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:30 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30124.874581 secs 2024-04-27T02:40:30.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29427.842923 secs 2024-04-27T02:40:30.617 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:30 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30124.874581 secs 2024-04-27T02:40:30.617 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29427.842923 secs 2024-04-27T02:40:30.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:30 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30124.874581 secs 2024-04-27T02:40:30.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29427.842923 secs 2024-04-27T02:40:31.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:31 smithi189 ceph-mon[32756]: pgmap v16493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:31.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:31 smithi156 ceph-mon[32679]: pgmap v16493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:31.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:31 smithi092 ceph-mon[29156]: pgmap v16493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:33.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:33 smithi189 ceph-mon[32756]: pgmap v16494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:33.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:33 smithi156 ceph-mon[32679]: pgmap v16494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:33.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:33 smithi092 ceph-mon[29156]: pgmap v16494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:34.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29432.843041 secs 2024-04-27T02:40:35.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29432.843041 secs 2024-04-27T02:40:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29432.843041 secs 2024-04-27T02:40:36.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:35 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30129.874702 secs 2024-04-27T02:40:36.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:35 smithi189 ceph-mon[32756]: pgmap v16495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:36.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:35 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30129.874702 secs 2024-04-27T02:40:36.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:35 smithi156 ceph-mon[32679]: pgmap v16495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:36.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:35 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30129.874702 secs 2024-04-27T02:40:36.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:35 smithi092 ceph-mon[29156]: pgmap v16495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:37.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:37 smithi189 ceph-mon[32756]: pgmap v16496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:37.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:37 smithi156 ceph-mon[32679]: pgmap v16496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:37.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:37 smithi092 ceph-mon[29156]: pgmap v16496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:39.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:39 smithi189 ceph-mon[32756]: pgmap v16497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:39.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:39 smithi156 ceph-mon[32679]: pgmap v16497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:39.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:39 smithi092 ceph-mon[29156]: pgmap v16497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:40.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:40 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30134.874854 secs 2024-04-27T02:40:40.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29437.843162 secs 2024-04-27T02:40:40.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:40 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30134.874854 secs 2024-04-27T02:40:40.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29437.843162 secs 2024-04-27T02:40:40.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:40 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30134.874854 secs 2024-04-27T02:40:40.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29437.843162 secs 2024-04-27T02:40:41.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:41 smithi189 ceph-mon[32756]: pgmap v16498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:41.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:41 smithi156 ceph-mon[32679]: pgmap v16498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:41.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:41 smithi092 ceph-mon[29156]: pgmap v16498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:43.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:43 smithi189 ceph-mon[32756]: pgmap v16499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:43 smithi156 ceph-mon[32679]: pgmap v16499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:43.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:43 smithi092 ceph-mon[29156]: pgmap v16499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:44.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29442.843321 secs 2024-04-27T02:40:45.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29442.843321 secs 2024-04-27T02:40:45.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29442.843321 secs 2024-04-27T02:40:46.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:45 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30139.874937 secs 2024-04-27T02:40:46.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:45 smithi189 ceph-mon[32756]: pgmap v16500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:45 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30139.874937 secs 2024-04-27T02:40:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:45 smithi156 ceph-mon[32679]: pgmap v16500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:46.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:45 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30139.874937 secs 2024-04-27T02:40:46.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:45 smithi092 ceph-mon[29156]: pgmap v16500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:47.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:47 smithi189 ceph-mon[32756]: pgmap v16501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:47.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:47 smithi156 ceph-mon[32679]: pgmap v16501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:47.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:47 smithi092 ceph-mon[29156]: pgmap v16501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:49.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:49 smithi189 ceph-mon[32756]: pgmap v16502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:49.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:49 smithi156 ceph-mon[32679]: pgmap v16502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:49.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:49 smithi092 ceph-mon[29156]: pgmap v16502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:50.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:50 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30144.875011 secs 2024-04-27T02:40:50.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29447.843462 secs 2024-04-27T02:40:50.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:50 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30144.875011 secs 2024-04-27T02:40:50.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29447.843462 secs 2024-04-27T02:40:50.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:50 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30144.875011 secs 2024-04-27T02:40:50.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29447.843462 secs 2024-04-27T02:40:51.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:51 smithi189 ceph-mon[32756]: pgmap v16503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:51.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:51 smithi156 ceph-mon[32679]: pgmap v16503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:51.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:51 smithi092 ceph-mon[29156]: pgmap v16503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:53.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:53 smithi189 ceph-mon[32756]: pgmap v16504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:53 smithi156 ceph-mon[32679]: pgmap v16504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:53.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:53 smithi092 ceph-mon[29156]: pgmap v16504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:54.966 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:54 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29452.843567 secs 2024-04-27T02:40:55.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:54 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29452.843567 secs 2024-04-27T02:40:55.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:54 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29452.843567 secs 2024-04-27T02:40:56.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:55 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30149.875070 secs 2024-04-27T02:40:56.012 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:55 smithi189 ceph-mon[32756]: pgmap v16505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:56.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:55 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30149.875070 secs 2024-04-27T02:40:56.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:55 smithi156 ceph-mon[32679]: pgmap v16505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:56.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:55 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30149.875070 secs 2024-04-27T02:40:56.216 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:55 smithi092 ceph-mon[29156]: pgmap v16505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:57.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:57 smithi189 ceph-mon[32756]: pgmap v16506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:57.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:57 smithi156 ceph-mon[32679]: pgmap v16506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:57.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:57 smithi092 ceph-mon[29156]: pgmap v16506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:40:59.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:40:59 smithi189 ceph-mon[32756]: pgmap v16507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:59.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:40:59 smithi156 ceph-mon[32679]: pgmap v16507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:40:59.716 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:40:59 smithi092 ceph-mon[29156]: pgmap v16507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:00.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:00 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30154.875135 secs 2024-04-27T02:41:00.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29457.843687 secs 2024-04-27T02:41:00.618 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:00 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30154.875135 secs 2024-04-27T02:41:00.618 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29457.843687 secs 2024-04-27T02:41:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:00 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30154.875135 secs 2024-04-27T02:41:00.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29457.843687 secs 2024-04-27T02:41:01.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:01 smithi189 ceph-mon[32756]: pgmap v16508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:01.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:41:01.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:01 smithi156 ceph-mon[32679]: pgmap v16508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:01.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:41:01.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:01 smithi092 ceph-mon[29156]: pgmap v16508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:01.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:03.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:04.111 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:03 smithi189 ceph-mon[32756]: pgmap v16509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:03 smithi156 ceph-mon[32679]: pgmap v16509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:04.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:03 smithi092 ceph-mon[29156]: pgmap v16509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30159.875220 secs 2024-04-27T02:41:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29462.843756 secs 2024-04-27T02:41:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30159.875220 secs 2024-04-27T02:41:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29462.843756 secs 2024-04-27T02:41:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30159.875220 secs 2024-04-27T02:41:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.361 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29462.843756 secs 2024-04-27T02:41:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: pgmap v16510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:41:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:41:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: pgmap v16511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:41:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: pgmap v16512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.364 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: pgmap v16510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: pgmap v16511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:41:06.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: pgmap v16512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.467 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:41:06.468 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: pgmap v16510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: pgmap v16511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: pgmap v16512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:06.469 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:41:07.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:07 smithi189 ceph-mon[32756]: pgmap v16513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:07.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:07 smithi156 ceph-mon[32679]: pgmap v16513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:07.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:07 smithi092 ceph-mon[29156]: pgmap v16513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:09.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:09 smithi189 ceph-mon[32756]: pgmap v16514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:09.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:09 smithi156 ceph-mon[32679]: pgmap v16514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:09.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:09 smithi092 ceph-mon[29156]: pgmap v16514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:10 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30164.875347 secs 2024-04-27T02:41:10.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:10 smithi189 ceph-mon[32756]: 21 slow requests, 1 included below; oldest blocked for > 29467.843901 secs 2024-04-27T02:41:10.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:10 smithi189 ceph-mon[32756]: slow request 2880.876735 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:10 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30164.875347 secs 2024-04-27T02:41:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:10 smithi156 ceph-mon[32679]: 21 slow requests, 1 included below; oldest blocked for > 29467.843901 secs 2024-04-27T02:41:10.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:10 smithi156 ceph-mon[32679]: slow request 2880.876735 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:10.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:10 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30164.875347 secs 2024-04-27T02:41:10.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:10 smithi092 ceph-mon[29156]: 21 slow requests, 1 included below; oldest blocked for > 29467.843901 secs 2024-04-27T02:41:10.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:10 smithi092 ceph-mon[29156]: slow request 2880.876735 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:11.611 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:11 smithi189 ceph-mon[32756]: pgmap v16515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:11.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:11 smithi156 ceph-mon[32679]: pgmap v16515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:11.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:11 smithi092 ceph-mon[29156]: pgmap v16515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:13.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:13 smithi189 ceph-mon[32756]: pgmap v16516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:13.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:13 smithi156 ceph-mon[32679]: pgmap v16516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:13.717 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:13 smithi092 ceph-mon[29156]: pgmap v16516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T02:41:15.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:14 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29472.844038 secs 2024-04-27T02:41:15.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:14 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29472.844038 secs 2024-04-27T02:41:15.217 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:14 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29472.844038 secs 2024-04-27T02:41:16.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:15 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 30169.875423 secs 2024-04-27T02:41:16.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:15 smithi189 ceph-mon[32756]: slow request 364.976479 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:16.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:15 smithi189 ceph-mon[32756]: pgmap v16517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:41:16.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:15 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 30169.875423 secs 2024-04-27T02:41:16.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:15 smithi156 ceph-mon[32679]: slow request 364.976479 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:16.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:15 smithi156 ceph-mon[32679]: pgmap v16517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:41:16.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:15 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 30169.875423 secs 2024-04-27T02:41:16.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:15 smithi092 ceph-mon[29156]: slow request 364.976479 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:41:16.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:15 smithi092 ceph-mon[29156]: pgmap v16517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:41:17.604 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:17 smithi092 ceph-mon[29156]: pgmap v16518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:17.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:17 smithi189 ceph-mon[32756]: pgmap v16518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:17.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:17 smithi156 ceph-mon[32679]: pgmap v16518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:19.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:19 smithi189 ceph-mon[32756]: pgmap v16519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:19.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:19 smithi156 ceph-mon[32679]: pgmap v16519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:19.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:19 smithi092 ceph-mon[29156]: pgmap v16519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:20.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:20 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30174.875539 secs 2024-04-27T02:41:20.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29477.844153 secs 2024-04-27T02:41:20.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:20 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30174.875539 secs 2024-04-27T02:41:20.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29477.844153 secs 2024-04-27T02:41:20.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:20 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30174.875539 secs 2024-04-27T02:41:20.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29477.844153 secs 2024-04-27T02:41:21.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:21 smithi189 ceph-mon[32756]: pgmap v16520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:21.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:21 smithi156 ceph-mon[32679]: pgmap v16520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:21.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:21 smithi092 ceph-mon[29156]: pgmap v16520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:23.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:23 smithi189 ceph-mon[32756]: pgmap v16521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:23.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:23 smithi156 ceph-mon[32679]: pgmap v16521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:23.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:23 smithi092 ceph-mon[29156]: pgmap v16521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:41:25.112 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:24 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29482.844230 secs 2024-04-27T02:41:25.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:24 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29482.844230 secs 2024-04-27T02:41:25.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:24 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29482.844230 secs 2024-04-27T02:41:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:25 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30179.875655 secs 2024-04-27T02:41:26.014 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:25 smithi189 ceph-mon[32756]: pgmap v16522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:26.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:25 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30179.875655 secs 2024-04-27T02:41:26.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:25 smithi156 ceph-mon[32679]: pgmap v16522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:26.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:25 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30179.875655 secs 2024-04-27T02:41:26.218 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:25 smithi092 ceph-mon[29156]: pgmap v16522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:41:27.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:27 smithi189 ceph-mon[32756]: pgmap v16523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:27.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:27 smithi156 ceph-mon[32679]: pgmap v16523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:27.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:27 smithi092 ceph-mon[29156]: pgmap v16523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:29.612 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:29 smithi189 ceph-mon[32756]: pgmap v16524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:29.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:29 smithi156 ceph-mon[32679]: pgmap v16524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:29.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:29 smithi092 ceph-mon[29156]: pgmap v16524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:30 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30184.875760 secs 2024-04-27T02:41:30.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29487.844368 secs 2024-04-27T02:41:30.620 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:30 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30184.875760 secs 2024-04-27T02:41:30.620 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29487.844368 secs 2024-04-27T02:41:30.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:30 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30184.875760 secs 2024-04-27T02:41:30.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29487.844368 secs 2024-04-27T02:41:31.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:31 smithi189 ceph-mon[32756]: pgmap v16525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:31.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:31 smithi156 ceph-mon[32679]: pgmap v16525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:31.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:31 smithi092 ceph-mon[29156]: pgmap v16525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:33.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:33 smithi189 ceph-mon[32756]: pgmap v16526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:33.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:33 smithi156 ceph-mon[32679]: pgmap v16526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:33.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:33 smithi092 ceph-mon[29156]: pgmap v16526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:35.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:34 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29492.844446 secs 2024-04-27T02:41:35.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:34 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29492.844446 secs 2024-04-27T02:41:35.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:34 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29492.844446 secs 2024-04-27T02:41:36.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:35 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30189.875881 secs 2024-04-27T02:41:36.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:35 smithi189 ceph-mon[32756]: pgmap v16527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:36.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:35 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30189.875881 secs 2024-04-27T02:41:36.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:35 smithi156 ceph-mon[32679]: pgmap v16527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:36.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:35 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30189.875881 secs 2024-04-27T02:41:36.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:35 smithi092 ceph-mon[29156]: pgmap v16527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:37.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:37 smithi189 ceph-mon[32756]: pgmap v16528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:37.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:37 smithi156 ceph-mon[32679]: pgmap v16528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:37.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:37 smithi092 ceph-mon[29156]: pgmap v16528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:39.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:39 smithi189 ceph-mon[32756]: pgmap v16529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:39.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:39 smithi156 ceph-mon[32679]: pgmap v16529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:39.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:39 smithi092 ceph-mon[29156]: pgmap v16529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:40.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:40 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30194.875960 secs 2024-04-27T02:41:40.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29497.844537 secs 2024-04-27T02:41:40.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:40 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30194.875960 secs 2024-04-27T02:41:40.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29497.844537 secs 2024-04-27T02:41:40.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:40 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30194.875960 secs 2024-04-27T02:41:40.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29497.844537 secs 2024-04-27T02:41:41.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:41 smithi189 ceph-mon[32756]: pgmap v16530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:41.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:41 smithi156 ceph-mon[32679]: pgmap v16530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:41.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:41 smithi092 ceph-mon[29156]: pgmap v16530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:43.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:43 smithi189 ceph-mon[32756]: pgmap v16531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:43.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:43 smithi156 ceph-mon[32679]: pgmap v16531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:43.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:43 smithi092 ceph-mon[29156]: pgmap v16531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:45.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:44 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29502.844649 secs 2024-04-27T02:41:45.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:44 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29502.844649 secs 2024-04-27T02:41:45.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:44 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29502.844649 secs 2024-04-27T02:41:46.113 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:45 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30199.876025 secs 2024-04-27T02:41:46.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:45 smithi189 ceph-mon[32756]: pgmap v16532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:46.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:45 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30199.876025 secs 2024-04-27T02:41:46.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:45 smithi156 ceph-mon[32679]: pgmap v16532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:46.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:45 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30199.876025 secs 2024-04-27T02:41:46.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:45 smithi092 ceph-mon[29156]: pgmap v16532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:47.613 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:47 smithi189 ceph-mon[32756]: pgmap v16533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:47.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:47 smithi156 ceph-mon[32679]: pgmap v16533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:47.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:47 smithi092 ceph-mon[29156]: pgmap v16533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:49.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:48 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30204.876143 secs 2024-04-27T02:41:49.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:48 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30204.876143 secs 2024-04-27T02:41:49.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:48 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30204.876143 secs 2024-04-27T02:41:50.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:49 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29507.844736 secs 2024-04-27T02:41:50.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:49 smithi189 ceph-mon[32756]: pgmap v16534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:50.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:49 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29507.844736 secs 2024-04-27T02:41:50.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:49 smithi156 ceph-mon[32679]: pgmap v16534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:50.219 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:49 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29507.844736 secs 2024-04-27T02:41:50.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:49 smithi092 ceph-mon[29156]: pgmap v16534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:51.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:51 smithi189 ceph-mon[32756]: pgmap v16535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:51.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:51 smithi156 ceph-mon[32679]: pgmap v16535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:51.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:51 smithi092 ceph-mon[29156]: pgmap v16535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:53.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:53 smithi189 ceph-mon[32756]: pgmap v16536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:53.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:53 smithi156 ceph-mon[32679]: pgmap v16536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:53.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:53 smithi092 ceph-mon[29156]: pgmap v16536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:54.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30209.876270 secs 2024-04-27T02:41:54.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30209.876270 secs 2024-04-27T02:41:54.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30209.876270 secs 2024-04-27T02:41:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:41:55.129+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:41:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:41:55.129+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:41:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:41:55.129+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:41:55.106 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:41:55.129+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 233 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:41:55.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29512.844861 secs 2024-04-27T02:41:55.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:55 smithi189 ceph-mon[32756]: pgmap v16537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:55.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29512.844861 secs 2024-04-27T02:41:55.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:55 smithi156 ceph-mon[32679]: pgmap v16537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29512.844861 secs 2024-04-27T02:41:55.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:55 smithi092 ceph-mon[29156]: pgmap v16537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:41:57.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:57 smithi189 ceph-mon[32756]: pgmap v16538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:57.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:57 smithi156 ceph-mon[32679]: pgmap v16538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:57.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:57 smithi092 ceph-mon[29156]: pgmap v16538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:41:59.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:58 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30214.876405 secs 2024-04-27T02:41:59.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:58 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30214.876405 secs 2024-04-27T02:41:59.220 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:58 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30214.876405 secs 2024-04-27T02:42:00.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:59 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29517.844955 secs 2024-04-27T02:42:00.114 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:41:59 smithi189 ceph-mon[32756]: pgmap v16539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:00.121 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:59 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29517.844955 secs 2024-04-27T02:42:00.121 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:41:59 smithi092 ceph-mon[29156]: pgmap v16539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:00.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:59 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29517.844955 secs 2024-04-27T02:42:00.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:41:59 smithi156 ceph-mon[32679]: pgmap v16539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:01.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:01 smithi189 ceph-mon[32756]: pgmap v16540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:01.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:01 smithi156 ceph-mon[32679]: pgmap v16540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:01.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:01 smithi092 ceph-mon[29156]: pgmap v16540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:03.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:03 smithi189 ceph-mon[32756]: pgmap v16541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:03.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:03 smithi156 ceph-mon[32679]: pgmap v16541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:03.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:03 smithi092 ceph-mon[29156]: pgmap v16541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:04.614 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30219.876527 secs 2024-04-27T02:42:04.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30219.876527 secs 2024-04-27T02:42:04.709 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30219.876527 secs 2024-04-27T02:42:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29522.845054 secs 2024-04-27T02:42:05.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:05 smithi189 ceph-mon[32756]: pgmap v16542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:05.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29522.845054 secs 2024-04-27T02:42:05.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:05 smithi156 ceph-mon[32679]: pgmap v16542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:05.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29522.845054 secs 2024-04-27T02:42:05.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:05 smithi092 ceph-mon[29156]: pgmap v16542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: pgmap v16543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: pgmap v16544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:06.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:42:06.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:42:06.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:42:06.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:42:06.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: pgmap v16543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:06.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: pgmap v16544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:06.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:42:06.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:42:06.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:42:06.720 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:42:06.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: pgmap v16543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:06.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: pgmap v16544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:06.721 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:42:09.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:09 smithi189 ceph-mon[32756]: pgmap v16545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:42:09.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:09 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 30224.876624 secs 2024-04-27T02:42:09.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:09 smithi189 ceph-mon[32756]: slow request 720.103822 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:42:09.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:09 smithi156 ceph-mon[32679]: pgmap v16545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:42:09.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:09 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 30224.876624 secs 2024-04-27T02:42:09.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:09 smithi156 ceph-mon[32679]: slow request 720.103822 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:42:09.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:09 smithi092 ceph-mon[29156]: pgmap v16545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:42:09.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:09 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 30224.876624 secs 2024-04-27T02:42:09.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:09 smithi092 ceph-mon[29156]: slow request 720.103822 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:42:10.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:10 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29527.845177 secs 2024-04-27T02:42:10.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:10 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29527.845177 secs 2024-04-27T02:42:10.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:10 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29527.845177 secs 2024-04-27T02:42:11.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:11 smithi189 ceph-mon[32756]: pgmap v16546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:11.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:11 smithi156 ceph-mon[32679]: pgmap v16546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:11.470 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:11 smithi092 ceph-mon[29156]: pgmap v16546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:13.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:13 smithi189 ceph-mon[32756]: pgmap v16547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:13.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:13 smithi156 ceph-mon[32679]: pgmap v16547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:13.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:13 smithi092 ceph-mon[29156]: pgmap v16547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:42:14.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30229.876759 secs 2024-04-27T02:42:14.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30229.876759 secs 2024-04-27T02:42:14.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30229.876759 secs 2024-04-27T02:42:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:15 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29532.845318 secs 2024-04-27T02:42:15.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:15 smithi189 ceph-mon[32756]: pgmap v16548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:42:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:15 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29532.845318 secs 2024-04-27T02:42:15.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:15 smithi156 ceph-mon[32679]: pgmap v16548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:42:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:15 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29532.845318 secs 2024-04-27T02:42:15.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:15 smithi092 ceph-mon[29156]: pgmap v16548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:42:17.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:17 smithi189 ceph-mon[32756]: pgmap v16549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:17.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:17 smithi156 ceph-mon[32679]: pgmap v16549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:17.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:17 smithi092 ceph-mon[29156]: pgmap v16549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:42:19.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:19 smithi189 ceph-mon[32756]: pgmap v16550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:19.365 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30234.876882 secs 2024-04-27T02:42:19.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:19 smithi156 ceph-mon[32679]: pgmap v16550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:19.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30234.876882 secs 2024-04-27T02:42:19.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:19 smithi092 ceph-mon[29156]: pgmap v16550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:19.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30234.876882 secs 2024-04-27T02:42:20.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:20 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29537.845393 secs 2024-04-27T02:42:20.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:20 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29537.845393 secs 2024-04-27T02:42:20.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:20 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29537.845393 secs 2024-04-27T02:42:21.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:21 smithi156 ceph-mon[32679]: pgmap v16551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:21.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:21 smithi092 ceph-mon[29156]: pgmap v16551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:21.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:21 smithi189 ceph-mon[32756]: pgmap v16551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:23.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:23 smithi156 ceph-mon[32679]: pgmap v16552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:23.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:23 smithi092 ceph-mon[29156]: pgmap v16552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:23.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:23 smithi189 ceph-mon[32756]: pgmap v16552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:42:24.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30239.877004 secs 2024-04-27T02:42:24.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30239.877004 secs 2024-04-27T02:42:24.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30239.877004 secs 2024-04-27T02:42:25.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:25 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29542.845473 secs 2024-04-27T02:42:25.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:25 smithi156 ceph-mon[32679]: pgmap v16553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:25 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29542.845473 secs 2024-04-27T02:42:25.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:25 smithi092 ceph-mon[29156]: pgmap v16553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:25.615 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:25 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29542.845473 secs 2024-04-27T02:42:25.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:25 smithi189 ceph-mon[32756]: pgmap v16553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:42:27.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:27 smithi156 ceph-mon[32679]: pgmap v16554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:27.418 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:27 smithi189 ceph-mon[32756]: pgmap v16554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:27.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:27 smithi092 ceph-mon[29156]: pgmap v16554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:29.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:29 smithi156 ceph-mon[32679]: pgmap v16555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:29.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30244.877129 secs 2024-04-27T02:42:29.471 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:29 smithi092 ceph-mon[29156]: pgmap v16555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:29.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30244.877129 secs 2024-04-27T02:42:29.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:29 smithi189 ceph-mon[32756]: pgmap v16555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:29.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30244.877129 secs 2024-04-27T02:42:30.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:30 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29547.845567 secs 2024-04-27T02:42:30.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:30 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29547.845567 secs 2024-04-27T02:42:30.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:30 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29547.845567 secs 2024-04-27T02:42:31.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:31 smithi156 ceph-mon[32679]: pgmap v16556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:31.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:31 smithi092 ceph-mon[29156]: pgmap v16556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:31.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:31 smithi189 ceph-mon[32756]: pgmap v16556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:33.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:33 smithi156 ceph-mon[32679]: pgmap v16557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:33.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:33 smithi092 ceph-mon[29156]: pgmap v16557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:33.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:33 smithi189 ceph-mon[32756]: pgmap v16557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:34.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30249.877237 secs 2024-04-27T02:42:34.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30249.877237 secs 2024-04-27T02:42:34.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30249.877237 secs 2024-04-27T02:42:35.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:35 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29552.845692 secs 2024-04-27T02:42:35.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:35 smithi156 ceph-mon[32679]: pgmap v16558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:35.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:35 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29552.845692 secs 2024-04-27T02:42:35.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:35 smithi092 ceph-mon[29156]: pgmap v16558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:35.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:35 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29552.845692 secs 2024-04-27T02:42:35.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:35 smithi189 ceph-mon[32756]: pgmap v16558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:37.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:37 smithi092 ceph-mon[29156]: pgmap v16559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:37.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:37 smithi189 ceph-mon[32756]: pgmap v16559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:37.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:37 smithi156 ceph-mon[32679]: pgmap v16559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:39.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:39 smithi092 ceph-mon[29156]: pgmap v16560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:39.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30254.877360 secs 2024-04-27T02:42:39.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:39 smithi189 ceph-mon[32756]: pgmap v16560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:39.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30254.877360 secs 2024-04-27T02:42:39.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:39 smithi156 ceph-mon[32679]: pgmap v16560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:39.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30254.877360 secs 2024-04-27T02:42:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:42:40.135+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:42:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:42:40.135+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:42:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:42:40.135+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:42:40.114 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:42:40.135+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 234 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:42:40.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:40 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29557.845787 secs 2024-04-27T02:42:40.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:40 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29557.845787 secs 2024-04-27T02:42:40.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:40 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29557.845787 secs 2024-04-27T02:42:41.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:41 smithi092 ceph-mon[29156]: pgmap v16561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:41.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:41 smithi189 ceph-mon[32756]: pgmap v16561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:41.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:41 smithi156 ceph-mon[32679]: pgmap v16561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:43.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:43 smithi092 ceph-mon[29156]: pgmap v16562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:43.616 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:43 smithi189 ceph-mon[32756]: pgmap v16562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:43.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:43 smithi156 ceph-mon[32679]: pgmap v16562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:44.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30259.877438 secs 2024-04-27T02:42:44.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30259.877438 secs 2024-04-27T02:42:44.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30259.877438 secs 2024-04-27T02:42:45.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:45 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29562.845906 secs 2024-04-27T02:42:45.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:45 smithi092 ceph-mon[29156]: pgmap v16563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:45.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:45 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29562.845906 secs 2024-04-27T02:42:45.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:45 smithi189 ceph-mon[32756]: pgmap v16563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:45.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:45 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29562.845906 secs 2024-04-27T02:42:45.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:45 smithi156 ceph-mon[32679]: pgmap v16563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:47.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:47 smithi092 ceph-mon[29156]: pgmap v16564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:47.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:47 smithi189 ceph-mon[32756]: pgmap v16564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:47.662 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:47 smithi156 ceph-mon[32679]: pgmap v16564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:49.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:49 smithi092 ceph-mon[29156]: pgmap v16565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:49.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30264.877519 secs 2024-04-27T02:42:49.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:49 smithi189 ceph-mon[32756]: pgmap v16565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:49.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30264.877519 secs 2024-04-27T02:42:49.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:49 smithi156 ceph-mon[32679]: pgmap v16565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:49.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30264.877519 secs 2024-04-27T02:42:50.472 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:50 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29567.846022 secs 2024-04-27T02:42:50.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:50 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29567.846022 secs 2024-04-27T02:42:50.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:50 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29567.846022 secs 2024-04-27T02:42:51.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:51 smithi092 ceph-mon[29156]: pgmap v16566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:51.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:51 smithi189 ceph-mon[32756]: pgmap v16566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:51.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:51 smithi156 ceph-mon[32679]: pgmap v16566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:53.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:53 smithi092 ceph-mon[29156]: pgmap v16567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:53.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:53 smithi189 ceph-mon[32756]: pgmap v16567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:53.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:53 smithi156 ceph-mon[32679]: pgmap v16567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:54.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30269.877637 secs 2024-04-27T02:42:54.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30269.877637 secs 2024-04-27T02:42:54.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30269.877637 secs 2024-04-27T02:42:55.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:55 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29572.846144 secs 2024-04-27T02:42:55.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:55 smithi092 ceph-mon[29156]: pgmap v16568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:55.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:55 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29572.846144 secs 2024-04-27T02:42:55.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:55 smithi189 ceph-mon[32756]: pgmap v16568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:55.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:55 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29572.846144 secs 2024-04-27T02:42:55.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:55 smithi156 ceph-mon[32679]: pgmap v16568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:42:57.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:57 smithi092 ceph-mon[29156]: pgmap v16569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:57.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:57 smithi189 ceph-mon[32756]: pgmap v16569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:57.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:57 smithi156 ceph-mon[32679]: pgmap v16569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:59.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:59 smithi092 ceph-mon[29156]: pgmap v16570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:59.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:42:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30274.877777 secs 2024-04-27T02:42:59.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:59 smithi189 ceph-mon[32756]: pgmap v16570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:59.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:42:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30274.877777 secs 2024-04-27T02:42:59.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:59 smithi156 ceph-mon[32679]: pgmap v16570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:42:59.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:42:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30274.877777 secs 2024-04-27T02:43:00.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:00 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29577.846258 secs 2024-04-27T02:43:00.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:00 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29577.846258 secs 2024-04-27T02:43:00.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:00 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29577.846258 secs 2024-04-27T02:43:01.473 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:01 smithi092 ceph-mon[29156]: pgmap v16571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:01.565 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:01 smithi156 ceph-mon[32679]: pgmap v16571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:01.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:01 smithi189 ceph-mon[32756]: pgmap v16571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:03.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:03 smithi189 ceph-mon[32756]: pgmap v16572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:03.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:03 smithi156 ceph-mon[32679]: pgmap v16572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:03.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:03 smithi092 ceph-mon[29156]: pgmap v16572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:04.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30279.877906 secs 2024-04-27T02:43:04.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30279.877906 secs 2024-04-27T02:43:04.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30279.877906 secs 2024-04-27T02:43:05.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:05 smithi189 ceph-mon[32756]: 21 slow requests, 0 included below; oldest blocked for > 29582.846410 secs 2024-04-27T02:43:05.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:05 smithi189 ceph-mon[32756]: pgmap v16573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:05.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:05 smithi156 ceph-mon[32679]: 21 slow requests, 0 included below; oldest blocked for > 29582.846410 secs 2024-04-27T02:43:05.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:05 smithi156 ceph-mon[32679]: pgmap v16573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:05 smithi092 ceph-mon[29156]: 21 slow requests, 0 included below; oldest blocked for > 29582.846410 secs 2024-04-27T02:43:05.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:05 smithi092 ceph-mon[29156]: pgmap v16573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:06.617 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:43:06.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:43:06.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:43:07.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:07 smithi189 ceph-mon[32756]: pgmap v16574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:07.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:43:07.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:43:07.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:43:07.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:07 smithi156 ceph-mon[32679]: pgmap v16574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:07.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:43:07.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:43:07.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:43:07.689 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:07 smithi092 ceph-mon[29156]: pgmap v16574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:07.689 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:43:07.689 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:43:07.689 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:43:08.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:08 smithi189 ceph-mon[32756]: pgmap v16575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:43:08.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:08 smithi189 ceph-mon[32756]: pgmap v16576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:08.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:08 smithi156 ceph-mon[32679]: pgmap v16575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:43:08.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:08 smithi156 ceph-mon[32679]: pgmap v16576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:08.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:08 smithi092 ceph-mon[29156]: pgmap v16575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:43:08.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:08 smithi092 ceph-mon[29156]: pgmap v16576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:09.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30284.878022 secs 2024-04-27T02:43:09.663 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30284.878022 secs 2024-04-27T02:43:09.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30284.878022 secs 2024-04-27T02:43:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:10 smithi189 ceph-mon[32756]: pgmap v16577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:10 smithi189 ceph-mon[32756]: 22 slow requests, 2 included below; oldest blocked for > 29587.846528 secs 2024-04-27T02:43:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:10 smithi189 ceph-mon[32756]: slow request 11523.266075 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:43:10.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:10 smithi189 ceph-mon[32756]: slow request 180.105186 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:43:10.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:10 smithi156 ceph-mon[32679]: pgmap v16577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:10.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:10 smithi156 ceph-mon[32679]: 22 slow requests, 2 included below; oldest blocked for > 29587.846528 secs 2024-04-27T02:43:10.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:10 smithi156 ceph-mon[32679]: slow request 11523.266075 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:43:10.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:10 smithi156 ceph-mon[32679]: slow request 180.105186 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:43:10.723 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:10 smithi092 ceph-mon[29156]: pgmap v16577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:10 smithi092 ceph-mon[29156]: 22 slow requests, 2 included below; oldest blocked for > 29587.846528 secs 2024-04-27T02:43:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:10 smithi092 ceph-mon[29156]: slow request 11523.266075 seconds old, received at 2024-04-26T23:31:05.726486+0000: client_request(client.17190:1 getattr pAsLsXsFs #0x1 2024-04-26T23:31:05.722166+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:43:10.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:10 smithi092 ceph-mon[29156]: slow request 180.105186 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:43:12.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:12 smithi189 ceph-mon[32756]: pgmap v16578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:12.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:12 smithi156 ceph-mon[32679]: pgmap v16578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:12.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:12 smithi092 ceph-mon[29156]: pgmap v16578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:14.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:14 smithi189 ceph-mon[32756]: pgmap v16579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:43:14.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:43:14.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:43:14.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30289.878103 secs 2024-04-27T02:43:14.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:14 smithi156 ceph-mon[32679]: pgmap v16579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:43:14.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:43:14.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:43:14.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30289.878103 secs 2024-04-27T02:43:14.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:14 smithi092 ceph-mon[29156]: pgmap v16579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:43:14.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:43:14.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:43:14.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30289.878103 secs 2024-04-27T02:43:15.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:15 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29592.846636 secs 2024-04-27T02:43:15.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:15 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29592.846636 secs 2024-04-27T02:43:15.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:15 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29592.846636 secs 2024-04-27T02:43:16.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:16 smithi189 ceph-mon[32756]: pgmap v16580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:16.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:16 smithi156 ceph-mon[32679]: pgmap v16580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:16.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:16 smithi092 ceph-mon[29156]: pgmap v16580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:43:18.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:18 smithi189 ceph-mon[32756]: pgmap v16581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:43:18.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:18 smithi156 ceph-mon[32679]: pgmap v16581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:43:18.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:18 smithi092 ceph-mon[29156]: pgmap v16581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:43:19.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30294.878228 secs 2024-04-27T02:43:19.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30294.878228 secs 2024-04-27T02:43:19.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30294.878228 secs 2024-04-27T02:43:20.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:20 smithi189 ceph-mon[32756]: pgmap v16582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:20.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:20 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29597.846697 secs 2024-04-27T02:43:20.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:20 smithi156 ceph-mon[32679]: pgmap v16582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:20.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:20 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29597.846697 secs 2024-04-27T02:43:20.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:20 smithi092 ceph-mon[29156]: pgmap v16582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:20.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:20 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29597.846697 secs 2024-04-27T02:43:22.537 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:22 smithi092 ceph-mon[29156]: pgmap v16583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:22.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:22 smithi189 ceph-mon[32756]: pgmap v16583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:22.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:22 smithi156 ceph-mon[32679]: pgmap v16583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:24.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:24 smithi189 ceph-mon[32756]: pgmap v16584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:24.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30299.878314 secs 2024-04-27T02:43:24.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:24 smithi156 ceph-mon[32679]: pgmap v16584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:24.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30299.878314 secs 2024-04-27T02:43:24.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:24 smithi092 ceph-mon[29156]: pgmap v16584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:24.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30299.878314 secs 2024-04-27T02:43:25.618 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:25 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29602.846817 secs 2024-04-27T02:43:25.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:25 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29602.846817 secs 2024-04-27T02:43:25.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:25 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29602.846817 secs 2024-04-27T02:43:26.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:26 smithi189 ceph-mon[32756]: pgmap v16585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:26.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:26 smithi156 ceph-mon[32679]: pgmap v16585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:26.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:26 smithi092 ceph-mon[29156]: pgmap v16585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:28.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:28 smithi189 ceph-mon[32756]: pgmap v16586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:28.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:28 smithi156 ceph-mon[32679]: pgmap v16586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:28.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:28 smithi092 ceph-mon[29156]: pgmap v16586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:29.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30304.878418 secs 2024-04-27T02:43:29.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30304.878418 secs 2024-04-27T02:43:29.724 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30304.878418 secs 2024-04-27T02:43:30.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:30 smithi189 ceph-mon[32756]: pgmap v16587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:30.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:30 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29607.846893 secs 2024-04-27T02:43:30.626 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:30 smithi092 ceph-mon[29156]: pgmap v16587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:30.626 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:30 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29607.846893 secs 2024-04-27T02:43:30.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:30 smithi156 ceph-mon[32679]: pgmap v16587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:30.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:30 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29607.846893 secs 2024-04-27T02:43:32.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:32 smithi189 ceph-mon[32756]: pgmap v16588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:32.664 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:32 smithi156 ceph-mon[32679]: pgmap v16588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:32.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:32 smithi092 ceph-mon[29156]: pgmap v16588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:34.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:34 smithi189 ceph-mon[32756]: pgmap v16589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:34.620 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30309.878559 secs 2024-04-27T02:43:34.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:34 smithi156 ceph-mon[32679]: pgmap v16589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:34.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30309.878559 secs 2024-04-27T02:43:34.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:34 smithi092 ceph-mon[29156]: pgmap v16589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:34.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30309.878559 secs 2024-04-27T02:43:35.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:35 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29612.847032 secs 2024-04-27T02:43:35.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:35 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29612.847032 secs 2024-04-27T02:43:35.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:35 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29612.847032 secs 2024-04-27T02:43:36.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:36 smithi189 ceph-mon[32756]: pgmap v16590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:36.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:36 smithi156 ceph-mon[32679]: pgmap v16590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:36.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:36 smithi092 ceph-mon[29156]: pgmap v16590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:37.619 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:37 smithi189 ceph-mon[32756]: pgmap v16591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:37.665 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:37 smithi156 ceph-mon[32679]: pgmap v16591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:37.725 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:37 smithi092 ceph-mon[29156]: pgmap v16591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:39.119 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:38 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30314.878688 secs 2024-04-27T02:43:39.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:38 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30314.878688 secs 2024-04-27T02:43:39.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:38 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30314.878688 secs 2024-04-27T02:43:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:39 smithi156 ceph-mon[32679]: pgmap v16592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:40.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:39 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29617.847154 secs 2024-04-27T02:43:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:39 smithi092 ceph-mon[29156]: pgmap v16592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:40.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:39 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29617.847154 secs 2024-04-27T02:43:40.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:39 smithi189 ceph-mon[32756]: pgmap v16592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:40.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:39 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29617.847154 secs 2024-04-27T02:43:42.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:41 smithi156 ceph-mon[32679]: pgmap v16593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:42.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:41 smithi092 ceph-mon[29156]: pgmap v16593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:42.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:41 smithi189 ceph-mon[32756]: pgmap v16593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:44.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:43 smithi156 ceph-mon[32679]: pgmap v16594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:44.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:43 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30319.878811 secs 2024-04-27T02:43:44.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:43 smithi092 ceph-mon[29156]: pgmap v16594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:44.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:43 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30319.878811 secs 2024-04-27T02:43:44.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:43 smithi189 ceph-mon[32756]: pgmap v16594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:44.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:43 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30319.878811 secs 2024-04-27T02:43:45.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:44 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29622.847260 secs 2024-04-27T02:43:45.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:44 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29622.847260 secs 2024-04-27T02:43:45.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:44 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29622.847260 secs 2024-04-27T02:43:46.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:45 smithi156 ceph-mon[32679]: pgmap v16595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:46.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:45 smithi092 ceph-mon[29156]: pgmap v16595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:46.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:45 smithi189 ceph-mon[32756]: pgmap v16595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:48.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:47 smithi156 ceph-mon[32679]: pgmap v16596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:48.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:47 smithi092 ceph-mon[29156]: pgmap v16596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:48.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:47 smithi189 ceph-mon[32756]: pgmap v16596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:49.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:48 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30324.878910 secs 2024-04-27T02:43:49.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:48 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30324.878910 secs 2024-04-27T02:43:49.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:48 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30324.878910 secs 2024-04-27T02:43:50.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:49 smithi156 ceph-mon[32679]: pgmap v16597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:50.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:49 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29627.847409 secs 2024-04-27T02:43:50.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:49 smithi092 ceph-mon[29156]: pgmap v16597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:50.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:49 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29627.847409 secs 2024-04-27T02:43:50.369 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:49 smithi189 ceph-mon[32756]: pgmap v16597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:50.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:49 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29627.847409 secs 2024-04-27T02:43:52.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:51 smithi156 ceph-mon[32679]: pgmap v16598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:52.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:51 smithi092 ceph-mon[29156]: pgmap v16598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:52.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:51 smithi189 ceph-mon[32756]: pgmap v16598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:54.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:53 smithi156 ceph-mon[32679]: pgmap v16599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:54.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:53 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30329.878973 secs 2024-04-27T02:43:54.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:53 smithi092 ceph-mon[29156]: pgmap v16599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:54.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:53 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30329.878973 secs 2024-04-27T02:43:54.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:53 smithi189 ceph-mon[32756]: pgmap v16599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:54.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:53 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30329.878973 secs 2024-04-27T02:43:55.225 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:54 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29632.847486 secs 2024-04-27T02:43:55.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:54 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29632.847486 secs 2024-04-27T02:43:55.415 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:54 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29632.847486 secs 2024-04-27T02:43:56.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:55 smithi092 ceph-mon[29156]: pgmap v16600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:56.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:55 smithi189 ceph-mon[32756]: pgmap v16600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:56.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:55 smithi156 ceph-mon[32679]: pgmap v16600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:43:58.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:57 smithi092 ceph-mon[29156]: pgmap v16601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:58.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:57 smithi189 ceph-mon[32756]: pgmap v16601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:58.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:57 smithi156 ceph-mon[32679]: pgmap v16601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:43:59.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:58 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30334.879036 secs 2024-04-27T02:43:59.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:58 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30334.879036 secs 2024-04-27T02:43:59.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:58 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30334.879036 secs 2024-04-27T02:44:00.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:59 smithi092 ceph-mon[29156]: pgmap v16602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:00.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:43:59 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29637.847596 secs 2024-04-27T02:44:00.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:59 smithi189 ceph-mon[32756]: pgmap v16602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:00.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:43:59 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29637.847596 secs 2024-04-27T02:44:00.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:59 smithi156 ceph-mon[32679]: pgmap v16602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:00.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:43:59 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29637.847596 secs 2024-04-27T02:44:02.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:01 smithi156 ceph-mon[32679]: pgmap v16603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:02.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:01 smithi092 ceph-mon[29156]: pgmap v16603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:02.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:01 smithi189 ceph-mon[32756]: pgmap v16603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:04.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:03 smithi092 ceph-mon[29156]: pgmap v16604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:04.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:03 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30339.879174 secs 2024-04-27T02:44:04.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:03 smithi189 ceph-mon[32756]: pgmap v16604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:04.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:03 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30339.879174 secs 2024-04-27T02:44:04.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:03 smithi156 ceph-mon[32679]: pgmap v16604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:04.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:03 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30339.879174 secs 2024-04-27T02:44:05.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:04 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29642.847752 secs 2024-04-27T02:44:05.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:04 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29642.847752 secs 2024-04-27T02:44:05.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:04 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29642.847752 secs 2024-04-27T02:44:06.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:05 smithi092 ceph-mon[29156]: pgmap v16605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:06.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:05 smithi189 ceph-mon[32756]: pgmap v16605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:06.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:05 smithi156 ceph-mon[32679]: pgmap v16605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:07.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:44:07.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:44:07.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:44:08.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:07 smithi092 ceph-mon[29156]: pgmap v16606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:08.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:44:08.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:44:08.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:44:08.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:07 smithi189 ceph-mon[32756]: pgmap v16606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:08.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:44:08.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:44:08.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:44:08.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:07 smithi156 ceph-mon[32679]: pgmap v16606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:08.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:44:08.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:44:08.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:44:09.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:08 smithi092 ceph-mon[29156]: pgmap v16607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:44:09.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:08 smithi092 ceph-mon[29156]: pgmap v16608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:09.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:08 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30344.879330 secs 2024-04-27T02:44:09.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:08 smithi189 ceph-mon[32756]: pgmap v16607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:44:09.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:08 smithi189 ceph-mon[32756]: pgmap v16608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:09.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:08 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30344.879330 secs 2024-04-27T02:44:09.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:08 smithi156 ceph-mon[32679]: pgmap v16607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:44:09.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:08 smithi156 ceph-mon[32679]: pgmap v16608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:09.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:08 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30344.879330 secs 2024-04-27T02:44:10.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:09 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29647.847888 secs 2024-04-27T02:44:10.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:09 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29647.847888 secs 2024-04-27T02:44:10.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:09 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29647.847888 secs 2024-04-27T02:44:11.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:10 smithi092 ceph-mon[29156]: pgmap v16609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:11.370 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:10 smithi189 ceph-mon[32756]: pgmap v16609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:11.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:10 smithi156 ceph-mon[32679]: pgmap v16609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:13.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:12 smithi092 ceph-mon[29156]: pgmap v16610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:13.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:12 smithi189 ceph-mon[32756]: pgmap v16610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:13.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:12 smithi156 ceph-mon[32679]: pgmap v16610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:14.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:13 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30349.879451 secs 2024-04-27T02:44:14.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:13 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30349.879451 secs 2024-04-27T02:44:14.416 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:13 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30349.879451 secs 2024-04-27T02:44:15.226 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:14 smithi092 ceph-mon[29156]: pgmap v16611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:15.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:14 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29652.847985 secs 2024-04-27T02:44:15.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:14 smithi189 ceph-mon[32756]: pgmap v16611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:15.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:14 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29652.847985 secs 2024-04-27T02:44:15.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:14 smithi156 ceph-mon[32679]: pgmap v16611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:44:15.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:14 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29652.847985 secs 2024-04-27T02:44:17.227 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:16 smithi092 ceph-mon[29156]: pgmap v16612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:17.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:16 smithi189 ceph-mon[32756]: pgmap v16612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:17.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:16 smithi156 ceph-mon[32679]: pgmap v16612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:44:19.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:18 smithi189 ceph-mon[32756]: pgmap v16613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:44:19.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:18 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30354.879543 secs 2024-04-27T02:44:19.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:18 smithi156 ceph-mon[32679]: pgmap v16613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:44:19.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:18 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30354.879543 secs 2024-04-27T02:44:19.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:18 smithi092 ceph-mon[29156]: pgmap v16613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:44:19.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:18 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30354.879543 secs 2024-04-27T02:44:20.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:20 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29657.848097 secs 2024-04-27T02:44:20.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:20 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29657.848097 secs 2024-04-27T02:44:20.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:20 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29657.848097 secs 2024-04-27T02:44:21.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:21 smithi189 ceph-mon[32756]: pgmap v16614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:21.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:21 smithi156 ceph-mon[32679]: pgmap v16614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:21.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:21 smithi092 ceph-mon[29156]: pgmap v16614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:23.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:23 smithi189 ceph-mon[32756]: pgmap v16615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:23.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:23 smithi156 ceph-mon[32679]: pgmap v16615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:23.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:23 smithi092 ceph-mon[29156]: pgmap v16615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:24.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30359.879686 secs 2024-04-27T02:44:24.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30359.879686 secs 2024-04-27T02:44:24.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30359.879686 secs 2024-04-27T02:44:25.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:25 smithi189 ceph-mon[32756]: pgmap v16616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:25.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:25 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29662.848242 secs 2024-04-27T02:44:25.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:25 smithi156 ceph-mon[32679]: pgmap v16616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:25.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:25 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29662.848242 secs 2024-04-27T02:44:25.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:25 smithi092 ceph-mon[29156]: pgmap v16616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:25.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:25 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29662.848242 secs 2024-04-27T02:44:27.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:27 smithi189 ceph-mon[32756]: pgmap v16617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:27.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:27 smithi156 ceph-mon[32679]: pgmap v16617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:27.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:27 smithi092 ceph-mon[29156]: pgmap v16617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:29.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:29 smithi189 ceph-mon[32756]: pgmap v16618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:29.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30364.879837 secs 2024-04-27T02:44:29.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:29 smithi156 ceph-mon[32679]: pgmap v16618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:29.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30364.879837 secs 2024-04-27T02:44:29.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:29 smithi092 ceph-mon[29156]: pgmap v16618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:29.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30364.879837 secs 2024-04-27T02:44:30.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:30 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29667.848357 secs 2024-04-27T02:44:30.379 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:30 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29667.848357 secs 2024-04-27T02:44:30.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:30 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29667.848357 secs 2024-04-27T02:44:31.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:31 smithi189 ceph-mon[32756]: pgmap v16619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:31.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:31 smithi156 ceph-mon[32679]: pgmap v16619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:31.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:31 smithi092 ceph-mon[29156]: pgmap v16619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:33.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:33 smithi189 ceph-mon[32756]: pgmap v16620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:33.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:33 smithi156 ceph-mon[32679]: pgmap v16620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:33.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:33 smithi092 ceph-mon[29156]: pgmap v16620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:34.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30369.879950 secs 2024-04-27T02:44:34.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30369.879950 secs 2024-04-27T02:44:34.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30369.879950 secs 2024-04-27T02:44:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:35 smithi189 ceph-mon[32756]: pgmap v16621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:35.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:35 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29672.848421 secs 2024-04-27T02:44:35.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:35 smithi156 ceph-mon[32679]: pgmap v16621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:35.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:35 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29672.848421 secs 2024-04-27T02:44:35.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:35 smithi092 ceph-mon[29156]: pgmap v16621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:35.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:35 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29672.848421 secs 2024-04-27T02:44:37.371 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:37 smithi189 ceph-mon[32756]: pgmap v16622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:37.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:37 smithi156 ceph-mon[32679]: pgmap v16622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:37.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:37 smithi092 ceph-mon[29156]: pgmap v16622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:39.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:39 smithi189 ceph-mon[32756]: pgmap v16623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:39.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30374.880043 secs 2024-04-27T02:44:39.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:39 smithi156 ceph-mon[32679]: pgmap v16623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:39.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30374.880043 secs 2024-04-27T02:44:39.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:39 smithi092 ceph-mon[29156]: pgmap v16623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:39.478 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30374.880043 secs 2024-04-27T02:44:40.228 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:40 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29677.848491 secs 2024-04-27T02:44:40.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:40 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29677.848491 secs 2024-04-27T02:44:40.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:40 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29677.848491 secs 2024-04-27T02:44:41.372 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:41 smithi189 ceph-mon[32756]: pgmap v16624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:41.417 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:41 smithi156 ceph-mon[32679]: pgmap v16624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:41.477 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:41 smithi092 ceph-mon[29156]: pgmap v16624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:42.668 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:42 smithi156 ceph-mon[32679]: pgmap v16625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:42.727 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:42 smithi092 ceph-mon[29156]: pgmap v16625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:42.872 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:42 smithi189 ceph-mon[32756]: pgmap v16625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:44 smithi156 ceph-mon[32679]: pgmap v16626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:44.918 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30379.880172 secs 2024-04-27T02:44:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:44 smithi092 ceph-mon[29156]: pgmap v16626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:44.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30379.880172 secs 2024-04-27T02:44:45.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:44 smithi189 ceph-mon[32756]: pgmap v16626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:45.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30379.880172 secs 2024-04-27T02:44:45.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:45 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29682.848582 secs 2024-04-27T02:44:46.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:45 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29682.848582 secs 2024-04-27T02:44:46.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:45 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29682.848582 secs 2024-04-27T02:44:46.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:46 smithi092 ceph-mon[29156]: pgmap v16627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:47.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:46 smithi189 ceph-mon[32756]: pgmap v16627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:47.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:46 smithi156 ceph-mon[32679]: pgmap v16627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:48.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:48 smithi092 ceph-mon[29156]: pgmap v16628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:49.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:48 smithi189 ceph-mon[32756]: pgmap v16628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:49.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:48 smithi156 ceph-mon[32679]: pgmap v16628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:49.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30384.880271 secs 2024-04-27T02:44:50.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30384.880271 secs 2024-04-27T02:44:50.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30384.880271 secs 2024-04-27T02:44:50.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:50 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29687.848648 secs 2024-04-27T02:44:50.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:50 smithi092 ceph-mon[29156]: pgmap v16629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:51.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:50 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29687.848648 secs 2024-04-27T02:44:51.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:50 smithi189 ceph-mon[32756]: pgmap v16629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:51.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:50 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29687.848648 secs 2024-04-27T02:44:51.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:50 smithi156 ceph-mon[32679]: pgmap v16629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:52.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:52 smithi092 ceph-mon[29156]: pgmap v16630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:53.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:52 smithi189 ceph-mon[32756]: pgmap v16630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:53.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:52 smithi156 ceph-mon[32679]: pgmap v16630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:54 smithi092 ceph-mon[29156]: pgmap v16631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:54.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30389.880371 secs 2024-04-27T02:44:55.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:54 smithi189 ceph-mon[32756]: pgmap v16631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:55.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30389.880371 secs 2024-04-27T02:44:55.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:54 smithi156 ceph-mon[32679]: pgmap v16631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:44:55.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30389.880371 secs 2024-04-27T02:44:55.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:55 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29692.848725 secs 2024-04-27T02:44:56.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:55 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29692.848725 secs 2024-04-27T02:44:56.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:55 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29692.848725 secs 2024-04-27T02:44:56.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:56 smithi092 ceph-mon[29156]: pgmap v16632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:57.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:56 smithi189 ceph-mon[32756]: pgmap v16632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:57.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:56 smithi156 ceph-mon[32679]: pgmap v16632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:58.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:58 smithi092 ceph-mon[29156]: pgmap v16633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:59.122 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:58 smithi189 ceph-mon[32756]: pgmap v16633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:59.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:58 smithi156 ceph-mon[32679]: pgmap v16633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:44:59.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:44:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30394.880489 secs 2024-04-27T02:45:00.024 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:44:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30394.880489 secs 2024-04-27T02:45:00.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:44:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30394.880489 secs 2024-04-27T02:45:00.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:00 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29697.848804 secs 2024-04-27T02:45:00.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:00 smithi092 ceph-mon[29156]: pgmap v16634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:01.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:00 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29697.848804 secs 2024-04-27T02:45:01.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:00 smithi189 ceph-mon[32756]: pgmap v16634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:01.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:00 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29697.848804 secs 2024-04-27T02:45:01.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:00 smithi156 ceph-mon[32679]: pgmap v16634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:02.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:02 smithi092 ceph-mon[29156]: pgmap v16635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:03.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:02 smithi189 ceph-mon[32756]: pgmap v16635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:03.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:02 smithi156 ceph-mon[32679]: pgmap v16635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:04.970 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:04 smithi156 ceph-mon[32679]: pgmap v16636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:04.970 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30399.880619 secs 2024-04-27T02:45:04.971 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:04 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29702.848889 secs 2024-04-27T02:45:04.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:04 smithi092 ceph-mon[29156]: pgmap v16636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:04.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30399.880619 secs 2024-04-27T02:45:04.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:04 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29702.848889 secs 2024-04-27T02:45:05.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:04 smithi189 ceph-mon[32756]: pgmap v16636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:05.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30399.880619 secs 2024-04-27T02:45:05.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:04 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29702.848889 secs 2024-04-27T02:45:06.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:06 smithi092 ceph-mon[29156]: pgmap v16637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:07.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:06 smithi189 ceph-mon[32756]: pgmap v16637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:07.170 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:06 smithi156 ceph-mon[32679]: pgmap v16637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:07.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:45:08.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:45:08.168 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:45:09.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:08 smithi189 ceph-mon[32756]: pgmap v16638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:09.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:45:09.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:45:09.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:45:09.170 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:08 smithi156 ceph-mon[32679]: pgmap v16638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:09.170 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:45:09.170 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:45:09.170 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-mon[29156]: pgmap v16638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:45:08.979+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:45:08.979+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:45:08.979+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:45:09.229 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:45:08.979+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:45:09.230 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:45:08 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:45:08.979+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:45:10.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:09 smithi189 ceph-mon[32756]: pgmap v16639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:45:10.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:09 smithi189 ceph-mon[32756]: pgmap v16640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:10.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30404.880754 secs 2024-04-27T02:45:10.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:09 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29707.849032 secs 2024-04-27T02:45:10.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:09 smithi156 ceph-mon[32679]: pgmap v16639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:45:10.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:09 smithi156 ceph-mon[32679]: pgmap v16640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:10.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30404.880754 secs 2024-04-27T02:45:10.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:09 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29707.849032 secs 2024-04-27T02:45:10.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:09 smithi092 ceph-mon[29156]: pgmap v16639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:45:10.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:09 smithi092 ceph-mon[29156]: pgmap v16640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:10.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30404.880754 secs 2024-04-27T02:45:10.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:09 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29707.849032 secs 2024-04-27T02:45:11.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:11 smithi092 ceph-mon[29156]: pgmap v16641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:45:12.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:11 smithi189 ceph-mon[32756]: pgmap v16641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:45:12.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:11 smithi156 ceph-mon[32679]: pgmap v16641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:45:14.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:13 smithi189 ceph-mon[32756]: pgmap v16642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:14.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:13 smithi156 ceph-mon[32679]: pgmap v16642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:14.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:13 smithi092 ceph-mon[29156]: pgmap v16642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:45:15.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30409.880881 secs 2024-04-27T02:45:15.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:14 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29712.849173 secs 2024-04-27T02:45:15.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30409.880881 secs 2024-04-27T02:45:15.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:14 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29712.849173 secs 2024-04-27T02:45:15.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30409.880881 secs 2024-04-27T02:45:15.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:14 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29712.849173 secs 2024-04-27T02:45:16.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:15 smithi189 ceph-mon[32756]: pgmap v16643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:16.169 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:15 smithi156 ceph-mon[32679]: pgmap v16643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:16.229 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:15 smithi092 ceph-mon[29156]: pgmap v16643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:17.669 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:17 smithi156 ceph-mon[32679]: pgmap v16644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:17.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:17 smithi092 ceph-mon[29156]: pgmap v16644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:17.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:17 smithi189 ceph-mon[32756]: pgmap v16644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 350 B/s wr, 20 op/s 2024-04-27T02:45:19.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:19 smithi092 ceph-mon[29156]: pgmap v16645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 307 B/s wr, 17 op/s 2024-04-27T02:45:19.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30414.881022 secs 2024-04-27T02:45:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:19 smithi189 ceph-mon[32756]: pgmap v16645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 307 B/s wr, 17 op/s 2024-04-27T02:45:19.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30414.881022 secs 2024-04-27T02:45:19.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:19 smithi156 ceph-mon[32679]: pgmap v16645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 307 B/s wr, 17 op/s 2024-04-27T02:45:19.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30414.881022 secs 2024-04-27T02:45:20.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:20 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29717.849320 secs 2024-04-27T02:45:20.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:20 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29717.849320 secs 2024-04-27T02:45:20.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:20 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29717.849320 secs 2024-04-27T02:45:21.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:21 smithi092 ceph-mon[29156]: pgmap v16646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:21.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:21 smithi189 ceph-mon[32756]: pgmap v16646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:21.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:21 smithi156 ceph-mon[32679]: pgmap v16646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:23.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:23 smithi092 ceph-mon[29156]: pgmap v16647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T02:45:23.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:23 smithi189 ceph-mon[32756]: pgmap v16647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T02:45:23.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:23 smithi156 ceph-mon[32679]: pgmap v16647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 255 B/s wr, 14 op/s 2024-04-27T02:45:24.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30419.881085 secs 2024-04-27T02:45:24.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30419.881085 secs 2024-04-27T02:45:24.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30419.881085 secs 2024-04-27T02:45:25.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:25 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29722.849388 secs 2024-04-27T02:45:25.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:25 smithi092 ceph-mon[29156]: pgmap v16648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:25.873 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:25 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29722.849388 secs 2024-04-27T02:45:25.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:25 smithi189 ceph-mon[32756]: pgmap v16648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:25.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:25 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29722.849388 secs 2024-04-27T02:45:25.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:25 smithi156 ceph-mon[32679]: pgmap v16648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 255 B/s wr, 16 op/s 2024-04-27T02:45:27.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:27 smithi092 ceph-mon[29156]: pgmap v16649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:27.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:27 smithi189 ceph-mon[32756]: pgmap v16649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:27.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:27 smithi156 ceph-mon[32679]: pgmap v16649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:29.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:29 smithi092 ceph-mon[29156]: pgmap v16650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:29.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30424.881217 secs 2024-04-27T02:45:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:29 smithi189 ceph-mon[32756]: pgmap v16650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:29.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30424.881217 secs 2024-04-27T02:45:29.919 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:29 smithi156 ceph-mon[32679]: pgmap v16650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:29.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30424.881217 secs 2024-04-27T02:45:30.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:30 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29727.849482 secs 2024-04-27T02:45:30.775 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:30 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29727.849482 secs 2024-04-27T02:45:30.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:30 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29727.849482 secs 2024-04-27T02:45:31.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:31 smithi092 ceph-mon[29156]: pgmap v16651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:31.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:31 smithi189 ceph-mon[32756]: pgmap v16651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:31.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:31 smithi156 ceph-mon[32679]: pgmap v16651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:33.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:33 smithi189 ceph-mon[32756]: pgmap v16652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:33.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:33 smithi156 ceph-mon[32679]: pgmap v16652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:33.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:33 smithi092 ceph-mon[29156]: pgmap v16652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:34.821 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30429.881334 secs 2024-04-27T02:45:34.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30429.881334 secs 2024-04-27T02:45:34.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30429.881334 secs 2024-04-27T02:45:35.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:35 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29732.849563 secs 2024-04-27T02:45:35.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:35 smithi189 ceph-mon[32756]: pgmap v16653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:35.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:35 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29732.849563 secs 2024-04-27T02:45:35.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:35 smithi156 ceph-mon[32679]: pgmap v16653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:35.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:35 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29732.849563 secs 2024-04-27T02:45:35.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:35 smithi092 ceph-mon[29156]: pgmap v16653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:37.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:37 smithi189 ceph-mon[32756]: pgmap v16654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:37.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:37 smithi156 ceph-mon[32679]: pgmap v16654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:37.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:37 smithi092 ceph-mon[29156]: pgmap v16654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:39 smithi189 ceph-mon[32756]: pgmap v16655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:39.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30434.881462 secs 2024-04-27T02:45:39.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:39 smithi156 ceph-mon[32679]: pgmap v16655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:39.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30434.881462 secs 2024-04-27T02:45:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:39 smithi092 ceph-mon[29156]: pgmap v16655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:39.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30434.881462 secs 2024-04-27T02:45:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:45:40.160+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:45:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:45:40.160+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:45:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:45:40.160+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:45:40.147 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:45:40.160+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 235 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:45:40.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:40 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29737.849687 secs 2024-04-27T02:45:40.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:40 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29737.849687 secs 2024-04-27T02:45:40.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:40 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29737.849687 secs 2024-04-27T02:45:41.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:41 smithi189 ceph-mon[32756]: pgmap v16656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:41.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:41 smithi156 ceph-mon[32679]: pgmap v16656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:41.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:41 smithi092 ceph-mon[29156]: pgmap v16656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:43.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:43 smithi189 ceph-mon[32756]: pgmap v16657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:43.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:43 smithi156 ceph-mon[32679]: pgmap v16657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:43.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:43 smithi092 ceph-mon[29156]: pgmap v16657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:44.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30439.881555 secs 2024-04-27T02:45:44.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30439.881555 secs 2024-04-27T02:45:44.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30439.881555 secs 2024-04-27T02:45:45.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:45 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29742.849751 secs 2024-04-27T02:45:45.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:45 smithi189 ceph-mon[32756]: pgmap v16658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:45.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:45 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29742.849751 secs 2024-04-27T02:45:45.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:45 smithi156 ceph-mon[32679]: pgmap v16658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:45.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:45 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29742.849751 secs 2024-04-27T02:45:45.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:45 smithi092 ceph-mon[29156]: pgmap v16658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:47.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:47 smithi189 ceph-mon[32756]: pgmap v16659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:47.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:47 smithi156 ceph-mon[32679]: pgmap v16659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:47.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:47 smithi092 ceph-mon[29156]: pgmap v16659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:49.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:49 smithi189 ceph-mon[32756]: pgmap v16660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:49.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30444.881681 secs 2024-04-27T02:45:49.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:49 smithi156 ceph-mon[32679]: pgmap v16660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:49.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30444.881681 secs 2024-04-27T02:45:49.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:49 smithi092 ceph-mon[29156]: pgmap v16660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:49.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30444.881681 secs 2024-04-27T02:45:50.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:50 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29747.849826 secs 2024-04-27T02:45:50.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:50 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29747.849826 secs 2024-04-27T02:45:50.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:50 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29747.849826 secs 2024-04-27T02:45:51.874 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:51 smithi189 ceph-mon[32756]: pgmap v16661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:51.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:51 smithi156 ceph-mon[32679]: pgmap v16661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:51.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:51 smithi092 ceph-mon[29156]: pgmap v16661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:53.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:53 smithi189 ceph-mon[32756]: pgmap v16662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:53.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:53 smithi156 ceph-mon[32679]: pgmap v16662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:53.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:53 smithi092 ceph-mon[29156]: pgmap v16662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:54.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30449.881809 secs 2024-04-27T02:45:54.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30449.881809 secs 2024-04-27T02:45:54.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30449.881809 secs 2024-04-27T02:45:55.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:55 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29752.849969 secs 2024-04-27T02:45:55.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:55 smithi189 ceph-mon[32756]: pgmap v16663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:55.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:55 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29752.849969 secs 2024-04-27T02:45:55.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:55 smithi156 ceph-mon[32679]: pgmap v16663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:55.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:55 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29752.849969 secs 2024-04-27T02:45:55.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:55 smithi092 ceph-mon[29156]: pgmap v16663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:45:57.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:57 smithi189 ceph-mon[32756]: pgmap v16664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:57.920 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:57 smithi156 ceph-mon[32679]: pgmap v16664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:57.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:57 smithi092 ceph-mon[29156]: pgmap v16664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:59 smithi189 ceph-mon[32756]: pgmap v16665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:59.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:45:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30454.881871 secs 2024-04-27T02:45:59.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:59 smithi156 ceph-mon[32679]: pgmap v16665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:59.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:45:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30454.881871 secs 2024-04-27T02:45:59.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:59 smithi092 ceph-mon[29156]: pgmap v16665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:45:59.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:45:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30454.881871 secs 2024-04-27T02:46:00.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:00 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29757.850075 secs 2024-04-27T02:46:00.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:00 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29757.850075 secs 2024-04-27T02:46:00.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:00 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29757.850075 secs 2024-04-27T02:46:01.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:01 smithi189 ceph-mon[32756]: pgmap v16666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:01.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:01 smithi156 ceph-mon[32679]: pgmap v16666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:01.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:01 smithi092 ceph-mon[29156]: pgmap v16666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:03.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:03 smithi189 ceph-mon[32756]: pgmap v16667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:03.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:03 smithi156 ceph-mon[32679]: pgmap v16667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:03.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:03 smithi092 ceph-mon[29156]: pgmap v16667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:04.822 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30459.881989 secs 2024-04-27T02:46:04.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30459.881989 secs 2024-04-27T02:46:04.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30459.881989 secs 2024-04-27T02:46:05.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:05 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29762.850171 secs 2024-04-27T02:46:05.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:05 smithi189 ceph-mon[32756]: pgmap v16668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:05.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:05 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29762.850171 secs 2024-04-27T02:46:05.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:05 smithi156 ceph-mon[32679]: pgmap v16668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:05.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:05 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29762.850171 secs 2024-04-27T02:46:05.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:05 smithi092 ceph-mon[29156]: pgmap v16668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:07.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:07 smithi189 ceph-mon[32756]: pgmap v16669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:07.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:07 smithi156 ceph-mon[32679]: pgmap v16669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:07.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:07 smithi092 ceph-mon[29156]: pgmap v16669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:08.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:46:08.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:46:08.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:46:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: pgmap v16670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30464.882078 secs 2024-04-27T02:46:09.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:46:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:46:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: pgmap v16671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: pgmap v16672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.876 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: pgmap v16670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30464.882078 secs 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: pgmap v16671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: pgmap v16672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: pgmap v16670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30464.882078 secs 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: pgmap v16671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: pgmap v16672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:09.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:46:10.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:10 smithi189 ceph-mon[32756]: 22 slow requests, 2 included below; oldest blocked for > 29767.850237 secs 2024-04-27T02:46:10.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:10 smithi189 ceph-mon[32756]: slow request 2880.815321 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:10.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:10 smithi189 ceph-mon[32756]: slow request 360.108895 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:10 smithi156 ceph-mon[32679]: 22 slow requests, 2 included below; oldest blocked for > 29767.850237 secs 2024-04-27T02:46:10.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:10 smithi156 ceph-mon[32679]: slow request 2880.815321 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:10.922 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:10 smithi156 ceph-mon[32679]: slow request 360.108895 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:10.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:10 smithi092 ceph-mon[29156]: 22 slow requests, 2 included below; oldest blocked for > 29767.850237 secs 2024-04-27T02:46:10.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:10 smithi092 ceph-mon[29156]: slow request 2880.815321 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:10.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:10 smithi092 ceph-mon[29156]: slow request 360.108895 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:46:11.875 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:11 smithi189 ceph-mon[32756]: pgmap v16673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:11.921 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:11 smithi156 ceph-mon[32679]: pgmap v16673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:11.981 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:11 smithi092 ceph-mon[29156]: pgmap v16673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:46:14.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:14 smithi189 ceph-mon[32756]: pgmap v16674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:46:14.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30469.882200 secs 2024-04-27T02:46:14.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:14 smithi156 ceph-mon[32679]: pgmap v16674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:46:14.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30469.882200 secs 2024-04-27T02:46:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:14 smithi092 ceph-mon[29156]: pgmap v16674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:46:14.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30469.882200 secs 2024-04-27T02:46:15.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:15 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29772.850331 secs 2024-04-27T02:46:15.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:15 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29772.850331 secs 2024-04-27T02:46:15.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:15 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29772.850331 secs 2024-04-27T02:46:16.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:16 smithi189 ceph-mon[32756]: pgmap v16675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:16.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:16 smithi156 ceph-mon[32679]: pgmap v16675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:16.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:16 smithi092 ceph-mon[29156]: pgmap v16675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:18.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:18 smithi189 ceph-mon[32756]: pgmap v16676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:18.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:18 smithi156 ceph-mon[32679]: pgmap v16676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:18.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:18 smithi092 ceph-mon[29156]: pgmap v16676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:46:19.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30474.882317 secs 2024-04-27T02:46:19.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30474.882317 secs 2024-04-27T02:46:19.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30474.882317 secs 2024-04-27T02:46:20.625 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:20 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29777.850421 secs 2024-04-27T02:46:20.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:20 smithi189 ceph-mon[32756]: pgmap v16677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:46:20.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:20 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29777.850421 secs 2024-04-27T02:46:20.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:20 smithi156 ceph-mon[32679]: pgmap v16677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:46:20.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:20 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29777.850421 secs 2024-04-27T02:46:20.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:20 smithi092 ceph-mon[29156]: pgmap v16677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:46:22.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:22 smithi189 ceph-mon[32756]: pgmap v16678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:22.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:22 smithi156 ceph-mon[32679]: pgmap v16678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:22.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:22 smithi092 ceph-mon[29156]: pgmap v16678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:24 smithi189 ceph-mon[32756]: pgmap v16679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:24.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30479.882431 secs 2024-04-27T02:46:24.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:24 smithi156 ceph-mon[32679]: pgmap v16679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:24.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30479.882431 secs 2024-04-27T02:46:24.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:24 smithi092 ceph-mon[29156]: pgmap v16679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:24.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30479.882431 secs 2024-04-27T02:46:25.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:25 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29782.850544 secs 2024-04-27T02:46:25.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:25 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29782.850544 secs 2024-04-27T02:46:25.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:25 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29782.850544 secs 2024-04-27T02:46:26.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:26 smithi189 ceph-mon[32756]: pgmap v16680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:26.671 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:26 smithi156 ceph-mon[32679]: pgmap v16680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:26.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:26 smithi092 ceph-mon[29156]: pgmap v16680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:28.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:28 smithi189 ceph-mon[32756]: pgmap v16681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:28.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:28 smithi156 ceph-mon[32679]: pgmap v16681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:28.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:28 smithi092 ceph-mon[29156]: pgmap v16681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:29.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30484.882549 secs 2024-04-27T02:46:29.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30484.882549 secs 2024-04-27T02:46:29.731 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30484.882549 secs 2024-04-27T02:46:30.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:30 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29787.850652 secs 2024-04-27T02:46:30.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:30 smithi189 ceph-mon[32756]: pgmap v16682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:30.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:30 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29787.850652 secs 2024-04-27T02:46:30.633 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:30 smithi092 ceph-mon[29156]: pgmap v16682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:30.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:30 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29787.850652 secs 2024-04-27T02:46:30.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:30 smithi156 ceph-mon[32679]: pgmap v16682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:32.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:32 smithi189 ceph-mon[32756]: pgmap v16683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:32.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:32 smithi156 ceph-mon[32679]: pgmap v16683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:32.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:32 smithi092 ceph-mon[29156]: pgmap v16683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:34 smithi189 ceph-mon[32756]: pgmap v16684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:34.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30489.882667 secs 2024-04-27T02:46:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:34 smithi156 ceph-mon[32679]: pgmap v16684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:34.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30489.882667 secs 2024-04-27T02:46:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:34 smithi092 ceph-mon[29156]: pgmap v16684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:34.734 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30489.882667 secs 2024-04-27T02:46:35.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:35 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29792.850795 secs 2024-04-27T02:46:35.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:35 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29792.850795 secs 2024-04-27T02:46:35.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:35 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29792.850795 secs 2024-04-27T02:46:36.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:36 smithi189 ceph-mon[32756]: pgmap v16685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:36.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:36 smithi156 ceph-mon[32679]: pgmap v16685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:36.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:36 smithi092 ceph-mon[29156]: pgmap v16685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:38.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:38 smithi189 ceph-mon[32756]: pgmap v16686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:38.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:38 smithi156 ceph-mon[32679]: pgmap v16686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:38.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:38 smithi092 ceph-mon[29156]: pgmap v16686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:39.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30494.882783 secs 2024-04-27T02:46:39.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30494.882783 secs 2024-04-27T02:46:39.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30494.882783 secs 2024-04-27T02:46:40.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:40 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29797.850854 secs 2024-04-27T02:46:40.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:40 smithi189 ceph-mon[32756]: pgmap v16687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:40.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:40 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29797.850854 secs 2024-04-27T02:46:40.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:40 smithi156 ceph-mon[32679]: pgmap v16687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:40 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29797.850854 secs 2024-04-27T02:46:40.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:40 smithi092 ceph-mon[29156]: pgmap v16687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:42.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:42 smithi189 ceph-mon[32756]: pgmap v16688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:42.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:42 smithi156 ceph-mon[32679]: pgmap v16688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:42.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:42 smithi092 ceph-mon[29156]: pgmap v16688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:44.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:44 smithi189 ceph-mon[32756]: pgmap v16689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:44.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30499.882913 secs 2024-04-27T02:46:44.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:44 smithi156 ceph-mon[32679]: pgmap v16689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:44.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30499.882913 secs 2024-04-27T02:46:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:44 smithi092 ceph-mon[29156]: pgmap v16689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:44.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30499.882913 secs 2024-04-27T02:46:45.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:45 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29802.850929 secs 2024-04-27T02:46:45.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:45 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29802.850929 secs 2024-04-27T02:46:45.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:45 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29802.850929 secs 2024-04-27T02:46:46.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:46 smithi189 ceph-mon[32756]: pgmap v16690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:46.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:46 smithi156 ceph-mon[32679]: pgmap v16690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:46.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:46 smithi092 ceph-mon[29156]: pgmap v16690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:48.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:48 smithi189 ceph-mon[32756]: pgmap v16691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:48.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:48 smithi156 ceph-mon[32679]: pgmap v16691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:48.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:48 smithi092 ceph-mon[29156]: pgmap v16691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:49.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30504.883062 secs 2024-04-27T02:46:49.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30504.883062 secs 2024-04-27T02:46:49.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30504.883062 secs 2024-04-27T02:46:50.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:50 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29807.851016 secs 2024-04-27T02:46:50.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:50 smithi189 ceph-mon[32756]: pgmap v16692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:50.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:50 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29807.851016 secs 2024-04-27T02:46:50.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:50 smithi156 ceph-mon[32679]: pgmap v16692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:50.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:50 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29807.851016 secs 2024-04-27T02:46:50.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:50 smithi092 ceph-mon[29156]: pgmap v16692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:52.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:52 smithi189 ceph-mon[32756]: pgmap v16693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:52.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:52 smithi156 ceph-mon[32679]: pgmap v16693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:52.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:52 smithi092 ceph-mon[29156]: pgmap v16693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:54 smithi189 ceph-mon[32756]: pgmap v16694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:54.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30509.883178 secs 2024-04-27T02:46:54.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:54 smithi156 ceph-mon[32679]: pgmap v16694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:54.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30509.883178 secs 2024-04-27T02:46:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:54 smithi092 ceph-mon[29156]: pgmap v16694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:54.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30509.883178 secs 2024-04-27T02:46:55.626 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:55 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29812.851154 secs 2024-04-27T02:46:55.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:55 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29812.851154 secs 2024-04-27T02:46:55.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:55 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29812.851154 secs 2024-04-27T02:46:56.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:56 smithi189 ceph-mon[32756]: pgmap v16695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:56.672 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:56 smithi156 ceph-mon[32679]: pgmap v16695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:56.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:56 smithi092 ceph-mon[29156]: pgmap v16695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:46:57.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:57 smithi189 ceph-mon[32756]: pgmap v16696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:57.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:57 smithi156 ceph-mon[32679]: pgmap v16696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:57.732 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:57 smithi092 ceph-mon[29156]: pgmap v16696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:46:59.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:58 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30514.883298 secs 2024-04-27T02:46:59.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:58 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30514.883298 secs 2024-04-27T02:46:59.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:58 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30514.883298 secs 2024-04-27T02:47:00.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:59 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29817.851220 secs 2024-04-27T02:47:00.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:46:59 smithi156 ceph-mon[32679]: pgmap v16697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:00.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:59 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29817.851220 secs 2024-04-27T02:47:00.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:46:59 smithi092 ceph-mon[29156]: pgmap v16697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:00.278 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:59 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29817.851220 secs 2024-04-27T02:47:00.279 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:46:59 smithi189 ceph-mon[32756]: pgmap v16697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:02.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:02 smithi189 ceph-mon[32756]: pgmap v16698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:02.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:02 smithi156 ceph-mon[32679]: pgmap v16698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:02.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:02 smithi092 ceph-mon[29156]: pgmap v16698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:04.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:04 smithi189 ceph-mon[32756]: pgmap v16699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:04.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30519.883434 secs 2024-04-27T02:47:04.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:04 smithi156 ceph-mon[32679]: pgmap v16699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:04.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30519.883434 secs 2024-04-27T02:47:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:04 smithi092 ceph-mon[29156]: pgmap v16699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:04.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30519.883434 secs 2024-04-27T02:47:05.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:05 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29822.851340 secs 2024-04-27T02:47:05.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:05 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29822.851340 secs 2024-04-27T02:47:05.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:05 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29822.851340 secs 2024-04-27T02:47:06.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:06 smithi189 ceph-mon[32756]: pgmap v16700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:06.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:06 smithi156 ceph-mon[32679]: pgmap v16700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:06.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:06 smithi092 ceph-mon[29156]: pgmap v16700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:08.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:08 smithi189 ceph-mon[32756]: pgmap v16701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:08.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:08 smithi156 ceph-mon[32679]: pgmap v16701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:08.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:08 smithi092 ceph-mon[29156]: pgmap v16701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:09.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30524.883573 secs 2024-04-27T02:47:09.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30524.883573 secs 2024-04-27T02:47:09.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30524.883573 secs 2024-04-27T02:47:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29827.851451 secs 2024-04-27T02:47:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: pgmap v16702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:47:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:47:10.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:47:10.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29827.851451 secs 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: pgmap v16702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:47:10.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29827.851451 secs 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: pgmap v16702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:47:10.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:47:11.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:11 smithi189 ceph-mon[32756]: pgmap v16703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:47:11.627 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:11 smithi189 ceph-mon[32756]: pgmap v16704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:11.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:11 smithi156 ceph-mon[32679]: pgmap v16703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:47:11.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:11 smithi156 ceph-mon[32679]: pgmap v16704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:11.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:11 smithi092 ceph-mon[29156]: pgmap v16703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:47:11.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:11 smithi092 ceph-mon[29156]: pgmap v16704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:12.673 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:12 smithi156 ceph-mon[32679]: pgmap v16705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:12.733 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:12 smithi092 ceph-mon[29156]: pgmap v16705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:12.877 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:12 smithi189 ceph-mon[32756]: pgmap v16705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:14.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:13 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 30529.883694 secs 2024-04-27T02:47:14.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:13 smithi156 ceph-mon[32679]: slow request 724.984750 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:47:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:13 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 30529.883694 secs 2024-04-27T02:47:14.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:13 smithi092 ceph-mon[29156]: slow request 724.984750 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:47:14.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:13 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 30529.883694 secs 2024-04-27T02:47:14.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:13 smithi189 ceph-mon[32756]: slow request 724.984750 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:47:15.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:14 smithi156 ceph-mon[32679]: pgmap v16706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:15.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:14 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29832.851513 secs 2024-04-27T02:47:15.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:14 smithi092 ceph-mon[29156]: pgmap v16706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:15.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:14 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29832.851513 secs 2024-04-27T02:47:15.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:14 smithi189 ceph-mon[32756]: pgmap v16706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:15.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:14 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29832.851513 secs 2024-04-27T02:47:17.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:17 smithi189 ceph-mon[32756]: pgmap v16707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:17.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:17 smithi156 ceph-mon[32679]: pgmap v16707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:17.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:17 smithi092 ceph-mon[29156]: pgmap v16707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:47:19.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:19 smithi189 ceph-mon[32756]: pgmap v16708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:47:19.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30534.883816 secs 2024-04-27T02:47:19.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:19 smithi156 ceph-mon[32679]: pgmap v16708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:47:19.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30534.883816 secs 2024-04-27T02:47:19.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:19 smithi092 ceph-mon[29156]: pgmap v16708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:47:19.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30534.883816 secs 2024-04-27T02:47:20.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:20 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29837.851634 secs 2024-04-27T02:47:20.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:20 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29837.851634 secs 2024-04-27T02:47:20.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:20 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29837.851634 secs 2024-04-27T02:47:21.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:21 smithi189 ceph-mon[32756]: pgmap v16709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:47:21.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:21 smithi156 ceph-mon[32679]: pgmap v16709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:47:21.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:21 smithi092 ceph-mon[29156]: pgmap v16709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:47:23.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:23 smithi189 ceph-mon[32756]: pgmap v16710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:23.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:23 smithi156 ceph-mon[32679]: pgmap v16710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:23.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:23 smithi092 ceph-mon[29156]: pgmap v16710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:24.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30539.883913 secs 2024-04-27T02:47:24.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30539.883913 secs 2024-04-27T02:47:24.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30539.883913 secs 2024-04-27T02:47:25.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:25 smithi189 ceph-mon[32756]: pgmap v16711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:25.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:25 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29842.851747 secs 2024-04-27T02:47:25.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:25 smithi156 ceph-mon[32679]: pgmap v16711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:25.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:25 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29842.851747 secs 2024-04-27T02:47:25.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:25 smithi092 ceph-mon[29156]: pgmap v16711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:25.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:25 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29842.851747 secs 2024-04-27T02:47:27.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:27 smithi189 ceph-mon[32756]: pgmap v16712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:27.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:27 smithi156 ceph-mon[32679]: pgmap v16712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:27.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:27 smithi092 ceph-mon[29156]: pgmap v16712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:29.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:29 smithi189 ceph-mon[32756]: pgmap v16713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:29.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30544.884045 secs 2024-04-27T02:47:29.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:29 smithi156 ceph-mon[32679]: pgmap v16713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:29.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30544.884045 secs 2024-04-27T02:47:29.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:29 smithi092 ceph-mon[29156]: pgmap v16713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:29.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30544.884045 secs 2024-04-27T02:47:30.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:30 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29847.851869 secs 2024-04-27T02:47:30.385 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:30 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29847.851869 secs 2024-04-27T02:47:30.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:30 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29847.851869 secs 2024-04-27T02:47:31.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:31 smithi092 ceph-mon[29156]: pgmap v16714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:31.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:31 smithi189 ceph-mon[32756]: pgmap v16714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:31.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:31 smithi156 ceph-mon[32679]: pgmap v16714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:33.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:33 smithi189 ceph-mon[32756]: pgmap v16715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:33.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:33 smithi156 ceph-mon[32679]: pgmap v16715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:33.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:33 smithi092 ceph-mon[29156]: pgmap v16715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:34.325 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30549.884184 secs 2024-04-27T02:47:34.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30549.884184 secs 2024-04-27T02:47:34.483 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30549.884184 secs 2024-04-27T02:47:35.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:35 smithi189 ceph-mon[32756]: pgmap v16716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:35.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:35 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29852.851991 secs 2024-04-27T02:47:35.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:35 smithi156 ceph-mon[32679]: pgmap v16716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:35.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:35 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29852.851991 secs 2024-04-27T02:47:35.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:35 smithi092 ceph-mon[29156]: pgmap v16716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:35.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:35 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29852.851991 secs 2024-04-27T02:47:37.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:37 smithi189 ceph-mon[32756]: pgmap v16717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:37.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:37 smithi156 ceph-mon[32679]: pgmap v16717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:37.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:37 smithi092 ceph-mon[29156]: pgmap v16717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:39.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:39 smithi189 ceph-mon[32756]: pgmap v16718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:39.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30554.884319 secs 2024-04-27T02:47:39.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:39 smithi156 ceph-mon[32679]: pgmap v16718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:39.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30554.884319 secs 2024-04-27T02:47:39.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:39 smithi092 ceph-mon[29156]: pgmap v16718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:39.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30554.884319 secs 2024-04-27T02:47:40.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:40 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29857.852107 secs 2024-04-27T02:47:40.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:40 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29857.852107 secs 2024-04-27T02:47:40.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:40 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29857.852107 secs 2024-04-27T02:47:41.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:41 smithi189 ceph-mon[32756]: pgmap v16719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:41.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:41 smithi156 ceph-mon[32679]: pgmap v16719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:41.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:41 smithi092 ceph-mon[29156]: pgmap v16719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:43.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:43 smithi189 ceph-mon[32756]: pgmap v16720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:43.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:43 smithi156 ceph-mon[32679]: pgmap v16720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:43.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:43 smithi092 ceph-mon[29156]: pgmap v16720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:44.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30559.884420 secs 2024-04-27T02:47:44.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30559.884420 secs 2024-04-27T02:47:44.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30559.884420 secs 2024-04-27T02:47:45.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:45 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29862.852171 secs 2024-04-27T02:47:45.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:45 smithi189 ceph-mon[32756]: pgmap v16721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:45.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:45 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29862.852171 secs 2024-04-27T02:47:45.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:45 smithi156 ceph-mon[32679]: pgmap v16721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:45.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:45 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29862.852171 secs 2024-04-27T02:47:45.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:45 smithi092 ceph-mon[29156]: pgmap v16721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:47.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:47 smithi189 ceph-mon[32756]: pgmap v16722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:47.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:47 smithi156 ceph-mon[32679]: pgmap v16722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:47.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:47 smithi092 ceph-mon[29156]: pgmap v16722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:49.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:49 smithi189 ceph-mon[32756]: pgmap v16723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:49.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30564.884543 secs 2024-04-27T02:47:49.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:49 smithi156 ceph-mon[32679]: pgmap v16723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:49.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30564.884543 secs 2024-04-27T02:47:49.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:49 smithi092 ceph-mon[29156]: pgmap v16723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:49.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30564.884543 secs 2024-04-27T02:47:50.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:50 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29867.852288 secs 2024-04-27T02:47:50.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:50 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29867.852288 secs 2024-04-27T02:47:50.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:50 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29867.852288 secs 2024-04-27T02:47:51.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:51 smithi189 ceph-mon[32756]: pgmap v16724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:51.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:51 smithi156 ceph-mon[32679]: pgmap v16724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:51.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:51 smithi092 ceph-mon[29156]: pgmap v16724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:53.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:53 smithi189 ceph-mon[32756]: pgmap v16725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:53.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:53 smithi156 ceph-mon[32679]: pgmap v16725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:53.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:53 smithi092 ceph-mon[29156]: pgmap v16725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:54.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30569.884668 secs 2024-04-27T02:47:54.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30569.884668 secs 2024-04-27T02:47:54.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30569.884668 secs 2024-04-27T02:47:55.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:55 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29872.852406 secs 2024-04-27T02:47:55.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:55 smithi156 ceph-mon[32679]: pgmap v16726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:55.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:55 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29872.852406 secs 2024-04-27T02:47:55.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:55 smithi092 ceph-mon[29156]: pgmap v16726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:55.628 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:55 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29872.852406 secs 2024-04-27T02:47:55.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:55 smithi189 ceph-mon[32756]: pgmap v16726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:47:57.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:57 smithi156 ceph-mon[32679]: pgmap v16727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:57.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:57 smithi092 ceph-mon[29156]: pgmap v16727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:57.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:57 smithi189 ceph-mon[32756]: pgmap v16727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:59.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:59 smithi156 ceph-mon[32679]: pgmap v16728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:59.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:47:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30574.884788 secs 2024-04-27T02:47:59.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:59 smithi092 ceph-mon[29156]: pgmap v16728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:59.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:47:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30574.884788 secs 2024-04-27T02:47:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:59 smithi189 ceph-mon[32756]: pgmap v16728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:47:59.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:47:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30574.884788 secs 2024-04-27T02:48:00.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:00 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29877.852543 secs 2024-04-27T02:48:00.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:00 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29877.852543 secs 2024-04-27T02:48:00.530 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:00 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29877.852543 secs 2024-04-27T02:48:01.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:01 smithi156 ceph-mon[32679]: pgmap v16729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:01.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:01 smithi092 ceph-mon[29156]: pgmap v16729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:01.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:01 smithi189 ceph-mon[32756]: pgmap v16729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:03.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:03 smithi156 ceph-mon[32679]: pgmap v16730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:03.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:03 smithi092 ceph-mon[29156]: pgmap v16730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:03.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:03 smithi189 ceph-mon[32756]: pgmap v16730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:04.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30579.884904 secs 2024-04-27T02:48:04.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30579.884904 secs 2024-04-27T02:48:04.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30579.884904 secs 2024-04-27T02:48:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:05 smithi156 ceph-mon[32679]: 22 slow requests, 0 included below; oldest blocked for > 29882.852627 secs 2024-04-27T02:48:05.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:05 smithi156 ceph-mon[32679]: pgmap v16731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:05.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:05 smithi092 ceph-mon[29156]: 22 slow requests, 0 included below; oldest blocked for > 29882.852627 secs 2024-04-27T02:48:05.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:05 smithi092 ceph-mon[29156]: pgmap v16731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:05.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:05 smithi189 ceph-mon[32756]: 22 slow requests, 0 included below; oldest blocked for > 29882.852627 secs 2024-04-27T02:48:05.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:05 smithi189 ceph-mon[32756]: pgmap v16731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:07.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:07 smithi156 ceph-mon[32679]: pgmap v16732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:07.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:07 smithi092 ceph-mon[29156]: pgmap v16732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:07.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:07 smithi189 ceph-mon[32756]: pgmap v16732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:09.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:09 smithi156 ceph-mon[32679]: pgmap v16733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:09.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30584.885017 secs 2024-04-27T02:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:09 smithi092 ceph-mon[29156]: pgmap v16733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:09.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30584.885017 secs 2024-04-27T02:48:09.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:09 smithi189 ceph-mon[32756]: pgmap v16733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:09.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30584.885017 secs 2024-04-27T02:48:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:10 smithi156 ceph-mon[32679]: 23 slow requests, 1 included below; oldest blocked for > 29887.852700 secs 2024-04-27T02:48:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:10 smithi156 ceph-mon[32679]: slow request 180.013666 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:48:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:48:10.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:10 smithi092 ceph-mon[29156]: 23 slow requests, 1 included below; oldest blocked for > 29887.852700 secs 2024-04-27T02:48:10.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:10 smithi092 ceph-mon[29156]: slow request 180.013666 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:48:10.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:48:10.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:10 smithi189 ceph-mon[32756]: 23 slow requests, 1 included below; oldest blocked for > 29887.852700 secs 2024-04-27T02:48:10.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:10 smithi189 ceph-mon[32756]: slow request 180.013666 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:48:10.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:48:11.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:11 smithi156 ceph-mon[32679]: pgmap v16734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:11.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:48:11.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:48:11.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:48:11.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:11 smithi092 ceph-mon[29156]: pgmap v16734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:11.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:48:11.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:48:11.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:48:11.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:11 smithi189 ceph-mon[32756]: pgmap v16734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:11.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:48:11.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:48:11.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:48:12.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:12 smithi092 ceph-mon[29156]: pgmap v16735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:48:12.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:12 smithi092 ceph-mon[29156]: pgmap v16736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:12.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:12 smithi189 ceph-mon[32756]: pgmap v16735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:48:12.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:12 smithi189 ceph-mon[32756]: pgmap v16736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:12.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:12 smithi156 ceph-mon[32679]: pgmap v16735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:48:12.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:12 smithi156 ceph-mon[32679]: pgmap v16736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:14 smithi092 ceph-mon[29156]: pgmap v16737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:48:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:14 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:48:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:14 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:48:14.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30589.885115 secs 2024-04-27T02:48:14.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:14 smithi189 ceph-mon[32756]: pgmap v16737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:48:14.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:14 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:48:14.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:14 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:48:14.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30589.885115 secs 2024-04-27T02:48:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:14 smithi156 ceph-mon[32679]: pgmap v16737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:48:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:14 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:48:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:14 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:48:14.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30589.885115 secs 2024-04-27T02:48:15.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29892.852820 secs 2024-04-27T02:48:15.629 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29892.852820 secs 2024-04-27T02:48:15.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29892.852820 secs 2024-04-27T02:48:16.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:16 smithi092 ceph-mon[29156]: pgmap v16738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:16.630 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:16 smithi189 ceph-mon[32756]: pgmap v16738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:16.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:16 smithi156 ceph-mon[32679]: pgmap v16738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:17.735 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:17 smithi092 ceph-mon[29156]: pgmap v16739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:17.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:17 smithi189 ceph-mon[32756]: pgmap v16739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:17.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:17 smithi156 ceph-mon[32679]: pgmap v16739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:20.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:19 smithi189 ceph-mon[32756]: pgmap v16740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:20.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30594.885232 secs 2024-04-27T02:48:20.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:19 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29897.852934 secs 2024-04-27T02:48:20.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:19 smithi156 ceph-mon[32679]: pgmap v16740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:20.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30594.885232 secs 2024-04-27T02:48:20.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:19 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29897.852934 secs 2024-04-27T02:48:20.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:19 smithi092 ceph-mon[29156]: pgmap v16740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:48:20.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30594.885232 secs 2024-04-27T02:48:20.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:19 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29897.852934 secs 2024-04-27T02:48:22.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:21 smithi189 ceph-mon[32756]: pgmap v16741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:48:22.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:21 smithi156 ceph-mon[32679]: pgmap v16741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:48:22.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:21 smithi092 ceph-mon[29156]: pgmap v16741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:48:24.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:23 smithi189 ceph-mon[32756]: pgmap v16742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:24.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:23 smithi156 ceph-mon[32679]: pgmap v16742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:24.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:23 smithi092 ceph-mon[29156]: pgmap v16742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:25.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30599.885303 secs 2024-04-27T02:48:25.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:24 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29902.853039 secs 2024-04-27T02:48:25.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30599.885303 secs 2024-04-27T02:48:25.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:24 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29902.853039 secs 2024-04-27T02:48:25.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30599.885303 secs 2024-04-27T02:48:25.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:24 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29902.853039 secs 2024-04-27T02:48:26.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:25 smithi189 ceph-mon[32756]: pgmap v16743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:26.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:25 smithi156 ceph-mon[32679]: pgmap v16743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:26.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:25 smithi092 ceph-mon[29156]: pgmap v16743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:28.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:27 smithi189 ceph-mon[32756]: pgmap v16744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:28.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:27 smithi156 ceph-mon[32679]: pgmap v16744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:28.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:27 smithi092 ceph-mon[29156]: pgmap v16744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:30.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:29 smithi189 ceph-mon[32756]: pgmap v16745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:30.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30604.885387 secs 2024-04-27T02:48:30.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:29 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29907.853149 secs 2024-04-27T02:48:30.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:29 smithi156 ceph-mon[32679]: pgmap v16745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:30.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30604.885387 secs 2024-04-27T02:48:30.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:29 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29907.853149 secs 2024-04-27T02:48:30.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:29 smithi092 ceph-mon[29156]: pgmap v16745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:30.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30604.885387 secs 2024-04-27T02:48:30.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:29 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29907.853149 secs 2024-04-27T02:48:32.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:31 smithi189 ceph-mon[32756]: pgmap v16746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:32.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:31 smithi156 ceph-mon[32679]: pgmap v16746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:32.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:31 smithi092 ceph-mon[29156]: pgmap v16746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:34.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:33 smithi189 ceph-mon[32756]: pgmap v16747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:34.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:33 smithi156 ceph-mon[32679]: pgmap v16747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:34.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:33 smithi092 ceph-mon[29156]: pgmap v16747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:35.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30609.885505 secs 2024-04-27T02:48:35.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:34 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29912.853286 secs 2024-04-27T02:48:35.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30609.885505 secs 2024-04-27T02:48:35.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:34 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29912.853286 secs 2024-04-27T02:48:35.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30609.885505 secs 2024-04-27T02:48:35.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:34 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29912.853286 secs 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900002703) for more than 900000000 us, fault. 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f1ca808a0d0 tx=0x7f1ca80d9000 comp rx=0 tx=0).stop 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T02:48:36.032 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.039+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:48:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.040+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca80d5000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T02:48:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.084+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T02:48:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.084+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T02:48:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.084+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T02:48:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.084+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=32 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T02:48:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.084+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T02:48:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T02:48:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:36.085+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T02:48:36.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:35 smithi189 ceph-mon[32756]: pgmap v16748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:36.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:35 smithi156 ceph-mon[32679]: pgmap v16748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:36.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:35 smithi092 ceph-mon[29156]: pgmap v16748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:38.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:37 smithi189 ceph-mon[32756]: pgmap v16749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:38.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:37 smithi156 ceph-mon[32679]: pgmap v16749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:38.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:37 smithi092 ceph-mon[29156]: pgmap v16749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:48:39.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:38 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30614.885602 secs 2024-04-27T02:48:39.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:38 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30614.885602 secs 2024-04-27T02:48:39.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:38 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30614.885602 secs 2024-04-27T02:48:40.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:39 smithi189 ceph-mon[32756]: pgmap v16750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:40.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:39 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29917.853334 secs 2024-04-27T02:48:40.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:39 smithi156 ceph-mon[32679]: pgmap v16750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:40.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:39 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29917.853334 secs 2024-04-27T02:48:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:40.184+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:48:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:40.184+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:48:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:40.184+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:48:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:48:40.184+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 236 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:48:40.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:39 smithi092 ceph-mon[29156]: pgmap v16750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:48:40.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:39 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29917.853334 secs 2024-04-27T02:48:42.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:41 smithi189 ceph-mon[32756]: pgmap v16751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:42.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:41 smithi156 ceph-mon[32679]: pgmap v16751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:42.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:41 smithi092 ceph-mon[29156]: pgmap v16751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:44.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:43 smithi189 ceph-mon[32756]: pgmap v16752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:44.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:43 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30619.885748 secs 2024-04-27T02:48:44.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:43 smithi156 ceph-mon[32679]: pgmap v16752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:44.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:43 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30619.885748 secs 2024-04-27T02:48:44.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:43 smithi092 ceph-mon[29156]: pgmap v16752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:44.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:43 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30619.885748 secs 2024-04-27T02:48:45.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:44 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29922.853423 secs 2024-04-27T02:48:45.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:44 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29922.853423 secs 2024-04-27T02:48:45.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:44 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29922.853423 secs 2024-04-27T02:48:46.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:45 smithi189 ceph-mon[32756]: pgmap v16753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:46.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:45 smithi156 ceph-mon[32679]: pgmap v16753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:46.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:45 smithi092 ceph-mon[29156]: pgmap v16753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:48.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:47 smithi189 ceph-mon[32756]: pgmap v16754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:48.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:47 smithi156 ceph-mon[32679]: pgmap v16754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:48.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:47 smithi092 ceph-mon[29156]: pgmap v16754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:49.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:48 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30624.885853 secs 2024-04-27T02:48:49.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:48 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30624.885853 secs 2024-04-27T02:48:49.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:48 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30624.885853 secs 2024-04-27T02:48:49.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:49 smithi092 ceph-mon[29156]: pgmap v16755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:49.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:49 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29927.853491 secs 2024-04-27T02:48:50.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:49 smithi156 ceph-mon[32679]: pgmap v16755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:50.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:49 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29927.853491 secs 2024-04-27T02:48:50.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:49 smithi189 ceph-mon[32756]: pgmap v16755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:50.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:49 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29927.853491 secs 2024-04-27T02:48:52.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:51 smithi156 ceph-mon[32679]: pgmap v16756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:52.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:51 smithi092 ceph-mon[29156]: pgmap v16756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:52.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:51 smithi189 ceph-mon[32756]: pgmap v16756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:54.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:53 smithi156 ceph-mon[32679]: pgmap v16757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:54.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:53 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30629.885908 secs 2024-04-27T02:48:54.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:53 smithi092 ceph-mon[29156]: pgmap v16757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:54.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:53 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30629.885908 secs 2024-04-27T02:48:54.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:53 smithi189 ceph-mon[32756]: pgmap v16757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:54.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:53 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30629.885908 secs 2024-04-27T02:48:55.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:54 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29932.853585 secs 2024-04-27T02:48:55.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:54 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29932.853585 secs 2024-04-27T02:48:55.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:54 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29932.853585 secs 2024-04-27T02:48:56.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:55 smithi156 ceph-mon[32679]: pgmap v16758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:56.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:55 smithi092 ceph-mon[29156]: pgmap v16758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:56.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:55 smithi189 ceph-mon[32756]: pgmap v16758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:48:58.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:57 smithi156 ceph-mon[32679]: pgmap v16759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:58.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:57 smithi092 ceph-mon[29156]: pgmap v16759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:58.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:57 smithi189 ceph-mon[32756]: pgmap v16759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:48:59.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:58 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30634.886025 secs 2024-04-27T02:48:59.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:58 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30634.886025 secs 2024-04-27T02:48:59.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:58 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30634.886025 secs 2024-04-27T02:49:00.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:59 smithi156 ceph-mon[32679]: pgmap v16760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:00.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:48:59 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29937.853702 secs 2024-04-27T02:49:00.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:59 smithi092 ceph-mon[29156]: pgmap v16760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:00.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:48:59 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29937.853702 secs 2024-04-27T02:49:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:59 smithi189 ceph-mon[32756]: pgmap v16760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:48:59 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29937.853702 secs 2024-04-27T02:49:02.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:01 smithi156 ceph-mon[32679]: pgmap v16761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:02.182 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:01 smithi189 ceph-mon[32756]: pgmap v16761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:02.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:01 smithi092 ceph-mon[29156]: pgmap v16761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:04.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:03 smithi156 ceph-mon[32679]: pgmap v16762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:04.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:03 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30639.886151 secs 2024-04-27T02:49:04.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:03 smithi092 ceph-mon[29156]: pgmap v16762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:04.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:03 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30639.886151 secs 2024-04-27T02:49:04.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:03 smithi189 ceph-mon[32756]: pgmap v16762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:04.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:03 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30639.886151 secs 2024-04-27T02:49:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:04 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29942.853782 secs 2024-04-27T02:49:05.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:04 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29942.853782 secs 2024-04-27T02:49:05.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:04 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29942.853782 secs 2024-04-27T02:49:06.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:05 smithi092 ceph-mon[29156]: pgmap v16763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:06.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:05 smithi189 ceph-mon[32756]: pgmap v16763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:06.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:05 smithi156 ceph-mon[32679]: pgmap v16763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:08.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:07 smithi092 ceph-mon[29156]: pgmap v16764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:08.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:07 smithi189 ceph-mon[32756]: pgmap v16764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:08.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:07 smithi156 ceph-mon[32679]: pgmap v16764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:09.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:08 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30644.886235 secs 2024-04-27T02:49:09.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:08 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30644.886235 secs 2024-04-27T02:49:09.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:08 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30644.886235 secs 2024-04-27T02:49:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:09 smithi092 ceph-mon[29156]: pgmap v16765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:09 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29947.853901 secs 2024-04-27T02:49:10.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:09 smithi189 ceph-mon[32756]: pgmap v16765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:10.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:09 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29947.853901 secs 2024-04-27T02:49:10.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:09 smithi156 ceph-mon[32679]: pgmap v16765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:10.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:09 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29947.853901 secs 2024-04-27T02:49:11.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:49:11.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:49:11.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:49:12.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:11 smithi092 ceph-mon[29156]: pgmap v16766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:12.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:49:12.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:49:12.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:49:12.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:11 smithi189 ceph-mon[32756]: pgmap v16766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:12.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:49:12.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:49:12.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:49:12.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:11 smithi156 ceph-mon[32679]: pgmap v16766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:12.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:49:12.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:49:12.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:49:13.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:12 smithi092 ceph-mon[29156]: pgmap v16767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:49:13.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:12 smithi092 ceph-mon[29156]: pgmap v16768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:13.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:12 smithi189 ceph-mon[32756]: pgmap v16767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:49:13.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:12 smithi189 ceph-mon[32756]: pgmap v16768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:13.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:12 smithi156 ceph-mon[32679]: pgmap v16767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:49:13.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:12 smithi156 ceph-mon[32679]: pgmap v16768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:14.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:13 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30649.886344 secs 2024-04-27T02:49:14.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:13 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30649.886344 secs 2024-04-27T02:49:14.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:13 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30649.886344 secs 2024-04-27T02:49:15.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:14 smithi092 ceph-mon[29156]: pgmap v16769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:49:15.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:14 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29952.854008 secs 2024-04-27T02:49:15.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:14 smithi189 ceph-mon[32756]: pgmap v16769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:49:15.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:14 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29952.854008 secs 2024-04-27T02:49:15.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:14 smithi156 ceph-mon[32679]: pgmap v16769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:49:15.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:14 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29952.854008 secs 2024-04-27T02:49:17.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:16 smithi092 ceph-mon[29156]: pgmap v16770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:17.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:16 smithi189 ceph-mon[32756]: pgmap v16770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:17.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:16 smithi156 ceph-mon[32679]: pgmap v16770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:19.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:18 smithi092 ceph-mon[29156]: pgmap v16771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:49:19.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:18 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30654.886458 secs 2024-04-27T02:49:19.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:18 smithi189 ceph-mon[32756]: pgmap v16771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:49:19.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:18 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30654.886458 secs 2024-04-27T02:49:19.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:18 smithi156 ceph-mon[32679]: pgmap v16771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:49:19.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:18 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30654.886458 secs 2024-04-27T02:49:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:19 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29957.854132 secs 2024-04-27T02:49:20.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:19 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29957.854132 secs 2024-04-27T02:49:20.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:19 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29957.854132 secs 2024-04-27T02:49:21.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:20 smithi092 ceph-mon[29156]: pgmap v16772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:21.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:20 smithi189 ceph-mon[32756]: pgmap v16772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:21.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:20 smithi156 ceph-mon[32679]: pgmap v16772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:49:23.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:22 smithi092 ceph-mon[29156]: pgmap v16773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:49:23.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:22 smithi189 ceph-mon[32756]: pgmap v16773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:49:23.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:22 smithi156 ceph-mon[32679]: pgmap v16773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:49:24.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:23 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30659.886575 secs 2024-04-27T02:49:24.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:23 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30659.886575 secs 2024-04-27T02:49:24.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:23 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30659.886575 secs 2024-04-27T02:49:25.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:24 smithi092 ceph-mon[29156]: pgmap v16774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:25.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:24 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29962.854273 secs 2024-04-27T02:49:25.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:24 smithi189 ceph-mon[32756]: pgmap v16774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:25.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:24 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29962.854273 secs 2024-04-27T02:49:25.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:24 smithi156 ceph-mon[32679]: pgmap v16774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:25.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:24 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29962.854273 secs 2024-04-27T02:49:27.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:26 smithi092 ceph-mon[29156]: pgmap v16775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:27.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:26 smithi189 ceph-mon[32756]: pgmap v16775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:27.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:26 smithi156 ceph-mon[32679]: pgmap v16775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:29.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:28 smithi189 ceph-mon[32756]: pgmap v16776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:29.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:28 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30664.886698 secs 2024-04-27T02:49:29.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:28 smithi156 ceph-mon[32679]: pgmap v16776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:29.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:28 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30664.886698 secs 2024-04-27T02:49:29.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:28 smithi092 ceph-mon[29156]: pgmap v16776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:29.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:28 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30664.886698 secs 2024-04-27T02:49:30.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29967.854345 secs 2024-04-27T02:49:30.388 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29967.854345 secs 2024-04-27T02:49:30.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29967.854345 secs 2024-04-27T02:49:31.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:31 smithi189 ceph-mon[32756]: pgmap v16777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:31.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:31 smithi156 ceph-mon[32679]: pgmap v16777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:31.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:31 smithi092 ceph-mon[29156]: pgmap v16777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:33.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:33 smithi189 ceph-mon[32756]: pgmap v16778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:33.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:33 smithi156 ceph-mon[32679]: pgmap v16778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:33.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:33 smithi092 ceph-mon[29156]: pgmap v16778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:34.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30669.886838 secs 2024-04-27T02:49:34.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30669.886838 secs 2024-04-27T02:49:34.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30669.886838 secs 2024-04-27T02:49:35.328 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:35 smithi156 ceph-mon[32679]: pgmap v16779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:35.329 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29972.854469 secs 2024-04-27T02:49:35.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:35 smithi189 ceph-mon[32756]: pgmap v16779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:35.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29972.854469 secs 2024-04-27T02:49:35.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:35 smithi092 ceph-mon[29156]: pgmap v16779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:35.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29972.854469 secs 2024-04-27T02:49:37.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:37 smithi189 ceph-mon[32756]: pgmap v16780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:37.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:37 smithi156 ceph-mon[32679]: pgmap v16780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:37.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:37 smithi092 ceph-mon[29156]: pgmap v16780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:39.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:39 smithi189 ceph-mon[32756]: pgmap v16781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:39.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30674.886955 secs 2024-04-27T02:49:39.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:39 smithi156 ceph-mon[32679]: pgmap v16781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:39.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30674.886955 secs 2024-04-27T02:49:39.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:39 smithi092 ceph-mon[29156]: pgmap v16781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:39.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30674.886955 secs 2024-04-27T02:49:40.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29977.854553 secs 2024-04-27T02:49:40.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29977.854553 secs 2024-04-27T02:49:40.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29977.854553 secs 2024-04-27T02:49:41.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:41 smithi189 ceph-mon[32756]: pgmap v16782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:41.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:41 smithi156 ceph-mon[32679]: pgmap v16782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:41.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:41 smithi092 ceph-mon[29156]: pgmap v16782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:43.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:43 smithi189 ceph-mon[32756]: pgmap v16783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:43.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:43 smithi156 ceph-mon[32679]: pgmap v16783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:43.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:43 smithi092 ceph-mon[29156]: pgmap v16783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:44.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30679.887072 secs 2024-04-27T02:49:44.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30679.887072 secs 2024-04-27T02:49:44.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30679.887072 secs 2024-04-27T02:49:45.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:45 smithi189 ceph-mon[32756]: pgmap v16784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:45.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29982.854686 secs 2024-04-27T02:49:45.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:45 smithi156 ceph-mon[32679]: pgmap v16784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:45.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29982.854686 secs 2024-04-27T02:49:45.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:45 smithi092 ceph-mon[29156]: pgmap v16784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:45.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29982.854686 secs 2024-04-27T02:49:47.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:47 smithi189 ceph-mon[32756]: pgmap v16785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:47.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:47 smithi156 ceph-mon[32679]: pgmap v16785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:47.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:47 smithi092 ceph-mon[29156]: pgmap v16785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:49.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:49 smithi189 ceph-mon[32756]: pgmap v16786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:49.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30684.887167 secs 2024-04-27T02:49:49.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:49 smithi156 ceph-mon[32679]: pgmap v16786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:49.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30684.887167 secs 2024-04-27T02:49:49.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:49 smithi092 ceph-mon[29156]: pgmap v16786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:49.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30684.887167 secs 2024-04-27T02:49:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29987.854839 secs 2024-04-27T02:49:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29987.854839 secs 2024-04-27T02:49:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29987.854839 secs 2024-04-27T02:49:51.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:51 smithi189 ceph-mon[32756]: pgmap v16787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:51.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:51 smithi156 ceph-mon[32679]: pgmap v16787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:51.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:51 smithi092 ceph-mon[29156]: pgmap v16787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:53.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:53 smithi189 ceph-mon[32756]: pgmap v16788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:53.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:53 smithi156 ceph-mon[32679]: pgmap v16788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:53.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:53 smithi092 ceph-mon[29156]: pgmap v16788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:54.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30689.887285 secs 2024-04-27T02:49:54.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30689.887285 secs 2024-04-27T02:49:54.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30689.887285 secs 2024-04-27T02:49:55.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:55 smithi189 ceph-mon[32756]: pgmap v16789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:55.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29992.854951 secs 2024-04-27T02:49:55.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:55 smithi156 ceph-mon[32679]: pgmap v16789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:55.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29992.854951 secs 2024-04-27T02:49:55.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:55 smithi092 ceph-mon[29156]: pgmap v16789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:49:55.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29992.854951 secs 2024-04-27T02:49:57.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:57 smithi189 ceph-mon[32756]: pgmap v16790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:57.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:57 smithi156 ceph-mon[32679]: pgmap v16790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:57.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:57 smithi092 ceph-mon[29156]: pgmap v16790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:59.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:59 smithi189 ceph-mon[32756]: pgmap v16791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:59.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:49:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30694.887383 secs 2024-04-27T02:49:59.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:59 smithi156 ceph-mon[32679]: pgmap v16791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:59.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:49:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30694.887383 secs 2024-04-27T02:49:59.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:59 smithi092 ceph-mon[29156]: pgmap v16791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:49:59.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:49:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30694.887383 secs 2024-04-27T02:50:00.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 29997.855070 secs 2024-04-27T02:50:00.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:50:00.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 29997.855070 secs 2024-04-27T02:50:00.389 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:50:00.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 29997.855070 secs 2024-04-27T02:50:00.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T02:50:01.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:01 smithi189 ceph-mon[32756]: pgmap v16792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:01.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:01 smithi156 ceph-mon[32679]: pgmap v16792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:01.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:01 smithi092 ceph-mon[29156]: pgmap v16792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:03.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:03 smithi189 ceph-mon[32756]: pgmap v16793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:03.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:03 smithi156 ceph-mon[32679]: pgmap v16793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:03.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:03 smithi092 ceph-mon[29156]: pgmap v16793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:04.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30699.887493 secs 2024-04-27T02:50:04.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30699.887493 secs 2024-04-27T02:50:04.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30699.887493 secs 2024-04-27T02:50:05.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:05 smithi189 ceph-mon[32756]: pgmap v16794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:05.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30002.855169 secs 2024-04-27T02:50:05.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:05 smithi156 ceph-mon[32679]: pgmap v16794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:05.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30002.855169 secs 2024-04-27T02:50:05.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:05 smithi092 ceph-mon[29156]: pgmap v16794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:05.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30002.855169 secs 2024-04-27T02:50:07.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:07 smithi189 ceph-mon[32756]: pgmap v16795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:07.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:07 smithi156 ceph-mon[32679]: pgmap v16795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:07.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:07 smithi092 ceph-mon[29156]: pgmap v16795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:09.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:09 smithi189 ceph-mon[32756]: pgmap v16796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:09.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30704.887601 secs 2024-04-27T02:50:09.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:09 smithi156 ceph-mon[32679]: pgmap v16796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:09.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30704.887601 secs 2024-04-27T02:50:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-mon[29156]: pgmap v16796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:09.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30704.887601 secs 2024-04-27T02:50:09.488 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:50:09.029+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:50:09.488 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:50:09.029+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:50:09.488 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:50:09.029+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:50:09.489 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:50:09.029+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:50:09.489 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:50:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:50:09.029+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:50:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:50:10.197+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:50:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:50:10.197+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:50:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:50:10.198+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:50:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:50:10.198+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 237 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:50:10.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30007.855340 secs 2024-04-27T02:50:10.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30007.855340 secs 2024-04-27T02:50:10.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30007.855340 secs 2024-04-27T02:50:11.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:11 smithi189 ceph-mon[32756]: pgmap v16797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:11.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:11 smithi156 ceph-mon[32679]: pgmap v16797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:11.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:11 smithi092 ceph-mon[29156]: pgmap v16797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:12.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:50:12.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:50:12.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:50:13.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: pgmap v16798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:13.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:50:13.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:50:13.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: pgmap v16799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:50:13.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: pgmap v16800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:50:13.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: pgmap v16798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: pgmap v16799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: pgmap v16800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:50:13.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: pgmap v16798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: pgmap v16799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: pgmap v16800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:50:13.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:50:14.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30709.887696 secs 2024-04-27T02:50:14.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30709.887696 secs 2024-04-27T02:50:14.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30709.887696 secs 2024-04-27T02:50:15.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30012.855385 secs 2024-04-27T02:50:15.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:15 smithi189 ceph-mon[32756]: pgmap v16801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:15.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30012.855385 secs 2024-04-27T02:50:15.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:15 smithi156 ceph-mon[32679]: pgmap v16801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:15.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30012.855385 secs 2024-04-27T02:50:15.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:15 smithi092 ceph-mon[29156]: pgmap v16801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:16.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:16 smithi092 ceph-mon[29156]: pgmap v16802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:16.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:16 smithi189 ceph-mon[32756]: pgmap v16802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:16.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:16 smithi156 ceph-mon[32679]: pgmap v16802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:18.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:18 smithi092 ceph-mon[29156]: pgmap v16803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T02:50:18.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:18 smithi189 ceph-mon[32756]: pgmap v16803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T02:50:18.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:18 smithi156 ceph-mon[32679]: pgmap v16803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T02:50:19.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30714.887793 secs 2024-04-27T02:50:19.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30714.887793 secs 2024-04-27T02:50:19.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30714.887793 secs 2024-04-27T02:50:20.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30017.855503 secs 2024-04-27T02:50:20.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:20 smithi092 ceph-mon[29156]: pgmap v16804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:20.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30017.855503 secs 2024-04-27T02:50:20.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:20 smithi189 ceph-mon[32756]: pgmap v16804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:20.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30017.855503 secs 2024-04-27T02:50:20.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:20 smithi156 ceph-mon[32679]: pgmap v16804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T02:50:22.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:22 smithi092 ceph-mon[29156]: pgmap v16805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:50:22.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:22 smithi189 ceph-mon[32756]: pgmap v16805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:50:22.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:22 smithi156 ceph-mon[32679]: pgmap v16805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T02:50:24.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:23 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30719.887910 secs 2024-04-27T02:50:24.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:23 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30719.887910 secs 2024-04-27T02:50:24.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:23 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30719.887910 secs 2024-04-27T02:50:25.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:24 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30022.855589 secs 2024-04-27T02:50:25.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:24 smithi156 ceph-mon[32679]: pgmap v16806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:50:25.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:24 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30022.855589 secs 2024-04-27T02:50:25.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:24 smithi092 ceph-mon[29156]: pgmap v16806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:50:25.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:24 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30022.855589 secs 2024-04-27T02:50:25.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:24 smithi189 ceph-mon[32756]: pgmap v16806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T02:50:26.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:26 smithi092 ceph-mon[29156]: pgmap v16807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:26.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:26 smithi189 ceph-mon[32756]: pgmap v16807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:26.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:26 smithi156 ceph-mon[32679]: pgmap v16807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:28.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:28 smithi092 ceph-mon[29156]: pgmap v16808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:28.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:28 smithi189 ceph-mon[32756]: pgmap v16808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:28.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:28 smithi156 ceph-mon[32679]: pgmap v16808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:29.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30724.888028 secs 2024-04-27T02:50:29.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30724.888028 secs 2024-04-27T02:50:29.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30724.888028 secs 2024-04-27T02:50:30.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30027.855705 secs 2024-04-27T02:50:30.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:30 smithi092 ceph-mon[29156]: pgmap v16809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:30.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30027.855705 secs 2024-04-27T02:50:30.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:30 smithi189 ceph-mon[32756]: pgmap v16809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:30.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30027.855705 secs 2024-04-27T02:50:30.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:30 smithi156 ceph-mon[32679]: pgmap v16809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:32.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:32 smithi092 ceph-mon[29156]: pgmap v16810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:32.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:32 smithi189 ceph-mon[32756]: pgmap v16810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:32.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:32 smithi156 ceph-mon[32679]: pgmap v16810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:34.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:33 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30729.888134 secs 2024-04-27T02:50:34.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:33 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30729.888134 secs 2024-04-27T02:50:34.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:33 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30729.888134 secs 2024-04-27T02:50:35.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:34 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30032.855819 secs 2024-04-27T02:50:35.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:34 smithi156 ceph-mon[32679]: pgmap v16811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:35.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:34 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30032.855819 secs 2024-04-27T02:50:35.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:34 smithi092 ceph-mon[29156]: pgmap v16811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:35.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:34 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30032.855819 secs 2024-04-27T02:50:35.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:34 smithi189 ceph-mon[32756]: pgmap v16811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:36.679 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:36 smithi156 ceph-mon[32679]: pgmap v16812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:36.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:36 smithi092 ceph-mon[29156]: pgmap v16812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:36.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:36 smithi189 ceph-mon[32756]: pgmap v16812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:38.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:38 smithi092 ceph-mon[29156]: pgmap v16813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:38.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:38 smithi189 ceph-mon[32756]: pgmap v16813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:38.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:38 smithi156 ceph-mon[32679]: pgmap v16813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:39.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30734.888255 secs 2024-04-27T02:50:39.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30734.888255 secs 2024-04-27T02:50:39.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30734.888255 secs 2024-04-27T02:50:40.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30037.855889 secs 2024-04-27T02:50:40.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:40 smithi092 ceph-mon[29156]: pgmap v16814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:40.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30037.855889 secs 2024-04-27T02:50:40.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:40 smithi189 ceph-mon[32756]: pgmap v16814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:40.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30037.855889 secs 2024-04-27T02:50:40.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:40 smithi156 ceph-mon[32679]: pgmap v16814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:42.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:42 smithi092 ceph-mon[29156]: pgmap v16815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:42.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:42 smithi189 ceph-mon[32756]: pgmap v16815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:42.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:42 smithi156 ceph-mon[32679]: pgmap v16815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:44.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:43 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30739.888369 secs 2024-04-27T02:50:44.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:43 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30739.888369 secs 2024-04-27T02:50:44.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:43 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30739.888369 secs 2024-04-27T02:50:45.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:44 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30042.855986 secs 2024-04-27T02:50:45.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:44 smithi156 ceph-mon[32679]: pgmap v16816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:45.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:44 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30042.855986 secs 2024-04-27T02:50:45.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:44 smithi092 ceph-mon[29156]: pgmap v16816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:45.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:44 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30042.855986 secs 2024-04-27T02:50:45.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:44 smithi189 ceph-mon[32756]: pgmap v16816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:46.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:46 smithi092 ceph-mon[29156]: pgmap v16817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:46.788 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:46 smithi156 ceph-mon[32679]: pgmap v16817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:46.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:46 smithi189 ceph-mon[32756]: pgmap v16817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:48.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:48 smithi092 ceph-mon[29156]: pgmap v16818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:48.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:48 smithi189 ceph-mon[32756]: pgmap v16818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:48.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:48 smithi156 ceph-mon[32679]: pgmap v16818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:49.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30744.888484 secs 2024-04-27T02:50:49.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30744.888484 secs 2024-04-27T02:50:49.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30744.888484 secs 2024-04-27T02:50:50.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30047.856111 secs 2024-04-27T02:50:50.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:50 smithi092 ceph-mon[29156]: pgmap v16819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:50.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30047.856111 secs 2024-04-27T02:50:50.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:50 smithi189 ceph-mon[32756]: pgmap v16819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:50.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30047.856111 secs 2024-04-27T02:50:50.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:50 smithi156 ceph-mon[32679]: pgmap v16819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:52.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:52 smithi092 ceph-mon[29156]: pgmap v16820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:52.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:52 smithi189 ceph-mon[32756]: pgmap v16820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:52.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:52 smithi156 ceph-mon[32679]: pgmap v16820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:54.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:53 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30749.888594 secs 2024-04-27T02:50:54.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:53 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30749.888594 secs 2024-04-27T02:50:54.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:53 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30749.888594 secs 2024-04-27T02:50:55.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:54 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30052.856188 secs 2024-04-27T02:50:55.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:54 smithi092 ceph-mon[29156]: pgmap v16821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:55.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:54 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30052.856188 secs 2024-04-27T02:50:55.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:54 smithi189 ceph-mon[32756]: pgmap v16821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:55.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:54 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30052.856188 secs 2024-04-27T02:50:55.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:54 smithi156 ceph-mon[32679]: pgmap v16821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:50:56.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:56 smithi092 ceph-mon[29156]: pgmap v16822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:56.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:56 smithi189 ceph-mon[32756]: pgmap v16822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:56.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:56 smithi156 ceph-mon[32679]: pgmap v16822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:58.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:58 smithi092 ceph-mon[29156]: pgmap v16823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:58.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:58 smithi189 ceph-mon[32756]: pgmap v16823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:58.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:58 smithi156 ceph-mon[32679]: pgmap v16823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:50:59.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:50:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30754.888708 secs 2024-04-27T02:50:59.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:50:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30754.888708 secs 2024-04-27T02:50:59.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:50:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30754.888708 secs 2024-04-27T02:51:00.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30057.856346 secs 2024-04-27T02:51:00.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:00 smithi092 ceph-mon[29156]: pgmap v16824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:00.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30057.856346 secs 2024-04-27T02:51:00.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:00 smithi189 ceph-mon[32756]: pgmap v16824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:00.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30057.856346 secs 2024-04-27T02:51:00.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:00 smithi156 ceph-mon[32679]: pgmap v16824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:02.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:02 smithi092 ceph-mon[29156]: pgmap v16825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:02.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:02 smithi189 ceph-mon[32756]: pgmap v16825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:02.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:02 smithi156 ceph-mon[32679]: pgmap v16825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:04.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:03 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30759.888839 secs 2024-04-27T02:51:04.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:03 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30759.888839 secs 2024-04-27T02:51:04.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:03 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30759.888839 secs 2024-04-27T02:51:05.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:04 smithi156 ceph-mon[32679]: 23 slow requests, 1 included below; oldest blocked for > 30062.856459 secs 2024-04-27T02:51:05.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:04 smithi156 ceph-mon[32679]: slow request 23041.069124 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:05.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:04 smithi156 ceph-mon[32679]: pgmap v16826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:05.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:04 smithi092 ceph-mon[29156]: 23 slow requests, 1 included below; oldest blocked for > 30062.856459 secs 2024-04-27T02:51:05.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:04 smithi092 ceph-mon[29156]: slow request 23041.069124 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:05.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:04 smithi092 ceph-mon[29156]: pgmap v16826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:05.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:04 smithi189 ceph-mon[32756]: 23 slow requests, 1 included below; oldest blocked for > 30062.856459 secs 2024-04-27T02:51:05.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:04 smithi189 ceph-mon[32756]: slow request 23041.069124 seconds old, received at 2024-04-26T20:27:02.933369+0000: client_request(client.16986:1 getattr pAsLsXsFs #0x1 2024-04-26T20:27:02.925969+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:05.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:04 smithi189 ceph-mon[32756]: pgmap v16826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:06.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:06 smithi092 ceph-mon[29156]: pgmap v16827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:06.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:06 smithi189 ceph-mon[32756]: pgmap v16827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:06.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:06 smithi156 ceph-mon[32679]: pgmap v16827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:08.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:08 smithi092 ceph-mon[29156]: pgmap v16828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:08.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:08 smithi189 ceph-mon[32756]: pgmap v16828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:08.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:08 smithi156 ceph-mon[32679]: pgmap v16828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:09.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30764.888935 secs 2024-04-27T02:51:09.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30764.888935 secs 2024-04-27T02:51:09.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30764.888935 secs 2024-04-27T02:51:10.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:10 smithi092 ceph-mon[29156]: 23 slow requests, 1 included below; oldest blocked for > 30067.856569 secs 2024-04-27T02:51:10.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:10 smithi092 ceph-mon[29156]: slow request 360.017534 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:10.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:10 smithi092 ceph-mon[29156]: pgmap v16829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:10.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:10 smithi189 ceph-mon[32756]: 23 slow requests, 1 included below; oldest blocked for > 30067.856569 secs 2024-04-27T02:51:10.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:10 smithi189 ceph-mon[32756]: slow request 360.017534 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:10.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:10 smithi189 ceph-mon[32756]: pgmap v16829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:10.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:10 smithi156 ceph-mon[32679]: 23 slow requests, 1 included below; oldest blocked for > 30067.856569 secs 2024-04-27T02:51:10.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:10 smithi156 ceph-mon[32679]: slow request 360.017534 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:51:10.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:10 smithi156 ceph-mon[32679]: pgmap v16829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:12.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:12 smithi092 ceph-mon[29156]: pgmap v16830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:12.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:12 smithi189 ceph-mon[32756]: pgmap v16830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:12.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:12 smithi156 ceph-mon[32679]: pgmap v16830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:13.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:51:13.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:51:13.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:13.802 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:14.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30769.888999 secs 2024-04-27T02:51:14.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:14 smithi092 ceph-mon[29156]: pgmap v16831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:14.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30769.888999 secs 2024-04-27T02:51:14.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:14 smithi189 ceph-mon[32756]: pgmap v16831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:14.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30769.888999 secs 2024-04-27T02:51:14.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:14 smithi156 ceph-mon[32679]: pgmap v16831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:15.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30072.856640 secs 2024-04-27T02:51:15.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30072.856640 secs 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30072.856640 secs 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:15.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:51:16.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: pgmap v16832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: pgmap v16833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: pgmap v16832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:16.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: pgmap v16833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:16.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: pgmap v16832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: pgmap v16833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:16.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:51:19.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:19 smithi189 ceph-mon[32756]: pgmap v16834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:19.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30774.889107 secs 2024-04-27T02:51:19.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:19 smithi156 ceph-mon[32679]: pgmap v16834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:19.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30774.889107 secs 2024-04-27T02:51:19.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:19 smithi092 ceph-mon[29156]: pgmap v16834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:19.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30774.889107 secs 2024-04-27T02:51:20.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30077.856756 secs 2024-04-27T02:51:20.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30077.856756 secs 2024-04-27T02:51:20.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30077.856756 secs 2024-04-27T02:51:21.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:21 smithi189 ceph-mon[32756]: pgmap v16835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:21.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:21 smithi156 ceph-mon[32679]: pgmap v16835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:21.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:21 smithi092 ceph-mon[29156]: pgmap v16835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:23.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:23 smithi189 ceph-mon[32756]: pgmap v16836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:23.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:23 smithi156 ceph-mon[32679]: pgmap v16836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:23.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:23 smithi092 ceph-mon[29156]: pgmap v16836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:24.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30779.889226 secs 2024-04-27T02:51:24.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30779.889226 secs 2024-04-27T02:51:24.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30779.889226 secs 2024-04-27T02:51:25.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:25 smithi092 ceph-mon[29156]: pgmap v16837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:25.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30082.856878 secs 2024-04-27T02:51:25.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:25 smithi189 ceph-mon[32756]: pgmap v16837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:25.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30082.856878 secs 2024-04-27T02:51:25.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:25 smithi156 ceph-mon[32679]: pgmap v16837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T02:51:25.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30082.856878 secs 2024-04-27T02:51:27.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:27 smithi189 ceph-mon[32756]: pgmap v16838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:51:27.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:27 smithi156 ceph-mon[32679]: pgmap v16838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:51:27.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:27 smithi092 ceph-mon[29156]: pgmap v16838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:51:29.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:29 smithi189 ceph-mon[32756]: pgmap v16839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:29.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30784.889351 secs 2024-04-27T02:51:29.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:29 smithi156 ceph-mon[32679]: pgmap v16839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:29.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30784.889351 secs 2024-04-27T02:51:29.489 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:29 smithi092 ceph-mon[29156]: pgmap v16839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:29.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30784.889351 secs 2024-04-27T02:51:30.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30087.856990 secs 2024-04-27T02:51:30.391 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30087.856990 secs 2024-04-27T02:51:30.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30087.856990 secs 2024-04-27T02:51:31.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:31 smithi189 ceph-mon[32756]: pgmap v16840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:31.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:31 smithi156 ceph-mon[32679]: pgmap v16840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:31.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:31 smithi092 ceph-mon[29156]: pgmap v16840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:33.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:33 smithi189 ceph-mon[32756]: pgmap v16841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:33.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:33 smithi156 ceph-mon[32679]: pgmap v16841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:33.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:33 smithi092 ceph-mon[29156]: pgmap v16841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:34.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30789.889482 secs 2024-04-27T02:51:34.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30789.889482 secs 2024-04-27T02:51:34.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30789.889482 secs 2024-04-27T02:51:35.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:35 smithi156 ceph-mon[32679]: pgmap v16842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:35.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30092.857097 secs 2024-04-27T02:51:35.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:35 smithi189 ceph-mon[32756]: pgmap v16842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:35.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30092.857097 secs 2024-04-27T02:51:35.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:35 smithi092 ceph-mon[29156]: pgmap v16842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:35.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30092.857097 secs 2024-04-27T02:51:37.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:37 smithi189 ceph-mon[32756]: pgmap v16843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:37.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:37 smithi156 ceph-mon[32679]: pgmap v16843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:37.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:37 smithi092 ceph-mon[29156]: pgmap v16843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:39.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:39 smithi189 ceph-mon[32756]: pgmap v16844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:39.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30794.889628 secs 2024-04-27T02:51:39.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:39 smithi156 ceph-mon[32679]: pgmap v16844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:39.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30794.889628 secs 2024-04-27T02:51:39.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:39 smithi092 ceph-mon[29156]: pgmap v16844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:39.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30794.889628 secs 2024-04-27T02:51:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:51:40.209+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:51:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:51:40.209+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:51:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:51:40.209+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:51:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:51:40.209+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 238 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:51:40.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30097.857170 secs 2024-04-27T02:51:40.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30097.857170 secs 2024-04-27T02:51:40.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30097.857170 secs 2024-04-27T02:51:41.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:41 smithi189 ceph-mon[32756]: pgmap v16845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:41.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:41 smithi156 ceph-mon[32679]: pgmap v16845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:41.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:41 smithi092 ceph-mon[29156]: pgmap v16845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:43.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:43 smithi189 ceph-mon[32756]: pgmap v16846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:43.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:43 smithi156 ceph-mon[32679]: pgmap v16846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:43.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:43 smithi092 ceph-mon[29156]: pgmap v16846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:44.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30799.889714 secs 2024-04-27T02:51:44.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30799.889714 secs 2024-04-27T02:51:44.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30799.889714 secs 2024-04-27T02:51:45.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:45 smithi189 ceph-mon[32756]: pgmap v16847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:45.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30102.857274 secs 2024-04-27T02:51:45.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:45 smithi156 ceph-mon[32679]: pgmap v16847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:45.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30102.857274 secs 2024-04-27T02:51:45.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:45 smithi092 ceph-mon[29156]: pgmap v16847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:45.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30102.857274 secs 2024-04-27T02:51:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:47 smithi189 ceph-mon[32756]: pgmap v16848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:47.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:47 smithi156 ceph-mon[32679]: pgmap v16848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:47.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:47 smithi092 ceph-mon[29156]: pgmap v16848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:49.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:49 smithi189 ceph-mon[32756]: pgmap v16849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:49.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30804.889817 secs 2024-04-27T02:51:49.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:49 smithi156 ceph-mon[32679]: pgmap v16849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:49.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30804.889817 secs 2024-04-27T02:51:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:49 smithi092 ceph-mon[29156]: pgmap v16849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:49.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30804.889817 secs 2024-04-27T02:51:50.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30107.857418 secs 2024-04-27T02:51:50.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30107.857418 secs 2024-04-27T02:51:50.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30107.857418 secs 2024-04-27T02:51:51.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:51 smithi189 ceph-mon[32756]: pgmap v16850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:51.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:51 smithi156 ceph-mon[32679]: pgmap v16850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:51.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:51 smithi092 ceph-mon[29156]: pgmap v16850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:51:53.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:53 smithi189 ceph-mon[32756]: pgmap v16851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:53.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:53 smithi156 ceph-mon[32679]: pgmap v16851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:53.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:53 smithi092 ceph-mon[29156]: pgmap v16851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:51:54.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30809.889914 secs 2024-04-27T02:51:54.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30809.889914 secs 2024-04-27T02:51:54.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30809.889914 secs 2024-04-27T02:51:55.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:55 smithi189 ceph-mon[32756]: pgmap v16852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:51:55.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30112.857521 secs 2024-04-27T02:51:55.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:55 smithi156 ceph-mon[32679]: pgmap v16852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:51:55.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30112.857521 secs 2024-04-27T02:51:55.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:55 smithi092 ceph-mon[29156]: pgmap v16852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:51:55.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30112.857521 secs 2024-04-27T02:51:57.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:57 smithi189 ceph-mon[32756]: pgmap v16853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:57.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:57 smithi156 ceph-mon[32679]: pgmap v16853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:57.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:57 smithi092 ceph-mon[29156]: pgmap v16853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:59.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:59 smithi189 ceph-mon[32756]: pgmap v16854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:59.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:51:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30814.890033 secs 2024-04-27T02:51:59.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:59 smithi156 ceph-mon[32679]: pgmap v16854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:59.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:51:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30814.890033 secs 2024-04-27T02:51:59.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:59 smithi092 ceph-mon[29156]: pgmap v16854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:51:59.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:51:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30814.890033 secs 2024-04-27T02:52:00.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30117.857641 secs 2024-04-27T02:52:00.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30117.857641 secs 2024-04-27T02:52:00.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30117.857641 secs 2024-04-27T02:52:01.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:01 smithi156 ceph-mon[32679]: pgmap v16855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:01.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:01 smithi092 ceph-mon[29156]: pgmap v16855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:01.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:01 smithi189 ceph-mon[32756]: pgmap v16855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:03.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:03 smithi156 ceph-mon[32679]: pgmap v16856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:52:03.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:03 smithi092 ceph-mon[29156]: pgmap v16856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:52:03.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:03 smithi189 ceph-mon[32756]: pgmap v16856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:52:04.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30819.890168 secs 2024-04-27T02:52:04.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30819.890168 secs 2024-04-27T02:52:04.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30819.890168 secs 2024-04-27T02:52:05.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:05 smithi156 ceph-mon[32679]: pgmap v16857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:05.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30122.857780 secs 2024-04-27T02:52:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:05 smithi092 ceph-mon[29156]: pgmap v16857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30122.857780 secs 2024-04-27T02:52:05.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:05 smithi189 ceph-mon[32756]: pgmap v16857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:52:05.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30122.857780 secs 2024-04-27T02:52:07.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:07 smithi156 ceph-mon[32679]: pgmap v16858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:07.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:07 smithi092 ceph-mon[29156]: pgmap v16858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:07.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:07 smithi189 ceph-mon[32756]: pgmap v16858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:09.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:09 smithi156 ceph-mon[32679]: pgmap v16859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30824.890287 secs 2024-04-27T02:52:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:09 smithi092 ceph-mon[29156]: pgmap v16859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:09.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30824.890287 secs 2024-04-27T02:52:09.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:09 smithi189 ceph-mon[32756]: pgmap v16859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:09.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30824.890287 secs 2024-04-27T02:52:10.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:10 smithi156 ceph-mon[32679]: 23 slow requests, 1 included below; oldest blocked for > 30127.857930 secs 2024-04-27T02:52:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:10 smithi156 ceph-mon[32679]: slow request 720.116589 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:10.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:10 smithi092 ceph-mon[29156]: 23 slow requests, 1 included below; oldest blocked for > 30127.857930 secs 2024-04-27T02:52:10.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:10 smithi092 ceph-mon[29156]: slow request 720.116589 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:10.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:10 smithi189 ceph-mon[32756]: 23 slow requests, 1 included below; oldest blocked for > 30127.857930 secs 2024-04-27T02:52:10.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:10 smithi189 ceph-mon[32756]: slow request 720.116589 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:11.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:11 smithi156 ceph-mon[32679]: pgmap v16860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:11.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:11 smithi092 ceph-mon[29156]: pgmap v16860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:11.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:11 smithi189 ceph-mon[32756]: pgmap v16860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:13.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:13 smithi156 ceph-mon[32679]: pgmap v16861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:13.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:13 smithi092 ceph-mon[29156]: pgmap v16861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:13.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:13 smithi189 ceph-mon[32756]: pgmap v16861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:14.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30829.890417 secs 2024-04-27T02:52:14.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30829.890417 secs 2024-04-27T02:52:14.634 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30829.890417 secs 2024-04-27T02:52:15.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:15 smithi156 ceph-mon[32679]: pgmap v16862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30132.858030 secs 2024-04-27T02:52:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:15 smithi092 ceph-mon[29156]: pgmap v16862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30132.858030 secs 2024-04-27T02:52:15.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:15 smithi189 ceph-mon[32756]: pgmap v16862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:15.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30132.858030 secs 2024-04-27T02:52:16.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:52:16.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:52:16.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:52:17.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:17 smithi092 ceph-mon[29156]: pgmap v16863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:17.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:52:17.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:52:17.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:52:17.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:17 smithi189 ceph-mon[32756]: pgmap v16863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:17.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:52:17.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:52:17.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:52:17.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:17 smithi156 ceph-mon[32679]: pgmap v16863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:17.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:52:17.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:52:17.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:52:18.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:18 smithi092 ceph-mon[29156]: pgmap v16864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:52:18.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:18 smithi092 ceph-mon[29156]: pgmap v16865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:18.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:18 smithi189 ceph-mon[32756]: pgmap v16864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:52:18.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:18 smithi189 ceph-mon[32756]: pgmap v16865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:18 smithi156 ceph-mon[32679]: pgmap v16864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:52:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:18 smithi156 ceph-mon[32679]: pgmap v16865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:19.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30834.890551 secs 2024-04-27T02:52:19.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30834.890551 secs 2024-04-27T02:52:19.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30834.890551 secs 2024-04-27T02:52:20.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:20 smithi092 ceph-mon[29156]: pgmap v16866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30137.858142 secs 2024-04-27T02:52:20.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:20 smithi189 ceph-mon[32756]: pgmap v16866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:20.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30137.858142 secs 2024-04-27T02:52:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:20 smithi156 ceph-mon[32679]: pgmap v16866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30137.858142 secs 2024-04-27T02:52:22.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:22 smithi092 ceph-mon[29156]: pgmap v16867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:22.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:22 smithi189 ceph-mon[32756]: pgmap v16867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:22.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:22 smithi156 ceph-mon[32679]: pgmap v16867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:24 smithi092 ceph-mon[29156]: pgmap v16868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:52:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30839.890686 secs 2024-04-27T02:52:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:24 smithi189 ceph-mon[32756]: pgmap v16868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:52:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30839.890686 secs 2024-04-27T02:52:24.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:24 smithi156 ceph-mon[32679]: pgmap v16868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:52:24.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30839.890686 secs 2024-04-27T02:52:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30142.858260 secs 2024-04-27T02:52:25.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30142.858260 secs 2024-04-27T02:52:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30142.858260 secs 2024-04-27T02:52:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:26 smithi092 ceph-mon[29156]: pgmap v16869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:26.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:26 smithi189 ceph-mon[32756]: pgmap v16869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:26.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:26 smithi156 ceph-mon[32679]: pgmap v16869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:52:28.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:28 smithi092 ceph-mon[29156]: pgmap v16870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:52:28.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:28 smithi189 ceph-mon[32756]: pgmap v16870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:52:28.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:28 smithi156 ceph-mon[32679]: pgmap v16870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:52:29.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30844.890804 secs 2024-04-27T02:52:29.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30844.890804 secs 2024-04-27T02:52:29.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30844.890804 secs 2024-04-27T02:52:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:30 smithi092 ceph-mon[29156]: pgmap v16871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30147.858379 secs 2024-04-27T02:52:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:30 smithi189 ceph-mon[32756]: pgmap v16871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30147.858379 secs 2024-04-27T02:52:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:30 smithi156 ceph-mon[32679]: pgmap v16871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30147.858379 secs 2024-04-27T02:52:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:32 smithi092 ceph-mon[29156]: pgmap v16872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:32.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:32 smithi189 ceph-mon[32756]: pgmap v16872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:32.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:32 smithi156 ceph-mon[32679]: pgmap v16872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:34 smithi092 ceph-mon[29156]: pgmap v16873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30849.890917 secs 2024-04-27T02:52:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:34 smithi189 ceph-mon[32756]: pgmap v16873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30849.890917 secs 2024-04-27T02:52:34.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:34 smithi156 ceph-mon[32679]: pgmap v16873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:34.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30849.890917 secs 2024-04-27T02:52:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30152.858447 secs 2024-04-27T02:52:35.581 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30152.858447 secs 2024-04-27T02:52:35.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30152.858447 secs 2024-04-27T02:52:36.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:36 smithi092 ceph-mon[29156]: pgmap v16874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:36.597 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:36 smithi156 ceph-mon[32679]: pgmap v16874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:36.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:36 smithi189 ceph-mon[32756]: pgmap v16874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:38.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:38 smithi092 ceph-mon[29156]: pgmap v16875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:38.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:38 smithi189 ceph-mon[32756]: pgmap v16875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:38.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:38 smithi156 ceph-mon[32679]: pgmap v16875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:39 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 30854.891037 secs 2024-04-27T02:52:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:39 smithi092 ceph-mon[29156]: slow request 5761.355193 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:39.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:39 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 30854.891037 secs 2024-04-27T02:52:39.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:39 smithi189 ceph-mon[32756]: slow request 5761.355193 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:39.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:39 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 30854.891037 secs 2024-04-27T02:52:39.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:39 smithi156 ceph-mon[32679]: slow request 5761.355193 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:52:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:40 smithi092 ceph-mon[29156]: pgmap v16876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30157.858512 secs 2024-04-27T02:52:40.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:40 smithi189 ceph-mon[32756]: pgmap v16876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:40.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30157.858512 secs 2024-04-27T02:52:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:40 smithi156 ceph-mon[32679]: pgmap v16876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30157.858512 secs 2024-04-27T02:52:42.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:42 smithi189 ceph-mon[32756]: pgmap v16877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:42.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:42 smithi156 ceph-mon[32679]: pgmap v16877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:42 smithi092 ceph-mon[29156]: pgmap v16877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:44.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:44 smithi189 ceph-mon[32756]: pgmap v16878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:44.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30859.891153 secs 2024-04-27T02:52:44.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:44 smithi156 ceph-mon[32679]: pgmap v16878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:44.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30859.891153 secs 2024-04-27T02:52:44.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:44 smithi092 ceph-mon[29156]: pgmap v16878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:44.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30859.891153 secs 2024-04-27T02:52:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30162.858578 secs 2024-04-27T02:52:45.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30162.858578 secs 2024-04-27T02:52:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30162.858578 secs 2024-04-27T02:52:46.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:46 smithi189 ceph-mon[32756]: pgmap v16879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:46.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:46 smithi156 ceph-mon[32679]: pgmap v16879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:46.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:46 smithi092 ceph-mon[29156]: pgmap v16879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:48.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:48 smithi189 ceph-mon[32756]: pgmap v16880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:48.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:48 smithi156 ceph-mon[32679]: pgmap v16880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:48.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:48 smithi092 ceph-mon[29156]: pgmap v16880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:49.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30864.891271 secs 2024-04-27T02:52:49.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30864.891271 secs 2024-04-27T02:52:49.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30864.891271 secs 2024-04-27T02:52:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:50 smithi189 ceph-mon[32756]: pgmap v16881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30167.858703 secs 2024-04-27T02:52:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:50 smithi156 ceph-mon[32679]: pgmap v16881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30167.858703 secs 2024-04-27T02:52:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:50 smithi092 ceph-mon[29156]: pgmap v16881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30167.858703 secs 2024-04-27T02:52:52.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:52 smithi189 ceph-mon[32756]: pgmap v16882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:52.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:52 smithi156 ceph-mon[32679]: pgmap v16882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:52.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:52 smithi092 ceph-mon[29156]: pgmap v16882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:54.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:54 smithi189 ceph-mon[32756]: pgmap v16883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:54.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30869.891350 secs 2024-04-27T02:52:54.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:54 smithi156 ceph-mon[32679]: pgmap v16883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:54.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30869.891350 secs 2024-04-27T02:52:54.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:54 smithi092 ceph-mon[29156]: pgmap v16883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:54.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30869.891350 secs 2024-04-27T02:52:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30172.858780 secs 2024-04-27T02:52:55.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30172.858780 secs 2024-04-27T02:52:55.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30172.858780 secs 2024-04-27T02:52:56.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:56 smithi189 ceph-mon[32756]: pgmap v16884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:56.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:56 smithi156 ceph-mon[32679]: pgmap v16884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:56.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:56 smithi092 ceph-mon[29156]: pgmap v16884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:52:58.554 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:58 smithi092 ceph-mon[29156]: pgmap v16885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:58.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:58 smithi189 ceph-mon[32756]: pgmap v16885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:58.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:58 smithi156 ceph-mon[32679]: pgmap v16885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:52:59.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:52:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30874.891487 secs 2024-04-27T02:52:59.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:52:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30874.891487 secs 2024-04-27T02:52:59.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:52:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30874.891487 secs 2024-04-27T02:53:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:00 smithi189 ceph-mon[32756]: pgmap v16886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30177.858861 secs 2024-04-27T02:53:00.642 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:00 smithi092 ceph-mon[29156]: pgmap v16886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:00.642 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30177.858861 secs 2024-04-27T02:53:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:00 smithi156 ceph-mon[32679]: pgmap v16886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30177.858861 secs 2024-04-27T02:53:02.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:02 smithi189 ceph-mon[32756]: pgmap v16887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:02.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:02 smithi156 ceph-mon[32679]: pgmap v16887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:02.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:02 smithi092 ceph-mon[29156]: pgmap v16887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:04.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:04 smithi189 ceph-mon[32756]: pgmap v16888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:04.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30879.891599 secs 2024-04-27T02:53:04.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:04 smithi156 ceph-mon[32679]: pgmap v16888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:04.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30879.891599 secs 2024-04-27T02:53:04.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:04 smithi092 ceph-mon[29156]: pgmap v16888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:04.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30879.891599 secs 2024-04-27T02:53:05.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30182.858995 secs 2024-04-27T02:53:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30182.858995 secs 2024-04-27T02:53:05.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30182.858995 secs 2024-04-27T02:53:06.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:06 smithi189 ceph-mon[32756]: pgmap v16889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:06.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:06 smithi156 ceph-mon[32679]: pgmap v16889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:06.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:06 smithi092 ceph-mon[29156]: pgmap v16889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:08.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:08 smithi189 ceph-mon[32756]: pgmap v16890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:08.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:08 smithi156 ceph-mon[32679]: pgmap v16890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:08.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:08 smithi092 ceph-mon[29156]: pgmap v16890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30884.891722 secs 2024-04-27T02:53:09.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30884.891722 secs 2024-04-27T02:53:09.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30884.891722 secs 2024-04-27T02:53:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:10 smithi189 ceph-mon[32756]: pgmap v16891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30187.859084 secs 2024-04-27T02:53:10.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:10 smithi156 ceph-mon[32679]: pgmap v16891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:10.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30187.859084 secs 2024-04-27T02:53:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:10 smithi092 ceph-mon[29156]: pgmap v16891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:10.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30187.859084 secs 2024-04-27T02:53:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:12 smithi189 ceph-mon[32756]: pgmap v16892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:12.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:12 smithi156 ceph-mon[32679]: pgmap v16892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:12 smithi092 ceph-mon[29156]: pgmap v16892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:14 smithi189 ceph-mon[32756]: pgmap v16893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30889.891861 secs 2024-04-27T02:53:14.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:14 smithi156 ceph-mon[32679]: pgmap v16893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:14.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30889.891861 secs 2024-04-27T02:53:14.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:14 smithi092 ceph-mon[29156]: pgmap v16893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:14.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30889.891861 secs 2024-04-27T02:53:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30192.859233 secs 2024-04-27T02:53:15.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30192.859233 secs 2024-04-27T02:53:15.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30192.859233 secs 2024-04-27T02:53:16.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:16 smithi189 ceph-mon[32756]: pgmap v16894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:16 smithi156 ceph-mon[32679]: pgmap v16894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:16 smithi092 ceph-mon[29156]: pgmap v16894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:53:17.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:53:17.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:53:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:18 smithi189 ceph-mon[32756]: pgmap v16895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:53:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:53:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:53:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:18 smithi156 ceph-mon[32679]: pgmap v16895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:53:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:53:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:53:18.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:18 smithi092 ceph-mon[29156]: pgmap v16895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:53:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:53:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:53:19.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:19 smithi189 ceph-mon[32756]: pgmap v16896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:53:19.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:19 smithi189 ceph-mon[32756]: pgmap v16897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:53:19.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30894.891935 secs 2024-04-27T02:53:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:19 smithi156 ceph-mon[32679]: pgmap v16896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:53:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:19 smithi156 ceph-mon[32679]: pgmap v16897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:53:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30894.891935 secs 2024-04-27T02:53:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:19 smithi092 ceph-mon[29156]: pgmap v16896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:53:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:19 smithi092 ceph-mon[29156]: pgmap v16897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:53:19.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30894.891935 secs 2024-04-27T02:53:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30197.859354 secs 2024-04-27T02:53:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30197.859354 secs 2024-04-27T02:53:20.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30197.859354 secs 2024-04-27T02:53:21.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:21 smithi189 ceph-mon[32756]: pgmap v16898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:21.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:21 smithi156 ceph-mon[32679]: pgmap v16898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:21.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:21 smithi092 ceph-mon[29156]: pgmap v16898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:23.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:23 smithi189 ceph-mon[32756]: pgmap v16899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:23.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:23 smithi156 ceph-mon[32679]: pgmap v16899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:23.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:23 smithi092 ceph-mon[29156]: pgmap v16899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:24.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30899.892071 secs 2024-04-27T02:53:24.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30899.892071 secs 2024-04-27T02:53:24.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30899.892071 secs 2024-04-27T02:53:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:25 smithi189 ceph-mon[32756]: pgmap v16900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:53:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30202.859456 secs 2024-04-27T02:53:25.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:25 smithi156 ceph-mon[32679]: pgmap v16900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:53:25.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30202.859456 secs 2024-04-27T02:53:25.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:25 smithi092 ceph-mon[29156]: pgmap v16900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T02:53:25.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30202.859456 secs 2024-04-27T02:53:27.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:27 smithi189 ceph-mon[32756]: pgmap v16901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:27.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:27 smithi156 ceph-mon[32679]: pgmap v16901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:27.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:27 smithi092 ceph-mon[29156]: pgmap v16901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:53:29.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:29 smithi189 ceph-mon[32756]: pgmap v16902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:53:29.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30904.892193 secs 2024-04-27T02:53:29.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:29 smithi156 ceph-mon[32679]: pgmap v16902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:53:29.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30904.892193 secs 2024-04-27T02:53:29.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:29 smithi092 ceph-mon[29156]: pgmap v16902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:53:29.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30904.892193 secs 2024-04-27T02:53:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30207.859544 secs 2024-04-27T02:53:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30207.859544 secs 2024-04-27T02:53:30.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30207.859544 secs 2024-04-27T02:53:31.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:31 smithi189 ceph-mon[32756]: pgmap v16903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:31.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:31 smithi156 ceph-mon[32679]: pgmap v16903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:31.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:31 smithi092 ceph-mon[29156]: pgmap v16903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:33.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:33 smithi189 ceph-mon[32756]: pgmap v16904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:33.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:33 smithi156 ceph-mon[32679]: pgmap v16904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:33.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:33 smithi092 ceph-mon[29156]: pgmap v16904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:34.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30909.892329 secs 2024-04-27T02:53:34.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30909.892329 secs 2024-04-27T02:53:34.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30909.892329 secs 2024-04-27T02:53:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:35 smithi156 ceph-mon[32679]: pgmap v16905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30212.859664 secs 2024-04-27T02:53:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:35 smithi092 ceph-mon[29156]: pgmap v16905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30212.859664 secs 2024-04-27T02:53:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:35 smithi189 ceph-mon[32756]: pgmap v16905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30212.859664 secs 2024-04-27T02:53:37.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:37 smithi156 ceph-mon[32679]: pgmap v16906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:37.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:37 smithi092 ceph-mon[29156]: pgmap v16906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:37.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:37 smithi189 ceph-mon[32756]: pgmap v16906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:39.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:39 smithi156 ceph-mon[32679]: pgmap v16907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:39.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30914.892458 secs 2024-04-27T02:53:39.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:39 smithi092 ceph-mon[29156]: pgmap v16907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:39.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30914.892458 secs 2024-04-27T02:53:39.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:39 smithi189 ceph-mon[32756]: pgmap v16907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:39.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30914.892458 secs 2024-04-27T02:53:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30217.859763 secs 2024-04-27T02:53:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30217.859763 secs 2024-04-27T02:53:40.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30217.859763 secs 2024-04-27T02:53:41.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:41 smithi156 ceph-mon[32679]: pgmap v16908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:41.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:41 smithi092 ceph-mon[29156]: pgmap v16908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:41.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:41 smithi189 ceph-mon[32756]: pgmap v16908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:43.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:43 smithi156 ceph-mon[32679]: pgmap v16909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:43.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:43 smithi092 ceph-mon[29156]: pgmap v16909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:43.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:43 smithi189 ceph-mon[32756]: pgmap v16909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:44.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30919.892576 secs 2024-04-27T02:53:44.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30919.892576 secs 2024-04-27T02:53:44.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30919.892576 secs 2024-04-27T02:53:45.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:45 smithi156 ceph-mon[32679]: pgmap v16910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:45.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30222.859884 secs 2024-04-27T02:53:45.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:45 smithi092 ceph-mon[29156]: pgmap v16910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:45.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30222.859884 secs 2024-04-27T02:53:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:45 smithi189 ceph-mon[32756]: pgmap v16910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30222.859884 secs 2024-04-27T02:53:47.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:47 smithi156 ceph-mon[32679]: pgmap v16911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:47.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:47 smithi092 ceph-mon[29156]: pgmap v16911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:47.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:47 smithi189 ceph-mon[32756]: pgmap v16911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:49.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:49 smithi156 ceph-mon[32679]: pgmap v16912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:49.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30924.892667 secs 2024-04-27T02:53:49.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:49 smithi092 ceph-mon[29156]: pgmap v16912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:49.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30924.892667 secs 2024-04-27T02:53:49.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:49 smithi189 ceph-mon[32756]: pgmap v16912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:49.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30924.892667 secs 2024-04-27T02:53:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30227.859999 secs 2024-04-27T02:53:50.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30227.859999 secs 2024-04-27T02:53:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30227.859999 secs 2024-04-27T02:53:51.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:51 smithi092 ceph-mon[29156]: pgmap v16913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:51.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:51 smithi189 ceph-mon[32756]: pgmap v16913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:51.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:51 smithi156 ceph-mon[32679]: pgmap v16913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:52.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:52 smithi092 ceph-mon[29156]: pgmap v16914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:52.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:52 smithi189 ceph-mon[32756]: pgmap v16914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:52.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:52 smithi156 ceph-mon[32679]: pgmap v16914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:54.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:54 smithi189 ceph-mon[32756]: pgmap v16915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30929.892802 secs 2024-04-27T02:53:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:54 smithi156 ceph-mon[32679]: pgmap v16915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30929.892802 secs 2024-04-27T02:53:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:54 smithi092 ceph-mon[29156]: pgmap v16915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:53:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30929.892802 secs 2024-04-27T02:53:55.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30232.860101 secs 2024-04-27T02:53:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30232.860101 secs 2024-04-27T02:53:55.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30232.860101 secs 2024-04-27T02:53:56.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:56 smithi189 ceph-mon[32756]: pgmap v16916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:56.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:56 smithi156 ceph-mon[32679]: pgmap v16916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:56.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:56 smithi092 ceph-mon[29156]: pgmap v16916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:58.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:58 smithi189 ceph-mon[32756]: pgmap v16917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:58.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:58 smithi156 ceph-mon[32679]: pgmap v16917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:58.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:58 smithi092 ceph-mon[29156]: pgmap v16917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:53:59.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:53:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30934.892919 secs 2024-04-27T02:53:59.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:53:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30934.892919 secs 2024-04-27T02:53:59.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:53:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30934.892919 secs 2024-04-27T02:54:00.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30237.860237 secs 2024-04-27T02:54:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:00 smithi189 ceph-mon[32756]: pgmap v16918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:00.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30237.860237 secs 2024-04-27T02:54:00.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:00 smithi092 ceph-mon[29156]: pgmap v16918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:00.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30237.860237 secs 2024-04-27T02:54:00.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:00 smithi156 ceph-mon[32679]: pgmap v16918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:02.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:02 smithi189 ceph-mon[32756]: pgmap v16919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:02.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:02 smithi156 ceph-mon[32679]: pgmap v16919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:02.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:02 smithi092 ceph-mon[29156]: pgmap v16919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:04 smithi189 ceph-mon[32756]: pgmap v16920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30939.893043 secs 2024-04-27T02:54:04.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:04 smithi156 ceph-mon[32679]: pgmap v16920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:04.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30939.893043 secs 2024-04-27T02:54:04.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:04 smithi092 ceph-mon[29156]: pgmap v16920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30939.893043 secs 2024-04-27T02:54:05.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30242.860357 secs 2024-04-27T02:54:05.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30242.860357 secs 2024-04-27T02:54:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30242.860357 secs 2024-04-27T02:54:06.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:06 smithi156 ceph-mon[32679]: pgmap v16921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:06.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:06 smithi092 ceph-mon[29156]: pgmap v16921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:06 smithi189 ceph-mon[32756]: pgmap v16921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:08 smithi156 ceph-mon[32679]: pgmap v16922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:08.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:08 smithi092 ceph-mon[29156]: pgmap v16922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:08 smithi189 ceph-mon[32756]: pgmap v16922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:09.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:09 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 30944.893121 secs 2024-04-27T02:54:09.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:09 smithi156 ceph-mon[32679]: slow request 1440.120319 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:54:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:09 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 30944.893121 secs 2024-04-27T02:54:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:09 smithi092 ceph-mon[29156]: slow request 1440.120319 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:54:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:09 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 30944.893121 secs 2024-04-27T02:54:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:09 smithi189 ceph-mon[32756]: slow request 1440.120319 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:54:10.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30247.860438 secs 2024-04-27T02:54:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:10 smithi156 ceph-mon[32679]: pgmap v16923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30247.860438 secs 2024-04-27T02:54:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:10 smithi092 ceph-mon[29156]: pgmap v16923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30247.860438 secs 2024-04-27T02:54:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:10 smithi189 ceph-mon[32756]: pgmap v16923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:12.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:12 smithi156 ceph-mon[32679]: pgmap v16924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:12.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:12 smithi092 ceph-mon[29156]: pgmap v16924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:12 smithi189 ceph-mon[32756]: pgmap v16924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:14 smithi156 ceph-mon[32679]: pgmap v16925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:14.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30949.893239 secs 2024-04-27T02:54:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:14 smithi092 ceph-mon[29156]: pgmap v16925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30949.893239 secs 2024-04-27T02:54:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:14 smithi189 ceph-mon[32756]: pgmap v16925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30949.893239 secs 2024-04-27T02:54:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30252.860505 secs 2024-04-27T02:54:15.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30252.860505 secs 2024-04-27T02:54:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30252.860505 secs 2024-04-27T02:54:16.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:16 smithi156 ceph-mon[32679]: pgmap v16926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:16.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:16 smithi092 ceph-mon[29156]: pgmap v16926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:16 smithi189 ceph-mon[32756]: pgmap v16926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:17.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:54:17.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:54:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: pgmap v16927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: pgmap v16928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: pgmap v16929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: pgmap v16927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: pgmap v16928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: pgmap v16929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:18.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: pgmap v16927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: pgmap v16928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: pgmap v16929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:54:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30954.893335 secs 2024-04-27T02:54:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30954.893335 secs 2024-04-27T02:54:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30954.893335 secs 2024-04-27T02:54:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30257.860612 secs 2024-04-27T02:54:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:20 smithi092 ceph-mon[29156]: pgmap v16930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30257.860612 secs 2024-04-27T02:54:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:20 smithi189 ceph-mon[32756]: pgmap v16930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30257.860612 secs 2024-04-27T02:54:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:20 smithi156 ceph-mon[32679]: pgmap v16930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:23.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:23 smithi189 ceph-mon[32756]: pgmap v16931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:23.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:23 smithi156 ceph-mon[32679]: pgmap v16931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:23.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:23 smithi092 ceph-mon[29156]: pgmap v16931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:54:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30959.893432 secs 2024-04-27T02:54:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30959.893432 secs 2024-04-27T02:54:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30959.893432 secs 2024-04-27T02:54:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30262.860674 secs 2024-04-27T02:54:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:25 smithi189 ceph-mon[32756]: pgmap v16932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30262.860674 secs 2024-04-27T02:54:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:25 smithi156 ceph-mon[32679]: pgmap v16932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30262.860674 secs 2024-04-27T02:54:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:25 smithi092 ceph-mon[29156]: pgmap v16932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:27.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:27 smithi156 ceph-mon[32679]: pgmap v16933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:27.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:27 smithi092 ceph-mon[29156]: pgmap v16933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:27.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:27 smithi189 ceph-mon[32756]: pgmap v16933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:54:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:29 smithi156 ceph-mon[32679]: pgmap v16934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:54:29.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30964.893494 secs 2024-04-27T02:54:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:29 smithi092 ceph-mon[29156]: pgmap v16934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:54:29.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30964.893494 secs 2024-04-27T02:54:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:29 smithi189 ceph-mon[32756]: pgmap v16934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:54:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30964.893494 secs 2024-04-27T02:54:30.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30267.860799 secs 2024-04-27T02:54:30.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30267.860799 secs 2024-04-27T02:54:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30267.860799 secs 2024-04-27T02:54:31.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:31 smithi156 ceph-mon[32679]: pgmap v16935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:31.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:31 smithi092 ceph-mon[29156]: pgmap v16935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:31 smithi189 ceph-mon[32756]: pgmap v16935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:33.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:33 smithi156 ceph-mon[32679]: pgmap v16936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:33.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:33 smithi092 ceph-mon[29156]: pgmap v16936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:33 smithi189 ceph-mon[32756]: pgmap v16936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30969.893610 secs 2024-04-27T02:54:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30969.893610 secs 2024-04-27T02:54:34.788 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30969.893610 secs 2024-04-27T02:54:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30272.860935 secs 2024-04-27T02:54:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:35 smithi156 ceph-mon[32679]: pgmap v16937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30272.860935 secs 2024-04-27T02:54:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:35 smithi092 ceph-mon[29156]: pgmap v16937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30272.860935 secs 2024-04-27T02:54:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:35 smithi189 ceph-mon[32756]: pgmap v16937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:37.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:37 smithi156 ceph-mon[32679]: pgmap v16938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:37.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:37 smithi092 ceph-mon[29156]: pgmap v16938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:37 smithi189 ceph-mon[32756]: pgmap v16938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:39 smithi156 ceph-mon[32679]: pgmap v16939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:39.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30974.893719 secs 2024-04-27T02:54:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:39 smithi092 ceph-mon[29156]: pgmap v16939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:39.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30974.893719 secs 2024-04-27T02:54:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:39 smithi189 ceph-mon[32756]: pgmap v16939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30974.893719 secs 2024-04-27T02:54:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:54:40.234+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:54:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:54:40.234+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:54:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:54:40.235+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:54:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:54:40.235+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 239 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:54:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30277.861036 secs 2024-04-27T02:54:40.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30277.861036 secs 2024-04-27T02:54:40.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30277.861036 secs 2024-04-27T02:54:41.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:41 smithi156 ceph-mon[32679]: pgmap v16940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:41.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:41 smithi092 ceph-mon[29156]: pgmap v16940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:41.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:41 smithi189 ceph-mon[32756]: pgmap v16940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:43.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:43 smithi156 ceph-mon[32679]: pgmap v16941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:43 smithi092 ceph-mon[29156]: pgmap v16941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:43.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:43 smithi189 ceph-mon[32756]: pgmap v16941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30979.893857 secs 2024-04-27T02:54:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30979.893857 secs 2024-04-27T02:54:44.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30979.893857 secs 2024-04-27T02:54:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30282.861149 secs 2024-04-27T02:54:45.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:45 smithi156 ceph-mon[32679]: pgmap v16942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30282.861149 secs 2024-04-27T02:54:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:45 smithi092 ceph-mon[29156]: pgmap v16942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30282.861149 secs 2024-04-27T02:54:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:45 smithi189 ceph-mon[32756]: pgmap v16942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:47.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:47 smithi092 ceph-mon[29156]: pgmap v16943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:47.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:47 smithi189 ceph-mon[32756]: pgmap v16943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:47.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:47 smithi156 ceph-mon[32679]: pgmap v16943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:49 smithi092 ceph-mon[29156]: pgmap v16944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:49.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30984.893991 secs 2024-04-27T02:54:49.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:49 smithi189 ceph-mon[32756]: pgmap v16944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:49.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30984.893991 secs 2024-04-27T02:54:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:49 smithi156 ceph-mon[32679]: pgmap v16944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:49.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30984.893991 secs 2024-04-27T02:54:50.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30287.861287 secs 2024-04-27T02:54:50.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30287.861287 secs 2024-04-27T02:54:50.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30287.861287 secs 2024-04-27T02:54:51.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:51 smithi092 ceph-mon[29156]: pgmap v16945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:51.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:51 smithi189 ceph-mon[32756]: pgmap v16945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:51.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:51 smithi156 ceph-mon[32679]: pgmap v16945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:52 smithi092 ceph-mon[29156]: pgmap v16946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:52.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:52 smithi189 ceph-mon[32756]: pgmap v16946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:52.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:52 smithi156 ceph-mon[32679]: pgmap v16946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:53 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30989.894100 secs 2024-04-27T02:54:54.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:53 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30989.894100 secs 2024-04-27T02:54:54.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:53 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30989.894100 secs 2024-04-27T02:54:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:54 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30292.861389 secs 2024-04-27T02:54:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:54 smithi092 ceph-mon[29156]: pgmap v16947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:54 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30292.861389 secs 2024-04-27T02:54:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:54 smithi189 ceph-mon[32756]: pgmap v16947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:54 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30292.861389 secs 2024-04-27T02:54:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:54 smithi156 ceph-mon[32679]: pgmap v16947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:54:57.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:57 smithi189 ceph-mon[32756]: pgmap v16948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:57.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:57 smithi156 ceph-mon[32679]: pgmap v16948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:57.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:57 smithi092 ceph-mon[29156]: pgmap v16948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:59 smithi156 ceph-mon[32679]: pgmap v16949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:59.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:54:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30994.894219 secs 2024-04-27T02:54:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:59 smithi092 ceph-mon[29156]: pgmap v16949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:59.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:54:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30994.894219 secs 2024-04-27T02:54:59.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:59 smithi189 ceph-mon[32756]: pgmap v16949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:54:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:54:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30994.894219 secs 2024-04-27T02:55:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30297.861476 secs 2024-04-27T02:55:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30297.861476 secs 2024-04-27T02:55:00.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30297.861476 secs 2024-04-27T02:55:01.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:01 smithi156 ceph-mon[32679]: pgmap v16950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:01.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:01 smithi092 ceph-mon[29156]: pgmap v16950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:01.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:01 smithi189 ceph-mon[32756]: pgmap v16950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:03.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:03 smithi156 ceph-mon[32679]: pgmap v16951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:03.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:03 smithi092 ceph-mon[29156]: pgmap v16951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:03 smithi189 ceph-mon[32756]: pgmap v16951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:04.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 30999.894338 secs 2024-04-27T02:55:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 30999.894338 secs 2024-04-27T02:55:04.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 30999.894338 secs 2024-04-27T02:55:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30302.861592 secs 2024-04-27T02:55:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:05 smithi156 ceph-mon[32679]: pgmap v16952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30302.861592 secs 2024-04-27T02:55:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:05 smithi092 ceph-mon[29156]: pgmap v16952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30302.861592 secs 2024-04-27T02:55:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:05 smithi189 ceph-mon[32756]: pgmap v16952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:07.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:07 smithi156 ceph-mon[32679]: pgmap v16953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:07.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:07 smithi092 ceph-mon[29156]: pgmap v16953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:07 smithi189 ceph-mon[32756]: pgmap v16953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:09.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:09 smithi156 ceph-mon[32679]: pgmap v16954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31004.894429 secs 2024-04-27T02:55:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:09 smithi092 ceph-mon[29156]: pgmap v16954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:09.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31004.894429 secs 2024-04-27T02:55:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:09 smithi189 ceph-mon[32756]: pgmap v16954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31004.894429 secs 2024-04-27T02:55:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30307.861703 secs 2024-04-27T02:55:10.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30307.861703 secs 2024-04-27T02:55:10.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30307.861703 secs 2024-04-27T02:55:11.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:11 smithi156 ceph-mon[32679]: pgmap v16955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:11.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:11 smithi092 ceph-mon[29156]: pgmap v16955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:11 smithi189 ceph-mon[32756]: pgmap v16955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:13 smithi156 ceph-mon[32679]: pgmap v16956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:13.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:13 smithi092 ceph-mon[29156]: pgmap v16956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:13 smithi189 ceph-mon[32756]: pgmap v16956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31009.894551 secs 2024-04-27T02:55:14.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31009.894551 secs 2024-04-27T02:55:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31009.894551 secs 2024-04-27T02:55:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30312.861820 secs 2024-04-27T02:55:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:15 smithi156 ceph-mon[32679]: pgmap v16957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30312.861820 secs 2024-04-27T02:55:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:15 smithi092 ceph-mon[29156]: pgmap v16957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30312.861820 secs 2024-04-27T02:55:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:15 smithi189 ceph-mon[32756]: pgmap v16957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:17.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:17 smithi156 ceph-mon[32679]: pgmap v16958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:17.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:17 smithi092 ceph-mon[29156]: pgmap v16958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:17 smithi189 ceph-mon[32756]: pgmap v16958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:55:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:55:18.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:19 smithi092 ceph-mon[29156]: pgmap v16959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31014.894639 secs 2024-04-27T02:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:55:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:55:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:19 smithi189 ceph-mon[32756]: pgmap v16959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31014.894639 secs 2024-04-27T02:55:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:55:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:55:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:55:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:19 smithi156 ceph-mon[32679]: pgmap v16959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31014.894639 secs 2024-04-27T02:55:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:55:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:55:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:55:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30317.861908 secs 2024-04-27T02:55:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:20 smithi092 ceph-mon[29156]: pgmap v16960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:55:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:20 smithi092 ceph-mon[29156]: pgmap v16961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30317.861908 secs 2024-04-27T02:55:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:20 smithi189 ceph-mon[32756]: pgmap v16960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:55:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:20 smithi189 ceph-mon[32756]: pgmap v16961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30317.861908 secs 2024-04-27T02:55:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:20 smithi156 ceph-mon[32679]: pgmap v16960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T02:55:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:20 smithi156 ceph-mon[32679]: pgmap v16961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:21 smithi189 ceph-mon[32756]: pgmap v16962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:21.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:21 smithi156 ceph-mon[32679]: pgmap v16962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:21 smithi092 ceph-mon[29156]: pgmap v16962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:24 smithi156 ceph-mon[32679]: pgmap v16963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:55:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31019.894772 secs 2024-04-27T02:55:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:24 smithi092 ceph-mon[29156]: pgmap v16963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:55:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31019.894772 secs 2024-04-27T02:55:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:24 smithi189 ceph-mon[32756]: pgmap v16963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:55:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31019.894772 secs 2024-04-27T02:55:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30322.862026 secs 2024-04-27T02:55:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30322.862026 secs 2024-04-27T02:55:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30322.862026 secs 2024-04-27T02:55:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:26 smithi156 ceph-mon[32679]: pgmap v16964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:26 smithi092 ceph-mon[29156]: pgmap v16964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:26 smithi189 ceph-mon[32756]: pgmap v16964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:28 smithi156 ceph-mon[32679]: pgmap v16965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:28 smithi092 ceph-mon[29156]: pgmap v16965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:28 smithi189 ceph-mon[32756]: pgmap v16965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:55:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31024.894927 secs 2024-04-27T02:55:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31024.894927 secs 2024-04-27T02:55:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31024.894927 secs 2024-04-27T02:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30327.862124 secs 2024-04-27T02:55:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:30 smithi156 ceph-mon[32679]: pgmap v16966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:55:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30327.862124 secs 2024-04-27T02:55:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:30 smithi092 ceph-mon[29156]: pgmap v16966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:55:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30327.862124 secs 2024-04-27T02:55:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:30 smithi189 ceph-mon[32756]: pgmap v16966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:55:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:32 smithi156 ceph-mon[32679]: pgmap v16967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:32 smithi092 ceph-mon[29156]: pgmap v16967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:32 smithi189 ceph-mon[32756]: pgmap v16967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:34 smithi156 ceph-mon[32679]: pgmap v16968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31029.895040 secs 2024-04-27T02:55:34.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:34 smithi189 ceph-mon[32756]: pgmap v16968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:34.440 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31029.895040 secs 2024-04-27T02:55:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:34 smithi092 ceph-mon[29156]: pgmap v16968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31029.895040 secs 2024-04-27T02:55:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30332.862227 secs 2024-04-27T02:55:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30332.862227 secs 2024-04-27T02:55:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30332.862227 secs 2024-04-27T02:55:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:36 smithi092 ceph-mon[29156]: pgmap v16969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:36 smithi189 ceph-mon[32756]: pgmap v16969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:36.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:36 smithi156 ceph-mon[32679]: pgmap v16969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:38 smithi092 ceph-mon[29156]: pgmap v16970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:38 smithi189 ceph-mon[32756]: pgmap v16970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:38 smithi156 ceph-mon[32679]: pgmap v16970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31034.895153 secs 2024-04-27T02:55:39.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:55:39.132+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:55:39.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:55:39.132+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:55:39.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:55:39.132+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:55:39.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:55:39.132+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:55:39.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 02:55:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T02:55:39.132+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T02:55:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31034.895153 secs 2024-04-27T02:55:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31034.895153 secs 2024-04-27T02:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30337.862344 secs 2024-04-27T02:55:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:40 smithi092 ceph-mon[29156]: pgmap v16971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30337.862344 secs 2024-04-27T02:55:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:40 smithi189 ceph-mon[32756]: pgmap v16971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30337.862344 secs 2024-04-27T02:55:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:40 smithi156 ceph-mon[32679]: pgmap v16971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:55:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:42 smithi092 ceph-mon[29156]: pgmap v16972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:42 smithi189 ceph-mon[32756]: pgmap v16972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:42 smithi156 ceph-mon[32679]: pgmap v16972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:44 smithi092 ceph-mon[29156]: pgmap v16973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31039.895261 secs 2024-04-27T02:55:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:44 smithi189 ceph-mon[32756]: pgmap v16973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31039.895261 secs 2024-04-27T02:55:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:44 smithi156 ceph-mon[32679]: pgmap v16973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:44.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31039.895261 secs 2024-04-27T02:55:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30342.862461 secs 2024-04-27T02:55:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30342.862461 secs 2024-04-27T02:55:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30342.862461 secs 2024-04-27T02:55:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:46 smithi092 ceph-mon[29156]: pgmap v16974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:46 smithi189 ceph-mon[32756]: pgmap v16974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:46 smithi156 ceph-mon[32679]: pgmap v16974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:48 smithi092 ceph-mon[29156]: pgmap v16975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:48 smithi189 ceph-mon[32756]: pgmap v16975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:48.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:48 smithi156 ceph-mon[32679]: pgmap v16975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31044.895327 secs 2024-04-27T02:55:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31044.895327 secs 2024-04-27T02:55:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31044.895327 secs 2024-04-27T02:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30347.862561 secs 2024-04-27T02:55:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:50 smithi092 ceph-mon[29156]: pgmap v16976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30347.862561 secs 2024-04-27T02:55:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:50 smithi189 ceph-mon[32756]: pgmap v16976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30347.862561 secs 2024-04-27T02:55:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:50 smithi156 ceph-mon[32679]: pgmap v16976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:52 smithi092 ceph-mon[29156]: pgmap v16977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:52 smithi189 ceph-mon[32756]: pgmap v16977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:52 smithi156 ceph-mon[32679]: pgmap v16977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:54 smithi092 ceph-mon[29156]: pgmap v16978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31049.895440 secs 2024-04-27T02:55:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:54 smithi189 ceph-mon[32756]: pgmap v16978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31049.895440 secs 2024-04-27T02:55:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:54 smithi156 ceph-mon[32679]: pgmap v16978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T02:55:54.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31049.895440 secs 2024-04-27T02:55:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30352.862671 secs 2024-04-27T02:55:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30352.862671 secs 2024-04-27T02:55:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30352.862671 secs 2024-04-27T02:55:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:56 smithi092 ceph-mon[29156]: pgmap v16979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:56 smithi189 ceph-mon[32756]: pgmap v16979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:56 smithi156 ceph-mon[32679]: pgmap v16979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T02:55:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:58 smithi092 ceph-mon[29156]: pgmap v16980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:58 smithi189 ceph-mon[32756]: pgmap v16980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:58 smithi156 ceph-mon[32679]: pgmap v16980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:55:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:55:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31054.895555 secs 2024-04-27T02:55:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:55:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31054.895555 secs 2024-04-27T02:55:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:55:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31054.895555 secs 2024-04-27T02:56:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30357.862742 secs 2024-04-27T02:56:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:00 smithi189 ceph-mon[32756]: pgmap v16981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30357.862742 secs 2024-04-27T02:56:00.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:00 smithi092 ceph-mon[29156]: pgmap v16981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30357.862742 secs 2024-04-27T02:56:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:00 smithi156 ceph-mon[32679]: pgmap v16981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:02 smithi189 ceph-mon[32756]: pgmap v16982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:02 smithi156 ceph-mon[32679]: pgmap v16982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:02 smithi092 ceph-mon[29156]: pgmap v16982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:04 smithi189 ceph-mon[32756]: pgmap v16983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31059.895670 secs 2024-04-27T02:56:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:04 smithi156 ceph-mon[32679]: pgmap v16983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31059.895670 secs 2024-04-27T02:56:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:04 smithi092 ceph-mon[29156]: pgmap v16983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31059.895670 secs 2024-04-27T02:56:05.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30362.862829 secs 2024-04-27T02:56:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30362.862829 secs 2024-04-27T02:56:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30362.862829 secs 2024-04-27T02:56:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:06 smithi189 ceph-mon[32756]: pgmap v16984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:06 smithi156 ceph-mon[32679]: pgmap v16984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:06 smithi092 ceph-mon[29156]: pgmap v16984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:08 smithi189 ceph-mon[32756]: pgmap v16985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:08 smithi156 ceph-mon[32679]: pgmap v16985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:08 smithi092 ceph-mon[29156]: pgmap v16985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:09.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31064.895778 secs 2024-04-27T02:56:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31064.895778 secs 2024-04-27T02:56:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31064.895778 secs 2024-04-27T02:56:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30367.862903 secs 2024-04-27T02:56:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:10 smithi189 ceph-mon[32756]: pgmap v16986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30367.862903 secs 2024-04-27T02:56:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:10 smithi156 ceph-mon[32679]: pgmap v16986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30367.862903 secs 2024-04-27T02:56:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:10 smithi092 ceph-mon[29156]: pgmap v16986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:12 smithi189 ceph-mon[32756]: pgmap v16987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:12 smithi156 ceph-mon[32679]: pgmap v16987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:12 smithi092 ceph-mon[29156]: pgmap v16987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:14 smithi189 ceph-mon[32756]: pgmap v16988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31069.895905 secs 2024-04-27T02:56:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:14 smithi156 ceph-mon[32679]: pgmap v16988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31069.895905 secs 2024-04-27T02:56:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:14 smithi092 ceph-mon[29156]: pgmap v16988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T02:56:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31069.895905 secs 2024-04-27T02:56:15.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30372.863058 secs 2024-04-27T02:56:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30372.863058 secs 2024-04-27T02:56:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30372.863058 secs 2024-04-27T02:56:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:16 smithi189 ceph-mon[32756]: pgmap v16989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:16 smithi156 ceph-mon[32679]: pgmap v16989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:16 smithi092 ceph-mon[29156]: pgmap v16989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T02:56:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:17 smithi189 ceph-mon[32756]: pgmap v16990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:17.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:17 smithi156 ceph-mon[32679]: pgmap v16990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:17.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:17 smithi092 ceph-mon[29156]: pgmap v16990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:18 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31074.896025 secs 2024-04-27T02:56:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:18 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31074.896025 secs 2024-04-27T02:56:19.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:18 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31074.896025 secs 2024-04-27T02:56:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30377.863122 secs 2024-04-27T02:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: pgmap v16991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30377.863122 secs 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: pgmap v16991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:56:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30377.863122 secs 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: pgmap v16991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:56:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:20 smithi092 ceph-mon[29156]: pgmap v16992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:56:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:20 smithi092 ceph-mon[29156]: pgmap v16993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:20 smithi189 ceph-mon[32756]: pgmap v16992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:56:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:20 smithi189 ceph-mon[32756]: pgmap v16993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:20 smithi156 ceph-mon[32679]: pgmap v16992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:56:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:20 smithi156 ceph-mon[32679]: pgmap v16993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:22 smithi092 ceph-mon[29156]: pgmap v16994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:23.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:22 smithi189 ceph-mon[32756]: pgmap v16994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:23.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:22 smithi156 ceph-mon[32679]: pgmap v16994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:23 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31079.896142 secs 2024-04-27T02:56:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:23 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31079.896142 secs 2024-04-27T02:56:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:23 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31079.896142 secs 2024-04-27T02:56:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:24 smithi092 ceph-mon[29156]: pgmap v16995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:24 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30382.863227 secs 2024-04-27T02:56:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:24 smithi189 ceph-mon[32756]: pgmap v16995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:24 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30382.863227 secs 2024-04-27T02:56:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:24 smithi156 ceph-mon[32679]: pgmap v16995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:24 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30382.863227 secs 2024-04-27T02:56:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:26 smithi189 ceph-mon[32756]: pgmap v16996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:26 smithi156 ceph-mon[32679]: pgmap v16996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:26 smithi092 ceph-mon[29156]: pgmap v16996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:29 smithi189 ceph-mon[32756]: pgmap v16997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:56:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31084.896272 secs 2024-04-27T02:56:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:29 smithi156 ceph-mon[32679]: pgmap v16997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:56:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31084.896272 secs 2024-04-27T02:56:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:29 smithi092 ceph-mon[29156]: pgmap v16997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:56:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31084.896272 secs 2024-04-27T02:56:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30387.863376 secs 2024-04-27T02:56:30.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30387.863376 secs 2024-04-27T02:56:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30387.863376 secs 2024-04-27T02:56:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:31 smithi189 ceph-mon[32756]: pgmap v16998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:56:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:31 smithi156 ceph-mon[32679]: pgmap v16998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:56:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:31 smithi092 ceph-mon[29156]: pgmap v16998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:56:33.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:33 smithi189 ceph-mon[32756]: pgmap v16999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:33.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:33 smithi156 ceph-mon[32679]: pgmap v16999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:33.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:33 smithi092 ceph-mon[29156]: pgmap v16999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:34.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31089.896407 secs 2024-04-27T02:56:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31089.896407 secs 2024-04-27T02:56:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31089.896407 secs 2024-04-27T02:56:35.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:35 smithi156 ceph-mon[32679]: pgmap v17000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:35.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30392.863524 secs 2024-04-27T02:56:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:35 smithi189 ceph-mon[32756]: pgmap v17000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30392.863524 secs 2024-04-27T02:56:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:35 smithi092 ceph-mon[29156]: pgmap v17000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30392.863524 secs 2024-04-27T02:56:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:37 smithi189 ceph-mon[32756]: pgmap v17001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:37.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:37 smithi156 ceph-mon[32679]: pgmap v17001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:37 smithi092 ceph-mon[29156]: pgmap v17001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:39 smithi189 ceph-mon[32756]: pgmap v17002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31094.896558 secs 2024-04-27T02:56:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:39 smithi156 ceph-mon[32679]: pgmap v17002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31094.896558 secs 2024-04-27T02:56:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:39 smithi092 ceph-mon[29156]: pgmap v17002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31094.896558 secs 2024-04-27T02:56:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30397.863631 secs 2024-04-27T02:56:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30397.863631 secs 2024-04-27T02:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30397.863631 secs 2024-04-27T02:56:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:41 smithi189 ceph-mon[32756]: pgmap v17003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:41 smithi156 ceph-mon[32679]: pgmap v17003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:41 smithi092 ceph-mon[29156]: pgmap v17003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:43 smithi189 ceph-mon[32756]: pgmap v17004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:43 smithi156 ceph-mon[32679]: pgmap v17004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:43 smithi092 ceph-mon[29156]: pgmap v17004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31099.896693 secs 2024-04-27T02:56:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31099.896693 secs 2024-04-27T02:56:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31099.896693 secs 2024-04-27T02:56:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:45 smithi189 ceph-mon[32756]: pgmap v17005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30402.863738 secs 2024-04-27T02:56:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:45 smithi156 ceph-mon[32679]: pgmap v17005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30402.863738 secs 2024-04-27T02:56:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:45 smithi092 ceph-mon[29156]: pgmap v17005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30402.863738 secs 2024-04-27T02:56:47.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:47 smithi189 ceph-mon[32756]: pgmap v17006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:47.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:47 smithi156 ceph-mon[32679]: pgmap v17006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:47 smithi092 ceph-mon[29156]: pgmap v17006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:49 smithi189 ceph-mon[32756]: pgmap v17007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31104.896813 secs 2024-04-27T02:56:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:49 smithi156 ceph-mon[32679]: pgmap v17007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31104.896813 secs 2024-04-27T02:56:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:49 smithi092 ceph-mon[29156]: pgmap v17007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31104.896813 secs 2024-04-27T02:56:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30407.863873 secs 2024-04-27T02:56:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30407.863873 secs 2024-04-27T02:56:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30407.863873 secs 2024-04-27T02:56:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:51 smithi189 ceph-mon[32756]: pgmap v17008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:51.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:51 smithi156 ceph-mon[32679]: pgmap v17008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:51.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:51 smithi092 ceph-mon[29156]: pgmap v17008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:53.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:53 smithi189 ceph-mon[32756]: pgmap v17009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:53 smithi156 ceph-mon[32679]: pgmap v17009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:53.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:53 smithi092 ceph-mon[29156]: pgmap v17009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31109.896929 secs 2024-04-27T02:56:54.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31109.896929 secs 2024-04-27T02:56:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31109.896929 secs 2024-04-27T02:56:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:55 smithi189 ceph-mon[32756]: pgmap v17010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30412.863971 secs 2024-04-27T02:56:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:55 smithi156 ceph-mon[32679]: pgmap v17010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30412.863971 secs 2024-04-27T02:56:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:55 smithi092 ceph-mon[29156]: pgmap v17010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:56:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30412.863971 secs 2024-04-27T02:56:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:57 smithi189 ceph-mon[32756]: pgmap v17011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:57.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:57 smithi156 ceph-mon[32679]: pgmap v17011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:57.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:57 smithi092 ceph-mon[29156]: pgmap v17011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:59 smithi189 ceph-mon[32756]: pgmap v17012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:56:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31114.897008 secs 2024-04-27T02:56:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:59 smithi156 ceph-mon[32679]: pgmap v17012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:56:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31114.897008 secs 2024-04-27T02:56:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:59 smithi092 ceph-mon[29156]: pgmap v17012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:56:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:56:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31114.897008 secs 2024-04-27T02:57:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30417.864079 secs 2024-04-27T02:57:00.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30417.864079 secs 2024-04-27T02:57:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30417.864079 secs 2024-04-27T02:57:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:01 smithi189 ceph-mon[32756]: pgmap v17013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:01.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:01 smithi156 ceph-mon[32679]: pgmap v17013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:01 smithi092 ceph-mon[29156]: pgmap v17013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:03.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:03 smithi189 ceph-mon[32756]: pgmap v17014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:03.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:03 smithi156 ceph-mon[32679]: pgmap v17014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:03 smithi092 ceph-mon[29156]: pgmap v17014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31119.897128 secs 2024-04-27T02:57:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31119.897128 secs 2024-04-27T02:57:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31119.897128 secs 2024-04-27T02:57:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:05 smithi189 ceph-mon[32756]: pgmap v17015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30422.864218 secs 2024-04-27T02:57:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:05 smithi156 ceph-mon[32679]: pgmap v17015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30422.864218 secs 2024-04-27T02:57:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:05 smithi092 ceph-mon[29156]: pgmap v17015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30422.864218 secs 2024-04-27T02:57:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:07 smithi092 ceph-mon[29156]: pgmap v17016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:07 smithi189 ceph-mon[32756]: pgmap v17016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:07 smithi156 ceph-mon[32679]: pgmap v17016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:09 smithi189 ceph-mon[32756]: pgmap v17017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31124.897248 secs 2024-04-27T02:57:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:09 smithi156 ceph-mon[32679]: pgmap v17017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31124.897248 secs 2024-04-27T02:57:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:09 smithi092 ceph-mon[29156]: pgmap v17017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31124.897248 secs 2024-04-27T02:57:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:10 smithi189 ceph-mon[32756]: 23 slow requests, 1 included below; oldest blocked for > 30427.864343 secs 2024-04-27T02:57:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:10 smithi189 ceph-mon[32756]: slow request 720.025309 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:10 smithi156 ceph-mon[32679]: 23 slow requests, 1 included below; oldest blocked for > 30427.864343 secs 2024-04-27T02:57:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:10 smithi156 ceph-mon[32679]: slow request 720.025309 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:10 smithi092 ceph-mon[29156]: 23 slow requests, 1 included below; oldest blocked for > 30427.864343 secs 2024-04-27T02:57:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:10 smithi092 ceph-mon[29156]: slow request 720.025309 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:11 smithi189 ceph-mon[32756]: pgmap v17018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:11.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:11 smithi156 ceph-mon[32679]: pgmap v17018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:11 smithi092 ceph-mon[29156]: pgmap v17018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:13.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:13 smithi189 ceph-mon[32756]: pgmap v17019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:13.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:13 smithi156 ceph-mon[32679]: pgmap v17019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:13.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:13 smithi092 ceph-mon[29156]: pgmap v17019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31129.897365 secs 2024-04-27T02:57:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31129.897365 secs 2024-04-27T02:57:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31129.897365 secs 2024-04-27T02:57:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:15 smithi189 ceph-mon[32756]: pgmap v17020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30432.864468 secs 2024-04-27T02:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:15 smithi156 ceph-mon[32679]: pgmap v17020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30432.864468 secs 2024-04-27T02:57:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:15 smithi092 ceph-mon[29156]: pgmap v17020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30432.864468 secs 2024-04-27T02:57:17.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:17 smithi189 ceph-mon[32756]: pgmap v17021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:17.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:17 smithi156 ceph-mon[32679]: pgmap v17021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:17 smithi092 ceph-mon[29156]: pgmap v17021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:19 smithi189 ceph-mon[32756]: pgmap v17022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31134.897481 secs 2024-04-27T02:57:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:19 smithi156 ceph-mon[32679]: pgmap v17022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31134.897481 secs 2024-04-27T02:57:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:19 smithi092 ceph-mon[29156]: pgmap v17022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31134.897481 secs 2024-04-27T02:57:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30437.864531 secs 2024-04-27T02:57:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:57:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30437.864531 secs 2024-04-27T02:57:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:57:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30437.864531 secs 2024-04-27T02:57:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:57:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:21 smithi156 ceph-mon[32679]: pgmap v17023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:57:21.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:57:21.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:57:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:21 smithi092 ceph-mon[29156]: pgmap v17023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:57:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:57:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:57:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:21 smithi189 ceph-mon[32756]: pgmap v17023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:57:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:57:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:57:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:22 smithi156 ceph-mon[32679]: pgmap v17024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:22 smithi156 ceph-mon[32679]: pgmap v17025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:57:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:22 smithi092 ceph-mon[29156]: pgmap v17024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:22 smithi092 ceph-mon[29156]: pgmap v17025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:57:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:22 smithi189 ceph-mon[32756]: pgmap v17024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:22 smithi189 ceph-mon[32756]: pgmap v17025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:57:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:24 smithi156 ceph-mon[32679]: pgmap v17026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:57:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31139.897614 secs 2024-04-27T02:57:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:24 smithi092 ceph-mon[29156]: pgmap v17026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:57:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31139.897614 secs 2024-04-27T02:57:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:24 smithi189 ceph-mon[32756]: pgmap v17026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:57:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31139.897614 secs 2024-04-27T02:57:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30442.864609 secs 2024-04-27T02:57:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30442.864609 secs 2024-04-27T02:57:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30442.864609 secs 2024-04-27T02:57:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:26 smithi156 ceph-mon[32679]: pgmap v17027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:26 smithi092 ceph-mon[29156]: pgmap v17027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:26 smithi189 ceph-mon[32756]: pgmap v17027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:28 smithi156 ceph-mon[32679]: pgmap v17028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:28 smithi092 ceph-mon[29156]: pgmap v17028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:28 smithi189 ceph-mon[32756]: pgmap v17028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31144.897754 secs 2024-04-27T02:57:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31144.897754 secs 2024-04-27T02:57:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31144.897754 secs 2024-04-27T02:57:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:30 smithi156 ceph-mon[32679]: pgmap v17029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30447.864725 secs 2024-04-27T02:57:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:30 smithi092 ceph-mon[29156]: pgmap v17029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30447.864725 secs 2024-04-27T02:57:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:30 smithi189 ceph-mon[32756]: pgmap v17029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T02:57:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30447.864725 secs 2024-04-27T02:57:32.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:32 smithi156 ceph-mon[32679]: pgmap v17030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:32.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:32 smithi092 ceph-mon[29156]: pgmap v17030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:32 smithi189 ceph-mon[32756]: pgmap v17030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:57:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:34 smithi156 ceph-mon[32679]: pgmap v17031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:57:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31149.897869 secs 2024-04-27T02:57:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:34 smithi189 ceph-mon[32756]: pgmap v17031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:57:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31149.897869 secs 2024-04-27T02:57:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:34 smithi092 ceph-mon[29156]: pgmap v17031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T02:57:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31149.897869 secs 2024-04-27T02:57:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30452.864792 secs 2024-04-27T02:57:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30452.864792 secs 2024-04-27T02:57:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30452.864792 secs 2024-04-27T02:57:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:36 smithi156 ceph-mon[32679]: pgmap v17032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:57:36.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:36 smithi092 ceph-mon[29156]: pgmap v17032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:57:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:36 smithi189 ceph-mon[32756]: pgmap v17032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T02:57:38.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:38 smithi092 ceph-mon[29156]: pgmap v17033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:38 smithi189 ceph-mon[32756]: pgmap v17033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:38 smithi156 ceph-mon[32679]: pgmap v17033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:39 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 31154.897987 secs 2024-04-27T02:57:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:39 smithi092 ceph-mon[29156]: slow request 5761.240757 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:39 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 31154.897987 secs 2024-04-27T02:57:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:39 smithi189 ceph-mon[32756]: slow request 5761.240757 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:39 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 31154.897987 secs 2024-04-27T02:57:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:39 smithi156 ceph-mon[32679]: slow request 5761.240757 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:57:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:57:40.259+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:57:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:57:40.259+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:57:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:57:40.259+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:57:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:57:40.259+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 240 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:57:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:40 smithi092 ceph-mon[29156]: pgmap v17034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30457.864853 secs 2024-04-27T02:57:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:40 smithi189 ceph-mon[32756]: pgmap v17034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30457.864853 secs 2024-04-27T02:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:40 smithi156 ceph-mon[32679]: pgmap v17034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30457.864853 secs 2024-04-27T02:57:42.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:42 smithi092 ceph-mon[29156]: pgmap v17035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:42 smithi189 ceph-mon[32756]: pgmap v17035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:42 smithi156 ceph-mon[32679]: pgmap v17035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:44 smithi092 ceph-mon[29156]: pgmap v17036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31159.898097 secs 2024-04-27T02:57:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:44 smithi189 ceph-mon[32756]: pgmap v17036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31159.898097 secs 2024-04-27T02:57:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:44 smithi156 ceph-mon[32679]: pgmap v17036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31159.898097 secs 2024-04-27T02:57:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:45 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30462.864926 secs 2024-04-27T02:57:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:45 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30462.864926 secs 2024-04-27T02:57:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:45 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30462.864926 secs 2024-04-27T02:57:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:46 smithi092 ceph-mon[29156]: pgmap v17037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:46 smithi189 ceph-mon[32756]: pgmap v17037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:46 smithi156 ceph-mon[32679]: pgmap v17037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:48.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:48 smithi092 ceph-mon[29156]: pgmap v17038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:48 smithi189 ceph-mon[32756]: pgmap v17038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:48 smithi156 ceph-mon[32679]: pgmap v17038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31164.898186 secs 2024-04-27T02:57:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31164.898186 secs 2024-04-27T02:57:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31164.898186 secs 2024-04-27T02:57:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:50 smithi092 ceph-mon[29156]: pgmap v17039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:50 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30467.865016 secs 2024-04-27T02:57:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:50 smithi189 ceph-mon[32756]: pgmap v17039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:50 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30467.865016 secs 2024-04-27T02:57:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:50 smithi156 ceph-mon[32679]: pgmap v17039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:50 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30467.865016 secs 2024-04-27T02:57:52.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:52 smithi092 ceph-mon[29156]: pgmap v17040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:52 smithi189 ceph-mon[32756]: pgmap v17040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:52 smithi156 ceph-mon[32679]: pgmap v17040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:54 smithi092 ceph-mon[29156]: pgmap v17041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31169.898263 secs 2024-04-27T02:57:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:54 smithi189 ceph-mon[32756]: pgmap v17041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31169.898263 secs 2024-04-27T02:57:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:54 smithi156 ceph-mon[32679]: pgmap v17041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31169.898263 secs 2024-04-27T02:57:55.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:55 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30472.865101 secs 2024-04-27T02:57:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:55 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30472.865101 secs 2024-04-27T02:57:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:55 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30472.865101 secs 2024-04-27T02:57:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:56 smithi092 ceph-mon[29156]: pgmap v17042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:56 smithi189 ceph-mon[32756]: pgmap v17042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:56 smithi156 ceph-mon[32679]: pgmap v17042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:57:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:58 smithi092 ceph-mon[29156]: pgmap v17043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:58 smithi189 ceph-mon[32756]: pgmap v17043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:58 smithi156 ceph-mon[32679]: pgmap v17043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:57:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:57:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31174.898384 secs 2024-04-27T02:57:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:57:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31174.898384 secs 2024-04-27T02:57:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:57:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31174.898384 secs 2024-04-27T02:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:00 smithi189 ceph-mon[32756]: pgmap v17044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:00 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30477.865212 secs 2024-04-27T02:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:00 smithi156 ceph-mon[32679]: pgmap v17044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:00 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30477.865212 secs 2024-04-27T02:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:00 smithi092 ceph-mon[29156]: pgmap v17044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:00 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30477.865212 secs 2024-04-27T02:58:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:02 smithi189 ceph-mon[32756]: pgmap v17045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:02.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:02 smithi156 ceph-mon[32679]: pgmap v17045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:02.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:02 smithi092 ceph-mon[29156]: pgmap v17045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:04 smithi189 ceph-mon[32756]: pgmap v17046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31179.898460 secs 2024-04-27T02:58:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:04 smithi156 ceph-mon[32679]: pgmap v17046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31179.898460 secs 2024-04-27T02:58:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:04 smithi092 ceph-mon[29156]: pgmap v17046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31179.898460 secs 2024-04-27T02:58:05.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:05 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30482.865273 secs 2024-04-27T02:58:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:05 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30482.865273 secs 2024-04-27T02:58:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:05 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30482.865273 secs 2024-04-27T02:58:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:06 smithi189 ceph-mon[32756]: pgmap v17047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:06.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:06 smithi156 ceph-mon[32679]: pgmap v17047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:06 smithi092 ceph-mon[29156]: pgmap v17047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:08 smithi189 ceph-mon[32756]: pgmap v17048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:08 smithi156 ceph-mon[32679]: pgmap v17048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:08 smithi092 ceph-mon[29156]: pgmap v17048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31184.898535 secs 2024-04-27T02:58:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31184.898535 secs 2024-04-27T02:58:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31184.898535 secs 2024-04-27T02:58:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:10 smithi189 ceph-mon[32756]: pgmap v17049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:10 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30487.865354 secs 2024-04-27T02:58:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:10 smithi156 ceph-mon[32679]: pgmap v17049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:10 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30487.865354 secs 2024-04-27T02:58:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:10 smithi092 ceph-mon[29156]: pgmap v17049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:10 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30487.865354 secs 2024-04-27T02:58:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:12 smithi189 ceph-mon[32756]: pgmap v17050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:12 smithi156 ceph-mon[32679]: pgmap v17050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:12 smithi092 ceph-mon[29156]: pgmap v17050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:14 smithi189 ceph-mon[32756]: pgmap v17051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31189.898646 secs 2024-04-27T02:58:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:14 smithi156 ceph-mon[32679]: pgmap v17051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31189.898646 secs 2024-04-27T02:58:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:14 smithi092 ceph-mon[29156]: pgmap v17051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31189.898646 secs 2024-04-27T02:58:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:15 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30492.865449 secs 2024-04-27T02:58:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:15 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30492.865449 secs 2024-04-27T02:58:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:15 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30492.865449 secs 2024-04-27T02:58:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:16 smithi189 ceph-mon[32756]: pgmap v17052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:16 smithi156 ceph-mon[32679]: pgmap v17052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:16 smithi092 ceph-mon[29156]: pgmap v17052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:18 smithi189 ceph-mon[32756]: pgmap v17053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:18 smithi156 ceph-mon[32679]: pgmap v17053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:18 smithi092 ceph-mon[29156]: pgmap v17053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31194.898780 secs 2024-04-27T02:58:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31194.898780 secs 2024-04-27T02:58:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31194.898780 secs 2024-04-27T02:58:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:20 smithi189 ceph-mon[32756]: pgmap v17054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:20 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30497.865561 secs 2024-04-27T02:58:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:20 smithi156 ceph-mon[32679]: pgmap v17054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:20 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30497.865561 secs 2024-04-27T02:58:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:20 smithi092 ceph-mon[29156]: pgmap v17054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:20 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30497.865561 secs 2024-04-27T02:58:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:58:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:58:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:58:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: pgmap v17055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:58:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:58:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: pgmap v17056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:58:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: pgmap v17057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:22.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:58:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: pgmap v17055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:58:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:58:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: pgmap v17056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:58:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: pgmap v17057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: pgmap v17055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: pgmap v17056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: pgmap v17057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:58:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:23 smithi189 ceph-mon[32756]: pgmap v17058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:23 smithi156 ceph-mon[32679]: pgmap v17058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:23.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:23 smithi092 ceph-mon[29156]: pgmap v17058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31199.898919 secs 2024-04-27T02:58:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31199.898919 secs 2024-04-27T02:58:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31199.898919 secs 2024-04-27T02:58:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:58:25.265+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:58:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:58:25.265+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:58:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:58:25.265+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T02:58:25.268 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T02:58:25.265+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 241 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T02:58:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:25 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30502.865638 secs 2024-04-27T02:58:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:25 smithi189 ceph-mon[32756]: pgmap v17059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:25 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30502.865638 secs 2024-04-27T02:58:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:25 smithi156 ceph-mon[32679]: pgmap v17059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:25 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30502.865638 secs 2024-04-27T02:58:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:25 smithi092 ceph-mon[29156]: pgmap v17059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:27 smithi189 ceph-mon[32756]: pgmap v17060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:27 smithi156 ceph-mon[32679]: pgmap v17060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:27.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:27 smithi092 ceph-mon[29156]: pgmap v17060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:58:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:28 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31204.899035 secs 2024-04-27T02:58:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:28 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31204.899035 secs 2024-04-27T02:58:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:28 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31204.899035 secs 2024-04-27T02:58:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:30 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30507.865704 secs 2024-04-27T02:58:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:30 smithi189 ceph-mon[32756]: pgmap v17061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:30.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:30 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30507.865704 secs 2024-04-27T02:58:30.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:30 smithi092 ceph-mon[29156]: pgmap v17061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:30 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30507.865704 secs 2024-04-27T02:58:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:30 smithi156 ceph-mon[32679]: pgmap v17061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:58:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:31 smithi189 ceph-mon[32756]: pgmap v17062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:58:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:31 smithi156 ceph-mon[32679]: pgmap v17062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:58:31.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:31 smithi092 ceph-mon[29156]: pgmap v17062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:58:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:33 smithi189 ceph-mon[32756]: pgmap v17063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:33 smithi156 ceph-mon[32679]: pgmap v17063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:33 smithi092 ceph-mon[29156]: pgmap v17063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:34.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31209.899149 secs 2024-04-27T02:58:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31209.899149 secs 2024-04-27T02:58:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31209.899149 secs 2024-04-27T02:58:35.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:35 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30512.865821 secs 2024-04-27T02:58:35.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:35 smithi156 ceph-mon[32679]: pgmap v17064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:35 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30512.865821 secs 2024-04-27T02:58:35.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:35 smithi189 ceph-mon[32756]: pgmap v17064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:35 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30512.865821 secs 2024-04-27T02:58:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:35 smithi092 ceph-mon[29156]: pgmap v17064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:37 smithi189 ceph-mon[32756]: pgmap v17065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:37 smithi156 ceph-mon[32679]: pgmap v17065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:37.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:37 smithi092 ceph-mon[29156]: pgmap v17065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:39.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:38 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31214.899227 secs 2024-04-27T02:58:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:38 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31214.899227 secs 2024-04-27T02:58:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:38 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31214.899227 secs 2024-04-27T02:58:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:40 smithi189 ceph-mon[32756]: 23 slow requests, 0 included below; oldest blocked for > 30517.865904 secs 2024-04-27T02:58:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:40 smithi189 ceph-mon[32756]: pgmap v17066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:40 smithi156 ceph-mon[32679]: 23 slow requests, 0 included below; oldest blocked for > 30517.865904 secs 2024-04-27T02:58:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:40 smithi156 ceph-mon[32679]: pgmap v17066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:40 smithi092 ceph-mon[29156]: 23 slow requests, 0 included below; oldest blocked for > 30517.865904 secs 2024-04-27T02:58:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:40 smithi092 ceph-mon[29156]: pgmap v17066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:41 smithi189 ceph-mon[32756]: pgmap v17067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:41 smithi156 ceph-mon[32679]: pgmap v17067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:41.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:41 smithi092 ceph-mon[29156]: pgmap v17067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:43 smithi189 ceph-mon[32756]: pgmap v17068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:43 smithi156 ceph-mon[32679]: pgmap v17068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:43 smithi092 ceph-mon[29156]: pgmap v17068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31219.899341 secs 2024-04-27T02:58:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31219.899341 secs 2024-04-27T02:58:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31219.899341 secs 2024-04-27T02:58:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:45 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 30522.866023 secs 2024-04-27T02:58:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:45 smithi189 ceph-mon[32756]: slow request 184.872562 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:58:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:45 smithi189 ceph-mon[32756]: pgmap v17069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:45 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 30522.866023 secs 2024-04-27T02:58:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:45 smithi156 ceph-mon[32679]: slow request 184.872562 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:58:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:45 smithi156 ceph-mon[32679]: pgmap v17069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:45 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 30522.866023 secs 2024-04-27T02:58:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:45 smithi092 ceph-mon[29156]: slow request 184.872562 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T02:58:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:45 smithi092 ceph-mon[29156]: pgmap v17069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:46.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:58:46.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:58:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:58:46.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:58:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T02:58:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T02:58:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:47 smithi189 ceph-mon[32756]: pgmap v17070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:47 smithi156 ceph-mon[32679]: pgmap v17070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:47 smithi092 ceph-mon[29156]: pgmap v17070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:49.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:48 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31224.899489 secs 2024-04-27T02:58:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:48 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31224.899489 secs 2024-04-27T02:58:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:48 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31224.899489 secs 2024-04-27T02:58:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30527.866157 secs 2024-04-27T02:58:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:50 smithi189 ceph-mon[32756]: pgmap v17071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30527.866157 secs 2024-04-27T02:58:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:50 smithi156 ceph-mon[32679]: pgmap v17071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30527.866157 secs 2024-04-27T02:58:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:50 smithi092 ceph-mon[29156]: pgmap v17071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:51.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:51 smithi189 ceph-mon[32756]: pgmap v17072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:51.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:51 smithi156 ceph-mon[32679]: pgmap v17072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:51 smithi092 ceph-mon[29156]: pgmap v17072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:53.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:53 smithi189 ceph-mon[32756]: pgmap v17073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:53 smithi156 ceph-mon[32679]: pgmap v17073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:53 smithi092 ceph-mon[29156]: pgmap v17073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31229.899587 secs 2024-04-27T02:58:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31229.899587 secs 2024-04-27T02:58:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31229.899587 secs 2024-04-27T02:58:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30532.866245 secs 2024-04-27T02:58:55.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:55 smithi189 ceph-mon[32756]: pgmap v17074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:55.935 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30532.866245 secs 2024-04-27T02:58:55.936 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:55 smithi092 ceph-mon[29156]: pgmap v17074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30532.866245 secs 2024-04-27T02:58:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:55 smithi156 ceph-mon[32679]: pgmap v17074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:58:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:57 smithi189 ceph-mon[32756]: pgmap v17075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:57 smithi156 ceph-mon[32679]: pgmap v17075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:57 smithi092 ceph-mon[29156]: pgmap v17075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:58:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:58:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31234.899659 secs 2024-04-27T02:58:59.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:58:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31234.899659 secs 2024-04-27T02:58:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:58:58 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31234.899659 secs 2024-04-27T02:59:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30537.866414 secs 2024-04-27T02:59:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:00 smithi189 ceph-mon[32756]: pgmap v17076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:00.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30537.866414 secs 2024-04-27T02:59:00.398 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:00 smithi092 ceph-mon[29156]: pgmap v17076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30537.866414 secs 2024-04-27T02:59:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:00 smithi156 ceph-mon[32679]: pgmap v17076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:01 smithi189 ceph-mon[32756]: pgmap v17077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:01 smithi156 ceph-mon[32679]: pgmap v17077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:01 smithi092 ceph-mon[29156]: pgmap v17077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:03.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:03 smithi189 ceph-mon[32756]: pgmap v17078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:03 smithi156 ceph-mon[32679]: pgmap v17078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:03 smithi092 ceph-mon[29156]: pgmap v17078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:04.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31239.899781 secs 2024-04-27T02:59:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31239.899781 secs 2024-04-27T02:59:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31239.899781 secs 2024-04-27T02:59:05.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30542.866516 secs 2024-04-27T02:59:05.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:05 smithi156 ceph-mon[32679]: pgmap v17079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:05.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30542.866516 secs 2024-04-27T02:59:05.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:05 smithi189 ceph-mon[32756]: pgmap v17079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30542.866516 secs 2024-04-27T02:59:05.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:05 smithi092 ceph-mon[29156]: pgmap v17079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:07 smithi189 ceph-mon[32756]: pgmap v17080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:07 smithi156 ceph-mon[32679]: pgmap v17080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:07.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:07 smithi092 ceph-mon[29156]: pgmap v17080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:09.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:09 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 31244.899900 secs 2024-04-27T02:59:09.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:09 smithi189 ceph-mon[32756]: slow request 1440.000957 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:09 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 31244.899900 secs 2024-04-27T02:59:09.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:09 smithi156 ceph-mon[32679]: slow request 1440.000957 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:09 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 31244.899900 secs 2024-04-27T02:59:09.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:09 smithi092 ceph-mon[29156]: slow request 1440.000957 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:10 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 30547.866652 secs 2024-04-27T02:59:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:10 smithi189 ceph-mon[32756]: slow request 11523.007166 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:10 smithi189 ceph-mon[32756]: pgmap v17081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:10 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 30547.866652 secs 2024-04-27T02:59:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:10 smithi156 ceph-mon[32679]: slow request 11523.007166 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:10 smithi156 ceph-mon[32679]: pgmap v17081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:10 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 30547.866652 secs 2024-04-27T02:59:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:10 smithi092 ceph-mon[29156]: slow request 11523.007166 seconds old, received at 2024-04-26T23:47:06.005520+0000: client_request(client.26579:1 getattr pAsLsXsFs #0x1 2024-04-26T23:47:05.998272+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T02:59:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:10 smithi092 ceph-mon[29156]: pgmap v17081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:11.808 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:11 smithi092 ceph-mon[29156]: pgmap v17082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:11.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:11 smithi189 ceph-mon[32756]: pgmap v17082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:11.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:11 smithi156 ceph-mon[32679]: pgmap v17082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:13 smithi189 ceph-mon[32756]: pgmap v17083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:13.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:13 smithi156 ceph-mon[32679]: pgmap v17083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:13.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:13 smithi092 ceph-mon[29156]: pgmap v17083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31249.900024 secs 2024-04-27T02:59:14.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31249.900024 secs 2024-04-27T02:59:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31249.900024 secs 2024-04-27T02:59:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30552.866769 secs 2024-04-27T02:59:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:15 smithi189 ceph-mon[32756]: pgmap v17084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:15.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30552.866769 secs 2024-04-27T02:59:15.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:15 smithi156 ceph-mon[32679]: pgmap v17084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30552.866769 secs 2024-04-27T02:59:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:15 smithi092 ceph-mon[29156]: pgmap v17084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:17 smithi189 ceph-mon[32756]: pgmap v17085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:17.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:17 smithi156 ceph-mon[32679]: pgmap v17085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:17 smithi092 ceph-mon[29156]: pgmap v17085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:19.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31254.900146 secs 2024-04-27T02:59:19.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31254.900146 secs 2024-04-27T02:59:19.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31254.900146 secs 2024-04-27T02:59:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30557.866848 secs 2024-04-27T02:59:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:20 smithi189 ceph-mon[32756]: pgmap v17086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30557.866848 secs 2024-04-27T02:59:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:20 smithi156 ceph-mon[32679]: pgmap v17086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30557.866848 secs 2024-04-27T02:59:20.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:20 smithi092 ceph-mon[29156]: pgmap v17086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:21 smithi189 ceph-mon[32756]: pgmap v17087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:21.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:21 smithi156 ceph-mon[32679]: pgmap v17087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:21 smithi092 ceph-mon[29156]: pgmap v17087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:59:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:59:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:59:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: pgmap v17088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:59:22.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: pgmap v17089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:22.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: pgmap v17088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: pgmap v17089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:22.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: pgmap v17088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: pgmap v17089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:22.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T02:59:24.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31259.900265 secs 2024-04-27T02:59:24.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31259.900265 secs 2024-04-27T02:59:24.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31259.900265 secs 2024-04-27T02:59:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30562.866913 secs 2024-04-27T02:59:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:25 smithi189 ceph-mon[32756]: pgmap v17090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30562.866913 secs 2024-04-27T02:59:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:25 smithi156 ceph-mon[32679]: pgmap v17090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30562.866913 secs 2024-04-27T02:59:25.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:25 smithi092 ceph-mon[29156]: pgmap v17090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:27.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:27 smithi189 ceph-mon[32756]: pgmap v17091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:27.680 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:27 smithi092 ceph-mon[29156]: pgmap v17091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:27.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:27 smithi156 ceph-mon[32679]: pgmap v17091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:29 smithi189 ceph-mon[32756]: pgmap v17092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:59:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31264.900397 secs 2024-04-27T02:59:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:29 smithi156 ceph-mon[32679]: pgmap v17092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:59:29.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31264.900397 secs 2024-04-27T02:59:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:29 smithi092 ceph-mon[29156]: pgmap v17092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T02:59:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31264.900397 secs 2024-04-27T02:59:30.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30567.867045 secs 2024-04-27T02:59:30.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30567.867045 secs 2024-04-27T02:59:30.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30567.867045 secs 2024-04-27T02:59:31.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:31 smithi189 ceph-mon[32756]: pgmap v17093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:31.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:31 smithi156 ceph-mon[32679]: pgmap v17093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:31.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:31 smithi092 ceph-mon[29156]: pgmap v17093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T02:59:33.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:33 smithi189 ceph-mon[32756]: pgmap v17094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:59:33.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:33 smithi156 ceph-mon[32679]: pgmap v17094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:59:33.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:33 smithi092 ceph-mon[29156]: pgmap v17094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T02:59:34.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31269.900525 secs 2024-04-27T02:59:34.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31269.900525 secs 2024-04-27T02:59:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31269.900525 secs 2024-04-27T02:59:35.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30572.867160 secs 2024-04-27T02:59:35.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:35 smithi156 ceph-mon[32679]: pgmap v17095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30572.867160 secs 2024-04-27T02:59:35.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:35 smithi189 ceph-mon[32756]: pgmap v17095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30572.867160 secs 2024-04-27T02:59:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:35 smithi092 ceph-mon[29156]: pgmap v17095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:37.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:37 smithi189 ceph-mon[32756]: pgmap v17096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:37.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:37 smithi156 ceph-mon[32679]: pgmap v17096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:37.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:37 smithi092 ceph-mon[29156]: pgmap v17096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:39 smithi189 ceph-mon[32756]: pgmap v17097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:39.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31274.900678 secs 2024-04-27T02:59:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:39 smithi156 ceph-mon[32679]: pgmap v17097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:39.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31274.900678 secs 2024-04-27T02:59:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:39 smithi092 ceph-mon[29156]: pgmap v17097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31274.900678 secs 2024-04-27T02:59:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30577.867319 secs 2024-04-27T02:59:40.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30577.867319 secs 2024-04-27T02:59:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30577.867319 secs 2024-04-27T02:59:41.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:41 smithi189 ceph-mon[32756]: pgmap v17098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:41.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:41 smithi156 ceph-mon[32679]: pgmap v17098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:41.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:41 smithi092 ceph-mon[29156]: pgmap v17098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:43.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:43 smithi189 ceph-mon[32756]: pgmap v17099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:43.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:43 smithi156 ceph-mon[32679]: pgmap v17099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:43.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:43 smithi092 ceph-mon[29156]: pgmap v17099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:44.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31279.900813 secs 2024-04-27T02:59:44.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31279.900813 secs 2024-04-27T02:59:44.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31279.900813 secs 2024-04-27T02:59:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30582.867429 secs 2024-04-27T02:59:45.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:45 smithi189 ceph-mon[32756]: pgmap v17100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30582.867429 secs 2024-04-27T02:59:45.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:45 smithi156 ceph-mon[32679]: pgmap v17100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30582.867429 secs 2024-04-27T02:59:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:45 smithi092 ceph-mon[29156]: pgmap v17100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:47.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:47 smithi189 ceph-mon[32756]: pgmap v17101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:47.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:47 smithi156 ceph-mon[32679]: pgmap v17101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:47.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:47 smithi092 ceph-mon[29156]: pgmap v17101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:49 smithi189 ceph-mon[32756]: pgmap v17102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31284.900930 secs 2024-04-27T02:59:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:49 smithi156 ceph-mon[32679]: pgmap v17102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:49.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31284.900930 secs 2024-04-27T02:59:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:49 smithi092 ceph-mon[29156]: pgmap v17102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:49.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31284.900930 secs 2024-04-27T02:59:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30587.867540 secs 2024-04-27T02:59:50.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30587.867540 secs 2024-04-27T02:59:50.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30587.867540 secs 2024-04-27T02:59:51.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:51 smithi189 ceph-mon[32756]: pgmap v17103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:51.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:51 smithi156 ceph-mon[32679]: pgmap v17103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:51.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:51 smithi092 ceph-mon[29156]: pgmap v17103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:53.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:53 smithi189 ceph-mon[32756]: pgmap v17104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:53.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:53 smithi156 ceph-mon[32679]: pgmap v17104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:53.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:53 smithi092 ceph-mon[29156]: pgmap v17104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:54.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31289.901035 secs 2024-04-27T02:59:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31289.901035 secs 2024-04-27T02:59:54.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31289.901035 secs 2024-04-27T02:59:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30592.867678 secs 2024-04-27T02:59:55.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:55 smithi189 ceph-mon[32756]: pgmap v17105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30592.867678 secs 2024-04-27T02:59:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:55 smithi156 ceph-mon[32679]: pgmap v17105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:55.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30592.867678 secs 2024-04-27T02:59:55.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:55 smithi092 ceph-mon[29156]: pgmap v17105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T02:59:57.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:57 smithi189 ceph-mon[32756]: pgmap v17106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:57.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:57 smithi156 ceph-mon[32679]: pgmap v17106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:57.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:57 smithi092 ceph-mon[29156]: pgmap v17106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:59 smithi189 ceph-mon[32756]: pgmap v17107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:59.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 02:59:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31294.901157 secs 2024-04-27T02:59:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:59 smithi156 ceph-mon[32679]: pgmap v17107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:59.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 02:59:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31294.901157 secs 2024-04-27T02:59:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:59 smithi092 ceph-mon[29156]: pgmap v17107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T02:59:59.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 02:59:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31294.901157 secs 2024-04-27T03:00:00.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30597.867809 secs 2024-04-27T03:00:00.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:00:00.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30597.867809 secs 2024-04-27T03:00:00.649 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:00:00.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30597.867809 secs 2024-04-27T03:00:00.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:00:01.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:01 smithi189 ceph-mon[32756]: pgmap v17108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:01.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:01 smithi156 ceph-mon[32679]: pgmap v17108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:01.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:01 smithi092 ceph-mon[29156]: pgmap v17108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:03.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:03 smithi189 ceph-mon[32756]: pgmap v17109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:03.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:03 smithi156 ceph-mon[32679]: pgmap v17109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:03.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:03 smithi092 ceph-mon[29156]: pgmap v17109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:04.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31299.901245 secs 2024-04-27T03:00:04.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31299.901245 secs 2024-04-27T03:00:04.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31299.901245 secs 2024-04-27T03:00:05.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30602.867920 secs 2024-04-27T03:00:05.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:05 smithi189 ceph-mon[32756]: pgmap v17110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30602.867920 secs 2024-04-27T03:00:05.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:05 smithi156 ceph-mon[32679]: pgmap v17110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30602.867920 secs 2024-04-27T03:00:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:05 smithi092 ceph-mon[29156]: pgmap v17110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:07.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:07 smithi189 ceph-mon[32756]: pgmap v17111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:07.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:07 smithi156 ceph-mon[32679]: pgmap v17111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:07 smithi092 ceph-mon[29156]: pgmap v17111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:09.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:09 smithi189 ceph-mon[32756]: pgmap v17112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31304.901372 secs 2024-04-27T03:00:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:09 smithi156 ceph-mon[32679]: pgmap v17112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:09.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31304.901372 secs 2024-04-27T03:00:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:09 smithi092 ceph-mon[29156]: pgmap v17112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:09.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31304.901372 secs 2024-04-27T03:00:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30607.868021 secs 2024-04-27T03:00:10.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30607.868021 secs 2024-04-27T03:00:10.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30607.868021 secs 2024-04-27T03:00:11.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:11 smithi189 ceph-mon[32756]: pgmap v17113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:11.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:11 smithi156 ceph-mon[32679]: pgmap v17113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:11.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:11 smithi092 ceph-mon[29156]: pgmap v17113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:13.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:13 smithi156 ceph-mon[32679]: pgmap v17114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:13.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:13 smithi092 ceph-mon[29156]: pgmap v17114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:13.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:13 smithi189 ceph-mon[32756]: pgmap v17114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:14.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31309.901463 secs 2024-04-27T03:00:14.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31309.901463 secs 2024-04-27T03:00:14.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31309.901463 secs 2024-04-27T03:00:15.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30612.868140 secs 2024-04-27T03:00:15.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:15 smithi156 ceph-mon[32679]: pgmap v17115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30612.868140 secs 2024-04-27T03:00:15.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:15 smithi092 ceph-mon[29156]: pgmap v17115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30612.868140 secs 2024-04-27T03:00:15.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:15 smithi189 ceph-mon[32756]: pgmap v17115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:17.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:17 smithi156 ceph-mon[32679]: pgmap v17116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:17.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:17 smithi092 ceph-mon[29156]: pgmap v17116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:17.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:17 smithi189 ceph-mon[32756]: pgmap v17116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:19.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:19 smithi156 ceph-mon[32679]: pgmap v17117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31314.901582 secs 2024-04-27T03:00:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:19 smithi092 ceph-mon[29156]: pgmap v17117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31314.901582 secs 2024-04-27T03:00:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:19 smithi189 ceph-mon[32756]: pgmap v17117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:19.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31314.901582 secs 2024-04-27T03:00:20.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30617.868259 secs 2024-04-27T03:00:20.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30617.868259 secs 2024-04-27T03:00:20.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30617.868259 secs 2024-04-27T03:00:21.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:21 smithi156 ceph-mon[32679]: pgmap v17118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:21.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:21 smithi092 ceph-mon[29156]: pgmap v17118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:21.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:21 smithi189 ceph-mon[32756]: pgmap v17118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:22.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:00:22.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:00:22.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:00:23.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:23 smithi156 ceph-mon[32679]: pgmap v17119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:23.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:00:23.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:00:23.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:00:23.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:23 smithi092 ceph-mon[29156]: pgmap v17119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:00:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:00:23.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:00:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:23 smithi189 ceph-mon[32756]: pgmap v17119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:23.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:00:23.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:00:23.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:00:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:24 smithi156 ceph-mon[32679]: pgmap v17120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:00:24.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:24 smithi156 ceph-mon[32679]: pgmap v17121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:00:24.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31319.901693 secs 2024-04-27T03:00:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:24 smithi092 ceph-mon[29156]: pgmap v17120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:00:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:24 smithi092 ceph-mon[29156]: pgmap v17121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:00:24.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31319.901693 secs 2024-04-27T03:00:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:24 smithi189 ceph-mon[32756]: pgmap v17120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:00:24.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:24 smithi189 ceph-mon[32756]: pgmap v17121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:00:24.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31319.901693 secs 2024-04-27T03:00:25.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30622.868367 secs 2024-04-27T03:00:25.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30622.868367 secs 2024-04-27T03:00:25.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30622.868367 secs 2024-04-27T03:00:26.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:26 smithi092 ceph-mon[29156]: pgmap v17122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:26.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:26 smithi189 ceph-mon[32756]: pgmap v17122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:26.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:26 smithi156 ceph-mon[32679]: pgmap v17122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:28.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:28 smithi092 ceph-mon[29156]: pgmap v17123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:28.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:28 smithi189 ceph-mon[32756]: pgmap v17123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:28.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:28 smithi156 ceph-mon[32679]: pgmap v17123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:29.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31324.901812 secs 2024-04-27T03:00:29.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31324.901812 secs 2024-04-27T03:00:29.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31324.901812 secs 2024-04-27T03:00:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:30 smithi092 ceph-mon[29156]: pgmap v17124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:30.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30627.868501 secs 2024-04-27T03:00:30.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:30 smithi189 ceph-mon[32756]: pgmap v17124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:30.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30627.868501 secs 2024-04-27T03:00:30.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:30 smithi156 ceph-mon[32679]: pgmap v17124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:30.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30627.868501 secs 2024-04-27T03:00:32.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:32 smithi092 ceph-mon[29156]: pgmap v17125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:32.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:32 smithi189 ceph-mon[32756]: pgmap v17125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:32.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:32 smithi156 ceph-mon[32679]: pgmap v17125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:00:34.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:34 smithi092 ceph-mon[29156]: pgmap v17126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:00:34.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31329.901920 secs 2024-04-27T03:00:34.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:34 smithi189 ceph-mon[32756]: pgmap v17126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:00:34.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31329.901920 secs 2024-04-27T03:00:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:34 smithi156 ceph-mon[32679]: pgmap v17126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:00:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31329.901920 secs 2024-04-27T03:00:35.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30632.868623 secs 2024-04-27T03:00:35.838 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30632.868623 secs 2024-04-27T03:00:35.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30632.868623 secs 2024-04-27T03:00:36.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:36 smithi092 ceph-mon[29156]: pgmap v17127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:36.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:36 smithi189 ceph-mon[32756]: pgmap v17127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:36.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:36 smithi156 ceph-mon[32679]: pgmap v17127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:38 smithi092 ceph-mon[29156]: pgmap v17128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:38.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:38 smithi189 ceph-mon[32756]: pgmap v17128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:38.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:38 smithi156 ceph-mon[32679]: pgmap v17128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:39.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:00:39.182+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:00:39.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:00:39.182+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:00:39.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:00:39.182+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:00:39.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:00:39.182+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:00:39.475 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:00:39.182+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:00:39.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31334.902037 secs 2024-04-27T03:00:39.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31334.902037 secs 2024-04-27T03:00:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31334.902037 secs 2024-04-27T03:00:40.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:00:40.284+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:00:40.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:00:40.284+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:00:40.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:00:40.284+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:00:40.289 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:00:40.284+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 242 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:00:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:40 smithi092 ceph-mon[29156]: pgmap v17129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:40.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30637.868759 secs 2024-04-27T03:00:40.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:40 smithi189 ceph-mon[32756]: pgmap v17129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:40.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30637.868759 secs 2024-04-27T03:00:40.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:40 smithi156 ceph-mon[32679]: pgmap v17129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:00:40.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30637.868759 secs 2024-04-27T03:00:42.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:42 smithi092 ceph-mon[29156]: pgmap v17130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:42.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:42 smithi189 ceph-mon[32756]: pgmap v17130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:42.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:42 smithi156 ceph-mon[32679]: pgmap v17130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:44 smithi092 ceph-mon[29156]: pgmap v17131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31339.902145 secs 2024-04-27T03:00:44.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:44 smithi189 ceph-mon[32756]: pgmap v17131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:44.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31339.902145 secs 2024-04-27T03:00:44.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:44 smithi156 ceph-mon[32679]: pgmap v17131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:44.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31339.902145 secs 2024-04-27T03:00:45.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30642.868897 secs 2024-04-27T03:00:45.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30642.868897 secs 2024-04-27T03:00:45.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30642.868897 secs 2024-04-27T03:00:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:46 smithi092 ceph-mon[29156]: pgmap v17132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:46.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:46 smithi189 ceph-mon[32756]: pgmap v17132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:46.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:46 smithi156 ceph-mon[32679]: pgmap v17132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:48.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:48 smithi092 ceph-mon[29156]: pgmap v17133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:48.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:48 smithi189 ceph-mon[32756]: pgmap v17133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:48.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:48 smithi156 ceph-mon[32679]: pgmap v17133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:49.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31344.902219 secs 2024-04-27T03:00:49.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31344.902219 secs 2024-04-27T03:00:49.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31344.902219 secs 2024-04-27T03:00:50.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:50 smithi189 ceph-mon[32756]: pgmap v17134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:50.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30647.869008 secs 2024-04-27T03:00:50.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:50 smithi156 ceph-mon[32679]: pgmap v17134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:50.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30647.869008 secs 2024-04-27T03:00:50.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:50 smithi092 ceph-mon[29156]: pgmap v17134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30647.869008 secs 2024-04-27T03:00:52.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:52 smithi189 ceph-mon[32756]: pgmap v17135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:52.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:52 smithi156 ceph-mon[32679]: pgmap v17135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:52.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:52 smithi092 ceph-mon[29156]: pgmap v17135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:54.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:54 smithi189 ceph-mon[32756]: pgmap v17136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:54.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31349.902366 secs 2024-04-27T03:00:54.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:54 smithi156 ceph-mon[32679]: pgmap v17136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:54.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31349.902366 secs 2024-04-27T03:00:54.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:54 smithi092 ceph-mon[29156]: pgmap v17136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:00:54.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31349.902366 secs 2024-04-27T03:00:55.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30652.869101 secs 2024-04-27T03:00:55.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30652.869101 secs 2024-04-27T03:00:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30652.869101 secs 2024-04-27T03:00:56.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:56 smithi189 ceph-mon[32756]: pgmap v17137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:56.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:56 smithi156 ceph-mon[32679]: pgmap v17137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:56 smithi092 ceph-mon[29156]: pgmap v17137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:00:57.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:57 smithi189 ceph-mon[32756]: pgmap v17138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:57.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:57 smithi156 ceph-mon[32679]: pgmap v17138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:57 smithi092 ceph-mon[29156]: pgmap v17138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:00:59.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:00:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31354.902457 secs 2024-04-27T03:00:59.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:00:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31354.902457 secs 2024-04-27T03:00:59.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:00:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31354.902457 secs 2024-04-27T03:01:00.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:00 smithi189 ceph-mon[32756]: pgmap v17139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:00.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30657.869242 secs 2024-04-27T03:01:00.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:00 smithi092 ceph-mon[29156]: pgmap v17139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:00.399 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30657.869242 secs 2024-04-27T03:01:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:00 smithi156 ceph-mon[32679]: pgmap v17139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:00.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30657.869242 secs 2024-04-27T03:01:02.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:02 smithi189 ceph-mon[32756]: pgmap v17140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:02.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:02 smithi156 ceph-mon[32679]: pgmap v17140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:02 smithi092 ceph-mon[29156]: pgmap v17140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:04.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:04 smithi189 ceph-mon[32756]: pgmap v17141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:04.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31359.902569 secs 2024-04-27T03:01:04.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:04 smithi156 ceph-mon[32679]: pgmap v17141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:04.511 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31359.902569 secs 2024-04-27T03:01:04.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:04 smithi092 ceph-mon[29156]: pgmap v17141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:04.512 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31359.902569 secs 2024-04-27T03:01:05.339 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30662.869378 secs 2024-04-27T03:01:05.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30662.869378 secs 2024-04-27T03:01:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30662.869378 secs 2024-04-27T03:01:06.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:06 smithi189 ceph-mon[32756]: pgmap v17142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:06.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:06 smithi156 ceph-mon[32679]: pgmap v17142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:06 smithi092 ceph-mon[29156]: pgmap v17142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:08.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:08 smithi189 ceph-mon[32756]: pgmap v17143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:08.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:08 smithi156 ceph-mon[32679]: pgmap v17143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:08 smithi092 ceph-mon[29156]: pgmap v17143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:09.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31364.902670 secs 2024-04-27T03:01:09.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31364.902670 secs 2024-04-27T03:01:09.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31364.902670 secs 2024-04-27T03:01:10.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:10 smithi189 ceph-mon[32756]: pgmap v17144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:10.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30667.869473 secs 2024-04-27T03:01:10.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:10 smithi156 ceph-mon[32679]: pgmap v17144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:10.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30667.869473 secs 2024-04-27T03:01:10.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:10 smithi092 ceph-mon[29156]: pgmap v17144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30667.869473 secs 2024-04-27T03:01:12.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:12 smithi189 ceph-mon[32756]: pgmap v17145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:12.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:12 smithi156 ceph-mon[32679]: pgmap v17145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:12.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:12 smithi092 ceph-mon[29156]: pgmap v17145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:14.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:14 smithi189 ceph-mon[32756]: pgmap v17146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:14.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31369.902747 secs 2024-04-27T03:01:14.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:14 smithi156 ceph-mon[32679]: pgmap v17146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:14.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31369.902747 secs 2024-04-27T03:01:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:14 smithi092 ceph-mon[29156]: pgmap v17146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:14.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31369.902747 secs 2024-04-27T03:01:15.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30672.869590 secs 2024-04-27T03:01:15.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30672.869590 secs 2024-04-27T03:01:15.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30672.869590 secs 2024-04-27T03:01:16.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:16 smithi189 ceph-mon[32756]: pgmap v17147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:16.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:16 smithi156 ceph-mon[32679]: pgmap v17147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:16.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:16 smithi092 ceph-mon[29156]: pgmap v17147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:18.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:18 smithi189 ceph-mon[32756]: pgmap v17148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:18.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:18 smithi156 ceph-mon[32679]: pgmap v17148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:18.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:18 smithi092 ceph-mon[29156]: pgmap v17148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:19.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31374.902892 secs 2024-04-27T03:01:19.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31374.902892 secs 2024-04-27T03:01:19.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31374.902892 secs 2024-04-27T03:01:20.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:20 smithi189 ceph-mon[32756]: pgmap v17149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:20.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30677.869683 secs 2024-04-27T03:01:20.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:20 smithi156 ceph-mon[32679]: pgmap v17149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:20.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30677.869683 secs 2024-04-27T03:01:20.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:20 smithi092 ceph-mon[29156]: pgmap v17149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:20.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30677.869683 secs 2024-04-27T03:01:22.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:22 smithi189 ceph-mon[32756]: pgmap v17150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:22.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:22 smithi156 ceph-mon[32679]: pgmap v17150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:22.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:22 smithi092 ceph-mon[29156]: pgmap v17150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:23.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:01:23.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:01:23.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:01:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: pgmap v17151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31379.902984 secs 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: pgmap v17151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31379.902984 secs 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: pgmap v17151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.439 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:24.440 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31379.902984 secs 2024-04-27T03:01:25.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30682.869745 secs 2024-04-27T03:01:25.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30682.869745 secs 2024-04-27T03:01:25.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30682.869745 secs 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: pgmap v17152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: pgmap v17152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: pgmap v17152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:26.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:27.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:01:27.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:01:27.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:27.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:01:27.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:01:27.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:01:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:01:28.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:01:28.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:28.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:28 smithi189 ceph-mon[32756]: pgmap v17153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:28.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:28 smithi189 ceph-mon[32756]: pgmap v17154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:28.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:01:28.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:28.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:28 smithi156 ceph-mon[32679]: pgmap v17153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:28.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:28 smithi156 ceph-mon[32679]: pgmap v17154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:01:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:01:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:28 smithi092 ceph-mon[29156]: pgmap v17153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:28.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:28 smithi092 ceph-mon[29156]: pgmap v17154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:29.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31384.903105 secs 2024-04-27T03:01:29.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31384.903105 secs 2024-04-27T03:01:29.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31384.903105 secs 2024-04-27T03:01:30.400 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:30 smithi092 ceph-mon[29156]: pgmap v17155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:30.400 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30687.869825 secs 2024-04-27T03:01:30.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:30 smithi156 ceph-mon[32679]: pgmap v17155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:30.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30687.869825 secs 2024-04-27T03:01:30.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:30 smithi189 ceph-mon[32756]: pgmap v17155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:30.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30687.869825 secs 2024-04-27T03:01:32.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:32 smithi156 ceph-mon[32679]: pgmap v17156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:32 smithi092 ceph-mon[29156]: pgmap v17156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:32.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:32 smithi189 ceph-mon[32756]: pgmap v17156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:34.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:34 smithi156 ceph-mon[32679]: pgmap v17157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:34.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31389.903221 secs 2024-04-27T03:01:34.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:34 smithi189 ceph-mon[32756]: pgmap v17157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:34.445 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31389.903221 secs 2024-04-27T03:01:34.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:34 smithi092 ceph-mon[29156]: pgmap v17157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:34.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31389.903221 secs 2024-04-27T03:01:35.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30692.869937 secs 2024-04-27T03:01:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30692.869937 secs 2024-04-27T03:01:35.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30692.869937 secs 2024-04-27T03:01:36.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:36 smithi156 ceph-mon[32679]: pgmap v17158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:36.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:36 smithi092 ceph-mon[29156]: pgmap v17158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:36.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:36 smithi189 ceph-mon[32756]: pgmap v17158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:01:38.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:38 smithi156 ceph-mon[32679]: pgmap v17159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:01:38.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:38 smithi092 ceph-mon[29156]: pgmap v17159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:01:38.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:38 smithi189 ceph-mon[32756]: pgmap v17159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:01:39.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31394.903318 secs 2024-04-27T03:01:39.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31394.903318 secs 2024-04-27T03:01:39.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31394.903318 secs 2024-04-27T03:01:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:40 smithi156 ceph-mon[32679]: pgmap v17160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30697.870011 secs 2024-04-27T03:01:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:40 smithi092 ceph-mon[29156]: pgmap v17160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:40.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30697.870011 secs 2024-04-27T03:01:40.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:40 smithi189 ceph-mon[32756]: pgmap v17160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:40.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30697.870011 secs 2024-04-27T03:01:42.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:42 smithi156 ceph-mon[32679]: pgmap v17161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:42.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:42 smithi092 ceph-mon[29156]: pgmap v17161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:42.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:42 smithi189 ceph-mon[32756]: pgmap v17161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:44.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:44 smithi156 ceph-mon[32679]: pgmap v17162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:44.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31399.903407 secs 2024-04-27T03:01:44.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:44 smithi092 ceph-mon[29156]: pgmap v17162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:44.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31399.903407 secs 2024-04-27T03:01:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:44 smithi189 ceph-mon[32756]: pgmap v17162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31399.903407 secs 2024-04-27T03:01:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:45 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 30702.870115 secs 2024-04-27T03:01:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:45 smithi156 ceph-mon[32679]: slow request 364.876654 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:01:45.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:45 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 30702.870115 secs 2024-04-27T03:01:45.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:45 smithi092 ceph-mon[29156]: slow request 364.876654 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:01:45.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:45 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 30702.870115 secs 2024-04-27T03:01:45.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:45 smithi189 ceph-mon[32756]: slow request 364.876654 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:01:46.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:46 smithi156 ceph-mon[32679]: pgmap v17163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:46.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:46 smithi092 ceph-mon[29156]: pgmap v17163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:46 smithi189 ceph-mon[32756]: pgmap v17163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:48.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:48 smithi092 ceph-mon[29156]: pgmap v17164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:48.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:48 smithi156 ceph-mon[32679]: pgmap v17164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:48.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:48 smithi189 ceph-mon[32756]: pgmap v17164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:49.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31404.903529 secs 2024-04-27T03:01:49.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31404.903529 secs 2024-04-27T03:01:49.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31404.903529 secs 2024-04-27T03:01:50.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:50 smithi092 ceph-mon[29156]: pgmap v17165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:50.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30707.870233 secs 2024-04-27T03:01:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:50 smithi189 ceph-mon[32756]: pgmap v17165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30707.870233 secs 2024-04-27T03:01:50.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:50 smithi156 ceph-mon[32679]: pgmap v17165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:50.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30707.870233 secs 2024-04-27T03:01:52.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:52 smithi092 ceph-mon[29156]: pgmap v17166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:52.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:52 smithi189 ceph-mon[32756]: pgmap v17166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:52.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:52 smithi156 ceph-mon[32679]: pgmap v17166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:54 smithi092 ceph-mon[29156]: pgmap v17167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31409.903599 secs 2024-04-27T03:01:54.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:54 smithi189 ceph-mon[32756]: pgmap v17167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31409.903599 secs 2024-04-27T03:01:54.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:54 smithi156 ceph-mon[32679]: pgmap v17167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:54.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31409.903599 secs 2024-04-27T03:01:55.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30712.870348 secs 2024-04-27T03:01:55.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30712.870348 secs 2024-04-27T03:01:55.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30712.870348 secs 2024-04-27T03:01:56.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:56 smithi092 ceph-mon[29156]: pgmap v17168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:56.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:56 smithi189 ceph-mon[32756]: pgmap v17168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:56.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:56 smithi156 ceph-mon[32679]: pgmap v17168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:01:58.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:58 smithi092 ceph-mon[29156]: pgmap v17169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:58.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:58 smithi189 ceph-mon[32756]: pgmap v17169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:58.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:58 smithi156 ceph-mon[32679]: pgmap v17169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:01:59.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:01:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31414.903731 secs 2024-04-27T03:01:59.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:01:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31414.903731 secs 2024-04-27T03:01:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:01:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31414.903731 secs 2024-04-27T03:02:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:00 smithi092 ceph-mon[29156]: pgmap v17170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:00.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30717.870484 secs 2024-04-27T03:02:00.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:00 smithi189 ceph-mon[32756]: pgmap v17170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:00.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30717.870484 secs 2024-04-27T03:02:00.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:00 smithi156 ceph-mon[32679]: pgmap v17170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:00.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30717.870484 secs 2024-04-27T03:02:02.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:02 smithi092 ceph-mon[29156]: pgmap v17171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:02.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:02 smithi189 ceph-mon[32756]: pgmap v17171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:02.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:02 smithi156 ceph-mon[32679]: pgmap v17171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:04.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:04 smithi092 ceph-mon[29156]: pgmap v17172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:04.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31419.903876 secs 2024-04-27T03:02:04.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:04 smithi189 ceph-mon[32756]: pgmap v17172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:04.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31419.903876 secs 2024-04-27T03:02:04.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:04 smithi156 ceph-mon[32679]: pgmap v17172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:04.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31419.903876 secs 2024-04-27T03:02:05.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30722.870606 secs 2024-04-27T03:02:05.590 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30722.870606 secs 2024-04-27T03:02:05.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30722.870606 secs 2024-04-27T03:02:06.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:06 smithi092 ceph-mon[29156]: pgmap v17173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:06.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:06 smithi189 ceph-mon[32756]: pgmap v17173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:06.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:06 smithi156 ceph-mon[32679]: pgmap v17173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:08 smithi092 ceph-mon[29156]: pgmap v17174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:08.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:08 smithi189 ceph-mon[32756]: pgmap v17174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:08.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:08 smithi156 ceph-mon[32679]: pgmap v17174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:09.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:09 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 31424.904008 secs 2024-04-27T03:02:09.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:09 smithi092 ceph-mon[29156]: slow request 2880.361088 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:02:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:09 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 31424.904008 secs 2024-04-27T03:02:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:09 smithi189 ceph-mon[32756]: slow request 2880.361088 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:02:09.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:09 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 31424.904008 secs 2024-04-27T03:02:09.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:09 smithi156 ceph-mon[32679]: slow request 2880.361088 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:02:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:10 smithi092 ceph-mon[29156]: pgmap v17175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30727.870731 secs 2024-04-27T03:02:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:10 smithi189 ceph-mon[32756]: pgmap v17175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30727.870731 secs 2024-04-27T03:02:10.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:10 smithi156 ceph-mon[32679]: pgmap v17175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:10.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30727.870731 secs 2024-04-27T03:02:12.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:12 smithi189 ceph-mon[32756]: pgmap v17176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:12.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:12 smithi156 ceph-mon[32679]: pgmap v17176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:12.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:12 smithi092 ceph-mon[29156]: pgmap v17176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:14 smithi189 ceph-mon[32756]: pgmap v17177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31429.904123 secs 2024-04-27T03:02:14.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:14 smithi156 ceph-mon[32679]: pgmap v17177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:14.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31429.904123 secs 2024-04-27T03:02:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:14 smithi092 ceph-mon[29156]: pgmap v17177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31429.904123 secs 2024-04-27T03:02:15.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30732.870853 secs 2024-04-27T03:02:15.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30732.870853 secs 2024-04-27T03:02:15.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30732.870853 secs 2024-04-27T03:02:16.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:16 smithi189 ceph-mon[32756]: pgmap v17178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:16.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:16 smithi156 ceph-mon[32679]: pgmap v17178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:16 smithi092 ceph-mon[29156]: pgmap v17178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:18.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:18 smithi189 ceph-mon[32756]: pgmap v17179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:18.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:18 smithi156 ceph-mon[32679]: pgmap v17179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:18.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:18 smithi092 ceph-mon[29156]: pgmap v17179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:19.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31434.904251 secs 2024-04-27T03:02:19.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31434.904251 secs 2024-04-27T03:02:19.713 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31434.904251 secs 2024-04-27T03:02:20.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:20 smithi189 ceph-mon[32756]: pgmap v17180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:20.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30737.870970 secs 2024-04-27T03:02:20.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:20 smithi156 ceph-mon[32679]: pgmap v17180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:20.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30737.870970 secs 2024-04-27T03:02:20.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:20 smithi092 ceph-mon[29156]: pgmap v17180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:20.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30737.870970 secs 2024-04-27T03:02:22.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:22 smithi189 ceph-mon[32756]: pgmap v17181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:22.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:22 smithi156 ceph-mon[32679]: pgmap v17181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:22.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:22 smithi092 ceph-mon[29156]: pgmap v17181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:24.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:24 smithi189 ceph-mon[32756]: pgmap v17182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:24.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31439.904394 secs 2024-04-27T03:02:24.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:24 smithi156 ceph-mon[32679]: pgmap v17182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:24.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31439.904394 secs 2024-04-27T03:02:24.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:24 smithi092 ceph-mon[29156]: pgmap v17182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:24.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31439.904394 secs 2024-04-27T03:02:25.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30742.871108 secs 2024-04-27T03:02:25.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30742.871108 secs 2024-04-27T03:02:25.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30742.871108 secs 2024-04-27T03:02:26.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:26 smithi189 ceph-mon[32756]: pgmap v17183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:26.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:26 smithi156 ceph-mon[32679]: pgmap v17183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:26.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:26 smithi092 ceph-mon[29156]: pgmap v17183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:27.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:02:27.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:02:27.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: pgmap v17184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: pgmap v17185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: pgmap v17186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:28.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:02:28.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: pgmap v17184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:02:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:02:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: pgmap v17185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:02:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: pgmap v17186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:02:28.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: pgmap v17184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:28.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:02:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:02:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: pgmap v17185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:02:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: pgmap v17186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:02:29.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31444.904493 secs 2024-04-27T03:02:29.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31444.904493 secs 2024-04-27T03:02:29.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31444.904493 secs 2024-04-27T03:02:30.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30747.871223 secs 2024-04-27T03:02:30.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:30 smithi189 ceph-mon[32756]: pgmap v17187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:30.650 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30747.871223 secs 2024-04-27T03:02:30.650 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:30 smithi092 ceph-mon[29156]: pgmap v17187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:30.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30747.871223 secs 2024-04-27T03:02:30.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:30 smithi156 ceph-mon[32679]: pgmap v17187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:32.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:32 smithi092 ceph-mon[29156]: pgmap v17188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:32.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:32 smithi189 ceph-mon[32756]: pgmap v17188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:32 smithi156 ceph-mon[32679]: pgmap v17188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:34 smithi092 ceph-mon[29156]: pgmap v17189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31449.904614 secs 2024-04-27T03:02:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:34 smithi189 ceph-mon[32756]: pgmap v17189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31449.904614 secs 2024-04-27T03:02:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:34 smithi156 ceph-mon[32679]: pgmap v17189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:02:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31449.904614 secs 2024-04-27T03:02:35.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30752.871346 secs 2024-04-27T03:02:35.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30752.871346 secs 2024-04-27T03:02:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30752.871346 secs 2024-04-27T03:02:36.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:36 smithi092 ceph-mon[29156]: pgmap v17190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:36 smithi189 ceph-mon[32756]: pgmap v17190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:36 smithi156 ceph-mon[32679]: pgmap v17190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:02:38.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:38 smithi092 ceph-mon[29156]: pgmap v17191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:02:38.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:38 smithi189 ceph-mon[32756]: pgmap v17191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:02:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:38 smithi156 ceph-mon[32679]: pgmap v17191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:02:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31454.904736 secs 2024-04-27T03:02:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31454.904736 secs 2024-04-27T03:02:39.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31454.904736 secs 2024-04-27T03:02:40.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30757.871466 secs 2024-04-27T03:02:40.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:40 smithi092 ceph-mon[29156]: pgmap v17192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30757.871466 secs 2024-04-27T03:02:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:40 smithi189 ceph-mon[32756]: pgmap v17192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30757.871466 secs 2024-04-27T03:02:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:40 smithi156 ceph-mon[32679]: pgmap v17192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:42.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:42 smithi092 ceph-mon[29156]: pgmap v17193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:42.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:42 smithi189 ceph-mon[32756]: pgmap v17193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:42.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:42 smithi156 ceph-mon[32679]: pgmap v17193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:44 smithi189 ceph-mon[32756]: pgmap v17194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31459.904861 secs 2024-04-27T03:02:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:44 smithi156 ceph-mon[32679]: pgmap v17194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31459.904861 secs 2024-04-27T03:02:44.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:44 smithi092 ceph-mon[29156]: pgmap v17194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31459.904861 secs 2024-04-27T03:02:45.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30762.871584 secs 2024-04-27T03:02:45.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30762.871584 secs 2024-04-27T03:02:45.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30762.871584 secs 2024-04-27T03:02:46.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:46 smithi189 ceph-mon[32756]: pgmap v17195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:46.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:46 smithi156 ceph-mon[32679]: pgmap v17195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:46 smithi092 ceph-mon[29156]: pgmap v17195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:48.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:48 smithi189 ceph-mon[32756]: pgmap v17196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:48.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:48 smithi156 ceph-mon[32679]: pgmap v17196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:48.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:48 smithi092 ceph-mon[29156]: pgmap v17196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31464.904956 secs 2024-04-27T03:02:49.922 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31464.904956 secs 2024-04-27T03:02:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31464.904956 secs 2024-04-27T03:02:50.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30767.871702 secs 2024-04-27T03:02:50.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:50 smithi189 ceph-mon[32756]: pgmap v17197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30767.871702 secs 2024-04-27T03:02:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:50 smithi156 ceph-mon[32679]: pgmap v17197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30767.871702 secs 2024-04-27T03:02:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:50 smithi092 ceph-mon[29156]: pgmap v17197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:52.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:52 smithi189 ceph-mon[32756]: pgmap v17198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:52.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:52 smithi156 ceph-mon[32679]: pgmap v17198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:52 smithi092 ceph-mon[29156]: pgmap v17198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:54 smithi189 ceph-mon[32756]: pgmap v17199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31469.905076 secs 2024-04-27T03:02:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:54 smithi156 ceph-mon[32679]: pgmap v17199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31469.905076 secs 2024-04-27T03:02:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:54 smithi092 ceph-mon[29156]: pgmap v17199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31469.905076 secs 2024-04-27T03:02:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30772.871804 secs 2024-04-27T03:02:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:55 smithi189 ceph-mon[32756]: pgmap v17200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30772.871804 secs 2024-04-27T03:02:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:55 smithi156 ceph-mon[32679]: pgmap v17200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30772.871804 secs 2024-04-27T03:02:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:55 smithi092 ceph-mon[29156]: pgmap v17200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:02:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:58 smithi092 ceph-mon[29156]: pgmap v17201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:58 smithi189 ceph-mon[32756]: pgmap v17201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:58 smithi156 ceph-mon[32679]: pgmap v17201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:02:59.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:02:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31474.905200 secs 2024-04-27T03:02:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:02:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31474.905200 secs 2024-04-27T03:02:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:02:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31474.905200 secs 2024-04-27T03:03:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30777.871926 secs 2024-04-27T03:03:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:00 smithi092 ceph-mon[29156]: pgmap v17202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30777.871926 secs 2024-04-27T03:03:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:00 smithi189 ceph-mon[32756]: pgmap v17202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30777.871926 secs 2024-04-27T03:03:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:00 smithi156 ceph-mon[32679]: pgmap v17202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:02.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:02 smithi092 ceph-mon[29156]: pgmap v17203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:02 smithi189 ceph-mon[32756]: pgmap v17203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:02 smithi156 ceph-mon[32679]: pgmap v17203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:04 smithi092 ceph-mon[29156]: pgmap v17204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31479.905350 secs 2024-04-27T03:03:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:04 smithi189 ceph-mon[32756]: pgmap v17204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31479.905350 secs 2024-04-27T03:03:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:04 smithi156 ceph-mon[32679]: pgmap v17204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31479.905350 secs 2024-04-27T03:03:05.794 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30782.872049 secs 2024-04-27T03:03:05.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30782.872049 secs 2024-04-27T03:03:05.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30782.872049 secs 2024-04-27T03:03:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:06 smithi189 ceph-mon[32756]: pgmap v17205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:06 smithi156 ceph-mon[32679]: pgmap v17205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:06 smithi092 ceph-mon[29156]: pgmap v17205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:08.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:08 smithi189 ceph-mon[32756]: pgmap v17206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:08 smithi156 ceph-mon[32679]: pgmap v17206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:08 smithi092 ceph-mon[29156]: pgmap v17206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31484.905446 secs 2024-04-27T03:03:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31484.905446 secs 2024-04-27T03:03:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31484.905446 secs 2024-04-27T03:03:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30787.872187 secs 2024-04-27T03:03:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:10 smithi189 ceph-mon[32756]: pgmap v17207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30787.872187 secs 2024-04-27T03:03:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:10 smithi156 ceph-mon[32679]: pgmap v17207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30787.872187 secs 2024-04-27T03:03:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:10 smithi092 ceph-mon[29156]: pgmap v17207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:12 smithi189 ceph-mon[32756]: pgmap v17208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:12 smithi156 ceph-mon[32679]: pgmap v17208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:12 smithi092 ceph-mon[29156]: pgmap v17208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:13.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:13 smithi189 ceph-mon[32756]: pgmap v17209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:13.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:13 smithi156 ceph-mon[32679]: pgmap v17209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:13.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:13 smithi092 ceph-mon[29156]: pgmap v17209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31489.905563 secs 2024-04-27T03:03:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31489.905563 secs 2024-04-27T03:03:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31489.905563 secs 2024-04-27T03:03:15.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30792.872324 secs 2024-04-27T03:03:15.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:15 smithi189 ceph-mon[32756]: pgmap v17210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:15.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30792.872324 secs 2024-04-27T03:03:15.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:15 smithi156 ceph-mon[32679]: pgmap v17210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30792.872324 secs 2024-04-27T03:03:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:15 smithi092 ceph-mon[29156]: pgmap v17210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:18 smithi092 ceph-mon[29156]: pgmap v17211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:18 smithi189 ceph-mon[32756]: pgmap v17211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:18 smithi156 ceph-mon[32679]: pgmap v17211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31494.905705 secs 2024-04-27T03:03:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31494.905705 secs 2024-04-27T03:03:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31494.905705 secs 2024-04-27T03:03:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30797.872435 secs 2024-04-27T03:03:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:20 smithi092 ceph-mon[29156]: pgmap v17212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30797.872435 secs 2024-04-27T03:03:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:20 smithi189 ceph-mon[32756]: pgmap v17212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30797.872435 secs 2024-04-27T03:03:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:20 smithi156 ceph-mon[32679]: pgmap v17212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:22 smithi092 ceph-mon[29156]: pgmap v17213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:22 smithi189 ceph-mon[32756]: pgmap v17213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:22 smithi156 ceph-mon[32679]: pgmap v17213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:24 smithi189 ceph-mon[32756]: pgmap v17214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31499.905836 secs 2024-04-27T03:03:24.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:24 smithi156 ceph-mon[32679]: pgmap v17214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:24.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31499.905836 secs 2024-04-27T03:03:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:24 smithi092 ceph-mon[29156]: pgmap v17214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31499.905836 secs 2024-04-27T03:03:25.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30802.872539 secs 2024-04-27T03:03:25.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30802.872539 secs 2024-04-27T03:03:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30802.872539 secs 2024-04-27T03:03:26.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:26 smithi189 ceph-mon[32756]: pgmap v17215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:26 smithi156 ceph-mon[32679]: pgmap v17215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:26 smithi092 ceph-mon[29156]: pgmap v17215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:28 smithi189 ceph-mon[32756]: pgmap v17216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:03:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:03:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:03:28.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:03:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:28 smithi156 ceph-mon[32679]: pgmap v17216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:03:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:03:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:03:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:03:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:28 smithi092 ceph-mon[29156]: pgmap v17216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:03:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:03:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:03:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:03:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:29 smithi189 ceph-mon[32756]: pgmap v17217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:03:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:29 smithi189 ceph-mon[32756]: pgmap v17218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:03:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31504.905945 secs 2024-04-27T03:03:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:29 smithi156 ceph-mon[32679]: pgmap v17217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:03:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:29 smithi156 ceph-mon[32679]: pgmap v17218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:03:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31504.905945 secs 2024-04-27T03:03:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:29 smithi092 ceph-mon[29156]: pgmap v17217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:03:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:29 smithi092 ceph-mon[29156]: pgmap v17218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:03:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31504.905945 secs 2024-04-27T03:03:30.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30807.872693 secs 2024-04-27T03:03:30.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30807.872693 secs 2024-04-27T03:03:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30807.872693 secs 2024-04-27T03:03:31.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:31 smithi189 ceph-mon[32756]: pgmap v17219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:31.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:31 smithi156 ceph-mon[32679]: pgmap v17219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:31 smithi092 ceph-mon[29156]: pgmap v17219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:33.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:33 smithi189 ceph-mon[32756]: pgmap v17220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:33 smithi156 ceph-mon[32679]: pgmap v17220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:33 smithi092 ceph-mon[29156]: pgmap v17220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:34.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31509.906037 secs 2024-04-27T03:03:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31509.906037 secs 2024-04-27T03:03:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31509.906037 secs 2024-04-27T03:03:35.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30812.872846 secs 2024-04-27T03:03:35.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:35 smithi156 ceph-mon[32679]: pgmap v17221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30812.872846 secs 2024-04-27T03:03:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:35 smithi189 ceph-mon[32756]: pgmap v17221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30812.872846 secs 2024-04-27T03:03:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:35 smithi092 ceph-mon[29156]: pgmap v17221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001852) for more than 900000000 us, fault. 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca80d5000 comp rx=0 tx=0).stop 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.042+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.043+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca8095000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T03:03:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.084+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T03:03:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T03:03:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T03:03:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=33 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T03:03:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:03:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T03:03:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:36.085+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T03:03:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:36 smithi189 ceph-mon[32756]: pgmap v17222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:36 smithi156 ceph-mon[32679]: pgmap v17222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:36 smithi092 ceph-mon[29156]: pgmap v17222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:03:39.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:39 smithi189 ceph-mon[32756]: pgmap v17223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:03:39.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31514.906155 secs 2024-04-27T03:03:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:39 smithi156 ceph-mon[32679]: pgmap v17223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:03:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31514.906155 secs 2024-04-27T03:03:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:39 smithi092 ceph-mon[29156]: pgmap v17223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:03:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31514.906155 secs 2024-04-27T03:03:40.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:40.309+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:03:40.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:40.309+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:03:40.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:40.309+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:03:40.315 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:03:40.309+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 243 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:03:40.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30817.872969 secs 2024-04-27T03:03:40.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30817.872969 secs 2024-04-27T03:03:40.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30817.872969 secs 2024-04-27T03:03:41.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:41 smithi189 ceph-mon[32756]: pgmap v17224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:41.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:41 smithi156 ceph-mon[32679]: pgmap v17224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:41.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:41 smithi092 ceph-mon[29156]: pgmap v17224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:43.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:43 smithi189 ceph-mon[32756]: pgmap v17225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:43.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:43 smithi156 ceph-mon[32679]: pgmap v17225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:43.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:43 smithi092 ceph-mon[29156]: pgmap v17225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:44.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31519.906268 secs 2024-04-27T03:03:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31519.906268 secs 2024-04-27T03:03:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31519.906268 secs 2024-04-27T03:03:45.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30822.873106 secs 2024-04-27T03:03:45.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:45 smithi189 ceph-mon[32756]: pgmap v17226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:45.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30822.873106 secs 2024-04-27T03:03:45.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:45 smithi156 ceph-mon[32679]: pgmap v17226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30822.873106 secs 2024-04-27T03:03:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:45 smithi092 ceph-mon[29156]: pgmap v17226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:47.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:47 smithi189 ceph-mon[32756]: pgmap v17227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:47.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:47 smithi156 ceph-mon[32679]: pgmap v17227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:47 smithi092 ceph-mon[29156]: pgmap v17227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:49.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:49 smithi189 ceph-mon[32756]: pgmap v17228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:49.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31524.906377 secs 2024-04-27T03:03:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:49 smithi156 ceph-mon[32679]: pgmap v17228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31524.906377 secs 2024-04-27T03:03:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:49 smithi092 ceph-mon[29156]: pgmap v17228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31524.906377 secs 2024-04-27T03:03:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30827.873175 secs 2024-04-27T03:03:50.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30827.873175 secs 2024-04-27T03:03:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30827.873175 secs 2024-04-27T03:03:51.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:51 smithi189 ceph-mon[32756]: pgmap v17229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:51.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:51 smithi156 ceph-mon[32679]: pgmap v17229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:51 smithi092 ceph-mon[29156]: pgmap v17229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:53.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:53 smithi189 ceph-mon[32756]: pgmap v17230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:53.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:53 smithi156 ceph-mon[32679]: pgmap v17230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:53.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:53 smithi092 ceph-mon[29156]: pgmap v17230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31529.906513 secs 2024-04-27T03:03:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31529.906513 secs 2024-04-27T03:03:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31529.906513 secs 2024-04-27T03:03:55.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30832.873268 secs 2024-04-27T03:03:55.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:55 smithi189 ceph-mon[32756]: pgmap v17231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30832.873268 secs 2024-04-27T03:03:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:55 smithi156 ceph-mon[32679]: pgmap v17231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:55.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30832.873268 secs 2024-04-27T03:03:55.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:55 smithi092 ceph-mon[29156]: pgmap v17231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:03:57.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:57 smithi189 ceph-mon[32756]: pgmap v17232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:57 smithi156 ceph-mon[32679]: pgmap v17232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:57.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:57 smithi092 ceph-mon[29156]: pgmap v17232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:59.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:59 smithi189 ceph-mon[32756]: pgmap v17233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:59.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:03:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31534.906645 secs 2024-04-27T03:03:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:59 smithi156 ceph-mon[32679]: pgmap v17233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:03:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31534.906645 secs 2024-04-27T03:03:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:59 smithi092 ceph-mon[29156]: pgmap v17233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:03:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:03:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31534.906645 secs 2024-04-27T03:04:00.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30837.873376 secs 2024-04-27T03:04:00.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30837.873376 secs 2024-04-27T03:04:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30837.873376 secs 2024-04-27T03:04:01.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:01 smithi189 ceph-mon[32756]: pgmap v17234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:01.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:01 smithi156 ceph-mon[32679]: pgmap v17234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:01 smithi092 ceph-mon[29156]: pgmap v17234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:03.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:03 smithi189 ceph-mon[32756]: pgmap v17235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:03.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:03 smithi156 ceph-mon[32679]: pgmap v17235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:03.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:03 smithi092 ceph-mon[29156]: pgmap v17235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:04.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31539.906773 secs 2024-04-27T03:04:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31539.906773 secs 2024-04-27T03:04:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31539.906773 secs 2024-04-27T03:04:05.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30842.873488 secs 2024-04-27T03:04:05.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:05 smithi156 ceph-mon[32679]: pgmap v17236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:05.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30842.873488 secs 2024-04-27T03:04:05.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:05 smithi189 ceph-mon[32756]: pgmap v17236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:05.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30842.873488 secs 2024-04-27T03:04:05.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:05 smithi092 ceph-mon[29156]: pgmap v17236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:07.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:07 smithi189 ceph-mon[32756]: pgmap v17237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:07.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:07 smithi156 ceph-mon[32679]: pgmap v17237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:07 smithi092 ceph-mon[29156]: pgmap v17237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:09 smithi189 ceph-mon[32756]: pgmap v17238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:09.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31544.906890 secs 2024-04-27T03:04:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:09 smithi156 ceph-mon[32679]: pgmap v17238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31544.906890 secs 2024-04-27T03:04:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:09 smithi092 ceph-mon[29156]: pgmap v17238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31544.906890 secs 2024-04-27T03:04:10.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:10 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 30847.873574 secs 2024-04-27T03:04:10.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:10 smithi189 ceph-mon[32756]: slow request 1440.132232 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:04:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:10 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 30847.873574 secs 2024-04-27T03:04:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:10 smithi156 ceph-mon[32679]: slow request 1440.132232 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:04:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:10 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 30847.873574 secs 2024-04-27T03:04:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:10 smithi092 ceph-mon[29156]: slow request 1440.132232 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:04:11.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:11 smithi189 ceph-mon[32756]: pgmap v17239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:11.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:11 smithi156 ceph-mon[32679]: pgmap v17239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:11.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:11 smithi092 ceph-mon[29156]: pgmap v17239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:13.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:13 smithi189 ceph-mon[32756]: pgmap v17240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:13.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:13 smithi156 ceph-mon[32679]: pgmap v17240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:13.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:13 smithi092 ceph-mon[29156]: pgmap v17240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:14.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31549.907002 secs 2024-04-27T03:04:14.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31549.907002 secs 2024-04-27T03:04:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31549.907002 secs 2024-04-27T03:04:15.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30852.873700 secs 2024-04-27T03:04:15.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:15 smithi189 ceph-mon[32756]: pgmap v17241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:15.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30852.873700 secs 2024-04-27T03:04:15.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:15 smithi156 ceph-mon[32679]: pgmap v17241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:15.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30852.873700 secs 2024-04-27T03:04:15.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:15 smithi092 ceph-mon[29156]: pgmap v17241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:17.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:17 smithi189 ceph-mon[32756]: pgmap v17242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:17.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:17 smithi156 ceph-mon[32679]: pgmap v17242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:17.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:17 smithi092 ceph-mon[29156]: pgmap v17242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:19 smithi189 ceph-mon[32756]: pgmap v17243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31554.907097 secs 2024-04-27T03:04:19.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:19 smithi156 ceph-mon[32679]: pgmap v17243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:19.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31554.907097 secs 2024-04-27T03:04:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:19 smithi092 ceph-mon[29156]: pgmap v17243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:04:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31554.907097 secs 2024-04-27T03:04:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30857.873841 secs 2024-04-27T03:04:20.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30857.873841 secs 2024-04-27T03:04:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30857.873841 secs 2024-04-27T03:04:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:21 smithi189 ceph-mon[32756]: pgmap v17244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:21.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:21 smithi156 ceph-mon[32679]: pgmap v17244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:21 smithi092 ceph-mon[29156]: pgmap v17244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:04:23.618 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:23 smithi092 ceph-mon[29156]: pgmap v17245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:23.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:23 smithi189 ceph-mon[32756]: pgmap v17245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:23.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:23 smithi156 ceph-mon[32679]: pgmap v17245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:24.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31559.907194 secs 2024-04-27T03:04:24.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31559.907194 secs 2024-04-27T03:04:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31559.907194 secs 2024-04-27T03:04:25.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30862.873958 secs 2024-04-27T03:04:25.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:25 smithi189 ceph-mon[32756]: pgmap v17246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:25.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30862.873958 secs 2024-04-27T03:04:25.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:25 smithi156 ceph-mon[32679]: pgmap v17246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:25.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30862.873958 secs 2024-04-27T03:04:25.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:25 smithi092 ceph-mon[29156]: pgmap v17246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:27.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:27 smithi189 ceph-mon[32756]: pgmap v17247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:27.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:27 smithi156 ceph-mon[32679]: pgmap v17247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:27.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:27 smithi092 ceph-mon[29156]: pgmap v17247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:28.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:04:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:04:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:04:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:29 smithi189 ceph-mon[32756]: pgmap v17248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31564.907263 secs 2024-04-27T03:04:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:04:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:04:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:04:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:29 smithi156 ceph-mon[32679]: pgmap v17248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31564.907263 secs 2024-04-27T03:04:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:04:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:04:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:04:29.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:29 smithi092 ceph-mon[29156]: pgmap v17248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:29.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31564.907263 secs 2024-04-27T03:04:29.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:04:29.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:04:29.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:04:30.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:30 smithi189 ceph-mon[32756]: pgmap v17249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:30.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30867.874052 secs 2024-04-27T03:04:30.650 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:30 smithi092 ceph-mon[29156]: pgmap v17249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:30.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30867.874052 secs 2024-04-27T03:04:30.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:30 smithi156 ceph-mon[32679]: pgmap v17249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:30.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30867.874052 secs 2024-04-27T03:04:32.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:32 smithi156 ceph-mon[32679]: pgmap v17250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:32.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:32 smithi092 ceph-mon[29156]: pgmap v17250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:32.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:32 smithi189 ceph-mon[32756]: pgmap v17250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:34.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:34 smithi156 ceph-mon[32679]: pgmap v17251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:34.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31569.907326 secs 2024-04-27T03:04:34.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:34 smithi189 ceph-mon[32756]: pgmap v17251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:34.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31569.907326 secs 2024-04-27T03:04:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:34 smithi092 ceph-mon[29156]: pgmap v17251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:34.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31569.907326 secs 2024-04-27T03:04:35.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30872.874184 secs 2024-04-27T03:04:35.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30872.874184 secs 2024-04-27T03:04:35.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30872.874184 secs 2024-04-27T03:04:36.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:36 smithi156 ceph-mon[32679]: pgmap v17252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:36.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:36 smithi092 ceph-mon[29156]: pgmap v17252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:36 smithi189 ceph-mon[32756]: pgmap v17252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:38.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:38 smithi156 ceph-mon[32679]: pgmap v17253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:38.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:38 smithi092 ceph-mon[29156]: pgmap v17253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:38.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:38 smithi189 ceph-mon[32756]: pgmap v17253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:04:39.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31574.907441 secs 2024-04-27T03:04:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31574.907441 secs 2024-04-27T03:04:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31574.907441 secs 2024-04-27T03:04:40.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:40 smithi156 ceph-mon[32679]: pgmap v17254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:40.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30877.874369 secs 2024-04-27T03:04:40.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:40 smithi092 ceph-mon[29156]: pgmap v17254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:40.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30877.874369 secs 2024-04-27T03:04:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:40 smithi189 ceph-mon[32756]: pgmap v17254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:04:40.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30877.874369 secs 2024-04-27T03:04:42.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:42 smithi156 ceph-mon[32679]: pgmap v17255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:42.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:42 smithi092 ceph-mon[29156]: pgmap v17255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:42.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:42 smithi189 ceph-mon[32756]: pgmap v17255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:44 smithi156 ceph-mon[32679]: pgmap v17256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:44.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31579.907556 secs 2024-04-27T03:04:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:44 smithi092 ceph-mon[29156]: pgmap v17256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:44.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31579.907556 secs 2024-04-27T03:04:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:44 smithi189 ceph-mon[32756]: pgmap v17256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31579.907556 secs 2024-04-27T03:04:45.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30882.874482 secs 2024-04-27T03:04:45.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30882.874482 secs 2024-04-27T03:04:45.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30882.874482 secs 2024-04-27T03:04:46.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:46 smithi156 ceph-mon[32679]: pgmap v17257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:46 smithi092 ceph-mon[29156]: pgmap v17257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:46.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:46 smithi189 ceph-mon[32756]: pgmap v17257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:48.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:48 smithi156 ceph-mon[32679]: pgmap v17258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:48.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:48 smithi092 ceph-mon[29156]: pgmap v17258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:48.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:48 smithi189 ceph-mon[32756]: pgmap v17258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:49.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31584.907667 secs 2024-04-27T03:04:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31584.907667 secs 2024-04-27T03:04:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31584.907667 secs 2024-04-27T03:04:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:50 smithi092 ceph-mon[29156]: pgmap v17259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:50.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30887.874555 secs 2024-04-27T03:04:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:50 smithi189 ceph-mon[32756]: pgmap v17259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30887.874555 secs 2024-04-27T03:04:50.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:50 smithi156 ceph-mon[32679]: pgmap v17259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:50.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30887.874555 secs 2024-04-27T03:04:52.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:52 smithi092 ceph-mon[29156]: pgmap v17260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:52.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:52 smithi189 ceph-mon[32756]: pgmap v17260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:52.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:52 smithi156 ceph-mon[32679]: pgmap v17260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:54.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:54 smithi092 ceph-mon[29156]: pgmap v17261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:54.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31589.907814 secs 2024-04-27T03:04:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:54 smithi189 ceph-mon[32756]: pgmap v17261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31589.907814 secs 2024-04-27T03:04:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:54 smithi156 ceph-mon[32679]: pgmap v17261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31589.907814 secs 2024-04-27T03:04:55.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30892.874693 secs 2024-04-27T03:04:55.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30892.874693 secs 2024-04-27T03:04:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30892.874693 secs 2024-04-27T03:04:56.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:56 smithi092 ceph-mon[29156]: pgmap v17262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:56.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:56 smithi189 ceph-mon[32756]: pgmap v17262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:56.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:56 smithi156 ceph-mon[32679]: pgmap v17262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:04:58.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:58 smithi092 ceph-mon[29156]: pgmap v17263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:58.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:58 smithi189 ceph-mon[32756]: pgmap v17263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:58.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:58 smithi156 ceph-mon[32679]: pgmap v17263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:04:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:04:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31594.907928 secs 2024-04-27T03:04:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:04:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31594.907928 secs 2024-04-27T03:04:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:04:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31594.907928 secs 2024-04-27T03:05:00.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:00 smithi092 ceph-mon[29156]: pgmap v17264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:00.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30897.874772 secs 2024-04-27T03:05:00.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:00 smithi189 ceph-mon[32756]: pgmap v17264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:00.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30897.874772 secs 2024-04-27T03:05:00.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:00 smithi156 ceph-mon[32679]: pgmap v17264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:00.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30897.874772 secs 2024-04-27T03:05:02.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:02 smithi092 ceph-mon[29156]: pgmap v17265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:02.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:02 smithi189 ceph-mon[32756]: pgmap v17265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:02.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:02 smithi156 ceph-mon[32679]: pgmap v17265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:04.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:04 smithi092 ceph-mon[29156]: pgmap v17266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:04.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31599.908074 secs 2024-04-27T03:05:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:04 smithi189 ceph-mon[32756]: pgmap v17266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31599.908074 secs 2024-04-27T03:05:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:04 smithi156 ceph-mon[32679]: pgmap v17266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31599.908074 secs 2024-04-27T03:05:05.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30902.874906 secs 2024-04-27T03:05:05.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30902.874906 secs 2024-04-27T03:05:05.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30902.874906 secs 2024-04-27T03:05:06.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:06 smithi092 ceph-mon[29156]: pgmap v17267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:06.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:06 smithi189 ceph-mon[32756]: pgmap v17267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:06.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:06 smithi156 ceph-mon[32679]: pgmap v17267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:08.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:08 smithi092 ceph-mon[29156]: pgmap v17268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:08.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:08 smithi189 ceph-mon[32756]: pgmap v17268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:08.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:08 smithi156 ceph-mon[32679]: pgmap v17268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:09.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31604.908187 secs 2024-04-27T03:05:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31604.908187 secs 2024-04-27T03:05:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31604.908187 secs 2024-04-27T03:05:10.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:10 smithi092 ceph-mon[29156]: pgmap v17269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:10.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30907.874968 secs 2024-04-27T03:05:10.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:10 smithi189 ceph-mon[32756]: pgmap v17269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:10.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30907.874968 secs 2024-04-27T03:05:10.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:10 smithi156 ceph-mon[32679]: pgmap v17269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:10.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30907.874968 secs 2024-04-27T03:05:12.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:12 smithi092 ceph-mon[29156]: pgmap v17270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:12.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:12 smithi189 ceph-mon[32756]: pgmap v17270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:12.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:12 smithi156 ceph-mon[32679]: pgmap v17270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:14 smithi092 ceph-mon[29156]: pgmap v17271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31609.908306 secs 2024-04-27T03:05:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:14 smithi189 ceph-mon[32756]: pgmap v17271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31609.908306 secs 2024-04-27T03:05:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:14 smithi156 ceph-mon[32679]: pgmap v17271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31609.908306 secs 2024-04-27T03:05:15.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30912.875105 secs 2024-04-27T03:05:15.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30912.875105 secs 2024-04-27T03:05:16.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30912.875105 secs 2024-04-27T03:05:16.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:16 smithi189 ceph-mon[32756]: pgmap v17272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:16.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:16 smithi156 ceph-mon[32679]: pgmap v17272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:17.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:16 smithi092 ceph-mon[29156]: pgmap v17272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:18.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:18 smithi189 ceph-mon[32756]: pgmap v17273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:18.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:18 smithi156 ceph-mon[32679]: pgmap v17273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:19.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:18 smithi092 ceph-mon[29156]: pgmap v17273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31614.908421 secs 2024-04-27T03:05:19.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31614.908421 secs 2024-04-27T03:05:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31614.908421 secs 2024-04-27T03:05:20.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:20 smithi189 ceph-mon[32756]: pgmap v17274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:20.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30917.875241 secs 2024-04-27T03:05:20.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:20 smithi156 ceph-mon[32679]: pgmap v17274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:20.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30917.875241 secs 2024-04-27T03:05:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:20 smithi092 ceph-mon[29156]: pgmap v17274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:21.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30917.875241 secs 2024-04-27T03:05:22.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:22 smithi189 ceph-mon[32756]: pgmap v17275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:22.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:22 smithi156 ceph-mon[32679]: pgmap v17275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:23.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:22 smithi092 ceph-mon[29156]: pgmap v17275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:24 smithi189 ceph-mon[32756]: pgmap v17276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31619.908508 secs 2024-04-27T03:05:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:24 smithi156 ceph-mon[32679]: pgmap v17276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31619.908508 secs 2024-04-27T03:05:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:24 smithi092 ceph-mon[29156]: pgmap v17276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31619.908508 secs 2024-04-27T03:05:25.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30922.875378 secs 2024-04-27T03:05:25.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30922.875378 secs 2024-04-27T03:05:25.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30922.875378 secs 2024-04-27T03:05:26.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:26 smithi189 ceph-mon[32756]: pgmap v17277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:26.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:26 smithi156 ceph-mon[32679]: pgmap v17277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:26 smithi092 ceph-mon[29156]: pgmap v17277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:28.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:28 smithi189 ceph-mon[32756]: pgmap v17278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:28.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:28 smithi156 ceph-mon[32679]: pgmap v17278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:29.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:28 smithi092 ceph-mon[29156]: pgmap v17278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31624.908629 secs 2024-04-27T03:05:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:05:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31624.908629 secs 2024-04-27T03:05:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:05:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31624.908629 secs 2024-04-27T03:05:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:05:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:30 smithi189 ceph-mon[32756]: pgmap v17279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30927.875478 secs 2024-04-27T03:05:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:05:30.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:05:30.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:05:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:30 smithi092 ceph-mon[29156]: pgmap v17279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30927.875478 secs 2024-04-27T03:05:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:05:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:05:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:05:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:30 smithi156 ceph-mon[32679]: pgmap v17279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30927.875478 secs 2024-04-27T03:05:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:05:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:05:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:05:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:31 smithi189 ceph-mon[32756]: pgmap v17280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:05:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:31 smithi189 ceph-mon[32756]: pgmap v17281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:31 smithi156 ceph-mon[32679]: pgmap v17280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:05:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:31 smithi156 ceph-mon[32679]: pgmap v17281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:31 smithi092 ceph-mon[29156]: pgmap v17280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:05:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:31 smithi092 ceph-mon[29156]: pgmap v17281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:33.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:33 smithi189 ceph-mon[32756]: pgmap v17282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:33.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:33 smithi156 ceph-mon[32679]: pgmap v17282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:34.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:33 smithi092 ceph-mon[29156]: pgmap v17282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31629.908763 secs 2024-04-27T03:05:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31629.908763 secs 2024-04-27T03:05:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31629.908763 secs 2024-04-27T03:05:35.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:35 smithi156 ceph-mon[32679]: pgmap v17283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:35.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30932.875606 secs 2024-04-27T03:05:35.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:35 smithi189 ceph-mon[32756]: pgmap v17283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:35.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30932.875606 secs 2024-04-27T03:05:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:35 smithi092 ceph-mon[29156]: pgmap v17283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:36.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30932.875606 secs 2024-04-27T03:05:36.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:36 smithi189 ceph-mon[32756]: pgmap v17284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:36.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:36 smithi156 ceph-mon[32679]: pgmap v17284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:37.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:36 smithi092 ceph-mon[29156]: pgmap v17284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:05:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:38 smithi189 ceph-mon[32756]: pgmap v17285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:05:39.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:38 smithi156 ceph-mon[32679]: pgmap v17285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:05:39.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:38 smithi092 ceph-mon[29156]: pgmap v17285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:05:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31634.908854 secs 2024-04-27T03:05:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31634.908854 secs 2024-04-27T03:05:40.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31634.908854 secs 2024-04-27T03:05:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30937.875726 secs 2024-04-27T03:05:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:40 smithi189 ceph-mon[32756]: pgmap v17286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:05:41.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30937.875726 secs 2024-04-27T03:05:41.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:40 smithi156 ceph-mon[32679]: pgmap v17286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:05:41.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30937.875726 secs 2024-04-27T03:05:41.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:40 smithi092 ceph-mon[29156]: pgmap v17286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:05:43.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:42 smithi189 ceph-mon[32756]: pgmap v17287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:43.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:42 smithi156 ceph-mon[32679]: pgmap v17287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:43.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:42 smithi092 ceph-mon[29156]: pgmap v17287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:44 smithi189 ceph-mon[32756]: pgmap v17288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31639.908970 secs 2024-04-27T03:05:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:44 smithi156 ceph-mon[32679]: pgmap v17288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31639.908970 secs 2024-04-27T03:05:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:44 smithi092 ceph-mon[29156]: pgmap v17288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31639.908970 secs 2024-04-27T03:05:46.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30942.875853 secs 2024-04-27T03:05:46.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30942.875853 secs 2024-04-27T03:05:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30942.875853 secs 2024-04-27T03:05:47.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:46 smithi189 ceph-mon[32756]: pgmap v17289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:47.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:46 smithi156 ceph-mon[32679]: pgmap v17289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:47.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:46 smithi092 ceph-mon[29156]: pgmap v17289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:49.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:48 smithi189 ceph-mon[32756]: pgmap v17290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:49.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:48 smithi156 ceph-mon[32679]: pgmap v17290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:49.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:48 smithi092 ceph-mon[29156]: pgmap v17290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31644.909086 secs 2024-04-27T03:05:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31644.909086 secs 2024-04-27T03:05:50.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31644.909086 secs 2024-04-27T03:05:51.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30947.875969 secs 2024-04-27T03:05:51.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:50 smithi189 ceph-mon[32756]: pgmap v17291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:51.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30947.875969 secs 2024-04-27T03:05:51.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:50 smithi156 ceph-mon[32679]: pgmap v17291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:51.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30947.875969 secs 2024-04-27T03:05:51.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:50 smithi092 ceph-mon[29156]: pgmap v17291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:52 smithi189 ceph-mon[32756]: pgmap v17292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:52 smithi156 ceph-mon[32679]: pgmap v17292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:52 smithi092 ceph-mon[29156]: pgmap v17292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:54 smithi189 ceph-mon[32756]: pgmap v17293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31649.909203 secs 2024-04-27T03:05:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:54 smithi156 ceph-mon[32679]: pgmap v17293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31649.909203 secs 2024-04-27T03:05:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:54 smithi092 ceph-mon[29156]: pgmap v17293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:05:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31649.909203 secs 2024-04-27T03:05:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30952.876091 secs 2024-04-27T03:05:56.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30952.876091 secs 2024-04-27T03:05:56.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30952.876091 secs 2024-04-27T03:05:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:56 smithi189 ceph-mon[32756]: pgmap v17294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:57.151 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:56 smithi092 ceph-mon[29156]: pgmap v17294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:57.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:56 smithi156 ceph-mon[32679]: pgmap v17294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:59.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:58 smithi189 ceph-mon[32756]: pgmap v17295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:59.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:58 smithi156 ceph-mon[32679]: pgmap v17295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:05:59.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:58 smithi092 ceph-mon[29156]: pgmap v17295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:05:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31654.909334 secs 2024-04-27T03:06:00.151 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:05:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31654.909334 secs 2024-04-27T03:06:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:05:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31654.909334 secs 2024-04-27T03:06:01.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30957.876213 secs 2024-04-27T03:06:01.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:00 smithi189 ceph-mon[32756]: pgmap v17296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:01.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30957.876213 secs 2024-04-27T03:06:01.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:00 smithi156 ceph-mon[32679]: pgmap v17296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:01.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30957.876213 secs 2024-04-27T03:06:01.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:00 smithi092 ceph-mon[29156]: pgmap v17296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:03.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:02 smithi189 ceph-mon[32756]: pgmap v17297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:03.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:02 smithi156 ceph-mon[32679]: pgmap v17297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:03.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:02 smithi092 ceph-mon[29156]: pgmap v17297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:04 smithi189 ceph-mon[32756]: pgmap v17298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:05.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31659.909421 secs 2024-04-27T03:06:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:04 smithi156 ceph-mon[32679]: pgmap v17298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:05.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31659.909421 secs 2024-04-27T03:06:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:04 smithi092 ceph-mon[29156]: pgmap v17298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31659.909421 secs 2024-04-27T03:06:06.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30962.876330 secs 2024-04-27T03:06:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30962.876330 secs 2024-04-27T03:06:06.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30962.876330 secs 2024-04-27T03:06:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:06 smithi156 ceph-mon[32679]: pgmap v17299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:07.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:06 smithi092 ceph-mon[29156]: pgmap v17299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:07.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:06 smithi189 ceph-mon[32756]: pgmap v17299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:09.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:08 smithi156 ceph-mon[32679]: pgmap v17300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:09.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:08 smithi092 ceph-mon[29156]: pgmap v17300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:09.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:08 smithi189 ceph-mon[32756]: pgmap v17300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:09.750 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:06:09.287+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:06:09.751 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:06:09.287+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:06:09.751 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:06:09.287+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:06:09.751 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:06:09.287+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:06:09.751 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:06:09.287+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:06:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31664.909548 secs 2024-04-27T03:06:10.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31664.909548 secs 2024-04-27T03:06:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31664.909548 secs 2024-04-27T03:06:11.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30967.876448 secs 2024-04-27T03:06:11.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:10 smithi156 ceph-mon[32679]: pgmap v17301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:11.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30967.876448 secs 2024-04-27T03:06:11.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:10 smithi092 ceph-mon[29156]: pgmap v17301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:11.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30967.876448 secs 2024-04-27T03:06:11.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:10 smithi189 ceph-mon[32756]: pgmap v17301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:13.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:12 smithi092 ceph-mon[29156]: pgmap v17302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:13.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:12 smithi156 ceph-mon[32679]: pgmap v17302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:13.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:12 smithi189 ceph-mon[32756]: pgmap v17302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:14 smithi156 ceph-mon[32679]: pgmap v17303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:15.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31669.909649 secs 2024-04-27T03:06:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:14 smithi092 ceph-mon[29156]: pgmap v17303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31669.909649 secs 2024-04-27T03:06:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:14 smithi189 ceph-mon[32756]: pgmap v17303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:15.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31669.909649 secs 2024-04-27T03:06:16.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30972.876601 secs 2024-04-27T03:06:16.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:06:16.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:15 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:06:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30972.876601 secs 2024-04-27T03:06:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:06:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:15 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:06:16.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30972.876601 secs 2024-04-27T03:06:16.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:06:16.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:15 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:06:17.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:16 smithi156 ceph-mon[32679]: pgmap v17304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:17.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:16 smithi092 ceph-mon[29156]: pgmap v17304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:17.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:16 smithi189 ceph-mon[32756]: pgmap v17304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:19.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:18 smithi156 ceph-mon[32679]: pgmap v17305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:19.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:18 smithi092 ceph-mon[29156]: pgmap v17305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:19.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:18 smithi189 ceph-mon[32756]: pgmap v17305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31674.909751 secs 2024-04-27T03:06:20.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30977.876741 secs 2024-04-27T03:06:20.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31674.909751 secs 2024-04-27T03:06:20.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30977.876741 secs 2024-04-27T03:06:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31674.909751 secs 2024-04-27T03:06:20.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30977.876741 secs 2024-04-27T03:06:21.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:20 smithi156 ceph-mon[32679]: pgmap v17306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:21.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:20 smithi092 ceph-mon[29156]: pgmap v17306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:21.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:20 smithi189 ceph-mon[32756]: pgmap v17306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:23.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:22 smithi156 ceph-mon[32679]: pgmap v17307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:23.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:22 smithi092 ceph-mon[29156]: pgmap v17307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:23.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:22 smithi189 ceph-mon[32756]: pgmap v17307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:06:25.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:24 smithi156 ceph-mon[32679]: pgmap v17308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:25.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31679.909871 secs 2024-04-27T03:06:25.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30982.876865 secs 2024-04-27T03:06:25.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:24 smithi092 ceph-mon[29156]: pgmap v17308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:25.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31679.909871 secs 2024-04-27T03:06:25.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30982.876865 secs 2024-04-27T03:06:25.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:24 smithi189 ceph-mon[32756]: pgmap v17308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:06:25.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31679.909871 secs 2024-04-27T03:06:25.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30982.876865 secs 2024-04-27T03:06:27.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:26 smithi092 ceph-mon[29156]: pgmap v17309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:27.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:26 smithi189 ceph-mon[32756]: pgmap v17309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:27.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:26 smithi156 ceph-mon[32679]: pgmap v17309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:29.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:28 smithi092 ceph-mon[29156]: pgmap v17310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:28 smithi189 ceph-mon[32756]: pgmap v17310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:28 smithi156 ceph-mon[32679]: pgmap v17310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31684.909996 secs 2024-04-27T03:06:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30987.876992 secs 2024-04-27T03:06:30.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:06:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31684.909996 secs 2024-04-27T03:06:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30987.876992 secs 2024-04-27T03:06:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:06:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31684.909996 secs 2024-04-27T03:06:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30987.876992 secs 2024-04-27T03:06:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:06:31.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:30 smithi092 ceph-mon[29156]: pgmap v17311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:31.295 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:30 smithi156 ceph-mon[32679]: pgmap v17311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:31.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:30 smithi189 ceph-mon[32756]: pgmap v17311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:33.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:32 smithi092 ceph-mon[29156]: pgmap v17312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:33.362 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:32 smithi156 ceph-mon[32679]: pgmap v17312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:33.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:32 smithi189 ceph-mon[32756]: pgmap v17312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:06:35.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: pgmap v17313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31689.910064 secs 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30992.877146 secs 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: pgmap v17314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: pgmap v17315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: pgmap v17313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31689.910064 secs 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30992.877146 secs 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: pgmap v17314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:06:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: pgmap v17315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: pgmap v17313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31689.910064 secs 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30992.877146 secs 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: pgmap v17314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:06:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: pgmap v17315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:35.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:06:37.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:37 smithi189 ceph-mon[32756]: pgmap v17316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:37.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:37 smithi156 ceph-mon[32679]: pgmap v17316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:37.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:37 smithi092 ceph-mon[29156]: pgmap v17316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:39 smithi189 ceph-mon[32756]: pgmap v17317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31694.910177 secs 2024-04-27T03:06:39.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:39 smithi156 ceph-mon[32679]: pgmap v17317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:39.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31694.910177 secs 2024-04-27T03:06:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:39 smithi092 ceph-mon[29156]: pgmap v17317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31694.910177 secs 2024-04-27T03:06:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.332+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:06:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.332+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:06:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.335+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:06:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.336+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:06:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.336+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 244 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:06:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.336+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:06:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.336+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:06:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:06:40.336+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 245 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:06:40.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 30997.877265 secs 2024-04-27T03:06:40.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 30997.877265 secs 2024-04-27T03:06:40.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 30997.877265 secs 2024-04-27T03:06:41.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:41 smithi189 ceph-mon[32756]: pgmap v17318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:41.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:41 smithi156 ceph-mon[32679]: pgmap v17318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:41.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:41 smithi092 ceph-mon[29156]: pgmap v17318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:06:43.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:43 smithi189 ceph-mon[32756]: pgmap v17319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:43.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:43 smithi156 ceph-mon[32679]: pgmap v17319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:43.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:43 smithi092 ceph-mon[29156]: pgmap v17319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:06:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31699.910315 secs 2024-04-27T03:06:44.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31699.910315 secs 2024-04-27T03:06:44.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31699.910315 secs 2024-04-27T03:06:45.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31002.877313 secs 2024-04-27T03:06:45.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:45 smithi189 ceph-mon[32756]: pgmap v17320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:06:45.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31002.877313 secs 2024-04-27T03:06:45.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:45 smithi156 ceph-mon[32679]: pgmap v17320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:06:45.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31002.877313 secs 2024-04-27T03:06:45.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:45 smithi092 ceph-mon[29156]: pgmap v17320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:06:47.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:47 smithi189 ceph-mon[32756]: pgmap v17321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:47.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:47 smithi156 ceph-mon[32679]: pgmap v17321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:47.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:47 smithi092 ceph-mon[29156]: pgmap v17321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:49.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:49 smithi189 ceph-mon[32756]: pgmap v17322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:49.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31704.910442 secs 2024-04-27T03:06:49.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:49 smithi156 ceph-mon[32679]: pgmap v17322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:49.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31704.910442 secs 2024-04-27T03:06:49.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:49 smithi092 ceph-mon[29156]: pgmap v17322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:49.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31704.910442 secs 2024-04-27T03:06:50.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31007.877435 secs 2024-04-27T03:06:50.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31007.877435 secs 2024-04-27T03:06:50.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31007.877435 secs 2024-04-27T03:06:51.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:51 smithi189 ceph-mon[32756]: pgmap v17323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:51.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:51 smithi156 ceph-mon[32679]: pgmap v17323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:51.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:51 smithi092 ceph-mon[29156]: pgmap v17323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:53.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:53 smithi189 ceph-mon[32756]: pgmap v17324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:53.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:53 smithi156 ceph-mon[32679]: pgmap v17324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:53.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:53 smithi092 ceph-mon[29156]: pgmap v17324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:54.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31709.910567 secs 2024-04-27T03:06:54.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31709.910567 secs 2024-04-27T03:06:54.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31709.910567 secs 2024-04-27T03:06:55.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31012.877556 secs 2024-04-27T03:06:55.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:55 smithi189 ceph-mon[32756]: pgmap v17325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:55.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31012.877556 secs 2024-04-27T03:06:55.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:55 smithi156 ceph-mon[32679]: pgmap v17325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:55.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31012.877556 secs 2024-04-27T03:06:55.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:55 smithi092 ceph-mon[29156]: pgmap v17325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:06:57.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:57 smithi189 ceph-mon[32756]: pgmap v17326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:57.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:57 smithi156 ceph-mon[32679]: pgmap v17326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:57.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:57 smithi092 ceph-mon[29156]: pgmap v17326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:59.523 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:59 smithi092 ceph-mon[29156]: pgmap v17327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:59.523 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:06:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31714.910707 secs 2024-04-27T03:06:59.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:59 smithi189 ceph-mon[32756]: pgmap v17327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:59.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:06:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31714.910707 secs 2024-04-27T03:06:59.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:59 smithi156 ceph-mon[32679]: pgmap v17327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:06:59.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:06:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31714.910707 secs 2024-04-27T03:07:00.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31017.877673 secs 2024-04-27T03:07:00.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31017.877673 secs 2024-04-27T03:07:00.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31017.877673 secs 2024-04-27T03:07:01.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:01 smithi189 ceph-mon[32756]: pgmap v17328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:01.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:01 smithi156 ceph-mon[32679]: pgmap v17328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:01.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:01 smithi092 ceph-mon[29156]: pgmap v17328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:03.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:03 smithi156 ceph-mon[32679]: pgmap v17329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:03.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:03 smithi092 ceph-mon[29156]: pgmap v17329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:03.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:03 smithi189 ceph-mon[32756]: pgmap v17329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:04.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31719.910848 secs 2024-04-27T03:07:04.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31719.910848 secs 2024-04-27T03:07:04.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31719.910848 secs 2024-04-27T03:07:05.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31022.877789 secs 2024-04-27T03:07:05.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:05 smithi156 ceph-mon[32679]: pgmap v17330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:05.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31022.877789 secs 2024-04-27T03:07:05.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:05 smithi092 ceph-mon[29156]: pgmap v17330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:05.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31022.877789 secs 2024-04-27T03:07:05.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:05 smithi189 ceph-mon[32756]: pgmap v17330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:07.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:07 smithi156 ceph-mon[32679]: pgmap v17331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:07.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:07 smithi092 ceph-mon[29156]: pgmap v17331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:07.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:07 smithi189 ceph-mon[32756]: pgmap v17331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:09.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:09 smithi156 ceph-mon[32679]: pgmap v17332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:09.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31724.910940 secs 2024-04-27T03:07:09.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:09 smithi092 ceph-mon[29156]: pgmap v17332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:09.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31724.910940 secs 2024-04-27T03:07:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:09 smithi189 ceph-mon[32756]: pgmap v17332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31724.910940 secs 2024-04-27T03:07:10.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31027.877865 secs 2024-04-27T03:07:10.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31027.877865 secs 2024-04-27T03:07:10.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31027.877865 secs 2024-04-27T03:07:11.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:11 smithi156 ceph-mon[32679]: pgmap v17333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:11.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:11 smithi092 ceph-mon[29156]: pgmap v17333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:11.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:11 smithi189 ceph-mon[32756]: pgmap v17333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:13.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:13 smithi156 ceph-mon[32679]: pgmap v17334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:13.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:13 smithi092 ceph-mon[29156]: pgmap v17334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:13.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:13 smithi189 ceph-mon[32756]: pgmap v17334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:07:14.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31729.911049 secs 2024-04-27T03:07:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31729.911049 secs 2024-04-27T03:07:14.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31729.911049 secs 2024-04-27T03:07:15.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31032.877973 secs 2024-04-27T03:07:15.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:15 smithi156 ceph-mon[32679]: pgmap v17335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:15.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31032.877973 secs 2024-04-27T03:07:15.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:15 smithi092 ceph-mon[29156]: pgmap v17335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:15.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31032.877973 secs 2024-04-27T03:07:15.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:15 smithi189 ceph-mon[32756]: pgmap v17335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:07:17.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:17 smithi156 ceph-mon[32679]: pgmap v17336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:17.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:17 smithi092 ceph-mon[29156]: pgmap v17336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:17.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:17 smithi189 ceph-mon[32756]: pgmap v17336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:19.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:19 smithi156 ceph-mon[32679]: pgmap v17337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:19.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31734.911200 secs 2024-04-27T03:07:19.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:19 smithi092 ceph-mon[29156]: pgmap v17337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:19.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31734.911200 secs 2024-04-27T03:07:19.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:19 smithi189 ceph-mon[32756]: pgmap v17337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:19.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31734.911200 secs 2024-04-27T03:07:20.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31037.878097 secs 2024-04-27T03:07:20.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31037.878097 secs 2024-04-27T03:07:20.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31037.878097 secs 2024-04-27T03:07:21.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:21 smithi156 ceph-mon[32679]: pgmap v17338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:21.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:21 smithi092 ceph-mon[29156]: pgmap v17338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:21.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:21 smithi189 ceph-mon[32756]: pgmap v17338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:23.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:23 smithi092 ceph-mon[29156]: pgmap v17339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:23.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:23 smithi189 ceph-mon[32756]: pgmap v17339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:23.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:23 smithi156 ceph-mon[32679]: pgmap v17339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:24.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31739.911292 secs 2024-04-27T03:07:24.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31739.911292 secs 2024-04-27T03:07:24.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31739.911292 secs 2024-04-27T03:07:25.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31042.878163 secs 2024-04-27T03:07:25.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:25 smithi092 ceph-mon[29156]: pgmap v17340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:25.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31042.878163 secs 2024-04-27T03:07:25.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:25 smithi189 ceph-mon[32756]: pgmap v17340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:25.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31042.878163 secs 2024-04-27T03:07:25.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:25 smithi156 ceph-mon[32679]: pgmap v17340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:27.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:27 smithi092 ceph-mon[29156]: pgmap v17341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:27.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:27 smithi189 ceph-mon[32756]: pgmap v17341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:27.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:27 smithi156 ceph-mon[32679]: pgmap v17341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:29.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:29 smithi092 ceph-mon[29156]: pgmap v17342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:29.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31744.911427 secs 2024-04-27T03:07:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:29 smithi189 ceph-mon[32756]: pgmap v17342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31744.911427 secs 2024-04-27T03:07:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:29 smithi156 ceph-mon[32679]: pgmap v17342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31744.911427 secs 2024-04-27T03:07:30.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31047.878324 secs 2024-04-27T03:07:30.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31047.878324 secs 2024-04-27T03:07:30.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31047.878324 secs 2024-04-27T03:07:31.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:31 smithi092 ceph-mon[29156]: pgmap v17343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:31.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:31 smithi189 ceph-mon[32756]: pgmap v17343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:31.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:31 smithi156 ceph-mon[32679]: pgmap v17343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:33.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:33 smithi092 ceph-mon[29156]: pgmap v17344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:33.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:33 smithi189 ceph-mon[32756]: pgmap v17344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:33.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:33 smithi156 ceph-mon[32679]: pgmap v17344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:34.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31749.911583 secs 2024-04-27T03:07:34.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:07:34.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31749.911583 secs 2024-04-27T03:07:34.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:07:34.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31749.911583 secs 2024-04-27T03:07:34.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:07:35.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31052.878441 secs 2024-04-27T03:07:35.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:35 smithi092 ceph-mon[29156]: pgmap v17345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:35.796 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31052.878441 secs 2024-04-27T03:07:35.796 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:35 smithi189 ceph-mon[32756]: pgmap v17345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:35.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31052.878441 secs 2024-04-27T03:07:35.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:35 smithi156 ceph-mon[32679]: pgmap v17345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:37.743 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:37 smithi156 ceph-mon[32679]: pgmap v17346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:37.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:37 smithi092 ceph-mon[29156]: pgmap v17346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:37.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:37 smithi189 ceph-mon[32756]: pgmap v17346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: pgmap v17347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:07:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:07:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31754.911680 secs 2024-04-27T03:07:39.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: pgmap v17347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31754.911680 secs 2024-04-27T03:07:39.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: pgmap v17347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:39.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:07:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:07:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31754.911680 secs 2024-04-27T03:07:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:07:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:40 smithi092 ceph-mon[29156]: pgmap v17348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:07:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:40 smithi092 ceph-mon[29156]: pgmap v17349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:40.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31057.878551 secs 2024-04-27T03:07:40.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:40 smithi189 ceph-mon[32756]: pgmap v17348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:07:40.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:40 smithi189 ceph-mon[32756]: pgmap v17349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:40.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31057.878551 secs 2024-04-27T03:07:40.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:40 smithi156 ceph-mon[32679]: pgmap v17348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:07:40.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:40 smithi156 ceph-mon[32679]: pgmap v17349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:40.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31057.878551 secs 2024-04-27T03:07:42.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:42 smithi092 ceph-mon[29156]: pgmap v17350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:42.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:42 smithi189 ceph-mon[32756]: pgmap v17350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:42.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:42 smithi156 ceph-mon[32679]: pgmap v17350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:44.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:44 smithi092 ceph-mon[29156]: pgmap v17351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:07:44.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31759.911799 secs 2024-04-27T03:07:44.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:44 smithi189 ceph-mon[32756]: pgmap v17351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:07:44.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31759.911799 secs 2024-04-27T03:07:44.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:44 smithi156 ceph-mon[32679]: pgmap v17351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:07:44.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31759.911799 secs 2024-04-27T03:07:45.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:45 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 31062.878625 secs 2024-04-27T03:07:45.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:45 smithi092 ceph-mon[29156]: slow request 724.885163 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:07:45.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:45 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 31062.878625 secs 2024-04-27T03:07:45.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:45 smithi189 ceph-mon[32756]: slow request 724.885163 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:07:45.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:45 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 31062.878625 secs 2024-04-27T03:07:45.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:45 smithi156 ceph-mon[32679]: slow request 724.885163 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:07:46.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:46 smithi092 ceph-mon[29156]: pgmap v17352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:46.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:46 smithi189 ceph-mon[32756]: pgmap v17352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:46.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:46 smithi156 ceph-mon[32679]: pgmap v17352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:48.801 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:48 smithi189 ceph-mon[32756]: pgmap v17353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:48.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:48 smithi156 ceph-mon[32679]: pgmap v17353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:49.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:48 smithi092 ceph-mon[29156]: pgmap v17353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:07:49.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31764.911931 secs 2024-04-27T03:07:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31764.911931 secs 2024-04-27T03:07:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31764.911931 secs 2024-04-27T03:07:50.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:50 smithi189 ceph-mon[32756]: pgmap v17354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:07:50.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31067.878703 secs 2024-04-27T03:07:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:50 smithi156 ceph-mon[32679]: pgmap v17354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:07:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31067.878703 secs 2024-04-27T03:07:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:50 smithi092 ceph-mon[29156]: pgmap v17354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:07:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31067.878703 secs 2024-04-27T03:07:52.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:52 smithi189 ceph-mon[32756]: pgmap v17355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:52.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:52 smithi156 ceph-mon[32679]: pgmap v17355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:53.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:52 smithi092 ceph-mon[29156]: pgmap v17355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:54.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:54 smithi189 ceph-mon[32756]: pgmap v17356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:54.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31769.912071 secs 2024-04-27T03:07:54.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:54 smithi156 ceph-mon[32679]: pgmap v17356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:54.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31769.912071 secs 2024-04-27T03:07:55.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:54 smithi092 ceph-mon[29156]: pgmap v17356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:55.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31769.912071 secs 2024-04-27T03:07:55.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31072.878794 secs 2024-04-27T03:07:55.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31072.878794 secs 2024-04-27T03:07:56.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31072.878794 secs 2024-04-27T03:07:56.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:56 smithi189 ceph-mon[32756]: pgmap v17357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:56 smithi156 ceph-mon[32679]: pgmap v17357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:56 smithi092 ceph-mon[29156]: pgmap v17357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:07:58.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:58 smithi189 ceph-mon[32756]: pgmap v17358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:58.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:58 smithi156 ceph-mon[32679]: pgmap v17358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:59.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:58 smithi092 ceph-mon[29156]: pgmap v17358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:07:59.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:07:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31774.912195 secs 2024-04-27T03:07:59.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:07:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31774.912195 secs 2024-04-27T03:08:00.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:07:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31774.912195 secs 2024-04-27T03:08:00.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:00 smithi189 ceph-mon[32756]: pgmap v17359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:00.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31077.878855 secs 2024-04-27T03:08:00.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:00 smithi092 ceph-mon[29156]: pgmap v17359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:00.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31077.878855 secs 2024-04-27T03:08:00.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:00 smithi156 ceph-mon[32679]: pgmap v17359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:00.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31077.878855 secs 2024-04-27T03:08:02.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:02 smithi189 ceph-mon[32756]: pgmap v17360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:02.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:02 smithi156 ceph-mon[32679]: pgmap v17360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:03.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:02 smithi092 ceph-mon[29156]: pgmap v17360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:04.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:04 smithi189 ceph-mon[32756]: pgmap v17361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:04.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:04 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31779.912257 secs 2024-04-27T03:08:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:04 smithi156 ceph-mon[32679]: pgmap v17361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:04 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31779.912257 secs 2024-04-27T03:08:05.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:04 smithi092 ceph-mon[29156]: pgmap v17361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:05.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:04 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31779.912257 secs 2024-04-27T03:08:05.796 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31082.878921 secs 2024-04-27T03:08:05.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31082.878921 secs 2024-04-27T03:08:06.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31082.878921 secs 2024-04-27T03:08:06.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:06 smithi189 ceph-mon[32756]: pgmap v17362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:06.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:06 smithi156 ceph-mon[32679]: pgmap v17362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:07.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:06 smithi092 ceph-mon[29156]: pgmap v17362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:08.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:08 smithi189 ceph-mon[32756]: pgmap v17363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:08.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:08 smithi156 ceph-mon[32679]: pgmap v17363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:09.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:08 smithi092 ceph-mon[29156]: pgmap v17363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:09 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31784.912395 secs 2024-04-27T03:08:09.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:09 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31784.912395 secs 2024-04-27T03:08:10.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:09 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31784.912395 secs 2024-04-27T03:08:10.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:10 smithi189 ceph-mon[32756]: pgmap v17364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:10.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31087.879023 secs 2024-04-27T03:08:10.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:10 smithi156 ceph-mon[32679]: pgmap v17364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:10.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31087.879023 secs 2024-04-27T03:08:11.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:10 smithi092 ceph-mon[29156]: pgmap v17364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:11.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31087.879023 secs 2024-04-27T03:08:12.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:12 smithi189 ceph-mon[32756]: pgmap v17365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:12.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:12 smithi156 ceph-mon[32679]: pgmap v17365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:13.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:12 smithi092 ceph-mon[29156]: pgmap v17365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:14.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:14 smithi189 ceph-mon[32756]: pgmap v17366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:14.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:14 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31789.912457 secs 2024-04-27T03:08:14.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:14 smithi156 ceph-mon[32679]: pgmap v17366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:14.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:14 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31789.912457 secs 2024-04-27T03:08:15.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:14 smithi092 ceph-mon[29156]: pgmap v17366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:15.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:14 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31789.912457 secs 2024-04-27T03:08:15.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31092.879149 secs 2024-04-27T03:08:15.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31092.879149 secs 2024-04-27T03:08:16.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31092.879149 secs 2024-04-27T03:08:16.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:16 smithi189 ceph-mon[32756]: pgmap v17367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:16.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:16 smithi156 ceph-mon[32679]: pgmap v17367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:17.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:16 smithi092 ceph-mon[29156]: pgmap v17367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:18.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:17 smithi092 ceph-mon[29156]: pgmap v17368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:18.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:17 smithi189 ceph-mon[32756]: pgmap v17368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:18.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:17 smithi156 ceph-mon[32679]: pgmap v17368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:20.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:19 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31794.912582 secs 2024-04-27T03:08:20.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:19 smithi156 ceph-mon[32679]: pgmap v17369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:20.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:19 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31794.912582 secs 2024-04-27T03:08:20.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:19 smithi092 ceph-mon[29156]: pgmap v17369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:20.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:19 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31794.912582 secs 2024-04-27T03:08:20.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:19 smithi189 ceph-mon[32756]: pgmap v17369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:21.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31097.879210 secs 2024-04-27T03:08:21.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31097.879210 secs 2024-04-27T03:08:21.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31097.879210 secs 2024-04-27T03:08:22.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:21 smithi156 ceph-mon[32679]: pgmap v17370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:22.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:21 smithi092 ceph-mon[29156]: pgmap v17370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:22.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:21 smithi189 ceph-mon[32756]: pgmap v17370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:24.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:23 smithi156 ceph-mon[32679]: pgmap v17371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:24.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:23 smithi092 ceph-mon[29156]: pgmap v17371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:24.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:23 smithi189 ceph-mon[32756]: pgmap v17371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:25.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:24 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31799.912714 secs 2024-04-27T03:08:25.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:24 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31799.912714 secs 2024-04-27T03:08:25.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:24 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31799.912714 secs 2024-04-27T03:08:26.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31102.879385 secs 2024-04-27T03:08:26.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:25 smithi156 ceph-mon[32679]: pgmap v17372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:26.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31102.879385 secs 2024-04-27T03:08:26.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:25 smithi092 ceph-mon[29156]: pgmap v17372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:26.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31102.879385 secs 2024-04-27T03:08:26.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:25 smithi189 ceph-mon[32756]: pgmap v17372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:28.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:27 smithi156 ceph-mon[32679]: pgmap v17373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:28.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:27 smithi092 ceph-mon[29156]: pgmap v17373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:28.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:27 smithi189 ceph-mon[32756]: pgmap v17373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:30.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:29 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31804.912852 secs 2024-04-27T03:08:30.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:29 smithi156 ceph-mon[32679]: pgmap v17374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:30.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:29 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31804.912852 secs 2024-04-27T03:08:30.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:29 smithi092 ceph-mon[29156]: pgmap v17374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:29 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31804.912852 secs 2024-04-27T03:08:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:29 smithi189 ceph-mon[32756]: pgmap v17374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:31.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31107.879540 secs 2024-04-27T03:08:31.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31107.879540 secs 2024-04-27T03:08:31.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31107.879540 secs 2024-04-27T03:08:32.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:31 smithi156 ceph-mon[32679]: pgmap v17375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:32.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:31 smithi092 ceph-mon[29156]: pgmap v17375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:32.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:31 smithi189 ceph-mon[32756]: pgmap v17375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:34.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:33 smithi156 ceph-mon[32679]: pgmap v17376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:34.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:33 smithi092 ceph-mon[29156]: pgmap v17376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:34.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:33 smithi189 ceph-mon[32756]: pgmap v17376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:34 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31809.912971 secs 2024-04-27T03:08:35.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31112.879657 secs 2024-04-27T03:08:35.297 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:34 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31809.912971 secs 2024-04-27T03:08:35.297 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31112.879657 secs 2024-04-27T03:08:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:34 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31809.912971 secs 2024-04-27T03:08:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31112.879657 secs 2024-04-27T03:08:36.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:35 smithi092 ceph-mon[29156]: pgmap v17377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:36.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:35 smithi189 ceph-mon[32756]: pgmap v17377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:36.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:35 smithi156 ceph-mon[32679]: pgmap v17377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:38.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:37 smithi156 ceph-mon[32679]: pgmap v17378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:38.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:37 smithi092 ceph-mon[29156]: pgmap v17378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:38.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:37 smithi189 ceph-mon[32756]: pgmap v17378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31814.913105 secs 2024-04-27T03:08:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: pgmap v17379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31117.879765 secs 2024-04-27T03:08:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:08:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:08:40.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:08:40.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:08:40.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31814.913105 secs 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: pgmap v17379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31117.879765 secs 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:08:40.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:08:40.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31814.913105 secs 2024-04-27T03:08:40.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: pgmap v17379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:40.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31117.879765 secs 2024-04-27T03:08:40.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:08:40.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:08:40.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:08:40.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:08:41.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:40 smithi092 ceph-mon[29156]: pgmap v17380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:08:41.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:40 smithi092 ceph-mon[29156]: pgmap v17381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:41.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:40 smithi189 ceph-mon[32756]: pgmap v17380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:08:41.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:40 smithi189 ceph-mon[32756]: pgmap v17381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:41.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:40 smithi156 ceph-mon[32679]: pgmap v17380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:08:41.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:40 smithi156 ceph-mon[32679]: pgmap v17381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:43.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:42 smithi092 ceph-mon[29156]: pgmap v17382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:43.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:42 smithi189 ceph-mon[32756]: pgmap v17382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:43.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:42 smithi156 ceph-mon[32679]: pgmap v17382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:45.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:44 smithi092 ceph-mon[29156]: pgmap v17383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:45.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:44 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31819.913180 secs 2024-04-27T03:08:45.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31122.879896 secs 2024-04-27T03:08:45.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:44 smithi189 ceph-mon[32756]: pgmap v17383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:45.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:44 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31819.913180 secs 2024-04-27T03:08:45.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31122.879896 secs 2024-04-27T03:08:45.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:44 smithi156 ceph-mon[32679]: pgmap v17383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:45.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:44 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31819.913180 secs 2024-04-27T03:08:45.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31122.879896 secs 2024-04-27T03:08:47.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:46 smithi092 ceph-mon[29156]: pgmap v17384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:47.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:46 smithi189 ceph-mon[32756]: pgmap v17384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:47.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:46 smithi156 ceph-mon[32679]: pgmap v17384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:08:49.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:48 smithi092 ceph-mon[29156]: pgmap v17385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:08:49.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:48 smithi189 ceph-mon[32756]: pgmap v17385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:08:49.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:48 smithi156 ceph-mon[32679]: pgmap v17385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:08:50.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:49 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31824.913314 secs 2024-04-27T03:08:50.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31127.880019 secs 2024-04-27T03:08:50.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:49 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31824.913314 secs 2024-04-27T03:08:50.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31127.880019 secs 2024-04-27T03:08:50.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:49 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31824.913314 secs 2024-04-27T03:08:50.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31127.880019 secs 2024-04-27T03:08:51.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:50 smithi092 ceph-mon[29156]: pgmap v17386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:08:51.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:50 smithi189 ceph-mon[32756]: pgmap v17386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:08:51.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:50 smithi156 ceph-mon[32679]: pgmap v17386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:08:53.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:52 smithi092 ceph-mon[29156]: pgmap v17387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:53.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:52 smithi189 ceph-mon[32756]: pgmap v17387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:53.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:52 smithi156 ceph-mon[32679]: pgmap v17387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:55.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:54 smithi092 ceph-mon[29156]: pgmap v17388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:55.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:54 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31829.913408 secs 2024-04-27T03:08:55.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31132.880157 secs 2024-04-27T03:08:55.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:54 smithi189 ceph-mon[32756]: pgmap v17388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:55.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:54 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31829.913408 secs 2024-04-27T03:08:55.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31132.880157 secs 2024-04-27T03:08:55.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:54 smithi156 ceph-mon[32679]: pgmap v17388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:08:55.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:54 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31829.913408 secs 2024-04-27T03:08:55.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31132.880157 secs 2024-04-27T03:08:57.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:56 smithi092 ceph-mon[29156]: pgmap v17389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:57.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:56 smithi189 ceph-mon[32756]: pgmap v17389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:57.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:56 smithi156 ceph-mon[32679]: pgmap v17389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:59.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:58 smithi092 ceph-mon[29156]: pgmap v17390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:59.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:58 smithi189 ceph-mon[32756]: pgmap v17390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:08:59.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:58 smithi156 ceph-mon[32679]: pgmap v17390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:00.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:59 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31834.913531 secs 2024-04-27T03:09:00.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:08:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31137.880289 secs 2024-04-27T03:09:00.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:59 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31834.913531 secs 2024-04-27T03:09:00.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:08:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31137.880289 secs 2024-04-27T03:09:00.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:59 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31834.913531 secs 2024-04-27T03:09:00.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:08:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31137.880289 secs 2024-04-27T03:09:01.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:00 smithi189 ceph-mon[32756]: pgmap v17391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:01.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:00 smithi156 ceph-mon[32679]: pgmap v17391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:01.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:00 smithi092 ceph-mon[29156]: pgmap v17391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:03.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:03 smithi189 ceph-mon[32756]: pgmap v17392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:03.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:03 smithi156 ceph-mon[32679]: pgmap v17392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:03.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:03 smithi092 ceph-mon[29156]: pgmap v17392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:05.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:05 smithi189 ceph-mon[32756]: pgmap v17393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:05.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:05 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31839.913665 secs 2024-04-27T03:09:05.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31142.880403 secs 2024-04-27T03:09:05.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:05 smithi156 ceph-mon[32679]: pgmap v17393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:05.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:05 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31839.913665 secs 2024-04-27T03:09:05.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31142.880403 secs 2024-04-27T03:09:05.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:05 smithi092 ceph-mon[29156]: pgmap v17393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:05.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:05 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31839.913665 secs 2024-04-27T03:09:05.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31142.880403 secs 2024-04-27T03:09:07.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:07 smithi189 ceph-mon[32756]: pgmap v17394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:07.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:07 smithi156 ceph-mon[32679]: pgmap v17394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:07.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:07 smithi092 ceph-mon[29156]: pgmap v17394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:09.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:09 smithi189 ceph-mon[32756]: pgmap v17395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:09.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:09 smithi156 ceph-mon[32679]: pgmap v17395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:09.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:09 smithi092 ceph-mon[29156]: pgmap v17395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:10.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:10 smithi189 ceph-mon[32756]: 14 slow requests, 0 included below; oldest blocked for > 31844.913767 secs 2024-04-27T03:09:10.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:10 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 31147.880555 secs 2024-04-27T03:09:10.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:10 smithi189 ceph-mon[32756]: slow request 1440.041521 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:09:10.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:10 smithi156 ceph-mon[32679]: 14 slow requests, 0 included below; oldest blocked for > 31844.913767 secs 2024-04-27T03:09:10.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:10 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 31147.880555 secs 2024-04-27T03:09:10.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:10 smithi156 ceph-mon[32679]: slow request 1440.041521 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:09:10.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:10 smithi092 ceph-mon[29156]: 14 slow requests, 0 included below; oldest blocked for > 31844.913767 secs 2024-04-27T03:09:10.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:10 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 31147.880555 secs 2024-04-27T03:09:10.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:10 smithi092 ceph-mon[29156]: slow request 1440.041521 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:09:11.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:11 smithi189 ceph-mon[32756]: pgmap v17396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:11.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:11 smithi156 ceph-mon[32679]: pgmap v17396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:11.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:11 smithi092 ceph-mon[29156]: pgmap v17396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:13.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:12 smithi092 ceph-mon[29156]: pgmap v17397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:13.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:12 smithi189 ceph-mon[32756]: pgmap v17397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:13.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:12 smithi156 ceph-mon[32679]: pgmap v17397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:15.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:14 smithi189 ceph-mon[32756]: pgmap v17398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:15.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:14 smithi189 ceph-mon[32756]: 16 slow requests, 1 included below; oldest blocked for > 31849.913908 secs 2024-04-27T03:09:15.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:14 smithi189 ceph-mon[32756]: slow request 184.536593 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:09:15.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:14 smithi156 ceph-mon[32679]: pgmap v17398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:15.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:14 smithi156 ceph-mon[32679]: 16 slow requests, 1 included below; oldest blocked for > 31849.913908 secs 2024-04-27T03:09:15.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:14 smithi156 ceph-mon[32679]: slow request 184.536593 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:09:15.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:14 smithi092 ceph-mon[29156]: pgmap v17398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:15.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:14 smithi092 ceph-mon[29156]: 16 slow requests, 1 included below; oldest blocked for > 31849.913908 secs 2024-04-27T03:09:15.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:14 smithi092 ceph-mon[29156]: slow request 184.536593 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:09:16.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31152.880672 secs 2024-04-27T03:09:16.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:15 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:09:16.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:15 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:09:16.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31152.880672 secs 2024-04-27T03:09:16.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:15 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:09:16.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:15 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:09:16.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31152.880672 secs 2024-04-27T03:09:16.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:15 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:09:16.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:15 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:09:17.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:16 smithi189 ceph-mon[32756]: pgmap v17399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:17.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:16 smithi156 ceph-mon[32679]: pgmap v17399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:17.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:16 smithi092 ceph-mon[29156]: pgmap v17399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:19.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:18 smithi189 ceph-mon[32756]: pgmap v17400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:19.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:18 smithi156 ceph-mon[32679]: pgmap v17400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:19.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:18 smithi092 ceph-mon[29156]: pgmap v17400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:20.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31854.914019 secs 2024-04-27T03:09:20.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31854.914019 secs 2024-04-27T03:09:20.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31854.914019 secs 2024-04-27T03:09:21.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31157.880797 secs 2024-04-27T03:09:21.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:20 smithi189 ceph-mon[32756]: pgmap v17401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:21.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31157.880797 secs 2024-04-27T03:09:21.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:20 smithi156 ceph-mon[32679]: pgmap v17401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:21.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31157.880797 secs 2024-04-27T03:09:21.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:20 smithi092 ceph-mon[29156]: pgmap v17401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:23.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:22 smithi189 ceph-mon[32756]: pgmap v17402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:23.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:22 smithi156 ceph-mon[32679]: pgmap v17402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:23.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:22 smithi092 ceph-mon[29156]: pgmap v17402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:25.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:24 smithi189 ceph-mon[32756]: pgmap v17403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:25.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31859.914131 secs 2024-04-27T03:09:25.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:24 smithi156 ceph-mon[32679]: pgmap v17403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:25.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31859.914131 secs 2024-04-27T03:09:25.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:24 smithi092 ceph-mon[29156]: pgmap v17403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:25.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31859.914131 secs 2024-04-27T03:09:26.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31162.880914 secs 2024-04-27T03:09:26.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31162.880914 secs 2024-04-27T03:09:26.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31162.880914 secs 2024-04-27T03:09:27.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:26 smithi189 ceph-mon[32756]: pgmap v17404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:27.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:26 smithi156 ceph-mon[32679]: pgmap v17404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:27.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:26 smithi092 ceph-mon[29156]: pgmap v17404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:29.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:28 smithi189 ceph-mon[32756]: pgmap v17405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:29.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:28 smithi156 ceph-mon[32679]: pgmap v17405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:29.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:28 smithi092 ceph-mon[29156]: pgmap v17405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:30.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31864.914252 secs 2024-04-27T03:09:30.152 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31864.914252 secs 2024-04-27T03:09:30.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31864.914252 secs 2024-04-27T03:09:31.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31167.881029 secs 2024-04-27T03:09:31.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:30 smithi189 ceph-mon[32756]: pgmap v17406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:31.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31167.881029 secs 2024-04-27T03:09:31.194 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:30 smithi156 ceph-mon[32679]: pgmap v17406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:31.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31167.881029 secs 2024-04-27T03:09:31.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:30 smithi092 ceph-mon[29156]: pgmap v17406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:33.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:32 smithi189 ceph-mon[32756]: pgmap v17407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:33.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:32 smithi156 ceph-mon[32679]: pgmap v17407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:33.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:32 smithi092 ceph-mon[29156]: pgmap v17407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:35.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:34 smithi189 ceph-mon[32756]: pgmap v17408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:35.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31869.914326 secs 2024-04-27T03:09:35.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:34 smithi156 ceph-mon[32679]: pgmap v17408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:35.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31869.914326 secs 2024-04-27T03:09:35.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:34 smithi092 ceph-mon[29156]: pgmap v17408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:35.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31869.914326 secs 2024-04-27T03:09:36.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31172.881173 secs 2024-04-27T03:09:36.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31172.881173 secs 2024-04-27T03:09:36.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31172.881173 secs 2024-04-27T03:09:37.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:36 smithi189 ceph-mon[32756]: pgmap v17409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:37.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:36 smithi156 ceph-mon[32679]: pgmap v17409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:37.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:36 smithi092 ceph-mon[29156]: pgmap v17409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:39.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:38 smithi189 ceph-mon[32756]: pgmap v17410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:39.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:38 smithi156 ceph-mon[32679]: pgmap v17410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:39.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:38 smithi092 ceph-mon[29156]: pgmap v17410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:40.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31874.914440 secs 2024-04-27T03:09:40.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:09:40.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31874.914440 secs 2024-04-27T03:09:40.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:09:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31874.914440 secs 2024-04-27T03:09:40.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:09:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:09:40.358+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:09:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:09:40.358+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:09:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:09:40.358+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:09:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:09:40.358+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 246 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31177.881262 secs 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: pgmap v17411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: pgmap v17412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:09:41.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: pgmap v17413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:41.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:09:41.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31177.881262 secs 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: pgmap v17411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: pgmap v17412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: pgmap v17413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:41.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:09:41.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31177.881262 secs 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: pgmap v17411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: pgmap v17412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: pgmap v17413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:41.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:09:43.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:43 smithi189 ceph-mon[32756]: pgmap v17414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:43.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:43 smithi156 ceph-mon[32679]: pgmap v17414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:44.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:43 smithi092 ceph-mon[29156]: pgmap v17414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:44.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31879.914558 secs 2024-04-27T03:09:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31879.914558 secs 2024-04-27T03:09:45.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31879.914558 secs 2024-04-27T03:09:45.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31182.881403 secs 2024-04-27T03:09:45.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:45 smithi189 ceph-mon[32756]: pgmap v17415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31182.881403 secs 2024-04-27T03:09:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:45 smithi156 ceph-mon[32679]: pgmap v17415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31182.881403 secs 2024-04-27T03:09:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:45 smithi092 ceph-mon[29156]: pgmap v17415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:47.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:47 smithi189 ceph-mon[32756]: pgmap v17416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:47.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:47 smithi156 ceph-mon[32679]: pgmap v17416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:48.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:47 smithi092 ceph-mon[29156]: pgmap v17416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:09:49.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:49 smithi189 ceph-mon[32756]: pgmap v17417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:49.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31884.914652 secs 2024-04-27T03:09:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:49 smithi156 ceph-mon[32679]: pgmap v17417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31884.914652 secs 2024-04-27T03:09:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:49 smithi092 ceph-mon[29156]: pgmap v17417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:09:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31884.914652 secs 2024-04-27T03:09:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31187.881554 secs 2024-04-27T03:09:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31187.881554 secs 2024-04-27T03:09:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31187.881554 secs 2024-04-27T03:09:51.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:51 smithi189 ceph-mon[32756]: pgmap v17418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:09:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:51 smithi156 ceph-mon[32679]: pgmap v17418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:09:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:51 smithi092 ceph-mon[29156]: pgmap v17418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:09:53.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:52 smithi092 ceph-mon[29156]: pgmap v17419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:53.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:52 smithi189 ceph-mon[32756]: pgmap v17419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:53.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:52 smithi156 ceph-mon[32679]: pgmap v17419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:54.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31889.914798 secs 2024-04-27T03:09:54.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31889.914798 secs 2024-04-27T03:09:54.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31889.914798 secs 2024-04-27T03:09:55.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31192.881704 secs 2024-04-27T03:09:55.396 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:55 smithi189 ceph-mon[32756]: pgmap v17420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:55.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31192.881704 secs 2024-04-27T03:09:55.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:55 smithi156 ceph-mon[32679]: pgmap v17420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:55.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31192.881704 secs 2024-04-27T03:09:55.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:55 smithi092 ceph-mon[29156]: pgmap v17420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:09:57.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:57 smithi189 ceph-mon[32756]: pgmap v17421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:57.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:57 smithi156 ceph-mon[32679]: pgmap v17421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:58.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:57 smithi092 ceph-mon[29156]: pgmap v17421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:59.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:59 smithi189 ceph-mon[32756]: pgmap v17422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:59.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:09:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31894.914908 secs 2024-04-27T03:09:59.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:59 smithi156 ceph-mon[32679]: pgmap v17422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:09:59.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:09:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31894.914908 secs 2024-04-27T03:10:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:59 smithi092 ceph-mon[29156]: pgmap v17422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:09:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31894.914908 secs 2024-04-27T03:10:00.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31197.881825 secs 2024-04-27T03:10:00.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:10:00.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31197.881825 secs 2024-04-27T03:10:00.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:10:00.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31197.881825 secs 2024-04-27T03:10:00.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:10:01.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:01 smithi189 ceph-mon[32756]: pgmap v17423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:01.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:01 smithi156 ceph-mon[32679]: pgmap v17423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:02.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:01 smithi092 ceph-mon[29156]: pgmap v17423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:03.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:03 smithi189 ceph-mon[32756]: pgmap v17424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:03.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:03 smithi156 ceph-mon[32679]: pgmap v17424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:04.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:03 smithi092 ceph-mon[29156]: pgmap v17424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:04.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31899.915008 secs 2024-04-27T03:10:04.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31899.915008 secs 2024-04-27T03:10:05.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31899.915008 secs 2024-04-27T03:10:05.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31202.881958 secs 2024-04-27T03:10:05.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:05 smithi189 ceph-mon[32756]: pgmap v17425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:05.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31202.881958 secs 2024-04-27T03:10:05.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:05 smithi092 ceph-mon[29156]: pgmap v17425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31202.881958 secs 2024-04-27T03:10:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:05 smithi156 ceph-mon[32679]: pgmap v17425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:07.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:07 smithi189 ceph-mon[32756]: pgmap v17426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:07.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:07 smithi156 ceph-mon[32679]: pgmap v17426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:08.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:07 smithi092 ceph-mon[29156]: pgmap v17426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:09 smithi189 ceph-mon[32756]: pgmap v17427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31904.915116 secs 2024-04-27T03:10:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:09 smithi156 ceph-mon[32679]: pgmap v17427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31904.915116 secs 2024-04-27T03:10:10.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:09 smithi092 ceph-mon[29156]: pgmap v17427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:10.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31904.915116 secs 2024-04-27T03:10:10.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31207.882090 secs 2024-04-27T03:10:10.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31207.882090 secs 2024-04-27T03:10:11.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31207.882090 secs 2024-04-27T03:10:11.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:11 smithi189 ceph-mon[32756]: pgmap v17428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:11.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:11 smithi156 ceph-mon[32679]: pgmap v17428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:12.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:11 smithi092 ceph-mon[29156]: pgmap v17428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:13.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:13 smithi189 ceph-mon[32756]: pgmap v17429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:13.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:13 smithi156 ceph-mon[32679]: pgmap v17429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:14.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:13 smithi092 ceph-mon[29156]: pgmap v17429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:14 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31909.915244 secs 2024-04-27T03:10:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:14 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31909.915244 secs 2024-04-27T03:10:15.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:14 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31909.915244 secs 2024-04-27T03:10:15.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31212.882168 secs 2024-04-27T03:10:15.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:15 smithi189 ceph-mon[32756]: pgmap v17430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:15.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31212.882168 secs 2024-04-27T03:10:15.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:15 smithi156 ceph-mon[32679]: pgmap v17430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:16.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31212.882168 secs 2024-04-27T03:10:16.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:15 smithi092 ceph-mon[29156]: pgmap v17430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:17.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:17 smithi189 ceph-mon[32756]: pgmap v17431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:17.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:17 smithi156 ceph-mon[32679]: pgmap v17431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:18.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:17 smithi092 ceph-mon[29156]: pgmap v17431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:18.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:18 smithi156 ceph-mon[32679]: pgmap v17432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:19.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:18 smithi092 ceph-mon[29156]: pgmap v17432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:19.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:18 smithi189 ceph-mon[32756]: pgmap v17432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:19 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31914.915366 secs 2024-04-27T03:10:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:19 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31914.915366 secs 2024-04-27T03:10:20.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:19 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31914.915366 secs 2024-04-27T03:10:20.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31217.882284 secs 2024-04-27T03:10:20.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:20 smithi156 ceph-mon[32679]: pgmap v17433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31217.882284 secs 2024-04-27T03:10:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:20 smithi092 ceph-mon[29156]: pgmap v17433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:21.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31217.882284 secs 2024-04-27T03:10:21.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:20 smithi189 ceph-mon[32756]: pgmap v17433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:23.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:23 smithi189 ceph-mon[32756]: pgmap v17434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:23.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:23 smithi156 ceph-mon[32679]: pgmap v17434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:24.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:23 smithi092 ceph-mon[29156]: pgmap v17434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:24.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:24 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31919.915459 secs 2024-04-27T03:10:24.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:24 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31919.915459 secs 2024-04-27T03:10:25.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:24 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31919.915459 secs 2024-04-27T03:10:25.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31222.882397 secs 2024-04-27T03:10:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:25 smithi189 ceph-mon[32756]: pgmap v17435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:25.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31222.882397 secs 2024-04-27T03:10:25.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:25 smithi156 ceph-mon[32679]: pgmap v17435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:26.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31222.882397 secs 2024-04-27T03:10:26.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:25 smithi092 ceph-mon[29156]: pgmap v17435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:27.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:27 smithi189 ceph-mon[32756]: pgmap v17436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:27.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:27 smithi156 ceph-mon[32679]: pgmap v17436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:28.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:27 smithi092 ceph-mon[29156]: pgmap v17436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:29.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:29 smithi189 ceph-mon[32756]: pgmap v17437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:29.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31924.915580 secs 2024-04-27T03:10:29.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:29 smithi156 ceph-mon[32679]: pgmap v17437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:29.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31924.915580 secs 2024-04-27T03:10:30.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:29 smithi092 ceph-mon[29156]: pgmap v17437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:30.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31924.915580 secs 2024-04-27T03:10:30.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31227.882507 secs 2024-04-27T03:10:30.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31227.882507 secs 2024-04-27T03:10:30.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31227.882507 secs 2024-04-27T03:10:31.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:31 smithi189 ceph-mon[32756]: pgmap v17438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:31.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:31 smithi156 ceph-mon[32679]: pgmap v17438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:32.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:31 smithi092 ceph-mon[29156]: pgmap v17438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:33.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:33 smithi189 ceph-mon[32756]: pgmap v17439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:33.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:33 smithi156 ceph-mon[32679]: pgmap v17439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:34.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:33 smithi092 ceph-mon[29156]: pgmap v17439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:34.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:34 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31929.915691 secs 2024-04-27T03:10:34.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:34 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31929.915691 secs 2024-04-27T03:10:35.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:34 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31929.915691 secs 2024-04-27T03:10:35.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31232.882590 secs 2024-04-27T03:10:35.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:35 smithi189 ceph-mon[32756]: pgmap v17440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:35.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31232.882590 secs 2024-04-27T03:10:35.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:35 smithi156 ceph-mon[32679]: pgmap v17440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:36.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31232.882590 secs 2024-04-27T03:10:36.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:35 smithi092 ceph-mon[29156]: pgmap v17440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:37.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:37 smithi189 ceph-mon[32756]: pgmap v17441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:37.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:37 smithi156 ceph-mon[32679]: pgmap v17441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:38.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:37 smithi092 ceph-mon[29156]: pgmap v17441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:39.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:39 smithi189 ceph-mon[32756]: pgmap v17442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:39.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:39 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31934.915803 secs 2024-04-27T03:10:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:39 smithi156 ceph-mon[32679]: pgmap v17442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:39 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31934.915803 secs 2024-04-27T03:10:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:39 smithi092 ceph-mon[29156]: pgmap v17442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:39 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31934.915803 secs 2024-04-27T03:10:40.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31237.882647 secs 2024-04-27T03:10:40.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31237.882647 secs 2024-04-27T03:10:41.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31237.882647 secs 2024-04-27T03:10:41.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:41 smithi189 ceph-mon[32756]: pgmap v17443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:41.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:10:41.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:10:41.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:10:41.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:10:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:41 smithi156 ceph-mon[32679]: pgmap v17443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:10:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:10:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:10:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:10:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:41 smithi092 ceph-mon[29156]: pgmap v17443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:10:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:10:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:10:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:10:42.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:42 smithi189 ceph-mon[32756]: pgmap v17444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:10:42.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:42 smithi189 ceph-mon[32756]: pgmap v17445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:42.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:42 smithi156 ceph-mon[32679]: pgmap v17444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:10:42.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:42 smithi156 ceph-mon[32679]: pgmap v17445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:43.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:42 smithi092 ceph-mon[29156]: pgmap v17444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:10:43.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:42 smithi092 ceph-mon[29156]: pgmap v17445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:43.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:43 smithi189 ceph-mon[32756]: pgmap v17446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:10:43.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:43 smithi156 ceph-mon[32679]: pgmap v17446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:10:44.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:43 smithi092 ceph-mon[29156]: pgmap v17446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:10:44.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:44 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31939.915900 secs 2024-04-27T03:10:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:44 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31939.915900 secs 2024-04-27T03:10:45.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:44 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31939.915900 secs 2024-04-27T03:10:45.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31242.882795 secs 2024-04-27T03:10:45.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:45 smithi189 ceph-mon[32756]: pgmap v17447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31242.882795 secs 2024-04-27T03:10:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:45 smithi156 ceph-mon[32679]: pgmap v17447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31242.882795 secs 2024-04-27T03:10:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:45 smithi092 ceph-mon[29156]: pgmap v17447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:48.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:48 smithi189 ceph-mon[32756]: pgmap v17448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:48.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:48 smithi156 ceph-mon[32679]: pgmap v17448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:48.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:48 smithi092 ceph-mon[29156]: pgmap v17448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:49 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31944.916020 secs 2024-04-27T03:10:49.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:49 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31944.916020 secs 2024-04-27T03:10:49.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:49 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31944.916020 secs 2024-04-27T03:10:50.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31247.882913 secs 2024-04-27T03:10:50.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:50 smithi189 ceph-mon[32756]: pgmap v17449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:50.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31247.882913 secs 2024-04-27T03:10:50.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:50 smithi156 ceph-mon[32679]: pgmap v17449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:50.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31247.882913 secs 2024-04-27T03:10:50.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:50 smithi092 ceph-mon[29156]: pgmap v17449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:10:52.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:52 smithi189 ceph-mon[32756]: pgmap v17450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:10:52.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:52 smithi156 ceph-mon[32679]: pgmap v17450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:10:52.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:52 smithi092 ceph-mon[29156]: pgmap v17450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:10:54.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:54 smithi189 ceph-mon[32756]: pgmap v17451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:54.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:54 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31949.916172 secs 2024-04-27T03:10:54.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:54 smithi156 ceph-mon[32679]: pgmap v17451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:54.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:54 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31949.916172 secs 2024-04-27T03:10:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:54 smithi092 ceph-mon[29156]: pgmap v17451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:54 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31949.916172 secs 2024-04-27T03:10:55.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31252.883030 secs 2024-04-27T03:10:55.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31252.883030 secs 2024-04-27T03:10:55.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31252.883030 secs 2024-04-27T03:10:56.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:56 smithi189 ceph-mon[32756]: pgmap v17452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:56.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:56 smithi156 ceph-mon[32679]: pgmap v17452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:56.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:56 smithi092 ceph-mon[29156]: pgmap v17452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:10:58.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:58 smithi189 ceph-mon[32756]: pgmap v17453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:58.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:58 smithi156 ceph-mon[32679]: pgmap v17453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:58 smithi092 ceph-mon[29156]: pgmap v17453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:10:59.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:10:59 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31954.916283 secs 2024-04-27T03:10:59.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:10:59 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31954.916283 secs 2024-04-27T03:10:59.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:10:59 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31954.916283 secs 2024-04-27T03:11:00.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31257.883139 secs 2024-04-27T03:11:00.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:00 smithi189 ceph-mon[32756]: pgmap v17454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:00.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31257.883139 secs 2024-04-27T03:11:00.653 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:00 smithi092 ceph-mon[29156]: pgmap v17454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:00.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31257.883139 secs 2024-04-27T03:11:00.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:00 smithi156 ceph-mon[32679]: pgmap v17454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:02.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:02 smithi189 ceph-mon[32756]: pgmap v17455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:02.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:02 smithi156 ceph-mon[32679]: pgmap v17455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:02.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:02 smithi092 ceph-mon[29156]: pgmap v17455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:04.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:04 smithi189 ceph-mon[32756]: pgmap v17456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:04.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:04 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31959.916385 secs 2024-04-27T03:11:04.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:04 smithi156 ceph-mon[32679]: pgmap v17456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:04.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:04 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31959.916385 secs 2024-04-27T03:11:04.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:04 smithi092 ceph-mon[29156]: pgmap v17456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:04.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:04 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31959.916385 secs 2024-04-27T03:11:05.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31262.883275 secs 2024-04-27T03:11:05.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31262.883275 secs 2024-04-27T03:11:05.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31262.883275 secs 2024-04-27T03:11:06.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:06 smithi189 ceph-mon[32756]: pgmap v17457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:06.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:06 smithi156 ceph-mon[32679]: pgmap v17457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:06.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:06 smithi092 ceph-mon[29156]: pgmap v17457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:08.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:08 smithi189 ceph-mon[32756]: pgmap v17458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:08.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:08 smithi156 ceph-mon[32679]: pgmap v17458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:08.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:08 smithi092 ceph-mon[29156]: pgmap v17458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:09.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:09 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 31964.916523 secs 2024-04-27T03:11:09.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:09 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 31964.916523 secs 2024-04-27T03:11:09.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 31964.916523 secs 2024-04-27T03:11:09.752 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:11:09.351+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:11:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:11:09.351+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:11:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:11:09.351+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:11:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:11:09.351+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:11:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:11:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:11:09.351+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:11:10.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31267.883349 secs 2024-04-27T03:11:10.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:10 smithi189 ceph-mon[32756]: pgmap v17459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:10.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31267.883349 secs 2024-04-27T03:11:10.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:10 smithi156 ceph-mon[32679]: pgmap v17459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:10.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31267.883349 secs 2024-04-27T03:11:10.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:10 smithi092 ceph-mon[29156]: pgmap v17459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:12.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:12 smithi189 ceph-mon[32756]: pgmap v17460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:12.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:12 smithi156 ceph-mon[32679]: pgmap v17460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:12.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:12 smithi092 ceph-mon[29156]: pgmap v17460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:14.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:14 smithi189 ceph-mon[32756]: pgmap v17461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:14.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31969.916593 secs 2024-04-27T03:11:14.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:14 smithi156 ceph-mon[32679]: pgmap v17461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:14.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31969.916593 secs 2024-04-27T03:11:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:14 smithi092 ceph-mon[29156]: pgmap v17461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31969.916593 secs 2024-04-27T03:11:15.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31272.883426 secs 2024-04-27T03:11:15.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31272.883426 secs 2024-04-27T03:11:15.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31272.883426 secs 2024-04-27T03:11:16.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:16 smithi189 ceph-mon[32756]: pgmap v17462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:16.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:11:16.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:11:16.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:16 smithi156 ceph-mon[32679]: pgmap v17462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:16.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:11:16.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:11:16.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:16 smithi092 ceph-mon[29156]: pgmap v17462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:16.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:11:16.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:11:18.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:18 smithi156 ceph-mon[32679]: pgmap v17463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:18.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:18 smithi092 ceph-mon[29156]: pgmap v17463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:18.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:18 smithi189 ceph-mon[32756]: pgmap v17463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:19.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31974.916728 secs 2024-04-27T03:11:19.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31974.916728 secs 2024-04-27T03:11:19.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31974.916728 secs 2024-04-27T03:11:20.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31277.883530 secs 2024-04-27T03:11:20.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:20 smithi156 ceph-mon[32679]: pgmap v17464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:20.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31277.883530 secs 2024-04-27T03:11:20.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:20 smithi092 ceph-mon[29156]: pgmap v17464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:20.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31277.883530 secs 2024-04-27T03:11:20.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:20 smithi189 ceph-mon[32756]: pgmap v17464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:22.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:22 smithi156 ceph-mon[32679]: pgmap v17465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:22.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:22 smithi092 ceph-mon[29156]: pgmap v17465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:22.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:22 smithi189 ceph-mon[32756]: pgmap v17465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:24.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:24 smithi156 ceph-mon[32679]: pgmap v17466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:24.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31979.916845 secs 2024-04-27T03:11:24.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:24 smithi092 ceph-mon[29156]: pgmap v17466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:24.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31979.916845 secs 2024-04-27T03:11:24.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:24 smithi189 ceph-mon[32756]: pgmap v17466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T03:11:24.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31979.916845 secs 2024-04-27T03:11:25.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31282.883649 secs 2024-04-27T03:11:25.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31282.883649 secs 2024-04-27T03:11:25.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31282.883649 secs 2024-04-27T03:11:26.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:26 smithi156 ceph-mon[32679]: pgmap v17467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:26.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:26 smithi092 ceph-mon[29156]: pgmap v17467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:26.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:26 smithi189 ceph-mon[32756]: pgmap v17467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T03:11:28.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:28 smithi156 ceph-mon[32679]: pgmap v17468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:28.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:28 smithi092 ceph-mon[29156]: pgmap v17468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:28.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:28 smithi189 ceph-mon[32756]: pgmap v17468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:29.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31984.916896 secs 2024-04-27T03:11:29.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31984.916896 secs 2024-04-27T03:11:29.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31984.916896 secs 2024-04-27T03:11:30.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31287.883773 secs 2024-04-27T03:11:30.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:30 smithi156 ceph-mon[32679]: pgmap v17469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:30.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31287.883773 secs 2024-04-27T03:11:30.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:30 smithi092 ceph-mon[29156]: pgmap v17469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:30.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31287.883773 secs 2024-04-27T03:11:30.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:30 smithi189 ceph-mon[32756]: pgmap v17469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:32.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:32 smithi156 ceph-mon[32679]: pgmap v17470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:32.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:32 smithi092 ceph-mon[29156]: pgmap v17470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:32.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:32 smithi189 ceph-mon[32756]: pgmap v17470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:34.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:34 smithi156 ceph-mon[32679]: pgmap v17471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:34.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31989.916968 secs 2024-04-27T03:11:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:34 smithi092 ceph-mon[29156]: pgmap v17471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31989.916968 secs 2024-04-27T03:11:34.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:34 smithi189 ceph-mon[32756]: pgmap v17471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:34.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31989.916968 secs 2024-04-27T03:11:35.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31292.883901 secs 2024-04-27T03:11:35.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31292.883901 secs 2024-04-27T03:11:35.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31292.883901 secs 2024-04-27T03:11:36.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:36 smithi092 ceph-mon[29156]: pgmap v17472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:36.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:36 smithi189 ceph-mon[32756]: pgmap v17472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:36.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:36 smithi156 ceph-mon[32679]: pgmap v17472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:38.699 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:38 smithi189 ceph-mon[32756]: pgmap v17473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:38.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:38 smithi092 ceph-mon[29156]: pgmap v17473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:38.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:38 smithi156 ceph-mon[32679]: pgmap v17473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:39.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31994.917062 secs 2024-04-27T03:11:39.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31994.917062 secs 2024-04-27T03:11:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31994.917062 secs 2024-04-27T03:11:40.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31297.884035 secs 2024-04-27T03:11:40.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:40 smithi092 ceph-mon[29156]: pgmap v17474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:40.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31297.884035 secs 2024-04-27T03:11:40.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:40 smithi156 ceph-mon[32679]: pgmap v17474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:40.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31297.884035 secs 2024-04-27T03:11:40.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:40 smithi189 ceph-mon[32756]: pgmap v17474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:41.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:11:41.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:11:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:11:42.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: pgmap v17475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:42.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.738 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.739 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: pgmap v17475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: pgmap v17475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:42.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: pgmap v17476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:44.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 31999.917139 secs 2024-04-27T03:11:44.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: pgmap v17476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 31999.917139 secs 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: pgmap v17476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 31999.917139 secs 2024-04-27T03:11:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31302.884129 secs 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:11:45.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31302.884129 secs 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:11:45.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31302.884129 secs 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:11:45.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:11:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:11:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: pgmap v17477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: pgmap v17478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:46.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:46 smithi092 ceph-mon[29156]: pgmap v17479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:11:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:11:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:11:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: pgmap v17477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:46.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:11:46.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: pgmap v17478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:46.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:46 smithi189 ceph-mon[32756]: pgmap v17479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:46.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: pgmap v17477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: pgmap v17478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:46 smithi156 ceph-mon[32679]: pgmap v17479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:48.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:48 smithi092 ceph-mon[29156]: pgmap v17480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:48.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:48 smithi189 ceph-mon[32756]: pgmap v17480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:48.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:48 smithi156 ceph-mon[32679]: pgmap v17480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:49.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32004.917262 secs 2024-04-27T03:11:49.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32004.917262 secs 2024-04-27T03:11:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32004.917262 secs 2024-04-27T03:11:50.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31307.884249 secs 2024-04-27T03:11:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:50 smithi092 ceph-mon[29156]: pgmap v17481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:50.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31307.884249 secs 2024-04-27T03:11:50.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:50 smithi189 ceph-mon[32756]: pgmap v17481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31307.884249 secs 2024-04-27T03:11:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:50 smithi156 ceph-mon[32679]: pgmap v17481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:52.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:52 smithi092 ceph-mon[29156]: pgmap v17482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:52.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:52 smithi189 ceph-mon[32756]: pgmap v17482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:52.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:52 smithi156 ceph-mon[32679]: pgmap v17482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:11:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:54 smithi092 ceph-mon[29156]: pgmap v17483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32009.917378 secs 2024-04-27T03:11:54.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:54 smithi189 ceph-mon[32756]: pgmap v17483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:54.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32009.917378 secs 2024-04-27T03:11:54.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:54 smithi156 ceph-mon[32679]: pgmap v17483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:11:54.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32009.917378 secs 2024-04-27T03:11:55.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31312.884365 secs 2024-04-27T03:11:55.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31312.884365 secs 2024-04-27T03:11:55.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31312.884365 secs 2024-04-27T03:11:56.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:56 smithi092 ceph-mon[29156]: pgmap v17484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:56.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:56 smithi189 ceph-mon[32756]: pgmap v17484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:56.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:56 smithi156 ceph-mon[32679]: pgmap v17484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:11:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:58 smithi092 ceph-mon[29156]: pgmap v17485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:58.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:58 smithi189 ceph-mon[32756]: pgmap v17485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:58.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:58 smithi156 ceph-mon[32679]: pgmap v17485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:11:59.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:11:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32014.917494 secs 2024-04-27T03:11:59.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:11:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32014.917494 secs 2024-04-27T03:12:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:11:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32014.917494 secs 2024-04-27T03:12:00.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31317.884426 secs 2024-04-27T03:12:00.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:00 smithi189 ceph-mon[32756]: pgmap v17486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:00.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31317.884426 secs 2024-04-27T03:12:00.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:00 smithi092 ceph-mon[29156]: pgmap v17486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:00.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31317.884426 secs 2024-04-27T03:12:00.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:00 smithi156 ceph-mon[32679]: pgmap v17486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:02.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:02 smithi189 ceph-mon[32756]: pgmap v17487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:02.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:02 smithi156 ceph-mon[32679]: pgmap v17487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:03.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:02 smithi092 ceph-mon[29156]: pgmap v17487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:04 smithi189 ceph-mon[32756]: pgmap v17488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:04 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 32019.917622 secs 2024-04-27T03:12:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:04 smithi189 ceph-mon[32756]: slow request 11522.939699 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T03:12:04.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:04 smithi156 ceph-mon[32679]: pgmap v17488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:04.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:04 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 32019.917622 secs 2024-04-27T03:12:04.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:04 smithi156 ceph-mon[32679]: slow request 11522.939699 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T03:12:05.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:04 smithi092 ceph-mon[29156]: pgmap v17488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:05.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:04 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 32019.917622 secs 2024-04-27T03:12:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:04 smithi092 ceph-mon[29156]: slow request 11522.939699 seconds old, received at 2024-04-27T00:00:00.893664+0000: client_request(client.24770:4277 lookup #0x10000000006/log 2024-04-27T00:00:00.892415+0000 caller_uid=26, caller_gid=26{26,}) currently failed to acquire snap lock 2024-04-27T03:12:05.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31322.884491 secs 2024-04-27T03:12:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31322.884491 secs 2024-04-27T03:12:06.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31322.884491 secs 2024-04-27T03:12:06.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:06 smithi189 ceph-mon[32756]: pgmap v17489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:06.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:06 smithi156 ceph-mon[32679]: pgmap v17489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:07.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:06 smithi092 ceph-mon[29156]: pgmap v17489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:08.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:08 smithi189 ceph-mon[32756]: pgmap v17490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:08.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:08 smithi156 ceph-mon[32679]: pgmap v17490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:09.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:08 smithi092 ceph-mon[29156]: pgmap v17490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:09.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32024.917733 secs 2024-04-27T03:12:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32024.917733 secs 2024-04-27T03:12:10.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32024.917733 secs 2024-04-27T03:12:10.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31327.884614 secs 2024-04-27T03:12:10.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:10 smithi156 ceph-mon[32679]: pgmap v17491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31327.884614 secs 2024-04-27T03:12:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:10 smithi189 ceph-mon[32756]: pgmap v17491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:10.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31327.884614 secs 2024-04-27T03:12:10.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:10 smithi092 ceph-mon[29156]: pgmap v17491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:12.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:12 smithi189 ceph-mon[32756]: pgmap v17492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:12.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:12 smithi156 ceph-mon[32679]: pgmap v17492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:13.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:12 smithi092 ceph-mon[29156]: pgmap v17492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:14.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:14 smithi189 ceph-mon[32756]: pgmap v17493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:14.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:14 smithi189 ceph-mon[32756]: 15 slow requests, 1 included below; oldest blocked for > 32029.917855 secs 2024-04-27T03:12:14.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:14 smithi189 ceph-mon[32756]: slow request 364.540540 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:12:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:14 smithi156 ceph-mon[32679]: pgmap v17493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:14.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:14 smithi156 ceph-mon[32679]: 15 slow requests, 1 included below; oldest blocked for > 32029.917855 secs 2024-04-27T03:12:14.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:14 smithi156 ceph-mon[32679]: slow request 364.540540 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:12:15.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:14 smithi092 ceph-mon[29156]: pgmap v17493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:15.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:14 smithi092 ceph-mon[29156]: 15 slow requests, 1 included below; oldest blocked for > 32029.917855 secs 2024-04-27T03:12:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:14 smithi092 ceph-mon[29156]: slow request 364.540540 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:12:15.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31332.884729 secs 2024-04-27T03:12:15.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31332.884729 secs 2024-04-27T03:12:16.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31332.884729 secs 2024-04-27T03:12:16.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:16 smithi189 ceph-mon[32756]: pgmap v17494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:16.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:16 smithi156 ceph-mon[32679]: pgmap v17494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:17.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:16 smithi092 ceph-mon[29156]: pgmap v17494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:18.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:17 smithi189 ceph-mon[32756]: pgmap v17495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:18.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:17 smithi156 ceph-mon[32679]: pgmap v17495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:18.252 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:17 smithi092 ceph-mon[29156]: pgmap v17495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:19.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32034.917950 secs 2024-04-27T03:12:19.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32034.917950 secs 2024-04-27T03:12:19.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32034.917950 secs 2024-04-27T03:12:20.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31337.884803 secs 2024-04-27T03:12:20.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:20 smithi189 ceph-mon[32756]: pgmap v17496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:20.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31337.884803 secs 2024-04-27T03:12:20.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:20 smithi156 ceph-mon[32679]: pgmap v17496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:20.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31337.884803 secs 2024-04-27T03:12:20.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:20 smithi092 ceph-mon[29156]: pgmap v17496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:22.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:22 smithi092 ceph-mon[29156]: pgmap v17497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:22.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:22 smithi189 ceph-mon[32756]: pgmap v17497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:22.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:22 smithi156 ceph-mon[32679]: pgmap v17497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:24 smithi092 ceph-mon[29156]: pgmap v17498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32039.918036 secs 2024-04-27T03:12:24.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:24 smithi189 ceph-mon[32756]: pgmap v17498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:24.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32039.918036 secs 2024-04-27T03:12:24.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:24 smithi156 ceph-mon[32679]: pgmap v17498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:24.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32039.918036 secs 2024-04-27T03:12:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31342.884942 secs 2024-04-27T03:12:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31342.884942 secs 2024-04-27T03:12:25.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31342.884942 secs 2024-04-27T03:12:26.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:26 smithi092 ceph-mon[29156]: pgmap v17499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:26.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:26 smithi189 ceph-mon[32756]: pgmap v17499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:26.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:26 smithi156 ceph-mon[32679]: pgmap v17499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:28.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:28 smithi092 ceph-mon[29156]: pgmap v17500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:28.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:28 smithi189 ceph-mon[32756]: pgmap v17500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:28.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:28 smithi156 ceph-mon[32679]: pgmap v17500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:29.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32044.918154 secs 2024-04-27T03:12:29.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32044.918154 secs 2024-04-27T03:12:29.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32044.918154 secs 2024-04-27T03:12:30.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31347.885047 secs 2024-04-27T03:12:30.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:30 smithi092 ceph-mon[29156]: pgmap v17501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:30.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31347.885047 secs 2024-04-27T03:12:30.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:30 smithi189 ceph-mon[32756]: pgmap v17501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:30.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31347.885047 secs 2024-04-27T03:12:30.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:30 smithi156 ceph-mon[32679]: pgmap v17501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:32.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:32 smithi092 ceph-mon[29156]: pgmap v17502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:32.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:32 smithi189 ceph-mon[32756]: pgmap v17502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:32.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:32 smithi156 ceph-mon[32679]: pgmap v17502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:34 smithi092 ceph-mon[29156]: pgmap v17503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:34.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32049.918254 secs 2024-04-27T03:12:34.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:34 smithi189 ceph-mon[32756]: pgmap v17503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:34.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32049.918254 secs 2024-04-27T03:12:34.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:34 smithi156 ceph-mon[32679]: pgmap v17503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:34.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32049.918254 secs 2024-04-27T03:12:35.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31352.885169 secs 2024-04-27T03:12:35.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31352.885169 secs 2024-04-27T03:12:35.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31352.885169 secs 2024-04-27T03:12:36.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:36 smithi092 ceph-mon[29156]: pgmap v17504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:36.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:36 smithi189 ceph-mon[32756]: pgmap v17504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:36.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:36 smithi156 ceph-mon[32679]: pgmap v17504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:38.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:38 smithi092 ceph-mon[29156]: pgmap v17505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:38.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:38 smithi189 ceph-mon[32756]: pgmap v17505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:38.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:38 smithi156 ceph-mon[32679]: pgmap v17505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:39.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32054.918353 secs 2024-04-27T03:12:39.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32054.918353 secs 2024-04-27T03:12:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32054.918353 secs 2024-04-27T03:12:40.392 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:12:40.383+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:12:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:12:40.383+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:12:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:12:40.383+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:12:40.393 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:12:40.384+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 247 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:12:40.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31357.885278 secs 2024-04-27T03:12:40.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:40 smithi156 ceph-mon[32679]: pgmap v17506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:40.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31357.885278 secs 2024-04-27T03:12:40.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:40 smithi189 ceph-mon[32756]: pgmap v17506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31357.885278 secs 2024-04-27T03:12:41.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:40 smithi092 ceph-mon[29156]: pgmap v17506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:42.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:42 smithi189 ceph-mon[32756]: pgmap v17507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:42.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:42 smithi156 ceph-mon[32679]: pgmap v17507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:43.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:42 smithi092 ceph-mon[29156]: pgmap v17507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:44 smithi189 ceph-mon[32756]: pgmap v17508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:44.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32059.918467 secs 2024-04-27T03:12:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:44 smithi156 ceph-mon[32679]: pgmap v17508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:44.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32059.918467 secs 2024-04-27T03:12:45.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:44 smithi092 ceph-mon[29156]: pgmap v17508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:45.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32059.918467 secs 2024-04-27T03:12:45.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31362.885392 secs 2024-04-27T03:12:45.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31362.885392 secs 2024-04-27T03:12:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31362.885392 secs 2024-04-27T03:12:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:46 smithi189 ceph-mon[32756]: pgmap v17509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:12:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:12:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:12:46.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:12:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:46 smithi156 ceph-mon[32679]: pgmap v17509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:12:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:12:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:12:46.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:12:47.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:46 smithi092 ceph-mon[29156]: pgmap v17509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:12:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:12:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:12:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:12:47.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:12:47.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:47 smithi189 ceph-mon[32756]: pgmap v17510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:12:47.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:47 smithi189 ceph-mon[32756]: pgmap v17511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:47.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:47 smithi156 ceph-mon[32679]: pgmap v17510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:12:47.944 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:47 smithi156 ceph-mon[32679]: pgmap v17511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:48.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:47 smithi092 ceph-mon[29156]: pgmap v17510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:12:48.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:47 smithi092 ceph-mon[29156]: pgmap v17511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:49.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:49 smithi189 ceph-mon[32756]: pgmap v17512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:12:49.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32064.918597 secs 2024-04-27T03:12:49.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:49 smithi156 ceph-mon[32679]: pgmap v17512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:12:49.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32064.918597 secs 2024-04-27T03:12:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:49 smithi092 ceph-mon[29156]: pgmap v17512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:12:50.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32064.918597 secs 2024-04-27T03:12:50.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31367.885502 secs 2024-04-27T03:12:50.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31367.885502 secs 2024-04-27T03:12:51.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31367.885502 secs 2024-04-27T03:12:51.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:51 smithi189 ceph-mon[32756]: pgmap v17513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:51.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:51 smithi156 ceph-mon[32679]: pgmap v17513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:52.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:51 smithi092 ceph-mon[29156]: pgmap v17513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:53.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:53 smithi189 ceph-mon[32756]: pgmap v17514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:53.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:53 smithi156 ceph-mon[32679]: pgmap v17514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:54.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:53 smithi092 ceph-mon[29156]: pgmap v17514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:54.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32069.918735 secs 2024-04-27T03:12:54.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32069.918735 secs 2024-04-27T03:12:55.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32069.918735 secs 2024-04-27T03:12:55.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31372.885583 secs 2024-04-27T03:12:55.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:55 smithi189 ceph-mon[32756]: pgmap v17515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:55.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31372.885583 secs 2024-04-27T03:12:55.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:55 smithi156 ceph-mon[32679]: pgmap v17515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:56.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31372.885583 secs 2024-04-27T03:12:56.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:55 smithi092 ceph-mon[29156]: pgmap v17515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:12:57.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:57 smithi189 ceph-mon[32756]: pgmap v17516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:12:57.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:57 smithi156 ceph-mon[32679]: pgmap v17516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:12:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:57 smithi092 ceph-mon[29156]: pgmap v17516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:12:59.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:59 smithi189 ceph-mon[32756]: pgmap v17517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:59.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:12:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32074.918881 secs 2024-04-27T03:12:59.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:59 smithi156 ceph-mon[32679]: pgmap v17517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:12:59.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:12:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32074.918881 secs 2024-04-27T03:13:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:59 smithi092 ceph-mon[29156]: pgmap v17517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:12:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32074.918881 secs 2024-04-27T03:13:00.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31377.885722 secs 2024-04-27T03:13:00.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31377.885722 secs 2024-04-27T03:13:00.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31377.885722 secs 2024-04-27T03:13:01.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:01 smithi189 ceph-mon[32756]: pgmap v17518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:01.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:01 smithi156 ceph-mon[32679]: pgmap v17518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:02.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:01 smithi092 ceph-mon[29156]: pgmap v17518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:03.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:03 smithi189 ceph-mon[32756]: pgmap v17519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:03.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:03 smithi156 ceph-mon[32679]: pgmap v17519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:04.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:03 smithi092 ceph-mon[29156]: pgmap v17519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32079.918990 secs 2024-04-27T03:13:04.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32079.918990 secs 2024-04-27T03:13:05.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32079.918990 secs 2024-04-27T03:13:05.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31382.885845 secs 2024-04-27T03:13:05.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:05 smithi189 ceph-mon[32756]: pgmap v17520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:05.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31382.885845 secs 2024-04-27T03:13:05.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:05 smithi156 ceph-mon[32679]: pgmap v17520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:06.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31382.885845 secs 2024-04-27T03:13:06.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:05 smithi092 ceph-mon[29156]: pgmap v17520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:07.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:07 smithi189 ceph-mon[32756]: pgmap v17521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:07.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:07 smithi156 ceph-mon[32679]: pgmap v17521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:08.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:07 smithi092 ceph-mon[29156]: pgmap v17521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:09.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:09 smithi189 ceph-mon[32756]: pgmap v17522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:09.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32084.919095 secs 2024-04-27T03:13:09.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:09 smithi156 ceph-mon[32679]: pgmap v17522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:09.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32084.919095 secs 2024-04-27T03:13:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:09 smithi092 ceph-mon[29156]: pgmap v17522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:10.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32084.919095 secs 2024-04-27T03:13:10.844 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31387.885959 secs 2024-04-27T03:13:10.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31387.885959 secs 2024-04-27T03:13:11.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31387.885959 secs 2024-04-27T03:13:11.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:11 smithi189 ceph-mon[32756]: pgmap v17523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:11.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:11 smithi156 ceph-mon[32679]: pgmap v17523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:12.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:11 smithi092 ceph-mon[29156]: pgmap v17523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:13.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:13 smithi189 ceph-mon[32756]: pgmap v17524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:13.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:13 smithi156 ceph-mon[32679]: pgmap v17524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:14.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:13 smithi092 ceph-mon[29156]: pgmap v17524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:14.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:14 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32089.919211 secs 2024-04-27T03:13:14.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:14 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32089.919211 secs 2024-04-27T03:13:15.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:14 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32089.919211 secs 2024-04-27T03:13:15.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31392.886075 secs 2024-04-27T03:13:15.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:15 smithi189 ceph-mon[32756]: pgmap v17525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:15.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31392.886075 secs 2024-04-27T03:13:15.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:15 smithi156 ceph-mon[32679]: pgmap v17525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31392.886075 secs 2024-04-27T03:13:16.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:15 smithi092 ceph-mon[29156]: pgmap v17525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:17.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:17 smithi189 ceph-mon[32756]: pgmap v17526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:17.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:17 smithi156 ceph-mon[32679]: pgmap v17526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:18.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:17 smithi092 ceph-mon[29156]: pgmap v17526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:19.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:19 smithi189 ceph-mon[32756]: pgmap v17527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:19.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:19 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32094.919303 secs 2024-04-27T03:13:19.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:19 smithi156 ceph-mon[32679]: pgmap v17527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:19.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:19 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32094.919303 secs 2024-04-27T03:13:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:19 smithi092 ceph-mon[29156]: pgmap v17527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:20.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:19 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32094.919303 secs 2024-04-27T03:13:20.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31397.886191 secs 2024-04-27T03:13:20.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31397.886191 secs 2024-04-27T03:13:21.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31397.886191 secs 2024-04-27T03:13:21.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:21 smithi189 ceph-mon[32756]: pgmap v17528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:21.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:21 smithi156 ceph-mon[32679]: pgmap v17528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:22.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:21 smithi092 ceph-mon[29156]: pgmap v17528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:23.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:23 smithi189 ceph-mon[32756]: pgmap v17529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:23.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:23 smithi156 ceph-mon[32679]: pgmap v17529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:24.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:23 smithi092 ceph-mon[29156]: pgmap v17529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:24.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:24 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32099.919413 secs 2024-04-27T03:13:24.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:24 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32099.919413 secs 2024-04-27T03:13:25.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:24 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32099.919413 secs 2024-04-27T03:13:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31402.886281 secs 2024-04-27T03:13:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:25 smithi189 ceph-mon[32756]: pgmap v17530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:25.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31402.886281 secs 2024-04-27T03:13:25.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:25 smithi156 ceph-mon[32679]: pgmap v17530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:26.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31402.886281 secs 2024-04-27T03:13:26.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:25 smithi092 ceph-mon[29156]: pgmap v17530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:27.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:27 smithi189 ceph-mon[32756]: pgmap v17531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:27.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:27 smithi156 ceph-mon[32679]: pgmap v17531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:28.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:27 smithi092 ceph-mon[29156]: pgmap v17531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:29.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:29 smithi189 ceph-mon[32756]: pgmap v17532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:29.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:29 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32104.919497 secs 2024-04-27T03:13:29.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:29 smithi156 ceph-mon[32679]: pgmap v17532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:29.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:29 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32104.919497 secs 2024-04-27T03:13:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:29 smithi092 ceph-mon[29156]: pgmap v17532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:30.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:29 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32104.919497 secs 2024-04-27T03:13:30.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31407.886402 secs 2024-04-27T03:13:30.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:30 smithi189 ceph-mon[32756]: pgmap v17533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:30.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31407.886402 secs 2024-04-27T03:13:30.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:30 smithi092 ceph-mon[29156]: pgmap v17533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:30.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31407.886402 secs 2024-04-27T03:13:30.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:30 smithi156 ceph-mon[32679]: pgmap v17533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:33.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:33 smithi189 ceph-mon[32756]: pgmap v17534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:33.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:33 smithi156 ceph-mon[32679]: pgmap v17534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:33 smithi092 ceph-mon[29156]: pgmap v17534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:34.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:34 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32109.919607 secs 2024-04-27T03:13:34.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:34 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32109.919607 secs 2024-04-27T03:13:34.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:34 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32109.919607 secs 2024-04-27T03:13:35.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31412.886467 secs 2024-04-27T03:13:35.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:35 smithi189 ceph-mon[32756]: pgmap v17535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:35.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31412.886467 secs 2024-04-27T03:13:35.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:35 smithi156 ceph-mon[32679]: pgmap v17535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31412.886467 secs 2024-04-27T03:13:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:35 smithi092 ceph-mon[29156]: pgmap v17535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:37.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:37 smithi189 ceph-mon[32756]: pgmap v17536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:37.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:37 smithi156 ceph-mon[32679]: pgmap v17536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:37 smithi092 ceph-mon[29156]: pgmap v17536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:39.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:39 smithi189 ceph-mon[32756]: pgmap v17537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:39.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:39 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32114.919725 secs 2024-04-27T03:13:39.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:39 smithi156 ceph-mon[32679]: pgmap v17537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:39.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:39 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32114.919725 secs 2024-04-27T03:13:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:39 smithi092 ceph-mon[29156]: pgmap v17537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:39 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32114.919725 secs 2024-04-27T03:13:40.595 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31417.886585 secs 2024-04-27T03:13:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31417.886585 secs 2024-04-27T03:13:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31417.886585 secs 2024-04-27T03:13:41.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:41 smithi189 ceph-mon[32756]: pgmap v17538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:41.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:41 smithi156 ceph-mon[32679]: pgmap v17538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:41 smithi092 ceph-mon[29156]: pgmap v17538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:43.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:43 smithi189 ceph-mon[32756]: pgmap v17539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:43.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:43 smithi156 ceph-mon[32679]: pgmap v17539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:43.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:43 smithi092 ceph-mon[29156]: pgmap v17539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:44.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:44 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32119.919849 secs 2024-04-27T03:13:44.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:44 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32119.919849 secs 2024-04-27T03:13:44.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:44 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32119.919849 secs 2024-04-27T03:13:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31422.886734 secs 2024-04-27T03:13:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:45 smithi189 ceph-mon[32756]: pgmap v17540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:45.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31422.886734 secs 2024-04-27T03:13:45.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:45 smithi156 ceph-mon[32679]: pgmap v17540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31422.886734 secs 2024-04-27T03:13:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:45 smithi092 ceph-mon[29156]: pgmap v17540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:13:47.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:47 smithi189 ceph-mon[32756]: pgmap v17541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:47.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:13:47.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:13:47.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:13:47.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:13:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:47 smithi156 ceph-mon[32679]: pgmap v17541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:13:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:13:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:13:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:13:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:47 smithi092 ceph-mon[29156]: pgmap v17541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:13:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:13:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:13:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:13:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:13:48.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:48 smithi189 ceph-mon[32756]: pgmap v17542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:13:48.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:48 smithi189 ceph-mon[32756]: pgmap v17543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:48.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:48 smithi156 ceph-mon[32679]: pgmap v17542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:13:48.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:48 smithi156 ceph-mon[32679]: pgmap v17543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:48.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:48 smithi092 ceph-mon[29156]: pgmap v17542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:13:48.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:48 smithi092 ceph-mon[29156]: pgmap v17543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:49 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32124.919965 secs 2024-04-27T03:13:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:49 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32124.919965 secs 2024-04-27T03:13:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:49 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32124.919965 secs 2024-04-27T03:13:50.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:50 smithi189 ceph-mon[32756]: pgmap v17544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:50.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31427.886804 secs 2024-04-27T03:13:50.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:50 smithi156 ceph-mon[32679]: pgmap v17544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:50.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31427.886804 secs 2024-04-27T03:13:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:50 smithi092 ceph-mon[29156]: pgmap v17544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31427.886804 secs 2024-04-27T03:13:52.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:52 smithi189 ceph-mon[32756]: pgmap v17545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:52.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:52 smithi156 ceph-mon[32679]: pgmap v17545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:52.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:52 smithi092 ceph-mon[29156]: pgmap v17545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:54.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:54 smithi189 ceph-mon[32756]: pgmap v17546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:13:54.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:54 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32129.920061 secs 2024-04-27T03:13:54.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:54 smithi156 ceph-mon[32679]: pgmap v17546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:13:54.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:54 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32129.920061 secs 2024-04-27T03:13:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:54 smithi092 ceph-mon[29156]: pgmap v17546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:13:54.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:54 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32129.920061 secs 2024-04-27T03:13:55.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31432.886945 secs 2024-04-27T03:13:55.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31432.886945 secs 2024-04-27T03:13:55.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31432.886945 secs 2024-04-27T03:13:56.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:56 smithi189 ceph-mon[32756]: pgmap v17547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:56.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:56 smithi156 ceph-mon[32679]: pgmap v17547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:56.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:56 smithi092 ceph-mon[29156]: pgmap v17547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:13:58.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:58 smithi189 ceph-mon[32756]: pgmap v17548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:13:58.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:58 smithi156 ceph-mon[32679]: pgmap v17548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:13:58.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:58 smithi092 ceph-mon[29156]: pgmap v17548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:13:59.622 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:13:59 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32134.920174 secs 2024-04-27T03:13:59.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:13:59 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32134.920174 secs 2024-04-27T03:13:59.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:13:59 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32134.920174 secs 2024-04-27T03:14:00.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:00 smithi189 ceph-mon[32756]: pgmap v17549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:00.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31437.887066 secs 2024-04-27T03:14:00.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:00 smithi156 ceph-mon[32679]: pgmap v17549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:00.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31437.887066 secs 2024-04-27T03:14:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:00 smithi092 ceph-mon[29156]: pgmap v17549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:00.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31437.887066 secs 2024-04-27T03:14:02.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:02 smithi189 ceph-mon[32756]: pgmap v17550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:02.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:02 smithi156 ceph-mon[32679]: pgmap v17550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:02.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:02 smithi092 ceph-mon[29156]: pgmap v17550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:04.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:04 smithi189 ceph-mon[32756]: pgmap v17551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:04.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:04 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32139.920280 secs 2024-04-27T03:14:04.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:04 smithi156 ceph-mon[32679]: pgmap v17551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:04.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:04 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32139.920280 secs 2024-04-27T03:14:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:04 smithi092 ceph-mon[29156]: pgmap v17551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:04.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:04 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32139.920280 secs 2024-04-27T03:14:05.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31442.887167 secs 2024-04-27T03:14:05.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31442.887167 secs 2024-04-27T03:14:05.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31442.887167 secs 2024-04-27T03:14:06.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:06 smithi189 ceph-mon[32756]: pgmap v17552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:06.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:06 smithi156 ceph-mon[32679]: pgmap v17552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:06.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:06 smithi092 ceph-mon[29156]: pgmap v17552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:08.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:08 smithi189 ceph-mon[32756]: pgmap v17553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:08.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:08 smithi156 ceph-mon[32679]: pgmap v17553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:08.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:08 smithi092 ceph-mon[29156]: pgmap v17553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:09.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:09 smithi189 ceph-mon[32756]: 15 slow requests, 0 included below; oldest blocked for > 32144.920421 secs 2024-04-27T03:14:09.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:09 smithi156 ceph-mon[32679]: 15 slow requests, 0 included below; oldest blocked for > 32144.920421 secs 2024-04-27T03:14:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:09 smithi092 ceph-mon[29156]: 15 slow requests, 0 included below; oldest blocked for > 32144.920421 secs 2024-04-27T03:14:10.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:10 smithi189 ceph-mon[32756]: pgmap v17554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:10.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31447.887286 secs 2024-04-27T03:14:10.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:10 smithi156 ceph-mon[32679]: pgmap v17554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:10.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31447.887286 secs 2024-04-27T03:14:10.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:10 smithi092 ceph-mon[29156]: pgmap v17554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:10.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31447.887286 secs 2024-04-27T03:14:12.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:12 smithi189 ceph-mon[32756]: pgmap v17555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:12.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:12 smithi156 ceph-mon[32679]: pgmap v17555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:12.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:12 smithi092 ceph-mon[29156]: pgmap v17555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:14.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:14 smithi189 ceph-mon[32756]: pgmap v17556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:14.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32149.920558 secs 2024-04-27T03:14:14.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:14 smithi189 ceph-mon[32756]: slow request 184.475063 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:14:14.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:14 smithi156 ceph-mon[32679]: pgmap v17556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:14.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32149.920558 secs 2024-04-27T03:14:14.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:14 smithi156 ceph-mon[32679]: slow request 184.475063 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:14:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:14 smithi092 ceph-mon[29156]: pgmap v17556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32149.920558 secs 2024-04-27T03:14:14.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:14 smithi092 ceph-mon[29156]: slow request 184.475063 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:14:15.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31452.887428 secs 2024-04-27T03:14:15.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31452.887428 secs 2024-04-27T03:14:15.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31452.887428 secs 2024-04-27T03:14:16.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:16 smithi189 ceph-mon[32756]: pgmap v17557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:16.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:14:16.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:14:16.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:16 smithi156 ceph-mon[32679]: pgmap v17557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:16.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:14:16.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:14:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:16 smithi092 ceph-mon[29156]: pgmap v17557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T03:14:16.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:14:18.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:17 smithi189 ceph-mon[32756]: pgmap v17558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:18.193 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:17 smithi156 ceph-mon[32679]: pgmap v17558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:18.253 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:17 smithi092 ceph-mon[29156]: pgmap v17558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:20.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32154.920671 secs 2024-04-27T03:14:20.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:20 smithi189 ceph-mon[32756]: pgmap v17559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:20.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31457.887549 secs 2024-04-27T03:14:20.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32154.920671 secs 2024-04-27T03:14:20.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:20 smithi156 ceph-mon[32679]: pgmap v17559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:20.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31457.887549 secs 2024-04-27T03:14:20.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32154.920671 secs 2024-04-27T03:14:20.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:20 smithi092 ceph-mon[29156]: pgmap v17559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:20.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31457.887549 secs 2024-04-27T03:14:22.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:22 smithi189 ceph-mon[32756]: pgmap v17560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:22.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:22 smithi156 ceph-mon[32679]: pgmap v17560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:22.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:22 smithi092 ceph-mon[29156]: pgmap v17560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:24.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:24 smithi189 ceph-mon[32756]: pgmap v17561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:24.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:24 smithi156 ceph-mon[32679]: pgmap v17561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:24.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:24 smithi092 ceph-mon[29156]: pgmap v17561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:25.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32159.920784 secs 2024-04-27T03:14:25.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31462.887667 secs 2024-04-27T03:14:25.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32159.920784 secs 2024-04-27T03:14:25.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31462.887667 secs 2024-04-27T03:14:25.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32159.920784 secs 2024-04-27T03:14:25.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31462.887667 secs 2024-04-27T03:14:26.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:26 smithi189 ceph-mon[32756]: pgmap v17562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:26.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:26 smithi156 ceph-mon[32679]: pgmap v17562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:26.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:26 smithi092 ceph-mon[29156]: pgmap v17562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:28.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:28 smithi189 ceph-mon[32756]: pgmap v17563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:28.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:28 smithi156 ceph-mon[32679]: pgmap v17563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:28.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:28 smithi092 ceph-mon[29156]: pgmap v17563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:30.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32164.920914 secs 2024-04-27T03:14:30.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:30 smithi189 ceph-mon[32756]: pgmap v17564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:30.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31467.887783 secs 2024-04-27T03:14:30.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32164.920914 secs 2024-04-27T03:14:30.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:30 smithi156 ceph-mon[32679]: pgmap v17564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:30.444 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31467.887783 secs 2024-04-27T03:14:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32164.920914 secs 2024-04-27T03:14:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:30 smithi092 ceph-mon[29156]: pgmap v17564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:30.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31467.887783 secs 2024-04-27T03:14:32.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:32 smithi189 ceph-mon[32756]: pgmap v17565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:32.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:32 smithi156 ceph-mon[32679]: pgmap v17565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:32.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:32 smithi092 ceph-mon[29156]: pgmap v17565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:34.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:34 smithi189 ceph-mon[32756]: pgmap v17566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:34.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:34 smithi156 ceph-mon[32679]: pgmap v17566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:34.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:34 smithi092 ceph-mon[29156]: pgmap v17566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:35.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32169.920984 secs 2024-04-27T03:14:35.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31472.887883 secs 2024-04-27T03:14:35.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32169.920984 secs 2024-04-27T03:14:35.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31472.887883 secs 2024-04-27T03:14:35.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32169.920984 secs 2024-04-27T03:14:35.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31472.887883 secs 2024-04-27T03:14:36.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:36 smithi189 ceph-mon[32756]: pgmap v17567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:36.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:36 smithi156 ceph-mon[32679]: pgmap v17567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:36.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:36 smithi092 ceph-mon[29156]: pgmap v17567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:14:38.397 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:38 smithi189 ceph-mon[32756]: pgmap v17568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:38.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:38 smithi156 ceph-mon[32679]: pgmap v17568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:38.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:38 smithi092 ceph-mon[29156]: pgmap v17568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:39.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32174.921071 secs 2024-04-27T03:14:39.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32174.921071 secs 2024-04-27T03:14:39.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32174.921071 secs 2024-04-27T03:14:40.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:40 smithi156 ceph-mon[32679]: pgmap v17569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:40.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31477.888018 secs 2024-04-27T03:14:40.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:40 smithi092 ceph-mon[29156]: pgmap v17569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:40.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31477.888018 secs 2024-04-27T03:14:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:40 smithi189 ceph-mon[32756]: pgmap v17569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31477.888018 secs 2024-04-27T03:14:42.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:42 smithi156 ceph-mon[32679]: pgmap v17570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:42.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:42 smithi092 ceph-mon[29156]: pgmap v17570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:42.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:42 smithi189 ceph-mon[32756]: pgmap v17570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:44.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:44 smithi156 ceph-mon[32679]: pgmap v17571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:44.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32179.921195 secs 2024-04-27T03:14:44.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:44 smithi092 ceph-mon[29156]: pgmap v17571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:44.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32179.921195 secs 2024-04-27T03:14:44.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:44 smithi189 ceph-mon[32756]: pgmap v17571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-27T03:14:44.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32179.921195 secs 2024-04-27T03:14:45.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31482.888140 secs 2024-04-27T03:14:45.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31482.888140 secs 2024-04-27T03:14:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31482.888140 secs 2024-04-27T03:14:46.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:46 smithi156 ceph-mon[32679]: pgmap v17572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:46.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:46 smithi092 ceph-mon[29156]: pgmap v17572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:46.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:46 smithi189 ceph-mon[32756]: pgmap v17572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:47.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:14:47.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:14:47.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:14:48.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:48 smithi156 ceph-mon[32679]: pgmap v17573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-27T03:14:48.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:14:48.444 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:14:48.444 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:14:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:48 smithi092 ceph-mon[29156]: pgmap v17573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-27T03:14:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:14:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:14:48.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:14:48.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:48 smithi189 ceph-mon[32756]: pgmap v17573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 3 op/s 2024-04-27T03:14:48.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:14:48.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:14:48.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:14:49.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:49 smithi156 ceph-mon[32679]: pgmap v17574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:49.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:49 smithi156 ceph-mon[32679]: pgmap v17575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:14:49.444 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32184.921313 secs 2024-04-27T03:14:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:49 smithi092 ceph-mon[29156]: pgmap v17574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:49.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:49 smithi092 ceph-mon[29156]: pgmap v17575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:14:49.504 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32184.921313 secs 2024-04-27T03:14:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:49 smithi189 ceph-mon[32756]: pgmap v17574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:14:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:49 smithi189 ceph-mon[32756]: pgmap v17575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:14:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32184.921313 secs 2024-04-27T03:14:50.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31487.888220 secs 2024-04-27T03:14:50.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31487.888220 secs 2024-04-27T03:14:50.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31487.888220 secs 2024-04-27T03:14:51.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:51 smithi156 ceph-mon[32679]: pgmap v17576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:51.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:51 smithi092 ceph-mon[29156]: pgmap v17576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:51.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:51 smithi189 ceph-mon[32756]: pgmap v17576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:53.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:53 smithi092 ceph-mon[29156]: pgmap v17577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:53.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:53 smithi189 ceph-mon[32756]: pgmap v17577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:53.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:53 smithi156 ceph-mon[32679]: pgmap v17577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:54.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32189.921418 secs 2024-04-27T03:14:54.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32189.921418 secs 2024-04-27T03:14:54.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32189.921418 secs 2024-04-27T03:14:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:14:55.402+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:14:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:14:55.402+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:14:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:14:55.402+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:14:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:14:55.402+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 248 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:14:55.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:55 smithi092 ceph-mon[29156]: pgmap v17578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:55.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31492.888328 secs 2024-04-27T03:14:55.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:55 smithi189 ceph-mon[32756]: pgmap v17578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:55.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31492.888328 secs 2024-04-27T03:14:55.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:55 smithi156 ceph-mon[32679]: pgmap v17578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:55.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31492.888328 secs 2024-04-27T03:14:57.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:57 smithi092 ceph-mon[29156]: pgmap v17579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:57.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:57 smithi189 ceph-mon[32756]: pgmap v17579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:57.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:57 smithi156 ceph-mon[32679]: pgmap v17579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:14:59.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:59 smithi092 ceph-mon[29156]: pgmap v17580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:14:59.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:14:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32194.921535 secs 2024-04-27T03:14:59.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:59 smithi189 ceph-mon[32756]: pgmap v17580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:14:59.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:14:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32194.921535 secs 2024-04-27T03:14:59.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:59 smithi156 ceph-mon[32679]: pgmap v17580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:14:59.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:14:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32194.921535 secs 2024-04-27T03:15:00.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31497.888393 secs 2024-04-27T03:15:00.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31497.888393 secs 2024-04-27T03:15:00.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31497.888393 secs 2024-04-27T03:15:01.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:01 smithi092 ceph-mon[29156]: pgmap v17581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:01.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:01 smithi189 ceph-mon[32756]: pgmap v17581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:01.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:01 smithi156 ceph-mon[32679]: pgmap v17581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:03.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:03 smithi092 ceph-mon[29156]: pgmap v17582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:03.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:03 smithi189 ceph-mon[32756]: pgmap v17582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:03.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:03 smithi156 ceph-mon[32679]: pgmap v17582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:04.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32199.921602 secs 2024-04-27T03:15:04.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32199.921602 secs 2024-04-27T03:15:04.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32199.921602 secs 2024-04-27T03:15:05.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:05 smithi092 ceph-mon[29156]: pgmap v17583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:05.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31502.888514 secs 2024-04-27T03:15:05.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:05 smithi189 ceph-mon[32756]: pgmap v17583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:05.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31502.888514 secs 2024-04-27T03:15:05.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:05 smithi156 ceph-mon[32679]: pgmap v17583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:05.694 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31502.888514 secs 2024-04-27T03:15:07.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:07 smithi092 ceph-mon[29156]: pgmap v17584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:07.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:07 smithi189 ceph-mon[32756]: pgmap v17584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:07.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:07 smithi156 ceph-mon[32679]: pgmap v17584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:09.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:09 smithi092 ceph-mon[29156]: pgmap v17585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:09.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32204.921741 secs 2024-04-27T03:15:09.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:09 smithi092 ceph-mon[29156]: slow request 11522.608451 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:15:09.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:09 smithi189 ceph-mon[32756]: pgmap v17585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:09.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32204.921741 secs 2024-04-27T03:15:09.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:09 smithi189 ceph-mon[32756]: slow request 11522.608451 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:15:09.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:09 smithi156 ceph-mon[32679]: pgmap v17585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:09.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32204.921741 secs 2024-04-27T03:15:09.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:09 smithi156 ceph-mon[32679]: slow request 11522.608451 seconds old, received at 2024-04-27T00:03:06.229031+0000: client_request(client.17226:1 getattr pAsLsXsFs #0x1 2024-04-27T00:03:06.224930+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:15:10.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31507.888629 secs 2024-04-27T03:15:10.594 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31507.888629 secs 2024-04-27T03:15:10.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31507.888629 secs 2024-04-27T03:15:11.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:11 smithi092 ceph-mon[29156]: pgmap v17586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:11.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:11 smithi189 ceph-mon[32756]: pgmap v17586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:11.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:11 smithi156 ceph-mon[32679]: pgmap v17586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:13.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:13 smithi092 ceph-mon[29156]: pgmap v17587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:13.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:13 smithi189 ceph-mon[32756]: pgmap v17587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:13.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:13 smithi156 ceph-mon[32679]: pgmap v17587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:14.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32209.921855 secs 2024-04-27T03:15:14.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32209.921855 secs 2024-04-27T03:15:14.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32209.921855 secs 2024-04-27T03:15:15.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:15 smithi092 ceph-mon[29156]: pgmap v17588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:15.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31512.888707 secs 2024-04-27T03:15:15.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:15 smithi189 ceph-mon[32756]: pgmap v17588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:15.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31512.888707 secs 2024-04-27T03:15:15.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:15 smithi156 ceph-mon[32679]: pgmap v17588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:15.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31512.888707 secs 2024-04-27T03:15:17.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:17 smithi189 ceph-mon[32756]: pgmap v17589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:17.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:17 smithi156 ceph-mon[32679]: pgmap v17589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:17.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:17 smithi092 ceph-mon[29156]: pgmap v17589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:19.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:19 smithi189 ceph-mon[32756]: pgmap v17590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:19.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32214.921972 secs 2024-04-27T03:15:19.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:19 smithi156 ceph-mon[32679]: pgmap v17590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:19.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32214.921972 secs 2024-04-27T03:15:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:19 smithi092 ceph-mon[29156]: pgmap v17590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:19.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32214.921972 secs 2024-04-27T03:15:20.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31517.888789 secs 2024-04-27T03:15:20.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31517.888789 secs 2024-04-27T03:15:20.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31517.888789 secs 2024-04-27T03:15:21.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:21 smithi189 ceph-mon[32756]: pgmap v17591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:21.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:21 smithi156 ceph-mon[32679]: pgmap v17591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:21.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:21 smithi092 ceph-mon[29156]: pgmap v17591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:23.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:23 smithi189 ceph-mon[32756]: pgmap v17592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:23.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:23 smithi156 ceph-mon[32679]: pgmap v17592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:23.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:23 smithi092 ceph-mon[29156]: pgmap v17592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:24.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32219.922099 secs 2024-04-27T03:15:24.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32219.922099 secs 2024-04-27T03:15:24.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32219.922099 secs 2024-04-27T03:15:25.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:25 smithi189 ceph-mon[32756]: pgmap v17593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:25.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31522.888861 secs 2024-04-27T03:15:25.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:25 smithi156 ceph-mon[32679]: pgmap v17593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:25.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31522.888861 secs 2024-04-27T03:15:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:25 smithi092 ceph-mon[29156]: pgmap v17593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:25.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31522.888861 secs 2024-04-27T03:15:27.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:27 smithi189 ceph-mon[32756]: pgmap v17594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:27.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:27 smithi156 ceph-mon[32679]: pgmap v17594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:27.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:27 smithi092 ceph-mon[29156]: pgmap v17594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:29.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:29 smithi189 ceph-mon[32756]: pgmap v17595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:29.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32224.922210 secs 2024-04-27T03:15:29.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:29 smithi156 ceph-mon[32679]: pgmap v17595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:29.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32224.922210 secs 2024-04-27T03:15:29.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:29 smithi092 ceph-mon[29156]: pgmap v17595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:29.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32224.922210 secs 2024-04-27T03:15:30.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31527.888994 secs 2024-04-27T03:15:30.654 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31527.888994 secs 2024-04-27T03:15:30.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31527.888994 secs 2024-04-27T03:15:31.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:31 smithi189 ceph-mon[32756]: pgmap v17596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:31.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:31 smithi156 ceph-mon[32679]: pgmap v17596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:31.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:31 smithi092 ceph-mon[29156]: pgmap v17596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:33.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:33 smithi189 ceph-mon[32756]: pgmap v17597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:33.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:33 smithi156 ceph-mon[32679]: pgmap v17597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:33.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:33 smithi092 ceph-mon[29156]: pgmap v17597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:34.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32229.922357 secs 2024-04-27T03:15:34.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32229.922357 secs 2024-04-27T03:15:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32229.922357 secs 2024-04-27T03:15:35.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:35 smithi189 ceph-mon[32756]: pgmap v17598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:35.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31532.889101 secs 2024-04-27T03:15:35.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:35 smithi156 ceph-mon[32679]: pgmap v17598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:35.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31532.889101 secs 2024-04-27T03:15:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:35 smithi092 ceph-mon[29156]: pgmap v17598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:35.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31532.889101 secs 2024-04-27T03:15:37.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:37 smithi189 ceph-mon[32756]: pgmap v17599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:37.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:37 smithi156 ceph-mon[32679]: pgmap v17599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:37.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:37 smithi092 ceph-mon[29156]: pgmap v17599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:39.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:39 smithi189 ceph-mon[32756]: pgmap v17600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:39.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32234.922449 secs 2024-04-27T03:15:39.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:39 smithi156 ceph-mon[32679]: pgmap v17600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:39.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32234.922449 secs 2024-04-27T03:15:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:39 smithi092 ceph-mon[29156]: pgmap v17600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:39.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32234.922449 secs 2024-04-27T03:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:15:40.407+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:15:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:15:40.407+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:15:40.407+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:15:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:15:40.407+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 249 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:15:40.594 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31537.889190 secs 2024-04-27T03:15:40.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31537.889190 secs 2024-04-27T03:15:40.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31537.889190 secs 2024-04-27T03:15:41.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:41 smithi189 ceph-mon[32756]: pgmap v17601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:41.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:41 smithi156 ceph-mon[32679]: pgmap v17601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:41.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:41 smithi092 ceph-mon[29156]: pgmap v17601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:43.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:43 smithi189 ceph-mon[32756]: pgmap v17602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:43.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:43 smithi156 ceph-mon[32679]: pgmap v17602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:43.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:43 smithi092 ceph-mon[29156]: pgmap v17602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:44.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32239.922556 secs 2024-04-27T03:15:44.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32239.922556 secs 2024-04-27T03:15:44.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32239.922556 secs 2024-04-27T03:15:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:45 smithi189 ceph-mon[32756]: pgmap v17603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:45.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31542.889326 secs 2024-04-27T03:15:45.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:45 smithi156 ceph-mon[32679]: pgmap v17603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:45.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31542.889326 secs 2024-04-27T03:15:45.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:45 smithi092 ceph-mon[29156]: pgmap v17603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:15:45.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31542.889326 secs 2024-04-27T03:15:47.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:47 smithi189 ceph-mon[32756]: pgmap v17604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:47.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:47 smithi156 ceph-mon[32679]: pgmap v17604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:47.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:47 smithi092 ceph-mon[29156]: pgmap v17604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:48.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:15:48.678 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:15:48.695 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:15:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: pgmap v17605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:15:49.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:15:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: pgmap v17606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:15:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: pgmap v17607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:15:49.648 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32244.922679 secs 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: pgmap v17605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: pgmap v17606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: pgmap v17607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:15:49.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32244.922679 secs 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: pgmap v17605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: pgmap v17606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: pgmap v17607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:15:49.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32244.922679 secs 2024-04-27T03:15:50.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31547.889438 secs 2024-04-27T03:15:50.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31547.889438 secs 2024-04-27T03:15:50.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31547.889438 secs 2024-04-27T03:15:51.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:51 smithi189 ceph-mon[32756]: pgmap v17608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:51.693 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:51 smithi156 ceph-mon[32679]: pgmap v17608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:51.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:51 smithi092 ceph-mon[29156]: pgmap v17608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:53.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:53 smithi189 ceph-mon[32756]: pgmap v17609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:15:53.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:53 smithi156 ceph-mon[32679]: pgmap v17609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:15:54.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:53 smithi092 ceph-mon[29156]: pgmap v17609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:15:54.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32249.922801 secs 2024-04-27T03:15:54.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32249.922801 secs 2024-04-27T03:15:55.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32249.922801 secs 2024-04-27T03:15:55.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31552.889574 secs 2024-04-27T03:15:55.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:55 smithi189 ceph-mon[32756]: pgmap v17610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:55.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31552.889574 secs 2024-04-27T03:15:55.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:55 smithi156 ceph-mon[32679]: pgmap v17610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:56.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31552.889574 secs 2024-04-27T03:15:56.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:55 smithi092 ceph-mon[29156]: pgmap v17610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:57.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:57 smithi189 ceph-mon[32756]: pgmap v17611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:57.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:57 smithi156 ceph-mon[32679]: pgmap v17611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:58.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:57 smithi092 ceph-mon[29156]: pgmap v17611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:15:59.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:59 smithi189 ceph-mon[32756]: pgmap v17612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:15:59.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:15:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32254.922911 secs 2024-04-27T03:15:59.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:59 smithi156 ceph-mon[32679]: pgmap v17612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:15:59.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:15:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32254.922911 secs 2024-04-27T03:16:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:59 smithi092 ceph-mon[29156]: pgmap v17612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:16:00.003 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:15:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32254.922911 secs 2024-04-27T03:16:00.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31557.889681 secs 2024-04-27T03:16:00.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31557.889681 secs 2024-04-27T03:16:00.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31557.889681 secs 2024-04-27T03:16:01.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:01 smithi189 ceph-mon[32756]: pgmap v17613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:01.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:01 smithi156 ceph-mon[32679]: pgmap v17613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:02.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:01 smithi092 ceph-mon[29156]: pgmap v17613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:03.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:03 smithi189 ceph-mon[32756]: pgmap v17614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:03.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:03 smithi156 ceph-mon[32679]: pgmap v17614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:04.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:03 smithi092 ceph-mon[29156]: pgmap v17614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:04.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32259.923023 secs 2024-04-27T03:16:04.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32259.923023 secs 2024-04-27T03:16:05.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32259.923023 secs 2024-04-27T03:16:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31562.889816 secs 2024-04-27T03:16:05.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:05 smithi156 ceph-mon[32679]: pgmap v17615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:06.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31562.889816 secs 2024-04-27T03:16:06.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:05 smithi092 ceph-mon[29156]: pgmap v17615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:06.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31562.889816 secs 2024-04-27T03:16:06.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:05 smithi189 ceph-mon[32756]: pgmap v17615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:07.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:07 smithi156 ceph-mon[32679]: pgmap v17616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:08.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:07 smithi092 ceph-mon[29156]: pgmap v17616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:08.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:07 smithi189 ceph-mon[32756]: pgmap v17616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:09.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-mon[29156]: pgmap v17617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32264.923180 secs 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:16:09.474+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:16:09.474+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:16:09.474+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:16:09.474+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:16:09.753 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:16:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:16:09.474+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:16:09.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:09 smithi156 ceph-mon[32679]: pgmap v17617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:09.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32264.923180 secs 2024-04-27T03:16:09.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:09 smithi189 ceph-mon[32756]: pgmap v17617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:09.949 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32264.923180 secs 2024-04-27T03:16:10.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31567.889941 secs 2024-04-27T03:16:11.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31567.889941 secs 2024-04-27T03:16:11.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31567.889941 secs 2024-04-27T03:16:11.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:11 smithi156 ceph-mon[32679]: pgmap v17618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:12.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:11 smithi092 ceph-mon[29156]: pgmap v17618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:12.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:11 smithi189 ceph-mon[32756]: pgmap v17618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:12.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:12 smithi156 ceph-mon[32679]: pgmap v17619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:13.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:12 smithi092 ceph-mon[29156]: pgmap v17619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:13.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:12 smithi189 ceph-mon[32756]: pgmap v17619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:14.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32269.923297 secs 2024-04-27T03:16:14.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32269.923297 secs 2024-04-27T03:16:14.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32269.923297 secs 2024-04-27T03:16:15.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31572.890014 secs 2024-04-27T03:16:15.443 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:15 smithi156 ceph-mon[32679]: pgmap v17620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:15.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31572.890014 secs 2024-04-27T03:16:15.503 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:15 smithi092 ceph-mon[29156]: pgmap v17620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:15.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31572.890014 secs 2024-04-27T03:16:15.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:15 smithi189 ceph-mon[32756]: pgmap v17620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:17.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:17 smithi189 ceph-mon[32756]: pgmap v17621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:17.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:17 smithi156 ceph-mon[32679]: pgmap v17621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:18.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:17 smithi092 ceph-mon[29156]: pgmap v17621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:19.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:19 smithi189 ceph-mon[32756]: pgmap v17622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:19.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32274.923415 secs 2024-04-27T03:16:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:19 smithi156 ceph-mon[32679]: pgmap v17622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32274.923415 secs 2024-04-27T03:16:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:19 smithi092 ceph-mon[29156]: pgmap v17622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32274.923415 secs 2024-04-27T03:16:20.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31577.890144 secs 2024-04-27T03:16:20.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31577.890144 secs 2024-04-27T03:16:21.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31577.890144 secs 2024-04-27T03:16:21.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:21 smithi189 ceph-mon[32756]: pgmap v17623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:21.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:21 smithi156 ceph-mon[32679]: pgmap v17623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:22.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:21 smithi092 ceph-mon[29156]: pgmap v17623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:23.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:23 smithi189 ceph-mon[32756]: pgmap v17624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:23.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:23 smithi156 ceph-mon[32679]: pgmap v17624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:24.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:23 smithi092 ceph-mon[29156]: pgmap v17624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T03:16:24.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32279.923553 secs 2024-04-27T03:16:24.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32279.923553 secs 2024-04-27T03:16:25.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32279.923553 secs 2024-04-27T03:16:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31582.890267 secs 2024-04-27T03:16:25.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:25 smithi189 ceph-mon[32756]: pgmap v17625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:25.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31582.890267 secs 2024-04-27T03:16:25.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:25 smithi156 ceph-mon[32679]: pgmap v17625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:26.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31582.890267 secs 2024-04-27T03:16:26.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:25 smithi092 ceph-mon[29156]: pgmap v17625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T03:16:27.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:27 smithi156 ceph-mon[32679]: pgmap v17626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:28.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:27 smithi092 ceph-mon[29156]: pgmap v17626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:28.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:27 smithi189 ceph-mon[32756]: pgmap v17626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:29.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:29 smithi156 ceph-mon[32679]: pgmap v17627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:29.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32284.923649 secs 2024-04-27T03:16:30.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:29 smithi092 ceph-mon[29156]: pgmap v17627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:30.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32284.923649 secs 2024-04-27T03:16:30.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:29 smithi189 ceph-mon[32756]: pgmap v17627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:30.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32284.923649 secs 2024-04-27T03:16:30.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31587.890393 secs 2024-04-27T03:16:31.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31587.890393 secs 2024-04-27T03:16:31.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31587.890393 secs 2024-04-27T03:16:31.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:31 smithi156 ceph-mon[32679]: pgmap v17628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:32.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:31 smithi092 ceph-mon[29156]: pgmap v17628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:32.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:31 smithi189 ceph-mon[32756]: pgmap v17628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:33.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:32 smithi092 ceph-mon[29156]: pgmap v17629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:33.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:32 smithi189 ceph-mon[32756]: pgmap v17629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:33.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:32 smithi156 ceph-mon[32679]: pgmap v17629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:34.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32289.923781 secs 2024-04-27T03:16:34.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32289.923781 secs 2024-04-27T03:16:34.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32289.923781 secs 2024-04-27T03:16:35.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31592.890532 secs 2024-04-27T03:16:35.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:35 smithi156 ceph-mon[32679]: pgmap v17630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:35.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31592.890532 secs 2024-04-27T03:16:35.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:35 smithi092 ceph-mon[29156]: pgmap v17630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:35.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31592.890532 secs 2024-04-27T03:16:35.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:35 smithi189 ceph-mon[32756]: pgmap v17630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:37.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:37 smithi189 ceph-mon[32756]: pgmap v17631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:37.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:37 smithi156 ceph-mon[32679]: pgmap v17631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:38.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:37 smithi092 ceph-mon[29156]: pgmap v17631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:39.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:39 smithi189 ceph-mon[32756]: pgmap v17632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:39.897 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32294.923911 secs 2024-04-27T03:16:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:39 smithi156 ceph-mon[32679]: pgmap v17632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:39.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32294.923911 secs 2024-04-27T03:16:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:39 smithi092 ceph-mon[29156]: pgmap v17632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:40.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32294.923911 secs 2024-04-27T03:16:40.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31597.890603 secs 2024-04-27T03:16:40.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31597.890603 secs 2024-04-27T03:16:41.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31597.890603 secs 2024-04-27T03:16:41.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:41 smithi189 ceph-mon[32756]: pgmap v17633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:41.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:41 smithi156 ceph-mon[32679]: pgmap v17633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:42.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:41 smithi092 ceph-mon[29156]: pgmap v17633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:43.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:43 smithi189 ceph-mon[32756]: pgmap v17634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:43.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:43 smithi156 ceph-mon[32679]: pgmap v17634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:44.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:43 smithi092 ceph-mon[29156]: pgmap v17634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32299.924034 secs 2024-04-27T03:16:45.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32299.924034 secs 2024-04-27T03:16:45.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32299.924034 secs 2024-04-27T03:16:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31602.890723 secs 2024-04-27T03:16:45.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:45 smithi156 ceph-mon[32679]: pgmap v17635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31602.890723 secs 2024-04-27T03:16:46.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:45 smithi092 ceph-mon[29156]: pgmap v17635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:46.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31602.890723 secs 2024-04-27T03:16:46.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:45 smithi189 ceph-mon[32756]: pgmap v17635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:47.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:47 smithi156 ceph-mon[32679]: pgmap v17636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:48.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:47 smithi092 ceph-mon[29156]: pgmap v17636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:48.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:47 smithi189 ceph-mon[32756]: pgmap v17636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:16:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: pgmap v17637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:16:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32304.924146 secs 2024-04-27T03:16:49.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:16:49.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:16:49.943 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: pgmap v17637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32304.924146 secs 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:16:50.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:16:50.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: pgmap v17637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:16:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:16:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32304.924146 secs 2024-04-27T03:16:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:16:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:16:50.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:16:50.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31607.890812 secs 2024-04-27T03:16:50.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:50 smithi092 ceph-mon[29156]: pgmap v17638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:16:50.904 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:50 smithi092 ceph-mon[29156]: pgmap v17639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31607.890812 secs 2024-04-27T03:16:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:50 smithi156 ceph-mon[32679]: pgmap v17638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:16:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:50 smithi156 ceph-mon[32679]: pgmap v17639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:51.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31607.890812 secs 2024-04-27T03:16:51.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:50 smithi189 ceph-mon[32756]: pgmap v17638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:16:51.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:50 smithi189 ceph-mon[32756]: pgmap v17639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:52.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:51 smithi092 ceph-mon[29156]: pgmap v17640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:52.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:51 smithi189 ceph-mon[32756]: pgmap v17640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:52.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:51 smithi156 ceph-mon[32679]: pgmap v17640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:54.646 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:54 smithi189 ceph-mon[32756]: pgmap v17641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:54.647 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32309.924267 secs 2024-04-27T03:16:54.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:54 smithi156 ceph-mon[32679]: pgmap v17641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:54.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32309.924267 secs 2024-04-27T03:16:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:54 smithi092 ceph-mon[29156]: pgmap v17641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:54.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32309.924267 secs 2024-04-27T03:16:55.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31612.890878 secs 2024-04-27T03:16:55.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31612.890878 secs 2024-04-27T03:16:55.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31612.890878 secs 2024-04-27T03:16:56.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:56 smithi156 ceph-mon[32679]: pgmap v17642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:56.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:56 smithi092 ceph-mon[29156]: pgmap v17642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:56.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:56 smithi189 ceph-mon[32756]: pgmap v17642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:16:58.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:58 smithi156 ceph-mon[32679]: pgmap v17643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:58.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:58 smithi092 ceph-mon[29156]: pgmap v17643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:58.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:58 smithi189 ceph-mon[32756]: pgmap v17643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:16:59.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:16:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32314.924383 secs 2024-04-27T03:16:59.754 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:16:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32314.924383 secs 2024-04-27T03:16:59.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:16:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32314.924383 secs 2024-04-27T03:17:00.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31617.890986 secs 2024-04-27T03:17:00.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:00 smithi156 ceph-mon[32679]: pgmap v17644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:17:00.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31617.890986 secs 2024-04-27T03:17:00.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:00 smithi092 ceph-mon[29156]: pgmap v17644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:17:00.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31617.890986 secs 2024-04-27T03:17:00.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:00 smithi189 ceph-mon[32756]: pgmap v17644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:17:02.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:02 smithi156 ceph-mon[32679]: pgmap v17645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:02.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:02 smithi092 ceph-mon[29156]: pgmap v17645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:02.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:02 smithi189 ceph-mon[32756]: pgmap v17645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:04.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:04 smithi156 ceph-mon[32679]: pgmap v17646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:04.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32319.924501 secs 2024-04-27T03:17:04.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:04 smithi092 ceph-mon[29156]: pgmap v17646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:04.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32319.924501 secs 2024-04-27T03:17:04.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:04 smithi189 ceph-mon[32756]: pgmap v17646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:04.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32319.924501 secs 2024-04-27T03:17:05.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31622.891109 secs 2024-04-27T03:17:05.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31622.891109 secs 2024-04-27T03:17:05.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31622.891109 secs 2024-04-27T03:17:06.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:06 smithi156 ceph-mon[32679]: pgmap v17647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:06.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:06 smithi092 ceph-mon[29156]: pgmap v17647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:06.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:06 smithi189 ceph-mon[32756]: pgmap v17647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:08.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:08 smithi156 ceph-mon[32679]: pgmap v17648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:08.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:08 smithi092 ceph-mon[29156]: pgmap v17648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:08.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:08 smithi189 ceph-mon[32756]: pgmap v17648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:09.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32324.924614 secs 2024-04-27T03:17:09.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32324.924614 secs 2024-04-27T03:17:09.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32324.924614 secs 2024-04-27T03:17:10.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31627.891232 secs 2024-04-27T03:17:10.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:10 smithi156 ceph-mon[32679]: pgmap v17649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:10.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31627.891232 secs 2024-04-27T03:17:10.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:10 smithi092 ceph-mon[29156]: pgmap v17649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:10.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31627.891232 secs 2024-04-27T03:17:10.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:10 smithi189 ceph-mon[32756]: pgmap v17649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:12.692 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:12 smithi156 ceph-mon[32679]: pgmap v17650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:12.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:12 smithi092 ceph-mon[29156]: pgmap v17650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:12.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:12 smithi189 ceph-mon[32756]: pgmap v17650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:14 smithi092 ceph-mon[29156]: pgmap v17651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32329.924730 secs 2024-04-27T03:17:14.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:14 smithi092 ceph-mon[29156]: slow request 364.479235 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:17:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:14 smithi189 ceph-mon[32756]: pgmap v17651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32329.924730 secs 2024-04-27T03:17:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:14 smithi189 ceph-mon[32756]: slow request 364.479235 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:17:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:14 smithi156 ceph-mon[32679]: pgmap v17651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:17:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32329.924730 secs 2024-04-27T03:17:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:14 smithi156 ceph-mon[32679]: slow request 364.479235 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:17:15.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31632.891344 secs 2024-04-27T03:17:15.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31632.891344 secs 2024-04-27T03:17:15.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31632.891344 secs 2024-04-27T03:17:16.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:16 smithi092 ceph-mon[29156]: pgmap v17652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:16.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:16 smithi189 ceph-mon[32756]: pgmap v17652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:16.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:16 smithi156 ceph-mon[32679]: pgmap v17652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:17:18.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:18 smithi092 ceph-mon[29156]: pgmap v17653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:18.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:18 smithi189 ceph-mon[32756]: pgmap v17653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:18.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:18 smithi156 ceph-mon[32679]: pgmap v17653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:19.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32334.924871 secs 2024-04-27T03:17:19.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32334.924871 secs 2024-04-27T03:17:19.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32334.924871 secs 2024-04-27T03:17:20.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31637.891459 secs 2024-04-27T03:17:20.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:20 smithi092 ceph-mon[29156]: pgmap v17654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:20.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31637.891459 secs 2024-04-27T03:17:20.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:20 smithi189 ceph-mon[32756]: pgmap v17654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:20.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31637.891459 secs 2024-04-27T03:17:20.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:20 smithi156 ceph-mon[32679]: pgmap v17654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:22.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:22 smithi092 ceph-mon[29156]: pgmap v17655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:22.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:22 smithi189 ceph-mon[32756]: pgmap v17655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:22.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:22 smithi156 ceph-mon[32679]: pgmap v17655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:24.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:24 smithi092 ceph-mon[29156]: pgmap v17656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:24.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32339.924964 secs 2024-04-27T03:17:24.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:24 smithi189 ceph-mon[32756]: pgmap v17656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:24.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32339.924964 secs 2024-04-27T03:17:24.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:24 smithi156 ceph-mon[32679]: pgmap v17656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:24.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32339.924964 secs 2024-04-27T03:17:25.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31642.891521 secs 2024-04-27T03:17:25.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31642.891521 secs 2024-04-27T03:17:25.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31642.891521 secs 2024-04-27T03:17:26.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:26 smithi092 ceph-mon[29156]: pgmap v17657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:26.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:26 smithi189 ceph-mon[32756]: pgmap v17657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:26.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:26 smithi156 ceph-mon[32679]: pgmap v17657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:28.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:28 smithi092 ceph-mon[29156]: pgmap v17658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:28.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:28 smithi189 ceph-mon[32756]: pgmap v17658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:28.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:28 smithi156 ceph-mon[32679]: pgmap v17658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:29.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32344.925121 secs 2024-04-27T03:17:29.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32344.925121 secs 2024-04-27T03:17:29.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32344.925121 secs 2024-04-27T03:17:30.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31647.891600 secs 2024-04-27T03:17:30.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:30 smithi092 ceph-mon[29156]: pgmap v17659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:30.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31647.891600 secs 2024-04-27T03:17:30.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:30 smithi189 ceph-mon[32756]: pgmap v17659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:30.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31647.891600 secs 2024-04-27T03:17:30.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:30 smithi156 ceph-mon[32679]: pgmap v17659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:32.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:32 smithi092 ceph-mon[29156]: pgmap v17660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:32.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:32 smithi189 ceph-mon[32756]: pgmap v17660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:32.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:32 smithi156 ceph-mon[32679]: pgmap v17660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:34 smithi092 ceph-mon[29156]: pgmap v17661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:34.752 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32349.925236 secs 2024-04-27T03:17:34.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:34 smithi189 ceph-mon[32756]: pgmap v17661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:34.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32349.925236 secs 2024-04-27T03:17:34.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:34 smithi156 ceph-mon[32679]: pgmap v17661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:34.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32349.925236 secs 2024-04-27T03:17:35.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31652.891716 secs 2024-04-27T03:17:35.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31652.891716 secs 2024-04-27T03:17:35.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31652.891716 secs 2024-04-27T03:17:36.751 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:36 smithi092 ceph-mon[29156]: pgmap v17662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:36.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:36 smithi189 ceph-mon[32756]: pgmap v17662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:36.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:36 smithi156 ceph-mon[32679]: pgmap v17662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:38.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:38 smithi189 ceph-mon[32756]: pgmap v17663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:38.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:38 smithi156 ceph-mon[32679]: pgmap v17663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:39.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:38 smithi092 ceph-mon[29156]: pgmap v17663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:39.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32354.925353 secs 2024-04-27T03:17:39.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32354.925353 secs 2024-04-27T03:17:40.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32354.925353 secs 2024-04-27T03:17:40.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31657.891852 secs 2024-04-27T03:17:40.843 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:40 smithi156 ceph-mon[32679]: pgmap v17664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:40.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31657.891852 secs 2024-04-27T03:17:40.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:40 smithi189 ceph-mon[32756]: pgmap v17664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:41.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31657.891852 secs 2024-04-27T03:17:41.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:40 smithi092 ceph-mon[29156]: pgmap v17664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:42.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:42 smithi189 ceph-mon[32756]: pgmap v17665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:42.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:42 smithi156 ceph-mon[32679]: pgmap v17665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:43.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:42 smithi092 ceph-mon[29156]: pgmap v17665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:44.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:44 smithi189 ceph-mon[32756]: pgmap v17666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:44.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32359.925480 secs 2024-04-27T03:17:44.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:44 smithi156 ceph-mon[32679]: pgmap v17666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:44.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32359.925480 secs 2024-04-27T03:17:45.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:44 smithi092 ceph-mon[29156]: pgmap v17666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:45.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32359.925480 secs 2024-04-27T03:17:45.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31662.891990 secs 2024-04-27T03:17:45.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31662.891990 secs 2024-04-27T03:17:46.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31662.891990 secs 2024-04-27T03:17:46.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:46 smithi189 ceph-mon[32756]: pgmap v17667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:46.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:46 smithi156 ceph-mon[32679]: pgmap v17667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:47.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:46 smithi092 ceph-mon[29156]: pgmap v17667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:48.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:48 smithi189 ceph-mon[32756]: pgmap v17668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:48.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:48 smithi156 ceph-mon[32679]: pgmap v17668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:49.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:48 smithi092 ceph-mon[29156]: pgmap v17668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:17:49.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32364.925596 secs 2024-04-27T03:17:49.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:17:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32364.925596 secs 2024-04-27T03:17:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:17:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32364.925596 secs 2024-04-27T03:17:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:17:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31667.892135 secs 2024-04-27T03:17:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:50 smithi189 ceph-mon[32756]: pgmap v17669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:17:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:17:50.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:17:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31667.892135 secs 2024-04-27T03:17:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:50 smithi156 ceph-mon[32679]: pgmap v17669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:17:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:17:50.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:17:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31667.892135 secs 2024-04-27T03:17:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:50 smithi092 ceph-mon[29156]: pgmap v17669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:17:51.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:17:51.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:17:51.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:17:51.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:51 smithi189 ceph-mon[32756]: pgmap v17670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:17:51.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:51 smithi189 ceph-mon[32756]: pgmap v17671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:51.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:51 smithi156 ceph-mon[32679]: pgmap v17670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:17:51.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:51 smithi156 ceph-mon[32679]: pgmap v17671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:51 smithi092 ceph-mon[29156]: pgmap v17670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:17:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:51 smithi092 ceph-mon[29156]: pgmap v17671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:53.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:53 smithi189 ceph-mon[32756]: pgmap v17672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:53.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:53 smithi156 ceph-mon[32679]: pgmap v17672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:54.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:53 smithi092 ceph-mon[29156]: pgmap v17672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:54.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32369.925691 secs 2024-04-27T03:17:54.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32369.925691 secs 2024-04-27T03:17:55.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32369.925691 secs 2024-04-27T03:17:55.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31672.892273 secs 2024-04-27T03:17:55.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:55 smithi189 ceph-mon[32756]: pgmap v17673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:55.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31672.892273 secs 2024-04-27T03:17:55.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:55 smithi156 ceph-mon[32679]: pgmap v17673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:56.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31672.892273 secs 2024-04-27T03:17:56.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:55 smithi092 ceph-mon[29156]: pgmap v17673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:57.898 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:57 smithi189 ceph-mon[32756]: pgmap v17674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:57.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:57 smithi156 ceph-mon[32679]: pgmap v17674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:58.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:57 smithi092 ceph-mon[29156]: pgmap v17674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:17:59.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:59 smithi189 ceph-mon[32756]: pgmap v17675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:17:59.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:17:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32374.925820 secs 2024-04-27T03:17:59.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:59 smithi156 ceph-mon[32679]: pgmap v17675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:17:59.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:17:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32374.925820 secs 2024-04-27T03:18:00.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:59 smithi092 ceph-mon[29156]: pgmap v17675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:18:00.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:17:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32374.925820 secs 2024-04-27T03:18:00.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31677.892396 secs 2024-04-27T03:18:00.903 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31677.892396 secs 2024-04-27T03:18:00.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31677.892396 secs 2024-04-27T03:18:01.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:01 smithi189 ceph-mon[32756]: pgmap v17676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:18:01.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:01 smithi156 ceph-mon[32679]: pgmap v17676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:18:02.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:01 smithi092 ceph-mon[29156]: pgmap v17676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:18:03.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:03 smithi189 ceph-mon[32756]: pgmap v17677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:03.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:03 smithi156 ceph-mon[32679]: pgmap v17677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:04.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:03 smithi092 ceph-mon[29156]: pgmap v17677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:04.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32379.925925 secs 2024-04-27T03:18:04.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32379.925925 secs 2024-04-27T03:18:05.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32379.925925 secs 2024-04-27T03:18:05.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31682.892473 secs 2024-04-27T03:18:05.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:05 smithi189 ceph-mon[32756]: pgmap v17678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31682.892473 secs 2024-04-27T03:18:05.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:05 smithi156 ceph-mon[32679]: pgmap v17678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:06.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31682.892473 secs 2024-04-27T03:18:06.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:05 smithi092 ceph-mon[29156]: pgmap v17678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:07.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:07 smithi189 ceph-mon[32756]: pgmap v17679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:07.941 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:07 smithi092 ceph-mon[29156]: pgmap v17679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:07.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:07 smithi156 ceph-mon[32679]: pgmap v17679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:09 smithi189 ceph-mon[32756]: pgmap v17680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32384.926034 secs 2024-04-27T03:18:09.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:09 smithi189 ceph-mon[32756]: slow request 2880.153232 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:09.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:09 smithi156 ceph-mon[32679]: pgmap v17680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:09.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32384.926034 secs 2024-04-27T03:18:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:09 smithi156 ceph-mon[32679]: slow request 2880.153232 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:10.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:09 smithi092 ceph-mon[29156]: pgmap v17680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:10.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32384.926034 secs 2024-04-27T03:18:10.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:09 smithi092 ceph-mon[29156]: slow request 2880.153232 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:10.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31687.892581 secs 2024-04-27T03:18:10.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31687.892581 secs 2024-04-27T03:18:11.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31687.892581 secs 2024-04-27T03:18:11.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:11 smithi189 ceph-mon[32756]: pgmap v17681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:11.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:11 smithi156 ceph-mon[32679]: pgmap v17681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:12.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:11 smithi092 ceph-mon[29156]: pgmap v17681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:13.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:13 smithi189 ceph-mon[32756]: pgmap v17682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:13.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:13 smithi156 ceph-mon[32679]: pgmap v17682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:14.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:13 smithi092 ceph-mon[29156]: pgmap v17682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32389.926159 secs 2024-04-27T03:18:14.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:14 smithi189 ceph-mon[32756]: slow request 724.548843 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:14.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32389.926159 secs 2024-04-27T03:18:14.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:14 smithi156 ceph-mon[32679]: slow request 724.548843 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:15.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32389.926159 secs 2024-04-27T03:18:15.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:14 smithi092 ceph-mon[29156]: slow request 724.548843 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:18:15.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31692.892695 secs 2024-04-27T03:18:15.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:15 smithi189 ceph-mon[32756]: pgmap v17683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:15.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31692.892695 secs 2024-04-27T03:18:15.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:15 smithi156 ceph-mon[32679]: pgmap v17683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:16.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31692.892695 secs 2024-04-27T03:18:16.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:15 smithi092 ceph-mon[29156]: pgmap v17683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:17.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:17 smithi189 ceph-mon[32756]: pgmap v17684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:17.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:17 smithi156 ceph-mon[32679]: pgmap v17684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:18.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:17 smithi092 ceph-mon[29156]: pgmap v17684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:19.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:19 smithi189 ceph-mon[32756]: pgmap v17685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:19.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32394.926276 secs 2024-04-27T03:18:19.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:19 smithi156 ceph-mon[32679]: pgmap v17685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:19.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32394.926276 secs 2024-04-27T03:18:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:19 smithi092 ceph-mon[29156]: pgmap v17685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:20.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32394.926276 secs 2024-04-27T03:18:20.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31697.892813 secs 2024-04-27T03:18:20.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31697.892813 secs 2024-04-27T03:18:21.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31697.892813 secs 2024-04-27T03:18:21.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:21 smithi189 ceph-mon[32756]: pgmap v17686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:21.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:21 smithi156 ceph-mon[32679]: pgmap v17686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:22.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:21 smithi092 ceph-mon[29156]: pgmap v17686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:23.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:23 smithi189 ceph-mon[32756]: pgmap v17687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:23.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:23 smithi156 ceph-mon[32679]: pgmap v17687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:24.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:23 smithi092 ceph-mon[29156]: pgmap v17687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:24.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32399.926365 secs 2024-04-27T03:18:24.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32399.926365 secs 2024-04-27T03:18:25.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32399.926365 secs 2024-04-27T03:18:25.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31702.892948 secs 2024-04-27T03:18:25.896 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:25 smithi189 ceph-mon[32756]: pgmap v17688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:25.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31702.892948 secs 2024-04-27T03:18:25.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:25 smithi156 ceph-mon[32679]: pgmap v17688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:26.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31702.892948 secs 2024-04-27T03:18:26.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:25 smithi092 ceph-mon[29156]: pgmap v17688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:27.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:27 smithi189 ceph-mon[32756]: pgmap v17689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:27.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:27 smithi156 ceph-mon[32679]: pgmap v17689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:28.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:27 smithi092 ceph-mon[29156]: pgmap v17689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:29 smithi189 ceph-mon[32756]: pgmap v17690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32404.926516 secs 2024-04-27T03:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:29 smithi156 ceph-mon[32679]: pgmap v17690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32404.926516 secs 2024-04-27T03:18:30.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:29 smithi092 ceph-mon[29156]: pgmap v17690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:30.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32404.926516 secs 2024-04-27T03:18:30.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31707.893036 secs 2024-04-27T03:18:30.902 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31707.893036 secs 2024-04-27T03:18:30.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31707.893036 secs 2024-04-27T03:18:31.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:31 smithi189 ceph-mon[32756]: pgmap v17691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:31.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:31 smithi156 ceph-mon[32679]: pgmap v17691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:32.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:31 smithi092 ceph-mon[29156]: pgmap v17691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:33.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:33 smithi189 ceph-mon[32756]: pgmap v17692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:33.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:33 smithi156 ceph-mon[32679]: pgmap v17692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:34.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:33 smithi092 ceph-mon[29156]: pgmap v17692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:34.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32409.926633 secs 2024-04-27T03:18:35.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32409.926633 secs 2024-04-27T03:18:35.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32409.926633 secs 2024-04-27T03:18:35.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31712.893148 secs 2024-04-27T03:18:35.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:35 smithi156 ceph-mon[32679]: pgmap v17693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31712.893148 secs 2024-04-27T03:18:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:35 smithi092 ceph-mon[29156]: pgmap v17693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000052) for more than 900000000 us, fault. 2024-04-27T03:18:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1ca802ab30 tx=0x7f1ca8095000 comp rx=0 tx=0).stop 2024-04-27T03:18:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T03:18:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T03:18:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T03:18:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:18:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.043+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca80c2000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T03:18:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.085+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T03:18:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.085+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T03:18:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T03:18:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=34 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T03:18:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.085+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:18:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.086+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T03:18:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:36.086+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T03:18:36.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31712.893148 secs 2024-04-27T03:18:36.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:35 smithi189 ceph-mon[32756]: pgmap v17693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:37.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:37 smithi156 ceph-mon[32679]: pgmap v17694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:38.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:37 smithi092 ceph-mon[29156]: pgmap v17694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:38.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:37 smithi189 ceph-mon[32756]: pgmap v17694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:39.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:39 smithi156 ceph-mon[32679]: pgmap v17695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:39.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32414.926748 secs 2024-04-27T03:18:39.947 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:39 smithi189 ceph-mon[32756]: pgmap v17695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:39.948 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32414.926748 secs 2024-04-27T03:18:40.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:39 smithi092 ceph-mon[29156]: pgmap v17695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:40.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32414.926748 secs 2024-04-27T03:18:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:40.432+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:18:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:40.432+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:18:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:40.432+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:18:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:18:40.432+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 250 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:18:40.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31717.893255 secs 2024-04-27T03:18:41.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31717.893255 secs 2024-04-27T03:18:41.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31717.893255 secs 2024-04-27T03:18:41.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:41 smithi156 ceph-mon[32679]: pgmap v17696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:42.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:41 smithi092 ceph-mon[29156]: pgmap v17696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:42.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:41 smithi189 ceph-mon[32756]: pgmap v17696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:43.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:43 smithi156 ceph-mon[32679]: pgmap v17697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:44.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:43 smithi092 ceph-mon[29156]: pgmap v17697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:44.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:43 smithi189 ceph-mon[32756]: pgmap v17697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:44.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32419.926892 secs 2024-04-27T03:18:45.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32419.926892 secs 2024-04-27T03:18:45.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32419.926892 secs 2024-04-27T03:18:45.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31722.893307 secs 2024-04-27T03:18:45.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:45 smithi156 ceph-mon[32679]: pgmap v17698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:46.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31722.893307 secs 2024-04-27T03:18:46.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:45 smithi092 ceph-mon[29156]: pgmap v17698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:46.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31722.893307 secs 2024-04-27T03:18:46.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:45 smithi189 ceph-mon[32756]: pgmap v17698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:47.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:47 smithi156 ceph-mon[32679]: pgmap v17699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:48.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:47 smithi092 ceph-mon[29156]: pgmap v17699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:48.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:47 smithi189 ceph-mon[32756]: pgmap v17699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:49 smithi156 ceph-mon[32679]: pgmap v17700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32424.927014 secs 2024-04-27T03:18:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:49 smithi092 ceph-mon[29156]: pgmap v17700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:50.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32424.927014 secs 2024-04-27T03:18:50.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:49 smithi189 ceph-mon[32756]: pgmap v17700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:18:50.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32424.927014 secs 2024-04-27T03:18:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31727.893423 secs 2024-04-27T03:18:50.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:18:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31727.893423 secs 2024-04-27T03:18:51.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:18:51.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31727.893423 secs 2024-04-27T03:18:51.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: pgmap v17701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: pgmap v17702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: pgmap v17703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:51.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: pgmap v17701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: pgmap v17702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: pgmap v17703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:52.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:18:52.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: pgmap v17701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:18:52.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:18:52.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:18:52.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: pgmap v17702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:18:52.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: pgmap v17703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:52.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:18:54.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:53 smithi092 ceph-mon[29156]: pgmap v17704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:18:54.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:53 smithi189 ceph-mon[32756]: pgmap v17704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:18:54.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:53 smithi156 ceph-mon[32679]: pgmap v17704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:18:55.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32429.927128 secs 2024-04-27T03:18:55.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32429.927128 secs 2024-04-27T03:18:55.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32429.927128 secs 2024-04-27T03:18:56.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31732.893566 secs 2024-04-27T03:18:56.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:55 smithi092 ceph-mon[29156]: pgmap v17705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:56.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31732.893566 secs 2024-04-27T03:18:56.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:55 smithi189 ceph-mon[32756]: pgmap v17705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:56.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31732.893566 secs 2024-04-27T03:18:56.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:55 smithi156 ceph-mon[32679]: pgmap v17705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:58.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:57 smithi092 ceph-mon[29156]: pgmap v17706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:58.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:57 smithi189 ceph-mon[32756]: pgmap v17706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:18:58.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:57 smithi156 ceph-mon[32679]: pgmap v17706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:00.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32434.927249 secs 2024-04-27T03:19:00.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:18:59 smithi092 ceph-mon[29156]: pgmap v17707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:00.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32434.927249 secs 2024-04-27T03:19:00.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:18:59 smithi189 ceph-mon[32756]: pgmap v17707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:00.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32434.927249 secs 2024-04-27T03:19:00.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:18:59 smithi156 ceph-mon[32679]: pgmap v17707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:01.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31737.893681 secs 2024-04-27T03:19:01.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31737.893681 secs 2024-04-27T03:19:01.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31737.893681 secs 2024-04-27T03:19:02.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:01 smithi092 ceph-mon[29156]: pgmap v17708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:19:02.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:01 smithi189 ceph-mon[32756]: pgmap v17708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:19:02.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:01 smithi156 ceph-mon[32679]: pgmap v17708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:19:04.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:03 smithi092 ceph-mon[29156]: pgmap v17709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:04.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:03 smithi189 ceph-mon[32756]: pgmap v17709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:04.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:03 smithi156 ceph-mon[32679]: pgmap v17709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:05.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32439.927365 secs 2024-04-27T03:19:05.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32439.927365 secs 2024-04-27T03:19:05.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32439.927365 secs 2024-04-27T03:19:06.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31742.893746 secs 2024-04-27T03:19:06.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:05 smithi092 ceph-mon[29156]: pgmap v17710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:06.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31742.893746 secs 2024-04-27T03:19:06.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:05 smithi189 ceph-mon[32756]: pgmap v17710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:06.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31742.893746 secs 2024-04-27T03:19:06.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:05 smithi156 ceph-mon[32679]: pgmap v17710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:08.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:07 smithi092 ceph-mon[29156]: pgmap v17711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:08.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:07 smithi189 ceph-mon[32756]: pgmap v17711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:08.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:07 smithi156 ceph-mon[32679]: pgmap v17711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:10.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32444.927483 secs 2024-04-27T03:19:10.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:09 smithi156 ceph-mon[32679]: pgmap v17712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:10.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32444.927483 secs 2024-04-27T03:19:10.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:09 smithi092 ceph-mon[29156]: pgmap v17712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:10.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32444.927483 secs 2024-04-27T03:19:10.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:09 smithi189 ceph-mon[32756]: pgmap v17712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:11.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:10 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 31747.893864 secs 2024-04-27T03:19:11.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:10 smithi092 ceph-mon[29156]: slow request 5761.107275 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:11.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:10 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 31747.893864 secs 2024-04-27T03:19:11.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:10 smithi189 ceph-mon[32756]: slow request 5761.107275 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:11.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:10 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 31747.893864 secs 2024-04-27T03:19:11.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:10 smithi156 ceph-mon[32679]: slow request 5761.107275 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:12.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:11 smithi092 ceph-mon[29156]: pgmap v17713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:12.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:11 smithi189 ceph-mon[32756]: pgmap v17713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:12.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:11 smithi156 ceph-mon[32679]: pgmap v17713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:14.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:13 smithi189 ceph-mon[32756]: pgmap v17714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:14.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:13 smithi156 ceph-mon[32679]: pgmap v17714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:14.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:13 smithi092 ceph-mon[29156]: pgmap v17714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:15.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32449.927596 secs 2024-04-27T03:19:15.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32449.927596 secs 2024-04-27T03:19:15.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32449.927596 secs 2024-04-27T03:19:16.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:16 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31752.894001 secs 2024-04-27T03:19:16.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:16 smithi189 ceph-mon[32756]: pgmap v17715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:16.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:16 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31752.894001 secs 2024-04-27T03:19:16.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:16 smithi156 ceph-mon[32679]: pgmap v17715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:16.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:16 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31752.894001 secs 2024-04-27T03:19:16.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:16 smithi092 ceph-mon[29156]: pgmap v17715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:18.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:18 smithi189 ceph-mon[32756]: pgmap v17716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:18.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:18 smithi156 ceph-mon[32679]: pgmap v17716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:18.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:18 smithi092 ceph-mon[29156]: pgmap v17716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:20.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32454.927716 secs 2024-04-27T03:19:20.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:20 smithi189 ceph-mon[32756]: pgmap v17717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:20.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32454.927716 secs 2024-04-27T03:19:20.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:20 smithi156 ceph-mon[32679]: pgmap v17717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:20.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32454.927716 secs 2024-04-27T03:19:20.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:20 smithi092 ceph-mon[29156]: pgmap v17717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:21.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:21 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31757.894171 secs 2024-04-27T03:19:21.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:21 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31757.894171 secs 2024-04-27T03:19:21.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:21 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31757.894171 secs 2024-04-27T03:19:22.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:22 smithi189 ceph-mon[32756]: pgmap v17718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:22.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:22 smithi156 ceph-mon[32679]: pgmap v17718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:22.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:22 smithi092 ceph-mon[29156]: pgmap v17718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:24.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:24 smithi189 ceph-mon[32756]: pgmap v17719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:24.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:24 smithi156 ceph-mon[32679]: pgmap v17719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:24.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:24 smithi092 ceph-mon[29156]: pgmap v17719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:25.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32459.927808 secs 2024-04-27T03:19:25.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32459.927808 secs 2024-04-27T03:19:25.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32459.927808 secs 2024-04-27T03:19:26.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:26 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31762.894252 secs 2024-04-27T03:19:26.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:26 smithi189 ceph-mon[32756]: pgmap v17720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:26 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31762.894252 secs 2024-04-27T03:19:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:26 smithi156 ceph-mon[32679]: pgmap v17720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:26 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31762.894252 secs 2024-04-27T03:19:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:26 smithi092 ceph-mon[29156]: pgmap v17720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:28.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:28 smithi189 ceph-mon[32756]: pgmap v17721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:28.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:28 smithi156 ceph-mon[32679]: pgmap v17721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:28.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:28 smithi092 ceph-mon[29156]: pgmap v17721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:30.303 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32464.927906 secs 2024-04-27T03:19:30.303 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:30 smithi092 ceph-mon[29156]: pgmap v17722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:30.303 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31767.894315 secs 2024-04-27T03:19:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32464.927906 secs 2024-04-27T03:19:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:30 smithi189 ceph-mon[32756]: pgmap v17722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:30.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31767.894315 secs 2024-04-27T03:19:30.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32464.927906 secs 2024-04-27T03:19:30.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:30 smithi156 ceph-mon[32679]: pgmap v17722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:30.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31767.894315 secs 2024-04-27T03:19:32.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:32 smithi189 ceph-mon[32756]: pgmap v17723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:32.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:32 smithi156 ceph-mon[32679]: pgmap v17723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:32.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:32 smithi092 ceph-mon[29156]: pgmap v17723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:34.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:34 smithi189 ceph-mon[32756]: pgmap v17724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:34.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:34 smithi156 ceph-mon[32679]: pgmap v17724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:34.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:34 smithi092 ceph-mon[29156]: pgmap v17724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32469.928022 secs 2024-04-27T03:19:35.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31772.894432 secs 2024-04-27T03:19:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32469.928022 secs 2024-04-27T03:19:35.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31772.894432 secs 2024-04-27T03:19:35.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32469.928022 secs 2024-04-27T03:19:35.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31772.894432 secs 2024-04-27T03:19:36.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:36 smithi189 ceph-mon[32756]: pgmap v17725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:36.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:36 smithi156 ceph-mon[32679]: pgmap v17725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:36.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:36 smithi092 ceph-mon[29156]: pgmap v17725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:38.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:38 smithi189 ceph-mon[32756]: pgmap v17726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:38.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:38 smithi156 ceph-mon[32679]: pgmap v17726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:38.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:38 smithi092 ceph-mon[29156]: pgmap v17726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:40.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32474.928143 secs 2024-04-27T03:19:40.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:40 smithi189 ceph-mon[32756]: pgmap v17727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:40.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31777.894544 secs 2024-04-27T03:19:40.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32474.928143 secs 2024-04-27T03:19:40.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:40 smithi156 ceph-mon[32679]: pgmap v17727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:40.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31777.894544 secs 2024-04-27T03:19:40.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32474.928143 secs 2024-04-27T03:19:40.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:40 smithi092 ceph-mon[29156]: pgmap v17727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:40.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31777.894544 secs 2024-04-27T03:19:42.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:42 smithi189 ceph-mon[32756]: pgmap v17728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:42.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:42 smithi156 ceph-mon[32679]: pgmap v17728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:42.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:42 smithi092 ceph-mon[29156]: pgmap v17728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:44.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:44 smithi189 ceph-mon[32756]: pgmap v17729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:44.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:44 smithi156 ceph-mon[32679]: pgmap v17729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:44.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:44 smithi092 ceph-mon[29156]: pgmap v17729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:45.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32479.928261 secs 2024-04-27T03:19:45.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:45 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 31782.894669 secs 2024-04-27T03:19:45.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:45 smithi189 ceph-mon[32756]: slow request 1444.901208 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32479.928261 secs 2024-04-27T03:19:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:45 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 31782.894669 secs 2024-04-27T03:19:45.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:45 smithi156 ceph-mon[32679]: slow request 1444.901208 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:45.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32479.928261 secs 2024-04-27T03:19:45.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:45 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 31782.894669 secs 2024-04-27T03:19:45.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:45 smithi092 ceph-mon[29156]: slow request 1444.901208 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:19:46.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:46 smithi189 ceph-mon[32756]: pgmap v17730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:46.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:46 smithi156 ceph-mon[32679]: pgmap v17730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:46.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:46 smithi092 ceph-mon[29156]: pgmap v17730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:48.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:48 smithi189 ceph-mon[32756]: pgmap v17731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:48.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:48 smithi156 ceph-mon[32679]: pgmap v17731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:48.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:48 smithi092 ceph-mon[29156]: pgmap v17731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:50.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32484.928383 secs 2024-04-27T03:19:50.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:50 smithi189 ceph-mon[32756]: pgmap v17732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:50.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31787.894789 secs 2024-04-27T03:19:50.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32484.928383 secs 2024-04-27T03:19:50.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:50 smithi156 ceph-mon[32679]: pgmap v17732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:50.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31787.894789 secs 2024-04-27T03:19:50.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32484.928383 secs 2024-04-27T03:19:50.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:50 smithi092 ceph-mon[29156]: pgmap v17732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:19:50.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31787.894789 secs 2024-04-27T03:19:51.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:19:51.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:19:51.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: pgmap v17733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: pgmap v17734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: pgmap v17735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:52.395 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: pgmap v17733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: pgmap v17734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: pgmap v17735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:52.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:19:52.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: pgmap v17733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:19:52.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:19:52.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:19:52.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: pgmap v17734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:19:52.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: pgmap v17735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:52.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:19:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:53 smithi092 ceph-mon[29156]: pgmap v17736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:54.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:53 smithi189 ceph-mon[32756]: pgmap v17736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:54.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:53 smithi156 ceph-mon[32679]: pgmap v17736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:55.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32489.928504 secs 2024-04-27T03:19:55.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32489.928504 secs 2024-04-27T03:19:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32489.928504 secs 2024-04-27T03:19:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31792.894900 secs 2024-04-27T03:19:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:55 smithi092 ceph-mon[29156]: pgmap v17737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:56.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31792.894900 secs 2024-04-27T03:19:56.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:55 smithi189 ceph-mon[32756]: pgmap v17737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:56.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31792.894900 secs 2024-04-27T03:19:56.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:55 smithi156 ceph-mon[32679]: pgmap v17737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:19:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:57 smithi092 ceph-mon[29156]: pgmap v17738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:19:58.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:57 smithi189 ceph-mon[32756]: pgmap v17738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:19:58.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:57 smithi156 ceph-mon[32679]: pgmap v17738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:19:59.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:19:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32494.928641 secs 2024-04-27T03:19:59.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:19:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32494.928641 secs 2024-04-27T03:19:59.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:19:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32494.928641 secs 2024-04-27T03:20:00.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31797.895019 secs 2024-04-27T03:20:00.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:00 smithi092 ceph-mon[29156]: pgmap v17739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:00.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:20:00.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31797.895019 secs 2024-04-27T03:20:00.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:00 smithi189 ceph-mon[32756]: pgmap v17739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:00.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:20:00.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31797.895019 secs 2024-04-27T03:20:00.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:00 smithi156 ceph-mon[32679]: pgmap v17739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:00.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:20:02.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:01 smithi092 ceph-mon[29156]: pgmap v17740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:20:02.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:01 smithi189 ceph-mon[32756]: pgmap v17740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:20:02.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:01 smithi156 ceph-mon[32679]: pgmap v17740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:20:04.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:03 smithi092 ceph-mon[29156]: pgmap v17741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:04.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:03 smithi189 ceph-mon[32756]: pgmap v17741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:04.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:03 smithi156 ceph-mon[32679]: pgmap v17741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32499.928780 secs 2024-04-27T03:20:05.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32499.928780 secs 2024-04-27T03:20:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32499.928780 secs 2024-04-27T03:20:06.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31802.895101 secs 2024-04-27T03:20:06.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:05 smithi189 ceph-mon[32756]: pgmap v17742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:06.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31802.895101 secs 2024-04-27T03:20:06.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:05 smithi156 ceph-mon[32679]: pgmap v17742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31802.895101 secs 2024-04-27T03:20:06.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:05 smithi092 ceph-mon[29156]: pgmap v17742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:08.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:07 smithi092 ceph-mon[29156]: pgmap v17743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:08.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:07 smithi189 ceph-mon[32756]: pgmap v17743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:08.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:07 smithi156 ceph-mon[32679]: pgmap v17743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:09.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32504.928918 secs 2024-04-27T03:20:09.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32504.928918 secs 2024-04-27T03:20:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32504.928918 secs 2024-04-27T03:20:10.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31807.895221 secs 2024-04-27T03:20:10.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:10 smithi092 ceph-mon[29156]: pgmap v17744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:10.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31807.895221 secs 2024-04-27T03:20:10.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:10 smithi189 ceph-mon[32756]: pgmap v17744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:10.592 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31807.895221 secs 2024-04-27T03:20:10.592 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:10 smithi156 ceph-mon[32679]: pgmap v17744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:12.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:11 smithi092 ceph-mon[29156]: pgmap v17745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:12.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:11 smithi189 ceph-mon[32756]: pgmap v17745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:12.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:11 smithi156 ceph-mon[32679]: pgmap v17745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:14.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:13 smithi092 ceph-mon[29156]: pgmap v17746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:14.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:13 smithi189 ceph-mon[32756]: pgmap v17746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:14.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:13 smithi156 ceph-mon[32679]: pgmap v17746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32509.928979 secs 2024-04-27T03:20:15.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32509.928979 secs 2024-04-27T03:20:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32509.928979 secs 2024-04-27T03:20:16.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31812.895372 secs 2024-04-27T03:20:16.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:15 smithi189 ceph-mon[32756]: pgmap v17747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:16.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31812.895372 secs 2024-04-27T03:20:16.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:15 smithi156 ceph-mon[32679]: pgmap v17747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31812.895372 secs 2024-04-27T03:20:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:15 smithi092 ceph-mon[29156]: pgmap v17747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:18.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:17 smithi189 ceph-mon[32756]: pgmap v17748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:18.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:17 smithi156 ceph-mon[32679]: pgmap v17748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:18.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:17 smithi092 ceph-mon[29156]: pgmap v17748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:19.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32514.929084 secs 2024-04-27T03:20:19.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32514.929084 secs 2024-04-27T03:20:19.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32514.929084 secs 2024-04-27T03:20:20.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31817.895487 secs 2024-04-27T03:20:20.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:20 smithi092 ceph-mon[29156]: pgmap v17749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:20.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31817.895487 secs 2024-04-27T03:20:20.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:20 smithi189 ceph-mon[32756]: pgmap v17749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:20.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31817.895487 secs 2024-04-27T03:20:20.691 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:20 smithi156 ceph-mon[32679]: pgmap v17749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:22.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:21 smithi092 ceph-mon[29156]: pgmap v17750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:21 smithi189 ceph-mon[32756]: pgmap v17750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:22.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:21 smithi156 ceph-mon[32679]: pgmap v17750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:24.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:23 smithi092 ceph-mon[29156]: pgmap v17751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:24.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:23 smithi189 ceph-mon[32756]: pgmap v17751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:24.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:23 smithi156 ceph-mon[32679]: pgmap v17751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32519.929204 secs 2024-04-27T03:20:25.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32519.929204 secs 2024-04-27T03:20:25.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32519.929204 secs 2024-04-27T03:20:26.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31822.895606 secs 2024-04-27T03:20:26.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:25 smithi189 ceph-mon[32756]: pgmap v17752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:26.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31822.895606 secs 2024-04-27T03:20:26.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:25 smithi156 ceph-mon[32679]: pgmap v17752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:26.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31822.895606 secs 2024-04-27T03:20:26.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:25 smithi092 ceph-mon[29156]: pgmap v17752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:27 smithi092 ceph-mon[29156]: pgmap v17753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:28.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:27 smithi189 ceph-mon[32756]: pgmap v17753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:27 smithi156 ceph-mon[32679]: pgmap v17753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:29.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32524.929325 secs 2024-04-27T03:20:29.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32524.929325 secs 2024-04-27T03:20:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32524.929325 secs 2024-04-27T03:20:30.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31827.895714 secs 2024-04-27T03:20:30.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:30 smithi092 ceph-mon[29156]: pgmap v17754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:30.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31827.895714 secs 2024-04-27T03:20:30.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:30 smithi189 ceph-mon[32756]: pgmap v17754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:30.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31827.895714 secs 2024-04-27T03:20:30.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:30 smithi156 ceph-mon[32679]: pgmap v17754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:31 smithi092 ceph-mon[29156]: pgmap v17755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:32.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:31 smithi189 ceph-mon[32756]: pgmap v17755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:32.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:31 smithi156 ceph-mon[32679]: pgmap v17755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:34.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:33 smithi092 ceph-mon[29156]: pgmap v17756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:34.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:33 smithi189 ceph-mon[32756]: pgmap v17756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:34.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:33 smithi156 ceph-mon[32679]: pgmap v17756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32529.929443 secs 2024-04-27T03:20:35.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32529.929443 secs 2024-04-27T03:20:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32529.929443 secs 2024-04-27T03:20:36.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:35 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31832.895848 secs 2024-04-27T03:20:36.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:35 smithi189 ceph-mon[32756]: pgmap v17757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:36.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:35 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31832.895848 secs 2024-04-27T03:20:36.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:35 smithi156 ceph-mon[32679]: pgmap v17757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:36.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:35 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31832.895848 secs 2024-04-27T03:20:36.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:35 smithi092 ceph-mon[29156]: pgmap v17757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:38.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:37 smithi092 ceph-mon[29156]: pgmap v17758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:38.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:37 smithi189 ceph-mon[32756]: pgmap v17758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:38.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:37 smithi156 ceph-mon[32679]: pgmap v17758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:39.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32534.929528 secs 2024-04-27T03:20:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32534.929528 secs 2024-04-27T03:20:39.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32534.929528 secs 2024-04-27T03:20:40.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:40 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31837.895984 secs 2024-04-27T03:20:40.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:40 smithi092 ceph-mon[29156]: pgmap v17759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:40.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:40 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31837.895984 secs 2024-04-27T03:20:40.546 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:40 smithi189 ceph-mon[32756]: pgmap v17759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:40.592 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:40 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31837.895984 secs 2024-04-27T03:20:40.592 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:40 smithi156 ceph-mon[32679]: pgmap v17759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:41.869 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:41 smithi156 ceph-mon[32679]: pgmap v17760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:42.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:41 smithi189 ceph-mon[32756]: pgmap v17760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:42.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:41 smithi092 ceph-mon[29156]: pgmap v17760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:44.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:43 smithi189 ceph-mon[32756]: pgmap v17761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:44.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:43 smithi156 ceph-mon[32679]: pgmap v17761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:44.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:43 smithi092 ceph-mon[29156]: pgmap v17761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:45.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32539.929654 secs 2024-04-27T03:20:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32539.929654 secs 2024-04-27T03:20:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32539.929654 secs 2024-04-27T03:20:46.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:45 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31842.896130 secs 2024-04-27T03:20:46.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:45 smithi189 ceph-mon[32756]: pgmap v17762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:46.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:45 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31842.896130 secs 2024-04-27T03:20:46.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:45 smithi156 ceph-mon[32679]: pgmap v17762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:45 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31842.896130 secs 2024-04-27T03:20:46.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:45 smithi092 ceph-mon[29156]: pgmap v17762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:48.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:47 smithi189 ceph-mon[32756]: pgmap v17763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:48.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:47 smithi156 ceph-mon[32679]: pgmap v17763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:48.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:47 smithi092 ceph-mon[29156]: pgmap v17763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:49.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32544.929766 secs 2024-04-27T03:20:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32544.929766 secs 2024-04-27T03:20:49.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32544.929766 secs 2024-04-27T03:20:50.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:50 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31847.896249 secs 2024-04-27T03:20:50.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:50 smithi092 ceph-mon[29156]: pgmap v17764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:50.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:50 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31847.896249 secs 2024-04-27T03:20:50.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:50 smithi189 ceph-mon[32756]: pgmap v17764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:50.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:50 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31847.896249 secs 2024-04-27T03:20:50.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:50 smithi156 ceph-mon[32679]: pgmap v17764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:20:52.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:51 smithi189 ceph-mon[32756]: pgmap v17765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:52.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:51 smithi156 ceph-mon[32679]: pgmap v17765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:52.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:51 smithi092 ceph-mon[29156]: pgmap v17765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:20:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:20:53.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:20:53.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:20:53.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: pgmap v17766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:20:53.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: pgmap v17767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:53.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: pgmap v17766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: pgmap v17767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: pgmap v17766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: pgmap v17767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:53.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:20:54.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32549.929903 secs 2024-04-27T03:20:54.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32549.929903 secs 2024-04-27T03:20:54.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32549.929903 secs 2024-04-27T03:20:55.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:55 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31852.896343 secs 2024-04-27T03:20:55.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:55 smithi092 ceph-mon[29156]: pgmap v17768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:55.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:55 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31852.896343 secs 2024-04-27T03:20:55.645 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:55 smithi189 ceph-mon[32756]: pgmap v17768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:55.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:55 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31852.896343 secs 2024-04-27T03:20:55.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:55 smithi156 ceph-mon[32679]: pgmap v17768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:57.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:57 smithi189 ceph-mon[32756]: pgmap v17769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:57 smithi156 ceph-mon[32679]: pgmap v17769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:57 smithi092 ceph-mon[29156]: pgmap v17769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:20:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:59 smithi189 ceph-mon[32756]: pgmap v17770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:59.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:20:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32554.930028 secs 2024-04-27T03:20:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:59 smithi156 ceph-mon[32679]: pgmap v17770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:20:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32554.930028 secs 2024-04-27T03:20:59.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:59 smithi092 ceph-mon[29156]: pgmap v17770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:20:59.971 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:20:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32554.930028 secs 2024-04-27T03:21:00.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:00 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31857.896448 secs 2024-04-27T03:21:00.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:00 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31857.896448 secs 2024-04-27T03:21:01.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:00 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31857.896448 secs 2024-04-27T03:21:01.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:01 smithi189 ceph-mon[32756]: pgmap v17771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:21:01.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:01 smithi156 ceph-mon[32679]: pgmap v17771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:21:02.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:01 smithi092 ceph-mon[29156]: pgmap v17771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:21:03.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:03 smithi189 ceph-mon[32756]: pgmap v17772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:21:03.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:03 smithi156 ceph-mon[32679]: pgmap v17772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:21:04.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:03 smithi092 ceph-mon[29156]: pgmap v17772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:21:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32559.930147 secs 2024-04-27T03:21:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32559.930147 secs 2024-04-27T03:21:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32559.930147 secs 2024-04-27T03:21:05.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:05 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31862.896551 secs 2024-04-27T03:21:05.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:05 smithi189 ceph-mon[32756]: pgmap v17773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:05.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:05 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31862.896551 secs 2024-04-27T03:21:05.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:05 smithi156 ceph-mon[32679]: pgmap v17773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:06.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:05 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31862.896551 secs 2024-04-27T03:21:06.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:05 smithi092 ceph-mon[29156]: pgmap v17773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:07.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:07 smithi189 ceph-mon[32756]: pgmap v17774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:07.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:07 smithi156 ceph-mon[32679]: pgmap v17774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:08.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:07 smithi092 ceph-mon[29156]: pgmap v17774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:09 smithi189 ceph-mon[32756]: pgmap v17775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32564.930236 secs 2024-04-27T03:21:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:09 smithi156 ceph-mon[32679]: pgmap v17775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32564.930236 secs 2024-04-27T03:21:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:09 smithi092 ceph-mon[29156]: pgmap v17775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32564.930236 secs 2024-04-27T03:21:10.841 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:10 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31867.896676 secs 2024-04-27T03:21:10.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:10 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31867.896676 secs 2024-04-27T03:21:11.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:10 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31867.896676 secs 2024-04-27T03:21:11.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:11 smithi189 ceph-mon[32756]: pgmap v17776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:11.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:11 smithi156 ceph-mon[32679]: pgmap v17776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:12.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:11 smithi092 ceph-mon[29156]: pgmap v17776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:13.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:13 smithi189 ceph-mon[32756]: pgmap v17777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:13.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:13 smithi156 ceph-mon[32679]: pgmap v17777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:14.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:13 smithi092 ceph-mon[29156]: pgmap v17777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32569.930349 secs 2024-04-27T03:21:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32569.930349 secs 2024-04-27T03:21:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32569.930349 secs 2024-04-27T03:21:15.843 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:15 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31872.896796 secs 2024-04-27T03:21:15.843 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:15 smithi092 ceph-mon[29156]: pgmap v17778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:15.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:15 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31872.896796 secs 2024-04-27T03:21:15.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:15 smithi189 ceph-mon[32756]: pgmap v17778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:15.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:15 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31872.896796 secs 2024-04-27T03:21:15.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:15 smithi156 ceph-mon[32679]: pgmap v17778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:17.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:17 smithi189 ceph-mon[32756]: pgmap v17779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:17.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:17 smithi156 ceph-mon[32679]: pgmap v17779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:18.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:17 smithi092 ceph-mon[29156]: pgmap v17779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:19 smithi189 ceph-mon[32756]: pgmap v17780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32574.930470 secs 2024-04-27T03:21:19.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:19 smithi156 ceph-mon[32679]: pgmap v17780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:19.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32574.930470 secs 2024-04-27T03:21:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:19 smithi092 ceph-mon[29156]: pgmap v17780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32574.930470 secs 2024-04-27T03:21:20.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:20 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31877.896912 secs 2024-04-27T03:21:20.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:20 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31877.896912 secs 2024-04-27T03:21:21.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:20 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31877.896912 secs 2024-04-27T03:21:21.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:21 smithi189 ceph-mon[32756]: pgmap v17781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:21.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:21 smithi156 ceph-mon[32679]: pgmap v17781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:22.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:21 smithi092 ceph-mon[29156]: pgmap v17781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:23.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:23 smithi189 ceph-mon[32756]: pgmap v17782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:23.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:23 smithi156 ceph-mon[32679]: pgmap v17782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:24.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:23 smithi092 ceph-mon[29156]: pgmap v17782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32579.930559 secs 2024-04-27T03:21:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32579.930559 secs 2024-04-27T03:21:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32579.930559 secs 2024-04-27T03:21:25.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:25 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31882.897045 secs 2024-04-27T03:21:25.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:25 smithi189 ceph-mon[32756]: pgmap v17783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:25.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:25 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31882.897045 secs 2024-04-27T03:21:25.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:25 smithi156 ceph-mon[32679]: pgmap v17783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:26.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:25 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31882.897045 secs 2024-04-27T03:21:26.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:25 smithi092 ceph-mon[29156]: pgmap v17783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:27.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:27 smithi189 ceph-mon[32756]: pgmap v17784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:27.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:27 smithi156 ceph-mon[32679]: pgmap v17784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:28.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:27 smithi092 ceph-mon[29156]: pgmap v17784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:29 smithi189 ceph-mon[32756]: pgmap v17785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:29.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32584.930692 secs 2024-04-27T03:21:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:29 smithi156 ceph-mon[32679]: pgmap v17785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32584.930692 secs 2024-04-27T03:21:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:29 smithi092 ceph-mon[29156]: pgmap v17785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32584.930692 secs 2024-04-27T03:21:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:30 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31887.897140 secs 2024-04-27T03:21:30.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:30 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31887.897140 secs 2024-04-27T03:21:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:30 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31887.897140 secs 2024-04-27T03:21:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:31 smithi189 ceph-mon[32756]: pgmap v17786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:31 smithi156 ceph-mon[32679]: pgmap v17786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:31 smithi092 ceph-mon[29156]: pgmap v17786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:33.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:33 smithi189 ceph-mon[32756]: pgmap v17787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:33.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:33 smithi156 ceph-mon[32679]: pgmap v17787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:34.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:33 smithi092 ceph-mon[29156]: pgmap v17787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32589.930778 secs 2024-04-27T03:21:34.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31892.897281 secs 2024-04-27T03:21:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32589.930778 secs 2024-04-27T03:21:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31892.897281 secs 2024-04-27T03:21:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32589.930778 secs 2024-04-27T03:21:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31892.897281 secs 2024-04-27T03:21:35.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:35 smithi189 ceph-mon[32756]: pgmap v17788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:35.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:35 smithi156 ceph-mon[32679]: pgmap v17788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:36.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:35 smithi092 ceph-mon[29156]: pgmap v17788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:37.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:37 smithi189 ceph-mon[32756]: pgmap v17789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:37.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:37 smithi156 ceph-mon[32679]: pgmap v17789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:38.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:37 smithi092 ceph-mon[29156]: pgmap v17789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:39 smithi189 ceph-mon[32756]: pgmap v17790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32594.930898 secs 2024-04-27T03:21:39.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31897.897343 secs 2024-04-27T03:21:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:39 smithi156 ceph-mon[32679]: pgmap v17790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32594.930898 secs 2024-04-27T03:21:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31897.897343 secs 2024-04-27T03:21:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-mon[29156]: pgmap v17790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32594.930898 secs 2024-04-27T03:21:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31897.897343 secs 2024-04-27T03:21:40.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:21:39.521+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:21:40.001 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:21:39.521+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:21:40.001 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:21:39.521+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:21:40.001 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:21:39.521+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:21:40.001 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:21:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:21:39.521+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:21:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:21:40.457+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:21:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:21:40.457+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:21:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:21:40.457+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:21:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:21:40.458+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 251 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:21:41.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:41 smithi189 ceph-mon[32756]: pgmap v17791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:41.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:41 smithi156 ceph-mon[32679]: pgmap v17791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:42.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:41 smithi092 ceph-mon[29156]: pgmap v17791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:21:43.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:43 smithi189 ceph-mon[32756]: pgmap v17792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:43.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:43 smithi156 ceph-mon[32679]: pgmap v17792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:44.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:43 smithi092 ceph-mon[29156]: pgmap v17792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32599.931007 secs 2024-04-27T03:21:44.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31902.897454 secs 2024-04-27T03:21:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32599.931007 secs 2024-04-27T03:21:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31902.897454 secs 2024-04-27T03:21:45.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32599.931007 secs 2024-04-27T03:21:45.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31902.897454 secs 2024-04-27T03:21:45.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:45 smithi189 ceph-mon[32756]: pgmap v17793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:45.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:45 smithi156 ceph-mon[32679]: pgmap v17793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:46.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:45 smithi092 ceph-mon[29156]: pgmap v17793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:47.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:47 smithi189 ceph-mon[32756]: pgmap v17794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:47.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:47 smithi156 ceph-mon[32679]: pgmap v17794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:48.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:47 smithi092 ceph-mon[29156]: pgmap v17794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:49 smithi156 ceph-mon[32679]: pgmap v17795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32604.931143 secs 2024-04-27T03:21:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31907.897521 secs 2024-04-27T03:21:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:49 smithi092 ceph-mon[29156]: pgmap v17795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32604.931143 secs 2024-04-27T03:21:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31907.897521 secs 2024-04-27T03:21:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:49 smithi189 ceph-mon[32756]: pgmap v17795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32604.931143 secs 2024-04-27T03:21:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31907.897521 secs 2024-04-27T03:21:51.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:51 smithi156 ceph-mon[32679]: pgmap v17796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:52.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:51 smithi092 ceph-mon[29156]: pgmap v17796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:52.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:51 smithi189 ceph-mon[32756]: pgmap v17796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:52.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:21:53.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:21:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: pgmap v17797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: pgmap v17797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: pgmap v17797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32609.931255 secs 2024-04-27T03:21:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31912.897607 secs 2024-04-27T03:21:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32609.931255 secs 2024-04-27T03:21:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31912.897607 secs 2024-04-27T03:21:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32609.931255 secs 2024-04-27T03:21:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31912.897607 secs 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: pgmap v17798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: pgmap v17798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: pgmap v17798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:21:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:56.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:21:56.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:57.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:21:57.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:21:57.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: pgmap v17799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:57 smithi156 ceph-mon[32679]: pgmap v17800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: pgmap v17799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:57 smithi092 ceph-mon[29156]: pgmap v17800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: pgmap v17799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:21:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:57 smithi189 ceph-mon[32756]: pgmap v17800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:21:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:59 smithi156 ceph-mon[32679]: pgmap v17801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:21:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32614.931327 secs 2024-04-27T03:21:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:21:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31917.897727 secs 2024-04-27T03:22:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:59 smithi092 ceph-mon[29156]: pgmap v17801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32614.931327 secs 2024-04-27T03:22:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:21:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31917.897727 secs 2024-04-27T03:22:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:59 smithi189 ceph-mon[32756]: pgmap v17801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32614.931327 secs 2024-04-27T03:22:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:21:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31917.897727 secs 2024-04-27T03:22:01.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:01 smithi156 ceph-mon[32679]: pgmap v17802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:02.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:01 smithi092 ceph-mon[29156]: pgmap v17802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:02.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:01 smithi189 ceph-mon[32756]: pgmap v17802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:03.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:03 smithi156 ceph-mon[32679]: pgmap v17803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:04.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:03 smithi092 ceph-mon[29156]: pgmap v17803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:04.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:03 smithi189 ceph-mon[32756]: pgmap v17803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:04.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32619.931445 secs 2024-04-27T03:22:04.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31922.897851 secs 2024-04-27T03:22:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32619.931445 secs 2024-04-27T03:22:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31922.897851 secs 2024-04-27T03:22:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32619.931445 secs 2024-04-27T03:22:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31922.897851 secs 2024-04-27T03:22:05.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:05 smithi156 ceph-mon[32679]: pgmap v17804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:06.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:05 smithi092 ceph-mon[29156]: pgmap v17804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:06.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:05 smithi189 ceph-mon[32756]: pgmap v17804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:22:07.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:07 smithi156 ceph-mon[32679]: pgmap v17805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:22:07.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:07 smithi092 ceph-mon[29156]: pgmap v17805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:22:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:07 smithi189 ceph-mon[32756]: pgmap v17805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:22:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:09 smithi092 ceph-mon[29156]: pgmap v17806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32624.931564 secs 2024-04-27T03:22:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31927.897988 secs 2024-04-27T03:22:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:09 smithi189 ceph-mon[32756]: pgmap v17806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32624.931564 secs 2024-04-27T03:22:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31927.897988 secs 2024-04-27T03:22:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:09 smithi156 ceph-mon[32679]: pgmap v17806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32624.931564 secs 2024-04-27T03:22:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31927.897988 secs 2024-04-27T03:22:11.947 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:11 smithi189 ceph-mon[32756]: pgmap v17807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:11.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:11 smithi156 ceph-mon[32679]: pgmap v17807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:12.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:11 smithi092 ceph-mon[29156]: pgmap v17807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:14.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:13 smithi092 ceph-mon[29156]: pgmap v17808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:14.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:13 smithi189 ceph-mon[32756]: pgmap v17808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:14.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:13 smithi156 ceph-mon[32679]: pgmap v17808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32629.931700 secs 2024-04-27T03:22:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31932.898107 secs 2024-04-27T03:22:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32629.931700 secs 2024-04-27T03:22:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31932.898107 secs 2024-04-27T03:22:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32629.931700 secs 2024-04-27T03:22:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31932.898107 secs 2024-04-27T03:22:16.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:15 smithi092 ceph-mon[29156]: pgmap v17809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:16.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:15 smithi189 ceph-mon[32756]: pgmap v17809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:16.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:15 smithi156 ceph-mon[32679]: pgmap v17809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:18.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:17 smithi092 ceph-mon[29156]: pgmap v17810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:18.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:17 smithi189 ceph-mon[32756]: pgmap v17810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:18.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:17 smithi156 ceph-mon[32679]: pgmap v17810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:19 smithi092 ceph-mon[29156]: pgmap v17811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:20.126 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32634.931756 secs 2024-04-27T03:22:20.127 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31937.898226 secs 2024-04-27T03:22:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:19 smithi189 ceph-mon[32756]: pgmap v17811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32634.931756 secs 2024-04-27T03:22:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31937.898226 secs 2024-04-27T03:22:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:19 smithi156 ceph-mon[32679]: pgmap v17811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32634.931756 secs 2024-04-27T03:22:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31937.898226 secs 2024-04-27T03:22:21.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:20 smithi189 ceph-mon[32756]: pgmap v17812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:21.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:20 smithi156 ceph-mon[32679]: pgmap v17812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:20 smithi092 ceph-mon[29156]: pgmap v17812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:23.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:23 smithi189 ceph-mon[32756]: pgmap v17813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:23.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:23 smithi156 ceph-mon[32679]: pgmap v17813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:23.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:23 smithi092 ceph-mon[29156]: pgmap v17813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:24.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31942.898378 secs 2024-04-27T03:22:24.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31942.898378 secs 2024-04-27T03:22:24.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31942.898378 secs 2024-04-27T03:22:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32639.931898 secs 2024-04-27T03:22:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:25 smithi189 ceph-mon[32756]: pgmap v17814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32639.931898 secs 2024-04-27T03:22:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:25 smithi156 ceph-mon[32679]: pgmap v17814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32639.931898 secs 2024-04-27T03:22:25.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:25 smithi092 ceph-mon[29156]: pgmap v17814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:27.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:27 smithi189 ceph-mon[32756]: pgmap v17815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:27.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:27 smithi156 ceph-mon[32679]: pgmap v17815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:27.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:27 smithi092 ceph-mon[29156]: pgmap v17815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:29 smithi189 ceph-mon[32756]: pgmap v17816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31947.898439 secs 2024-04-27T03:22:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:29 smithi156 ceph-mon[32679]: pgmap v17816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31947.898439 secs 2024-04-27T03:22:29.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:29 smithi092 ceph-mon[29156]: pgmap v17816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:29.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31947.898439 secs 2024-04-27T03:22:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32644.931989 secs 2024-04-27T03:22:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32644.931989 secs 2024-04-27T03:22:30.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32644.931989 secs 2024-04-27T03:22:31.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:31 smithi189 ceph-mon[32756]: pgmap v17817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:31.401 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:31 smithi092 ceph-mon[29156]: pgmap v17817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:31.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:31 smithi156 ceph-mon[32679]: pgmap v17817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:33.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:33 smithi189 ceph-mon[32756]: pgmap v17818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:33.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:33 smithi156 ceph-mon[32679]: pgmap v17818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:33.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:33 smithi092 ceph-mon[29156]: pgmap v17818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:34.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31952.898550 secs 2024-04-27T03:22:34.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31952.898550 secs 2024-04-27T03:22:34.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31952.898550 secs 2024-04-27T03:22:35.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32649.932053 secs 2024-04-27T03:22:35.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:35 smithi156 ceph-mon[32679]: pgmap v17819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32649.932053 secs 2024-04-27T03:22:35.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:35 smithi092 ceph-mon[29156]: pgmap v17819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:35.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32649.932053 secs 2024-04-27T03:22:35.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:35 smithi189 ceph-mon[32756]: pgmap v17819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:37.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:37 smithi156 ceph-mon[32679]: pgmap v17820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:37.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:37 smithi092 ceph-mon[29156]: pgmap v17820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:37.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:37 smithi189 ceph-mon[32756]: pgmap v17820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:39.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:39 smithi156 ceph-mon[32679]: pgmap v17821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:39.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31957.898639 secs 2024-04-27T03:22:39.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:39 smithi092 ceph-mon[29156]: pgmap v17821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:39.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31957.898639 secs 2024-04-27T03:22:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:39 smithi189 ceph-mon[32756]: pgmap v17821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31957.898639 secs 2024-04-27T03:22:40.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32654.932172 secs 2024-04-27T03:22:40.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32654.932172 secs 2024-04-27T03:22:40.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32654.932172 secs 2024-04-27T03:22:41.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:41 smithi156 ceph-mon[32679]: pgmap v17822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:41.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:41 smithi092 ceph-mon[29156]: pgmap v17822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:41.545 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:41 smithi189 ceph-mon[32756]: pgmap v17822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:43.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:43 smithi156 ceph-mon[32679]: pgmap v17823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:43.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:43 smithi092 ceph-mon[29156]: pgmap v17823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:43.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:43 smithi189 ceph-mon[32756]: pgmap v17823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:44.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31962.898744 secs 2024-04-27T03:22:44.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31962.898744 secs 2024-04-27T03:22:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31962.898744 secs 2024-04-27T03:22:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32659.932286 secs 2024-04-27T03:22:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:45 smithi156 ceph-mon[32679]: pgmap v17824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:45.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32659.932286 secs 2024-04-27T03:22:45.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:45 smithi092 ceph-mon[29156]: pgmap v17824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:45.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32659.932286 secs 2024-04-27T03:22:45.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:45 smithi189 ceph-mon[32756]: pgmap v17824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:47.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:47 smithi156 ceph-mon[32679]: pgmap v17825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:47.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:47 smithi092 ceph-mon[29156]: pgmap v17825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:47.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:47 smithi189 ceph-mon[32756]: pgmap v17825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:49.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:49 smithi156 ceph-mon[32679]: pgmap v17826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:49.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32664.932362 secs 2024-04-27T03:22:49.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31967.898880 secs 2024-04-27T03:22:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:49 smithi092 ceph-mon[29156]: pgmap v17826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:49.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32664.932362 secs 2024-04-27T03:22:49.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31967.898880 secs 2024-04-27T03:22:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:49 smithi189 ceph-mon[32756]: pgmap v17826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:22:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32664.932362 secs 2024-04-27T03:22:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31967.898880 secs 2024-04-27T03:22:51.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:51 smithi156 ceph-mon[32679]: pgmap v17827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:51.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:51 smithi092 ceph-mon[29156]: pgmap v17827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:51.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:51 smithi189 ceph-mon[32756]: pgmap v17827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:22:53.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:53 smithi156 ceph-mon[32679]: pgmap v17828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:53.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:53 smithi092 ceph-mon[29156]: pgmap v17828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:53.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:53 smithi189 ceph-mon[32756]: pgmap v17828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:54.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32669.932477 secs 2024-04-27T03:22:54.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31972.899006 secs 2024-04-27T03:22:54.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32669.932477 secs 2024-04-27T03:22:54.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31972.899006 secs 2024-04-27T03:22:54.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32669.932477 secs 2024-04-27T03:22:54.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31972.899006 secs 2024-04-27T03:22:55.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:55 smithi092 ceph-mon[29156]: pgmap v17829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:55.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:55 smithi189 ceph-mon[32756]: pgmap v17829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:55 smithi156 ceph-mon[32679]: pgmap v17829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:22:56.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:22:56.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:22:56.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:22:57.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:57 smithi092 ceph-mon[29156]: pgmap v17830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:57.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:22:57.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:22:57.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:22:57.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:57 smithi189 ceph-mon[32756]: pgmap v17830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:57.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:22:57.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:22:57.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:22:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:57 smithi156 ceph-mon[32679]: pgmap v17830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:22:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:22:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:22:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:22:58.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:58 smithi092 ceph-mon[29156]: pgmap v17831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:22:58.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:58 smithi092 ceph-mon[29156]: pgmap v17832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:22:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:58 smithi189 ceph-mon[32756]: pgmap v17831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:22:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:58 smithi189 ceph-mon[32756]: pgmap v17832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:22:58.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:58 smithi156 ceph-mon[32679]: pgmap v17831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:22:58.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:58 smithi156 ceph-mon[32679]: pgmap v17832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:22:59.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32674.932598 secs 2024-04-27T03:22:59.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:22:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31977.899112 secs 2024-04-27T03:22:59.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32674.932598 secs 2024-04-27T03:22:59.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:22:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31977.899112 secs 2024-04-27T03:22:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32674.932598 secs 2024-04-27T03:22:59.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:22:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31977.899112 secs 2024-04-27T03:23:00.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:00 smithi092 ceph-mon[29156]: pgmap v17833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:00 smithi189 ceph-mon[32756]: pgmap v17833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:00 smithi156 ceph-mon[32679]: pgmap v17833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:02.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:02 smithi092 ceph-mon[29156]: pgmap v17834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:02.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:02 smithi189 ceph-mon[32756]: pgmap v17834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:02.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:02 smithi156 ceph-mon[32679]: pgmap v17834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:04.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:04 smithi092 ceph-mon[29156]: pgmap v17835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:04.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32679.932713 secs 2024-04-27T03:23:04.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31982.899231 secs 2024-04-27T03:23:04.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:04 smithi189 ceph-mon[32756]: pgmap v17835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:04.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32679.932713 secs 2024-04-27T03:23:04.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31982.899231 secs 2024-04-27T03:23:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:04 smithi156 ceph-mon[32679]: pgmap v17835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:04.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32679.932713 secs 2024-04-27T03:23:04.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31982.899231 secs 2024-04-27T03:23:06.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:06 smithi092 ceph-mon[29156]: pgmap v17836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:06.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:06 smithi189 ceph-mon[32756]: pgmap v17836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:06.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:06 smithi156 ceph-mon[32679]: pgmap v17836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:23:08.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:08 smithi092 ceph-mon[29156]: pgmap v17837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:23:08.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:08 smithi189 ceph-mon[32756]: pgmap v17837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:23:08.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:08 smithi156 ceph-mon[32679]: pgmap v17837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:23:09.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32684.932788 secs 2024-04-27T03:23:09.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:09 smithi092 ceph-mon[29156]: slow request 2880.033844 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:09.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31987.899340 secs 2024-04-27T03:23:09.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32684.932788 secs 2024-04-27T03:23:09.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:09 smithi189 ceph-mon[32756]: slow request 2880.033844 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:09.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31987.899340 secs 2024-04-27T03:23:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32684.932788 secs 2024-04-27T03:23:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:09 smithi156 ceph-mon[32679]: slow request 2880.033844 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31987.899340 secs 2024-04-27T03:23:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:23:10.470+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:23:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:23:10.470+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:23:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:23:10.470+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:23:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:23:10.470+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 252 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:23:10.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:10 smithi092 ceph-mon[29156]: pgmap v17838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:10.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:10 smithi189 ceph-mon[32756]: pgmap v17838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:10 smithi156 ceph-mon[32679]: pgmap v17838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:12.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:12 smithi189 ceph-mon[32756]: pgmap v17839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:12.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:12 smithi156 ceph-mon[32679]: pgmap v17839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:12.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:12 smithi092 ceph-mon[29156]: pgmap v17839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:14.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:14 smithi189 ceph-mon[32756]: pgmap v17840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:14.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32689.932914 secs 2024-04-27T03:23:14.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:14 smithi189 ceph-mon[32756]: slow request 724.487419 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:14.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31992.899479 secs 2024-04-27T03:23:14.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:14 smithi156 ceph-mon[32679]: pgmap v17840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:14.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32689.932914 secs 2024-04-27T03:23:14.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:14 smithi156 ceph-mon[32679]: slow request 724.487419 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:14.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31992.899479 secs 2024-04-27T03:23:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:14 smithi092 ceph-mon[29156]: pgmap v17840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32689.932914 secs 2024-04-27T03:23:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:14 smithi092 ceph-mon[29156]: slow request 724.487419 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:23:14.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31992.899479 secs 2024-04-27T03:23:16.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:16 smithi189 ceph-mon[32756]: pgmap v17841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:16.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:16 smithi156 ceph-mon[32679]: pgmap v17841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:16.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:16 smithi092 ceph-mon[29156]: pgmap v17841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:18.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:18 smithi189 ceph-mon[32756]: pgmap v17842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:18.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:18 smithi156 ceph-mon[32679]: pgmap v17842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:18 smithi092 ceph-mon[29156]: pgmap v17842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32694.933028 secs 2024-04-27T03:23:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 31997.899597 secs 2024-04-27T03:23:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32694.933028 secs 2024-04-27T03:23:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 31997.899597 secs 2024-04-27T03:23:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32694.933028 secs 2024-04-27T03:23:19.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 31997.899597 secs 2024-04-27T03:23:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:20 smithi189 ceph-mon[32756]: pgmap v17843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:20.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:20 smithi156 ceph-mon[32679]: pgmap v17843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:20 smithi092 ceph-mon[29156]: pgmap v17843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:22.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:22 smithi189 ceph-mon[32756]: pgmap v17844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:22.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:22 smithi156 ceph-mon[32679]: pgmap v17844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:22 smithi092 ceph-mon[29156]: pgmap v17844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:24.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:24 smithi189 ceph-mon[32756]: pgmap v17845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:24.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32699.933100 secs 2024-04-27T03:23:24.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32002.899748 secs 2024-04-27T03:23:24.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:24 smithi156 ceph-mon[32679]: pgmap v17845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:24.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32699.933100 secs 2024-04-27T03:23:24.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32002.899748 secs 2024-04-27T03:23:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:24 smithi092 ceph-mon[29156]: pgmap v17845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32699.933100 secs 2024-04-27T03:23:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32002.899748 secs 2024-04-27T03:23:26.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:26 smithi189 ceph-mon[32756]: pgmap v17846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:26.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:26 smithi156 ceph-mon[32679]: pgmap v17846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:26.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:26 smithi092 ceph-mon[29156]: pgmap v17846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:28.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:28 smithi189 ceph-mon[32756]: pgmap v17847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:28.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:28 smithi156 ceph-mon[32679]: pgmap v17847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:28.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:28 smithi092 ceph-mon[29156]: pgmap v17847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32704.933211 secs 2024-04-27T03:23:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32007.899865 secs 2024-04-27T03:23:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32704.933211 secs 2024-04-27T03:23:29.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32007.899865 secs 2024-04-27T03:23:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32704.933211 secs 2024-04-27T03:23:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32007.899865 secs 2024-04-27T03:23:30.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:30 smithi189 ceph-mon[32756]: pgmap v17848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:30.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:30 smithi156 ceph-mon[32679]: pgmap v17848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:30.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:30 smithi092 ceph-mon[29156]: pgmap v17848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:32.552 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:32 smithi092 ceph-mon[29156]: pgmap v17849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:32.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:32 smithi189 ceph-mon[32756]: pgmap v17849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:32.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:32 smithi156 ceph-mon[32679]: pgmap v17849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:34.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:34 smithi189 ceph-mon[32756]: pgmap v17850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:34.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32709.933328 secs 2024-04-27T03:23:34.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32012.900000 secs 2024-04-27T03:23:34.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:34 smithi156 ceph-mon[32679]: pgmap v17850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:34.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32709.933328 secs 2024-04-27T03:23:34.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32012.900000 secs 2024-04-27T03:23:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:34 smithi092 ceph-mon[29156]: pgmap v17850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32709.933328 secs 2024-04-27T03:23:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32012.900000 secs 2024-04-27T03:23:36.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:36 smithi189 ceph-mon[32756]: pgmap v17851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:36.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:36 smithi156 ceph-mon[32679]: pgmap v17851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:36.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:36 smithi092 ceph-mon[29156]: pgmap v17851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:38.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:38 smithi189 ceph-mon[32756]: pgmap v17852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:38.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:38 smithi156 ceph-mon[32679]: pgmap v17852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:38.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:38 smithi092 ceph-mon[29156]: pgmap v17852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32714.933445 secs 2024-04-27T03:23:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32017.900131 secs 2024-04-27T03:23:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32714.933445 secs 2024-04-27T03:23:39.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32017.900131 secs 2024-04-27T03:23:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32714.933445 secs 2024-04-27T03:23:39.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32017.900131 secs 2024-04-27T03:23:40.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:40 smithi189 ceph-mon[32756]: pgmap v17853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:40.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:40 smithi156 ceph-mon[32679]: pgmap v17853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:40.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:40 smithi092 ceph-mon[29156]: pgmap v17853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:42.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:42 smithi189 ceph-mon[32756]: pgmap v17854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:42.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:42 smithi156 ceph-mon[32679]: pgmap v17854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:42.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:42 smithi092 ceph-mon[29156]: pgmap v17854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:44 smithi189 ceph-mon[32756]: pgmap v17855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32719.933581 secs 2024-04-27T03:23:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32022.900228 secs 2024-04-27T03:23:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:44 smithi156 ceph-mon[32679]: pgmap v17855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32719.933581 secs 2024-04-27T03:23:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32022.900228 secs 2024-04-27T03:23:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:44 smithi092 ceph-mon[29156]: pgmap v17855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32719.933581 secs 2024-04-27T03:23:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32022.900228 secs 2024-04-27T03:23:46.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:46 smithi189 ceph-mon[32756]: pgmap v17856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:46.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:46 smithi156 ceph-mon[32679]: pgmap v17856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:46.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:46 smithi092 ceph-mon[29156]: pgmap v17856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:48.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:48 smithi189 ceph-mon[32756]: pgmap v17857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:48.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:48 smithi156 ceph-mon[32679]: pgmap v17857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:48.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:48 smithi092 ceph-mon[29156]: pgmap v17857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32724.933714 secs 2024-04-27T03:23:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32027.900363 secs 2024-04-27T03:23:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32724.933714 secs 2024-04-27T03:23:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32027.900363 secs 2024-04-27T03:23:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32724.933714 secs 2024-04-27T03:23:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32027.900363 secs 2024-04-27T03:23:50.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:50 smithi189 ceph-mon[32756]: pgmap v17858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:50.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:50 smithi156 ceph-mon[32679]: pgmap v17858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:50 smithi092 ceph-mon[29156]: pgmap v17858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:52.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:52 smithi189 ceph-mon[32756]: pgmap v17859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:52.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:52 smithi156 ceph-mon[32679]: pgmap v17859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:52.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:52 smithi092 ceph-mon[29156]: pgmap v17859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:54.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:54 smithi189 ceph-mon[32756]: pgmap v17860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:54.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32729.933854 secs 2024-04-27T03:23:54.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32032.900479 secs 2024-04-27T03:23:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:54 smithi156 ceph-mon[32679]: pgmap v17860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32729.933854 secs 2024-04-27T03:23:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32032.900479 secs 2024-04-27T03:23:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:54 smithi092 ceph-mon[29156]: pgmap v17860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32729.933854 secs 2024-04-27T03:23:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32032.900479 secs 2024-04-27T03:23:56.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:56 smithi189 ceph-mon[32756]: pgmap v17861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:56.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:56 smithi156 ceph-mon[32679]: pgmap v17861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:56.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:56 smithi092 ceph-mon[29156]: pgmap v17861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:23:57.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:23:57.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:23:57.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: pgmap v17862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: pgmap v17863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: pgmap v17864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:58.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:23:58.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: pgmap v17862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:58.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:23:58.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:23:58.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: pgmap v17863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:23:58.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: pgmap v17864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:58.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:23:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: pgmap v17862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:23:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:23:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:23:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: pgmap v17863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:23:58.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: pgmap v17864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:23:58.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:23:59.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32734.933971 secs 2024-04-27T03:23:59.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:23:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32037.900556 secs 2024-04-27T03:23:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32734.933971 secs 2024-04-27T03:23:59.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:23:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32037.900556 secs 2024-04-27T03:23:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32734.933971 secs 2024-04-27T03:23:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:23:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32037.900556 secs 2024-04-27T03:24:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:00 smithi189 ceph-mon[32756]: pgmap v17865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:00 smithi156 ceph-mon[32679]: pgmap v17865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:00 smithi092 ceph-mon[29156]: pgmap v17865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:02 smithi092 ceph-mon[29156]: pgmap v17866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:02 smithi189 ceph-mon[32756]: pgmap v17866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:02 smithi156 ceph-mon[32679]: pgmap v17866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:04 smithi092 ceph-mon[29156]: pgmap v17867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32739.934088 secs 2024-04-27T03:24:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32042.900674 secs 2024-04-27T03:24:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:04 smithi189 ceph-mon[32756]: pgmap v17867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32739.934088 secs 2024-04-27T03:24:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32042.900674 secs 2024-04-27T03:24:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:04 smithi156 ceph-mon[32679]: pgmap v17867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32739.934088 secs 2024-04-27T03:24:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32042.900674 secs 2024-04-27T03:24:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:06 smithi092 ceph-mon[29156]: pgmap v17868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:06 smithi189 ceph-mon[32756]: pgmap v17868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:06 smithi156 ceph-mon[32679]: pgmap v17868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:24:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:08 smithi092 ceph-mon[29156]: pgmap v17869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:24:09.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:08 smithi189 ceph-mon[32756]: pgmap v17869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:24:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:08 smithi156 ceph-mon[32679]: pgmap v17869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:24:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 32744.934205 secs 2024-04-27T03:24:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:09 smithi092 ceph-mon[29156]: slow request 5760.859069 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:24:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32047.900797 secs 2024-04-27T03:24:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 32744.934205 secs 2024-04-27T03:24:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:09 smithi189 ceph-mon[32756]: slow request 5760.859069 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:24:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32047.900797 secs 2024-04-27T03:24:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 32744.934205 secs 2024-04-27T03:24:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:09 smithi156 ceph-mon[32679]: slow request 5760.859069 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:24:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32047.900797 secs 2024-04-27T03:24:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:10 smithi092 ceph-mon[29156]: pgmap v17870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:11.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:10 smithi189 ceph-mon[32756]: pgmap v17870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:11.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:10 smithi156 ceph-mon[32679]: pgmap v17870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:12.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:12 smithi156 ceph-mon[32679]: pgmap v17871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:12 smithi092 ceph-mon[29156]: pgmap v17871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:13.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:12 smithi189 ceph-mon[32756]: pgmap v17871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:14 smithi092 ceph-mon[29156]: pgmap v17872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32749.934346 secs 2024-04-27T03:24:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32052.900936 secs 2024-04-27T03:24:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:14 smithi189 ceph-mon[32756]: pgmap v17872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32749.934346 secs 2024-04-27T03:24:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32052.900936 secs 2024-04-27T03:24:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:14 smithi156 ceph-mon[32679]: pgmap v17872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32749.934346 secs 2024-04-27T03:24:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32052.900936 secs 2024-04-27T03:24:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:16 smithi092 ceph-mon[29156]: pgmap v17873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:17.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:16 smithi189 ceph-mon[32756]: pgmap v17873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:17.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:16 smithi156 ceph-mon[32679]: pgmap v17873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:17 smithi156 ceph-mon[32679]: pgmap v17874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:17 smithi092 ceph-mon[29156]: pgmap v17874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:18.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:17 smithi189 ceph-mon[32756]: pgmap v17874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:19.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32057.901071 secs 2024-04-27T03:24:19.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32057.901071 secs 2024-04-27T03:24:19.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32057.901071 secs 2024-04-27T03:24:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32754.934457 secs 2024-04-27T03:24:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:20 smithi189 ceph-mon[32756]: pgmap v17875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32754.934457 secs 2024-04-27T03:24:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:20 smithi156 ceph-mon[32679]: pgmap v17875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32754.934457 secs 2024-04-27T03:24:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:20 smithi092 ceph-mon[29156]: pgmap v17875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:22 smithi092 ceph-mon[29156]: pgmap v17876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:23.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:22 smithi189 ceph-mon[32756]: pgmap v17876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:22 smithi156 ceph-mon[32679]: pgmap v17876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:24 smithi092 ceph-mon[29156]: pgmap v17877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32759.934566 secs 2024-04-27T03:24:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32062.901189 secs 2024-04-27T03:24:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:24 smithi189 ceph-mon[32756]: pgmap v17877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32759.934566 secs 2024-04-27T03:24:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32062.901189 secs 2024-04-27T03:24:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:24 smithi156 ceph-mon[32679]: pgmap v17877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32759.934566 secs 2024-04-27T03:24:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32062.901189 secs 2024-04-27T03:24:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:26 smithi092 ceph-mon[29156]: pgmap v17878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:26 smithi189 ceph-mon[32756]: pgmap v17878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:26 smithi156 ceph-mon[32679]: pgmap v17878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:28 smithi092 ceph-mon[29156]: pgmap v17879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:28 smithi189 ceph-mon[32756]: pgmap v17879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:28 smithi156 ceph-mon[32679]: pgmap v17879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32764.934685 secs 2024-04-27T03:24:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32067.901252 secs 2024-04-27T03:24:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32764.934685 secs 2024-04-27T03:24:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32067.901252 secs 2024-04-27T03:24:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32764.934685 secs 2024-04-27T03:24:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32067.901252 secs 2024-04-27T03:24:30.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:30 smithi092 ceph-mon[29156]: pgmap v17880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:30 smithi189 ceph-mon[32756]: pgmap v17880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:30 smithi156 ceph-mon[32679]: pgmap v17880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:32.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:32 smithi092 ceph-mon[29156]: pgmap v17881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:32 smithi189 ceph-mon[32756]: pgmap v17881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:32 smithi156 ceph-mon[32679]: pgmap v17881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:34.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:33 smithi189 ceph-mon[32756]: pgmap v17882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:34.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:33 smithi156 ceph-mon[32679]: pgmap v17882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:34.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:33 smithi092 ceph-mon[29156]: pgmap v17882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32769.934804 secs 2024-04-27T03:24:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32072.901390 secs 2024-04-27T03:24:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32769.934804 secs 2024-04-27T03:24:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32072.901390 secs 2024-04-27T03:24:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32769.934804 secs 2024-04-27T03:24:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32072.901390 secs 2024-04-27T03:24:36.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:35 smithi189 ceph-mon[32756]: pgmap v17883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:36.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:35 smithi156 ceph-mon[32679]: pgmap v17883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:36.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:35 smithi092 ceph-mon[29156]: pgmap v17883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:38 smithi092 ceph-mon[29156]: pgmap v17884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:38 smithi189 ceph-mon[32756]: pgmap v17884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:38 smithi156 ceph-mon[32679]: pgmap v17884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32774.934925 secs 2024-04-27T03:24:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32077.901515 secs 2024-04-27T03:24:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32774.934925 secs 2024-04-27T03:24:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32077.901515 secs 2024-04-27T03:24:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32774.934925 secs 2024-04-27T03:24:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32077.901515 secs 2024-04-27T03:24:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:24:40.483+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:24:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:24:40.483+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:24:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:24:40.484+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:24:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:24:40.484+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 253 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:24:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:40 smithi092 ceph-mon[29156]: pgmap v17885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:40 smithi189 ceph-mon[32756]: pgmap v17885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:40 smithi156 ceph-mon[32679]: pgmap v17885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:42.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:42 smithi156 ceph-mon[32679]: pgmap v17886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:42 smithi092 ceph-mon[29156]: pgmap v17886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:42 smithi189 ceph-mon[32756]: pgmap v17886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:44 smithi092 ceph-mon[29156]: pgmap v17887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32779.935042 secs 2024-04-27T03:24:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32082.901652 secs 2024-04-27T03:24:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:44 smithi189 ceph-mon[32756]: pgmap v17887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32779.935042 secs 2024-04-27T03:24:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32082.901652 secs 2024-04-27T03:24:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:44 smithi156 ceph-mon[32679]: pgmap v17887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32779.935042 secs 2024-04-27T03:24:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32082.901652 secs 2024-04-27T03:24:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:46 smithi092 ceph-mon[29156]: pgmap v17888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:46 smithi189 ceph-mon[32756]: pgmap v17888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:46 smithi156 ceph-mon[32679]: pgmap v17888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:48.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:47 smithi189 ceph-mon[32756]: pgmap v17889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:47 smithi156 ceph-mon[32679]: pgmap v17889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:48.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:47 smithi092 ceph-mon[29156]: pgmap v17889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:49.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32087.901768 secs 2024-04-27T03:24:49.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32087.901768 secs 2024-04-27T03:24:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32087.901768 secs 2024-04-27T03:24:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32784.935160 secs 2024-04-27T03:24:50.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:50 smithi189 ceph-mon[32756]: pgmap v17890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32784.935160 secs 2024-04-27T03:24:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:50 smithi156 ceph-mon[32679]: pgmap v17890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32784.935160 secs 2024-04-27T03:24:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:50 smithi092 ceph-mon[29156]: pgmap v17890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:52 smithi092 ceph-mon[29156]: pgmap v17891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:53.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:52 smithi189 ceph-mon[32756]: pgmap v17891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:52 smithi156 ceph-mon[32679]: pgmap v17891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:54 smithi092 ceph-mon[29156]: pgmap v17892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32789.935302 secs 2024-04-27T03:24:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32092.901845 secs 2024-04-27T03:24:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:54 smithi189 ceph-mon[32756]: pgmap v17892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32789.935302 secs 2024-04-27T03:24:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32092.901845 secs 2024-04-27T03:24:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:54 smithi156 ceph-mon[32679]: pgmap v17892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:24:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32789.935302 secs 2024-04-27T03:24:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32092.901845 secs 2024-04-27T03:24:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:56 smithi092 ceph-mon[29156]: pgmap v17893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:57.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:56 smithi189 ceph-mon[32756]: pgmap v17893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:56 smithi156 ceph-mon[32679]: pgmap v17893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:58 smithi092 ceph-mon[29156]: pgmap v17894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:24:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:24:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:24:59.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:24:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:58 smithi189 ceph-mon[32756]: pgmap v17894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:24:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:24:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:24:59.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:24:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:58 smithi156 ceph-mon[32679]: pgmap v17894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:24:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:24:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:24:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:24:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:24:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:59 smithi092 ceph-mon[29156]: pgmap v17895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:24:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:59 smithi092 ceph-mon[29156]: pgmap v17896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:24:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32794.935421 secs 2024-04-27T03:24:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:24:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32097.901963 secs 2024-04-27T03:25:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:59 smithi189 ceph-mon[32756]: pgmap v17895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:25:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:59 smithi189 ceph-mon[32756]: pgmap v17896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:25:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32794.935421 secs 2024-04-27T03:25:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:24:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32097.901963 secs 2024-04-27T03:25:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:59 smithi156 ceph-mon[32679]: pgmap v17895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:25:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:59 smithi156 ceph-mon[32679]: pgmap v17896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:25:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32794.935421 secs 2024-04-27T03:25:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:24:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32097.901963 secs 2024-04-27T03:25:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:01 smithi092 ceph-mon[29156]: pgmap v17897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:01 smithi189 ceph-mon[32756]: pgmap v17897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:01 smithi156 ceph-mon[32679]: pgmap v17897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:02 smithi092 ceph-mon[29156]: pgmap v17898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:25:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:02 smithi189 ceph-mon[32756]: pgmap v17898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:25:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:02 smithi156 ceph-mon[32679]: pgmap v17898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:25:04.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32102.902097 secs 2024-04-27T03:25:04.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32102.902097 secs 2024-04-27T03:25:04.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32102.902097 secs 2024-04-27T03:25:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32799.935539 secs 2024-04-27T03:25:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:05 smithi189 ceph-mon[32756]: pgmap v17899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:05.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32799.935539 secs 2024-04-27T03:25:05.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:05 smithi156 ceph-mon[32679]: pgmap v17899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32799.935539 secs 2024-04-27T03:25:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:05 smithi092 ceph-mon[29156]: pgmap v17899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:07.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:07 smithi189 ceph-mon[32756]: pgmap v17900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:07.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:07 smithi156 ceph-mon[32679]: pgmap v17900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:07.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:07 smithi092 ceph-mon[29156]: pgmap v17900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:25:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:09 smithi189 ceph-mon[32756]: pgmap v17901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:25:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32804.935657 secs 2024-04-27T03:25:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32107.902215 secs 2024-04-27T03:25:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:09 smithi156 ceph-mon[32679]: pgmap v17901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:25:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32804.935657 secs 2024-04-27T03:25:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32107.902215 secs 2024-04-27T03:25:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:09 smithi092 ceph-mon[29156]: pgmap v17901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:25:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32804.935657 secs 2024-04-27T03:25:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32107.902215 secs 2024-04-27T03:25:11.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:11 smithi189 ceph-mon[32756]: pgmap v17902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:11.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:11 smithi156 ceph-mon[32679]: pgmap v17902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:11.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:11 smithi092 ceph-mon[29156]: pgmap v17902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:13.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:13 smithi189 ceph-mon[32756]: pgmap v17903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:13.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:13 smithi156 ceph-mon[32679]: pgmap v17903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:13.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:13 smithi092 ceph-mon[29156]: pgmap v17903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32809.935777 secs 2024-04-27T03:25:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32112.902329 secs 2024-04-27T03:25:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32809.935777 secs 2024-04-27T03:25:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32112.902329 secs 2024-04-27T03:25:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32809.935777 secs 2024-04-27T03:25:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32112.902329 secs 2024-04-27T03:25:15.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:15 smithi189 ceph-mon[32756]: pgmap v17904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:15.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:15 smithi156 ceph-mon[32679]: pgmap v17904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:15 smithi092 ceph-mon[29156]: pgmap v17904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:17.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:17 smithi189 ceph-mon[32756]: pgmap v17905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:17.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:17 smithi156 ceph-mon[32679]: pgmap v17905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:17.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:17 smithi092 ceph-mon[29156]: pgmap v17905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:19 smithi189 ceph-mon[32756]: pgmap v17906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32814.935876 secs 2024-04-27T03:25:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32117.902399 secs 2024-04-27T03:25:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:19 smithi156 ceph-mon[32679]: pgmap v17906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32814.935876 secs 2024-04-27T03:25:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32117.902399 secs 2024-04-27T03:25:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:19 smithi092 ceph-mon[29156]: pgmap v17906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32814.935876 secs 2024-04-27T03:25:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32117.902399 secs 2024-04-27T03:25:21.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:21 smithi189 ceph-mon[32756]: pgmap v17907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:21.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:21 smithi156 ceph-mon[32679]: pgmap v17907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:21.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:21 smithi092 ceph-mon[29156]: pgmap v17907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:23.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:23 smithi189 ceph-mon[32756]: pgmap v17908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:23.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:23 smithi156 ceph-mon[32679]: pgmap v17908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:23.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:23 smithi092 ceph-mon[29156]: pgmap v17908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32819.935989 secs 2024-04-27T03:25:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32122.902516 secs 2024-04-27T03:25:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32819.935989 secs 2024-04-27T03:25:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32122.902516 secs 2024-04-27T03:25:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32819.935989 secs 2024-04-27T03:25:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32122.902516 secs 2024-04-27T03:25:25.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:25 smithi189 ceph-mon[32756]: pgmap v17909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:25.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:25 smithi156 ceph-mon[32679]: pgmap v17909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:25 smithi092 ceph-mon[29156]: pgmap v17909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:27.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:27 smithi189 ceph-mon[32756]: pgmap v17910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:27.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:27 smithi156 ceph-mon[32679]: pgmap v17910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:27 smithi092 ceph-mon[29156]: pgmap v17910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:29 smithi189 ceph-mon[32756]: pgmap v17911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32824.936111 secs 2024-04-27T03:25:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32127.902599 secs 2024-04-27T03:25:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:29 smithi156 ceph-mon[32679]: pgmap v17911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32824.936111 secs 2024-04-27T03:25:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32127.902599 secs 2024-04-27T03:25:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:29 smithi092 ceph-mon[29156]: pgmap v17911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32824.936111 secs 2024-04-27T03:25:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32127.902599 secs 2024-04-27T03:25:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:31 smithi189 ceph-mon[32756]: pgmap v17912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:31.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:31 smithi156 ceph-mon[32679]: pgmap v17912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:31 smithi092 ceph-mon[29156]: pgmap v17912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:33.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:33 smithi189 ceph-mon[32756]: pgmap v17913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:33 smithi156 ceph-mon[32679]: pgmap v17913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:33 smithi092 ceph-mon[29156]: pgmap v17913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32829.936234 secs 2024-04-27T03:25:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32132.902720 secs 2024-04-27T03:25:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32829.936234 secs 2024-04-27T03:25:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32132.902720 secs 2024-04-27T03:25:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32829.936234 secs 2024-04-27T03:25:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32132.902720 secs 2024-04-27T03:25:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:35 smithi189 ceph-mon[32756]: pgmap v17914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:35.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:35 smithi156 ceph-mon[32679]: pgmap v17914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:35 smithi092 ceph-mon[29156]: pgmap v17914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:37.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:37 smithi189 ceph-mon[32756]: pgmap v17915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:37.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:37 smithi156 ceph-mon[32679]: pgmap v17915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:37.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:37 smithi092 ceph-mon[29156]: pgmap v17915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:39.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:39 smithi092 ceph-mon[29156]: pgmap v17916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:39.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32834.936364 secs 2024-04-27T03:25:39.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:39 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 32137.902856 secs 2024-04-27T03:25:39.802 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:39 smithi092 ceph-mon[29156]: slow request 11522.633469 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:25:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:39 smithi189 ceph-mon[32756]: pgmap v17916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32834.936364 secs 2024-04-27T03:25:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:39 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 32137.902856 secs 2024-04-27T03:25:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:39 smithi189 ceph-mon[32756]: slow request 11522.633469 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:25:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:39 smithi156 ceph-mon[32679]: pgmap v17916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32834.936364 secs 2024-04-27T03:25:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:39 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 32137.902856 secs 2024-04-27T03:25:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:39 smithi156 ceph-mon[32679]: slow request 11522.633469 seconds old, received at 2024-04-27T00:13:36.415420+0000: client_request(client.17241:1 getattr pAsLsXsFs #0x1 2024-04-27T00:13:36.408128+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:25:41.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:41 smithi189 ceph-mon[32756]: pgmap v17917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:41.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:41 smithi156 ceph-mon[32679]: pgmap v17917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:41.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:41 smithi092 ceph-mon[29156]: pgmap v17917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:43.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:43 smithi189 ceph-mon[32756]: pgmap v17918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:43.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:43 smithi156 ceph-mon[32679]: pgmap v17918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:43.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:43 smithi092 ceph-mon[29156]: pgmap v17918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32839.936486 secs 2024-04-27T03:25:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32142.902930 secs 2024-04-27T03:25:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32839.936486 secs 2024-04-27T03:25:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32142.902930 secs 2024-04-27T03:25:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32839.936486 secs 2024-04-27T03:25:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32142.902930 secs 2024-04-27T03:25:45.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:45 smithi189 ceph-mon[32756]: pgmap v17919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:45.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:45 smithi156 ceph-mon[32679]: pgmap v17919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:45.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:45 smithi092 ceph-mon[29156]: pgmap v17919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:47.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:47 smithi189 ceph-mon[32756]: pgmap v17920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:47.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:47 smithi156 ceph-mon[32679]: pgmap v17920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:47.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:47 smithi092 ceph-mon[29156]: pgmap v17920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:49 smithi189 ceph-mon[32756]: pgmap v17921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32844.936608 secs 2024-04-27T03:25:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32147.903044 secs 2024-04-27T03:25:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:49 smithi156 ceph-mon[32679]: pgmap v17921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32844.936608 secs 2024-04-27T03:25:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32147.903044 secs 2024-04-27T03:25:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:49 smithi092 ceph-mon[29156]: pgmap v17921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32844.936608 secs 2024-04-27T03:25:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32147.903044 secs 2024-04-27T03:25:51.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:51 smithi189 ceph-mon[32756]: pgmap v17922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:51.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:51 smithi156 ceph-mon[32679]: pgmap v17922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:51.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:51 smithi092 ceph-mon[29156]: pgmap v17922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:53.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:53 smithi189 ceph-mon[32756]: pgmap v17923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:53.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:53 smithi156 ceph-mon[32679]: pgmap v17923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:53.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:53 smithi092 ceph-mon[29156]: pgmap v17923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:54.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32849.936726 secs 2024-04-27T03:25:54.882 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32152.903160 secs 2024-04-27T03:25:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32849.936726 secs 2024-04-27T03:25:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32152.903160 secs 2024-04-27T03:25:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32849.936726 secs 2024-04-27T03:25:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32152.903160 secs 2024-04-27T03:25:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:55 smithi189 ceph-mon[32756]: pgmap v17924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:55 smithi156 ceph-mon[32679]: pgmap v17924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:55 smithi092 ceph-mon[29156]: pgmap v17924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:25:57.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:57 smithi189 ceph-mon[32756]: pgmap v17925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:57.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:57 smithi156 ceph-mon[32679]: pgmap v17925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:57.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:57 smithi092 ceph-mon[29156]: pgmap v17925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:25:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:25:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: pgmap v17926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32854.936819 secs 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32157.903252 secs 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:25:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:25:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:25:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: pgmap v17926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:25:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32854.936819 secs 2024-04-27T03:25:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32157.903252 secs 2024-04-27T03:26:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:26:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:26:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:25:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:26:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: pgmap v17926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32854.936819 secs 2024-04-27T03:26:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32157.903252 secs 2024-04-27T03:26:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:26:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:26:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:25:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:26:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:00 smithi156 ceph-mon[32679]: pgmap v17927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:26:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:00 smithi156 ceph-mon[32679]: pgmap v17928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:00 smithi092 ceph-mon[29156]: pgmap v17927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:26:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:00 smithi092 ceph-mon[29156]: pgmap v17928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:00 smithi189 ceph-mon[32756]: pgmap v17927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:26:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:00 smithi189 ceph-mon[32756]: pgmap v17928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:02 smithi156 ceph-mon[32679]: pgmap v17929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:02 smithi092 ceph-mon[29156]: pgmap v17929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:02 smithi189 ceph-mon[32756]: pgmap v17929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:04 smithi156 ceph-mon[32679]: pgmap v17930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:26:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32859.936958 secs 2024-04-27T03:26:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32162.903376 secs 2024-04-27T03:26:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:04 smithi092 ceph-mon[29156]: pgmap v17930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:26:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32859.936958 secs 2024-04-27T03:26:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32162.903376 secs 2024-04-27T03:26:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:04 smithi189 ceph-mon[32756]: pgmap v17930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:26:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32859.936958 secs 2024-04-27T03:26:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32162.903376 secs 2024-04-27T03:26:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:06 smithi156 ceph-mon[32679]: pgmap v17931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:06 smithi092 ceph-mon[29156]: pgmap v17931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:06 smithi189 ceph-mon[32756]: pgmap v17931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:08 smithi156 ceph-mon[32679]: pgmap v17932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:08 smithi092 ceph-mon[29156]: pgmap v17932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:08 smithi189 ceph-mon[32756]: pgmap v17932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:26:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32864.937079 secs 2024-04-27T03:26:09.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32167.903512 secs 2024-04-27T03:26:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32864.937079 secs 2024-04-27T03:26:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32167.903512 secs 2024-04-27T03:26:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32864.937079 secs 2024-04-27T03:26:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32167.903512 secs 2024-04-27T03:26:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:10 smithi156 ceph-mon[32679]: pgmap v17933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:26:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:10 smithi092 ceph-mon[29156]: pgmap v17933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:26:11.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:10 smithi189 ceph-mon[32756]: pgmap v17933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:26:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:12 smithi156 ceph-mon[32679]: pgmap v17934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:12 smithi092 ceph-mon[29156]: pgmap v17934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:13.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:12 smithi189 ceph-mon[32756]: pgmap v17934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:14 smithi156 ceph-mon[32679]: pgmap v17935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32869.937155 secs 2024-04-27T03:26:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32172.903640 secs 2024-04-27T03:26:14.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:14 smithi189 ceph-mon[32756]: pgmap v17935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:14.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32869.937155 secs 2024-04-27T03:26:14.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32172.903640 secs 2024-04-27T03:26:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:14 smithi092 ceph-mon[29156]: pgmap v17935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32869.937155 secs 2024-04-27T03:26:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32172.903640 secs 2024-04-27T03:26:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:16 smithi156 ceph-mon[32679]: pgmap v17936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:16 smithi092 ceph-mon[29156]: pgmap v17936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:17.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:16 smithi189 ceph-mon[32756]: pgmap v17936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:18 smithi156 ceph-mon[32679]: pgmap v17937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:18.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:18 smithi092 ceph-mon[29156]: pgmap v17937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:19.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:18 smithi189 ceph-mon[32756]: pgmap v17937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:26:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32874.937293 secs 2024-04-27T03:26:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32177.903765 secs 2024-04-27T03:26:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32874.937293 secs 2024-04-27T03:26:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32177.903765 secs 2024-04-27T03:26:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32874.937293 secs 2024-04-27T03:26:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32177.903765 secs 2024-04-27T03:26:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:20 smithi156 ceph-mon[32679]: pgmap v17938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:20 smithi092 ceph-mon[29156]: pgmap v17938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:21.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:20 smithi189 ceph-mon[32756]: pgmap v17938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:26:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:22 smithi156 ceph-mon[32679]: pgmap v17939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:22 smithi092 ceph-mon[29156]: pgmap v17939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:22 smithi189 ceph-mon[32756]: pgmap v17939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:24 smithi092 ceph-mon[29156]: pgmap v17940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32879.937354 secs 2024-04-27T03:26:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32182.903887 secs 2024-04-27T03:26:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:24 smithi189 ceph-mon[32756]: pgmap v17940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32879.937354 secs 2024-04-27T03:26:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32182.903887 secs 2024-04-27T03:26:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:24 smithi156 ceph-mon[32679]: pgmap v17940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32879.937354 secs 2024-04-27T03:26:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32182.903887 secs 2024-04-27T03:26:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:26 smithi092 ceph-mon[29156]: pgmap v17941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:26 smithi189 ceph-mon[32756]: pgmap v17941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:26 smithi156 ceph-mon[32679]: pgmap v17941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:28 smithi092 ceph-mon[29156]: pgmap v17942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:28 smithi189 ceph-mon[32756]: pgmap v17942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:28 smithi156 ceph-mon[32679]: pgmap v17942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32884.937502 secs 2024-04-27T03:26:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32187.903957 secs 2024-04-27T03:26:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32884.937502 secs 2024-04-27T03:26:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32187.903957 secs 2024-04-27T03:26:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32884.937502 secs 2024-04-27T03:26:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32187.903957 secs 2024-04-27T03:26:30.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:30 smithi092 ceph-mon[29156]: pgmap v17943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:30 smithi189 ceph-mon[32756]: pgmap v17943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:30 smithi156 ceph-mon[32679]: pgmap v17943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:32.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:32 smithi092 ceph-mon[29156]: pgmap v17944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:32 smithi189 ceph-mon[32756]: pgmap v17944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:32 smithi156 ceph-mon[32679]: pgmap v17944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:34 smithi092 ceph-mon[29156]: pgmap v17945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32889.937595 secs 2024-04-27T03:26:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32192.904059 secs 2024-04-27T03:26:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:34 smithi189 ceph-mon[32756]: pgmap v17945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32889.937595 secs 2024-04-27T03:26:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32192.904059 secs 2024-04-27T03:26:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:34 smithi156 ceph-mon[32679]: pgmap v17945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32889.937595 secs 2024-04-27T03:26:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32192.904059 secs 2024-04-27T03:26:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:36 smithi092 ceph-mon[29156]: pgmap v17946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:36 smithi189 ceph-mon[32756]: pgmap v17946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:36 smithi156 ceph-mon[32679]: pgmap v17946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:38 smithi092 ceph-mon[29156]: pgmap v17947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:38 smithi189 ceph-mon[32756]: pgmap v17947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:38 smithi156 ceph-mon[32679]: pgmap v17947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32894.937718 secs 2024-04-27T03:26:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32197.904156 secs 2024-04-27T03:26:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32894.937718 secs 2024-04-27T03:26:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32197.904156 secs 2024-04-27T03:26:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32894.937718 secs 2024-04-27T03:26:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32197.904156 secs 2024-04-27T03:26:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:40 smithi092 ceph-mon[29156]: pgmap v17948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:40 smithi189 ceph-mon[32756]: pgmap v17948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:40 smithi156 ceph-mon[32679]: pgmap v17948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:26:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:42 smithi092 ceph-mon[29156]: pgmap v17949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:42 smithi189 ceph-mon[32756]: pgmap v17949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:43.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:42 smithi156 ceph-mon[32679]: pgmap v17949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:44.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:44 smithi156 ceph-mon[32679]: pgmap v17950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:44.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32899.937793 secs 2024-04-27T03:26:44.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32202.904275 secs 2024-04-27T03:26:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:44 smithi092 ceph-mon[29156]: pgmap v17950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32899.937793 secs 2024-04-27T03:26:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32202.904275 secs 2024-04-27T03:26:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:44 smithi189 ceph-mon[32756]: pgmap v17950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32899.937793 secs 2024-04-27T03:26:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32202.904275 secs 2024-04-27T03:26:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:46 smithi092 ceph-mon[29156]: pgmap v17951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:46 smithi189 ceph-mon[32756]: pgmap v17951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:46 smithi156 ceph-mon[32679]: pgmap v17951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:47 smithi156 ceph-mon[32679]: pgmap v17952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:48.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:47 smithi092 ceph-mon[29156]: pgmap v17952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:48.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:47 smithi189 ceph-mon[32756]: pgmap v17952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:49.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32207.904379 secs 2024-04-27T03:26:49.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32207.904379 secs 2024-04-27T03:26:49.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32207.904379 secs 2024-04-27T03:26:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32904.937912 secs 2024-04-27T03:26:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:50 smithi156 ceph-mon[32679]: pgmap v17953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:50.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32904.937912 secs 2024-04-27T03:26:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:50 smithi092 ceph-mon[29156]: pgmap v17953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32904.937912 secs 2024-04-27T03:26:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:50 smithi189 ceph-mon[32756]: pgmap v17953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:52.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:52 smithi189 ceph-mon[32756]: pgmap v17954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:52.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:52 smithi156 ceph-mon[32679]: pgmap v17954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:52.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:52 smithi092 ceph-mon[29156]: pgmap v17954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:54 smithi189 ceph-mon[32756]: pgmap v17955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32909.937994 secs 2024-04-27T03:26:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32212.904497 secs 2024-04-27T03:26:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:54 smithi156 ceph-mon[32679]: pgmap v17955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32909.937994 secs 2024-04-27T03:26:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32212.904497 secs 2024-04-27T03:26:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:54 smithi092 ceph-mon[29156]: pgmap v17955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:26:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32909.937994 secs 2024-04-27T03:26:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32212.904497 secs 2024-04-27T03:26:56.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:56 smithi189 ceph-mon[32756]: pgmap v17956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:56.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:56 smithi156 ceph-mon[32679]: pgmap v17956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:56.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:56 smithi092 ceph-mon[29156]: pgmap v17956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:26:58.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:58 smithi189 ceph-mon[32756]: pgmap v17957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:58.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:58 smithi156 ceph-mon[32679]: pgmap v17957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:58.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:58 smithi092 ceph-mon[29156]: pgmap v17957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:26:59.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32914.938110 secs 2024-04-27T03:26:59.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:26:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32217.904608 secs 2024-04-27T03:26:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32914.938110 secs 2024-04-27T03:26:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:26:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32217.904608 secs 2024-04-27T03:26:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32914.938110 secs 2024-04-27T03:26:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:26:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32217.904608 secs 2024-04-27T03:27:00.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:00 smithi189 ceph-mon[32756]: pgmap v17958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:27:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:27:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:27:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:27:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:00 smithi156 ceph-mon[32679]: pgmap v17958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:27:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:27:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:27:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:27:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:00 smithi092 ceph-mon[29156]: pgmap v17958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:27:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:27:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:27:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:27:01.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:01 smithi189 ceph-mon[32756]: pgmap v17959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:27:01.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:01 smithi189 ceph-mon[32756]: pgmap v17960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:01.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:01 smithi156 ceph-mon[32679]: pgmap v17959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:27:01.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:01 smithi156 ceph-mon[32679]: pgmap v17960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:01 smithi092 ceph-mon[29156]: pgmap v17959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:27:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:01 smithi092 ceph-mon[29156]: pgmap v17960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:03.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:03 smithi189 ceph-mon[32756]: pgmap v17961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:03.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:03 smithi156 ceph-mon[32679]: pgmap v17961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:03.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:03 smithi092 ceph-mon[29156]: pgmap v17961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:04.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32919.938221 secs 2024-04-27T03:27:04.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32222.904729 secs 2024-04-27T03:27:04.650 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32919.938221 secs 2024-04-27T03:27:04.650 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32222.904729 secs 2024-04-27T03:27:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32919.938221 secs 2024-04-27T03:27:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32222.904729 secs 2024-04-27T03:27:05.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:05 smithi189 ceph-mon[32756]: pgmap v17962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:05.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:05 smithi156 ceph-mon[32679]: pgmap v17962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:05.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:05 smithi092 ceph-mon[29156]: pgmap v17962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:07.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:07 smithi189 ceph-mon[32756]: pgmap v17963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:07.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:07 smithi156 ceph-mon[32679]: pgmap v17963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:07.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:07 smithi092 ceph-mon[29156]: pgmap v17963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:27:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:09 smithi189 ceph-mon[32756]: pgmap v17964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:27:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32924.938341 secs 2024-04-27T03:27:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32227.904845 secs 2024-04-27T03:27:09.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-mon[29156]: pgmap v17964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:27:09.648 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32924.938341 secs 2024-04-27T03:27:09.649 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32227.904845 secs 2024-04-27T03:27:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:09 smithi156 ceph-mon[32679]: pgmap v17964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:27:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32924.938341 secs 2024-04-27T03:27:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32227.904845 secs 2024-04-27T03:27:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:27:09.641+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:27:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:27:09.641+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:27:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:27:09.641+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:27:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:27:09.641+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:27:10.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:27:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:27:09.641+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:27:11.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:11 smithi189 ceph-mon[32756]: pgmap v17965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:27:11.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:11 smithi156 ceph-mon[32679]: pgmap v17965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:27:11.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:11 smithi092 ceph-mon[29156]: pgmap v17965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:27:13.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:13 smithi189 ceph-mon[32756]: pgmap v17966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:13.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:13 smithi156 ceph-mon[32679]: pgmap v17966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:13.730 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:13 smithi092 ceph-mon[29156]: pgmap v17966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32929.938464 secs 2024-04-27T03:27:14.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32232.904983 secs 2024-04-27T03:27:14.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32929.938464 secs 2024-04-27T03:27:14.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32232.904983 secs 2024-04-27T03:27:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32929.938464 secs 2024-04-27T03:27:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32232.904983 secs 2024-04-27T03:27:15.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:15 smithi189 ceph-mon[32756]: pgmap v17967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:15.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:15 smithi156 ceph-mon[32679]: pgmap v17967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:15.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:15 smithi092 ceph-mon[29156]: pgmap v17967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:17.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:17 smithi189 ceph-mon[32756]: pgmap v17968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:17.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:17 smithi156 ceph-mon[32679]: pgmap v17968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:17.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:17 smithi092 ceph-mon[29156]: pgmap v17968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:19.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:19 smithi189 ceph-mon[32756]: pgmap v17969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:19.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32934.938605 secs 2024-04-27T03:27:19.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32237.905046 secs 2024-04-27T03:27:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:19 smithi156 ceph-mon[32679]: pgmap v17969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32934.938605 secs 2024-04-27T03:27:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32237.905046 secs 2024-04-27T03:27:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:19 smithi092 ceph-mon[29156]: pgmap v17969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32934.938605 secs 2024-04-27T03:27:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32237.905046 secs 2024-04-27T03:27:21.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:21 smithi189 ceph-mon[32756]: pgmap v17970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:21.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:21 smithi156 ceph-mon[32679]: pgmap v17970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:21 smithi092 ceph-mon[29156]: pgmap v17970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:23.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:23 smithi189 ceph-mon[32756]: pgmap v17971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:23.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:23 smithi156 ceph-mon[32679]: pgmap v17971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:23.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:23 smithi092 ceph-mon[29156]: pgmap v17971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:27:24.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32939.938742 secs 2024-04-27T03:27:24.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32242.905187 secs 2024-04-27T03:27:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32939.938742 secs 2024-04-27T03:27:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32242.905187 secs 2024-04-27T03:27:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32939.938742 secs 2024-04-27T03:27:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32242.905187 secs 2024-04-27T03:27:25.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:25 smithi156 ceph-mon[32679]: pgmap v17972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:25.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:25 smithi092 ceph-mon[29156]: pgmap v17972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:25.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:25 smithi189 ceph-mon[32756]: pgmap v17972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:27:27.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:27 smithi156 ceph-mon[32679]: pgmap v17973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:27.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:27 smithi092 ceph-mon[29156]: pgmap v17973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:27.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:27 smithi189 ceph-mon[32756]: pgmap v17973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:29 smithi156 ceph-mon[32679]: pgmap v17974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32944.938898 secs 2024-04-27T03:27:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32247.905321 secs 2024-04-27T03:27:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:29 smithi092 ceph-mon[29156]: pgmap v17974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32944.938898 secs 2024-04-27T03:27:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32247.905321 secs 2024-04-27T03:27:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:29 smithi189 ceph-mon[32756]: pgmap v17974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32944.938898 secs 2024-04-27T03:27:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32247.905321 secs 2024-04-27T03:27:31.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:31 smithi156 ceph-mon[32679]: pgmap v17975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:31.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:31 smithi092 ceph-mon[29156]: pgmap v17975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:31.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:31 smithi189 ceph-mon[32756]: pgmap v17975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:33.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:33 smithi156 ceph-mon[32679]: pgmap v17976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:33.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:33 smithi092 ceph-mon[29156]: pgmap v17976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:33.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:33 smithi189 ceph-mon[32756]: pgmap v17976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:34.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32949.939034 secs 2024-04-27T03:27:34.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32252.905439 secs 2024-04-27T03:27:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32949.939034 secs 2024-04-27T03:27:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32252.905439 secs 2024-04-27T03:27:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32949.939034 secs 2024-04-27T03:27:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32252.905439 secs 2024-04-27T03:27:35.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:35 smithi156 ceph-mon[32679]: pgmap v17977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:35.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:35 smithi092 ceph-mon[29156]: pgmap v17977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:35 smithi189 ceph-mon[32756]: pgmap v17977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:37.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:37 smithi156 ceph-mon[32679]: pgmap v17978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:37.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:37 smithi092 ceph-mon[29156]: pgmap v17978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:37.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:37 smithi189 ceph-mon[32756]: pgmap v17978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:39 smithi156 ceph-mon[32679]: pgmap v17979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32954.939157 secs 2024-04-27T03:27:39.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32257.905557 secs 2024-04-27T03:27:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:39 smithi092 ceph-mon[29156]: pgmap v17979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32954.939157 secs 2024-04-27T03:27:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32257.905557 secs 2024-04-27T03:27:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:39 smithi189 ceph-mon[32756]: pgmap v17979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32954.939157 secs 2024-04-27T03:27:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32257.905557 secs 2024-04-27T03:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:27:40.509+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:27:40.509+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:27:40.509+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:27:40.509+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 254 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:27:41.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:41 smithi156 ceph-mon[32679]: pgmap v17980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:41.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:41 smithi092 ceph-mon[29156]: pgmap v17980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:41.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:41 smithi189 ceph-mon[32756]: pgmap v17980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:43.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:43 smithi156 ceph-mon[32679]: pgmap v17981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:43.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:43 smithi092 ceph-mon[29156]: pgmap v17981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:43.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:43 smithi189 ceph-mon[32756]: pgmap v17981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32959.939274 secs 2024-04-27T03:27:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32262.905633 secs 2024-04-27T03:27:44.794 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32959.939274 secs 2024-04-27T03:27:44.794 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32262.905633 secs 2024-04-27T03:27:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32959.939274 secs 2024-04-27T03:27:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32262.905633 secs 2024-04-27T03:27:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:45 smithi092 ceph-mon[29156]: pgmap v17982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:45.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:45 smithi189 ceph-mon[32756]: pgmap v17982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:45.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:45 smithi156 ceph-mon[32679]: pgmap v17982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:47.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:47 smithi092 ceph-mon[29156]: pgmap v17983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:47.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:47 smithi189 ceph-mon[32756]: pgmap v17983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:47.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:47 smithi156 ceph-mon[32679]: pgmap v17983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:49 smithi092 ceph-mon[29156]: pgmap v17984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32964.939398 secs 2024-04-27T03:27:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32267.905695 secs 2024-04-27T03:27:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:49 smithi189 ceph-mon[32756]: pgmap v17984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32964.939398 secs 2024-04-27T03:27:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32267.905695 secs 2024-04-27T03:27:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:49 smithi156 ceph-mon[32679]: pgmap v17984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32964.939398 secs 2024-04-27T03:27:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32267.905695 secs 2024-04-27T03:27:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:51 smithi092 ceph-mon[29156]: pgmap v17985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:51.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:51 smithi189 ceph-mon[32756]: pgmap v17985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:51.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:51 smithi156 ceph-mon[32679]: pgmap v17985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:53.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:53 smithi092 ceph-mon[29156]: pgmap v17986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:53.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:53 smithi189 ceph-mon[32756]: pgmap v17986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:53.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:53 smithi156 ceph-mon[32679]: pgmap v17986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32969.939534 secs 2024-04-27T03:27:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32272.905815 secs 2024-04-27T03:27:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32969.939534 secs 2024-04-27T03:27:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32272.905815 secs 2024-04-27T03:27:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32969.939534 secs 2024-04-27T03:27:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32272.905815 secs 2024-04-27T03:27:55.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:55 smithi092 ceph-mon[29156]: pgmap v17987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:55 smithi189 ceph-mon[32756]: pgmap v17987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:55 smithi156 ceph-mon[32679]: pgmap v17987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:27:57.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:57 smithi092 ceph-mon[29156]: pgmap v17988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:57.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:57 smithi189 ceph-mon[32756]: pgmap v17988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:57.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:57 smithi156 ceph-mon[32679]: pgmap v17988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:59 smithi092 ceph-mon[29156]: pgmap v17989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32974.939644 secs 2024-04-27T03:27:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:27:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32277.905925 secs 2024-04-27T03:27:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:59 smithi189 ceph-mon[32756]: pgmap v17989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32974.939644 secs 2024-04-27T03:27:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:27:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32277.905925 secs 2024-04-27T03:27:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:59 smithi156 ceph-mon[32679]: pgmap v17989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:27:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32974.939644 secs 2024-04-27T03:27:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:27:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32277.905925 secs 2024-04-27T03:28:00.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:28:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:28:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:28:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:01 smithi092 ceph-mon[29156]: pgmap v17990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:28:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:28:01.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:28:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:01 smithi189 ceph-mon[32756]: pgmap v17990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:28:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:28:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:28:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:01 smithi156 ceph-mon[32679]: pgmap v17990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:28:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:28:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:28:02.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:02 smithi092 ceph-mon[29156]: pgmap v17991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:28:02.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:02 smithi092 ceph-mon[29156]: pgmap v17992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:28:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:02 smithi189 ceph-mon[32756]: pgmap v17991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:28:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:02 smithi189 ceph-mon[32756]: pgmap v17992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:28:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:02 smithi156 ceph-mon[32679]: pgmap v17991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:28:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:02 smithi156 ceph-mon[32679]: pgmap v17992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:28:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:04 smithi092 ceph-mon[29156]: pgmap v17993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:28:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32979.939761 secs 2024-04-27T03:28:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32282.906049 secs 2024-04-27T03:28:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:04 smithi189 ceph-mon[32756]: pgmap v17993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:28:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32979.939761 secs 2024-04-27T03:28:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32282.906049 secs 2024-04-27T03:28:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:04 smithi156 ceph-mon[32679]: pgmap v17993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:28:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32979.939761 secs 2024-04-27T03:28:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32282.906049 secs 2024-04-27T03:28:06.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:06 smithi092 ceph-mon[29156]: pgmap v17994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:06 smithi189 ceph-mon[32756]: pgmap v17994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:06 smithi156 ceph-mon[32679]: pgmap v17994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:08.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:08 smithi092 ceph-mon[29156]: pgmap v17995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:08.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:08 smithi189 ceph-mon[32756]: pgmap v17995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:08 smithi156 ceph-mon[32679]: pgmap v17995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32984.939892 secs 2024-04-27T03:28:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:09 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 32287.906169 secs 2024-04-27T03:28:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:09 smithi092 ceph-mon[29156]: slow request 2880.164827 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:28:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32984.939892 secs 2024-04-27T03:28:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:09 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 32287.906169 secs 2024-04-27T03:28:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:09 smithi189 ceph-mon[32756]: slow request 2880.164827 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:28:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32984.939892 secs 2024-04-27T03:28:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:09 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 32287.906169 secs 2024-04-27T03:28:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:09 smithi156 ceph-mon[32679]: slow request 2880.164827 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:28:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:10 smithi092 ceph-mon[29156]: pgmap v17996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:10 smithi189 ceph-mon[32756]: pgmap v17996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:10 smithi156 ceph-mon[32679]: pgmap v17996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:12 smithi189 ceph-mon[32756]: pgmap v17997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T03:28:12.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:12 smithi156 ceph-mon[32679]: pgmap v17997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T03:28:12.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:12 smithi092 ceph-mon[29156]: pgmap v17997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T03:28:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:14 smithi189 ceph-mon[32756]: pgmap v17998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:28:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32989.940012 secs 2024-04-27T03:28:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32292.906243 secs 2024-04-27T03:28:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:14 smithi156 ceph-mon[32679]: pgmap v17998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:28:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32989.940012 secs 2024-04-27T03:28:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32292.906243 secs 2024-04-27T03:28:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:14 smithi092 ceph-mon[29156]: pgmap v17998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:28:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32989.940012 secs 2024-04-27T03:28:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32292.906243 secs 2024-04-27T03:28:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:16 smithi189 ceph-mon[32756]: pgmap v17999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:16 smithi156 ceph-mon[32679]: pgmap v17999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:16 smithi092 ceph-mon[29156]: pgmap v17999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:28:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:18 smithi189 ceph-mon[32756]: pgmap v18000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:18 smithi156 ceph-mon[32679]: pgmap v18000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:18.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:18 smithi092 ceph-mon[29156]: pgmap v18000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32994.940129 secs 2024-04-27T03:28:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32297.906365 secs 2024-04-27T03:28:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32994.940129 secs 2024-04-27T03:28:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32297.906365 secs 2024-04-27T03:28:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32994.940129 secs 2024-04-27T03:28:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32297.906365 secs 2024-04-27T03:28:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:20 smithi189 ceph-mon[32756]: pgmap v18001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:20 smithi156 ceph-mon[32679]: pgmap v18001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:20 smithi092 ceph-mon[29156]: pgmap v18001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:22 smithi189 ceph-mon[32756]: pgmap v18002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:22 smithi156 ceph-mon[32679]: pgmap v18002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:22 smithi092 ceph-mon[29156]: pgmap v18002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:24 smithi189 ceph-mon[32756]: pgmap v18003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 32999.940207 secs 2024-04-27T03:28:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32302.906484 secs 2024-04-27T03:28:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:24 smithi156 ceph-mon[32679]: pgmap v18003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 32999.940207 secs 2024-04-27T03:28:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32302.906484 secs 2024-04-27T03:28:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:24 smithi092 ceph-mon[29156]: pgmap v18003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 32999.940207 secs 2024-04-27T03:28:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32302.906484 secs 2024-04-27T03:28:26.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:26 smithi189 ceph-mon[32756]: pgmap v18004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:26 smithi156 ceph-mon[32679]: pgmap v18004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:26.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:26 smithi092 ceph-mon[29156]: pgmap v18004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:28 smithi189 ceph-mon[32756]: pgmap v18005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:28 smithi156 ceph-mon[32679]: pgmap v18005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:28 smithi092 ceph-mon[29156]: pgmap v18005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33004.940323 secs 2024-04-27T03:28:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32307.906575 secs 2024-04-27T03:28:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33004.940323 secs 2024-04-27T03:28:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32307.906575 secs 2024-04-27T03:28:29.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33004.940323 secs 2024-04-27T03:28:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32307.906575 secs 2024-04-27T03:28:30.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:30 smithi189 ceph-mon[32756]: pgmap v18006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:30 smithi156 ceph-mon[32679]: pgmap v18006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:30.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:30 smithi092 ceph-mon[29156]: pgmap v18006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:32.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:32 smithi189 ceph-mon[32756]: pgmap v18007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:32 smithi156 ceph-mon[32679]: pgmap v18007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:32.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:32 smithi092 ceph-mon[29156]: pgmap v18007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:34.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:34 smithi092 ceph-mon[29156]: pgmap v18008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:34.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33009.940438 secs 2024-04-27T03:28:34.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32312.906656 secs 2024-04-27T03:28:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:34 smithi189 ceph-mon[32756]: pgmap v18008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33009.940438 secs 2024-04-27T03:28:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32312.906656 secs 2024-04-27T03:28:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:34 smithi156 ceph-mon[32679]: pgmap v18008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33009.940438 secs 2024-04-27T03:28:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32312.906656 secs 2024-04-27T03:28:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:36 smithi189 ceph-mon[32756]: pgmap v18009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:36 smithi156 ceph-mon[32679]: pgmap v18009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:36 smithi092 ceph-mon[29156]: pgmap v18009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:38.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:38 smithi189 ceph-mon[32756]: pgmap v18010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:38 smithi156 ceph-mon[32679]: pgmap v18010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:38.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:38 smithi092 ceph-mon[29156]: pgmap v18010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33014.940544 secs 2024-04-27T03:28:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32317.906781 secs 2024-04-27T03:28:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33014.940544 secs 2024-04-27T03:28:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32317.906781 secs 2024-04-27T03:28:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33014.940544 secs 2024-04-27T03:28:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32317.906781 secs 2024-04-27T03:28:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:40 smithi189 ceph-mon[32756]: pgmap v18011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:40 smithi156 ceph-mon[32679]: pgmap v18011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:40.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:40 smithi092 ceph-mon[29156]: pgmap v18011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:42.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:42 smithi189 ceph-mon[32756]: pgmap v18012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:42 smithi156 ceph-mon[32679]: pgmap v18012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:42.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:42 smithi092 ceph-mon[29156]: pgmap v18012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:44 smithi189 ceph-mon[32756]: pgmap v18013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33019.940693 secs 2024-04-27T03:28:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32322.906915 secs 2024-04-27T03:28:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:44 smithi156 ceph-mon[32679]: pgmap v18013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33019.940693 secs 2024-04-27T03:28:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32322.906915 secs 2024-04-27T03:28:44.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:44 smithi092 ceph-mon[29156]: pgmap v18013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33019.940693 secs 2024-04-27T03:28:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32322.906915 secs 2024-04-27T03:28:46.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:46 smithi189 ceph-mon[32756]: pgmap v18014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:46.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:46 smithi156 ceph-mon[32679]: pgmap v18014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:46 smithi092 ceph-mon[29156]: pgmap v18014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:48.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:48 smithi189 ceph-mon[32756]: pgmap v18015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:48.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:48 smithi156 ceph-mon[32679]: pgmap v18015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:48.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:48 smithi092 ceph-mon[29156]: pgmap v18015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33024.940853 secs 2024-04-27T03:28:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32327.906976 secs 2024-04-27T03:28:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33024.940853 secs 2024-04-27T03:28:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32327.906976 secs 2024-04-27T03:28:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33024.940853 secs 2024-04-27T03:28:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32327.906976 secs 2024-04-27T03:28:50.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:50 smithi189 ceph-mon[32756]: pgmap v18016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:50 smithi156 ceph-mon[32679]: pgmap v18016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:50 smithi092 ceph-mon[29156]: pgmap v18016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:52.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:52 smithi189 ceph-mon[32756]: pgmap v18017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:52.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:52 smithi156 ceph-mon[32679]: pgmap v18017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:52 smithi092 ceph-mon[29156]: pgmap v18017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:54 smithi189 ceph-mon[32756]: pgmap v18018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33029.940982 secs 2024-04-27T03:28:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32332.907052 secs 2024-04-27T03:28:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:54 smithi156 ceph-mon[32679]: pgmap v18018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33029.940982 secs 2024-04-27T03:28:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32332.907052 secs 2024-04-27T03:28:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:54 smithi092 ceph-mon[29156]: pgmap v18018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33029.940982 secs 2024-04-27T03:28:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32332.907052 secs 2024-04-27T03:28:56.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:56 smithi189 ceph-mon[32756]: pgmap v18019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:56.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:56 smithi156 ceph-mon[32679]: pgmap v18019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:56 smithi092 ceph-mon[29156]: pgmap v18019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:28:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:58 smithi189 ceph-mon[32756]: pgmap v18020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:58 smithi156 ceph-mon[32679]: pgmap v18020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:58.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:58 smithi092 ceph-mon[29156]: pgmap v18020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:28:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33034.941098 secs 2024-04-27T03:28:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:28:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32337.907172 secs 2024-04-27T03:28:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33034.941098 secs 2024-04-27T03:28:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:28:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32337.907172 secs 2024-04-27T03:28:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33034.941098 secs 2024-04-27T03:28:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:28:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32337.907172 secs 2024-04-27T03:29:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:00 smithi189 ceph-mon[32756]: pgmap v18021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:00.942 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:00 smithi156 ceph-mon[32679]: pgmap v18021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:00 smithi092 ceph-mon[29156]: pgmap v18021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:29:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:29:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:29:01.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:29:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:29:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:29:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:29:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:29:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:29:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:02 smithi189 ceph-mon[32756]: pgmap v18022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:02.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:02 smithi189 ceph-mon[32756]: pgmap v18023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:29:02.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:02 smithi189 ceph-mon[32756]: pgmap v18024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:02.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:29:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:02 smithi156 ceph-mon[32679]: pgmap v18022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:02 smithi156 ceph-mon[32679]: pgmap v18023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:29:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:02 smithi156 ceph-mon[32679]: pgmap v18024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:29:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:02 smithi092 ceph-mon[29156]: pgmap v18022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:02 smithi092 ceph-mon[29156]: pgmap v18023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:29:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:02 smithi092 ceph-mon[29156]: pgmap v18024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:29:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:04 smithi189 ceph-mon[32756]: pgmap v18025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33039.941217 secs 2024-04-27T03:29:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:04 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 32342.907314 secs 2024-04-27T03:29:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:04 smithi189 ceph-mon[32756]: slow request 23040.543393 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:04 smithi156 ceph-mon[32679]: pgmap v18025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33039.941217 secs 2024-04-27T03:29:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:04 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 32342.907314 secs 2024-04-27T03:29:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:04 smithi156 ceph-mon[32679]: slow request 23040.543393 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:04 smithi092 ceph-mon[29156]: pgmap v18025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33039.941217 secs 2024-04-27T03:29:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:04 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 32342.907314 secs 2024-04-27T03:29:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:04 smithi092 ceph-mon[29156]: slow request 23040.543393 seconds old, received at 2024-04-26T21:05:03.509954+0000: client_request(client.17028:1 getattr pAsLsXsFs #0x1 2024-04-26T21:05:03.505955+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:06 smithi189 ceph-mon[32756]: pgmap v18026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:06 smithi156 ceph-mon[32679]: pgmap v18026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:06 smithi092 ceph-mon[29156]: pgmap v18026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:08.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:08 smithi189 ceph-mon[32756]: pgmap v18027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:29:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:08 smithi156 ceph-mon[32679]: pgmap v18027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:29:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:08 smithi092 ceph-mon[29156]: pgmap v18027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:29:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33044.941297 secs 2024-04-27T03:29:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:09 smithi189 ceph-mon[32756]: 24 slow requests, 1 included below; oldest blocked for > 32347.907394 secs 2024-04-27T03:29:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:09 smithi189 ceph-mon[32756]: slow request 5760.940229 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33044.941297 secs 2024-04-27T03:29:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:09 smithi156 ceph-mon[32679]: 24 slow requests, 1 included below; oldest blocked for > 32347.907394 secs 2024-04-27T03:29:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:09 smithi156 ceph-mon[32679]: slow request 5760.940229 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33044.941297 secs 2024-04-27T03:29:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:09 smithi092 ceph-mon[29156]: 24 slow requests, 1 included below; oldest blocked for > 32347.907394 secs 2024-04-27T03:29:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:09 smithi092 ceph-mon[29156]: slow request 5760.940229 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:29:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:10 smithi189 ceph-mon[32756]: pgmap v18028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:10 smithi156 ceph-mon[32679]: pgmap v18028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:10.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:10 smithi092 ceph-mon[29156]: pgmap v18028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:29:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:12 smithi189 ceph-mon[32756]: pgmap v18029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:29:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:12 smithi156 ceph-mon[32679]: pgmap v18029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:29:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:12 smithi092 ceph-mon[29156]: pgmap v18029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:29:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:14 smithi189 ceph-mon[32756]: pgmap v18030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33049.941417 secs 2024-04-27T03:29:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:14 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32352.907514 secs 2024-04-27T03:29:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:14 smithi156 ceph-mon[32679]: pgmap v18030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33049.941417 secs 2024-04-27T03:29:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:14 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32352.907514 secs 2024-04-27T03:29:14.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:14 smithi092 ceph-mon[29156]: pgmap v18030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33049.941417 secs 2024-04-27T03:29:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:14 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32352.907514 secs 2024-04-27T03:29:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:16 smithi189 ceph-mon[32756]: pgmap v18031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:16 smithi156 ceph-mon[32679]: pgmap v18031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:16 smithi092 ceph-mon[29156]: pgmap v18031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:18 smithi156 ceph-mon[32679]: pgmap v18032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:18.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:18 smithi092 ceph-mon[29156]: pgmap v18032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:19.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:18 smithi189 ceph-mon[32756]: pgmap v18032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33054.941553 secs 2024-04-27T03:29:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:19 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32357.907634 secs 2024-04-27T03:29:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33054.941553 secs 2024-04-27T03:29:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:19 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32357.907634 secs 2024-04-27T03:29:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33054.941553 secs 2024-04-27T03:29:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:19 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32357.907634 secs 2024-04-27T03:29:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:20 smithi156 ceph-mon[32679]: pgmap v18033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:20 smithi092 ceph-mon[29156]: pgmap v18033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:21.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:20 smithi189 ceph-mon[32756]: pgmap v18033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:22 smithi156 ceph-mon[32679]: pgmap v18034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:22 smithi092 ceph-mon[29156]: pgmap v18034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:22 smithi189 ceph-mon[32756]: pgmap v18034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:24 smithi156 ceph-mon[32679]: pgmap v18035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33059.941651 secs 2024-04-27T03:29:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:24 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32362.907758 secs 2024-04-27T03:29:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:24 smithi092 ceph-mon[29156]: pgmap v18035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33059.941651 secs 2024-04-27T03:29:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:24 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32362.907758 secs 2024-04-27T03:29:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:24 smithi189 ceph-mon[32756]: pgmap v18035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33059.941651 secs 2024-04-27T03:29:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:24 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32362.907758 secs 2024-04-27T03:29:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:26 smithi156 ceph-mon[32679]: pgmap v18036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:26 smithi092 ceph-mon[29156]: pgmap v18036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:26 smithi189 ceph-mon[32756]: pgmap v18036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:28 smithi156 ceph-mon[32679]: pgmap v18037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:28 smithi092 ceph-mon[29156]: pgmap v18037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:28 smithi189 ceph-mon[32756]: pgmap v18037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33064.941795 secs 2024-04-27T03:29:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:29 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32367.907885 secs 2024-04-27T03:29:29.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33064.941795 secs 2024-04-27T03:29:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:29 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32367.907885 secs 2024-04-27T03:29:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33064.941795 secs 2024-04-27T03:29:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:29 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32367.907885 secs 2024-04-27T03:29:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:30 smithi156 ceph-mon[32679]: pgmap v18038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:30.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:30 smithi092 ceph-mon[29156]: pgmap v18038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:30 smithi189 ceph-mon[32756]: pgmap v18038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:32 smithi156 ceph-mon[32679]: pgmap v18039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:32 smithi092 ceph-mon[29156]: pgmap v18039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:32 smithi189 ceph-mon[32756]: pgmap v18039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:34 smithi156 ceph-mon[32679]: pgmap v18040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33069.941922 secs 2024-04-27T03:29:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:34 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32372.907994 secs 2024-04-27T03:29:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:34 smithi092 ceph-mon[29156]: pgmap v18040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33069.941922 secs 2024-04-27T03:29:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:34 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32372.907994 secs 2024-04-27T03:29:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:34 smithi189 ceph-mon[32756]: pgmap v18040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33069.941922 secs 2024-04-27T03:29:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:34 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32372.907994 secs 2024-04-27T03:29:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:36 smithi156 ceph-mon[32679]: pgmap v18041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:36 smithi092 ceph-mon[29156]: pgmap v18041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:36 smithi189 ceph-mon[32756]: pgmap v18041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:38 smithi156 ceph-mon[32679]: pgmap v18042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:38.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:38 smithi092 ceph-mon[29156]: pgmap v18042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:38 smithi189 ceph-mon[32756]: pgmap v18042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33074.942067 secs 2024-04-27T03:29:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:39 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32377.908070 secs 2024-04-27T03:29:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33074.942067 secs 2024-04-27T03:29:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:39 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32377.908070 secs 2024-04-27T03:29:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33074.942067 secs 2024-04-27T03:29:40.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:39 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32377.908070 secs 2024-04-27T03:29:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:40 smithi092 ceph-mon[29156]: pgmap v18043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:40 smithi189 ceph-mon[32756]: pgmap v18043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:40 smithi156 ceph-mon[32679]: pgmap v18043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:42 smithi092 ceph-mon[29156]: pgmap v18044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:42 smithi189 ceph-mon[32756]: pgmap v18044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:43.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:42 smithi156 ceph-mon[32679]: pgmap v18044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:44.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:44 smithi189 ceph-mon[32756]: pgmap v18045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:44.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33079.942125 secs 2024-04-27T03:29:44.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:44 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32382.908161 secs 2024-04-27T03:29:44.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:44 smithi156 ceph-mon[32679]: pgmap v18045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:44.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33079.942125 secs 2024-04-27T03:29:44.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:44 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32382.908161 secs 2024-04-27T03:29:44.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:44 smithi092 ceph-mon[29156]: pgmap v18045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:44.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33079.942125 secs 2024-04-27T03:29:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:44 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32382.908161 secs 2024-04-27T03:29:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:46 smithi092 ceph-mon[29156]: pgmap v18046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:46 smithi189 ceph-mon[32756]: pgmap v18046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:46 smithi156 ceph-mon[32679]: pgmap v18046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:48.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:48 smithi092 ceph-mon[29156]: pgmap v18047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:49.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:48 smithi189 ceph-mon[32756]: pgmap v18047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:48 smithi156 ceph-mon[32679]: pgmap v18047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33084.942191 secs 2024-04-27T03:29:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:49 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32387.908261 secs 2024-04-27T03:29:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33084.942191 secs 2024-04-27T03:29:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:49 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32387.908261 secs 2024-04-27T03:29:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33084.942191 secs 2024-04-27T03:29:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:49 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32387.908261 secs 2024-04-27T03:29:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:50 smithi092 ceph-mon[29156]: pgmap v18048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:51.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:50 smithi189 ceph-mon[32756]: pgmap v18048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:51.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:50 smithi156 ceph-mon[32679]: pgmap v18048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:52 smithi092 ceph-mon[29156]: pgmap v18049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:53.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:52 smithi189 ceph-mon[32756]: pgmap v18049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:52 smithi156 ceph-mon[32679]: pgmap v18049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:55.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:54 smithi092 ceph-mon[29156]: pgmap v18050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:55.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33089.942282 secs 2024-04-27T03:29:55.002 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:54 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32392.908367 secs 2024-04-27T03:29:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:54 smithi189 ceph-mon[32756]: pgmap v18050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33089.942282 secs 2024-04-27T03:29:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:54 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32392.908367 secs 2024-04-27T03:29:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:54 smithi156 ceph-mon[32679]: pgmap v18050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:29:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33089.942282 secs 2024-04-27T03:29:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:54 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32392.908367 secs 2024-04-27T03:29:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:56 smithi092 ceph-mon[29156]: pgmap v18051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:57.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:56 smithi189 ceph-mon[32756]: pgmap v18051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:57.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:56 smithi156 ceph-mon[32679]: pgmap v18051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:58 smithi092 ceph-mon[29156]: pgmap v18052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:58 smithi189 ceph-mon[32756]: pgmap v18052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:58 smithi156 ceph-mon[32679]: pgmap v18052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:29:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33094.942410 secs 2024-04-27T03:29:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:29:59 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32397.908513 secs 2024-04-27T03:30:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33094.942410 secs 2024-04-27T03:30:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:29:59 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32397.908513 secs 2024-04-27T03:30:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33094.942410 secs 2024-04-27T03:30:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:29:59 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32397.908513 secs 2024-04-27T03:30:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:00 smithi092 ceph-mon[29156]: pgmap v18053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:30:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:00 smithi189 ceph-mon[32756]: pgmap v18053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:30:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:00 smithi156 ceph-mon[32679]: pgmap v18053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:30:01.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:30:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:30:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:30:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:02 smithi092 ceph-mon[29156]: pgmap v18054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:30:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:30:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:30:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:02 smithi189 ceph-mon[32756]: pgmap v18054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:30:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:30:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:30:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:02 smithi156 ceph-mon[32679]: pgmap v18054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:30:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:30:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:30:03.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:03 smithi092 ceph-mon[29156]: pgmap v18055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:04.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:03 smithi189 ceph-mon[32756]: pgmap v18055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:04.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:03 smithi156 ceph-mon[32679]: pgmap v18055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:04.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33099.942529 secs 2024-04-27T03:30:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:04 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32402.908616 secs 2024-04-27T03:30:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33099.942529 secs 2024-04-27T03:30:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:04 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32402.908616 secs 2024-04-27T03:30:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33099.942529 secs 2024-04-27T03:30:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:04 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32402.908616 secs 2024-04-27T03:30:06.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:05 smithi189 ceph-mon[32756]: pgmap v18056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:06.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:05 smithi156 ceph-mon[32679]: pgmap v18056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:06.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:05 smithi092 ceph-mon[29156]: pgmap v18056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:07 smithi189 ceph-mon[32756]: pgmap v18057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:07 smithi156 ceph-mon[32679]: pgmap v18057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:08.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:07 smithi092 ceph-mon[29156]: pgmap v18057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:09 smithi189 ceph-mon[32756]: pgmap v18058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33104.942653 secs 2024-04-27T03:30:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:09 smithi189 ceph-mon[32756]: 24 slow requests, 0 included below; oldest blocked for > 32407.908753 secs 2024-04-27T03:30:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:09 smithi156 ceph-mon[32679]: pgmap v18058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33104.942653 secs 2024-04-27T03:30:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:09 smithi156 ceph-mon[32679]: 24 slow requests, 0 included below; oldest blocked for > 32407.908753 secs 2024-04-27T03:30:10.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:09 smithi092 ceph-mon[29156]: pgmap v18058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33104.942653 secs 2024-04-27T03:30:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:09 smithi092 ceph-mon[29156]: 24 slow requests, 0 included below; oldest blocked for > 32407.908753 secs 2024-04-27T03:30:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:11 smithi189 ceph-mon[32756]: pgmap v18059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:11 smithi156 ceph-mon[32679]: pgmap v18059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:12.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:11 smithi092 ceph-mon[29156]: pgmap v18059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:14.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:13 smithi189 ceph-mon[32756]: pgmap v18060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:13 smithi156 ceph-mon[32679]: pgmap v18060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:13 smithi092 ceph-mon[29156]: pgmap v18060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:30:15.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 33109.942792 secs 2024-04-27T03:30:15.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:14 smithi189 ceph-mon[32756]: slow request 1444.565476 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:30:15.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:14 smithi189 ceph-mon[32756]: 25 slow requests, 1 included below; oldest blocked for > 32412.908881 secs 2024-04-27T03:30:15.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:14 smithi189 ceph-mon[32756]: slow request 184.406236 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:30:15.089 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 33109.942792 secs 2024-04-27T03:30:15.089 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:14 smithi156 ceph-mon[32679]: slow request 1444.565476 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:30:15.089 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:14 smithi156 ceph-mon[32679]: 25 slow requests, 1 included below; oldest blocked for > 32412.908881 secs 2024-04-27T03:30:15.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:14 smithi156 ceph-mon[32679]: slow request 184.406236 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:30:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 33109.942792 secs 2024-04-27T03:30:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:14 smithi092 ceph-mon[29156]: slow request 1444.565476 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:30:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:14 smithi092 ceph-mon[29156]: 25 slow requests, 1 included below; oldest blocked for > 32412.908881 secs 2024-04-27T03:30:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:14 smithi092 ceph-mon[29156]: slow request 184.406236 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:30:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:15 smithi189 ceph-mon[32756]: pgmap v18061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:15 smithi156 ceph-mon[32679]: pgmap v18061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:16.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:15 smithi092 ceph-mon[29156]: pgmap v18061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:18.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:17 smithi189 ceph-mon[32756]: pgmap v18062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:18.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:17 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:30:18.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:17 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:30:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:17 smithi156 ceph-mon[32679]: pgmap v18062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:17 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:30:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:17 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:30:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:17 smithi092 ceph-mon[29156]: pgmap v18062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:17 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:30:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:17 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:30:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:19 smithi189 ceph-mon[32756]: pgmap v18063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33114.942914 secs 2024-04-27T03:30:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:19 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32417.908987 secs 2024-04-27T03:30:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:19 smithi156 ceph-mon[32679]: pgmap v18063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33114.942914 secs 2024-04-27T03:30:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:19 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32417.908987 secs 2024-04-27T03:30:20.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:19 smithi092 ceph-mon[29156]: pgmap v18063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33114.942914 secs 2024-04-27T03:30:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:19 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32417.908987 secs 2024-04-27T03:30:22.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:21 smithi189 ceph-mon[32756]: pgmap v18064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:21 smithi156 ceph-mon[32679]: pgmap v18064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:22.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:21 smithi092 ceph-mon[29156]: pgmap v18064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:24.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:23 smithi189 ceph-mon[32756]: pgmap v18065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:24.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:23 smithi156 ceph-mon[32679]: pgmap v18065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:24.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:23 smithi092 ceph-mon[29156]: pgmap v18065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33119.942973 secs 2024-04-27T03:30:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:24 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32422.909104 secs 2024-04-27T03:30:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33119.942973 secs 2024-04-27T03:30:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:24 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32422.909104 secs 2024-04-27T03:30:25.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33119.942973 secs 2024-04-27T03:30:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:24 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32422.909104 secs 2024-04-27T03:30:26.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:25 smithi189 ceph-mon[32756]: pgmap v18066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:26.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:25 smithi156 ceph-mon[32679]: pgmap v18066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:26.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:25 smithi092 ceph-mon[29156]: pgmap v18066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:26 smithi189 ceph-mon[32756]: pgmap v18067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:26 smithi156 ceph-mon[32679]: pgmap v18067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:27.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:26 smithi092 ceph-mon[29156]: pgmap v18067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:29 smithi092 ceph-mon[29156]: pgmap v18068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33124.943095 secs 2024-04-27T03:30:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:29 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32427.909193 secs 2024-04-27T03:30:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:29 smithi189 ceph-mon[32756]: pgmap v18068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33124.943095 secs 2024-04-27T03:30:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:29 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32427.909193 secs 2024-04-27T03:30:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:29 smithi156 ceph-mon[32679]: pgmap v18068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33124.943095 secs 2024-04-27T03:30:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:29 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32427.909193 secs 2024-04-27T03:30:31.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:31 smithi092 ceph-mon[29156]: pgmap v18069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:31.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:31 smithi189 ceph-mon[32756]: pgmap v18069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:31.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:31 smithi156 ceph-mon[32679]: pgmap v18069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:33.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:33 smithi092 ceph-mon[29156]: pgmap v18070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:33.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:33 smithi189 ceph-mon[32756]: pgmap v18070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:33 smithi156 ceph-mon[32679]: pgmap v18070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33129.943208 secs 2024-04-27T03:30:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:34 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32432.909334 secs 2024-04-27T03:30:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33129.943208 secs 2024-04-27T03:30:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:34 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32432.909334 secs 2024-04-27T03:30:34.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33129.943208 secs 2024-04-27T03:30:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:34 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32432.909334 secs 2024-04-27T03:30:35.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:35 smithi092 ceph-mon[29156]: pgmap v18071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:35 smithi189 ceph-mon[32756]: pgmap v18071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:35.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:35 smithi156 ceph-mon[32679]: pgmap v18071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:37.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:37 smithi092 ceph-mon[29156]: pgmap v18072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:37.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:37 smithi189 ceph-mon[32756]: pgmap v18072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:37.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:37 smithi156 ceph-mon[32679]: pgmap v18072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:39 smithi092 ceph-mon[29156]: pgmap v18073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33134.943334 secs 2024-04-27T03:30:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:39 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32437.909472 secs 2024-04-27T03:30:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:39 smithi189 ceph-mon[32756]: pgmap v18073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33134.943334 secs 2024-04-27T03:30:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:39 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32437.909472 secs 2024-04-27T03:30:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:39 smithi156 ceph-mon[32679]: pgmap v18073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33134.943334 secs 2024-04-27T03:30:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:39 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32437.909472 secs 2024-04-27T03:30:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:30:40.532+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:30:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:30:40.532+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:30:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:30:40.532+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:30:40.538 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:30:40.532+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 255 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:30:41.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:41 smithi092 ceph-mon[29156]: pgmap v18074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:41.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:41 smithi189 ceph-mon[32756]: pgmap v18074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:41.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:41 smithi156 ceph-mon[32679]: pgmap v18074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:43.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:43 smithi092 ceph-mon[29156]: pgmap v18075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:43.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:43 smithi189 ceph-mon[32756]: pgmap v18075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:43.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:43 smithi156 ceph-mon[32679]: pgmap v18075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:44.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33139.943473 secs 2024-04-27T03:30:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:44 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32442.909559 secs 2024-04-27T03:30:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33139.943473 secs 2024-04-27T03:30:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:44 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32442.909559 secs 2024-04-27T03:30:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33139.943473 secs 2024-04-27T03:30:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:44 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32442.909559 secs 2024-04-27T03:30:45.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:45 smithi092 ceph-mon[29156]: pgmap v18076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:45.794 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:45 smithi189 ceph-mon[32756]: pgmap v18076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:45.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:45 smithi156 ceph-mon[32679]: pgmap v18076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:30:47.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:47 smithi092 ceph-mon[29156]: pgmap v18077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:47.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:47 smithi189 ceph-mon[32756]: pgmap v18077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:47.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:47 smithi156 ceph-mon[32679]: pgmap v18077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:49 smithi092 ceph-mon[29156]: pgmap v18078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33144.943614 secs 2024-04-27T03:30:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:49 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32447.909620 secs 2024-04-27T03:30:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:49 smithi189 ceph-mon[32756]: pgmap v18078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33144.943614 secs 2024-04-27T03:30:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:49 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32447.909620 secs 2024-04-27T03:30:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:49 smithi156 ceph-mon[32679]: pgmap v18078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:30:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33144.943614 secs 2024-04-27T03:30:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:49 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32447.909620 secs 2024-04-27T03:30:51.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:51 smithi092 ceph-mon[29156]: pgmap v18079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:51.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:51 smithi189 ceph-mon[32756]: pgmap v18079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:51.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:51 smithi156 ceph-mon[32679]: pgmap v18079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:53.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:53 smithi092 ceph-mon[29156]: pgmap v18080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:53.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:53 smithi189 ceph-mon[32756]: pgmap v18080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:53.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:53 smithi156 ceph-mon[32679]: pgmap v18080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33149.943755 secs 2024-04-27T03:30:54.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:54 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32452.909732 secs 2024-04-27T03:30:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33149.943755 secs 2024-04-27T03:30:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:54 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32452.909732 secs 2024-04-27T03:30:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33149.943755 secs 2024-04-27T03:30:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:54 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32452.909732 secs 2024-04-27T03:30:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:55 smithi189 ceph-mon[32756]: pgmap v18081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:55 smithi156 ceph-mon[32679]: pgmap v18081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:55.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:55 smithi092 ceph-mon[29156]: pgmap v18081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:30:57.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:57 smithi189 ceph-mon[32756]: pgmap v18082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:57.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:57 smithi156 ceph-mon[32679]: pgmap v18082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:57 smithi092 ceph-mon[29156]: pgmap v18082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:59 smithi189 ceph-mon[32756]: pgmap v18083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33154.943891 secs 2024-04-27T03:30:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:30:59 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32457.909867 secs 2024-04-27T03:30:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:59 smithi156 ceph-mon[32679]: pgmap v18083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33154.943891 secs 2024-04-27T03:30:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:30:59 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32457.909867 secs 2024-04-27T03:30:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:59 smithi092 ceph-mon[29156]: pgmap v18083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:30:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33154.943891 secs 2024-04-27T03:30:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:30:59 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32457.909867 secs 2024-04-27T03:31:01.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:01 smithi189 ceph-mon[32756]: pgmap v18084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:31:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:01 smithi156 ceph-mon[32679]: pgmap v18084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:31:01.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:01 smithi092 ceph-mon[29156]: pgmap v18084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:31:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:31:02.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:31:02.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:31:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:03 smithi189 ceph-mon[32756]: pgmap v18085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:31:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:31:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:31:03.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:03 smithi156 ceph-mon[32679]: pgmap v18085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:03.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:31:03.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:31:03.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:31:03.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:03 smithi092 ceph-mon[29156]: pgmap v18085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:31:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:31:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:31:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:04 smithi189 ceph-mon[32756]: pgmap v18086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:31:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:04 smithi189 ceph-mon[32756]: pgmap v18087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:31:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33159.944007 secs 2024-04-27T03:31:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:04 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32462.909989 secs 2024-04-27T03:31:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:04 smithi092 ceph-mon[29156]: pgmap v18086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:31:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:04 smithi092 ceph-mon[29156]: pgmap v18087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:31:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33159.944007 secs 2024-04-27T03:31:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:04 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32462.909989 secs 2024-04-27T03:31:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:04 smithi156 ceph-mon[32679]: pgmap v18086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:31:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:04 smithi156 ceph-mon[32679]: pgmap v18087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:31:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33159.944007 secs 2024-04-27T03:31:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:04 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32462.909989 secs 2024-04-27T03:31:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:06 smithi189 ceph-mon[32756]: pgmap v18088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:06 smithi156 ceph-mon[32679]: pgmap v18088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:06.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:06 smithi092 ceph-mon[29156]: pgmap v18088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:08.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:08 smithi189 ceph-mon[32756]: pgmap v18089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:08 smithi156 ceph-mon[32679]: pgmap v18089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:08.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:08 smithi092 ceph-mon[29156]: pgmap v18089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33164.944139 secs 2024-04-27T03:31:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:09 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32467.910108 secs 2024-04-27T03:31:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33164.944139 secs 2024-04-27T03:31:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:09 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32467.910108 secs 2024-04-27T03:31:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33164.944139 secs 2024-04-27T03:31:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:09 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32467.910108 secs 2024-04-27T03:31:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:10 smithi189 ceph-mon[32756]: pgmap v18090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:10 smithi156 ceph-mon[32679]: pgmap v18090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:10.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:10 smithi092 ceph-mon[29156]: pgmap v18090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:12 smithi189 ceph-mon[32756]: pgmap v18091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:12.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:12 smithi156 ceph-mon[32679]: pgmap v18091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:12.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:12 smithi092 ceph-mon[29156]: pgmap v18091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:31:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:14 smithi189 ceph-mon[32756]: pgmap v18092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:31:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33169.944259 secs 2024-04-27T03:31:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:14 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32472.910230 secs 2024-04-27T03:31:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:14 smithi156 ceph-mon[32679]: pgmap v18092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:31:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33169.944259 secs 2024-04-27T03:31:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:14 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32472.910230 secs 2024-04-27T03:31:14.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:14 smithi092 ceph-mon[29156]: pgmap v18092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:31:14.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33169.944259 secs 2024-04-27T03:31:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:14 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32472.910230 secs 2024-04-27T03:31:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:16 smithi189 ceph-mon[32756]: pgmap v18093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:16 smithi156 ceph-mon[32679]: pgmap v18093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:16.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:16 smithi092 ceph-mon[29156]: pgmap v18093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:18 smithi189 ceph-mon[32756]: pgmap v18094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:18 smithi156 ceph-mon[32679]: pgmap v18094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:18 smithi092 ceph-mon[29156]: pgmap v18094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33174.944334 secs 2024-04-27T03:31:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:19 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32477.910348 secs 2024-04-27T03:31:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33174.944334 secs 2024-04-27T03:31:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:19 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32477.910348 secs 2024-04-27T03:31:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33174.944334 secs 2024-04-27T03:31:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:19 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32477.910348 secs 2024-04-27T03:31:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:20 smithi189 ceph-mon[32756]: pgmap v18095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:20 smithi156 ceph-mon[32679]: pgmap v18095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:20 smithi092 ceph-mon[29156]: pgmap v18095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:22 smithi189 ceph-mon[32756]: pgmap v18096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:22 smithi156 ceph-mon[32679]: pgmap v18096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:22 smithi092 ceph-mon[29156]: pgmap v18096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:24 smithi189 ceph-mon[32756]: pgmap v18097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33179.944431 secs 2024-04-27T03:31:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:24 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32482.910394 secs 2024-04-27T03:31:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:24 smithi156 ceph-mon[32679]: pgmap v18097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33179.944431 secs 2024-04-27T03:31:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:24 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32482.910394 secs 2024-04-27T03:31:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:24 smithi092 ceph-mon[29156]: pgmap v18097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33179.944431 secs 2024-04-27T03:31:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:24 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32482.910394 secs 2024-04-27T03:31:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:31:25.538+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:31:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:31:25.538+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:31:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:31:25.538+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:31:25.544 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:31:25.538+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 256 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:31:26.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:26 smithi189 ceph-mon[32756]: pgmap v18098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:26 smithi156 ceph-mon[32679]: pgmap v18098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:26 smithi092 ceph-mon[29156]: pgmap v18098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:28 smithi189 ceph-mon[32756]: pgmap v18099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:28 smithi156 ceph-mon[32679]: pgmap v18099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:28.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:28 smithi092 ceph-mon[29156]: pgmap v18099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33184.944536 secs 2024-04-27T03:31:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:29 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32487.910514 secs 2024-04-27T03:31:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33184.944536 secs 2024-04-27T03:31:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:29 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32487.910514 secs 2024-04-27T03:31:29.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33184.944536 secs 2024-04-27T03:31:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:29 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32487.910514 secs 2024-04-27T03:31:30.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:30 smithi189 ceph-mon[32756]: pgmap v18100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:30 smithi156 ceph-mon[32679]: pgmap v18100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:30.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:30 smithi092 ceph-mon[29156]: pgmap v18100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:32.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:32 smithi189 ceph-mon[32756]: pgmap v18101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:32 smithi156 ceph-mon[32679]: pgmap v18101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:32.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:32 smithi092 ceph-mon[29156]: pgmap v18101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:34 smithi189 ceph-mon[32756]: pgmap v18102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33189.944657 secs 2024-04-27T03:31:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:34 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32492.910626 secs 2024-04-27T03:31:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:34 smithi156 ceph-mon[32679]: pgmap v18102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33189.944657 secs 2024-04-27T03:31:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:34 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32492.910626 secs 2024-04-27T03:31:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:34 smithi092 ceph-mon[29156]: pgmap v18102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33189.944657 secs 2024-04-27T03:31:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:34 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32492.910626 secs 2024-04-27T03:31:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:36 smithi189 ceph-mon[32756]: pgmap v18103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:36 smithi156 ceph-mon[32679]: pgmap v18103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:36 smithi092 ceph-mon[29156]: pgmap v18103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:38.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:38 smithi189 ceph-mon[32756]: pgmap v18104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:38 smithi156 ceph-mon[32679]: pgmap v18104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:38 smithi092 ceph-mon[29156]: pgmap v18104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33194.944795 secs 2024-04-27T03:31:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:39 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32497.910726 secs 2024-04-27T03:31:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33194.944795 secs 2024-04-27T03:31:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:39 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32497.910726 secs 2024-04-27T03:31:39.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33194.944795 secs 2024-04-27T03:31:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:39 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32497.910726 secs 2024-04-27T03:31:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:40 smithi189 ceph-mon[32756]: pgmap v18105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:40 smithi156 ceph-mon[32679]: pgmap v18105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:40 smithi092 ceph-mon[29156]: pgmap v18105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:42.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:42 smithi189 ceph-mon[32756]: pgmap v18106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:42 smithi156 ceph-mon[32679]: pgmap v18106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:42.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:42 smithi092 ceph-mon[29156]: pgmap v18106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:44 smithi189 ceph-mon[32756]: pgmap v18107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33199.944923 secs 2024-04-27T03:31:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:44 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32502.910865 secs 2024-04-27T03:31:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:44 smithi156 ceph-mon[32679]: pgmap v18107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33199.944923 secs 2024-04-27T03:31:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:44 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32502.910865 secs 2024-04-27T03:31:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:44 smithi092 ceph-mon[29156]: pgmap v18107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33199.944923 secs 2024-04-27T03:31:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:44 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32502.910865 secs 2024-04-27T03:31:46.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:46 smithi189 ceph-mon[32756]: pgmap v18108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:46.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:46 smithi156 ceph-mon[32679]: pgmap v18108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:46 smithi092 ceph-mon[29156]: pgmap v18108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:48.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:48 smithi189 ceph-mon[32756]: pgmap v18109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:48.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:48 smithi156 ceph-mon[32679]: pgmap v18109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:48.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:48 smithi092 ceph-mon[29156]: pgmap v18109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33204.945021 secs 2024-04-27T03:31:49.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:49 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32507.910975 secs 2024-04-27T03:31:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33204.945021 secs 2024-04-27T03:31:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:49 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32507.910975 secs 2024-04-27T03:31:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33204.945021 secs 2024-04-27T03:31:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:49 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32507.910975 secs 2024-04-27T03:31:50.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:50 smithi189 ceph-mon[32756]: pgmap v18110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:50 smithi156 ceph-mon[32679]: pgmap v18110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:50 smithi092 ceph-mon[29156]: pgmap v18110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:52.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:52 smithi189 ceph-mon[32756]: pgmap v18111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:52.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:52 smithi156 ceph-mon[32679]: pgmap v18111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:52.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:52 smithi092 ceph-mon[29156]: pgmap v18111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:54 smithi189 ceph-mon[32756]: pgmap v18112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33209.945138 secs 2024-04-27T03:31:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:54 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32512.911100 secs 2024-04-27T03:31:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:54 smithi156 ceph-mon[32679]: pgmap v18112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33209.945138 secs 2024-04-27T03:31:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:54 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32512.911100 secs 2024-04-27T03:31:54.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:54 smithi092 ceph-mon[29156]: pgmap v18112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33209.945138 secs 2024-04-27T03:31:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:54 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32512.911100 secs 2024-04-27T03:31:56.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:56 smithi189 ceph-mon[32756]: pgmap v18113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:56.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:56 smithi156 ceph-mon[32679]: pgmap v18113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:56.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:56 smithi092 ceph-mon[29156]: pgmap v18113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:31:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:58 smithi189 ceph-mon[32756]: pgmap v18114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:58 smithi156 ceph-mon[32679]: pgmap v18114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:58.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:58 smithi092 ceph-mon[29156]: pgmap v18114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:31:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33214.945264 secs 2024-04-27T03:31:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:31:59 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32517.911246 secs 2024-04-27T03:31:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33214.945264 secs 2024-04-27T03:31:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:31:59 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32517.911246 secs 2024-04-27T03:31:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33214.945264 secs 2024-04-27T03:31:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:31:59 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32517.911246 secs 2024-04-27T03:32:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:00 smithi189 ceph-mon[32756]: pgmap v18115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:00 smithi156 ceph-mon[32679]: pgmap v18115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:00 smithi092 ceph-mon[29156]: pgmap v18115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:02 smithi189 ceph-mon[32756]: pgmap v18116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:02 smithi156 ceph-mon[32679]: pgmap v18116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:02.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:02 smithi092 ceph-mon[29156]: pgmap v18116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:32:03.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:32:03.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:32:04.810 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: pgmap v18117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33219.945352 secs 2024-04-27T03:32:04.811 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:04 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32522.911316 secs 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: pgmap v18117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33219.945352 secs 2024-04-27T03:32:04.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:04 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32522.911316 secs 2024-04-27T03:32:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: pgmap v18117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33219.945352 secs 2024-04-27T03:32:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:04 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32522.911316 secs 2024-04-27T03:32:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: pgmap v18118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:32:07.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:32:07.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: pgmap v18118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.154 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:32:07.155 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: pgmap v18118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:32:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:32:07.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:32:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:32:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:32:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:32:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:32:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: pgmap v18119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:07 smithi189 ceph-mon[32756]: pgmap v18120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: pgmap v18119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:07 smithi156 ceph-mon[32679]: pgmap v18120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:08.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: pgmap v18119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:07 smithi092 ceph-mon[29156]: pgmap v18120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-mon[29156]: pgmap v18121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33224.945479 secs 2024-04-27T03:32:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32527.911438 secs 2024-04-27T03:32:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:32:09.695+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:32:10.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:32:09.695+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:32:10.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:32:09.695+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:32:10.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:32:09.695+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:32:10.000 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:32:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:32:09.695+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:32:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:09 smithi189 ceph-mon[32756]: pgmap v18121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33224.945479 secs 2024-04-27T03:32:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:09 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32527.911438 secs 2024-04-27T03:32:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:09 smithi156 ceph-mon[32679]: pgmap v18121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33224.945479 secs 2024-04-27T03:32:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:09 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32527.911438 secs 2024-04-27T03:32:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:11 smithi189 ceph-mon[32756]: pgmap v18122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:11 smithi156 ceph-mon[32679]: pgmap v18122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:11 smithi092 ceph-mon[29156]: pgmap v18122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:14.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:13 smithi189 ceph-mon[32756]: pgmap v18123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:14.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:13 smithi156 ceph-mon[32679]: pgmap v18123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:14.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:13 smithi092 ceph-mon[29156]: pgmap v18123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:32:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33229.945568 secs 2024-04-27T03:32:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:14 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32532.911557 secs 2024-04-27T03:32:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33229.945568 secs 2024-04-27T03:32:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:14 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32532.911557 secs 2024-04-27T03:32:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33229.945568 secs 2024-04-27T03:32:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:14 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32532.911557 secs 2024-04-27T03:32:16.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:15 smithi156 ceph-mon[32679]: pgmap v18124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 320 B/s wr, 4 op/s 2024-04-27T03:32:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:15 smithi189 ceph-mon[32756]: pgmap v18124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 320 B/s wr, 4 op/s 2024-04-27T03:32:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:15 smithi092 ceph-mon[29156]: pgmap v18124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 320 B/s wr, 4 op/s 2024-04-27T03:32:16.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:16 smithi092 ceph-mon[29156]: pgmap v18125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-04-27T03:32:17.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:16 smithi189 ceph-mon[32756]: pgmap v18125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-04-27T03:32:17.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:16 smithi156 ceph-mon[32679]: pgmap v18125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 307 B/s wr, 4 op/s 2024-04-27T03:32:19.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:18 smithi189 ceph-mon[32756]: pgmap v18126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:19.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:18 smithi156 ceph-mon[32679]: pgmap v18126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:19.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:18 smithi092 ceph-mon[29156]: pgmap v18126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33234.945684 secs 2024-04-27T03:32:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:19 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32537.911685 secs 2024-04-27T03:32:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33234.945684 secs 2024-04-27T03:32:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:19 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32537.911685 secs 2024-04-27T03:32:20.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33234.945684 secs 2024-04-27T03:32:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:19 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32537.911685 secs 2024-04-27T03:32:21.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:20 smithi189 ceph-mon[32756]: pgmap v18127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:21.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:20 smithi156 ceph-mon[32679]: pgmap v18127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:21.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:20 smithi092 ceph-mon[29156]: pgmap v18127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:22 smithi189 ceph-mon[32756]: pgmap v18128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:22 smithi156 ceph-mon[32679]: pgmap v18128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:23.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:22 smithi092 ceph-mon[29156]: pgmap v18128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-04-27T03:32:24.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:24 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32542.911800 secs 2024-04-27T03:32:24.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:24 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32542.911800 secs 2024-04-27T03:32:24.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:24 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32542.911800 secs 2024-04-27T03:32:25.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33239.945797 secs 2024-04-27T03:32:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:25 smithi092 ceph-mon[29156]: pgmap v18129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:25.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33239.945797 secs 2024-04-27T03:32:25.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:25 smithi189 ceph-mon[32756]: pgmap v18129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:25.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33239.945797 secs 2024-04-27T03:32:25.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:25 smithi156 ceph-mon[32679]: pgmap v18129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-27T03:32:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:26 smithi189 ceph-mon[32756]: pgmap v18130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:26 smithi156 ceph-mon[32679]: pgmap v18130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:27.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:26 smithi092 ceph-mon[29156]: pgmap v18130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:28 smithi189 ceph-mon[32756]: pgmap v18131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:29.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:28 smithi156 ceph-mon[32679]: pgmap v18131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:28 smithi092 ceph-mon[29156]: pgmap v18131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33244.945865 secs 2024-04-27T03:32:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:29 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32547.911865 secs 2024-04-27T03:32:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33244.945865 secs 2024-04-27T03:32:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:29 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32547.911865 secs 2024-04-27T03:32:30.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33244.945865 secs 2024-04-27T03:32:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:29 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32547.911865 secs 2024-04-27T03:32:31.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:30 smithi189 ceph-mon[32756]: pgmap v18132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:30 smithi156 ceph-mon[32679]: pgmap v18132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:31.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:30 smithi092 ceph-mon[29156]: pgmap v18132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:32 smithi189 ceph-mon[32756]: pgmap v18133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:33.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:32 smithi156 ceph-mon[32679]: pgmap v18133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:32 smithi092 ceph-mon[29156]: pgmap v18133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:34.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:34 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32552.911988 secs 2024-04-27T03:32:34.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:34 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32552.911988 secs 2024-04-27T03:32:34.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:34 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32552.911988 secs 2024-04-27T03:32:35.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33249.945942 secs 2024-04-27T03:32:35.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:35 smithi092 ceph-mon[29156]: pgmap v18134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:35.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33249.945942 secs 2024-04-27T03:32:35.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:35 smithi189 ceph-mon[32756]: pgmap v18134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:35.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33249.945942 secs 2024-04-27T03:32:35.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:35 smithi156 ceph-mon[32679]: pgmap v18134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:36 smithi189 ceph-mon[32756]: pgmap v18135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:36 smithi156 ceph-mon[32679]: pgmap v18135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:36 smithi092 ceph-mon[29156]: pgmap v18135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:38 smithi189 ceph-mon[32756]: pgmap v18136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:38 smithi156 ceph-mon[32679]: pgmap v18136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:38 smithi092 ceph-mon[29156]: pgmap v18136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33254.946032 secs 2024-04-27T03:32:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:39 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32557.912112 secs 2024-04-27T03:32:40.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33254.946032 secs 2024-04-27T03:32:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:39 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32557.912112 secs 2024-04-27T03:32:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33254.946032 secs 2024-04-27T03:32:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:39 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32557.912112 secs 2024-04-27T03:32:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:40 smithi189 ceph-mon[32756]: pgmap v18137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:40 smithi156 ceph-mon[32679]: pgmap v18137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:40 smithi092 ceph-mon[29156]: pgmap v18137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:42 smithi189 ceph-mon[32756]: pgmap v18138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:43.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:42 smithi156 ceph-mon[32679]: pgmap v18138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:43.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:42 smithi092 ceph-mon[29156]: pgmap v18138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:44.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:44 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32562.912174 secs 2024-04-27T03:32:44.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:44 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32562.912174 secs 2024-04-27T03:32:44.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:44 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32562.912174 secs 2024-04-27T03:32:45.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33259.946140 secs 2024-04-27T03:32:45.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:45 smithi092 ceph-mon[29156]: pgmap v18139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:45.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33259.946140 secs 2024-04-27T03:32:45.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:45 smithi189 ceph-mon[32756]: pgmap v18139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:45.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33259.946140 secs 2024-04-27T03:32:45.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:45 smithi156 ceph-mon[32679]: pgmap v18139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:46 smithi189 ceph-mon[32756]: pgmap v18140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:46 smithi156 ceph-mon[32679]: pgmap v18140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:47.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:46 smithi092 ceph-mon[29156]: pgmap v18140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:49.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:48 smithi189 ceph-mon[32756]: pgmap v18141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:48 smithi156 ceph-mon[32679]: pgmap v18141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:49.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:48 smithi092 ceph-mon[29156]: pgmap v18141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33264.946210 secs 2024-04-27T03:32:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:49 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32567.912325 secs 2024-04-27T03:32:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33264.946210 secs 2024-04-27T03:32:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:49 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32567.912325 secs 2024-04-27T03:32:50.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33264.946210 secs 2024-04-27T03:32:50.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:49 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32567.912325 secs 2024-04-27T03:32:51.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:50 smithi189 ceph-mon[32756]: pgmap v18142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:51.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:50 smithi156 ceph-mon[32679]: pgmap v18142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:51.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:50 smithi092 ceph-mon[29156]: pgmap v18142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:53.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:52 smithi189 ceph-mon[32756]: pgmap v18143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:52 smithi156 ceph-mon[32679]: pgmap v18143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:53.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:52 smithi092 ceph-mon[29156]: pgmap v18143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:54.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:54 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32572.912412 secs 2024-04-27T03:32:54.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:54 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32572.912412 secs 2024-04-27T03:32:54.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:54 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32572.912412 secs 2024-04-27T03:32:55.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33269.946324 secs 2024-04-27T03:32:55.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:55 smithi092 ceph-mon[29156]: pgmap v18144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:55.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33269.946324 secs 2024-04-27T03:32:55.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:55 smithi189 ceph-mon[32756]: pgmap v18144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33269.946324 secs 2024-04-27T03:32:55.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:55 smithi156 ceph-mon[32679]: pgmap v18144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:57.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:56 smithi189 ceph-mon[32756]: pgmap v18145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:56 smithi156 ceph-mon[32679]: pgmap v18145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:57.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:56 smithi092 ceph-mon[29156]: pgmap v18145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:32:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:58 smithi189 ceph-mon[32756]: pgmap v18146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:58 smithi156 ceph-mon[32679]: pgmap v18146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:32:59.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:58 smithi092 ceph-mon[29156]: pgmap v18146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33274.946400 secs 2024-04-27T03:33:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:32:59 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32577.912478 secs 2024-04-27T03:33:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33274.946400 secs 2024-04-27T03:33:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:32:59 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32577.912478 secs 2024-04-27T03:33:00.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33274.946400 secs 2024-04-27T03:33:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:32:59 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32577.912478 secs 2024-04-27T03:33:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:00 smithi189 ceph-mon[32756]: pgmap v18147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:00 smithi156 ceph-mon[32679]: pgmap v18147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:01.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:00 smithi092 ceph-mon[29156]: pgmap v18147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:02 smithi189 ceph-mon[32756]: pgmap v18148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:02 smithi156 ceph-mon[32679]: pgmap v18148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:03.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:02 smithi092 ceph-mon[29156]: pgmap v18148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:04.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:04 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32582.912544 secs 2024-04-27T03:33:04.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:04 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32582.912544 secs 2024-04-27T03:33:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:04 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32582.912544 secs 2024-04-27T03:33:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33279.946540 secs 2024-04-27T03:33:05.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:05 smithi092 ceph-mon[29156]: pgmap v18149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:05.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33279.946540 secs 2024-04-27T03:33:05.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:05 smithi189 ceph-mon[32756]: pgmap v18149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:05.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33279.946540 secs 2024-04-27T03:33:05.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:05 smithi156 ceph-mon[32679]: pgmap v18149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:06 smithi189 ceph-mon[32756]: pgmap v18150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:06 smithi156 ceph-mon[32679]: pgmap v18150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:07.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:06 smithi092 ceph-mon[29156]: pgmap v18150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: pgmap v18151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: pgmap v18152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:33:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: pgmap v18151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: pgmap v18152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:33:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: pgmap v18151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: pgmap v18152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:33:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:33:09.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:09 smithi092 ceph-mon[29156]: 25 slow requests, 1 included below; oldest blocked for > 32587.912661 secs 2024-04-27T03:33:09.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:09 smithi092 ceph-mon[29156]: slow request 2880.073627 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:09 smithi189 ceph-mon[32756]: 25 slow requests, 1 included below; oldest blocked for > 32587.912661 secs 2024-04-27T03:33:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:09 smithi189 ceph-mon[32756]: slow request 2880.073627 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:09 smithi156 ceph-mon[32679]: 25 slow requests, 1 included below; oldest blocked for > 32587.912661 secs 2024-04-27T03:33:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:09 smithi156 ceph-mon[32679]: slow request 2880.073627 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33284.946631 secs 2024-04-27T03:33:10.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:10 smithi092 ceph-mon[29156]: pgmap v18153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33284.946631 secs 2024-04-27T03:33:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:10 smithi189 ceph-mon[32756]: pgmap v18153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33284.946631 secs 2024-04-27T03:33:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:10 smithi156 ceph-mon[32679]: pgmap v18153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:12 smithi189 ceph-mon[32756]: pgmap v18154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:12 smithi156 ceph-mon[32679]: pgmap v18154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:12.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:12 smithi092 ceph-mon[29156]: pgmap v18154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:14 smithi189 ceph-mon[32756]: pgmap v18155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33289.946754 secs 2024-04-27T03:33:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:14 smithi189 ceph-mon[32756]: 25 slow requests, 1 included below; oldest blocked for > 32592.912776 secs 2024-04-27T03:33:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:14 smithi189 ceph-mon[32756]: slow request 364.410132 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:14 smithi156 ceph-mon[32679]: pgmap v18155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33289.946754 secs 2024-04-27T03:33:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:14 smithi156 ceph-mon[32679]: 25 slow requests, 1 included below; oldest blocked for > 32592.912776 secs 2024-04-27T03:33:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:14 smithi156 ceph-mon[32679]: slow request 364.410132 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:14 smithi092 ceph-mon[29156]: pgmap v18155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33289.946754 secs 2024-04-27T03:33:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:14 smithi092 ceph-mon[29156]: 25 slow requests, 1 included below; oldest blocked for > 32592.912776 secs 2024-04-27T03:33:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:14 smithi092 ceph-mon[29156]: slow request 364.410132 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:33:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:16 smithi189 ceph-mon[32756]: pgmap v18156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:16 smithi156 ceph-mon[32679]: pgmap v18156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:16.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:16 smithi092 ceph-mon[29156]: pgmap v18156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:33:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:18 smithi189 ceph-mon[32756]: pgmap v18157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:33:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:18 smithi156 ceph-mon[32679]: pgmap v18157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:33:18.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:18 smithi092 ceph-mon[29156]: pgmap v18157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:33:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33294.946872 secs 2024-04-27T03:33:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:19 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32597.912899 secs 2024-04-27T03:33:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33294.946872 secs 2024-04-27T03:33:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:19 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32597.912899 secs 2024-04-27T03:33:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33294.946872 secs 2024-04-27T03:33:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:19 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32597.912899 secs 2024-04-27T03:33:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:20 smithi189 ceph-mon[32756]: pgmap v18158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:20 smithi156 ceph-mon[32679]: pgmap v18158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:20.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:20 smithi092 ceph-mon[29156]: pgmap v18158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:22 smithi189 ceph-mon[32756]: pgmap v18159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:22 smithi156 ceph-mon[32679]: pgmap v18159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:22.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:22 smithi092 ceph-mon[29156]: pgmap v18159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:24 smithi189 ceph-mon[32756]: pgmap v18160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33299.946992 secs 2024-04-27T03:33:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:24 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32602.913025 secs 2024-04-27T03:33:24.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:24 smithi156 ceph-mon[32679]: pgmap v18160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33299.946992 secs 2024-04-27T03:33:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:24 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32602.913025 secs 2024-04-27T03:33:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:24 smithi092 ceph-mon[29156]: pgmap v18160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33299.946992 secs 2024-04-27T03:33:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:24 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32602.913025 secs 2024-04-27T03:33:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:26 smithi156 ceph-mon[32679]: pgmap v18161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:26.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:26 smithi092 ceph-mon[29156]: pgmap v18161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:26 smithi189 ceph-mon[32756]: pgmap v18161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:28 smithi156 ceph-mon[32679]: pgmap v18162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:28.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:28 smithi092 ceph-mon[29156]: pgmap v18162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:28 smithi189 ceph-mon[32756]: pgmap v18162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33304.947109 secs 2024-04-27T03:33:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:29 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32607.913088 secs 2024-04-27T03:33:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33304.947109 secs 2024-04-27T03:33:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:29 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32607.913088 secs 2024-04-27T03:33:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33304.947109 secs 2024-04-27T03:33:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:29 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32607.913088 secs 2024-04-27T03:33:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:30 smithi156 ceph-mon[32679]: pgmap v18163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:30.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:30 smithi092 ceph-mon[29156]: pgmap v18163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:30 smithi189 ceph-mon[32756]: pgmap v18163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:32 smithi156 ceph-mon[32679]: pgmap v18164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:32.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:32 smithi092 ceph-mon[29156]: pgmap v18164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:32 smithi189 ceph-mon[32756]: pgmap v18164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:34 smithi156 ceph-mon[32679]: pgmap v18165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33309.947204 secs 2024-04-27T03:33:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:34 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32612.913183 secs 2024-04-27T03:33:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:34 smithi092 ceph-mon[29156]: pgmap v18165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33309.947204 secs 2024-04-27T03:33:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:34 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32612.913183 secs 2024-04-27T03:33:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:34 smithi189 ceph-mon[32756]: pgmap v18165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33309.947204 secs 2024-04-27T03:33:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:34 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32612.913183 secs 2024-04-27T03:33:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001001) for more than 900000000 us, fault. 2024-04-27T03:33:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca80c2000 comp rx=0 tx=0).stop 2024-04-27T03:33:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T03:33:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T03:33:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T03:33:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:33:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.044+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80d9000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T03:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T03:33:36.093 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T03:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T03:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=35 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T03:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T03:33:36.094 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:36.088+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T03:33:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:36 smithi156 ceph-mon[32679]: pgmap v18166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:36.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:36 smithi092 ceph-mon[29156]: pgmap v18166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:36 smithi189 ceph-mon[32756]: pgmap v18166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:38 smithi156 ceph-mon[32679]: pgmap v18167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:38 smithi092 ceph-mon[29156]: pgmap v18167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:38 smithi189 ceph-mon[32756]: pgmap v18167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33314.947324 secs 2024-04-27T03:33:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:39 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32617.913319 secs 2024-04-27T03:33:39.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33314.947324 secs 2024-04-27T03:33:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:39 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32617.913319 secs 2024-04-27T03:33:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33314.947324 secs 2024-04-27T03:33:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:39 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32617.913319 secs 2024-04-27T03:33:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:40.556+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:33:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:40.556+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:33:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:40.557+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:33:40.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:33:40.557+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 257 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:33:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:40 smithi156 ceph-mon[32679]: pgmap v18168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:40.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:40 smithi092 ceph-mon[29156]: pgmap v18168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:40 smithi189 ceph-mon[32756]: pgmap v18168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:42 smithi156 ceph-mon[32679]: pgmap v18169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:42 smithi092 ceph-mon[29156]: pgmap v18169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:42 smithi189 ceph-mon[32756]: pgmap v18169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:44 smithi156 ceph-mon[32679]: pgmap v18170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33319.947399 secs 2024-04-27T03:33:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:44 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32622.913378 secs 2024-04-27T03:33:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:44 smithi092 ceph-mon[29156]: pgmap v18170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33319.947399 secs 2024-04-27T03:33:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:44 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32622.913378 secs 2024-04-27T03:33:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:44 smithi189 ceph-mon[32756]: pgmap v18170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33319.947399 secs 2024-04-27T03:33:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:44 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32622.913378 secs 2024-04-27T03:33:46.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:46 smithi156 ceph-mon[32679]: pgmap v18171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:46.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:46 smithi092 ceph-mon[29156]: pgmap v18171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:46 smithi189 ceph-mon[32756]: pgmap v18171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:48.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:48 smithi189 ceph-mon[32756]: pgmap v18172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:48.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:48 smithi092 ceph-mon[29156]: pgmap v18172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:48 smithi156 ceph-mon[32679]: pgmap v18172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33324.947517 secs 2024-04-27T03:33:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:49 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32627.913460 secs 2024-04-27T03:33:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33324.947517 secs 2024-04-27T03:33:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:49 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32627.913460 secs 2024-04-27T03:33:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33324.947517 secs 2024-04-27T03:33:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:49 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32627.913460 secs 2024-04-27T03:33:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:50 smithi092 ceph-mon[29156]: pgmap v18173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:51.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:50 smithi189 ceph-mon[32756]: pgmap v18173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:51.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:50 smithi156 ceph-mon[32679]: pgmap v18173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:52.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:52 smithi092 ceph-mon[29156]: pgmap v18174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:53.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:52 smithi189 ceph-mon[32756]: pgmap v18174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:52 smithi156 ceph-mon[32679]: pgmap v18174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:54 smithi092 ceph-mon[29156]: pgmap v18175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33329.947632 secs 2024-04-27T03:33:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:54 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32632.913528 secs 2024-04-27T03:33:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:54 smithi189 ceph-mon[32756]: pgmap v18175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33329.947632 secs 2024-04-27T03:33:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:54 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32632.913528 secs 2024-04-27T03:33:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:54 smithi156 ceph-mon[32679]: pgmap v18175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:33:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33329.947632 secs 2024-04-27T03:33:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:54 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32632.913528 secs 2024-04-27T03:33:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:56 smithi092 ceph-mon[29156]: pgmap v18176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:57.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:56 smithi189 ceph-mon[32756]: pgmap v18176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:56 smithi156 ceph-mon[32679]: pgmap v18176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:58.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:58 smithi092 ceph-mon[29156]: pgmap v18177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:58 smithi189 ceph-mon[32756]: pgmap v18177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:58 smithi156 ceph-mon[32679]: pgmap v18177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:33:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33334.947751 secs 2024-04-27T03:33:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:33:59 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32637.913611 secs 2024-04-27T03:34:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33334.947751 secs 2024-04-27T03:34:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:33:59 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32637.913611 secs 2024-04-27T03:34:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33334.947751 secs 2024-04-27T03:34:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:33:59 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32637.913611 secs 2024-04-27T03:34:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:00 smithi092 ceph-mon[29156]: pgmap v18178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:00 smithi189 ceph-mon[32756]: pgmap v18178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:00 smithi156 ceph-mon[32679]: pgmap v18178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:02 smithi092 ceph-mon[29156]: pgmap v18179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:02 smithi189 ceph-mon[32756]: pgmap v18179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:02 smithi156 ceph-mon[32679]: pgmap v18179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:04 smithi092 ceph-mon[29156]: pgmap v18180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33339.947887 secs 2024-04-27T03:34:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:04 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32642.913715 secs 2024-04-27T03:34:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:04 smithi189 ceph-mon[32756]: pgmap v18180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33339.947887 secs 2024-04-27T03:34:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:04 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32642.913715 secs 2024-04-27T03:34:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:04 smithi156 ceph-mon[32679]: pgmap v18180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33339.947887 secs 2024-04-27T03:34:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:04 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32642.913715 secs 2024-04-27T03:34:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:06 smithi092 ceph-mon[29156]: pgmap v18181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:06 smithi189 ceph-mon[32756]: pgmap v18181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:06 smithi156 ceph-mon[32679]: pgmap v18181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:07.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:34:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:34:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:34:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:08 smithi092 ceph-mon[29156]: pgmap v18182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:34:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:34:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:34:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:08 smithi189 ceph-mon[32756]: pgmap v18182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:34:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:34:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:34:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:08 smithi156 ceph-mon[32679]: pgmap v18182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:34:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:34:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:34:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:09 smithi092 ceph-mon[29156]: pgmap v18183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:34:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:09 smithi092 ceph-mon[29156]: pgmap v18184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33344.948012 secs 2024-04-27T03:34:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:09 smithi092 ceph-mon[29156]: 25 slow requests, 1 included below; oldest blocked for > 32647.913829 secs 2024-04-27T03:34:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:09 smithi092 ceph-mon[29156]: slow request 5760.878913 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:34:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:09 smithi189 ceph-mon[32756]: pgmap v18183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:34:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:09 smithi189 ceph-mon[32756]: pgmap v18184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33344.948012 secs 2024-04-27T03:34:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:09 smithi189 ceph-mon[32756]: 25 slow requests, 1 included below; oldest blocked for > 32647.913829 secs 2024-04-27T03:34:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:09 smithi189 ceph-mon[32756]: slow request 5760.878913 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:34:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:09 smithi156 ceph-mon[32679]: pgmap v18183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:34:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:09 smithi156 ceph-mon[32679]: pgmap v18184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33344.948012 secs 2024-04-27T03:34:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:09 smithi156 ceph-mon[32679]: 25 slow requests, 1 included below; oldest blocked for > 32647.913829 secs 2024-04-27T03:34:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:09 smithi156 ceph-mon[32679]: slow request 5760.878913 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:34:11.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:11 smithi092 ceph-mon[29156]: pgmap v18185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:11 smithi189 ceph-mon[32756]: pgmap v18185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:11 smithi156 ceph-mon[32679]: pgmap v18185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:13.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:13 smithi092 ceph-mon[29156]: pgmap v18186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:14.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:13 smithi189 ceph-mon[32756]: pgmap v18186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:13 smithi156 ceph-mon[32679]: pgmap v18186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:34:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33349.948120 secs 2024-04-27T03:34:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:14 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32652.913898 secs 2024-04-27T03:34:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33349.948120 secs 2024-04-27T03:34:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:14 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32652.913898 secs 2024-04-27T03:34:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33349.948120 secs 2024-04-27T03:34:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:14 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32652.913898 secs 2024-04-27T03:34:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:15 smithi189 ceph-mon[32756]: pgmap v18187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:15 smithi156 ceph-mon[32679]: pgmap v18187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:16.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:15 smithi092 ceph-mon[29156]: pgmap v18187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:18.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:17 smithi189 ceph-mon[32756]: pgmap v18188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:17 smithi156 ceph-mon[32679]: pgmap v18188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:17 smithi092 ceph-mon[29156]: pgmap v18188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:34:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:19 smithi189 ceph-mon[32756]: pgmap v18189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:34:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33354.948237 secs 2024-04-27T03:34:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:19 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32657.913993 secs 2024-04-27T03:34:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:19 smithi156 ceph-mon[32679]: pgmap v18189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:34:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33354.948237 secs 2024-04-27T03:34:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:19 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32657.913993 secs 2024-04-27T03:34:20.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:19 smithi092 ceph-mon[29156]: pgmap v18189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:34:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33354.948237 secs 2024-04-27T03:34:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:19 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32657.913993 secs 2024-04-27T03:34:22.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:21 smithi189 ceph-mon[32756]: pgmap v18190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:21 smithi156 ceph-mon[32679]: pgmap v18190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:22.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:21 smithi092 ceph-mon[29156]: pgmap v18190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:24.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:23 smithi189 ceph-mon[32756]: pgmap v18191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:24.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:23 smithi156 ceph-mon[32679]: pgmap v18191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:24.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:23 smithi092 ceph-mon[29156]: pgmap v18191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33359.948386 secs 2024-04-27T03:34:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:24 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32662.914058 secs 2024-04-27T03:34:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33359.948386 secs 2024-04-27T03:34:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:24 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32662.914058 secs 2024-04-27T03:34:25.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33359.948386 secs 2024-04-27T03:34:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:24 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32662.914058 secs 2024-04-27T03:34:26.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:25 smithi189 ceph-mon[32756]: pgmap v18192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:26.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:25 smithi156 ceph-mon[32679]: pgmap v18192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:26.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:25 smithi092 ceph-mon[29156]: pgmap v18192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:28.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:27 smithi189 ceph-mon[32756]: pgmap v18193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:28.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:27 smithi156 ceph-mon[32679]: pgmap v18193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:28.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:27 smithi092 ceph-mon[29156]: pgmap v18193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:30.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:29 smithi189 ceph-mon[32756]: pgmap v18194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:30.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33364.948532 secs 2024-04-27T03:34:30.147 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:29 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32667.914178 secs 2024-04-27T03:34:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:29 smithi156 ceph-mon[32679]: pgmap v18194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33364.948532 secs 2024-04-27T03:34:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:29 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32667.914178 secs 2024-04-27T03:34:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:29 smithi092 ceph-mon[29156]: pgmap v18194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33364.948532 secs 2024-04-27T03:34:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:29 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32667.914178 secs 2024-04-27T03:34:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:31 smithi189 ceph-mon[32756]: pgmap v18195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:32.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:31 smithi156 ceph-mon[32679]: pgmap v18195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:32.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:31 smithi092 ceph-mon[29156]: pgmap v18195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:34.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:33 smithi092 ceph-mon[29156]: pgmap v18196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:34.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:33 smithi189 ceph-mon[32756]: pgmap v18196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:34.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:33 smithi156 ceph-mon[32679]: pgmap v18196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33369.948675 secs 2024-04-27T03:34:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:34 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32672.914286 secs 2024-04-27T03:34:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33369.948675 secs 2024-04-27T03:34:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:34 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32672.914286 secs 2024-04-27T03:34:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33369.948675 secs 2024-04-27T03:34:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:34 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32672.914286 secs 2024-04-27T03:34:36.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:35 smithi189 ceph-mon[32756]: pgmap v18197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:36.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:35 smithi156 ceph-mon[32679]: pgmap v18197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:36.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:35 smithi092 ceph-mon[29156]: pgmap v18197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:38.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:37 smithi189 ceph-mon[32756]: pgmap v18198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:38.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:37 smithi156 ceph-mon[32679]: pgmap v18198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:38.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:37 smithi092 ceph-mon[29156]: pgmap v18198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:39 smithi189 ceph-mon[32756]: pgmap v18199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33374.948790 secs 2024-04-27T03:34:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:39 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32677.914403 secs 2024-04-27T03:34:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:39 smithi156 ceph-mon[32679]: pgmap v18199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33374.948790 secs 2024-04-27T03:34:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:39 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32677.914403 secs 2024-04-27T03:34:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:39 smithi092 ceph-mon[29156]: pgmap v18199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33374.948790 secs 2024-04-27T03:34:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:39 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32677.914403 secs 2024-04-27T03:34:42.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:41 smithi189 ceph-mon[32756]: pgmap v18200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:42.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:41 smithi156 ceph-mon[32679]: pgmap v18200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:42.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:41 smithi092 ceph-mon[29156]: pgmap v18200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:44.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:43 smithi189 ceph-mon[32756]: pgmap v18201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:44.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:43 smithi156 ceph-mon[32679]: pgmap v18201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:44.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:43 smithi092 ceph-mon[29156]: pgmap v18201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33379.948866 secs 2024-04-27T03:34:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:44 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32682.914544 secs 2024-04-27T03:34:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33379.948866 secs 2024-04-27T03:34:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:44 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32682.914544 secs 2024-04-27T03:34:45.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33379.948866 secs 2024-04-27T03:34:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:44 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32682.914544 secs 2024-04-27T03:34:46.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:45 smithi189 ceph-mon[32756]: pgmap v18202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:45 smithi156 ceph-mon[32679]: pgmap v18202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:46.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:45 smithi092 ceph-mon[29156]: pgmap v18202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:48.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:47 smithi189 ceph-mon[32756]: pgmap v18203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:47 smithi156 ceph-mon[32679]: pgmap v18203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:48.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:47 smithi092 ceph-mon[29156]: pgmap v18203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:49 smithi189 ceph-mon[32756]: pgmap v18204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33384.948977 secs 2024-04-27T03:34:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:49 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32687.914641 secs 2024-04-27T03:34:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:49 smithi156 ceph-mon[32679]: pgmap v18204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33384.948977 secs 2024-04-27T03:34:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:49 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32687.914641 secs 2024-04-27T03:34:50.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:49 smithi092 ceph-mon[29156]: pgmap v18204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33384.948977 secs 2024-04-27T03:34:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:49 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32687.914641 secs 2024-04-27T03:34:52.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:51 smithi189 ceph-mon[32756]: pgmap v18205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:52.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:51 smithi156 ceph-mon[32679]: pgmap v18205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:52.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:51 smithi092 ceph-mon[29156]: pgmap v18205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:54.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:53 smithi189 ceph-mon[32756]: pgmap v18206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:54.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:53 smithi156 ceph-mon[32679]: pgmap v18206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:54.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:53 smithi092 ceph-mon[29156]: pgmap v18206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33389.949090 secs 2024-04-27T03:34:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:54 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32692.914710 secs 2024-04-27T03:34:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33389.949090 secs 2024-04-27T03:34:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:54 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32692.914710 secs 2024-04-27T03:34:55.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33389.949090 secs 2024-04-27T03:34:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:54 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32692.914710 secs 2024-04-27T03:34:56.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:55 smithi189 ceph-mon[32756]: pgmap v18207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:56.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:55 smithi156 ceph-mon[32679]: pgmap v18207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:56.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:55 smithi092 ceph-mon[29156]: pgmap v18207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:34:58.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:57 smithi189 ceph-mon[32756]: pgmap v18208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:58.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:57 smithi156 ceph-mon[32679]: pgmap v18208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:58.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:57 smithi092 ceph-mon[29156]: pgmap v18208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:58 smithi189 ceph-mon[32756]: pgmap v18209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:58 smithi156 ceph-mon[32679]: pgmap v18209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:34:59.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:58 smithi092 ceph-mon[29156]: pgmap v18209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33394.949202 secs 2024-04-27T03:35:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:34:59 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32697.914793 secs 2024-04-27T03:35:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33394.949202 secs 2024-04-27T03:35:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:34:59 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32697.914793 secs 2024-04-27T03:35:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33394.949202 secs 2024-04-27T03:35:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:34:59 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32697.914793 secs 2024-04-27T03:35:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:00 smithi092 ceph-mon[29156]: pgmap v18210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:00 smithi156 ceph-mon[32679]: pgmap v18210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:01.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:00 smithi189 ceph-mon[32756]: pgmap v18210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:03.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:03 smithi156 ceph-mon[32679]: pgmap v18211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:03.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:03 smithi092 ceph-mon[29156]: pgmap v18211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:03.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:03 smithi189 ceph-mon[32756]: pgmap v18211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33399.949310 secs 2024-04-27T03:35:04.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:04 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32702.914908 secs 2024-04-27T03:35:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33399.949310 secs 2024-04-27T03:35:04.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:04 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32702.914908 secs 2024-04-27T03:35:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33399.949310 secs 2024-04-27T03:35:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:04 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32702.914908 secs 2024-04-27T03:35:05.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:05 smithi156 ceph-mon[32679]: pgmap v18212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:05.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:05 smithi092 ceph-mon[29156]: pgmap v18212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:05.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:05 smithi189 ceph-mon[32756]: pgmap v18212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:07.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:07 smithi156 ceph-mon[32679]: pgmap v18213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:07.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:07 smithi092 ceph-mon[29156]: pgmap v18213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:07.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:07 smithi189 ceph-mon[32756]: pgmap v18213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: pgmap v18214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33404.949377 secs 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: 25 slow requests, 0 included below; oldest blocked for > 32707.914977 secs 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:35:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:35:09.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:35:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: pgmap v18214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:35:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33404.949377 secs 2024-04-27T03:35:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: 25 slow requests, 0 included below; oldest blocked for > 32707.914977 secs 2024-04-27T03:35:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:35:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:35:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: pgmap v18214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33404.949377 secs 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: 25 slow requests, 0 included below; oldest blocked for > 32707.914977 secs 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:35:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:35:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:10 smithi092 ceph-mon[29156]: pgmap v18215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:35:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:10 smithi092 ceph-mon[29156]: pgmap v18216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:10 smithi189 ceph-mon[32756]: pgmap v18215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:35:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:10 smithi189 ceph-mon[32756]: pgmap v18216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:10 smithi156 ceph-mon[32679]: pgmap v18215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:35:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:10 smithi156 ceph-mon[32679]: pgmap v18216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:12.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:12 smithi092 ceph-mon[29156]: pgmap v18217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:12.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:12 smithi189 ceph-mon[32756]: pgmap v18217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:12 smithi156 ceph-mon[32679]: pgmap v18217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:14 smithi092 ceph-mon[29156]: pgmap v18218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:35:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 33409.949490 secs 2024-04-27T03:35:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:14 smithi092 ceph-mon[29156]: slow request 1444.503996 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:35:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:14 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 32712.915042 secs 2024-04-27T03:35:14.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:14 smithi092 ceph-mon[29156]: slow request 184.359492 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:35:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:14 smithi189 ceph-mon[32756]: pgmap v18218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:35:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 33409.949490 secs 2024-04-27T03:35:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:14 smithi189 ceph-mon[32756]: slow request 1444.503996 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:35:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:14 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 32712.915042 secs 2024-04-27T03:35:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:14 smithi189 ceph-mon[32756]: slow request 184.359492 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:35:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:14 smithi156 ceph-mon[32679]: pgmap v18218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:35:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 33409.949490 secs 2024-04-27T03:35:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:14 smithi156 ceph-mon[32679]: slow request 1444.503996 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:35:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:14 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 32712.915042 secs 2024-04-27T03:35:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:14 smithi156 ceph-mon[32679]: slow request 184.359492 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T03:35:16.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:16 smithi092 ceph-mon[29156]: pgmap v18219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:16.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:16 smithi189 ceph-mon[32756]: pgmap v18219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:16 smithi156 ceph-mon[32679]: pgmap v18219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:18 smithi092 ceph-mon[29156]: pgmap v18220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:35:18.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:35:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:18 smithi189 ceph-mon[32756]: pgmap v18220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:35:18.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:35:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:18 smithi156 ceph-mon[32679]: pgmap v18220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:35:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T03:35:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T03:35:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33414.949628 secs 2024-04-27T03:35:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32717.915148 secs 2024-04-27T03:35:19.794 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33414.949628 secs 2024-04-27T03:35:19.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32717.915148 secs 2024-04-27T03:35:19.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33414.949628 secs 2024-04-27T03:35:19.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32717.915148 secs 2024-04-27T03:35:20.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:20 smithi092 ceph-mon[29156]: pgmap v18221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:35:20.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:20 smithi189 ceph-mon[32756]: pgmap v18221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:35:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:20 smithi156 ceph-mon[32679]: pgmap v18221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:35:22.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:22 smithi092 ceph-mon[29156]: pgmap v18222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:22.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:22 smithi189 ceph-mon[32756]: pgmap v18222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:22 smithi156 ceph-mon[32679]: pgmap v18222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:24 smithi092 ceph-mon[29156]: pgmap v18223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33419.949745 secs 2024-04-27T03:35:24.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32722.915251 secs 2024-04-27T03:35:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:24 smithi189 ceph-mon[32756]: pgmap v18223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33419.949745 secs 2024-04-27T03:35:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32722.915251 secs 2024-04-27T03:35:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:24 smithi156 ceph-mon[32679]: pgmap v18223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33419.949745 secs 2024-04-27T03:35:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32722.915251 secs 2024-04-27T03:35:26.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:26 smithi092 ceph-mon[29156]: pgmap v18224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:26.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:26 smithi189 ceph-mon[32756]: pgmap v18224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:26 smithi156 ceph-mon[32679]: pgmap v18224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:28.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:28 smithi092 ceph-mon[29156]: pgmap v18225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:28.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:28 smithi189 ceph-mon[32756]: pgmap v18225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:28.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:28 smithi156 ceph-mon[32679]: pgmap v18225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:29.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33424.949899 secs 2024-04-27T03:35:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32727.915332 secs 2024-04-27T03:35:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33424.949899 secs 2024-04-27T03:35:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32727.915332 secs 2024-04-27T03:35:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33424.949899 secs 2024-04-27T03:35:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32727.915332 secs 2024-04-27T03:35:30.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:30 smithi092 ceph-mon[29156]: pgmap v18226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:30.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:30 smithi189 ceph-mon[32756]: pgmap v18226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:30.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:30 smithi156 ceph-mon[32679]: pgmap v18226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:32.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:32 smithi092 ceph-mon[29156]: pgmap v18227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:32.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:32 smithi189 ceph-mon[32756]: pgmap v18227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:32 smithi156 ceph-mon[32679]: pgmap v18227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:34 smithi092 ceph-mon[29156]: pgmap v18228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33429.949992 secs 2024-04-27T03:35:34.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32732.915399 secs 2024-04-27T03:35:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:34 smithi189 ceph-mon[32756]: pgmap v18228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33429.949992 secs 2024-04-27T03:35:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32732.915399 secs 2024-04-27T03:35:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:34 smithi156 ceph-mon[32679]: pgmap v18228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33429.949992 secs 2024-04-27T03:35:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32732.915399 secs 2024-04-27T03:35:36.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:36 smithi092 ceph-mon[29156]: pgmap v18229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:36.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:36 smithi189 ceph-mon[32756]: pgmap v18229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:36 smithi156 ceph-mon[32679]: pgmap v18229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:38.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:38 smithi189 ceph-mon[32756]: pgmap v18230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:38 smithi156 ceph-mon[32679]: pgmap v18230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:38 smithi092 ceph-mon[29156]: pgmap v18230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33434.950127 secs 2024-04-27T03:35:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32737.915538 secs 2024-04-27T03:35:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33434.950127 secs 2024-04-27T03:35:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32737.915538 secs 2024-04-27T03:35:39.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33434.950127 secs 2024-04-27T03:35:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32737.915538 secs 2024-04-27T03:35:40.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:40 smithi189 ceph-mon[32756]: pgmap v18231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:40 smithi156 ceph-mon[32679]: pgmap v18231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:40 smithi092 ceph-mon[29156]: pgmap v18231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:42.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:42 smithi189 ceph-mon[32756]: pgmap v18232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:42 smithi156 ceph-mon[32679]: pgmap v18232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:42.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:42 smithi092 ceph-mon[29156]: pgmap v18232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:44 smithi189 ceph-mon[32756]: pgmap v18233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33439.950238 secs 2024-04-27T03:35:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32742.915678 secs 2024-04-27T03:35:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:44 smithi156 ceph-mon[32679]: pgmap v18233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33439.950238 secs 2024-04-27T03:35:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32742.915678 secs 2024-04-27T03:35:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:44 smithi092 ceph-mon[29156]: pgmap v18233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33439.950238 secs 2024-04-27T03:35:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32742.915678 secs 2024-04-27T03:35:46.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:46 smithi189 ceph-mon[32756]: pgmap v18234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:46.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:46 smithi156 ceph-mon[32679]: pgmap v18234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:46 smithi092 ceph-mon[29156]: pgmap v18234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:48.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:48 smithi189 ceph-mon[32756]: pgmap v18235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:48.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:48 smithi156 ceph-mon[32679]: pgmap v18235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:48.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:48 smithi092 ceph-mon[29156]: pgmap v18235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:49.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33444.950329 secs 2024-04-27T03:35:49.795 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32747.915739 secs 2024-04-27T03:35:49.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33444.950329 secs 2024-04-27T03:35:49.840 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32747.915739 secs 2024-04-27T03:35:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33444.950329 secs 2024-04-27T03:35:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32747.915739 secs 2024-04-27T03:35:50.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:50 smithi189 ceph-mon[32756]: pgmap v18236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:50 smithi156 ceph-mon[32679]: pgmap v18236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:50.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:50 smithi092 ceph-mon[29156]: pgmap v18236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:52.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:52 smithi189 ceph-mon[32756]: pgmap v18237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:52.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:52 smithi156 ceph-mon[32679]: pgmap v18237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:52 smithi092 ceph-mon[29156]: pgmap v18237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:54 smithi189 ceph-mon[32756]: pgmap v18238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33449.950450 secs 2024-04-27T03:35:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32752.915856 secs 2024-04-27T03:35:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:54 smithi156 ceph-mon[32679]: pgmap v18238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33449.950450 secs 2024-04-27T03:35:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32752.915856 secs 2024-04-27T03:35:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:54 smithi092 ceph-mon[29156]: pgmap v18238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33449.950450 secs 2024-04-27T03:35:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32752.915856 secs 2024-04-27T03:35:56.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:56 smithi189 ceph-mon[32756]: pgmap v18239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:56.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:56 smithi156 ceph-mon[32679]: pgmap v18239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:56 smithi092 ceph-mon[29156]: pgmap v18239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:35:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:58 smithi189 ceph-mon[32756]: pgmap v18240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:58 smithi156 ceph-mon[32679]: pgmap v18240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:58 smithi092 ceph-mon[29156]: pgmap v18240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:35:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33454.950566 secs 2024-04-27T03:35:59.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:35:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32757.915967 secs 2024-04-27T03:35:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33454.950566 secs 2024-04-27T03:35:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:35:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32757.915967 secs 2024-04-27T03:35:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33454.950566 secs 2024-04-27T03:35:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:35:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32757.915967 secs 2024-04-27T03:36:00.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:00 smithi189 ceph-mon[32756]: pgmap v18241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:00 smithi156 ceph-mon[32679]: pgmap v18241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:00 smithi092 ceph-mon[29156]: pgmap v18241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:02.801 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:02 smithi092 ceph-mon[29156]: pgmap v18242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:02.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:02 smithi189 ceph-mon[32756]: pgmap v18242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:02 smithi156 ceph-mon[32679]: pgmap v18242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:04.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:04 smithi189 ceph-mon[32756]: pgmap v18243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33459.950680 secs 2024-04-27T03:36:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32762.916105 secs 2024-04-27T03:36:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:04 smithi156 ceph-mon[32679]: pgmap v18243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33459.950680 secs 2024-04-27T03:36:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32762.916105 secs 2024-04-27T03:36:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:04 smithi092 ceph-mon[29156]: pgmap v18243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33459.950680 secs 2024-04-27T03:36:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32762.916105 secs 2024-04-27T03:36:06.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:06 smithi189 ceph-mon[32756]: pgmap v18244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:06 smithi156 ceph-mon[32679]: pgmap v18244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:06.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:06 smithi092 ceph-mon[29156]: pgmap v18244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:08.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:08 smithi189 ceph-mon[32756]: pgmap v18245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:08 smithi156 ceph-mon[32679]: pgmap v18245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:08 smithi092 ceph-mon[29156]: pgmap v18245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33464.950819 secs 2024-04-27T03:36:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:09 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 32767.916227 secs 2024-04-27T03:36:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:09 smithi189 ceph-mon[32756]: slow request 11522.465988 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:36:09.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:36:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33464.950819 secs 2024-04-27T03:36:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:09 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 32767.916227 secs 2024-04-27T03:36:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:09 smithi156 ceph-mon[32679]: slow request 11522.465988 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:36:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:36:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33464.950819 secs 2024-04-27T03:36:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:09 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 32767.916227 secs 2024-04-27T03:36:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:09 smithi092 ceph-mon[29156]: slow request 11522.465988 seconds old, received at 2024-04-27T00:24:06.596273+0000: client_request(client.17253:1 getattr pAsLsXsFs #0x1 2024-04-27T00:24:06.592001+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:36:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:36:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:10 smithi189 ceph-mon[32756]: pgmap v18246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:36:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:36:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:36:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:10 smithi156 ceph-mon[32679]: pgmap v18246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:36:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:36:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:36:10.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:10 smithi092 ceph-mon[29156]: pgmap v18246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:36:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:36:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:36:11.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:11 smithi189 ceph-mon[32756]: pgmap v18247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:36:11.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:11 smithi189 ceph-mon[32756]: pgmap v18248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:11.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:11 smithi156 ceph-mon[32679]: pgmap v18247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:36:11.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:11 smithi156 ceph-mon[32679]: pgmap v18248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:11.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:11 smithi092 ceph-mon[29156]: pgmap v18247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:36:11.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:11 smithi092 ceph-mon[29156]: pgmap v18248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:13.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:13 smithi189 ceph-mon[32756]: pgmap v18249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:13.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:13 smithi156 ceph-mon[32679]: pgmap v18249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:13.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:13 smithi092 ceph-mon[29156]: pgmap v18249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33469.950936 secs 2024-04-27T03:36:14.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32772.916298 secs 2024-04-27T03:36:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33469.950936 secs 2024-04-27T03:36:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32772.916298 secs 2024-04-27T03:36:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33469.950936 secs 2024-04-27T03:36:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32772.916298 secs 2024-04-27T03:36:15.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:15 smithi189 ceph-mon[32756]: pgmap v18250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:15.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:15 smithi156 ceph-mon[32679]: pgmap v18250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:15.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:15 smithi092 ceph-mon[29156]: pgmap v18250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:17.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:17 smithi189 ceph-mon[32756]: pgmap v18251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:17.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:17 smithi156 ceph-mon[32679]: pgmap v18251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:17.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:17 smithi092 ceph-mon[29156]: pgmap v18251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:36:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:19 smithi189 ceph-mon[32756]: pgmap v18252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:36:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33474.951050 secs 2024-04-27T03:36:19.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32777.916405 secs 2024-04-27T03:36:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:19 smithi156 ceph-mon[32679]: pgmap v18252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:36:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33474.951050 secs 2024-04-27T03:36:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32777.916405 secs 2024-04-27T03:36:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:19 smithi092 ceph-mon[29156]: pgmap v18252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:36:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33474.951050 secs 2024-04-27T03:36:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32777.916405 secs 2024-04-27T03:36:21.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:21 smithi189 ceph-mon[32756]: pgmap v18253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:36:21.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:21 smithi156 ceph-mon[32679]: pgmap v18253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:36:21.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:21 smithi092 ceph-mon[29156]: pgmap v18253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:36:23.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:23 smithi189 ceph-mon[32756]: pgmap v18254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:23.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:23 smithi156 ceph-mon[32679]: pgmap v18254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:23.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:23 smithi092 ceph-mon[29156]: pgmap v18254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33479.951166 secs 2024-04-27T03:36:24.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32782.916509 secs 2024-04-27T03:36:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33479.951166 secs 2024-04-27T03:36:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32782.916509 secs 2024-04-27T03:36:24.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33479.951166 secs 2024-04-27T03:36:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32782.916509 secs 2024-04-27T03:36:25.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:25 smithi189 ceph-mon[32756]: pgmap v18255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:25.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:25 smithi156 ceph-mon[32679]: pgmap v18255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:25 smithi092 ceph-mon[29156]: pgmap v18255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:27.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:27 smithi189 ceph-mon[32756]: pgmap v18256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:27.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:27 smithi156 ceph-mon[32679]: pgmap v18256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:27.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:27 smithi092 ceph-mon[29156]: pgmap v18256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:29 smithi189 ceph-mon[32756]: pgmap v18257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:29.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33484.951229 secs 2024-04-27T03:36:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32787.916580 secs 2024-04-27T03:36:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:29 smithi156 ceph-mon[32679]: pgmap v18257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33484.951229 secs 2024-04-27T03:36:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32787.916580 secs 2024-04-27T03:36:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:29 smithi092 ceph-mon[29156]: pgmap v18257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33484.951229 secs 2024-04-27T03:36:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32787.916580 secs 2024-04-27T03:36:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:31 smithi189 ceph-mon[32756]: pgmap v18258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:31.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:31 smithi156 ceph-mon[32679]: pgmap v18258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:31 smithi092 ceph-mon[29156]: pgmap v18258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:33.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:33 smithi189 ceph-mon[32756]: pgmap v18259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:33 smithi156 ceph-mon[32679]: pgmap v18259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:33 smithi092 ceph-mon[29156]: pgmap v18259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:34.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33489.951363 secs 2024-04-27T03:36:34.950 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32792.916682 secs 2024-04-27T03:36:34.951 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33489.951363 secs 2024-04-27T03:36:34.951 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32792.916682 secs 2024-04-27T03:36:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33489.951363 secs 2024-04-27T03:36:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32792.916682 secs 2024-04-27T03:36:35.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:35 smithi189 ceph-mon[32756]: pgmap v18260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:35.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:35 smithi156 ceph-mon[32679]: pgmap v18260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:35 smithi092 ceph-mon[29156]: pgmap v18260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:37.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:37 smithi189 ceph-mon[32756]: pgmap v18261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:37.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:37 smithi156 ceph-mon[32679]: pgmap v18261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:37.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:37 smithi092 ceph-mon[29156]: pgmap v18261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:39 smithi189 ceph-mon[32756]: pgmap v18262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33494.951501 secs 2024-04-27T03:36:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32797.916811 secs 2024-04-27T03:36:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:39 smithi156 ceph-mon[32679]: pgmap v18262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33494.951501 secs 2024-04-27T03:36:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32797.916811 secs 2024-04-27T03:36:39.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:39 smithi092 ceph-mon[29156]: pgmap v18262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33494.951501 secs 2024-04-27T03:36:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32797.916811 secs 2024-04-27T03:36:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:36:40.582+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:36:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:36:40.582+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:36:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:36:40.582+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:36:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:36:40.582+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 258 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:36:41.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:41 smithi189 ceph-mon[32756]: pgmap v18263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:41.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:41 smithi156 ceph-mon[32679]: pgmap v18263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:41.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:41 smithi092 ceph-mon[29156]: pgmap v18263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:43.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:43 smithi189 ceph-mon[32756]: pgmap v18264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:43.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:43 smithi156 ceph-mon[32679]: pgmap v18264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:43.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:43 smithi092 ceph-mon[29156]: pgmap v18264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33499.951633 secs 2024-04-27T03:36:44.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32802.916945 secs 2024-04-27T03:36:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33499.951633 secs 2024-04-27T03:36:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32802.916945 secs 2024-04-27T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33499.951633 secs 2024-04-27T03:36:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32802.916945 secs 2024-04-27T03:36:45.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:45 smithi189 ceph-mon[32756]: pgmap v18265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:45.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:45 smithi156 ceph-mon[32679]: pgmap v18265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:45.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:45 smithi092 ceph-mon[29156]: pgmap v18265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:47.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:47 smithi156 ceph-mon[32679]: pgmap v18266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:47.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:47 smithi092 ceph-mon[29156]: pgmap v18266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:48.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:47 smithi189 ceph-mon[32756]: pgmap v18266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:49 smithi156 ceph-mon[32679]: pgmap v18267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33504.951745 secs 2024-04-27T03:36:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32807.917044 secs 2024-04-27T03:36:49.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:49 smithi189 ceph-mon[32756]: pgmap v18267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:49.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33504.951745 secs 2024-04-27T03:36:49.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32807.917044 secs 2024-04-27T03:36:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:49 smithi092 ceph-mon[29156]: pgmap v18267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33504.951745 secs 2024-04-27T03:36:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32807.917044 secs 2024-04-27T03:36:51.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:51 smithi156 ceph-mon[32679]: pgmap v18268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:51.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:51 smithi092 ceph-mon[29156]: pgmap v18268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:52.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:51 smithi189 ceph-mon[32756]: pgmap v18268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:53.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:53 smithi156 ceph-mon[32679]: pgmap v18269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:53.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:53 smithi092 ceph-mon[29156]: pgmap v18269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:54.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:53 smithi189 ceph-mon[32756]: pgmap v18269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33509.951893 secs 2024-04-27T03:36:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32812.917117 secs 2024-04-27T03:36:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33509.951893 secs 2024-04-27T03:36:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32812.917117 secs 2024-04-27T03:36:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33509.951893 secs 2024-04-27T03:36:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32812.917117 secs 2024-04-27T03:36:55.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:55 smithi156 ceph-mon[32679]: pgmap v18270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:55 smithi092 ceph-mon[29156]: pgmap v18270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:56.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:55 smithi189 ceph-mon[32756]: pgmap v18270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:36:57.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:57 smithi156 ceph-mon[32679]: pgmap v18271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:57.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:57 smithi092 ceph-mon[29156]: pgmap v18271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:58.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:57 smithi189 ceph-mon[32756]: pgmap v18271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:59 smithi156 ceph-mon[32679]: pgmap v18272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33514.951961 secs 2024-04-27T03:36:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:36:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32817.917236 secs 2024-04-27T03:36:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:59 smithi092 ceph-mon[29156]: pgmap v18272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:36:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33514.951961 secs 2024-04-27T03:36:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:36:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32817.917236 secs 2024-04-27T03:37:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:59 smithi189 ceph-mon[32756]: pgmap v18272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33514.951961 secs 2024-04-27T03:37:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:36:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32817.917236 secs 2024-04-27T03:37:01.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:01 smithi156 ceph-mon[32679]: pgmap v18273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:01 smithi092 ceph-mon[29156]: pgmap v18273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:01 smithi189 ceph-mon[32756]: pgmap v18273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:03.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:03 smithi156 ceph-mon[32679]: pgmap v18274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:03 smithi092 ceph-mon[29156]: pgmap v18274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:04.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:03 smithi189 ceph-mon[32756]: pgmap v18274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33519.952025 secs 2024-04-27T03:37:04.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32822.917357 secs 2024-04-27T03:37:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33519.952025 secs 2024-04-27T03:37:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32822.917357 secs 2024-04-27T03:37:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33519.952025 secs 2024-04-27T03:37:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32822.917357 secs 2024-04-27T03:37:05.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:05 smithi156 ceph-mon[32679]: pgmap v18275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:05.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:05 smithi092 ceph-mon[29156]: pgmap v18275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:06.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:05 smithi189 ceph-mon[32756]: pgmap v18275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:07.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:07 smithi156 ceph-mon[32679]: pgmap v18276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:07.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:07 smithi092 ceph-mon[29156]: pgmap v18276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:07 smithi189 ceph-mon[32756]: pgmap v18276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:09 smithi156 ceph-mon[32679]: pgmap v18277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33524.952146 secs 2024-04-27T03:37:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32827.917434 secs 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-mon[29156]: pgmap v18277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33524.952146 secs 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32827.917434 secs 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:37:09.800+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:37:09.800+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:37:09.800+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:37:09.800+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:37:09.999 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:37:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:37:09.800+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:37:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:09 smithi189 ceph-mon[32756]: pgmap v18277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33524.952146 secs 2024-04-27T03:37:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32827.917434 secs 2024-04-27T03:37:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:37:11.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:37:11.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:37:11.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:11 smithi156 ceph-mon[32679]: pgmap v18278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:11.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:11 smithi092 ceph-mon[29156]: pgmap v18278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:11 smithi189 ceph-mon[32756]: pgmap v18278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:37:13.962 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:13 smithi092 ceph-mon[29156]: pgmap v18279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:14.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:13 smithi156 ceph-mon[32679]: pgmap v18279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:14.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:13 smithi189 ceph-mon[32756]: pgmap v18279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33529.952262 secs 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32832.917515 secs 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:37:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:37:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33529.952262 secs 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32832.917515 secs 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:37:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33529.952262 secs 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32832.917515 secs 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:37:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:37:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:37:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:15 smithi092 ceph-mon[29156]: pgmap v18280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T03:37:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:15 smithi092 ceph-mon[29156]: pgmap v18281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 485 B/s wr, 17 op/s 2024-04-27T03:37:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:15 smithi092 ceph-mon[29156]: pgmap v18282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:15 smithi189 ceph-mon[32756]: pgmap v18280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T03:37:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:15 smithi189 ceph-mon[32756]: pgmap v18281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 485 B/s wr, 17 op/s 2024-04-27T03:37:16.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:15 smithi189 ceph-mon[32756]: pgmap v18282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:15 smithi156 ceph-mon[32679]: pgmap v18280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T03:37:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:15 smithi156 ceph-mon[32679]: pgmap v18281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 485 B/s wr, 17 op/s 2024-04-27T03:37:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:15 smithi156 ceph-mon[32679]: pgmap v18282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:17.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:17 smithi092 ceph-mon[29156]: pgmap v18283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:18.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:17 smithi189 ceph-mon[32756]: pgmap v18283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:17 smithi156 ceph-mon[32679]: pgmap v18283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:19.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:19 smithi156 ceph-mon[32679]: pgmap v18284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 B/s wr, 18 op/s 2024-04-27T03:37:19.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33534.952381 secs 2024-04-27T03:37:19.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32837.917628 secs 2024-04-27T03:37:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:19 smithi092 ceph-mon[29156]: pgmap v18284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 B/s wr, 18 op/s 2024-04-27T03:37:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33534.952381 secs 2024-04-27T03:37:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32837.917628 secs 2024-04-27T03:37:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:19 smithi189 ceph-mon[32756]: pgmap v18284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 B/s wr, 18 op/s 2024-04-27T03:37:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33534.952381 secs 2024-04-27T03:37:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32837.917628 secs 2024-04-27T03:37:21.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:21 smithi092 ceph-mon[29156]: pgmap v18285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:22.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:21 smithi189 ceph-mon[32756]: pgmap v18285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:21 smithi156 ceph-mon[32679]: pgmap v18285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 599 B/s wr, 21 op/s 2024-04-27T03:37:23.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:23 smithi092 ceph-mon[29156]: pgmap v18286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:37:24.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:23 smithi189 ceph-mon[32756]: pgmap v18286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:37:24.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:23 smithi156 ceph-mon[32679]: pgmap v18286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:37:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33539.952503 secs 2024-04-27T03:37:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32842.917709 secs 2024-04-27T03:37:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33539.952503 secs 2024-04-27T03:37:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32842.917709 secs 2024-04-27T03:37:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33539.952503 secs 2024-04-27T03:37:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32842.917709 secs 2024-04-27T03:37:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:25 smithi092 ceph-mon[29156]: pgmap v18287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:37:26.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:25 smithi189 ceph-mon[32756]: pgmap v18287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:37:26.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:25 smithi156 ceph-mon[32679]: pgmap v18287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:37:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:27 smithi092 ceph-mon[29156]: pgmap v18288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:28.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:27 smithi189 ceph-mon[32756]: pgmap v18288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:28.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:27 smithi156 ceph-mon[32679]: pgmap v18288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:29 smithi092 ceph-mon[29156]: pgmap v18289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33544.952639 secs 2024-04-27T03:37:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32847.917787 secs 2024-04-27T03:37:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:29 smithi189 ceph-mon[32756]: pgmap v18289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33544.952639 secs 2024-04-27T03:37:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32847.917787 secs 2024-04-27T03:37:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:29 smithi156 ceph-mon[32679]: pgmap v18289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33544.952639 secs 2024-04-27T03:37:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32847.917787 secs 2024-04-27T03:37:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:31 smithi092 ceph-mon[29156]: pgmap v18290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:31 smithi189 ceph-mon[32756]: pgmap v18290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:32.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:31 smithi156 ceph-mon[32679]: pgmap v18290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:33 smithi092 ceph-mon[29156]: pgmap v18291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:34.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:33 smithi189 ceph-mon[32756]: pgmap v18291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:34.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:33 smithi156 ceph-mon[32679]: pgmap v18291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33549.952776 secs 2024-04-27T03:37:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32852.917906 secs 2024-04-27T03:37:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33549.952776 secs 2024-04-27T03:37:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32852.917906 secs 2024-04-27T03:37:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33549.952776 secs 2024-04-27T03:37:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32852.917906 secs 2024-04-27T03:37:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:35 smithi092 ceph-mon[29156]: pgmap v18292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:36.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:35 smithi189 ceph-mon[32756]: pgmap v18292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:36.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:35 smithi156 ceph-mon[32679]: pgmap v18292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:37.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:37 smithi092 ceph-mon[29156]: pgmap v18293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:38.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:37 smithi189 ceph-mon[32756]: pgmap v18293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:38.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:37 smithi156 ceph-mon[32679]: pgmap v18293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:39 smithi189 ceph-mon[32756]: pgmap v18294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33554.952896 secs 2024-04-27T03:37:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32857.918003 secs 2024-04-27T03:37:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:39 smithi156 ceph-mon[32679]: pgmap v18294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33554.952896 secs 2024-04-27T03:37:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32857.918003 secs 2024-04-27T03:37:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:39 smithi092 ceph-mon[29156]: pgmap v18294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33554.952896 secs 2024-04-27T03:37:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32857.918003 secs 2024-04-27T03:37:42.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:41 smithi189 ceph-mon[32756]: pgmap v18295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:42.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:41 smithi156 ceph-mon[32679]: pgmap v18295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:42.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:41 smithi092 ceph-mon[29156]: pgmap v18295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:44.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:43 smithi189 ceph-mon[32756]: pgmap v18296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:44.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:43 smithi156 ceph-mon[32679]: pgmap v18296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:44.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:43 smithi092 ceph-mon[29156]: pgmap v18296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33559.953016 secs 2024-04-27T03:37:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32862.918126 secs 2024-04-27T03:37:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33559.953016 secs 2024-04-27T03:37:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32862.918126 secs 2024-04-27T03:37:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33559.953016 secs 2024-04-27T03:37:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32862.918126 secs 2024-04-27T03:37:45.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:45 smithi092 ceph-mon[29156]: pgmap v18297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:46.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:45 smithi189 ceph-mon[32756]: pgmap v18297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:45 smithi156 ceph-mon[32679]: pgmap v18297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:48.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:47 smithi189 ceph-mon[32756]: pgmap v18298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:47 smithi156 ceph-mon[32679]: pgmap v18298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:48.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:47 smithi092 ceph-mon[29156]: pgmap v18298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:49 smithi189 ceph-mon[32756]: pgmap v18299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33564.953144 secs 2024-04-27T03:37:50.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32867.918201 secs 2024-04-27T03:37:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:49 smithi156 ceph-mon[32679]: pgmap v18299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33564.953144 secs 2024-04-27T03:37:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32867.918201 secs 2024-04-27T03:37:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:49 smithi092 ceph-mon[29156]: pgmap v18299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33564.953144 secs 2024-04-27T03:37:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32867.918201 secs 2024-04-27T03:37:51.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:51 smithi092 ceph-mon[29156]: pgmap v18300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:52.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:51 smithi189 ceph-mon[32756]: pgmap v18300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:52.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:51 smithi156 ceph-mon[32679]: pgmap v18300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:54.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:53 smithi189 ceph-mon[32756]: pgmap v18301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:54.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:53 smithi156 ceph-mon[32679]: pgmap v18301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:54.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:53 smithi092 ceph-mon[29156]: pgmap v18301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33569.953209 secs 2024-04-27T03:37:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32872.918288 secs 2024-04-27T03:37:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33569.953209 secs 2024-04-27T03:37:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32872.918288 secs 2024-04-27T03:37:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33569.953209 secs 2024-04-27T03:37:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32872.918288 secs 2024-04-27T03:37:56.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:55 smithi189 ceph-mon[32756]: pgmap v18302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:56.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:55 smithi156 ceph-mon[32679]: pgmap v18302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:56.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:55 smithi092 ceph-mon[29156]: pgmap v18302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:37:58.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:57 smithi189 ceph-mon[32756]: pgmap v18303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:58.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:57 smithi156 ceph-mon[32679]: pgmap v18303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:37:58.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:57 smithi092 ceph-mon[29156]: pgmap v18303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:00.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:59 smithi189 ceph-mon[32756]: pgmap v18304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:00.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33574.953347 secs 2024-04-27T03:38:00.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:37:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32877.918405 secs 2024-04-27T03:38:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:59 smithi156 ceph-mon[32679]: pgmap v18304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33574.953347 secs 2024-04-27T03:38:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:37:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32877.918405 secs 2024-04-27T03:38:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:59 smithi092 ceph-mon[29156]: pgmap v18304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33574.953347 secs 2024-04-27T03:38:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:37:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32877.918405 secs 2024-04-27T03:38:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:01 smithi189 ceph-mon[32756]: pgmap v18305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:01 smithi156 ceph-mon[32679]: pgmap v18305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:02.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:01 smithi092 ceph-mon[29156]: pgmap v18305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:04.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:03 smithi092 ceph-mon[29156]: pgmap v18306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:04.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:03 smithi189 ceph-mon[32756]: pgmap v18306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:04.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:03 smithi156 ceph-mon[32679]: pgmap v18306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33579.953478 secs 2024-04-27T03:38:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32882.918487 secs 2024-04-27T03:38:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33579.953478 secs 2024-04-27T03:38:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32882.918487 secs 2024-04-27T03:38:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33579.953478 secs 2024-04-27T03:38:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32882.918487 secs 2024-04-27T03:38:06.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:05 smithi189 ceph-mon[32756]: pgmap v18307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:06.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:05 smithi156 ceph-mon[32679]: pgmap v18307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:05 smithi092 ceph-mon[29156]: pgmap v18307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:08.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:07 smithi189 ceph-mon[32756]: pgmap v18308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:07 smithi156 ceph-mon[32679]: pgmap v18308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:07 smithi092 ceph-mon[29156]: pgmap v18308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:09 smithi189 ceph-mon[32756]: pgmap v18309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33584.953616 secs 2024-04-27T03:38:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32887.918622 secs 2024-04-27T03:38:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:09 smithi156 ceph-mon[32679]: pgmap v18309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33584.953616 secs 2024-04-27T03:38:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32887.918622 secs 2024-04-27T03:38:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:09 smithi092 ceph-mon[29156]: pgmap v18309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33584.953616 secs 2024-04-27T03:38:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32887.918622 secs 2024-04-27T03:38:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:11 smithi189 ceph-mon[32756]: pgmap v18310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:11 smithi156 ceph-mon[32679]: pgmap v18310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:11 smithi092 ceph-mon[29156]: pgmap v18310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:14.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:13 smithi189 ceph-mon[32756]: pgmap v18311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:13 smithi156 ceph-mon[32679]: pgmap v18311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:13 smithi092 ceph-mon[29156]: pgmap v18311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:38:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33589.953749 secs 2024-04-27T03:38:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:14 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 32892.918745 secs 2024-04-27T03:38:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:14 smithi189 ceph-mon[32756]: slow request 364.363195 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:38:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:38:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33589.953749 secs 2024-04-27T03:38:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:14 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 32892.918745 secs 2024-04-27T03:38:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:14 smithi156 ceph-mon[32679]: slow request 364.363195 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:38:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:38:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33589.953749 secs 2024-04-27T03:38:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:14 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 32892.918745 secs 2024-04-27T03:38:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:14 smithi092 ceph-mon[29156]: slow request 364.363195 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:38:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:38:16.078 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:15 smithi189 ceph-mon[32756]: pgmap v18312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:15 smithi156 ceph-mon[32679]: pgmap v18312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:15 smithi092 ceph-mon[29156]: pgmap v18312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:38:18.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:17 smithi189 ceph-mon[32756]: pgmap v18313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:17 smithi156 ceph-mon[32679]: pgmap v18313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:17 smithi092 ceph-mon[29156]: pgmap v18313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: pgmap v18314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33594.953883 secs 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32897.918826 secs 2024-04-27T03:38:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: pgmap v18314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33594.953883 secs 2024-04-27T03:38:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:38:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:38:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32897.918826 secs 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: pgmap v18314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33594.953883 secs 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:38:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32897.918826 secs 2024-04-27T03:38:21.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:20 smithi189 ceph-mon[32756]: pgmap v18315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T03:38:21.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:20 smithi189 ceph-mon[32756]: pgmap v18316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:21.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:20 smithi156 ceph-mon[32679]: pgmap v18315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T03:38:21.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:20 smithi156 ceph-mon[32679]: pgmap v18316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:20 smithi092 ceph-mon[29156]: pgmap v18315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-27T03:38:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:20 smithi092 ceph-mon[29156]: pgmap v18316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:22 smithi189 ceph-mon[32756]: pgmap v18317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:22 smithi156 ceph-mon[32679]: pgmap v18317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:22 smithi092 ceph-mon[29156]: pgmap v18317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:24 smithi189 ceph-mon[32756]: pgmap v18318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:38:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33599.953992 secs 2024-04-27T03:38:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32902.918908 secs 2024-04-27T03:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:24 smithi156 ceph-mon[32679]: pgmap v18318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33599.953992 secs 2024-04-27T03:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32902.918908 secs 2024-04-27T03:38:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:24 smithi092 ceph-mon[29156]: pgmap v18318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:38:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33599.953992 secs 2024-04-27T03:38:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32902.918908 secs 2024-04-27T03:38:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:26 smithi189 ceph-mon[32756]: pgmap v18319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:26 smithi156 ceph-mon[32679]: pgmap v18319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:27.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:26 smithi092 ceph-mon[29156]: pgmap v18319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:28 smithi189 ceph-mon[32756]: pgmap v18320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:28 smithi156 ceph-mon[32679]: pgmap v18320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:28 smithi092 ceph-mon[29156]: pgmap v18320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:38:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33604.954116 secs 2024-04-27T03:38:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32907.919064 secs 2024-04-27T03:38:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33604.954116 secs 2024-04-27T03:38:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32907.919064 secs 2024-04-27T03:38:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33604.954116 secs 2024-04-27T03:38:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32907.919064 secs 2024-04-27T03:38:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:30 smithi189 ceph-mon[32756]: pgmap v18321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:38:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:30 smithi156 ceph-mon[32679]: pgmap v18321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:38:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:30 smithi092 ceph-mon[29156]: pgmap v18321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:38:33.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:32 smithi189 ceph-mon[32756]: pgmap v18322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:32 smithi156 ceph-mon[32679]: pgmap v18322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:32 smithi092 ceph-mon[29156]: pgmap v18322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:34 smithi189 ceph-mon[32756]: pgmap v18323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33609.954217 secs 2024-04-27T03:38:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32912.919137 secs 2024-04-27T03:38:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:34 smithi156 ceph-mon[32679]: pgmap v18323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33609.954217 secs 2024-04-27T03:38:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32912.919137 secs 2024-04-27T03:38:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:34 smithi092 ceph-mon[29156]: pgmap v18323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33609.954217 secs 2024-04-27T03:38:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32912.919137 secs 2024-04-27T03:38:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:36 smithi189 ceph-mon[32756]: pgmap v18324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:36 smithi156 ceph-mon[32679]: pgmap v18324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:36 smithi092 ceph-mon[29156]: pgmap v18324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:38 smithi189 ceph-mon[32756]: pgmap v18325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:38 smithi156 ceph-mon[32679]: pgmap v18325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:38 smithi092 ceph-mon[29156]: pgmap v18325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33614.954298 secs 2024-04-27T03:38:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32917.919203 secs 2024-04-27T03:38:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33614.954298 secs 2024-04-27T03:38:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32917.919203 secs 2024-04-27T03:38:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33614.954298 secs 2024-04-27T03:38:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32917.919203 secs 2024-04-27T03:38:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:40 smithi189 ceph-mon[32756]: pgmap v18326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:40 smithi156 ceph-mon[32679]: pgmap v18326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:40 smithi092 ceph-mon[29156]: pgmap v18326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:42.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:41 smithi156 ceph-mon[32679]: pgmap v18327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:42.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:41 smithi092 ceph-mon[29156]: pgmap v18327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:42.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:41 smithi189 ceph-mon[32756]: pgmap v18327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:44.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:43 smithi092 ceph-mon[29156]: pgmap v18328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:44.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:43 smithi189 ceph-mon[32756]: pgmap v18328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:44.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:43 smithi156 ceph-mon[32679]: pgmap v18328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:45.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33619.954411 secs 2024-04-27T03:38:45.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32922.919342 secs 2024-04-27T03:38:45.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33619.954411 secs 2024-04-27T03:38:45.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32922.919342 secs 2024-04-27T03:38:45.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33619.954411 secs 2024-04-27T03:38:45.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32922.919342 secs 2024-04-27T03:38:46.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:46 smithi189 ceph-mon[32756]: pgmap v18329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:46.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:46 smithi156 ceph-mon[32679]: pgmap v18329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:46.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:46 smithi092 ceph-mon[29156]: pgmap v18329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:48.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:48 smithi189 ceph-mon[32756]: pgmap v18330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:48.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:48 smithi156 ceph-mon[32679]: pgmap v18330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:48.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:48 smithi092 ceph-mon[29156]: pgmap v18330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33624.954506 secs 2024-04-27T03:38:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:50 smithi189 ceph-mon[32756]: pgmap v18331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:50 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32927.919423 secs 2024-04-27T03:38:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33624.954506 secs 2024-04-27T03:38:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:50 smithi156 ceph-mon[32679]: pgmap v18331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:50.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:50 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32927.919423 secs 2024-04-27T03:38:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33624.954506 secs 2024-04-27T03:38:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:50 smithi092 ceph-mon[29156]: pgmap v18331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:50.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:50 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32927.919423 secs 2024-04-27T03:38:52.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:52 smithi189 ceph-mon[32756]: pgmap v18332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:52.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:52 smithi156 ceph-mon[32679]: pgmap v18332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:52.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:52 smithi092 ceph-mon[29156]: pgmap v18332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:54.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:54 smithi189 ceph-mon[32756]: pgmap v18333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:54.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:54 smithi156 ceph-mon[32679]: pgmap v18333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:54.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:54 smithi092 ceph-mon[29156]: pgmap v18333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33629.954626 secs 2024-04-27T03:38:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:55 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32932.919505 secs 2024-04-27T03:38:55.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33629.954626 secs 2024-04-27T03:38:55.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:55 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32932.919505 secs 2024-04-27T03:38:55.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33629.954626 secs 2024-04-27T03:38:55.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:55 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32932.919505 secs 2024-04-27T03:38:56.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:56 smithi189 ceph-mon[32756]: pgmap v18334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:56.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:56 smithi156 ceph-mon[32679]: pgmap v18334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:56.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:56 smithi092 ceph-mon[29156]: pgmap v18334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:38:58.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:38:58 smithi189 ceph-mon[32756]: pgmap v18335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:58.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:38:58 smithi156 ceph-mon[32679]: pgmap v18335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:38:58.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:38:58 smithi092 ceph-mon[29156]: pgmap v18335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:00.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33634.954746 secs 2024-04-27T03:39:00.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:00 smithi189 ceph-mon[32756]: pgmap v18336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:00.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:00 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32937.919571 secs 2024-04-27T03:39:00.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33634.954746 secs 2024-04-27T03:39:00.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:00 smithi156 ceph-mon[32679]: pgmap v18336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:00.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:00 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32937.919571 secs 2024-04-27T03:39:00.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33634.954746 secs 2024-04-27T03:39:00.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:00 smithi092 ceph-mon[29156]: pgmap v18336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:00.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:00 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32937.919571 secs 2024-04-27T03:39:02.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:02 smithi189 ceph-mon[32756]: pgmap v18337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:02.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:02 smithi156 ceph-mon[32679]: pgmap v18337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:02.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:02 smithi092 ceph-mon[29156]: pgmap v18337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:04.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:04 smithi189 ceph-mon[32756]: pgmap v18338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:04.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:04 smithi156 ceph-mon[32679]: pgmap v18338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:04.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:04 smithi092 ceph-mon[29156]: pgmap v18338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33639.954836 secs 2024-04-27T03:39:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:05 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32942.919693 secs 2024-04-27T03:39:05.400 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33639.954836 secs 2024-04-27T03:39:05.400 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:05 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32942.919693 secs 2024-04-27T03:39:05.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33639.954836 secs 2024-04-27T03:39:05.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:05 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32942.919693 secs 2024-04-27T03:39:06.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:06 smithi189 ceph-mon[32756]: pgmap v18339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:06.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:06 smithi156 ceph-mon[32679]: pgmap v18339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:06.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:06 smithi092 ceph-mon[29156]: pgmap v18339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:08.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:08 smithi189 ceph-mon[32756]: pgmap v18340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:08.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:08 smithi156 ceph-mon[32679]: pgmap v18340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:08.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:08 smithi092 ceph-mon[29156]: pgmap v18340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33644.954975 secs 2024-04-27T03:39:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:10 smithi189 ceph-mon[32756]: pgmap v18341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:10.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:10 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32947.919818 secs 2024-04-27T03:39:10.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33644.954975 secs 2024-04-27T03:39:10.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:10 smithi156 ceph-mon[32679]: pgmap v18341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:10.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:10 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32947.919818 secs 2024-04-27T03:39:10.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33644.954975 secs 2024-04-27T03:39:10.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:10 smithi092 ceph-mon[29156]: pgmap v18341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:10.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:10 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32947.919818 secs 2024-04-27T03:39:12.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:12 smithi189 ceph-mon[32756]: pgmap v18342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:12.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:12 smithi156 ceph-mon[32679]: pgmap v18342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:12.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:12 smithi092 ceph-mon[29156]: pgmap v18342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:14.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:14 smithi189 ceph-mon[32756]: pgmap v18343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:14.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:14 smithi156 ceph-mon[32679]: pgmap v18343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:14.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:14 smithi092 ceph-mon[29156]: pgmap v18343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:15.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33649.955082 secs 2024-04-27T03:39:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:15 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 32952.919939 secs 2024-04-27T03:39:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:15 smithi189 ceph-mon[32756]: slow request 724.417294 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:39:15.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33649.955082 secs 2024-04-27T03:39:15.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:15 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 32952.919939 secs 2024-04-27T03:39:15.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:15 smithi156 ceph-mon[32679]: slow request 724.417294 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:39:15.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33649.955082 secs 2024-04-27T03:39:15.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:15 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 32952.919939 secs 2024-04-27T03:39:15.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:15 smithi092 ceph-mon[29156]: slow request 724.417294 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:39:16.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:16 smithi189 ceph-mon[32756]: pgmap v18344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:16.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:16 smithi156 ceph-mon[32679]: pgmap v18344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:16.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:16 smithi092 ceph-mon[29156]: pgmap v18344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:18.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:18 smithi189 ceph-mon[32756]: pgmap v18345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:18.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:18 smithi156 ceph-mon[32679]: pgmap v18345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:18 smithi092 ceph-mon[29156]: pgmap v18345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:20.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33654.955194 secs 2024-04-27T03:39:20.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: pgmap v18346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32957.920023 secs 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: pgmap v18347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: pgmap v18348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33654.955194 secs 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: pgmap v18346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32957.920023 secs 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:39:20.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: pgmap v18347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:39:20.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: pgmap v18348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:20.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33654.955194 secs 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: pgmap v18346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32957.920023 secs 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: pgmap v18347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: pgmap v18348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:20.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:39:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:22 smithi189 ceph-mon[32756]: pgmap v18349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:22 smithi156 ceph-mon[32679]: pgmap v18349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:22 smithi092 ceph-mon[29156]: pgmap v18349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:24 smithi189 ceph-mon[32756]: pgmap v18350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33659.955264 secs 2024-04-27T03:39:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32962.920126 secs 2024-04-27T03:39:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:24 smithi156 ceph-mon[32679]: pgmap v18350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33659.955264 secs 2024-04-27T03:39:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32962.920126 secs 2024-04-27T03:39:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:24 smithi092 ceph-mon[29156]: pgmap v18350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33659.955264 secs 2024-04-27T03:39:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32962.920126 secs 2024-04-27T03:39:26.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:25 smithi156 ceph-mon[32679]: pgmap v18351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:26.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:25 smithi092 ceph-mon[29156]: pgmap v18351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:26.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:25 smithi189 ceph-mon[32756]: pgmap v18351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:39:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:28 smithi189 ceph-mon[32756]: pgmap v18352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:39:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:28 smithi156 ceph-mon[32679]: pgmap v18352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:39:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:28 smithi092 ceph-mon[29156]: pgmap v18352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:39:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33664.955333 secs 2024-04-27T03:39:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32967.920249 secs 2024-04-27T03:39:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33664.955333 secs 2024-04-27T03:39:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32967.920249 secs 2024-04-27T03:39:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33664.955333 secs 2024-04-27T03:39:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32967.920249 secs 2024-04-27T03:39:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:30 smithi189 ceph-mon[32756]: pgmap v18353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:39:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:30 smithi156 ceph-mon[32679]: pgmap v18353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:39:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:30 smithi092 ceph-mon[29156]: pgmap v18353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:39:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:31 smithi189 ceph-mon[32756]: pgmap v18354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:32.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:31 smithi156 ceph-mon[32679]: pgmap v18354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:32.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:31 smithi092 ceph-mon[29156]: pgmap v18354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:34 smithi189 ceph-mon[32756]: pgmap v18355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33669.955402 secs 2024-04-27T03:39:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32972.920380 secs 2024-04-27T03:39:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:34 smithi156 ceph-mon[32679]: pgmap v18355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33669.955402 secs 2024-04-27T03:39:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32972.920380 secs 2024-04-27T03:39:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:34 smithi092 ceph-mon[29156]: pgmap v18355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33669.955402 secs 2024-04-27T03:39:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32972.920380 secs 2024-04-27T03:39:36.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:35 smithi156 ceph-mon[32679]: pgmap v18356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:36.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:35 smithi092 ceph-mon[29156]: pgmap v18356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:36.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:35 smithi189 ceph-mon[32756]: pgmap v18356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:38 smithi189 ceph-mon[32756]: pgmap v18357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:38 smithi156 ceph-mon[32679]: pgmap v18357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:38 smithi092 ceph-mon[29156]: pgmap v18357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33674.955472 secs 2024-04-27T03:39:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32977.920474 secs 2024-04-27T03:39:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33674.955472 secs 2024-04-27T03:39:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32977.920474 secs 2024-04-27T03:39:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33674.955472 secs 2024-04-27T03:39:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32977.920474 secs 2024-04-27T03:39:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.606+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:39:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.606+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:39:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T03:39:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:39:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 259 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T03:39:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:39:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:39:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:39:40.607+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 260 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:39:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:40 smithi092 ceph-mon[29156]: pgmap v18358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:40 smithi189 ceph-mon[32756]: pgmap v18358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:40 smithi156 ceph-mon[32679]: pgmap v18358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:39:42.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:41 smithi189 ceph-mon[32756]: pgmap v18359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:42.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:41 smithi156 ceph-mon[32679]: pgmap v18359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:42.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:41 smithi092 ceph-mon[29156]: pgmap v18359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:44.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:43 smithi156 ceph-mon[32679]: pgmap v18360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:44.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:43 smithi092 ceph-mon[29156]: pgmap v18360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:44.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:43 smithi189 ceph-mon[32756]: pgmap v18360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33679.955581 secs 2024-04-27T03:39:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32982.920541 secs 2024-04-27T03:39:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33679.955581 secs 2024-04-27T03:39:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32982.920541 secs 2024-04-27T03:39:45.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33679.955581 secs 2024-04-27T03:39:45.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32982.920541 secs 2024-04-27T03:39:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:45 smithi156 ceph-mon[32679]: pgmap v18361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:46.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:45 smithi092 ceph-mon[29156]: pgmap v18361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:46.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:45 smithi189 ceph-mon[32756]: pgmap v18361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:47 smithi156 ceph-mon[32679]: pgmap v18362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:48.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:47 smithi092 ceph-mon[29156]: pgmap v18362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:48.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:47 smithi189 ceph-mon[32756]: pgmap v18362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:49.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32987.920605 secs 2024-04-27T03:39:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32987.920605 secs 2024-04-27T03:39:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32987.920605 secs 2024-04-27T03:39:50.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33684.955699 secs 2024-04-27T03:39:50.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:50 smithi189 ceph-mon[32756]: pgmap v18363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:50.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33684.955699 secs 2024-04-27T03:39:50.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:50 smithi156 ceph-mon[32679]: pgmap v18363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33684.955699 secs 2024-04-27T03:39:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:50 smithi092 ceph-mon[29156]: pgmap v18363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:52.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:51 smithi156 ceph-mon[32679]: pgmap v18364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:52.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:51 smithi092 ceph-mon[29156]: pgmap v18364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:52.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:51 smithi189 ceph-mon[32756]: pgmap v18364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:39:54.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:53 smithi156 ceph-mon[32679]: pgmap v18365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:54.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:53 smithi092 ceph-mon[29156]: pgmap v18365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:54.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:53 smithi189 ceph-mon[32756]: pgmap v18365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:39:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33689.955797 secs 2024-04-27T03:39:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32992.920722 secs 2024-04-27T03:39:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33689.955797 secs 2024-04-27T03:39:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32992.920722 secs 2024-04-27T03:39:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33689.955797 secs 2024-04-27T03:39:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32992.920722 secs 2024-04-27T03:39:56.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:55 smithi156 ceph-mon[32679]: pgmap v18366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:56.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:55 smithi092 ceph-mon[29156]: pgmap v18366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:56.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:55 smithi189 ceph-mon[32756]: pgmap v18366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:58.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:57 smithi156 ceph-mon[32679]: pgmap v18367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:58.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:57 smithi092 ceph-mon[29156]: pgmap v18367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:58.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:57 smithi189 ceph-mon[32756]: pgmap v18367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:39:59.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:39:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 32997.920832 secs 2024-04-27T03:39:59.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:39:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 32997.920832 secs 2024-04-27T03:39:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:39:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 32997.920832 secs 2024-04-27T03:40:00.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33694.955849 secs 2024-04-27T03:40:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:00 smithi189 ceph-mon[32756]: pgmap v18368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:40:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33694.955849 secs 2024-04-27T03:40:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:00 smithi156 ceph-mon[32679]: pgmap v18368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:00.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:40:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33694.955849 secs 2024-04-27T03:40:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:00 smithi092 ceph-mon[29156]: pgmap v18368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:40:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:01 smithi156 ceph-mon[32679]: pgmap v18369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:02.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:01 smithi092 ceph-mon[29156]: pgmap v18369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:02.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:01 smithi189 ceph-mon[32756]: pgmap v18369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:04.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:03 smithi156 ceph-mon[32679]: pgmap v18370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:04.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:03 smithi092 ceph-mon[29156]: pgmap v18370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:04.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:03 smithi189 ceph-mon[32756]: pgmap v18370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33699.955973 secs 2024-04-27T03:40:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33002.920908 secs 2024-04-27T03:40:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33699.955973 secs 2024-04-27T03:40:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33002.920908 secs 2024-04-27T03:40:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33699.955973 secs 2024-04-27T03:40:05.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33002.920908 secs 2024-04-27T03:40:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:05 smithi092 ceph-mon[29156]: pgmap v18371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:06.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:05 smithi189 ceph-mon[32756]: pgmap v18371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:06.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:05 smithi156 ceph-mon[32679]: pgmap v18371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:08.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:08 smithi189 ceph-mon[32756]: pgmap v18372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:08.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:08 smithi156 ceph-mon[32679]: pgmap v18372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:08.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:08 smithi092 ceph-mon[29156]: pgmap v18372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:09.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33007.921025 secs 2024-04-27T03:40:09.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33007.921025 secs 2024-04-27T03:40:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33007.921025 secs 2024-04-27T03:40:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33704.956093 secs 2024-04-27T03:40:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:10 smithi189 ceph-mon[32756]: pgmap v18373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33704.956093 secs 2024-04-27T03:40:10.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:10 smithi156 ceph-mon[32679]: pgmap v18373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33704.956093 secs 2024-04-27T03:40:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:10 smithi092 ceph-mon[29156]: pgmap v18373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:11 smithi156 ceph-mon[32679]: pgmap v18374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:11 smithi092 ceph-mon[29156]: pgmap v18374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:12.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:11 smithi189 ceph-mon[32756]: pgmap v18374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:13 smithi156 ceph-mon[32679]: pgmap v18375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:13 smithi092 ceph-mon[29156]: pgmap v18375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:14.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:13 smithi189 ceph-mon[32756]: pgmap v18375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33709.956193 secs 2024-04-27T03:40:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33012.921145 secs 2024-04-27T03:40:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33709.956193 secs 2024-04-27T03:40:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33012.921145 secs 2024-04-27T03:40:15.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33709.956193 secs 2024-04-27T03:40:15.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33012.921145 secs 2024-04-27T03:40:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:15 smithi092 ceph-mon[29156]: pgmap v18376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:16.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:15 smithi189 ceph-mon[32756]: pgmap v18376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:16.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:15 smithi156 ceph-mon[32679]: pgmap v18376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:18.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:18 smithi189 ceph-mon[32756]: pgmap v18377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:18.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:18 smithi156 ceph-mon[32679]: pgmap v18377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:18 smithi092 ceph-mon[29156]: pgmap v18377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33017.921265 secs 2024-04-27T03:40:19.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33017.921265 secs 2024-04-27T03:40:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33017.921265 secs 2024-04-27T03:40:20.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33714.956313 secs 2024-04-27T03:40:20.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:20 smithi189 ceph-mon[32756]: pgmap v18378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:20.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:40:20.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33714.956313 secs 2024-04-27T03:40:20.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:20 smithi156 ceph-mon[32679]: pgmap v18378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:20.591 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:40:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33714.956313 secs 2024-04-27T03:40:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:20 smithi092 ceph-mon[29156]: pgmap v18378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:40:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:40:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:40:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:21 smithi189 ceph-mon[32756]: pgmap v18379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:40:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:21 smithi189 ceph-mon[32756]: pgmap v18380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:21.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:40:21.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:40:21.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:40:21.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:21 smithi156 ceph-mon[32679]: pgmap v18379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:40:21.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:21 smithi156 ceph-mon[32679]: pgmap v18380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:21.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:40:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:40:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:40:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:21 smithi092 ceph-mon[29156]: pgmap v18379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:40:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:21 smithi092 ceph-mon[29156]: pgmap v18380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:21.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:40:23.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:23 smithi156 ceph-mon[32679]: pgmap v18381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:40:23.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:23 smithi092 ceph-mon[29156]: pgmap v18381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:40:24.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:23 smithi189 ceph-mon[32756]: pgmap v18381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:40:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33719.956434 secs 2024-04-27T03:40:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33022.921405 secs 2024-04-27T03:40:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33719.956434 secs 2024-04-27T03:40:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33022.921405 secs 2024-04-27T03:40:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33719.956434 secs 2024-04-27T03:40:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33022.921405 secs 2024-04-27T03:40:25.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:25 smithi156 ceph-mon[32679]: pgmap v18382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:25 smithi092 ceph-mon[29156]: pgmap v18382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:26.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:25 smithi189 ceph-mon[32756]: pgmap v18382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:27.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:27 smithi156 ceph-mon[32679]: pgmap v18383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:27 smithi092 ceph-mon[29156]: pgmap v18383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:28.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:27 smithi189 ceph-mon[32756]: pgmap v18383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:29 smithi156 ceph-mon[32679]: pgmap v18384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33724.956532 secs 2024-04-27T03:40:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33027.921505 secs 2024-04-27T03:40:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:29 smithi092 ceph-mon[29156]: pgmap v18384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33724.956532 secs 2024-04-27T03:40:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33027.921505 secs 2024-04-27T03:40:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:29 smithi189 ceph-mon[32756]: pgmap v18384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:40:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33724.956532 secs 2024-04-27T03:40:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33027.921505 secs 2024-04-27T03:40:31.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:31 smithi156 ceph-mon[32679]: pgmap v18385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:40:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:31 smithi092 ceph-mon[29156]: pgmap v18385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:40:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:31 smithi189 ceph-mon[32756]: pgmap v18385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:40:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:33 smithi156 ceph-mon[32679]: pgmap v18386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:33 smithi092 ceph-mon[29156]: pgmap v18386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:34.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:33 smithi189 ceph-mon[32756]: pgmap v18386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33729.956646 secs 2024-04-27T03:40:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33032.921631 secs 2024-04-27T03:40:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33729.956646 secs 2024-04-27T03:40:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33032.921631 secs 2024-04-27T03:40:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33729.956646 secs 2024-04-27T03:40:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33032.921631 secs 2024-04-27T03:40:35.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:35 smithi156 ceph-mon[32679]: pgmap v18387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:35 smithi092 ceph-mon[29156]: pgmap v18387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:36.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:35 smithi189 ceph-mon[32756]: pgmap v18387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:37.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:37 smithi156 ceph-mon[32679]: pgmap v18388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:37.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:37 smithi092 ceph-mon[29156]: pgmap v18388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:38.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:37 smithi189 ceph-mon[32756]: pgmap v18388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:39 smithi156 ceph-mon[32679]: pgmap v18389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33734.956758 secs 2024-04-27T03:40:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33037.921756 secs 2024-04-27T03:40:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:39 smithi092 ceph-mon[29156]: pgmap v18389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33734.956758 secs 2024-04-27T03:40:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33037.921756 secs 2024-04-27T03:40:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:39 smithi189 ceph-mon[32756]: pgmap v18389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33734.956758 secs 2024-04-27T03:40:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33037.921756 secs 2024-04-27T03:40:41.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:41 smithi156 ceph-mon[32679]: pgmap v18390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:42.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:41 smithi092 ceph-mon[29156]: pgmap v18390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:42.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:41 smithi189 ceph-mon[32756]: pgmap v18390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:43.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:43 smithi156 ceph-mon[32679]: pgmap v18391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:43.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:43 smithi092 ceph-mon[29156]: pgmap v18391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:44.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:43 smithi189 ceph-mon[32756]: pgmap v18391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33739.956875 secs 2024-04-27T03:40:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33042.921878 secs 2024-04-27T03:40:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33739.956875 secs 2024-04-27T03:40:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33042.921878 secs 2024-04-27T03:40:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33739.956875 secs 2024-04-27T03:40:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33042.921878 secs 2024-04-27T03:40:45.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:45 smithi092 ceph-mon[29156]: pgmap v18392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:46.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:45 smithi189 ceph-mon[32756]: pgmap v18392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:45 smithi156 ceph-mon[32679]: pgmap v18392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:47.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:47 smithi092 ceph-mon[29156]: pgmap v18393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:48.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:47 smithi189 ceph-mon[32756]: pgmap v18393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:47 smithi156 ceph-mon[32679]: pgmap v18393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:49 smithi092 ceph-mon[29156]: pgmap v18394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33744.956994 secs 2024-04-27T03:40:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33047.921971 secs 2024-04-27T03:40:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:49 smithi189 ceph-mon[32756]: pgmap v18394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33744.956994 secs 2024-04-27T03:40:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33047.921971 secs 2024-04-27T03:40:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:49 smithi156 ceph-mon[32679]: pgmap v18394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33744.956994 secs 2024-04-27T03:40:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33047.921971 secs 2024-04-27T03:40:51.991 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:51 smithi156 ceph-mon[32679]: pgmap v18395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:51.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:51 smithi092 ceph-mon[29156]: pgmap v18395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:52.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:51 smithi189 ceph-mon[32756]: pgmap v18395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:53.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:53 smithi092 ceph-mon[29156]: pgmap v18396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:54.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:53 smithi189 ceph-mon[32756]: pgmap v18396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:54.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:53 smithi156 ceph-mon[32679]: pgmap v18396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33749.957109 secs 2024-04-27T03:40:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33052.922107 secs 2024-04-27T03:40:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33749.957109 secs 2024-04-27T03:40:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33052.922107 secs 2024-04-27T03:40:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33749.957109 secs 2024-04-27T03:40:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33052.922107 secs 2024-04-27T03:40:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:55 smithi092 ceph-mon[29156]: pgmap v18397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:55 smithi189 ceph-mon[32756]: pgmap v18397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:56.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:55 smithi156 ceph-mon[32679]: pgmap v18397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:57.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:57 smithi092 ceph-mon[29156]: pgmap v18398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:58.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:57 smithi189 ceph-mon[32756]: pgmap v18398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:58.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:57 smithi156 ceph-mon[32679]: pgmap v18398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:40:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:59 smithi092 ceph-mon[29156]: pgmap v18399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:40:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33754.957185 secs 2024-04-27T03:40:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:40:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33057.922226 secs 2024-04-27T03:41:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:59 smithi189 ceph-mon[32756]: pgmap v18399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33754.957185 secs 2024-04-27T03:41:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:40:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33057.922226 secs 2024-04-27T03:41:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:59 smithi156 ceph-mon[32679]: pgmap v18399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33754.957185 secs 2024-04-27T03:41:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:40:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33057.922226 secs 2024-04-27T03:41:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:01 smithi092 ceph-mon[29156]: pgmap v18400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:02.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:01 smithi189 ceph-mon[32756]: pgmap v18400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:01 smithi156 ceph-mon[32679]: pgmap v18400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:03 smithi092 ceph-mon[29156]: pgmap v18401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:04.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:03 smithi189 ceph-mon[32756]: pgmap v18401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:04.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:03 smithi156 ceph-mon[32679]: pgmap v18401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33759.957303 secs 2024-04-27T03:41:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33062.922329 secs 2024-04-27T03:41:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33759.957303 secs 2024-04-27T03:41:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33062.922329 secs 2024-04-27T03:41:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33759.957303 secs 2024-04-27T03:41:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33062.922329 secs 2024-04-27T03:41:05.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:05 smithi092 ceph-mon[29156]: pgmap v18402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:06.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:05 smithi189 ceph-mon[32756]: pgmap v18402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:06.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:05 smithi156 ceph-mon[32679]: pgmap v18402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:08.001 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:07 smithi092 ceph-mon[29156]: pgmap v18403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:08.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:07 smithi189 ceph-mon[32756]: pgmap v18403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:07 smithi156 ceph-mon[32679]: pgmap v18403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:09 smithi092 ceph-mon[29156]: pgmap v18404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33764.957421 secs 2024-04-27T03:41:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33067.922440 secs 2024-04-27T03:41:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:09 smithi189 ceph-mon[32756]: pgmap v18404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33764.957421 secs 2024-04-27T03:41:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33067.922440 secs 2024-04-27T03:41:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:09 smithi156 ceph-mon[32679]: pgmap v18404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33764.957421 secs 2024-04-27T03:41:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33067.922440 secs 2024-04-27T03:41:12.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:11 smithi189 ceph-mon[32756]: pgmap v18405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:12.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:11 smithi156 ceph-mon[32679]: pgmap v18405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:11 smithi092 ceph-mon[29156]: pgmap v18405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:14.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:13 smithi092 ceph-mon[29156]: pgmap v18406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:14.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:13 smithi189 ceph-mon[32756]: pgmap v18406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:13 smithi156 ceph-mon[32679]: pgmap v18406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33769.957533 secs 2024-04-27T03:41:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33072.922576 secs 2024-04-27T03:41:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33769.957533 secs 2024-04-27T03:41:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33072.922576 secs 2024-04-27T03:41:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33769.957533 secs 2024-04-27T03:41:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33072.922576 secs 2024-04-27T03:41:16.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:15 smithi189 ceph-mon[32756]: pgmap v18407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:15 smithi156 ceph-mon[32679]: pgmap v18407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:15 smithi092 ceph-mon[29156]: pgmap v18407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:18.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:17 smithi189 ceph-mon[32756]: pgmap v18408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:17 smithi156 ceph-mon[32679]: pgmap v18408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:17 smithi092 ceph-mon[29156]: pgmap v18408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:19 smithi189 ceph-mon[32756]: pgmap v18409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33774.957679 secs 2024-04-27T03:41:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33077.922715 secs 2024-04-27T03:41:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:19 smithi156 ceph-mon[32679]: pgmap v18409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33774.957679 secs 2024-04-27T03:41:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33077.922715 secs 2024-04-27T03:41:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:19 smithi092 ceph-mon[29156]: pgmap v18409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33774.957679 secs 2024-04-27T03:41:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33077.922715 secs 2024-04-27T03:41:21.044 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:41:21.090 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:41:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:41:22.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:21 smithi189 ceph-mon[32756]: pgmap v18410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:41:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:41:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:41:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:21 smithi156 ceph-mon[32679]: pgmap v18410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:41:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:41:22.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:41:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:21 smithi092 ceph-mon[29156]: pgmap v18410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:41:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:41:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:41:23.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:22 smithi189 ceph-mon[32756]: pgmap v18411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:41:23.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:22 smithi189 ceph-mon[32756]: pgmap v18412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:22 smithi156 ceph-mon[32679]: pgmap v18411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:41:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:22 smithi156 ceph-mon[32679]: pgmap v18412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:22 smithi092 ceph-mon[29156]: pgmap v18411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:41:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:22 smithi092 ceph-mon[29156]: pgmap v18412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:24 smithi189 ceph-mon[32756]: pgmap v18413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33779.957767 secs 2024-04-27T03:41:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33082.922814 secs 2024-04-27T03:41:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:24 smithi156 ceph-mon[32679]: pgmap v18413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33779.957767 secs 2024-04-27T03:41:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33082.922814 secs 2024-04-27T03:41:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:24 smithi092 ceph-mon[29156]: pgmap v18413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33779.957767 secs 2024-04-27T03:41:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33082.922814 secs 2024-04-27T03:41:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:26 smithi189 ceph-mon[32756]: pgmap v18414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:26 smithi156 ceph-mon[32679]: pgmap v18414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:27.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:26 smithi092 ceph-mon[29156]: pgmap v18414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:29.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:28 smithi189 ceph-mon[32756]: pgmap v18415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:28 smithi156 ceph-mon[32679]: pgmap v18415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:28 smithi092 ceph-mon[29156]: pgmap v18415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:41:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33784.957891 secs 2024-04-27T03:41:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33087.922893 secs 2024-04-27T03:41:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33784.957891 secs 2024-04-27T03:41:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33087.922893 secs 2024-04-27T03:41:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33784.957891 secs 2024-04-27T03:41:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33087.922893 secs 2024-04-27T03:41:31.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:30 smithi189 ceph-mon[32756]: pgmap v18416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:30 smithi156 ceph-mon[32679]: pgmap v18416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:30 smithi092 ceph-mon[29156]: pgmap v18416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:41:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:32 smithi189 ceph-mon[32756]: pgmap v18417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:41:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:32 smithi156 ceph-mon[32679]: pgmap v18417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:41:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:32 smithi092 ceph-mon[29156]: pgmap v18417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:41:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:34 smithi189 ceph-mon[32756]: pgmap v18418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33789.958019 secs 2024-04-27T03:41:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33092.922967 secs 2024-04-27T03:41:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:34 smithi156 ceph-mon[32679]: pgmap v18418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33789.958019 secs 2024-04-27T03:41:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33092.922967 secs 2024-04-27T03:41:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:34 smithi092 ceph-mon[29156]: pgmap v18418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33789.958019 secs 2024-04-27T03:41:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33092.922967 secs 2024-04-27T03:41:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:36 smithi189 ceph-mon[32756]: pgmap v18419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:36 smithi156 ceph-mon[32679]: pgmap v18419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:36 smithi092 ceph-mon[29156]: pgmap v18419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:38 smithi189 ceph-mon[32756]: pgmap v18420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:38 smithi156 ceph-mon[32679]: pgmap v18420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:38 smithi092 ceph-mon[29156]: pgmap v18420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33794.958099 secs 2024-04-27T03:41:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33097.923082 secs 2024-04-27T03:41:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33794.958099 secs 2024-04-27T03:41:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33097.923082 secs 2024-04-27T03:41:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33794.958099 secs 2024-04-27T03:41:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33097.923082 secs 2024-04-27T03:41:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:40 smithi189 ceph-mon[32756]: pgmap v18421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:40 smithi156 ceph-mon[32679]: pgmap v18421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:40 smithi092 ceph-mon[29156]: pgmap v18421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:42 smithi189 ceph-mon[32756]: pgmap v18422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:43.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:42 smithi156 ceph-mon[32679]: pgmap v18422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:43.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:42 smithi092 ceph-mon[29156]: pgmap v18422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:44 smithi189 ceph-mon[32756]: pgmap v18423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33799.958153 secs 2024-04-27T03:41:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33102.923218 secs 2024-04-27T03:41:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:44 smithi156 ceph-mon[32679]: pgmap v18423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33799.958153 secs 2024-04-27T03:41:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33102.923218 secs 2024-04-27T03:41:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:44 smithi092 ceph-mon[29156]: pgmap v18423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33799.958153 secs 2024-04-27T03:41:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33102.923218 secs 2024-04-27T03:41:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:46 smithi189 ceph-mon[32756]: pgmap v18424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:46 smithi156 ceph-mon[32679]: pgmap v18424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:47.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:46 smithi092 ceph-mon[29156]: pgmap v18424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:49.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:48 smithi189 ceph-mon[32756]: pgmap v18425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:48 smithi156 ceph-mon[32679]: pgmap v18425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:49.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:48 smithi092 ceph-mon[29156]: pgmap v18425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33804.958288 secs 2024-04-27T03:41:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33107.923363 secs 2024-04-27T03:41:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33804.958288 secs 2024-04-27T03:41:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33107.923363 secs 2024-04-27T03:41:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33804.958288 secs 2024-04-27T03:41:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33107.923363 secs 2024-04-27T03:41:51.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:50 smithi156 ceph-mon[32679]: pgmap v18426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:51.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:50 smithi189 ceph-mon[32756]: pgmap v18426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:51.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:50 smithi092 ceph-mon[29156]: pgmap v18426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:52 smithi189 ceph-mon[32756]: pgmap v18427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:52 smithi156 ceph-mon[32679]: pgmap v18427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:53.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:52 smithi092 ceph-mon[29156]: pgmap v18427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:54 smithi189 ceph-mon[32756]: pgmap v18428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33809.958423 secs 2024-04-27T03:41:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33112.923493 secs 2024-04-27T03:41:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:54 smithi156 ceph-mon[32679]: pgmap v18428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33809.958423 secs 2024-04-27T03:41:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33112.923493 secs 2024-04-27T03:41:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:54 smithi092 ceph-mon[29156]: pgmap v18428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33809.958423 secs 2024-04-27T03:41:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33112.923493 secs 2024-04-27T03:41:57.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:56 smithi189 ceph-mon[32756]: pgmap v18429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:56 smithi156 ceph-mon[32679]: pgmap v18429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:57.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:56 smithi092 ceph-mon[29156]: pgmap v18429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:41:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:58 smithi189 ceph-mon[32756]: pgmap v18430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:59.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:58 smithi156 ceph-mon[32679]: pgmap v18430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:41:59.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:58 smithi092 ceph-mon[29156]: pgmap v18430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33814.958543 secs 2024-04-27T03:42:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:41:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33117.923622 secs 2024-04-27T03:42:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33814.958543 secs 2024-04-27T03:42:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:41:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33117.923622 secs 2024-04-27T03:42:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33814.958543 secs 2024-04-27T03:42:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:41:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33117.923622 secs 2024-04-27T03:42:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:00 smithi189 ceph-mon[32756]: pgmap v18431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:00 smithi156 ceph-mon[32679]: pgmap v18431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:01.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:00 smithi092 ceph-mon[29156]: pgmap v18431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:03.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:02 smithi189 ceph-mon[32756]: pgmap v18432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:02 smithi156 ceph-mon[32679]: pgmap v18432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:03.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:02 smithi092 ceph-mon[29156]: pgmap v18432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:04 smithi189 ceph-mon[32756]: pgmap v18433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33819.958666 secs 2024-04-27T03:42:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33122.923725 secs 2024-04-27T03:42:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:04 smithi156 ceph-mon[32679]: pgmap v18433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33819.958666 secs 2024-04-27T03:42:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33122.923725 secs 2024-04-27T03:42:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:04 smithi092 ceph-mon[29156]: pgmap v18433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33819.958666 secs 2024-04-27T03:42:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33122.923725 secs 2024-04-27T03:42:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:06 smithi189 ceph-mon[32756]: pgmap v18434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:06 smithi156 ceph-mon[32679]: pgmap v18434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:06 smithi092 ceph-mon[29156]: pgmap v18434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:08 smithi189 ceph-mon[32756]: pgmap v18435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:08 smithi156 ceph-mon[32679]: pgmap v18435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:09.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:08 smithi092 ceph-mon[29156]: pgmap v18435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33824.958803 secs 2024-04-27T03:42:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33127.923830 secs 2024-04-27T03:42:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33824.958803 secs 2024-04-27T03:42:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33127.923830 secs 2024-04-27T03:42:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33824.958803 secs 2024-04-27T03:42:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33127.923830 secs 2024-04-27T03:42:11.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:10 smithi189 ceph-mon[32756]: pgmap v18436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:11.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:10 smithi156 ceph-mon[32679]: pgmap v18436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:11.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:10 smithi092 ceph-mon[29156]: pgmap v18436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:13.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:12 smithi189 ceph-mon[32756]: pgmap v18437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:13.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:12 smithi156 ceph-mon[32679]: pgmap v18437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:13.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:12 smithi092 ceph-mon[29156]: pgmap v18437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:14 smithi189 ceph-mon[32756]: pgmap v18438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33829.958848 secs 2024-04-27T03:42:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33132.923896 secs 2024-04-27T03:42:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:14 smithi156 ceph-mon[32679]: pgmap v18438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33829.958848 secs 2024-04-27T03:42:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33132.923896 secs 2024-04-27T03:42:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:14 smithi092 ceph-mon[29156]: pgmap v18438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33829.958848 secs 2024-04-27T03:42:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33132.923896 secs 2024-04-27T03:42:17.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:16 smithi189 ceph-mon[32756]: pgmap v18439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:17.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:16 smithi156 ceph-mon[32679]: pgmap v18439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:17.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:16 smithi092 ceph-mon[29156]: pgmap v18439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:19.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:18 smithi189 ceph-mon[32756]: pgmap v18440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:19.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:18 smithi156 ceph-mon[32679]: pgmap v18440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:19.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:18 smithi092 ceph-mon[29156]: pgmap v18440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33834.958965 secs 2024-04-27T03:42:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33137.924019 secs 2024-04-27T03:42:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33834.958965 secs 2024-04-27T03:42:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33137.924019 secs 2024-04-27T03:42:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33834.958965 secs 2024-04-27T03:42:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33137.924019 secs 2024-04-27T03:42:21.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:20 smithi156 ceph-mon[32679]: pgmap v18441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:20 smithi092 ceph-mon[29156]: pgmap v18441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:21.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:20 smithi189 ceph-mon[32756]: pgmap v18441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:42:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:42:22.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: pgmap v18442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.070 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: pgmap v18442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: pgmap v18442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:24.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:23 smithi092 ceph-mon[29156]: pgmap v18443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:24.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:23 smithi189 ceph-mon[32756]: pgmap v18443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:24.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:23 smithi156 ceph-mon[32679]: pgmap v18443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33839.959032 secs 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33142.924086 secs 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33839.959032 secs 2024-04-27T03:42:25.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33142.924086 secs 2024-04-27T03:42:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33839.959032 secs 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33142.924086 secs 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.398 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: pgmap v18444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:42:26.399 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:42:26.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: pgmap v18445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:26.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: pgmap v18446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:26.400 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: pgmap v18444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:42:26.441 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:42:26.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:42:26.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: pgmap v18445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:26.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: pgmap v18446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:26.442 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: pgmap v18444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:42:26.501 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:42:26.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:42:26.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:42:26.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: pgmap v18445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:26.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: pgmap v18446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:26.502 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:42:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:28 smithi189 ceph-mon[32756]: pgmap v18447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:28.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:28 smithi156 ceph-mon[32679]: pgmap v18447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:28.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:28 smithi092 ceph-mon[29156]: pgmap v18447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:29.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33147.924203 secs 2024-04-27T03:42:29.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33147.924203 secs 2024-04-27T03:42:29.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33147.924203 secs 2024-04-27T03:42:30.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33844.959147 secs 2024-04-27T03:42:30.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:30 smithi189 ceph-mon[32756]: pgmap v18448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:30.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33844.959147 secs 2024-04-27T03:42:30.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:30 smithi156 ceph-mon[32679]: pgmap v18448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:30.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33844.959147 secs 2024-04-27T03:42:30.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:30 smithi092 ceph-mon[29156]: pgmap v18448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:32.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:32 smithi189 ceph-mon[32756]: pgmap v18449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:32 smithi156 ceph-mon[32679]: pgmap v18449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:32.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:32 smithi092 ceph-mon[29156]: pgmap v18449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:34 smithi189 ceph-mon[32756]: pgmap v18450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33849.959243 secs 2024-04-27T03:42:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33152.924314 secs 2024-04-27T03:42:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:34 smithi156 ceph-mon[32679]: pgmap v18450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33849.959243 secs 2024-04-27T03:42:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33152.924314 secs 2024-04-27T03:42:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:34 smithi092 ceph-mon[29156]: pgmap v18450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T03:42:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33849.959243 secs 2024-04-27T03:42:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33152.924314 secs 2024-04-27T03:42:36.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:36 smithi189 ceph-mon[32756]: pgmap v18451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:36.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:36 smithi156 ceph-mon[32679]: pgmap v18451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:36 smithi092 ceph-mon[29156]: pgmap v18451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:42:38.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:38 smithi189 ceph-mon[32756]: pgmap v18452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:38 smithi156 ceph-mon[32679]: pgmap v18452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:38 smithi092 ceph-mon[29156]: pgmap v18452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:39.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33854.959384 secs 2024-04-27T03:42:39.874 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33157.924380 secs 2024-04-27T03:42:39.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33854.959384 secs 2024-04-27T03:42:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33157.924380 secs 2024-04-27T03:42:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33854.959384 secs 2024-04-27T03:42:39.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33157.924380 secs 2024-04-27T03:42:40.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:42:39.867+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:42:40.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:42:39.867+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:42:40.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:42:39.867+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:42:40.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:42:39.867+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:42:40.249 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:42:39 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:42:39.867+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:42:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:42:40.631+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:42:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:42:40.631+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:42:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:42:40.631+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:42:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:42:40.631+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 261 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:42:40.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:40 smithi189 ceph-mon[32756]: pgmap v18453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:40 smithi156 ceph-mon[32679]: pgmap v18453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:40 smithi092 ceph-mon[29156]: pgmap v18453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:42:42.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:42 smithi189 ceph-mon[32756]: pgmap v18454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:42 smithi156 ceph-mon[32679]: pgmap v18454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:42 smithi092 ceph-mon[29156]: pgmap v18454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:44 smithi189 ceph-mon[32756]: pgmap v18455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33859.959515 secs 2024-04-27T03:42:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33162.924507 secs 2024-04-27T03:42:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:44 smithi156 ceph-mon[32679]: pgmap v18455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33859.959515 secs 2024-04-27T03:42:44.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33162.924507 secs 2024-04-27T03:42:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:44 smithi092 ceph-mon[29156]: pgmap v18455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33859.959515 secs 2024-04-27T03:42:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33162.924507 secs 2024-04-27T03:42:46.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:46 smithi189 ceph-mon[32756]: pgmap v18456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:46.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:46 smithi156 ceph-mon[32679]: pgmap v18456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:46 smithi092 ceph-mon[29156]: pgmap v18456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:48.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:48 smithi189 ceph-mon[32756]: pgmap v18457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:48.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:48 smithi156 ceph-mon[32679]: pgmap v18457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:48.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:48 smithi092 ceph-mon[29156]: pgmap v18457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33864.959666 secs 2024-04-27T03:42:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33167.924617 secs 2024-04-27T03:42:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33864.959666 secs 2024-04-27T03:42:49.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33167.924617 secs 2024-04-27T03:42:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33864.959666 secs 2024-04-27T03:42:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33167.924617 secs 2024-04-27T03:42:50.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:50 smithi189 ceph-mon[32756]: pgmap v18458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:50.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:50 smithi156 ceph-mon[32679]: pgmap v18458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:50 smithi092 ceph-mon[29156]: pgmap v18458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:52.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:52 smithi189 ceph-mon[32756]: pgmap v18459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:52.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:52 smithi156 ceph-mon[32679]: pgmap v18459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:52 smithi092 ceph-mon[29156]: pgmap v18459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:54.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:54 smithi189 ceph-mon[32756]: pgmap v18460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33869.959747 secs 2024-04-27T03:42:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33172.924686 secs 2024-04-27T03:42:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:54 smithi156 ceph-mon[32679]: pgmap v18460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:54.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33869.959747 secs 2024-04-27T03:42:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33172.924686 secs 2024-04-27T03:42:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:54 smithi092 ceph-mon[29156]: pgmap v18460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:42:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33869.959747 secs 2024-04-27T03:42:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33172.924686 secs 2024-04-27T03:42:56.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:56 smithi189 ceph-mon[32756]: pgmap v18461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:56.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:56 smithi156 ceph-mon[32679]: pgmap v18461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:56 smithi092 ceph-mon[29156]: pgmap v18461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:42:58.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:58 smithi189 ceph-mon[32756]: pgmap v18462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:58.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:58 smithi156 ceph-mon[32679]: pgmap v18462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:58 smithi092 ceph-mon[29156]: pgmap v18462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:42:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33874.959866 secs 2024-04-27T03:42:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:42:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33177.924769 secs 2024-04-27T03:42:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33874.959866 secs 2024-04-27T03:42:59.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:42:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33177.924769 secs 2024-04-27T03:42:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33874.959866 secs 2024-04-27T03:42:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:42:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33177.924769 secs 2024-04-27T03:43:00.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:00 smithi189 ceph-mon[32756]: pgmap v18463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:00.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:00 smithi156 ceph-mon[32679]: pgmap v18463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:00 smithi092 ceph-mon[29156]: pgmap v18463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:02.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:02 smithi189 ceph-mon[32756]: pgmap v18464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:02.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:02 smithi156 ceph-mon[32679]: pgmap v18464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:02.978 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:02 smithi092 ceph-mon[29156]: pgmap v18464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:04 smithi189 ceph-mon[32756]: pgmap v18465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33879.959985 secs 2024-04-27T03:43:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33182.924862 secs 2024-04-27T03:43:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:04 smithi156 ceph-mon[32679]: pgmap v18465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33879.959985 secs 2024-04-27T03:43:04.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33182.924862 secs 2024-04-27T03:43:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:04 smithi092 ceph-mon[29156]: pgmap v18465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33879.959985 secs 2024-04-27T03:43:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33182.924862 secs 2024-04-27T03:43:06.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:06 smithi189 ceph-mon[32756]: pgmap v18466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:06.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:06 smithi156 ceph-mon[32679]: pgmap v18466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:06 smithi092 ceph-mon[29156]: pgmap v18466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:08.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:08 smithi189 ceph-mon[32756]: pgmap v18467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:08.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:08 smithi156 ceph-mon[32679]: pgmap v18467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:08 smithi092 ceph-mon[29156]: pgmap v18467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33884.960104 secs 2024-04-27T03:43:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33187.924983 secs 2024-04-27T03:43:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33884.960104 secs 2024-04-27T03:43:09.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33187.924983 secs 2024-04-27T03:43:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33884.960104 secs 2024-04-27T03:43:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33187.924983 secs 2024-04-27T03:43:10.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:10 smithi189 ceph-mon[32756]: pgmap v18468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:10.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:10 smithi156 ceph-mon[32679]: pgmap v18468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:10 smithi092 ceph-mon[29156]: pgmap v18468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:12.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:12 smithi189 ceph-mon[32756]: pgmap v18469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:12.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:12 smithi156 ceph-mon[32679]: pgmap v18469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:12 smithi092 ceph-mon[29156]: pgmap v18469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:14 smithi189 ceph-mon[32756]: pgmap v18470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33889.960162 secs 2024-04-27T03:43:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33192.925109 secs 2024-04-27T03:43:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:14 smithi156 ceph-mon[32679]: pgmap v18470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:14.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33889.960162 secs 2024-04-27T03:43:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33192.925109 secs 2024-04-27T03:43:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:14 smithi092 ceph-mon[29156]: pgmap v18470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33889.960162 secs 2024-04-27T03:43:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33192.925109 secs 2024-04-27T03:43:16.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:16 smithi189 ceph-mon[32756]: pgmap v18471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:16.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:16 smithi156 ceph-mon[32679]: pgmap v18471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:16 smithi092 ceph-mon[29156]: pgmap v18471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:18.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:18 smithi156 ceph-mon[32679]: pgmap v18472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:18.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:18 smithi092 ceph-mon[29156]: pgmap v18472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:19.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:18 smithi189 ceph-mon[32756]: pgmap v18472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33894.960277 secs 2024-04-27T03:43:19.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33197.925231 secs 2024-04-27T03:43:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33894.960277 secs 2024-04-27T03:43:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33197.925231 secs 2024-04-27T03:43:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33894.960277 secs 2024-04-27T03:43:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33197.925231 secs 2024-04-27T03:43:20.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:20 smithi156 ceph-mon[32679]: pgmap v18473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:20.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:20 smithi092 ceph-mon[29156]: pgmap v18473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:21.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:20 smithi189 ceph-mon[32756]: pgmap v18473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:22.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:22 smithi156 ceph-mon[32679]: pgmap v18474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:22.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:22 smithi189 ceph-mon[32756]: pgmap v18474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:22.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:22 smithi092 ceph-mon[29156]: pgmap v18474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:24.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:24 smithi156 ceph-mon[32679]: pgmap v18475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33899.960398 secs 2024-04-27T03:43:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33202.925350 secs 2024-04-27T03:43:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:24 smithi092 ceph-mon[29156]: pgmap v18475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33899.960398 secs 2024-04-27T03:43:24.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33202.925350 secs 2024-04-27T03:43:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:24 smithi189 ceph-mon[32756]: pgmap v18475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33899.960398 secs 2024-04-27T03:43:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33202.925350 secs 2024-04-27T03:43:25.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:43:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:43:26.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:43:26.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:26 smithi156 ceph-mon[32679]: pgmap v18476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:26.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:43:26.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:43:26.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:43:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:26 smithi092 ceph-mon[29156]: pgmap v18476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:43:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:43:26.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:43:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:26 smithi189 ceph-mon[32756]: pgmap v18476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:27.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:43:27.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:43:27.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:43:27.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:27 smithi156 ceph-mon[32679]: pgmap v18477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:43:27.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:27 smithi156 ceph-mon[32679]: pgmap v18478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:27 smithi092 ceph-mon[29156]: pgmap v18477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:43:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:27 smithi092 ceph-mon[29156]: pgmap v18478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:27 smithi189 ceph-mon[32756]: pgmap v18477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:43:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:27 smithi189 ceph-mon[32756]: pgmap v18478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:29.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:29 smithi156 ceph-mon[32679]: pgmap v18479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:43:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33904.960509 secs 2024-04-27T03:43:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33207.925418 secs 2024-04-27T03:43:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:29 smithi092 ceph-mon[29156]: pgmap v18479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:43:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33904.960509 secs 2024-04-27T03:43:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33207.925418 secs 2024-04-27T03:43:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:29 smithi189 ceph-mon[32756]: pgmap v18479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:43:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33904.960509 secs 2024-04-27T03:43:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33207.925418 secs 2024-04-27T03:43:31.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:31 smithi156 ceph-mon[32679]: pgmap v18480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:31 smithi092 ceph-mon[29156]: pgmap v18480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:31 smithi189 ceph-mon[32756]: pgmap v18480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:33.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:33 smithi156 ceph-mon[32679]: pgmap v18481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:33 smithi092 ceph-mon[29156]: pgmap v18481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:34.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:33 smithi189 ceph-mon[32756]: pgmap v18481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:34.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33909.960620 secs 2024-04-27T03:43:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33212.925490 secs 2024-04-27T03:43:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33909.960620 secs 2024-04-27T03:43:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33212.925490 secs 2024-04-27T03:43:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33909.960620 secs 2024-04-27T03:43:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33212.925490 secs 2024-04-27T03:43:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:35 smithi092 ceph-mon[29156]: pgmap v18482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:36.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:35 smithi189 ceph-mon[32756]: pgmap v18482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:36.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:35 smithi156 ceph-mon[32679]: pgmap v18482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:43:37.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:37 smithi092 ceph-mon[29156]: pgmap v18483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:43:38.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:37 smithi189 ceph-mon[32756]: pgmap v18483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:43:38.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:37 smithi156 ceph-mon[32679]: pgmap v18483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:43:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:39 smithi092 ceph-mon[29156]: pgmap v18484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33914.960735 secs 2024-04-27T03:43:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33217.925612 secs 2024-04-27T03:43:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:39 smithi189 ceph-mon[32756]: pgmap v18484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33914.960735 secs 2024-04-27T03:43:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33217.925612 secs 2024-04-27T03:43:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:39 smithi156 ceph-mon[32679]: pgmap v18484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33914.960735 secs 2024-04-27T03:43:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33217.925612 secs 2024-04-27T03:43:41.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:41 smithi092 ceph-mon[29156]: pgmap v18485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:42.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:41 smithi189 ceph-mon[32756]: pgmap v18485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:42.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:41 smithi156 ceph-mon[32679]: pgmap v18485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:43.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:43 smithi092 ceph-mon[29156]: pgmap v18486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:44.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:43 smithi189 ceph-mon[32756]: pgmap v18486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:44.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:43 smithi156 ceph-mon[32679]: pgmap v18486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33919.960856 secs 2024-04-27T03:43:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:44 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33222.925736 secs 2024-04-27T03:43:45.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:44 smithi092 ceph-mon[29156]: slow request 2884.932274 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:43:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33919.960856 secs 2024-04-27T03:43:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:44 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33222.925736 secs 2024-04-27T03:43:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:44 smithi189 ceph-mon[32756]: slow request 2884.932274 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:43:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33919.960856 secs 2024-04-27T03:43:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:44 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33222.925736 secs 2024-04-27T03:43:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:44 smithi156 ceph-mon[32679]: slow request 2884.932274 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:43:45.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:45 smithi092 ceph-mon[29156]: pgmap v18487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:46.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:45 smithi189 ceph-mon[32756]: pgmap v18487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:46.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:45 smithi156 ceph-mon[32679]: pgmap v18487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:47.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:47 smithi092 ceph-mon[29156]: pgmap v18488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:48.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:47 smithi189 ceph-mon[32756]: pgmap v18488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:48.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:47 smithi156 ceph-mon[32679]: pgmap v18488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:49 smithi092 ceph-mon[29156]: pgmap v18489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33924.960948 secs 2024-04-27T03:43:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33227.925869 secs 2024-04-27T03:43:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:49 smithi189 ceph-mon[32756]: pgmap v18489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33924.960948 secs 2024-04-27T03:43:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33227.925869 secs 2024-04-27T03:43:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:49 smithi156 ceph-mon[32679]: pgmap v18489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33924.960948 secs 2024-04-27T03:43:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33227.925869 secs 2024-04-27T03:43:51.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:51 smithi092 ceph-mon[29156]: pgmap v18490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:52.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:51 smithi189 ceph-mon[32756]: pgmap v18490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:52.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:51 smithi156 ceph-mon[32679]: pgmap v18490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:53.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:53 smithi156 ceph-mon[32679]: pgmap v18491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:53.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:53 smithi092 ceph-mon[29156]: pgmap v18491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:54.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:53 smithi189 ceph-mon[32756]: pgmap v18491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33929.961060 secs 2024-04-27T03:43:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33232.926009 secs 2024-04-27T03:43:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33929.961060 secs 2024-04-27T03:43:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33232.926009 secs 2024-04-27T03:43:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33929.961060 secs 2024-04-27T03:43:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33232.926009 secs 2024-04-27T03:43:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:55 smithi092 ceph-mon[29156]: pgmap v18492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:55 smithi189 ceph-mon[32756]: pgmap v18492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:56.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:55 smithi156 ceph-mon[32679]: pgmap v18492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:43:57.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:57 smithi092 ceph-mon[29156]: pgmap v18493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:57 smithi189 ceph-mon[32756]: pgmap v18493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:58.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:57 smithi156 ceph-mon[32679]: pgmap v18493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:59 smithi092 ceph-mon[29156]: pgmap v18494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:43:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33934.961199 secs 2024-04-27T03:43:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:43:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33237.926070 secs 2024-04-27T03:44:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:59 smithi189 ceph-mon[32756]: pgmap v18494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33934.961199 secs 2024-04-27T03:44:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:43:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33237.926070 secs 2024-04-27T03:44:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:59 smithi156 ceph-mon[32679]: pgmap v18494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33934.961199 secs 2024-04-27T03:44:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:43:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33237.926070 secs 2024-04-27T03:44:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:01 smithi092 ceph-mon[29156]: pgmap v18495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:02.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:01 smithi189 ceph-mon[32756]: pgmap v18495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:01 smithi156 ceph-mon[32679]: pgmap v18495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:03 smithi092 ceph-mon[29156]: pgmap v18496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:04.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:03 smithi189 ceph-mon[32756]: pgmap v18496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:04.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:03 smithi156 ceph-mon[32679]: pgmap v18496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33939.961308 secs 2024-04-27T03:44:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33242.926203 secs 2024-04-27T03:44:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33939.961308 secs 2024-04-27T03:44:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33242.926203 secs 2024-04-27T03:44:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33939.961308 secs 2024-04-27T03:44:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33242.926203 secs 2024-04-27T03:44:06.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:05 smithi189 ceph-mon[32756]: pgmap v18497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:06.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:05 smithi156 ceph-mon[32679]: pgmap v18497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:05 smithi092 ceph-mon[29156]: pgmap v18497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:07 smithi189 ceph-mon[32756]: pgmap v18498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:08.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:07 smithi156 ceph-mon[32679]: pgmap v18498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:07 smithi092 ceph-mon[29156]: pgmap v18498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:10.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:09 smithi092 ceph-mon[29156]: pgmap v18499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:10.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33944.961427 secs 2024-04-27T03:44:10.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33247.926328 secs 2024-04-27T03:44:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:09 smithi189 ceph-mon[32756]: pgmap v18499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33944.961427 secs 2024-04-27T03:44:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33247.926328 secs 2024-04-27T03:44:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:09 smithi156 ceph-mon[32679]: pgmap v18499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33944.961427 secs 2024-04-27T03:44:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33247.926328 secs 2024-04-27T03:44:12.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:11 smithi189 ceph-mon[32756]: pgmap v18500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:12.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:11 smithi156 ceph-mon[32679]: pgmap v18500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:11 smithi092 ceph-mon[29156]: pgmap v18500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:14.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:13 smithi189 ceph-mon[32756]: pgmap v18501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:14.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:13 smithi156 ceph-mon[32679]: pgmap v18501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:13 smithi092 ceph-mon[29156]: pgmap v18501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33949.961541 secs 2024-04-27T03:44:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:14 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33252.926443 secs 2024-04-27T03:44:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:14 smithi189 ceph-mon[32756]: slow request 724.370893 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:44:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33949.961541 secs 2024-04-27T03:44:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:14 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33252.926443 secs 2024-04-27T03:44:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:14 smithi156 ceph-mon[32679]: slow request 724.370893 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:44:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33949.961541 secs 2024-04-27T03:44:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:14 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33252.926443 secs 2024-04-27T03:44:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:14 smithi092 ceph-mon[29156]: slow request 724.370893 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:44:16.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:15 smithi189 ceph-mon[32756]: pgmap v18502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:16.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:15 smithi156 ceph-mon[32679]: pgmap v18502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:15 smithi092 ceph-mon[29156]: pgmap v18502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:18.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:17 smithi189 ceph-mon[32756]: pgmap v18503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:18.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:17 smithi156 ceph-mon[32679]: pgmap v18503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:17 smithi092 ceph-mon[29156]: pgmap v18503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:19 smithi189 ceph-mon[32756]: pgmap v18504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33954.961657 secs 2024-04-27T03:44:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33257.926549 secs 2024-04-27T03:44:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:19 smithi156 ceph-mon[32679]: pgmap v18504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33954.961657 secs 2024-04-27T03:44:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33257.926549 secs 2024-04-27T03:44:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:19 smithi092 ceph-mon[29156]: pgmap v18504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33954.961657 secs 2024-04-27T03:44:20.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33257.926549 secs 2024-04-27T03:44:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:21 smithi189 ceph-mon[32756]: pgmap v18505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:22.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:21 smithi156 ceph-mon[32679]: pgmap v18505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:21 smithi092 ceph-mon[29156]: pgmap v18505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:24.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:23 smithi189 ceph-mon[32756]: pgmap v18506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:24.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:23 smithi156 ceph-mon[32679]: pgmap v18506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:24.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:23 smithi092 ceph-mon[29156]: pgmap v18506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33959.961772 secs 2024-04-27T03:44:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33262.926670 secs 2024-04-27T03:44:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33959.961772 secs 2024-04-27T03:44:25.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33262.926670 secs 2024-04-27T03:44:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33959.961772 secs 2024-04-27T03:44:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33262.926670 secs 2024-04-27T03:44:26.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:25 smithi189 ceph-mon[32756]: pgmap v18507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:26.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:25 smithi156 ceph-mon[32679]: pgmap v18507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:26.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:25 smithi092 ceph-mon[29156]: pgmap v18507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:27.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:44:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:44:27.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:44:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:27 smithi189 ceph-mon[32756]: pgmap v18508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:44:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:44:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:44:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:27 smithi156 ceph-mon[32679]: pgmap v18508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:44:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:44:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:44:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:27 smithi092 ceph-mon[29156]: pgmap v18508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:44:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:44:28.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:44:29.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:28 smithi189 ceph-mon[32756]: pgmap v18509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:44:29.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:28 smithi189 ceph-mon[32756]: pgmap v18510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:28 smithi156 ceph-mon[32679]: pgmap v18509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:44:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:28 smithi156 ceph-mon[32679]: pgmap v18510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:28 smithi092 ceph-mon[29156]: pgmap v18509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:44:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:28 smithi092 ceph-mon[29156]: pgmap v18510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33964.961844 secs 2024-04-27T03:44:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33267.926793 secs 2024-04-27T03:44:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33964.961844 secs 2024-04-27T03:44:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33267.926793 secs 2024-04-27T03:44:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33964.961844 secs 2024-04-27T03:44:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33267.926793 secs 2024-04-27T03:44:31.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:30 smithi189 ceph-mon[32756]: pgmap v18511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:30 smithi156 ceph-mon[32679]: pgmap v18511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:30 smithi092 ceph-mon[29156]: pgmap v18511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:33.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:32 smithi189 ceph-mon[32756]: pgmap v18512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:32 smithi156 ceph-mon[32679]: pgmap v18512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:32 smithi092 ceph-mon[29156]: pgmap v18512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:34 smithi189 ceph-mon[32756]: pgmap v18513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:44:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33969.961960 secs 2024-04-27T03:44:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33272.926925 secs 2024-04-27T03:44:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:34 smithi156 ceph-mon[32679]: pgmap v18513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:44:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33969.961960 secs 2024-04-27T03:44:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33272.926925 secs 2024-04-27T03:44:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:34 smithi092 ceph-mon[29156]: pgmap v18513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:44:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33969.961960 secs 2024-04-27T03:44:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33272.926925 secs 2024-04-27T03:44:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:36 smithi092 ceph-mon[29156]: pgmap v18514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:37.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:36 smithi189 ceph-mon[32756]: pgmap v18514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:36 smithi156 ceph-mon[32679]: pgmap v18514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:44:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:38 smithi189 ceph-mon[32756]: pgmap v18515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:44:39.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:38 smithi156 ceph-mon[32679]: pgmap v18515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:44:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:38 smithi092 ceph-mon[29156]: pgmap v18515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:44:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33974.962055 secs 2024-04-27T03:44:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33277.927043 secs 2024-04-27T03:44:40.150 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33974.962055 secs 2024-04-27T03:44:40.150 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33277.927043 secs 2024-04-27T03:44:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33974.962055 secs 2024-04-27T03:44:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33277.927043 secs 2024-04-27T03:44:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:40 smithi189 ceph-mon[32756]: pgmap v18516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:41.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:40 smithi156 ceph-mon[32679]: pgmap v18516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:40 smithi092 ceph-mon[29156]: pgmap v18516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:43.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:42 smithi189 ceph-mon[32756]: pgmap v18517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:43.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:42 smithi156 ceph-mon[32679]: pgmap v18517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:43.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:42 smithi092 ceph-mon[29156]: pgmap v18517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:44 smithi189 ceph-mon[32756]: pgmap v18518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33979.962172 secs 2024-04-27T03:44:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33282.927159 secs 2024-04-27T03:44:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:44 smithi156 ceph-mon[32679]: pgmap v18518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33979.962172 secs 2024-04-27T03:44:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33282.927159 secs 2024-04-27T03:44:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:44 smithi092 ceph-mon[29156]: pgmap v18518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33979.962172 secs 2024-04-27T03:44:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33282.927159 secs 2024-04-27T03:44:47.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:46 smithi189 ceph-mon[32756]: pgmap v18519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:46 smithi156 ceph-mon[32679]: pgmap v18519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:47.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:46 smithi092 ceph-mon[29156]: pgmap v18519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:49.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:48 smithi189 ceph-mon[32756]: pgmap v18520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:48 smithi156 ceph-mon[32679]: pgmap v18520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:49.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:48 smithi092 ceph-mon[29156]: pgmap v18520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33984.962293 secs 2024-04-27T03:44:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33287.927240 secs 2024-04-27T03:44:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33984.962293 secs 2024-04-27T03:44:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33287.927240 secs 2024-04-27T03:44:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33984.962293 secs 2024-04-27T03:44:50.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33287.927240 secs 2024-04-27T03:44:51.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:50 smithi189 ceph-mon[32756]: pgmap v18521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:51.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:50 smithi156 ceph-mon[32679]: pgmap v18521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:51.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:50 smithi092 ceph-mon[29156]: pgmap v18521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:52 smithi189 ceph-mon[32756]: pgmap v18522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:52 smithi156 ceph-mon[32679]: pgmap v18522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:53.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:52 smithi092 ceph-mon[29156]: pgmap v18522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:54 smithi189 ceph-mon[32756]: pgmap v18523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33989.962358 secs 2024-04-27T03:44:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33292.927865 secs 2024-04-27T03:44:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:54 smithi156 ceph-mon[32679]: pgmap v18523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33989.962358 secs 2024-04-27T03:44:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33292.927865 secs 2024-04-27T03:44:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:54 smithi092 ceph-mon[29156]: pgmap v18523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33989.962358 secs 2024-04-27T03:44:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33292.927865 secs 2024-04-27T03:44:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:56 smithi189 ceph-mon[32756]: pgmap v18524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:57.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:56 smithi156 ceph-mon[32679]: pgmap v18524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:57.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:56 smithi092 ceph-mon[29156]: pgmap v18524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:44:59.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:58 smithi189 ceph-mon[32756]: pgmap v18525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:59.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:58 smithi156 ceph-mon[32679]: pgmap v18525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:44:59.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:58 smithi092 ceph-mon[29156]: pgmap v18525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33994.962454 secs 2024-04-27T03:45:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:44:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33297.928003 secs 2024-04-27T03:45:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33994.962454 secs 2024-04-27T03:45:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:44:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33297.928003 secs 2024-04-27T03:45:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33994.962454 secs 2024-04-27T03:45:00.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:44:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33297.928003 secs 2024-04-27T03:45:01.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:00 smithi189 ceph-mon[32756]: pgmap v18526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:00 smithi156 ceph-mon[32679]: pgmap v18526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:01.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:00 smithi092 ceph-mon[29156]: pgmap v18526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:03.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:02 smithi189 ceph-mon[32756]: pgmap v18527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:02 smithi156 ceph-mon[32679]: pgmap v18527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:03.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:02 smithi092 ceph-mon[29156]: pgmap v18527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:04 smithi189 ceph-mon[32756]: pgmap v18528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 33999.962547 secs 2024-04-27T03:45:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:04 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33302.928119 secs 2024-04-27T03:45:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:04 smithi189 ceph-mon[32756]: slow request 23040.339274 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:45:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:04 smithi156 ceph-mon[32679]: pgmap v18528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 33999.962547 secs 2024-04-27T03:45:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:04 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33302.928119 secs 2024-04-27T03:45:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:04 smithi156 ceph-mon[32679]: slow request 23040.339274 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:45:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:04 smithi092 ceph-mon[29156]: pgmap v18528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 33999.962547 secs 2024-04-27T03:45:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:04 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33302.928119 secs 2024-04-27T03:45:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:04 smithi092 ceph-mon[29156]: slow request 23040.339274 seconds old, received at 2024-04-26T21:21:03.734879+0000: client_request(client.17046:1 getattr pAsLsXsFs #0x1 2024-04-26T21:21:03.730604+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:45:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:06 smithi189 ceph-mon[32756]: pgmap v18529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:06 smithi156 ceph-mon[32679]: pgmap v18529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:07.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:06 smithi092 ceph-mon[29156]: pgmap v18529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:09.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:08 smithi189 ceph-mon[32756]: pgmap v18530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:08 smithi156 ceph-mon[32679]: pgmap v18530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:09.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:08 smithi092 ceph-mon[29156]: pgmap v18530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34004.962662 secs 2024-04-27T03:45:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33307.928237 secs 2024-04-27T03:45:10.150 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34004.962662 secs 2024-04-27T03:45:10.151 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33307.928237 secs 2024-04-27T03:45:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34004.962662 secs 2024-04-27T03:45:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33307.928237 secs 2024-04-27T03:45:11.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:10 smithi189 ceph-mon[32756]: pgmap v18531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:11.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:10 smithi156 ceph-mon[32679]: pgmap v18531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:11.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:10 smithi092 ceph-mon[29156]: pgmap v18531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:13.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:12 smithi156 ceph-mon[32679]: pgmap v18532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:13.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:12 smithi092 ceph-mon[29156]: pgmap v18532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:13.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:12 smithi189 ceph-mon[32756]: pgmap v18532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:14 smithi156 ceph-mon[32679]: pgmap v18533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34009.962778 secs 2024-04-27T03:45:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33312.928368 secs 2024-04-27T03:45:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:14 smithi092 ceph-mon[29156]: pgmap v18533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34009.962778 secs 2024-04-27T03:45:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33312.928368 secs 2024-04-27T03:45:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:14 smithi189 ceph-mon[32756]: pgmap v18533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34009.962778 secs 2024-04-27T03:45:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33312.928368 secs 2024-04-27T03:45:17.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:16 smithi156 ceph-mon[32679]: pgmap v18534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:17.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:16 smithi092 ceph-mon[29156]: pgmap v18534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:17.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:16 smithi189 ceph-mon[32756]: pgmap v18534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:19.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:18 smithi156 ceph-mon[32679]: pgmap v18535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:19.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:18 smithi092 ceph-mon[29156]: pgmap v18535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:19.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:18 smithi189 ceph-mon[32756]: pgmap v18535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34014.962895 secs 2024-04-27T03:45:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33317.928494 secs 2024-04-27T03:45:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34014.962895 secs 2024-04-27T03:45:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33317.928494 secs 2024-04-27T03:45:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34014.962895 secs 2024-04-27T03:45:20.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33317.928494 secs 2024-04-27T03:45:21.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:20 smithi156 ceph-mon[32679]: pgmap v18536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:20 smithi092 ceph-mon[29156]: pgmap v18536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:21.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:20 smithi189 ceph-mon[32756]: pgmap v18536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:23.051 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:22 smithi092 ceph-mon[29156]: pgmap v18537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:23.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:22 smithi156 ceph-mon[32679]: pgmap v18537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:23.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:22 smithi189 ceph-mon[32756]: pgmap v18537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:24 smithi156 ceph-mon[32679]: pgmap v18538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:25.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34019.963029 secs 2024-04-27T03:45:25.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33322.928615 secs 2024-04-27T03:45:25.196 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:24 smithi189 ceph-mon[32756]: pgmap v18538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:25.196 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34019.963029 secs 2024-04-27T03:45:25.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33322.928615 secs 2024-04-27T03:45:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:24 smithi092 ceph-mon[29156]: pgmap v18538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34019.963029 secs 2024-04-27T03:45:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33322.928615 secs 2024-04-27T03:45:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:26 smithi156 ceph-mon[32679]: pgmap v18539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:27.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:26 smithi092 ceph-mon[29156]: pgmap v18539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:27.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:26 smithi189 ceph-mon[32756]: pgmap v18539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:45:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:45:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:45:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:45:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:45:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:45:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:45:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:45:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:45:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:45:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:45:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:45:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:28 smithi156 ceph-mon[32679]: pgmap v18540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:28 smithi156 ceph-mon[32679]: pgmap v18541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:45:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:28 smithi156 ceph-mon[32679]: pgmap v18542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:45:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:28 smithi092 ceph-mon[29156]: pgmap v18540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:28 smithi092 ceph-mon[29156]: pgmap v18541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:45:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:28 smithi092 ceph-mon[29156]: pgmap v18542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:45:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:28 smithi189 ceph-mon[32756]: pgmap v18540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:28 smithi189 ceph-mon[32756]: pgmap v18541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:45:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:28 smithi189 ceph-mon[32756]: pgmap v18542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:45:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34024.963144 secs 2024-04-27T03:45:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33327.928688 secs 2024-04-27T03:45:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34024.963144 secs 2024-04-27T03:45:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33327.928688 secs 2024-04-27T03:45:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34024.963144 secs 2024-04-27T03:45:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33327.928688 secs 2024-04-27T03:45:31.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:30 smithi156 ceph-mon[32679]: pgmap v18543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:30 smithi092 ceph-mon[29156]: pgmap v18543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:31.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:30 smithi189 ceph-mon[32756]: pgmap v18543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:32.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:31 smithi092 ceph-mon[29156]: pgmap v18544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:32.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:31 smithi189 ceph-mon[32756]: pgmap v18544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:32.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:31 smithi156 ceph-mon[32679]: pgmap v18544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:34 smithi156 ceph-mon[32679]: pgmap v18545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34029.963260 secs 2024-04-27T03:45:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33332.928758 secs 2024-04-27T03:45:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:34 smithi092 ceph-mon[29156]: pgmap v18545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34029.963260 secs 2024-04-27T03:45:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33332.928758 secs 2024-04-27T03:45:35.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:34 smithi189 ceph-mon[32756]: pgmap v18545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:35.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34029.963260 secs 2024-04-27T03:45:35.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33332.928758 secs 2024-04-27T03:45:36.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:35 smithi092 ceph-mon[29156]: pgmap v18546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:36.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:35 smithi189 ceph-mon[32756]: pgmap v18546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:36.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:35 smithi156 ceph-mon[32679]: pgmap v18546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:45:38.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:37 smithi092 ceph-mon[29156]: pgmap v18547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:45:38.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:37 smithi189 ceph-mon[32756]: pgmap v18547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:45:38.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:37 smithi156 ceph-mon[32679]: pgmap v18547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:45:39.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33337.928821 secs 2024-04-27T03:45:39.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33337.928821 secs 2024-04-27T03:45:39.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33337.928821 secs 2024-04-27T03:45:40.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34034.963360 secs 2024-04-27T03:45:40.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:40 smithi189 ceph-mon[32756]: pgmap v18548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:40.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34034.963360 secs 2024-04-27T03:45:40.651 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:40 smithi092 ceph-mon[29156]: pgmap v18548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:45:40.654+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:45:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:45:40.654+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:45:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:45:40.654+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:45:40.661 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:45:40.654+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 262 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:45:40.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34034.963360 secs 2024-04-27T03:45:40.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:40 smithi156 ceph-mon[32679]: pgmap v18548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:42.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:41 smithi092 ceph-mon[29156]: pgmap v18549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:42.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:41 smithi189 ceph-mon[32756]: pgmap v18549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:42.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:41 smithi156 ceph-mon[32679]: pgmap v18549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:44.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:43 smithi092 ceph-mon[29156]: pgmap v18550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:44.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:43 smithi189 ceph-mon[32756]: pgmap v18550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:44.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:43 smithi156 ceph-mon[32679]: pgmap v18550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34039.963476 secs 2024-04-27T03:45:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33342.928896 secs 2024-04-27T03:45:45.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34039.963476 secs 2024-04-27T03:45:45.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33342.928896 secs 2024-04-27T03:45:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34039.963476 secs 2024-04-27T03:45:45.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33342.928896 secs 2024-04-27T03:45:46.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:45 smithi092 ceph-mon[29156]: pgmap v18551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:46.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:45 smithi189 ceph-mon[32756]: pgmap v18551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:46.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:45 smithi156 ceph-mon[32679]: pgmap v18551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:48.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:47 smithi092 ceph-mon[29156]: pgmap v18552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:48.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:47 smithi189 ceph-mon[32756]: pgmap v18552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:48.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:47 smithi156 ceph-mon[32679]: pgmap v18552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:49.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33347.929019 secs 2024-04-27T03:45:49.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33347.929019 secs 2024-04-27T03:45:49.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33347.929019 secs 2024-04-27T03:45:50.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34044.963613 secs 2024-04-27T03:45:50.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:50 smithi189 ceph-mon[32756]: pgmap v18553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:50.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34044.963613 secs 2024-04-27T03:45:50.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:50 smithi156 ceph-mon[32679]: pgmap v18553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34044.963613 secs 2024-04-27T03:45:50.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:50 smithi092 ceph-mon[29156]: pgmap v18553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:52.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:51 smithi092 ceph-mon[29156]: pgmap v18554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:52.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:51 smithi189 ceph-mon[32756]: pgmap v18554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:52.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:51 smithi156 ceph-mon[32679]: pgmap v18554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:54.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:53 smithi092 ceph-mon[29156]: pgmap v18555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:54.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:53 smithi189 ceph-mon[32756]: pgmap v18555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:54.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:53 smithi156 ceph-mon[32679]: pgmap v18555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:45:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34049.963724 secs 2024-04-27T03:45:55.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33352.929110 secs 2024-04-27T03:45:55.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34049.963724 secs 2024-04-27T03:45:55.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33352.929110 secs 2024-04-27T03:45:55.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34049.963724 secs 2024-04-27T03:45:55.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33352.929110 secs 2024-04-27T03:45:56.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:55 smithi189 ceph-mon[32756]: pgmap v18556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:56.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:55 smithi156 ceph-mon[32679]: pgmap v18556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:56.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:55 smithi092 ceph-mon[29156]: pgmap v18556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:58.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:57 smithi092 ceph-mon[29156]: pgmap v18557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:58.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:57 smithi189 ceph-mon[32756]: pgmap v18557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:58.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:57 smithi156 ceph-mon[32679]: pgmap v18557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:45:59.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:45:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33357.929183 secs 2024-04-27T03:45:59.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:45:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33357.929183 secs 2024-04-27T03:45:59.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:45:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33357.929183 secs 2024-04-27T03:46:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34054.963853 secs 2024-04-27T03:46:00.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:00 smithi189 ceph-mon[32756]: pgmap v18558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:00.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34054.963853 secs 2024-04-27T03:46:00.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:00 smithi156 ceph-mon[32679]: pgmap v18558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34054.963853 secs 2024-04-27T03:46:00.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:00 smithi092 ceph-mon[29156]: pgmap v18558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:02.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:01 smithi092 ceph-mon[29156]: pgmap v18559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:02.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:01 smithi189 ceph-mon[32756]: pgmap v18559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:02.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:01 smithi156 ceph-mon[32679]: pgmap v18559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:04.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:03 smithi092 ceph-mon[29156]: pgmap v18560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:04.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:03 smithi189 ceph-mon[32756]: pgmap v18560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:04.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:03 smithi156 ceph-mon[32679]: pgmap v18560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34059.963965 secs 2024-04-27T03:46:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33362.929246 secs 2024-04-27T03:46:05.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34059.963965 secs 2024-04-27T03:46:05.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33362.929246 secs 2024-04-27T03:46:05.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34059.963965 secs 2024-04-27T03:46:05.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33362.929246 secs 2024-04-27T03:46:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:05 smithi092 ceph-mon[29156]: pgmap v18561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:06.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:05 smithi189 ceph-mon[32756]: pgmap v18561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:06.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:05 smithi156 ceph-mon[32679]: pgmap v18561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:07 smithi092 ceph-mon[29156]: pgmap v18562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:08.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:07 smithi189 ceph-mon[32756]: pgmap v18562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:08.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:07 smithi156 ceph-mon[32679]: pgmap v18562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:09.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33367.929401 secs 2024-04-27T03:46:09.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33367.929401 secs 2024-04-27T03:46:09.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33367.929401 secs 2024-04-27T03:46:10.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34064.964059 secs 2024-04-27T03:46:10.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:10 smithi189 ceph-mon[32756]: pgmap v18563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:10.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34064.964059 secs 2024-04-27T03:46:10.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:10 smithi156 ceph-mon[32679]: pgmap v18563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:10.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34064.964059 secs 2024-04-27T03:46:10.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:10 smithi092 ceph-mon[29156]: pgmap v18563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:12.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:11 smithi092 ceph-mon[29156]: pgmap v18564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:12.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:11 smithi189 ceph-mon[32756]: pgmap v18564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:12.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:11 smithi156 ceph-mon[32679]: pgmap v18564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:13 smithi092 ceph-mon[29156]: pgmap v18565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:14.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:13 smithi189 ceph-mon[32756]: pgmap v18565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:14.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:13 smithi156 ceph-mon[32679]: pgmap v18565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34069.964135 secs 2024-04-27T03:46:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33372.929488 secs 2024-04-27T03:46:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34069.964135 secs 2024-04-27T03:46:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33372.929488 secs 2024-04-27T03:46:15.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34069.964135 secs 2024-04-27T03:46:15.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33372.929488 secs 2024-04-27T03:46:16.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:15 smithi092 ceph-mon[29156]: pgmap v18566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:16.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:15 smithi189 ceph-mon[32756]: pgmap v18566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:16.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:15 smithi156 ceph-mon[32679]: pgmap v18566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:17 smithi092 ceph-mon[29156]: pgmap v18567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:18.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:17 smithi189 ceph-mon[32756]: pgmap v18567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:18.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:17 smithi156 ceph-mon[32679]: pgmap v18567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33377.929607 secs 2024-04-27T03:46:19.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33377.929607 secs 2024-04-27T03:46:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33377.929607 secs 2024-04-27T03:46:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34074.964257 secs 2024-04-27T03:46:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:20 smithi189 ceph-mon[32756]: pgmap v18568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:20.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34074.964257 secs 2024-04-27T03:46:20.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:20 smithi156 ceph-mon[32679]: pgmap v18568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34074.964257 secs 2024-04-27T03:46:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:20 smithi092 ceph-mon[29156]: pgmap v18568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:21 smithi092 ceph-mon[29156]: pgmap v18569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:22.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:21 smithi189 ceph-mon[32756]: pgmap v18569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:22.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:21 smithi156 ceph-mon[32679]: pgmap v18569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:24.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:23 smithi092 ceph-mon[29156]: pgmap v18570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:24.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:23 smithi189 ceph-mon[32756]: pgmap v18570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:24.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:23 smithi156 ceph-mon[32679]: pgmap v18570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34079.964358 secs 2024-04-27T03:46:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33382.929724 secs 2024-04-27T03:46:25.295 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34079.964358 secs 2024-04-27T03:46:25.296 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33382.929724 secs 2024-04-27T03:46:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34079.964358 secs 2024-04-27T03:46:25.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33382.929724 secs 2024-04-27T03:46:26.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:25 smithi189 ceph-mon[32756]: pgmap v18571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:26.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:25 smithi156 ceph-mon[32679]: pgmap v18571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:26.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:25 smithi092 ceph-mon[29156]: pgmap v18571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:27 smithi092 ceph-mon[29156]: pgmap v18572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:28.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:46:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:27 smithi189 ceph-mon[32756]: pgmap v18572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:28.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:46:28.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:27 smithi156 ceph-mon[32679]: pgmap v18572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:28.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:46:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:46:29.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:46:29.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:28 smithi092 ceph-mon[29156]: pgmap v18573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:46:29.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:28 smithi092 ceph-mon[29156]: pgmap v18574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:29.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:46:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:46:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:46:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:28 smithi189 ceph-mon[32756]: pgmap v18573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:46:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:28 smithi189 ceph-mon[32756]: pgmap v18574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:29.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:46:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:46:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:46:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:28 smithi156 ceph-mon[32679]: pgmap v18573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:46:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:28 smithi156 ceph-mon[32679]: pgmap v18574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:29.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:46:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34084.964470 secs 2024-04-27T03:46:30.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33387.929806 secs 2024-04-27T03:46:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34084.964470 secs 2024-04-27T03:46:30.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33387.929806 secs 2024-04-27T03:46:30.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34084.964470 secs 2024-04-27T03:46:30.500 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33387.929806 secs 2024-04-27T03:46:31.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:30 smithi189 ceph-mon[32756]: pgmap v18575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:31.440 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:30 smithi156 ceph-mon[32679]: pgmap v18575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:31.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:30 smithi092 ceph-mon[29156]: pgmap v18575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:33 smithi092 ceph-mon[29156]: pgmap v18576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:46:34.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:33 smithi189 ceph-mon[32756]: pgmap v18576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:46:34.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:33 smithi156 ceph-mon[32679]: pgmap v18576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:46:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34089.964584 secs 2024-04-27T03:46:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33392.929943 secs 2024-04-27T03:46:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34089.964584 secs 2024-04-27T03:46:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33392.929943 secs 2024-04-27T03:46:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34089.964584 secs 2024-04-27T03:46:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33392.929943 secs 2024-04-27T03:46:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:35 smithi092 ceph-mon[29156]: pgmap v18577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:36.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:35 smithi189 ceph-mon[32756]: pgmap v18577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:36.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:35 smithi156 ceph-mon[32679]: pgmap v18577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:38.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:37 smithi092 ceph-mon[29156]: pgmap v18578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:38.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:37 smithi189 ceph-mon[32756]: pgmap v18578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:38.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:37 smithi156 ceph-mon[32679]: pgmap v18578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:46:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:39 smithi092 ceph-mon[29156]: pgmap v18579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:46:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34094.964704 secs 2024-04-27T03:46:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:39 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33397.930079 secs 2024-04-27T03:46:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:39 smithi092 ceph-mon[29156]: slow request 11522.322240 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:46:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:39 smithi189 ceph-mon[32756]: pgmap v18579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:46:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34094.964704 secs 2024-04-27T03:46:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:39 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33397.930079 secs 2024-04-27T03:46:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:39 smithi189 ceph-mon[32756]: slow request 11522.322240 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:46:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:39 smithi156 ceph-mon[32679]: pgmap v18579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:46:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34094.964704 secs 2024-04-27T03:46:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:39 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33397.930079 secs 2024-04-27T03:46:40.191 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:39 smithi156 ceph-mon[32679]: slow request 11522.322240 seconds old, received at 2024-04-27T00:34:36.753873+0000: client_request(client.17265:1 getattr pAsLsXsFs #0x1 2024-04-27T00:34:36.749720+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:46:41.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:41 smithi092 ceph-mon[29156]: pgmap v18580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:42.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:41 smithi189 ceph-mon[32756]: pgmap v18580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:42.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:41 smithi156 ceph-mon[32679]: pgmap v18580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:43.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:43 smithi092 ceph-mon[29156]: pgmap v18581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:43.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:43 smithi189 ceph-mon[32756]: pgmap v18581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:43.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:43 smithi156 ceph-mon[32679]: pgmap v18581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:44.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33402.930199 secs 2024-04-27T03:46:44.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33402.930199 secs 2024-04-27T03:46:44.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33402.930199 secs 2024-04-27T03:46:45.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34099.964856 secs 2024-04-27T03:46:45.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:45 smithi189 ceph-mon[32756]: pgmap v18582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:45.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34099.964856 secs 2024-04-27T03:46:45.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:45 smithi156 ceph-mon[32679]: pgmap v18582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34099.964856 secs 2024-04-27T03:46:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:45 smithi092 ceph-mon[29156]: pgmap v18582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:48.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:47 smithi092 ceph-mon[29156]: pgmap v18583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:48.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:47 smithi189 ceph-mon[32756]: pgmap v18583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:48.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:47 smithi156 ceph-mon[32679]: pgmap v18583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:49 smithi092 ceph-mon[29156]: pgmap v18584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34104.964950 secs 2024-04-27T03:46:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33407.930352 secs 2024-04-27T03:46:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:49 smithi189 ceph-mon[32756]: pgmap v18584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34104.964950 secs 2024-04-27T03:46:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33407.930352 secs 2024-04-27T03:46:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:49 smithi156 ceph-mon[32679]: pgmap v18584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34104.964950 secs 2024-04-27T03:46:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33407.930352 secs 2024-04-27T03:46:52.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:51 smithi092 ceph-mon[29156]: pgmap v18585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:52.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:51 smithi189 ceph-mon[32756]: pgmap v18585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:52.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:51 smithi156 ceph-mon[32679]: pgmap v18585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:53.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:53 smithi092 ceph-mon[29156]: pgmap v18586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:54.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:53 smithi189 ceph-mon[32756]: pgmap v18586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:54.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:53 smithi156 ceph-mon[32679]: pgmap v18586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34109.965045 secs 2024-04-27T03:46:55.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33412.930461 secs 2024-04-27T03:46:55.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34109.965045 secs 2024-04-27T03:46:55.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33412.930461 secs 2024-04-27T03:46:55.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34109.965045 secs 2024-04-27T03:46:55.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33412.930461 secs 2024-04-27T03:46:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:55 smithi092 ceph-mon[29156]: pgmap v18587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:56.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:55 smithi189 ceph-mon[32756]: pgmap v18587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:56.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:55 smithi156 ceph-mon[32679]: pgmap v18587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:46:57.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:57 smithi092 ceph-mon[29156]: pgmap v18588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:58.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:57 smithi189 ceph-mon[32756]: pgmap v18588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:46:58.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:57 smithi156 ceph-mon[32679]: pgmap v18588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:59 smithi092 ceph-mon[29156]: pgmap v18589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34114.965177 secs 2024-04-27T03:47:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:46:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33417.930552 secs 2024-04-27T03:47:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:59 smithi189 ceph-mon[32756]: pgmap v18589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34114.965177 secs 2024-04-27T03:47:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:46:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33417.930552 secs 2024-04-27T03:47:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:59 smithi156 ceph-mon[32679]: pgmap v18589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34114.965177 secs 2024-04-27T03:47:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:46:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33417.930552 secs 2024-04-27T03:47:01.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:01 smithi092 ceph-mon[29156]: pgmap v18590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:02.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:01 smithi189 ceph-mon[32756]: pgmap v18590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:02.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:01 smithi156 ceph-mon[32679]: pgmap v18590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:03.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:03 smithi092 ceph-mon[29156]: pgmap v18591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:04.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:03 smithi189 ceph-mon[32756]: pgmap v18591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:04.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:03 smithi156 ceph-mon[32679]: pgmap v18591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34119.965297 secs 2024-04-27T03:47:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33422.930634 secs 2024-04-27T03:47:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34119.965297 secs 2024-04-27T03:47:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33422.930634 secs 2024-04-27T03:47:05.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34119.965297 secs 2024-04-27T03:47:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33422.930634 secs 2024-04-27T03:47:06.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:05 smithi189 ceph-mon[32756]: pgmap v18592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:06.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:05 smithi156 ceph-mon[32679]: pgmap v18592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:06.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:05 smithi092 ceph-mon[29156]: pgmap v18592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:08.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:07 smithi189 ceph-mon[32756]: pgmap v18593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:08.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:07 smithi156 ceph-mon[32679]: pgmap v18593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:08.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:07 smithi092 ceph-mon[29156]: pgmap v18593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:09 smithi189 ceph-mon[32756]: pgmap v18594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34124.965372 secs 2024-04-27T03:47:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33427.930714 secs 2024-04-27T03:47:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:09 smithi156 ceph-mon[32679]: pgmap v18594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34124.965372 secs 2024-04-27T03:47:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33427.930714 secs 2024-04-27T03:47:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:09 smithi092 ceph-mon[29156]: pgmap v18594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34124.965372 secs 2024-04-27T03:47:10.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33427.930714 secs 2024-04-27T03:47:12.052 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:11 smithi092 ceph-mon[29156]: pgmap v18595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:12.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:11 smithi189 ceph-mon[32756]: pgmap v18595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:12.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:11 smithi156 ceph-mon[32679]: pgmap v18595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:14.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:13 smithi189 ceph-mon[32756]: pgmap v18596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:14.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:13 smithi156 ceph-mon[32679]: pgmap v18596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:14.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:13 smithi092 ceph-mon[29156]: pgmap v18596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34129.965492 secs 2024-04-27T03:47:15.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33432.930829 secs 2024-04-27T03:47:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34129.965492 secs 2024-04-27T03:47:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33432.930829 secs 2024-04-27T03:47:15.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34129.965492 secs 2024-04-27T03:47:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33432.930829 secs 2024-04-27T03:47:16.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:15 smithi189 ceph-mon[32756]: pgmap v18597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:16.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:15 smithi156 ceph-mon[32679]: pgmap v18597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:16.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:15 smithi092 ceph-mon[29156]: pgmap v18597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:18.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:17 smithi189 ceph-mon[32756]: pgmap v18598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:18.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:17 smithi156 ceph-mon[32679]: pgmap v18598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:18.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:17 smithi092 ceph-mon[29156]: pgmap v18598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:19 smithi189 ceph-mon[32756]: pgmap v18599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34134.965609 secs 2024-04-27T03:47:20.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33437.930894 secs 2024-04-27T03:47:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:19 smithi156 ceph-mon[32679]: pgmap v18599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34134.965609 secs 2024-04-27T03:47:20.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33437.930894 secs 2024-04-27T03:47:20.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:19 smithi092 ceph-mon[29156]: pgmap v18599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:20.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34134.965609 secs 2024-04-27T03:47:20.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33437.930894 secs 2024-04-27T03:47:22.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:21 smithi189 ceph-mon[32756]: pgmap v18600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:22.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:21 smithi156 ceph-mon[32679]: pgmap v18600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:22.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:21 smithi092 ceph-mon[29156]: pgmap v18600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:24.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:23 smithi189 ceph-mon[32756]: pgmap v18601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:24.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:23 smithi156 ceph-mon[32679]: pgmap v18601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:24.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:23 smithi092 ceph-mon[29156]: pgmap v18601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:25.045 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34139.965722 secs 2024-04-27T03:47:25.046 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33442.931037 secs 2024-04-27T03:47:25.091 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34139.965722 secs 2024-04-27T03:47:25.125 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33442.931037 secs 2024-04-27T03:47:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34139.965722 secs 2024-04-27T03:47:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33442.931037 secs 2024-04-27T03:47:26.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:25 smithi189 ceph-mon[32756]: pgmap v18602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:26.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:25 smithi156 ceph-mon[32679]: pgmap v18602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:26.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:25 smithi092 ceph-mon[29156]: pgmap v18602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:27 smithi092 ceph-mon[29156]: pgmap v18603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:28.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:27 smithi189 ceph-mon[32756]: pgmap v18603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:28.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:27 smithi156 ceph-mon[32679]: pgmap v18603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:29.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:47:29.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:47:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:47:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: pgmap v18604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34144.965828 secs 2024-04-27T03:47:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33447.931125 secs 2024-04-27T03:47:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:47:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:47:30.145 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: pgmap v18604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34144.965828 secs 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33447.931125 secs 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:47:30.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: pgmap v18604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34144.965828 secs 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33447.931125 secs 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:47:30.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:47:31.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:30 smithi189 ceph-mon[32756]: pgmap v18605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:47:31.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:30 smithi189 ceph-mon[32756]: pgmap v18606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:31.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:30 smithi156 ceph-mon[32679]: pgmap v18605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:47:31.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:30 smithi156 ceph-mon[32679]: pgmap v18606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:31.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:30 smithi092 ceph-mon[29156]: pgmap v18605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:47:31.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:30 smithi092 ceph-mon[29156]: pgmap v18606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:33.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:32 smithi189 ceph-mon[32756]: pgmap v18607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:33.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:32 smithi156 ceph-mon[32679]: pgmap v18607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:32 smithi092 ceph-mon[29156]: pgmap v18607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:34 smithi189 ceph-mon[32756]: pgmap v18608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34149.965948 secs 2024-04-27T03:47:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33452.931266 secs 2024-04-27T03:47:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:34 smithi156 ceph-mon[32679]: pgmap v18608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34149.965948 secs 2024-04-27T03:47:35.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33452.931266 secs 2024-04-27T03:47:35.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:34 smithi092 ceph-mon[29156]: pgmap v18608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:35.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34149.965948 secs 2024-04-27T03:47:35.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33452.931266 secs 2024-04-27T03:47:37.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:36 smithi189 ceph-mon[32756]: pgmap v18609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:37.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:36 smithi156 ceph-mon[32679]: pgmap v18609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:36 smithi092 ceph-mon[29156]: pgmap v18609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:47:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:38 smithi189 ceph-mon[32756]: pgmap v18610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:39.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:38 smithi156 ceph-mon[32679]: pgmap v18610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:39.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:38 smithi092 ceph-mon[29156]: pgmap v18610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:47:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34154.966048 secs 2024-04-27T03:47:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33457.931377 secs 2024-04-27T03:47:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34154.966048 secs 2024-04-27T03:47:40.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33457.931377 secs 2024-04-27T03:47:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34154.966048 secs 2024-04-27T03:47:40.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33457.931377 secs 2024-04-27T03:47:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:40 smithi189 ceph-mon[32756]: pgmap v18611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:47:41.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:40 smithi156 ceph-mon[32679]: pgmap v18611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:47:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:40 smithi092 ceph-mon[29156]: pgmap v18611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:47:43.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:42 smithi189 ceph-mon[32756]: pgmap v18612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:43.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:42 smithi156 ceph-mon[32679]: pgmap v18612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:43.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:42 smithi092 ceph-mon[29156]: pgmap v18612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:44 smithi189 ceph-mon[32756]: pgmap v18613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34159.966174 secs 2024-04-27T03:47:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33462.931493 secs 2024-04-27T03:47:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:44 smithi156 ceph-mon[32679]: pgmap v18613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34159.966174 secs 2024-04-27T03:47:45.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33462.931493 secs 2024-04-27T03:47:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:44 smithi092 ceph-mon[29156]: pgmap v18613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34159.966174 secs 2024-04-27T03:47:45.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33462.931493 secs 2024-04-27T03:47:47.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:46 smithi189 ceph-mon[32756]: pgmap v18614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:47.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:46 smithi156 ceph-mon[32679]: pgmap v18614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:47.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:46 smithi092 ceph-mon[29156]: pgmap v18614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:49.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:48 smithi189 ceph-mon[32756]: pgmap v18615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:49.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:48 smithi156 ceph-mon[32679]: pgmap v18615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:49.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:48 smithi092 ceph-mon[29156]: pgmap v18615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34164.966299 secs 2024-04-27T03:47:50.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33467.931611 secs 2024-04-27T03:47:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34164.966299 secs 2024-04-27T03:47:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33467.931611 secs 2024-04-27T03:47:50.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34164.966299 secs 2024-04-27T03:47:50.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33467.931611 secs 2024-04-27T03:47:51.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:50 smithi189 ceph-mon[32756]: pgmap v18616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:51.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:50 smithi156 ceph-mon[32679]: pgmap v18616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:51.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:50 smithi092 ceph-mon[29156]: pgmap v18616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:53.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:52 smithi189 ceph-mon[32756]: pgmap v18617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:53.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:52 smithi156 ceph-mon[32679]: pgmap v18617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:53.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:52 smithi092 ceph-mon[29156]: pgmap v18617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:54 smithi189 ceph-mon[32756]: pgmap v18618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34169.966415 secs 2024-04-27T03:47:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33472.931682 secs 2024-04-27T03:47:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:54 smithi156 ceph-mon[32679]: pgmap v18618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34169.966415 secs 2024-04-27T03:47:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33472.931682 secs 2024-04-27T03:47:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:54 smithi092 ceph-mon[29156]: pgmap v18618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T03:47:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34169.966415 secs 2024-04-27T03:47:55.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33472.931682 secs 2024-04-27T03:47:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:47:55.673+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:47:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:47:55.673+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:47:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:47:55.673+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:47:55.680 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:47:55.673+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 263 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:47:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:56 smithi189 ceph-mon[32756]: pgmap v18619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:57.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:56 smithi156 ceph-mon[32679]: pgmap v18619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:57.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:56 smithi092 ceph-mon[29156]: pgmap v18619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T03:47:59.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:58 smithi189 ceph-mon[32756]: pgmap v18620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:59.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:58 smithi156 ceph-mon[32679]: pgmap v18620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:47:59.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:58 smithi092 ceph-mon[29156]: pgmap v18620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34174.966539 secs 2024-04-27T03:48:00.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:47:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33477.931799 secs 2024-04-27T03:48:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34174.966539 secs 2024-04-27T03:48:00.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:47:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33477.931799 secs 2024-04-27T03:48:00.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34174.966539 secs 2024-04-27T03:48:00.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:47:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33477.931799 secs 2024-04-27T03:48:01.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:00 smithi189 ceph-mon[32756]: pgmap v18621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:01.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:00 smithi156 ceph-mon[32679]: pgmap v18621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:01.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:00 smithi092 ceph-mon[29156]: pgmap v18621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:03.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:02 smithi189 ceph-mon[32756]: pgmap v18622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:03.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:02 smithi156 ceph-mon[32679]: pgmap v18622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:03.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:02 smithi092 ceph-mon[29156]: pgmap v18622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:04 smithi189 ceph-mon[32756]: pgmap v18623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34179.966661 secs 2024-04-27T03:48:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33482.931879 secs 2024-04-27T03:48:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:04 smithi156 ceph-mon[32679]: pgmap v18623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34179.966661 secs 2024-04-27T03:48:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33482.931879 secs 2024-04-27T03:48:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:04 smithi092 ceph-mon[29156]: pgmap v18623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34179.966661 secs 2024-04-27T03:48:05.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33482.931879 secs 2024-04-27T03:48:07.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:06 smithi189 ceph-mon[32756]: pgmap v18624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:07.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:06 smithi156 ceph-mon[32679]: pgmap v18624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:07.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:06 smithi092 ceph-mon[29156]: pgmap v18624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:09.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:08 smithi189 ceph-mon[32756]: pgmap v18625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:09.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:08 smithi156 ceph-mon[32679]: pgmap v18625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:09.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:08 smithi092 ceph-mon[29156]: pgmap v18625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34184.966755 secs 2024-04-27T03:48:10.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33487.932013 secs 2024-04-27T03:48:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34184.966755 secs 2024-04-27T03:48:10.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33487.932013 secs 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34184.966755 secs 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33487.932013 secs 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:48:09.970+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:48:09.970+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:48:09.970+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:48:09.970+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:48:10.250 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:48:09 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:48:09.970+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:48:11.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:10 smithi189 ceph-mon[32756]: pgmap v18626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:11.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:10 smithi156 ceph-mon[32679]: pgmap v18626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:11.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:10 smithi092 ceph-mon[29156]: pgmap v18626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:13.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:12 smithi156 ceph-mon[32679]: pgmap v18627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:13.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:12 smithi092 ceph-mon[29156]: pgmap v18627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:13.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:12 smithi189 ceph-mon[32756]: pgmap v18627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:14 smithi156 ceph-mon[32679]: pgmap v18628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34189.966871 secs 2024-04-27T03:48:15.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33492.932133 secs 2024-04-27T03:48:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:14 smithi092 ceph-mon[29156]: pgmap v18628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34189.966871 secs 2024-04-27T03:48:15.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33492.932133 secs 2024-04-27T03:48:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:14 smithi189 ceph-mon[32756]: pgmap v18628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34189.966871 secs 2024-04-27T03:48:15.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33492.932133 secs 2024-04-27T03:48:17.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:16 smithi156 ceph-mon[32679]: pgmap v18629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:17.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:16 smithi092 ceph-mon[29156]: pgmap v18629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:17.394 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:16 smithi189 ceph-mon[32756]: pgmap v18629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:18.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:18 smithi092 ceph-mon[29156]: pgmap v18630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:18.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:18 smithi189 ceph-mon[32756]: pgmap v18630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:18.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:18 smithi156 ceph-mon[32679]: pgmap v18630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:19.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33497.932221 secs 2024-04-27T03:48:19.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33497.932221 secs 2024-04-27T03:48:19.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33497.932221 secs 2024-04-27T03:48:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34194.966951 secs 2024-04-27T03:48:20.644 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:20 smithi189 ceph-mon[32756]: pgmap v18631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:20.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34194.966951 secs 2024-04-27T03:48:20.690 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:20 smithi156 ceph-mon[32679]: pgmap v18631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:20.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34194.966951 secs 2024-04-27T03:48:20.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:20 smithi092 ceph-mon[29156]: pgmap v18631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:22.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:22 smithi189 ceph-mon[32756]: pgmap v18632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:22.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:22 smithi156 ceph-mon[32679]: pgmap v18632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:23.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:22 smithi092 ceph-mon[29156]: pgmap v18632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:24 smithi189 ceph-mon[32756]: pgmap v18633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34199.967065 secs 2024-04-27T03:48:24.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33502.932360 secs 2024-04-27T03:48:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:24 smithi156 ceph-mon[32679]: pgmap v18633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34199.967065 secs 2024-04-27T03:48:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33502.932360 secs 2024-04-27T03:48:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:24 smithi092 ceph-mon[29156]: pgmap v18633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-27T03:48:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34199.967065 secs 2024-04-27T03:48:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33502.932360 secs 2024-04-27T03:48:26.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:26 smithi189 ceph-mon[32756]: pgmap v18634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:26.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:26 smithi156 ceph-mon[32679]: pgmap v18634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:27.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:26 smithi092 ceph-mon[29156]: pgmap v18634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-27T03:48:28.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:28 smithi189 ceph-mon[32756]: pgmap v18635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:28.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:28 smithi156 ceph-mon[32679]: pgmap v18635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:28.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:28 smithi092 ceph-mon[29156]: pgmap v18635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34204.967158 secs 2024-04-27T03:48:29.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33507.932480 secs 2024-04-27T03:48:29.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34204.967158 secs 2024-04-27T03:48:29.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33507.932480 secs 2024-04-27T03:48:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34204.967158 secs 2024-04-27T03:48:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33507.932480 secs 2024-04-27T03:48:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:30 smithi189 ceph-mon[32756]: pgmap v18636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:48:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:48:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:48:30.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:48:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:30 smithi156 ceph-mon[32679]: pgmap v18636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:48:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:48:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:48:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:48:30.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:30 smithi092 ceph-mon[29156]: pgmap v18636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:48:31.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:48:31.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:48:31.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:48:31.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:48:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:31 smithi189 ceph-mon[32756]: pgmap v18637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:48:31.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:31 smithi189 ceph-mon[32756]: pgmap v18638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:31 smithi156 ceph-mon[32679]: pgmap v18637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:48:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:31 smithi156 ceph-mon[32679]: pgmap v18638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:31 smithi092 ceph-mon[29156]: pgmap v18637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:48:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:31 smithi092 ceph-mon[29156]: pgmap v18638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:33.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:33 smithi189 ceph-mon[32756]: pgmap v18639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:33.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:33 smithi156 ceph-mon[32679]: pgmap v18639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:33.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:33 smithi092 ceph-mon[29156]: pgmap v18639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34209.967287 secs 2024-04-27T03:48:34.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33512.932603 secs 2024-04-27T03:48:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34209.967287 secs 2024-04-27T03:48:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33512.932603 secs 2024-04-27T03:48:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34209.967287 secs 2024-04-27T03:48:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33512.932603 secs 2024-04-27T03:48:35.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:35 smithi189 ceph-mon[32756]: pgmap v18640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:35.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:35 smithi156 ceph-mon[32679]: pgmap v18640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:35.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:35 smithi092 ceph-mon[29156]: pgmap v18640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000913) for more than 900000000 us, fault. 2024-04-27T03:48:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80d9000 comp rx=0 tx=0).stop 2024-04-27T03:48:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T03:48:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T03:48:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T03:48:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:48:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.045+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca8095000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T03:48:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T03:48:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T03:48:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T03:48:36.095 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=36 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T03:48:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T03:48:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.089+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T03:48:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:36.089+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T03:48:37.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:37 smithi189 ceph-mon[32756]: pgmap v18641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:37.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:37 smithi156 ceph-mon[32679]: pgmap v18641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:38.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:37 smithi092 ceph-mon[29156]: pgmap v18641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:48:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:39 smithi189 ceph-mon[32756]: pgmap v18642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:48:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34214.967350 secs 2024-04-27T03:48:39.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33517.932723 secs 2024-04-27T03:48:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:39 smithi156 ceph-mon[32679]: pgmap v18642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:48:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34214.967350 secs 2024-04-27T03:48:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33517.932723 secs 2024-04-27T03:48:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:39 smithi092 ceph-mon[29156]: pgmap v18642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:48:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34214.967350 secs 2024-04-27T03:48:40.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33517.932723 secs 2024-04-27T03:48:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:40.679+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:48:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:40.679+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:48:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:40.679+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:48:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:48:40.679+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 264 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:48:41.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:41 smithi189 ceph-mon[32756]: pgmap v18643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:48:41.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:41 smithi156 ceph-mon[32679]: pgmap v18643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:48:42.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:41 smithi092 ceph-mon[29156]: pgmap v18643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:48:43.802 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:43 smithi092 ceph-mon[29156]: pgmap v18644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:43.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:43 smithi189 ceph-mon[32756]: pgmap v18644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:43.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:43 smithi156 ceph-mon[32679]: pgmap v18644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34219.967463 secs 2024-04-27T03:48:44.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33522.932792 secs 2024-04-27T03:48:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34219.967463 secs 2024-04-27T03:48:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33522.932792 secs 2024-04-27T03:48:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34219.967463 secs 2024-04-27T03:48:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33522.932792 secs 2024-04-27T03:48:45.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:45 smithi189 ceph-mon[32756]: pgmap v18645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:45.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:45 smithi156 ceph-mon[32679]: pgmap v18645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:46.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:45 smithi092 ceph-mon[29156]: pgmap v18645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:47.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:47 smithi189 ceph-mon[32756]: pgmap v18646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:47.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:47 smithi156 ceph-mon[32679]: pgmap v18646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:47.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:47 smithi092 ceph-mon[29156]: pgmap v18646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:49 smithi189 ceph-mon[32756]: pgmap v18647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:49.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34224.967584 secs 2024-04-27T03:48:49.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33527.932854 secs 2024-04-27T03:48:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:49 smithi156 ceph-mon[32679]: pgmap v18647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:49.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34224.967584 secs 2024-04-27T03:48:49.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33527.932854 secs 2024-04-27T03:48:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:49 smithi092 ceph-mon[29156]: pgmap v18647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34224.967584 secs 2024-04-27T03:48:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33527.932854 secs 2024-04-27T03:48:51.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:51 smithi189 ceph-mon[32756]: pgmap v18648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:51.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:51 smithi156 ceph-mon[32679]: pgmap v18648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:52.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:51 smithi092 ceph-mon[29156]: pgmap v18648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:53.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:53 smithi189 ceph-mon[32756]: pgmap v18649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:53.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:53 smithi156 ceph-mon[32679]: pgmap v18649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:54.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:53 smithi092 ceph-mon[29156]: pgmap v18649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:48:54.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34229.967697 secs 2024-04-27T03:48:54.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33532.932980 secs 2024-04-27T03:48:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34229.967697 secs 2024-04-27T03:48:54.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33532.932980 secs 2024-04-27T03:48:55.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34229.967697 secs 2024-04-27T03:48:55.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33532.932980 secs 2024-04-27T03:48:55.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:55 smithi189 ceph-mon[32756]: pgmap v18650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:55.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:55 smithi156 ceph-mon[32679]: pgmap v18650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:55.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:55 smithi092 ceph-mon[29156]: pgmap v18650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:48:57.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:57 smithi189 ceph-mon[32756]: pgmap v18651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:57.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:57 smithi156 ceph-mon[32679]: pgmap v18651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:58.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:57 smithi092 ceph-mon[29156]: pgmap v18651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:59 smithi189 ceph-mon[32756]: pgmap v18652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34234.967814 secs 2024-04-27T03:48:59.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:48:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33537.933051 secs 2024-04-27T03:48:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:59 smithi156 ceph-mon[32679]: pgmap v18652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:48:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34234.967814 secs 2024-04-27T03:48:59.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:48:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33537.933051 secs 2024-04-27T03:49:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:59 smithi092 ceph-mon[29156]: pgmap v18652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34234.967814 secs 2024-04-27T03:49:00.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:48:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33537.933051 secs 2024-04-27T03:49:01.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:01 smithi189 ceph-mon[32756]: pgmap v18653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:01.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:01 smithi156 ceph-mon[32679]: pgmap v18653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:02.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:01 smithi092 ceph-mon[29156]: pgmap v18653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:03.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:03 smithi189 ceph-mon[32756]: pgmap v18654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:03.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:03 smithi156 ceph-mon[32679]: pgmap v18654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:04.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:03 smithi092 ceph-mon[29156]: pgmap v18654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34239.967946 secs 2024-04-27T03:49:04.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33542.933165 secs 2024-04-27T03:49:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34239.967946 secs 2024-04-27T03:49:04.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33542.933165 secs 2024-04-27T03:49:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34239.967946 secs 2024-04-27T03:49:05.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33542.933165 secs 2024-04-27T03:49:05.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:05 smithi189 ceph-mon[32756]: pgmap v18655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:05.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:05 smithi156 ceph-mon[32679]: pgmap v18655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:06.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:05 smithi092 ceph-mon[29156]: pgmap v18655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:07.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:07 smithi189 ceph-mon[32756]: pgmap v18656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:07.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:07 smithi156 ceph-mon[32679]: pgmap v18656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:08.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:07 smithi092 ceph-mon[29156]: pgmap v18656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:09 smithi189 ceph-mon[32756]: pgmap v18657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:09.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34244.968083 secs 2024-04-27T03:49:09.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33547.933263 secs 2024-04-27T03:49:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:09 smithi156 ceph-mon[32679]: pgmap v18657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34244.968083 secs 2024-04-27T03:49:09.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33547.933263 secs 2024-04-27T03:49:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:09 smithi092 ceph-mon[29156]: pgmap v18657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34244.968083 secs 2024-04-27T03:49:10.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33547.933263 secs 2024-04-27T03:49:11.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:11 smithi189 ceph-mon[32756]: pgmap v18658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:11.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:11 smithi156 ceph-mon[32679]: pgmap v18658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:11.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:11 smithi092 ceph-mon[29156]: pgmap v18658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:13.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:13 smithi189 ceph-mon[32756]: pgmap v18659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:13.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:13 smithi156 ceph-mon[32679]: pgmap v18659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:14.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:13 smithi092 ceph-mon[29156]: pgmap v18659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T03:49:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34249.968218 secs 2024-04-27T03:49:14.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33552.933411 secs 2024-04-27T03:49:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34249.968218 secs 2024-04-27T03:49:14.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33552.933411 secs 2024-04-27T03:49:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34249.968218 secs 2024-04-27T03:49:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33552.933411 secs 2024-04-27T03:49:15.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:15 smithi189 ceph-mon[32756]: pgmap v18660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:15.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:15 smithi156 ceph-mon[32679]: pgmap v18660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:15.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:15 smithi092 ceph-mon[29156]: pgmap v18660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T03:49:17.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:17 smithi189 ceph-mon[32756]: pgmap v18661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:17.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:17 smithi156 ceph-mon[32679]: pgmap v18661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:18.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:17 smithi092 ceph-mon[29156]: pgmap v18661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:19.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:19 smithi189 ceph-mon[32756]: pgmap v18662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:19.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34254.968344 secs 2024-04-27T03:49:19.895 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33557.933559 secs 2024-04-27T03:49:19.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:19 smithi156 ceph-mon[32679]: pgmap v18662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:19.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34254.968344 secs 2024-04-27T03:49:19.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33557.933559 secs 2024-04-27T03:49:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:19 smithi092 ceph-mon[29156]: pgmap v18662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34254.968344 secs 2024-04-27T03:49:20.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33557.933559 secs 2024-04-27T03:49:21.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:21 smithi189 ceph-mon[32756]: pgmap v18663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:21.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:21 smithi156 ceph-mon[32679]: pgmap v18663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:22.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:21 smithi092 ceph-mon[29156]: pgmap v18663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:23.894 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:23 smithi189 ceph-mon[32756]: pgmap v18664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:23.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:23 smithi156 ceph-mon[32679]: pgmap v18664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:23.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:23 smithi092 ceph-mon[29156]: pgmap v18664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34259.968443 secs 2024-04-27T03:49:24.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33562.933677 secs 2024-04-27T03:49:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34259.968443 secs 2024-04-27T03:49:25.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33562.933677 secs 2024-04-27T03:49:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34259.968443 secs 2024-04-27T03:49:25.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33562.933677 secs 2024-04-27T03:49:25.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:25 smithi156 ceph-mon[32679]: pgmap v18665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:25.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:25 smithi092 ceph-mon[29156]: pgmap v18665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:26.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:25 smithi189 ceph-mon[32756]: pgmap v18665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:27.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:27 smithi156 ceph-mon[32679]: pgmap v18666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:27.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:27 smithi189 ceph-mon[32756]: pgmap v18666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:27.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:27 smithi092 ceph-mon[29156]: pgmap v18666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:29 smithi156 ceph-mon[32679]: pgmap v18667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34264.968569 secs 2024-04-27T03:49:29.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33567.933771 secs 2024-04-27T03:49:29.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:29 smithi092 ceph-mon[29156]: pgmap v18667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34264.968569 secs 2024-04-27T03:49:30.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33567.933771 secs 2024-04-27T03:49:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:29 smithi189 ceph-mon[32756]: pgmap v18667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:49:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34264.968569 secs 2024-04-27T03:49:30.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33567.933771 secs 2024-04-27T03:49:30.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:49:30.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:49:31.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:49:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:31 smithi156 ceph-mon[32679]: pgmap v18668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:49:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:49:31.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:49:31.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:31 smithi092 ceph-mon[29156]: pgmap v18668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:49:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:49:32.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:49:32.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:31 smithi189 ceph-mon[32756]: pgmap v18668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:49:32.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:49:32.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:49:32.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:49:32.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:32 smithi092 ceph-mon[29156]: pgmap v18669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:49:32.901 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:32 smithi092 ceph-mon[29156]: pgmap v18670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:32.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:32 smithi156 ceph-mon[32679]: pgmap v18669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:49:32.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:32 smithi156 ceph-mon[32679]: pgmap v18670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:33.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:32 smithi189 ceph-mon[32756]: pgmap v18669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:49:33.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:32 smithi189 ceph-mon[32756]: pgmap v18670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:34 smithi156 ceph-mon[32679]: pgmap v18671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:49:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34269.968678 secs 2024-04-27T03:49:34.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33572.933844 secs 2024-04-27T03:49:34.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:34 smithi092 ceph-mon[29156]: pgmap v18671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:49:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34269.968678 secs 2024-04-27T03:49:35.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33572.933844 secs 2024-04-27T03:49:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:34 smithi189 ceph-mon[32756]: pgmap v18671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:49:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34269.968678 secs 2024-04-27T03:49:35.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33572.933844 secs 2024-04-27T03:49:36.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:36 smithi156 ceph-mon[32679]: pgmap v18672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:36.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:36 smithi092 ceph-mon[29156]: pgmap v18672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:37.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:36 smithi189 ceph-mon[32756]: pgmap v18672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:38.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:38 smithi156 ceph-mon[32679]: pgmap v18673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:38.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:38 smithi092 ceph-mon[29156]: pgmap v18673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:39.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:38 smithi189 ceph-mon[32756]: pgmap v18673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34274.968761 secs 2024-04-27T03:49:39.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33577.933958 secs 2024-04-27T03:49:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34274.968761 secs 2024-04-27T03:49:39.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33577.933958 secs 2024-04-27T03:49:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34274.968761 secs 2024-04-27T03:49:40.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33577.933958 secs 2024-04-27T03:49:40.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:40 smithi156 ceph-mon[32679]: pgmap v18674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:40.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:40 smithi092 ceph-mon[29156]: pgmap v18674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:41.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:40 smithi189 ceph-mon[32756]: pgmap v18674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:49:42.939 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:42 smithi156 ceph-mon[32679]: pgmap v18675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:49:42.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:42 smithi092 ceph-mon[29156]: pgmap v18675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:49:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:42 smithi189 ceph-mon[32756]: pgmap v18675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:49:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:44 smithi156 ceph-mon[32679]: pgmap v18676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34279.968839 secs 2024-04-27T03:49:44.940 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33582.934035 secs 2024-04-27T03:49:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:44 smithi092 ceph-mon[29156]: pgmap v18676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34279.968839 secs 2024-04-27T03:49:44.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33582.934035 secs 2024-04-27T03:49:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:44 smithi189 ceph-mon[32756]: pgmap v18676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34279.968839 secs 2024-04-27T03:49:45.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33582.934035 secs 2024-04-27T03:49:46.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:46 smithi092 ceph-mon[29156]: pgmap v18677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:47.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:46 smithi189 ceph-mon[32756]: pgmap v18677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:47.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:46 smithi156 ceph-mon[32679]: pgmap v18677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:48.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:48 smithi092 ceph-mon[29156]: pgmap v18678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:49.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:48 smithi189 ceph-mon[32756]: pgmap v18678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:49.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:48 smithi156 ceph-mon[32679]: pgmap v18678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:49.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34284.968951 secs 2024-04-27T03:49:50.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33587.934096 secs 2024-04-27T03:49:50.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34284.968951 secs 2024-04-27T03:49:50.146 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33587.934096 secs 2024-04-27T03:49:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34284.968951 secs 2024-04-27T03:49:50.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33587.934096 secs 2024-04-27T03:49:50.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:50 smithi092 ceph-mon[29156]: pgmap v18679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:51.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:50 smithi189 ceph-mon[32756]: pgmap v18679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:51.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:50 smithi156 ceph-mon[32679]: pgmap v18679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:52.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:52 smithi092 ceph-mon[29156]: pgmap v18680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:53.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:52 smithi189 ceph-mon[32756]: pgmap v18680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:52 smithi156 ceph-mon[32679]: pgmap v18680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:54 smithi092 ceph-mon[29156]: pgmap v18681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34289.969057 secs 2024-04-27T03:49:54.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33592.934234 secs 2024-04-27T03:49:55.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:54 smithi189 ceph-mon[32756]: pgmap v18681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34289.969057 secs 2024-04-27T03:49:55.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33592.934234 secs 2024-04-27T03:49:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:54 smithi156 ceph-mon[32679]: pgmap v18681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34289.969057 secs 2024-04-27T03:49:55.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33592.934234 secs 2024-04-27T03:49:56.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:56 smithi092 ceph-mon[29156]: pgmap v18682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:57.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:56 smithi189 ceph-mon[32756]: pgmap v18682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:56 smithi156 ceph-mon[32679]: pgmap v18682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:49:58.992 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:58 smithi156 ceph-mon[32679]: pgmap v18683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:58.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:58 smithi092 ceph-mon[29156]: pgmap v18683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:59.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:58 smithi189 ceph-mon[32756]: pgmap v18683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:49:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34294.969137 secs 2024-04-27T03:49:59.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:49:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33597.934356 secs 2024-04-27T03:50:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34294.969137 secs 2024-04-27T03:50:00.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:49:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33597.934356 secs 2024-04-27T03:50:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34294.969137 secs 2024-04-27T03:50:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:49:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33597.934356 secs 2024-04-27T03:50:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:00 smithi092 ceph-mon[29156]: pgmap v18684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:00.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:50:01.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:00 smithi189 ceph-mon[32756]: pgmap v18684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:01.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:50:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:00 smithi156 ceph-mon[32679]: pgmap v18684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:01.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T03:50:02.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:02 smithi092 ceph-mon[29156]: pgmap v18685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:03.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:02 smithi189 ceph-mon[32756]: pgmap v18685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:02 smithi156 ceph-mon[32679]: pgmap v18685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:04 smithi092 ceph-mon[29156]: pgmap v18686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34299.969197 secs 2024-04-27T03:50:04.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33602.934465 secs 2024-04-27T03:50:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:04 smithi189 ceph-mon[32756]: pgmap v18686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34299.969197 secs 2024-04-27T03:50:05.144 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33602.934465 secs 2024-04-27T03:50:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:04 smithi156 ceph-mon[32679]: pgmap v18686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34299.969197 secs 2024-04-27T03:50:05.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33602.934465 secs 2024-04-27T03:50:06.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:06 smithi092 ceph-mon[29156]: pgmap v18687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:07.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:06 smithi189 ceph-mon[32756]: pgmap v18687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:07.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:06 smithi156 ceph-mon[32679]: pgmap v18687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:08.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:08 smithi092 ceph-mon[29156]: pgmap v18688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:09.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:08 smithi189 ceph-mon[32756]: pgmap v18688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:09.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:08 smithi156 ceph-mon[32679]: pgmap v18688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 34304.969301 secs 2024-04-27T03:50:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:09 smithi092 ceph-mon[29156]: slow request 5760.426382 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:50:09.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33607.934538 secs 2024-04-27T03:50:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 34304.969301 secs 2024-04-27T03:50:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:09 smithi189 ceph-mon[32756]: slow request 5760.426382 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:50:10.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33607.934538 secs 2024-04-27T03:50:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 34304.969301 secs 2024-04-27T03:50:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:09 smithi156 ceph-mon[32679]: slow request 5760.426382 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:50:10.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33607.934538 secs 2024-04-27T03:50:10.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:10 smithi092 ceph-mon[29156]: pgmap v18689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:11.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:10 smithi189 ceph-mon[32756]: pgmap v18689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:11.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:10 smithi156 ceph-mon[32679]: pgmap v18689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:12.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:12 smithi092 ceph-mon[29156]: pgmap v18690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:13.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:12 smithi189 ceph-mon[32756]: pgmap v18690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:13.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:12 smithi156 ceph-mon[32679]: pgmap v18690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:14 smithi092 ceph-mon[29156]: pgmap v18691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:14.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34309.969421 secs 2024-04-27T03:50:15.000 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33612.934615 secs 2024-04-27T03:50:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:14 smithi189 ceph-mon[32756]: pgmap v18691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34309.969421 secs 2024-04-27T03:50:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33612.934615 secs 2024-04-27T03:50:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:14 smithi156 ceph-mon[32679]: pgmap v18691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34309.969421 secs 2024-04-27T03:50:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33612.934615 secs 2024-04-27T03:50:16.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:16 smithi092 ceph-mon[29156]: pgmap v18692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:17.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:16 smithi189 ceph-mon[32756]: pgmap v18692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:17.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:16 smithi156 ceph-mon[32679]: pgmap v18692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:19.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:18 smithi189 ceph-mon[32756]: pgmap v18693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:19.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:18 smithi156 ceph-mon[32679]: pgmap v18693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:19.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:18 smithi092 ceph-mon[29156]: pgmap v18693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34314.969540 secs 2024-04-27T03:50:19.999 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33617.934730 secs 2024-04-27T03:50:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34314.969540 secs 2024-04-27T03:50:20.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33617.934730 secs 2024-04-27T03:50:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34314.969540 secs 2024-04-27T03:50:20.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33617.934730 secs 2024-04-27T03:50:21.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:20 smithi189 ceph-mon[32756]: pgmap v18694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:21.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:20 smithi156 ceph-mon[32679]: pgmap v18694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:21.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:20 smithi092 ceph-mon[29156]: pgmap v18694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:23.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:22 smithi189 ceph-mon[32756]: pgmap v18695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:23.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:22 smithi156 ceph-mon[32679]: pgmap v18695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:23.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:22 smithi092 ceph-mon[29156]: pgmap v18695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:24 smithi189 ceph-mon[32756]: pgmap v18696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34319.969669 secs 2024-04-27T03:50:25.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33622.934868 secs 2024-04-27T03:50:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:24 smithi156 ceph-mon[32679]: pgmap v18696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34319.969669 secs 2024-04-27T03:50:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33622.934868 secs 2024-04-27T03:50:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:24 smithi092 ceph-mon[29156]: pgmap v18696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34319.969669 secs 2024-04-27T03:50:25.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33622.934868 secs 2024-04-27T03:50:27.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:26 smithi189 ceph-mon[32756]: pgmap v18697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:27.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:26 smithi156 ceph-mon[32679]: pgmap v18697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:27.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:26 smithi092 ceph-mon[29156]: pgmap v18697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:29.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:28 smithi189 ceph-mon[32756]: pgmap v18698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:29.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:28 smithi156 ceph-mon[32679]: pgmap v18698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:29.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:28 smithi092 ceph-mon[29156]: pgmap v18698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34324.969787 secs 2024-04-27T03:50:30.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33627.934984 secs 2024-04-27T03:50:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34324.969787 secs 2024-04-27T03:50:30.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33627.934984 secs 2024-04-27T03:50:30.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34324.969787 secs 2024-04-27T03:50:30.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33627.934984 secs 2024-04-27T03:50:31.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:30 smithi189 ceph-mon[32756]: pgmap v18699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:30 smithi156 ceph-mon[32679]: pgmap v18699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:31.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:30 smithi092 ceph-mon[29156]: pgmap v18699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:32.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:50:32.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:50:32.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: pgmap v18700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: pgmap v18701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: pgmap v18702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:33.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: pgmap v18700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: pgmap v18701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: pgmap v18702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:33.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: pgmap v18700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: pgmap v18701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: pgmap v18702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:33.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:50:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:34 smithi189 ceph-mon[32756]: pgmap v18703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34329.969918 secs 2024-04-27T03:50:35.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33632.935107 secs 2024-04-27T03:50:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:34 smithi156 ceph-mon[32679]: pgmap v18703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34329.969918 secs 2024-04-27T03:50:35.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33632.935107 secs 2024-04-27T03:50:35.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:34 smithi092 ceph-mon[29156]: pgmap v18703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34329.969918 secs 2024-04-27T03:50:35.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33632.935107 secs 2024-04-27T03:50:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:36 smithi189 ceph-mon[32756]: pgmap v18704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:36 smithi156 ceph-mon[32679]: pgmap v18704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:36 smithi092 ceph-mon[29156]: pgmap v18704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:39.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:38 smithi189 ceph-mon[32756]: pgmap v18705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:50:39.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:38 smithi156 ceph-mon[32679]: pgmap v18705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:50:39.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:38 smithi092 ceph-mon[29156]: pgmap v18705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:50:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34334.970017 secs 2024-04-27T03:50:40.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33637.935243 secs 2024-04-27T03:50:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34334.970017 secs 2024-04-27T03:50:40.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33637.935243 secs 2024-04-27T03:50:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34334.970017 secs 2024-04-27T03:50:40.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33637.935243 secs 2024-04-27T03:50:41.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:40 smithi189 ceph-mon[32756]: pgmap v18706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:41.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:40 smithi156 ceph-mon[32679]: pgmap v18706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:41.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:40 smithi092 ceph-mon[29156]: pgmap v18706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:50:43.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:42 smithi189 ceph-mon[32756]: pgmap v18707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:50:43.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:42 smithi156 ceph-mon[32679]: pgmap v18707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:50:43.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:42 smithi092 ceph-mon[29156]: pgmap v18707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:50:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:44 smithi189 ceph-mon[32756]: pgmap v18708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34339.970135 secs 2024-04-27T03:50:45.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33642.935333 secs 2024-04-27T03:50:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:44 smithi156 ceph-mon[32679]: pgmap v18708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34339.970135 secs 2024-04-27T03:50:45.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33642.935333 secs 2024-04-27T03:50:45.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:44 smithi092 ceph-mon[29156]: pgmap v18708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:45.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34339.970135 secs 2024-04-27T03:50:45.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33642.935333 secs 2024-04-27T03:50:47.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:46 smithi189 ceph-mon[32756]: pgmap v18709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:47.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:46 smithi156 ceph-mon[32679]: pgmap v18709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:47.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:46 smithi092 ceph-mon[29156]: pgmap v18709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:49.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:48 smithi189 ceph-mon[32756]: pgmap v18710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:49.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:48 smithi156 ceph-mon[32679]: pgmap v18710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:49.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:48 smithi092 ceph-mon[29156]: pgmap v18710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34344.970202 secs 2024-04-27T03:50:50.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33647.935399 secs 2024-04-27T03:50:50.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34344.970202 secs 2024-04-27T03:50:50.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33647.935399 secs 2024-04-27T03:50:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34344.970202 secs 2024-04-27T03:50:50.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33647.935399 secs 2024-04-27T03:50:51.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:50 smithi156 ceph-mon[32679]: pgmap v18711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:51.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:50 smithi092 ceph-mon[29156]: pgmap v18711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:51.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:50 smithi189 ceph-mon[32756]: pgmap v18711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:53.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:52 smithi156 ceph-mon[32679]: pgmap v18712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:53.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:52 smithi092 ceph-mon[29156]: pgmap v18712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:53.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:52 smithi189 ceph-mon[32756]: pgmap v18712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:55.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:54 smithi156 ceph-mon[32679]: pgmap v18713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34349.970279 secs 2024-04-27T03:50:55.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33652.935527 secs 2024-04-27T03:50:55.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:54 smithi092 ceph-mon[29156]: pgmap v18713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:55.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34349.970279 secs 2024-04-27T03:50:55.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33652.935527 secs 2024-04-27T03:50:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:54 smithi189 ceph-mon[32756]: pgmap v18713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:50:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34349.970279 secs 2024-04-27T03:50:55.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33652.935527 secs 2024-04-27T03:50:57.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:56 smithi156 ceph-mon[32679]: pgmap v18714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:57.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:56 smithi092 ceph-mon[29156]: pgmap v18714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:57.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:56 smithi189 ceph-mon[32756]: pgmap v18714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:59.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:58 smithi156 ceph-mon[32679]: pgmap v18715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:59.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:58 smithi189 ceph-mon[32756]: pgmap v18715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:50:59.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:58 smithi092 ceph-mon[29156]: pgmap v18715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:00.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34354.970417 secs 2024-04-27T03:51:00.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:50:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33657.935650 secs 2024-04-27T03:51:00.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34354.970417 secs 2024-04-27T03:51:00.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:50:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33657.935650 secs 2024-04-27T03:51:00.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34354.970417 secs 2024-04-27T03:51:00.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:50:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33657.935650 secs 2024-04-27T03:51:01.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:00 smithi156 ceph-mon[32679]: pgmap v18716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:01.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:00 smithi092 ceph-mon[29156]: pgmap v18716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:01.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:00 smithi189 ceph-mon[32756]: pgmap v18716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:03.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:02 smithi156 ceph-mon[32679]: pgmap v18717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:03.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:02 smithi092 ceph-mon[29156]: pgmap v18717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:03.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:02 smithi189 ceph-mon[32756]: pgmap v18717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:05.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:04 smithi156 ceph-mon[32679]: pgmap v18718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34359.970536 secs 2024-04-27T03:51:05.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33662.935791 secs 2024-04-27T03:51:05.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:04 smithi092 ceph-mon[29156]: pgmap v18718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:05.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34359.970536 secs 2024-04-27T03:51:05.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33662.935791 secs 2024-04-27T03:51:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:04 smithi189 ceph-mon[32756]: pgmap v18718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34359.970536 secs 2024-04-27T03:51:05.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33662.935791 secs 2024-04-27T03:51:07.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:06 smithi156 ceph-mon[32679]: pgmap v18719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:07.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:06 smithi092 ceph-mon[29156]: pgmap v18719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:07.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:06 smithi189 ceph-mon[32756]: pgmap v18719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:08.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:08 smithi092 ceph-mon[29156]: pgmap v18720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:08.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:08 smithi189 ceph-mon[32756]: pgmap v18720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:08.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:08 smithi156 ceph-mon[32679]: pgmap v18720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:09.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33667.935913 secs 2024-04-27T03:51:09.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33667.935913 secs 2024-04-27T03:51:09.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33667.935913 secs 2024-04-27T03:51:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34364.970653 secs 2024-04-27T03:51:10.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:10 smithi189 ceph-mon[32756]: pgmap v18721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:10.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34364.970653 secs 2024-04-27T03:51:10.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:10 smithi156 ceph-mon[32679]: pgmap v18721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34364.970653 secs 2024-04-27T03:51:10.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:10 smithi092 ceph-mon[29156]: pgmap v18721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:13.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:12 smithi189 ceph-mon[32756]: pgmap v18722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:13.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:12 smithi156 ceph-mon[32679]: pgmap v18722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:13.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:12 smithi092 ceph-mon[29156]: pgmap v18722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:15.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:14 smithi189 ceph-mon[32756]: pgmap v18723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34369.970803 secs 2024-04-27T03:51:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:14 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33672.936031 secs 2024-04-27T03:51:15.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:14 smithi189 ceph-mon[32756]: slow request 1444.433387 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:51:15.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:14 smithi156 ceph-mon[32679]: pgmap v18723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:15.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34369.970803 secs 2024-04-27T03:51:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:14 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33672.936031 secs 2024-04-27T03:51:15.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:14 smithi156 ceph-mon[32679]: slow request 1444.433387 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:51:15.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:14 smithi092 ceph-mon[29156]: pgmap v18723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:15.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34369.970803 secs 2024-04-27T03:51:15.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:14 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33672.936031 secs 2024-04-27T03:51:15.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:14 smithi092 ceph-mon[29156]: slow request 1444.433387 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:51:17.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:16 smithi189 ceph-mon[32756]: pgmap v18724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:17.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:16 smithi156 ceph-mon[32679]: pgmap v18724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:17.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:16 smithi092 ceph-mon[29156]: pgmap v18724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:19.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:18 smithi189 ceph-mon[32756]: pgmap v18725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:19.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:18 smithi156 ceph-mon[32679]: pgmap v18725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:19.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:18 smithi092 ceph-mon[29156]: pgmap v18725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:20.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34374.970876 secs 2024-04-27T03:51:20.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33677.936158 secs 2024-04-27T03:51:20.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34374.970876 secs 2024-04-27T03:51:20.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33677.936158 secs 2024-04-27T03:51:20.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34374.970876 secs 2024-04-27T03:51:20.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33677.936158 secs 2024-04-27T03:51:21.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:20 smithi156 ceph-mon[32679]: pgmap v18726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:21.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:20 smithi092 ceph-mon[29156]: pgmap v18726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:21.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:20 smithi189 ceph-mon[32756]: pgmap v18726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:23.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:22 smithi156 ceph-mon[32679]: pgmap v18727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:23.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:22 smithi092 ceph-mon[29156]: pgmap v18727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:23.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:22 smithi189 ceph-mon[32756]: pgmap v18727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:25.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:24 smithi156 ceph-mon[32679]: pgmap v18728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:25.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34379.970994 secs 2024-04-27T03:51:25.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33682.936260 secs 2024-04-27T03:51:25.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:24 smithi092 ceph-mon[29156]: pgmap v18728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:25.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34379.970994 secs 2024-04-27T03:51:25.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33682.936260 secs 2024-04-27T03:51:25.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:24 smithi189 ceph-mon[32756]: pgmap v18728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:25.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34379.970994 secs 2024-04-27T03:51:25.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33682.936260 secs 2024-04-27T03:51:27.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:26 smithi156 ceph-mon[32679]: pgmap v18729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:27.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:26 smithi092 ceph-mon[29156]: pgmap v18729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:27.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:26 smithi189 ceph-mon[32756]: pgmap v18729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:29.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:28 smithi156 ceph-mon[32679]: pgmap v18730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:29.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:28 smithi189 ceph-mon[32756]: pgmap v18730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:29.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:28 smithi092 ceph-mon[29156]: pgmap v18730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:30.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34384.971113 secs 2024-04-27T03:51:30.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33687.936381 secs 2024-04-27T03:51:30.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34384.971113 secs 2024-04-27T03:51:30.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33687.936381 secs 2024-04-27T03:51:30.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34384.971113 secs 2024-04-27T03:51:30.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33687.936381 secs 2024-04-27T03:51:31.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:30 smithi156 ceph-mon[32679]: pgmap v18731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:31.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:30 smithi092 ceph-mon[29156]: pgmap v18731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:31.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:30 smithi189 ceph-mon[32756]: pgmap v18731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:32.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:51:32.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:51:32.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:51:33.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:32 smithi092 ceph-mon[29156]: pgmap v18732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:33.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:51:33.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:51:33.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:51:33.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:32 smithi189 ceph-mon[32756]: pgmap v18732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:33.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:51:33.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:51:33.393 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:51:33.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:32 smithi156 ceph-mon[32679]: pgmap v18732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:33.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:51:33.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:51:33.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:51:34.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:33 smithi092 ceph-mon[29156]: pgmap v18733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:51:34.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:33 smithi092 ceph-mon[29156]: pgmap v18734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:34.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:33 smithi189 ceph-mon[32756]: pgmap v18733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:51:34.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:33 smithi189 ceph-mon[32756]: pgmap v18734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:34.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:33 smithi156 ceph-mon[32679]: pgmap v18733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:51:34.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:33 smithi156 ceph-mon[32679]: pgmap v18734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:35.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34389.971227 secs 2024-04-27T03:51:35.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33692.936499 secs 2024-04-27T03:51:35.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34389.971227 secs 2024-04-27T03:51:35.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33692.936499 secs 2024-04-27T03:51:35.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34389.971227 secs 2024-04-27T03:51:35.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33692.936499 secs 2024-04-27T03:51:36.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:35 smithi092 ceph-mon[29156]: pgmap v18735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:36.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:35 smithi189 ceph-mon[32756]: pgmap v18735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:36.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:35 smithi156 ceph-mon[32679]: pgmap v18735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:38.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:37 smithi092 ceph-mon[29156]: pgmap v18736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:38.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:37 smithi189 ceph-mon[32756]: pgmap v18736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:38.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:37 smithi156 ceph-mon[32679]: pgmap v18736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:39 smithi092 ceph-mon[29156]: pgmap v18737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34394.971361 secs 2024-04-27T03:51:40.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33697.936623 secs 2024-04-27T03:51:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:39 smithi189 ceph-mon[32756]: pgmap v18737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34394.971361 secs 2024-04-27T03:51:40.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33697.936623 secs 2024-04-27T03:51:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:39 smithi156 ceph-mon[32679]: pgmap v18737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:51:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34394.971361 secs 2024-04-27T03:51:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33697.936623 secs 2024-04-27T03:51:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:51:40.705+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:51:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:51:40.705+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:51:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:51:40.705+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:51:40.709 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:51:40.705+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 265 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:51:42.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:41 smithi092 ceph-mon[29156]: pgmap v18738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:42.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:41 smithi189 ceph-mon[32756]: pgmap v18738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:42.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:41 smithi156 ceph-mon[32679]: pgmap v18738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:51:44.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:43 smithi092 ceph-mon[29156]: pgmap v18739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:51:44.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:43 smithi189 ceph-mon[32756]: pgmap v18739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:51:44.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:43 smithi156 ceph-mon[32679]: pgmap v18739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:51:45.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34399.971471 secs 2024-04-27T03:51:45.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33702.936746 secs 2024-04-27T03:51:45.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34399.971471 secs 2024-04-27T03:51:45.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33702.936746 secs 2024-04-27T03:51:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34399.971471 secs 2024-04-27T03:51:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33702.936746 secs 2024-04-27T03:51:46.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:45 smithi189 ceph-mon[32756]: pgmap v18740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:46.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:45 smithi156 ceph-mon[32679]: pgmap v18740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:46.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:45 smithi092 ceph-mon[29156]: pgmap v18740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:47.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:47 smithi189 ceph-mon[32756]: pgmap v18741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:47.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:47 smithi156 ceph-mon[32679]: pgmap v18741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:47.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:47 smithi092 ceph-mon[29156]: pgmap v18741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:49.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:49 smithi156 ceph-mon[32679]: pgmap v18742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:49.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34404.971587 secs 2024-04-27T03:51:49.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33707.936859 secs 2024-04-27T03:51:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:49 smithi092 ceph-mon[29156]: pgmap v18742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34404.971587 secs 2024-04-27T03:51:49.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33707.936859 secs 2024-04-27T03:51:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:49 smithi189 ceph-mon[32756]: pgmap v18742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34404.971587 secs 2024-04-27T03:51:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33707.936859 secs 2024-04-27T03:51:51.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:51 smithi156 ceph-mon[32679]: pgmap v18743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:51.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:51 smithi092 ceph-mon[29156]: pgmap v18743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:52.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:51 smithi189 ceph-mon[32756]: pgmap v18743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:53.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:53 smithi156 ceph-mon[32679]: pgmap v18744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:53.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:53 smithi092 ceph-mon[29156]: pgmap v18744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:54.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:53 smithi189 ceph-mon[32756]: pgmap v18744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:54.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34409.971725 secs 2024-04-27T03:51:54.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33712.937002 secs 2024-04-27T03:51:54.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34409.971725 secs 2024-04-27T03:51:54.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33712.937002 secs 2024-04-27T03:51:55.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34409.971725 secs 2024-04-27T03:51:55.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33712.937002 secs 2024-04-27T03:51:55.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:55 smithi156 ceph-mon[32679]: pgmap v18745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:55.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:55 smithi092 ceph-mon[29156]: pgmap v18745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:56.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:55 smithi189 ceph-mon[32756]: pgmap v18745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:51:57.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:57 smithi156 ceph-mon[32679]: pgmap v18746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:57.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:57 smithi092 ceph-mon[29156]: pgmap v18746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:58.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:57 smithi189 ceph-mon[32756]: pgmap v18746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:59.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:59 smithi156 ceph-mon[32679]: pgmap v18747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:59.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34414.971871 secs 2024-04-27T03:51:59.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:51:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33717.937138 secs 2024-04-27T03:51:59.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:59 smithi189 ceph-mon[32756]: pgmap v18747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:59.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34414.971871 secs 2024-04-27T03:51:59.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:51:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33717.937138 secs 2024-04-27T03:51:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:59 smithi092 ceph-mon[29156]: pgmap v18747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:51:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34414.971871 secs 2024-04-27T03:51:59.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:51:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33717.937138 secs 2024-04-27T03:52:01.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:01 smithi156 ceph-mon[32679]: pgmap v18748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:01.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:01 smithi092 ceph-mon[29156]: pgmap v18748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:02.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:01 smithi189 ceph-mon[32756]: pgmap v18748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:03.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:03 smithi156 ceph-mon[32679]: pgmap v18749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:03.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:03 smithi092 ceph-mon[29156]: pgmap v18749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:04.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:03 smithi189 ceph-mon[32756]: pgmap v18749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34419.971894 secs 2024-04-27T03:52:04.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33722.937266 secs 2024-04-27T03:52:04.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34419.971894 secs 2024-04-27T03:52:04.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33722.937266 secs 2024-04-27T03:52:05.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34419.971894 secs 2024-04-27T03:52:05.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33722.937266 secs 2024-04-27T03:52:05.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:05 smithi156 ceph-mon[32679]: pgmap v18750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:05.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:05 smithi092 ceph-mon[29156]: pgmap v18750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:06.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:05 smithi189 ceph-mon[32756]: pgmap v18750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:07.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:07 smithi092 ceph-mon[29156]: pgmap v18751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:08.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:07 smithi189 ceph-mon[32756]: pgmap v18751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:08.190 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:07 smithi156 ceph-mon[32679]: pgmap v18751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:09 smithi092 ceph-mon[29156]: pgmap v18752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34424.971973 secs 2024-04-27T03:52:09.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33727.937380 secs 2024-04-27T03:52:10.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:09 smithi189 ceph-mon[32756]: pgmap v18752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:10.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34424.971973 secs 2024-04-27T03:52:10.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33727.937380 secs 2024-04-27T03:52:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:09 smithi156 ceph-mon[32679]: pgmap v18752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:10.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34424.971973 secs 2024-04-27T03:52:10.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33727.937380 secs 2024-04-27T03:52:11.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:11 smithi092 ceph-mon[29156]: pgmap v18753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:12.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:11 smithi189 ceph-mon[32756]: pgmap v18753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:12.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:11 smithi156 ceph-mon[32679]: pgmap v18753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:13.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:13 smithi092 ceph-mon[29156]: pgmap v18754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:14.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:13 smithi189 ceph-mon[32756]: pgmap v18754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:14.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:13 smithi156 ceph-mon[32679]: pgmap v18754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:14.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34429.972081 secs 2024-04-27T03:52:14.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33732.937499 secs 2024-04-27T03:52:15.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34429.972081 secs 2024-04-27T03:52:15.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33732.937499 secs 2024-04-27T03:52:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34429.972081 secs 2024-04-27T03:52:15.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33732.937499 secs 2024-04-27T03:52:15.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:15 smithi092 ceph-mon[29156]: pgmap v18755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:16.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:15 smithi189 ceph-mon[32756]: pgmap v18755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:16.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:15 smithi156 ceph-mon[32679]: pgmap v18755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:17.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:17 smithi092 ceph-mon[29156]: pgmap v18756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:18.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:17 smithi189 ceph-mon[32756]: pgmap v18756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:18.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:17 smithi156 ceph-mon[32679]: pgmap v18756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:19.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:19 smithi092 ceph-mon[29156]: pgmap v18757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34434.972196 secs 2024-04-27T03:52:19.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33737.937600 secs 2024-04-27T03:52:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:19 smithi189 ceph-mon[32756]: pgmap v18757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34434.972196 secs 2024-04-27T03:52:20.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33737.937600 secs 2024-04-27T03:52:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:19 smithi156 ceph-mon[32679]: pgmap v18757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:20.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34434.972196 secs 2024-04-27T03:52:20.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33737.937600 secs 2024-04-27T03:52:21.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:21 smithi092 ceph-mon[29156]: pgmap v18758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:22.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:21 smithi189 ceph-mon[32756]: pgmap v18758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:22.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:21 smithi156 ceph-mon[32679]: pgmap v18758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:23.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:23 smithi092 ceph-mon[29156]: pgmap v18759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:24.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:23 smithi189 ceph-mon[32756]: pgmap v18759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:24.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:23 smithi156 ceph-mon[32679]: pgmap v18759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34439.972316 secs 2024-04-27T03:52:24.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33742.937743 secs 2024-04-27T03:52:25.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34439.972316 secs 2024-04-27T03:52:25.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33742.937743 secs 2024-04-27T03:52:25.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34439.972316 secs 2024-04-27T03:52:25.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33742.937743 secs 2024-04-27T03:52:25.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:25 smithi092 ceph-mon[29156]: pgmap v18760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:26.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:25 smithi189 ceph-mon[32756]: pgmap v18760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:26.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:25 smithi156 ceph-mon[32679]: pgmap v18760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:27.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:27 smithi092 ceph-mon[29156]: pgmap v18761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:28.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:27 smithi189 ceph-mon[32756]: pgmap v18761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:28.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:27 smithi156 ceph-mon[32679]: pgmap v18761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:29.990 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:29 smithi156 ceph-mon[32679]: pgmap v18762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:29.990 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34444.972444 secs 2024-04-27T03:52:29.990 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33747.937864 secs 2024-04-27T03:52:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:29 smithi092 ceph-mon[29156]: pgmap v18762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34444.972444 secs 2024-04-27T03:52:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33747.937864 secs 2024-04-27T03:52:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:29 smithi189 ceph-mon[32756]: pgmap v18762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:30.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34444.972444 secs 2024-04-27T03:52:30.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33747.937864 secs 2024-04-27T03:52:31.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:31 smithi092 ceph-mon[29156]: pgmap v18763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:32.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:31 smithi189 ceph-mon[32756]: pgmap v18763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:32.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:31 smithi156 ceph-mon[32679]: pgmap v18763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:32.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:52:33.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:52:33.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:52:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: pgmap v18764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:33.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:33.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:33.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:33.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: pgmap v18764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:34.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.001 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.002 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.002 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.002 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.011 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: pgmap v18764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:34.011 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.011 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.011 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.011 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.012 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:34.012 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:35.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34449.972551 secs 2024-04-27T03:52:35.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33752.937934 secs 2024-04-27T03:52:35.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34449.972551 secs 2024-04-27T03:52:35.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33752.937934 secs 2024-04-27T03:52:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34449.972551 secs 2024-04-27T03:52:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33752.937934 secs 2024-04-27T03:52:36.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: pgmap v18765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: pgmap v18765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: pgmap v18765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:36.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:52:37.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:52:37.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T03:52:37.248 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:52:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:52:37.249 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:52:38.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:52:38.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:38.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:37 smithi189 ceph-mon[32756]: pgmap v18766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:38.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:37 smithi189 ceph-mon[32756]: pgmap v18767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:52:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:37 smithi156 ceph-mon[32679]: pgmap v18766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:38.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:37 smithi156 ceph-mon[32679]: pgmap v18767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T03:52:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T03:52:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:37 smithi092 ceph-mon[29156]: pgmap v18766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:37 smithi092 ceph-mon[29156]: pgmap v18767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:40.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:39 smithi189 ceph-mon[32756]: pgmap v18768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T03:52:40.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34454.972680 secs 2024-04-27T03:52:40.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33757.938035 secs 2024-04-27T03:52:40.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:39 smithi156 ceph-mon[32679]: pgmap v18768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T03:52:40.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34454.972680 secs 2024-04-27T03:52:40.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33757.938035 secs 2024-04-27T03:52:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:39 smithi092 ceph-mon[29156]: pgmap v18768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 3 op/s 2024-04-27T03:52:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34454.972680 secs 2024-04-27T03:52:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33757.938035 secs 2024-04-27T03:52:42.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:41 smithi189 ceph-mon[32756]: pgmap v18769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:42.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:41 smithi156 ceph-mon[32679]: pgmap v18769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:42.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:41 smithi092 ceph-mon[29156]: pgmap v18769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:44.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:43 smithi189 ceph-mon[32756]: pgmap v18770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:44.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:43 smithi156 ceph-mon[32679]: pgmap v18770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:44.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:43 smithi092 ceph-mon[29156]: pgmap v18770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:45.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34459.972811 secs 2024-04-27T03:52:45.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33762.938151 secs 2024-04-27T03:52:45.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34459.972811 secs 2024-04-27T03:52:45.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33762.938151 secs 2024-04-27T03:52:45.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34459.972811 secs 2024-04-27T03:52:45.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33762.938151 secs 2024-04-27T03:52:46.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:45 smithi189 ceph-mon[32756]: pgmap v18771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:46.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:45 smithi156 ceph-mon[32679]: pgmap v18771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:46.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:45 smithi092 ceph-mon[29156]: pgmap v18771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T03:52:48.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:47 smithi189 ceph-mon[32756]: pgmap v18772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:52:48.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:47 smithi156 ceph-mon[32679]: pgmap v18772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:52:48.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:47 smithi092 ceph-mon[29156]: pgmap v18772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:52:50.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:49 smithi189 ceph-mon[32756]: pgmap v18773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34464.972949 secs 2024-04-27T03:52:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33767.938242 secs 2024-04-27T03:52:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:49 smithi156 ceph-mon[32679]: pgmap v18773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34464.972949 secs 2024-04-27T03:52:50.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33767.938242 secs 2024-04-27T03:52:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:49 smithi092 ceph-mon[29156]: pgmap v18773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34464.972949 secs 2024-04-27T03:52:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33767.938242 secs 2024-04-27T03:52:52.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:51 smithi189 ceph-mon[32756]: pgmap v18774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:52.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:51 smithi156 ceph-mon[32679]: pgmap v18774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:52.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:51 smithi092 ceph-mon[29156]: pgmap v18774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:54.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:53 smithi189 ceph-mon[32756]: pgmap v18775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:54.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:53 smithi156 ceph-mon[32679]: pgmap v18775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:54.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:53 smithi092 ceph-mon[29156]: pgmap v18775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:55.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34469.973066 secs 2024-04-27T03:52:55.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33772.938321 secs 2024-04-27T03:52:55.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34469.973066 secs 2024-04-27T03:52:55.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33772.938321 secs 2024-04-27T03:52:55.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34469.973066 secs 2024-04-27T03:52:55.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33772.938321 secs 2024-04-27T03:52:56.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:55 smithi189 ceph-mon[32756]: pgmap v18776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:56.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:55 smithi156 ceph-mon[32679]: pgmap v18776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:56.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:55 smithi092 ceph-mon[29156]: pgmap v18776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:52:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:57 smithi189 ceph-mon[32756]: pgmap v18777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:58.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:57 smithi156 ceph-mon[32679]: pgmap v18777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:52:58.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:57 smithi092 ceph-mon[29156]: pgmap v18777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:00.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:59 smithi189 ceph-mon[32756]: pgmap v18778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:00.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34474.973186 secs 2024-04-27T03:53:00.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:52:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33777.938442 secs 2024-04-27T03:53:00.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:59 smithi156 ceph-mon[32679]: pgmap v18778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:00.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34474.973186 secs 2024-04-27T03:53:00.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:52:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33777.938442 secs 2024-04-27T03:53:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:59 smithi092 ceph-mon[29156]: pgmap v18778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34474.973186 secs 2024-04-27T03:53:00.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:52:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33777.938442 secs 2024-04-27T03:53:02.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:01 smithi189 ceph-mon[32756]: pgmap v18779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:02.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:01 smithi156 ceph-mon[32679]: pgmap v18779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:02.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:01 smithi092 ceph-mon[29156]: pgmap v18779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:04.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:03 smithi189 ceph-mon[32756]: pgmap v18780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:04.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:03 smithi156 ceph-mon[32679]: pgmap v18780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:04.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:03 smithi092 ceph-mon[29156]: pgmap v18780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:05.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34479.973302 secs 2024-04-27T03:53:05.143 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33782.938522 secs 2024-04-27T03:53:05.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34479.973302 secs 2024-04-27T03:53:05.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33782.938522 secs 2024-04-27T03:53:05.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34479.973302 secs 2024-04-27T03:53:05.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33782.938522 secs 2024-04-27T03:53:06.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:05 smithi189 ceph-mon[32756]: pgmap v18781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:06.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:05 smithi156 ceph-mon[32679]: pgmap v18781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:06.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:05 smithi092 ceph-mon[29156]: pgmap v18781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:08.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:07 smithi189 ceph-mon[32756]: pgmap v18782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:08.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:07 smithi156 ceph-mon[32679]: pgmap v18782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:08.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:07 smithi092 ceph-mon[29156]: pgmap v18782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:10.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:09 smithi189 ceph-mon[32756]: pgmap v18783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:10.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34484.973420 secs 2024-04-27T03:53:10.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33787.938613 secs 2024-04-27T03:53:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:09 smithi156 ceph-mon[32679]: pgmap v18783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34484.973420 secs 2024-04-27T03:53:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33787.938613 secs 2024-04-27T03:53:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:09 smithi092 ceph-mon[29156]: pgmap v18783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34484.973420 secs 2024-04-27T03:53:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33787.938613 secs 2024-04-27T03:53:12.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:11 smithi189 ceph-mon[32756]: pgmap v18784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:12.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:11 smithi156 ceph-mon[32679]: pgmap v18784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:12.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:11 smithi092 ceph-mon[29156]: pgmap v18784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:14.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:13 smithi189 ceph-mon[32756]: pgmap v18785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:14.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:13 smithi156 ceph-mon[32679]: pgmap v18785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:14.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:13 smithi092 ceph-mon[29156]: pgmap v18785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34489.973539 secs 2024-04-27T03:53:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33792.938746 secs 2024-04-27T03:53:15.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34489.973539 secs 2024-04-27T03:53:15.148 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33792.938746 secs 2024-04-27T03:53:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34489.973539 secs 2024-04-27T03:53:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33792.938746 secs 2024-04-27T03:53:16.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:15 smithi189 ceph-mon[32756]: pgmap v18786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:16.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:15 smithi156 ceph-mon[32679]: pgmap v18786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:16.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:15 smithi092 ceph-mon[29156]: pgmap v18786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:18.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:17 smithi189 ceph-mon[32756]: pgmap v18787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:18.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:17 smithi156 ceph-mon[32679]: pgmap v18787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:18.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:17 smithi092 ceph-mon[29156]: pgmap v18787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:19 smithi189 ceph-mon[32756]: pgmap v18788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34494.973660 secs 2024-04-27T03:53:20.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33797.938873 secs 2024-04-27T03:53:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:19 smithi156 ceph-mon[32679]: pgmap v18788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34494.973660 secs 2024-04-27T03:53:20.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33797.938873 secs 2024-04-27T03:53:20.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:19 smithi092 ceph-mon[29156]: pgmap v18788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:20.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34494.973660 secs 2024-04-27T03:53:20.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33797.938873 secs 2024-04-27T03:53:22.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:21 smithi189 ceph-mon[32756]: pgmap v18789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:22.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:21 smithi156 ceph-mon[32679]: pgmap v18789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:22.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:21 smithi092 ceph-mon[29156]: pgmap v18789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:24.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:23 smithi189 ceph-mon[32756]: pgmap v18790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:24.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:23 smithi156 ceph-mon[32679]: pgmap v18790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:23 smithi092 ceph-mon[29156]: pgmap v18790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:25.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34499.973756 secs 2024-04-27T03:53:25.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33802.938991 secs 2024-04-27T03:53:25.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34499.973756 secs 2024-04-27T03:53:25.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33802.938991 secs 2024-04-27T03:53:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34499.973756 secs 2024-04-27T03:53:25.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33802.938991 secs 2024-04-27T03:53:26.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:25 smithi189 ceph-mon[32756]: pgmap v18791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:26.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:25 smithi156 ceph-mon[32679]: pgmap v18791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:26.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:25 smithi092 ceph-mon[29156]: pgmap v18791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:28.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:27 smithi189 ceph-mon[32756]: pgmap v18792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:28.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:27 smithi156 ceph-mon[32679]: pgmap v18792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:28.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:27 smithi092 ceph-mon[29156]: pgmap v18792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:29 smithi189 ceph-mon[32756]: pgmap v18793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34504.973875 secs 2024-04-27T03:53:30.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33807.939116 secs 2024-04-27T03:53:30.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:29 smithi156 ceph-mon[32679]: pgmap v18793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:30.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34504.973875 secs 2024-04-27T03:53:30.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33807.939116 secs 2024-04-27T03:53:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:29 smithi092 ceph-mon[29156]: pgmap v18793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34504.973875 secs 2024-04-27T03:53:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33807.939116 secs 2024-04-27T03:53:32.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:31 smithi189 ceph-mon[32756]: pgmap v18794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:32.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:31 smithi156 ceph-mon[32679]: pgmap v18794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:32.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:31 smithi092 ceph-mon[29156]: pgmap v18794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:34.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:33 smithi189 ceph-mon[32756]: pgmap v18795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:34.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:33 smithi156 ceph-mon[32679]: pgmap v18795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:34.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:33 smithi092 ceph-mon[29156]: pgmap v18795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:35.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34509.973991 secs 2024-04-27T03:53:35.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33812.939249 secs 2024-04-27T03:53:35.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34509.973991 secs 2024-04-27T03:53:35.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33812.939249 secs 2024-04-27T03:53:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34509.973991 secs 2024-04-27T03:53:35.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33812.939249 secs 2024-04-27T03:53:36.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:35 smithi189 ceph-mon[32756]: pgmap v18796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:36.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:35 smithi156 ceph-mon[32679]: pgmap v18796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:36.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:35 smithi092 ceph-mon[29156]: pgmap v18796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:53:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:53:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:53:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: pgmap v18797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:53:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:53:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: pgmap v18798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:53:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: pgmap v18799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:38.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: pgmap v18797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: pgmap v18798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: pgmap v18799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:38.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:53:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: pgmap v18797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:53:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:53:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: pgmap v18798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:53:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: pgmap v18799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:38.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:53:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34514.974115 secs 2024-04-27T03:53:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:39 smithi092 ceph-mon[29156]: pgmap v18800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:40.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33817.939372 secs 2024-04-27T03:53:40.247 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:53:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:53:40.020+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:53:40.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:53:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:53:40.020+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:53:40.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:53:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:53:40.020+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:53:40.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:53:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:53:40.020+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:53:40.248 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:53:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:53:40.020+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:53:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34514.974115 secs 2024-04-27T03:53:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:39 smithi189 ceph-mon[32756]: pgmap v18800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:40.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33817.939372 secs 2024-04-27T03:53:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34514.974115 secs 2024-04-27T03:53:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:39 smithi156 ceph-mon[32679]: pgmap v18800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:40.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33817.939372 secs 2024-04-27T03:53:42.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:41 smithi092 ceph-mon[29156]: pgmap v18801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:42.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:41 smithi189 ceph-mon[32756]: pgmap v18801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:42.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:41 smithi156 ceph-mon[32679]: pgmap v18801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:44.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:43 smithi092 ceph-mon[29156]: pgmap v18802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:53:44.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:43 smithi189 ceph-mon[32756]: pgmap v18802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:53:44.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:43 smithi156 ceph-mon[32679]: pgmap v18802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:53:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34519.974224 secs 2024-04-27T03:53:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33822.939496 secs 2024-04-27T03:53:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34519.974224 secs 2024-04-27T03:53:45.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33822.939496 secs 2024-04-27T03:53:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34519.974224 secs 2024-04-27T03:53:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33822.939496 secs 2024-04-27T03:53:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:45 smithi092 ceph-mon[29156]: pgmap v18803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:46.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:45 smithi189 ceph-mon[32756]: pgmap v18803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:46.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:45 smithi156 ceph-mon[32679]: pgmap v18803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:53:48.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:47 smithi092 ceph-mon[29156]: pgmap v18804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:53:48.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:47 smithi189 ceph-mon[32756]: pgmap v18804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:53:48.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:47 smithi156 ceph-mon[32679]: pgmap v18804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:53:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34524.974302 secs 2024-04-27T03:53:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:49 smithi092 ceph-mon[29156]: pgmap v18805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:50.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33827.939578 secs 2024-04-27T03:53:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34524.974302 secs 2024-04-27T03:53:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:49 smithi189 ceph-mon[32756]: pgmap v18805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:50.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33827.939578 secs 2024-04-27T03:53:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34524.974302 secs 2024-04-27T03:53:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:49 smithi156 ceph-mon[32679]: pgmap v18805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:50.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33827.939578 secs 2024-04-27T03:53:52.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:51 smithi092 ceph-mon[29156]: pgmap v18806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:52.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:51 smithi189 ceph-mon[32756]: pgmap v18806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:52.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:51 smithi156 ceph-mon[32679]: pgmap v18806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:54.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:53 smithi189 ceph-mon[32756]: pgmap v18807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:54.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:53 smithi156 ceph-mon[32679]: pgmap v18807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:53 smithi092 ceph-mon[29156]: pgmap v18807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34529.974417 secs 2024-04-27T03:53:55.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:55 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33832.939697 secs 2024-04-27T03:53:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34529.974417 secs 2024-04-27T03:53:55.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:55 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33832.939697 secs 2024-04-27T03:53:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34529.974417 secs 2024-04-27T03:53:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:55 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33832.939697 secs 2024-04-27T03:53:56.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:56 smithi189 ceph-mon[32756]: pgmap v18808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:56.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:56 smithi156 ceph-mon[32679]: pgmap v18808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:56 smithi092 ceph-mon[29156]: pgmap v18808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:53:58.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:53:58 smithi189 ceph-mon[32756]: pgmap v18809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:58.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:53:58 smithi156 ceph-mon[32679]: pgmap v18809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:53:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:53:58 smithi092 ceph-mon[29156]: pgmap v18809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34534.974497 secs 2024-04-27T03:54:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:00 smithi189 ceph-mon[32756]: pgmap v18810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:00 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33837.939811 secs 2024-04-27T03:54:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34534.974497 secs 2024-04-27T03:54:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:00 smithi156 ceph-mon[32679]: pgmap v18810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:00.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:00 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33837.939811 secs 2024-04-27T03:54:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34534.974497 secs 2024-04-27T03:54:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:00 smithi092 ceph-mon[29156]: pgmap v18810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:00.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:00 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33837.939811 secs 2024-04-27T03:54:02.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:02 smithi189 ceph-mon[32756]: pgmap v18811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:02 smithi156 ceph-mon[32679]: pgmap v18811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:02 smithi092 ceph-mon[29156]: pgmap v18811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:04.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:04 smithi189 ceph-mon[32756]: pgmap v18812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:04 smithi156 ceph-mon[32679]: pgmap v18812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:04 smithi092 ceph-mon[29156]: pgmap v18812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34539.974609 secs 2024-04-27T03:54:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:05 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33842.939924 secs 2024-04-27T03:54:05.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:05 smithi189 ceph-mon[32756]: pgmap v18813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34539.974609 secs 2024-04-27T03:54:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:05 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33842.939924 secs 2024-04-27T03:54:05.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:05 smithi156 ceph-mon[32679]: pgmap v18813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34539.974609 secs 2024-04-27T03:54:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:05 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33842.939924 secs 2024-04-27T03:54:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:05 smithi092 ceph-mon[29156]: pgmap v18813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:08.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:07 smithi092 ceph-mon[29156]: pgmap v18814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:08.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:07 smithi189 ceph-mon[32756]: pgmap v18814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:08.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:07 smithi156 ceph-mon[32679]: pgmap v18814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34544.974685 secs 2024-04-27T03:54:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:09 smithi092 ceph-mon[29156]: pgmap v18815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:10.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33847.940019 secs 2024-04-27T03:54:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34544.974685 secs 2024-04-27T03:54:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:09 smithi189 ceph-mon[32756]: pgmap v18815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:10.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33847.940019 secs 2024-04-27T03:54:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34544.974685 secs 2024-04-27T03:54:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:09 smithi156 ceph-mon[32679]: pgmap v18815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:10.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33847.940019 secs 2024-04-27T03:54:12.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:11 smithi092 ceph-mon[29156]: pgmap v18816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:12.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:11 smithi189 ceph-mon[32756]: pgmap v18816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:12.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:11 smithi156 ceph-mon[32679]: pgmap v18816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:14.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:13 smithi092 ceph-mon[29156]: pgmap v18817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:13 smithi189 ceph-mon[32756]: pgmap v18817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:13 smithi156 ceph-mon[32679]: pgmap v18817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 34549.974798 secs 2024-04-27T03:54:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:14 smithi092 ceph-mon[29156]: slow request 2884.597483 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:54:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33852.940146 secs 2024-04-27T03:54:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 34549.974798 secs 2024-04-27T03:54:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:14 smithi189 ceph-mon[32756]: slow request 2884.597483 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:54:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33852.940146 secs 2024-04-27T03:54:15.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 34549.974798 secs 2024-04-27T03:54:15.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:14 smithi156 ceph-mon[32679]: slow request 2884.597483 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:54:15.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33852.940146 secs 2024-04-27T03:54:16.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:15 smithi189 ceph-mon[32756]: pgmap v18818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:16.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:15 smithi156 ceph-mon[32679]: pgmap v18818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:16.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:15 smithi092 ceph-mon[29156]: pgmap v18818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:18.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:17 smithi189 ceph-mon[32756]: pgmap v18819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:18.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:17 smithi156 ceph-mon[32679]: pgmap v18819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:18.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:17 smithi092 ceph-mon[29156]: pgmap v18819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34554.974870 secs 2024-04-27T03:54:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:20 smithi189 ceph-mon[32756]: pgmap v18820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:20.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:20 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33857.940268 secs 2024-04-27T03:54:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34554.974870 secs 2024-04-27T03:54:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:20 smithi156 ceph-mon[32679]: pgmap v18820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:20.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:20 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33857.940268 secs 2024-04-27T03:54:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34554.974870 secs 2024-04-27T03:54:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:20 smithi092 ceph-mon[29156]: pgmap v18820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:20 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33857.940268 secs 2024-04-27T03:54:22.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:22 smithi189 ceph-mon[32756]: pgmap v18821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:22.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:22 smithi156 ceph-mon[32679]: pgmap v18821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:22.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:22 smithi092 ceph-mon[29156]: pgmap v18821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:24 smithi189 ceph-mon[32756]: pgmap v18822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:24 smithi156 ceph-mon[32679]: pgmap v18822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:24 smithi092 ceph-mon[29156]: pgmap v18822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34559.974986 secs 2024-04-27T03:54:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:25 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33862.940335 secs 2024-04-27T03:54:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34559.974986 secs 2024-04-27T03:54:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:25 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33862.940335 secs 2024-04-27T03:54:25.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34559.974986 secs 2024-04-27T03:54:25.499 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:25 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33862.940335 secs 2024-04-27T03:54:26.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:26 smithi189 ceph-mon[32756]: pgmap v18823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:26 smithi156 ceph-mon[32679]: pgmap v18823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:26 smithi092 ceph-mon[29156]: pgmap v18823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:27 smithi189 ceph-mon[32756]: pgmap v18824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:27 smithi156 ceph-mon[32679]: pgmap v18824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:27 smithi092 ceph-mon[29156]: pgmap v18824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34564.975105 secs 2024-04-27T03:54:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:29 smithi092 ceph-mon[29156]: pgmap v18825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:30.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33867.940437 secs 2024-04-27T03:54:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34564.975105 secs 2024-04-27T03:54:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:29 smithi189 ceph-mon[32756]: pgmap v18825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:30.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33867.940437 secs 2024-04-27T03:54:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34564.975105 secs 2024-04-27T03:54:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:29 smithi156 ceph-mon[32679]: pgmap v18825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:30.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33867.940437 secs 2024-04-27T03:54:32.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:31 smithi092 ceph-mon[29156]: pgmap v18826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:32.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:31 smithi189 ceph-mon[32756]: pgmap v18826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:32.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:31 smithi156 ceph-mon[32679]: pgmap v18826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:33 smithi092 ceph-mon[29156]: pgmap v18827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:33 smithi189 ceph-mon[32756]: pgmap v18827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:34.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:33 smithi156 ceph-mon[32679]: pgmap v18827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34569.975215 secs 2024-04-27T03:54:35.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33872.940567 secs 2024-04-27T03:54:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34569.975215 secs 2024-04-27T03:54:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33872.940567 secs 2024-04-27T03:54:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34569.975215 secs 2024-04-27T03:54:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33872.940567 secs 2024-04-27T03:54:36.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:35 smithi189 ceph-mon[32756]: pgmap v18828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:36.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:35 smithi156 ceph-mon[32679]: pgmap v18828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:36.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:35 smithi092 ceph-mon[29156]: pgmap v18828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:38 smithi189 ceph-mon[32756]: pgmap v18829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:54:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:54:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:54:38.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:54:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:38 smithi156 ceph-mon[32679]: pgmap v18829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:54:38.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:54:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:54:38.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:54:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:38 smithi092 ceph-mon[29156]: pgmap v18829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:54:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:54:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:54:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:54:39.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:39 smithi189 ceph-mon[32756]: pgmap v18830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:54:39.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:39 smithi189 ceph-mon[32756]: pgmap v18831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:54:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:39 smithi156 ceph-mon[32679]: pgmap v18830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:54:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:39 smithi156 ceph-mon[32679]: pgmap v18831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:54:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:39 smithi092 ceph-mon[29156]: pgmap v18830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:54:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:39 smithi092 ceph-mon[29156]: pgmap v18831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:54:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34574.975354 secs 2024-04-27T03:54:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:40 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33877.940689 secs 2024-04-27T03:54:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34574.975354 secs 2024-04-27T03:54:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:40 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33877.940689 secs 2024-04-27T03:54:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34574.975354 secs 2024-04-27T03:54:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:40 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33877.940689 secs 2024-04-27T03:54:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:54:40.729+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:54:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:54:40.729+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:54:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:54:40.733+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:54:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:54:40.733+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 266 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:54:41.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:41 smithi189 ceph-mon[32756]: pgmap v18832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:41 smithi156 ceph-mon[32679]: pgmap v18832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:41.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:41 smithi092 ceph-mon[29156]: pgmap v18832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:42.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:42 smithi189 ceph-mon[32756]: pgmap v18833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:42.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:42 smithi156 ceph-mon[32679]: pgmap v18833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:42.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:42 smithi092 ceph-mon[29156]: pgmap v18833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:44 smithi189 ceph-mon[32756]: pgmap v18834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34579.975424 secs 2024-04-27T03:54:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33882.940807 secs 2024-04-27T03:54:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:44 smithi156 ceph-mon[32679]: pgmap v18834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34579.975424 secs 2024-04-27T03:54:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33882.940807 secs 2024-04-27T03:54:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:44 smithi092 ceph-mon[29156]: pgmap v18834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34579.975424 secs 2024-04-27T03:54:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33882.940807 secs 2024-04-27T03:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:46 smithi189 ceph-mon[32756]: pgmap v18835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:46 smithi156 ceph-mon[32679]: pgmap v18835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:46 smithi092 ceph-mon[29156]: pgmap v18835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:54:49.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:48 smithi189 ceph-mon[32756]: pgmap v18836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:54:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:48 smithi156 ceph-mon[32679]: pgmap v18836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:54:49.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:48 smithi092 ceph-mon[29156]: pgmap v18836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:54:50.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34584.975529 secs 2024-04-27T03:54:50.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33887.940928 secs 2024-04-27T03:54:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34584.975529 secs 2024-04-27T03:54:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33887.940928 secs 2024-04-27T03:54:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34584.975529 secs 2024-04-27T03:54:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33887.940928 secs 2024-04-27T03:54:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:50 smithi189 ceph-mon[32756]: pgmap v18837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:51.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:50 smithi156 ceph-mon[32679]: pgmap v18837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:51.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:50 smithi092 ceph-mon[29156]: pgmap v18837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:53.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:52 smithi189 ceph-mon[32756]: pgmap v18838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:53.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:52 smithi156 ceph-mon[32679]: pgmap v18838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:53.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:52 smithi092 ceph-mon[29156]: pgmap v18838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:54 smithi189 ceph-mon[32756]: pgmap v18839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34589.975641 secs 2024-04-27T03:54:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33892.941065 secs 2024-04-27T03:54:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:54 smithi156 ceph-mon[32679]: pgmap v18839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34589.975641 secs 2024-04-27T03:54:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33892.941065 secs 2024-04-27T03:54:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:54 smithi092 ceph-mon[29156]: pgmap v18839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:54:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34589.975641 secs 2024-04-27T03:54:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33892.941065 secs 2024-04-27T03:54:57.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:56 smithi189 ceph-mon[32756]: pgmap v18840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:56 smithi156 ceph-mon[32679]: pgmap v18840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:57.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:56 smithi092 ceph-mon[29156]: pgmap v18840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:59.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:58 smithi189 ceph-mon[32756]: pgmap v18841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:59.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:58 smithi156 ceph-mon[32679]: pgmap v18841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:54:59.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:58 smithi092 ceph-mon[29156]: pgmap v18841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:00.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34594.975762 secs 2024-04-27T03:55:00.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:54:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33897.941205 secs 2024-04-27T03:55:00.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34594.975762 secs 2024-04-27T03:55:00.088 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:54:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33897.941205 secs 2024-04-27T03:55:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34594.975762 secs 2024-04-27T03:55:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:54:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33897.941205 secs 2024-04-27T03:55:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:00 smithi189 ceph-mon[32756]: pgmap v18842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:00 smithi156 ceph-mon[32679]: pgmap v18842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:00 smithi092 ceph-mon[29156]: pgmap v18842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:03.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:02 smithi189 ceph-mon[32756]: pgmap v18843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:03.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:02 smithi156 ceph-mon[32679]: pgmap v18843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:03.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:02 smithi092 ceph-mon[29156]: pgmap v18843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:04 smithi189 ceph-mon[32756]: pgmap v18844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34599.975918 secs 2024-04-27T03:55:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33902.941354 secs 2024-04-27T03:55:05.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:04 smithi156 ceph-mon[32679]: pgmap v18844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:05.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34599.975918 secs 2024-04-27T03:55:05.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33902.941354 secs 2024-04-27T03:55:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:04 smithi092 ceph-mon[29156]: pgmap v18844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34599.975918 secs 2024-04-27T03:55:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33902.941354 secs 2024-04-27T03:55:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:06 smithi189 ceph-mon[32756]: pgmap v18845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:07.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:06 smithi156 ceph-mon[32679]: pgmap v18845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:07.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:06 smithi092 ceph-mon[29156]: pgmap v18845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:09.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:08 smithi189 ceph-mon[32756]: pgmap v18846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:08 smithi156 ceph-mon[32679]: pgmap v18846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:09.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:08 smithi092 ceph-mon[29156]: pgmap v18846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34604.976026 secs 2024-04-27T03:55:10.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33907.941477 secs 2024-04-27T03:55:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34604.976026 secs 2024-04-27T03:55:10.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33907.941477 secs 2024-04-27T03:55:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34604.976026 secs 2024-04-27T03:55:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33907.941477 secs 2024-04-27T03:55:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:10 smithi189 ceph-mon[32756]: pgmap v18847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:11.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:10 smithi156 ceph-mon[32679]: pgmap v18847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:10 smithi092 ceph-mon[29156]: pgmap v18847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:13.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:12 smithi189 ceph-mon[32756]: pgmap v18848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:13.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:12 smithi156 ceph-mon[32679]: pgmap v18848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:13.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:12 smithi092 ceph-mon[29156]: pgmap v18848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:14 smithi092 ceph-mon[29156]: pgmap v18849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34609.976134 secs 2024-04-27T03:55:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33912.941605 secs 2024-04-27T03:55:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:14 smithi189 ceph-mon[32756]: pgmap v18849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:15.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34609.976134 secs 2024-04-27T03:55:15.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33912.941605 secs 2024-04-27T03:55:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:14 smithi156 ceph-mon[32679]: pgmap v18849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34609.976134 secs 2024-04-27T03:55:15.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33912.941605 secs 2024-04-27T03:55:17.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:16 smithi189 ceph-mon[32756]: pgmap v18850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:17.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:16 smithi156 ceph-mon[32679]: pgmap v18850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:17.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:16 smithi092 ceph-mon[29156]: pgmap v18850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:19.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:18 smithi189 ceph-mon[32756]: pgmap v18851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:19.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:18 smithi156 ceph-mon[32679]: pgmap v18851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:19.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:18 smithi092 ceph-mon[29156]: pgmap v18851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34614.976198 secs 2024-04-27T03:55:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33917.941743 secs 2024-04-27T03:55:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34614.976198 secs 2024-04-27T03:55:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33917.941743 secs 2024-04-27T03:55:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34614.976198 secs 2024-04-27T03:55:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33917.941743 secs 2024-04-27T03:55:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:20 smithi189 ceph-mon[32756]: pgmap v18852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:20 smithi156 ceph-mon[32679]: pgmap v18852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:21.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:20 smithi092 ceph-mon[29156]: pgmap v18852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:22 smithi189 ceph-mon[32756]: pgmap v18853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:22 smithi156 ceph-mon[32679]: pgmap v18853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:23.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:22 smithi092 ceph-mon[29156]: pgmap v18853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:24 smithi189 ceph-mon[32756]: pgmap v18854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34619.976311 secs 2024-04-27T03:55:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33922.941898 secs 2024-04-27T03:55:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:24 smithi156 ceph-mon[32679]: pgmap v18854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34619.976311 secs 2024-04-27T03:55:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33922.941898 secs 2024-04-27T03:55:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:24 smithi092 ceph-mon[29156]: pgmap v18854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34619.976311 secs 2024-04-27T03:55:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33922.941898 secs 2024-04-27T03:55:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:26 smithi189 ceph-mon[32756]: pgmap v18855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:26 smithi156 ceph-mon[32679]: pgmap v18855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:27.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:26 smithi092 ceph-mon[29156]: pgmap v18855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:28 smithi189 ceph-mon[32756]: pgmap v18856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:28 smithi156 ceph-mon[32679]: pgmap v18856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:28 smithi092 ceph-mon[29156]: pgmap v18856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34624.976462 secs 2024-04-27T03:55:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33927.942039 secs 2024-04-27T03:55:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34624.976462 secs 2024-04-27T03:55:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33927.942039 secs 2024-04-27T03:55:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34624.976462 secs 2024-04-27T03:55:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33927.942039 secs 2024-04-27T03:55:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:30 smithi189 ceph-mon[32756]: pgmap v18857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:31.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:30 smithi156 ceph-mon[32679]: pgmap v18857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:30 smithi092 ceph-mon[29156]: pgmap v18857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:33.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:32 smithi189 ceph-mon[32756]: pgmap v18858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:33.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:32 smithi156 ceph-mon[32679]: pgmap v18858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:33.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:32 smithi092 ceph-mon[29156]: pgmap v18858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:34 smithi189 ceph-mon[32756]: pgmap v18859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34629.976576 secs 2024-04-27T03:55:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33932.942185 secs 2024-04-27T03:55:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:34 smithi156 ceph-mon[32679]: pgmap v18859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34629.976576 secs 2024-04-27T03:55:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33932.942185 secs 2024-04-27T03:55:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:34 smithi092 ceph-mon[29156]: pgmap v18859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34629.976576 secs 2024-04-27T03:55:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33932.942185 secs 2024-04-27T03:55:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:36 smithi189 ceph-mon[32756]: pgmap v18860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:36 smithi156 ceph-mon[32679]: pgmap v18860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:36 smithi092 ceph-mon[29156]: pgmap v18860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:55:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:55:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:55:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:38 smithi189 ceph-mon[32756]: pgmap v18861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:55:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:55:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:55:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:38 smithi156 ceph-mon[32679]: pgmap v18861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:39.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:55:39.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:55:39.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:55:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:38 smithi092 ceph-mon[29156]: pgmap v18861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:55:39.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:55:39.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:39 smithi189 ceph-mon[32756]: pgmap v18862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:39 smithi189 ceph-mon[32756]: pgmap v18863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34634.976695 secs 2024-04-27T03:55:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33937.942285 secs 2024-04-27T03:55:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:39 smithi156 ceph-mon[32679]: pgmap v18862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:55:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:39 smithi156 ceph-mon[32679]: pgmap v18863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34634.976695 secs 2024-04-27T03:55:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33937.942285 secs 2024-04-27T03:55:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:39 smithi092 ceph-mon[29156]: pgmap v18862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:55:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:39 smithi092 ceph-mon[29156]: pgmap v18863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34634.976695 secs 2024-04-27T03:55:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33937.942285 secs 2024-04-27T03:55:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:41 smithi189 ceph-mon[32756]: pgmap v18864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:42.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:41 smithi156 ceph-mon[32679]: pgmap v18864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:41 smithi092 ceph-mon[29156]: pgmap v18864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:43 smithi189 ceph-mon[32756]: pgmap v18865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:44.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:43 smithi156 ceph-mon[32679]: pgmap v18865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:43 smithi092 ceph-mon[29156]: pgmap v18865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:55:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34639.976816 secs 2024-04-27T03:55:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33942.942409 secs 2024-04-27T03:55:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34639.976816 secs 2024-04-27T03:55:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33942.942409 secs 2024-04-27T03:55:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34639.976816 secs 2024-04-27T03:55:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33942.942409 secs 2024-04-27T03:55:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:45 smithi189 ceph-mon[32756]: pgmap v18866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:46.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:45 smithi092 ceph-mon[29156]: pgmap v18866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:45 smithi156 ceph-mon[32679]: pgmap v18866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:47 smithi189 ceph-mon[32756]: pgmap v18867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:47 smithi156 ceph-mon[32679]: pgmap v18867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:47 smithi092 ceph-mon[29156]: pgmap v18867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:55:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:49 smithi189 ceph-mon[32756]: pgmap v18868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:55:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34644.976908 secs 2024-04-27T03:55:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33947.942472 secs 2024-04-27T03:55:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:49 smithi156 ceph-mon[32679]: pgmap v18868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:55:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34644.976908 secs 2024-04-27T03:55:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33947.942472 secs 2024-04-27T03:55:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:49 smithi092 ceph-mon[29156]: pgmap v18868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:55:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34644.976908 secs 2024-04-27T03:55:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33947.942472 secs 2024-04-27T03:55:52.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:51 smithi189 ceph-mon[32756]: pgmap v18869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:52.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:51 smithi156 ceph-mon[32679]: pgmap v18869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:51 smithi092 ceph-mon[29156]: pgmap v18869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:54.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:53 smithi156 ceph-mon[32679]: pgmap v18870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:53 smithi092 ceph-mon[29156]: pgmap v18870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:53 smithi189 ceph-mon[32756]: pgmap v18870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34649.976976 secs 2024-04-27T03:55:55.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33952.942612 secs 2024-04-27T03:55:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34649.976976 secs 2024-04-27T03:55:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33952.942612 secs 2024-04-27T03:55:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34649.976976 secs 2024-04-27T03:55:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33952.942612 secs 2024-04-27T03:55:56.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:55 smithi156 ceph-mon[32679]: pgmap v18871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:56.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:55 smithi092 ceph-mon[29156]: pgmap v18871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:56.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:55 smithi189 ceph-mon[32756]: pgmap v18871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:55:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:57 smithi156 ceph-mon[32679]: pgmap v18872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:57 smithi092 ceph-mon[29156]: pgmap v18872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:55:58.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:57 smithi189 ceph-mon[32756]: pgmap v18872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:59 smithi156 ceph-mon[32679]: pgmap v18873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34654.977071 secs 2024-04-27T03:56:00.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:55:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33957.942725 secs 2024-04-27T03:56:00.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:59 smithi189 ceph-mon[32756]: pgmap v18873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:00.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34654.977071 secs 2024-04-27T03:56:00.192 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:55:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33957.942725 secs 2024-04-27T03:56:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:59 smithi092 ceph-mon[29156]: pgmap v18873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34654.977071 secs 2024-04-27T03:56:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:55:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33957.942725 secs 2024-04-27T03:56:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:01 smithi092 ceph-mon[29156]: pgmap v18874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:02.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:01 smithi156 ceph-mon[32679]: pgmap v18874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:02.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:01 smithi189 ceph-mon[32756]: pgmap v18874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:04.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:03 smithi156 ceph-mon[32679]: pgmap v18875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:03 smithi092 ceph-mon[29156]: pgmap v18875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:04.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:03 smithi189 ceph-mon[32756]: pgmap v18875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34659.977148 secs 2024-04-27T03:56:05.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33962.942798 secs 2024-04-27T03:56:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34659.977148 secs 2024-04-27T03:56:05.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33962.942798 secs 2024-04-27T03:56:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34659.977148 secs 2024-04-27T03:56:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33962.942798 secs 2024-04-27T03:56:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:05 smithi156 ceph-mon[32679]: pgmap v18876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:05 smithi092 ceph-mon[29156]: pgmap v18876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:06.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:05 smithi189 ceph-mon[32756]: pgmap v18876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:07 smithi156 ceph-mon[32679]: pgmap v18877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:07 smithi092 ceph-mon[29156]: pgmap v18877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:08.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:07 smithi189 ceph-mon[32756]: pgmap v18877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:09 smithi156 ceph-mon[32679]: pgmap v18878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34664.977267 secs 2024-04-27T03:56:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33967.942928 secs 2024-04-27T03:56:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:09 smithi092 ceph-mon[29156]: pgmap v18878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34664.977267 secs 2024-04-27T03:56:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33967.942928 secs 2024-04-27T03:56:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:09 smithi189 ceph-mon[32756]: pgmap v18878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34664.977267 secs 2024-04-27T03:56:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33967.942928 secs 2024-04-27T03:56:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:56:10.742+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:56:10.744 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:56:10.742+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T03:56:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:56:10.745+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:56:10.747 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:56:10.745+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 267 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:56:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:11 smithi156 ceph-mon[32679]: pgmap v18879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:11 smithi092 ceph-mon[29156]: pgmap v18879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:12.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:11 smithi189 ceph-mon[32756]: pgmap v18879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:13 smithi156 ceph-mon[32679]: pgmap v18880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:13 smithi092 ceph-mon[29156]: pgmap v18880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:13 smithi189 ceph-mon[32756]: pgmap v18880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34669.977342 secs 2024-04-27T03:56:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:14 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 33972.943048 secs 2024-04-27T03:56:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:14 smithi092 ceph-mon[29156]: slow request 1444.387498 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:56:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34669.977342 secs 2024-04-27T03:56:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:14 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 33972.943048 secs 2024-04-27T03:56:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:14 smithi189 ceph-mon[32756]: slow request 1444.387498 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:56:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34669.977342 secs 2024-04-27T03:56:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:14 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 33972.943048 secs 2024-04-27T03:56:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:14 smithi156 ceph-mon[32679]: slow request 1444.387498 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:56:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:15 smithi092 ceph-mon[29156]: pgmap v18881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:15 smithi189 ceph-mon[32756]: pgmap v18881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:15 smithi156 ceph-mon[32679]: pgmap v18881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:17 smithi092 ceph-mon[29156]: pgmap v18882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:17 smithi189 ceph-mon[32756]: pgmap v18882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:18.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:17 smithi156 ceph-mon[32679]: pgmap v18882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:19 smithi092 ceph-mon[29156]: pgmap v18883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34674.977436 secs 2024-04-27T03:56:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33977.943173 secs 2024-04-27T03:56:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:19 smithi189 ceph-mon[32756]: pgmap v18883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34674.977436 secs 2024-04-27T03:56:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33977.943173 secs 2024-04-27T03:56:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:19 smithi156 ceph-mon[32679]: pgmap v18883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34674.977436 secs 2024-04-27T03:56:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33977.943173 secs 2024-04-27T03:56:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:21 smithi092 ceph-mon[29156]: pgmap v18884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:22.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:21 smithi189 ceph-mon[32756]: pgmap v18884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:21 smithi156 ceph-mon[32679]: pgmap v18884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:23 smithi092 ceph-mon[29156]: pgmap v18885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:23 smithi189 ceph-mon[32756]: pgmap v18885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:23 smithi156 ceph-mon[32679]: pgmap v18885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34679.977512 secs 2024-04-27T03:56:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33982.943312 secs 2024-04-27T03:56:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34679.977512 secs 2024-04-27T03:56:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33982.943312 secs 2024-04-27T03:56:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34679.977512 secs 2024-04-27T03:56:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33982.943312 secs 2024-04-27T03:56:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:25 smithi092 ceph-mon[29156]: pgmap v18886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:25 smithi189 ceph-mon[32756]: pgmap v18886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:25 smithi156 ceph-mon[32679]: pgmap v18886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:27 smithi092 ceph-mon[29156]: pgmap v18887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:27 smithi189 ceph-mon[32756]: pgmap v18887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:27 smithi156 ceph-mon[32679]: pgmap v18887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:29 smithi092 ceph-mon[29156]: pgmap v18888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34684.977647 secs 2024-04-27T03:56:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33987.943430 secs 2024-04-27T03:56:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:29 smithi189 ceph-mon[32756]: pgmap v18888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34684.977647 secs 2024-04-27T03:56:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33987.943430 secs 2024-04-27T03:56:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:29 smithi156 ceph-mon[32679]: pgmap v18888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34684.977647 secs 2024-04-27T03:56:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33987.943430 secs 2024-04-27T03:56:32.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:31 smithi156 ceph-mon[32679]: pgmap v18889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:31 smithi092 ceph-mon[29156]: pgmap v18889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:32.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:31 smithi189 ceph-mon[32756]: pgmap v18889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:33 smithi092 ceph-mon[29156]: pgmap v18890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:33 smithi189 ceph-mon[32756]: pgmap v18890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:33 smithi156 ceph-mon[32679]: pgmap v18890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34689.977782 secs 2024-04-27T03:56:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33992.943506 secs 2024-04-27T03:56:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34689.977782 secs 2024-04-27T03:56:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33992.943506 secs 2024-04-27T03:56:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34689.977782 secs 2024-04-27T03:56:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33992.943506 secs 2024-04-27T03:56:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:35 smithi092 ceph-mon[29156]: pgmap v18891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:35 smithi189 ceph-mon[32756]: pgmap v18891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:35 smithi156 ceph-mon[32679]: pgmap v18891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:37 smithi092 ceph-mon[29156]: pgmap v18892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:37 smithi189 ceph-mon[32756]: pgmap v18892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:37 smithi156 ceph-mon[32679]: pgmap v18892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:56:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:56:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: pgmap v18893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34694.977889 secs 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 33997.943614 secs 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:56:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:56:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: pgmap v18893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34694.977889 secs 2024-04-27T03:56:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 33997.943614 secs 2024-04-27T03:56:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:56:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:56:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: pgmap v18893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34694.977889 secs 2024-04-27T03:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 33997.943614 secs 2024-04-27T03:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:56:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:56:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:56:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:41 smithi189 ceph-mon[32756]: pgmap v18894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:56:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:41 smithi189 ceph-mon[32756]: pgmap v18895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:41 smithi156 ceph-mon[32679]: pgmap v18894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:56:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:41 smithi156 ceph-mon[32679]: pgmap v18895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:41 smithi092 ceph-mon[29156]: pgmap v18894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T03:56:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:41 smithi092 ceph-mon[29156]: pgmap v18895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:43 smithi189 ceph-mon[32756]: pgmap v18896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:43 smithi156 ceph-mon[32679]: pgmap v18896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:43 smithi092 ceph-mon[29156]: pgmap v18896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:45 smithi189 ceph-mon[32756]: pgmap v18897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:56:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34699.977998 secs 2024-04-27T03:56:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:45 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34002.943735 secs 2024-04-27T03:56:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:45 smithi156 ceph-mon[32679]: pgmap v18897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:56:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34699.977998 secs 2024-04-27T03:56:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:45 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34002.943735 secs 2024-04-27T03:56:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:45 smithi092 ceph-mon[29156]: pgmap v18897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:56:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34699.977998 secs 2024-04-27T03:56:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:45 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34002.943735 secs 2024-04-27T03:56:47.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:47 smithi189 ceph-mon[32756]: pgmap v18898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:47.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:47 smithi156 ceph-mon[32679]: pgmap v18898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:47 smithi092 ceph-mon[29156]: pgmap v18898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:49 smithi189 ceph-mon[32756]: pgmap v18899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:49 smithi156 ceph-mon[32679]: pgmap v18899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:49 smithi092 ceph-mon[29156]: pgmap v18899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:56:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34704.978113 secs 2024-04-27T03:56:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:50 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34007.943852 secs 2024-04-27T03:56:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34704.978113 secs 2024-04-27T03:56:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:50 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34007.943852 secs 2024-04-27T03:56:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34704.978113 secs 2024-04-27T03:56:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:50 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34007.943852 secs 2024-04-27T03:56:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:51 smithi189 ceph-mon[32756]: pgmap v18900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:56:51.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:51 smithi156 ceph-mon[32679]: pgmap v18900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:56:51.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:51 smithi092 ceph-mon[29156]: pgmap v18900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:56:53.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:53 smithi189 ceph-mon[32756]: pgmap v18901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:53.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:53 smithi156 ceph-mon[32679]: pgmap v18901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:53.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:53 smithi092 ceph-mon[29156]: pgmap v18901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:55 smithi189 ceph-mon[32756]: pgmap v18902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34709.978253 secs 2024-04-27T03:56:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:55 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34012.943964 secs 2024-04-27T03:56:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:55 smithi156 ceph-mon[32679]: pgmap v18902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34709.978253 secs 2024-04-27T03:56:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:55 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34012.943964 secs 2024-04-27T03:56:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:55 smithi092 ceph-mon[29156]: pgmap v18902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34709.978253 secs 2024-04-27T03:56:55.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:55 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34012.943964 secs 2024-04-27T03:56:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:57 smithi189 ceph-mon[32756]: pgmap v18903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:57.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:57 smithi156 ceph-mon[32679]: pgmap v18903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:57.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:57 smithi092 ceph-mon[29156]: pgmap v18903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:56:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:56:59 smithi189 ceph-mon[32756]: pgmap v18904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:56:59 smithi156 ceph-mon[32679]: pgmap v18904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:56:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:56:59 smithi092 ceph-mon[29156]: pgmap v18904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:00.291 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34714.978316 secs 2024-04-27T03:57:00.291 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:00 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34017.944115 secs 2024-04-27T03:57:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34714.978316 secs 2024-04-27T03:57:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:00 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34017.944115 secs 2024-04-27T03:57:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34714.978316 secs 2024-04-27T03:57:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:00 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34017.944115 secs 2024-04-27T03:57:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:01 smithi189 ceph-mon[32756]: pgmap v18905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:01.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:01 smithi156 ceph-mon[32679]: pgmap v18905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:01 smithi092 ceph-mon[29156]: pgmap v18905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:03.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:03 smithi189 ceph-mon[32756]: pgmap v18906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:03.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:03 smithi156 ceph-mon[32679]: pgmap v18906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:03 smithi092 ceph-mon[29156]: pgmap v18906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:04 smithi189 ceph-mon[32756]: pgmap v18907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:04 smithi156 ceph-mon[32679]: pgmap v18907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:04 smithi092 ceph-mon[29156]: pgmap v18907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34719.978395 secs 2024-04-27T03:57:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:05 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34022.944242 secs 2024-04-27T03:57:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34719.978395 secs 2024-04-27T03:57:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:05 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34022.944242 secs 2024-04-27T03:57:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34719.978395 secs 2024-04-27T03:57:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:05 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34022.944242 secs 2024-04-27T03:57:06.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:06 smithi189 ceph-mon[32756]: pgmap v18908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:06.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:06 smithi156 ceph-mon[32679]: pgmap v18908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:06 smithi092 ceph-mon[29156]: pgmap v18908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:08 smithi189 ceph-mon[32756]: pgmap v18909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:08 smithi156 ceph-mon[32679]: pgmap v18909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:08 smithi092 ceph-mon[29156]: pgmap v18909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:10.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34724.978508 secs 2024-04-27T03:57:10.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:10 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34027.944373 secs 2024-04-27T03:57:10.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:10 smithi189 ceph-mon[32756]: pgmap v18910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34724.978508 secs 2024-04-27T03:57:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:10 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34027.944373 secs 2024-04-27T03:57:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:10 smithi156 ceph-mon[32679]: pgmap v18910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34724.978508 secs 2024-04-27T03:57:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:10 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34027.944373 secs 2024-04-27T03:57:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:10 smithi092 ceph-mon[29156]: pgmap v18910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:12 smithi189 ceph-mon[32756]: pgmap v18911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:12 smithi156 ceph-mon[32679]: pgmap v18911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:12 smithi092 ceph-mon[29156]: pgmap v18911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:14 smithi189 ceph-mon[32756]: pgmap v18912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:14 smithi156 ceph-mon[32679]: pgmap v18912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:14 smithi092 ceph-mon[29156]: pgmap v18912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34729.978624 secs 2024-04-27T03:57:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:15 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34032.944445 secs 2024-04-27T03:57:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34729.978624 secs 2024-04-27T03:57:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:15 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34032.944445 secs 2024-04-27T03:57:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34729.978624 secs 2024-04-27T03:57:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:15 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34032.944445 secs 2024-04-27T03:57:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:16 smithi189 ceph-mon[32756]: pgmap v18913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:16 smithi156 ceph-mon[32679]: pgmap v18913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:16 smithi092 ceph-mon[29156]: pgmap v18913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:18 smithi189 ceph-mon[32756]: pgmap v18914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:18 smithi156 ceph-mon[32679]: pgmap v18914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:18 smithi092 ceph-mon[29156]: pgmap v18914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34734.978740 secs 2024-04-27T03:57:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:20 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34037.944596 secs 2024-04-27T03:57:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:20 smithi189 ceph-mon[32756]: pgmap v18915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34734.978740 secs 2024-04-27T03:57:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:20 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34037.944596 secs 2024-04-27T03:57:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:20 smithi156 ceph-mon[32679]: pgmap v18915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34734.978740 secs 2024-04-27T03:57:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:20 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34037.944596 secs 2024-04-27T03:57:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:20 smithi092 ceph-mon[29156]: pgmap v18915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:22 smithi189 ceph-mon[32756]: pgmap v18916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:22 smithi156 ceph-mon[32679]: pgmap v18916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:22 smithi092 ceph-mon[29156]: pgmap v18916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:24 smithi189 ceph-mon[32756]: pgmap v18917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:24 smithi156 ceph-mon[32679]: pgmap v18917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:24 smithi092 ceph-mon[29156]: pgmap v18917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34739.978855 secs 2024-04-27T03:57:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:25 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34042.944715 secs 2024-04-27T03:57:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34739.978855 secs 2024-04-27T03:57:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:25 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34042.944715 secs 2024-04-27T03:57:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34739.978855 secs 2024-04-27T03:57:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:25 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34042.944715 secs 2024-04-27T03:57:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:26 smithi189 ceph-mon[32756]: pgmap v18918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:26 smithi156 ceph-mon[32679]: pgmap v18918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:26 smithi092 ceph-mon[29156]: pgmap v18918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:28 smithi189 ceph-mon[32756]: pgmap v18919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:28 smithi156 ceph-mon[32679]: pgmap v18919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:28 smithi092 ceph-mon[29156]: pgmap v18919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34744.978973 secs 2024-04-27T03:57:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:30 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34047.944832 secs 2024-04-27T03:57:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:30 smithi189 ceph-mon[32756]: pgmap v18920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34744.978973 secs 2024-04-27T03:57:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:30 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34047.944832 secs 2024-04-27T03:57:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:30 smithi156 ceph-mon[32679]: pgmap v18920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34744.978973 secs 2024-04-27T03:57:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:30 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34047.944832 secs 2024-04-27T03:57:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:30 smithi092 ceph-mon[29156]: pgmap v18920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:32 smithi189 ceph-mon[32756]: pgmap v18921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:32 smithi156 ceph-mon[32679]: pgmap v18921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:32 smithi092 ceph-mon[29156]: pgmap v18921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:34 smithi189 ceph-mon[32756]: pgmap v18922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34052.944904 secs 2024-04-27T03:57:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:34 smithi156 ceph-mon[32679]: pgmap v18922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34052.944904 secs 2024-04-27T03:57:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:34 smithi092 ceph-mon[29156]: pgmap v18922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34052.944904 secs 2024-04-27T03:57:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34749.979087 secs 2024-04-27T03:57:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34749.979087 secs 2024-04-27T03:57:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34749.979087 secs 2024-04-27T03:57:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:36 smithi189 ceph-mon[32756]: pgmap v18923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:36 smithi156 ceph-mon[32679]: pgmap v18923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:36 smithi092 ceph-mon[29156]: pgmap v18923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:38 smithi189 ceph-mon[32756]: pgmap v18924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:38 smithi156 ceph-mon[32679]: pgmap v18924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:38 smithi092 ceph-mon[29156]: pgmap v18924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34057.945007 secs 2024-04-27T03:57:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:57:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34057.945007 secs 2024-04-27T03:57:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:57:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34057.945007 secs 2024-04-27T03:57:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34754.979197 secs 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: pgmap v18925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: pgmap v18926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:57:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: pgmap v18927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34754.979197 secs 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: pgmap v18925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: pgmap v18926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: pgmap v18927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:57:40.753+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T03:57:40.755 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:57:40.753+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T03:57:40.757 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:57:40.755+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:57:40.758 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T03:57:40.756+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 268 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34754.979197 secs 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: pgmap v18925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: pgmap v18926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:57:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: pgmap v18927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:57:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:42 smithi189 ceph-mon[32756]: pgmap v18928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:42 smithi156 ceph-mon[32679]: pgmap v18928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:42 smithi092 ceph-mon[29156]: pgmap v18928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:44 smithi189 ceph-mon[32756]: pgmap v18929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:44 smithi156 ceph-mon[32679]: pgmap v18929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:44 smithi092 ceph-mon[29156]: pgmap v18929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34759.979325 secs 2024-04-27T03:57:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:45 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34062.945142 secs 2024-04-27T03:57:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34759.979325 secs 2024-04-27T03:57:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:45 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34062.945142 secs 2024-04-27T03:57:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34759.979325 secs 2024-04-27T03:57:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:45 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34062.945142 secs 2024-04-27T03:57:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:46 smithi189 ceph-mon[32756]: pgmap v18930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:46 smithi156 ceph-mon[32679]: pgmap v18930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:46 smithi092 ceph-mon[29156]: pgmap v18930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:57:48.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:48 smithi189 ceph-mon[32756]: pgmap v18931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:57:48.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:48 smithi156 ceph-mon[32679]: pgmap v18931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:57:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:48 smithi092 ceph-mon[29156]: pgmap v18931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:57:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34067.945260 secs 2024-04-27T03:57:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34067.945260 secs 2024-04-27T03:57:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34067.945260 secs 2024-04-27T03:57:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34764.979438 secs 2024-04-27T03:57:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:50 smithi156 ceph-mon[32679]: pgmap v18932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:57:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34764.979438 secs 2024-04-27T03:57:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:50 smithi092 ceph-mon[29156]: pgmap v18932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:57:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34764.979438 secs 2024-04-27T03:57:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:50 smithi189 ceph-mon[32756]: pgmap v18932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:57:52.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:52 smithi189 ceph-mon[32756]: pgmap v18933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:52 smithi156 ceph-mon[32679]: pgmap v18933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:52.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:52 smithi092 ceph-mon[29156]: pgmap v18933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:57:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:54 smithi189 ceph-mon[32756]: pgmap v18934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:57:54.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:54 smithi156 ceph-mon[32679]: pgmap v18934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:57:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:54 smithi092 ceph-mon[29156]: pgmap v18934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:57:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34769.979558 secs 2024-04-27T03:57:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:55 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34072.945380 secs 2024-04-27T03:57:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34769.979558 secs 2024-04-27T03:57:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:55 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34072.945380 secs 2024-04-27T03:57:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34769.979558 secs 2024-04-27T03:57:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:55 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34072.945380 secs 2024-04-27T03:57:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:56 smithi189 ceph-mon[32756]: pgmap v18935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:56.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:56 smithi156 ceph-mon[32679]: pgmap v18935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:56 smithi092 ceph-mon[29156]: pgmap v18935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:58 smithi189 ceph-mon[32756]: pgmap v18936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:58.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:58 smithi156 ceph-mon[32679]: pgmap v18936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:58 smithi092 ceph-mon[29156]: pgmap v18936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:57:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:57:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34077.945483 secs 2024-04-27T03:57:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:57:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34077.945483 secs 2024-04-27T03:57:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:57:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34077.945483 secs 2024-04-27T03:58:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34774.979648 secs 2024-04-27T03:58:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:00 smithi156 ceph-mon[32679]: pgmap v18937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34774.979648 secs 2024-04-27T03:58:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:00 smithi092 ceph-mon[29156]: pgmap v18937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:00.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34774.979648 secs 2024-04-27T03:58:00.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:00 smithi189 ceph-mon[32756]: pgmap v18937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:02.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:02 smithi189 ceph-mon[32756]: pgmap v18938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:58:02.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:02 smithi156 ceph-mon[32679]: pgmap v18938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:58:02.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:02 smithi092 ceph-mon[29156]: pgmap v18938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:58:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:04 smithi189 ceph-mon[32756]: pgmap v18939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:04 smithi156 ceph-mon[32679]: pgmap v18939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:04 smithi092 ceph-mon[29156]: pgmap v18939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:58:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34779.979764 secs 2024-04-27T03:58:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:05 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34082.945557 secs 2024-04-27T03:58:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34779.979764 secs 2024-04-27T03:58:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:05 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34082.945557 secs 2024-04-27T03:58:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34779.979764 secs 2024-04-27T03:58:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:05 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34082.945557 secs 2024-04-27T03:58:06.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:06 smithi189 ceph-mon[32756]: pgmap v18940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:06.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:06 smithi156 ceph-mon[32679]: pgmap v18940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:06 smithi092 ceph-mon[29156]: pgmap v18940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:08.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:08 smithi189 ceph-mon[32756]: pgmap v18941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:08.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:08 smithi156 ceph-mon[32679]: pgmap v18941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:08 smithi092 ceph-mon[29156]: pgmap v18941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34087.945638 secs 2024-04-27T03:58:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34087.945638 secs 2024-04-27T03:58:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34087.945638 secs 2024-04-27T03:58:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34784.979928 secs 2024-04-27T03:58:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:10 smithi156 ceph-mon[32679]: pgmap v18942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34784.979928 secs 2024-04-27T03:58:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:10 smithi092 ceph-mon[29156]: pgmap v18942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34784.979928 secs 2024-04-27T03:58:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:10 smithi189 ceph-mon[32756]: pgmap v18942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:12.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:12 smithi189 ceph-mon[32756]: pgmap v18943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:12.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:12 smithi156 ceph-mon[32679]: pgmap v18943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:12 smithi092 ceph-mon[29156]: pgmap v18943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:14 smithi189 ceph-mon[32756]: pgmap v18944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:14 smithi156 ceph-mon[32679]: pgmap v18944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:14 smithi092 ceph-mon[29156]: pgmap v18944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34789.979999 secs 2024-04-27T03:58:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:15 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34092.945718 secs 2024-04-27T03:58:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34789.979999 secs 2024-04-27T03:58:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:15 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34092.945718 secs 2024-04-27T03:58:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34789.979999 secs 2024-04-27T03:58:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:15 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34092.945718 secs 2024-04-27T03:58:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:16 smithi189 ceph-mon[32756]: pgmap v18945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:16 smithi156 ceph-mon[32679]: pgmap v18945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:16 smithi092 ceph-mon[29156]: pgmap v18945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:18 smithi189 ceph-mon[32756]: pgmap v18946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:18 smithi156 ceph-mon[32679]: pgmap v18946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:18 smithi092 ceph-mon[29156]: pgmap v18946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34097.945830 secs 2024-04-27T03:58:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34097.945830 secs 2024-04-27T03:58:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34097.945830 secs 2024-04-27T03:58:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34794.980112 secs 2024-04-27T03:58:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:20 smithi156 ceph-mon[32679]: pgmap v18947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34794.980112 secs 2024-04-27T03:58:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:20 smithi092 ceph-mon[29156]: pgmap v18947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34794.980112 secs 2024-04-27T03:58:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:20 smithi189 ceph-mon[32756]: pgmap v18947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:22.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:22 smithi189 ceph-mon[32756]: pgmap v18948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:22 smithi156 ceph-mon[32679]: pgmap v18948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:22 smithi092 ceph-mon[29156]: pgmap v18948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:24 smithi189 ceph-mon[32756]: pgmap v18949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:24 smithi156 ceph-mon[32679]: pgmap v18949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:24 smithi092 ceph-mon[29156]: pgmap v18949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34799.980227 secs 2024-04-27T03:58:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:25 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34102.945917 secs 2024-04-27T03:58:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34799.980227 secs 2024-04-27T03:58:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:25 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34102.945917 secs 2024-04-27T03:58:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34799.980227 secs 2024-04-27T03:58:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:25 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34102.945917 secs 2024-04-27T03:58:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:26 smithi189 ceph-mon[32756]: pgmap v18950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:26 smithi156 ceph-mon[32679]: pgmap v18950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:26 smithi092 ceph-mon[29156]: pgmap v18950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:28 smithi189 ceph-mon[32756]: pgmap v18951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:28 smithi156 ceph-mon[32679]: pgmap v18951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:28 smithi092 ceph-mon[29156]: pgmap v18951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34107.946053 secs 2024-04-27T03:58:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34107.946053 secs 2024-04-27T03:58:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34107.946053 secs 2024-04-27T03:58:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34804.980292 secs 2024-04-27T03:58:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:30 smithi156 ceph-mon[32679]: pgmap v18952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34804.980292 secs 2024-04-27T03:58:30.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:30 smithi092 ceph-mon[29156]: pgmap v18952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:30.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34804.980292 secs 2024-04-27T03:58:30.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:30 smithi189 ceph-mon[32756]: pgmap v18952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:32.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:32 smithi189 ceph-mon[32756]: pgmap v18953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:32 smithi156 ceph-mon[32679]: pgmap v18953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:32 smithi092 ceph-mon[29156]: pgmap v18953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:34 smithi189 ceph-mon[32756]: pgmap v18954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:34 smithi156 ceph-mon[32679]: pgmap v18954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:34 smithi092 ceph-mon[29156]: pgmap v18954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34809.980405 secs 2024-04-27T03:58:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:35 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34112.946116 secs 2024-04-27T03:58:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34809.980405 secs 2024-04-27T03:58:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:35 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34112.946116 secs 2024-04-27T03:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34809.980405 secs 2024-04-27T03:58:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:35 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34112.946116 secs 2024-04-27T03:58:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:36 smithi189 ceph-mon[32756]: pgmap v18955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:36 smithi156 ceph-mon[32679]: pgmap v18955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:36 smithi092 ceph-mon[29156]: pgmap v18955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:38 smithi189 ceph-mon[32756]: pgmap v18956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:38 smithi156 ceph-mon[32679]: pgmap v18956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:38 smithi092 ceph-mon[29156]: pgmap v18956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34117.946221 secs 2024-04-27T03:58:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34117.946221 secs 2024-04-27T03:58:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34117.946221 secs 2024-04-27T03:58:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34814.980545 secs 2024-04-27T03:58:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:40 smithi156 ceph-mon[32679]: pgmap v18957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:58:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34814.980545 secs 2024-04-27T03:58:40.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:40 smithi092 ceph-mon[29156]: pgmap v18957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:58:40.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34814.980545 secs 2024-04-27T03:58:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:40 smithi189 ceph-mon[32756]: pgmap v18957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:58:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:58:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:58:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:41 smithi092 ceph-mon[29156]: pgmap v18958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:58:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:41 smithi092 ceph-mon[29156]: pgmap v18959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:58:41.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:58:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:58:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:41 smithi189 ceph-mon[32756]: pgmap v18958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:58:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:41 smithi189 ceph-mon[32756]: pgmap v18959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:58:41.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:58:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:58:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:41 smithi156 ceph-mon[32679]: pgmap v18958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T03:58:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:41 smithi156 ceph-mon[32679]: pgmap v18959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:58:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:43 smithi189 ceph-mon[32756]: pgmap v18960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:58:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:43 smithi156 ceph-mon[32679]: pgmap v18960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:58:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:43 smithi092 ceph-mon[29156]: pgmap v18960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:58:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34819.980680 secs 2024-04-27T03:58:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34122.946341 secs 2024-04-27T03:58:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34819.980680 secs 2024-04-27T03:58:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34122.946341 secs 2024-04-27T03:58:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34819.980680 secs 2024-04-27T03:58:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34122.946341 secs 2024-04-27T03:58:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:45 smithi189 ceph-mon[32756]: pgmap v18961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:45 smithi156 ceph-mon[32679]: pgmap v18961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:46.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:45 smithi092 ceph-mon[29156]: pgmap v18961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:47 smithi189 ceph-mon[32756]: pgmap v18962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:47 smithi156 ceph-mon[32679]: pgmap v18962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:47 smithi092 ceph-mon[29156]: pgmap v18962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:49 smithi189 ceph-mon[32756]: pgmap v18963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34824.980814 secs 2024-04-27T03:58:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34127.946430 secs 2024-04-27T03:58:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:49 smithi156 ceph-mon[32679]: pgmap v18963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34824.980814 secs 2024-04-27T03:58:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34127.946430 secs 2024-04-27T03:58:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:49 smithi092 ceph-mon[29156]: pgmap v18963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:58:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34824.980814 secs 2024-04-27T03:58:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34127.946430 secs 2024-04-27T03:58:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:51 smithi189 ceph-mon[32756]: pgmap v18964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:58:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:51 smithi156 ceph-mon[32679]: pgmap v18964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:58:52.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:51 smithi092 ceph-mon[29156]: pgmap v18964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:58:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:53 smithi189 ceph-mon[32756]: pgmap v18965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:53 smithi156 ceph-mon[32679]: pgmap v18965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:54.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:53 smithi092 ceph-mon[29156]: pgmap v18965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34829.980887 secs 2024-04-27T03:58:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34132.946543 secs 2024-04-27T03:58:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34829.980887 secs 2024-04-27T03:58:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34132.946543 secs 2024-04-27T03:58:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34829.980887 secs 2024-04-27T03:58:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34132.946543 secs 2024-04-27T03:58:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:55 smithi156 ceph-mon[32679]: pgmap v18966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:55 smithi092 ceph-mon[29156]: pgmap v18966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:55 smithi189 ceph-mon[32756]: pgmap v18966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:58:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:57 smithi156 ceph-mon[32679]: pgmap v18967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:58.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:57 smithi092 ceph-mon[29156]: pgmap v18967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:58:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:57 smithi189 ceph-mon[32756]: pgmap v18967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:59 smithi156 ceph-mon[32679]: pgmap v18968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34834.980965 secs 2024-04-27T03:59:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:58:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34137.946660 secs 2024-04-27T03:59:00.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:59 smithi189 ceph-mon[32756]: pgmap v18968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:00.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34834.980965 secs 2024-04-27T03:59:00.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:58:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34137.946660 secs 2024-04-27T03:59:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:59 smithi092 ceph-mon[29156]: pgmap v18968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34834.980965 secs 2024-04-27T03:59:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:58:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34137.946660 secs 2024-04-27T03:59:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:01 smithi156 ceph-mon[32679]: pgmap v18969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:01 smithi092 ceph-mon[29156]: pgmap v18969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:01 smithi189 ceph-mon[32756]: pgmap v18969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:03 smithi156 ceph-mon[32679]: pgmap v18970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:03 smithi092 ceph-mon[29156]: pgmap v18970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:03 smithi189 ceph-mon[32756]: pgmap v18970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34839.981073 secs 2024-04-27T03:59:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34142.946777 secs 2024-04-27T03:59:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34839.981073 secs 2024-04-27T03:59:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34142.946777 secs 2024-04-27T03:59:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34839.981073 secs 2024-04-27T03:59:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34142.946777 secs 2024-04-27T03:59:06.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:05 smithi156 ceph-mon[32679]: pgmap v18971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:05 smithi092 ceph-mon[29156]: pgmap v18971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:05 smithi189 ceph-mon[32756]: pgmap v18971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:07 smithi156 ceph-mon[32679]: pgmap v18972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:08.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:07 smithi092 ceph-mon[29156]: pgmap v18972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:07 smithi189 ceph-mon[32756]: pgmap v18972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:09 smithi156 ceph-mon[32679]: pgmap v18973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34844.981152 secs 2024-04-27T03:59:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34147.946836 secs 2024-04-27T03:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:09 smithi092 ceph-mon[29156]: pgmap v18973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34844.981152 secs 2024-04-27T03:59:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34147.946836 secs 2024-04-27T03:59:10.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:59:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:59:10.135+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:59:10.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:59:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:59:10.135+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:59:10.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:59:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:59:10.135+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:59:10.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:59:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:59:10.135+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:59:10.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 03:59:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T03:59:10.135+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T03:59:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:09 smithi189 ceph-mon[32756]: pgmap v18973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34844.981152 secs 2024-04-27T03:59:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34147.946836 secs 2024-04-27T03:59:12.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:11 smithi156 ceph-mon[32679]: pgmap v18974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:11 smithi092 ceph-mon[29156]: pgmap v18974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:11 smithi189 ceph-mon[32756]: pgmap v18974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:13 smithi156 ceph-mon[32679]: pgmap v18975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:14.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:13 smithi092 ceph-mon[29156]: pgmap v18975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:13 smithi189 ceph-mon[32756]: pgmap v18975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:14 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 34849.981268 secs 2024-04-27T03:59:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:14 smithi092 ceph-mon[29156]: slow request 2884.535774 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:59:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34152.946939 secs 2024-04-27T03:59:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:14 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 34849.981268 secs 2024-04-27T03:59:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:14 smithi189 ceph-mon[32756]: slow request 2884.535774 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:59:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34152.946939 secs 2024-04-27T03:59:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:14 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 34849.981268 secs 2024-04-27T03:59:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:14 smithi156 ceph-mon[32679]: slow request 2884.535774 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T03:59:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34152.946939 secs 2024-04-27T03:59:16.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:15 smithi092 ceph-mon[29156]: pgmap v18976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:15 smithi189 ceph-mon[32756]: pgmap v18976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:15 smithi156 ceph-mon[32679]: pgmap v18976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:18.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:17 smithi092 ceph-mon[29156]: pgmap v18977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:18.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:17 smithi189 ceph-mon[32756]: pgmap v18977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:17 smithi156 ceph-mon[32679]: pgmap v18977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:19 smithi092 ceph-mon[29156]: pgmap v18978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34854.981385 secs 2024-04-27T03:59:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34157.947046 secs 2024-04-27T03:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:19 smithi189 ceph-mon[32756]: pgmap v18978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34854.981385 secs 2024-04-27T03:59:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34157.947046 secs 2024-04-27T03:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:19 smithi156 ceph-mon[32679]: pgmap v18978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34854.981385 secs 2024-04-27T03:59:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34157.947046 secs 2024-04-27T03:59:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:21 smithi092 ceph-mon[29156]: pgmap v18979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:21 smithi189 ceph-mon[32756]: pgmap v18979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:21 smithi156 ceph-mon[32679]: pgmap v18979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:23 smithi092 ceph-mon[29156]: pgmap v18980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:23 smithi189 ceph-mon[32756]: pgmap v18980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:23 smithi156 ceph-mon[32679]: pgmap v18980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T03:59:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34859.981466 secs 2024-04-27T03:59:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34162.947199 secs 2024-04-27T03:59:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34859.981466 secs 2024-04-27T03:59:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34162.947199 secs 2024-04-27T03:59:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34859.981466 secs 2024-04-27T03:59:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34162.947199 secs 2024-04-27T03:59:26.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:25 smithi092 ceph-mon[29156]: pgmap v18981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:25 smithi189 ceph-mon[32756]: pgmap v18981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:25 smithi156 ceph-mon[32679]: pgmap v18981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T03:59:28.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:27 smithi092 ceph-mon[29156]: pgmap v18982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:27 smithi189 ceph-mon[32756]: pgmap v18982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:27 smithi156 ceph-mon[32679]: pgmap v18982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:29 smithi092 ceph-mon[29156]: pgmap v18983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34864.981609 secs 2024-04-27T03:59:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34167.947341 secs 2024-04-27T03:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:29 smithi189 ceph-mon[32756]: pgmap v18983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34864.981609 secs 2024-04-27T03:59:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34167.947341 secs 2024-04-27T03:59:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:29 smithi156 ceph-mon[32679]: pgmap v18983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34864.981609 secs 2024-04-27T03:59:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34167.947341 secs 2024-04-27T03:59:32.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:31 smithi092 ceph-mon[29156]: pgmap v18984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:31 smithi189 ceph-mon[32756]: pgmap v18984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:31 smithi156 ceph-mon[32679]: pgmap v18984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:33 smithi092 ceph-mon[29156]: pgmap v18985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:33 smithi189 ceph-mon[32756]: pgmap v18985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:33 smithi156 ceph-mon[32679]: pgmap v18985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34869.981732 secs 2024-04-27T03:59:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34172.947408 secs 2024-04-27T03:59:35.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34869.981732 secs 2024-04-27T03:59:35.335 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34172.947408 secs 2024-04-27T03:59:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34869.981732 secs 2024-04-27T03:59:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34172.947408 secs 2024-04-27T03:59:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:35 smithi092 ceph-mon[29156]: pgmap v18986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:35 smithi189 ceph-mon[32756]: pgmap v18986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:35 smithi156 ceph-mon[32679]: pgmap v18986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:38.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:37 smithi092 ceph-mon[29156]: pgmap v18987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:37 smithi189 ceph-mon[32756]: pgmap v18987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:37 smithi156 ceph-mon[32679]: pgmap v18987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:39 smithi092 ceph-mon[29156]: pgmap v18988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:59:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34874.981869 secs 2024-04-27T03:59:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34177.947524 secs 2024-04-27T03:59:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:39 smithi189 ceph-mon[32756]: pgmap v18988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:59:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34874.981869 secs 2024-04-27T03:59:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34177.947524 secs 2024-04-27T03:59:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:39 smithi156 ceph-mon[32679]: pgmap v18988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T03:59:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34874.981869 secs 2024-04-27T03:59:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34177.947524 secs 2024-04-27T03:59:41.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:59:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:59:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T03:59:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:41 smithi092 ceph-mon[29156]: pgmap v18989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:59:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:59:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:59:42.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:59:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:41 smithi189 ceph-mon[32756]: pgmap v18989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:59:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:59:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:59:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:59:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:41 smithi156 ceph-mon[32679]: pgmap v18989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T03:59:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T03:59:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T03:59:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T03:59:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:42 smithi092 ceph-mon[29156]: pgmap v18990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:59:43.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:42 smithi092 ceph-mon[29156]: pgmap v18991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:42 smithi189 ceph-mon[32756]: pgmap v18990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:59:43.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:42 smithi189 ceph-mon[32756]: pgmap v18991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:42 smithi156 ceph-mon[32679]: pgmap v18990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T03:59:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:42 smithi156 ceph-mon[32679]: pgmap v18991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:44 smithi189 ceph-mon[32756]: pgmap v18992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34879.981979 secs 2024-04-27T03:59:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34182.947591 secs 2024-04-27T03:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:44 smithi156 ceph-mon[32679]: pgmap v18992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34879.981979 secs 2024-04-27T03:59:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34182.947591 secs 2024-04-27T03:59:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:44 smithi092 ceph-mon[29156]: pgmap v18992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34879.981979 secs 2024-04-27T03:59:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34182.947591 secs 2024-04-27T03:59:47.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:46 smithi189 ceph-mon[32756]: pgmap v18993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:46 smithi156 ceph-mon[32679]: pgmap v18993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:46 smithi092 ceph-mon[29156]: pgmap v18993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T03:59:49.296 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:49 smithi092 ceph-mon[29156]: pgmap v18994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:59:49.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:49 smithi189 ceph-mon[32756]: pgmap v18994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:59:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:49 smithi156 ceph-mon[32679]: pgmap v18994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T03:59:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34884.982076 secs 2024-04-27T03:59:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:50 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34187.947727 secs 2024-04-27T03:59:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34884.982076 secs 2024-04-27T03:59:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:50 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34187.947727 secs 2024-04-27T03:59:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34884.982076 secs 2024-04-27T03:59:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:50 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34187.947727 secs 2024-04-27T03:59:51.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:51 smithi189 ceph-mon[32756]: pgmap v18995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:59:51.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:51 smithi156 ceph-mon[32679]: pgmap v18995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:59:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:51 smithi092 ceph-mon[29156]: pgmap v18995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T03:59:53.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:53 smithi189 ceph-mon[32756]: pgmap v18996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:59:53.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:53 smithi156 ceph-mon[32679]: pgmap v18996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:59:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:53 smithi092 ceph-mon[29156]: pgmap v18996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T03:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:55 smithi189 ceph-mon[32756]: pgmap v18997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34889.982201 secs 2024-04-27T03:59:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:55 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34192.947870 secs 2024-04-27T03:59:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:55 smithi156 ceph-mon[32679]: pgmap v18997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34889.982201 secs 2024-04-27T03:59:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:55 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34192.947870 secs 2024-04-27T03:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:55 smithi092 ceph-mon[29156]: pgmap v18997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T03:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34889.982201 secs 2024-04-27T03:59:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:55 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34192.947870 secs 2024-04-27T03:59:57.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:57 smithi189 ceph-mon[32756]: pgmap v18998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:57.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:57 smithi156 ceph-mon[32679]: pgmap v18998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:57 smithi092 ceph-mon[29156]: pgmap v18998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:59.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 03:59:59 smithi189 ceph-mon[32756]: pgmap v18999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:59.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 03:59:59 smithi156 ceph-mon[32679]: pgmap v18999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T03:59:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 03:59:59 smithi092 ceph-mon[29156]: pgmap v18999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:00.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34894.982322 secs 2024-04-27T04:00:00.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:00 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34197.947997 secs 2024-04-27T04:00:00.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34894.982322 secs 2024-04-27T04:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:00 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34197.947997 secs 2024-04-27T04:00:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:00:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34894.982322 secs 2024-04-27T04:00:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:00 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34197.947997 secs 2024-04-27T04:00:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:00:01.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:01 smithi189 ceph-mon[32756]: pgmap v19000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:01.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:01 smithi156 ceph-mon[32679]: pgmap v19000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:01 smithi092 ceph-mon[29156]: pgmap v19000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:03.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:03 smithi189 ceph-mon[32756]: pgmap v19001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:03.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:03 smithi156 ceph-mon[32679]: pgmap v19001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:03 smithi092 ceph-mon[29156]: pgmap v19001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:05 smithi189 ceph-mon[32756]: pgmap v19002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34899.982408 secs 2024-04-27T04:00:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:05 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34202.948134 secs 2024-04-27T04:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:05 smithi156 ceph-mon[32679]: pgmap v19002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34899.982408 secs 2024-04-27T04:00:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:05 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34202.948134 secs 2024-04-27T04:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:05 smithi092 ceph-mon[29156]: pgmap v19002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34899.982408 secs 2024-04-27T04:00:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:05 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34202.948134 secs 2024-04-27T04:00:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:07 smithi189 ceph-mon[32756]: pgmap v19003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:07 smithi156 ceph-mon[32679]: pgmap v19003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:07 smithi092 ceph-mon[29156]: pgmap v19003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:08 smithi189 ceph-mon[32756]: pgmap v19004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:08 smithi156 ceph-mon[32679]: pgmap v19004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:08 smithi092 ceph-mon[29156]: pgmap v19004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:09.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34207.948270 secs 2024-04-27T04:00:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34207.948270 secs 2024-04-27T04:00:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34207.948270 secs 2024-04-27T04:00:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34904.982552 secs 2024-04-27T04:00:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:10 smithi092 ceph-mon[29156]: pgmap v19005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34904.982552 secs 2024-04-27T04:00:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:10 smithi189 ceph-mon[32756]: pgmap v19005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34904.982552 secs 2024-04-27T04:00:10.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:10 smithi156 ceph-mon[32679]: pgmap v19005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:12.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:12 smithi156 ceph-mon[32679]: pgmap v19006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:12.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:12 smithi092 ceph-mon[29156]: pgmap v19006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:13.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:12 smithi189 ceph-mon[32756]: pgmap v19006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:00:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:14 smithi156 ceph-mon[32679]: pgmap v19007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34909.982692 secs 2024-04-27T04:00:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34212.948390 secs 2024-04-27T04:00:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:14 smithi092 ceph-mon[29156]: pgmap v19007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34909.982692 secs 2024-04-27T04:00:14.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34212.948390 secs 2024-04-27T04:00:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:14 smithi189 ceph-mon[32756]: pgmap v19007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:00:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34909.982692 secs 2024-04-27T04:00:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34212.948390 secs 2024-04-27T04:00:16.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:16 smithi156 ceph-mon[32679]: pgmap v19008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:16.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:16 smithi092 ceph-mon[29156]: pgmap v19008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:17.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:16 smithi189 ceph-mon[32756]: pgmap v19008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:18 smithi189 ceph-mon[32756]: pgmap v19009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:18 smithi156 ceph-mon[32679]: pgmap v19009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:18 smithi092 ceph-mon[29156]: pgmap v19009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:19.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34217.948468 secs 2024-04-27T04:00:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34217.948468 secs 2024-04-27T04:00:19.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34217.948468 secs 2024-04-27T04:00:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34914.982838 secs 2024-04-27T04:00:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:20 smithi092 ceph-mon[29156]: pgmap v19010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34914.982838 secs 2024-04-27T04:00:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:20 smithi189 ceph-mon[32756]: pgmap v19010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34914.982838 secs 2024-04-27T04:00:20.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:20 smithi156 ceph-mon[32679]: pgmap v19010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:22.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:22 smithi156 ceph-mon[32679]: pgmap v19011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:22.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:22 smithi092 ceph-mon[29156]: pgmap v19011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:23.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:22 smithi189 ceph-mon[32756]: pgmap v19011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:24 smithi156 ceph-mon[32679]: pgmap v19012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34919.982959 secs 2024-04-27T04:00:24.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34222.948578 secs 2024-04-27T04:00:24.942 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:24 smithi189 ceph-mon[32756]: pgmap v19012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:24.942 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34919.982959 secs 2024-04-27T04:00:24.942 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34222.948578 secs 2024-04-27T04:00:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:24 smithi092 ceph-mon[29156]: pgmap v19012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34919.982959 secs 2024-04-27T04:00:24.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34222.948578 secs 2024-04-27T04:00:26.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:26 smithi156 ceph-mon[32679]: pgmap v19013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:26.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:26 smithi092 ceph-mon[29156]: pgmap v19013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:27.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:26 smithi189 ceph-mon[32756]: pgmap v19013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:28.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:28 smithi156 ceph-mon[32679]: pgmap v19014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:28.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:28 smithi092 ceph-mon[29156]: pgmap v19014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:29.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:28 smithi189 ceph-mon[32756]: pgmap v19014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34924.983087 secs 2024-04-27T04:00:29.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34227.948662 secs 2024-04-27T04:00:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34924.983087 secs 2024-04-27T04:00:29.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34227.948662 secs 2024-04-27T04:00:30.039 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34924.983087 secs 2024-04-27T04:00:30.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34227.948662 secs 2024-04-27T04:00:30.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:30 smithi156 ceph-mon[32679]: pgmap v19015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:30 smithi092 ceph-mon[29156]: pgmap v19015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:30 smithi189 ceph-mon[32756]: pgmap v19015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:32.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:32 smithi092 ceph-mon[29156]: pgmap v19016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:33.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:32 smithi189 ceph-mon[32756]: pgmap v19016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:33.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:32 smithi156 ceph-mon[32679]: pgmap v19016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:34 smithi092 ceph-mon[29156]: pgmap v19017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34929.983190 secs 2024-04-27T04:00:34.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34232.948809 secs 2024-04-27T04:00:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:34 smithi189 ceph-mon[32756]: pgmap v19017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34929.983190 secs 2024-04-27T04:00:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34232.948809 secs 2024-04-27T04:00:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:34 smithi156 ceph-mon[32679]: pgmap v19017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34929.983190 secs 2024-04-27T04:00:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34232.948809 secs 2024-04-27T04:00:36.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:36 smithi156 ceph-mon[32679]: pgmap v19018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:36.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:36 smithi092 ceph-mon[29156]: pgmap v19018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:36 smithi189 ceph-mon[32756]: pgmap v19018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:38.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:38 smithi092 ceph-mon[29156]: pgmap v19019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:39.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:38 smithi189 ceph-mon[32756]: pgmap v19019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:39.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:38 smithi156 ceph-mon[32679]: pgmap v19019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34934.983311 secs 2024-04-27T04:00:39.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34237.948928 secs 2024-04-27T04:00:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34934.983311 secs 2024-04-27T04:00:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34237.948928 secs 2024-04-27T04:00:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34934.983311 secs 2024-04-27T04:00:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34237.948928 secs 2024-04-27T04:00:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:00:40.777+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:00:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:00:40.777+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:00:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:00:40.777+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:00:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:00:40.777+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 269 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:00:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:40 smithi092 ceph-mon[29156]: pgmap v19020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:40 smithi189 ceph-mon[32756]: pgmap v19020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:40 smithi156 ceph-mon[32679]: pgmap v19020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:42 smithi092 ceph-mon[29156]: pgmap v19021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:00:42.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:00:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:42 smithi189 ceph-mon[32756]: pgmap v19021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:00:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:00:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:00:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:00:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:42 smithi156 ceph-mon[32679]: pgmap v19021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:00:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:00:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:00:43.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:00:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:43 smithi092 ceph-mon[29156]: pgmap v19022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:00:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:43 smithi092 ceph-mon[29156]: pgmap v19023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:43 smithi189 ceph-mon[32756]: pgmap v19022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:00:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:43 smithi189 ceph-mon[32756]: pgmap v19023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:43 smithi156 ceph-mon[32679]: pgmap v19022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:00:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:43 smithi156 ceph-mon[32679]: pgmap v19023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34939.983445 secs 2024-04-27T04:00:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34242.949065 secs 2024-04-27T04:00:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34939.983445 secs 2024-04-27T04:00:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34242.949065 secs 2024-04-27T04:00:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34939.983445 secs 2024-04-27T04:00:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34242.949065 secs 2024-04-27T04:00:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:45 smithi092 ceph-mon[29156]: pgmap v19024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:46.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:45 smithi189 ceph-mon[32756]: pgmap v19024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:46.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:45 smithi156 ceph-mon[32679]: pgmap v19024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:47 smithi092 ceph-mon[29156]: pgmap v19025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:47 smithi189 ceph-mon[32756]: pgmap v19025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:47 smithi156 ceph-mon[32679]: pgmap v19025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:49 smithi092 ceph-mon[29156]: pgmap v19026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34944.983570 secs 2024-04-27T04:00:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34247.949193 secs 2024-04-27T04:00:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:49 smithi189 ceph-mon[32756]: pgmap v19026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34944.983570 secs 2024-04-27T04:00:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34247.949193 secs 2024-04-27T04:00:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:49 smithi156 ceph-mon[32679]: pgmap v19026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:00:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34944.983570 secs 2024-04-27T04:00:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34247.949193 secs 2024-04-27T04:00:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:51 smithi092 ceph-mon[29156]: pgmap v19027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:52.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:51 smithi189 ceph-mon[32756]: pgmap v19027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:52.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:51 smithi156 ceph-mon[32679]: pgmap v19027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:00:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:53 smithi092 ceph-mon[29156]: pgmap v19028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:00:54.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:53 smithi189 ceph-mon[32756]: pgmap v19028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:00:54.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:53 smithi156 ceph-mon[32679]: pgmap v19028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34949.983710 secs 2024-04-27T04:00:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34252.949349 secs 2024-04-27T04:00:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34949.983710 secs 2024-04-27T04:00:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34252.949349 secs 2024-04-27T04:00:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34949.983710 secs 2024-04-27T04:00:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34252.949349 secs 2024-04-27T04:00:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:55 smithi092 ceph-mon[29156]: pgmap v19029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:56.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:55 smithi189 ceph-mon[32756]: pgmap v19029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:56.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:55 smithi156 ceph-mon[32679]: pgmap v19029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:00:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:57 smithi092 ceph-mon[29156]: pgmap v19030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:57 smithi189 ceph-mon[32756]: pgmap v19030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:58.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:57 smithi156 ceph-mon[32679]: pgmap v19030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:59 smithi092 ceph-mon[29156]: pgmap v19031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34954.983846 secs 2024-04-27T04:00:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:00:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34257.949463 secs 2024-04-27T04:01:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:59 smithi189 ceph-mon[32756]: pgmap v19031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34954.983846 secs 2024-04-27T04:01:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:00:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34257.949463 secs 2024-04-27T04:01:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:59 smithi156 ceph-mon[32679]: pgmap v19031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34954.983846 secs 2024-04-27T04:01:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:00:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34257.949463 secs 2024-04-27T04:01:02.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:01 smithi189 ceph-mon[32756]: pgmap v19032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:02.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:01 smithi156 ceph-mon[32679]: pgmap v19032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:02.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:01 smithi092 ceph-mon[29156]: pgmap v19032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:03 smithi189 ceph-mon[32756]: pgmap v19033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:04.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:03 smithi156 ceph-mon[32679]: pgmap v19033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:04.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:03 smithi092 ceph-mon[29156]: pgmap v19033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34959.983943 secs 2024-04-27T04:01:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34262.949546 secs 2024-04-27T04:01:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34959.983943 secs 2024-04-27T04:01:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34262.949546 secs 2024-04-27T04:01:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34959.983943 secs 2024-04-27T04:01:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34262.949546 secs 2024-04-27T04:01:06.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:05 smithi156 ceph-mon[32679]: pgmap v19034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:06.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:05 smithi189 ceph-mon[32756]: pgmap v19034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:06.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:05 smithi092 ceph-mon[29156]: pgmap v19034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:08.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:07 smithi189 ceph-mon[32756]: pgmap v19035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:08.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:07 smithi156 ceph-mon[32679]: pgmap v19035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:07 smithi092 ceph-mon[29156]: pgmap v19035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:09 smithi189 ceph-mon[32756]: pgmap v19036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34964.984061 secs 2024-04-27T04:01:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34267.949691 secs 2024-04-27T04:01:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:09 smithi156 ceph-mon[32679]: pgmap v19036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34964.984061 secs 2024-04-27T04:01:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34267.949691 secs 2024-04-27T04:01:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:09 smithi092 ceph-mon[29156]: pgmap v19036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34964.984061 secs 2024-04-27T04:01:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34267.949691 secs 2024-04-27T04:01:12.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:11 smithi189 ceph-mon[32756]: pgmap v19037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:11 smithi156 ceph-mon[32679]: pgmap v19037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:12.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:11 smithi092 ceph-mon[29156]: pgmap v19037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:14.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:13 smithi189 ceph-mon[32756]: pgmap v19038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:14.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:13 smithi156 ceph-mon[32679]: pgmap v19038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:13 smithi092 ceph-mon[29156]: pgmap v19038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34969.984177 secs 2024-04-27T04:01:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34272.949811 secs 2024-04-27T04:01:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34969.984177 secs 2024-04-27T04:01:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34272.949811 secs 2024-04-27T04:01:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34969.984177 secs 2024-04-27T04:01:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34272.949811 secs 2024-04-27T04:01:16.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:15 smithi189 ceph-mon[32756]: pgmap v19039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:16.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:15 smithi156 ceph-mon[32679]: pgmap v19039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:15 smithi092 ceph-mon[29156]: pgmap v19039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:18.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:17 smithi189 ceph-mon[32756]: pgmap v19040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:18.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:17 smithi156 ceph-mon[32679]: pgmap v19040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:17 smithi092 ceph-mon[29156]: pgmap v19040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:20.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:19 smithi092 ceph-mon[29156]: pgmap v19041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:20.046 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34974.984301 secs 2024-04-27T04:01:20.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34277.949906 secs 2024-04-27T04:01:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:19 smithi189 ceph-mon[32756]: pgmap v19041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34974.984301 secs 2024-04-27T04:01:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34277.949906 secs 2024-04-27T04:01:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:19 smithi156 ceph-mon[32679]: pgmap v19041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34974.984301 secs 2024-04-27T04:01:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34277.949906 secs 2024-04-27T04:01:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:21 smithi189 ceph-mon[32756]: pgmap v19042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:21 smithi156 ceph-mon[32679]: pgmap v19042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:22.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:21 smithi092 ceph-mon[29156]: pgmap v19042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:24.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:23 smithi189 ceph-mon[32756]: pgmap v19043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:23 smithi156 ceph-mon[32679]: pgmap v19043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:23 smithi092 ceph-mon[29156]: pgmap v19043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34979.984364 secs 2024-04-27T04:01:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34282.950008 secs 2024-04-27T04:01:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34979.984364 secs 2024-04-27T04:01:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34282.950008 secs 2024-04-27T04:01:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34979.984364 secs 2024-04-27T04:01:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34282.950008 secs 2024-04-27T04:01:26.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:25 smithi189 ceph-mon[32756]: pgmap v19044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:26.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:25 smithi156 ceph-mon[32679]: pgmap v19044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:25 smithi092 ceph-mon[29156]: pgmap v19044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:28.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:27 smithi189 ceph-mon[32756]: pgmap v19045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:28.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:27 smithi156 ceph-mon[32679]: pgmap v19045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:27 smithi092 ceph-mon[29156]: pgmap v19045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:29 smithi189 ceph-mon[32756]: pgmap v19046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34984.984504 secs 2024-04-27T04:01:30.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34287.950122 secs 2024-04-27T04:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:29 smithi156 ceph-mon[32679]: pgmap v19046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34984.984504 secs 2024-04-27T04:01:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34287.950122 secs 2024-04-27T04:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:29 smithi092 ceph-mon[29156]: pgmap v19046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34984.984504 secs 2024-04-27T04:01:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34287.950122 secs 2024-04-27T04:01:32.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:31 smithi189 ceph-mon[32756]: pgmap v19047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:31 smithi156 ceph-mon[32679]: pgmap v19047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:31 smithi092 ceph-mon[29156]: pgmap v19047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:34.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:33 smithi189 ceph-mon[32756]: pgmap v19048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:34.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:33 smithi156 ceph-mon[32679]: pgmap v19048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:33 smithi092 ceph-mon[29156]: pgmap v19048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34989.984624 secs 2024-04-27T04:01:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34292.950197 secs 2024-04-27T04:01:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34989.984624 secs 2024-04-27T04:01:35.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34292.950197 secs 2024-04-27T04:01:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34989.984624 secs 2024-04-27T04:01:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34292.950197 secs 2024-04-27T04:01:36.084 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:35 smithi156 ceph-mon[32679]: pgmap v19049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:36.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:35 smithi189 ceph-mon[32756]: pgmap v19049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:35 smithi092 ceph-mon[29156]: pgmap v19049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:38.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:37 smithi189 ceph-mon[32756]: pgmap v19050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:38.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:37 smithi156 ceph-mon[32679]: pgmap v19050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:37 smithi092 ceph-mon[29156]: pgmap v19050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:39 smithi189 ceph-mon[32756]: pgmap v19051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34994.984768 secs 2024-04-27T04:01:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34297.950330 secs 2024-04-27T04:01:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:39 smithi156 ceph-mon[32679]: pgmap v19051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34994.984768 secs 2024-04-27T04:01:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34297.950330 secs 2024-04-27T04:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:39 smithi092 ceph-mon[29156]: pgmap v19051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34994.984768 secs 2024-04-27T04:01:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34297.950330 secs 2024-04-27T04:01:42.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:41 smithi189 ceph-mon[32756]: pgmap v19052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:41 smithi156 ceph-mon[32679]: pgmap v19052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:41 smithi092 ceph-mon[29156]: pgmap v19052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:43.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:01:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:01:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:01:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:43 smithi092 ceph-mon[29156]: pgmap v19053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:01:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:01:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:43 smithi189 ceph-mon[32756]: pgmap v19053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:01:44.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:01:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:43 smithi156 ceph-mon[32679]: pgmap v19053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:01:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:01:44.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:01:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:44 smithi189 ceph-mon[32756]: pgmap v19054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:01:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:44 smithi189 ceph-mon[32756]: pgmap v19055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:01:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 34999.984924 secs 2024-04-27T04:01:45.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34302.950453 secs 2024-04-27T04:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:44 smithi156 ceph-mon[32679]: pgmap v19054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:44 smithi156 ceph-mon[32679]: pgmap v19055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 34999.984924 secs 2024-04-27T04:01:45.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34302.950453 secs 2024-04-27T04:01:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:44 smithi092 ceph-mon[29156]: pgmap v19054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:01:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:44 smithi092 ceph-mon[29156]: pgmap v19055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:01:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 34999.984924 secs 2024-04-27T04:01:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34302.950453 secs 2024-04-27T04:01:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:46 smithi189 ceph-mon[32756]: pgmap v19056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:46 smithi156 ceph-mon[32679]: pgmap v19056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:46 smithi092 ceph-mon[29156]: pgmap v19056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:49.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:48 smithi189 ceph-mon[32756]: pgmap v19057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:48 smithi156 ceph-mon[32679]: pgmap v19057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:48 smithi092 ceph-mon[29156]: pgmap v19057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35004.985005 secs 2024-04-27T04:01:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34307.950520 secs 2024-04-27T04:01:50.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35004.985005 secs 2024-04-27T04:01:50.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34307.950520 secs 2024-04-27T04:01:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35004.985005 secs 2024-04-27T04:01:50.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34307.950520 secs 2024-04-27T04:01:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:50 smithi189 ceph-mon[32756]: pgmap v19058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:51.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:50 smithi156 ceph-mon[32679]: pgmap v19058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:51.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:50 smithi092 ceph-mon[29156]: pgmap v19058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:53.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:52 smithi189 ceph-mon[32756]: pgmap v19059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:52 smithi156 ceph-mon[32679]: pgmap v19059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:52 smithi092 ceph-mon[29156]: pgmap v19059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:01:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:54 smithi189 ceph-mon[32756]: pgmap v19060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:01:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35009.985132 secs 2024-04-27T04:01:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34312.950649 secs 2024-04-27T04:01:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:54 smithi156 ceph-mon[32679]: pgmap v19060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:01:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35009.985132 secs 2024-04-27T04:01:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34312.950649 secs 2024-04-27T04:01:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:54 smithi092 ceph-mon[29156]: pgmap v19060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:01:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35009.985132 secs 2024-04-27T04:01:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34312.950649 secs 2024-04-27T04:01:57.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:56 smithi189 ceph-mon[32756]: pgmap v19061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:56 smithi156 ceph-mon[32679]: pgmap v19061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:56 smithi092 ceph-mon[29156]: pgmap v19061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:01:59.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:58 smithi189 ceph-mon[32756]: pgmap v19062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:59.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:58 smithi156 ceph-mon[32679]: pgmap v19062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:01:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:58 smithi092 ceph-mon[29156]: pgmap v19062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35014.985222 secs 2024-04-27T04:02:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:01:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34317.950768 secs 2024-04-27T04:02:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35014.985222 secs 2024-04-27T04:02:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:01:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34317.950768 secs 2024-04-27T04:02:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35014.985222 secs 2024-04-27T04:02:00.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:01:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34317.950768 secs 2024-04-27T04:02:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:00 smithi189 ceph-mon[32756]: pgmap v19063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:00 smithi156 ceph-mon[32679]: pgmap v19063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:00 smithi092 ceph-mon[29156]: pgmap v19063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:03.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:02 smithi189 ceph-mon[32756]: pgmap v19064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:03.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:02 smithi156 ceph-mon[32679]: pgmap v19064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:02 smithi092 ceph-mon[29156]: pgmap v19064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:04 smithi156 ceph-mon[32679]: pgmap v19065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35019.985335 secs 2024-04-27T04:02:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34322.950830 secs 2024-04-27T04:02:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:04 smithi092 ceph-mon[29156]: pgmap v19065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35019.985335 secs 2024-04-27T04:02:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34322.950830 secs 2024-04-27T04:02:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:04 smithi189 ceph-mon[32756]: pgmap v19065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35019.985335 secs 2024-04-27T04:02:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34322.950830 secs 2024-04-27T04:02:07.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:06 smithi156 ceph-mon[32679]: pgmap v19066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:06 smithi092 ceph-mon[29156]: pgmap v19066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:06 smithi189 ceph-mon[32756]: pgmap v19066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:09.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:08 smithi156 ceph-mon[32679]: pgmap v19067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:08 smithi092 ceph-mon[29156]: pgmap v19067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:08 smithi189 ceph-mon[32756]: pgmap v19067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35024.985404 secs 2024-04-27T04:02:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34327.950951 secs 2024-04-27T04:02:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35024.985404 secs 2024-04-27T04:02:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34327.950951 secs 2024-04-27T04:02:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35024.985404 secs 2024-04-27T04:02:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34327.950951 secs 2024-04-27T04:02:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:10 smithi156 ceph-mon[32679]: pgmap v19068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:10 smithi092 ceph-mon[29156]: pgmap v19068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:10 smithi189 ceph-mon[32756]: pgmap v19068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:13.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:12 smithi156 ceph-mon[32679]: pgmap v19069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:12 smithi092 ceph-mon[29156]: pgmap v19069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:12 smithi189 ceph-mon[32756]: pgmap v19069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:14 smithi156 ceph-mon[32679]: pgmap v19070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35029.985519 secs 2024-04-27T04:02:15.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34332.951077 secs 2024-04-27T04:02:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:14 smithi092 ceph-mon[29156]: pgmap v19070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35029.985519 secs 2024-04-27T04:02:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34332.951077 secs 2024-04-27T04:02:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:14 smithi189 ceph-mon[32756]: pgmap v19070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35029.985519 secs 2024-04-27T04:02:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34332.951077 secs 2024-04-27T04:02:17.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:16 smithi156 ceph-mon[32679]: pgmap v19071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:16 smithi092 ceph-mon[29156]: pgmap v19071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:16 smithi189 ceph-mon[32756]: pgmap v19071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:19.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:18 smithi156 ceph-mon[32679]: pgmap v19072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:18 smithi092 ceph-mon[29156]: pgmap v19072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:18 smithi189 ceph-mon[32756]: pgmap v19072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35034.985668 secs 2024-04-27T04:02:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34337.951203 secs 2024-04-27T04:02:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35034.985668 secs 2024-04-27T04:02:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34337.951203 secs 2024-04-27T04:02:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35034.985668 secs 2024-04-27T04:02:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34337.951203 secs 2024-04-27T04:02:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:20 smithi156 ceph-mon[32679]: pgmap v19073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:20 smithi092 ceph-mon[29156]: pgmap v19073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:20 smithi189 ceph-mon[32756]: pgmap v19073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:23.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:22 smithi156 ceph-mon[32679]: pgmap v19074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:22 smithi092 ceph-mon[29156]: pgmap v19074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:22 smithi189 ceph-mon[32756]: pgmap v19074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:24 smithi156 ceph-mon[32679]: pgmap v19075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35039.985800 secs 2024-04-27T04:02:25.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34342.951329 secs 2024-04-27T04:02:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:24 smithi092 ceph-mon[29156]: pgmap v19075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35039.985800 secs 2024-04-27T04:02:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34342.951329 secs 2024-04-27T04:02:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:24 smithi189 ceph-mon[32756]: pgmap v19075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35039.985800 secs 2024-04-27T04:02:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34342.951329 secs 2024-04-27T04:02:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:26 smithi156 ceph-mon[32679]: pgmap v19076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:26 smithi092 ceph-mon[29156]: pgmap v19076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:26 smithi189 ceph-mon[32756]: pgmap v19076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:28 smithi092 ceph-mon[29156]: pgmap v19077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:28 smithi189 ceph-mon[32756]: pgmap v19077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:28 smithi156 ceph-mon[32679]: pgmap v19077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35044.985899 secs 2024-04-27T04:02:30.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34347.951431 secs 2024-04-27T04:02:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35044.985899 secs 2024-04-27T04:02:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34347.951431 secs 2024-04-27T04:02:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35044.985899 secs 2024-04-27T04:02:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34347.951431 secs 2024-04-27T04:02:31.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:30 smithi092 ceph-mon[29156]: pgmap v19078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:31.289 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:30 smithi189 ceph-mon[32756]: pgmap v19078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:31.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:30 smithi156 ceph-mon[32679]: pgmap v19078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:32 smithi092 ceph-mon[29156]: pgmap v19079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:33.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:32 smithi189 ceph-mon[32756]: pgmap v19079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:33.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:32 smithi156 ceph-mon[32679]: pgmap v19079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:34 smithi092 ceph-mon[29156]: pgmap v19080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35049.985969 secs 2024-04-27T04:02:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34352.951580 secs 2024-04-27T04:02:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:34 smithi189 ceph-mon[32756]: pgmap v19080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35049.985969 secs 2024-04-27T04:02:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34352.951580 secs 2024-04-27T04:02:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:34 smithi156 ceph-mon[32679]: pgmap v19080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35049.985969 secs 2024-04-27T04:02:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34352.951580 secs 2024-04-27T04:02:37.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:36 smithi156 ceph-mon[32679]: pgmap v19081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:36 smithi092 ceph-mon[29156]: pgmap v19081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:36 smithi189 ceph-mon[32756]: pgmap v19081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:38 smithi092 ceph-mon[29156]: pgmap v19082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:39.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:38 smithi189 ceph-mon[32756]: pgmap v19082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:39.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:38 smithi156 ceph-mon[32679]: pgmap v19082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:39 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 35054.986085 secs 2024-04-27T04:02:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:39 smithi092 ceph-mon[29156]: slow request 11521.868951 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:02:40.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34357.951699 secs 2024-04-27T04:02:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:39 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 35054.986085 secs 2024-04-27T04:02:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:39 smithi189 ceph-mon[32756]: slow request 11521.868951 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:02:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34357.951699 secs 2024-04-27T04:02:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:39 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 35054.986085 secs 2024-04-27T04:02:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:39 smithi156 ceph-mon[32679]: slow request 11521.868951 seconds old, received at 2024-04-27T00:50:37.032875+0000: client_request(client.17283:1 getattr pAsLsXsFs #0x1 2024-04-27T00:50:37.025748+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:02:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34357.951699 secs 2024-04-27T04:02:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:40 smithi092 ceph-mon[29156]: pgmap v19083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:41.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:40 smithi189 ceph-mon[32756]: pgmap v19083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:41.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:40 smithi156 ceph-mon[32679]: pgmap v19083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:42 smithi092 ceph-mon[29156]: pgmap v19084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:42 smithi189 ceph-mon[32756]: pgmap v19084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:42 smithi156 ceph-mon[32679]: pgmap v19084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:02:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:44 smithi092 ceph-mon[29156]: pgmap v19085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35059.986152 secs 2024-04-27T04:02:45.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34362.951767 secs 2024-04-27T04:02:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:44 smithi189 ceph-mon[32756]: pgmap v19085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35059.986152 secs 2024-04-27T04:02:45.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34362.951767 secs 2024-04-27T04:02:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:44 smithi156 ceph-mon[32679]: pgmap v19085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35059.986152 secs 2024-04-27T04:02:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34362.951767 secs 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: pgmap v19086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:02:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: pgmap v19086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:02:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: pgmap v19086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:02:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: pgmap v19087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:48.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:47 smithi189 ceph-mon[32756]: pgmap v19088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: pgmap v19087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:48.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:47 smithi156 ceph-mon[32679]: pgmap v19088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:02:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:02:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:02:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:02:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:02:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: pgmap v19087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:02:48.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:47 smithi092 ceph-mon[29156]: pgmap v19088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:49 smithi189 ceph-mon[32756]: pgmap v19089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35064.986216 secs 2024-04-27T04:02:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34367.951831 secs 2024-04-27T04:02:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:49 smithi156 ceph-mon[32679]: pgmap v19089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35064.986216 secs 2024-04-27T04:02:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34367.951831 secs 2024-04-27T04:02:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:49 smithi092 ceph-mon[29156]: pgmap v19089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35064.986216 secs 2024-04-27T04:02:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34367.951831 secs 2024-04-27T04:02:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:51 smithi189 ceph-mon[32756]: pgmap v19090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:51 smithi156 ceph-mon[32679]: pgmap v19090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:52.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:51 smithi092 ceph-mon[29156]: pgmap v19090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:53 smithi189 ceph-mon[32756]: pgmap v19091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:53 smithi156 ceph-mon[32679]: pgmap v19091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:54.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:53 smithi092 ceph-mon[29156]: pgmap v19091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35069.986331 secs 2024-04-27T04:02:55.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34372.951972 secs 2024-04-27T04:02:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35069.986331 secs 2024-04-27T04:02:55.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34372.951972 secs 2024-04-27T04:02:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35069.986331 secs 2024-04-27T04:02:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34372.951972 secs 2024-04-27T04:02:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:55 smithi189 ceph-mon[32756]: pgmap v19092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:55 smithi156 ceph-mon[32679]: pgmap v19092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:56.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:55 smithi092 ceph-mon[29156]: pgmap v19092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:02:58.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:57 smithi189 ceph-mon[32756]: pgmap v19093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:02:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:57 smithi156 ceph-mon[32679]: pgmap v19093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:02:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:57 smithi092 ceph-mon[29156]: pgmap v19093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:03:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:59 smithi189 ceph-mon[32756]: pgmap v19094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35074.986448 secs 2024-04-27T04:03:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:02:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34377.952112 secs 2024-04-27T04:03:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:59 smithi156 ceph-mon[32679]: pgmap v19094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35074.986448 secs 2024-04-27T04:03:00.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:02:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34377.952112 secs 2024-04-27T04:03:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:59 smithi092 ceph-mon[29156]: pgmap v19094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35074.986448 secs 2024-04-27T04:03:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:02:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34377.952112 secs 2024-04-27T04:03:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:01 smithi189 ceph-mon[32756]: pgmap v19095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:01 smithi156 ceph-mon[32679]: pgmap v19095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:01 smithi092 ceph-mon[29156]: pgmap v19095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:04.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:03 smithi189 ceph-mon[32756]: pgmap v19096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:03 smithi156 ceph-mon[32679]: pgmap v19096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:03 smithi092 ceph-mon[29156]: pgmap v19096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35079.986560 secs 2024-04-27T04:03:05.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34382.952237 secs 2024-04-27T04:03:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35079.986560 secs 2024-04-27T04:03:05.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34382.952237 secs 2024-04-27T04:03:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35079.986560 secs 2024-04-27T04:03:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34382.952237 secs 2024-04-27T04:03:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:05 smithi189 ceph-mon[32756]: pgmap v19097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:05 smithi156 ceph-mon[32679]: pgmap v19097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:05 smithi092 ceph-mon[29156]: pgmap v19097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:07 smithi189 ceph-mon[32756]: pgmap v19098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:07 smithi156 ceph-mon[32679]: pgmap v19098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:07 smithi092 ceph-mon[29156]: pgmap v19098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:09 smithi189 ceph-mon[32756]: pgmap v19099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35084.986624 secs 2024-04-27T04:03:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34387.952351 secs 2024-04-27T04:03:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:09 smithi156 ceph-mon[32679]: pgmap v19099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35084.986624 secs 2024-04-27T04:03:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34387.952351 secs 2024-04-27T04:03:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:09 smithi092 ceph-mon[29156]: pgmap v19099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35084.986624 secs 2024-04-27T04:03:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34387.952351 secs 2024-04-27T04:03:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:11 smithi189 ceph-mon[32756]: pgmap v19100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:11 smithi156 ceph-mon[32679]: pgmap v19100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:11 smithi092 ceph-mon[29156]: pgmap v19100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:13 smithi189 ceph-mon[32756]: pgmap v19101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:13 smithi156 ceph-mon[32679]: pgmap v19101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:13 smithi092 ceph-mon[29156]: pgmap v19101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35089.986772 secs 2024-04-27T04:03:15.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34392.952452 secs 2024-04-27T04:03:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35089.986772 secs 2024-04-27T04:03:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34392.952452 secs 2024-04-27T04:03:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35089.986772 secs 2024-04-27T04:03:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34392.952452 secs 2024-04-27T04:03:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:15 smithi189 ceph-mon[32756]: pgmap v19102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:15 smithi156 ceph-mon[32679]: pgmap v19102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:15 smithi092 ceph-mon[29156]: pgmap v19102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:17 smithi189 ceph-mon[32756]: pgmap v19103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:17 smithi156 ceph-mon[32679]: pgmap v19103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:17 smithi092 ceph-mon[29156]: pgmap v19103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:19 smithi156 ceph-mon[32679]: pgmap v19104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35094.986938 secs 2024-04-27T04:03:20.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34397.952566 secs 2024-04-27T04:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:19 smithi092 ceph-mon[29156]: pgmap v19104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35094.986938 secs 2024-04-27T04:03:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34397.952566 secs 2024-04-27T04:03:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:19 smithi189 ceph-mon[32756]: pgmap v19104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35094.986938 secs 2024-04-27T04:03:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34397.952566 secs 2024-04-27T04:03:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:21 smithi156 ceph-mon[32679]: pgmap v19105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:22.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:21 smithi092 ceph-mon[29156]: pgmap v19105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:22.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:21 smithi189 ceph-mon[32756]: pgmap v19105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:23 smithi156 ceph-mon[32679]: pgmap v19106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:23 smithi092 ceph-mon[29156]: pgmap v19106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:24.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:23 smithi189 ceph-mon[32756]: pgmap v19106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35099.987005 secs 2024-04-27T04:03:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34402.952669 secs 2024-04-27T04:03:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35099.987005 secs 2024-04-27T04:03:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34402.952669 secs 2024-04-27T04:03:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35099.987005 secs 2024-04-27T04:03:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34402.952669 secs 2024-04-27T04:03:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:25 smithi156 ceph-mon[32679]: pgmap v19107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:25 smithi092 ceph-mon[29156]: pgmap v19107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:26.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:25 smithi189 ceph-mon[32756]: pgmap v19107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:27 smithi156 ceph-mon[32679]: pgmap v19108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:27 smithi092 ceph-mon[29156]: pgmap v19108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:28.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:27 smithi189 ceph-mon[32756]: pgmap v19108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:29 smithi156 ceph-mon[32679]: pgmap v19109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35104.987081 secs 2024-04-27T04:03:30.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34407.952793 secs 2024-04-27T04:03:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:29 smithi092 ceph-mon[29156]: pgmap v19109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35104.987081 secs 2024-04-27T04:03:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34407.952793 secs 2024-04-27T04:03:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:29 smithi189 ceph-mon[32756]: pgmap v19109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35104.987081 secs 2024-04-27T04:03:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34407.952793 secs 2024-04-27T04:03:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:31 smithi156 ceph-mon[32679]: pgmap v19110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:32.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:31 smithi189 ceph-mon[32756]: pgmap v19110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:31 smithi092 ceph-mon[29156]: pgmap v19110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:33 smithi156 ceph-mon[32679]: pgmap v19111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:33 smithi092 ceph-mon[29156]: pgmap v19111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:34.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:33 smithi189 ceph-mon[32756]: pgmap v19111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35109.987188 secs 2024-04-27T04:03:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34412.952943 secs 2024-04-27T04:03:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35109.987188 secs 2024-04-27T04:03:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34412.952943 secs 2024-04-27T04:03:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35109.987188 secs 2024-04-27T04:03:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34412.952943 secs 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001696) for more than 900000000 us, fault. 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca8095000 comp rx=0 tx=0).stop 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.047+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80b6000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T04:03:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T04:03:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.088+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T04:03:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:03:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=37 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T04:03:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.088+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:03:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.089+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T04:03:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:36.089+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T04:03:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:35 smithi156 ceph-mon[32679]: pgmap v19112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:36.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:35 smithi092 ceph-mon[29156]: pgmap v19112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:36.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:35 smithi189 ceph-mon[32756]: pgmap v19112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:37 smithi156 ceph-mon[32679]: pgmap v19113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:38.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:37 smithi092 ceph-mon[29156]: pgmap v19113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:38.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:37 smithi189 ceph-mon[32756]: pgmap v19113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:39 smithi156 ceph-mon[32679]: pgmap v19114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35114.987311 secs 2024-04-27T04:03:40.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34417.953069 secs 2024-04-27T04:03:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:39 smithi092 ceph-mon[29156]: pgmap v19114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35114.987311 secs 2024-04-27T04:03:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34417.953069 secs 2024-04-27T04:03:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:39 smithi189 ceph-mon[32756]: pgmap v19114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35114.987311 secs 2024-04-27T04:03:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34417.953069 secs 2024-04-27T04:03:40.801 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:40.802+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:03:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:40.802+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:03:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:40.802+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:03:40.802 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:03:40.802+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 270 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:03:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:41 smithi156 ceph-mon[32679]: pgmap v19115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:41 smithi092 ceph-mon[29156]: pgmap v19115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:42.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:41 smithi189 ceph-mon[32756]: pgmap v19115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:43 smithi092 ceph-mon[29156]: pgmap v19116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:44.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:43 smithi189 ceph-mon[32756]: pgmap v19116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:44.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:43 smithi156 ceph-mon[32679]: pgmap v19116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35119.987450 secs 2024-04-27T04:03:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34422.953136 secs 2024-04-27T04:03:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35119.987450 secs 2024-04-27T04:03:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34422.953136 secs 2024-04-27T04:03:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35119.987450 secs 2024-04-27T04:03:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34422.953136 secs 2024-04-27T04:03:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:45 smithi092 ceph-mon[29156]: pgmap v19117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:45 smithi189 ceph-mon[32756]: pgmap v19117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:45 smithi156 ceph-mon[32679]: pgmap v19117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:03:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:03:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:03:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:03:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:47 smithi092 ceph-mon[29156]: pgmap v19118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:03:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:03:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:03:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:47 smithi189 ceph-mon[32756]: pgmap v19118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:03:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:03:48.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:03:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:47 smithi156 ceph-mon[32679]: pgmap v19118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:03:48.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:03:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:03:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:03:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:48 smithi092 ceph-mon[29156]: pgmap v19119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:03:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:48 smithi092 ceph-mon[29156]: pgmap v19120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:03:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:48 smithi189 ceph-mon[32756]: pgmap v19119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:03:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:48 smithi189 ceph-mon[32756]: pgmap v19120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:03:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:48 smithi156 ceph-mon[32679]: pgmap v19119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:03:49.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:48 smithi156 ceph-mon[32679]: pgmap v19120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:03:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35124.987583 secs 2024-04-27T04:03:50.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34427.953260 secs 2024-04-27T04:03:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35124.987583 secs 2024-04-27T04:03:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34427.953260 secs 2024-04-27T04:03:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35124.987583 secs 2024-04-27T04:03:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34427.953260 secs 2024-04-27T04:03:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:50 smithi092 ceph-mon[29156]: pgmap v19121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:50 smithi189 ceph-mon[32756]: pgmap v19121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:50 smithi156 ceph-mon[32679]: pgmap v19121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:52 smithi092 ceph-mon[29156]: pgmap v19122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:52 smithi189 ceph-mon[32756]: pgmap v19122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:52 smithi156 ceph-mon[32679]: pgmap v19122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:54 smithi092 ceph-mon[29156]: pgmap v19123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:03:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35129.987679 secs 2024-04-27T04:03:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34432.953375 secs 2024-04-27T04:03:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:54 smithi189 ceph-mon[32756]: pgmap v19123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:03:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35129.987679 secs 2024-04-27T04:03:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34432.953375 secs 2024-04-27T04:03:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:54 smithi156 ceph-mon[32679]: pgmap v19123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:03:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35129.987679 secs 2024-04-27T04:03:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34432.953375 secs 2024-04-27T04:03:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:56 smithi092 ceph-mon[29156]: pgmap v19124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:56 smithi189 ceph-mon[32756]: pgmap v19124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:56 smithi156 ceph-mon[32679]: pgmap v19124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:03:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:58 smithi092 ceph-mon[29156]: pgmap v19125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:03:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:58 smithi189 ceph-mon[32756]: pgmap v19125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:03:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:58 smithi156 ceph-mon[32679]: pgmap v19125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:04:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35134.987777 secs 2024-04-27T04:04:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:03:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34437.953492 secs 2024-04-27T04:04:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35134.987777 secs 2024-04-27T04:04:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:03:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34437.953492 secs 2024-04-27T04:04:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35134.987777 secs 2024-04-27T04:04:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:03:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34437.953492 secs 2024-04-27T04:04:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:00 smithi092 ceph-mon[29156]: pgmap v19126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:00 smithi189 ceph-mon[32756]: pgmap v19126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:00 smithi156 ceph-mon[32679]: pgmap v19126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:02 smithi092 ceph-mon[29156]: pgmap v19127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:02 smithi189 ceph-mon[32756]: pgmap v19127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:02 smithi156 ceph-mon[32679]: pgmap v19127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:04 smithi092 ceph-mon[29156]: pgmap v19128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35139.987889 secs 2024-04-27T04:04:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34442.953563 secs 2024-04-27T04:04:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:04 smithi189 ceph-mon[32756]: pgmap v19128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35139.987889 secs 2024-04-27T04:04:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34442.953563 secs 2024-04-27T04:04:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:04 smithi156 ceph-mon[32679]: pgmap v19128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35139.987889 secs 2024-04-27T04:04:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34442.953563 secs 2024-04-27T04:04:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:06 smithi189 ceph-mon[32756]: pgmap v19129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:06 smithi156 ceph-mon[32679]: pgmap v19129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:07.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:06 smithi092 ceph-mon[29156]: pgmap v19129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:09 smithi189 ceph-mon[32756]: pgmap v19130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:08 smithi156 ceph-mon[32679]: pgmap v19130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:09.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:08 smithi092 ceph-mon[29156]: pgmap v19130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35144.988007 secs 2024-04-27T04:04:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:10 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34447.953669 secs 2024-04-27T04:04:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35144.988007 secs 2024-04-27T04:04:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:10 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34447.953669 secs 2024-04-27T04:04:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35144.988007 secs 2024-04-27T04:04:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:10 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34447.953669 secs 2024-04-27T04:04:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:11 smithi189 ceph-mon[32756]: pgmap v19131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:11 smithi156 ceph-mon[32679]: pgmap v19131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:11.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:11 smithi092 ceph-mon[29156]: pgmap v19131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:13 smithi189 ceph-mon[32756]: pgmap v19132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:13 smithi156 ceph-mon[32679]: pgmap v19132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:13.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:13 smithi092 ceph-mon[29156]: pgmap v19132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:15 smithi189 ceph-mon[32756]: pgmap v19133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35149.988088 secs 2024-04-27T04:04:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:15 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34452.953790 secs 2024-04-27T04:04:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:15 smithi156 ceph-mon[32679]: pgmap v19133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35149.988088 secs 2024-04-27T04:04:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:15 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34452.953790 secs 2024-04-27T04:04:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:15 smithi092 ceph-mon[29156]: pgmap v19133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35149.988088 secs 2024-04-27T04:04:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:15 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34452.953790 secs 2024-04-27T04:04:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:17 smithi189 ceph-mon[32756]: pgmap v19134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:17 smithi156 ceph-mon[32679]: pgmap v19134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:17.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:17 smithi092 ceph-mon[29156]: pgmap v19134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:18.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:18 smithi156 ceph-mon[32679]: pgmap v19135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:18 smithi092 ceph-mon[29156]: pgmap v19135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:18.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:18 smithi189 ceph-mon[32756]: pgmap v19135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:19.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34457.953938 secs 2024-04-27T04:04:19.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34457.953938 secs 2024-04-27T04:04:19.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34457.953938 secs 2024-04-27T04:04:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35154.988207 secs 2024-04-27T04:04:20.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:20 smithi092 ceph-mon[29156]: pgmap v19136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:04:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35154.988207 secs 2024-04-27T04:04:20.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:20 smithi189 ceph-mon[32756]: pgmap v19136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:04:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35154.988207 secs 2024-04-27T04:04:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:20 smithi156 ceph-mon[32679]: pgmap v19136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:04:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:22 smithi189 ceph-mon[32756]: pgmap v19137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:22.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:22 smithi156 ceph-mon[32679]: pgmap v19137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:22.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:22 smithi092 ceph-mon[29156]: pgmap v19137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:04:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:24 smithi189 ceph-mon[32756]: pgmap v19138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35159.988313 secs 2024-04-27T04:04:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34462.954055 secs 2024-04-27T04:04:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:24 smithi156 ceph-mon[32679]: pgmap v19138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35159.988313 secs 2024-04-27T04:04:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34462.954055 secs 2024-04-27T04:04:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:24 smithi092 ceph-mon[29156]: pgmap v19138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-27T04:04:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35159.988313 secs 2024-04-27T04:04:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34462.954055 secs 2024-04-27T04:04:25.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:04:25.807+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:04:25.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:04:25.807+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:04:25.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:04:25.807+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:04:25.808 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:04:25.807+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 271 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:04:26.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:26 smithi156 ceph-mon[32679]: pgmap v19139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:26.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:26 smithi092 ceph-mon[29156]: pgmap v19139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:26 smithi189 ceph-mon[32756]: pgmap v19139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:28.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:28 smithi156 ceph-mon[32679]: pgmap v19140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:28.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:28 smithi092 ceph-mon[29156]: pgmap v19140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:28 smithi189 ceph-mon[32756]: pgmap v19140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35164.988432 secs 2024-04-27T04:04:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34467.954175 secs 2024-04-27T04:04:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35164.988432 secs 2024-04-27T04:04:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34467.954175 secs 2024-04-27T04:04:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35164.988432 secs 2024-04-27T04:04:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34467.954175 secs 2024-04-27T04:04:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:30 smithi156 ceph-mon[32679]: pgmap v19141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:30 smithi092 ceph-mon[29156]: pgmap v19141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:30 smithi189 ceph-mon[32756]: pgmap v19141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:32.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:32 smithi156 ceph-mon[32679]: pgmap v19142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:32.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:32 smithi092 ceph-mon[29156]: pgmap v19142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:33.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:32 smithi189 ceph-mon[32756]: pgmap v19142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:34 smithi156 ceph-mon[32679]: pgmap v19143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35169.988525 secs 2024-04-27T04:04:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34472.954292 secs 2024-04-27T04:04:34.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:34 smithi189 ceph-mon[32756]: pgmap v19143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:34.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35169.988525 secs 2024-04-27T04:04:34.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34472.954292 secs 2024-04-27T04:04:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:34 smithi092 ceph-mon[29156]: pgmap v19143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35169.988525 secs 2024-04-27T04:04:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34472.954292 secs 2024-04-27T04:04:36.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:36 smithi156 ceph-mon[32679]: pgmap v19144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:36.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:36 smithi092 ceph-mon[29156]: pgmap v19144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:37.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:36 smithi189 ceph-mon[32756]: pgmap v19144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:38.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:38 smithi156 ceph-mon[32679]: pgmap v19145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:38.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:38 smithi092 ceph-mon[29156]: pgmap v19145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:39.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:38 smithi189 ceph-mon[32756]: pgmap v19145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35174.988644 secs 2024-04-27T04:04:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34477.954403 secs 2024-04-27T04:04:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35174.988644 secs 2024-04-27T04:04:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34477.954403 secs 2024-04-27T04:04:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35174.988644 secs 2024-04-27T04:04:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34477.954403 secs 2024-04-27T04:04:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:04:40.200+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:04:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:04:40.200+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:04:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:04:40.200+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:04:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:04:40.200+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:04:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:04:40.200+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:04:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:40 smithi156 ceph-mon[32679]: pgmap v19146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:40 smithi092 ceph-mon[29156]: pgmap v19146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:40 smithi189 ceph-mon[32756]: pgmap v19146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:04:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:42 smithi156 ceph-mon[32679]: pgmap v19147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:42 smithi092 ceph-mon[29156]: pgmap v19147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:42 smithi189 ceph-mon[32756]: pgmap v19147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:04:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:44 smithi156 ceph-mon[32679]: pgmap v19148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-27T04:04:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35179.988755 secs 2024-04-27T04:04:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34482.954499 secs 2024-04-27T04:04:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:44 smithi092 ceph-mon[29156]: pgmap v19148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-27T04:04:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35179.988755 secs 2024-04-27T04:04:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34482.954499 secs 2024-04-27T04:04:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:44 smithi189 ceph-mon[32756]: pgmap v19148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 4 op/s 2024-04-27T04:04:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35179.988755 secs 2024-04-27T04:04:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34482.954499 secs 2024-04-27T04:04:46.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:46 smithi156 ceph-mon[32679]: pgmap v19149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:04:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:46 smithi092 ceph-mon[29156]: pgmap v19149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:04:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:46 smithi189 ceph-mon[32756]: pgmap v19149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:04:47.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:04:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:04:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:04:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:48 smithi092 ceph-mon[29156]: pgmap v19150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:04:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:04:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:04:48.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:48 smithi189 ceph-mon[32756]: pgmap v19150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:04:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:48 smithi156 ceph-mon[32679]: pgmap v19150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:04:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:04:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:04:49.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:04:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:49 smithi092 ceph-mon[29156]: pgmap v19151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:04:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:49 smithi092 ceph-mon[29156]: pgmap v19152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:04:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35184.988853 secs 2024-04-27T04:04:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34487.954586 secs 2024-04-27T04:04:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:49 smithi189 ceph-mon[32756]: pgmap v19151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:04:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:49 smithi189 ceph-mon[32756]: pgmap v19152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:04:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35184.988853 secs 2024-04-27T04:04:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34487.954586 secs 2024-04-27T04:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:49 smithi156 ceph-mon[32679]: pgmap v19151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:49 smithi156 ceph-mon[32679]: pgmap v19152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35184.988853 secs 2024-04-27T04:04:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34487.954586 secs 2024-04-27T04:04:51.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:51 smithi092 ceph-mon[29156]: pgmap v19153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:04:52.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:51 smithi189 ceph-mon[32756]: pgmap v19153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:04:52.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:51 smithi156 ceph-mon[32679]: pgmap v19153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:04:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:53 smithi092 ceph-mon[29156]: pgmap v19154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 116 B/s wr, 3 op/s 2024-04-27T04:04:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:53 smithi189 ceph-mon[32756]: pgmap v19154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 116 B/s wr, 3 op/s 2024-04-27T04:04:54.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:53 smithi156 ceph-mon[32679]: pgmap v19154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 116 B/s wr, 3 op/s 2024-04-27T04:04:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35189.988920 secs 2024-04-27T04:04:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34492.954706 secs 2024-04-27T04:04:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35189.988920 secs 2024-04-27T04:04:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34492.954706 secs 2024-04-27T04:04:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35189.988920 secs 2024-04-27T04:04:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34492.954706 secs 2024-04-27T04:04:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:55 smithi092 ceph-mon[29156]: pgmap v19155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:55 smithi189 ceph-mon[32756]: pgmap v19155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:55 smithi156 ceph-mon[32679]: pgmap v19155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:57.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:57 smithi092 ceph-mon[29156]: pgmap v19156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:57 smithi189 ceph-mon[32756]: pgmap v19156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:57 smithi156 ceph-mon[32679]: pgmap v19156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:04:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:59 smithi092 ceph-mon[29156]: pgmap v19157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:04:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35194.989000 secs 2024-04-27T04:04:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:04:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34497.954846 secs 2024-04-27T04:05:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:59 smithi189 ceph-mon[32756]: pgmap v19157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:05:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35194.989000 secs 2024-04-27T04:05:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:04:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34497.954846 secs 2024-04-27T04:05:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:59 smithi156 ceph-mon[32679]: pgmap v19157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:05:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35194.989000 secs 2024-04-27T04:05:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:04:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34497.954846 secs 2024-04-27T04:05:01.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:01 smithi092 ceph-mon[29156]: pgmap v19158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:01 smithi189 ceph-mon[32756]: pgmap v19158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:01 smithi156 ceph-mon[32679]: pgmap v19158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:03.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:03 smithi092 ceph-mon[29156]: pgmap v19159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:03 smithi189 ceph-mon[32756]: pgmap v19159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:03 smithi156 ceph-mon[32679]: pgmap v19159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35199.989114 secs 2024-04-27T04:05:04.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34502.954960 secs 2024-04-27T04:05:05.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35199.989114 secs 2024-04-27T04:05:05.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34502.954960 secs 2024-04-27T04:05:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35199.989114 secs 2024-04-27T04:05:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34502.954960 secs 2024-04-27T04:05:05.980 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:05 smithi092 ceph-mon[29156]: pgmap v19160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:05 smithi189 ceph-mon[32756]: pgmap v19160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:05 smithi156 ceph-mon[32679]: pgmap v19160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:07.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:07 smithi092 ceph-mon[29156]: pgmap v19161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:07 smithi189 ceph-mon[32756]: pgmap v19161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:07 smithi156 ceph-mon[32679]: pgmap v19161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:09 smithi092 ceph-mon[29156]: pgmap v19162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35204.989237 secs 2024-04-27T04:05:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34507.955076 secs 2024-04-27T04:05:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:09 smithi189 ceph-mon[32756]: pgmap v19162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35204.989237 secs 2024-04-27T04:05:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34507.955076 secs 2024-04-27T04:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:09 smithi156 ceph-mon[32679]: pgmap v19162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35204.989237 secs 2024-04-27T04:05:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34507.955076 secs 2024-04-27T04:05:11.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:11 smithi092 ceph-mon[29156]: pgmap v19163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:11 smithi189 ceph-mon[32756]: pgmap v19163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:11 smithi156 ceph-mon[32679]: pgmap v19163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:13 smithi189 ceph-mon[32756]: pgmap v19164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:13 smithi156 ceph-mon[32679]: pgmap v19164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:13 smithi092 ceph-mon[29156]: pgmap v19164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:05:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35209.989351 secs 2024-04-27T04:05:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34512.955219 secs 2024-04-27T04:05:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35209.989351 secs 2024-04-27T04:05:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34512.955219 secs 2024-04-27T04:05:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35209.989351 secs 2024-04-27T04:05:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34512.955219 secs 2024-04-27T04:05:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:15 smithi189 ceph-mon[32756]: pgmap v19165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:15 smithi156 ceph-mon[32679]: pgmap v19165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:15 smithi092 ceph-mon[29156]: pgmap v19165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:05:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:17 smithi189 ceph-mon[32756]: pgmap v19166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:17 smithi156 ceph-mon[32679]: pgmap v19166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:17 smithi092 ceph-mon[29156]: pgmap v19166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:19 smithi189 ceph-mon[32756]: pgmap v19167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35214.989484 secs 2024-04-27T04:05:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34517.955364 secs 2024-04-27T04:05:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:19 smithi156 ceph-mon[32679]: pgmap v19167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35214.989484 secs 2024-04-27T04:05:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34517.955364 secs 2024-04-27T04:05:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:19 smithi092 ceph-mon[29156]: pgmap v19167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35214.989484 secs 2024-04-27T04:05:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34517.955364 secs 2024-04-27T04:05:22.045 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:21 smithi092 ceph-mon[29156]: pgmap v19168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:22.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:21 smithi189 ceph-mon[32756]: pgmap v19168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:22.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:21 smithi156 ceph-mon[32679]: pgmap v19168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:24.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:23 smithi189 ceph-mon[32756]: pgmap v19169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:24.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:23 smithi156 ceph-mon[32679]: pgmap v19169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:24.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:23 smithi092 ceph-mon[29156]: pgmap v19169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35219.989603 secs 2024-04-27T04:05:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34522.955509 secs 2024-04-27T04:05:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35219.989603 secs 2024-04-27T04:05:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34522.955509 secs 2024-04-27T04:05:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35219.989603 secs 2024-04-27T04:05:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34522.955509 secs 2024-04-27T04:05:26.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:25 smithi189 ceph-mon[32756]: pgmap v19170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:26.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:25 smithi156 ceph-mon[32679]: pgmap v19170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:26.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:25 smithi092 ceph-mon[29156]: pgmap v19170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:28.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:27 smithi189 ceph-mon[32756]: pgmap v19171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:28.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:27 smithi156 ceph-mon[32679]: pgmap v19171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:27 smithi092 ceph-mon[29156]: pgmap v19171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:29 smithi189 ceph-mon[32756]: pgmap v19172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35224.989671 secs 2024-04-27T04:05:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34527.955579 secs 2024-04-27T04:05:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:29 smithi156 ceph-mon[32679]: pgmap v19172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35224.989671 secs 2024-04-27T04:05:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34527.955579 secs 2024-04-27T04:05:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:29 smithi092 ceph-mon[29156]: pgmap v19172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35224.989671 secs 2024-04-27T04:05:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34527.955579 secs 2024-04-27T04:05:32.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:31 smithi189 ceph-mon[32756]: pgmap v19173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:32.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:31 smithi156 ceph-mon[32679]: pgmap v19173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:32.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:31 smithi092 ceph-mon[29156]: pgmap v19173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:34.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:33 smithi189 ceph-mon[32756]: pgmap v19174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:34.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:33 smithi156 ceph-mon[32679]: pgmap v19174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:34.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:33 smithi092 ceph-mon[29156]: pgmap v19174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35229.989810 secs 2024-04-27T04:05:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34532.955681 secs 2024-04-27T04:05:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35229.989810 secs 2024-04-27T04:05:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34532.955681 secs 2024-04-27T04:05:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35229.989810 secs 2024-04-27T04:05:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34532.955681 secs 2024-04-27T04:05:36.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:35 smithi189 ceph-mon[32756]: pgmap v19175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:36.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:35 smithi156 ceph-mon[32679]: pgmap v19175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:36.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:35 smithi092 ceph-mon[29156]: pgmap v19175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:37 smithi092 ceph-mon[29156]: pgmap v19176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:38.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:37 smithi189 ceph-mon[32756]: pgmap v19176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:38.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:37 smithi156 ceph-mon[32679]: pgmap v19176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:39 smithi189 ceph-mon[32756]: pgmap v19177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35234.989927 secs 2024-04-27T04:05:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34537.955820 secs 2024-04-27T04:05:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:39 smithi156 ceph-mon[32679]: pgmap v19177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35234.989927 secs 2024-04-27T04:05:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34537.955820 secs 2024-04-27T04:05:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:39 smithi092 ceph-mon[29156]: pgmap v19177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35234.989927 secs 2024-04-27T04:05:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34537.955820 secs 2024-04-27T04:05:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:41 smithi189 ceph-mon[32756]: pgmap v19178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:42.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:41 smithi156 ceph-mon[32679]: pgmap v19178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:42.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:41 smithi092 ceph-mon[29156]: pgmap v19178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:43 smithi189 ceph-mon[32756]: pgmap v19179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:44.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:43 smithi156 ceph-mon[32679]: pgmap v19179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:44.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:43 smithi092 ceph-mon[29156]: pgmap v19179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35239.990062 secs 2024-04-27T04:05:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34542.955962 secs 2024-04-27T04:05:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35239.990062 secs 2024-04-27T04:05:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34542.955962 secs 2024-04-27T04:05:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35239.990062 secs 2024-04-27T04:05:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34542.955962 secs 2024-04-27T04:05:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:45 smithi189 ceph-mon[32756]: pgmap v19180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:46.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:45 smithi156 ceph-mon[32679]: pgmap v19180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:46.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:45 smithi092 ceph-mon[29156]: pgmap v19180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:05:48.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:47 smithi189 ceph-mon[32756]: pgmap v19181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:48.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:47 smithi156 ceph-mon[32679]: pgmap v19181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:48.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:47 smithi092 ceph-mon[29156]: pgmap v19181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:05:49.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:05:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: pgmap v19182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35244.990132 secs 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34547.956052 secs 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:05:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: pgmap v19182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35244.990132 secs 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34547.956052 secs 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:05:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: pgmap v19182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35244.990132 secs 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34547.956052 secs 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:05:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:05:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:50 smithi189 ceph-mon[32756]: pgmap v19183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:05:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:50 smithi189 ceph-mon[32756]: pgmap v19184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:50 smithi156 ceph-mon[32679]: pgmap v19183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:05:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:50 smithi156 ceph-mon[32679]: pgmap v19184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:50 smithi092 ceph-mon[29156]: pgmap v19183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:05:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:50 smithi092 ceph-mon[29156]: pgmap v19184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:52 smithi189 ceph-mon[32756]: pgmap v19185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:53.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:52 smithi156 ceph-mon[32679]: pgmap v19185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:52 smithi092 ceph-mon[29156]: pgmap v19185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:54 smithi189 ceph-mon[32756]: pgmap v19186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:05:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35249.990248 secs 2024-04-27T04:05:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34552.956191 secs 2024-04-27T04:05:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:54 smithi156 ceph-mon[32679]: pgmap v19186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:05:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35249.990248 secs 2024-04-27T04:05:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34552.956191 secs 2024-04-27T04:05:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:54 smithi092 ceph-mon[29156]: pgmap v19186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:05:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35249.990248 secs 2024-04-27T04:05:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34552.956191 secs 2024-04-27T04:05:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:56 smithi189 ceph-mon[32756]: pgmap v19187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:57.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:56 smithi156 ceph-mon[32679]: pgmap v19187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:56 smithi092 ceph-mon[29156]: pgmap v19187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:58 smithi189 ceph-mon[32756]: pgmap v19188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:59.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:58 smithi156 ceph-mon[32679]: pgmap v19188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:05:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:58 smithi092 ceph-mon[29156]: pgmap v19188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35254.990366 secs 2024-04-27T04:06:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:05:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34557.956328 secs 2024-04-27T04:06:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35254.990366 secs 2024-04-27T04:06:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:05:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34557.956328 secs 2024-04-27T04:06:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35254.990366 secs 2024-04-27T04:06:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:05:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34557.956328 secs 2024-04-27T04:06:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:00 smithi189 ceph-mon[32756]: pgmap v19189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:06:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:00 smithi156 ceph-mon[32679]: pgmap v19189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:06:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:00 smithi092 ceph-mon[29156]: pgmap v19189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:06:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:02 smithi189 ceph-mon[32756]: pgmap v19190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:03.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:02 smithi156 ceph-mon[32679]: pgmap v19190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:02 smithi092 ceph-mon[29156]: pgmap v19190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:04 smithi189 ceph-mon[32756]: pgmap v19191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35259.990480 secs 2024-04-27T04:06:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34562.956484 secs 2024-04-27T04:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:04 smithi156 ceph-mon[32679]: pgmap v19191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35259.990480 secs 2024-04-27T04:06:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34562.956484 secs 2024-04-27T04:06:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:04 smithi092 ceph-mon[29156]: pgmap v19191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35259.990480 secs 2024-04-27T04:06:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34562.956484 secs 2024-04-27T04:06:07.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:06 smithi189 ceph-mon[32756]: pgmap v19192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:07.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:06 smithi156 ceph-mon[32679]: pgmap v19192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:06 smithi092 ceph-mon[29156]: pgmap v19192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:09.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:08 smithi189 ceph-mon[32756]: pgmap v19193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:09.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:08 smithi156 ceph-mon[32679]: pgmap v19193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:08 smithi092 ceph-mon[29156]: pgmap v19193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 35264.990597 secs 2024-04-27T04:06:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:09 smithi189 ceph-mon[32756]: slow request 5760.217795 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:06:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34567.956601 secs 2024-04-27T04:06:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 35264.990597 secs 2024-04-27T04:06:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:09 smithi156 ceph-mon[32679]: slow request 5760.217795 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:06:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34567.956601 secs 2024-04-27T04:06:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 35264.990597 secs 2024-04-27T04:06:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:09 smithi092 ceph-mon[29156]: slow request 5760.217795 seconds old, received at 2024-04-27T02:30:08.688543+0000: client_request(client.17397:1 getattr pAsLsXsFs #0x1 2024-04-27T02:30:08.684787+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:06:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34567.956601 secs 2024-04-27T04:06:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:10 smithi189 ceph-mon[32756]: pgmap v19194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:10 smithi156 ceph-mon[32679]: pgmap v19194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:10 smithi092 ceph-mon[29156]: pgmap v19194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:13.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:12 smithi189 ceph-mon[32756]: pgmap v19195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:13.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:12 smithi156 ceph-mon[32679]: pgmap v19195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:13.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:12 smithi092 ceph-mon[29156]: pgmap v19195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:14 smithi189 ceph-mon[32756]: pgmap v19196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35269.990727 secs 2024-04-27T04:06:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:14 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34572.956727 secs 2024-04-27T04:06:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:14 smithi156 ceph-mon[32679]: pgmap v19196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35269.990727 secs 2024-04-27T04:06:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:14 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34572.956727 secs 2024-04-27T04:06:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:14 smithi092 ceph-mon[29156]: pgmap v19196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35269.990727 secs 2024-04-27T04:06:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:14 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34572.956727 secs 2024-04-27T04:06:17.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:16 smithi189 ceph-mon[32756]: pgmap v19197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:17.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:16 smithi156 ceph-mon[32679]: pgmap v19197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:17.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:16 smithi092 ceph-mon[29156]: pgmap v19197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:18 smithi189 ceph-mon[32756]: pgmap v19198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:18 smithi156 ceph-mon[32679]: pgmap v19198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:18 smithi092 ceph-mon[29156]: pgmap v19198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35274.990831 secs 2024-04-27T04:06:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:19 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34577.956809 secs 2024-04-27T04:06:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35274.990831 secs 2024-04-27T04:06:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:19 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34577.956809 secs 2024-04-27T04:06:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35274.990831 secs 2024-04-27T04:06:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:19 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34577.956809 secs 2024-04-27T04:06:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:20 smithi156 ceph-mon[32679]: pgmap v19199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:20 smithi092 ceph-mon[29156]: pgmap v19199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:20 smithi189 ceph-mon[32756]: pgmap v19199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:22 smithi156 ceph-mon[32679]: pgmap v19200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:23.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:22 smithi092 ceph-mon[29156]: pgmap v19200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:22 smithi189 ceph-mon[32756]: pgmap v19200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:24 smithi156 ceph-mon[32679]: pgmap v19201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35279.990870 secs 2024-04-27T04:06:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:24 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34582.956922 secs 2024-04-27T04:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:24 smithi092 ceph-mon[29156]: pgmap v19201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35279.990870 secs 2024-04-27T04:06:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:24 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34582.956922 secs 2024-04-27T04:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:24 smithi189 ceph-mon[32756]: pgmap v19201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35279.990870 secs 2024-04-27T04:06:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:24 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34582.956922 secs 2024-04-27T04:06:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:26 smithi156 ceph-mon[32679]: pgmap v19202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:26 smithi092 ceph-mon[29156]: pgmap v19202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:26 smithi189 ceph-mon[32756]: pgmap v19202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:28 smithi156 ceph-mon[32679]: pgmap v19203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:28 smithi092 ceph-mon[29156]: pgmap v19203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:28 smithi189 ceph-mon[32756]: pgmap v19203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35284.990935 secs 2024-04-27T04:06:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:29 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34587.957060 secs 2024-04-27T04:06:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35284.990935 secs 2024-04-27T04:06:30.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:29 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34587.957060 secs 2024-04-27T04:06:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35284.990935 secs 2024-04-27T04:06:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:29 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34587.957060 secs 2024-04-27T04:06:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:30 smithi156 ceph-mon[32679]: pgmap v19204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:30 smithi092 ceph-mon[29156]: pgmap v19204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:30 smithi189 ceph-mon[32756]: pgmap v19204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:32 smithi156 ceph-mon[32679]: pgmap v19205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:33.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:32 smithi092 ceph-mon[29156]: pgmap v19205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:32 smithi189 ceph-mon[32756]: pgmap v19205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:34 smithi156 ceph-mon[32679]: pgmap v19206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35289.991056 secs 2024-04-27T04:06:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:34 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34592.957187 secs 2024-04-27T04:06:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:34 smithi092 ceph-mon[29156]: pgmap v19206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35289.991056 secs 2024-04-27T04:06:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:34 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34592.957187 secs 2024-04-27T04:06:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:34 smithi189 ceph-mon[32756]: pgmap v19206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35289.991056 secs 2024-04-27T04:06:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:34 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34592.957187 secs 2024-04-27T04:06:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:36 smithi156 ceph-mon[32679]: pgmap v19207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:37.189 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:36 smithi189 ceph-mon[32756]: pgmap v19207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:37.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:36 smithi092 ceph-mon[29156]: pgmap v19207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:38 smithi156 ceph-mon[32679]: pgmap v19208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:38 smithi092 ceph-mon[29156]: pgmap v19208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:38 smithi189 ceph-mon[32756]: pgmap v19208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35294.991129 secs 2024-04-27T04:06:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:39 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34597.957322 secs 2024-04-27T04:06:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35294.991129 secs 2024-04-27T04:06:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:39 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34597.957322 secs 2024-04-27T04:06:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35294.991129 secs 2024-04-27T04:06:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:39 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34597.957322 secs 2024-04-27T04:06:40.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:06:40.827+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:06:40.826 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:06:40.827+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:06:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:06:40.827+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:06:40.827 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:06:40.827+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 272 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:06:41.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:40 smithi092 ceph-mon[29156]: pgmap v19209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:40 smithi189 ceph-mon[32756]: pgmap v19209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:41.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:40 smithi156 ceph-mon[32679]: pgmap v19209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:42 smithi092 ceph-mon[29156]: pgmap v19210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:42 smithi189 ceph-mon[32756]: pgmap v19210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:43.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:42 smithi156 ceph-mon[32679]: pgmap v19210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:44 smithi092 ceph-mon[29156]: pgmap v19211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35299.991236 secs 2024-04-27T04:06:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:44 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34602.957442 secs 2024-04-27T04:06:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:44 smithi189 ceph-mon[32756]: pgmap v19211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35299.991236 secs 2024-04-27T04:06:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:44 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34602.957442 secs 2024-04-27T04:06:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:44 smithi156 ceph-mon[32679]: pgmap v19211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35299.991236 secs 2024-04-27T04:06:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:44 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34602.957442 secs 2024-04-27T04:06:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:46 smithi092 ceph-mon[29156]: pgmap v19212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:46 smithi189 ceph-mon[32756]: pgmap v19212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:47.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:46 smithi156 ceph-mon[32679]: pgmap v19212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:49.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:48 smithi092 ceph-mon[29156]: pgmap v19213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:48 smithi189 ceph-mon[32756]: pgmap v19213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:48 smithi156 ceph-mon[32679]: pgmap v19213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35304.991355 secs 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34607.957526 secs 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:06:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35304.991355 secs 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34607.957526 secs 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:06:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35304.991355 secs 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34607.957526 secs 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:06:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:06:51.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:50 smithi092 ceph-mon[29156]: pgmap v19214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:50 smithi092 ceph-mon[29156]: pgmap v19215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:06:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:50 smithi092 ceph-mon[29156]: pgmap v19216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:50 smithi189 ceph-mon[32756]: pgmap v19214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:50 smithi189 ceph-mon[32756]: pgmap v19215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:06:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:50 smithi189 ceph-mon[32756]: pgmap v19216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:51.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:50 smithi156 ceph-mon[32679]: pgmap v19214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:06:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:50 smithi156 ceph-mon[32679]: pgmap v19215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:06:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:50 smithi156 ceph-mon[32679]: pgmap v19216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:52 smithi092 ceph-mon[29156]: pgmap v19217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:52 smithi189 ceph-mon[32756]: pgmap v19217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:53.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:52 smithi156 ceph-mon[32679]: pgmap v19217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35309.991485 secs 2024-04-27T04:06:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:54 smithi092 ceph-mon[29156]: pgmap v19218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:54 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34612.957612 secs 2024-04-27T04:06:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35309.991485 secs 2024-04-27T04:06:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:54 smithi189 ceph-mon[32756]: pgmap v19218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:54 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34612.957612 secs 2024-04-27T04:06:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35309.991485 secs 2024-04-27T04:06:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:54 smithi156 ceph-mon[32679]: pgmap v19218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:54 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34612.957612 secs 2024-04-27T04:06:57.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:56 smithi092 ceph-mon[29156]: pgmap v19219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:56 smithi189 ceph-mon[32756]: pgmap v19219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:57.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:56 smithi156 ceph-mon[32679]: pgmap v19219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:06:59.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:58 smithi092 ceph-mon[29156]: pgmap v19220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:06:59.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:58 smithi189 ceph-mon[32756]: pgmap v19220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:06:59.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:58 smithi156 ceph-mon[32679]: pgmap v19220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:07:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35314.991588 secs 2024-04-27T04:07:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:06:59 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34617.957738 secs 2024-04-27T04:07:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35314.991588 secs 2024-04-27T04:07:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:06:59 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34617.957738 secs 2024-04-27T04:07:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35314.991588 secs 2024-04-27T04:07:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:06:59 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34617.957738 secs 2024-04-27T04:07:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:00 smithi092 ceph-mon[29156]: pgmap v19221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:07:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:00 smithi189 ceph-mon[32756]: pgmap v19221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:07:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:00 smithi156 ceph-mon[32679]: pgmap v19221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:07:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:02 smithi092 ceph-mon[29156]: pgmap v19222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:02 smithi189 ceph-mon[32756]: pgmap v19222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:02 smithi156 ceph-mon[32679]: pgmap v19222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35319.991719 secs 2024-04-27T04:07:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:04 smithi092 ceph-mon[29156]: pgmap v19223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:04 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34622.957861 secs 2024-04-27T04:07:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35319.991719 secs 2024-04-27T04:07:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:04 smithi189 ceph-mon[32756]: pgmap v19223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:04 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34622.957861 secs 2024-04-27T04:07:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35319.991719 secs 2024-04-27T04:07:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:04 smithi156 ceph-mon[32679]: pgmap v19223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:04 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34622.957861 secs 2024-04-27T04:07:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:06 smithi092 ceph-mon[29156]: pgmap v19224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:07.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:06 smithi189 ceph-mon[32756]: pgmap v19224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:06 smithi156 ceph-mon[32679]: pgmap v19224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:08 smithi092 ceph-mon[29156]: pgmap v19225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:08 smithi189 ceph-mon[32756]: pgmap v19225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:08 smithi156 ceph-mon[32679]: pgmap v19225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:10.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35324.991807 secs 2024-04-27T04:07:10.144 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:09 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34627.957996 secs 2024-04-27T04:07:10.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35324.991807 secs 2024-04-27T04:07:10.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:09 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34627.957996 secs 2024-04-27T04:07:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35324.991807 secs 2024-04-27T04:07:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:09 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34627.957996 secs 2024-04-27T04:07:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:11 smithi189 ceph-mon[32756]: pgmap v19226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:11 smithi156 ceph-mon[32679]: pgmap v19226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:11.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:11 smithi092 ceph-mon[29156]: pgmap v19226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:13 smithi189 ceph-mon[32756]: pgmap v19227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:13 smithi156 ceph-mon[32679]: pgmap v19227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:13.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:13 smithi092 ceph-mon[29156]: pgmap v19227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35329.991944 secs 2024-04-27T04:07:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:15 smithi189 ceph-mon[32756]: pgmap v19228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:15 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34632.958121 secs 2024-04-27T04:07:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35329.991944 secs 2024-04-27T04:07:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:15 smithi156 ceph-mon[32679]: pgmap v19228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:15 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34632.958121 secs 2024-04-27T04:07:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35329.991944 secs 2024-04-27T04:07:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:15 smithi092 ceph-mon[29156]: pgmap v19228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:15 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34632.958121 secs 2024-04-27T04:07:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:17 smithi189 ceph-mon[32756]: pgmap v19229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:17 smithi156 ceph-mon[32679]: pgmap v19229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:17.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:17 smithi092 ceph-mon[29156]: pgmap v19229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:19 smithi189 ceph-mon[32756]: pgmap v19230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:19 smithi156 ceph-mon[32679]: pgmap v19230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:19.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:19 smithi092 ceph-mon[29156]: pgmap v19230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35334.992064 secs 2024-04-27T04:07:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:20 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34637.958221 secs 2024-04-27T04:07:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35334.992064 secs 2024-04-27T04:07:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:20 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34637.958221 secs 2024-04-27T04:07:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35334.992064 secs 2024-04-27T04:07:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:20 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34637.958221 secs 2024-04-27T04:07:21.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:21 smithi189 ceph-mon[32756]: pgmap v19231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:21.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:21 smithi156 ceph-mon[32679]: pgmap v19231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:21.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:21 smithi092 ceph-mon[29156]: pgmap v19231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:23.295 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:23 smithi092 ceph-mon[29156]: pgmap v19232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:23.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:23 smithi189 ceph-mon[32756]: pgmap v19232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:23.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:23 smithi156 ceph-mon[32679]: pgmap v19232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35339.992176 secs 2024-04-27T04:07:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:25 smithi189 ceph-mon[32756]: pgmap v19233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:25 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34642.958334 secs 2024-04-27T04:07:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35339.992176 secs 2024-04-27T04:07:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:25 smithi156 ceph-mon[32679]: pgmap v19233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:25 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34642.958334 secs 2024-04-27T04:07:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35339.992176 secs 2024-04-27T04:07:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:25 smithi092 ceph-mon[29156]: pgmap v19233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:25 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34642.958334 secs 2024-04-27T04:07:27.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:27 smithi189 ceph-mon[32756]: pgmap v19234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:27.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:27 smithi156 ceph-mon[32679]: pgmap v19234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:27.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:27 smithi092 ceph-mon[29156]: pgmap v19234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:29.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:29 smithi189 ceph-mon[32756]: pgmap v19235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:29.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:29 smithi156 ceph-mon[32679]: pgmap v19235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:29.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:29 smithi092 ceph-mon[29156]: pgmap v19235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35344.992271 secs 2024-04-27T04:07:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:30 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34647.958397 secs 2024-04-27T04:07:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35344.992271 secs 2024-04-27T04:07:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:30 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34647.958397 secs 2024-04-27T04:07:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35344.992271 secs 2024-04-27T04:07:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:30 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34647.958397 secs 2024-04-27T04:07:31.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:31 smithi189 ceph-mon[32756]: pgmap v19236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:31.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:31 smithi156 ceph-mon[32679]: pgmap v19236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:31 smithi092 ceph-mon[29156]: pgmap v19236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:33 smithi189 ceph-mon[32756]: pgmap v19237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:33.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:33 smithi156 ceph-mon[32679]: pgmap v19237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:33.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:33 smithi092 ceph-mon[29156]: pgmap v19237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35349.992428 secs 2024-04-27T04:07:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:35 smithi189 ceph-mon[32756]: pgmap v19238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:35 smithi189 ceph-mon[32756]: 26 slow requests, 0 included below; oldest blocked for > 34652.958476 secs 2024-04-27T04:07:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35349.992428 secs 2024-04-27T04:07:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:35 smithi156 ceph-mon[32679]: pgmap v19238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:35.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:35 smithi156 ceph-mon[32679]: 26 slow requests, 0 included below; oldest blocked for > 34652.958476 secs 2024-04-27T04:07:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35349.992428 secs 2024-04-27T04:07:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:35 smithi092 ceph-mon[29156]: pgmap v19238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:35 smithi092 ceph-mon[29156]: 26 slow requests, 0 included below; oldest blocked for > 34652.958476 secs 2024-04-27T04:07:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:37 smithi189 ceph-mon[32756]: pgmap v19239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:37.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:37 smithi156 ceph-mon[32679]: pgmap v19239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:37.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:37 smithi092 ceph-mon[29156]: pgmap v19239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:39 smithi189 ceph-mon[32756]: pgmap v19240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:39.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:39 smithi156 ceph-mon[32679]: pgmap v19240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:39.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:39 smithi092 ceph-mon[29156]: pgmap v19240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:40.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35354.992538 secs 2024-04-27T04:07:40.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:40 smithi156 ceph-mon[32679]: 26 slow requests, 1 included below; oldest blocked for > 34657.958589 secs 2024-04-27T04:07:40.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:40 smithi156 ceph-mon[32679]: slow request 11522.002909 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:07:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35354.992538 secs 2024-04-27T04:07:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:40 smithi189 ceph-mon[32756]: 26 slow requests, 1 included below; oldest blocked for > 34657.958589 secs 2024-04-27T04:07:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:40 smithi189 ceph-mon[32756]: slow request 11522.002909 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:07:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35354.992538 secs 2024-04-27T04:07:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:40 smithi092 ceph-mon[29156]: 26 slow requests, 1 included below; oldest blocked for > 34657.958589 secs 2024-04-27T04:07:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:40 smithi092 ceph-mon[29156]: slow request 11522.002909 seconds old, received at 2024-04-27T00:55:37.101714+0000: client_request(client.17289:1 getattr pAsLsXsFs #0x1 2024-04-27T00:55:37.094991+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:07:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:41 smithi189 ceph-mon[32756]: pgmap v19241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:41.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:41 smithi156 ceph-mon[32679]: pgmap v19241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:41.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:41 smithi092 ceph-mon[29156]: pgmap v19241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:43 smithi189 ceph-mon[32756]: pgmap v19242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:43.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:43 smithi156 ceph-mon[32679]: pgmap v19242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:43.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:43 smithi092 ceph-mon[29156]: pgmap v19242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35359.992654 secs 2024-04-27T04:07:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:45 smithi189 ceph-mon[32756]: pgmap v19243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:45 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 34662.958690 secs 2024-04-27T04:07:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:45 smithi189 ceph-mon[32756]: slow request 183.894096 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:07:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35359.992654 secs 2024-04-27T04:07:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:45 smithi156 ceph-mon[32679]: pgmap v19243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:45 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 34662.958690 secs 2024-04-27T04:07:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:45 smithi156 ceph-mon[32679]: slow request 183.894096 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:07:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35359.992654 secs 2024-04-27T04:07:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:45 smithi092 ceph-mon[29156]: pgmap v19243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:45 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 34662.958690 secs 2024-04-27T04:07:45.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:45 smithi092 ceph-mon[29156]: slow request 183.894096 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:07:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:07:46.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:07:46.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:07:46.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:07:46.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:07:46.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:07:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:47 smithi189 ceph-mon[32756]: pgmap v19244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:47.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:47 smithi156 ceph-mon[32679]: pgmap v19244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:47.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:47 smithi092 ceph-mon[29156]: pgmap v19244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:49 smithi189 ceph-mon[32756]: pgmap v19245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:49 smithi156 ceph-mon[32679]: pgmap v19245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:49.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:49 smithi092 ceph-mon[29156]: pgmap v19245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35364.992779 secs 2024-04-27T04:07:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:50 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34667.958769 secs 2024-04-27T04:07:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:07:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35364.992779 secs 2024-04-27T04:07:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:50 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34667.958769 secs 2024-04-27T04:07:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:07:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35364.992779 secs 2024-04-27T04:07:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:50 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34667.958769 secs 2024-04-27T04:07:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:07:51.340 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:51 smithi156 ceph-mon[32679]: pgmap v19246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:51.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:51 smithi189 ceph-mon[32756]: pgmap v19246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:51.393 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:51 smithi092 ceph-mon[29156]: pgmap v19246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:53 smithi092 ceph-mon[29156]: pgmap v19247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:53 smithi189 ceph-mon[32756]: pgmap v19247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:53 smithi156 ceph-mon[32679]: pgmap v19247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:07:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35369.992882 secs 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: pgmap v19248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34672.958868 secs 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:07:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35369.992882 secs 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: pgmap v19248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34672.958868 secs 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:07:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35369.992882 secs 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: pgmap v19248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34672.958868 secs 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:07:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:07:56.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:56 smithi189 ceph-mon[32756]: pgmap v19249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:07:56.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:56 smithi189 ceph-mon[32756]: pgmap v19250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:07:56.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:56 smithi156 ceph-mon[32679]: pgmap v19249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:07:56.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:56 smithi156 ceph-mon[32679]: pgmap v19250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:07:56.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:56 smithi092 ceph-mon[29156]: pgmap v19249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:07:56.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:56 smithi092 ceph-mon[29156]: pgmap v19250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:07:58.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:07:58 smithi189 ceph-mon[32756]: pgmap v19251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:07:58.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:07:58 smithi156 ceph-mon[32679]: pgmap v19251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:07:58.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:07:58 smithi092 ceph-mon[29156]: pgmap v19251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:08:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:00 smithi189 ceph-mon[32756]: pgmap v19252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35374.992979 secs 2024-04-27T04:08:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34677.958956 secs 2024-04-27T04:08:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:00 smithi156 ceph-mon[32679]: pgmap v19252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35374.992979 secs 2024-04-27T04:08:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34677.958956 secs 2024-04-27T04:08:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:00 smithi092 ceph-mon[29156]: pgmap v19252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35374.992979 secs 2024-04-27T04:08:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34677.958956 secs 2024-04-27T04:08:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:02 smithi189 ceph-mon[32756]: pgmap v19253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:08:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:02 smithi156 ceph-mon[32679]: pgmap v19253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:08:02.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:02 smithi092 ceph-mon[29156]: pgmap v19253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:08:04.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:04 smithi189 ceph-mon[32756]: pgmap v19254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:04.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:04 smithi156 ceph-mon[32679]: pgmap v19254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:04.455 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:04 smithi092 ceph-mon[29156]: pgmap v19254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:08:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35379.993063 secs 2024-04-27T04:08:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34682.959069 secs 2024-04-27T04:08:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35379.993063 secs 2024-04-27T04:08:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34682.959069 secs 2024-04-27T04:08:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35379.993063 secs 2024-04-27T04:08:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34682.959069 secs 2024-04-27T04:08:06.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:06 smithi189 ceph-mon[32756]: pgmap v19255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:08:06.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:06 smithi156 ceph-mon[32679]: pgmap v19255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:08:06.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:06 smithi092 ceph-mon[29156]: pgmap v19255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:08:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:08 smithi189 ceph-mon[32756]: pgmap v19256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:08.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:08 smithi156 ceph-mon[32679]: pgmap v19256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:08.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:08 smithi092 ceph-mon[29156]: pgmap v19256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:10 smithi189 ceph-mon[32756]: pgmap v19257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35384.993185 secs 2024-04-27T04:08:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:10 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34687.959219 secs 2024-04-27T04:08:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:10 smithi156 ceph-mon[32679]: pgmap v19257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35384.993185 secs 2024-04-27T04:08:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:10 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34687.959219 secs 2024-04-27T04:08:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:10 smithi092 ceph-mon[29156]: pgmap v19257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35384.993185 secs 2024-04-27T04:08:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:10 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34687.959219 secs 2024-04-27T04:08:12.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:12 smithi189 ceph-mon[32756]: pgmap v19258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:12.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:12 smithi156 ceph-mon[32679]: pgmap v19258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:12.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:12 smithi092 ceph-mon[29156]: pgmap v19258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:14.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:14 smithi189 ceph-mon[32756]: pgmap v19259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:14.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:14 smithi156 ceph-mon[32679]: pgmap v19259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:14.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:14 smithi092 ceph-mon[29156]: pgmap v19259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35389.993281 secs 2024-04-27T04:08:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:15 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34692.959337 secs 2024-04-27T04:08:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35389.993281 secs 2024-04-27T04:08:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:15 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34692.959337 secs 2024-04-27T04:08:15.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35389.993281 secs 2024-04-27T04:08:15.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:15 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34692.959337 secs 2024-04-27T04:08:16.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:16 smithi156 ceph-mon[32679]: pgmap v19260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:16.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:16 smithi092 ceph-mon[29156]: pgmap v19260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:16.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:16 smithi189 ceph-mon[32756]: pgmap v19260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:18.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:18 smithi156 ceph-mon[32679]: pgmap v19261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:18.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:18 smithi092 ceph-mon[29156]: pgmap v19261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:18 smithi189 ceph-mon[32756]: pgmap v19261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:20 smithi156 ceph-mon[32679]: pgmap v19262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35394.993359 secs 2024-04-27T04:08:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:20 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34697.959454 secs 2024-04-27T04:08:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:20 smithi092 ceph-mon[29156]: pgmap v19262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35394.993359 secs 2024-04-27T04:08:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:20 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34697.959454 secs 2024-04-27T04:08:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:20 smithi189 ceph-mon[32756]: pgmap v19262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35394.993359 secs 2024-04-27T04:08:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:20 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34697.959454 secs 2024-04-27T04:08:22.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:22 smithi156 ceph-mon[32679]: pgmap v19263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:22.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:22 smithi092 ceph-mon[29156]: pgmap v19263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:22.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:22 smithi189 ceph-mon[32756]: pgmap v19263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:24.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:24 smithi156 ceph-mon[32679]: pgmap v19264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:24.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:24 smithi092 ceph-mon[29156]: pgmap v19264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:24.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:24 smithi189 ceph-mon[32756]: pgmap v19264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35399.993475 secs 2024-04-27T04:08:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:25 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34702.959591 secs 2024-04-27T04:08:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35399.993475 secs 2024-04-27T04:08:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:25 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34702.959591 secs 2024-04-27T04:08:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35399.993475 secs 2024-04-27T04:08:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:25 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34702.959591 secs 2024-04-27T04:08:26.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:26 smithi156 ceph-mon[32679]: pgmap v19265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:26.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:26 smithi092 ceph-mon[29156]: pgmap v19265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:26.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:26 smithi189 ceph-mon[32756]: pgmap v19265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:27.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:27 smithi156 ceph-mon[32679]: pgmap v19266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:27.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:27 smithi092 ceph-mon[29156]: pgmap v19266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:27 smithi189 ceph-mon[32756]: pgmap v19266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:29 smithi189 ceph-mon[32756]: pgmap v19267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:29.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34707.959710 secs 2024-04-27T04:08:29.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:29 smithi156 ceph-mon[32679]: pgmap v19267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:29.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34707.959710 secs 2024-04-27T04:08:29.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:29 smithi092 ceph-mon[29156]: pgmap v19267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:29.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34707.959710 secs 2024-04-27T04:08:30.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35404.993617 secs 2024-04-27T04:08:30.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35404.993617 secs 2024-04-27T04:08:30.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35404.993617 secs 2024-04-27T04:08:31.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:31 smithi189 ceph-mon[32756]: pgmap v19268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:31.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:31 smithi156 ceph-mon[32679]: pgmap v19268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:31.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:31 smithi092 ceph-mon[29156]: pgmap v19268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:33.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:33 smithi189 ceph-mon[32756]: pgmap v19269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:33.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:33 smithi156 ceph-mon[32679]: pgmap v19269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:33.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:33 smithi092 ceph-mon[29156]: pgmap v19269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:34.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34712.959832 secs 2024-04-27T04:08:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34712.959832 secs 2024-04-27T04:08:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34712.959832 secs 2024-04-27T04:08:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35409.993706 secs 2024-04-27T04:08:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:35 smithi189 ceph-mon[32756]: pgmap v19270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:35.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35409.993706 secs 2024-04-27T04:08:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:35 smithi156 ceph-mon[32679]: pgmap v19270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:35.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35409.993706 secs 2024-04-27T04:08:35.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:35 smithi092 ceph-mon[29156]: pgmap v19270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:37.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:37 smithi189 ceph-mon[32756]: pgmap v19271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:37.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:37 smithi156 ceph-mon[32679]: pgmap v19271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:37.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:37 smithi092 ceph-mon[29156]: pgmap v19271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:39.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:39 smithi189 ceph-mon[32756]: pgmap v19272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:39.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34717.959938 secs 2024-04-27T04:08:39.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:39 smithi156 ceph-mon[32679]: pgmap v19272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34717.959938 secs 2024-04-27T04:08:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:39 smithi092 ceph-mon[29156]: pgmap v19272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34717.959938 secs 2024-04-27T04:08:40.833 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35414.993853 secs 2024-04-27T04:08:40.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35414.993853 secs 2024-04-27T04:08:40.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35414.993853 secs 2024-04-27T04:08:41.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:41 smithi189 ceph-mon[32756]: pgmap v19273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:41.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:41 smithi156 ceph-mon[32679]: pgmap v19273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:41.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:41 smithi092 ceph-mon[29156]: pgmap v19273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:43.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:43 smithi189 ceph-mon[32756]: pgmap v19274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:43.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:43 smithi156 ceph-mon[32679]: pgmap v19274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:43.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:43 smithi092 ceph-mon[29156]: pgmap v19274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:44.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34722.960056 secs 2024-04-27T04:08:44.893 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34722.960056 secs 2024-04-27T04:08:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34722.960056 secs 2024-04-27T04:08:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35419.993976 secs 2024-04-27T04:08:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:45 smithi189 ceph-mon[32756]: pgmap v19275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:45.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35419.993976 secs 2024-04-27T04:08:45.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:45 smithi156 ceph-mon[32679]: pgmap v19275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:45.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35419.993976 secs 2024-04-27T04:08:45.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:45 smithi092 ceph-mon[29156]: pgmap v19275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:47.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:47 smithi189 ceph-mon[32756]: pgmap v19276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:47.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:47 smithi156 ceph-mon[32679]: pgmap v19276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:47.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:47 smithi092 ceph-mon[29156]: pgmap v19276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:49.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:49 smithi189 ceph-mon[32756]: pgmap v19277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:49.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34727.960206 secs 2024-04-27T04:08:49.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:49 smithi156 ceph-mon[32679]: pgmap v19277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:49.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34727.960206 secs 2024-04-27T04:08:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:49 smithi092 ceph-mon[29156]: pgmap v19277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34727.960206 secs 2024-04-27T04:08:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35424.994094 secs 2024-04-27T04:08:50.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35424.994094 secs 2024-04-27T04:08:50.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35424.994094 secs 2024-04-27T04:08:51.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:51 smithi189 ceph-mon[32756]: pgmap v19278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:51.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:51 smithi156 ceph-mon[32679]: pgmap v19278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:51.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:51 smithi092 ceph-mon[29156]: pgmap v19278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:53.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:53 smithi189 ceph-mon[32756]: pgmap v19279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:53.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:53 smithi156 ceph-mon[32679]: pgmap v19279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:53.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:53 smithi092 ceph-mon[29156]: pgmap v19279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:54.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35429.994207 secs 2024-04-27T04:08:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34732.960323 secs 2024-04-27T04:08:54.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:08:54.893 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35429.994207 secs 2024-04-27T04:08:54.893 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34732.960323 secs 2024-04-27T04:08:54.894 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:08:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35429.994207 secs 2024-04-27T04:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34732.960323 secs 2024-04-27T04:08:54.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:08:55.860 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:55 smithi189 ceph-mon[32756]: pgmap v19280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:55 smithi156 ceph-mon[32679]: pgmap v19280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:55.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:55 smithi092 ceph-mon[29156]: pgmap v19280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:08:57.699 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:08:57 smithi189 ceph-mon[32756]: pgmap v19281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:57.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:08:57 smithi156 ceph-mon[32679]: pgmap v19281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:08:57.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:08:57 smithi092 ceph-mon[29156]: pgmap v19281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: pgmap v19282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35434.994319 secs 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: pgmap v19283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: pgmap v19284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34737.960391 secs 2024-04-27T04:09:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: pgmap v19282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35434.994319 secs 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: pgmap v19283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: pgmap v19284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34737.960391 secs 2024-04-27T04:09:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: pgmap v19282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35434.994319 secs 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: pgmap v19283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: pgmap v19284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34737.960391 secs 2024-04-27T04:09:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:09:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:02 smithi156 ceph-mon[32679]: pgmap v19285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:02.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:02 smithi092 ceph-mon[29156]: pgmap v19285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:02.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:02 smithi189 ceph-mon[32756]: pgmap v19285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:03 smithi156 ceph-mon[32679]: pgmap v19286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:09:03.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:03 smithi092 ceph-mon[29156]: pgmap v19286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:09:03.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:03 smithi189 ceph-mon[32756]: pgmap v19286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:09:04.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:04 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34742.960513 secs 2024-04-27T04:09:04.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:04 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34742.960513 secs 2024-04-27T04:09:04.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:04 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34742.960513 secs 2024-04-27T04:09:05.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35439.994456 secs 2024-04-27T04:09:05.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:05 smithi189 ceph-mon[32756]: pgmap v19287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:05.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35439.994456 secs 2024-04-27T04:09:05.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:05 smithi156 ceph-mon[32679]: pgmap v19287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:05.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35439.994456 secs 2024-04-27T04:09:05.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:05 smithi092 ceph-mon[29156]: pgmap v19287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:07.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:07 smithi092 ceph-mon[29156]: pgmap v19288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:07.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:07 smithi189 ceph-mon[32756]: pgmap v19288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:07.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:07 smithi156 ceph-mon[32679]: pgmap v19288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:09:09.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:09 smithi092 ceph-mon[29156]: pgmap v19289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:09:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:09 smithi189 ceph-mon[32756]: pgmap v19289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:09:09.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:09 smithi156 ceph-mon[32679]: pgmap v19289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:09:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35444.994595 secs 2024-04-27T04:09:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:10 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34747.960582 secs 2024-04-27T04:09:10.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35444.994595 secs 2024-04-27T04:09:10.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:10 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34747.960582 secs 2024-04-27T04:09:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35444.994595 secs 2024-04-27T04:09:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:10 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34747.960582 secs 2024-04-27T04:09:11.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:11 smithi092 ceph-mon[29156]: pgmap v19290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:11.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:11 smithi189 ceph-mon[32756]: pgmap v19290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:11.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:11 smithi156 ceph-mon[32679]: pgmap v19290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:13.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:13 smithi092 ceph-mon[29156]: pgmap v19291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:13.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:13 smithi189 ceph-mon[32756]: pgmap v19291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:13.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:13 smithi156 ceph-mon[32679]: pgmap v19291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:14.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:14 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34752.960699 secs 2024-04-27T04:09:14.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:14 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34752.960699 secs 2024-04-27T04:09:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:14 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34752.960699 secs 2024-04-27T04:09:15.836 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35449.994736 secs 2024-04-27T04:09:15.837 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:15 smithi092 ceph-mon[29156]: pgmap v19292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:15.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35449.994736 secs 2024-04-27T04:09:15.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:15 smithi189 ceph-mon[32756]: pgmap v19292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:15.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35449.994736 secs 2024-04-27T04:09:15.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:15 smithi156 ceph-mon[32679]: pgmap v19292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:17.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:17 smithi092 ceph-mon[29156]: pgmap v19293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:17 smithi189 ceph-mon[32756]: pgmap v19293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:17 smithi156 ceph-mon[32679]: pgmap v19293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:19.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:19 smithi092 ceph-mon[29156]: pgmap v19294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:19.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:19 smithi189 ceph-mon[32756]: pgmap v19294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:19.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:19 smithi156 ceph-mon[32679]: pgmap v19294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35454.994854 secs 2024-04-27T04:09:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:20 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34757.960786 secs 2024-04-27T04:09:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35454.994854 secs 2024-04-27T04:09:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:20 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34757.960786 secs 2024-04-27T04:09:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35454.994854 secs 2024-04-27T04:09:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:20 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34757.960786 secs 2024-04-27T04:09:21.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:21 smithi092 ceph-mon[29156]: pgmap v19295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:21.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:21 smithi189 ceph-mon[32756]: pgmap v19295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:21.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:21 smithi156 ceph-mon[32679]: pgmap v19295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:23.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:23 smithi092 ceph-mon[29156]: pgmap v19296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:23.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:23 smithi189 ceph-mon[32756]: pgmap v19296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:23.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:23 smithi156 ceph-mon[32679]: pgmap v19296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:24.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34762.960909 secs 2024-04-27T04:09:24.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34762.960909 secs 2024-04-27T04:09:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34762.960909 secs 2024-04-27T04:09:25.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35459.994974 secs 2024-04-27T04:09:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:25 smithi189 ceph-mon[32756]: pgmap v19297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:25.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35459.994974 secs 2024-04-27T04:09:25.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:25 smithi156 ceph-mon[32679]: pgmap v19297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:25.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35459.994974 secs 2024-04-27T04:09:25.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:25 smithi092 ceph-mon[29156]: pgmap v19297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:27.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:27 smithi092 ceph-mon[29156]: pgmap v19298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:27.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:27 smithi189 ceph-mon[32756]: pgmap v19298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:27.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:27 smithi156 ceph-mon[32679]: pgmap v19298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:29.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:29 smithi092 ceph-mon[29156]: pgmap v19299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:29.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:29 smithi189 ceph-mon[32756]: pgmap v19299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:29.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:29 smithi156 ceph-mon[32679]: pgmap v19299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35464.995073 secs 2024-04-27T04:09:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:30 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34767.961027 secs 2024-04-27T04:09:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35464.995073 secs 2024-04-27T04:09:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:30 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34767.961027 secs 2024-04-27T04:09:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35464.995073 secs 2024-04-27T04:09:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:30 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34767.961027 secs 2024-04-27T04:09:31.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:31 smithi092 ceph-mon[29156]: pgmap v19300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:31.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:31 smithi189 ceph-mon[32756]: pgmap v19300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:31.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:31 smithi156 ceph-mon[32679]: pgmap v19300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:33.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:33 smithi092 ceph-mon[29156]: pgmap v19301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:33.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:33 smithi189 ceph-mon[32756]: pgmap v19301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:33.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:33 smithi156 ceph-mon[32679]: pgmap v19301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:34.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34772.961143 secs 2024-04-27T04:09:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34772.961143 secs 2024-04-27T04:09:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34772.961143 secs 2024-04-27T04:09:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35469.995147 secs 2024-04-27T04:09:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:35 smithi189 ceph-mon[32756]: pgmap v19302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:35.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35469.995147 secs 2024-04-27T04:09:35.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:35 smithi156 ceph-mon[32679]: pgmap v19302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:35.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35469.995147 secs 2024-04-27T04:09:35.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:35 smithi092 ceph-mon[29156]: pgmap v19302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:37.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:37 smithi092 ceph-mon[29156]: pgmap v19303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:37.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:37 smithi189 ceph-mon[32756]: pgmap v19303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:37.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:37 smithi156 ceph-mon[32679]: pgmap v19303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:39.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:39 smithi092 ceph-mon[29156]: pgmap v19304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:39.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:39 smithi189 ceph-mon[32756]: pgmap v19304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:39.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:39 smithi156 ceph-mon[32679]: pgmap v19304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35474.995265 secs 2024-04-27T04:09:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34777.961272 secs 2024-04-27T04:09:40.492 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:09:40.323+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:09:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:09:40.323+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:09:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:09:40.323+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:09:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:09:40.323+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:09:40.493 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:09:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:09:40.323+0000 7f2543cf5700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:09:40.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35474.995265 secs 2024-04-27T04:09:40.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:40 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34777.961272 secs 2024-04-27T04:09:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35474.995265 secs 2024-04-27T04:09:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:40 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34777.961272 secs 2024-04-27T04:09:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:09:40.851+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:09:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:09:40.851+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:09:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:09:40.851+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:09:40.851 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:09:40.851+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 273 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:09:41.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:41 smithi092 ceph-mon[29156]: pgmap v19305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:41.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:41 smithi189 ceph-mon[32756]: pgmap v19305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:41.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:41 smithi156 ceph-mon[32679]: pgmap v19305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:43.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:43 smithi092 ceph-mon[29156]: pgmap v19306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:43.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:43 smithi189 ceph-mon[32756]: pgmap v19306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:43.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:43 smithi156 ceph-mon[32679]: pgmap v19306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:44.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34782.961389 secs 2024-04-27T04:09:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34782.961389 secs 2024-04-27T04:09:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34782.961389 secs 2024-04-27T04:09:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35479.995381 secs 2024-04-27T04:09:45.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:45 smithi189 ceph-mon[32756]: pgmap v19307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:45.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35479.995381 secs 2024-04-27T04:09:45.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:45 smithi156 ceph-mon[32679]: pgmap v19307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:45.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35479.995381 secs 2024-04-27T04:09:45.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:45 smithi092 ceph-mon[29156]: pgmap v19307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:47.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:47 smithi092 ceph-mon[29156]: pgmap v19308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:47.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:47 smithi189 ceph-mon[32756]: pgmap v19308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:47.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:47 smithi156 ceph-mon[32679]: pgmap v19308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:49.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:49 smithi092 ceph-mon[29156]: pgmap v19309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:49.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:49 smithi189 ceph-mon[32756]: pgmap v19309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:49.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:49 smithi156 ceph-mon[32679]: pgmap v19309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35484.995500 secs 2024-04-27T04:09:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:50 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34787.961506 secs 2024-04-27T04:09:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35484.995500 secs 2024-04-27T04:09:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:50 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34787.961506 secs 2024-04-27T04:09:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35484.995500 secs 2024-04-27T04:09:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:50 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34787.961506 secs 2024-04-27T04:09:51.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:51 smithi092 ceph-mon[29156]: pgmap v19310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:51.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:51 smithi189 ceph-mon[32756]: pgmap v19310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:51.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:51 smithi156 ceph-mon[32679]: pgmap v19310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:53.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:53 smithi092 ceph-mon[29156]: pgmap v19311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:53.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:53 smithi189 ceph-mon[32756]: pgmap v19311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:53.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:53 smithi156 ceph-mon[32679]: pgmap v19311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:09:54.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34792.961629 secs 2024-04-27T04:09:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34792.961629 secs 2024-04-27T04:09:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34792.961629 secs 2024-04-27T04:09:55.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35489.995632 secs 2024-04-27T04:09:55.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:55 smithi189 ceph-mon[32756]: pgmap v19312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35489.995632 secs 2024-04-27T04:09:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:55 smithi156 ceph-mon[32679]: pgmap v19312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:55.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35489.995632 secs 2024-04-27T04:09:55.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:55 smithi092 ceph-mon[29156]: pgmap v19312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:09:57.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:57 smithi092 ceph-mon[29156]: pgmap v19313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:57.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:57 smithi189 ceph-mon[32756]: pgmap v19313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:57.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:57 smithi156 ceph-mon[32679]: pgmap v19313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:09:59.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:09:59 smithi092 ceph-mon[29156]: pgmap v19314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:59.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:09:59 smithi189 ceph-mon[32756]: pgmap v19314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:09:59.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:09:59 smithi156 ceph-mon[32679]: pgmap v19314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35494.995743 secs 2024-04-27T04:10:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34797.961783 secs 2024-04-27T04:10:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:10:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: pgmap v19315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: pgmap v19316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:10:00.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:10:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35494.995743 secs 2024-04-27T04:10:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34797.961783 secs 2024-04-27T04:10:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: pgmap v19315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: pgmap v19316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:10:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:10:00.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35494.995743 secs 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34797.961783 secs 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: pgmap v19315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: pgmap v19316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:10:00.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:10:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:03 smithi189 ceph-mon[32756]: pgmap v19317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:03 smithi156 ceph-mon[32679]: pgmap v19317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:03.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:03 smithi092 ceph-mon[29156]: pgmap v19317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:10:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35499.995856 secs 2024-04-27T04:10:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:05 smithi189 ceph-mon[32756]: pgmap v19318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34802.961900 secs 2024-04-27T04:10:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35499.995856 secs 2024-04-27T04:10:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:05 smithi156 ceph-mon[32679]: pgmap v19318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34802.961900 secs 2024-04-27T04:10:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35499.995856 secs 2024-04-27T04:10:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:05 smithi092 ceph-mon[29156]: pgmap v19318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34802.961900 secs 2024-04-27T04:10:07.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:07 smithi189 ceph-mon[32756]: pgmap v19319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:07.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:07 smithi156 ceph-mon[32679]: pgmap v19319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:07.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:07 smithi092 ceph-mon[29156]: pgmap v19319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:09 smithi189 ceph-mon[32756]: pgmap v19320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T04:10:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:09 smithi156 ceph-mon[32679]: pgmap v19320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T04:10:09.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:09 smithi092 ceph-mon[29156]: pgmap v19320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T04:10:10.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35504.995974 secs 2024-04-27T04:10:10.334 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:10 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34807.962020 secs 2024-04-27T04:10:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35504.995974 secs 2024-04-27T04:10:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:10 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34807.962020 secs 2024-04-27T04:10:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35504.995974 secs 2024-04-27T04:10:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:10 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34807.962020 secs 2024-04-27T04:10:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:11 smithi189 ceph-mon[32756]: pgmap v19321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:10:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:11 smithi156 ceph-mon[32679]: pgmap v19321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:10:11.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:11 smithi092 ceph-mon[29156]: pgmap v19321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:10:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:13 smithi189 ceph-mon[32756]: pgmap v19322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:10:13.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:13 smithi156 ceph-mon[32679]: pgmap v19322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:10:13.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:13 smithi092 ceph-mon[29156]: pgmap v19322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:10:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35509.996095 secs 2024-04-27T04:10:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:15 smithi189 ceph-mon[32756]: pgmap v19323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:15 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34812.962169 secs 2024-04-27T04:10:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35509.996095 secs 2024-04-27T04:10:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:15 smithi156 ceph-mon[32679]: pgmap v19323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:15 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34812.962169 secs 2024-04-27T04:10:15.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35509.996095 secs 2024-04-27T04:10:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:15 smithi092 ceph-mon[29156]: pgmap v19323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:10:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:15 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34812.962169 secs 2024-04-27T04:10:17.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:17 smithi189 ceph-mon[32756]: pgmap v19324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:17.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:17 smithi156 ceph-mon[32679]: pgmap v19324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:17.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:17 smithi092 ceph-mon[29156]: pgmap v19324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:19 smithi189 ceph-mon[32756]: pgmap v19325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:19.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:19 smithi156 ceph-mon[32679]: pgmap v19325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:19.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:19 smithi092 ceph-mon[29156]: pgmap v19325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35514.996211 secs 2024-04-27T04:10:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:20 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34817.962247 secs 2024-04-27T04:10:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35514.996211 secs 2024-04-27T04:10:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:20 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34817.962247 secs 2024-04-27T04:10:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35514.996211 secs 2024-04-27T04:10:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:20 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34817.962247 secs 2024-04-27T04:10:21.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:21 smithi189 ceph-mon[32756]: pgmap v19326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:21.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:21 smithi156 ceph-mon[32679]: pgmap v19326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:21.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:21 smithi092 ceph-mon[29156]: pgmap v19326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:23.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:23 smithi189 ceph-mon[32756]: pgmap v19327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:23.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:23 smithi156 ceph-mon[32679]: pgmap v19327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:23.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:23 smithi092 ceph-mon[29156]: pgmap v19327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35519.996347 secs 2024-04-27T04:10:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:25 smithi189 ceph-mon[32756]: pgmap v19328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:25 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34822.962367 secs 2024-04-27T04:10:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35519.996347 secs 2024-04-27T04:10:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:25 smithi156 ceph-mon[32679]: pgmap v19328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:25 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34822.962367 secs 2024-04-27T04:10:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35519.996347 secs 2024-04-27T04:10:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:25 smithi092 ceph-mon[29156]: pgmap v19328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:25 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34822.962367 secs 2024-04-27T04:10:27.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:27 smithi189 ceph-mon[32756]: pgmap v19329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:27.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:27 smithi156 ceph-mon[32679]: pgmap v19329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:27.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:27 smithi092 ceph-mon[29156]: pgmap v19329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:29 smithi189 ceph-mon[32756]: pgmap v19330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:29.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:29 smithi156 ceph-mon[32679]: pgmap v19330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:29.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:29 smithi092 ceph-mon[29156]: pgmap v19330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35524.996465 secs 2024-04-27T04:10:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:30 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34827.962447 secs 2024-04-27T04:10:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35524.996465 secs 2024-04-27T04:10:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:30 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34827.962447 secs 2024-04-27T04:10:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35524.996465 secs 2024-04-27T04:10:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:30 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34827.962447 secs 2024-04-27T04:10:31.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:31 smithi189 ceph-mon[32756]: pgmap v19331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:31.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:31 smithi156 ceph-mon[32679]: pgmap v19331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:31.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:31 smithi092 ceph-mon[29156]: pgmap v19331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:33 smithi189 ceph-mon[32756]: pgmap v19332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:33.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:33 smithi156 ceph-mon[32679]: pgmap v19332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:33.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:33 smithi092 ceph-mon[29156]: pgmap v19332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35529.996571 secs 2024-04-27T04:10:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:35 smithi189 ceph-mon[32756]: pgmap v19333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:35 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34832.962518 secs 2024-04-27T04:10:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35529.996571 secs 2024-04-27T04:10:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:35 smithi156 ceph-mon[32679]: pgmap v19333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:35 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34832.962518 secs 2024-04-27T04:10:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35529.996571 secs 2024-04-27T04:10:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:35 smithi092 ceph-mon[29156]: pgmap v19333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:35 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34832.962518 secs 2024-04-27T04:10:37.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:37 smithi189 ceph-mon[32756]: pgmap v19334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:37.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:37 smithi156 ceph-mon[32679]: pgmap v19334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:37.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:37 smithi092 ceph-mon[29156]: pgmap v19334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:39 smithi189 ceph-mon[32756]: pgmap v19335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:39.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:39 smithi156 ceph-mon[32679]: pgmap v19335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:39.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:39 smithi092 ceph-mon[29156]: pgmap v19335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35534.996686 secs 2024-04-27T04:10:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:40 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34837.962627 secs 2024-04-27T04:10:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35534.996686 secs 2024-04-27T04:10:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:40 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34837.962627 secs 2024-04-27T04:10:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35534.996686 secs 2024-04-27T04:10:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:40 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34837.962627 secs 2024-04-27T04:10:41.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:41 smithi189 ceph-mon[32756]: pgmap v19336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:41.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:41 smithi156 ceph-mon[32679]: pgmap v19336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:41.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:41 smithi092 ceph-mon[29156]: pgmap v19336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:43.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:43 smithi189 ceph-mon[32756]: pgmap v19337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:43.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:43 smithi156 ceph-mon[32679]: pgmap v19337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:43.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:43 smithi092 ceph-mon[29156]: pgmap v19337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35539.996782 secs 2024-04-27T04:10:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:45 smithi189 ceph-mon[32756]: pgmap v19338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:45 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 34842.962718 secs 2024-04-27T04:10:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:45 smithi189 ceph-mon[32756]: slow request 363.898101 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:10:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35539.996782 secs 2024-04-27T04:10:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:45 smithi156 ceph-mon[32679]: pgmap v19338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:45 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 34842.962718 secs 2024-04-27T04:10:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:45 smithi156 ceph-mon[32679]: slow request 363.898101 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:10:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35539.996782 secs 2024-04-27T04:10:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:45 smithi092 ceph-mon[29156]: pgmap v19338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:45 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 34842.962718 secs 2024-04-27T04:10:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:45 smithi092 ceph-mon[29156]: slow request 363.898101 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:10:47.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:47 smithi189 ceph-mon[32756]: pgmap v19339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:47.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:47 smithi156 ceph-mon[32679]: pgmap v19339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:47.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:47 smithi092 ceph-mon[29156]: pgmap v19339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:49 smithi189 ceph-mon[32756]: pgmap v19340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:49 smithi156 ceph-mon[32679]: pgmap v19340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:49.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:49 smithi092 ceph-mon[29156]: pgmap v19340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35544.996899 secs 2024-04-27T04:10:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:50 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34847.962768 secs 2024-04-27T04:10:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35544.996899 secs 2024-04-27T04:10:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:50 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34847.962768 secs 2024-04-27T04:10:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35544.996899 secs 2024-04-27T04:10:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:50 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34847.962768 secs 2024-04-27T04:10:51.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:51 smithi156 ceph-mon[32679]: pgmap v19341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:51.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:51 smithi092 ceph-mon[29156]: pgmap v19341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:51.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:51 smithi189 ceph-mon[32756]: pgmap v19341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:53.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:53 smithi156 ceph-mon[32679]: pgmap v19342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:53.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:53 smithi092 ceph-mon[29156]: pgmap v19342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:53.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:53 smithi189 ceph-mon[32756]: pgmap v19342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35549.997006 secs 2024-04-27T04:10:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:55 smithi156 ceph-mon[32679]: pgmap v19343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:55 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34852.962905 secs 2024-04-27T04:10:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35549.997006 secs 2024-04-27T04:10:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:55 smithi092 ceph-mon[29156]: pgmap v19343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:55.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:55 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34852.962905 secs 2024-04-27T04:10:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35549.997006 secs 2024-04-27T04:10:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:55 smithi189 ceph-mon[32756]: pgmap v19343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:10:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:55 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34852.962905 secs 2024-04-27T04:10:57.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:57 smithi156 ceph-mon[32679]: pgmap v19344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:57.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:57 smithi092 ceph-mon[29156]: pgmap v19344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:57.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:57 smithi189 ceph-mon[32756]: pgmap v19344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:10:59 smithi156 ceph-mon[32679]: pgmap v19345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:59.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:10:59 smithi092 ceph-mon[29156]: pgmap v19345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:10:59.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:10:59 smithi189 ceph-mon[32756]: pgmap v19345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35554.997117 secs 2024-04-27T04:11:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34857.963066 secs 2024-04-27T04:11:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:11:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35554.997117 secs 2024-04-27T04:11:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34857.963066 secs 2024-04-27T04:11:00.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:11:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35554.997117 secs 2024-04-27T04:11:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34857.963066 secs 2024-04-27T04:11:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:11:01.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:01 smithi156 ceph-mon[32679]: pgmap v19346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:01.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:11:01.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:11:01.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:11:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:01 smithi092 ceph-mon[29156]: pgmap v19346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:11:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:11:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:11:01.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:01 smithi189 ceph-mon[32756]: pgmap v19346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:01.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:11:01.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:11:01.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:11:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:02 smithi156 ceph-mon[32679]: pgmap v19347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:02 smithi156 ceph-mon[32679]: pgmap v19348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:02.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:02 smithi092 ceph-mon[29156]: pgmap v19347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:02.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:02 smithi092 ceph-mon[29156]: pgmap v19348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:02.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:02 smithi189 ceph-mon[32756]: pgmap v19347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:02.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:02 smithi189 ceph-mon[32756]: pgmap v19348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:04.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:04 smithi156 ceph-mon[32679]: pgmap v19349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:11:04.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:04 smithi092 ceph-mon[29156]: pgmap v19349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:11:04.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:04 smithi189 ceph-mon[32756]: pgmap v19349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:11:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35559.997236 secs 2024-04-27T04:11:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34862.963213 secs 2024-04-27T04:11:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35559.997236 secs 2024-04-27T04:11:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34862.963213 secs 2024-04-27T04:11:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35559.997236 secs 2024-04-27T04:11:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34862.963213 secs 2024-04-27T04:11:06.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:06 smithi156 ceph-mon[32679]: pgmap v19350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:06.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:06 smithi092 ceph-mon[29156]: pgmap v19350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:06.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:06 smithi189 ceph-mon[32756]: pgmap v19350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:07.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:07 smithi092 ceph-mon[29156]: pgmap v19351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:07.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:07 smithi189 ceph-mon[32756]: pgmap v19351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:07.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:07 smithi156 ceph-mon[32679]: pgmap v19351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:11:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:09 smithi189 ceph-mon[32756]: pgmap v19352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:11:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 35564.997375 secs 2024-04-27T04:11:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:09 smithi189 ceph-mon[32756]: slow request 5760.098431 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:11:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:09 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34867.963330 secs 2024-04-27T04:11:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:09 smithi156 ceph-mon[32679]: pgmap v19352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:11:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 35564.997375 secs 2024-04-27T04:11:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:09 smithi156 ceph-mon[32679]: slow request 5760.098431 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:11:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:09 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34867.963330 secs 2024-04-27T04:11:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:09 smithi092 ceph-mon[29156]: pgmap v19352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:11:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 35564.997375 secs 2024-04-27T04:11:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:09 smithi092 ceph-mon[29156]: slow request 5760.098431 seconds old, received at 2024-04-27T02:35:08.814685+0000: client_request(client.17403:1 getattr pAsLsXsFs #0x1 2024-04-27T02:35:08.808102+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:11:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:09 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34867.963330 secs 2024-04-27T04:11:12.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:11 smithi189 ceph-mon[32756]: pgmap v19353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:12.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:11 smithi156 ceph-mon[32679]: pgmap v19353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:12.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:11 smithi092 ceph-mon[29156]: pgmap v19353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:11:14.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:13 smithi189 ceph-mon[32756]: pgmap v19354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:14.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:13 smithi156 ceph-mon[32679]: pgmap v19354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:14.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:13 smithi092 ceph-mon[29156]: pgmap v19354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35569.997510 secs 2024-04-27T04:11:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:14 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34872.963423 secs 2024-04-27T04:11:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35569.997510 secs 2024-04-27T04:11:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:14 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34872.963423 secs 2024-04-27T04:11:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35569.997510 secs 2024-04-27T04:11:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:14 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34872.963423 secs 2024-04-27T04:11:16.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:15 smithi189 ceph-mon[32756]: pgmap v19355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:15 smithi156 ceph-mon[32679]: pgmap v19355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:16.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:15 smithi092 ceph-mon[29156]: pgmap v19355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:17 smithi189 ceph-mon[32756]: pgmap v19356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:18.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:17 smithi156 ceph-mon[32679]: pgmap v19356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:18.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:17 smithi092 ceph-mon[29156]: pgmap v19356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:11:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:19 smithi092 ceph-mon[29156]: pgmap v19357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35574.997624 secs 2024-04-27T04:11:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34877.963539 secs 2024-04-27T04:11:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:19 smithi189 ceph-mon[32756]: pgmap v19357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35574.997624 secs 2024-04-27T04:11:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34877.963539 secs 2024-04-27T04:11:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:19 smithi156 ceph-mon[32679]: pgmap v19357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:11:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35574.997624 secs 2024-04-27T04:11:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34877.963539 secs 2024-04-27T04:11:22.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:21 smithi189 ceph-mon[32756]: pgmap v19358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:22.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:21 smithi156 ceph-mon[32679]: pgmap v19358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:22.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:21 smithi092 ceph-mon[29156]: pgmap v19358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:24.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:23 smithi189 ceph-mon[32756]: pgmap v19359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:24.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:23 smithi156 ceph-mon[32679]: pgmap v19359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:24.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:23 smithi092 ceph-mon[29156]: pgmap v19359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35579.997736 secs 2024-04-27T04:11:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34882.963648 secs 2024-04-27T04:11:25.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35579.997736 secs 2024-04-27T04:11:25.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34882.963648 secs 2024-04-27T04:11:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35579.997736 secs 2024-04-27T04:11:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34882.963648 secs 2024-04-27T04:11:26.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:25 smithi189 ceph-mon[32756]: pgmap v19360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:26.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:25 smithi156 ceph-mon[32679]: pgmap v19360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:26.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:25 smithi092 ceph-mon[29156]: pgmap v19360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:28.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:27 smithi189 ceph-mon[32756]: pgmap v19361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:28.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:27 smithi156 ceph-mon[32679]: pgmap v19361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:28.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:27 smithi092 ceph-mon[29156]: pgmap v19361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:29 smithi189 ceph-mon[32756]: pgmap v19362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35584.997873 secs 2024-04-27T04:11:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34887.963798 secs 2024-04-27T04:11:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:29 smithi156 ceph-mon[32679]: pgmap v19362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35584.997873 secs 2024-04-27T04:11:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34887.963798 secs 2024-04-27T04:11:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:29 smithi092 ceph-mon[29156]: pgmap v19362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35584.997873 secs 2024-04-27T04:11:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34887.963798 secs 2024-04-27T04:11:32.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:31 smithi189 ceph-mon[32756]: pgmap v19363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:32.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:31 smithi156 ceph-mon[32679]: pgmap v19363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:32.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:31 smithi092 ceph-mon[29156]: pgmap v19363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:34.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:33 smithi189 ceph-mon[32756]: pgmap v19364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:34.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:33 smithi156 ceph-mon[32679]: pgmap v19364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:34.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:33 smithi092 ceph-mon[29156]: pgmap v19364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35589.997987 secs 2024-04-27T04:11:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34892.963894 secs 2024-04-27T04:11:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35589.997987 secs 2024-04-27T04:11:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34892.963894 secs 2024-04-27T04:11:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35589.997987 secs 2024-04-27T04:11:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34892.963894 secs 2024-04-27T04:11:36.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:35 smithi189 ceph-mon[32756]: pgmap v19365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:36.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:35 smithi156 ceph-mon[32679]: pgmap v19365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:36.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:35 smithi092 ceph-mon[29156]: pgmap v19365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:38.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:37 smithi189 ceph-mon[32756]: pgmap v19366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:38.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:37 smithi156 ceph-mon[32679]: pgmap v19366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:38.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:37 smithi092 ceph-mon[29156]: pgmap v19366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:39 smithi189 ceph-mon[32756]: pgmap v19367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35594.998067 secs 2024-04-27T04:11:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34897.964016 secs 2024-04-27T04:11:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:39 smithi156 ceph-mon[32679]: pgmap v19367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35594.998067 secs 2024-04-27T04:11:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34897.964016 secs 2024-04-27T04:11:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:39 smithi092 ceph-mon[29156]: pgmap v19367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35594.998067 secs 2024-04-27T04:11:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34897.964016 secs 2024-04-27T04:11:42.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:41 smithi156 ceph-mon[32679]: pgmap v19368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:42.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:41 smithi092 ceph-mon[29156]: pgmap v19368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:42.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:41 smithi189 ceph-mon[32756]: pgmap v19368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:44.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:43 smithi156 ceph-mon[32679]: pgmap v19369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:44.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:43 smithi092 ceph-mon[29156]: pgmap v19369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:44.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:43 smithi189 ceph-mon[32756]: pgmap v19369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35599.998144 secs 2024-04-27T04:11:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34902.964135 secs 2024-04-27T04:11:45.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35599.998144 secs 2024-04-27T04:11:45.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34902.964135 secs 2024-04-27T04:11:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35599.998144 secs 2024-04-27T04:11:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34902.964135 secs 2024-04-27T04:11:46.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:45 smithi156 ceph-mon[32679]: pgmap v19370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:46.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:45 smithi092 ceph-mon[29156]: pgmap v19370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:46.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:45 smithi189 ceph-mon[32756]: pgmap v19370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:48.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:47 smithi156 ceph-mon[32679]: pgmap v19371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:48.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:47 smithi092 ceph-mon[29156]: pgmap v19371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:47 smithi189 ceph-mon[32756]: pgmap v19371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:49 smithi156 ceph-mon[32679]: pgmap v19372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35604.998266 secs 2024-04-27T04:11:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34907.964270 secs 2024-04-27T04:11:50.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:49 smithi092 ceph-mon[29156]: pgmap v19372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:50.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35604.998266 secs 2024-04-27T04:11:50.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34907.964270 secs 2024-04-27T04:11:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:49 smithi189 ceph-mon[32756]: pgmap v19372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35604.998266 secs 2024-04-27T04:11:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34907.964270 secs 2024-04-27T04:11:52.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:51 smithi156 ceph-mon[32679]: pgmap v19373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:52.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:51 smithi092 ceph-mon[29156]: pgmap v19373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:52.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:51 smithi189 ceph-mon[32756]: pgmap v19373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:54.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:53 smithi156 ceph-mon[32679]: pgmap v19374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:54.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:53 smithi092 ceph-mon[29156]: pgmap v19374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:54.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:53 smithi189 ceph-mon[32756]: pgmap v19374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35609.998322 secs 2024-04-27T04:11:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34912.964384 secs 2024-04-27T04:11:55.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35609.998322 secs 2024-04-27T04:11:55.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34912.964384 secs 2024-04-27T04:11:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35609.998322 secs 2024-04-27T04:11:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34912.964384 secs 2024-04-27T04:11:56.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:55 smithi156 ceph-mon[32679]: pgmap v19375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:56.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:55 smithi092 ceph-mon[29156]: pgmap v19375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:56.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:55 smithi189 ceph-mon[32756]: pgmap v19375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:11:58.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:57 smithi156 ceph-mon[32679]: pgmap v19376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:58.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:57 smithi092 ceph-mon[29156]: pgmap v19376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:11:58.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:57 smithi189 ceph-mon[32756]: pgmap v19376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:59 smithi156 ceph-mon[32679]: pgmap v19377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35614.998438 secs 2024-04-27T04:12:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:11:59 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34917.964463 secs 2024-04-27T04:12:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:59 smithi092 ceph-mon[29156]: pgmap v19377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35614.998438 secs 2024-04-27T04:12:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:11:59 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34917.964463 secs 2024-04-27T04:12:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:59 smithi189 ceph-mon[32756]: pgmap v19377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35614.998438 secs 2024-04-27T04:12:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:11:59 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34917.964463 secs 2024-04-27T04:12:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:12:01.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:12:01.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:12:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:01 smithi092 ceph-mon[29156]: pgmap v19378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:12:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:12:02.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:12:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:01 smithi189 ceph-mon[32756]: pgmap v19378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:12:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:12:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:12:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:01 smithi156 ceph-mon[32679]: pgmap v19378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:12:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:12:02.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:12:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:02 smithi092 ceph-mon[29156]: pgmap v19379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:12:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:02 smithi092 ceph-mon[29156]: pgmap v19380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:02 smithi189 ceph-mon[32756]: pgmap v19379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:12:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:02 smithi189 ceph-mon[32756]: pgmap v19380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:02 smithi156 ceph-mon[32679]: pgmap v19379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:12:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:02 smithi156 ceph-mon[32679]: pgmap v19380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:04 smithi092 ceph-mon[29156]: pgmap v19381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:12:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35619.998577 secs 2024-04-27T04:12:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:04 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34922.964555 secs 2024-04-27T04:12:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:04 smithi189 ceph-mon[32756]: pgmap v19381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:12:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35619.998577 secs 2024-04-27T04:12:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:04 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34922.964555 secs 2024-04-27T04:12:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:04 smithi156 ceph-mon[32679]: pgmap v19381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:12:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35619.998577 secs 2024-04-27T04:12:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:04 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34922.964555 secs 2024-04-27T04:12:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:06 smithi092 ceph-mon[29156]: pgmap v19382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:07.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:06 smithi189 ceph-mon[32756]: pgmap v19382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:07.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:06 smithi156 ceph-mon[32679]: pgmap v19382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:09.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:08 smithi092 ceph-mon[29156]: pgmap v19383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:12:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:08 smithi189 ceph-mon[32756]: pgmap v19383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:12:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:08 smithi156 ceph-mon[32679]: pgmap v19383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:12:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35624.998698 secs 2024-04-27T04:12:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:09 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 34927.964676 secs 2024-04-27T04:12:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:09 smithi092 ceph-mon[29156]: slow request 23044.946167 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35624.998698 secs 2024-04-27T04:12:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:09 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 34927.964676 secs 2024-04-27T04:12:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:09 smithi189 ceph-mon[32756]: slow request 23044.946167 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35624.998698 secs 2024-04-27T04:12:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:09 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 34927.964676 secs 2024-04-27T04:12:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:09 smithi156 ceph-mon[32679]: slow request 23044.946167 seconds old, received at 2024-04-26T21:48:04.164543+0000: client_request(client.17076:1 getattr pAsLsXsFs #0x1 2024-04-26T21:48:04.157721+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:11.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:10 smithi092 ceph-mon[29156]: pgmap v19384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:11.287 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:10 smithi189 ceph-mon[32756]: pgmap v19384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:11.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:10 smithi156 ceph-mon[32679]: pgmap v19384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:12:13.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:12 smithi092 ceph-mon[29156]: pgmap v19385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:12:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:12 smithi189 ceph-mon[32756]: pgmap v19385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:12:13.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:12 smithi156 ceph-mon[32679]: pgmap v19385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:12:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:14 smithi092 ceph-mon[29156]: pgmap v19386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35629.998759 secs 2024-04-27T04:12:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:14 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34932.964819 secs 2024-04-27T04:12:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:14 smithi189 ceph-mon[32756]: pgmap v19386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35629.998759 secs 2024-04-27T04:12:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:14 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34932.964819 secs 2024-04-27T04:12:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:14 smithi156 ceph-mon[32679]: pgmap v19386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35629.998759 secs 2024-04-27T04:12:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:14 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34932.964819 secs 2024-04-27T04:12:17.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:16 smithi092 ceph-mon[29156]: pgmap v19387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:17.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:16 smithi189 ceph-mon[32756]: pgmap v19387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:17.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:16 smithi156 ceph-mon[32679]: pgmap v19387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:18.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:18 smithi189 ceph-mon[32756]: pgmap v19388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:18.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:18 smithi156 ceph-mon[32679]: pgmap v19388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:18 smithi092 ceph-mon[29156]: pgmap v19388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:19.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34937.964958 secs 2024-04-27T04:12:19.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34937.964958 secs 2024-04-27T04:12:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34937.964958 secs 2024-04-27T04:12:20.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35634.998856 secs 2024-04-27T04:12:20.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:20 smithi189 ceph-mon[32756]: pgmap v19389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35634.998856 secs 2024-04-27T04:12:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:20 smithi156 ceph-mon[32679]: pgmap v19389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35634.998856 secs 2024-04-27T04:12:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:20 smithi092 ceph-mon[29156]: pgmap v19389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:22.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:22 smithi189 ceph-mon[32756]: pgmap v19390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:22.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:22 smithi156 ceph-mon[32679]: pgmap v19390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:22.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:22 smithi092 ceph-mon[29156]: pgmap v19390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:24.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:24 smithi189 ceph-mon[32756]: pgmap v19391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:24.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34942.965077 secs 2024-04-27T04:12:24.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:24 smithi156 ceph-mon[32679]: pgmap v19391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:24.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34942.965077 secs 2024-04-27T04:12:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:24 smithi092 ceph-mon[29156]: pgmap v19391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34942.965077 secs 2024-04-27T04:12:25.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35639.998974 secs 2024-04-27T04:12:25.893 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35639.998974 secs 2024-04-27T04:12:25.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35639.998974 secs 2024-04-27T04:12:26.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:26 smithi189 ceph-mon[32756]: pgmap v19392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:26.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:26 smithi156 ceph-mon[32679]: pgmap v19392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:26.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:26 smithi092 ceph-mon[29156]: pgmap v19392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:28.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:28 smithi189 ceph-mon[32756]: pgmap v19393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:28.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:28 smithi156 ceph-mon[32679]: pgmap v19393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:28.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:28 smithi092 ceph-mon[29156]: pgmap v19393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:29.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35644.999100 secs 2024-04-27T04:12:29.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34947.965201 secs 2024-04-27T04:12:29.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35644.999100 secs 2024-04-27T04:12:29.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34947.965201 secs 2024-04-27T04:12:29.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35644.999100 secs 2024-04-27T04:12:29.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34947.965201 secs 2024-04-27T04:12:30.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:30 smithi189 ceph-mon[32756]: pgmap v19394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:30.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:30 smithi156 ceph-mon[32679]: pgmap v19394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:30.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:30 smithi092 ceph-mon[29156]: pgmap v19394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:32.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:32 smithi156 ceph-mon[32679]: pgmap v19395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:32.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:32 smithi092 ceph-mon[29156]: pgmap v19395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:33.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:32 smithi189 ceph-mon[32756]: pgmap v19395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:34 smithi156 ceph-mon[32679]: pgmap v19396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35649.999202 secs 2024-04-27T04:12:34.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34952.965334 secs 2024-04-27T04:12:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:34 smithi092 ceph-mon[29156]: pgmap v19396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35649.999202 secs 2024-04-27T04:12:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34952.965334 secs 2024-04-27T04:12:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:34 smithi189 ceph-mon[32756]: pgmap v19396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35649.999202 secs 2024-04-27T04:12:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34952.965334 secs 2024-04-27T04:12:36.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:36 smithi156 ceph-mon[32679]: pgmap v19397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:36.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:36 smithi092 ceph-mon[29156]: pgmap v19397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:37.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:36 smithi189 ceph-mon[32756]: pgmap v19397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:38.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:38 smithi156 ceph-mon[32679]: pgmap v19398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:38.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:38 smithi092 ceph-mon[29156]: pgmap v19398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:39.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:38 smithi189 ceph-mon[32756]: pgmap v19398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:39.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:39 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 35654.999325 secs 2024-04-27T04:12:39.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:39 smithi156 ceph-mon[32679]: slow request 11521.695470 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:39.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34957.965450 secs 2024-04-27T04:12:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:39 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 35654.999325 secs 2024-04-27T04:12:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:39 smithi092 ceph-mon[29156]: slow request 11521.695470 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34957.965450 secs 2024-04-27T04:12:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:39 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 35654.999325 secs 2024-04-27T04:12:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:39 smithi189 ceph-mon[32756]: slow request 11521.695470 seconds old, received at 2024-04-27T01:00:37.219596+0000: client_request(client.17295:1 getattr pAsLsXsFs #0x1 2024-04-27T01:00:37.216118+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:12:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34957.965450 secs 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.875+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.875+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.875+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.875+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.876+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 274 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.876+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:12:40.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.876+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T04:12:40.876 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:12:40.876+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 275 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:12:40.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:40 smithi156 ceph-mon[32679]: pgmap v19399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:40.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:40 smithi092 ceph-mon[29156]: pgmap v19399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:41.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:40 smithi189 ceph-mon[32756]: pgmap v19399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:42.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:42 smithi156 ceph-mon[32679]: pgmap v19400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:42.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:42 smithi092 ceph-mon[29156]: pgmap v19400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:43.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:42 smithi189 ceph-mon[32756]: pgmap v19400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:44 smithi156 ceph-mon[32679]: pgmap v19401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35659.999445 secs 2024-04-27T04:12:44.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34962.965530 secs 2024-04-27T04:12:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:44 smithi092 ceph-mon[29156]: pgmap v19401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35659.999445 secs 2024-04-27T04:12:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34962.965530 secs 2024-04-27T04:12:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:44 smithi189 ceph-mon[32756]: pgmap v19401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35659.999445 secs 2024-04-27T04:12:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34962.965530 secs 2024-04-27T04:12:46.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:46 smithi156 ceph-mon[32679]: pgmap v19402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:46.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:46 smithi092 ceph-mon[29156]: pgmap v19402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:47.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:46 smithi189 ceph-mon[32756]: pgmap v19402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:48.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:48 smithi156 ceph-mon[32679]: pgmap v19403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:48.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:48 smithi092 ceph-mon[29156]: pgmap v19403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:49.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:48 smithi189 ceph-mon[32756]: pgmap v19403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:49.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35664.999566 secs 2024-04-27T04:12:49.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34967.965642 secs 2024-04-27T04:12:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35664.999566 secs 2024-04-27T04:12:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34967.965642 secs 2024-04-27T04:12:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35664.999566 secs 2024-04-27T04:12:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34967.965642 secs 2024-04-27T04:12:50.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:50 smithi156 ceph-mon[32679]: pgmap v19404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:50.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:50 smithi092 ceph-mon[29156]: pgmap v19404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:51.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:50 smithi189 ceph-mon[32756]: pgmap v19404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:52.923 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:52 smithi092 ceph-mon[29156]: pgmap v19405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:52.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:52 smithi156 ceph-mon[32679]: pgmap v19405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:53.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:52 smithi189 ceph-mon[32756]: pgmap v19405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:54 smithi156 ceph-mon[32679]: pgmap v19406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35669.999698 secs 2024-04-27T04:12:54.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34972.965761 secs 2024-04-27T04:12:54.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:54 smithi092 ceph-mon[29156]: pgmap v19406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35669.999698 secs 2024-04-27T04:12:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34972.965761 secs 2024-04-27T04:12:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:54 smithi189 ceph-mon[32756]: pgmap v19406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:12:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35669.999698 secs 2024-04-27T04:12:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34972.965761 secs 2024-04-27T04:12:56.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:56 smithi156 ceph-mon[32679]: pgmap v19407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:56.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:56 smithi092 ceph-mon[29156]: pgmap v19407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:57.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:56 smithi189 ceph-mon[32756]: pgmap v19407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:58.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:58 smithi156 ceph-mon[32679]: pgmap v19408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:58.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:58 smithi092 ceph-mon[29156]: pgmap v19408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:58 smithi189 ceph-mon[32756]: pgmap v19408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:12:59.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35674.999847 secs 2024-04-27T04:12:59.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:12:59 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34977.965901 secs 2024-04-27T04:13:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35674.999847 secs 2024-04-27T04:13:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:12:59 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34977.965901 secs 2024-04-27T04:13:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35674.999847 secs 2024-04-27T04:13:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:12:59 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34977.965901 secs 2024-04-27T04:13:00.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:00 smithi092 ceph-mon[29156]: pgmap v19409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:01.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:00 smithi189 ceph-mon[32756]: pgmap v19409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:00 smithi156 ceph-mon[32679]: pgmap v19409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:01.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:13:02.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:13:02.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: pgmap v19410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: pgmap v19410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: pgmap v19410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:03.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: pgmap v19411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35679.999911 secs 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34982.965965 secs 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: pgmap v19411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35679.999911 secs 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34982.965965 secs 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: pgmap v19411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35679.999911 secs 2024-04-27T04:13:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34982.965965 secs 2024-04-27T04:13:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:05.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: pgmap v19412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:13:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:13:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: pgmap v19413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: pgmap v19414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: pgmap v19412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: pgmap v19413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: pgmap v19414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: pgmap v19412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: pgmap v19413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: pgmap v19414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:13:08.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:08 smithi156 ceph-mon[32679]: pgmap v19415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:13:08.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:08 smithi092 ceph-mon[29156]: pgmap v19415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:13:09.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:08 smithi189 ceph-mon[32756]: pgmap v19415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:13:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35685.000030 secs 2024-04-27T04:13:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:09 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34987.966080 secs 2024-04-27T04:13:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35685.000030 secs 2024-04-27T04:13:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:09 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34987.966080 secs 2024-04-27T04:13:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35685.000030 secs 2024-04-27T04:13:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:09 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34987.966080 secs 2024-04-27T04:13:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:10 smithi092 ceph-mon[29156]: pgmap v19416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:11.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:10 smithi189 ceph-mon[32756]: pgmap v19416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:11.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:10 smithi156 ceph-mon[32679]: pgmap v19416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:12.984 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:12 smithi156 ceph-mon[32679]: pgmap v19417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:13:12.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:12 smithi092 ceph-mon[29156]: pgmap v19417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:13:13.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:12 smithi189 ceph-mon[32756]: pgmap v19417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:13:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:14 smithi092 ceph-mon[29156]: pgmap v19418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35690.000115 secs 2024-04-27T04:13:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:14 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34992.966195 secs 2024-04-27T04:13:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:14 smithi189 ceph-mon[32756]: pgmap v19418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35690.000115 secs 2024-04-27T04:13:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:14 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34992.966195 secs 2024-04-27T04:13:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:14 smithi156 ceph-mon[32679]: pgmap v19418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35690.000115 secs 2024-04-27T04:13:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:14 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34992.966195 secs 2024-04-27T04:13:16.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:16 smithi092 ceph-mon[29156]: pgmap v19419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:17.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:16 smithi189 ceph-mon[32756]: pgmap v19419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:17.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:16 smithi156 ceph-mon[32679]: pgmap v19419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:13:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:18 smithi092 ceph-mon[29156]: pgmap v19420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:19.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:18 smithi189 ceph-mon[32756]: pgmap v19420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:19.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:18 smithi156 ceph-mon[32679]: pgmap v19420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:19.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35695.000180 secs 2024-04-27T04:13:19.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 34997.966255 secs 2024-04-27T04:13:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35695.000180 secs 2024-04-27T04:13:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 34997.966255 secs 2024-04-27T04:13:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35695.000180 secs 2024-04-27T04:13:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 34997.966255 secs 2024-04-27T04:13:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:20 smithi092 ceph-mon[29156]: pgmap v19421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:21.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:20 smithi189 ceph-mon[32756]: pgmap v19421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:21.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:20 smithi156 ceph-mon[32679]: pgmap v19421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:22.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:22 smithi092 ceph-mon[29156]: pgmap v19422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:23.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:22 smithi189 ceph-mon[32756]: pgmap v19422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:23.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:22 smithi156 ceph-mon[32679]: pgmap v19422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:24 smithi092 ceph-mon[29156]: pgmap v19423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35700.000311 secs 2024-04-27T04:13:24.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35002.966391 secs 2024-04-27T04:13:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:24 smithi189 ceph-mon[32756]: pgmap v19423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35700.000311 secs 2024-04-27T04:13:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35002.966391 secs 2024-04-27T04:13:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:24 smithi156 ceph-mon[32679]: pgmap v19423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35700.000311 secs 2024-04-27T04:13:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35002.966391 secs 2024-04-27T04:13:26.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:26 smithi092 ceph-mon[29156]: pgmap v19424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:27.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:26 smithi189 ceph-mon[32756]: pgmap v19424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:27.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:26 smithi156 ceph-mon[32679]: pgmap v19424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:28.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:28 smithi189 ceph-mon[32756]: pgmap v19425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:28.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:28 smithi156 ceph-mon[32679]: pgmap v19425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:28.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:28 smithi092 ceph-mon[29156]: pgmap v19425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:29.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35007.966510 secs 2024-04-27T04:13:29.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35007.966510 secs 2024-04-27T04:13:29.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35007.966510 secs 2024-04-27T04:13:30.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35705.000429 secs 2024-04-27T04:13:30.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:30 smithi189 ceph-mon[32756]: pgmap v19426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:30.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35705.000429 secs 2024-04-27T04:13:30.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:30 smithi156 ceph-mon[32679]: pgmap v19426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:30.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35705.000429 secs 2024-04-27T04:13:30.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:30 smithi092 ceph-mon[29156]: pgmap v19426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:32.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:32 smithi092 ceph-mon[29156]: pgmap v19427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:33.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:32 smithi189 ceph-mon[32756]: pgmap v19427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:33.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:32 smithi156 ceph-mon[32679]: pgmap v19427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:34 smithi092 ceph-mon[29156]: pgmap v19428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35710.000556 secs 2024-04-27T04:13:34.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35012.966573 secs 2024-04-27T04:13:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:34 smithi189 ceph-mon[32756]: pgmap v19428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35710.000556 secs 2024-04-27T04:13:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35012.966573 secs 2024-04-27T04:13:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:34 smithi156 ceph-mon[32679]: pgmap v19428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35710.000556 secs 2024-04-27T04:13:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35012.966573 secs 2024-04-27T04:13:36.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:36 smithi092 ceph-mon[29156]: pgmap v19429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:37.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:36 smithi189 ceph-mon[32756]: pgmap v19429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:37.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:36 smithi156 ceph-mon[32679]: pgmap v19429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:38.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:38 smithi092 ceph-mon[29156]: pgmap v19430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:39.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:38 smithi189 ceph-mon[32756]: pgmap v19430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:39.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:38 smithi156 ceph-mon[32679]: pgmap v19430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:39.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35715.000679 secs 2024-04-27T04:13:39.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35017.966647 secs 2024-04-27T04:13:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35715.000679 secs 2024-04-27T04:13:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35017.966647 secs 2024-04-27T04:13:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35715.000679 secs 2024-04-27T04:13:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35017.966647 secs 2024-04-27T04:13:40.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:40 smithi092 ceph-mon[29156]: pgmap v19431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:41.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:40 smithi189 ceph-mon[32756]: pgmap v19431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:41.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:40 smithi156 ceph-mon[32679]: pgmap v19431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:42.984 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:42 smithi156 ceph-mon[32679]: pgmap v19432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:42.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:42 smithi092 ceph-mon[29156]: pgmap v19432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:43.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:42 smithi189 ceph-mon[32756]: pgmap v19432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:44 smithi092 ceph-mon[29156]: pgmap v19433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35720.000791 secs 2024-04-27T04:13:44.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35022.966751 secs 2024-04-27T04:13:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:44 smithi189 ceph-mon[32756]: pgmap v19433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35720.000791 secs 2024-04-27T04:13:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35022.966751 secs 2024-04-27T04:13:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:44 smithi156 ceph-mon[32679]: pgmap v19433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35720.000791 secs 2024-04-27T04:13:45.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35022.966751 secs 2024-04-27T04:13:46.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:46 smithi092 ceph-mon[29156]: pgmap v19434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:47.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:46 smithi189 ceph-mon[32756]: pgmap v19434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:47.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:46 smithi156 ceph-mon[32679]: pgmap v19434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:48.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:48 smithi092 ceph-mon[29156]: pgmap v19435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:49.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:48 smithi189 ceph-mon[32756]: pgmap v19435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:49.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:48 smithi156 ceph-mon[32679]: pgmap v19435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35725.000914 secs 2024-04-27T04:13:49.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35027.966845 secs 2024-04-27T04:13:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35725.000914 secs 2024-04-27T04:13:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35027.966845 secs 2024-04-27T04:13:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35725.000914 secs 2024-04-27T04:13:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35027.966845 secs 2024-04-27T04:13:50.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:50 smithi092 ceph-mon[29156]: pgmap v19436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:51.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:50 smithi189 ceph-mon[32756]: pgmap v19436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:51.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:50 smithi156 ceph-mon[32679]: pgmap v19436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:52.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:52 smithi092 ceph-mon[29156]: pgmap v19437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:53.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:52 smithi189 ceph-mon[32756]: pgmap v19437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:53.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:52 smithi156 ceph-mon[32679]: pgmap v19437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:54 smithi092 ceph-mon[29156]: pgmap v19438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35730.001043 secs 2024-04-27T04:13:54.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35032.966931 secs 2024-04-27T04:13:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:54 smithi189 ceph-mon[32756]: pgmap v19438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35730.001043 secs 2024-04-27T04:13:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35032.966931 secs 2024-04-27T04:13:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:54 smithi156 ceph-mon[32679]: pgmap v19438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:13:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35730.001043 secs 2024-04-27T04:13:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35032.966931 secs 2024-04-27T04:13:56.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:56 smithi092 ceph-mon[29156]: pgmap v19439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:57.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:56 smithi189 ceph-mon[32756]: pgmap v19439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:57.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:56 smithi156 ceph-mon[32679]: pgmap v19439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:58.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:58 smithi092 ceph-mon[29156]: pgmap v19440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:59.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:58 smithi189 ceph-mon[32756]: pgmap v19440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:13:59.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:58 smithi156 ceph-mon[32679]: pgmap v19440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35735.001126 secs 2024-04-27T04:14:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:13:59 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35037.967048 secs 2024-04-27T04:14:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35735.001126 secs 2024-04-27T04:14:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:13:59 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35037.967048 secs 2024-04-27T04:14:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35735.001126 secs 2024-04-27T04:14:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:13:59 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35037.967048 secs 2024-04-27T04:14:01.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:00 smithi189 ceph-mon[32756]: pgmap v19441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:00 smithi156 ceph-mon[32679]: pgmap v19441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:01.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:00 smithi092 ceph-mon[29156]: pgmap v19441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:03.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:02 smithi189 ceph-mon[32756]: pgmap v19442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:03.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:02 smithi156 ceph-mon[32679]: pgmap v19442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:03.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:02 smithi092 ceph-mon[29156]: pgmap v19442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:04 smithi189 ceph-mon[32756]: pgmap v19443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:14:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35740.001190 secs 2024-04-27T04:14:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:04 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35042.967114 secs 2024-04-27T04:14:05.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:04 smithi156 ceph-mon[32679]: pgmap v19443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:14:05.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35740.001190 secs 2024-04-27T04:14:05.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:04 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35042.967114 secs 2024-04-27T04:14:05.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:04 smithi092 ceph-mon[29156]: pgmap v19443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:14:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35740.001190 secs 2024-04-27T04:14:05.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:04 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35042.967114 secs 2024-04-27T04:14:06.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:05 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:14:06.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:05 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:14:06.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:05 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:14:07.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:06 smithi189 ceph-mon[32756]: pgmap v19444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:14:07.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:14:07.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:14:07.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:14:07.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:06 smithi156 ceph-mon[32679]: pgmap v19444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:14:07.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:14:07.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:14:07.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:14:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:06 smithi092 ceph-mon[29156]: pgmap v19444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:14:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:14:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:14:07.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:14:08.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:07 smithi189 ceph-mon[32756]: pgmap v19445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:14:08.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:07 smithi189 ceph-mon[32756]: pgmap v19446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:07 smithi156 ceph-mon[32679]: pgmap v19445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:14:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:07 smithi156 ceph-mon[32679]: pgmap v19446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:08.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:07 smithi092 ceph-mon[29156]: pgmap v19445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:14:08.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:07 smithi092 ceph-mon[29156]: pgmap v19446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:09 smithi189 ceph-mon[32756]: pgmap v19447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:14:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35745.001270 secs 2024-04-27T04:14:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:09 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35047.967230 secs 2024-04-27T04:14:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:09 smithi156 ceph-mon[32679]: pgmap v19447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:14:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35745.001270 secs 2024-04-27T04:14:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:09 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35047.967230 secs 2024-04-27T04:14:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:09 smithi092 ceph-mon[29156]: pgmap v19447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:14:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35745.001270 secs 2024-04-27T04:14:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:09 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35047.967230 secs 2024-04-27T04:14:12.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:11 smithi189 ceph-mon[32756]: pgmap v19448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:12.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:11 smithi156 ceph-mon[32679]: pgmap v19448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:12.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:11 smithi092 ceph-mon[29156]: pgmap v19448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:14:14.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:13 smithi189 ceph-mon[32756]: pgmap v19449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:14:14.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:13 smithi156 ceph-mon[32679]: pgmap v19449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:14:14.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:13 smithi092 ceph-mon[29156]: pgmap v19449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:14:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35750.001348 secs 2024-04-27T04:14:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:14 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35052.967326 secs 2024-04-27T04:14:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35750.001348 secs 2024-04-27T04:14:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:14 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35052.967326 secs 2024-04-27T04:14:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35750.001348 secs 2024-04-27T04:14:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:14 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35052.967326 secs 2024-04-27T04:14:16.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:15 smithi189 ceph-mon[32756]: pgmap v19450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:14:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:15 smithi156 ceph-mon[32679]: pgmap v19450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:14:16.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:15 smithi092 ceph-mon[29156]: pgmap v19450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:14:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:17 smithi189 ceph-mon[32756]: pgmap v19451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:14:18.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:17 smithi156 ceph-mon[32679]: pgmap v19451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:14:18.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:17 smithi092 ceph-mon[29156]: pgmap v19451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:14:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:19 smithi189 ceph-mon[32756]: pgmap v19452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35755.001469 secs 2024-04-27T04:14:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35057.967440 secs 2024-04-27T04:14:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:19 smithi156 ceph-mon[32679]: pgmap v19452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35755.001469 secs 2024-04-27T04:14:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35057.967440 secs 2024-04-27T04:14:20.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:19 smithi092 ceph-mon[29156]: pgmap v19452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:20.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35755.001469 secs 2024-04-27T04:14:20.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35057.967440 secs 2024-04-27T04:14:22.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:21 smithi189 ceph-mon[32756]: pgmap v19453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:22.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:21 smithi156 ceph-mon[32679]: pgmap v19453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:22.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:21 smithi092 ceph-mon[29156]: pgmap v19453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:24.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:23 smithi189 ceph-mon[32756]: pgmap v19454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:24.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:23 smithi156 ceph-mon[32679]: pgmap v19454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:24.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:23 smithi092 ceph-mon[29156]: pgmap v19454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35760.001601 secs 2024-04-27T04:14:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35062.967528 secs 2024-04-27T04:14:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35760.001601 secs 2024-04-27T04:14:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35062.967528 secs 2024-04-27T04:14:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35760.001601 secs 2024-04-27T04:14:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35062.967528 secs 2024-04-27T04:14:26.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:25 smithi189 ceph-mon[32756]: pgmap v19455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:26.142 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:25 smithi092 ceph-mon[29156]: pgmap v19455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:26.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:25 smithi156 ceph-mon[32679]: pgmap v19455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:28.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:27 smithi189 ceph-mon[32756]: pgmap v19456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:28.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:27 smithi156 ceph-mon[32679]: pgmap v19456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:28.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:27 smithi092 ceph-mon[29156]: pgmap v19456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:29 smithi189 ceph-mon[32756]: pgmap v19457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35765.001674 secs 2024-04-27T04:14:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35067.967649 secs 2024-04-27T04:14:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:29 smithi156 ceph-mon[32679]: pgmap v19457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35765.001674 secs 2024-04-27T04:14:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35067.967649 secs 2024-04-27T04:14:30.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:29 smithi092 ceph-mon[29156]: pgmap v19457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35765.001674 secs 2024-04-27T04:14:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35067.967649 secs 2024-04-27T04:14:32.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:31 smithi189 ceph-mon[32756]: pgmap v19458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:32.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:31 smithi156 ceph-mon[32679]: pgmap v19458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:32.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:31 smithi092 ceph-mon[29156]: pgmap v19458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:34.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:33 smithi189 ceph-mon[32756]: pgmap v19459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:34.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:33 smithi156 ceph-mon[32679]: pgmap v19459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:34.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:33 smithi092 ceph-mon[29156]: pgmap v19459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:35.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35770.001802 secs 2024-04-27T04:14:35.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35072.967783 secs 2024-04-27T04:14:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35770.001802 secs 2024-04-27T04:14:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35072.967783 secs 2024-04-27T04:14:35.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35770.001802 secs 2024-04-27T04:14:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35072.967783 secs 2024-04-27T04:14:36.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:35 smithi189 ceph-mon[32756]: pgmap v19460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:36.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:35 smithi156 ceph-mon[32679]: pgmap v19460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:36.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:35 smithi092 ceph-mon[29156]: pgmap v19460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:38.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:37 smithi189 ceph-mon[32756]: pgmap v19461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:38.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:37 smithi156 ceph-mon[32679]: pgmap v19461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:38.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:37 smithi092 ceph-mon[29156]: pgmap v19461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:39 smithi189 ceph-mon[32756]: pgmap v19462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35775.001926 secs 2024-04-27T04:14:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35077.967926 secs 2024-04-27T04:14:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:39 smithi156 ceph-mon[32679]: pgmap v19462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35775.001926 secs 2024-04-27T04:14:40.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35077.967926 secs 2024-04-27T04:14:40.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:39 smithi092 ceph-mon[29156]: pgmap v19462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35775.001926 secs 2024-04-27T04:14:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35077.967926 secs 2024-04-27T04:14:42.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:41 smithi189 ceph-mon[32756]: pgmap v19463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:42.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:41 smithi156 ceph-mon[32679]: pgmap v19463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:42.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:41 smithi092 ceph-mon[29156]: pgmap v19463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:14:44.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:43 smithi189 ceph-mon[32756]: pgmap v19464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:44.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:43 smithi156 ceph-mon[32679]: pgmap v19464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:44.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:43 smithi092 ceph-mon[29156]: pgmap v19464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35780.002043 secs 2024-04-27T04:14:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35082.968053 secs 2024-04-27T04:14:45.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35780.002043 secs 2024-04-27T04:14:45.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35082.968053 secs 2024-04-27T04:14:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35780.002043 secs 2024-04-27T04:14:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35082.968053 secs 2024-04-27T04:14:46.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:45 smithi189 ceph-mon[32756]: pgmap v19465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:46.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:45 smithi156 ceph-mon[32679]: pgmap v19465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:46.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:45 smithi092 ceph-mon[29156]: pgmap v19465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:48.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:47 smithi189 ceph-mon[32756]: pgmap v19466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:48.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:47 smithi156 ceph-mon[32679]: pgmap v19466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:48.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:47 smithi092 ceph-mon[29156]: pgmap v19466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:49 smithi189 ceph-mon[32756]: pgmap v19467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:14:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35785.002186 secs 2024-04-27T04:14:50.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35087.968175 secs 2024-04-27T04:14:50.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:49 smithi156 ceph-mon[32679]: pgmap v19467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:14:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35785.002186 secs 2024-04-27T04:14:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35087.968175 secs 2024-04-27T04:14:50.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:49 smithi092 ceph-mon[29156]: pgmap v19467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-04-27T04:14:50.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35785.002186 secs 2024-04-27T04:14:50.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35087.968175 secs 2024-04-27T04:14:52.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:51 smithi189 ceph-mon[32756]: pgmap v19468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:52.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:51 smithi156 ceph-mon[32679]: pgmap v19468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:52.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:51 smithi092 ceph-mon[29156]: pgmap v19468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:54.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:53 smithi189 ceph-mon[32756]: pgmap v19469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:54.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:53 smithi156 ceph-mon[32679]: pgmap v19469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:54.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:53 smithi092 ceph-mon[29156]: pgmap v19469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:14:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35790.002321 secs 2024-04-27T04:14:55.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35092.968324 secs 2024-04-27T04:14:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35790.002321 secs 2024-04-27T04:14:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35092.968324 secs 2024-04-27T04:14:55.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35790.002321 secs 2024-04-27T04:14:55.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35092.968324 secs 2024-04-27T04:14:56.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:55 smithi189 ceph-mon[32756]: pgmap v19470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:56.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:55 smithi092 ceph-mon[29156]: pgmap v19470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:56.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:55 smithi156 ceph-mon[32679]: pgmap v19470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:14:58.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:57 smithi189 ceph-mon[32756]: pgmap v19471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:58.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:57 smithi156 ceph-mon[32679]: pgmap v19471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:14:58.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:57 smithi092 ceph-mon[29156]: pgmap v19471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:59 smithi189 ceph-mon[32756]: pgmap v19472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35795.002453 secs 2024-04-27T04:15:00.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:14:59 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35097.968420 secs 2024-04-27T04:15:00.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:59 smithi156 ceph-mon[32679]: pgmap v19472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:00.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35795.002453 secs 2024-04-27T04:15:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:14:59 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35097.968420 secs 2024-04-27T04:15:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:59 smithi092 ceph-mon[29156]: pgmap v19472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35795.002453 secs 2024-04-27T04:15:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:14:59 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35097.968420 secs 2024-04-27T04:15:02.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:01 smithi189 ceph-mon[32756]: pgmap v19473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:02.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:01 smithi156 ceph-mon[32679]: pgmap v19473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:02.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:01 smithi092 ceph-mon[29156]: pgmap v19473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:04.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:03 smithi189 ceph-mon[32756]: pgmap v19474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:04.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:03 smithi156 ceph-mon[32679]: pgmap v19474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:04.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:03 smithi092 ceph-mon[29156]: pgmap v19474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35800.002566 secs 2024-04-27T04:15:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:04 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35102.968542 secs 2024-04-27T04:15:05.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35800.002566 secs 2024-04-27T04:15:05.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:04 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35102.968542 secs 2024-04-27T04:15:05.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35800.002566 secs 2024-04-27T04:15:05.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:04 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35102.968542 secs 2024-04-27T04:15:06.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:05 smithi189 ceph-mon[32756]: pgmap v19475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:06.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:05 smithi156 ceph-mon[32679]: pgmap v19475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:06.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:05 smithi092 ceph-mon[29156]: pgmap v19475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:07.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:06 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:15:07.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:06 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:15:07.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:06 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:15:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:07 smithi156 ceph-mon[32679]: pgmap v19476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:15:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:15:08.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:15:08.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:07 smithi092 ceph-mon[29156]: pgmap v19476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:08.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:15:08.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:15:08.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:15:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:07 smithi189 ceph-mon[32756]: pgmap v19476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:15:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:15:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:15:09.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:08 smithi156 ceph-mon[32679]: pgmap v19477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:15:09.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:08 smithi156 ceph-mon[32679]: pgmap v19478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:15:09.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:08 smithi092 ceph-mon[29156]: pgmap v19477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:15:09.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:08 smithi092 ceph-mon[29156]: pgmap v19478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:15:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:08 smithi189 ceph-mon[32756]: pgmap v19477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:15:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:08 smithi189 ceph-mon[32756]: pgmap v19478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:15:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35805.002644 secs 2024-04-27T04:15:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:09 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35107.968653 secs 2024-04-27T04:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35805.002644 secs 2024-04-27T04:15:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:09 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35107.968653 secs 2024-04-27T04:15:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35805.002644 secs 2024-04-27T04:15:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:09 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35107.968653 secs 2024-04-27T04:15:10.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:15:10.389+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:15:10.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:15:10.389+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:15:10.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:15:10.389+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:15:10.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:15:10.389+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:15:10.742 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:15:10.389+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:15:11.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:10 smithi156 ceph-mon[32679]: pgmap v19479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:11.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:10 smithi092 ceph-mon[29156]: pgmap v19479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:11.287 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:10 smithi189 ceph-mon[32756]: pgmap v19479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:13.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:12 smithi156 ceph-mon[32679]: pgmap v19480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:13.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:12 smithi092 ceph-mon[29156]: pgmap v19480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:12 smithi189 ceph-mon[32756]: pgmap v19480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:15:15.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:14 smithi156 ceph-mon[32679]: pgmap v19481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:15:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35810.002708 secs 2024-04-27T04:15:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:14 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 35112.968772 secs 2024-04-27T04:15:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:14 smithi156 ceph-mon[32679]: slow request 2884.466127 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:15:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:14 smithi092 ceph-mon[29156]: pgmap v19481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:15:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35810.002708 secs 2024-04-27T04:15:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:14 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 35112.968772 secs 2024-04-27T04:15:15.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:14 smithi092 ceph-mon[29156]: slow request 2884.466127 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:15:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:14 smithi189 ceph-mon[32756]: pgmap v19481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:15:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35810.002708 secs 2024-04-27T04:15:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:14 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 35112.968772 secs 2024-04-27T04:15:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:14 smithi189 ceph-mon[32756]: slow request 2884.466127 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:15:17.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:16 smithi156 ceph-mon[32679]: pgmap v19482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:15:17.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:16 smithi092 ceph-mon[29156]: pgmap v19482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:15:17.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:16 smithi189 ceph-mon[32756]: pgmap v19482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:15:19.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:18 smithi156 ceph-mon[32679]: pgmap v19483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T04:15:19.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:18 smithi092 ceph-mon[29156]: pgmap v19483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T04:15:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:18 smithi189 ceph-mon[32756]: pgmap v19483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 409 B/s wr, 4 op/s 2024-04-27T04:15:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35815.002843 secs 2024-04-27T04:15:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35117.968873 secs 2024-04-27T04:15:20.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35815.002843 secs 2024-04-27T04:15:20.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35117.968873 secs 2024-04-27T04:15:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35815.002843 secs 2024-04-27T04:15:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35117.968873 secs 2024-04-27T04:15:21.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:20 smithi156 ceph-mon[32679]: pgmap v19484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:21.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:20 smithi092 ceph-mon[29156]: pgmap v19484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:21.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:20 smithi189 ceph-mon[32756]: pgmap v19484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:23.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:22 smithi092 ceph-mon[29156]: pgmap v19485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:23.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:22 smithi189 ceph-mon[32756]: pgmap v19485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:23.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:22 smithi156 ceph-mon[32679]: pgmap v19485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:25.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:24 smithi092 ceph-mon[29156]: pgmap v19486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:25.250 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35820.002955 secs 2024-04-27T04:15:25.251 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:24 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35122.968947 secs 2024-04-27T04:15:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:24 smithi189 ceph-mon[32756]: pgmap v19486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35820.002955 secs 2024-04-27T04:15:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:24 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35122.968947 secs 2024-04-27T04:15:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:24 smithi156 ceph-mon[32679]: pgmap v19486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:15:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35820.002955 secs 2024-04-27T04:15:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:24 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35122.968947 secs 2024-04-27T04:15:27.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:26 smithi092 ceph-mon[29156]: pgmap v19487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:27.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:26 smithi189 ceph-mon[32756]: pgmap v19487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:27.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:26 smithi156 ceph-mon[32679]: pgmap v19487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:15:29.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:28 smithi092 ceph-mon[29156]: pgmap v19488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:28 smithi189 ceph-mon[32756]: pgmap v19488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:29.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:28 smithi156 ceph-mon[32679]: pgmap v19488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:30.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35825.003049 secs 2024-04-27T04:15:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:29 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35127.969003 secs 2024-04-27T04:15:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35825.003049 secs 2024-04-27T04:15:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:29 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35127.969003 secs 2024-04-27T04:15:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35825.003049 secs 2024-04-27T04:15:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:29 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35127.969003 secs 2024-04-27T04:15:31.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:30 smithi092 ceph-mon[29156]: pgmap v19489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:31.392 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:30 smithi189 ceph-mon[32756]: pgmap v19489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:31.439 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:30 smithi156 ceph-mon[32679]: pgmap v19489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:33.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:32 smithi092 ceph-mon[29156]: pgmap v19490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:32 smithi189 ceph-mon[32756]: pgmap v19490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:33.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:32 smithi156 ceph-mon[32679]: pgmap v19490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:35.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:34 smithi092 ceph-mon[29156]: pgmap v19491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35830.003166 secs 2024-04-27T04:15:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:34 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35132.969120 secs 2024-04-27T04:15:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:34 smithi189 ceph-mon[32756]: pgmap v19491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35830.003166 secs 2024-04-27T04:15:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:34 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35132.969120 secs 2024-04-27T04:15:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:34 smithi156 ceph-mon[32679]: pgmap v19491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35830.003166 secs 2024-04-27T04:15:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:34 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35132.969120 secs 2024-04-27T04:15:37.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:36 smithi092 ceph-mon[29156]: pgmap v19492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:37.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:36 smithi189 ceph-mon[32756]: pgmap v19492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:37.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:36 smithi156 ceph-mon[32679]: pgmap v19492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:39.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:38 smithi092 ceph-mon[29156]: pgmap v19493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:38 smithi189 ceph-mon[32756]: pgmap v19493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:39.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:38 smithi156 ceph-mon[32679]: pgmap v19493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35835.003282 secs 2024-04-27T04:15:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:39 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35137.969199 secs 2024-04-27T04:15:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35835.003282 secs 2024-04-27T04:15:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:39 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35137.969199 secs 2024-04-27T04:15:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35835.003282 secs 2024-04-27T04:15:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:39 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35137.969199 secs 2024-04-27T04:15:40.899 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:15:40.900+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:15:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:15:40.900+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T04:15:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:15:40.901+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006490 con 0x5617fb906f00 2024-04-27T04:15:40.900 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:15:40.901+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 276 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:15:41.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:40 smithi092 ceph-mon[29156]: pgmap v19494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:41.287 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:40 smithi189 ceph-mon[32756]: pgmap v19494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:41.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:40 smithi156 ceph-mon[32679]: pgmap v19494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:43.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:42 smithi092 ceph-mon[29156]: pgmap v19495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:43.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:42 smithi189 ceph-mon[32756]: pgmap v19495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:43.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:42 smithi156 ceph-mon[32679]: pgmap v19495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:45.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:44 smithi156 ceph-mon[32679]: pgmap v19496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:45.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35840.003351 secs 2024-04-27T04:15:45.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:44 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35142.969271 secs 2024-04-27T04:15:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:44 smithi092 ceph-mon[29156]: pgmap v19496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35840.003351 secs 2024-04-27T04:15:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:44 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35142.969271 secs 2024-04-27T04:15:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:44 smithi189 ceph-mon[32756]: pgmap v19496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35840.003351 secs 2024-04-27T04:15:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:44 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35142.969271 secs 2024-04-27T04:15:47.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:46 smithi092 ceph-mon[29156]: pgmap v19497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:47.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:46 smithi189 ceph-mon[32756]: pgmap v19497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:46 smithi156 ceph-mon[32679]: pgmap v19497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:49.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:48 smithi092 ceph-mon[29156]: pgmap v19498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:48 smithi189 ceph-mon[32756]: pgmap v19498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:49.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:48 smithi156 ceph-mon[32679]: pgmap v19498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35845.003475 secs 2024-04-27T04:15:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:49 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35147.969384 secs 2024-04-27T04:15:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35845.003475 secs 2024-04-27T04:15:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:49 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35147.969384 secs 2024-04-27T04:15:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35845.003475 secs 2024-04-27T04:15:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:49 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35147.969384 secs 2024-04-27T04:15:51.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:50 smithi189 ceph-mon[32756]: pgmap v19499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:51.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:50 smithi156 ceph-mon[32679]: pgmap v19499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:51.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:50 smithi092 ceph-mon[29156]: pgmap v19499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:53 smithi189 ceph-mon[32756]: pgmap v19500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:53.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:53 smithi156 ceph-mon[32679]: pgmap v19500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:53.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:53 smithi092 ceph-mon[29156]: pgmap v19500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:55 smithi189 ceph-mon[32756]: pgmap v19501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35850.003548 secs 2024-04-27T04:15:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:55 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35152.969509 secs 2024-04-27T04:15:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:55 smithi156 ceph-mon[32679]: pgmap v19501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35850.003548 secs 2024-04-27T04:15:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:55 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35152.969509 secs 2024-04-27T04:15:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:55 smithi092 ceph-mon[29156]: pgmap v19501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35850.003548 secs 2024-04-27T04:15:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:55 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35152.969509 secs 2024-04-27T04:15:57.294 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:57 smithi092 ceph-mon[29156]: pgmap v19502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:57.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:57 smithi189 ceph-mon[32756]: pgmap v19502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:57.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:57 smithi156 ceph-mon[32679]: pgmap v19502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:15:59.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:15:59 smithi189 ceph-mon[32756]: pgmap v19503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:59.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:15:59 smithi156 ceph-mon[32679]: pgmap v19503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:15:59.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:15:59 smithi092 ceph-mon[29156]: pgmap v19503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35855.003686 secs 2024-04-27T04:16:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35157.969626 secs 2024-04-27T04:16:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35855.003686 secs 2024-04-27T04:16:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35157.969626 secs 2024-04-27T04:16:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35855.003686 secs 2024-04-27T04:16:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35157.969626 secs 2024-04-27T04:16:01.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:01 smithi189 ceph-mon[32756]: pgmap v19504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:01.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:01 smithi156 ceph-mon[32679]: pgmap v19504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:01.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:01 smithi092 ceph-mon[29156]: pgmap v19504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:03 smithi189 ceph-mon[32756]: pgmap v19505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:03.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:03 smithi156 ceph-mon[32679]: pgmap v19505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:03.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:03 smithi092 ceph-mon[29156]: pgmap v19505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:05 smithi189 ceph-mon[32756]: pgmap v19506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35860.003759 secs 2024-04-27T04:16:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35162.969743 secs 2024-04-27T04:16:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:05 smithi156 ceph-mon[32679]: pgmap v19506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35860.003759 secs 2024-04-27T04:16:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35162.969743 secs 2024-04-27T04:16:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:05 smithi092 ceph-mon[29156]: pgmap v19506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35860.003759 secs 2024-04-27T04:16:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35162.969743 secs 2024-04-27T04:16:07.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:07 smithi189 ceph-mon[32756]: pgmap v19507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:07.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:07 smithi156 ceph-mon[32679]: pgmap v19507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:07.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:07 smithi092 ceph-mon[29156]: pgmap v19507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:16:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:16:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:16:08.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:16:08.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:16:08.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:16:08.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:16:08.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:16:08.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:16:08.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:16:08.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:16:08.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:16:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:09 smithi189 ceph-mon[32756]: pgmap v19508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:09 smithi189 ceph-mon[32756]: pgmap v19509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:16:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:09 smithi189 ceph-mon[32756]: pgmap v19510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:16:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:09 smithi156 ceph-mon[32679]: pgmap v19508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:09 smithi156 ceph-mon[32679]: pgmap v19509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:16:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:09 smithi156 ceph-mon[32679]: pgmap v19510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:16:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:09 smithi092 ceph-mon[29156]: pgmap v19508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:09.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:09 smithi092 ceph-mon[29156]: pgmap v19509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:16:09.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:09 smithi092 ceph-mon[29156]: pgmap v19510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:16:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35865.003901 secs 2024-04-27T04:16:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:10 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 35167.969907 secs 2024-04-27T04:16:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:10 smithi189 ceph-mon[32756]: slow request 5760.228565 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35865.003901 secs 2024-04-27T04:16:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:10 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 35167.969907 secs 2024-04-27T04:16:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:10 smithi156 ceph-mon[32679]: slow request 5760.228565 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35865.003901 secs 2024-04-27T04:16:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:10 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 35167.969907 secs 2024-04-27T04:16:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:10 smithi092 ceph-mon[29156]: slow request 5760.228565 seconds old, received at 2024-04-27T02:40:08.887376+0000: client_request(client.17409:1 getattr pAsLsXsFs #0x1 2024-04-27T02:40:08.883457+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:11 smithi189 ceph-mon[32756]: pgmap v19511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:11 smithi156 ceph-mon[32679]: pgmap v19511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:11 smithi092 ceph-mon[29156]: pgmap v19511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:13 smithi189 ceph-mon[32756]: pgmap v19512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:13 smithi156 ceph-mon[32679]: pgmap v19512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:13 smithi092 ceph-mon[29156]: pgmap v19512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35870.003968 secs 2024-04-27T04:16:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:15 smithi189 ceph-mon[32756]: pgmap v19513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:15 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35172.970048 secs 2024-04-27T04:16:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35870.003968 secs 2024-04-27T04:16:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:15 smithi156 ceph-mon[32679]: pgmap v19513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:15 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35172.970048 secs 2024-04-27T04:16:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35870.003968 secs 2024-04-27T04:16:15.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:15 smithi092 ceph-mon[29156]: pgmap v19513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:15.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:15 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35172.970048 secs 2024-04-27T04:16:17.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:17 smithi189 ceph-mon[32756]: pgmap v19514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:17.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:17 smithi156 ceph-mon[32679]: pgmap v19514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:17.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:17 smithi092 ceph-mon[29156]: pgmap v19514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:16:18.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:18 smithi189 ceph-mon[32756]: pgmap v19515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:16:18.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:18 smithi156 ceph-mon[32679]: pgmap v19515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:16:18.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:18 smithi092 ceph-mon[29156]: pgmap v19515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:16:19.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:19 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35177.970112 secs 2024-04-27T04:16:19.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:19 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35177.970112 secs 2024-04-27T04:16:19.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:19 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35177.970112 secs 2024-04-27T04:16:20.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35875.004066 secs 2024-04-27T04:16:20.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:20 smithi189 ceph-mon[32756]: pgmap v19516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:20.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35875.004066 secs 2024-04-27T04:16:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:20 smithi156 ceph-mon[32679]: pgmap v19516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:20.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35875.004066 secs 2024-04-27T04:16:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:20 smithi092 ceph-mon[29156]: pgmap v19516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:23.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:23 smithi189 ceph-mon[32756]: pgmap v19517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:23.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:23 smithi156 ceph-mon[32679]: pgmap v19517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:23.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:23 smithi092 ceph-mon[29156]: pgmap v19517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35880.004184 secs 2024-04-27T04:16:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:25 smithi189 ceph-mon[32756]: pgmap v19518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:25 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35182.970242 secs 2024-04-27T04:16:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35880.004184 secs 2024-04-27T04:16:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:25 smithi156 ceph-mon[32679]: pgmap v19518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:25 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35182.970242 secs 2024-04-27T04:16:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35880.004184 secs 2024-04-27T04:16:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:25 smithi092 ceph-mon[29156]: pgmap v19518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:25 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35182.970242 secs 2024-04-27T04:16:27.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:27 smithi189 ceph-mon[32756]: pgmap v19519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:27.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:27 smithi156 ceph-mon[32679]: pgmap v19519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:27.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:27 smithi092 ceph-mon[29156]: pgmap v19519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:29 smithi189 ceph-mon[32756]: pgmap v19520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:29.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:29 smithi156 ceph-mon[32679]: pgmap v19520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:29.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:29 smithi092 ceph-mon[29156]: pgmap v19520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35885.004319 secs 2024-04-27T04:16:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:30 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35187.970314 secs 2024-04-27T04:16:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35885.004319 secs 2024-04-27T04:16:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:30 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35187.970314 secs 2024-04-27T04:16:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35885.004319 secs 2024-04-27T04:16:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:30 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35187.970314 secs 2024-04-27T04:16:31.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:31 smithi189 ceph-mon[32756]: pgmap v19521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:31.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:31 smithi156 ceph-mon[32679]: pgmap v19521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:31.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:31 smithi092 ceph-mon[29156]: pgmap v19521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:33 smithi189 ceph-mon[32756]: pgmap v19522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:33.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:33 smithi156 ceph-mon[32679]: pgmap v19522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:33.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:33 smithi092 ceph-mon[29156]: pgmap v19522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35890.004416 secs 2024-04-27T04:16:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:35 smithi189 ceph-mon[32756]: pgmap v19523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:35 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35192.970388 secs 2024-04-27T04:16:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35890.004416 secs 2024-04-27T04:16:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:35 smithi156 ceph-mon[32679]: pgmap v19523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:35 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35192.970388 secs 2024-04-27T04:16:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35890.004416 secs 2024-04-27T04:16:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:35 smithi092 ceph-mon[29156]: pgmap v19523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:35 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35192.970388 secs 2024-04-27T04:16:37.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:37 smithi189 ceph-mon[32756]: pgmap v19524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:37.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:37 smithi156 ceph-mon[32679]: pgmap v19524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:37.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:37 smithi092 ceph-mon[29156]: pgmap v19524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:39 smithi189 ceph-mon[32756]: pgmap v19525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:39.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:39 smithi156 ceph-mon[32679]: pgmap v19525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:39 smithi092 ceph-mon[29156]: pgmap v19525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35895.004535 secs 2024-04-27T04:16:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:40 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35197.970500 secs 2024-04-27T04:16:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35895.004535 secs 2024-04-27T04:16:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:40 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35197.970500 secs 2024-04-27T04:16:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35895.004535 secs 2024-04-27T04:16:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:40 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35197.970500 secs 2024-04-27T04:16:41.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:41 smithi189 ceph-mon[32756]: pgmap v19526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:41.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:41 smithi156 ceph-mon[32679]: pgmap v19526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:41.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:41 smithi092 ceph-mon[29156]: pgmap v19526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:43.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:43 smithi189 ceph-mon[32756]: pgmap v19527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:43.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:43 smithi156 ceph-mon[32679]: pgmap v19527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:43.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:43 smithi092 ceph-mon[29156]: pgmap v19527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35900.004643 secs 2024-04-27T04:16:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:45 smithi189 ceph-mon[32756]: pgmap v19528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:45 smithi189 ceph-mon[32756]: 27 slow requests, 1 included below; oldest blocked for > 35202.970569 secs 2024-04-27T04:16:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:45 smithi189 ceph-mon[32756]: slow request 723.905975 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35900.004643 secs 2024-04-27T04:16:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:45 smithi156 ceph-mon[32679]: pgmap v19528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:45 smithi156 ceph-mon[32679]: 27 slow requests, 1 included below; oldest blocked for > 35202.970569 secs 2024-04-27T04:16:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:45 smithi156 ceph-mon[32679]: slow request 723.905975 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35900.004643 secs 2024-04-27T04:16:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:45 smithi092 ceph-mon[29156]: pgmap v19528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:45 smithi092 ceph-mon[29156]: 27 slow requests, 1 included below; oldest blocked for > 35202.970569 secs 2024-04-27T04:16:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:45 smithi092 ceph-mon[29156]: slow request 723.905975 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:16:47.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:47 smithi189 ceph-mon[32756]: pgmap v19529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:47 smithi156 ceph-mon[32679]: pgmap v19529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:47.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:47 smithi092 ceph-mon[29156]: pgmap v19529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:49 smithi189 ceph-mon[32756]: pgmap v19530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:49.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:49 smithi156 ceph-mon[32679]: pgmap v19530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:49 smithi092 ceph-mon[29156]: pgmap v19530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:50.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35905.004785 secs 2024-04-27T04:16:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:50 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35207.970665 secs 2024-04-27T04:16:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35905.004785 secs 2024-04-27T04:16:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:50 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35207.970665 secs 2024-04-27T04:16:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35905.004785 secs 2024-04-27T04:16:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:50 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35207.970665 secs 2024-04-27T04:16:51.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:51 smithi189 ceph-mon[32756]: pgmap v19531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:51.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:51 smithi156 ceph-mon[32679]: pgmap v19531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:51.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:51 smithi092 ceph-mon[29156]: pgmap v19531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:53 smithi189 ceph-mon[32756]: pgmap v19532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:53.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:53 smithi156 ceph-mon[32679]: pgmap v19532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:53.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:53 smithi092 ceph-mon[29156]: pgmap v19532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35910.004906 secs 2024-04-27T04:16:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:55 smithi189 ceph-mon[32756]: pgmap v19533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:55 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35212.970775 secs 2024-04-27T04:16:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35910.004906 secs 2024-04-27T04:16:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:55 smithi156 ceph-mon[32679]: pgmap v19533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:55 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35212.970775 secs 2024-04-27T04:16:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35910.004906 secs 2024-04-27T04:16:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:55 smithi092 ceph-mon[29156]: pgmap v19533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:16:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:55 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35212.970775 secs 2024-04-27T04:16:57.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:57 smithi156 ceph-mon[32679]: pgmap v19534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:57.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:57 smithi092 ceph-mon[29156]: pgmap v19534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:57.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:57 smithi189 ceph-mon[32756]: pgmap v19534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:59.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:16:59 smithi156 ceph-mon[32679]: pgmap v19535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:59.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:16:59 smithi092 ceph-mon[29156]: pgmap v19535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:16:59.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:16:59 smithi189 ceph-mon[32756]: pgmap v19535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35915.005023 secs 2024-04-27T04:17:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:00 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35217.970837 secs 2024-04-27T04:17:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35915.005023 secs 2024-04-27T04:17:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:00 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35217.970837 secs 2024-04-27T04:17:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35915.005023 secs 2024-04-27T04:17:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:00 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35217.970837 secs 2024-04-27T04:17:01.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:01 smithi156 ceph-mon[32679]: pgmap v19536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:01.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:01 smithi092 ceph-mon[29156]: pgmap v19536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:01.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:01 smithi189 ceph-mon[32756]: pgmap v19536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:03.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:03 smithi156 ceph-mon[32679]: pgmap v19537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:03.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:03 smithi092 ceph-mon[29156]: pgmap v19537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:03.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:03 smithi189 ceph-mon[32756]: pgmap v19537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35920.005137 secs 2024-04-27T04:17:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:05 smithi156 ceph-mon[32679]: pgmap v19538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:05 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35222.970974 secs 2024-04-27T04:17:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35920.005137 secs 2024-04-27T04:17:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:05 smithi092 ceph-mon[29156]: pgmap v19538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:05 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35222.970974 secs 2024-04-27T04:17:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35920.005137 secs 2024-04-27T04:17:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:05 smithi189 ceph-mon[32756]: pgmap v19538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:05 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35222.970974 secs 2024-04-27T04:17:07.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:07 smithi156 ceph-mon[32679]: pgmap v19539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:07.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:07 smithi092 ceph-mon[29156]: pgmap v19539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:07.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:07 smithi189 ceph-mon[32756]: pgmap v19539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:17:08.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:17:08.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:17:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:09 smithi156 ceph-mon[32679]: pgmap v19540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:17:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:17:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:17:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:09 smithi092 ceph-mon[29156]: pgmap v19540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:17:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:17:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:17:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:09 smithi189 ceph-mon[32756]: pgmap v19540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:17:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:17:09.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:17:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:10 smithi156 ceph-mon[32679]: pgmap v19541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:17:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:10 smithi156 ceph-mon[32679]: pgmap v19542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35925.005198 secs 2024-04-27T04:17:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:10 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35227.971066 secs 2024-04-27T04:17:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:10 smithi092 ceph-mon[29156]: pgmap v19541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:17:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:10 smithi092 ceph-mon[29156]: pgmap v19542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35925.005198 secs 2024-04-27T04:17:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:10 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35227.971066 secs 2024-04-27T04:17:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:10 smithi189 ceph-mon[32756]: pgmap v19541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:17:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:10 smithi189 ceph-mon[32756]: pgmap v19542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35925.005198 secs 2024-04-27T04:17:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:10 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35227.971066 secs 2024-04-27T04:17:12.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:12 smithi156 ceph-mon[32679]: pgmap v19543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:12.437 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:12 smithi189 ceph-mon[32756]: pgmap v19543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:12.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:12 smithi092 ceph-mon[29156]: pgmap v19543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:14.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:14 smithi156 ceph-mon[32679]: pgmap v19544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:17:14.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:14 smithi092 ceph-mon[29156]: pgmap v19544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:17:14.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:14 smithi189 ceph-mon[32756]: pgmap v19544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:17:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35930.005314 secs 2024-04-27T04:17:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:15 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35232.971206 secs 2024-04-27T04:17:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35930.005314 secs 2024-04-27T04:17:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:15 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35232.971206 secs 2024-04-27T04:17:15.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35930.005314 secs 2024-04-27T04:17:15.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:15 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35232.971206 secs 2024-04-27T04:17:16.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:16 smithi092 ceph-mon[29156]: pgmap v19545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:16.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:16 smithi189 ceph-mon[32756]: pgmap v19545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:16.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:16 smithi156 ceph-mon[32679]: pgmap v19545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:18.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:18 smithi092 ceph-mon[29156]: pgmap v19546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:18 smithi189 ceph-mon[32756]: pgmap v19546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:18 smithi156 ceph-mon[32679]: pgmap v19546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:17:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:20 smithi092 ceph-mon[29156]: pgmap v19547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:17:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35935.005387 secs 2024-04-27T04:17:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:20 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35237.971267 secs 2024-04-27T04:17:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:20 smithi189 ceph-mon[32756]: pgmap v19547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:17:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35935.005387 secs 2024-04-27T04:17:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:20 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35237.971267 secs 2024-04-27T04:17:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:20 smithi156 ceph-mon[32679]: pgmap v19547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:17:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35935.005387 secs 2024-04-27T04:17:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:20 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35237.971267 secs 2024-04-27T04:17:22.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:22 smithi092 ceph-mon[29156]: pgmap v19548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:22.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:22 smithi189 ceph-mon[32756]: pgmap v19548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:22.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:22 smithi156 ceph-mon[32679]: pgmap v19548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:24 smithi092 ceph-mon[29156]: pgmap v19549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:24 smithi189 ceph-mon[32756]: pgmap v19549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:24.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:24 smithi156 ceph-mon[32679]: pgmap v19549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35940.005492 secs 2024-04-27T04:17:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:25 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35242.971394 secs 2024-04-27T04:17:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35940.005492 secs 2024-04-27T04:17:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:25 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35242.971394 secs 2024-04-27T04:17:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35940.005492 secs 2024-04-27T04:17:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:25 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35242.971394 secs 2024-04-27T04:17:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:26 smithi092 ceph-mon[29156]: pgmap v19550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:26.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:26 smithi189 ceph-mon[32756]: pgmap v19550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:26.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:26 smithi156 ceph-mon[32679]: pgmap v19550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:28.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:28 smithi092 ceph-mon[29156]: pgmap v19551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:28.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:28 smithi189 ceph-mon[32756]: pgmap v19551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:28.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:28 smithi156 ceph-mon[32679]: pgmap v19551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:30 smithi092 ceph-mon[29156]: pgmap v19552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35945.005636 secs 2024-04-27T04:17:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:30 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35247.971471 secs 2024-04-27T04:17:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:30 smithi189 ceph-mon[32756]: pgmap v19552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35945.005636 secs 2024-04-27T04:17:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:30 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35247.971471 secs 2024-04-27T04:17:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:30 smithi156 ceph-mon[32679]: pgmap v19552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35945.005636 secs 2024-04-27T04:17:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:30 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35247.971471 secs 2024-04-27T04:17:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:32 smithi092 ceph-mon[29156]: pgmap v19553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:32.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:32 smithi189 ceph-mon[32756]: pgmap v19553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:32.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:32 smithi156 ceph-mon[32679]: pgmap v19553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:34 smithi092 ceph-mon[29156]: pgmap v19554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:34 smithi189 ceph-mon[32756]: pgmap v19554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:34.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:34 smithi156 ceph-mon[32679]: pgmap v19554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35950.005719 secs 2024-04-27T04:17:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:35 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35252.971587 secs 2024-04-27T04:17:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35950.005719 secs 2024-04-27T04:17:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:35 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35252.971587 secs 2024-04-27T04:17:35.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35950.005719 secs 2024-04-27T04:17:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:35 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35252.971587 secs 2024-04-27T04:17:36.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:36 smithi092 ceph-mon[29156]: pgmap v19555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:36.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:36 smithi189 ceph-mon[32756]: pgmap v19555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:36.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:36 smithi156 ceph-mon[32679]: pgmap v19555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:38.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:38 smithi092 ceph-mon[29156]: pgmap v19556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:38.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:38 smithi189 ceph-mon[32756]: pgmap v19556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:38.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:38 smithi156 ceph-mon[32679]: pgmap v19556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:40 smithi092 ceph-mon[29156]: pgmap v19557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35955.005817 secs 2024-04-27T04:17:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:40 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35257.971651 secs 2024-04-27T04:17:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:40 smithi189 ceph-mon[32756]: pgmap v19557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35955.005817 secs 2024-04-27T04:17:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:40 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35257.971651 secs 2024-04-27T04:17:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:40 smithi156 ceph-mon[32679]: pgmap v19557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35955.005817 secs 2024-04-27T04:17:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:40 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35257.971651 secs 2024-04-27T04:17:42.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:42 smithi092 ceph-mon[29156]: pgmap v19558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:42.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:42 smithi189 ceph-mon[32756]: pgmap v19558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:42.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:42 smithi156 ceph-mon[32679]: pgmap v19558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:44.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:44 smithi092 ceph-mon[29156]: pgmap v19559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:44.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:44 smithi189 ceph-mon[32756]: pgmap v19559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:44.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:44 smithi156 ceph-mon[32679]: pgmap v19559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35960.005934 secs 2024-04-27T04:17:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:45 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35262.971768 secs 2024-04-27T04:17:45.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35960.005934 secs 2024-04-27T04:17:45.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:45 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35262.971768 secs 2024-04-27T04:17:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35960.005934 secs 2024-04-27T04:17:45.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:45 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35262.971768 secs 2024-04-27T04:17:46.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:46 smithi092 ceph-mon[29156]: pgmap v19560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:46.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:46 smithi189 ceph-mon[32756]: pgmap v19560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:46.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:46 smithi156 ceph-mon[32679]: pgmap v19560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:48.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:48 smithi189 ceph-mon[32756]: pgmap v19561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:48.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:48 smithi156 ceph-mon[32679]: pgmap v19561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:48.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:48 smithi092 ceph-mon[29156]: pgmap v19561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:49.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:49 smithi189 ceph-mon[32756]: pgmap v19562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:49.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:49 smithi156 ceph-mon[32679]: pgmap v19562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:49.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:49 smithi092 ceph-mon[29156]: pgmap v19562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35965.006032 secs 2024-04-27T04:17:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:50 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35267.971885 secs 2024-04-27T04:17:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35965.006032 secs 2024-04-27T04:17:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:50 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35267.971885 secs 2024-04-27T04:17:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35965.006032 secs 2024-04-27T04:17:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:50 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35267.971885 secs 2024-04-27T04:17:51.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:51 smithi189 ceph-mon[32756]: pgmap v19563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:51.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:51 smithi156 ceph-mon[32679]: pgmap v19563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:51.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:51 smithi092 ceph-mon[29156]: pgmap v19563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:54.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:53 smithi156 ceph-mon[32679]: pgmap v19564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:54.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:53 smithi092 ceph-mon[29156]: pgmap v19564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:54.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:53 smithi189 ceph-mon[32756]: pgmap v19564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:55.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35970.006149 secs 2024-04-27T04:17:55.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:54 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35272.971997 secs 2024-04-27T04:17:55.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35970.006149 secs 2024-04-27T04:17:55.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:54 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35272.971997 secs 2024-04-27T04:17:55.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35970.006149 secs 2024-04-27T04:17:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:54 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35272.971997 secs 2024-04-27T04:17:56.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:55 smithi156 ceph-mon[32679]: pgmap v19565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:56.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:55 smithi092 ceph-mon[29156]: pgmap v19565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:56.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:55 smithi189 ceph-mon[32756]: pgmap v19565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:17:58.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:57 smithi156 ceph-mon[32679]: pgmap v19566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:58.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:57 smithi092 ceph-mon[29156]: pgmap v19566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:17:58.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:57 smithi189 ceph-mon[32756]: pgmap v19566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:59 smithi156 ceph-mon[32679]: pgmap v19567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35975.006275 secs 2024-04-27T04:18:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:17:59 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35277.972136 secs 2024-04-27T04:18:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:59 smithi092 ceph-mon[29156]: pgmap v19567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35975.006275 secs 2024-04-27T04:18:00.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:17:59 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35277.972136 secs 2024-04-27T04:18:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:59 smithi189 ceph-mon[32756]: pgmap v19567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35975.006275 secs 2024-04-27T04:18:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:17:59 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35277.972136 secs 2024-04-27T04:18:02.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:01 smithi156 ceph-mon[32679]: pgmap v19568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:02.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:01 smithi092 ceph-mon[29156]: pgmap v19568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:02.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:01 smithi189 ceph-mon[32756]: pgmap v19568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:04.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:03 smithi156 ceph-mon[32679]: pgmap v19569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:04.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:03 smithi092 ceph-mon[29156]: pgmap v19569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:04.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:03 smithi189 ceph-mon[32756]: pgmap v19569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:04.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35980.006411 secs 2024-04-27T04:18:04.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:04 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35282.972201 secs 2024-04-27T04:18:05.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35980.006411 secs 2024-04-27T04:18:05.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:04 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35282.972201 secs 2024-04-27T04:18:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35980.006411 secs 2024-04-27T04:18:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:04 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35282.972201 secs 2024-04-27T04:18:06.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:05 smithi156 ceph-mon[32679]: pgmap v19570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:06.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:05 smithi092 ceph-mon[29156]: pgmap v19570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:06.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:05 smithi189 ceph-mon[32756]: pgmap v19570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:08.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:07 smithi156 ceph-mon[32679]: pgmap v19571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:08.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:07 smithi092 ceph-mon[29156]: pgmap v19571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:08.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:07 smithi189 ceph-mon[32756]: pgmap v19571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:10.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: pgmap v19572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35985.006473 secs 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: 27 slow requests, 0 included below; oldest blocked for > 35287.972324 secs 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:18:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:18:10.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: pgmap v19572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:10.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35985.006473 secs 2024-04-27T04:18:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:18:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: 27 slow requests, 0 included below; oldest blocked for > 35287.972324 secs 2024-04-27T04:18:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:18:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:18:10.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: pgmap v19572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35985.006473 secs 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: 27 slow requests, 0 included below; oldest blocked for > 35287.972324 secs 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:18:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:18:11.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:10 smithi092 ceph-mon[29156]: pgmap v19573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:18:11.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:10 smithi092 ceph-mon[29156]: pgmap v19574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:10 smithi189 ceph-mon[32756]: pgmap v19573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:18:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:10 smithi189 ceph-mon[32756]: pgmap v19574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:10 smithi156 ceph-mon[32679]: pgmap v19573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:18:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:10 smithi156 ceph-mon[32679]: pgmap v19574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:13.188 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:12 smithi189 ceph-mon[32756]: pgmap v19575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:13.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:12 smithi092 ceph-mon[29156]: pgmap v19575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:12 smithi156 ceph-mon[32679]: pgmap v19575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:15.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:14 smithi156 ceph-mon[32679]: pgmap v19576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:15.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35990.006565 secs 2024-04-27T04:18:15.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:14 smithi156 ceph-mon[32679]: 28 slow requests, 1 included below; oldest blocked for > 35292.972438 secs 2024-04-27T04:18:15.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:14 smithi156 ceph-mon[32679]: slow request 183.718742 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:18:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:14 smithi092 ceph-mon[29156]: pgmap v19576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35990.006565 secs 2024-04-27T04:18:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:14 smithi092 ceph-mon[29156]: 28 slow requests, 1 included below; oldest blocked for > 35292.972438 secs 2024-04-27T04:18:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:14 smithi092 ceph-mon[29156]: slow request 183.718742 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:18:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:14 smithi189 ceph-mon[32756]: pgmap v19576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35990.006565 secs 2024-04-27T04:18:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:14 smithi189 ceph-mon[32756]: 28 slow requests, 1 included below; oldest blocked for > 35292.972438 secs 2024-04-27T04:18:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:14 smithi189 ceph-mon[32756]: slow request 183.718742 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:18:17.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:16 smithi092 ceph-mon[29156]: pgmap v19577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:17.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:16 smithi189 ceph-mon[32756]: pgmap v19577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:17.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:16 smithi156 ceph-mon[32679]: pgmap v19577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:18:19.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:18 smithi092 ceph-mon[29156]: pgmap v19578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:18:19.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:18:19.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:18:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:18 smithi189 ceph-mon[32756]: pgmap v19578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:18:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:18:19.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:18:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:18 smithi156 ceph-mon[32679]: pgmap v19578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:18:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:18:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:18:20.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 35995.006699 secs 2024-04-27T04:18:20.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:19 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35297.972510 secs 2024-04-27T04:18:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 35995.006699 secs 2024-04-27T04:18:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:19 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35297.972510 secs 2024-04-27T04:18:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 35995.006699 secs 2024-04-27T04:18:20.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:19 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35297.972510 secs 2024-04-27T04:18:21.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:20 smithi092 ceph-mon[29156]: pgmap v19579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:18:21.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:20 smithi189 ceph-mon[32756]: pgmap v19579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:18:21.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:20 smithi156 ceph-mon[32679]: pgmap v19579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:18:23.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:22 smithi092 ceph-mon[29156]: pgmap v19580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:23.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:22 smithi189 ceph-mon[32756]: pgmap v19580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:23.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:22 smithi156 ceph-mon[32679]: pgmap v19580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:25.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:24 smithi092 ceph-mon[29156]: pgmap v19581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36000.006808 secs 2024-04-27T04:18:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:24 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35302.972632 secs 2024-04-27T04:18:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:24 smithi189 ceph-mon[32756]: pgmap v19581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36000.006808 secs 2024-04-27T04:18:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:24 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35302.972632 secs 2024-04-27T04:18:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:24 smithi156 ceph-mon[32679]: pgmap v19581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36000.006808 secs 2024-04-27T04:18:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:24 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35302.972632 secs 2024-04-27T04:18:27.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:26 smithi092 ceph-mon[29156]: pgmap v19582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:27.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:26 smithi189 ceph-mon[32756]: pgmap v19582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:27.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:26 smithi156 ceph-mon[32679]: pgmap v19582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:29.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:28 smithi092 ceph-mon[29156]: pgmap v19583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:28 smithi189 ceph-mon[32756]: pgmap v19583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:29.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:28 smithi156 ceph-mon[32679]: pgmap v19583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:30.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36005.006920 secs 2024-04-27T04:18:30.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:29 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35307.972753 secs 2024-04-27T04:18:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36005.006920 secs 2024-04-27T04:18:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:29 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35307.972753 secs 2024-04-27T04:18:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36005.006920 secs 2024-04-27T04:18:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:29 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35307.972753 secs 2024-04-27T04:18:31.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:30 smithi092 ceph-mon[29156]: pgmap v19584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:31.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:30 smithi189 ceph-mon[32756]: pgmap v19584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:31.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:30 smithi156 ceph-mon[32679]: pgmap v19584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:33.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:32 smithi092 ceph-mon[29156]: pgmap v19585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:32 smithi189 ceph-mon[32756]: pgmap v19585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:33.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:32 smithi156 ceph-mon[32679]: pgmap v19585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:35.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:34 smithi092 ceph-mon[29156]: pgmap v19586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:35.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36010.007071 secs 2024-04-27T04:18:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:34 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35312.972864 secs 2024-04-27T04:18:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:34 smithi189 ceph-mon[32756]: pgmap v19586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36010.007071 secs 2024-04-27T04:18:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:34 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35312.972864 secs 2024-04-27T04:18:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:34 smithi156 ceph-mon[32679]: pgmap v19586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36010.007071 secs 2024-04-27T04:18:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:34 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35312.972864 secs 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80b6000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80b6000 comp rx=0 tx=0).stop 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T04:18:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T04:18:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.048+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:18:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.049+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80c1040 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T04:18:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T04:18:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T04:18:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:18:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=38 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T04:18:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:18:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T04:18:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:36.092+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T04:18:37.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:36 smithi189 ceph-mon[32756]: pgmap v19587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:37.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:36 smithi156 ceph-mon[32679]: pgmap v19587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:37.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:36 smithi092 ceph-mon[29156]: pgmap v19587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:38 smithi189 ceph-mon[32756]: pgmap v19588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:39.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:38 smithi156 ceph-mon[32679]: pgmap v19588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:38 smithi092 ceph-mon[29156]: pgmap v19588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36015.007210 secs 2024-04-27T04:18:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35317.972979 secs 2024-04-27T04:18:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36015.007210 secs 2024-04-27T04:18:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35317.972979 secs 2024-04-27T04:18:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36015.007210 secs 2024-04-27T04:18:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35317.972979 secs 2024-04-27T04:18:40.924 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:40.926+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:18:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:40.926+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:18:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:40.926+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:18:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:18:40.926+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 277 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:18:41.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:41 smithi189 ceph-mon[32756]: pgmap v19589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:41.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:41 smithi156 ceph-mon[32679]: pgmap v19589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:41.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:41 smithi092 ceph-mon[29156]: pgmap v19589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:43.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:43 smithi189 ceph-mon[32756]: pgmap v19590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:43.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:43 smithi156 ceph-mon[32679]: pgmap v19590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:43.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:43 smithi092 ceph-mon[29156]: pgmap v19590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:45 smithi189 ceph-mon[32756]: pgmap v19591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36020.007358 secs 2024-04-27T04:18:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35322.973044 secs 2024-04-27T04:18:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:45 smithi156 ceph-mon[32679]: pgmap v19591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36020.007358 secs 2024-04-27T04:18:45.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35322.973044 secs 2024-04-27T04:18:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:45 smithi092 ceph-mon[29156]: pgmap v19591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36020.007358 secs 2024-04-27T04:18:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35322.973044 secs 2024-04-27T04:18:47.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:47 smithi189 ceph-mon[32756]: pgmap v19592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:47 smithi156 ceph-mon[32679]: pgmap v19592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:47.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:47 smithi092 ceph-mon[29156]: pgmap v19592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:49 smithi189 ceph-mon[32756]: pgmap v19593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:49.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:49 smithi156 ceph-mon[32679]: pgmap v19593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:49 smithi092 ceph-mon[29156]: pgmap v19593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36025.007483 secs 2024-04-27T04:18:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35327.973162 secs 2024-04-27T04:18:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36025.007483 secs 2024-04-27T04:18:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35327.973162 secs 2024-04-27T04:18:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36025.007483 secs 2024-04-27T04:18:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35327.973162 secs 2024-04-27T04:18:51.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:51 smithi189 ceph-mon[32756]: pgmap v19594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:51.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:51 smithi156 ceph-mon[32679]: pgmap v19594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:51.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:51 smithi092 ceph-mon[29156]: pgmap v19594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:53 smithi189 ceph-mon[32756]: pgmap v19595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:53.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:53 smithi156 ceph-mon[32679]: pgmap v19595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:53.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:53 smithi092 ceph-mon[29156]: pgmap v19595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:55 smithi189 ceph-mon[32756]: pgmap v19596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36030.007599 secs 2024-04-27T04:18:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35332.973319 secs 2024-04-27T04:18:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:55 smithi156 ceph-mon[32679]: pgmap v19596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36030.007599 secs 2024-04-27T04:18:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35332.973319 secs 2024-04-27T04:18:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:55 smithi092 ceph-mon[29156]: pgmap v19596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:18:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36030.007599 secs 2024-04-27T04:18:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35332.973319 secs 2024-04-27T04:18:57.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:57 smithi189 ceph-mon[32756]: pgmap v19597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:57.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:57 smithi156 ceph-mon[32679]: pgmap v19597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:57.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:57 smithi092 ceph-mon[29156]: pgmap v19597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:59.293 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:18:59 smithi092 ceph-mon[29156]: pgmap v19598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:59.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:18:59 smithi189 ceph-mon[32756]: pgmap v19598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:18:59.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:18:59 smithi156 ceph-mon[32679]: pgmap v19598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:00.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36035.007720 secs 2024-04-27T04:19:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35337.973548 secs 2024-04-27T04:19:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36035.007720 secs 2024-04-27T04:19:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35337.973548 secs 2024-04-27T04:19:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36035.007720 secs 2024-04-27T04:19:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35337.973548 secs 2024-04-27T04:19:01.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:01 smithi189 ceph-mon[32756]: pgmap v19599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:01.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:01 smithi156 ceph-mon[32679]: pgmap v19599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:01.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:01 smithi092 ceph-mon[29156]: pgmap v19599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:03.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:03 smithi189 ceph-mon[32756]: pgmap v19600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:03.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:03 smithi156 ceph-mon[32679]: pgmap v19600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:03.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:03 smithi092 ceph-mon[29156]: pgmap v19600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:05 smithi189 ceph-mon[32756]: pgmap v19601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36040.007847 secs 2024-04-27T04:19:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35342.973667 secs 2024-04-27T04:19:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:05 smithi156 ceph-mon[32679]: pgmap v19601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36040.007847 secs 2024-04-27T04:19:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35342.973667 secs 2024-04-27T04:19:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:05 smithi092 ceph-mon[29156]: pgmap v19601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36040.007847 secs 2024-04-27T04:19:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35342.973667 secs 2024-04-27T04:19:07.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:07 smithi189 ceph-mon[32756]: pgmap v19602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:07.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:07 smithi156 ceph-mon[32679]: pgmap v19602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:07.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:07 smithi092 ceph-mon[29156]: pgmap v19602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:09 smithi189 ceph-mon[32756]: pgmap v19603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:09 smithi156 ceph-mon[32679]: pgmap v19603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:09 smithi092 ceph-mon[29156]: pgmap v19603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36045.007941 secs 2024-04-27T04:19:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35347.973788 secs 2024-04-27T04:19:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:19:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36045.007941 secs 2024-04-27T04:19:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35347.973788 secs 2024-04-27T04:19:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:19:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36045.007941 secs 2024-04-27T04:19:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35347.973788 secs 2024-04-27T04:19:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:19:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:11 smithi189 ceph-mon[32756]: pgmap v19604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:19:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:19:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:19:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:11 smithi156 ceph-mon[32679]: pgmap v19604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:19:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:19:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:19:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:11 smithi092 ceph-mon[29156]: pgmap v19604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:19:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:19:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:19:12.066 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:12 smithi092 ceph-mon[29156]: pgmap v19605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:19:12.066 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:12 smithi092 ceph-mon[29156]: pgmap v19606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:12.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:12 smithi189 ceph-mon[32756]: pgmap v19605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:19:12.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:12 smithi189 ceph-mon[32756]: pgmap v19606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:12.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:12 smithi156 ceph-mon[32679]: pgmap v19605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:19:12.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:12 smithi156 ceph-mon[32679]: pgmap v19606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:14.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:14 smithi189 ceph-mon[32756]: pgmap v19607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:14.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:14 smithi156 ceph-mon[32679]: pgmap v19607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:14.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:14 smithi092 ceph-mon[29156]: pgmap v19607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:15.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36050.008046 secs 2024-04-27T04:19:15.333 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:15 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35352.973951 secs 2024-04-27T04:19:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36050.008046 secs 2024-04-27T04:19:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:15 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35352.973951 secs 2024-04-27T04:19:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36050.008046 secs 2024-04-27T04:19:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:15 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35352.973951 secs 2024-04-27T04:19:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:16 smithi189 ceph-mon[32756]: pgmap v19608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:16.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:16 smithi156 ceph-mon[32679]: pgmap v19608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:16.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:16 smithi092 ceph-mon[29156]: pgmap v19608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:18.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:18 smithi189 ceph-mon[32756]: pgmap v19609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:18.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:18 smithi156 ceph-mon[32679]: pgmap v19609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:18.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:18 smithi092 ceph-mon[29156]: pgmap v19609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:19:20.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:20 smithi189 ceph-mon[32756]: pgmap v19610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36055.008163 secs 2024-04-27T04:19:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35357.974084 secs 2024-04-27T04:19:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:20 smithi156 ceph-mon[32679]: pgmap v19610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36055.008163 secs 2024-04-27T04:19:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35357.974084 secs 2024-04-27T04:19:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:20 smithi092 ceph-mon[29156]: pgmap v19610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:19:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36055.008163 secs 2024-04-27T04:19:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35357.974084 secs 2024-04-27T04:19:22.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:22 smithi189 ceph-mon[32756]: pgmap v19611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:19:22.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:22 smithi156 ceph-mon[32679]: pgmap v19611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:19:22.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:22 smithi092 ceph-mon[29156]: pgmap v19611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:19:24.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:24 smithi189 ceph-mon[32756]: pgmap v19612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:24.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:24 smithi156 ceph-mon[32679]: pgmap v19612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:24 smithi092 ceph-mon[29156]: pgmap v19612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:25.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36060.008281 secs 2024-04-27T04:19:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35362.974232 secs 2024-04-27T04:19:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36060.008281 secs 2024-04-27T04:19:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35362.974232 secs 2024-04-27T04:19:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36060.008281 secs 2024-04-27T04:19:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35362.974232 secs 2024-04-27T04:19:26.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:26 smithi189 ceph-mon[32756]: pgmap v19613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:26.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:26 smithi156 ceph-mon[32679]: pgmap v19613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:26 smithi092 ceph-mon[29156]: pgmap v19613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:28.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:28 smithi189 ceph-mon[32756]: pgmap v19614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:28.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:28 smithi156 ceph-mon[32679]: pgmap v19614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:28.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:28 smithi092 ceph-mon[29156]: pgmap v19614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:30.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:30 smithi189 ceph-mon[32756]: pgmap v19615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36065.008364 secs 2024-04-27T04:19:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35367.974387 secs 2024-04-27T04:19:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:30 smithi156 ceph-mon[32679]: pgmap v19615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36065.008364 secs 2024-04-27T04:19:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35367.974387 secs 2024-04-27T04:19:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:30 smithi092 ceph-mon[29156]: pgmap v19615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36065.008364 secs 2024-04-27T04:19:30.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35367.974387 secs 2024-04-27T04:19:32.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:32 smithi189 ceph-mon[32756]: pgmap v19616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:32.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:32 smithi156 ceph-mon[32679]: pgmap v19616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:32 smithi092 ceph-mon[29156]: pgmap v19616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:34.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:34 smithi189 ceph-mon[32756]: pgmap v19617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:34.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:34 smithi156 ceph-mon[32679]: pgmap v19617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:34 smithi092 ceph-mon[29156]: pgmap v19617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:35.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36070.008483 secs 2024-04-27T04:19:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35372.974453 secs 2024-04-27T04:19:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36070.008483 secs 2024-04-27T04:19:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35372.974453 secs 2024-04-27T04:19:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36070.008483 secs 2024-04-27T04:19:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35372.974453 secs 2024-04-27T04:19:36.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:36 smithi189 ceph-mon[32756]: pgmap v19618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:36.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:36 smithi156 ceph-mon[32679]: pgmap v19618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:36.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:36 smithi092 ceph-mon[29156]: pgmap v19618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:38.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:38 smithi092 ceph-mon[29156]: pgmap v19619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:38.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:38 smithi189 ceph-mon[32756]: pgmap v19619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:38.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:38 smithi156 ceph-mon[32679]: pgmap v19619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:40 smithi189 ceph-mon[32756]: pgmap v19620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36075.008603 secs 2024-04-27T04:19:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35377.974599 secs 2024-04-27T04:19:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:40 smithi156 ceph-mon[32679]: pgmap v19620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36075.008603 secs 2024-04-27T04:19:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35377.974599 secs 2024-04-27T04:19:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:40 smithi092 ceph-mon[29156]: pgmap v19620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36075.008603 secs 2024-04-27T04:19:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35377.974599 secs 2024-04-27T04:19:42.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:42 smithi189 ceph-mon[32756]: pgmap v19621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:42.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:42 smithi156 ceph-mon[32679]: pgmap v19621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:42.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:42 smithi092 ceph-mon[29156]: pgmap v19621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:44.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:44 smithi189 ceph-mon[32756]: pgmap v19622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:44.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:44 smithi156 ceph-mon[32679]: pgmap v19622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:44.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:44 smithi092 ceph-mon[29156]: pgmap v19622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36080.008718 secs 2024-04-27T04:19:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35382.974662 secs 2024-04-27T04:19:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36080.008718 secs 2024-04-27T04:19:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35382.974662 secs 2024-04-27T04:19:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36080.008718 secs 2024-04-27T04:19:45.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35382.974662 secs 2024-04-27T04:19:46.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:46 smithi156 ceph-mon[32679]: pgmap v19623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:46.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:46 smithi092 ceph-mon[29156]: pgmap v19623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:46.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:46 smithi189 ceph-mon[32756]: pgmap v19623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:48 smithi156 ceph-mon[32679]: pgmap v19624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:48 smithi092 ceph-mon[29156]: pgmap v19624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:48.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:48 smithi189 ceph-mon[32756]: pgmap v19624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:50 smithi156 ceph-mon[32679]: pgmap v19625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36085.008856 secs 2024-04-27T04:19:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35387.974736 secs 2024-04-27T04:19:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:50 smithi092 ceph-mon[29156]: pgmap v19625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36085.008856 secs 2024-04-27T04:19:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35387.974736 secs 2024-04-27T04:19:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:50 smithi189 ceph-mon[32756]: pgmap v19625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36085.008856 secs 2024-04-27T04:19:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35387.974736 secs 2024-04-27T04:19:52.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:52 smithi156 ceph-mon[32679]: pgmap v19626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:52.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:52 smithi092 ceph-mon[29156]: pgmap v19626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:52.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:52 smithi189 ceph-mon[32756]: pgmap v19626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:54.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:54 smithi156 ceph-mon[32679]: pgmap v19627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:54.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:54 smithi092 ceph-mon[29156]: pgmap v19627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:54.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:54 smithi189 ceph-mon[32756]: pgmap v19627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36090.008966 secs 2024-04-27T04:19:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35392.974797 secs 2024-04-27T04:19:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36090.008966 secs 2024-04-27T04:19:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35392.974797 secs 2024-04-27T04:19:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36090.008966 secs 2024-04-27T04:19:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35392.974797 secs 2024-04-27T04:19:56.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:56 smithi156 ceph-mon[32679]: pgmap v19628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:56.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:56 smithi092 ceph-mon[29156]: pgmap v19628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:56.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:56 smithi189 ceph-mon[32756]: pgmap v19628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:19:58.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:19:58 smithi156 ceph-mon[32679]: pgmap v19629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:58.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:19:58 smithi092 ceph-mon[29156]: pgmap v19629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:19:58.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:19:58 smithi189 ceph-mon[32756]: pgmap v19629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:00 smithi156 ceph-mon[32679]: pgmap v19630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36095.009086 secs 2024-04-27T04:20:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35397.974913 secs 2024-04-27T04:20:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:20:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:00 smithi092 ceph-mon[29156]: pgmap v19630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36095.009086 secs 2024-04-27T04:20:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35397.974913 secs 2024-04-27T04:20:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:20:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:00 smithi189 ceph-mon[32756]: pgmap v19630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36095.009086 secs 2024-04-27T04:20:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35397.974913 secs 2024-04-27T04:20:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:20:02.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:02 smithi156 ceph-mon[32679]: pgmap v19631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:02.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:02 smithi092 ceph-mon[29156]: pgmap v19631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:02.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:02 smithi189 ceph-mon[32756]: pgmap v19631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:04.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:04 smithi156 ceph-mon[32679]: pgmap v19632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:04.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:04 smithi092 ceph-mon[29156]: pgmap v19632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:04.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:04 smithi189 ceph-mon[32756]: pgmap v19632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36100.009190 secs 2024-04-27T04:20:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35402.975030 secs 2024-04-27T04:20:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36100.009190 secs 2024-04-27T04:20:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35402.975030 secs 2024-04-27T04:20:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36100.009190 secs 2024-04-27T04:20:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35402.975030 secs 2024-04-27T04:20:06.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:06 smithi156 ceph-mon[32679]: pgmap v19633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:06.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:06 smithi092 ceph-mon[29156]: pgmap v19633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:06.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:06 smithi189 ceph-mon[32756]: pgmap v19633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:08.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:08 smithi156 ceph-mon[32679]: pgmap v19634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:08.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:08 smithi092 ceph-mon[29156]: pgmap v19634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:08.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:08 smithi189 ceph-mon[32756]: pgmap v19634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-mon[29156]: pgmap v19635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36105.009250 secs 2024-04-27T04:20:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35407.975144 secs 2024-04-27T04:20:10.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:10 smithi189 ceph-mon[32756]: pgmap v19635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36105.009250 secs 2024-04-27T04:20:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35407.975144 secs 2024-04-27T04:20:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:10 smithi156 ceph-mon[32679]: pgmap v19635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36105.009250 secs 2024-04-27T04:20:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35407.975144 secs 2024-04-27T04:20:10.991 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:20:10.516+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:20:10.991 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:20:10.516+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:20:10.991 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:20:10.516+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:20:10.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:20:10.516+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:20:10.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:20:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:20:10.516+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:20:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:20:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:20:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:20:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:20:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:20:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:20:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:20:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:20:11.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:20:11.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:20:11.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:20:11.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:20:12.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:12 smithi092 ceph-mon[29156]: pgmap v19636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:12.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:12 smithi092 ceph-mon[29156]: pgmap v19637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:20:12.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:12 smithi092 ceph-mon[29156]: pgmap v19638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:20:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:12 smithi189 ceph-mon[32756]: pgmap v19636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:12 smithi189 ceph-mon[32756]: pgmap v19637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:20:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:12 smithi189 ceph-mon[32756]: pgmap v19638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:20:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:12 smithi156 ceph-mon[32679]: pgmap v19636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:12 smithi156 ceph-mon[32679]: pgmap v19637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:20:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:12 smithi156 ceph-mon[32679]: pgmap v19638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:20:13.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:13 smithi189 ceph-mon[32756]: pgmap v19639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:20:13.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:13 smithi156 ceph-mon[32679]: pgmap v19639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:20:13.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:13 smithi092 ceph-mon[29156]: pgmap v19639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:20:14.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:14 smithi189 ceph-mon[32756]: 28 slow requests, 1 included below; oldest blocked for > 35412.975265 secs 2024-04-27T04:20:14.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:14 smithi189 ceph-mon[32756]: slow request 2884.419715 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:20:14.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:14 smithi156 ceph-mon[32679]: 28 slow requests, 1 included below; oldest blocked for > 35412.975265 secs 2024-04-27T04:20:14.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:14 smithi156 ceph-mon[32679]: slow request 2884.419715 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:20:14.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:14 smithi092 ceph-mon[29156]: 28 slow requests, 1 included below; oldest blocked for > 35412.975265 secs 2024-04-27T04:20:14.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:14 smithi092 ceph-mon[29156]: slow request 2884.419715 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:20:15.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36110.009372 secs 2024-04-27T04:20:15.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:15 smithi189 ceph-mon[32756]: pgmap v19640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:15.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36110.009372 secs 2024-04-27T04:20:15.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:15 smithi156 ceph-mon[32679]: pgmap v19640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:15.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36110.009372 secs 2024-04-27T04:20:15.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:15 smithi092 ceph-mon[29156]: pgmap v19640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:18.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:18 smithi092 ceph-mon[29156]: pgmap v19641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:18.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:18 smithi189 ceph-mon[32756]: pgmap v19641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:18 smithi156 ceph-mon[32679]: pgmap v19641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36115.009507 secs 2024-04-27T04:20:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35417.975384 secs 2024-04-27T04:20:20.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:20 smithi092 ceph-mon[29156]: pgmap v19642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:20.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36115.009507 secs 2024-04-27T04:20:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35417.975384 secs 2024-04-27T04:20:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:20 smithi189 ceph-mon[32756]: pgmap v19642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36115.009507 secs 2024-04-27T04:20:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35417.975384 secs 2024-04-27T04:20:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:20 smithi156 ceph-mon[32679]: pgmap v19642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 701 B/s wr, 20 op/s 2024-04-27T04:20:22.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:22 smithi092 ceph-mon[29156]: pgmap v19643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 614 B/s wr, 18 op/s 2024-04-27T04:20:22.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:22 smithi189 ceph-mon[32756]: pgmap v19643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 614 B/s wr, 18 op/s 2024-04-27T04:20:22.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:22 smithi156 ceph-mon[32679]: pgmap v19643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 614 B/s wr, 18 op/s 2024-04-27T04:20:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:24 smithi092 ceph-mon[29156]: pgmap v19644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:20:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:24 smithi189 ceph-mon[32756]: pgmap v19644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:20:24.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:24 smithi156 ceph-mon[32679]: pgmap v19644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 511 B/s wr, 15 op/s 2024-04-27T04:20:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36120.009612 secs 2024-04-27T04:20:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35422.975513 secs 2024-04-27T04:20:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36120.009612 secs 2024-04-27T04:20:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35422.975513 secs 2024-04-27T04:20:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36120.009612 secs 2024-04-27T04:20:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35422.975513 secs 2024-04-27T04:20:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:26 smithi092 ceph-mon[29156]: pgmap v19645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:20:26.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:26 smithi189 ceph-mon[32756]: pgmap v19645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:20:26.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:26 smithi156 ceph-mon[32679]: pgmap v19645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 511 B/s wr, 16 op/s 2024-04-27T04:20:28.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:28 smithi092 ceph-mon[29156]: pgmap v19646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:28.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:28 smithi189 ceph-mon[32756]: pgmap v19646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:28.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:28 smithi156 ceph-mon[32679]: pgmap v19646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36125.009745 secs 2024-04-27T04:20:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35427.975627 secs 2024-04-27T04:20:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:30 smithi092 ceph-mon[29156]: pgmap v19647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36125.009745 secs 2024-04-27T04:20:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35427.975627 secs 2024-04-27T04:20:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:30 smithi189 ceph-mon[32756]: pgmap v19647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36125.009745 secs 2024-04-27T04:20:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35427.975627 secs 2024-04-27T04:20:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:30 smithi156 ceph-mon[32679]: pgmap v19647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:32 smithi092 ceph-mon[29156]: pgmap v19648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:32.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:32 smithi189 ceph-mon[32756]: pgmap v19648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:32.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:32 smithi156 ceph-mon[32679]: pgmap v19648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:34 smithi189 ceph-mon[32756]: pgmap v19649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:34.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:34 smithi156 ceph-mon[32679]: pgmap v19649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:34.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:34 smithi092 ceph-mon[29156]: pgmap v19649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36130.009852 secs 2024-04-27T04:20:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35432.975760 secs 2024-04-27T04:20:35.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36130.009852 secs 2024-04-27T04:20:35.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35432.975760 secs 2024-04-27T04:20:35.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36130.009852 secs 2024-04-27T04:20:35.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35432.975760 secs 2024-04-27T04:20:36.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:36 smithi189 ceph-mon[32756]: pgmap v19650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:36.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:36 smithi156 ceph-mon[32679]: pgmap v19650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:36.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:36 smithi092 ceph-mon[29156]: pgmap v19650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:38.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:38 smithi189 ceph-mon[32756]: pgmap v19651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:38.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:38 smithi156 ceph-mon[32679]: pgmap v19651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:38.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:38 smithi092 ceph-mon[29156]: pgmap v19651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36135.009965 secs 2024-04-27T04:20:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35437.975865 secs 2024-04-27T04:20:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:40 smithi189 ceph-mon[32756]: pgmap v19652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36135.009965 secs 2024-04-27T04:20:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35437.975865 secs 2024-04-27T04:20:40.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:40 smithi156 ceph-mon[32679]: pgmap v19652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:40.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36135.009965 secs 2024-04-27T04:20:40.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35437.975865 secs 2024-04-27T04:20:40.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:40 smithi092 ceph-mon[29156]: pgmap v19652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:42.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:42 smithi189 ceph-mon[32756]: pgmap v19653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:42.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:42 smithi156 ceph-mon[32679]: pgmap v19653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:42.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:42 smithi092 ceph-mon[29156]: pgmap v19653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:44.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:44 smithi189 ceph-mon[32756]: pgmap v19654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:44.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:44 smithi156 ceph-mon[32679]: pgmap v19654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:44.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:44 smithi092 ceph-mon[29156]: pgmap v19654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:45.582 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36140.010076 secs 2024-04-27T04:20:45.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35442.976009 secs 2024-04-27T04:20:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36140.010076 secs 2024-04-27T04:20:45.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35442.976009 secs 2024-04-27T04:20:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36140.010076 secs 2024-04-27T04:20:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35442.976009 secs 2024-04-27T04:20:46.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:46 smithi189 ceph-mon[32756]: pgmap v19655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:46.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:46 smithi156 ceph-mon[32679]: pgmap v19655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:46.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:46 smithi092 ceph-mon[29156]: pgmap v19655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:47.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:47 smithi189 ceph-mon[32756]: pgmap v19656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:47.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:47 smithi156 ceph-mon[32679]: pgmap v19656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:47.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:47 smithi092 ceph-mon[29156]: pgmap v19656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36145.010235 secs 2024-04-27T04:20:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35447.976098 secs 2024-04-27T04:20:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:50 smithi092 ceph-mon[29156]: pgmap v19657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36145.010235 secs 2024-04-27T04:20:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35447.976098 secs 2024-04-27T04:20:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:50 smithi189 ceph-mon[32756]: pgmap v19657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36145.010235 secs 2024-04-27T04:20:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35447.976098 secs 2024-04-27T04:20:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:50 smithi156 ceph-mon[32679]: pgmap v19657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:52.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:52 smithi092 ceph-mon[29156]: pgmap v19658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:52.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:52 smithi189 ceph-mon[32756]: pgmap v19658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:52.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:52 smithi156 ceph-mon[32679]: pgmap v19658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:54.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:54 smithi092 ceph-mon[29156]: pgmap v19659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:54.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:54 smithi189 ceph-mon[32756]: pgmap v19659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:54.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:54 smithi156 ceph-mon[32679]: pgmap v19659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36150.010350 secs 2024-04-27T04:20:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35452.976217 secs 2024-04-27T04:20:55.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36150.010350 secs 2024-04-27T04:20:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35452.976217 secs 2024-04-27T04:20:55.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36150.010350 secs 2024-04-27T04:20:55.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35452.976217 secs 2024-04-27T04:20:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:20:55.945+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:20:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:20:55.945+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:20:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:20:55.945+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:20:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:20:55.945+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 278 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:20:56.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:56 smithi092 ceph-mon[29156]: pgmap v19660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:56.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:56 smithi189 ceph-mon[32756]: pgmap v19660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:56.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:56 smithi156 ceph-mon[32679]: pgmap v19660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:20:58.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:20:58 smithi189 ceph-mon[32756]: pgmap v19661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:58.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:20:58 smithi156 ceph-mon[32679]: pgmap v19661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:20:58.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:20:58 smithi092 ceph-mon[29156]: pgmap v19661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:00.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36155.010462 secs 2024-04-27T04:21:00.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35457.976354 secs 2024-04-27T04:21:00.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:00 smithi092 ceph-mon[29156]: pgmap v19662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:00.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36155.010462 secs 2024-04-27T04:21:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35457.976354 secs 2024-04-27T04:21:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:00 smithi189 ceph-mon[32756]: pgmap v19662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36155.010462 secs 2024-04-27T04:21:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35457.976354 secs 2024-04-27T04:21:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:00 smithi156 ceph-mon[32679]: pgmap v19662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:02.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:02 smithi189 ceph-mon[32756]: pgmap v19663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:02.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:02 smithi156 ceph-mon[32679]: pgmap v19663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:02.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:02 smithi092 ceph-mon[29156]: pgmap v19663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:04.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:04 smithi189 ceph-mon[32756]: pgmap v19664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:04.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:04 smithi156 ceph-mon[32679]: pgmap v19664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:04.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:04 smithi092 ceph-mon[29156]: pgmap v19664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:05.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36160.010552 secs 2024-04-27T04:21:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35462.976428 secs 2024-04-27T04:21:05.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36160.010552 secs 2024-04-27T04:21:05.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35462.976428 secs 2024-04-27T04:21:05.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36160.010552 secs 2024-04-27T04:21:05.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35462.976428 secs 2024-04-27T04:21:06.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:06 smithi189 ceph-mon[32756]: pgmap v19665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:06.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:06 smithi156 ceph-mon[32679]: pgmap v19665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:06.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:06 smithi092 ceph-mon[29156]: pgmap v19665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:08.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:08 smithi189 ceph-mon[32756]: pgmap v19666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:08.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:08 smithi156 ceph-mon[32679]: pgmap v19666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:08.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:08 smithi092 ceph-mon[29156]: pgmap v19666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:10.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36165.010674 secs 2024-04-27T04:21:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:10 smithi189 ceph-mon[32756]: 28 slow requests, 1 included below; oldest blocked for > 35467.976542 secs 2024-04-27T04:21:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:10 smithi189 ceph-mon[32756]: slow request 5760.137508 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:10 smithi189 ceph-mon[32756]: pgmap v19667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36165.010674 secs 2024-04-27T04:21:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:10 smithi156 ceph-mon[32679]: 28 slow requests, 1 included below; oldest blocked for > 35467.976542 secs 2024-04-27T04:21:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:10 smithi156 ceph-mon[32679]: slow request 5760.137508 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:10 smithi156 ceph-mon[32679]: pgmap v19667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36165.010674 secs 2024-04-27T04:21:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:10 smithi092 ceph-mon[29156]: 28 slow requests, 1 included below; oldest blocked for > 35467.976542 secs 2024-04-27T04:21:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:10 smithi092 ceph-mon[29156]: slow request 5760.137508 seconds old, received at 2024-04-27T02:45:08.985068+0000: client_request(client.17415:1 getattr pAsLsXsFs #0x1 2024-04-27T02:45:08.981869+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:10 smithi092 ceph-mon[29156]: pgmap v19667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:11.610 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:21:11.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:21:11.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:21:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:12 smithi189 ceph-mon[32756]: pgmap v19668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:21:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:21:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:21:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:12 smithi156 ceph-mon[32679]: pgmap v19668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:21:12.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:21:12.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:21:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:12 smithi092 ceph-mon[29156]: pgmap v19668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:21:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:21:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:21:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:21:13.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:13 smithi189 ceph-mon[32756]: pgmap v19669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:21:13.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:13 smithi189 ceph-mon[32756]: pgmap v19670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:13.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:13 smithi156 ceph-mon[32679]: pgmap v19669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:21:13.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:13 smithi156 ceph-mon[32679]: pgmap v19670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:13.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:13 smithi092 ceph-mon[29156]: pgmap v19669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-27T04:21:13.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:13 smithi092 ceph-mon[29156]: pgmap v19670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:21:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:14 smithi189 ceph-mon[32756]: pgmap v19671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:14.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:14 smithi156 ceph-mon[32679]: pgmap v19671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:14 smithi092 ceph-mon[29156]: pgmap v19671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:15.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36170.010796 secs 2024-04-27T04:21:15.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:15 smithi156 ceph-mon[32679]: 28 slow requests, 1 included below; oldest blocked for > 35472.976679 secs 2024-04-27T04:21:15.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:15 smithi156 ceph-mon[32679]: slow request 363.722983 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:15.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36170.010796 secs 2024-04-27T04:21:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:15 smithi189 ceph-mon[32756]: 28 slow requests, 1 included below; oldest blocked for > 35472.976679 secs 2024-04-27T04:21:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:15 smithi189 ceph-mon[32756]: slow request 363.722983 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:15.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36170.010796 secs 2024-04-27T04:21:15.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:15 smithi092 ceph-mon[29156]: 28 slow requests, 1 included below; oldest blocked for > 35472.976679 secs 2024-04-27T04:21:15.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:15 smithi092 ceph-mon[29156]: slow request 363.722983 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:21:16.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:16 smithi189 ceph-mon[32756]: pgmap v19672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:16.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:16 smithi156 ceph-mon[32679]: pgmap v19672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:16 smithi092 ceph-mon[29156]: pgmap v19672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:19.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:18 smithi092 ceph-mon[29156]: pgmap v19673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:21:19.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:18 smithi189 ceph-mon[32756]: pgmap v19673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:21:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:18 smithi156 ceph-mon[32679]: pgmap v19673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:21:20.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36175.010918 secs 2024-04-27T04:21:20.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35477.976817 secs 2024-04-27T04:21:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36175.010918 secs 2024-04-27T04:21:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35477.976817 secs 2024-04-27T04:21:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36175.010918 secs 2024-04-27T04:21:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35477.976817 secs 2024-04-27T04:21:21.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:21 smithi189 ceph-mon[32756]: pgmap v19674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:21.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:21 smithi156 ceph-mon[32679]: pgmap v19674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:21.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:21 smithi092 ceph-mon[29156]: pgmap v19674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:21:23.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:23 smithi189 ceph-mon[32756]: pgmap v19675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:21:23.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:23 smithi156 ceph-mon[32679]: pgmap v19675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:21:23.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:23 smithi092 ceph-mon[29156]: pgmap v19675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:21:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36180.011036 secs 2024-04-27T04:21:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:25 smithi189 ceph-mon[32756]: pgmap v19676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35482.976914 secs 2024-04-27T04:21:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36180.011036 secs 2024-04-27T04:21:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:25 smithi156 ceph-mon[32679]: pgmap v19676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35482.976914 secs 2024-04-27T04:21:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36180.011036 secs 2024-04-27T04:21:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:25 smithi092 ceph-mon[29156]: pgmap v19676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35482.976914 secs 2024-04-27T04:21:27.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:27 smithi092 ceph-mon[29156]: pgmap v19677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:27.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:27 smithi189 ceph-mon[32756]: pgmap v19677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:27.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:27 smithi156 ceph-mon[32679]: pgmap v19677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:29.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:29 smithi189 ceph-mon[32756]: pgmap v19678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:29.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:29 smithi156 ceph-mon[32679]: pgmap v19678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:29.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:29 smithi092 ceph-mon[29156]: pgmap v19678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:30.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36185.011143 secs 2024-04-27T04:21:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35487.977067 secs 2024-04-27T04:21:30.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36185.011143 secs 2024-04-27T04:21:30.393 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35487.977067 secs 2024-04-27T04:21:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36185.011143 secs 2024-04-27T04:21:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35487.977067 secs 2024-04-27T04:21:31.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:31 smithi189 ceph-mon[32756]: pgmap v19679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:31.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:31 smithi156 ceph-mon[32679]: pgmap v19679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:31.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:31 smithi092 ceph-mon[29156]: pgmap v19679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:33 smithi189 ceph-mon[32756]: pgmap v19680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:33.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:33 smithi156 ceph-mon[32679]: pgmap v19680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:33.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:33 smithi092 ceph-mon[29156]: pgmap v19680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36190.011264 secs 2024-04-27T04:21:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:35 smithi189 ceph-mon[32756]: pgmap v19681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:35.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35492.977215 secs 2024-04-27T04:21:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36190.011264 secs 2024-04-27T04:21:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:35 smithi156 ceph-mon[32679]: pgmap v19681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35492.977215 secs 2024-04-27T04:21:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36190.011264 secs 2024-04-27T04:21:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:35 smithi092 ceph-mon[29156]: pgmap v19681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35492.977215 secs 2024-04-27T04:21:37.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:37 smithi189 ceph-mon[32756]: pgmap v19682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:37.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:37 smithi156 ceph-mon[32679]: pgmap v19682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:37.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:37 smithi092 ceph-mon[29156]: pgmap v19682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:39.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:39 smithi189 ceph-mon[32756]: pgmap v19683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:39.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:39 smithi156 ceph-mon[32679]: pgmap v19683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:39.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:39 smithi092 ceph-mon[29156]: pgmap v19683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:40.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36195.011400 secs 2024-04-27T04:21:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35497.977334 secs 2024-04-27T04:21:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36195.011400 secs 2024-04-27T04:21:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35497.977334 secs 2024-04-27T04:21:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36195.011400 secs 2024-04-27T04:21:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35497.977334 secs 2024-04-27T04:21:40.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:21:40.950+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:21:40.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:21:40.950+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:21:40.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:21:40.951+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:21:40.949 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:21:40.951+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 279 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:21:41.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:41 smithi189 ceph-mon[32756]: pgmap v19684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:41.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:41 smithi156 ceph-mon[32679]: pgmap v19684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:41.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:41 smithi092 ceph-mon[29156]: pgmap v19684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:43.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:43 smithi092 ceph-mon[29156]: pgmap v19685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:43.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:43 smithi189 ceph-mon[32756]: pgmap v19685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:43.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:43 smithi156 ceph-mon[32679]: pgmap v19685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:45.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36200.011514 secs 2024-04-27T04:21:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:45 smithi189 ceph-mon[32756]: pgmap v19686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35502.977454 secs 2024-04-27T04:21:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36200.011514 secs 2024-04-27T04:21:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:45 smithi156 ceph-mon[32679]: pgmap v19686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:45.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35502.977454 secs 2024-04-27T04:21:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36200.011514 secs 2024-04-27T04:21:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:45 smithi092 ceph-mon[29156]: pgmap v19686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35502.977454 secs 2024-04-27T04:21:47.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:47 smithi189 ceph-mon[32756]: pgmap v19687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:47 smithi156 ceph-mon[32679]: pgmap v19687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:47.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:47 smithi092 ceph-mon[29156]: pgmap v19687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:49.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:49 smithi189 ceph-mon[32756]: pgmap v19688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:49.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:49 smithi156 ceph-mon[32679]: pgmap v19688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:49.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:49 smithi092 ceph-mon[29156]: pgmap v19688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:50.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36205.011623 secs 2024-04-27T04:21:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35507.977546 secs 2024-04-27T04:21:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36205.011623 secs 2024-04-27T04:21:50.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35507.977546 secs 2024-04-27T04:21:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36205.011623 secs 2024-04-27T04:21:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35507.977546 secs 2024-04-27T04:21:51.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:51 smithi189 ceph-mon[32756]: pgmap v19689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:51.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:51 smithi156 ceph-mon[32679]: pgmap v19689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:51.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:51 smithi092 ceph-mon[29156]: pgmap v19689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:53.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:53 smithi189 ceph-mon[32756]: pgmap v19690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:53.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:53 smithi156 ceph-mon[32679]: pgmap v19690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:53.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:53 smithi092 ceph-mon[29156]: pgmap v19690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36210.011695 secs 2024-04-27T04:21:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:55 smithi189 ceph-mon[32756]: pgmap v19691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:55.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35512.977622 secs 2024-04-27T04:21:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36210.011695 secs 2024-04-27T04:21:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:55 smithi156 ceph-mon[32679]: pgmap v19691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:55.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35512.977622 secs 2024-04-27T04:21:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36210.011695 secs 2024-04-27T04:21:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:55 smithi092 ceph-mon[29156]: pgmap v19691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:21:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35512.977622 secs 2024-04-27T04:21:57.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:57 smithi189 ceph-mon[32756]: pgmap v19692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:57.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:57 smithi156 ceph-mon[32679]: pgmap v19692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:57.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:57 smithi092 ceph-mon[29156]: pgmap v19692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:59.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:21:59 smithi189 ceph-mon[32756]: pgmap v19693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:59.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:21:59 smithi156 ceph-mon[32679]: pgmap v19693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:21:59.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:21:59 smithi092 ceph-mon[29156]: pgmap v19693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:00.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36215.011798 secs 2024-04-27T04:22:00.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35517.977734 secs 2024-04-27T04:22:00.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36215.011798 secs 2024-04-27T04:22:00.392 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35517.977734 secs 2024-04-27T04:22:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36215.011798 secs 2024-04-27T04:22:00.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35517.977734 secs 2024-04-27T04:22:01.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:01 smithi189 ceph-mon[32756]: pgmap v19694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:01.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:01 smithi156 ceph-mon[32679]: pgmap v19694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:01.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:01 smithi092 ceph-mon[29156]: pgmap v19694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:03.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:03 smithi189 ceph-mon[32756]: pgmap v19695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:03.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:03 smithi156 ceph-mon[32679]: pgmap v19695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:03.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:03 smithi092 ceph-mon[29156]: pgmap v19695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36220.011889 secs 2024-04-27T04:22:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:05 smithi189 ceph-mon[32756]: pgmap v19696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:05.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35522.977799 secs 2024-04-27T04:22:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36220.011889 secs 2024-04-27T04:22:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:05 smithi156 ceph-mon[32679]: pgmap v19696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:05.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35522.977799 secs 2024-04-27T04:22:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36220.011889 secs 2024-04-27T04:22:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:05 smithi092 ceph-mon[29156]: pgmap v19696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35522.977799 secs 2024-04-27T04:22:07.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:07 smithi189 ceph-mon[32756]: pgmap v19697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:07.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:07 smithi156 ceph-mon[32679]: pgmap v19697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:07.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:07 smithi092 ceph-mon[29156]: pgmap v19697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:09 smithi189 ceph-mon[32756]: pgmap v19698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:09.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:09 smithi156 ceph-mon[32679]: pgmap v19698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:09.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:09 smithi092 ceph-mon[29156]: pgmap v19698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36225.012024 secs 2024-04-27T04:22:10.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35527.977905 secs 2024-04-27T04:22:10.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36225.012024 secs 2024-04-27T04:22:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35527.977905 secs 2024-04-27T04:22:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36225.012024 secs 2024-04-27T04:22:10.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35527.977905 secs 2024-04-27T04:22:11.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:11 smithi189 ceph-mon[32756]: pgmap v19699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:11.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:11 smithi156 ceph-mon[32679]: pgmap v19699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:11.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:11 smithi092 ceph-mon[29156]: pgmap v19699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:12.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:12 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:22:12.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:12 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:22:12.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:12 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:22:13.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:13 smithi189 ceph-mon[32756]: pgmap v19700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:22:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:22:13.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:22:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:13 smithi156 ceph-mon[32679]: pgmap v19700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:22:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:22:13.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:22:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:13 smithi092 ceph-mon[29156]: pgmap v19700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:22:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:22:13.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:22:14.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:14 smithi189 ceph-mon[32756]: pgmap v19701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:22:14.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:14 smithi189 ceph-mon[32756]: pgmap v19702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:22:14.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:14 smithi156 ceph-mon[32679]: pgmap v19701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:22:14.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:14 smithi156 ceph-mon[32679]: pgmap v19702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:22:14.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:14 smithi092 ceph-mon[29156]: pgmap v19701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:22:14.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:14 smithi092 ceph-mon[29156]: pgmap v19702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:22:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36230.012163 secs 2024-04-27T04:22:15.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:15 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35532.977974 secs 2024-04-27T04:22:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36230.012163 secs 2024-04-27T04:22:15.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:15 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35532.977974 secs 2024-04-27T04:22:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36230.012163 secs 2024-04-27T04:22:15.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:15 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35532.977974 secs 2024-04-27T04:22:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:16 smithi189 ceph-mon[32756]: pgmap v19703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:16.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:16 smithi156 ceph-mon[32679]: pgmap v19703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:16.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:16 smithi092 ceph-mon[29156]: pgmap v19703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:18.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:18 smithi189 ceph-mon[32756]: pgmap v19704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:18.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:18 smithi156 ceph-mon[32679]: pgmap v19704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:18.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:18 smithi092 ceph-mon[29156]: pgmap v19704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:20 smithi156 ceph-mon[32679]: pgmap v19705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36235.012288 secs 2024-04-27T04:22:20.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35537.978107 secs 2024-04-27T04:22:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:20 smithi092 ceph-mon[29156]: pgmap v19705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36235.012288 secs 2024-04-27T04:22:20.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35537.978107 secs 2024-04-27T04:22:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:20 smithi189 ceph-mon[32756]: pgmap v19705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36235.012288 secs 2024-04-27T04:22:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35537.978107 secs 2024-04-27T04:22:22.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:22 smithi156 ceph-mon[32679]: pgmap v19706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:22.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:22 smithi092 ceph-mon[29156]: pgmap v19706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:22.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:22 smithi189 ceph-mon[32756]: pgmap v19706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:22:24.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:24 smithi156 ceph-mon[32679]: pgmap v19707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:22:24.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:24 smithi092 ceph-mon[29156]: pgmap v19707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:22:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:24 smithi189 ceph-mon[32756]: pgmap v19707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:22:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36240.012403 secs 2024-04-27T04:22:25.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35542.978181 secs 2024-04-27T04:22:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36240.012403 secs 2024-04-27T04:22:25.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35542.978181 secs 2024-04-27T04:22:25.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36240.012403 secs 2024-04-27T04:22:25.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35542.978181 secs 2024-04-27T04:22:26.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:26 smithi156 ceph-mon[32679]: pgmap v19708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:26.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:26 smithi092 ceph-mon[29156]: pgmap v19708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:26.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:26 smithi189 ceph-mon[32756]: pgmap v19708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:28.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:28 smithi156 ceph-mon[32679]: pgmap v19709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:28.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:28 smithi092 ceph-mon[29156]: pgmap v19709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:28.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:28 smithi189 ceph-mon[32756]: pgmap v19709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:30 smithi156 ceph-mon[32679]: pgmap v19710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36245.012520 secs 2024-04-27T04:22:30.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35547.978327 secs 2024-04-27T04:22:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:30 smithi092 ceph-mon[29156]: pgmap v19710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36245.012520 secs 2024-04-27T04:22:30.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35547.978327 secs 2024-04-27T04:22:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:30 smithi189 ceph-mon[32756]: pgmap v19710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36245.012520 secs 2024-04-27T04:22:30.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35547.978327 secs 2024-04-27T04:22:32.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:32 smithi156 ceph-mon[32679]: pgmap v19711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:32.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:32 smithi092 ceph-mon[29156]: pgmap v19711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:32.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:32 smithi189 ceph-mon[32756]: pgmap v19711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:34.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:34 smithi156 ceph-mon[32679]: pgmap v19712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:34.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:34 smithi092 ceph-mon[29156]: pgmap v19712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:34.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:34 smithi189 ceph-mon[32756]: pgmap v19712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36250.012649 secs 2024-04-27T04:22:35.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35552.978462 secs 2024-04-27T04:22:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36250.012649 secs 2024-04-27T04:22:35.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35552.978462 secs 2024-04-27T04:22:35.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36250.012649 secs 2024-04-27T04:22:35.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35552.978462 secs 2024-04-27T04:22:36.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:36 smithi156 ceph-mon[32679]: pgmap v19713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:36.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:36 smithi092 ceph-mon[29156]: pgmap v19713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:36.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:36 smithi189 ceph-mon[32756]: pgmap v19713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:38.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:38 smithi156 ceph-mon[32679]: pgmap v19714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:38.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:38 smithi092 ceph-mon[29156]: pgmap v19714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:38.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:38 smithi189 ceph-mon[32756]: pgmap v19714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:40 smithi156 ceph-mon[32679]: pgmap v19715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36255.012762 secs 2024-04-27T04:22:40.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35557.978538 secs 2024-04-27T04:22:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:40 smithi092 ceph-mon[29156]: pgmap v19715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36255.012762 secs 2024-04-27T04:22:40.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35557.978538 secs 2024-04-27T04:22:40.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:40 smithi189 ceph-mon[32756]: pgmap v19715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36255.012762 secs 2024-04-27T04:22:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35557.978538 secs 2024-04-27T04:22:42.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:42 smithi092 ceph-mon[29156]: pgmap v19716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:42.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:42 smithi189 ceph-mon[32756]: pgmap v19716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:42.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:42 smithi156 ceph-mon[32679]: pgmap v19716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:44.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:44 smithi092 ceph-mon[29156]: pgmap v19717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:44.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:44 smithi189 ceph-mon[32756]: pgmap v19717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:44.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:44 smithi156 ceph-mon[32679]: pgmap v19717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36260.012903 secs 2024-04-27T04:22:45.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35562.978609 secs 2024-04-27T04:22:45.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36260.012903 secs 2024-04-27T04:22:45.537 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35562.978609 secs 2024-04-27T04:22:45.582 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36260.012903 secs 2024-04-27T04:22:45.582 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35562.978609 secs 2024-04-27T04:22:46.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:46 smithi092 ceph-mon[29156]: pgmap v19718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:46.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:46 smithi189 ceph-mon[32756]: pgmap v19718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:46.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:46 smithi156 ceph-mon[32679]: pgmap v19718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:48 smithi092 ceph-mon[29156]: pgmap v19719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:48.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:48 smithi189 ceph-mon[32756]: pgmap v19719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:48.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:48 smithi156 ceph-mon[32679]: pgmap v19719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:50 smithi092 ceph-mon[29156]: pgmap v19720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36265.013020 secs 2024-04-27T04:22:50.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35567.978679 secs 2024-04-27T04:22:50.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:50 smithi189 ceph-mon[32756]: pgmap v19720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36265.013020 secs 2024-04-27T04:22:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35567.978679 secs 2024-04-27T04:22:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:50 smithi156 ceph-mon[32679]: pgmap v19720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36265.013020 secs 2024-04-27T04:22:50.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35567.978679 secs 2024-04-27T04:22:52.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:52 smithi092 ceph-mon[29156]: pgmap v19721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:52.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:52 smithi189 ceph-mon[32756]: pgmap v19721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:52 smithi156 ceph-mon[32679]: pgmap v19721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:54.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:54 smithi092 ceph-mon[29156]: pgmap v19722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:54.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:54 smithi189 ceph-mon[32756]: pgmap v19722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:54.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:54 smithi156 ceph-mon[32679]: pgmap v19722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36270.013139 secs 2024-04-27T04:22:55.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35572.978814 secs 2024-04-27T04:22:55.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36270.013139 secs 2024-04-27T04:22:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35572.978814 secs 2024-04-27T04:22:55.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36270.013139 secs 2024-04-27T04:22:55.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35572.978814 secs 2024-04-27T04:22:56.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:56 smithi092 ceph-mon[29156]: pgmap v19723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:56.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:56 smithi189 ceph-mon[32756]: pgmap v19723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:56.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:56 smithi156 ceph-mon[32679]: pgmap v19723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:22:58.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:22:58 smithi092 ceph-mon[29156]: pgmap v19724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:58.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:22:58 smithi189 ceph-mon[32756]: pgmap v19724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:22:58.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:22:58 smithi156 ceph-mon[32679]: pgmap v19724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:00 smithi092 ceph-mon[29156]: pgmap v19725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36275.013250 secs 2024-04-27T04:23:00.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35577.978927 secs 2024-04-27T04:23:00.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:00 smithi189 ceph-mon[32756]: pgmap v19725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36275.013250 secs 2024-04-27T04:23:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35577.978927 secs 2024-04-27T04:23:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:00 smithi156 ceph-mon[32679]: pgmap v19725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36275.013250 secs 2024-04-27T04:23:00.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35577.978927 secs 2024-04-27T04:23:02.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:02 smithi092 ceph-mon[29156]: pgmap v19726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:02.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:02 smithi189 ceph-mon[32756]: pgmap v19726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:02.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:02 smithi156 ceph-mon[32679]: pgmap v19726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:04.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:04 smithi092 ceph-mon[29156]: pgmap v19727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:04.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:04 smithi189 ceph-mon[32756]: pgmap v19727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:04.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:04 smithi156 ceph-mon[32679]: pgmap v19727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36280.013370 secs 2024-04-27T04:23:05.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35582.978998 secs 2024-04-27T04:23:05.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36280.013370 secs 2024-04-27T04:23:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35582.978998 secs 2024-04-27T04:23:05.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36280.013370 secs 2024-04-27T04:23:05.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35582.978998 secs 2024-04-27T04:23:06.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:06 smithi092 ceph-mon[29156]: pgmap v19728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:06.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:06 smithi189 ceph-mon[32756]: pgmap v19728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:06.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:06 smithi156 ceph-mon[32679]: pgmap v19728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:08.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:08 smithi189 ceph-mon[32756]: pgmap v19729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:08.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:08 smithi156 ceph-mon[32679]: pgmap v19729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:08.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:08 smithi092 ceph-mon[29156]: pgmap v19729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:10.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:10 smithi189 ceph-mon[32756]: pgmap v19730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36285.013485 secs 2024-04-27T04:23:10.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35587.979138 secs 2024-04-27T04:23:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:10 smithi156 ceph-mon[32679]: pgmap v19730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36285.013485 secs 2024-04-27T04:23:10.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35587.979138 secs 2024-04-27T04:23:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:10 smithi092 ceph-mon[29156]: pgmap v19730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36285.013485 secs 2024-04-27T04:23:10.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35587.979138 secs 2024-04-27T04:23:12.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:12 smithi189 ceph-mon[32756]: pgmap v19731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:12.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:12 smithi156 ceph-mon[32679]: pgmap v19731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:12.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:12 smithi092 ceph-mon[29156]: pgmap v19731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:13.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:13 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:23:13.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:13 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:23:13.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:13 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: pgmap v19732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.507 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:14 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: pgmap v19732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:14 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: pgmap v19732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:14.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:14 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:15.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36290.013550 secs 2024-04-27T04:23:15.514 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:15 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35592.979217 secs 2024-04-27T04:23:15.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36290.013550 secs 2024-04-27T04:23:15.536 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:15 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35592.979217 secs 2024-04-27T04:23:15.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36290.013550 secs 2024-04-27T04:23:15.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:15 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35592.979217 secs 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: pgmap v19733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: pgmap v19733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:16.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: pgmap v19733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:23:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:23:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:17.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:23:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:17.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:23:17.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:23:17.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:23:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:23:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:18 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:23:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:18 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:18 smithi189 ceph-mon[32756]: pgmap v19734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:18 smithi189 ceph-mon[32756]: pgmap v19735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:18 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:23:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:18 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:18 smithi156 ceph-mon[32679]: pgmap v19734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:18.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:18 smithi156 ceph-mon[32679]: pgmap v19735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:18.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:18 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:23:18.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:18 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:23:18.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:18 smithi092 ceph-mon[29156]: pgmap v19734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:18.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:18 smithi092 ceph-mon[29156]: pgmap v19735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:20.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:20 smithi189 ceph-mon[32756]: pgmap v19736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:23:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36295.013663 secs 2024-04-27T04:23:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35597.979352 secs 2024-04-27T04:23:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:20 smithi156 ceph-mon[32679]: pgmap v19736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:23:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36295.013663 secs 2024-04-27T04:23:20.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35597.979352 secs 2024-04-27T04:23:20.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:20 smithi092 ceph-mon[29156]: pgmap v19736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T04:23:20.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36295.013663 secs 2024-04-27T04:23:20.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35597.979352 secs 2024-04-27T04:23:22.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:22 smithi189 ceph-mon[32756]: pgmap v19737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:22.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:22 smithi156 ceph-mon[32679]: pgmap v19737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:22.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:22 smithi092 ceph-mon[29156]: pgmap v19737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:24.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:24 smithi189 ceph-mon[32756]: pgmap v19738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:24.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:24 smithi156 ceph-mon[32679]: pgmap v19738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:24.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:24 smithi092 ceph-mon[29156]: pgmap v19738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36300.013789 secs 2024-04-27T04:23:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35602.979449 secs 2024-04-27T04:23:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36300.013789 secs 2024-04-27T04:23:25.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35602.979449 secs 2024-04-27T04:23:25.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36300.013789 secs 2024-04-27T04:23:25.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35602.979449 secs 2024-04-27T04:23:26.635 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:26 smithi189 ceph-mon[32756]: pgmap v19739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:26.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:26 smithi156 ceph-mon[32679]: pgmap v19739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:26.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:26 smithi092 ceph-mon[29156]: pgmap v19739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:23:28.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:28 smithi189 ceph-mon[32756]: pgmap v19740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:23:28.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:28 smithi156 ceph-mon[32679]: pgmap v19740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:23:28.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:28 smithi092 ceph-mon[29156]: pgmap v19740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:23:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:30 smithi189 ceph-mon[32756]: pgmap v19741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36305.013908 secs 2024-04-27T04:23:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35607.979570 secs 2024-04-27T04:23:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:30 smithi156 ceph-mon[32679]: pgmap v19741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36305.013908 secs 2024-04-27T04:23:30.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35607.979570 secs 2024-04-27T04:23:30.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:30 smithi092 ceph-mon[29156]: pgmap v19741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:30.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36305.013908 secs 2024-04-27T04:23:30.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35607.979570 secs 2024-04-27T04:23:32.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:32 smithi189 ceph-mon[32756]: pgmap v19742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:32.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:32 smithi156 ceph-mon[32679]: pgmap v19742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:32.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:32 smithi092 ceph-mon[29156]: pgmap v19742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:33.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:33 smithi189 ceph-mon[32756]: pgmap v19743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:33.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:33 smithi156 ceph-mon[32679]: pgmap v19743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:33.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:33 smithi092 ceph-mon[29156]: pgmap v19743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:35.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36310.014030 secs 2024-04-27T04:23:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35612.979689 secs 2024-04-27T04:23:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:35 smithi092 ceph-mon[29156]: pgmap v19744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36310.014030 secs 2024-04-27T04:23:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35612.979689 secs 2024-04-27T04:23:35.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:35 smithi189 ceph-mon[32756]: pgmap v19744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:35.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36310.014030 secs 2024-04-27T04:23:35.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35612.979689 secs 2024-04-27T04:23:35.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:35 smithi156 ceph-mon[32679]: pgmap v19744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:37.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:37 smithi092 ceph-mon[29156]: pgmap v19745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:37.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:37 smithi189 ceph-mon[32756]: pgmap v19745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:37.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:37 smithi156 ceph-mon[32679]: pgmap v19745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:39.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:39 smithi092 ceph-mon[29156]: pgmap v19746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:39.885 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:39 smithi189 ceph-mon[32756]: pgmap v19746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:39.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:39 smithi156 ceph-mon[32679]: pgmap v19746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:40.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36315.014146 secs 2024-04-27T04:23:40.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35617.979801 secs 2024-04-27T04:23:40.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36315.014146 secs 2024-04-27T04:23:40.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35617.979801 secs 2024-04-27T04:23:40.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36315.014146 secs 2024-04-27T04:23:40.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35617.979801 secs 2024-04-27T04:23:41.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:41 smithi092 ceph-mon[29156]: pgmap v19747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:41.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:41 smithi189 ceph-mon[32756]: pgmap v19747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:41.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:41 smithi156 ceph-mon[32679]: pgmap v19747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:23:43.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:43 smithi092 ceph-mon[29156]: pgmap v19748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:43.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:43 smithi189 ceph-mon[32756]: pgmap v19748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:43.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:43 smithi156 ceph-mon[32679]: pgmap v19748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:45.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36320.014281 secs 2024-04-27T04:23:45.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35622.979963 secs 2024-04-27T04:23:45.734 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:45 smithi156 ceph-mon[32679]: pgmap v19749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36320.014281 secs 2024-04-27T04:23:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35622.979963 secs 2024-04-27T04:23:45.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:45 smithi092 ceph-mon[29156]: pgmap v19749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36320.014281 secs 2024-04-27T04:23:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35622.979963 secs 2024-04-27T04:23:45.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:45 smithi189 ceph-mon[32756]: pgmap v19749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:47.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:47 smithi092 ceph-mon[29156]: pgmap v19750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:47.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:47 smithi189 ceph-mon[32756]: pgmap v19750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:47.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:47 smithi156 ceph-mon[32679]: pgmap v19750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:49.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:49 smithi092 ceph-mon[29156]: pgmap v19751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:49.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:49 smithi189 ceph-mon[32756]: pgmap v19751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:49.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:49 smithi156 ceph-mon[32679]: pgmap v19751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36325.014427 secs 2024-04-27T04:23:50.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35627.980028 secs 2024-04-27T04:23:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36325.014427 secs 2024-04-27T04:23:50.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35627.980028 secs 2024-04-27T04:23:50.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36325.014427 secs 2024-04-27T04:23:50.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35627.980028 secs 2024-04-27T04:23:51.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:51 smithi092 ceph-mon[29156]: pgmap v19752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:51.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:51 smithi189 ceph-mon[32756]: pgmap v19752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:51.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:51 smithi156 ceph-mon[32679]: pgmap v19752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:53.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:53 smithi092 ceph-mon[29156]: pgmap v19753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:53.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:53 smithi189 ceph-mon[32756]: pgmap v19753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:53.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:53 smithi156 ceph-mon[32679]: pgmap v19753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:23:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36330.014568 secs 2024-04-27T04:23:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35632.980129 secs 2024-04-27T04:23:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:55 smithi092 ceph-mon[29156]: pgmap v19754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:55.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36330.014568 secs 2024-04-27T04:23:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35632.980129 secs 2024-04-27T04:23:55.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:55 smithi189 ceph-mon[32756]: pgmap v19754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:55.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36330.014568 secs 2024-04-27T04:23:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35632.980129 secs 2024-04-27T04:23:55.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:55 smithi156 ceph-mon[32679]: pgmap v19754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:23:57.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:57 smithi092 ceph-mon[29156]: pgmap v19755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:57.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:57 smithi189 ceph-mon[32756]: pgmap v19755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:57.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:57 smithi156 ceph-mon[32679]: pgmap v19755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:59.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:23:59 smithi092 ceph-mon[29156]: pgmap v19756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:59.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:23:59 smithi189 ceph-mon[32756]: pgmap v19756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:23:59.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:23:59 smithi156 ceph-mon[32679]: pgmap v19756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:00.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36335.014702 secs 2024-04-27T04:24:00.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35637.980244 secs 2024-04-27T04:24:00.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36335.014702 secs 2024-04-27T04:24:00.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35637.980244 secs 2024-04-27T04:24:00.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36335.014702 secs 2024-04-27T04:24:00.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35637.980244 secs 2024-04-27T04:24:01.886 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:01 smithi189 ceph-mon[32756]: pgmap v19757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:01.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:01 smithi156 ceph-mon[32679]: pgmap v19757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:01.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:01 smithi092 ceph-mon[29156]: pgmap v19757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:03.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:03 smithi156 ceph-mon[32679]: pgmap v19758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:03.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:03 smithi092 ceph-mon[29156]: pgmap v19758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:04.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:03 smithi189 ceph-mon[32756]: pgmap v19758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:04.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:04 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35642.980368 secs 2024-04-27T04:24:04.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:04 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35642.980368 secs 2024-04-27T04:24:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:04 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35642.980368 secs 2024-04-27T04:24:05.931 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36340.014815 secs 2024-04-27T04:24:05.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:05 smithi156 ceph-mon[32679]: pgmap v19759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:05.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36340.014815 secs 2024-04-27T04:24:05.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:05 smithi092 ceph-mon[29156]: pgmap v19759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:06.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36340.014815 secs 2024-04-27T04:24:06.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:05 smithi189 ceph-mon[32756]: pgmap v19759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:07.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:07 smithi156 ceph-mon[32679]: pgmap v19760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:07.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:07 smithi092 ceph-mon[29156]: pgmap v19760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:08.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:07 smithi189 ceph-mon[32756]: pgmap v19760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:09.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:09 smithi156 ceph-mon[32679]: pgmap v19761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:09.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:09 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35647.980484 secs 2024-04-27T04:24:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:09 smithi092 ceph-mon[29156]: pgmap v19761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:09 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35647.980484 secs 2024-04-27T04:24:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:09 smithi189 ceph-mon[32756]: pgmap v19761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:09 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35647.980484 secs 2024-04-27T04:24:10.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36345.014930 secs 2024-04-27T04:24:10.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36345.014930 secs 2024-04-27T04:24:11.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36345.014930 secs 2024-04-27T04:24:11.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:11 smithi092 ceph-mon[29156]: pgmap v19762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:12.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:11 smithi189 ceph-mon[32756]: pgmap v19762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:12.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:11 smithi156 ceph-mon[32679]: pgmap v19762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:13.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:13 smithi092 ceph-mon[29156]: pgmap v19763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:14.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:13 smithi189 ceph-mon[32756]: pgmap v19763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:14.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:13 smithi156 ceph-mon[32679]: pgmap v19763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:14.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:14 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35652.980625 secs 2024-04-27T04:24:15.037 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:14 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35652.980625 secs 2024-04-27T04:24:15.083 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:14 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35652.980625 secs 2024-04-27T04:24:15.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36350.015046 secs 2024-04-27T04:24:15.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:15 smithi092 ceph-mon[29156]: pgmap v19764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:16.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36350.015046 secs 2024-04-27T04:24:16.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:15 smithi189 ceph-mon[32756]: pgmap v19764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36350.015046 secs 2024-04-27T04:24:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:15 smithi156 ceph-mon[32679]: pgmap v19764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:16.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:16 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:24:17.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:16 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:24:17.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:16 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: pgmap v19765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: pgmap v19766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: pgmap v19767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:17.979 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: pgmap v19765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: pgmap v19766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: pgmap v19767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:18.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:24:18.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: pgmap v19765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: pgmap v19766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: pgmap v19767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:24:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36355.015159 secs 2024-04-27T04:24:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35657.980762 secs 2024-04-27T04:24:20.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:20 smithi189 ceph-mon[32756]: pgmap v19768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36355.015159 secs 2024-04-27T04:24:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35657.980762 secs 2024-04-27T04:24:20.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:20 smithi156 ceph-mon[32679]: pgmap v19768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:20.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36355.015159 secs 2024-04-27T04:24:20.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35657.980762 secs 2024-04-27T04:24:20.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:20 smithi092 ceph-mon[29156]: pgmap v19768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:22.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:22 smithi189 ceph-mon[32756]: pgmap v19769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:22.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:22 smithi156 ceph-mon[32679]: pgmap v19769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:22.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:22 smithi092 ceph-mon[29156]: pgmap v19769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:24.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:24 smithi189 ceph-mon[32756]: pgmap v19770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:24:24.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:24 smithi156 ceph-mon[32679]: pgmap v19770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:24:24.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:24 smithi092 ceph-mon[29156]: pgmap v19770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:24:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36360.015238 secs 2024-04-27T04:24:25.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35662.980874 secs 2024-04-27T04:24:25.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36360.015238 secs 2024-04-27T04:24:25.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35662.980874 secs 2024-04-27T04:24:25.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36360.015238 secs 2024-04-27T04:24:25.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35662.980874 secs 2024-04-27T04:24:26.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:26 smithi189 ceph-mon[32756]: pgmap v19771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:26.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:26 smithi156 ceph-mon[32679]: pgmap v19771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:26.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:26 smithi092 ceph-mon[29156]: pgmap v19771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:24:28.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:28 smithi189 ceph-mon[32756]: pgmap v19772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:24:28.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:28 smithi156 ceph-mon[32679]: pgmap v19772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:24:28.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:28 smithi092 ceph-mon[29156]: pgmap v19772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:24:30.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36365.015351 secs 2024-04-27T04:24:30.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35667.980993 secs 2024-04-27T04:24:30.544 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:30 smithi092 ceph-mon[29156]: pgmap v19773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36365.015351 secs 2024-04-27T04:24:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35667.980993 secs 2024-04-27T04:24:30.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:30 smithi189 ceph-mon[32756]: pgmap v19773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36365.015351 secs 2024-04-27T04:24:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35667.980993 secs 2024-04-27T04:24:30.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:30 smithi156 ceph-mon[32679]: pgmap v19773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:32.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:32 smithi189 ceph-mon[32756]: pgmap v19774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:32.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:32 smithi156 ceph-mon[32679]: pgmap v19774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:32.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:32 smithi092 ceph-mon[29156]: pgmap v19774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:34.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:34 smithi189 ceph-mon[32756]: pgmap v19775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:34.681 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:34 smithi156 ceph-mon[32679]: pgmap v19775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:34.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:34 smithi092 ceph-mon[29156]: pgmap v19775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36370.015467 secs 2024-04-27T04:24:35.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35672.981117 secs 2024-04-27T04:24:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36370.015467 secs 2024-04-27T04:24:35.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35672.981117 secs 2024-04-27T04:24:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36370.015467 secs 2024-04-27T04:24:35.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35672.981117 secs 2024-04-27T04:24:36.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:36 smithi189 ceph-mon[32756]: pgmap v19776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:36.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:36 smithi156 ceph-mon[32679]: pgmap v19776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:36.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:36 smithi092 ceph-mon[29156]: pgmap v19776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:38.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:38 smithi189 ceph-mon[32756]: pgmap v19777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:38.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:38 smithi156 ceph-mon[32679]: pgmap v19777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:38.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:38 smithi092 ceph-mon[29156]: pgmap v19777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36375.015591 secs 2024-04-27T04:24:40.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35677.981218 secs 2024-04-27T04:24:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:40 smithi189 ceph-mon[32756]: pgmap v19778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36375.015591 secs 2024-04-27T04:24:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35677.981218 secs 2024-04-27T04:24:40.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:40 smithi156 ceph-mon[32679]: pgmap v19778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36375.015591 secs 2024-04-27T04:24:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35677.981218 secs 2024-04-27T04:24:40.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:40 smithi092 ceph-mon[29156]: pgmap v19778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:40.974 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:24:40.975+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:24:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:24:40.975+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:24:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:24:40.975+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:24:40.975 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:24:40.975+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 280 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:24:42.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:42 smithi189 ceph-mon[32756]: pgmap v19779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:42.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:42 smithi156 ceph-mon[32679]: pgmap v19779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:42.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:42 smithi092 ceph-mon[29156]: pgmap v19779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:44.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:44 smithi189 ceph-mon[32756]: pgmap v19780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:44.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:44 smithi156 ceph-mon[32679]: pgmap v19780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:44.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:44 smithi092 ceph-mon[29156]: pgmap v19780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:45.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36380.015708 secs 2024-04-27T04:24:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35682.981335 secs 2024-04-27T04:24:45.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36380.015708 secs 2024-04-27T04:24:45.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35682.981335 secs 2024-04-27T04:24:45.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36380.015708 secs 2024-04-27T04:24:45.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35682.981335 secs 2024-04-27T04:24:46.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:46 smithi189 ceph-mon[32756]: pgmap v19781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:46.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:46 smithi156 ceph-mon[32679]: pgmap v19781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:46.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:46 smithi092 ceph-mon[29156]: pgmap v19781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:48.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:48 smithi189 ceph-mon[32756]: pgmap v19782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:48.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:48 smithi156 ceph-mon[32679]: pgmap v19782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:48.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:48 smithi092 ceph-mon[29156]: pgmap v19782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36385.015845 secs 2024-04-27T04:24:50.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35687.981454 secs 2024-04-27T04:24:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:50 smithi189 ceph-mon[32756]: pgmap v19783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36385.015845 secs 2024-04-27T04:24:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35687.981454 secs 2024-04-27T04:24:50.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:50 smithi156 ceph-mon[32679]: pgmap v19783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:50.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36385.015845 secs 2024-04-27T04:24:50.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35687.981454 secs 2024-04-27T04:24:50.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:50 smithi092 ceph-mon[29156]: pgmap v19783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:52 smithi189 ceph-mon[32756]: pgmap v19784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:52.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:52 smithi156 ceph-mon[32679]: pgmap v19784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:52.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:52 smithi092 ceph-mon[29156]: pgmap v19784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:54.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:54 smithi189 ceph-mon[32756]: pgmap v19785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:54.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:54 smithi156 ceph-mon[32679]: pgmap v19785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:54.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:54 smithi092 ceph-mon[29156]: pgmap v19785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36390.015964 secs 2024-04-27T04:24:55.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35692.981546 secs 2024-04-27T04:24:55.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36390.015964 secs 2024-04-27T04:24:55.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35692.981546 secs 2024-04-27T04:24:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36390.015964 secs 2024-04-27T04:24:55.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35692.981546 secs 2024-04-27T04:24:56.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:56 smithi189 ceph-mon[32756]: pgmap v19786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:56.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:56 smithi156 ceph-mon[32679]: pgmap v19786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:56.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:56 smithi092 ceph-mon[29156]: pgmap v19786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:24:57.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:24:57 smithi189 ceph-mon[32756]: pgmap v19787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:57.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:24:57 smithi156 ceph-mon[32679]: pgmap v19787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:24:57.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:24:57 smithi092 ceph-mon[29156]: pgmap v19787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:00.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36395.016040 secs 2024-04-27T04:25:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35697.981668 secs 2024-04-27T04:25:00.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:00 smithi189 ceph-mon[32756]: pgmap v19788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:00.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36395.016040 secs 2024-04-27T04:25:00.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35697.981668 secs 2024-04-27T04:25:00.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:00 smithi156 ceph-mon[32679]: pgmap v19788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:00.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36395.016040 secs 2024-04-27T04:25:00.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35697.981668 secs 2024-04-27T04:25:00.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:00 smithi092 ceph-mon[29156]: pgmap v19788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:02.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:02 smithi189 ceph-mon[32756]: pgmap v19789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:02.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:02 smithi156 ceph-mon[32679]: pgmap v19789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:02.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:02 smithi092 ceph-mon[29156]: pgmap v19789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:04.571 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:04 smithi092 ceph-mon[29156]: pgmap v19790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:04.679 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:04 smithi189 ceph-mon[32756]: pgmap v19790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:04 smithi156 ceph-mon[32679]: pgmap v19790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36400.016134 secs 2024-04-27T04:25:05.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35702.981791 secs 2024-04-27T04:25:05.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36400.016134 secs 2024-04-27T04:25:05.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35702.981791 secs 2024-04-27T04:25:05.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36400.016134 secs 2024-04-27T04:25:05.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35702.981791 secs 2024-04-27T04:25:06.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:06 smithi189 ceph-mon[32756]: pgmap v19791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:06.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:06 smithi156 ceph-mon[32679]: pgmap v19791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:06.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:06 smithi092 ceph-mon[29156]: pgmap v19791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:08.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:08 smithi189 ceph-mon[32756]: pgmap v19792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:08.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:08 smithi156 ceph-mon[32679]: pgmap v19792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:08.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:08 smithi092 ceph-mon[29156]: pgmap v19792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36405.016272 secs 2024-04-27T04:25:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35707.981889 secs 2024-04-27T04:25:10.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:10 smithi189 ceph-mon[32756]: pgmap v19793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:10.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36405.016272 secs 2024-04-27T04:25:10.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35707.981889 secs 2024-04-27T04:25:10.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:10 smithi156 ceph-mon[32679]: pgmap v19793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:10.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36405.016272 secs 2024-04-27T04:25:10.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35707.981889 secs 2024-04-27T04:25:10.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:10 smithi092 ceph-mon[29156]: pgmap v19793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:12.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:12 smithi189 ceph-mon[32756]: pgmap v19794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:12.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:12 smithi156 ceph-mon[32679]: pgmap v19794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:12.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:12 smithi092 ceph-mon[29156]: pgmap v19794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:14.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:14 smithi189 ceph-mon[32756]: pgmap v19795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:14.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:14 smithi156 ceph-mon[32679]: pgmap v19795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:14.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:14 smithi092 ceph-mon[29156]: pgmap v19795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:15.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36410.016416 secs 2024-04-27T04:25:15.583 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:15 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35712.982014 secs 2024-04-27T04:25:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36410.016416 secs 2024-04-27T04:25:15.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:15 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35712.982014 secs 2024-04-27T04:25:15.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36410.016416 secs 2024-04-27T04:25:15.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:15 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35712.982014 secs 2024-04-27T04:25:16.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:16 smithi189 ceph-mon[32756]: pgmap v19796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:25:16.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:16 smithi156 ceph-mon[32679]: pgmap v19796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:25:16.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:16 smithi092 ceph-mon[29156]: pgmap v19796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T04:25:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:17 smithi189 ceph-mon[32756]: pgmap v19797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:25:17.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:17 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:25:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:17 smithi156 ceph-mon[32679]: pgmap v19797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:25:17.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:17 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:25:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:17 smithi092 ceph-mon[29156]: pgmap v19797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T04:25:17.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:17 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:25:18.636 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:25:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:25:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:18 smithi189 ceph-mon[32756]: pgmap v19798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:25:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:18 smithi189 ceph-mon[32756]: pgmap v19799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:25:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:25:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:25:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:25:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:18 smithi156 ceph-mon[32679]: pgmap v19798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:25:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:18 smithi156 ceph-mon[32679]: pgmap v19799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:25:18.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:25:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:25:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:25:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:18 smithi092 ceph-mon[29156]: pgmap v19798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 380 B/s wr, 4 op/s 2024-04-27T04:25:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:18 smithi092 ceph-mon[29156]: pgmap v19799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 467 B/s wr, 2 op/s 2024-04-27T04:25:18.742 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:25:19.931 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:19 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35717.982074 secs 2024-04-27T04:25:19.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:19 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35717.982074 secs 2024-04-27T04:25:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:19 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35717.982074 secs 2024-04-27T04:25:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36415.016529 secs 2024-04-27T04:25:20.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:20 smithi156 ceph-mon[32679]: pgmap v19800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36415.016529 secs 2024-04-27T04:25:20.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:20 smithi092 ceph-mon[29156]: pgmap v19800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:21.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36415.016529 secs 2024-04-27T04:25:21.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:20 smithi189 ceph-mon[32756]: pgmap v19800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:23.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:23 smithi189 ceph-mon[32756]: pgmap v19801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:23.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:23 smithi156 ceph-mon[32679]: pgmap v19801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:23.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:23 smithi092 ceph-mon[29156]: pgmap v19801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 467 B/s wr, 5 op/s 2024-04-27T04:25:25.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36420.016645 secs 2024-04-27T04:25:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:25 smithi189 ceph-mon[32756]: pgmap v19802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:25.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35722.982198 secs 2024-04-27T04:25:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36420.016645 secs 2024-04-27T04:25:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:25 smithi156 ceph-mon[32679]: pgmap v19802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35722.982198 secs 2024-04-27T04:25:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36420.016645 secs 2024-04-27T04:25:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:25 smithi092 ceph-mon[29156]: pgmap v19802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:25.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35722.982198 secs 2024-04-27T04:25:27.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:27 smithi189 ceph-mon[32756]: pgmap v19803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:27.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:27 smithi156 ceph-mon[32679]: pgmap v19803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:27.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:27 smithi092 ceph-mon[29156]: pgmap v19803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:25:29.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:29 smithi189 ceph-mon[32756]: pgmap v19804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:25:29.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:29 smithi156 ceph-mon[32679]: pgmap v19804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:25:29.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:29 smithi092 ceph-mon[29156]: pgmap v19804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:25:30.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36425.016773 secs 2024-04-27T04:25:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35727.982321 secs 2024-04-27T04:25:30.393 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36425.016773 secs 2024-04-27T04:25:30.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35727.982321 secs 2024-04-27T04:25:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36425.016773 secs 2024-04-27T04:25:30.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35727.982321 secs 2024-04-27T04:25:31.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:31 smithi189 ceph-mon[32756]: pgmap v19805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:31.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:31 smithi156 ceph-mon[32679]: pgmap v19805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:31.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:31 smithi092 ceph-mon[29156]: pgmap v19805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:33 smithi189 ceph-mon[32756]: pgmap v19806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:33.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:33 smithi156 ceph-mon[32679]: pgmap v19806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:33.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:33 smithi092 ceph-mon[29156]: pgmap v19806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36430.016888 secs 2024-04-27T04:25:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:35 smithi189 ceph-mon[32756]: pgmap v19807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:35.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35732.982402 secs 2024-04-27T04:25:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36430.016888 secs 2024-04-27T04:25:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:35 smithi156 ceph-mon[32679]: pgmap v19807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:35.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35732.982402 secs 2024-04-27T04:25:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36430.016888 secs 2024-04-27T04:25:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:35 smithi092 ceph-mon[29156]: pgmap v19807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:35.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35732.982402 secs 2024-04-27T04:25:37.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:37 smithi189 ceph-mon[32756]: pgmap v19808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:37.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:37 smithi156 ceph-mon[32679]: pgmap v19808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:37.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:37 smithi092 ceph-mon[29156]: pgmap v19808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:39.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:39 smithi189 ceph-mon[32756]: pgmap v19809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:39.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:39 smithi156 ceph-mon[32679]: pgmap v19809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:39.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:39 smithi092 ceph-mon[29156]: pgmap v19809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:40.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36435.016979 secs 2024-04-27T04:25:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35737.982469 secs 2024-04-27T04:25:40.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36435.016979 secs 2024-04-27T04:25:40.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35737.982469 secs 2024-04-27T04:25:40.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36435.016979 secs 2024-04-27T04:25:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35737.982469 secs 2024-04-27T04:25:40.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:25:40.582+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:25:40.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:25:40.582+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:25:40.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:25:40.582+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:25:40.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:25:40.582+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:25:40.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:25:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:25:40.582+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:25:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:41 smithi189 ceph-mon[32756]: pgmap v19810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:41.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:41 smithi156 ceph-mon[32679]: pgmap v19810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:41.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:41 smithi092 ceph-mon[29156]: pgmap v19810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:25:43.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:43 smithi189 ceph-mon[32756]: pgmap v19811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:43.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:43 smithi156 ceph-mon[32679]: pgmap v19811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:43.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:43 smithi092 ceph-mon[29156]: pgmap v19811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:45.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36440.017074 secs 2024-04-27T04:25:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:45 smithi189 ceph-mon[32756]: pgmap v19812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:45.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35742.982580 secs 2024-04-27T04:25:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36440.017074 secs 2024-04-27T04:25:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:45 smithi156 ceph-mon[32679]: pgmap v19812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:45.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35742.982580 secs 2024-04-27T04:25:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36440.017074 secs 2024-04-27T04:25:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:45 smithi092 ceph-mon[29156]: pgmap v19812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:45.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35742.982580 secs 2024-04-27T04:25:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:47 smithi189 ceph-mon[32756]: pgmap v19813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:47.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:47 smithi156 ceph-mon[32679]: pgmap v19813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:47.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:47 smithi092 ceph-mon[29156]: pgmap v19813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:49 smithi189 ceph-mon[32756]: pgmap v19814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:49.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:49 smithi156 ceph-mon[32679]: pgmap v19814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:49.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:49 smithi092 ceph-mon[29156]: pgmap v19814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:50.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36445.017178 secs 2024-04-27T04:25:50.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35747.982695 secs 2024-04-27T04:25:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36445.017178 secs 2024-04-27T04:25:50.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35747.982695 secs 2024-04-27T04:25:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36445.017178 secs 2024-04-27T04:25:50.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35747.982695 secs 2024-04-27T04:25:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:51 smithi189 ceph-mon[32756]: pgmap v19815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:51.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:51 smithi156 ceph-mon[32679]: pgmap v19815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:51.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:51 smithi092 ceph-mon[29156]: pgmap v19815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:53 smithi189 ceph-mon[32756]: pgmap v19816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:53.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:53 smithi156 ceph-mon[32679]: pgmap v19816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:53.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:53 smithi092 ceph-mon[29156]: pgmap v19816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T04:25:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36450.017320 secs 2024-04-27T04:25:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:55 smithi189 ceph-mon[32756]: pgmap v19817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:55 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35752.982837 secs 2024-04-27T04:25:55.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36450.017320 secs 2024-04-27T04:25:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:55 smithi156 ceph-mon[32679]: pgmap v19817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:55 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35752.982837 secs 2024-04-27T04:25:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36450.017320 secs 2024-04-27T04:25:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:55 smithi092 ceph-mon[29156]: pgmap v19817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T04:25:55.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:55 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35752.982837 secs 2024-04-27T04:25:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:57 smithi189 ceph-mon[32756]: pgmap v19818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:57.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:57 smithi156 ceph-mon[32679]: pgmap v19818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:57.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:57 smithi092 ceph-mon[29156]: pgmap v19818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:25:59 smithi189 ceph-mon[32756]: pgmap v19819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:59.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:25:59 smithi156 ceph-mon[32679]: pgmap v19819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:25:59.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:25:59 smithi092 ceph-mon[29156]: pgmap v19819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36455.017440 secs 2024-04-27T04:26:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:00 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35757.982936 secs 2024-04-27T04:26:00.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36455.017440 secs 2024-04-27T04:26:00.394 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:00 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35757.982936 secs 2024-04-27T04:26:00.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36455.017440 secs 2024-04-27T04:26:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:00 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35757.982936 secs 2024-04-27T04:26:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:01 smithi189 ceph-mon[32756]: pgmap v19820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:01.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:01 smithi156 ceph-mon[32679]: pgmap v19820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:01.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:01 smithi092 ceph-mon[29156]: pgmap v19820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:03 smithi189 ceph-mon[32756]: pgmap v19821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:03 smithi156 ceph-mon[32679]: pgmap v19821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:03.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:03 smithi092 ceph-mon[29156]: pgmap v19821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36460.017544 secs 2024-04-27T04:26:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:05 smithi189 ceph-mon[32756]: pgmap v19822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:05 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35762.983059 secs 2024-04-27T04:26:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36460.017544 secs 2024-04-27T04:26:05.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:05 smithi156 ceph-mon[32679]: pgmap v19822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:05 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35762.983059 secs 2024-04-27T04:26:05.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36460.017544 secs 2024-04-27T04:26:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:05 smithi092 ceph-mon[29156]: pgmap v19822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:05.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:05 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35762.983059 secs 2024-04-27T04:26:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:07 smithi189 ceph-mon[32756]: pgmap v19823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:07 smithi156 ceph-mon[32679]: pgmap v19823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:07.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:07 smithi092 ceph-mon[29156]: pgmap v19823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:09 smithi189 ceph-mon[32756]: pgmap v19824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:09.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:09 smithi156 ceph-mon[32679]: pgmap v19824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:09.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:09 smithi092 ceph-mon[29156]: pgmap v19824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36465.017677 secs 2024-04-27T04:26:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:10 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35767.983180 secs 2024-04-27T04:26:10.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36465.017677 secs 2024-04-27T04:26:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:10 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35767.983180 secs 2024-04-27T04:26:10.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36465.017677 secs 2024-04-27T04:26:10.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:10 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35767.983180 secs 2024-04-27T04:26:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:11 smithi189 ceph-mon[32756]: pgmap v19825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:11.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:11 smithi156 ceph-mon[32679]: pgmap v19825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:11.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:11 smithi092 ceph-mon[29156]: pgmap v19825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:13 smithi189 ceph-mon[32756]: pgmap v19826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:13 smithi156 ceph-mon[32679]: pgmap v19826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:13.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:13 smithi092 ceph-mon[29156]: pgmap v19826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36470.017814 secs 2024-04-27T04:26:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:15 smithi189 ceph-mon[32756]: pgmap v19827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:15 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35772.983318 secs 2024-04-27T04:26:15.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36470.017814 secs 2024-04-27T04:26:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:15 smithi156 ceph-mon[32679]: pgmap v19827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:15 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35772.983318 secs 2024-04-27T04:26:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36470.017814 secs 2024-04-27T04:26:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:15 smithi092 ceph-mon[29156]: pgmap v19827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:15.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:15 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35772.983318 secs 2024-04-27T04:26:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:17 smithi156 ceph-mon[32679]: pgmap v19828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:17.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:17 smithi092 ceph-mon[29156]: pgmap v19828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:17.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:17 smithi189 ceph-mon[32756]: pgmap v19828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:18.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:26:18.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:26:18.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:19 smithi156 ceph-mon[32679]: pgmap v19829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:26:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:26:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:19 smithi092 ceph-mon[29156]: pgmap v19829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:26:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:26:19.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:26:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:19 smithi189 ceph-mon[32756]: pgmap v19829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:26:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:26:19.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:20 smithi156 ceph-mon[32679]: pgmap v19830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:20 smithi156 ceph-mon[32679]: pgmap v19831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36475.017930 secs 2024-04-27T04:26:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:20 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35777.983379 secs 2024-04-27T04:26:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:20 smithi092 ceph-mon[29156]: pgmap v19830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:26:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:20 smithi092 ceph-mon[29156]: pgmap v19831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36475.017930 secs 2024-04-27T04:26:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:20 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35777.983379 secs 2024-04-27T04:26:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:20 smithi189 ceph-mon[32756]: pgmap v19830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:26:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:20 smithi189 ceph-mon[32756]: pgmap v19831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36475.017930 secs 2024-04-27T04:26:20.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:20 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35777.983379 secs 2024-04-27T04:26:22.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:22 smithi156 ceph-mon[32679]: pgmap v19832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:22.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:22 smithi092 ceph-mon[29156]: pgmap v19832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:22.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:22 smithi189 ceph-mon[32756]: pgmap v19832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:24.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:24 smithi156 ceph-mon[32679]: pgmap v19833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:26:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:24 smithi092 ceph-mon[29156]: pgmap v19833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:26:24.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:24 smithi189 ceph-mon[32756]: pgmap v19833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:26:25.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36480.018040 secs 2024-04-27T04:26:25.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35782.983439 secs 2024-04-27T04:26:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36480.018040 secs 2024-04-27T04:26:25.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35782.983439 secs 2024-04-27T04:26:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36480.018040 secs 2024-04-27T04:26:25.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35782.983439 secs 2024-04-27T04:26:26.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:26 smithi156 ceph-mon[32679]: pgmap v19834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:26.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:26 smithi092 ceph-mon[29156]: pgmap v19834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:26.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:26 smithi189 ceph-mon[32756]: pgmap v19834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:28.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:28 smithi156 ceph-mon[32679]: pgmap v19835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:28 smithi092 ceph-mon[29156]: pgmap v19835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:28.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:28 smithi189 ceph-mon[32756]: pgmap v19835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:26:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:30 smithi156 ceph-mon[32679]: pgmap v19836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:26:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36485.018151 secs 2024-04-27T04:26:30.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:30 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35787.983556 secs 2024-04-27T04:26:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:30 smithi092 ceph-mon[29156]: pgmap v19836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:26:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36485.018151 secs 2024-04-27T04:26:30.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:30 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35787.983556 secs 2024-04-27T04:26:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:30 smithi189 ceph-mon[32756]: pgmap v19836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:26:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36485.018151 secs 2024-04-27T04:26:30.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:30 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35787.983556 secs 2024-04-27T04:26:32.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:32 smithi092 ceph-mon[29156]: pgmap v19837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:32.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:32 smithi189 ceph-mon[32756]: pgmap v19837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:32 smithi156 ceph-mon[32679]: pgmap v19837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:34 smithi092 ceph-mon[29156]: pgmap v19838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:34.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:34 smithi189 ceph-mon[32756]: pgmap v19838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:34.682 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:34 smithi156 ceph-mon[32679]: pgmap v19838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36490.018278 secs 2024-04-27T04:26:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35792.983677 secs 2024-04-27T04:26:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36490.018278 secs 2024-04-27T04:26:35.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35792.983677 secs 2024-04-27T04:26:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36490.018278 secs 2024-04-27T04:26:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35792.983677 secs 2024-04-27T04:26:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:36 smithi092 ceph-mon[29156]: pgmap v19839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:36.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:36 smithi189 ceph-mon[32756]: pgmap v19839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:36 smithi156 ceph-mon[32679]: pgmap v19839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:38.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:38 smithi092 ceph-mon[29156]: pgmap v19840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:38.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:38 smithi189 ceph-mon[32756]: pgmap v19840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:38.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:38 smithi156 ceph-mon[32679]: pgmap v19840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:40 smithi092 ceph-mon[29156]: pgmap v19841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36495.018392 secs 2024-04-27T04:26:40.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:40 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35797.983801 secs 2024-04-27T04:26:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:40 smithi189 ceph-mon[32756]: pgmap v19841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36495.018392 secs 2024-04-27T04:26:40.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:40 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35797.983801 secs 2024-04-27T04:26:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:40 smithi156 ceph-mon[32679]: pgmap v19841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36495.018392 secs 2024-04-27T04:26:40.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:40 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35797.983801 secs 2024-04-27T04:26:42.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:42 smithi092 ceph-mon[29156]: pgmap v19842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:42.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:42 smithi189 ceph-mon[32756]: pgmap v19842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:42.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:42 smithi156 ceph-mon[32679]: pgmap v19842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:44.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:44 smithi092 ceph-mon[29156]: pgmap v19843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:44.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:44 smithi189 ceph-mon[32756]: pgmap v19843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:44 smithi156 ceph-mon[32679]: pgmap v19843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36500.018506 secs 2024-04-27T04:26:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:45 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35802.983920 secs 2024-04-27T04:26:45.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36500.018506 secs 2024-04-27T04:26:45.538 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:45 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35802.983920 secs 2024-04-27T04:26:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36500.018506 secs 2024-04-27T04:26:45.584 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:45 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35802.983920 secs 2024-04-27T04:26:46.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:46 smithi092 ceph-mon[29156]: pgmap v19844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:46.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:46 smithi189 ceph-mon[32756]: pgmap v19844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:46 smithi156 ceph-mon[32679]: pgmap v19844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:48.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:48 smithi092 ceph-mon[29156]: pgmap v19845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:48.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:48 smithi189 ceph-mon[32756]: pgmap v19845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:48 smithi156 ceph-mon[32679]: pgmap v19845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:50 smithi092 ceph-mon[29156]: pgmap v19846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36505.018630 secs 2024-04-27T04:26:50.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:50 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35807.984029 secs 2024-04-27T04:26:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:50 smithi189 ceph-mon[32756]: pgmap v19846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36505.018630 secs 2024-04-27T04:26:50.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:50 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35807.984029 secs 2024-04-27T04:26:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:50 smithi156 ceph-mon[32679]: pgmap v19846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36505.018630 secs 2024-04-27T04:26:50.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:50 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35807.984029 secs 2024-04-27T04:26:52.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:52 smithi092 ceph-mon[29156]: pgmap v19847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:52.637 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:52 smithi189 ceph-mon[32756]: pgmap v19847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:52 smithi156 ceph-mon[32679]: pgmap v19847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:53.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:53 smithi092 ceph-mon[29156]: pgmap v19848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:54.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:53 smithi189 ceph-mon[32756]: pgmap v19848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:54.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:53 smithi156 ceph-mon[32679]: pgmap v19848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:54 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35812.984110 secs 2024-04-27T04:26:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:54 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35812.984110 secs 2024-04-27T04:26:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:54 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35812.984110 secs 2024-04-27T04:26:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36510.018746 secs 2024-04-27T04:26:55.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:55 smithi092 ceph-mon[29156]: pgmap v19849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36510.018746 secs 2024-04-27T04:26:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:55 smithi189 ceph-mon[32756]: pgmap v19849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36510.018746 secs 2024-04-27T04:26:56.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:55 smithi156 ceph-mon[32679]: pgmap v19849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:26:58.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:57 smithi189 ceph-mon[32756]: pgmap v19850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:58.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:57 smithi156 ceph-mon[32679]: pgmap v19850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:26:58.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:57 smithi092 ceph-mon[29156]: pgmap v19850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:59 smithi189 ceph-mon[32756]: pgmap v19851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36515.018884 secs 2024-04-27T04:27:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:26:59 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35817.984214 secs 2024-04-27T04:27:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:59 smithi156 ceph-mon[32679]: pgmap v19851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36515.018884 secs 2024-04-27T04:27:00.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:26:59 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35817.984214 secs 2024-04-27T04:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:59 smithi092 ceph-mon[29156]: pgmap v19851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36515.018884 secs 2024-04-27T04:27:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:26:59 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35817.984214 secs 2024-04-27T04:27:02.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:01 smithi189 ceph-mon[32756]: pgmap v19852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:02.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:01 smithi156 ceph-mon[32679]: pgmap v19852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:02.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:01 smithi092 ceph-mon[29156]: pgmap v19852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:04.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:03 smithi189 ceph-mon[32756]: pgmap v19853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:04.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:03 smithi156 ceph-mon[32679]: pgmap v19853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:04.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:03 smithi092 ceph-mon[29156]: pgmap v19853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36520.018985 secs 2024-04-27T04:27:05.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:04 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35822.984332 secs 2024-04-27T04:27:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36520.018985 secs 2024-04-27T04:27:05.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:04 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35822.984332 secs 2024-04-27T04:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36520.018985 secs 2024-04-27T04:27:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:04 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35822.984332 secs 2024-04-27T04:27:06.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:05 smithi189 ceph-mon[32756]: pgmap v19854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:06.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:05 smithi156 ceph-mon[32679]: pgmap v19854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:06.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:05 smithi092 ceph-mon[29156]: pgmap v19854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:08.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:07 smithi189 ceph-mon[32756]: pgmap v19855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:08.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:07 smithi156 ceph-mon[32679]: pgmap v19855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:08.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:07 smithi092 ceph-mon[29156]: pgmap v19855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:09 smithi189 ceph-mon[32756]: pgmap v19856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36525.019100 secs 2024-04-27T04:27:10.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:09 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35827.984444 secs 2024-04-27T04:27:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:09 smithi156 ceph-mon[32679]: pgmap v19856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36525.019100 secs 2024-04-27T04:27:10.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:09 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35827.984444 secs 2024-04-27T04:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:09 smithi092 ceph-mon[29156]: pgmap v19856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36525.019100 secs 2024-04-27T04:27:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:09 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35827.984444 secs 2024-04-27T04:27:12.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:11 smithi189 ceph-mon[32756]: pgmap v19857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:12.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:11 smithi156 ceph-mon[32679]: pgmap v19857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:12.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:11 smithi092 ceph-mon[29156]: pgmap v19857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:14.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:13 smithi189 ceph-mon[32756]: pgmap v19858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:14.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:13 smithi156 ceph-mon[32679]: pgmap v19858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:14.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:13 smithi092 ceph-mon[29156]: pgmap v19858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36530.019192 secs 2024-04-27T04:27:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:14 smithi189 ceph-mon[32756]: 28 slow requests, 1 included below; oldest blocked for > 35832.984568 secs 2024-04-27T04:27:15.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:14 smithi189 ceph-mon[32756]: slow request 723.730872 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36530.019192 secs 2024-04-27T04:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:14 smithi156 ceph-mon[32679]: 28 slow requests, 1 included below; oldest blocked for > 35832.984568 secs 2024-04-27T04:27:15.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:14 smithi156 ceph-mon[32679]: slow request 723.730872 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:27:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36530.019192 secs 2024-04-27T04:27:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:14 smithi092 ceph-mon[29156]: 28 slow requests, 1 included below; oldest blocked for > 35832.984568 secs 2024-04-27T04:27:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:14 smithi092 ceph-mon[29156]: slow request 723.730872 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:27:16.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:15 smithi189 ceph-mon[32756]: pgmap v19859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:16.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:15 smithi156 ceph-mon[32679]: pgmap v19859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:16.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:15 smithi092 ceph-mon[29156]: pgmap v19859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:18.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:17 smithi189 ceph-mon[32756]: pgmap v19860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:18.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:17 smithi156 ceph-mon[32679]: pgmap v19860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:18.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:17 smithi092 ceph-mon[29156]: pgmap v19860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:19.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:18 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:27:19.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:18 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:27:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:18 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: pgmap v19861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36535.019282 secs 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35837.984677 secs 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:27:20.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: pgmap v19861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36535.019282 secs 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35837.984677 secs 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:27:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: pgmap v19861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36535.019282 secs 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35837.984677 secs 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:27:20.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:27:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:20 smithi189 ceph-mon[32756]: pgmap v19862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:27:21.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:20 smithi189 ceph-mon[32756]: pgmap v19863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:20 smithi156 ceph-mon[32679]: pgmap v19862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:27:21.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:20 smithi156 ceph-mon[32679]: pgmap v19863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:20 smithi092 ceph-mon[29156]: pgmap v19862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:27:21.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:20 smithi092 ceph-mon[29156]: pgmap v19863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:22 smithi189 ceph-mon[32756]: pgmap v19864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:23.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:22 smithi156 ceph-mon[32679]: pgmap v19864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:23.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:22 smithi092 ceph-mon[29156]: pgmap v19864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:25.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:24 smithi189 ceph-mon[32756]: pgmap v19865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36540.019361 secs 2024-04-27T04:27:25.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:24 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35842.984795 secs 2024-04-27T04:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:24 smithi156 ceph-mon[32679]: pgmap v19865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36540.019361 secs 2024-04-27T04:27:25.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:24 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35842.984795 secs 2024-04-27T04:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:24 smithi092 ceph-mon[29156]: pgmap v19865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36540.019361 secs 2024-04-27T04:27:25.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:24 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35842.984795 secs 2024-04-27T04:27:27.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:26 smithi189 ceph-mon[32756]: pgmap v19866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:27.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:26 smithi156 ceph-mon[32679]: pgmap v19866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:27.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:26 smithi092 ceph-mon[29156]: pgmap v19866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:27:29.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:28 smithi189 ceph-mon[32756]: pgmap v19867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:29.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:28 smithi156 ceph-mon[32679]: pgmap v19867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:29.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:28 smithi092 ceph-mon[29156]: pgmap v19867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:27:30.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36545.019501 secs 2024-04-27T04:27:30.145 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:29 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35847.984919 secs 2024-04-27T04:27:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36545.019501 secs 2024-04-27T04:27:30.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:29 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35847.984919 secs 2024-04-27T04:27:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36545.019501 secs 2024-04-27T04:27:30.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:29 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35847.984919 secs 2024-04-27T04:27:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:30 smithi156 ceph-mon[32679]: pgmap v19868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:27:31.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:30 smithi092 ceph-mon[29156]: pgmap v19868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:27:31.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:30 smithi189 ceph-mon[32756]: pgmap v19868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:27:33.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:32 smithi156 ceph-mon[32679]: pgmap v19869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:33.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:32 smithi092 ceph-mon[29156]: pgmap v19869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:33.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:32 smithi189 ceph-mon[32756]: pgmap v19869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:34 smithi156 ceph-mon[32679]: pgmap v19870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36550.019574 secs 2024-04-27T04:27:35.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:34 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35852.985045 secs 2024-04-27T04:27:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:34 smithi092 ceph-mon[29156]: pgmap v19870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36550.019574 secs 2024-04-27T04:27:35.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:34 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35852.985045 secs 2024-04-27T04:27:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:34 smithi189 ceph-mon[32756]: pgmap v19870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36550.019574 secs 2024-04-27T04:27:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:34 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35852.985045 secs 2024-04-27T04:27:37.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:36 smithi156 ceph-mon[32679]: pgmap v19871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:37.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:36 smithi092 ceph-mon[29156]: pgmap v19871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:37.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:36 smithi189 ceph-mon[32756]: pgmap v19871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:39.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:38 smithi156 ceph-mon[32679]: pgmap v19872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:39.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:38 smithi092 ceph-mon[29156]: pgmap v19872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:39.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:38 smithi189 ceph-mon[32756]: pgmap v19872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36555.019692 secs 2024-04-27T04:27:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:39 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35857.985165 secs 2024-04-27T04:27:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36555.019692 secs 2024-04-27T04:27:40.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:39 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35857.985165 secs 2024-04-27T04:27:40.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36555.019692 secs 2024-04-27T04:27:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:39 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35857.985165 secs 2024-04-27T04:27:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:40 smithi092 ceph-mon[29156]: pgmap v19873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:27:41.000+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:27:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:27:41.000+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:27:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:27:41.001+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:27:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:27:41.001+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 281 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:27:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:40 smithi156 ceph-mon[32679]: pgmap v19873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:41.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:40 smithi189 ceph-mon[32756]: pgmap v19873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:43.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:42 smithi156 ceph-mon[32679]: pgmap v19874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:43.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:42 smithi092 ceph-mon[29156]: pgmap v19874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:43.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:42 smithi189 ceph-mon[32756]: pgmap v19874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:44 smithi156 ceph-mon[32679]: pgmap v19875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36560.019755 secs 2024-04-27T04:27:45.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:44 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35862.985227 secs 2024-04-27T04:27:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:44 smithi189 ceph-mon[32756]: pgmap v19875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36560.019755 secs 2024-04-27T04:27:45.190 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:44 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35862.985227 secs 2024-04-27T04:27:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:44 smithi092 ceph-mon[29156]: pgmap v19875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36560.019755 secs 2024-04-27T04:27:45.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:44 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35862.985227 secs 2024-04-27T04:27:47.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:46 smithi156 ceph-mon[32679]: pgmap v19876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:47.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:46 smithi092 ceph-mon[29156]: pgmap v19876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:47.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:46 smithi189 ceph-mon[32756]: pgmap v19876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:49.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:48 smithi156 ceph-mon[32679]: pgmap v19877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:49.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:48 smithi092 ceph-mon[29156]: pgmap v19877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:49.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:48 smithi189 ceph-mon[32756]: pgmap v19877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36565.019883 secs 2024-04-27T04:27:50.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:49 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35867.985345 secs 2024-04-27T04:27:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36565.019883 secs 2024-04-27T04:27:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:49 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35867.985345 secs 2024-04-27T04:27:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36565.019883 secs 2024-04-27T04:27:50.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:49 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35867.985345 secs 2024-04-27T04:27:51.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:50 smithi092 ceph-mon[29156]: pgmap v19878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:51.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:50 smithi189 ceph-mon[32756]: pgmap v19878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:51.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:50 smithi156 ceph-mon[32679]: pgmap v19878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:53.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:52 smithi092 ceph-mon[29156]: pgmap v19879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:53.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:52 smithi189 ceph-mon[32756]: pgmap v19879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:53.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:52 smithi156 ceph-mon[32679]: pgmap v19879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:55.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:54 smithi092 ceph-mon[29156]: pgmap v19880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36570.020000 secs 2024-04-27T04:27:55.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:54 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35872.985458 secs 2024-04-27T04:27:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:54 smithi189 ceph-mon[32756]: pgmap v19880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:55.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36570.020000 secs 2024-04-27T04:27:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:54 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35872.985458 secs 2024-04-27T04:27:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:54 smithi156 ceph-mon[32679]: pgmap v19880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36570.020000 secs 2024-04-27T04:27:55.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:54 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35872.985458 secs 2024-04-27T04:27:57.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:56 smithi092 ceph-mon[29156]: pgmap v19881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:57.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:56 smithi189 ceph-mon[32756]: pgmap v19881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:57.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:56 smithi156 ceph-mon[32679]: pgmap v19881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:27:59.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:58 smithi092 ceph-mon[29156]: pgmap v19882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:59.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:58 smithi189 ceph-mon[32756]: pgmap v19882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:27:59.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:58 smithi156 ceph-mon[32679]: pgmap v19882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36575.020134 secs 2024-04-27T04:28:00.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:27:59 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35877.985564 secs 2024-04-27T04:28:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36575.020134 secs 2024-04-27T04:28:00.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:27:59 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35877.985564 secs 2024-04-27T04:28:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36575.020134 secs 2024-04-27T04:28:00.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:27:59 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35877.985564 secs 2024-04-27T04:28:01.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:00 smithi092 ceph-mon[29156]: pgmap v19883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:01.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:00 smithi189 ceph-mon[32756]: pgmap v19883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:01.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:00 smithi156 ceph-mon[32679]: pgmap v19883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:03.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:02 smithi092 ceph-mon[29156]: pgmap v19884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:03.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:02 smithi189 ceph-mon[32756]: pgmap v19884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:03.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:02 smithi156 ceph-mon[32679]: pgmap v19884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:04 smithi092 ceph-mon[29156]: pgmap v19885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36580.020231 secs 2024-04-27T04:28:05.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:04 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35882.985687 secs 2024-04-27T04:28:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:04 smithi189 ceph-mon[32756]: pgmap v19885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:05.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36580.020231 secs 2024-04-27T04:28:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:04 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35882.985687 secs 2024-04-27T04:28:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:04 smithi156 ceph-mon[32679]: pgmap v19885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36580.020231 secs 2024-04-27T04:28:05.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:04 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35882.985687 secs 2024-04-27T04:28:07.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:06 smithi092 ceph-mon[29156]: pgmap v19886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:07.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:06 smithi189 ceph-mon[32756]: pgmap v19886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:07.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:06 smithi156 ceph-mon[32679]: pgmap v19886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:09.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:08 smithi092 ceph-mon[29156]: pgmap v19887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:08 smithi189 ceph-mon[32756]: pgmap v19887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:09.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:08 smithi156 ceph-mon[32679]: pgmap v19887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36585.020343 secs 2024-04-27T04:28:10.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:09 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35887.985809 secs 2024-04-27T04:28:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36585.020343 secs 2024-04-27T04:28:10.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:09 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35887.985809 secs 2024-04-27T04:28:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36585.020343 secs 2024-04-27T04:28:10.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:09 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35887.985809 secs 2024-04-27T04:28:11.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:10 smithi092 ceph-mon[29156]: pgmap v19888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:11.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:10 smithi189 ceph-mon[32756]: pgmap v19888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:11.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:10 smithi156 ceph-mon[32679]: pgmap v19888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:13.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:12 smithi092 ceph-mon[29156]: pgmap v19889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:13.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:12 smithi189 ceph-mon[32756]: pgmap v19889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:13.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:12 smithi156 ceph-mon[32679]: pgmap v19889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:14 smithi092 ceph-mon[29156]: pgmap v19890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36590.020483 secs 2024-04-27T04:28:15.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:14 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35892.985945 secs 2024-04-27T04:28:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:14 smithi189 ceph-mon[32756]: pgmap v19890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:15.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36590.020483 secs 2024-04-27T04:28:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:14 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35892.985945 secs 2024-04-27T04:28:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:14 smithi156 ceph-mon[32679]: pgmap v19890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36590.020483 secs 2024-04-27T04:28:15.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:14 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35892.985945 secs 2024-04-27T04:28:17.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:16 smithi092 ceph-mon[29156]: pgmap v19891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:17.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:16 smithi189 ceph-mon[32756]: pgmap v19891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:17.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:16 smithi156 ceph-mon[32679]: pgmap v19891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:19.243 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:18 smithi092 ceph-mon[29156]: pgmap v19892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:19.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:18 smithi189 ceph-mon[32756]: pgmap v19892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:19.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:18 smithi156 ceph-mon[32679]: pgmap v19892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36595.020606 secs 2024-04-27T04:28:20.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:19 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35897.986077 secs 2024-04-27T04:28:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:28:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36595.020606 secs 2024-04-27T04:28:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:19 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35897.986077 secs 2024-04-27T04:28:20.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:28:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36595.020606 secs 2024-04-27T04:28:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:19 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35897.986077 secs 2024-04-27T04:28:20.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: pgmap v19893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: pgmap v19894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: pgmap v19895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: pgmap v19893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:28:21.433 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: pgmap v19894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:28:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: pgmap v19895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: pgmap v19893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:28:21.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:28:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: pgmap v19894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:28:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: pgmap v19895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:21.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:28:22.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:22 smithi156 ceph-mon[32679]: pgmap v19896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:22.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:22 smithi092 ceph-mon[29156]: pgmap v19896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:22.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:22 smithi189 ceph-mon[32756]: pgmap v19896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:24.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:24 smithi156 ceph-mon[32679]: pgmap v19897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:24.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:24 smithi092 ceph-mon[29156]: pgmap v19897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:24.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:24 smithi189 ceph-mon[32756]: pgmap v19897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36600.020747 secs 2024-04-27T04:28:25.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:25 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35902.986198 secs 2024-04-27T04:28:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36600.020747 secs 2024-04-27T04:28:25.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:25 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35902.986198 secs 2024-04-27T04:28:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36600.020747 secs 2024-04-27T04:28:25.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:25 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35902.986198 secs 2024-04-27T04:28:26.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:26 smithi156 ceph-mon[32679]: pgmap v19898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:26.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:26 smithi092 ceph-mon[29156]: pgmap v19898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:26.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:26 smithi189 ceph-mon[32756]: pgmap v19898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:28:28.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:28 smithi156 ceph-mon[32679]: pgmap v19899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:28:28.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:28 smithi092 ceph-mon[29156]: pgmap v19899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:28:28.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:28 smithi189 ceph-mon[32756]: pgmap v19899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:28:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:29 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35907.986329 secs 2024-04-27T04:28:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:29 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35907.986329 secs 2024-04-27T04:28:30.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:29 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35907.986329 secs 2024-04-27T04:28:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36605.020873 secs 2024-04-27T04:28:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:30 smithi092 ceph-mon[29156]: pgmap v19900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:28:31.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36605.020873 secs 2024-04-27T04:28:31.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:30 smithi189 ceph-mon[32756]: pgmap v19900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:28:31.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36605.020873 secs 2024-04-27T04:28:31.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:30 smithi156 ceph-mon[32679]: pgmap v19900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:28:32.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:32 smithi156 ceph-mon[32679]: pgmap v19901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:32.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:32 smithi092 ceph-mon[29156]: pgmap v19901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:32.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:32 smithi189 ceph-mon[32756]: pgmap v19901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:34.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:34 smithi156 ceph-mon[32679]: pgmap v19902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:34.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:34 smithi092 ceph-mon[29156]: pgmap v19902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:34 smithi189 ceph-mon[32756]: pgmap v19902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36610.020973 secs 2024-04-27T04:28:35.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:35 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35912.986362 secs 2024-04-27T04:28:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36610.020973 secs 2024-04-27T04:28:35.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:35 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35912.986362 secs 2024-04-27T04:28:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36610.020973 secs 2024-04-27T04:28:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:35 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35912.986362 secs 2024-04-27T04:28:36.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:36 smithi156 ceph-mon[32679]: pgmap v19903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:36.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:36 smithi092 ceph-mon[29156]: pgmap v19903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:36.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:36 smithi189 ceph-mon[32756]: pgmap v19903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:38 smithi156 ceph-mon[32679]: pgmap v19904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:38.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:38 smithi092 ceph-mon[29156]: pgmap v19904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:38.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:38 smithi189 ceph-mon[32756]: pgmap v19904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:39 smithi092 ceph-mon[29156]: 28 slow requests, 0 included below; oldest blocked for > 35917.986441 secs 2024-04-27T04:28:40.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:39 smithi189 ceph-mon[32756]: 28 slow requests, 0 included below; oldest blocked for > 35917.986441 secs 2024-04-27T04:28:40.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:39 smithi156 ceph-mon[32679]: 28 slow requests, 0 included below; oldest blocked for > 35917.986441 secs 2024-04-27T04:28:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:40 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 36615.021096 secs 2024-04-27T04:28:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:40 smithi092 ceph-mon[29156]: slow request 11521.485252 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:40 smithi092 ceph-mon[29156]: pgmap v19905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:40 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 36615.021096 secs 2024-04-27T04:28:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:40 smithi189 ceph-mon[32756]: slow request 11521.485252 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:41.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:40 smithi189 ceph-mon[32756]: pgmap v19905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:40 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 36615.021096 secs 2024-04-27T04:28:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:40 smithi156 ceph-mon[32679]: slow request 11521.485252 seconds old, received at 2024-04-27T01:16:37.451586+0000: client_request(client.17313:1 getattr pAsLsXsFs #0x1 2024-04-27T01:16:37.447460+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:41.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:40 smithi156 ceph-mon[32679]: pgmap v19905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:42 smithi156 ceph-mon[32679]: pgmap v19906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:42.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:42 smithi092 ceph-mon[29156]: pgmap v19906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:42.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:42 smithi189 ceph-mon[32756]: pgmap v19906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:44 smithi156 ceph-mon[32679]: pgmap v19907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:44.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:44 smithi092 ceph-mon[29156]: pgmap v19907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:44.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:44 smithi189 ceph-mon[32756]: pgmap v19907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36620.021221 secs 2024-04-27T04:28:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:45 smithi156 ceph-mon[32679]: 29 slow requests, 2 included below; oldest blocked for > 35922.986520 secs 2024-04-27T04:28:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:45 smithi156 ceph-mon[32679]: slow request 1443.921926 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:45 smithi156 ceph-mon[32679]: slow request 183.542245 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:28:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36620.021221 secs 2024-04-27T04:28:45.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:45 smithi092 ceph-mon[29156]: 29 slow requests, 2 included below; oldest blocked for > 35922.986520 secs 2024-04-27T04:28:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:45 smithi092 ceph-mon[29156]: slow request 1443.921926 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:45 smithi092 ceph-mon[29156]: slow request 183.542245 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:28:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36620.021221 secs 2024-04-27T04:28:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:45 smithi189 ceph-mon[32756]: 29 slow requests, 2 included below; oldest blocked for > 35922.986520 secs 2024-04-27T04:28:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:45 smithi189 ceph-mon[32756]: slow request 1443.921926 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:28:45.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:45 smithi189 ceph-mon[32756]: slow request 183.542245 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:28:46.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:28:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:28:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:46 smithi156 ceph-mon[32679]: pgmap v19908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:28:46.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:28:46.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:46 smithi092 ceph-mon[29156]: pgmap v19908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:28:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:28:46.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:46 smithi189 ceph-mon[32756]: pgmap v19908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:48.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:48 smithi156 ceph-mon[32679]: pgmap v19909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:48.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:48 smithi092 ceph-mon[29156]: pgmap v19909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:48.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:48 smithi189 ceph-mon[32756]: pgmap v19909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:49 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35927.986623 secs 2024-04-27T04:28:50.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:49 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35927.986623 secs 2024-04-27T04:28:50.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:49 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35927.986623 secs 2024-04-27T04:28:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36625.021319 secs 2024-04-27T04:28:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:50 smithi092 ceph-mon[29156]: pgmap v19910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36625.021319 secs 2024-04-27T04:28:51.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:50 smithi189 ceph-mon[32756]: pgmap v19910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36625.021319 secs 2024-04-27T04:28:51.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:50 smithi156 ceph-mon[32679]: pgmap v19910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:52.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:52 smithi156 ceph-mon[32679]: pgmap v19911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:52.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:52 smithi092 ceph-mon[29156]: pgmap v19911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:52.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:52 smithi189 ceph-mon[32756]: pgmap v19911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:54 smithi156 ceph-mon[32679]: pgmap v19912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:54.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:54 smithi092 ceph-mon[29156]: pgmap v19912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:54 smithi189 ceph-mon[32756]: pgmap v19912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:28:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36630.021383 secs 2024-04-27T04:28:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:55 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35932.986738 secs 2024-04-27T04:28:55.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36630.021383 secs 2024-04-27T04:28:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:55 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35932.986738 secs 2024-04-27T04:28:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36630.021383 secs 2024-04-27T04:28:55.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:55 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35932.986738 secs 2024-04-27T04:28:56.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:56 smithi156 ceph-mon[32679]: pgmap v19913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:56.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:56 smithi092 ceph-mon[29156]: pgmap v19913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:56.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:56 smithi189 ceph-mon[32756]: pgmap v19913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:58.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:58 smithi156 ceph-mon[32679]: pgmap v19914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:58.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:58 smithi092 ceph-mon[29156]: pgmap v19914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:58.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:58 smithi189 ceph-mon[32756]: pgmap v19914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:28:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:28:59 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35937.986852 secs 2024-04-27T04:29:00.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:28:59 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35937.986852 secs 2024-04-27T04:29:00.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:28:59 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35937.986852 secs 2024-04-27T04:29:00.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36635.021501 secs 2024-04-27T04:29:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:00 smithi092 ceph-mon[29156]: pgmap v19915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36635.021501 secs 2024-04-27T04:29:01.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:00 smithi189 ceph-mon[32756]: pgmap v19915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:01.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36635.021501 secs 2024-04-27T04:29:01.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:00 smithi156 ceph-mon[32679]: pgmap v19915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:02 smithi156 ceph-mon[32679]: pgmap v19916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:02.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:02 smithi092 ceph-mon[29156]: pgmap v19916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:02.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:02 smithi189 ceph-mon[32756]: pgmap v19916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:04 smithi156 ceph-mon[32679]: pgmap v19917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:04.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:04 smithi092 ceph-mon[29156]: pgmap v19917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:04 smithi189 ceph-mon[32756]: pgmap v19917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36640.021624 secs 2024-04-27T04:29:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:05 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35942.986964 secs 2024-04-27T04:29:05.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36640.021624 secs 2024-04-27T04:29:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:05 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35942.986964 secs 2024-04-27T04:29:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36640.021624 secs 2024-04-27T04:29:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:05 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35942.986964 secs 2024-04-27T04:29:06.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:06 smithi156 ceph-mon[32679]: pgmap v19918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:06.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:06 smithi092 ceph-mon[29156]: pgmap v19918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:06.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:06 smithi189 ceph-mon[32756]: pgmap v19918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:08.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:08 smithi156 ceph-mon[32679]: pgmap v19919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:08.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:08 smithi092 ceph-mon[29156]: pgmap v19919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:08.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:08 smithi189 ceph-mon[32756]: pgmap v19919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:09.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:09 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35947.987099 secs 2024-04-27T04:29:10.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:09 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35947.987099 secs 2024-04-27T04:29:10.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:09 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35947.987099 secs 2024-04-27T04:29:10.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36645.021738 secs 2024-04-27T04:29:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:10 smithi092 ceph-mon[29156]: pgmap v19920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:29:11.013+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:29:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:29:11.013+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:29:11.013 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:29:11.013+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:29:11.014 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:29:11.013+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 282 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:29:11.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36645.021738 secs 2024-04-27T04:29:11.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:10 smithi189 ceph-mon[32756]: pgmap v19920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36645.021738 secs 2024-04-27T04:29:11.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:10 smithi156 ceph-mon[32679]: pgmap v19920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:12.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:12 smithi156 ceph-mon[32679]: pgmap v19921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:12.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:12 smithi092 ceph-mon[29156]: pgmap v19921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:12.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:12 smithi189 ceph-mon[32756]: pgmap v19921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:14.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:14 smithi156 ceph-mon[32679]: pgmap v19922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:14 smithi092 ceph-mon[29156]: pgmap v19922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:14 smithi189 ceph-mon[32756]: pgmap v19922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:15.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36650.021877 secs 2024-04-27T04:29:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:15 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35952.987194 secs 2024-04-27T04:29:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36650.021877 secs 2024-04-27T04:29:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:15 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35952.987194 secs 2024-04-27T04:29:15.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36650.021877 secs 2024-04-27T04:29:15.789 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:15 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35952.987194 secs 2024-04-27T04:29:16.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:16 smithi156 ceph-mon[32679]: pgmap v19923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:16.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:16 smithi092 ceph-mon[29156]: pgmap v19923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:16.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:16 smithi189 ceph-mon[32756]: pgmap v19923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:18 smithi156 ceph-mon[32679]: pgmap v19924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:18.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:18 smithi092 ceph-mon[29156]: pgmap v19924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:18.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:18 smithi189 ceph-mon[32756]: pgmap v19924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:19.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:19 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35957.987284 secs 2024-04-27T04:29:20.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:19 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35957.987284 secs 2024-04-27T04:29:20.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:19 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35957.987284 secs 2024-04-27T04:29:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36655.022025 secs 2024-04-27T04:29:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:20 smithi092 ceph-mon[29156]: pgmap v19925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:20.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:29:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36655.022025 secs 2024-04-27T04:29:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:20 smithi189 ceph-mon[32756]: pgmap v19925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:21.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:29:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36655.022025 secs 2024-04-27T04:29:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:20 smithi156 ceph-mon[32679]: pgmap v19925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:21.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:29:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:29:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:29:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:21 smithi092 ceph-mon[29156]: pgmap v19926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:29:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:21 smithi092 ceph-mon[29156]: pgmap v19927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:21.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:21 smithi189 ceph-mon[32756]: pgmap v19926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:21 smithi189 ceph-mon[32756]: pgmap v19927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:22.138 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:21 smithi156 ceph-mon[32679]: pgmap v19926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:21 smithi156 ceph-mon[32679]: pgmap v19927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:22.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:29:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:24 smithi156 ceph-mon[32679]: pgmap v19928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:29:24.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:24 smithi092 ceph-mon[29156]: pgmap v19928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:29:24.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:24 smithi189 ceph-mon[32756]: pgmap v19928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:29:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36660.022144 secs 2024-04-27T04:29:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:25 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35962.987408 secs 2024-04-27T04:29:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36660.022144 secs 2024-04-27T04:29:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:25 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35962.987408 secs 2024-04-27T04:29:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36660.022144 secs 2024-04-27T04:29:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:25 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35962.987408 secs 2024-04-27T04:29:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:26 smithi156 ceph-mon[32679]: pgmap v19929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:26.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:26 smithi092 ceph-mon[29156]: pgmap v19929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:26.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:26 smithi189 ceph-mon[32756]: pgmap v19929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:28 smithi156 ceph-mon[32679]: pgmap v19930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:28.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:28 smithi092 ceph-mon[29156]: pgmap v19930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:28.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:28 smithi189 ceph-mon[32756]: pgmap v19930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36665.022265 secs 2024-04-27T04:29:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:30 smithi156 ceph-mon[32679]: pgmap v19931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:30 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35967.987524 secs 2024-04-27T04:29:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36665.022265 secs 2024-04-27T04:29:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:30 smithi092 ceph-mon[29156]: pgmap v19931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:30 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35967.987524 secs 2024-04-27T04:29:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36665.022265 secs 2024-04-27T04:29:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:30 smithi189 ceph-mon[32756]: pgmap v19931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:29:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:30 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35967.987524 secs 2024-04-27T04:29:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:32 smithi156 ceph-mon[32679]: pgmap v19932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:29:32.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:32 smithi092 ceph-mon[29156]: pgmap v19932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:29:32.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:32 smithi189 ceph-mon[32756]: pgmap v19932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:29:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:34 smithi156 ceph-mon[32679]: pgmap v19933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:34.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:34 smithi092 ceph-mon[29156]: pgmap v19933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:34.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:34 smithi189 ceph-mon[32756]: pgmap v19933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36670.022396 secs 2024-04-27T04:29:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:35 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35972.987666 secs 2024-04-27T04:29:35.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36670.022396 secs 2024-04-27T04:29:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:35 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35972.987666 secs 2024-04-27T04:29:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36670.022396 secs 2024-04-27T04:29:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:35 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35972.987666 secs 2024-04-27T04:29:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:36 smithi156 ceph-mon[32679]: pgmap v19934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:36.493 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:36 smithi092 ceph-mon[29156]: pgmap v19934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:36.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:36 smithi189 ceph-mon[32756]: pgmap v19934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:38 smithi092 ceph-mon[29156]: pgmap v19935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:38.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:38 smithi189 ceph-mon[32756]: pgmap v19935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:38.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:38 smithi156 ceph-mon[32679]: pgmap v19935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36675.022537 secs 2024-04-27T04:29:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:40 smithi092 ceph-mon[29156]: pgmap v19936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:40 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35977.987805 secs 2024-04-27T04:29:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36675.022537 secs 2024-04-27T04:29:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:40 smithi189 ceph-mon[32756]: pgmap v19936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:40 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35977.987805 secs 2024-04-27T04:29:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36675.022537 secs 2024-04-27T04:29:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:40 smithi156 ceph-mon[32679]: pgmap v19936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:40 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35977.987805 secs 2024-04-27T04:29:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:42 smithi092 ceph-mon[29156]: pgmap v19937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:42.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:42 smithi189 ceph-mon[32756]: pgmap v19937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:42.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:42 smithi156 ceph-mon[32679]: pgmap v19937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:44 smithi092 ceph-mon[29156]: pgmap v19938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:44.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:44 smithi189 ceph-mon[32756]: pgmap v19938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:44.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:44 smithi156 ceph-mon[32679]: pgmap v19938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36680.022658 secs 2024-04-27T04:29:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:45 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35982.987922 secs 2024-04-27T04:29:45.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36680.022658 secs 2024-04-27T04:29:45.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:45 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35982.987922 secs 2024-04-27T04:29:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36680.022658 secs 2024-04-27T04:29:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:45 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35982.987922 secs 2024-04-27T04:29:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:46 smithi092 ceph-mon[29156]: pgmap v19939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:46.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:46 smithi189 ceph-mon[32756]: pgmap v19939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:46.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:46 smithi156 ceph-mon[32679]: pgmap v19939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:48.486 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:48 smithi156 ceph-mon[32679]: pgmap v19940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:48 smithi092 ceph-mon[29156]: pgmap v19940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:48.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:48 smithi189 ceph-mon[32756]: pgmap v19940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36685.022751 secs 2024-04-27T04:29:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:50 smithi092 ceph-mon[29156]: pgmap v19941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:50 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35987.988045 secs 2024-04-27T04:29:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36685.022751 secs 2024-04-27T04:29:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:50 smithi189 ceph-mon[32756]: pgmap v19941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:50 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35987.988045 secs 2024-04-27T04:29:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36685.022751 secs 2024-04-27T04:29:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:50 smithi156 ceph-mon[32679]: pgmap v19941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:50 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35987.988045 secs 2024-04-27T04:29:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:52 smithi092 ceph-mon[29156]: pgmap v19942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:52.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:52 smithi189 ceph-mon[32756]: pgmap v19942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:52.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:52 smithi156 ceph-mon[32679]: pgmap v19942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:54 smithi092 ceph-mon[29156]: pgmap v19943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:54.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:54 smithi189 ceph-mon[32756]: pgmap v19943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:54.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:54 smithi156 ceph-mon[32679]: pgmap v19943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36690.022868 secs 2024-04-27T04:29:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:55 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35992.988122 secs 2024-04-27T04:29:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36690.022868 secs 2024-04-27T04:29:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:55 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35992.988122 secs 2024-04-27T04:29:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36690.022868 secs 2024-04-27T04:29:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:55 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35992.988122 secs 2024-04-27T04:29:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:56 smithi092 ceph-mon[29156]: pgmap v19944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:56.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:56 smithi189 ceph-mon[32756]: pgmap v19944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:56.683 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:56 smithi156 ceph-mon[32679]: pgmap v19944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:29:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:29:58 smithi092 ceph-mon[29156]: pgmap v19945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:58.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:29:58 smithi189 ceph-mon[32756]: pgmap v19945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:29:58.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:29:58 smithi156 ceph-mon[32679]: pgmap v19945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36695.022962 secs 2024-04-27T04:30:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:00 smithi092 ceph-mon[29156]: pgmap v19946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:00 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 35997.988236 secs 2024-04-27T04:30:00.509 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36695.022962 secs 2024-04-27T04:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:00 smithi189 ceph-mon[32756]: pgmap v19946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:00 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 35997.988236 secs 2024-04-27T04:30:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:30:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36695.022962 secs 2024-04-27T04:30:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:00 smithi156 ceph-mon[32679]: pgmap v19946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:00 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 35997.988236 secs 2024-04-27T04:30:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:30:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:02 smithi189 ceph-mon[32756]: pgmap v19947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:02 smithi156 ceph-mon[32679]: pgmap v19947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:02 smithi092 ceph-mon[29156]: pgmap v19947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:04.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:04 smithi189 ceph-mon[32756]: pgmap v19948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:04.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:04 smithi156 ceph-mon[32679]: pgmap v19948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:04.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:04 smithi092 ceph-mon[29156]: pgmap v19948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36700.023079 secs 2024-04-27T04:30:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:05 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36002.988357 secs 2024-04-27T04:30:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36700.023079 secs 2024-04-27T04:30:05.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:05 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36002.988357 secs 2024-04-27T04:30:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36700.023079 secs 2024-04-27T04:30:05.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:05 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36002.988357 secs 2024-04-27T04:30:06.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:06 smithi189 ceph-mon[32756]: pgmap v19949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:06.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:06 smithi156 ceph-mon[32679]: pgmap v19949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:06.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:06 smithi092 ceph-mon[29156]: pgmap v19949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:08 smithi189 ceph-mon[32756]: pgmap v19950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:08.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:08 smithi156 ceph-mon[32679]: pgmap v19950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:08.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:08 smithi092 ceph-mon[29156]: pgmap v19950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36705.023218 secs 2024-04-27T04:30:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:10 smithi189 ceph-mon[32756]: pgmap v19951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:10.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:10 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36007.988418 secs 2024-04-27T04:30:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36705.023218 secs 2024-04-27T04:30:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:10 smithi156 ceph-mon[32679]: pgmap v19951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:10 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36007.988418 secs 2024-04-27T04:30:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36705.023218 secs 2024-04-27T04:30:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:10 smithi092 ceph-mon[29156]: pgmap v19951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:10.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:10 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36007.988418 secs 2024-04-27T04:30:12.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:12 smithi189 ceph-mon[32756]: pgmap v19952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:12.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:12 smithi156 ceph-mon[32679]: pgmap v19952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:12.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:12 smithi092 ceph-mon[29156]: pgmap v19952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:14.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:14 smithi189 ceph-mon[32756]: pgmap v19953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:14.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:14 smithi156 ceph-mon[32679]: pgmap v19953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:14.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:14 smithi092 ceph-mon[29156]: pgmap v19953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:15.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36710.023318 secs 2024-04-27T04:30:15.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:15 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36012.988538 secs 2024-04-27T04:30:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36710.023318 secs 2024-04-27T04:30:15.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:15 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36012.988538 secs 2024-04-27T04:30:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36710.023318 secs 2024-04-27T04:30:15.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:15 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36012.988538 secs 2024-04-27T04:30:16.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:16 smithi189 ceph-mon[32756]: pgmap v19954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:16.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:16 smithi156 ceph-mon[32679]: pgmap v19954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:16.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:16 smithi092 ceph-mon[29156]: pgmap v19954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:18.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:18 smithi189 ceph-mon[32756]: pgmap v19955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:18.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:18 smithi156 ceph-mon[32679]: pgmap v19955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:18.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:18 smithi092 ceph-mon[29156]: pgmap v19955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36715.023432 secs 2024-04-27T04:30:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:20 smithi189 ceph-mon[32756]: pgmap v19956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:20.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:20 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36017.988618 secs 2024-04-27T04:30:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36715.023432 secs 2024-04-27T04:30:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:20 smithi156 ceph-mon[32679]: pgmap v19956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:20.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:20 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36017.988618 secs 2024-04-27T04:30:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36715.023432 secs 2024-04-27T04:30:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:20 smithi092 ceph-mon[29156]: pgmap v19956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:30:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:20 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36017.988618 secs 2024-04-27T04:30:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:30:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:30:21.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:30:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:22 smithi189 ceph-mon[32756]: pgmap v19957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:30:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:30:22.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:30:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:22 smithi156 ceph-mon[32679]: pgmap v19957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:30:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:30:22.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:30:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:22 smithi092 ceph-mon[29156]: pgmap v19957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:30:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:30:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:30:22.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:30:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:23 smithi189 ceph-mon[32756]: pgmap v19958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:30:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:23 smithi189 ceph-mon[32756]: pgmap v19959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:30:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:23 smithi156 ceph-mon[32679]: pgmap v19958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:30:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:23 smithi156 ceph-mon[32679]: pgmap v19959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:30:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:23 smithi092 ceph-mon[29156]: pgmap v19958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:30:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:23 smithi092 ceph-mon[29156]: pgmap v19959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:30:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:25 smithi189 ceph-mon[32756]: pgmap v19960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36720.023550 secs 2024-04-27T04:30:25.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:25 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36022.988730 secs 2024-04-27T04:30:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:25 smithi156 ceph-mon[32679]: pgmap v19960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36720.023550 secs 2024-04-27T04:30:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:25 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36022.988730 secs 2024-04-27T04:30:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:25 smithi092 ceph-mon[29156]: pgmap v19960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36720.023550 secs 2024-04-27T04:30:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:25 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36022.988730 secs 2024-04-27T04:30:27.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:27 smithi189 ceph-mon[32756]: pgmap v19961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:27 smithi156 ceph-mon[32679]: pgmap v19961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:27.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:27 smithi092 ceph-mon[29156]: pgmap v19961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:29.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:29 smithi189 ceph-mon[32756]: pgmap v19962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:30:29.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:29 smithi156 ceph-mon[32679]: pgmap v19962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:30:29.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:29 smithi092 ceph-mon[29156]: pgmap v19962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:30:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36725.023705 secs 2024-04-27T04:30:30.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:30 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36027.988849 secs 2024-04-27T04:30:30.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36725.023705 secs 2024-04-27T04:30:30.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:30 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36027.988849 secs 2024-04-27T04:30:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36725.023705 secs 2024-04-27T04:30:30.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:30 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36027.988849 secs 2024-04-27T04:30:31.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:31 smithi189 ceph-mon[32756]: pgmap v19963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:31.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:31 smithi156 ceph-mon[32679]: pgmap v19963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:31.741 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:31 smithi092 ceph-mon[29156]: pgmap v19963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:30:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:33 smithi189 ceph-mon[32756]: pgmap v19964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:30:33.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:33 smithi156 ceph-mon[32679]: pgmap v19964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:30:33.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:33 smithi092 ceph-mon[29156]: pgmap v19964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:35 smithi189 ceph-mon[32756]: pgmap v19965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36730.023844 secs 2024-04-27T04:30:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:35 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36032.988927 secs 2024-04-27T04:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:35 smithi156 ceph-mon[32679]: pgmap v19965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36730.023844 secs 2024-04-27T04:30:35.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:35 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36032.988927 secs 2024-04-27T04:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:35 smithi092 ceph-mon[29156]: pgmap v19965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36730.023844 secs 2024-04-27T04:30:35.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:35 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36032.988927 secs 2024-04-27T04:30:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:37 smithi189 ceph-mon[32756]: pgmap v19966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:37.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:37 smithi156 ceph-mon[32679]: pgmap v19966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:37.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:37 smithi092 ceph-mon[29156]: pgmap v19966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:39 smithi189 ceph-mon[32756]: pgmap v19967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:39.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:39 smithi156 ceph-mon[32679]: pgmap v19967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:39.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:39 smithi092 ceph-mon[29156]: pgmap v19967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36735.023959 secs 2024-04-27T04:30:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:40 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36037.989018 secs 2024-04-27T04:30:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36735.023959 secs 2024-04-27T04:30:40.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:40 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36037.989018 secs 2024-04-27T04:30:40.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36735.023959 secs 2024-04-27T04:30:40.695 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36037.989018 secs 2024-04-27T04:30:40.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:30:40.694+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:30:40.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:30:40.694+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:30:40.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:30:40.694+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:30:40.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:30:40.694+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:30:40.994 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:30:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:30:40.694+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:30:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:30:41.024+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:30:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:30:41.024+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:30:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:30:41.025+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:30:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:30:41.025+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 283 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:30:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:41 smithi189 ceph-mon[32756]: pgmap v19968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:41.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:41 smithi156 ceph-mon[32679]: pgmap v19968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:41.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:41 smithi092 ceph-mon[29156]: pgmap v19968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:30:43.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:43 smithi189 ceph-mon[32756]: pgmap v19969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:43.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:43 smithi156 ceph-mon[32679]: pgmap v19969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:43.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:43 smithi092 ceph-mon[29156]: pgmap v19969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:45 smithi189 ceph-mon[32756]: pgmap v19970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36740.024056 secs 2024-04-27T04:30:45.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:45 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36042.989167 secs 2024-04-27T04:30:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:45 smithi156 ceph-mon[32679]: pgmap v19970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36740.024056 secs 2024-04-27T04:30:45.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:45 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36042.989167 secs 2024-04-27T04:30:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:45 smithi092 ceph-mon[29156]: pgmap v19970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36740.024056 secs 2024-04-27T04:30:45.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:45 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36042.989167 secs 2024-04-27T04:30:47.613 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:47 smithi092 ceph-mon[29156]: pgmap v19971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:47 smithi189 ceph-mon[32756]: pgmap v19971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:47.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:47 smithi156 ceph-mon[32679]: pgmap v19971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:49 smithi189 ceph-mon[32756]: pgmap v19972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:49.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:49 smithi156 ceph-mon[32679]: pgmap v19972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:49.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:49 smithi092 ceph-mon[29156]: pgmap v19972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36745.024175 secs 2024-04-27T04:30:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:50 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36047.989284 secs 2024-04-27T04:30:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36745.024175 secs 2024-04-27T04:30:50.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:50 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36047.989284 secs 2024-04-27T04:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36745.024175 secs 2024-04-27T04:30:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:50 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36047.989284 secs 2024-04-27T04:30:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:51 smithi189 ceph-mon[32756]: pgmap v19973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:51.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:51 smithi156 ceph-mon[32679]: pgmap v19973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:51.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:51 smithi092 ceph-mon[29156]: pgmap v19973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:53 smithi189 ceph-mon[32756]: pgmap v19974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:53 smithi156 ceph-mon[32679]: pgmap v19974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:53.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:53 smithi092 ceph-mon[29156]: pgmap v19974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T04:30:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:55 smithi189 ceph-mon[32756]: pgmap v19975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36750.024298 secs 2024-04-27T04:30:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:55 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36052.989383 secs 2024-04-27T04:30:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:55 smithi156 ceph-mon[32679]: pgmap v19975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36750.024298 secs 2024-04-27T04:30:55.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:55 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36052.989383 secs 2024-04-27T04:30:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:55 smithi092 ceph-mon[29156]: pgmap v19975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T04:30:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36750.024298 secs 2024-04-27T04:30:55.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:55 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36052.989383 secs 2024-04-27T04:30:57.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:57 smithi189 ceph-mon[32756]: pgmap v19976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:57 smithi156 ceph-mon[32679]: pgmap v19976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:57.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:57 smithi092 ceph-mon[29156]: pgmap v19976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:30:59 smithi189 ceph-mon[32756]: pgmap v19977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:30:59 smithi156 ceph-mon[32679]: pgmap v19977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:30:59.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:30:59 smithi092 ceph-mon[29156]: pgmap v19977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36755.024428 secs 2024-04-27T04:31:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:00 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36057.989445 secs 2024-04-27T04:31:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36755.024428 secs 2024-04-27T04:31:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:00 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36057.989445 secs 2024-04-27T04:31:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36755.024428 secs 2024-04-27T04:31:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:00 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36057.989445 secs 2024-04-27T04:31:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:01 smithi189 ceph-mon[32756]: pgmap v19978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:01.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:01 smithi156 ceph-mon[32679]: pgmap v19978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:01.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:01 smithi092 ceph-mon[29156]: pgmap v19978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:02.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:02 smithi189 ceph-mon[32756]: pgmap v19979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:02.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:02 smithi156 ceph-mon[32679]: pgmap v19979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:02.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:02 smithi092 ceph-mon[29156]: pgmap v19979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:04 smithi092 ceph-mon[29156]: pgmap v19980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36760.024483 secs 2024-04-27T04:31:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:04 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36062.989583 secs 2024-04-27T04:31:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:04 smithi189 ceph-mon[32756]: pgmap v19980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36760.024483 secs 2024-04-27T04:31:05.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:04 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36062.989583 secs 2024-04-27T04:31:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:04 smithi156 ceph-mon[32679]: pgmap v19980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36760.024483 secs 2024-04-27T04:31:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:04 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36062.989583 secs 2024-04-27T04:31:07.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:06 smithi092 ceph-mon[29156]: pgmap v19981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:07.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:06 smithi189 ceph-mon[32756]: pgmap v19981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:07.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:06 smithi156 ceph-mon[32679]: pgmap v19981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:09.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:08 smithi092 ceph-mon[29156]: pgmap v19982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:09.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:08 smithi189 ceph-mon[32756]: pgmap v19982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:09.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:08 smithi156 ceph-mon[32679]: pgmap v19982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36765.024603 secs 2024-04-27T04:31:10.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:09 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36067.989706 secs 2024-04-27T04:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36765.024603 secs 2024-04-27T04:31:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:09 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36067.989706 secs 2024-04-27T04:31:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36765.024603 secs 2024-04-27T04:31:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:09 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36067.989706 secs 2024-04-27T04:31:11.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:10 smithi092 ceph-mon[29156]: pgmap v19983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:11.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:10 smithi189 ceph-mon[32756]: pgmap v19983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:11.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:10 smithi156 ceph-mon[32679]: pgmap v19983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:13.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:12 smithi092 ceph-mon[29156]: pgmap v19984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:13.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:12 smithi189 ceph-mon[32756]: pgmap v19984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:13.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:12 smithi156 ceph-mon[32679]: pgmap v19984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:31:15.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:14 smithi092 ceph-mon[29156]: pgmap v19985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36770.024732 secs 2024-04-27T04:31:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:14 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36072.989824 secs 2024-04-27T04:31:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:14 smithi189 ceph-mon[32756]: pgmap v19985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:15.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36770.024732 secs 2024-04-27T04:31:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:14 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36072.989824 secs 2024-04-27T04:31:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:14 smithi156 ceph-mon[32679]: pgmap v19985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:31:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36770.024732 secs 2024-04-27T04:31:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:14 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36072.989824 secs 2024-04-27T04:31:17.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:16 smithi092 ceph-mon[29156]: pgmap v19986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:17.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:16 smithi189 ceph-mon[32756]: pgmap v19986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:17.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:16 smithi156 ceph-mon[32679]: pgmap v19986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:19.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:18 smithi156 ceph-mon[32679]: pgmap v19987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:19.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:18 smithi092 ceph-mon[29156]: pgmap v19987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:19.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:18 smithi189 ceph-mon[32756]: pgmap v19987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:20.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36775.024870 secs 2024-04-27T04:31:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:19 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36077.989919 secs 2024-04-27T04:31:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36775.024870 secs 2024-04-27T04:31:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:19 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36077.989919 secs 2024-04-27T04:31:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36775.024870 secs 2024-04-27T04:31:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:19 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36077.989919 secs 2024-04-27T04:31:21.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:20 smithi092 ceph-mon[29156]: pgmap v19988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:21.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:20 smithi189 ceph-mon[32756]: pgmap v19988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:21.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:20 smithi156 ceph-mon[32679]: pgmap v19988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:22 smithi092 ceph-mon[29156]: pgmap v19989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:31:23.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:31:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:31:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:22 smithi189 ceph-mon[32756]: pgmap v19989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:31:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:31:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:22 smithi156 ceph-mon[32679]: pgmap v19989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:31:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:31:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:31:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:31:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:23 smithi092 ceph-mon[29156]: pgmap v19990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:31:24.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:23 smithi092 ceph-mon[29156]: pgmap v19991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:31:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:23 smithi189 ceph-mon[32756]: pgmap v19990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:31:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:23 smithi189 ceph-mon[32756]: pgmap v19991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:31:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:23 smithi156 ceph-mon[32679]: pgmap v19990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:31:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:23 smithi156 ceph-mon[32679]: pgmap v19991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:31:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36780.024971 secs 2024-04-27T04:31:25.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:24 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36082.990046 secs 2024-04-27T04:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36780.024971 secs 2024-04-27T04:31:25.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:24 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36082.990046 secs 2024-04-27T04:31:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36780.024971 secs 2024-04-27T04:31:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:24 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36082.990046 secs 2024-04-27T04:31:26.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:25 smithi189 ceph-mon[32756]: pgmap v19992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:26.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:25 smithi156 ceph-mon[32679]: pgmap v19992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:26.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:25 smithi092 ceph-mon[29156]: pgmap v19992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:28.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:27 smithi189 ceph-mon[32756]: pgmap v19993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:27 smithi156 ceph-mon[32679]: pgmap v19993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:28.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:27 smithi092 ceph-mon[29156]: pgmap v19993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:30.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:30 smithi092 ceph-mon[29156]: pgmap v19994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:30.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36785.025095 secs 2024-04-27T04:31:30.297 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:30 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36087.990163 secs 2024-04-27T04:31:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:30 smithi189 ceph-mon[32756]: pgmap v19994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36785.025095 secs 2024-04-27T04:31:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:30 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36087.990163 secs 2024-04-27T04:31:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:30 smithi156 ceph-mon[32679]: pgmap v19994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36785.025095 secs 2024-04-27T04:31:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:30 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36087.990163 secs 2024-04-27T04:31:32.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:32 smithi189 ceph-mon[32756]: pgmap v19995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:32.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:32 smithi156 ceph-mon[32679]: pgmap v19995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:32 smithi092 ceph-mon[29156]: pgmap v19995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:31:34.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:34 smithi189 ceph-mon[32756]: pgmap v19996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:31:34.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:34 smithi156 ceph-mon[32679]: pgmap v19996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:31:34.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:34 smithi092 ceph-mon[29156]: pgmap v19996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:31:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36790.025188 secs 2024-04-27T04:31:35.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:35 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36092.990268 secs 2024-04-27T04:31:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36790.025188 secs 2024-04-27T04:31:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:35 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36092.990268 secs 2024-04-27T04:31:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36790.025188 secs 2024-04-27T04:31:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:35 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36092.990268 secs 2024-04-27T04:31:36.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:36 smithi189 ceph-mon[32756]: pgmap v19997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:36.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:36 smithi156 ceph-mon[32679]: pgmap v19997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:36.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:36 smithi092 ceph-mon[29156]: pgmap v19997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:38.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:38 smithi189 ceph-mon[32756]: pgmap v19998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:38.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:38 smithi156 ceph-mon[32679]: pgmap v19998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:38.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:38 smithi092 ceph-mon[29156]: pgmap v19998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:40 smithi189 ceph-mon[32756]: pgmap v19999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:40.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36795.025312 secs 2024-04-27T04:31:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:40 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36097.990384 secs 2024-04-27T04:31:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:40 smithi156 ceph-mon[32679]: pgmap v19999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36795.025312 secs 2024-04-27T04:31:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:40 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36097.990384 secs 2024-04-27T04:31:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:40 smithi092 ceph-mon[29156]: pgmap v19999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36795.025312 secs 2024-04-27T04:31:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:40 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36097.990384 secs 2024-04-27T04:31:42.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:42 smithi189 ceph-mon[32756]: pgmap v20000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:42.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:42 smithi156 ceph-mon[32679]: pgmap v20000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:42.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:42 smithi092 ceph-mon[29156]: pgmap v20000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:44.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:44 smithi189 ceph-mon[32756]: pgmap v20001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:44 smithi156 ceph-mon[32679]: pgmap v20001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:44 smithi092 ceph-mon[29156]: pgmap v20001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:45.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36800.025447 secs 2024-04-27T04:31:45.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:45 smithi189 ceph-mon[32756]: 29 slow requests, 2 included below; oldest blocked for > 36102.990508 secs 2024-04-27T04:31:45.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:45 smithi189 ceph-mon[32756]: slow request 5764.997047 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:45.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:45 smithi189 ceph-mon[32756]: slow request 363.546234 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36800.025447 secs 2024-04-27T04:31:45.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:45 smithi156 ceph-mon[32679]: 29 slow requests, 2 included below; oldest blocked for > 36102.990508 secs 2024-04-27T04:31:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:45 smithi156 ceph-mon[32679]: slow request 5764.997047 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:45 smithi156 ceph-mon[32679]: slow request 363.546234 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36800.025447 secs 2024-04-27T04:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:45 smithi092 ceph-mon[29156]: 29 slow requests, 2 included below; oldest blocked for > 36102.990508 secs 2024-04-27T04:31:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:45 smithi092 ceph-mon[29156]: slow request 5764.997047 seconds old, received at 2024-04-27T02:55:39.139495+0000: client_request(client.17427:1 getattr pAsLsXsFs #0x1 2024-04-27T02:55:39.135387+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:45 smithi092 ceph-mon[29156]: slow request 363.546234 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:31:46.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:46 smithi189 ceph-mon[32756]: pgmap v20002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:46.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:46 smithi156 ceph-mon[32679]: pgmap v20002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:46.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:46 smithi092 ceph-mon[29156]: pgmap v20002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:48.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:48 smithi189 ceph-mon[32756]: pgmap v20003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:48 smithi156 ceph-mon[32679]: pgmap v20003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:48 smithi092 ceph-mon[29156]: pgmap v20003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:50 smithi189 ceph-mon[32756]: pgmap v20004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:50.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36805.025565 secs 2024-04-27T04:31:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:50 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36107.990573 secs 2024-04-27T04:31:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:50 smithi156 ceph-mon[32679]: pgmap v20004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36805.025565 secs 2024-04-27T04:31:50.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:50 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36107.990573 secs 2024-04-27T04:31:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:50 smithi092 ceph-mon[29156]: pgmap v20004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36805.025565 secs 2024-04-27T04:31:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:50 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36107.990573 secs 2024-04-27T04:31:52.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:52 smithi189 ceph-mon[32756]: pgmap v20005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:52.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:52 smithi156 ceph-mon[32679]: pgmap v20005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:52 smithi092 ceph-mon[29156]: pgmap v20005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:54.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:54 smithi189 ceph-mon[32756]: pgmap v20006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:54 smithi156 ceph-mon[32679]: pgmap v20006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:54.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:54 smithi092 ceph-mon[29156]: pgmap v20006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:55.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36810.025684 secs 2024-04-27T04:31:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:55 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36112.990664 secs 2024-04-27T04:31:55.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36810.025684 secs 2024-04-27T04:31:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:55 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36112.990664 secs 2024-04-27T04:31:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36810.025684 secs 2024-04-27T04:31:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:55 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36112.990664 secs 2024-04-27T04:31:56.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:56 smithi189 ceph-mon[32756]: pgmap v20007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:56.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:56 smithi156 ceph-mon[32679]: pgmap v20007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:56 smithi092 ceph-mon[29156]: pgmap v20007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:31:58.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:31:58 smithi189 ceph-mon[32756]: pgmap v20008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:58.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:31:58 smithi156 ceph-mon[32679]: pgmap v20008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:31:58.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:31:58 smithi092 ceph-mon[29156]: pgmap v20008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:00.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:00 smithi189 ceph-mon[32756]: pgmap v20009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36815.025801 secs 2024-04-27T04:32:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:00 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36117.990787 secs 2024-04-27T04:32:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:00 smithi156 ceph-mon[32679]: pgmap v20009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36815.025801 secs 2024-04-27T04:32:00.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:00 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36117.990787 secs 2024-04-27T04:32:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:00 smithi092 ceph-mon[29156]: pgmap v20009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36815.025801 secs 2024-04-27T04:32:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:00 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36117.990787 secs 2024-04-27T04:32:02.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:02 smithi189 ceph-mon[32756]: pgmap v20010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:02.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:02 smithi156 ceph-mon[32679]: pgmap v20010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:02.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:02 smithi092 ceph-mon[29156]: pgmap v20010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:04.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:04 smithi189 ceph-mon[32756]: pgmap v20011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:04.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:04 smithi156 ceph-mon[32679]: pgmap v20011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:04.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:04 smithi092 ceph-mon[29156]: pgmap v20011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36820.025918 secs 2024-04-27T04:32:05.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:05 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36122.990909 secs 2024-04-27T04:32:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36820.025918 secs 2024-04-27T04:32:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:05 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36122.990909 secs 2024-04-27T04:32:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36820.025918 secs 2024-04-27T04:32:05.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:05 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36122.990909 secs 2024-04-27T04:32:06.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:06 smithi189 ceph-mon[32756]: pgmap v20012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:06.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:06 smithi156 ceph-mon[32679]: pgmap v20012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:06.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:06 smithi092 ceph-mon[29156]: pgmap v20012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:08.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:08 smithi189 ceph-mon[32756]: pgmap v20013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:08.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:08 smithi156 ceph-mon[32679]: pgmap v20013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:08.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:08 smithi092 ceph-mon[29156]: pgmap v20013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:10.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:10 smithi189 ceph-mon[32756]: pgmap v20014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36825.026036 secs 2024-04-27T04:32:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:10 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36127.991029 secs 2024-04-27T04:32:10.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:10 smithi156 ceph-mon[32679]: pgmap v20014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36825.026036 secs 2024-04-27T04:32:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:10 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36127.991029 secs 2024-04-27T04:32:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:10 smithi092 ceph-mon[29156]: pgmap v20014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36825.026036 secs 2024-04-27T04:32:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:10 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36127.991029 secs 2024-04-27T04:32:12.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:12 smithi189 ceph-mon[32756]: pgmap v20015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:12.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:12 smithi156 ceph-mon[32679]: pgmap v20015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:12.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:12 smithi092 ceph-mon[29156]: pgmap v20015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:14.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:14 smithi189 ceph-mon[32756]: pgmap v20016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:14.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:14 smithi156 ceph-mon[32679]: pgmap v20016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:14.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:14 smithi092 ceph-mon[29156]: pgmap v20016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36830.026133 secs 2024-04-27T04:32:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:15 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36132.991160 secs 2024-04-27T04:32:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36830.026133 secs 2024-04-27T04:32:15.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:15 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36132.991160 secs 2024-04-27T04:32:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36830.026133 secs 2024-04-27T04:32:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:15 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36132.991160 secs 2024-04-27T04:32:16.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:16 smithi189 ceph-mon[32756]: pgmap v20017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:16.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:16 smithi156 ceph-mon[32679]: pgmap v20017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:16.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:16 smithi092 ceph-mon[29156]: pgmap v20017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:18.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:18 smithi189 ceph-mon[32756]: pgmap v20018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:18.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:18 smithi156 ceph-mon[32679]: pgmap v20018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:18.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:18 smithi092 ceph-mon[29156]: pgmap v20018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:20.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:20 smithi189 ceph-mon[32756]: pgmap v20019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36835.026246 secs 2024-04-27T04:32:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:20 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36137.991284 secs 2024-04-27T04:32:20.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:20 smithi156 ceph-mon[32679]: pgmap v20019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36835.026246 secs 2024-04-27T04:32:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:20 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36137.991284 secs 2024-04-27T04:32:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:20 smithi092 ceph-mon[29156]: pgmap v20019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:20.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36835.026246 secs 2024-04-27T04:32:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:20 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36137.991284 secs 2024-04-27T04:32:22.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:22 smithi189 ceph-mon[32756]: pgmap v20020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:22.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:22 smithi156 ceph-mon[32679]: pgmap v20020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:22.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:22 smithi092 ceph-mon[29156]: pgmap v20020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:23.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:23 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:32:23.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:23 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:32:23.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:23 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:32:24.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:24 smithi189 ceph-mon[32756]: pgmap v20021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:32:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:32:24.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:32:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:24 smithi156 ceph-mon[32679]: pgmap v20021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:32:24.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:32:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:32:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:24 smithi092 ceph-mon[29156]: pgmap v20021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:32:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:32:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:32:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:25 smithi189 ceph-mon[32756]: pgmap v20022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:32:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:25 smithi189 ceph-mon[32756]: pgmap v20023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36840.026388 secs 2024-04-27T04:32:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:25 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36142.991370 secs 2024-04-27T04:32:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:25 smithi156 ceph-mon[32679]: pgmap v20022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:32:25.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:25 smithi156 ceph-mon[32679]: pgmap v20023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36840.026388 secs 2024-04-27T04:32:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:25 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36142.991370 secs 2024-04-27T04:32:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:25 smithi092 ceph-mon[29156]: pgmap v20022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:32:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:25 smithi092 ceph-mon[29156]: pgmap v20023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:25.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36840.026388 secs 2024-04-27T04:32:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:25 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36142.991370 secs 2024-04-27T04:32:27.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:27 smithi189 ceph-mon[32756]: pgmap v20024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:27.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:27 smithi156 ceph-mon[32679]: pgmap v20024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:27.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:27 smithi092 ceph-mon[29156]: pgmap v20024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:29 smithi189 ceph-mon[32756]: pgmap v20025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:29.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:29 smithi156 ceph-mon[32679]: pgmap v20025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:29.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:29 smithi092 ceph-mon[29156]: pgmap v20025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:32:30.388 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36845.026505 secs 2024-04-27T04:32:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:30 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36147.991450 secs 2024-04-27T04:32:30.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36845.026505 secs 2024-04-27T04:32:30.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:30 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36147.991450 secs 2024-04-27T04:32:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36845.026505 secs 2024-04-27T04:32:30.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:30 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36147.991450 secs 2024-04-27T04:32:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:31 smithi189 ceph-mon[32756]: pgmap v20026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:31.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:31 smithi156 ceph-mon[32679]: pgmap v20026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:31.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:31 smithi092 ceph-mon[29156]: pgmap v20026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:33.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:33 smithi156 ceph-mon[32679]: pgmap v20027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:33.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:33 smithi092 ceph-mon[29156]: pgmap v20027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:33.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:33 smithi189 ceph-mon[32756]: pgmap v20027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:32:35.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:35 smithi156 ceph-mon[32679]: pgmap v20028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:32:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36850.026615 secs 2024-04-27T04:32:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:35 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36152.991536 secs 2024-04-27T04:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:35 smithi092 ceph-mon[29156]: pgmap v20028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36850.026615 secs 2024-04-27T04:32:35.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:35 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36152.991536 secs 2024-04-27T04:32:35.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:35 smithi189 ceph-mon[32756]: pgmap v20028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:32:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36850.026615 secs 2024-04-27T04:32:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:35 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36152.991536 secs 2024-04-27T04:32:37.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:37 smithi156 ceph-mon[32679]: pgmap v20029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:37.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:37 smithi092 ceph-mon[29156]: pgmap v20029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:37.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:37 smithi189 ceph-mon[32756]: pgmap v20029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:39 smithi156 ceph-mon[32679]: pgmap v20030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:39.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:39 smithi092 ceph-mon[29156]: pgmap v20030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:39.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:39 smithi189 ceph-mon[32756]: pgmap v20030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:40.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36855.026689 secs 2024-04-27T04:32:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:40 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36157.991643 secs 2024-04-27T04:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36855.026689 secs 2024-04-27T04:32:40.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:40 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36157.991643 secs 2024-04-27T04:32:40.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36855.026689 secs 2024-04-27T04:32:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:40 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36157.991643 secs 2024-04-27T04:32:41.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:41 smithi156 ceph-mon[32679]: pgmap v20031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:41.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:41 smithi092 ceph-mon[29156]: pgmap v20031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:41.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:41 smithi189 ceph-mon[32756]: pgmap v20031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:43.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:43 smithi156 ceph-mon[32679]: pgmap v20032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:43.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:43 smithi092 ceph-mon[29156]: pgmap v20032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:43.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:43 smithi189 ceph-mon[32756]: pgmap v20032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:45 smithi156 ceph-mon[32679]: pgmap v20033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36860.026797 secs 2024-04-27T04:32:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:45 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36162.991753 secs 2024-04-27T04:32:45.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:45 smithi189 ceph-mon[32756]: pgmap v20033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:45.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36860.026797 secs 2024-04-27T04:32:45.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:45 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36162.991753 secs 2024-04-27T04:32:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:45 smithi092 ceph-mon[29156]: pgmap v20033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36860.026797 secs 2024-04-27T04:32:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:45 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36162.991753 secs 2024-04-27T04:32:47.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:47 smithi156 ceph-mon[32679]: pgmap v20034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:47.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:47 smithi092 ceph-mon[29156]: pgmap v20034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:47.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:47 smithi189 ceph-mon[32756]: pgmap v20034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:49.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:49 smithi156 ceph-mon[32679]: pgmap v20035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:49.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:49 smithi092 ceph-mon[29156]: pgmap v20035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:49.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:49 smithi189 ceph-mon[32756]: pgmap v20035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36865.026962 secs 2024-04-27T04:32:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:50 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36167.991829 secs 2024-04-27T04:32:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36865.026962 secs 2024-04-27T04:32:50.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:50 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36167.991829 secs 2024-04-27T04:32:50.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36865.026962 secs 2024-04-27T04:32:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:50 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36167.991829 secs 2024-04-27T04:32:51.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:51 smithi156 ceph-mon[32679]: pgmap v20036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:51.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:51 smithi092 ceph-mon[29156]: pgmap v20036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:51.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:51 smithi189 ceph-mon[32756]: pgmap v20036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:53.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:53 smithi092 ceph-mon[29156]: pgmap v20037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:53.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:53 smithi189 ceph-mon[32756]: pgmap v20037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:53.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:53 smithi156 ceph-mon[32679]: pgmap v20037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:55.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:55 smithi092 ceph-mon[29156]: pgmap v20038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36870.027081 secs 2024-04-27T04:32:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:55 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36172.991945 secs 2024-04-27T04:32:55.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:55 smithi189 ceph-mon[32756]: pgmap v20038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36870.027081 secs 2024-04-27T04:32:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:55 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36172.991945 secs 2024-04-27T04:32:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:55 smithi156 ceph-mon[32679]: pgmap v20038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36870.027081 secs 2024-04-27T04:32:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:55 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36172.991945 secs 2024-04-27T04:32:57.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:57 smithi092 ceph-mon[29156]: pgmap v20039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:57 smithi189 ceph-mon[32756]: pgmap v20039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:57.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:57 smithi156 ceph-mon[32679]: pgmap v20039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:32:59.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:32:59 smithi092 ceph-mon[29156]: pgmap v20040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:59.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:32:59 smithi189 ceph-mon[32756]: pgmap v20040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:32:59.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:32:59 smithi156 ceph-mon[32679]: pgmap v20040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:00.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36875.027202 secs 2024-04-27T04:33:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:00 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36177.992056 secs 2024-04-27T04:33:00.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36875.027202 secs 2024-04-27T04:33:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:00 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36177.992056 secs 2024-04-27T04:33:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36875.027202 secs 2024-04-27T04:33:00.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:00 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36177.992056 secs 2024-04-27T04:33:01.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:01 smithi092 ceph-mon[29156]: pgmap v20041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:01.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:01 smithi189 ceph-mon[32756]: pgmap v20041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:01.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:01 smithi156 ceph-mon[32679]: pgmap v20041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:03.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:03 smithi092 ceph-mon[29156]: pgmap v20042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:03 smithi189 ceph-mon[32756]: pgmap v20042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:03.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:03 smithi156 ceph-mon[32679]: pgmap v20042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:05.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:05 smithi092 ceph-mon[29156]: pgmap v20043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36880.027274 secs 2024-04-27T04:33:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:05 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36182.992165 secs 2024-04-27T04:33:05.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:05 smithi189 ceph-mon[32756]: pgmap v20043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36880.027274 secs 2024-04-27T04:33:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:05 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36182.992165 secs 2024-04-27T04:33:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:05 smithi156 ceph-mon[32679]: pgmap v20043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36880.027274 secs 2024-04-27T04:33:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:05 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36182.992165 secs 2024-04-27T04:33:07.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:07 smithi092 ceph-mon[29156]: pgmap v20044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:07 smithi189 ceph-mon[32756]: pgmap v20044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:07.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:07 smithi156 ceph-mon[32679]: pgmap v20044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:09.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:09 smithi092 ceph-mon[29156]: pgmap v20045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:09 smithi189 ceph-mon[32756]: pgmap v20045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:09.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:09 smithi156 ceph-mon[32679]: pgmap v20045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:10.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36885.027393 secs 2024-04-27T04:33:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:10 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36187.992264 secs 2024-04-27T04:33:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36885.027393 secs 2024-04-27T04:33:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:10 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36187.992264 secs 2024-04-27T04:33:10.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36885.027393 secs 2024-04-27T04:33:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:10 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36187.992264 secs 2024-04-27T04:33:11.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:11 smithi092 ceph-mon[29156]: pgmap v20046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:11.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:11 smithi189 ceph-mon[32756]: pgmap v20046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:11 smithi156 ceph-mon[32679]: pgmap v20046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:13.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:13 smithi092 ceph-mon[29156]: pgmap v20047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:13 smithi189 ceph-mon[32756]: pgmap v20047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:13.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:13 smithi156 ceph-mon[32679]: pgmap v20047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:15.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:15 smithi092 ceph-mon[29156]: pgmap v20048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36890.027510 secs 2024-04-27T04:33:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:15 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36192.992388 secs 2024-04-27T04:33:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:15 smithi189 ceph-mon[32756]: pgmap v20048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36890.027510 secs 2024-04-27T04:33:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:15 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36192.992388 secs 2024-04-27T04:33:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:15 smithi156 ceph-mon[32679]: pgmap v20048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36890.027510 secs 2024-04-27T04:33:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:15 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36192.992388 secs 2024-04-27T04:33:17.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:17 smithi092 ceph-mon[29156]: pgmap v20049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:17 smithi189 ceph-mon[32756]: pgmap v20049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:17.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:17 smithi156 ceph-mon[32679]: pgmap v20049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:19 smithi092 ceph-mon[29156]: pgmap v20050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:19 smithi189 ceph-mon[32756]: pgmap v20050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:19 smithi156 ceph-mon[32679]: pgmap v20050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:20.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36895.027630 secs 2024-04-27T04:33:20.585 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:20 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36197.992508 secs 2024-04-27T04:33:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36895.027630 secs 2024-04-27T04:33:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:20 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36197.992508 secs 2024-04-27T04:33:20.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36895.027630 secs 2024-04-27T04:33:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:20 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36197.992508 secs 2024-04-27T04:33:21.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:21 smithi189 ceph-mon[32756]: pgmap v20051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:21.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:21 smithi156 ceph-mon[32679]: pgmap v20051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:21.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:21 smithi092 ceph-mon[29156]: pgmap v20051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:23.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:23 smithi189 ceph-mon[32756]: pgmap v20052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:23.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:23 smithi156 ceph-mon[32679]: pgmap v20052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:23.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:23 smithi092 ceph-mon[29156]: pgmap v20052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:24 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:24 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:33:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:24 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:25 smithi189 ceph-mon[32756]: pgmap v20053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36900.027694 secs 2024-04-27T04:33:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:25 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36202.992579 secs 2024-04-27T04:33:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:25 smithi156 ceph-mon[32679]: pgmap v20053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:25.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36900.027694 secs 2024-04-27T04:33:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:25 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36202.992579 secs 2024-04-27T04:33:25.744 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:25 smithi092 ceph-mon[29156]: pgmap v20053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36900.027694 secs 2024-04-27T04:33:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:25 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36202.992579 secs 2024-04-27T04:33:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: pgmap v20054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:33:27.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: pgmap v20054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:33:27.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: pgmap v20054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:33:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: pgmap v20055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:28.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:28 smithi189 ceph-mon[32756]: pgmap v20056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:28.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: pgmap v20055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:28 smithi156 ceph-mon[32679]: pgmap v20056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: pgmap v20055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:33:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:28 smithi092 ceph-mon[29156]: pgmap v20056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36905.027818 secs 2024-04-27T04:33:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:30 smithi189 ceph-mon[32756]: pgmap v20057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:30 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36207.992701 secs 2024-04-27T04:33:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36905.027818 secs 2024-04-27T04:33:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:30 smithi156 ceph-mon[32679]: pgmap v20057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:30 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36207.992701 secs 2024-04-27T04:33:30.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36905.027818 secs 2024-04-27T04:33:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:30 smithi092 ceph-mon[29156]: pgmap v20057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:30 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36207.992701 secs 2024-04-27T04:33:32.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:32 smithi189 ceph-mon[32756]: pgmap v20058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:32 smithi156 ceph-mon[32679]: pgmap v20058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:32.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:32 smithi092 ceph-mon[29156]: pgmap v20058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:33 smithi189 ceph-mon[32756]: pgmap v20059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:33 smithi156 ceph-mon[32679]: pgmap v20059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:34.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:33 smithi092 ceph-mon[29156]: pgmap v20059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:34 smithi189 ceph-mon[32756]: 29 slow requests, 0 included below; oldest blocked for > 36212.992863 secs 2024-04-27T04:33:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:34 smithi156 ceph-mon[32679]: 29 slow requests, 0 included below; oldest blocked for > 36212.992863 secs 2024-04-27T04:33:35.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:34 smithi092 ceph-mon[29156]: 29 slow requests, 0 included below; oldest blocked for > 36212.992863 secs 2024-04-27T04:33:35.798 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36910.027948 secs 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000408) for more than 900000000 us, fault. 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803af70 tx=0x7f1ca80c1040 comp rx=0 tx=0).stop 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:33:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.049+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca8089000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T04:33:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.095+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.095+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.095+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.095+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=39 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.096+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.096+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T04:33:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:36.096+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T04:33:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36910.027948 secs 2024-04-27T04:33:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:35 smithi189 ceph-mon[32756]: pgmap v20060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:35 smithi156 ceph-mon[32679]: pgmap v20060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:36.244 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36910.027948 secs 2024-04-27T04:33:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:35 smithi092 ceph-mon[29156]: pgmap v20060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T04:33:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:38 smithi189 ceph-mon[32756]: pgmap v20061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:38.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:38 smithi156 ceph-mon[32679]: pgmap v20061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:38.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:38 smithi092 ceph-mon[29156]: pgmap v20061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:33:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:40 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 36915.028048 secs 2024-04-27T04:33:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:40 smithi189 ceph-mon[32756]: slow request 11521.370818 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:40 smithi189 ceph-mon[32756]: pgmap v20062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:40 smithi189 ceph-mon[32756]: 29 slow requests, 1 included below; oldest blocked for > 36217.992990 secs 2024-04-27T04:33:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:40 smithi189 ceph-mon[32756]: slow request 23044.649790 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:40 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 36915.028048 secs 2024-04-27T04:33:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:40 smithi156 ceph-mon[32679]: slow request 11521.370818 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:40 smithi156 ceph-mon[32679]: pgmap v20062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:40 smithi156 ceph-mon[32679]: 29 slow requests, 1 included below; oldest blocked for > 36217.992990 secs 2024-04-27T04:33:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:40 smithi156 ceph-mon[32679]: slow request 23044.649790 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:40 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 36915.028048 secs 2024-04-27T04:33:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:40 smithi092 ceph-mon[29156]: slow request 11521.370818 seconds old, received at 2024-04-27T01:21:37.572972+0000: client_request(client.17319:1 getattr pAsLsXsFs #0x1 2024-04-27T01:21:37.566642+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:40 smithi092 ceph-mon[29156]: pgmap v20062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:40 smithi092 ceph-mon[29156]: 29 slow requests, 1 included below; oldest blocked for > 36217.992990 secs 2024-04-27T04:33:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:40 smithi092 ceph-mon[29156]: slow request 23044.649790 seconds old, received at 2024-04-26T22:09:34.489233+0000: client_request(client.17100:1 getattr pAsLsXsFs #0x1 2024-04-26T22:09:34.485377+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:33:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:41.049+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:33:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:41.049+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:33:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:41.049+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:33:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:33:41.049+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 284 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:33:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:42 smithi189 ceph-mon[32756]: pgmap v20063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:42 smithi156 ceph-mon[32679]: pgmap v20063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:42 smithi092 ceph-mon[29156]: pgmap v20063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:44 smithi189 ceph-mon[32756]: pgmap v20064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:44.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:44 smithi156 ceph-mon[32679]: pgmap v20064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:44.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:44 smithi092 ceph-mon[29156]: pgmap v20064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36920.028166 secs 2024-04-27T04:33:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 36222.993053 secs 2024-04-27T04:33:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:45 smithi189 ceph-mon[32756]: slow request 183.435565 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:33:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36920.028166 secs 2024-04-27T04:33:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 36222.993053 secs 2024-04-27T04:33:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:45 smithi156 ceph-mon[32679]: slow request 183.435565 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:33:45.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36920.028166 secs 2024-04-27T04:33:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 36222.993053 secs 2024-04-27T04:33:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:45 smithi092 ceph-mon[29156]: slow request 183.435565 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:33:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:46 smithi189 ceph-mon[32756]: pgmap v20065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:33:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:33:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:46 smithi156 ceph-mon[32679]: pgmap v20065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:33:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:33:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:46 smithi092 ceph-mon[29156]: pgmap v20065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:33:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:33:48.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:48 smithi189 ceph-mon[32756]: pgmap v20066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:48.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:48 smithi156 ceph-mon[32679]: pgmap v20066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:48.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:48 smithi092 ceph-mon[29156]: pgmap v20066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36925.028283 secs 2024-04-27T04:33:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:50 smithi189 ceph-mon[32756]: pgmap v20067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36227.993119 secs 2024-04-27T04:33:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36925.028283 secs 2024-04-27T04:33:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:50 smithi156 ceph-mon[32679]: pgmap v20067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36227.993119 secs 2024-04-27T04:33:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36925.028283 secs 2024-04-27T04:33:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:50 smithi092 ceph-mon[29156]: pgmap v20067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36227.993119 secs 2024-04-27T04:33:52.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:52 smithi189 ceph-mon[32756]: pgmap v20068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:52.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:52 smithi156 ceph-mon[32679]: pgmap v20068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:52.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:52 smithi092 ceph-mon[29156]: pgmap v20068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:54 smithi092 ceph-mon[29156]: pgmap v20069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:54.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:54 smithi189 ceph-mon[32756]: pgmap v20069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:54.434 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:54 smithi156 ceph-mon[32679]: pgmap v20069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36930.028362 secs 2024-04-27T04:33:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36232.993269 secs 2024-04-27T04:33:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36930.028362 secs 2024-04-27T04:33:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36232.993269 secs 2024-04-27T04:33:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36930.028362 secs 2024-04-27T04:33:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36232.993269 secs 2024-04-27T04:33:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:56 smithi189 ceph-mon[32756]: pgmap v20070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:56.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:56 smithi156 ceph-mon[32679]: pgmap v20070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:56.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:56 smithi092 ceph-mon[29156]: pgmap v20070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:33:58.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:33:58 smithi189 ceph-mon[32756]: pgmap v20071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:58.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:33:58 smithi156 ceph-mon[32679]: pgmap v20071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:33:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:33:58 smithi092 ceph-mon[29156]: pgmap v20071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36935.028479 secs 2024-04-27T04:34:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:00 smithi189 ceph-mon[32756]: pgmap v20072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36237.993324 secs 2024-04-27T04:34:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36935.028479 secs 2024-04-27T04:34:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:00 smithi156 ceph-mon[32679]: pgmap v20072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36237.993324 secs 2024-04-27T04:34:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36935.028479 secs 2024-04-27T04:34:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:00 smithi092 ceph-mon[29156]: pgmap v20072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36237.993324 secs 2024-04-27T04:34:02.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:02 smithi189 ceph-mon[32756]: pgmap v20073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:02.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:02 smithi156 ceph-mon[32679]: pgmap v20073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:02.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:02 smithi092 ceph-mon[29156]: pgmap v20073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:04.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:04 smithi189 ceph-mon[32756]: pgmap v20074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:04 smithi156 ceph-mon[32679]: pgmap v20074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:04 smithi092 ceph-mon[29156]: pgmap v20074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36940.028612 secs 2024-04-27T04:34:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36242.993391 secs 2024-04-27T04:34:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36940.028612 secs 2024-04-27T04:34:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36242.993391 secs 2024-04-27T04:34:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36940.028612 secs 2024-04-27T04:34:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36242.993391 secs 2024-04-27T04:34:06.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:06 smithi156 ceph-mon[32679]: pgmap v20075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:06 smithi092 ceph-mon[29156]: pgmap v20075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:06 smithi189 ceph-mon[32756]: pgmap v20075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:08.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:08 smithi156 ceph-mon[32679]: pgmap v20076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:08.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:08 smithi092 ceph-mon[29156]: pgmap v20076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:08.638 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:08 smithi189 ceph-mon[32756]: pgmap v20076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36945.028712 secs 2024-04-27T04:34:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:10 smithi156 ceph-mon[32679]: pgmap v20077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36247.993528 secs 2024-04-27T04:34:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36945.028712 secs 2024-04-27T04:34:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:10 smithi092 ceph-mon[29156]: pgmap v20077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36247.993528 secs 2024-04-27T04:34:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36945.028712 secs 2024-04-27T04:34:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:10 smithi189 ceph-mon[32756]: pgmap v20077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36247.993528 secs 2024-04-27T04:34:12.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:12 smithi156 ceph-mon[32679]: pgmap v20078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:12.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:12 smithi092 ceph-mon[29156]: pgmap v20078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:12 smithi189 ceph-mon[32756]: pgmap v20078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:14 smithi156 ceph-mon[32679]: pgmap v20079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:14 smithi092 ceph-mon[29156]: pgmap v20079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:14 smithi189 ceph-mon[32756]: pgmap v20079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36950.028802 secs 2024-04-27T04:34:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36252.993628 secs 2024-04-27T04:34:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36950.028802 secs 2024-04-27T04:34:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36252.993628 secs 2024-04-27T04:34:15.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36950.028802 secs 2024-04-27T04:34:15.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36252.993628 secs 2024-04-27T04:34:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:16 smithi156 ceph-mon[32679]: pgmap v20080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:16.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:16 smithi092 ceph-mon[29156]: pgmap v20080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:16 smithi189 ceph-mon[32756]: pgmap v20080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:18.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:18 smithi156 ceph-mon[32679]: pgmap v20081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:18.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:18 smithi092 ceph-mon[29156]: pgmap v20081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:18 smithi189 ceph-mon[32756]: pgmap v20081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36955.028927 secs 2024-04-27T04:34:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:20 smithi156 ceph-mon[32679]: pgmap v20082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36257.993724 secs 2024-04-27T04:34:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36955.028927 secs 2024-04-27T04:34:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:20 smithi092 ceph-mon[29156]: pgmap v20082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36257.993724 secs 2024-04-27T04:34:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36955.028927 secs 2024-04-27T04:34:20.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:20 smithi189 ceph-mon[32756]: pgmap v20082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:20.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36257.993724 secs 2024-04-27T04:34:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:22 smithi156 ceph-mon[32679]: pgmap v20083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:22 smithi092 ceph-mon[29156]: pgmap v20083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:22 smithi189 ceph-mon[32756]: pgmap v20083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:24 smithi156 ceph-mon[32679]: pgmap v20084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:24.494 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:24 smithi092 ceph-mon[29156]: pgmap v20084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:24 smithi189 ceph-mon[32756]: pgmap v20084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36960.029042 secs 2024-04-27T04:34:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36262.993867 secs 2024-04-27T04:34:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36960.029042 secs 2024-04-27T04:34:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36262.993867 secs 2024-04-27T04:34:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36960.029042 secs 2024-04-27T04:34:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36262.993867 secs 2024-04-27T04:34:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:26 smithi156 ceph-mon[32679]: pgmap v20085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:26 smithi092 ceph-mon[29156]: pgmap v20085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:26 smithi189 ceph-mon[32756]: pgmap v20085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:34:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:34:27.684 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:34:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:28 smithi092 ceph-mon[29156]: pgmap v20086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:34:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:34:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:34:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:28 smithi189 ceph-mon[32756]: pgmap v20086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:34:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:34:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:34:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:28 smithi156 ceph-mon[32679]: pgmap v20086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:34:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:34:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:34:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:29 smithi092 ceph-mon[29156]: pgmap v20087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:34:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:29 smithi092 ceph-mon[29156]: pgmap v20088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:34:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:29 smithi189 ceph-mon[32756]: pgmap v20087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:34:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:29 smithi189 ceph-mon[32756]: pgmap v20088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:34:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:29 smithi156 ceph-mon[32679]: pgmap v20087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:34:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:29 smithi156 ceph-mon[32679]: pgmap v20088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:34:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36965.029159 secs 2024-04-27T04:34:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36267.993956 secs 2024-04-27T04:34:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36965.029159 secs 2024-04-27T04:34:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36267.993956 secs 2024-04-27T04:34:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36965.029159 secs 2024-04-27T04:34:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36267.993956 secs 2024-04-27T04:34:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:31 smithi092 ceph-mon[29156]: pgmap v20089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:31.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:31 smithi189 ceph-mon[32756]: pgmap v20089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:31 smithi156 ceph-mon[32679]: pgmap v20089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:33.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:33 smithi092 ceph-mon[29156]: pgmap v20090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:33 smithi189 ceph-mon[32756]: pgmap v20090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:33.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:33 smithi156 ceph-mon[32679]: pgmap v20090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:35 smithi092 ceph-mon[29156]: pgmap v20091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36970.029220 secs 2024-04-27T04:34:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36272.994075 secs 2024-04-27T04:34:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:35 smithi189 ceph-mon[32756]: pgmap v20091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36970.029220 secs 2024-04-27T04:34:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36272.994075 secs 2024-04-27T04:34:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:35 smithi156 ceph-mon[32679]: pgmap v20091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36970.029220 secs 2024-04-27T04:34:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36272.994075 secs 2024-04-27T04:34:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:37 smithi092 ceph-mon[29156]: pgmap v20092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:37.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:37 smithi189 ceph-mon[32756]: pgmap v20092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:37 smithi156 ceph-mon[32679]: pgmap v20092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:34:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:39 smithi092 ceph-mon[29156]: pgmap v20093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:34:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:39 smithi189 ceph-mon[32756]: pgmap v20093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:34:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:39 smithi156 ceph-mon[32679]: pgmap v20093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:34:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36975.029335 secs 2024-04-27T04:34:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36277.994187 secs 2024-04-27T04:34:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36975.029335 secs 2024-04-27T04:34:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36277.994187 secs 2024-04-27T04:34:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36975.029335 secs 2024-04-27T04:34:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36277.994187 secs 2024-04-27T04:34:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:41 smithi092 ceph-mon[29156]: pgmap v20094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:41 smithi189 ceph-mon[32756]: pgmap v20094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:41 smithi156 ceph-mon[32679]: pgmap v20094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:43 smithi092 ceph-mon[29156]: pgmap v20095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:43.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:43 smithi189 ceph-mon[32756]: pgmap v20095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:43.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:43 smithi156 ceph-mon[32679]: pgmap v20095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:45 smithi092 ceph-mon[29156]: pgmap v20096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:45 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36980.029456 secs 2024-04-27T04:34:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36282.994325 secs 2024-04-27T04:34:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:45 smithi189 ceph-mon[32756]: pgmap v20096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:45 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36980.029456 secs 2024-04-27T04:34:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36282.994325 secs 2024-04-27T04:34:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:45 smithi156 ceph-mon[32679]: pgmap v20096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:45 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36980.029456 secs 2024-04-27T04:34:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36282.994325 secs 2024-04-27T04:34:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:47 smithi092 ceph-mon[29156]: pgmap v20097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:47 smithi189 ceph-mon[32756]: pgmap v20097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:47.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:47 smithi156 ceph-mon[32679]: pgmap v20097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:49 smithi092 ceph-mon[29156]: pgmap v20098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:49 smithi189 ceph-mon[32756]: pgmap v20098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:49 smithi156 ceph-mon[32679]: pgmap v20098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:50.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:50 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36985.029604 secs 2024-04-27T04:34:50.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36287.994467 secs 2024-04-27T04:34:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:50 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36985.029604 secs 2024-04-27T04:34:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36287.994467 secs 2024-04-27T04:34:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:50 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36985.029604 secs 2024-04-27T04:34:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36287.994467 secs 2024-04-27T04:34:51.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:51 smithi189 ceph-mon[32756]: pgmap v20099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:51.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:51 smithi156 ceph-mon[32679]: pgmap v20099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:51 smithi092 ceph-mon[29156]: pgmap v20099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:53 smithi189 ceph-mon[32756]: pgmap v20100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:53.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:53 smithi156 ceph-mon[32679]: pgmap v20100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:53 smithi092 ceph-mon[29156]: pgmap v20100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:55 smithi189 ceph-mon[32756]: pgmap v20101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:55 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36990.029745 secs 2024-04-27T04:34:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36292.994606 secs 2024-04-27T04:34:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:55 smithi156 ceph-mon[32679]: pgmap v20101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:55 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36990.029745 secs 2024-04-27T04:34:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36292.994606 secs 2024-04-27T04:34:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:55 smithi092 ceph-mon[29156]: pgmap v20101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:34:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:55 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36990.029745 secs 2024-04-27T04:34:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36292.994606 secs 2024-04-27T04:34:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:57 smithi189 ceph-mon[32756]: pgmap v20102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:57 smithi156 ceph-mon[32679]: pgmap v20102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:57 smithi092 ceph-mon[29156]: pgmap v20102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:34:59 smithi189 ceph-mon[32756]: pgmap v20103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:34:59 smithi156 ceph-mon[32679]: pgmap v20103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:34:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:34:59 smithi092 ceph-mon[29156]: pgmap v20103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:00 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 36995.029858 secs 2024-04-27T04:35:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36297.994745 secs 2024-04-27T04:35:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:00 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 36995.029858 secs 2024-04-27T04:35:00.645 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36297.994745 secs 2024-04-27T04:35:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:00 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 36995.029858 secs 2024-04-27T04:35:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36297.994745 secs 2024-04-27T04:35:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:01 smithi189 ceph-mon[32756]: pgmap v20104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:01.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:01 smithi156 ceph-mon[32679]: pgmap v20104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:01.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:01 smithi092 ceph-mon[29156]: pgmap v20104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:03 smithi189 ceph-mon[32756]: pgmap v20105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:03 smithi156 ceph-mon[32679]: pgmap v20105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:03 smithi092 ceph-mon[29156]: pgmap v20105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:05 smithi189 ceph-mon[32756]: pgmap v20106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:05 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37000.029975 secs 2024-04-27T04:35:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36302.994865 secs 2024-04-27T04:35:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:05 smithi156 ceph-mon[32679]: pgmap v20106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:05 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37000.029975 secs 2024-04-27T04:35:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36302.994865 secs 2024-04-27T04:35:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:05 smithi092 ceph-mon[29156]: pgmap v20106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:05 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37000.029975 secs 2024-04-27T04:35:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36302.994865 secs 2024-04-27T04:35:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:07 smithi189 ceph-mon[32756]: pgmap v20107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:07 smithi156 ceph-mon[32679]: pgmap v20107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:07 smithi092 ceph-mon[29156]: pgmap v20107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:09 smithi189 ceph-mon[32756]: pgmap v20108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:09 smithi156 ceph-mon[32679]: pgmap v20108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:09 smithi092 ceph-mon[29156]: pgmap v20108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:10 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37005.030086 secs 2024-04-27T04:35:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36307.994985 secs 2024-04-27T04:35:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:10 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37005.030086 secs 2024-04-27T04:35:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36307.994985 secs 2024-04-27T04:35:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:10 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37005.030086 secs 2024-04-27T04:35:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36307.994985 secs 2024-04-27T04:35:11.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:11 smithi189 ceph-mon[32756]: pgmap v20109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:11 smithi156 ceph-mon[32679]: pgmap v20109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:11.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:11 smithi092 ceph-mon[29156]: pgmap v20109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:13 smithi189 ceph-mon[32756]: pgmap v20110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:13.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:13 smithi156 ceph-mon[32679]: pgmap v20110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:13 smithi092 ceph-mon[29156]: pgmap v20110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:15 smithi189 ceph-mon[32756]: pgmap v20111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:15 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37010.030214 secs 2024-04-27T04:35:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36312.995103 secs 2024-04-27T04:35:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:15 smithi156 ceph-mon[32679]: pgmap v20111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:15 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37010.030214 secs 2024-04-27T04:35:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36312.995103 secs 2024-04-27T04:35:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:15 smithi092 ceph-mon[29156]: pgmap v20111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:15 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37010.030214 secs 2024-04-27T04:35:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36312.995103 secs 2024-04-27T04:35:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:17 smithi189 ceph-mon[32756]: pgmap v20112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:17 smithi156 ceph-mon[32679]: pgmap v20112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:17.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:17 smithi092 ceph-mon[29156]: pgmap v20112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:19 smithi189 ceph-mon[32756]: pgmap v20113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:19 smithi156 ceph-mon[32679]: pgmap v20113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:19 smithi092 ceph-mon[29156]: pgmap v20113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:20.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:20 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37015.030332 secs 2024-04-27T04:35:20.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36317.995222 secs 2024-04-27T04:35:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:20 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37015.030332 secs 2024-04-27T04:35:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36317.995222 secs 2024-04-27T04:35:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:20 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37015.030332 secs 2024-04-27T04:35:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36317.995222 secs 2024-04-27T04:35:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:21 smithi189 ceph-mon[32756]: pgmap v20114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:21 smithi156 ceph-mon[32679]: pgmap v20114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:21 smithi092 ceph-mon[29156]: pgmap v20114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:23 smithi189 ceph-mon[32756]: pgmap v20115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:23 smithi156 ceph-mon[32679]: pgmap v20115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:23 smithi092 ceph-mon[29156]: pgmap v20115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:25 smithi189 ceph-mon[32756]: pgmap v20116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:25 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37020.030481 secs 2024-04-27T04:35:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36322.995342 secs 2024-04-27T04:35:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:25 smithi156 ceph-mon[32679]: pgmap v20116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:25 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37020.030481 secs 2024-04-27T04:35:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36322.995342 secs 2024-04-27T04:35:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:25 smithi092 ceph-mon[29156]: pgmap v20116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:35:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:25 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37020.030481 secs 2024-04-27T04:35:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36322.995342 secs 2024-04-27T04:35:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:27 smithi189 ceph-mon[32756]: pgmap v20117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:27.678 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:27 smithi092 ceph-mon[29156]: pgmap v20117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:27 smithi156 ceph-mon[32679]: pgmap v20117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:28.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:35:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:35:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:35:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:29 smithi189 ceph-mon[32756]: pgmap v20118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:35:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:35:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:35:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:29 smithi156 ceph-mon[32679]: pgmap v20118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:35:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:35:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:35:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:29 smithi092 ceph-mon[29156]: pgmap v20118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:35:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:35:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:35:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:30 smithi189 ceph-mon[32756]: pgmap v20119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:35:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:30 smithi189 ceph-mon[32756]: pgmap v20120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:35:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:30 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37025.030621 secs 2024-04-27T04:35:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36327.995427 secs 2024-04-27T04:35:30.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:30 smithi092 ceph-mon[29156]: pgmap v20119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:35:30.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:30 smithi092 ceph-mon[29156]: pgmap v20120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:35:30.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:30 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37025.030621 secs 2024-04-27T04:35:30.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36327.995427 secs 2024-04-27T04:35:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:30 smithi156 ceph-mon[32679]: pgmap v20119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:35:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:30 smithi156 ceph-mon[32679]: pgmap v20120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:35:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:30 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37025.030621 secs 2024-04-27T04:35:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36327.995427 secs 2024-04-27T04:35:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:32 smithi189 ceph-mon[32756]: pgmap v20121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:32 smithi156 ceph-mon[32679]: pgmap v20121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:32 smithi092 ceph-mon[29156]: pgmap v20121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:34 smithi189 ceph-mon[32756]: pgmap v20122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:35:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:34 smithi156 ceph-mon[32679]: pgmap v20122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:35:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:34 smithi092 ceph-mon[29156]: pgmap v20122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:35:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:35 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37030.030719 secs 2024-04-27T04:35:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36332.995564 secs 2024-04-27T04:35:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:35 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37030.030719 secs 2024-04-27T04:35:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36332.995564 secs 2024-04-27T04:35:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:35 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37030.030719 secs 2024-04-27T04:35:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36332.995564 secs 2024-04-27T04:35:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:36 smithi189 ceph-mon[32756]: pgmap v20123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:36 smithi156 ceph-mon[32679]: pgmap v20123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:36 smithi092 ceph-mon[29156]: pgmap v20123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:38 smithi189 ceph-mon[32756]: pgmap v20124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:38 smithi156 ceph-mon[32679]: pgmap v20124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:38 smithi092 ceph-mon[29156]: pgmap v20124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:35:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:40 smithi189 ceph-mon[32756]: pgmap v20125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:35:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:40 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 37035.030865 secs 2024-04-27T04:35:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36337.995674 secs 2024-04-27T04:35:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:40 smithi156 ceph-mon[32679]: pgmap v20125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:35:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:40 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 37035.030865 secs 2024-04-27T04:35:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36337.995674 secs 2024-04-27T04:35:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-mon[29156]: pgmap v20125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:35:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 37035.030865 secs 2024-04-27T04:35:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36337.995674 secs 2024-04-27T04:35:41.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:35:40.763+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:35:41.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:35:40.763+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:35:41.245 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:35:40.763+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:35:41.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:35:40.763+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:35:41.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:35:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:35:40.763+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:35:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:42 smithi189 ceph-mon[32756]: pgmap v20126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:42 smithi156 ceph-mon[32679]: pgmap v20126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:42 smithi092 ceph-mon[29156]: pgmap v20126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:44 smithi189 ceph-mon[32756]: pgmap v20127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:44 smithi156 ceph-mon[32679]: pgmap v20127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:44 smithi092 ceph-mon[29156]: pgmap v20127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37040.030986 secs 2024-04-27T04:35:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36342.995835 secs 2024-04-27T04:35:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37040.030986 secs 2024-04-27T04:35:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36342.995835 secs 2024-04-27T04:35:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37040.030986 secs 2024-04-27T04:35:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36342.995835 secs 2024-04-27T04:35:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:46 smithi189 ceph-mon[32756]: pgmap v20128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:46 smithi156 ceph-mon[32679]: pgmap v20128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:46 smithi092 ceph-mon[29156]: pgmap v20128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:48 smithi189 ceph-mon[32756]: pgmap v20129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:35:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:48 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:35:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:48 smithi156 ceph-mon[32679]: pgmap v20129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:35:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:48 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:35:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:48 smithi092 ceph-mon[29156]: pgmap v20129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:35:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:48 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:35:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:50 smithi189 ceph-mon[32756]: pgmap v20130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37045.031099 secs 2024-04-27T04:35:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36347.995926 secs 2024-04-27T04:35:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:50 smithi156 ceph-mon[32679]: pgmap v20130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37045.031099 secs 2024-04-27T04:35:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36347.995926 secs 2024-04-27T04:35:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:50 smithi092 ceph-mon[29156]: pgmap v20130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37045.031099 secs 2024-04-27T04:35:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36347.995926 secs 2024-04-27T04:35:52.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:52 smithi189 ceph-mon[32756]: pgmap v20131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T04:35:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:52 smithi156 ceph-mon[32679]: pgmap v20131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T04:35:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:52 smithi092 ceph-mon[29156]: pgmap v20131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-04-27T04:35:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:54 smithi189 ceph-mon[32756]: pgmap v20132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:54 smithi156 ceph-mon[32679]: pgmap v20132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:54 smithi092 ceph-mon[29156]: pgmap v20132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:35:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37050.031220 secs 2024-04-27T04:35:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36352.996066 secs 2024-04-27T04:35:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37050.031220 secs 2024-04-27T04:35:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36352.996066 secs 2024-04-27T04:35:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37050.031220 secs 2024-04-27T04:35:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36352.996066 secs 2024-04-27T04:35:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:56 smithi156 ceph-mon[32679]: pgmap v20133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:56 smithi092 ceph-mon[29156]: pgmap v20133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:56 smithi189 ceph-mon[32756]: pgmap v20133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:35:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:35:58 smithi156 ceph-mon[32679]: pgmap v20134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:35:58 smithi092 ceph-mon[29156]: pgmap v20134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:35:58.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:35:58 smithi189 ceph-mon[32756]: pgmap v20134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:00 smithi156 ceph-mon[32679]: pgmap v20135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37055.031360 secs 2024-04-27T04:36:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36357.996152 secs 2024-04-27T04:36:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:00 smithi092 ceph-mon[29156]: pgmap v20135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37055.031360 secs 2024-04-27T04:36:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36357.996152 secs 2024-04-27T04:36:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:00 smithi189 ceph-mon[32756]: pgmap v20135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37055.031360 secs 2024-04-27T04:36:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36357.996152 secs 2024-04-27T04:36:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:02 smithi156 ceph-mon[32679]: pgmap v20136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:02 smithi092 ceph-mon[29156]: pgmap v20136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:02 smithi189 ceph-mon[32756]: pgmap v20136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:04 smithi156 ceph-mon[32679]: pgmap v20137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:04 smithi092 ceph-mon[29156]: pgmap v20137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:04 smithi189 ceph-mon[32756]: pgmap v20137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37060.031481 secs 2024-04-27T04:36:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36362.996271 secs 2024-04-27T04:36:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37060.031481 secs 2024-04-27T04:36:05.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36362.996271 secs 2024-04-27T04:36:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37060.031481 secs 2024-04-27T04:36:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36362.996271 secs 2024-04-27T04:36:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:06 smithi156 ceph-mon[32679]: pgmap v20138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:06 smithi092 ceph-mon[29156]: pgmap v20138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:06 smithi189 ceph-mon[32756]: pgmap v20138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:08 smithi156 ceph-mon[32679]: pgmap v20139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:08 smithi092 ceph-mon[29156]: pgmap v20139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:08 smithi189 ceph-mon[32756]: pgmap v20139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:10 smithi156 ceph-mon[32679]: pgmap v20140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37065.031579 secs 2024-04-27T04:36:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36367.996388 secs 2024-04-27T04:36:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:10 smithi092 ceph-mon[29156]: pgmap v20140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37065.031579 secs 2024-04-27T04:36:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36367.996388 secs 2024-04-27T04:36:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:10 smithi189 ceph-mon[32756]: pgmap v20140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37065.031579 secs 2024-04-27T04:36:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36367.996388 secs 2024-04-27T04:36:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:12 smithi156 ceph-mon[32679]: pgmap v20141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:12 smithi092 ceph-mon[29156]: pgmap v20141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:12 smithi189 ceph-mon[32756]: pgmap v20141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:14 smithi156 ceph-mon[32679]: pgmap v20142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:14 smithi092 ceph-mon[29156]: pgmap v20142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:14 smithi189 ceph-mon[32756]: pgmap v20142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37070.031720 secs 2024-04-27T04:36:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36372.996534 secs 2024-04-27T04:36:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37070.031720 secs 2024-04-27T04:36:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36372.996534 secs 2024-04-27T04:36:15.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37070.031720 secs 2024-04-27T04:36:15.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36372.996534 secs 2024-04-27T04:36:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:16 smithi156 ceph-mon[32679]: pgmap v20143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:16 smithi092 ceph-mon[29156]: pgmap v20143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:16 smithi189 ceph-mon[32756]: pgmap v20143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:17.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:17 smithi092 ceph-mon[29156]: pgmap v20144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:17 smithi189 ceph-mon[32756]: pgmap v20144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:17 smithi156 ceph-mon[32679]: pgmap v20144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:19 smithi189 ceph-mon[32756]: pgmap v20145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:19 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36377.996653 secs 2024-04-27T04:36:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:19 smithi156 ceph-mon[32679]: pgmap v20145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:19 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36377.996653 secs 2024-04-27T04:36:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:19 smithi092 ceph-mon[29156]: pgmap v20145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:19 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36377.996653 secs 2024-04-27T04:36:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37075.031839 secs 2024-04-27T04:36:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37075.031839 secs 2024-04-27T04:36:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37075.031839 secs 2024-04-27T04:36:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:21 smithi189 ceph-mon[32756]: pgmap v20146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:21 smithi156 ceph-mon[32679]: pgmap v20146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:21 smithi092 ceph-mon[29156]: pgmap v20146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:23 smithi189 ceph-mon[32756]: pgmap v20147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:23 smithi156 ceph-mon[32679]: pgmap v20147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:23 smithi092 ceph-mon[29156]: pgmap v20147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:24 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36382.996724 secs 2024-04-27T04:36:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:24 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36382.996724 secs 2024-04-27T04:36:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:24 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36382.996724 secs 2024-04-27T04:36:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37080.031960 secs 2024-04-27T04:36:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:25 smithi189 ceph-mon[32756]: pgmap v20148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37080.031960 secs 2024-04-27T04:36:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:25 smithi156 ceph-mon[32679]: pgmap v20148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37080.031960 secs 2024-04-27T04:36:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:25 smithi092 ceph-mon[29156]: pgmap v20148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:27 smithi189 ceph-mon[32756]: pgmap v20149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:27 smithi156 ceph-mon[32679]: pgmap v20149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:27 smithi092 ceph-mon[29156]: pgmap v20149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:36:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:36:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:36:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: pgmap v20150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37085.032053 secs 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36387.996813 secs 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: pgmap v20151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: pgmap v20152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:29.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: pgmap v20150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37085.032053 secs 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36387.996813 secs 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:36:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: pgmap v20151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T04:36:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: pgmap v20152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:36:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: pgmap v20150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37085.032053 secs 2024-04-27T04:36:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36387.996813 secs 2024-04-27T04:36:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:36:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:36:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: pgmap v20151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-04-27T04:36:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: pgmap v20152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:36:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:32 smithi156 ceph-mon[32679]: pgmap v20153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:32.699 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:32 smithi092 ceph-mon[29156]: pgmap v20153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:32 smithi189 ceph-mon[32756]: pgmap v20153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:34 smithi156 ceph-mon[32679]: pgmap v20154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:34 smithi092 ceph-mon[29156]: pgmap v20154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:34 smithi189 ceph-mon[32756]: pgmap v20154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37090.032185 secs 2024-04-27T04:36:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36392.996891 secs 2024-04-27T04:36:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37090.032185 secs 2024-04-27T04:36:35.763 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36392.996891 secs 2024-04-27T04:36:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37090.032185 secs 2024-04-27T04:36:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36392.996891 secs 2024-04-27T04:36:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:36 smithi092 ceph-mon[29156]: pgmap v20155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:36 smithi189 ceph-mon[32756]: pgmap v20155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:36 smithi156 ceph-mon[32679]: pgmap v20155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:36:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:37 smithi092 ceph-mon[29156]: pgmap v20156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:37 smithi189 ceph-mon[32756]: pgmap v20156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:37 smithi156 ceph-mon[32679]: pgmap v20156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:36:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37095.032313 secs 2024-04-27T04:36:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36397.996976 secs 2024-04-27T04:36:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:40 smithi156 ceph-mon[32679]: pgmap v20157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:36:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37095.032313 secs 2024-04-27T04:36:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36397.996976 secs 2024-04-27T04:36:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:40 smithi092 ceph-mon[29156]: pgmap v20157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:36:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37095.032313 secs 2024-04-27T04:36:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36397.996976 secs 2024-04-27T04:36:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:40 smithi189 ceph-mon[32756]: pgmap v20157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:36:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:36:41.075+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:36:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:36:41.075+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:36:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:36:41.075+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:36:41.077 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:36:41.075+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 285 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:36:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:42 smithi156 ceph-mon[32679]: pgmap v20158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:42 smithi092 ceph-mon[29156]: pgmap v20158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:42 smithi189 ceph-mon[32756]: pgmap v20158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:44 smithi156 ceph-mon[32679]: pgmap v20159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:44 smithi092 ceph-mon[29156]: pgmap v20159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:44 smithi189 ceph-mon[32756]: pgmap v20159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37100.032439 secs 2024-04-27T04:36:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 36402.997091 secs 2024-04-27T04:36:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:45 smithi092 ceph-mon[29156]: slow request 363.439602 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:36:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:45 smithi092 ceph-mon[29156]: pgmap v20160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:45.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37100.032439 secs 2024-04-27T04:36:45.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 36402.997091 secs 2024-04-27T04:36:45.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:45 smithi189 ceph-mon[32756]: slow request 363.439602 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:36:45.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:45 smithi189 ceph-mon[32756]: pgmap v20160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37100.032439 secs 2024-04-27T04:36:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 36402.997091 secs 2024-04-27T04:36:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:45 smithi156 ceph-mon[32679]: slow request 363.439602 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:36:45.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:45 smithi156 ceph-mon[32679]: pgmap v20160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:48 smithi156 ceph-mon[32679]: pgmap v20161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:48 smithi092 ceph-mon[29156]: pgmap v20161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:48 smithi189 ceph-mon[32756]: pgmap v20161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37105.032547 secs 2024-04-27T04:36:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36407.997159 secs 2024-04-27T04:36:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:50 smithi156 ceph-mon[32679]: pgmap v20162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37105.032547 secs 2024-04-27T04:36:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36407.997159 secs 2024-04-27T04:36:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:50 smithi092 ceph-mon[29156]: pgmap v20162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37105.032547 secs 2024-04-27T04:36:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36407.997159 secs 2024-04-27T04:36:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:50 smithi189 ceph-mon[32756]: pgmap v20162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:51 smithi092 ceph-mon[29156]: pgmap v20163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:51 smithi189 ceph-mon[32756]: pgmap v20163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:51 smithi156 ceph-mon[32679]: pgmap v20163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:54 smithi156 ceph-mon[32679]: pgmap v20164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:54 smithi092 ceph-mon[29156]: pgmap v20164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:54 smithi189 ceph-mon[32756]: pgmap v20164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37110.032667 secs 2024-04-27T04:36:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36412.997278 secs 2024-04-27T04:36:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37110.032667 secs 2024-04-27T04:36:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36412.997278 secs 2024-04-27T04:36:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37110.032667 secs 2024-04-27T04:36:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36412.997278 secs 2024-04-27T04:36:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:56 smithi092 ceph-mon[29156]: pgmap v20165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:56 smithi189 ceph-mon[32756]: pgmap v20165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:56 smithi156 ceph-mon[32679]: pgmap v20165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:36:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:36:57 smithi092 ceph-mon[29156]: pgmap v20166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:36:57 smithi189 ceph-mon[32756]: pgmap v20166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:36:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:36:57 smithi156 ceph-mon[32679]: pgmap v20166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37115.032784 secs 2024-04-27T04:37:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36417.997392 secs 2024-04-27T04:37:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:00 smithi156 ceph-mon[32679]: pgmap v20167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37115.032784 secs 2024-04-27T04:37:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36417.997392 secs 2024-04-27T04:37:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:00 smithi092 ceph-mon[29156]: pgmap v20167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37115.032784 secs 2024-04-27T04:37:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36417.997392 secs 2024-04-27T04:37:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:00 smithi189 ceph-mon[32756]: pgmap v20167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:01.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:01 smithi092 ceph-mon[29156]: pgmap v20168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:01 smithi189 ceph-mon[32756]: pgmap v20168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:01 smithi156 ceph-mon[32679]: pgmap v20168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:04 smithi092 ceph-mon[29156]: pgmap v20169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:04 smithi189 ceph-mon[32756]: pgmap v20169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:04 smithi156 ceph-mon[32679]: pgmap v20169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37120.032894 secs 2024-04-27T04:37:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36422.997506 secs 2024-04-27T04:37:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37120.032894 secs 2024-04-27T04:37:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36422.997506 secs 2024-04-27T04:37:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37120.032894 secs 2024-04-27T04:37:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36422.997506 secs 2024-04-27T04:37:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:06 smithi092 ceph-mon[29156]: pgmap v20170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:06 smithi189 ceph-mon[32756]: pgmap v20170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:06 smithi156 ceph-mon[32679]: pgmap v20170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:07 smithi092 ceph-mon[29156]: pgmap v20171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:07 smithi189 ceph-mon[32756]: pgmap v20171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:07 smithi156 ceph-mon[32679]: pgmap v20171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37125.033007 secs 2024-04-27T04:37:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36427.997618 secs 2024-04-27T04:37:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:10 smithi092 ceph-mon[29156]: pgmap v20172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37125.033007 secs 2024-04-27T04:37:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36427.997618 secs 2024-04-27T04:37:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:10 smithi189 ceph-mon[32756]: pgmap v20172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37125.033007 secs 2024-04-27T04:37:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36427.997618 secs 2024-04-27T04:37:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:10 smithi156 ceph-mon[32679]: pgmap v20172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:11.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:11 smithi092 ceph-mon[29156]: pgmap v20173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:11 smithi189 ceph-mon[32756]: pgmap v20173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:11 smithi156 ceph-mon[32679]: pgmap v20173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:13 smithi189 ceph-mon[32756]: pgmap v20174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:13 smithi156 ceph-mon[32679]: pgmap v20174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:13 smithi092 ceph-mon[29156]: pgmap v20174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:14 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36432.997745 secs 2024-04-27T04:37:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:14 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36432.997745 secs 2024-04-27T04:37:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:14 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36432.997745 secs 2024-04-27T04:37:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37130.033087 secs 2024-04-27T04:37:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:15 smithi189 ceph-mon[32756]: pgmap v20175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37130.033087 secs 2024-04-27T04:37:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:15 smithi156 ceph-mon[32679]: pgmap v20175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37130.033087 secs 2024-04-27T04:37:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:15 smithi092 ceph-mon[29156]: pgmap v20175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:18 smithi092 ceph-mon[29156]: pgmap v20176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:18 smithi189 ceph-mon[32756]: pgmap v20176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:18 smithi156 ceph-mon[32679]: pgmap v20176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:19 smithi092 ceph-mon[29156]: pgmap v20177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:19 smithi189 ceph-mon[32756]: pgmap v20177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:19 smithi156 ceph-mon[32679]: pgmap v20177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37135.033183 secs 2024-04-27T04:37:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36437.997897 secs 2024-04-27T04:37:20.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37135.033183 secs 2024-04-27T04:37:20.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36437.997897 secs 2024-04-27T04:37:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37135.033183 secs 2024-04-27T04:37:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36437.997897 secs 2024-04-27T04:37:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:21 smithi092 ceph-mon[29156]: pgmap v20178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:21 smithi189 ceph-mon[32756]: pgmap v20178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:21 smithi156 ceph-mon[32679]: pgmap v20178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:23 smithi092 ceph-mon[29156]: pgmap v20179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:23 smithi189 ceph-mon[32756]: pgmap v20179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:23 smithi156 ceph-mon[32679]: pgmap v20179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:24 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36442.998009 secs 2024-04-27T04:37:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:24 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36442.998009 secs 2024-04-27T04:37:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:24 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36442.998009 secs 2024-04-27T04:37:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:37:26.081+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:37:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:37:26.081+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:37:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:37:26.082+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:37:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:37:26.082+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 286 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:37:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37140.033280 secs 2024-04-27T04:37:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:25 smithi189 ceph-mon[32756]: pgmap v20180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37140.033280 secs 2024-04-27T04:37:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:25 smithi156 ceph-mon[32679]: pgmap v20180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37140.033280 secs 2024-04-27T04:37:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:25 smithi092 ceph-mon[29156]: pgmap v20180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:27 smithi092 ceph-mon[29156]: pgmap v20181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:27 smithi189 ceph-mon[32756]: pgmap v20181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:27 smithi156 ceph-mon[32679]: pgmap v20181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:29 smithi092 ceph-mon[29156]: pgmap v20182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:37:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:29 smithi189 ceph-mon[32756]: pgmap v20182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:37:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:29 smithi156 ceph-mon[32679]: pgmap v20182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:37:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37145.033419 secs 2024-04-27T04:37:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36447.998127 secs 2024-04-27T04:37:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:37:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:37:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: pgmap v20183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:37:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: pgmap v20184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:37:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37145.033419 secs 2024-04-27T04:37:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36447.998127 secs 2024-04-27T04:37:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:37:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:37:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: pgmap v20183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:37:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: pgmap v20184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:37:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37145.033419 secs 2024-04-27T04:37:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36447.998127 secs 2024-04-27T04:37:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:37:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:37:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: pgmap v20183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:37:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: pgmap v20184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:37:33.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:33 smithi092 ceph-mon[29156]: pgmap v20185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:33 smithi189 ceph-mon[32756]: pgmap v20185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:33.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:33 smithi156 ceph-mon[32679]: pgmap v20185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37150.033536 secs 2024-04-27T04:37:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36452.998226 secs 2024-04-27T04:37:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:35 smithi092 ceph-mon[29156]: pgmap v20186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37150.033536 secs 2024-04-27T04:37:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36452.998226 secs 2024-04-27T04:37:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:35 smithi189 ceph-mon[32756]: pgmap v20186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37150.033536 secs 2024-04-27T04:37:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36452.998226 secs 2024-04-27T04:37:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:35 smithi156 ceph-mon[32679]: pgmap v20186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:37.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:37 smithi092 ceph-mon[29156]: pgmap v20187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:37.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:37 smithi189 ceph-mon[32756]: pgmap v20187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:37 smithi156 ceph-mon[32679]: pgmap v20187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:37:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:39 smithi092 ceph-mon[29156]: pgmap v20188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:37:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:39 smithi189 ceph-mon[32756]: pgmap v20188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:37:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:39 smithi156 ceph-mon[32679]: pgmap v20188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:37:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37155.033645 secs 2024-04-27T04:37:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36457.998364 secs 2024-04-27T04:37:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37155.033645 secs 2024-04-27T04:37:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36457.998364 secs 2024-04-27T04:37:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37155.033645 secs 2024-04-27T04:37:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36457.998364 secs 2024-04-27T04:37:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:41 smithi092 ceph-mon[29156]: pgmap v20189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:37:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:41 smithi189 ceph-mon[32756]: pgmap v20189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:37:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:41 smithi156 ceph-mon[32679]: pgmap v20189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:37:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:43 smithi092 ceph-mon[29156]: pgmap v20190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:43.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:43 smithi189 ceph-mon[32756]: pgmap v20190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:43.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:43 smithi156 ceph-mon[32679]: pgmap v20190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:45 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37160.033761 secs 2024-04-27T04:37:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 36462.998506 secs 2024-04-27T04:37:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:45 smithi092 ceph-mon[29156]: slow request 723.554231 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:37:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:45 smithi092 ceph-mon[29156]: pgmap v20191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:45 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37160.033761 secs 2024-04-27T04:37:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 36462.998506 secs 2024-04-27T04:37:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:45 smithi189 ceph-mon[32756]: slow request 723.554231 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:37:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:45 smithi189 ceph-mon[32756]: pgmap v20191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:45 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37160.033761 secs 2024-04-27T04:37:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 36462.998506 secs 2024-04-27T04:37:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:45 smithi156 ceph-mon[32679]: slow request 723.554231 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:37:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:45 smithi156 ceph-mon[32679]: pgmap v20191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:47 smithi092 ceph-mon[29156]: pgmap v20192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:47 smithi189 ceph-mon[32756]: pgmap v20192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:47.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:47 smithi156 ceph-mon[32679]: pgmap v20192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:49 smithi092 ceph-mon[29156]: pgmap v20193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:49 smithi189 ceph-mon[32756]: pgmap v20193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:49 smithi156 ceph-mon[32679]: pgmap v20193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:50.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:50 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37165.033883 secs 2024-04-27T04:37:50.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36467.998621 secs 2024-04-27T04:37:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:50 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37165.033883 secs 2024-04-27T04:37:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36467.998621 secs 2024-04-27T04:37:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:50 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37165.033883 secs 2024-04-27T04:37:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36467.998621 secs 2024-04-27T04:37:51.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:51 smithi189 ceph-mon[32756]: pgmap v20194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:51.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:51 smithi156 ceph-mon[32679]: pgmap v20194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:51 smithi092 ceph-mon[29156]: pgmap v20194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:53 smithi189 ceph-mon[32756]: pgmap v20195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:53.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:53 smithi156 ceph-mon[32679]: pgmap v20195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:53 smithi092 ceph-mon[29156]: pgmap v20195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:55 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37170.033992 secs 2024-04-27T04:37:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36472.998742 secs 2024-04-27T04:37:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:55 smithi189 ceph-mon[32756]: pgmap v20196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:55 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37170.033992 secs 2024-04-27T04:37:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36472.998742 secs 2024-04-27T04:37:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:55 smithi156 ceph-mon[32679]: pgmap v20196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:55 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37170.033992 secs 2024-04-27T04:37:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36472.998742 secs 2024-04-27T04:37:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:55 smithi092 ceph-mon[29156]: pgmap v20196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:37:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:57 smithi189 ceph-mon[32756]: pgmap v20197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:57 smithi156 ceph-mon[32679]: pgmap v20197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:57 smithi092 ceph-mon[29156]: pgmap v20197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:37:59 smithi189 ceph-mon[32756]: pgmap v20198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:37:59 smithi156 ceph-mon[32679]: pgmap v20198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:37:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:37:59 smithi092 ceph-mon[29156]: pgmap v20198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:00 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37175.034123 secs 2024-04-27T04:38:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36477.998829 secs 2024-04-27T04:38:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:00 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37175.034123 secs 2024-04-27T04:38:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36477.998829 secs 2024-04-27T04:38:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:00 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37175.034123 secs 2024-04-27T04:38:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36477.998829 secs 2024-04-27T04:38:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:01 smithi189 ceph-mon[32756]: pgmap v20199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:01.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:01 smithi156 ceph-mon[32679]: pgmap v20199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:01.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:01 smithi092 ceph-mon[29156]: pgmap v20199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:03 smithi189 ceph-mon[32756]: pgmap v20200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:03 smithi156 ceph-mon[32679]: pgmap v20200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:03 smithi092 ceph-mon[29156]: pgmap v20200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:05 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37180.034239 secs 2024-04-27T04:38:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36482.998955 secs 2024-04-27T04:38:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:05 smithi189 ceph-mon[32756]: pgmap v20201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:05 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37180.034239 secs 2024-04-27T04:38:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36482.998955 secs 2024-04-27T04:38:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:05 smithi156 ceph-mon[32679]: pgmap v20201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:05 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37180.034239 secs 2024-04-27T04:38:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36482.998955 secs 2024-04-27T04:38:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:05 smithi092 ceph-mon[29156]: pgmap v20201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:07 smithi189 ceph-mon[32756]: pgmap v20202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:07 smithi156 ceph-mon[32679]: pgmap v20202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:07 smithi092 ceph-mon[29156]: pgmap v20202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:09 smithi189 ceph-mon[32756]: pgmap v20203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:09 smithi156 ceph-mon[32679]: pgmap v20203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:09 smithi092 ceph-mon[29156]: pgmap v20203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:10 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37185.034360 secs 2024-04-27T04:38:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36487.999076 secs 2024-04-27T04:38:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:10 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37185.034360 secs 2024-04-27T04:38:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36487.999076 secs 2024-04-27T04:38:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:10 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37185.034360 secs 2024-04-27T04:38:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36487.999076 secs 2024-04-27T04:38:11.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:11 smithi189 ceph-mon[32756]: pgmap v20204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:11 smithi156 ceph-mon[32679]: pgmap v20204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:11.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:11 smithi092 ceph-mon[29156]: pgmap v20204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:13 smithi189 ceph-mon[32756]: pgmap v20205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:13.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:13 smithi156 ceph-mon[32679]: pgmap v20205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:13 smithi092 ceph-mon[29156]: pgmap v20205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:15 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37190.034471 secs 2024-04-27T04:38:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36492.999193 secs 2024-04-27T04:38:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:15 smithi189 ceph-mon[32756]: pgmap v20206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:15 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37190.034471 secs 2024-04-27T04:38:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36492.999193 secs 2024-04-27T04:38:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:15 smithi156 ceph-mon[32679]: pgmap v20206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:15 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37190.034471 secs 2024-04-27T04:38:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36492.999193 secs 2024-04-27T04:38:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:15 smithi092 ceph-mon[29156]: pgmap v20206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:17 smithi189 ceph-mon[32756]: pgmap v20207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:17 smithi156 ceph-mon[32679]: pgmap v20207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:17.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:17 smithi092 ceph-mon[29156]: pgmap v20207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:19 smithi189 ceph-mon[32756]: pgmap v20208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:19 smithi156 ceph-mon[32679]: pgmap v20208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:19.710 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:19 smithi092 ceph-mon[29156]: pgmap v20208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:20.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:20 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37195.034589 secs 2024-04-27T04:38:20.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36497.999258 secs 2024-04-27T04:38:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:20 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37195.034589 secs 2024-04-27T04:38:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36497.999258 secs 2024-04-27T04:38:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:20 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37195.034589 secs 2024-04-27T04:38:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36497.999258 secs 2024-04-27T04:38:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:21 smithi189 ceph-mon[32756]: pgmap v20209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:21 smithi156 ceph-mon[32679]: pgmap v20209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:21 smithi092 ceph-mon[29156]: pgmap v20209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:23 smithi189 ceph-mon[32756]: pgmap v20210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:23 smithi156 ceph-mon[32679]: pgmap v20210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:23 smithi092 ceph-mon[29156]: pgmap v20210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:25 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37200.034706 secs 2024-04-27T04:38:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36502.999376 secs 2024-04-27T04:38:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:25 smithi189 ceph-mon[32756]: pgmap v20211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:25 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37200.034706 secs 2024-04-27T04:38:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36502.999376 secs 2024-04-27T04:38:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:25 smithi156 ceph-mon[32679]: pgmap v20211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:25 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37200.034706 secs 2024-04-27T04:38:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36502.999376 secs 2024-04-27T04:38:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:25 smithi092 ceph-mon[29156]: pgmap v20211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:27 smithi189 ceph-mon[32756]: pgmap v20212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:27 smithi156 ceph-mon[32679]: pgmap v20212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:27 smithi092 ceph-mon[29156]: pgmap v20212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:29 smithi189 ceph-mon[32756]: pgmap v20213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:29 smithi156 ceph-mon[32679]: pgmap v20213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:29 smithi092 ceph-mon[29156]: pgmap v20213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:30 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37205.034841 secs 2024-04-27T04:38:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36507.999461 secs 2024-04-27T04:38:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:38:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:30 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37205.034841 secs 2024-04-27T04:38:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36507.999461 secs 2024-04-27T04:38:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:38:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:30 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37205.034841 secs 2024-04-27T04:38:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36507.999461 secs 2024-04-27T04:38:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:38:31.585 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:31 smithi092 ceph-mon[29156]: pgmap v20214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:31.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:31 smithi189 ceph-mon[32756]: pgmap v20214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:31 smithi156 ceph-mon[32679]: pgmap v20214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:33.466 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:33 smithi156 ceph-mon[32679]: pgmap v20215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:33 smithi092 ceph-mon[29156]: pgmap v20215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:33.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:33 smithi189 ceph-mon[32756]: pgmap v20215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37210.034908 secs 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36512.999540 secs 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: pgmap v20216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:38:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37210.034908 secs 2024-04-27T04:38:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36512.999540 secs 2024-04-27T04:38:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: pgmap v20216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:38:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37210.034908 secs 2024-04-27T04:38:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36512.999540 secs 2024-04-27T04:38:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: pgmap v20216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:38:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:38:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:36 smithi189 ceph-mon[32756]: pgmap v20217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:38:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:36 smithi189 ceph-mon[32756]: pgmap v20218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:36 smithi156 ceph-mon[32679]: pgmap v20217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:38:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:36 smithi156 ceph-mon[32679]: pgmap v20218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:36 smithi092 ceph-mon[29156]: pgmap v20217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:38:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:36 smithi092 ceph-mon[29156]: pgmap v20218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:38 smithi189 ceph-mon[32756]: pgmap v20219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:38 smithi156 ceph-mon[32679]: pgmap v20219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:38.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:38 smithi092 ceph-mon[29156]: pgmap v20219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:40 smithi189 ceph-mon[32756]: pgmap v20220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:40 smithi189 ceph-mon[32756]: 16 slow requests, 0 included below; oldest blocked for > 37215.034996 secs 2024-04-27T04:38:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36517.999673 secs 2024-04-27T04:38:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:40 smithi156 ceph-mon[32679]: pgmap v20220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:40 smithi156 ceph-mon[32679]: 16 slow requests, 0 included below; oldest blocked for > 37215.034996 secs 2024-04-27T04:38:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36517.999673 secs 2024-04-27T04:38:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:40 smithi092 ceph-mon[29156]: pgmap v20220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:40 smithi092 ceph-mon[29156]: 16 slow requests, 0 included below; oldest blocked for > 37215.034996 secs 2024-04-27T04:38:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36517.999673 secs 2024-04-27T04:38:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:42 smithi189 ceph-mon[32756]: pgmap v20221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:42 smithi156 ceph-mon[32679]: pgmap v20221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:42 smithi092 ceph-mon[29156]: pgmap v20221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:38:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:44 smithi189 ceph-mon[32756]: pgmap v20222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:38:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:44 smithi156 ceph-mon[32679]: pgmap v20222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:38:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:44 smithi092 ceph-mon[29156]: pgmap v20222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:38:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:45 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 37220.035067 secs 2024-04-27T04:38:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:45 smithi189 ceph-mon[32756]: slow request 183.181551 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:38:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36522.999795 secs 2024-04-27T04:38:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:45 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 37220.035067 secs 2024-04-27T04:38:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:45 smithi156 ceph-mon[32679]: slow request 183.181551 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:38:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36522.999795 secs 2024-04-27T04:38:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:45 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 37220.035067 secs 2024-04-27T04:38:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:45 smithi092 ceph-mon[29156]: slow request 183.181551 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:38:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36522.999795 secs 2024-04-27T04:38:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:46 smithi189 ceph-mon[32756]: pgmap v20223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:38:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:46 smithi156 ceph-mon[32679]: pgmap v20223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:38:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:46 smithi092 ceph-mon[29156]: pgmap v20223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:38:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:48 smithi189 ceph-mon[32756]: pgmap v20224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:48 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:38:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:48 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:48 smithi156 ceph-mon[32679]: pgmap v20224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:48 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:38:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:48 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:38:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:48 smithi092 ceph-mon[29156]: pgmap v20224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:48 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T04:38:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:48 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:38:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:50 smithi189 ceph-mon[32756]: pgmap v20225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37225.035183 secs 2024-04-27T04:38:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36527.999860 secs 2024-04-27T04:38:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:50 smithi156 ceph-mon[32679]: pgmap v20225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37225.035183 secs 2024-04-27T04:38:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36527.999860 secs 2024-04-27T04:38:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:50 smithi092 ceph-mon[29156]: pgmap v20225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37225.035183 secs 2024-04-27T04:38:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36527.999860 secs 2024-04-27T04:38:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:52 smithi189 ceph-mon[32756]: pgmap v20226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:52 smithi156 ceph-mon[32679]: pgmap v20226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:52 smithi092 ceph-mon[29156]: pgmap v20226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:54 smithi189 ceph-mon[32756]: pgmap v20227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:54 smithi156 ceph-mon[32679]: pgmap v20227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:54 smithi092 ceph-mon[29156]: pgmap v20227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37230.035278 secs 2024-04-27T04:38:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36532.999926 secs 2024-04-27T04:38:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37230.035278 secs 2024-04-27T04:38:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36532.999926 secs 2024-04-27T04:38:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37230.035278 secs 2024-04-27T04:38:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36532.999926 secs 2024-04-27T04:38:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:56 smithi189 ceph-mon[32756]: pgmap v20228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:56 smithi156 ceph-mon[32679]: pgmap v20228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:56 smithi092 ceph-mon[29156]: pgmap v20228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:38:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:38:58 smithi189 ceph-mon[32756]: pgmap v20229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:38:58 smithi156 ceph-mon[32679]: pgmap v20229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:38:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:38:58 smithi092 ceph-mon[29156]: pgmap v20229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:00 smithi156 ceph-mon[32679]: pgmap v20230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37235.035404 secs 2024-04-27T04:39:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36538.000045 secs 2024-04-27T04:39:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:00 smithi092 ceph-mon[29156]: pgmap v20230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37235.035404 secs 2024-04-27T04:39:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36538.000045 secs 2024-04-27T04:39:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:00 smithi189 ceph-mon[32756]: pgmap v20230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37235.035404 secs 2024-04-27T04:39:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36538.000045 secs 2024-04-27T04:39:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:02 smithi156 ceph-mon[32679]: pgmap v20231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:02 smithi092 ceph-mon[29156]: pgmap v20231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:02 smithi189 ceph-mon[32756]: pgmap v20231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:04 smithi156 ceph-mon[32679]: pgmap v20232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:04 smithi092 ceph-mon[29156]: pgmap v20232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:04 smithi189 ceph-mon[32756]: pgmap v20232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37240.035538 secs 2024-04-27T04:39:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36543.000194 secs 2024-04-27T04:39:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37240.035538 secs 2024-04-27T04:39:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36543.000194 secs 2024-04-27T04:39:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37240.035538 secs 2024-04-27T04:39:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36543.000194 secs 2024-04-27T04:39:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:06 smithi156 ceph-mon[32679]: pgmap v20233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:06 smithi092 ceph-mon[29156]: pgmap v20233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:06 smithi189 ceph-mon[32756]: pgmap v20233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:08 smithi156 ceph-mon[32679]: pgmap v20234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:08 smithi092 ceph-mon[29156]: pgmap v20234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:08 smithi189 ceph-mon[32756]: pgmap v20234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:10 smithi156 ceph-mon[32679]: pgmap v20235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37245.035684 secs 2024-04-27T04:39:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36548.000327 secs 2024-04-27T04:39:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:10 smithi092 ceph-mon[29156]: pgmap v20235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37245.035684 secs 2024-04-27T04:39:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36548.000327 secs 2024-04-27T04:39:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:10 smithi189 ceph-mon[32756]: pgmap v20235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37245.035684 secs 2024-04-27T04:39:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36548.000327 secs 2024-04-27T04:39:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:12 smithi156 ceph-mon[32679]: pgmap v20236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:12 smithi092 ceph-mon[29156]: pgmap v20236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:12 smithi189 ceph-mon[32756]: pgmap v20236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:14 smithi156 ceph-mon[32679]: pgmap v20237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:14 smithi092 ceph-mon[29156]: pgmap v20237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:14 smithi189 ceph-mon[32756]: pgmap v20237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37250.035801 secs 2024-04-27T04:39:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:15 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 36553.000386 secs 2024-04-27T04:39:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:15 smithi156 ceph-mon[32679]: slow request 1443.746690 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:39:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37250.035801 secs 2024-04-27T04:39:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:15 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 36553.000386 secs 2024-04-27T04:39:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:15 smithi092 ceph-mon[29156]: slow request 1443.746690 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:39:15.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37250.035801 secs 2024-04-27T04:39:15.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:15 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 36553.000386 secs 2024-04-27T04:39:15.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:15 smithi189 ceph-mon[32756]: slow request 1443.746690 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:39:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:16 smithi156 ceph-mon[32679]: pgmap v20238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:16 smithi092 ceph-mon[29156]: pgmap v20238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:16 smithi189 ceph-mon[32756]: pgmap v20238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:18 smithi156 ceph-mon[32679]: pgmap v20239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:18 smithi092 ceph-mon[29156]: pgmap v20239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:18 smithi189 ceph-mon[32756]: pgmap v20239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:20 smithi156 ceph-mon[32679]: pgmap v20240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37255.035880 secs 2024-04-27T04:39:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36558.000503 secs 2024-04-27T04:39:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:20 smithi092 ceph-mon[29156]: pgmap v20240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37255.035880 secs 2024-04-27T04:39:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36558.000503 secs 2024-04-27T04:39:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:20 smithi189 ceph-mon[32756]: pgmap v20240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37255.035880 secs 2024-04-27T04:39:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36558.000503 secs 2024-04-27T04:39:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:22 smithi092 ceph-mon[29156]: pgmap v20241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:22 smithi189 ceph-mon[32756]: pgmap v20241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:22 smithi156 ceph-mon[32679]: pgmap v20241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:24 smithi092 ceph-mon[29156]: pgmap v20242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:24 smithi189 ceph-mon[32756]: pgmap v20242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:24 smithi156 ceph-mon[32679]: pgmap v20242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:39:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37260.035971 secs 2024-04-27T04:39:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36563.000628 secs 2024-04-27T04:39:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37260.035971 secs 2024-04-27T04:39:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36563.000628 secs 2024-04-27T04:39:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37260.035971 secs 2024-04-27T04:39:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36563.000628 secs 2024-04-27T04:39:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:26 smithi092 ceph-mon[29156]: pgmap v20243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:26 smithi189 ceph-mon[32756]: pgmap v20243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:26 smithi156 ceph-mon[32679]: pgmap v20243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:28 smithi092 ceph-mon[29156]: pgmap v20244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:28 smithi189 ceph-mon[32756]: pgmap v20244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:28 smithi156 ceph-mon[32679]: pgmap v20244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:30 smithi092 ceph-mon[29156]: pgmap v20245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37265.036092 secs 2024-04-27T04:39:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36568.000751 secs 2024-04-27T04:39:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:30 smithi189 ceph-mon[32756]: pgmap v20245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37265.036092 secs 2024-04-27T04:39:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36568.000751 secs 2024-04-27T04:39:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:30 smithi156 ceph-mon[32679]: pgmap v20245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37265.036092 secs 2024-04-27T04:39:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36568.000751 secs 2024-04-27T04:39:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:32 smithi092 ceph-mon[29156]: pgmap v20246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:32 smithi189 ceph-mon[32756]: pgmap v20246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:32 smithi156 ceph-mon[32679]: pgmap v20246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:34 smithi092 ceph-mon[29156]: pgmap v20247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:34 smithi189 ceph-mon[32756]: pgmap v20247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:34 smithi156 ceph-mon[32679]: pgmap v20247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37270.036212 secs 2024-04-27T04:39:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36573.000839 secs 2024-04-27T04:39:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:35 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:39:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37270.036212 secs 2024-04-27T04:39:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36573.000839 secs 2024-04-27T04:39:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:35 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:39:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37270.036212 secs 2024-04-27T04:39:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36573.000839 secs 2024-04-27T04:39:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:35 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:39:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:36 smithi092 ceph-mon[29156]: pgmap v20248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:36 smithi189 ceph-mon[32756]: pgmap v20248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:36 smithi156 ceph-mon[32679]: pgmap v20248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:37 smithi092 ceph-mon[29156]: pgmap v20249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:37.797 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:37 smithi189 ceph-mon[32756]: pgmap v20249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:37 smithi156 ceph-mon[32679]: pgmap v20249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: pgmap v20250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37275.036342 secs 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: pgmap v20251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: pgmap v20252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36578.000912 secs 2024-04-27T04:39:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: pgmap v20250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37275.036342 secs 2024-04-27T04:39:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: pgmap v20251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: pgmap v20252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36578.000912 secs 2024-04-27T04:39:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: pgmap v20250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37275.036342 secs 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: pgmap v20251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: pgmap v20252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:39:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36578.000912 secs 2024-04-27T04:39:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:39:41.099+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:39:41.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:39:41.099+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:39:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:39:41.100+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:39:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:39:41.100+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 287 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:39:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:42 smithi156 ceph-mon[32679]: pgmap v20253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:42 smithi092 ceph-mon[29156]: pgmap v20253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:42 smithi189 ceph-mon[32756]: pgmap v20253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:44 smithi156 ceph-mon[32679]: pgmap v20254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:44 smithi092 ceph-mon[29156]: pgmap v20254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:44 smithi189 ceph-mon[32756]: pgmap v20254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37280.036461 secs 2024-04-27T04:39:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36583.001017 secs 2024-04-27T04:39:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37280.036461 secs 2024-04-27T04:39:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36583.001017 secs 2024-04-27T04:39:45.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37280.036461 secs 2024-04-27T04:39:45.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36583.001017 secs 2024-04-27T04:39:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:46 smithi156 ceph-mon[32679]: pgmap v20255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:46 smithi092 ceph-mon[29156]: pgmap v20255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:46.552 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:46 smithi189 ceph-mon[32756]: pgmap v20255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:39:48.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:48 smithi156 ceph-mon[32679]: pgmap v20256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:48 smithi092 ceph-mon[29156]: pgmap v20256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:48 smithi189 ceph-mon[32756]: pgmap v20256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:39:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37285.036575 secs 2024-04-27T04:39:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:50 smithi156 ceph-mon[32679]: pgmap v20257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:39:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36588.001136 secs 2024-04-27T04:39:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37285.036575 secs 2024-04-27T04:39:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:50 smithi092 ceph-mon[29156]: pgmap v20257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:39:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36588.001136 secs 2024-04-27T04:39:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37285.036575 secs 2024-04-27T04:39:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:50 smithi189 ceph-mon[32756]: pgmap v20257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:39:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36588.001136 secs 2024-04-27T04:39:52.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:52 smithi092 ceph-mon[29156]: pgmap v20258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:52 smithi189 ceph-mon[32756]: pgmap v20258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:52 smithi156 ceph-mon[32679]: pgmap v20258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:54 smithi092 ceph-mon[29156]: pgmap v20259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:54 smithi189 ceph-mon[32756]: pgmap v20259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:54 smithi156 ceph-mon[32679]: pgmap v20259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37290.036699 secs 2024-04-27T04:39:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36593.001251 secs 2024-04-27T04:39:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37290.036699 secs 2024-04-27T04:39:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36593.001251 secs 2024-04-27T04:39:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37290.036699 secs 2024-04-27T04:39:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36593.001251 secs 2024-04-27T04:39:56.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:56 smithi092 ceph-mon[29156]: pgmap v20260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:56.591 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:56 smithi189 ceph-mon[32756]: pgmap v20260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:56 smithi156 ceph-mon[32679]: pgmap v20260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:39:58.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:39:58 smithi092 ceph-mon[29156]: pgmap v20261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:39:58 smithi189 ceph-mon[32756]: pgmap v20261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:39:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:39:58 smithi156 ceph-mon[32679]: pgmap v20261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37295.036773 secs 2024-04-27T04:40:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:00 smithi092 ceph-mon[29156]: pgmap v20262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36598.001342 secs 2024-04-27T04:40:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:40:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37295.036773 secs 2024-04-27T04:40:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:00 smithi189 ceph-mon[32756]: pgmap v20262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36598.001342 secs 2024-04-27T04:40:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:40:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37295.036773 secs 2024-04-27T04:40:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:00 smithi156 ceph-mon[32679]: pgmap v20262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36598.001342 secs 2024-04-27T04:40:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:40:02.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:02 smithi092 ceph-mon[29156]: pgmap v20263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:02 smithi189 ceph-mon[32756]: pgmap v20263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:02 smithi156 ceph-mon[32679]: pgmap v20263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:04 smithi092 ceph-mon[29156]: pgmap v20264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:04 smithi189 ceph-mon[32756]: pgmap v20264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:04 smithi156 ceph-mon[32679]: pgmap v20264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37300.036889 secs 2024-04-27T04:40:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36603.001405 secs 2024-04-27T04:40:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37300.036889 secs 2024-04-27T04:40:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36603.001405 secs 2024-04-27T04:40:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37300.036889 secs 2024-04-27T04:40:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36603.001405 secs 2024-04-27T04:40:06.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:06 smithi092 ceph-mon[29156]: pgmap v20265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:06 smithi189 ceph-mon[32756]: pgmap v20265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:06 smithi156 ceph-mon[32679]: pgmap v20265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:08.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:08 smithi092 ceph-mon[29156]: pgmap v20266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:08 smithi189 ceph-mon[32756]: pgmap v20266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:08 smithi156 ceph-mon[32679]: pgmap v20266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37305.037004 secs 2024-04-27T04:40:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:10 smithi092 ceph-mon[29156]: pgmap v20267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36608.001508 secs 2024-04-27T04:40:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37305.037004 secs 2024-04-27T04:40:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:10 smithi189 ceph-mon[32756]: pgmap v20267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36608.001508 secs 2024-04-27T04:40:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37305.037004 secs 2024-04-27T04:40:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:10 smithi156 ceph-mon[32679]: pgmap v20267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36608.001508 secs 2024-04-27T04:40:12.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:12 smithi092 ceph-mon[29156]: pgmap v20268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:12 smithi189 ceph-mon[32756]: pgmap v20268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:12 smithi156 ceph-mon[32679]: pgmap v20268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:14 smithi092 ceph-mon[29156]: pgmap v20269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:14 smithi189 ceph-mon[32756]: pgmap v20269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:14 smithi156 ceph-mon[32679]: pgmap v20269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37310.037126 secs 2024-04-27T04:40:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36613.001627 secs 2024-04-27T04:40:15.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37310.037126 secs 2024-04-27T04:40:15.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36613.001627 secs 2024-04-27T04:40:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37310.037126 secs 2024-04-27T04:40:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36613.001627 secs 2024-04-27T04:40:16.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:16 smithi092 ceph-mon[29156]: pgmap v20270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:16 smithi189 ceph-mon[32756]: pgmap v20270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:16 smithi156 ceph-mon[32679]: pgmap v20270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:18.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:18 smithi092 ceph-mon[29156]: pgmap v20271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:18 smithi189 ceph-mon[32756]: pgmap v20271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:18 smithi156 ceph-mon[32679]: pgmap v20271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37315.037214 secs 2024-04-27T04:40:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:20 smithi189 ceph-mon[32756]: pgmap v20272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36618.001750 secs 2024-04-27T04:40:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37315.037214 secs 2024-04-27T04:40:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:20 smithi156 ceph-mon[32679]: pgmap v20272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36618.001750 secs 2024-04-27T04:40:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37315.037214 secs 2024-04-27T04:40:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:20 smithi092 ceph-mon[29156]: pgmap v20272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36618.001750 secs 2024-04-27T04:40:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:22 smithi189 ceph-mon[32756]: pgmap v20273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:22 smithi156 ceph-mon[32679]: pgmap v20273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:22 smithi092 ceph-mon[29156]: pgmap v20273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:23 smithi189 ceph-mon[32756]: pgmap v20274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:23 smithi156 ceph-mon[32679]: pgmap v20274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:23 smithi092 ceph-mon[29156]: pgmap v20274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37320.037364 secs 2024-04-27T04:40:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:24 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36623.001869 secs 2024-04-27T04:40:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37320.037364 secs 2024-04-27T04:40:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:24 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36623.001869 secs 2024-04-27T04:40:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37320.037364 secs 2024-04-27T04:40:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:24 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36623.001869 secs 2024-04-27T04:40:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:25 smithi156 ceph-mon[32679]: pgmap v20275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:25 smithi092 ceph-mon[29156]: pgmap v20275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:25 smithi189 ceph-mon[32756]: pgmap v20275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:28 smithi156 ceph-mon[32679]: pgmap v20276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:28 smithi092 ceph-mon[29156]: pgmap v20276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:28 smithi189 ceph-mon[32756]: pgmap v20276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37325.037497 secs 2024-04-27T04:40:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:30 smithi156 ceph-mon[32679]: pgmap v20277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36628.001999 secs 2024-04-27T04:40:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37325.037497 secs 2024-04-27T04:40:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:30 smithi092 ceph-mon[29156]: pgmap v20277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36628.001999 secs 2024-04-27T04:40:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37325.037497 secs 2024-04-27T04:40:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:30 smithi189 ceph-mon[32756]: pgmap v20277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36628.001999 secs 2024-04-27T04:40:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:32 smithi156 ceph-mon[32679]: pgmap v20278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:32.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:32 smithi092 ceph-mon[29156]: pgmap v20278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:32 smithi189 ceph-mon[32756]: pgmap v20278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:34 smithi092 ceph-mon[29156]: pgmap v20279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:34 smithi189 ceph-mon[32756]: pgmap v20279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:34 smithi156 ceph-mon[32679]: pgmap v20279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37330.037621 secs 2024-04-27T04:40:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36633.002140 secs 2024-04-27T04:40:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37330.037621 secs 2024-04-27T04:40:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36633.002140 secs 2024-04-27T04:40:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37330.037621 secs 2024-04-27T04:40:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36633.002140 secs 2024-04-27T04:40:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:36 smithi092 ceph-mon[29156]: pgmap v20280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:36 smithi189 ceph-mon[32756]: pgmap v20280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:36 smithi156 ceph-mon[32679]: pgmap v20280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:38 smithi092 ceph-mon[29156]: pgmap v20281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:38 smithi189 ceph-mon[32756]: pgmap v20281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:38 smithi156 ceph-mon[32679]: pgmap v20281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37335.037739 secs 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: pgmap v20282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36638.002261 secs 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:40:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:40:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37335.037739 secs 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: pgmap v20282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36638.002261 secs 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:40:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:40:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37335.037739 secs 2024-04-27T04:40:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: pgmap v20282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:40:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36638.002261 secs 2024-04-27T04:40:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:40:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:40:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:40:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:40:41.204 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:40:40.875+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:40:41.204 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:40:40.875+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:40:41.204 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:40:40.875+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:40:41.204 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:40:40.875+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:40:41.205 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:40:40 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:40:40.875+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:40:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:41 smithi092 ceph-mon[29156]: pgmap v20283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:40:41.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:41 smithi092 ceph-mon[29156]: pgmap v20284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:41 smithi189 ceph-mon[32756]: pgmap v20283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:40:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:41 smithi189 ceph-mon[32756]: pgmap v20284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:41 smithi156 ceph-mon[32679]: pgmap v20283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:40:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:41 smithi156 ceph-mon[32679]: pgmap v20284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:43 smithi092 ceph-mon[29156]: pgmap v20285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:43 smithi189 ceph-mon[32756]: pgmap v20285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:43.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:43 smithi156 ceph-mon[32679]: pgmap v20285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:40:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37340.037893 secs 2024-04-27T04:40:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:45 smithi092 ceph-mon[29156]: pgmap v20286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36643.002387 secs 2024-04-27T04:40:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37340.037893 secs 2024-04-27T04:40:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:45 smithi189 ceph-mon[32756]: pgmap v20286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36643.002387 secs 2024-04-27T04:40:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37340.037893 secs 2024-04-27T04:40:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:45 smithi156 ceph-mon[32679]: pgmap v20286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36643.002387 secs 2024-04-27T04:40:47.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:47 smithi092 ceph-mon[29156]: pgmap v20287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:47.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:47 smithi189 ceph-mon[32756]: pgmap v20287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:47.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:47 smithi156 ceph-mon[32679]: pgmap v20287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 231 B/s wr, 20 op/s 2024-04-27T04:40:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:49 smithi092 ceph-mon[29156]: pgmap v20288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 231 B/s wr, 17 op/s 2024-04-27T04:40:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:49 smithi189 ceph-mon[32756]: pgmap v20288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 231 B/s wr, 17 op/s 2024-04-27T04:40:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:49 smithi156 ceph-mon[32679]: pgmap v20288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 231 B/s wr, 17 op/s 2024-04-27T04:40:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37345.038024 secs 2024-04-27T04:40:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36648.002475 secs 2024-04-27T04:40:50.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37345.038024 secs 2024-04-27T04:40:50.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36648.002475 secs 2024-04-27T04:40:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37345.038024 secs 2024-04-27T04:40:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36648.002475 secs 2024-04-27T04:40:51.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:51 smithi092 ceph-mon[29156]: pgmap v20289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T04:40:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:51 smithi189 ceph-mon[32756]: pgmap v20289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T04:40:51.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:51 smithi156 ceph-mon[32679]: pgmap v20289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 204 B/s wr, 17 op/s 2024-04-27T04:40:53.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:53 smithi092 ceph-mon[29156]: pgmap v20290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:40:53.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:53 smithi189 ceph-mon[32756]: pgmap v20290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:40:53.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:53 smithi156 ceph-mon[32679]: pgmap v20290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:40:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37350.038148 secs 2024-04-27T04:40:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:55 smithi092 ceph-mon[29156]: pgmap v20291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:40:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36653.002594 secs 2024-04-27T04:40:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37350.038148 secs 2024-04-27T04:40:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:55 smithi189 ceph-mon[32756]: pgmap v20291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:40:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36653.002594 secs 2024-04-27T04:40:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37350.038148 secs 2024-04-27T04:40:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:55 smithi156 ceph-mon[32679]: pgmap v20291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:40:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36653.002594 secs 2024-04-27T04:40:57.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:57 smithi092 ceph-mon[29156]: pgmap v20292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:57.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:57 smithi189 ceph-mon[32756]: pgmap v20292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:57 smithi156 ceph-mon[32679]: pgmap v20292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:40:59 smithi092 ceph-mon[29156]: pgmap v20293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:40:59 smithi189 ceph-mon[32756]: pgmap v20293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:40:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:40:59 smithi156 ceph-mon[32679]: pgmap v20293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37355.038246 secs 2024-04-27T04:41:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36658.002711 secs 2024-04-27T04:41:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37355.038246 secs 2024-04-27T04:41:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36658.002711 secs 2024-04-27T04:41:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37355.038246 secs 2024-04-27T04:41:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36658.002711 secs 2024-04-27T04:41:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:01 smithi092 ceph-mon[29156]: pgmap v20294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:01.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:01 smithi189 ceph-mon[32756]: pgmap v20294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:01.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:01 smithi156 ceph-mon[32679]: pgmap v20294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:03 smithi189 ceph-mon[32756]: pgmap v20295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:03 smithi156 ceph-mon[32679]: pgmap v20295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:03 smithi092 ceph-mon[29156]: pgmap v20295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:05.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37360.038377 secs 2024-04-27T04:41:05.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:05 smithi092 ceph-mon[29156]: pgmap v20296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:05.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36663.002793 secs 2024-04-27T04:41:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37360.038377 secs 2024-04-27T04:41:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:05 smithi189 ceph-mon[32756]: pgmap v20296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36663.002793 secs 2024-04-27T04:41:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37360.038377 secs 2024-04-27T04:41:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:05 smithi156 ceph-mon[32679]: pgmap v20296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36663.002793 secs 2024-04-27T04:41:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:07 smithi189 ceph-mon[32756]: pgmap v20297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:07 smithi156 ceph-mon[32679]: pgmap v20297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:07.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:07 smithi092 ceph-mon[29156]: pgmap v20297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:09 smithi189 ceph-mon[32756]: pgmap v20298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:09 smithi156 ceph-mon[32679]: pgmap v20298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:09 smithi092 ceph-mon[29156]: pgmap v20298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37365.038505 secs 2024-04-27T04:41:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36668.002864 secs 2024-04-27T04:41:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37365.038505 secs 2024-04-27T04:41:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36668.002864 secs 2024-04-27T04:41:10.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37365.038505 secs 2024-04-27T04:41:10.719 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36668.002864 secs 2024-04-27T04:41:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:11 smithi189 ceph-mon[32756]: pgmap v20299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:11 smithi156 ceph-mon[32679]: pgmap v20299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:11.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:11 smithi092 ceph-mon[29156]: pgmap v20299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:13.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:13 smithi189 ceph-mon[32756]: pgmap v20300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:13.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:13 smithi156 ceph-mon[32679]: pgmap v20300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:13.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:13 smithi092 ceph-mon[29156]: pgmap v20300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:41:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37370.038641 secs 2024-04-27T04:41:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:15 smithi189 ceph-mon[32756]: pgmap v20301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36673.003005 secs 2024-04-27T04:41:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37370.038641 secs 2024-04-27T04:41:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:15 smithi156 ceph-mon[32679]: pgmap v20301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36673.003005 secs 2024-04-27T04:41:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37370.038641 secs 2024-04-27T04:41:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:15 smithi092 ceph-mon[29156]: pgmap v20301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:41:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36673.003005 secs 2024-04-27T04:41:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:17 smithi189 ceph-mon[32756]: pgmap v20302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:17.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:17 smithi156 ceph-mon[32679]: pgmap v20302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:17.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:17 smithi092 ceph-mon[29156]: pgmap v20302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:19 smithi189 ceph-mon[32756]: pgmap v20303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:19 smithi156 ceph-mon[32679]: pgmap v20303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:19 smithi092 ceph-mon[29156]: pgmap v20303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:20.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37375.038796 secs 2024-04-27T04:41:20.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36678.003146 secs 2024-04-27T04:41:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37375.038796 secs 2024-04-27T04:41:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36678.003146 secs 2024-04-27T04:41:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37375.038796 secs 2024-04-27T04:41:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36678.003146 secs 2024-04-27T04:41:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:21 smithi189 ceph-mon[32756]: pgmap v20304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:21 smithi156 ceph-mon[32679]: pgmap v20304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:21 smithi092 ceph-mon[29156]: pgmap v20304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:23.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:23 smithi189 ceph-mon[32756]: pgmap v20305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:23 smithi156 ceph-mon[32679]: pgmap v20305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:23 smithi092 ceph-mon[29156]: pgmap v20305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:25.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37380.038926 secs 2024-04-27T04:41:25.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:25 smithi092 ceph-mon[29156]: pgmap v20306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:25.567 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36683.003234 secs 2024-04-27T04:41:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37380.038926 secs 2024-04-27T04:41:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:25 smithi189 ceph-mon[32756]: pgmap v20306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36683.003234 secs 2024-04-27T04:41:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37380.038926 secs 2024-04-27T04:41:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:25 smithi156 ceph-mon[32679]: pgmap v20306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36683.003234 secs 2024-04-27T04:41:27.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:27 smithi189 ceph-mon[32756]: pgmap v20307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:27 smithi156 ceph-mon[32679]: pgmap v20307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:27 smithi092 ceph-mon[29156]: pgmap v20307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:29 smithi189 ceph-mon[32756]: pgmap v20308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:29 smithi156 ceph-mon[32679]: pgmap v20308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:29 smithi092 ceph-mon[29156]: pgmap v20308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37385.038998 secs 2024-04-27T04:41:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36688.003359 secs 2024-04-27T04:41:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37385.038998 secs 2024-04-27T04:41:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36688.003359 secs 2024-04-27T04:41:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37385.038998 secs 2024-04-27T04:41:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36688.003359 secs 2024-04-27T04:41:31.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:31 smithi189 ceph-mon[32756]: pgmap v20309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:31.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:31 smithi156 ceph-mon[32679]: pgmap v20309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:31 smithi092 ceph-mon[29156]: pgmap v20309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:33 smithi189 ceph-mon[32756]: pgmap v20310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:33.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:33 smithi156 ceph-mon[32679]: pgmap v20310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:33 smithi092 ceph-mon[29156]: pgmap v20310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37390.039097 secs 2024-04-27T04:41:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:35 smithi189 ceph-mon[32756]: pgmap v20311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36693.003423 secs 2024-04-27T04:41:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37390.039097 secs 2024-04-27T04:41:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:35 smithi156 ceph-mon[32679]: pgmap v20311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36693.003423 secs 2024-04-27T04:41:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37390.039097 secs 2024-04-27T04:41:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:35 smithi092 ceph-mon[29156]: pgmap v20311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36693.003423 secs 2024-04-27T04:41:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:37 smithi189 ceph-mon[32756]: pgmap v20312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:37 smithi156 ceph-mon[32679]: pgmap v20312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:37 smithi092 ceph-mon[29156]: pgmap v20312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:39 smithi189 ceph-mon[32756]: pgmap v20313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:39 smithi156 ceph-mon[32679]: pgmap v20313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:39 smithi092 ceph-mon[29156]: pgmap v20313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37395.039249 secs 2024-04-27T04:41:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36698.003545 secs 2024-04-27T04:41:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:41:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37395.039249 secs 2024-04-27T04:41:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36698.003545 secs 2024-04-27T04:41:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:41:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37395.039249 secs 2024-04-27T04:41:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36698.003545 secs 2024-04-27T04:41:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:41:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:41 smithi189 ceph-mon[32756]: pgmap v20314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:41:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:41:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:41:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:41 smithi156 ceph-mon[32679]: pgmap v20314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:41:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:41:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:41:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:41 smithi092 ceph-mon[29156]: pgmap v20314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:41:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:41:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:41:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:42 smithi189 ceph-mon[32756]: pgmap v20315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:41:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:42 smithi189 ceph-mon[32756]: pgmap v20316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:42 smithi156 ceph-mon[32679]: pgmap v20315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:41:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:42 smithi156 ceph-mon[32679]: pgmap v20316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:42 smithi092 ceph-mon[29156]: pgmap v20315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:41:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:42 smithi092 ceph-mon[29156]: pgmap v20316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:44 smithi189 ceph-mon[32756]: pgmap v20317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:41:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:44 smithi156 ceph-mon[32679]: pgmap v20317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:41:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:44 smithi092 ceph-mon[29156]: pgmap v20317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:41:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:45 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 37400.039369 secs 2024-04-27T04:41:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:45 smithi189 ceph-mon[32756]: slow request 363.185852 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:41:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36703.003614 secs 2024-04-27T04:41:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:45 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 37400.039369 secs 2024-04-27T04:41:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:45 smithi156 ceph-mon[32679]: slow request 363.185852 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:41:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36703.003614 secs 2024-04-27T04:41:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:45 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 37400.039369 secs 2024-04-27T04:41:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:45 smithi092 ceph-mon[29156]: slow request 363.185852 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:41:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36703.003614 secs 2024-04-27T04:41:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:46 smithi189 ceph-mon[32756]: pgmap v20318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:46 smithi156 ceph-mon[32679]: pgmap v20318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:46 smithi092 ceph-mon[29156]: pgmap v20318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:48 smithi189 ceph-mon[32756]: pgmap v20319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:48 smithi156 ceph-mon[32679]: pgmap v20319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:48 smithi092 ceph-mon[29156]: pgmap v20319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:50 smithi189 ceph-mon[32756]: pgmap v20320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37405.039488 secs 2024-04-27T04:41:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36708.003680 secs 2024-04-27T04:41:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:50 smithi156 ceph-mon[32679]: pgmap v20320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37405.039488 secs 2024-04-27T04:41:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36708.003680 secs 2024-04-27T04:41:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:50 smithi092 ceph-mon[29156]: pgmap v20320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:41:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37405.039488 secs 2024-04-27T04:41:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36708.003680 secs 2024-04-27T04:41:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:52 smithi189 ceph-mon[32756]: pgmap v20321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:41:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:52 smithi156 ceph-mon[32679]: pgmap v20321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:41:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:52 smithi092 ceph-mon[29156]: pgmap v20321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:41:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:54 smithi189 ceph-mon[32756]: pgmap v20322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:54 smithi156 ceph-mon[32679]: pgmap v20322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:54 smithi092 ceph-mon[29156]: pgmap v20322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37410.039609 secs 2024-04-27T04:41:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36713.003823 secs 2024-04-27T04:41:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37410.039609 secs 2024-04-27T04:41:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36713.003823 secs 2024-04-27T04:41:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37410.039609 secs 2024-04-27T04:41:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36713.003823 secs 2024-04-27T04:41:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:56 smithi189 ceph-mon[32756]: pgmap v20323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:56 smithi156 ceph-mon[32679]: pgmap v20323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:56 smithi092 ceph-mon[29156]: pgmap v20323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:41:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:41:58 smithi189 ceph-mon[32756]: pgmap v20324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:41:58 smithi156 ceph-mon[32679]: pgmap v20324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:41:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:41:58 smithi092 ceph-mon[29156]: pgmap v20324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:00 smithi189 ceph-mon[32756]: pgmap v20325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37415.039760 secs 2024-04-27T04:42:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36718.003925 secs 2024-04-27T04:42:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:00 smithi156 ceph-mon[32679]: pgmap v20325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37415.039760 secs 2024-04-27T04:42:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36718.003925 secs 2024-04-27T04:42:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:00 smithi092 ceph-mon[29156]: pgmap v20325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37415.039760 secs 2024-04-27T04:42:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36718.003925 secs 2024-04-27T04:42:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:02 smithi189 ceph-mon[32756]: pgmap v20326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:02 smithi156 ceph-mon[32679]: pgmap v20326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:02 smithi092 ceph-mon[29156]: pgmap v20326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:04 smithi189 ceph-mon[32756]: pgmap v20327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:04 smithi156 ceph-mon[32679]: pgmap v20327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:04 smithi092 ceph-mon[29156]: pgmap v20327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37420.039873 secs 2024-04-27T04:42:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36723.004048 secs 2024-04-27T04:42:05.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37420.039873 secs 2024-04-27T04:42:05.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36723.004048 secs 2024-04-27T04:42:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37420.039873 secs 2024-04-27T04:42:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36723.004048 secs 2024-04-27T04:42:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:06 smithi156 ceph-mon[32679]: pgmap v20328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:06 smithi092 ceph-mon[29156]: pgmap v20328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:06 smithi189 ceph-mon[32756]: pgmap v20328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:08 smithi156 ceph-mon[32679]: pgmap v20329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:08 smithi092 ceph-mon[29156]: pgmap v20329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:08 smithi189 ceph-mon[32756]: pgmap v20329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:10 smithi156 ceph-mon[32679]: pgmap v20330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37425.039978 secs 2024-04-27T04:42:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36728.004180 secs 2024-04-27T04:42:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:10 smithi092 ceph-mon[29156]: pgmap v20330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37425.039978 secs 2024-04-27T04:42:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36728.004180 secs 2024-04-27T04:42:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:10 smithi189 ceph-mon[32756]: pgmap v20330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37425.039978 secs 2024-04-27T04:42:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36728.004180 secs 2024-04-27T04:42:12.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:12 smithi092 ceph-mon[29156]: pgmap v20331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:12 smithi156 ceph-mon[32679]: pgmap v20331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:12 smithi189 ceph-mon[32756]: pgmap v20331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:14 smithi156 ceph-mon[32679]: pgmap v20332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:14 smithi092 ceph-mon[29156]: pgmap v20332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:14 smithi189 ceph-mon[32756]: pgmap v20332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:15 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 37430.040135 secs 2024-04-27T04:42:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:15 smithi156 ceph-mon[32679]: slow request 5764.662820 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36733.004315 secs 2024-04-27T04:42:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:15 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 37430.040135 secs 2024-04-27T04:42:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:15 smithi092 ceph-mon[29156]: slow request 5764.662820 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36733.004315 secs 2024-04-27T04:42:15.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:15 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 37430.040135 secs 2024-04-27T04:42:15.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:15 smithi189 ceph-mon[32756]: slow request 5764.662820 seconds old, received at 2024-04-27T03:06:09.293057+0000: client_request(client.17439:1 getattr pAsLsXsFs #0x1 2024-04-27T03:06:09.289368+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:15.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36733.004315 secs 2024-04-27T04:42:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:16 smithi156 ceph-mon[32679]: pgmap v20333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:16 smithi092 ceph-mon[29156]: pgmap v20333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:16 smithi189 ceph-mon[32756]: pgmap v20333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:18 smithi156 ceph-mon[32679]: pgmap v20334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:18 smithi092 ceph-mon[29156]: pgmap v20334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:18 smithi189 ceph-mon[32756]: pgmap v20334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:20 smithi156 ceph-mon[32679]: pgmap v20335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37435.040250 secs 2024-04-27T04:42:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36738.004377 secs 2024-04-27T04:42:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:20 smithi092 ceph-mon[29156]: pgmap v20335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37435.040250 secs 2024-04-27T04:42:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36738.004377 secs 2024-04-27T04:42:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:20 smithi189 ceph-mon[32756]: pgmap v20335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37435.040250 secs 2024-04-27T04:42:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36738.004377 secs 2024-04-27T04:42:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:22 smithi156 ceph-mon[32679]: pgmap v20336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:22 smithi092 ceph-mon[29156]: pgmap v20336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:22 smithi189 ceph-mon[32756]: pgmap v20336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:24 smithi156 ceph-mon[32679]: pgmap v20337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:24 smithi092 ceph-mon[29156]: pgmap v20337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:24 smithi189 ceph-mon[32756]: pgmap v20337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37440.040373 secs 2024-04-27T04:42:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36743.004500 secs 2024-04-27T04:42:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37440.040373 secs 2024-04-27T04:42:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36743.004500 secs 2024-04-27T04:42:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37440.040373 secs 2024-04-27T04:42:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36743.004500 secs 2024-04-27T04:42:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:26 smithi156 ceph-mon[32679]: pgmap v20338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:26 smithi092 ceph-mon[29156]: pgmap v20338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:26 smithi189 ceph-mon[32756]: pgmap v20338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:28 smithi156 ceph-mon[32679]: pgmap v20339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:28 smithi092 ceph-mon[29156]: pgmap v20339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:28 smithi189 ceph-mon[32756]: pgmap v20339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:30 smithi156 ceph-mon[32679]: pgmap v20340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37445.040522 secs 2024-04-27T04:42:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36748.004613 secs 2024-04-27T04:42:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:30 smithi092 ceph-mon[29156]: pgmap v20340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37445.040522 secs 2024-04-27T04:42:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36748.004613 secs 2024-04-27T04:42:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:30 smithi189 ceph-mon[32756]: pgmap v20340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37445.040522 secs 2024-04-27T04:42:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36748.004613 secs 2024-04-27T04:42:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:32 smithi092 ceph-mon[29156]: pgmap v20341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:32 smithi189 ceph-mon[32756]: pgmap v20341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:32 smithi156 ceph-mon[32679]: pgmap v20341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:34 smithi092 ceph-mon[29156]: pgmap v20342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:34 smithi189 ceph-mon[32756]: pgmap v20342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:34 smithi156 ceph-mon[32679]: pgmap v20342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37450.040642 secs 2024-04-27T04:42:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36753.004770 secs 2024-04-27T04:42:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37450.040642 secs 2024-04-27T04:42:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36753.004770 secs 2024-04-27T04:42:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37450.040642 secs 2024-04-27T04:42:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36753.004770 secs 2024-04-27T04:42:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:36 smithi092 ceph-mon[29156]: pgmap v20343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:36 smithi189 ceph-mon[32756]: pgmap v20343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:36.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:36 smithi156 ceph-mon[32679]: pgmap v20343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:38 smithi092 ceph-mon[29156]: pgmap v20344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:38 smithi189 ceph-mon[32756]: pgmap v20344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:38.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:38 smithi156 ceph-mon[32679]: pgmap v20344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:40 smithi092 ceph-mon[29156]: pgmap v20345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37455.040777 secs 2024-04-27T04:42:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36758.004848 secs 2024-04-27T04:42:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:40 smithi189 ceph-mon[32756]: pgmap v20345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37455.040777 secs 2024-04-27T04:42:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36758.004848 secs 2024-04-27T04:42:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:40 smithi156 ceph-mon[32679]: pgmap v20345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37455.040777 secs 2024-04-27T04:42:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36758.004848 secs 2024-04-27T04:42:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:42:41.124+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:42:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:42:41.124+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:42:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:42:41.125+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:42:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:42:41.125+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 288 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:42:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:42:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:42:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:42:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:42 smithi092 ceph-mon[29156]: pgmap v20346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:42:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:42:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:42:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:42 smithi189 ceph-mon[32756]: pgmap v20346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:42:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:42:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:42:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:42 smithi156 ceph-mon[32679]: pgmap v20346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:42:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:42:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:42:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:43 smithi092 ceph-mon[29156]: pgmap v20347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:42:43.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:43 smithi092 ceph-mon[29156]: pgmap v20348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:43 smithi189 ceph-mon[32756]: pgmap v20347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:42:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:43 smithi189 ceph-mon[32756]: pgmap v20348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:43 smithi156 ceph-mon[32679]: pgmap v20347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:42:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:43 smithi156 ceph-mon[32679]: pgmap v20348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:45 smithi092 ceph-mon[29156]: pgmap v20349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:42:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37460.040864 secs 2024-04-27T04:42:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 36763.004965 secs 2024-04-27T04:42:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:45 smithi092 ceph-mon[29156]: slow request 723.447476 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:45 smithi189 ceph-mon[32756]: pgmap v20349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:42:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37460.040864 secs 2024-04-27T04:42:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 36763.004965 secs 2024-04-27T04:42:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:45 smithi189 ceph-mon[32756]: slow request 723.447476 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:45 smithi156 ceph-mon[32679]: pgmap v20349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:42:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37460.040864 secs 2024-04-27T04:42:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 36763.004965 secs 2024-04-27T04:42:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:45 smithi156 ceph-mon[32679]: slow request 723.447476 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:42:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:47 smithi092 ceph-mon[29156]: pgmap v20350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:47 smithi189 ceph-mon[32756]: pgmap v20350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:47 smithi156 ceph-mon[32679]: pgmap v20350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:49 smithi092 ceph-mon[29156]: pgmap v20351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:42:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:49 smithi189 ceph-mon[32756]: pgmap v20351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:42:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:49 smithi156 ceph-mon[32679]: pgmap v20351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:42:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37465.040991 secs 2024-04-27T04:42:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36768.005084 secs 2024-04-27T04:42:50.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37465.040991 secs 2024-04-27T04:42:50.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36768.005084 secs 2024-04-27T04:42:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37465.040991 secs 2024-04-27T04:42:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36768.005084 secs 2024-04-27T04:42:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:51 smithi092 ceph-mon[29156]: pgmap v20352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:51 smithi189 ceph-mon[32756]: pgmap v20352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:51 smithi156 ceph-mon[32679]: pgmap v20352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:42:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:53 smithi092 ceph-mon[29156]: pgmap v20353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:42:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:53 smithi189 ceph-mon[32756]: pgmap v20353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:42:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:53 smithi156 ceph-mon[32679]: pgmap v20353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:42:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:55 smithi092 ceph-mon[29156]: pgmap v20354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37470.041055 secs 2024-04-27T04:42:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36773.005206 secs 2024-04-27T04:42:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:55 smithi189 ceph-mon[32756]: pgmap v20354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37470.041055 secs 2024-04-27T04:42:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36773.005206 secs 2024-04-27T04:42:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:55 smithi156 ceph-mon[32679]: pgmap v20354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:42:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37470.041055 secs 2024-04-27T04:42:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36773.005206 secs 2024-04-27T04:42:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:57 smithi092 ceph-mon[29156]: pgmap v20355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:57 smithi189 ceph-mon[32756]: pgmap v20355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:57 smithi156 ceph-mon[32679]: pgmap v20355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:42:58 smithi189 ceph-mon[32756]: pgmap v20356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:42:58 smithi156 ceph-mon[32679]: pgmap v20356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:42:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:42:58 smithi092 ceph-mon[29156]: pgmap v20356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37475.041130 secs 2024-04-27T04:43:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36778.005341 secs 2024-04-27T04:43:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:00 smithi189 ceph-mon[32756]: pgmap v20357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37475.041130 secs 2024-04-27T04:43:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36778.005341 secs 2024-04-27T04:43:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:00 smithi156 ceph-mon[32679]: pgmap v20357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37475.041130 secs 2024-04-27T04:43:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36778.005341 secs 2024-04-27T04:43:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:00 smithi092 ceph-mon[29156]: pgmap v20357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:02 smithi189 ceph-mon[32756]: pgmap v20358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:02 smithi156 ceph-mon[32679]: pgmap v20358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:02 smithi092 ceph-mon[29156]: pgmap v20358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:04 smithi189 ceph-mon[32756]: pgmap v20359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:04 smithi156 ceph-mon[32679]: pgmap v20359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:04 smithi092 ceph-mon[29156]: pgmap v20359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37480.041209 secs 2024-04-27T04:43:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36783.005459 secs 2024-04-27T04:43:05.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37480.041209 secs 2024-04-27T04:43:05.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36783.005459 secs 2024-04-27T04:43:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37480.041209 secs 2024-04-27T04:43:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36783.005459 secs 2024-04-27T04:43:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:06 smithi189 ceph-mon[32756]: pgmap v20360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:06 smithi156 ceph-mon[32679]: pgmap v20360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:06 smithi092 ceph-mon[29156]: pgmap v20360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:08 smithi189 ceph-mon[32756]: pgmap v20361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:08 smithi156 ceph-mon[32679]: pgmap v20361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:08 smithi092 ceph-mon[29156]: pgmap v20361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37485.041283 secs 2024-04-27T04:43:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36788.005567 secs 2024-04-27T04:43:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:10 smithi189 ceph-mon[32756]: pgmap v20362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37485.041283 secs 2024-04-27T04:43:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36788.005567 secs 2024-04-27T04:43:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:10 smithi156 ceph-mon[32679]: pgmap v20362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37485.041283 secs 2024-04-27T04:43:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36788.005567 secs 2024-04-27T04:43:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:10 smithi092 ceph-mon[29156]: pgmap v20362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:12 smithi189 ceph-mon[32756]: pgmap v20363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:12 smithi156 ceph-mon[32679]: pgmap v20363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:12 smithi092 ceph-mon[29156]: pgmap v20363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:14 smithi189 ceph-mon[32756]: pgmap v20364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:14 smithi156 ceph-mon[32679]: pgmap v20364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:14 smithi092 ceph-mon[29156]: pgmap v20364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37490.041396 secs 2024-04-27T04:43:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36793.005662 secs 2024-04-27T04:43:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37490.041396 secs 2024-04-27T04:43:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36793.005662 secs 2024-04-27T04:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37490.041396 secs 2024-04-27T04:43:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36793.005662 secs 2024-04-27T04:43:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:16 smithi156 ceph-mon[32679]: pgmap v20365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:16 smithi092 ceph-mon[29156]: pgmap v20365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:17.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:16 smithi189 ceph-mon[32756]: pgmap v20365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:18 smithi156 ceph-mon[32679]: pgmap v20366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:18 smithi092 ceph-mon[29156]: pgmap v20366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:19.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:18 smithi189 ceph-mon[32756]: pgmap v20366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37495.041512 secs 2024-04-27T04:43:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36798.005796 secs 2024-04-27T04:43:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:20 smithi156 ceph-mon[32679]: pgmap v20367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37495.041512 secs 2024-04-27T04:43:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36798.005796 secs 2024-04-27T04:43:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:20 smithi092 ceph-mon[29156]: pgmap v20367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37495.041512 secs 2024-04-27T04:43:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36798.005796 secs 2024-04-27T04:43:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:20 smithi189 ceph-mon[32756]: pgmap v20367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:22 smithi156 ceph-mon[32679]: pgmap v20368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:22 smithi092 ceph-mon[29156]: pgmap v20368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:22 smithi189 ceph-mon[32756]: pgmap v20368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:24 smithi156 ceph-mon[32679]: pgmap v20369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:24 smithi092 ceph-mon[29156]: pgmap v20369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:24 smithi189 ceph-mon[32756]: pgmap v20369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37500.041630 secs 2024-04-27T04:43:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36803.005941 secs 2024-04-27T04:43:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37500.041630 secs 2024-04-27T04:43:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36803.005941 secs 2024-04-27T04:43:26.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37500.041630 secs 2024-04-27T04:43:26.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36803.005941 secs 2024-04-27T04:43:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:26 smithi156 ceph-mon[32679]: pgmap v20370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:26 smithi092 ceph-mon[29156]: pgmap v20370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:26 smithi189 ceph-mon[32756]: pgmap v20370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:28 smithi156 ceph-mon[32679]: pgmap v20371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:28.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:28 smithi092 ceph-mon[29156]: pgmap v20371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:28 smithi189 ceph-mon[32756]: pgmap v20371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37505.041742 secs 2024-04-27T04:43:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36808.006054 secs 2024-04-27T04:43:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:30 smithi156 ceph-mon[32679]: pgmap v20372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37505.041742 secs 2024-04-27T04:43:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36808.006054 secs 2024-04-27T04:43:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:30 smithi092 ceph-mon[29156]: pgmap v20372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37505.041742 secs 2024-04-27T04:43:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36808.006054 secs 2024-04-27T04:43:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:30 smithi189 ceph-mon[32756]: pgmap v20372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:32.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:32 smithi156 ceph-mon[32679]: pgmap v20373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:32 smithi092 ceph-mon[29156]: pgmap v20373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:33.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:32 smithi189 ceph-mon[32756]: pgmap v20373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:34 smithi156 ceph-mon[32679]: pgmap v20374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:34 smithi092 ceph-mon[29156]: pgmap v20374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:34 smithi189 ceph-mon[32756]: pgmap v20374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37510.041859 secs 2024-04-27T04:43:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36813.006170 secs 2024-04-27T04:43:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37510.041859 secs 2024-04-27T04:43:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36813.006170 secs 2024-04-27T04:43:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37510.041859 secs 2024-04-27T04:43:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36813.006170 secs 2024-04-27T04:43:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:36 smithi156 ceph-mon[32679]: pgmap v20375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:36 smithi092 ceph-mon[29156]: pgmap v20375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:36 smithi189 ceph-mon[32756]: pgmap v20375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:38 smithi092 ceph-mon[29156]: pgmap v20376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:38 smithi189 ceph-mon[32756]: pgmap v20376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:39.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:38 smithi156 ceph-mon[32679]: pgmap v20376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37515.041994 secs 2024-04-27T04:43:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36818.006319 secs 2024-04-27T04:43:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:40 smithi092 ceph-mon[29156]: pgmap v20377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37515.041994 secs 2024-04-27T04:43:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36818.006319 secs 2024-04-27T04:43:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:40 smithi189 ceph-mon[32756]: pgmap v20377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37515.041994 secs 2024-04-27T04:43:41.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36818.006319 secs 2024-04-27T04:43:41.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:40 smithi156 ceph-mon[32679]: pgmap v20377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:43:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:43:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: pgmap v20378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: pgmap v20378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: pgmap v20378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:43.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: pgmap v20379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37520.042062 secs 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36823.006390 secs 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: pgmap v20379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37520.042062 secs 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36823.006390 secs 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: pgmap v20379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37520.042062 secs 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36823.006390 secs 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:43:46.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:43:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:43:46.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:43:46.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:43:46.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:43:46.748 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:43:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:47 smithi092 ceph-mon[29156]: pgmap v20380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:43:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:47 smithi092 ceph-mon[29156]: pgmap v20381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:47 smithi092 ceph-mon[29156]: pgmap v20382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:47 smithi189 ceph-mon[32756]: pgmap v20380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:43:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:47 smithi189 ceph-mon[32756]: pgmap v20381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:47 smithi189 ceph-mon[32756]: pgmap v20382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:47 smithi156 ceph-mon[32679]: pgmap v20380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:43:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:43:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:47 smithi156 ceph-mon[32679]: pgmap v20381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:47 smithi156 ceph-mon[32679]: pgmap v20382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:49 smithi092 ceph-mon[29156]: pgmap v20383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:43:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:49 smithi189 ceph-mon[32756]: pgmap v20383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:43:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:49 smithi156 ceph-mon[32679]: pgmap v20383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T04:43:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37525.042154 secs 2024-04-27T04:43:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36828.006503 secs 2024-04-27T04:43:50.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37525.042154 secs 2024-04-27T04:43:50.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36828.006503 secs 2024-04-27T04:43:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37525.042154 secs 2024-04-27T04:43:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36828.006503 secs 2024-04-27T04:43:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:51 smithi092 ceph-mon[29156]: pgmap v20384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:51 smithi189 ceph-mon[32756]: pgmap v20384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:51 smithi156 ceph-mon[32679]: pgmap v20384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:53 smithi092 ceph-mon[29156]: pgmap v20385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:43:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:53 smithi189 ceph-mon[32756]: pgmap v20385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:43:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:53 smithi156 ceph-mon[32679]: pgmap v20385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 3 op/s 2024-04-27T04:43:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:55 smithi092 ceph-mon[29156]: pgmap v20386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37530.042285 secs 2024-04-27T04:43:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36833.006617 secs 2024-04-27T04:43:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:55 smithi189 ceph-mon[32756]: pgmap v20386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37530.042285 secs 2024-04-27T04:43:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36833.006617 secs 2024-04-27T04:43:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:55 smithi156 ceph-mon[32679]: pgmap v20386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:43:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37530.042285 secs 2024-04-27T04:43:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36833.006617 secs 2024-04-27T04:43:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:57 smithi092 ceph-mon[29156]: pgmap v20387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:57 smithi189 ceph-mon[32756]: pgmap v20387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:57 smithi156 ceph-mon[32679]: pgmap v20387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:43:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:43:59 smithi092 ceph-mon[29156]: pgmap v20388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:43:59 smithi189 ceph-mon[32756]: pgmap v20388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:43:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:43:59 smithi156 ceph-mon[32679]: pgmap v20388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37535.042419 secs 2024-04-27T04:44:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36838.006756 secs 2024-04-27T04:44:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37535.042419 secs 2024-04-27T04:44:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36838.006756 secs 2024-04-27T04:44:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37535.042419 secs 2024-04-27T04:44:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36838.006756 secs 2024-04-27T04:44:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:01 smithi189 ceph-mon[32756]: pgmap v20389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:01 smithi156 ceph-mon[32679]: pgmap v20389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:01 smithi092 ceph-mon[29156]: pgmap v20389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:03 smithi189 ceph-mon[32756]: pgmap v20390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:03 smithi156 ceph-mon[32679]: pgmap v20390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:03 smithi092 ceph-mon[29156]: pgmap v20390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:05 smithi092 ceph-mon[29156]: pgmap v20391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37540.042538 secs 2024-04-27T04:44:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36843.006871 secs 2024-04-27T04:44:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:05 smithi189 ceph-mon[32756]: pgmap v20391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37540.042538 secs 2024-04-27T04:44:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36843.006871 secs 2024-04-27T04:44:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:05 smithi156 ceph-mon[32679]: pgmap v20391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37540.042538 secs 2024-04-27T04:44:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36843.006871 secs 2024-04-27T04:44:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:07 smithi189 ceph-mon[32756]: pgmap v20392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:07 smithi156 ceph-mon[32679]: pgmap v20392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:07 smithi092 ceph-mon[29156]: pgmap v20392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:08 smithi189 ceph-mon[32756]: pgmap v20393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:08 smithi156 ceph-mon[32679]: pgmap v20393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:08 smithi092 ceph-mon[29156]: pgmap v20393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:09 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36848.006988 secs 2024-04-27T04:44:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:09 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36848.006988 secs 2024-04-27T04:44:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:09 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36848.006988 secs 2024-04-27T04:44:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37545.042672 secs 2024-04-27T04:44:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:10 smithi189 ceph-mon[32756]: pgmap v20394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37545.042672 secs 2024-04-27T04:44:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:10 smithi156 ceph-mon[32679]: pgmap v20394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37545.042672 secs 2024-04-27T04:44:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:10 smithi092 ceph-mon[29156]: pgmap v20394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:12 smithi092 ceph-mon[29156]: pgmap v20395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:13.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:12 smithi189 ceph-mon[32756]: pgmap v20395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:12 smithi156 ceph-mon[32679]: pgmap v20395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:14 smithi189 ceph-mon[32756]: pgmap v20396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:14 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36853.007110 secs 2024-04-27T04:44:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:14 smithi156 ceph-mon[32679]: pgmap v20396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:14 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36853.007110 secs 2024-04-27T04:44:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:14 smithi092 ceph-mon[29156]: pgmap v20396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:14 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36853.007110 secs 2024-04-27T04:44:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37550.042796 secs 2024-04-27T04:44:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37550.042796 secs 2024-04-27T04:44:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37550.042796 secs 2024-04-27T04:44:17.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:16 smithi189 ceph-mon[32756]: pgmap v20397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:16 smithi156 ceph-mon[32679]: pgmap v20397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:16 smithi092 ceph-mon[29156]: pgmap v20397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:19.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:18 smithi156 ceph-mon[32679]: pgmap v20398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:18 smithi092 ceph-mon[29156]: pgmap v20398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:18 smithi189 ceph-mon[32756]: pgmap v20398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37555.042914 secs 2024-04-27T04:44:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:19 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36858.007226 secs 2024-04-27T04:44:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37555.042914 secs 2024-04-27T04:44:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:19 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36858.007226 secs 2024-04-27T04:44:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37555.042914 secs 2024-04-27T04:44:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:19 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36858.007226 secs 2024-04-27T04:44:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:20 smithi156 ceph-mon[32679]: pgmap v20399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:21.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:20 smithi092 ceph-mon[29156]: pgmap v20399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:21.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:20 smithi189 ceph-mon[32756]: pgmap v20399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:22 smithi156 ceph-mon[32679]: pgmap v20400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:22 smithi092 ceph-mon[29156]: pgmap v20400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:23.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:22 smithi189 ceph-mon[32756]: pgmap v20400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:24 smithi156 ceph-mon[32679]: pgmap v20401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37560.043030 secs 2024-04-27T04:44:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:24 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36863.007365 secs 2024-04-27T04:44:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:24 smithi092 ceph-mon[29156]: pgmap v20401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37560.043030 secs 2024-04-27T04:44:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:24 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36863.007365 secs 2024-04-27T04:44:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:24 smithi189 ceph-mon[32756]: pgmap v20401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37560.043030 secs 2024-04-27T04:44:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:24 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36863.007365 secs 2024-04-27T04:44:27.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:26 smithi092 ceph-mon[29156]: pgmap v20402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:27.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:26 smithi189 ceph-mon[32756]: pgmap v20402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:26 smithi156 ceph-mon[32679]: pgmap v20402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:29.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:28 smithi092 ceph-mon[29156]: pgmap v20403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:29.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:28 smithi189 ceph-mon[32756]: pgmap v20403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:28 smithi156 ceph-mon[32679]: pgmap v20403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37565.043130 secs 2024-04-27T04:44:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:29 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36868.007491 secs 2024-04-27T04:44:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37565.043130 secs 2024-04-27T04:44:30.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:29 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36868.007491 secs 2024-04-27T04:44:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37565.043130 secs 2024-04-27T04:44:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:29 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36868.007491 secs 2024-04-27T04:44:31.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:30 smithi156 ceph-mon[32679]: pgmap v20404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:30 smithi092 ceph-mon[29156]: pgmap v20404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:30 smithi189 ceph-mon[32756]: pgmap v20404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:32 smithi092 ceph-mon[29156]: pgmap v20405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:33.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:32 smithi189 ceph-mon[32756]: pgmap v20405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:33.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:32 smithi156 ceph-mon[32679]: pgmap v20405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:34 smithi092 ceph-mon[29156]: pgmap v20406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37570.043222 secs 2024-04-27T04:44:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:34 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36873.007572 secs 2024-04-27T04:44:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:34 smithi189 ceph-mon[32756]: pgmap v20406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37570.043222 secs 2024-04-27T04:44:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:34 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36873.007572 secs 2024-04-27T04:44:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:34 smithi156 ceph-mon[32679]: pgmap v20406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37570.043222 secs 2024-04-27T04:44:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:34 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36873.007572 secs 2024-04-27T04:44:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:36 smithi092 ceph-mon[29156]: pgmap v20407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:37.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:36 smithi189 ceph-mon[32756]: pgmap v20407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:37.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:36 smithi156 ceph-mon[32679]: pgmap v20407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:39.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:38 smithi092 ceph-mon[29156]: pgmap v20408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:39.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:38 smithi189 ceph-mon[32756]: pgmap v20408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:38 smithi156 ceph-mon[32679]: pgmap v20408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37575.043347 secs 2024-04-27T04:44:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:39 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36878.007696 secs 2024-04-27T04:44:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37575.043347 secs 2024-04-27T04:44:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:39 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36878.007696 secs 2024-04-27T04:44:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37575.043347 secs 2024-04-27T04:44:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:39 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36878.007696 secs 2024-04-27T04:44:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:40 smithi092 ceph-mon[29156]: pgmap v20409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:41.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:40 smithi189 ceph-mon[32756]: pgmap v20409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:40 smithi156 ceph-mon[32679]: pgmap v20409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:43.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:42 smithi092 ceph-mon[29156]: pgmap v20410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:43.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:42 smithi189 ceph-mon[32756]: pgmap v20410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:43.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:42 smithi156 ceph-mon[32679]: pgmap v20410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:44 smithi092 ceph-mon[29156]: pgmap v20411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37580.043409 secs 2024-04-27T04:44:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:44 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36883.007816 secs 2024-04-27T04:44:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:44 smithi189 ceph-mon[32756]: pgmap v20411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37580.043409 secs 2024-04-27T04:44:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:44 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36883.007816 secs 2024-04-27T04:44:45.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:44 smithi156 ceph-mon[32679]: pgmap v20411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:44:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37580.043409 secs 2024-04-27T04:44:45.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:44 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36883.007816 secs 2024-04-27T04:44:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:45 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:44:46.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:45 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:44:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:45 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:44:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: pgmap v20412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:44:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:44:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: pgmap v20413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:44:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: pgmap v20414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: pgmap v20412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: pgmap v20413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: pgmap v20414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:44:47.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: pgmap v20412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:44:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:44:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: pgmap v20413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:44:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: pgmap v20414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:47.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:44:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:48 smithi189 ceph-mon[32756]: pgmap v20415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:48 smithi156 ceph-mon[32679]: pgmap v20415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:48 smithi092 ceph-mon[29156]: pgmap v20415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:49 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36888.007949 secs 2024-04-27T04:44:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:49 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36888.007949 secs 2024-04-27T04:44:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:49 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36888.007949 secs 2024-04-27T04:44:51.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37585.043519 secs 2024-04-27T04:44:51.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:50 smithi156 ceph-mon[32679]: pgmap v20416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37585.043519 secs 2024-04-27T04:44:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:50 smithi189 ceph-mon[32756]: pgmap v20416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:51.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37585.043519 secs 2024-04-27T04:44:51.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:50 smithi092 ceph-mon[29156]: pgmap v20416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:52 smithi189 ceph-mon[32756]: pgmap v20417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:52 smithi156 ceph-mon[32679]: pgmap v20417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:52 smithi092 ceph-mon[29156]: pgmap v20417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:44:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:54 smithi189 ceph-mon[32756]: pgmap v20418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:54 smithi156 ceph-mon[32679]: pgmap v20418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:54 smithi092 ceph-mon[29156]: pgmap v20418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:44:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37590.043657 secs 2024-04-27T04:44:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36893.008035 secs 2024-04-27T04:44:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37590.043657 secs 2024-04-27T04:44:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36893.008035 secs 2024-04-27T04:44:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37590.043657 secs 2024-04-27T04:44:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36893.008035 secs 2024-04-27T04:44:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:57 smithi189 ceph-mon[32756]: pgmap v20419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:44:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:57 smithi156 ceph-mon[32679]: pgmap v20419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:44:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:57 smithi092 ceph-mon[29156]: pgmap v20419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:44:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:44:59 smithi189 ceph-mon[32756]: pgmap v20420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:44:59 smithi156 ceph-mon[32679]: pgmap v20420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:44:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:44:59 smithi092 ceph-mon[29156]: pgmap v20420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37595.043770 secs 2024-04-27T04:45:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36898.008187 secs 2024-04-27T04:45:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37595.043770 secs 2024-04-27T04:45:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36898.008187 secs 2024-04-27T04:45:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37595.043770 secs 2024-04-27T04:45:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36898.008187 secs 2024-04-27T04:45:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:01 smithi189 ceph-mon[32756]: pgmap v20421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:01 smithi156 ceph-mon[32679]: pgmap v20421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:01 smithi092 ceph-mon[29156]: pgmap v20421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:03 smithi189 ceph-mon[32756]: pgmap v20422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:03 smithi156 ceph-mon[32679]: pgmap v20422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:03 smithi092 ceph-mon[29156]: pgmap v20422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37600.043929 secs 2024-04-27T04:45:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36903.008335 secs 2024-04-27T04:45:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:05 smithi189 ceph-mon[32756]: pgmap v20423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37600.043929 secs 2024-04-27T04:45:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36903.008335 secs 2024-04-27T04:45:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:05 smithi156 ceph-mon[32679]: pgmap v20423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37600.043929 secs 2024-04-27T04:45:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36903.008335 secs 2024-04-27T04:45:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:05 smithi092 ceph-mon[29156]: pgmap v20423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:07 smithi189 ceph-mon[32756]: pgmap v20424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:07 smithi156 ceph-mon[32679]: pgmap v20424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:07 smithi092 ceph-mon[29156]: pgmap v20424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:09 smithi189 ceph-mon[32756]: pgmap v20425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:09 smithi156 ceph-mon[32679]: pgmap v20425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:09 smithi092 ceph-mon[29156]: pgmap v20425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37605.044051 secs 2024-04-27T04:45:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36908.008451 secs 2024-04-27T04:45:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37605.044051 secs 2024-04-27T04:45:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36908.008451 secs 2024-04-27T04:45:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37605.044051 secs 2024-04-27T04:45:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36908.008451 secs 2024-04-27T04:45:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:11 smithi189 ceph-mon[32756]: pgmap v20426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:11 smithi156 ceph-mon[32679]: pgmap v20426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:11 smithi092 ceph-mon[29156]: pgmap v20426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:13 smithi189 ceph-mon[32756]: pgmap v20427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:13 smithi156 ceph-mon[32679]: pgmap v20427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:13 smithi092 ceph-mon[29156]: pgmap v20427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37610.044169 secs 2024-04-27T04:45:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36913.008569 secs 2024-04-27T04:45:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:15 smithi189 ceph-mon[32756]: pgmap v20428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37610.044169 secs 2024-04-27T04:45:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36913.008569 secs 2024-04-27T04:45:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:15 smithi156 ceph-mon[32679]: pgmap v20428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37610.044169 secs 2024-04-27T04:45:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36913.008569 secs 2024-04-27T04:45:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:15 smithi092 ceph-mon[29156]: pgmap v20428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:17 smithi189 ceph-mon[32756]: pgmap v20429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:17 smithi156 ceph-mon[32679]: pgmap v20429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:17 smithi092 ceph-mon[29156]: pgmap v20429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:19 smithi189 ceph-mon[32756]: pgmap v20430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:19 smithi156 ceph-mon[32679]: pgmap v20430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:19 smithi092 ceph-mon[29156]: pgmap v20430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37615.044296 secs 2024-04-27T04:45:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36918.008677 secs 2024-04-27T04:45:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37615.044296 secs 2024-04-27T04:45:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36918.008677 secs 2024-04-27T04:45:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37615.044296 secs 2024-04-27T04:45:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36918.008677 secs 2024-04-27T04:45:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:21 smithi189 ceph-mon[32756]: pgmap v20431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:21 smithi156 ceph-mon[32679]: pgmap v20431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:21 smithi092 ceph-mon[29156]: pgmap v20431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:23 smithi189 ceph-mon[32756]: pgmap v20432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:23 smithi156 ceph-mon[32679]: pgmap v20432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:23 smithi092 ceph-mon[29156]: pgmap v20432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37620.044438 secs 2024-04-27T04:45:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36923.008794 secs 2024-04-27T04:45:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:25 smithi189 ceph-mon[32756]: pgmap v20433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37620.044438 secs 2024-04-27T04:45:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36923.008794 secs 2024-04-27T04:45:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:25 smithi156 ceph-mon[32679]: pgmap v20433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37620.044438 secs 2024-04-27T04:45:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36923.008794 secs 2024-04-27T04:45:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:25 smithi092 ceph-mon[29156]: pgmap v20433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:27 smithi189 ceph-mon[32756]: pgmap v20434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:27.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:27 smithi156 ceph-mon[32679]: pgmap v20434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:27 smithi092 ceph-mon[29156]: pgmap v20434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:29 smithi156 ceph-mon[32679]: pgmap v20435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:29 smithi092 ceph-mon[29156]: pgmap v20435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:29 smithi189 ceph-mon[32756]: pgmap v20435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37625.044558 secs 2024-04-27T04:45:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36928.008900 secs 2024-04-27T04:45:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37625.044558 secs 2024-04-27T04:45:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36928.008900 secs 2024-04-27T04:45:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37625.044558 secs 2024-04-27T04:45:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36928.008900 secs 2024-04-27T04:45:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:31 smithi156 ceph-mon[32679]: pgmap v20436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:31 smithi092 ceph-mon[29156]: pgmap v20436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:32.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:31 smithi189 ceph-mon[32756]: pgmap v20436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:45:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:33 smithi156 ceph-mon[32679]: pgmap v20437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:33 smithi092 ceph-mon[29156]: pgmap v20437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:34.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:33 smithi189 ceph-mon[32756]: pgmap v20437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37630.044662 secs 2024-04-27T04:45:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36933.009027 secs 2024-04-27T04:45:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:35 smithi156 ceph-mon[32679]: pgmap v20438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37630.044662 secs 2024-04-27T04:45:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36933.009027 secs 2024-04-27T04:45:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:35 smithi092 ceph-mon[29156]: pgmap v20438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37630.044662 secs 2024-04-27T04:45:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36933.009027 secs 2024-04-27T04:45:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:35 smithi189 ceph-mon[32756]: pgmap v20438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:37 smithi156 ceph-mon[32679]: pgmap v20439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:37.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:37 smithi092 ceph-mon[29156]: pgmap v20439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:37 smithi189 ceph-mon[32756]: pgmap v20439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:39 smithi156 ceph-mon[32679]: pgmap v20440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:39 smithi092 ceph-mon[29156]: pgmap v20440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:39 smithi189 ceph-mon[32756]: pgmap v20440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37635.044786 secs 2024-04-27T04:45:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36938.009145 secs 2024-04-27T04:45:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37635.044786 secs 2024-04-27T04:45:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36938.009145 secs 2024-04-27T04:45:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37635.044786 secs 2024-04-27T04:45:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36938.009145 secs 2024-04-27T04:45:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.149+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:45:41.151 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.149+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 289 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:45:41.152 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:45:41.150+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 290 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1ca80c2070 con 0x5617fb906f00 2024-04-27T04:45:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:41 smithi156 ceph-mon[32679]: pgmap v20441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:41 smithi092 ceph-mon[29156]: pgmap v20441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:41 smithi189 ceph-mon[32756]: pgmap v20441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:43 smithi156 ceph-mon[32679]: pgmap v20442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:43 smithi092 ceph-mon[29156]: pgmap v20442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:43 smithi189 ceph-mon[32756]: pgmap v20442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:45:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37640.044918 secs 2024-04-27T04:45:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36943.009215 secs 2024-04-27T04:45:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:45 smithi156 ceph-mon[32679]: pgmap v20443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37640.044918 secs 2024-04-27T04:45:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36943.009215 secs 2024-04-27T04:45:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:45 smithi092 ceph-mon[29156]: pgmap v20443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37640.044918 secs 2024-04-27T04:45:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36943.009215 secs 2024-04-27T04:45:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:45 smithi189 ceph-mon[32756]: pgmap v20443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:45:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:45:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:45:47.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: pgmap v20444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: pgmap v20445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: pgmap v20446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:45:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: pgmap v20444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: pgmap v20445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: pgmap v20446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:45:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: pgmap v20444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: pgmap v20445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: pgmap v20446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-04-27T04:45:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:45:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37645.045050 secs 2024-04-27T04:45:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36948.009336 secs 2024-04-27T04:45:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:50 smithi189 ceph-mon[32756]: pgmap v20447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37645.045050 secs 2024-04-27T04:45:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36948.009336 secs 2024-04-27T04:45:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:50 smithi156 ceph-mon[32679]: pgmap v20447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37645.045050 secs 2024-04-27T04:45:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36948.009336 secs 2024-04-27T04:45:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:50 smithi092 ceph-mon[29156]: pgmap v20447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:52 smithi189 ceph-mon[32756]: pgmap v20448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:52 smithi156 ceph-mon[32679]: pgmap v20448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:52 smithi092 ceph-mon[29156]: pgmap v20448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:54 smithi189 ceph-mon[32756]: pgmap v20449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:45:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:54 smithi156 ceph-mon[32679]: pgmap v20449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:45:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:54 smithi092 ceph-mon[29156]: pgmap v20449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:45:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37650.045156 secs 2024-04-27T04:45:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36953.009455 secs 2024-04-27T04:45:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37650.045156 secs 2024-04-27T04:45:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36953.009455 secs 2024-04-27T04:45:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37650.045156 secs 2024-04-27T04:45:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36953.009455 secs 2024-04-27T04:45:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:56 smithi189 ceph-mon[32756]: pgmap v20450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:56 smithi156 ceph-mon[32679]: pgmap v20450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:56 smithi092 ceph-mon[29156]: pgmap v20450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:45:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:45:58 smithi189 ceph-mon[32756]: pgmap v20451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:45:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:45:58 smithi156 ceph-mon[32679]: pgmap v20451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:45:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:45:58 smithi092 ceph-mon[29156]: pgmap v20451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:46:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37655.045250 secs 2024-04-27T04:46:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36958.009591 secs 2024-04-27T04:46:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:00 smithi189 ceph-mon[32756]: pgmap v20452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37655.045250 secs 2024-04-27T04:46:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36958.009591 secs 2024-04-27T04:46:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:00 smithi156 ceph-mon[32679]: pgmap v20452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37655.045250 secs 2024-04-27T04:46:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36958.009591 secs 2024-04-27T04:46:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:00 smithi092 ceph-mon[29156]: pgmap v20452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:02 smithi189 ceph-mon[32756]: pgmap v20453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:02 smithi156 ceph-mon[32679]: pgmap v20453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:02 smithi092 ceph-mon[29156]: pgmap v20453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:04 smithi189 ceph-mon[32756]: pgmap v20454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:04 smithi156 ceph-mon[32679]: pgmap v20454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:04 smithi092 ceph-mon[29156]: pgmap v20454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:05.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37660.045348 secs 2024-04-27T04:46:05.631 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36963.009712 secs 2024-04-27T04:46:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37660.045348 secs 2024-04-27T04:46:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36963.009712 secs 2024-04-27T04:46:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37660.045348 secs 2024-04-27T04:46:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36963.009712 secs 2024-04-27T04:46:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:06 smithi189 ceph-mon[32756]: pgmap v20455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:06 smithi156 ceph-mon[32679]: pgmap v20455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:06 smithi092 ceph-mon[29156]: pgmap v20455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:08 smithi189 ceph-mon[32756]: pgmap v20456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:08 smithi156 ceph-mon[32679]: pgmap v20456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:08 smithi092 ceph-mon[29156]: pgmap v20456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37665.045462 secs 2024-04-27T04:46:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36968.009785 secs 2024-04-27T04:46:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:10 smithi189 ceph-mon[32756]: pgmap v20457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37665.045462 secs 2024-04-27T04:46:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36968.009785 secs 2024-04-27T04:46:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:10 smithi156 ceph-mon[32679]: pgmap v20457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37665.045462 secs 2024-04-27T04:46:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36968.009785 secs 2024-04-27T04:46:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-mon[29156]: pgmap v20457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:11.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:46:10.927+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:46:11.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:46:10.927+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:46:11.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:46:10.927+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:46:11.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:46:10.927+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:46:11.246 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:46:10 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:46:10.927+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:46:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:12 smithi189 ceph-mon[32756]: pgmap v20458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:12 smithi156 ceph-mon[32679]: pgmap v20458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:12 smithi092 ceph-mon[29156]: pgmap v20458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:14 smithi189 ceph-mon[32756]: pgmap v20459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:14 smithi156 ceph-mon[32679]: pgmap v20459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:14 smithi092 ceph-mon[29156]: pgmap v20459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37670.045560 secs 2024-04-27T04:46:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36973.009911 secs 2024-04-27T04:46:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37670.045560 secs 2024-04-27T04:46:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36973.009911 secs 2024-04-27T04:46:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37670.045560 secs 2024-04-27T04:46:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36973.009911 secs 2024-04-27T04:46:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:16 smithi156 ceph-mon[32679]: pgmap v20460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:16 smithi092 ceph-mon[29156]: pgmap v20460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:16 smithi189 ceph-mon[32756]: pgmap v20460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:18 smithi156 ceph-mon[32679]: pgmap v20461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:18.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:18 smithi189 ceph-mon[32756]: pgmap v20461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:18 smithi092 ceph-mon[29156]: pgmap v20461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37675.045697 secs 2024-04-27T04:46:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36978.010017 secs 2024-04-27T04:46:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:20 smithi156 ceph-mon[32679]: pgmap v20462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37675.045697 secs 2024-04-27T04:46:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36978.010017 secs 2024-04-27T04:46:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:20 smithi092 ceph-mon[29156]: pgmap v20462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37675.045697 secs 2024-04-27T04:46:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36978.010017 secs 2024-04-27T04:46:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:20 smithi189 ceph-mon[32756]: pgmap v20462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:22 smithi156 ceph-mon[32679]: pgmap v20463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:22 smithi092 ceph-mon[29156]: pgmap v20463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:22 smithi189 ceph-mon[32756]: pgmap v20463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:24 smithi156 ceph-mon[32679]: pgmap v20464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:24 smithi092 ceph-mon[29156]: pgmap v20464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:24 smithi189 ceph-mon[32756]: pgmap v20464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37680.045770 secs 2024-04-27T04:46:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36983.010125 secs 2024-04-27T04:46:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37680.045770 secs 2024-04-27T04:46:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36983.010125 secs 2024-04-27T04:46:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37680.045770 secs 2024-04-27T04:46:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36983.010125 secs 2024-04-27T04:46:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:26 smithi156 ceph-mon[32679]: pgmap v20465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:26 smithi092 ceph-mon[29156]: pgmap v20465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:26 smithi189 ceph-mon[32756]: pgmap v20465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:28 smithi156 ceph-mon[32679]: pgmap v20466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:28 smithi092 ceph-mon[29156]: pgmap v20466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:28 smithi189 ceph-mon[32756]: pgmap v20466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37685.045889 secs 2024-04-27T04:46:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36988.010234 secs 2024-04-27T04:46:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:30 smithi156 ceph-mon[32679]: pgmap v20467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37685.045889 secs 2024-04-27T04:46:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36988.010234 secs 2024-04-27T04:46:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:30 smithi092 ceph-mon[29156]: pgmap v20467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37685.045889 secs 2024-04-27T04:46:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36988.010234 secs 2024-04-27T04:46:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:30 smithi189 ceph-mon[32756]: pgmap v20467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:32 smithi156 ceph-mon[32679]: pgmap v20468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:32 smithi092 ceph-mon[29156]: pgmap v20468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:32 smithi189 ceph-mon[32756]: pgmap v20468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:34 smithi156 ceph-mon[32679]: pgmap v20469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:34 smithi092 ceph-mon[29156]: pgmap v20469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:34 smithi189 ceph-mon[32756]: pgmap v20469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37690.046005 secs 2024-04-27T04:46:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36993.010364 secs 2024-04-27T04:46:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37690.046005 secs 2024-04-27T04:46:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36993.010364 secs 2024-04-27T04:46:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37690.046005 secs 2024-04-27T04:46:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36993.010364 secs 2024-04-27T04:46:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:36 smithi156 ceph-mon[32679]: pgmap v20470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:36 smithi092 ceph-mon[29156]: pgmap v20470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:36 smithi189 ceph-mon[32756]: pgmap v20470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:38 smithi092 ceph-mon[29156]: pgmap v20471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:38 smithi189 ceph-mon[32756]: pgmap v20471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:38.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:38 smithi156 ceph-mon[32679]: pgmap v20471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37695.046123 secs 2024-04-27T04:46:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 36998.010425 secs 2024-04-27T04:46:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:40 smithi092 ceph-mon[29156]: pgmap v20472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37695.046123 secs 2024-04-27T04:46:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 36998.010425 secs 2024-04-27T04:46:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:40 smithi189 ceph-mon[32756]: pgmap v20472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37695.046123 secs 2024-04-27T04:46:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 36998.010425 secs 2024-04-27T04:46:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:40 smithi156 ceph-mon[32679]: pgmap v20472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:42 smithi092 ceph-mon[29156]: pgmap v20473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:42 smithi189 ceph-mon[32756]: pgmap v20473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:42 smithi156 ceph-mon[32679]: pgmap v20473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:44 smithi092 ceph-mon[29156]: pgmap v20474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:44 smithi189 ceph-mon[32756]: pgmap v20474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:44 smithi156 ceph-mon[32679]: pgmap v20474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37700.046239 secs 2024-04-27T04:46:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37003.010498 secs 2024-04-27T04:46:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37700.046239 secs 2024-04-27T04:46:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37003.010498 secs 2024-04-27T04:46:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37700.046239 secs 2024-04-27T04:46:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37003.010498 secs 2024-04-27T04:46:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:46 smithi092 ceph-mon[29156]: pgmap v20475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:46 smithi189 ceph-mon[32756]: pgmap v20475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:46 smithi156 ceph-mon[32679]: pgmap v20475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:46:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:46:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:46:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:46:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:48 smithi092 ceph-mon[29156]: pgmap v20476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:46:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:46:48.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:46:48.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:48 smithi189 ceph-mon[32756]: pgmap v20476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:48.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:46:48.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:46:48.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:46:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:48 smithi156 ceph-mon[32679]: pgmap v20476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:46:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:46:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:46:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:46:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:49 smithi092 ceph-mon[29156]: pgmap v20477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:46:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:49 smithi092 ceph-mon[29156]: pgmap v20478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:46:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:49 smithi189 ceph-mon[32756]: pgmap v20477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:46:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:49 smithi189 ceph-mon[32756]: pgmap v20478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:46:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:49 smithi156 ceph-mon[32679]: pgmap v20477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:46:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:49 smithi156 ceph-mon[32679]: pgmap v20478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:46:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37705.046335 secs 2024-04-27T04:46:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37008.010574 secs 2024-04-27T04:46:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37705.046335 secs 2024-04-27T04:46:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37008.010574 secs 2024-04-27T04:46:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37705.046335 secs 2024-04-27T04:46:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37008.010574 secs 2024-04-27T04:46:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:51 smithi092 ceph-mon[29156]: pgmap v20479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:51 smithi189 ceph-mon[32756]: pgmap v20479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:51 smithi156 ceph-mon[32679]: pgmap v20479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:53.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:53 smithi156 ceph-mon[32679]: pgmap v20480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:53 smithi092 ceph-mon[29156]: pgmap v20480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:53 smithi189 ceph-mon[32756]: pgmap v20480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37710.046452 secs 2024-04-27T04:46:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:55 smithi092 ceph-mon[29156]: pgmap v20481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37013.010704 secs 2024-04-27T04:46:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37710.046452 secs 2024-04-27T04:46:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:55 smithi189 ceph-mon[32756]: pgmap v20481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37013.010704 secs 2024-04-27T04:46:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37710.046452 secs 2024-04-27T04:46:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:55 smithi156 ceph-mon[32679]: pgmap v20481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37013.010704 secs 2024-04-27T04:46:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:57 smithi092 ceph-mon[29156]: pgmap v20482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:57 smithi189 ceph-mon[32756]: pgmap v20482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:57 smithi156 ceph-mon[32679]: pgmap v20482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:46:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:46:59 smithi092 ceph-mon[29156]: pgmap v20483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:46:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:46:59 smithi189 ceph-mon[32756]: pgmap v20483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:46:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:46:59 smithi156 ceph-mon[32679]: pgmap v20483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:47:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37715.046573 secs 2024-04-27T04:47:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37018.010799 secs 2024-04-27T04:47:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37715.046573 secs 2024-04-27T04:47:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37018.010799 secs 2024-04-27T04:47:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37715.046573 secs 2024-04-27T04:47:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37018.010799 secs 2024-04-27T04:47:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:01 smithi189 ceph-mon[32756]: pgmap v20484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:01 smithi156 ceph-mon[32679]: pgmap v20484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:01 smithi092 ceph-mon[29156]: pgmap v20484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:03 smithi189 ceph-mon[32756]: pgmap v20485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:03 smithi156 ceph-mon[32679]: pgmap v20485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:03 smithi092 ceph-mon[29156]: pgmap v20485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:05.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37720.046696 secs 2024-04-27T04:47:05.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:05 smithi092 ceph-mon[29156]: pgmap v20486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:05.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37023.010922 secs 2024-04-27T04:47:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37720.046696 secs 2024-04-27T04:47:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:05 smithi189 ceph-mon[32756]: pgmap v20486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37023.010922 secs 2024-04-27T04:47:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37720.046696 secs 2024-04-27T04:47:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:05 smithi156 ceph-mon[32679]: pgmap v20486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37023.010922 secs 2024-04-27T04:47:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:07 smithi189 ceph-mon[32756]: pgmap v20487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:07 smithi156 ceph-mon[32679]: pgmap v20487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:07 smithi092 ceph-mon[29156]: pgmap v20487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:09.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:08 smithi092 ceph-mon[29156]: pgmap v20488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:08 smithi189 ceph-mon[32756]: pgmap v20488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:08 smithi156 ceph-mon[32679]: pgmap v20488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37725.046790 secs 2024-04-27T04:47:10.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:09 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37028.011038 secs 2024-04-27T04:47:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37725.046790 secs 2024-04-27T04:47:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:09 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37028.011038 secs 2024-04-27T04:47:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37725.046790 secs 2024-04-27T04:47:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:09 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37028.011038 secs 2024-04-27T04:47:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:10 smithi092 ceph-mon[29156]: pgmap v20489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:11.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:10 smithi189 ceph-mon[32756]: pgmap v20489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:11.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:10 smithi156 ceph-mon[32679]: pgmap v20489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:13.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:13 smithi189 ceph-mon[32756]: pgmap v20490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:13.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:13 smithi156 ceph-mon[32679]: pgmap v20490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:13.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:13 smithi092 ceph-mon[29156]: pgmap v20490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:15 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 37730.046938 secs 2024-04-27T04:47:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:15 smithi189 ceph-mon[32756]: slow request 5764.601443 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:15 smithi189 ceph-mon[32756]: pgmap v20491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:15.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37033.011180 secs 2024-04-27T04:47:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:15 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 37730.046938 secs 2024-04-27T04:47:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:15 smithi156 ceph-mon[32679]: slow request 5764.601443 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:15 smithi156 ceph-mon[32679]: pgmap v20491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37033.011180 secs 2024-04-27T04:47:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:15 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 37730.046938 secs 2024-04-27T04:47:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:15 smithi092 ceph-mon[29156]: slow request 5764.601443 seconds old, received at 2024-04-27T03:11:09.361236+0000: client_request(client.17445:1 getattr pAsLsXsFs #0x1 2024-04-27T03:11:09.354046+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:15 smithi092 ceph-mon[29156]: pgmap v20491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37033.011180 secs 2024-04-27T04:47:17.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:17 smithi189 ceph-mon[32756]: pgmap v20492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:17.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:17 smithi156 ceph-mon[32679]: pgmap v20492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:17.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:17 smithi092 ceph-mon[29156]: pgmap v20492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:19 smithi189 ceph-mon[32756]: pgmap v20493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:19 smithi156 ceph-mon[32679]: pgmap v20493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:19 smithi092 ceph-mon[29156]: pgmap v20493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37735.047086 secs 2024-04-27T04:47:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37038.011334 secs 2024-04-27T04:47:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37735.047086 secs 2024-04-27T04:47:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37038.011334 secs 2024-04-27T04:47:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37735.047086 secs 2024-04-27T04:47:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37038.011334 secs 2024-04-27T04:47:21.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:21 smithi156 ceph-mon[32679]: pgmap v20494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:21.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:21 smithi092 ceph-mon[29156]: pgmap v20494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:21 smithi189 ceph-mon[32756]: pgmap v20494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:23.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:23 smithi156 ceph-mon[32679]: pgmap v20495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:23.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:23 smithi092 ceph-mon[29156]: pgmap v20495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:23.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:23 smithi189 ceph-mon[32756]: pgmap v20495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37740.047201 secs 2024-04-27T04:47:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:25 smithi156 ceph-mon[32679]: pgmap v20496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37043.011399 secs 2024-04-27T04:47:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37740.047201 secs 2024-04-27T04:47:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:25 smithi092 ceph-mon[29156]: pgmap v20496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37043.011399 secs 2024-04-27T04:47:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37740.047201 secs 2024-04-27T04:47:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:25 smithi189 ceph-mon[32756]: pgmap v20496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37043.011399 secs 2024-04-27T04:47:27.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:27 smithi156 ceph-mon[32679]: pgmap v20497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:27.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:27 smithi092 ceph-mon[29156]: pgmap v20497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:27.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:27 smithi189 ceph-mon[32756]: pgmap v20497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:29 smithi156 ceph-mon[32679]: pgmap v20498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:29 smithi092 ceph-mon[29156]: pgmap v20498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:29 smithi189 ceph-mon[32756]: pgmap v20498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37745.047315 secs 2024-04-27T04:47:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37048.011470 secs 2024-04-27T04:47:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37745.047315 secs 2024-04-27T04:47:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37048.011470 secs 2024-04-27T04:47:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37745.047315 secs 2024-04-27T04:47:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37048.011470 secs 2024-04-27T04:47:31.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:31 smithi156 ceph-mon[32679]: pgmap v20499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:31.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:31 smithi092 ceph-mon[29156]: pgmap v20499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:31.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:31 smithi189 ceph-mon[32756]: pgmap v20499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:33.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:33 smithi156 ceph-mon[32679]: pgmap v20500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:33.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:33 smithi092 ceph-mon[29156]: pgmap v20500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:33 smithi189 ceph-mon[32756]: pgmap v20500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37750.047392 secs 2024-04-27T04:47:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:35 smithi156 ceph-mon[32679]: pgmap v20501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37053.011591 secs 2024-04-27T04:47:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37750.047392 secs 2024-04-27T04:47:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:35 smithi092 ceph-mon[29156]: pgmap v20501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37053.011591 secs 2024-04-27T04:47:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37750.047392 secs 2024-04-27T04:47:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:35 smithi189 ceph-mon[32756]: pgmap v20501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37053.011591 secs 2024-04-27T04:47:37.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:37 smithi156 ceph-mon[32679]: pgmap v20502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:37.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:37 smithi092 ceph-mon[29156]: pgmap v20502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:37 smithi189 ceph-mon[32756]: pgmap v20502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:39 smithi156 ceph-mon[32679]: pgmap v20503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:39 smithi092 ceph-mon[29156]: pgmap v20503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:39 smithi189 ceph-mon[32756]: pgmap v20503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37755.047516 secs 2024-04-27T04:47:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37058.011715 secs 2024-04-27T04:47:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37755.047516 secs 2024-04-27T04:47:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37058.011715 secs 2024-04-27T04:47:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37755.047516 secs 2024-04-27T04:47:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37058.011715 secs 2024-04-27T04:47:41.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:41 smithi156 ceph-mon[32679]: pgmap v20504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:41.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:41 smithi092 ceph-mon[29156]: pgmap v20504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:41 smithi189 ceph-mon[32756]: pgmap v20504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:43.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:43 smithi092 ceph-mon[29156]: pgmap v20505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:43 smithi189 ceph-mon[32756]: pgmap v20505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:43.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:43 smithi156 ceph-mon[32679]: pgmap v20505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:45 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 37760.047643 secs 2024-04-27T04:47:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:45 smithi092 ceph-mon[29156]: slow request 723.194127 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:45 smithi092 ceph-mon[29156]: pgmap v20506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37063.011807 secs 2024-04-27T04:47:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:45 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 37760.047643 secs 2024-04-27T04:47:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:45 smithi189 ceph-mon[32756]: slow request 723.194127 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:45 smithi189 ceph-mon[32756]: pgmap v20506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37063.011807 secs 2024-04-27T04:47:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:45 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 37760.047643 secs 2024-04-27T04:47:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:45 smithi156 ceph-mon[32679]: slow request 723.194127 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:47:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:45 smithi156 ceph-mon[32679]: pgmap v20506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:47:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37063.011807 secs 2024-04-27T04:47:47.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:47 smithi092 ceph-mon[29156]: pgmap v20507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:47 smithi189 ceph-mon[32756]: pgmap v20507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:47.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:47 smithi156 ceph-mon[32679]: pgmap v20507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:47:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:47:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:47:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:49 smithi092 ceph-mon[29156]: pgmap v20508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:47:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:47:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:47:49.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:49 smithi189 ceph-mon[32756]: pgmap v20508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:49.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:47:49.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:47:49.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:47:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:49 smithi156 ceph-mon[32679]: pgmap v20508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:47:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:47:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:47:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:47:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:50 smithi092 ceph-mon[29156]: pgmap v20509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:47:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:50 smithi092 ceph-mon[29156]: pgmap v20510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37765.047703 secs 2024-04-27T04:47:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37068.011953 secs 2024-04-27T04:47:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:50 smithi189 ceph-mon[32756]: pgmap v20509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:47:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:50 smithi189 ceph-mon[32756]: pgmap v20510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37765.047703 secs 2024-04-27T04:47:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37068.011953 secs 2024-04-27T04:47:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:50 smithi156 ceph-mon[32679]: pgmap v20509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:47:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:50 smithi156 ceph-mon[32679]: pgmap v20510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37765.047703 secs 2024-04-27T04:47:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37068.011953 secs 2024-04-27T04:47:52.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:52 smithi092 ceph-mon[29156]: pgmap v20511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:52 smithi189 ceph-mon[32756]: pgmap v20511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:52 smithi156 ceph-mon[32679]: pgmap v20511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:54.488 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:54 smithi156 ceph-mon[32679]: pgmap v20512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:47:54.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:54 smithi092 ceph-mon[29156]: pgmap v20512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:47:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:54 smithi189 ceph-mon[32756]: pgmap v20512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:47:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37770.047857 secs 2024-04-27T04:47:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37073.012097 secs 2024-04-27T04:47:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37770.047857 secs 2024-04-27T04:47:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37073.012097 secs 2024-04-27T04:47:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37770.047857 secs 2024-04-27T04:47:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37073.012097 secs 2024-04-27T04:47:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:56 smithi092 ceph-mon[29156]: pgmap v20513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:56 smithi189 ceph-mon[32756]: pgmap v20513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:56 smithi156 ceph-mon[32679]: pgmap v20513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:47:58 smithi092 ceph-mon[29156]: pgmap v20514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:47:58 smithi189 ceph-mon[32756]: pgmap v20514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:47:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:47:58 smithi156 ceph-mon[32679]: pgmap v20514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:00 smithi092 ceph-mon[29156]: pgmap v20515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:48:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37775.047972 secs 2024-04-27T04:48:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37078.012216 secs 2024-04-27T04:48:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:00 smithi189 ceph-mon[32756]: pgmap v20515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:48:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37775.047972 secs 2024-04-27T04:48:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37078.012216 secs 2024-04-27T04:48:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:00 smithi156 ceph-mon[32679]: pgmap v20515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:48:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37775.047972 secs 2024-04-27T04:48:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37078.012216 secs 2024-04-27T04:48:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:02 smithi092 ceph-mon[29156]: pgmap v20516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:02 smithi189 ceph-mon[32756]: pgmap v20516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:02.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:02 smithi156 ceph-mon[32679]: pgmap v20516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:04 smithi092 ceph-mon[29156]: pgmap v20517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:04 smithi189 ceph-mon[32756]: pgmap v20517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:04 smithi156 ceph-mon[32679]: pgmap v20517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37780.048065 secs 2024-04-27T04:48:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37083.012355 secs 2024-04-27T04:48:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37780.048065 secs 2024-04-27T04:48:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37083.012355 secs 2024-04-27T04:48:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37780.048065 secs 2024-04-27T04:48:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37083.012355 secs 2024-04-27T04:48:06.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:06 smithi092 ceph-mon[29156]: pgmap v20518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:06 smithi189 ceph-mon[32756]: pgmap v20518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:06.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:06 smithi156 ceph-mon[32679]: pgmap v20518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:08 smithi189 ceph-mon[32756]: pgmap v20519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:08.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:08 smithi156 ceph-mon[32679]: pgmap v20519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:08 smithi092 ceph-mon[29156]: pgmap v20519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:10.559 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:10 smithi092 ceph-mon[29156]: pgmap v20520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:10.559 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37785.048162 secs 2024-04-27T04:48:10.559 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37088.012495 secs 2024-04-27T04:48:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:10 smithi189 ceph-mon[32756]: pgmap v20520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37785.048162 secs 2024-04-27T04:48:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37088.012495 secs 2024-04-27T04:48:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:10 smithi156 ceph-mon[32679]: pgmap v20520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37785.048162 secs 2024-04-27T04:48:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37088.012495 secs 2024-04-27T04:48:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:12 smithi189 ceph-mon[32756]: pgmap v20521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:12.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:12 smithi156 ceph-mon[32679]: pgmap v20521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:12 smithi092 ceph-mon[29156]: pgmap v20521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:14 smithi189 ceph-mon[32756]: pgmap v20522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:14 smithi156 ceph-mon[32679]: pgmap v20522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:14 smithi092 ceph-mon[29156]: pgmap v20522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37790.048259 secs 2024-04-27T04:48:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37093.012606 secs 2024-04-27T04:48:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37790.048259 secs 2024-04-27T04:48:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37093.012606 secs 2024-04-27T04:48:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37790.048259 secs 2024-04-27T04:48:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37093.012606 secs 2024-04-27T04:48:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:16 smithi189 ceph-mon[32756]: pgmap v20523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:16.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:16 smithi156 ceph-mon[32679]: pgmap v20523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:16.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:16 smithi092 ceph-mon[29156]: pgmap v20523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:18 smithi189 ceph-mon[32756]: pgmap v20524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:18 smithi156 ceph-mon[32679]: pgmap v20524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:18 smithi092 ceph-mon[29156]: pgmap v20524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:48:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:20 smithi189 ceph-mon[32756]: pgmap v20525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37795.048367 secs 2024-04-27T04:48:20.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37098.012670 secs 2024-04-27T04:48:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:20 smithi156 ceph-mon[32679]: pgmap v20525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37795.048367 secs 2024-04-27T04:48:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37098.012670 secs 2024-04-27T04:48:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:20 smithi092 ceph-mon[29156]: pgmap v20525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:48:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37795.048367 secs 2024-04-27T04:48:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37098.012670 secs 2024-04-27T04:48:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:22 smithi189 ceph-mon[32756]: pgmap v20526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:22 smithi156 ceph-mon[32679]: pgmap v20526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:22 smithi092 ceph-mon[29156]: pgmap v20526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:24 smithi189 ceph-mon[32756]: pgmap v20527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:24 smithi156 ceph-mon[32679]: pgmap v20527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:24 smithi092 ceph-mon[29156]: pgmap v20527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37800.048497 secs 2024-04-27T04:48:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37103.012749 secs 2024-04-27T04:48:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37800.048497 secs 2024-04-27T04:48:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37103.012749 secs 2024-04-27T04:48:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37800.048497 secs 2024-04-27T04:48:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37103.012749 secs 2024-04-27T04:48:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:26 smithi189 ceph-mon[32756]: pgmap v20528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:26 smithi156 ceph-mon[32679]: pgmap v20528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:26 smithi092 ceph-mon[29156]: pgmap v20528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:28 smithi189 ceph-mon[32756]: pgmap v20529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:28 smithi156 ceph-mon[32679]: pgmap v20529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:28 smithi092 ceph-mon[29156]: pgmap v20529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:30 smithi189 ceph-mon[32756]: pgmap v20530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37805.048635 secs 2024-04-27T04:48:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37108.012866 secs 2024-04-27T04:48:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:30 smithi156 ceph-mon[32679]: pgmap v20530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37805.048635 secs 2024-04-27T04:48:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37108.012866 secs 2024-04-27T04:48:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:30 smithi092 ceph-mon[29156]: pgmap v20530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37805.048635 secs 2024-04-27T04:48:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37108.012866 secs 2024-04-27T04:48:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:32 smithi189 ceph-mon[32756]: pgmap v20531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:32 smithi156 ceph-mon[32679]: pgmap v20531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:32 smithi092 ceph-mon[29156]: pgmap v20531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:34 smithi189 ceph-mon[32756]: pgmap v20532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:34 smithi156 ceph-mon[32679]: pgmap v20532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:34 smithi092 ceph-mon[29156]: pgmap v20532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37810.048698 secs 2024-04-27T04:48:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37113.013011 secs 2024-04-27T04:48:35.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37810.048698 secs 2024-04-27T04:48:35.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37113.013011 secs 2024-04-27T04:48:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37810.048698 secs 2024-04-27T04:48:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37113.013011 secs 2024-04-27T04:48:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-27T04:48:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-27T04:48:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca8089000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca8089000 comp rx=0 tx=0).stop 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).tick see no progress in more than 10000000 us during connecting to v2:172.21.15.92:6800/1487524229, fault. 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:48:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.051+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca806e000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T04:48:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.099+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T04:48:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.099+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T04:48:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.099+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T04:48:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.099+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=40 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T04:48:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.099+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T04:48:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.100+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T04:48:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:36.100+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T04:48:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:36 smithi189 ceph-mon[32756]: pgmap v20533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:36 smithi156 ceph-mon[32679]: pgmap v20533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:36 smithi092 ceph-mon[29156]: pgmap v20533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:38.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:38 smithi189 ceph-mon[32756]: pgmap v20534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:38 smithi156 ceph-mon[32679]: pgmap v20534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:38 smithi092 ceph-mon[29156]: pgmap v20534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:40 smithi189 ceph-mon[32756]: pgmap v20535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37815.048854 secs 2024-04-27T04:48:40.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37118.013146 secs 2024-04-27T04:48:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:40 smithi156 ceph-mon[32679]: pgmap v20535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37815.048854 secs 2024-04-27T04:48:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37118.013146 secs 2024-04-27T04:48:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:40 smithi092 ceph-mon[29156]: pgmap v20535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37815.048854 secs 2024-04-27T04:48:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37118.013146 secs 2024-04-27T04:48:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:41.173+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:48:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:41.173+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:48:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:41.173+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:48:41.176 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:48:41.173+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 291 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:48:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:42 smithi189 ceph-mon[32756]: pgmap v20536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:42 smithi156 ceph-mon[32679]: pgmap v20536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:42 smithi092 ceph-mon[29156]: pgmap v20536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:44 smithi189 ceph-mon[32756]: pgmap v20537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:44 smithi156 ceph-mon[32679]: pgmap v20537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:44 smithi092 ceph-mon[29156]: pgmap v20537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37820.048915 secs 2024-04-27T04:48:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37123.013281 secs 2024-04-27T04:48:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37820.048915 secs 2024-04-27T04:48:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37123.013281 secs 2024-04-27T04:48:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37820.048915 secs 2024-04-27T04:48:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37123.013281 secs 2024-04-27T04:48:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:46 smithi189 ceph-mon[32756]: pgmap v20538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:46 smithi156 ceph-mon[32679]: pgmap v20538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:46 smithi092 ceph-mon[29156]: pgmap v20538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:48 smithi189 ceph-mon[32756]: pgmap v20539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:48 smithi156 ceph-mon[32679]: pgmap v20539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:48 smithi092 ceph-mon[29156]: pgmap v20539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:48:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:48:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:48:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:48:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: pgmap v20540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:50.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37825.049030 secs 2024-04-27T04:48:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37128.013369 secs 2024-04-27T04:48:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:48:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:48:50.643 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: pgmap v20540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37825.049030 secs 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37128.013369 secs 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:48:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: pgmap v20540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37825.049030 secs 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37128.013369 secs 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:48:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:48:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:51 smithi189 ceph-mon[32756]: pgmap v20541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:48:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:51 smithi189 ceph-mon[32756]: pgmap v20542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:51 smithi156 ceph-mon[32679]: pgmap v20541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:48:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:51 smithi156 ceph-mon[32679]: pgmap v20542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:51 smithi092 ceph-mon[29156]: pgmap v20541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:48:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:51 smithi092 ceph-mon[29156]: pgmap v20542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:53 smithi189 ceph-mon[32756]: pgmap v20543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:53 smithi156 ceph-mon[32679]: pgmap v20543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:53 smithi092 ceph-mon[29156]: pgmap v20543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:55 smithi189 ceph-mon[32756]: pgmap v20544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37830.049170 secs 2024-04-27T04:48:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37133.013509 secs 2024-04-27T04:48:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:55 smithi156 ceph-mon[32679]: pgmap v20544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37830.049170 secs 2024-04-27T04:48:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37133.013509 secs 2024-04-27T04:48:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:55 smithi092 ceph-mon[29156]: pgmap v20544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37830.049170 secs 2024-04-27T04:48:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37133.013509 secs 2024-04-27T04:48:57.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:57 smithi189 ceph-mon[32756]: pgmap v20545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:57.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:57 smithi092 ceph-mon[29156]: pgmap v20545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:57.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:57 smithi156 ceph-mon[32679]: pgmap v20545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:48:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:48:59 smithi189 ceph-mon[32756]: pgmap v20546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:48:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:48:59 smithi156 ceph-mon[32679]: pgmap v20546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:48:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:48:59 smithi092 ceph-mon[29156]: pgmap v20546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37835.049280 secs 2024-04-27T04:49:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37138.013636 secs 2024-04-27T04:49:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37835.049280 secs 2024-04-27T04:49:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37138.013636 secs 2024-04-27T04:49:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37835.049280 secs 2024-04-27T04:49:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37138.013636 secs 2024-04-27T04:49:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:01 smithi189 ceph-mon[32756]: pgmap v20547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:49:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:01 smithi156 ceph-mon[32679]: pgmap v20547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:49:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:01 smithi092 ceph-mon[29156]: pgmap v20547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:49:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:03 smithi189 ceph-mon[32756]: pgmap v20548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:03 smithi156 ceph-mon[32679]: pgmap v20548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:03 smithi092 ceph-mon[29156]: pgmap v20548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:05 smithi189 ceph-mon[32756]: pgmap v20549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37840.049410 secs 2024-04-27T04:49:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37143.013738 secs 2024-04-27T04:49:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:05 smithi156 ceph-mon[32679]: pgmap v20549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37840.049410 secs 2024-04-27T04:49:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37143.013738 secs 2024-04-27T04:49:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:05 smithi092 ceph-mon[29156]: pgmap v20549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37840.049410 secs 2024-04-27T04:49:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37143.013738 secs 2024-04-27T04:49:07.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:07 smithi189 ceph-mon[32756]: pgmap v20550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:07 smithi156 ceph-mon[32679]: pgmap v20550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:07 smithi092 ceph-mon[29156]: pgmap v20550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:09 smithi189 ceph-mon[32756]: pgmap v20551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:09 smithi156 ceph-mon[32679]: pgmap v20551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:09 smithi092 ceph-mon[29156]: pgmap v20551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37845.049543 secs 2024-04-27T04:49:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37148.013872 secs 2024-04-27T04:49:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37845.049543 secs 2024-04-27T04:49:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37148.013872 secs 2024-04-27T04:49:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37845.049543 secs 2024-04-27T04:49:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37148.013872 secs 2024-04-27T04:49:11.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:11 smithi156 ceph-mon[32679]: pgmap v20552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:11 smithi092 ceph-mon[29156]: pgmap v20552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:11 smithi189 ceph-mon[32756]: pgmap v20552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:13 smithi156 ceph-mon[32679]: pgmap v20553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:13 smithi092 ceph-mon[29156]: pgmap v20553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:13 smithi189 ceph-mon[32756]: pgmap v20553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:15 smithi156 ceph-mon[32679]: pgmap v20554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37850.049663 secs 2024-04-27T04:49:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37153.013992 secs 2024-04-27T04:49:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:15 smithi092 ceph-mon[29156]: pgmap v20554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37850.049663 secs 2024-04-27T04:49:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37153.013992 secs 2024-04-27T04:49:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:15 smithi189 ceph-mon[32756]: pgmap v20554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37850.049663 secs 2024-04-27T04:49:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37153.013992 secs 2024-04-27T04:49:17.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:17 smithi156 ceph-mon[32679]: pgmap v20555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:17 smithi092 ceph-mon[29156]: pgmap v20555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:17 smithi189 ceph-mon[32756]: pgmap v20555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:19 smithi156 ceph-mon[32679]: pgmap v20556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:19 smithi092 ceph-mon[29156]: pgmap v20556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:19 smithi189 ceph-mon[32756]: pgmap v20556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37855.049772 secs 2024-04-27T04:49:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37158.014105 secs 2024-04-27T04:49:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37855.049772 secs 2024-04-27T04:49:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37158.014105 secs 2024-04-27T04:49:20.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37855.049772 secs 2024-04-27T04:49:20.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37158.014105 secs 2024-04-27T04:49:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:21 smithi156 ceph-mon[32679]: pgmap v20557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:21 smithi092 ceph-mon[29156]: pgmap v20557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:21 smithi189 ceph-mon[32756]: pgmap v20557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:23.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:23 smithi156 ceph-mon[32679]: pgmap v20558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:23.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:23 smithi092 ceph-mon[29156]: pgmap v20558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:23 smithi189 ceph-mon[32756]: pgmap v20558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:25 smithi156 ceph-mon[32679]: pgmap v20559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37860.049888 secs 2024-04-27T04:49:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37163.014256 secs 2024-04-27T04:49:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:25 smithi092 ceph-mon[29156]: pgmap v20559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37860.049888 secs 2024-04-27T04:49:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37163.014256 secs 2024-04-27T04:49:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:25 smithi189 ceph-mon[32756]: pgmap v20559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37860.049888 secs 2024-04-27T04:49:25.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37163.014256 secs 2024-04-27T04:49:27.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:27 smithi156 ceph-mon[32679]: pgmap v20560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:27 smithi092 ceph-mon[29156]: pgmap v20560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:27 smithi189 ceph-mon[32756]: pgmap v20560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:29 smithi156 ceph-mon[32679]: pgmap v20561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:29 smithi092 ceph-mon[29156]: pgmap v20561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:29 smithi189 ceph-mon[32756]: pgmap v20561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37865.049983 secs 2024-04-27T04:49:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37168.014370 secs 2024-04-27T04:49:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37865.049983 secs 2024-04-27T04:49:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37168.014370 secs 2024-04-27T04:49:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37865.049983 secs 2024-04-27T04:49:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37168.014370 secs 2024-04-27T04:49:31.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:31 smithi092 ceph-mon[29156]: pgmap v20562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:31 smithi189 ceph-mon[32756]: pgmap v20562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:31 smithi156 ceph-mon[32679]: pgmap v20562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:33.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:33 smithi092 ceph-mon[29156]: pgmap v20563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:33 smithi189 ceph-mon[32756]: pgmap v20563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:33 smithi156 ceph-mon[32679]: pgmap v20563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:35 smithi092 ceph-mon[29156]: pgmap v20564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37870.050093 secs 2024-04-27T04:49:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37173.014433 secs 2024-04-27T04:49:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:35 smithi189 ceph-mon[32756]: pgmap v20564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37870.050093 secs 2024-04-27T04:49:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37173.014433 secs 2024-04-27T04:49:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:35 smithi156 ceph-mon[32679]: pgmap v20564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37870.050093 secs 2024-04-27T04:49:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37173.014433 secs 2024-04-27T04:49:37.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:37 smithi092 ceph-mon[29156]: pgmap v20565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:37 smithi189 ceph-mon[32756]: pgmap v20565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:37 smithi156 ceph-mon[32679]: pgmap v20565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:39 smithi092 ceph-mon[29156]: pgmap v20566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:39 smithi189 ceph-mon[32756]: pgmap v20566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:39.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:39 smithi156 ceph-mon[32679]: pgmap v20566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37875.050216 secs 2024-04-27T04:49:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37178.014549 secs 2024-04-27T04:49:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37875.050216 secs 2024-04-27T04:49:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37178.014549 secs 2024-04-27T04:49:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37875.050216 secs 2024-04-27T04:49:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37178.014549 secs 2024-04-27T04:49:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:41 smithi092 ceph-mon[29156]: pgmap v20567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:41 smithi189 ceph-mon[32756]: pgmap v20567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:41 smithi156 ceph-mon[32679]: pgmap v20567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:43.743 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:43 smithi092 ceph-mon[29156]: pgmap v20568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:43 smithi189 ceph-mon[32756]: pgmap v20568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:43 smithi156 ceph-mon[32679]: pgmap v20568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:45 smithi092 ceph-mon[29156]: pgmap v20569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37880.050296 secs 2024-04-27T04:49:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 37183.014628 secs 2024-04-27T04:49:45.749 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:45 smithi092 ceph-mon[29156]: slow request 1443.570353 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:49:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:45 smithi189 ceph-mon[32756]: pgmap v20569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37880.050296 secs 2024-04-27T04:49:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 37183.014628 secs 2024-04-27T04:49:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:45 smithi189 ceph-mon[32756]: slow request 1443.570353 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:49:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:45 smithi156 ceph-mon[32679]: pgmap v20569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37880.050296 secs 2024-04-27T04:49:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 37183.014628 secs 2024-04-27T04:49:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:45 smithi156 ceph-mon[32679]: slow request 1443.570353 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:49:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:47 smithi092 ceph-mon[29156]: pgmap v20570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:47 smithi189 ceph-mon[32756]: pgmap v20570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:47 smithi156 ceph-mon[32679]: pgmap v20570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:49 smithi092 ceph-mon[29156]: pgmap v20571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:49 smithi189 ceph-mon[32756]: pgmap v20571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:49 smithi156 ceph-mon[32679]: pgmap v20571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37885.050414 secs 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37188.014720 secs 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:49:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:49:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37885.050414 secs 2024-04-27T04:49:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37188.014720 secs 2024-04-27T04:49:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:49:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:49:50.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:49:50.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37885.050414 secs 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37188.014720 secs 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:49:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:49:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:51 smithi092 ceph-mon[29156]: pgmap v20572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:51 smithi092 ceph-mon[29156]: pgmap v20573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:49:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:51 smithi092 ceph-mon[29156]: pgmap v20574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:51 smithi189 ceph-mon[32756]: pgmap v20572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:51 smithi189 ceph-mon[32756]: pgmap v20573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:49:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:51 smithi189 ceph-mon[32756]: pgmap v20574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:51 smithi156 ceph-mon[32679]: pgmap v20572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:49:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:51 smithi156 ceph-mon[32679]: pgmap v20573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:49:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:51 smithi156 ceph-mon[32679]: pgmap v20574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:53 smithi092 ceph-mon[29156]: pgmap v20575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:53 smithi189 ceph-mon[32756]: pgmap v20575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:53 smithi156 ceph-mon[32679]: pgmap v20575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:55.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37890.050532 secs 2024-04-27T04:49:55.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37193.014782 secs 2024-04-27T04:49:55.738 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:55 smithi156 ceph-mon[32679]: pgmap v20576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37890.050532 secs 2024-04-27T04:49:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37193.014782 secs 2024-04-27T04:49:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:55 smithi092 ceph-mon[29156]: pgmap v20576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37890.050532 secs 2024-04-27T04:49:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37193.014782 secs 2024-04-27T04:49:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:55 smithi189 ceph-mon[32756]: pgmap v20576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:57 smithi092 ceph-mon[29156]: pgmap v20577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:57 smithi189 ceph-mon[32756]: pgmap v20577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:57 smithi156 ceph-mon[32679]: pgmap v20577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:49:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:49:59 smithi092 ceph-mon[29156]: pgmap v20578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:49:59 smithi189 ceph-mon[32756]: pgmap v20578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:49:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:49:59 smithi156 ceph-mon[32679]: pgmap v20578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:50:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37895.050648 secs 2024-04-27T04:50:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37198.014900 secs 2024-04-27T04:50:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:50:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37895.050648 secs 2024-04-27T04:50:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37198.014900 secs 2024-04-27T04:50:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:50:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37895.050648 secs 2024-04-27T04:50:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37198.014900 secs 2024-04-27T04:50:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T04:50:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:01 smithi092 ceph-mon[29156]: pgmap v20579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:50:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:01 smithi189 ceph-mon[32756]: pgmap v20579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:50:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:01 smithi156 ceph-mon[32679]: pgmap v20579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:50:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:03 smithi189 ceph-mon[32756]: pgmap v20580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:03 smithi156 ceph-mon[32679]: pgmap v20580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:03 smithi092 ceph-mon[29156]: pgmap v20580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37900.050763 secs 2024-04-27T04:50:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37203.015015 secs 2024-04-27T04:50:05.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:05 smithi092 ceph-mon[29156]: pgmap v20581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37900.050763 secs 2024-04-27T04:50:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37203.015015 secs 2024-04-27T04:50:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:05 smithi189 ceph-mon[32756]: pgmap v20581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37900.050763 secs 2024-04-27T04:50:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37203.015015 secs 2024-04-27T04:50:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:05 smithi156 ceph-mon[32679]: pgmap v20581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:07 smithi189 ceph-mon[32756]: pgmap v20582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:07 smithi156 ceph-mon[32679]: pgmap v20582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:07.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:07 smithi092 ceph-mon[29156]: pgmap v20582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:09 smithi189 ceph-mon[32756]: pgmap v20583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:09 smithi156 ceph-mon[32679]: pgmap v20583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:09 smithi092 ceph-mon[29156]: pgmap v20583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37905.050880 secs 2024-04-27T04:50:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37208.015095 secs 2024-04-27T04:50:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37905.050880 secs 2024-04-27T04:50:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37208.015095 secs 2024-04-27T04:50:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37905.050880 secs 2024-04-27T04:50:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37208.015095 secs 2024-04-27T04:50:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:11 smithi189 ceph-mon[32756]: pgmap v20584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:11.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:11 smithi156 ceph-mon[32679]: pgmap v20584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:11.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:11 smithi092 ceph-mon[29156]: pgmap v20584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:13 smithi189 ceph-mon[32756]: pgmap v20585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:13 smithi156 ceph-mon[32679]: pgmap v20585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:13.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:13 smithi092 ceph-mon[29156]: pgmap v20585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37910.050943 secs 2024-04-27T04:50:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37213.015195 secs 2024-04-27T04:50:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:15 smithi189 ceph-mon[32756]: pgmap v20586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37910.050943 secs 2024-04-27T04:50:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37213.015195 secs 2024-04-27T04:50:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:15 smithi156 ceph-mon[32679]: pgmap v20586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37910.050943 secs 2024-04-27T04:50:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37213.015195 secs 2024-04-27T04:50:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:15 smithi092 ceph-mon[29156]: pgmap v20586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:17 smithi189 ceph-mon[32756]: pgmap v20587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:17 smithi156 ceph-mon[32679]: pgmap v20587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:17.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:17 smithi092 ceph-mon[29156]: pgmap v20587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:19 smithi189 ceph-mon[32756]: pgmap v20588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:19 smithi156 ceph-mon[32679]: pgmap v20588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:19 smithi092 ceph-mon[29156]: pgmap v20588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:20.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37915.051057 secs 2024-04-27T04:50:20.792 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37218.015267 secs 2024-04-27T04:50:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37915.051057 secs 2024-04-27T04:50:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37218.015267 secs 2024-04-27T04:50:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37915.051057 secs 2024-04-27T04:50:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37218.015267 secs 2024-04-27T04:50:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:21 smithi189 ceph-mon[32756]: pgmap v20589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:21 smithi156 ceph-mon[32679]: pgmap v20589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:21.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:21 smithi092 ceph-mon[29156]: pgmap v20589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:23 smithi189 ceph-mon[32756]: pgmap v20590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:23 smithi156 ceph-mon[32679]: pgmap v20590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:23.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:23 smithi092 ceph-mon[29156]: pgmap v20590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37920.051188 secs 2024-04-27T04:50:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37223.015404 secs 2024-04-27T04:50:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:25 smithi189 ceph-mon[32756]: pgmap v20591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37920.051188 secs 2024-04-27T04:50:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37223.015404 secs 2024-04-27T04:50:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:25 smithi156 ceph-mon[32679]: pgmap v20591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37920.051188 secs 2024-04-27T04:50:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37223.015404 secs 2024-04-27T04:50:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:25 smithi092 ceph-mon[29156]: pgmap v20591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:27 smithi189 ceph-mon[32756]: pgmap v20592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:27 smithi156 ceph-mon[32679]: pgmap v20592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:27 smithi092 ceph-mon[29156]: pgmap v20592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:29 smithi189 ceph-mon[32756]: pgmap v20593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:29 smithi156 ceph-mon[32679]: pgmap v20593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:29 smithi092 ceph-mon[29156]: pgmap v20593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:30.847 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37925.051282 secs 2024-04-27T04:50:30.847 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37228.015518 secs 2024-04-27T04:50:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37925.051282 secs 2024-04-27T04:50:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37228.015518 secs 2024-04-27T04:50:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37925.051282 secs 2024-04-27T04:50:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37228.015518 secs 2024-04-27T04:50:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:31 smithi189 ceph-mon[32756]: pgmap v20594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:31 smithi156 ceph-mon[32679]: pgmap v20594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:31.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:31 smithi092 ceph-mon[29156]: pgmap v20594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:33 smithi189 ceph-mon[32756]: pgmap v20595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:33 smithi156 ceph-mon[32679]: pgmap v20595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:33 smithi092 ceph-mon[29156]: pgmap v20595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:35 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37930.051391 secs 2024-04-27T04:50:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37233.015664 secs 2024-04-27T04:50:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:35 smithi189 ceph-mon[32756]: pgmap v20596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:35 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37930.051391 secs 2024-04-27T04:50:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37233.015664 secs 2024-04-27T04:50:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:35 smithi156 ceph-mon[32679]: pgmap v20596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:35 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37930.051391 secs 2024-04-27T04:50:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37233.015664 secs 2024-04-27T04:50:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:35 smithi092 ceph-mon[29156]: pgmap v20596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:37 smithi189 ceph-mon[32756]: pgmap v20597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:37 smithi156 ceph-mon[32679]: pgmap v20597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:37.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:37 smithi092 ceph-mon[29156]: pgmap v20597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:39.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:39 smithi189 ceph-mon[32756]: pgmap v20598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:39 smithi156 ceph-mon[32679]: pgmap v20598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:39 smithi092 ceph-mon[29156]: pgmap v20598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:40 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37935.051507 secs 2024-04-27T04:50:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37238.015747 secs 2024-04-27T04:50:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:40 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37935.051507 secs 2024-04-27T04:50:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37238.015747 secs 2024-04-27T04:50:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:40 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37935.051507 secs 2024-04-27T04:50:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37238.015747 secs 2024-04-27T04:50:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:41 smithi189 ceph-mon[32756]: pgmap v20599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:41 smithi156 ceph-mon[32679]: pgmap v20599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:41.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:41 smithi092 ceph-mon[29156]: pgmap v20599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:42 smithi189 ceph-mon[32756]: pgmap v20600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:42 smithi156 ceph-mon[32679]: pgmap v20600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:42.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:42 smithi092 ceph-mon[29156]: pgmap v20600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:45 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37940.051624 secs 2024-04-27T04:50:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37243.015865 secs 2024-04-27T04:50:45.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:45 smithi189 ceph-mon[32756]: pgmap v20601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:45 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37940.051624 secs 2024-04-27T04:50:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37243.015865 secs 2024-04-27T04:50:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:45 smithi156 ceph-mon[32679]: pgmap v20601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:45 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37940.051624 secs 2024-04-27T04:50:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37243.015865 secs 2024-04-27T04:50:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:45 smithi092 ceph-mon[29156]: pgmap v20601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:47 smithi189 ceph-mon[32756]: pgmap v20602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:47 smithi156 ceph-mon[32679]: pgmap v20602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:47.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:47 smithi092 ceph-mon[29156]: pgmap v20602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:49 smithi189 ceph-mon[32756]: pgmap v20603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:49 smithi156 ceph-mon[32679]: pgmap v20603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:49 smithi092 ceph-mon[29156]: pgmap v20603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:50:50.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:50 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37945.051762 secs 2024-04-27T04:50:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37248.015982 secs 2024-04-27T04:50:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:50 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37945.051762 secs 2024-04-27T04:50:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37248.015982 secs 2024-04-27T04:50:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:50 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37945.051762 secs 2024-04-27T04:50:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37248.015982 secs 2024-04-27T04:50:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:51 smithi189 ceph-mon[32756]: pgmap v20604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:50:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:50:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:50:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:50:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:51 smithi156 ceph-mon[32679]: pgmap v20604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:50:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:50:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:50:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:50:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:51 smithi092 ceph-mon[29156]: pgmap v20604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:50:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:50:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:50:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:50:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:50:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:52 smithi189 ceph-mon[32756]: pgmap v20605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:50:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:52 smithi189 ceph-mon[32756]: pgmap v20606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:52 smithi156 ceph-mon[32679]: pgmap v20605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:50:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:52 smithi156 ceph-mon[32679]: pgmap v20606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:52 smithi092 ceph-mon[29156]: pgmap v20605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:50:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:52 smithi092 ceph-mon[29156]: pgmap v20606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:54 smithi189 ceph-mon[32756]: pgmap v20607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:50:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:54 smithi156 ceph-mon[32679]: pgmap v20607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:50:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:54 smithi092 ceph-mon[29156]: pgmap v20607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:50:55.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37950.051904 secs 2024-04-27T04:50:55.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37253.016084 secs 2024-04-27T04:50:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37950.051904 secs 2024-04-27T04:50:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37253.016084 secs 2024-04-27T04:50:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37950.051904 secs 2024-04-27T04:50:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37253.016084 secs 2024-04-27T04:50:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:56 smithi189 ceph-mon[32756]: pgmap v20608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:56 smithi156 ceph-mon[32679]: pgmap v20608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:56 smithi092 ceph-mon[29156]: pgmap v20608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:50:58 smithi189 ceph-mon[32756]: pgmap v20609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:50:58 smithi156 ceph-mon[32679]: pgmap v20609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:50:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:50:58 smithi092 ceph-mon[29156]: pgmap v20609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37955.051995 secs 2024-04-27T04:51:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37258.016192 secs 2024-04-27T04:51:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:00 smithi189 ceph-mon[32756]: pgmap v20610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37955.051995 secs 2024-04-27T04:51:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37258.016192 secs 2024-04-27T04:51:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:00 smithi156 ceph-mon[32679]: pgmap v20610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37955.051995 secs 2024-04-27T04:51:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37258.016192 secs 2024-04-27T04:51:00.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:00 smithi092 ceph-mon[29156]: pgmap v20610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:02 smithi189 ceph-mon[32756]: pgmap v20611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:51:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:02 smithi156 ceph-mon[32679]: pgmap v20611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:51:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:02 smithi092 ceph-mon[29156]: pgmap v20611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:51:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:04 smithi189 ceph-mon[32756]: pgmap v20612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:04 smithi156 ceph-mon[32679]: pgmap v20612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:04 smithi092 ceph-mon[29156]: pgmap v20612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37960.052117 secs 2024-04-27T04:51:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37263.016308 secs 2024-04-27T04:51:05.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37960.052117 secs 2024-04-27T04:51:05.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37263.016308 secs 2024-04-27T04:51:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37960.052117 secs 2024-04-27T04:51:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37263.016308 secs 2024-04-27T04:51:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:06 smithi189 ceph-mon[32756]: pgmap v20613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:06 smithi156 ceph-mon[32679]: pgmap v20613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:06 smithi092 ceph-mon[29156]: pgmap v20613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:08 smithi189 ceph-mon[32756]: pgmap v20614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:08 smithi156 ceph-mon[32679]: pgmap v20614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:08 smithi092 ceph-mon[29156]: pgmap v20614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37965.052183 secs 2024-04-27T04:51:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37268.016421 secs 2024-04-27T04:51:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:10 smithi189 ceph-mon[32756]: pgmap v20615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37965.052183 secs 2024-04-27T04:51:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37268.016421 secs 2024-04-27T04:51:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:10 smithi156 ceph-mon[32679]: pgmap v20615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37965.052183 secs 2024-04-27T04:51:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37268.016421 secs 2024-04-27T04:51:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:10 smithi092 ceph-mon[29156]: pgmap v20615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:12 smithi189 ceph-mon[32756]: pgmap v20616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:12 smithi156 ceph-mon[32679]: pgmap v20616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:12 smithi092 ceph-mon[29156]: pgmap v20616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:13 smithi189 ceph-mon[32756]: pgmap v20617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:13 smithi156 ceph-mon[32679]: pgmap v20617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:13.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:13 smithi092 ceph-mon[29156]: pgmap v20617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:14 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37273.016528 secs 2024-04-27T04:51:15.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:14 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37273.016528 secs 2024-04-27T04:51:15.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:14 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37273.016528 secs 2024-04-27T04:51:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37970.052259 secs 2024-04-27T04:51:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:15 smithi189 ceph-mon[32756]: pgmap v20618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37970.052259 secs 2024-04-27T04:51:16.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:15 smithi156 ceph-mon[32679]: pgmap v20618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37970.052259 secs 2024-04-27T04:51:16.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:15 smithi092 ceph-mon[29156]: pgmap v20618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:18 smithi189 ceph-mon[32756]: pgmap v20619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:18 smithi156 ceph-mon[32679]: pgmap v20619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:18.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:18 smithi092 ceph-mon[29156]: pgmap v20619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37975.052395 secs 2024-04-27T04:51:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37278.016603 secs 2024-04-27T04:51:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:20 smithi189 ceph-mon[32756]: pgmap v20620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37975.052395 secs 2024-04-27T04:51:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37278.016603 secs 2024-04-27T04:51:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:20 smithi156 ceph-mon[32679]: pgmap v20620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37975.052395 secs 2024-04-27T04:51:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37278.016603 secs 2024-04-27T04:51:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:20 smithi092 ceph-mon[29156]: pgmap v20620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:22 smithi189 ceph-mon[32756]: pgmap v20621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:22.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:22 smithi156 ceph-mon[32679]: pgmap v20621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:22.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:22 smithi092 ceph-mon[29156]: pgmap v20621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:24 smithi189 ceph-mon[32756]: pgmap v20622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:24 smithi156 ceph-mon[32679]: pgmap v20622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:24 smithi092 ceph-mon[29156]: pgmap v20622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:25.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37980.052509 secs 2024-04-27T04:51:25.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37283.016746 secs 2024-04-27T04:51:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37980.052509 secs 2024-04-27T04:51:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37283.016746 secs 2024-04-27T04:51:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37980.052509 secs 2024-04-27T04:51:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37283.016746 secs 2024-04-27T04:51:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:26 smithi189 ceph-mon[32756]: pgmap v20623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:26 smithi156 ceph-mon[32679]: pgmap v20623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:26 smithi092 ceph-mon[29156]: pgmap v20623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:28 smithi189 ceph-mon[32756]: pgmap v20624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:28 smithi156 ceph-mon[32679]: pgmap v20624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:28.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:28 smithi092 ceph-mon[29156]: pgmap v20624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37985.052631 secs 2024-04-27T04:51:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37985.052631 secs 2024-04-27T04:51:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37985.052631 secs 2024-04-27T04:51:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37288.016861 secs 2024-04-27T04:51:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:30 smithi189 ceph-mon[32756]: pgmap v20625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37288.016861 secs 2024-04-27T04:51:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:30 smithi156 ceph-mon[32679]: pgmap v20625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37288.016861 secs 2024-04-27T04:51:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:30 smithi092 ceph-mon[29156]: pgmap v20625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:32 smithi189 ceph-mon[32756]: pgmap v20626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:32 smithi156 ceph-mon[32679]: pgmap v20626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:32 smithi092 ceph-mon[29156]: pgmap v20626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:34 smithi189 ceph-mon[32756]: pgmap v20627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37990.052745 secs 2024-04-27T04:51:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:34 smithi156 ceph-mon[32679]: pgmap v20627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37990.052745 secs 2024-04-27T04:51:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:34 smithi092 ceph-mon[29156]: pgmap v20627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37990.052745 secs 2024-04-27T04:51:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37293.016983 secs 2024-04-27T04:51:35.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37293.016983 secs 2024-04-27T04:51:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37293.016983 secs 2024-04-27T04:51:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:36 smithi189 ceph-mon[32756]: pgmap v20628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:36 smithi156 ceph-mon[32679]: pgmap v20628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:36.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:36 smithi092 ceph-mon[29156]: pgmap v20628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:38.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:38 smithi189 ceph-mon[32756]: pgmap v20629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:38 smithi156 ceph-mon[32679]: pgmap v20629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:38.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:38 smithi092 ceph-mon[29156]: pgmap v20629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 37995.052865 secs 2024-04-27T04:51:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 37995.052865 secs 2024-04-27T04:51:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 37995.052865 secs 2024-04-27T04:51:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37298.017098 secs 2024-04-27T04:51:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:40 smithi189 ceph-mon[32756]: pgmap v20630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37298.017098 secs 2024-04-27T04:51:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:40 smithi156 ceph-mon[32679]: pgmap v20630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37298.017098 secs 2024-04-27T04:51:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:40 smithi092 ceph-mon[29156]: pgmap v20630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:51:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:51:41.198+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:51:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:51:41.198+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:51:41.201 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:51:41.198+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:51:41.202 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:51:41.198+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 292 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:51:41.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:51:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:51:41.034+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:51:41.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:51:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:51:41.034+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:51:41.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:51:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:51:41.034+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:51:41.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:51:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:51:41.034+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:51:41.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:51:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:51:41.034+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:51:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:42 smithi189 ceph-mon[32756]: pgmap v20631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:42 smithi156 ceph-mon[32679]: pgmap v20631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:42.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:42 smithi092 ceph-mon[29156]: pgmap v20631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:44 smithi189 ceph-mon[32756]: pgmap v20632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:44.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38000.052974 secs 2024-04-27T04:51:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:44 smithi156 ceph-mon[32679]: pgmap v20632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38000.052974 secs 2024-04-27T04:51:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:44 smithi092 ceph-mon[29156]: pgmap v20632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:51:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38000.052974 secs 2024-04-27T04:51:45.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37303.017198 secs 2024-04-27T04:51:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37303.017198 secs 2024-04-27T04:51:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37303.017198 secs 2024-04-27T04:51:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:46 smithi189 ceph-mon[32756]: pgmap v20633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:46 smithi156 ceph-mon[32679]: pgmap v20633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:46 smithi092 ceph-mon[29156]: pgmap v20633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:48 smithi189 ceph-mon[32756]: pgmap v20634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:48.671 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:48 smithi092 ceph-mon[29156]: pgmap v20634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:48 smithi156 ceph-mon[32679]: pgmap v20634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38005.053068 secs 2024-04-27T04:51:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38005.053068 secs 2024-04-27T04:51:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38005.053068 secs 2024-04-27T04:51:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37308.017259 secs 2024-04-27T04:51:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:50 smithi189 ceph-mon[32756]: pgmap v20635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37308.017259 secs 2024-04-27T04:51:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:50 smithi156 ceph-mon[32679]: pgmap v20635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37308.017259 secs 2024-04-27T04:51:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:50 smithi092 ceph-mon[29156]: pgmap v20635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T04:51:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:51:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:51:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:51:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:52 smithi189 ceph-mon[32756]: pgmap v20636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:51:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:51:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:51:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:52 smithi156 ceph-mon[32679]: pgmap v20636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:51:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:51:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:51:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:52 smithi092 ceph-mon[29156]: pgmap v20636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T04:51:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:51:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:51:52.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:51:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:53 smithi189 ceph-mon[32756]: pgmap v20637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-27T04:51:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:53 smithi189 ceph-mon[32756]: pgmap v20638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T04:51:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:53 smithi156 ceph-mon[32679]: pgmap v20637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-27T04:51:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:53 smithi156 ceph-mon[32679]: pgmap v20638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T04:51:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:53 smithi092 ceph-mon[29156]: pgmap v20637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 190 B/s wr, 16 op/s 2024-04-27T04:51:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:53 smithi092 ceph-mon[29156]: pgmap v20638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 233 B/s wr, 20 op/s 2024-04-27T04:51:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38010.053212 secs 2024-04-27T04:51:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38010.053212 secs 2024-04-27T04:51:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38010.053212 secs 2024-04-27T04:51:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:55 smithi189 ceph-mon[32756]: pgmap v20639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37313.017380 secs 2024-04-27T04:51:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:55 smithi156 ceph-mon[32679]: pgmap v20639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:55.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37313.017380 secs 2024-04-27T04:51:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:55 smithi092 ceph-mon[29156]: pgmap v20639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37313.017380 secs 2024-04-27T04:51:57.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:57 smithi156 ceph-mon[32679]: pgmap v20640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:57 smithi092 ceph-mon[29156]: pgmap v20640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:57 smithi189 ceph-mon[32756]: pgmap v20640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:51:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:59 smithi156 ceph-mon[32679]: pgmap v20641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:51:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:51:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38015.053284 secs 2024-04-27T04:51:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:59 smithi092 ceph-mon[29156]: pgmap v20641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:51:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:51:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38015.053284 secs 2024-04-27T04:51:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:59 smithi189 ceph-mon[32756]: pgmap v20641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:51:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:51:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38015.053284 secs 2024-04-27T04:52:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37318.017503 secs 2024-04-27T04:52:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37318.017503 secs 2024-04-27T04:52:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37318.017503 secs 2024-04-27T04:52:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:01 smithi156 ceph-mon[32679]: pgmap v20642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:01 smithi092 ceph-mon[29156]: pgmap v20642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:01 smithi189 ceph-mon[32756]: pgmap v20642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:03 smithi156 ceph-mon[32679]: pgmap v20643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:52:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:03 smithi092 ceph-mon[29156]: pgmap v20643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:52:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:03 smithi189 ceph-mon[32756]: pgmap v20643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:52:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38020.053373 secs 2024-04-27T04:52:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38020.053373 secs 2024-04-27T04:52:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38020.053373 secs 2024-04-27T04:52:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:05 smithi156 ceph-mon[32679]: pgmap v20644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37323.017576 secs 2024-04-27T04:52:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:05 smithi092 ceph-mon[29156]: pgmap v20644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37323.017576 secs 2024-04-27T04:52:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:05 smithi189 ceph-mon[32756]: pgmap v20644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37323.017576 secs 2024-04-27T04:52:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:07 smithi156 ceph-mon[32679]: pgmap v20645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:07 smithi092 ceph-mon[29156]: pgmap v20645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:07 smithi189 ceph-mon[32756]: pgmap v20645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:09 smithi156 ceph-mon[32679]: pgmap v20646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38025.053486 secs 2024-04-27T04:52:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:09 smithi092 ceph-mon[29156]: pgmap v20646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38025.053486 secs 2024-04-27T04:52:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:09 smithi189 ceph-mon[32756]: pgmap v20646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38025.053486 secs 2024-04-27T04:52:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37328.017687 secs 2024-04-27T04:52:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37328.017687 secs 2024-04-27T04:52:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37328.017687 secs 2024-04-27T04:52:11.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:11 smithi156 ceph-mon[32679]: pgmap v20647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:11 smithi092 ceph-mon[29156]: pgmap v20647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:11 smithi189 ceph-mon[32756]: pgmap v20647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:13 smithi156 ceph-mon[32679]: pgmap v20648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:13 smithi092 ceph-mon[29156]: pgmap v20648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:13 smithi189 ceph-mon[32756]: pgmap v20648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T04:52:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38030.053605 secs 2024-04-27T04:52:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38030.053605 secs 2024-04-27T04:52:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38030.053605 secs 2024-04-27T04:52:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:15 smithi092 ceph-mon[29156]: pgmap v20649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37333.017835 secs 2024-04-27T04:52:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:15 smithi189 ceph-mon[32756]: pgmap v20649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:15.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37333.017835 secs 2024-04-27T04:52:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:15 smithi156 ceph-mon[32679]: pgmap v20649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T04:52:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37333.017835 secs 2024-04-27T04:52:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:17 smithi092 ceph-mon[29156]: pgmap v20650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:17 smithi189 ceph-mon[32756]: pgmap v20650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:17 smithi156 ceph-mon[32679]: pgmap v20650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:19 smithi092 ceph-mon[29156]: pgmap v20651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38035.053684 secs 2024-04-27T04:52:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:19 smithi189 ceph-mon[32756]: pgmap v20651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38035.053684 secs 2024-04-27T04:52:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:19 smithi156 ceph-mon[32679]: pgmap v20651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38035.053684 secs 2024-04-27T04:52:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37338.017961 secs 2024-04-27T04:52:20.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37338.017961 secs 2024-04-27T04:52:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37338.017961 secs 2024-04-27T04:52:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:21 smithi092 ceph-mon[29156]: pgmap v20652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:21 smithi189 ceph-mon[32756]: pgmap v20652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:21.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:21 smithi156 ceph-mon[32679]: pgmap v20652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:23.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:23 smithi092 ceph-mon[29156]: pgmap v20653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:23 smithi189 ceph-mon[32756]: pgmap v20653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:23.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:23 smithi156 ceph-mon[32679]: pgmap v20653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38040.053777 secs 2024-04-27T04:52:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38040.053777 secs 2024-04-27T04:52:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38040.053777 secs 2024-04-27T04:52:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:25 smithi092 ceph-mon[29156]: pgmap v20654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37343.018083 secs 2024-04-27T04:52:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:25 smithi156 ceph-mon[32679]: pgmap v20654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37343.018083 secs 2024-04-27T04:52:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:25 smithi189 ceph-mon[32756]: pgmap v20654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37343.018083 secs 2024-04-27T04:52:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:27 smithi092 ceph-mon[29156]: pgmap v20655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:27 smithi189 ceph-mon[32756]: pgmap v20655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:27.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:27 smithi156 ceph-mon[32679]: pgmap v20655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:29 smithi092 ceph-mon[29156]: pgmap v20656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38045.053926 secs 2024-04-27T04:52:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:29 smithi189 ceph-mon[32756]: pgmap v20656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38045.053926 secs 2024-04-27T04:52:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:29 smithi156 ceph-mon[32679]: pgmap v20656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38045.053926 secs 2024-04-27T04:52:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37348.018216 secs 2024-04-27T04:52:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37348.018216 secs 2024-04-27T04:52:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37348.018216 secs 2024-04-27T04:52:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:31 smithi092 ceph-mon[29156]: pgmap v20657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:31 smithi189 ceph-mon[32756]: pgmap v20657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:31 smithi156 ceph-mon[32679]: pgmap v20657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:33.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:33 smithi092 ceph-mon[29156]: pgmap v20658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:33 smithi189 ceph-mon[32756]: pgmap v20658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:33 smithi156 ceph-mon[32679]: pgmap v20658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38050.054052 secs 2024-04-27T04:52:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38050.054052 secs 2024-04-27T04:52:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38050.054052 secs 2024-04-27T04:52:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:35 smithi092 ceph-mon[29156]: pgmap v20659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37353.018339 secs 2024-04-27T04:52:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:35 smithi189 ceph-mon[32756]: pgmap v20659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37353.018339 secs 2024-04-27T04:52:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:35 smithi156 ceph-mon[32679]: pgmap v20659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37353.018339 secs 2024-04-27T04:52:37.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:37 smithi092 ceph-mon[29156]: pgmap v20660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:37 smithi189 ceph-mon[32756]: pgmap v20660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:37.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:37 smithi156 ceph-mon[32679]: pgmap v20660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:39 smithi092 ceph-mon[29156]: pgmap v20661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38055.054144 secs 2024-04-27T04:52:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:39 smithi189 ceph-mon[32756]: pgmap v20661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38055.054144 secs 2024-04-27T04:52:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:39 smithi156 ceph-mon[32679]: pgmap v20661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38055.054144 secs 2024-04-27T04:52:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37358.018416 secs 2024-04-27T04:52:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37358.018416 secs 2024-04-27T04:52:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37358.018416 secs 2024-04-27T04:52:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:41 smithi189 ceph-mon[32756]: pgmap v20662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:41.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:41 smithi156 ceph-mon[32679]: pgmap v20662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:41.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:41 smithi092 ceph-mon[29156]: pgmap v20662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:43 smithi189 ceph-mon[32756]: pgmap v20663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:43.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:43 smithi156 ceph-mon[32679]: pgmap v20663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:43.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:43 smithi092 ceph-mon[29156]: pgmap v20663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38060.054269 secs 2024-04-27T04:52:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38060.054269 secs 2024-04-27T04:52:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38060.054269 secs 2024-04-27T04:52:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:45 smithi189 ceph-mon[32756]: pgmap v20664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:45 smithi189 ceph-mon[32756]: 30 slow requests, 1 included below; oldest blocked for > 37363.018494 secs 2024-04-27T04:52:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:45 smithi189 ceph-mon[32756]: slow request 2883.953900 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:52:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:45 smithi156 ceph-mon[32679]: pgmap v20664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:45 smithi156 ceph-mon[32679]: 30 slow requests, 1 included below; oldest blocked for > 37363.018494 secs 2024-04-27T04:52:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:45 smithi156 ceph-mon[32679]: slow request 2883.953900 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:52:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:45 smithi092 ceph-mon[29156]: pgmap v20664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:45 smithi092 ceph-mon[29156]: 30 slow requests, 1 included below; oldest blocked for > 37363.018494 secs 2024-04-27T04:52:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:45 smithi092 ceph-mon[29156]: slow request 2883.953900 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:52:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:47 smithi189 ceph-mon[32756]: pgmap v20665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:47 smithi156 ceph-mon[32679]: pgmap v20665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:47 smithi092 ceph-mon[29156]: pgmap v20665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:49 smithi189 ceph-mon[32756]: pgmap v20666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38065.054381 secs 2024-04-27T04:52:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:49 smithi156 ceph-mon[32679]: pgmap v20666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38065.054381 secs 2024-04-27T04:52:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:49 smithi092 ceph-mon[29156]: pgmap v20666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38065.054381 secs 2024-04-27T04:52:50.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37368.018612 secs 2024-04-27T04:52:50.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37368.018612 secs 2024-04-27T04:52:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37368.018612 secs 2024-04-27T04:52:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:51 smithi189 ceph-mon[32756]: pgmap v20667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:51.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:51 smithi156 ceph-mon[32679]: pgmap v20667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:51.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:51 smithi092 ceph-mon[29156]: pgmap v20667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:52:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:52 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:52:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:52 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:52:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:52 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:52:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:53 smithi189 ceph-mon[32756]: pgmap v20668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:52:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:52:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:52:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:53 smithi156 ceph-mon[32679]: pgmap v20668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:52:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:52:53.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:52:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:53 smithi092 ceph-mon[29156]: pgmap v20668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:52:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:52:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:52:53.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:52:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:54 smithi189 ceph-mon[32756]: pgmap v20669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:52:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:54 smithi189 ceph-mon[32756]: pgmap v20670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:52:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38070.054496 secs 2024-04-27T04:52:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:54 smithi156 ceph-mon[32679]: pgmap v20669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:52:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:54 smithi156 ceph-mon[32679]: pgmap v20670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:52:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38070.054496 secs 2024-04-27T04:52:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:54 smithi092 ceph-mon[29156]: pgmap v20669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:52:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:54 smithi092 ceph-mon[29156]: pgmap v20670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:52:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38070.054496 secs 2024-04-27T04:52:55.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37373.018730 secs 2024-04-27T04:52:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37373.018730 secs 2024-04-27T04:52:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37373.018730 secs 2024-04-27T04:52:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:56 smithi189 ceph-mon[32756]: pgmap v20671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:56 smithi156 ceph-mon[32679]: pgmap v20671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:56 smithi092 ceph-mon[29156]: pgmap v20671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:58 smithi189 ceph-mon[32756]: pgmap v20672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:58 smithi156 ceph-mon[32679]: pgmap v20672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:58 smithi092 ceph-mon[29156]: pgmap v20672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:52:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:52:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38075.054628 secs 2024-04-27T04:52:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:52:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38075.054628 secs 2024-04-27T04:52:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:52:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38075.054628 secs 2024-04-27T04:53:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:00 smithi189 ceph-mon[32756]: pgmap v20673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37378.018842 secs 2024-04-27T04:53:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:00 smithi156 ceph-mon[32679]: pgmap v20673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37378.018842 secs 2024-04-27T04:53:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:00 smithi092 ceph-mon[29156]: pgmap v20673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37378.018842 secs 2024-04-27T04:53:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:02 smithi189 ceph-mon[32756]: pgmap v20674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:02 smithi156 ceph-mon[32679]: pgmap v20674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:02 smithi092 ceph-mon[29156]: pgmap v20674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:53:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:04 smithi189 ceph-mon[32756]: pgmap v20675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:53:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38080.054780 secs 2024-04-27T04:53:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:04 smithi156 ceph-mon[32679]: pgmap v20675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:53:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38080.054780 secs 2024-04-27T04:53:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:04 smithi092 ceph-mon[29156]: pgmap v20675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:53:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38080.054780 secs 2024-04-27T04:53:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37383.018971 secs 2024-04-27T04:53:05.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37383.018971 secs 2024-04-27T04:53:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37383.018971 secs 2024-04-27T04:53:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:06 smithi189 ceph-mon[32756]: pgmap v20676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:06 smithi156 ceph-mon[32679]: pgmap v20676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:06 smithi092 ceph-mon[29156]: pgmap v20676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:08 smithi189 ceph-mon[32756]: pgmap v20677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:08 smithi156 ceph-mon[32679]: pgmap v20677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:08 smithi092 ceph-mon[29156]: pgmap v20677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38085.054909 secs 2024-04-27T04:53:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38085.054909 secs 2024-04-27T04:53:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38085.054909 secs 2024-04-27T04:53:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:10 smithi189 ceph-mon[32756]: pgmap v20678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37388.019108 secs 2024-04-27T04:53:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:10 smithi156 ceph-mon[32679]: pgmap v20678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37388.019108 secs 2024-04-27T04:53:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:10 smithi092 ceph-mon[29156]: pgmap v20678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37388.019108 secs 2024-04-27T04:53:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:12 smithi189 ceph-mon[32756]: pgmap v20679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:12 smithi156 ceph-mon[32679]: pgmap v20679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:12 smithi092 ceph-mon[29156]: pgmap v20679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:14 smithi189 ceph-mon[32756]: pgmap v20680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38090.055033 secs 2024-04-27T04:53:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:14 smithi156 ceph-mon[32679]: pgmap v20680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38090.055033 secs 2024-04-27T04:53:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:14 smithi092 ceph-mon[29156]: pgmap v20680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38090.055033 secs 2024-04-27T04:53:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37393.019227 secs 2024-04-27T04:53:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37393.019227 secs 2024-04-27T04:53:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37393.019227 secs 2024-04-27T04:53:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:16 smithi189 ceph-mon[32756]: pgmap v20681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:16 smithi156 ceph-mon[32679]: pgmap v20681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:16 smithi092 ceph-mon[29156]: pgmap v20681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:17 smithi189 ceph-mon[32756]: pgmap v20682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:17.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:17 smithi156 ceph-mon[32679]: pgmap v20682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:17.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:17 smithi092 ceph-mon[29156]: pgmap v20682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:19 smithi189 ceph-mon[32756]: pgmap v20683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38095.055165 secs 2024-04-27T04:53:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:19 smithi156 ceph-mon[32679]: pgmap v20683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38095.055165 secs 2024-04-27T04:53:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:19 smithi092 ceph-mon[29156]: pgmap v20683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38095.055165 secs 2024-04-27T04:53:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37398.019346 secs 2024-04-27T04:53:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37398.019346 secs 2024-04-27T04:53:21.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37398.019346 secs 2024-04-27T04:53:22.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:21 smithi189 ceph-mon[32756]: pgmap v20684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:22.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:21 smithi092 ceph-mon[29156]: pgmap v20684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:22.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:21 smithi156 ceph-mon[32679]: pgmap v20684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:24.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:23 smithi189 ceph-mon[32756]: pgmap v20685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:24.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:23 smithi156 ceph-mon[32679]: pgmap v20685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:24.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:23 smithi092 ceph-mon[29156]: pgmap v20685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38100.055275 secs 2024-04-27T04:53:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:24 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37403.019433 secs 2024-04-27T04:53:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38100.055275 secs 2024-04-27T04:53:25.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:24 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37403.019433 secs 2024-04-27T04:53:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38100.055275 secs 2024-04-27T04:53:25.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:24 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37403.019433 secs 2024-04-27T04:53:26.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:25 smithi189 ceph-mon[32756]: pgmap v20686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:26.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:25 smithi156 ceph-mon[32679]: pgmap v20686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:26.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:25 smithi092 ceph-mon[29156]: pgmap v20686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:27 smithi189 ceph-mon[32756]: pgmap v20687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:28.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:27 smithi156 ceph-mon[32679]: pgmap v20687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:28.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:27 smithi092 ceph-mon[29156]: pgmap v20687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:29 smithi189 ceph-mon[32756]: pgmap v20688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38105.055397 secs 2024-04-27T04:53:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:29 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37408.019524 secs 2024-04-27T04:53:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:29 smithi156 ceph-mon[32679]: pgmap v20688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38105.055397 secs 2024-04-27T04:53:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:29 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37408.019524 secs 2024-04-27T04:53:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:29 smithi092 ceph-mon[29156]: pgmap v20688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38105.055397 secs 2024-04-27T04:53:30.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:29 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37408.019524 secs 2024-04-27T04:53:32.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:31 smithi189 ceph-mon[32756]: pgmap v20689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:32.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:31 smithi156 ceph-mon[32679]: pgmap v20689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:32.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:31 smithi092 ceph-mon[29156]: pgmap v20689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:34.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:33 smithi189 ceph-mon[32756]: pgmap v20690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:34.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:33 smithi156 ceph-mon[32679]: pgmap v20690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:34.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:33 smithi092 ceph-mon[29156]: pgmap v20690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38110.055541 secs 2024-04-27T04:53:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:34 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37413.019664 secs 2024-04-27T04:53:35.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38110.055541 secs 2024-04-27T04:53:35.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:34 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37413.019664 secs 2024-04-27T04:53:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38110.055541 secs 2024-04-27T04:53:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:34 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37413.019664 secs 2024-04-27T04:53:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:35 smithi189 ceph-mon[32756]: pgmap v20691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:36.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:35 smithi156 ceph-mon[32679]: pgmap v20691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:36.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:35 smithi092 ceph-mon[29156]: pgmap v20691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:37.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:37 smithi092 ceph-mon[29156]: pgmap v20692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:37 smithi189 ceph-mon[32756]: pgmap v20692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:38.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:37 smithi156 ceph-mon[32679]: pgmap v20692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:39.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38115.055681 secs 2024-04-27T04:53:39.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38115.055681 secs 2024-04-27T04:53:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38115.055681 secs 2024-04-27T04:53:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:40 smithi189 ceph-mon[32756]: pgmap v20693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:40.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37418.019748 secs 2024-04-27T04:53:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:40 smithi156 ceph-mon[32679]: pgmap v20693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:40.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37418.019748 secs 2024-04-27T04:53:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:40 smithi092 ceph-mon[29156]: pgmap v20693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37418.019748 secs 2024-04-27T04:53:42.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:42 smithi189 ceph-mon[32756]: pgmap v20694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:42.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:42 smithi156 ceph-mon[32679]: pgmap v20694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:42.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:42 smithi092 ceph-mon[29156]: pgmap v20694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:44 smithi189 ceph-mon[32756]: pgmap v20695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38120.055853 secs 2024-04-27T04:53:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:44 smithi156 ceph-mon[32679]: pgmap v20695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38120.055853 secs 2024-04-27T04:53:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:44 smithi092 ceph-mon[29156]: pgmap v20695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38120.055853 secs 2024-04-27T04:53:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:45 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37423.019858 secs 2024-04-27T04:53:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:45 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37423.019858 secs 2024-04-27T04:53:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:45 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37423.019858 secs 2024-04-27T04:53:46.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:46 smithi189 ceph-mon[32756]: pgmap v20696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:46.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:46 smithi156 ceph-mon[32679]: pgmap v20696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:46.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:46 smithi092 ceph-mon[29156]: pgmap v20696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:48.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:48 smithi189 ceph-mon[32756]: pgmap v20697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:48.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:48 smithi156 ceph-mon[32679]: pgmap v20697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:48.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:48 smithi092 ceph-mon[29156]: pgmap v20697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:49.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38125.055972 secs 2024-04-27T04:53:49.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38125.055972 secs 2024-04-27T04:53:49.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38125.055972 secs 2024-04-27T04:53:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:50 smithi189 ceph-mon[32756]: pgmap v20698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:50.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:50 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37428.019923 secs 2024-04-27T04:53:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:50 smithi156 ceph-mon[32679]: pgmap v20698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:50.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:50 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37428.019923 secs 2024-04-27T04:53:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:50 smithi092 ceph-mon[29156]: pgmap v20698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:50 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37428.019923 secs 2024-04-27T04:53:52.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:52 smithi189 ceph-mon[32756]: pgmap v20699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:52.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:52 smithi156 ceph-mon[32679]: pgmap v20699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:52.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:52 smithi092 ceph-mon[29156]: pgmap v20699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:53.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:53 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:53:53.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:53 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:53:53.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:53 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: pgmap v20700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.687 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38130.056041 secs 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: pgmap v20700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38130.056041 secs 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: pgmap v20700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:54.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38130.056041 secs 2024-04-27T04:53:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:55 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37433.020043 secs 2024-04-27T04:53:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:55 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37433.020043 secs 2024-04-27T04:53:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:55 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37433.020043 secs 2024-04-27T04:53:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.219 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:53:56.217+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:53:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:53:56.217+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:53:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:53:56.217+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:53:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:53:56.217+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 293 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:53:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: pgmap v20701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: pgmap v20701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: pgmap v20701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:56.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:53:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:53:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:53:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:53:57.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:53:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:53:57.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:53:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:53:57.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:53:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:58 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:53:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:58 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:58 smithi189 ceph-mon[32756]: pgmap v20702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:58 smithi189 ceph-mon[32756]: pgmap v20703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:53:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:58 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:53:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:58 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:58.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:58 smithi156 ceph-mon[32679]: pgmap v20702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:58.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:58 smithi156 ceph-mon[32679]: pgmap v20703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:53:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:58 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T04:53:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:58 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T04:53:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:58 smithi092 ceph-mon[29156]: pgmap v20702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:53:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:58 smithi092 ceph-mon[29156]: pgmap v20703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:53:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:53:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38135.056159 secs 2024-04-27T04:53:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:53:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38135.056159 secs 2024-04-27T04:53:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:53:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38135.056159 secs 2024-04-27T04:54:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:00 smithi189 ceph-mon[32756]: pgmap v20704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:00 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37438.020125 secs 2024-04-27T04:54:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:00 smithi156 ceph-mon[32679]: pgmap v20704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:00 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37438.020125 secs 2024-04-27T04:54:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:00 smithi092 ceph-mon[29156]: pgmap v20704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:00 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37438.020125 secs 2024-04-27T04:54:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:02 smithi189 ceph-mon[32756]: pgmap v20705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:02 smithi156 ceph-mon[32679]: pgmap v20705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:02 smithi092 ceph-mon[29156]: pgmap v20705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:04 smithi189 ceph-mon[32756]: pgmap v20706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38140.056256 secs 2024-04-27T04:54:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:04 smithi156 ceph-mon[32679]: pgmap v20706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38140.056256 secs 2024-04-27T04:54:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:04 smithi092 ceph-mon[29156]: pgmap v20706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38140.056256 secs 2024-04-27T04:54:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:05 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37443.020267 secs 2024-04-27T04:54:05.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:05 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37443.020267 secs 2024-04-27T04:54:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:05 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37443.020267 secs 2024-04-27T04:54:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:06 smithi189 ceph-mon[32756]: pgmap v20707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:06.909 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:06 smithi092 ceph-mon[29156]: pgmap v20707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:06 smithi156 ceph-mon[32679]: pgmap v20707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s 2024-04-27T04:54:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:08 smithi189 ceph-mon[32756]: pgmap v20708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:54:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:08 smithi156 ceph-mon[32679]: pgmap v20708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:54:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:08 smithi092 ceph-mon[29156]: pgmap v20708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:54:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38145.056367 secs 2024-04-27T04:54:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38145.056367 secs 2024-04-27T04:54:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38145.056367 secs 2024-04-27T04:54:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:10 smithi189 ceph-mon[32756]: pgmap v20709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:10 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37448.020378 secs 2024-04-27T04:54:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:10 smithi156 ceph-mon[32679]: pgmap v20709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:10 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37448.020378 secs 2024-04-27T04:54:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:10 smithi092 ceph-mon[29156]: pgmap v20709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:10 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37448.020378 secs 2024-04-27T04:54:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:12 smithi189 ceph-mon[32756]: pgmap v20710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:12 smithi156 ceph-mon[32679]: pgmap v20710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:12 smithi092 ceph-mon[29156]: pgmap v20710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:14 smithi189 ceph-mon[32756]: pgmap v20711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38150.056462 secs 2024-04-27T04:54:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:14 smithi156 ceph-mon[32679]: pgmap v20711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38150.056462 secs 2024-04-27T04:54:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:14 smithi092 ceph-mon[29156]: pgmap v20711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38150.056462 secs 2024-04-27T04:54:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:15 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37453.020501 secs 2024-04-27T04:54:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:15 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37453.020501 secs 2024-04-27T04:54:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:15 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37453.020501 secs 2024-04-27T04:54:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:16 smithi189 ceph-mon[32756]: pgmap v20712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:16 smithi156 ceph-mon[32679]: pgmap v20712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:16 smithi092 ceph-mon[29156]: pgmap v20712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:18 smithi189 ceph-mon[32756]: pgmap v20713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:18 smithi156 ceph-mon[32679]: pgmap v20713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:18 smithi092 ceph-mon[29156]: pgmap v20713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38155.056576 secs 2024-04-27T04:54:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38155.056576 secs 2024-04-27T04:54:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38155.056576 secs 2024-04-27T04:54:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:20 smithi189 ceph-mon[32756]: pgmap v20714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:20 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37458.020584 secs 2024-04-27T04:54:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:20 smithi156 ceph-mon[32679]: pgmap v20714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:20 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37458.020584 secs 2024-04-27T04:54:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:20 smithi092 ceph-mon[29156]: pgmap v20714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:20 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37458.020584 secs 2024-04-27T04:54:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:22 smithi189 ceph-mon[32756]: pgmap v20715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:22 smithi156 ceph-mon[32679]: pgmap v20715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:22 smithi092 ceph-mon[29156]: pgmap v20715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:24 smithi189 ceph-mon[32756]: pgmap v20716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38160.056666 secs 2024-04-27T04:54:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:24 smithi156 ceph-mon[32679]: pgmap v20716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38160.056666 secs 2024-04-27T04:54:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:24 smithi092 ceph-mon[29156]: pgmap v20716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38160.056666 secs 2024-04-27T04:54:25.856 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:25 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37463.020645 secs 2024-04-27T04:54:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:25 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37463.020645 secs 2024-04-27T04:54:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:25 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37463.020645 secs 2024-04-27T04:54:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:26 smithi189 ceph-mon[32756]: pgmap v20717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:26.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:26 smithi156 ceph-mon[32679]: pgmap v20717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:26 smithi092 ceph-mon[29156]: pgmap v20717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:28 smithi189 ceph-mon[32756]: pgmap v20718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:28.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:28 smithi156 ceph-mon[32679]: pgmap v20718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:28.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:28 smithi092 ceph-mon[29156]: pgmap v20718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38165.056803 secs 2024-04-27T04:54:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38165.056803 secs 2024-04-27T04:54:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38165.056803 secs 2024-04-27T04:54:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:30 smithi189 ceph-mon[32756]: pgmap v20719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:30 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37468.020779 secs 2024-04-27T04:54:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:30 smithi156 ceph-mon[32679]: pgmap v20719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:30 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37468.020779 secs 2024-04-27T04:54:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:30 smithi092 ceph-mon[29156]: pgmap v20719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:30 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37468.020779 secs 2024-04-27T04:54:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:31 smithi189 ceph-mon[32756]: pgmap v20720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:31.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:31 smithi156 ceph-mon[32679]: pgmap v20720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:31.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:31 smithi092 ceph-mon[29156]: pgmap v20720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:33 smithi092 ceph-mon[29156]: pgmap v20721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:34.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:33 smithi189 ceph-mon[32756]: pgmap v20721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:34.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:33 smithi156 ceph-mon[32679]: pgmap v20721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38170.056943 secs 2024-04-27T04:54:35.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38170.056943 secs 2024-04-27T04:54:35.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38170.056943 secs 2024-04-27T04:54:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:35 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37473.020894 secs 2024-04-27T04:54:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:35 smithi189 ceph-mon[32756]: pgmap v20722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:36.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:35 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37473.020894 secs 2024-04-27T04:54:36.147 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:35 smithi092 ceph-mon[29156]: pgmap v20722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:36.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:35 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37473.020894 secs 2024-04-27T04:54:36.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:35 smithi156 ceph-mon[32679]: pgmap v20722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:37 smithi189 ceph-mon[32756]: pgmap v20723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:38.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:37 smithi156 ceph-mon[32679]: pgmap v20723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:37 smithi092 ceph-mon[29156]: pgmap v20723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:39 smithi092 ceph-mon[29156]: pgmap v20724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38175.057086 secs 2024-04-27T04:54:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:39 smithi189 ceph-mon[32756]: pgmap v20724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38175.057086 secs 2024-04-27T04:54:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:39 smithi156 ceph-mon[32679]: pgmap v20724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:40.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38175.057086 secs 2024-04-27T04:54:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:40 smithi189 ceph-mon[32756]: 30 slow requests, 0 included below; oldest blocked for > 37478.021012 secs 2024-04-27T04:54:41.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:40 smithi156 ceph-mon[32679]: 30 slow requests, 0 included below; oldest blocked for > 37478.021012 secs 2024-04-27T04:54:41.225 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:54:41.222+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:54:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:54:41.222+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:54:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:54:41.223+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:54:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:54:41.223+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 294 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:54:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:40 smithi092 ceph-mon[29156]: 30 slow requests, 0 included below; oldest blocked for > 37478.021012 secs 2024-04-27T04:54:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:41 smithi189 ceph-mon[32756]: pgmap v20725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:42.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:41 smithi156 ceph-mon[32679]: pgmap v20725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:42.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:41 smithi092 ceph-mon[29156]: pgmap v20725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:43 smithi189 ceph-mon[32756]: pgmap v20726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:44.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:43 smithi156 ceph-mon[32679]: pgmap v20726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:44.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:43 smithi092 ceph-mon[29156]: pgmap v20726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38180.057204 secs 2024-04-27T04:54:45.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38180.057204 secs 2024-04-27T04:54:45.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38180.057204 secs 2024-04-27T04:54:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:45 smithi189 ceph-mon[32756]: 31 slow requests, 2 included below; oldest blocked for > 37483.021131 secs 2024-04-27T04:54:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:45 smithi189 ceph-mon[32756]: slow request 1443.463642 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:54:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:45 smithi189 ceph-mon[32756]: slow request 183.125509 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:54:46.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:45 smithi189 ceph-mon[32756]: pgmap v20727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:45 smithi156 ceph-mon[32679]: 31 slow requests, 2 included below; oldest blocked for > 37483.021131 secs 2024-04-27T04:54:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:45 smithi156 ceph-mon[32679]: slow request 1443.463642 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:54:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:45 smithi156 ceph-mon[32679]: slow request 183.125509 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:54:46.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:45 smithi156 ceph-mon[32679]: pgmap v20727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:45 smithi092 ceph-mon[29156]: 31 slow requests, 2 included below; oldest blocked for > 37483.021131 secs 2024-04-27T04:54:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:45 smithi092 ceph-mon[29156]: slow request 1443.463642 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:54:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:45 smithi092 ceph-mon[29156]: slow request 183.125509 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T04:54:46.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:45 smithi092 ceph-mon[29156]: pgmap v20727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:54:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:54:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:54:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T04:54:47.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T04:54:48.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:47 smithi189 ceph-mon[32756]: pgmap v20728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:48.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:47 smithi156 ceph-mon[32679]: pgmap v20728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:48.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:47 smithi092 ceph-mon[29156]: pgmap v20728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:49 smithi189 ceph-mon[32756]: pgmap v20729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38185.057284 secs 2024-04-27T04:54:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:49 smithi156 ceph-mon[32679]: pgmap v20729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38185.057284 secs 2024-04-27T04:54:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:49 smithi092 ceph-mon[29156]: pgmap v20729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:50.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38185.057284 secs 2024-04-27T04:54:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37488.021266 secs 2024-04-27T04:54:51.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37488.021266 secs 2024-04-27T04:54:51.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37488.021266 secs 2024-04-27T04:54:52.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:51 smithi189 ceph-mon[32756]: pgmap v20730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:52.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:51 smithi156 ceph-mon[32679]: pgmap v20730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:52.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:51 smithi092 ceph-mon[29156]: pgmap v20730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:54.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:53 smithi189 ceph-mon[32756]: pgmap v20731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:54.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:53 smithi156 ceph-mon[32679]: pgmap v20731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:54.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:53 smithi092 ceph-mon[29156]: pgmap v20731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:55.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38190.057419 secs 2024-04-27T04:54:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38190.057419 secs 2024-04-27T04:54:55.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38190.057419 secs 2024-04-27T04:54:56.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37493.021366 secs 2024-04-27T04:54:56.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:55 smithi189 ceph-mon[32756]: pgmap v20732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:56.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37493.021366 secs 2024-04-27T04:54:56.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:55 smithi156 ceph-mon[32679]: pgmap v20732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:56.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37493.021366 secs 2024-04-27T04:54:56.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:55 smithi092 ceph-mon[29156]: pgmap v20732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:54:58.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: pgmap v20733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:58.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:54:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:54:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:54:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: pgmap v20734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:54:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: pgmap v20735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:54:58.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: pgmap v20733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: pgmap v20734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: pgmap v20735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:54:58.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: pgmap v20733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: pgmap v20734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: pgmap v20735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:54:58.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:54:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:54:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38195.057552 secs 2024-04-27T04:54:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:54:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38195.057552 secs 2024-04-27T04:54:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:54:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38195.057552 secs 2024-04-27T04:55:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37498.021488 secs 2024-04-27T04:55:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:00 smithi189 ceph-mon[32756]: pgmap v20736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37498.021488 secs 2024-04-27T04:55:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:00 smithi156 ceph-mon[32679]: pgmap v20736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37498.021488 secs 2024-04-27T04:55:00.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:00 smithi092 ceph-mon[29156]: pgmap v20736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:02 smithi189 ceph-mon[32756]: pgmap v20737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:02 smithi156 ceph-mon[32679]: pgmap v20737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:02 smithi092 ceph-mon[29156]: pgmap v20737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:04 smithi189 ceph-mon[32756]: pgmap v20738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38200.057654 secs 2024-04-27T04:55:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:04 smithi156 ceph-mon[32679]: pgmap v20738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38200.057654 secs 2024-04-27T04:55:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:04 smithi092 ceph-mon[29156]: pgmap v20738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38200.057654 secs 2024-04-27T04:55:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37503.021610 secs 2024-04-27T04:55:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37503.021610 secs 2024-04-27T04:55:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37503.021610 secs 2024-04-27T04:55:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:06 smithi189 ceph-mon[32756]: pgmap v20739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:06.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:06 smithi092 ceph-mon[29156]: pgmap v20739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:06.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:06 smithi156 ceph-mon[32679]: pgmap v20739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:55:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:08 smithi189 ceph-mon[32756]: pgmap v20740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:55:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:08 smithi156 ceph-mon[32679]: pgmap v20740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:55:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:08 smithi092 ceph-mon[29156]: pgmap v20740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:55:09.887 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38205.057790 secs 2024-04-27T04:55:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38205.057790 secs 2024-04-27T04:55:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38205.057790 secs 2024-04-27T04:55:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:10 smithi189 ceph-mon[32756]: 31 slow requests, 1 included below; oldest blocked for > 37508.021725 secs 2024-04-27T04:55:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:10 smithi189 ceph-mon[32756]: slow request 11521.235136 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:55:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:10 smithi189 ceph-mon[32756]: pgmap v20741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:10 smithi156 ceph-mon[32679]: 31 slow requests, 1 included below; oldest blocked for > 37508.021725 secs 2024-04-27T04:55:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:10 smithi156 ceph-mon[32679]: slow request 11521.235136 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:55:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:10 smithi156 ceph-mon[32679]: pgmap v20741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:10 smithi092 ceph-mon[29156]: 31 slow requests, 1 included below; oldest blocked for > 37508.021725 secs 2024-04-27T04:55:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:10 smithi092 ceph-mon[29156]: slow request 11521.235136 seconds old, received at 2024-04-27T01:43:07.932622+0000: client_request(client.17343:1 getattr pAsLsXsFs #0x1 2024-04-27T01:43:07.928621+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:55:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:10 smithi092 ceph-mon[29156]: pgmap v20741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:12 smithi189 ceph-mon[32756]: pgmap v20742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:12 smithi156 ceph-mon[32679]: pgmap v20742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:12 smithi092 ceph-mon[29156]: pgmap v20742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:14 smithi189 ceph-mon[32756]: pgmap v20743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38210.057900 secs 2024-04-27T04:55:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:14 smithi156 ceph-mon[32679]: pgmap v20743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38210.057900 secs 2024-04-27T04:55:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:14 smithi092 ceph-mon[29156]: pgmap v20743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:14.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38210.057900 secs 2024-04-27T04:55:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37513.021862 secs 2024-04-27T04:55:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37513.021862 secs 2024-04-27T04:55:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37513.021862 secs 2024-04-27T04:55:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:16 smithi189 ceph-mon[32756]: pgmap v20744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:16.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:16 smithi156 ceph-mon[32679]: pgmap v20744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:16 smithi092 ceph-mon[29156]: pgmap v20744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:18 smithi189 ceph-mon[32756]: pgmap v20745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:18 smithi156 ceph-mon[32679]: pgmap v20745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:18 smithi092 ceph-mon[29156]: pgmap v20745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38215.058014 secs 2024-04-27T04:55:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38215.058014 secs 2024-04-27T04:55:19.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38215.058014 secs 2024-04-27T04:55:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37518.021976 secs 2024-04-27T04:55:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:20 smithi189 ceph-mon[32756]: pgmap v20746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37518.021976 secs 2024-04-27T04:55:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:20 smithi156 ceph-mon[32679]: pgmap v20746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37518.021976 secs 2024-04-27T04:55:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:20 smithi092 ceph-mon[29156]: pgmap v20746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:22 smithi189 ceph-mon[32756]: pgmap v20747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:22 smithi156 ceph-mon[32679]: pgmap v20747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:22 smithi092 ceph-mon[29156]: pgmap v20747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:24 smithi189 ceph-mon[32756]: pgmap v20748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38220.058132 secs 2024-04-27T04:55:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:24 smithi156 ceph-mon[32679]: pgmap v20748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38220.058132 secs 2024-04-27T04:55:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:24 smithi092 ceph-mon[29156]: pgmap v20748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38220.058132 secs 2024-04-27T04:55:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37523.022103 secs 2024-04-27T04:55:25.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37523.022103 secs 2024-04-27T04:55:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37523.022103 secs 2024-04-27T04:55:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:26 smithi189 ceph-mon[32756]: pgmap v20749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:26.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:26 smithi156 ceph-mon[32679]: pgmap v20749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:26 smithi092 ceph-mon[29156]: pgmap v20749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:28 smithi189 ceph-mon[32756]: pgmap v20750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:28.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:28 smithi156 ceph-mon[32679]: pgmap v20750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:28.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:28 smithi092 ceph-mon[29156]: pgmap v20750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38225.058228 secs 2024-04-27T04:55:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38225.058228 secs 2024-04-27T04:55:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38225.058228 secs 2024-04-27T04:55:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37528.022224 secs 2024-04-27T04:55:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:30 smithi189 ceph-mon[32756]: pgmap v20751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37528.022224 secs 2024-04-27T04:55:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:30 smithi156 ceph-mon[32679]: pgmap v20751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37528.022224 secs 2024-04-27T04:55:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:30 smithi092 ceph-mon[29156]: pgmap v20751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:32 smithi189 ceph-mon[32756]: pgmap v20752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:32.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:32 smithi156 ceph-mon[32679]: pgmap v20752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:32.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:32 smithi092 ceph-mon[29156]: pgmap v20752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:33 smithi189 ceph-mon[32756]: pgmap v20753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:33.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:33 smithi156 ceph-mon[32679]: pgmap v20753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:33.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:33 smithi092 ceph-mon[29156]: pgmap v20753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38230.058325 secs 2024-04-27T04:55:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38230.058325 secs 2024-04-27T04:55:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38230.058325 secs 2024-04-27T04:55:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37533.022345 secs 2024-04-27T04:55:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:35 smithi189 ceph-mon[32756]: pgmap v20754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37533.022345 secs 2024-04-27T04:55:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:35 smithi156 ceph-mon[32679]: pgmap v20754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37533.022345 secs 2024-04-27T04:55:35.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:35 smithi092 ceph-mon[29156]: pgmap v20754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:38 smithi189 ceph-mon[32756]: pgmap v20755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:38.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:38 smithi156 ceph-mon[32679]: pgmap v20755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:38.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:38 smithi092 ceph-mon[29156]: pgmap v20755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38235.058435 secs 2024-04-27T04:55:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38235.058435 secs 2024-04-27T04:55:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38235.058435 secs 2024-04-27T04:55:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37538.022492 secs 2024-04-27T04:55:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:40 smithi189 ceph-mon[32756]: pgmap v20756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37538.022492 secs 2024-04-27T04:55:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:40 smithi156 ceph-mon[32679]: pgmap v20756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37538.022492 secs 2024-04-27T04:55:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:40 smithi092 ceph-mon[29156]: pgmap v20756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:42 smithi189 ceph-mon[32756]: pgmap v20757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:42.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:42 smithi156 ceph-mon[32679]: pgmap v20757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:42.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:42 smithi092 ceph-mon[29156]: pgmap v20757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:44 smithi189 ceph-mon[32756]: pgmap v20758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38240.058551 secs 2024-04-27T04:55:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:44 smithi156 ceph-mon[32679]: pgmap v20758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38240.058551 secs 2024-04-27T04:55:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:44 smithi092 ceph-mon[29156]: pgmap v20758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38240.058551 secs 2024-04-27T04:55:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37543.022577 secs 2024-04-27T04:55:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37543.022577 secs 2024-04-27T04:55:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37543.022577 secs 2024-04-27T04:55:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:46 smithi189 ceph-mon[32756]: pgmap v20759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:46.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:46 smithi156 ceph-mon[32679]: pgmap v20759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:46 smithi092 ceph-mon[29156]: pgmap v20759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:48 smithi189 ceph-mon[32756]: pgmap v20760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:48 smithi156 ceph-mon[32679]: pgmap v20760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:48.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:48 smithi092 ceph-mon[29156]: pgmap v20760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38245.058647 secs 2024-04-27T04:55:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38245.058647 secs 2024-04-27T04:55:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38245.058647 secs 2024-04-27T04:55:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37548.022677 secs 2024-04-27T04:55:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:50 smithi189 ceph-mon[32756]: pgmap v20761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37548.022677 secs 2024-04-27T04:55:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:50 smithi156 ceph-mon[32679]: pgmap v20761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37548.022677 secs 2024-04-27T04:55:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:50 smithi092 ceph-mon[29156]: pgmap v20761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:52 smithi189 ceph-mon[32756]: pgmap v20762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:52 smithi156 ceph-mon[32679]: pgmap v20762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:52 smithi092 ceph-mon[29156]: pgmap v20762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:54 smithi189 ceph-mon[32756]: pgmap v20763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38250.058766 secs 2024-04-27T04:55:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:54 smithi156 ceph-mon[32679]: pgmap v20763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38250.058766 secs 2024-04-27T04:55:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:54 smithi092 ceph-mon[29156]: pgmap v20763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:54.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38250.058766 secs 2024-04-27T04:55:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37553.022748 secs 2024-04-27T04:55:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37553.022748 secs 2024-04-27T04:55:55.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37553.022748 secs 2024-04-27T04:55:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:56 smithi189 ceph-mon[32756]: pgmap v20764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:56.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:56 smithi156 ceph-mon[32679]: pgmap v20764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:56.991 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:56 smithi092 ceph-mon[29156]: pgmap v20764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:55:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:57 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:55:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:57 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:55:57.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:57 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:55:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:58 smithi189 ceph-mon[32756]: pgmap v20765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:55:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:55:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:58 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:55:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:58 smithi156 ceph-mon[32679]: pgmap v20765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:55:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:55:58.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:58 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:55:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:58 smithi092 ceph-mon[29156]: pgmap v20765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:55:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:55:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:55:58.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:58 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:55:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:59 smithi189 ceph-mon[32756]: pgmap v20766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:55:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:59 smithi189 ceph-mon[32756]: pgmap v20767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:55:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38255.058883 secs 2024-04-27T04:55:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:59 smithi156 ceph-mon[32679]: pgmap v20766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:55:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:59 smithi156 ceph-mon[32679]: pgmap v20767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:55:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38255.058883 secs 2024-04-27T04:55:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:59 smithi092 ceph-mon[29156]: pgmap v20766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:55:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:59 smithi092 ceph-mon[29156]: pgmap v20767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:55:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:55:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38255.058883 secs 2024-04-27T04:56:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37558.022862 secs 2024-04-27T04:56:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37558.022862 secs 2024-04-27T04:56:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37558.022862 secs 2024-04-27T04:56:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:01 smithi189 ceph-mon[32756]: pgmap v20768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:01.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:01 smithi156 ceph-mon[32679]: pgmap v20768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:01 smithi092 ceph-mon[29156]: pgmap v20768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:02 smithi189 ceph-mon[32756]: pgmap v20769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:02 smithi156 ceph-mon[32679]: pgmap v20769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:02 smithi092 ceph-mon[29156]: pgmap v20769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:04.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38260.059017 secs 2024-04-27T04:56:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38260.059017 secs 2024-04-27T04:56:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38260.059017 secs 2024-04-27T04:56:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37563.022954 secs 2024-04-27T04:56:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:05 smithi189 ceph-mon[32756]: pgmap v20770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37563.022954 secs 2024-04-27T04:56:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:05 smithi156 ceph-mon[32679]: pgmap v20770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37563.022954 secs 2024-04-27T04:56:05.497 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:05 smithi092 ceph-mon[29156]: pgmap v20770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:07.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:07 smithi189 ceph-mon[32756]: pgmap v20771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:07 smithi156 ceph-mon[32679]: pgmap v20771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:07 smithi092 ceph-mon[29156]: pgmap v20771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:56:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:09 smithi189 ceph-mon[32756]: pgmap v20772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:56:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38265.059108 secs 2024-04-27T04:56:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:09 smithi156 ceph-mon[32679]: pgmap v20772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:56:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38265.059108 secs 2024-04-27T04:56:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:09 smithi092 ceph-mon[29156]: pgmap v20772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:56:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38265.059108 secs 2024-04-27T04:56:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37568.023080 secs 2024-04-27T04:56:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37568.023080 secs 2024-04-27T04:56:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37568.023080 secs 2024-04-27T04:56:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:11 smithi189 ceph-mon[32756]: pgmap v20773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:11.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:11 smithi156 ceph-mon[32679]: pgmap v20773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:11 smithi092 ceph-mon[29156]: pgmap v20773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:13.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:13 smithi189 ceph-mon[32756]: pgmap v20774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:13 smithi156 ceph-mon[32679]: pgmap v20774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:13 smithi092 ceph-mon[29156]: pgmap v20774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38270.059227 secs 2024-04-27T04:56:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38270.059227 secs 2024-04-27T04:56:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38270.059227 secs 2024-04-27T04:56:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37573.023207 secs 2024-04-27T04:56:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:15 smithi189 ceph-mon[32756]: pgmap v20775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37573.023207 secs 2024-04-27T04:56:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:15 smithi156 ceph-mon[32679]: pgmap v20775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37573.023207 secs 2024-04-27T04:56:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:15 smithi092 ceph-mon[29156]: pgmap v20775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:17.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:17 smithi189 ceph-mon[32756]: pgmap v20776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:17.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:17 smithi156 ceph-mon[32679]: pgmap v20776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:17 smithi092 ceph-mon[29156]: pgmap v20776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:19 smithi189 ceph-mon[32756]: pgmap v20777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:19.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38275.059339 secs 2024-04-27T04:56:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:19 smithi156 ceph-mon[32679]: pgmap v20777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38275.059339 secs 2024-04-27T04:56:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:19 smithi092 ceph-mon[29156]: pgmap v20777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38275.059339 secs 2024-04-27T04:56:20.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37578.023333 secs 2024-04-27T04:56:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37578.023333 secs 2024-04-27T04:56:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37578.023333 secs 2024-04-27T04:56:21.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:21 smithi189 ceph-mon[32756]: pgmap v20778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:21.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:21 smithi156 ceph-mon[32679]: pgmap v20778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:21.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:21 smithi092 ceph-mon[29156]: pgmap v20778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:23.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:23 smithi189 ceph-mon[32756]: pgmap v20779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:23.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:23 smithi156 ceph-mon[32679]: pgmap v20779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:23.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:23 smithi092 ceph-mon[29156]: pgmap v20779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38280.059454 secs 2024-04-27T04:56:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38280.059454 secs 2024-04-27T04:56:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38280.059454 secs 2024-04-27T04:56:25.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37583.023457 secs 2024-04-27T04:56:25.588 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:25 smithi156 ceph-mon[32679]: pgmap v20780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37583.023457 secs 2024-04-27T04:56:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:25 smithi189 ceph-mon[32756]: pgmap v20780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37583.023457 secs 2024-04-27T04:56:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:25 smithi092 ceph-mon[29156]: pgmap v20780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:27.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:27 smithi189 ceph-mon[32756]: pgmap v20781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:27.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:27 smithi156 ceph-mon[32679]: pgmap v20781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:27 smithi092 ceph-mon[29156]: pgmap v20781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:29 smithi189 ceph-mon[32756]: pgmap v20782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:29.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38285.059571 secs 2024-04-27T04:56:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:29 smithi156 ceph-mon[32679]: pgmap v20782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38285.059571 secs 2024-04-27T04:56:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:29 smithi092 ceph-mon[29156]: pgmap v20782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38285.059571 secs 2024-04-27T04:56:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37588.023574 secs 2024-04-27T04:56:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37588.023574 secs 2024-04-27T04:56:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37588.023574 secs 2024-04-27T04:56:31.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:31 smithi189 ceph-mon[32756]: pgmap v20783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:31.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:31 smithi156 ceph-mon[32679]: pgmap v20783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:31.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:31 smithi092 ceph-mon[29156]: pgmap v20783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:33 smithi189 ceph-mon[32756]: pgmap v20784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:33.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:33 smithi156 ceph-mon[32679]: pgmap v20784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:33.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:33 smithi092 ceph-mon[29156]: pgmap v20784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38290.059683 secs 2024-04-27T04:56:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38290.059683 secs 2024-04-27T04:56:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38290.059683 secs 2024-04-27T04:56:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37593.023689 secs 2024-04-27T04:56:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:35 smithi189 ceph-mon[32756]: pgmap v20785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37593.023689 secs 2024-04-27T04:56:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:35 smithi156 ceph-mon[32679]: pgmap v20785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37593.023689 secs 2024-04-27T04:56:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:35 smithi092 ceph-mon[29156]: pgmap v20785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:37 smithi189 ceph-mon[32756]: pgmap v20786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:37.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:37 smithi156 ceph-mon[32679]: pgmap v20786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:37.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:37 smithi092 ceph-mon[29156]: pgmap v20786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:39 smithi189 ceph-mon[32756]: pgmap v20787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38295.059805 secs 2024-04-27T04:56:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:39 smithi156 ceph-mon[32679]: pgmap v20787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38295.059805 secs 2024-04-27T04:56:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:39 smithi092 ceph-mon[29156]: pgmap v20787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38295.059805 secs 2024-04-27T04:56:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37598.023803 secs 2024-04-27T04:56:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37598.023803 secs 2024-04-27T04:56:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37598.023803 secs 2024-04-27T04:56:41.374 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:56:41.088+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:56:41.375 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:56:41.088+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:56:41.375 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:56:41.088+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:56:41.375 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:56:41.088+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:56:41.375 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T04:56:41.088+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T04:56:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:41 smithi189 ceph-mon[32756]: pgmap v20788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:41 smithi156 ceph-mon[32679]: pgmap v20788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:41 smithi092 ceph-mon[29156]: pgmap v20788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:56:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:43 smithi189 ceph-mon[32756]: pgmap v20789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:43.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:43 smithi156 ceph-mon[32679]: pgmap v20789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:43.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:43 smithi092 ceph-mon[29156]: pgmap v20789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38300.059908 secs 2024-04-27T04:56:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38300.059908 secs 2024-04-27T04:56:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38300.059908 secs 2024-04-27T04:56:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37603.023876 secs 2024-04-27T04:56:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:45 smithi189 ceph-mon[32756]: pgmap v20790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37603.023876 secs 2024-04-27T04:56:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:45 smithi156 ceph-mon[32679]: pgmap v20790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37603.023876 secs 2024-04-27T04:56:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:45 smithi092 ceph-mon[29156]: pgmap v20790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:47.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:47 smithi156 ceph-mon[32679]: pgmap v20791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:47 smithi092 ceph-mon[29156]: pgmap v20791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:47 smithi189 ceph-mon[32756]: pgmap v20791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:49 smithi156 ceph-mon[32679]: pgmap v20792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38305.060020 secs 2024-04-27T04:56:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:49 smithi092 ceph-mon[29156]: pgmap v20792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38305.060020 secs 2024-04-27T04:56:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:49 smithi189 ceph-mon[32756]: pgmap v20792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38305.060020 secs 2024-04-27T04:56:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37608.023946 secs 2024-04-27T04:56:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37608.023946 secs 2024-04-27T04:56:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37608.023946 secs 2024-04-27T04:56:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:51 smithi156 ceph-mon[32679]: pgmap v20793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:51 smithi092 ceph-mon[29156]: pgmap v20793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:51 smithi189 ceph-mon[32756]: pgmap v20793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:53 smithi156 ceph-mon[32679]: pgmap v20794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:53.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:53 smithi189 ceph-mon[32756]: pgmap v20794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:53 smithi092 ceph-mon[29156]: pgmap v20794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T04:56:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38310.060096 secs 2024-04-27T04:56:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38310.060096 secs 2024-04-27T04:56:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38310.060096 secs 2024-04-27T04:56:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37613.024079 secs 2024-04-27T04:56:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:55 smithi156 ceph-mon[32679]: pgmap v20795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37613.024079 secs 2024-04-27T04:56:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:55 smithi092 ceph-mon[29156]: pgmap v20795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37613.024079 secs 2024-04-27T04:56:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:55 smithi189 ceph-mon[32756]: pgmap v20795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T04:56:57.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:57 smithi156 ceph-mon[32679]: pgmap v20796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:57 smithi092 ceph-mon[29156]: pgmap v20796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:57.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:57 smithi189 ceph-mon[32756]: pgmap v20796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: pgmap v20797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:56:59.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38315.060195 secs 2024-04-27T04:56:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:56:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:56:59.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:56:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: pgmap v20797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38315.060195 secs 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:56:59.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:56:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: pgmap v20797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38315.060195 secs 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:56:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:56:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:57:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:00 smithi092 ceph-mon[29156]: pgmap v20798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:57:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:00 smithi092 ceph-mon[29156]: pgmap v20799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:00.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37618.024170 secs 2024-04-27T04:57:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:00 smithi189 ceph-mon[32756]: pgmap v20798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:57:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:00 smithi189 ceph-mon[32756]: pgmap v20799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:00.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37618.024170 secs 2024-04-27T04:57:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:00 smithi156 ceph-mon[32679]: pgmap v20798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T04:57:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:00 smithi156 ceph-mon[32679]: pgmap v20799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37618.024170 secs 2024-04-27T04:57:02.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:02 smithi189 ceph-mon[32756]: pgmap v20800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:02.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:02 smithi156 ceph-mon[32679]: pgmap v20800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:02.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:02 smithi092 ceph-mon[29156]: pgmap v20800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:04.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:04 smithi189 ceph-mon[32756]: pgmap v20801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:57:04.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38320.060335 secs 2024-04-27T04:57:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:04 smithi156 ceph-mon[32679]: pgmap v20801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:57:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38320.060335 secs 2024-04-27T04:57:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:04 smithi092 ceph-mon[29156]: pgmap v20801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:57:04.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38320.060335 secs 2024-04-27T04:57:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37623.024326 secs 2024-04-27T04:57:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37623.024326 secs 2024-04-27T04:57:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37623.024326 secs 2024-04-27T04:57:06.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:06 smithi189 ceph-mon[32756]: pgmap v20802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:06.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:06 smithi156 ceph-mon[32679]: pgmap v20802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:06.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:06 smithi092 ceph-mon[29156]: pgmap v20802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:08.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:08 smithi189 ceph-mon[32756]: pgmap v20803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:08.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:08 smithi156 ceph-mon[32679]: pgmap v20803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:08.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:08 smithi092 ceph-mon[29156]: pgmap v20803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:57:09.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38325.060468 secs 2024-04-27T04:57:09.397 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38325.060468 secs 2024-04-27T04:57:09.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38325.060468 secs 2024-04-27T04:57:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:10 smithi189 ceph-mon[32756]: pgmap v20804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:57:10.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37628.024480 secs 2024-04-27T04:57:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:10 smithi156 ceph-mon[32679]: pgmap v20804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:57:10.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37628.024480 secs 2024-04-27T04:57:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:10 smithi092 ceph-mon[29156]: pgmap v20804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:57:10.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37628.024480 secs 2024-04-27T04:57:12.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:12 smithi189 ceph-mon[32756]: pgmap v20805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:12.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:12 smithi156 ceph-mon[32679]: pgmap v20805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:12.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:12 smithi092 ceph-mon[29156]: pgmap v20805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:14 smithi189 ceph-mon[32756]: pgmap v20806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38330.060582 secs 2024-04-27T04:57:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:14 smithi156 ceph-mon[32679]: pgmap v20806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38330.060582 secs 2024-04-27T04:57:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:14 smithi092 ceph-mon[29156]: pgmap v20806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38330.060582 secs 2024-04-27T04:57:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37633.024599 secs 2024-04-27T04:57:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37633.024599 secs 2024-04-27T04:57:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37633.024599 secs 2024-04-27T04:57:16.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:16 smithi156 ceph-mon[32679]: pgmap v20807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:16.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:16 smithi092 ceph-mon[29156]: pgmap v20807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:16 smithi189 ceph-mon[32756]: pgmap v20807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:18.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:18 smithi156 ceph-mon[32679]: pgmap v20808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:18.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:18 smithi092 ceph-mon[29156]: pgmap v20808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:18 smithi189 ceph-mon[32756]: pgmap v20808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:19.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38335.060698 secs 2024-04-27T04:57:19.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38335.060698 secs 2024-04-27T04:57:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38335.060698 secs 2024-04-27T04:57:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:20 smithi156 ceph-mon[32679]: pgmap v20809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:20.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37638.024673 secs 2024-04-27T04:57:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:20 smithi092 ceph-mon[29156]: pgmap v20809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:20.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37638.024673 secs 2024-04-27T04:57:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:20 smithi189 ceph-mon[32756]: pgmap v20809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37638.024673 secs 2024-04-27T04:57:22.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:22 smithi156 ceph-mon[32679]: pgmap v20810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:22.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:22 smithi092 ceph-mon[29156]: pgmap v20810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:22 smithi189 ceph-mon[32756]: pgmap v20810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:24 smithi156 ceph-mon[32679]: pgmap v20811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38340.060841 secs 2024-04-27T04:57:24.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:24 smithi189 ceph-mon[32756]: pgmap v20811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:24.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38340.060841 secs 2024-04-27T04:57:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:24 smithi092 ceph-mon[29156]: pgmap v20811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T04:57:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38340.060841 secs 2024-04-27T04:57:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37643.024793 secs 2024-04-27T04:57:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37643.024793 secs 2024-04-27T04:57:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37643.024793 secs 2024-04-27T04:57:26.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:26 smithi156 ceph-mon[32679]: pgmap v20812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:26.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:26 smithi092 ceph-mon[29156]: pgmap v20812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:26.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:26 smithi189 ceph-mon[32756]: pgmap v20812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:57:28.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:28 smithi156 ceph-mon[32679]: pgmap v20813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:28.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:28 smithi092 ceph-mon[29156]: pgmap v20813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:28 smithi189 ceph-mon[32756]: pgmap v20813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:29.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38345.060921 secs 2024-04-27T04:57:29.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38345.060921 secs 2024-04-27T04:57:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38345.060921 secs 2024-04-27T04:57:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:30 smithi156 ceph-mon[32679]: pgmap v20814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:30.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37648.024855 secs 2024-04-27T04:57:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:30 smithi092 ceph-mon[29156]: pgmap v20814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37648.024855 secs 2024-04-27T04:57:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:30 smithi189 ceph-mon[32756]: pgmap v20814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37648.024855 secs 2024-04-27T04:57:32.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:32 smithi156 ceph-mon[32679]: pgmap v20815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:32.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:32 smithi092 ceph-mon[29156]: pgmap v20815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:32 smithi189 ceph-mon[32756]: pgmap v20815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:34 smithi092 ceph-mon[29156]: pgmap v20816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38350.060987 secs 2024-04-27T04:57:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:34 smithi189 ceph-mon[32756]: pgmap v20816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38350.060987 secs 2024-04-27T04:57:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:34 smithi156 ceph-mon[32679]: pgmap v20816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38350.060987 secs 2024-04-27T04:57:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37653.024980 secs 2024-04-27T04:57:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37653.024980 secs 2024-04-27T04:57:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37653.024980 secs 2024-04-27T04:57:36.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:36 smithi092 ceph-mon[29156]: pgmap v20817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:36 smithi189 ceph-mon[32756]: pgmap v20817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:36.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:36 smithi156 ceph-mon[32679]: pgmap v20817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:38.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:38 smithi092 ceph-mon[29156]: pgmap v20818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:38.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:38 smithi189 ceph-mon[32756]: pgmap v20818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:38.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:38 smithi156 ceph-mon[32679]: pgmap v20818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:39.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38355.061100 secs 2024-04-27T04:57:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38355.061100 secs 2024-04-27T04:57:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38355.061100 secs 2024-04-27T04:57:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:40 smithi092 ceph-mon[29156]: pgmap v20819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37658.025100 secs 2024-04-27T04:57:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:40 smithi189 ceph-mon[32756]: pgmap v20819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37658.025100 secs 2024-04-27T04:57:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:40 smithi156 ceph-mon[32679]: pgmap v20819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37658.025100 secs 2024-04-27T04:57:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:57:41.248+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:57:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:57:41.248+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:57:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:57:41.248+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T04:57:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T04:57:41.248+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 295 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T04:57:42.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:42 smithi092 ceph-mon[29156]: pgmap v20820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:42.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:42 smithi189 ceph-mon[32756]: pgmap v20820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:42.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:42 smithi156 ceph-mon[32679]: pgmap v20820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:44 smithi092 ceph-mon[29156]: pgmap v20821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38360.061218 secs 2024-04-27T04:57:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:44 smithi189 ceph-mon[32756]: pgmap v20821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38360.061218 secs 2024-04-27T04:57:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:44 smithi156 ceph-mon[32679]: pgmap v20821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38360.061218 secs 2024-04-27T04:57:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:45 smithi092 ceph-mon[29156]: 31 slow requests, 1 included below; oldest blocked for > 37663.025221 secs 2024-04-27T04:57:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:45 smithi092 ceph-mon[29156]: slow request 363.129600 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:57:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:45 smithi189 ceph-mon[32756]: 31 slow requests, 1 included below; oldest blocked for > 37663.025221 secs 2024-04-27T04:57:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:45 smithi189 ceph-mon[32756]: slow request 363.129600 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:57:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:45 smithi156 ceph-mon[32679]: 31 slow requests, 1 included below; oldest blocked for > 37663.025221 secs 2024-04-27T04:57:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:45 smithi156 ceph-mon[32679]: slow request 363.129600 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:57:46.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:46 smithi092 ceph-mon[29156]: pgmap v20822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:46 smithi189 ceph-mon[32756]: pgmap v20822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:46 smithi156 ceph-mon[32679]: pgmap v20822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:48.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:48 smithi092 ceph-mon[29156]: pgmap v20823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:48.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:48 smithi189 ceph-mon[32756]: pgmap v20823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:48.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:48 smithi156 ceph-mon[32679]: pgmap v20823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:49.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38365.061301 secs 2024-04-27T04:57:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38365.061301 secs 2024-04-27T04:57:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38365.061301 secs 2024-04-27T04:57:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:50 smithi092 ceph-mon[29156]: pgmap v20824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:50.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37668.025326 secs 2024-04-27T04:57:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:50 smithi189 ceph-mon[32756]: pgmap v20824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:50.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37668.025326 secs 2024-04-27T04:57:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:50 smithi156 ceph-mon[32679]: pgmap v20824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37668.025326 secs 2024-04-27T04:57:52.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:52 smithi092 ceph-mon[29156]: pgmap v20825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:52.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:52 smithi189 ceph-mon[32756]: pgmap v20825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:52.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:52 smithi156 ceph-mon[32679]: pgmap v20825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:54 smithi092 ceph-mon[29156]: pgmap v20826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38370.061418 secs 2024-04-27T04:57:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:54 smithi189 ceph-mon[32756]: pgmap v20826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38370.061418 secs 2024-04-27T04:57:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:54 smithi156 ceph-mon[32679]: pgmap v20826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38370.061418 secs 2024-04-27T04:57:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37673.025451 secs 2024-04-27T04:57:55.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37673.025451 secs 2024-04-27T04:57:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37673.025451 secs 2024-04-27T04:57:56.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:56 smithi092 ceph-mon[29156]: pgmap v20827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:56 smithi189 ceph-mon[32756]: pgmap v20827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:56.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:56 smithi156 ceph-mon[32679]: pgmap v20827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:57:58.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:58 smithi092 ceph-mon[29156]: pgmap v20828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:58.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:58 smithi189 ceph-mon[32756]: pgmap v20828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:58.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:58 smithi156 ceph-mon[32679]: pgmap v20828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:57:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38375.061535 secs 2024-04-27T04:57:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:57:59 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:57:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38375.061535 secs 2024-04-27T04:57:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:57:59 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:57:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38375.061535 secs 2024-04-27T04:57:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:57:59 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:00 smithi189 ceph-mon[32756]: pgmap v20829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37678.025522 secs 2024-04-27T04:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:58:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:00 smithi156 ceph-mon[32679]: pgmap v20829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37678.025522 secs 2024-04-27T04:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:58:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:00 smithi092 ceph-mon[29156]: pgmap v20829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T04:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37678.025522 secs 2024-04-27T04:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:58:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:58:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:01 smithi189 ceph-mon[32756]: pgmap v20830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:58:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:01 smithi189 ceph-mon[32756]: pgmap v20831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:01 smithi156 ceph-mon[32679]: pgmap v20830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:58:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:01 smithi156 ceph-mon[32679]: pgmap v20831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:01 smithi092 ceph-mon[29156]: pgmap v20830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T04:58:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:01 smithi092 ceph-mon[29156]: pgmap v20831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:03 smithi189 ceph-mon[32756]: pgmap v20832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:03 smithi156 ceph-mon[32679]: pgmap v20832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:03 smithi092 ceph-mon[29156]: pgmap v20832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38380.061653 secs 2024-04-27T04:58:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38380.061653 secs 2024-04-27T04:58:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38380.061653 secs 2024-04-27T04:58:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:05 smithi189 ceph-mon[32756]: pgmap v20833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37683.025639 secs 2024-04-27T04:58:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:05 smithi156 ceph-mon[32679]: pgmap v20833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:05.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37683.025639 secs 2024-04-27T04:58:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:05 smithi092 ceph-mon[29156]: pgmap v20833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:05.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37683.025639 secs 2024-04-27T04:58:07.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:07 smithi189 ceph-mon[32756]: pgmap v20834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:07.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:07 smithi156 ceph-mon[32679]: pgmap v20834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:07 smithi092 ceph-mon[29156]: pgmap v20834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T04:58:09.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:09 smithi092 ceph-mon[29156]: pgmap v20835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:58:09.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38385.061788 secs 2024-04-27T04:58:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:09 smithi189 ceph-mon[32756]: pgmap v20835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:58:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38385.061788 secs 2024-04-27T04:58:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:09 smithi156 ceph-mon[32679]: pgmap v20835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:58:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38385.061788 secs 2024-04-27T04:58:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37688.025710 secs 2024-04-27T04:58:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37688.025710 secs 2024-04-27T04:58:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37688.025710 secs 2024-04-27T04:58:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:11 smithi189 ceph-mon[32756]: pgmap v20836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:58:11.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:11 smithi156 ceph-mon[32679]: pgmap v20836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:58:11.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:11 smithi092 ceph-mon[29156]: pgmap v20836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:58:13.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:13 smithi189 ceph-mon[32756]: pgmap v20837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:13.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:13 smithi156 ceph-mon[32679]: pgmap v20837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:13.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:13 smithi092 ceph-mon[29156]: pgmap v20837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38390.061922 secs 2024-04-27T04:58:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38390.061922 secs 2024-04-27T04:58:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38390.061922 secs 2024-04-27T04:58:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:15 smithi189 ceph-mon[32756]: pgmap v20838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37693.025825 secs 2024-04-27T04:58:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:15 smithi156 ceph-mon[32679]: pgmap v20838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:15.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37693.025825 secs 2024-04-27T04:58:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:15 smithi092 ceph-mon[29156]: pgmap v20838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37693.025825 secs 2024-04-27T04:58:17.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:17 smithi189 ceph-mon[32756]: pgmap v20839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:17.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:17 smithi156 ceph-mon[32679]: pgmap v20839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:17.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:17 smithi092 ceph-mon[29156]: pgmap v20839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:19 smithi189 ceph-mon[32756]: pgmap v20840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38395.062002 secs 2024-04-27T04:58:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:19 smithi156 ceph-mon[32679]: pgmap v20840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38395.062002 secs 2024-04-27T04:58:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:19 smithi092 ceph-mon[29156]: pgmap v20840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:19.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38395.062002 secs 2024-04-27T04:58:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37698.025939 secs 2024-04-27T04:58:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37698.025939 secs 2024-04-27T04:58:20.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37698.025939 secs 2024-04-27T04:58:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:21 smithi189 ceph-mon[32756]: pgmap v20841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:21.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:21 smithi156 ceph-mon[32679]: pgmap v20841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:21.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:21 smithi092 ceph-mon[29156]: pgmap v20841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:23.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:23 smithi189 ceph-mon[32756]: pgmap v20842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:23.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:23 smithi156 ceph-mon[32679]: pgmap v20842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:23.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:23 smithi092 ceph-mon[29156]: pgmap v20842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38400.062154 secs 2024-04-27T04:58:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38400.062154 secs 2024-04-27T04:58:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38400.062154 secs 2024-04-27T04:58:25.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:25 smithi156 ceph-mon[32679]: pgmap v20843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:25.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37703.026046 secs 2024-04-27T04:58:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:25 smithi189 ceph-mon[32756]: pgmap v20843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37703.026046 secs 2024-04-27T04:58:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:25 smithi092 ceph-mon[29156]: pgmap v20843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:25.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37703.026046 secs 2024-04-27T04:58:27.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:27 smithi189 ceph-mon[32756]: pgmap v20844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:27.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:27 smithi156 ceph-mon[32679]: pgmap v20844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:27.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:27 smithi092 ceph-mon[29156]: pgmap v20844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:29 smithi189 ceph-mon[32756]: pgmap v20845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38405.062299 secs 2024-04-27T04:58:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:29 smithi156 ceph-mon[32679]: pgmap v20845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38405.062299 secs 2024-04-27T04:58:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:29 smithi092 ceph-mon[29156]: pgmap v20845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:29.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38405.062299 secs 2024-04-27T04:58:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37708.026156 secs 2024-04-27T04:58:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37708.026156 secs 2024-04-27T04:58:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37708.026156 secs 2024-04-27T04:58:31.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:31 smithi189 ceph-mon[32756]: pgmap v20846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:31.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:31 smithi156 ceph-mon[32679]: pgmap v20846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:31.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:31 smithi092 ceph-mon[29156]: pgmap v20846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:33 smithi189 ceph-mon[32756]: pgmap v20847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:33.663 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:33 smithi092 ceph-mon[29156]: pgmap v20847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:33.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:33 smithi156 ceph-mon[32679]: pgmap v20847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38410.062417 secs 2024-04-27T04:58:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38410.062417 secs 2024-04-27T04:58:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38410.062417 secs 2024-04-27T04:58:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:35 smithi189 ceph-mon[32756]: pgmap v20848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:35.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37713.026261 secs 2024-04-27T04:58:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:35 smithi156 ceph-mon[32679]: pgmap v20848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37713.026261 secs 2024-04-27T04:58:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:35 smithi092 ceph-mon[29156]: pgmap v20848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:35.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37713.026261 secs 2024-04-27T04:58:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:37 smithi189 ceph-mon[32756]: pgmap v20849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:37 smithi156 ceph-mon[32679]: pgmap v20849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:37.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:37 smithi092 ceph-mon[29156]: pgmap v20849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:39 smithi189 ceph-mon[32756]: pgmap v20850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38415.062530 secs 2024-04-27T04:58:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:39 smithi156 ceph-mon[32679]: pgmap v20850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38415.062530 secs 2024-04-27T04:58:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:39 smithi092 ceph-mon[29156]: pgmap v20850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:39.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38415.062530 secs 2024-04-27T04:58:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37718.026383 secs 2024-04-27T04:58:40.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37718.026383 secs 2024-04-27T04:58:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37718.026383 secs 2024-04-27T04:58:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:41 smithi189 ceph-mon[32756]: pgmap v20851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:41.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:41 smithi156 ceph-mon[32679]: pgmap v20851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:41.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:41 smithi092 ceph-mon[29156]: pgmap v20851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:43 smithi189 ceph-mon[32756]: pgmap v20852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:43.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:43 smithi156 ceph-mon[32679]: pgmap v20852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:43.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:43 smithi092 ceph-mon[29156]: pgmap v20852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38420.062669 secs 2024-04-27T04:58:44.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38420.062669 secs 2024-04-27T04:58:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38420.062669 secs 2024-04-27T04:58:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:45 smithi189 ceph-mon[32756]: pgmap v20853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37723.026458 secs 2024-04-27T04:58:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:45 smithi156 ceph-mon[32679]: pgmap v20853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:45.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37723.026458 secs 2024-04-27T04:58:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:45 smithi092 ceph-mon[29156]: pgmap v20853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:45.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37723.026458 secs 2024-04-27T04:58:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:47 smithi189 ceph-mon[32756]: pgmap v20854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:47.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:47 smithi156 ceph-mon[32679]: pgmap v20854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:47.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:47 smithi092 ceph-mon[29156]: pgmap v20854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:49 smithi189 ceph-mon[32756]: pgmap v20855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:49.641 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38425.062802 secs 2024-04-27T04:58:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:49 smithi156 ceph-mon[32679]: pgmap v20855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:49.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38425.062802 secs 2024-04-27T04:58:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:49 smithi092 ceph-mon[29156]: pgmap v20855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:49.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38425.062802 secs 2024-04-27T04:58:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37728.026581 secs 2024-04-27T04:58:50.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37728.026581 secs 2024-04-27T04:58:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37728.026581 secs 2024-04-27T04:58:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:51 smithi189 ceph-mon[32756]: pgmap v20856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:51 smithi156 ceph-mon[32679]: pgmap v20856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:51 smithi092 ceph-mon[29156]: pgmap v20856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:53 smithi189 ceph-mon[32756]: pgmap v20857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:53.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:53 smithi156 ceph-mon[32679]: pgmap v20857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:53.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:53 smithi092 ceph-mon[29156]: pgmap v20857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38430.062926 secs 2024-04-27T04:58:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38430.062926 secs 2024-04-27T04:58:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38430.062926 secs 2024-04-27T04:58:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:55 smithi189 ceph-mon[32756]: pgmap v20858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37733.026658 secs 2024-04-27T04:58:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:55 smithi156 ceph-mon[32679]: pgmap v20858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:55.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37733.026658 secs 2024-04-27T04:58:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:55 smithi092 ceph-mon[29156]: pgmap v20858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:58:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37733.026658 secs 2024-04-27T04:58:57.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:57 smithi189 ceph-mon[32756]: pgmap v20859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:57.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:57 smithi156 ceph-mon[32679]: pgmap v20859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:57.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:57 smithi092 ceph-mon[29156]: pgmap v20859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:59 smithi156 ceph-mon[32679]: pgmap v20860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:58:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38435.063023 secs 2024-04-27T04:58:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:59 smithi092 ceph-mon[29156]: pgmap v20860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:59.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:58:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38435.063023 secs 2024-04-27T04:58:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:59 smithi189 ceph-mon[32756]: pgmap v20860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:58:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:58:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38435.063023 secs 2024-04-27T04:59:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37738.026717 secs 2024-04-27T04:59:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:59:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37738.026717 secs 2024-04-27T04:59:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:59:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37738.026717 secs 2024-04-27T04:59:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: pgmap v20861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: pgmap v20862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: pgmap v20863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:01.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: pgmap v20861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: pgmap v20862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: pgmap v20863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:01.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:59:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: pgmap v20861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T04:59:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T04:59:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: pgmap v20862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T04:59:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: pgmap v20863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:01.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T04:59:02.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:02 smithi092 ceph-mon[29156]: pgmap v20864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:03.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:02 smithi189 ceph-mon[32756]: pgmap v20864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:03.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:02 smithi156 ceph-mon[32679]: pgmap v20864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:04.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38440.063108 secs 2024-04-27T04:59:04.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38440.063108 secs 2024-04-27T04:59:04.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38440.063108 secs 2024-04-27T04:59:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37743.026856 secs 2024-04-27T04:59:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:05 smithi189 ceph-mon[32756]: pgmap v20865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37743.026856 secs 2024-04-27T04:59:05.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:05 smithi156 ceph-mon[32679]: pgmap v20865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37743.026856 secs 2024-04-27T04:59:05.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:05 smithi092 ceph-mon[29156]: pgmap v20865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:06.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:06 smithi092 ceph-mon[29156]: pgmap v20866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:07.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:06 smithi189 ceph-mon[32756]: pgmap v20866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:07.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:06 smithi156 ceph-mon[32679]: pgmap v20866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T04:59:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:08 smithi092 ceph-mon[29156]: pgmap v20867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:09.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:08 smithi189 ceph-mon[32756]: pgmap v20867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:09.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:08 smithi156 ceph-mon[32679]: pgmap v20867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T04:59:09.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38445.063189 secs 2024-04-27T04:59:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38445.063189 secs 2024-04-27T04:59:10.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38445.063189 secs 2024-04-27T04:59:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37748.026986 secs 2024-04-27T04:59:10.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:10 smithi092 ceph-mon[29156]: pgmap v20868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:59:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37748.026986 secs 2024-04-27T04:59:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:10 smithi189 ceph-mon[32756]: pgmap v20868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:59:11.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37748.026986 secs 2024-04-27T04:59:11.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:10 smithi156 ceph-mon[32679]: pgmap v20868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T04:59:12.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:12 smithi092 ceph-mon[29156]: pgmap v20869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:13.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:12 smithi189 ceph-mon[32756]: pgmap v20869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:13.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:12 smithi156 ceph-mon[32679]: pgmap v20869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:14.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38450.063308 secs 2024-04-27T04:59:14.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38450.063308 secs 2024-04-27T04:59:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38450.063308 secs 2024-04-27T04:59:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37753.027096 secs 2024-04-27T04:59:15.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:15 smithi189 ceph-mon[32756]: pgmap v20870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37753.027096 secs 2024-04-27T04:59:15.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:15 smithi156 ceph-mon[32679]: pgmap v20870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37753.027096 secs 2024-04-27T04:59:15.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:15 smithi092 ceph-mon[29156]: pgmap v20870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:16.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:16 smithi092 ceph-mon[29156]: pgmap v20871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:17.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:16 smithi189 ceph-mon[32756]: pgmap v20871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:17.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:16 smithi156 ceph-mon[32679]: pgmap v20871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:18.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:18 smithi092 ceph-mon[29156]: pgmap v20872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:19.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:18 smithi189 ceph-mon[32756]: pgmap v20872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:19.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:18 smithi156 ceph-mon[32679]: pgmap v20872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38455.063425 secs 2024-04-27T04:59:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38455.063425 secs 2024-04-27T04:59:20.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38455.063425 secs 2024-04-27T04:59:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37758.027210 secs 2024-04-27T04:59:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:20 smithi092 ceph-mon[29156]: pgmap v20873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37758.027210 secs 2024-04-27T04:59:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:20 smithi189 ceph-mon[32756]: pgmap v20873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37758.027210 secs 2024-04-27T04:59:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:20 smithi156 ceph-mon[32679]: pgmap v20873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:22 smithi092 ceph-mon[29156]: pgmap v20874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:22 smithi189 ceph-mon[32756]: pgmap v20874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:22 smithi156 ceph-mon[32679]: pgmap v20874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38460.063560 secs 2024-04-27T04:59:24.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38460.063560 secs 2024-04-27T04:59:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38460.063560 secs 2024-04-27T04:59:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37763.027334 secs 2024-04-27T04:59:25.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:25 smithi189 ceph-mon[32756]: pgmap v20875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37763.027334 secs 2024-04-27T04:59:25.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:25 smithi156 ceph-mon[32679]: pgmap v20875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37763.027334 secs 2024-04-27T04:59:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:25 smithi092 ceph-mon[29156]: pgmap v20875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:26 smithi092 ceph-mon[29156]: pgmap v20876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:26 smithi189 ceph-mon[32756]: pgmap v20876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:26 smithi156 ceph-mon[32679]: pgmap v20876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:28.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:28 smithi092 ceph-mon[29156]: pgmap v20877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:28 smithi189 ceph-mon[32756]: pgmap v20877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:28 smithi156 ceph-mon[32679]: pgmap v20877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38465.063638 secs 2024-04-27T04:59:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38465.063638 secs 2024-04-27T04:59:30.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38465.063638 secs 2024-04-27T04:59:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37768.027369 secs 2024-04-27T04:59:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:30 smithi092 ceph-mon[29156]: pgmap v20878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37768.027369 secs 2024-04-27T04:59:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:30 smithi189 ceph-mon[32756]: pgmap v20878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:31.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37768.027369 secs 2024-04-27T04:59:31.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:30 smithi156 ceph-mon[32679]: pgmap v20878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:32 smithi092 ceph-mon[29156]: pgmap v20879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:33.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:32 smithi189 ceph-mon[32756]: pgmap v20879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:33.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:32 smithi156 ceph-mon[32679]: pgmap v20879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:34.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38470.063756 secs 2024-04-27T04:59:34.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38470.063756 secs 2024-04-27T04:59:34.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38470.063756 secs 2024-04-27T04:59:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37773.027436 secs 2024-04-27T04:59:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:35 smithi189 ceph-mon[32756]: pgmap v20880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37773.027436 secs 2024-04-27T04:59:35.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:35 smithi156 ceph-mon[32679]: pgmap v20880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37773.027436 secs 2024-04-27T04:59:35.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:35 smithi092 ceph-mon[29156]: pgmap v20880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:36.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:36 smithi092 ceph-mon[29156]: pgmap v20881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:36 smithi189 ceph-mon[32756]: pgmap v20881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:36 smithi156 ceph-mon[32679]: pgmap v20881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:38 smithi092 ceph-mon[29156]: pgmap v20882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:39.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:38 smithi189 ceph-mon[32756]: pgmap v20882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:38 smithi156 ceph-mon[32679]: pgmap v20882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38475.063867 secs 2024-04-27T04:59:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38475.063867 secs 2024-04-27T04:59:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38475.063867 secs 2024-04-27T04:59:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37778.027558 secs 2024-04-27T04:59:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:40 smithi092 ceph-mon[29156]: pgmap v20883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37778.027558 secs 2024-04-27T04:59:41.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:40 smithi189 ceph-mon[32756]: pgmap v20883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:41.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37778.027558 secs 2024-04-27T04:59:41.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:40 smithi156 ceph-mon[32679]: pgmap v20883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:42.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:42 smithi092 ceph-mon[29156]: pgmap v20884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:43.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:42 smithi189 ceph-mon[32756]: pgmap v20884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:43.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:42 smithi156 ceph-mon[32679]: pgmap v20884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:44 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 38480.063981 secs 2024-04-27T04:59:44.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:44 smithi189 ceph-mon[32756]: slow request 1443.210465 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:59:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:44 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 38480.063981 secs 2024-04-27T04:59:44.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:44 smithi156 ceph-mon[32679]: slow request 1443.210465 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:59:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:44 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 38480.063981 secs 2024-04-27T04:59:44.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:44 smithi092 ceph-mon[29156]: slow request 1443.210465 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T04:59:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37783.027645 secs 2024-04-27T04:59:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:45 smithi189 ceph-mon[32756]: pgmap v20885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37783.027645 secs 2024-04-27T04:59:45.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:45 smithi156 ceph-mon[32679]: pgmap v20885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37783.027645 secs 2024-04-27T04:59:45.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:45 smithi092 ceph-mon[29156]: pgmap v20885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:46 smithi092 ceph-mon[29156]: pgmap v20886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:46 smithi189 ceph-mon[32756]: pgmap v20886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:46 smithi156 ceph-mon[32679]: pgmap v20886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:48.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:48 smithi092 ceph-mon[29156]: pgmap v20887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:49.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:48 smithi189 ceph-mon[32756]: pgmap v20887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:49.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:48 smithi156 ceph-mon[32679]: pgmap v20887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:49.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38485.064079 secs 2024-04-27T04:59:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38485.064079 secs 2024-04-27T04:59:50.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38485.064079 secs 2024-04-27T04:59:50.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37788.027788 secs 2024-04-27T04:59:50.975 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:50 smithi092 ceph-mon[29156]: pgmap v20888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37788.027788 secs 2024-04-27T04:59:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:50 smithi189 ceph-mon[32756]: pgmap v20888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:51.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37788.027788 secs 2024-04-27T04:59:51.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:50 smithi156 ceph-mon[32679]: pgmap v20888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:52 smithi092 ceph-mon[29156]: pgmap v20889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:53.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:52 smithi189 ceph-mon[32756]: pgmap v20889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:53.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:52 smithi156 ceph-mon[32679]: pgmap v20889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:54.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38490.064145 secs 2024-04-27T04:59:54.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38490.064145 secs 2024-04-27T04:59:54.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38490.064145 secs 2024-04-27T04:59:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37793.027869 secs 2024-04-27T04:59:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:55 smithi189 ceph-mon[32756]: pgmap v20890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37793.027869 secs 2024-04-27T04:59:55.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:55 smithi156 ceph-mon[32679]: pgmap v20890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37793.027869 secs 2024-04-27T04:59:55.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:55 smithi092 ceph-mon[29156]: pgmap v20890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:56 smithi092 ceph-mon[29156]: pgmap v20891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:57.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:56 smithi189 ceph-mon[32756]: pgmap v20891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:57.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:56 smithi156 ceph-mon[32679]: pgmap v20891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T04:59:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:58 smithi092 ceph-mon[29156]: pgmap v20892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:59.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:58 smithi189 ceph-mon[32756]: pgmap v20892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:59.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:58 smithi156 ceph-mon[32679]: pgmap v20892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T04:59:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 04:59:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38495.064280 secs 2024-04-27T05:00:00.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 04:59:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38495.064280 secs 2024-04-27T05:00:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 04:59:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38495.064280 secs 2024-04-27T05:00:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37798.027962 secs 2024-04-27T05:00:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:00:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:00 smithi092 ceph-mon[29156]: pgmap v20893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37798.027962 secs 2024-04-27T05:00:01.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:00:01.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:00 smithi189 ceph-mon[32756]: pgmap v20893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37798.027962 secs 2024-04-27T05:00:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:00:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:00 smithi156 ceph-mon[32679]: pgmap v20893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:00:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:00:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:00:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: pgmap v20894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:00:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: pgmap v20895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:01.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: pgmap v20894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: pgmap v20895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:00:02.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:00:02.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:00:02.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:00:02.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: pgmap v20894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:00:02.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: pgmap v20895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:02.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:00:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:04 smithi092 ceph-mon[29156]: pgmap v20896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:04.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38500.064395 secs 2024-04-27T05:00:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:04 smithi189 ceph-mon[32756]: pgmap v20896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38500.064395 secs 2024-04-27T05:00:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:04 smithi156 ceph-mon[32679]: pgmap v20896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38500.064395 secs 2024-04-27T05:00:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37803.028078 secs 2024-04-27T05:00:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37803.028078 secs 2024-04-27T05:00:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37803.028078 secs 2024-04-27T05:00:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:06 smithi092 ceph-mon[29156]: pgmap v20897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:06 smithi189 ceph-mon[32756]: pgmap v20897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:06 smithi156 ceph-mon[32679]: pgmap v20897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:08 smithi092 ceph-mon[29156]: pgmap v20898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:08 smithi189 ceph-mon[32756]: pgmap v20898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:08 smithi156 ceph-mon[32679]: pgmap v20898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:00:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:09 smithi092 ceph-mon[29156]: 18 slow requests, 1 included below; oldest blocked for > 38505.064532 secs 2024-04-27T05:00:09.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:09 smithi092 ceph-mon[29156]: slow request 11520.989396 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:00:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:09 smithi189 ceph-mon[32756]: 18 slow requests, 1 included below; oldest blocked for > 38505.064532 secs 2024-04-27T05:00:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:09 smithi189 ceph-mon[32756]: slow request 11520.989396 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:00:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:09 smithi156 ceph-mon[32679]: 18 slow requests, 1 included below; oldest blocked for > 38505.064532 secs 2024-04-27T05:00:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:09 smithi156 ceph-mon[32679]: slow request 11520.989396 seconds old, received at 2024-04-27T01:48:07.990877+0000: client_request(client.17349:1 getattr pAsLsXsFs #0x1 2024-04-27T01:48:07.983690+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:00:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37808.028195 secs 2024-04-27T05:00:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:10 smithi092 ceph-mon[29156]: pgmap v20899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37808.028195 secs 2024-04-27T05:00:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:10 smithi189 ceph-mon[32756]: pgmap v20899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37808.028195 secs 2024-04-27T05:00:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:10 smithi156 ceph-mon[32679]: pgmap v20899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:00:12.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:12 smithi092 ceph-mon[29156]: pgmap v20900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:00:12.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:12 smithi189 ceph-mon[32756]: pgmap v20900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:00:12.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:12 smithi156 ceph-mon[32679]: pgmap v20900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:00:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:14 smithi092 ceph-mon[29156]: pgmap v20901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:14.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38510.064653 secs 2024-04-27T05:00:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:14 smithi189 ceph-mon[32756]: pgmap v20901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38510.064653 secs 2024-04-27T05:00:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:14 smithi156 ceph-mon[32679]: pgmap v20901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38510.064653 secs 2024-04-27T05:00:15.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37813.028326 secs 2024-04-27T05:00:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37813.028326 secs 2024-04-27T05:00:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37813.028326 secs 2024-04-27T05:00:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:16 smithi092 ceph-mon[29156]: pgmap v20902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:16 smithi189 ceph-mon[32756]: pgmap v20902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:16 smithi156 ceph-mon[32679]: pgmap v20902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:18 smithi092 ceph-mon[29156]: pgmap v20903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:18 smithi189 ceph-mon[32756]: pgmap v20903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:18.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:18 smithi156 ceph-mon[32679]: pgmap v20903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38515.064772 secs 2024-04-27T05:00:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38515.064772 secs 2024-04-27T05:00:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38515.064772 secs 2024-04-27T05:00:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37818.028446 secs 2024-04-27T05:00:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:20 smithi189 ceph-mon[32756]: pgmap v20904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37818.028446 secs 2024-04-27T05:00:20.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:20 smithi156 ceph-mon[32679]: pgmap v20904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37818.028446 secs 2024-04-27T05:00:20.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:20 smithi092 ceph-mon[29156]: pgmap v20904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:22 smithi189 ceph-mon[32756]: pgmap v20905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:22 smithi156 ceph-mon[32679]: pgmap v20905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:22 smithi092 ceph-mon[29156]: pgmap v20905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:24 smithi189 ceph-mon[32756]: pgmap v20906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38520.064887 secs 2024-04-27T05:00:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:24 smithi156 ceph-mon[32679]: pgmap v20906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:24.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38520.064887 secs 2024-04-27T05:00:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:24 smithi092 ceph-mon[29156]: pgmap v20906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:24.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38520.064887 secs 2024-04-27T05:00:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37823.028591 secs 2024-04-27T05:00:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37823.028591 secs 2024-04-27T05:00:25.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37823.028591 secs 2024-04-27T05:00:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:26 smithi189 ceph-mon[32756]: pgmap v20907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:26.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:26 smithi156 ceph-mon[32679]: pgmap v20907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:26 smithi092 ceph-mon[29156]: pgmap v20907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:28 smithi189 ceph-mon[32756]: pgmap v20908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:28 smithi156 ceph-mon[32679]: pgmap v20908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:28 smithi092 ceph-mon[29156]: pgmap v20908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38525.065015 secs 2024-04-27T05:00:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38525.065015 secs 2024-04-27T05:00:29.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38525.065015 secs 2024-04-27T05:00:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37828.028706 secs 2024-04-27T05:00:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:30 smithi189 ceph-mon[32756]: pgmap v20909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37828.028706 secs 2024-04-27T05:00:30.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:30 smithi156 ceph-mon[32679]: pgmap v20909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37828.028706 secs 2024-04-27T05:00:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:30 smithi092 ceph-mon[29156]: pgmap v20909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:32 smithi189 ceph-mon[32756]: pgmap v20910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:32.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:32 smithi156 ceph-mon[32679]: pgmap v20910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:32 smithi092 ceph-mon[29156]: pgmap v20910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:34 smithi189 ceph-mon[32756]: pgmap v20911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38530.065138 secs 2024-04-27T05:00:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:34 smithi156 ceph-mon[32679]: pgmap v20911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38530.065138 secs 2024-04-27T05:00:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:34 smithi092 ceph-mon[29156]: pgmap v20911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38530.065138 secs 2024-04-27T05:00:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37833.028847 secs 2024-04-27T05:00:35.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37833.028847 secs 2024-04-27T05:00:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37833.028847 secs 2024-04-27T05:00:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:36 smithi189 ceph-mon[32756]: pgmap v20912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:36 smithi156 ceph-mon[32679]: pgmap v20912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:36 smithi092 ceph-mon[29156]: pgmap v20912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:38 smithi189 ceph-mon[32756]: pgmap v20913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:38.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:38 smithi156 ceph-mon[32679]: pgmap v20913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:38 smithi092 ceph-mon[29156]: pgmap v20913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38535.065235 secs 2024-04-27T05:00:39.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38535.065235 secs 2024-04-27T05:00:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38535.065235 secs 2024-04-27T05:00:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37838.028934 secs 2024-04-27T05:00:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:40 smithi189 ceph-mon[32756]: pgmap v20914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37838.028934 secs 2024-04-27T05:00:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:40 smithi156 ceph-mon[32679]: pgmap v20914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37838.028934 secs 2024-04-27T05:00:40.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:40 smithi092 ceph-mon[29156]: pgmap v20914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:00:41.274+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:00:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:00:41.274+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:00:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:00:41.274+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:00:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:00:41.274+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 296 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:00:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:42 smithi189 ceph-mon[32756]: pgmap v20915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:42 smithi156 ceph-mon[32679]: pgmap v20915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:42.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:42 smithi092 ceph-mon[29156]: pgmap v20915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:44 smithi189 ceph-mon[32756]: pgmap v20916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38540.065311 secs 2024-04-27T05:00:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:44 smithi156 ceph-mon[32679]: pgmap v20916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:44.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38540.065311 secs 2024-04-27T05:00:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:44 smithi092 ceph-mon[29156]: pgmap v20916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38540.065311 secs 2024-04-27T05:00:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37843.029053 secs 2024-04-27T05:00:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37843.029053 secs 2024-04-27T05:00:45.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37843.029053 secs 2024-04-27T05:00:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:46 smithi189 ceph-mon[32756]: pgmap v20917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:46.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:46 smithi156 ceph-mon[32679]: pgmap v20917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:46 smithi092 ceph-mon[29156]: pgmap v20917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:48 smithi189 ceph-mon[32756]: pgmap v20918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:48.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:48 smithi156 ceph-mon[32679]: pgmap v20918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:48 smithi092 ceph-mon[29156]: pgmap v20918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38545.065449 secs 2024-04-27T05:00:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38545.065449 secs 2024-04-27T05:00:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38545.065449 secs 2024-04-27T05:00:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37848.029137 secs 2024-04-27T05:00:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:50 smithi189 ceph-mon[32756]: pgmap v20919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37848.029137 secs 2024-04-27T05:00:50.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:50 smithi156 ceph-mon[32679]: pgmap v20919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37848.029137 secs 2024-04-27T05:00:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:50 smithi092 ceph-mon[29156]: pgmap v20919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:52 smithi189 ceph-mon[32756]: pgmap v20920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:52.926 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:52 smithi092 ceph-mon[29156]: pgmap v20920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:52 smithi156 ceph-mon[32679]: pgmap v20920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:54 smithi189 ceph-mon[32756]: pgmap v20921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38550.065565 secs 2024-04-27T05:00:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:54 smithi156 ceph-mon[32679]: pgmap v20921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:54.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38550.065565 secs 2024-04-27T05:00:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:54 smithi092 ceph-mon[29156]: pgmap v20921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38550.065565 secs 2024-04-27T05:00:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37853.029256 secs 2024-04-27T05:00:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37853.029256 secs 2024-04-27T05:00:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37853.029256 secs 2024-04-27T05:00:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:56 smithi189 ceph-mon[32756]: pgmap v20922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:56 smithi156 ceph-mon[32679]: pgmap v20922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:56 smithi092 ceph-mon[29156]: pgmap v20922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:00:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:58 smithi189 ceph-mon[32756]: pgmap v20923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:58 smithi156 ceph-mon[32679]: pgmap v20923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:58 smithi092 ceph-mon[29156]: pgmap v20923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:00:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:00:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38555.065678 secs 2024-04-27T05:00:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:00:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38555.065678 secs 2024-04-27T05:00:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:00:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38555.065678 secs 2024-04-27T05:01:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37858.029372 secs 2024-04-27T05:01:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:00 smithi189 ceph-mon[32756]: pgmap v20924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37858.029372 secs 2024-04-27T05:01:00.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:00 smithi156 ceph-mon[32679]: pgmap v20924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37858.029372 secs 2024-04-27T05:01:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:00 smithi092 ceph-mon[29156]: pgmap v20924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:01.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:01 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:01:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:01 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:01:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:01 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:01:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:02 smithi189 ceph-mon[32756]: pgmap v20925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:01:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:01:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:01:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:02 smithi156 ceph-mon[32679]: pgmap v20925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:01:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:01:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:01:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:02 smithi092 ceph-mon[29156]: pgmap v20925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:01:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:01:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:01:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:03 smithi189 ceph-mon[32756]: pgmap v20926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:01:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:03 smithi189 ceph-mon[32756]: pgmap v20927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:03 smithi156 ceph-mon[32679]: pgmap v20926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:01:03.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:03 smithi156 ceph-mon[32679]: pgmap v20927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:03 smithi092 ceph-mon[29156]: pgmap v20926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:01:03.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:03 smithi092 ceph-mon[29156]: pgmap v20927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38560.065749 secs 2024-04-27T05:01:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38560.065749 secs 2024-04-27T05:01:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38560.065749 secs 2024-04-27T05:01:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37863.029481 secs 2024-04-27T05:01:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:05 smithi189 ceph-mon[32756]: pgmap v20928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37863.029481 secs 2024-04-27T05:01:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:05 smithi156 ceph-mon[32679]: pgmap v20928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37863.029481 secs 2024-04-27T05:01:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:05 smithi092 ceph-mon[29156]: pgmap v20928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:07 smithi189 ceph-mon[32756]: pgmap v20929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:07 smithi156 ceph-mon[32679]: pgmap v20929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:07.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:07 smithi092 ceph-mon[29156]: pgmap v20929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:09 smithi189 ceph-mon[32756]: pgmap v20930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:01:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38565.065867 secs 2024-04-27T05:01:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:09 smithi156 ceph-mon[32679]: pgmap v20930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:01:09.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38565.065867 secs 2024-04-27T05:01:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:09 smithi092 ceph-mon[29156]: pgmap v20930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:01:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38565.065867 secs 2024-04-27T05:01:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37868.029558 secs 2024-04-27T05:01:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37868.029558 secs 2024-04-27T05:01:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37868.029558 secs 2024-04-27T05:01:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:11 smithi156 ceph-mon[32679]: pgmap v20931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:11 smithi092 ceph-mon[29156]: pgmap v20931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:12.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:11 smithi189 ceph-mon[32756]: pgmap v20931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:01:13.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:13 smithi156 ceph-mon[32679]: pgmap v20932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:01:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:13 smithi092 ceph-mon[29156]: pgmap v20932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:01:14.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:13 smithi189 ceph-mon[32756]: pgmap v20932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:01:14.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38570.066002 secs 2024-04-27T05:01:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38570.066002 secs 2024-04-27T05:01:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38570.066002 secs 2024-04-27T05:01:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37873.029685 secs 2024-04-27T05:01:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:15 smithi156 ceph-mon[32679]: pgmap v20933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37873.029685 secs 2024-04-27T05:01:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:15 smithi092 ceph-mon[29156]: pgmap v20933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37873.029685 secs 2024-04-27T05:01:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:15 smithi189 ceph-mon[32756]: pgmap v20933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:17 smithi156 ceph-mon[32679]: pgmap v20934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:17 smithi092 ceph-mon[29156]: pgmap v20934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:18.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:17 smithi189 ceph-mon[32756]: pgmap v20934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:19 smithi156 ceph-mon[32679]: pgmap v20935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38575.066121 secs 2024-04-27T05:01:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:19 smithi092 ceph-mon[29156]: pgmap v20935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38575.066121 secs 2024-04-27T05:01:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:19 smithi189 ceph-mon[32756]: pgmap v20935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38575.066121 secs 2024-04-27T05:01:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37878.029806 secs 2024-04-27T05:01:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37878.029806 secs 2024-04-27T05:01:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37878.029806 secs 2024-04-27T05:01:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:21 smithi156 ceph-mon[32679]: pgmap v20936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:21 smithi092 ceph-mon[29156]: pgmap v20936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:22.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:21 smithi189 ceph-mon[32756]: pgmap v20936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:22.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:22 smithi092 ceph-mon[29156]: pgmap v20937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:23.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:22 smithi189 ceph-mon[32756]: pgmap v20937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:23.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:22 smithi156 ceph-mon[32679]: pgmap v20937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:24.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38580.066229 secs 2024-04-27T05:01:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38580.066229 secs 2024-04-27T05:01:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38580.066229 secs 2024-04-27T05:01:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37883.029925 secs 2024-04-27T05:01:25.391 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:25 smithi189 ceph-mon[32756]: pgmap v20938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37883.029925 secs 2024-04-27T05:01:25.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:25 smithi156 ceph-mon[32679]: pgmap v20938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37883.029925 secs 2024-04-27T05:01:25.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:25 smithi092 ceph-mon[29156]: pgmap v20938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:27 smithi092 ceph-mon[29156]: pgmap v20939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:27.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:27 smithi189 ceph-mon[32756]: pgmap v20939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:27.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:27 smithi156 ceph-mon[32679]: pgmap v20939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:29 smithi189 ceph-mon[32756]: pgmap v20940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38585.066353 secs 2024-04-27T05:01:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:29 smithi156 ceph-mon[32679]: pgmap v20940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:29.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38585.066353 secs 2024-04-27T05:01:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:29 smithi092 ceph-mon[29156]: pgmap v20940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38585.066353 secs 2024-04-27T05:01:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37888.030038 secs 2024-04-27T05:01:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37888.030038 secs 2024-04-27T05:01:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37888.030038 secs 2024-04-27T05:01:31.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:31 smithi189 ceph-mon[32756]: pgmap v20941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:31.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:31 smithi156 ceph-mon[32679]: pgmap v20941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:31.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:31 smithi092 ceph-mon[29156]: pgmap v20941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:33.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:33 smithi189 ceph-mon[32756]: pgmap v20942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:33.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:33 smithi156 ceph-mon[32679]: pgmap v20942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:33 smithi092 ceph-mon[29156]: pgmap v20942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38590.066469 secs 2024-04-27T05:01:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38590.066469 secs 2024-04-27T05:01:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38590.066469 secs 2024-04-27T05:01:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37893.030149 secs 2024-04-27T05:01:35.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:35 smithi189 ceph-mon[32756]: pgmap v20943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37893.030149 secs 2024-04-27T05:01:35.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:35 smithi156 ceph-mon[32679]: pgmap v20943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37893.030149 secs 2024-04-27T05:01:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:35 smithi092 ceph-mon[29156]: pgmap v20943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:37.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:37 smithi189 ceph-mon[32756]: pgmap v20944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:37.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:37 smithi156 ceph-mon[32679]: pgmap v20944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:37.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:37 smithi092 ceph-mon[29156]: pgmap v20944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:39.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:39 smithi092 ceph-mon[29156]: pgmap v20945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:39.548 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38595.066565 secs 2024-04-27T05:01:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:39 smithi189 ceph-mon[32756]: pgmap v20945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38595.066565 secs 2024-04-27T05:01:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:39 smithi156 ceph-mon[32679]: pgmap v20945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38595.066565 secs 2024-04-27T05:01:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37898.030314 secs 2024-04-27T05:01:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37898.030314 secs 2024-04-27T05:01:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37898.030314 secs 2024-04-27T05:01:41.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:41 smithi189 ceph-mon[32756]: pgmap v20946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:41 smithi156 ceph-mon[32679]: pgmap v20946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:41 smithi092 ceph-mon[29156]: pgmap v20946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:01:43.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:43 smithi189 ceph-mon[32756]: pgmap v20947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:43.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:43 smithi156 ceph-mon[32679]: pgmap v20947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:43 smithi092 ceph-mon[29156]: pgmap v20947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38600.066693 secs 2024-04-27T05:01:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38600.066693 secs 2024-04-27T05:01:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38600.066693 secs 2024-04-27T05:01:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37903.030307 secs 2024-04-27T05:01:45.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:45 smithi189 ceph-mon[32756]: pgmap v20948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37903.030307 secs 2024-04-27T05:01:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:45 smithi156 ceph-mon[32679]: pgmap v20948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37903.030307 secs 2024-04-27T05:01:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:45 smithi092 ceph-mon[29156]: pgmap v20948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:47.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:47 smithi189 ceph-mon[32756]: pgmap v20949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:47.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:47 smithi156 ceph-mon[32679]: pgmap v20949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:47 smithi092 ceph-mon[29156]: pgmap v20949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:49 smithi189 ceph-mon[32756]: pgmap v20950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38605.066813 secs 2024-04-27T05:01:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:49 smithi156 ceph-mon[32679]: pgmap v20950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38605.066813 secs 2024-04-27T05:01:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:49 smithi092 ceph-mon[29156]: pgmap v20950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38605.066813 secs 2024-04-27T05:01:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37908.030421 secs 2024-04-27T05:01:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37908.030421 secs 2024-04-27T05:01:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37908.030421 secs 2024-04-27T05:01:51.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:51 smithi189 ceph-mon[32756]: pgmap v20951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:51.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:51 smithi156 ceph-mon[32679]: pgmap v20951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:51 smithi092 ceph-mon[29156]: pgmap v20951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:53.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:53 smithi189 ceph-mon[32756]: pgmap v20952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:53.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:53 smithi156 ceph-mon[32679]: pgmap v20952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:53 smithi092 ceph-mon[29156]: pgmap v20952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-04-27T05:01:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38610.066929 secs 2024-04-27T05:01:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38610.066929 secs 2024-04-27T05:01:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38610.066929 secs 2024-04-27T05:01:55.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37913.030500 secs 2024-04-27T05:01:55.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:55 smithi156 ceph-mon[32679]: pgmap v20953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37913.030500 secs 2024-04-27T05:01:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:55 smithi189 ceph-mon[32756]: pgmap v20953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37913.030500 secs 2024-04-27T05:01:55.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:55 smithi092 ceph-mon[29156]: pgmap v20953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-04-27T05:01:57.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:57 smithi189 ceph-mon[32756]: pgmap v20954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:57.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:57 smithi156 ceph-mon[32679]: pgmap v20954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:57 smithi092 ceph-mon[29156]: pgmap v20954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:59 smithi189 ceph-mon[32756]: pgmap v20955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:01:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38615.066993 secs 2024-04-27T05:01:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:59 smithi156 ceph-mon[32679]: pgmap v20955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:59.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:01:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38615.066993 secs 2024-04-27T05:01:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:59 smithi092 ceph-mon[29156]: pgmap v20955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:01:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:01:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38615.066993 secs 2024-04-27T05:02:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37918.030613 secs 2024-04-27T05:02:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37918.030613 secs 2024-04-27T05:02:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37918.030613 secs 2024-04-27T05:02:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:01 smithi189 ceph-mon[32756]: pgmap v20956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:01.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:01 smithi156 ceph-mon[32679]: pgmap v20956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:01.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:01 smithi092 ceph-mon[29156]: pgmap v20956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:02.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:02 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:02:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:02 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:02:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:02 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:02:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:03 smithi189 ceph-mon[32756]: pgmap v20957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:02:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:02:03.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:02:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:03 smithi156 ceph-mon[32679]: pgmap v20957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:03.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:02:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:02:03.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:02:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:03 smithi092 ceph-mon[29156]: pgmap v20957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:02:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:02:03.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:02:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:04 smithi189 ceph-mon[32756]: pgmap v20958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:02:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:04 smithi189 ceph-mon[32756]: pgmap v20959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:02:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38620.067120 secs 2024-04-27T05:02:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:04 smithi156 ceph-mon[32679]: pgmap v20958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:02:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:04 smithi156 ceph-mon[32679]: pgmap v20959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:02:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38620.067120 secs 2024-04-27T05:02:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:04 smithi092 ceph-mon[29156]: pgmap v20958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:02:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:04 smithi092 ceph-mon[29156]: pgmap v20959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:02:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38620.067120 secs 2024-04-27T05:02:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37923.030710 secs 2024-04-27T05:02:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37923.030710 secs 2024-04-27T05:02:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37923.030710 secs 2024-04-27T05:02:06.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:06 smithi189 ceph-mon[32756]: pgmap v20960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:06 smithi156 ceph-mon[32679]: pgmap v20960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:06.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:06 smithi092 ceph-mon[29156]: pgmap v20960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:08.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:08 smithi189 ceph-mon[32756]: pgmap v20961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:08 smithi156 ceph-mon[32679]: pgmap v20961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:08 smithi092 ceph-mon[29156]: pgmap v20961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38625.067234 secs 2024-04-27T05:02:09.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38625.067234 secs 2024-04-27T05:02:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38625.067234 secs 2024-04-27T05:02:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:10 smithi189 ceph-mon[32756]: pgmap v20962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37928.030774 secs 2024-04-27T05:02:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:10 smithi156 ceph-mon[32679]: pgmap v20962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37928.030774 secs 2024-04-27T05:02:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:10 smithi092 ceph-mon[29156]: pgmap v20962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37928.030774 secs 2024-04-27T05:02:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:02:11.285+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:02:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:02:11.285+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:02:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:02:11.285+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:02:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:02:11.285+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 297 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:02:11.495 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:02:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:02:11.205+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:02:11.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:02:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:02:11.205+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:02:11.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:02:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:02:11.205+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:02:11.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:02:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:02:11.205+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:02:11.496 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:02:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:02:11.205+0000 7f2544d37700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:02:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:12 smithi189 ceph-mon[32756]: pgmap v20963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:12 smithi156 ceph-mon[32679]: pgmap v20963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:12 smithi092 ceph-mon[29156]: pgmap v20963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:02:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:14 smithi189 ceph-mon[32756]: pgmap v20964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:02:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38630.067344 secs 2024-04-27T05:02:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:14 smithi156 ceph-mon[32679]: pgmap v20964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:02:14.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38630.067344 secs 2024-04-27T05:02:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:14 smithi092 ceph-mon[29156]: pgmap v20964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:02:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38630.067344 secs 2024-04-27T05:02:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37933.030890 secs 2024-04-27T05:02:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37933.030890 secs 2024-04-27T05:02:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37933.030890 secs 2024-04-27T05:02:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:16 smithi189 ceph-mon[32756]: pgmap v20965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:16 smithi156 ceph-mon[32679]: pgmap v20965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:16 smithi092 ceph-mon[29156]: pgmap v20965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:18 smithi189 ceph-mon[32756]: pgmap v20966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:18.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:18 smithi156 ceph-mon[32679]: pgmap v20966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:18 smithi092 ceph-mon[29156]: pgmap v20966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:19.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38635.067462 secs 2024-04-27T05:02:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38635.067462 secs 2024-04-27T05:02:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38635.067462 secs 2024-04-27T05:02:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:20 smithi156 ceph-mon[32679]: pgmap v20967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:20.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37938.031046 secs 2024-04-27T05:02:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:20 smithi092 ceph-mon[29156]: pgmap v20967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37938.031046 secs 2024-04-27T05:02:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:20 smithi189 ceph-mon[32756]: pgmap v20967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37938.031046 secs 2024-04-27T05:02:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:22 smithi156 ceph-mon[32679]: pgmap v20968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:22 smithi092 ceph-mon[29156]: pgmap v20968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:22 smithi189 ceph-mon[32756]: pgmap v20968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:24 smithi156 ceph-mon[32679]: pgmap v20969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:24.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38640.067578 secs 2024-04-27T05:02:24.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:24 smithi189 ceph-mon[32756]: pgmap v20969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:24.692 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38640.067578 secs 2024-04-27T05:02:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:24 smithi092 ceph-mon[29156]: pgmap v20969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:02:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38640.067578 secs 2024-04-27T05:02:25.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37943.031120 secs 2024-04-27T05:02:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37943.031120 secs 2024-04-27T05:02:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37943.031120 secs 2024-04-27T05:02:26.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:26 smithi156 ceph-mon[32679]: pgmap v20970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:26.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:26 smithi092 ceph-mon[29156]: pgmap v20970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:26 smithi189 ceph-mon[32756]: pgmap v20970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:02:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:28 smithi156 ceph-mon[32679]: pgmap v20971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:28 smithi092 ceph-mon[29156]: pgmap v20971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:28.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:28 smithi189 ceph-mon[32756]: pgmap v20971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38645.067717 secs 2024-04-27T05:02:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38645.067717 secs 2024-04-27T05:02:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38645.067717 secs 2024-04-27T05:02:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:30 smithi156 ceph-mon[32679]: pgmap v20972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:30.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37948.031228 secs 2024-04-27T05:02:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:30 smithi092 ceph-mon[29156]: pgmap v20972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:30.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37948.031228 secs 2024-04-27T05:02:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:30 smithi189 ceph-mon[32756]: pgmap v20972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37948.031228 secs 2024-04-27T05:02:32.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:32 smithi156 ceph-mon[32679]: pgmap v20973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:32 smithi092 ceph-mon[29156]: pgmap v20973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:32 smithi189 ceph-mon[32756]: pgmap v20973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:34 smithi156 ceph-mon[32679]: pgmap v20974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:34.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38650.067852 secs 2024-04-27T05:02:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:34 smithi092 ceph-mon[29156]: pgmap v20974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:34.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38650.067852 secs 2024-04-27T05:02:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:34 smithi189 ceph-mon[32756]: pgmap v20974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38650.067852 secs 2024-04-27T05:02:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37953.031349 secs 2024-04-27T05:02:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37953.031349 secs 2024-04-27T05:02:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37953.031349 secs 2024-04-27T05:02:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:36 smithi156 ceph-mon[32679]: pgmap v20975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:36 smithi092 ceph-mon[29156]: pgmap v20975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:36 smithi189 ceph-mon[32756]: pgmap v20975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:38 smithi156 ceph-mon[32679]: pgmap v20976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:38 smithi092 ceph-mon[29156]: pgmap v20976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:38 smithi189 ceph-mon[32756]: pgmap v20976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:39.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38655.067969 secs 2024-04-27T05:02:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38655.067969 secs 2024-04-27T05:02:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38655.067969 secs 2024-04-27T05:02:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:40 smithi092 ceph-mon[29156]: pgmap v20977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:40.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37958.031394 secs 2024-04-27T05:02:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:40 smithi189 ceph-mon[32756]: pgmap v20977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37958.031394 secs 2024-04-27T05:02:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:40 smithi156 ceph-mon[32679]: pgmap v20977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37958.031394 secs 2024-04-27T05:02:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:42 smithi092 ceph-mon[29156]: pgmap v20978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:42.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:42 smithi189 ceph-mon[32756]: pgmap v20978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:42 smithi156 ceph-mon[32679]: pgmap v20978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:44 smithi092 ceph-mon[29156]: pgmap v20979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:44.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38660.068092 secs 2024-04-27T05:02:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:44 smithi189 ceph-mon[32756]: pgmap v20979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38660.068092 secs 2024-04-27T05:02:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:44 smithi156 ceph-mon[32679]: pgmap v20979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38660.068092 secs 2024-04-27T05:02:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37963.031506 secs 2024-04-27T05:02:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37963.031506 secs 2024-04-27T05:02:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37963.031506 secs 2024-04-27T05:02:46.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:46 smithi092 ceph-mon[29156]: pgmap v20980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:46 smithi189 ceph-mon[32756]: pgmap v20980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:46 smithi156 ceph-mon[32679]: pgmap v20980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:48 smithi092 ceph-mon[29156]: pgmap v20981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:48 smithi189 ceph-mon[32756]: pgmap v20981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:48 smithi156 ceph-mon[32679]: pgmap v20981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38665.068219 secs 2024-04-27T05:02:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38665.068219 secs 2024-04-27T05:02:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38665.068219 secs 2024-04-27T05:02:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:50 smithi092 ceph-mon[29156]: pgmap v20982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:50.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37968.031626 secs 2024-04-27T05:02:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:50 smithi189 ceph-mon[32756]: pgmap v20982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37968.031626 secs 2024-04-27T05:02:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:50 smithi156 ceph-mon[32679]: pgmap v20982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37968.031626 secs 2024-04-27T05:02:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:52 smithi092 ceph-mon[29156]: pgmap v20983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:52 smithi189 ceph-mon[32756]: pgmap v20983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:52.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:52 smithi156 ceph-mon[32679]: pgmap v20983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:54 smithi092 ceph-mon[29156]: pgmap v20984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:54.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38670.068322 secs 2024-04-27T05:02:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:54 smithi189 ceph-mon[32756]: pgmap v20984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38670.068322 secs 2024-04-27T05:02:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:54 smithi156 ceph-mon[32679]: pgmap v20984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38670.068322 secs 2024-04-27T05:02:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37973.031705 secs 2024-04-27T05:02:55.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37973.031705 secs 2024-04-27T05:02:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37973.031705 secs 2024-04-27T05:02:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:56 smithi092 ceph-mon[29156]: pgmap v20985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:56 smithi189 ceph-mon[32756]: pgmap v20985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:56 smithi156 ceph-mon[32679]: pgmap v20985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:02:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:58 smithi092 ceph-mon[29156]: pgmap v20986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:58 smithi189 ceph-mon[32756]: pgmap v20986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:58 smithi156 ceph-mon[32679]: pgmap v20986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:02:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:02:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38675.068470 secs 2024-04-27T05:02:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:02:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38675.068470 secs 2024-04-27T05:02:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:02:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38675.068470 secs 2024-04-27T05:03:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:00 smithi092 ceph-mon[29156]: pgmap v20987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:00.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37978.031784 secs 2024-04-27T05:03:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:00 smithi189 ceph-mon[32756]: pgmap v20987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37978.031784 secs 2024-04-27T05:03:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:00 smithi156 ceph-mon[32679]: pgmap v20987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37978.031784 secs 2024-04-27T05:03:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:02 smithi092 ceph-mon[29156]: pgmap v20988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:02 smithi189 ceph-mon[32756]: pgmap v20988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:02 smithi156 ceph-mon[32679]: pgmap v20988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:03.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:03 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:03:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:03 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:03:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:03 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:03:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:04 smithi189 ceph-mon[32756]: pgmap v20989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:03:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:03:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:03:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38680.068532 secs 2024-04-27T05:03:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:04 smithi156 ceph-mon[32679]: pgmap v20989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:03:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:03:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:03:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38680.068532 secs 2024-04-27T05:03:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:04 smithi092 ceph-mon[29156]: pgmap v20989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:03:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:03:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:03:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38680.068532 secs 2024-04-27T05:03:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:05 smithi189 ceph-mon[32756]: pgmap v20990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:05 smithi189 ceph-mon[32756]: pgmap v20991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37983.031894 secs 2024-04-27T05:03:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:05 smithi156 ceph-mon[32679]: pgmap v20990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:05 smithi156 ceph-mon[32679]: pgmap v20991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37983.031894 secs 2024-04-27T05:03:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:05 smithi092 ceph-mon[29156]: pgmap v20990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:05 smithi092 ceph-mon[29156]: pgmap v20991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:05.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37983.031894 secs 2024-04-27T05:03:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:07 smithi189 ceph-mon[32756]: pgmap v20992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:07 smithi156 ceph-mon[32679]: pgmap v20992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:07 smithi092 ceph-mon[29156]: pgmap v20992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:09.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:09 smithi092 ceph-mon[29156]: pgmap v20993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T05:03:09.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38685.068645 secs 2024-04-27T05:03:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:09 smithi189 ceph-mon[32756]: pgmap v20993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T05:03:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38685.068645 secs 2024-04-27T05:03:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:09 smithi156 ceph-mon[32679]: pgmap v20993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-27T05:03:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38685.068645 secs 2024-04-27T05:03:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37988.032011 secs 2024-04-27T05:03:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37988.032011 secs 2024-04-27T05:03:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37988.032011 secs 2024-04-27T05:03:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:11 smithi189 ceph-mon[32756]: pgmap v20994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:11 smithi156 ceph-mon[32679]: pgmap v20994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:11 smithi092 ceph-mon[29156]: pgmap v20994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:13.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:13 smithi092 ceph-mon[29156]: pgmap v20995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:13.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:13 smithi189 ceph-mon[32756]: pgmap v20995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:13 smithi156 ceph-mon[32679]: pgmap v20995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:03:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38690.068797 secs 2024-04-27T05:03:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38690.068797 secs 2024-04-27T05:03:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38690.068797 secs 2024-04-27T05:03:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:15 smithi189 ceph-mon[32756]: pgmap v20996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:03:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:15 smithi189 ceph-mon[32756]: 31 slow requests, 2 included below; oldest blocked for > 37993.032119 secs 2024-04-27T05:03:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:15 smithi189 ceph-mon[32756]: slow request 5764.529475 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:15 smithi189 ceph-mon[32756]: slow request 2883.778423 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:15 smithi156 ceph-mon[32679]: pgmap v20996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:03:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:15 smithi156 ceph-mon[32679]: 31 slow requests, 2 included below; oldest blocked for > 37993.032119 secs 2024-04-27T05:03:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:15 smithi156 ceph-mon[32679]: slow request 5764.529475 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:15 smithi156 ceph-mon[32679]: slow request 2883.778423 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:15 smithi092 ceph-mon[29156]: pgmap v20996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:03:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:15 smithi092 ceph-mon[29156]: 31 slow requests, 2 included below; oldest blocked for > 37993.032119 secs 2024-04-27T05:03:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:15 smithi092 ceph-mon[29156]: slow request 5764.529475 seconds old, received at 2024-04-27T03:27:09.648678+0000: client_request(client.17463:1 getattr pAsLsXsFs #0x1 2024-04-27T03:27:09.644256+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:15 smithi092 ceph-mon[29156]: slow request 2883.778423 seconds old, received at 2024-04-27T04:15:10.399730+0000: client_request(client.17517:1 getattr pAsLsXsFs #0x1 2024-04-27T04:15:10.392450+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:17 smithi189 ceph-mon[32756]: pgmap v20997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:17 smithi156 ceph-mon[32679]: pgmap v20997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:17 smithi092 ceph-mon[29156]: pgmap v20997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:19 smithi189 ceph-mon[32756]: pgmap v20998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38695.068888 secs 2024-04-27T05:03:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:19 smithi156 ceph-mon[32679]: pgmap v20998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:19.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38695.068888 secs 2024-04-27T05:03:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:19 smithi092 ceph-mon[29156]: pgmap v20998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38695.068888 secs 2024-04-27T05:03:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 37998.032234 secs 2024-04-27T05:03:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 37998.032234 secs 2024-04-27T05:03:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 37998.032234 secs 2024-04-27T05:03:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:21 smithi189 ceph-mon[32756]: pgmap v20999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:21 smithi156 ceph-mon[32679]: pgmap v20999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:21 smithi092 ceph-mon[29156]: pgmap v20999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:23.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:23 smithi189 ceph-mon[32756]: pgmap v21000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:23 smithi156 ceph-mon[32679]: pgmap v21000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:23 smithi092 ceph-mon[29156]: pgmap v21000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38700.068935 secs 2024-04-27T05:03:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38700.068935 secs 2024-04-27T05:03:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38700.068935 secs 2024-04-27T05:03:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:25 smithi156 ceph-mon[32679]: pgmap v21001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38003.032379 secs 2024-04-27T05:03:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:25 smithi189 ceph-mon[32756]: pgmap v21001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38003.032379 secs 2024-04-27T05:03:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:25 smithi092 ceph-mon[29156]: pgmap v21001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38003.032379 secs 2024-04-27T05:03:27.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:27 smithi189 ceph-mon[32756]: pgmap v21002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:27 smithi156 ceph-mon[32679]: pgmap v21002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:27 smithi092 ceph-mon[29156]: pgmap v21002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:29 smithi189 ceph-mon[32756]: pgmap v21003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38705.069072 secs 2024-04-27T05:03:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:29 smithi156 ceph-mon[32679]: pgmap v21003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38705.069072 secs 2024-04-27T05:03:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:29 smithi092 ceph-mon[29156]: pgmap v21003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38705.069072 secs 2024-04-27T05:03:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38008.032502 secs 2024-04-27T05:03:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38008.032502 secs 2024-04-27T05:03:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38008.032502 secs 2024-04-27T05:03:31.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:31 smithi189 ceph-mon[32756]: pgmap v21004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:31 smithi156 ceph-mon[32679]: pgmap v21004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:31 smithi092 ceph-mon[29156]: pgmap v21004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:33 smithi189 ceph-mon[32756]: pgmap v21005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:33 smithi156 ceph-mon[32679]: pgmap v21005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:33 smithi092 ceph-mon[29156]: pgmap v21005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38710.069152 secs 2024-04-27T05:03:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38710.069152 secs 2024-04-27T05:03:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38710.069152 secs 2024-04-27T05:03:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:35 smithi189 ceph-mon[32756]: pgmap v21006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:35.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38013.032620 secs 2024-04-27T05:03:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:35 smithi156 ceph-mon[32679]: pgmap v21006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38013.032620 secs 2024-04-27T05:03:35.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:35 smithi092 ceph-mon[29156]: pgmap v21006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:35.998 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38013.032620 secs 2024-04-27T05:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900001095) for more than 900000000 us, fault. 2024-04-27T05:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1ca803df70 tx=0x7f1ca806e000 comp rx=0 tx=0).stop 2024-04-27T05:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T05:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T05:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T05:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.052+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.053+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca809f070 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T05:03:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.101+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T05:03:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.101+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T05:03:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.101+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T05:03:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.101+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=41 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T05:03:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.101+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:03:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.102+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T05:03:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:36.102+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T05:03:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:37 smithi189 ceph-mon[32756]: pgmap v21007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:37 smithi156 ceph-mon[32679]: pgmap v21007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:37 smithi092 ceph-mon[29156]: pgmap v21007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:39 smithi189 ceph-mon[32756]: pgmap v21008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38715.069215 secs 2024-04-27T05:03:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:39 smithi156 ceph-mon[32679]: pgmap v21008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38715.069215 secs 2024-04-27T05:03:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:39 smithi092 ceph-mon[29156]: pgmap v21008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38715.069215 secs 2024-04-27T05:03:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38018.032738 secs 2024-04-27T05:03:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38018.032738 secs 2024-04-27T05:03:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38018.032738 secs 2024-04-27T05:03:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:41.297+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:03:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:41.297+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:03:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:41.297+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006560 con 0x5617fb906f00 2024-04-27T05:03:41.300 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:03:41.298+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 298 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:03:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:41 smithi189 ceph-mon[32756]: pgmap v21009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:41 smithi156 ceph-mon[32679]: pgmap v21009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:41 smithi092 ceph-mon[29156]: pgmap v21009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:43.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:43 smithi189 ceph-mon[32756]: pgmap v21010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:43.934 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:43 smithi092 ceph-mon[29156]: pgmap v21010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:43 smithi156 ceph-mon[32679]: pgmap v21010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38720.069328 secs 2024-04-27T05:03:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38720.069328 secs 2024-04-27T05:03:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38720.069328 secs 2024-04-27T05:03:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:45 smithi189 ceph-mon[32756]: pgmap v21011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:45 smithi189 ceph-mon[32756]: 31 slow requests, 1 included below; oldest blocked for > 38023.032855 secs 2024-04-27T05:03:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:45 smithi189 ceph-mon[32756]: slow request 723.137233 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:45 smithi156 ceph-mon[32679]: pgmap v21011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:45 smithi156 ceph-mon[32679]: 31 slow requests, 1 included below; oldest blocked for > 38023.032855 secs 2024-04-27T05:03:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:45 smithi156 ceph-mon[32679]: slow request 723.137233 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:45 smithi092 ceph-mon[29156]: pgmap v21011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:45 smithi092 ceph-mon[29156]: 31 slow requests, 1 included below; oldest blocked for > 38023.032855 secs 2024-04-27T05:03:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:45 smithi092 ceph-mon[29156]: slow request 723.137233 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:03:47.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:47 smithi189 ceph-mon[32756]: pgmap v21012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:47.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:47 smithi156 ceph-mon[32679]: pgmap v21012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:47 smithi092 ceph-mon[29156]: pgmap v21012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:49 smithi189 ceph-mon[32756]: pgmap v21013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38725.069443 secs 2024-04-27T05:03:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:49 smithi156 ceph-mon[32679]: pgmap v21013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:49.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38725.069443 secs 2024-04-27T05:03:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:49 smithi092 ceph-mon[29156]: pgmap v21013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38725.069443 secs 2024-04-27T05:03:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38028.032925 secs 2024-04-27T05:03:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38028.032925 secs 2024-04-27T05:03:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38028.032925 secs 2024-04-27T05:03:51.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:51 smithi189 ceph-mon[32756]: pgmap v21014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:51 smithi156 ceph-mon[32679]: pgmap v21014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:51 smithi092 ceph-mon[29156]: pgmap v21014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:53 smithi189 ceph-mon[32756]: pgmap v21015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:53 smithi156 ceph-mon[32679]: pgmap v21015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:53 smithi092 ceph-mon[29156]: pgmap v21015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38730.069559 secs 2024-04-27T05:03:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38730.069559 secs 2024-04-27T05:03:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38730.069559 secs 2024-04-27T05:03:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:55 smithi156 ceph-mon[32679]: pgmap v21016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:55.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38033.033062 secs 2024-04-27T05:03:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:55 smithi092 ceph-mon[29156]: pgmap v21016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38033.033062 secs 2024-04-27T05:03:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:55 smithi189 ceph-mon[32756]: pgmap v21016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:03:56.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38033.033062 secs 2024-04-27T05:03:57.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:57 smithi156 ceph-mon[32679]: pgmap v21017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:57 smithi092 ceph-mon[29156]: pgmap v21017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:58.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:57 smithi189 ceph-mon[32756]: pgmap v21017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:59 smithi156 ceph-mon[32679]: pgmap v21018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:59.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:03:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38735.069674 secs 2024-04-27T05:03:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:59 smithi092 ceph-mon[29156]: pgmap v21018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:03:59.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:03:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38735.069674 secs 2024-04-27T05:04:00.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:59 smithi189 ceph-mon[32756]: pgmap v21018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:00.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:03:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38735.069674 secs 2024-04-27T05:04:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38038.033180 secs 2024-04-27T05:04:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38038.033180 secs 2024-04-27T05:04:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38038.033180 secs 2024-04-27T05:04:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:01 smithi156 ceph-mon[32679]: pgmap v21019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:01 smithi092 ceph-mon[29156]: pgmap v21019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:02.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:01 smithi189 ceph-mon[32756]: pgmap v21019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:03 smithi156 ceph-mon[32679]: pgmap v21020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:03 smithi092 ceph-mon[29156]: pgmap v21020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:03 smithi189 ceph-mon[32756]: pgmap v21020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38740.069765 secs 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:04 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:04:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38740.069765 secs 2024-04-27T05:04:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:04 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38740.069765 secs 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:04 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:05 smithi156 ceph-mon[32679]: pgmap v21021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38043.033242 secs 2024-04-27T05:04:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:05 smithi092 ceph-mon[29156]: pgmap v21021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38043.033242 secs 2024-04-27T05:04:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:05 smithi189 ceph-mon[32756]: pgmap v21021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:06.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38043.033242 secs 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: pgmap v21022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:04:07.747 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: pgmap v21022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:04:07.891 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:04:07.892 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: pgmap v21022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:04:07.937 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:04:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:04:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: pgmap v21023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:08.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:08 smithi092 ceph-mon[29156]: pgmap v21024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: pgmap v21023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:08 smithi189 ceph-mon[32756]: pgmap v21024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: pgmap v21023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:08 smithi156 ceph-mon[32679]: pgmap v21024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38745.069889 secs 2024-04-27T05:04:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38745.069889 secs 2024-04-27T05:04:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38745.069889 secs 2024-04-27T05:04:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38048.033359 secs 2024-04-27T05:04:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:10 smithi092 ceph-mon[29156]: pgmap v21025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38048.033359 secs 2024-04-27T05:04:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:10 smithi189 ceph-mon[32756]: pgmap v21025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38048.033359 secs 2024-04-27T05:04:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:10 smithi156 ceph-mon[32679]: pgmap v21025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:12 smithi092 ceph-mon[29156]: pgmap v21026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:12 smithi189 ceph-mon[32756]: pgmap v21026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:12 smithi156 ceph-mon[32679]: pgmap v21026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:14 smithi092 ceph-mon[29156]: pgmap v21027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:04:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38750.069956 secs 2024-04-27T05:04:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:14 smithi189 ceph-mon[32756]: pgmap v21027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:04:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38750.069956 secs 2024-04-27T05:04:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:14 smithi156 ceph-mon[32679]: pgmap v21027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:04:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38750.069956 secs 2024-04-27T05:04:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38053.033459 secs 2024-04-27T05:04:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38053.033459 secs 2024-04-27T05:04:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38053.033459 secs 2024-04-27T05:04:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:16 smithi092 ceph-mon[29156]: pgmap v21028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:16 smithi189 ceph-mon[32756]: pgmap v21028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:16 smithi156 ceph-mon[32679]: pgmap v21028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:04:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:18 smithi092 ceph-mon[29156]: pgmap v21029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:04:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:18 smithi189 ceph-mon[32756]: pgmap v21029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:04:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:18 smithi156 ceph-mon[32679]: pgmap v21029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:04:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38755.070070 secs 2024-04-27T05:04:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38755.070070 secs 2024-04-27T05:04:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38755.070070 secs 2024-04-27T05:04:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38058.033544 secs 2024-04-27T05:04:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:20 smithi092 ceph-mon[29156]: pgmap v21030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38058.033544 secs 2024-04-27T05:04:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:20 smithi189 ceph-mon[32756]: pgmap v21030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38058.033544 secs 2024-04-27T05:04:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:20 smithi156 ceph-mon[32679]: pgmap v21030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:22 smithi092 ceph-mon[29156]: pgmap v21031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:22 smithi189 ceph-mon[32756]: pgmap v21031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:22 smithi156 ceph-mon[32679]: pgmap v21031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:24 smithi092 ceph-mon[29156]: pgmap v21032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:24.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38760.070175 secs 2024-04-27T05:04:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:24 smithi189 ceph-mon[32756]: pgmap v21032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38760.070175 secs 2024-04-27T05:04:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:24 smithi156 ceph-mon[32679]: pgmap v21032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38760.070175 secs 2024-04-27T05:04:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38063.033664 secs 2024-04-27T05:04:25.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38063.033664 secs 2024-04-27T05:04:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38063.033664 secs 2024-04-27T05:04:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:26 smithi092 ceph-mon[29156]: pgmap v21033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:26.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:26 smithi189 ceph-mon[32756]: pgmap v21033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:26 smithi156 ceph-mon[32679]: pgmap v21033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:28 smithi092 ceph-mon[29156]: pgmap v21034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:28 smithi189 ceph-mon[32756]: pgmap v21034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:28 smithi156 ceph-mon[32679]: pgmap v21034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38765.070296 secs 2024-04-27T05:04:29.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38765.070296 secs 2024-04-27T05:04:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38765.070296 secs 2024-04-27T05:04:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38068.033780 secs 2024-04-27T05:04:30.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:30 smithi189 ceph-mon[32756]: pgmap v21035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38068.033780 secs 2024-04-27T05:04:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:30 smithi156 ceph-mon[32679]: pgmap v21035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38068.033780 secs 2024-04-27T05:04:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:30 smithi092 ceph-mon[29156]: pgmap v21035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:32.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:32 smithi189 ceph-mon[32756]: pgmap v21036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:32 smithi156 ceph-mon[32679]: pgmap v21036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:32 smithi092 ceph-mon[29156]: pgmap v21036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:34 smithi189 ceph-mon[32756]: pgmap v21037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38770.070433 secs 2024-04-27T05:04:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:34 smithi156 ceph-mon[32679]: pgmap v21037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38770.070433 secs 2024-04-27T05:04:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:34 smithi092 ceph-mon[29156]: pgmap v21037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38770.070433 secs 2024-04-27T05:04:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38073.033916 secs 2024-04-27T05:04:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38073.033916 secs 2024-04-27T05:04:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38073.033916 secs 2024-04-27T05:04:36.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:36 smithi189 ceph-mon[32756]: pgmap v21038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:36 smithi156 ceph-mon[32679]: pgmap v21038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:36 smithi092 ceph-mon[29156]: pgmap v21038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:38.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:38 smithi189 ceph-mon[32756]: pgmap v21039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:38 smithi156 ceph-mon[32679]: pgmap v21039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:38 smithi092 ceph-mon[29156]: pgmap v21039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:39.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38775.070586 secs 2024-04-27T05:04:39.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38775.070586 secs 2024-04-27T05:04:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38775.070586 secs 2024-04-27T05:04:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38078.034032 secs 2024-04-27T05:04:40.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:40 smithi189 ceph-mon[32756]: pgmap v21040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38078.034032 secs 2024-04-27T05:04:40.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:40 smithi156 ceph-mon[32679]: pgmap v21040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38078.034032 secs 2024-04-27T05:04:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:40 smithi092 ceph-mon[29156]: pgmap v21040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:42 smithi189 ceph-mon[32756]: pgmap v21041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:42 smithi156 ceph-mon[32679]: pgmap v21041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:42 smithi092 ceph-mon[29156]: pgmap v21041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:44 smithi189 ceph-mon[32756]: pgmap v21042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38780.070717 secs 2024-04-27T05:04:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:44 smithi156 ceph-mon[32679]: pgmap v21042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38780.070717 secs 2024-04-27T05:04:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:44 smithi092 ceph-mon[29156]: pgmap v21042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:04:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38780.070717 secs 2024-04-27T05:04:45.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38083.034153 secs 2024-04-27T05:04:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38083.034153 secs 2024-04-27T05:04:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38083.034153 secs 2024-04-27T05:04:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:46 smithi189 ceph-mon[32756]: pgmap v21043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:46 smithi156 ceph-mon[32679]: pgmap v21043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:46 smithi092 ceph-mon[29156]: pgmap v21043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:04:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:48 smithi189 ceph-mon[32756]: pgmap v21044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:48 smithi156 ceph-mon[32679]: pgmap v21044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:48 smithi092 ceph-mon[29156]: pgmap v21044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38785.070840 secs 2024-04-27T05:04:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38785.070840 secs 2024-04-27T05:04:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38785.070840 secs 2024-04-27T05:04:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38088.034266 secs 2024-04-27T05:04:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:50 smithi189 ceph-mon[32756]: pgmap v21045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38088.034266 secs 2024-04-27T05:04:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:50 smithi156 ceph-mon[32679]: pgmap v21045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38088.034266 secs 2024-04-27T05:04:50.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:50 smithi092 ceph-mon[29156]: pgmap v21045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:52.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:52 smithi189 ceph-mon[32756]: pgmap v21046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:52 smithi156 ceph-mon[32679]: pgmap v21046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:52.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:52 smithi092 ceph-mon[29156]: pgmap v21046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:54 smithi189 ceph-mon[32756]: pgmap v21047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:54.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38790.070943 secs 2024-04-27T05:04:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:54 smithi156 ceph-mon[32679]: pgmap v21047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38790.070943 secs 2024-04-27T05:04:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:54 smithi092 ceph-mon[29156]: pgmap v21047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38790.070943 secs 2024-04-27T05:04:55.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38093.034381 secs 2024-04-27T05:04:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38093.034381 secs 2024-04-27T05:04:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38093.034381 secs 2024-04-27T05:04:56.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:56 smithi189 ceph-mon[32756]: pgmap v21048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:56 smithi156 ceph-mon[32679]: pgmap v21048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:56 smithi092 ceph-mon[29156]: pgmap v21048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:04:58.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:58 smithi189 ceph-mon[32756]: pgmap v21049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:58 smithi156 ceph-mon[32679]: pgmap v21049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:58 smithi092 ceph-mon[29156]: pgmap v21049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:04:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:04:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38795.071068 secs 2024-04-27T05:04:59.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:04:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38795.071068 secs 2024-04-27T05:04:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:04:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38795.071068 secs 2024-04-27T05:05:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38098.034459 secs 2024-04-27T05:05:00.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:00 smithi189 ceph-mon[32756]: pgmap v21050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38098.034459 secs 2024-04-27T05:05:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:00 smithi156 ceph-mon[32679]: pgmap v21050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38098.034459 secs 2024-04-27T05:05:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:00 smithi092 ceph-mon[29156]: pgmap v21050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:02.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:02 smithi189 ceph-mon[32756]: pgmap v21051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:02 smithi156 ceph-mon[32679]: pgmap v21051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:02 smithi092 ceph-mon[29156]: pgmap v21051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:04 smithi189 ceph-mon[32756]: pgmap v21052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:04.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38800.071177 secs 2024-04-27T05:05:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:04 smithi156 ceph-mon[32679]: pgmap v21052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38800.071177 secs 2024-04-27T05:05:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:04 smithi092 ceph-mon[29156]: pgmap v21052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38800.071177 secs 2024-04-27T05:05:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38103.034595 secs 2024-04-27T05:05:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38103.034595 secs 2024-04-27T05:05:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38103.034595 secs 2024-04-27T05:05:06.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:06 smithi189 ceph-mon[32756]: pgmap v21053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:06 smithi156 ceph-mon[32679]: pgmap v21053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:06 smithi092 ceph-mon[29156]: pgmap v21053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:07 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:05:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:07 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:05:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:07 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:05:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:08 smithi189 ceph-mon[32756]: pgmap v21054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:05:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:05:08.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:08 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:05:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:08 smithi156 ceph-mon[32679]: pgmap v21054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:05:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:05:08.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:08 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:05:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:08 smithi092 ceph-mon[29156]: pgmap v21054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:05:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:05:08.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:08 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:09 smithi189 ceph-mon[32756]: pgmap v21055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:09 smithi189 ceph-mon[32756]: pgmap v21056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:05:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38805.071257 secs 2024-04-27T05:05:09.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:09 smithi092 ceph-mon[29156]: pgmap v21055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:05:09.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:09 smithi092 ceph-mon[29156]: pgmap v21056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:05:09.897 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38805.071257 secs 2024-04-27T05:05:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:09 smithi156 ceph-mon[32679]: pgmap v21055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:05:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:09 smithi156 ceph-mon[32679]: pgmap v21056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:05:09.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38805.071257 secs 2024-04-27T05:05:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:10 smithi189 ceph-mon[32756]: 31 slow requests, 1 included below; oldest blocked for > 38108.034712 secs 2024-04-27T05:05:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:10 smithi189 ceph-mon[32756]: slow request 11521.067546 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:05:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:10 smithi156 ceph-mon[32679]: 31 slow requests, 1 included below; oldest blocked for > 38108.034712 secs 2024-04-27T05:05:10.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:10 smithi156 ceph-mon[32679]: slow request 11521.067546 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:05:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:10 smithi092 ceph-mon[29156]: 31 slow requests, 1 included below; oldest blocked for > 38108.034712 secs 2024-04-27T05:05:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:10 smithi092 ceph-mon[29156]: slow request 11521.067546 seconds old, received at 2024-04-27T01:53:08.113200+0000: client_request(client.17355:1 getattr pAsLsXsFs #0x1 2024-04-27T01:53:08.106313+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:05:11.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:11 smithi189 ceph-mon[32756]: pgmap v21057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:11 smithi156 ceph-mon[32679]: pgmap v21057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:11 smithi092 ceph-mon[29156]: pgmap v21057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:13 smithi189 ceph-mon[32756]: pgmap v21058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:13 smithi156 ceph-mon[32679]: pgmap v21058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:13 smithi092 ceph-mon[29156]: pgmap v21058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:14.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38810.071374 secs 2024-04-27T05:05:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38810.071374 secs 2024-04-27T05:05:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38810.071374 secs 2024-04-27T05:05:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:15 smithi189 ceph-mon[32756]: pgmap v21059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38113.034845 secs 2024-04-27T05:05:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:15 smithi156 ceph-mon[32679]: pgmap v21059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38113.034845 secs 2024-04-27T05:05:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:15 smithi092 ceph-mon[29156]: pgmap v21059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38113.034845 secs 2024-04-27T05:05:17.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:17 smithi189 ceph-mon[32756]: pgmap v21060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:17 smithi156 ceph-mon[32679]: pgmap v21060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:17 smithi092 ceph-mon[29156]: pgmap v21060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:05:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:19 smithi189 ceph-mon[32756]: pgmap v21061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:05:19.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38815.071477 secs 2024-04-27T05:05:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:19 smithi156 ceph-mon[32679]: pgmap v21061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:05:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38815.071477 secs 2024-04-27T05:05:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:19 smithi092 ceph-mon[29156]: pgmap v21061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:05:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38815.071477 secs 2024-04-27T05:05:20.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38118.034906 secs 2024-04-27T05:05:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38118.034906 secs 2024-04-27T05:05:20.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38118.034906 secs 2024-04-27T05:05:21.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:21 smithi189 ceph-mon[32756]: pgmap v21062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:21 smithi156 ceph-mon[32679]: pgmap v21062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:21 smithi092 ceph-mon[29156]: pgmap v21062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:23 smithi156 ceph-mon[32679]: pgmap v21063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:23 smithi092 ceph-mon[29156]: pgmap v21063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:23 smithi189 ceph-mon[32756]: pgmap v21063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38820.071595 secs 2024-04-27T05:05:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38820.071595 secs 2024-04-27T05:05:25.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38820.071595 secs 2024-04-27T05:05:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:25 smithi156 ceph-mon[32679]: pgmap v21064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38123.035014 secs 2024-04-27T05:05:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:25 smithi092 ceph-mon[29156]: pgmap v21064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38123.035014 secs 2024-04-27T05:05:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:25 smithi189 ceph-mon[32756]: pgmap v21064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:26.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38123.035014 secs 2024-04-27T05:05:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:27 smithi156 ceph-mon[32679]: pgmap v21065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:27 smithi092 ceph-mon[29156]: pgmap v21065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:27 smithi189 ceph-mon[32756]: pgmap v21065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:29 smithi156 ceph-mon[32679]: pgmap v21066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38825.071707 secs 2024-04-27T05:05:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:29 smithi092 ceph-mon[29156]: pgmap v21066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38825.071707 secs 2024-04-27T05:05:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:29 smithi189 ceph-mon[32756]: pgmap v21066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:30.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38825.071707 secs 2024-04-27T05:05:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38128.035146 secs 2024-04-27T05:05:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38128.035146 secs 2024-04-27T05:05:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38128.035146 secs 2024-04-27T05:05:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:31 smithi156 ceph-mon[32679]: pgmap v21067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:31 smithi092 ceph-mon[29156]: pgmap v21067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:32.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:31 smithi189 ceph-mon[32756]: pgmap v21067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:33 smithi156 ceph-mon[32679]: pgmap v21068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:33 smithi092 ceph-mon[29156]: pgmap v21068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:33 smithi189 ceph-mon[32756]: pgmap v21068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38830.071862 secs 2024-04-27T05:05:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38830.071862 secs 2024-04-27T05:05:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38830.071862 secs 2024-04-27T05:05:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:35 smithi156 ceph-mon[32679]: pgmap v21069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38133.035265 secs 2024-04-27T05:05:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:35 smithi092 ceph-mon[29156]: pgmap v21069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38133.035265 secs 2024-04-27T05:05:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:35 smithi189 ceph-mon[32756]: pgmap v21069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38133.035265 secs 2024-04-27T05:05:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:37 smithi156 ceph-mon[32679]: pgmap v21070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:37 smithi092 ceph-mon[29156]: pgmap v21070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:37 smithi189 ceph-mon[32756]: pgmap v21070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:39 smithi156 ceph-mon[32679]: pgmap v21071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38835.071971 secs 2024-04-27T05:05:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:39 smithi092 ceph-mon[29156]: pgmap v21071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:39.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38835.071971 secs 2024-04-27T05:05:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:39 smithi189 ceph-mon[32756]: pgmap v21071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38835.071971 secs 2024-04-27T05:05:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38138.035390 secs 2024-04-27T05:05:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38138.035390 secs 2024-04-27T05:05:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38138.035390 secs 2024-04-27T05:05:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:41 smithi092 ceph-mon[29156]: pgmap v21072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:41 smithi189 ceph-mon[32756]: pgmap v21072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:41 smithi156 ceph-mon[32679]: pgmap v21072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:43 smithi092 ceph-mon[29156]: pgmap v21073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:43 smithi189 ceph-mon[32756]: pgmap v21073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:43 smithi156 ceph-mon[32679]: pgmap v21073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38840.072059 secs 2024-04-27T05:05:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38840.072059 secs 2024-04-27T05:05:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38840.072059 secs 2024-04-27T05:05:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:45 smithi092 ceph-mon[29156]: pgmap v21074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38143.035541 secs 2024-04-27T05:05:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:45 smithi189 ceph-mon[32756]: pgmap v21074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38143.035541 secs 2024-04-27T05:05:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:45 smithi156 ceph-mon[32679]: pgmap v21074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38143.035541 secs 2024-04-27T05:05:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:47 smithi092 ceph-mon[29156]: pgmap v21075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:47 smithi189 ceph-mon[32756]: pgmap v21075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:47 smithi156 ceph-mon[32679]: pgmap v21075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:49 smithi092 ceph-mon[29156]: pgmap v21076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38845.072173 secs 2024-04-27T05:05:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:49 smithi189 ceph-mon[32756]: pgmap v21076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38845.072173 secs 2024-04-27T05:05:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:49 smithi156 ceph-mon[32679]: pgmap v21076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38845.072173 secs 2024-04-27T05:05:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38148.035611 secs 2024-04-27T05:05:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38148.035611 secs 2024-04-27T05:05:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38148.035611 secs 2024-04-27T05:05:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:51 smithi092 ceph-mon[29156]: pgmap v21077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:52.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:51 smithi189 ceph-mon[32756]: pgmap v21077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:51 smithi156 ceph-mon[32679]: pgmap v21077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:53 smithi092 ceph-mon[29156]: pgmap v21078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:53 smithi189 ceph-mon[32756]: pgmap v21078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:54.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:53 smithi156 ceph-mon[32679]: pgmap v21078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38850.072239 secs 2024-04-27T05:05:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:54 smithi092 ceph-mon[29156]: pgmap v21079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:55.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38850.072239 secs 2024-04-27T05:05:55.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:54 smithi189 ceph-mon[32756]: pgmap v21079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:55.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38850.072239 secs 2024-04-27T05:05:55.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:54 smithi156 ceph-mon[32679]: pgmap v21079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:05:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38153.035755 secs 2024-04-27T05:05:56.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38153.035755 secs 2024-04-27T05:05:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38153.035755 secs 2024-04-27T05:05:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:56 smithi092 ceph-mon[29156]: pgmap v21080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:56 smithi189 ceph-mon[32756]: pgmap v21080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:56 smithi156 ceph-mon[32679]: pgmap v21080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:59 smithi156 ceph-mon[32679]: pgmap v21081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:05:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38855.072342 secs 2024-04-27T05:05:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:59 smithi092 ceph-mon[29156]: pgmap v21081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:59.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:05:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38855.072342 secs 2024-04-27T05:05:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:59 smithi189 ceph-mon[32756]: pgmap v21081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:05:59.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:05:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38855.072342 secs 2024-04-27T05:06:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38158.035874 secs 2024-04-27T05:06:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38158.035874 secs 2024-04-27T05:06:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38158.035874 secs 2024-04-27T05:06:01.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:01 smithi156 ceph-mon[32679]: pgmap v21082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:01 smithi092 ceph-mon[29156]: pgmap v21082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:01.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:01 smithi189 ceph-mon[32756]: pgmap v21082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:03.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:03 smithi156 ceph-mon[32679]: pgmap v21083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:03 smithi092 ceph-mon[29156]: pgmap v21083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:03.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:03 smithi189 ceph-mon[32756]: pgmap v21083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:04.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38860.072490 secs 2024-04-27T05:06:04.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38860.072490 secs 2024-04-27T05:06:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38860.072490 secs 2024-04-27T05:06:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:05 smithi156 ceph-mon[32679]: pgmap v21084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38163.035941 secs 2024-04-27T05:06:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:05 smithi092 ceph-mon[29156]: pgmap v21084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38163.035941 secs 2024-04-27T05:06:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:05 smithi189 ceph-mon[32756]: pgmap v21084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:05.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38163.035941 secs 2024-04-27T05:06:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:07 smithi092 ceph-mon[29156]: pgmap v21085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:07.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:07 smithi189 ceph-mon[32756]: pgmap v21085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:07.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:07 smithi156 ceph-mon[32679]: pgmap v21085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: pgmap v21086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:06:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:06:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:06:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:06:09.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38865.072635 secs 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: pgmap v21086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:06:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38865.072635 secs 2024-04-27T05:06:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: pgmap v21086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:06:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:06:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:06:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:06:09.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38865.072635 secs 2024-04-27T05:06:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:10 smithi092 ceph-mon[29156]: pgmap v21087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:06:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:10 smithi092 ceph-mon[29156]: pgmap v21088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:10.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38168.036019 secs 2024-04-27T05:06:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:10 smithi189 ceph-mon[32756]: pgmap v21087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:06:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:10 smithi189 ceph-mon[32756]: pgmap v21088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38168.036019 secs 2024-04-27T05:06:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:10 smithi156 ceph-mon[32679]: pgmap v21087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:06:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:10 smithi156 ceph-mon[32679]: pgmap v21088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38168.036019 secs 2024-04-27T05:06:12.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:12 smithi092 ceph-mon[29156]: pgmap v21089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:12.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:12 smithi189 ceph-mon[32756]: pgmap v21089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:12.689 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:12 smithi156 ceph-mon[32679]: pgmap v21089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:14 smithi092 ceph-mon[29156]: pgmap v21090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:06:14.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38870.072751 secs 2024-04-27T05:06:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:14 smithi189 ceph-mon[32756]: pgmap v21090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:06:14.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38870.072751 secs 2024-04-27T05:06:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:14 smithi156 ceph-mon[32679]: pgmap v21090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:06:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38870.072751 secs 2024-04-27T05:06:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38173.036110 secs 2024-04-27T05:06:15.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38173.036110 secs 2024-04-27T05:06:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38173.036110 secs 2024-04-27T05:06:16.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:16 smithi092 ceph-mon[29156]: pgmap v21091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:16.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:16 smithi189 ceph-mon[32756]: pgmap v21091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:16 smithi156 ceph-mon[32679]: pgmap v21091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:18.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:18 smithi092 ceph-mon[29156]: pgmap v21092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:18.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:18 smithi189 ceph-mon[32756]: pgmap v21092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:18 smithi156 ceph-mon[32679]: pgmap v21092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:06:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38875.072900 secs 2024-04-27T05:06:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38875.072900 secs 2024-04-27T05:06:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38875.072900 secs 2024-04-27T05:06:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:20 smithi092 ceph-mon[29156]: pgmap v21093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:06:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38178.036224 secs 2024-04-27T05:06:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:20 smithi189 ceph-mon[32756]: pgmap v21093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:06:20.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38178.036224 secs 2024-04-27T05:06:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:20 smithi156 ceph-mon[32679]: pgmap v21093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:06:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38178.036224 secs 2024-04-27T05:06:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:22 smithi092 ceph-mon[29156]: pgmap v21094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:22 smithi189 ceph-mon[32756]: pgmap v21094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:22 smithi156 ceph-mon[32679]: pgmap v21094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:24 smithi092 ceph-mon[29156]: pgmap v21095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:24.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38880.072990 secs 2024-04-27T05:06:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:24 smithi189 ceph-mon[32756]: pgmap v21095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38880.072990 secs 2024-04-27T05:06:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:24 smithi156 ceph-mon[32679]: pgmap v21095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38880.072990 secs 2024-04-27T05:06:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38183.036344 secs 2024-04-27T05:06:25.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38183.036344 secs 2024-04-27T05:06:25.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38183.036344 secs 2024-04-27T05:06:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:26 smithi092 ceph-mon[29156]: pgmap v21096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:26 smithi189 ceph-mon[32756]: pgmap v21096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:26 smithi156 ceph-mon[32679]: pgmap v21096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:28 smithi092 ceph-mon[29156]: pgmap v21097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:28 smithi189 ceph-mon[32756]: pgmap v21097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:28 smithi156 ceph-mon[32679]: pgmap v21097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38885.073102 secs 2024-04-27T05:06:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38885.073102 secs 2024-04-27T05:06:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38885.073102 secs 2024-04-27T05:06:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:30 smithi092 ceph-mon[29156]: pgmap v21098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:30.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38188.036445 secs 2024-04-27T05:06:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:30 smithi189 ceph-mon[32756]: pgmap v21098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:30.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38188.036445 secs 2024-04-27T05:06:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:30 smithi156 ceph-mon[32679]: pgmap v21098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38188.036445 secs 2024-04-27T05:06:32.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:32 smithi189 ceph-mon[32756]: pgmap v21099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:32 smithi156 ceph-mon[32679]: pgmap v21099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:32 smithi092 ceph-mon[29156]: pgmap v21099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:34 smithi189 ceph-mon[32756]: pgmap v21100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38890.073212 secs 2024-04-27T05:06:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:34 smithi156 ceph-mon[32679]: pgmap v21100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38890.073212 secs 2024-04-27T05:06:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:34 smithi092 ceph-mon[29156]: pgmap v21100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38890.073212 secs 2024-04-27T05:06:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38193.036572 secs 2024-04-27T05:06:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38193.036572 secs 2024-04-27T05:06:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38193.036572 secs 2024-04-27T05:06:36.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:36 smithi189 ceph-mon[32756]: pgmap v21101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:36 smithi156 ceph-mon[32679]: pgmap v21101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:36 smithi092 ceph-mon[29156]: pgmap v21101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:38 smithi189 ceph-mon[32756]: pgmap v21102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:38 smithi156 ceph-mon[32679]: pgmap v21102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:38 smithi092 ceph-mon[29156]: pgmap v21102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38895.073344 secs 2024-04-27T05:06:39.647 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38895.073344 secs 2024-04-27T05:06:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38895.073344 secs 2024-04-27T05:06:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:40 smithi189 ceph-mon[32756]: pgmap v21103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38198.036682 secs 2024-04-27T05:06:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:40 smithi156 ceph-mon[32679]: pgmap v21103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38198.036682 secs 2024-04-27T05:06:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:40 smithi092 ceph-mon[29156]: pgmap v21103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38198.036682 secs 2024-04-27T05:06:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:06:41.322+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:06:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:06:41.322+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:06:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:06:41.322+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:06:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:06:41.322+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 299 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:06:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:42 smithi189 ceph-mon[32756]: pgmap v21104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:42 smithi156 ceph-mon[32679]: pgmap v21104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:42 smithi092 ceph-mon[29156]: pgmap v21104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:44 smithi189 ceph-mon[32756]: pgmap v21105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38900.073485 secs 2024-04-27T05:06:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:44 smithi156 ceph-mon[32679]: pgmap v21105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38900.073485 secs 2024-04-27T05:06:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:44 smithi092 ceph-mon[29156]: pgmap v21105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38900.073485 secs 2024-04-27T05:06:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:45 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38203.036782 secs 2024-04-27T05:06:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:45 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38203.036782 secs 2024-04-27T05:06:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:45 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38203.036782 secs 2024-04-27T05:06:46.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:46 smithi189 ceph-mon[32756]: pgmap v21106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:46 smithi156 ceph-mon[32679]: pgmap v21106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:46 smithi092 ceph-mon[29156]: pgmap v21106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:48 smithi189 ceph-mon[32756]: pgmap v21107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:48 smithi156 ceph-mon[32679]: pgmap v21107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:48 smithi092 ceph-mon[29156]: pgmap v21107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:49.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38905.073599 secs 2024-04-27T05:06:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38905.073599 secs 2024-04-27T05:06:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38905.073599 secs 2024-04-27T05:06:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:50 smithi189 ceph-mon[32756]: pgmap v21108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:50 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38208.036861 secs 2024-04-27T05:06:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:50 smithi156 ceph-mon[32679]: pgmap v21108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:50 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38208.036861 secs 2024-04-27T05:06:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:50 smithi092 ceph-mon[29156]: pgmap v21108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:50 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38208.036861 secs 2024-04-27T05:06:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:52 smithi189 ceph-mon[32756]: pgmap v21109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:52 smithi156 ceph-mon[32679]: pgmap v21109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:52 smithi092 ceph-mon[29156]: pgmap v21109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:54 smithi189 ceph-mon[32756]: pgmap v21110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38910.073720 secs 2024-04-27T05:06:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:54 smithi156 ceph-mon[32679]: pgmap v21110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38910.073720 secs 2024-04-27T05:06:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:54 smithi092 ceph-mon[29156]: pgmap v21110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38910.073720 secs 2024-04-27T05:06:55.587 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:55 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38213.036996 secs 2024-04-27T05:06:55.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:55 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38213.036996 secs 2024-04-27T05:06:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:55 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38213.036996 secs 2024-04-27T05:06:56.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:56 smithi189 ceph-mon[32756]: pgmap v21111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:56 smithi156 ceph-mon[32679]: pgmap v21111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:56 smithi092 ceph-mon[29156]: pgmap v21111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:06:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:58 smithi189 ceph-mon[32756]: pgmap v21112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:58 smithi156 ceph-mon[32679]: pgmap v21112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:58 smithi092 ceph-mon[29156]: pgmap v21112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:06:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:06:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38915.073801 secs 2024-04-27T05:06:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:06:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38915.073801 secs 2024-04-27T05:06:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:06:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38915.073801 secs 2024-04-27T05:07:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:00 smithi189 ceph-mon[32756]: pgmap v21113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:00.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:00 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38218.037113 secs 2024-04-27T05:07:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:00 smithi156 ceph-mon[32679]: pgmap v21113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:00 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38218.037113 secs 2024-04-27T05:07:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:00 smithi092 ceph-mon[29156]: pgmap v21113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:00 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38218.037113 secs 2024-04-27T05:07:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:02 smithi189 ceph-mon[32756]: pgmap v21114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:02 smithi156 ceph-mon[32679]: pgmap v21114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:02 smithi092 ceph-mon[29156]: pgmap v21114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:04 smithi189 ceph-mon[32756]: pgmap v21115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38920.073919 secs 2024-04-27T05:07:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:04 smithi156 ceph-mon[32679]: pgmap v21115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:04.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38920.073919 secs 2024-04-27T05:07:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:04 smithi092 ceph-mon[29156]: pgmap v21115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38920.073919 secs 2024-04-27T05:07:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:05 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38223.037265 secs 2024-04-27T05:07:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:05 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38223.037265 secs 2024-04-27T05:07:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:05 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38223.037265 secs 2024-04-27T05:07:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:06 smithi189 ceph-mon[32756]: pgmap v21116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:06 smithi156 ceph-mon[32679]: pgmap v21116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:06 smithi092 ceph-mon[29156]: pgmap v21116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:08 smithi189 ceph-mon[32756]: pgmap v21117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:08 smithi156 ceph-mon[32679]: pgmap v21117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:08 smithi092 ceph-mon[29156]: pgmap v21117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:09 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:07:09.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38925.074034 secs 2024-04-27T05:07:09.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:09 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:07:09.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38925.074034 secs 2024-04-27T05:07:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:09 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:07:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38925.074034 secs 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: pgmap v21118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38228.037351 secs 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: pgmap v21119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: pgmap v21120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:07:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: pgmap v21118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38228.037351 secs 2024-04-27T05:07:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:07:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:07:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: pgmap v21119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:07:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: pgmap v21120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:10.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:07:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: pgmap v21118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:07:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38228.037351 secs 2024-04-27T05:07:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:07:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:07:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: pgmap v21119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:07:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: pgmap v21120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:10.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:07:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:12 smithi092 ceph-mon[29156]: pgmap v21121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:12 smithi189 ceph-mon[32756]: pgmap v21121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:12 smithi156 ceph-mon[32679]: pgmap v21121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:07:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:14 smithi092 ceph-mon[29156]: pgmap v21122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38930.074166 secs 2024-04-27T05:07:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:14 smithi189 ceph-mon[32756]: pgmap v21122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38930.074166 secs 2024-04-27T05:07:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:14 smithi156 ceph-mon[32679]: pgmap v21122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38930.074166 secs 2024-04-27T05:07:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:15 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38233.037461 secs 2024-04-27T05:07:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:15 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38233.037461 secs 2024-04-27T05:07:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:15 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38233.037461 secs 2024-04-27T05:07:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:16 smithi092 ceph-mon[29156]: pgmap v21123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:16 smithi189 ceph-mon[32756]: pgmap v21123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:16 smithi156 ceph-mon[32679]: pgmap v21123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 233 B/s wr, 4 op/s 2024-04-27T05:07:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:18 smithi092 ceph-mon[29156]: pgmap v21124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T05:07:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:18 smithi189 ceph-mon[32756]: pgmap v21124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T05:07:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:18 smithi156 ceph-mon[32679]: pgmap v21124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 233 B/s wr, 2 op/s 2024-04-27T05:07:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38935.074240 secs 2024-04-27T05:07:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:19 smithi092 ceph-mon[29156]: pgmap v21125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T05:07:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38935.074240 secs 2024-04-27T05:07:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:19 smithi189 ceph-mon[32756]: pgmap v21125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T05:07:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38935.074240 secs 2024-04-27T05:07:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:19 smithi156 ceph-mon[32679]: pgmap v21125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 204 B/s wr, 4 op/s 2024-04-27T05:07:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:20 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38238.037572 secs 2024-04-27T05:07:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:20 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38238.037572 secs 2024-04-27T05:07:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:20 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38238.037572 secs 2024-04-27T05:07:22.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:21 smithi189 ceph-mon[32756]: pgmap v21126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:21 smithi156 ceph-mon[32679]: pgmap v21126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:21 smithi092 ceph-mon[29156]: pgmap v21126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:24 smithi092 ceph-mon[29156]: pgmap v21127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38940.074359 secs 2024-04-27T05:07:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:24 smithi189 ceph-mon[32756]: pgmap v21127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:25.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38940.074359 secs 2024-04-27T05:07:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:24 smithi156 ceph-mon[32679]: pgmap v21127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38940.074359 secs 2024-04-27T05:07:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:25 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38243.037689 secs 2024-04-27T05:07:26.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:25 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38243.037689 secs 2024-04-27T05:07:26.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:25 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38243.037689 secs 2024-04-27T05:07:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:26 smithi092 ceph-mon[29156]: pgmap v21128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:26 smithi189 ceph-mon[32756]: pgmap v21128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:26 smithi156 ceph-mon[32679]: pgmap v21128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:27 smithi092 ceph-mon[29156]: pgmap v21129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:27 smithi189 ceph-mon[32756]: pgmap v21129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:27 smithi156 ceph-mon[32679]: pgmap v21129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38945.074473 secs 2024-04-27T05:07:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38945.074473 secs 2024-04-27T05:07:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38945.074473 secs 2024-04-27T05:07:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:30 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38248.037836 secs 2024-04-27T05:07:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:30 smithi156 ceph-mon[32679]: pgmap v21130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:30 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38248.037836 secs 2024-04-27T05:07:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:30 smithi092 ceph-mon[29156]: pgmap v21130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:30 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38248.037836 secs 2024-04-27T05:07:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:30 smithi189 ceph-mon[32756]: pgmap v21130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:32 smithi092 ceph-mon[29156]: pgmap v21131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:32 smithi189 ceph-mon[32756]: pgmap v21131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:32 smithi156 ceph-mon[32679]: pgmap v21131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:34 smithi092 ceph-mon[29156]: pgmap v21132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:34.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38950.074563 secs 2024-04-27T05:07:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:34 smithi189 ceph-mon[32756]: pgmap v21132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:35.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38950.074563 secs 2024-04-27T05:07:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:34 smithi156 ceph-mon[32679]: pgmap v21132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38950.074563 secs 2024-04-27T05:07:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:35 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38253.037953 secs 2024-04-27T05:07:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:35 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38253.037953 secs 2024-04-27T05:07:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:35 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38253.037953 secs 2024-04-27T05:07:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:36 smithi092 ceph-mon[29156]: pgmap v21133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:36 smithi189 ceph-mon[32756]: pgmap v21133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:36 smithi156 ceph-mon[32679]: pgmap v21133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:37 smithi092 ceph-mon[29156]: pgmap v21134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:37 smithi189 ceph-mon[32756]: pgmap v21134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:37 smithi156 ceph-mon[32679]: pgmap v21134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:07:39.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38955.074716 secs 2024-04-27T05:07:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38955.074716 secs 2024-04-27T05:07:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38955.074716 secs 2024-04-27T05:07:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:40 smithi156 ceph-mon[32679]: 31 slow requests, 0 included below; oldest blocked for > 38258.038074 secs 2024-04-27T05:07:40.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:40 smithi156 ceph-mon[32679]: pgmap v21135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:40 smithi092 ceph-mon[29156]: 31 slow requests, 0 included below; oldest blocked for > 38258.038074 secs 2024-04-27T05:07:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:40 smithi092 ceph-mon[29156]: pgmap v21135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:40 smithi189 ceph-mon[32756]: 31 slow requests, 0 included below; oldest blocked for > 38258.038074 secs 2024-04-27T05:07:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:40 smithi189 ceph-mon[32756]: pgmap v21135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:07:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:07:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:07:41.257+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:07:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:07:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:07:41.257+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:07:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:07:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:07:41.257+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:07:41.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:07:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:07:41.257+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:07:41.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:07:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:07:41.257+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:07:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:42 smithi092 ceph-mon[29156]: pgmap v21136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:43.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:42 smithi189 ceph-mon[32756]: pgmap v21136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:42 smithi156 ceph-mon[32679]: pgmap v21136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:44 smithi092 ceph-mon[29156]: pgmap v21137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38960.074848 secs 2024-04-27T05:07:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:44 smithi189 ceph-mon[32756]: pgmap v21137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:45.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38960.074848 secs 2024-04-27T05:07:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:44 smithi156 ceph-mon[32679]: pgmap v21137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38960.074848 secs 2024-04-27T05:07:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:45 smithi092 ceph-mon[29156]: MDS health message cleared (mds.?): 31 slow requests are blocked > 180 secs 2024-04-27T05:07:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:45 smithi189 ceph-mon[32756]: MDS health message cleared (mds.?): 31 slow requests are blocked > 180 secs 2024-04-27T05:07:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:45 smithi156 ceph-mon[32679]: MDS health message cleared (mds.?): 31 slow requests are blocked > 180 secs 2024-04-27T05:07:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:46 smithi092 ceph-mon[29156]: pgmap v21138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:46 smithi092 ceph-mon[29156]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:07:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:07:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:07:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:46 smithi189 ceph-mon[32756]: pgmap v21138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:46 smithi189 ceph-mon[32756]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:07:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:07:47.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:07:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:46 smithi156 ceph-mon[32679]: pgmap v21138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:46 smithi156 ceph-mon[32679]: Health check update: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:07:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:07:47.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:07:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:47 smithi092 ceph-mon[29156]: pgmap v21139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:47 smithi189 ceph-mon[32756]: pgmap v21139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:47 smithi156 ceph-mon[32679]: pgmap v21139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:49.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38965.074936 secs 2024-04-27T05:07:49.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38965.074936 secs 2024-04-27T05:07:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38965.074936 secs 2024-04-27T05:07:50.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:50 smithi156 ceph-mon[32679]: pgmap v21140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:50.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:50 smithi092 ceph-mon[29156]: pgmap v21140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:50.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:50 smithi189 ceph-mon[32756]: pgmap v21140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:52 smithi092 ceph-mon[29156]: pgmap v21141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:52 smithi189 ceph-mon[32756]: pgmap v21141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:52 smithi156 ceph-mon[32679]: pgmap v21141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:07:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:54 smithi092 ceph-mon[29156]: pgmap v21142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38970.074999 secs 2024-04-27T05:07:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:54 smithi189 ceph-mon[32756]: pgmap v21142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:55.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38970.074999 secs 2024-04-27T05:07:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:54 smithi156 ceph-mon[32679]: pgmap v21142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:07:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38970.074999 secs 2024-04-27T05:07:56.988 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:56 smithi156 ceph-mon[32679]: pgmap v21143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:56 smithi092 ceph-mon[29156]: pgmap v21143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:56 smithi189 ceph-mon[32756]: pgmap v21143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:57 smithi092 ceph-mon[29156]: pgmap v21144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:57 smithi189 ceph-mon[32756]: pgmap v21144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:57 smithi156 ceph-mon[32679]: pgmap v21144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:07:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:07:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38975.075118 secs 2024-04-27T05:07:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:07:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38975.075118 secs 2024-04-27T05:07:59.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:07:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38975.075118 secs 2024-04-27T05:08:00.436 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:00 smithi156 ceph-mon[32679]: pgmap v21145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:00 smithi092 ceph-mon[29156]: pgmap v21145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:00 smithi189 ceph-mon[32756]: pgmap v21145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:02 smithi092 ceph-mon[29156]: pgmap v21146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:02 smithi189 ceph-mon[32756]: pgmap v21146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:02 smithi156 ceph-mon[32679]: pgmap v21146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:04 smithi092 ceph-mon[29156]: pgmap v21147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38980.075235 secs 2024-04-27T05:08:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:04 smithi189 ceph-mon[32756]: pgmap v21147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38980.075235 secs 2024-04-27T05:08:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:04 smithi156 ceph-mon[32679]: pgmap v21147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38980.075235 secs 2024-04-27T05:08:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:06 smithi092 ceph-mon[29156]: pgmap v21148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:06 smithi189 ceph-mon[32756]: pgmap v21148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:06 smithi156 ceph-mon[32679]: pgmap v21148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:07 smithi189 ceph-mon[32756]: pgmap v21149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:07 smithi156 ceph-mon[32679]: pgmap v21149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:07 smithi092 ceph-mon[29156]: pgmap v21149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38985.075315 secs 2024-04-27T05:08:09.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38985.075315 secs 2024-04-27T05:08:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38985.075315 secs 2024-04-27T05:08:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:10 smithi156 ceph-mon[32679]: pgmap v21150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:08:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:10 smithi092 ceph-mon[29156]: pgmap v21150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:10.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:08:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:10 smithi189 ceph-mon[32756]: pgmap v21150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:10.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:08:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:08:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:08:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:11 smithi092 ceph-mon[29156]: pgmap v21151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:08:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:11 smithi092 ceph-mon[29156]: pgmap v21152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:11 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:08:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:08:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:08:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:11 smithi189 ceph-mon[32756]: pgmap v21151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:08:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:11 smithi189 ceph-mon[32756]: pgmap v21152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:11.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:11 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:08:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:08:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:08:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:11 smithi156 ceph-mon[32679]: pgmap v21151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:08:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:11 smithi156 ceph-mon[32679]: pgmap v21152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:11.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:11 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:08:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:13 smithi189 ceph-mon[32756]: pgmap v21153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:13 smithi156 ceph-mon[32679]: pgmap v21153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:13 smithi092 ceph-mon[29156]: pgmap v21153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38990.075456 secs 2024-04-27T05:08:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38990.075456 secs 2024-04-27T05:08:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38990.075456 secs 2024-04-27T05:08:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:15 smithi189 ceph-mon[32756]: pgmap v21154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:15 smithi156 ceph-mon[32679]: pgmap v21154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:15 smithi092 ceph-mon[29156]: pgmap v21154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:17 smithi189 ceph-mon[32756]: pgmap v21155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:17 smithi156 ceph-mon[32679]: pgmap v21155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:17 smithi092 ceph-mon[29156]: pgmap v21155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:08:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:19 smithi189 ceph-mon[32756]: pgmap v21156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:19.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 38995.075570 secs 2024-04-27T05:08:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:19 smithi156 ceph-mon[32679]: pgmap v21156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 38995.075570 secs 2024-04-27T05:08:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:19 smithi092 ceph-mon[29156]: pgmap v21156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:08:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 38995.075570 secs 2024-04-27T05:08:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:21 smithi189 ceph-mon[32756]: pgmap v21157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:08:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:21 smithi156 ceph-mon[32679]: pgmap v21157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:08:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:21 smithi092 ceph-mon[29156]: pgmap v21157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:08:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:23 smithi189 ceph-mon[32756]: pgmap v21158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:23 smithi156 ceph-mon[32679]: pgmap v21158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:23 smithi092 ceph-mon[29156]: pgmap v21158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39000.075717 secs 2024-04-27T05:08:24.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39000.075717 secs 2024-04-27T05:08:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39000.075717 secs 2024-04-27T05:08:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:25 smithi189 ceph-mon[32756]: pgmap v21159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:25 smithi156 ceph-mon[32679]: pgmap v21159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:25 smithi092 ceph-mon[29156]: pgmap v21159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:27 smithi189 ceph-mon[32756]: pgmap v21160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:27 smithi156 ceph-mon[32679]: pgmap v21160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:27 smithi092 ceph-mon[29156]: pgmap v21160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:29 smithi189 ceph-mon[32756]: pgmap v21161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:29.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39005.075842 secs 2024-04-27T05:08:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:29 smithi156 ceph-mon[32679]: pgmap v21161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39005.075842 secs 2024-04-27T05:08:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:29 smithi092 ceph-mon[29156]: pgmap v21161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39005.075842 secs 2024-04-27T05:08:31.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:31 smithi189 ceph-mon[32756]: pgmap v21162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:31 smithi156 ceph-mon[32679]: pgmap v21162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:31 smithi092 ceph-mon[29156]: pgmap v21162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:33 smithi189 ceph-mon[32756]: pgmap v21163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:33 smithi156 ceph-mon[32679]: pgmap v21163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:33 smithi092 ceph-mon[29156]: pgmap v21163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39010.075924 secs 2024-04-27T05:08:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39010.075924 secs 2024-04-27T05:08:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39010.075924 secs 2024-04-27T05:08:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:35 smithi189 ceph-mon[32756]: pgmap v21164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:35 smithi156 ceph-mon[32679]: pgmap v21164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:35 smithi092 ceph-mon[29156]: pgmap v21164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:37.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:37 smithi189 ceph-mon[32756]: pgmap v21165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:37.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:37 smithi156 ceph-mon[32679]: pgmap v21165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:37 smithi092 ceph-mon[29156]: pgmap v21165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:39.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:39 smithi092 ceph-mon[29156]: pgmap v21166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:39.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39015.075991 secs 2024-04-27T05:08:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:39 smithi189 ceph-mon[32756]: pgmap v21166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39015.075991 secs 2024-04-27T05:08:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:39 smithi156 ceph-mon[32679]: pgmap v21166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39015.075991 secs 2024-04-27T05:08:41.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:41 smithi189 ceph-mon[32756]: pgmap v21167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:41 smithi156 ceph-mon[32679]: pgmap v21167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:41 smithi092 ceph-mon[29156]: pgmap v21167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:43 smithi189 ceph-mon[32756]: pgmap v21168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:43 smithi156 ceph-mon[32679]: pgmap v21168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:43 smithi092 ceph-mon[29156]: pgmap v21168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39020.076057 secs 2024-04-27T05:08:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39020.076057 secs 2024-04-27T05:08:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39020.076057 secs 2024-04-27T05:08:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:45 smithi189 ceph-mon[32756]: pgmap v21169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:45 smithi156 ceph-mon[32679]: pgmap v21169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:45 smithi092 ceph-mon[29156]: pgmap v21169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:47 smithi189 ceph-mon[32756]: pgmap v21170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:47 smithi156 ceph-mon[32679]: pgmap v21170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:47 smithi092 ceph-mon[29156]: pgmap v21170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:49 smithi189 ceph-mon[32756]: pgmap v21171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39025.076177 secs 2024-04-27T05:08:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:49 smithi156 ceph-mon[32679]: pgmap v21171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39025.076177 secs 2024-04-27T05:08:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:49 smithi092 ceph-mon[29156]: pgmap v21171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39025.076177 secs 2024-04-27T05:08:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:51 smithi189 ceph-mon[32756]: pgmap v21172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:51 smithi156 ceph-mon[32679]: pgmap v21172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:51 smithi092 ceph-mon[29156]: pgmap v21172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:53 smithi189 ceph-mon[32756]: pgmap v21173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:53 smithi156 ceph-mon[32679]: pgmap v21173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:53 smithi092 ceph-mon[29156]: pgmap v21173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39030.076273 secs 2024-04-27T05:08:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39030.076273 secs 2024-04-27T05:08:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39030.076273 secs 2024-04-27T05:08:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:55 smithi189 ceph-mon[32756]: pgmap v21174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:55.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:55 smithi092 ceph-mon[29156]: pgmap v21174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:55 smithi156 ceph-mon[32679]: pgmap v21174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:08:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:57 smithi189 ceph-mon[32756]: pgmap v21175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:57 smithi156 ceph-mon[32679]: pgmap v21175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:57 smithi092 ceph-mon[29156]: pgmap v21175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:59 smithi189 ceph-mon[32756]: pgmap v21176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:08:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39035.076379 secs 2024-04-27T05:08:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:59 smithi156 ceph-mon[32679]: pgmap v21176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:08:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39035.076379 secs 2024-04-27T05:08:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:59 smithi092 ceph-mon[29156]: pgmap v21176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:08:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:08:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39035.076379 secs 2024-04-27T05:09:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:01 smithi189 ceph-mon[32756]: pgmap v21177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:01 smithi156 ceph-mon[32679]: pgmap v21177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:01 smithi092 ceph-mon[29156]: pgmap v21177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:03.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:03 smithi189 ceph-mon[32756]: pgmap v21178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:03 smithi156 ceph-mon[32679]: pgmap v21178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:03 smithi092 ceph-mon[29156]: pgmap v21178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39040.076482 secs 2024-04-27T05:09:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39040.076482 secs 2024-04-27T05:09:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39040.076482 secs 2024-04-27T05:09:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:05 smithi189 ceph-mon[32756]: pgmap v21179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:05 smithi156 ceph-mon[32679]: pgmap v21179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:05 smithi092 ceph-mon[29156]: pgmap v21179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:07 smithi189 ceph-mon[32756]: pgmap v21180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:07 smithi156 ceph-mon[32679]: pgmap v21180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:07 smithi092 ceph-mon[29156]: pgmap v21180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:09 smithi189 ceph-mon[32756]: pgmap v21181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39045.076625 secs 2024-04-27T05:09:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:09 smithi156 ceph-mon[32679]: pgmap v21181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39045.076625 secs 2024-04-27T05:09:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:09 smithi092 ceph-mon[29156]: pgmap v21181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39045.076625 secs 2024-04-27T05:09:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:10 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:09:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:10 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:09:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:10 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:09:11.858 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:11 smithi092 ceph-mon[29156]: pgmap v21182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:11 smithi189 ceph-mon[32756]: pgmap v21182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:11 smithi156 ceph-mon[32679]: pgmap v21182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:13 smithi189 ceph-mon[32756]: pgmap v21183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:13 smithi156 ceph-mon[32679]: pgmap v21183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:13 smithi092 ceph-mon[29156]: pgmap v21183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:14.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39050.076719 secs 2024-04-27T05:09:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39050.076719 secs 2024-04-27T05:09:14.976 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39050.076719 secs 2024-04-27T05:09:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: pgmap v21184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:09:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: pgmap v21184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:09:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:09:15.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: pgmap v21184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:09:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:09:15.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:09:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:16 smithi189 ceph-mon[32756]: pgmap v21185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:09:16.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:16 smithi189 ceph-mon[32756]: pgmap v21186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:16 smithi156 ceph-mon[32679]: pgmap v21185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:09:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:16 smithi156 ceph-mon[32679]: pgmap v21186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:16 smithi092 ceph-mon[29156]: pgmap v21185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:09:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:16 smithi092 ceph-mon[29156]: pgmap v21186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:18 smithi189 ceph-mon[32756]: pgmap v21187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:18 smithi156 ceph-mon[32679]: pgmap v21187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:18 smithi092 ceph-mon[29156]: pgmap v21187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39055.076861 secs 2024-04-27T05:09:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39055.076861 secs 2024-04-27T05:09:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39055.076861 secs 2024-04-27T05:09:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:20 smithi189 ceph-mon[32756]: pgmap v21188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:20 smithi156 ceph-mon[32679]: pgmap v21188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:20 smithi092 ceph-mon[29156]: pgmap v21188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:22 smithi189 ceph-mon[32756]: pgmap v21189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:22 smithi156 ceph-mon[32679]: pgmap v21189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:22 smithi092 ceph-mon[29156]: pgmap v21189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:09:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:24 smithi189 ceph-mon[32756]: pgmap v21190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:09:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39060.076980 secs 2024-04-27T05:09:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:24 smithi156 ceph-mon[32679]: pgmap v21190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:09:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39060.076980 secs 2024-04-27T05:09:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:24 smithi092 ceph-mon[29156]: pgmap v21190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:09:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39060.076980 secs 2024-04-27T05:09:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:26 smithi156 ceph-mon[32679]: pgmap v21191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:09:26.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:26 smithi092 ceph-mon[29156]: pgmap v21191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:09:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:26 smithi189 ceph-mon[32756]: pgmap v21191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:09:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:28 smithi156 ceph-mon[32679]: pgmap v21192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:28.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:28 smithi189 ceph-mon[32756]: pgmap v21192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:28 smithi092 ceph-mon[29156]: pgmap v21192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39065.077072 secs 2024-04-27T05:09:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39065.077072 secs 2024-04-27T05:09:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39065.077072 secs 2024-04-27T05:09:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:30 smithi156 ceph-mon[32679]: pgmap v21193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:30 smithi092 ceph-mon[29156]: pgmap v21193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:30 smithi189 ceph-mon[32756]: pgmap v21193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:32 smithi156 ceph-mon[32679]: pgmap v21194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:32 smithi092 ceph-mon[29156]: pgmap v21194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:32 smithi189 ceph-mon[32756]: pgmap v21194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:34 smithi156 ceph-mon[32679]: pgmap v21195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39070.077156 secs 2024-04-27T05:09:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:34 smithi092 ceph-mon[29156]: pgmap v21195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39070.077156 secs 2024-04-27T05:09:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:34 smithi189 ceph-mon[32756]: pgmap v21195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39070.077156 secs 2024-04-27T05:09:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:36 smithi156 ceph-mon[32679]: pgmap v21196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:36 smithi092 ceph-mon[29156]: pgmap v21196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:36 smithi189 ceph-mon[32756]: pgmap v21196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:38 smithi156 ceph-mon[32679]: pgmap v21197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:38 smithi092 ceph-mon[29156]: pgmap v21197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:38 smithi189 ceph-mon[32756]: pgmap v21197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39075.077278 secs 2024-04-27T05:09:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39075.077278 secs 2024-04-27T05:09:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39075.077278 secs 2024-04-27T05:09:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:40 smithi156 ceph-mon[32679]: pgmap v21198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:40 smithi092 ceph-mon[29156]: pgmap v21198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:40 smithi189 ceph-mon[32756]: pgmap v21198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:09:41.347+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:09:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:09:41.347+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:09:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:09:41.347+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:09:41.350 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:09:41.347+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 300 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:09:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:42 smithi156 ceph-mon[32679]: pgmap v21199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:42 smithi092 ceph-mon[29156]: pgmap v21199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:42 smithi189 ceph-mon[32756]: pgmap v21199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:44 smithi092 ceph-mon[29156]: pgmap v21200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:44.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39080.077398 secs 2024-04-27T05:09:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:44 smithi189 ceph-mon[32756]: pgmap v21200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39080.077398 secs 2024-04-27T05:09:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:44 smithi156 ceph-mon[32679]: pgmap v21200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39080.077398 secs 2024-04-27T05:09:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:46 smithi092 ceph-mon[29156]: pgmap v21201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:46 smithi189 ceph-mon[32756]: pgmap v21201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:46 smithi156 ceph-mon[32679]: pgmap v21201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:48 smithi092 ceph-mon[29156]: pgmap v21202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:48 smithi189 ceph-mon[32756]: pgmap v21202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:48 smithi156 ceph-mon[32679]: pgmap v21202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39085.077516 secs 2024-04-27T05:09:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39085.077516 secs 2024-04-27T05:09:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39085.077516 secs 2024-04-27T05:09:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:50 smithi092 ceph-mon[29156]: pgmap v21203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:51.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:50 smithi189 ceph-mon[32756]: pgmap v21203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:50 smithi156 ceph-mon[32679]: pgmap v21203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:52 smithi092 ceph-mon[29156]: pgmap v21204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:52 smithi189 ceph-mon[32756]: pgmap v21204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:52 smithi156 ceph-mon[32679]: pgmap v21204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:54 smithi092 ceph-mon[29156]: pgmap v21205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39090.077637 secs 2024-04-27T05:09:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:54 smithi189 ceph-mon[32756]: pgmap v21205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39090.077637 secs 2024-04-27T05:09:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:54 smithi156 ceph-mon[32679]: pgmap v21205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39090.077637 secs 2024-04-27T05:09:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:56 smithi092 ceph-mon[29156]: pgmap v21206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:56 smithi189 ceph-mon[32756]: pgmap v21206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:56 smithi156 ceph-mon[32679]: pgmap v21206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:09:58.987 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:58 smithi156 ceph-mon[32679]: pgmap v21207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:58 smithi092 ceph-mon[29156]: pgmap v21207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:58 smithi189 ceph-mon[32756]: pgmap v21207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:09:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:09:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39095.077780 secs 2024-04-27T05:10:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:09:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39095.077780 secs 2024-04-27T05:10:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:09:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39095.077780 secs 2024-04-27T05:10:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: pgmap v21208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-27T05:10:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:10:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.j on smithi092 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.d on smithi092 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.k on smithi156 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.h on smithi156 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.l on smithi189 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.c on smithi189 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-27T05:10:00.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:00 smithi092 ceph-mon[29156]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:10:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: pgmap v21208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.j on smithi092 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.d on smithi092 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.k on smithi156 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.h on smithi156 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.l on smithi189 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.c on smithi189 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-27T05:10:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:00 smithi189 ceph-mon[32756]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: pgmap v21208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 1 MDSs report slow requests 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.j on smithi092 is in error state 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.d on smithi092 is in error state 2024-04-27T05:10:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.k on smithi156 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.h on smithi156 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.l on smithi189 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.c on smithi189 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2024-04-27T05:10:01.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:00 smithi156 ceph-mon[32679]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:10:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:02 smithi092 ceph-mon[29156]: pgmap v21209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:02 smithi189 ceph-mon[32756]: pgmap v21209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:02 smithi156 ceph-mon[32679]: pgmap v21209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:04 smithi092 ceph-mon[29156]: pgmap v21210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:04.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39100.077899 secs 2024-04-27T05:10:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:04 smithi189 ceph-mon[32756]: pgmap v21210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39100.077899 secs 2024-04-27T05:10:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:04 smithi156 ceph-mon[32679]: pgmap v21210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39100.077899 secs 2024-04-27T05:10:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:06 smithi092 ceph-mon[29156]: pgmap v21211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:07.029 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:06 smithi156 ceph-mon[32679]: pgmap v21211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:06 smithi189 ceph-mon[32756]: pgmap v21211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:08 smithi092 ceph-mon[29156]: pgmap v21212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:08 smithi189 ceph-mon[32756]: pgmap v21212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:08 smithi156 ceph-mon[32679]: pgmap v21212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39105.077966 secs 2024-04-27T05:10:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39105.077966 secs 2024-04-27T05:10:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39105.077966 secs 2024-04-27T05:10:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:10 smithi092 ceph-mon[29156]: pgmap v21213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:10 smithi189 ceph-mon[32756]: pgmap v21213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:10 smithi156 ceph-mon[32679]: pgmap v21213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:12 smithi092 ceph-mon[29156]: pgmap v21214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:13.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:12 smithi189 ceph-mon[32756]: pgmap v21214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:12 smithi156 ceph-mon[32679]: pgmap v21214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:14 smithi189 ceph-mon[32756]: pgmap v21215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39110.078085 secs 2024-04-27T05:10:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:14 smithi156 ceph-mon[32679]: pgmap v21215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39110.078085 secs 2024-04-27T05:10:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:14 smithi092 ceph-mon[29156]: pgmap v21215: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39110.078085 secs 2024-04-27T05:10:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:15 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:10:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:15 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:10:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:15 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:10:16.838 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:16 smithi189 ceph-mon[32756]: pgmap v21216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:16 smithi156 ceph-mon[32679]: pgmap v21216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:16 smithi092 ceph-mon[29156]: pgmap v21216: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:18 smithi189 ceph-mon[32756]: pgmap v21217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:18 smithi156 ceph-mon[32679]: pgmap v21217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:18 smithi092 ceph-mon[29156]: pgmap v21217: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39115.078167 secs 2024-04-27T05:10:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:10:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:10:20.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:19 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39115.078167 secs 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:10:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:19 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39115.078167 secs 2024-04-27T05:10:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:10:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:10:20.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:19 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:10:21.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:20 smithi189 ceph-mon[32756]: pgmap v21218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:21.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:20 smithi189 ceph-mon[32756]: pgmap v21219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:10:21.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:20 smithi189 ceph-mon[32756]: pgmap v21220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:20 smithi156 ceph-mon[32679]: pgmap v21218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:20 smithi156 ceph-mon[32679]: pgmap v21219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:10:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:20 smithi156 ceph-mon[32679]: pgmap v21220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:20 smithi092 ceph-mon[29156]: pgmap v21218: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:20 smithi092 ceph-mon[29156]: pgmap v21219: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:10:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:20 smithi092 ceph-mon[29156]: pgmap v21220: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:21 smithi189 ceph-mon[32756]: pgmap v21221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:21 smithi156 ceph-mon[32679]: pgmap v21221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:21 smithi092 ceph-mon[29156]: pgmap v21221: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:24 smithi189 ceph-mon[32756]: pgmap v21222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:24.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39120.078305 secs 2024-04-27T05:10:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:24 smithi156 ceph-mon[32679]: pgmap v21222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39120.078305 secs 2024-04-27T05:10:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:24 smithi092 ceph-mon[29156]: pgmap v21222: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39120.078305 secs 2024-04-27T05:10:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:10:26.354+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:10:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:10:26.354+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:10:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:10:26.354+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:10:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:10:26.354+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 301 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:10:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:26 smithi189 ceph-mon[32756]: pgmap v21223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:26 smithi156 ceph-mon[32679]: pgmap v21223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:26 smithi092 ceph-mon[29156]: pgmap v21223: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:10:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:28 smithi189 ceph-mon[32756]: pgmap v21224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:10:28.926 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:28 smithi092 ceph-mon[29156]: pgmap v21224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:10:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:28 smithi156 ceph-mon[32679]: pgmap v21224: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:10:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39125.078457 secs 2024-04-27T05:10:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39125.078457 secs 2024-04-27T05:10:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39125.078457 secs 2024-04-27T05:10:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:30 smithi189 ceph-mon[32756]: pgmap v21225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:10:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:30 smithi156 ceph-mon[32679]: pgmap v21225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:10:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:30 smithi092 ceph-mon[29156]: pgmap v21225: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:10:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:32 smithi189 ceph-mon[32756]: pgmap v21226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:32 smithi156 ceph-mon[32679]: pgmap v21226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:32 smithi092 ceph-mon[29156]: pgmap v21226: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:34 smithi189 ceph-mon[32756]: pgmap v21227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39130.078577 secs 2024-04-27T05:10:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:34 smithi156 ceph-mon[32679]: pgmap v21227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39130.078577 secs 2024-04-27T05:10:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:34 smithi092 ceph-mon[29156]: pgmap v21227: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39130.078577 secs 2024-04-27T05:10:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:36 smithi189 ceph-mon[32756]: pgmap v21228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:36 smithi156 ceph-mon[32679]: pgmap v21228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:36 smithi092 ceph-mon[29156]: pgmap v21228: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:38 smithi189 ceph-mon[32756]: pgmap v21229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:38 smithi156 ceph-mon[32679]: pgmap v21229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:38 smithi092 ceph-mon[29156]: pgmap v21229: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39135.078637 secs 2024-04-27T05:10:39.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39135.078637 secs 2024-04-27T05:10:39.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39135.078637 secs 2024-04-27T05:10:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:40 smithi189 ceph-mon[32756]: pgmap v21230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:40 smithi156 ceph-mon[32679]: pgmap v21230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:40 smithi092 ceph-mon[29156]: pgmap v21230: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:42 smithi189 ceph-mon[32756]: pgmap v21231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:42 smithi156 ceph-mon[32679]: pgmap v21231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:42 smithi092 ceph-mon[29156]: pgmap v21231: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:44 smithi189 ceph-mon[32756]: pgmap v21232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39140.078757 secs 2024-04-27T05:10:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:44 smithi156 ceph-mon[32679]: pgmap v21232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39140.078757 secs 2024-04-27T05:10:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:44 smithi092 ceph-mon[29156]: pgmap v21232: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39140.078757 secs 2024-04-27T05:10:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:45 smithi189 ceph-mon[32756]: 32 slow requests, 3 included below; oldest blocked for > 38443.042358 secs 2024-04-27T05:10:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:45 smithi189 ceph-mon[32756]: slow request 182.924024 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:10:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:45 smithi189 ceph-mon[32756]: slow request 11556.007442 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:45 smithi189 ceph-mon[32756]: slow request 5914.486808 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:45 smithi156 ceph-mon[32679]: 32 slow requests, 3 included below; oldest blocked for > 38443.042358 secs 2024-04-27T05:10:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:45 smithi156 ceph-mon[32679]: slow request 182.924024 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:10:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:45 smithi156 ceph-mon[32679]: slow request 11556.007442 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:45 smithi156 ceph-mon[32679]: slow request 5914.486808 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:45 smithi092 ceph-mon[29156]: 32 slow requests, 3 included below; oldest blocked for > 38443.042358 secs 2024-04-27T05:10:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:45 smithi092 ceph-mon[29156]: slow request 182.924024 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:10:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:45 smithi092 ceph-mon[29156]: slow request 11556.007442 seconds old, received at 2024-04-27T01:58:08.180950+0000: client_request(client.17361:1 getattr pAsLsXsFs #0x1 2024-04-27T01:58:08.177315+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:45 smithi092 ceph-mon[29156]: slow request 5914.486808 seconds old, received at 2024-04-27T03:32:09.701584+0000: client_request(client.17469:1 getattr pAsLsXsFs #0x1 2024-04-27T03:32:09.697292+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:10:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:46 smithi189 ceph-mon[32756]: pgmap v21233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:46 smithi189 ceph-mon[32756]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:10:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:46 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:10:46.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:46 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:10:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:46 smithi156 ceph-mon[32679]: pgmap v21233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:46 smithi156 ceph-mon[32679]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:10:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:46 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:10:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:46 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:10:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:46 smithi092 ceph-mon[29156]: pgmap v21233: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:46 smithi092 ceph-mon[29156]: Health check update: 2 MDSs report slow requests (MDS_SLOW_REQUEST) 2024-04-27T05:10:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:46 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:10:46.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:46 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:10:48.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:48 smithi189 ceph-mon[32756]: pgmap v21234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:48 smithi156 ceph-mon[32679]: pgmap v21234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:48 smithi092 ceph-mon[29156]: pgmap v21234: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39145.078893 secs 2024-04-27T05:10:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39145.078893 secs 2024-04-27T05:10:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39145.078893 secs 2024-04-27T05:10:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38448.042481 secs 2024-04-27T05:10:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:50 smithi189 ceph-mon[32756]: pgmap v21235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38448.042481 secs 2024-04-27T05:10:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:50 smithi156 ceph-mon[32679]: pgmap v21235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38448.042481 secs 2024-04-27T05:10:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:50 smithi092 ceph-mon[29156]: pgmap v21235: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:52 smithi156 ceph-mon[32679]: pgmap v21236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:52 smithi092 ceph-mon[29156]: pgmap v21236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:52 smithi189 ceph-mon[32756]: pgmap v21236: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:54 smithi156 ceph-mon[32679]: pgmap v21237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39150.079005 secs 2024-04-27T05:10:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:54 smithi092 ceph-mon[29156]: pgmap v21237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39150.079005 secs 2024-04-27T05:10:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:54 smithi189 ceph-mon[32756]: pgmap v21237: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:10:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39150.079005 secs 2024-04-27T05:10:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38453.042601 secs 2024-04-27T05:10:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38453.042601 secs 2024-04-27T05:10:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38453.042601 secs 2024-04-27T05:10:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:56 smithi156 ceph-mon[32679]: pgmap v21238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:56 smithi092 ceph-mon[29156]: pgmap v21238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:56 smithi189 ceph-mon[32756]: pgmap v21238: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:58 smithi156 ceph-mon[32679]: pgmap v21239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:58.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:58 smithi189 ceph-mon[32756]: pgmap v21239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:58 smithi092 ceph-mon[29156]: pgmap v21239: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:10:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:10:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39155.079084 secs 2024-04-27T05:10:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:10:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39155.079084 secs 2024-04-27T05:11:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:10:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39155.079084 secs 2024-04-27T05:11:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38458.042720 secs 2024-04-27T05:11:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:00 smithi156 ceph-mon[32679]: pgmap v21240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38458.042720 secs 2024-04-27T05:11:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:00 smithi092 ceph-mon[29156]: pgmap v21240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38458.042720 secs 2024-04-27T05:11:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:00 smithi189 ceph-mon[32756]: pgmap v21240: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:02.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:02 smithi156 ceph-mon[32679]: pgmap v21241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:02 smithi092 ceph-mon[29156]: pgmap v21241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:03.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:02 smithi189 ceph-mon[32756]: pgmap v21241: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:04 smithi156 ceph-mon[32679]: pgmap v21242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39160.079204 secs 2024-04-27T05:11:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:04 smithi092 ceph-mon[29156]: pgmap v21242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39160.079204 secs 2024-04-27T05:11:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:04 smithi189 ceph-mon[32756]: pgmap v21242: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:05.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39160.079204 secs 2024-04-27T05:11:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38463.042866 secs 2024-04-27T05:11:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38463.042866 secs 2024-04-27T05:11:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38463.042866 secs 2024-04-27T05:11:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:06 smithi092 ceph-mon[29156]: pgmap v21243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:06 smithi189 ceph-mon[32756]: pgmap v21243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:06 smithi156 ceph-mon[32679]: pgmap v21243: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:08 smithi092 ceph-mon[29156]: pgmap v21244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:08 smithi189 ceph-mon[32756]: pgmap v21244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:08 smithi156 ceph-mon[32679]: pgmap v21244: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39165.079320 secs 2024-04-27T05:11:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39165.079320 secs 2024-04-27T05:11:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39165.079320 secs 2024-04-27T05:11:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38468.042983 secs 2024-04-27T05:11:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:10 smithi092 ceph-mon[29156]: pgmap v21245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38468.042983 secs 2024-04-27T05:11:11.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:10 smithi189 ceph-mon[32756]: pgmap v21245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38468.042983 secs 2024-04-27T05:11:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:10 smithi156 ceph-mon[32679]: pgmap v21245: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:12 smithi092 ceph-mon[29156]: pgmap v21246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:12 smithi189 ceph-mon[32756]: pgmap v21246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:12 smithi156 ceph-mon[32679]: pgmap v21246: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:14 smithi092 ceph-mon[29156]: pgmap v21247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39170.079440 secs 2024-04-27T05:11:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:14 smithi189 ceph-mon[32756]: pgmap v21247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:15.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39170.079440 secs 2024-04-27T05:11:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:14 smithi156 ceph-mon[32679]: pgmap v21247: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39170.079440 secs 2024-04-27T05:11:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38473.043099 secs 2024-04-27T05:11:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38473.043099 secs 2024-04-27T05:11:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38473.043099 secs 2024-04-27T05:11:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:16 smithi092 ceph-mon[29156]: pgmap v21248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:16 smithi189 ceph-mon[32756]: pgmap v21248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:16 smithi156 ceph-mon[32679]: pgmap v21248: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:18 smithi092 ceph-mon[29156]: pgmap v21249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:18 smithi189 ceph-mon[32756]: pgmap v21249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:18 smithi156 ceph-mon[32679]: pgmap v21249: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39175.079572 secs 2024-04-27T05:11:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39175.079572 secs 2024-04-27T05:11:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39175.079572 secs 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38478.043237 secs 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: pgmap v21250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:11:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:20 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:11:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38478.043237 secs 2024-04-27T05:11:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: pgmap v21250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:11:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:11:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:11:21.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:20 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:11:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38478.043237 secs 2024-04-27T05:11:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: pgmap v21250: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:11:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:11:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:11:21.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:20 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:11:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:21 smithi092 ceph-mon[29156]: pgmap v21251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:11:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:21 smithi092 ceph-mon[29156]: pgmap v21252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:21 smithi189 ceph-mon[32756]: pgmap v21251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:11:22.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:21 smithi189 ceph-mon[32756]: pgmap v21252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:21 smithi156 ceph-mon[32679]: pgmap v21251: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:11:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:21 smithi156 ceph-mon[32679]: pgmap v21252: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:23 smithi092 ceph-mon[29156]: pgmap v21253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:23 smithi189 ceph-mon[32756]: pgmap v21253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:24.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:23 smithi156 ceph-mon[32679]: pgmap v21253: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39180.079706 secs 2024-04-27T05:11:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39180.079706 secs 2024-04-27T05:11:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39180.079706 secs 2024-04-27T05:11:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38483.043375 secs 2024-04-27T05:11:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:25 smithi092 ceph-mon[29156]: pgmap v21254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38483.043375 secs 2024-04-27T05:11:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:25 smithi189 ceph-mon[32756]: pgmap v21254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38483.043375 secs 2024-04-27T05:11:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:25 smithi156 ceph-mon[32679]: pgmap v21254: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:27 smithi092 ceph-mon[29156]: pgmap v21255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:27 smithi189 ceph-mon[32756]: pgmap v21255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:27 smithi156 ceph-mon[32679]: pgmap v21255: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:11:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:29 smithi189 ceph-mon[32756]: pgmap v21256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39185.079849 secs 2024-04-27T05:11:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:29 smithi156 ceph-mon[32679]: pgmap v21256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39185.079849 secs 2024-04-27T05:11:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:29 smithi092 ceph-mon[29156]: pgmap v21256: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:11:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39185.079849 secs 2024-04-27T05:11:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38488.043492 secs 2024-04-27T05:11:31.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38488.043492 secs 2024-04-27T05:11:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38488.043492 secs 2024-04-27T05:11:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:31 smithi189 ceph-mon[32756]: pgmap v21257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:11:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:31 smithi156 ceph-mon[32679]: pgmap v21257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:11:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:31 smithi092 ceph-mon[29156]: pgmap v21257: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:11:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:33 smithi189 ceph-mon[32756]: pgmap v21258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:33 smithi156 ceph-mon[32679]: pgmap v21258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:33 smithi092 ceph-mon[29156]: pgmap v21258: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39190.079961 secs 2024-04-27T05:11:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39190.079961 secs 2024-04-27T05:11:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39190.079961 secs 2024-04-27T05:11:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38493.043613 secs 2024-04-27T05:11:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:35 smithi189 ceph-mon[32756]: pgmap v21259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38493.043613 secs 2024-04-27T05:11:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:35 smithi156 ceph-mon[32679]: pgmap v21259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38493.043613 secs 2024-04-27T05:11:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:35 smithi092 ceph-mon[29156]: pgmap v21259: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:38.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:37 smithi189 ceph-mon[32756]: pgmap v21260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:37 smithi156 ceph-mon[32679]: pgmap v21260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:37 smithi092 ceph-mon[29156]: pgmap v21260: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:39 smithi189 ceph-mon[32756]: pgmap v21261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:39.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39195.080094 secs 2024-04-27T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:39 smithi156 ceph-mon[32679]: pgmap v21261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39195.080094 secs 2024-04-27T05:11:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:39 smithi092 ceph-mon[29156]: pgmap v21261: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39195.080094 secs 2024-04-27T05:11:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38498.043730 secs 2024-04-27T05:11:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38498.043730 secs 2024-04-27T05:11:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38498.043730 secs 2024-04-27T05:11:41.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:41 smithi189 ceph-mon[32756]: pgmap v21262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:41.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:41 smithi156 ceph-mon[32679]: pgmap v21262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:41 smithi092 ceph-mon[29156]: pgmap v21262: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:43 smithi092 ceph-mon[29156]: pgmap v21263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:43 smithi189 ceph-mon[32756]: pgmap v21263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:43 smithi156 ceph-mon[32679]: pgmap v21263: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39200.080215 secs 2024-04-27T05:11:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39200.080215 secs 2024-04-27T05:11:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39200.080215 secs 2024-04-27T05:11:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:45 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38503.043841 secs 2024-04-27T05:11:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:45 smithi092 ceph-mon[29156]: pgmap v21264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:45 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38503.043841 secs 2024-04-27T05:11:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:45 smithi189 ceph-mon[32756]: pgmap v21264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:45 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38503.043841 secs 2024-04-27T05:11:45.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:45 smithi156 ceph-mon[32679]: pgmap v21264: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:47 smithi092 ceph-mon[29156]: pgmap v21265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:47 smithi189 ceph-mon[32756]: pgmap v21265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:47 smithi156 ceph-mon[32679]: pgmap v21265: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:49 smithi092 ceph-mon[29156]: pgmap v21266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39205.080331 secs 2024-04-27T05:11:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:49 smithi189 ceph-mon[32756]: pgmap v21266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39205.080331 secs 2024-04-27T05:11:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:49 smithi156 ceph-mon[32679]: pgmap v21266: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39205.080331 secs 2024-04-27T05:11:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38508.043940 secs 2024-04-27T05:11:50.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38508.043940 secs 2024-04-27T05:11:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38508.043940 secs 2024-04-27T05:11:51.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:51 smithi092 ceph-mon[29156]: pgmap v21267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:51 smithi189 ceph-mon[32756]: pgmap v21267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:51 smithi156 ceph-mon[32679]: pgmap v21267: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:53 smithi092 ceph-mon[29156]: pgmap v21268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:53.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:53 smithi189 ceph-mon[32756]: pgmap v21268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:53 smithi156 ceph-mon[32679]: pgmap v21268: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39210.080445 secs 2024-04-27T05:11:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39210.080445 secs 2024-04-27T05:11:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39210.080445 secs 2024-04-27T05:11:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38513.044058 secs 2024-04-27T05:11:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:55 smithi189 ceph-mon[32756]: pgmap v21269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38513.044058 secs 2024-04-27T05:11:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:55 smithi156 ceph-mon[32679]: pgmap v21269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38513.044058 secs 2024-04-27T05:11:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:55 smithi092 ceph-mon[29156]: pgmap v21269: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:11:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:57 smithi189 ceph-mon[32756]: pgmap v21270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:57 smithi156 ceph-mon[32679]: pgmap v21270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:57 smithi092 ceph-mon[29156]: pgmap v21270: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:59 smithi189 ceph-mon[32756]: pgmap v21271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:59.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:11:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39215.080568 secs 2024-04-27T05:11:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:59 smithi156 ceph-mon[32679]: pgmap v21271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:11:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39215.080568 secs 2024-04-27T05:11:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:59 smithi092 ceph-mon[29156]: pgmap v21271: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:11:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:11:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39215.080568 secs 2024-04-27T05:12:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38518.044165 secs 2024-04-27T05:12:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38518.044165 secs 2024-04-27T05:12:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38518.044165 secs 2024-04-27T05:12:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:01 smithi189 ceph-mon[32756]: pgmap v21272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:01 smithi156 ceph-mon[32679]: pgmap v21272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:01 smithi092 ceph-mon[29156]: pgmap v21272: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:03.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:03 smithi189 ceph-mon[32756]: pgmap v21273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:03 smithi156 ceph-mon[32679]: pgmap v21273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:03 smithi092 ceph-mon[29156]: pgmap v21273: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39220.080703 secs 2024-04-27T05:12:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39220.080703 secs 2024-04-27T05:12:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39220.080703 secs 2024-04-27T05:12:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38523.044311 secs 2024-04-27T05:12:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:05 smithi189 ceph-mon[32756]: pgmap v21274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38523.044311 secs 2024-04-27T05:12:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:05 smithi156 ceph-mon[32679]: pgmap v21274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38523.044311 secs 2024-04-27T05:12:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:05 smithi092 ceph-mon[29156]: pgmap v21274: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:07 smithi189 ceph-mon[32756]: pgmap v21275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:07 smithi156 ceph-mon[32679]: pgmap v21275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:07 smithi092 ceph-mon[29156]: pgmap v21275: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:09.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:09 smithi092 ceph-mon[29156]: pgmap v21276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:09.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39225.080833 secs 2024-04-27T05:12:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:09 smithi189 ceph-mon[32756]: pgmap v21276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39225.080833 secs 2024-04-27T05:12:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:09 smithi156 ceph-mon[32679]: pgmap v21276: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39225.080833 secs 2024-04-27T05:12:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38528.044380 secs 2024-04-27T05:12:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38528.044380 secs 2024-04-27T05:12:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38528.044380 secs 2024-04-27T05:12:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:11 smithi189 ceph-mon[32756]: pgmap v21277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:11 smithi156 ceph-mon[32679]: pgmap v21277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:11 smithi092 ceph-mon[29156]: pgmap v21277: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:13 smithi189 ceph-mon[32756]: pgmap v21278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:13 smithi156 ceph-mon[32679]: pgmap v21278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:13 smithi092 ceph-mon[29156]: pgmap v21278: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39230.080954 secs 2024-04-27T05:12:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39230.080954 secs 2024-04-27T05:12:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39230.080954 secs 2024-04-27T05:12:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38533.044500 secs 2024-04-27T05:12:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:15 smithi189 ceph-mon[32756]: pgmap v21279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38533.044500 secs 2024-04-27T05:12:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:15 smithi156 ceph-mon[32679]: pgmap v21279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38533.044500 secs 2024-04-27T05:12:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:15 smithi092 ceph-mon[29156]: pgmap v21279: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:17 smithi189 ceph-mon[32756]: pgmap v21280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:17 smithi156 ceph-mon[32679]: pgmap v21280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:17.982 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:17 smithi092 ceph-mon[29156]: pgmap v21280: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:19 smithi189 ceph-mon[32756]: pgmap v21281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39235.081072 secs 2024-04-27T05:12:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:19 smithi156 ceph-mon[32679]: pgmap v21281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39235.081072 secs 2024-04-27T05:12:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:19 smithi092 ceph-mon[29156]: pgmap v21281: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39235.081072 secs 2024-04-27T05:12:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38538.044615 secs 2024-04-27T05:12:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38538.044615 secs 2024-04-27T05:12:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38538.044615 secs 2024-04-27T05:12:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:21 smithi189 ceph-mon[32756]: pgmap v21282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:12:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:12:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:12:21.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:12:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:21 smithi156 ceph-mon[32679]: pgmap v21282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:12:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:12:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:12:21.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:12:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:21 smithi092 ceph-mon[29156]: pgmap v21282: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:12:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:12:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:12:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:12:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:22 smithi189 ceph-mon[32756]: pgmap v21283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:12:22.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:22 smithi189 ceph-mon[32756]: pgmap v21284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:22 smithi156 ceph-mon[32679]: pgmap v21283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:12:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:22 smithi156 ceph-mon[32679]: pgmap v21284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:22 smithi092 ceph-mon[29156]: pgmap v21283: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:12:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:22 smithi092 ceph-mon[29156]: pgmap v21284: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:24 smithi189 ceph-mon[32756]: pgmap v21285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:12:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39240.081184 secs 2024-04-27T05:12:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:24 smithi156 ceph-mon[32679]: pgmap v21285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:12:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39240.081184 secs 2024-04-27T05:12:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:24 smithi092 ceph-mon[29156]: pgmap v21285: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:12:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39240.081184 secs 2024-04-27T05:12:25.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38543.044694 secs 2024-04-27T05:12:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38543.044694 secs 2024-04-27T05:12:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38543.044694 secs 2024-04-27T05:12:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:26 smithi189 ceph-mon[32756]: pgmap v21286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:26 smithi156 ceph-mon[32679]: pgmap v21286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:26 smithi092 ceph-mon[29156]: pgmap v21286: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:28 smithi189 ceph-mon[32756]: pgmap v21287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:28 smithi156 ceph-mon[32679]: pgmap v21287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:28 smithi092 ceph-mon[29156]: pgmap v21287: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:29.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39245.081305 secs 2024-04-27T05:12:29.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39245.081305 secs 2024-04-27T05:12:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39245.081305 secs 2024-04-27T05:12:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:30 smithi189 ceph-mon[32756]: pgmap v21288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38548.044752 secs 2024-04-27T05:12:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:30 smithi156 ceph-mon[32679]: pgmap v21288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38548.044752 secs 2024-04-27T05:12:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:30 smithi092 ceph-mon[29156]: pgmap v21288: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:12:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38548.044752 secs 2024-04-27T05:12:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:32 smithi189 ceph-mon[32756]: pgmap v21289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:12:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:32 smithi156 ceph-mon[32679]: pgmap v21289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:12:32.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:32 smithi092 ceph-mon[29156]: pgmap v21289: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:12:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:34 smithi189 ceph-mon[32756]: pgmap v21290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39250.081424 secs 2024-04-27T05:12:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:34 smithi156 ceph-mon[32679]: pgmap v21290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39250.081424 secs 2024-04-27T05:12:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:34 smithi092 ceph-mon[29156]: pgmap v21290: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39250.081424 secs 2024-04-27T05:12:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38553.044864 secs 2024-04-27T05:12:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38553.044864 secs 2024-04-27T05:12:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38553.044864 secs 2024-04-27T05:12:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:36 smithi189 ceph-mon[32756]: pgmap v21291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:36 smithi156 ceph-mon[32679]: pgmap v21291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:36 smithi092 ceph-mon[29156]: pgmap v21291: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:38 smithi189 ceph-mon[32756]: pgmap v21292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:38 smithi156 ceph-mon[32679]: pgmap v21292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:38 smithi092 ceph-mon[29156]: pgmap v21292: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39255.081535 secs 2024-04-27T05:12:39.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39255.081535 secs 2024-04-27T05:12:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39255.081535 secs 2024-04-27T05:12:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:40 smithi189 ceph-mon[32756]: pgmap v21293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38558.044949 secs 2024-04-27T05:12:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:40 smithi156 ceph-mon[32679]: pgmap v21293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38558.044949 secs 2024-04-27T05:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:40 smithi092 ceph-mon[29156]: pgmap v21293: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:12:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38558.044949 secs 2024-04-27T05:12:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:12:41.371+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:12:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:12:41.371+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:12:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:12:41.372+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:12:41.374 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:12:41.372+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 302 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:12:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:12:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:12:41.365+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:12:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:12:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:12:41.365+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:12:41.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:12:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:12:41.365+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:12:41.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:12:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:12:41.365+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:12:41.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:12:41 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:12:41.365+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:12:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:42 smithi189 ceph-mon[32756]: pgmap v21294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:42 smithi156 ceph-mon[32679]: pgmap v21294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:42.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:42 smithi092 ceph-mon[29156]: pgmap v21294: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:44 smithi189 ceph-mon[32756]: pgmap v21295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:44.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39260.081669 secs 2024-04-27T05:12:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:44 smithi156 ceph-mon[32679]: pgmap v21295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39260.081669 secs 2024-04-27T05:12:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:44 smithi092 ceph-mon[29156]: pgmap v21295: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39260.081669 secs 2024-04-27T05:12:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:45 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38563.045084 secs 2024-04-27T05:12:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:45 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38563.045084 secs 2024-04-27T05:12:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:45 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38563.045084 secs 2024-04-27T05:12:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:46 smithi189 ceph-mon[32756]: pgmap v21296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:46.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:46 smithi156 ceph-mon[32679]: pgmap v21296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:46.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:46 smithi092 ceph-mon[29156]: pgmap v21296: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:48 smithi189 ceph-mon[32756]: pgmap v21297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:48 smithi156 ceph-mon[32679]: pgmap v21297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:48.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:48 smithi092 ceph-mon[29156]: pgmap v21297: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39265.081803 secs 2024-04-27T05:12:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39265.081803 secs 2024-04-27T05:12:49.726 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39265.081803 secs 2024-04-27T05:12:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:50 smithi189 ceph-mon[32756]: pgmap v21298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38568.045169 secs 2024-04-27T05:12:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:50 smithi156 ceph-mon[32679]: pgmap v21298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38568.045169 secs 2024-04-27T05:12:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:50 smithi092 ceph-mon[29156]: pgmap v21298: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38568.045169 secs 2024-04-27T05:12:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:52 smithi189 ceph-mon[32756]: pgmap v21299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:52 smithi156 ceph-mon[32679]: pgmap v21299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:52 smithi092 ceph-mon[29156]: pgmap v21299: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:54 smithi189 ceph-mon[32756]: pgmap v21300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:54.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39270.081867 secs 2024-04-27T05:12:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:54 smithi156 ceph-mon[32679]: pgmap v21300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:54.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39270.081867 secs 2024-04-27T05:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:54 smithi092 ceph-mon[29156]: pgmap v21300: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 170 B/s wr, 14 op/s 2024-04-27T05:12:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39270.081867 secs 2024-04-27T05:12:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38573.045306 secs 2024-04-27T05:12:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38573.045306 secs 2024-04-27T05:12:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38573.045306 secs 2024-04-27T05:12:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:56 smithi156 ceph-mon[32679]: pgmap v21301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:56.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:56 smithi092 ceph-mon[29156]: pgmap v21301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:56 smithi189 ceph-mon[32756]: pgmap v21301: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 16 op/s 2024-04-27T05:12:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:58 smithi156 ceph-mon[32679]: pgmap v21302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:58 smithi092 ceph-mon[29156]: pgmap v21302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:58.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:58 smithi189 ceph-mon[32756]: pgmap v21302: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:12:59.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:12:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39275.081976 secs 2024-04-27T05:12:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:12:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39275.081976 secs 2024-04-27T05:12:59.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:12:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39275.081976 secs 2024-04-27T05:13:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38578.045410 secs 2024-04-27T05:13:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:00 smithi156 ceph-mon[32679]: pgmap v21303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38578.045410 secs 2024-04-27T05:13:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:00 smithi092 ceph-mon[29156]: pgmap v21303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38578.045410 secs 2024-04-27T05:13:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:00 smithi189 ceph-mon[32756]: pgmap v21303: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:02 smithi156 ceph-mon[32679]: pgmap v21304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:02 smithi092 ceph-mon[29156]: pgmap v21304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:02 smithi189 ceph-mon[32756]: pgmap v21304: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:04 smithi156 ceph-mon[32679]: pgmap v21305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39280.082071 secs 2024-04-27T05:13:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:04 smithi092 ceph-mon[29156]: pgmap v21305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39280.082071 secs 2024-04-27T05:13:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:04 smithi189 ceph-mon[32756]: pgmap v21305: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39280.082071 secs 2024-04-27T05:13:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38583.045480 secs 2024-04-27T05:13:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38583.045480 secs 2024-04-27T05:13:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38583.045480 secs 2024-04-27T05:13:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:06 smithi156 ceph-mon[32679]: pgmap v21306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:06 smithi092 ceph-mon[29156]: pgmap v21306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:06 smithi189 ceph-mon[32756]: pgmap v21306: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:08 smithi156 ceph-mon[32679]: pgmap v21307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:08 smithi092 ceph-mon[29156]: pgmap v21307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:08 smithi189 ceph-mon[32756]: pgmap v21307: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39285.082192 secs 2024-04-27T05:13:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39285.082192 secs 2024-04-27T05:13:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39285.082192 secs 2024-04-27T05:13:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38588.045597 secs 2024-04-27T05:13:10.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:10 smithi092 ceph-mon[29156]: pgmap v21308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38588.045597 secs 2024-04-27T05:13:10.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:10 smithi189 ceph-mon[32756]: pgmap v21308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38588.045597 secs 2024-04-27T05:13:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:10 smithi156 ceph-mon[32679]: pgmap v21308: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:12 smithi092 ceph-mon[29156]: pgmap v21309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:12 smithi189 ceph-mon[32756]: pgmap v21309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:12 smithi156 ceph-mon[32679]: pgmap v21309: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:14 smithi092 ceph-mon[29156]: pgmap v21310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39290.082304 secs 2024-04-27T05:13:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:14 smithi189 ceph-mon[32756]: pgmap v21310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39290.082304 secs 2024-04-27T05:13:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:14 smithi156 ceph-mon[32679]: pgmap v21310: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:13:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39290.082304 secs 2024-04-27T05:13:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38593.045688 secs 2024-04-27T05:13:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38593.045688 secs 2024-04-27T05:13:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38593.045688 secs 2024-04-27T05:13:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:16 smithi092 ceph-mon[29156]: pgmap v21311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:16 smithi189 ceph-mon[32756]: pgmap v21311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:16 smithi156 ceph-mon[32679]: pgmap v21311: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:13:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:18 smithi092 ceph-mon[29156]: pgmap v21312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:18 smithi189 ceph-mon[32756]: pgmap v21312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:18 smithi156 ceph-mon[32679]: pgmap v21312: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39295.082425 secs 2024-04-27T05:13:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39295.082425 secs 2024-04-27T05:13:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39295.082425 secs 2024-04-27T05:13:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38598.045799 secs 2024-04-27T05:13:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:20 smithi092 ceph-mon[29156]: pgmap v21313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38598.045799 secs 2024-04-27T05:13:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:20 smithi189 ceph-mon[32756]: pgmap v21313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38598.045799 secs 2024-04-27T05:13:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:20 smithi156 ceph-mon[32679]: pgmap v21313: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:21.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:21 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:13:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:21 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:13:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:21 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:13:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:22 smithi092 ceph-mon[29156]: pgmap v21314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:22.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:13:22.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:13:22.750 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:13:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:22 smithi189 ceph-mon[32756]: pgmap v21314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:13:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:13:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:13:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:22 smithi156 ceph-mon[32679]: pgmap v21314: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:13:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:13:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:13:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:23 smithi092 ceph-mon[29156]: pgmap v21315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:13:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:23 smithi092 ceph-mon[29156]: pgmap v21316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:23 smithi189 ceph-mon[32756]: pgmap v21315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:13:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:23 smithi189 ceph-mon[32756]: pgmap v21316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:23 smithi156 ceph-mon[32679]: pgmap v21315: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:13:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:23 smithi156 ceph-mon[32679]: pgmap v21316: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39300.082538 secs 2024-04-27T05:13:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39300.082538 secs 2024-04-27T05:13:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39300.082538 secs 2024-04-27T05:13:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:25 smithi092 ceph-mon[29156]: pgmap v21317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38603.045916 secs 2024-04-27T05:13:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:25 smithi189 ceph-mon[32756]: pgmap v21317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38603.045916 secs 2024-04-27T05:13:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:25 smithi156 ceph-mon[32679]: pgmap v21317: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38603.045916 secs 2024-04-27T05:13:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:27 smithi092 ceph-mon[29156]: pgmap v21318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:27 smithi189 ceph-mon[32756]: pgmap v21318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:27 smithi156 ceph-mon[32679]: pgmap v21318: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:29.736 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:29 smithi156 ceph-mon[32679]: pgmap v21319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:13:29.737 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39305.082655 secs 2024-04-27T05:13:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:29 smithi092 ceph-mon[29156]: pgmap v21319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:13:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39305.082655 secs 2024-04-27T05:13:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:29 smithi189 ceph-mon[32756]: pgmap v21319: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:13:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39305.082655 secs 2024-04-27T05:13:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38608.045994 secs 2024-04-27T05:13:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38608.045994 secs 2024-04-27T05:13:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38608.045994 secs 2024-04-27T05:13:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:31 smithi092 ceph-mon[29156]: pgmap v21320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:31.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:31 smithi189 ceph-mon[32756]: pgmap v21320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:31 smithi156 ceph-mon[32679]: pgmap v21320: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:13:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:33 smithi092 ceph-mon[29156]: pgmap v21321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:13:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:33 smithi189 ceph-mon[32756]: pgmap v21321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:13:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:33 smithi156 ceph-mon[32679]: pgmap v21321: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:13:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39310.082774 secs 2024-04-27T05:13:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39310.082774 secs 2024-04-27T05:13:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39310.082774 secs 2024-04-27T05:13:35.806 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:35 smithi092 ceph-mon[29156]: pgmap v21322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:35.806 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38613.046106 secs 2024-04-27T05:13:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:35 smithi189 ceph-mon[32756]: pgmap v21322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38613.046106 secs 2024-04-27T05:13:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:35 smithi156 ceph-mon[32679]: pgmap v21322: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38613.046106 secs 2024-04-27T05:13:37.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:37 smithi189 ceph-mon[32756]: pgmap v21323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:37 smithi156 ceph-mon[32679]: pgmap v21323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:37 smithi092 ceph-mon[29156]: pgmap v21323: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:39.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:39 smithi092 ceph-mon[29156]: pgmap v21324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:39.798 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39315.082890 secs 2024-04-27T05:13:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:39 smithi189 ceph-mon[32756]: pgmap v21324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39315.082890 secs 2024-04-27T05:13:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:39 smithi156 ceph-mon[32679]: pgmap v21324: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:39.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39315.082890 secs 2024-04-27T05:13:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38618.046246 secs 2024-04-27T05:13:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38618.046246 secs 2024-04-27T05:13:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38618.046246 secs 2024-04-27T05:13:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:41 smithi189 ceph-mon[32756]: pgmap v21325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:41 smithi156 ceph-mon[32679]: pgmap v21325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:41 smithi092 ceph-mon[29156]: pgmap v21325: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:43 smithi189 ceph-mon[32756]: pgmap v21326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:43 smithi156 ceph-mon[32679]: pgmap v21326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:43 smithi092 ceph-mon[29156]: pgmap v21326: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:13:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39320.083017 secs 2024-04-27T05:13:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39320.083017 secs 2024-04-27T05:13:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39320.083017 secs 2024-04-27T05:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:45 smithi189 ceph-mon[32756]: pgmap v21327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:45 smithi189 ceph-mon[32756]: 32 slow requests, 2 included below; oldest blocked for > 38623.046373 secs 2024-04-27T05:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:45 smithi189 ceph-mon[32756]: slow request 362.928039 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:45.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:45 smithi189 ceph-mon[32756]: slow request 2883.602098 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:45 smithi156 ceph-mon[32679]: pgmap v21327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:45 smithi156 ceph-mon[32679]: 32 slow requests, 2 included below; oldest blocked for > 38623.046373 secs 2024-04-27T05:13:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:45 smithi156 ceph-mon[32679]: slow request 362.928039 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:45 smithi156 ceph-mon[32679]: slow request 2883.602098 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:45 smithi092 ceph-mon[29156]: pgmap v21327: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:13:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:45 smithi092 ceph-mon[29156]: 32 slow requests, 2 included below; oldest blocked for > 38623.046373 secs 2024-04-27T05:13:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:45 smithi092 ceph-mon[29156]: slow request 362.928039 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:45 smithi092 ceph-mon[29156]: slow request 2883.602098 seconds old, received at 2024-04-27T04:25:40.590308+0000: client_request(client.17529:1 getattr pAsLsXsFs #0x1 2024-04-27T04:25:40.585770+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:13:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:47 smithi189 ceph-mon[32756]: pgmap v21328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:47 smithi156 ceph-mon[32679]: pgmap v21328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:47 smithi092 ceph-mon[29156]: pgmap v21328: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:49 smithi189 ceph-mon[32756]: pgmap v21329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:49.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39325.083083 secs 2024-04-27T05:13:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:49 smithi156 ceph-mon[32679]: pgmap v21329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39325.083083 secs 2024-04-27T05:13:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:49 smithi092 ceph-mon[29156]: pgmap v21329: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39325.083083 secs 2024-04-27T05:13:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38628.046436 secs 2024-04-27T05:13:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38628.046436 secs 2024-04-27T05:13:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38628.046436 secs 2024-04-27T05:13:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:51 smithi189 ceph-mon[32756]: pgmap v21330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:51 smithi156 ceph-mon[32679]: pgmap v21330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:51 smithi092 ceph-mon[29156]: pgmap v21330: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:53.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:53 smithi189 ceph-mon[32756]: pgmap v21331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:53 smithi156 ceph-mon[32679]: pgmap v21331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:53 smithi092 ceph-mon[29156]: pgmap v21331: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39330.083190 secs 2024-04-27T05:13:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39330.083190 secs 2024-04-27T05:13:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39330.083190 secs 2024-04-27T05:13:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:55 smithi189 ceph-mon[32756]: pgmap v21332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38633.046552 secs 2024-04-27T05:13:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:55 smithi156 ceph-mon[32679]: pgmap v21332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38633.046552 secs 2024-04-27T05:13:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:55 smithi092 ceph-mon[29156]: pgmap v21332: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:13:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38633.046552 secs 2024-04-27T05:13:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:57 smithi189 ceph-mon[32756]: pgmap v21333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:57 smithi156 ceph-mon[32679]: pgmap v21333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:57 smithi092 ceph-mon[29156]: pgmap v21333: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:59 smithi189 ceph-mon[32756]: pgmap v21334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:13:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39335.083322 secs 2024-04-27T05:13:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:59 smithi156 ceph-mon[32679]: pgmap v21334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:13:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39335.083322 secs 2024-04-27T05:13:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:59 smithi092 ceph-mon[29156]: pgmap v21334: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:13:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:13:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39335.083322 secs 2024-04-27T05:14:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38638.046654 secs 2024-04-27T05:14:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38638.046654 secs 2024-04-27T05:14:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38638.046654 secs 2024-04-27T05:14:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:01 smithi189 ceph-mon[32756]: pgmap v21335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:01 smithi156 ceph-mon[32679]: pgmap v21335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:01 smithi092 ceph-mon[29156]: pgmap v21335: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:03.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:03 smithi189 ceph-mon[32756]: pgmap v21336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:03 smithi156 ceph-mon[32679]: pgmap v21336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:03 smithi092 ceph-mon[29156]: pgmap v21336: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39340.083440 secs 2024-04-27T05:14:04.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39340.083440 secs 2024-04-27T05:14:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39340.083440 secs 2024-04-27T05:14:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:05 smithi189 ceph-mon[32756]: pgmap v21337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38643.046733 secs 2024-04-27T05:14:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:05 smithi156 ceph-mon[32679]: pgmap v21337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38643.046733 secs 2024-04-27T05:14:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:05 smithi092 ceph-mon[29156]: pgmap v21337: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38643.046733 secs 2024-04-27T05:14:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:07 smithi189 ceph-mon[32756]: pgmap v21338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:07 smithi156 ceph-mon[32679]: pgmap v21338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:07 smithi092 ceph-mon[29156]: pgmap v21338: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:09 smithi189 ceph-mon[32756]: pgmap v21339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:09.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39345.083554 secs 2024-04-27T05:14:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:09 smithi156 ceph-mon[32679]: pgmap v21339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39345.083554 secs 2024-04-27T05:14:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:09 smithi092 ceph-mon[29156]: pgmap v21339: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39345.083554 secs 2024-04-27T05:14:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38648.046867 secs 2024-04-27T05:14:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38648.046867 secs 2024-04-27T05:14:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38648.046867 secs 2024-04-27T05:14:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:11 smithi189 ceph-mon[32756]: pgmap v21340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:11 smithi156 ceph-mon[32679]: pgmap v21340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:11.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:11 smithi092 ceph-mon[29156]: pgmap v21340: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:13 smithi189 ceph-mon[32756]: pgmap v21341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:13 smithi156 ceph-mon[32679]: pgmap v21341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:13 smithi092 ceph-mon[29156]: pgmap v21341: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39350.083675 secs 2024-04-27T05:14:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39350.083675 secs 2024-04-27T05:14:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39350.083675 secs 2024-04-27T05:14:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:15 smithi189 ceph-mon[32756]: pgmap v21342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:15.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38653.046942 secs 2024-04-27T05:14:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:15 smithi156 ceph-mon[32679]: pgmap v21342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38653.046942 secs 2024-04-27T05:14:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:15 smithi092 ceph-mon[29156]: pgmap v21342: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38653.046942 secs 2024-04-27T05:14:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:17 smithi189 ceph-mon[32756]: pgmap v21343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:17 smithi156 ceph-mon[32679]: pgmap v21343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:17 smithi092 ceph-mon[29156]: pgmap v21343: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:19 smithi189 ceph-mon[32756]: pgmap v21344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39355.083788 secs 2024-04-27T05:14:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:19 smithi156 ceph-mon[32679]: pgmap v21344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39355.083788 secs 2024-04-27T05:14:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:19 smithi092 ceph-mon[29156]: pgmap v21344: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39355.083788 secs 2024-04-27T05:14:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38658.047041 secs 2024-04-27T05:14:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38658.047041 secs 2024-04-27T05:14:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38658.047041 secs 2024-04-27T05:14:21.886 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:21 smithi092 ceph-mon[29156]: pgmap v21345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:21 smithi189 ceph-mon[32756]: pgmap v21345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:21 smithi156 ceph-mon[32679]: pgmap v21345: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:14:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:22 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:22 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:22 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:23.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:23 smithi156 ceph-mon[32679]: pgmap v21346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:23.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:23 smithi092 ceph-mon[29156]: pgmap v21346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:23 smithi189 ceph-mon[32756]: pgmap v21346: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39360.083873 secs 2024-04-27T05:14:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39360.083873 secs 2024-04-27T05:14:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39360.083873 secs 2024-04-27T05:14:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: pgmap v21347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38663.047135 secs 2024-04-27T05:14:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:25 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: pgmap v21347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38663.047135 secs 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:25 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: pgmap v21347: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38663.047135 secs 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:25 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:14:26.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:14:26.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:14:27.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:14:27.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:14:27.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:14:27.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:14:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:27 smithi189 ceph-mon[32756]: pgmap v21348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:27 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:14:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:27 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:27 smithi189 ceph-mon[32756]: pgmap v21349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:28.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:27 smithi189 ceph-mon[32756]: pgmap v21350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:27 smithi156 ceph-mon[32679]: pgmap v21348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:27 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:27 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:27 smithi156 ceph-mon[32679]: pgmap v21349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:27 smithi156 ceph-mon[32679]: pgmap v21350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:27 smithi092 ceph-mon[29156]: pgmap v21348: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:27 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:14:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:27 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:14:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:27 smithi092 ceph-mon[29156]: pgmap v21349: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:27 smithi092 ceph-mon[29156]: pgmap v21350: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:29 smithi189 ceph-mon[32756]: pgmap v21351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39365.083989 secs 2024-04-27T05:14:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:29 smithi156 ceph-mon[32679]: pgmap v21351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39365.083989 secs 2024-04-27T05:14:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:29 smithi092 ceph-mon[29156]: pgmap v21351: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39365.083989 secs 2024-04-27T05:14:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38668.047285 secs 2024-04-27T05:14:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38668.047285 secs 2024-04-27T05:14:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38668.047285 secs 2024-04-27T05:14:32.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:31 smithi189 ceph-mon[32756]: pgmap v21352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:31 smithi156 ceph-mon[32679]: pgmap v21352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:31 smithi092 ceph-mon[29156]: pgmap v21352: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:33 smithi189 ceph-mon[32756]: pgmap v21353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:33 smithi156 ceph-mon[32679]: pgmap v21353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:33 smithi092 ceph-mon[29156]: pgmap v21353: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:14:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39370.084104 secs 2024-04-27T05:14:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39370.084104 secs 2024-04-27T05:14:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39370.084104 secs 2024-04-27T05:14:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:35 smithi189 ceph-mon[32756]: pgmap v21354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:36.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38673.047330 secs 2024-04-27T05:14:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:35 smithi156 ceph-mon[32679]: pgmap v21354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38673.047330 secs 2024-04-27T05:14:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:35 smithi092 ceph-mon[29156]: pgmap v21354: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38673.047330 secs 2024-04-27T05:14:38.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:37 smithi092 ceph-mon[29156]: pgmap v21355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:37 smithi189 ceph-mon[32756]: pgmap v21355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:37 smithi156 ceph-mon[32679]: pgmap v21355: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:14:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:39 smithi189 ceph-mon[32756]: pgmap v21356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39375.084221 secs 2024-04-27T05:14:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:39 smithi156 ceph-mon[32679]: pgmap v21356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39375.084221 secs 2024-04-27T05:14:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:39 smithi092 ceph-mon[29156]: pgmap v21356: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39375.084221 secs 2024-04-27T05:14:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38678.047449 secs 2024-04-27T05:14:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38678.047449 secs 2024-04-27T05:14:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38678.047449 secs 2024-04-27T05:14:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:41 smithi189 ceph-mon[32756]: pgmap v21357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:41 smithi156 ceph-mon[32679]: pgmap v21357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:41 smithi092 ceph-mon[29156]: pgmap v21357: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:43 smithi189 ceph-mon[32756]: pgmap v21358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:43 smithi156 ceph-mon[32679]: pgmap v21358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:43 smithi092 ceph-mon[29156]: pgmap v21358: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39380.084320 secs 2024-04-27T05:14:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39380.084320 secs 2024-04-27T05:14:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39380.084320 secs 2024-04-27T05:14:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:45 smithi189 ceph-mon[32756]: pgmap v21359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:45 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38683.047562 secs 2024-04-27T05:14:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:45 smithi156 ceph-mon[32679]: pgmap v21359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:45 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38683.047562 secs 2024-04-27T05:14:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:45 smithi092 ceph-mon[29156]: pgmap v21359: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:45 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38683.047562 secs 2024-04-27T05:14:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:47 smithi189 ceph-mon[32756]: pgmap v21360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:47 smithi156 ceph-mon[32679]: pgmap v21360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:47 smithi092 ceph-mon[29156]: pgmap v21360: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:49 smithi189 ceph-mon[32756]: pgmap v21361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:50.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39385.084442 secs 2024-04-27T05:14:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:49 smithi156 ceph-mon[32679]: pgmap v21361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39385.084442 secs 2024-04-27T05:14:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:49 smithi092 ceph-mon[29156]: pgmap v21361: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39385.084442 secs 2024-04-27T05:14:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38688.047657 secs 2024-04-27T05:14:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38688.047657 secs 2024-04-27T05:14:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38688.047657 secs 2024-04-27T05:14:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:51 smithi189 ceph-mon[32756]: pgmap v21362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:51 smithi156 ceph-mon[32679]: pgmap v21362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:51 smithi092 ceph-mon[29156]: pgmap v21362: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:52 smithi189 ceph-mon[32756]: pgmap v21363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:52 smithi156 ceph-mon[32679]: pgmap v21363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:53.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:52 smithi092 ceph-mon[29156]: pgmap v21363: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:55 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39390.084560 secs 2024-04-27T05:14:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:55 smithi189 ceph-mon[32756]: pgmap v21364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:55.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38693.047815 secs 2024-04-27T05:14:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:55 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39390.084560 secs 2024-04-27T05:14:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:55 smithi156 ceph-mon[32679]: pgmap v21364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:55.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38693.047815 secs 2024-04-27T05:14:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:55 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39390.084560 secs 2024-04-27T05:14:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:55 smithi092 ceph-mon[29156]: pgmap v21364: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:14:55.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38693.047815 secs 2024-04-27T05:14:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:57 smithi189 ceph-mon[32756]: pgmap v21365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:57.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:57 smithi156 ceph-mon[32679]: pgmap v21365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:57.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:57 smithi092 ceph-mon[29156]: pgmap v21365: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:14:59 smithi189 ceph-mon[32756]: pgmap v21366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:59.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:14:59 smithi156 ceph-mon[32679]: pgmap v21366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:14:59.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:14:59 smithi092 ceph-mon[29156]: pgmap v21366: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:00 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39395.084695 secs 2024-04-27T05:15:00.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38698.047956 secs 2024-04-27T05:15:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:00 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39395.084695 secs 2024-04-27T05:15:00.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38698.047956 secs 2024-04-27T05:15:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:00 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39395.084695 secs 2024-04-27T05:15:00.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38698.047956 secs 2024-04-27T05:15:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:01 smithi189 ceph-mon[32756]: pgmap v21367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:01.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:01 smithi156 ceph-mon[32679]: pgmap v21367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:01.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:01 smithi092 ceph-mon[29156]: pgmap v21367: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:03.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:03 smithi189 ceph-mon[32756]: pgmap v21368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:03.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:03 smithi156 ceph-mon[32679]: pgmap v21368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:03.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:03 smithi092 ceph-mon[29156]: pgmap v21368: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:05 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39400.084808 secs 2024-04-27T05:15:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:05 smithi189 ceph-mon[32756]: pgmap v21369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:05.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38703.048079 secs 2024-04-27T05:15:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:05 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39400.084808 secs 2024-04-27T05:15:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:05 smithi156 ceph-mon[32679]: pgmap v21369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:05.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38703.048079 secs 2024-04-27T05:15:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:05 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39400.084808 secs 2024-04-27T05:15:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:05 smithi092 ceph-mon[29156]: pgmap v21369: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:05.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38703.048079 secs 2024-04-27T05:15:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:07 smithi189 ceph-mon[32756]: pgmap v21370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:07 smithi156 ceph-mon[32679]: pgmap v21370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:07.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:07 smithi092 ceph-mon[29156]: pgmap v21370: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:09.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:09 smithi092 ceph-mon[29156]: pgmap v21371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:09.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:09 smithi156 ceph-mon[32679]: pgmap v21371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:09 smithi189 ceph-mon[32756]: pgmap v21371: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:10 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39405.084900 secs 2024-04-27T05:15:10.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38708.048215 secs 2024-04-27T05:15:10.459 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:10 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39405.084900 secs 2024-04-27T05:15:10.459 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38708.048215 secs 2024-04-27T05:15:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:10 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39405.084900 secs 2024-04-27T05:15:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38708.048215 secs 2024-04-27T05:15:11.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:11 smithi156 ceph-mon[32679]: pgmap v21372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:11.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:11 smithi092 ceph-mon[29156]: pgmap v21372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:11.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:11 smithi189 ceph-mon[32756]: pgmap v21372: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:13.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:13 smithi156 ceph-mon[32679]: pgmap v21373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:13.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:13 smithi092 ceph-mon[29156]: pgmap v21373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:13.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:13 smithi189 ceph-mon[32756]: pgmap v21373: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:15 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39410.085022 secs 2024-04-27T05:15:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:15 smithi156 ceph-mon[32679]: pgmap v21374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38713.048334 secs 2024-04-27T05:15:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:15 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39410.085022 secs 2024-04-27T05:15:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:15 smithi092 ceph-mon[29156]: pgmap v21374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:15.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38713.048334 secs 2024-04-27T05:15:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:15 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39410.085022 secs 2024-04-27T05:15:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:15 smithi189 ceph-mon[32756]: pgmap v21374: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38713.048334 secs 2024-04-27T05:15:17.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:17 smithi156 ceph-mon[32679]: pgmap v21375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:17.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:17 smithi092 ceph-mon[29156]: pgmap v21375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:17.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:17 smithi189 ceph-mon[32756]: pgmap v21375: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:19 smithi156 ceph-mon[32679]: pgmap v21376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:19 smithi092 ceph-mon[29156]: pgmap v21376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:19 smithi189 ceph-mon[32756]: pgmap v21376: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:20 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39415.085095 secs 2024-04-27T05:15:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38718.048443 secs 2024-04-27T05:15:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:20 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39415.085095 secs 2024-04-27T05:15:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38718.048443 secs 2024-04-27T05:15:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:20 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39415.085095 secs 2024-04-27T05:15:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38718.048443 secs 2024-04-27T05:15:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:21 smithi156 ceph-mon[32679]: pgmap v21377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:21.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:21 smithi092 ceph-mon[29156]: pgmap v21377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:21.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:21 smithi189 ceph-mon[32756]: pgmap v21377: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:23.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:23 smithi156 ceph-mon[32679]: pgmap v21378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:23.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:23 smithi092 ceph-mon[29156]: pgmap v21378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:23.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:23 smithi189 ceph-mon[32756]: pgmap v21378: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39420.085203 secs 2024-04-27T05:15:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:25 smithi156 ceph-mon[32679]: pgmap v21379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38723.048567 secs 2024-04-27T05:15:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39420.085203 secs 2024-04-27T05:15:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:25 smithi092 ceph-mon[29156]: pgmap v21379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38723.048567 secs 2024-04-27T05:15:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39420.085203 secs 2024-04-27T05:15:25.653 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:25 smithi189 ceph-mon[32756]: pgmap v21379: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:25.654 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38723.048567 secs 2024-04-27T05:15:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:26 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:15:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:26 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:15:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:26 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:15:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:27 smithi092 ceph-mon[29156]: pgmap v21380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:15:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:15:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:15:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:27 smithi189 ceph-mon[32756]: pgmap v21380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:15:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:15:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:15:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:27 smithi156 ceph-mon[32679]: pgmap v21380: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:15:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:15:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:15:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:28 smithi092 ceph-mon[29156]: pgmap v21381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:15:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:28 smithi092 ceph-mon[29156]: pgmap v21382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:28 smithi189 ceph-mon[32756]: pgmap v21381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:15:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:28 smithi189 ceph-mon[32756]: pgmap v21382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:28 smithi156 ceph-mon[32679]: pgmap v21381: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:15:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:28 smithi156 ceph-mon[32679]: pgmap v21382: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39425.085315 secs 2024-04-27T05:15:29.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39425.085315 secs 2024-04-27T05:15:29.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39425.085315 secs 2024-04-27T05:15:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:30 smithi092 ceph-mon[29156]: pgmap v21383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38728.048657 secs 2024-04-27T05:15:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:30 smithi189 ceph-mon[32756]: pgmap v21383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38728.048657 secs 2024-04-27T05:15:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:30 smithi156 ceph-mon[32679]: pgmap v21383: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38728.048657 secs 2024-04-27T05:15:32.498 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:32 smithi092 ceph-mon[29156]: pgmap v21384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:32 smithi189 ceph-mon[32756]: pgmap v21384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:32.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:32 smithi156 ceph-mon[32679]: pgmap v21384: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:34 smithi092 ceph-mon[29156]: pgmap v21385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:15:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39430.085433 secs 2024-04-27T05:15:34.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:34 smithi189 ceph-mon[32756]: pgmap v21385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:15:34.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39430.085433 secs 2024-04-27T05:15:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:34 smithi156 ceph-mon[32679]: pgmap v21385: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:15:34.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39430.085433 secs 2024-04-27T05:15:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38733.048721 secs 2024-04-27T05:15:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38733.048721 secs 2024-04-27T05:15:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38733.048721 secs 2024-04-27T05:15:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:36 smithi092 ceph-mon[29156]: pgmap v21386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:36 smithi189 ceph-mon[32756]: pgmap v21386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:36 smithi156 ceph-mon[32679]: pgmap v21386: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:15:38.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:38 smithi092 ceph-mon[29156]: pgmap v21387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:15:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:38 smithi189 ceph-mon[32756]: pgmap v21387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:15:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:38 smithi156 ceph-mon[32679]: pgmap v21387: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:15:39.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39435.085551 secs 2024-04-27T05:15:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39435.085551 secs 2024-04-27T05:15:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39435.085551 secs 2024-04-27T05:15:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:40 smithi092 ceph-mon[29156]: pgmap v21388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38738.048828 secs 2024-04-27T05:15:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:40 smithi189 ceph-mon[32756]: pgmap v21388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38738.048828 secs 2024-04-27T05:15:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:40 smithi156 ceph-mon[32679]: pgmap v21388: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38738.048828 secs 2024-04-27T05:15:41.398 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:15:41.397+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:15:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:15:41.397+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:15:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:15:41.397+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:15:41.399 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:15:41.397+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 303 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:15:42.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:42 smithi092 ceph-mon[29156]: pgmap v21389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:42.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:42 smithi189 ceph-mon[32756]: pgmap v21389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:42.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:42 smithi156 ceph-mon[32679]: pgmap v21389: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:44 smithi092 ceph-mon[29156]: pgmap v21390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:44.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39440.085613 secs 2024-04-27T05:15:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:44 smithi189 ceph-mon[32756]: pgmap v21390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:44.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39440.085613 secs 2024-04-27T05:15:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:44 smithi156 ceph-mon[32679]: pgmap v21390: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:44.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39440.085613 secs 2024-04-27T05:15:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:45 smithi092 ceph-mon[29156]: 32 slow requests, 1 included below; oldest blocked for > 38743.048902 secs 2024-04-27T05:15:45.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:45 smithi092 ceph-mon[29156]: slow request 1443.153280 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:15:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:45 smithi189 ceph-mon[32756]: 32 slow requests, 1 included below; oldest blocked for > 38743.048902 secs 2024-04-27T05:15:45.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:45 smithi189 ceph-mon[32756]: slow request 1443.153280 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:15:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:45 smithi156 ceph-mon[32679]: 32 slow requests, 1 included below; oldest blocked for > 38743.048902 secs 2024-04-27T05:15:45.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:45 smithi156 ceph-mon[32679]: slow request 1443.153280 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:15:46.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:46 smithi092 ceph-mon[29156]: pgmap v21391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:46.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:46 smithi189 ceph-mon[32756]: pgmap v21391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:46.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:46 smithi156 ceph-mon[32679]: pgmap v21391: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:48.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:48 smithi092 ceph-mon[29156]: pgmap v21392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:48.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:48 smithi189 ceph-mon[32756]: pgmap v21392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:48.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:48 smithi156 ceph-mon[32679]: pgmap v21392: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:49.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39445.085712 secs 2024-04-27T05:15:49.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39445.085712 secs 2024-04-27T05:15:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39445.085712 secs 2024-04-27T05:15:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:50 smithi189 ceph-mon[32756]: pgmap v21393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:50.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38748.049019 secs 2024-04-27T05:15:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:50 smithi156 ceph-mon[32679]: pgmap v21393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:50.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38748.049019 secs 2024-04-27T05:15:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:50 smithi092 ceph-mon[29156]: pgmap v21393: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38748.049019 secs 2024-04-27T05:15:52.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:52 smithi189 ceph-mon[32756]: pgmap v21394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:52.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:52 smithi156 ceph-mon[32679]: pgmap v21394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:52.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:52 smithi092 ceph-mon[29156]: pgmap v21394: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:54 smithi189 ceph-mon[32756]: pgmap v21395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:54.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39450.085850 secs 2024-04-27T05:15:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:54 smithi156 ceph-mon[32679]: pgmap v21395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:54.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39450.085850 secs 2024-04-27T05:15:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:54 smithi092 ceph-mon[29156]: pgmap v21395: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39450.085850 secs 2024-04-27T05:15:55.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38753.049161 secs 2024-04-27T05:15:55.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38753.049161 secs 2024-04-27T05:15:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38753.049161 secs 2024-04-27T05:15:56.606 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:56 smithi092 ceph-mon[29156]: pgmap v21396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:56.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:56 smithi189 ceph-mon[32756]: pgmap v21396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:56.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:56 smithi156 ceph-mon[32679]: pgmap v21396: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:15:58.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:58 smithi189 ceph-mon[32756]: pgmap v21397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:58.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:58 smithi156 ceph-mon[32679]: pgmap v21397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:58.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:58 smithi092 ceph-mon[29156]: pgmap v21397: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:15:59.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:15:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39455.085967 secs 2024-04-27T05:15:59.586 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:15:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39455.085967 secs 2024-04-27T05:15:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:15:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39455.085967 secs 2024-04-27T05:16:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:00 smithi189 ceph-mon[32756]: pgmap v21398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:00.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38758.049266 secs 2024-04-27T05:16:00.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:00 smithi156 ceph-mon[32679]: pgmap v21398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:00.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38758.049266 secs 2024-04-27T05:16:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:00 smithi092 ceph-mon[29156]: pgmap v21398: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38758.049266 secs 2024-04-27T05:16:02.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:02 smithi189 ceph-mon[32756]: pgmap v21399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:02.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:02 smithi156 ceph-mon[32679]: pgmap v21399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:02.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:02 smithi092 ceph-mon[29156]: pgmap v21399: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:04.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:04 smithi189 ceph-mon[32756]: pgmap v21400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:04.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39460.086086 secs 2024-04-27T05:16:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:04 smithi156 ceph-mon[32679]: pgmap v21400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:04.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39460.086086 secs 2024-04-27T05:16:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:04 smithi092 ceph-mon[29156]: pgmap v21400: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:04.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39460.086086 secs 2024-04-27T05:16:05.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38763.049401 secs 2024-04-27T05:16:05.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38763.049401 secs 2024-04-27T05:16:05.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38763.049401 secs 2024-04-27T05:16:06.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:06 smithi189 ceph-mon[32756]: pgmap v21401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:06.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:06 smithi156 ceph-mon[32679]: pgmap v21401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:06.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:06 smithi092 ceph-mon[29156]: pgmap v21401: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:08.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:08 smithi189 ceph-mon[32756]: pgmap v21402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:08.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:08 smithi156 ceph-mon[32679]: pgmap v21402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:08.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:08 smithi092 ceph-mon[29156]: pgmap v21402: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39465.086204 secs 2024-04-27T05:16:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39465.086204 secs 2024-04-27T05:16:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39465.086204 secs 2024-04-27T05:16:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:10 smithi189 ceph-mon[32756]: pgmap v21403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38768.049490 secs 2024-04-27T05:16:10.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:10 smithi092 ceph-mon[29156]: pgmap v21403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:10.646 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38768.049490 secs 2024-04-27T05:16:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:10 smithi156 ceph-mon[32679]: pgmap v21403: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38768.049490 secs 2024-04-27T05:16:12.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:12 smithi189 ceph-mon[32756]: pgmap v21404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:12.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:12 smithi156 ceph-mon[32679]: pgmap v21404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:12.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:12 smithi092 ceph-mon[29156]: pgmap v21404: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:14 smithi189 ceph-mon[32756]: pgmap v21405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:14.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39470.086325 secs 2024-04-27T05:16:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:14 smithi156 ceph-mon[32679]: pgmap v21405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:14.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39470.086325 secs 2024-04-27T05:16:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:14 smithi092 ceph-mon[29156]: pgmap v21405: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:14.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39470.086325 secs 2024-04-27T05:16:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38773.049621 secs 2024-04-27T05:16:15.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38773.049621 secs 2024-04-27T05:16:15.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38773.049621 secs 2024-04-27T05:16:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:16 smithi189 ceph-mon[32756]: pgmap v21406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:16.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:16 smithi156 ceph-mon[32679]: pgmap v21406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:16.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:16 smithi092 ceph-mon[29156]: pgmap v21406: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:18 smithi189 ceph-mon[32756]: pgmap v21407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:18.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:18 smithi156 ceph-mon[32679]: pgmap v21407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:18.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:18 smithi092 ceph-mon[29156]: pgmap v21407: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39475.086444 secs 2024-04-27T05:16:19.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39475.086444 secs 2024-04-27T05:16:19.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39475.086444 secs 2024-04-27T05:16:20.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:20 smithi189 ceph-mon[32756]: pgmap v21408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:20.642 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38778.049740 secs 2024-04-27T05:16:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:20 smithi156 ceph-mon[32679]: pgmap v21408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:20.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38778.049740 secs 2024-04-27T05:16:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:20 smithi092 ceph-mon[29156]: pgmap v21408: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:20.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38778.049740 secs 2024-04-27T05:16:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:22 smithi189 ceph-mon[32756]: pgmap v21409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:22.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:22 smithi156 ceph-mon[32679]: pgmap v21409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:22.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:22 smithi092 ceph-mon[29156]: pgmap v21409: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:24 smithi189 ceph-mon[32756]: pgmap v21410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:24.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39480.086560 secs 2024-04-27T05:16:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:24 smithi156 ceph-mon[32679]: pgmap v21410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:24.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39480.086560 secs 2024-04-27T05:16:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:24 smithi092 ceph-mon[29156]: pgmap v21410: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39480.086560 secs 2024-04-27T05:16:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38783.049862 secs 2024-04-27T05:16:25.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38783.049862 secs 2024-04-27T05:16:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38783.049862 secs 2024-04-27T05:16:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:26 smithi189 ceph-mon[32756]: pgmap v21411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:26.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:26 smithi156 ceph-mon[32679]: pgmap v21411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:26.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:26 smithi092 ceph-mon[29156]: pgmap v21411: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:27.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:16:27.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:16:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:16:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: pgmap v21412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:16:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:16:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: pgmap v21413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:16:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: pgmap v21414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:16:28.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:16:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: pgmap v21412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:16:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:16:28.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: pgmap v21413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:16:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: pgmap v21414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:16:28.686 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: pgmap v21412: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: pgmap v21413: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: pgmap v21414: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:16:28.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:16:29.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39485.086684 secs 2024-04-27T05:16:29.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39485.086684 secs 2024-04-27T05:16:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39485.086684 secs 2024-04-27T05:16:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38788.049973 secs 2024-04-27T05:16:30.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:30 smithi156 ceph-mon[32679]: pgmap v21415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38788.049973 secs 2024-04-27T05:16:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:30 smithi092 ceph-mon[29156]: pgmap v21415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38788.049973 secs 2024-04-27T05:16:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:30 smithi189 ceph-mon[32756]: pgmap v21415: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:32 smithi156 ceph-mon[32679]: pgmap v21416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:32 smithi092 ceph-mon[29156]: pgmap v21416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:32 smithi189 ceph-mon[32756]: pgmap v21416: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:34 smithi156 ceph-mon[32679]: pgmap v21417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39490.086804 secs 2024-04-27T05:16:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:34 smithi092 ceph-mon[29156]: pgmap v21417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39490.086804 secs 2024-04-27T05:16:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:34 smithi189 ceph-mon[32756]: pgmap v21417: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39490.086804 secs 2024-04-27T05:16:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38793.050090 secs 2024-04-27T05:16:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38793.050090 secs 2024-04-27T05:16:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38793.050090 secs 2024-04-27T05:16:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:36 smithi156 ceph-mon[32679]: pgmap v21418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:36 smithi092 ceph-mon[29156]: pgmap v21418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:36 smithi189 ceph-mon[32756]: pgmap v21418: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:16:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:38 smithi156 ceph-mon[32679]: pgmap v21419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:16:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:38 smithi092 ceph-mon[29156]: pgmap v21419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:16:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:38 smithi189 ceph-mon[32756]: pgmap v21419: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:16:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39495.086871 secs 2024-04-27T05:16:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39495.086871 secs 2024-04-27T05:16:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39495.086871 secs 2024-04-27T05:16:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38798.050213 secs 2024-04-27T05:16:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:40 smithi156 ceph-mon[32679]: pgmap v21420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38798.050213 secs 2024-04-27T05:16:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:40 smithi092 ceph-mon[29156]: pgmap v21420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38798.050213 secs 2024-04-27T05:16:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:40 smithi189 ceph-mon[32756]: pgmap v21420: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:42 smithi092 ceph-mon[29156]: pgmap v21421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:42 smithi189 ceph-mon[32756]: pgmap v21421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:42 smithi156 ceph-mon[32679]: pgmap v21421: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:44 smithi092 ceph-mon[29156]: pgmap v21422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39500.086978 secs 2024-04-27T05:16:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:44 smithi189 ceph-mon[32756]: pgmap v21422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39500.086978 secs 2024-04-27T05:16:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:44 smithi156 ceph-mon[32679]: pgmap v21422: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39500.086978 secs 2024-04-27T05:16:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:45 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38803.050274 secs 2024-04-27T05:16:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:45 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38803.050274 secs 2024-04-27T05:16:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:45 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38803.050274 secs 2024-04-27T05:16:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:46 smithi092 ceph-mon[29156]: pgmap v21423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:46 smithi189 ceph-mon[32756]: pgmap v21423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:46 smithi156 ceph-mon[32679]: pgmap v21423: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:48 smithi092 ceph-mon[29156]: pgmap v21424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:48 smithi189 ceph-mon[32756]: pgmap v21424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:48 smithi156 ceph-mon[32679]: pgmap v21424: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39505.087076 secs 2024-04-27T05:16:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39505.087076 secs 2024-04-27T05:16:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39505.087076 secs 2024-04-27T05:16:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38808.050384 secs 2024-04-27T05:16:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:50 smithi092 ceph-mon[29156]: pgmap v21425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38808.050384 secs 2024-04-27T05:16:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:50 smithi189 ceph-mon[32756]: pgmap v21425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38808.050384 secs 2024-04-27T05:16:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:50 smithi156 ceph-mon[32679]: pgmap v21425: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:52 smithi092 ceph-mon[29156]: pgmap v21426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:52 smithi189 ceph-mon[32756]: pgmap v21426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:52 smithi156 ceph-mon[32679]: pgmap v21426: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:54 smithi092 ceph-mon[29156]: pgmap v21427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39510.087167 secs 2024-04-27T05:16:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:54 smithi189 ceph-mon[32756]: pgmap v21427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39510.087167 secs 2024-04-27T05:16:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:54 smithi156 ceph-mon[32679]: pgmap v21427: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:16:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39510.087167 secs 2024-04-27T05:16:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38813.050512 secs 2024-04-27T05:16:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38813.050512 secs 2024-04-27T05:16:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38813.050512 secs 2024-04-27T05:16:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:56 smithi092 ceph-mon[29156]: pgmap v21428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:56 smithi189 ceph-mon[32756]: pgmap v21428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:56 smithi156 ceph-mon[32679]: pgmap v21428: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:58 smithi092 ceph-mon[29156]: pgmap v21429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:58 smithi189 ceph-mon[32756]: pgmap v21429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:58 smithi156 ceph-mon[32679]: pgmap v21429: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:16:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:16:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39515.087237 secs 2024-04-27T05:17:00.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:16:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39515.087237 secs 2024-04-27T05:17:00.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:16:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39515.087237 secs 2024-04-27T05:17:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38818.050625 secs 2024-04-27T05:17:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:00 smithi092 ceph-mon[29156]: pgmap v21430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38818.050625 secs 2024-04-27T05:17:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:00 smithi189 ceph-mon[32756]: pgmap v21430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38818.050625 secs 2024-04-27T05:17:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:00 smithi156 ceph-mon[32679]: pgmap v21430: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:02 smithi092 ceph-mon[29156]: pgmap v21431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:02 smithi189 ceph-mon[32756]: pgmap v21431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:02 smithi156 ceph-mon[32679]: pgmap v21431: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:04 smithi092 ceph-mon[29156]: pgmap v21432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39520.087389 secs 2024-04-27T05:17:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:04 smithi189 ceph-mon[32756]: pgmap v21432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39520.087389 secs 2024-04-27T05:17:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:04 smithi156 ceph-mon[32679]: pgmap v21432: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39520.087389 secs 2024-04-27T05:17:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38823.050762 secs 2024-04-27T05:17:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38823.050762 secs 2024-04-27T05:17:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38823.050762 secs 2024-04-27T05:17:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:06 smithi092 ceph-mon[29156]: pgmap v21433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:06 smithi189 ceph-mon[32756]: pgmap v21433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:06 smithi156 ceph-mon[32679]: pgmap v21433: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:08 smithi189 ceph-mon[32756]: pgmap v21434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:08 smithi156 ceph-mon[32679]: pgmap v21434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:09.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:08 smithi092 ceph-mon[29156]: pgmap v21434: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39525.087533 secs 2024-04-27T05:17:10.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39525.087533 secs 2024-04-27T05:17:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39525.087533 secs 2024-04-27T05:17:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38828.050833 secs 2024-04-27T05:17:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:10 smithi189 ceph-mon[32756]: pgmap v21435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38828.050833 secs 2024-04-27T05:17:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:10 smithi156 ceph-mon[32679]: pgmap v21435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38828.050833 secs 2024-04-27T05:17:11.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:10 smithi092 ceph-mon[29156]: pgmap v21435: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:12 smithi189 ceph-mon[32756]: pgmap v21436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:12 smithi156 ceph-mon[32679]: pgmap v21436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:13.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:12 smithi092 ceph-mon[29156]: pgmap v21436: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:14 smithi189 ceph-mon[32756]: pgmap v21437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39530.087676 secs 2024-04-27T05:17:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:14 smithi156 ceph-mon[32679]: pgmap v21437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39530.087676 secs 2024-04-27T05:17:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:14 smithi092 ceph-mon[29156]: pgmap v21437: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39530.087676 secs 2024-04-27T05:17:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:15 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38833.050964 secs 2024-04-27T05:17:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:15 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38833.050964 secs 2024-04-27T05:17:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:15 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38833.050964 secs 2024-04-27T05:17:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:16 smithi189 ceph-mon[32756]: pgmap v21438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:16 smithi156 ceph-mon[32679]: pgmap v21438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:16 smithi092 ceph-mon[29156]: pgmap v21438: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:18 smithi189 ceph-mon[32756]: pgmap v21439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:18 smithi156 ceph-mon[32679]: pgmap v21439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:18 smithi092 ceph-mon[29156]: pgmap v21439: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39535.087801 secs 2024-04-27T05:17:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39535.087801 secs 2024-04-27T05:17:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39535.087801 secs 2024-04-27T05:17:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:20 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38838.051035 secs 2024-04-27T05:17:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:20 smithi189 ceph-mon[32756]: pgmap v21440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:20 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38838.051035 secs 2024-04-27T05:17:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:20 smithi156 ceph-mon[32679]: pgmap v21440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:20 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38838.051035 secs 2024-04-27T05:17:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:20 smithi092 ceph-mon[29156]: pgmap v21440: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:22 smithi189 ceph-mon[32756]: pgmap v21441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:22 smithi156 ceph-mon[32679]: pgmap v21441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:22 smithi092 ceph-mon[29156]: pgmap v21441: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:24 smithi189 ceph-mon[32756]: pgmap v21442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39540.087877 secs 2024-04-27T05:17:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:24 smithi156 ceph-mon[32679]: pgmap v21442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39540.087877 secs 2024-04-27T05:17:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:24 smithi092 ceph-mon[29156]: pgmap v21442: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39540.087877 secs 2024-04-27T05:17:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:25 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38843.051155 secs 2024-04-27T05:17:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:25 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38843.051155 secs 2024-04-27T05:17:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:25 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38843.051155 secs 2024-04-27T05:17:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:26 smithi189 ceph-mon[32756]: pgmap v21443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:26 smithi156 ceph-mon[32679]: pgmap v21443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:26 smithi092 ceph-mon[29156]: pgmap v21443: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:27 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:17:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:27 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:17:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:27 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:17:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:28 smithi189 ceph-mon[32756]: pgmap v21444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:17:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:17:29.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:17:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:28 smithi156 ceph-mon[32679]: pgmap v21444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:17:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:17:29.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:17:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:28 smithi092 ceph-mon[29156]: pgmap v21444: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:17:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:17:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:17:30.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:29 smithi156 ceph-mon[32679]: pgmap v21445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:17:30.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:29 smithi156 ceph-mon[32679]: pgmap v21446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:30.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39545.088008 secs 2024-04-27T05:17:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:29 smithi189 ceph-mon[32756]: pgmap v21445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:17:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:29 smithi189 ceph-mon[32756]: pgmap v21446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39545.088008 secs 2024-04-27T05:17:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:29 smithi092 ceph-mon[29156]: pgmap v21445: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:17:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:29 smithi092 ceph-mon[29156]: pgmap v21446: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39545.088008 secs 2024-04-27T05:17:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:30 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38848.051288 secs 2024-04-27T05:17:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:30 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38848.051288 secs 2024-04-27T05:17:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:30 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38848.051288 secs 2024-04-27T05:17:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:31 smithi189 ceph-mon[32756]: pgmap v21447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:31 smithi156 ceph-mon[32679]: pgmap v21447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:31 smithi092 ceph-mon[29156]: pgmap v21447: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:33 smithi189 ceph-mon[32756]: pgmap v21448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:33 smithi156 ceph-mon[32679]: pgmap v21448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:33 smithi092 ceph-mon[29156]: pgmap v21448: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:17:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39550.088129 secs 2024-04-27T05:17:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39550.088129 secs 2024-04-27T05:17:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39550.088129 secs 2024-04-27T05:17:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:35 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38853.051417 secs 2024-04-27T05:17:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:35 smithi189 ceph-mon[32756]: pgmap v21449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:35 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38853.051417 secs 2024-04-27T05:17:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:35 smithi156 ceph-mon[32679]: pgmap v21449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:35 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38853.051417 secs 2024-04-27T05:17:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:35 smithi092 ceph-mon[29156]: pgmap v21449: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:37 smithi189 ceph-mon[32756]: pgmap v21450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:37 smithi156 ceph-mon[32679]: pgmap v21450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:37 smithi092 ceph-mon[29156]: pgmap v21450: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:17:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:38 smithi189 ceph-mon[32756]: pgmap v21451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:17:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:38 smithi156 ceph-mon[32679]: pgmap v21451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:17:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:38 smithi092 ceph-mon[29156]: pgmap v21451: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:17:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39555.088259 secs 2024-04-27T05:17:40.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39555.088259 secs 2024-04-27T05:17:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39555.088259 secs 2024-04-27T05:17:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:40 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38858.051534 secs 2024-04-27T05:17:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:40 smithi156 ceph-mon[32679]: pgmap v21452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:40 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38858.051534 secs 2024-04-27T05:17:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:40 smithi092 ceph-mon[29156]: pgmap v21452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:40 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38858.051534 secs 2024-04-27T05:17:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:40 smithi189 ceph-mon[32756]: pgmap v21452: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:43.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:43 smithi092 ceph-mon[29156]: pgmap v21453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:43 smithi189 ceph-mon[32756]: pgmap v21453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:43 smithi156 ceph-mon[32679]: pgmap v21453: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:44.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39560.088379 secs 2024-04-27T05:17:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39560.088379 secs 2024-04-27T05:17:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39560.088379 secs 2024-04-27T05:17:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:45 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38863.051662 secs 2024-04-27T05:17:45.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:45 smithi092 ceph-mon[29156]: pgmap v21454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:45 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38863.051662 secs 2024-04-27T05:17:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:45 smithi189 ceph-mon[32756]: pgmap v21454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:45 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38863.051662 secs 2024-04-27T05:17:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:45 smithi156 ceph-mon[32679]: pgmap v21454: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:47.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:47 smithi092 ceph-mon[29156]: pgmap v21455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:47.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:47 smithi189 ceph-mon[32756]: pgmap v21455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:47.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:47 smithi156 ceph-mon[32679]: pgmap v21455: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:49 smithi092 ceph-mon[29156]: pgmap v21456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:49.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39565.088504 secs 2024-04-27T05:17:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:49 smithi189 ceph-mon[32756]: pgmap v21456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39565.088504 secs 2024-04-27T05:17:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:49 smithi156 ceph-mon[32679]: pgmap v21456: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39565.088504 secs 2024-04-27T05:17:50.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:50 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38868.051791 secs 2024-04-27T05:17:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:50 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38868.051791 secs 2024-04-27T05:17:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:50 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38868.051791 secs 2024-04-27T05:17:51.746 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:51 smithi092 ceph-mon[29156]: pgmap v21457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:51.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:51 smithi189 ceph-mon[32756]: pgmap v21457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:51.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:51 smithi156 ceph-mon[32679]: pgmap v21457: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:53.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:53 smithi092 ceph-mon[29156]: pgmap v21458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:53.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:53 smithi189 ceph-mon[32756]: pgmap v21458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:53.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:53 smithi156 ceph-mon[32679]: pgmap v21458: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:54.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39570.088654 secs 2024-04-27T05:17:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39570.088654 secs 2024-04-27T05:17:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39570.088654 secs 2024-04-27T05:17:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:55 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38873.051935 secs 2024-04-27T05:17:55.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:55 smithi092 ceph-mon[29156]: pgmap v21459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:55 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38873.051935 secs 2024-04-27T05:17:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:55 smithi189 ceph-mon[32756]: pgmap v21459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:55 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38873.051935 secs 2024-04-27T05:17:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:55 smithi156 ceph-mon[32679]: pgmap v21459: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:17:57.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:57 smithi092 ceph-mon[29156]: pgmap v21460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:57.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:57 smithi189 ceph-mon[32756]: pgmap v21460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:57.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:57 smithi156 ceph-mon[32679]: pgmap v21460: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:59 smithi092 ceph-mon[29156]: pgmap v21461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:59.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:17:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39575.088750 secs 2024-04-27T05:17:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:59 smithi189 ceph-mon[32756]: pgmap v21461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:17:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39575.088750 secs 2024-04-27T05:17:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:59 smithi156 ceph-mon[32679]: pgmap v21461: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:17:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:17:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39575.088750 secs 2024-04-27T05:18:00.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:00 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38878.051995 secs 2024-04-27T05:18:00.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:00 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38878.051995 secs 2024-04-27T05:18:00.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:00 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38878.051995 secs 2024-04-27T05:18:01.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:01 smithi092 ceph-mon[29156]: pgmap v21462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:01.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:01 smithi189 ceph-mon[32756]: pgmap v21462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:01.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:01 smithi156 ceph-mon[32679]: pgmap v21462: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:03.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:03 smithi092 ceph-mon[29156]: pgmap v21463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:03.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:03 smithi189 ceph-mon[32756]: pgmap v21463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:03.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:03 smithi156 ceph-mon[32679]: pgmap v21463: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39580.088871 secs 2024-04-27T05:18:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39580.088871 secs 2024-04-27T05:18:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39580.088871 secs 2024-04-27T05:18:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:05 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38883.052089 secs 2024-04-27T05:18:05.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:05 smithi189 ceph-mon[32756]: pgmap v21464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:05 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38883.052089 secs 2024-04-27T05:18:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:05 smithi156 ceph-mon[32679]: pgmap v21464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:05 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38883.052089 secs 2024-04-27T05:18:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:05 smithi092 ceph-mon[29156]: pgmap v21464: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:07.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:07 smithi189 ceph-mon[32756]: pgmap v21465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:07.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:07 smithi156 ceph-mon[32679]: pgmap v21465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:07 smithi092 ceph-mon[29156]: pgmap v21465: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:09 smithi189 ceph-mon[32756]: pgmap v21466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39585.088954 secs 2024-04-27T05:18:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:09 smithi156 ceph-mon[32679]: pgmap v21466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39585.088954 secs 2024-04-27T05:18:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:09 smithi092 ceph-mon[29156]: pgmap v21466: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39585.088954 secs 2024-04-27T05:18:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:10 smithi189 ceph-mon[32756]: 32 slow requests, 0 included below; oldest blocked for > 38888.052221 secs 2024-04-27T05:18:10.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:10 smithi092 ceph-mon[29156]: 32 slow requests, 0 included below; oldest blocked for > 38888.052221 secs 2024-04-27T05:18:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:10 smithi156 ceph-mon[32679]: 32 slow requests, 0 included below; oldest blocked for > 38888.052221 secs 2024-04-27T05:18:11.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-mon[29156]: pgmap v21467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:11.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:18:11.415+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:18:11.745 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:18:11.415+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:18:11.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:18:11.415+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:18:11.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:18:11.415+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:18:11.746 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:18:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:18:11.415+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:18:11.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:11 smithi189 ceph-mon[32756]: pgmap v21467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:11.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:11 smithi156 ceph-mon[32679]: pgmap v21467: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:13.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:13 smithi189 ceph-mon[32756]: pgmap v21468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:13.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:13 smithi156 ceph-mon[32679]: pgmap v21468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:13.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:13 smithi092 ceph-mon[29156]: pgmap v21468: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39590.089104 secs 2024-04-27T05:18:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39590.089104 secs 2024-04-27T05:18:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39590.089104 secs 2024-04-27T05:18:15.870 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:15 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38893.052316 secs 2024-04-27T05:18:15.870 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:15 smithi092 ceph-mon[29156]: pgmap v21469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:15 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38893.052316 secs 2024-04-27T05:18:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:15 smithi189 ceph-mon[32756]: pgmap v21469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:15 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38893.052316 secs 2024-04-27T05:18:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:15 smithi156 ceph-mon[32679]: pgmap v21469: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:17.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:17 smithi189 ceph-mon[32756]: pgmap v21470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:17.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:17 smithi156 ceph-mon[32679]: pgmap v21470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:17.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:17 smithi092 ceph-mon[29156]: pgmap v21470: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:18:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:18:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:18:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:18:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:18:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:18:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:19 smithi189 ceph-mon[32756]: pgmap v21471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39595.089208 secs 2024-04-27T05:18:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:19 smithi156 ceph-mon[32679]: pgmap v21471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39595.089208 secs 2024-04-27T05:18:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:19 smithi092 ceph-mon[29156]: pgmap v21471: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39595.089208 secs 2024-04-27T05:18:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:20 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38898.052426 secs 2024-04-27T05:18:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:20 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38898.052426 secs 2024-04-27T05:18:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:20 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38898.052426 secs 2024-04-27T05:18:21.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:21 smithi189 ceph-mon[32756]: pgmap v21472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:21.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:21 smithi156 ceph-mon[32679]: pgmap v21472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:21 smithi092 ceph-mon[29156]: pgmap v21472: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:23.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:23 smithi189 ceph-mon[32756]: pgmap v21473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:23.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:23 smithi156 ceph-mon[32679]: pgmap v21473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:23.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:23 smithi092 ceph-mon[29156]: pgmap v21473: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:18:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39600.089306 secs 2024-04-27T05:18:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39600.089306 secs 2024-04-27T05:18:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39600.089306 secs 2024-04-27T05:18:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:25 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38903.052536 secs 2024-04-27T05:18:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:25 smithi189 ceph-mon[32756]: pgmap v21474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:25 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38903.052536 secs 2024-04-27T05:18:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:25 smithi156 ceph-mon[32679]: pgmap v21474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:25 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38903.052536 secs 2024-04-27T05:18:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:25 smithi092 ceph-mon[29156]: pgmap v21474: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:18:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:27 smithi189 ceph-mon[32756]: pgmap v21475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:27 smithi156 ceph-mon[32679]: pgmap v21475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:27.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:27 smithi092 ceph-mon[29156]: pgmap v21475: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:28 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:18:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:28 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:18:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:28 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:18:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:29 smithi189 ceph-mon[32756]: pgmap v21476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39605.089375 secs 2024-04-27T05:18:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:18:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:18:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:18:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:29 smithi156 ceph-mon[32679]: pgmap v21476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39605.089375 secs 2024-04-27T05:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:18:29.941 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:18:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:29 smithi092 ceph-mon[29156]: pgmap v21476: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39605.089375 secs 2024-04-27T05:18:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:18:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:18:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:18:30.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:30 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38908.052619 secs 2024-04-27T05:18:30.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:30 smithi156 ceph-mon[32679]: pgmap v21477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:18:30.837 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:30 smithi156 ceph-mon[32679]: pgmap v21478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:30 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38908.052619 secs 2024-04-27T05:18:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:30 smithi189 ceph-mon[32756]: pgmap v21477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:18:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:30 smithi189 ceph-mon[32756]: pgmap v21478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:30 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38908.052619 secs 2024-04-27T05:18:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:30 smithi092 ceph-mon[29156]: pgmap v21477: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:18:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:30 smithi092 ceph-mon[29156]: pgmap v21478: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:32 smithi189 ceph-mon[32756]: pgmap v21479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:32 smithi156 ceph-mon[32679]: pgmap v21479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:32 smithi092 ceph-mon[29156]: pgmap v21479: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:34 smithi189 ceph-mon[32756]: pgmap v21480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:18:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39610.089493 secs 2024-04-27T05:18:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:34 smithi156 ceph-mon[32679]: pgmap v21480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:18:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39610.089493 secs 2024-04-27T05:18:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:34 smithi092 ceph-mon[29156]: pgmap v21480: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:18:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39610.089493 secs 2024-04-27T05:18:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:35 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38913.052757 secs 2024-04-27T05:18:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:35 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38913.052757 secs 2024-04-27T05:18:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:35 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38913.052757 secs 2024-04-27T05:18:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000035) for more than 900000000 us, fault. 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8049510 tx=0x7f1ca809f070 comp rx=0 tx=0).stop 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 msgr2=0x7f1c9c0b25a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.053+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:18:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.054+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca8089000 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T05:18:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.103+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T05:18:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.103+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T05:18:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T05:18:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=42 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T05:18:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:18:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.104+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T05:18:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:36.104+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T05:18:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:36 smithi189 ceph-mon[32756]: pgmap v21481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:36 smithi156 ceph-mon[32679]: pgmap v21481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:36 smithi092 ceph-mon[29156]: pgmap v21481: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:38 smithi189 ceph-mon[32756]: pgmap v21482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:38 smithi156 ceph-mon[32679]: pgmap v21482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:38 smithi092 ceph-mon[29156]: pgmap v21482: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:18:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39615.089617 secs 2024-04-27T05:18:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39615.089617 secs 2024-04-27T05:18:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39615.089617 secs 2024-04-27T05:18:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:40 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38918.052895 secs 2024-04-27T05:18:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:40 smithi189 ceph-mon[32756]: pgmap v21483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:18:40.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:40 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38918.052895 secs 2024-04-27T05:18:40.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:40 smithi092 ceph-mon[29156]: pgmap v21483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:18:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:40 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38918.052895 secs 2024-04-27T05:18:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:40 smithi156 ceph-mon[32679]: pgmap v21483: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:18:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:18:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 612+0+0 (secure 0 0 0) 0x7f1c8c006510 con 0x5617fb906f00 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 304 ==== auth_reply(proto 2 0 (0) Success) ==== 783+0+0 (secure 0 0 0) 0x7f1c88006550 con 0x7f1cb4108940 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.420+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.421+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:18:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:18:41.421+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 305 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:18:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:42 smithi189 ceph-mon[32756]: pgmap v21484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:42 smithi156 ceph-mon[32679]: pgmap v21484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:42 smithi092 ceph-mon[29156]: pgmap v21484: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:44 smithi189 ceph-mon[32756]: pgmap v21485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39620.089744 secs 2024-04-27T05:18:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:44 smithi156 ceph-mon[32679]: pgmap v21485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39620.089744 secs 2024-04-27T05:18:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:44 smithi092 ceph-mon[29156]: pgmap v21485: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39620.089744 secs 2024-04-27T05:18:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:45 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38923.053052 secs 2024-04-27T05:18:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:45 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38923.053052 secs 2024-04-27T05:18:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:45 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38923.053052 secs 2024-04-27T05:18:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:46 smithi189 ceph-mon[32756]: pgmap v21486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:46 smithi156 ceph-mon[32679]: pgmap v21486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:46 smithi092 ceph-mon[29156]: pgmap v21486: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:48 smithi189 ceph-mon[32756]: pgmap v21487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:48 smithi156 ceph-mon[32679]: pgmap v21487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:48 smithi092 ceph-mon[29156]: pgmap v21487: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39625.089863 secs 2024-04-27T05:18:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39625.089863 secs 2024-04-27T05:18:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39625.089863 secs 2024-04-27T05:18:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:50 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38928.053182 secs 2024-04-27T05:18:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:50 smithi189 ceph-mon[32756]: pgmap v21488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:50 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38928.053182 secs 2024-04-27T05:18:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:50 smithi156 ceph-mon[32679]: pgmap v21488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:50 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38928.053182 secs 2024-04-27T05:18:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:50 smithi092 ceph-mon[29156]: pgmap v21488: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:52 smithi189 ceph-mon[32756]: pgmap v21489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:52 smithi156 ceph-mon[32679]: pgmap v21489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:52 smithi092 ceph-mon[29156]: pgmap v21489: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:54 smithi189 ceph-mon[32756]: pgmap v21490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39630.089971 secs 2024-04-27T05:18:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:54 smithi156 ceph-mon[32679]: pgmap v21490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39630.089971 secs 2024-04-27T05:18:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:54 smithi092 ceph-mon[29156]: pgmap v21490: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39630.089971 secs 2024-04-27T05:18:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:55 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38933.053283 secs 2024-04-27T05:18:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:55 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38933.053283 secs 2024-04-27T05:18:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:55 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38933.053283 secs 2024-04-27T05:18:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:56 smithi156 ceph-mon[32679]: pgmap v21491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:56 smithi092 ceph-mon[29156]: pgmap v21491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:56 smithi189 ceph-mon[32756]: pgmap v21491: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:18:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:58 smithi156 ceph-mon[32679]: pgmap v21492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:58 smithi092 ceph-mon[29156]: pgmap v21492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:58 smithi189 ceph-mon[32756]: pgmap v21492: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:18:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:18:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39635.090098 secs 2024-04-27T05:18:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:18:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39635.090098 secs 2024-04-27T05:19:00.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:18:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39635.090098 secs 2024-04-27T05:19:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:00 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38938.053401 secs 2024-04-27T05:19:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:00 smithi156 ceph-mon[32679]: pgmap v21493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:00 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38938.053401 secs 2024-04-27T05:19:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:00 smithi092 ceph-mon[29156]: pgmap v21493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:00 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38938.053401 secs 2024-04-27T05:19:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:00 smithi189 ceph-mon[32756]: pgmap v21493: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:02 smithi156 ceph-mon[32679]: pgmap v21494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:02.974 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:02 smithi092 ceph-mon[29156]: pgmap v21494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:02 smithi189 ceph-mon[32756]: pgmap v21494: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:04 smithi156 ceph-mon[32679]: pgmap v21495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39640.090203 secs 2024-04-27T05:19:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:04 smithi092 ceph-mon[29156]: pgmap v21495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39640.090203 secs 2024-04-27T05:19:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:04 smithi189 ceph-mon[32756]: pgmap v21495: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39640.090203 secs 2024-04-27T05:19:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:05 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38943.053518 secs 2024-04-27T05:19:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:05 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38943.053518 secs 2024-04-27T05:19:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:05 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38943.053518 secs 2024-04-27T05:19:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:06 smithi156 ceph-mon[32679]: pgmap v21496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:06 smithi092 ceph-mon[29156]: pgmap v21496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:06 smithi189 ceph-mon[32756]: pgmap v21496: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:08 smithi156 ceph-mon[32679]: pgmap v21497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:08 smithi092 ceph-mon[29156]: pgmap v21497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:08 smithi189 ceph-mon[32756]: pgmap v21497: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39645.090294 secs 2024-04-27T05:19:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39645.090294 secs 2024-04-27T05:19:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39645.090294 secs 2024-04-27T05:19:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:10 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38948.053576 secs 2024-04-27T05:19:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:10 smithi156 ceph-mon[32679]: pgmap v21498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:10 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38948.053576 secs 2024-04-27T05:19:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:10 smithi092 ceph-mon[29156]: pgmap v21498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:10 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38948.053576 secs 2024-04-27T05:19:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:10 smithi189 ceph-mon[32756]: pgmap v21498: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:12 smithi156 ceph-mon[32679]: pgmap v21499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:12 smithi092 ceph-mon[29156]: pgmap v21499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:12 smithi189 ceph-mon[32756]: pgmap v21499: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:14 smithi092 ceph-mon[29156]: pgmap v21500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39650.090443 secs 2024-04-27T05:19:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:14 smithi189 ceph-mon[32756]: pgmap v21500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39650.090443 secs 2024-04-27T05:19:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:14 smithi156 ceph-mon[32679]: pgmap v21500: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39650.090443 secs 2024-04-27T05:19:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:15 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38953.053702 secs 2024-04-27T05:19:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:15 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38953.053702 secs 2024-04-27T05:19:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:15 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38953.053702 secs 2024-04-27T05:19:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:16 smithi092 ceph-mon[29156]: pgmap v21501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:16 smithi189 ceph-mon[32756]: pgmap v21501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:16 smithi156 ceph-mon[32679]: pgmap v21501: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:18 smithi092 ceph-mon[29156]: pgmap v21502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:18 smithi189 ceph-mon[32756]: pgmap v21502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:18 smithi156 ceph-mon[32679]: pgmap v21502: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39655.090582 secs 2024-04-27T05:19:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39655.090582 secs 2024-04-27T05:19:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39655.090582 secs 2024-04-27T05:19:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:20 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38958.053824 secs 2024-04-27T05:19:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:20 smithi092 ceph-mon[29156]: pgmap v21503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:20 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38958.053824 secs 2024-04-27T05:19:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:20 smithi189 ceph-mon[32756]: pgmap v21503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:20 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38958.053824 secs 2024-04-27T05:19:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:20 smithi156 ceph-mon[32679]: pgmap v21503: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:22 smithi092 ceph-mon[29156]: pgmap v21504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:22 smithi189 ceph-mon[32756]: pgmap v21504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:22 smithi156 ceph-mon[32679]: pgmap v21504: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:24 smithi092 ceph-mon[29156]: pgmap v21505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39660.090729 secs 2024-04-27T05:19:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:24 smithi189 ceph-mon[32756]: pgmap v21505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39660.090729 secs 2024-04-27T05:19:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:24 smithi156 ceph-mon[32679]: pgmap v21505: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39660.090729 secs 2024-04-27T05:19:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:25 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38963.053946 secs 2024-04-27T05:19:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:25 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38963.053946 secs 2024-04-27T05:19:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:25 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38963.053946 secs 2024-04-27T05:19:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:26 smithi092 ceph-mon[29156]: pgmap v21506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:26 smithi189 ceph-mon[32756]: pgmap v21506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:26 smithi156 ceph-mon[32679]: pgmap v21506: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:28 smithi092 ceph-mon[29156]: pgmap v21507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:28 smithi189 ceph-mon[32756]: pgmap v21507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:28 smithi156 ceph-mon[32679]: pgmap v21507: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39665.090867 secs 2024-04-27T05:19:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:29 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:19:30.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39665.090867 secs 2024-04-27T05:19:30.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:29 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:19:30.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39665.090867 secs 2024-04-27T05:19:30.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:29 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:19:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:30 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38968.054064 secs 2024-04-27T05:19:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:30 smithi092 ceph-mon[29156]: pgmap v21508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:19:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:19:30.996 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:30 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:19:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:30 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38968.054064 secs 2024-04-27T05:19:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:30 smithi189 ceph-mon[32756]: pgmap v21508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:19:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:19:31.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:30 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:19:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:30 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38968.054064 secs 2024-04-27T05:19:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:30 smithi156 ceph-mon[32679]: pgmap v21508: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:19:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:19:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:30 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:19:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:31 smithi092 ceph-mon[29156]: pgmap v21509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:19:31.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:31 smithi092 ceph-mon[29156]: pgmap v21510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:31 smithi189 ceph-mon[32756]: pgmap v21509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:19:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:31 smithi189 ceph-mon[32756]: pgmap v21510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:31 smithi156 ceph-mon[32679]: pgmap v21509: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:19:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:31 smithi156 ceph-mon[32679]: pgmap v21510: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:33 smithi092 ceph-mon[29156]: pgmap v21511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:33 smithi189 ceph-mon[32756]: pgmap v21511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:33 smithi156 ceph-mon[32679]: pgmap v21511: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39670.090980 secs 2024-04-27T05:19:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39670.090980 secs 2024-04-27T05:19:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39670.090980 secs 2024-04-27T05:19:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:35 smithi189 ceph-mon[32756]: pgmap v21512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:35 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38973.054198 secs 2024-04-27T05:19:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:35 smithi156 ceph-mon[32679]: pgmap v21512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:35 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38973.054198 secs 2024-04-27T05:19:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:35 smithi092 ceph-mon[29156]: pgmap v21512: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:35 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38973.054198 secs 2024-04-27T05:19:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:37 smithi189 ceph-mon[32756]: pgmap v21513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:37 smithi156 ceph-mon[32679]: pgmap v21513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:37 smithi092 ceph-mon[29156]: pgmap v21513: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:19:40.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:39 smithi092 ceph-mon[29156]: pgmap v21514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:19:40.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39675.091081 secs 2024-04-27T05:19:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:39 smithi189 ceph-mon[32756]: pgmap v21514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:19:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39675.091081 secs 2024-04-27T05:19:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:39 smithi156 ceph-mon[32679]: pgmap v21514: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:19:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39675.091081 secs 2024-04-27T05:19:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:40 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38978.054320 secs 2024-04-27T05:19:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:40 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38978.054320 secs 2024-04-27T05:19:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:40 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38978.054320 secs 2024-04-27T05:19:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:41 smithi189 ceph-mon[32756]: pgmap v21515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:19:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:41 smithi156 ceph-mon[32679]: pgmap v21515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:19:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:41 smithi092 ceph-mon[29156]: pgmap v21515: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:19:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:43 smithi189 ceph-mon[32756]: pgmap v21516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:43 smithi156 ceph-mon[32679]: pgmap v21516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:43 smithi092 ceph-mon[29156]: pgmap v21516: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39680.091210 secs 2024-04-27T05:19:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39680.091210 secs 2024-04-27T05:19:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39680.091210 secs 2024-04-27T05:19:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:45 smithi189 ceph-mon[32756]: pgmap v21517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:45 smithi189 ceph-mon[32756]: 2 slow requests, 1 included below; oldest blocked for > 38983.054409 secs 2024-04-27T05:19:46.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:45 smithi189 ceph-mon[32756]: slow request 722.936076 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:19:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:45 smithi156 ceph-mon[32679]: pgmap v21517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:45 smithi156 ceph-mon[32679]: 2 slow requests, 1 included below; oldest blocked for > 38983.054409 secs 2024-04-27T05:19:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:45 smithi156 ceph-mon[32679]: slow request 722.936076 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:19:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:45 smithi092 ceph-mon[29156]: pgmap v21517: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:45 smithi092 ceph-mon[29156]: 2 slow requests, 1 included below; oldest blocked for > 38983.054409 secs 2024-04-27T05:19:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:45 smithi092 ceph-mon[29156]: slow request 722.936076 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:19:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:47 smithi189 ceph-mon[32756]: pgmap v21518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:47 smithi156 ceph-mon[32679]: pgmap v21518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:47 smithi092 ceph-mon[29156]: pgmap v21518: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:49 smithi092 ceph-mon[29156]: pgmap v21519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39685.091338 secs 2024-04-27T05:19:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:49 smithi189 ceph-mon[32756]: pgmap v21519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39685.091338 secs 2024-04-27T05:19:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:49 smithi156 ceph-mon[32679]: pgmap v21519: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39685.091338 secs 2024-04-27T05:19:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:50 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38988.054559 secs 2024-04-27T05:19:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:50 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38988.054559 secs 2024-04-27T05:19:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:50 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38988.054559 secs 2024-04-27T05:19:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:51 smithi189 ceph-mon[32756]: pgmap v21520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:51 smithi156 ceph-mon[32679]: pgmap v21520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:51 smithi092 ceph-mon[29156]: pgmap v21520: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:53 smithi189 ceph-mon[32756]: pgmap v21521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:53 smithi156 ceph-mon[32679]: pgmap v21521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:53 smithi092 ceph-mon[29156]: pgmap v21521: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39690.091465 secs 2024-04-27T05:19:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39690.091465 secs 2024-04-27T05:19:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39690.091465 secs 2024-04-27T05:19:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:55 smithi189 ceph-mon[32756]: pgmap v21522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:55 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38993.054652 secs 2024-04-27T05:19:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:55 smithi156 ceph-mon[32679]: pgmap v21522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:55 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38993.054652 secs 2024-04-27T05:19:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:55 smithi092 ceph-mon[29156]: pgmap v21522: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:19:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:55 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38993.054652 secs 2024-04-27T05:19:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:57 smithi189 ceph-mon[32756]: pgmap v21523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:57 smithi156 ceph-mon[32679]: pgmap v21523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:19:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:57 smithi092 ceph-mon[29156]: pgmap v21523: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:59 smithi189 ceph-mon[32756]: pgmap v21524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:19:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39695.091580 secs 2024-04-27T05:20:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:59 smithi156 ceph-mon[32679]: pgmap v21524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:19:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39695.091580 secs 2024-04-27T05:20:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:59 smithi092 ceph-mon[29156]: pgmap v21524: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:19:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39695.091580 secs 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 38998.054780 secs 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.j on smithi092 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.d on smithi092 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.k on smithi156 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.h on smithi156 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.l on smithi189 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.f on smithi189 is in error state 2024-04-27T05:20:01.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.c on smithi189 is in error state 2024-04-27T05:20:01.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: daemon mds.i on smithi189 is in error state 2024-04-27T05:20:01.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-27T05:20:01.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: mds.a(mds.1): 2 slow requests are blocked > 180 secs 2024-04-27T05:20:01.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:00 smithi156 ceph-mon[32679]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:20:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 38998.054780 secs 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.j on smithi092 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.d on smithi092 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.k on smithi156 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.h on smithi156 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.l on smithi189 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.f on smithi189 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.c on smithi189 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: daemon mds.i on smithi189 is in error state 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: mds.a(mds.1): 2 slow requests are blocked > 180 secs 2024-04-27T05:20:01.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:00 smithi189 ceph-mon[32756]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:20:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 38998.054780 secs 2024-04-27T05:20:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: Health detail: HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:20:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: [WRN] CEPHADM_FAILED_DAEMON: 8 failed cephadm daemon(s) 2024-04-27T05:20:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.j on smithi092 is in error state 2024-04-27T05:20:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.d on smithi092 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.k on smithi156 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.h on smithi156 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.l on smithi189 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.f on smithi189 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.c on smithi189 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: daemon mds.i on smithi189 is in error state 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: [WRN] MDS_SLOW_REQUEST: 2 MDSs report slow requests 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: mds.a(mds.1): 2 slow requests are blocked > 180 secs 2024-04-27T05:20:01.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:00 smithi092 ceph-mon[29156]: mds.b(mds.0): 18 slow requests are blocked > 180 secs 2024-04-27T05:20:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:01 smithi189 ceph-mon[32756]: pgmap v21525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:02.192 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:01 smithi156 ceph-mon[32679]: pgmap v21525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:02.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:01 smithi092 ceph-mon[29156]: pgmap v21525: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:03 smithi189 ceph-mon[32756]: pgmap v21526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:03 smithi156 ceph-mon[32679]: pgmap v21526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:04.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:03 smithi092 ceph-mon[29156]: pgmap v21526: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39700.091727 secs 2024-04-27T05:20:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39700.091727 secs 2024-04-27T05:20:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39700.091727 secs 2024-04-27T05:20:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:05 smithi189 ceph-mon[32756]: pgmap v21527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:05 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39003.054906 secs 2024-04-27T05:20:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:05 smithi156 ceph-mon[32679]: pgmap v21527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:05 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39003.054906 secs 2024-04-27T05:20:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:05 smithi092 ceph-mon[29156]: pgmap v21527: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:05 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39003.054906 secs 2024-04-27T05:20:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:07 smithi189 ceph-mon[32756]: pgmap v21528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:07 smithi156 ceph-mon[32679]: pgmap v21528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:07 smithi092 ceph-mon[29156]: pgmap v21528: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:09 smithi189 ceph-mon[32756]: pgmap v21529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39705.091861 secs 2024-04-27T05:20:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:09 smithi156 ceph-mon[32679]: pgmap v21529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39705.091861 secs 2024-04-27T05:20:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:09 smithi092 ceph-mon[29156]: pgmap v21529: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39705.091861 secs 2024-04-27T05:20:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:10 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39008.055001 secs 2024-04-27T05:20:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:10 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39008.055001 secs 2024-04-27T05:20:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:10 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39008.055001 secs 2024-04-27T05:20:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:11 smithi189 ceph-mon[32756]: pgmap v21530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:11 smithi156 ceph-mon[32679]: pgmap v21530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:11 smithi092 ceph-mon[29156]: pgmap v21530: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:13 smithi189 ceph-mon[32756]: pgmap v21531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:13 smithi156 ceph-mon[32679]: pgmap v21531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:13 smithi092 ceph-mon[29156]: pgmap v21531: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39710.091991 secs 2024-04-27T05:20:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39710.091991 secs 2024-04-27T05:20:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39710.091991 secs 2024-04-27T05:20:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:15 smithi189 ceph-mon[32756]: pgmap v21532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:15 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39013.055066 secs 2024-04-27T05:20:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:15 smithi156 ceph-mon[32679]: pgmap v21532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:15 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39013.055066 secs 2024-04-27T05:20:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:15 smithi092 ceph-mon[29156]: pgmap v21532: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:15 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39013.055066 secs 2024-04-27T05:20:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:17 smithi189 ceph-mon[32756]: pgmap v21533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:17 smithi156 ceph-mon[32679]: pgmap v21533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:17 smithi092 ceph-mon[29156]: pgmap v21533: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:19 smithi189 ceph-mon[32756]: pgmap v21534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39715.092119 secs 2024-04-27T05:20:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:19 smithi156 ceph-mon[32679]: pgmap v21534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39715.092119 secs 2024-04-27T05:20:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:19 smithi092 ceph-mon[29156]: pgmap v21534: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39715.092119 secs 2024-04-27T05:20:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:20 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39018.055217 secs 2024-04-27T05:20:21.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:20 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39018.055217 secs 2024-04-27T05:20:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:20 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39018.055217 secs 2024-04-27T05:20:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:21 smithi189 ceph-mon[32756]: pgmap v21535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:21 smithi156 ceph-mon[32679]: pgmap v21535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:21 smithi092 ceph-mon[29156]: pgmap v21535: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:22 smithi189 ceph-mon[32756]: pgmap v21536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:22 smithi156 ceph-mon[32679]: pgmap v21536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:22 smithi092 ceph-mon[29156]: pgmap v21536: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:25 smithi189 ceph-mon[32756]: pgmap v21537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:25 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39720.092230 secs 2024-04-27T05:20:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:25 smithi156 ceph-mon[32679]: pgmap v21537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:25 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39720.092230 secs 2024-04-27T05:20:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:25 smithi092 ceph-mon[29156]: pgmap v21537: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:25 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39720.092230 secs 2024-04-27T05:20:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:26 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39023.055278 secs 2024-04-27T05:20:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:26 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39023.055278 secs 2024-04-27T05:20:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:26 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39023.055278 secs 2024-04-27T05:20:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:27 smithi189 ceph-mon[32756]: pgmap v21538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:27 smithi156 ceph-mon[32679]: pgmap v21538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:27.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:27 smithi092 ceph-mon[29156]: pgmap v21538: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:29 smithi189 ceph-mon[32756]: pgmap v21539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:29 smithi156 ceph-mon[32679]: pgmap v21539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:29.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:29 smithi092 ceph-mon[29156]: pgmap v21539: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:30 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39725.092363 secs 2024-04-27T05:20:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:30 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39725.092363 secs 2024-04-27T05:20:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:30 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39725.092363 secs 2024-04-27T05:20:31.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39028.055403 secs 2024-04-27T05:20:31.336 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: pgmap v21540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: pgmap v21541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: pgmap v21542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:31.337 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:20:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39028.055403 secs 2024-04-27T05:20:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: pgmap v21540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:20:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:20:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:20:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: pgmap v21541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:20:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: pgmap v21542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:31.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39028.055403 secs 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: pgmap v21540: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: pgmap v21541: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: pgmap v21542: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:31.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:20:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:33 smithi189 ceph-mon[32756]: pgmap v21543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:20:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:33 smithi156 ceph-mon[32679]: pgmap v21543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:20:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:33 smithi092 ceph-mon[29156]: pgmap v21543: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:20:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39730.092458 secs 2024-04-27T05:20:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39730.092458 secs 2024-04-27T05:20:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39730.092458 secs 2024-04-27T05:20:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:35 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39033.055549 secs 2024-04-27T05:20:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:35 smithi189 ceph-mon[32756]: pgmap v21544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:35 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39033.055549 secs 2024-04-27T05:20:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:35 smithi156 ceph-mon[32679]: pgmap v21544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:35 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39033.055549 secs 2024-04-27T05:20:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:35 smithi092 ceph-mon[29156]: pgmap v21544: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:37 smithi189 ceph-mon[32756]: pgmap v21545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:37 smithi156 ceph-mon[32679]: pgmap v21545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:37 smithi092 ceph-mon[29156]: pgmap v21545: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:39 smithi189 ceph-mon[32756]: pgmap v21546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39735.092537 secs 2024-04-27T05:20:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:39 smithi156 ceph-mon[32679]: pgmap v21546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39735.092537 secs 2024-04-27T05:20:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:39 smithi092 ceph-mon[29156]: pgmap v21546: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:20:40.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39735.092537 secs 2024-04-27T05:20:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:40 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39038.055686 secs 2024-04-27T05:20:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:40 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39038.055686 secs 2024-04-27T05:20:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:40 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39038.055686 secs 2024-04-27T05:20:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:41 smithi189 ceph-mon[32756]: pgmap v21547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:20:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:41 smithi156 ceph-mon[32679]: pgmap v21547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:20:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:41 smithi092 ceph-mon[29156]: pgmap v21547: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:20:44.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:43 smithi189 ceph-mon[32756]: pgmap v21548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:43 smithi156 ceph-mon[32679]: pgmap v21548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:43 smithi092 ceph-mon[29156]: pgmap v21548: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39740.092635 secs 2024-04-27T05:20:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39740.092635 secs 2024-04-27T05:20:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39740.092635 secs 2024-04-27T05:20:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:45 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39043.055825 secs 2024-04-27T05:20:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:45 smithi189 ceph-mon[32756]: pgmap v21549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:45 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39043.055825 secs 2024-04-27T05:20:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:45 smithi156 ceph-mon[32679]: pgmap v21549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:45 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39043.055825 secs 2024-04-27T05:20:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:45 smithi092 ceph-mon[29156]: pgmap v21549: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:46 smithi189 ceph-mon[32756]: pgmap v21550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:46 smithi156 ceph-mon[32679]: pgmap v21550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:46 smithi092 ceph-mon[29156]: pgmap v21550: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:49 smithi189 ceph-mon[32756]: pgmap v21551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39745.092758 secs 2024-04-27T05:20:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:49 smithi156 ceph-mon[32679]: pgmap v21551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39745.092758 secs 2024-04-27T05:20:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:49 smithi092 ceph-mon[29156]: pgmap v21551: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39745.092758 secs 2024-04-27T05:20:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:50 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39048.055939 secs 2024-04-27T05:20:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:50 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39048.055939 secs 2024-04-27T05:20:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:50 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39048.055939 secs 2024-04-27T05:20:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:51 smithi189 ceph-mon[32756]: pgmap v21552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:51 smithi156 ceph-mon[32679]: pgmap v21552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:51 smithi092 ceph-mon[29156]: pgmap v21552: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:53 smithi189 ceph-mon[32756]: pgmap v21553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:53 smithi156 ceph-mon[32679]: pgmap v21553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:53 smithi092 ceph-mon[29156]: pgmap v21553: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39750.092874 secs 2024-04-27T05:20:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39750.092874 secs 2024-04-27T05:20:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39750.092874 secs 2024-04-27T05:20:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:55 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39053.056035 secs 2024-04-27T05:20:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:55 smithi189 ceph-mon[32756]: pgmap v21554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:55 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39053.056035 secs 2024-04-27T05:20:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:55 smithi156 ceph-mon[32679]: pgmap v21554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:55 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39053.056035 secs 2024-04-27T05:20:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:55 smithi092 ceph-mon[29156]: pgmap v21554: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:20:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:57 smithi189 ceph-mon[32756]: pgmap v21555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:57 smithi156 ceph-mon[32679]: pgmap v21555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:20:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:57 smithi092 ceph-mon[29156]: pgmap v21555: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:59 smithi189 ceph-mon[32756]: pgmap v21556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:20:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39755.092983 secs 2024-04-27T05:21:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:59 smithi156 ceph-mon[32679]: pgmap v21556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:20:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39755.092983 secs 2024-04-27T05:21:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:59 smithi092 ceph-mon[29156]: pgmap v21556: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:20:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39755.092983 secs 2024-04-27T05:21:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:00 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39058.056151 secs 2024-04-27T05:21:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:00 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39058.056151 secs 2024-04-27T05:21:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:00 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39058.056151 secs 2024-04-27T05:21:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:01 smithi189 ceph-mon[32756]: pgmap v21557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:02.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:01 smithi156 ceph-mon[32679]: pgmap v21557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:02.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:01 smithi092 ceph-mon[29156]: pgmap v21557: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:03 smithi189 ceph-mon[32756]: pgmap v21558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:03 smithi156 ceph-mon[32679]: pgmap v21558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:03 smithi092 ceph-mon[29156]: pgmap v21558: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39760.093101 secs 2024-04-27T05:21:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39760.093101 secs 2024-04-27T05:21:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39760.093101 secs 2024-04-27T05:21:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:05 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39063.056265 secs 2024-04-27T05:21:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:05 smithi189 ceph-mon[32756]: pgmap v21559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:05 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39063.056265 secs 2024-04-27T05:21:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:05 smithi156 ceph-mon[32679]: pgmap v21559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:05 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39063.056265 secs 2024-04-27T05:21:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:05 smithi092 ceph-mon[29156]: pgmap v21559: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:06 smithi189 ceph-mon[32756]: pgmap v21560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:06 smithi156 ceph-mon[32679]: pgmap v21560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:06 smithi092 ceph-mon[29156]: pgmap v21560: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:09 smithi189 ceph-mon[32756]: pgmap v21561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39765.093226 secs 2024-04-27T05:21:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:09 smithi156 ceph-mon[32679]: pgmap v21561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39765.093226 secs 2024-04-27T05:21:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:09 smithi092 ceph-mon[29156]: pgmap v21561: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39765.093226 secs 2024-04-27T05:21:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:10 smithi189 ceph-mon[32756]: 2 slow requests, 0 included below; oldest blocked for > 39068.056367 secs 2024-04-27T05:21:11.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:10 smithi092 ceph-mon[29156]: 2 slow requests, 0 included below; oldest blocked for > 39068.056367 secs 2024-04-27T05:21:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:10 smithi156 ceph-mon[32679]: 2 slow requests, 0 included below; oldest blocked for > 39068.056367 secs 2024-04-27T05:21:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:11 smithi189 ceph-mon[32756]: pgmap v21562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:11 smithi156 ceph-mon[32679]: pgmap v21562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:11 smithi092 ceph-mon[29156]: pgmap v21562: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:13 smithi189 ceph-mon[32756]: pgmap v21563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:13 smithi156 ceph-mon[32679]: pgmap v21563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:13 smithi092 ceph-mon[29156]: pgmap v21563: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39770.093371 secs 2024-04-27T05:21:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39770.093371 secs 2024-04-27T05:21:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39770.093371 secs 2024-04-27T05:21:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:15 smithi189 ceph-mon[32756]: 33 slow requests, 2 included below; oldest blocked for > 39073.056507 secs 2024-04-27T05:21:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:15 smithi189 ceph-mon[32756]: slow request 182.779520 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:21:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:15 smithi189 ceph-mon[32756]: slow request 3033.499018 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:21:16.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:15 smithi189 ceph-mon[32756]: pgmap v21564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:15 smithi156 ceph-mon[32679]: 33 slow requests, 2 included below; oldest blocked for > 39073.056507 secs 2024-04-27T05:21:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:15 smithi156 ceph-mon[32679]: slow request 182.779520 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:21:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:15 smithi156 ceph-mon[32679]: slow request 3033.499018 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:21:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:15 smithi156 ceph-mon[32679]: pgmap v21564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:15 smithi092 ceph-mon[29156]: 33 slow requests, 2 included below; oldest blocked for > 39073.056507 secs 2024-04-27T05:21:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:15 smithi092 ceph-mon[29156]: slow request 182.779520 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:21:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:15 smithi092 ceph-mon[29156]: slow request 3033.499018 seconds old, received at 2024-04-27T04:30:40.703523+0000: client_request(client.17535:1 getattr pAsLsXsFs #0x1 2024-04-27T04:30:40.696599+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:21:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:15 smithi092 ceph-mon[29156]: pgmap v21564: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:17 smithi189 ceph-mon[32756]: pgmap v21565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:17 smithi156 ceph-mon[32679]: pgmap v21565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:17 smithi092 ceph-mon[29156]: pgmap v21565: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:21:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:21:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:18 smithi189 ceph-mon[32756]: pgmap v21566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:21:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:21:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:18 smithi156 ceph-mon[32679]: pgmap v21566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:21:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:21:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:18 smithi092 ceph-mon[29156]: pgmap v21566: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39775.093482 secs 2024-04-27T05:21:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39775.093482 secs 2024-04-27T05:21:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39775.093482 secs 2024-04-27T05:21:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39078.056643 secs 2024-04-27T05:21:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:20 smithi189 ceph-mon[32756]: pgmap v21567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39078.056643 secs 2024-04-27T05:21:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:20 smithi156 ceph-mon[32679]: pgmap v21567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39078.056643 secs 2024-04-27T05:21:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:20 smithi092 ceph-mon[29156]: pgmap v21567: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:23 smithi189 ceph-mon[32756]: pgmap v21568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:23 smithi156 ceph-mon[32679]: pgmap v21568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:23 smithi092 ceph-mon[29156]: pgmap v21568: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39780.093579 secs 2024-04-27T05:21:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39780.093579 secs 2024-04-27T05:21:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39780.093579 secs 2024-04-27T05:21:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39083.056760 secs 2024-04-27T05:21:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:25 smithi189 ceph-mon[32756]: pgmap v21569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39083.056760 secs 2024-04-27T05:21:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:25 smithi156 ceph-mon[32679]: pgmap v21569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39083.056760 secs 2024-04-27T05:21:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:25 smithi092 ceph-mon[29156]: pgmap v21569: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:27 smithi189 ceph-mon[32756]: pgmap v21570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:27 smithi156 ceph-mon[32679]: pgmap v21570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:27 smithi092 ceph-mon[29156]: pgmap v21570: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:29 smithi189 ceph-mon[32756]: pgmap v21571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39785.093698 secs 2024-04-27T05:21:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:29 smithi156 ceph-mon[32679]: pgmap v21571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39785.093698 secs 2024-04-27T05:21:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:29 smithi092 ceph-mon[29156]: pgmap v21571: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39785.093698 secs 2024-04-27T05:21:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39088.056875 secs 2024-04-27T05:21:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39088.056875 secs 2024-04-27T05:21:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39088.056875 secs 2024-04-27T05:21:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:31 smithi189 ceph-mon[32756]: pgmap v21572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:21:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:21:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:21:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:21:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:31 smithi156 ceph-mon[32679]: pgmap v21572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:21:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:21:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:21:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:21:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:31 smithi092 ceph-mon[29156]: pgmap v21572: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:21:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:21:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:21:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:21:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:32 smithi189 ceph-mon[32756]: pgmap v21573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:33.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:32 smithi189 ceph-mon[32756]: pgmap v21574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:21:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:32 smithi156 ceph-mon[32679]: pgmap v21573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:32 smithi156 ceph-mon[32679]: pgmap v21574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:21:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:32 smithi092 ceph-mon[29156]: pgmap v21573: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:32 smithi092 ceph-mon[29156]: pgmap v21574: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:21:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:33 smithi156 ceph-mon[32679]: pgmap v21575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:33 smithi092 ceph-mon[29156]: pgmap v21575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:33 smithi189 ceph-mon[32756]: pgmap v21575: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39790.093852 secs 2024-04-27T05:21:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39790.093852 secs 2024-04-27T05:21:35.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39790.093852 secs 2024-04-27T05:21:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39093.056992 secs 2024-04-27T05:21:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:35 smithi156 ceph-mon[32679]: pgmap v21576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39093.056992 secs 2024-04-27T05:21:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:35 smithi092 ceph-mon[29156]: pgmap v21576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39093.056992 secs 2024-04-27T05:21:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:35 smithi189 ceph-mon[32756]: pgmap v21576: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:38 smithi189 ceph-mon[32756]: pgmap v21577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:21:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:38 smithi156 ceph-mon[32679]: pgmap v21577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:21:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:38 smithi092 ceph-mon[29156]: pgmap v21577: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:21:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39795.093988 secs 2024-04-27T05:21:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39795.093988 secs 2024-04-27T05:21:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39795.093988 secs 2024-04-27T05:21:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39098.057117 secs 2024-04-27T05:21:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:40 smithi189 ceph-mon[32756]: pgmap v21578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39098.057117 secs 2024-04-27T05:21:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:40 smithi156 ceph-mon[32679]: pgmap v21578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39098.057117 secs 2024-04-27T05:21:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:40 smithi092 ceph-mon[29156]: pgmap v21578: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:21:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:21:41.444+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:21:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:21:41.444+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:21:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:21:41.444+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:21:41.446 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:21:41.444+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 306 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:21:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:42 smithi189 ceph-mon[32756]: pgmap v21579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:42 smithi156 ceph-mon[32679]: pgmap v21579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:42 smithi092 ceph-mon[29156]: pgmap v21579: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:21:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:44 smithi189 ceph-mon[32756]: pgmap v21580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:21:44.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39800.094103 secs 2024-04-27T05:21:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:44 smithi156 ceph-mon[32679]: pgmap v21580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:21:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39800.094103 secs 2024-04-27T05:21:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:44 smithi092 ceph-mon[29156]: pgmap v21580: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:21:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39800.094103 secs 2024-04-27T05:21:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39103.057252 secs 2024-04-27T05:21:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39103.057252 secs 2024-04-27T05:21:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39103.057252 secs 2024-04-27T05:21:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:46 smithi189 ceph-mon[32756]: pgmap v21581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:46 smithi156 ceph-mon[32679]: pgmap v21581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:46 smithi092 ceph-mon[29156]: pgmap v21581: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:48 smithi189 ceph-mon[32756]: pgmap v21582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:48 smithi156 ceph-mon[32679]: pgmap v21582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:48 smithi092 ceph-mon[29156]: pgmap v21582: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39805.094201 secs 2024-04-27T05:21:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39805.094201 secs 2024-04-27T05:21:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39805.094201 secs 2024-04-27T05:21:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39108.057364 secs 2024-04-27T05:21:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:50 smithi189 ceph-mon[32756]: pgmap v21583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39108.057364 secs 2024-04-27T05:21:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:50 smithi156 ceph-mon[32679]: pgmap v21583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39108.057364 secs 2024-04-27T05:21:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:50 smithi092 ceph-mon[29156]: pgmap v21583: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:52 smithi156 ceph-mon[32679]: pgmap v21584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:52 smithi092 ceph-mon[29156]: pgmap v21584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:52 smithi189 ceph-mon[32756]: pgmap v21584: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:54 smithi156 ceph-mon[32679]: pgmap v21585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39810.094318 secs 2024-04-27T05:21:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:54 smithi092 ceph-mon[29156]: pgmap v21585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39810.094318 secs 2024-04-27T05:21:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:54 smithi189 ceph-mon[32756]: pgmap v21585: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:21:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39810.094318 secs 2024-04-27T05:21:55.938 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39113.057485 secs 2024-04-27T05:21:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39113.057485 secs 2024-04-27T05:21:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39113.057485 secs 2024-04-27T05:21:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:56 smithi156 ceph-mon[32679]: pgmap v21586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:56 smithi092 ceph-mon[29156]: pgmap v21586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:56 smithi189 ceph-mon[32756]: pgmap v21586: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:58 smithi156 ceph-mon[32679]: pgmap v21587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:58 smithi092 ceph-mon[29156]: pgmap v21587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:58 smithi189 ceph-mon[32756]: pgmap v21587: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:21:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:21:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39815.094415 secs 2024-04-27T05:21:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:21:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39815.094415 secs 2024-04-27T05:22:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:21:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39815.094415 secs 2024-04-27T05:22:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39118.057632 secs 2024-04-27T05:22:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:00 smithi156 ceph-mon[32679]: pgmap v21588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39118.057632 secs 2024-04-27T05:22:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:00 smithi092 ceph-mon[29156]: pgmap v21588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:01.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39118.057632 secs 2024-04-27T05:22:01.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:00 smithi189 ceph-mon[32756]: pgmap v21588: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:02 smithi156 ceph-mon[32679]: pgmap v21589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:02 smithi092 ceph-mon[29156]: pgmap v21589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:03.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:02 smithi189 ceph-mon[32756]: pgmap v21589: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:04 smithi156 ceph-mon[32679]: pgmap v21590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39820.094533 secs 2024-04-27T05:22:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:04 smithi092 ceph-mon[29156]: pgmap v21590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39820.094533 secs 2024-04-27T05:22:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:04 smithi189 ceph-mon[32756]: pgmap v21590: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39820.094533 secs 2024-04-27T05:22:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39123.057747 secs 2024-04-27T05:22:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39123.057747 secs 2024-04-27T05:22:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39123.057747 secs 2024-04-27T05:22:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:06 smithi156 ceph-mon[32679]: pgmap v21591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:06 smithi092 ceph-mon[29156]: pgmap v21591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:07.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:06 smithi189 ceph-mon[32756]: pgmap v21591: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:08 smithi156 ceph-mon[32679]: pgmap v21592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:08 smithi092 ceph-mon[29156]: pgmap v21592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:09.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:08 smithi189 ceph-mon[32756]: pgmap v21592: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39825.094651 secs 2024-04-27T05:22:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39825.094651 secs 2024-04-27T05:22:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39825.094651 secs 2024-04-27T05:22:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39128.057822 secs 2024-04-27T05:22:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:10 smithi092 ceph-mon[29156]: pgmap v21593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39128.057822 secs 2024-04-27T05:22:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:10 smithi189 ceph-mon[32756]: pgmap v21593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39128.057822 secs 2024-04-27T05:22:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:10 smithi156 ceph-mon[32679]: pgmap v21593: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:12 smithi092 ceph-mon[29156]: pgmap v21594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:13.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:12 smithi189 ceph-mon[32756]: pgmap v21594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:12 smithi156 ceph-mon[32679]: pgmap v21594: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:14 smithi092 ceph-mon[29156]: pgmap v21595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:14 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39830.094767 secs 2024-04-27T05:22:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:14 smithi189 ceph-mon[32756]: pgmap v21595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:14 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39830.094767 secs 2024-04-27T05:22:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:14 smithi156 ceph-mon[32679]: pgmap v21595: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:14 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39830.094767 secs 2024-04-27T05:22:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:15 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39133.057956 secs 2024-04-27T05:22:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:15 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39133.057956 secs 2024-04-27T05:22:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:15 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39133.057956 secs 2024-04-27T05:22:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:16 smithi092 ceph-mon[29156]: pgmap v21596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:16 smithi189 ceph-mon[32756]: pgmap v21596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:16 smithi156 ceph-mon[32679]: pgmap v21596: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:18 smithi092 ceph-mon[29156]: pgmap v21597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:19.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:18 smithi189 ceph-mon[32756]: pgmap v21597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:18 smithi156 ceph-mon[32679]: pgmap v21597: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:19 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39835.094883 secs 2024-04-27T05:22:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:19 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39835.094883 secs 2024-04-27T05:22:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:19 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39835.094883 secs 2024-04-27T05:22:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39138.058069 secs 2024-04-27T05:22:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:20 smithi092 ceph-mon[29156]: pgmap v21598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39138.058069 secs 2024-04-27T05:22:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:20 smithi189 ceph-mon[32756]: pgmap v21598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39138.058069 secs 2024-04-27T05:22:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:20 smithi156 ceph-mon[32679]: pgmap v21598: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:22 smithi092 ceph-mon[29156]: pgmap v21599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:23.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:22 smithi189 ceph-mon[32756]: pgmap v21599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:22 smithi156 ceph-mon[32679]: pgmap v21599: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:24 smithi092 ceph-mon[29156]: pgmap v21600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:24 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39840.094960 secs 2024-04-27T05:22:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:24 smithi189 ceph-mon[32756]: pgmap v21600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:24 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39840.094960 secs 2024-04-27T05:22:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:24 smithi156 ceph-mon[32679]: pgmap v21600: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:24 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39840.094960 secs 2024-04-27T05:22:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39143.058190 secs 2024-04-27T05:22:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39143.058190 secs 2024-04-27T05:22:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39143.058190 secs 2024-04-27T05:22:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:26 smithi092 ceph-mon[29156]: pgmap v21601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:26 smithi189 ceph-mon[32756]: pgmap v21601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:26 smithi156 ceph-mon[32679]: pgmap v21601: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:28 smithi092 ceph-mon[29156]: pgmap v21602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:28 smithi189 ceph-mon[32756]: pgmap v21602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:28 smithi156 ceph-mon[32679]: pgmap v21602: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:29 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39845.095023 secs 2024-04-27T05:22:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:29 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39845.095023 secs 2024-04-27T05:22:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:29 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39845.095023 secs 2024-04-27T05:22:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39148.058327 secs 2024-04-27T05:22:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:30 smithi092 ceph-mon[29156]: pgmap v21603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:31.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39148.058327 secs 2024-04-27T05:22:31.041 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:30 smithi189 ceph-mon[32756]: pgmap v21603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:31.188 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39148.058327 secs 2024-04-27T05:22:31.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:30 smithi156 ceph-mon[32679]: pgmap v21603: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:32.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:31 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:22:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:31 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:22:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:31 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:22:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:32 smithi189 ceph-mon[32756]: pgmap v21604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:22:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:22:33.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:22:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:32 smithi156 ceph-mon[32679]: pgmap v21604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:22:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:22:33.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:22:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:32 smithi092 ceph-mon[29156]: pgmap v21604: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:22:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:22:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:22:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:33 smithi189 ceph-mon[32756]: pgmap v21605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:22:34.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:33 smithi189 ceph-mon[32756]: pgmap v21606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:33 smithi156 ceph-mon[32679]: pgmap v21605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:22:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:33 smithi156 ceph-mon[32679]: pgmap v21606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:33 smithi092 ceph-mon[29156]: pgmap v21605: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:22:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:33 smithi092 ceph-mon[29156]: pgmap v21606: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:34 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39850.095173 secs 2024-04-27T05:22:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:34 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39850.095173 secs 2024-04-27T05:22:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:34 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39850.095173 secs 2024-04-27T05:22:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39153.058422 secs 2024-04-27T05:22:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:35 smithi189 ceph-mon[32756]: pgmap v21607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39153.058422 secs 2024-04-27T05:22:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:35 smithi156 ceph-mon[32679]: pgmap v21607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:36.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39153.058422 secs 2024-04-27T05:22:36.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:35 smithi092 ceph-mon[29156]: pgmap v21607: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:37 smithi189 ceph-mon[32756]: pgmap v21608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:37 smithi156 ceph-mon[32679]: pgmap v21608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:37 smithi092 ceph-mon[29156]: pgmap v21608: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:39 smithi189 ceph-mon[32756]: pgmap v21609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:39 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39855.095305 secs 2024-04-27T05:22:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:39 smithi156 ceph-mon[32679]: pgmap v21609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:39 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39855.095305 secs 2024-04-27T05:22:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:39 smithi092 ceph-mon[29156]: pgmap v21609: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:22:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:39 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39855.095305 secs 2024-04-27T05:22:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39158.058515 secs 2024-04-27T05:22:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39158.058515 secs 2024-04-27T05:22:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39158.058515 secs 2024-04-27T05:22:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:41 smithi189 ceph-mon[32756]: pgmap v21610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:41 smithi156 ceph-mon[32679]: pgmap v21610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:41 smithi092 ceph-mon[29156]: pgmap v21610: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:22:44.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:43 smithi092 ceph-mon[29156]: pgmap v21611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:22:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:43 smithi189 ceph-mon[32756]: pgmap v21611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:22:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:43 smithi156 ceph-mon[32679]: pgmap v21611: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:22:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:44 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39860.095440 secs 2024-04-27T05:22:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:44 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39860.095440 secs 2024-04-27T05:22:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:44 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39860.095440 secs 2024-04-27T05:22:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39163.058632 secs 2024-04-27T05:22:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:45 smithi189 ceph-mon[32756]: pgmap v21612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39163.058632 secs 2024-04-27T05:22:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:45 smithi156 ceph-mon[32679]: pgmap v21612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39163.058632 secs 2024-04-27T05:22:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:45 smithi092 ceph-mon[29156]: pgmap v21612: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:47 smithi189 ceph-mon[32756]: pgmap v21613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:47 smithi156 ceph-mon[32679]: pgmap v21613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:47 smithi092 ceph-mon[29156]: pgmap v21613: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:49 smithi189 ceph-mon[32756]: pgmap v21614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:49 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39865.095576 secs 2024-04-27T05:22:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:49 smithi156 ceph-mon[32679]: pgmap v21614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:49 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39865.095576 secs 2024-04-27T05:22:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:49 smithi092 ceph-mon[29156]: pgmap v21614: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:49 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39865.095576 secs 2024-04-27T05:22:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39168.058764 secs 2024-04-27T05:22:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39168.058764 secs 2024-04-27T05:22:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39168.058764 secs 2024-04-27T05:22:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:51 smithi189 ceph-mon[32756]: pgmap v21615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:51 smithi156 ceph-mon[32679]: pgmap v21615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:51 smithi092 ceph-mon[29156]: pgmap v21615: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:53 smithi189 ceph-mon[32756]: pgmap v21616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:53 smithi156 ceph-mon[32679]: pgmap v21616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:53 smithi092 ceph-mon[29156]: pgmap v21616: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:54 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39870.095712 secs 2024-04-27T05:22:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:54 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39870.095712 secs 2024-04-27T05:22:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:54 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39870.095712 secs 2024-04-27T05:22:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39173.058836 secs 2024-04-27T05:22:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:55 smithi189 ceph-mon[32756]: pgmap v21617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:56.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39173.058836 secs 2024-04-27T05:22:56.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:55 smithi092 ceph-mon[29156]: pgmap v21617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39173.058836 secs 2024-04-27T05:22:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:55 smithi156 ceph-mon[32679]: pgmap v21617: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:22:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:57 smithi189 ceph-mon[32756]: pgmap v21618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:57 smithi156 ceph-mon[32679]: pgmap v21618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:22:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:57 smithi092 ceph-mon[29156]: pgmap v21618: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:59 smithi189 ceph-mon[32756]: pgmap v21619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:22:59 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39875.095862 secs 2024-04-27T05:23:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:59 smithi156 ceph-mon[32679]: pgmap v21619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:22:59 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39875.095862 secs 2024-04-27T05:23:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:59 smithi092 ceph-mon[29156]: pgmap v21619: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:22:59 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39875.095862 secs 2024-04-27T05:23:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39178.058967 secs 2024-04-27T05:23:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39178.058967 secs 2024-04-27T05:23:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39178.058967 secs 2024-04-27T05:23:02.087 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:01 smithi156 ceph-mon[32679]: pgmap v21620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:01 smithi189 ceph-mon[32756]: pgmap v21620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:02.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:01 smithi092 ceph-mon[29156]: pgmap v21620: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:03 smithi189 ceph-mon[32756]: pgmap v21621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:03 smithi156 ceph-mon[32679]: pgmap v21621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:03 smithi092 ceph-mon[29156]: pgmap v21621: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:04 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39880.095986 secs 2024-04-27T05:23:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:04 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39880.095986 secs 2024-04-27T05:23:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:04 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39880.095986 secs 2024-04-27T05:23:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39183.059082 secs 2024-04-27T05:23:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:05 smithi189 ceph-mon[32756]: pgmap v21622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39183.059082 secs 2024-04-27T05:23:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:05 smithi156 ceph-mon[32679]: pgmap v21622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39183.059082 secs 2024-04-27T05:23:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:05 smithi092 ceph-mon[29156]: pgmap v21622: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:07 smithi189 ceph-mon[32756]: pgmap v21623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:07 smithi156 ceph-mon[32679]: pgmap v21623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:07 smithi092 ceph-mon[29156]: pgmap v21623: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:09 smithi189 ceph-mon[32756]: pgmap v21624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:09 smithi189 ceph-mon[32756]: 18 slow requests, 0 included below; oldest blocked for > 39885.096123 secs 2024-04-27T05:23:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:09 smithi156 ceph-mon[32679]: pgmap v21624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:09 smithi156 ceph-mon[32679]: 18 slow requests, 0 included below; oldest blocked for > 39885.096123 secs 2024-04-27T05:23:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:09 smithi092 ceph-mon[29156]: pgmap v21624: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:09 smithi092 ceph-mon[29156]: 18 slow requests, 0 included below; oldest blocked for > 39885.096123 secs 2024-04-27T05:23:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39188.059219 secs 2024-04-27T05:23:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39188.059219 secs 2024-04-27T05:23:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39188.059219 secs 2024-04-27T05:23:11.806 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:23:11.525+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:23:11.807 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:23:11.525+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:23:11.807 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:23:11.525+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:23:11.807 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:23:11.525+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:23:11.807 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:23:11.525+0000 7f25434f4700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:23:12.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:11 smithi189 ceph-mon[32756]: pgmap v21625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:12.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:11 smithi156 ceph-mon[32679]: pgmap v21625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:11 smithi092 ceph-mon[29156]: pgmap v21625: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:13 smithi189 ceph-mon[32756]: pgmap v21626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:13 smithi156 ceph-mon[32679]: pgmap v21626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:13 smithi092 ceph-mon[29156]: pgmap v21626: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39890.096184 secs 2024-04-27T05:23:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39890.096184 secs 2024-04-27T05:23:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39890.096184 secs 2024-04-27T05:23:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:15 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39193.059332 secs 2024-04-27T05:23:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:15 smithi189 ceph-mon[32756]: pgmap v21627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:15 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39193.059332 secs 2024-04-27T05:23:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:15 smithi156 ceph-mon[32679]: pgmap v21627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:15 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39193.059332 secs 2024-04-27T05:23:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:15 smithi092 ceph-mon[29156]: pgmap v21627: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:23:17.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:23:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:23:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:23:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:23:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:23:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:17 smithi189 ceph-mon[32756]: pgmap v21628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:17 smithi156 ceph-mon[32679]: pgmap v21628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:17 smithi092 ceph-mon[29156]: pgmap v21628: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:19 smithi189 ceph-mon[32756]: pgmap v21629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39895.096310 secs 2024-04-27T05:23:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:19 smithi156 ceph-mon[32679]: pgmap v21629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39895.096310 secs 2024-04-27T05:23:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:19 smithi092 ceph-mon[29156]: pgmap v21629: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39895.096310 secs 2024-04-27T05:23:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39198.059394 secs 2024-04-27T05:23:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39198.059394 secs 2024-04-27T05:23:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39198.059394 secs 2024-04-27T05:23:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:21 smithi189 ceph-mon[32756]: pgmap v21630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:21 smithi156 ceph-mon[32679]: pgmap v21630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:21 smithi092 ceph-mon[29156]: pgmap v21630: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:23.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:22 smithi156 ceph-mon[32679]: pgmap v21631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:22 smithi092 ceph-mon[29156]: pgmap v21631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:23.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:22 smithi189 ceph-mon[32756]: pgmap v21631: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 341 B/s wr, 15 op/s 2024-04-27T05:23:24.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39900.096426 secs 2024-04-27T05:23:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39900.096426 secs 2024-04-27T05:23:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39900.096426 secs 2024-04-27T05:23:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39203.059457 secs 2024-04-27T05:23:25.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:25 smithi092 ceph-mon[29156]: pgmap v21632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39203.059457 secs 2024-04-27T05:23:25.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:25 smithi189 ceph-mon[32756]: pgmap v21632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39203.059457 secs 2024-04-27T05:23:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:25 smithi156 ceph-mon[32679]: pgmap v21632: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 341 B/s wr, 16 op/s 2024-04-27T05:23:27.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:27 smithi092 ceph-mon[29156]: pgmap v21633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:27.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:27 smithi189 ceph-mon[32756]: pgmap v21633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:27.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:27 smithi156 ceph-mon[32679]: pgmap v21633: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:29 smithi092 ceph-mon[29156]: pgmap v21634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:29.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39905.096539 secs 2024-04-27T05:23:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:29 smithi189 ceph-mon[32756]: pgmap v21634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39905.096539 secs 2024-04-27T05:23:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:29 smithi156 ceph-mon[32679]: pgmap v21634: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39905.096539 secs 2024-04-27T05:23:30.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39208.059535 secs 2024-04-27T05:23:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39208.059535 secs 2024-04-27T05:23:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39208.059535 secs 2024-04-27T05:23:31.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:31 smithi092 ceph-mon[29156]: pgmap v21635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:31.791 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:31 smithi189 ceph-mon[32756]: pgmap v21635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:31.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:31 smithi156 ceph-mon[32679]: pgmap v21635: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:32.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:32 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:23:32.836 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:32 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:23:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:32 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:23:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:33 smithi092 ceph-mon[29156]: pgmap v21636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:23:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:23:33.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:23:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:33 smithi189 ceph-mon[32756]: pgmap v21636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:23:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:23:33.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:23:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:33 smithi156 ceph-mon[32679]: pgmap v21636: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:23:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:23:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:34 smithi092 ceph-mon[29156]: pgmap v21637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:34 smithi092 ceph-mon[29156]: pgmap v21638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:23:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39910.096657 secs 2024-04-27T05:23:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:34 smithi189 ceph-mon[32756]: pgmap v21637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:23:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:34 smithi189 ceph-mon[32756]: pgmap v21638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:23:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39910.096657 secs 2024-04-27T05:23:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:34 smithi156 ceph-mon[32679]: pgmap v21637: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:23:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:34 smithi156 ceph-mon[32679]: pgmap v21638: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:23:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39910.096657 secs 2024-04-27T05:23:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39213.059606 secs 2024-04-27T05:23:35.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39213.059606 secs 2024-04-27T05:23:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39213.059606 secs 2024-04-27T05:23:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:36 smithi092 ceph-mon[29156]: pgmap v21639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:36 smithi189 ceph-mon[32756]: pgmap v21639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:36 smithi156 ceph-mon[32679]: pgmap v21639: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:38 smithi092 ceph-mon[29156]: pgmap v21640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:38 smithi189 ceph-mon[32756]: pgmap v21640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:38 smithi156 ceph-mon[32679]: pgmap v21640: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39915.096809 secs 2024-04-27T05:23:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39915.096809 secs 2024-04-27T05:23:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39915.096809 secs 2024-04-27T05:23:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:40 smithi189 ceph-mon[32756]: pgmap v21641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39218.059692 secs 2024-04-27T05:23:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:40 smithi156 ceph-mon[32679]: pgmap v21641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39218.059692 secs 2024-04-27T05:23:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:40 smithi092 ceph-mon[29156]: pgmap v21641: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39218.059692 secs 2024-04-27T05:23:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:42 smithi189 ceph-mon[32756]: pgmap v21642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:42 smithi156 ceph-mon[32679]: pgmap v21642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:42 smithi092 ceph-mon[29156]: pgmap v21642: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:23:44.796 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:44 smithi092 ceph-mon[29156]: pgmap v21643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:23:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:44 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 39920.096954 secs 2024-04-27T05:23:44.797 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:44 smithi092 ceph-mon[29156]: slow request 2883.243438 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:23:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:44 smithi189 ceph-mon[32756]: pgmap v21643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:23:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:44 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 39920.096954 secs 2024-04-27T05:23:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:44 smithi189 ceph-mon[32756]: slow request 2883.243438 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:23:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:44 smithi156 ceph-mon[32679]: pgmap v21643: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:23:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:44 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 39920.096954 secs 2024-04-27T05:23:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:44 smithi156 ceph-mon[32679]: slow request 2883.243438 seconds old, received at 2024-04-27T04:35:40.769258+0000: client_request(client.17541:1 getattr pAsLsXsFs #0x1 2024-04-27T04:35:40.765015+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:23:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39223.059753 secs 2024-04-27T05:23:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39223.059753 secs 2024-04-27T05:23:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39223.059753 secs 2024-04-27T05:23:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:46 smithi189 ceph-mon[32756]: pgmap v21644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:46 smithi156 ceph-mon[32679]: pgmap v21644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:46 smithi092 ceph-mon[29156]: pgmap v21644: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:48 smithi189 ceph-mon[32756]: pgmap v21645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:48 smithi156 ceph-mon[32679]: pgmap v21645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:48 smithi092 ceph-mon[29156]: pgmap v21645: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39925.097048 secs 2024-04-27T05:23:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39925.097048 secs 2024-04-27T05:23:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39925.097048 secs 2024-04-27T05:23:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:50 smithi189 ceph-mon[32756]: pgmap v21646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39228.059835 secs 2024-04-27T05:23:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:50 smithi156 ceph-mon[32679]: pgmap v21646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39228.059835 secs 2024-04-27T05:23:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:50 smithi092 ceph-mon[29156]: pgmap v21646: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39228.059835 secs 2024-04-27T05:23:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:52 smithi189 ceph-mon[32756]: pgmap v21647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:52 smithi156 ceph-mon[32679]: pgmap v21647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:52 smithi092 ceph-mon[29156]: pgmap v21647: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:54 smithi189 ceph-mon[32756]: pgmap v21648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39930.097159 secs 2024-04-27T05:23:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:54 smithi156 ceph-mon[32679]: pgmap v21648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39930.097159 secs 2024-04-27T05:23:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:54 smithi092 ceph-mon[29156]: pgmap v21648: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39930.097159 secs 2024-04-27T05:23:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39233.059896 secs 2024-04-27T05:23:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39233.059896 secs 2024-04-27T05:23:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39233.059896 secs 2024-04-27T05:23:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:56 smithi189 ceph-mon[32756]: pgmap v21649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:56 smithi156 ceph-mon[32679]: pgmap v21649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:56 smithi092 ceph-mon[29156]: pgmap v21649: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:23:58.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:58 smithi189 ceph-mon[32756]: pgmap v21650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:58 smithi156 ceph-mon[32679]: pgmap v21650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:58 smithi092 ceph-mon[29156]: pgmap v21650: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:23:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:23:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39935.097281 secs 2024-04-27T05:23:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:23:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39935.097281 secs 2024-04-27T05:23:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:23:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39935.097281 secs 2024-04-27T05:24:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:00 smithi189 ceph-mon[32756]: pgmap v21651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39238.060009 secs 2024-04-27T05:24:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:00 smithi156 ceph-mon[32679]: pgmap v21651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39238.060009 secs 2024-04-27T05:24:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:00 smithi092 ceph-mon[29156]: pgmap v21651: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39238.060009 secs 2024-04-27T05:24:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:02 smithi189 ceph-mon[32756]: pgmap v21652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:02 smithi156 ceph-mon[32679]: pgmap v21652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:02 smithi092 ceph-mon[29156]: pgmap v21652: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:04 smithi189 ceph-mon[32756]: pgmap v21653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39940.097403 secs 2024-04-27T05:24:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:04 smithi156 ceph-mon[32679]: pgmap v21653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39940.097403 secs 2024-04-27T05:24:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:04 smithi092 ceph-mon[29156]: pgmap v21653: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39940.097403 secs 2024-04-27T05:24:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39243.060145 secs 2024-04-27T05:24:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39243.060145 secs 2024-04-27T05:24:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39243.060145 secs 2024-04-27T05:24:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:06 smithi189 ceph-mon[32756]: pgmap v21654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:06 smithi156 ceph-mon[32679]: pgmap v21654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:06 smithi092 ceph-mon[29156]: pgmap v21654: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:08 smithi189 ceph-mon[32756]: pgmap v21655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:08 smithi156 ceph-mon[32679]: pgmap v21655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:08 smithi092 ceph-mon[29156]: pgmap v21655: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39945.097492 secs 2024-04-27T05:24:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39945.097492 secs 2024-04-27T05:24:09.997 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39945.097492 secs 2024-04-27T05:24:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:10 smithi189 ceph-mon[32756]: pgmap v21656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39248.060215 secs 2024-04-27T05:24:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:10 smithi156 ceph-mon[32679]: pgmap v21656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39248.060215 secs 2024-04-27T05:24:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:10 smithi092 ceph-mon[29156]: pgmap v21656: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39248.060215 secs 2024-04-27T05:24:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:12 smithi189 ceph-mon[32756]: pgmap v21657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:12 smithi156 ceph-mon[32679]: pgmap v21657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:12 smithi092 ceph-mon[29156]: pgmap v21657: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:14 smithi189 ceph-mon[32756]: pgmap v21658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39950.097613 secs 2024-04-27T05:24:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:14 smithi156 ceph-mon[32679]: pgmap v21658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39950.097613 secs 2024-04-27T05:24:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:14 smithi092 ceph-mon[29156]: pgmap v21658: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:24:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39950.097613 secs 2024-04-27T05:24:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:15 smithi189 ceph-mon[32756]: 33 slow requests, 1 included below; oldest blocked for > 39253.060274 secs 2024-04-27T05:24:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:15 smithi189 ceph-mon[32756]: slow request 362.783287 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:24:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:15 smithi156 ceph-mon[32679]: 33 slow requests, 1 included below; oldest blocked for > 39253.060274 secs 2024-04-27T05:24:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:15 smithi156 ceph-mon[32679]: slow request 362.783287 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:24:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:15 smithi092 ceph-mon[29156]: 33 slow requests, 1 included below; oldest blocked for > 39253.060274 secs 2024-04-27T05:24:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:15 smithi092 ceph-mon[29156]: slow request 362.783287 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:24:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:16 smithi189 ceph-mon[32756]: pgmap v21659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:16 smithi156 ceph-mon[32679]: pgmap v21659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:16 smithi092 ceph-mon[29156]: pgmap v21659: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:24:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:18 smithi189 ceph-mon[32756]: pgmap v21660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:18 smithi156 ceph-mon[32679]: pgmap v21660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:18 smithi092 ceph-mon[29156]: pgmap v21660: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39955.097748 secs 2024-04-27T05:24:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39955.097748 secs 2024-04-27T05:24:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39955.097748 secs 2024-04-27T05:24:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:20 smithi189 ceph-mon[32756]: pgmap v21661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39258.060365 secs 2024-04-27T05:24:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:20 smithi156 ceph-mon[32679]: pgmap v21661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39258.060365 secs 2024-04-27T05:24:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:20 smithi092 ceph-mon[29156]: pgmap v21661: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39258.060365 secs 2024-04-27T05:24:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:22 smithi189 ceph-mon[32756]: pgmap v21662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:22 smithi156 ceph-mon[32679]: pgmap v21662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:22 smithi092 ceph-mon[29156]: pgmap v21662: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:24 smithi189 ceph-mon[32756]: pgmap v21663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:24.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39960.097894 secs 2024-04-27T05:24:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:24 smithi156 ceph-mon[32679]: pgmap v21663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39960.097894 secs 2024-04-27T05:24:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:24 smithi092 ceph-mon[29156]: pgmap v21663: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39960.097894 secs 2024-04-27T05:24:25.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39263.060445 secs 2024-04-27T05:24:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39263.060445 secs 2024-04-27T05:24:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39263.060445 secs 2024-04-27T05:24:26.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:26 smithi189 ceph-mon[32756]: pgmap v21664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:26 smithi156 ceph-mon[32679]: pgmap v21664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:26 smithi092 ceph-mon[29156]: pgmap v21664: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:28.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:28 smithi189 ceph-mon[32756]: pgmap v21665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:28 smithi156 ceph-mon[32679]: pgmap v21665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:28 smithi092 ceph-mon[29156]: pgmap v21665: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:29.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39965.098011 secs 2024-04-27T05:24:29.896 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39965.098011 secs 2024-04-27T05:24:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39965.098011 secs 2024-04-27T05:24:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:30 smithi189 ceph-mon[32756]: pgmap v21666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:30.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39268.060529 secs 2024-04-27T05:24:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:30 smithi156 ceph-mon[32679]: pgmap v21666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39268.060529 secs 2024-04-27T05:24:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:30 smithi092 ceph-mon[29156]: pgmap v21666: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39268.060529 secs 2024-04-27T05:24:32.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:32 smithi189 ceph-mon[32756]: pgmap v21667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:32 smithi156 ceph-mon[32679]: pgmap v21667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:32 smithi092 ceph-mon[29156]: pgmap v21667: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:33.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:33 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:24:33.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:33 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:24:33.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:33 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:24:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: pgmap v21668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39970.098105 secs 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: pgmap v21668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.936 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39970.098105 secs 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: pgmap v21668: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39970.098105 secs 2024-04-27T05:24:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39273.060594 secs 2024-04-27T05:24:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39273.060594 secs 2024-04-27T05:24:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39273.060594 secs 2024-04-27T05:24:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: pgmap v21669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:24:37.141 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: pgmap v21669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:24:37.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:24:37.187 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: pgmap v21669: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:24:37.247 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:24:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:24:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:24:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:24:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:24:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: pgmap v21670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:38.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:37 smithi189 ceph-mon[32756]: pgmap v21671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: pgmap v21670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:37 smithi156 ceph-mon[32679]: pgmap v21671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:24:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:24:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: pgmap v21670: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:37 smithi092 ceph-mon[29156]: pgmap v21671: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:39 smithi092 ceph-mon[29156]: pgmap v21672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:39.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39975.098242 secs 2024-04-27T05:24:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:39 smithi189 ceph-mon[32756]: pgmap v21672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39975.098242 secs 2024-04-27T05:24:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:39 smithi156 ceph-mon[32679]: pgmap v21672: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:39.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39975.098242 secs 2024-04-27T05:24:40.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39278.060652 secs 2024-04-27T05:24:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39278.060652 secs 2024-04-27T05:24:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39278.060652 secs 2024-04-27T05:24:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:24:41.468+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:24:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:24:41.468+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:24:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:24:41.468+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:24:41.471 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:24:41.469+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 307 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:24:41.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:41 smithi092 ceph-mon[29156]: pgmap v21673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:41.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:41 smithi189 ceph-mon[32756]: pgmap v21673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:41.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:41 smithi156 ceph-mon[32679]: pgmap v21673: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:43 smithi189 ceph-mon[32756]: pgmap v21674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:43 smithi156 ceph-mon[32679]: pgmap v21674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:43 smithi092 ceph-mon[29156]: pgmap v21674: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:44.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39980.098357 secs 2024-04-27T05:24:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39980.098357 secs 2024-04-27T05:24:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39980.098357 secs 2024-04-27T05:24:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39283.060732 secs 2024-04-27T05:24:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:45 smithi189 ceph-mon[32756]: pgmap v21675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39283.060732 secs 2024-04-27T05:24:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:45 smithi156 ceph-mon[32679]: pgmap v21675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39283.060732 secs 2024-04-27T05:24:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:45 smithi092 ceph-mon[29156]: pgmap v21675: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:24:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:47 smithi189 ceph-mon[32756]: pgmap v21676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:24:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:47 smithi156 ceph-mon[32679]: pgmap v21676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:24:48.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:47 smithi092 ceph-mon[29156]: pgmap v21676: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:24:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:49 smithi189 ceph-mon[32756]: pgmap v21677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:50.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39985.098477 secs 2024-04-27T05:24:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:49 smithi156 ceph-mon[32679]: pgmap v21677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39985.098477 secs 2024-04-27T05:24:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:49 smithi092 ceph-mon[29156]: pgmap v21677: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39985.098477 secs 2024-04-27T05:24:51.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39288.060801 secs 2024-04-27T05:24:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39288.060801 secs 2024-04-27T05:24:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39288.060801 secs 2024-04-27T05:24:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:51 smithi189 ceph-mon[32756]: pgmap v21678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:51 smithi156 ceph-mon[32679]: pgmap v21678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:52.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:51 smithi092 ceph-mon[29156]: pgmap v21678: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:53 smithi189 ceph-mon[32756]: pgmap v21679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:53 smithi156 ceph-mon[32679]: pgmap v21679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:54.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:53 smithi092 ceph-mon[29156]: pgmap v21679: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39990.098622 secs 2024-04-27T05:24:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39990.098622 secs 2024-04-27T05:24:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39990.098622 secs 2024-04-27T05:24:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39293.060862 secs 2024-04-27T05:24:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:55 smithi092 ceph-mon[29156]: pgmap v21680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39293.060862 secs 2024-04-27T05:24:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:55 smithi189 ceph-mon[32756]: pgmap v21680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39293.060862 secs 2024-04-27T05:24:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:55 smithi156 ceph-mon[32679]: pgmap v21680: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:24:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:57 smithi189 ceph-mon[32756]: pgmap v21681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:57 smithi156 ceph-mon[32679]: pgmap v21681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:24:58.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:57 smithi092 ceph-mon[29156]: pgmap v21681: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:59 smithi189 ceph-mon[32756]: pgmap v21682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:24:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 39995.098740 secs 2024-04-27T05:25:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:59 smithi156 ceph-mon[32679]: pgmap v21682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:24:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 39995.098740 secs 2024-04-27T05:25:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:59 smithi092 ceph-mon[29156]: pgmap v21682: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:24:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 39995.098740 secs 2024-04-27T05:25:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39298.060998 secs 2024-04-27T05:25:01.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39298.060998 secs 2024-04-27T05:25:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39298.060998 secs 2024-04-27T05:25:02.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:01 smithi156 ceph-mon[32679]: pgmap v21683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:01 smithi189 ceph-mon[32756]: pgmap v21683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:02.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:01 smithi092 ceph-mon[29156]: pgmap v21683: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:03 smithi189 ceph-mon[32756]: pgmap v21684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:03 smithi156 ceph-mon[32679]: pgmap v21684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:03 smithi092 ceph-mon[29156]: pgmap v21684: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40000.098893 secs 2024-04-27T05:25:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40000.098893 secs 2024-04-27T05:25:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40000.098893 secs 2024-04-27T05:25:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39303.061036 secs 2024-04-27T05:25:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:05 smithi189 ceph-mon[32756]: pgmap v21685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39303.061036 secs 2024-04-27T05:25:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:05 smithi156 ceph-mon[32679]: pgmap v21685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39303.061036 secs 2024-04-27T05:25:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:05 smithi092 ceph-mon[29156]: pgmap v21685: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:07 smithi189 ceph-mon[32756]: pgmap v21686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:07 smithi156 ceph-mon[32679]: pgmap v21686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:07 smithi092 ceph-mon[29156]: pgmap v21686: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:09 smithi189 ceph-mon[32756]: pgmap v21687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:10.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:09 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40005.099045 secs 2024-04-27T05:25:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:09 smithi156 ceph-mon[32679]: pgmap v21687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:09 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40005.099045 secs 2024-04-27T05:25:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:09 smithi092 ceph-mon[29156]: pgmap v21687: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:09 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40005.099045 secs 2024-04-27T05:25:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39308.061097 secs 2024-04-27T05:25:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39308.061097 secs 2024-04-27T05:25:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39308.061097 secs 2024-04-27T05:25:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:11 smithi189 ceph-mon[32756]: pgmap v21688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:11 smithi156 ceph-mon[32679]: pgmap v21688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:11 smithi092 ceph-mon[29156]: pgmap v21688: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:13 smithi189 ceph-mon[32756]: pgmap v21689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:13 smithi156 ceph-mon[32679]: pgmap v21689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:13 smithi092 ceph-mon[29156]: pgmap v21689: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:14 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40010.099175 secs 2024-04-27T05:25:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:14 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40010.099175 secs 2024-04-27T05:25:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:14 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40010.099175 secs 2024-04-27T05:25:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:15 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39313.061158 secs 2024-04-27T05:25:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:15 smithi189 ceph-mon[32756]: pgmap v21690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:15 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39313.061158 secs 2024-04-27T05:25:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:15 smithi156 ceph-mon[32679]: pgmap v21690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:15 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39313.061158 secs 2024-04-27T05:25:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:15 smithi092 ceph-mon[29156]: pgmap v21690: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:17 smithi189 ceph-mon[32756]: pgmap v21691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:17 smithi156 ceph-mon[32679]: pgmap v21691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:17 smithi092 ceph-mon[29156]: pgmap v21691: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:19 smithi189 ceph-mon[32756]: pgmap v21692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:19 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40015.099317 secs 2024-04-27T05:25:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:19 smithi156 ceph-mon[32679]: pgmap v21692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:19 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40015.099317 secs 2024-04-27T05:25:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:19 smithi092 ceph-mon[29156]: pgmap v21692: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:19 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40015.099317 secs 2024-04-27T05:25:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39318.061240 secs 2024-04-27T05:25:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39318.061240 secs 2024-04-27T05:25:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39318.061240 secs 2024-04-27T05:25:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:21 smithi189 ceph-mon[32756]: pgmap v21693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:21 smithi156 ceph-mon[32679]: pgmap v21693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:21 smithi092 ceph-mon[29156]: pgmap v21693: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:23 smithi189 ceph-mon[32756]: pgmap v21694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:23 smithi156 ceph-mon[32679]: pgmap v21694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:23 smithi092 ceph-mon[29156]: pgmap v21694: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:24 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40020.099450 secs 2024-04-27T05:25:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:24 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40020.099450 secs 2024-04-27T05:25:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:24 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40020.099450 secs 2024-04-27T05:25:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39323.061325 secs 2024-04-27T05:25:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:25 smithi189 ceph-mon[32756]: pgmap v21695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39323.061325 secs 2024-04-27T05:25:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:25 smithi156 ceph-mon[32679]: pgmap v21695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39323.061325 secs 2024-04-27T05:25:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:25 smithi092 ceph-mon[29156]: pgmap v21695: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:27 smithi189 ceph-mon[32756]: pgmap v21696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:27 smithi156 ceph-mon[32679]: pgmap v21696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:27 smithi092 ceph-mon[29156]: pgmap v21696: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:29 smithi189 ceph-mon[32756]: pgmap v21697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:29 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40025.099584 secs 2024-04-27T05:25:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:29 smithi156 ceph-mon[32679]: pgmap v21697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:29 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40025.099584 secs 2024-04-27T05:25:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:29 smithi092 ceph-mon[29156]: pgmap v21697: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:29 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40025.099584 secs 2024-04-27T05:25:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39328.061454 secs 2024-04-27T05:25:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39328.061454 secs 2024-04-27T05:25:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39328.061454 secs 2024-04-27T05:25:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:31 smithi189 ceph-mon[32756]: pgmap v21698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:31 smithi156 ceph-mon[32679]: pgmap v21698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:31 smithi092 ceph-mon[29156]: pgmap v21698: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:33 smithi189 ceph-mon[32756]: pgmap v21699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:33 smithi156 ceph-mon[32679]: pgmap v21699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:33 smithi092 ceph-mon[29156]: pgmap v21699: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:34 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40030.099734 secs 2024-04-27T05:25:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:34 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40030.099734 secs 2024-04-27T05:25:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:34 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40030.099734 secs 2024-04-27T05:25:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39333.061531 secs 2024-04-27T05:25:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:35 smithi156 ceph-mon[32679]: pgmap v21700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39333.061531 secs 2024-04-27T05:25:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:35 smithi092 ceph-mon[29156]: pgmap v21700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39333.061531 secs 2024-04-27T05:25:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:35 smithi189 ceph-mon[32756]: pgmap v21700: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:37.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:36 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:25:37.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:36 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:25:37.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:36 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:25:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:37 smithi156 ceph-mon[32679]: pgmap v21701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:25:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:25:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:25:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:37 smithi092 ceph-mon[29156]: pgmap v21701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:25:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:25:38.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:25:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:37 smithi189 ceph-mon[32756]: pgmap v21701: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:25:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:25:38.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:25:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:38 smithi156 ceph-mon[32679]: pgmap v21702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:25:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:38 smithi156 ceph-mon[32679]: pgmap v21703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:38 smithi092 ceph-mon[29156]: pgmap v21702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:25:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:38 smithi092 ceph-mon[29156]: pgmap v21703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:38 smithi189 ceph-mon[32756]: pgmap v21702: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:25:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:38 smithi189 ceph-mon[32756]: pgmap v21703: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:39 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40035.099853 secs 2024-04-27T05:25:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:39 smithi156 ceph-mon[32679]: pgmap v21704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:39 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40035.099853 secs 2024-04-27T05:25:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:39 smithi092 ceph-mon[29156]: pgmap v21704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:39 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40035.099853 secs 2024-04-27T05:25:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:39 smithi189 ceph-mon[32756]: pgmap v21704: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39338.061652 secs 2024-04-27T05:25:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39338.061652 secs 2024-04-27T05:25:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39338.061652 secs 2024-04-27T05:25:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:41 smithi156 ceph-mon[32679]: pgmap v21705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:41 smithi092 ceph-mon[29156]: pgmap v21705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:41 smithi189 ceph-mon[32756]: pgmap v21705: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:44 smithi189 ceph-mon[32756]: pgmap v21706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:44 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40040.099955 secs 2024-04-27T05:25:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:44 smithi156 ceph-mon[32679]: pgmap v21706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:44.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:44 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40040.099955 secs 2024-04-27T05:25:44.948 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:44 smithi092 ceph-mon[29156]: pgmap v21706: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:25:44.948 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:44 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40040.099955 secs 2024-04-27T05:25:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39343.061725 secs 2024-04-27T05:25:45.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39343.061725 secs 2024-04-27T05:25:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39343.061725 secs 2024-04-27T05:25:46.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:46 smithi189 ceph-mon[32756]: pgmap v21707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:46.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:46 smithi156 ceph-mon[32679]: pgmap v21707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:46.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:46 smithi092 ceph-mon[29156]: pgmap v21707: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:25:48.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:48 smithi189 ceph-mon[32756]: pgmap v21708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:25:48.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:48 smithi156 ceph-mon[32679]: pgmap v21708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:25:48.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:48 smithi092 ceph-mon[29156]: pgmap v21708: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:25:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:49 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40045.100088 secs 2024-04-27T05:25:49.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:49 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40045.100088 secs 2024-04-27T05:25:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:49 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40045.100088 secs 2024-04-27T05:25:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39348.061804 secs 2024-04-27T05:25:50.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:50 smithi189 ceph-mon[32756]: pgmap v21709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39348.061804 secs 2024-04-27T05:25:50.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:50 smithi156 ceph-mon[32679]: pgmap v21709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39348.061804 secs 2024-04-27T05:25:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:50 smithi092 ceph-mon[29156]: pgmap v21709: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:52.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:52 smithi189 ceph-mon[32756]: pgmap v21710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:52.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:52 smithi156 ceph-mon[32679]: pgmap v21710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:52.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:52 smithi092 ceph-mon[29156]: pgmap v21710: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:54 smithi189 ceph-mon[32756]: pgmap v21711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:54.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:54 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40050.100215 secs 2024-04-27T05:25:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:54 smithi156 ceph-mon[32679]: pgmap v21711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:54.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:54 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40050.100215 secs 2024-04-27T05:25:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:54 smithi092 ceph-mon[29156]: pgmap v21711: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:54 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40050.100215 secs 2024-04-27T05:25:55.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39353.061936 secs 2024-04-27T05:25:55.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39353.061936 secs 2024-04-27T05:25:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39353.061936 secs 2024-04-27T05:25:56.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:56 smithi189 ceph-mon[32756]: pgmap v21712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:56.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:56 smithi156 ceph-mon[32679]: pgmap v21712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:56.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:56 smithi092 ceph-mon[29156]: pgmap v21712: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:25:58.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:58 smithi189 ceph-mon[32756]: pgmap v21713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:58.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:58 smithi156 ceph-mon[32679]: pgmap v21713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:58.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:58 smithi092 ceph-mon[29156]: pgmap v21713: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:25:59.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:25:59 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40055.100342 secs 2024-04-27T05:25:59.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:25:59 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40055.100342 secs 2024-04-27T05:25:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:25:59 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40055.100342 secs 2024-04-27T05:26:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39358.062061 secs 2024-04-27T05:26:00.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:00 smithi189 ceph-mon[32756]: pgmap v21714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39358.062061 secs 2024-04-27T05:26:00.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:00 smithi156 ceph-mon[32679]: pgmap v21714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39358.062061 secs 2024-04-27T05:26:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:00 smithi092 ceph-mon[29156]: pgmap v21714: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:02.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:02 smithi189 ceph-mon[32756]: pgmap v21715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:02.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:02 smithi156 ceph-mon[32679]: pgmap v21715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:02.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:02 smithi092 ceph-mon[29156]: pgmap v21715: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:04 smithi189 ceph-mon[32756]: pgmap v21716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:04.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:04 smithi189 ceph-mon[32756]: 17 slow requests, 0 included below; oldest blocked for > 40060.100468 secs 2024-04-27T05:26:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:04 smithi156 ceph-mon[32679]: pgmap v21716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:04.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:04 smithi156 ceph-mon[32679]: 17 slow requests, 0 included below; oldest blocked for > 40060.100468 secs 2024-04-27T05:26:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:04 smithi092 ceph-mon[29156]: pgmap v21716: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:04 smithi092 ceph-mon[29156]: 17 slow requests, 0 included below; oldest blocked for > 40060.100468 secs 2024-04-27T05:26:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39363.062179 secs 2024-04-27T05:26:05.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39363.062179 secs 2024-04-27T05:26:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39363.062179 secs 2024-04-27T05:26:06.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:06 smithi189 ceph-mon[32756]: pgmap v21717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:06.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:06 smithi156 ceph-mon[32679]: pgmap v21717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:06.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:06 smithi092 ceph-mon[29156]: pgmap v21717: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:08.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:08 smithi189 ceph-mon[32756]: pgmap v21718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:08.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:08 smithi156 ceph-mon[32679]: pgmap v21718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:08.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:08 smithi092 ceph-mon[29156]: pgmap v21718: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:09 smithi189 ceph-mon[32756]: 17 slow requests, 1 included below; oldest blocked for > 40065.100579 secs 2024-04-27T05:26:09.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:09 smithi189 ceph-mon[32756]: slow request 11520.557660 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:26:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:09 smithi156 ceph-mon[32679]: 17 slow requests, 1 included below; oldest blocked for > 40065.100579 secs 2024-04-27T05:26:09.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:09 smithi156 ceph-mon[32679]: slow request 11520.557660 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:26:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:09 smithi092 ceph-mon[29156]: 17 slow requests, 1 included below; oldest blocked for > 40065.100579 secs 2024-04-27T05:26:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:09 smithi092 ceph-mon[29156]: slow request 11520.557660 seconds old, received at 2024-04-27T02:14:08.458660+0000: client_request(client.17379:1 getattr pAsLsXsFs #0x1 2024-04-27T02:14:08.454909+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:26:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39368.062286 secs 2024-04-27T05:26:10.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:10 smithi189 ceph-mon[32756]: pgmap v21719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39368.062286 secs 2024-04-27T05:26:10.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:10 smithi156 ceph-mon[32679]: pgmap v21719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39368.062286 secs 2024-04-27T05:26:10.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:10 smithi092 ceph-mon[29156]: pgmap v21719: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:12.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:12 smithi189 ceph-mon[32756]: pgmap v21720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:12.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:12 smithi156 ceph-mon[32679]: pgmap v21720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:12.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:12 smithi092 ceph-mon[29156]: pgmap v21720: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:14 smithi189 ceph-mon[32756]: pgmap v21721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:14 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 40070.100693 secs 2024-04-27T05:26:14.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:14 smithi189 ceph-mon[32756]: slow request 182.485103 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:26:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:14 smithi156 ceph-mon[32679]: pgmap v21721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:14 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 40070.100693 secs 2024-04-27T05:26:14.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:14 smithi156 ceph-mon[32679]: slow request 182.485103 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:26:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:14 smithi092 ceph-mon[29156]: pgmap v21721: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:14 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 40070.100693 secs 2024-04-27T05:26:14.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:14 smithi092 ceph-mon[29156]: slow request 182.485103 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:26:15.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:15 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39373.062371 secs 2024-04-27T05:26:15.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:15 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39373.062371 secs 2024-04-27T05:26:15.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:15 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39373.062371 secs 2024-04-27T05:26:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:16 smithi189 ceph-mon[32756]: pgmap v21722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:16 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:26:16.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:16 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:26:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:16 smithi156 ceph-mon[32679]: pgmap v21722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:16 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:26:16.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:16 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:26:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:16 smithi092 ceph-mon[29156]: pgmap v21722: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:16 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] up:active 2024-04-27T05:26:16.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:16 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:26:18.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:18 smithi189 ceph-mon[32756]: pgmap v21723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:18.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:18 smithi156 ceph-mon[32679]: pgmap v21723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:18.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:18 smithi092 ceph-mon[29156]: pgmap v21723: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:19.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40075.100814 secs 2024-04-27T05:26:19.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40075.100814 secs 2024-04-27T05:26:19.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40075.100814 secs 2024-04-27T05:26:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39378.062490 secs 2024-04-27T05:26:20.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:20 smithi189 ceph-mon[32756]: pgmap v21724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39378.062490 secs 2024-04-27T05:26:20.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:20 smithi156 ceph-mon[32679]: pgmap v21724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39378.062490 secs 2024-04-27T05:26:20.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:20 smithi092 ceph-mon[29156]: pgmap v21724: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:22.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:22 smithi189 ceph-mon[32756]: pgmap v21725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:22.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:22 smithi156 ceph-mon[32679]: pgmap v21725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:22.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:22 smithi092 ceph-mon[29156]: pgmap v21725: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:24 smithi156 ceph-mon[32679]: pgmap v21726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:24.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40080.100932 secs 2024-04-27T05:26:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:24 smithi092 ceph-mon[29156]: pgmap v21726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:24.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40080.100932 secs 2024-04-27T05:26:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:24 smithi189 ceph-mon[32756]: pgmap v21726: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40080.100932 secs 2024-04-27T05:26:25.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39383.062553 secs 2024-04-27T05:26:25.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39383.062553 secs 2024-04-27T05:26:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39383.062553 secs 2024-04-27T05:26:26.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:26 smithi156 ceph-mon[32679]: pgmap v21727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:26.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:26 smithi092 ceph-mon[29156]: pgmap v21727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:27.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:26 smithi189 ceph-mon[32756]: pgmap v21727: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:28.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:28 smithi156 ceph-mon[32679]: pgmap v21728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:28.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:28 smithi092 ceph-mon[29156]: pgmap v21728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:29.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:28 smithi189 ceph-mon[32756]: pgmap v21728: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:29.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40085.101058 secs 2024-04-27T05:26:29.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40085.101058 secs 2024-04-27T05:26:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40085.101058 secs 2024-04-27T05:26:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39388.062615 secs 2024-04-27T05:26:30.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:30 smithi156 ceph-mon[32679]: pgmap v21729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39388.062615 secs 2024-04-27T05:26:30.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:30 smithi092 ceph-mon[29156]: pgmap v21729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39388.062615 secs 2024-04-27T05:26:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:30 smithi189 ceph-mon[32756]: pgmap v21729: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:32.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:32 smithi156 ceph-mon[32679]: pgmap v21730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:32.941 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:32 smithi189 ceph-mon[32756]: pgmap v21730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:32.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:32 smithi092 ceph-mon[29156]: pgmap v21730: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:34 smithi156 ceph-mon[32679]: pgmap v21731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40090.101139 secs 2024-04-27T05:26:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:34 smithi092 ceph-mon[29156]: pgmap v21731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:34.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40090.101139 secs 2024-04-27T05:26:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:34 smithi189 ceph-mon[32756]: pgmap v21731: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40090.101139 secs 2024-04-27T05:26:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39393.062748 secs 2024-04-27T05:26:35.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39393.062748 secs 2024-04-27T05:26:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39393.062748 secs 2024-04-27T05:26:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:36 smithi156 ceph-mon[32679]: pgmap v21732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:36.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:36 smithi092 ceph-mon[29156]: pgmap v21732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:37.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:36 smithi189 ceph-mon[32756]: pgmap v21732: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:37.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:37 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:26:37.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:37 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:26:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:37 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:26:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:38 smithi092 ceph-mon[29156]: pgmap v21733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:26:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:26:38.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:26:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:38 smithi189 ceph-mon[32756]: pgmap v21733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:26:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:26:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:26:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:38 smithi156 ceph-mon[32679]: pgmap v21733: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:26:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:26:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:26:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:39 smithi092 ceph-mon[29156]: pgmap v21734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:26:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:39 smithi092 ceph-mon[29156]: pgmap v21735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:26:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40095.101217 secs 2024-04-27T05:26:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:39 smithi189 ceph-mon[32756]: pgmap v21734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:26:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:39 smithi189 ceph-mon[32756]: pgmap v21735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:26:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40095.101217 secs 2024-04-27T05:26:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:39 smithi156 ceph-mon[32679]: pgmap v21734: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:26:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:39 smithi156 ceph-mon[32679]: pgmap v21735: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:26:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40095.101217 secs 2024-04-27T05:26:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39398.062854 secs 2024-04-27T05:26:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39398.062854 secs 2024-04-27T05:26:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39398.062854 secs 2024-04-27T05:26:41.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:41 smithi092 ceph-mon[29156]: pgmap v21736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:41 smithi189 ceph-mon[32756]: pgmap v21736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:41 smithi156 ceph-mon[32679]: pgmap v21736: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:43 smithi092 ceph-mon[29156]: pgmap v21737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:44.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:43 smithi189 ceph-mon[32756]: pgmap v21737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:44.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:43 smithi156 ceph-mon[32679]: pgmap v21737: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:44.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40100.101337 secs 2024-04-27T05:26:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40100.101337 secs 2024-04-27T05:26:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40100.101337 secs 2024-04-27T05:26:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39403.062940 secs 2024-04-27T05:26:45.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:45 smithi092 ceph-mon[29156]: pgmap v21738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39403.062940 secs 2024-04-27T05:26:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:45 smithi189 ceph-mon[32756]: pgmap v21738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39403.062940 secs 2024-04-27T05:26:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:45 smithi156 ceph-mon[32679]: pgmap v21738: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:47.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:47 smithi092 ceph-mon[29156]: pgmap v21739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:48.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:47 smithi189 ceph-mon[32756]: pgmap v21739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:48.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:47 smithi156 ceph-mon[32679]: pgmap v21739: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:26:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:49 smithi092 ceph-mon[29156]: pgmap v21740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:26:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40105.101455 secs 2024-04-27T05:26:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:49 smithi189 ceph-mon[32756]: pgmap v21740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:26:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40105.101455 secs 2024-04-27T05:26:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:49 smithi156 ceph-mon[32679]: pgmap v21740: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:26:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40105.101455 secs 2024-04-27T05:26:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39408.063073 secs 2024-04-27T05:26:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39408.063073 secs 2024-04-27T05:26:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39408.063073 secs 2024-04-27T05:26:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:51 smithi092 ceph-mon[29156]: pgmap v21741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:51 smithi189 ceph-mon[32756]: pgmap v21741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:51 smithi156 ceph-mon[32679]: pgmap v21741: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:53 smithi092 ceph-mon[29156]: pgmap v21742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:53 smithi189 ceph-mon[32756]: pgmap v21742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:53 smithi156 ceph-mon[32679]: pgmap v21742: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40110.101576 secs 2024-04-27T05:26:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40110.101576 secs 2024-04-27T05:26:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40110.101576 secs 2024-04-27T05:26:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39413.063198 secs 2024-04-27T05:26:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:55 smithi092 ceph-mon[29156]: pgmap v21743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39413.063198 secs 2024-04-27T05:26:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:55 smithi189 ceph-mon[32756]: pgmap v21743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39413.063198 secs 2024-04-27T05:26:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:55 smithi156 ceph-mon[32679]: pgmap v21743: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:26:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:26:56.487+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:26:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:26:56.487+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:26:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:26:56.487+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:26:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:26:56.487+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 308 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:26:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:57 smithi092 ceph-mon[29156]: pgmap v21744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:57 smithi189 ceph-mon[32756]: pgmap v21744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:57 smithi156 ceph-mon[32679]: pgmap v21744: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:59 smithi092 ceph-mon[29156]: pgmap v21745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:26:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:26:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40115.101690 secs 2024-04-27T05:27:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:59 smithi189 ceph-mon[32756]: pgmap v21745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:26:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40115.101690 secs 2024-04-27T05:27:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:59 smithi156 ceph-mon[32679]: pgmap v21745: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:26:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40115.101690 secs 2024-04-27T05:27:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39418.063346 secs 2024-04-27T05:27:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39418.063346 secs 2024-04-27T05:27:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39418.063346 secs 2024-04-27T05:27:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:01 smithi092 ceph-mon[29156]: pgmap v21746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:02.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:01 smithi189 ceph-mon[32756]: pgmap v21746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:02.085 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:01 smithi156 ceph-mon[32679]: pgmap v21746: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:03 smithi189 ceph-mon[32756]: pgmap v21747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:04.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:03 smithi156 ceph-mon[32679]: pgmap v21747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:04.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:03 smithi092 ceph-mon[29156]: pgmap v21747: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:05.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40120.101845 secs 2024-04-27T05:27:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40120.101845 secs 2024-04-27T05:27:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40120.101845 secs 2024-04-27T05:27:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39423.063484 secs 2024-04-27T05:27:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:05 smithi189 ceph-mon[32756]: pgmap v21748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:06.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39423.063484 secs 2024-04-27T05:27:06.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:05 smithi092 ceph-mon[29156]: pgmap v21748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39423.063484 secs 2024-04-27T05:27:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:05 smithi156 ceph-mon[32679]: pgmap v21748: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:07 smithi189 ceph-mon[32756]: pgmap v21749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:07 smithi156 ceph-mon[32679]: pgmap v21749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:07 smithi092 ceph-mon[29156]: pgmap v21749: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:09 smithi189 ceph-mon[32756]: pgmap v21750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40125.101971 secs 2024-04-27T05:27:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:09 smithi156 ceph-mon[32679]: pgmap v21750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40125.101971 secs 2024-04-27T05:27:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:09 smithi092 ceph-mon[29156]: pgmap v21750: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40125.101971 secs 2024-04-27T05:27:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39428.063598 secs 2024-04-27T05:27:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39428.063598 secs 2024-04-27T05:27:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39428.063598 secs 2024-04-27T05:27:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:11 smithi189 ceph-mon[32756]: pgmap v21751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:11 smithi156 ceph-mon[32679]: pgmap v21751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:11 smithi092 ceph-mon[29156]: pgmap v21751: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:14.047 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:13 smithi092 ceph-mon[29156]: pgmap v21752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:13 smithi189 ceph-mon[32756]: pgmap v21752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:13 smithi156 ceph-mon[32679]: pgmap v21752: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40130.102035 secs 2024-04-27T05:27:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40130.102035 secs 2024-04-27T05:27:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40130.102035 secs 2024-04-27T05:27:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:15 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39433.063711 secs 2024-04-27T05:27:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:15 smithi189 ceph-mon[32756]: pgmap v21753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:15 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39433.063711 secs 2024-04-27T05:27:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:15 smithi156 ceph-mon[32679]: pgmap v21753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:15 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39433.063711 secs 2024-04-27T05:27:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:15 smithi092 ceph-mon[29156]: pgmap v21753: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:17 smithi189 ceph-mon[32756]: pgmap v21754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:17 smithi156 ceph-mon[32679]: pgmap v21754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:17 smithi092 ceph-mon[29156]: pgmap v21754: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:19 smithi189 ceph-mon[32756]: pgmap v21755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40135.102162 secs 2024-04-27T05:27:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:19 smithi156 ceph-mon[32679]: pgmap v21755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40135.102162 secs 2024-04-27T05:27:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:19 smithi092 ceph-mon[29156]: pgmap v21755: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40135.102162 secs 2024-04-27T05:27:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:20 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39438.063842 secs 2024-04-27T05:27:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:20 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39438.063842 secs 2024-04-27T05:27:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:20 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39438.063842 secs 2024-04-27T05:27:21.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:21 smithi092 ceph-mon[29156]: pgmap v21756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:21 smithi189 ceph-mon[32756]: pgmap v21756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:21 smithi156 ceph-mon[32679]: pgmap v21756: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:23 smithi189 ceph-mon[32756]: pgmap v21757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:23 smithi156 ceph-mon[32679]: pgmap v21757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:23 smithi092 ceph-mon[29156]: pgmap v21757: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40140.102316 secs 2024-04-27T05:27:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40140.102316 secs 2024-04-27T05:27:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40140.102316 secs 2024-04-27T05:27:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:25 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39443.063918 secs 2024-04-27T05:27:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:25 smithi189 ceph-mon[32756]: pgmap v21758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:25 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39443.063918 secs 2024-04-27T05:27:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:25 smithi156 ceph-mon[32679]: pgmap v21758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:25 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39443.063918 secs 2024-04-27T05:27:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:25 smithi092 ceph-mon[29156]: pgmap v21758: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:27 smithi189 ceph-mon[32756]: pgmap v21759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:27 smithi156 ceph-mon[32679]: pgmap v21759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:27 smithi092 ceph-mon[29156]: pgmap v21759: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:29 smithi189 ceph-mon[32756]: pgmap v21760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40145.102459 secs 2024-04-27T05:27:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:29 smithi156 ceph-mon[32679]: pgmap v21760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40145.102459 secs 2024-04-27T05:27:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:29 smithi092 ceph-mon[29156]: pgmap v21760: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40145.102459 secs 2024-04-27T05:27:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:30 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39448.064042 secs 2024-04-27T05:27:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:30 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39448.064042 secs 2024-04-27T05:27:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:30 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39448.064042 secs 2024-04-27T05:27:32.086 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:31 smithi156 ceph-mon[32679]: pgmap v21761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:31 smithi189 ceph-mon[32756]: pgmap v21761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:31 smithi092 ceph-mon[29156]: pgmap v21761: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:33 smithi189 ceph-mon[32756]: pgmap v21762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:33 smithi156 ceph-mon[32679]: pgmap v21762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:33 smithi092 ceph-mon[29156]: pgmap v21762: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40150.102583 secs 2024-04-27T05:27:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40150.102583 secs 2024-04-27T05:27:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40150.102583 secs 2024-04-27T05:27:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:35 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39453.064168 secs 2024-04-27T05:27:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:35 smithi189 ceph-mon[32756]: pgmap v21763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:35 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39453.064168 secs 2024-04-27T05:27:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:35 smithi156 ceph-mon[32679]: pgmap v21763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:35 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39453.064168 secs 2024-04-27T05:27:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:35 smithi092 ceph-mon[29156]: pgmap v21763: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:37 smithi189 ceph-mon[32756]: pgmap v21764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:37 smithi156 ceph-mon[32679]: pgmap v21764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:37 smithi092 ceph-mon[29156]: pgmap v21764: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:39.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:38 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:27:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:38 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:27:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:38 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:27:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:39 smithi189 ceph-mon[32756]: pgmap v21765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40155.102718 secs 2024-04-27T05:27:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:27:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:27:40.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:27:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:39 smithi156 ceph-mon[32679]: pgmap v21765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40155.102718 secs 2024-04-27T05:27:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:27:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:27:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:27:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:39 smithi092 ceph-mon[29156]: pgmap v21765: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40155.102718 secs 2024-04-27T05:27:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:27:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:27:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:27:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:40 smithi189 ceph-mon[32756]: pgmap v21766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:27:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:40 smithi189 ceph-mon[32756]: pgmap v21767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:40 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39458.064303 secs 2024-04-27T05:27:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:40 smithi156 ceph-mon[32679]: pgmap v21766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:27:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:40 smithi156 ceph-mon[32679]: pgmap v21767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:40 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39458.064303 secs 2024-04-27T05:27:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:40 smithi092 ceph-mon[29156]: pgmap v21766: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:27:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:40 smithi092 ceph-mon[29156]: pgmap v21767: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:40 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39458.064303 secs 2024-04-27T05:27:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:27:41.493+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:27:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:27:41.493+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:27:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:27:41.493+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:27:41.495 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:27:41.493+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 309 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:27:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:42 smithi189 ceph-mon[32756]: pgmap v21768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:42 smithi156 ceph-mon[32679]: pgmap v21768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:42 smithi092 ceph-mon[29156]: pgmap v21768: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:44 smithi189 ceph-mon[32756]: pgmap v21769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:27:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40160.102855 secs 2024-04-27T05:27:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:44 smithi156 ceph-mon[32679]: pgmap v21769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:27:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40160.102855 secs 2024-04-27T05:27:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:44 smithi092 ceph-mon[29156]: pgmap v21769: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:27:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40160.102855 secs 2024-04-27T05:27:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:45 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39463.064438 secs 2024-04-27T05:27:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:45 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39463.064438 secs 2024-04-27T05:27:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:45 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39463.064438 secs 2024-04-27T05:27:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:46 smithi189 ceph-mon[32756]: pgmap v21770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:46 smithi156 ceph-mon[32679]: pgmap v21770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:46 smithi092 ceph-mon[29156]: pgmap v21770: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:48 smithi189 ceph-mon[32756]: pgmap v21771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:48 smithi156 ceph-mon[32679]: pgmap v21771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:48 smithi092 ceph-mon[29156]: pgmap v21771: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:27:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40165.103015 secs 2024-04-27T05:27:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40165.103015 secs 2024-04-27T05:27:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40165.103015 secs 2024-04-27T05:27:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:50 smithi189 ceph-mon[32756]: pgmap v21772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:27:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:50 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39468.064565 secs 2024-04-27T05:27:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:50 smithi156 ceph-mon[32679]: pgmap v21772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:27:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:50 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39468.064565 secs 2024-04-27T05:27:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:50 smithi092 ceph-mon[29156]: pgmap v21772: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:27:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:50 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39468.064565 secs 2024-04-27T05:27:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:52 smithi189 ceph-mon[32756]: pgmap v21773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:52 smithi156 ceph-mon[32679]: pgmap v21773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:53.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:52 smithi092 ceph-mon[29156]: pgmap v21773: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:54 smithi189 ceph-mon[32756]: pgmap v21774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40170.103136 secs 2024-04-27T05:27:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:54 smithi156 ceph-mon[32679]: pgmap v21774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40170.103136 secs 2024-04-27T05:27:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:54 smithi092 ceph-mon[29156]: pgmap v21774: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40170.103136 secs 2024-04-27T05:27:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:55 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39473.064689 secs 2024-04-27T05:27:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:55 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39473.064689 secs 2024-04-27T05:27:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:55 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39473.064689 secs 2024-04-27T05:27:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:56 smithi156 ceph-mon[32679]: pgmap v21775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:56 smithi092 ceph-mon[29156]: pgmap v21775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:57.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:56 smithi189 ceph-mon[32756]: pgmap v21775: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:27:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:58 smithi156 ceph-mon[32679]: pgmap v21776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:58 smithi092 ceph-mon[29156]: pgmap v21776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:27:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:58 smithi189 ceph-mon[32756]: pgmap v21776: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:27:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40175.103256 secs 2024-04-27T05:28:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:27:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40175.103256 secs 2024-04-27T05:28:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:27:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40175.103256 secs 2024-04-27T05:28:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:00 smithi156 ceph-mon[32679]: pgmap v21777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:00 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39478.064803 secs 2024-04-27T05:28:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:00 smithi092 ceph-mon[29156]: pgmap v21777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:00 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39478.064803 secs 2024-04-27T05:28:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:00 smithi189 ceph-mon[32756]: pgmap v21777: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:00 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39478.064803 secs 2024-04-27T05:28:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:02 smithi156 ceph-mon[32679]: pgmap v21778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:03.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:02 smithi189 ceph-mon[32756]: pgmap v21778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:03.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:02 smithi092 ceph-mon[29156]: pgmap v21778: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:04 smithi156 ceph-mon[32679]: pgmap v21779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40180.103416 secs 2024-04-27T05:28:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:04 smithi092 ceph-mon[29156]: pgmap v21779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40180.103416 secs 2024-04-27T05:28:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:04 smithi189 ceph-mon[32756]: pgmap v21779: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:05.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40180.103416 secs 2024-04-27T05:28:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:05 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39483.064916 secs 2024-04-27T05:28:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:05 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39483.064916 secs 2024-04-27T05:28:06.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:05 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39483.064916 secs 2024-04-27T05:28:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:06 smithi156 ceph-mon[32679]: pgmap v21780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:06 smithi092 ceph-mon[29156]: pgmap v21780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:06 smithi189 ceph-mon[32756]: pgmap v21780: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:08 smithi156 ceph-mon[32679]: pgmap v21781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:09.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:08 smithi092 ceph-mon[29156]: pgmap v21781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:08 smithi189 ceph-mon[32756]: pgmap v21781: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40185.103573 secs 2024-04-27T05:28:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40185.103573 secs 2024-04-27T05:28:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40185.103573 secs 2024-04-27T05:28:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:10 smithi156 ceph-mon[32679]: pgmap v21782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:10 smithi156 ceph-mon[32679]: 33 slow requests, 0 included below; oldest blocked for > 39488.065041 secs 2024-04-27T05:28:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:10 smithi092 ceph-mon[29156]: pgmap v21782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:10 smithi092 ceph-mon[29156]: 33 slow requests, 0 included below; oldest blocked for > 39488.065041 secs 2024-04-27T05:28:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:10 smithi189 ceph-mon[32756]: pgmap v21782: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:10 smithi189 ceph-mon[32756]: 33 slow requests, 0 included below; oldest blocked for > 39488.065041 secs 2024-04-27T05:28:11.937 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:28:11.593+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:28:11.937 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:28:11.593+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:28:11.937 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:28:11.593+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:28:11.937 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:28:11.593+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:28:11.937 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:28:11.593+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:28:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:11 smithi092 ceph-mon[29156]: pgmap v21783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:12.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:11 smithi189 ceph-mon[32756]: pgmap v21783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:12.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:11 smithi156 ceph-mon[32679]: pgmap v21783: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:14.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:14 smithi189 ceph-mon[32756]: pgmap v21784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:14.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:14 smithi156 ceph-mon[32679]: pgmap v21784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:14.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:14 smithi092 ceph-mon[29156]: pgmap v21784: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:15.396 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:15 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40190.103717 secs 2024-04-27T05:28:15.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:15 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40190.103717 secs 2024-04-27T05:28:15.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:15 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40190.103717 secs 2024-04-27T05:28:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:16 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39493.065166 secs 2024-04-27T05:28:16.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:16 smithi156 ceph-mon[32679]: pgmap v21785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:16.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:16 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39493.065166 secs 2024-04-27T05:28:16.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:16 smithi092 ceph-mon[29156]: pgmap v21785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:16 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39493.065166 secs 2024-04-27T05:28:16.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:16 smithi189 ceph-mon[32756]: pgmap v21785: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:18.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:18 smithi156 ceph-mon[32679]: pgmap v21786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:18.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:18 smithi092 ceph-mon[29156]: pgmap v21786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:18.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:18 smithi189 ceph-mon[32756]: pgmap v21786: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:19 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:28:19.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:19 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:28:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:19 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:28:19.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:19 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:28:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:19 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:28:19.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:19 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:28:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:20 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40195.103861 secs 2024-04-27T05:28:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:20 smithi156 ceph-mon[32679]: pgmap v21787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39498.065338 secs 2024-04-27T05:28:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:20 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40195.103861 secs 2024-04-27T05:28:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:20 smithi092 ceph-mon[29156]: pgmap v21787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:20.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39498.065338 secs 2024-04-27T05:28:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:20 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40195.103861 secs 2024-04-27T05:28:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:20 smithi189 ceph-mon[32756]: pgmap v21787: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:20.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39498.065338 secs 2024-04-27T05:28:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:22 smithi156 ceph-mon[32679]: pgmap v21788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:22.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:22 smithi092 ceph-mon[29156]: pgmap v21788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:22.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:22 smithi189 ceph-mon[32756]: pgmap v21788: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:24.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:24 smithi156 ceph-mon[32679]: pgmap v21789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:24.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:24 smithi092 ceph-mon[29156]: pgmap v21789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:24.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:24 smithi189 ceph-mon[32756]: pgmap v21789: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-04-27T05:28:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:25 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40200.103945 secs 2024-04-27T05:28:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39503.065437 secs 2024-04-27T05:28:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:25 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40200.103945 secs 2024-04-27T05:28:25.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39503.065437 secs 2024-04-27T05:28:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:25 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40200.103945 secs 2024-04-27T05:28:25.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39503.065437 secs 2024-04-27T05:28:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:26 smithi156 ceph-mon[32679]: pgmap v21790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:26.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:26 smithi092 ceph-mon[29156]: pgmap v21790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:26.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:26 smithi189 ceph-mon[32756]: pgmap v21790: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-27T05:28:28.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:28 smithi156 ceph-mon[32679]: pgmap v21791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:28.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:28 smithi092 ceph-mon[29156]: pgmap v21791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:28.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:28 smithi189 ceph-mon[32756]: pgmap v21791: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:30 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40205.104063 secs 2024-04-27T05:28:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:30 smithi156 ceph-mon[32679]: pgmap v21792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39508.065556 secs 2024-04-27T05:28:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:30 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40205.104063 secs 2024-04-27T05:28:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:30 smithi092 ceph-mon[29156]: pgmap v21792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:30.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39508.065556 secs 2024-04-27T05:28:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:30 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40205.104063 secs 2024-04-27T05:28:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:30 smithi189 ceph-mon[32756]: pgmap v21792: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:30.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39508.065556 secs 2024-04-27T05:28:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:32 smithi156 ceph-mon[32679]: pgmap v21793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:32.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:32 smithi092 ceph-mon[29156]: pgmap v21793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:32.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:32 smithi189 ceph-mon[32756]: pgmap v21793: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:34 smithi156 ceph-mon[32679]: pgmap v21794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:34.441 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:34 smithi189 ceph-mon[32756]: pgmap v21794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:34.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:34 smithi092 ceph-mon[29156]: pgmap v21794: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:35 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40210.104180 secs 2024-04-27T05:28:35.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39513.065680 secs 2024-04-27T05:28:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:35 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40210.104180 secs 2024-04-27T05:28:35.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39513.065680 secs 2024-04-27T05:28:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:35 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40210.104180 secs 2024-04-27T05:28:35.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39513.065680 secs 2024-04-27T05:28:36.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:36 smithi092 ceph-mon[29156]: pgmap v21795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:36.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:36 smithi189 ceph-mon[32756]: pgmap v21795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:36.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:36 smithi156 ceph-mon[32679]: pgmap v21795: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:38.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:38 smithi092 ceph-mon[29156]: pgmap v21796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:38.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:38 smithi189 ceph-mon[32756]: pgmap v21796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:38.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:38 smithi156 ceph-mon[32679]: pgmap v21796: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:39 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:28:39.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:39 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:28:39.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:39 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40215.104303 secs 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: pgmap v21797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39518.065752 secs 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:28:40.495 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: pgmap v21798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:28:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: pgmap v21799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:40.496 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40215.104303 secs 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: pgmap v21797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39518.065752 secs 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:28:40.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: pgmap v21798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:28:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: pgmap v21799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:40.640 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40215.104303 secs 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: pgmap v21797: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39518.065752 secs 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: pgmap v21798: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: pgmap v21799: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:40.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:28:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:42 smithi156 ceph-mon[32679]: pgmap v21800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:43.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:42 smithi092 ceph-mon[29156]: pgmap v21800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:43.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:42 smithi189 ceph-mon[32756]: pgmap v21800: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:44 smithi156 ceph-mon[32679]: pgmap v21801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40220.104425 secs 2024-04-27T05:28:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:44 smithi092 ceph-mon[29156]: pgmap v21801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40220.104425 secs 2024-04-27T05:28:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:44 smithi189 ceph-mon[32756]: pgmap v21801: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40220.104425 secs 2024-04-27T05:28:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39523.065868 secs 2024-04-27T05:28:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39523.065868 secs 2024-04-27T05:28:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39523.065868 secs 2024-04-27T05:28:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:46 smithi156 ceph-mon[32679]: pgmap v21802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:46 smithi092 ceph-mon[29156]: pgmap v21802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:47.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:46 smithi189 ceph-mon[32756]: pgmap v21802: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:28:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:48 smithi156 ceph-mon[32679]: pgmap v21803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:28:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:48 smithi092 ceph-mon[29156]: pgmap v21803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:28:49.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:48 smithi189 ceph-mon[32756]: pgmap v21803: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:28:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40225.104552 secs 2024-04-27T05:28:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40225.104552 secs 2024-04-27T05:28:50.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40225.104552 secs 2024-04-27T05:28:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39528.065967 secs 2024-04-27T05:28:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:50 smithi156 ceph-mon[32679]: pgmap v21804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:28:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39528.065967 secs 2024-04-27T05:28:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:50 smithi092 ceph-mon[29156]: pgmap v21804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:28:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39528.065967 secs 2024-04-27T05:28:51.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:50 smithi189 ceph-mon[32756]: pgmap v21804: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:28:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:52 smithi156 ceph-mon[32679]: pgmap v21805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:53.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:52 smithi092 ceph-mon[29156]: pgmap v21805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:53.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:52 smithi189 ceph-mon[32756]: pgmap v21805: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:54 smithi156 ceph-mon[32679]: pgmap v21806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40230.104673 secs 2024-04-27T05:28:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:54 smithi092 ceph-mon[29156]: pgmap v21806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40230.104673 secs 2024-04-27T05:28:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:54 smithi189 ceph-mon[32756]: pgmap v21806: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:28:55.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40230.104673 secs 2024-04-27T05:28:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39533.066087 secs 2024-04-27T05:28:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:55 smithi092 ceph-mon[29156]: pgmap v21807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39533.066087 secs 2024-04-27T05:28:56.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:55 smithi189 ceph-mon[32756]: pgmap v21807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:56.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39533.066087 secs 2024-04-27T05:28:56.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:55 smithi156 ceph-mon[32679]: pgmap v21807: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:58 smithi156 ceph-mon[32679]: pgmap v21808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:58 smithi092 ceph-mon[29156]: pgmap v21808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:28:59.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:58 smithi189 ceph-mon[32756]: pgmap v21808: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:28:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40235.104798 secs 2024-04-27T05:29:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:28:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40235.104798 secs 2024-04-27T05:29:00.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:28:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40235.104798 secs 2024-04-27T05:29:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39538.066201 secs 2024-04-27T05:29:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:00 smithi156 ceph-mon[32679]: pgmap v21809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39538.066201 secs 2024-04-27T05:29:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:00 smithi092 ceph-mon[29156]: pgmap v21809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39538.066201 secs 2024-04-27T05:29:01.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:00 smithi189 ceph-mon[32756]: pgmap v21809: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:02 smithi156 ceph-mon[32679]: pgmap v21810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:03.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:02 smithi092 ceph-mon[29156]: pgmap v21810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:03.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:02 smithi189 ceph-mon[32756]: pgmap v21810: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:04 smithi156 ceph-mon[32679]: pgmap v21811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40240.104895 secs 2024-04-27T05:29:05.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:04 smithi189 ceph-mon[32756]: pgmap v21811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:05.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40240.104895 secs 2024-04-27T05:29:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:04 smithi092 ceph-mon[29156]: pgmap v21811: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40240.104895 secs 2024-04-27T05:29:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39543.066324 secs 2024-04-27T05:29:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39543.066324 secs 2024-04-27T05:29:06.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39543.066324 secs 2024-04-27T05:29:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:06 smithi092 ceph-mon[29156]: pgmap v21812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:06 smithi189 ceph-mon[32756]: pgmap v21812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:07.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:06 smithi156 ceph-mon[32679]: pgmap v21812: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:08.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:07 smithi092 ceph-mon[29156]: pgmap v21813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:08.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:07 smithi189 ceph-mon[32756]: pgmap v21813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:08.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:07 smithi156 ceph-mon[32679]: pgmap v21813: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:09.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40245.104964 secs 2024-04-27T05:29:09.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40245.104964 secs 2024-04-27T05:29:09.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40245.104964 secs 2024-04-27T05:29:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39548.066452 secs 2024-04-27T05:29:10.639 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:10 smithi189 ceph-mon[32756]: pgmap v21814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39548.066452 secs 2024-04-27T05:29:10.685 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:10 smithi156 ceph-mon[32679]: pgmap v21814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:10.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39548.066452 secs 2024-04-27T05:29:10.718 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:10 smithi092 ceph-mon[29156]: pgmap v21814: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:12 smithi156 ceph-mon[32679]: pgmap v21815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:13.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:12 smithi092 ceph-mon[29156]: pgmap v21815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:13.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:12 smithi189 ceph-mon[32756]: pgmap v21815: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:14 smithi156 ceph-mon[32679]: pgmap v21816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:14 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 40250.105030 secs 2024-04-27T05:29:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:14 smithi156 ceph-mon[32679]: slow request 362.489440 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:29:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:14 smithi092 ceph-mon[29156]: pgmap v21816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:14 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 40250.105030 secs 2024-04-27T05:29:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:14 smithi092 ceph-mon[29156]: slow request 362.489440 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:14 smithi189 ceph-mon[32756]: pgmap v21816: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:14 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 40250.105030 secs 2024-04-27T05:29:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:14 smithi189 ceph-mon[32756]: slow request 362.489440 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:29:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:15 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39553.066533 secs 2024-04-27T05:29:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:15 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39553.066533 secs 2024-04-27T05:29:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:15 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39553.066533 secs 2024-04-27T05:29:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:16 smithi156 ceph-mon[32679]: pgmap v21817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:16 smithi092 ceph-mon[29156]: pgmap v21817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:17.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:16 smithi189 ceph-mon[32756]: pgmap v21817: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:18 smithi156 ceph-mon[32679]: pgmap v21818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:18 smithi092 ceph-mon[29156]: pgmap v21818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:18 smithi189 ceph-mon[32756]: pgmap v21818: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40255.105151 secs 2024-04-27T05:29:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40255.105151 secs 2024-04-27T05:29:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40255.105151 secs 2024-04-27T05:29:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39558.066669 secs 2024-04-27T05:29:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:20 smithi092 ceph-mon[29156]: pgmap v21819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39558.066669 secs 2024-04-27T05:29:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:20 smithi189 ceph-mon[32756]: pgmap v21819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39558.066669 secs 2024-04-27T05:29:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:20 smithi156 ceph-mon[32679]: pgmap v21819: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:21 smithi092 ceph-mon[29156]: pgmap v21820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:22.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:21 smithi189 ceph-mon[32756]: pgmap v21820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:22.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:21 smithi156 ceph-mon[32679]: pgmap v21820: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:24 smithi156 ceph-mon[32679]: pgmap v21821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40260.105275 secs 2024-04-27T05:29:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:24 smithi092 ceph-mon[29156]: pgmap v21821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40260.105275 secs 2024-04-27T05:29:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:24 smithi189 ceph-mon[32756]: pgmap v21821: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40260.105275 secs 2024-04-27T05:29:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39563.066787 secs 2024-04-27T05:29:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39563.066787 secs 2024-04-27T05:29:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39563.066787 secs 2024-04-27T05:29:27.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:26 smithi156 ceph-mon[32679]: pgmap v21822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:26 smithi092 ceph-mon[29156]: pgmap v21822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:26 smithi189 ceph-mon[32756]: pgmap v21822: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:29.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:28 smithi156 ceph-mon[32679]: pgmap v21823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:28 smithi092 ceph-mon[29156]: pgmap v21823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:28 smithi189 ceph-mon[32756]: pgmap v21823: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40265.105361 secs 2024-04-27T05:29:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40265.105361 secs 2024-04-27T05:29:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40265.105361 secs 2024-04-27T05:29:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39568.066904 secs 2024-04-27T05:29:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:30 smithi092 ceph-mon[29156]: pgmap v21824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39568.066904 secs 2024-04-27T05:29:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:30 smithi189 ceph-mon[32756]: pgmap v21824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:31.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39568.066904 secs 2024-04-27T05:29:31.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:30 smithi156 ceph-mon[32679]: pgmap v21824: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:33.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:32 smithi156 ceph-mon[32679]: pgmap v21825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:33.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:32 smithi092 ceph-mon[29156]: pgmap v21825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:33.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:32 smithi189 ceph-mon[32756]: pgmap v21825: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:33 smithi092 ceph-mon[29156]: pgmap v21826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:34.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:33 smithi189 ceph-mon[32756]: pgmap v21826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:34.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:33 smithi156 ceph-mon[32679]: pgmap v21826: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40270.105464 secs 2024-04-27T05:29:35.290 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40270.105464 secs 2024-04-27T05:29:35.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40270.105464 secs 2024-04-27T05:29:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39573.066997 secs 2024-04-27T05:29:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:35 smithi092 ceph-mon[29156]: pgmap v21827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39573.066997 secs 2024-04-27T05:29:36.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:35 smithi189 ceph-mon[32756]: pgmap v21827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39573.066997 secs 2024-04-27T05:29:36.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:35 smithi156 ceph-mon[32679]: pgmap v21827: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:39.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:38 smithi156 ceph-mon[32679]: pgmap v21828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:39.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:38 smithi092 ceph-mon[29156]: pgmap v21828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:39.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:38 smithi189 ceph-mon[32756]: pgmap v21828: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40275.105528 secs 2024-04-27T05:29:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40275.105528 secs 2024-04-27T05:29:40.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40275.105528 secs 2024-04-27T05:29:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39578.067136 secs 2024-04-27T05:29:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: pgmap v21829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:29:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:29:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:29:41.246 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39578.067136 secs 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: pgmap v21829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:29:41.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39578.067136 secs 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: pgmap v21829: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:29:41.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:29:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:41 smithi092 ceph-mon[29156]: pgmap v21830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:41 smithi092 ceph-mon[29156]: pgmap v21831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:41 smithi189 ceph-mon[32756]: pgmap v21830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:42.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:41 smithi189 ceph-mon[32756]: pgmap v21831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:41 smithi156 ceph-mon[32679]: pgmap v21830: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:42.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:41 smithi156 ceph-mon[32679]: pgmap v21831: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:44.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:43 smithi092 ceph-mon[29156]: pgmap v21832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 B/s rd, 1 op/s 2024-04-27T05:29:44.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:43 smithi189 ceph-mon[32756]: pgmap v21832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 B/s rd, 1 op/s 2024-04-27T05:29:44.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:43 smithi156 ceph-mon[32679]: pgmap v21832: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 934 B/s rd, 1 op/s 2024-04-27T05:29:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40280.105650 secs 2024-04-27T05:29:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:44 smithi092 ceph-mon[29156]: pgmap v21833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:45.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40280.105650 secs 2024-04-27T05:29:45.390 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:44 smithi189 ceph-mon[32756]: pgmap v21833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40280.105650 secs 2024-04-27T05:29:45.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:44 smithi156 ceph-mon[32679]: pgmap v21833: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39583.067253 secs 2024-04-27T05:29:46.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39583.067253 secs 2024-04-27T05:29:46.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39583.067253 secs 2024-04-27T05:29:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:46 smithi092 ceph-mon[29156]: pgmap v21834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:47.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:46 smithi189 ceph-mon[32756]: pgmap v21834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:47.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:46 smithi156 ceph-mon[32679]: pgmap v21834: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:29:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:49 smithi092 ceph-mon[29156]: pgmap v21835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:49.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40285.105779 secs 2024-04-27T05:29:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:49 smithi189 ceph-mon[32756]: pgmap v21835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40285.105779 secs 2024-04-27T05:29:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:49 smithi156 ceph-mon[32679]: pgmap v21835: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:29:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40285.105779 secs 2024-04-27T05:29:50.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39588.067365 secs 2024-04-27T05:29:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39588.067365 secs 2024-04-27T05:29:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39588.067365 secs 2024-04-27T05:29:51.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:51 smithi092 ceph-mon[29156]: pgmap v21836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:29:52.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:51 smithi189 ceph-mon[32756]: pgmap v21836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:29:52.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:51 smithi156 ceph-mon[32679]: pgmap v21836: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:29:53.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:53 smithi092 ceph-mon[29156]: pgmap v21837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:54.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:53 smithi189 ceph-mon[32756]: pgmap v21837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:54.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:53 smithi156 ceph-mon[32679]: pgmap v21837: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:54.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40290.105909 secs 2024-04-27T05:29:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40290.105909 secs 2024-04-27T05:29:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40290.105909 secs 2024-04-27T05:29:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39593.067464 secs 2024-04-27T05:29:55.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:55 smithi092 ceph-mon[29156]: pgmap v21838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39593.067464 secs 2024-04-27T05:29:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:55 smithi189 ceph-mon[32756]: pgmap v21838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39593.067464 secs 2024-04-27T05:29:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:55 smithi156 ceph-mon[32679]: pgmap v21838: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:57.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:57 smithi092 ceph-mon[29156]: pgmap v21839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:58.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:57 smithi189 ceph-mon[32756]: pgmap v21839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:58.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:57 smithi156 ceph-mon[32679]: pgmap v21839: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:29:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:59 smithi092 ceph-mon[29156]: pgmap v21840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:29:59.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:29:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40295.106031 secs 2024-04-27T05:30:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:59 smithi189 ceph-mon[32756]: pgmap v21840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:29:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40295.106031 secs 2024-04-27T05:30:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:59 smithi156 ceph-mon[32679]: pgmap v21840: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:29:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40295.106031 secs 2024-04-27T05:30:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39598.067579 secs 2024-04-27T05:30:00.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:30:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39598.067579 secs 2024-04-27T05:30:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:30:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39598.067579 secs 2024-04-27T05:30:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:30:01.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:01 smithi092 ceph-mon[29156]: pgmap v21841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:02.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:01 smithi189 ceph-mon[32756]: pgmap v21841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:02.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:01 smithi156 ceph-mon[32679]: pgmap v21841: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:03.986 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:03 smithi156 ceph-mon[32679]: pgmap v21842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:03.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:03 smithi092 ceph-mon[29156]: pgmap v21842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:04.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:03 smithi189 ceph-mon[32756]: pgmap v21842: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:04.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40300.106106 secs 2024-04-27T05:30:05.040 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40300.106106 secs 2024-04-27T05:30:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40300.106106 secs 2024-04-27T05:30:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39603.067672 secs 2024-04-27T05:30:05.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:05 smithi092 ceph-mon[29156]: pgmap v21843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39603.067672 secs 2024-04-27T05:30:06.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:05 smithi189 ceph-mon[32756]: pgmap v21843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39603.067672 secs 2024-04-27T05:30:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:05 smithi156 ceph-mon[32679]: pgmap v21843: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:07.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:07 smithi092 ceph-mon[29156]: pgmap v21844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:08.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:07 smithi189 ceph-mon[32756]: pgmap v21844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:08.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:07 smithi156 ceph-mon[32679]: pgmap v21844: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:09 smithi092 ceph-mon[29156]: pgmap v21845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:09.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40305.106183 secs 2024-04-27T05:30:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:09 smithi189 ceph-mon[32756]: pgmap v21845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:10.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40305.106183 secs 2024-04-27T05:30:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:09 smithi156 ceph-mon[32679]: pgmap v21845: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40305.106183 secs 2024-04-27T05:30:11.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39608.067751 secs 2024-04-27T05:30:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39608.067751 secs 2024-04-27T05:30:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39608.067751 secs 2024-04-27T05:30:12.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:11 smithi189 ceph-mon[32756]: pgmap v21846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:12.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:11 smithi156 ceph-mon[32679]: pgmap v21846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:12.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:11 smithi092 ceph-mon[29156]: pgmap v21846: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:14.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:13 smithi189 ceph-mon[32756]: pgmap v21847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:14.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:13 smithi156 ceph-mon[32679]: pgmap v21847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:14.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:13 smithi092 ceph-mon[29156]: pgmap v21847: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:15.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40310.106263 secs 2024-04-27T05:30:15.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40310.106263 secs 2024-04-27T05:30:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40310.106263 secs 2024-04-27T05:30:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:15 smithi189 ceph-mon[32756]: 4 slow requests, 1 included below; oldest blocked for > 39613.067867 secs 2024-04-27T05:30:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:15 smithi189 ceph-mon[32756]: slow request 722.790879 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:30:16.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:15 smithi189 ceph-mon[32756]: pgmap v21848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:15 smithi156 ceph-mon[32679]: 4 slow requests, 1 included below; oldest blocked for > 39613.067867 secs 2024-04-27T05:30:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:15 smithi156 ceph-mon[32679]: slow request 722.790879 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:30:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:15 smithi156 ceph-mon[32679]: pgmap v21848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:15 smithi092 ceph-mon[29156]: 4 slow requests, 1 included below; oldest blocked for > 39613.067867 secs 2024-04-27T05:30:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:15 smithi092 ceph-mon[29156]: slow request 722.790879 seconds old, received at 2024-04-27T05:18:11.423021+0000: client_request(client.17589:1 getattr pAsLsXsFs #0x1 2024-04-27T05:18:11.418715+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:30:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:15 smithi092 ceph-mon[29156]: pgmap v21848: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:18.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:17 smithi189 ceph-mon[32756]: pgmap v21849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:18.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:17 smithi156 ceph-mon[32679]: pgmap v21849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:18.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:17 smithi092 ceph-mon[29156]: pgmap v21849: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:19 smithi189 ceph-mon[32756]: pgmap v21850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:20.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40315.106338 secs 2024-04-27T05:30:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:19 smithi156 ceph-mon[32679]: pgmap v21850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:20.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40315.106338 secs 2024-04-27T05:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:19 smithi092 ceph-mon[29156]: pgmap v21850: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40315.106338 secs 2024-04-27T05:30:21.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:20 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39618.067999 secs 2024-04-27T05:30:21.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:20 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39618.067999 secs 2024-04-27T05:30:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:20 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39618.067999 secs 2024-04-27T05:30:22.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:21 smithi189 ceph-mon[32756]: pgmap v21851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:22.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:21 smithi156 ceph-mon[32679]: pgmap v21851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:22.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:21 smithi092 ceph-mon[29156]: pgmap v21851: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:24.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:23 smithi189 ceph-mon[32756]: pgmap v21852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:24.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:23 smithi156 ceph-mon[32679]: pgmap v21852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:24.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:23 smithi092 ceph-mon[29156]: pgmap v21852: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:25.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40320.106450 secs 2024-04-27T05:30:25.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40320.106450 secs 2024-04-27T05:30:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40320.106450 secs 2024-04-27T05:30:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:25 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39623.068135 secs 2024-04-27T05:30:26.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:25 smithi189 ceph-mon[32756]: pgmap v21853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:26.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:25 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39623.068135 secs 2024-04-27T05:30:26.186 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:25 smithi156 ceph-mon[32679]: pgmap v21853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:25 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39623.068135 secs 2024-04-27T05:30:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:25 smithi092 ceph-mon[29156]: pgmap v21853: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:28.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:27 smithi189 ceph-mon[32756]: pgmap v21854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:28.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:27 smithi156 ceph-mon[32679]: pgmap v21854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:28.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:27 smithi092 ceph-mon[29156]: pgmap v21854: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:29 smithi189 ceph-mon[32756]: pgmap v21855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:30.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40325.106529 secs 2024-04-27T05:30:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:29 smithi156 ceph-mon[32679]: pgmap v21855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:30.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40325.106529 secs 2024-04-27T05:30:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:29 smithi092 ceph-mon[29156]: pgmap v21855: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40325.106529 secs 2024-04-27T05:30:31.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:30 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39628.068234 secs 2024-04-27T05:30:31.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:30 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39628.068234 secs 2024-04-27T05:30:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:30 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39628.068234 secs 2024-04-27T05:30:32.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:31 smithi189 ceph-mon[32756]: pgmap v21856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:32.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:31 smithi156 ceph-mon[32679]: pgmap v21856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:31 smithi092 ceph-mon[29156]: pgmap v21856: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:34.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:33 smithi189 ceph-mon[32756]: pgmap v21857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:34.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:33 smithi156 ceph-mon[32679]: pgmap v21857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:34.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:33 smithi092 ceph-mon[29156]: pgmap v21857: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:35.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40330.106650 secs 2024-04-27T05:30:35.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40330.106650 secs 2024-04-27T05:30:35.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40330.106650 secs 2024-04-27T05:30:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:35 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39633.068373 secs 2024-04-27T05:30:36.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:35 smithi189 ceph-mon[32756]: pgmap v21858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:35 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39633.068373 secs 2024-04-27T05:30:36.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:35 smithi156 ceph-mon[32679]: pgmap v21858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:35 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39633.068373 secs 2024-04-27T05:30:36.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:35 smithi092 ceph-mon[29156]: pgmap v21858: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:38.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:37 smithi189 ceph-mon[32756]: pgmap v21859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:38.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:37 smithi156 ceph-mon[32679]: pgmap v21859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:38.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:37 smithi092 ceph-mon[29156]: pgmap v21859: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:39 smithi189 ceph-mon[32756]: pgmap v21860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:40.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40335.106794 secs 2024-04-27T05:30:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:39 smithi156 ceph-mon[32679]: pgmap v21860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:40.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40335.106794 secs 2024-04-27T05:30:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:39 smithi092 ceph-mon[29156]: pgmap v21860: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:40.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40335.106794 secs 2024-04-27T05:30:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:40 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39638.068449 secs 2024-04-27T05:30:41.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:40 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:30:41.184 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:40 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39638.068449 secs 2024-04-27T05:30:41.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:40 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:30:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:40 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39638.068449 secs 2024-04-27T05:30:41.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:40 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:30:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:30:41.518+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:30:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:30:41.518+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:30:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:30:41.518+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:30:41.520 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:30:41.518+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 310 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:30:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:41 smithi189 ceph-mon[32756]: pgmap v21861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:42.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:30:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:30:42.140 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:41 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:30:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:41 smithi156 ceph-mon[32679]: pgmap v21861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:30:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:30:42.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:41 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:30:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:41 smithi092 ceph-mon[29156]: pgmap v21861: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:30:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:30:42.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:41 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:30:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:42 smithi189 ceph-mon[32756]: pgmap v21862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:30:43.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:42 smithi189 ceph-mon[32756]: pgmap v21863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:43.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:42 smithi092 ceph-mon[29156]: pgmap v21862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:30:43.146 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:42 smithi092 ceph-mon[29156]: pgmap v21863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:42 smithi156 ceph-mon[32679]: pgmap v21862: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:30:43.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:42 smithi156 ceph-mon[32679]: pgmap v21863: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:44 smithi189 ceph-mon[32756]: pgmap v21864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:45.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40340.106929 secs 2024-04-27T05:30:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:44 smithi156 ceph-mon[32679]: pgmap v21864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:45.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40340.106929 secs 2024-04-27T05:30:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:44 smithi092 ceph-mon[29156]: pgmap v21864: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:45.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40340.106929 secs 2024-04-27T05:30:46.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:45 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39643.068571 secs 2024-04-27T05:30:46.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:45 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39643.068571 secs 2024-04-27T05:30:46.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:45 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39643.068571 secs 2024-04-27T05:30:47.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:46 smithi189 ceph-mon[32756]: pgmap v21865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:47.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:46 smithi156 ceph-mon[32679]: pgmap v21865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:47.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:46 smithi092 ceph-mon[29156]: pgmap v21865: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:49.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:48 smithi189 ceph-mon[32756]: pgmap v21866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:49.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:48 smithi156 ceph-mon[32679]: pgmap v21866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:49.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:48 smithi092 ceph-mon[29156]: pgmap v21866: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:30:50.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40345.107071 secs 2024-04-27T05:30:50.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40345.107071 secs 2024-04-27T05:30:50.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40345.107071 secs 2024-04-27T05:30:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:50 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39648.068630 secs 2024-04-27T05:30:51.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:50 smithi189 ceph-mon[32756]: pgmap v21867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:50 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39648.068630 secs 2024-04-27T05:30:51.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:50 smithi156 ceph-mon[32679]: pgmap v21867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:50 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39648.068630 secs 2024-04-27T05:30:51.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:50 smithi092 ceph-mon[29156]: pgmap v21867: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:30:53.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:52 smithi189 ceph-mon[32756]: pgmap v21868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:30:53.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:52 smithi156 ceph-mon[32679]: pgmap v21868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:30:53.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:52 smithi092 ceph-mon[29156]: pgmap v21868: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:30:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:54 smithi189 ceph-mon[32756]: pgmap v21869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:55.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40350.107187 secs 2024-04-27T05:30:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:54 smithi156 ceph-mon[32679]: pgmap v21869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:55.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40350.107187 secs 2024-04-27T05:30:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:54 smithi092 ceph-mon[29156]: pgmap v21869: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:55.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40350.107187 secs 2024-04-27T05:30:56.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:55 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39653.068752 secs 2024-04-27T05:30:56.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:55 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39653.068752 secs 2024-04-27T05:30:56.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:55 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39653.068752 secs 2024-04-27T05:30:57.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:56 smithi189 ceph-mon[32756]: pgmap v21870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:57.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:56 smithi156 ceph-mon[32679]: pgmap v21870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:57.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:56 smithi092 ceph-mon[29156]: pgmap v21870: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:30:59.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:58 smithi189 ceph-mon[32756]: pgmap v21871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:59.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:58 smithi156 ceph-mon[32679]: pgmap v21871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:30:59.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:58 smithi092 ceph-mon[29156]: pgmap v21871: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:00.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:30:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40355.107327 secs 2024-04-27T05:31:00.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:30:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40355.107327 secs 2024-04-27T05:31:00.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:30:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40355.107327 secs 2024-04-27T05:31:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:00 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39658.068867 secs 2024-04-27T05:31:01.139 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:00 smithi189 ceph-mon[32756]: pgmap v21872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:00 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39658.068867 secs 2024-04-27T05:31:01.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:00 smithi156 ceph-mon[32679]: pgmap v21872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:00 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39658.068867 secs 2024-04-27T05:31:01.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:00 smithi092 ceph-mon[29156]: pgmap v21872: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:03.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:02 smithi156 ceph-mon[32679]: pgmap v21873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:03.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:02 smithi092 ceph-mon[29156]: pgmap v21873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:03.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:02 smithi189 ceph-mon[32756]: pgmap v21873: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:04 smithi156 ceph-mon[32679]: pgmap v21874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:05.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40360.107471 secs 2024-04-27T05:31:05.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:04 smithi189 ceph-mon[32756]: pgmap v21874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:05.191 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40360.107471 secs 2024-04-27T05:31:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:04 smithi092 ceph-mon[29156]: pgmap v21874: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:05.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40360.107471 secs 2024-04-27T05:31:06.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:05 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39663.068999 secs 2024-04-27T05:31:06.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:05 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39663.068999 secs 2024-04-27T05:31:06.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:05 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39663.068999 secs 2024-04-27T05:31:07.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:06 smithi156 ceph-mon[32679]: pgmap v21875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:07.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:06 smithi092 ceph-mon[29156]: pgmap v21875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:07.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:06 smithi189 ceph-mon[32756]: pgmap v21875: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:09.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:08 smithi156 ceph-mon[32679]: pgmap v21876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:09.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:08 smithi092 ceph-mon[29156]: pgmap v21876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:09.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:08 smithi189 ceph-mon[32756]: pgmap v21876: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:10.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40365.107544 secs 2024-04-27T05:31:10.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40365.107544 secs 2024-04-27T05:31:10.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40365.107544 secs 2024-04-27T05:31:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:10 smithi156 ceph-mon[32679]: 4 slow requests, 0 included below; oldest blocked for > 39668.069086 secs 2024-04-27T05:31:11.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:10 smithi156 ceph-mon[32679]: pgmap v21877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:10 smithi092 ceph-mon[29156]: 4 slow requests, 0 included below; oldest blocked for > 39668.069086 secs 2024-04-27T05:31:11.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:10 smithi092 ceph-mon[29156]: pgmap v21877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:10 smithi189 ceph-mon[32756]: 4 slow requests, 0 included below; oldest blocked for > 39668.069086 secs 2024-04-27T05:31:11.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:10 smithi189 ceph-mon[32756]: pgmap v21877: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:13.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:12 smithi156 ceph-mon[32679]: pgmap v21878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:13.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:12 smithi092 ceph-mon[29156]: pgmap v21878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:13.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:12 smithi189 ceph-mon[32756]: pgmap v21878: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:14 smithi156 ceph-mon[32679]: pgmap v21879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:15.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40370.107661 secs 2024-04-27T05:31:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:14 smithi092 ceph-mon[29156]: pgmap v21879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:15.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40370.107661 secs 2024-04-27T05:31:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:14 smithi189 ceph-mon[32756]: pgmap v21879: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:15.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40370.107661 secs 2024-04-27T05:31:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:15 smithi156 ceph-mon[32679]: 34 slow requests, 1 included below; oldest blocked for > 39673.069176 secs 2024-04-27T05:31:16.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:15 smithi156 ceph-mon[32679]: slow request 182.611718 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:31:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:15 smithi092 ceph-mon[29156]: 34 slow requests, 1 included below; oldest blocked for > 39673.069176 secs 2024-04-27T05:31:16.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:15 smithi092 ceph-mon[29156]: slow request 182.611718 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:31:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:15 smithi189 ceph-mon[32756]: 34 slow requests, 1 included below; oldest blocked for > 39673.069176 secs 2024-04-27T05:31:16.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:15 smithi189 ceph-mon[32756]: slow request 182.611718 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:31:17.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:16 smithi156 ceph-mon[32679]: pgmap v21880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:17.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:16 smithi092 ceph-mon[29156]: pgmap v21880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:17.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:16 smithi189 ceph-mon[32756]: pgmap v21880: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:18 smithi156 ceph-mon[32679]: pgmap v21881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:31:19.185 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:31:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:18 smithi092 ceph-mon[29156]: pgmap v21881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:31:19.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:31:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:18 smithi189 ceph-mon[32756]: pgmap v21881: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:31:19.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:31:20.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40375.107777 secs 2024-04-27T05:31:20.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40375.107777 secs 2024-04-27T05:31:20.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40375.107777 secs 2024-04-27T05:31:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:20 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39678.069315 secs 2024-04-27T05:31:21.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:20 smithi092 ceph-mon[29156]: pgmap v21882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:20 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39678.069315 secs 2024-04-27T05:31:21.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:20 smithi189 ceph-mon[32756]: pgmap v21882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:20 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39678.069315 secs 2024-04-27T05:31:21.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:20 smithi156 ceph-mon[32679]: pgmap v21882: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:23.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:22 smithi092 ceph-mon[29156]: pgmap v21883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:23.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:22 smithi189 ceph-mon[32756]: pgmap v21883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:23.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:22 smithi156 ceph-mon[32679]: pgmap v21883: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:24 smithi092 ceph-mon[29156]: pgmap v21884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:25.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40380.107893 secs 2024-04-27T05:31:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:24 smithi189 ceph-mon[32756]: pgmap v21884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:25.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40380.107893 secs 2024-04-27T05:31:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:24 smithi156 ceph-mon[32679]: pgmap v21884: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:25.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40380.107893 secs 2024-04-27T05:31:26.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:25 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39683.069401 secs 2024-04-27T05:31:26.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:25 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39683.069401 secs 2024-04-27T05:31:26.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:25 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39683.069401 secs 2024-04-27T05:31:27.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:26 smithi092 ceph-mon[29156]: pgmap v21885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:27.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:26 smithi189 ceph-mon[32756]: pgmap v21885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:27.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:26 smithi156 ceph-mon[32679]: pgmap v21885: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:29.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:28 smithi092 ceph-mon[29156]: pgmap v21886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:29.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:28 smithi189 ceph-mon[32756]: pgmap v21886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:29.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:28 smithi156 ceph-mon[32679]: pgmap v21886: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:30.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40385.107974 secs 2024-04-27T05:31:30.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40385.107974 secs 2024-04-27T05:31:30.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40385.107974 secs 2024-04-27T05:31:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:30 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39688.069459 secs 2024-04-27T05:31:31.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:30 smithi092 ceph-mon[29156]: pgmap v21887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:30 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39688.069459 secs 2024-04-27T05:31:31.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:30 smithi189 ceph-mon[32756]: pgmap v21887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:31.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:30 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39688.069459 secs 2024-04-27T05:31:31.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:30 smithi156 ceph-mon[32679]: pgmap v21887: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:32.245 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:31 smithi092 ceph-mon[29156]: pgmap v21888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:32.389 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:31 smithi189 ceph-mon[32756]: pgmap v21888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:32.435 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:31 smithi156 ceph-mon[32679]: pgmap v21888: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:34 smithi092 ceph-mon[29156]: pgmap v21889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:34.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40390.108091 secs 2024-04-27T05:31:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:34 smithi189 ceph-mon[32756]: pgmap v21889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:34.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40390.108091 secs 2024-04-27T05:31:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:34 smithi156 ceph-mon[32679]: pgmap v21889: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:34.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40390.108091 secs 2024-04-27T05:31:35.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:35 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39693.069581 secs 2024-04-27T05:31:35.790 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:35 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39693.069581 secs 2024-04-27T05:31:35.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:35 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39693.069581 secs 2024-04-27T05:31:36.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:36 smithi092 ceph-mon[29156]: pgmap v21890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:36.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:36 smithi189 ceph-mon[32756]: pgmap v21890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:36.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:36 smithi156 ceph-mon[32679]: pgmap v21890: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:38.745 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:38 smithi092 ceph-mon[29156]: pgmap v21891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:38.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:38 smithi189 ceph-mon[32756]: pgmap v21891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:38.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:38 smithi156 ceph-mon[32679]: pgmap v21891: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:39.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40395.108209 secs 2024-04-27T05:31:39.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40395.108209 secs 2024-04-27T05:31:39.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40395.108209 secs 2024-04-27T05:31:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:40 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39698.069660 secs 2024-04-27T05:31:40.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:40 smithi189 ceph-mon[32756]: pgmap v21892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:40 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39698.069660 secs 2024-04-27T05:31:40.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:40 smithi156 ceph-mon[32679]: pgmap v21892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:40.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:40 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39698.069660 secs 2024-04-27T05:31:40.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:40 smithi092 ceph-mon[29156]: pgmap v21892: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:42 smithi189 ceph-mon[32756]: pgmap v21893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:31:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:31:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:31:42.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:31:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:42 smithi156 ceph-mon[32679]: pgmap v21893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:31:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:31:42.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:31:42.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:31:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:42 smithi092 ceph-mon[29156]: pgmap v21893: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:31:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:31:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:31:42.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:31:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:43 smithi189 ceph-mon[32756]: pgmap v21894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:31:43.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:43 smithi189 ceph-mon[32756]: pgmap v21895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:43.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:43 smithi156 ceph-mon[32679]: pgmap v21894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:31:43.935 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:43 smithi156 ceph-mon[32679]: pgmap v21895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:43.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:43 smithi092 ceph-mon[29156]: pgmap v21894: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:31:43.995 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:43 smithi092 ceph-mon[29156]: pgmap v21895: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:44.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40400.108325 secs 2024-04-27T05:31:44.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40400.108325 secs 2024-04-27T05:31:44.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40400.108325 secs 2024-04-27T05:31:45.854 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:45 smithi092 ceph-mon[29156]: pgmap v21896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:45.854 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:45 smithi092 ceph-mon[29156]: 34 slow requests, 1 included below; oldest blocked for > 39703.069768 secs 2024-04-27T05:31:45.854 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:45 smithi092 ceph-mon[29156]: slow request 1442.951435 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:31:45.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:45 smithi189 ceph-mon[32756]: pgmap v21896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:45 smithi189 ceph-mon[32756]: 34 slow requests, 1 included below; oldest blocked for > 39703.069768 secs 2024-04-27T05:31:45.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:45 smithi189 ceph-mon[32756]: slow request 1442.951435 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:31:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:45 smithi156 ceph-mon[32679]: pgmap v21896: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:45 smithi156 ceph-mon[32679]: 34 slow requests, 1 included below; oldest blocked for > 39703.069768 secs 2024-04-27T05:31:45.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:45 smithi156 ceph-mon[32679]: slow request 1442.951435 seconds old, received at 2024-04-27T05:07:41.264367+0000: client_request(client.17577:1 getattr pAsLsXsFs #0x1 2024-04-27T05:07:41.259776+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:31:47.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:47 smithi189 ceph-mon[32756]: pgmap v21897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:47.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:47 smithi156 ceph-mon[32679]: pgmap v21897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:47.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:47 smithi092 ceph-mon[29156]: pgmap v21897: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:49 smithi189 ceph-mon[32756]: pgmap v21898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:31:49.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40405.108386 secs 2024-04-27T05:31:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:49 smithi156 ceph-mon[32679]: pgmap v21898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:31:49.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40405.108386 secs 2024-04-27T05:31:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:49 smithi092 ceph-mon[29156]: pgmap v21898: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:31:49.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40405.108386 secs 2024-04-27T05:31:50.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:50 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39708.069852 secs 2024-04-27T05:31:50.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:50 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39708.069852 secs 2024-04-27T05:31:50.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:50 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39708.069852 secs 2024-04-27T05:31:51.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:51 smithi189 ceph-mon[32756]: pgmap v21899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:51.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:51 smithi156 ceph-mon[32679]: pgmap v21899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:51.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:51 smithi092 ceph-mon[29156]: pgmap v21899: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:31:53.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:53 smithi189 ceph-mon[32756]: pgmap v21900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:31:53.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:53 smithi156 ceph-mon[32679]: pgmap v21900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:31:53.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:53 smithi092 ceph-mon[29156]: pgmap v21900: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:31:54.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40410.108505 secs 2024-04-27T05:31:54.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40410.108505 secs 2024-04-27T05:31:54.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40410.108505 secs 2024-04-27T05:31:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:55 smithi189 ceph-mon[32756]: pgmap v21901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:55.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:55 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39713.069927 secs 2024-04-27T05:31:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:55 smithi156 ceph-mon[32679]: pgmap v21901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:55.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:55 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39713.069927 secs 2024-04-27T05:31:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:55 smithi092 ceph-mon[29156]: pgmap v21901: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:31:55.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:55 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39713.069927 secs 2024-04-27T05:31:57.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:57 smithi189 ceph-mon[32756]: pgmap v21902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:57.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:57 smithi156 ceph-mon[32679]: pgmap v21902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:57.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:57 smithi092 ceph-mon[29156]: pgmap v21902: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:59 smithi189 ceph-mon[32756]: pgmap v21903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:59.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:31:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40415.108642 secs 2024-04-27T05:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:59 smithi156 ceph-mon[32679]: pgmap v21903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:59.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:31:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40415.108642 secs 2024-04-27T05:31:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:59 smithi092 ceph-mon[29156]: pgmap v21903: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:31:59.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:31:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40415.108642 secs 2024-04-27T05:32:00.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:00 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39718.070039 secs 2024-04-27T05:32:00.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:00 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39718.070039 secs 2024-04-27T05:32:00.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:00 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39718.070039 secs 2024-04-27T05:32:01.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:01 smithi189 ceph-mon[32756]: pgmap v21904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:01.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:01 smithi156 ceph-mon[32679]: pgmap v21904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:01.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:01 smithi092 ceph-mon[29156]: pgmap v21904: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:03.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:03 smithi189 ceph-mon[32756]: pgmap v21905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:03.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:03 smithi156 ceph-mon[32679]: pgmap v21905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:03.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:03 smithi092 ceph-mon[29156]: pgmap v21905: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:04.835 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40420.108766 secs 2024-04-27T05:32:04.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40420.108766 secs 2024-04-27T05:32:04.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40420.108766 secs 2024-04-27T05:32:05.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:05 smithi189 ceph-mon[32756]: pgmap v21906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:05.889 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:05 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39723.070146 secs 2024-04-27T05:32:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:05 smithi156 ceph-mon[32679]: pgmap v21906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:05.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:05 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39723.070146 secs 2024-04-27T05:32:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:05 smithi092 ceph-mon[29156]: pgmap v21906: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:05.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:05 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39723.070146 secs 2024-04-27T05:32:07.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:07 smithi189 ceph-mon[32756]: pgmap v21907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:07.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:07 smithi156 ceph-mon[32679]: pgmap v21907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:07.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:07 smithi092 ceph-mon[29156]: pgmap v21907: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:09 smithi189 ceph-mon[32756]: pgmap v21908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:09.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40425.108865 secs 2024-04-27T05:32:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:09 smithi156 ceph-mon[32679]: pgmap v21908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:09.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40425.108865 secs 2024-04-27T05:32:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:09 smithi092 ceph-mon[29156]: pgmap v21908: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:09.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40425.108865 secs 2024-04-27T05:32:10.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:10 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39728.070265 secs 2024-04-27T05:32:10.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:10 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39728.070265 secs 2024-04-27T05:32:10.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:10 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39728.070265 secs 2024-04-27T05:32:11.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:11 smithi189 ceph-mon[32756]: pgmap v21909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:11.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:11 smithi156 ceph-mon[32679]: pgmap v21909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:11.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:11 smithi092 ceph-mon[29156]: pgmap v21909: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:13.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:13 smithi189 ceph-mon[32756]: pgmap v21910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:13.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:13 smithi156 ceph-mon[32679]: pgmap v21910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:13.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:13 smithi092 ceph-mon[29156]: pgmap v21910: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:14.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40430.108983 secs 2024-04-27T05:32:14.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40430.108983 secs 2024-04-27T05:32:14.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40430.108983 secs 2024-04-27T05:32:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:15 smithi189 ceph-mon[32756]: pgmap v21911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:15.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:15 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39733.070384 secs 2024-04-27T05:32:15.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:15 smithi092 ceph-mon[29156]: pgmap v21911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:15.895 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:15 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39733.070384 secs 2024-04-27T05:32:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:15 smithi156 ceph-mon[32679]: pgmap v21911: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:15.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:15 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39733.070384 secs 2024-04-27T05:32:17.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:17 smithi189 ceph-mon[32756]: pgmap v21912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:17.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:17 smithi156 ceph-mon[32679]: pgmap v21912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:17.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:17 smithi092 ceph-mon[29156]: pgmap v21912: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:19.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:19 smithi189 ceph-mon[32756]: pgmap v21913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:20.015 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40435.109096 secs 2024-04-27T05:32:20.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:19 smithi092 ceph-mon[29156]: pgmap v21913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:20.016 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40435.109096 secs 2024-04-27T05:32:20.016 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:19 smithi156 ceph-mon[32679]: pgmap v21913: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:20.016 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40435.109096 secs 2024-04-27T05:32:20.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:20 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39738.070483 secs 2024-04-27T05:32:20.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:20 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39738.070483 secs 2024-04-27T05:32:20.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:20 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39738.070483 secs 2024-04-27T05:32:21.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:21 smithi189 ceph-mon[32756]: pgmap v21914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:21.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:21 smithi156 ceph-mon[32679]: pgmap v21914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:21.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:21 smithi092 ceph-mon[29156]: pgmap v21914: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:23.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:23 smithi189 ceph-mon[32756]: pgmap v21915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:23.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:23 smithi156 ceph-mon[32679]: pgmap v21915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:23.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:23 smithi092 ceph-mon[29156]: pgmap v21915: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:24.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40440.109222 secs 2024-04-27T05:32:24.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40440.109222 secs 2024-04-27T05:32:24.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40440.109222 secs 2024-04-27T05:32:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:25 smithi189 ceph-mon[32756]: pgmap v21916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:25.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:25 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39743.070570 secs 2024-04-27T05:32:25.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:25 smithi156 ceph-mon[32679]: pgmap v21916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:25.934 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:25 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39743.070570 secs 2024-04-27T05:32:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:25 smithi092 ceph-mon[29156]: pgmap v21916: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:25.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:25 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39743.070570 secs 2024-04-27T05:32:27.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:27 smithi189 ceph-mon[32756]: pgmap v21917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:27.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:27 smithi156 ceph-mon[32679]: pgmap v21917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:27.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:27 smithi092 ceph-mon[29156]: pgmap v21917: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:29 smithi189 ceph-mon[32756]: pgmap v21918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:29.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40445.109356 secs 2024-04-27T05:32:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:29 smithi156 ceph-mon[32679]: pgmap v21918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:29.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40445.109356 secs 2024-04-27T05:32:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:29 smithi092 ceph-mon[29156]: pgmap v21918: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:29.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40445.109356 secs 2024-04-27T05:32:30.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:30 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39748.070662 secs 2024-04-27T05:32:30.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:30 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39748.070662 secs 2024-04-27T05:32:30.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:30 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39748.070662 secs 2024-04-27T05:32:31.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:31 smithi189 ceph-mon[32756]: pgmap v21919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:31.932 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:31 smithi092 ceph-mon[29156]: pgmap v21919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:31.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:31 smithi156 ceph-mon[32679]: pgmap v21919: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:33.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:33 smithi189 ceph-mon[32756]: pgmap v21920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:33.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:33 smithi156 ceph-mon[32679]: pgmap v21920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:33.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:33 smithi092 ceph-mon[29156]: pgmap v21920: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:34.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40450.109479 secs 2024-04-27T05:32:34.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40450.109479 secs 2024-04-27T05:32:34.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40450.109479 secs 2024-04-27T05:32:35.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:35 smithi189 ceph-mon[32756]: pgmap v21921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:35.888 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:35 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39753.070778 secs 2024-04-27T05:32:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:35 smithi156 ceph-mon[32679]: pgmap v21921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:35.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:35 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39753.070778 secs 2024-04-27T05:32:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:35 smithi092 ceph-mon[29156]: pgmap v21921: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:35.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:35 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39753.070778 secs 2024-04-27T05:32:37.887 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:37 smithi189 ceph-mon[32756]: pgmap v21922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:37.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:37 smithi156 ceph-mon[32679]: pgmap v21922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:37.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:37 smithi092 ceph-mon[29156]: pgmap v21922: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:39 smithi156 ceph-mon[32679]: pgmap v21923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:39.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40455.109613 secs 2024-04-27T05:32:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:39 smithi092 ceph-mon[29156]: pgmap v21923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:39.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40455.109613 secs 2024-04-27T05:32:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:39 smithi189 ceph-mon[32756]: pgmap v21923: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:40.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40455.109613 secs 2024-04-27T05:32:40.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:40 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39758.070881 secs 2024-04-27T05:32:40.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:40 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39758.070881 secs 2024-04-27T05:32:41.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:40 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39758.070881 secs 2024-04-27T05:32:41.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:41 smithi156 ceph-mon[32679]: pgmap v21924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:41.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:41 smithi092 ceph-mon[29156]: pgmap v21924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:42.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:41 smithi189 ceph-mon[32756]: pgmap v21924: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:42.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:42 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:32:42.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:42 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:32:43.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:42 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:32:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:43 smithi156 ceph-mon[32679]: pgmap v21925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:32:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:32:43.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:32:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:43 smithi092 ceph-mon[29156]: pgmap v21925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:32:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:32:43.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:32:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:43 smithi189 ceph-mon[32756]: pgmap v21925: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:32:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:32:44.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:32:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:44 smithi156 ceph-mon[32679]: pgmap v21926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:32:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:44 smithi156 ceph-mon[32679]: pgmap v21927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:32:44.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40460.109745 secs 2024-04-27T05:32:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:44 smithi092 ceph-mon[29156]: pgmap v21926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:32:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:44 smithi092 ceph-mon[29156]: pgmap v21927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:32:44.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40460.109745 secs 2024-04-27T05:32:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:44 smithi189 ceph-mon[32756]: pgmap v21926: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:32:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:44 smithi189 ceph-mon[32756]: pgmap v21927: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:32:45.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40460.109745 secs 2024-04-27T05:32:45.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:45 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39763.071016 secs 2024-04-27T05:32:45.994 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:45 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39763.071016 secs 2024-04-27T05:32:46.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:45 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39763.071016 secs 2024-04-27T05:32:46.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:46 smithi156 ceph-mon[32679]: pgmap v21928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:46.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:46 smithi092 ceph-mon[29156]: pgmap v21928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:47.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:46 smithi189 ceph-mon[32756]: pgmap v21928: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:48.933 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:48 smithi156 ceph-mon[32679]: pgmap v21929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:48.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:48 smithi092 ceph-mon[29156]: pgmap v21929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:49.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:48 smithi189 ceph-mon[32756]: pgmap v21929: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:49.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40465.109860 secs 2024-04-27T05:32:50.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40465.109860 secs 2024-04-27T05:32:50.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40465.109860 secs 2024-04-27T05:32:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:50 smithi092 ceph-mon[29156]: pgmap v21930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:50.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:50 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39768.071130 secs 2024-04-27T05:32:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:50 smithi189 ceph-mon[32756]: pgmap v21930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:51.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:50 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39768.071130 secs 2024-04-27T05:32:51.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:50 smithi156 ceph-mon[32679]: pgmap v21930: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:51.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:50 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39768.071130 secs 2024-04-27T05:32:52.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:52 smithi092 ceph-mon[29156]: pgmap v21931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:53.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:52 smithi189 ceph-mon[32756]: pgmap v21931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:53.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:52 smithi156 ceph-mon[32679]: pgmap v21931: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:32:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:54 smithi092 ceph-mon[29156]: pgmap v21932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:32:54.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40470.109923 secs 2024-04-27T05:32:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:54 smithi189 ceph-mon[32756]: pgmap v21932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:32:55.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40470.109923 secs 2024-04-27T05:32:55.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:54 smithi156 ceph-mon[32679]: pgmap v21932: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:32:55.183 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40470.109923 secs 2024-04-27T05:32:55.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:55 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39773.071209 secs 2024-04-27T05:32:56.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:55 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39773.071209 secs 2024-04-27T05:32:56.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:55 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39773.071209 secs 2024-04-27T05:32:56.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:56 smithi092 ceph-mon[29156]: pgmap v21933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:57.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:56 smithi189 ceph-mon[32756]: pgmap v21933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:57.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:56 smithi156 ceph-mon[32679]: pgmap v21933: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:32:58.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:58 smithi092 ceph-mon[29156]: pgmap v21934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:59.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:58 smithi189 ceph-mon[32756]: pgmap v21934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:59.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:58 smithi156 ceph-mon[32679]: pgmap v21934: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:32:59.993 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:32:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40475.109989 secs 2024-04-27T05:33:00.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:32:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40475.109989 secs 2024-04-27T05:33:00.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:32:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40475.109989 secs 2024-04-27T05:33:00.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:00 smithi092 ceph-mon[29156]: pgmap v21935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:00.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:00 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39778.071322 secs 2024-04-27T05:33:01.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:00 smithi189 ceph-mon[32756]: pgmap v21935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:01.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:00 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39778.071322 secs 2024-04-27T05:33:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:00 smithi156 ceph-mon[32679]: pgmap v21935: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:01.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:00 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39778.071322 secs 2024-04-27T05:33:02.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:02 smithi092 ceph-mon[29156]: pgmap v21936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:03.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:02 smithi189 ceph-mon[32756]: pgmap v21936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:03.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:02 smithi156 ceph-mon[32679]: pgmap v21936: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:04.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:04 smithi156 ceph-mon[32679]: pgmap v21937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:04.985 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40480.110069 secs 2024-04-27T05:33:04.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:04 smithi092 ceph-mon[29156]: pgmap v21937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:04.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40480.110069 secs 2024-04-27T05:33:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:04 smithi189 ceph-mon[32756]: pgmap v21937: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:05.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40480.110069 secs 2024-04-27T05:33:05.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:05 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39783.071438 secs 2024-04-27T05:33:06.038 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:05 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39783.071438 secs 2024-04-27T05:33:06.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:05 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39783.071438 secs 2024-04-27T05:33:06.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:06 smithi092 ceph-mon[29156]: pgmap v21938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:07.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:06 smithi189 ceph-mon[32756]: pgmap v21938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:07.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:06 smithi156 ceph-mon[32679]: pgmap v21938: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:08.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:08 smithi092 ceph-mon[29156]: pgmap v21939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:09.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:08 smithi189 ceph-mon[32756]: pgmap v21939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:09.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:08 smithi156 ceph-mon[32679]: pgmap v21939: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:09.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40485.110131 secs 2024-04-27T05:33:10.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40485.110131 secs 2024-04-27T05:33:10.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40485.110131 secs 2024-04-27T05:33:10.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:10 smithi092 ceph-mon[29156]: pgmap v21940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:10.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:10 smithi092 ceph-mon[29156]: 34 slow requests, 0 included below; oldest blocked for > 39788.071531 secs 2024-04-27T05:33:11.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:10 smithi189 ceph-mon[32756]: pgmap v21940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:11.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:10 smithi189 ceph-mon[32756]: 34 slow requests, 0 included below; oldest blocked for > 39788.071531 secs 2024-04-27T05:33:11.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:10 smithi156 ceph-mon[32679]: pgmap v21940: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:11.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:10 smithi156 ceph-mon[32679]: 34 slow requests, 0 included below; oldest blocked for > 39788.071531 secs 2024-04-27T05:33:11.992 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:33:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:33:11.723+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:33:11.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:33:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:33:11.723+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:33:11.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:33:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:33:11.723+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:33:11.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:33:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:33:11.723+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:33:11.993 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:33:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:33:11.723+0000 7f2542cf3700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:33:12.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:12 smithi092 ceph-mon[29156]: pgmap v21941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:13.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:12 smithi189 ceph-mon[32756]: pgmap v21941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:13.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:12 smithi156 ceph-mon[32679]: pgmap v21941: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:14 smithi092 ceph-mon[29156]: pgmap v21942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:14.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40490.110253 secs 2024-04-27T05:33:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:14 smithi189 ceph-mon[32756]: pgmap v21942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:15.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40490.110253 secs 2024-04-27T05:33:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:14 smithi156 ceph-mon[32679]: pgmap v21942: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:15.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40490.110253 secs 2024-04-27T05:33:15.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:15 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39793.071630 secs 2024-04-27T05:33:16.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:15 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39793.071630 secs 2024-04-27T05:33:16.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:15 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39793.071630 secs 2024-04-27T05:33:17.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:16 smithi189 ceph-mon[32756]: pgmap v21943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:17.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:16 smithi156 ceph-mon[32679]: pgmap v21943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:17.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:16 smithi092 ceph-mon[29156]: pgmap v21943: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:18 smithi092 ceph-mon[29156]: pgmap v21944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:33:18.992 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:33:19.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:18 smithi189 ceph-mon[32756]: pgmap v21944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:19.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:33:19.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:33:19.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:18 smithi156 ceph-mon[32679]: pgmap v21944: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:19.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:33:19.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:33:20.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40495.110389 secs 2024-04-27T05:33:20.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40495.110389 secs 2024-04-27T05:33:20.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40495.110389 secs 2024-04-27T05:33:21.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:20 smithi189 ceph-mon[32756]: pgmap v21945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:21.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:20 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39798.071764 secs 2024-04-27T05:33:21.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:20 smithi156 ceph-mon[32679]: pgmap v21945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:21.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:20 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39798.071764 secs 2024-04-27T05:33:21.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:20 smithi092 ceph-mon[29156]: pgmap v21945: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:21.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:20 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39798.071764 secs 2024-04-27T05:33:23.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:22 smithi189 ceph-mon[32756]: pgmap v21946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:23.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:22 smithi156 ceph-mon[32679]: pgmap v21946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:23.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:22 smithi092 ceph-mon[29156]: pgmap v21946: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:24 smithi189 ceph-mon[32756]: pgmap v21947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:25.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40500.110504 secs 2024-04-27T05:33:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:24 smithi156 ceph-mon[32679]: pgmap v21947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:25.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40500.110504 secs 2024-04-27T05:33:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:24 smithi092 ceph-mon[29156]: pgmap v21947: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 426 B/s wr, 15 op/s 2024-04-27T05:33:25.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40500.110504 secs 2024-04-27T05:33:26.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:25 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39803.071881 secs 2024-04-27T05:33:26.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:25 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39803.071881 secs 2024-04-27T05:33:26.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:25 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39803.071881 secs 2024-04-27T05:33:27.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:26 smithi189 ceph-mon[32756]: pgmap v21948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:27.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:26 smithi156 ceph-mon[32679]: pgmap v21948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:27.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:26 smithi092 ceph-mon[29156]: pgmap v21948: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 426 B/s wr, 16 op/s 2024-04-27T05:33:29.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:28 smithi189 ceph-mon[32756]: pgmap v21949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:29.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:28 smithi156 ceph-mon[32679]: pgmap v21949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:29.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:28 smithi092 ceph-mon[29156]: pgmap v21949: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:30.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40505.110622 secs 2024-04-27T05:33:30.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40505.110622 secs 2024-04-27T05:33:30.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40505.110622 secs 2024-04-27T05:33:31.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:30 smithi189 ceph-mon[32756]: pgmap v21950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:31.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:30 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39808.071983 secs 2024-04-27T05:33:31.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:30 smithi156 ceph-mon[32679]: pgmap v21950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:31.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:30 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39808.071983 secs 2024-04-27T05:33:31.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:30 smithi092 ceph-mon[29156]: pgmap v21950: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:31.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:30 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39808.071983 secs 2024-04-27T05:33:33.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:32 smithi189 ceph-mon[32756]: pgmap v21951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:33.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:32 smithi156 ceph-mon[32679]: pgmap v21951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:33.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:32 smithi092 ceph-mon[29156]: pgmap v21951: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:35.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:34 smithi189 ceph-mon[32756]: pgmap v21952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:35.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40510.110688 secs 2024-04-27T05:33:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:34 smithi156 ceph-mon[32679]: pgmap v21952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:35.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40510.110688 secs 2024-04-27T05:33:35.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:34 smithi092 ceph-mon[29156]: pgmap v21952: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:35.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40510.110688 secs 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1cb27fc640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900000023) for more than 900000000 us, fault. 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80039c0 tx=0x7f1ca8089000 comp rx=0 tx=0).stop 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 msgr2=0x7f1c9c0a5cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a4760 0x7f1c9c0a5cc0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1c9bfff640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.054+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:33:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.055+0000 7f1cb27fc640 1 --2- 172.21.15.92:0/2399433965 >> [v2:172.21.15.92:6800/1487524229,v1:172.21.15.92:6801/1487524229] conn(0x7f1c9c0a6200 0x7f1c9c0b25a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8005a80 tx=0x7f1ca80b0050 comp rx=0 tx=0).ready entity=mgr.15111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-27T05:33:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.103+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-27T05:33:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.103+0000 7f1cb2ffd640 1 -- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 msgr2=0x5617fb98b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-27T05:33:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-27T05:33:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=READY pgs=588 cs=43 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-04-27T05:33:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.103+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 unknown :-1 s=BANNER_CONNECTING pgs=588 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-27T05:33:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.104+0000 7f1cb2ffd640 1 --2- 172.21.15.92:0/534035708 >> [v2:172.21.15.156:6838/2836729853,v1:172.21.15.156:6839/2836729853] conn(0x5617fb9891b0 0x5617fb98b5a0 crc :-1 s=READY pgs=588 cs=44 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5e08252f5d00f3 server_cookie=105b7d800bab196e in_seq=0 out_seq=0 2024-04-27T05:33:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:36.104+0000 7f1c96ff5640 10 client.16836 ms_handle_connect on v2:172.21.15.156:6838/2836729853 2024-04-27T05:33:36.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:35 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39813.072124 secs 2024-04-27T05:33:36.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:35 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39813.072124 secs 2024-04-27T05:33:36.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:35 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39813.072124 secs 2024-04-27T05:33:37.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:36 smithi189 ceph-mon[32756]: pgmap v21953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:37.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:36 smithi156 ceph-mon[32679]: pgmap v21953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:37.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:36 smithi092 ceph-mon[29156]: pgmap v21953: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:39.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:38 smithi189 ceph-mon[32756]: pgmap v21954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:39.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:38 smithi156 ceph-mon[32679]: pgmap v21954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:39.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:38 smithi092 ceph-mon[29156]: pgmap v21954: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:39 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 40515.110866 secs 2024-04-27T05:33:40.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:39 smithi189 ceph-mon[32756]: slow request 23043.627861 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:33:40.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:39 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 40515.110866 secs 2024-04-27T05:33:40.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:39 smithi156 ceph-mon[32679]: slow request 23043.627861 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:33:40.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:39 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 40515.110866 secs 2024-04-27T05:33:40.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:39 smithi092 ceph-mon[29156]: slow request 23043.627861 seconds old, received at 2024-04-26T23:09:35.398746+0000: client_request(client.17166:1 getattr pAsLsXsFs #0x1 2024-04-26T23:09:35.391375+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:33:41.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:40 smithi189 ceph-mon[32756]: pgmap v21955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:41.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39818.072264 secs 2024-04-27T05:33:41.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:40 smithi156 ceph-mon[32679]: pgmap v21955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:41.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39818.072264 secs 2024-04-27T05:33:41.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:40 smithi092 ceph-mon[29156]: pgmap v21955: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:33:41.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39818.072264 secs 2024-04-27T05:33:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:41.542+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:33:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:41.542+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:33:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:41.543+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:33:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:33:41.543+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 311 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:33:43.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:42 smithi189 ceph-mon[32756]: pgmap v21956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:43.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:42 smithi156 ceph-mon[32679]: pgmap v21956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:43.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:42 smithi092 ceph-mon[29156]: pgmap v21956: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:44.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:33:44.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:33:44.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:33:44.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:33:44.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:33:44.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:33:44.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:33:44.182 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:33:44.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:33:44.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:33:44.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:33:44.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:33:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:44 smithi189 ceph-mon[32756]: pgmap v21957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:44 smithi189 ceph-mon[32756]: pgmap v21958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:45.136 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40520.110980 secs 2024-04-27T05:33:45.142 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:44 smithi092 ceph-mon[29156]: pgmap v21957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:45.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:44 smithi092 ceph-mon[29156]: pgmap v21958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:45.143 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40520.110980 secs 2024-04-27T05:33:45.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:44 smithi156 ceph-mon[32679]: pgmap v21957: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:45.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:44 smithi156 ceph-mon[32679]: pgmap v21958: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:45.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40520.110980 secs 2024-04-27T05:33:46.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:45 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39823.072369 secs 2024-04-27T05:33:46.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:45 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39823.072369 secs 2024-04-27T05:33:46.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:45 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39823.072369 secs 2024-04-27T05:33:47.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:46 smithi189 ceph-mon[32756]: pgmap v21959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:47.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:46 smithi156 ceph-mon[32679]: pgmap v21959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:47.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:46 smithi092 ceph-mon[29156]: pgmap v21959: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:49.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:48 smithi189 ceph-mon[32756]: pgmap v21960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:49.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:48 smithi156 ceph-mon[32679]: pgmap v21960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:49.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:48 smithi092 ceph-mon[29156]: pgmap v21960: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:50.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40525.111079 secs 2024-04-27T05:33:50.142 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40525.111079 secs 2024-04-27T05:33:50.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40525.111079 secs 2024-04-27T05:33:51.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:50 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39828.072481 secs 2024-04-27T05:33:51.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:50 smithi189 ceph-mon[32756]: pgmap v21961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:51.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:50 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39828.072481 secs 2024-04-27T05:33:51.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:50 smithi156 ceph-mon[32679]: pgmap v21961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:51.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:50 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39828.072481 secs 2024-04-27T05:33:51.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:50 smithi092 ceph-mon[29156]: pgmap v21961: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:53.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:52 smithi189 ceph-mon[32756]: pgmap v21962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:53.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:52 smithi156 ceph-mon[32679]: pgmap v21962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:53.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:52 smithi092 ceph-mon[29156]: pgmap v21962: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:33:55.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:54 smithi189 ceph-mon[32756]: pgmap v21963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:55.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40530.111199 secs 2024-04-27T05:33:55.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:54 smithi156 ceph-mon[32679]: pgmap v21963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:55.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40530.111199 secs 2024-04-27T05:33:55.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:54 smithi092 ceph-mon[29156]: pgmap v21963: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:33:55.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40530.111199 secs 2024-04-27T05:33:56.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:55 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39833.072618 secs 2024-04-27T05:33:56.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:55 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39833.072618 secs 2024-04-27T05:33:56.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:55 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39833.072618 secs 2024-04-27T05:33:57.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:56 smithi189 ceph-mon[32756]: pgmap v21964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:57.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:56 smithi156 ceph-mon[32679]: pgmap v21964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:57.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:56 smithi092 ceph-mon[29156]: pgmap v21964: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:59.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:58 smithi189 ceph-mon[32756]: pgmap v21965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:59.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:58 smithi156 ceph-mon[32679]: pgmap v21965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:33:59.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:58 smithi092 ceph-mon[29156]: pgmap v21965: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:00.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:33:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40535.111294 secs 2024-04-27T05:34:00.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:33:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40535.111294 secs 2024-04-27T05:34:00.242 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:33:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40535.111294 secs 2024-04-27T05:34:01.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:00 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39838.072732 secs 2024-04-27T05:34:01.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:00 smithi189 ceph-mon[32756]: pgmap v21966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:01.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:00 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39838.072732 secs 2024-04-27T05:34:01.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:00 smithi156 ceph-mon[32679]: pgmap v21966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:01.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:00 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39838.072732 secs 2024-04-27T05:34:01.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:00 smithi092 ceph-mon[29156]: pgmap v21966: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:03.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:02 smithi189 ceph-mon[32756]: pgmap v21967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:03.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:02 smithi156 ceph-mon[32679]: pgmap v21967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:03.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:02 smithi092 ceph-mon[29156]: pgmap v21967: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:05.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:04 smithi189 ceph-mon[32756]: pgmap v21968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:05.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40540.111414 secs 2024-04-27T05:34:05.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:04 smithi156 ceph-mon[32679]: pgmap v21968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:05.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40540.111414 secs 2024-04-27T05:34:05.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:04 smithi092 ceph-mon[29156]: pgmap v21968: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:05.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40540.111414 secs 2024-04-27T05:34:06.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:05 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39843.072848 secs 2024-04-27T05:34:06.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:05 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39843.072848 secs 2024-04-27T05:34:06.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:05 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39843.072848 secs 2024-04-27T05:34:07.135 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:06 smithi189 ceph-mon[32756]: pgmap v21969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:07.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:06 smithi156 ceph-mon[32679]: pgmap v21969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:07.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:06 smithi092 ceph-mon[29156]: pgmap v21969: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:09.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:08 smithi156 ceph-mon[32679]: pgmap v21970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:09.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:08 smithi092 ceph-mon[29156]: pgmap v21970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:08 smithi189 ceph-mon[32756]: pgmap v21970: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:10.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40545.111533 secs 2024-04-27T05:34:10.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40545.111533 secs 2024-04-27T05:34:10.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40545.111533 secs 2024-04-27T05:34:11.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39848.072981 secs 2024-04-27T05:34:11.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:10 smithi156 ceph-mon[32679]: pgmap v21971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:11.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39848.072981 secs 2024-04-27T05:34:11.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:10 smithi092 ceph-mon[29156]: pgmap v21971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:11.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39848.072981 secs 2024-04-27T05:34:11.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:10 smithi189 ceph-mon[32756]: pgmap v21971: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:13.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:12 smithi156 ceph-mon[32679]: pgmap v21972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:13.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:12 smithi092 ceph-mon[29156]: pgmap v21972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:13.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:12 smithi189 ceph-mon[32756]: pgmap v21972: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-27T05:34:15.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:14 smithi156 ceph-mon[32679]: pgmap v21973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:15.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40550.111662 secs 2024-04-27T05:34:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:14 smithi092 ceph-mon[29156]: pgmap v21973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:15.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40550.111662 secs 2024-04-27T05:34:15.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:14 smithi189 ceph-mon[32756]: pgmap v21973: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-04-27T05:34:15.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40550.111662 secs 2024-04-27T05:34:16.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:15 smithi156 ceph-mon[32679]: 6 slow requests, 1 included below; oldest blocked for > 39853.073106 secs 2024-04-27T05:34:16.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:15 smithi156 ceph-mon[32679]: slow request 362.615648 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:34:16.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:15 smithi092 ceph-mon[29156]: 6 slow requests, 1 included below; oldest blocked for > 39853.073106 secs 2024-04-27T05:34:16.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:15 smithi092 ceph-mon[29156]: slow request 362.615648 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:34:16.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:15 smithi189 ceph-mon[32756]: 6 slow requests, 1 included below; oldest blocked for > 39853.073106 secs 2024-04-27T05:34:16.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:15 smithi189 ceph-mon[32756]: slow request 362.615648 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:34:17.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:16 smithi156 ceph-mon[32679]: pgmap v21974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:17.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:16 smithi092 ceph-mon[29156]: pgmap v21974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:17.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:16 smithi189 ceph-mon[32756]: pgmap v21974: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:19.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:18 smithi156 ceph-mon[32679]: pgmap v21975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:19.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:18 smithi092 ceph-mon[29156]: pgmap v21975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:19.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:18 smithi189 ceph-mon[32756]: pgmap v21975: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:20.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40555.111779 secs 2024-04-27T05:34:20.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40555.111779 secs 2024-04-27T05:34:20.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40555.111779 secs 2024-04-27T05:34:21.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:20 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39858.073228 secs 2024-04-27T05:34:21.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:20 smithi156 ceph-mon[32679]: pgmap v21976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:21.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:20 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39858.073228 secs 2024-04-27T05:34:21.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:20 smithi092 ceph-mon[29156]: pgmap v21976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:21.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:20 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39858.073228 secs 2024-04-27T05:34:21.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:20 smithi189 ceph-mon[32756]: pgmap v21976: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:23.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:22 smithi156 ceph-mon[32679]: pgmap v21977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:23.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:22 smithi092 ceph-mon[29156]: pgmap v21977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:23.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:22 smithi189 ceph-mon[32756]: pgmap v21977: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:25.180 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:24 smithi156 ceph-mon[32679]: pgmap v21978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:25.181 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40560.111895 secs 2024-04-27T05:34:25.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:24 smithi092 ceph-mon[29156]: pgmap v21978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:25.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40560.111895 secs 2024-04-27T05:34:25.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:24 smithi189 ceph-mon[32756]: pgmap v21978: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:25.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40560.111895 secs 2024-04-27T05:34:26.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:25 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39863.073288 secs 2024-04-27T05:34:26.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:25 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39863.073288 secs 2024-04-27T05:34:26.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:25 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39863.073288 secs 2024-04-27T05:34:27.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:26 smithi092 ceph-mon[29156]: pgmap v21979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:27.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:26 smithi189 ceph-mon[32756]: pgmap v21979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:27.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:26 smithi156 ceph-mon[32679]: pgmap v21979: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:29.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:28 smithi092 ceph-mon[29156]: pgmap v21980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:29.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:28 smithi189 ceph-mon[32756]: pgmap v21980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:29.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:28 smithi156 ceph-mon[32679]: pgmap v21980: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:30.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40565.112016 secs 2024-04-27T05:34:30.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40565.112016 secs 2024-04-27T05:34:30.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40565.112016 secs 2024-04-27T05:34:31.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:30 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39868.073386 secs 2024-04-27T05:34:31.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:30 smithi092 ceph-mon[29156]: pgmap v21981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:31.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:30 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39868.073386 secs 2024-04-27T05:34:31.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:30 smithi189 ceph-mon[32756]: pgmap v21981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:31.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:30 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39868.073386 secs 2024-04-27T05:34:31.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:30 smithi156 ceph-mon[32679]: pgmap v21981: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:33.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:32 smithi092 ceph-mon[29156]: pgmap v21982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:33.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:32 smithi189 ceph-mon[32756]: pgmap v21982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:33.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:32 smithi156 ceph-mon[32679]: pgmap v21982: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:35.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:34 smithi156 ceph-mon[32679]: pgmap v21983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:35.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40570.112127 secs 2024-04-27T05:34:35.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:34 smithi092 ceph-mon[29156]: pgmap v21983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:35.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40570.112127 secs 2024-04-27T05:34:35.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:34 smithi189 ceph-mon[32756]: pgmap v21983: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:35.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40570.112127 secs 2024-04-27T05:34:36.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:35 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39873.073530 secs 2024-04-27T05:34:36.286 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:35 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39873.073530 secs 2024-04-27T05:34:36.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:35 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39873.073530 secs 2024-04-27T05:34:37.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:36 smithi092 ceph-mon[29156]: pgmap v21984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:37.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:36 smithi189 ceph-mon[32756]: pgmap v21984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:37.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:36 smithi156 ceph-mon[32679]: pgmap v21984: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:39.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:38 smithi092 ceph-mon[29156]: pgmap v21985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:39.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:38 smithi189 ceph-mon[32756]: pgmap v21985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:39.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:38 smithi156 ceph-mon[32679]: pgmap v21985: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:40.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40575.112245 secs 2024-04-27T05:34:40.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40575.112245 secs 2024-04-27T05:34:40.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40575.112245 secs 2024-04-27T05:34:41.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39878.073652 secs 2024-04-27T05:34:41.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:40 smithi092 ceph-mon[29156]: pgmap v21986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:41.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39878.073652 secs 2024-04-27T05:34:41.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:40 smithi189 ceph-mon[32756]: pgmap v21986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:41.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39878.073652 secs 2024-04-27T05:34:41.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:40 smithi156 ceph-mon[32679]: pgmap v21986: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:43.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:42 smithi092 ceph-mon[29156]: pgmap v21987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:43.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:42 smithi189 ceph-mon[32756]: pgmap v21987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:43.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:42 smithi156 ceph-mon[32679]: pgmap v21987: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:44.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:43 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:34:44.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:43 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:34:44.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:43 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:34:45.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: pgmap v21988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:45.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40580.112338 secs 2024-04-27T05:34:45.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.241 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:44 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: pgmap v21988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40580.112338 secs 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.331 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:44 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: pgmap v21988: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40580.112338 secs 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:45.359 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:44 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:46.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:45 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39883.073739 secs 2024-04-27T05:34:46.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:45 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39883.073739 secs 2024-04-27T05:34:46.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:45 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39883.073739 secs 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: pgmap v21989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.240 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:46 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: pgmap v21989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:46 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: pgmap v21989: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:47.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:46 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:48.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: pgmap v21990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: pgmap v21991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:48.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:48.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.430 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:34:48.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:34:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:34:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: pgmap v21990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: pgmap v21991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:48.432 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:48.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.490 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi156 to 176.2M 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi156 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi092 to 176.2M 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi092 to 184783872: error parsing value: Value '184783872' is below minimum 939524096 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-27T05:34:48.491 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Adjusting osd_memory_target on smithi189 to 176.2M 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: Unable to set osd_memory_target on smithi189 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: pgmap v21990: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: pgmap v21991: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:48.492 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:34:49.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40585.112453 secs 2024-04-27T05:34:49.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40585.112453 secs 2024-04-27T05:34:49.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40585.112453 secs 2024-04-27T05:34:50.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:50 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39888.073816 secs 2024-04-27T05:34:50.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:50 smithi156 ceph-mon[32679]: pgmap v21992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:50.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:50 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39888.073816 secs 2024-04-27T05:34:50.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:50 smithi092 ceph-mon[29156]: pgmap v21992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:50.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:50 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39888.073816 secs 2024-04-27T05:34:50.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:50 smithi189 ceph-mon[32756]: pgmap v21992: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:52.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:52 smithi156 ceph-mon[32679]: pgmap v21993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:52.729 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:52 smithi092 ceph-mon[29156]: pgmap v21993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:52.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:52 smithi189 ceph-mon[32756]: pgmap v21993: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:54.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:54 smithi156 ceph-mon[32679]: pgmap v21994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:34:54.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40590.112592 secs 2024-04-27T05:34:54.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:54 smithi092 ceph-mon[29156]: pgmap v21994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:34:54.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40590.112592 secs 2024-04-27T05:34:54.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:54 smithi189 ceph-mon[32756]: pgmap v21994: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 2 op/s 2024-04-27T05:34:54.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40590.112592 secs 2024-04-27T05:34:55.680 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:55 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39893.073902 secs 2024-04-27T05:34:55.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:55 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39893.073902 secs 2024-04-27T05:34:55.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:55 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39893.073902 secs 2024-04-27T05:34:56.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:56 smithi092 ceph-mon[29156]: pgmap v21995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:56.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:56 smithi189 ceph-mon[32756]: pgmap v21995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:56.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:56 smithi156 ceph-mon[32679]: pgmap v21995: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-04-27T05:34:58.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:58 smithi092 ceph-mon[29156]: pgmap v21996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:34:58.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:58 smithi189 ceph-mon[32756]: pgmap v21996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:34:58.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:58 smithi156 ceph-mon[32679]: pgmap v21996: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:34:59.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:34:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40595.112730 secs 2024-04-27T05:34:59.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:34:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40595.112730 secs 2024-04-27T05:34:59.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:34:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40595.112730 secs 2024-04-27T05:35:00.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:00 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39898.074017 secs 2024-04-27T05:35:00.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:00 smithi092 ceph-mon[29156]: pgmap v21997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:00.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:00 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39898.074017 secs 2024-04-27T05:35:00.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:00 smithi189 ceph-mon[32756]: pgmap v21997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:00.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:00 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39898.074017 secs 2024-04-27T05:35:00.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:00 smithi156 ceph-mon[32679]: pgmap v21997: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:02.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:02 smithi092 ceph-mon[29156]: pgmap v21998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:02.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:02 smithi189 ceph-mon[32756]: pgmap v21998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:02.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:02 smithi156 ceph-mon[32679]: pgmap v21998: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:04.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:04 smithi092 ceph-mon[29156]: pgmap v21999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:04.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40600.112847 secs 2024-04-27T05:35:04.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:04 smithi189 ceph-mon[32756]: pgmap v21999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:04.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40600.112847 secs 2024-04-27T05:35:04.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:04 smithi156 ceph-mon[32679]: pgmap v21999: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:04.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40600.112847 secs 2024-04-27T05:35:05.740 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:05 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39903.074141 secs 2024-04-27T05:35:05.831 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:05 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39903.074141 secs 2024-04-27T05:35:05.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:05 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39903.074141 secs 2024-04-27T05:35:06.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:06 smithi092 ceph-mon[29156]: pgmap v22000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:06.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:06 smithi189 ceph-mon[32756]: pgmap v22000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:06.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:06 smithi156 ceph-mon[32679]: pgmap v22000: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:08.739 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:08 smithi092 ceph-mon[29156]: pgmap v22001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:08.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:08 smithi189 ceph-mon[32756]: pgmap v22001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:08.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:08 smithi156 ceph-mon[32679]: pgmap v22001: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:09.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40605.112911 secs 2024-04-27T05:35:09.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40605.112911 secs 2024-04-27T05:35:09.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40605.112911 secs 2024-04-27T05:35:10.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39908.074273 secs 2024-04-27T05:35:10.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:10 smithi189 ceph-mon[32756]: pgmap v22002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:10.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39908.074273 secs 2024-04-27T05:35:10.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:10 smithi156 ceph-mon[32679]: pgmap v22002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:10.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39908.074273 secs 2024-04-27T05:35:10.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:10 smithi092 ceph-mon[29156]: pgmap v22002: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:35:11.555+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:35:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:35:11.555+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:35:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:35:11.555+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:35:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:35:11.555+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 312 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:35:12.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:12 smithi189 ceph-mon[32756]: pgmap v22003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:12.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:12 smithi156 ceph-mon[32679]: pgmap v22003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:12.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:12 smithi092 ceph-mon[29156]: pgmap v22003: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:14.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:14 smithi189 ceph-mon[32756]: pgmap v22004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:14.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:14 smithi189 ceph-mon[32756]: 19 slow requests, 1 included below; oldest blocked for > 40610.112990 secs 2024-04-27T05:35:14.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:14 smithi189 ceph-mon[32756]: slow request 722.497400 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:35:14.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:14 smithi156 ceph-mon[32679]: pgmap v22004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:14.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:14 smithi156 ceph-mon[32679]: 19 slow requests, 1 included below; oldest blocked for > 40610.112990 secs 2024-04-27T05:35:14.930 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:14 smithi156 ceph-mon[32679]: slow request 722.497400 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:35:14.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:14 smithi092 ceph-mon[29156]: pgmap v22004: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:14.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:14 smithi092 ceph-mon[29156]: 19 slow requests, 1 included below; oldest blocked for > 40610.112990 secs 2024-04-27T05:35:14.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:14 smithi092 ceph-mon[29156]: slow request 722.497400 seconds old, received at 2024-04-27T05:23:11.531331+0000: client_request(client.17595:1 getattr pAsLsXsFs #0x1 2024-04-27T05:23:11.527269+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:35:15.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:15 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39913.074362 secs 2024-04-27T05:35:15.891 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:15 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39913.074362 secs 2024-04-27T05:35:15.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:15 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39913.074362 secs 2024-04-27T05:35:16.884 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:16 smithi189 ceph-mon[32756]: pgmap v22005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:16.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:16 smithi156 ceph-mon[32679]: pgmap v22005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:16.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:16 smithi092 ceph-mon[29156]: pgmap v22005: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:18.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:18 smithi189 ceph-mon[32756]: pgmap v22006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:18.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:18 smithi156 ceph-mon[32679]: pgmap v22006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:18.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:18 smithi092 ceph-mon[29156]: pgmap v22006: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:19.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40615.113102 secs 2024-04-27T05:35:19.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40615.113102 secs 2024-04-27T05:35:19.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40615.113102 secs 2024-04-27T05:35:20.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:20 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39918.074472 secs 2024-04-27T05:35:20.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:20 smithi189 ceph-mon[32756]: pgmap v22007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:20.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:20 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39918.074472 secs 2024-04-27T05:35:20.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:20 smithi156 ceph-mon[32679]: pgmap v22007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:20.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:20 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39918.074472 secs 2024-04-27T05:35:20.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:20 smithi092 ceph-mon[29156]: pgmap v22007: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:22.883 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:22 smithi189 ceph-mon[32756]: pgmap v22008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:22.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:22 smithi156 ceph-mon[32679]: pgmap v22008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:22.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:22 smithi092 ceph-mon[29156]: pgmap v22008: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:24.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:24 smithi156 ceph-mon[32679]: pgmap v22009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:24.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40620.113238 secs 2024-04-27T05:35:24.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:24 smithi092 ceph-mon[29156]: pgmap v22009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:24.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40620.113238 secs 2024-04-27T05:35:25.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:24 smithi189 ceph-mon[32756]: pgmap v22009: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:25.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40620.113238 secs 2024-04-27T05:35:25.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:25 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39923.074584 secs 2024-04-27T05:35:25.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:25 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39923.074584 secs 2024-04-27T05:35:26.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:25 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39923.074584 secs 2024-04-27T05:35:26.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:26 smithi156 ceph-mon[32679]: pgmap v22010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:26.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:26 smithi092 ceph-mon[29156]: pgmap v22010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:27.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:26 smithi189 ceph-mon[32756]: pgmap v22010: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:28.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:28 smithi156 ceph-mon[32679]: pgmap v22011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:28.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:28 smithi092 ceph-mon[29156]: pgmap v22011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:29.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:28 smithi189 ceph-mon[32756]: pgmap v22011: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:29.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40625.113373 secs 2024-04-27T05:35:29.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40625.113373 secs 2024-04-27T05:35:30.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40625.113373 secs 2024-04-27T05:35:30.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:30 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39928.074658 secs 2024-04-27T05:35:30.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:30 smithi156 ceph-mon[32679]: pgmap v22012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:30.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:30 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39928.074658 secs 2024-04-27T05:35:30.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:30 smithi092 ceph-mon[29156]: pgmap v22012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:31.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:30 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39928.074658 secs 2024-04-27T05:35:31.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:30 smithi189 ceph-mon[32756]: pgmap v22012: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:32.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:32 smithi156 ceph-mon[32679]: pgmap v22013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:32.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:32 smithi092 ceph-mon[29156]: pgmap v22013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:33.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:32 smithi189 ceph-mon[32756]: pgmap v22013: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:34.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:34 smithi156 ceph-mon[32679]: pgmap v22014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:34.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40630.113435 secs 2024-04-27T05:35:34.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:34 smithi092 ceph-mon[29156]: pgmap v22014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:34.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40630.113435 secs 2024-04-27T05:35:35.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:34 smithi189 ceph-mon[32756]: pgmap v22014: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:35.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40630.113435 secs 2024-04-27T05:35:35.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:35 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39933.074789 secs 2024-04-27T05:35:35.990 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:35 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39933.074789 secs 2024-04-27T05:35:36.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:35 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39933.074789 secs 2024-04-27T05:35:36.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:36 smithi156 ceph-mon[32679]: pgmap v22015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:36.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:36 smithi092 ceph-mon[29156]: pgmap v22015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:37.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:36 smithi189 ceph-mon[32756]: pgmap v22015: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:38.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:38 smithi156 ceph-mon[32679]: pgmap v22016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:38.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:38 smithi092 ceph-mon[29156]: pgmap v22016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:39.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:38 smithi189 ceph-mon[32756]: pgmap v22016: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:39.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40635.113560 secs 2024-04-27T05:35:39.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40635.113560 secs 2024-04-27T05:35:40.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40635.113560 secs 2024-04-27T05:35:40.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:40 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39938.074849 secs 2024-04-27T05:35:40.929 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:40 smithi156 ceph-mon[32679]: pgmap v22017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:40.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:40 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39938.074849 secs 2024-04-27T05:35:40.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:40 smithi092 ceph-mon[29156]: pgmap v22017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:41.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:40 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39938.074849 secs 2024-04-27T05:35:41.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:40 smithi189 ceph-mon[32756]: pgmap v22017: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:42.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:42 smithi092 ceph-mon[29156]: pgmap v22018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:43.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:42 smithi189 ceph-mon[32756]: pgmap v22018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:43.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:42 smithi156 ceph-mon[32679]: pgmap v22018: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:44.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:44 smithi092 ceph-mon[29156]: pgmap v22019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:44.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40640.113694 secs 2024-04-27T05:35:45.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:44 smithi189 ceph-mon[32756]: pgmap v22019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:45.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40640.113694 secs 2024-04-27T05:35:45.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:44 smithi156 ceph-mon[32679]: pgmap v22019: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:45.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40640.113694 secs 2024-04-27T05:35:45.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:45 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39943.074968 secs 2024-04-27T05:35:46.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:45 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39943.074968 secs 2024-04-27T05:35:46.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:45 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39943.074968 secs 2024-04-27T05:35:46.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:46 smithi092 ceph-mon[29156]: pgmap v22020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:47.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:46 smithi189 ceph-mon[32756]: pgmap v22020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:47.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:46 smithi156 ceph-mon[32679]: pgmap v22020: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:35:47.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:47 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:35:48.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:47 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:35:48.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:47 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:35:48.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:48 smithi092 ceph-mon[29156]: pgmap v22021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:48.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:35:48.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:35:48.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:35:49.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:48 smithi189 ceph-mon[32756]: pgmap v22021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:49.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:35:49.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:35:49.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:35:49.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:48 smithi156 ceph-mon[32679]: pgmap v22021: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:35:49.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:35:49.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:35:49.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:35:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:49 smithi092 ceph-mon[29156]: pgmap v22022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:35:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:49 smithi092 ceph-mon[29156]: pgmap v22023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:35:49.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40645.113812 secs 2024-04-27T05:35:50.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:49 smithi189 ceph-mon[32756]: pgmap v22022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:35:50.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:49 smithi189 ceph-mon[32756]: pgmap v22023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:35:50.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40645.113812 secs 2024-04-27T05:35:50.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:49 smithi156 ceph-mon[32679]: pgmap v22022: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:35:50.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:49 smithi156 ceph-mon[32679]: pgmap v22023: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:35:50.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40645.113812 secs 2024-04-27T05:35:50.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:50 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39948.075054 secs 2024-04-27T05:35:51.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:50 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39948.075054 secs 2024-04-27T05:35:51.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:50 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39948.075054 secs 2024-04-27T05:35:51.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:51 smithi092 ceph-mon[29156]: pgmap v22024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:52.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:51 smithi189 ceph-mon[32756]: pgmap v22024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:52.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:51 smithi156 ceph-mon[32679]: pgmap v22024: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:53.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:53 smithi092 ceph-mon[29156]: pgmap v22025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:54.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:53 smithi189 ceph-mon[32756]: pgmap v22025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:54.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:53 smithi156 ceph-mon[32679]: pgmap v22025: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:54.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40650.113931 secs 2024-04-27T05:35:55.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40650.113931 secs 2024-04-27T05:35:55.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40650.113931 secs 2024-04-27T05:35:55.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:55 smithi092 ceph-mon[29156]: pgmap v22026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:55.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:55 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39953.075187 secs 2024-04-27T05:35:56.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:55 smithi189 ceph-mon[32756]: pgmap v22026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:56.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:55 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39953.075187 secs 2024-04-27T05:35:56.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:55 smithi156 ceph-mon[32679]: pgmap v22026: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:56.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:55 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39953.075187 secs 2024-04-27T05:35:57.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:57 smithi092 ceph-mon[29156]: pgmap v22027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:58.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:57 smithi189 ceph-mon[32756]: pgmap v22027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:58.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:57 smithi156 ceph-mon[32679]: pgmap v22027: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:35:59.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:59 smithi092 ceph-mon[29156]: pgmap v22028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:35:59.989 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:35:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40655.114046 secs 2024-04-27T05:36:00.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:59 smithi189 ceph-mon[32756]: pgmap v22028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:36:00.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:35:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40655.114046 secs 2024-04-27T05:36:00.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:59 smithi156 ceph-mon[32679]: pgmap v22028: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:36:00.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:35:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40655.114046 secs 2024-04-27T05:36:00.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:00 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39958.075320 secs 2024-04-27T05:36:01.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:00 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39958.075320 secs 2024-04-27T05:36:01.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:00 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39958.075320 secs 2024-04-27T05:36:01.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:01 smithi092 ceph-mon[29156]: pgmap v22029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:02.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:01 smithi189 ceph-mon[32756]: pgmap v22029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:02.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:01 smithi156 ceph-mon[32679]: pgmap v22029: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:03.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:03 smithi092 ceph-mon[29156]: pgmap v22030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:04.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:03 smithi189 ceph-mon[32756]: pgmap v22030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:04.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:03 smithi156 ceph-mon[32679]: pgmap v22030: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:05.080 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40660.114165 secs 2024-04-27T05:36:05.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40660.114165 secs 2024-04-27T05:36:05.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40660.114165 secs 2024-04-27T05:36:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:05 smithi189 ceph-mon[32756]: pgmap v22031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:06.034 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:05 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39963.075437 secs 2024-04-27T05:36:06.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:05 smithi156 ceph-mon[32679]: pgmap v22031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:06.179 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:05 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39963.075437 secs 2024-04-27T05:36:06.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:05 smithi092 ceph-mon[29156]: pgmap v22031: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:06.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:05 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39963.075437 secs 2024-04-27T05:36:08.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:07 smithi189 ceph-mon[32756]: pgmap v22032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:08.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:07 smithi156 ceph-mon[32679]: pgmap v22032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:08.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:07 smithi092 ceph-mon[29156]: pgmap v22032: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:10.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:09 smithi189 ceph-mon[32756]: pgmap v22033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:10.133 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40665.114286 secs 2024-04-27T05:36:10.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:09 smithi156 ceph-mon[32679]: pgmap v22033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:10.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40665.114286 secs 2024-04-27T05:36:10.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:09 smithi092 ceph-mon[29156]: pgmap v22033: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:10.239 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40665.114286 secs 2024-04-27T05:36:10.988 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:10 smithi092 ceph-mon[29156]: 6 slow requests, 0 included below; oldest blocked for > 39968.075553 secs 2024-04-27T05:36:11.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:10 smithi189 ceph-mon[32756]: 6 slow requests, 0 included below; oldest blocked for > 39968.075553 secs 2024-04-27T05:36:11.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:10 smithi156 ceph-mon[32679]: 6 slow requests, 0 included below; oldest blocked for > 39968.075553 secs 2024-04-27T05:36:12.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:11 smithi189 ceph-mon[32756]: pgmap v22034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:12.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:11 smithi156 ceph-mon[32679]: pgmap v22034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:12.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:11 smithi092 ceph-mon[29156]: pgmap v22034: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:14.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:13 smithi189 ceph-mon[32756]: pgmap v22035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:14.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:13 smithi156 ceph-mon[32679]: pgmap v22035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:14.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:13 smithi092 ceph-mon[29156]: pgmap v22035: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:15.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40670.114354 secs 2024-04-27T05:36:15.139 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40670.114354 secs 2024-04-27T05:36:15.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40670.114354 secs 2024-04-27T05:36:16.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:15 smithi189 ceph-mon[32756]: pgmap v22036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:16.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:15 smithi189 ceph-mon[32756]: 35 slow requests, 1 included below; oldest blocked for > 39973.075666 secs 2024-04-27T05:36:16.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:15 smithi189 ceph-mon[32756]: slow request 182.491589 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:36:16.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:15 smithi156 ceph-mon[32679]: pgmap v22036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:16.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:15 smithi156 ceph-mon[32679]: 35 slow requests, 1 included below; oldest blocked for > 39973.075666 secs 2024-04-27T05:36:16.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:15 smithi156 ceph-mon[32679]: slow request 182.491589 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:36:16.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:15 smithi092 ceph-mon[29156]: pgmap v22036: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:16.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:15 smithi092 ceph-mon[29156]: 35 slow requests, 1 included below; oldest blocked for > 39973.075666 secs 2024-04-27T05:36:16.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:15 smithi092 ceph-mon[29156]: slow request 182.491589 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently joining batch getattr 2024-04-27T05:36:18.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:17 smithi189 ceph-mon[32756]: pgmap v22037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:18.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:17 smithi156 ceph-mon[32679]: pgmap v22037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:18.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:17 smithi092 ceph-mon[29156]: pgmap v22037: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:19.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:18 smithi189 ceph-mon[32756]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:36:19.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:18 smithi189 ceph-mon[32756]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:36:19.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:18 smithi156 ceph-mon[32679]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:36:19.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:18 smithi156 ceph-mon[32679]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:36:19.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:18 smithi092 ceph-mon[29156]: mds.? [v2:172.21.15.92:6840/430240915,v1:172.21.15.92:6841/430240915] up:active 2024-04-27T05:36:19.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:18 smithi092 ceph-mon[29156]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=j=up:active(laggy or crashed)} 2 up:standby-replay 2024-04-27T05:36:20.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:19 smithi189 ceph-mon[32756]: pgmap v22038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:20.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40675.114442 secs 2024-04-27T05:36:20.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:19 smithi156 ceph-mon[32679]: pgmap v22038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:20.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40675.114442 secs 2024-04-27T05:36:20.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:19 smithi092 ceph-mon[29156]: pgmap v22038: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:20.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40675.114442 secs 2024-04-27T05:36:21.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:20 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 39978.075806 secs 2024-04-27T05:36:21.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:20 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 39978.075806 secs 2024-04-27T05:36:21.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:20 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 39978.075806 secs 2024-04-27T05:36:22.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:21 smithi189 ceph-mon[32756]: pgmap v22039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:22.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:21 smithi156 ceph-mon[32679]: pgmap v22039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:22.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:21 smithi092 ceph-mon[29156]: pgmap v22039: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:24.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:23 smithi189 ceph-mon[32756]: pgmap v22040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:24.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:23 smithi156 ceph-mon[32679]: pgmap v22040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:24.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:23 smithi092 ceph-mon[29156]: pgmap v22040: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:25.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40680.114585 secs 2024-04-27T05:36:25.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40680.114585 secs 2024-04-27T05:36:25.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40680.114585 secs 2024-04-27T05:36:26.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:25 smithi189 ceph-mon[32756]: pgmap v22041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:26.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:25 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 39983.075920 secs 2024-04-27T05:36:26.139 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:25 smithi092 ceph-mon[29156]: pgmap v22041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:26.139 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:25 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 39983.075920 secs 2024-04-27T05:36:26.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:25 smithi156 ceph-mon[32679]: pgmap v22041: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:26.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:25 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 39983.075920 secs 2024-04-27T05:36:28.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:27 smithi189 ceph-mon[32756]: pgmap v22042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:28.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:27 smithi156 ceph-mon[32679]: pgmap v22042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:28.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:27 smithi092 ceph-mon[29156]: pgmap v22042: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:30.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:29 smithi189 ceph-mon[32756]: pgmap v22043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:30.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40685.114702 secs 2024-04-27T05:36:30.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:29 smithi156 ceph-mon[32679]: pgmap v22043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:30.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40685.114702 secs 2024-04-27T05:36:30.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:29 smithi092 ceph-mon[29156]: pgmap v22043: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:30.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40685.114702 secs 2024-04-27T05:36:31.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:30 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 39988.076014 secs 2024-04-27T05:36:31.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:30 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 39988.076014 secs 2024-04-27T05:36:31.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:30 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 39988.076014 secs 2024-04-27T05:36:32.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:31 smithi189 ceph-mon[32756]: pgmap v22044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:32.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:31 smithi156 ceph-mon[32679]: pgmap v22044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:32.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:31 smithi092 ceph-mon[29156]: pgmap v22044: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:34.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:33 smithi189 ceph-mon[32756]: pgmap v22045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:34.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:33 smithi156 ceph-mon[32679]: pgmap v22045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:34.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:33 smithi092 ceph-mon[29156]: pgmap v22045: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:35.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40690.114861 secs 2024-04-27T05:36:35.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40690.114861 secs 2024-04-27T05:36:35.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40690.114861 secs 2024-04-27T05:36:36.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:35 smithi189 ceph-mon[32756]: pgmap v22046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:36.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:35 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 39993.076137 secs 2024-04-27T05:36:36.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:35 smithi156 ceph-mon[32679]: pgmap v22046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:36.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:35 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 39993.076137 secs 2024-04-27T05:36:36.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:35 smithi092 ceph-mon[29156]: pgmap v22046: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:36.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:35 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 39993.076137 secs 2024-04-27T05:36:38.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:37 smithi189 ceph-mon[32756]: pgmap v22047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:38.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:37 smithi156 ceph-mon[32679]: pgmap v22047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:38.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:37 smithi092 ceph-mon[29156]: pgmap v22047: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:40.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:39 smithi189 ceph-mon[32756]: pgmap v22048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:40.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40695.114998 secs 2024-04-27T05:36:40.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:39 smithi156 ceph-mon[32679]: pgmap v22048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:40.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40695.114998 secs 2024-04-27T05:36:40.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:39 smithi092 ceph-mon[29156]: pgmap v22048: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:40.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40695.114998 secs 2024-04-27T05:36:40.854 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:40 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 39998.076252 secs 2024-04-27T05:36:41.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:40 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 39998.076252 secs 2024-04-27T05:36:41.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:40 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 39998.076252 secs 2024-04-27T05:36:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:36:41.568+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:36:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:36:41.568+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:36:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:36:41.568+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:36:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:36:41.568+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 313 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:36:42.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:41 smithi189 ceph-mon[32756]: pgmap v22049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:42.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:41 smithi156 ceph-mon[32679]: pgmap v22049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:42.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:41 smithi092 ceph-mon[29156]: pgmap v22049: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:44.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:43 smithi189 ceph-mon[32756]: pgmap v22050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:44.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:43 smithi156 ceph-mon[32679]: pgmap v22050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:44.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:43 smithi092 ceph-mon[29156]: pgmap v22050: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:45.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40700.115115 secs 2024-04-27T05:36:45.139 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40700.115115 secs 2024-04-27T05:36:45.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40700.115115 secs 2024-04-27T05:36:46.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:45 smithi189 ceph-mon[32756]: pgmap v22051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:46.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:45 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40003.076370 secs 2024-04-27T05:36:46.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:45 smithi156 ceph-mon[32679]: pgmap v22051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:46.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:45 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40003.076370 secs 2024-04-27T05:36:46.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:45 smithi092 ceph-mon[29156]: pgmap v22051: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:36:46.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:45 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40003.076370 secs 2024-04-27T05:36:48.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:47 smithi189 ceph-mon[32756]: pgmap v22052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:48.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:47 smithi156 ceph-mon[32679]: pgmap v22052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:48.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:47 smithi092 ceph-mon[29156]: pgmap v22052: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:49.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:48 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:36:49.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:48 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:36:49.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:48 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: pgmap v22053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: pgmap v22054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: pgmap v22055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:36:50.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40705.115195 secs 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: pgmap v22053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: pgmap v22054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: pgmap v22055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:36:50.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40705.115195 secs 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: pgmap v22053: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: pgmap v22054: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: pgmap v22055: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:36:50.238 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40705.115195 secs 2024-04-27T05:36:51.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:50 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40008.076478 secs 2024-04-27T05:36:51.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:50 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40008.076478 secs 2024-04-27T05:36:51.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:50 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40008.076478 secs 2024-04-27T05:36:52.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:51 smithi189 ceph-mon[32756]: pgmap v22056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:52.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:51 smithi156 ceph-mon[32679]: pgmap v22056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:52.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:51 smithi092 ceph-mon[29156]: pgmap v22056: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:53.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:53 smithi189 ceph-mon[32756]: pgmap v22057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:36:53.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:53 smithi156 ceph-mon[32679]: pgmap v22057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:36:53.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:53 smithi092 ceph-mon[29156]: pgmap v22057: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:36:54.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40710.115314 secs 2024-04-27T05:36:54.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40710.115314 secs 2024-04-27T05:36:54.881 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40710.115314 secs 2024-04-27T05:36:55.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:55 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40013.076607 secs 2024-04-27T05:36:55.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:55 smithi092 ceph-mon[29156]: pgmap v22058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:55.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:55 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40013.076607 secs 2024-04-27T05:36:55.882 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:55 smithi189 ceph-mon[32756]: pgmap v22058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:55.927 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:55 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40013.076607 secs 2024-04-27T05:36:55.928 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:55 smithi156 ceph-mon[32679]: pgmap v22058: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:57.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:57 smithi189 ceph-mon[32756]: pgmap v22059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:57.428 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:57 smithi156 ceph-mon[32679]: pgmap v22059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:57.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:57 smithi092 ceph-mon[29156]: pgmap v22059: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:36:59.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:36:59 smithi189 ceph-mon[32756]: pgmap v22060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:36:59.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:36:59 smithi156 ceph-mon[32679]: pgmap v22060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:36:59.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:36:59 smithi092 ceph-mon[29156]: pgmap v22060: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:37:00.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:00 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40715.115404 secs 2024-04-27T05:37:00.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:00 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40715.115404 secs 2024-04-27T05:37:00.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:00 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40715.115404 secs 2024-04-27T05:37:01.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:01 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40018.076743 secs 2024-04-27T05:37:01.382 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:01 smithi189 ceph-mon[32756]: pgmap v22061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:01.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:01 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40018.076743 secs 2024-04-27T05:37:01.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:01 smithi156 ceph-mon[32679]: pgmap v22061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:01.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:01 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40018.076743 secs 2024-04-27T05:37:01.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:01 smithi092 ceph-mon[29156]: pgmap v22061: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:03.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:03 smithi189 ceph-mon[32756]: pgmap v22062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:03.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:03 smithi156 ceph-mon[32679]: pgmap v22062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:03.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:03 smithi092 ceph-mon[29156]: pgmap v22062: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:04.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40720.115522 secs 2024-04-27T05:37:04.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40720.115522 secs 2024-04-27T05:37:04.881 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40720.115522 secs 2024-04-27T05:37:05.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:05 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40023.076853 secs 2024-04-27T05:37:05.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:05 smithi092 ceph-mon[29156]: pgmap v22063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:05.881 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:05 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40023.076853 secs 2024-04-27T05:37:05.881 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:05 smithi189 ceph-mon[32756]: pgmap v22063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:05.927 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:05 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40023.076853 secs 2024-04-27T05:37:05.927 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:05 smithi156 ceph-mon[32679]: pgmap v22063: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:07.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:07 smithi189 ceph-mon[32756]: pgmap v22064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:07.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:07 smithi156 ceph-mon[32679]: pgmap v22064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:07.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:07 smithi092 ceph-mon[29156]: pgmap v22064: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:09.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:09 smithi189 ceph-mon[32756]: pgmap v22065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:09.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:09 smithi156 ceph-mon[32679]: pgmap v22065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:09.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:09 smithi092 ceph-mon[29156]: pgmap v22065: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:10.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:10 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40725.115639 secs 2024-04-27T05:37:10.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:10 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40028.076952 secs 2024-04-27T05:37:10.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:10 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40725.115639 secs 2024-04-27T05:37:10.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:10 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40028.076952 secs 2024-04-27T05:37:10.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:10 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40725.115639 secs 2024-04-27T05:37:10.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:10 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40028.076952 secs 2024-04-27T05:37:11.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:11 smithi189 ceph-mon[32756]: pgmap v22066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:11.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:11 smithi156 ceph-mon[32679]: pgmap v22066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:11.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:11 smithi092 ceph-mon[29156]: pgmap v22066: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:13.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:13 smithi189 ceph-mon[32756]: pgmap v22067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:13.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:13 smithi156 ceph-mon[32679]: pgmap v22067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:13.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:13 smithi092 ceph-mon[29156]: pgmap v22067: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:14.632 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:14 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40033.077027 secs 2024-04-27T05:37:14.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:14 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40033.077027 secs 2024-04-27T05:37:14.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:14 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40033.077027 secs 2024-04-27T05:37:15.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:15 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40730.115751 secs 2024-04-27T05:37:15.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:15 smithi189 ceph-mon[32756]: pgmap v22068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:15.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:15 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40730.115751 secs 2024-04-27T05:37:15.639 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:15 smithi092 ceph-mon[29156]: pgmap v22068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:15.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:15 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40730.115751 secs 2024-04-27T05:37:15.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:15 smithi156 ceph-mon[32679]: pgmap v22068: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:17.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:17 smithi189 ceph-mon[32756]: pgmap v22069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:17.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:17 smithi156 ceph-mon[32679]: pgmap v22069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:17.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:17 smithi092 ceph-mon[29156]: pgmap v22069: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:19.383 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:19 smithi189 ceph-mon[32756]: pgmap v22070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:19.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:19 smithi156 ceph-mon[32679]: pgmap v22070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:19.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:19 smithi092 ceph-mon[29156]: pgmap v22070: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:20.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:20 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40735.115877 secs 2024-04-27T05:37:20.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:20 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40038.077134 secs 2024-04-27T05:37:20.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:20 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40735.115877 secs 2024-04-27T05:37:20.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:20 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40038.077134 secs 2024-04-27T05:37:20.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:20 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40735.115877 secs 2024-04-27T05:37:20.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:20 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40038.077134 secs 2024-04-27T05:37:21.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:21 smithi189 ceph-mon[32756]: pgmap v22071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:21.429 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:21 smithi156 ceph-mon[32679]: pgmap v22071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:21.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:21 smithi092 ceph-mon[29156]: pgmap v22071: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:23.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:23 smithi189 ceph-mon[32756]: pgmap v22072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:23.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:23 smithi156 ceph-mon[32679]: pgmap v22072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:23.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:23 smithi092 ceph-mon[29156]: pgmap v22072: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:24.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:24 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40043.077253 secs 2024-04-27T05:37:24.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:24 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40043.077253 secs 2024-04-27T05:37:24.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:24 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40043.077253 secs 2024-04-27T05:37:25.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:25 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40740.115943 secs 2024-04-27T05:37:25.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:25 smithi189 ceph-mon[32756]: pgmap v22073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:25.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:25 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40740.115943 secs 2024-04-27T05:37:25.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:25 smithi156 ceph-mon[32679]: pgmap v22073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:25.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:25 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40740.115943 secs 2024-04-27T05:37:25.738 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:25 smithi092 ceph-mon[29156]: pgmap v22073: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:27.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:27 smithi189 ceph-mon[32756]: pgmap v22074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:27.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:27 smithi156 ceph-mon[32679]: pgmap v22074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:27.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:27 smithi092 ceph-mon[29156]: pgmap v22074: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:29.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:29 smithi189 ceph-mon[32756]: pgmap v22075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:29.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:29 smithi156 ceph-mon[32679]: pgmap v22075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:29.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:29 smithi092 ceph-mon[29156]: pgmap v22075: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:30.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:30 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40745.116064 secs 2024-04-27T05:37:30.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:30 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40048.077307 secs 2024-04-27T05:37:30.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:30 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40745.116064 secs 2024-04-27T05:37:30.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:30 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40048.077307 secs 2024-04-27T05:37:30.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:30 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40745.116064 secs 2024-04-27T05:37:30.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:30 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40048.077307 secs 2024-04-27T05:37:31.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:31 smithi189 ceph-mon[32756]: pgmap v22076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:31.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:31 smithi156 ceph-mon[32679]: pgmap v22076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:31.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:31 smithi092 ceph-mon[29156]: pgmap v22076: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:33.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:33 smithi189 ceph-mon[32756]: pgmap v22077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:33.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:33 smithi156 ceph-mon[32679]: pgmap v22077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:33.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:33 smithi092 ceph-mon[29156]: pgmap v22077: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:34.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:34 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40053.077407 secs 2024-04-27T05:37:34.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:34 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40053.077407 secs 2024-04-27T05:37:34.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:34 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40053.077407 secs 2024-04-27T05:37:35.578 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:35 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40750.116145 secs 2024-04-27T05:37:35.579 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:35 smithi156 ceph-mon[32679]: pgmap v22078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:35.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:35 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40750.116145 secs 2024-04-27T05:37:35.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:35 smithi189 ceph-mon[32756]: pgmap v22078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:35.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:35 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40750.116145 secs 2024-04-27T05:37:35.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:35 smithi092 ceph-mon[29156]: pgmap v22078: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:37.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:37 smithi189 ceph-mon[32756]: pgmap v22079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:37.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:37 smithi156 ceph-mon[32679]: pgmap v22079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:37.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:37 smithi092 ceph-mon[29156]: pgmap v22079: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:39.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:39 smithi189 ceph-mon[32756]: pgmap v22080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:39.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:39 smithi156 ceph-mon[32679]: pgmap v22080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:39.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:39 smithi092 ceph-mon[29156]: pgmap v22080: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:40.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:40 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40755.116238 secs 2024-04-27T05:37:40.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:40 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40058.077532 secs 2024-04-27T05:37:40.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:40 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40755.116238 secs 2024-04-27T05:37:40.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:40 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40058.077532 secs 2024-04-27T05:37:40.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:40 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40755.116238 secs 2024-04-27T05:37:40.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:40 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40058.077532 secs 2024-04-27T05:37:41.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:41 smithi189 ceph-mon[32756]: pgmap v22081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:41.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:41 smithi156 ceph-mon[32679]: pgmap v22081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:41.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:41 smithi092 ceph-mon[29156]: pgmap v22081: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:43.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:43 smithi189 ceph-mon[32756]: pgmap v22082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:43.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:43 smithi156 ceph-mon[32679]: pgmap v22082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:43.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:43 smithi092 ceph-mon[29156]: pgmap v22082: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:44.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:44 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40063.077610 secs 2024-04-27T05:37:44.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:44 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40063.077610 secs 2024-04-27T05:37:44.737 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:44 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40063.077610 secs 2024-04-27T05:37:45.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:45 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40760.116370 secs 2024-04-27T05:37:45.631 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:45 smithi189 ceph-mon[32756]: pgmap v22083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:45.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:45 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40760.116370 secs 2024-04-27T05:37:45.638 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:45 smithi092 ceph-mon[29156]: pgmap v22083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:45.676 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:45 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40760.116370 secs 2024-04-27T05:37:45.677 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:45 smithi156 ceph-mon[32679]: pgmap v22083: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:47.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:47 smithi189 ceph-mon[32756]: pgmap v22084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:47.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:47 smithi156 ceph-mon[32679]: pgmap v22084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:47.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:47 smithi092 ceph-mon[29156]: pgmap v22084: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:37:49.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:49 smithi189 ceph-mon[32756]: pgmap v22085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:49.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:49 smithi156 ceph-mon[32679]: pgmap v22085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:49.486 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:49 smithi092 ceph-mon[29156]: pgmap v22085: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40765.116462 secs 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40068.077680 secs 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: pgmap v22086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: pgmap v22087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:50.381 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40765.116462 secs 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40068.077680 secs 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: pgmap v22086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: pgmap v22087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:50.427 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:37:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40765.116462 secs 2024-04-27T05:37:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:37:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40068.077680 secs 2024-04-27T05:37:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:37:50.487 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:37:50.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: pgmap v22086: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:37:50.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: pgmap v22087: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:50.488 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:37:53.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:52 smithi189 ceph-mon[32756]: pgmap v22088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:53.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:52 smithi156 ceph-mon[32679]: pgmap v22088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:53.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:52 smithi092 ceph-mon[29156]: pgmap v22088: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:55.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:54 smithi189 ceph-mon[32756]: pgmap v22089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:55.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40770.116587 secs 2024-04-27T05:37:55.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:54 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40073.077789 secs 2024-04-27T05:37:55.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:54 smithi156 ceph-mon[32679]: pgmap v22089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:55.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40770.116587 secs 2024-04-27T05:37:55.177 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:54 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40073.077789 secs 2024-04-27T05:37:55.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:54 smithi092 ceph-mon[29156]: pgmap v22089: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:55.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40770.116587 secs 2024-04-27T05:37:55.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:54 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40073.077789 secs 2024-04-27T05:37:57.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:56 smithi189 ceph-mon[32756]: pgmap v22090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:57.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:56 smithi156 ceph-mon[32679]: pgmap v22090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:57.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:56 smithi092 ceph-mon[29156]: pgmap v22090: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:37:59.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:58 smithi189 ceph-mon[32756]: pgmap v22091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:37:59.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:58 smithi156 ceph-mon[32679]: pgmap v22091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:37:59.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:58 smithi092 ceph-mon[29156]: pgmap v22091: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:37:59.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40775.116707 secs 2024-04-27T05:37:59.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:37:59 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40078.077932 secs 2024-04-27T05:38:00.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40775.116707 secs 2024-04-27T05:38:00.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:37:59 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40078.077932 secs 2024-04-27T05:38:00.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40775.116707 secs 2024-04-27T05:38:00.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:37:59 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40078.077932 secs 2024-04-27T05:38:01.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:00 smithi189 ceph-mon[32756]: pgmap v22092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:38:01.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:00 smithi156 ceph-mon[32679]: pgmap v22092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:38:01.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:00 smithi092 ceph-mon[29156]: pgmap v22092: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:38:03.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:02 smithi189 ceph-mon[32756]: pgmap v22093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:03.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:02 smithi156 ceph-mon[32679]: pgmap v22093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:03.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:02 smithi092 ceph-mon[29156]: pgmap v22093: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:05.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:04 smithi189 ceph-mon[32756]: pgmap v22094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:05.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40780.116859 secs 2024-04-27T05:38:05.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:04 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40083.078073 secs 2024-04-27T05:38:05.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:04 smithi156 ceph-mon[32679]: pgmap v22094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:05.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40780.116859 secs 2024-04-27T05:38:05.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:04 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40083.078073 secs 2024-04-27T05:38:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:04 smithi092 ceph-mon[29156]: pgmap v22094: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40780.116859 secs 2024-04-27T05:38:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:04 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40083.078073 secs 2024-04-27T05:38:07.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:06 smithi189 ceph-mon[32756]: pgmap v22095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:07.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:06 smithi156 ceph-mon[32679]: pgmap v22095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:07.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:06 smithi092 ceph-mon[29156]: pgmap v22095: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:09.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:08 smithi189 ceph-mon[32756]: pgmap v22096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:09.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:08 smithi156 ceph-mon[32679]: pgmap v22096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:09.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:08 smithi092 ceph-mon[29156]: pgmap v22096: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:10.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40785.116923 secs 2024-04-27T05:38:10.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:09 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40088.078207 secs 2024-04-27T05:38:10.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40785.116923 secs 2024-04-27T05:38:10.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:09 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40088.078207 secs 2024-04-27T05:38:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40785.116923 secs 2024-04-27T05:38:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:09 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40088.078207 secs 2024-04-27T05:38:11.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:10 smithi189 ceph-mon[32756]: pgmap v22097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:11.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:10 smithi156 ceph-mon[32679]: pgmap v22097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:11.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:10 smithi092 ceph-mon[29156]: pgmap v22097: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:12.236 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:38:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:38:11.779+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:38:12.236 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:38:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:38:11.779+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:38:12.236 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:38:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:38:11.779+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:38:12.237 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:38:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:38:11.779+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:38:12.237 INFO:journalctl@ceph.mgr.x.smithi092.stdout:Apr 27 05:38:11 smithi092 ceph-fb3c417a-03f4-11ef-bc93-c7b262605968-mgr-x[29387]: 2024-04-27T05:38:11.779+0000 7f2545578700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-27T05:38:13.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:12 smithi189 ceph-mon[32756]: pgmap v22098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:13.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:12 smithi156 ceph-mon[32679]: pgmap v22098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:13.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:12 smithi092 ceph-mon[29156]: pgmap v22098: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:15.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:14 smithi189 ceph-mon[32756]: pgmap v22099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:15.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40790.117034 secs 2024-04-27T05:38:15.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:14 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40093.078345 secs 2024-04-27T05:38:15.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:14 smithi156 ceph-mon[32679]: pgmap v22099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:15.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40790.117034 secs 2024-04-27T05:38:15.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:14 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40093.078345 secs 2024-04-27T05:38:15.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:14 smithi092 ceph-mon[29156]: pgmap v22099: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:15.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40790.117034 secs 2024-04-27T05:38:15.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:14 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40093.078345 secs 2024-04-27T05:38:17.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:16 smithi189 ceph-mon[32756]: pgmap v22100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:17.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:16 smithi156 ceph-mon[32679]: pgmap v22100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:17.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:16 smithi092 ceph-mon[29156]: pgmap v22100: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:19.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:18 smithi189 ceph-mon[32756]: pgmap v22101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:19.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:18 smithi156 ceph-mon[32679]: pgmap v22101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:19.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:18 smithi092 ceph-mon[29156]: pgmap v22101: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:20.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40795.117100 secs 2024-04-27T05:38:20.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:19 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40098.078465 secs 2024-04-27T05:38:20.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40795.117100 secs 2024-04-27T05:38:20.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:19 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40098.078465 secs 2024-04-27T05:38:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40795.117100 secs 2024-04-27T05:38:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:19 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40098.078465 secs 2024-04-27T05:38:21.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:20 smithi189 ceph-mon[32756]: pgmap v22102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:21.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:20 smithi156 ceph-mon[32679]: pgmap v22102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:21.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:20 smithi092 ceph-mon[29156]: pgmap v22102: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:23.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:22 smithi189 ceph-mon[32756]: pgmap v22103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:23.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:22 smithi156 ceph-mon[32679]: pgmap v22103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:23.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:22 smithi092 ceph-mon[29156]: pgmap v22103: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-04-27T05:38:25.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:24 smithi189 ceph-mon[32756]: pgmap v22104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:25.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40800.117236 secs 2024-04-27T05:38:25.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:24 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40103.078537 secs 2024-04-27T05:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:24 smithi156 ceph-mon[32679]: pgmap v22104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40800.117236 secs 2024-04-27T05:38:25.189 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:24 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40103.078537 secs 2024-04-27T05:38:25.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:24 smithi092 ceph-mon[29156]: pgmap v22104: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-27T05:38:25.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40800.117236 secs 2024-04-27T05:38:25.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:24 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40103.078537 secs 2024-04-27T05:38:27.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:26 smithi189 ceph-mon[32756]: pgmap v22105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:27.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:26 smithi156 ceph-mon[32679]: pgmap v22105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:27.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:26 smithi092 ceph-mon[29156]: pgmap v22105: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:29.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:28 smithi189 ceph-mon[32756]: pgmap v22106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:29.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:28 smithi156 ceph-mon[32679]: pgmap v22106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:29.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:28 smithi092 ceph-mon[29156]: pgmap v22106: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:30.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40805.117315 secs 2024-04-27T05:38:30.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:29 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40108.078652 secs 2024-04-27T05:38:30.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40805.117315 secs 2024-04-27T05:38:30.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:29 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40108.078652 secs 2024-04-27T05:38:30.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40805.117315 secs 2024-04-27T05:38:30.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:29 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40108.078652 secs 2024-04-27T05:38:31.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:30 smithi189 ceph-mon[32756]: pgmap v22107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:31.136 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:30 smithi092 ceph-mon[29156]: pgmap v22107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:31.178 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:30 smithi156 ceph-mon[32679]: pgmap v22107: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:33.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:32 smithi189 ceph-mon[32756]: pgmap v22108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:33.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:32 smithi156 ceph-mon[32679]: pgmap v22108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:33.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:32 smithi092 ceph-mon[29156]: pgmap v22108: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:35.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:34 smithi189 ceph-mon[32756]: pgmap v22109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:35.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40810.117429 secs 2024-04-27T05:38:35.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:34 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40113.078754 secs 2024-04-27T05:38:35.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:34 smithi156 ceph-mon[32679]: pgmap v22109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:35.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40810.117429 secs 2024-04-27T05:38:35.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:34 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40113.078754 secs 2024-04-27T05:38:35.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:34 smithi092 ceph-mon[29156]: pgmap v22109: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:35.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40810.117429 secs 2024-04-27T05:38:35.237 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:34 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40113.078754 secs 2024-04-27T05:38:37.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:36 smithi189 ceph-mon[32756]: pgmap v22110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:37.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:36 smithi156 ceph-mon[32679]: pgmap v22110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:37.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:36 smithi092 ceph-mon[29156]: pgmap v22110: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:39.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:38 smithi156 ceph-mon[32679]: pgmap v22111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:39.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:38 smithi092 ceph-mon[29156]: pgmap v22111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:39.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:38 smithi189 ceph-mon[32756]: pgmap v22111: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:40.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40815.117545 secs 2024-04-27T05:38:40.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:39 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40118.078887 secs 2024-04-27T05:38:40.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40815.117545 secs 2024-04-27T05:38:40.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:39 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40118.078887 secs 2024-04-27T05:38:40.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40815.117545 secs 2024-04-27T05:38:40.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:39 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40118.078887 secs 2024-04-27T05:38:41.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:40 smithi156 ceph-mon[32679]: pgmap v22112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:41.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:40 smithi092 ceph-mon[29156]: pgmap v22112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:41.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:40 smithi189 ceph-mon[32756]: pgmap v22112: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:38:43.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:42 smithi156 ceph-mon[32679]: pgmap v22113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:43.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:42 smithi092 ceph-mon[29156]: pgmap v22113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:43.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:42 smithi189 ceph-mon[32756]: pgmap v22113: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:38:45.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:44 smithi156 ceph-mon[32679]: pgmap v22114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:45.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40820.117646 secs 2024-04-27T05:38:45.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:44 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40123.079004 secs 2024-04-27T05:38:45.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:44 smithi092 ceph-mon[29156]: pgmap v22114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:45.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40820.117646 secs 2024-04-27T05:38:45.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:44 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40123.079004 secs 2024-04-27T05:38:45.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:44 smithi189 ceph-mon[32756]: pgmap v22114: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:45.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40820.117646 secs 2024-04-27T05:38:45.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:44 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40123.079004 secs 2024-04-27T05:38:46.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:46 smithi092 ceph-mon[29156]: pgmap v22115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:47.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:46 smithi156 ceph-mon[32679]: pgmap v22115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:47.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:46 smithi189 ceph-mon[32756]: pgmap v22115: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:49.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:48 smithi156 ceph-mon[32679]: pgmap v22116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:49.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:48 smithi092 ceph-mon[29156]: pgmap v22116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:49.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:48 smithi189 ceph-mon[32756]: pgmap v22116: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:38:50.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40825.117765 secs 2024-04-27T05:38:50.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:49 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40128.079064 secs 2024-04-27T05:38:50.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:49 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:38:50.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40825.117765 secs 2024-04-27T05:38:50.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:49 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40128.079064 secs 2024-04-27T05:38:50.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:49 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:38:50.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40825.117765 secs 2024-04-27T05:38:50.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:49 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40128.079064 secs 2024-04-27T05:38:50.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:49 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:38:51.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:50 smithi156 ceph-mon[32679]: pgmap v22117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:51.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:38:51.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:38:51.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:50 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:38:51.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:50 smithi092 ceph-mon[29156]: pgmap v22117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:51.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:38:51.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:38:51.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:50 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:38:51.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:50 smithi189 ceph-mon[32756]: pgmap v22117: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:38:51.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:38:51.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:38:51.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:50 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:38:52.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:51 smithi156 ceph-mon[32679]: pgmap v22118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:38:52.176 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:51 smithi156 ceph-mon[32679]: pgmap v22119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:38:52.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:51 smithi092 ceph-mon[29156]: pgmap v22118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:38:52.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:51 smithi092 ceph-mon[29156]: pgmap v22119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:38:52.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:51 smithi189 ceph-mon[32756]: pgmap v22118: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3 op/s 2024-04-27T05:38:52.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:51 smithi189 ceph-mon[32756]: pgmap v22119: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-04-27T05:38:54.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:53 smithi156 ceph-mon[32679]: pgmap v22120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:38:54.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:53 smithi092 ceph-mon[29156]: pgmap v22120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:38:54.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:53 smithi189 ceph-mon[32756]: pgmap v22120: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:38:55.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40830.117884 secs 2024-04-27T05:38:55.795 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:54 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40133.079215 secs 2024-04-27T05:38:55.796 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40830.117884 secs 2024-04-27T05:38:55.796 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:54 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40133.079215 secs 2024-04-27T05:38:55.796 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40830.117884 secs 2024-04-27T05:38:55.796 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:54 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40133.079215 secs 2024-04-27T05:38:56.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:55 smithi092 ceph-mon[29156]: pgmap v22121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:38:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:55 smithi189 ceph-mon[32756]: pgmap v22121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:38:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:55 smithi156 ceph-mon[32679]: pgmap v22121: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:38:58.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:57 smithi092 ceph-mon[29156]: pgmap v22122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:38:58.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:57 smithi189 ceph-mon[32756]: pgmap v22122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:38:58.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:57 smithi156 ceph-mon[32679]: pgmap v22122: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:39:00.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:59 smithi092 ceph-mon[29156]: pgmap v22123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:39:00.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40835.118002 secs 2024-04-27T05:39:00.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:38:59 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40138.079361 secs 2024-04-27T05:39:00.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:59 smithi189 ceph-mon[32756]: pgmap v22123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:39:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40835.118002 secs 2024-04-27T05:39:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:38:59 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40138.079361 secs 2024-04-27T05:39:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:59 smithi156 ceph-mon[32679]: pgmap v22123: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:39:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40835.118002 secs 2024-04-27T05:39:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:38:59 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40138.079361 secs 2024-04-27T05:39:02.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:01 smithi092 ceph-mon[29156]: pgmap v22124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:39:02.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:01 smithi189 ceph-mon[32756]: pgmap v22124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:39:02.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:01 smithi156 ceph-mon[32679]: pgmap v22124: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:39:04.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:03 smithi092 ceph-mon[29156]: pgmap v22125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:04.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:03 smithi189 ceph-mon[32756]: pgmap v22125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:04.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:03 smithi156 ceph-mon[32679]: pgmap v22125: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:05.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40840.118108 secs 2024-04-27T05:39:05.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:04 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40143.079480 secs 2024-04-27T05:39:05.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40840.118108 secs 2024-04-27T05:39:05.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:04 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40143.079480 secs 2024-04-27T05:39:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40840.118108 secs 2024-04-27T05:39:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:04 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40143.079480 secs 2024-04-27T05:39:06.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:05 smithi092 ceph-mon[29156]: pgmap v22126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:06.327 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:05 smithi156 ceph-mon[32679]: pgmap v22126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:06.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:05 smithi189 ceph-mon[32756]: pgmap v22126: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:08.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:07 smithi092 ceph-mon[29156]: pgmap v22127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:08.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:07 smithi189 ceph-mon[32756]: pgmap v22127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:08.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:07 smithi156 ceph-mon[32679]: pgmap v22127: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:10.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:09 smithi092 ceph-mon[29156]: pgmap v22128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40845.118225 secs 2024-04-27T05:39:10.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:09 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40148.079614 secs 2024-04-27T05:39:10.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:09 smithi189 ceph-mon[32756]: pgmap v22128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:10.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40845.118225 secs 2024-04-27T05:39:10.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:09 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40148.079614 secs 2024-04-27T05:39:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:09 smithi156 ceph-mon[32679]: pgmap v22128: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:10.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40845.118225 secs 2024-04-27T05:39:10.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:09 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40148.079614 secs 2024-04-27T05:39:12.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:11 smithi092 ceph-mon[29156]: pgmap v22129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:12.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:11 smithi189 ceph-mon[32756]: pgmap v22129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:12.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:11 smithi156 ceph-mon[32679]: pgmap v22129: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:14.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:13 smithi092 ceph-mon[29156]: pgmap v22130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:14.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:13 smithi189 ceph-mon[32756]: pgmap v22130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:14.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:13 smithi156 ceph-mon[32679]: pgmap v22130: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:15.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40850.118324 secs 2024-04-27T05:39:15.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:14 smithi092 ceph-mon[29156]: 35 slow requests, 1 included below; oldest blocked for > 40153.079739 secs 2024-04-27T05:39:15.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:14 smithi092 ceph-mon[29156]: slow request 362.495662 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:15.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40850.118324 secs 2024-04-27T05:39:15.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:14 smithi189 ceph-mon[32756]: 35 slow requests, 1 included below; oldest blocked for > 40153.079739 secs 2024-04-27T05:39:15.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:14 smithi189 ceph-mon[32756]: slow request 362.495662 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:15.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40850.118324 secs 2024-04-27T05:39:15.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:14 smithi156 ceph-mon[32679]: 35 slow requests, 1 included below; oldest blocked for > 40153.079739 secs 2024-04-27T05:39:15.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:14 smithi156 ceph-mon[32679]: slow request 362.495662 seconds old, received at 2024-04-27T05:33:11.730111+0000: client_request(client.17607:1 getattr pAsLsXsFs #0x1 2024-04-27T05:33:11.726459+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:16.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:15 smithi092 ceph-mon[29156]: pgmap v22131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:16.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:15 smithi189 ceph-mon[32756]: pgmap v22131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:16.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:15 smithi156 ceph-mon[32679]: pgmap v22131: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:18.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:17 smithi092 ceph-mon[29156]: pgmap v22132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:18.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:17 smithi189 ceph-mon[32756]: pgmap v22132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:18.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:17 smithi156 ceph-mon[32679]: pgmap v22132: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:20.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:19 smithi092 ceph-mon[29156]: pgmap v22133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40855.118430 secs 2024-04-27T05:39:20.236 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:19 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40158.079873 secs 2024-04-27T05:39:20.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:19 smithi189 ceph-mon[32756]: pgmap v22133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:20.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40855.118430 secs 2024-04-27T05:39:20.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:19 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40158.079873 secs 2024-04-27T05:39:20.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:19 smithi156 ceph-mon[32679]: pgmap v22133: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:20.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40855.118430 secs 2024-04-27T05:39:20.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:19 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40158.079873 secs 2024-04-27T05:39:22.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:21 smithi092 ceph-mon[29156]: pgmap v22134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:22.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:21 smithi189 ceph-mon[32756]: pgmap v22134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:22.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:21 smithi156 ceph-mon[32679]: pgmap v22134: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:24.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:23 smithi092 ceph-mon[29156]: pgmap v22135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:24.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:23 smithi189 ceph-mon[32756]: pgmap v22135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:24.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:23 smithi156 ceph-mon[32679]: pgmap v22135: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:25.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40860.118575 secs 2024-04-27T05:39:25.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:24 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40163.079992 secs 2024-04-27T05:39:25.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40860.118575 secs 2024-04-27T05:39:25.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:24 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40163.079992 secs 2024-04-27T05:39:25.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40860.118575 secs 2024-04-27T05:39:25.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:24 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40163.079992 secs 2024-04-27T05:39:26.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:25 smithi189 ceph-mon[32756]: pgmap v22136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:26.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:25 smithi156 ceph-mon[32679]: pgmap v22136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:26.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:25 smithi092 ceph-mon[29156]: pgmap v22136: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:28.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:28 smithi189 ceph-mon[32756]: pgmap v22137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:28.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:28 smithi156 ceph-mon[32679]: pgmap v22137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:28.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:28 smithi092 ceph-mon[29156]: pgmap v22137: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:30.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:30 smithi189 ceph-mon[32756]: pgmap v22138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:30.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:30 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40865.118695 secs 2024-04-27T05:39:30.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:30 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40168.080114 secs 2024-04-27T05:39:30.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:30 smithi156 ceph-mon[32679]: pgmap v22138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:30.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:30 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40865.118695 secs 2024-04-27T05:39:30.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:30 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40168.080114 secs 2024-04-27T05:39:30.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:30 smithi092 ceph-mon[29156]: pgmap v22138: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:30.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:30 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40865.118695 secs 2024-04-27T05:39:30.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:30 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40168.080114 secs 2024-04-27T05:39:32.384 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:32 smithi189 ceph-mon[32756]: pgmap v22139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:32.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:32 smithi156 ceph-mon[32679]: pgmap v22139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:32.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:32 smithi092 ceph-mon[29156]: pgmap v22139: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:34.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:34 smithi189 ceph-mon[32756]: pgmap v22140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:34.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:34 smithi156 ceph-mon[32679]: pgmap v22140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:34.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:34 smithi092 ceph-mon[29156]: pgmap v22140: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:35.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:35 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40870.118810 secs 2024-04-27T05:39:35.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:35 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40173.080216 secs 2024-04-27T05:39:35.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:35 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40870.118810 secs 2024-04-27T05:39:35.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:35 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40173.080216 secs 2024-04-27T05:39:35.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:35 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40870.118810 secs 2024-04-27T05:39:35.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:35 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40173.080216 secs 2024-04-27T05:39:36.326 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:36 smithi156 ceph-mon[32679]: pgmap v22141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:36.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:36 smithi189 ceph-mon[32756]: pgmap v22141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:36.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:36 smithi092 ceph-mon[29156]: pgmap v22141: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:38.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:38 smithi189 ceph-mon[32756]: pgmap v22142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:38.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:38 smithi156 ceph-mon[32679]: pgmap v22142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:38.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:38 smithi092 ceph-mon[29156]: pgmap v22142: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:40.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:40 smithi189 ceph-mon[32756]: pgmap v22143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:40.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:40 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40875.118937 secs 2024-04-27T05:39:40.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:40 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40178.080329 secs 2024-04-27T05:39:40.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:40 smithi156 ceph-mon[32679]: pgmap v22143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:40.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:40 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40875.118937 secs 2024-04-27T05:39:40.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:40 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40178.080329 secs 2024-04-27T05:39:40.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:40 smithi092 ceph-mon[29156]: pgmap v22143: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:40.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:40 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40875.118937 secs 2024-04-27T05:39:40.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:40 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40178.080329 secs 2024-04-27T05:39:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:39:41.593+0000 7f1c95ff3640 1 -- 172.21.15.92:0/534035708 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:39:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:39:41.593+0000 7f1c9affd640 1 -- 172.21.15.92:0/2399433965 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:39:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:39:41.593+0000 7f1c96ff5640 1 -- 172.21.15.92:0/534035708 <== mon.0 v2:172.21.15.92:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) ==== 409+0+0 (secure 0 0 0) 0x7f1c8c004920 con 0x5617fb906f00 2024-04-27T05:39:41.585 INFO:teuthology.task.background_exec.ubuntu@smithi092.front.sepia.ceph.com.smithi092.stderr:2024-04-27T05:39:41.593+0000 7f1c9bfff640 1 -- 172.21.15.92:0/2399433965 <== mon.0 v2:172.21.15.92:3300/0 314 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7f1c880036c0 con 0x7f1cb4108940 2024-04-27T05:39:42.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:42 smithi189 ceph-mon[32756]: pgmap v22144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:42.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:42 smithi156 ceph-mon[32679]: pgmap v22144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:42.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:42 smithi092 ceph-mon[29156]: pgmap v22144: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:44.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:44 smithi189 ceph-mon[32756]: pgmap v22145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:44.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:44 smithi156 ceph-mon[32679]: pgmap v22145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:44.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:44 smithi092 ceph-mon[29156]: pgmap v22145: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:45.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:45 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40880.119002 secs 2024-04-27T05:39:45.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:45 smithi189 ceph-mon[32756]: 35 slow requests, 1 included below; oldest blocked for > 40183.080423 secs 2024-04-27T05:39:45.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:45 smithi189 ceph-mon[32756]: slow request 2883.184802 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:45.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:45 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40880.119002 secs 2024-04-27T05:39:45.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:45 smithi092 ceph-mon[29156]: 35 slow requests, 1 included below; oldest blocked for > 40183.080423 secs 2024-04-27T05:39:45.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:45 smithi092 ceph-mon[29156]: slow request 2883.184802 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:45.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:45 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40880.119002 secs 2024-04-27T05:39:45.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:45 smithi156 ceph-mon[32679]: 35 slow requests, 1 included below; oldest blocked for > 40183.080423 secs 2024-04-27T05:39:45.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:45 smithi156 ceph-mon[32679]: slow request 2883.184802 seconds old, received at 2024-04-27T04:51:41.041655+0000: client_request(client.17559:1 getattr pAsLsXsFs #0x1 2024-04-27T04:51:41.037668+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:39:46.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:46 smithi189 ceph-mon[32756]: pgmap v22146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:46.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:46 smithi156 ceph-mon[32679]: pgmap v22146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:46.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:46 smithi092 ceph-mon[29156]: pgmap v22146: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:47.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:47 smithi189 ceph-mon[32756]: pgmap v22147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:47.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:47 smithi156 ceph-mon[32679]: pgmap v22147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:47.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:47 smithi092 ceph-mon[29156]: pgmap v22147: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:49.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:49 smithi189 ceph-mon[32756]: pgmap v22148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:49.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40885.119115 secs 2024-04-27T05:39:49.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:49 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40188.080568 secs 2024-04-27T05:39:49.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:49 smithi156 ceph-mon[32679]: pgmap v22148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:49.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40885.119115 secs 2024-04-27T05:39:49.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:49 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40188.080568 secs 2024-04-27T05:39:49.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:49 smithi092 ceph-mon[29156]: pgmap v22148: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:49.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40885.119115 secs 2024-04-27T05:39:49.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:49 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40188.080568 secs 2024-04-27T05:39:51.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:51 smithi189 ceph-mon[32756]: pgmap v22149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:51.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:51 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:39:51.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:51 smithi092 ceph-mon[29156]: pgmap v22149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:51.900 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:51 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:39:51.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:51 smithi156 ceph-mon[32679]: pgmap v22149: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:51.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:51 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:39:53.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:53 smithi189 ceph-mon[32756]: pgmap v22150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:53.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:53 smithi156 ceph-mon[32679]: pgmap v22150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:53.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:53 smithi092 ceph-mon[29156]: pgmap v22150: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:39:54.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40890.119183 secs 2024-04-27T05:39:54.879 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:54 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40193.080633 secs 2024-04-27T05:39:54.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40890.119183 secs 2024-04-27T05:39:54.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:54 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40193.080633 secs 2024-04-27T05:39:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40890.119183 secs 2024-04-27T05:39:54.973 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:54 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40193.080633 secs 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: pgmap v22151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:39:56.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:56 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: pgmap v22151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:39:56.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:56 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: pgmap v22151: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:39:56.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:56 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:39:57.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:57 smithi189 ceph-mon[32756]: pgmap v22152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:39:57.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:57 smithi189 ceph-mon[32756]: pgmap v22153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:39:57.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:57 smithi156 ceph-mon[32679]: pgmap v22152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:39:57.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:57 smithi156 ceph-mon[32679]: pgmap v22153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:39:57.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:57 smithi092 ceph-mon[29156]: pgmap v22152: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:39:57.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:57 smithi092 ceph-mon[29156]: pgmap v22153: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:39:59.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:39:59 smithi189 ceph-mon[32756]: pgmap v22154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:39:59.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:39:59 smithi156 ceph-mon[32679]: pgmap v22154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:39:59.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:39:59 smithi092 ceph-mon[29156]: pgmap v22154: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:40:00.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:00 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40895.119252 secs 2024-04-27T05:40:00.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:00 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40198.080754 secs 2024-04-27T05:40:00.380 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:00 smithi189 ceph-mon[32756]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:40:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:00 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40895.119252 secs 2024-04-27T05:40:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:00 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40198.080754 secs 2024-04-27T05:40:00.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:00 smithi156 ceph-mon[32679]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:40:00.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:00 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40895.119252 secs 2024-04-27T05:40:00.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:00 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40198.080754 secs 2024-04-27T05:40:00.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:00 smithi092 ceph-mon[29156]: overall HEALTH_WARN 8 failed cephadm daemon(s); 2 MDSs report slow requests 2024-04-27T05:40:01.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:01 smithi189 ceph-mon[32756]: pgmap v22155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:01.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:01 smithi156 ceph-mon[32679]: pgmap v22155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:01.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:01 smithi092 ceph-mon[29156]: pgmap v22155: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:02.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:02 smithi189 ceph-mon[32756]: pgmap v22156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:02.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:02 smithi156 ceph-mon[32679]: pgmap v22156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:02.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:02 smithi092 ceph-mon[29156]: pgmap v22156: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:40:04.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:04 smithi189 ceph-mon[32756]: pgmap v22157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:40:04.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:04 smithi156 ceph-mon[32679]: pgmap v22157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:40:04.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:04 smithi092 ceph-mon[29156]: pgmap v22157: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-27T05:40:05.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:05 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40900.119365 secs 2024-04-27T05:40:05.266 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:05 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40203.080876 secs 2024-04-27T05:40:05.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:05 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40900.119365 secs 2024-04-27T05:40:05.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:05 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40203.080876 secs 2024-04-27T05:40:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:05 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40900.119365 secs 2024-04-27T05:40:05.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:05 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40203.080876 secs 2024-04-27T05:40:06.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:06 smithi189 ceph-mon[32756]: pgmap v22158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:40:06.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:06 smithi156 ceph-mon[32679]: pgmap v22158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:40:06.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:06 smithi092 ceph-mon[29156]: pgmap v22158: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:40:08.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:08 smithi189 ceph-mon[32756]: pgmap v22159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:08.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:08 smithi156 ceph-mon[32679]: pgmap v22159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:08.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:08 smithi092 ceph-mon[29156]: pgmap v22159: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:10.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:10 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40905.119475 secs 2024-04-27T05:40:10.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:10 smithi189 ceph-mon[32756]: pgmap v22160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:10.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:10 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40208.080974 secs 2024-04-27T05:40:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:10 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40905.119475 secs 2024-04-27T05:40:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:10 smithi156 ceph-mon[32679]: pgmap v22160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:10.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:10 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40208.080974 secs 2024-04-27T05:40:10.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:10 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40905.119475 secs 2024-04-27T05:40:10.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:10 smithi092 ceph-mon[29156]: pgmap v22160: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:10.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:10 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40208.080974 secs 2024-04-27T05:40:12.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:12 smithi189 ceph-mon[32756]: pgmap v22161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:12.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:12 smithi156 ceph-mon[32679]: pgmap v22161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:12.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:12 smithi092 ceph-mon[29156]: pgmap v22161: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:14.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:14 smithi189 ceph-mon[32756]: pgmap v22162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:14.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:14 smithi156 ceph-mon[32679]: pgmap v22162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:14.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:14 smithi092 ceph-mon[29156]: pgmap v22162: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:15.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:15 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40910.119583 secs 2024-04-27T05:40:15.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:15 smithi189 ceph-mon[32756]: 35 slow requests, 1 included below; oldest blocked for > 40213.081049 secs 2024-04-27T05:40:15.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:15 smithi189 ceph-mon[32756]: slow request 722.623591 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:15.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:15 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40910.119583 secs 2024-04-27T05:40:15.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:15 smithi092 ceph-mon[29156]: 35 slow requests, 1 included below; oldest blocked for > 40213.081049 secs 2024-04-27T05:40:15.386 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:15 smithi092 ceph-mon[29156]: slow request 722.623591 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:15.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:15 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40910.119583 secs 2024-04-27T05:40:15.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:15 smithi156 ceph-mon[32679]: 35 slow requests, 1 included below; oldest blocked for > 40213.081049 secs 2024-04-27T05:40:15.425 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:15 smithi156 ceph-mon[32679]: slow request 722.623591 seconds old, received at 2024-04-27T05:28:11.603492+0000: client_request(client.17601:1 getattr pAsLsXsFs #0x1 2024-04-27T05:28:11.596398+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:16.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:16 smithi189 ceph-mon[32756]: pgmap v22163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:16.424 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:16 smithi156 ceph-mon[32679]: pgmap v22163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:16.485 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:16 smithi092 ceph-mon[29156]: pgmap v22163: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:18.379 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:18 smithi189 ceph-mon[32756]: pgmap v22164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:18.426 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:18 smithi156 ceph-mon[32679]: pgmap v22164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:18.484 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:18 smithi092 ceph-mon[29156]: pgmap v22164: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:19.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40915.119703 secs 2024-04-27T05:40:19.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:19 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40218.081164 secs 2024-04-27T05:40:19.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40915.119703 secs 2024-04-27T05:40:19.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:19 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40218.081164 secs 2024-04-27T05:40:20.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40915.119703 secs 2024-04-27T05:40:20.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:19 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40218.081164 secs 2024-04-27T05:40:20.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:20 smithi156 ceph-mon[32679]: pgmap v22165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:20.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:20 smithi092 ceph-mon[29156]: pgmap v22165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:21.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:20 smithi189 ceph-mon[32756]: pgmap v22165: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:22.926 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:22 smithi156 ceph-mon[32679]: pgmap v22166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:22.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:22 smithi092 ceph-mon[29156]: pgmap v22166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:23.132 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:22 smithi189 ceph-mon[32756]: pgmap v22166: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:24.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:24 smithi156 ceph-mon[32679]: pgmap v22167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:24.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40920.119857 secs 2024-04-27T05:40:24.925 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:24 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40223.081285 secs 2024-04-27T05:40:24.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:24 smithi092 ceph-mon[29156]: pgmap v22167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:24.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40920.119857 secs 2024-04-27T05:40:24.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:24 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40223.081285 secs 2024-04-27T05:40:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:24 smithi189 ceph-mon[32756]: pgmap v22167: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40920.119857 secs 2024-04-27T05:40:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:24 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40223.081285 secs 2024-04-27T05:40:26.924 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:26 smithi156 ceph-mon[32679]: pgmap v22168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:26.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:26 smithi092 ceph-mon[29156]: pgmap v22168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:27.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:26 smithi189 ceph-mon[32756]: pgmap v22168: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:28.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:28 smithi092 ceph-mon[29156]: pgmap v22169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:29.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:28 smithi189 ceph-mon[32756]: pgmap v22169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:29.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:28 smithi156 ceph-mon[32679]: pgmap v22169: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:29.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40925.119959 secs 2024-04-27T05:40:29.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:29 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40228.081388 secs 2024-04-27T05:40:30.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40925.119959 secs 2024-04-27T05:40:30.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:29 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40228.081388 secs 2024-04-27T05:40:30.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40925.119959 secs 2024-04-27T05:40:30.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:29 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40228.081388 secs 2024-04-27T05:40:30.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:30 smithi092 ceph-mon[29156]: pgmap v22170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:31.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:30 smithi189 ceph-mon[32756]: pgmap v22170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:31.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:30 smithi156 ceph-mon[32679]: pgmap v22170: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:32.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:32 smithi092 ceph-mon[29156]: pgmap v22171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:33.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:32 smithi189 ceph-mon[32756]: pgmap v22171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:33.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:32 smithi156 ceph-mon[32679]: pgmap v22171: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:34.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:34 smithi092 ceph-mon[29156]: pgmap v22172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:34.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40930.120080 secs 2024-04-27T05:40:34.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:34 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40233.081459 secs 2024-04-27T05:40:35.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:34 smithi189 ceph-mon[32756]: pgmap v22172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:35.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40930.120080 secs 2024-04-27T05:40:35.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:34 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40233.081459 secs 2024-04-27T05:40:35.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:34 smithi156 ceph-mon[32679]: pgmap v22172: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:35.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40930.120080 secs 2024-04-27T05:40:35.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:34 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40233.081459 secs 2024-04-27T05:40:36.976 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:36 smithi156 ceph-mon[32679]: pgmap v22173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:36.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:36 smithi092 ceph-mon[29156]: pgmap v22173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:37.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:36 smithi189 ceph-mon[32756]: pgmap v22173: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:38.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:38 smithi092 ceph-mon[29156]: pgmap v22174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:39.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:38 smithi189 ceph-mon[32756]: pgmap v22174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:39.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:38 smithi156 ceph-mon[32679]: pgmap v22174: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:39.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40935.120158 secs 2024-04-27T05:40:39.985 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:39 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40238.081604 secs 2024-04-27T05:40:40.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40935.120158 secs 2024-04-27T05:40:40.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:39 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40238.081604 secs 2024-04-27T05:40:40.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40935.120158 secs 2024-04-27T05:40:40.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:39 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40238.081604 secs 2024-04-27T05:40:40.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:40 smithi092 ceph-mon[29156]: pgmap v22175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:41.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:40 smithi189 ceph-mon[32756]: pgmap v22175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:41.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:40 smithi156 ceph-mon[32679]: pgmap v22175: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:42.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:42 smithi092 ceph-mon[29156]: pgmap v22176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:43.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:42 smithi189 ceph-mon[32756]: pgmap v22176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:43.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:42 smithi156 ceph-mon[32679]: pgmap v22176: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:44.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:44 smithi092 ceph-mon[29156]: pgmap v22177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:44.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40940.120280 secs 2024-04-27T05:40:44.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:44 smithi092 ceph-mon[29156]: 35 slow requests, 1 included below; oldest blocked for > 40243.081694 secs 2024-04-27T05:40:44.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:44 smithi092 ceph-mon[29156]: slow request 5764.017100 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:45.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:44 smithi189 ceph-mon[32756]: pgmap v22177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:45.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40940.120280 secs 2024-04-27T05:40:45.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:44 smithi189 ceph-mon[32756]: 35 slow requests, 1 included below; oldest blocked for > 40243.081694 secs 2024-04-27T05:40:45.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:44 smithi189 ceph-mon[32756]: slow request 5764.017100 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:45.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:44 smithi156 ceph-mon[32679]: pgmap v22177: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:45.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40940.120280 secs 2024-04-27T05:40:45.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:44 smithi156 ceph-mon[32679]: 35 slow requests, 1 included below; oldest blocked for > 40243.081694 secs 2024-04-27T05:40:45.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:44 smithi156 ceph-mon[32679]: slow request 5764.017100 seconds old, received at 2024-04-27T04:04:40.210627+0000: client_request(client.17505:1 getattr pAsLsXsFs #0x1 2024-04-27T04:04:40.203029+0000 caller_uid=0, caller_gid=0{}) currently cleaned up request 2024-04-27T05:40:46.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:46 smithi092 ceph-mon[29156]: pgmap v22178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:47.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:46 smithi189 ceph-mon[32756]: pgmap v22178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:47.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:46 smithi156 ceph-mon[32679]: pgmap v22178: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:48.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:48 smithi092 ceph-mon[29156]: pgmap v22179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:49.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:48 smithi189 ceph-mon[32756]: pgmap v22179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:49.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:48 smithi156 ceph-mon[32679]: pgmap v22179: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:49.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40945.120397 secs 2024-04-27T05:40:49.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:49 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40248.081772 secs 2024-04-27T05:40:50.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40945.120397 secs 2024-04-27T05:40:50.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:49 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40248.081772 secs 2024-04-27T05:40:50.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40945.120397 secs 2024-04-27T05:40:50.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:49 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40248.081772 secs 2024-04-27T05:40:50.986 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:50 smithi092 ceph-mon[29156]: pgmap v22180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:51.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:50 smithi189 ceph-mon[32756]: pgmap v22180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:51.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:50 smithi156 ceph-mon[32679]: pgmap v22180: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:52.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:52 smithi092 ceph-mon[29156]: pgmap v22181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:53.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:52 smithi189 ceph-mon[32756]: pgmap v22181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:53.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:52 smithi156 ceph-mon[32679]: pgmap v22181: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:54.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:54 smithi092 ceph-mon[29156]: pgmap v22182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:54.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40950.120537 secs 2024-04-27T05:40:54.984 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:54 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40253.081845 secs 2024-04-27T05:40:55.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:54 smithi189 ceph-mon[32756]: pgmap v22182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:55.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40950.120537 secs 2024-04-27T05:40:55.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:54 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40253.081845 secs 2024-04-27T05:40:55.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:54 smithi156 ceph-mon[32679]: pgmap v22182: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:55.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40950.120537 secs 2024-04-27T05:40:55.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:54 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40253.081845 secs 2024-04-27T05:40:56.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:55 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:40:56.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:55 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:40:56.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:55 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-27T05:40:57.042 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:56 smithi189 ceph-mon[32756]: pgmap v22183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:57.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:56 smithi156 ceph-mon[32679]: pgmap v22183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:57.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:56 smithi092 ceph-mon[29156]: pgmap v22183: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:40:58.958 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:58 smithi189 ceph-mon[32756]: pgmap v22184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:59.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:58 smithi156 ceph-mon[32679]: pgmap v22184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:40:59.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:58 smithi092 ceph-mon[29156]: pgmap v22184: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:00.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:59 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40955.120662 secs 2024-04-27T05:41:00.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:40:59 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40258.081903 secs 2024-04-27T05:41:00.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:59 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40955.120662 secs 2024-04-27T05:41:00.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:40:59 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40258.081903 secs 2024-04-27T05:41:00.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:59 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40955.120662 secs 2024-04-27T05:41:00.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:40:59 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40258.081903 secs 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: pgmap v22185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:41:01.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: pgmap v22186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:41:01.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: pgmap v22187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:01.129 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:00 smithi189 ceph-mon[32756]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: pgmap v22185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: pgmap v22186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:41:01.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: pgmap v22187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:01.175 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:00 smithi156 ceph-mon[32679]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: pgmap v22185: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: pgmap v22186: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-04-27T05:41:01.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: pgmap v22187: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:01.235 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:00 smithi092 ceph-mon[29156]: from='mgr.15111 172.21.15.92:0/3988249731' entity='mgr.x' 2024-04-27T05:41:03.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:02 smithi189 ceph-mon[32756]: pgmap v22188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:03.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:02 smithi156 ceph-mon[32679]: pgmap v22188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:03.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:02 smithi092 ceph-mon[29156]: pgmap v22188: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:05.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:04 smithi189 ceph-mon[32756]: pgmap v22189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:05.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:04 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40960.120809 secs 2024-04-27T05:41:05.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:04 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40263.082012 secs 2024-04-27T05:41:05.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:04 smithi156 ceph-mon[32679]: pgmap v22189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:05.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:04 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40960.120809 secs 2024-04-27T05:41:05.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:04 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40263.082012 secs 2024-04-27T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:04 smithi092 ceph-mon[29156]: pgmap v22189: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:04 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40960.120809 secs 2024-04-27T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:04 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40263.082012 secs 2024-04-27T05:41:07.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:06 smithi189 ceph-mon[32756]: pgmap v22190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:07.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:06 smithi156 ceph-mon[32679]: pgmap v22190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:07.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:06 smithi092 ceph-mon[29156]: pgmap v22190: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-04-27T05:41:09.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:08 smithi189 ceph-mon[32756]: pgmap v22191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:41:09.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:08 smithi156 ceph-mon[32679]: pgmap v22191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:41:09.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:08 smithi092 ceph-mon[29156]: pgmap v22191: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-27T05:41:10.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:09 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40965.120928 secs 2024-04-27T05:41:10.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:09 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40268.082133 secs 2024-04-27T05:41:10.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:09 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40965.120928 secs 2024-04-27T05:41:10.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:09 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40268.082133 secs 2024-04-27T05:41:10.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:09 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40965.120928 secs 2024-04-27T05:41:10.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:09 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40268.082133 secs 2024-04-27T05:41:11.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:10 smithi189 ceph-mon[32756]: pgmap v22192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:41:11.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:10 smithi156 ceph-mon[32679]: pgmap v22192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:41:11.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:10 smithi092 ceph-mon[29156]: pgmap v22192: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-04-27T05:41:13.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:12 smithi189 ceph-mon[32756]: pgmap v22193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:13.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:12 smithi156 ceph-mon[32679]: pgmap v22193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:13.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:12 smithi092 ceph-mon[29156]: pgmap v22193: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:15.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:14 smithi189 ceph-mon[32756]: pgmap v22194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:15.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:14 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40970.121045 secs 2024-04-27T05:41:15.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:14 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40273.082255 secs 2024-04-27T05:41:15.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:14 smithi156 ceph-mon[32679]: pgmap v22194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:15.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:14 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40970.121045 secs 2024-04-27T05:41:15.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:14 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40273.082255 secs 2024-04-27T05:41:15.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:14 smithi092 ceph-mon[29156]: pgmap v22194: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:15.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:14 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40970.121045 secs 2024-04-27T05:41:15.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:14 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40273.082255 secs 2024-04-27T05:41:17.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:16 smithi189 ceph-mon[32756]: pgmap v22195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:17.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:16 smithi156 ceph-mon[32679]: pgmap v22195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:17.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:16 smithi092 ceph-mon[29156]: pgmap v22195: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:19.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:18 smithi189 ceph-mon[32756]: pgmap v22196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:19.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:18 smithi156 ceph-mon[32679]: pgmap v22196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:19.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:18 smithi092 ceph-mon[29156]: pgmap v22196: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:20.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:19 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40975.121171 secs 2024-04-27T05:41:20.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:19 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40278.082374 secs 2024-04-27T05:41:20.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:19 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40975.121171 secs 2024-04-27T05:41:20.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:19 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40278.082374 secs 2024-04-27T05:41:20.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:19 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40975.121171 secs 2024-04-27T05:41:20.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:19 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40278.082374 secs 2024-04-27T05:41:21.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:20 smithi189 ceph-mon[32756]: pgmap v22197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:21.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:20 smithi156 ceph-mon[32679]: pgmap v22197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:21.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:20 smithi092 ceph-mon[29156]: pgmap v22197: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:23.130 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:22 smithi189 ceph-mon[32756]: pgmap v22198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:23.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:22 smithi156 ceph-mon[32679]: pgmap v22198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:23.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:22 smithi092 ceph-mon[29156]: pgmap v22198: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:24 smithi189 ceph-mon[32756]: pgmap v22199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:24 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40980.121286 secs 2024-04-27T05:41:25.128 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:24 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40283.082485 secs 2024-04-27T05:41:25.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:24 smithi156 ceph-mon[32679]: pgmap v22199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:25.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:24 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40980.121286 secs 2024-04-27T05:41:25.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:24 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40283.082485 secs 2024-04-27T05:41:25.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:24 smithi092 ceph-mon[29156]: pgmap v22199: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:25.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:24 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40980.121286 secs 2024-04-27T05:41:25.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:24 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40283.082485 secs 2024-04-27T05:41:27.127 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:26 smithi189 ceph-mon[32756]: pgmap v22200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:27.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:26 smithi156 ceph-mon[32679]: pgmap v22200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:27.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:26 smithi092 ceph-mon[29156]: pgmap v22200: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:29.127 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:28 smithi189 ceph-mon[32756]: pgmap v22201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:29.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:28 smithi156 ceph-mon[32679]: pgmap v22201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:29.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:28 smithi092 ceph-mon[29156]: pgmap v22201: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 3 op/s 2024-04-27T05:41:30.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:29 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40985.121404 secs 2024-04-27T05:41:30.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:29 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40288.082544 secs 2024-04-27T05:41:30.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:29 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40985.121404 secs 2024-04-27T05:41:30.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:29 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40288.082544 secs 2024-04-27T05:41:30.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:29 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40985.121404 secs 2024-04-27T05:41:30.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:29 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40288.082544 secs 2024-04-27T05:41:31.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:30 smithi156 ceph-mon[32679]: pgmap v22202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:31.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:30 smithi092 ceph-mon[29156]: pgmap v22202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:31.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:30 smithi189 ceph-mon[32756]: pgmap v22202: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-27T05:41:33.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:32 smithi156 ceph-mon[32679]: pgmap v22203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:33.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:32 smithi092 ceph-mon[29156]: pgmap v22203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:33.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:32 smithi189 ceph-mon[32756]: pgmap v22203: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:35.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:34 smithi156 ceph-mon[32679]: pgmap v22204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:35.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:34 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40990.121521 secs 2024-04-27T05:41:35.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:34 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40293.082686 secs 2024-04-27T05:41:35.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:34 smithi092 ceph-mon[29156]: pgmap v22204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:35.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:34 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40990.121521 secs 2024-04-27T05:41:35.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:34 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40293.082686 secs 2024-04-27T05:41:35.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:34 smithi189 ceph-mon[32756]: pgmap v22204: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:35.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:34 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40990.121521 secs 2024-04-27T05:41:35.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:34 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40293.082686 secs 2024-04-27T05:41:37.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:36 smithi156 ceph-mon[32679]: pgmap v22205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:37.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:36 smithi092 ceph-mon[29156]: pgmap v22205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:37.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:36 smithi189 ceph-mon[32756]: pgmap v22205: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:39.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:38 smithi156 ceph-mon[32679]: pgmap v22206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:39.180 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:38 smithi189 ceph-mon[32756]: pgmap v22206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:39.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:38 smithi092 ceph-mon[29156]: pgmap v22206: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:40.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:39 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 40995.121654 secs 2024-04-27T05:41:40.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:39 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40298.082804 secs 2024-04-27T05:41:40.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:39 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 40995.121654 secs 2024-04-27T05:41:40.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:39 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40298.082804 secs 2024-04-27T05:41:40.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:39 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 40995.121654 secs 2024-04-27T05:41:40.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:39 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40298.082804 secs 2024-04-27T05:41:41.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:40 smithi156 ceph-mon[32679]: pgmap v22207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:41.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:40 smithi092 ceph-mon[29156]: pgmap v22207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:41.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:40 smithi189 ceph-mon[32756]: pgmap v22207: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:43.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:42 smithi156 ceph-mon[32679]: pgmap v22208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:43.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:42 smithi092 ceph-mon[29156]: pgmap v22208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:43.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:42 smithi189 ceph-mon[32756]: pgmap v22208: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:45.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:44 smithi156 ceph-mon[32679]: pgmap v22209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:45.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:44 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 41000.121790 secs 2024-04-27T05:41:45.174 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:44 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40303.082939 secs 2024-04-27T05:41:45.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:44 smithi092 ceph-mon[29156]: pgmap v22209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:45.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:44 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 41000.121790 secs 2024-04-27T05:41:45.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:44 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40303.082939 secs 2024-04-27T05:41:45.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:44 smithi189 ceph-mon[32756]: pgmap v22209: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:45.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:44 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 41000.121790 secs 2024-04-27T05:41:45.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:44 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40303.082939 secs 2024-04-27T05:41:47.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:46 smithi156 ceph-mon[32679]: pgmap v22210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:47.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:46 smithi092 ceph-mon[29156]: pgmap v22210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:47.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:46 smithi189 ceph-mon[32756]: pgmap v22210: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:49.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:48 smithi156 ceph-mon[32679]: pgmap v22211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:49.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:48 smithi092 ceph-mon[29156]: pgmap v22211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:49.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:48 smithi189 ceph-mon[32756]: pgmap v22211: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:50.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:49 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 41005.121898 secs 2024-04-27T05:41:50.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:49 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40308.083071 secs 2024-04-27T05:41:50.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:49 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 41005.121898 secs 2024-04-27T05:41:50.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:49 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40308.083071 secs 2024-04-27T05:41:50.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:49 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 41005.121898 secs 2024-04-27T05:41:50.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:49 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40308.083071 secs 2024-04-27T05:41:51.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:50 smithi156 ceph-mon[32679]: pgmap v22212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:51.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:50 smithi092 ceph-mon[29156]: pgmap v22212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:51.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:50 smithi189 ceph-mon[32756]: pgmap v22212: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:53.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:52 smithi156 ceph-mon[32679]: pgmap v22213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:53.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:52 smithi092 ceph-mon[29156]: pgmap v22213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:53.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:52 smithi189 ceph-mon[32756]: pgmap v22213: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-04-27T05:41:55.233 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:54 smithi092 ceph-mon[29156]: pgmap v22214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:55.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:54 smithi092 ceph-mon[29156]: 19 slow requests, 0 included below; oldest blocked for > 41010.122009 secs 2024-04-27T05:41:55.234 INFO:journalctl@ceph.mon.a.smithi092.stdout:Apr 27 05:41:54 smithi092 ceph-mon[29156]: 35 slow requests, 0 included below; oldest blocked for > 40313.083205 secs 2024-04-27T05:41:55.377 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:54 smithi189 ceph-mon[32756]: pgmap v22214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:55.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:54 smithi189 ceph-mon[32756]: 19 slow requests, 0 included below; oldest blocked for > 41010.122009 secs 2024-04-27T05:41:55.378 INFO:journalctl@ceph.mon.c.smithi189.stdout:Apr 27 05:41:54 smithi189 ceph-mon[32756]: 35 slow requests, 0 included below; oldest blocked for > 40313.083205 secs 2024-04-27T05:41:55.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:54 smithi156 ceph-mon[32679]: pgmap v22214: 97 pgs: 97 active+clean; 1.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-27T05:41:55.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:54 smithi156 ceph-mon[32679]: 19 slow requests, 0 included below; oldest blocked for > 41010.122009 secs 2024-04-27T05:41:55.423 INFO:journalctl@ceph.mon.b.smithi156.stdout:Apr 27 05:41:54 smithi156 ceph-mon[32679]: 35 slow requests, 0 included below; oldest blocked for > 40313.083205 secs 2024-04-27T05:41:57.006 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-04-27T05:41:57.006 DEBUG:teuthology.task.console_log:Killing console logger for smithi092 2024-04-27T05:41:57.007 DEBUG:teuthology.task.console_log:Killing console logger for smithi156 2024-04-27T05:41:57.007 DEBUG:teuthology.task.console_log:Killing console logger for smithi189 2024-04-27T05:41:57.008 DEBUG:teuthology.exit:Finished running handlers